2023-07-14T10:40:42.448 INFO:root:teuthology version: 0.0.1.dev145+gaa6a80e 2023-07-14T10:40:42.449 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/misc}} --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi/7337410 --verbose --name rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi -- /home/teuthworker/archive/rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi/7337410/orig.config.yaml 2023-07-14T10:40:42.495 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T10:40:42.594 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi/7337410 branch: wip-rishabh-2023Jul13 description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/misc}} email: null first_in_suite: false job_id: '7337410' kernel: client: branch: testing flavor: default kdb: true sha1: a440c79eee0258ae07e4988d8690fe6187b8b7a3 ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 8.stream overrides: admin_socket: branch: wip-rishabh-2023Jul13 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 3fc0089cc1082313a98853d48b892acdc1385b8b ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 3fc0089cc1082313a98853d48b892acdc1385b8b kclient: syntax: v2 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-2023Jul13 sha1: 3fc0089cc1082313a98853d48b892acdc1385b8b owner: scheduled_rishabh@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 sha1: 3fc0089cc1082313a98853d48b892acdc1385b8b sleep_before_teardown: 0 suite: fs suite_branch: wip-rishabh-2023Jul13 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_3fc0089cc1082313a98853d48b892acdc1385b8b/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 3fc0089cc1082313a98853d48b892acdc1385b8b syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi084.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO7BHmxN2RACnOY5AgcD58lLfgn+7XLSowNTataSO5kVQcm72LqT3Lz2KTGN61lhfr7s0pP0EFXaftriSqHRnZY= smithi179.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCqZv/wOGyMgL6b522Br09/irVRGhPzDuWDhH9AXCR6lN0pZbPVpTluqBIsemY44eocmee46S2PdN8yeRAwvsDISyLUNJSal7utXmyWMOylWhGMizNtgPiC1GHRxWjKJ1WHOaGoc1O+4BDTjSLYB2CnGAkqjDCiUKaUm59EIdgU8u7xk1haD/SDuFK72DaCnVKq5x+RsKzM5qnmWO2GPZZUVd/dWvKUnLg7oCmm6NSPVOjHyroQTfQqzwSUdpbH2Fb32dLhxSDDhZBeTvIBii/KqgbRBxP0S7we+prrZASAH+bC0AlV8hfKj5YYDnMlrvgBToyclQ/M7+Y9faYA6Tb1HOtvEmcSP2DgT/pgk83KG4dVuA4UXXEsW+YHL84nM9oi4+cU/PpRTqHz2RrCx86pHI3VL2fK4I/UEP3y/R8Wk/A+GoUkoawYME9NJdKulGeqV+YDmVSHohFHHZfA+kWZRRso6nndIksIoRXIRxvbFlnl3BdYNtydLiImfT+tQXk= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestMisc teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: aa6a80e6cc655fff48452a7eca02070e61d074fc timestamp: 2023-07-14_10:26:42 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23459 2023-07-14T10:40:42.595 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_3fc0089cc1082313a98853d48b892acdc1385b8b/qa; will attempt to use it 2023-07-14T10:40:42.596 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_3fc0089cc1082313a98853d48b892acdc1385b8b/qa/tasks 2023-07-14T10:40:42.596 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-07-14T10:40:42.605 INFO:teuthology.task.internal:Checking packages... 2023-07-14T10:40:42.642 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '3fc0089cc1082313a98853d48b892acdc1385b8b' 2023-07-14T10:40:42.642 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-07-14T10:40:42.643 INFO:teuthology.packaging:ref: None 2023-07-14T10:40:42.644 INFO:teuthology.packaging:tag: None 2023-07-14T10:40:42.644 INFO:teuthology.packaging:branch: wip-rishabh-2023Jul13 2023-07-14T10:40:42.644 INFO:teuthology.packaging:sha1: 3fc0089cc1082313a98853d48b892acdc1385b8b 2023-07-14T10:40:42.645 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-rishabh-2023Jul13 2023-07-14T10:40:42.901 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-4757.g3fc0089c 2023-07-14T10:40:42.901 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-07-14T10:40:42.908 INFO:teuthology.task.internal:no buildpackages task found 2023-07-14T10:40:42.908 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-07-14T10:40:42.929 INFO:teuthology.task.internal:Saving configuration 2023-07-14T10:40:42.948 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-07-14T10:40:42.953 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-14T10:40:42.982 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi084.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi/7337410', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-14 10:27:24.821984', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO7BHmxN2RACnOY5AgcD58lLfgn+7XLSowNTataSO5kVQcm72LqT3Lz2KTGN61lhfr7s0pP0EFXaftriSqHRnZY='} 2023-07-14T10:40:43.003 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi179.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi/7337410', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-14 10:27:24.824311', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBTH2FBeYrDcABu5bGcSRXxyCSU7YUlQ8ACDBSzTnzmr5209E/9SGlNZ0yKcl0khTnW7NwUgiCa38yqJgAmrQLs='} 2023-07-14T10:40:43.004 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-07-14T10:40:43.010 INFO:teuthology.task.internal:roles: ubuntu@smithi084.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-07-14T10:40:43.010 INFO:teuthology.task.internal:roles: ubuntu@smithi179.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-07-14T10:40:43.010 INFO:teuthology.run_tasks:Running task console_log... 2023-07-14T10:40:43.102 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f75ca2b4430>, signals=[15]) 2023-07-14T10:40:43.104 INFO:teuthology.run_tasks:Running task internal.connect... 2023-07-14T10:40:43.114 INFO:teuthology.task.internal:Opening connections... 2023-07-14T10:40:43.115 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi084.front.sepia.ceph.com 2023-07-14T10:40:43.119 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T10:40:43.189 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi179.front.sepia.ceph.com 2023-07-14T10:40:43.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T10:40:43.256 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-07-14T10:40:43.262 DEBUG:teuthology.orchestra.run.smithi084:> uname -m 2023-07-14T10:40:43.284 INFO:teuthology.orchestra.run.smithi084.stdout:x86_64 2023-07-14T10:40:43.285 DEBUG:teuthology.orchestra.run.smithi084:> cat /etc/os-release 2023-07-14T10:40:43.344 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="CentOS Stream" 2023-07-14T10:40:43.344 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="8" 2023-07-14T10:40:43.344 INFO:teuthology.orchestra.run.smithi084.stdout:ID="centos" 2023-07-14T10:40:43.345 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE="rhel fedora" 2023-07-14T10:40:43.345 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="8" 2023-07-14T10:40:43.345 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM_ID="platform:el8" 2023-07-14T10:40:43.345 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-14T10:40:43.345 INFO:teuthology.orchestra.run.smithi084.stdout:ANSI_COLOR="0;31" 2023-07-14T10:40:43.345 INFO:teuthology.orchestra.run.smithi084.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-14T10:40:43.345 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://centos.org/" 2023-07-14T10:40:43.346 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-14T10:40:43.346 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-14T10:40:43.346 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-14T10:40:43.346 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2023-07-14T10:40:43.366 DEBUG:teuthology.orchestra.run.smithi179:> uname -m 2023-07-14T10:40:43.388 INFO:teuthology.orchestra.run.smithi179.stdout:x86_64 2023-07-14T10:40:43.389 DEBUG:teuthology.orchestra.run.smithi179:> cat /etc/os-release 2023-07-14T10:40:43.450 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="CentOS Stream" 2023-07-14T10:40:43.450 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="8" 2023-07-14T10:40:43.450 INFO:teuthology.orchestra.run.smithi179.stdout:ID="centos" 2023-07-14T10:40:43.451 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE="rhel fedora" 2023-07-14T10:40:43.451 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="8" 2023-07-14T10:40:43.451 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM_ID="platform:el8" 2023-07-14T10:40:43.451 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-14T10:40:43.451 INFO:teuthology.orchestra.run.smithi179.stdout:ANSI_COLOR="0;31" 2023-07-14T10:40:43.451 INFO:teuthology.orchestra.run.smithi179.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-14T10:40:43.451 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://centos.org/" 2023-07-14T10:40:43.452 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-14T10:40:43.452 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-14T10:40:43.452 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-14T10:40:43.453 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server 2023-07-14T10:40:43.475 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-07-14T10:40:43.485 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-07-14T10:40:43.490 INFO:teuthology.task.internal:Checking for old test directory... 2023-07-14T10:40:43.491 DEBUG:teuthology.orchestra.run.smithi084:> test '!' -e /home/ubuntu/cephtest 2023-07-14T10:40:43.493 DEBUG:teuthology.orchestra.run.smithi179:> test '!' -e /home/ubuntu/cephtest 2023-07-14T10:40:43.513 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-07-14T10:40:43.521 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-07-14T10:40:43.522 DEBUG:teuthology.orchestra.run.smithi084:> test -z $(ls -A /var/lib/ceph) 2023-07-14T10:40:43.553 DEBUG:teuthology.orchestra.run.smithi179:> test -z $(ls -A /var/lib/ceph) 2023-07-14T10:40:43.599 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-07-14T10:40:43.663 INFO:teuthology.run_tasks:Running task kernel... 2023-07-14T10:40:43.679 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'a440c79eee0258ae07e4988d8690fe6187b8b7a3'} 2023-07-14T10:40:43.680 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2023-07-14T10:40:43.680 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2023-07-14T10:40:43.681 DEBUG:teuthology.orchestra.run.smithi084:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-14T10:40:43.681 DEBUG:teuthology.orchestra.run.smithi179:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-14T10:40:43.699 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-14T10:40:43.700 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2023-07-14T10:40:43.704 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-14T10:40:43.704 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2023-07-14T10:40:43.968 DEBUG:teuthology.task.kernel:sha1 for client.0 is a440c79eee0258ae07e4988d8690fe6187b8b7a3 2023-07-14T10:40:43.968 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "a440c79eee0258ae07e4988d8690fe6187b8b7a3"... 2023-07-14T10:40:43.969 DEBUG:teuthology.orchestra.run.smithi084:> uname -r 2023-07-14T10:40:43.971 DEBUG:teuthology.task.kernel:sha1 for client.1 is a440c79eee0258ae07e4988d8690fe6187b8b7a3 2023-07-14T10:40:43.971 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "a440c79eee0258ae07e4988d8690fe6187b8b7a3"... 2023-07-14T10:40:43.972 DEBUG:teuthology.orchestra.run.smithi179:> uname -r 2023-07-14T10:40:43.992 INFO:teuthology.orchestra.run.smithi084.stdout:4.18.0-489.el8.x86_64 2023-07-14T10:40:43.993 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-489.el8.x86_64 vs a440c79eee0258ae07e4988d8690fe6187b8b7a3 2023-07-14T10:40:43.993 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-07-14T10:40:43.994 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum upgrade -y linux-firmware 2023-07-14T10:40:43.995 INFO:teuthology.orchestra.run.smithi179.stdout:4.18.0-489.el8.x86_64 2023-07-14T10:40:43.995 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-489.el8.x86_64 vs a440c79eee0258ae07e4988d8690fe6187b8b7a3 2023-07-14T10:40:43.995 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-07-14T10:40:43.996 DEBUG:teuthology.orchestra.run.smithi179:> sudo yum upgrade -y linux-firmware 2023-07-14T10:41:15.928 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 8 - AppStream 1.0 MB/s | 31 MB 00:29 2023-07-14T10:41:16.066 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Stream 8 - AppStream 1.0 MB/s | 31 MB 00:29 2023-07-14T10:41:24.501 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 8 - BaseOS 14 MB/s | 41 MB 00:02 2023-07-14T10:41:24.732 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Stream 8 - BaseOS 13 MB/s | 41 MB 00:03 2023-07-14T10:41:31.002 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 8 - Extras 39 kB/s | 18 kB 00:00 2023-07-14T10:41:31.141 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Stream 8 - Extras 42 kB/s | 18 kB 00:00 2023-07-14T10:41:31.477 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 8 - Extras common packages 21 kB/s | 6.6 kB 00:00 2023-07-14T10:41:31.692 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Stream 8 - Extras common packages 17 kB/s | 6.6 kB 00:00 2023-07-14T10:41:31.862 INFO:teuthology.orchestra.run.smithi084.stdout:Copr repo for python3-asyncssh owned by ceph 14 kB/s | 3.5 kB 00:00 2023-07-14T10:41:32.044 INFO:teuthology.orchestra.run.smithi179.stdout:Copr repo for python3-asyncssh owned by ceph 17 kB/s | 3.5 kB 00:00 2023-07-14T10:41:34.746 INFO:teuthology.orchestra.run.smithi084.stdout:Extra Packages for Enterprise Linux 5.7 MB/s | 16 MB 00:02 2023-07-14T10:41:35.261 INFO:teuthology.orchestra.run.smithi179.stdout:Extra Packages for Enterprise Linux 5.1 MB/s | 16 MB 00:03 2023-07-14T10:41:38.512 INFO:teuthology.orchestra.run.smithi084.stdout:lab-extras 355 kB/s | 24 kB 00:00 2023-07-14T10:41:39.044 INFO:teuthology.orchestra.run.smithi179.stdout:lab-extras 376 kB/s | 24 kB 00:00 2023-07-14T10:41:41.935 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2023-07-14T10:41:41.936 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2023-07-14T10:41:41.936 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repo Size 2023-07-14T10:41:41.936 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2023-07-14T10:41:41.936 INFO:teuthology.orchestra.run.smithi084.stdout:Upgrading: 2023-07-14T10:41:41.937 INFO:teuthology.orchestra.run.smithi084.stdout: linux-firmware noarch 20230515-115.gitd1962891.el8 baseos 266 M 2023-07-14T10:41:41.937 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T10:41:41.937 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2023-07-14T10:41:41.937 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2023-07-14T10:41:41.937 INFO:teuthology.orchestra.run.smithi084.stdout:Upgrade 1 Package 2023-07-14T10:41:41.937 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T10:41:41.937 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 266 M 2023-07-14T10:41:41.938 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2023-07-14T10:41:42.493 INFO:teuthology.orchestra.run.smithi179.stdout:Dependencies resolved. 2023-07-14T10:41:42.493 INFO:teuthology.orchestra.run.smithi179.stdout:================================================================================ 2023-07-14T10:41:42.494 INFO:teuthology.orchestra.run.smithi179.stdout: Package Arch Version Repo Size 2023-07-14T10:41:42.494 INFO:teuthology.orchestra.run.smithi179.stdout:================================================================================ 2023-07-14T10:41:42.494 INFO:teuthology.orchestra.run.smithi179.stdout:Upgrading: 2023-07-14T10:41:42.494 INFO:teuthology.orchestra.run.smithi179.stdout: linux-firmware noarch 20230515-115.gitd1962891.el8 baseos 266 M 2023-07-14T10:41:42.494 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-07-14T10:41:42.494 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction Summary 2023-07-14T10:41:42.494 INFO:teuthology.orchestra.run.smithi179.stdout:================================================================================ 2023-07-14T10:41:42.495 INFO:teuthology.orchestra.run.smithi179.stdout:Upgrade 1 Package 2023-07-14T10:41:42.495 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-07-14T10:41:42.495 INFO:teuthology.orchestra.run.smithi179.stdout:Total download size: 266 M 2023-07-14T10:41:42.495 INFO:teuthology.orchestra.run.smithi179.stdout:Downloading Packages: 2023-07-14T10:41:42.713 INFO:teuthology.orchestra.run.smithi179.stdout:[MIRROR] linux-firmware-20230515-115.gitd1962891.el8.noarch.rpm: Status code: 403 for http://distro.ibiblio.org/centos/8-stream/BaseOS/x86_64/os/Packages/linux-firmware-20230515-115.gitd1962891.el8.noarch.rpm (IP: 152.19.134.43) 2023-07-14T10:41:54.904 INFO:teuthology.orchestra.run.smithi179.stdout:linux-firmware-20230515-115.gitd1962891.el8.noa 22 MB/s | 266 MB 00:12 2023-07-14T10:41:54.904 INFO:teuthology.orchestra.run.smithi179.stdout:-------------------------------------------------------------------------------- 2023-07-14T10:41:54.905 INFO:teuthology.orchestra.run.smithi179.stdout:Total 21 MB/s | 266 MB 00:12 2023-07-14T10:41:56.485 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction check 2023-07-14T10:41:56.538 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction check succeeded. 2023-07-14T10:41:56.538 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction test 2023-07-14T10:41:58.224 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction test succeeded. 2023-07-14T10:41:58.263 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction 2023-07-14T10:42:16.190 INFO:teuthology.orchestra.run.smithi179.stdout: Preparing : 1/1 2023-07-14T10:42:16.583 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : linux-firmware-20230515-115.gitd1962891.el8.noarch 1/2 2023-07-14T10:42:16.839 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-07-14T10:42:17.062 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-07-14T10:42:17.062 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : linux-firmware-20230515-115.gitd1962891.el8.noarch 1/2 2023-07-14T10:42:17.761 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-07-14T10:42:17.761 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-07-14T10:42:17.761 INFO:teuthology.orchestra.run.smithi179.stdout:Upgraded: 2023-07-14T10:42:17.761 INFO:teuthology.orchestra.run.smithi179.stdout: linux-firmware-20230515-115.gitd1962891.el8.noarch 2023-07-14T10:42:17.762 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-07-14T10:42:17.762 INFO:teuthology.orchestra.run.smithi179.stdout:Complete! 2023-07-14T10:42:17.952 INFO:teuthology.task.kernel:Downloading kernel a440c79eee0258ae07e4988d8690fe6187b8b7a3 on client.1... 2023-07-14T10:42:17.952 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a440c79eee0258ae07e4988d8690fe6187b8b7a3 2023-07-14T10:42:18.359 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/a440c79eee0258ae07e4988d8690fe6187b8b7a3/centos/8/flavors/default/x86_64/ 2023-07-14T10:42:18.360 DEBUG:teuthology.orchestra.run.smithi179:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.5.0_rc1_ga440c79eee02-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/a440c79eee0258ae07e4988d8690fe6187b8b7a3/centos/8/flavors/default/x86_64/ --input-file=- 2023-07-14T10:42:18.362 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi179.front.sepia.ceph.com to complete... 2023-07-14T10:45:01.959 INFO:teuthology.orchestra.run.smithi084.stdout:linux-firmware-20230515-115.gitd1962891.el8.noa 1.3 MB/s | 266 MB 03:19 2023-07-14T10:45:01.960 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2023-07-14T10:45:01.960 INFO:teuthology.orchestra.run.smithi084.stdout:Total 1.3 MB/s | 266 MB 03:20 2023-07-14T10:45:03.531 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2023-07-14T10:45:03.604 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2023-07-14T10:45:03.605 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2023-07-14T10:45:05.280 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2023-07-14T10:45:05.316 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2023-07-14T10:45:22.993 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2023-07-14T10:45:23.339 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : linux-firmware-20230515-115.gitd1962891.el8.noarch 1/2 2023-07-14T10:45:23.601 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-07-14T10:45:23.837 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-07-14T10:45:23.837 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : linux-firmware-20230515-115.gitd1962891.el8.noarch 1/2 2023-07-14T10:45:24.511 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-07-14T10:45:24.511 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T10:45:24.511 INFO:teuthology.orchestra.run.smithi084.stdout:Upgraded: 2023-07-14T10:45:24.511 INFO:teuthology.orchestra.run.smithi084.stdout: linux-firmware-20230515-115.gitd1962891.el8.noarch 2023-07-14T10:45:24.511 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T10:45:24.511 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2023-07-14T10:45:24.730 INFO:teuthology.task.kernel:Downloading kernel a440c79eee0258ae07e4988d8690fe6187b8b7a3 on client.0... 2023-07-14T10:45:24.731 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a440c79eee0258ae07e4988d8690fe6187b8b7a3 2023-07-14T10:45:25.085 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/a440c79eee0258ae07e4988d8690fe6187b8b7a3/centos/8/flavors/default/x86_64/ 2023-07-14T10:45:25.086 DEBUG:teuthology.orchestra.run.smithi084:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.5.0_rc1_ga440c79eee02-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/a440c79eee0258ae07e4988d8690fe6187b8b7a3/centos/8/flavors/default/x86_64/ --input-file=- 2023-07-14T10:45:25.088 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi084.front.sepia.ceph.com to complete... 2023-07-14T10:48:00.338 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14 10:48:00 URL:https://2.chacra.ceph.com/r/kernel/testing/a440c79eee0258ae07e4988d8690fe6187b8b7a3/centos/8/flavors/default/x86_64/kernel-6.5.0_rc1_ga440c79eee02-1.x86_64.rpm [380684764/380684764] -> "/tmp/kernel.x86_64.rpm" [1] 2023-07-14T10:48:00.338 INFO:teuthology.orchestra.run.smithi179.stderr:FINISHED --2023-07-14 10:48:00-- 2023-07-14T10:48:00.339 INFO:teuthology.orchestra.run.smithi179.stderr:Total wall clock time: 5m 42s 2023-07-14T10:48:00.339 INFO:teuthology.orchestra.run.smithi179.stderr:Downloaded: 1 files, 363M in 5m 41s (1.06 MB/s) 2023-07-14T10:48:00.342 INFO:teuthology.task.kernel:Installing kernel a440c79eee0258ae07e4988d8690fe6187b8b7a3 on client.1... 2023-07-14T10:48:00.342 DEBUG:teuthology.orchestra.run.smithi179:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-07-14T10:48:02.011 INFO:teuthology.orchestra.run.smithi179.stdout:Verifying... ######################################## 2023-07-14T10:48:02.054 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing... ######################################## 2023-07-14T10:48:02.163 INFO:teuthology.orchestra.run.smithi179.stdout:Updating / installing... 2023-07-14T10:48:40.021 INFO:teuthology.orchestra.run.smithi179.stdout:kernel-6.5.0_rc1_ga440c79eee02-1 ######################################## 2023-07-14T10:49:03.595 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi179.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-07-14T10:49:03.595 DEBUG:teuthology.orchestra.run.smithi179:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-07-14T10:49:03.650 INFO:teuthology.orchestra.run.smithi179.stdout:/boot/System.map-6.5.0-rc1-ga440c79eee02 2023-07-14T10:49:03.650 INFO:teuthology.orchestra.run.smithi179.stdout:/boot/config-6.5.0-rc1-ga440c79eee02 2023-07-14T10:49:03.651 INFO:teuthology.orchestra.run.smithi179.stdout:/boot/vmlinuz-6.5.0-rc1-ga440c79eee02 2023-07-14T10:49:03.651 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02 2023-07-14T10:49:03.651 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel 2023-07-14T10:49:03.651 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch 2023-07-14T10:49:03.652 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86 2023-07-14T10:49:03.652 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto 2023-07-14T10:49:03.652 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-07-14T10:49:03.652 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-07-14T10:49:03.653 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-07-14T10:49:03.653 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-07-14T10:49:03.653 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-07-14T10:49:03.653 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-07-14T10:49:03.653 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-07-14T10:49:03.653 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/crc32c-intel.ko 2023-07-14T10:49:03.654 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-07-14T10:49:03.654 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-07-14T10:49:03.654 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-07-14T10:49:03.654 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-07-14T10:49:03.654 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/serpent-avx2.ko 2023-07-14T10:49:03.654 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-07-14T10:49:03.655 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-07-14T10:49:03.655 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-07-14T10:49:03.655 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-07-14T10:49:03.655 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-07-14T10:49:03.655 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-07-14T10:49:03.655 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-07-14T10:49:03.656 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kernel 2023-07-14T10:49:03.656 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kernel/cpu 2023-07-14T10:49:03.656 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kernel/cpu/mce 2023-07-14T10:49:03.656 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-07-14T10:49:03.656 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kvm 2023-07-14T10:49:03.656 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kvm/kvm-amd.ko 2023-07-14T10:49:03.657 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kvm/kvm-intel.ko 2023-07-14T10:49:03.657 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kvm/kvm.ko 2023-07-14T10:49:03.657 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto 2023-07-14T10:49:03.657 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/ansi_cprng.ko 2023-07-14T10:49:03.657 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/anubis.ko 2023-07-14T10:49:03.657 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/arc4.ko 2023-07-14T10:49:03.657 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/async_tx 2023-07-14T10:49:03.658 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/async_tx/async_memcpy.ko 2023-07-14T10:49:03.658 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/async_tx/async_pq.ko 2023-07-14T10:49:03.658 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/async_tx/async_raid6_recov.ko 2023-07-14T10:49:03.658 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/async_tx/async_tx.ko 2023-07-14T10:49:03.658 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/async_tx/async_xor.ko 2023-07-14T10:49:03.659 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/async_tx/raid6test.ko 2023-07-14T10:49:03.659 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/authenc.ko 2023-07-14T10:49:03.659 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/authencesn.ko 2023-07-14T10:49:03.659 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/blake2b_generic.ko 2023-07-14T10:49:03.659 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/blowfish_common.ko 2023-07-14T10:49:03.659 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/blowfish_generic.ko 2023-07-14T10:49:03.660 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/camellia_generic.ko 2023-07-14T10:49:03.660 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/cast5_generic.ko 2023-07-14T10:49:03.660 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/cast6_generic.ko 2023-07-14T10:49:03.660 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/cast_common.ko 2023-07-14T10:49:03.660 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/ccm.ko 2023-07-14T10:49:03.660 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/cmac.ko 2023-07-14T10:49:03.660 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/crc32_generic.ko 2023-07-14T10:49:03.661 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/crypto_engine.ko 2023-07-14T10:49:03.661 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/crypto_user.ko 2023-07-14T10:49:03.661 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/cts.ko 2023-07-14T10:49:03.661 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/des_generic.ko 2023-07-14T10:49:03.661 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/dh_generic.ko 2023-07-14T10:49:03.662 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/echainiv.ko 2023-07-14T10:49:03.662 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/essiv.ko 2023-07-14T10:49:03.662 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/fcrypt.ko 2023-07-14T10:49:03.662 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/khazad.ko 2023-07-14T10:49:03.662 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/lz4.ko 2023-07-14T10:49:03.662 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/lz4hc.ko 2023-07-14T10:49:03.663 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/md4.ko 2023-07-14T10:49:03.663 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/michael_mic.ko 2023-07-14T10:49:03.663 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/pcbc.ko 2023-07-14T10:49:03.663 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/pcrypt.ko 2023-07-14T10:49:03.663 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/rmd160.ko 2023-07-14T10:49:03.663 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/seed.ko 2023-07-14T10:49:03.663 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/serpent_generic.ko 2023-07-14T10:49:03.664 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/tcrypt.ko 2023-07-14T10:49:03.664 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/tea.ko 2023-07-14T10:49:03.664 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/twofish_common.ko 2023-07-14T10:49:03.664 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/twofish_generic.ko 2023-07-14T10:49:03.664 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/vmac.ko 2023-07-14T10:49:03.664 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/wp512.ko 2023-07-14T10:49:03.664 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/xcbc.ko 2023-07-14T10:49:03.665 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/xor.ko 2023-07-14T10:49:03.665 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/xxhash_generic.ko 2023-07-14T10:49:03.665 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers 2023-07-14T10:49:03.665 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi 2023-07-14T10:49:03.665 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/acpi_ipmi.ko 2023-07-14T10:49:03.665 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/acpi_pad.ko 2023-07-14T10:49:03.665 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/custom_method.ko 2023-07-14T10:49:03.665 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/ec_sys.ko 2023-07-14T10:49:03.666 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/platform_profile.ko 2023-07-14T10:49:03.666 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/sbs.ko 2023-07-14T10:49:03.666 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/sbshc.ko 2023-07-14T10:49:03.666 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/video.ko 2023-07-14T10:49:03.666 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata 2023-07-14T10:49:03.666 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/acard-ahci.ko 2023-07-14T10:49:03.666 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/ahci_platform.ko 2023-07-14T10:49:03.666 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/ata_generic.ko 2023-07-14T10:49:03.667 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/libahci_platform.ko 2023-07-14T10:49:03.667 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_acpi.ko 2023-07-14T10:49:03.667 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_ali.ko 2023-07-14T10:49:03.667 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_amd.ko 2023-07-14T10:49:03.667 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_artop.ko 2023-07-14T10:49:03.667 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_atiixp.ko 2023-07-14T10:49:03.667 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_atp867x.ko 2023-07-14T10:49:03.668 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_cmd640.ko 2023-07-14T10:49:03.668 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_cmd64x.ko 2023-07-14T10:49:03.668 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_cypress.ko 2023-07-14T10:49:03.668 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_efar.ko 2023-07-14T10:49:03.668 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_hpt366.ko 2023-07-14T10:49:03.668 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_hpt37x.ko 2023-07-14T10:49:03.668 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_hpt3x2n.ko 2023-07-14T10:49:03.669 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_hpt3x3.ko 2023-07-14T10:49:03.669 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_it8213.ko 2023-07-14T10:49:03.669 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_it821x.ko 2023-07-14T10:49:03.669 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_jmicron.ko 2023-07-14T10:49:03.670 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_marvell.ko 2023-07-14T10:49:03.670 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_mpiix.ko 2023-07-14T10:49:03.670 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_netcell.ko 2023-07-14T10:49:03.670 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_ninja32.ko 2023-07-14T10:49:03.670 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_ns87410.ko 2023-07-14T10:49:03.670 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_ns87415.ko 2023-07-14T10:49:03.671 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_oldpiix.ko 2023-07-14T10:49:03.671 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_opti.ko 2023-07-14T10:49:03.671 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_optidma.ko 2023-07-14T10:49:03.671 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_pcmcia.ko 2023-07-14T10:49:03.671 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_pdc2027x.ko 2023-07-14T10:49:03.671 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-07-14T10:49:03.672 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_piccolo.ko 2023-07-14T10:49:03.672 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_rdc.ko 2023-07-14T10:49:03.672 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_sch.ko 2023-07-14T10:49:03.672 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_serverworks.ko 2023-07-14T10:49:03.672 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_sil680.ko 2023-07-14T10:49:03.673 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_sis.ko 2023-07-14T10:49:03.673 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_sl82c105.ko 2023-07-14T10:49:03.673 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_triflex.ko 2023-07-14T10:49:03.673 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_via.ko 2023-07-14T10:49:03.673 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pdc_adma.ko 2023-07-14T10:49:03.673 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_inic162x.ko 2023-07-14T10:49:03.673 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_mv.ko 2023-07-14T10:49:03.674 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_nv.ko 2023-07-14T10:49:03.674 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_promise.ko 2023-07-14T10:49:03.674 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_qstor.ko 2023-07-14T10:49:03.674 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_sil.ko 2023-07-14T10:49:03.674 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_sil24.ko 2023-07-14T10:49:03.674 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_sis.ko 2023-07-14T10:49:03.674 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_svw.ko 2023-07-14T10:49:03.674 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_sx4.ko 2023-07-14T10:49:03.675 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_uli.ko 2023-07-14T10:49:03.675 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_via.ko 2023-07-14T10:49:03.675 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_vsc.ko 2023-07-14T10:49:03.675 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/auxdisplay 2023-07-14T10:49:03.675 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/auxdisplay/ks0108.ko 2023-07-14T10:49:03.675 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/base 2023-07-14T10:49:03.675 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/base/regmap 2023-07-14T10:49:03.675 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/base/regmap/regmap-i2c.ko 2023-07-14T10:49:03.676 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/base/regmap/regmap-mmio.ko 2023-07-14T10:49:03.676 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/bcma 2023-07-14T10:49:03.676 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/bcma/bcma.ko 2023-07-14T10:49:03.676 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block 2023-07-14T10:49:03.676 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/aoe 2023-07-14T10:49:03.676 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/aoe/aoe.ko 2023-07-14T10:49:03.676 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/brd.ko 2023-07-14T10:49:03.677 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/drbd 2023-07-14T10:49:03.677 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/drbd/drbd.ko 2023-07-14T10:49:03.677 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/floppy.ko 2023-07-14T10:49:03.677 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/loop.ko 2023-07-14T10:49:03.677 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/mtip32xx 2023-07-14T10:49:03.677 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-07-14T10:49:03.677 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/nbd.ko 2023-07-14T10:49:03.678 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/null_blk 2023-07-14T10:49:03.678 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/null_blk/null_blk.ko 2023-07-14T10:49:03.678 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/pktcdvd.ko 2023-07-14T10:49:03.678 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/rbd.ko 2023-07-14T10:49:03.678 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/virtio_blk.ko 2023-07-14T10:49:03.678 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/xen-blkback 2023-07-14T10:49:03.678 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-07-14T10:49:03.679 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/xen-blkfront.ko 2023-07-14T10:49:03.679 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/zram 2023-07-14T10:49:03.679 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/zram/zram.ko 2023-07-14T10:49:03.679 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char 2023-07-14T10:49:03.679 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/hangcheck-timer.ko 2023-07-14T10:49:03.679 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/hw_random 2023-07-14T10:49:03.680 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/hw_random/amd-rng.ko 2023-07-14T10:49:03.680 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/hw_random/intel-rng.ko 2023-07-14T10:49:03.680 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-07-14T10:49:03.680 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/hw_random/via-rng.ko 2023-07-14T10:49:03.680 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/hw_random/virtio-rng.ko 2023-07-14T10:49:03.680 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ipmi 2023-07-14T10:49:03.680 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-07-14T10:49:03.681 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-07-14T10:49:03.681 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-07-14T10:49:03.681 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ipmi/ipmi_si.ko 2023-07-14T10:49:03.681 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-07-14T10:49:03.681 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-07-14T10:49:03.681 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/lp.ko 2023-07-14T10:49:03.681 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/mwave 2023-07-14T10:49:03.681 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/mwave/mwave.ko 2023-07-14T10:49:03.682 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ppdev.ko 2023-07-14T10:49:03.682 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tlclk.ko 2023-07-14T10:49:03.682 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tpm 2023-07-14T10:49:03.682 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tpm/tpm.ko 2023-07-14T10:49:03.682 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tpm/tpm_atmel.ko 2023-07-14T10:49:03.683 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tpm/tpm_infineon.ko 2023-07-14T10:49:03.683 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tpm/tpm_nsc.ko 2023-07-14T10:49:03.683 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tpm/tpm_tis.ko 2023-07-14T10:49:03.683 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-07-14T10:49:03.683 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/uv_mmtimer.ko 2023-07-14T10:49:03.683 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/virtio_console.ko 2023-07-14T10:49:03.684 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/cpufreq 2023-07-14T10:49:03.684 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-07-14T10:49:03.684 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-07-14T10:49:03.684 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/cpufreq/p4-clockmod.ko 2023-07-14T10:49:03.684 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-07-14T10:49:03.684 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/cpufreq/powernow-k8.ko 2023-07-14T10:49:03.684 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/cpufreq/speedstep-lib.ko 2023-07-14T10:49:03.685 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto 2023-07-14T10:49:03.685 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/ccp 2023-07-14T10:49:03.685 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-07-14T10:49:03.685 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/ccp/ccp.ko 2023-07-14T10:49:03.685 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/intel 2023-07-14T10:49:03.685 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/intel/qat 2023-07-14T10:49:03.685 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/intel/qat/qat_common 2023-07-14T10:49:03.685 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-07-14T10:49:03.686 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-07-14T10:49:03.686 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-07-14T10:49:03.686 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/padlock-aes.ko 2023-07-14T10:49:03.686 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/padlock-sha.ko 2023-07-14T10:49:03.686 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/virtio 2023-07-14T10:49:03.686 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-07-14T10:49:03.686 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/dca 2023-07-14T10:49:03.686 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/dca/dca.ko 2023-07-14T10:49:03.687 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/devfreq 2023-07-14T10:49:03.687 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-07-14T10:49:03.687 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/dma 2023-07-14T10:49:03.687 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/dma/dw 2023-07-14T10:49:03.687 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/dma/dw/dw_dmac.ko 2023-07-14T10:49:03.687 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/dma/ioat 2023-07-14T10:49:03.687 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/dma/ioat/ioatdma.ko 2023-07-14T10:49:03.688 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac 2023-07-14T10:49:03.688 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/amd64_edac.ko 2023-07-14T10:49:03.688 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/e752x_edac.ko 2023-07-14T10:49:03.688 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/edac_mce_amd.ko 2023-07-14T10:49:03.688 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/i3000_edac.ko 2023-07-14T10:49:03.688 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/i3200_edac.ko 2023-07-14T10:49:03.689 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/i5100_edac.ko 2023-07-14T10:49:03.689 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/i5400_edac.ko 2023-07-14T10:49:03.689 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/i7300_edac.ko 2023-07-14T10:49:03.689 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/i7core_edac.ko 2023-07-14T10:49:03.689 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/i82975x_edac.ko 2023-07-14T10:49:03.689 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/ie31200_edac.ko 2023-07-14T10:49:03.690 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/sb_edac.ko 2023-07-14T10:49:03.690 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/x38_edac.ko 2023-07-14T10:49:03.690 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/firmware 2023-07-14T10:49:03.690 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/firmware/edd.ko 2023-07-14T10:49:03.690 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/firmware/iscsi_ibft.ko 2023-07-14T10:49:03.690 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio 2023-07-14T10:49:03.690 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/gpio-ich.ko 2023-07-14T10:49:03.691 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/gpio-viperboard.ko 2023-07-14T10:49:03.691 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid 2023-07-14T10:49:03.691 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-appleir.ko 2023-07-14T10:49:03.691 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-aureal.ko 2023-07-14T10:49:03.691 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-axff.ko 2023-07-14T10:49:03.691 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-dr.ko 2023-07-14T10:49:03.691 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-elecom.ko 2023-07-14T10:49:03.692 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-elo.ko 2023-07-14T10:49:03.692 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-emsff.ko 2023-07-14T10:49:03.692 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-gaff.ko 2023-07-14T10:49:03.692 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-gt683r.ko 2023-07-14T10:49:03.692 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-gyration.ko 2023-07-14T10:49:03.692 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-holtek-kbd.ko 2023-07-14T10:49:03.693 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-holtek-mouse.ko 2023-07-14T10:49:03.693 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-holtekff.ko 2023-07-14T10:49:03.693 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-hyperv.ko 2023-07-14T10:49:03.693 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-icade.ko 2023-07-14T10:49:03.693 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-keytouch.ko 2023-07-14T10:49:03.694 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-kye.ko 2023-07-14T10:49:03.694 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-lcpower.ko 2023-07-14T10:49:03.694 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-led.ko 2023-07-14T10:49:03.694 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-lenovo.ko 2023-07-14T10:49:03.694 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-logitech-dj.ko 2023-07-14T10:49:03.694 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-07-14T10:49:03.694 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-multitouch.ko 2023-07-14T10:49:03.694 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-ortek.ko 2023-07-14T10:49:03.695 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-penmount.ko 2023-07-14T10:49:03.695 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-petalynx.ko 2023-07-14T10:49:03.695 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-picolcd.ko 2023-07-14T10:49:03.695 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-pl.ko 2023-07-14T10:49:03.695 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-plantronics.ko 2023-07-14T10:49:03.695 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-primax.ko 2023-07-14T10:49:03.695 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-rmi.ko 2023-07-14T10:49:03.695 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-arvo.ko 2023-07-14T10:49:03.696 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-common.ko 2023-07-14T10:49:03.696 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-isku.ko 2023-07-14T10:49:03.696 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-kone.ko 2023-07-14T10:49:03.696 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-07-14T10:49:03.696 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-konepure.ko 2023-07-14T10:49:03.696 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-07-14T10:49:03.696 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-lua.ko 2023-07-14T10:49:03.697 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-pyra.ko 2023-07-14T10:49:03.697 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-ryos.ko 2023-07-14T10:49:03.697 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-savu.ko 2023-07-14T10:49:03.697 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat.ko 2023-07-14T10:49:03.697 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-saitek.ko 2023-07-14T10:49:03.697 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-samsung.ko 2023-07-14T10:49:03.697 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-sensor-hub.ko 2023-07-14T10:49:03.698 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-sjoy.ko 2023-07-14T10:49:03.698 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-sony.ko 2023-07-14T10:49:03.698 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-speedlink.ko 2023-07-14T10:49:03.698 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-steelseries.ko 2023-07-14T10:49:03.698 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-sunplus.ko 2023-07-14T10:49:03.698 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-thrustmaster.ko 2023-07-14T10:49:03.698 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-tivo.ko 2023-07-14T10:49:03.699 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-tmff.ko 2023-07-14T10:49:03.699 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-topseed.ko 2023-07-14T10:49:03.699 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-twinhan.ko 2023-07-14T10:49:03.699 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-uclogic.ko 2023-07-14T10:49:03.699 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-waltop.ko 2023-07-14T10:49:03.699 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-wiimote.ko 2023-07-14T10:49:03.699 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-xinmo.ko 2023-07-14T10:49:03.700 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-zpff.ko 2023-07-14T10:49:03.700 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-zydacron.ko 2023-07-14T10:49:03.700 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/uhid.ko 2023-07-14T10:49:03.700 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/wacom.ko 2023-07-14T10:49:03.700 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hv 2023-07-14T10:49:03.700 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hv/hv_balloon.ko 2023-07-14T10:49:03.700 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hv/hv_utils.ko 2023-07-14T10:49:03.700 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hv/hv_vmbus.ko 2023-07-14T10:49:03.701 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon 2023-07-14T10:49:03.701 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/abituguru.ko 2023-07-14T10:49:03.701 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/abituguru3.ko 2023-07-14T10:49:03.701 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/acpi_power_meter.ko 2023-07-14T10:49:03.701 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ad7414.ko 2023-07-14T10:49:03.701 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ad7418.ko 2023-07-14T10:49:03.702 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adc128d818.ko 2023-07-14T10:49:03.702 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adm1025.ko 2023-07-14T10:49:03.702 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adm1026.ko 2023-07-14T10:49:03.702 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adm1029.ko 2023-07-14T10:49:03.702 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adm1031.ko 2023-07-14T10:49:03.702 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adm9240.ko 2023-07-14T10:49:03.703 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ads7828.ko 2023-07-14T10:49:03.703 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adt7410.ko 2023-07-14T10:49:03.703 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adt7411.ko 2023-07-14T10:49:03.703 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adt7462.ko 2023-07-14T10:49:03.703 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adt7470.ko 2023-07-14T10:49:03.704 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adt7475.ko 2023-07-14T10:49:03.704 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adt7x10.ko 2023-07-14T10:49:03.704 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/amc6821.ko 2023-07-14T10:49:03.704 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/applesmc.ko 2023-07-14T10:49:03.704 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/asb100.ko 2023-07-14T10:49:03.705 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/asc7621.ko 2023-07-14T10:49:03.705 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/asus_atk0110.ko 2023-07-14T10:49:03.705 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/atxp1.ko 2023-07-14T10:49:03.705 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/coretemp.ko 2023-07-14T10:49:03.705 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-07-14T10:49:03.705 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/dme1737.ko 2023-07-14T10:49:03.706 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ds1621.ko 2023-07-14T10:49:03.706 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ds620.ko 2023-07-14T10:49:03.706 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/emc1403.ko 2023-07-14T10:49:03.706 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/emc6w201.ko 2023-07-14T10:49:03.706 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/f71805f.ko 2023-07-14T10:49:03.707 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/f71882fg.ko 2023-07-14T10:49:03.707 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/f75375s.ko 2023-07-14T10:49:03.707 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/fam15h_power.ko 2023-07-14T10:49:03.707 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/fschmd.ko 2023-07-14T10:49:03.707 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/g760a.ko 2023-07-14T10:49:03.707 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/g762.ko 2023-07-14T10:49:03.707 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/gl518sm.ko 2023-07-14T10:49:03.707 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/gl520sm.ko 2023-07-14T10:49:03.708 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/hwmon-vid.ko 2023-07-14T10:49:03.708 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/i5500_temp.ko 2023-07-14T10:49:03.708 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/i5k_amb.ko 2023-07-14T10:49:03.708 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ibmaem.ko 2023-07-14T10:49:03.708 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ibmpex.ko 2023-07-14T10:49:03.708 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ina209.ko 2023-07-14T10:49:03.709 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ina2xx.ko 2023-07-14T10:49:03.709 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/it87.ko 2023-07-14T10:49:03.709 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/k10temp.ko 2023-07-14T10:49:03.709 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/k8temp.ko 2023-07-14T10:49:03.709 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lineage-pem.ko 2023-07-14T10:49:03.709 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm63.ko 2023-07-14T10:49:03.709 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm73.ko 2023-07-14T10:49:03.709 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm75.ko 2023-07-14T10:49:03.710 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm77.ko 2023-07-14T10:49:03.710 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm78.ko 2023-07-14T10:49:03.710 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm80.ko 2023-07-14T10:49:03.710 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm83.ko 2023-07-14T10:49:03.710 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm85.ko 2023-07-14T10:49:03.711 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm87.ko 2023-07-14T10:49:03.711 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm90.ko 2023-07-14T10:49:03.711 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm92.ko 2023-07-14T10:49:03.711 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm93.ko 2023-07-14T10:49:03.712 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm95234.ko 2023-07-14T10:49:03.712 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm95241.ko 2023-07-14T10:49:03.712 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm95245.ko 2023-07-14T10:49:03.712 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ltc2945.ko 2023-07-14T10:49:03.713 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ltc4151.ko 2023-07-14T10:49:03.713 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ltc4215.ko 2023-07-14T10:49:03.713 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ltc4222.ko 2023-07-14T10:49:03.713 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ltc4245.ko 2023-07-14T10:49:03.714 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ltc4260.ko 2023-07-14T10:49:03.714 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ltc4261.ko 2023-07-14T10:49:03.714 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/max16065.ko 2023-07-14T10:49:03.714 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/max1619.ko 2023-07-14T10:49:03.715 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/max1668.ko 2023-07-14T10:49:03.715 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/max197.ko 2023-07-14T10:49:03.715 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/max6639.ko 2023-07-14T10:49:03.716 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/max6650.ko 2023-07-14T10:49:03.716 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/max6697.ko 2023-07-14T10:49:03.716 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/mcp3021.ko 2023-07-14T10:49:03.716 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/nct6683.ko 2023-07-14T10:49:03.717 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/nct6775-core.ko 2023-07-14T10:49:03.717 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/nct6775.ko 2023-07-14T10:49:03.717 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/nct7802.ko 2023-07-14T10:49:03.718 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pc87360.ko 2023-07-14T10:49:03.718 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pc87427.ko 2023-07-14T10:49:03.718 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pcf8591.ko 2023-07-14T10:49:03.718 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus 2023-07-14T10:49:03.719 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-07-14T10:49:03.719 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-07-14T10:49:03.719 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-07-14T10:49:03.719 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/max16064.ko 2023-07-14T10:49:03.720 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/max34440.ko 2023-07-14T10:49:03.720 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/max8688.ko 2023-07-14T10:49:03.720 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-07-14T10:49:03.720 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-07-14T10:49:03.721 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-07-14T10:49:03.721 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-07-14T10:49:03.721 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-07-14T10:49:03.721 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-07-14T10:49:03.721 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/powr1220.ko 2023-07-14T10:49:03.722 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/sch5627.ko 2023-07-14T10:49:03.722 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/sch5636.ko 2023-07-14T10:49:03.722 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/sch56xx-common.ko 2023-07-14T10:49:03.722 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/sht15.ko 2023-07-14T10:49:03.723 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/sht21.ko 2023-07-14T10:49:03.723 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/shtc1.ko 2023-07-14T10:49:03.723 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/sis5595.ko 2023-07-14T10:49:03.723 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/smsc47b397.ko 2023-07-14T10:49:03.724 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/smsc47m1.ko 2023-07-14T10:49:03.724 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/smsc47m192.ko 2023-07-14T10:49:03.724 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/thmc50.ko 2023-07-14T10:49:03.724 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/tmp102.ko 2023-07-14T10:49:03.725 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/tmp103.ko 2023-07-14T10:49:03.725 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/tmp401.ko 2023-07-14T10:49:03.725 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/tmp421.ko 2023-07-14T10:49:03.725 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/via-cputemp.ko 2023-07-14T10:49:03.726 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/via686a.ko 2023-07-14T10:49:03.726 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/vt1211.ko 2023-07-14T10:49:03.726 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/vt8231.ko 2023-07-14T10:49:03.726 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83627ehf.ko 2023-07-14T10:49:03.727 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83627hf.ko 2023-07-14T10:49:03.727 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83781d.ko 2023-07-14T10:49:03.727 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83791d.ko 2023-07-14T10:49:03.727 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83792d.ko 2023-07-14T10:49:03.728 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83793.ko 2023-07-14T10:49:03.728 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83795.ko 2023-07-14T10:49:03.728 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83l785ts.ko 2023-07-14T10:49:03.729 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83l786ng.ko 2023-07-14T10:49:03.729 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c 2023-07-14T10:49:03.729 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/algos 2023-07-14T10:49:03.729 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-07-14T10:49:03.730 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-07-14T10:49:03.730 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses 2023-07-14T10:49:03.730 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-07-14T10:49:03.730 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-07-14T10:49:03.731 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-07-14T10:49:03.731 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-07-14T10:49:03.731 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-07-14T10:49:03.731 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-07-14T10:49:03.732 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-07-14T10:49:03.732 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-07-14T10:49:03.732 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-i801.ko 2023-07-14T10:49:03.733 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-isch.ko 2023-07-14T10:49:03.733 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-07-14T10:49:03.733 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-07-14T10:49:03.733 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-07-14T10:49:03.734 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-parport.ko 2023-07-14T10:49:03.734 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-07-14T10:49:03.734 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-07-14T10:49:03.735 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-07-14T10:49:03.735 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-07-14T10:49:03.735 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-07-14T10:49:03.735 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-07-14T10:49:03.736 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-via.ko 2023-07-14T10:49:03.736 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-07-14T10:49:03.736 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-07-14T10:49:03.736 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/i2c-dev.ko 2023-07-14T10:49:03.737 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/i2c-mux.ko 2023-07-14T10:49:03.737 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-07-14T10:49:03.737 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/i2c-smbus.ko 2023-07-14T10:49:03.738 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/i2c-stub.ko 2023-07-14T10:49:03.738 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband 2023-07-14T10:49:03.738 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core 2023-07-14T10:49:03.738 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core/ib_cm.ko 2023-07-14T10:49:03.739 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core/ib_core.ko 2023-07-14T10:49:03.739 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core/ib_umad.ko 2023-07-14T10:49:03.739 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-07-14T10:49:03.739 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core/iw_cm.ko 2023-07-14T10:49:03.739 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core/rdma_cm.ko 2023-07-14T10:49:03.739 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-07-14T10:49:03.739 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw 2023-07-14T10:49:03.740 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/cxgb4 2023-07-14T10:49:03.740 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-07-14T10:49:03.740 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/mlx4 2023-07-14T10:49:03.740 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-07-14T10:49:03.740 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/mlx5 2023-07-14T10:49:03.740 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-07-14T10:49:03.740 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/mthca 2023-07-14T10:49:03.741 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-07-14T10:49:03.741 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp 2023-07-14T10:49:03.741 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/ipoib 2023-07-14T10:49:03.741 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-07-14T10:49:03.741 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/iser 2023-07-14T10:49:03.741 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-07-14T10:49:03.741 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/isert 2023-07-14T10:49:03.741 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-07-14T10:49:03.742 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/srp 2023-07-14T10:49:03.742 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-07-14T10:49:03.742 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/srpt 2023-07-14T10:49:03.742 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-07-14T10:49:03.742 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input 2023-07-14T10:49:03.742 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/gameport 2023-07-14T10:49:03.742 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-07-14T10:49:03.743 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/gameport/fm801-gp.ko 2023-07-14T10:49:03.743 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/gameport/gameport.ko 2023-07-14T10:49:03.743 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/gameport/lightning.ko 2023-07-14T10:49:03.743 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/gameport/ns558.ko 2023-07-14T10:49:03.743 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/joydev.ko 2023-07-14T10:49:03.743 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/keyboard 2023-07-14T10:49:03.743 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/keyboard/gpio_keys.ko 2023-07-14T10:49:03.743 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse 2023-07-14T10:49:03.744 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/appletouch.ko 2023-07-14T10:49:03.744 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/bcm5974.ko 2023-07-14T10:49:03.744 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/cyapatp.ko 2023-07-14T10:49:03.744 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/elan_i2c.ko 2023-07-14T10:49:03.744 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/sermouse.ko 2023-07-14T10:49:03.744 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-07-14T10:49:03.744 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/synaptics_usb.ko 2023-07-14T10:49:03.745 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/vsxxxaa.ko 2023-07-14T10:49:03.745 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/rmi4 2023-07-14T10:49:03.745 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/rmi4/rmi_core.ko 2023-07-14T10:49:03.745 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/serio 2023-07-14T10:49:03.745 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/serio/altera_ps2.ko 2023-07-14T10:49:03.745 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/serio/arc_ps2.ko 2023-07-14T10:49:03.746 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-07-14T10:49:03.746 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/serio/serio_raw.ko 2023-07-14T10:49:03.746 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/sparse-keymap.ko 2023-07-14T10:49:03.746 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/iommu 2023-07-14T10:49:03.746 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/iommu/amd 2023-07-14T10:49:03.747 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/iommu/amd/iommu_v2.ko 2023-07-14T10:49:03.747 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds 2023-07-14T10:49:03.747 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-blinkm.ko 2023-07-14T10:49:03.747 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-lm3530.ko 2023-07-14T10:49:03.747 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-lp3944.ko 2023-07-14T10:49:03.747 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-ss4200.ko 2023-07-14T10:49:03.748 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger 2023-07-14T10:49:03.748 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-07-14T10:49:03.748 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-07-14T10:49:03.748 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-07-14T10:49:03.748 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-07-14T10:49:03.748 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-07-14T10:49:03.748 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-07-14T10:49:03.749 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-07-14T10:49:03.749 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-07-14T10:49:03.749 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md 2023-07-14T10:49:03.749 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/bcache 2023-07-14T10:49:03.749 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/bcache/bcache.ko 2023-07-14T10:49:03.749 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-bio-prison.ko 2023-07-14T10:49:03.749 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-cache-smq.ko 2023-07-14T10:49:03.749 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-cache.ko 2023-07-14T10:49:03.750 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-crypt.ko 2023-07-14T10:49:03.750 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-delay.ko 2023-07-14T10:49:03.750 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-flakey.ko 2023-07-14T10:49:03.750 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-log-userspace.ko 2023-07-14T10:49:03.750 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-multipath.ko 2023-07-14T10:49:03.750 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-queue-length.ko 2023-07-14T10:49:03.751 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-raid.ko 2023-07-14T10:49:03.751 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-round-robin.ko 2023-07-14T10:49:03.751 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-service-time.ko 2023-07-14T10:49:03.751 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-switch.ko 2023-07-14T10:49:03.752 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-thin-pool.ko 2023-07-14T10:49:03.752 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-verity.ko 2023-07-14T10:49:03.752 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/faulty.ko 2023-07-14T10:49:03.752 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/linear.ko 2023-07-14T10:49:03.752 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/multipath.ko 2023-07-14T10:49:03.752 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/persistent-data 2023-07-14T10:49:03.753 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-07-14T10:49:03.753 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/raid0.ko 2023-07-14T10:49:03.753 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/raid1.ko 2023-07-14T10:49:03.753 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/raid10.ko 2023-07-14T10:49:03.753 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/raid456.ko 2023-07-14T10:49:03.753 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message 2023-07-14T10:49:03.754 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion 2023-07-14T10:49:03.754 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion/mptbase.ko 2023-07-14T10:49:03.754 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion/mptctl.ko 2023-07-14T10:49:03.754 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion/mptfc.ko 2023-07-14T10:49:03.754 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion/mptlan.ko 2023-07-14T10:49:03.754 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion/mptsas.ko 2023-07-14T10:49:03.755 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion/mptscsih.ko 2023-07-14T10:49:03.755 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion/mptspi.ko 2023-07-14T10:49:03.755 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd 2023-07-14T10:49:03.755 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/lpc_ich.ko 2023-07-14T10:49:03.755 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/lpc_sch.ko 2023-07-14T10:49:03.755 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/mfd-core.ko 2023-07-14T10:49:03.755 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/sm501.ko 2023-07-14T10:49:03.756 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/viperboard.ko 2023-07-14T10:49:03.756 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/vx855.ko 2023-07-14T10:49:03.756 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/wl1273-core.ko 2023-07-14T10:49:03.756 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc 2023-07-14T10:49:03.757 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/altera-stapl 2023-07-14T10:49:03.757 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-07-14T10:49:03.757 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/apds9802als.ko 2023-07-14T10:49:03.757 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/apds990x.ko 2023-07-14T10:49:03.758 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/bh1770glc.ko 2023-07-14T10:49:03.758 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/cb710 2023-07-14T10:49:03.758 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/cb710/cb710.ko 2023-07-14T10:49:03.758 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/eeprom 2023-07-14T10:49:03.758 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/eeprom/at24.ko 2023-07-14T10:49:03.758 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/eeprom/eeprom.ko 2023-07-14T10:49:03.758 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-07-14T10:49:03.759 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/eeprom/max6875.ko 2023-07-14T10:49:03.759 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/enclosure.ko 2023-07-14T10:49:03.759 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/hpilo.ko 2023-07-14T10:49:03.759 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/isl29003.ko 2023-07-14T10:49:03.759 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/isl29020.ko 2023-07-14T10:49:03.759 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/lis3lv02d 2023-07-14T10:49:03.759 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-07-14T10:49:03.760 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-07-14T10:49:03.760 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/mei 2023-07-14T10:49:03.760 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/mei/mei-me.ko 2023-07-14T10:49:03.760 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/mei/mei-txe.ko 2023-07-14T10:49:03.760 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/mei/mei.ko 2023-07-14T10:49:03.760 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/sgi-gru 2023-07-14T10:49:03.760 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/sgi-gru/gru.ko 2023-07-14T10:49:03.761 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/sgi-xp 2023-07-14T10:49:03.761 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/sgi-xp/xp.ko 2023-07-14T10:49:03.761 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/sgi-xp/xpc.ko 2023-07-14T10:49:03.761 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-07-14T10:49:03.761 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/tifm_7xx1.ko 2023-07-14T10:49:03.762 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/tifm_core.ko 2023-07-14T10:49:03.762 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/tsl2550.ko 2023-07-14T10:49:03.762 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/vmw_balloon.ko 2023-07-14T10:49:03.762 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/vmw_vmci 2023-07-14T10:49:03.762 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-07-14T10:49:03.762 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net 2023-07-14T10:49:03.762 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/bonding 2023-07-14T10:49:03.763 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/bonding/bonding.ko 2023-07-14T10:49:03.763 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dsa 2023-07-14T10:49:03.763 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dsa/b53 2023-07-14T10:49:03.763 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dsa/b53/b53_common.ko 2023-07-14T10:49:03.763 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dsa/bcm-sf2.ko 2023-07-14T10:49:03.763 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dsa/mv88e6060.ko 2023-07-14T10:49:03.763 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dsa/mv88e6xxx 2023-07-14T10:49:03.763 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-07-14T10:49:03.764 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dummy.ko 2023-07-14T10:49:03.764 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/eql.ko 2023-07-14T10:49:03.764 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet 2023-07-14T10:49:03.764 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/3com 2023-07-14T10:49:03.764 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-07-14T10:49:03.764 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-07-14T10:49:03.765 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-07-14T10:49:03.765 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-07-14T10:49:03.765 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/8390 2023-07-14T10:49:03.765 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/8390/8390.ko 2023-07-14T10:49:03.765 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-07-14T10:49:03.765 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-07-14T10:49:03.765 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-07-14T10:49:03.765 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/adaptec 2023-07-14T10:49:03.766 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-07-14T10:49:03.766 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/agere 2023-07-14T10:49:03.766 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/agere/et131x.ko 2023-07-14T10:49:03.766 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/alteon 2023-07-14T10:49:03.766 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-07-14T10:49:03.766 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/altera 2023-07-14T10:49:03.767 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-07-14T10:49:03.767 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/amd 2023-07-14T10:49:03.767 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-07-14T10:49:03.767 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-07-14T10:49:03.767 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-07-14T10:49:03.767 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros 2023-07-14T10:49:03.767 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/alx 2023-07-14T10:49:03.768 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-07-14T10:49:03.768 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/atl1c 2023-07-14T10:49:03.768 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-07-14T10:49:03.768 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/atl1e 2023-07-14T10:49:03.768 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-07-14T10:49:03.768 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/atlx 2023-07-14T10:49:03.768 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-07-14T10:49:03.769 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-07-14T10:49:03.769 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom 2023-07-14T10:49:03.769 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-07-14T10:49:03.769 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-07-14T10:49:03.769 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-07-14T10:49:03.769 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-07-14T10:49:03.769 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-07-14T10:49:03.770 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/genet 2023-07-14T10:49:03.770 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-07-14T10:49:03.770 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-07-14T10:49:03.770 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/brocade 2023-07-14T10:49:03.770 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/brocade/bna 2023-07-14T10:49:03.770 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-07-14T10:49:03.770 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio 2023-07-14T10:49:03.770 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb 2023-07-14T10:49:03.771 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-07-14T10:49:03.771 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-07-14T10:49:03.771 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-07-14T10:49:03.771 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-07-14T10:49:03.771 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-07-14T10:49:03.771 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-07-14T10:49:03.771 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-07-14T10:49:03.771 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-07-14T10:49:03.772 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-07-14T10:49:03.772 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/cisco 2023-07-14T10:49:03.772 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/cisco/enic 2023-07-14T10:49:03.772 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-07-14T10:49:03.772 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec 2023-07-14T10:49:03.772 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec/tulip 2023-07-14T10:49:03.772 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-07-14T10:49:03.773 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-07-14T10:49:03.773 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-07-14T10:49:03.773 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-07-14T10:49:03.773 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-07-14T10:49:03.773 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-07-14T10:49:03.773 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dlink 2023-07-14T10:49:03.773 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-07-14T10:49:03.773 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-07-14T10:49:03.774 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dnet.ko 2023-07-14T10:49:03.774 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/emulex 2023-07-14T10:49:03.774 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/emulex/benet 2023-07-14T10:49:03.774 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-07-14T10:49:03.774 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/ethoc.ko 2023-07-14T10:49:03.774 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/fealnx.ko 2023-07-14T10:49:03.774 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel 2023-07-14T10:49:03.775 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/e100.ko 2023-07-14T10:49:03.775 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/e1000 2023-07-14T10:49:03.775 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-07-14T10:49:03.775 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/e1000e 2023-07-14T10:49:03.775 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-07-14T10:49:03.775 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/fm10k 2023-07-14T10:49:03.775 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-07-14T10:49:03.775 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/i40e 2023-07-14T10:49:03.776 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-07-14T10:49:03.776 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/iavf 2023-07-14T10:49:03.776 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-07-14T10:49:03.776 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/igb 2023-07-14T10:49:03.776 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-07-14T10:49:03.776 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/igbvf 2023-07-14T10:49:03.776 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-07-14T10:49:03.777 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/ixgbe 2023-07-14T10:49:03.777 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-07-14T10:49:03.777 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/ixgbevf 2023-07-14T10:49:03.777 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-07-14T10:49:03.777 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/jme.ko 2023-07-14T10:49:03.777 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/marvell 2023-07-14T10:49:03.778 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-07-14T10:49:03.778 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/marvell/skge.ko 2023-07-14T10:49:03.778 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-07-14T10:49:03.778 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/mellanox 2023-07-14T10:49:03.778 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/mellanox/mlx4 2023-07-14T10:49:03.778 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-07-14T10:49:03.778 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-07-14T10:49:03.778 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/mellanox/mlx5 2023-07-14T10:49:03.779 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-07-14T10:49:03.779 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-07-14T10:49:03.779 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/micrel 2023-07-14T10:49:03.779 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-07-14T10:49:03.779 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/myricom 2023-07-14T10:49:03.779 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/myricom/myri10ge 2023-07-14T10:49:03.779 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-07-14T10:49:03.780 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/natsemi 2023-07-14T10:49:03.780 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-07-14T10:49:03.780 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-07-14T10:49:03.780 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/neterion 2023-07-14T10:49:03.780 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-07-14T10:49:03.780 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/nvidia 2023-07-14T10:49:03.780 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-07-14T10:49:03.781 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/packetengines 2023-07-14T10:49:03.781 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-07-14T10:49:03.781 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-07-14T10:49:03.781 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/qlogic 2023-07-14T10:49:03.781 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/qlogic/netxen 2023-07-14T10:49:03.781 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-07-14T10:49:03.781 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-07-14T10:49:03.781 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-07-14T10:49:03.782 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-07-14T10:49:03.782 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/rdc 2023-07-14T10:49:03.782 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-07-14T10:49:03.782 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/realtek 2023-07-14T10:49:03.782 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-07-14T10:49:03.782 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-07-14T10:49:03.782 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/realtek/atp.ko 2023-07-14T10:49:03.782 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-07-14T10:49:03.783 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/rocker 2023-07-14T10:49:03.783 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-07-14T10:49:03.783 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sfc 2023-07-14T10:49:03.783 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-07-14T10:49:03.783 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/silan 2023-07-14T10:49:03.783 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-07-14T10:49:03.783 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sis 2023-07-14T10:49:03.784 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sis/sis190.ko 2023-07-14T10:49:03.784 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sis/sis900.ko 2023-07-14T10:49:03.784 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/smsc 2023-07-14T10:49:03.784 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-07-14T10:49:03.784 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-07-14T10:49:03.784 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-07-14T10:49:03.784 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-07-14T10:49:03.785 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/stmicro 2023-07-14T10:49:03.785 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/stmicro/stmmac 2023-07-14T10:49:03.785 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-07-14T10:49:03.785 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-07-14T10:49:03.785 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sun 2023-07-14T10:49:03.785 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sun/cassini.ko 2023-07-14T10:49:03.785 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sun/niu.ko 2023-07-14T10:49:03.785 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sun/sungem.ko 2023-07-14T10:49:03.786 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-07-14T10:49:03.786 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/tehuti 2023-07-14T10:49:03.786 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-07-14T10:49:03.786 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/ti 2023-07-14T10:49:03.786 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/ti/tlan.ko 2023-07-14T10:49:03.786 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/via 2023-07-14T10:49:03.786 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-07-14T10:49:03.786 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-07-14T10:49:03.787 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/wiznet 2023-07-14T10:49:03.787 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-07-14T10:49:03.787 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-07-14T10:49:03.787 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/xircom 2023-07-14T10:49:03.787 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-07-14T10:49:03.787 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/geneve.ko 2023-07-14T10:49:03.788 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/hyperv 2023-07-14T10:49:03.788 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-07-14T10:49:03.788 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ieee802154 2023-07-14T10:49:03.788 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ieee802154/fakelb.ko 2023-07-14T10:49:03.788 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ifb.ko 2023-07-14T10:49:03.789 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ipvlan 2023-07-14T10:49:03.789 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ipvlan/ipvlan.ko 2023-07-14T10:49:03.789 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/macvlan.ko 2023-07-14T10:49:03.789 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/macvtap.ko 2023-07-14T10:49:03.789 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/mdio 2023-07-14T10:49:03.789 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/mdio.ko 2023-07-14T10:49:03.789 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-07-14T10:49:03.790 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-07-14T10:49:03.790 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/mdio/mdio-regmap.ko 2023-07-14T10:49:03.790 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/mii.ko 2023-07-14T10:49:03.790 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/net_failover.ko 2023-07-14T10:49:03.790 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/netconsole.ko 2023-07-14T10:49:03.790 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/nlmon.ko 2023-07-14T10:49:03.790 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/pcs 2023-07-14T10:49:03.790 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/pcs/pcs-lynx.ko 2023-07-14T10:49:03.791 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-07-14T10:49:03.791 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy 2023-07-14T10:49:03.791 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/amd.ko 2023-07-14T10:49:03.791 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-07-14T10:49:03.791 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-07-14T10:49:03.791 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/bcm7xxx.ko 2023-07-14T10:49:03.791 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/bcm87xx.ko 2023-07-14T10:49:03.792 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/broadcom.ko 2023-07-14T10:49:03.792 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/cicada.ko 2023-07-14T10:49:03.792 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/davicom.ko 2023-07-14T10:49:03.792 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/dp83640.ko 2023-07-14T10:49:03.792 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/et1011c.ko 2023-07-14T10:49:03.792 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/icplus.ko 2023-07-14T10:49:03.792 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/lxt.ko 2023-07-14T10:49:03.793 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/marvell.ko 2023-07-14T10:49:03.793 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/micrel.ko 2023-07-14T10:49:03.793 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/national.ko 2023-07-14T10:49:03.793 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/phylink.ko 2023-07-14T10:49:03.793 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/qsemi.ko 2023-07-14T10:49:03.793 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/realtek.ko 2023-07-14T10:49:03.793 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/smsc.ko 2023-07-14T10:49:03.793 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/ste10Xp.ko 2023-07-14T10:49:03.794 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/vitesse.ko 2023-07-14T10:49:03.794 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp 2023-07-14T10:49:03.794 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/bsd_comp.ko 2023-07-14T10:49:03.794 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/ppp_async.ko 2023-07-14T10:49:03.794 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/ppp_deflate.ko 2023-07-14T10:49:03.794 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/ppp_generic.ko 2023-07-14T10:49:03.794 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/ppp_mppe.ko 2023-07-14T10:49:03.794 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/ppp_synctty.ko 2023-07-14T10:49:03.795 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/pppoe.ko 2023-07-14T10:49:03.795 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/pppox.ko 2023-07-14T10:49:03.795 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/pptp.ko 2023-07-14T10:49:03.795 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/slip 2023-07-14T10:49:03.795 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/slip/slhc.ko 2023-07-14T10:49:03.795 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/slip/slip.ko 2023-07-14T10:49:03.795 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/sungem_phy.ko 2023-07-14T10:49:03.795 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/tap.ko 2023-07-14T10:49:03.796 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/team 2023-07-14T10:49:03.796 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/team/team.ko 2023-07-14T10:49:03.796 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/team/team_mode_activebackup.ko 2023-07-14T10:49:03.796 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/team/team_mode_broadcast.ko 2023-07-14T10:49:03.796 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-07-14T10:49:03.796 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/team/team_mode_random.ko 2023-07-14T10:49:03.796 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-07-14T10:49:03.797 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/tun.ko 2023-07-14T10:49:03.797 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/veth.ko 2023-07-14T10:49:03.797 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/virtio_net.ko 2023-07-14T10:49:03.797 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/vmxnet3 2023-07-14T10:49:03.797 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-07-14T10:49:03.797 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/vxlan 2023-07-14T10:49:03.797 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/vxlan/vxlan.ko 2023-07-14T10:49:03.797 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/xen-netback 2023-07-14T10:49:03.798 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/xen-netback/xen-netback.ko 2023-07-14T10:49:03.798 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/xen-netfront.ko 2023-07-14T10:49:03.798 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ntb 2023-07-14T10:49:03.798 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ntb/ntb.ko 2023-07-14T10:49:03.798 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/nvme 2023-07-14T10:49:03.799 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/nvme/host 2023-07-14T10:49:03.799 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/nvme/host/nvme-core.ko 2023-07-14T10:49:03.799 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/nvme/host/nvme.ko 2023-07-14T10:49:03.799 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/parport 2023-07-14T10:49:03.799 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/parport/parport.ko 2023-07-14T10:49:03.799 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/parport/parport_cs.ko 2023-07-14T10:49:03.800 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/parport/parport_pc.ko 2023-07-14T10:49:03.800 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/parport/parport_serial.ko 2023-07-14T10:49:03.800 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pci 2023-07-14T10:49:03.800 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pci/hotplug 2023-07-14T10:49:03.800 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-07-14T10:49:03.800 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pci/pcie 2023-07-14T10:49:03.800 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pci/pcie/aer_inject.ko 2023-07-14T10:49:03.801 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pci/xen-pcifront.ko 2023-07-14T10:49:03.801 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pcmcia 2023-07-14T10:49:03.801 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pcmcia/i82092.ko 2023-07-14T10:49:03.801 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pcmcia/pd6729.ko 2023-07-14T10:49:03.801 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pcmcia/yenta_socket.ko 2023-07-14T10:49:03.801 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pinctrl 2023-07-14T10:49:03.802 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pinctrl/intel 2023-07-14T10:49:03.802 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-07-14T10:49:03.802 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform 2023-07-14T10:49:03.802 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86 2023-07-14T10:49:03.802 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/acer-wmi.ko 2023-07-14T10:49:03.802 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/acerhdf.ko 2023-07-14T10:49:03.802 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/apple-gmux.ko 2023-07-14T10:49:03.802 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/asus-laptop.ko 2023-07-14T10:49:03.803 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-07-14T10:49:03.803 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/asus-wmi.ko 2023-07-14T10:49:03.803 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/classmate-laptop.ko 2023-07-14T10:49:03.803 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-07-14T10:49:03.804 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-07-14T10:49:03.804 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-07-14T10:49:03.804 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-07-14T10:49:03.805 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/hdaps.ko 2023-07-14T10:49:03.805 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/intel 2023-07-14T10:49:03.805 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-07-14T10:49:03.805 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/intel_ips.ko 2023-07-14T10:49:03.806 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/msi-wmi.ko 2023-07-14T10:49:03.806 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/mxm-wmi.ko 2023-07-14T10:49:03.806 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-07-14T10:49:03.806 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/samsung-laptop.ko 2023-07-14T10:49:03.807 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/samsung-q10.ko 2023-07-14T10:49:03.807 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/topstar-laptop.ko 2023-07-14T10:49:03.807 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-07-14T10:49:03.808 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/toshiba_haps.ko 2023-07-14T10:49:03.808 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/wmi-bmof.ko 2023-07-14T10:49:03.808 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/wmi.ko 2023-07-14T10:49:03.808 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/powercap 2023-07-14T10:49:03.808 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/powercap/intel_rapl_common.ko 2023-07-14T10:49:03.809 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/powercap/intel_rapl_msr.ko 2023-07-14T10:49:03.809 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pps 2023-07-14T10:49:03.809 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pps/clients 2023-07-14T10:49:03.809 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pps/clients/pps-gpio.ko 2023-07-14T10:49:03.810 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pps/clients/pps-ldisc.ko 2023-07-14T10:49:03.810 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pps/clients/pps_parport.ko 2023-07-14T10:49:03.810 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pps/pps_core.ko 2023-07-14T10:49:03.810 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ptp 2023-07-14T10:49:03.810 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ptp/ptp.ko 2023-07-14T10:49:03.811 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ptp/ptp_kvm.ko 2023-07-14T10:49:03.811 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc 2023-07-14T10:49:03.811 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-bq32k.ko 2023-07-14T10:49:03.811 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-bq4802.ko 2023-07-14T10:49:03.812 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds1286.ko 2023-07-14T10:49:03.812 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds1307.ko 2023-07-14T10:49:03.812 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds1374.ko 2023-07-14T10:49:03.812 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds1511.ko 2023-07-14T10:49:03.812 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds1553.ko 2023-07-14T10:49:03.813 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds1672.ko 2023-07-14T10:49:03.813 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds1742.ko 2023-07-14T10:49:03.813 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds2404.ko 2023-07-14T10:49:03.813 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds3232.ko 2023-07-14T10:49:03.814 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-em3027.ko 2023-07-14T10:49:03.814 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-fm3130.ko 2023-07-14T10:49:03.814 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-isl12022.ko 2023-07-14T10:49:03.814 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-isl1208.ko 2023-07-14T10:49:03.814 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-m41t80.ko 2023-07-14T10:49:03.815 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-m48t35.ko 2023-07-14T10:49:03.815 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-m48t59.ko 2023-07-14T10:49:03.815 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-max6900.ko 2023-07-14T10:49:03.815 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-msm6242.ko 2023-07-14T10:49:03.815 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-pcf2127.ko 2023-07-14T10:49:03.816 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-pcf85063.ko 2023-07-14T10:49:03.816 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-pcf8523.ko 2023-07-14T10:49:03.816 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-pcf8563.ko 2023-07-14T10:49:03.816 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-pcf8583.ko 2023-07-14T10:49:03.817 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-rp5c01.ko 2023-07-14T10:49:03.817 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-rs5c372.ko 2023-07-14T10:49:03.817 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-07-14T10:49:03.817 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-rx8025.ko 2023-07-14T10:49:03.817 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-rx8581.ko 2023-07-14T10:49:03.818 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-07-14T10:49:03.818 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-x1205.ko 2023-07-14T10:49:03.818 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi 2023-07-14T10:49:03.818 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/3w-9xxx.ko 2023-07-14T10:49:03.818 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/3w-sas.ko 2023-07-14T10:49:03.819 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/3w-xxxx.ko 2023-07-14T10:49:03.819 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/BusLogic.ko 2023-07-14T10:49:03.819 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/a100u2w.ko 2023-07-14T10:49:03.819 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/aacraid 2023-07-14T10:49:03.820 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/aacraid/aacraid.ko 2023-07-14T10:49:03.820 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/advansys.ko 2023-07-14T10:49:03.820 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/aic7xxx 2023-07-14T10:49:03.820 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-07-14T10:49:03.821 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-07-14T10:49:03.821 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/am53c974.ko 2023-07-14T10:49:03.821 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/arcmsr 2023-07-14T10:49:03.821 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-07-14T10:49:03.821 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/atp870u.ko 2023-07-14T10:49:03.822 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/be2iscsi 2023-07-14T10:49:03.822 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-07-14T10:49:03.822 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/bfa 2023-07-14T10:49:03.822 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/bfa/bfa.ko 2023-07-14T10:49:03.822 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/bnx2fc 2023-07-14T10:49:03.823 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-07-14T10:49:03.823 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/bnx2i 2023-07-14T10:49:03.823 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-07-14T10:49:03.823 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/ch.ko 2023-07-14T10:49:03.824 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/csiostor 2023-07-14T10:49:03.824 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/csiostor/csiostor.ko 2023-07-14T10:49:03.824 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/cxgbi 2023-07-14T10:49:03.824 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/cxgbi/cxgb3i 2023-07-14T10:49:03.824 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-07-14T10:49:03.825 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/cxgbi/cxgb4i 2023-07-14T10:49:03.825 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-07-14T10:49:03.825 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-07-14T10:49:03.825 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/dc395x.ko 2023-07-14T10:49:03.825 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/device_handler 2023-07-14T10:49:03.826 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-07-14T10:49:03.826 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-07-14T10:49:03.826 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-07-14T10:49:03.826 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-07-14T10:49:03.826 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/dmx3191d.ko 2023-07-14T10:49:03.827 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/esas2r 2023-07-14T10:49:03.827 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/esas2r/esas2r.ko 2023-07-14T10:49:03.827 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/esp_scsi.ko 2023-07-14T10:49:03.827 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/fcoe 2023-07-14T10:49:03.827 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/fcoe/fcoe.ko 2023-07-14T10:49:03.828 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-07-14T10:49:03.828 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/fnic 2023-07-14T10:49:03.828 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/fnic/fnic.ko 2023-07-14T10:49:03.828 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/hpsa.ko 2023-07-14T10:49:03.829 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/hptiop.ko 2023-07-14T10:49:03.829 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/hv_storvsc.ko 2023-07-14T10:49:03.829 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/initio.ko 2023-07-14T10:49:03.829 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/ipr.ko 2023-07-14T10:49:03.829 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/ips.ko 2023-07-14T10:49:03.830 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/isci 2023-07-14T10:49:03.830 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/isci/isci.ko 2023-07-14T10:49:03.830 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-07-14T10:49:03.830 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/iscsi_tcp.ko 2023-07-14T10:49:03.831 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/libfc 2023-07-14T10:49:03.831 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/libfc/libfc.ko 2023-07-14T10:49:03.831 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/libiscsi.ko 2023-07-14T10:49:03.831 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/libiscsi_tcp.ko 2023-07-14T10:49:03.831 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/libsas 2023-07-14T10:49:03.832 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/libsas/libsas.ko 2023-07-14T10:49:03.832 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/lpfc 2023-07-14T10:49:03.832 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/lpfc/lpfc.ko 2023-07-14T10:49:03.832 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/megaraid 2023-07-14T10:49:03.832 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/megaraid.ko 2023-07-14T10:49:03.833 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-07-14T10:49:03.833 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-07-14T10:49:03.833 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-07-14T10:49:03.833 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/mpt3sas 2023-07-14T10:49:03.834 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-07-14T10:49:03.834 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/mvsas 2023-07-14T10:49:03.834 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/mvsas/mvsas.ko 2023-07-14T10:49:03.834 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/mvumi.ko 2023-07-14T10:49:03.834 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/pm8001 2023-07-14T10:49:03.835 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-07-14T10:49:03.835 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/pmcraid.ko 2023-07-14T10:49:03.835 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/qla1280.ko 2023-07-14T10:49:03.835 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/qla2xxx 2023-07-14T10:49:03.835 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-07-14T10:49:03.836 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-07-14T10:49:03.836 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/qla4xxx 2023-07-14T10:49:03.836 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-07-14T10:49:03.836 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/raid_class.ko 2023-07-14T10:49:03.837 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/scsi_debug.ko 2023-07-14T10:49:03.837 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/scsi_transport_fc.ko 2023-07-14T10:49:03.837 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-07-14T10:49:03.837 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/scsi_transport_sas.ko 2023-07-14T10:49:03.837 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/scsi_transport_spi.ko 2023-07-14T10:49:03.837 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/scsi_transport_srp.ko 2023-07-14T10:49:03.837 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/ses.ko 2023-07-14T10:49:03.838 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/st.ko 2023-07-14T10:49:03.838 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/stex.ko 2023-07-14T10:49:03.838 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/sym53c8xx_2 2023-07-14T10:49:03.838 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-07-14T10:49:03.838 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/virtio_scsi.ko 2023-07-14T10:49:03.838 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/vmw_pvscsi.ko 2023-07-14T10:49:03.838 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/wd719x.ko 2023-07-14T10:49:03.838 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ssb 2023-07-14T10:49:03.839 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ssb/ssb.ko 2023-07-14T10:49:03.839 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target 2023-07-14T10:49:03.839 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/iscsi 2023-07-14T10:49:03.839 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-07-14T10:49:03.839 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/loopback 2023-07-14T10:49:03.839 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/loopback/tcm_loop.ko 2023-07-14T10:49:03.840 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/target_core_file.ko 2023-07-14T10:49:03.840 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/target_core_iblock.ko 2023-07-14T10:49:03.840 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/target_core_mod.ko 2023-07-14T10:49:03.840 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/target_core_pscsi.ko 2023-07-14T10:49:03.841 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/target_core_user.ko 2023-07-14T10:49:03.841 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/tcm_fc 2023-07-14T10:49:03.841 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-07-14T10:49:03.841 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal 2023-07-14T10:49:03.841 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel 2023-07-14T10:49:03.841 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal 2023-07-14T10:49:03.841 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-07-14T10:49:03.841 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-07-14T10:49:03.842 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-07-14T10:49:03.842 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-07-14T10:49:03.842 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-07-14T10:49:03.842 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-07-14T10:49:03.842 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-07-14T10:49:03.842 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-07-14T10:49:03.842 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-07-14T10:49:03.842 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-07-14T10:49:03.843 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-07-14T10:49:03.843 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-07-14T10:49:03.843 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-07-14T10:49:03.843 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-07-14T10:49:03.843 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-07-14T10:49:03.843 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty 2023-07-14T10:49:03.843 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/ipwireless 2023-07-14T10:49:03.844 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-07-14T10:49:03.844 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/n_gsm.ko 2023-07-14T10:49:03.844 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/n_hdlc.ko 2023-07-14T10:49:03.844 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/nozomi.ko 2023-07-14T10:49:03.844 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/serial 2023-07-14T10:49:03.844 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/serial/8250 2023-07-14T10:49:03.844 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-07-14T10:49:03.845 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/serial/arc_uart.ko 2023-07-14T10:49:03.845 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/serial/jsm 2023-07-14T10:49:03.845 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/serial/jsm/jsm.ko 2023-07-14T10:49:03.845 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/synclink_gt.ko 2023-07-14T10:49:03.845 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ufs 2023-07-14T10:49:03.845 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ufs/core 2023-07-14T10:49:03.845 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ufs/core/ufshcd-core.ko 2023-07-14T10:49:03.845 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ufs/host 2023-07-14T10:49:03.846 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-07-14T10:49:03.846 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/uio 2023-07-14T10:49:03.846 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/uio/uio.ko 2023-07-14T10:49:03.846 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/uio/uio_aec.ko 2023-07-14T10:49:03.846 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/uio/uio_cif.ko 2023-07-14T10:49:03.846 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/uio/uio_pci_generic.ko 2023-07-14T10:49:03.846 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/uio/uio_sercos3.ko 2023-07-14T10:49:03.847 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb 2023-07-14T10:49:03.847 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/class 2023-07-14T10:49:03.847 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/class/cdc-acm.ko 2023-07-14T10:49:03.847 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/class/cdc-wdm.ko 2023-07-14T10:49:03.848 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/class/usblp.ko 2023-07-14T10:49:03.848 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/class/usbtmc.ko 2023-07-14T10:49:03.848 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/host 2023-07-14T10:49:03.848 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/host/sl811-hcd.ko 2023-07-14T10:49:03.849 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/image 2023-07-14T10:49:03.849 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/image/mdc800.ko 2023-07-14T10:49:03.849 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/image/microtek.ko 2023-07-14T10:49:03.849 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc 2023-07-14T10:49:03.849 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/adutux.ko 2023-07-14T10:49:03.849 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/appledisplay.ko 2023-07-14T10:49:03.849 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/emi26.ko 2023-07-14T10:49:03.850 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/emi62.ko 2023-07-14T10:49:03.850 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/ezusb.ko 2023-07-14T10:49:03.850 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/idmouse.ko 2023-07-14T10:49:03.850 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/iowarrior.ko 2023-07-14T10:49:03.850 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/isight_firmware.ko 2023-07-14T10:49:03.850 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/ldusb.ko 2023-07-14T10:49:03.850 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/legousbtower.ko 2023-07-14T10:49:03.850 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/sisusbvga 2023-07-14T10:49:03.851 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-07-14T10:49:03.851 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/trancevibrator.ko 2023-07-14T10:49:03.851 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/usb3503.ko 2023-07-14T10:49:03.851 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/usblcd.ko 2023-07-14T10:49:03.851 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/usbsevseg.ko 2023-07-14T10:49:03.851 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/uss720.ko 2023-07-14T10:49:03.851 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/yurex.ko 2023-07-14T10:49:03.851 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/phy 2023-07-14T10:49:03.852 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/phy/phy-generic.ko 2023-07-14T10:49:03.852 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial 2023-07-14T10:49:03.852 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/aircable.ko 2023-07-14T10:49:03.852 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ark3116.ko 2023-07-14T10:49:03.852 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/belkin_sa.ko 2023-07-14T10:49:03.852 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ch341.ko 2023-07-14T10:49:03.852 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/cp210x.ko 2023-07-14T10:49:03.853 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/cyberjack.ko 2023-07-14T10:49:03.853 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/cypress_m8.ko 2023-07-14T10:49:03.853 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/digi_acceleport.ko 2023-07-14T10:49:03.853 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/empeg.ko 2023-07-14T10:49:03.853 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ftdi_sio.ko 2023-07-14T10:49:03.853 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/garmin_gps.ko 2023-07-14T10:49:03.853 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/io_edgeport.ko 2023-07-14T10:49:03.853 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/io_ti.ko 2023-07-14T10:49:03.854 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ipaq.ko 2023-07-14T10:49:03.854 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ipw.ko 2023-07-14T10:49:03.854 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ir-usb.ko 2023-07-14T10:49:03.854 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-07-14T10:49:03.854 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/keyspan.ko 2023-07-14T10:49:03.854 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/keyspan_pda.ko 2023-07-14T10:49:03.854 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/kl5kusb105.ko 2023-07-14T10:49:03.854 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/kobil_sct.ko 2023-07-14T10:49:03.855 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/mct_u232.ko 2023-07-14T10:49:03.855 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/mos7720.ko 2023-07-14T10:49:03.855 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/mos7840.ko 2023-07-14T10:49:03.855 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/navman.ko 2023-07-14T10:49:03.855 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/omninet.ko 2023-07-14T10:49:03.855 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/opticon.ko 2023-07-14T10:49:03.855 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/option.ko 2023-07-14T10:49:03.855 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/oti6858.ko 2023-07-14T10:49:03.856 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/pl2303.ko 2023-07-14T10:49:03.856 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/qcaux.ko 2023-07-14T10:49:03.856 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/qcserial.ko 2023-07-14T10:49:03.856 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/quatech2.ko 2023-07-14T10:49:03.856 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/safe_serial.ko 2023-07-14T10:49:03.856 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/sierra.ko 2023-07-14T10:49:03.856 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/spcp8x5.ko 2023-07-14T10:49:03.856 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ssu100.ko 2023-07-14T10:49:03.857 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/symbolserial.ko 2023-07-14T10:49:03.857 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-07-14T10:49:03.857 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-07-14T10:49:03.857 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/usb_debug.ko 2023-07-14T10:49:03.857 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/usb_wwan.ko 2023-07-14T10:49:03.857 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/visor.ko 2023-07-14T10:49:03.857 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/whiteheat.ko 2023-07-14T10:49:03.858 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/xsens_mt.ko 2023-07-14T10:49:03.858 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage 2023-07-14T10:49:03.858 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/uas.ko 2023-07-14T10:49:03.858 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-alauda.ko 2023-07-14T10:49:03.858 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-cypress.ko 2023-07-14T10:49:03.858 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-datafab.ko 2023-07-14T10:49:03.858 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-07-14T10:49:03.858 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-freecom.ko 2023-07-14T10:49:03.859 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-isd200.ko 2023-07-14T10:49:03.859 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-07-14T10:49:03.859 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-karma.ko 2023-07-14T10:49:03.859 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-onetouch.ko 2023-07-14T10:49:03.859 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-realtek.ko 2023-07-14T10:49:03.859 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-sddr09.ko 2023-07-14T10:49:03.859 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-sddr55.ko 2023-07-14T10:49:03.859 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-usbat.ko 2023-07-14T10:49:03.860 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/usb-storage.ko 2023-07-14T10:49:03.860 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/usbip 2023-07-14T10:49:03.860 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/usbip/usbip-core.ko 2023-07-14T10:49:03.860 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/usbip/usbip-host.ko 2023-07-14T10:49:03.860 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-07-14T10:49:03.860 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vfio 2023-07-14T10:49:03.860 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vfio/pci 2023-07-14T10:49:03.861 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-07-14T10:49:03.861 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vfio/pci/vfio-pci.ko 2023-07-14T10:49:03.861 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vfio/vfio.ko 2023-07-14T10:49:03.861 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-07-14T10:49:03.861 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vhost 2023-07-14T10:49:03.861 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vhost/vhost.ko 2023-07-14T10:49:03.861 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vhost/vhost_iotlb.ko 2023-07-14T10:49:03.862 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vhost/vhost_net.ko 2023-07-14T10:49:03.862 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vhost/vhost_scsi.ko 2023-07-14T10:49:03.862 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video 2023-07-14T10:49:03.862 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight 2023-07-14T10:49:03.862 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight/apple_bl.ko 2023-07-14T10:49:03.862 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight/lcd.ko 2023-07-14T10:49:03.862 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight/platform_lcd.ko 2023-07-14T10:49:03.862 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/virtio 2023-07-14T10:49:03.863 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/virtio/virtio.ko 2023-07-14T10:49:03.863 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/virtio/virtio_balloon.ko 2023-07-14T10:49:03.863 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/virtio/virtio_mmio.ko 2023-07-14T10:49:03.863 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/virtio/virtio_pci.ko 2023-07-14T10:49:03.863 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-07-14T10:49:03.863 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-07-14T10:49:03.863 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/virtio/virtio_ring.ko 2023-07-14T10:49:03.863 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1 2023-07-14T10:49:03.864 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/masters 2023-07-14T10:49:03.864 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/masters/ds2482.ko 2023-07-14T10:49:03.864 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/masters/ds2490.ko 2023-07-14T10:49:03.864 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves 2023-07-14T10:49:03.864 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-07-14T10:49:03.864 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-07-14T10:49:03.864 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-07-14T10:49:03.864 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-07-14T10:49:03.865 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-07-14T10:49:03.865 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-07-14T10:49:03.865 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-07-14T10:49:03.865 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-07-14T10:49:03.865 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-07-14T10:49:03.865 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_smem.ko 2023-07-14T10:49:03.865 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_therm.ko 2023-07-14T10:49:03.866 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/wire.ko 2023-07-14T10:49:03.866 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog 2023-07-14T10:49:03.866 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/alim1535_wdt.ko 2023-07-14T10:49:03.866 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/alim7101_wdt.ko 2023-07-14T10:49:03.866 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/f71808e_wdt.ko 2023-07-14T10:49:03.866 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/hpwdt.ko 2023-07-14T10:49:03.866 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/i6300esb.ko 2023-07-14T10:49:03.866 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-07-14T10:49:03.867 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/iTCO_wdt.ko 2023-07-14T10:49:03.867 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/ib700wdt.ko 2023-07-14T10:49:03.867 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/ibmasr.ko 2023-07-14T10:49:03.867 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-07-14T10:49:03.867 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/it8712f_wdt.ko 2023-07-14T10:49:03.867 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/it87_wdt.ko 2023-07-14T10:49:03.867 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/machzwd.ko 2023-07-14T10:49:03.867 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/nv_tco.ko 2023-07-14T10:49:03.868 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/pcwd_pci.ko 2023-07-14T10:49:03.868 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/pcwd_usb.ko 2023-07-14T10:49:03.868 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-07-14T10:49:03.868 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/sch311x_wdt.ko 2023-07-14T10:49:03.868 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/softdog.ko 2023-07-14T10:49:03.868 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/sp5100_tco.ko 2023-07-14T10:49:03.868 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/via_wdt.ko 2023-07-14T10:49:03.868 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-07-14T10:49:03.869 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/w83877f_wdt.ko 2023-07-14T10:49:03.869 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/w83977f_wdt.ko 2023-07-14T10:49:03.869 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/wdt_pci.ko 2023-07-14T10:49:03.869 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/xen_wdt.ko 2023-07-14T10:49:03.869 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen 2023-07-14T10:49:03.869 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xen-acpi-processor.ko 2023-07-14T10:49:03.869 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xen-evtchn.ko 2023-07-14T10:49:03.869 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xen-gntalloc.ko 2023-07-14T10:49:03.870 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xen-gntdev.ko 2023-07-14T10:49:03.870 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xen-pciback 2023-07-14T10:49:03.870 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-07-14T10:49:03.870 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xen-privcmd.ko 2023-07-14T10:49:03.870 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xenfs 2023-07-14T10:49:03.870 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xenfs/xenfs.ko 2023-07-14T10:49:03.870 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs 2023-07-14T10:49:03.871 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/9p 2023-07-14T10:49:03.871 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/9p/9p.ko 2023-07-14T10:49:03.871 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/affs 2023-07-14T10:49:03.871 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/affs/affs.ko 2023-07-14T10:49:03.871 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/befs 2023-07-14T10:49:03.871 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/befs/befs.ko 2023-07-14T10:49:03.871 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/binfmt_misc.ko 2023-07-14T10:49:03.871 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/btrfs 2023-07-14T10:49:03.872 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/btrfs/btrfs.ko 2023-07-14T10:49:03.872 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/cachefiles 2023-07-14T10:49:03.872 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/cachefiles/cachefiles.ko 2023-07-14T10:49:03.872 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ceph 2023-07-14T10:49:03.872 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ceph/ceph.ko 2023-07-14T10:49:03.872 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/coda 2023-07-14T10:49:03.872 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/coda/coda.ko 2023-07-14T10:49:03.872 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/cramfs 2023-07-14T10:49:03.873 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/cramfs/cramfs.ko 2023-07-14T10:49:03.873 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/dlm 2023-07-14T10:49:03.873 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/dlm/dlm.ko 2023-07-14T10:49:03.873 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ecryptfs 2023-07-14T10:49:03.873 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ecryptfs/ecryptfs.ko 2023-07-14T10:49:03.873 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/f2fs 2023-07-14T10:49:03.873 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/f2fs/f2fs.ko 2023-07-14T10:49:03.873 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fat 2023-07-14T10:49:03.874 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fat/fat.ko 2023-07-14T10:49:03.874 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fat/msdos.ko 2023-07-14T10:49:03.874 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fat/vfat.ko 2023-07-14T10:49:03.874 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fscache 2023-07-14T10:49:03.874 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fscache/fscache.ko 2023-07-14T10:49:03.874 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fuse 2023-07-14T10:49:03.874 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fuse/cuse.ko 2023-07-14T10:49:03.874 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fuse/fuse.ko 2023-07-14T10:49:03.875 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/gfs2 2023-07-14T10:49:03.875 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/gfs2/gfs2.ko 2023-07-14T10:49:03.875 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/hfs 2023-07-14T10:49:03.875 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/hfs/hfs.ko 2023-07-14T10:49:03.875 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/hfsplus 2023-07-14T10:49:03.875 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/hfsplus/hfsplus.ko 2023-07-14T10:49:03.875 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/isofs 2023-07-14T10:49:03.876 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/isofs/isofs.ko 2023-07-14T10:49:03.876 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/jfs 2023-07-14T10:49:03.876 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/jfs/jfs.ko 2023-07-14T10:49:03.876 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/lockd 2023-07-14T10:49:03.876 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/lockd/lockd.ko 2023-07-14T10:49:03.876 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/minix 2023-07-14T10:49:03.876 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/minix/minix.ko 2023-07-14T10:49:03.876 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/netfs 2023-07-14T10:49:03.877 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/netfs/netfs.ko 2023-07-14T10:49:03.877 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs 2023-07-14T10:49:03.877 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/blocklayout 2023-07-14T10:49:03.877 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-07-14T10:49:03.877 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/filelayout 2023-07-14T10:49:03.877 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-07-14T10:49:03.877 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/flexfilelayout 2023-07-14T10:49:03.877 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-07-14T10:49:03.878 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/nfs.ko 2023-07-14T10:49:03.878 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/nfsv3.ko 2023-07-14T10:49:03.878 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/nfsv4.ko 2023-07-14T10:49:03.878 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs_common 2023-07-14T10:49:03.878 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs_common/grace.ko 2023-07-14T10:49:03.878 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs_common/nfs_acl.ko 2023-07-14T10:49:03.878 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfsd 2023-07-14T10:49:03.879 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfsd/nfsd.ko 2023-07-14T10:49:03.879 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nilfs2 2023-07-14T10:49:03.879 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nilfs2/nilfs2.ko 2023-07-14T10:49:03.879 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls 2023-07-14T10:49:03.879 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-celtic.ko 2023-07-14T10:49:03.879 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-centeuro.ko 2023-07-14T10:49:03.879 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-croatian.ko 2023-07-14T10:49:03.879 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-cyrillic.ko 2023-07-14T10:49:03.880 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-gaelic.ko 2023-07-14T10:49:03.880 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-greek.ko 2023-07-14T10:49:03.880 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-iceland.ko 2023-07-14T10:49:03.880 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-inuit.ko 2023-07-14T10:49:03.880 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-roman.ko 2023-07-14T10:49:03.880 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-romanian.ko 2023-07-14T10:49:03.880 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-turkish.ko 2023-07-14T10:49:03.880 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp1250.ko 2023-07-14T10:49:03.881 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp1251.ko 2023-07-14T10:49:03.881 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp1255.ko 2023-07-14T10:49:03.881 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp737.ko 2023-07-14T10:49:03.881 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp775.ko 2023-07-14T10:49:03.881 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp850.ko 2023-07-14T10:49:03.881 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp852.ko 2023-07-14T10:49:03.881 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp855.ko 2023-07-14T10:49:03.882 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp857.ko 2023-07-14T10:49:03.882 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp860.ko 2023-07-14T10:49:03.882 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp861.ko 2023-07-14T10:49:03.882 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp862.ko 2023-07-14T10:49:03.882 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp863.ko 2023-07-14T10:49:03.882 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp864.ko 2023-07-14T10:49:03.882 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp865.ko 2023-07-14T10:49:03.882 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp866.ko 2023-07-14T10:49:03.883 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp869.ko 2023-07-14T10:49:03.883 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp874.ko 2023-07-14T10:49:03.883 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp932.ko 2023-07-14T10:49:03.883 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp936.ko 2023-07-14T10:49:03.883 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp949.ko 2023-07-14T10:49:03.883 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp950.ko 2023-07-14T10:49:03.883 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_euc-jp.ko 2023-07-14T10:49:03.883 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-1.ko 2023-07-14T10:49:03.884 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-13.ko 2023-07-14T10:49:03.884 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-14.ko 2023-07-14T10:49:03.884 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-15.ko 2023-07-14T10:49:03.884 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-2.ko 2023-07-14T10:49:03.884 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-3.ko 2023-07-14T10:49:03.884 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-4.ko 2023-07-14T10:49:03.884 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-5.ko 2023-07-14T10:49:03.884 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-6.ko 2023-07-14T10:49:03.885 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-7.ko 2023-07-14T10:49:03.885 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-9.ko 2023-07-14T10:49:03.885 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_koi8-r.ko 2023-07-14T10:49:03.885 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_koi8-ru.ko 2023-07-14T10:49:03.885 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_koi8-u.ko 2023-07-14T10:49:03.885 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_utf8.ko 2023-07-14T10:49:03.885 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2 2023-07-14T10:49:03.885 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/cluster 2023-07-14T10:49:03.886 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-07-14T10:49:03.886 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/dlm 2023-07-14T10:49:03.886 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-07-14T10:49:03.886 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/dlmfs 2023-07-14T10:49:03.886 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-07-14T10:49:03.886 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/ocfs2.ko 2023-07-14T10:49:03.886 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-07-14T10:49:03.886 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-07-14T10:49:03.887 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-07-14T10:49:03.887 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/overlayfs 2023-07-14T10:49:03.887 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/overlayfs/overlay.ko 2023-07-14T10:49:03.887 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/pstore 2023-07-14T10:49:03.887 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/pstore/ramoops.ko 2023-07-14T10:49:03.887 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/reiserfs 2023-07-14T10:49:03.887 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/reiserfs/reiserfs.ko 2023-07-14T10:49:03.888 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/romfs 2023-07-14T10:49:03.888 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/romfs/romfs.ko 2023-07-14T10:49:03.888 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/smb 2023-07-14T10:49:03.888 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/smb/client 2023-07-14T10:49:03.888 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/smb/client/cifs.ko 2023-07-14T10:49:03.888 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/smb/common 2023-07-14T10:49:03.888 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/smb/common/cifs_arc4.ko 2023-07-14T10:49:03.888 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/smb/common/cifs_md4.ko 2023-07-14T10:49:03.889 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/squashfs 2023-07-14T10:49:03.889 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/squashfs/squashfs.ko 2023-07-14T10:49:03.889 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/sysv 2023-07-14T10:49:03.889 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/sysv/sysv.ko 2023-07-14T10:49:03.889 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/udf 2023-07-14T10:49:03.889 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/udf/udf.ko 2023-07-14T10:49:03.889 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ufs 2023-07-14T10:49:03.889 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ufs/ufs.ko 2023-07-14T10:49:03.890 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/xfs 2023-07-14T10:49:03.890 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/xfs/xfs.ko 2023-07-14T10:49:03.890 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/kernel 2023-07-14T10:49:03.890 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/kernel/rcu 2023-07-14T10:49:03.890 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/kernel/rcu/rcutorture.ko 2023-07-14T10:49:03.890 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/kernel/torture.ko 2023-07-14T10:49:03.890 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/kernel/trace 2023-07-14T10:49:03.890 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-07-14T10:49:03.891 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib 2023-07-14T10:49:03.891 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/asn1_encoder.ko 2023-07-14T10:49:03.891 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/crc-itu-t.ko 2023-07-14T10:49:03.891 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/crc8.ko 2023-07-14T10:49:03.891 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/crypto 2023-07-14T10:49:03.891 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/crypto/libarc4.ko 2023-07-14T10:49:03.891 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/crypto/libdes.ko 2023-07-14T10:49:03.891 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/libcrc32c.ko 2023-07-14T10:49:03.892 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/lru_cache.ko 2023-07-14T10:49:03.892 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/lz4 2023-07-14T10:49:03.892 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/lz4/lz4_compress.ko 2023-07-14T10:49:03.892 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/lz4/lz4hc_compress.ko 2023-07-14T10:49:03.892 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/math 2023-07-14T10:49:03.892 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/math/cordic.ko 2023-07-14T10:49:03.892 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/raid6 2023-07-14T10:49:03.893 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/raid6/raid6_pq.ko 2023-07-14T10:49:03.893 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/reed_solomon 2023-07-14T10:49:03.893 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/reed_solomon/reed_solomon.ko 2023-07-14T10:49:03.893 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/ts_bm.ko 2023-07-14T10:49:03.893 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/ts_fsm.ko 2023-07-14T10:49:03.893 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/ts_kmp.ko 2023-07-14T10:49:03.893 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/zstd 2023-07-14T10:49:03.893 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/zstd/zstd_compress.ko 2023-07-14T10:49:03.894 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/mm 2023-07-14T10:49:03.894 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/mm/hwpoison-inject.ko 2023-07-14T10:49:03.894 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net 2023-07-14T10:49:03.894 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan 2023-07-14T10:49:03.894 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/6lowpan.ko 2023-07-14T10:49:03.894 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/nhc_dest.ko 2023-07-14T10:49:03.894 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/nhc_fragment.ko 2023-07-14T10:49:03.894 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/nhc_hop.ko 2023-07-14T10:49:03.895 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/nhc_ipv6.ko 2023-07-14T10:49:03.895 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/nhc_mobility.ko 2023-07-14T10:49:03.895 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/nhc_routing.ko 2023-07-14T10:49:03.895 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/nhc_udp.ko 2023-07-14T10:49:03.895 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/802 2023-07-14T10:49:03.895 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/802/garp.ko 2023-07-14T10:49:03.895 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/802/mrp.ko 2023-07-14T10:49:03.895 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/802/p8022.ko 2023-07-14T10:49:03.896 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/802/psnap.ko 2023-07-14T10:49:03.896 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/802/stp.ko 2023-07-14T10:49:03.896 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/8021q 2023-07-14T10:49:03.896 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/8021q/8021q.ko 2023-07-14T10:49:03.896 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/9p 2023-07-14T10:49:03.896 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/9p/9pnet.ko 2023-07-14T10:49:03.896 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/9p/9pnet_fd.ko 2023-07-14T10:49:03.896 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/9p/9pnet_rdma.ko 2023-07-14T10:49:03.897 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/9p/9pnet_virtio.ko 2023-07-14T10:49:03.897 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/batman-adv 2023-07-14T10:49:03.897 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/batman-adv/batman-adv.ko 2023-07-14T10:49:03.897 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge 2023-07-14T10:49:03.897 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/br_netfilter.ko 2023-07-14T10:49:03.897 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/bridge.ko 2023-07-14T10:49:03.897 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter 2023-07-14T10:49:03.897 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-07-14T10:49:03.898 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_among.ko 2023-07-14T10:49:03.898 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_arp.ko 2023-07-14T10:49:03.898 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-07-14T10:49:03.898 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-07-14T10:49:03.898 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_ip.ko 2023-07-14T10:49:03.898 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-07-14T10:49:03.898 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_limit.ko 2023-07-14T10:49:03.898 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_log.ko 2023-07-14T10:49:03.899 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_mark.ko 2023-07-14T10:49:03.899 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-07-14T10:49:03.899 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-07-14T10:49:03.899 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-07-14T10:49:03.899 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-07-14T10:49:03.899 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_snat.ko 2023-07-14T10:49:03.899 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_stp.ko 2023-07-14T10:49:03.899 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-07-14T10:49:03.900 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-07-14T10:49:03.900 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-07-14T10:49:03.900 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-07-14T10:49:03.900 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebtables.ko 2023-07-14T10:49:03.900 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-07-14T10:49:03.900 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-07-14T10:49:03.900 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-07-14T10:49:03.901 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ceph 2023-07-14T10:49:03.901 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ceph/libceph.ko 2023-07-14T10:49:03.901 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/core 2023-07-14T10:49:03.901 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/core/failover.ko 2023-07-14T10:49:03.901 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/core/pktgen.ko 2023-07-14T10:49:03.901 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dccp 2023-07-14T10:49:03.901 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dccp/dccp.ko 2023-07-14T10:49:03.901 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dccp/dccp_diag.ko 2023-07-14T10:49:03.902 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dccp/dccp_ipv4.ko 2023-07-14T10:49:03.902 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dccp/dccp_ipv6.ko 2023-07-14T10:49:03.902 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dns_resolver 2023-07-14T10:49:03.902 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dns_resolver/dns_resolver.ko 2023-07-14T10:49:03.902 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dsa 2023-07-14T10:49:03.902 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dsa/dsa_core.ko 2023-07-14T10:49:03.902 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dsa/tag_brcm.ko 2023-07-14T10:49:03.902 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dsa/tag_dsa.ko 2023-07-14T10:49:03.903 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dsa/tag_none.ko 2023-07-14T10:49:03.903 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dsa/tag_trailer.ko 2023-07-14T10:49:03.903 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ieee802154 2023-07-14T10:49:03.903 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ieee802154/6lowpan 2023-07-14T10:49:03.903 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-07-14T10:49:03.903 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ieee802154/ieee802154.ko 2023-07-14T10:49:03.903 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ieee802154/ieee802154_socket.ko 2023-07-14T10:49:03.903 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4 2023-07-14T10:49:03.904 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/ah4.ko 2023-07-14T10:49:03.904 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/esp4.ko 2023-07-14T10:49:03.904 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/fou.ko 2023-07-14T10:49:03.904 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/gre.ko 2023-07-14T10:49:03.904 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/inet_diag.ko 2023-07-14T10:49:03.904 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/ip_gre.ko 2023-07-14T10:49:03.904 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/ip_tunnel.ko 2023-07-14T10:49:03.905 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/ip_vti.ko 2023-07-14T10:49:03.905 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/ipcomp.ko 2023-07-14T10:49:03.905 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/ipip.ko 2023-07-14T10:49:03.905 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter 2023-07-14T10:49:03.905 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/arp_tables.ko 2023-07-14T10:49:03.905 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-07-14T10:49:03.905 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-07-14T10:49:03.905 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-07-14T10:49:03.906 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-07-14T10:49:03.906 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-07-14T10:49:03.906 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-07-14T10:49:03.906 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-07-14T10:49:03.906 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-07-14T10:49:03.906 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-07-14T10:49:03.906 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/iptable_security.ko 2023-07-14T10:49:03.906 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-07-14T10:49:03.907 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-07-14T10:49:03.907 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-07-14T10:49:03.907 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-07-14T10:49:03.907 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-07-14T10:49:03.907 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-07-14T10:49:03.907 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-07-14T10:49:03.907 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-07-14T10:49:03.907 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-07-14T10:49:03.908 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-07-14T10:49:03.908 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_bic.ko 2023-07-14T10:49:03.908 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_dctcp.ko 2023-07-14T10:49:03.908 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_diag.ko 2023-07-14T10:49:03.908 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_highspeed.ko 2023-07-14T10:49:03.908 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_htcp.ko 2023-07-14T10:49:03.908 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_hybla.ko 2023-07-14T10:49:03.909 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_illinois.ko 2023-07-14T10:49:03.909 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_lp.ko 2023-07-14T10:49:03.909 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_scalable.ko 2023-07-14T10:49:03.909 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_vegas.ko 2023-07-14T10:49:03.909 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_veno.ko 2023-07-14T10:49:03.909 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_westwood.ko 2023-07-14T10:49:03.909 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_yeah.ko 2023-07-14T10:49:03.909 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tunnel4.ko 2023-07-14T10:49:03.910 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/udp_diag.ko 2023-07-14T10:49:03.910 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/udp_tunnel.ko 2023-07-14T10:49:03.910 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/xfrm4_tunnel.ko 2023-07-14T10:49:03.910 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6 2023-07-14T10:49:03.910 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/ah6.ko 2023-07-14T10:49:03.910 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/esp6.ko 2023-07-14T10:49:03.910 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/fou6.ko 2023-07-14T10:49:03.910 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/ip6_tunnel.ko 2023-07-14T10:49:03.911 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-07-14T10:49:03.911 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/ip6_vti.ko 2023-07-14T10:49:03.911 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/ipcomp6.ko 2023-07-14T10:49:03.911 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter 2023-07-14T10:49:03.911 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-07-14T10:49:03.911 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-07-14T10:49:03.911 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-07-14T10:49:03.911 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-07-14T10:49:03.912 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-07-14T10:49:03.912 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-07-14T10:49:03.912 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-07-14T10:49:03.912 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-07-14T10:49:03.912 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-07-14T10:49:03.912 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-07-14T10:49:03.912 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-07-14T10:49:03.912 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-07-14T10:49:03.913 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-07-14T10:49:03.913 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-07-14T10:49:03.913 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-07-14T10:49:03.913 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-07-14T10:49:03.913 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-07-14T10:49:03.913 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-07-14T10:49:03.913 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-07-14T10:49:03.913 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-07-14T10:49:03.914 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-07-14T10:49:03.914 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-07-14T10:49:03.914 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-07-14T10:49:03.914 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-07-14T10:49:03.914 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/sit.ko 2023-07-14T10:49:03.914 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/tunnel6.ko 2023-07-14T10:49:03.914 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/xfrm6_tunnel.ko 2023-07-14T10:49:03.914 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/key 2023-07-14T10:49:03.915 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/key/af_key.ko 2023-07-14T10:49:03.915 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp 2023-07-14T10:49:03.915 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp/l2tp_core.ko 2023-07-14T10:49:03.915 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp/l2tp_debugfs.ko 2023-07-14T10:49:03.915 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp/l2tp_eth.ko 2023-07-14T10:49:03.915 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp/l2tp_ip.ko 2023-07-14T10:49:03.915 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp/l2tp_ip6.ko 2023-07-14T10:49:03.916 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp/l2tp_netlink.ko 2023-07-14T10:49:03.916 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp/l2tp_ppp.ko 2023-07-14T10:49:03.916 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/llc 2023-07-14T10:49:03.916 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/llc/llc.ko 2023-07-14T10:49:03.916 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/mac802154 2023-07-14T10:49:03.916 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/mac802154/mac802154.ko 2023-07-14T10:49:03.916 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/mpls 2023-07-14T10:49:03.916 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/mpls/mpls_gso.ko 2023-07-14T10:49:03.917 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter 2023-07-14T10:49:03.917 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset 2023-07-14T10:49:03.917 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set.ko 2023-07-14T10:49:03.917 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-07-14T10:49:03.917 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-07-14T10:49:03.917 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-07-14T10:49:03.917 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-07-14T10:49:03.917 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-07-14T10:49:03.918 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-07-14T10:49:03.918 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-07-14T10:49:03.918 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-07-14T10:49:03.918 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-07-14T10:49:03.918 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-07-14T10:49:03.918 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-07-14T10:49:03.918 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-07-14T10:49:03.918 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-07-14T10:49:03.919 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-07-14T10:49:03.919 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-07-14T10:49:03.919 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs 2023-07-14T10:49:03.919 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs.ko 2023-07-14T10:49:03.919 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-07-14T10:49:03.919 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-07-14T10:49:03.919 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-07-14T10:49:03.919 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-07-14T10:49:03.920 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-07-14T10:49:03.920 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-07-14T10:49:03.920 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-07-14T10:49:03.920 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-07-14T10:49:03.920 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-07-14T10:49:03.920 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-07-14T10:49:03.920 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-07-14T10:49:03.921 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-07-14T10:49:03.921 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-07-14T10:49:03.921 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conncount.ko 2023-07-14T10:49:03.921 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack.ko 2023-07-14T10:49:03.921 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-07-14T10:49:03.921 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-07-14T10:49:03.921 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-07-14T10:49:03.921 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_h323.ko 2023-07-14T10:49:03.922 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_irc.ko 2023-07-14T10:49:03.922 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-07-14T10:49:03.922 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-07-14T10:49:03.922 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-07-14T10:49:03.922 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_sane.ko 2023-07-14T10:49:03.922 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_sip.ko 2023-07-14T10:49:03.922 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-07-14T10:49:03.922 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-07-14T10:49:03.923 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_dup_netdev.ko 2023-07-14T10:49:03.923 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_flow_table.ko 2023-07-14T10:49:03.923 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_flow_table_inet.ko 2023-07-14T10:49:03.923 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_log_syslog.ko 2023-07-14T10:49:03.923 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_nat.ko 2023-07-14T10:49:03.923 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_nat_amanda.ko 2023-07-14T10:49:03.923 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_nat_ftp.ko 2023-07-14T10:49:03.923 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_nat_irc.ko 2023-07-14T10:49:03.924 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_nat_sip.ko 2023-07-14T10:49:03.924 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_nat_tftp.ko 2023-07-14T10:49:03.924 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_synproxy_core.ko 2023-07-14T10:49:03.924 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_tables.ko 2023-07-14T10:49:03.924 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nfnetlink.ko 2023-07-14T10:49:03.924 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nfnetlink_acct.ko 2023-07-14T10:49:03.924 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nfnetlink_log.ko 2023-07-14T10:49:03.924 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nfnetlink_osf.ko 2023-07-14T10:49:03.925 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nfnetlink_queue.ko 2023-07-14T10:49:03.925 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_chain_nat.ko 2023-07-14T10:49:03.925 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_compat.ko 2023-07-14T10:49:03.925 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_ct.ko 2023-07-14T10:49:03.925 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_dup_netdev.ko 2023-07-14T10:49:03.925 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_fib.ko 2023-07-14T10:49:03.925 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_fwd_netdev.ko 2023-07-14T10:49:03.925 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_hash.ko 2023-07-14T10:49:03.926 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_limit.ko 2023-07-14T10:49:03.926 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_log.ko 2023-07-14T10:49:03.926 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_masq.ko 2023-07-14T10:49:03.926 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_nat.ko 2023-07-14T10:49:03.926 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_numgen.ko 2023-07-14T10:49:03.926 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_queue.ko 2023-07-14T10:49:03.926 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_quota.ko 2023-07-14T10:49:03.926 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_redir.ko 2023-07-14T10:49:03.927 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_reject.ko 2023-07-14T10:49:03.927 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_reject_inet.ko 2023-07-14T10:49:03.927 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_socket.ko 2023-07-14T10:49:03.927 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_tunnel.ko 2023-07-14T10:49:03.927 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_AUDIT.ko 2023-07-14T10:49:03.927 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_CHECKSUM.ko 2023-07-14T10:49:03.927 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_CLASSIFY.ko 2023-07-14T10:49:03.927 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-07-14T10:49:03.928 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_CT.ko 2023-07-14T10:49:03.928 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_DSCP.ko 2023-07-14T10:49:03.928 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_HL.ko 2023-07-14T10:49:03.928 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_HMARK.ko 2023-07-14T10:49:03.928 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_IDLETIMER.ko 2023-07-14T10:49:03.928 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_LED.ko 2023-07-14T10:49:03.928 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_LOG.ko 2023-07-14T10:49:03.929 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_MASQUERADE.ko 2023-07-14T10:49:03.929 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_NETMAP.ko 2023-07-14T10:49:03.929 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_NFLOG.ko 2023-07-14T10:49:03.929 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_NFQUEUE.ko 2023-07-14T10:49:03.929 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_RATEEST.ko 2023-07-14T10:49:03.929 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_REDIRECT.ko 2023-07-14T10:49:03.929 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_SECMARK.ko 2023-07-14T10:49:03.929 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_TCPMSS.ko 2023-07-14T10:49:03.930 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-07-14T10:49:03.930 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_TEE.ko 2023-07-14T10:49:03.930 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_TPROXY.ko 2023-07-14T10:49:03.930 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_TRACE.ko 2023-07-14T10:49:03.930 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_addrtype.ko 2023-07-14T10:49:03.930 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_bpf.ko 2023-07-14T10:49:03.930 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_cgroup.ko 2023-07-14T10:49:03.930 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_cluster.ko 2023-07-14T10:49:03.931 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_comment.ko 2023-07-14T10:49:03.931 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_connbytes.ko 2023-07-14T10:49:03.931 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_connlabel.ko 2023-07-14T10:49:03.931 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_connlimit.ko 2023-07-14T10:49:03.931 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_connmark.ko 2023-07-14T10:49:03.931 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_conntrack.ko 2023-07-14T10:49:03.931 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_cpu.ko 2023-07-14T10:49:03.931 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_dccp.ko 2023-07-14T10:49:03.932 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_devgroup.ko 2023-07-14T10:49:03.932 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_dscp.ko 2023-07-14T10:49:03.932 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_ecn.ko 2023-07-14T10:49:03.932 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_esp.ko 2023-07-14T10:49:03.932 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_hashlimit.ko 2023-07-14T10:49:03.932 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_helper.ko 2023-07-14T10:49:03.932 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_hl.ko 2023-07-14T10:49:03.932 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_ipcomp.ko 2023-07-14T10:49:03.933 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_iprange.ko 2023-07-14T10:49:03.933 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_ipvs.ko 2023-07-14T10:49:03.933 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_l2tp.ko 2023-07-14T10:49:03.933 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_length.ko 2023-07-14T10:49:03.933 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_limit.ko 2023-07-14T10:49:03.933 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_mac.ko 2023-07-14T10:49:03.933 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_mark.ko 2023-07-14T10:49:03.933 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_multiport.ko 2023-07-14T10:49:03.934 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_nat.ko 2023-07-14T10:49:03.934 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_nfacct.ko 2023-07-14T10:49:03.934 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_osf.ko 2023-07-14T10:49:03.934 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_owner.ko 2023-07-14T10:49:03.934 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_physdev.ko 2023-07-14T10:49:03.934 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_pkttype.ko 2023-07-14T10:49:03.934 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_policy.ko 2023-07-14T10:49:03.934 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_quota.ko 2023-07-14T10:49:03.935 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_rateest.ko 2023-07-14T10:49:03.935 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_realm.ko 2023-07-14T10:49:03.935 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_recent.ko 2023-07-14T10:49:03.935 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_sctp.ko 2023-07-14T10:49:03.935 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_set.ko 2023-07-14T10:49:03.935 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_socket.ko 2023-07-14T10:49:03.935 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_state.ko 2023-07-14T10:49:03.935 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_statistic.ko 2023-07-14T10:49:03.936 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_string.ko 2023-07-14T10:49:03.936 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_tcpmss.ko 2023-07-14T10:49:03.936 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_time.ko 2023-07-14T10:49:03.936 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_u32.ko 2023-07-14T10:49:03.936 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netlink 2023-07-14T10:49:03.936 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netlink/netlink_diag.ko 2023-07-14T10:49:03.936 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/nsh 2023-07-14T10:49:03.937 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/nsh/nsh.ko 2023-07-14T10:49:03.937 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/openvswitch 2023-07-14T10:49:03.937 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/openvswitch/openvswitch.ko 2023-07-14T10:49:03.937 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/openvswitch/vport-geneve.ko 2023-07-14T10:49:03.937 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/openvswitch/vport-gre.ko 2023-07-14T10:49:03.937 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/openvswitch/vport-vxlan.ko 2023-07-14T10:49:03.937 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/packet 2023-07-14T10:49:03.937 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/packet/af_packet_diag.ko 2023-07-14T10:49:03.938 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/rds 2023-07-14T10:49:03.938 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/rds/rds.ko 2023-07-14T10:49:03.938 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/rds/rds_rdma.ko 2023-07-14T10:49:03.938 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/rds/rds_tcp.ko 2023-07-14T10:49:03.938 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched 2023-07-14T10:49:03.938 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_csum.ko 2023-07-14T10:49:03.938 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_gact.ko 2023-07-14T10:49:03.938 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_ipt.ko 2023-07-14T10:49:03.939 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_mirred.ko 2023-07-14T10:49:03.939 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_nat.ko 2023-07-14T10:49:03.939 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_pedit.ko 2023-07-14T10:49:03.939 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_police.ko 2023-07-14T10:49:03.939 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_simple.ko 2023-07-14T10:49:03.939 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_skbedit.ko 2023-07-14T10:49:03.939 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_vlan.ko 2023-07-14T10:49:03.939 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/cls_basic.ko 2023-07-14T10:49:03.940 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/cls_bpf.ko 2023-07-14T10:49:03.940 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/cls_flow.ko 2023-07-14T10:49:03.940 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/cls_fw.ko 2023-07-14T10:49:03.940 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/cls_route.ko 2023-07-14T10:49:03.940 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/cls_u32.ko 2023-07-14T10:49:03.940 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/em_cmp.ko 2023-07-14T10:49:03.940 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/em_ipset.ko 2023-07-14T10:49:03.940 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/em_meta.ko 2023-07-14T10:49:03.941 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/em_nbyte.ko 2023-07-14T10:49:03.941 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/em_text.ko 2023-07-14T10:49:03.941 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/em_u32.ko 2023-07-14T10:49:03.941 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_choke.ko 2023-07-14T10:49:03.941 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_codel.ko 2023-07-14T10:49:03.941 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_drr.ko 2023-07-14T10:49:03.941 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_fq.ko 2023-07-14T10:49:03.942 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_gred.ko 2023-07-14T10:49:03.942 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_hfsc.ko 2023-07-14T10:49:03.942 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_hhf.ko 2023-07-14T10:49:03.942 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_htb.ko 2023-07-14T10:49:03.942 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_ingress.ko 2023-07-14T10:49:03.942 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_mqprio.ko 2023-07-14T10:49:03.942 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_mqprio_lib.ko 2023-07-14T10:49:03.942 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_multiq.ko 2023-07-14T10:49:03.943 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_netem.ko 2023-07-14T10:49:03.943 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_pie.ko 2023-07-14T10:49:03.943 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_plug.ko 2023-07-14T10:49:03.943 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_prio.ko 2023-07-14T10:49:03.943 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_qfq.ko 2023-07-14T10:49:03.943 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_red.ko 2023-07-14T10:49:03.943 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_sfb.ko 2023-07-14T10:49:03.943 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_sfq.ko 2023-07-14T10:49:03.944 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_tbf.ko 2023-07-14T10:49:03.944 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_teql.ko 2023-07-14T10:49:03.944 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sctp 2023-07-14T10:49:03.944 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sctp/sctp.ko 2023-07-14T10:49:03.944 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sctp/sctp_diag.ko 2023-07-14T10:49:03.944 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sunrpc 2023-07-14T10:49:03.944 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sunrpc/auth_gss 2023-07-14T10:49:03.944 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-07-14T10:49:03.945 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-07-14T10:49:03.945 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sunrpc/sunrpc.ko 2023-07-14T10:49:03.945 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sunrpc/xprtrdma 2023-07-14T10:49:03.945 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-07-14T10:49:03.945 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/tipc 2023-07-14T10:49:03.945 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/tipc/diag.ko 2023-07-14T10:49:03.945 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/tipc/tipc.ko 2023-07-14T10:49:03.945 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/unix 2023-07-14T10:49:03.946 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/unix/unix_diag.ko 2023-07-14T10:49:03.946 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/vmw_vsock 2023-07-14T10:49:03.946 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-07-14T10:49:03.946 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-07-14T10:49:03.946 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/vmw_vsock/vsock.ko 2023-07-14T10:49:03.946 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/vmw_vsock/vsock_diag.ko 2023-07-14T10:49:03.946 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/vmw_vsock/vsock_loopback.ko 2023-07-14T10:49:03.946 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/xfrm 2023-07-14T10:49:03.947 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/xfrm/xfrm_ipcomp.ko 2023-07-14T10:49:03.947 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/security 2023-07-14T10:49:03.947 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/security/keys 2023-07-14T10:49:03.947 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/security/keys/encrypted-keys 2023-07-14T10:49:03.947 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-07-14T10:49:03.947 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/security/keys/trusted-keys 2023-07-14T10:49:03.947 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/security/keys/trusted-keys/trusted.ko 2023-07-14T10:49:03.947 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/virt 2023-07-14T10:49:03.948 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/virt/lib 2023-07-14T10:49:03.948 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/virt/lib/irqbypass.ko 2023-07-14T10:49:03.948 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.alias 2023-07-14T10:49:03.948 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.alias.bin 2023-07-14T10:49:03.948 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.builtin 2023-07-14T10:49:03.948 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.builtin.bin 2023-07-14T10:49:03.948 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.builtin.modinfo 2023-07-14T10:49:03.949 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.dep 2023-07-14T10:49:03.949 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.dep.bin 2023-07-14T10:49:03.949 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.devname 2023-07-14T10:49:03.949 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.order 2023-07-14T10:49:03.949 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.softdep 2023-07-14T10:49:03.949 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.symbols 2023-07-14T10:49:03.949 INFO:teuthology.orchestra.run.smithi179.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.symbols.bin 2023-07-14T10:49:03.950 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc1-ga440c79eee02 2023-07-14T10:49:03.950 DEBUG:teuthology.orchestra.run.smithi179:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-07-14T10:49:03.979 INFO:teuthology.orchestra.run.smithi179.stdout:postinstall scriptlet (using /bin/sh): 2023-07-14T10:49:03.979 INFO:teuthology.orchestra.run.smithi179.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.5.0-rc1-ga440c79eee02 -a -r /boot/System.map-6.5.0-rc1-ga440c79eee02 ]; then 2023-07-14T10:49:03.979 INFO:teuthology.orchestra.run.smithi179.stdout:cp /boot/vmlinuz-6.5.0-rc1-ga440c79eee02 /boot/.vmlinuz-6.5.0-rc1-ga440c79eee02-rpm 2023-07-14T10:49:03.980 INFO:teuthology.orchestra.run.smithi179.stdout:cp /boot/System.map-6.5.0-rc1-ga440c79eee02 /boot/.System.map-6.5.0-rc1-ga440c79eee02-rpm 2023-07-14T10:49:03.980 INFO:teuthology.orchestra.run.smithi179.stdout:rm -f /boot/vmlinuz-6.5.0-rc1-ga440c79eee02 /boot/System.map-6.5.0-rc1-ga440c79eee02 2023-07-14T10:49:03.980 INFO:teuthology.orchestra.run.smithi179.stdout:/sbin/installkernel 6.5.0-rc1-ga440c79eee02 /boot/.vmlinuz-6.5.0-rc1-ga440c79eee02-rpm /boot/.System.map-6.5.0-rc1-ga440c79eee02-rpm 2023-07-14T10:49:03.980 INFO:teuthology.orchestra.run.smithi179.stdout:rm -f /boot/.vmlinuz-6.5.0-rc1-ga440c79eee02-rpm /boot/.System.map-6.5.0-rc1-ga440c79eee02-rpm 2023-07-14T10:49:03.980 INFO:teuthology.orchestra.run.smithi179.stdout:fi 2023-07-14T10:49:03.981 INFO:teuthology.orchestra.run.smithi179.stdout:preuninstall scriptlet (using /bin/sh): 2023-07-14T10:49:03.981 INFO:teuthology.orchestra.run.smithi179.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-07-14T10:49:03.981 INFO:teuthology.orchestra.run.smithi179.stdout:new-kernel-pkg --remove 6.5.0-rc1-ga440c79eee02 --rminitrd --initrdfile=/boot/initramfs-6.5.0-rc1-ga440c79eee02.img 2023-07-14T10:49:03.981 INFO:teuthology.orchestra.run.smithi179.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-07-14T10:49:03.981 INFO:teuthology.orchestra.run.smithi179.stdout:kernel-install remove 6.5.0-rc1-ga440c79eee02 2023-07-14T10:49:03.981 INFO:teuthology.orchestra.run.smithi179.stdout:fi 2023-07-14T10:49:03.981 INFO:teuthology.orchestra.run.smithi179.stdout:postuninstall scriptlet (using /bin/sh): 2023-07-14T10:49:03.982 INFO:teuthology.orchestra.run.smithi179.stdout:if [ -x /sbin/update-bootloader ]; then 2023-07-14T10:49:03.982 INFO:teuthology.orchestra.run.smithi179.stdout:/sbin/update-bootloader --remove 6.5.0-rc1-ga440c79eee02 2023-07-14T10:49:03.982 INFO:teuthology.orchestra.run.smithi179.stdout:fi 2023-07-14T10:49:03.982 DEBUG:teuthology.orchestra.run.smithi179:> sudo rpm -qi grub2-tools 2023-07-14T10:49:04.056 INFO:teuthology.orchestra.run.smithi179.stdout:Name : grub2-tools 2023-07-14T10:49:04.057 INFO:teuthology.orchestra.run.smithi179.stdout:Epoch : 1 2023-07-14T10:49:04.057 INFO:teuthology.orchestra.run.smithi179.stdout:Version : 2.02 2023-07-14T10:49:04.057 INFO:teuthology.orchestra.run.smithi179.stdout:Release : 129.el8 2023-07-14T10:49:04.057 INFO:teuthology.orchestra.run.smithi179.stdout:Architecture: x86_64 2023-07-14T10:49:04.057 INFO:teuthology.orchestra.run.smithi179.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-07-14T10:49:04.057 INFO:teuthology.orchestra.run.smithi179.stdout:Group : System Environment/Base 2023-07-14T10:49:04.057 INFO:teuthology.orchestra.run.smithi179.stdout:Size : 9265586 2023-07-14T10:49:04.058 INFO:teuthology.orchestra.run.smithi179.stdout:License : GPLv3+ 2023-07-14T10:49:04.058 INFO:teuthology.orchestra.run.smithi179.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-07-14T10:49:04.058 INFO:teuthology.orchestra.run.smithi179.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-07-14T10:49:04.058 INFO:teuthology.orchestra.run.smithi179.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-07-14T10:49:04.058 INFO:teuthology.orchestra.run.smithi179.stdout:Build Host : kbuilder.bsys.centos.org 2023-07-14T10:49:04.058 INFO:teuthology.orchestra.run.smithi179.stdout:Relocations : (not relocatable) 2023-07-14T10:49:04.058 INFO:teuthology.orchestra.run.smithi179.stdout:Packager : CentOS BuildSystem 2023-07-14T10:49:04.058 INFO:teuthology.orchestra.run.smithi179.stdout:Vendor : CentOS 2023-07-14T10:49:04.059 INFO:teuthology.orchestra.run.smithi179.stdout:URL : http://www.gnu.org/software/grub/ 2023-07-14T10:49:04.059 INFO:teuthology.orchestra.run.smithi179.stdout:Summary : Support tools for GRUB. 2023-07-14T10:49:04.059 INFO:teuthology.orchestra.run.smithi179.stdout:Description : 2023-07-14T10:49:04.059 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-07-14T10:49:04.059 INFO:teuthology.orchestra.run.smithi179.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-07-14T10:49:04.059 INFO:teuthology.orchestra.run.smithi179.stdout:customizable bootloader with modular architecture. It supports a rich 2023-07-14T10:49:04.059 INFO:teuthology.orchestra.run.smithi179.stdout:variety of kernel formats, file systems, computer architectures and 2023-07-14T10:49:04.059 INFO:teuthology.orchestra.run.smithi179.stdout:hardware devices. 2023-07-14T10:49:04.060 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-07-14T10:49:04.060 INFO:teuthology.orchestra.run.smithi179.stdout:This subpackage provides tools for support of all platforms. 2023-07-14T10:49:04.061 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-07-14T10:49:04.061 INFO:teuthology.task.kernel:Updating grub on smithi179 to boot 6.5.0-rc1-ga440c79eee02 2023-07-14T10:49:04.061 DEBUG:teuthology.orchestra.run.smithi179:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-07-14T10:49:08.168 INFO:teuthology.orchestra.run.smithi179.stderr:Generating grub configuration file ... 2023-07-14T10:49:10.639 INFO:teuthology.orchestra.run.smithi179.stderr:done 2023-07-14T10:49:10.641 DEBUG:teuthology.orchestra.run.smithi179:> mktemp 2023-07-14T10:49:10.675 INFO:teuthology.orchestra.run.smithi179.stdout:/tmp/tmp.ak78KRezKH 2023-07-14T10:49:10.676 DEBUG:teuthology.orchestra.run.smithi179:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.ak78KRezKH 2023-07-14T10:49:10.750 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 0666 /tmp/tmp.ak78KRezKH 2023-07-14T10:49:10.904 DEBUG:teuthology.orchestra.remote:smithi179:/tmp/tmp.ak78KRezKH is 6KB 2023-07-14T10:49:10.954 DEBUG:teuthology.orchestra.run.smithi179:> rm -fr /tmp/tmp.ak78KRezKH 2023-07-14T10:49:10.972 DEBUG:teuthology.orchestra.run.smithi179:> sudo /bin/ls /boot/loader/entries || true 2023-07-14T10:49:11.049 INFO:teuthology.orchestra.run.smithi179.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-07-14T10:49:11.050 INFO:teuthology.orchestra.run.smithi179.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-07-14T10:49:11.050 INFO:teuthology.orchestra.run.smithi179.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-07-14T10:49:11.050 INFO:teuthology.orchestra.run.smithi179.stdout:a1b29d6c289747bdb22930598d39874a-6.5.0-rc1-ga440c79eee02.conf 2023-07-14T10:49:11.051 DEBUG:teuthology.orchestra.run.smithi179:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-6.5.0-rc1-ga440c79eee02 2023-07-14T10:49:11.200 DEBUG:teuthology.orchestra.run.smithi179:> sudo shutdown -r now 2023-07-14T10:49:41.203 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-07-14T10:49:41.204 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2023-07-14T10:49:41.205 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T10:49:53.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14 10:49:53 URL:https://2.chacra.ceph.com/r/kernel/testing/a440c79eee0258ae07e4988d8690fe6187b8b7a3/centos/8/flavors/default/x86_64/kernel-6.5.0_rc1_ga440c79eee02-1.x86_64.rpm [380684764/380684764] -> "/tmp/kernel.x86_64.rpm" [1] 2023-07-14T10:49:53.897 INFO:teuthology.orchestra.run.smithi084.stderr:FINISHED --2023-07-14 10:49:53-- 2023-07-14T10:49:53.897 INFO:teuthology.orchestra.run.smithi084.stderr:Total wall clock time: 4m 29s 2023-07-14T10:49:53.897 INFO:teuthology.orchestra.run.smithi084.stderr:Downloaded: 1 files, 363M in 4m 28s (1.35 MB/s) 2023-07-14T10:49:53.898 INFO:teuthology.task.kernel:Installing kernel a440c79eee0258ae07e4988d8690fe6187b8b7a3 on client.0... 2023-07-14T10:49:53.899 DEBUG:teuthology.orchestra.run.smithi084:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-07-14T10:49:55.563 INFO:teuthology.orchestra.run.smithi084.stdout:Verifying... ######################################## 2023-07-14T10:49:55.607 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing... ######################################## 2023-07-14T10:49:55.716 INFO:teuthology.orchestra.run.smithi084.stdout:Updating / installing... 2023-07-14T10:49:59.670 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-07-14T10:50:08.672 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2023-07-14T10:50:08.673 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T10:50:11.728 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-07-14T10:50:23.730 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2023-07-14T10:50:23.731 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T10:50:33.682 INFO:teuthology.orchestra.run.smithi084.stdout:kernel-6.5.0_rc1_ga440c79eee02-1 ######################################## 2023-07-14T10:50:42.164 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-07-14T10:50:57.165 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2023-07-14T10:50:57.166 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T10:50:57.489 DEBUG:teuthology.orchestra.run.smithi179:> true 2023-07-14T10:50:57.706 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi084.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-07-14T10:50:57.707 DEBUG:teuthology.orchestra.run.smithi084:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-07-14T10:50:57.768 INFO:teuthology.orchestra.run.smithi084.stdout:/boot/System.map-6.5.0-rc1-ga440c79eee02 2023-07-14T10:50:57.768 INFO:teuthology.orchestra.run.smithi084.stdout:/boot/config-6.5.0-rc1-ga440c79eee02 2023-07-14T10:50:57.768 INFO:teuthology.orchestra.run.smithi084.stdout:/boot/vmlinuz-6.5.0-rc1-ga440c79eee02 2023-07-14T10:50:57.769 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02 2023-07-14T10:50:57.769 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel 2023-07-14T10:50:57.769 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch 2023-07-14T10:50:57.769 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86 2023-07-14T10:50:57.769 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto 2023-07-14T10:50:57.769 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-07-14T10:50:57.769 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-07-14T10:50:57.770 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-07-14T10:50:57.770 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-07-14T10:50:57.770 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-07-14T10:50:57.770 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-07-14T10:50:57.770 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-07-14T10:50:57.770 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/crc32c-intel.ko 2023-07-14T10:50:57.770 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-07-14T10:50:57.771 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-07-14T10:50:57.771 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-07-14T10:50:57.771 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-07-14T10:50:57.771 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/serpent-avx2.ko 2023-07-14T10:50:57.771 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-07-14T10:50:57.771 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-07-14T10:50:57.771 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-07-14T10:50:57.772 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-07-14T10:50:57.772 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-07-14T10:50:57.772 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-07-14T10:50:57.772 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-07-14T10:50:57.772 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kernel 2023-07-14T10:50:57.772 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kernel/cpu 2023-07-14T10:50:57.772 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kernel/cpu/mce 2023-07-14T10:50:57.773 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-07-14T10:50:57.773 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kvm 2023-07-14T10:50:57.773 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kvm/kvm-amd.ko 2023-07-14T10:50:57.773 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kvm/kvm-intel.ko 2023-07-14T10:50:57.773 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kvm/kvm.ko 2023-07-14T10:50:57.773 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto 2023-07-14T10:50:57.773 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/ansi_cprng.ko 2023-07-14T10:50:57.773 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/anubis.ko 2023-07-14T10:50:57.774 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/arc4.ko 2023-07-14T10:50:57.774 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/async_tx 2023-07-14T10:50:57.774 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/async_tx/async_memcpy.ko 2023-07-14T10:50:57.775 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/async_tx/async_pq.ko 2023-07-14T10:50:57.775 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/async_tx/async_raid6_recov.ko 2023-07-14T10:50:57.775 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/async_tx/async_tx.ko 2023-07-14T10:50:57.775 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/async_tx/async_xor.ko 2023-07-14T10:50:57.775 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/async_tx/raid6test.ko 2023-07-14T10:50:57.775 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/authenc.ko 2023-07-14T10:50:57.775 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/authencesn.ko 2023-07-14T10:50:57.776 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/blake2b_generic.ko 2023-07-14T10:50:57.776 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/blowfish_common.ko 2023-07-14T10:50:57.776 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/blowfish_generic.ko 2023-07-14T10:50:57.776 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/camellia_generic.ko 2023-07-14T10:50:57.776 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/cast5_generic.ko 2023-07-14T10:50:57.776 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/cast6_generic.ko 2023-07-14T10:50:57.776 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/cast_common.ko 2023-07-14T10:50:57.777 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/ccm.ko 2023-07-14T10:50:57.777 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/cmac.ko 2023-07-14T10:50:57.777 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/crc32_generic.ko 2023-07-14T10:50:57.777 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/crypto_engine.ko 2023-07-14T10:50:57.777 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/crypto_user.ko 2023-07-14T10:50:57.777 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/cts.ko 2023-07-14T10:50:57.777 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/des_generic.ko 2023-07-14T10:50:57.778 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/dh_generic.ko 2023-07-14T10:50:57.778 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/echainiv.ko 2023-07-14T10:50:57.778 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/essiv.ko 2023-07-14T10:50:57.778 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/fcrypt.ko 2023-07-14T10:50:57.778 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/khazad.ko 2023-07-14T10:50:57.778 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/lz4.ko 2023-07-14T10:50:57.778 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/lz4hc.ko 2023-07-14T10:50:57.778 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/md4.ko 2023-07-14T10:50:57.779 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/michael_mic.ko 2023-07-14T10:50:57.779 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/pcbc.ko 2023-07-14T10:50:57.779 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/pcrypt.ko 2023-07-14T10:50:57.779 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/rmd160.ko 2023-07-14T10:50:57.779 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/seed.ko 2023-07-14T10:50:57.779 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/serpent_generic.ko 2023-07-14T10:50:57.779 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/tcrypt.ko 2023-07-14T10:50:57.780 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/tea.ko 2023-07-14T10:50:57.780 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/twofish_common.ko 2023-07-14T10:50:57.780 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/twofish_generic.ko 2023-07-14T10:50:57.780 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/vmac.ko 2023-07-14T10:50:57.780 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/wp512.ko 2023-07-14T10:50:57.780 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/xcbc.ko 2023-07-14T10:50:57.780 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/xor.ko 2023-07-14T10:50:57.781 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/xxhash_generic.ko 2023-07-14T10:50:57.781 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers 2023-07-14T10:50:57.781 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi 2023-07-14T10:50:57.781 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/acpi_ipmi.ko 2023-07-14T10:50:57.781 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/acpi_pad.ko 2023-07-14T10:50:57.781 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/custom_method.ko 2023-07-14T10:50:57.781 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/ec_sys.ko 2023-07-14T10:50:57.781 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/platform_profile.ko 2023-07-14T10:50:57.782 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/sbs.ko 2023-07-14T10:50:57.782 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/sbshc.ko 2023-07-14T10:50:57.782 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/video.ko 2023-07-14T10:50:57.782 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata 2023-07-14T10:50:57.782 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/acard-ahci.ko 2023-07-14T10:50:57.782 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/ahci_platform.ko 2023-07-14T10:50:57.782 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/ata_generic.ko 2023-07-14T10:50:57.783 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/libahci_platform.ko 2023-07-14T10:50:57.783 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_acpi.ko 2023-07-14T10:50:57.783 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_ali.ko 2023-07-14T10:50:57.783 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_amd.ko 2023-07-14T10:50:57.783 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_artop.ko 2023-07-14T10:50:57.783 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_atiixp.ko 2023-07-14T10:50:57.783 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_atp867x.ko 2023-07-14T10:50:57.783 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_cmd640.ko 2023-07-14T10:50:57.784 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_cmd64x.ko 2023-07-14T10:50:57.784 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_cypress.ko 2023-07-14T10:50:57.784 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_efar.ko 2023-07-14T10:50:57.784 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_hpt366.ko 2023-07-14T10:50:57.784 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_hpt37x.ko 2023-07-14T10:50:57.785 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_hpt3x2n.ko 2023-07-14T10:50:57.785 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_hpt3x3.ko 2023-07-14T10:50:57.785 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_it8213.ko 2023-07-14T10:50:57.785 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_it821x.ko 2023-07-14T10:50:57.785 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_jmicron.ko 2023-07-14T10:50:57.786 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_marvell.ko 2023-07-14T10:50:57.786 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_mpiix.ko 2023-07-14T10:50:57.786 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_netcell.ko 2023-07-14T10:50:57.786 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_ninja32.ko 2023-07-14T10:50:57.786 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_ns87410.ko 2023-07-14T10:50:57.787 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_ns87415.ko 2023-07-14T10:50:57.787 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_oldpiix.ko 2023-07-14T10:50:57.787 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_opti.ko 2023-07-14T10:50:57.787 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_optidma.ko 2023-07-14T10:50:57.787 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_pcmcia.ko 2023-07-14T10:50:57.787 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_pdc2027x.ko 2023-07-14T10:50:57.787 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-07-14T10:50:57.788 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_piccolo.ko 2023-07-14T10:50:57.788 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_rdc.ko 2023-07-14T10:50:57.788 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_sch.ko 2023-07-14T10:50:57.788 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_serverworks.ko 2023-07-14T10:50:57.788 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_sil680.ko 2023-07-14T10:50:57.788 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_sis.ko 2023-07-14T10:50:57.788 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_sl82c105.ko 2023-07-14T10:50:57.789 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_triflex.ko 2023-07-14T10:50:57.789 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_via.ko 2023-07-14T10:50:57.789 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pdc_adma.ko 2023-07-14T10:50:57.789 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_inic162x.ko 2023-07-14T10:50:57.789 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_mv.ko 2023-07-14T10:50:57.789 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_nv.ko 2023-07-14T10:50:57.789 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_promise.ko 2023-07-14T10:50:57.789 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_qstor.ko 2023-07-14T10:50:57.790 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_sil.ko 2023-07-14T10:50:57.790 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_sil24.ko 2023-07-14T10:50:57.790 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_sis.ko 2023-07-14T10:50:57.790 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_svw.ko 2023-07-14T10:50:57.790 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_sx4.ko 2023-07-14T10:50:57.790 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_uli.ko 2023-07-14T10:50:57.790 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_via.ko 2023-07-14T10:50:57.791 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_vsc.ko 2023-07-14T10:50:57.791 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/auxdisplay 2023-07-14T10:50:57.791 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/auxdisplay/ks0108.ko 2023-07-14T10:50:57.791 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/base 2023-07-14T10:50:57.791 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/base/regmap 2023-07-14T10:50:57.791 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/base/regmap/regmap-i2c.ko 2023-07-14T10:50:57.791 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/base/regmap/regmap-mmio.ko 2023-07-14T10:50:57.792 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/bcma 2023-07-14T10:50:57.792 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/bcma/bcma.ko 2023-07-14T10:50:57.792 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block 2023-07-14T10:50:57.792 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/aoe 2023-07-14T10:50:57.792 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/aoe/aoe.ko 2023-07-14T10:50:57.792 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/brd.ko 2023-07-14T10:50:57.792 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/drbd 2023-07-14T10:50:57.793 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/drbd/drbd.ko 2023-07-14T10:50:57.793 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/floppy.ko 2023-07-14T10:50:57.793 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/loop.ko 2023-07-14T10:50:57.793 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/mtip32xx 2023-07-14T10:50:57.793 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-07-14T10:50:57.793 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/nbd.ko 2023-07-14T10:50:57.793 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/null_blk 2023-07-14T10:50:57.794 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/null_blk/null_blk.ko 2023-07-14T10:50:57.794 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/pktcdvd.ko 2023-07-14T10:50:57.794 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/rbd.ko 2023-07-14T10:50:57.794 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/virtio_blk.ko 2023-07-14T10:50:57.794 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/xen-blkback 2023-07-14T10:50:57.794 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-07-14T10:50:57.794 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/xen-blkfront.ko 2023-07-14T10:50:57.794 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/zram 2023-07-14T10:50:57.796 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/zram/zram.ko 2023-07-14T10:50:57.796 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char 2023-07-14T10:50:57.796 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/hangcheck-timer.ko 2023-07-14T10:50:57.796 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/hw_random 2023-07-14T10:50:57.796 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/hw_random/amd-rng.ko 2023-07-14T10:50:57.796 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/hw_random/intel-rng.ko 2023-07-14T10:50:57.796 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-07-14T10:50:57.797 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/hw_random/via-rng.ko 2023-07-14T10:50:57.797 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/hw_random/virtio-rng.ko 2023-07-14T10:50:57.797 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ipmi 2023-07-14T10:50:57.797 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-07-14T10:50:57.797 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-07-14T10:50:57.797 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-07-14T10:50:57.797 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ipmi/ipmi_si.ko 2023-07-14T10:50:57.798 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-07-14T10:50:57.798 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-07-14T10:50:57.798 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/lp.ko 2023-07-14T10:50:57.798 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/mwave 2023-07-14T10:50:57.798 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/mwave/mwave.ko 2023-07-14T10:50:57.798 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ppdev.ko 2023-07-14T10:50:57.798 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tlclk.ko 2023-07-14T10:50:57.799 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tpm 2023-07-14T10:50:57.799 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tpm/tpm.ko 2023-07-14T10:50:57.799 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tpm/tpm_atmel.ko 2023-07-14T10:50:57.799 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tpm/tpm_infineon.ko 2023-07-14T10:50:57.799 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tpm/tpm_nsc.ko 2023-07-14T10:50:57.799 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tpm/tpm_tis.ko 2023-07-14T10:50:57.799 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-07-14T10:50:57.799 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/uv_mmtimer.ko 2023-07-14T10:50:57.800 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/virtio_console.ko 2023-07-14T10:50:57.800 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/cpufreq 2023-07-14T10:50:57.800 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-07-14T10:50:57.800 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-07-14T10:50:57.800 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/cpufreq/p4-clockmod.ko 2023-07-14T10:50:57.801 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-07-14T10:50:57.801 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/cpufreq/powernow-k8.ko 2023-07-14T10:50:57.801 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/cpufreq/speedstep-lib.ko 2023-07-14T10:50:57.801 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto 2023-07-14T10:50:57.801 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/ccp 2023-07-14T10:50:57.801 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-07-14T10:50:57.801 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/ccp/ccp.ko 2023-07-14T10:50:57.802 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/intel 2023-07-14T10:50:57.802 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/intel/qat 2023-07-14T10:50:57.802 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/intel/qat/qat_common 2023-07-14T10:50:57.802 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-07-14T10:50:57.802 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-07-14T10:50:57.802 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-07-14T10:50:57.802 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/padlock-aes.ko 2023-07-14T10:50:57.802 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/padlock-sha.ko 2023-07-14T10:50:57.803 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/virtio 2023-07-14T10:50:57.803 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-07-14T10:50:57.803 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/dca 2023-07-14T10:50:57.803 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/dca/dca.ko 2023-07-14T10:50:57.803 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/devfreq 2023-07-14T10:50:57.803 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-07-14T10:50:57.803 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/dma 2023-07-14T10:50:57.804 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/dma/dw 2023-07-14T10:50:57.804 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/dma/dw/dw_dmac.ko 2023-07-14T10:50:57.804 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/dma/ioat 2023-07-14T10:50:57.804 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/dma/ioat/ioatdma.ko 2023-07-14T10:50:57.804 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac 2023-07-14T10:50:57.804 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/amd64_edac.ko 2023-07-14T10:50:57.804 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/e752x_edac.ko 2023-07-14T10:50:57.805 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/edac_mce_amd.ko 2023-07-14T10:50:57.805 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/i3000_edac.ko 2023-07-14T10:50:57.805 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/i3200_edac.ko 2023-07-14T10:50:57.805 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/i5100_edac.ko 2023-07-14T10:50:57.805 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/i5400_edac.ko 2023-07-14T10:50:57.805 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/i7300_edac.ko 2023-07-14T10:50:57.805 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/i7core_edac.ko 2023-07-14T10:50:57.806 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/i82975x_edac.ko 2023-07-14T10:50:57.806 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/ie31200_edac.ko 2023-07-14T10:50:57.806 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/sb_edac.ko 2023-07-14T10:50:57.806 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/x38_edac.ko 2023-07-14T10:50:57.806 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/firmware 2023-07-14T10:50:57.806 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/firmware/edd.ko 2023-07-14T10:50:57.806 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/firmware/iscsi_ibft.ko 2023-07-14T10:50:57.807 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio 2023-07-14T10:50:57.807 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/gpio-ich.ko 2023-07-14T10:50:57.807 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/gpio-viperboard.ko 2023-07-14T10:50:57.807 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid 2023-07-14T10:50:57.807 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-appleir.ko 2023-07-14T10:50:57.807 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-aureal.ko 2023-07-14T10:50:57.807 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-axff.ko 2023-07-14T10:50:57.807 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-dr.ko 2023-07-14T10:50:57.808 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-elecom.ko 2023-07-14T10:50:57.808 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-elo.ko 2023-07-14T10:50:57.808 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-emsff.ko 2023-07-14T10:50:57.808 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-gaff.ko 2023-07-14T10:50:57.808 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-gt683r.ko 2023-07-14T10:50:57.808 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-gyration.ko 2023-07-14T10:50:57.808 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-holtek-kbd.ko 2023-07-14T10:50:57.809 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-holtek-mouse.ko 2023-07-14T10:50:57.809 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-holtekff.ko 2023-07-14T10:50:57.809 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-hyperv.ko 2023-07-14T10:50:57.809 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-icade.ko 2023-07-14T10:50:57.809 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-keytouch.ko 2023-07-14T10:50:57.809 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-kye.ko 2023-07-14T10:50:57.809 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-lcpower.ko 2023-07-14T10:50:57.809 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-led.ko 2023-07-14T10:50:57.810 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-lenovo.ko 2023-07-14T10:50:57.810 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-logitech-dj.ko 2023-07-14T10:50:57.810 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-07-14T10:50:57.810 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-multitouch.ko 2023-07-14T10:50:57.810 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-ortek.ko 2023-07-14T10:50:57.810 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-penmount.ko 2023-07-14T10:50:57.810 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-petalynx.ko 2023-07-14T10:50:57.811 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-picolcd.ko 2023-07-14T10:50:57.811 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-pl.ko 2023-07-14T10:50:57.811 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-plantronics.ko 2023-07-14T10:50:57.811 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-primax.ko 2023-07-14T10:50:57.811 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-rmi.ko 2023-07-14T10:50:57.811 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-arvo.ko 2023-07-14T10:50:57.811 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-common.ko 2023-07-14T10:50:57.811 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-isku.ko 2023-07-14T10:50:57.812 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-kone.ko 2023-07-14T10:50:57.812 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-07-14T10:50:57.812 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-konepure.ko 2023-07-14T10:50:57.812 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-07-14T10:50:57.812 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-lua.ko 2023-07-14T10:50:57.812 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-pyra.ko 2023-07-14T10:50:57.812 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-ryos.ko 2023-07-14T10:50:57.813 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-savu.ko 2023-07-14T10:50:57.813 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat.ko 2023-07-14T10:50:57.813 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-saitek.ko 2023-07-14T10:50:57.813 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-samsung.ko 2023-07-14T10:50:57.813 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-sensor-hub.ko 2023-07-14T10:50:57.813 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-sjoy.ko 2023-07-14T10:50:57.813 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-sony.ko 2023-07-14T10:50:57.813 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-speedlink.ko 2023-07-14T10:50:57.814 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-steelseries.ko 2023-07-14T10:50:57.814 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-sunplus.ko 2023-07-14T10:50:57.814 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-thrustmaster.ko 2023-07-14T10:50:57.814 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-tivo.ko 2023-07-14T10:50:57.814 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-tmff.ko 2023-07-14T10:50:57.814 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-topseed.ko 2023-07-14T10:50:57.814 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-twinhan.ko 2023-07-14T10:50:57.815 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-uclogic.ko 2023-07-14T10:50:57.815 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-waltop.ko 2023-07-14T10:50:57.815 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-wiimote.ko 2023-07-14T10:50:57.815 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-xinmo.ko 2023-07-14T10:50:57.815 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-zpff.ko 2023-07-14T10:50:57.815 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-zydacron.ko 2023-07-14T10:50:57.815 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/uhid.ko 2023-07-14T10:50:57.815 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/wacom.ko 2023-07-14T10:50:57.816 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hv 2023-07-14T10:50:57.816 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hv/hv_balloon.ko 2023-07-14T10:50:57.816 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hv/hv_utils.ko 2023-07-14T10:50:57.816 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hv/hv_vmbus.ko 2023-07-14T10:50:57.816 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon 2023-07-14T10:50:57.816 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/abituguru.ko 2023-07-14T10:50:57.816 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/abituguru3.ko 2023-07-14T10:50:57.817 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/acpi_power_meter.ko 2023-07-14T10:50:57.817 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ad7414.ko 2023-07-14T10:50:57.817 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ad7418.ko 2023-07-14T10:50:57.817 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adc128d818.ko 2023-07-14T10:50:57.817 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adm1025.ko 2023-07-14T10:50:57.817 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adm1026.ko 2023-07-14T10:50:57.817 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adm1029.ko 2023-07-14T10:50:57.818 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adm1031.ko 2023-07-14T10:50:57.818 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adm9240.ko 2023-07-14T10:50:57.818 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ads7828.ko 2023-07-14T10:50:57.818 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adt7410.ko 2023-07-14T10:50:57.818 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adt7411.ko 2023-07-14T10:50:57.818 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adt7462.ko 2023-07-14T10:50:57.818 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adt7470.ko 2023-07-14T10:50:57.818 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adt7475.ko 2023-07-14T10:50:57.819 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adt7x10.ko 2023-07-14T10:50:57.819 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/amc6821.ko 2023-07-14T10:50:57.819 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/applesmc.ko 2023-07-14T10:50:57.819 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/asb100.ko 2023-07-14T10:50:57.819 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/asc7621.ko 2023-07-14T10:50:57.819 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/asus_atk0110.ko 2023-07-14T10:50:57.819 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/atxp1.ko 2023-07-14T10:50:57.820 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/coretemp.ko 2023-07-14T10:50:57.820 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-07-14T10:50:57.820 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/dme1737.ko 2023-07-14T10:50:57.820 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ds1621.ko 2023-07-14T10:50:57.820 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ds620.ko 2023-07-14T10:50:57.820 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/emc1403.ko 2023-07-14T10:50:57.820 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/emc6w201.ko 2023-07-14T10:50:57.821 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/f71805f.ko 2023-07-14T10:50:57.821 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/f71882fg.ko 2023-07-14T10:50:57.821 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/f75375s.ko 2023-07-14T10:50:57.821 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/fam15h_power.ko 2023-07-14T10:50:57.821 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/fschmd.ko 2023-07-14T10:50:57.821 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/g760a.ko 2023-07-14T10:50:57.821 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/g762.ko 2023-07-14T10:50:57.821 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/gl518sm.ko 2023-07-14T10:50:57.822 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/gl520sm.ko 2023-07-14T10:50:57.822 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/hwmon-vid.ko 2023-07-14T10:50:57.822 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/i5500_temp.ko 2023-07-14T10:50:57.822 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/i5k_amb.ko 2023-07-14T10:50:57.822 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ibmaem.ko 2023-07-14T10:50:57.822 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ibmpex.ko 2023-07-14T10:50:57.822 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ina209.ko 2023-07-14T10:50:57.823 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ina2xx.ko 2023-07-14T10:50:57.823 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/it87.ko 2023-07-14T10:50:57.823 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/k10temp.ko 2023-07-14T10:50:57.823 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/k8temp.ko 2023-07-14T10:50:57.823 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lineage-pem.ko 2023-07-14T10:50:57.823 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm63.ko 2023-07-14T10:50:57.823 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm73.ko 2023-07-14T10:50:57.823 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm75.ko 2023-07-14T10:50:57.824 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm77.ko 2023-07-14T10:50:57.824 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm78.ko 2023-07-14T10:50:57.824 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm80.ko 2023-07-14T10:50:57.824 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm83.ko 2023-07-14T10:50:57.824 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm85.ko 2023-07-14T10:50:57.824 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm87.ko 2023-07-14T10:50:57.824 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm90.ko 2023-07-14T10:50:57.825 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm92.ko 2023-07-14T10:50:57.825 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm93.ko 2023-07-14T10:50:57.825 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm95234.ko 2023-07-14T10:50:57.825 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm95241.ko 2023-07-14T10:50:57.825 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm95245.ko 2023-07-14T10:50:57.825 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ltc2945.ko 2023-07-14T10:50:57.825 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ltc4151.ko 2023-07-14T10:50:57.826 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ltc4215.ko 2023-07-14T10:50:57.826 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ltc4222.ko 2023-07-14T10:50:57.826 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ltc4245.ko 2023-07-14T10:50:57.826 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ltc4260.ko 2023-07-14T10:50:57.826 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ltc4261.ko 2023-07-14T10:50:57.826 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/max16065.ko 2023-07-14T10:50:57.826 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/max1619.ko 2023-07-14T10:50:57.826 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/max1668.ko 2023-07-14T10:50:57.827 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/max197.ko 2023-07-14T10:50:57.827 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/max6639.ko 2023-07-14T10:50:57.827 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/max6650.ko 2023-07-14T10:50:57.827 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/max6697.ko 2023-07-14T10:50:57.827 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/mcp3021.ko 2023-07-14T10:50:57.827 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/nct6683.ko 2023-07-14T10:50:57.827 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/nct6775-core.ko 2023-07-14T10:50:57.827 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/nct6775.ko 2023-07-14T10:50:57.828 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/nct7802.ko 2023-07-14T10:50:57.828 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pc87360.ko 2023-07-14T10:50:57.828 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pc87427.ko 2023-07-14T10:50:57.828 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pcf8591.ko 2023-07-14T10:50:57.828 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus 2023-07-14T10:50:57.828 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-07-14T10:50:57.828 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-07-14T10:50:57.829 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-07-14T10:50:57.829 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/max16064.ko 2023-07-14T10:50:57.829 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/max34440.ko 2023-07-14T10:50:57.829 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/max8688.ko 2023-07-14T10:50:57.829 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-07-14T10:50:57.829 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-07-14T10:50:57.829 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-07-14T10:50:57.829 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-07-14T10:50:57.830 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-07-14T10:50:57.830 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-07-14T10:50:57.830 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/powr1220.ko 2023-07-14T10:50:57.830 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/sch5627.ko 2023-07-14T10:50:57.830 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/sch5636.ko 2023-07-14T10:50:57.830 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/sch56xx-common.ko 2023-07-14T10:50:57.830 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/sht15.ko 2023-07-14T10:50:57.831 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/sht21.ko 2023-07-14T10:50:57.831 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/shtc1.ko 2023-07-14T10:50:57.831 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/sis5595.ko 2023-07-14T10:50:57.831 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/smsc47b397.ko 2023-07-14T10:50:57.831 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/smsc47m1.ko 2023-07-14T10:50:57.831 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/smsc47m192.ko 2023-07-14T10:50:57.831 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/thmc50.ko 2023-07-14T10:50:57.831 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/tmp102.ko 2023-07-14T10:50:57.832 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/tmp103.ko 2023-07-14T10:50:57.832 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/tmp401.ko 2023-07-14T10:50:57.832 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/tmp421.ko 2023-07-14T10:50:57.832 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/via-cputemp.ko 2023-07-14T10:50:57.832 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/via686a.ko 2023-07-14T10:50:57.832 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/vt1211.ko 2023-07-14T10:50:57.832 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/vt8231.ko 2023-07-14T10:50:57.833 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83627ehf.ko 2023-07-14T10:50:57.833 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83627hf.ko 2023-07-14T10:50:57.833 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83781d.ko 2023-07-14T10:50:57.833 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83791d.ko 2023-07-14T10:50:57.833 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83792d.ko 2023-07-14T10:50:57.833 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83793.ko 2023-07-14T10:50:57.833 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83795.ko 2023-07-14T10:50:57.833 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83l785ts.ko 2023-07-14T10:50:57.834 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83l786ng.ko 2023-07-14T10:50:57.834 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c 2023-07-14T10:50:57.834 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/algos 2023-07-14T10:50:57.834 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-07-14T10:50:57.834 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-07-14T10:50:57.834 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses 2023-07-14T10:50:57.834 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-07-14T10:50:57.835 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-07-14T10:50:57.835 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-07-14T10:50:57.835 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-07-14T10:50:57.835 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-07-14T10:50:57.835 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-07-14T10:50:57.835 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-07-14T10:50:57.835 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-07-14T10:50:57.836 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-i801.ko 2023-07-14T10:50:57.836 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-isch.ko 2023-07-14T10:50:57.836 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-07-14T10:50:57.836 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-07-14T10:50:57.836 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-07-14T10:50:57.836 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-parport.ko 2023-07-14T10:50:57.836 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-07-14T10:50:57.836 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-07-14T10:50:57.837 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-07-14T10:50:57.837 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-07-14T10:50:57.837 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-07-14T10:50:57.837 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-07-14T10:50:57.837 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-via.ko 2023-07-14T10:50:57.837 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-07-14T10:50:57.837 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-07-14T10:50:57.837 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/i2c-dev.ko 2023-07-14T10:50:57.838 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/i2c-mux.ko 2023-07-14T10:50:57.838 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-07-14T10:50:57.838 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/i2c-smbus.ko 2023-07-14T10:50:57.838 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/i2c-stub.ko 2023-07-14T10:50:57.838 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband 2023-07-14T10:50:57.838 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core 2023-07-14T10:50:57.838 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core/ib_cm.ko 2023-07-14T10:50:57.839 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core/ib_core.ko 2023-07-14T10:50:57.839 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core/ib_umad.ko 2023-07-14T10:50:57.839 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-07-14T10:50:57.839 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core/iw_cm.ko 2023-07-14T10:50:57.839 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core/rdma_cm.ko 2023-07-14T10:50:57.839 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-07-14T10:50:57.839 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw 2023-07-14T10:50:57.839 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/cxgb4 2023-07-14T10:50:57.840 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-07-14T10:50:57.840 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/mlx4 2023-07-14T10:50:57.840 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-07-14T10:50:57.840 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/mlx5 2023-07-14T10:50:57.840 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-07-14T10:50:57.840 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/mthca 2023-07-14T10:50:57.840 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-07-14T10:50:57.841 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp 2023-07-14T10:50:57.841 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/ipoib 2023-07-14T10:50:57.841 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-07-14T10:50:57.841 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/iser 2023-07-14T10:50:57.841 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-07-14T10:50:57.841 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/isert 2023-07-14T10:50:57.841 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-07-14T10:50:57.841 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/srp 2023-07-14T10:50:57.842 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-07-14T10:50:57.842 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/srpt 2023-07-14T10:50:57.842 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-07-14T10:50:57.842 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input 2023-07-14T10:50:57.842 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/gameport 2023-07-14T10:50:57.842 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-07-14T10:50:57.842 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/gameport/fm801-gp.ko 2023-07-14T10:50:57.843 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/gameport/gameport.ko 2023-07-14T10:50:57.843 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/gameport/lightning.ko 2023-07-14T10:50:57.843 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/gameport/ns558.ko 2023-07-14T10:50:57.843 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/joydev.ko 2023-07-14T10:50:57.843 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/keyboard 2023-07-14T10:50:57.843 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/keyboard/gpio_keys.ko 2023-07-14T10:50:57.843 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse 2023-07-14T10:50:57.843 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/appletouch.ko 2023-07-14T10:50:57.844 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/bcm5974.ko 2023-07-14T10:50:57.844 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/cyapatp.ko 2023-07-14T10:50:57.844 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/elan_i2c.ko 2023-07-14T10:50:57.844 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/sermouse.ko 2023-07-14T10:50:57.844 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-07-14T10:50:57.844 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/synaptics_usb.ko 2023-07-14T10:50:57.844 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/vsxxxaa.ko 2023-07-14T10:50:57.845 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/rmi4 2023-07-14T10:50:57.845 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/rmi4/rmi_core.ko 2023-07-14T10:50:57.845 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/serio 2023-07-14T10:50:57.845 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/serio/altera_ps2.ko 2023-07-14T10:50:57.845 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/serio/arc_ps2.ko 2023-07-14T10:50:57.845 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-07-14T10:50:57.845 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/serio/serio_raw.ko 2023-07-14T10:50:57.846 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/sparse-keymap.ko 2023-07-14T10:50:57.846 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/iommu 2023-07-14T10:50:57.846 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/iommu/amd 2023-07-14T10:50:57.846 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/iommu/amd/iommu_v2.ko 2023-07-14T10:50:57.846 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds 2023-07-14T10:50:57.846 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-blinkm.ko 2023-07-14T10:50:57.846 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-lm3530.ko 2023-07-14T10:50:57.846 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-lp3944.ko 2023-07-14T10:50:57.847 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-ss4200.ko 2023-07-14T10:50:57.847 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger 2023-07-14T10:50:57.847 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-07-14T10:50:57.847 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-07-14T10:50:57.847 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-07-14T10:50:57.847 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-07-14T10:50:57.847 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-07-14T10:50:57.847 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-07-14T10:50:57.848 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-07-14T10:50:57.848 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-07-14T10:50:57.848 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md 2023-07-14T10:50:57.848 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/bcache 2023-07-14T10:50:57.848 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/bcache/bcache.ko 2023-07-14T10:50:57.848 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-bio-prison.ko 2023-07-14T10:50:57.848 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-cache-smq.ko 2023-07-14T10:50:57.849 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-cache.ko 2023-07-14T10:50:57.849 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-crypt.ko 2023-07-14T10:50:57.849 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-delay.ko 2023-07-14T10:50:57.849 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-flakey.ko 2023-07-14T10:50:57.849 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-log-userspace.ko 2023-07-14T10:50:57.849 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-multipath.ko 2023-07-14T10:50:57.849 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-queue-length.ko 2023-07-14T10:50:57.849 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-raid.ko 2023-07-14T10:50:57.850 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-round-robin.ko 2023-07-14T10:50:57.850 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-service-time.ko 2023-07-14T10:50:57.850 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-switch.ko 2023-07-14T10:50:57.850 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-thin-pool.ko 2023-07-14T10:50:57.850 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-verity.ko 2023-07-14T10:50:57.850 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/faulty.ko 2023-07-14T10:50:57.850 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/linear.ko 2023-07-14T10:50:57.851 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/multipath.ko 2023-07-14T10:50:57.851 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/persistent-data 2023-07-14T10:50:57.851 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-07-14T10:50:57.851 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/raid0.ko 2023-07-14T10:50:57.851 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/raid1.ko 2023-07-14T10:50:57.851 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/raid10.ko 2023-07-14T10:50:57.851 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/raid456.ko 2023-07-14T10:50:57.852 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message 2023-07-14T10:50:57.852 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion 2023-07-14T10:50:57.852 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion/mptbase.ko 2023-07-14T10:50:57.852 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion/mptctl.ko 2023-07-14T10:50:57.852 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion/mptfc.ko 2023-07-14T10:50:57.852 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion/mptlan.ko 2023-07-14T10:50:57.852 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion/mptsas.ko 2023-07-14T10:50:57.852 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion/mptscsih.ko 2023-07-14T10:50:57.853 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion/mptspi.ko 2023-07-14T10:50:57.853 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd 2023-07-14T10:50:57.853 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/lpc_ich.ko 2023-07-14T10:50:57.853 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/lpc_sch.ko 2023-07-14T10:50:57.853 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/mfd-core.ko 2023-07-14T10:50:57.853 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/sm501.ko 2023-07-14T10:50:57.853 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/viperboard.ko 2023-07-14T10:50:57.854 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/vx855.ko 2023-07-14T10:50:57.854 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/wl1273-core.ko 2023-07-14T10:50:57.854 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc 2023-07-14T10:50:57.854 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/altera-stapl 2023-07-14T10:50:57.854 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-07-14T10:50:57.854 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/apds9802als.ko 2023-07-14T10:50:57.854 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/apds990x.ko 2023-07-14T10:50:57.854 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/bh1770glc.ko 2023-07-14T10:50:57.855 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/cb710 2023-07-14T10:50:57.855 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/cb710/cb710.ko 2023-07-14T10:50:57.855 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/eeprom 2023-07-14T10:50:57.855 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/eeprom/at24.ko 2023-07-14T10:50:57.855 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/eeprom/eeprom.ko 2023-07-14T10:50:57.855 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-07-14T10:50:57.855 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/eeprom/max6875.ko 2023-07-14T10:50:57.855 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/enclosure.ko 2023-07-14T10:50:57.856 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/hpilo.ko 2023-07-14T10:50:57.856 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/isl29003.ko 2023-07-14T10:50:57.856 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/isl29020.ko 2023-07-14T10:50:57.856 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/lis3lv02d 2023-07-14T10:50:57.856 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-07-14T10:50:57.856 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-07-14T10:50:57.856 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/mei 2023-07-14T10:50:57.857 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/mei/mei-me.ko 2023-07-14T10:50:57.857 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/mei/mei-txe.ko 2023-07-14T10:50:57.857 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/mei/mei.ko 2023-07-14T10:50:57.857 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/sgi-gru 2023-07-14T10:50:57.857 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/sgi-gru/gru.ko 2023-07-14T10:50:57.857 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/sgi-xp 2023-07-14T10:50:57.857 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/sgi-xp/xp.ko 2023-07-14T10:50:57.857 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/sgi-xp/xpc.ko 2023-07-14T10:50:57.858 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-07-14T10:50:57.858 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/tifm_7xx1.ko 2023-07-14T10:50:57.858 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/tifm_core.ko 2023-07-14T10:50:57.858 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/tsl2550.ko 2023-07-14T10:50:57.858 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/vmw_balloon.ko 2023-07-14T10:50:57.858 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/vmw_vmci 2023-07-14T10:50:57.858 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-07-14T10:50:57.859 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net 2023-07-14T10:50:57.859 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/bonding 2023-07-14T10:50:57.859 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/bonding/bonding.ko 2023-07-14T10:50:57.859 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dsa 2023-07-14T10:50:57.859 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dsa/b53 2023-07-14T10:50:57.859 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dsa/b53/b53_common.ko 2023-07-14T10:50:57.859 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dsa/bcm-sf2.ko 2023-07-14T10:50:57.859 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dsa/mv88e6060.ko 2023-07-14T10:50:57.860 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dsa/mv88e6xxx 2023-07-14T10:50:57.860 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-07-14T10:50:57.860 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dummy.ko 2023-07-14T10:50:57.860 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/eql.ko 2023-07-14T10:50:57.860 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet 2023-07-14T10:50:57.860 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/3com 2023-07-14T10:50:57.860 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-07-14T10:50:57.861 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-07-14T10:50:57.861 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-07-14T10:50:57.861 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-07-14T10:50:57.861 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/8390 2023-07-14T10:50:57.861 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/8390/8390.ko 2023-07-14T10:50:57.861 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-07-14T10:50:57.861 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-07-14T10:50:57.861 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-07-14T10:50:57.862 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/adaptec 2023-07-14T10:50:57.862 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-07-14T10:50:57.862 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/agere 2023-07-14T10:50:57.862 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/agere/et131x.ko 2023-07-14T10:50:57.862 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/alteon 2023-07-14T10:50:57.862 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-07-14T10:50:57.862 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/altera 2023-07-14T10:50:57.862 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-07-14T10:50:57.863 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/amd 2023-07-14T10:50:57.863 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-07-14T10:50:57.863 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-07-14T10:50:57.863 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-07-14T10:50:57.863 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros 2023-07-14T10:50:57.863 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/alx 2023-07-14T10:50:57.863 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-07-14T10:50:57.864 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/atl1c 2023-07-14T10:50:57.864 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-07-14T10:50:57.864 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/atl1e 2023-07-14T10:50:57.864 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-07-14T10:50:57.864 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/atlx 2023-07-14T10:50:57.864 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-07-14T10:50:57.864 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-07-14T10:50:57.864 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom 2023-07-14T10:50:57.865 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-07-14T10:50:57.865 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-07-14T10:50:57.865 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-07-14T10:50:57.865 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-07-14T10:50:57.865 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-07-14T10:50:57.865 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/genet 2023-07-14T10:50:57.865 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-07-14T10:50:57.866 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-07-14T10:50:57.866 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/brocade 2023-07-14T10:50:57.866 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/brocade/bna 2023-07-14T10:50:57.866 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-07-14T10:50:57.866 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio 2023-07-14T10:50:57.866 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb 2023-07-14T10:50:57.866 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-07-14T10:50:57.867 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-07-14T10:50:57.867 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-07-14T10:50:57.867 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-07-14T10:50:57.867 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-07-14T10:50:57.867 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-07-14T10:50:57.867 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-07-14T10:50:57.867 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-07-14T10:50:57.867 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-07-14T10:50:57.868 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/cisco 2023-07-14T10:50:57.868 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/cisco/enic 2023-07-14T10:50:57.868 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-07-14T10:50:57.868 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec 2023-07-14T10:50:57.868 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec/tulip 2023-07-14T10:50:57.868 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-07-14T10:50:57.868 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-07-14T10:50:57.869 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-07-14T10:50:57.869 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-07-14T10:50:57.869 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-07-14T10:50:57.869 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-07-14T10:50:57.869 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dlink 2023-07-14T10:50:57.869 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-07-14T10:50:57.869 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-07-14T10:50:57.869 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dnet.ko 2023-07-14T10:50:57.870 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/emulex 2023-07-14T10:50:57.870 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/emulex/benet 2023-07-14T10:50:57.870 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-07-14T10:50:57.870 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/ethoc.ko 2023-07-14T10:50:57.870 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/fealnx.ko 2023-07-14T10:50:57.870 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel 2023-07-14T10:50:57.870 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/e100.ko 2023-07-14T10:50:57.871 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/e1000 2023-07-14T10:50:57.871 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-07-14T10:50:57.871 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/e1000e 2023-07-14T10:50:57.871 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-07-14T10:50:57.871 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/fm10k 2023-07-14T10:50:57.871 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-07-14T10:50:57.871 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/i40e 2023-07-14T10:50:57.871 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-07-14T10:50:57.872 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/iavf 2023-07-14T10:50:57.872 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-07-14T10:50:57.872 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/igb 2023-07-14T10:50:57.872 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-07-14T10:50:57.872 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/igbvf 2023-07-14T10:50:57.872 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-07-14T10:50:57.872 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/ixgbe 2023-07-14T10:50:57.873 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-07-14T10:50:57.873 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/ixgbevf 2023-07-14T10:50:57.873 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-07-14T10:50:57.873 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/jme.ko 2023-07-14T10:50:57.873 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/marvell 2023-07-14T10:50:57.873 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-07-14T10:50:57.873 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/marvell/skge.ko 2023-07-14T10:50:57.873 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-07-14T10:50:57.874 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/mellanox 2023-07-14T10:50:57.874 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/mellanox/mlx4 2023-07-14T10:50:57.874 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-07-14T10:50:57.874 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-07-14T10:50:57.874 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/mellanox/mlx5 2023-07-14T10:50:57.874 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-07-14T10:50:57.874 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-07-14T10:50:57.874 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/micrel 2023-07-14T10:50:57.875 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-07-14T10:50:57.875 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/myricom 2023-07-14T10:50:57.875 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/myricom/myri10ge 2023-07-14T10:50:57.875 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-07-14T10:50:57.875 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/natsemi 2023-07-14T10:50:57.875 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-07-14T10:50:57.875 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-07-14T10:50:57.876 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/neterion 2023-07-14T10:50:57.876 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-07-14T10:50:57.876 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/nvidia 2023-07-14T10:50:57.876 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-07-14T10:50:57.876 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/packetengines 2023-07-14T10:50:57.876 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-07-14T10:50:57.876 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-07-14T10:50:57.876 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/qlogic 2023-07-14T10:50:57.877 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/qlogic/netxen 2023-07-14T10:50:57.877 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-07-14T10:50:57.877 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-07-14T10:50:57.877 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-07-14T10:50:57.877 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-07-14T10:50:57.877 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/rdc 2023-07-14T10:50:57.877 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-07-14T10:50:57.877 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/realtek 2023-07-14T10:50:57.878 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-07-14T10:50:57.878 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-07-14T10:50:57.878 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/realtek/atp.ko 2023-07-14T10:50:57.878 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-07-14T10:50:57.878 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/rocker 2023-07-14T10:50:57.878 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-07-14T10:50:57.878 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sfc 2023-07-14T10:50:57.879 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-07-14T10:50:57.879 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/silan 2023-07-14T10:50:57.879 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-07-14T10:50:57.879 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sis 2023-07-14T10:50:57.879 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sis/sis190.ko 2023-07-14T10:50:57.879 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sis/sis900.ko 2023-07-14T10:50:57.879 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/smsc 2023-07-14T10:50:57.879 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-07-14T10:50:57.880 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-07-14T10:50:57.880 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-07-14T10:50:57.880 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-07-14T10:50:57.880 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/stmicro 2023-07-14T10:50:57.880 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/stmicro/stmmac 2023-07-14T10:50:57.880 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-07-14T10:50:57.880 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-07-14T10:50:57.881 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sun 2023-07-14T10:50:57.881 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sun/cassini.ko 2023-07-14T10:50:57.881 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sun/niu.ko 2023-07-14T10:50:57.881 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sun/sungem.ko 2023-07-14T10:50:57.881 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-07-14T10:50:57.881 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/tehuti 2023-07-14T10:50:57.881 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-07-14T10:50:57.881 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/ti 2023-07-14T10:50:57.882 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/ti/tlan.ko 2023-07-14T10:50:57.882 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/via 2023-07-14T10:50:57.882 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-07-14T10:50:57.882 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-07-14T10:50:57.882 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/wiznet 2023-07-14T10:50:57.882 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-07-14T10:50:57.882 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-07-14T10:50:57.883 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/xircom 2023-07-14T10:50:57.883 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-07-14T10:50:57.883 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/geneve.ko 2023-07-14T10:50:57.883 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/hyperv 2023-07-14T10:50:57.883 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-07-14T10:50:57.883 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ieee802154 2023-07-14T10:50:57.883 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ieee802154/fakelb.ko 2023-07-14T10:50:57.883 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ifb.ko 2023-07-14T10:50:57.884 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ipvlan 2023-07-14T10:50:57.884 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ipvlan/ipvlan.ko 2023-07-14T10:50:57.884 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/macvlan.ko 2023-07-14T10:50:57.884 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/macvtap.ko 2023-07-14T10:50:57.884 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/mdio 2023-07-14T10:50:57.884 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/mdio.ko 2023-07-14T10:50:57.884 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-07-14T10:50:57.884 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-07-14T10:50:57.885 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/mdio/mdio-regmap.ko 2023-07-14T10:50:57.885 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/mii.ko 2023-07-14T10:50:57.885 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/net_failover.ko 2023-07-14T10:50:57.885 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/netconsole.ko 2023-07-14T10:50:57.885 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/nlmon.ko 2023-07-14T10:50:57.885 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/pcs 2023-07-14T10:50:57.885 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/pcs/pcs-lynx.ko 2023-07-14T10:50:57.886 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-07-14T10:50:57.886 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy 2023-07-14T10:50:57.886 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/amd.ko 2023-07-14T10:50:57.886 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-07-14T10:50:57.886 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-07-14T10:50:57.887 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/bcm7xxx.ko 2023-07-14T10:50:57.887 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/bcm87xx.ko 2023-07-14T10:50:57.887 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/broadcom.ko 2023-07-14T10:50:57.887 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/cicada.ko 2023-07-14T10:50:57.887 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/davicom.ko 2023-07-14T10:50:57.887 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/dp83640.ko 2023-07-14T10:50:57.887 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/et1011c.ko 2023-07-14T10:50:57.888 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/icplus.ko 2023-07-14T10:50:57.888 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/lxt.ko 2023-07-14T10:50:57.888 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/marvell.ko 2023-07-14T10:50:57.888 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/micrel.ko 2023-07-14T10:50:57.888 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/national.ko 2023-07-14T10:50:57.888 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/phylink.ko 2023-07-14T10:50:57.888 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/qsemi.ko 2023-07-14T10:50:57.889 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/realtek.ko 2023-07-14T10:50:57.889 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/smsc.ko 2023-07-14T10:50:57.889 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/ste10Xp.ko 2023-07-14T10:50:57.889 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/vitesse.ko 2023-07-14T10:50:57.889 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp 2023-07-14T10:50:57.889 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/bsd_comp.ko 2023-07-14T10:50:57.889 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/ppp_async.ko 2023-07-14T10:50:57.889 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/ppp_deflate.ko 2023-07-14T10:50:57.890 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/ppp_generic.ko 2023-07-14T10:50:57.890 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/ppp_mppe.ko 2023-07-14T10:50:57.890 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/ppp_synctty.ko 2023-07-14T10:50:57.890 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/pppoe.ko 2023-07-14T10:50:57.890 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/pppox.ko 2023-07-14T10:50:57.890 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/pptp.ko 2023-07-14T10:50:57.890 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/slip 2023-07-14T10:50:57.891 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/slip/slhc.ko 2023-07-14T10:50:57.891 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/slip/slip.ko 2023-07-14T10:50:57.891 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/sungem_phy.ko 2023-07-14T10:50:57.891 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/tap.ko 2023-07-14T10:50:57.891 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/team 2023-07-14T10:50:57.891 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/team/team.ko 2023-07-14T10:50:57.891 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/team/team_mode_activebackup.ko 2023-07-14T10:50:57.891 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/team/team_mode_broadcast.ko 2023-07-14T10:50:57.892 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-07-14T10:50:57.892 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/team/team_mode_random.ko 2023-07-14T10:50:57.892 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-07-14T10:50:57.892 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/tun.ko 2023-07-14T10:50:57.892 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/veth.ko 2023-07-14T10:50:57.892 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/virtio_net.ko 2023-07-14T10:50:57.892 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/vmxnet3 2023-07-14T10:50:57.893 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-07-14T10:50:57.893 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/vxlan 2023-07-14T10:50:57.893 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/vxlan/vxlan.ko 2023-07-14T10:50:57.893 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/xen-netback 2023-07-14T10:50:57.893 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/xen-netback/xen-netback.ko 2023-07-14T10:50:57.893 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/xen-netfront.ko 2023-07-14T10:50:57.893 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ntb 2023-07-14T10:50:57.894 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ntb/ntb.ko 2023-07-14T10:50:57.894 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/nvme 2023-07-14T10:50:57.894 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/nvme/host 2023-07-14T10:50:57.894 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/nvme/host/nvme-core.ko 2023-07-14T10:50:57.894 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/nvme/host/nvme.ko 2023-07-14T10:50:57.894 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/parport 2023-07-14T10:50:57.894 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/parport/parport.ko 2023-07-14T10:50:57.894 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/parport/parport_cs.ko 2023-07-14T10:50:57.895 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/parport/parport_pc.ko 2023-07-14T10:50:57.895 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/parport/parport_serial.ko 2023-07-14T10:50:57.895 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pci 2023-07-14T10:50:57.895 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pci/hotplug 2023-07-14T10:50:57.895 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-07-14T10:50:57.895 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pci/pcie 2023-07-14T10:50:57.895 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pci/pcie/aer_inject.ko 2023-07-14T10:50:57.896 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pci/xen-pcifront.ko 2023-07-14T10:50:57.896 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pcmcia 2023-07-14T10:50:57.896 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pcmcia/i82092.ko 2023-07-14T10:50:57.896 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pcmcia/pd6729.ko 2023-07-14T10:50:57.896 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pcmcia/yenta_socket.ko 2023-07-14T10:50:57.897 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pinctrl 2023-07-14T10:50:57.897 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pinctrl/intel 2023-07-14T10:50:57.897 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-07-14T10:50:57.897 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform 2023-07-14T10:50:57.897 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86 2023-07-14T10:50:57.897 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/acer-wmi.ko 2023-07-14T10:50:57.897 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/acerhdf.ko 2023-07-14T10:50:57.898 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/apple-gmux.ko 2023-07-14T10:50:57.898 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/asus-laptop.ko 2023-07-14T10:50:57.898 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-07-14T10:50:57.898 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/asus-wmi.ko 2023-07-14T10:50:57.898 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/classmate-laptop.ko 2023-07-14T10:50:57.898 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-07-14T10:50:57.898 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-07-14T10:50:57.898 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-07-14T10:50:57.899 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-07-14T10:50:57.899 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/hdaps.ko 2023-07-14T10:50:57.899 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/intel 2023-07-14T10:50:57.899 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-07-14T10:50:57.899 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/intel_ips.ko 2023-07-14T10:50:57.899 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/msi-wmi.ko 2023-07-14T10:50:57.899 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/mxm-wmi.ko 2023-07-14T10:50:57.900 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-07-14T10:50:57.900 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/samsung-laptop.ko 2023-07-14T10:50:57.900 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/samsung-q10.ko 2023-07-14T10:50:57.900 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/topstar-laptop.ko 2023-07-14T10:50:57.901 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-07-14T10:50:57.901 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/toshiba_haps.ko 2023-07-14T10:50:57.901 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/wmi-bmof.ko 2023-07-14T10:50:57.901 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/wmi.ko 2023-07-14T10:50:57.901 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/powercap 2023-07-14T10:50:57.901 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/powercap/intel_rapl_common.ko 2023-07-14T10:50:57.901 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/powercap/intel_rapl_msr.ko 2023-07-14T10:50:57.901 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pps 2023-07-14T10:50:57.902 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pps/clients 2023-07-14T10:50:57.902 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pps/clients/pps-gpio.ko 2023-07-14T10:50:57.902 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pps/clients/pps-ldisc.ko 2023-07-14T10:50:57.902 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pps/clients/pps_parport.ko 2023-07-14T10:50:57.903 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pps/pps_core.ko 2023-07-14T10:50:57.903 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ptp 2023-07-14T10:50:57.903 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ptp/ptp.ko 2023-07-14T10:50:57.903 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ptp/ptp_kvm.ko 2023-07-14T10:50:57.904 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc 2023-07-14T10:50:57.904 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-bq32k.ko 2023-07-14T10:50:57.904 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-bq4802.ko 2023-07-14T10:50:57.905 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds1286.ko 2023-07-14T10:50:57.905 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds1307.ko 2023-07-14T10:50:57.905 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds1374.ko 2023-07-14T10:50:57.906 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds1511.ko 2023-07-14T10:50:57.906 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds1553.ko 2023-07-14T10:50:57.906 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds1672.ko 2023-07-14T10:50:57.906 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds1742.ko 2023-07-14T10:50:57.907 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds2404.ko 2023-07-14T10:50:57.907 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds3232.ko 2023-07-14T10:50:57.907 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-em3027.ko 2023-07-14T10:50:57.907 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-fm3130.ko 2023-07-14T10:50:57.908 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-isl12022.ko 2023-07-14T10:50:57.909 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-isl1208.ko 2023-07-14T10:50:57.909 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-m41t80.ko 2023-07-14T10:50:57.910 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-m48t35.ko 2023-07-14T10:50:57.910 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-m48t59.ko 2023-07-14T10:50:57.910 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-max6900.ko 2023-07-14T10:50:57.910 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-msm6242.ko 2023-07-14T10:50:57.911 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-pcf2127.ko 2023-07-14T10:50:57.911 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-pcf85063.ko 2023-07-14T10:50:57.911 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-pcf8523.ko 2023-07-14T10:50:57.911 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-pcf8563.ko 2023-07-14T10:50:57.912 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-pcf8583.ko 2023-07-14T10:50:57.912 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-rp5c01.ko 2023-07-14T10:50:57.912 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-rs5c372.ko 2023-07-14T10:50:57.913 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-07-14T10:50:57.913 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-rx8025.ko 2023-07-14T10:50:57.913 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-rx8581.ko 2023-07-14T10:50:57.914 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-07-14T10:50:57.914 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-x1205.ko 2023-07-14T10:50:57.914 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi 2023-07-14T10:50:57.914 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/3w-9xxx.ko 2023-07-14T10:50:57.915 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/3w-sas.ko 2023-07-14T10:50:57.915 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/3w-xxxx.ko 2023-07-14T10:50:57.915 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/BusLogic.ko 2023-07-14T10:50:57.916 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/a100u2w.ko 2023-07-14T10:50:57.916 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/aacraid 2023-07-14T10:50:57.916 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/aacraid/aacraid.ko 2023-07-14T10:50:57.917 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/advansys.ko 2023-07-14T10:50:57.917 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/aic7xxx 2023-07-14T10:50:57.917 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-07-14T10:50:57.918 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-07-14T10:50:57.918 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/am53c974.ko 2023-07-14T10:50:57.918 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/arcmsr 2023-07-14T10:50:57.918 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-07-14T10:50:57.918 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/atp870u.ko 2023-07-14T10:50:57.919 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/be2iscsi 2023-07-14T10:50:57.919 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-07-14T10:50:57.919 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/bfa 2023-07-14T10:50:57.919 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/bfa/bfa.ko 2023-07-14T10:50:57.920 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/bnx2fc 2023-07-14T10:50:57.920 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-07-14T10:50:57.920 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/bnx2i 2023-07-14T10:50:57.921 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-07-14T10:50:57.921 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/ch.ko 2023-07-14T10:50:57.921 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/csiostor 2023-07-14T10:50:57.921 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/csiostor/csiostor.ko 2023-07-14T10:50:57.922 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/cxgbi 2023-07-14T10:50:57.922 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/cxgbi/cxgb3i 2023-07-14T10:50:57.922 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-07-14T10:50:57.922 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/cxgbi/cxgb4i 2023-07-14T10:50:57.922 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-07-14T10:50:57.922 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-07-14T10:50:57.922 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/dc395x.ko 2023-07-14T10:50:57.923 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/device_handler 2023-07-14T10:50:57.923 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-07-14T10:50:57.923 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-07-14T10:50:57.923 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-07-14T10:50:57.923 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-07-14T10:50:57.923 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/dmx3191d.ko 2023-07-14T10:50:57.923 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/esas2r 2023-07-14T10:50:57.923 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/esas2r/esas2r.ko 2023-07-14T10:50:57.924 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/esp_scsi.ko 2023-07-14T10:50:57.924 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/fcoe 2023-07-14T10:50:57.924 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/fcoe/fcoe.ko 2023-07-14T10:50:57.924 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-07-14T10:50:57.924 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/fnic 2023-07-14T10:50:57.924 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/fnic/fnic.ko 2023-07-14T10:50:57.924 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/hpsa.ko 2023-07-14T10:50:57.925 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/hptiop.ko 2023-07-14T10:50:57.925 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/hv_storvsc.ko 2023-07-14T10:50:57.925 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/initio.ko 2023-07-14T10:50:57.925 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/ipr.ko 2023-07-14T10:50:57.925 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/ips.ko 2023-07-14T10:50:57.925 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/isci 2023-07-14T10:50:57.926 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/isci/isci.ko 2023-07-14T10:50:57.926 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-07-14T10:50:57.926 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/iscsi_tcp.ko 2023-07-14T10:50:57.927 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/libfc 2023-07-14T10:50:57.927 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/libfc/libfc.ko 2023-07-14T10:50:57.927 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/libiscsi.ko 2023-07-14T10:50:57.927 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/libiscsi_tcp.ko 2023-07-14T10:50:57.928 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/libsas 2023-07-14T10:50:57.928 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/libsas/libsas.ko 2023-07-14T10:50:57.928 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/lpfc 2023-07-14T10:50:57.929 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/lpfc/lpfc.ko 2023-07-14T10:50:57.929 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/megaraid 2023-07-14T10:50:57.929 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/megaraid.ko 2023-07-14T10:50:57.929 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-07-14T10:50:57.930 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-07-14T10:50:57.930 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-07-14T10:50:57.930 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/mpt3sas 2023-07-14T10:50:57.930 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-07-14T10:50:57.931 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/mvsas 2023-07-14T10:50:57.931 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/mvsas/mvsas.ko 2023-07-14T10:50:57.931 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/mvumi.ko 2023-07-14T10:50:57.932 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/pm8001 2023-07-14T10:50:57.932 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-07-14T10:50:57.932 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/pmcraid.ko 2023-07-14T10:50:57.933 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/qla1280.ko 2023-07-14T10:50:57.933 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/qla2xxx 2023-07-14T10:50:57.933 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-07-14T10:50:57.933 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-07-14T10:50:57.933 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/qla4xxx 2023-07-14T10:50:57.934 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-07-14T10:50:57.934 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/raid_class.ko 2023-07-14T10:50:57.934 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/scsi_debug.ko 2023-07-14T10:50:57.934 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/scsi_transport_fc.ko 2023-07-14T10:50:57.934 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-07-14T10:50:57.934 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/scsi_transport_sas.ko 2023-07-14T10:50:57.935 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/scsi_transport_spi.ko 2023-07-14T10:50:57.935 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/scsi_transport_srp.ko 2023-07-14T10:50:57.935 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/ses.ko 2023-07-14T10:50:57.935 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/st.ko 2023-07-14T10:50:57.935 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/stex.ko 2023-07-14T10:50:57.935 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/sym53c8xx_2 2023-07-14T10:50:57.935 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-07-14T10:50:57.936 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/virtio_scsi.ko 2023-07-14T10:50:57.936 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/vmw_pvscsi.ko 2023-07-14T10:50:57.936 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/wd719x.ko 2023-07-14T10:50:57.936 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ssb 2023-07-14T10:50:57.937 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ssb/ssb.ko 2023-07-14T10:50:57.937 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target 2023-07-14T10:50:57.937 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/iscsi 2023-07-14T10:50:57.937 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-07-14T10:50:57.938 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/loopback 2023-07-14T10:50:57.938 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/loopback/tcm_loop.ko 2023-07-14T10:50:57.938 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/target_core_file.ko 2023-07-14T10:50:57.938 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/target_core_iblock.ko 2023-07-14T10:50:57.938 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/target_core_mod.ko 2023-07-14T10:50:57.938 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/target_core_pscsi.ko 2023-07-14T10:50:57.938 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/target_core_user.ko 2023-07-14T10:50:57.938 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/tcm_fc 2023-07-14T10:50:57.939 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-07-14T10:50:57.939 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal 2023-07-14T10:50:57.939 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel 2023-07-14T10:50:57.939 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal 2023-07-14T10:50:57.940 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-07-14T10:50:57.940 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-07-14T10:50:57.940 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-07-14T10:50:57.940 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-07-14T10:50:57.940 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-07-14T10:50:57.941 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-07-14T10:50:57.941 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-07-14T10:50:57.941 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-07-14T10:50:57.941 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-07-14T10:50:57.941 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-07-14T10:50:57.941 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-07-14T10:50:57.941 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-07-14T10:50:57.942 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-07-14T10:50:57.942 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-07-14T10:50:57.942 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-07-14T10:50:57.942 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty 2023-07-14T10:50:57.942 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/ipwireless 2023-07-14T10:50:57.942 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-07-14T10:50:57.942 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/n_gsm.ko 2023-07-14T10:50:57.943 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/n_hdlc.ko 2023-07-14T10:50:57.943 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/nozomi.ko 2023-07-14T10:50:57.943 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/serial 2023-07-14T10:50:57.943 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/serial/8250 2023-07-14T10:50:57.943 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-07-14T10:50:57.943 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/serial/arc_uart.ko 2023-07-14T10:50:57.944 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/serial/jsm 2023-07-14T10:50:57.944 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/serial/jsm/jsm.ko 2023-07-14T10:50:57.944 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/synclink_gt.ko 2023-07-14T10:50:57.944 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ufs 2023-07-14T10:50:57.944 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ufs/core 2023-07-14T10:50:57.944 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ufs/core/ufshcd-core.ko 2023-07-14T10:50:57.944 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ufs/host 2023-07-14T10:50:57.945 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-07-14T10:50:57.945 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/uio 2023-07-14T10:50:57.945 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/uio/uio.ko 2023-07-14T10:50:57.945 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/uio/uio_aec.ko 2023-07-14T10:50:57.945 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/uio/uio_cif.ko 2023-07-14T10:50:57.945 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/uio/uio_pci_generic.ko 2023-07-14T10:50:57.945 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/uio/uio_sercos3.ko 2023-07-14T10:50:57.945 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb 2023-07-14T10:50:57.946 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/class 2023-07-14T10:50:57.946 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/class/cdc-acm.ko 2023-07-14T10:50:57.946 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/class/cdc-wdm.ko 2023-07-14T10:50:57.946 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/class/usblp.ko 2023-07-14T10:50:57.946 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/class/usbtmc.ko 2023-07-14T10:50:57.946 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/host 2023-07-14T10:50:57.946 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/host/sl811-hcd.ko 2023-07-14T10:50:57.947 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/image 2023-07-14T10:50:57.947 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/image/mdc800.ko 2023-07-14T10:50:57.947 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/image/microtek.ko 2023-07-14T10:50:57.947 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc 2023-07-14T10:50:57.947 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/adutux.ko 2023-07-14T10:50:57.947 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/appledisplay.ko 2023-07-14T10:50:57.947 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/emi26.ko 2023-07-14T10:50:57.947 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/emi62.ko 2023-07-14T10:50:57.948 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/ezusb.ko 2023-07-14T10:50:57.948 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/idmouse.ko 2023-07-14T10:50:57.948 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/iowarrior.ko 2023-07-14T10:50:57.948 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/isight_firmware.ko 2023-07-14T10:50:57.948 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/ldusb.ko 2023-07-14T10:50:57.948 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/legousbtower.ko 2023-07-14T10:50:57.948 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/sisusbvga 2023-07-14T10:50:57.948 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-07-14T10:50:57.949 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/trancevibrator.ko 2023-07-14T10:50:57.949 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/usb3503.ko 2023-07-14T10:50:57.949 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/usblcd.ko 2023-07-14T10:50:57.949 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/usbsevseg.ko 2023-07-14T10:50:57.949 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/uss720.ko 2023-07-14T10:50:57.949 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/yurex.ko 2023-07-14T10:50:57.949 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/phy 2023-07-14T10:50:57.950 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/phy/phy-generic.ko 2023-07-14T10:50:57.950 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial 2023-07-14T10:50:57.950 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/aircable.ko 2023-07-14T10:50:57.950 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ark3116.ko 2023-07-14T10:50:57.950 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/belkin_sa.ko 2023-07-14T10:50:57.950 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ch341.ko 2023-07-14T10:50:57.950 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/cp210x.ko 2023-07-14T10:50:57.950 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/cyberjack.ko 2023-07-14T10:50:57.951 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/cypress_m8.ko 2023-07-14T10:50:57.951 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/digi_acceleport.ko 2023-07-14T10:50:57.951 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/empeg.ko 2023-07-14T10:50:57.951 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ftdi_sio.ko 2023-07-14T10:50:57.951 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/garmin_gps.ko 2023-07-14T10:50:57.951 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/io_edgeport.ko 2023-07-14T10:50:57.951 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/io_ti.ko 2023-07-14T10:50:57.951 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ipaq.ko 2023-07-14T10:50:57.952 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ipw.ko 2023-07-14T10:50:57.952 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ir-usb.ko 2023-07-14T10:50:57.952 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-07-14T10:50:57.952 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/keyspan.ko 2023-07-14T10:50:57.952 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/keyspan_pda.ko 2023-07-14T10:50:57.952 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/kl5kusb105.ko 2023-07-14T10:50:57.952 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/kobil_sct.ko 2023-07-14T10:50:57.953 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/mct_u232.ko 2023-07-14T10:50:57.953 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/mos7720.ko 2023-07-14T10:50:57.953 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/mos7840.ko 2023-07-14T10:50:57.953 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/navman.ko 2023-07-14T10:50:57.953 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/omninet.ko 2023-07-14T10:50:57.953 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/opticon.ko 2023-07-14T10:50:57.953 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/option.ko 2023-07-14T10:50:57.953 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/oti6858.ko 2023-07-14T10:50:57.954 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/pl2303.ko 2023-07-14T10:50:57.954 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/qcaux.ko 2023-07-14T10:50:57.954 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/qcserial.ko 2023-07-14T10:50:57.954 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/quatech2.ko 2023-07-14T10:50:57.954 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/safe_serial.ko 2023-07-14T10:50:57.954 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/sierra.ko 2023-07-14T10:50:57.954 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/spcp8x5.ko 2023-07-14T10:50:57.955 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ssu100.ko 2023-07-14T10:50:57.955 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/symbolserial.ko 2023-07-14T10:50:57.955 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-07-14T10:50:57.955 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-07-14T10:50:57.955 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/usb_debug.ko 2023-07-14T10:50:57.955 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/usb_wwan.ko 2023-07-14T10:50:57.955 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/visor.ko 2023-07-14T10:50:57.955 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/whiteheat.ko 2023-07-14T10:50:57.956 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/xsens_mt.ko 2023-07-14T10:50:57.956 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage 2023-07-14T10:50:57.956 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/uas.ko 2023-07-14T10:50:57.956 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-alauda.ko 2023-07-14T10:50:57.956 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-cypress.ko 2023-07-14T10:50:57.956 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-datafab.ko 2023-07-14T10:50:57.956 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-07-14T10:50:57.957 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-freecom.ko 2023-07-14T10:50:57.957 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-isd200.ko 2023-07-14T10:50:57.957 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-07-14T10:50:57.957 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-karma.ko 2023-07-14T10:50:57.957 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-onetouch.ko 2023-07-14T10:50:57.957 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-realtek.ko 2023-07-14T10:50:57.957 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-sddr09.ko 2023-07-14T10:50:57.958 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-sddr55.ko 2023-07-14T10:50:57.958 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-usbat.ko 2023-07-14T10:50:57.958 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/usb-storage.ko 2023-07-14T10:50:57.958 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/usbip 2023-07-14T10:50:57.958 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/usbip/usbip-core.ko 2023-07-14T10:50:57.958 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/usbip/usbip-host.ko 2023-07-14T10:50:57.958 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-07-14T10:50:57.958 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vfio 2023-07-14T10:50:57.959 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vfio/pci 2023-07-14T10:50:57.959 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-07-14T10:50:57.959 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vfio/pci/vfio-pci.ko 2023-07-14T10:50:57.959 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vfio/vfio.ko 2023-07-14T10:50:57.959 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-07-14T10:50:57.959 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vhost 2023-07-14T10:50:57.959 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vhost/vhost.ko 2023-07-14T10:50:57.960 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vhost/vhost_iotlb.ko 2023-07-14T10:50:57.960 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vhost/vhost_net.ko 2023-07-14T10:50:57.960 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vhost/vhost_scsi.ko 2023-07-14T10:50:57.960 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video 2023-07-14T10:50:57.960 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight 2023-07-14T10:50:57.960 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight/apple_bl.ko 2023-07-14T10:50:57.960 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight/lcd.ko 2023-07-14T10:50:57.960 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight/platform_lcd.ko 2023-07-14T10:50:57.961 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/virtio 2023-07-14T10:50:57.961 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/virtio/virtio.ko 2023-07-14T10:50:57.961 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/virtio/virtio_balloon.ko 2023-07-14T10:50:57.961 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/virtio/virtio_mmio.ko 2023-07-14T10:50:57.961 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/virtio/virtio_pci.ko 2023-07-14T10:50:57.961 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-07-14T10:50:57.961 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-07-14T10:50:57.962 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/virtio/virtio_ring.ko 2023-07-14T10:50:57.962 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1 2023-07-14T10:50:57.962 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/masters 2023-07-14T10:50:57.962 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/masters/ds2482.ko 2023-07-14T10:50:57.962 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/masters/ds2490.ko 2023-07-14T10:50:57.962 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves 2023-07-14T10:50:57.962 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-07-14T10:50:57.962 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-07-14T10:50:57.963 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-07-14T10:50:57.963 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-07-14T10:50:57.963 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-07-14T10:50:57.963 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-07-14T10:50:57.963 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-07-14T10:50:57.963 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-07-14T10:50:57.963 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-07-14T10:50:57.964 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_smem.ko 2023-07-14T10:50:57.964 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_therm.ko 2023-07-14T10:50:57.964 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/wire.ko 2023-07-14T10:50:57.964 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog 2023-07-14T10:50:57.964 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/alim1535_wdt.ko 2023-07-14T10:50:57.964 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/alim7101_wdt.ko 2023-07-14T10:50:57.964 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/f71808e_wdt.ko 2023-07-14T10:50:57.964 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/hpwdt.ko 2023-07-14T10:50:57.965 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/i6300esb.ko 2023-07-14T10:50:57.965 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-07-14T10:50:57.965 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/iTCO_wdt.ko 2023-07-14T10:50:57.965 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/ib700wdt.ko 2023-07-14T10:50:57.965 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/ibmasr.ko 2023-07-14T10:50:57.965 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-07-14T10:50:57.965 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/it8712f_wdt.ko 2023-07-14T10:50:57.966 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/it87_wdt.ko 2023-07-14T10:50:57.966 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/machzwd.ko 2023-07-14T10:50:57.966 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/nv_tco.ko 2023-07-14T10:50:57.966 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/pcwd_pci.ko 2023-07-14T10:50:57.966 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/pcwd_usb.ko 2023-07-14T10:50:57.966 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-07-14T10:50:57.966 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/sch311x_wdt.ko 2023-07-14T10:50:57.967 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/softdog.ko 2023-07-14T10:50:57.967 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/sp5100_tco.ko 2023-07-14T10:50:57.967 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/via_wdt.ko 2023-07-14T10:50:57.967 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-07-14T10:50:57.967 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/w83877f_wdt.ko 2023-07-14T10:50:57.967 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/w83977f_wdt.ko 2023-07-14T10:50:57.967 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/wdt_pci.ko 2023-07-14T10:50:57.967 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/xen_wdt.ko 2023-07-14T10:50:57.968 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen 2023-07-14T10:50:57.968 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xen-acpi-processor.ko 2023-07-14T10:50:57.968 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xen-evtchn.ko 2023-07-14T10:50:57.968 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xen-gntalloc.ko 2023-07-14T10:50:57.968 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xen-gntdev.ko 2023-07-14T10:50:57.968 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xen-pciback 2023-07-14T10:50:57.968 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-07-14T10:50:57.972 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xen-privcmd.ko 2023-07-14T10:50:57.972 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xenfs 2023-07-14T10:50:57.972 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xenfs/xenfs.ko 2023-07-14T10:50:57.973 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs 2023-07-14T10:50:57.973 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/9p 2023-07-14T10:50:57.973 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/9p/9p.ko 2023-07-14T10:50:57.973 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/affs 2023-07-14T10:50:57.973 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/affs/affs.ko 2023-07-14T10:50:57.973 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/befs 2023-07-14T10:50:57.973 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/befs/befs.ko 2023-07-14T10:50:57.974 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/binfmt_misc.ko 2023-07-14T10:50:57.974 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/btrfs 2023-07-14T10:50:57.974 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/btrfs/btrfs.ko 2023-07-14T10:50:57.974 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/cachefiles 2023-07-14T10:50:57.974 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/cachefiles/cachefiles.ko 2023-07-14T10:50:57.974 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ceph 2023-07-14T10:50:57.974 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ceph/ceph.ko 2023-07-14T10:50:57.975 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/coda 2023-07-14T10:50:57.975 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/coda/coda.ko 2023-07-14T10:50:57.975 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/cramfs 2023-07-14T10:50:57.975 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/cramfs/cramfs.ko 2023-07-14T10:50:57.975 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/dlm 2023-07-14T10:50:57.975 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/dlm/dlm.ko 2023-07-14T10:50:57.975 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ecryptfs 2023-07-14T10:50:57.975 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ecryptfs/ecryptfs.ko 2023-07-14T10:50:57.976 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/f2fs 2023-07-14T10:50:57.976 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/f2fs/f2fs.ko 2023-07-14T10:50:57.976 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fat 2023-07-14T10:50:57.976 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fat/fat.ko 2023-07-14T10:50:57.976 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fat/msdos.ko 2023-07-14T10:50:57.976 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fat/vfat.ko 2023-07-14T10:50:57.976 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fscache 2023-07-14T10:50:57.977 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fscache/fscache.ko 2023-07-14T10:50:57.977 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fuse 2023-07-14T10:50:57.977 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fuse/cuse.ko 2023-07-14T10:50:57.977 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fuse/fuse.ko 2023-07-14T10:50:57.977 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/gfs2 2023-07-14T10:50:57.977 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/gfs2/gfs2.ko 2023-07-14T10:50:57.977 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/hfs 2023-07-14T10:50:57.978 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/hfs/hfs.ko 2023-07-14T10:50:57.978 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/hfsplus 2023-07-14T10:50:57.978 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/hfsplus/hfsplus.ko 2023-07-14T10:50:57.978 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/isofs 2023-07-14T10:50:57.978 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/isofs/isofs.ko 2023-07-14T10:50:57.978 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/jfs 2023-07-14T10:50:57.978 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/jfs/jfs.ko 2023-07-14T10:50:57.978 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/lockd 2023-07-14T10:50:57.979 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/lockd/lockd.ko 2023-07-14T10:50:57.979 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/minix 2023-07-14T10:50:57.979 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/minix/minix.ko 2023-07-14T10:50:57.979 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/netfs 2023-07-14T10:50:57.979 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/netfs/netfs.ko 2023-07-14T10:50:57.979 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs 2023-07-14T10:50:57.979 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/blocklayout 2023-07-14T10:50:57.980 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-07-14T10:50:57.980 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/filelayout 2023-07-14T10:50:57.980 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-07-14T10:50:57.980 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/flexfilelayout 2023-07-14T10:50:57.980 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-07-14T10:50:57.980 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/nfs.ko 2023-07-14T10:50:57.980 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/nfsv3.ko 2023-07-14T10:50:57.980 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/nfsv4.ko 2023-07-14T10:50:57.981 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs_common 2023-07-14T10:50:57.981 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs_common/grace.ko 2023-07-14T10:50:57.981 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs_common/nfs_acl.ko 2023-07-14T10:50:57.981 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfsd 2023-07-14T10:50:57.981 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfsd/nfsd.ko 2023-07-14T10:50:57.981 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nilfs2 2023-07-14T10:50:57.981 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nilfs2/nilfs2.ko 2023-07-14T10:50:57.982 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls 2023-07-14T10:50:57.982 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-celtic.ko 2023-07-14T10:50:57.982 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-centeuro.ko 2023-07-14T10:50:57.982 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-croatian.ko 2023-07-14T10:50:57.982 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-cyrillic.ko 2023-07-14T10:50:57.982 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-gaelic.ko 2023-07-14T10:50:57.982 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-greek.ko 2023-07-14T10:50:57.982 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-iceland.ko 2023-07-14T10:50:57.983 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-inuit.ko 2023-07-14T10:50:57.983 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-roman.ko 2023-07-14T10:50:57.983 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-romanian.ko 2023-07-14T10:50:57.983 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-turkish.ko 2023-07-14T10:50:57.983 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp1250.ko 2023-07-14T10:50:57.983 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp1251.ko 2023-07-14T10:50:57.983 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp1255.ko 2023-07-14T10:50:57.984 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp737.ko 2023-07-14T10:50:57.984 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp775.ko 2023-07-14T10:50:57.984 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp850.ko 2023-07-14T10:50:57.984 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp852.ko 2023-07-14T10:50:57.984 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp855.ko 2023-07-14T10:50:57.984 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp857.ko 2023-07-14T10:50:57.984 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp860.ko 2023-07-14T10:50:57.984 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp861.ko 2023-07-14T10:50:57.985 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp862.ko 2023-07-14T10:50:57.985 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp863.ko 2023-07-14T10:50:57.985 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp864.ko 2023-07-14T10:50:57.985 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp865.ko 2023-07-14T10:50:57.985 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp866.ko 2023-07-14T10:50:57.985 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp869.ko 2023-07-14T10:50:57.985 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp874.ko 2023-07-14T10:50:57.985 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp932.ko 2023-07-14T10:50:57.986 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp936.ko 2023-07-14T10:50:57.986 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp949.ko 2023-07-14T10:50:57.986 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp950.ko 2023-07-14T10:50:57.986 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_euc-jp.ko 2023-07-14T10:50:57.986 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-1.ko 2023-07-14T10:50:57.986 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-13.ko 2023-07-14T10:50:57.987 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-14.ko 2023-07-14T10:50:57.987 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-15.ko 2023-07-14T10:50:57.987 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-2.ko 2023-07-14T10:50:57.987 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-3.ko 2023-07-14T10:50:57.987 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-4.ko 2023-07-14T10:50:57.987 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-5.ko 2023-07-14T10:50:57.988 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-6.ko 2023-07-14T10:50:57.988 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-7.ko 2023-07-14T10:50:57.988 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-9.ko 2023-07-14T10:50:57.988 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_koi8-r.ko 2023-07-14T10:50:57.988 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_koi8-ru.ko 2023-07-14T10:50:57.988 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_koi8-u.ko 2023-07-14T10:50:57.988 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_utf8.ko 2023-07-14T10:50:57.989 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2 2023-07-14T10:50:57.989 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/cluster 2023-07-14T10:50:57.989 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-07-14T10:50:57.989 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/dlm 2023-07-14T10:50:57.989 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-07-14T10:50:57.989 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/dlmfs 2023-07-14T10:50:57.989 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-07-14T10:50:57.989 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/ocfs2.ko 2023-07-14T10:50:57.990 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-07-14T10:50:57.990 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-07-14T10:50:57.990 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-07-14T10:50:57.990 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/overlayfs 2023-07-14T10:50:57.990 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/overlayfs/overlay.ko 2023-07-14T10:50:57.990 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/pstore 2023-07-14T10:50:57.990 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/pstore/ramoops.ko 2023-07-14T10:50:57.991 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/reiserfs 2023-07-14T10:50:57.991 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/reiserfs/reiserfs.ko 2023-07-14T10:50:57.991 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/romfs 2023-07-14T10:50:57.991 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/romfs/romfs.ko 2023-07-14T10:50:57.991 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/smb 2023-07-14T10:50:57.991 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/smb/client 2023-07-14T10:50:57.991 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/smb/client/cifs.ko 2023-07-14T10:50:57.992 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/smb/common 2023-07-14T10:50:57.992 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/smb/common/cifs_arc4.ko 2023-07-14T10:50:57.992 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/smb/common/cifs_md4.ko 2023-07-14T10:50:57.992 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/squashfs 2023-07-14T10:50:57.992 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/squashfs/squashfs.ko 2023-07-14T10:50:57.992 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/sysv 2023-07-14T10:50:57.992 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/sysv/sysv.ko 2023-07-14T10:50:57.992 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/udf 2023-07-14T10:50:57.993 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/udf/udf.ko 2023-07-14T10:50:57.993 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ufs 2023-07-14T10:50:57.993 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ufs/ufs.ko 2023-07-14T10:50:57.993 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/xfs 2023-07-14T10:50:57.993 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/xfs/xfs.ko 2023-07-14T10:50:57.993 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/kernel 2023-07-14T10:50:57.993 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/kernel/rcu 2023-07-14T10:50:57.994 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/kernel/rcu/rcutorture.ko 2023-07-14T10:50:57.994 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/kernel/torture.ko 2023-07-14T10:50:57.994 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/kernel/trace 2023-07-14T10:50:57.994 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-07-14T10:50:57.994 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib 2023-07-14T10:50:57.994 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/asn1_encoder.ko 2023-07-14T10:50:57.994 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/crc-itu-t.ko 2023-07-14T10:50:57.994 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/crc8.ko 2023-07-14T10:50:57.995 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/crypto 2023-07-14T10:50:57.995 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/crypto/libarc4.ko 2023-07-14T10:50:57.995 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/crypto/libdes.ko 2023-07-14T10:50:57.995 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/libcrc32c.ko 2023-07-14T10:50:57.995 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/lru_cache.ko 2023-07-14T10:50:57.995 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/lz4 2023-07-14T10:50:57.995 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/lz4/lz4_compress.ko 2023-07-14T10:50:57.996 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/lz4/lz4hc_compress.ko 2023-07-14T10:50:57.996 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/math 2023-07-14T10:50:57.996 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/math/cordic.ko 2023-07-14T10:50:57.997 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/raid6 2023-07-14T10:50:57.997 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/raid6/raid6_pq.ko 2023-07-14T10:50:57.997 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/reed_solomon 2023-07-14T10:50:57.997 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/reed_solomon/reed_solomon.ko 2023-07-14T10:50:57.997 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/ts_bm.ko 2023-07-14T10:50:57.997 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/ts_fsm.ko 2023-07-14T10:50:57.997 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/ts_kmp.ko 2023-07-14T10:50:57.998 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/zstd 2023-07-14T10:50:57.998 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/zstd/zstd_compress.ko 2023-07-14T10:50:57.998 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/mm 2023-07-14T10:50:57.998 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/mm/hwpoison-inject.ko 2023-07-14T10:50:57.998 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net 2023-07-14T10:50:57.998 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan 2023-07-14T10:50:57.998 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/6lowpan.ko 2023-07-14T10:50:57.999 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/nhc_dest.ko 2023-07-14T10:50:57.999 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/nhc_fragment.ko 2023-07-14T10:50:57.999 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/nhc_hop.ko 2023-07-14T10:50:57.999 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/nhc_ipv6.ko 2023-07-14T10:50:57.999 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/nhc_mobility.ko 2023-07-14T10:50:57.999 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/nhc_routing.ko 2023-07-14T10:50:57.999 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/nhc_udp.ko 2023-07-14T10:50:57.999 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/802 2023-07-14T10:50:58.000 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/802/garp.ko 2023-07-14T10:50:58.000 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/802/mrp.ko 2023-07-14T10:50:58.000 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/802/p8022.ko 2023-07-14T10:50:58.000 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/802/psnap.ko 2023-07-14T10:50:58.000 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/802/stp.ko 2023-07-14T10:50:58.000 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/8021q 2023-07-14T10:50:58.000 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/8021q/8021q.ko 2023-07-14T10:50:58.001 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/9p 2023-07-14T10:50:58.001 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/9p/9pnet.ko 2023-07-14T10:50:58.001 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/9p/9pnet_fd.ko 2023-07-14T10:50:58.001 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/9p/9pnet_rdma.ko 2023-07-14T10:50:58.001 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/9p/9pnet_virtio.ko 2023-07-14T10:50:58.001 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/batman-adv 2023-07-14T10:50:58.001 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/batman-adv/batman-adv.ko 2023-07-14T10:50:58.001 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge 2023-07-14T10:50:58.002 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/br_netfilter.ko 2023-07-14T10:50:58.002 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/bridge.ko 2023-07-14T10:50:58.002 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter 2023-07-14T10:50:58.002 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-07-14T10:50:58.002 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_among.ko 2023-07-14T10:50:58.002 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_arp.ko 2023-07-14T10:50:58.002 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-07-14T10:50:58.003 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-07-14T10:50:58.003 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_ip.ko 2023-07-14T10:50:58.003 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-07-14T10:50:58.003 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_limit.ko 2023-07-14T10:50:58.003 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_log.ko 2023-07-14T10:50:58.003 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_mark.ko 2023-07-14T10:50:58.003 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-07-14T10:50:58.003 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-07-14T10:50:58.004 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-07-14T10:50:58.004 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-07-14T10:50:58.004 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_snat.ko 2023-07-14T10:50:58.004 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_stp.ko 2023-07-14T10:50:58.004 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-07-14T10:50:58.004 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-07-14T10:50:58.004 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-07-14T10:50:58.005 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-07-14T10:50:58.005 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebtables.ko 2023-07-14T10:50:58.005 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-07-14T10:50:58.005 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-07-14T10:50:58.005 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-07-14T10:50:58.005 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ceph 2023-07-14T10:50:58.005 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ceph/libceph.ko 2023-07-14T10:50:58.005 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/core 2023-07-14T10:50:58.006 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/core/failover.ko 2023-07-14T10:50:58.006 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/core/pktgen.ko 2023-07-14T10:50:58.006 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dccp 2023-07-14T10:50:58.006 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dccp/dccp.ko 2023-07-14T10:50:58.006 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dccp/dccp_diag.ko 2023-07-14T10:50:58.006 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dccp/dccp_ipv4.ko 2023-07-14T10:50:58.006 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dccp/dccp_ipv6.ko 2023-07-14T10:50:58.007 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dns_resolver 2023-07-14T10:50:58.007 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dns_resolver/dns_resolver.ko 2023-07-14T10:50:58.007 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dsa 2023-07-14T10:50:58.007 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dsa/dsa_core.ko 2023-07-14T10:50:58.007 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dsa/tag_brcm.ko 2023-07-14T10:50:58.007 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dsa/tag_dsa.ko 2023-07-14T10:50:58.007 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dsa/tag_none.ko 2023-07-14T10:50:58.007 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dsa/tag_trailer.ko 2023-07-14T10:50:58.008 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ieee802154 2023-07-14T10:50:58.008 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ieee802154/6lowpan 2023-07-14T10:50:58.008 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-07-14T10:50:58.008 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ieee802154/ieee802154.ko 2023-07-14T10:50:58.008 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ieee802154/ieee802154_socket.ko 2023-07-14T10:50:58.008 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4 2023-07-14T10:50:58.008 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/ah4.ko 2023-07-14T10:50:58.009 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/esp4.ko 2023-07-14T10:50:58.009 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/fou.ko 2023-07-14T10:50:58.009 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/gre.ko 2023-07-14T10:50:58.009 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/inet_diag.ko 2023-07-14T10:50:58.009 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/ip_gre.ko 2023-07-14T10:50:58.009 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/ip_tunnel.ko 2023-07-14T10:50:58.009 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/ip_vti.ko 2023-07-14T10:50:58.009 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/ipcomp.ko 2023-07-14T10:50:58.010 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/ipip.ko 2023-07-14T10:50:58.010 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter 2023-07-14T10:50:58.010 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/arp_tables.ko 2023-07-14T10:50:58.010 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-07-14T10:50:58.010 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-07-14T10:50:58.010 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-07-14T10:50:58.010 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-07-14T10:50:58.010 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-07-14T10:50:58.011 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-07-14T10:50:58.011 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-07-14T10:50:58.011 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-07-14T10:50:58.011 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-07-14T10:50:58.011 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/iptable_security.ko 2023-07-14T10:50:58.011 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-07-14T10:50:58.011 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-07-14T10:50:58.012 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-07-14T10:50:58.012 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-07-14T10:50:58.012 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-07-14T10:50:58.012 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-07-14T10:50:58.012 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-07-14T10:50:58.012 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-07-14T10:50:58.012 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-07-14T10:50:58.012 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-07-14T10:50:58.013 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_bic.ko 2023-07-14T10:50:58.013 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_dctcp.ko 2023-07-14T10:50:58.013 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_diag.ko 2023-07-14T10:50:58.013 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_highspeed.ko 2023-07-14T10:50:58.013 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_htcp.ko 2023-07-14T10:50:58.013 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_hybla.ko 2023-07-14T10:50:58.013 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_illinois.ko 2023-07-14T10:50:58.014 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_lp.ko 2023-07-14T10:50:58.014 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_scalable.ko 2023-07-14T10:50:58.014 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_vegas.ko 2023-07-14T10:50:58.014 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_veno.ko 2023-07-14T10:50:58.014 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_westwood.ko 2023-07-14T10:50:58.014 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_yeah.ko 2023-07-14T10:50:58.014 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tunnel4.ko 2023-07-14T10:50:58.014 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/udp_diag.ko 2023-07-14T10:50:58.015 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/udp_tunnel.ko 2023-07-14T10:50:58.015 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/xfrm4_tunnel.ko 2023-07-14T10:50:58.015 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6 2023-07-14T10:50:58.015 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/ah6.ko 2023-07-14T10:50:58.015 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/esp6.ko 2023-07-14T10:50:58.015 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/fou6.ko 2023-07-14T10:50:58.015 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/ip6_tunnel.ko 2023-07-14T10:50:58.016 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-07-14T10:50:58.016 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/ip6_vti.ko 2023-07-14T10:50:58.016 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/ipcomp6.ko 2023-07-14T10:50:58.016 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter 2023-07-14T10:50:58.016 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-07-14T10:50:58.016 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-07-14T10:50:58.016 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-07-14T10:50:58.017 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-07-14T10:50:58.017 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-07-14T10:50:58.017 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-07-14T10:50:58.017 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-07-14T10:50:58.017 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-07-14T10:50:58.017 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-07-14T10:50:58.017 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-07-14T10:50:58.017 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-07-14T10:50:58.018 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-07-14T10:50:58.018 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-07-14T10:50:58.018 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-07-14T10:50:58.018 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-07-14T10:50:58.018 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-07-14T10:50:58.018 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-07-14T10:50:58.018 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-07-14T10:50:58.019 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-07-14T10:50:58.019 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-07-14T10:50:58.019 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-07-14T10:50:58.019 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-07-14T10:50:58.019 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-07-14T10:50:58.019 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-07-14T10:50:58.019 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/sit.ko 2023-07-14T10:50:58.019 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/tunnel6.ko 2023-07-14T10:50:58.020 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/xfrm6_tunnel.ko 2023-07-14T10:50:58.020 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/key 2023-07-14T10:50:58.020 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/key/af_key.ko 2023-07-14T10:50:58.020 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp 2023-07-14T10:50:58.020 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp/l2tp_core.ko 2023-07-14T10:50:58.020 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp/l2tp_debugfs.ko 2023-07-14T10:50:58.020 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp/l2tp_eth.ko 2023-07-14T10:50:58.021 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp/l2tp_ip.ko 2023-07-14T10:50:58.021 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp/l2tp_ip6.ko 2023-07-14T10:50:58.021 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp/l2tp_netlink.ko 2023-07-14T10:50:58.021 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp/l2tp_ppp.ko 2023-07-14T10:50:58.021 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/llc 2023-07-14T10:50:58.021 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/llc/llc.ko 2023-07-14T10:50:58.021 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/mac802154 2023-07-14T10:50:58.022 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/mac802154/mac802154.ko 2023-07-14T10:50:58.022 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/mpls 2023-07-14T10:50:58.022 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/mpls/mpls_gso.ko 2023-07-14T10:50:58.022 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter 2023-07-14T10:50:58.022 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset 2023-07-14T10:50:58.022 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set.ko 2023-07-14T10:50:58.022 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-07-14T10:50:58.022 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-07-14T10:50:58.023 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-07-14T10:50:58.023 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-07-14T10:50:58.023 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-07-14T10:50:58.023 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-07-14T10:50:58.023 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-07-14T10:50:58.023 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-07-14T10:50:58.023 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-07-14T10:50:58.023 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-07-14T10:50:58.024 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-07-14T10:50:58.024 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-07-14T10:50:58.024 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-07-14T10:50:58.024 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-07-14T10:50:58.024 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-07-14T10:50:58.024 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs 2023-07-14T10:50:58.024 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs.ko 2023-07-14T10:50:58.025 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-07-14T10:50:58.025 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-07-14T10:50:58.025 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-07-14T10:50:58.025 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-07-14T10:50:58.025 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-07-14T10:50:58.025 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-07-14T10:50:58.025 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-07-14T10:50:58.026 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-07-14T10:50:58.026 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-07-14T10:50:58.026 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-07-14T10:50:58.026 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-07-14T10:50:58.026 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-07-14T10:50:58.026 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-07-14T10:50:58.026 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conncount.ko 2023-07-14T10:50:58.026 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack.ko 2023-07-14T10:50:58.027 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-07-14T10:50:58.027 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-07-14T10:50:58.027 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-07-14T10:50:58.027 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_h323.ko 2023-07-14T10:50:58.027 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_irc.ko 2023-07-14T10:50:58.027 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-07-14T10:50:58.027 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-07-14T10:50:58.028 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-07-14T10:50:58.028 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_sane.ko 2023-07-14T10:50:58.028 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_sip.ko 2023-07-14T10:50:58.028 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-07-14T10:50:58.028 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-07-14T10:50:58.028 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_dup_netdev.ko 2023-07-14T10:50:58.028 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_flow_table.ko 2023-07-14T10:50:58.028 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_flow_table_inet.ko 2023-07-14T10:50:58.029 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_log_syslog.ko 2023-07-14T10:50:58.029 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_nat.ko 2023-07-14T10:50:58.029 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_nat_amanda.ko 2023-07-14T10:50:58.029 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_nat_ftp.ko 2023-07-14T10:50:58.029 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_nat_irc.ko 2023-07-14T10:50:58.029 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_nat_sip.ko 2023-07-14T10:50:58.029 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_nat_tftp.ko 2023-07-14T10:50:58.030 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_synproxy_core.ko 2023-07-14T10:50:58.030 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_tables.ko 2023-07-14T10:50:58.030 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nfnetlink.ko 2023-07-14T10:50:58.030 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nfnetlink_acct.ko 2023-07-14T10:50:58.030 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nfnetlink_log.ko 2023-07-14T10:50:58.030 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nfnetlink_osf.ko 2023-07-14T10:50:58.030 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nfnetlink_queue.ko 2023-07-14T10:50:58.030 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_chain_nat.ko 2023-07-14T10:50:58.031 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_compat.ko 2023-07-14T10:50:58.031 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_ct.ko 2023-07-14T10:50:58.031 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_dup_netdev.ko 2023-07-14T10:50:58.031 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_fib.ko 2023-07-14T10:50:58.031 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_fwd_netdev.ko 2023-07-14T10:50:58.031 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_hash.ko 2023-07-14T10:50:58.031 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_limit.ko 2023-07-14T10:50:58.032 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_log.ko 2023-07-14T10:50:58.032 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_masq.ko 2023-07-14T10:50:58.032 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_nat.ko 2023-07-14T10:50:58.032 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_numgen.ko 2023-07-14T10:50:58.032 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_queue.ko 2023-07-14T10:50:58.032 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_quota.ko 2023-07-14T10:50:58.032 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_redir.ko 2023-07-14T10:50:58.032 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_reject.ko 2023-07-14T10:50:58.033 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_reject_inet.ko 2023-07-14T10:50:58.033 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_socket.ko 2023-07-14T10:50:58.033 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_tunnel.ko 2023-07-14T10:50:58.033 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_AUDIT.ko 2023-07-14T10:50:58.033 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_CHECKSUM.ko 2023-07-14T10:50:58.033 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_CLASSIFY.ko 2023-07-14T10:50:58.033 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-07-14T10:50:58.034 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_CT.ko 2023-07-14T10:50:58.034 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_DSCP.ko 2023-07-14T10:50:58.034 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_HL.ko 2023-07-14T10:50:58.034 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_HMARK.ko 2023-07-14T10:50:58.034 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_IDLETIMER.ko 2023-07-14T10:50:58.034 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_LED.ko 2023-07-14T10:50:58.034 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_LOG.ko 2023-07-14T10:50:58.034 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_MASQUERADE.ko 2023-07-14T10:50:58.035 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_NETMAP.ko 2023-07-14T10:50:58.035 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_NFLOG.ko 2023-07-14T10:50:58.035 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_NFQUEUE.ko 2023-07-14T10:50:58.035 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_RATEEST.ko 2023-07-14T10:50:58.035 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_REDIRECT.ko 2023-07-14T10:50:58.035 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_SECMARK.ko 2023-07-14T10:50:58.035 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_TCPMSS.ko 2023-07-14T10:50:58.036 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-07-14T10:50:58.036 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_TEE.ko 2023-07-14T10:50:58.036 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_TPROXY.ko 2023-07-14T10:50:58.036 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_TRACE.ko 2023-07-14T10:50:58.036 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_addrtype.ko 2023-07-14T10:50:58.036 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_bpf.ko 2023-07-14T10:50:58.036 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_cgroup.ko 2023-07-14T10:50:58.036 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_cluster.ko 2023-07-14T10:50:58.037 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_comment.ko 2023-07-14T10:50:58.037 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_connbytes.ko 2023-07-14T10:50:58.037 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_connlabel.ko 2023-07-14T10:50:58.037 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_connlimit.ko 2023-07-14T10:50:58.037 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_connmark.ko 2023-07-14T10:50:58.037 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_conntrack.ko 2023-07-14T10:50:58.037 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_cpu.ko 2023-07-14T10:50:58.037 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_dccp.ko 2023-07-14T10:50:58.038 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_devgroup.ko 2023-07-14T10:50:58.038 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_dscp.ko 2023-07-14T10:50:58.038 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_ecn.ko 2023-07-14T10:50:58.038 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_esp.ko 2023-07-14T10:50:58.038 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_hashlimit.ko 2023-07-14T10:50:58.038 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_helper.ko 2023-07-14T10:50:58.038 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_hl.ko 2023-07-14T10:50:58.039 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_ipcomp.ko 2023-07-14T10:50:58.039 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_iprange.ko 2023-07-14T10:50:58.039 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_ipvs.ko 2023-07-14T10:50:58.039 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_l2tp.ko 2023-07-14T10:50:58.039 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_length.ko 2023-07-14T10:50:58.039 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_limit.ko 2023-07-14T10:50:58.039 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_mac.ko 2023-07-14T10:50:58.039 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_mark.ko 2023-07-14T10:50:58.040 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_multiport.ko 2023-07-14T10:50:58.040 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_nat.ko 2023-07-14T10:50:58.040 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_nfacct.ko 2023-07-14T10:50:58.040 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_osf.ko 2023-07-14T10:50:58.040 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_owner.ko 2023-07-14T10:50:58.040 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_physdev.ko 2023-07-14T10:50:58.040 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_pkttype.ko 2023-07-14T10:50:58.041 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_policy.ko 2023-07-14T10:50:58.041 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_quota.ko 2023-07-14T10:50:58.041 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_rateest.ko 2023-07-14T10:50:58.041 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_realm.ko 2023-07-14T10:50:58.041 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_recent.ko 2023-07-14T10:50:58.041 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_sctp.ko 2023-07-14T10:50:58.041 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_set.ko 2023-07-14T10:50:58.041 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_socket.ko 2023-07-14T10:50:58.042 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_state.ko 2023-07-14T10:50:58.042 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_statistic.ko 2023-07-14T10:50:58.042 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_string.ko 2023-07-14T10:50:58.042 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_tcpmss.ko 2023-07-14T10:50:58.042 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_time.ko 2023-07-14T10:50:58.042 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_u32.ko 2023-07-14T10:50:58.042 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netlink 2023-07-14T10:50:58.043 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netlink/netlink_diag.ko 2023-07-14T10:50:58.043 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/nsh 2023-07-14T10:50:58.043 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/nsh/nsh.ko 2023-07-14T10:50:58.043 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/openvswitch 2023-07-14T10:50:58.043 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/openvswitch/openvswitch.ko 2023-07-14T10:50:58.043 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/openvswitch/vport-geneve.ko 2023-07-14T10:50:58.043 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/openvswitch/vport-gre.ko 2023-07-14T10:50:58.043 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/openvswitch/vport-vxlan.ko 2023-07-14T10:50:58.044 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/packet 2023-07-14T10:50:58.044 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/packet/af_packet_diag.ko 2023-07-14T10:50:58.044 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/rds 2023-07-14T10:50:58.044 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/rds/rds.ko 2023-07-14T10:50:58.044 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/rds/rds_rdma.ko 2023-07-14T10:50:58.044 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/rds/rds_tcp.ko 2023-07-14T10:50:58.044 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched 2023-07-14T10:50:58.045 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_csum.ko 2023-07-14T10:50:58.045 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_gact.ko 2023-07-14T10:50:58.045 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_ipt.ko 2023-07-14T10:50:58.045 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_mirred.ko 2023-07-14T10:50:58.045 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_nat.ko 2023-07-14T10:50:58.045 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_pedit.ko 2023-07-14T10:50:58.045 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_police.ko 2023-07-14T10:50:58.045 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_simple.ko 2023-07-14T10:50:58.046 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_skbedit.ko 2023-07-14T10:50:58.046 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_vlan.ko 2023-07-14T10:50:58.046 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/cls_basic.ko 2023-07-14T10:50:58.046 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/cls_bpf.ko 2023-07-14T10:50:58.046 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/cls_flow.ko 2023-07-14T10:50:58.046 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/cls_fw.ko 2023-07-14T10:50:58.046 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/cls_route.ko 2023-07-14T10:50:58.047 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/cls_u32.ko 2023-07-14T10:50:58.047 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/em_cmp.ko 2023-07-14T10:50:58.047 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/em_ipset.ko 2023-07-14T10:50:58.047 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/em_meta.ko 2023-07-14T10:50:58.047 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/em_nbyte.ko 2023-07-14T10:50:58.047 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/em_text.ko 2023-07-14T10:50:58.047 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/em_u32.ko 2023-07-14T10:50:58.047 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_choke.ko 2023-07-14T10:50:58.048 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_codel.ko 2023-07-14T10:50:58.048 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_drr.ko 2023-07-14T10:50:58.048 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_fq.ko 2023-07-14T10:50:58.048 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_gred.ko 2023-07-14T10:50:58.048 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_hfsc.ko 2023-07-14T10:50:58.048 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_hhf.ko 2023-07-14T10:50:58.048 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_htb.ko 2023-07-14T10:50:58.049 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_ingress.ko 2023-07-14T10:50:58.049 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_mqprio.ko 2023-07-14T10:50:58.049 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_mqprio_lib.ko 2023-07-14T10:50:58.049 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_multiq.ko 2023-07-14T10:50:58.049 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_netem.ko 2023-07-14T10:50:58.049 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_pie.ko 2023-07-14T10:50:58.049 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_plug.ko 2023-07-14T10:50:58.049 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_prio.ko 2023-07-14T10:50:58.050 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_qfq.ko 2023-07-14T10:50:58.050 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_red.ko 2023-07-14T10:50:58.050 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_sfb.ko 2023-07-14T10:50:58.050 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_sfq.ko 2023-07-14T10:50:58.050 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_tbf.ko 2023-07-14T10:50:58.050 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_teql.ko 2023-07-14T10:50:58.050 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sctp 2023-07-14T10:50:58.050 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sctp/sctp.ko 2023-07-14T10:50:58.051 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sctp/sctp_diag.ko 2023-07-14T10:50:58.051 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sunrpc 2023-07-14T10:50:58.051 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sunrpc/auth_gss 2023-07-14T10:50:58.051 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-07-14T10:50:58.051 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-07-14T10:50:58.051 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sunrpc/sunrpc.ko 2023-07-14T10:50:58.051 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sunrpc/xprtrdma 2023-07-14T10:50:58.052 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-07-14T10:50:58.052 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/tipc 2023-07-14T10:50:58.052 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/tipc/diag.ko 2023-07-14T10:50:58.052 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/tipc/tipc.ko 2023-07-14T10:50:58.052 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/unix 2023-07-14T10:50:58.052 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/unix/unix_diag.ko 2023-07-14T10:50:58.052 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/vmw_vsock 2023-07-14T10:50:58.052 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-07-14T10:50:58.053 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-07-14T10:50:58.053 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/vmw_vsock/vsock.ko 2023-07-14T10:50:58.053 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/vmw_vsock/vsock_diag.ko 2023-07-14T10:50:58.053 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/vmw_vsock/vsock_loopback.ko 2023-07-14T10:50:58.053 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/xfrm 2023-07-14T10:50:58.053 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/xfrm/xfrm_ipcomp.ko 2023-07-14T10:50:58.053 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/security 2023-07-14T10:50:58.054 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/security/keys 2023-07-14T10:50:58.054 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/security/keys/encrypted-keys 2023-07-14T10:50:58.054 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-07-14T10:50:58.054 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/security/keys/trusted-keys 2023-07-14T10:50:58.054 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/security/keys/trusted-keys/trusted.ko 2023-07-14T10:50:58.054 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/virt 2023-07-14T10:50:58.054 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/virt/lib 2023-07-14T10:50:58.054 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/virt/lib/irqbypass.ko 2023-07-14T10:50:58.055 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.alias 2023-07-14T10:50:58.055 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.alias.bin 2023-07-14T10:50:58.055 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.builtin 2023-07-14T10:50:58.055 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.builtin.bin 2023-07-14T10:50:58.055 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.builtin.modinfo 2023-07-14T10:50:58.055 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.dep 2023-07-14T10:50:58.055 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.dep.bin 2023-07-14T10:50:58.055 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.devname 2023-07-14T10:50:58.056 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.order 2023-07-14T10:50:58.056 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.softdep 2023-07-14T10:50:58.056 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.symbols 2023-07-14T10:50:58.056 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.symbols.bin 2023-07-14T10:50:58.057 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc1-ga440c79eee02 2023-07-14T10:50:58.057 DEBUG:teuthology.orchestra.run.smithi084:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-07-14T10:50:58.086 INFO:teuthology.orchestra.run.smithi084.stdout:postinstall scriptlet (using /bin/sh): 2023-07-14T10:50:58.086 INFO:teuthology.orchestra.run.smithi084.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.5.0-rc1-ga440c79eee02 -a -r /boot/System.map-6.5.0-rc1-ga440c79eee02 ]; then 2023-07-14T10:50:58.086 INFO:teuthology.orchestra.run.smithi084.stdout:cp /boot/vmlinuz-6.5.0-rc1-ga440c79eee02 /boot/.vmlinuz-6.5.0-rc1-ga440c79eee02-rpm 2023-07-14T10:50:58.087 INFO:teuthology.orchestra.run.smithi084.stdout:cp /boot/System.map-6.5.0-rc1-ga440c79eee02 /boot/.System.map-6.5.0-rc1-ga440c79eee02-rpm 2023-07-14T10:50:58.087 INFO:teuthology.orchestra.run.smithi084.stdout:rm -f /boot/vmlinuz-6.5.0-rc1-ga440c79eee02 /boot/System.map-6.5.0-rc1-ga440c79eee02 2023-07-14T10:50:58.087 INFO:teuthology.orchestra.run.smithi084.stdout:/sbin/installkernel 6.5.0-rc1-ga440c79eee02 /boot/.vmlinuz-6.5.0-rc1-ga440c79eee02-rpm /boot/.System.map-6.5.0-rc1-ga440c79eee02-rpm 2023-07-14T10:50:58.087 INFO:teuthology.orchestra.run.smithi084.stdout:rm -f /boot/.vmlinuz-6.5.0-rc1-ga440c79eee02-rpm /boot/.System.map-6.5.0-rc1-ga440c79eee02-rpm 2023-07-14T10:50:58.087 INFO:teuthology.orchestra.run.smithi084.stdout:fi 2023-07-14T10:50:58.088 INFO:teuthology.orchestra.run.smithi084.stdout:preuninstall scriptlet (using /bin/sh): 2023-07-14T10:50:58.088 INFO:teuthology.orchestra.run.smithi084.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-07-14T10:50:58.088 INFO:teuthology.orchestra.run.smithi084.stdout:new-kernel-pkg --remove 6.5.0-rc1-ga440c79eee02 --rminitrd --initrdfile=/boot/initramfs-6.5.0-rc1-ga440c79eee02.img 2023-07-14T10:50:58.088 INFO:teuthology.orchestra.run.smithi084.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-07-14T10:50:58.088 INFO:teuthology.orchestra.run.smithi084.stdout:kernel-install remove 6.5.0-rc1-ga440c79eee02 2023-07-14T10:50:58.088 INFO:teuthology.orchestra.run.smithi084.stdout:fi 2023-07-14T10:50:58.088 INFO:teuthology.orchestra.run.smithi084.stdout:postuninstall scriptlet (using /bin/sh): 2023-07-14T10:50:58.089 INFO:teuthology.orchestra.run.smithi084.stdout:if [ -x /sbin/update-bootloader ]; then 2023-07-14T10:50:58.089 INFO:teuthology.orchestra.run.smithi084.stdout:/sbin/update-bootloader --remove 6.5.0-rc1-ga440c79eee02 2023-07-14T10:50:58.089 INFO:teuthology.orchestra.run.smithi084.stdout:fi 2023-07-14T10:50:58.090 DEBUG:teuthology.orchestra.run.smithi084:> sudo rpm -qi grub2-tools 2023-07-14T10:50:58.151 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi179.front.sepia.ceph.com' 2023-07-14T10:50:58.152 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.5.0-rc1-ga440c79eee02"... 2023-07-14T10:50:58.152 DEBUG:teuthology.orchestra.run.smithi179:> uname -r 2023-07-14T10:50:58.169 INFO:teuthology.orchestra.run.smithi084.stdout:Name : grub2-tools 2023-07-14T10:50:58.169 INFO:teuthology.orchestra.run.smithi084.stdout:Epoch : 1 2023-07-14T10:50:58.169 INFO:teuthology.orchestra.run.smithi084.stdout:Version : 2.02 2023-07-14T10:50:58.169 INFO:teuthology.orchestra.run.smithi084.stdout:Release : 129.el8 2023-07-14T10:50:58.169 INFO:teuthology.orchestra.run.smithi084.stdout:Architecture: x86_64 2023-07-14T10:50:58.169 INFO:teuthology.orchestra.run.smithi084.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-07-14T10:50:58.170 INFO:teuthology.orchestra.run.smithi084.stdout:Group : System Environment/Base 2023-07-14T10:50:58.170 INFO:teuthology.orchestra.run.smithi084.stdout:Size : 9265586 2023-07-14T10:50:58.170 INFO:teuthology.orchestra.run.smithi084.stdout:License : GPLv3+ 2023-07-14T10:50:58.170 INFO:teuthology.orchestra.run.smithi084.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-07-14T10:50:58.170 INFO:teuthology.orchestra.run.smithi084.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-07-14T10:50:58.170 INFO:teuthology.orchestra.run.smithi084.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-07-14T10:50:58.170 INFO:teuthology.orchestra.run.smithi084.stdout:Build Host : kbuilder.bsys.centos.org 2023-07-14T10:50:58.171 INFO:teuthology.orchestra.run.smithi084.stdout:Relocations : (not relocatable) 2023-07-14T10:50:58.171 INFO:teuthology.orchestra.run.smithi084.stdout:Packager : CentOS BuildSystem 2023-07-14T10:50:58.171 INFO:teuthology.orchestra.run.smithi084.stdout:Vendor : CentOS 2023-07-14T10:50:58.171 INFO:teuthology.orchestra.run.smithi084.stdout:URL : http://www.gnu.org/software/grub/ 2023-07-14T10:50:58.171 INFO:teuthology.orchestra.run.smithi084.stdout:Summary : Support tools for GRUB. 2023-07-14T10:50:58.171 INFO:teuthology.orchestra.run.smithi084.stdout:Description : 2023-07-14T10:50:58.171 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T10:50:58.171 INFO:teuthology.orchestra.run.smithi084.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-07-14T10:50:58.172 INFO:teuthology.orchestra.run.smithi084.stdout:customizable bootloader with modular architecture. It supports a rich 2023-07-14T10:50:58.172 INFO:teuthology.orchestra.run.smithi084.stdout:variety of kernel formats, file systems, computer architectures and 2023-07-14T10:50:58.172 INFO:teuthology.orchestra.run.smithi084.stdout:hardware devices. 2023-07-14T10:50:58.172 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T10:50:58.172 INFO:teuthology.orchestra.run.smithi084.stdout:This subpackage provides tools for support of all platforms. 2023-07-14T10:50:58.173 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-07-14T10:50:58.173 INFO:teuthology.task.kernel:Updating grub on smithi084 to boot 6.5.0-rc1-ga440c79eee02 2023-07-14T10:50:58.174 DEBUG:teuthology.orchestra.run.smithi084:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-07-14T10:50:58.197 INFO:teuthology.orchestra.run.smithi179.stdout:6.5.0-rc1-ga440c79eee02 2023-07-14T10:50:58.197 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc1-ga440c79eee02 vs 6.5.0-rc1-ga440c79eee02 2023-07-14T10:50:58.198 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-07-14T10:50:58.198 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-07-14T10:50:59.199 DEBUG:teuthology.parallel:result is None 2023-07-14T10:51:01.520 INFO:teuthology.orchestra.run.smithi084.stderr:Generating grub configuration file ... 2023-07-14T10:51:03.814 INFO:teuthology.orchestra.run.smithi084.stderr:done 2023-07-14T10:51:03.816 DEBUG:teuthology.orchestra.run.smithi084:> mktemp 2023-07-14T10:51:03.843 INFO:teuthology.orchestra.run.smithi084.stdout:/tmp/tmp.ZFakw9F4qk 2023-07-14T10:51:03.844 DEBUG:teuthology.orchestra.run.smithi084:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.ZFakw9F4qk 2023-07-14T10:51:03.918 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 0666 /tmp/tmp.ZFakw9F4qk 2023-07-14T10:51:04.076 DEBUG:teuthology.orchestra.remote:smithi084:/tmp/tmp.ZFakw9F4qk is 6KB 2023-07-14T10:51:04.126 DEBUG:teuthology.orchestra.run.smithi084:> rm -fr /tmp/tmp.ZFakw9F4qk 2023-07-14T10:51:04.144 DEBUG:teuthology.orchestra.run.smithi084:> sudo /bin/ls /boot/loader/entries || true 2023-07-14T10:51:04.225 INFO:teuthology.orchestra.run.smithi084.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-07-14T10:51:04.226 INFO:teuthology.orchestra.run.smithi084.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-07-14T10:51:04.226 INFO:teuthology.orchestra.run.smithi084.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-07-14T10:51:04.226 INFO:teuthology.orchestra.run.smithi084.stdout:a1b29d6c289747bdb22930598d39874a-6.5.0-rc1-ga440c79eee02.conf 2023-07-14T10:51:04.227 DEBUG:teuthology.orchestra.run.smithi084:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-6.5.0-rc1-ga440c79eee02 2023-07-14T10:51:04.424 DEBUG:teuthology.orchestra.run.smithi084:> sudo shutdown -r now 2023-07-14T10:51:34.427 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-07-14T10:51:34.428 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2023-07-14T10:51:34.429 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T10:51:52.820 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-07-14T10:52:01.821 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2023-07-14T10:52:01.822 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T10:52:04.884 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-07-14T10:52:16.886 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2023-07-14T10:52:16.887 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T10:52:48.764 DEBUG:teuthology.orchestra.run.smithi084:> true 2023-07-14T10:52:49.318 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi084.front.sepia.ceph.com' 2023-07-14T10:52:49.319 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.5.0-rc1-ga440c79eee02"... 2023-07-14T10:52:49.319 DEBUG:teuthology.orchestra.run.smithi084:> uname -r 2023-07-14T10:52:49.364 INFO:teuthology.orchestra.run.smithi084.stdout:6.5.0-rc1-ga440c79eee02 2023-07-14T10:52:49.365 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc1-ga440c79eee02 vs 6.5.0-rc1-ga440c79eee02 2023-07-14T10:52:49.365 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-07-14T10:52:49.365 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-07-14T10:52:50.367 DEBUG:teuthology.parallel:result is None 2023-07-14T10:52:50.368 INFO:teuthology.run_tasks:Running task internal.base... 2023-07-14T10:52:50.383 INFO:teuthology.task.internal:Creating test directory... 2023-07-14T10:52:50.384 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-14T10:52:50.391 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-14T10:52:50.443 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-07-14T10:52:50.453 INFO:teuthology.run_tasks:Running task internal.archive... 2023-07-14T10:52:50.540 INFO:teuthology.task.internal:Creating archive directory... 2023-07-14T10:52:50.541 DEBUG:teuthology.orchestra.run.smithi084:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-14T10:52:50.549 DEBUG:teuthology.orchestra.run.smithi179:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-14T10:52:50.628 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-07-14T10:52:50.638 INFO:teuthology.task.internal:Enabling coredump saving... 2023-07-14T10:52:50.638 DEBUG:teuthology.orchestra.run.smithi084:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-14T10:52:50.643 DEBUG:teuthology.orchestra.run.smithi179:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-14T10:52:50.761 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-14T10:52:50.794 INFO:teuthology.orchestra.run.smithi179.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-14T10:52:50.819 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-14T10:52:50.828 INFO:teuthology.orchestra.run.smithi179.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-14T10:52:50.831 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-07-14T10:52:50.840 INFO:teuthology.task.internal:Configuring sudo... 2023-07-14T10:52:50.841 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-14T10:52:50.847 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-14T10:52:50.917 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-07-14T10:52:50.930 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-07-14T10:52:50.933 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-14T10:52:50.937 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-14T10:52:50.986 DEBUG:teuthology.orchestra.run.smithi084:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-14T10:52:51.101 DEBUG:teuthology.orchestra.run.smithi084:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-14T10:52:51.171 DEBUG:teuthology.orchestra.run.smithi084:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-14T10:52:51.248 DEBUG:teuthology.orchestra.run.smithi084:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-14T10:52:51.317 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-14T10:52:51.317 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-14T10:52:51.387 DEBUG:teuthology.orchestra.run.smithi179:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-14T10:52:51.465 DEBUG:teuthology.orchestra.run.smithi179:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-14T10:52:51.547 DEBUG:teuthology.orchestra.run.smithi179:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-14T10:52:51.627 DEBUG:teuthology.orchestra.run.smithi179:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-14T10:52:51.696 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-07-14T10:52:51.696 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-14T10:52:51.766 DEBUG:teuthology.orchestra.run.smithi084:> sudo service rsyslog restart 2023-07-14T10:52:51.772 DEBUG:teuthology.orchestra.run.smithi179:> sudo service rsyslog restart 2023-07-14T10:52:51.893 INFO:teuthology.orchestra.run.smithi084.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-14T10:52:51.934 INFO:teuthology.orchestra.run.smithi179.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-14T10:52:52.362 INFO:teuthology.run_tasks:Running task internal.timer... 2023-07-14T10:52:52.374 INFO:teuthology.task.internal:Starting timer... 2023-07-14T10:52:52.375 INFO:teuthology.run_tasks:Running task pcp... 2023-07-14T10:52:52.392 INFO:teuthology.run_tasks:Running task selinux... 2023-07-14T10:52:52.410 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-07-14T10:52:52.411 DEBUG:teuthology.orchestra.run.smithi084:> sudo service auditd rotate 2023-07-14T10:52:52.556 INFO:teuthology.orchestra.run.smithi084.stdout:Rotating logs: 2023-07-14T10:52:52.559 DEBUG:teuthology.orchestra.run.smithi179:> sudo service auditd rotate 2023-07-14T10:52:52.717 INFO:teuthology.orchestra.run.smithi179.stdout:Rotating logs: 2023-07-14T10:52:52.721 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-07-14T10:52:52.721 DEBUG:teuthology.orchestra.run.smithi084:> /usr/sbin/getenforce 2023-07-14T10:52:52.779 INFO:teuthology.orchestra.run.smithi084.stdout:Permissive 2023-07-14T10:52:52.779 DEBUG:teuthology.orchestra.run.smithi179:> /usr/sbin/getenforce 2023-07-14T10:52:52.841 INFO:teuthology.orchestra.run.smithi179.stdout:Permissive 2023-07-14T10:52:52.841 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi084.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi179.front.sepia.ceph.com': 'permissive'} 2023-07-14T10:52:52.842 DEBUG:teuthology.orchestra.run.smithi084:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-14T10:52:52.917 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-14T10:52:52.918 DEBUG:teuthology.orchestra.run.smithi179:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-14T10:52:52.988 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-14T10:52:52.989 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-07-14T10:52:52.990 DEBUG:teuthology.orchestra.run.smithi084:> sudo /usr/sbin/setenforce permissive 2023-07-14T10:52:53.060 DEBUG:teuthology.orchestra.run.smithi179:> sudo /usr/sbin/setenforce permissive 2023-07-14T10:52:53.140 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-07-14T10:52:53.157 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-07-14T10:52:53.157 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-07-14T10:52:53.183 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-07-14T10:52:53.186 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi084.front.sepia.ceph.com,smithi179.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-07-14T11:03:42.640 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi084.front.sepia.ceph.com'), Remote(name='ubuntu@smithi179.front.sepia.ceph.com')] 2023-07-14T11:03:42.643 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2023-07-14T11:03:42.644 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T11:03:42.733 DEBUG:teuthology.orchestra.run.smithi084:> true 2023-07-14T11:03:42.853 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi084.front.sepia.ceph.com' 2023-07-14T11:03:42.853 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2023-07-14T11:03:42.854 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T11:03:42.937 DEBUG:teuthology.orchestra.run.smithi179:> true 2023-07-14T11:03:43.051 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi179.front.sepia.ceph.com' 2023-07-14T11:03:43.052 INFO:teuthology.run_tasks:Running task clock... 2023-07-14T11:03:43.071 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-07-14T11:03:43.071 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-14T11:03:43.072 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-14T11:03:43.076 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-14T11:03:43.077 DEBUG:teuthology.orchestra.run.smithi179:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-14T11:03:43.147 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-07-14T11:03:43.152 INFO:teuthology.orchestra.run.smithi179.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-07-14T11:03:43.179 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-07-14T11:03:43.185 INFO:teuthology.orchestra.run.smithi179.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-07-14T11:03:43.271 INFO:teuthology.orchestra.run.smithi084.stderr:sudo: ntpd: command not found 2023-07-14T11:03:43.274 INFO:teuthology.orchestra.run.smithi179.stderr:sudo: ntpd: command not found 2023-07-14T11:03:43.299 INFO:teuthology.orchestra.run.smithi084.stdout:506 Cannot talk to daemon 2023-07-14T11:03:43.302 INFO:teuthology.orchestra.run.smithi179.stdout:506 Cannot talk to daemon 2023-07-14T11:03:43.331 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-07-14T11:03:43.336 INFO:teuthology.orchestra.run.smithi179.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-07-14T11:03:43.363 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-07-14T11:03:43.368 INFO:teuthology.orchestra.run.smithi179.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-07-14T11:03:43.461 INFO:teuthology.orchestra.run.smithi179.stderr:bash: ntpq: command not found 2023-07-14T11:03:43.465 INFO:teuthology.orchestra.run.smithi084.stderr:bash: ntpq: command not found 2023-07-14T11:03:43.468 INFO:teuthology.orchestra.run.smithi179.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-14T11:03:43.469 INFO:teuthology.orchestra.run.smithi179.stdout:=============================================================================== 2023-07-14T11:03:43.469 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-14T11:03:43.469 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-14T11:03:43.469 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-14T11:03:43.469 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-14T11:03:43.472 INFO:teuthology.orchestra.run.smithi084.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-14T11:03:43.472 INFO:teuthology.orchestra.run.smithi084.stdout:=============================================================================== 2023-07-14T11:03:43.472 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-14T11:03:43.472 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-14T11:03:43.472 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-14T11:03:43.472 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-14T11:03:43.473 INFO:teuthology.run_tasks:Running task install... 2023-07-14T11:03:43.483 DEBUG:teuthology.task.install:project ceph 2023-07-14T11:03:43.484 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '3fc0089cc1082313a98853d48b892acdc1385b8b'}} 2023-07-14T11:03:43.484 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '3fc0089cc1082313a98853d48b892acdc1385b8b'} 2023-07-14T11:03:43.484 INFO:teuthology.task.install:Using flavor: default 2023-07-14T11:03:43.497 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-07-14T11:03:43.497 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-07-14T11:03:43.498 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3fc0089cc1082313a98853d48b892acdc1385b8b', 'tag': None, 'wait_for_package': False} 2023-07-14T11:03:43.499 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=3fc0089cc1082313a98853d48b892acdc1385b8b 2023-07-14T11:03:43.502 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3fc0089cc1082313a98853d48b892acdc1385b8b', 'tag': None, 'wait_for_package': False} 2023-07-14T11:03:43.502 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=3fc0089cc1082313a98853d48b892acdc1385b8b 2023-07-14T11:03:43.729 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/centos/8/flavors/default/ 2023-07-14T11:03:43.730 INFO:teuthology.task.install.rpm:Package version is 18.0.0-4757.g3fc0089c 2023-07-14T11:03:43.735 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/centos/8/flavors/default/ 2023-07-14T11:03:43.735 INFO:teuthology.task.install.rpm:Package version is 18.0.0-4757.g3fc0089c 2023-07-14T11:03:43.993 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-07-14T11:03:43.993 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-14T11:03:43.993 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-07-14T11:03:43.996 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-07-14T11:03:43.996 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-07-14T11:03:43.996 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-07-14T11:03:44.066 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-07-14T11:03:44.067 DEBUG:teuthology.orchestra.run.smithi179:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3fc0089cc1082313a98853d48b892acdc1385b8b/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-07-14T11:03:44.068 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-07-14T11:03:44.069 DEBUG:teuthology.orchestra.run.smithi084:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3fc0089cc1082313a98853d48b892acdc1385b8b/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-07-14T11:03:44.177 DEBUG:teuthology.orchestra.run.smithi179:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-07-14T11:03:44.179 DEBUG:teuthology.orchestra.run.smithi084:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-07-14T11:03:44.273 DEBUG:teuthology.orchestra.run.smithi084:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-07-14T11:03:44.274 DEBUG:teuthology.orchestra.run.smithi179:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-07-14T11:03:44.343 INFO:teuthology.orchestra.run.smithi084.stdout:check_obsoletes = 1 2023-07-14T11:03:44.343 INFO:teuthology.orchestra.run.smithi179.stdout:check_obsoletes = 1 2023-07-14T11:03:44.346 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum clean all 2023-07-14T11:03:44.347 DEBUG:teuthology.orchestra.run.smithi179:> sudo yum clean all 2023-07-14T11:03:44.691 INFO:teuthology.orchestra.run.smithi179.stdout:73 files removed 2023-07-14T11:03:44.714 INFO:teuthology.orchestra.run.smithi084.stdout:73 files removed 2023-07-14T11:03:44.729 DEBUG:teuthology.orchestra.run.smithi179:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-07-14T11:03:44.750 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-07-14T11:03:45.935 INFO:teuthology.orchestra.run.smithi179.stdout:ceph packages for x86_64 121 kB/s | 81 kB 00:00 2023-07-14T11:03:45.940 INFO:teuthology.orchestra.run.smithi084.stdout:ceph packages for x86_64 123 kB/s | 81 kB 00:00 2023-07-14T11:03:46.527 INFO:teuthology.orchestra.run.smithi179.stdout:ceph noarch packages 17 kB/s | 9.4 kB 00:00 2023-07-14T11:03:46.541 INFO:teuthology.orchestra.run.smithi084.stdout:ceph noarch packages 17 kB/s | 9.4 kB 00:00 2023-07-14T11:03:47.145 INFO:teuthology.orchestra.run.smithi179.stdout:ceph source packages 2.5 kB/s | 1.5 kB 00:00 2023-07-14T11:03:47.300 INFO:teuthology.orchestra.run.smithi084.stdout:ceph source packages 2.0 kB/s | 1.5 kB 00:00 2023-07-14T11:03:55.340 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 8 - AppStream 3.8 MB/s | 31 MB 00:08 2023-07-14T11:04:02.260 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Stream 8 - AppStream 2.0 MB/s | 31 MB 00:15 2023-07-14T11:04:03.881 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 8 - BaseOS 16 MB/s | 41 MB 00:02 2023-07-14T11:04:10.823 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 8 - Extras 30 kB/s | 18 kB 00:00 2023-07-14T11:04:11.582 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 8 - Extras common packages 11 kB/s | 6.6 kB 00:00 2023-07-14T11:04:12.406 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 8 - PowerTools 9.3 MB/s | 6.3 MB 00:00 2023-07-14T11:04:13.900 INFO:teuthology.orchestra.run.smithi084.stdout:Copr repo for python3-asyncssh owned by ceph 22 kB/s | 3.5 kB 00:00 2023-07-14T11:04:14.119 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Stream 8 - BaseOS 7.0 MB/s | 41 MB 00:05 2023-07-14T11:04:18.387 INFO:teuthology.orchestra.run.smithi084.stdout:Extra Packages for Enterprise Linux 3.6 MB/s | 16 MB 00:04 2023-07-14T11:04:20.744 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Stream 8 - Extras 55 kB/s | 18 kB 00:00 2023-07-14T11:04:21.386 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Stream 8 - Extras common packages 14 kB/s | 6.6 kB 00:00 2023-07-14T11:04:22.387 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Stream 8 - PowerTools 7.3 MB/s | 6.3 MB 00:00 2023-07-14T11:04:22.734 INFO:teuthology.orchestra.run.smithi084.stdout:lab-extras 285 kB/s | 24 kB 00:00 2023-07-14T11:04:23.955 INFO:teuthology.orchestra.run.smithi179.stdout:Copr repo for python3-asyncssh owned by ceph 16 kB/s | 3.5 kB 00:00 2023-07-14T11:04:25.940 INFO:teuthology.orchestra.run.smithi179.stdout:Extra Packages for Enterprise Linux 8.5 MB/s | 16 MB 00:01 2023-07-14T11:04:26.691 INFO:teuthology.orchestra.run.smithi084.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-14T11:04:26.692 INFO:teuthology.orchestra.run.smithi084.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-14T11:04:26.705 INFO:teuthology.orchestra.run.smithi084.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-07-14T11:04:26.705 INFO:teuthology.orchestra.run.smithi084.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-07-14T11:04:26.706 INFO:teuthology.orchestra.run.smithi084.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-07-14T11:04:26.707 INFO:teuthology.orchestra.run.smithi084.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-07-14T11:04:26.708 INFO:teuthology.orchestra.run.smithi084.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-07-14T11:04:26.710 INFO:teuthology.orchestra.run.smithi084.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-07-14T11:04:26.713 INFO:teuthology.orchestra.run.smithi084.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-07-14T11:04:26.714 INFO:teuthology.orchestra.run.smithi084.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-07-14T11:04:26.902 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2023-07-14T11:04:26.916 INFO:teuthology.orchestra.run.smithi084.stdout:==================================================================================================== 2023-07-14T11:04:26.917 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repository Size 2023-07-14T11:04:26.917 INFO:teuthology.orchestra.run.smithi084.stdout:==================================================================================================== 2023-07-14T11:04:26.917 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2023-07-14T11:04:26.917 INFO:teuthology.orchestra.run.smithi084.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-07-14T11:04:26.918 INFO:teuthology.orchestra.run.smithi084.stdout: ceph x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 6.4 k 2023-07-14T11:04:26.918 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-base x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 5.4 M 2023-07-14T11:04:26.918 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-fuse x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 848 k 2023-07-14T11:04:26.918 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 165 k 2023-07-14T11:04:26.918 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 1.5 M 2023-07-14T11:04:26.918 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-cephadm noarch 2:18.0.0-4757.g3fc0089c.el8 ceph-noarch 129 k 2023-07-14T11:04:26.918 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-dashboard noarch 2:18.0.0-4757.g3fc0089c.el8 ceph-noarch 1.7 M 2023-07-14T11:04:26.918 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-4757.g3fc0089c.el8 ceph-noarch 7.4 M 2023-07-14T11:04:26.919 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-rook noarch 2:18.0.0-4757.g3fc0089c.el8 ceph-noarch 47 k 2023-07-14T11:04:26.919 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-radosgw x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 13 M 2023-07-14T11:04:26.919 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-test x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 48 M 2023-07-14T11:04:26.919 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-volume noarch 2:18.0.0-4757.g3fc0089c.el8 ceph-noarch 258 k 2023-07-14T11:04:26.919 INFO:teuthology.orchestra.run.smithi084.stdout: cephadm noarch 2:18.0.0-4757.g3fc0089c.el8 ceph-noarch 166 k 2023-07-14T11:04:26.919 INFO:teuthology.orchestra.run.smithi084.stdout: cephfs-mirror x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 258 k 2023-07-14T11:04:26.919 INFO:teuthology.orchestra.run.smithi084.stdout: cephfs-top noarch 2:18.0.0-4757.g3fc0089c.el8 ceph-noarch 18 k 2023-07-14T11:04:26.920 INFO:teuthology.orchestra.run.smithi084.stdout: elfutils-libelf-devel x86_64 0.189-2.el8 baseos 61 k 2023-07-14T11:04:26.920 INFO:teuthology.orchestra.run.smithi084.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-07-14T11:04:26.920 INFO:teuthology.orchestra.run.smithi084.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2023-07-14T11:04:26.920 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs-devel x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 31 k 2023-07-14T11:04:26.920 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs2 x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 771 k 2023-07-14T11:04:26.920 INFO:teuthology.orchestra.run.smithi084.stdout: librados-devel x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 139 k 2023-07-14T11:04:26.920 INFO:teuthology.orchestra.run.smithi084.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2023-07-14T11:04:26.921 INFO:teuthology.orchestra.run.smithi084.stdout: libuuid-devel x86_64 2.32.1-42.el8 baseos 99 k 2023-07-14T11:04:26.921 INFO:teuthology.orchestra.run.smithi084.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-07-14T11:04:26.921 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql x86_64 10.23-1.module_el8+300+2c53004c appstream 1.6 M 2023-07-14T11:04:26.921 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-contrib x86_64 10.23-1.module_el8+300+2c53004c appstream 903 k 2023-07-14T11:04:26.921 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-server x86_64 10.23-1.module_el8+300+2c53004c appstream 5.1 M 2023-07-14T11:04:26.921 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cephfs x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 197 k 2023-07-14T11:04:26.922 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rados x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 371 k 2023-07-14T11:04:26.922 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rbd x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 364 k 2023-07-14T11:04:26.922 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rgw x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 107 k 2023-07-14T11:04:26.922 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-fuse x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 94 k 2023-07-14T11:04:26.922 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-mirror x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 3.4 M 2023-07-14T11:04:26.923 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-nbd x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 179 k 2023-07-14T11:04:26.923 INFO:teuthology.orchestra.run.smithi084.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2023-07-14T11:04:26.923 INFO:teuthology.orchestra.run.smithi084.stdout:Upgrading: 2023-07-14T11:04:26.923 INFO:teuthology.orchestra.run.smithi084.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-8.el8 baseos 143 k 2023-07-14T11:04:26.923 INFO:teuthology.orchestra.run.smithi084.stdout: elfutils-debuginfod-client x86_64 0.189-2.el8 baseos 76 k 2023-07-14T11:04:26.923 INFO:teuthology.orchestra.run.smithi084.stdout: elfutils-libelf x86_64 0.189-2.el8 baseos 232 k 2023-07-14T11:04:26.924 INFO:teuthology.orchestra.run.smithi084.stdout: elfutils-libs x86_64 0.189-2.el8 baseos 302 k 2023-07-14T11:04:26.924 INFO:teuthology.orchestra.run.smithi084.stdout: iproute x86_64 6.2.0-2.el8 baseos 880 k 2023-07-14T11:04:26.924 INFO:teuthology.orchestra.run.smithi084.stdout: libblkid x86_64 2.32.1-42.el8 baseos 220 k 2023-07-14T11:04:26.924 INFO:teuthology.orchestra.run.smithi084.stdout: libfdisk x86_64 2.32.1-42.el8 baseos 253 k 2023-07-14T11:04:26.924 INFO:teuthology.orchestra.run.smithi084.stdout: libmount x86_64 2.32.1-42.el8 baseos 236 k 2023-07-14T11:04:26.924 INFO:teuthology.orchestra.run.smithi084.stdout: librados2 x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 3.7 M 2023-07-14T11:04:26.925 INFO:teuthology.orchestra.run.smithi084.stdout: librbd1 x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 3.6 M 2023-07-14T11:04:26.925 INFO:teuthology.orchestra.run.smithi084.stdout: libsmartcols x86_64 2.32.1-42.el8 baseos 179 k 2023-07-14T11:04:26.925 INFO:teuthology.orchestra.run.smithi084.stdout: libuuid x86_64 2.32.1-42.el8 baseos 98 k 2023-07-14T11:04:26.925 INFO:teuthology.orchestra.run.smithi084.stdout: util-linux x86_64 2.32.1-42.el8 baseos 2.6 M 2023-07-14T11:04:26.925 INFO:teuthology.orchestra.run.smithi084.stdout: util-linux-user x86_64 2.32.1-42.el8 baseos 102 k 2023-07-14T11:04:26.926 INFO:teuthology.orchestra.run.smithi084.stdout: xfsdump x86_64 3.1.8-6.el8 baseos 334 k 2023-07-14T11:04:26.926 INFO:teuthology.orchestra.run.smithi084.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2023-07-14T11:04:26.926 INFO:teuthology.orchestra.run.smithi084.stdout:Installing dependencies: 2023-07-14T11:04:26.926 INFO:teuthology.orchestra.run.smithi084.stdout: automake noarch 1.16.1-7.el8 appstream 713 k 2023-07-14T11:04:26.926 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-common x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 22 M 2023-07-14T11:04:26.926 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-grafana-dashboards noarch 2:18.0.0-4757.g3fc0089c.el8 ceph-noarch 23 k 2023-07-14T11:04:26.927 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mds x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 2.3 M 2023-07-14T11:04:26.927 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-modules-core noarch 2:18.0.0-4757.g3fc0089c.el8 ceph-noarch 240 k 2023-07-14T11:04:26.927 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mon x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 4.6 M 2023-07-14T11:04:26.927 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-osd x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 18 M 2023-07-14T11:04:26.927 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-prometheus-alerts noarch 2:18.0.0-4757.g3fc0089c.el8 ceph-noarch 15 k 2023-07-14T11:04:26.928 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-selinux x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 24 k 2023-07-14T11:04:26.928 INFO:teuthology.orchestra.run.smithi084.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-07-14T11:04:26.928 INFO:teuthology.orchestra.run.smithi084.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-07-14T11:04:26.928 INFO:teuthology.orchestra.run.smithi084.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-07-14T11:04:26.929 INFO:teuthology.orchestra.run.smithi084.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-07-14T11:04:26.929 INFO:teuthology.orchestra.run.smithi084.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-07-14T11:04:26.929 INFO:teuthology.orchestra.run.smithi084.stdout: libcephsqlite x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 137 k 2023-07-14T11:04:26.930 INFO:teuthology.orchestra.run.smithi084.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-07-14T11:04:26.930 INFO:teuthology.orchestra.run.smithi084.stdout: libgfortran x86_64 8.5.0-20.el8 baseos 645 k 2023-07-14T11:04:26.930 INFO:teuthology.orchestra.run.smithi084.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-07-14T11:04:26.930 INFO:teuthology.orchestra.run.smithi084.stdout: libpq x86_64 13.5-1.el8 appstream 198 k 2023-07-14T11:04:26.931 INFO:teuthology.orchestra.run.smithi084.stdout: libquadmath x86_64 8.5.0-20.el8 baseos 172 k 2023-07-14T11:04:26.931 INFO:teuthology.orchestra.run.smithi084.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-07-14T11:04:26.931 INFO:teuthology.orchestra.run.smithi084.stdout: libradosstriper1 x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 473 k 2023-07-14T11:04:26.931 INFO:teuthology.orchestra.run.smithi084.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-07-14T11:04:26.932 INFO:teuthology.orchestra.run.smithi084.stdout: librgw2 x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 6.7 M 2023-07-14T11:04:26.932 INFO:teuthology.orchestra.run.smithi084.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-07-14T11:04:26.932 INFO:teuthology.orchestra.run.smithi084.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-07-14T11:04:26.933 INFO:teuthology.orchestra.run.smithi084.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-07-14T11:04:26.933 INFO:teuthology.orchestra.run.smithi084.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-07-14T11:04:26.933 INFO:teuthology.orchestra.run.smithi084.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-07-14T11:04:26.934 INFO:teuthology.orchestra.run.smithi084.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-07-14T11:04:26.934 INFO:teuthology.orchestra.run.smithi084.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-07-14T11:04:26.934 INFO:teuthology.orchestra.run.smithi084.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-07-14T11:04:26.934 INFO:teuthology.orchestra.run.smithi084.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-07-14T11:04:26.935 INFO:teuthology.orchestra.run.smithi084.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-07-14T11:04:26.935 INFO:teuthology.orchestra.run.smithi084.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-07-14T11:04:26.935 INFO:teuthology.orchestra.run.smithi084.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-07-14T11:04:26.936 INFO:teuthology.orchestra.run.smithi084.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-07-14T11:04:26.936 INFO:teuthology.orchestra.run.smithi084.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-07-14T11:04:26.936 INFO:teuthology.orchestra.run.smithi084.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-07-14T11:04:26.936 INFO:teuthology.orchestra.run.smithi084.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-07-14T11:04:26.937 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-07-14T11:04:26.937 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-argparse x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 45 k 2023-07-14T11:04:26.937 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-common x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 119 k 2023-07-14T11:04:26.937 INFO:teuthology.orchestra.run.smithi084.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-07-14T11:04:26.937 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-07-14T11:04:26.938 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-07-14T11:04:26.938 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-07-14T11:04:26.938 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-07-14T11:04:26.938 INFO:teuthology.orchestra.run.smithi084.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-07-14T11:04:26.939 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-07-14T11:04:26.939 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-07-14T11:04:26.939 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-07-14T11:04:26.940 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-07-14T11:04:26.940 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-07-14T11:04:26.940 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-07-14T11:04:26.940 INFO:teuthology.orchestra.run.smithi084.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-07-14T11:04:26.940 INFO:teuthology.orchestra.run.smithi084.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-07-14T11:04:26.940 INFO:teuthology.orchestra.run.smithi084.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-07-14T11:04:26.941 INFO:teuthology.orchestra.run.smithi084.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-07-14T11:04:26.941 INFO:teuthology.orchestra.run.smithi084.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-07-14T11:04:26.941 INFO:teuthology.orchestra.run.smithi084.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-07-14T11:04:26.941 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-07-14T11:04:26.941 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-07-14T11:04:26.941 INFO:teuthology.orchestra.run.smithi084.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-07-14T11:04:26.941 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-07-14T11:04:26.942 INFO:teuthology.orchestra.run.smithi084.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-07-14T11:04:26.942 INFO:teuthology.orchestra.run.smithi084.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-07-14T11:04:26.942 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-07-14T11:04:26.942 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-07-14T11:04:26.942 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-07-14T11:04:26.942 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-07-14T11:04:26.942 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pytz noarch 2017.2-9.el8 appstream 54 k 2023-07-14T11:04:26.943 INFO:teuthology.orchestra.run.smithi084.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-07-14T11:04:26.943 INFO:teuthology.orchestra.run.smithi084.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-07-14T11:04:26.943 INFO:teuthology.orchestra.run.smithi084.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-07-14T11:04:26.943 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-07-14T11:04:26.943 INFO:teuthology.orchestra.run.smithi084.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-07-14T11:04:26.943 INFO:teuthology.orchestra.run.smithi084.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-07-14T11:04:26.943 INFO:teuthology.orchestra.run.smithi084.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-07-14T11:04:26.944 INFO:teuthology.orchestra.run.smithi084.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-07-14T11:04:26.944 INFO:teuthology.orchestra.run.smithi084.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-07-14T11:04:26.944 INFO:teuthology.orchestra.run.smithi084.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-07-14T11:04:26.944 INFO:teuthology.orchestra.run.smithi084.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-07-14T11:04:26.944 INFO:teuthology.orchestra.run.smithi084.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-07-14T11:04:26.944 INFO:teuthology.orchestra.run.smithi084.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-07-14T11:04:26.944 INFO:teuthology.orchestra.run.smithi084.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-07-14T11:04:26.945 INFO:teuthology.orchestra.run.smithi084.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-07-14T11:04:26.945 INFO:teuthology.orchestra.run.smithi084.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-07-14T11:04:26.945 INFO:teuthology.orchestra.run.smithi084.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-07-14T11:04:26.945 INFO:teuthology.orchestra.run.smithi084.stdout: uuid x86_64 1.6.2-43.el8 appstream 64 k 2023-07-14T11:04:26.945 INFO:teuthology.orchestra.run.smithi084.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-07-14T11:04:26.945 INFO:teuthology.orchestra.run.smithi084.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-07-14T11:04:26.945 INFO:teuthology.orchestra.run.smithi084.stdout:Enabling module streams: 2023-07-14T11:04:26.945 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql 10 2023-07-14T11:04:26.946 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:04:26.946 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2023-07-14T11:04:26.946 INFO:teuthology.orchestra.run.smithi084.stdout:==================================================================================================== 2023-07-14T11:04:26.946 INFO:teuthology.orchestra.run.smithi084.stdout:Install 128 Packages 2023-07-14T11:04:26.946 INFO:teuthology.orchestra.run.smithi084.stdout:Upgrade 16 Packages 2023-07-14T11:04:26.946 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:04:26.947 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 212 M 2023-07-14T11:04:26.947 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2023-07-14T11:04:28.368 INFO:teuthology.orchestra.run.smithi084.stdout:(1/144): ceph-18.0.0-4757.g3fc0089c.el8.x86_64. 10 kB/s | 6.4 kB 00:00 2023-07-14T11:04:30.315 INFO:teuthology.orchestra.run.smithi179.stdout:lab-extras 514 kB/s | 24 kB 00:00 2023-07-14T11:04:31.392 INFO:teuthology.orchestra.run.smithi084.stdout:(2/144): ceph-fuse-18.0.0-4757.g3fc0089c.el8.x8 281 kB/s | 848 kB 00:03 2023-07-14T11:04:31.917 INFO:teuthology.orchestra.run.smithi084.stdout:(3/144): ceph-immutable-object-cache-18.0.0-475 315 kB/s | 165 kB 00:00 2023-07-14T11:04:34.263 INFO:teuthology.orchestra.run.smithi179.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-14T11:04:34.264 INFO:teuthology.orchestra.run.smithi179.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-14T11:04:34.277 INFO:teuthology.orchestra.run.smithi179.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-07-14T11:04:34.277 INFO:teuthology.orchestra.run.smithi179.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-07-14T11:04:34.278 INFO:teuthology.orchestra.run.smithi179.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-07-14T11:04:34.279 INFO:teuthology.orchestra.run.smithi179.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-07-14T11:04:34.280 INFO:teuthology.orchestra.run.smithi179.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-07-14T11:04:34.282 INFO:teuthology.orchestra.run.smithi179.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-07-14T11:04:34.285 INFO:teuthology.orchestra.run.smithi179.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-07-14T11:04:34.286 INFO:teuthology.orchestra.run.smithi179.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-07-14T11:04:34.477 INFO:teuthology.orchestra.run.smithi179.stdout:Dependencies resolved. 2023-07-14T11:04:34.491 INFO:teuthology.orchestra.run.smithi179.stdout:==================================================================================================== 2023-07-14T11:04:34.491 INFO:teuthology.orchestra.run.smithi179.stdout: Package Arch Version Repository Size 2023-07-14T11:04:34.491 INFO:teuthology.orchestra.run.smithi179.stdout:==================================================================================================== 2023-07-14T11:04:34.492 INFO:teuthology.orchestra.run.smithi179.stdout:Installing: 2023-07-14T11:04:34.492 INFO:teuthology.orchestra.run.smithi179.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-07-14T11:04:34.492 INFO:teuthology.orchestra.run.smithi179.stdout: ceph x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 6.4 k 2023-07-14T11:04:34.492 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-base x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 5.4 M 2023-07-14T11:04:34.493 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-fuse x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 848 k 2023-07-14T11:04:34.493 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 165 k 2023-07-14T11:04:34.493 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 1.5 M 2023-07-14T11:04:34.493 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-cephadm noarch 2:18.0.0-4757.g3fc0089c.el8 ceph-noarch 129 k 2023-07-14T11:04:34.494 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-dashboard noarch 2:18.0.0-4757.g3fc0089c.el8 ceph-noarch 1.7 M 2023-07-14T11:04:34.494 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-4757.g3fc0089c.el8 ceph-noarch 7.4 M 2023-07-14T11:04:34.494 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-rook noarch 2:18.0.0-4757.g3fc0089c.el8 ceph-noarch 47 k 2023-07-14T11:04:34.494 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-radosgw x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 13 M 2023-07-14T11:04:34.494 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-test x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 48 M 2023-07-14T11:04:34.495 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-volume noarch 2:18.0.0-4757.g3fc0089c.el8 ceph-noarch 258 k 2023-07-14T11:04:34.495 INFO:teuthology.orchestra.run.smithi179.stdout: cephadm noarch 2:18.0.0-4757.g3fc0089c.el8 ceph-noarch 166 k 2023-07-14T11:04:34.495 INFO:teuthology.orchestra.run.smithi179.stdout: cephfs-mirror x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 258 k 2023-07-14T11:04:34.496 INFO:teuthology.orchestra.run.smithi179.stdout: cephfs-top noarch 2:18.0.0-4757.g3fc0089c.el8 ceph-noarch 18 k 2023-07-14T11:04:34.496 INFO:teuthology.orchestra.run.smithi179.stdout: elfutils-libelf-devel x86_64 0.189-2.el8 baseos 61 k 2023-07-14T11:04:34.496 INFO:teuthology.orchestra.run.smithi179.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-07-14T11:04:34.496 INFO:teuthology.orchestra.run.smithi179.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2023-07-14T11:04:34.497 INFO:teuthology.orchestra.run.smithi179.stdout: libcephfs-devel x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 31 k 2023-07-14T11:04:34.497 INFO:teuthology.orchestra.run.smithi179.stdout: libcephfs2 x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 771 k 2023-07-14T11:04:34.497 INFO:teuthology.orchestra.run.smithi179.stdout: librados-devel x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 139 k 2023-07-14T11:04:34.497 INFO:teuthology.orchestra.run.smithi179.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2023-07-14T11:04:34.497 INFO:teuthology.orchestra.run.smithi179.stdout: libuuid-devel x86_64 2.32.1-42.el8 baseos 99 k 2023-07-14T11:04:34.497 INFO:teuthology.orchestra.run.smithi179.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-07-14T11:04:34.498 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql x86_64 10.23-1.module_el8+300+2c53004c appstream 1.6 M 2023-07-14T11:04:34.498 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-contrib x86_64 10.23-1.module_el8+300+2c53004c appstream 903 k 2023-07-14T11:04:34.498 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-server x86_64 10.23-1.module_el8+300+2c53004c appstream 5.1 M 2023-07-14T11:04:34.498 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cephfs x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 197 k 2023-07-14T11:04:34.498 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rados x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 371 k 2023-07-14T11:04:34.498 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rbd x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 364 k 2023-07-14T11:04:34.499 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rgw x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 107 k 2023-07-14T11:04:34.499 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-fuse x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 94 k 2023-07-14T11:04:34.499 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-mirror x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 3.4 M 2023-07-14T11:04:34.499 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-nbd x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 179 k 2023-07-14T11:04:34.499 INFO:teuthology.orchestra.run.smithi179.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2023-07-14T11:04:34.500 INFO:teuthology.orchestra.run.smithi179.stdout:Upgrading: 2023-07-14T11:04:34.500 INFO:teuthology.orchestra.run.smithi179.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-8.el8 baseos 143 k 2023-07-14T11:04:34.500 INFO:teuthology.orchestra.run.smithi179.stdout: elfutils-debuginfod-client x86_64 0.189-2.el8 baseos 76 k 2023-07-14T11:04:34.500 INFO:teuthology.orchestra.run.smithi179.stdout: elfutils-libelf x86_64 0.189-2.el8 baseos 232 k 2023-07-14T11:04:34.500 INFO:teuthology.orchestra.run.smithi179.stdout: elfutils-libs x86_64 0.189-2.el8 baseos 302 k 2023-07-14T11:04:34.501 INFO:teuthology.orchestra.run.smithi179.stdout: iproute x86_64 6.2.0-2.el8 baseos 880 k 2023-07-14T11:04:34.501 INFO:teuthology.orchestra.run.smithi179.stdout: libblkid x86_64 2.32.1-42.el8 baseos 220 k 2023-07-14T11:04:34.501 INFO:teuthology.orchestra.run.smithi179.stdout: libfdisk x86_64 2.32.1-42.el8 baseos 253 k 2023-07-14T11:04:34.501 INFO:teuthology.orchestra.run.smithi179.stdout: libmount x86_64 2.32.1-42.el8 baseos 236 k 2023-07-14T11:04:34.502 INFO:teuthology.orchestra.run.smithi179.stdout: librados2 x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 3.7 M 2023-07-14T11:04:34.502 INFO:teuthology.orchestra.run.smithi179.stdout: librbd1 x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 3.6 M 2023-07-14T11:04:34.502 INFO:teuthology.orchestra.run.smithi179.stdout: libsmartcols x86_64 2.32.1-42.el8 baseos 179 k 2023-07-14T11:04:34.502 INFO:teuthology.orchestra.run.smithi179.stdout: libuuid x86_64 2.32.1-42.el8 baseos 98 k 2023-07-14T11:04:34.502 INFO:teuthology.orchestra.run.smithi179.stdout: util-linux x86_64 2.32.1-42.el8 baseos 2.6 M 2023-07-14T11:04:34.502 INFO:teuthology.orchestra.run.smithi179.stdout: util-linux-user x86_64 2.32.1-42.el8 baseos 102 k 2023-07-14T11:04:34.503 INFO:teuthology.orchestra.run.smithi179.stdout: xfsdump x86_64 3.1.8-6.el8 baseos 334 k 2023-07-14T11:04:34.503 INFO:teuthology.orchestra.run.smithi179.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2023-07-14T11:04:34.503 INFO:teuthology.orchestra.run.smithi179.stdout:Installing dependencies: 2023-07-14T11:04:34.503 INFO:teuthology.orchestra.run.smithi179.stdout: automake noarch 1.16.1-7.el8 appstream 713 k 2023-07-14T11:04:34.503 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-common x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 22 M 2023-07-14T11:04:34.504 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-grafana-dashboards noarch 2:18.0.0-4757.g3fc0089c.el8 ceph-noarch 23 k 2023-07-14T11:04:34.504 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mds x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 2.3 M 2023-07-14T11:04:34.504 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-modules-core noarch 2:18.0.0-4757.g3fc0089c.el8 ceph-noarch 240 k 2023-07-14T11:04:34.504 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mon x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 4.6 M 2023-07-14T11:04:34.504 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-osd x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 18 M 2023-07-14T11:04:34.504 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-prometheus-alerts noarch 2:18.0.0-4757.g3fc0089c.el8 ceph-noarch 15 k 2023-07-14T11:04:34.504 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-selinux x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 24 k 2023-07-14T11:04:34.505 INFO:teuthology.orchestra.run.smithi179.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-07-14T11:04:34.505 INFO:teuthology.orchestra.run.smithi179.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-07-14T11:04:34.505 INFO:teuthology.orchestra.run.smithi179.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-07-14T11:04:34.505 INFO:teuthology.orchestra.run.smithi179.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-07-14T11:04:34.505 INFO:teuthology.orchestra.run.smithi179.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-07-14T11:04:34.505 INFO:teuthology.orchestra.run.smithi179.stdout: libcephsqlite x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 137 k 2023-07-14T11:04:34.505 INFO:teuthology.orchestra.run.smithi179.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-07-14T11:04:34.506 INFO:teuthology.orchestra.run.smithi179.stdout: libgfortran x86_64 8.5.0-20.el8 baseos 645 k 2023-07-14T11:04:34.506 INFO:teuthology.orchestra.run.smithi179.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-07-14T11:04:34.506 INFO:teuthology.orchestra.run.smithi179.stdout: libpq x86_64 13.5-1.el8 appstream 198 k 2023-07-14T11:04:34.506 INFO:teuthology.orchestra.run.smithi179.stdout: libquadmath x86_64 8.5.0-20.el8 baseos 172 k 2023-07-14T11:04:34.507 INFO:teuthology.orchestra.run.smithi179.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-07-14T11:04:34.507 INFO:teuthology.orchestra.run.smithi179.stdout: libradosstriper1 x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 473 k 2023-07-14T11:04:34.507 INFO:teuthology.orchestra.run.smithi179.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-07-14T11:04:34.507 INFO:teuthology.orchestra.run.smithi179.stdout: librgw2 x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 6.7 M 2023-07-14T11:04:34.507 INFO:teuthology.orchestra.run.smithi179.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-07-14T11:04:34.507 INFO:teuthology.orchestra.run.smithi179.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-07-14T11:04:34.508 INFO:teuthology.orchestra.run.smithi179.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-07-14T11:04:34.508 INFO:teuthology.orchestra.run.smithi179.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-07-14T11:04:34.508 INFO:teuthology.orchestra.run.smithi179.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-07-14T11:04:34.508 INFO:teuthology.orchestra.run.smithi179.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-07-14T11:04:34.508 INFO:teuthology.orchestra.run.smithi179.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-07-14T11:04:34.508 INFO:teuthology.orchestra.run.smithi179.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-07-14T11:04:34.509 INFO:teuthology.orchestra.run.smithi179.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-07-14T11:04:34.509 INFO:teuthology.orchestra.run.smithi179.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-07-14T11:04:34.509 INFO:teuthology.orchestra.run.smithi179.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-07-14T11:04:34.509 INFO:teuthology.orchestra.run.smithi179.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-07-14T11:04:34.509 INFO:teuthology.orchestra.run.smithi179.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-07-14T11:04:34.509 INFO:teuthology.orchestra.run.smithi179.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-07-14T11:04:34.509 INFO:teuthology.orchestra.run.smithi179.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-07-14T11:04:34.509 INFO:teuthology.orchestra.run.smithi179.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-07-14T11:04:34.510 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-07-14T11:04:34.510 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ceph-argparse x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 45 k 2023-07-14T11:04:34.510 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ceph-common x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 119 k 2023-07-14T11:04:34.510 INFO:teuthology.orchestra.run.smithi179.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-07-14T11:04:34.510 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-07-14T11:04:34.510 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-07-14T11:04:34.510 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-07-14T11:04:34.511 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-07-14T11:04:34.511 INFO:teuthology.orchestra.run.smithi179.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-07-14T11:04:34.511 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-07-14T11:04:34.511 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-07-14T11:04:34.511 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-07-14T11:04:34.511 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-07-14T11:04:34.511 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-07-14T11:04:34.512 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-07-14T11:04:34.512 INFO:teuthology.orchestra.run.smithi179.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-07-14T11:04:34.512 INFO:teuthology.orchestra.run.smithi179.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-07-14T11:04:34.512 INFO:teuthology.orchestra.run.smithi179.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-07-14T11:04:34.512 INFO:teuthology.orchestra.run.smithi179.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-07-14T11:04:34.512 INFO:teuthology.orchestra.run.smithi179.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-07-14T11:04:34.513 INFO:teuthology.orchestra.run.smithi179.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-07-14T11:04:34.513 INFO:teuthology.orchestra.run.smithi179.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-07-14T11:04:34.513 INFO:teuthology.orchestra.run.smithi179.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-07-14T11:04:34.513 INFO:teuthology.orchestra.run.smithi179.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-07-14T11:04:34.513 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-07-14T11:04:34.513 INFO:teuthology.orchestra.run.smithi179.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-07-14T11:04:34.513 INFO:teuthology.orchestra.run.smithi179.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-07-14T11:04:34.514 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-07-14T11:04:34.514 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-07-14T11:04:34.514 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-07-14T11:04:34.514 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-07-14T11:04:34.514 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pytz noarch 2017.2-9.el8 appstream 54 k 2023-07-14T11:04:34.514 INFO:teuthology.orchestra.run.smithi179.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-07-14T11:04:34.514 INFO:teuthology.orchestra.run.smithi179.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-07-14T11:04:34.515 INFO:teuthology.orchestra.run.smithi179.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-07-14T11:04:34.515 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-07-14T11:04:34.515 INFO:teuthology.orchestra.run.smithi179.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-07-14T11:04:34.515 INFO:teuthology.orchestra.run.smithi179.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-07-14T11:04:34.515 INFO:teuthology.orchestra.run.smithi179.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-07-14T11:04:34.515 INFO:teuthology.orchestra.run.smithi179.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-07-14T11:04:34.516 INFO:teuthology.orchestra.run.smithi179.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-07-14T11:04:34.516 INFO:teuthology.orchestra.run.smithi179.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-07-14T11:04:34.516 INFO:teuthology.orchestra.run.smithi179.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-07-14T11:04:34.516 INFO:teuthology.orchestra.run.smithi179.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-07-14T11:04:34.516 INFO:teuthology.orchestra.run.smithi179.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-07-14T11:04:34.516 INFO:teuthology.orchestra.run.smithi179.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-07-14T11:04:34.516 INFO:teuthology.orchestra.run.smithi179.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-07-14T11:04:34.517 INFO:teuthology.orchestra.run.smithi179.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-07-14T11:04:34.517 INFO:teuthology.orchestra.run.smithi179.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-07-14T11:04:34.517 INFO:teuthology.orchestra.run.smithi179.stdout: uuid x86_64 1.6.2-43.el8 appstream 64 k 2023-07-14T11:04:34.517 INFO:teuthology.orchestra.run.smithi179.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-07-14T11:04:34.517 INFO:teuthology.orchestra.run.smithi179.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-07-14T11:04:34.517 INFO:teuthology.orchestra.run.smithi179.stdout:Enabling module streams: 2023-07-14T11:04:34.518 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql 10 2023-07-14T11:04:34.518 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-07-14T11:04:34.518 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction Summary 2023-07-14T11:04:34.518 INFO:teuthology.orchestra.run.smithi179.stdout:==================================================================================================== 2023-07-14T11:04:34.518 INFO:teuthology.orchestra.run.smithi179.stdout:Install 128 Packages 2023-07-14T11:04:34.518 INFO:teuthology.orchestra.run.smithi179.stdout:Upgrade 16 Packages 2023-07-14T11:04:34.518 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-07-14T11:04:34.519 INFO:teuthology.orchestra.run.smithi179.stdout:Total download size: 212 M 2023-07-14T11:04:34.519 INFO:teuthology.orchestra.run.smithi179.stdout:Downloading Packages: 2023-07-14T11:04:34.857 INFO:teuthology.orchestra.run.smithi179.stdout:(1/144): ceph-18.0.0-4757.g3fc0089c.el8.x86_64. 32 kB/s | 6.4 kB 00:00 2023-07-14T11:04:35.375 INFO:teuthology.orchestra.run.smithi179.stdout:(2/144): ceph-fuse-18.0.0-4757.g3fc0089c.el8.x8 1.6 MB/s | 848 kB 00:00 2023-07-14T11:04:35.458 INFO:teuthology.orchestra.run.smithi179.stdout:(3/144): ceph-immutable-object-cache-18.0.0-475 1.9 MB/s | 165 kB 00:00 2023-07-14T11:04:36.250 INFO:teuthology.orchestra.run.smithi179.stdout:(4/144): ceph-mds-18.0.0-4757.g3fc0089c.el8.x86 2.9 MB/s | 2.3 MB 00:00 2023-07-14T11:04:36.483 INFO:teuthology.orchestra.run.smithi084.stdout:(4/144): ceph-mds-18.0.0-4757.g3fc0089c.el8.x86 514 kB/s | 2.3 MB 00:04 2023-07-14T11:04:36.683 INFO:teuthology.orchestra.run.smithi179.stdout:(5/144): ceph-mgr-18.0.0-4757.g3fc0089c.el8.x86 3.6 MB/s | 1.5 MB 00:00 2023-07-14T11:04:36.734 INFO:teuthology.orchestra.run.smithi084.stdout:(5/144): ceph-base-18.0.0-4757.g3fc0089c.el8.x8 614 kB/s | 5.4 MB 00:08 2023-07-14T11:04:37.125 INFO:teuthology.orchestra.run.smithi179.stdout:(6/144): ceph-base-18.0.0-4757.g3fc0089c.el8.x8 2.2 MB/s | 5.4 MB 00:02 2023-07-14T11:04:37.809 INFO:teuthology.orchestra.run.smithi179.stdout:(7/144): ceph-mon-18.0.0-4757.g3fc0089c.el8.x86 4.1 MB/s | 4.6 MB 00:01 2023-07-14T11:04:38.975 INFO:teuthology.orchestra.run.smithi084.stdout:(6/144): ceph-mgr-18.0.0-4757.g3fc0089c.el8.x86 636 kB/s | 1.5 MB 00:02 2023-07-14T11:04:40.175 INFO:teuthology.orchestra.run.smithi084.stdout:(7/144): ceph-common-18.0.0-4757.g3fc0089c.el8. 1.8 MB/s | 22 MB 00:12 2023-07-14T11:04:42.526 INFO:teuthology.orchestra.run.smithi179.stdout:(8/144): ceph-common-18.0.0-4757.g3fc0089c.el8. 2.8 MB/s | 22 MB 00:07 2023-07-14T11:04:42.668 INFO:teuthology.orchestra.run.smithi179.stdout:(9/144): ceph-radosgw-18.0.0-4757.g3fc0089c.el8 2.8 MB/s | 13 MB 00:04 2023-07-14T11:04:42.725 INFO:teuthology.orchestra.run.smithi179.stdout:(10/144): ceph-selinux-18.0.0-4757.g3fc0089c.el 122 kB/s | 24 kB 00:00 2023-07-14T11:04:43.201 INFO:teuthology.orchestra.run.smithi179.stdout:(11/144): ceph-osd-18.0.0-4757.g3fc0089c.el8.x8 2.9 MB/s | 18 MB 00:06 2023-07-14T11:04:43.227 INFO:teuthology.orchestra.run.smithi179.stdout:(12/144): cephfs-mirror-18.0.0-4757.g3fc0089c.e 514 kB/s | 258 kB 00:00 2023-07-14T11:04:43.352 INFO:teuthology.orchestra.run.smithi179.stdout:(13/144): libcephfs-devel-18.0.0-4757.g3fc0089c 207 kB/s | 31 kB 00:00 2023-07-14T11:04:43.486 INFO:teuthology.orchestra.run.smithi179.stdout:(14/144): libcephsqlite-18.0.0-4757.g3fc0089c.e 1.0 MB/s | 137 kB 00:00 2023-07-14T11:04:43.628 INFO:teuthology.orchestra.run.smithi179.stdout:(15/144): librados-devel-18.0.0-4757.g3fc0089c. 979 kB/s | 139 kB 00:00 2023-07-14T11:04:43.959 INFO:teuthology.orchestra.run.smithi084.stdout:(8/144): ceph-mon-18.0.0-4757.g3fc0089c.el8.x86 655 kB/s | 4.6 MB 00:07 2023-07-14T11:04:44.075 INFO:teuthology.orchestra.run.smithi084.stdout:(9/144): ceph-selinux-18.0.0-4757.g3fc0089c.el8 209 kB/s | 24 kB 00:00 2023-07-14T11:04:44.179 INFO:teuthology.orchestra.run.smithi179.stdout:(16/144): libcephfs2-18.0.0-4757.g3fc0089c.el8. 811 kB/s | 771 kB 00:00 2023-07-14T11:04:44.237 INFO:teuthology.orchestra.run.smithi179.stdout:(17/144): libradosstriper1-18.0.0-4757.g3fc0089 778 kB/s | 473 kB 00:00 2023-07-14T11:04:44.329 INFO:teuthology.orchestra.run.smithi179.stdout:(18/144): python3-ceph-argparse-18.0.0-4757.g3f 488 kB/s | 45 kB 00:00 2023-07-14T11:04:44.445 INFO:teuthology.orchestra.run.smithi179.stdout:(19/144): python3-ceph-common-18.0.0-4757.g3fc0 1.0 MB/s | 119 kB 00:00 2023-07-14T11:04:44.571 INFO:teuthology.orchestra.run.smithi179.stdout:(20/144): python3-cephfs-18.0.0-4757.g3fc0089c. 1.5 MB/s | 197 kB 00:00 2023-07-14T11:04:44.788 INFO:teuthology.orchestra.run.smithi179.stdout:(21/144): python3-rados-18.0.0-4757.g3fc0089c.e 1.7 MB/s | 371 kB 00:00 2023-07-14T11:04:44.988 INFO:teuthology.orchestra.run.smithi179.stdout:(22/144): python3-rbd-18.0.0-4757.g3fc0089c.el8 1.8 MB/s | 364 kB 00:00 2023-07-14T11:04:45.097 INFO:teuthology.orchestra.run.smithi179.stdout:(23/144): python3-rgw-18.0.0-4757.g3fc0089c.el8 985 kB/s | 107 kB 00:00 2023-07-14T11:04:45.197 INFO:teuthology.orchestra.run.smithi179.stdout:(24/144): rbd-fuse-18.0.0-4757.g3fc0089c.el8.x8 947 kB/s | 94 kB 00:00 2023-07-14T11:04:46.731 INFO:teuthology.orchestra.run.smithi179.stdout:(25/144): rbd-mirror-18.0.0-4757.g3fc0089c.el8. 2.2 MB/s | 3.4 MB 00:01 2023-07-14T11:04:46.839 INFO:teuthology.orchestra.run.smithi179.stdout:(26/144): rbd-nbd-18.0.0-4757.g3fc0089c.el8.x86 1.6 MB/s | 179 kB 00:00 2023-07-14T11:04:46.940 INFO:teuthology.orchestra.run.smithi179.stdout:(27/144): ceph-grafana-dashboards-18.0.0-4757.g 231 kB/s | 23 kB 00:00 2023-07-14T11:04:47.948 INFO:teuthology.orchestra.run.smithi179.stdout:(28/144): ceph-mgr-cephadm-18.0.0-4757.g3fc0089 128 kB/s | 129 kB 00:01 2023-07-14T11:04:49.040 INFO:teuthology.orchestra.run.smithi179.stdout:(29/144): ceph-mgr-dashboard-18.0.0-4757.g3fc00 1.6 MB/s | 1.7 MB 00:01 2023-07-14T11:04:51.115 INFO:teuthology.orchestra.run.smithi179.stdout:(30/144): librgw2-18.0.0-4757.g3fc0089c.el8.x86 995 kB/s | 6.7 MB 00:06 2023-07-14T11:04:51.728 INFO:teuthology.orchestra.run.smithi179.stdout:(31/144): ceph-mgr-modules-core-18.0.0-4757.g3f 392 kB/s | 240 kB 00:00 2023-07-14T11:04:51.907 INFO:teuthology.orchestra.run.smithi179.stdout:(32/144): ceph-mgr-rook-18.0.0-4757.g3fc0089c.e 266 kB/s | 47 kB 00:00 2023-07-14T11:04:51.974 INFO:teuthology.orchestra.run.smithi179.stdout:(33/144): ceph-prometheus-alerts-18.0.0-4757.g3 218 kB/s | 15 kB 00:00 2023-07-14T11:04:52.474 INFO:teuthology.orchestra.run.smithi179.stdout:(34/144): ceph-volume-18.0.0-4757.g3fc0089c.el8 517 kB/s | 258 kB 00:00 2023-07-14T11:04:53.150 INFO:teuthology.orchestra.run.smithi179.stdout:(35/144): cephadm-18.0.0-4757.g3fc0089c.el8.noa 247 kB/s | 166 kB 00:00 2023-07-14T11:04:53.242 INFO:teuthology.orchestra.run.smithi179.stdout:(36/144): cephfs-top-18.0.0-4757.g3fc0089c.el8. 196 kB/s | 18 kB 00:00 2023-07-14T11:04:53.505 INFO:teuthology.orchestra.run.smithi179.stdout:[MIRROR] automake-1.16.1-7.el8.noarch.rpm: Status code: 503 for http://mirror.san.fastserv.com/pub/linux/centos/8-stream/AppStream/x86_64/os/Packages/automake-1.16.1-7.el8.noarch.rpm (IP: 208.85.242.118) 2023-07-14T11:04:54.380 INFO:teuthology.orchestra.run.smithi179.stdout:(37/144): automake-1.16.1-7.el8.noarch.rpm 627 kB/s | 713 kB 00:01 2023-07-14T11:04:54.574 INFO:teuthology.orchestra.run.smithi179.stdout:[MIRROR] bison-3.0.4-10.el8.x86_64.rpm: Status code: 503 for http://mirror.san.fastserv.com/pub/linux/centos/8-stream/AppStream/x86_64/os/Packages/bison-3.0.4-10.el8.x86_64.rpm (IP: 208.85.242.118) 2023-07-14T11:04:54.992 INFO:teuthology.orchestra.run.smithi179.stdout:(38/144): bison-3.0.4-10.el8.x86_64.rpm 1.1 MB/s | 688 kB 00:00 2023-07-14T11:04:55.165 INFO:teuthology.orchestra.run.smithi179.stdout:[MIRROR] flex-2.6.1-9.el8.x86_64.rpm: Status code: 503 for http://mirror.san.fastserv.com/pub/linux/centos/8-stream/AppStream/x86_64/os/Packages/flex-2.6.1-9.el8.x86_64.rpm (IP: 208.85.242.118) 2023-07-14T11:04:55.518 INFO:teuthology.orchestra.run.smithi179.stdout:(39/144): flex-2.6.1-9.el8.x86_64.rpm 609 kB/s | 320 kB 00:00 2023-07-14T11:04:55.826 INFO:teuthology.orchestra.run.smithi179.stdout:(40/144): jq-1.6-7.el8.x86_64.rpm 657 kB/s | 202 kB 00:00 2023-07-14T11:04:56.010 INFO:teuthology.orchestra.run.smithi179.stdout:(41/144): libpq-13.5-1.el8.x86_64.rpm 1.1 MB/s | 198 kB 00:00 2023-07-14T11:04:56.427 INFO:teuthology.orchestra.run.smithi179.stdout:(42/144): librdkafka-0.11.4-3.el8.x86_64.rpm 850 kB/s | 354 kB 00:00 2023-07-14T11:04:57.119 INFO:teuthology.orchestra.run.smithi179.stdout:(43/144): libtool-2.4.6-25.el8.x86_64.rpm 1.0 MB/s | 709 kB 00:00 2023-07-14T11:04:57.344 INFO:teuthology.orchestra.run.smithi179.stdout:(44/144): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.1 MB/s | 259 kB 00:00 2023-07-14T11:04:57.511 INFO:teuthology.orchestra.run.smithi179.stdout:(45/144): oniguruma-6.8.2-2.el8.x86_64.rpm 1.1 MB/s | 187 kB 00:00 2023-07-14T11:04:59.015 INFO:teuthology.orchestra.run.smithi084.stdout:(10/144): ceph-radosgw-18.0.0-4757.g3fc0089c.el 733 kB/s | 13 MB 00:18 2023-07-14T11:04:59.540 INFO:teuthology.orchestra.run.smithi084.stdout:(11/144): cephfs-mirror-18.0.0-4757.g3fc0089c.e 492 kB/s | 258 kB 00:00 2023-07-14T11:04:59.665 INFO:teuthology.orchestra.run.smithi084.stdout:(12/144): libcephfs-devel-18.0.0-4757.g3fc0089c 248 kB/s | 31 kB 00:00 2023-07-14T11:04:59.761 INFO:teuthology.orchestra.run.smithi179.stdout:(46/144): openblas-0.3.15-4.el8.x86_64.rpm 2.1 MB/s | 4.7 MB 00:02 2023-07-14T11:05:00.712 INFO:teuthology.orchestra.run.smithi179.stdout:(47/144): ceph-mgr-diskprediction-local-18.0.0- 650 kB/s | 7.4 MB 00:11 2023-07-14T11:05:00.899 INFO:teuthology.orchestra.run.smithi084.stdout:(13/144): libcephfs2-18.0.0-4757.g3fc0089c.el8. 626 kB/s | 771 kB 00:01 2023-07-14T11:05:01.216 INFO:teuthology.orchestra.run.smithi084.stdout:(14/144): libcephsqlite-18.0.0-4757.g3fc0089c.e 433 kB/s | 137 kB 00:00 2023-07-14T11:05:01.532 INFO:teuthology.orchestra.run.smithi084.stdout:(15/144): librados-devel-18.0.0-4757.g3fc0089c. 439 kB/s | 139 kB 00:00 2023-07-14T11:05:01.770 INFO:teuthology.orchestra.run.smithi179.stdout:(48/144): openblas-threads-0.3.15-4.el8.x86_64. 2.4 MB/s | 4.9 MB 00:02 2023-07-14T11:05:01.970 INFO:teuthology.orchestra.run.smithi179.stdout:(49/144): postgresql-10.23-1.module_el8+300+2c5 1.2 MB/s | 1.6 MB 00:01 2023-07-14T11:05:02.204 INFO:teuthology.orchestra.run.smithi179.stdout:(50/144): postgresql-contrib-10.23-1.module_el8 2.0 MB/s | 903 kB 00:00 2023-07-14T11:05:02.241 INFO:teuthology.orchestra.run.smithi084.stdout:(16/144): libradosstriper1-18.0.0-4757.g3fc0089 668 kB/s | 473 kB 00:00 2023-07-14T11:05:04.262 INFO:teuthology.orchestra.run.smithi179.stdout:(51/144): postgresql-server-10.23-1.module_el8+ 2.2 MB/s | 5.1 MB 00:02 2023-07-14T11:05:04.396 INFO:teuthology.orchestra.run.smithi179.stdout:(52/144): python3-jinja2-2.10.1-3.el8.noarch.rp 4.0 MB/s | 538 kB 00:00 2023-07-14T11:05:04.505 INFO:teuthology.orchestra.run.smithi179.stdout:(53/144): python3-babel-2.5.1-7.el8.noarch.rpm 2.1 MB/s | 4.8 MB 00:02 2023-07-14T11:05:04.530 INFO:teuthology.orchestra.run.smithi179.stdout:(54/144): python3-jsonpatch-1.21-2.el8.noarch.r 199 kB/s | 27 kB 00:00 2023-07-14T11:05:04.564 INFO:teuthology.orchestra.run.smithi179.stdout:(55/144): python3-jsonpointer-1.10-11.el8.noarc 342 kB/s | 20 kB 00:00 2023-07-14T11:05:04.597 INFO:teuthology.orchestra.run.smithi179.stdout:(56/144): python3-mako-1.0.6-14.el8.noarch.rpm 2.3 MB/s | 157 kB 00:00 2023-07-14T11:05:04.623 INFO:teuthology.orchestra.run.smithi179.stdout:(57/144): python3-markupsafe-0.23-19.el8.x86_64 663 kB/s | 39 kB 00:00 2023-07-14T11:05:04.723 INFO:teuthology.orchestra.run.smithi179.stdout:(58/144): python3-numpy-f2py-1.14.3-10.el8.x86_ 2.2 MB/s | 225 kB 00:00 2023-07-14T11:05:04.781 INFO:teuthology.orchestra.run.smithi179.stdout:(59/144): python3-prettytable-0.7.2-14.el8.noar 756 kB/s | 44 kB 00:00 2023-07-14T11:05:04.840 INFO:teuthology.orchestra.run.smithi179.stdout:(60/144): python3-pyOpenSSL-19.0.0-1.el8.noarch 1.7 MB/s | 103 kB 00:00 2023-07-14T11:05:04.907 INFO:teuthology.orchestra.run.smithi179.stdout:(61/144): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.9 MB/s | 126 kB 00:00 2023-07-14T11:05:04.966 INFO:teuthology.orchestra.run.smithi179.stdout:(62/144): python3-pyasn1-modules-0.3.7-6.el8.no 1.9 MB/s | 110 kB 00:00 2023-07-14T11:05:05.024 INFO:teuthology.orchestra.run.smithi179.stdout:(63/144): python3-pytz-2017.2-9.el8.noarch.rpm 933 kB/s | 54 kB 00:00 2023-07-14T11:05:05.175 INFO:teuthology.orchestra.run.smithi179.stdout:(64/144): python3-numpy-1.14.3-10.el8.x86_64.rp 6.5 MB/s | 3.7 MB 00:00 2023-07-14T11:05:05.275 INFO:teuthology.orchestra.run.smithi179.stdout:(65/144): python3-werkzeug-0.12.2-4.el8.noarch. 4.5 MB/s | 457 kB 00:00 2023-07-14T11:05:05.342 INFO:teuthology.orchestra.run.smithi179.stdout:(66/144): socat-1.7.4.1-1.el8.x86_64.rpm 4.7 MB/s | 323 kB 00:00 2023-07-14T11:05:05.409 INFO:teuthology.orchestra.run.smithi179.stdout:(67/144): uuid-1.6.2-43.el8.x86_64.rpm 961 kB/s | 64 kB 00:00 2023-07-14T11:05:05.476 INFO:teuthology.orchestra.run.smithi179.stdout:(68/144): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.0 MB/s | 71 kB 00:00 2023-07-14T11:05:05.626 INFO:teuthology.orchestra.run.smithi179.stdout:(69/144): elfutils-libelf-devel-0.189-2.el8.x86 411 kB/s | 61 kB 00:00 2023-07-14T11:05:05.727 INFO:teuthology.orchestra.run.smithi179.stdout:(70/144): fuse-2.9.7-17.el8.x86_64.rpm 831 kB/s | 83 kB 00:00 2023-07-14T11:05:05.785 INFO:teuthology.orchestra.run.smithi179.stdout:(71/144): keyutils-libs-devel-1.5.10-9.el8.x86_ 828 kB/s | 48 kB 00:00 2023-07-14T11:05:06.024 INFO:teuthology.orchestra.run.smithi179.stdout:(72/144): krb5-devel-1.18.2-22.el8.x86_64.rpm 2.3 MB/s | 561 kB 00:00 2023-07-14T11:05:06.094 INFO:teuthology.orchestra.run.smithi179.stdout:(73/144): libaio-devel-0.3.112-1.el8.x86_64.rpm 268 kB/s | 19 kB 00:00 2023-07-14T11:05:06.153 INFO:teuthology.orchestra.run.smithi179.stdout:(74/144): libcom_err-devel-1.45.6-5.el8.x86_64. 664 kB/s | 39 kB 00:00 2023-07-14T11:05:06.378 INFO:teuthology.orchestra.run.smithi179.stdout:(75/144): libgfortran-8.5.0-20.el8.x86_64.rpm 2.8 MB/s | 645 kB 00:00 2023-07-14T11:05:06.470 INFO:teuthology.orchestra.run.smithi179.stdout:(76/144): libquadmath-8.5.0-20.el8.x86_64.rpm 1.8 MB/s | 172 kB 00:00 2023-07-14T11:05:06.529 INFO:teuthology.orchestra.run.smithi179.stdout:(77/144): librabbitmq-0.9.0-4.el8.x86_64.rpm 807 kB/s | 47 kB 00:00 2023-07-14T11:05:06.621 INFO:teuthology.orchestra.run.smithi179.stdout:(78/144): libselinux-devel-2.9-8.el8.x86_64.rpm 2.1 MB/s | 200 kB 00:00 2023-07-14T11:05:06.679 INFO:teuthology.orchestra.run.smithi179.stdout:(79/144): libsepol-devel-2.9-3.el8.x86_64.rpm 1.5 MB/s | 87 kB 00:00 2023-07-14T11:05:06.746 INFO:teuthology.orchestra.run.smithi179.stdout:(80/144): libuuid-devel-2.32.1-42.el8.x86_64.rp 1.5 MB/s | 99 kB 00:00 2023-07-14T11:05:06.797 INFO:teuthology.orchestra.run.smithi179.stdout:(81/144): libverto-devel-0.3.2-2.el8.x86_64.rpm 363 kB/s | 18 kB 00:00 2023-07-14T11:05:06.847 INFO:teuthology.orchestra.run.smithi179.stdout:(82/144): libzstd-devel-1.4.4-1.el8.x86_64.rpm 877 kB/s | 44 kB 00:00 2023-07-14T11:05:07.356 INFO:teuthology.orchestra.run.smithi179.stdout:(83/144): openssl-devel-1.1.1k-9.el8.x86_64.rpm 6.3 MB/s | 3.2 MB 00:00 2023-07-14T11:05:07.464 INFO:teuthology.orchestra.run.smithi179.stdout:(84/144): pcre2-devel-10.32-3.el8.x86_64.rpm 5.5 MB/s | 605 kB 00:00 2023-07-14T11:05:07.523 INFO:teuthology.orchestra.run.smithi179.stdout:(85/144): pcre2-utf16-10.32-3.el8.x86_64.rpm 3.9 MB/s | 229 kB 00:00 2023-07-14T11:05:07.590 INFO:teuthology.orchestra.run.smithi179.stdout:(86/144): pcre2-utf32-10.32-3.el8.x86_64.rpm 3.2 MB/s | 220 kB 00:00 2023-07-14T11:05:07.648 INFO:teuthology.orchestra.run.smithi179.stdout:(87/144): python3-cffi-1.11.5-6.el8.x86_64.rpm 4.2 MB/s | 249 kB 00:00 2023-07-14T11:05:07.749 INFO:teuthology.orchestra.run.smithi179.stdout:(88/144): python3-cryptography-3.2.1-6.el8.x86_ 6.3 MB/s | 641 kB 00:00 2023-07-14T11:05:07.832 INFO:teuthology.orchestra.run.smithi179.stdout:(89/144): python3-jwt-1.6.1-2.el8.noarch.rpm 512 kB/s | 43 kB 00:00 2023-07-14T11:05:07.891 INFO:teuthology.orchestra.run.smithi179.stdout:(90/144): python3-oauthlib-2.1.0-1.el8.noarch.r 2.6 MB/s | 155 kB 00:00 2023-07-14T11:05:07.950 INFO:teuthology.orchestra.run.smithi179.stdout:(91/144): python3-pycparser-2.14-14.el8.noarch. 1.8 MB/s | 109 kB 00:00 2023-07-14T11:05:08.009 INFO:teuthology.orchestra.run.smithi179.stdout:(92/144): python3-requests-oauthlib-1.0.0-1.el8 733 kB/s | 43 kB 00:00 2023-07-14T11:05:08.059 INFO:teuthology.orchestra.run.smithi179.stdout:(93/144): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 1.5 MB/s | 74 kB 00:00 2023-07-14T11:05:08.117 INFO:teuthology.orchestra.run.smithi179.stdout:(94/144): zlib-devel-1.2.11-21.el8.x86_64.rpm 1.0 MB/s | 58 kB 00:00 2023-07-14T11:05:08.476 INFO:teuthology.orchestra.run.smithi179.stdout:(95/144): python3-scipy-1.0.0-21.module_el8.5.0 4.0 MB/s | 14 MB 00:03 2023-07-14T11:05:08.851 INFO:teuthology.orchestra.run.smithi179.stdout:(96/144): gperftools-libs-2.7-9.el8.x86_64.rpm 417 kB/s | 306 kB 00:00 2023-07-14T11:05:08.985 INFO:teuthology.orchestra.run.smithi179.stdout:(97/144): libunwind-1.3.1-3.el8.x86_64.rpm 565 kB/s | 75 kB 00:00 2023-07-14T11:05:09.035 INFO:teuthology.orchestra.run.smithi179.stdout:(98/144): liboath-2.6.2-3.el8.x86_64.rpm 105 kB/s | 59 kB 00:00 2023-07-14T11:05:09.211 INFO:teuthology.orchestra.run.smithi179.stdout:(99/144): python3-asyncssh-2.7.0-2.el8.noarch.r 2.1 MB/s | 476 kB 00:00 2023-07-14T11:05:09.236 INFO:teuthology.orchestra.run.smithi179.stdout:(100/144): python3-bcrypt-3.1.6-2.el8.1.x86_64. 218 kB/s | 44 kB 00:00 2023-07-14T11:05:09.361 INFO:teuthology.orchestra.run.smithi179.stdout:(101/144): python3-beautifulsoup4-4.6.3-2.el8.1 1.2 MB/s | 185 kB 00:00 2023-07-14T11:05:09.411 INFO:teuthology.orchestra.run.smithi179.stdout:(102/144): python3-cachetools-3.1.1-4.el8.noarc 188 kB/s | 33 kB 00:00 2023-07-14T11:05:09.504 INFO:teuthology.orchestra.run.smithi179.stdout:(103/144): python3-certifi-2018.10.15-7.el8.noa 115 kB/s | 16 kB 00:00 2023-07-14T11:05:09.762 INFO:teuthology.orchestra.run.smithi179.stdout:(104/144): python3-cherrypy-18.4.0-1.el8.noarch 1.5 MB/s | 384 kB 00:00 2023-07-14T11:05:09.787 INFO:teuthology.orchestra.run.smithi179.stdout:(105/144): python3-cheroot-8.5.2-1.el8.noarch.r 459 kB/s | 173 kB 00:00 2023-07-14T11:05:09.913 INFO:teuthology.orchestra.run.smithi179.stdout:(106/144): python3-google-auth-1.1.1-10.el8.noa 541 kB/s | 81 kB 00:00 2023-07-14T11:05:09.938 INFO:teuthology.orchestra.run.smithi179.stdout:(107/144): python3-jaraco-6.2-6.el8.noarch.rpm 74 kB/s | 11 kB 00:00 2023-07-14T11:05:09.957 INFO:teuthology.orchestra.run.smithi084.stdout:(17/144): ceph-osd-18.0.0-4757.g3fc0089c.el8.x8 586 kB/s | 18 MB 00:30 2023-07-14T11:05:10.115 INFO:teuthology.orchestra.run.smithi084.stdout:(18/144): python3-ceph-argparse-18.0.0-4757.g3f 283 kB/s | 45 kB 00:00 2023-07-14T11:05:10.263 INFO:teuthology.orchestra.run.smithi179.stdout:(108/144): python3-jaraco-functools-2.0-4.el8.n 50 kB/s | 18 kB 00:00 2023-07-14T11:05:10.332 INFO:teuthology.orchestra.run.smithi084.stdout:(19/144): python3-ceph-common-18.0.0-4757.g3fc0 548 kB/s | 119 kB 00:00 2023-07-14T11:05:10.397 INFO:teuthology.orchestra.run.smithi179.stdout:(109/144): python3-logutils-0.3.5-11.el8.noarch 366 kB/s | 49 kB 00:00 2023-07-14T11:05:10.522 INFO:teuthology.orchestra.run.smithi179.stdout:(110/144): python3-more-itertools-7.2.0-3.el8.n 470 kB/s | 59 kB 00:00 2023-07-14T11:05:10.540 INFO:teuthology.orchestra.run.smithi084.stdout:(20/144): python3-cephfs-18.0.0-4757.g3fc0089c. 945 kB/s | 197 kB 00:00 2023-07-14T11:05:10.564 INFO:teuthology.orchestra.run.smithi179.stdout:(111/144): python3-kubernetes-11.0.0-6.el8.noar 1.9 MB/s | 1.2 MB 00:00 2023-07-14T11:05:10.640 INFO:teuthology.orchestra.run.smithi179.stdout:(112/144): python3-natsort-7.1.1-2.el8.noarch.r 516 kB/s | 60 kB 00:00 2023-07-14T11:05:10.698 INFO:teuthology.orchestra.run.smithi179.stdout:(113/144): python3-pecan-1.3.2-9.el8.noarch.rpm 2.1 MB/s | 283 kB 00:00 2023-07-14T11:05:10.748 INFO:teuthology.orchestra.run.smithi179.stdout:(114/144): python3-portend-2.6-1.el8.noarch.rpm 144 kB/s | 16 kB 00:00 2023-07-14T11:05:10.799 INFO:teuthology.orchestra.run.smithi179.stdout:(115/144): python3-repoze-lru-0.7-6.el8.noarch. 336 kB/s | 34 kB 00:00 2023-07-14T11:05:10.824 INFO:teuthology.orchestra.run.smithi084.stdout:(21/144): librgw2-18.0.0-4757.g3fc0089c.el8.x86 804 kB/s | 6.7 MB 00:08 2023-07-14T11:05:10.891 INFO:teuthology.orchestra.run.smithi179.stdout:(116/144): python3-routes-2.4.1-12.el8.noarch.r 1.4 MB/s | 196 kB 00:00 2023-07-14T11:05:10.916 INFO:teuthology.orchestra.run.smithi179.stdout:(117/144): python3-rsa-4.8-1.el8.noarch.rpm 526 kB/s | 61 kB 00:00 2023-07-14T11:05:10.924 INFO:teuthology.orchestra.run.smithi084.stdout:(22/144): python3-rados-18.0.0-4757.g3fc0089c.e 968 kB/s | 371 kB 00:00 2023-07-14T11:05:11.000 INFO:teuthology.orchestra.run.smithi179.stdout:(118/144): python3-simplegeneric-0.8.1-17.el8.n 172 kB/s | 19 kB 00:00 2023-07-14T11:05:11.033 INFO:teuthology.orchestra.run.smithi179.stdout:(119/144): python3-singledispatch-3.4.0.3-18.el 204 kB/s | 24 kB 00:00 2023-07-14T11:05:11.095 INFO:teuthology.orchestra.run.smithi084.stdout:(23/144): python3-rgw-18.0.0-4757.g3fc0089c.el8 626 kB/s | 107 kB 00:00 2023-07-14T11:05:11.117 INFO:teuthology.orchestra.run.smithi179.stdout:(120/144): python3-tempora-1.14.1-5.el8.noarch. 250 kB/s | 29 kB 00:00 2023-07-14T11:05:11.151 INFO:teuthology.orchestra.run.smithi179.stdout:(121/144): python3-trustme-0.6.0-4.el8.noarch.r 236 kB/s | 27 kB 00:00 2023-07-14T11:05:11.233 INFO:teuthology.orchestra.run.smithi084.stdout:(24/144): rbd-fuse-18.0.0-4757.g3fc0089c.el8.x8 687 kB/s | 94 kB 00:00 2023-07-14T11:05:11.276 INFO:teuthology.orchestra.run.smithi179.stdout:(122/144): python3-waitress-1.4.3-1.el8.noarch. 1.6 MB/s | 255 kB 00:00 2023-07-14T11:05:11.301 INFO:teuthology.orchestra.run.smithi179.stdout:(123/144): python3-webob-1.8.5-1.el8.1.noarch.r 1.6 MB/s | 251 kB 00:00 2023-07-14T11:05:11.418 INFO:teuthology.orchestra.run.smithi179.stdout:(124/144): python3-websocket-client-0.56.0-5.el 432 kB/s | 61 kB 00:00 2023-07-14T11:05:11.443 INFO:teuthology.orchestra.run.smithi179.stdout:(125/144): python3-webtest-2.0.33-1.el8.noarch. 601 kB/s | 85 kB 00:00 2023-07-14T11:05:11.527 INFO:teuthology.orchestra.run.smithi179.stdout:(126/144): python3-zc-lockfile-2.0-2.el8.noarch 212 kB/s | 23 kB 00:00 2023-07-14T11:05:11.550 INFO:teuthology.orchestra.run.smithi084.stdout:(25/144): python3-rbd-18.0.0-4757.g3fc0089c.el8 502 kB/s | 364 kB 00:00 2023-07-14T11:05:11.761 INFO:teuthology.orchestra.run.smithi179.stdout:(127/144): thrift-0.13.0-2.el8.x86_64.rpm 5.5 MB/s | 1.7 MB 00:00 2023-07-14T11:05:11.992 INFO:teuthology.orchestra.run.smithi084.stdout:(26/144): rbd-nbd-18.0.0-4757.g3fc0089c.el8.x86 406 kB/s | 179 kB 00:00 2023-07-14T11:05:12.109 INFO:teuthology.orchestra.run.smithi084.stdout:(27/144): ceph-grafana-dashboards-18.0.0-4757.g 198 kB/s | 23 kB 00:00 2023-07-14T11:05:12.376 INFO:teuthology.orchestra.run.smithi084.stdout:(28/144): ceph-mgr-cephadm-18.0.0-4757.g3fc0089 483 kB/s | 129 kB 00:00 2023-07-14T11:05:16.392 INFO:teuthology.orchestra.run.smithi084.stdout:(29/144): rbd-mirror-18.0.0-4757.g3fc0089c.el8. 684 kB/s | 3.4 MB 00:05 2023-07-14T11:05:16.642 INFO:teuthology.orchestra.run.smithi084.stdout:(30/144): ceph-mgr-dashboard-18.0.0-4757.g3fc00 411 kB/s | 1.7 MB 00:04 2023-07-14T11:05:17.226 INFO:teuthology.orchestra.run.smithi084.stdout:(31/144): ceph-mgr-modules-core-18.0.0-4757.g3f 412 kB/s | 240 kB 00:00 2023-07-14T11:05:17.351 INFO:teuthology.orchestra.run.smithi084.stdout:(32/144): ceph-mgr-rook-18.0.0-4757.g3fc0089c.e 380 kB/s | 47 kB 00:00 2023-07-14T11:05:17.476 INFO:teuthology.orchestra.run.smithi084.stdout:(33/144): ceph-prometheus-alerts-18.0.0-4757.g3 117 kB/s | 15 kB 00:00 2023-07-14T11:05:18.185 INFO:teuthology.orchestra.run.smithi179.stdout:(128/144): librados2-18.0.0-4757.g3fc0089c.el8. 564 kB/s | 3.7 MB 00:06 2023-07-14T11:05:18.361 INFO:teuthology.orchestra.run.smithi179.stdout:(129/144): NetworkManager-initscripts-updown-1. 821 kB/s | 143 kB 00:00 2023-07-14T11:05:18.419 INFO:teuthology.orchestra.run.smithi179.stdout:(130/144): elfutils-debuginfod-client-0.189-2.e 1.3 MB/s | 76 kB 00:00 2023-07-14T11:05:18.573 INFO:teuthology.orchestra.run.smithi179.stdout:(131/144): librbd1-18.0.0-4757.g3fc0089c.el8.x8 535 kB/s | 3.6 MB 00:06 2023-07-14T11:05:18.603 INFO:teuthology.orchestra.run.smithi179.stdout:(132/144): elfutils-libelf-0.189-2.el8.x86_64.r 1.2 MB/s | 232 kB 00:00 2023-07-14T11:05:18.729 INFO:teuthology.orchestra.run.smithi179.stdout:(133/144): iproute-6.2.0-2.el8.x86_64.rpm 6.9 MB/s | 880 kB 00:00 2023-07-14T11:05:18.770 INFO:teuthology.orchestra.run.smithi179.stdout:(134/144): elfutils-libs-0.189-2.el8.x86_64.rpm 1.5 MB/s | 302 kB 00:00 2023-07-14T11:05:18.796 INFO:teuthology.orchestra.run.smithi179.stdout:(135/144): libblkid-2.32.1-42.el8.x86_64.rpm 3.2 MB/s | 220 kB 00:00 2023-07-14T11:05:18.829 INFO:teuthology.orchestra.run.smithi179.stdout:(136/144): libfdisk-2.32.1-42.el8.x86_64.rpm 4.2 MB/s | 253 kB 00:00 2023-07-14T11:05:18.855 INFO:teuthology.orchestra.run.smithi179.stdout:(137/144): libmount-2.32.1-42.el8.x86_64.rpm 3.9 MB/s | 236 kB 00:00 2023-07-14T11:05:18.880 INFO:teuthology.orchestra.run.smithi179.stdout:(138/144): libsmartcols-2.32.1-42.el8.x86_64.rp 3.5 MB/s | 179 kB 00:00 2023-07-14T11:05:18.913 INFO:teuthology.orchestra.run.smithi179.stdout:(139/144): libuuid-2.32.1-42.el8.x86_64.rpm 1.7 MB/s | 98 kB 00:00 2023-07-14T11:05:18.926 INFO:teuthology.orchestra.run.smithi084.stdout:(34/144): ceph-volume-18.0.0-4757.g3fc0089c.el8 178 kB/s | 258 kB 00:01 2023-07-14T11:05:18.972 INFO:teuthology.orchestra.run.smithi179.stdout:(140/144): util-linux-user-2.32.1-42.el8.x86_64 1.7 MB/s | 102 kB 00:00 2023-07-14T11:05:19.031 INFO:teuthology.orchestra.run.smithi179.stdout:(141/144): xfsdump-3.1.8-6.el8.x86_64.rpm 5.6 MB/s | 334 kB 00:00 2023-07-14T11:05:19.173 INFO:teuthology.orchestra.run.smithi179.stdout:(142/144): util-linux-2.32.1-42.el8.x86_64.rpm 8.9 MB/s | 2.6 MB 00:00 2023-07-14T11:05:19.223 INFO:teuthology.orchestra.run.smithi179.stdout:(143/144): xfsprogs-5.0.0-12.el8.x86_64.rpm 5.6 MB/s | 1.1 MB 00:00 2023-07-14T11:05:19.393 INFO:teuthology.orchestra.run.smithi084.stdout:(35/144): cephadm-18.0.0-4757.g3fc0089c.el8.noa 357 kB/s | 166 kB 00:00 2023-07-14T11:05:19.510 INFO:teuthology.orchestra.run.smithi084.stdout:(36/144): cephfs-top-18.0.0-4757.g3fc0089c.el8. 154 kB/s | 18 kB 00:00 2023-07-14T11:05:21.751 INFO:teuthology.orchestra.run.smithi084.stdout:(37/144): automake-1.16.1-7.el8.noarch.rpm 318 kB/s | 713 kB 00:02 2023-07-14T11:05:23.485 INFO:teuthology.orchestra.run.smithi084.stdout:(38/144): bison-3.0.4-10.el8.x86_64.rpm 397 kB/s | 688 kB 00:01 2023-07-14T11:05:24.160 INFO:teuthology.orchestra.run.smithi084.stdout:(39/144): flex-2.6.1-9.el8.x86_64.rpm 474 kB/s | 320 kB 00:00 2023-07-14T11:05:24.560 INFO:teuthology.orchestra.run.smithi084.stdout:(40/144): jq-1.6-7.el8.x86_64.rpm 507 kB/s | 202 kB 00:00 2023-07-14T11:05:24.994 INFO:teuthology.orchestra.run.smithi084.stdout:(41/144): libpq-13.5-1.el8.x86_64.rpm 456 kB/s | 198 kB 00:00 2023-07-14T11:05:25.619 INFO:teuthology.orchestra.run.smithi084.stdout:(42/144): librdkafka-0.11.4-3.el8.x86_64.rpm 566 kB/s | 354 kB 00:00 2023-07-14T11:05:26.161 INFO:teuthology.orchestra.run.smithi084.stdout:(43/144): ceph-mgr-diskprediction-local-18.0.0- 777 kB/s | 7.4 MB 00:09 2023-07-14T11:05:26.678 INFO:teuthology.orchestra.run.smithi084.stdout:(44/144): libtool-2.4.6-25.el8.x86_64.rpm 670 kB/s | 709 kB 00:01 2023-07-14T11:05:27.044 INFO:teuthology.orchestra.run.smithi084.stdout:(45/144): oniguruma-6.8.2-2.el8.x86_64.rpm 512 kB/s | 187 kB 00:00 2023-07-14T11:05:30.352 INFO:teuthology.orchestra.run.smithi084.stdout:(46/144): lttng-ust-2.8.1-11.el8.x86_64.rpm 62 kB/s | 259 kB 00:04 2023-07-14T11:05:31.469 INFO:teuthology.orchestra.run.smithi084.stdout:(47/144): openblas-0.3.15-4.el8.x86_64.rpm 1.1 MB/s | 4.7 MB 00:04 2023-07-14T11:05:32.994 INFO:teuthology.orchestra.run.smithi084.stdout:(48/144): postgresql-10.23-1.module_el8+300+2c5 1.0 MB/s | 1.6 MB 00:01 2023-07-14T11:05:33.877 INFO:teuthology.orchestra.run.smithi084.stdout:(49/144): postgresql-contrib-10.23-1.module_el8 1.0 MB/s | 903 kB 00:00 2023-07-14T11:05:37.710 INFO:teuthology.orchestra.run.smithi084.stdout:(50/144): postgresql-server-10.23-1.module_el8+ 1.3 MB/s | 5.1 MB 00:03 2023-07-14T11:05:39.619 INFO:teuthology.orchestra.run.smithi084.stdout:(51/144): openblas-threads-0.3.15-4.el8.x86_64. 537 kB/s | 4.9 MB 00:09 2023-07-14T11:05:40.968 INFO:teuthology.orchestra.run.smithi084.stdout:(52/144): python3-jinja2-2.10.1-3.el8.noarch.rp 399 kB/s | 538 kB 00:01 2023-07-14T11:05:41.127 INFO:teuthology.orchestra.run.smithi084.stdout:(53/144): python3-jsonpatch-1.21-2.el8.noarch.r 168 kB/s | 27 kB 00:00 2023-07-14T11:05:41.286 INFO:teuthology.orchestra.run.smithi084.stdout:(54/144): python3-jsonpointer-1.10-11.el8.noarc 126 kB/s | 20 kB 00:00 2023-07-14T11:05:41.578 INFO:teuthology.orchestra.run.smithi084.stdout:(55/144): python3-mako-1.0.6-14.el8.noarch.rpm 538 kB/s | 157 kB 00:00 2023-07-14T11:05:41.670 INFO:teuthology.orchestra.run.smithi084.stdout:(56/144): python3-babel-2.5.1-7.el8.noarch.rpm 1.2 MB/s | 4.8 MB 00:03 2023-07-14T11:05:41.745 INFO:teuthology.orchestra.run.smithi084.stdout:(57/144): python3-markupsafe-0.23-19.el8.x86_64 232 kB/s | 39 kB 00:00 2023-07-14T11:05:42.070 INFO:teuthology.orchestra.run.smithi084.stdout:(58/144): python3-numpy-f2py-1.14.3-10.el8.x86_ 692 kB/s | 225 kB 00:00 2023-07-14T11:05:42.254 INFO:teuthology.orchestra.run.smithi084.stdout:(59/144): python3-prettytable-0.7.2-14.el8.noar 240 kB/s | 44 kB 00:00 2023-07-14T11:05:42.429 INFO:teuthology.orchestra.run.smithi084.stdout:(60/144): python3-pyOpenSSL-19.0.0-1.el8.noarch 592 kB/s | 103 kB 00:00 2023-07-14T11:05:42.621 INFO:teuthology.orchestra.run.smithi084.stdout:(61/144): python3-pyasn1-0.3.7-6.el8.noarch.rpm 660 kB/s | 126 kB 00:00 2023-07-14T11:05:42.846 INFO:teuthology.orchestra.run.smithi084.stdout:(62/144): python3-pyasn1-modules-0.3.7-6.el8.no 489 kB/s | 110 kB 00:00 2023-07-14T11:05:43.055 INFO:teuthology.orchestra.run.smithi084.stdout:(63/144): python3-pytz-2017.2-9.el8.noarch.rpm 260 kB/s | 54 kB 00:00 2023-07-14T11:05:49.246 INFO:teuthology.orchestra.run.smithi084.stdout:(64/144): python3-numpy-1.14.3-10.el8.x86_64.rp 504 kB/s | 3.7 MB 00:07 2023-07-14T11:05:49.571 INFO:teuthology.orchestra.run.smithi084.stdout:(65/144): python3-werkzeug-0.12.2-4.el8.noarch. 1.4 MB/s | 457 kB 00:00 2023-07-14T11:05:49.787 INFO:teuthology.orchestra.run.smithi179.stdout:(144/144): ceph-test-18.0.0-4757.g3fc0089c.el8. 729 kB/s | 48 MB 01:07 2023-07-14T11:05:49.791 INFO:teuthology.orchestra.run.smithi179.stdout:-------------------------------------------------------------------------------- 2023-07-14T11:05:49.791 INFO:teuthology.orchestra.run.smithi179.stdout:Total 2.8 MB/s | 212 MB 01:15 2023-07-14T11:05:49.888 INFO:teuthology.orchestra.run.smithi084.stdout:(66/144): socat-1.7.4.1-1.el8.x86_64.rpm 1.0 MB/s | 323 kB 00:00 2023-07-14T11:05:50.096 INFO:teuthology.orchestra.run.smithi084.stdout:(67/144): uuid-1.6.2-43.el8.x86_64.rpm 307 kB/s | 64 kB 00:00 2023-07-14T11:05:50.280 INFO:teuthology.orchestra.run.smithi084.stdout:(68/144): xmlstarlet-1.6.1-20.el8.x86_64.rpm 386 kB/s | 71 kB 00:00 2023-07-14T11:05:50.739 INFO:teuthology.orchestra.run.smithi084.stdout:(69/144): elfutils-libelf-devel-0.189-2.el8.x86 134 kB/s | 61 kB 00:00 2023-07-14T11:05:50.981 INFO:teuthology.orchestra.run.smithi084.stdout:(70/144): fuse-2.9.7-17.el8.x86_64.rpm 344 kB/s | 83 kB 00:00 2023-07-14T11:05:51.139 INFO:teuthology.orchestra.run.smithi084.stdout:(71/144): keyutils-libs-devel-1.5.10-9.el8.x86_ 304 kB/s | 48 kB 00:00 2023-07-14T11:05:51.506 INFO:teuthology.orchestra.run.smithi084.stdout:(72/144): krb5-devel-1.18.2-22.el8.x86_64.rpm 1.5 MB/s | 561 kB 00:00 2023-07-14T11:05:51.596 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction check 2023-07-14T11:05:51.648 INFO:teuthology.orchestra.run.smithi084.stdout:(73/144): libaio-devel-0.3.112-1.el8.x86_64.rpm 132 kB/s | 19 kB 00:00 2023-07-14T11:05:51.782 INFO:teuthology.orchestra.run.smithi084.stdout:(74/144): libcom_err-devel-1.45.6-5.el8.x86_64. 290 kB/s | 39 kB 00:00 2023-07-14T11:05:51.949 INFO:teuthology.orchestra.run.smithi084.stdout:(75/144): libgfortran-8.5.0-20.el8.x86_64.rpm 3.8 MB/s | 645 kB 00:00 2023-07-14T11:05:52.009 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction check succeeded. 2023-07-14T11:05:52.009 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction test 2023-07-14T11:05:52.099 INFO:teuthology.orchestra.run.smithi084.stdout:(76/144): libquadmath-8.5.0-20.el8.x86_64.rpm 1.1 MB/s | 172 kB 00:00 2023-07-14T11:05:52.249 INFO:teuthology.orchestra.run.smithi084.stdout:(77/144): librabbitmq-0.9.0-4.el8.x86_64.rpm 313 kB/s | 47 kB 00:00 2023-07-14T11:05:52.424 INFO:teuthology.orchestra.run.smithi084.stdout:(78/144): python3-scipy-1.0.0-21.module_el8.5.0 1.5 MB/s | 14 MB 00:09 2023-07-14T11:05:52.450 INFO:teuthology.orchestra.run.smithi084.stdout:(79/144): libselinux-devel-2.9-8.el8.x86_64.rpm 1.0 MB/s | 200 kB 00:00 2023-07-14T11:05:52.671 INFO:teuthology.orchestra.run.smithi084.stdout:(80/144): libuuid-devel-2.32.1-42.el8.x86_64.rp 451 kB/s | 99 kB 00:00 2023-07-14T11:05:52.817 INFO:teuthology.orchestra.run.smithi084.stdout:(81/144): libverto-devel-0.3.2-2.el8.x86_64.rpm 123 kB/s | 18 kB 00:00 2023-07-14T11:05:52.934 INFO:teuthology.orchestra.run.smithi084.stdout:(82/144): libsepol-devel-2.9-3.el8.x86_64.rpm 171 kB/s | 87 kB 00:00 2023-07-14T11:05:52.968 INFO:teuthology.orchestra.run.smithi084.stdout:(83/144): libzstd-devel-1.4.4-1.el8.x86_64.rpm 292 kB/s | 44 kB 00:00 2023-07-14T11:05:53.110 INFO:teuthology.orchestra.run.smithi084.stdout:(84/144): pcre2-devel-10.32-3.el8.x86_64.rpm 4.2 MB/s | 605 kB 00:00 2023-07-14T11:05:53.251 INFO:teuthology.orchestra.run.smithi084.stdout:(85/144): pcre2-utf16-10.32-3.el8.x86_64.rpm 1.6 MB/s | 229 kB 00:00 2023-07-14T11:05:53.385 INFO:teuthology.orchestra.run.smithi084.stdout:(86/144): pcre2-utf32-10.32-3.el8.x86_64.rpm 1.6 MB/s | 220 kB 00:00 2023-07-14T11:05:53.482 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction test succeeded. 2023-07-14T11:05:53.486 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction 2023-07-14T11:05:53.510 INFO:teuthology.orchestra.run.smithi084.stdout:(87/144): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.9 MB/s | 249 kB 00:00 2023-07-14T11:05:53.661 INFO:teuthology.orchestra.run.smithi084.stdout:(88/144): python3-cryptography-3.2.1-6.el8.x86_ 4.2 MB/s | 641 kB 00:00 2023-07-14T11:05:53.794 INFO:teuthology.orchestra.run.smithi084.stdout:(89/144): python3-jwt-1.6.1-2.el8.noarch.rpm 320 kB/s | 43 kB 00:00 2023-07-14T11:05:53.919 INFO:teuthology.orchestra.run.smithi084.stdout:(90/144): python3-oauthlib-2.1.0-1.el8.noarch.r 1.2 MB/s | 155 kB 00:00 2023-07-14T11:05:54.070 INFO:teuthology.orchestra.run.smithi084.stdout:(91/144): python3-pycparser-2.14-14.el8.noarch. 727 kB/s | 109 kB 00:00 2023-07-14T11:05:54.220 INFO:teuthology.orchestra.run.smithi084.stdout:(92/144): python3-requests-oauthlib-1.0.0-1.el8 285 kB/s | 43 kB 00:00 2023-07-14T11:05:54.362 INFO:teuthology.orchestra.run.smithi084.stdout:(93/144): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 527 kB/s | 74 kB 00:00 2023-07-14T11:05:54.504 INFO:teuthology.orchestra.run.smithi084.stdout:(94/144): zlib-devel-1.2.11-21.el8.x86_64.rpm 409 kB/s | 58 kB 00:00 2023-07-14T11:05:54.662 INFO:teuthology.orchestra.run.smithi084.stdout:(95/144): openssl-devel-1.1.1k-9.el8.x86_64.rpm 1.8 MB/s | 3.2 MB 00:01 2023-07-14T11:05:58.816 INFO:teuthology.orchestra.run.smithi179.stdout: Preparing : 1/1 2023-07-14T11:05:59.036 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: thrift-0.13.0-2.el8.x86_64 1/1 2023-07-14T11:05:59.228 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/160 2023-07-14T11:05:59.356 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : libuuid-2.32.1-42.el8.x86_64 2/160 2023-07-14T11:05:59.440 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libuuid-2.32.1-42.el8.x86_64 2/160 2023-07-14T11:05:59.614 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : libblkid-2.32.1-42.el8.x86_64 3/160 2023-07-14T11:05:59.695 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libblkid-2.32.1-42.el8.x86_64 3/160 2023-07-14T11:05:59.941 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : liboath-2.6.2-3.el8.x86_64 4/160 2023-07-14T11:06:00.161 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : elfutils-libelf-0.189-2.el8.x86_64 5/160 2023-07-14T11:06:00.367 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 6/160 2023-07-14T11:06:00.531 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/160 2023-07-14T11:06:00.994 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/160 2023-07-14T11:06:01.173 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : librados2-2:18.0.0-4757.g3fc0089c.el8.x86_64 8/160 2023-07-14T11:06:01.617 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librados2-2:18.0.0-4757.g3fc0089c.el8.x86_64 8/160 2023-07-14T11:06:01.814 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : librbd1-2:18.0.0-4757.g3fc0089c.el8.x86_64 9/160 2023-07-14T11:06:01.961 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librbd1-2:18.0.0-4757.g3fc0089c.el8.x86_64 9/160 2023-07-14T11:06:02.155 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libcephfs2-2:18.0.0-4757.g3fc0089c.el8.x86_64 10/160 2023-07-14T11:06:02.257 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libcephfs2-2:18.0.0-4757.g3fc0089c.el8.x86_64 10/160 2023-07-14T11:06:02.497 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-rados-2:18.0.0-4757.g3fc0089c.el8.x86_64 11/160 2023-07-14T11:06:02.672 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 12/160 2023-07-14T11:06:02.900 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 12/160 2023-07-14T11:06:03.113 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 13/160 2023-07-14T11:06:03.210 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 13/160 2023-07-14T11:06:03.471 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/160 2023-07-14T11:06:03.673 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/160 2023-07-14T11:06:04.157 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libpq-13.5-1.el8.x86_64 16/160 2023-07-14T11:06:04.402 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 17/160 2023-07-14T11:06:04.563 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libcephsqlite-2:18.0.0-4757.g3fc0089c.el8.x86_64 18/160 2023-07-14T11:06:04.691 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libcephsqlite-2:18.0.0-4757.g3fc0089c.el8.x86_64 18/160 2023-07-14T11:06:04.830 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libradosstriper1-2:18.0.0-4757.g3fc0089c.el8.x86 19/160 2023-07-14T11:06:04.971 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libradosstriper1-2:18.0.0-4757.g3fc0089c.el8.x86 19/160 2023-07-14T11:06:05.232 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 20/160 2023-07-14T11:06:05.393 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 21/160 2023-07-14T11:06:05.530 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 22/160 2023-07-14T11:06:05.690 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 22/160 2023-07-14T11:06:05.830 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 23/160 2023-07-14T11:06:06.505 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 23/160 2023-07-14T11:06:06.696 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : openblas-0.3.15-4.el8.x86_64 24/160 2023-07-14T11:06:07.388 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 24/160 2023-07-14T11:06:07.588 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 25/160 2023-07-14T11:06:08.391 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 25/160 2023-07-14T11:06:08.788 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 26/160 2023-07-14T11:06:08.980 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 27/160 2023-07-14T11:06:09.153 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 28/160 2023-07-14T11:06:09.365 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 29/160 2023-07-14T11:06:09.612 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-ceph-common-2:18.0.0-4757.g3fc0089c.el8. 30/160 2023-07-14T11:06:09.809 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-ceph-argparse-2:18.0.0-4757.g3fc0089c.el 31/160 2023-07-14T11:06:10.029 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cephfs-2:18.0.0-4757.g3fc0089c.el8.x86_6 32/160 2023-07-14T11:06:11.090 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 33/160 2023-07-14T11:06:11.466 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 34/160 2023-07-14T11:06:11.782 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 35/160 2023-07-14T11:06:12.037 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 36/160 2023-07-14T11:06:14.123 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 36/160 2023-07-14T11:06:14.442 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 37/160 2023-07-14T11:06:14.662 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 38/160 2023-07-14T11:06:14.875 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-rsa-4.8-1.el8.noarch 39/160 2023-07-14T11:06:15.078 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-rbd-2:18.0.0-4757.g3fc0089c.el8.x86_64 40/160 2023-07-14T11:06:15.256 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : librados-devel-2:18.0.0-4757.g3fc0089c.el8.x86_6 41/160 2023-07-14T11:06:15.468 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : elfutils-libs-0.189-2.el8.x86_64 42/160 2023-07-14T11:06:15.662 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : elfutils-debuginfod-client-0.189-2.el8.x86_64 43/160 2023-07-14T11:06:15.937 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : libfdisk-2.32.1-42.el8.x86_64 44/160 2023-07-14T11:06:16.039 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libfdisk-2.32.1-42.el8.x86_64 44/160 2023-07-14T11:06:16.203 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : libmount-2.32.1-42.el8.x86_64 45/160 2023-07-14T11:06:16.289 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libmount-2.32.1-42.el8.x86_64 45/160 2023-07-14T11:06:16.466 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libuuid-devel-2.32.1-42.el8.x86_64 46/160 2023-07-14T11:06:16.637 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : libsmartcols-2.32.1-42.el8.x86_64 47/160 2023-07-14T11:06:17.221 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libsmartcols-2.32.1-42.el8.x86_64 47/160 2023-07-14T11:06:17.496 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : util-linux-2.32.1-42.el8.x86_64 48/160 2023-07-14T11:06:17.524 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: util-linux-2.32.1-42.el8.x86_64 48/160 2023-07-14T11:06:17.778 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 49/160 2023-07-14T11:06:18.060 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 50/160 2023-07-14T11:06:18.253 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 51/160 2023-07-14T11:06:18.809 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/160 2023-07-14T11:06:18.958 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/160 2023-07-14T11:06:19.177 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/160 2023-07-14T11:06:19.370 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/160 2023-07-14T11:06:19.619 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 56/160 2023-07-14T11:06:19.932 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 57/160 2023-07-14T11:06:20.103 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 58/160 2023-07-14T11:06:20.260 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 59/160 2023-07-14T11:06:20.510 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 60/160 2023-07-14T11:06:20.680 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-portend-2.6-1.el8.noarch 61/160 2023-07-14T11:06:20.899 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 62/160 2023-07-14T11:06:21.148 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 63/160 2023-07-14T11:06:21.428 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 64/160 2023-07-14T11:06:21.654 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 65/160 2023-07-14T11:06:22.009 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 66/160 2023-07-14T11:06:22.288 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 67/160 2023-07-14T11:06:22.513 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 68/160 2023-07-14T11:06:23.345 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 69/160 2023-07-14T11:06:23.575 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : librgw2-2:18.0.0-4757.g3fc0089c.el8.x86_64 70/160 2023-07-14T11:06:23.668 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librgw2-2:18.0.0-4757.g3fc0089c.el8.x86_64 70/160 2023-07-14T11:06:23.872 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-rgw-2:18.0.0-4757.g3fc0089c.el8.x86_64 71/160 2023-07-14T11:06:24.172 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 72/160 2023-07-14T11:06:24.586 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 73/160 2023-07-14T11:06:24.860 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 74/160 2023-07-14T11:06:25.075 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 75/160 2023-07-14T11:06:25.378 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 76/160 2023-07-14T11:06:25.603 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 77/160 2023-07-14T11:06:26.934 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/160 2023-07-14T11:06:27.322 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/160 2023-07-14T11:06:27.545 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 80/160 2023-07-14T11:06:27.814 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 81/160 2023-07-14T11:06:28.152 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 82/160 2023-07-14T11:06:28.377 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 83/160 2023-07-14T11:06:28.665 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 84/160 2023-07-14T11:06:28.881 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 85/160 2023-07-14T11:06:29.254 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 86/160 2023-07-14T11:06:29.508 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 87/160 2023-07-14T11:06:29.654 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 88/160 2023-07-14T11:06:29.846 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 89/160 2023-07-14T11:06:30.220 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 90/160 2023-07-14T11:06:30.465 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 91/160 2023-07-14T11:06:30.658 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 92/160 2023-07-14T11:06:30.852 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 93/160 2023-07-14T11:06:31.071 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 94/160 2023-07-14T11:06:31.313 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : fuse-2.9.7-17.el8.x86_64 95/160 2023-07-14T11:06:31.513 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 96/160 2023-07-14T11:06:31.718 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : uuid-1.6.2-43.el8.x86_64 97/160 2023-07-14T11:06:31.828 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 97/160 2023-07-14T11:06:32.028 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 98/160 2023-07-14T11:06:32.193 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 99/160 2023-07-14T11:06:35.051 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-common-2:18.0.0-4757.g3fc0089c.el8.x86_64 100/160 2023-07-14T11:06:35.301 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-common-2:18.0.0-4757.g3fc0089c.el8.x86_64 100/160 2023-07-14T11:06:36.001 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-common-2:18.0.0-4757.g3fc0089c.el8.x86_64 100/160 2023-07-14T11:06:36.299 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-base-2:18.0.0-4757.g3fc0089c.el8.x86_64 101/160 2023-07-14T11:06:36.492 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-base-2:18.0.0-4757.g3fc0089c.el8.x86_64 101/160 2023-07-14T11:06:36.767 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-selinux-2:18.0.0-4757.g3fc0089c.el8.x86_64 102/160 2023-07-14T11:06:41.978 INFO:teuthology.orchestra.run.smithi084.stdout:(96/144): ceph-test-18.0.0-4757.g3fc0089c.el8.x 415 kB/s | 48 MB 01:57 2023-07-14T11:06:57.333 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-selinux-2:18.0.0-4757.g3fc0089c.el8.x86_64 102/160 2023-07-14T11:06:57.334 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /sys 2023-07-14T11:06:57.334 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /proc 2023-07-14T11:06:57.334 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /dev 2023-07-14T11:06:57.334 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /run 2023-07-14T11:06:57.334 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /mnt 2023-07-14T11:06:57.334 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /var/tmp 2023-07-14T11:06:57.335 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /home 2023-07-14T11:06:57.335 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /tmp 2023-07-14T11:06:57.335 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /dev 2023-07-14T11:06:57.335 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-07-14T11:06:57.707 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-volume-2:18.0.0-4757.g3fc0089c.el8.noarch 103/160 2023-07-14T11:06:59.441 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-volume-2:18.0.0-4757.g3fc0089c.el8.noarch 103/160 2023-07-14T11:06:59.696 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-osd-2:18.0.0-4757.g3fc0089c.el8.x86_64 104/160 2023-07-14T11:06:59.964 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-osd-2:18.0.0-4757.g3fc0089c.el8.x86_64 104/160 2023-07-14T11:07:00.164 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mds-2:18.0.0-4757.g3fc0089c.el8.x86_64 105/160 2023-07-14T11:07:00.691 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mds-2:18.0.0-4757.g3fc0089c.el8.x86_64 105/160 2023-07-14T11:07:00.906 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mon-2:18.0.0-4757.g3fc0089c.el8.x86_64 106/160 2023-07-14T11:07:00.956 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mon-2:18.0.0-4757.g3fc0089c.el8.x86_64 106/160 2023-07-14T11:07:01.147 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 107/160 2023-07-14T11:07:01.410 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 108/160 2023-07-14T11:07:01.572 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 109/160 2023-07-14T11:07:01.666 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 109/160 2023-07-14T11:07:01.998 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : jq-1.6-7.el8.x86_64 110/160 2023-07-14T11:07:02.214 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : automake-1.16.1-7.el8.noarch 111/160 2023-07-14T11:07:02.796 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: cephadm-2:18.0.0-4757.g3fc0089c.el8.noarch 112/160 2023-07-14T11:07:02.965 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : cephadm-2:18.0.0-4757.g3fc0089c.el8.noarch 112/160 2023-07-14T11:07:03.149 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-4757.g3fc0089c.e 113/160 2023-07-14T11:07:03.377 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-4757.g3fc0089c. 114/160 2023-07-14T11:07:03.580 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-4757.g3fc0089c.el8.noa 115/160 2023-07-14T11:07:03.836 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-4757.g3fc0089c.el8.noa 115/160 2023-07-14T11:07:04.128 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-4757.g3fc0089c.el8.n 116/160 2023-07-14T11:07:05.237 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-4757.g3fc0089c.el8.n 116/160 2023-07-14T11:07:05.430 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-4757.g3fc 117/160 2023-07-14T11:07:05.555 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-4757.g3fc 117/160 2023-07-14T11:07:05.984 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-4757.g3fc0089c.el 118/160 2023-07-14T11:07:06.178 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-2:18.0.0-4757.g3fc0089c.el8.x86_64 119/160 2023-07-14T11:07:06.244 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mgr-2:18.0.0-4757.g3fc0089c.el8.x86_64 119/160 2023-07-14T11:07:06.404 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-rook-2:18.0.0-4757.g3fc0089c.el8.noarch 120/160 2023-07-14T11:07:06.431 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-4757.g3fc0089c.el8.noarch 120/160 2023-07-14T11:07:06.657 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-2:18.0.0-4757.g3fc0089c.el8.x86_64 121/160 2023-07-14T11:07:06.879 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libtool-2.4.6-25.el8.x86_64 122/160 2023-07-14T11:07:11.829 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 122/160 2023-07-14T11:07:13.437 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-test-2:18.0.0-4757.g3fc0089c.el8.x86_64 123/160 2023-07-14T11:07:13.686 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-radosgw-2:18.0.0-4757.g3fc0089c.el8.x86_64 124/160 2023-07-14T11:07:13.747 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-4757.g3fc0089c.el8.x86_64 124/160 2023-07-14T11:07:13.962 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-4757.g3fc00 125/160 2023-07-14T11:07:14.032 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-4757.g3fc00 125/160 2023-07-14T11:07:14.254 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : cephfs-mirror-2:18.0.0-4757.g3fc0089c.el8.x86_64 126/160 2023-07-14T11:07:14.660 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-4757.g3fc0089c.el8.x86_64 126/160 2023-07-14T11:07:14.904 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : rbd-mirror-2:18.0.0-4757.g3fc0089c.el8.x86_64 127/160 2023-07-14T11:07:15.258 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: rbd-mirror-2:18.0.0-4757.g3fc0089c.el8.x86_64 127/160 2023-07-14T11:07:15.566 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : postgresql-contrib-10.23-1.module_el8+300+2c5300 128/160 2023-07-14T11:07:16.841 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-fuse-2:18.0.0-4757.g3fc0089c.el8.x86_64 129/160 2023-07-14T11:07:17.192 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 130/160 2023-07-14T11:07:17.368 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : elfutils-libelf-devel-0.189-2.el8.x86_64 131/160 2023-07-14T11:07:17.617 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : util-linux-user-2.32.1-42.el8.x86_64 132/160 2023-07-14T11:07:17.783 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 133/160 2023-07-14T11:07:18.004 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libcephfs-devel-2:18.0.0-4757.g3fc0089c.el8.x86_ 134/160 2023-07-14T11:07:19.236 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 135/160 2023-07-14T11:07:19.528 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : postgresql-server-10.23-1.module_el8+300+2c53004 135/160 2023-07-14T11:07:19.611 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 135/160 2023-07-14T11:07:19.849 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : xfsdump-3.1.8-6.el8.x86_64 136/160 2023-07-14T11:07:20.112 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : cephfs-top-2:18.0.0-4757.g3fc0089c.el8.noarch 137/160 2023-07-14T11:07:20.405 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : rbd-fuse-2:18.0.0-4757.g3fc0089c.el8.x86_64 138/160 2023-07-14T11:07:20.728 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : rbd-nbd-2:18.0.0-4757.g3fc0089c.el8.x86_64 139/160 2023-07-14T11:07:21.097 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : iproute-6.2.0-2.el8.x86_64 140/160 2023-07-14T11:07:21.252 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-8.el 141/160 2023-07-14T11:07:21.284 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-8.el 141/160 2023-07-14T11:07:21.521 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 142/160 2023-07-14T11:07:21.786 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : flex-2.6.1-9.el8.x86_64 143/160 2023-07-14T11:07:21.896 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 143/160 2023-07-14T11:07:22.153 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : bison-3.0.4-10.el8.x86_64 144/160 2023-07-14T11:07:22.180 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 144/160 2023-07-14T11:07:22.354 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 145/160 2023-07-14T11:07:22.561 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 146/160 2023-07-14T11:07:22.749 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 147/160 2023-07-14T11:07:22.750 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 148/160 2023-07-14T11:07:23.074 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 148/160 2023-07-14T11:07:23.074 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 149/160 2023-07-14T11:07:23.305 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 149/160 2023-07-14T11:07:23.322 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-4.el 150/160 2023-07-14T11:07:23.450 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.16-4.el 150/160 2023-07-14T11:07:23.451 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 151/160 2023-07-14T11:07:23.719 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 151/160 2023-07-14T11:07:23.938 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 152/160 2023-07-14T11:07:24.118 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 153/160 2023-07-14T11:07:24.371 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 154/160 2023-07-14T11:07:24.371 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 155/160 2023-07-14T11:07:24.614 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 155/160 2023-07-14T11:07:24.614 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 156/160 2023-07-14T11:07:24.847 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 156/160 2023-07-14T11:07:24.847 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 157/160 2023-07-14T11:07:25.080 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 157/160 2023-07-14T11:07:25.080 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 158/160 2023-07-14T11:07:25.288 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 158/160 2023-07-14T11:07:25.289 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 159/160 2023-07-14T11:07:25.497 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 159/160 2023-07-14T11:07:25.737 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 160/160 2023-07-14T11:07:25.956 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 160/160 2023-07-14T11:07:25.956 INFO:teuthology.orchestra.run.smithi179.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-07-14T11:07:25.956 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-07-14T11:07:26.696 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-2:18.0.0-4757.g3fc0089c.el8.x86_64 1/160 2023-07-14T11:07:26.696 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-base-2:18.0.0-4757.g3fc0089c.el8.x86_64 2/160 2023-07-14T11:07:26.696 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-common-2:18.0.0-4757.g3fc0089c.el8.x86_64 3/160 2023-07-14T11:07:26.696 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-fuse-2:18.0.0-4757.g3fc0089c.el8.x86_64 4/160 2023-07-14T11:07:26.696 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-4757.g3fc00 5/160 2023-07-14T11:07:26.696 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mds-2:18.0.0-4757.g3fc0089c.el8.x86_64 6/160 2023-07-14T11:07:26.697 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-2:18.0.0-4757.g3fc0089c.el8.x86_64 7/160 2023-07-14T11:07:26.697 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mon-2:18.0.0-4757.g3fc0089c.el8.x86_64 8/160 2023-07-14T11:07:26.697 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-osd-2:18.0.0-4757.g3fc0089c.el8.x86_64 9/160 2023-07-14T11:07:26.697 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-radosgw-2:18.0.0-4757.g3fc0089c.el8.x86_64 10/160 2023-07-14T11:07:26.697 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-selinux-2:18.0.0-4757.g3fc0089c.el8.x86_64 11/160 2023-07-14T11:07:26.697 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-test-2:18.0.0-4757.g3fc0089c.el8.x86_64 12/160 2023-07-14T11:07:26.697 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : cephfs-mirror-2:18.0.0-4757.g3fc0089c.el8.x86_64 13/160 2023-07-14T11:07:26.698 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libcephfs-devel-2:18.0.0-4757.g3fc0089c.el8.x86_ 14/160 2023-07-14T11:07:26.698 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libcephfs2-2:18.0.0-4757.g3fc0089c.el8.x86_64 15/160 2023-07-14T11:07:26.698 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libcephsqlite-2:18.0.0-4757.g3fc0089c.el8.x86_64 16/160 2023-07-14T11:07:26.698 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librados-devel-2:18.0.0-4757.g3fc0089c.el8.x86_6 17/160 2023-07-14T11:07:26.698 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libradosstriper1-2:18.0.0-4757.g3fc0089c.el8.x86 18/160 2023-07-14T11:07:26.698 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librgw2-2:18.0.0-4757.g3fc0089c.el8.x86_64 19/160 2023-07-14T11:07:26.698 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-ceph-argparse-2:18.0.0-4757.g3fc0089c.el 20/160 2023-07-14T11:07:26.698 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-ceph-common-2:18.0.0-4757.g3fc0089c.el8. 21/160 2023-07-14T11:07:26.699 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cephfs-2:18.0.0-4757.g3fc0089c.el8.x86_6 22/160 2023-07-14T11:07:26.699 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-rados-2:18.0.0-4757.g3fc0089c.el8.x86_64 23/160 2023-07-14T11:07:26.699 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-rbd-2:18.0.0-4757.g3fc0089c.el8.x86_64 24/160 2023-07-14T11:07:26.699 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-rgw-2:18.0.0-4757.g3fc0089c.el8.x86_64 25/160 2023-07-14T11:07:26.699 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : rbd-fuse-2:18.0.0-4757.g3fc0089c.el8.x86_64 26/160 2023-07-14T11:07:26.699 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : rbd-mirror-2:18.0.0-4757.g3fc0089c.el8.x86_64 27/160 2023-07-14T11:07:26.699 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : rbd-nbd-2:18.0.0-4757.g3fc0089c.el8.x86_64 28/160 2023-07-14T11:07:26.699 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-4757.g3fc0089c. 29/160 2023-07-14T11:07:26.708 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-4757.g3fc0089c.el8.noa 30/160 2023-07-14T11:07:26.708 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-4757.g3fc0089c.el8.n 31/160 2023-07-14T11:07:26.708 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-4757.g3fc 32/160 2023-07-14T11:07:26.708 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-4757.g3fc0089c.el 33/160 2023-07-14T11:07:26.708 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-rook-2:18.0.0-4757.g3fc0089c.el8.noarch 34/160 2023-07-14T11:07:26.708 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-4757.g3fc0089c.e 35/160 2023-07-14T11:07:26.709 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-volume-2:18.0.0-4757.g3fc0089c.el8.noarch 36/160 2023-07-14T11:07:26.709 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : cephadm-2:18.0.0-4757.g3fc0089c.el8.noarch 37/160 2023-07-14T11:07:26.709 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : cephfs-top-2:18.0.0-4757.g3fc0089c.el8.noarch 38/160 2023-07-14T11:07:26.709 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : automake-1.16.1-7.el8.noarch 39/160 2023-07-14T11:07:26.709 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : bison-3.0.4-10.el8.x86_64 40/160 2023-07-14T11:07:26.709 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : flex-2.6.1-9.el8.x86_64 41/160 2023-07-14T11:07:26.709 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : jq-1.6-7.el8.x86_64 42/160 2023-07-14T11:07:26.709 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libpq-13.5-1.el8.x86_64 43/160 2023-07-14T11:07:26.710 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 44/160 2023-07-14T11:07:26.710 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 45/160 2023-07-14T11:07:26.710 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 46/160 2023-07-14T11:07:26.710 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 47/160 2023-07-14T11:07:26.710 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 48/160 2023-07-14T11:07:26.710 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 49/160 2023-07-14T11:07:26.710 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 50/160 2023-07-14T11:07:26.710 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : postgresql-contrib-10.23-1.module_el8+300+2c5300 51/160 2023-07-14T11:07:26.711 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : postgresql-server-10.23-1.module_el8+300+2c53004 52/160 2023-07-14T11:07:26.711 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 53/160 2023-07-14T11:07:26.711 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 54/160 2023-07-14T11:07:26.711 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 55/160 2023-07-14T11:07:26.711 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 56/160 2023-07-14T11:07:26.711 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 57/160 2023-07-14T11:07:26.711 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 58/160 2023-07-14T11:07:26.712 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 59/160 2023-07-14T11:07:26.712 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 60/160 2023-07-14T11:07:26.712 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 61/160 2023-07-14T11:07:26.712 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/160 2023-07-14T11:07:26.712 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 63/160 2023-07-14T11:07:26.712 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 64/160 2023-07-14T11:07:26.712 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 65/160 2023-07-14T11:07:26.713 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 66/160 2023-07-14T11:07:26.713 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 67/160 2023-07-14T11:07:26.713 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 68/160 2023-07-14T11:07:26.713 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 69/160 2023-07-14T11:07:26.713 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 70/160 2023-07-14T11:07:26.713 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : elfutils-libelf-devel-0.189-2.el8.x86_64 71/160 2023-07-14T11:07:26.713 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 72/160 2023-07-14T11:07:26.713 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 73/160 2023-07-14T11:07:26.714 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 74/160 2023-07-14T11:07:26.714 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 75/160 2023-07-14T11:07:26.714 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 76/160 2023-07-14T11:07:26.714 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 77/160 2023-07-14T11:07:26.714 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 78/160 2023-07-14T11:07:26.714 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 79/160 2023-07-14T11:07:26.714 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 80/160 2023-07-14T11:07:26.715 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 81/160 2023-07-14T11:07:26.715 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libuuid-devel-2.32.1-42.el8.x86_64 82/160 2023-07-14T11:07:26.715 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 83/160 2023-07-14T11:07:26.715 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 84/160 2023-07-14T11:07:26.715 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 85/160 2023-07-14T11:07:26.715 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 86/160 2023-07-14T11:07:26.715 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 87/160 2023-07-14T11:07:26.715 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 88/160 2023-07-14T11:07:26.716 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 89/160 2023-07-14T11:07:26.716 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 90/160 2023-07-14T11:07:26.716 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 91/160 2023-07-14T11:07:26.716 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 92/160 2023-07-14T11:07:26.716 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 93/160 2023-07-14T11:07:26.716 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 94/160 2023-07-14T11:07:26.716 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 95/160 2023-07-14T11:07:26.717 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 96/160 2023-07-14T11:07:26.717 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 97/160 2023-07-14T11:07:26.717 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 98/160 2023-07-14T11:07:26.717 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 99/160 2023-07-14T11:07:26.717 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 100/160 2023-07-14T11:07:26.717 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 101/160 2023-07-14T11:07:26.717 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 102/160 2023-07-14T11:07:26.717 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 103/160 2023-07-14T11:07:26.718 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 104/160 2023-07-14T11:07:26.718 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 105/160 2023-07-14T11:07:26.718 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 106/160 2023-07-14T11:07:26.718 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 107/160 2023-07-14T11:07:26.718 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 108/160 2023-07-14T11:07:26.718 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 109/160 2023-07-14T11:07:26.718 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 110/160 2023-07-14T11:07:26.718 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 111/160 2023-07-14T11:07:26.719 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 112/160 2023-07-14T11:07:26.719 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 113/160 2023-07-14T11:07:26.719 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 114/160 2023-07-14T11:07:26.719 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-portend-2.6-1.el8.noarch 115/160 2023-07-14T11:07:26.719 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 116/160 2023-07-14T11:07:26.719 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 117/160 2023-07-14T11:07:26.719 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 118/160 2023-07-14T11:07:26.719 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 119/160 2023-07-14T11:07:26.720 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 120/160 2023-07-14T11:07:26.720 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 121/160 2023-07-14T11:07:26.720 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 122/160 2023-07-14T11:07:26.720 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 123/160 2023-07-14T11:07:26.720 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 124/160 2023-07-14T11:07:26.720 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 125/160 2023-07-14T11:07:26.720 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 126/160 2023-07-14T11:07:26.721 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 127/160 2023-07-14T11:07:26.721 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 128/160 2023-07-14T11:07:26.721 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librados2-2:18.0.0-4757.g3fc0089c.el8.x86_64 129/160 2023-07-14T11:07:26.721 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/160 2023-07-14T11:07:26.721 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librbd1-2:18.0.0-4757.g3fc0089c.el8.x86_64 131/160 2023-07-14T11:07:26.721 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/160 2023-07-14T11:07:26.721 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-8.el 133/160 2023-07-14T11:07:26.721 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-4.el 134/160 2023-07-14T11:07:26.722 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : elfutils-debuginfod-client-0.189-2.el8.x86_64 135/160 2023-07-14T11:07:26.722 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 136/160 2023-07-14T11:07:26.722 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : elfutils-libelf-0.189-2.el8.x86_64 137/160 2023-07-14T11:07:26.722 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 138/160 2023-07-14T11:07:26.722 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : elfutils-libs-0.189-2.el8.x86_64 139/160 2023-07-14T11:07:26.722 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 140/160 2023-07-14T11:07:26.722 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : iproute-6.2.0-2.el8.x86_64 141/160 2023-07-14T11:07:26.722 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 142/160 2023-07-14T11:07:26.723 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libblkid-2.32.1-42.el8.x86_64 143/160 2023-07-14T11:07:26.723 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 144/160 2023-07-14T11:07:26.723 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libfdisk-2.32.1-42.el8.x86_64 145/160 2023-07-14T11:07:26.723 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 146/160 2023-07-14T11:07:26.723 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libmount-2.32.1-42.el8.x86_64 147/160 2023-07-14T11:07:26.723 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 148/160 2023-07-14T11:07:26.723 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libsmartcols-2.32.1-42.el8.x86_64 149/160 2023-07-14T11:07:26.723 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 150/160 2023-07-14T11:07:26.724 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libuuid-2.32.1-42.el8.x86_64 151/160 2023-07-14T11:07:26.724 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 152/160 2023-07-14T11:07:26.724 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : util-linux-2.32.1-42.el8.x86_64 153/160 2023-07-14T11:07:26.724 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 154/160 2023-07-14T11:07:26.724 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : util-linux-user-2.32.1-42.el8.x86_64 155/160 2023-07-14T11:07:26.724 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 156/160 2023-07-14T11:07:26.724 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : xfsdump-3.1.8-6.el8.x86_64 157/160 2023-07-14T11:07:26.724 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 158/160 2023-07-14T11:07:26.725 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 159/160 2023-07-14T11:07:28.968 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 160/160 2023-07-14T11:07:28.968 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-07-14T11:07:28.968 INFO:teuthology.orchestra.run.smithi179.stdout:Upgraded: 2023-07-14T11:07:28.969 INFO:teuthology.orchestra.run.smithi179.stdout: NetworkManager-initscripts-updown-1:1.40.16-8.el8.noarch 2023-07-14T11:07:28.969 INFO:teuthology.orchestra.run.smithi179.stdout: elfutils-debuginfod-client-0.189-2.el8.x86_64 2023-07-14T11:07:28.969 INFO:teuthology.orchestra.run.smithi179.stdout: elfutils-libelf-0.189-2.el8.x86_64 2023-07-14T11:07:28.969 INFO:teuthology.orchestra.run.smithi179.stdout: elfutils-libs-0.189-2.el8.x86_64 2023-07-14T11:07:28.969 INFO:teuthology.orchestra.run.smithi179.stdout: iproute-6.2.0-2.el8.x86_64 2023-07-14T11:07:28.969 INFO:teuthology.orchestra.run.smithi179.stdout: libblkid-2.32.1-42.el8.x86_64 2023-07-14T11:07:28.969 INFO:teuthology.orchestra.run.smithi179.stdout: libfdisk-2.32.1-42.el8.x86_64 2023-07-14T11:07:28.969 INFO:teuthology.orchestra.run.smithi179.stdout: libmount-2.32.1-42.el8.x86_64 2023-07-14T11:07:28.970 INFO:teuthology.orchestra.run.smithi179.stdout: librados2-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T11:07:28.970 INFO:teuthology.orchestra.run.smithi179.stdout: librbd1-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T11:07:28.970 INFO:teuthology.orchestra.run.smithi179.stdout: libsmartcols-2.32.1-42.el8.x86_64 2023-07-14T11:07:28.970 INFO:teuthology.orchestra.run.smithi179.stdout: libuuid-2.32.1-42.el8.x86_64 2023-07-14T11:07:28.970 INFO:teuthology.orchestra.run.smithi179.stdout: util-linux-2.32.1-42.el8.x86_64 2023-07-14T11:07:28.970 INFO:teuthology.orchestra.run.smithi179.stdout: util-linux-user-2.32.1-42.el8.x86_64 2023-07-14T11:07:28.970 INFO:teuthology.orchestra.run.smithi179.stdout: xfsdump-3.1.8-6.el8.x86_64 2023-07-14T11:07:28.971 INFO:teuthology.orchestra.run.smithi179.stdout: xfsprogs-5.0.0-12.el8.x86_64 2023-07-14T11:07:28.971 INFO:teuthology.orchestra.run.smithi179.stdout:Installed: 2023-07-14T11:07:28.971 INFO:teuthology.orchestra.run.smithi179.stdout: automake-1.16.1-7.el8.noarch 2023-07-14T11:07:28.971 INFO:teuthology.orchestra.run.smithi179.stdout: bison-3.0.4-10.el8.x86_64 2023-07-14T11:07:28.971 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T11:07:28.971 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-base-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T11:07:28.971 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-common-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T11:07:28.971 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-fuse-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T11:07:28.972 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-grafana-dashboards-2:18.0.0-4757.g3fc0089c.el8.noarch 2023-07-14T11:07:28.972 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-immutable-object-cache-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T11:07:28.972 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mds-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T11:07:28.972 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T11:07:28.972 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-cephadm-2:18.0.0-4757.g3fc0089c.el8.noarch 2023-07-14T11:07:28.972 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-dashboard-2:18.0.0-4757.g3fc0089c.el8.noarch 2023-07-14T11:07:28.972 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-diskprediction-local-2:18.0.0-4757.g3fc0089c.el8.noarch 2023-07-14T11:07:28.973 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-modules-core-2:18.0.0-4757.g3fc0089c.el8.noarch 2023-07-14T11:07:28.973 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-rook-2:18.0.0-4757.g3fc0089c.el8.noarch 2023-07-14T11:07:28.973 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mon-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T11:07:28.973 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-osd-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T11:07:28.973 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-prometheus-alerts-2:18.0.0-4757.g3fc0089c.el8.noarch 2023-07-14T11:07:28.973 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-radosgw-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T11:07:28.973 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-selinux-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T11:07:28.974 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-test-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T11:07:28.974 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-volume-2:18.0.0-4757.g3fc0089c.el8.noarch 2023-07-14T11:07:28.974 INFO:teuthology.orchestra.run.smithi179.stdout: cephadm-2:18.0.0-4757.g3fc0089c.el8.noarch 2023-07-14T11:07:28.974 INFO:teuthology.orchestra.run.smithi179.stdout: cephfs-mirror-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T11:07:28.974 INFO:teuthology.orchestra.run.smithi179.stdout: cephfs-top-2:18.0.0-4757.g3fc0089c.el8.noarch 2023-07-14T11:07:28.974 INFO:teuthology.orchestra.run.smithi179.stdout: elfutils-libelf-devel-0.189-2.el8.x86_64 2023-07-14T11:07:28.974 INFO:teuthology.orchestra.run.smithi179.stdout: flex-2.6.1-9.el8.x86_64 2023-07-14T11:07:28.974 INFO:teuthology.orchestra.run.smithi179.stdout: fuse-2.9.7-17.el8.x86_64 2023-07-14T11:07:28.975 INFO:teuthology.orchestra.run.smithi179.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-07-14T11:07:28.975 INFO:teuthology.orchestra.run.smithi179.stdout: jq-1.6-7.el8.x86_64 2023-07-14T11:07:28.975 INFO:teuthology.orchestra.run.smithi179.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-07-14T11:07:28.975 INFO:teuthology.orchestra.run.smithi179.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-07-14T11:07:28.975 INFO:teuthology.orchestra.run.smithi179.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-07-14T11:07:28.975 INFO:teuthology.orchestra.run.smithi179.stdout: libcephfs-devel-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T11:07:28.975 INFO:teuthology.orchestra.run.smithi179.stdout: libcephfs2-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T11:07:28.975 INFO:teuthology.orchestra.run.smithi179.stdout: libcephsqlite-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T11:07:28.976 INFO:teuthology.orchestra.run.smithi179.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-07-14T11:07:28.976 INFO:teuthology.orchestra.run.smithi179.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-07-14T11:07:28.976 INFO:teuthology.orchestra.run.smithi179.stdout: liboath-2.6.2-3.el8.x86_64 2023-07-14T11:07:28.976 INFO:teuthology.orchestra.run.smithi179.stdout: libpq-13.5-1.el8.x86_64 2023-07-14T11:07:28.976 INFO:teuthology.orchestra.run.smithi179.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-07-14T11:07:28.976 INFO:teuthology.orchestra.run.smithi179.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-07-14T11:07:28.976 INFO:teuthology.orchestra.run.smithi179.stdout: librados-devel-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T11:07:28.977 INFO:teuthology.orchestra.run.smithi179.stdout: libradosstriper1-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T11:07:28.977 INFO:teuthology.orchestra.run.smithi179.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-07-14T11:07:28.977 INFO:teuthology.orchestra.run.smithi179.stdout: librgw2-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T11:07:28.977 INFO:teuthology.orchestra.run.smithi179.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-07-14T11:07:28.977 INFO:teuthology.orchestra.run.smithi179.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-07-14T11:07:28.977 INFO:teuthology.orchestra.run.smithi179.stdout: libtool-2.4.6-25.el8.x86_64 2023-07-14T11:07:28.977 INFO:teuthology.orchestra.run.smithi179.stdout: libunwind-1.3.1-3.el8.x86_64 2023-07-14T11:07:28.977 INFO:teuthology.orchestra.run.smithi179.stdout: libuuid-devel-2.32.1-42.el8.x86_64 2023-07-14T11:07:28.978 INFO:teuthology.orchestra.run.smithi179.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-07-14T11:07:28.978 INFO:teuthology.orchestra.run.smithi179.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-07-14T11:07:28.978 INFO:teuthology.orchestra.run.smithi179.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-07-14T11:07:28.978 INFO:teuthology.orchestra.run.smithi179.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-07-14T11:07:28.978 INFO:teuthology.orchestra.run.smithi179.stdout: openblas-0.3.15-4.el8.x86_64 2023-07-14T11:07:28.978 INFO:teuthology.orchestra.run.smithi179.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-07-14T11:07:28.978 INFO:teuthology.orchestra.run.smithi179.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-07-14T11:07:28.979 INFO:teuthology.orchestra.run.smithi179.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-07-14T11:07:28.979 INFO:teuthology.orchestra.run.smithi179.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-07-14T11:07:28.979 INFO:teuthology.orchestra.run.smithi179.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-07-14T11:07:28.979 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-10.23-1.module_el8+300+2c53004c.x86_64 2023-07-14T11:07:28.979 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-contrib-10.23-1.module_el8+300+2c53004c.x86_64 2023-07-14T11:07:28.979 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-server-10.23-1.module_el8+300+2c53004c.x86_64 2023-07-14T11:07:28.979 INFO:teuthology.orchestra.run.smithi179.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-07-14T11:07:28.979 INFO:teuthology.orchestra.run.smithi179.stdout: python3-babel-2.5.1-7.el8.noarch 2023-07-14T11:07:28.980 INFO:teuthology.orchestra.run.smithi179.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-07-14T11:07:28.980 INFO:teuthology.orchestra.run.smithi179.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-07-14T11:07:28.980 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-07-14T11:07:28.980 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ceph-argparse-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T11:07:28.980 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ceph-common-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T11:07:28.980 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cephfs-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T11:07:28.980 INFO:teuthology.orchestra.run.smithi179.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-07-14T11:07:28.981 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-07-14T11:07:28.981 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-07-14T11:07:28.981 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-07-14T11:07:28.981 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-07-14T11:07:28.981 INFO:teuthology.orchestra.run.smithi179.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-07-14T11:07:28.981 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-6.2-6.el8.noarch 2023-07-14T11:07:28.981 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-07-14T11:07:28.981 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-07-14T11:07:28.982 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-07-14T11:07:28.982 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-07-14T11:07:28.982 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-07-14T11:07:28.982 INFO:teuthology.orchestra.run.smithi179.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-07-14T11:07:28.982 INFO:teuthology.orchestra.run.smithi179.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-07-14T11:07:28.982 INFO:teuthology.orchestra.run.smithi179.stdout: python3-mako-1.0.6-14.el8.noarch 2023-07-14T11:07:28.982 INFO:teuthology.orchestra.run.smithi179.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-07-14T11:07:28.982 INFO:teuthology.orchestra.run.smithi179.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-07-14T11:07:28.983 INFO:teuthology.orchestra.run.smithi179.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-07-14T11:07:28.983 INFO:teuthology.orchestra.run.smithi179.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-07-14T11:07:28.983 INFO:teuthology.orchestra.run.smithi179.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-07-14T11:07:28.983 INFO:teuthology.orchestra.run.smithi179.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-07-14T11:07:28.983 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-07-14T11:07:28.983 INFO:teuthology.orchestra.run.smithi179.stdout: python3-portend-2.6-1.el8.noarch 2023-07-14T11:07:28.983 INFO:teuthology.orchestra.run.smithi179.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-07-14T11:07:28.984 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-07-14T11:07:28.984 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-07-14T11:07:28.984 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-07-14T11:07:28.984 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pycparser-2.14-14.el8.noarch 2023-07-14T11:07:28.984 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pytz-2017.2-9.el8.noarch 2023-07-14T11:07:28.984 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rados-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T11:07:28.984 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rbd-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T11:07:28.984 INFO:teuthology.orchestra.run.smithi179.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-07-14T11:07:28.985 INFO:teuthology.orchestra.run.smithi179.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-07-14T11:07:28.985 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rgw-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T11:07:28.985 INFO:teuthology.orchestra.run.smithi179.stdout: python3-routes-2.4.1-12.el8.noarch 2023-07-14T11:07:28.985 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rsa-4.8-1.el8.noarch 2023-07-14T11:07:28.985 INFO:teuthology.orchestra.run.smithi179.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-07-14T11:07:28.985 INFO:teuthology.orchestra.run.smithi179.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-07-14T11:07:28.985 INFO:teuthology.orchestra.run.smithi179.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-07-14T11:07:28.985 INFO:teuthology.orchestra.run.smithi179.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-07-14T11:07:28.986 INFO:teuthology.orchestra.run.smithi179.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-07-14T11:07:28.986 INFO:teuthology.orchestra.run.smithi179.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-07-14T11:07:28.986 INFO:teuthology.orchestra.run.smithi179.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-07-14T11:07:28.986 INFO:teuthology.orchestra.run.smithi179.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-07-14T11:07:28.986 INFO:teuthology.orchestra.run.smithi179.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-07-14T11:07:28.986 INFO:teuthology.orchestra.run.smithi179.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-07-14T11:07:28.986 INFO:teuthology.orchestra.run.smithi179.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-07-14T11:07:28.987 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-fuse-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T11:07:28.987 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-mirror-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T11:07:28.987 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-nbd-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T11:07:28.987 INFO:teuthology.orchestra.run.smithi179.stdout: socat-1.7.4.1-1.el8.x86_64 2023-07-14T11:07:28.987 INFO:teuthology.orchestra.run.smithi179.stdout: thrift-0.13.0-2.el8.x86_64 2023-07-14T11:07:28.987 INFO:teuthology.orchestra.run.smithi179.stdout: uuid-1.6.2-43.el8.x86_64 2023-07-14T11:07:28.987 INFO:teuthology.orchestra.run.smithi179.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2023-07-14T11:07:28.987 INFO:teuthology.orchestra.run.smithi179.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-07-14T11:07:28.988 INFO:teuthology.orchestra.run.smithi179.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-07-14T11:07:28.988 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-07-14T11:07:28.988 INFO:teuthology.orchestra.run.smithi179.stdout:Complete! 2023-07-14T11:07:29.305 DEBUG:teuthology.parallel:result is None 2023-07-14T11:08:09.248 INFO:teuthology.orchestra.run.smithi084.stdout:[MIRROR] gperftools-libs-2.7-9.el8.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/g/gperftools-libs-2.7-9.el8.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-07-14T11:08:09.249 INFO:teuthology.orchestra.run.smithi084.stdout:[MIRROR] liboath-2.6.2-3.el8.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/l/liboath-2.6.2-3.el8.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-07-14T11:08:09.668 INFO:teuthology.orchestra.run.smithi084.stdout:(97/144): liboath-2.6.2-3.el8.x86_64.rpm 446 B/s | 59 kB 02:15 2023-07-14T11:08:09.868 INFO:teuthology.orchestra.run.smithi084.stdout:(98/144): gperftools-libs-2.7-9.el8.x86_64.rpm 2.3 kB/s | 306 kB 02:15 2023-07-14T11:08:58.382 INFO:teuthology.orchestra.run.smithi084.stdout:[MIRROR] libunwind-1.3.1-3.el8.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/l/libunwind-1.3.1-3.el8.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-07-14T11:08:58.767 INFO:teuthology.orchestra.run.smithi084.stdout:(99/144): libunwind-1.3.1-3.el8.x86_64.rpm 561 B/s | 75 kB 02:16 2023-07-14T11:08:58.958 INFO:teuthology.orchestra.run.smithi084.stdout:(100/144): python3-beautifulsoup4-4.6.3-2.el8.1 967 kB/s | 185 kB 00:00 2023-07-14T11:08:59.059 INFO:teuthology.orchestra.run.smithi084.stdout:(101/144): python3-cachetools-3.1.1-4.el8.noarc 330 kB/s | 33 kB 00:00 2023-07-14T11:08:59.197 INFO:teuthology.orchestra.run.smithi084.stdout:(102/144): python3-certifi-2018.10.15-7.el8.noa 118 kB/s | 16 kB 00:00 2023-07-14T11:08:59.309 INFO:teuthology.orchestra.run.smithi084.stdout:(103/144): python3-cheroot-8.5.2-1.el8.noarch.r 1.5 MB/s | 173 kB 00:00 2023-07-14T11:08:59.518 INFO:teuthology.orchestra.run.smithi084.stdout:(104/144): python3-cherrypy-18.4.0-1.el8.noarch 1.8 MB/s | 384 kB 00:00 2023-07-14T11:08:59.635 INFO:teuthology.orchestra.run.smithi084.stdout:(105/144): python3-google-auth-1.1.1-10.el8.noa 696 kB/s | 81 kB 00:00 2023-07-14T11:08:59.743 INFO:teuthology.orchestra.run.smithi084.stdout:(106/144): python3-jaraco-6.2-6.el8.noarch.rpm 103 kB/s | 11 kB 00:00 2023-07-14T11:08:59.852 INFO:teuthology.orchestra.run.smithi084.stdout:(107/144): python3-jaraco-functools-2.0-4.el8.n 162 kB/s | 18 kB 00:00 2023-07-14T11:09:00.244 INFO:teuthology.orchestra.run.smithi084.stdout:(108/144): python3-kubernetes-11.0.0-6.el8.noar 3.0 MB/s | 1.2 MB 00:00 2023-07-14T11:09:00.344 INFO:teuthology.orchestra.run.smithi084.stdout:(109/144): python3-logutils-0.3.5-11.el8.noarch 487 kB/s | 49 kB 00:00 2023-07-14T11:09:00.453 INFO:teuthology.orchestra.run.smithi084.stdout:(110/144): python3-more-itertools-7.2.0-3.el8.n 543 kB/s | 59 kB 00:00 2023-07-14T11:09:00.570 INFO:teuthology.orchestra.run.smithi084.stdout:(111/144): python3-natsort-7.1.1-2.el8.noarch.r 516 kB/s | 60 kB 00:00 2023-07-14T11:09:00.686 INFO:teuthology.orchestra.run.smithi084.stdout:(112/144): python3-pecan-1.3.2-9.el8.noarch.rpm 2.4 MB/s | 283 kB 00:00 2023-07-14T11:09:00.795 INFO:teuthology.orchestra.run.smithi084.stdout:(113/144): python3-portend-2.6-1.el8.noarch.rpm 144 kB/s | 16 kB 00:00 2023-07-14T11:09:00.921 INFO:teuthology.orchestra.run.smithi084.stdout:(114/144): python3-repoze-lru-0.7-6.el8.noarch. 269 kB/s | 34 kB 00:00 2023-07-14T11:09:01.021 INFO:teuthology.orchestra.run.smithi084.stdout:(115/144): python3-routes-2.4.1-12.el8.noarch.r 1.9 MB/s | 196 kB 00:00 2023-07-14T11:09:01.138 INFO:teuthology.orchestra.run.smithi084.stdout:(116/144): python3-rsa-4.8-1.el8.noarch.rpm 528 kB/s | 61 kB 00:00 2023-07-14T11:09:01.254 INFO:teuthology.orchestra.run.smithi084.stdout:(117/144): python3-simplegeneric-0.8.1-17.el8.n 161 kB/s | 19 kB 00:00 2023-07-14T11:09:01.371 INFO:teuthology.orchestra.run.smithi084.stdout:(118/144): python3-singledispatch-3.4.0.3-18.el 205 kB/s | 24 kB 00:00 2023-07-14T11:09:01.480 INFO:teuthology.orchestra.run.smithi084.stdout:(119/144): python3-tempora-1.14.1-5.el8.noarch. 270 kB/s | 29 kB 00:00 2023-07-14T11:09:01.613 INFO:teuthology.orchestra.run.smithi084.stdout:(120/144): python3-trustme-0.6.0-4.el8.noarch.r 207 kB/s | 27 kB 00:00 2023-07-14T11:09:01.730 INFO:teuthology.orchestra.run.smithi084.stdout:(121/144): python3-waitress-1.4.3-1.el8.noarch. 2.1 MB/s | 255 kB 00:00 2023-07-14T11:09:01.906 INFO:teuthology.orchestra.run.smithi084.stdout:(122/144): python3-webob-1.8.5-1.el8.1.noarch.r 1.4 MB/s | 251 kB 00:00 2023-07-14T11:09:02.048 INFO:teuthology.orchestra.run.smithi084.stdout:(123/144): python3-websocket-client-0.56.0-5.el 432 kB/s | 61 kB 00:00 2023-07-14T11:09:02.439 INFO:teuthology.orchestra.run.smithi084.stdout:(124/144): python3-webtest-2.0.33-1.el8.noarch. 218 kB/s | 85 kB 00:00 2023-07-14T11:09:02.581 INFO:teuthology.orchestra.run.smithi084.stdout:(125/144): python3-zc-lockfile-2.0-2.el8.noarch 162 kB/s | 23 kB 00:00 2023-07-14T11:09:10.488 INFO:teuthology.orchestra.run.smithi084.stdout:(126/144): thrift-0.13.0-2.el8.x86_64.rpm 225 kB/s | 1.7 MB 00:07 2023-07-14T11:09:21.370 INFO:teuthology.orchestra.run.smithi084.stdout:(127/144): librados2-18.0.0-4757.g3fc0089c.el8. 345 kB/s | 3.7 MB 00:10 2023-07-14T11:09:24.119 INFO:teuthology.orchestra.run.smithi084.stdout:(128/144): librbd1-18.0.0-4757.g3fc0089c.el8.x8 1.3 MB/s | 3.6 MB 00:02 2023-07-14T11:09:24.470 INFO:teuthology.orchestra.run.smithi084.stdout:(129/144): NetworkManager-initscripts-updown-1. 410 kB/s | 143 kB 00:00 2023-07-14T11:09:24.553 INFO:teuthology.orchestra.run.smithi084.stdout:(130/144): elfutils-debuginfod-client-0.189-2.e 910 kB/s | 76 kB 00:00 2023-07-14T11:09:24.737 INFO:teuthology.orchestra.run.smithi084.stdout:(131/144): elfutils-libelf-0.189-2.el8.x86_64.r 1.2 MB/s | 232 kB 00:00 2023-07-14T11:09:24.948 INFO:teuthology.orchestra.run.smithi084.stdout:(132/144): elfutils-libs-0.189-2.el8.x86_64.rpm 1.4 MB/s | 302 kB 00:00 2023-07-14T11:09:25.337 INFO:teuthology.orchestra.run.smithi084.stdout:(133/144): iproute-6.2.0-2.el8.x86_64.rpm 2.2 MB/s | 880 kB 00:00 2023-07-14T11:09:25.438 INFO:teuthology.orchestra.run.smithi084.stdout:(134/144): libblkid-2.32.1-42.el8.x86_64.rpm 2.2 MB/s | 220 kB 00:00 2023-07-14T11:09:25.546 INFO:teuthology.orchestra.run.smithi084.stdout:(135/144): libfdisk-2.32.1-42.el8.x86_64.rpm 2.3 MB/s | 253 kB 00:00 2023-07-14T11:09:25.646 INFO:teuthology.orchestra.run.smithi084.stdout:(136/144): libmount-2.32.1-42.el8.x86_64.rpm 2.3 MB/s | 236 kB 00:00 2023-07-14T11:09:25.722 INFO:teuthology.orchestra.run.smithi084.stdout:(137/144): libsmartcols-2.32.1-42.el8.x86_64.rp 2.3 MB/s | 179 kB 00:00 2023-07-14T11:09:25.788 INFO:teuthology.orchestra.run.smithi084.stdout:(138/144): libuuid-2.32.1-42.el8.x86_64.rpm 1.4 MB/s | 98 kB 00:00 2023-07-14T11:09:26.372 INFO:teuthology.orchestra.run.smithi084.stdout:(139/144): util-linux-2.32.1-42.el8.x86_64.rpm 4.4 MB/s | 2.6 MB 00:00 2023-07-14T11:09:26.439 INFO:teuthology.orchestra.run.smithi084.stdout:(140/144): util-linux-user-2.32.1-42.el8.x86_64 1.5 MB/s | 102 kB 00:00 2023-07-14T11:09:26.547 INFO:teuthology.orchestra.run.smithi084.stdout:(141/144): xfsdump-3.1.8-6.el8.x86_64.rpm 3.0 MB/s | 334 kB 00:00 2023-07-14T11:09:26.748 INFO:teuthology.orchestra.run.smithi084.stdout:(142/144): xfsprogs-5.0.0-12.el8.x86_64.rpm 5.4 MB/s | 1.1 MB 00:00 2023-07-14T11:10:24.398 INFO:teuthology.orchestra.run.smithi084.stdout:[MIRROR] python3-asyncssh-2.7.0-2.el8.noarch.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/p/python3-asyncssh-2.7.0-2.el8.noarch.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-07-14T11:10:24.399 INFO:teuthology.orchestra.run.smithi084.stdout:[MIRROR] python3-bcrypt-3.1.6-2.el8.1.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/p/python3-bcrypt-3.1.6-2.el8.1.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-07-14T11:10:24.811 INFO:teuthology.orchestra.run.smithi084.stdout:(143/144): python3-bcrypt-3.1.6-2.el8.1.x86_64. 331 B/s | 44 kB 02:14 2023-07-14T11:10:25.268 INFO:teuthology.orchestra.run.smithi084.stdout:(144/144): python3-asyncssh-2.7.0-2.el8.noarch. 3.5 kB/s | 476 kB 02:15 2023-07-14T11:10:25.271 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2023-07-14T11:10:25.271 INFO:teuthology.orchestra.run.smithi084.stdout:Total 606 kB/s | 212 MB 05:58 2023-07-14T11:10:27.088 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2023-07-14T11:10:27.501 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2023-07-14T11:10:27.501 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2023-07-14T11:10:29.006 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2023-07-14T11:10:29.013 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2023-07-14T11:10:34.549 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2023-07-14T11:10:34.771 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: thrift-0.13.0-2.el8.x86_64 1/1 2023-07-14T11:10:34.979 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/160 2023-07-14T11:10:35.125 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : libuuid-2.32.1-42.el8.x86_64 2/160 2023-07-14T11:10:35.239 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libuuid-2.32.1-42.el8.x86_64 2/160 2023-07-14T11:10:35.391 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : libblkid-2.32.1-42.el8.x86_64 3/160 2023-07-14T11:10:35.511 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libblkid-2.32.1-42.el8.x86_64 3/160 2023-07-14T11:10:35.713 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : liboath-2.6.2-3.el8.x86_64 4/160 2023-07-14T11:10:35.921 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : elfutils-libelf-0.189-2.el8.x86_64 5/160 2023-07-14T11:10:36.168 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 6/160 2023-07-14T11:10:36.332 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/160 2023-07-14T11:10:36.786 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/160 2023-07-14T11:10:36.974 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : librados2-2:18.0.0-4757.g3fc0089c.el8.x86_64 8/160 2023-07-14T11:10:37.423 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librados2-2:18.0.0-4757.g3fc0089c.el8.x86_64 8/160 2023-07-14T11:10:37.616 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : librbd1-2:18.0.0-4757.g3fc0089c.el8.x86_64 9/160 2023-07-14T11:10:37.768 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librbd1-2:18.0.0-4757.g3fc0089c.el8.x86_64 9/160 2023-07-14T11:10:37.932 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libcephfs2-2:18.0.0-4757.g3fc0089c.el8.x86_64 10/160 2023-07-14T11:10:38.044 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libcephfs2-2:18.0.0-4757.g3fc0089c.el8.x86_64 10/160 2023-07-14T11:10:38.275 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rados-2:18.0.0-4757.g3fc0089c.el8.x86_64 11/160 2023-07-14T11:10:38.415 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 12/160 2023-07-14T11:10:38.638 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 12/160 2023-07-14T11:10:38.848 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 13/160 2023-07-14T11:10:38.925 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 13/160 2023-07-14T11:10:39.124 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/160 2023-07-14T11:10:39.324 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/160 2023-07-14T11:10:39.769 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libpq-13.5-1.el8.x86_64 16/160 2023-07-14T11:10:39.945 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 17/160 2023-07-14T11:10:40.098 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libcephsqlite-2:18.0.0-4757.g3fc0089c.el8.x86_64 18/160 2023-07-14T11:10:40.254 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libcephsqlite-2:18.0.0-4757.g3fc0089c.el8.x86_64 18/160 2023-07-14T11:10:40.398 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libradosstriper1-2:18.0.0-4757.g3fc0089c.el8.x86 19/160 2023-07-14T11:10:40.544 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libradosstriper1-2:18.0.0-4757.g3fc0089c.el8.x86 19/160 2023-07-14T11:10:40.762 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 20/160 2023-07-14T11:10:40.964 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 21/160 2023-07-14T11:10:41.081 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 22/160 2023-07-14T11:10:41.243 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 22/160 2023-07-14T11:10:41.390 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 23/160 2023-07-14T11:10:42.054 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 23/160 2023-07-14T11:10:42.265 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : openblas-0.3.15-4.el8.x86_64 24/160 2023-07-14T11:10:42.965 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 24/160 2023-07-14T11:10:43.148 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 25/160 2023-07-14T11:10:43.973 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 25/160 2023-07-14T11:10:44.314 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 26/160 2023-07-14T11:10:44.523 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 27/160 2023-07-14T11:10:44.680 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 28/160 2023-07-14T11:10:44.866 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 29/160 2023-07-14T11:10:45.130 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-ceph-common-2:18.0.0-4757.g3fc0089c.el8. 30/160 2023-07-14T11:10:45.279 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-ceph-argparse-2:18.0.0-4757.g3fc0089c.el 31/160 2023-07-14T11:10:45.496 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cephfs-2:18.0.0-4757.g3fc0089c.el8.x86_6 32/160 2023-07-14T11:10:46.588 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 33/160 2023-07-14T11:10:46.927 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 34/160 2023-07-14T11:10:47.258 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 35/160 2023-07-14T11:10:47.463 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 36/160 2023-07-14T11:10:49.541 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 36/160 2023-07-14T11:10:49.868 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 37/160 2023-07-14T11:10:50.054 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 38/160 2023-07-14T11:10:50.251 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rsa-4.8-1.el8.noarch 39/160 2023-07-14T11:10:50.470 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rbd-2:18.0.0-4757.g3fc0089c.el8.x86_64 40/160 2023-07-14T11:10:50.640 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librados-devel-2:18.0.0-4757.g3fc0089c.el8.x86_6 41/160 2023-07-14T11:10:50.831 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : elfutils-libs-0.189-2.el8.x86_64 42/160 2023-07-14T11:10:51.043 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : elfutils-debuginfod-client-0.189-2.el8.x86_64 43/160 2023-07-14T11:10:51.254 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : libfdisk-2.32.1-42.el8.x86_64 44/160 2023-07-14T11:10:51.350 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libfdisk-2.32.1-42.el8.x86_64 44/160 2023-07-14T11:10:51.554 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : libmount-2.32.1-42.el8.x86_64 45/160 2023-07-14T11:10:51.643 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libmount-2.32.1-42.el8.x86_64 45/160 2023-07-14T11:10:51.826 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libuuid-devel-2.32.1-42.el8.x86_64 46/160 2023-07-14T11:10:52.021 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : libsmartcols-2.32.1-42.el8.x86_64 47/160 2023-07-14T11:10:52.607 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libsmartcols-2.32.1-42.el8.x86_64 47/160 2023-07-14T11:10:52.880 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : util-linux-2.32.1-42.el8.x86_64 48/160 2023-07-14T11:10:52.908 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: util-linux-2.32.1-42.el8.x86_64 48/160 2023-07-14T11:10:53.153 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 49/160 2023-07-14T11:10:53.428 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 50/160 2023-07-14T11:10:53.629 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 51/160 2023-07-14T11:10:53.767 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/160 2023-07-14T11:10:53.950 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/160 2023-07-14T11:10:54.142 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/160 2023-07-14T11:10:54.344 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/160 2023-07-14T11:10:54.559 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 56/160 2023-07-14T11:10:55.066 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 57/160 2023-07-14T11:10:55.294 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 58/160 2023-07-14T11:10:55.469 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 59/160 2023-07-14T11:10:55.653 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 60/160 2023-07-14T11:10:55.806 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-portend-2.6-1.el8.noarch 61/160 2023-07-14T11:10:56.024 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 62/160 2023-07-14T11:10:56.274 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 63/160 2023-07-14T11:10:56.509 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 64/160 2023-07-14T11:10:56.769 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 65/160 2023-07-14T11:10:57.108 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 66/160 2023-07-14T11:10:57.355 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 67/160 2023-07-14T11:10:57.546 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 68/160 2023-07-14T11:10:58.342 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 69/160 2023-07-14T11:10:58.569 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librgw2-2:18.0.0-4757.g3fc0089c.el8.x86_64 70/160 2023-07-14T11:10:58.661 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librgw2-2:18.0.0-4757.g3fc0089c.el8.x86_64 70/160 2023-07-14T11:10:58.896 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rgw-2:18.0.0-4757.g3fc0089c.el8.x86_64 71/160 2023-07-14T11:10:59.131 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 72/160 2023-07-14T11:10:59.533 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 73/160 2023-07-14T11:10:59.843 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 74/160 2023-07-14T11:11:00.025 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 75/160 2023-07-14T11:11:00.305 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 76/160 2023-07-14T11:11:00.504 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 77/160 2023-07-14T11:11:01.761 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/160 2023-07-14T11:11:02.136 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/160 2023-07-14T11:11:02.411 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 80/160 2023-07-14T11:11:02.637 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 81/160 2023-07-14T11:11:02.916 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 82/160 2023-07-14T11:11:03.169 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 83/160 2023-07-14T11:11:03.373 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 84/160 2023-07-14T11:11:03.606 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 85/160 2023-07-14T11:11:03.933 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 86/160 2023-07-14T11:11:04.174 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 87/160 2023-07-14T11:11:04.379 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 88/160 2023-07-14T11:11:04.572 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 89/160 2023-07-14T11:11:04.939 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 90/160 2023-07-14T11:11:05.240 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 91/160 2023-07-14T11:11:05.401 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 92/160 2023-07-14T11:11:05.585 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 93/160 2023-07-14T11:11:05.820 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 94/160 2023-07-14T11:11:06.046 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : fuse-2.9.7-17.el8.x86_64 95/160 2023-07-14T11:11:06.288 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 96/160 2023-07-14T11:11:06.451 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : uuid-1.6.2-43.el8.x86_64 97/160 2023-07-14T11:11:06.562 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 97/160 2023-07-14T11:11:06.753 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 98/160 2023-07-14T11:11:06.893 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 99/160 2023-07-14T11:11:09.731 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-common-2:18.0.0-4757.g3fc0089c.el8.x86_64 100/160 2023-07-14T11:11:10.192 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-common-2:18.0.0-4757.g3fc0089c.el8.x86_64 100/160 2023-07-14T11:11:10.885 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-common-2:18.0.0-4757.g3fc0089c.el8.x86_64 100/160 2023-07-14T11:11:11.211 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-base-2:18.0.0-4757.g3fc0089c.el8.x86_64 101/160 2023-07-14T11:11:11.407 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-base-2:18.0.0-4757.g3fc0089c.el8.x86_64 101/160 2023-07-14T11:11:11.624 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-selinux-2:18.0.0-4757.g3fc0089c.el8.x86_64 102/160 2023-07-14T11:11:31.936 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-selinux-2:18.0.0-4757.g3fc0089c.el8.x86_64 102/160 2023-07-14T11:11:31.936 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /sys 2023-07-14T11:11:31.937 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /proc 2023-07-14T11:11:31.937 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /dev 2023-07-14T11:11:31.937 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /run 2023-07-14T11:11:31.937 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /mnt 2023-07-14T11:11:31.937 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /var/tmp 2023-07-14T11:11:31.937 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /home 2023-07-14T11:11:31.937 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /tmp 2023-07-14T11:11:31.937 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /dev 2023-07-14T11:11:31.938 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:11:32.304 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-volume-2:18.0.0-4757.g3fc0089c.el8.noarch 103/160 2023-07-14T11:11:34.032 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-volume-2:18.0.0-4757.g3fc0089c.el8.noarch 103/160 2023-07-14T11:11:34.256 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-osd-2:18.0.0-4757.g3fc0089c.el8.x86_64 104/160 2023-07-14T11:11:34.523 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-osd-2:18.0.0-4757.g3fc0089c.el8.x86_64 104/160 2023-07-14T11:11:34.703 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mds-2:18.0.0-4757.g3fc0089c.el8.x86_64 105/160 2023-07-14T11:11:35.230 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mds-2:18.0.0-4757.g3fc0089c.el8.x86_64 105/160 2023-07-14T11:11:35.436 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mon-2:18.0.0-4757.g3fc0089c.el8.x86_64 106/160 2023-07-14T11:11:35.486 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mon-2:18.0.0-4757.g3fc0089c.el8.x86_64 106/160 2023-07-14T11:11:35.711 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 107/160 2023-07-14T11:11:35.925 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 108/160 2023-07-14T11:11:36.078 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 109/160 2023-07-14T11:11:36.170 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 109/160 2023-07-14T11:11:36.487 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : jq-1.6-7.el8.x86_64 110/160 2023-07-14T11:11:36.719 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : automake-1.16.1-7.el8.noarch 111/160 2023-07-14T11:11:37.337 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: cephadm-2:18.0.0-4757.g3fc0089c.el8.noarch 112/160 2023-07-14T11:11:37.508 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : cephadm-2:18.0.0-4757.g3fc0089c.el8.noarch 112/160 2023-07-14T11:11:37.653 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-4757.g3fc0089c.e 113/160 2023-07-14T11:11:37.909 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-4757.g3fc0089c. 114/160 2023-07-14T11:11:38.127 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-4757.g3fc0089c.el8.noa 115/160 2023-07-14T11:11:38.386 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-4757.g3fc0089c.el8.noa 115/160 2023-07-14T11:11:38.663 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-4757.g3fc0089c.el8.n 116/160 2023-07-14T11:11:39.777 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-4757.g3fc0089c.el8.n 116/160 2023-07-14T11:11:39.968 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-4757.g3fc 117/160 2023-07-14T11:11:40.095 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-4757.g3fc 117/160 2023-07-14T11:11:40.462 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-4757.g3fc0089c.el 118/160 2023-07-14T11:11:40.671 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-2:18.0.0-4757.g3fc0089c.el8.x86_64 119/160 2023-07-14T11:11:40.736 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-2:18.0.0-4757.g3fc0089c.el8.x86_64 119/160 2023-07-14T11:11:40.901 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-rook-2:18.0.0-4757.g3fc0089c.el8.noarch 120/160 2023-07-14T11:11:40.928 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-4757.g3fc0089c.el8.noarch 120/160 2023-07-14T11:11:41.117 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-2:18.0.0-4757.g3fc0089c.el8.x86_64 121/160 2023-07-14T11:11:41.276 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libtool-2.4.6-25.el8.x86_64 122/160 2023-07-14T11:11:46.249 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 122/160 2023-07-14T11:11:47.817 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-test-2:18.0.0-4757.g3fc0089c.el8.x86_64 123/160 2023-07-14T11:11:48.037 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-radosgw-2:18.0.0-4757.g3fc0089c.el8.x86_64 124/160 2023-07-14T11:11:48.097 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-4757.g3fc0089c.el8.x86_64 124/160 2023-07-14T11:11:48.267 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-4757.g3fc00 125/160 2023-07-14T11:11:48.337 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-4757.g3fc00 125/160 2023-07-14T11:11:48.559 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : cephfs-mirror-2:18.0.0-4757.g3fc0089c.el8.x86_64 126/160 2023-07-14T11:11:48.965 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-4757.g3fc0089c.el8.x86_64 126/160 2023-07-14T11:11:49.208 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : rbd-mirror-2:18.0.0-4757.g3fc0089c.el8.x86_64 127/160 2023-07-14T11:11:49.495 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: rbd-mirror-2:18.0.0-4757.g3fc0089c.el8.x86_64 127/160 2023-07-14T11:11:49.838 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : postgresql-contrib-10.23-1.module_el8+300+2c5300 128/160 2023-07-14T11:11:51.056 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-fuse-2:18.0.0-4757.g3fc0089c.el8.x86_64 129/160 2023-07-14T11:11:51.355 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 130/160 2023-07-14T11:11:51.564 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : elfutils-libelf-devel-0.189-2.el8.x86_64 131/160 2023-07-14T11:11:51.796 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : util-linux-user-2.32.1-42.el8.x86_64 132/160 2023-07-14T11:11:51.954 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 133/160 2023-07-14T11:11:52.167 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libcephfs-devel-2:18.0.0-4757.g3fc0089c.el8.x86_ 134/160 2023-07-14T11:11:53.406 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 135/160 2023-07-14T11:11:53.683 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : postgresql-server-10.23-1.module_el8+300+2c53004 135/160 2023-07-14T11:11:53.770 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 135/160 2023-07-14T11:11:53.987 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : xfsdump-3.1.8-6.el8.x86_64 136/160 2023-07-14T11:11:54.233 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : cephfs-top-2:18.0.0-4757.g3fc0089c.el8.noarch 137/160 2023-07-14T11:11:54.516 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : rbd-fuse-2:18.0.0-4757.g3fc0089c.el8.x86_64 138/160 2023-07-14T11:11:54.866 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : rbd-nbd-2:18.0.0-4757.g3fc0089c.el8.x86_64 139/160 2023-07-14T11:11:55.176 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : iproute-6.2.0-2.el8.x86_64 140/160 2023-07-14T11:11:55.315 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-8.el 141/160 2023-07-14T11:11:55.343 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-8.el 141/160 2023-07-14T11:11:55.541 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 142/160 2023-07-14T11:11:55.840 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : flex-2.6.1-9.el8.x86_64 143/160 2023-07-14T11:11:55.949 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 143/160 2023-07-14T11:11:56.173 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : bison-3.0.4-10.el8.x86_64 144/160 2023-07-14T11:11:56.199 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 144/160 2023-07-14T11:11:56.425 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 145/160 2023-07-14T11:11:56.628 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 146/160 2023-07-14T11:11:56.811 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 147/160 2023-07-14T11:11:56.811 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 148/160 2023-07-14T11:11:57.119 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 148/160 2023-07-14T11:11:57.119 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 149/160 2023-07-14T11:11:57.351 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 149/160 2023-07-14T11:11:57.367 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-4.el 150/160 2023-07-14T11:11:57.488 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.16-4.el 150/160 2023-07-14T11:11:57.488 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 151/160 2023-07-14T11:11:57.781 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 151/160 2023-07-14T11:11:57.959 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 152/160 2023-07-14T11:11:58.113 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 153/160 2023-07-14T11:11:58.350 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 154/160 2023-07-14T11:11:58.350 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 155/160 2023-07-14T11:11:58.609 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 155/160 2023-07-14T11:11:58.609 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 156/160 2023-07-14T11:11:58.826 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 156/160 2023-07-14T11:11:58.826 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 157/160 2023-07-14T11:11:59.042 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 157/160 2023-07-14T11:11:59.043 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 158/160 2023-07-14T11:11:59.292 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 158/160 2023-07-14T11:11:59.292 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 159/160 2023-07-14T11:11:59.501 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 159/160 2023-07-14T11:11:59.682 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 160/160 2023-07-14T11:11:59.895 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 160/160 2023-07-14T11:11:59.896 INFO:teuthology.orchestra.run.smithi084.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-07-14T11:11:59.896 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:12:00.614 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-2:18.0.0-4757.g3fc0089c.el8.x86_64 1/160 2023-07-14T11:12:00.614 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-base-2:18.0.0-4757.g3fc0089c.el8.x86_64 2/160 2023-07-14T11:12:00.614 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-common-2:18.0.0-4757.g3fc0089c.el8.x86_64 3/160 2023-07-14T11:12:00.614 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-fuse-2:18.0.0-4757.g3fc0089c.el8.x86_64 4/160 2023-07-14T11:12:00.614 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-4757.g3fc00 5/160 2023-07-14T11:12:00.614 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mds-2:18.0.0-4757.g3fc0089c.el8.x86_64 6/160 2023-07-14T11:12:00.615 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-2:18.0.0-4757.g3fc0089c.el8.x86_64 7/160 2023-07-14T11:12:00.615 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mon-2:18.0.0-4757.g3fc0089c.el8.x86_64 8/160 2023-07-14T11:12:00.615 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-osd-2:18.0.0-4757.g3fc0089c.el8.x86_64 9/160 2023-07-14T11:12:00.615 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-radosgw-2:18.0.0-4757.g3fc0089c.el8.x86_64 10/160 2023-07-14T11:12:00.615 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-selinux-2:18.0.0-4757.g3fc0089c.el8.x86_64 11/160 2023-07-14T11:12:00.615 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-test-2:18.0.0-4757.g3fc0089c.el8.x86_64 12/160 2023-07-14T11:12:00.615 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : cephfs-mirror-2:18.0.0-4757.g3fc0089c.el8.x86_64 13/160 2023-07-14T11:12:00.616 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libcephfs-devel-2:18.0.0-4757.g3fc0089c.el8.x86_ 14/160 2023-07-14T11:12:00.616 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libcephfs2-2:18.0.0-4757.g3fc0089c.el8.x86_64 15/160 2023-07-14T11:12:00.617 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libcephsqlite-2:18.0.0-4757.g3fc0089c.el8.x86_64 16/160 2023-07-14T11:12:00.617 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librados-devel-2:18.0.0-4757.g3fc0089c.el8.x86_6 17/160 2023-07-14T11:12:00.617 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libradosstriper1-2:18.0.0-4757.g3fc0089c.el8.x86 18/160 2023-07-14T11:12:00.618 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librgw2-2:18.0.0-4757.g3fc0089c.el8.x86_64 19/160 2023-07-14T11:12:00.618 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-ceph-argparse-2:18.0.0-4757.g3fc0089c.el 20/160 2023-07-14T11:12:00.618 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-ceph-common-2:18.0.0-4757.g3fc0089c.el8. 21/160 2023-07-14T11:12:00.618 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cephfs-2:18.0.0-4757.g3fc0089c.el8.x86_6 22/160 2023-07-14T11:12:00.618 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rados-2:18.0.0-4757.g3fc0089c.el8.x86_64 23/160 2023-07-14T11:12:00.618 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rbd-2:18.0.0-4757.g3fc0089c.el8.x86_64 24/160 2023-07-14T11:12:00.618 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rgw-2:18.0.0-4757.g3fc0089c.el8.x86_64 25/160 2023-07-14T11:12:00.619 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : rbd-fuse-2:18.0.0-4757.g3fc0089c.el8.x86_64 26/160 2023-07-14T11:12:00.619 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : rbd-mirror-2:18.0.0-4757.g3fc0089c.el8.x86_64 27/160 2023-07-14T11:12:00.627 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : rbd-nbd-2:18.0.0-4757.g3fc0089c.el8.x86_64 28/160 2023-07-14T11:12:00.628 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-4757.g3fc0089c. 29/160 2023-07-14T11:12:00.628 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-4757.g3fc0089c.el8.noa 30/160 2023-07-14T11:12:00.628 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-4757.g3fc0089c.el8.n 31/160 2023-07-14T11:12:00.629 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-4757.g3fc 32/160 2023-07-14T11:12:00.629 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-4757.g3fc0089c.el 33/160 2023-07-14T11:12:00.629 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-rook-2:18.0.0-4757.g3fc0089c.el8.noarch 34/160 2023-07-14T11:12:00.629 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-4757.g3fc0089c.e 35/160 2023-07-14T11:12:00.629 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-volume-2:18.0.0-4757.g3fc0089c.el8.noarch 36/160 2023-07-14T11:12:00.629 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : cephadm-2:18.0.0-4757.g3fc0089c.el8.noarch 37/160 2023-07-14T11:12:00.629 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : cephfs-top-2:18.0.0-4757.g3fc0089c.el8.noarch 38/160 2023-07-14T11:12:00.630 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : automake-1.16.1-7.el8.noarch 39/160 2023-07-14T11:12:00.630 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : bison-3.0.4-10.el8.x86_64 40/160 2023-07-14T11:12:00.630 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : flex-2.6.1-9.el8.x86_64 41/160 2023-07-14T11:12:00.630 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : jq-1.6-7.el8.x86_64 42/160 2023-07-14T11:12:00.630 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libpq-13.5-1.el8.x86_64 43/160 2023-07-14T11:12:00.630 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 44/160 2023-07-14T11:12:00.630 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 45/160 2023-07-14T11:12:00.630 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 46/160 2023-07-14T11:12:00.631 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 47/160 2023-07-14T11:12:00.631 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 48/160 2023-07-14T11:12:00.631 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 49/160 2023-07-14T11:12:00.631 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 50/160 2023-07-14T11:12:00.631 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : postgresql-contrib-10.23-1.module_el8+300+2c5300 51/160 2023-07-14T11:12:00.631 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : postgresql-server-10.23-1.module_el8+300+2c53004 52/160 2023-07-14T11:12:00.631 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 53/160 2023-07-14T11:12:00.632 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 54/160 2023-07-14T11:12:00.632 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 55/160 2023-07-14T11:12:00.632 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 56/160 2023-07-14T11:12:00.632 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 57/160 2023-07-14T11:12:00.632 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 58/160 2023-07-14T11:12:00.632 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 59/160 2023-07-14T11:12:00.633 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 60/160 2023-07-14T11:12:00.633 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 61/160 2023-07-14T11:12:00.633 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/160 2023-07-14T11:12:00.633 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 63/160 2023-07-14T11:12:00.633 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 64/160 2023-07-14T11:12:00.633 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 65/160 2023-07-14T11:12:00.633 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 66/160 2023-07-14T11:12:00.633 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 67/160 2023-07-14T11:12:00.634 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 68/160 2023-07-14T11:12:00.634 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 69/160 2023-07-14T11:12:00.634 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 70/160 2023-07-14T11:12:00.634 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : elfutils-libelf-devel-0.189-2.el8.x86_64 71/160 2023-07-14T11:12:00.634 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 72/160 2023-07-14T11:12:00.634 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 73/160 2023-07-14T11:12:00.634 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 74/160 2023-07-14T11:12:00.635 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 75/160 2023-07-14T11:12:00.635 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 76/160 2023-07-14T11:12:00.635 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 77/160 2023-07-14T11:12:00.635 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 78/160 2023-07-14T11:12:00.635 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 79/160 2023-07-14T11:12:00.635 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 80/160 2023-07-14T11:12:00.635 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 81/160 2023-07-14T11:12:00.636 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libuuid-devel-2.32.1-42.el8.x86_64 82/160 2023-07-14T11:12:00.636 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 83/160 2023-07-14T11:12:00.636 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 84/160 2023-07-14T11:12:00.636 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 85/160 2023-07-14T11:12:00.636 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 86/160 2023-07-14T11:12:00.636 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 87/160 2023-07-14T11:12:00.636 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 88/160 2023-07-14T11:12:00.636 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 89/160 2023-07-14T11:12:00.637 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 90/160 2023-07-14T11:12:00.637 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 91/160 2023-07-14T11:12:00.637 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 92/160 2023-07-14T11:12:00.637 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 93/160 2023-07-14T11:12:00.637 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 94/160 2023-07-14T11:12:00.637 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 95/160 2023-07-14T11:12:00.637 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 96/160 2023-07-14T11:12:00.638 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 97/160 2023-07-14T11:12:00.638 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 98/160 2023-07-14T11:12:00.638 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 99/160 2023-07-14T11:12:00.638 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 100/160 2023-07-14T11:12:00.638 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 101/160 2023-07-14T11:12:00.638 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 102/160 2023-07-14T11:12:00.638 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 103/160 2023-07-14T11:12:00.638 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 104/160 2023-07-14T11:12:00.639 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 105/160 2023-07-14T11:12:00.639 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 106/160 2023-07-14T11:12:00.639 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 107/160 2023-07-14T11:12:00.639 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 108/160 2023-07-14T11:12:00.639 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 109/160 2023-07-14T11:12:00.639 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 110/160 2023-07-14T11:12:00.639 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 111/160 2023-07-14T11:12:00.640 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 112/160 2023-07-14T11:12:00.640 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 113/160 2023-07-14T11:12:00.640 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 114/160 2023-07-14T11:12:00.640 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-portend-2.6-1.el8.noarch 115/160 2023-07-14T11:12:00.640 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 116/160 2023-07-14T11:12:00.640 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 117/160 2023-07-14T11:12:00.641 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 118/160 2023-07-14T11:12:00.641 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 119/160 2023-07-14T11:12:00.641 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 120/160 2023-07-14T11:12:00.641 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 121/160 2023-07-14T11:12:00.641 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 122/160 2023-07-14T11:12:00.641 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 123/160 2023-07-14T11:12:00.642 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 124/160 2023-07-14T11:12:00.642 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 125/160 2023-07-14T11:12:00.642 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 126/160 2023-07-14T11:12:00.642 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 127/160 2023-07-14T11:12:00.642 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 128/160 2023-07-14T11:12:00.643 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librados2-2:18.0.0-4757.g3fc0089c.el8.x86_64 129/160 2023-07-14T11:12:00.643 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/160 2023-07-14T11:12:00.643 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librbd1-2:18.0.0-4757.g3fc0089c.el8.x86_64 131/160 2023-07-14T11:12:00.643 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/160 2023-07-14T11:12:00.643 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-8.el 133/160 2023-07-14T11:12:00.643 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-4.el 134/160 2023-07-14T11:12:00.643 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : elfutils-debuginfod-client-0.189-2.el8.x86_64 135/160 2023-07-14T11:12:00.644 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 136/160 2023-07-14T11:12:00.644 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : elfutils-libelf-0.189-2.el8.x86_64 137/160 2023-07-14T11:12:00.644 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 138/160 2023-07-14T11:12:00.644 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : elfutils-libs-0.189-2.el8.x86_64 139/160 2023-07-14T11:12:00.644 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 140/160 2023-07-14T11:12:00.644 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : iproute-6.2.0-2.el8.x86_64 141/160 2023-07-14T11:12:00.644 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 142/160 2023-07-14T11:12:00.645 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libblkid-2.32.1-42.el8.x86_64 143/160 2023-07-14T11:12:00.645 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 144/160 2023-07-14T11:12:00.645 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libfdisk-2.32.1-42.el8.x86_64 145/160 2023-07-14T11:12:00.645 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 146/160 2023-07-14T11:12:00.645 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libmount-2.32.1-42.el8.x86_64 147/160 2023-07-14T11:12:00.645 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 148/160 2023-07-14T11:12:00.645 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libsmartcols-2.32.1-42.el8.x86_64 149/160 2023-07-14T11:12:00.645 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 150/160 2023-07-14T11:12:00.646 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libuuid-2.32.1-42.el8.x86_64 151/160 2023-07-14T11:12:00.646 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 152/160 2023-07-14T11:12:00.646 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : util-linux-2.32.1-42.el8.x86_64 153/160 2023-07-14T11:12:00.646 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 154/160 2023-07-14T11:12:00.646 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : util-linux-user-2.32.1-42.el8.x86_64 155/160 2023-07-14T11:12:00.646 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 156/160 2023-07-14T11:12:00.646 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : xfsdump-3.1.8-6.el8.x86_64 157/160 2023-07-14T11:12:00.646 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 158/160 2023-07-14T11:12:00.647 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 159/160 2023-07-14T11:12:02.824 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 160/160 2023-07-14T11:12:02.824 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:12:02.824 INFO:teuthology.orchestra.run.smithi084.stdout:Upgraded: 2023-07-14T11:12:02.825 INFO:teuthology.orchestra.run.smithi084.stdout: NetworkManager-initscripts-updown-1:1.40.16-8.el8.noarch 2023-07-14T11:12:02.825 INFO:teuthology.orchestra.run.smithi084.stdout: elfutils-debuginfod-client-0.189-2.el8.x86_64 2023-07-14T11:12:02.825 INFO:teuthology.orchestra.run.smithi084.stdout: elfutils-libelf-0.189-2.el8.x86_64 2023-07-14T11:12:02.825 INFO:teuthology.orchestra.run.smithi084.stdout: elfutils-libs-0.189-2.el8.x86_64 2023-07-14T11:12:02.825 INFO:teuthology.orchestra.run.smithi084.stdout: iproute-6.2.0-2.el8.x86_64 2023-07-14T11:12:02.825 INFO:teuthology.orchestra.run.smithi084.stdout: libblkid-2.32.1-42.el8.x86_64 2023-07-14T11:12:02.825 INFO:teuthology.orchestra.run.smithi084.stdout: libfdisk-2.32.1-42.el8.x86_64 2023-07-14T11:12:02.825 INFO:teuthology.orchestra.run.smithi084.stdout: libmount-2.32.1-42.el8.x86_64 2023-07-14T11:12:02.826 INFO:teuthology.orchestra.run.smithi084.stdout: librados2-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T11:12:02.826 INFO:teuthology.orchestra.run.smithi084.stdout: librbd1-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T11:12:02.826 INFO:teuthology.orchestra.run.smithi084.stdout: libsmartcols-2.32.1-42.el8.x86_64 2023-07-14T11:12:02.826 INFO:teuthology.orchestra.run.smithi084.stdout: libuuid-2.32.1-42.el8.x86_64 2023-07-14T11:12:02.826 INFO:teuthology.orchestra.run.smithi084.stdout: util-linux-2.32.1-42.el8.x86_64 2023-07-14T11:12:02.826 INFO:teuthology.orchestra.run.smithi084.stdout: util-linux-user-2.32.1-42.el8.x86_64 2023-07-14T11:12:02.826 INFO:teuthology.orchestra.run.smithi084.stdout: xfsdump-3.1.8-6.el8.x86_64 2023-07-14T11:12:02.827 INFO:teuthology.orchestra.run.smithi084.stdout: xfsprogs-5.0.0-12.el8.x86_64 2023-07-14T11:12:02.827 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2023-07-14T11:12:02.827 INFO:teuthology.orchestra.run.smithi084.stdout: automake-1.16.1-7.el8.noarch 2023-07-14T11:12:02.827 INFO:teuthology.orchestra.run.smithi084.stdout: bison-3.0.4-10.el8.x86_64 2023-07-14T11:12:02.827 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T11:12:02.827 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-base-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T11:12:02.827 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-common-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T11:12:02.827 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-fuse-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T11:12:02.828 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-grafana-dashboards-2:18.0.0-4757.g3fc0089c.el8.noarch 2023-07-14T11:12:02.828 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-immutable-object-cache-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T11:12:02.828 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mds-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T11:12:02.828 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T11:12:02.828 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-cephadm-2:18.0.0-4757.g3fc0089c.el8.noarch 2023-07-14T11:12:02.828 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-dashboard-2:18.0.0-4757.g3fc0089c.el8.noarch 2023-07-14T11:12:02.828 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-diskprediction-local-2:18.0.0-4757.g3fc0089c.el8.noarch 2023-07-14T11:12:02.829 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-modules-core-2:18.0.0-4757.g3fc0089c.el8.noarch 2023-07-14T11:12:02.829 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-rook-2:18.0.0-4757.g3fc0089c.el8.noarch 2023-07-14T11:12:02.829 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mon-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T11:12:02.829 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-osd-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T11:12:02.829 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-prometheus-alerts-2:18.0.0-4757.g3fc0089c.el8.noarch 2023-07-14T11:12:02.829 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-radosgw-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T11:12:02.829 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-selinux-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T11:12:02.830 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-test-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T11:12:02.830 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-volume-2:18.0.0-4757.g3fc0089c.el8.noarch 2023-07-14T11:12:02.830 INFO:teuthology.orchestra.run.smithi084.stdout: cephadm-2:18.0.0-4757.g3fc0089c.el8.noarch 2023-07-14T11:12:02.830 INFO:teuthology.orchestra.run.smithi084.stdout: cephfs-mirror-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T11:12:02.830 INFO:teuthology.orchestra.run.smithi084.stdout: cephfs-top-2:18.0.0-4757.g3fc0089c.el8.noarch 2023-07-14T11:12:02.830 INFO:teuthology.orchestra.run.smithi084.stdout: elfutils-libelf-devel-0.189-2.el8.x86_64 2023-07-14T11:12:02.830 INFO:teuthology.orchestra.run.smithi084.stdout: flex-2.6.1-9.el8.x86_64 2023-07-14T11:12:02.831 INFO:teuthology.orchestra.run.smithi084.stdout: fuse-2.9.7-17.el8.x86_64 2023-07-14T11:12:02.831 INFO:teuthology.orchestra.run.smithi084.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-07-14T11:12:02.831 INFO:teuthology.orchestra.run.smithi084.stdout: jq-1.6-7.el8.x86_64 2023-07-14T11:12:02.831 INFO:teuthology.orchestra.run.smithi084.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-07-14T11:12:02.831 INFO:teuthology.orchestra.run.smithi084.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-07-14T11:12:02.831 INFO:teuthology.orchestra.run.smithi084.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-07-14T11:12:02.831 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs-devel-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T11:12:02.831 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs2-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T11:12:02.832 INFO:teuthology.orchestra.run.smithi084.stdout: libcephsqlite-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T11:12:02.832 INFO:teuthology.orchestra.run.smithi084.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-07-14T11:12:02.832 INFO:teuthology.orchestra.run.smithi084.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-07-14T11:12:02.832 INFO:teuthology.orchestra.run.smithi084.stdout: liboath-2.6.2-3.el8.x86_64 2023-07-14T11:12:02.832 INFO:teuthology.orchestra.run.smithi084.stdout: libpq-13.5-1.el8.x86_64 2023-07-14T11:12:02.832 INFO:teuthology.orchestra.run.smithi084.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-07-14T11:12:02.832 INFO:teuthology.orchestra.run.smithi084.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-07-14T11:12:02.833 INFO:teuthology.orchestra.run.smithi084.stdout: librados-devel-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T11:12:02.833 INFO:teuthology.orchestra.run.smithi084.stdout: libradosstriper1-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T11:12:02.833 INFO:teuthology.orchestra.run.smithi084.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-07-14T11:12:02.833 INFO:teuthology.orchestra.run.smithi084.stdout: librgw2-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T11:12:02.833 INFO:teuthology.orchestra.run.smithi084.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-07-14T11:12:02.833 INFO:teuthology.orchestra.run.smithi084.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-07-14T11:12:02.833 INFO:teuthology.orchestra.run.smithi084.stdout: libtool-2.4.6-25.el8.x86_64 2023-07-14T11:12:02.833 INFO:teuthology.orchestra.run.smithi084.stdout: libunwind-1.3.1-3.el8.x86_64 2023-07-14T11:12:02.834 INFO:teuthology.orchestra.run.smithi084.stdout: libuuid-devel-2.32.1-42.el8.x86_64 2023-07-14T11:12:02.834 INFO:teuthology.orchestra.run.smithi084.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-07-14T11:12:02.834 INFO:teuthology.orchestra.run.smithi084.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-07-14T11:12:02.834 INFO:teuthology.orchestra.run.smithi084.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-07-14T11:12:02.834 INFO:teuthology.orchestra.run.smithi084.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-07-14T11:12:02.834 INFO:teuthology.orchestra.run.smithi084.stdout: openblas-0.3.15-4.el8.x86_64 2023-07-14T11:12:02.834 INFO:teuthology.orchestra.run.smithi084.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-07-14T11:12:02.835 INFO:teuthology.orchestra.run.smithi084.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-07-14T11:12:02.835 INFO:teuthology.orchestra.run.smithi084.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-07-14T11:12:02.835 INFO:teuthology.orchestra.run.smithi084.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-07-14T11:12:02.835 INFO:teuthology.orchestra.run.smithi084.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-07-14T11:12:02.835 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-10.23-1.module_el8+300+2c53004c.x86_64 2023-07-14T11:12:02.835 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-contrib-10.23-1.module_el8+300+2c53004c.x86_64 2023-07-14T11:12:02.835 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-server-10.23-1.module_el8+300+2c53004c.x86_64 2023-07-14T11:12:02.835 INFO:teuthology.orchestra.run.smithi084.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-07-14T11:12:02.836 INFO:teuthology.orchestra.run.smithi084.stdout: python3-babel-2.5.1-7.el8.noarch 2023-07-14T11:12:02.836 INFO:teuthology.orchestra.run.smithi084.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-07-14T11:12:02.836 INFO:teuthology.orchestra.run.smithi084.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-07-14T11:12:02.836 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-07-14T11:12:02.836 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-argparse-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T11:12:02.836 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-common-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T11:12:02.836 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cephfs-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T11:12:02.837 INFO:teuthology.orchestra.run.smithi084.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-07-14T11:12:02.837 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-07-14T11:12:02.837 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-07-14T11:12:02.837 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-07-14T11:12:02.837 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-07-14T11:12:02.837 INFO:teuthology.orchestra.run.smithi084.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-07-14T11:12:02.837 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-6.2-6.el8.noarch 2023-07-14T11:12:02.837 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-07-14T11:12:02.838 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-07-14T11:12:02.838 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-07-14T11:12:02.838 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-07-14T11:12:02.838 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-07-14T11:12:02.838 INFO:teuthology.orchestra.run.smithi084.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-07-14T11:12:02.838 INFO:teuthology.orchestra.run.smithi084.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-07-14T11:12:02.838 INFO:teuthology.orchestra.run.smithi084.stdout: python3-mako-1.0.6-14.el8.noarch 2023-07-14T11:12:02.839 INFO:teuthology.orchestra.run.smithi084.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-07-14T11:12:02.839 INFO:teuthology.orchestra.run.smithi084.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-07-14T11:12:02.839 INFO:teuthology.orchestra.run.smithi084.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-07-14T11:12:02.839 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-07-14T11:12:02.839 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-07-14T11:12:02.839 INFO:teuthology.orchestra.run.smithi084.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-07-14T11:12:02.839 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-07-14T11:12:02.839 INFO:teuthology.orchestra.run.smithi084.stdout: python3-portend-2.6-1.el8.noarch 2023-07-14T11:12:02.840 INFO:teuthology.orchestra.run.smithi084.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-07-14T11:12:02.840 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-07-14T11:12:02.840 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-07-14T11:12:02.840 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-07-14T11:12:02.840 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pycparser-2.14-14.el8.noarch 2023-07-14T11:12:02.840 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pytz-2017.2-9.el8.noarch 2023-07-14T11:12:02.840 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rados-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T11:12:02.840 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rbd-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T11:12:02.841 INFO:teuthology.orchestra.run.smithi084.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-07-14T11:12:02.841 INFO:teuthology.orchestra.run.smithi084.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-07-14T11:12:02.841 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rgw-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T11:12:02.841 INFO:teuthology.orchestra.run.smithi084.stdout: python3-routes-2.4.1-12.el8.noarch 2023-07-14T11:12:02.841 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rsa-4.8-1.el8.noarch 2023-07-14T11:12:02.841 INFO:teuthology.orchestra.run.smithi084.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-07-14T11:12:02.841 INFO:teuthology.orchestra.run.smithi084.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-07-14T11:12:02.842 INFO:teuthology.orchestra.run.smithi084.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-07-14T11:12:02.842 INFO:teuthology.orchestra.run.smithi084.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-07-14T11:12:02.842 INFO:teuthology.orchestra.run.smithi084.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-07-14T11:12:02.842 INFO:teuthology.orchestra.run.smithi084.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-07-14T11:12:02.842 INFO:teuthology.orchestra.run.smithi084.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-07-14T11:12:02.842 INFO:teuthology.orchestra.run.smithi084.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-07-14T11:12:02.842 INFO:teuthology.orchestra.run.smithi084.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-07-14T11:12:02.842 INFO:teuthology.orchestra.run.smithi084.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-07-14T11:12:02.843 INFO:teuthology.orchestra.run.smithi084.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-07-14T11:12:02.843 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-fuse-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T11:12:02.843 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-mirror-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T11:12:02.843 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-nbd-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T11:12:02.843 INFO:teuthology.orchestra.run.smithi084.stdout: socat-1.7.4.1-1.el8.x86_64 2023-07-14T11:12:02.843 INFO:teuthology.orchestra.run.smithi084.stdout: thrift-0.13.0-2.el8.x86_64 2023-07-14T11:12:02.843 INFO:teuthology.orchestra.run.smithi084.stdout: uuid-1.6.2-43.el8.x86_64 2023-07-14T11:12:02.843 INFO:teuthology.orchestra.run.smithi084.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2023-07-14T11:12:02.844 INFO:teuthology.orchestra.run.smithi084.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-07-14T11:12:02.844 INFO:teuthology.orchestra.run.smithi084.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-07-14T11:12:02.844 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:12:02.844 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2023-07-14T11:12:03.127 DEBUG:teuthology.parallel:result is None 2023-07-14T11:12:03.129 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=3fc0089cc1082313a98853d48b892acdc1385b8b 2023-07-14T11:12:03.424 DEBUG:teuthology.orchestra.run.smithi084:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-07-14T11:12:03.481 INFO:teuthology.orchestra.run.smithi084.stdout:18.0.0-4757.g3fc0089c.el8 2023-07-14T11:12:03.481 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4757.g3fc0089c.el8 2023-07-14T11:12:03.482 INFO:teuthology.task.install:The correct ceph version 18.0.0-4757.g3fc0089c is installed. 2023-07-14T11:12:03.482 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=3fc0089cc1082313a98853d48b892acdc1385b8b 2023-07-14T11:12:03.832 DEBUG:teuthology.orchestra.run.smithi179:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-07-14T11:12:03.894 INFO:teuthology.orchestra.run.smithi179.stdout:18.0.0-4757.g3fc0089c.el8 2023-07-14T11:12:03.895 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4757.g3fc0089c.el8 2023-07-14T11:12:03.895 INFO:teuthology.task.install:The correct ceph version 18.0.0-4757.g3fc0089c is installed. 2023-07-14T11:12:03.895 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-07-14T11:12:03.896 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-14T11:12:03.896 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-14T11:12:03.978 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-07-14T11:12:03.979 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-14T11:12:04.056 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-07-14T11:12:04.056 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-14T11:12:04.056 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/usr/bin/daemon-helper 2023-07-14T11:12:04.128 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-14T11:12:04.244 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-07-14T11:12:04.244 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/usr/bin/daemon-helper 2023-07-14T11:12:04.317 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-14T11:12:04.426 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-07-14T11:12:04.427 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-14T11:12:04.427 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-14T11:12:04.498 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-14T11:12:04.611 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-07-14T11:12:04.611 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-14T11:12:04.680 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-14T11:12:04.788 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-07-14T11:12:04.788 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-14T11:12:04.788 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/usr/bin/stdin-killer 2023-07-14T11:12:04.858 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-14T11:12:04.968 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-07-14T11:12:04.968 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/usr/bin/stdin-killer 2023-07-14T11:12:05.037 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-14T11:12:05.145 INFO:teuthology.run_tasks:Running task ceph... 2023-07-14T11:12:05.218 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-07-14T11:12:05.219 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 777 /var/log/ceph 2023-07-14T11:12:05.223 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 777 /var/log/ceph 2023-07-14T11:12:05.291 INFO:tasks.ceph:Disabling ceph logrotate... 2023-07-14T11:12:05.291 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f -- /etc/logrotate.d/ceph 2023-07-14T11:12:05.296 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -f -- /etc/logrotate.d/ceph 2023-07-14T11:12:05.363 INFO:tasks.ceph:Creating extra log directories... 2023-07-14T11:12:05.363 DEBUG:teuthology.orchestra.run.smithi084:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-07-14T11:12:05.367 DEBUG:teuthology.orchestra.run.smithi179:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-07-14T11:12:05.441 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-07-14T11:12:05.441 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-07-14T11:12:05.442 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-07-14T11:12:05.442 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-14T11:12:05.442 DEBUG:teuthology.orchestra.run.smithi084:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-07-14T11:12:05.487 DEBUG:teuthology.orchestra.run.smithi084:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-07-14T11:12:05.691 DEBUG:teuthology.orchestra.run.smithi084:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-07-14T11:12:05.766 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-07-14T11:12:05.767 DEBUG:teuthology.orchestra.run.smithi179:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-07-14T11:12:05.812 DEBUG:teuthology.orchestra.run.smithi179:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-07-14T11:12:06.021 DEBUG:teuthology.orchestra.run.smithi179:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-07-14T11:12:06.095 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-07-14T11:12:06.096 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-07-14T11:12:06.096 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi/7337410', 'branch': 'wip-rishabh-2023Jul13', 'description': 'fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/misc}}', 'email': None, 'first_in_suite': False, 'job_id': '7337410', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'a440c79eee0258ae07e4988d8690fe6187b8b7a3'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-2023Jul13'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '3fc0089cc1082313a98853d48b892acdc1385b8b'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '3fc0089cc1082313a98853d48b892acdc1385b8b'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-2023Jul13', 'sha1': '3fc0089cc1082313a98853d48b892acdc1385b8b'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 80, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'sha1': '3fc0089cc1082313a98853d48b892acdc1385b8b', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-rishabh-2023Jul13', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_3fc0089cc1082313a98853d48b892acdc1385b8b/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '3fc0089cc1082313a98853d48b892acdc1385b8b', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi084.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO7BHmxN2RACnOY5AgcD58lLfgn+7XLSowNTataSO5kVQcm72LqT3Lz2KTGN61lhfr7s0pP0EFXaftriSqHRnZY=', 'smithi179.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCqZv/wOGyMgL6b522Br09/irVRGhPzDuWDhH9AXCR6lN0pZbPVpTluqBIsemY44eocmee46S2PdN8yeRAwvsDISyLUNJSal7utXmyWMOylWhGMizNtgPiC1GHRxWjKJ1WHOaGoc1O+4BDTjSLYB2CnGAkqjDCiUKaUm59EIdgU8u7xk1haD/SDuFK72DaCnVKq5x+RsKzM5qnmWO2GPZZUVd/dWvKUnLg7oCmm6NSPVOjHyroQTfQqzwSUdpbH2Fb32dLhxSDDhZBeTvIBii/KqgbRBxP0S7we+prrZASAH+bC0AlV8hfKj5YYDnMlrvgBToyclQ/M7+Y9faYA6Tb1HOtvEmcSP2DgT/pgk83KG4dVuA4UXXEsW+YHL84nM9oi4+cU/PpRTqHz2RrCx86pHI3VL2fK4I/UEP3y/R8Wk/A+GoUkoawYME9NJdKulGeqV+YDmVSHohFHHZfA+kWZRRso6nndIksIoRXIRxvbFlnl3BdYNtydLiImfT+tQXk='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'a440c79eee0258ae07e4988d8690fe6187b8b7a3'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '3fc0089cc1082313a98853d48b892acdc1385b8b'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestMisc']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'aa6a80e6cc655fff48452a7eca02070e61d074fc', 'timestamp': '2023-07-14_10:26:42', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.23459'} 2023-07-14T11:12:06.097 DEBUG:teuthology.orchestra.run.smithi084:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-07-14T11:12:06.102 DEBUG:teuthology.orchestra.run.smithi179:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-07-14T11:12:06.147 DEBUG:teuthology.orchestra.run.smithi084:> sudo install -d -m0777 -- /var/run/ceph 2023-07-14T11:12:06.188 DEBUG:teuthology.orchestra.run.smithi179:> sudo install -d -m0777 -- /var/run/ceph 2023-07-14T11:12:06.259 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-14T11:12:06.259 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/scratch_devs of=/dev/stdout 2023-07-14T11:12:06.307 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-14T11:12:06.308 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_1 2023-07-14T11:12:06.393 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-14T11:12:06.394 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-14T11:12:06.394 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 5h/5d Inode: 446 Links: 1 2023-07-14T11:12:06.394 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-14T11:12:06.394 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2023-07-14T11:12:06.394 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2023-07-14 11:12:00.106632920 +0000 2023-07-14T11:12:06.394 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2023-07-14 11:02:49.053251986 +0000 2023-07-14T11:12:06.395 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2023-07-14 11:02:49.053251986 +0000 2023-07-14T11:12:06.395 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: 2023-07-14 11:02:49.025252457 +0000 2023-07-14T11:12:06.395 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-14T11:12:06.462 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2023-07-14T11:12:06.462 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2023-07-14T11:12:06.462 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000261154 s, 2.0 MB/s 2023-07-14T11:12:06.465 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-14T11:12:06.514 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_2 2023-07-14T11:12:06.559 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-14T11:12:06.559 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-14T11:12:06.559 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 5h/5d Inode: 452 Links: 1 2023-07-14T11:12:06.559 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-14T11:12:06.560 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2023-07-14T11:12:06.560 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2023-07-14 11:12:00.106632920 +0000 2023-07-14T11:12:06.560 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2023-07-14 11:02:49.899237743 +0000 2023-07-14T11:12:06.560 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2023-07-14 11:02:49.899237743 +0000 2023-07-14T11:12:06.560 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: 2023-07-14 11:02:49.874238164 +0000 2023-07-14T11:12:06.560 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-14T11:12:06.666 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2023-07-14T11:12:06.666 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2023-07-14T11:12:06.667 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000301761 s, 1.7 MB/s 2023-07-14T11:12:06.669 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-14T11:12:06.716 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_3 2023-07-14T11:12:06.760 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-14T11:12:06.760 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-14T11:12:06.761 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 5h/5d Inode: 458 Links: 1 2023-07-14T11:12:06.761 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-14T11:12:06.761 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2023-07-14T11:12:06.761 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2023-07-14 11:12:00.106632920 +0000 2023-07-14T11:12:06.761 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2023-07-14 11:02:50.779222928 +0000 2023-07-14T11:12:06.761 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2023-07-14 11:02:50.779222928 +0000 2023-07-14T11:12:06.761 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: 2023-07-14 11:02:50.753223366 +0000 2023-07-14T11:12:06.762 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-14T11:12:06.869 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2023-07-14T11:12:06.869 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2023-07-14T11:12:06.869 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000287113 s, 1.8 MB/s 2023-07-14T11:12:06.872 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-14T11:12:06.922 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_4 2023-07-14T11:12:06.970 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-14T11:12:06.970 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-14T11:12:06.970 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 5h/5d Inode: 464 Links: 1 2023-07-14T11:12:06.970 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-14T11:12:06.971 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2023-07-14T11:12:06.971 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2023-07-14 11:12:00.106632920 +0000 2023-07-14T11:12:06.971 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2023-07-14 11:02:51.657208147 +0000 2023-07-14T11:12:06.971 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2023-07-14 11:02:51.657208147 +0000 2023-07-14T11:12:06.971 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: 2023-07-14 11:02:51.633208551 +0000 2023-07-14T11:12:06.972 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-14T11:12:07.041 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2023-07-14T11:12:07.041 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2023-07-14T11:12:07.041 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000299647 s, 1.7 MB/s 2023-07-14T11:12:07.044 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-14T11:12:07.094 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-14T11:12:07.094 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-07-14T11:12:07.095 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/scratch_devs of=/dev/stdout 2023-07-14T11:12:07.142 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-14T11:12:07.143 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_1 2023-07-14T11:12:07.229 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-14T11:12:07.229 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-14T11:12:07.229 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 5h/5d Inode: 446 Links: 1 2023-07-14T11:12:07.229 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-14T11:12:07.229 INFO:teuthology.orchestra.run.smithi179.stdout:Context: system_u:object_r:device_t:s0 2023-07-14T11:12:07.230 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2023-07-14 11:07:26.178376787 +0000 2023-07-14T11:12:07.230 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2023-07-14 11:02:49.043674466 +0000 2023-07-14T11:12:07.230 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2023-07-14 11:02:49.043674466 +0000 2023-07-14T11:12:07.230 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: 2023-07-14 11:02:49.016675056 +0000 2023-07-14T11:12:07.230 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-14T11:12:07.297 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2023-07-14T11:12:07.297 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2023-07-14T11:12:07.297 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000299986 s, 1.7 MB/s 2023-07-14T11:12:07.299 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-14T11:12:07.346 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_2 2023-07-14T11:12:07.391 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-14T11:12:07.392 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-14T11:12:07.392 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 5h/5d Inode: 452 Links: 1 2023-07-14T11:12:07.392 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-14T11:12:07.392 INFO:teuthology.orchestra.run.smithi179.stdout:Context: system_u:object_r:device_t:s0 2023-07-14T11:12:07.392 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2023-07-14 11:07:26.178376787 +0000 2023-07-14T11:12:07.392 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2023-07-14 11:02:49.899655757 +0000 2023-07-14T11:12:07.392 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2023-07-14 11:02:49.899655757 +0000 2023-07-14T11:12:07.393 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: 2023-07-14 11:02:49.876656260 +0000 2023-07-14T11:12:07.393 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-14T11:12:07.458 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2023-07-14T11:12:07.458 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2023-07-14T11:12:07.458 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000294026 s, 1.7 MB/s 2023-07-14T11:12:07.460 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-14T11:12:07.507 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_3 2023-07-14T11:12:07.552 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-14T11:12:07.552 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-14T11:12:07.552 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 5h/5d Inode: 458 Links: 1 2023-07-14T11:12:07.552 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-14T11:12:07.553 INFO:teuthology.orchestra.run.smithi179.stdout:Context: system_u:object_r:device_t:s0 2023-07-14T11:12:07.553 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2023-07-14 11:07:26.178376787 +0000 2023-07-14T11:12:07.553 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2023-07-14 11:02:50.758636983 +0000 2023-07-14T11:12:07.553 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2023-07-14 11:02:50.758636983 +0000 2023-07-14T11:12:07.553 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: 2023-07-14 11:02:50.733637530 +0000 2023-07-14T11:12:07.554 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-14T11:12:07.659 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2023-07-14T11:12:07.659 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2023-07-14T11:12:07.659 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000289058 s, 1.8 MB/s 2023-07-14T11:12:07.661 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-14T11:12:07.708 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_4 2023-07-14T11:12:07.753 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-14T11:12:07.754 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-14T11:12:07.754 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 5h/5d Inode: 464 Links: 1 2023-07-14T11:12:07.754 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-14T11:12:07.754 INFO:teuthology.orchestra.run.smithi179.stdout:Context: system_u:object_r:device_t:s0 2023-07-14T11:12:07.754 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2023-07-14 11:07:26.178376787 +0000 2023-07-14T11:12:07.754 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2023-07-14 11:02:51.615618253 +0000 2023-07-14T11:12:07.755 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2023-07-14 11:02:51.615618253 +0000 2023-07-14T11:12:07.755 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: 2023-07-14 11:02:51.592618756 +0000 2023-07-14T11:12:07.755 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-14T11:12:07.859 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2023-07-14T11:12:07.860 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2023-07-14T11:12:07.860 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000265476 s, 1.9 MB/s 2023-07-14T11:12:07.862 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-14T11:12:07.909 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-14T11:12:07.909 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi084.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi179.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-07-14T11:12:07.909 INFO:tasks.ceph:Generating config... 2023-07-14T11:12:07.911 INFO:tasks.ceph:[client] client mount timeout = 600 2023-07-14T11:12:07.911 INFO:tasks.ceph:[client] debug client = 20 2023-07-14T11:12:07.911 INFO:tasks.ceph:[client] debug ms = 1 2023-07-14T11:12:07.911 INFO:tasks.ceph:[client] pid file = 2023-07-14T11:12:07.912 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-07-14T11:12:07.912 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-07-14T11:12:07.912 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-07-14T11:12:07.912 INFO:tasks.ceph:[mds] debug mds = 20 2023-07-14T11:12:07.912 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-07-14T11:12:07.913 INFO:tasks.ceph:[mds] debug ms = 1 2023-07-14T11:12:07.913 INFO:tasks.ceph:[mds] mds debug frag = True 2023-07-14T11:12:07.913 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-07-14T11:12:07.913 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-07-14T11:12:07.913 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-07-14T11:12:07.914 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-07-14T11:12:07.914 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-07-14T11:12:07.914 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-07-14T11:12:07.914 INFO:tasks.ceph:[mgr] debug client = 20 2023-07-14T11:12:07.914 INFO:tasks.ceph:[mgr] debug finisher = 20 2023-07-14T11:12:07.914 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-07-14T11:12:07.915 INFO:tasks.ceph:[mgr] debug ms = 1 2023-07-14T11:12:07.915 INFO:tasks.ceph:[mon] debug mon = 20 2023-07-14T11:12:07.915 INFO:tasks.ceph:[mon] debug ms = 1 2023-07-14T11:12:07.915 INFO:tasks.ceph:[mon] debug paxos = 20 2023-07-14T11:12:07.915 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-07-14T11:12:07.916 INFO:tasks.ceph:[osd] bdev async discard = True 2023-07-14T11:12:07.916 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-07-14T11:12:07.916 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-07-14T11:12:07.916 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-07-14T11:12:07.916 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-07-14T11:12:07.917 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-07-14T11:12:07.917 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-07-14T11:12:07.917 INFO:tasks.ceph:[osd] debug ms = 1 2023-07-14T11:12:07.917 INFO:tasks.ceph:[osd] debug osd = 20 2023-07-14T11:12:07.917 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-07-14T11:12:07.917 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-07-14T11:12:07.918 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-07-14T11:12:07.918 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-07-14T11:12:07.918 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-07-14T11:12:07.918 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-07-14T11:12:07.918 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-07-14T11:12:07.919 INFO:tasks.ceph:Setting up mon.a... 2023-07-14T11:12:07.919 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-07-14T11:12:08.024 INFO:teuthology.orchestra.run.smithi084.stdout:creating /etc/ceph/ceph.keyring 2023-07-14T11:12:08.030 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-07-14T11:12:08.128 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-14T11:12:08.194 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.84'), ('mon.b', '172.21.15.179'), ('mon.c', '[v2:172.21.15.179:3301,v1:172.21.15.179:6790]')] 2023-07-14T11:12:08.195 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.84,172.21.15.179,[v2:172.21.15.179:3301,v1:172.21.15.179:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-07-14T11:12:08.196 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-14T11:12:08.196 DEBUG:teuthology.orchestra.run.smithi084:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-07-14T11:12:08.239 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.84 --add b 172.21.15.179 --addv c '[v2:172.21.15.179:3301,v1:172.21.15.179:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-07-14T11:12:08.379 INFO:teuthology.orchestra.run.smithi084.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-07-14T11:12:08.379 INFO:teuthology.orchestra.run.smithi084.stdout:monmaptool: generated fsid 3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f 2023-07-14T11:12:08.379 INFO:teuthology.orchestra.run.smithi084.stdout:setting min_mon_release = pacific 2023-07-14T11:12:08.379 INFO:teuthology.orchestra.run.smithi084.stdout:epoch 0 2023-07-14T11:12:08.379 INFO:teuthology.orchestra.run.smithi084.stdout:fsid 3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f 2023-07-14T11:12:08.380 INFO:teuthology.orchestra.run.smithi084.stdout:last_changed 2023-07-14T11:12:08.378166+0000 2023-07-14T11:12:08.380 INFO:teuthology.orchestra.run.smithi084.stdout:created 2023-07-14T11:12:08.378166+0000 2023-07-14T11:12:08.380 INFO:teuthology.orchestra.run.smithi084.stdout:min_mon_release 16 (pacific) 2023-07-14T11:12:08.380 INFO:teuthology.orchestra.run.smithi084.stdout:election_strategy: 1 2023-07-14T11:12:08.380 INFO:teuthology.orchestra.run.smithi084.stdout:0: [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] mon.a 2023-07-14T11:12:08.380 INFO:teuthology.orchestra.run.smithi084.stdout:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2023-07-14T11:12:08.380 INFO:teuthology.orchestra.run.smithi084.stdout:2: [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] mon.c 2023-07-14T11:12:08.380 INFO:teuthology.orchestra.run.smithi084.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-07-14T11:12:08.382 DEBUG:teuthology.orchestra.run.smithi084:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-07-14T11:12:08.428 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f... 2023-07-14T11:12:08.429 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-07-14T11:12:08.434 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-07-14T11:12:08.552 INFO:teuthology.orchestra.run.smithi084.stdout:[global] 2023-07-14T11:12:08.552 INFO:teuthology.orchestra.run.smithi084.stdout: chdir = "" 2023-07-14T11:12:08.552 INFO:teuthology.orchestra.run.smithi084.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-07-14T11:12:08.553 INFO:teuthology.orchestra.run.smithi084.stdout: auth supported = cephx 2023-07-14T11:12:08.553 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:12:08.553 INFO:teuthology.orchestra.run.smithi084.stdout: filestore xattr use omap = true 2023-07-14T11:12:08.553 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:12:08.553 INFO:teuthology.orchestra.run.smithi084.stdout: mon clock drift allowed = 1.000 2023-07-14T11:12:08.553 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:12:08.553 INFO:teuthology.orchestra.run.smithi084.stdout: osd crush chooseleaf type = 0 2023-07-14T11:12:08.554 INFO:teuthology.orchestra.run.smithi084.stdout: auth debug = true 2023-07-14T11:12:08.554 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:12:08.554 INFO:teuthology.orchestra.run.smithi084.stdout: ms die on old message = true 2023-07-14T11:12:08.554 INFO:teuthology.orchestra.run.smithi084.stdout: ms die on bug = true 2023-07-14T11:12:08.554 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:12:08.554 INFO:teuthology.orchestra.run.smithi084.stdout: mon max pg per osd = 10000 # >= luminous 2023-07-14T11:12:08.554 INFO:teuthology.orchestra.run.smithi084.stdout: mon pg warn max object skew = 0 2023-07-14T11:12:08.554 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:12:08.555 INFO:teuthology.orchestra.run.smithi084.stdout: # disable pg_autoscaler by default for new pools 2023-07-14T11:12:08.555 INFO:teuthology.orchestra.run.smithi084.stdout: osd_pool_default_pg_autoscale_mode = off 2023-07-14T11:12:08.555 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:12:08.555 INFO:teuthology.orchestra.run.smithi084.stdout: osd pool default size = 2 2023-07-14T11:12:08.555 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:12:08.555 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd allow primary affinity = true 2023-07-14T11:12:08.555 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd allow pg remap = true 2023-07-14T11:12:08.555 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on legacy crush tunables = false 2023-07-14T11:12:08.556 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on crush straw calc version zero = false 2023-07-14T11:12:08.556 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on no sortbitwise = false 2023-07-14T11:12:08.556 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on osd down out interval zero = false 2023-07-14T11:12:08.556 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on too few osds = false 2023-07-14T11:12:08.556 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-07-14T11:12:08.556 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_pool_no_redundancy = false 2023-07-14T11:12:08.556 INFO:teuthology.orchestra.run.smithi084.stdout: mon_allow_pool_size_one = true 2023-07-14T11:12:08.557 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:12:08.557 INFO:teuthology.orchestra.run.smithi084.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-07-14T11:12:08.557 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:12:08.557 INFO:teuthology.orchestra.run.smithi084.stdout: osd default data pool replay window = 5 2023-07-14T11:12:08.557 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:12:08.557 INFO:teuthology.orchestra.run.smithi084.stdout: mon allow pool delete = true 2023-07-14T11:12:08.557 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:12:08.557 INFO:teuthology.orchestra.run.smithi084.stdout: mon cluster log file level = debug 2023-07-14T11:12:08.558 INFO:teuthology.orchestra.run.smithi084.stdout: debug asserts on shutdown = true 2023-07-14T11:12:08.558 INFO:teuthology.orchestra.run.smithi084.stdout: mon health detail to clog = false 2023-07-14T11:12:08.558 INFO:teuthology.orchestra.run.smithi084.stdout: mon host = "172.21.15.84,172.21.15.179,[v2:172.21.15.179:3301,v1:172.21.15.179:6790]" 2023-07-14T11:12:08.558 INFO:teuthology.orchestra.run.smithi084.stdout: ms die on skipped message = False 2023-07-14T11:12:08.558 INFO:teuthology.orchestra.run.smithi084.stdout: fsid = 3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f 2023-07-14T11:12:08.558 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:12:08.558 INFO:teuthology.orchestra.run.smithi084.stdout:[osd] 2023-07-14T11:12:08.558 INFO:teuthology.orchestra.run.smithi084.stdout: osd journal size = 100 2023-07-14T11:12:08.559 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:12:08.559 INFO:teuthology.orchestra.run.smithi084.stdout: osd scrub load threshold = 5.0 2023-07-14T11:12:08.559 INFO:teuthology.orchestra.run.smithi084.stdout: osd scrub max interval = 600 2023-07-14T11:12:08.559 INFO:teuthology.orchestra.run.smithi084.stdout: osd mclock profile = high_recovery_ops 2023-07-14T11:12:08.559 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:12:08.559 INFO:teuthology.orchestra.run.smithi084.stdout: osd recover clone overlap = true 2023-07-14T11:12:08.559 INFO:teuthology.orchestra.run.smithi084.stdout: osd recovery max chunk = 1048576 2023-07-14T11:12:08.560 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:12:08.560 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug shutdown = true 2023-07-14T11:12:08.560 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug op order = true 2023-07-14T11:12:08.560 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug verify stray on activate = true 2023-07-14T11:12:08.560 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:12:08.560 INFO:teuthology.orchestra.run.smithi084.stdout: osd open classes on start = true 2023-07-14T11:12:08.560 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug pg log writeout = true 2023-07-14T11:12:08.560 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:12:08.561 INFO:teuthology.orchestra.run.smithi084.stdout: osd deep scrub update digest min age = 30 2023-07-14T11:12:08.561 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:12:08.561 INFO:teuthology.orchestra.run.smithi084.stdout: osd map max advance = 10 2023-07-14T11:12:08.561 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:12:08.561 INFO:teuthology.orchestra.run.smithi084.stdout: journal zero on create = true 2023-07-14T11:12:08.561 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:12:08.561 INFO:teuthology.orchestra.run.smithi084.stdout: filestore ondisk finisher threads = 3 2023-07-14T11:12:08.561 INFO:teuthology.orchestra.run.smithi084.stdout: filestore apply finisher threads = 3 2023-07-14T11:12:08.562 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:12:08.562 INFO:teuthology.orchestra.run.smithi084.stdout: bdev debug aio = true 2023-07-14T11:12:08.562 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug misdirected ops = true 2023-07-14T11:12:08.562 INFO:teuthology.orchestra.run.smithi084.stdout: bdev async discard = True 2023-07-14T11:12:08.562 INFO:teuthology.orchestra.run.smithi084.stdout: bdev enable discard = True 2023-07-14T11:12:08.562 INFO:teuthology.orchestra.run.smithi084.stdout: bluestore allocator = bitmap 2023-07-14T11:12:08.562 INFO:teuthology.orchestra.run.smithi084.stdout: bluestore block size = 96636764160 2023-07-14T11:12:08.562 INFO:teuthology.orchestra.run.smithi084.stdout: bluestore fsck on mount = True 2023-07-14T11:12:08.563 INFO:teuthology.orchestra.run.smithi084.stdout: debug bluefs = 1/20 2023-07-14T11:12:08.563 INFO:teuthology.orchestra.run.smithi084.stdout: debug bluestore = 1/20 2023-07-14T11:12:08.563 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2023-07-14T11:12:08.563 INFO:teuthology.orchestra.run.smithi084.stdout: debug osd = 20 2023-07-14T11:12:08.563 INFO:teuthology.orchestra.run.smithi084.stdout: debug rocksdb = 4/10 2023-07-14T11:12:08.563 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd backfillfull_ratio = 0.85 2023-07-14T11:12:08.563 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd full ratio = 0.9 2023-07-14T11:12:08.563 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd nearfull ratio = 0.8 2023-07-14T11:12:08.564 INFO:teuthology.orchestra.run.smithi084.stdout: osd failsafe full ratio = 0.95 2023-07-14T11:12:08.564 INFO:teuthology.orchestra.run.smithi084.stdout: osd objectstore = bluestore 2023-07-14T11:12:08.564 INFO:teuthology.orchestra.run.smithi084.stdout: osd op complaint time = 180 2023-07-14T11:12:08.564 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:12:08.564 INFO:teuthology.orchestra.run.smithi084.stdout:[mgr] 2023-07-14T11:12:08.564 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2023-07-14T11:12:08.564 INFO:teuthology.orchestra.run.smithi084.stdout: debug mgr = 20 2023-07-14T11:12:08.565 INFO:teuthology.orchestra.run.smithi084.stdout: debug mon = 20 2023-07-14T11:12:08.565 INFO:teuthology.orchestra.run.smithi084.stdout: debug auth = 20 2023-07-14T11:12:08.565 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min pgs per osd = 4 2023-07-14T11:12:08.565 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min bytes per osd = 10 2023-07-14T11:12:08.565 INFO:teuthology.orchestra.run.smithi084.stdout: mgr/telemetry/nag = false 2023-07-14T11:12:08.565 INFO:teuthology.orchestra.run.smithi084.stdout: debug client = 20 2023-07-14T11:12:08.565 INFO:teuthology.orchestra.run.smithi084.stdout: debug finisher = 20 2023-07-14T11:12:08.565 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:12:08.566 INFO:teuthology.orchestra.run.smithi084.stdout:[mon] 2023-07-14T11:12:08.566 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2023-07-14T11:12:08.566 INFO:teuthology.orchestra.run.smithi084.stdout: debug mon = 20 2023-07-14T11:12:08.566 INFO:teuthology.orchestra.run.smithi084.stdout: debug paxos = 20 2023-07-14T11:12:08.566 INFO:teuthology.orchestra.run.smithi084.stdout: debug auth = 20 2023-07-14T11:12:08.566 INFO:teuthology.orchestra.run.smithi084.stdout: mon data avail warn = 5 2023-07-14T11:12:08.566 INFO:teuthology.orchestra.run.smithi084.stdout: mon mgr mkfs grace = 240 2023-07-14T11:12:08.566 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min pgs per osd = 4 2023-07-14T11:12:08.567 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd reporter subtree level = osd 2023-07-14T11:12:08.567 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd prime pg temp = true 2023-07-14T11:12:08.567 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min bytes per osd = 10 2023-07-14T11:12:08.567 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:12:08.567 INFO:teuthology.orchestra.run.smithi084.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-07-14T11:12:08.567 INFO:teuthology.orchestra.run.smithi084.stdout: auth mon ticket ttl = 660 # 11m 2023-07-14T11:12:08.567 INFO:teuthology.orchestra.run.smithi084.stdout: auth service ticket ttl = 240 # 4m 2023-07-14T11:12:08.567 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:12:08.568 INFO:teuthology.orchestra.run.smithi084.stdout: # don't complain about insecure global_id in the test suite 2023-07-14T11:12:08.568 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-07-14T11:12:08.568 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-07-14T11:12:08.568 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:12:08.568 INFO:teuthology.orchestra.run.smithi084.stdout: # 1m isn't quite enough 2023-07-14T11:12:08.568 INFO:teuthology.orchestra.run.smithi084.stdout: mon_down_mkfs_grace = 2m 2023-07-14T11:12:08.568 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:12:08.568 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_filestore_osds = false 2023-07-14T11:12:08.569 INFO:teuthology.orchestra.run.smithi084.stdout: mon op complaint time = 120 2023-07-14T11:12:08.569 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:12:08.569 INFO:teuthology.orchestra.run.smithi084.stdout:[client] 2023-07-14T11:12:08.569 INFO:teuthology.orchestra.run.smithi084.stdout: rgw cache enabled = true 2023-07-14T11:12:08.569 INFO:teuthology.orchestra.run.smithi084.stdout: rgw enable ops log = true 2023-07-14T11:12:08.569 INFO:teuthology.orchestra.run.smithi084.stdout: rgw enable usage log = true 2023-07-14T11:12:08.569 INFO:teuthology.orchestra.run.smithi084.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-07-14T11:12:08.569 INFO:teuthology.orchestra.run.smithi084.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-07-14T11:12:08.570 INFO:teuthology.orchestra.run.smithi084.stdout: client mount timeout = 600 2023-07-14T11:12:08.570 INFO:teuthology.orchestra.run.smithi084.stdout: debug client = 20 2023-07-14T11:12:08.570 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2023-07-14T11:12:08.570 INFO:teuthology.orchestra.run.smithi084.stdout: pid file = "" 2023-07-14T11:12:08.570 INFO:teuthology.orchestra.run.smithi084.stdout: rados mon op timeout = 900 2023-07-14T11:12:08.570 INFO:teuthology.orchestra.run.smithi084.stdout: rados osd op timeout = 900 2023-07-14T11:12:08.570 INFO:teuthology.orchestra.run.smithi084.stdout:[mon.a] 2023-07-14T11:12:08.570 INFO:teuthology.orchestra.run.smithi084.stdout:[mon.b] 2023-07-14T11:12:08.571 INFO:teuthology.orchestra.run.smithi084.stdout:[mon.c] 2023-07-14T11:12:08.571 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.a] 2023-07-14T11:12:08.571 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.c] 2023-07-14T11:12:08.571 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.b] 2023-07-14T11:12:08.571 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.d] 2023-07-14T11:12:08.571 INFO:teuthology.orchestra.run.smithi084.stdout:[mds] 2023-07-14T11:12:08.571 INFO:teuthology.orchestra.run.smithi084.stdout: debug mds = 20 2023-07-14T11:12:08.571 INFO:teuthology.orchestra.run.smithi084.stdout: debug mds balancer = 20 2023-07-14T11:12:08.572 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2023-07-14T11:12:08.572 INFO:teuthology.orchestra.run.smithi084.stdout: mds debug frag = True 2023-07-14T11:12:08.572 INFO:teuthology.orchestra.run.smithi084.stdout: mds debug scatterstat = True 2023-07-14T11:12:08.572 INFO:teuthology.orchestra.run.smithi084.stdout: mds op complaint time = 180 2023-07-14T11:12:08.572 INFO:teuthology.orchestra.run.smithi084.stdout: mds verify scatter = True 2023-07-14T11:12:08.572 INFO:teuthology.orchestra.run.smithi084.stdout: osd op complaint time = 180 2023-07-14T11:12:08.572 INFO:teuthology.orchestra.run.smithi084.stdout: rados mon op timeout = 900 2023-07-14T11:12:08.572 INFO:teuthology.orchestra.run.smithi084.stdout: rados osd op timeout = 900 2023-07-14T11:12:08.573 INFO:teuthology.orchestra.run.smithi179.stdout:[global] 2023-07-14T11:12:08.573 INFO:teuthology.orchestra.run.smithi179.stdout: chdir = "" 2023-07-14T11:12:08.573 INFO:teuthology.orchestra.run.smithi179.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-07-14T11:12:08.573 INFO:teuthology.orchestra.run.smithi179.stdout: auth supported = cephx 2023-07-14T11:12:08.574 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-07-14T11:12:08.574 INFO:teuthology.orchestra.run.smithi179.stdout: filestore xattr use omap = true 2023-07-14T11:12:08.574 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-07-14T11:12:08.574 INFO:teuthology.orchestra.run.smithi179.stdout: mon clock drift allowed = 1.000 2023-07-14T11:12:08.574 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-07-14T11:12:08.574 INFO:teuthology.orchestra.run.smithi179.stdout: osd crush chooseleaf type = 0 2023-07-14T11:12:08.574 INFO:teuthology.orchestra.run.smithi179.stdout: auth debug = true 2023-07-14T11:12:08.574 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-07-14T11:12:08.575 INFO:teuthology.orchestra.run.smithi179.stdout: ms die on old message = true 2023-07-14T11:12:08.575 INFO:teuthology.orchestra.run.smithi179.stdout: ms die on bug = true 2023-07-14T11:12:08.575 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-07-14T11:12:08.575 INFO:teuthology.orchestra.run.smithi179.stdout: mon max pg per osd = 10000 # >= luminous 2023-07-14T11:12:08.575 INFO:teuthology.orchestra.run.smithi179.stdout: mon pg warn max object skew = 0 2023-07-14T11:12:08.575 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-07-14T11:12:08.575 INFO:teuthology.orchestra.run.smithi179.stdout: # disable pg_autoscaler by default for new pools 2023-07-14T11:12:08.575 INFO:teuthology.orchestra.run.smithi179.stdout: osd_pool_default_pg_autoscale_mode = off 2023-07-14T11:12:08.576 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-07-14T11:12:08.576 INFO:teuthology.orchestra.run.smithi179.stdout: osd pool default size = 2 2023-07-14T11:12:08.576 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-07-14T11:12:08.576 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd allow primary affinity = true 2023-07-14T11:12:08.576 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd allow pg remap = true 2023-07-14T11:12:08.576 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on legacy crush tunables = false 2023-07-14T11:12:08.576 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on crush straw calc version zero = false 2023-07-14T11:12:08.576 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on no sortbitwise = false 2023-07-14T11:12:08.577 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on osd down out interval zero = false 2023-07-14T11:12:08.577 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on too few osds = false 2023-07-14T11:12:08.577 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-07-14T11:12:08.577 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_pool_no_redundancy = false 2023-07-14T11:12:08.577 INFO:teuthology.orchestra.run.smithi179.stdout: mon_allow_pool_size_one = true 2023-07-14T11:12:08.577 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-07-14T11:12:08.577 INFO:teuthology.orchestra.run.smithi179.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-07-14T11:12:08.577 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-07-14T11:12:08.578 INFO:teuthology.orchestra.run.smithi179.stdout: osd default data pool replay window = 5 2023-07-14T11:12:08.578 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-07-14T11:12:08.578 INFO:teuthology.orchestra.run.smithi179.stdout: mon allow pool delete = true 2023-07-14T11:12:08.578 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-07-14T11:12:08.578 INFO:teuthology.orchestra.run.smithi179.stdout: mon cluster log file level = debug 2023-07-14T11:12:08.578 INFO:teuthology.orchestra.run.smithi179.stdout: debug asserts on shutdown = true 2023-07-14T11:12:08.578 INFO:teuthology.orchestra.run.smithi179.stdout: mon health detail to clog = false 2023-07-14T11:12:08.579 INFO:teuthology.orchestra.run.smithi179.stdout: mon host = "172.21.15.84,172.21.15.179,[v2:172.21.15.179:3301,v1:172.21.15.179:6790]" 2023-07-14T11:12:08.579 INFO:teuthology.orchestra.run.smithi179.stdout: ms die on skipped message = False 2023-07-14T11:12:08.579 INFO:teuthology.orchestra.run.smithi179.stdout: fsid = 3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f 2023-07-14T11:12:08.579 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-07-14T11:12:08.579 INFO:teuthology.orchestra.run.smithi179.stdout:[osd] 2023-07-14T11:12:08.579 INFO:teuthology.orchestra.run.smithi179.stdout: osd journal size = 100 2023-07-14T11:12:08.579 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-07-14T11:12:08.579 INFO:teuthology.orchestra.run.smithi179.stdout: osd scrub load threshold = 5.0 2023-07-14T11:12:08.580 INFO:teuthology.orchestra.run.smithi179.stdout: osd scrub max interval = 600 2023-07-14T11:12:08.580 INFO:teuthology.orchestra.run.smithi179.stdout: osd mclock profile = high_recovery_ops 2023-07-14T11:12:08.580 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-07-14T11:12:08.580 INFO:teuthology.orchestra.run.smithi179.stdout: osd recover clone overlap = true 2023-07-14T11:12:08.580 INFO:teuthology.orchestra.run.smithi179.stdout: osd recovery max chunk = 1048576 2023-07-14T11:12:08.580 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-07-14T11:12:08.580 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug shutdown = true 2023-07-14T11:12:08.580 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug op order = true 2023-07-14T11:12:08.581 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug verify stray on activate = true 2023-07-14T11:12:08.581 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-07-14T11:12:08.581 INFO:teuthology.orchestra.run.smithi179.stdout: osd open classes on start = true 2023-07-14T11:12:08.581 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug pg log writeout = true 2023-07-14T11:12:08.581 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-07-14T11:12:08.581 INFO:teuthology.orchestra.run.smithi179.stdout: osd deep scrub update digest min age = 30 2023-07-14T11:12:08.581 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-07-14T11:12:08.581 INFO:teuthology.orchestra.run.smithi179.stdout: osd map max advance = 10 2023-07-14T11:12:08.582 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-07-14T11:12:08.582 INFO:teuthology.orchestra.run.smithi179.stdout: journal zero on create = true 2023-07-14T11:12:08.582 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-07-14T11:12:08.582 INFO:teuthology.orchestra.run.smithi179.stdout: filestore ondisk finisher threads = 3 2023-07-14T11:12:08.582 INFO:teuthology.orchestra.run.smithi179.stdout: filestore apply finisher threads = 3 2023-07-14T11:12:08.582 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-07-14T11:12:08.582 INFO:teuthology.orchestra.run.smithi179.stdout: bdev debug aio = true 2023-07-14T11:12:08.582 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug misdirected ops = true 2023-07-14T11:12:08.583 INFO:teuthology.orchestra.run.smithi179.stdout: bdev async discard = True 2023-07-14T11:12:08.583 INFO:teuthology.orchestra.run.smithi179.stdout: bdev enable discard = True 2023-07-14T11:12:08.583 INFO:teuthology.orchestra.run.smithi179.stdout: bluestore allocator = bitmap 2023-07-14T11:12:08.583 INFO:teuthology.orchestra.run.smithi179.stdout: bluestore block size = 96636764160 2023-07-14T11:12:08.583 INFO:teuthology.orchestra.run.smithi179.stdout: bluestore fsck on mount = True 2023-07-14T11:12:08.583 INFO:teuthology.orchestra.run.smithi179.stdout: debug bluefs = 1/20 2023-07-14T11:12:08.583 INFO:teuthology.orchestra.run.smithi179.stdout: debug bluestore = 1/20 2023-07-14T11:12:08.583 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2023-07-14T11:12:08.584 INFO:teuthology.orchestra.run.smithi179.stdout: debug osd = 20 2023-07-14T11:12:08.584 INFO:teuthology.orchestra.run.smithi179.stdout: debug rocksdb = 4/10 2023-07-14T11:12:08.584 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd backfillfull_ratio = 0.85 2023-07-14T11:12:08.584 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd full ratio = 0.9 2023-07-14T11:12:08.584 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd nearfull ratio = 0.8 2023-07-14T11:12:08.584 INFO:teuthology.orchestra.run.smithi179.stdout: osd failsafe full ratio = 0.95 2023-07-14T11:12:08.584 INFO:teuthology.orchestra.run.smithi179.stdout: osd objectstore = bluestore 2023-07-14T11:12:08.584 INFO:teuthology.orchestra.run.smithi179.stdout: osd op complaint time = 180 2023-07-14T11:12:08.585 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-07-14T11:12:08.585 INFO:teuthology.orchestra.run.smithi179.stdout:[mgr] 2023-07-14T11:12:08.585 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2023-07-14T11:12:08.585 INFO:teuthology.orchestra.run.smithi179.stdout: debug mgr = 20 2023-07-14T11:12:08.585 INFO:teuthology.orchestra.run.smithi179.stdout: debug mon = 20 2023-07-14T11:12:08.585 INFO:teuthology.orchestra.run.smithi179.stdout: debug auth = 20 2023-07-14T11:12:08.585 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min pgs per osd = 4 2023-07-14T11:12:08.585 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min bytes per osd = 10 2023-07-14T11:12:08.586 INFO:teuthology.orchestra.run.smithi179.stdout: mgr/telemetry/nag = false 2023-07-14T11:12:08.586 INFO:teuthology.orchestra.run.smithi179.stdout: debug client = 20 2023-07-14T11:12:08.586 INFO:teuthology.orchestra.run.smithi179.stdout: debug finisher = 20 2023-07-14T11:12:08.586 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-07-14T11:12:08.586 INFO:teuthology.orchestra.run.smithi179.stdout:[mon] 2023-07-14T11:12:08.586 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2023-07-14T11:12:08.586 INFO:teuthology.orchestra.run.smithi179.stdout: debug mon = 20 2023-07-14T11:12:08.586 INFO:teuthology.orchestra.run.smithi179.stdout: debug paxos = 20 2023-07-14T11:12:08.587 INFO:teuthology.orchestra.run.smithi179.stdout: debug auth = 20 2023-07-14T11:12:08.587 INFO:teuthology.orchestra.run.smithi179.stdout: mon data avail warn = 5 2023-07-14T11:12:08.587 INFO:teuthology.orchestra.run.smithi179.stdout: mon mgr mkfs grace = 240 2023-07-14T11:12:08.587 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min pgs per osd = 4 2023-07-14T11:12:08.587 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd reporter subtree level = osd 2023-07-14T11:12:08.587 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd prime pg temp = true 2023-07-14T11:12:08.587 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min bytes per osd = 10 2023-07-14T11:12:08.587 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-07-14T11:12:08.588 INFO:teuthology.orchestra.run.smithi179.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-07-14T11:12:08.588 INFO:teuthology.orchestra.run.smithi179.stdout: auth mon ticket ttl = 660 # 11m 2023-07-14T11:12:08.588 INFO:teuthology.orchestra.run.smithi179.stdout: auth service ticket ttl = 240 # 4m 2023-07-14T11:12:08.588 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-07-14T11:12:08.588 INFO:teuthology.orchestra.run.smithi179.stdout: # don't complain about insecure global_id in the test suite 2023-07-14T11:12:08.588 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-07-14T11:12:08.588 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-07-14T11:12:08.589 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-07-14T11:12:08.589 INFO:teuthology.orchestra.run.smithi179.stdout: # 1m isn't quite enough 2023-07-14T11:12:08.589 INFO:teuthology.orchestra.run.smithi179.stdout: mon_down_mkfs_grace = 2m 2023-07-14T11:12:08.589 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-07-14T11:12:08.589 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_filestore_osds = false 2023-07-14T11:12:08.589 INFO:teuthology.orchestra.run.smithi179.stdout: mon op complaint time = 120 2023-07-14T11:12:08.589 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-07-14T11:12:08.589 INFO:teuthology.orchestra.run.smithi179.stdout:[client] 2023-07-14T11:12:08.590 INFO:teuthology.orchestra.run.smithi179.stdout: rgw cache enabled = true 2023-07-14T11:12:08.590 INFO:teuthology.orchestra.run.smithi179.stdout: rgw enable ops log = true 2023-07-14T11:12:08.590 INFO:teuthology.orchestra.run.smithi179.stdout: rgw enable usage log = true 2023-07-14T11:12:08.590 INFO:teuthology.orchestra.run.smithi179.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-07-14T11:12:08.590 INFO:teuthology.orchestra.run.smithi179.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-07-14T11:12:08.590 INFO:teuthology.orchestra.run.smithi179.stdout: client mount timeout = 600 2023-07-14T11:12:08.590 INFO:teuthology.orchestra.run.smithi179.stdout: debug client = 20 2023-07-14T11:12:08.590 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2023-07-14T11:12:08.591 INFO:teuthology.orchestra.run.smithi179.stdout: pid file = "" 2023-07-14T11:12:08.591 INFO:teuthology.orchestra.run.smithi179.stdout: rados mon op timeout = 900 2023-07-14T11:12:08.591 INFO:teuthology.orchestra.run.smithi179.stdout: rados osd op timeout = 900 2023-07-14T11:12:08.591 INFO:teuthology.orchestra.run.smithi179.stdout:[mon.a] 2023-07-14T11:12:08.591 INFO:teuthology.orchestra.run.smithi179.stdout:[mon.b] 2023-07-14T11:12:08.591 INFO:teuthology.orchestra.run.smithi179.stdout:[mon.c] 2023-07-14T11:12:08.591 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.a] 2023-07-14T11:12:08.591 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.c] 2023-07-14T11:12:08.592 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.b] 2023-07-14T11:12:08.592 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.d] 2023-07-14T11:12:08.592 INFO:teuthology.orchestra.run.smithi179.stdout:[mds] 2023-07-14T11:12:08.592 INFO:teuthology.orchestra.run.smithi179.stdout: debug mds = 20 2023-07-14T11:12:08.592 INFO:teuthology.orchestra.run.smithi179.stdout: debug mds balancer = 20 2023-07-14T11:12:08.592 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2023-07-14T11:12:08.592 INFO:teuthology.orchestra.run.smithi179.stdout: mds debug frag = True 2023-07-14T11:12:08.592 INFO:teuthology.orchestra.run.smithi179.stdout: mds debug scatterstat = True 2023-07-14T11:12:08.593 INFO:teuthology.orchestra.run.smithi179.stdout: mds op complaint time = 180 2023-07-14T11:12:08.593 INFO:teuthology.orchestra.run.smithi179.stdout: mds verify scatter = True 2023-07-14T11:12:08.593 INFO:teuthology.orchestra.run.smithi179.stdout: osd op complaint time = 180 2023-07-14T11:12:08.593 INFO:teuthology.orchestra.run.smithi179.stdout: rados mon op timeout = 900 2023-07-14T11:12:08.593 INFO:teuthology.orchestra.run.smithi179.stdout: rados osd op timeout = 900 2023-07-14T11:12:08.594 INFO:tasks.ceph:Creating admin key on mon.a... 2023-07-14T11:12:08.595 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-07-14T11:12:08.708 INFO:tasks.ceph:Copying monmap to all nodes... 2023-07-14T11:12:08.708 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-14T11:12:08.709 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-07-14T11:12:08.755 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-14T11:12:08.755 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-07-14T11:12:08.842 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi084.front.sepia.ceph.com 2023-07-14T11:12:08.843 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-14T11:12:08.843 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/ceph/ceph.keyring 2023-07-14T11:12:08.843 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-14T11:12:08.978 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-14T11:12:08.978 DEBUG:teuthology.orchestra.run.smithi084:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-07-14T11:12:09.066 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi179.front.sepia.ceph.com 2023-07-14T11:12:09.066 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-07-14T11:12:09.067 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/etc/ceph/ceph.keyring 2023-07-14T11:12:09.067 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-14T11:12:09.162 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-07-14T11:12:09.162 DEBUG:teuthology.orchestra.run.smithi179:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-07-14T11:12:09.246 INFO:tasks.ceph:Setting up mon nodes... 2023-07-14T11:12:09.246 INFO:tasks.ceph:Setting up mgr nodes... 2023-07-14T11:12:09.246 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-07-14T11:12:09.373 INFO:teuthology.orchestra.run.smithi084.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-07-14T11:12:09.380 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-07-14T11:12:09.509 INFO:teuthology.orchestra.run.smithi179.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-07-14T11:12:09.516 INFO:tasks.ceph:Setting up mds nodes... 2023-07-14T11:12:09.516 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-07-14T11:12:09.641 INFO:teuthology.orchestra.run.smithi084.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-07-14T11:12:09.647 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-07-14T11:12:09.720 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-07-14T11:12:09.847 INFO:teuthology.orchestra.run.smithi084.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-07-14T11:12:09.853 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-07-14T11:12:09.923 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-07-14T11:12:10.045 INFO:teuthology.orchestra.run.smithi179.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-07-14T11:12:10.050 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-07-14T11:12:10.119 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-07-14T11:12:10.240 INFO:teuthology.orchestra.run.smithi179.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-07-14T11:12:10.245 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-07-14T11:12:10.313 INFO:tasks.ceph_client:Setting up client nodes... 2023-07-14T11:12:10.314 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-07-14T11:12:10.411 INFO:teuthology.orchestra.run.smithi084.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-07-14T11:12:10.441 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-07-14T11:12:10.537 INFO:teuthology.orchestra.run.smithi084.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-07-14T11:12:10.566 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-07-14T11:12:10.662 INFO:teuthology.orchestra.run.smithi179.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-07-14T11:12:10.693 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-07-14T11:12:10.788 INFO:teuthology.orchestra.run.smithi179.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-07-14T11:12:10.818 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-07-14T11:12:10.818 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi084.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi179.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-07-14T11:12:10.819 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-07-14T11:12:10.887 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-14T11:12:10.888 INFO:tasks.ceph:role: osd.0 2023-07-14T11:12:10.888 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi084.front.sepia.ceph.com 2023-07-14T11:12:10.888 DEBUG:teuthology.orchestra.run.smithi084:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-07-14T11:12:10.963 INFO:teuthology.orchestra.run.smithi084.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-07-14T11:12:10.964 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-14T11:12:10.964 INFO:teuthology.orchestra.run.smithi084.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-14T11:12:10.964 INFO:teuthology.orchestra.run.smithi084.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-14T11:12:10.964 INFO:teuthology.orchestra.run.smithi084.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-14T11:12:10.964 INFO:teuthology.orchestra.run.smithi084.stdout: = sunit=0 swidth=0 blks 2023-07-14T11:12:10.964 INFO:teuthology.orchestra.run.smithi084.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-14T11:12:10.964 INFO:teuthology.orchestra.run.smithi084.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-14T11:12:10.965 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-14T11:12:10.965 INFO:teuthology.orchestra.run.smithi084.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-14T11:12:11.394 INFO:teuthology.orchestra.run.smithi084.stdout:Discarding blocks...Done. 2023-07-14T11:12:11.397 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi084.front.sepia.ceph.com -o noatime 2023-07-14T11:12:11.398 DEBUG:teuthology.orchestra.run.smithi084:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-07-14T11:12:11.576 DEBUG:teuthology.orchestra.run.smithi084:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-07-14T11:12:11.653 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-07-14T11:12:11.722 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-14T11:12:11.722 INFO:tasks.ceph:role: osd.1 2023-07-14T11:12:11.723 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi084.front.sepia.ceph.com 2023-07-14T11:12:11.723 DEBUG:teuthology.orchestra.run.smithi084:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-07-14T11:12:11.798 INFO:teuthology.orchestra.run.smithi084.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-07-14T11:12:11.798 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-14T11:12:11.798 INFO:teuthology.orchestra.run.smithi084.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-14T11:12:11.798 INFO:teuthology.orchestra.run.smithi084.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-14T11:12:11.798 INFO:teuthology.orchestra.run.smithi084.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-14T11:12:11.798 INFO:teuthology.orchestra.run.smithi084.stdout: = sunit=0 swidth=0 blks 2023-07-14T11:12:11.799 INFO:teuthology.orchestra.run.smithi084.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-14T11:12:11.799 INFO:teuthology.orchestra.run.smithi084.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-14T11:12:11.799 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-14T11:12:11.799 INFO:teuthology.orchestra.run.smithi084.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-14T11:12:12.225 INFO:teuthology.orchestra.run.smithi084.stdout:Discarding blocks...Done. 2023-07-14T11:12:12.228 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi084.front.sepia.ceph.com -o noatime 2023-07-14T11:12:12.229 DEBUG:teuthology.orchestra.run.smithi084:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-07-14T11:12:12.372 DEBUG:teuthology.orchestra.run.smithi084:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-07-14T11:12:12.448 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-07-14T11:12:12.515 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-14T11:12:12.516 INFO:tasks.ceph:role: osd.2 2023-07-14T11:12:12.516 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi084.front.sepia.ceph.com 2023-07-14T11:12:12.516 DEBUG:teuthology.orchestra.run.smithi084:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-07-14T11:12:12.592 INFO:teuthology.orchestra.run.smithi084.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-07-14T11:12:12.593 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-14T11:12:12.593 INFO:teuthology.orchestra.run.smithi084.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-14T11:12:12.593 INFO:teuthology.orchestra.run.smithi084.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-14T11:12:12.593 INFO:teuthology.orchestra.run.smithi084.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-14T11:12:12.593 INFO:teuthology.orchestra.run.smithi084.stdout: = sunit=0 swidth=0 blks 2023-07-14T11:12:12.593 INFO:teuthology.orchestra.run.smithi084.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-14T11:12:12.593 INFO:teuthology.orchestra.run.smithi084.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-14T11:12:12.593 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-14T11:12:12.594 INFO:teuthology.orchestra.run.smithi084.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-14T11:12:13.033 INFO:teuthology.orchestra.run.smithi084.stdout:Discarding blocks...Done. 2023-07-14T11:12:13.036 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi084.front.sepia.ceph.com -o noatime 2023-07-14T11:12:13.037 DEBUG:teuthology.orchestra.run.smithi084:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-07-14T11:12:13.196 DEBUG:teuthology.orchestra.run.smithi084:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-07-14T11:12:13.271 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-07-14T11:12:13.340 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-14T11:12:13.340 INFO:tasks.ceph:role: osd.3 2023-07-14T11:12:13.341 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi084.front.sepia.ceph.com 2023-07-14T11:12:13.341 DEBUG:teuthology.orchestra.run.smithi084:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-07-14T11:12:13.416 INFO:teuthology.orchestra.run.smithi084.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-07-14T11:12:13.417 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-14T11:12:13.417 INFO:teuthology.orchestra.run.smithi084.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-14T11:12:13.417 INFO:teuthology.orchestra.run.smithi084.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-14T11:12:13.417 INFO:teuthology.orchestra.run.smithi084.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-14T11:12:13.417 INFO:teuthology.orchestra.run.smithi084.stdout: = sunit=0 swidth=0 blks 2023-07-14T11:12:13.417 INFO:teuthology.orchestra.run.smithi084.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-14T11:12:13.418 INFO:teuthology.orchestra.run.smithi084.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-14T11:12:13.418 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-14T11:12:13.418 INFO:teuthology.orchestra.run.smithi084.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-14T11:12:13.857 INFO:teuthology.orchestra.run.smithi084.stdout:Discarding blocks...Done. 2023-07-14T11:12:13.860 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi084.front.sepia.ceph.com -o noatime 2023-07-14T11:12:13.860 DEBUG:teuthology.orchestra.run.smithi084:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-07-14T11:12:14.009 DEBUG:teuthology.orchestra.run.smithi084:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-07-14T11:12:14.083 DEBUG:teuthology.orchestra.run.smithi084:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-14T11:12:14.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:14.203+0000 7fa567645640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-07-14T11:12:14.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:14.203+0000 7fa567645640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-07-14T11:12:14.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:14.203+0000 7fa567645640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-14T11:12:14.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:14.203+0000 7fa567645640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-14T11:12:14.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:14.203+0000 7fa567645640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-14T11:12:14.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:14.205+0000 7fa567645640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-07-14T11:12:17.099 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-07-14T11:12:17.169 DEBUG:teuthology.orchestra.run.smithi084:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-14T11:12:17.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:17.271+0000 7ff03ac08640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-07-14T11:12:17.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:17.272+0000 7ff03ac08640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-07-14T11:12:17.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:17.272+0000 7ff03ac08640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-14T11:12:17.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:17.272+0000 7ff03ac08640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-14T11:12:17.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:17.272+0000 7ff03ac08640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-14T11:12:17.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:17.273+0000 7ff03ac08640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-07-14T11:12:20.160 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-07-14T11:12:20.231 DEBUG:teuthology.orchestra.run.smithi084:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-14T11:12:20.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:20.334+0000 7f4dba18f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-07-14T11:12:20.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:20.334+0000 7f4dba18f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-07-14T11:12:20.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:20.334+0000 7f4dba18f640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-14T11:12:20.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:20.334+0000 7f4dba18f640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-14T11:12:20.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:20.334+0000 7f4dba18f640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-14T11:12:20.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:20.336+0000 7f4dba18f640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-07-14T11:12:23.222 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-07-14T11:12:23.291 DEBUG:teuthology.orchestra.run.smithi084:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-14T11:12:23.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:23.395+0000 7fd5cd31a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-07-14T11:12:23.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:23.395+0000 7fd5cd31a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-07-14T11:12:23.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:23.396+0000 7fd5cd31a640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-14T11:12:23.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:23.396+0000 7fd5cd31a640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-14T11:12:23.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:23.396+0000 7fd5cd31a640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-14T11:12:23.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:23.397+0000 7fd5cd31a640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-07-14T11:12:26.272 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-07-14T11:12:26.341 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-07-14T11:12:26.416 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-14T11:12:26.417 INFO:tasks.ceph:role: osd.4 2023-07-14T11:12:26.417 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi179.front.sepia.ceph.com 2023-07-14T11:12:26.417 DEBUG:teuthology.orchestra.run.smithi179:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-07-14T11:12:26.495 INFO:teuthology.orchestra.run.smithi179.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-07-14T11:12:26.496 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-14T11:12:26.496 INFO:teuthology.orchestra.run.smithi179.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-14T11:12:26.496 INFO:teuthology.orchestra.run.smithi179.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-14T11:12:26.496 INFO:teuthology.orchestra.run.smithi179.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-14T11:12:26.496 INFO:teuthology.orchestra.run.smithi179.stdout: = sunit=0 swidth=0 blks 2023-07-14T11:12:26.496 INFO:teuthology.orchestra.run.smithi179.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-14T11:12:26.496 INFO:teuthology.orchestra.run.smithi179.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-14T11:12:26.497 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-14T11:12:26.497 INFO:teuthology.orchestra.run.smithi179.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-14T11:12:26.936 INFO:teuthology.orchestra.run.smithi179.stdout:Discarding blocks...Done. 2023-07-14T11:12:26.940 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi179.front.sepia.ceph.com -o noatime 2023-07-14T11:12:26.940 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-07-14T11:12:27.123 DEBUG:teuthology.orchestra.run.smithi179:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-07-14T11:12:27.202 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-07-14T11:12:27.272 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-14T11:12:27.272 INFO:tasks.ceph:role: osd.5 2023-07-14T11:12:27.272 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi179.front.sepia.ceph.com 2023-07-14T11:12:27.273 DEBUG:teuthology.orchestra.run.smithi179:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-07-14T11:12:27.348 INFO:teuthology.orchestra.run.smithi179.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-07-14T11:12:27.349 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-14T11:12:27.349 INFO:teuthology.orchestra.run.smithi179.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-14T11:12:27.349 INFO:teuthology.orchestra.run.smithi179.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-14T11:12:27.349 INFO:teuthology.orchestra.run.smithi179.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-14T11:12:27.349 INFO:teuthology.orchestra.run.smithi179.stdout: = sunit=0 swidth=0 blks 2023-07-14T11:12:27.350 INFO:teuthology.orchestra.run.smithi179.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-14T11:12:27.350 INFO:teuthology.orchestra.run.smithi179.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-14T11:12:27.350 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-14T11:12:27.350 INFO:teuthology.orchestra.run.smithi179.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-14T11:12:27.755 INFO:teuthology.orchestra.run.smithi179.stdout:Discarding blocks...Done. 2023-07-14T11:12:27.758 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi179.front.sepia.ceph.com -o noatime 2023-07-14T11:12:27.759 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-07-14T11:12:27.898 DEBUG:teuthology.orchestra.run.smithi179:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-07-14T11:12:27.973 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-07-14T11:12:28.042 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-14T11:12:28.042 INFO:tasks.ceph:role: osd.6 2023-07-14T11:12:28.043 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi179.front.sepia.ceph.com 2023-07-14T11:12:28.043 DEBUG:teuthology.orchestra.run.smithi179:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-07-14T11:12:28.119 INFO:teuthology.orchestra.run.smithi179.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-07-14T11:12:28.120 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-14T11:12:28.120 INFO:teuthology.orchestra.run.smithi179.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-14T11:12:28.120 INFO:teuthology.orchestra.run.smithi179.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-14T11:12:28.120 INFO:teuthology.orchestra.run.smithi179.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-14T11:12:28.120 INFO:teuthology.orchestra.run.smithi179.stdout: = sunit=0 swidth=0 blks 2023-07-14T11:12:28.121 INFO:teuthology.orchestra.run.smithi179.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-14T11:12:28.121 INFO:teuthology.orchestra.run.smithi179.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-14T11:12:28.121 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-14T11:12:28.121 INFO:teuthology.orchestra.run.smithi179.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-14T11:12:28.561 INFO:teuthology.orchestra.run.smithi179.stdout:Discarding blocks...Done. 2023-07-14T11:12:28.566 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi179.front.sepia.ceph.com -o noatime 2023-07-14T11:12:28.566 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-07-14T11:12:28.746 DEBUG:teuthology.orchestra.run.smithi179:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-07-14T11:12:28.822 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-07-14T11:12:28.890 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-14T11:12:28.891 INFO:tasks.ceph:role: osd.7 2023-07-14T11:12:28.891 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi179.front.sepia.ceph.com 2023-07-14T11:12:28.891 DEBUG:teuthology.orchestra.run.smithi179:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-07-14T11:12:28.967 INFO:teuthology.orchestra.run.smithi179.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-07-14T11:12:28.967 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-14T11:12:28.967 INFO:teuthology.orchestra.run.smithi179.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-14T11:12:28.968 INFO:teuthology.orchestra.run.smithi179.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-14T11:12:28.968 INFO:teuthology.orchestra.run.smithi179.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-14T11:12:28.968 INFO:teuthology.orchestra.run.smithi179.stdout: = sunit=0 swidth=0 blks 2023-07-14T11:12:28.968 INFO:teuthology.orchestra.run.smithi179.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-14T11:12:28.968 INFO:teuthology.orchestra.run.smithi179.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-14T11:12:28.968 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-14T11:12:28.968 INFO:teuthology.orchestra.run.smithi179.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-14T11:12:29.404 INFO:teuthology.orchestra.run.smithi179.stdout:Discarding blocks...Done. 2023-07-14T11:12:29.408 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi179.front.sepia.ceph.com -o noatime 2023-07-14T11:12:29.408 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-07-14T11:12:29.546 DEBUG:teuthology.orchestra.run.smithi179:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-07-14T11:12:29.620 DEBUG:teuthology.orchestra.run.smithi179:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-14T11:12:29.740 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:29.738+0000 7f0799be3640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-07-14T11:12:29.741 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:29.738+0000 7f0799be3640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-07-14T11:12:29.741 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:29.738+0000 7f0799be3640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-14T11:12:29.741 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:29.738+0000 7f0799be3640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-14T11:12:29.741 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:29.738+0000 7f0799be3640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-14T11:12:29.742 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:29.740+0000 7f0799be3640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-07-14T11:12:32.619 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-07-14T11:12:32.689 DEBUG:teuthology.orchestra.run.smithi179:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-14T11:12:32.793 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:32.791+0000 7eff9fb77640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-07-14T11:12:32.794 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:32.792+0000 7eff9fb77640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-07-14T11:12:32.794 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:32.792+0000 7eff9fb77640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-14T11:12:32.794 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:32.792+0000 7eff9fb77640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-14T11:12:32.794 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:32.792+0000 7eff9fb77640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-14T11:12:32.795 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:32.794+0000 7eff9fb77640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-07-14T11:12:35.678 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-07-14T11:12:35.752 DEBUG:teuthology.orchestra.run.smithi179:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-14T11:12:35.858 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:35.856+0000 7fe7b4920640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-07-14T11:12:35.859 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:35.857+0000 7fe7b4920640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-07-14T11:12:35.859 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:35.857+0000 7fe7b4920640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-14T11:12:35.859 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:35.857+0000 7fe7b4920640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-14T11:12:35.859 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:35.857+0000 7fe7b4920640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-14T11:12:35.860 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:35.858+0000 7fe7b4920640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-07-14T11:12:36.098 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T11:12:36.103 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T11:12:38.736 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-07-14T11:12:38.808 DEBUG:teuthology.orchestra.run.smithi179:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-14T11:12:38.913 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:38.911+0000 7efc3903f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-07-14T11:12:38.914 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:38.912+0000 7efc3903f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-07-14T11:12:38.914 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:38.912+0000 7efc3903f640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-14T11:12:38.914 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:38.912+0000 7efc3903f640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-14T11:12:38.914 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:38.912+0000 7efc3903f640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-14T11:12:38.915 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:38.914+0000 7efc3903f640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-07-14T11:12:41.799 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-07-14T11:12:41.871 INFO:tasks.ceph:Reading keys from all nodes... 2023-07-14T11:12:41.871 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-14T11:12:41.871 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-07-14T11:12:41.946 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-14T11:12:41.947 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-07-14T11:12:42.016 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-14T11:12:42.016 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-07-14T11:12:42.126 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-14T11:12:42.126 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-07-14T11:12:42.234 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-14T11:12:42.235 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-07-14T11:12:42.342 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-14T11:12:42.342 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-07-14T11:12:42.449 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-14T11:12:42.449 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-07-14T11:12:42.556 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-07-14T11:12:42.556 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-07-14T11:12:42.631 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-07-14T11:12:42.632 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-07-14T11:12:42.701 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-07-14T11:12:42.702 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-07-14T11:12:42.810 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-07-14T11:12:42.810 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-07-14T11:12:42.918 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-07-14T11:12:42.919 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-07-14T11:12:43.026 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-07-14T11:12:43.027 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-07-14T11:12:43.134 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-07-14T11:12:43.135 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-07-14T11:12:43.242 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-14T11:12:43.243 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-07-14T11:12:43.290 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-14T11:12:43.290 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-07-14T11:12:43.376 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-07-14T11:12:43.377 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-07-14T11:12:43.422 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-07-14T11:12:43.422 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-07-14T11:12:43.507 INFO:tasks.ceph:Adding keys to all mons... 2023-07-14T11:12:43.507 DEBUG:teuthology.orchestra.run.smithi084:> sudo tee -a /etc/ceph/ceph.keyring 2023-07-14T11:12:43.511 DEBUG:teuthology.orchestra.run.smithi179:> sudo tee -a /etc/ceph/ceph.keyring 2023-07-14T11:12:43.572 INFO:teuthology.orchestra.run.smithi084.stdout:[mgr.y] 2023-07-14T11:12:43.573 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCJLbFk5dM1FhAAJWbB+GogsfcSkaBdHrFg4A== 2023-07-14T11:12:43.573 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.a] 2023-07-14T11:12:43.573 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCJLbFkprwsJhAAIZa03ewirqLtc0mn7ki6Vw== 2023-07-14T11:12:43.573 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.c] 2023-07-14T11:12:43.573 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCJLbFk9MZ4MhAAY2CpAoK7Bx7NyoccpK7MLA== 2023-07-14T11:12:43.573 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.0] 2023-07-14T11:12:43.573 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCOLbFkd18mDBAA2tneRYzoJkGwIZNDW6+Z7w== 2023-07-14T11:12:43.574 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.1] 2023-07-14T11:12:43.574 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCRLbFkwBlAEBAAoEG62Dam3KHra4oNXBGyfw== 2023-07-14T11:12:43.574 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.2] 2023-07-14T11:12:43.574 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCULbFkCln2ExAAKM+sAwMtcH6yEbNUqHbN4Q== 2023-07-14T11:12:43.574 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.3] 2023-07-14T11:12:43.574 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCXLbFk0ZGgFxAAgOEUoX5jqzic6bOxtG7qSw== 2023-07-14T11:12:43.574 INFO:teuthology.orchestra.run.smithi084.stdout:[mgr.x] 2023-07-14T11:12:43.575 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCJLbFk28xTHhAAAlmm5bW9VTtgE+OujO+G2w== 2023-07-14T11:12:43.575 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.b] 2023-07-14T11:12:43.575 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCKLbFkfYOoAhAAQcpDkBRXNSDyfnZp1A/BJw== 2023-07-14T11:12:43.575 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.d] 2023-07-14T11:12:43.575 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCKLbFkfxxFDhAAFPvGUrg0RW1nYTAdACvEAA== 2023-07-14T11:12:43.575 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.4] 2023-07-14T11:12:43.575 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCdLbFknOESLBAA9usIfRfkbbLiMOCvUR+pXQ== 2023-07-14T11:12:43.575 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.5] 2023-07-14T11:12:43.576 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCgLbFk+Rk/LxAAGqk3ueTaGaSINPuxoW53Gw== 2023-07-14T11:12:43.576 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.6] 2023-07-14T11:12:43.576 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCjLbFk1/QfMxAABnWxus7LXfn7R0iwMVTWiA== 2023-07-14T11:12:43.576 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.7] 2023-07-14T11:12:43.576 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCmLbFkNnhmNhAAz85GY1Sb1NuKINJCyWpPGQ== 2023-07-14T11:12:43.576 INFO:teuthology.orchestra.run.smithi084.stdout:[client.0] 2023-07-14T11:12:43.576 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCKLbFkKSl5GBAAwPK4Zs6+gv/6YKHh4JI3WA== 2023-07-14T11:12:43.577 INFO:teuthology.orchestra.run.smithi084.stdout:[client.2] 2023-07-14T11:12:43.577 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCKLbFkLhv6HxAACUfTJK618qRsXETPJagZXQ== 2023-07-14T11:12:43.577 INFO:teuthology.orchestra.run.smithi084.stdout:[client.1] 2023-07-14T11:12:43.577 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCKLbFkieNzJxAARri6UfCWdcXA3NpeFfvILw== 2023-07-14T11:12:43.577 INFO:teuthology.orchestra.run.smithi084.stdout:[client.3] 2023-07-14T11:12:43.577 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCKLbFka9HxLhAA4OsQY/t7A2FIYLEyYgJ19Q== 2023-07-14T11:12:43.612 INFO:teuthology.orchestra.run.smithi179.stdout:[mgr.y] 2023-07-14T11:12:43.612 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQCJLbFk5dM1FhAAJWbB+GogsfcSkaBdHrFg4A== 2023-07-14T11:12:43.612 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.a] 2023-07-14T11:12:43.612 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQCJLbFkprwsJhAAIZa03ewirqLtc0mn7ki6Vw== 2023-07-14T11:12:43.612 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.c] 2023-07-14T11:12:43.612 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQCJLbFk9MZ4MhAAY2CpAoK7Bx7NyoccpK7MLA== 2023-07-14T11:12:43.613 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.0] 2023-07-14T11:12:43.613 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQCOLbFkd18mDBAA2tneRYzoJkGwIZNDW6+Z7w== 2023-07-14T11:12:43.613 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.1] 2023-07-14T11:12:43.613 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQCRLbFkwBlAEBAAoEG62Dam3KHra4oNXBGyfw== 2023-07-14T11:12:43.613 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.2] 2023-07-14T11:12:43.613 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQCULbFkCln2ExAAKM+sAwMtcH6yEbNUqHbN4Q== 2023-07-14T11:12:43.613 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.3] 2023-07-14T11:12:43.614 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQCXLbFk0ZGgFxAAgOEUoX5jqzic6bOxtG7qSw== 2023-07-14T11:12:43.614 INFO:teuthology.orchestra.run.smithi179.stdout:[mgr.x] 2023-07-14T11:12:43.614 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQCJLbFk28xTHhAAAlmm5bW9VTtgE+OujO+G2w== 2023-07-14T11:12:43.614 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.b] 2023-07-14T11:12:43.614 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQCKLbFkfYOoAhAAQcpDkBRXNSDyfnZp1A/BJw== 2023-07-14T11:12:43.614 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.d] 2023-07-14T11:12:43.614 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQCKLbFkfxxFDhAAFPvGUrg0RW1nYTAdACvEAA== 2023-07-14T11:12:43.615 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.4] 2023-07-14T11:12:43.615 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQCdLbFknOESLBAA9usIfRfkbbLiMOCvUR+pXQ== 2023-07-14T11:12:43.615 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.5] 2023-07-14T11:12:43.615 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQCgLbFk+Rk/LxAAGqk3ueTaGaSINPuxoW53Gw== 2023-07-14T11:12:43.615 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.6] 2023-07-14T11:12:43.616 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQCjLbFk1/QfMxAABnWxus7LXfn7R0iwMVTWiA== 2023-07-14T11:12:43.616 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.7] 2023-07-14T11:12:43.616 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQCmLbFkNnhmNhAAz85GY1Sb1NuKINJCyWpPGQ== 2023-07-14T11:12:43.617 INFO:teuthology.orchestra.run.smithi179.stdout:[client.0] 2023-07-14T11:12:43.617 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQCKLbFkKSl5GBAAwPK4Zs6+gv/6YKHh4JI3WA== 2023-07-14T11:12:43.617 INFO:teuthology.orchestra.run.smithi179.stdout:[client.2] 2023-07-14T11:12:43.617 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQCKLbFkLhv6HxAACUfTJK618qRsXETPJagZXQ== 2023-07-14T11:12:43.618 INFO:teuthology.orchestra.run.smithi179.stdout:[client.1] 2023-07-14T11:12:43.618 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQCKLbFkieNzJxAARri6UfCWdcXA3NpeFfvILw== 2023-07-14T11:12:43.618 INFO:teuthology.orchestra.run.smithi179.stdout:[client.3] 2023-07-14T11:12:43.618 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQCKLbFka9HxLhAA4OsQY/t7A2FIYLEyYgJ19Q== 2023-07-14T11:12:43.620 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-14T11:12:43.625 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-14T11:12:43.766 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-14T11:12:43.771 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-14T11:12:43.883 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-14T11:12:43.887 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-14T11:12:43.997 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-14T11:12:44.001 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-14T11:12:44.109 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-14T11:12:44.114 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-14T11:12:44.221 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-14T11:12:44.225 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-14T11:12:44.332 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-14T11:12:44.336 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-14T11:12:44.443 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-14T11:12:44.447 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-14T11:12:44.555 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-14T11:12:44.560 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-14T11:12:44.671 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-14T11:12:44.675 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-14T11:12:44.786 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-14T11:12:44.791 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-14T11:12:44.900 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-14T11:12:44.905 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-14T11:12:45.013 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-14T11:12:45.018 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-14T11:12:45.126 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-14T11:12:45.130 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-14T11:12:45.237 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-14T11:12:45.241 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-14T11:12:45.351 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-14T11:12:45.356 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-14T11:12:45.466 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-14T11:12:45.471 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-14T11:12:45.582 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-14T11:12:45.586 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-14T11:12:45.696 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-07-14T11:12:45.697 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-07-14T11:12:45.765 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-14T11:12:45.887 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-07-14T11:12:45.955 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-07-14T11:12:46.025 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-14T11:12:46.147 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-07-14T11:12:46.217 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-07-14T11:12:46.286 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-14T11:12:46.408 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-07-14T11:12:46.478 DEBUG:teuthology.orchestra.run.smithi084:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-07-14T11:12:46.483 DEBUG:teuthology.orchestra.run.smithi179:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-07-14T11:12:46.527 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-07-14T11:12:46.528 INFO:tasks.ceph.mon.a:Restarting daemon 2023-07-14T11:12:46.529 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-07-14T11:12:46.569 INFO:tasks.ceph.mon.a:Started 2023-07-14T11:12:46.569 INFO:tasks.ceph.mon.b:Restarting daemon 2023-07-14T11:12:46.569 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-07-14T11:12:46.574 INFO:tasks.ceph.mon.b:Started 2023-07-14T11:12:46.574 INFO:tasks.ceph.mon.c:Restarting daemon 2023-07-14T11:12:46.574 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-07-14T11:12:46.578 INFO:tasks.ceph.mon.c:Started 2023-07-14T11:12:46.578 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-07-14T11:12:46.579 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-07-14T11:12:46.579 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-07-14T11:12:46.584 INFO:tasks.ceph.mgr.y:Started 2023-07-14T11:12:46.584 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-07-14T11:12:46.584 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-07-14T11:12:46.588 INFO:tasks.ceph.mgr.x:Started 2023-07-14T11:12:46.589 INFO:tasks.ceph:Setting crush tunables to default 2023-07-14T11:12:46.589 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph osd crush tunables default 2023-07-14T11:12:46.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.783+0000 7f0838bff700 1 Processor -- start 2023-07-14T11:12:46.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.783+0000 7f0838bff700 1 -- start start 2023-07-14T11:12:46.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.785+0000 7f0838bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08340b8a60 0x7f08340b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:12:46.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.785+0000 7f0838bff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f08340b4530 0x7f08340d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:12:46.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.785+0000 7f0838bff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08340b8e30 con 0x7f08340d1050 2023-07-14T11:12:46.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.785+0000 7f0838bff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08340d14d0 con 0x7f08340b4530 2023-07-14T11:12:46.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.785+0000 7f0838bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08340b1e30 con 0x7f08340b8a60 2023-07-14T11:12:46.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.785+0000 7f082bfff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f08340b4530 0x7f08340d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:12:46.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.785+0000 7f082bfff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f08340b4530 0x7f08340d0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.84:57622/0 (socket says 172.21.15.84:57622) 2023-07-14T11:12:46.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.785+0000 7f082bfff700 1 -- 172.21.15.84:0/3836344593 learned_addr learned my addr 172.21.15.84:0/3836344593 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:12:46.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.785+0000 7f083259c700 1 --2- 172.21.15.84:0/3836344593 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08340b8a60 0x7f08340b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:12:46.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.785+0000 7f0832d9d700 1 --1- 172.21.15.84:0/3836344593 >> v1:172.21.15.179:6789/0 conn(0x7f08340d1050 0x7f08340b25d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.84:52424/0 (socket says 172.21.15.84:52424) 2023-07-14T11:12:46.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.785+0000 7f082bfff700 1 -- 172.21.15.84:0/3836344593 >> v2:172.21.15.179:3300/0 conn(0x7f08340b4530 msgr2=0x7f08340d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-07-14T11:12:46.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.785+0000 7f082bfff700 1 -- 172.21.15.84:0/3836344593 >> v2:172.21.15.179:3300/0 conn(0x7f08340b4530 msgr2=0x7f08340d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-14T11:12:46.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.785+0000 7f082bfff700 1 --2- 172.21.15.84:0/3836344593 >> v2:172.21.15.179:3300/0 conn(0x7f08340b4530 0x7f08340d0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-14T11:12:46.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.785+0000 7f082bfff700 1 --2- 172.21.15.84:0/3836344593 >> v2:172.21.15.179:3300/0 conn(0x7f08340b4530 0x7f08340d0b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T11:12:46.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.785+0000 7f083259c700 1 -- 172.21.15.84:0/3836344593 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08340b8a60 msgr2=0x7f08340b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-07-14T11:12:46.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.785+0000 7f083259c700 1 -- 172.21.15.84:0/3836344593 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08340b8a60 msgr2=0x7f08340b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-14T11:12:46.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.785+0000 7f083259c700 1 --2- 172.21.15.84:0/3836344593 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08340b8a60 0x7f08340b3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-14T11:12:46.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.785+0000 7f083259c700 1 --2- 172.21.15.84:0/3836344593 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08340b8a60 0x7f08340b3ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T11:12:46.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.978+0000 7f0831d9b700 1 -- 172.21.15.84:0/3836344593 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 107295178 0 0) 0x7f08340b8e30 con 0x7f08340d1050 2023-07-14T11:12:46.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.978+0000 7f0831d9b700 1 -- 172.21.15.84:0/3836344593 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08200035b0 con 0x7f08340d1050 2023-07-14T11:12:46.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.984+0000 7f0831d9b700 1 -- 172.21.15.84:0/3836344593 <== mon.1 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 472631619 0 0) 0x7f08200035b0 con 0x7f08340d1050 2023-07-14T11:12:46.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.984+0000 7f0831d9b700 1 -- 172.21.15.84:0/3836344593 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08340b8a60 msgr2=0x7f08340b3ff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-14T11:12:46.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.984+0000 7f0831d9b700 1 --2- 172.21.15.84:0/3836344593 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08340b8a60 0x7f08340b3ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:46.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.984+0000 7f0831d9b700 1 -- 172.21.15.84:0/3836344593 >> v2:172.21.15.179:3300/0 conn(0x7f08340b4530 msgr2=0x7f08340d0b10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-14T11:12:46.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.984+0000 7f0831d9b700 1 --2- 172.21.15.84:0/3836344593 >> v2:172.21.15.179:3300/0 conn(0x7f08340b4530 0x7f08340d0b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:46.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.984+0000 7f0831d9b700 1 -- 172.21.15.84:0/3836344593 --> v1:172.21.15.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08340afaa0 con 0x7f08340d1050 2023-07-14T11:12:46.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.984+0000 7f0831d9b700 1 -- 172.21.15.84:0/3836344593 <== mon.1 v1:172.21.15.179:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7f082c0019f0 con 0x7f08340d1050 2023-07-14T11:12:46.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.984+0000 7f0831d9b700 1 -- 172.21.15.84:0/3836344593 >> v1:172.21.15.179:6789/0 conn(0x7f08340d1050 legacy=0x7f08340b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:12:46.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.984+0000 7f0831d9b700 1 --2- 172.21.15.84:0/3836344593 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08340b8a60 0x7f0820003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:12:46.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.984+0000 7f0831d9b700 1 --2- 172.21.15.84:0/3836344593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0820004080 0x7f0820004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:12:46.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.984+0000 7f0831d9b700 1 --2- 172.21.15.84:0/3836344593 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0820004d90 0x7f0820005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:12:46.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.984+0000 7f0831d9b700 1 -- 172.21.15.84:0/3836344593 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08340d14d0 con 0x7f0820004080 2023-07-14T11:12:46.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.984+0000 7f0831d9b700 1 -- 172.21.15.84:0/3836344593 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08340b1e30 con 0x7f0820004d90 2023-07-14T11:12:46.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.984+0000 7f0831d9b700 1 -- 172.21.15.84:0/3836344593 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f082000bc00 con 0x7f08340b8a60 2023-07-14T11:12:46.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.984+0000 7f083259c700 1 --2- 172.21.15.84:0/3836344593 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08340b8a60 0x7f0820003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:12:46.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.984+0000 7f082bfff700 1 --2- 172.21.15.84:0/3836344593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0820004080 0x7f0820004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:12:46.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.984+0000 7f0832d9d700 1 --2- 172.21.15.84:0/3836344593 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0820004d90 0x7f0820005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:12:46.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.984+0000 7f083259c700 1 -- 172.21.15.84:0/3836344593 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0820004d90 msgr2=0x7f0820005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:12:46.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.984+0000 7f083259c700 1 --2- 172.21.15.84:0/3836344593 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0820004d90 0x7f0820005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:46.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.984+0000 7f083259c700 1 -- 172.21.15.84:0/3836344593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0820004080 msgr2=0x7f0820004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:12:46.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.984+0000 7f083259c700 1 --2- 172.21.15.84:0/3836344593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0820004080 0x7f0820004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:46.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.984+0000 7f083259c700 1 -- 172.21.15.84:0/3836344593 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08200035b0 con 0x7f08340b8a60 2023-07-14T11:12:46.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.985+0000 7f082bfff700 1 --2- 172.21.15.84:0/3836344593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0820004080 0x7f0820004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:12:46.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.985+0000 7f083259c700 1 --2- 172.21.15.84:0/3836344593 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08340b8a60 0x7f0820003a00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0824009860 tx=0x7f0820005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c58ebbfea578ee33 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:12:46.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.985+0000 7f0831d9b700 1 -- 172.21.15.84:0/3836344593 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f082400c070 con 0x7f08340b8a60 2023-07-14T11:12:46.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.985+0000 7f0831d9b700 1 -- 172.21.15.84:0/3836344593 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0824004020 con 0x7f08340b8a60 2023-07-14T11:12:46.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.985+0000 7f0831d9b700 1 -- 172.21.15.84:0/3836344593 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08240043b0 con 0x7f08340b8a60 2023-07-14T11:12:46.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.986+0000 7f0838bff700 1 -- 172.21.15.84:0/3836344593 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08340b8a60 msgr2=0x7f0820003a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:12:46.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.986+0000 7f0838bff700 1 --2- 172.21.15.84:0/3836344593 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08340b8a60 0x7f0820003a00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0824009860 tx=0x7f0820005880 comp rx=0 tx=0).stop 2023-07-14T11:12:46.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.986+0000 7f0832d9d700 1 -- 172.21.15.84:0/3836344593 reap_dead start 2023-07-14T11:12:46.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.986+0000 7f0838bff700 1 -- 172.21.15.84:0/3836344593 shutdown_connections 2023-07-14T11:12:46.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.986+0000 7f0838bff700 1 -- 172.21.15.84:0/3836344593 >> 172.21.15.84:0/3836344593 conn(0x7f083409c1b0 msgr2=0x7f08340d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:12:46.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.986+0000 7f0838bff700 1 -- 172.21.15.84:0/3836344593 shutdown_connections 2023-07-14T11:12:46.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.986+0000 7f0838bff700 1 -- 172.21.15.84:0/3836344593 wait complete. 2023-07-14T11:12:46.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.988+0000 7f0838bff700 1 Processor -- start 2023-07-14T11:12:46.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.988+0000 7f0838bff700 1 -- start start 2023-07-14T11:12:46.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.989+0000 7f0838bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08340b8a60 0x7f083415f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:12:46.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.989+0000 7f0838bff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08340ca010 0x7f083414f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:12:46.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.989+0000 7f0838bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08341e5fd0 0x7f08341e6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:12:46.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.989+0000 7f0838bff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08341e69b0 con 0x7f08340ca010 2023-07-14T11:12:46.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.989+0000 7f0838bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08340cbbf0 con 0x7f08341e5fd0 2023-07-14T11:12:46.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.989+0000 7f0838bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f083415fe80 con 0x7f08340b8a60 2023-07-14T11:12:46.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.990+0000 7f083259c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08340b8a60 0x7f083415f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:12:46.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.990+0000 7f082bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08340ca010 0x7f083414f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:12:46.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.990+0000 7f083259c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08340b8a60 0x7f083415f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.84:39970/0 (socket says 172.21.15.84:39970) 2023-07-14T11:12:46.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.990+0000 7f083259c700 1 -- 172.21.15.84:0/3626853769 learned_addr learned my addr 172.21.15.84:0/3626853769 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:12:46.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.990+0000 7f0832d9d700 1 --2- 172.21.15.84:0/3626853769 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08341e5fd0 0x7f08341e6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:12:46.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.990+0000 7f082bfff700 1 -- 172.21.15.84:0/3626853769 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08340b8a60 msgr2=0x7f083415f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:12:46.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.990+0000 7f082bfff700 1 --2- 172.21.15.84:0/3626853769 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08340b8a60 0x7f083415f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:46.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.990+0000 7f082bfff700 1 -- 172.21.15.84:0/3626853769 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08341e5fd0 msgr2=0x7f08341e6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:12:46.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.990+0000 7f082bfff700 1 --2- 172.21.15.84:0/3626853769 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08341e5fd0 0x7f08341e6470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:46.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.990+0000 7f082bfff700 1 -- 172.21.15.84:0/3626853769 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08340cb0e0 con 0x7f08340ca010 2023-07-14T11:12:46.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.991+0000 7f082bfff700 1 --2- 172.21.15.84:0/3626853769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08340ca010 0x7f083414f150 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f081c0116d0 tx=0x7f081c0119e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:12:46.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.991+0000 7f082affd700 1 -- 172.21.15.84:0/3626853769 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f081c00c070 con 0x7f08340ca010 2023-07-14T11:12:46.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.991+0000 7f082affd700 1 -- 172.21.15.84:0/3626853769 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f081c004220 con 0x7f08340ca010 2023-07-14T11:12:46.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.991+0000 7f082affd700 1 -- 172.21.15.84:0/3626853769 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f081c015730 con 0x7f08340ca010 2023-07-14T11:12:46.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.991+0000 7f0838bff700 1 -- 172.21.15.84:0/3626853769 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08340cb570 con 0x7f08340ca010 2023-07-14T11:12:46.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.991+0000 7f0838bff700 1 -- 172.21.15.84:0/3626853769 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08340ca7b0 con 0x7f08340ca010 2023-07-14T11:12:46.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.991+0000 7f082affd700 1 -- 172.21.15.84:0/3626853769 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f081c015890 con 0x7f08340ca010 2023-07-14T11:12:46.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.991+0000 7f082affd700 1 -- 172.21.15.84:0/3626853769 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f081c003a40 con 0x7f08340ca010 2023-07-14T11:12:46.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.992+0000 7f0838bff700 1 -- 172.21.15.84:0/3626853769 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08340cb270 con 0x7f08340ca010 2023-07-14T11:12:46.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:46.995+0000 7f082affd700 1 -- 172.21.15.84:0/3626853769 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f081c03cb20 con 0x7f08340ca010 2023-07-14T11:12:47.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:47.075+0000 7f0838bff700 1 -- 172.21.15.84:0/3626853769 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f0834074350 con 0x7f08340ca010 2023-07-14T11:12:47.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:47.081+0000 7f082affd700 1 -- 172.21.15.84:0/3626853769 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f081c02b020 con 0x7f08340ca010 2023-07-14T11:12:47.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:47.082+0000 7f0838bff700 1 -- 172.21.15.84:0/3626853769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08340ca010 msgr2=0x7f083414f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:12:47.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:47.082+0000 7f0838bff700 1 --2- 172.21.15.84:0/3626853769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08340ca010 0x7f083414f150 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f081c0116d0 tx=0x7f081c0119e0 comp rx=0 tx=0).stop 2023-07-14T11:12:47.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:47.082+0000 7f0838bff700 1 -- 172.21.15.84:0/3626853769 shutdown_connections 2023-07-14T11:12:47.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:47.082+0000 7f0838bff700 1 --2- 172.21.15.84:0/3626853769 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08340b8a60 0x7f083415f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:47.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:47.082+0000 7f0838bff700 1 --2- 172.21.15.84:0/3626853769 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08341e5fd0 0x7f08341e6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:47.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:47.082+0000 7f0838bff700 1 --2- 172.21.15.84:0/3626853769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08340ca010 0x7f083414f150 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:47.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:47.082+0000 7f0838bff700 1 -- 172.21.15.84:0/3626853769 >> 172.21.15.84:0/3626853769 conn(0x7f083409c1b0 msgr2=0x7f083406b770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:12:47.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:47.083+0000 7f0838bff700 1 -- 172.21.15.84:0/3626853769 shutdown_connections 2023-07-14T11:12:47.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:47.083+0000 7f0838bff700 1 -- 172.21.15.84:0/3626853769 wait complete. 2023-07-14T11:12:47.086 INFO:teuthology.orchestra.run.smithi084.stderr:adjusted tunables profile to default 2023-07-14T11:12:47.102 INFO:tasks.ceph:check_enable_crimson: False 2023-07-14T11:12:47.102 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-07-14T11:12:47.102 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-14T11:12:47.103 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-07-14T11:12:47.137 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-07-14T11:12:47.135+0000 7f8eb188c200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-14T11:12:47.148 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:12:47.147+0000 7fed98b92200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-14T11:12:47.172 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-14T11:12:47.172 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-07-14T11:12:47.294 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-14T11:12:47.294 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-07-14T11:12:47.344 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-07-14T11:12:47.343+0000 7f8eb188c200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-14T11:12:47.367 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:12:47.366+0000 7fed98b92200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-14T11:12:47.403 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-14T11:12:47.404 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-07-14T11:12:47.513 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-07-14T11:12:47.513 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-07-14T11:12:47.583 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-07-14T11:12:47.584 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-07-14T11:12:47.696 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-07-14T11:12:47.696 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-07-14T11:12:47.800 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:12:47.798+0000 7fed98b92200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-14T11:12:47.802 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-07-14T11:12:47.800+0000 7f8eb188c200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-14T11:12:47.812 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-07-14T11:12:47.812 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-07-14T11:12:47.887 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new af0b2b54-5f73-424e-a946-83a521ddd973 0 2023-07-14T11:12:48.077 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.075+0000 7f090d9ff700 1 Processor -- start 2023-07-14T11:12:48.077 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.075+0000 7f090d9ff700 1 -- start start 2023-07-14T11:12:48.078 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.076+0000 7f090d9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09080d0b10 0x7f09080d0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:12:48.079 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.077+0000 7f090d9ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f09080b0e20 0x7f09080b12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:12:48.079 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.077+0000 7f090d9ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09080d14a0 con 0x7f09080b8a60 2023-07-14T11:12:48.079 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.077+0000 7f090d9ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09080b8e30 con 0x7f09080b0e20 2023-07-14T11:12:48.079 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.077+0000 7f090d9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09080afaa0 con 0x7f09080d0b10 2023-07-14T11:12:48.079 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.077+0000 7f08fffff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09080d0b10 0x7f09080d0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:12:48.079 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.077+0000 7f0906ffd700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f09080b8a60 0x7f09080b3ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:41860/0 (socket says 172.21.15.179:41860) 2023-07-14T11:12:48.080 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.077+0000 7f0906ffd700 1 -- 172.21.15.179:0/689002915 learned_addr learned my addr 172.21.15.179:0/689002915 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-07-14T11:12:48.080 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.077+0000 7f09077fe700 1 --2- 172.21.15.179:0/689002915 >> v2:172.21.15.84:3300/0 conn(0x7f09080b0e20 0x7f09080b12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:12:48.081 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.077+0000 7f08fffff700 1 -- 172.21.15.179:0/689002915 >> v2:172.21.15.84:3300/0 conn(0x7f09080b0e20 msgr2=0x7f09080b12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:12:48.081 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.077+0000 7f08fffff700 1 --2- 172.21.15.179:0/689002915 >> v2:172.21.15.84:3300/0 conn(0x7f09080b0e20 0x7f09080b12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:48.081 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.077+0000 7f08fffff700 1 -- 172.21.15.179:0/689002915 >> v1:172.21.15.179:6789/0 conn(0x7f09080b8a60 legacy=0x7f09080b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:12:48.081 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.077+0000 7f09067fc700 1 -- 172.21.15.179:0/689002915 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1758754971 0 0) 0x7f08f8001110 con 0x7f09080b8a60 2023-07-14T11:12:48.082 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.077+0000 7f08fffff700 1 -- 172.21.15.179:0/689002915 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09080afd80 con 0x7f09080d0b10 2023-07-14T11:12:48.082 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.078+0000 7f08fffff700 1 --2- 172.21.15.179:0/689002915 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09080d0b10 0x7f09080d0f60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f08f0009840 tx=0x7f08f0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebd25046c9e30be8 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:12:48.082 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.078+0000 7f09067fc700 1 -- 172.21.15.179:0/689002915 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f0011830 con 0x7f09080d0b10 2023-07-14T11:12:48.082 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.078+0000 7f09067fc700 1 -- 172.21.15.179:0/689002915 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f0011990 con 0x7f09080d0b10 2023-07-14T11:12:48.082 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.078+0000 7f09067fc700 1 -- 172.21.15.179:0/689002915 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f0011d20 con 0x7f09080d0b10 2023-07-14T11:12:48.082 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.078+0000 7f090d9ff700 1 -- 172.21.15.179:0/689002915 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09080d0b10 msgr2=0x7f09080d0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:12:48.082 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.078+0000 7f090d9ff700 1 --2- 172.21.15.179:0/689002915 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09080d0b10 0x7f09080d0f60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f08f0009840 tx=0x7f08f0009b50 comp rx=0 tx=0).stop 2023-07-14T11:12:48.083 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.078+0000 7f090d9ff700 1 -- 172.21.15.179:0/689002915 shutdown_connections 2023-07-14T11:12:48.083 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.078+0000 7f090d9ff700 1 --2- 172.21.15.179:0/689002915 >> v2:172.21.15.84:3300/0 conn(0x7f09080b0e20 0x7f09080b12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:48.083 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.078+0000 7f090d9ff700 1 --2- 172.21.15.179:0/689002915 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09080d0b10 0x7f09080d0f60 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:48.083 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.078+0000 7f090d9ff700 1 -- 172.21.15.179:0/689002915 >> 172.21.15.179:0/689002915 conn(0x7f090809c1b0 msgr2=0x7f09080d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:12:48.083 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.078+0000 7f090d9ff700 1 -- 172.21.15.179:0/689002915 shutdown_connections 2023-07-14T11:12:48.083 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.079+0000 7f090d9ff700 1 -- 172.21.15.179:0/689002915 wait complete. 2023-07-14T11:12:48.085 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.080+0000 7f090d9ff700 1 Processor -- start 2023-07-14T11:12:48.085 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.080+0000 7f090d9ff700 1 -- start start 2023-07-14T11:12:48.085 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.081+0000 7f090d9ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09080b0e20 0x7f090815f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:12:48.085 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.081+0000 7f090d9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09080b8a60 0x7f090815cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:12:48.085 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.081+0000 7f090d9ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09080d0b10 0x7f09080cf2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:12:48.085 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.081+0000 7f090d9ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090815d2f0 con 0x7f09080d0b10 2023-07-14T11:12:48.086 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.081+0000 7f090d9ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090815d590 con 0x7f09080b0e20 2023-07-14T11:12:48.086 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.081+0000 7f090d9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f090815d870 con 0x7f09080b8a60 2023-07-14T11:12:48.086 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.081+0000 7f08fffff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09080b8a60 0x7f090815cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:12:48.086 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.081+0000 7f0906ffd700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09080b0e20 0x7f090815f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:12:48.087 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.081+0000 7f08fffff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09080b8a60 0x7f090815cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.179:57640/0 (socket says 172.21.15.179:57640) 2023-07-14T11:12:48.087 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.081+0000 7f08fffff700 1 -- 172.21.15.179:0/55488552 learned_addr learned my addr 172.21.15.179:0/55488552 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-07-14T11:12:48.087 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.082+0000 7f09077fe700 1 --2- 172.21.15.179:0/55488552 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09080d0b10 0x7f09080cf2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:12:48.087 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.082+0000 7f08fffff700 1 -- 172.21.15.179:0/55488552 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09080b0e20 msgr2=0x7f090815f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:12:48.088 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.082+0000 7f08fffff700 1 --2- 172.21.15.179:0/55488552 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09080b0e20 0x7f090815f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:48.088 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.082+0000 7f08fffff700 1 -- 172.21.15.179:0/55488552 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09080d0b10 msgr2=0x7f09080cf2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:12:48.088 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.082+0000 7f08fffff700 1 --2- 172.21.15.179:0/55488552 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09080d0b10 0x7f09080cf2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:48.088 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.082+0000 7f08fffff700 1 -- 172.21.15.179:0/55488552 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f00094a0 con 0x7f09080b8a60 2023-07-14T11:12:48.088 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.082+0000 7f0906ffd700 1 --2- 172.21.15.179:0/55488552 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09080b0e20 0x7f090815f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:12:48.088 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.082+0000 7f08fffff700 1 --2- 172.21.15.179:0/55488552 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09080b8a60 0x7f090815cdb0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f08f0014040 tx=0x7f08f0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:12:48.089 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.082+0000 7f0904ff9700 1 -- 172.21.15.179:0/55488552 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f00036a0 con 0x7f09080b8a60 2023-07-14T11:12:48.089 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.082+0000 7f0904ff9700 1 -- 172.21.15.179:0/55488552 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f001e070 con 0x7f09080b8a60 2023-07-14T11:12:48.089 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.083+0000 7f090d9ff700 1 -- 172.21.15.179:0/55488552 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f090815db50 con 0x7f09080b8a60 2023-07-14T11:12:48.089 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.083+0000 7f0904ff9700 1 -- 172.21.15.179:0/55488552 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f0003a40 con 0x7f09080b8a60 2023-07-14T11:12:48.090 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.083+0000 7f090d9ff700 1 -- 172.21.15.179:0/55488552 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09080cf820 con 0x7f09080b8a60 2023-07-14T11:12:48.090 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.083+0000 7f0904ff9700 1 -- 172.21.15.179:0/55488552 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f08f002d450 con 0x7f09080b8a60 2023-07-14T11:12:48.090 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.083+0000 7f0904ff9700 1 -- 172.21.15.179:0/55488552 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f08f001a420 con 0x7f09080b8a60 2023-07-14T11:12:48.090 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.084+0000 7f090d9ff700 1 -- 172.21.15.179:0/55488552 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f090815e1a0 con 0x7f09080b8a60 2023-07-14T11:12:48.091 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.087+0000 7f0904ff9700 1 -- 172.21.15.179:0/55488552 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f08f0020070 con 0x7f09080b8a60 2023-07-14T11:12:48.173 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.172+0000 7f090d9ff700 1 -- 172.21.15.179:0/55488552 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd new", "uuid": "af0b2b54-5f73-424e-a946-83a521ddd973", "id": 0} v 0) v1 -- 0x7f09080cd570 con 0x7f09080b8a60 2023-07-14T11:12:48.182 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.180+0000 7f0904ff9700 1 -- 172.21.15.179:0/55488552 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "af0b2b54-5f73-424e-a946-83a521ddd973", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f09080cd570 con 0x7f09080b8a60 2023-07-14T11:12:48.182 INFO:teuthology.orchestra.run.smithi179.stdout:0 2023-07-14T11:12:48.183 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.181+0000 7f090d9ff700 1 -- 172.21.15.179:0/55488552 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09080b8a60 msgr2=0x7f090815cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:12:48.183 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.181+0000 7f090d9ff700 1 --2- 172.21.15.179:0/55488552 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09080b8a60 0x7f090815cdb0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f08f0014040 tx=0x7f08f0004750 comp rx=0 tx=0).stop 2023-07-14T11:12:48.184 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.181+0000 7f090d9ff700 1 -- 172.21.15.179:0/55488552 shutdown_connections 2023-07-14T11:12:48.184 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.181+0000 7f090d9ff700 1 --2- 172.21.15.179:0/55488552 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09080d0b10 0x7f09080cf2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:48.184 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.181+0000 7f090d9ff700 1 --2- 172.21.15.179:0/55488552 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09080b0e20 0x7f090815f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:48.184 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.181+0000 7f090d9ff700 1 --2- 172.21.15.179:0/55488552 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09080b8a60 0x7f090815cdb0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:48.184 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.181+0000 7f090d9ff700 1 -- 172.21.15.179:0/55488552 >> 172.21.15.179:0/55488552 conn(0x7f090809c1b0 msgr2=0x7f09080b4900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:12:48.184 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.182+0000 7f090d9ff700 1 -- 172.21.15.179:0/55488552 shutdown_connections 2023-07-14T11:12:48.184 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.182+0000 7f090d9ff700 1 -- 172.21.15.179:0/55488552 wait complete. 2023-07-14T11:12:48.200 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new df0d7e21-1ca8-4511-8ded-3d55acac7e67 1 2023-07-14T11:12:48.386 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:12:48.384+0000 7fed98b92200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-14T11:12:48.390 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.388+0000 7fcb5d3ff700 1 Processor -- start 2023-07-14T11:12:48.390 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.388+0000 7fcb5d3ff700 1 -- start start 2023-07-14T11:12:48.391 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.390+0000 7fcb5d3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb580cf890 0x7fcb580b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:12:48.391 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.390+0000 7fcb5d3ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcb580cf030 0x7fcb580cfc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:12:48.392 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.390+0000 7fcb5d3ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb580cd8e0 con 0x7fcb581601b0 2023-07-14T11:12:48.392 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.390+0000 7fcb5d3ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb580d2760 con 0x7fcb580cf030 2023-07-14T11:12:48.392 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.390+0000 7fcb5d3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb580d01a0 con 0x7fcb580cf890 2023-07-14T11:12:48.393 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.390+0000 7fcb577fe700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fcb581601b0 0x7fcb58160630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:41872/0 (socket says 172.21.15.179:41872) 2023-07-14T11:12:48.394 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.390+0000 7fcb577fe700 1 -- 172.21.15.179:0/595630720 learned_addr learned my addr 172.21.15.179:0/595630720 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-07-14T11:12:48.394 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.390+0000 7fcb56ffd700 1 --2- 172.21.15.179:0/595630720 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb580cf890 0x7fcb580b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:12:48.394 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.390+0000 7fcb567fc700 1 --2- 172.21.15.179:0/595630720 >> v2:172.21.15.84:3300/0 conn(0x7fcb580cf030 0x7fcb580cfc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:12:48.394 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.390+0000 7fcb55ffb700 1 -- 172.21.15.179:0/595630720 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1725784293 0 0) 0x7fcb580cd8e0 con 0x7fcb581601b0 2023-07-14T11:12:48.394 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.390+0000 7fcb55ffb700 1 -- 172.21.15.179:0/595630720 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb400035b0 con 0x7fcb581601b0 2023-07-14T11:12:48.394 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.390+0000 7fcb56ffd700 1 -- 172.21.15.179:0/595630720 >> v2:172.21.15.84:3300/0 conn(0x7fcb580cf030 msgr2=0x7fcb580cfc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:12:48.394 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.390+0000 7fcb56ffd700 1 --2- 172.21.15.179:0/595630720 >> v2:172.21.15.84:3300/0 conn(0x7fcb580cf030 0x7fcb580cfc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:48.395 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.390+0000 7fcb56ffd700 1 -- 172.21.15.179:0/595630720 >> v1:172.21.15.179:6789/0 conn(0x7fcb581601b0 legacy=0x7fcb58160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:12:48.395 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.390+0000 7fcb56ffd700 1 -- 172.21.15.179:0/595630720 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb580d1740 con 0x7fcb580cf890 2023-07-14T11:12:48.395 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.391+0000 7fcb56ffd700 1 --2- 172.21.15.179:0/595630720 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb580cf890 0x7fcb580b21f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fcb48009840 tx=0x7fcb48009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=140692efa7175dec server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:12:48.395 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.391+0000 7fcb55ffb700 1 -- 172.21.15.179:0/595630720 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb48011830 con 0x7fcb580cf890 2023-07-14T11:12:48.395 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.391+0000 7fcb55ffb700 1 -- 172.21.15.179:0/595630720 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb48011990 con 0x7fcb580cf890 2023-07-14T11:12:48.395 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.391+0000 7fcb55ffb700 1 -- 172.21.15.179:0/595630720 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb48011d20 con 0x7fcb580cf890 2023-07-14T11:12:48.395 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.392+0000 7fcb5d3ff700 1 -- 172.21.15.179:0/595630720 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb580cf890 msgr2=0x7fcb580b21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:12:48.396 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.392+0000 7fcb5d3ff700 1 --2- 172.21.15.179:0/595630720 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb580cf890 0x7fcb580b21f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fcb48009840 tx=0x7fcb48009b50 comp rx=0 tx=0).stop 2023-07-14T11:12:48.396 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.392+0000 7fcb5d3ff700 1 -- 172.21.15.179:0/595630720 shutdown_connections 2023-07-14T11:12:48.396 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.392+0000 7fcb5d3ff700 1 --2- 172.21.15.179:0/595630720 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb580cf890 0x7fcb580b21f0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:48.396 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.392+0000 7fcb5d3ff700 1 --2- 172.21.15.179:0/595630720 >> v2:172.21.15.84:3300/0 conn(0x7fcb580cf030 0x7fcb580cfc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:48.396 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.392+0000 7fcb5d3ff700 1 -- 172.21.15.179:0/595630720 >> 172.21.15.179:0/595630720 conn(0x7fcb5806c170 msgr2=0x7fcb5806c540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:12:48.399 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.392+0000 7fcb5d3ff700 1 -- 172.21.15.179:0/595630720 shutdown_connections 2023-07-14T11:12:48.399 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.392+0000 7fcb5d3ff700 1 -- 172.21.15.179:0/595630720 wait complete. 2023-07-14T11:12:48.399 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.394+0000 7fcb5d3ff700 1 Processor -- start 2023-07-14T11:12:48.399 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.394+0000 7fcb5d3ff700 1 -- start start 2023-07-14T11:12:48.399 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.395+0000 7fcb5d3ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb580cf030 0x7fcb580aa2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:12:48.399 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.395+0000 7fcb5d3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb580cf890 0x7fcb580ab5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:12:48.399 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.395+0000 7fcb5d3ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb581601b0 0x7fcb58153320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:12:48.400 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.395+0000 7fcb5d3ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb580ac270 con 0x7fcb580cf030 2023-07-14T11:12:48.400 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.395+0000 7fcb5d3ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb580abcb0 con 0x7fcb581601b0 2023-07-14T11:12:48.400 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.395+0000 7fcb5d3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb580abf90 con 0x7fcb580cf890 2023-07-14T11:12:48.400 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.395+0000 7fcb567fc700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb580cf890 0x7fcb580ab5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:12:48.400 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.395+0000 7fcb567fc700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb580cf890 0x7fcb580ab5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.179:57654/0 (socket says 172.21.15.179:57654) 2023-07-14T11:12:48.400 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.395+0000 7fcb567fc700 1 -- 172.21.15.179:0/584095009 learned_addr learned my addr 172.21.15.179:0/584095009 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-07-14T11:12:48.401 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.395+0000 7fcb56ffd700 1 --2- 172.21.15.179:0/584095009 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb580cf030 0x7fcb580aa2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:12:48.401 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.395+0000 7fcb577fe700 1 --2- 172.21.15.179:0/584095009 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb581601b0 0x7fcb58153320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:12:48.401 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.396+0000 7fcb56ffd700 1 -- 172.21.15.179:0/584095009 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb580cf890 msgr2=0x7fcb580ab5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:12:48.401 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.396+0000 7fcb56ffd700 1 --2- 172.21.15.179:0/584095009 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb580cf890 0x7fcb580ab5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:48.401 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.396+0000 7fcb56ffd700 1 -- 172.21.15.179:0/584095009 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb581601b0 msgr2=0x7fcb58153320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:12:48.401 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.396+0000 7fcb56ffd700 1 --2- 172.21.15.179:0/584095009 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb581601b0 0x7fcb58153320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:48.401 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.396+0000 7fcb56ffd700 1 -- 172.21.15.179:0/584095009 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb480094a0 con 0x7fcb580cf030 2023-07-14T11:12:48.402 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.396+0000 7fcb567fc700 1 --2- 172.21.15.179:0/584095009 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb580cf890 0x7fcb580ab5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:12:48.402 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.396+0000 7fcb56ffd700 1 --2- 172.21.15.179:0/584095009 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb580cf030 0x7fcb580aa2c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fcb48016000 tx=0x7fcb48004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:12:48.402 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.396+0000 7fcb3f7fe700 1 -- 172.21.15.179:0/584095009 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb480036a0 con 0x7fcb580cf030 2023-07-14T11:12:48.402 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.396+0000 7fcb3f7fe700 1 -- 172.21.15.179:0/584095009 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb4801f070 con 0x7fcb580cf030 2023-07-14T11:12:48.402 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.396+0000 7fcb3f7fe700 1 -- 172.21.15.179:0/584095009 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb48003a40 con 0x7fcb580cf030 2023-07-14T11:12:48.402 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.396+0000 7fcb5d3ff700 1 -- 172.21.15.179:0/584095009 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb580cb040 con 0x7fcb580cf030 2023-07-14T11:12:48.402 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.397+0000 7fcb5d3ff700 1 -- 172.21.15.179:0/584095009 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb580aebb0 con 0x7fcb580cf030 2023-07-14T11:12:48.402 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.397+0000 7fcb3f7fe700 1 -- 172.21.15.179:0/584095009 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fcb48026480 con 0x7fcb580cf030 2023-07-14T11:12:48.403 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.397+0000 7fcb3f7fe700 1 -- 172.21.15.179:0/584095009 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fcb48021070 con 0x7fcb580cf030 2023-07-14T11:12:48.403 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.397+0000 7fcb5d3ff700 1 -- 172.21.15.179:0/584095009 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb580ac0d0 con 0x7fcb580cf030 2023-07-14T11:12:48.403 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.400+0000 7fcb3f7fe700 1 -- 172.21.15.179:0/584095009 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7fcb580ac0d0 con 0x7fcb580cf030 2023-07-14T11:12:48.434 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-07-14T11:12:48.432+0000 7f8eb188c200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-14T11:12:48.485 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.484+0000 7fcb5d3ff700 1 -- 172.21.15.179:0/584095009 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd new", "uuid": "df0d7e21-1ca8-4511-8ded-3d55acac7e67", "id": 1} v 0) v1 -- 0x7fcb580cb560 con 0x7fcb580cf030 2023-07-14T11:12:48.493 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.491+0000 7fcb3f7fe700 1 -- 172.21.15.179:0/584095009 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "df0d7e21-1ca8-4511-8ded-3d55acac7e67", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fcb580cb560 con 0x7fcb580cf030 2023-07-14T11:12:48.493 INFO:teuthology.orchestra.run.smithi179.stdout:1 2023-07-14T11:12:48.494 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.492+0000 7fcb5d3ff700 1 -- 172.21.15.179:0/584095009 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb580cf030 msgr2=0x7fcb580aa2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:12:48.494 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.492+0000 7fcb5d3ff700 1 --2- 172.21.15.179:0/584095009 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb580cf030 0x7fcb580aa2c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fcb48016000 tx=0x7fcb48004750 comp rx=0 tx=0).stop 2023-07-14T11:12:48.494 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.492+0000 7fcb5d3ff700 1 -- 172.21.15.179:0/584095009 shutdown_connections 2023-07-14T11:12:48.494 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.492+0000 7fcb5d3ff700 1 --2- 172.21.15.179:0/584095009 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb581601b0 0x7fcb58153320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:48.495 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.492+0000 7fcb5d3ff700 1 --2- 172.21.15.179:0/584095009 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb580cf030 0x7fcb580aa2c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:48.495 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.492+0000 7fcb5d3ff700 1 --2- 172.21.15.179:0/584095009 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb580cf890 0x7fcb580ab5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:48.495 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.492+0000 7fcb5d3ff700 1 -- 172.21.15.179:0/584095009 >> 172.21.15.179:0/584095009 conn(0x7fcb5806c170 msgr2=0x7fcb581e52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:12:48.495 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.492+0000 7fcb5d3ff700 1 -- 172.21.15.179:0/584095009 shutdown_connections 2023-07-14T11:12:48.495 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.492+0000 7fcb5d3ff700 1 -- 172.21.15.179:0/584095009 wait complete. 2023-07-14T11:12:48.511 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new 1ce33f02-2334-4187-bdd5-82a300a1f9a2 2 2023-07-14T11:12:48.621 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:12:48.619+0000 7fed98b92200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-07-14T11:12:48.691 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-07-14T11:12:48.689+0000 7f8eb188c200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-07-14T11:12:48.704 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.702+0000 7f8b491ff700 1 Processor -- start 2023-07-14T11:12:48.704 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.702+0000 7f8b491ff700 1 -- start start 2023-07-14T11:12:48.705 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.703+0000 7f8b491ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8b440d0b10 0x7f8b440d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:12:48.705 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.703+0000 7f8b491ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b440b8e30 con 0x7f8b440b8a60 2023-07-14T11:12:48.705 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.703+0000 7f8b491ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b440afaa0 con 0x7f8b440b0e20 2023-07-14T11:12:48.705 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.703+0000 7f8b491ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b440d14d0 con 0x7f8b440d0b10 2023-07-14T11:12:48.706 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.704+0000 7f8b4359e700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f8b440b0e20 0x7f8b440b1260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:41874/0 (socket says 172.21.15.179:41874) 2023-07-14T11:12:48.707 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.704+0000 7f8b4359e700 1 -- 172.21.15.179:0/263373248 learned_addr learned my addr 172.21.15.179:0/263373248 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-07-14T11:12:48.707 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.704+0000 7f8b4259c700 1 --2- 172.21.15.179:0/263373248 >> v2:172.21.15.84:3300/0 conn(0x7f8b440d0b10 0x7f8b440d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:12:48.707 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.704+0000 7f8b41d9b700 1 -- 172.21.15.179:0/263373248 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2696915817 0 0) 0x7f8b440afaa0 con 0x7f8b440b0e20 2023-07-14T11:12:48.707 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.704+0000 7f8b41d9b700 1 -- 172.21.15.179:0/263373248 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b2c0035b0 con 0x7f8b440b0e20 2023-07-14T11:12:48.707 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.704+0000 7f8b4259c700 1 -- 172.21.15.179:0/263373248 >> v1:172.21.15.179:6789/0 conn(0x7f8b440b0e20 legacy=0x7f8b440b1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:12:48.707 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.704+0000 7f8b4259c700 1 -- 172.21.15.179:0/263373248 >> v1:172.21.15.84:6789/0 conn(0x7f8b440b8a60 legacy=0x7f8b440b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:12:48.707 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.704+0000 7f8b4259c700 1 -- 172.21.15.179:0/263373248 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b440afd80 con 0x7f8b440d0b10 2023-07-14T11:12:48.708 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.704+0000 7f8b4259c700 1 --2- 172.21.15.179:0/263373248 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b440d0b10 0x7f8b440d0f90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8b38009840 tx=0x7f8b38009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c35e6b33ca4f62a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:12:48.708 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.705+0000 7f8b41d9b700 1 -- 172.21.15.179:0/263373248 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b38011830 con 0x7f8b440d0b10 2023-07-14T11:12:48.708 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.705+0000 7f8b41d9b700 1 -- 172.21.15.179:0/263373248 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b38011990 con 0x7f8b440d0b10 2023-07-14T11:12:48.708 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.705+0000 7f8b41d9b700 1 -- 172.21.15.179:0/263373248 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b38011d20 con 0x7f8b440d0b10 2023-07-14T11:12:48.709 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.705+0000 7f8b491ff700 1 -- 172.21.15.179:0/263373248 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b440d0b10 msgr2=0x7f8b440d0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:12:48.709 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.705+0000 7f8b491ff700 1 --2- 172.21.15.179:0/263373248 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b440d0b10 0x7f8b440d0f90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8b38009840 tx=0x7f8b38009b50 comp rx=0 tx=0).stop 2023-07-14T11:12:48.709 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.705+0000 7f8b491ff700 1 -- 172.21.15.179:0/263373248 shutdown_connections 2023-07-14T11:12:48.709 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.705+0000 7f8b491ff700 1 --2- 172.21.15.179:0/263373248 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b440d0b10 0x7f8b440d0f90 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:48.709 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.705+0000 7f8b491ff700 1 -- 172.21.15.179:0/263373248 >> 172.21.15.179:0/263373248 conn(0x7f8b4409c1b0 msgr2=0x7f8b440d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:12:48.709 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.705+0000 7f8b491ff700 1 -- 172.21.15.179:0/263373248 shutdown_connections 2023-07-14T11:12:48.710 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.706+0000 7f8b491ff700 1 -- 172.21.15.179:0/263373248 wait complete. 2023-07-14T11:12:48.710 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.707+0000 7f8b491ff700 1 Processor -- start 2023-07-14T11:12:48.710 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.707+0000 7f8b491ff700 1 -- start start 2023-07-14T11:12:48.711 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.708+0000 7f8b491ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b440b0e20 0x7f8b440ccf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:12:48.712 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.708+0000 7f8b491ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b440b8a60 0x7f8b44151290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:12:48.712 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.708+0000 7f8b491ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b440d0b10 0x7f8b440b6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:12:48.712 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.708+0000 7f8b491ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b441f1cf0 con 0x7f8b440d0b10 2023-07-14T11:12:48.712 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.708+0000 7f8b491ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b440cd570 con 0x7f8b440b0e20 2023-07-14T11:12:48.712 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.708+0000 7f8b491ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b440cd850 con 0x7f8b440b8a60 2023-07-14T11:12:48.712 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.708+0000 7f8b42d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b440b0e20 0x7f8b440ccf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:12:48.713 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.709+0000 7f8b4259c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b440b8a60 0x7f8b44151290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:12:48.713 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.709+0000 7f8b42d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b440b0e20 0x7f8b440ccf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:38436/0 (socket says 172.21.15.179:38436) 2023-07-14T11:12:48.713 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.709+0000 7f8b42d9d700 1 -- 172.21.15.179:0/4188291017 learned_addr learned my addr 172.21.15.179:0/4188291017 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-07-14T11:12:48.713 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.709+0000 7f8b4359e700 1 --2- 172.21.15.179:0/4188291017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b440d0b10 0x7f8b440b6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:12:48.713 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.709+0000 7f8b42d9d700 1 -- 172.21.15.179:0/4188291017 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b440b8a60 msgr2=0x7f8b44151290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:12:48.713 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.709+0000 7f8b42d9d700 1 --2- 172.21.15.179:0/4188291017 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b440b8a60 0x7f8b44151290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:48.713 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.709+0000 7f8b42d9d700 1 -- 172.21.15.179:0/4188291017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b440d0b10 msgr2=0x7f8b440b6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:12:48.713 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.709+0000 7f8b42d9d700 1 --2- 172.21.15.179:0/4188291017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b440d0b10 0x7f8b440b6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:48.714 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.709+0000 7f8b42d9d700 1 -- 172.21.15.179:0/4188291017 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b380094a0 con 0x7f8b440b0e20 2023-07-14T11:12:48.714 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.709+0000 7f8b42d9d700 1 --2- 172.21.15.179:0/4188291017 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b440b0e20 0x7f8b440ccf20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8b3400c4e0 tx=0x7f8b3400c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:12:48.714 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.709+0000 7f8b2b7fe700 1 -- 172.21.15.179:0/4188291017 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b340052d0 con 0x7f8b440b0e20 2023-07-14T11:12:48.714 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.709+0000 7f8b2b7fe700 1 -- 172.21.15.179:0/4188291017 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b34005430 con 0x7f8b440b0e20 2023-07-14T11:12:48.714 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.709+0000 7f8b2b7fe700 1 -- 172.21.15.179:0/4188291017 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b340038c0 con 0x7f8b440b0e20 2023-07-14T11:12:48.714 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.709+0000 7f8b491ff700 1 -- 172.21.15.179:0/4188291017 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b440cdb30 con 0x7f8b440b0e20 2023-07-14T11:12:48.714 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.710+0000 7f8b491ff700 1 -- 172.21.15.179:0/4188291017 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b440ce0f0 con 0x7f8b440b0e20 2023-07-14T11:12:48.715 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.710+0000 7f8b2b7fe700 1 -- 172.21.15.179:0/4188291017 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f8b34003d20 con 0x7f8b440b0e20 2023-07-14T11:12:48.715 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.710+0000 7f8b2b7fe700 1 -- 172.21.15.179:0/4188291017 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f8b34011e30 con 0x7f8b440b0e20 2023-07-14T11:12:48.715 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.711+0000 7f8b491ff700 1 -- 172.21.15.179:0/4188291017 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b44074350 con 0x7f8b440b0e20 2023-07-14T11:12:48.715 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.714+0000 7f8b2b7fe700 1 -- 172.21.15.179:0/4188291017 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f8b34017070 con 0x7f8b440b0e20 2023-07-14T11:12:48.799 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.797+0000 7f8b491ff700 1 -- 172.21.15.179:0/4188291017 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1ce33f02-2334-4187-bdd5-82a300a1f9a2", "id": 2} v 0) v1 -- 0x7f8b44073800 con 0x7f8b440b0e20 2023-07-14T11:12:48.807 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.805+0000 7f8b2b7fe700 1 -- 172.21.15.179:0/4188291017 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1ce33f02-2334-4187-bdd5-82a300a1f9a2", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8b34011590 con 0x7f8b440b0e20 2023-07-14T11:12:48.807 INFO:teuthology.orchestra.run.smithi179.stdout:2 2023-07-14T11:12:48.808 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.806+0000 7f8b491ff700 1 -- 172.21.15.179:0/4188291017 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b440b0e20 msgr2=0x7f8b440ccf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:12:48.808 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.806+0000 7f8b491ff700 1 --2- 172.21.15.179:0/4188291017 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b440b0e20 0x7f8b440ccf20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8b3400c4e0 tx=0x7f8b3400c7f0 comp rx=0 tx=0).stop 2023-07-14T11:12:48.808 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.806+0000 7f8b491ff700 1 -- 172.21.15.179:0/4188291017 shutdown_connections 2023-07-14T11:12:48.808 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.806+0000 7f8b491ff700 1 --2- 172.21.15.179:0/4188291017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b440d0b10 0x7f8b440b6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:48.808 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.806+0000 7f8b491ff700 1 --2- 172.21.15.179:0/4188291017 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b440b0e20 0x7f8b440ccf20 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:48.808 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.806+0000 7f8b491ff700 1 --2- 172.21.15.179:0/4188291017 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b440b8a60 0x7f8b44151290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:48.809 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.806+0000 7f8b491ff700 1 -- 172.21.15.179:0/4188291017 >> 172.21.15.179:0/4188291017 conn(0x7f8b4409c1b0 msgr2=0x7f8b440d1640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:12:48.809 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.806+0000 7f8b491ff700 1 -- 172.21.15.179:0/4188291017 shutdown_connections 2023-07-14T11:12:48.809 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:48.806+0000 7f8b491ff700 1 -- 172.21.15.179:0/4188291017 wait complete. 2023-07-14T11:12:48.825 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new fec68cd7-c176-487d-9941-811be1202897 3 2023-07-14T11:12:49.022 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.020+0000 7f0b4cbff700 1 Processor -- start 2023-07-14T11:12:49.022 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.020+0000 7f0b4cbff700 1 -- start start 2023-07-14T11:12:49.024 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.022+0000 7f0b4cbff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0b480b4600 0x7f0b480cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:12:49.024 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.022+0000 7f0b4cbff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0b480b6f00 0x7f0b480d02b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:12:49.024 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.022+0000 7f0b4cbff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b4815cd60 con 0x7f0b480cfe40 2023-07-14T11:12:49.025 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.022+0000 7f0b4cbff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b480d1550 con 0x7f0b480b4600 2023-07-14T11:12:49.025 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.022+0000 7f0b4cbff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b480d2d90 con 0x7f0b480b6f00 2023-07-14T11:12:49.025 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.022+0000 7f0b46d9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0b480b6f00 0x7f0b480d02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:12:49.025 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.022+0000 7f0b4659c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0b480b4600 0x7f0b480cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:12:49.025 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.022+0000 7f0b46d9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0b480b6f00 0x7f0b480d02b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:38450/0 (socket says 172.21.15.179:38450) 2023-07-14T11:12:49.025 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.023+0000 7f0b46d9d700 1 -- 172.21.15.179:0/554629047 learned_addr learned my addr 172.21.15.179:0/554629047 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-07-14T11:12:49.026 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.023+0000 7f0b45d9b700 1 -- 172.21.15.179:0/554629047 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 595936348 0 0) 0x7f0b4815cd60 con 0x7f0b480cfe40 2023-07-14T11:12:49.027 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.023+0000 7f0b45d9b700 1 -- 172.21.15.179:0/554629047 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b340035b0 con 0x7f0b480cfe40 2023-07-14T11:12:49.027 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.023+0000 7f0b46d9d700 1 -- 172.21.15.179:0/554629047 >> v2:172.21.15.84:3300/0 conn(0x7f0b480b4600 msgr2=0x7f0b480cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:12:49.027 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.023+0000 7f0b46d9d700 1 --2- 172.21.15.179:0/554629047 >> v2:172.21.15.84:3300/0 conn(0x7f0b480b4600 0x7f0b480cf900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:49.027 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.023+0000 7f0b46d9d700 1 -- 172.21.15.179:0/554629047 >> v1:172.21.15.84:6789/0 conn(0x7f0b480cfe40 legacy=0x7f0b480cd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:12:49.027 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.023+0000 7f0b46d9d700 1 -- 172.21.15.179:0/554629047 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b480cf340 con 0x7f0b480b6f00 2023-07-14T11:12:49.027 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.023+0000 7f0b4659c700 1 --2- 172.21.15.179:0/554629047 >> v2:172.21.15.84:3300/0 conn(0x7f0b480b4600 0x7f0b480cf900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:12:49.027 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.023+0000 7f0b46d9d700 1 --2- 172.21.15.179:0/554629047 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b480b6f00 0x7f0b480d02b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0b4808d400 tx=0x7f0b4000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a912a374690a97cb server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:12:49.028 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.023+0000 7f0b45d9b700 1 -- 172.21.15.179:0/554629047 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4000e070 con 0x7f0b480b6f00 2023-07-14T11:12:49.028 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.024+0000 7f0b45d9b700 1 -- 172.21.15.179:0/554629047 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b4000b910 con 0x7f0b480b6f00 2023-07-14T11:12:49.028 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.024+0000 7f0b45d9b700 1 -- 172.21.15.179:0/554629047 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4000bcc0 con 0x7f0b480b6f00 2023-07-14T11:12:49.028 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.024+0000 7f0b4cbff700 1 -- 172.21.15.179:0/554629047 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b480b6f00 msgr2=0x7f0b480d02b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:12:49.028 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.024+0000 7f0b4cbff700 1 --2- 172.21.15.179:0/554629047 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b480b6f00 0x7f0b480d02b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0b4808d400 tx=0x7f0b4000b330 comp rx=0 tx=0).stop 2023-07-14T11:12:49.028 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.025+0000 7f0b4cbff700 1 -- 172.21.15.179:0/554629047 shutdown_connections 2023-07-14T11:12:49.028 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.025+0000 7f0b4cbff700 1 --2- 172.21.15.179:0/554629047 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b480b6f00 0x7f0b480d02b0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:49.029 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.025+0000 7f0b4cbff700 1 --2- 172.21.15.179:0/554629047 >> v2:172.21.15.84:3300/0 conn(0x7f0b480b4600 0x7f0b480cf900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:49.029 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.025+0000 7f0b4cbff700 1 -- 172.21.15.179:0/554629047 >> 172.21.15.179:0/554629047 conn(0x7f0b4809c200 msgr2=0x7f0b480d2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:12:49.029 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.025+0000 7f0b4cbff700 1 -- 172.21.15.179:0/554629047 shutdown_connections 2023-07-14T11:12:49.029 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.025+0000 7f0b4cbff700 1 -- 172.21.15.179:0/554629047 wait complete. 2023-07-14T11:12:49.030 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.026+0000 7f0b4cbff700 1 Processor -- start 2023-07-14T11:12:49.030 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.027+0000 7f0b4cbff700 1 -- start start 2023-07-14T11:12:49.030 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.028+0000 7f0b4cbff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b480b6f00 0x7f0b4809d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:12:49.030 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.028+0000 7f0b4cbff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b480cfe40 0x7f0b481f3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:12:49.031 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.028+0000 7f0b4cbff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b481f3eb0 0x7f0b4809fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:12:49.031 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.028+0000 7f0b4cbff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4809f040 con 0x7f0b480cfe40 2023-07-14T11:12:49.031 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.028+0000 7f0b4cbff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4809f320 con 0x7f0b481f3eb0 2023-07-14T11:12:49.031 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.028+0000 7f0b4cbff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4809f600 con 0x7f0b480b6f00 2023-07-14T11:12:49.031 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.028+0000 7f0b4659c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b480b6f00 0x7f0b4809d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:12:49.031 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.028+0000 7f0b46d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b481f3eb0 0x7f0b4809fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:12:49.031 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.028+0000 7f0b4659c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b480b6f00 0x7f0b4809d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.179:57678/0 (socket says 172.21.15.179:57678) 2023-07-14T11:12:49.032 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.028+0000 7f0b4659c700 1 -- 172.21.15.179:0/2102671288 learned_addr learned my addr 172.21.15.179:0/2102671288 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-07-14T11:12:49.032 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.028+0000 7f0b46d9d700 1 --2- 172.21.15.179:0/2102671288 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b481f3eb0 0x7f0b4809fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:38462/0 (socket says 172.21.15.179:38462) 2023-07-14T11:12:49.032 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.028+0000 7f0b3ffff700 1 --2- 172.21.15.179:0/2102671288 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b480cfe40 0x7f0b481f3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:12:49.033 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.029+0000 7f0b4659c700 1 -- 172.21.15.179:0/2102671288 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b481f3eb0 msgr2=0x7f0b4809fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:12:49.033 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.029+0000 7f0b4659c700 1 --2- 172.21.15.179:0/2102671288 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b481f3eb0 0x7f0b4809fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:49.033 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.029+0000 7f0b4659c700 1 -- 172.21.15.179:0/2102671288 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b480cfe40 msgr2=0x7f0b481f3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:12:49.033 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.029+0000 7f0b4659c700 1 --2- 172.21.15.179:0/2102671288 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b480cfe40 0x7f0b481f3970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:49.034 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.029+0000 7f0b4659c700 1 -- 172.21.15.179:0/2102671288 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b380094a0 con 0x7f0b480b6f00 2023-07-14T11:12:49.034 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.029+0000 7f0b46d9d700 1 --2- 172.21.15.179:0/2102671288 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b481f3eb0 0x7f0b4809fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:12:49.034 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.029+0000 7f0b4659c700 1 --2- 172.21.15.179:0/2102671288 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b480b6f00 0x7f0b4809d210 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0b3800ebe0 tx=0x7f0b3800eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:12:49.034 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.029+0000 7f0b3effd700 1 -- 172.21.15.179:0/2102671288 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b38009800 con 0x7f0b480b6f00 2023-07-14T11:12:49.034 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.029+0000 7f0b3effd700 1 -- 172.21.15.179:0/2102671288 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b3800c910 con 0x7f0b480b6f00 2023-07-14T11:12:49.034 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.029+0000 7f0b3effd700 1 -- 172.21.15.179:0/2102671288 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b3800cc80 con 0x7f0b480b6f00 2023-07-14T11:12:49.034 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.029+0000 7f0b4cbff700 1 -- 172.21.15.179:0/2102671288 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b40009b30 con 0x7f0b480b6f00 2023-07-14T11:12:49.034 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.030+0000 7f0b4cbff700 1 -- 172.21.15.179:0/2102671288 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b4809d750 con 0x7f0b480b6f00 2023-07-14T11:12:49.035 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.030+0000 7f0b3effd700 1 -- 172.21.15.179:0/2102671288 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0b38005d20 con 0x7f0b480b6f00 2023-07-14T11:12:49.035 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.030+0000 7f0b3effd700 1 -- 172.21.15.179:0/2102671288 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f0b380068e0 con 0x7f0b480b6f00 2023-07-14T11:12:49.035 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.031+0000 7f0b4cbff700 1 -- 172.21.15.179:0/2102671288 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b4809fb20 con 0x7f0b480b6f00 2023-07-14T11:12:49.035 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.033+0000 7f0b3effd700 1 -- 172.21.15.179:0/2102671288 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f0b38021060 con 0x7f0b480b6f00 2023-07-14T11:12:49.073 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:12:49.071+0000 7fed98b92200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-14T11:12:49.119 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.117+0000 7f0b4cbff700 1 -- 172.21.15.179:0/2102671288 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd new", "uuid": "fec68cd7-c176-487d-9941-811be1202897", "id": 3} v 0) v1 -- 0x7f0b48074350 con 0x7f0b480b6f00 2023-07-14T11:12:49.126 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.125+0000 7f0b3effd700 1 -- 172.21.15.179:0/2102671288 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fec68cd7-c176-487d-9941-811be1202897", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0b38029020 con 0x7f0b480b6f00 2023-07-14T11:12:49.127 INFO:teuthology.orchestra.run.smithi179.stdout:3 2023-07-14T11:12:49.128 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.126+0000 7f0b4cbff700 1 -- 172.21.15.179:0/2102671288 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b480b6f00 msgr2=0x7f0b4809d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:12:49.128 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.126+0000 7f0b4cbff700 1 --2- 172.21.15.179:0/2102671288 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b480b6f00 0x7f0b4809d210 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0b3800ebe0 tx=0x7f0b3800eef0 comp rx=0 tx=0).stop 2023-07-14T11:12:49.128 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.126+0000 7f0b4cbff700 1 -- 172.21.15.179:0/2102671288 shutdown_connections 2023-07-14T11:12:49.128 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.126+0000 7f0b4cbff700 1 --2- 172.21.15.179:0/2102671288 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b480b6f00 0x7f0b4809d210 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:49.128 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.126+0000 7f0b4cbff700 1 --2- 172.21.15.179:0/2102671288 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b481f3eb0 0x7f0b4809fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:49.129 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.126+0000 7f0b4cbff700 1 --2- 172.21.15.179:0/2102671288 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b480cfe40 0x7f0b481f3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:49.129 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.126+0000 7f0b4cbff700 1 -- 172.21.15.179:0/2102671288 >> 172.21.15.179:0/2102671288 conn(0x7f0b4809c200 msgr2=0x7f0b4815ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:12:49.129 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.126+0000 7f0b4cbff700 1 -- 172.21.15.179:0/2102671288 shutdown_connections 2023-07-14T11:12:49.129 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.126+0000 7f0b4cbff700 1 -- 172.21.15.179:0/2102671288 wait complete. 2023-07-14T11:12:49.145 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new 0f0296be-6337-4c76-866c-0cac384bc6fc 4 2023-07-14T11:12:49.167 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-07-14T11:12:49.165+0000 7f8eb188c200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-14T11:12:49.336 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.334+0000 7ff5d5fff700 1 Processor -- start 2023-07-14T11:12:49.337 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.334+0000 7ff5d5fff700 1 -- start start 2023-07-14T11:12:49.340 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.336+0000 7ff5d5fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff5d00b8660 0x7ff5d00cd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:12:49.340 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.336+0000 7ff5d5fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff5d00b4f70 0x7ff5d00d12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:12:49.340 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.336+0000 7ff5d5fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5d00d02a0 con 0x7ff5d00cd970 2023-07-14T11:12:49.341 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.336+0000 7ff5d5fff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5d00cfce0 con 0x7ff5d00b8660 2023-07-14T11:12:49.341 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.336+0000 7ff5d5fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5d00cffc0 con 0x7ff5d00b4f70 2023-07-14T11:12:49.341 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.337+0000 7ff5cffff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff5d00b4f70 0x7ff5d00d12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:12:49.341 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.337+0000 7ff5cffff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff5d00b4f70 0x7ff5d00d12c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:38474/0 (socket says 172.21.15.179:38474) 2023-07-14T11:12:49.342 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.337+0000 7ff5cffff700 1 -- 172.21.15.179:0/1310145552 learned_addr learned my addr 172.21.15.179:0/1310145552 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-07-14T11:12:49.342 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.337+0000 7ff5cf7fe700 1 --2- 172.21.15.179:0/1310145552 >> v2:172.21.15.84:3300/0 conn(0x7ff5d00b8660 0x7ff5d00cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:12:49.342 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.337+0000 7ff5cffff700 1 -- 172.21.15.179:0/1310145552 >> v2:172.21.15.84:3300/0 conn(0x7ff5d00b8660 msgr2=0x7ff5d00cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:12:49.342 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.337+0000 7ff5cffff700 1 --2- 172.21.15.179:0/1310145552 >> v2:172.21.15.84:3300/0 conn(0x7ff5d00b8660 0x7ff5d00cd430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:49.343 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.337+0000 7ff5cffff700 1 -- 172.21.15.179:0/1310145552 >> v1:172.21.15.179:6789/0 conn(0x7ff5d00cd970 legacy=0x7ff5d00b4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:12:49.343 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.337+0000 7ff5cffff700 1 -- 172.21.15.179:0/1310145552 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d00d0ac0 con 0x7ff5d00b4f70 2023-07-14T11:12:49.343 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.337+0000 7ff5cffff700 1 --2- 172.21.15.179:0/1310145552 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5d00b4f70 0x7ff5d00d12c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff5d00b8f20 tx=0x7ff5c800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8653548b788de80 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:12:49.343 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.338+0000 7ff5ceffd700 1 -- 172.21.15.179:0/1310145552 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c800e070 con 0x7ff5d00b4f70 2023-07-14T11:12:49.344 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.338+0000 7ff5ceffd700 1 -- 172.21.15.179:0/1310145552 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5c800b910 con 0x7ff5d00b4f70 2023-07-14T11:12:49.344 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.338+0000 7ff5ceffd700 1 -- 172.21.15.179:0/1310145552 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c800bcc0 con 0x7ff5d00b4f70 2023-07-14T11:12:49.348 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.339+0000 7ff5d5fff700 1 -- 172.21.15.179:0/1310145552 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5d00b4f70 msgr2=0x7ff5d00d12c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:12:49.348 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.339+0000 7ff5d5fff700 1 --2- 172.21.15.179:0/1310145552 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5d00b4f70 0x7ff5d00d12c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff5d00b8f20 tx=0x7ff5c800b330 comp rx=0 tx=0).stop 2023-07-14T11:12:49.349 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.339+0000 7ff5d5fff700 1 -- 172.21.15.179:0/1310145552 shutdown_connections 2023-07-14T11:12:49.349 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.339+0000 7ff5d5fff700 1 --2- 172.21.15.179:0/1310145552 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5d00b4f70 0x7ff5d00d12c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:49.349 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.339+0000 7ff5d5fff700 1 --2- 172.21.15.179:0/1310145552 >> v2:172.21.15.84:3300/0 conn(0x7ff5d00b8660 0x7ff5d00cd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:49.349 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.339+0000 7ff5d5fff700 1 -- 172.21.15.179:0/1310145552 >> 172.21.15.179:0/1310145552 conn(0x7ff5d0066860 msgr2=0x7ff5d006a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:12:49.350 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.339+0000 7ff5d5fff700 1 -- 172.21.15.179:0/1310145552 shutdown_connections 2023-07-14T11:12:49.350 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.339+0000 7ff5d5fff700 1 -- 172.21.15.179:0/1310145552 wait complete. 2023-07-14T11:12:49.350 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.341+0000 7ff5d5fff700 1 Processor -- start 2023-07-14T11:12:49.350 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.341+0000 7ff5d5fff700 1 -- start start 2023-07-14T11:12:49.351 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.341+0000 7ff5d5fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5d00b4f70 0x7ff5d015b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:12:49.351 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.342+0000 7ff5d5fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5d00b8660 0x7ff5d00cb380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:12:49.351 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.342+0000 7ff5d5fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5d00cd970 0x7ff5d00c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:12:49.351 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.342+0000 7ff5d5fff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d00cca30 con 0x7ff5d00b8660 2023-07-14T11:12:49.351 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.342+0000 7ff5d5fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d00ccd10 con 0x7ff5d00cd970 2023-07-14T11:12:49.352 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.342+0000 7ff5d5fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d00cab80 con 0x7ff5d00b4f70 2023-07-14T11:12:49.352 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.342+0000 7ff5cffff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5d00cd970 0x7ff5d00c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:12:49.352 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.342+0000 7ff5cf7fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5d00b4f70 0x7ff5d015b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:12:49.352 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.342+0000 7ff5cffff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5d00cd970 0x7ff5d00c85e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:38490/0 (socket says 172.21.15.179:38490) 2023-07-14T11:12:49.352 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.342+0000 7ff5cffff700 1 -- 172.21.15.179:0/3547884385 learned_addr learned my addr 172.21.15.179:0/3547884385 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-07-14T11:12:49.352 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.342+0000 7ff5c7fff700 1 --2- 172.21.15.179:0/3547884385 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5d00b8660 0x7ff5d00cb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:12:49.352 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.342+0000 7ff5cffff700 1 -- 172.21.15.179:0/3547884385 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5d00b4f70 msgr2=0x7ff5d015b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:12:49.353 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.342+0000 7ff5cffff700 1 --2- 172.21.15.179:0/3547884385 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5d00b4f70 0x7ff5d015b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:49.353 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.342+0000 7ff5cffff700 1 -- 172.21.15.179:0/3547884385 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5d00b8660 msgr2=0x7ff5d00cb380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:12:49.353 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.342+0000 7ff5cffff700 1 --2- 172.21.15.179:0/3547884385 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5d00b8660 0x7ff5d00cb380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:49.353 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.342+0000 7ff5cffff700 1 -- 172.21.15.179:0/3547884385 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5c8009b30 con 0x7ff5d00cd970 2023-07-14T11:12:49.353 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.342+0000 7ff5cffff700 1 --2- 172.21.15.179:0/3547884385 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5d00cd970 0x7ff5d00c85e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff5c8012000 tx=0x7ff5c8004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:12:49.353 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.343+0000 7ff5ccff9700 1 -- 172.21.15.179:0/3547884385 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c8004880 con 0x7ff5d00cd970 2023-07-14T11:12:49.353 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.343+0000 7ff5ccff9700 1 -- 172.21.15.179:0/3547884385 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5c80099b0 con 0x7ff5d00cd970 2023-07-14T11:12:49.354 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.343+0000 7ff5ccff9700 1 -- 172.21.15.179:0/3547884385 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c801c680 con 0x7ff5d00cd970 2023-07-14T11:12:49.354 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.343+0000 7ff5d5fff700 1 -- 172.21.15.179:0/3547884385 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5d00cae60 con 0x7ff5d00cd970 2023-07-14T11:12:49.354 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.343+0000 7ff5d5fff700 1 -- 172.21.15.179:0/3547884385 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5d00cc6c0 con 0x7ff5d00cd970 2023-07-14T11:12:49.354 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.343+0000 7ff5ccff9700 1 -- 172.21.15.179:0/3547884385 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff5c801cae0 con 0x7ff5d00cd970 2023-07-14T11:12:49.354 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.343+0000 7ff5ccff9700 1 -- 172.21.15.179:0/3547884385 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7ff5c801cd90 con 0x7ff5d00cd970 2023-07-14T11:12:49.354 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.344+0000 7ff5d5fff700 1 -- 172.21.15.179:0/3547884385 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5d00cb080 con 0x7ff5d00cd970 2023-07-14T11:12:49.354 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.346+0000 7ff5ccff9700 1 -- 172.21.15.179:0/3547884385 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7ff5c8043b20 con 0x7ff5d00cd970 2023-07-14T11:12:49.433 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.431+0000 7ff5d5fff700 1 -- 172.21.15.179:0/3547884385 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0f0296be-6337-4c76-866c-0cac384bc6fc", "id": 4} v 0) v1 -- 0x7ff5d00723c0 con 0x7ff5d00cd970 2023-07-14T11:12:49.439 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.438+0000 7ff5ccff9700 1 -- 172.21.15.179:0/3547884385 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0f0296be-6337-4c76-866c-0cac384bc6fc", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff5c8032030 con 0x7ff5d00cd970 2023-07-14T11:12:49.440 INFO:teuthology.orchestra.run.smithi179.stdout:4 2023-07-14T11:12:49.441 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.439+0000 7ff5d5fff700 1 -- 172.21.15.179:0/3547884385 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5d00cd970 msgr2=0x7ff5d00c85e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:12:49.441 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.439+0000 7ff5d5fff700 1 --2- 172.21.15.179:0/3547884385 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5d00cd970 0x7ff5d00c85e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff5c8012000 tx=0x7ff5c8004ad0 comp rx=0 tx=0).stop 2023-07-14T11:12:49.441 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.439+0000 7ff5d5fff700 1 -- 172.21.15.179:0/3547884385 shutdown_connections 2023-07-14T11:12:49.441 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.439+0000 7ff5d5fff700 1 --2- 172.21.15.179:0/3547884385 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5d00b4f70 0x7ff5d015b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:49.441 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.439+0000 7ff5d5fff700 1 --2- 172.21.15.179:0/3547884385 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5d00cd970 0x7ff5d00c85e0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:49.441 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.439+0000 7ff5d5fff700 1 --2- 172.21.15.179:0/3547884385 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5d00b8660 0x7ff5d00cb380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:49.441 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.439+0000 7ff5d5fff700 1 -- 172.21.15.179:0/3547884385 >> 172.21.15.179:0/3547884385 conn(0x7ff5d0066860 msgr2=0x7ff5d00d1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:12:49.442 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.439+0000 7ff5d5fff700 1 -- 172.21.15.179:0/3547884385 shutdown_connections 2023-07-14T11:12:49.442 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.439+0000 7ff5d5fff700 1 -- 172.21.15.179:0/3547884385 wait complete. 2023-07-14T11:12:49.459 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new 37ad400d-d06a-4888-9719-ae5d53b73128 5 2023-07-14T11:12:49.695 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.694+0000 7f11189ff700 1 Processor -- start 2023-07-14T11:12:49.696 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.694+0000 7f11189ff700 1 -- start start 2023-07-14T11:12:49.697 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.695+0000 7f11189ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f11140b4600 0x7f11140cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:12:49.697 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.695+0000 7f11189ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f11140cfe40 0x7f11140d02b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:12:49.697 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.695+0000 7f11189ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f111415cd60 con 0x7f11140cd540 2023-07-14T11:12:49.697 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.695+0000 7f11189ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11140d1550 con 0x7f11140b4600 2023-07-14T11:12:49.697 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.695+0000 7f11189ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11140d2d90 con 0x7f11140cfe40 2023-07-14T11:12:49.698 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.695+0000 7f110bfff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f11140cfe40 0x7f11140d02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:12:49.698 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.695+0000 7f110bfff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f11140cfe40 0x7f11140d02b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:38492/0 (socket says 172.21.15.179:38492) 2023-07-14T11:12:49.698 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.695+0000 7f110bfff700 1 -- 172.21.15.179:0/561976229 learned_addr learned my addr 172.21.15.179:0/561976229 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-07-14T11:12:49.698 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.695+0000 7f111259c700 1 --2- 172.21.15.179:0/561976229 >> v2:172.21.15.84:3300/0 conn(0x7f11140b4600 0x7f11140cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:12:49.699 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.696+0000 7f110bfff700 1 -- 172.21.15.179:0/561976229 >> v2:172.21.15.84:3300/0 conn(0x7f11140b4600 msgr2=0x7f11140cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:12:49.699 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.696+0000 7f110bfff700 1 --2- 172.21.15.179:0/561976229 >> v2:172.21.15.84:3300/0 conn(0x7f11140b4600 0x7f11140cf900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:49.700 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.696+0000 7f110bfff700 1 -- 172.21.15.179:0/561976229 >> v1:172.21.15.179:6789/0 conn(0x7f11140cd540 legacy=0x7f11140cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:12:49.700 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.696+0000 7f110bfff700 1 -- 172.21.15.179:0/561976229 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11140cf340 con 0x7f11140cfe40 2023-07-14T11:12:49.700 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.696+0000 7f110bfff700 1 --2- 172.21.15.179:0/561976229 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11140cfe40 0x7f11140d02b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f111408bdb0 tx=0x7f10fc009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1758043a499b8202 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:12:49.700 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.696+0000 7f1111d9b700 1 -- 172.21.15.179:0/561976229 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10fc00b870 con 0x7f11140cfe40 2023-07-14T11:12:49.700 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.696+0000 7f1111d9b700 1 -- 172.21.15.179:0/561976229 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10fc00b9d0 con 0x7f11140cfe40 2023-07-14T11:12:49.700 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.696+0000 7f1111d9b700 1 -- 172.21.15.179:0/561976229 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10fc00bd60 con 0x7f11140cfe40 2023-07-14T11:12:49.700 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.697+0000 7f11189ff700 1 -- 172.21.15.179:0/561976229 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11140cfe40 msgr2=0x7f11140d02b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:12:49.701 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.697+0000 7f11189ff700 1 --2- 172.21.15.179:0/561976229 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11140cfe40 0x7f11140d02b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f111408bdb0 tx=0x7f10fc009bd0 comp rx=0 tx=0).stop 2023-07-14T11:12:49.701 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.697+0000 7f11189ff700 1 -- 172.21.15.179:0/561976229 shutdown_connections 2023-07-14T11:12:49.701 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.697+0000 7f11189ff700 1 --2- 172.21.15.179:0/561976229 >> v2:172.21.15.84:3300/0 conn(0x7f11140b4600 0x7f11140cf900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:49.701 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.697+0000 7f11189ff700 1 --2- 172.21.15.179:0/561976229 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11140cfe40 0x7f11140d02b0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:49.701 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.697+0000 7f11189ff700 1 -- 172.21.15.179:0/561976229 >> 172.21.15.179:0/561976229 conn(0x7f111409c200 msgr2=0x7f11140d2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:12:49.701 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.697+0000 7f11189ff700 1 -- 172.21.15.179:0/561976229 shutdown_connections 2023-07-14T11:12:49.701 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.697+0000 7f11189ff700 1 -- 172.21.15.179:0/561976229 wait complete. 2023-07-14T11:12:49.702 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.699+0000 7f11189ff700 1 Processor -- start 2023-07-14T11:12:49.702 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.700+0000 7f11189ff700 1 -- start start 2023-07-14T11:12:49.703 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.701+0000 7f11189ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11140cd540 0x7f11141480d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:12:49.703 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.701+0000 7f11189ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11140cfe40 0x7f111415b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:12:49.704 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.701+0000 7f11189ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11141497a0 0x7f11140c6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:12:49.704 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.701+0000 7f11189ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f111415b5c0 con 0x7f11140cd540 2023-07-14T11:12:49.704 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.701+0000 7f11189ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f111415bab0 con 0x7f11140cfe40 2023-07-14T11:12:49.704 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.701+0000 7f11189ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1114147e40 con 0x7f11141497a0 2023-07-14T11:12:49.704 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.702+0000 7f1112d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11141497a0 0x7f11140c6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:12:49.704 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.702+0000 7f110bfff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11140cfe40 0x7f111415b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:12:49.704 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.702+0000 7f110bfff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11140cfe40 0x7f111415b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:38508/0 (socket says 172.21.15.179:38508) 2023-07-14T11:12:49.705 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.702+0000 7f110bfff700 1 -- 172.21.15.179:0/3772324730 learned_addr learned my addr 172.21.15.179:0/3772324730 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-07-14T11:12:49.705 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.702+0000 7f111259c700 1 --2- 172.21.15.179:0/3772324730 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11140cd540 0x7f11141480d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:12:49.706 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.702+0000 7f110bfff700 1 -- 172.21.15.179:0/3772324730 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11141497a0 msgr2=0x7f11140c6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:12:49.706 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.702+0000 7f110bfff700 1 --2- 172.21.15.179:0/3772324730 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11141497a0 0x7f11140c6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:49.706 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.702+0000 7f110bfff700 1 -- 172.21.15.179:0/3772324730 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11140cd540 msgr2=0x7f11141480d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:12:49.706 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.702+0000 7f110bfff700 1 --2- 172.21.15.179:0/3772324730 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11140cd540 0x7f11141480d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:49.706 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.702+0000 7f110bfff700 1 -- 172.21.15.179:0/3772324730 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10fc009550 con 0x7f11140cfe40 2023-07-14T11:12:49.707 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.702+0000 7f110bfff700 1 --2- 172.21.15.179:0/3772324730 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11140cfe40 0x7f111415b080 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f10fc009c10 tx=0x7f10fc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:12:49.707 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.702+0000 7f110affd700 1 -- 172.21.15.179:0/3772324730 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10fc004250 con 0x7f11140cfe40 2023-07-14T11:12:49.707 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.703+0000 7f110affd700 1 -- 172.21.15.179:0/3772324730 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10fc01f070 con 0x7f11140cfe40 2023-07-14T11:12:49.707 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.703+0000 7f110affd700 1 -- 172.21.15.179:0/3772324730 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10fc0045b0 con 0x7f11140cfe40 2023-07-14T11:12:49.707 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.703+0000 7f11189ff700 1 -- 172.21.15.179:0/3772324730 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1114148700 con 0x7f11140cfe40 2023-07-14T11:12:49.707 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.703+0000 7f11189ff700 1 -- 172.21.15.179:0/3772324730 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1114148cc0 con 0x7f11140cfe40 2023-07-14T11:12:49.707 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.703+0000 7f110affd700 1 -- 172.21.15.179:0/3772324730 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f10fc021030 con 0x7f11140cfe40 2023-07-14T11:12:49.707 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.703+0000 7f110affd700 1 -- 172.21.15.179:0/3772324730 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f10fc024840 con 0x7f11140cfe40 2023-07-14T11:12:49.708 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.704+0000 7f11189ff700 1 -- 172.21.15.179:0/3772324730 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1114074350 con 0x7f11140cfe40 2023-07-14T11:12:49.708 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.706+0000 7f110affd700 1 -- 172.21.15.179:0/3772324730 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f10fc044b20 con 0x7f11140cfe40 2023-07-14T11:12:49.794 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.792+0000 7f11189ff700 1 -- 172.21.15.179:0/3772324730 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd new", "uuid": "37ad400d-d06a-4888-9719-ae5d53b73128", "id": 5} v 0) v1 -- 0x7f11140d1830 con 0x7f11140cfe40 2023-07-14T11:12:49.800 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.798+0000 7f110affd700 1 -- 172.21.15.179:0/3772324730 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "37ad400d-d06a-4888-9719-ae5d53b73128", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f10fc033030 con 0x7f11140cfe40 2023-07-14T11:12:49.800 INFO:teuthology.orchestra.run.smithi179.stdout:5 2023-07-14T11:12:49.801 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.799+0000 7f11189ff700 1 -- 172.21.15.179:0/3772324730 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11140cfe40 msgr2=0x7f111415b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:12:49.801 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.799+0000 7f11189ff700 1 --2- 172.21.15.179:0/3772324730 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11140cfe40 0x7f111415b080 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f10fc009c10 tx=0x7f10fc004750 comp rx=0 tx=0).stop 2023-07-14T11:12:49.801 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.799+0000 7f11189ff700 1 -- 172.21.15.179:0/3772324730 shutdown_connections 2023-07-14T11:12:49.801 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.799+0000 7f11189ff700 1 --2- 172.21.15.179:0/3772324730 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11141497a0 0x7f11140c6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:49.801 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.799+0000 7f11189ff700 1 --2- 172.21.15.179:0/3772324730 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11140cd540 0x7f11141480d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:49.802 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.799+0000 7f11189ff700 1 --2- 172.21.15.179:0/3772324730 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11140cfe40 0x7f111415b080 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:49.802 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.799+0000 7f11189ff700 1 -- 172.21.15.179:0/3772324730 >> 172.21.15.179:0/3772324730 conn(0x7f111409c200 msgr2=0x7f11140b49e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:12:49.802 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.799+0000 7f11189ff700 1 -- 172.21.15.179:0/3772324730 shutdown_connections 2023-07-14T11:12:49.802 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:49.799+0000 7f11189ff700 1 -- 172.21.15.179:0/3772324730 wait complete. 2023-07-14T11:12:49.820 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new 79f265bc-42b0-496b-b3aa-5d1356c80a32 6 2023-07-14T11:12:49.882 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:12:49.880+0000 7fed98b92200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-14T11:12:49.975 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:12:49.973+0000 7fed98b92200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-14T11:12:50.016 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.014+0000 7f0e2e7ff700 1 Processor -- start 2023-07-14T11:12:50.017 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.015+0000 7f0e2e7ff700 1 -- start start 2023-07-14T11:12:50.021 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.017+0000 7f0e2e7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e280b21f0 0x7f0e280cfc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:12:50.021 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.017+0000 7f0e2e7ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e280cd8e0 con 0x7f0e280cf890 2023-07-14T11:12:50.021 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.017+0000 7f0e2e7ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e280d2760 con 0x7f0e280d29c0 2023-07-14T11:12:50.021 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.017+0000 7f0e2e7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e280d01a0 con 0x7f0e280b21f0 2023-07-14T11:12:50.022 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.017+0000 7f0e277fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e280b21f0 0x7f0e280cfc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:12:50.022 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.017+0000 7f0e27fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f0e280cf890 0x7f0e280cf030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.179:55694/0 (socket says 172.21.15.179:55694) 2023-07-14T11:12:50.022 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.017+0000 7f0e27fff700 1 -- 172.21.15.179:0/296830144 learned_addr learned my addr 172.21.15.179:0/296830144 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-07-14T11:12:50.022 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.017+0000 7f0e277fe700 1 -- 172.21.15.179:0/296830144 >> v1:172.21.15.179:6789/0 conn(0x7f0e280d29c0 legacy=0x7f0e280d2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:12:50.023 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.017+0000 7f0e26ffd700 1 -- 172.21.15.179:0/296830144 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 378448150 0 0) 0x7f0e280cd8e0 con 0x7f0e280cf890 2023-07-14T11:12:50.023 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.017+0000 7f0e277fe700 1 -- 172.21.15.179:0/296830144 >> v1:172.21.15.84:6789/0 conn(0x7f0e280cf890 legacy=0x7f0e280cf030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:12:50.023 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.017+0000 7f0e277fe700 1 -- 172.21.15.179:0/296830144 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e280d1740 con 0x7f0e280b21f0 2023-07-14T11:12:50.024 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.018+0000 7f0e277fe700 1 --2- 172.21.15.179:0/296830144 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e280b21f0 0x7f0e280cfc60 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c009870 tx=0x7f0e1c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51151390b91bf309 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:12:50.024 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.018+0000 7f0e26ffd700 1 -- 172.21.15.179:0/296830144 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c011830 con 0x7f0e280b21f0 2023-07-14T11:12:50.024 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.018+0000 7f0e26ffd700 1 -- 172.21.15.179:0/296830144 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e1c011990 con 0x7f0e280b21f0 2023-07-14T11:12:50.024 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.018+0000 7f0e26ffd700 1 -- 172.21.15.179:0/296830144 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c011d20 con 0x7f0e280b21f0 2023-07-14T11:12:50.025 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.018+0000 7f0e2e7ff700 1 -- 172.21.15.179:0/296830144 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e280b21f0 msgr2=0x7f0e280cfc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:12:50.025 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.018+0000 7f0e2e7ff700 1 --2- 172.21.15.179:0/296830144 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e280b21f0 0x7f0e280cfc60 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c009870 tx=0x7f0e1c009b80 comp rx=0 tx=0).stop 2023-07-14T11:12:50.025 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.019+0000 7f0e2e7ff700 1 -- 172.21.15.179:0/296830144 shutdown_connections 2023-07-14T11:12:50.025 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.019+0000 7f0e2e7ff700 1 --2- 172.21.15.179:0/296830144 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e280b21f0 0x7f0e280cfc60 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:50.026 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.019+0000 7f0e2e7ff700 1 -- 172.21.15.179:0/296830144 >> 172.21.15.179:0/296830144 conn(0x7f0e2806c170 msgr2=0x7f0e2806c540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:12:50.026 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.019+0000 7f0e2e7ff700 1 -- 172.21.15.179:0/296830144 shutdown_connections 2023-07-14T11:12:50.026 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.019+0000 7f0e2e7ff700 1 -- 172.21.15.179:0/296830144 wait complete. 2023-07-14T11:12:50.027 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-07-14T11:12:50.019+0000 7f8eb188c200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-14T11:12:50.030 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.020+0000 7f0e2e7ff700 1 Processor -- start 2023-07-14T11:12:50.030 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.020+0000 7f0e2e7ff700 1 -- start start 2023-07-14T11:12:50.030 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.021+0000 7f0e2e7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e280b21f0 0x7f0e280caf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:12:50.031 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.021+0000 7f0e2e7ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e280cf890 0x7f0e281f5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:12:50.031 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.021+0000 7f0e2e7ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e280d29c0 0x7f0e281596a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:12:50.031 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.021+0000 7f0e2e7ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e281f6110 con 0x7f0e280d29c0 2023-07-14T11:12:50.031 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.021+0000 7f0e2e7ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e281f6390 con 0x7f0e280cf890 2023-07-14T11:12:50.032 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.021+0000 7f0e2e7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e281f6670 con 0x7f0e280b21f0 2023-07-14T11:12:50.032 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.022+0000 7f0e27fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e280b21f0 0x7f0e280caf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:12:50.032 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.022+0000 7f0e277fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e280cf890 0x7f0e281f5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:12:50.033 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.022+0000 7f0e277fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e280cf890 0x7f0e281f5bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:38516/0 (socket says 172.21.15.179:38516) 2023-07-14T11:12:50.033 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.022+0000 7f0e277fe700 1 -- 172.21.15.179:0/34023869 learned_addr learned my addr 172.21.15.179:0/34023869 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-07-14T11:12:50.033 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.022+0000 7f0e2cd9c700 1 --2- 172.21.15.179:0/34023869 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e280d29c0 0x7f0e281596a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:12:50.033 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.022+0000 7f0e27fff700 1 -- 172.21.15.179:0/34023869 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e280cf890 msgr2=0x7f0e281f5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:12:50.034 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.022+0000 7f0e27fff700 1 --2- 172.21.15.179:0/34023869 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e280cf890 0x7f0e281f5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:50.034 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.022+0000 7f0e27fff700 1 -- 172.21.15.179:0/34023869 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e280d29c0 msgr2=0x7f0e281596a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:12:50.034 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.022+0000 7f0e27fff700 1 --2- 172.21.15.179:0/34023869 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e280d29c0 0x7f0e281596a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:50.034 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.022+0000 7f0e27fff700 1 -- 172.21.15.179:0/34023869 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e1c0094a0 con 0x7f0e280b21f0 2023-07-14T11:12:50.035 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.022+0000 7f0e277fe700 1 --2- 172.21.15.179:0/34023869 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e280cf890 0x7f0e281f5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:12:50.035 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.022+0000 7f0e27fff700 1 --2- 172.21.15.179:0/34023869 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e280b21f0 0x7f0e280caf40 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0e1800c4b0 tx=0x7f0e1800c7c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:12:50.035 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.023+0000 7f0e24ff9700 1 -- 172.21.15.179:0/34023869 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e18004c80 con 0x7f0e280b21f0 2023-07-14T11:12:50.035 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.023+0000 7f0e24ff9700 1 -- 172.21.15.179:0/34023869 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e18004e00 con 0x7f0e280b21f0 2023-07-14T11:12:50.036 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.023+0000 7f0e24ff9700 1 -- 172.21.15.179:0/34023869 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e18007310 con 0x7f0e280b21f0 2023-07-14T11:12:50.036 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.023+0000 7f0e2e7ff700 1 -- 172.21.15.179:0/34023869 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e281f6950 con 0x7f0e280b21f0 2023-07-14T11:12:50.036 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.023+0000 7f0e2e7ff700 1 -- 172.21.15.179:0/34023869 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e28159be0 con 0x7f0e280b21f0 2023-07-14T11:12:50.036 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.023+0000 7f0e24ff9700 1 -- 172.21.15.179:0/34023869 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0e180133c0 con 0x7f0e280b21f0 2023-07-14T11:12:50.037 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.023+0000 7f0e24ff9700 1 -- 172.21.15.179:0/34023869 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f0e18013c60 con 0x7f0e280b21f0 2023-07-14T11:12:50.037 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.024+0000 7f0e2e7ff700 1 -- 172.21.15.179:0/34023869 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e28067350 con 0x7f0e280b21f0 2023-07-14T11:12:50.037 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.026+0000 7f0e24ff9700 1 -- 172.21.15.179:0/34023869 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f0e18013670 con 0x7f0e280b21f0 2023-07-14T11:12:50.114 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.112+0000 7f0e2e7ff700 1 -- 172.21.15.179:0/34023869 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd new", "uuid": "79f265bc-42b0-496b-b3aa-5d1356c80a32", "id": 6} v 0) v1 -- 0x7f0e28073220 con 0x7f0e280b21f0 2023-07-14T11:12:50.117 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-07-14T11:12:50.115+0000 7f8eb188c200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-14T11:12:50.118 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.116+0000 7f0e24ff9700 1 -- 172.21.15.179:0/34023869 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "79f265bc-42b0-496b-b3aa-5d1356c80a32", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0e18013810 con 0x7f0e280b21f0 2023-07-14T11:12:50.118 INFO:teuthology.orchestra.run.smithi179.stdout:6 2023-07-14T11:12:50.119 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.117+0000 7f0e2e7ff700 1 -- 172.21.15.179:0/34023869 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e280b21f0 msgr2=0x7f0e280caf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:12:50.120 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.117+0000 7f0e2e7ff700 1 --2- 172.21.15.179:0/34023869 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e280b21f0 0x7f0e280caf40 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0e1800c4b0 tx=0x7f0e1800c7c0 comp rx=0 tx=0).stop 2023-07-14T11:12:50.120 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.118+0000 7f0e2e7ff700 1 -- 172.21.15.179:0/34023869 shutdown_connections 2023-07-14T11:12:50.120 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.118+0000 7f0e2e7ff700 1 --2- 172.21.15.179:0/34023869 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e280b21f0 0x7f0e280caf40 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:50.120 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.118+0000 7f0e2e7ff700 1 --2- 172.21.15.179:0/34023869 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e280d29c0 0x7f0e281596a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:50.120 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.118+0000 7f0e2e7ff700 1 --2- 172.21.15.179:0/34023869 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e280cf890 0x7f0e281f5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:50.120 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.118+0000 7f0e2e7ff700 1 -- 172.21.15.179:0/34023869 >> 172.21.15.179:0/34023869 conn(0x7f0e2806c170 msgr2=0x7f0e280b6870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:12:50.121 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.118+0000 7f0e2e7ff700 1 -- 172.21.15.179:0/34023869 shutdown_connections 2023-07-14T11:12:50.121 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.118+0000 7f0e2e7ff700 1 -- 172.21.15.179:0/34023869 wait complete. 2023-07-14T11:12:50.136 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new 9aac86cf-4c87-4536-be1a-d2db27abe4a2 7 2023-07-14T11:12:50.144 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:12:50.142+0000 7fed98b92200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-14T11:12:50.233 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:12:50.231+0000 7fed98b92200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-14T11:12:50.291 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-07-14T11:12:50.289+0000 7f8eb188c200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-14T11:12:50.328 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.326+0000 7f33e95ff700 1 Processor -- start 2023-07-14T11:12:50.328 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.326+0000 7f33e95ff700 1 -- start start 2023-07-14T11:12:50.330 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.328+0000 7f33e95ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f33e40b8660 0x7f33e40cd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:12:50.330 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.328+0000 7f33e95ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f33e40b4f70 0x7f33e40d12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:12:50.330 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.328+0000 7f33e95ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33e40d02a0 con 0x7f33e40cd970 2023-07-14T11:12:50.330 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.328+0000 7f33e95ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33e40cfce0 con 0x7f33e40b8660 2023-07-14T11:12:50.330 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.328+0000 7f33e95ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33e40cffc0 con 0x7f33e40b4f70 2023-07-14T11:12:50.331 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.328+0000 7f33dbfff700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f33e40cd970 0x7f33e40b4860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:41910/0 (socket says 172.21.15.179:41910) 2023-07-14T11:12:50.331 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.328+0000 7f33dbfff700 1 -- 172.21.15.179:0/1422803428 learned_addr learned my addr 172.21.15.179:0/1422803428 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-07-14T11:12:50.331 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.328+0000 7f33e37fe700 1 --2- 172.21.15.179:0/1422803428 >> v2:172.21.15.179:3300/0 conn(0x7f33e40b4f70 0x7f33e40d12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:12:50.331 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.328+0000 7f33e2ffd700 1 --2- 172.21.15.179:0/1422803428 >> v2:172.21.15.84:3300/0 conn(0x7f33e40b8660 0x7f33e40cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:12:50.332 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.328+0000 7f33e27fc700 1 -- 172.21.15.179:0/1422803428 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 283890244 0 0) 0x7f33e40d02a0 con 0x7f33e40cd970 2023-07-14T11:12:50.333 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.328+0000 7f33e27fc700 1 -- 172.21.15.179:0/1422803428 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33d00035b0 con 0x7f33e40cd970 2023-07-14T11:12:50.333 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.328+0000 7f33e37fe700 1 -- 172.21.15.179:0/1422803428 >> v2:172.21.15.84:3300/0 conn(0x7f33e40b8660 msgr2=0x7f33e40cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:12:50.333 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.328+0000 7f33e37fe700 1 --2- 172.21.15.179:0/1422803428 >> v2:172.21.15.84:3300/0 conn(0x7f33e40b8660 0x7f33e40cd430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:50.333 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.328+0000 7f33e37fe700 1 -- 172.21.15.179:0/1422803428 >> v1:172.21.15.179:6789/0 conn(0x7f33e40cd970 legacy=0x7f33e40b4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:12:50.333 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.329+0000 7f33e37fe700 1 -- 172.21.15.179:0/1422803428 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e40d0ac0 con 0x7f33e40b4f70 2023-07-14T11:12:50.333 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.329+0000 7f33e37fe700 1 --2- 172.21.15.179:0/1422803428 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33e40b4f70 0x7f33e40d12c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f33e40b8f20 tx=0x7f33dc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8bf79b70aa1fdb22 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:12:50.333 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.329+0000 7f33e27fc700 1 -- 172.21.15.179:0/1422803428 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33dc00e070 con 0x7f33e40b4f70 2023-07-14T11:12:50.334 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.329+0000 7f33e27fc700 1 -- 172.21.15.179:0/1422803428 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33dc00bb20 con 0x7f33e40b4f70 2023-07-14T11:12:50.334 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.329+0000 7f33e27fc700 1 -- 172.21.15.179:0/1422803428 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33dc012430 con 0x7f33e40b4f70 2023-07-14T11:12:50.334 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.330+0000 7f33e95ff700 1 -- 172.21.15.179:0/1422803428 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33e40b4f70 msgr2=0x7f33e40d12c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:12:50.334 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.330+0000 7f33e95ff700 1 --2- 172.21.15.179:0/1422803428 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33e40b4f70 0x7f33e40d12c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f33e40b8f20 tx=0x7f33dc00b330 comp rx=0 tx=0).stop 2023-07-14T11:12:50.334 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.330+0000 7f33e95ff700 1 -- 172.21.15.179:0/1422803428 shutdown_connections 2023-07-14T11:12:50.334 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.330+0000 7f33e95ff700 1 --2- 172.21.15.179:0/1422803428 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33e40b4f70 0x7f33e40d12c0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:50.335 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.330+0000 7f33e95ff700 1 --2- 172.21.15.179:0/1422803428 >> v2:172.21.15.84:3300/0 conn(0x7f33e40b8660 0x7f33e40cd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:50.335 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.330+0000 7f33e95ff700 1 -- 172.21.15.179:0/1422803428 >> 172.21.15.179:0/1422803428 conn(0x7f33e4066860 msgr2=0x7f33e406a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:12:50.335 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.330+0000 7f33e95ff700 1 -- 172.21.15.179:0/1422803428 shutdown_connections 2023-07-14T11:12:50.335 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.330+0000 7f33e95ff700 1 -- 172.21.15.179:0/1422803428 wait complete. 2023-07-14T11:12:50.337 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.332+0000 7f33e95ff700 1 Processor -- start 2023-07-14T11:12:50.337 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.332+0000 7f33e95ff700 1 -- start start 2023-07-14T11:12:50.337 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.333+0000 7f33e95ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33e40b4f70 0x7f33e4151d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:12:50.337 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.333+0000 7f33e95ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33e40b8660 0x7f33e41557d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:12:50.337 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.333+0000 7f33e95ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33e40cd970 0x7f33e415aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:12:50.338 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.333+0000 7f33e95ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e4153de0 con 0x7f33e40b8660 2023-07-14T11:12:50.338 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.333+0000 7f33e95ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e41522b0 con 0x7f33e40cd970 2023-07-14T11:12:50.338 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.333+0000 7f33e95ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33e4153160 con 0x7f33e40b4f70 2023-07-14T11:12:50.338 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.333+0000 7f33e2ffd700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33e40b4f70 0x7f33e4151d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:12:50.338 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.333+0000 7f33e2ffd700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33e40b4f70 0x7f33e4151d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.179:57708/0 (socket says 172.21.15.179:57708) 2023-07-14T11:12:50.338 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.333+0000 7f33e2ffd700 1 -- 172.21.15.179:0/119535924 learned_addr learned my addr 172.21.15.179:0/119535924 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-07-14T11:12:50.338 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.333+0000 7f33e37fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33e40cd970 0x7f33e415aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:12:50.339 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.333+0000 7f33dbfff700 1 --2- 172.21.15.179:0/119535924 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33e40b8660 0x7f33e41557d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:12:50.339 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.333+0000 7f33e2ffd700 1 -- 172.21.15.179:0/119535924 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33e40cd970 msgr2=0x7f33e415aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:12:50.339 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.333+0000 7f33e2ffd700 1 --2- 172.21.15.179:0/119535924 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33e40cd970 0x7f33e415aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:50.339 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.333+0000 7f33e2ffd700 1 -- 172.21.15.179:0/119535924 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33e40b8660 msgr2=0x7f33e41557d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:12:50.339 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.333+0000 7f33e2ffd700 1 --2- 172.21.15.179:0/119535924 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33e40b8660 0x7f33e41557d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:50.339 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.333+0000 7f33e2ffd700 1 -- 172.21.15.179:0/119535924 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33dc009a70 con 0x7f33e40b4f70 2023-07-14T11:12:50.339 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.334+0000 7f33e2ffd700 1 --2- 172.21.15.179:0/119535924 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33e40b4f70 0x7f33e4151d70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f33d400e9e0 tx=0x7f33d400ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:12:50.339 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.334+0000 7f33db7fe700 1 -- 172.21.15.179:0/119535924 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d4009710 con 0x7f33e40b4f70 2023-07-14T11:12:50.340 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.334+0000 7f33db7fe700 1 -- 172.21.15.179:0/119535924 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33d400ee80 con 0x7f33e40b4f70 2023-07-14T11:12:50.340 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.334+0000 7f33db7fe700 1 -- 172.21.15.179:0/119535924 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d400ca50 con 0x7f33e40b4f70 2023-07-14T11:12:50.340 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.334+0000 7f33e95ff700 1 -- 172.21.15.179:0/119535924 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33e4153440 con 0x7f33e40b4f70 2023-07-14T11:12:50.340 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.334+0000 7f33e95ff700 1 -- 172.21.15.179:0/119535924 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33e4153a00 con 0x7f33e40b4f70 2023-07-14T11:12:50.340 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.334+0000 7f33db7fe700 1 -- 172.21.15.179:0/119535924 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f33d4013470 con 0x7f33e40b4f70 2023-07-14T11:12:50.340 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.334+0000 7f33db7fe700 1 -- 172.21.15.179:0/119535924 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f33d4013d80 con 0x7f33e40b4f70 2023-07-14T11:12:50.340 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.335+0000 7f33e95ff700 1 -- 172.21.15.179:0/119535924 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33e4074350 con 0x7f33e40b4f70 2023-07-14T11:12:50.341 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.338+0000 7f33db7fe700 1 -- 172.21.15.179:0/119535924 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f33d4021060 con 0x7f33e40b4f70 2023-07-14T11:12:50.385 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-07-14T11:12:50.383+0000 7f8eb188c200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-14T11:12:50.425 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.424+0000 7f33e95ff700 1 -- 172.21.15.179:0/119535924 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd new", "uuid": "9aac86cf-4c87-4536-be1a-d2db27abe4a2", "id": 7} v 0) v1 -- 0x7f33e40b2150 con 0x7f33e40b4f70 2023-07-14T11:12:50.432 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.430+0000 7f33db7fe700 1 -- 172.21.15.179:0/119535924 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9aac86cf-4c87-4536-be1a-d2db27abe4a2", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f33d4017070 con 0x7f33e40b4f70 2023-07-14T11:12:50.432 INFO:teuthology.orchestra.run.smithi179.stdout:7 2023-07-14T11:12:50.433 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.431+0000 7f33e95ff700 1 -- 172.21.15.179:0/119535924 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33e40b4f70 msgr2=0x7f33e4151d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:12:50.433 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.431+0000 7f33e95ff700 1 --2- 172.21.15.179:0/119535924 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33e40b4f70 0x7f33e4151d70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f33d400e9e0 tx=0x7f33d400ecf0 comp rx=0 tx=0).stop 2023-07-14T11:12:50.433 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.431+0000 7f33e95ff700 1 -- 172.21.15.179:0/119535924 shutdown_connections 2023-07-14T11:12:50.434 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.431+0000 7f33e95ff700 1 --2- 172.21.15.179:0/119535924 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33e40b4f70 0x7f33e4151d70 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:50.434 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.431+0000 7f33e95ff700 1 --2- 172.21.15.179:0/119535924 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33e40cd970 0x7f33e415aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:50.434 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.431+0000 7f33e95ff700 1 --2- 172.21.15.179:0/119535924 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33e40b8660 0x7f33e41557d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:50.434 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.431+0000 7f33e95ff700 1 -- 172.21.15.179:0/119535924 >> 172.21.15.179:0/119535924 conn(0x7f33e4066860 msgr2=0x7f33e40b4590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:12:50.434 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.431+0000 7f33e95ff700 1 -- 172.21.15.179:0/119535924 shutdown_connections 2023-07-14T11:12:50.434 INFO:teuthology.orchestra.run.smithi179.stderr:2023-07-14T11:12:50.431+0000 7f33e95ff700 1 -- 172.21.15.179:0/119535924 wait complete. 2023-07-14T11:12:50.450 INFO:tasks.ceph.osd.0:Restarting daemon 2023-07-14T11:12:50.451 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-07-14T11:12:50.455 INFO:tasks.ceph.osd.0:Started 2023-07-14T11:12:50.455 INFO:tasks.ceph.osd.1:Restarting daemon 2023-07-14T11:12:50.456 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-07-14T11:12:50.456 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:12:50.451+0000 7fed98b92200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-14T11:12:50.460 INFO:tasks.ceph.osd.1:Started 2023-07-14T11:12:50.460 INFO:tasks.ceph.osd.2:Restarting daemon 2023-07-14T11:12:50.460 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-07-14T11:12:50.465 INFO:tasks.ceph.osd.2:Started 2023-07-14T11:12:50.465 INFO:tasks.ceph.osd.3:Restarting daemon 2023-07-14T11:12:50.466 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-07-14T11:12:50.471 INFO:tasks.ceph.osd.3:Started 2023-07-14T11:12:50.471 INFO:tasks.ceph.osd.4:Restarting daemon 2023-07-14T11:12:50.472 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-07-14T11:12:50.476 INFO:tasks.ceph.osd.4:Started 2023-07-14T11:12:50.476 INFO:tasks.ceph.osd.5:Restarting daemon 2023-07-14T11:12:50.476 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-07-14T11:12:50.480 INFO:tasks.ceph.osd.5:Started 2023-07-14T11:12:50.480 INFO:tasks.ceph.osd.6:Restarting daemon 2023-07-14T11:12:50.481 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-07-14T11:12:50.486 INFO:tasks.ceph.osd.6:Started 2023-07-14T11:12:50.486 INFO:tasks.ceph.osd.7:Restarting daemon 2023-07-14T11:12:50.487 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-07-14T11:12:50.492 INFO:tasks.ceph.osd.7:Started 2023-07-14T11:12:50.493 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:12:50.600 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:12:50.599+0000 7fed98b92200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-14T11:12:50.638 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-07-14T11:12:50.636+0000 7f8eb188c200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-14T11:12:50.720 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:12:50.718+0000 7fed98b92200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-14T11:12:50.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:50.737+0000 7f9120bff700 1 Processor -- start 2023-07-14T11:12:50.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:50.738+0000 7f9120bff700 1 -- start start 2023-07-14T11:12:50.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:50.739+0000 7f9120bff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f911c0d1220 0x7f911c0b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:12:50.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:50.739+0000 7f9120bff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f911c0b1e00 0x7f911c0afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:12:50.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:50.739+0000 7f9120bff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f911c0d2ce0 con 0x7f911c15c950 2023-07-14T11:12:50.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:50.739+0000 7f9120bff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f911c0b3350 con 0x7f911c0b1e00 2023-07-14T11:12:50.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:50.739+0000 7f9120bff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f911c0b3630 con 0x7f911c0d1220 2023-07-14T11:12:50.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:50.739+0000 7f911ad9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f911c0b1e00 0x7f911c0afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:12:50.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:50.739+0000 7f9113fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f911c0d1220 0x7f911c0b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:12:50.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:50.739+0000 7f9113fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f911c0d1220 0x7f911c0b43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.84:54532/0 (socket says 172.21.15.84:54532) 2023-07-14T11:12:50.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:50.739+0000 7f911ad9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f911c0b1e00 0x7f911c0afac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41906/0 (socket says 172.21.15.84:41906) 2023-07-14T11:12:50.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:50.739+0000 7f9113fff700 1 -- 172.21.15.84:0/4165365881 learned_addr learned my addr 172.21.15.84:0/4165365881 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:12:50.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:50.739+0000 7f911ad9d700 1 -- 172.21.15.84:0/4165365881 >> v2:172.21.15.179:3300/0 conn(0x7f911c0d1220 msgr2=0x7f911c0b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:12:50.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:50.739+0000 7f911ad9d700 1 --2- 172.21.15.84:0/4165365881 >> v2:172.21.15.179:3300/0 conn(0x7f911c0d1220 0x7f911c0b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:50.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:50.739+0000 7f911ad9d700 1 -- 172.21.15.84:0/4165365881 >> v1:172.21.15.179:6789/0 conn(0x7f911c15c950 legacy=0x7f911c0d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:12:50.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:50.739+0000 7f911ad9d700 1 -- 172.21.15.84:0/4165365881 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f911c0b3910 con 0x7f911c0b1e00 2023-07-14T11:12:50.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:50.740+0000 7f911ad9d700 1 --2- 172.21.15.84:0/4165365881 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f911c0b1e00 0x7f911c0afac0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f911c072140 tx=0x7f911400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0b993940c2d2dd7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:12:50.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:50.740+0000 7f9119d9b700 1 -- 172.21.15.84:0/4165365881 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911400e070 con 0x7f911c0b1e00 2023-07-14T11:12:50.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:50.740+0000 7f9119d9b700 1 -- 172.21.15.84:0/4165365881 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f911400bb20 con 0x7f911c0b1e00 2023-07-14T11:12:50.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:50.740+0000 7f9119d9b700 1 -- 172.21.15.84:0/4165365881 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9114012430 con 0x7f911c0b1e00 2023-07-14T11:12:50.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:50.741+0000 7f9120bff700 1 -- 172.21.15.84:0/4165365881 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f911c0b1e00 msgr2=0x7f911c0afac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:12:50.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:50.741+0000 7f9120bff700 1 --2- 172.21.15.84:0/4165365881 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f911c0b1e00 0x7f911c0afac0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f911c072140 tx=0x7f911400b330 comp rx=0 tx=0).stop 2023-07-14T11:12:50.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:50.741+0000 7f9120bff700 1 -- 172.21.15.84:0/4165365881 shutdown_connections 2023-07-14T11:12:50.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:50.741+0000 7f9120bff700 1 --2- 172.21.15.84:0/4165365881 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f911c0b1e00 0x7f911c0afac0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:50.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:50.741+0000 7f9120bff700 1 --2- 172.21.15.84:0/4165365881 >> v2:172.21.15.179:3300/0 conn(0x7f911c0d1220 0x7f911c0b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:50.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:50.741+0000 7f9120bff700 1 -- 172.21.15.84:0/4165365881 >> 172.21.15.84:0/4165365881 conn(0x7f911c09c1d0 msgr2=0x7f911c0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:12:50.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:50.741+0000 7f9120bff700 1 -- 172.21.15.84:0/4165365881 shutdown_connections 2023-07-14T11:12:50.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:50.741+0000 7f9120bff700 1 -- 172.21.15.84:0/4165365881 wait complete. 2023-07-14T11:12:50.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:50.743+0000 7f9120bff700 1 Processor -- start 2023-07-14T11:12:50.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:50.743+0000 7f9120bff700 1 -- start start 2023-07-14T11:12:50.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:50.744+0000 7f9120bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f911c0b1e00 0x7f911c156d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:12:50.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:50.744+0000 7f9120bff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f911c0d1220 0x7f911c0cc810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:12:50.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:50.744+0000 7f9120bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f911c15c950 0x7f911c0c8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:12:50.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:50.744+0000 7f9120bff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f911c1572c0 con 0x7f911c0d1220 2023-07-14T11:12:50.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:50.744+0000 7f9120bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f911c0cb770 con 0x7f911c0b1e00 2023-07-14T11:12:50.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:50.744+0000 7f9120bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f911c0cba50 con 0x7f911c15c950 2023-07-14T11:12:50.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:50.744+0000 7f9113fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f911c0d1220 0x7f911c0cc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:12:50.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:50.744+0000 7f9113fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f911c0d1220 0x7f911c0cc810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41908/0 (socket says 172.21.15.84:41908) 2023-07-14T11:12:50.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:50.744+0000 7f9113fff700 1 -- 172.21.15.84:0/609812727 learned_addr learned my addr 172.21.15.84:0/609812727 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:12:50.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:50.744+0000 7f911a59c700 1 --2- 172.21.15.84:0/609812727 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f911c0b1e00 0x7f911c156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:12:50.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:50.744+0000 7f911ad9d700 1 --2- 172.21.15.84:0/609812727 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f911c15c950 0x7f911c0c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:12:50.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:50.744+0000 7f9113fff700 1 -- 172.21.15.84:0/609812727 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f911c15c950 msgr2=0x7f911c0c8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:12:50.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:50.744+0000 7f9113fff700 1 --2- 172.21.15.84:0/609812727 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f911c15c950 0x7f911c0c8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:50.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:50.744+0000 7f9113fff700 1 -- 172.21.15.84:0/609812727 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f911c0b1e00 msgr2=0x7f911c156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:12:50.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:50.744+0000 7f9113fff700 1 --2- 172.21.15.84:0/609812727 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f911c0b1e00 0x7f911c156d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:50.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:50.744+0000 7f9113fff700 1 -- 172.21.15.84:0/609812727 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9114009a70 con 0x7f911c0d1220 2023-07-14T11:12:50.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:50.745+0000 7f9113fff700 1 --2- 172.21.15.84:0/609812727 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f911c0d1220 0x7f911c0cc810 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f910400e980 tx=0x7f910400ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:12:50.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:50.745+0000 7f9112ffd700 1 -- 172.21.15.84:0/609812727 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f910400eed0 con 0x7f911c0d1220 2023-07-14T11:12:50.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:50.745+0000 7f9112ffd700 1 -- 172.21.15.84:0/609812727 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f910400c850 con 0x7f911c0d1220 2023-07-14T11:12:50.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:50.745+0000 7f9112ffd700 1 -- 172.21.15.84:0/609812727 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f910400cbc0 con 0x7f911c0d1220 2023-07-14T11:12:50.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:50.745+0000 7f9120bff700 1 -- 172.21.15.84:0/609812727 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f911c0cbd30 con 0x7f911c0d1220 2023-07-14T11:12:50.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:50.745+0000 7f9120bff700 1 -- 172.21.15.84:0/609812727 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f911c0cc2f0 con 0x7f911c0d1220 2023-07-14T11:12:50.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:50.746+0000 7f9112ffd700 1 -- 172.21.15.84:0/609812727 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9104005d20 con 0x7f911c0d1220 2023-07-14T11:12:50.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:50.746+0000 7f9112ffd700 1 -- 172.21.15.84:0/609812727 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f91040068b0 con 0x7f911c0d1220 2023-07-14T11:12:50.752 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-07-14T11:12:50.749+0000 7f8eb188c200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-14T11:12:50.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:50.746+0000 7f9120bff700 1 -- 172.21.15.84:0/609812727 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f911c0cc510 con 0x7f911c0d1220 2023-07-14T11:12:50.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:50.749+0000 7f9112ffd700 1 -- 172.21.15.84:0/609812727 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f9104021060 con 0x7f911c0d1220 2023-07-14T11:12:50.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:50.820+0000 7f9120bff700 1 -- 172.21.15.84:0/609812727 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f911c04e280 con 0x7f911c0d1220 2023-07-14T11:12:50.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:50.821+0000 7f9112ffd700 1 -- 172.21.15.84:0/609812727 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f9104017070 con 0x7f911c0d1220 2023-07-14T11:12:50.823 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:12:50.823 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:12:50.425783+0000","last_up_change":"0.000000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:12:50.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:50.822+0000 7f9120bff700 1 -- 172.21.15.84:0/609812727 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f911c0d1220 msgr2=0x7f911c0cc810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:12:50.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:50.822+0000 7f9120bff700 1 --2- 172.21.15.84:0/609812727 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f911c0d1220 0x7f911c0cc810 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f910400e980 tx=0x7f910400ec90 comp rx=0 tx=0).stop 2023-07-14T11:12:50.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:50.822+0000 7f9120bff700 1 -- 172.21.15.84:0/609812727 shutdown_connections 2023-07-14T11:12:50.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:50.822+0000 7f9120bff700 1 --2- 172.21.15.84:0/609812727 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f911c15c950 0x7f911c0c8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:50.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:50.822+0000 7f9120bff700 1 --2- 172.21.15.84:0/609812727 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f911c0b1e00 0x7f911c156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:50.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:50.822+0000 7f9120bff700 1 --2- 172.21.15.84:0/609812727 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f911c0d1220 0x7f911c0cc810 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:50.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:50.822+0000 7f9120bff700 1 -- 172.21.15.84:0/609812727 >> 172.21.15.84:0/609812727 conn(0x7f911c09c1d0 msgr2=0x7f911c0b0730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:12:50.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:50.822+0000 7f9120bff700 1 -- 172.21.15.84:0/609812727 shutdown_connections 2023-07-14T11:12:50.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:12:50.822+0000 7f9120bff700 1 -- 172.21.15.84:0/609812727 wait complete. 2023-07-14T11:12:50.842 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-07-14T11:12:50.842 INFO:tasks.ceph:Waiting for OSDs to come up 2023-07-14T11:12:50.842 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:12:50.839+0000 7fed98b92200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-14T11:12:50.848 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-07-14T11:12:50.846+0000 7f8eb188c200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-14T11:12:50.957 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-07-14T11:12:50.956+0000 7f8eb188c200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-14T11:12:51.070 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:12:51.068+0000 7fed98b92200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-14T11:12:51.166 INFO:tasks.ceph.osd.4.smithi179.stderr:2023-07-14T11:12:51.164+0000 7f4e7d016640 -1 Falling back to public interface 2023-07-14T11:12:51.170 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:12:51.169+0000 7fed98b92200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-14T11:12:51.181 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-07-14T11:12:51.179+0000 7f3e9db92640 -1 Falling back to public interface 2023-07-14T11:12:51.183 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-07-14T11:12:51.181+0000 7f8eb188c200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-14T11:12:51.188 INFO:tasks.ceph.osd.0.smithi084.stderr:2023-07-14T11:12:51.187+0000 7fa9fbdb6640 -1 Falling back to public interface 2023-07-14T11:12:51.193 INFO:tasks.ceph.osd.6.smithi179.stderr:2023-07-14T11:12:51.192+0000 7fbe5ec28640 -1 Falling back to public interface 2023-07-14T11:12:51.195 INFO:tasks.ceph.osd.3.smithi084.stderr:2023-07-14T11:12:51.194+0000 7f388193c640 -1 Falling back to public interface 2023-07-14T11:12:51.208 INFO:tasks.ceph.osd.1.smithi084.stderr:2023-07-14T11:12:51.207+0000 7f4b26202640 -1 Falling back to public interface 2023-07-14T11:12:51.213 INFO:tasks.ceph.osd.5.smithi179.stderr:2023-07-14T11:12:51.212+0000 7f88d0c87640 -1 Falling back to public interface 2023-07-14T11:12:51.217 INFO:tasks.ceph.osd.7.smithi179.stderr:2023-07-14T11:12:51.216+0000 7fae367cf640 -1 Falling back to public interface 2023-07-14T11:12:51.294 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-07-14T11:12:51.292+0000 7f8eb188c200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-14T11:12:51.528 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:12:51.526+0000 7fed98b92200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-14T11:12:51.618 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:12:51.616+0000 7fed98b92200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-14T11:12:51.645 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-14T11:12:51.649 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-07-14T11:12:51.647+0000 7f8eb188c200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-14T11:12:51.740 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-07-14T11:12:51.738+0000 7f8eb188c200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-14T11:12:51.822 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:51.820+0000 7f51179ff700 1 Processor -- start 2023-07-14T11:12:51.822 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:51.820+0000 7f51179ff700 1 -- start start 2023-07-14T11:12:51.824 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:51.821+0000 7f51179ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f51100cd460 0x7f51100d1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:12:51.824 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:51.821+0000 7f51179ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51100b1b70 0x7f51100cd830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:12:51.824 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:51.821+0000 7f51179ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f511015cb40 0x7f51100b5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:12:51.824 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:51.821+0000 7f51179ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51100cdd70 con 0x7f51100cd460 2023-07-14T11:12:51.824 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:51.822+0000 7f51179ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51100d0d10 con 0x7f511015cb40 2023-07-14T11:12:51.824 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:51.822+0000 7f51179ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51100d0ff0 con 0x7f51100b1b70 2023-07-14T11:12:51.824 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:51.822+0000 7f511579b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f51100cd460 0x7f51100d1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:12:51.825 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:51.822+0000 7f511579b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f51100cd460 0x7f51100d1db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41918/0 (socket says 172.21.15.84:41918) 2023-07-14T11:12:51.825 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:51.822+0000 7f511579b700 1 -- 172.21.15.84:0/1108888255 learned_addr learned my addr 172.21.15.84:0/1108888255 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:12:51.825 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:51.822+0000 7f5115f9c700 1 --2- 172.21.15.84:0/1108888255 >> v2:172.21.15.179:3300/0 conn(0x7f511015cb40 0x7f51100b5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:12:51.825 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:51.822+0000 7f5114f9a700 1 --2- 172.21.15.84:0/1108888255 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51100b1b70 0x7f51100cd830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:12:51.826 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:51.822+0000 7f511579b700 1 -- 172.21.15.84:0/1108888255 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51100b1b70 msgr2=0x7f51100cd830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:12:51.826 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:51.822+0000 7f511579b700 1 --2- 172.21.15.84:0/1108888255 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51100b1b70 0x7f51100cd830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:51.827 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:51.822+0000 7f511579b700 1 -- 172.21.15.84:0/1108888255 >> v2:172.21.15.179:3300/0 conn(0x7f511015cb40 msgr2=0x7f51100b5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:12:51.827 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:51.822+0000 7f511579b700 1 --2- 172.21.15.84:0/1108888255 >> v2:172.21.15.179:3300/0 conn(0x7f511015cb40 0x7f51100b5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:51.827 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:51.822+0000 7f511579b700 1 -- 172.21.15.84:0/1108888255 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51100d12d0 con 0x7f51100cd460 2023-07-14T11:12:51.827 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:51.823+0000 7f511579b700 1 --2- 172.21.15.84:0/1108888255 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51100cd460 0x7f51100d1db0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f511008c0d0 tx=0x7f510c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92435590bc42507d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:12:51.827 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:51.823+0000 7f5107fff700 1 -- 172.21.15.84:0/1108888255 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510c011830 con 0x7f51100cd460 2023-07-14T11:12:51.827 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:51.823+0000 7f5107fff700 1 -- 172.21.15.84:0/1108888255 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f510c011990 con 0x7f51100cd460 2023-07-14T11:12:51.827 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:51.823+0000 7f5107fff700 1 -- 172.21.15.84:0/1108888255 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510c011d20 con 0x7f51100cd460 2023-07-14T11:12:51.828 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:51.823+0000 7f51179ff700 1 -- 172.21.15.84:0/1108888255 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51100cd460 msgr2=0x7f51100d1db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:12:51.828 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:51.823+0000 7f51179ff700 1 --2- 172.21.15.84:0/1108888255 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51100cd460 0x7f51100d1db0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f511008c0d0 tx=0x7f510c009bd0 comp rx=0 tx=0).stop 2023-07-14T11:12:51.828 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:51.823+0000 7f51179ff700 1 -- 172.21.15.84:0/1108888255 shutdown_connections 2023-07-14T11:12:51.828 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:51.823+0000 7f51179ff700 1 --2- 172.21.15.84:0/1108888255 >> v2:172.21.15.179:3300/0 conn(0x7f511015cb40 0x7f51100b5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:51.828 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:51.823+0000 7f51179ff700 1 --2- 172.21.15.84:0/1108888255 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51100cd460 0x7f51100d1db0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:51.828 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:51.823+0000 7f51179ff700 1 --2- 172.21.15.84:0/1108888255 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51100b1b70 0x7f51100cd830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:51.828 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:51.823+0000 7f51179ff700 1 -- 172.21.15.84:0/1108888255 >> 172.21.15.84:0/1108888255 conn(0x7f511006a680 msgr2=0x7f511006aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:12:51.829 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:51.824+0000 7f51179ff700 1 -- 172.21.15.84:0/1108888255 shutdown_connections 2023-07-14T11:12:51.829 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:51.824+0000 7f51179ff700 1 -- 172.21.15.84:0/1108888255 wait complete. 2023-07-14T11:12:51.830 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:51.825+0000 7f51179ff700 1 Processor -- start 2023-07-14T11:12:51.831 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:51.825+0000 7f51179ff700 1 -- start start 2023-07-14T11:12:51.831 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:51.826+0000 7f51179ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51100b1b70 0x7f51100cc910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:12:51.831 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:51.826+0000 7f51179ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51100cd460 0x7f511015d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:12:51.831 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:51.826+0000 7f51179ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f511015cb40 0x7f51101e6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:12:51.831 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:51.826+0000 7f51179ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f511015dba0 con 0x7f51100cd460 2023-07-14T11:12:51.831 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:51.826+0000 7f51179ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51100cc150 con 0x7f511015cb40 2023-07-14T11:12:51.832 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:51.826+0000 7f51179ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51100ca450 con 0x7f51100b1b70 2023-07-14T11:12:51.832 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:51.827+0000 7f5114f9a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51100cd460 0x7f511015d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:12:51.832 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:51.827+0000 7f5114f9a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51100cd460 0x7f511015d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41934/0 (socket says 172.21.15.84:41934) 2023-07-14T11:12:51.832 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:51.827+0000 7f5114f9a700 1 -- 172.21.15.84:0/3621414464 learned_addr learned my addr 172.21.15.84:0/3621414464 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:12:51.832 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:51.827+0000 7f511579b700 1 --2- 172.21.15.84:0/3621414464 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51100b1b70 0x7f51100cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:12:51.832 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:51.827+0000 7f5115f9c700 1 --2- 172.21.15.84:0/3621414464 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f511015cb40 0x7f51101e6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:12:51.833 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:51.827+0000 7f5114f9a700 1 -- 172.21.15.84:0/3621414464 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51100b1b70 msgr2=0x7f51100cc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:12:51.833 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:51.827+0000 7f5114f9a700 1 --2- 172.21.15.84:0/3621414464 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51100b1b70 0x7f51100cc910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:51.833 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:51.827+0000 7f5114f9a700 1 -- 172.21.15.84:0/3621414464 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f511015cb40 msgr2=0x7f51101e6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:12:51.833 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:51.827+0000 7f5114f9a700 1 --2- 172.21.15.84:0/3621414464 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f511015cb40 0x7f51101e6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:51.833 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:51.827+0000 7f5114f9a700 1 -- 172.21.15.84:0/3621414464 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f510c009550 con 0x7f51100cd460 2023-07-14T11:12:51.833 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:51.827+0000 7f5114f9a700 1 --2- 172.21.15.84:0/3621414464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51100cd460 0x7f511015d660 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f510000e930 tx=0x7f510000ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:12:51.833 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:51.827+0000 7f5105ffb700 1 -- 172.21.15.84:0/3621414464 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5100013680 con 0x7f51100cd460 2023-07-14T11:12:51.834 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:51.827+0000 7f5105ffb700 1 -- 172.21.15.84:0/3621414464 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51000137e0 con 0x7f51100cd460 2023-07-14T11:12:51.834 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:51.827+0000 7f51179ff700 1 -- 172.21.15.84:0/3621414464 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51100ca730 con 0x7f51100cd460 2023-07-14T11:12:51.834 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:51.827+0000 7f5105ffb700 1 -- 172.21.15.84:0/3621414464 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5100013b70 con 0x7f51100cd460 2023-07-14T11:12:51.834 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:51.828+0000 7f51179ff700 1 -- 172.21.15.84:0/3621414464 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51100caa10 con 0x7f51100cd460 2023-07-14T11:12:51.834 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:51.828+0000 7f5105ffb700 1 -- 172.21.15.84:0/3621414464 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5100005a20 con 0x7f51100cd460 2023-07-14T11:12:51.834 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:51.828+0000 7f5105ffb700 1 -- 172.21.15.84:0/3621414464 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f5100005cd0 con 0x7f51100cd460 2023-07-14T11:12:51.834 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:51.829+0000 7f51179ff700 1 -- 172.21.15.84:0/3621414464 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51100cbfb0 con 0x7f51100cd460 2023-07-14T11:12:51.835 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:51.831+0000 7f5105ffb700 1 -- 172.21.15.84:0/3621414464 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f51100cbfb0 con 0x7f51100cd460 2023-07-14T11:12:51.905 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:51.903+0000 7f51179ff700 1 -- 172.21.15.84:0/3621414464 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5110074350 con 0x7f51100cd460 2023-07-14T11:12:51.906 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:51.904+0000 7f5105ffb700 1 -- 172.21.15.84:0/3621414464 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f5100029020 con 0x7f51100cd460 2023-07-14T11:12:51.906 INFO:teuthology.misc.health.smithi084.stdout: 2023-07-14T11:12:51.906 INFO:teuthology.misc.health.smithi084.stdout:{"epoch":10,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:12:50.425783+0000","last_up_change":"0.000000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:12:51.907 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:51.905+0000 7f51179ff700 1 -- 172.21.15.84:0/3621414464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51100cd460 msgr2=0x7f511015d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:12:51.907 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:51.905+0000 7f51179ff700 1 --2- 172.21.15.84:0/3621414464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51100cd460 0x7f511015d660 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f510000e930 tx=0x7f510000ec40 comp rx=0 tx=0).stop 2023-07-14T11:12:51.907 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:51.905+0000 7f51179ff700 1 -- 172.21.15.84:0/3621414464 shutdown_connections 2023-07-14T11:12:51.908 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:51.905+0000 7f51179ff700 1 --2- 172.21.15.84:0/3621414464 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51100b1b70 0x7f51100cc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:51.908 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:51.905+0000 7f51179ff700 1 --2- 172.21.15.84:0/3621414464 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f511015cb40 0x7f51101e6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:51.908 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:51.905+0000 7f51179ff700 1 --2- 172.21.15.84:0/3621414464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51100cd460 0x7f511015d660 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:51.908 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:51.905+0000 7f51179ff700 1 -- 172.21.15.84:0/3621414464 >> 172.21.15.84:0/3621414464 conn(0x7f511006a680 msgr2=0x7f51100b6960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:12:51.908 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:51.905+0000 7f51179ff700 1 -- 172.21.15.84:0/3621414464 shutdown_connections 2023-07-14T11:12:51.908 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:51.905+0000 7f51179ff700 1 -- 172.21.15.84:0/3621414464 wait complete. 2023-07-14T11:12:51.922 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-07-14T11:12:52.258 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:12:52.256+0000 7fed98b92200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-14T11:12:52.364 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-07-14T11:12:52.362+0000 7f8eb188c200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-14T11:12:52.641 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:12:52.639+0000 7fed98b92200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-14T11:12:52.749 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-07-14T11:12:52.747+0000 7f8eb188c200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-14T11:12:52.821 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:12:52.819+0000 7fed98b92200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-14T11:12:52.931 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-07-14T11:12:52.929+0000 7f8eb188c200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-14T11:12:53.262 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:12:53.260+0000 7fed98b92200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-14T11:12:53.375 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-07-14T11:12:53.373+0000 7f8eb188c200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-14T11:12:53.445 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:12:53.443+0000 7fed98b92200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-14T11:12:53.560 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-07-14T11:12:53.558+0000 7f8eb188c200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-14T11:12:53.640 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:12:53.638+0000 7fed98b92200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-14T11:12:53.776 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-07-14T11:12:53.774+0000 7f8eb188c200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-14T11:12:54.051 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:12:54.049+0000 7fed98b92200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-14T11:12:54.211 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-07-14T11:12:54.209+0000 7f8eb188c200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-14T11:12:54.736 INFO:tasks.ceph.osd.6.smithi179.stderr:2023-07-14T11:12:54.734+0000 7fbe5ec28640 -1 osd.6 0 log_to_monitors true 2023-07-14T11:12:54.793 INFO:tasks.ceph.osd.5.smithi179.stderr:2023-07-14T11:12:54.791+0000 7f88d0c87640 -1 osd.5 0 log_to_monitors true 2023-07-14T11:12:54.946 INFO:tasks.ceph.osd.4.smithi179.stderr:2023-07-14T11:12:54.944+0000 7f4e7d016640 -1 osd.4 0 log_to_monitors true 2023-07-14T11:12:54.980 INFO:tasks.ceph.osd.0.smithi084.stderr:2023-07-14T11:12:54.978+0000 7fa9fbdb6640 -1 osd.0 0 log_to_monitors true 2023-07-14T11:12:54.985 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-07-14T11:12:54.983+0000 7f3e9db92640 -1 osd.2 0 log_to_monitors true 2023-07-14T11:12:55.021 INFO:tasks.ceph.osd.3.smithi084.stderr:2023-07-14T11:12:55.019+0000 7f388193c640 -1 osd.3 0 log_to_monitors true 2023-07-14T11:12:55.042 INFO:tasks.ceph.osd.1.smithi084.stderr:2023-07-14T11:12:55.040+0000 7f4b26202640 -1 osd.1 0 log_to_monitors true 2023-07-14T11:12:55.057 INFO:tasks.ceph.osd.7.smithi179.stderr:2023-07-14T11:12:55.056+0000 7fae367cf640 -1 osd.7 0 log_to_monitors true 2023-07-14T11:12:55.071 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:12:55.069+0000 7fed523fa700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-07-14T11:12:55.071 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:12:55.069+0000 7fed523fa700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-07-14T11:12:58.140 INFO:tasks.ceph.osd.4.smithi179.stderr:2023-07-14T11:12:58.137+0000 7f4e6cff9700 -1 osd.4 0 waiting for initial osdmap 2023-07-14T11:12:58.163 INFO:tasks.ceph.osd.4.smithi179.stderr:2023-07-14T11:12:58.161+0000 7f4e637fb700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-14T11:12:58.243 INFO:tasks.ceph.osd.0.smithi084.stderr:2023-07-14T11:12:58.241+0000 7fa9ea3f6700 -1 osd.0 0 waiting for initial osdmap 2023-07-14T11:12:58.251 INFO:tasks.ceph.osd.7.smithi179.stderr:2023-07-14T11:12:58.249+0000 7fae24df6700 -1 osd.7 0 waiting for initial osdmap 2023-07-14T11:12:58.252 INFO:tasks.ceph.osd.5.smithi179.stderr:2023-07-14T11:12:58.250+0000 7f88bf3f6700 -1 osd.5 0 waiting for initial osdmap 2023-07-14T11:12:58.260 INFO:tasks.ceph.osd.0.smithi084.stderr:2023-07-14T11:12:58.258+0000 7fa9e23fb700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-14T11:12:58.265 INFO:tasks.ceph.osd.5.smithi179.stderr:2023-07-14T11:12:58.263+0000 7f88b73fb700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-14T11:12:58.269 INFO:tasks.ceph.osd.7.smithi179.stderr:2023-07-14T11:12:58.267+0000 7fae1cdfb700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-14T11:12:58.269 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-07-14T11:12:58.268+0000 7f3e8c1f6700 -1 osd.2 0 waiting for initial osdmap 2023-07-14T11:12:58.287 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-07-14T11:12:58.285+0000 7f3e841fb700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-14T11:12:58.320 INFO:tasks.ceph.osd.3.smithi084.stderr:2023-07-14T11:12:58.318+0000 7f386fff6700 -1 osd.3 0 waiting for initial osdmap 2023-07-14T11:12:58.325 INFO:tasks.ceph.osd.6.smithi179.stderr:2023-07-14T11:12:58.323+0000 7fbe4ebf9700 -1 osd.6 0 waiting for initial osdmap 2023-07-14T11:12:58.332 INFO:tasks.ceph.osd.3.smithi084.stderr:2023-07-14T11:12:58.330+0000 7f3867ffb700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-14T11:12:58.340 INFO:tasks.ceph.osd.6.smithi179.stderr:2023-07-14T11:12:58.338+0000 7fbe453fb700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-14T11:12:58.347 INFO:tasks.ceph.osd.1.smithi084.stderr:2023-07-14T11:12:58.346+0000 7f4b147f6700 -1 osd.1 0 waiting for initial osdmap 2023-07-14T11:12:58.362 INFO:tasks.ceph.osd.1.smithi084.stderr:2023-07-14T11:12:58.360+0000 7f4b0c7fb700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-14T11:12:58.726 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-14T11:12:58.900 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:58.898+0000 7fd53abff700 1 Processor -- start 2023-07-14T11:12:58.900 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:58.898+0000 7fd53abff700 1 -- start start 2023-07-14T11:12:58.901 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:58.899+0000 7fd53abff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd5340cd460 0x7fd5340d1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:12:58.901 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:58.899+0000 7fd53abff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd53415cb40 0x7fd5340b5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:12:58.901 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:58.899+0000 7fd53abff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5340d0d10 con 0x7fd5340b1b70 2023-07-14T11:12:58.902 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:58.899+0000 7fd53abff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5340d0ff0 con 0x7fd5340cd460 2023-07-14T11:12:58.902 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:58.899+0000 7fd53abff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5340d12d0 con 0x7fd53415cb40 2023-07-14T11:12:58.902 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:58.899+0000 7fd533fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fd5340b1b70 0x7fd5340cd830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:37780/0 (socket says 172.21.15.84:37780) 2023-07-14T11:12:58.902 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:58.899+0000 7fd53899b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd5340cd460 0x7fd5340d1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:12:58.902 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:58.899+0000 7fd533fff700 1 -- 172.21.15.84:0/669828012 learned_addr learned my addr 172.21.15.84:0/669828012 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:12:58.903 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:58.900+0000 7fd5337fe700 1 -- 172.21.15.84:0/669828012 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3847273909 0 0) 0x7fd5340d0d10 con 0x7fd5340b1b70 2023-07-14T11:12:58.904 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:58.900+0000 7fd5337fe700 1 -- 172.21.15.84:0/669828012 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5240035b0 con 0x7fd5340b1b70 2023-07-14T11:12:58.904 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:58.900+0000 7fd53899b700 1 -- 172.21.15.84:0/669828012 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd53415cb40 msgr2=0x7fd5340b5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:12:58.904 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:58.900+0000 7fd53899b700 1 --2- 172.21.15.84:0/669828012 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd53415cb40 0x7fd5340b5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:58.904 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:58.900+0000 7fd53899b700 1 -- 172.21.15.84:0/669828012 >> v1:172.21.15.84:6789/0 conn(0x7fd5340b1b70 legacy=0x7fd5340cd830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:12:58.904 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:58.900+0000 7fd53899b700 1 -- 172.21.15.84:0/669828012 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5340d15b0 con 0x7fd5340cd460 2023-07-14T11:12:58.904 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:58.900+0000 7fd53899b700 1 --2- 172.21.15.84:0/669828012 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5340cd460 0x7fd5340d1db0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd528009840 tx=0x7fd528009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f348c70110e2d4f9 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:12:58.904 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:58.900+0000 7fd5337fe700 1 -- 172.21.15.84:0/669828012 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd528011830 con 0x7fd5340cd460 2023-07-14T11:12:58.905 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:58.900+0000 7fd5337fe700 1 -- 172.21.15.84:0/669828012 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd528011990 con 0x7fd5340cd460 2023-07-14T11:12:58.905 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:58.900+0000 7fd5337fe700 1 -- 172.21.15.84:0/669828012 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd528011d20 con 0x7fd5340cd460 2023-07-14T11:12:58.905 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:58.901+0000 7fd53abff700 1 -- 172.21.15.84:0/669828012 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5340cd460 msgr2=0x7fd5340d1db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:12:58.905 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:58.901+0000 7fd53abff700 1 --2- 172.21.15.84:0/669828012 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5340cd460 0x7fd5340d1db0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd528009840 tx=0x7fd528009b50 comp rx=0 tx=0).stop 2023-07-14T11:12:58.905 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:58.901+0000 7fd53abff700 1 -- 172.21.15.84:0/669828012 shutdown_connections 2023-07-14T11:12:58.905 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:58.901+0000 7fd53abff700 1 --2- 172.21.15.84:0/669828012 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd53415cb40 0x7fd5340b5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:58.905 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:58.901+0000 7fd53abff700 1 --2- 172.21.15.84:0/669828012 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5340cd460 0x7fd5340d1db0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:58.905 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:58.901+0000 7fd53abff700 1 -- 172.21.15.84:0/669828012 >> 172.21.15.84:0/669828012 conn(0x7fd53406a680 msgr2=0x7fd53406aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:12:58.906 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:58.901+0000 7fd53abff700 1 -- 172.21.15.84:0/669828012 shutdown_connections 2023-07-14T11:12:58.906 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:58.901+0000 7fd53abff700 1 -- 172.21.15.84:0/669828012 wait complete. 2023-07-14T11:12:58.907 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:58.903+0000 7fd53abff700 1 Processor -- start 2023-07-14T11:12:58.908 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:58.903+0000 7fd53abff700 1 -- start start 2023-07-14T11:12:58.908 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:58.904+0000 7fd53abff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5340b1b70 0x7fd5340b4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:12:58.908 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:58.904+0000 7fd53abff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5340cd460 0x7fd5340c6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:12:58.908 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:58.904+0000 7fd53abff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd53415cb40 0x7fd5340c81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:12:58.908 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:58.904+0000 7fd53abff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5340c6e80 con 0x7fd53415cb40 2023-07-14T11:12:58.908 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:58.904+0000 7fd53abff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5340c7120 con 0x7fd5340b1b70 2023-07-14T11:12:58.908 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:58.904+0000 7fd53abff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5340c7400 con 0x7fd5340cd460 2023-07-14T11:12:58.909 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:58.904+0000 7fd53919c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd53415cb40 0x7fd5340c81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:12:58.909 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:58.904+0000 7fd53919c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd53415cb40 0x7fd5340c81c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51850/0 (socket says 172.21.15.84:51850) 2023-07-14T11:12:58.909 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:58.904+0000 7fd53919c700 1 -- 172.21.15.84:0/2719713655 learned_addr learned my addr 172.21.15.84:0/2719713655 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:12:58.909 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:58.904+0000 7fd53899b700 1 --2- 172.21.15.84:0/2719713655 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5340b1b70 0x7fd5340b4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:12:58.909 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:58.904+0000 7fd53919c700 1 -- 172.21.15.84:0/2719713655 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5340cd460 msgr2=0x7fd5340c6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:12:58.909 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:58.904+0000 7fd53919c700 1 --2- 172.21.15.84:0/2719713655 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5340cd460 0x7fd5340c6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:58.909 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:58.904+0000 7fd53919c700 1 -- 172.21.15.84:0/2719713655 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5340b1b70 msgr2=0x7fd5340b4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:12:58.909 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:58.904+0000 7fd53919c700 1 --2- 172.21.15.84:0/2719713655 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5340b1b70 0x7fd5340b4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:58.910 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:58.904+0000 7fd53919c700 1 -- 172.21.15.84:0/2719713655 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5280094a0 con 0x7fd53415cb40 2023-07-14T11:12:58.910 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:58.904+0000 7fd53899b700 1 --2- 172.21.15.84:0/2719713655 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5340b1b70 0x7fd5340b4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:12:58.910 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:58.905+0000 7fd53919c700 1 --2- 172.21.15.84:0/2719713655 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd53415cb40 0x7fd5340c81c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd52c00be50 tx=0x7fd52c00bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:12:58.910 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:58.905+0000 7fd5317fa700 1 -- 172.21.15.84:0/2719713655 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52c00cd50 con 0x7fd53415cb40 2023-07-14T11:12:58.910 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:58.905+0000 7fd5317fa700 1 -- 172.21.15.84:0/2719713655 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd52c014440 con 0x7fd53415cb40 2023-07-14T11:12:58.910 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:58.905+0000 7fd53abff700 1 -- 172.21.15.84:0/2719713655 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5340c76e0 con 0x7fd53415cb40 2023-07-14T11:12:58.910 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:58.905+0000 7fd5317fa700 1 -- 172.21.15.84:0/2719713655 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52c0147f0 con 0x7fd53415cb40 2023-07-14T11:12:58.910 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:58.905+0000 7fd53abff700 1 -- 172.21.15.84:0/2719713655 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5340c7ca0 con 0x7fd53415cb40 2023-07-14T11:12:58.911 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:58.906+0000 7fd53abff700 1 -- 172.21.15.84:0/2719713655 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd534074350 con 0x7fd53415cb40 2023-07-14T11:12:58.911 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:58.907+0000 7fd5317fa700 1 -- 172.21.15.84:0/2719713655 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7fd52c01d3b0 con 0x7fd53415cb40 2023-07-14T11:12:58.912 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:58.908+0000 7fd5317fa700 1 --2- 172.21.15.84:0/2719713655 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fd51806ac50 0x7fd51806d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:12:58.912 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:58.908+0000 7fd5317fa700 1 -- 172.21.15.84:0/2719713655 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7fd52c088520 con 0x7fd53415cb40 2023-07-14T11:12:58.912 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:58.908+0000 7fd53899b700 1 --2- 172.21.15.84:0/2719713655 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fd51806ac50 0x7fd51806d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:12:58.912 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:58.909+0000 7fd53899b700 1 --2- 172.21.15.84:0/2719713655 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fd51806ac50 0x7fd51806d100 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd528009fd0 tx=0x7fd528008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:12:58.915 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:58.913+0000 7fd5317fa700 1 -- 172.21.15.84:0/2719713655 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fd52c0545a0 con 0x7fd53415cb40 2023-07-14T11:12:59.116 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:59.114+0000 7fd53abff700 1 -- 172.21.15.84:0/2719713655 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd5340ce9e0 con 0x7fd53415cb40 2023-07-14T11:12:59.117 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:59.115+0000 7fd5317fa700 1 -- 172.21.15.84:0/2719713655 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fd52c019090 con 0x7fd53415cb40 2023-07-14T11:12:59.117 INFO:teuthology.misc.health.smithi084.stdout: 2023-07-14T11:12:59.117 INFO:teuthology.misc.health.smithi084.stdout:{"epoch":12,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:12:56.124049+0000","last_up_change":"0.000000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:12:59.119 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:59.117+0000 7fd53abff700 1 -- 172.21.15.84:0/2719713655 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fd51806ac50 msgr2=0x7fd51806d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:12:59.119 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:59.117+0000 7fd53abff700 1 --2- 172.21.15.84:0/2719713655 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fd51806ac50 0x7fd51806d100 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd528009fd0 tx=0x7fd528008030 comp rx=0 tx=0).stop 2023-07-14T11:12:59.119 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:59.117+0000 7fd53abff700 1 -- 172.21.15.84:0/2719713655 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd53415cb40 msgr2=0x7fd5340c81c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:12:59.119 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:59.117+0000 7fd53abff700 1 --2- 172.21.15.84:0/2719713655 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd53415cb40 0x7fd5340c81c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd52c00be50 tx=0x7fd52c00bf30 comp rx=0 tx=0).stop 2023-07-14T11:12:59.120 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:59.118+0000 7fd53abff700 1 -- 172.21.15.84:0/2719713655 shutdown_connections 2023-07-14T11:12:59.120 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:59.118+0000 7fd53abff700 1 --2- 172.21.15.84:0/2719713655 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd53415cb40 0x7fd5340c81c0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:59.120 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:59.118+0000 7fd53abff700 1 --2- 172.21.15.84:0/2719713655 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5340b1b70 0x7fd5340b4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:59.121 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:59.118+0000 7fd53abff700 1 --2- 172.21.15.84:0/2719713655 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fd51806ac50 0x7fd51806d100 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:59.121 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:59.118+0000 7fd53abff700 1 --2- 172.21.15.84:0/2719713655 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5340cd460 0x7fd5340c6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:12:59.121 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:59.118+0000 7fd53abff700 1 -- 172.21.15.84:0/2719713655 >> 172.21.15.84:0/2719713655 conn(0x7fd53406a680 msgr2=0x7fd5340cd830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:12:59.121 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:59.118+0000 7fd53abff700 1 -- 172.21.15.84:0/2719713655 shutdown_connections 2023-07-14T11:12:59.121 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:12:59.118+0000 7fd53abff700 1 -- 172.21.15.84:0/2719713655 wait complete. 2023-07-14T11:12:59.135 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-07-14T11:13:05.940 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-14T11:13:06.122 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:13:06.120+0000 7fdb9d9ff700 1 Processor -- start 2023-07-14T11:13:06.122 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:13:06.120+0000 7fdb9d9ff700 1 -- start start 2023-07-14T11:13:06.123 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:13:06.121+0000 7fdb9d9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb980adb50 0x7fdb980b2300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:06.124 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:13:06.121+0000 7fdb9d9ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdb980b2840 0x7fdb9806b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:06.124 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:13:06.121+0000 7fdb9d9ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb98071ae0 con 0x7fdb98158a00 2023-07-14T11:13:06.124 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:13:06.121+0000 7fdb9d9ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb9806b040 con 0x7fdb980b2840 2023-07-14T11:13:06.124 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:13:06.121+0000 7fdb9d9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb980ae3c0 con 0x7fdb980adb50 2023-07-14T11:13:06.124 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:13:06.121+0000 7fdb96ffd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fdb98158a00 0x7fdb980b1bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:37782/0 (socket says 172.21.15.84:37782) 2023-07-14T11:13:06.124 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:13:06.121+0000 7fdb96ffd700 1 -- 172.21.15.84:0/2114825576 learned_addr learned my addr 172.21.15.84:0/2114825576 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:13:06.125 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:13:06.121+0000 7fdb977fe700 1 --2- 172.21.15.84:0/2114825576 >> v2:172.21.15.84:3300/0 conn(0x7fdb980b2840 0x7fdb9806b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:06.125 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:13:06.122+0000 7fdb967fc700 1 --2- 172.21.15.84:0/2114825576 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb980adb50 0x7fdb980b2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:06.126 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:13:06.122+0000 7fdb95ffb700 1 -- 172.21.15.84:0/2114825576 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3164398284 0 0) 0x7fdb98071ae0 con 0x7fdb98158a00 2023-07-14T11:13:06.126 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:13:06.122+0000 7fdb95ffb700 1 -- 172.21.15.84:0/2114825576 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb800035b0 con 0x7fdb98158a00 2023-07-14T11:13:06.126 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:13:06.122+0000 7fdb977fe700 1 -- 172.21.15.84:0/2114825576 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb980adb50 msgr2=0x7fdb980b2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:06.127 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:13:06.122+0000 7fdb977fe700 1 --2- 172.21.15.84:0/2114825576 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb980adb50 0x7fdb980b2300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:06.127 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:13:06.122+0000 7fdb977fe700 1 -- 172.21.15.84:0/2114825576 >> v1:172.21.15.84:6789/0 conn(0x7fdb98158a00 legacy=0x7fdb980b1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:06.127 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:13:06.122+0000 7fdb977fe700 1 -- 172.21.15.84:0/2114825576 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb98071560 con 0x7fdb980b2840 2023-07-14T11:13:06.127 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:13:06.122+0000 7fdb977fe700 1 --2- 172.21.15.84:0/2114825576 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb980b2840 0x7fdb9806b490 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fdb9000aed0 tx=0x7fdb9000c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a036cf945c188f5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:06.127 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:13:06.122+0000 7fdb95ffb700 1 -- 172.21.15.84:0/2114825576 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9000f070 con 0x7fdb980b2840 2023-07-14T11:13:06.127 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:13:06.122+0000 7fdb95ffb700 1 -- 172.21.15.84:0/2114825576 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb9000a2e0 con 0x7fdb980b2840 2023-07-14T11:13:06.128 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:13:06.122+0000 7fdb95ffb700 1 -- 172.21.15.84:0/2114825576 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9000cbd0 con 0x7fdb980b2840 2023-07-14T11:13:06.128 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:13:06.123+0000 7fdb9d9ff700 1 -- 172.21.15.84:0/2114825576 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb980b2840 msgr2=0x7fdb9806b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:06.128 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:13:06.123+0000 7fdb9d9ff700 1 --2- 172.21.15.84:0/2114825576 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb980b2840 0x7fdb9806b490 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fdb9000aed0 tx=0x7fdb9000c330 comp rx=0 tx=0).stop 2023-07-14T11:13:06.128 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:13:06.123+0000 7fdb9d9ff700 1 -- 172.21.15.84:0/2114825576 shutdown_connections 2023-07-14T11:13:06.128 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:13:06.123+0000 7fdb9d9ff700 1 --2- 172.21.15.84:0/2114825576 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb980b2840 0x7fdb9806b490 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:06.128 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:13:06.123+0000 7fdb9d9ff700 1 --2- 172.21.15.84:0/2114825576 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb980adb50 0x7fdb980b2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:06.129 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:13:06.123+0000 7fdb9d9ff700 1 -- 172.21.15.84:0/2114825576 >> 172.21.15.84:0/2114825576 conn(0x7fdb9806ab70 msgr2=0x7fdb980b05d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:06.129 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:13:06.123+0000 7fdb9d9ff700 1 -- 172.21.15.84:0/2114825576 shutdown_connections 2023-07-14T11:13:06.129 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:13:06.123+0000 7fdb9d9ff700 1 -- 172.21.15.84:0/2114825576 wait complete. 2023-07-14T11:13:06.131 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:13:06.125+0000 7fdb9d9ff700 1 Processor -- start 2023-07-14T11:13:06.131 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:13:06.126+0000 7fdb9d9ff700 1 -- start start 2023-07-14T11:13:06.131 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:13:06.127+0000 7fdb9d9ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb980adb50 0x7fdb98139bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:06.131 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:13:06.127+0000 7fdb9d9ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb980b2840 0x7fdb9814d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:06.131 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:13:06.127+0000 7fdb9d9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb98158a00 0x7fdb980ac850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:06.132 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:13:06.127+0000 7fdb9d9ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb981f3110 con 0x7fdb980b2840 2023-07-14T11:13:06.132 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:13:06.127+0000 7fdb9d9ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb981f2490 con 0x7fdb980adb50 2023-07-14T11:13:06.132 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:13:06.127+0000 7fdb9d9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb981f2770 con 0x7fdb98158a00 2023-07-14T11:13:06.132 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:13:06.127+0000 7fdb967fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb980b2840 0x7fdb9814d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:06.132 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:13:06.127+0000 7fdb967fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb980b2840 0x7fdb9814d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51900/0 (socket says 172.21.15.84:51900) 2023-07-14T11:13:06.132 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:13:06.127+0000 7fdb967fc700 1 -- 172.21.15.84:0/919376807 learned_addr learned my addr 172.21.15.84:0/919376807 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:06.132 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:13:06.127+0000 7fdb96ffd700 1 --2- 172.21.15.84:0/919376807 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb980adb50 0x7fdb98139bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:06.133 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:13:06.127+0000 7fdb977fe700 1 --2- 172.21.15.84:0/919376807 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb98158a00 0x7fdb980ac850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:06.133 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:13:06.127+0000 7fdb967fc700 1 -- 172.21.15.84:0/919376807 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb98158a00 msgr2=0x7fdb980ac850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:06.133 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:13:06.127+0000 7fdb967fc700 1 --2- 172.21.15.84:0/919376807 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb98158a00 0x7fdb980ac850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:06.133 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:13:06.127+0000 7fdb967fc700 1 -- 172.21.15.84:0/919376807 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb980adb50 msgr2=0x7fdb98139bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:06.133 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:13:06.127+0000 7fdb967fc700 1 --2- 172.21.15.84:0/919376807 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb980adb50 0x7fdb98139bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:06.133 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:13:06.128+0000 7fdb967fc700 1 -- 172.21.15.84:0/919376807 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb9000ab80 con 0x7fdb980b2840 2023-07-14T11:13:06.133 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:13:06.128+0000 7fdb967fc700 1 --2- 172.21.15.84:0/919376807 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb980b2840 0x7fdb9814d800 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c00e9b0 tx=0x7fdb8c00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:06.134 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:13:06.128+0000 7fdb7ffff700 1 -- 172.21.15.84:0/919376807 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb8c009710 con 0x7fdb980b2840 2023-07-14T11:13:06.134 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:13:06.128+0000 7fdb7ffff700 1 -- 172.21.15.84:0/919376807 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb8c00ee50 con 0x7fdb980b2840 2023-07-14T11:13:06.134 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:13:06.128+0000 7fdb7ffff700 1 -- 172.21.15.84:0/919376807 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb8c00ca50 con 0x7fdb980b2840 2023-07-14T11:13:06.134 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:13:06.128+0000 7fdb9d9ff700 1 -- 172.21.15.84:0/919376807 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb981f2a50 con 0x7fdb980b2840 2023-07-14T11:13:06.134 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:13:06.128+0000 7fdb9d9ff700 1 -- 172.21.15.84:0/919376807 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb98157ac0 con 0x7fdb980b2840 2023-07-14T11:13:06.134 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:13:06.129+0000 7fdb9d9ff700 1 -- 172.21.15.84:0/919376807 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb98074350 con 0x7fdb980b2840 2023-07-14T11:13:06.135 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:13:06.130+0000 7fdb7ffff700 1 -- 172.21.15.84:0/919376807 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdb8c00cbb0 con 0x7fdb980b2840 2023-07-14T11:13:06.135 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:13:06.131+0000 7fdb7ffff700 1 --2- 172.21.15.84:0/919376807 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fdb8406ace0 0x7fdb8406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:06.135 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:13:06.131+0000 7fdb7ffff700 1 -- 172.21.15.84:0/919376807 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fdb8c088fe0 con 0x7fdb980b2840 2023-07-14T11:13:06.135 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:13:06.131+0000 7fdb96ffd700 1 --2- 172.21.15.84:0/919376807 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fdb8406ace0 0x7fdb8406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:06.135 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:13:06.132+0000 7fdb96ffd700 1 --2- 172.21.15.84:0/919376807 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fdb8406ace0 0x7fdb8406d190 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdb88007fd0 tx=0x7fdb88007dc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:06.138 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:13:06.136+0000 7fdb7ffff700 1 -- 172.21.15.84:0/919376807 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fdb8c057f90 con 0x7fdb980b2840 2023-07-14T11:13:06.251 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T11:13:06.256 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T11:13:06.340 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:13:06.338+0000 7fdb9d9ff700 1 -- 172.21.15.84:0/919376807 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdb98157750 con 0x7fdb980b2840 2023-07-14T11:13:06.341 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:13:06.339+0000 7fdb7ffff700 1 -- 172.21.15.84:0/919376807 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12826 (secure 0 0 0) 0x7fdb8c021090 con 0x7fdb980b2840 2023-07-14T11:13:06.341 INFO:teuthology.misc.health.smithi084.stdout: 2023-07-14T11:13:06.342 INFO:teuthology.misc.health.smithi084.stdout:{"epoch":16,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:13:02.268110+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:13:06.344 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:13:06.341+0000 7fdb9d9ff700 1 -- 172.21.15.84:0/919376807 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fdb8406ace0 msgr2=0x7fdb8406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:06.344 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:13:06.341+0000 7fdb9d9ff700 1 --2- 172.21.15.84:0/919376807 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fdb8406ace0 0x7fdb8406d190 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdb88007fd0 tx=0x7fdb88007dc0 comp rx=0 tx=0).stop 2023-07-14T11:13:06.344 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:13:06.341+0000 7fdb9d9ff700 1 -- 172.21.15.84:0/919376807 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb980b2840 msgr2=0x7fdb9814d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:06.344 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:13:06.341+0000 7fdb9d9ff700 1 --2- 172.21.15.84:0/919376807 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb980b2840 0x7fdb9814d800 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c00e9b0 tx=0x7fdb8c00ecc0 comp rx=0 tx=0).stop 2023-07-14T11:13:06.344 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:13:06.341+0000 7fdb9d9ff700 1 -- 172.21.15.84:0/919376807 shutdown_connections 2023-07-14T11:13:06.345 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:13:06.341+0000 7fdb9d9ff700 1 --2- 172.21.15.84:0/919376807 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fdb8406ace0 0x7fdb8406d190 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:06.345 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:13:06.341+0000 7fdb9d9ff700 1 --2- 172.21.15.84:0/919376807 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb98158a00 0x7fdb980ac850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:06.345 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:13:06.341+0000 7fdb9d9ff700 1 --2- 172.21.15.84:0/919376807 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb980adb50 0x7fdb98139bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:06.345 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:13:06.341+0000 7fdb9d9ff700 1 --2- 172.21.15.84:0/919376807 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb980b2840 0x7fdb9814d800 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:06.345 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:13:06.341+0000 7fdb9d9ff700 1 -- 172.21.15.84:0/919376807 >> 172.21.15.84:0/919376807 conn(0x7fdb9806ab70 msgr2=0x7fdb9815b2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:06.345 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:13:06.342+0000 7fdb9d9ff700 1 -- 172.21.15.84:0/919376807 shutdown_connections 2023-07-14T11:13:06.346 INFO:teuthology.misc.health.smithi084.stderr:2023-07-14T11:13:06.342+0000 7fdb9d9ff700 1 -- 172.21.15.84:0/919376807 wait complete. 2023-07-14T11:13:06.359 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-07-14T11:13:06.359 INFO:tasks.ceph:Creating RBD pool 2023-07-14T11:13:06.359 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph osd pool create rbd 8 2023-07-14T11:13:06.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:06.547+0000 7f0726fff700 1 Processor -- start 2023-07-14T11:13:06.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:06.547+0000 7f0726fff700 1 -- start start 2023-07-14T11:13:06.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:06.548+0000 7f0726fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f07200b4600 0x7f07200cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:06.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:06.548+0000 7f0726fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07200b6f00 0x7f07200d02b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:06.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:06.548+0000 7f0726fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f072015cd60 con 0x7f07200cfe40 2023-07-14T11:13:06.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:06.548+0000 7f0726fff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07200d1550 con 0x7f07200b4600 2023-07-14T11:13:06.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:06.548+0000 7f0726fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07200d2d90 con 0x7f07200b6f00 2023-07-14T11:13:06.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:06.548+0000 7f0724d9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f07200b4600 0x7f07200cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:06.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:06.548+0000 7f0724d9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f07200b4600 0x7f07200cf900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51908/0 (socket says 172.21.15.84:51908) 2023-07-14T11:13:06.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:06.548+0000 7f0724d9b700 1 -- 172.21.15.84:0/1310865420 learned_addr learned my addr 172.21.15.84:0/1310865420 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:06.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:06.549+0000 7f072559c700 1 --2- 172.21.15.84:0/1310865420 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07200b6f00 0x7f07200d02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:06.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:06.549+0000 7f0724d9b700 1 -- 172.21.15.84:0/1310865420 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07200b6f00 msgr2=0x7f07200d02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:06.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:06.549+0000 7f0724d9b700 1 --2- 172.21.15.84:0/1310865420 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07200b6f00 0x7f07200d02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:06.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:06.549+0000 7f0724d9b700 1 -- 172.21.15.84:0/1310865420 >> v1:172.21.15.179:6789/0 conn(0x7f07200cfe40 legacy=0x7f07200cd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:06.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:06.549+0000 7f0724d9b700 1 -- 172.21.15.84:0/1310865420 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07200cf340 con 0x7f07200b4600 2023-07-14T11:13:06.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:06.549+0000 7f0724d9b700 1 --2- 172.21.15.84:0/1310865420 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07200b4600 0x7f07200cf900 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f07140098f0 tx=0x7f0714009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75732e3363f1761b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:06.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:06.549+0000 7f071f7fe700 1 -- 172.21.15.84:0/1310865420 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0714011830 con 0x7f07200b4600 2023-07-14T11:13:06.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:06.549+0000 7f071f7fe700 1 -- 172.21.15.84:0/1310865420 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0714011990 con 0x7f07200b4600 2023-07-14T11:13:06.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:06.549+0000 7f071f7fe700 1 -- 172.21.15.84:0/1310865420 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0714011d20 con 0x7f07200b4600 2023-07-14T11:13:06.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:06.550+0000 7f0726fff700 1 -- 172.21.15.84:0/1310865420 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07200b4600 msgr2=0x7f07200cf900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:06.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:06.550+0000 7f0726fff700 1 --2- 172.21.15.84:0/1310865420 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07200b4600 0x7f07200cf900 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f07140098f0 tx=0x7f0714009c00 comp rx=0 tx=0).stop 2023-07-14T11:13:06.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:06.550+0000 7f0726fff700 1 -- 172.21.15.84:0/1310865420 shutdown_connections 2023-07-14T11:13:06.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:06.550+0000 7f0726fff700 1 --2- 172.21.15.84:0/1310865420 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07200b6f00 0x7f07200d02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:06.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:06.550+0000 7f0726fff700 1 --2- 172.21.15.84:0/1310865420 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07200b4600 0x7f07200cf900 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:06.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:06.550+0000 7f0726fff700 1 -- 172.21.15.84:0/1310865420 >> 172.21.15.84:0/1310865420 conn(0x7f072009c200 msgr2=0x7f07200d2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:06.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:06.550+0000 7f0726fff700 1 -- 172.21.15.84:0/1310865420 shutdown_connections 2023-07-14T11:13:06.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:06.550+0000 7f0726fff700 1 -- 172.21.15.84:0/1310865420 wait complete. 2023-07-14T11:13:06.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:06.552+0000 7f0726fff700 1 Processor -- start 2023-07-14T11:13:06.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:06.552+0000 7f0726fff700 1 -- start start 2023-07-14T11:13:06.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:06.553+0000 7f0726fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07200b6f00 0x7f07201531c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:06.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:06.553+0000 7f0726fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07200cfe40 0x7f07200c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:06.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:06.553+0000 7f0726fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07200c9180 0x7f0720153bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:06.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:06.553+0000 7f0726fff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07200c9600 con 0x7f07200b6f00 2023-07-14T11:13:06.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:06.553+0000 7f0726fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07200c6490 con 0x7f07200c9180 2023-07-14T11:13:06.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:06.553+0000 7f0726fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07200c97e0 con 0x7f07200cfe40 2023-07-14T11:13:06.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:06.553+0000 7f0724d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07200b6f00 0x7f07201531c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:06.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:06.553+0000 7f0724d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07200b6f00 0x7f07201531c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51918/0 (socket says 172.21.15.84:51918) 2023-07-14T11:13:06.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:06.553+0000 7f0724d9b700 1 -- 172.21.15.84:0/1650785145 learned_addr learned my addr 172.21.15.84:0/1650785145 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:06.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:06.553+0000 7f071ffff700 1 --2- 172.21.15.84:0/1650785145 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07200cfe40 0x7f07200c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:06.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:06.553+0000 7f072559c700 1 --2- 172.21.15.84:0/1650785145 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07200c9180 0x7f0720153bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:06.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:06.553+0000 7f0724d9b700 1 -- 172.21.15.84:0/1650785145 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07200cfe40 msgr2=0x7f07200c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:06.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:06.553+0000 7f0724d9b700 1 --2- 172.21.15.84:0/1650785145 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07200cfe40 0x7f07200c8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:06.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:06.553+0000 7f0724d9b700 1 -- 172.21.15.84:0/1650785145 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07200c9180 msgr2=0x7f0720153bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:06.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:06.553+0000 7f0724d9b700 1 --2- 172.21.15.84:0/1650785145 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07200c9180 0x7f0720153bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:06.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:06.553+0000 7f0724d9b700 1 -- 172.21.15.84:0/1650785145 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0714009550 con 0x7f07200b6f00 2023-07-14T11:13:06.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:06.554+0000 7f0724d9b700 1 --2- 172.21.15.84:0/1650785145 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07200b6f00 0x7f07201531c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0714000c00 tx=0x7f0714004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:06.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:06.554+0000 7f071d7fa700 1 -- 172.21.15.84:0/1650785145 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0714004570 con 0x7f07200b6f00 2023-07-14T11:13:06.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:06.554+0000 7f071d7fa700 1 -- 172.21.15.84:0/1650785145 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f071401f070 con 0x7f07200b6f00 2023-07-14T11:13:06.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:06.554+0000 7f071d7fa700 1 -- 172.21.15.84:0/1650785145 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07140038c0 con 0x7f07200b6f00 2023-07-14T11:13:06.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:06.554+0000 7f0726fff700 1 -- 172.21.15.84:0/1650785145 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07200c8000 con 0x7f07200b6f00 2023-07-14T11:13:06.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:06.554+0000 7f0726fff700 1 -- 172.21.15.84:0/1650785145 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0720158450 con 0x7f07200b6f00 2023-07-14T11:13:06.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:06.555+0000 7f0726fff700 1 -- 172.21.15.84:0/1650785145 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f072008bba0 con 0x7f07200b6f00 2023-07-14T11:13:06.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:06.556+0000 7f071d7fa700 1 -- 172.21.15.84:0/1650785145 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0714021030 con 0x7f07200b6f00 2023-07-14T11:13:06.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:06.558+0000 7f071d7fa700 1 --2- 172.21.15.84:0/1650785145 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f070406ad30 0x7f070406d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:06.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:06.558+0000 7f071d7fa700 1 -- 172.21.15.84:0/1650785145 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f071408a360 con 0x7f07200b6f00 2023-07-14T11:13:06.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:06.558+0000 7f071ffff700 1 --2- 172.21.15.84:0/1650785145 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f070406ad30 0x7f070406d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:06.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:06.559+0000 7f071ffff700 1 --2- 172.21.15.84:0/1650785145 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f070406ad30 0x7f070406d1e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0720157f60 tx=0x7f070c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:06.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:06.562+0000 7f071d7fa700 1 -- 172.21.15.84:0/1650785145 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f0714055b50 con 0x7f07200b6f00 2023-07-14T11:13:06.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:06.764+0000 7f0726fff700 1 -- 172.21.15.84:0/1650785145 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f0720074350 con 0x7f07200b6f00 2023-07-14T11:13:07.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:07.746+0000 7f071d7fa700 1 -- 172.21.15.84:0/1650785145 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v17) v1 ==== 109+0+0 (secure 0 0 0) 0x7f0714059170 con 0x7f07200b6f00 2023-07-14T11:13:07.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:07.751+0000 7f0726fff700 1 -- 172.21.15.84:0/1650785145 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f070406ad30 msgr2=0x7f070406d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:07.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:07.751+0000 7f0726fff700 1 --2- 172.21.15.84:0/1650785145 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f070406ad30 0x7f070406d1e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0720157f60 tx=0x7f070c009040 comp rx=0 tx=0).stop 2023-07-14T11:13:07.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:07.751+0000 7f0726fff700 1 -- 172.21.15.84:0/1650785145 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07200b6f00 msgr2=0x7f07201531c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:07.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:07.751+0000 7f0726fff700 1 --2- 172.21.15.84:0/1650785145 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07200b6f00 0x7f07201531c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0714000c00 tx=0x7f0714004750 comp rx=0 tx=0).stop 2023-07-14T11:13:07.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:07.751+0000 7f0726fff700 1 -- 172.21.15.84:0/1650785145 shutdown_connections 2023-07-14T11:13:07.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:07.751+0000 7f0726fff700 1 --2- 172.21.15.84:0/1650785145 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07200c9180 0x7f0720153bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:07.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:07.751+0000 7f0726fff700 1 --2- 172.21.15.84:0/1650785145 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07200b6f00 0x7f07201531c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:07.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:07.751+0000 7f0726fff700 1 --2- 172.21.15.84:0/1650785145 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f070406ad30 0x7f070406d1e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:07.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:07.751+0000 7f0726fff700 1 --2- 172.21.15.84:0/1650785145 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07200cfe40 0x7f07200c8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:07.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:07.751+0000 7f0726fff700 1 -- 172.21.15.84:0/1650785145 >> 172.21.15.84:0/1650785145 conn(0x7f072009c200 msgr2=0x7f072015f5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:07.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:07.752+0000 7f0726fff700 1 -- 172.21.15.84:0/1650785145 shutdown_connections 2023-07-14T11:13:07.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:07.752+0000 7f0726fff700 1 -- 172.21.15.84:0/1650785145 wait complete. 2023-07-14T11:13:07.755 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'rbd' created 2023-07-14T11:13:07.774 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-07-14T11:13:07.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:07.966+0000 7f04e8fff700 1 Processor -- start 2023-07-14T11:13:07.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:07.967+0000 7f04e8fff700 1 -- start start 2023-07-14T11:13:07.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:07.968+0000 7f04e8fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04e415d810 0x7f04e40b2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:07.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:07.968+0000 7f04e8fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f04e40b2770 0x7f04e406fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:07.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:07.968+0000 7f04e8fff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04e4159fb0 con 0x7f04e4156e40 2023-07-14T11:13:07.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:07.968+0000 7f04e8fff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04e4159db0 con 0x7f04e40b2770 2023-07-14T11:13:07.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:07.968+0000 7f04e8fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04e415a290 con 0x7f04e415d810 2023-07-14T11:13:07.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:07.968+0000 7f04e259c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f04e4156e40 0x7f04e41596a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:37798/0 (socket says 172.21.15.84:37798) 2023-07-14T11:13:07.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:07.968+0000 7f04e259c700 1 -- 172.21.15.84:0/1194913419 learned_addr learned my addr 172.21.15.84:0/1194913419 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:13:07.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:07.968+0000 7f04e2d9d700 1 --2- 172.21.15.84:0/1194913419 >> v2:172.21.15.84:3300/0 conn(0x7f04e40b2770 0x7f04e406fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:07.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:07.968+0000 7f04dbfff700 1 --2- 172.21.15.84:0/1194913419 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04e415d810 0x7f04e40b2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:07.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:07.968+0000 7f04e1d9b700 1 -- 172.21.15.84:0/1194913419 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2772859035 0 0) 0x7f04e4159fb0 con 0x7f04e4156e40 2023-07-14T11:13:07.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:07.969+0000 7f04e1d9b700 1 -- 172.21.15.84:0/1194913419 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04d00035b0 con 0x7f04e4156e40 2023-07-14T11:13:07.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:07.969+0000 7f04e2d9d700 1 -- 172.21.15.84:0/1194913419 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04e415d810 msgr2=0x7f04e40b2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:07.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:07.969+0000 7f04e2d9d700 1 --2- 172.21.15.84:0/1194913419 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04e415d810 0x7f04e40b2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:07.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:07.969+0000 7f04e2d9d700 1 -- 172.21.15.84:0/1194913419 >> v1:172.21.15.84:6789/0 conn(0x7f04e4156e40 legacy=0x7f04e41596a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:07.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:07.969+0000 7f04e2d9d700 1 -- 172.21.15.84:0/1194913419 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04e415a570 con 0x7f04e40b2770 2023-07-14T11:13:07.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:07.969+0000 7f04e2d9d700 1 --2- 172.21.15.84:0/1194913419 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04e40b2770 0x7f04e406fde0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f04dc009d90 tx=0x7f04dc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=366f6c28c08ef9fd server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:07.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:07.969+0000 7f04e1d9b700 1 -- 172.21.15.84:0/1194913419 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04dc00e070 con 0x7f04e40b2770 2023-07-14T11:13:07.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:07.969+0000 7f04e1d9b700 1 -- 172.21.15.84:0/1194913419 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04dc00bb20 con 0x7f04e40b2770 2023-07-14T11:13:07.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:07.969+0000 7f04e1d9b700 1 -- 172.21.15.84:0/1194913419 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04dc012430 con 0x7f04e40b2770 2023-07-14T11:13:07.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:07.970+0000 7f04e8fff700 1 -- 172.21.15.84:0/1194913419 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04e40b2770 msgr2=0x7f04e406fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:07.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:07.970+0000 7f04e8fff700 1 --2- 172.21.15.84:0/1194913419 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04e40b2770 0x7f04e406fde0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f04dc009d90 tx=0x7f04dc00b330 comp rx=0 tx=0).stop 2023-07-14T11:13:07.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:07.970+0000 7f04e8fff700 1 -- 172.21.15.84:0/1194913419 shutdown_connections 2023-07-14T11:13:07.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:07.970+0000 7f04e8fff700 1 --2- 172.21.15.84:0/1194913419 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04e40b2770 0x7f04e406fde0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:07.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:07.970+0000 7f04e8fff700 1 --2- 172.21.15.84:0/1194913419 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04e415d810 0x7f04e40b2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:07.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:07.970+0000 7f04e8fff700 1 -- 172.21.15.84:0/1194913419 >> 172.21.15.84:0/1194913419 conn(0x7f04e4065bd0 msgr2=0x7f04e4065fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:07.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:07.970+0000 7f04e8fff700 1 -- 172.21.15.84:0/1194913419 shutdown_connections 2023-07-14T11:13:07.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:07.970+0000 7f04e8fff700 1 -- 172.21.15.84:0/1194913419 wait complete. 2023-07-14T11:13:07.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:07.971+0000 7f04e8fff700 1 Processor -- start 2023-07-14T11:13:07.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:07.972+0000 7f04e8fff700 1 -- start start 2023-07-14T11:13:07.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:07.972+0000 7f04e8fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04e40b2770 0x7f04e41f27f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:07.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:07.972+0000 7f04e8fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04e4156e40 0x7f04e40ac850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:07.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:07.973+0000 7f04e8fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04e415d810 0x7f04e415bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:07.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:07.973+0000 7f04e8fff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e41f21e0 con 0x7f04e40b2770 2023-07-14T11:13:07.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:07.973+0000 7f04e8fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e40cde60 con 0x7f04e4156e40 2023-07-14T11:13:07.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:07.973+0000 7f04e8fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04e40ce140 con 0x7f04e415d810 2023-07-14T11:13:07.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:07.973+0000 7f04e259c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04e40b2770 0x7f04e41f27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:07.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:07.973+0000 7f04e259c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04e40b2770 0x7f04e41f27f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51936/0 (socket says 172.21.15.84:51936) 2023-07-14T11:13:07.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:07.973+0000 7f04e259c700 1 -- 172.21.15.84:0/3060232509 learned_addr learned my addr 172.21.15.84:0/3060232509 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:07.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:07.973+0000 7f04e2d9d700 1 --2- 172.21.15.84:0/3060232509 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04e415d810 0x7f04e415bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:07.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:07.973+0000 7f04dbfff700 1 --2- 172.21.15.84:0/3060232509 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04e4156e40 0x7f04e40ac850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:07.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:07.973+0000 7f04e259c700 1 -- 172.21.15.84:0/3060232509 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04e415d810 msgr2=0x7f04e415bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:07.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:07.973+0000 7f04e259c700 1 --2- 172.21.15.84:0/3060232509 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04e415d810 0x7f04e415bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:07.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:07.973+0000 7f04e259c700 1 -- 172.21.15.84:0/3060232509 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04e4156e40 msgr2=0x7f04e40ac850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:07.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:07.973+0000 7f04e259c700 1 --2- 172.21.15.84:0/3060232509 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04e4156e40 0x7f04e40ac850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:07.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:07.973+0000 7f04e259c700 1 -- 172.21.15.84:0/3060232509 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04dc009a70 con 0x7f04e40b2770 2023-07-14T11:13:07.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:07.973+0000 7f04dbfff700 1 --2- 172.21.15.84:0/3060232509 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04e4156e40 0x7f04e40ac850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:13:07.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:07.973+0000 7f04e259c700 1 --2- 172.21.15.84:0/3060232509 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04e40b2770 0x7f04e41f27f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f04d400c700 tx=0x7f04d400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:07.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:07.974+0000 7f04daffd700 1 -- 172.21.15.84:0/3060232509 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d4005d70 con 0x7f04e40b2770 2023-07-14T11:13:07.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:07.974+0000 7f04daffd700 1 -- 172.21.15.84:0/3060232509 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04d40070d0 con 0x7f04e40b2770 2023-07-14T11:13:07.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:07.974+0000 7f04e8fff700 1 -- 172.21.15.84:0/3060232509 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04e40afd10 con 0x7f04e40b2770 2023-07-14T11:13:07.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:07.974+0000 7f04daffd700 1 -- 172.21.15.84:0/3060232509 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d4007460 con 0x7f04e40b2770 2023-07-14T11:13:07.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:07.974+0000 7f04e8fff700 1 -- 172.21.15.84:0/3060232509 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04e40b02d0 con 0x7f04e40b2770 2023-07-14T11:13:07.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:07.975+0000 7f04e8fff700 1 -- 172.21.15.84:0/3060232509 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04e40afb70 con 0x7f04e40b2770 2023-07-14T11:13:07.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:07.976+0000 7f04daffd700 1 -- 172.21.15.84:0/3060232509 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f04d40075c0 con 0x7f04e40b2770 2023-07-14T11:13:07.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:07.977+0000 7f04daffd700 1 --2- 172.21.15.84:0/3060232509 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f04c406ace0 0x7f04c406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:07.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:07.977+0000 7f04daffd700 1 -- 172.21.15.84:0/3060232509 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5199+0+0 (secure 0 0 0) 0x7f04d40889a0 con 0x7f04e40b2770 2023-07-14T11:13:07.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:07.977+0000 7f04dbfff700 1 --2- 172.21.15.84:0/3060232509 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f04c406ace0 0x7f04c406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:07.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:07.978+0000 7f04dbfff700 1 --2- 172.21.15.84:0/3060232509 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f04c406ace0 0x7f04c406d190 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f04e40ae3c0 tx=0x7f04cc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:07.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:07.981+0000 7f04daffd700 1 -- 172.21.15.84:0/3060232509 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f04d4053d90 con 0x7f04e40b2770 2023-07-14T11:13:08.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:08.179+0000 7f04e8fff700 1 -- 172.21.15.84:0/3060232509 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f04e40afb70 con 0x7f04e40b2770 2023-07-14T11:13:08.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:08.753+0000 7f04daffd700 1 -- 172.21.15.84:0/3060232509 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v18) v1 ==== 173+0+0 (secure 0 0 0) 0x7f04e40afb70 con 0x7f04e40b2770 2023-07-14T11:13:08.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:08.757+0000 7f04e8fff700 1 -- 172.21.15.84:0/3060232509 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f04c406ace0 msgr2=0x7f04c406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:08.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:08.757+0000 7f04e8fff700 1 --2- 172.21.15.84:0/3060232509 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f04c406ace0 0x7f04c406d190 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f04e40ae3c0 tx=0x7f04cc008040 comp rx=0 tx=0).stop 2023-07-14T11:13:08.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:08.757+0000 7f04e8fff700 1 -- 172.21.15.84:0/3060232509 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04e40b2770 msgr2=0x7f04e41f27f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:08.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:08.757+0000 7f04e8fff700 1 --2- 172.21.15.84:0/3060232509 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04e40b2770 0x7f04e41f27f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f04d400c700 tx=0x7f04d400ca10 comp rx=0 tx=0).stop 2023-07-14T11:13:08.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:08.757+0000 7f04e8fff700 1 -- 172.21.15.84:0/3060232509 shutdown_connections 2023-07-14T11:13:08.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:08.757+0000 7f04e8fff700 1 --2- 172.21.15.84:0/3060232509 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f04c406ace0 0x7f04c406d190 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:08.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:08.757+0000 7f04e8fff700 1 --2- 172.21.15.84:0/3060232509 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04e415d810 0x7f04e415bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:08.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:08.757+0000 7f04e8fff700 1 --2- 172.21.15.84:0/3060232509 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04e40b2770 0x7f04e41f27f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:08.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:08.757+0000 7f04e8fff700 1 --2- 172.21.15.84:0/3060232509 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04e4156e40 0x7f04e40ac850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:08.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:08.757+0000 7f04e8fff700 1 -- 172.21.15.84:0/3060232509 >> 172.21.15.84:0/3060232509 conn(0x7f04e4065bd0 msgr2=0x7f04e40cef70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:08.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:08.758+0000 7f04e8fff700 1 -- 172.21.15.84:0/3060232509 shutdown_connections 2023-07-14T11:13:08.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:08.758+0000 7f04e8fff700 1 -- 172.21.15.84:0/3060232509 wait complete. 2023-07-14T11:13:08.762 INFO:teuthology.orchestra.run.smithi084.stderr:enabled application 'rbd' on pool 'rbd' 2023-07-14T11:13:08.779 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-07-14T11:13:08.779 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-14T11:13:08.780 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-14T11:13:08.784 INFO:tasks.ceph.mds.a:Started 2023-07-14T11:13:08.784 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-14T11:13:08.784 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-14T11:13:08.788 INFO:tasks.ceph.mds.c:Started 2023-07-14T11:13:08.789 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-14T11:13:08.789 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-14T11:13:08.794 INFO:tasks.ceph.mds.b:Started 2023-07-14T11:13:08.794 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-14T11:13:08.794 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-14T11:13:08.798 INFO:tasks.ceph.mds.d:Started 2023-07-14T11:13:08.799 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-07-14T11:13:08.799 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:13:08.936 INFO:tasks.ceph.mds.c.smithi084.stdout:starting mds.c at 2023-07-14T11:13:08.937 INFO:tasks.ceph.mds.a.smithi084.stdout:starting mds.a at 2023-07-14T11:13:08.951 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2023-07-14T11:13:08.951 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2023-07-14T11:13:08.953 INFO:tasks.ceph.mds.b.smithi179.stderr:2023-07-14T11:13:08.950+0000 7f534f1fd700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2023-07-14T11:13:09.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.007+0000 7fdbf49ff700 1 Processor -- start 2023-07-14T11:13:09.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.008+0000 7fdbf49ff700 1 -- start start 2023-07-14T11:13:09.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.009+0000 7fdbf49ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdbf015c950 0x7fdbf00b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:09.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.009+0000 7fdbf49ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fdbf00d1220 0x7fdbf00afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:09.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.009+0000 7fdbf49ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbf00d2ce0 con 0x7fdbf00b1e00 2023-07-14T11:13:09.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.009+0000 7fdbf49ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbf00b3350 con 0x7fdbf00d1220 2023-07-14T11:13:09.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.009+0000 7fdbf49ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf00b3630 con 0x7fdbf015c950 2023-07-14T11:13:09.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.009+0000 7fdbee59c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdbf015c950 0x7fdbf00b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:09.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.009+0000 7fdbee59c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdbf015c950 0x7fdbf00b43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.84:46080/0 (socket says 172.21.15.84:46080) 2023-07-14T11:13:09.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.009+0000 7fdbee59c700 1 -- 172.21.15.84:0/2838111878 learned_addr learned my addr 172.21.15.84:0/2838111878 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:09.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.009+0000 7fdbeed9d700 1 --2- 172.21.15.84:0/2838111878 >> v2:172.21.15.179:3300/0 conn(0x7fdbf00d1220 0x7fdbf00afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:09.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.009+0000 7fdbee59c700 1 -- 172.21.15.84:0/2838111878 >> v2:172.21.15.179:3300/0 conn(0x7fdbf00d1220 msgr2=0x7fdbf00afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:09.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.009+0000 7fdbee59c700 1 --2- 172.21.15.84:0/2838111878 >> v2:172.21.15.179:3300/0 conn(0x7fdbf00d1220 0x7fdbf00afac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:09.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.009+0000 7fdbee59c700 1 -- 172.21.15.84:0/2838111878 >> v1:172.21.15.179:6789/0 conn(0x7fdbf00b1e00 legacy=0x7fdbf00d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:09.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.009+0000 7fdbee59c700 1 -- 172.21.15.84:0/2838111878 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbf00b3910 con 0x7fdbf015c950 2023-07-14T11:13:09.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.009+0000 7fdbeed9d700 1 --2- 172.21.15.84:0/2838111878 >> v2:172.21.15.179:3300/0 conn(0x7fdbf00d1220 0x7fdbf00afac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:13:09.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.010+0000 7fdbee59c700 1 --2- 172.21.15.84:0/2838111878 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdbf015c950 0x7fdbf00b43f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fdbe0006fd0 tx=0x7fdbe0009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eef8f9bf7bc8f71e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:09.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.010+0000 7fdbedd9b700 1 -- 172.21.15.84:0/2838111878 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe0005e30 con 0x7fdbf015c950 2023-07-14T11:13:09.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.010+0000 7fdbedd9b700 1 -- 172.21.15.84:0/2838111878 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbe0004030 con 0x7fdbf015c950 2023-07-14T11:13:09.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.010+0000 7fdbedd9b700 1 -- 172.21.15.84:0/2838111878 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe00043e0 con 0x7fdbf015c950 2023-07-14T11:13:09.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.010+0000 7fdbf49ff700 1 -- 172.21.15.84:0/2838111878 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdbf015c950 msgr2=0x7fdbf00b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:09.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.010+0000 7fdbf49ff700 1 --2- 172.21.15.84:0/2838111878 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdbf015c950 0x7fdbf00b43f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fdbe0006fd0 tx=0x7fdbe0009bd0 comp rx=0 tx=0).stop 2023-07-14T11:13:09.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.010+0000 7fdbf49ff700 1 -- 172.21.15.84:0/2838111878 shutdown_connections 2023-07-14T11:13:09.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.010+0000 7fdbf49ff700 1 --2- 172.21.15.84:0/2838111878 >> v2:172.21.15.179:3300/0 conn(0x7fdbf00d1220 0x7fdbf00afac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:09.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.010+0000 7fdbf49ff700 1 --2- 172.21.15.84:0/2838111878 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdbf015c950 0x7fdbf00b43f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:09.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.010+0000 7fdbf49ff700 1 -- 172.21.15.84:0/2838111878 >> 172.21.15.84:0/2838111878 conn(0x7fdbf009c1d0 msgr2=0x7fdbf00d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:09.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.011+0000 7fdbf49ff700 1 -- 172.21.15.84:0/2838111878 shutdown_connections 2023-07-14T11:13:09.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.011+0000 7fdbf49ff700 1 -- 172.21.15.84:0/2838111878 wait complete. 2023-07-14T11:13:09.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.012+0000 7fdbf49ff700 1 Processor -- start 2023-07-14T11:13:09.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.012+0000 7fdbf49ff700 1 -- start start 2023-07-14T11:13:09.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.013+0000 7fdbf49ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbf00b1e00 0x7fdbf01565a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:09.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.013+0000 7fdbf49ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdbf00d1220 0x7fdbf00b8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:09.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.013+0000 7fdbf49ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbf015c950 0x7fdbf00ce700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:09.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.013+0000 7fdbf49ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf00b77f0 con 0x7fdbf00b1e00 2023-07-14T11:13:09.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.013+0000 7fdbf49ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf00b7ad0 con 0x7fdbf015c950 2023-07-14T11:13:09.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.013+0000 7fdbf49ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf00b7db0 con 0x7fdbf00d1220 2023-07-14T11:13:09.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.014+0000 7fdbee59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbf00b1e00 0x7fdbf01565a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:09.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.014+0000 7fdbee59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbf00b1e00 0x7fdbf01565a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44076/0 (socket says 172.21.15.84:44076) 2023-07-14T11:13:09.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.014+0000 7fdbee59c700 1 -- 172.21.15.84:0/3581274745 learned_addr learned my addr 172.21.15.84:0/3581274745 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:09.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.014+0000 7fdbeed9d700 1 --2- 172.21.15.84:0/3581274745 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbf015c950 0x7fdbf00ce700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:09.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.014+0000 7fdbe7fff700 1 --2- 172.21.15.84:0/3581274745 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdbf00d1220 0x7fdbf00b8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:09.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.014+0000 7fdbee59c700 1 -- 172.21.15.84:0/3581274745 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdbf00d1220 msgr2=0x7fdbf00b8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:09.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.014+0000 7fdbee59c700 1 --2- 172.21.15.84:0/3581274745 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdbf00d1220 0x7fdbf00b8890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:09.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.014+0000 7fdbee59c700 1 -- 172.21.15.84:0/3581274745 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbf015c950 msgr2=0x7fdbf00ce700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:09.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.014+0000 7fdbee59c700 1 --2- 172.21.15.84:0/3581274745 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbf015c950 0x7fdbf00ce700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:09.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.014+0000 7fdbee59c700 1 -- 172.21.15.84:0/3581274745 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe0009500 con 0x7fdbf00b1e00 2023-07-14T11:13:09.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.014+0000 7fdbe7fff700 1 --2- 172.21.15.84:0/3581274745 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdbf00d1220 0x7fdbf00b8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:13:09.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.014+0000 7fdbeed9d700 1 --2- 172.21.15.84:0/3581274745 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbf015c950 0x7fdbf00ce700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:13:09.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.014+0000 7fdbee59c700 1 --2- 172.21.15.84:0/3581274745 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbf00b1e00 0x7fdbf01565a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fdbe0009130 tx=0x7fdbe0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:09.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.015+0000 7fdbe6ffd700 1 -- 172.21.15.84:0/3581274745 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe0003d90 con 0x7fdbf00b1e00 2023-07-14T11:13:09.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.015+0000 7fdbe6ffd700 1 -- 172.21.15.84:0/3581274745 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbe0011420 con 0x7fdbf00b1e00 2023-07-14T11:13:09.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.015+0000 7fdbf49ff700 1 -- 172.21.15.84:0/3581274745 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbf00b8090 con 0x7fdbf00b1e00 2023-07-14T11:13:09.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.015+0000 7fdbe6ffd700 1 -- 172.21.15.84:0/3581274745 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe00117d0 con 0x7fdbf00b1e00 2023-07-14T11:13:09.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.015+0000 7fdbf49ff700 1 -- 172.21.15.84:0/3581274745 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbf00cd730 con 0x7fdbf00b1e00 2023-07-14T11:13:09.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.016+0000 7fdbe4ff9700 1 -- 172.21.15.84:0/3581274745 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbf00cd8c0 con 0x7fdbf00b1e00 2023-07-14T11:13:09.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.017+0000 7fdbe6ffd700 1 -- 172.21.15.84:0/3581274745 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdbe0011930 con 0x7fdbf00b1e00 2023-07-14T11:13:09.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.018+0000 7fdbe6ffd700 1 --2- 172.21.15.84:0/3581274745 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fdbd006ace0 0x7fdbd006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:09.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.018+0000 7fdbe6ffd700 1 -- 172.21.15.84:0/3581274745 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fdbe008a3f0 con 0x7fdbf00b1e00 2023-07-14T11:13:09.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.018+0000 7fdbe7fff700 1 --2- 172.21.15.84:0/3581274745 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fdbd006ace0 0x7fdbd006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:09.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.019+0000 7fdbe7fff700 1 --2- 172.21.15.84:0/3581274745 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fdbd006ace0 0x7fdbd006d190 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdbf00b0bd0 tx=0x7fdbd8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:09.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.023+0000 7fdbe6ffd700 1 -- 172.21.15.84:0/3581274745 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fdbe00557e0 con 0x7fdbf00b1e00 2023-07-14T11:13:09.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.218+0000 7fdbe4ff9700 1 -- 172.21.15.84:0/3581274745 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdbf004e280 con 0x7fdbf00b1e00 2023-07-14T11:13:09.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.219+0000 7fdbe6ffd700 1 -- 172.21.15.84:0/3581274745 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+14625 (secure 0 0 0) 0x7fdbe0058e00 con 0x7fdbf00b1e00 2023-07-14T11:13:09.222 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:13:09.222 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":18,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:13:08.745512+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:13:09.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.221+0000 7fdbe4ff9700 1 -- 172.21.15.84:0/3581274745 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fdbd006ace0 msgr2=0x7fdbd006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:09.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.221+0000 7fdbe4ff9700 1 --2- 172.21.15.84:0/3581274745 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fdbd006ace0 0x7fdbd006d190 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdbf00b0bd0 tx=0x7fdbd8009040 comp rx=0 tx=0).stop 2023-07-14T11:13:09.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.221+0000 7fdbe4ff9700 1 -- 172.21.15.84:0/3581274745 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbf00b1e00 msgr2=0x7fdbf01565a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:09.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.221+0000 7fdbe4ff9700 1 --2- 172.21.15.84:0/3581274745 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbf00b1e00 0x7fdbf01565a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fdbe0009130 tx=0x7fdbe0004750 comp rx=0 tx=0).stop 2023-07-14T11:13:09.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.222+0000 7fdbe4ff9700 1 -- 172.21.15.84:0/3581274745 shutdown_connections 2023-07-14T11:13:09.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.222+0000 7fdbe4ff9700 1 --2- 172.21.15.84:0/3581274745 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbf015c950 0x7fdbf00ce700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:09.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.222+0000 7fdbe4ff9700 1 --2- 172.21.15.84:0/3581274745 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbf00b1e00 0x7fdbf01565a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:09.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.222+0000 7fdbe4ff9700 1 --2- 172.21.15.84:0/3581274745 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fdbd006ace0 0x7fdbd006d190 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:09.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.222+0000 7fdbe4ff9700 1 --2- 172.21.15.84:0/3581274745 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdbf00d1220 0x7fdbf00b8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:09.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.222+0000 7fdbe4ff9700 1 -- 172.21.15.84:0/3581274745 >> 172.21.15.84:0/3581274745 conn(0x7fdbf009c1d0 msgr2=0x7fdbf00c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:09.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.222+0000 7fdbe4ff9700 1 -- 172.21.15.84:0/3581274745 shutdown_connections 2023-07-14T11:13:09.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.222+0000 7fdbe4ff9700 1 -- 172.21.15.84:0/3581274745 wait complete. 2023-07-14T11:13:09.242 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T11:13:00.125395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T11:13:06.803994+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T11:13:09.242 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T11:13:09.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.437+0000 7f6abbfff700 1 Processor -- start 2023-07-14T11:13:09.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.437+0000 7f6abbfff700 1 -- start start 2023-07-14T11:13:09.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.438+0000 7f6abbfff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6ab40b8a60 0x7f6ab40b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:09.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.438+0000 7f6abbfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ab40b4530 0x7f6ab40d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:09.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.438+0000 7f6abbfff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ab40b8e30 con 0x7f6ab40d1050 2023-07-14T11:13:09.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.438+0000 7f6abbfff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ab40d14d0 con 0x7f6ab40b8a60 2023-07-14T11:13:09.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.438+0000 7f6abbfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab40b1e30 con 0x7f6ab40b4530 2023-07-14T11:13:09.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.438+0000 7f6ab959a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ab40b4530 0x7f6ab40d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:09.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.438+0000 7f6ab9d9b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6ab40b8a60 0x7f6ab40b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:09.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.438+0000 7f6ab959a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ab40b4530 0x7f6ab40d0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.84:46098/0 (socket says 172.21.15.84:46098) 2023-07-14T11:13:09.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.438+0000 7f6ab959a700 1 -- 172.21.15.84:0/1105928765 learned_addr learned my addr 172.21.15.84:0/1105928765 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:09.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.438+0000 7f6aba59c700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f6ab40d1050 0x7f6ab40b25d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.84:42902/0 (socket says 172.21.15.84:42902) 2023-07-14T11:13:09.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.438+0000 7f6ab9d9b700 1 --2- 172.21.15.84:0/1105928765 >> v2:172.21.15.179:3300/0 conn(0x7f6ab40b8a60 0x7f6ab40b3ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.84:46610/0 (socket says 172.21.15.84:46610) 2023-07-14T11:13:09.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.439+0000 7f6ab959a700 1 -- 172.21.15.84:0/1105928765 >> v2:172.21.15.179:3300/0 conn(0x7f6ab40b8a60 msgr2=0x7f6ab40b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:09.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.439+0000 7f6ab959a700 1 --2- 172.21.15.84:0/1105928765 >> v2:172.21.15.179:3300/0 conn(0x7f6ab40b8a60 0x7f6ab40b3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:09.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.439+0000 7f6ab959a700 1 -- 172.21.15.84:0/1105928765 >> v1:172.21.15.179:6789/0 conn(0x7f6ab40d1050 legacy=0x7f6ab40b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:09.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.439+0000 7f6ab959a700 1 -- 172.21.15.84:0/1105928765 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab40afaa0 con 0x7f6ab40b4530 2023-07-14T11:13:09.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.439+0000 7f6ab8d99700 1 -- 172.21.15.84:0/1105928765 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1642384432 0 0) 0x7f6ab40b8e30 con 0x7f6ab40d1050 2023-07-14T11:13:09.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.439+0000 7f6ab959a700 1 --2- 172.21.15.84:0/1105928765 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ab40b4530 0x7f6ab40d0b10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6aa40098f0 tx=0x7f6aa4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c553bd82e442955 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:09.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.439+0000 7f6ab8d99700 1 -- 172.21.15.84:0/1105928765 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa4011830 con 0x7f6ab40b4530 2023-07-14T11:13:09.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.439+0000 7f6ab8d99700 1 -- 172.21.15.84:0/1105928765 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aa4011990 con 0x7f6ab40b4530 2023-07-14T11:13:09.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.439+0000 7f6ab8d99700 1 -- 172.21.15.84:0/1105928765 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa4011d20 con 0x7f6ab40b4530 2023-07-14T11:13:09.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.440+0000 7f6abbfff700 1 -- 172.21.15.84:0/1105928765 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ab40b4530 msgr2=0x7f6ab40d0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:09.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.440+0000 7f6abbfff700 1 --2- 172.21.15.84:0/1105928765 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ab40b4530 0x7f6ab40d0b10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6aa40098f0 tx=0x7f6aa4009c00 comp rx=0 tx=0).stop 2023-07-14T11:13:09.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.440+0000 7f6abbfff700 1 -- 172.21.15.84:0/1105928765 shutdown_connections 2023-07-14T11:13:09.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.440+0000 7f6abbfff700 1 --2- 172.21.15.84:0/1105928765 >> v2:172.21.15.179:3300/0 conn(0x7f6ab40b8a60 0x7f6ab40b3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:09.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.440+0000 7f6abbfff700 1 --2- 172.21.15.84:0/1105928765 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ab40b4530 0x7f6ab40d0b10 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:09.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.440+0000 7f6abbfff700 1 -- 172.21.15.84:0/1105928765 >> 172.21.15.84:0/1105928765 conn(0x7f6ab409c1b0 msgr2=0x7f6ab40d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:09.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.440+0000 7f6abbfff700 1 -- 172.21.15.84:0/1105928765 shutdown_connections 2023-07-14T11:13:09.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.440+0000 7f6abbfff700 1 -- 172.21.15.84:0/1105928765 wait complete. 2023-07-14T11:13:09.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.442+0000 7f6abbfff700 1 Processor -- start 2023-07-14T11:13:09.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.442+0000 7f6abbfff700 1 -- start start 2023-07-14T11:13:09.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.443+0000 7f6abbfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ab40b4530 0x7f6ab415ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:09.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.443+0000 7f6abbfff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ab40b8a60 0x7f6ab41e6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:09.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.443+0000 7f6abbfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ab40d1050 0x7f6ab40cc400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:09.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.443+0000 7f6abbfff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab415d3d0 con 0x7f6ab40d1050 2023-07-14T11:13:09.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.443+0000 7f6abbfff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab415d5b0 con 0x7f6ab40b8a60 2023-07-14T11:13:09.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.443+0000 7f6abbfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab4143e50 con 0x7f6ab40b4530 2023-07-14T11:13:09.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.443+0000 7f6aba59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ab40d1050 0x7f6ab40cc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:09.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.443+0000 7f6aba59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ab40d1050 0x7f6ab40cc400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44086/0 (socket says 172.21.15.84:44086) 2023-07-14T11:13:09.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.443+0000 7f6aba59c700 1 -- 172.21.15.84:0/2628746934 learned_addr learned my addr 172.21.15.84:0/2628746934 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:09.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.443+0000 7f6ab9d9b700 1 --2- 172.21.15.84:0/2628746934 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ab40b4530 0x7f6ab415ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:09.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.443+0000 7f6ab959a700 1 --2- 172.21.15.84:0/2628746934 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ab40b8a60 0x7f6ab41e6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:09.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.443+0000 7f6aba59c700 1 -- 172.21.15.84:0/2628746934 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ab40b4530 msgr2=0x7f6ab415ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:09.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.443+0000 7f6aba59c700 1 --2- 172.21.15.84:0/2628746934 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ab40b4530 0x7f6ab415ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:09.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.443+0000 7f6aba59c700 1 -- 172.21.15.84:0/2628746934 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ab40b8a60 msgr2=0x7f6ab41e6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:09.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.443+0000 7f6aba59c700 1 --2- 172.21.15.84:0/2628746934 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ab40b8a60 0x7f6ab41e6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:09.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.443+0000 7f6aba59c700 1 -- 172.21.15.84:0/2628746934 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aa4009550 con 0x7f6ab40d1050 2023-07-14T11:13:09.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.444+0000 7f6aba59c700 1 --2- 172.21.15.84:0/2628746934 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ab40d1050 0x7f6ab40cc400 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6aac00cba0 tx=0x7f6aac00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:09.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.444+0000 7f6aaa7fc700 1 -- 172.21.15.84:0/2628746934 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aac00ab80 con 0x7f6ab40d1050 2023-07-14T11:13:09.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.444+0000 7f6aaa7fc700 1 -- 172.21.15.84:0/2628746934 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aac00ad00 con 0x7f6ab40d1050 2023-07-14T11:13:09.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.444+0000 7f6aaa7fc700 1 -- 172.21.15.84:0/2628746934 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aac007310 con 0x7f6ab40d1050 2023-07-14T11:13:09.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.444+0000 7f6abbfff700 1 -- 172.21.15.84:0/2628746934 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ab4144130 con 0x7f6ab40d1050 2023-07-14T11:13:09.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.444+0000 7f6abbfff700 1 -- 172.21.15.84:0/2628746934 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ab41446f0 con 0x7f6ab40d1050 2023-07-14T11:13:09.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.445+0000 7f6abbfff700 1 -- 172.21.15.84:0/2628746934 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ab41448e0 con 0x7f6ab40d1050 2023-07-14T11:13:09.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.446+0000 7f6aaa7fc700 1 -- 172.21.15.84:0/2628746934 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6aac007470 con 0x7f6ab40d1050 2023-07-14T11:13:09.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.447+0000 7f6aaa7fc700 1 --2- 172.21.15.84:0/2628746934 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6a9806ace0 0x7f6a9806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:09.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.447+0000 7f6aaa7fc700 1 -- 172.21.15.84:0/2628746934 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6aac088ca0 con 0x7f6ab40d1050 2023-07-14T11:13:09.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.447+0000 7f6ab9d9b700 1 --2- 172.21.15.84:0/2628746934 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6a9806ace0 0x7f6a9806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:09.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.447+0000 7f6ab9d9b700 1 --2- 172.21.15.84:0/2628746934 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6a9806ace0 0x7f6a9806d190 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6ab0009b70 tx=0x7f6ab0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:09.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.451+0000 7f6aaa7fc700 1 -- 172.21.15.84:0/2628746934 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f6aac054000 con 0x7f6ab40d1050 2023-07-14T11:13:09.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.641+0000 7f6abbfff700 1 -- 172.21.15.84:0/2628746934 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6ab4074350 con 0x7f6ab40d1050 2023-07-14T11:13:09.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.642+0000 7f6aaa7fc700 1 -- 172.21.15.84:0/2628746934 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6aac0180a0 con 0x7f6ab40d1050 2023-07-14T11:13:09.644 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-07-14T11:13:09.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.644+0000 7f6abbfff700 1 -- 172.21.15.84:0/2628746934 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6a9806ace0 msgr2=0x7f6a9806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:09.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.644+0000 7f6abbfff700 1 --2- 172.21.15.84:0/2628746934 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6a9806ace0 0x7f6a9806d190 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6ab0009b70 tx=0x7f6ab0008040 comp rx=0 tx=0).stop 2023-07-14T11:13:09.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.644+0000 7f6abbfff700 1 -- 172.21.15.84:0/2628746934 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ab40d1050 msgr2=0x7f6ab40cc400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:09.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.644+0000 7f6abbfff700 1 --2- 172.21.15.84:0/2628746934 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ab40d1050 0x7f6ab40cc400 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6aac00cba0 tx=0x7f6aac00cf60 comp rx=0 tx=0).stop 2023-07-14T11:13:09.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.644+0000 7f6abbfff700 1 -- 172.21.15.84:0/2628746934 shutdown_connections 2023-07-14T11:13:09.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.644+0000 7f6abbfff700 1 --2- 172.21.15.84:0/2628746934 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6a9806ace0 0x7f6a9806d190 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:09.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.644+0000 7f6abbfff700 1 --2- 172.21.15.84:0/2628746934 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ab40b4530 0x7f6ab415ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:09.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.644+0000 7f6abbfff700 1 --2- 172.21.15.84:0/2628746934 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ab40d1050 0x7f6ab40cc400 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:09.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.644+0000 7f6abbfff700 1 --2- 172.21.15.84:0/2628746934 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ab40b8a60 0x7f6ab41e6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:09.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.644+0000 7f6abbfff700 1 -- 172.21.15.84:0/2628746934 >> 172.21.15.84:0/2628746934 conn(0x7f6ab409c1b0 msgr2=0x7f6ab40b3130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:09.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.644+0000 7f6abbfff700 1 -- 172.21.15.84:0/2628746934 shutdown_connections 2023-07-14T11:13:09.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.644+0000 7f6abbfff700 1 -- 172.21.15.84:0/2628746934 wait complete. 2023-07-14T11:13:09.664 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T11:13:09.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.865+0000 7f7067bff700 1 Processor -- start 2023-07-14T11:13:09.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.865+0000 7f7067bff700 1 -- start start 2023-07-14T11:13:09.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.866+0000 7f7067bff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f706015d9d0 0x7f706006b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:09.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.866+0000 7f7067bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7060071170 0x7f70600715c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:09.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.866+0000 7f7067bff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7060071b00 con 0x7f706006c9f0 2023-07-14T11:13:09.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.866+0000 7f7067bff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f706006c4e0 con 0x7f706015d9d0 2023-07-14T11:13:09.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.866+0000 7f7067bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70600b2020 con 0x7f7060071170 2023-07-14T11:13:09.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.866+0000 7f706599b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f706015d9d0 0x7f706006b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:09.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.867+0000 7f706519a700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f706006c9f0 0x7f70600b1910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:43154/0 (socket says 172.21.15.84:43154) 2023-07-14T11:13:09.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.867+0000 7f706519a700 1 -- 172.21.15.84:0/381807843 learned_addr learned my addr 172.21.15.84:0/381807843 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:13:09.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.867+0000 7f706619c700 1 --2- 172.21.15.84:0/381807843 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7060071170 0x7f70600715c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:09.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.867+0000 7f706599b700 1 -- 172.21.15.84:0/381807843 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7060071170 msgr2=0x7f70600715c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:09.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.867+0000 7f706599b700 1 --2- 172.21.15.84:0/381807843 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7060071170 0x7f70600715c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:09.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.867+0000 7f706599b700 1 -- 172.21.15.84:0/381807843 >> v1:172.21.15.84:6789/0 conn(0x7f706006c9f0 legacy=0x7f70600b1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:09.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.867+0000 7f706599b700 1 -- 172.21.15.84:0/381807843 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f706015dda0 con 0x7f706015d9d0 2023-07-14T11:13:09.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.867+0000 7f7064999700 1 -- 172.21.15.84:0/381807843 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1761709510 0 0) 0x7f7060071b00 con 0x7f706006c9f0 2023-07-14T11:13:09.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.867+0000 7f706599b700 1 --2- 172.21.15.84:0/381807843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f706015d9d0 0x7f706006b5b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f705c009840 tx=0x7f705c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b06d4e85eeca06e5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:09.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.867+0000 7f7064999700 1 -- 172.21.15.84:0/381807843 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f705c011830 con 0x7f706015d9d0 2023-07-14T11:13:09.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.868+0000 7f7064999700 1 -- 172.21.15.84:0/381807843 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f705c011990 con 0x7f706015d9d0 2023-07-14T11:13:09.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.868+0000 7f7064999700 1 -- 172.21.15.84:0/381807843 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f705c011d20 con 0x7f706015d9d0 2023-07-14T11:13:09.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.868+0000 7f7067bff700 1 -- 172.21.15.84:0/381807843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f706015d9d0 msgr2=0x7f706006b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:09.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.868+0000 7f7067bff700 1 --2- 172.21.15.84:0/381807843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f706015d9d0 0x7f706006b5b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f705c009840 tx=0x7f705c009b50 comp rx=0 tx=0).stop 2023-07-14T11:13:09.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.868+0000 7f7067bff700 1 -- 172.21.15.84:0/381807843 shutdown_connections 2023-07-14T11:13:09.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.868+0000 7f7067bff700 1 --2- 172.21.15.84:0/381807843 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7060071170 0x7f70600715c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:09.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.868+0000 7f7067bff700 1 --2- 172.21.15.84:0/381807843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f706015d9d0 0x7f706006b5b0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:09.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.868+0000 7f7067bff700 1 -- 172.21.15.84:0/381807843 >> 172.21.15.84:0/381807843 conn(0x7f70600b05d0 msgr2=0x7f70600b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:09.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.868+0000 7f7067bff700 1 -- 172.21.15.84:0/381807843 shutdown_connections 2023-07-14T11:13:09.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.868+0000 7f7067bff700 1 -- 172.21.15.84:0/381807843 wait complete. 2023-07-14T11:13:09.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.870+0000 7f7067bff700 1 Processor -- start 2023-07-14T11:13:09.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.870+0000 7f7067bff700 1 -- start start 2023-07-14T11:13:09.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.871+0000 7f7067bff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f706006c9f0 0x7f70601e59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:09.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.871+0000 7f7067bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7060071170 0x7f70601e40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:09.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.871+0000 7f7067bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f706015d9d0 0x7f70601e45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:09.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.871+0000 7f7067bff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70600c2a40 con 0x7f706006c9f0 2023-07-14T11:13:09.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.871+0000 7f7067bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70601e4e50 con 0x7f706015d9d0 2023-07-14T11:13:09.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.871+0000 7f7067bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70601e5130 con 0x7f7060071170 2023-07-14T11:13:09.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.871+0000 7f706599b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f706006c9f0 0x7f70601e59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:09.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.871+0000 7f706599b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f706006c9f0 0x7f70601e59f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44098/0 (socket says 172.21.15.84:44098) 2023-07-14T11:13:09.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.871+0000 7f706599b700 1 -- 172.21.15.84:0/3929971888 learned_addr learned my addr 172.21.15.84:0/3929971888 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:09.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.872+0000 7f706519a700 1 --2- 172.21.15.84:0/3929971888 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7060071170 0x7f70601e40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:09.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.872+0000 7f706619c700 1 --2- 172.21.15.84:0/3929971888 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f706015d9d0 0x7f70601e45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:09.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.872+0000 7f706599b700 1 -- 172.21.15.84:0/3929971888 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7060071170 msgr2=0x7f70601e40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:09.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.872+0000 7f706599b700 1 --2- 172.21.15.84:0/3929971888 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7060071170 0x7f70601e40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:09.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.872+0000 7f706599b700 1 -- 172.21.15.84:0/3929971888 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f706015d9d0 msgr2=0x7f70601e45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:09.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.872+0000 7f706599b700 1 --2- 172.21.15.84:0/3929971888 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f706015d9d0 0x7f70601e45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:09.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.872+0000 7f706599b700 1 -- 172.21.15.84:0/3929971888 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f705c0094a0 con 0x7f706006c9f0 2023-07-14T11:13:09.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.872+0000 7f706619c700 1 --2- 172.21.15.84:0/3929971888 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f706015d9d0 0x7f70601e45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:13:09.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.872+0000 7f706519a700 1 --2- 172.21.15.84:0/3929971888 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7060071170 0x7f70601e40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:13:09.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.872+0000 7f706599b700 1 --2- 172.21.15.84:0/3929971888 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f706006c9f0 0x7f70601e59f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f705c014040 tx=0x7f705c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:09.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.872+0000 7f70567fc700 1 -- 172.21.15.84:0/3929971888 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f705c0038a0 con 0x7f706006c9f0 2023-07-14T11:13:09.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.872+0000 7f70567fc700 1 -- 172.21.15.84:0/3929971888 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f705c01e070 con 0x7f706006c9f0 2023-07-14T11:13:09.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.872+0000 7f70567fc700 1 -- 172.21.15.84:0/3929971888 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f705c003c20 con 0x7f706006c9f0 2023-07-14T11:13:09.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.872+0000 7f7067bff700 1 -- 172.21.15.84:0/3929971888 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70601e5410 con 0x7f706006c9f0 2023-07-14T11:13:09.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.872+0000 7f7067bff700 1 -- 172.21.15.84:0/3929971888 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70601e4b20 con 0x7f706006c9f0 2023-07-14T11:13:09.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.873+0000 7f7067bff700 1 -- 172.21.15.84:0/3929971888 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7060074350 con 0x7f706006c9f0 2023-07-14T11:13:09.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.874+0000 7f70567fc700 1 -- 172.21.15.84:0/3929971888 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f705c02d450 con 0x7f706006c9f0 2023-07-14T11:13:09.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.875+0000 7f70567fc700 1 --2- 172.21.15.84:0/3929971888 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f704406ace0 0x7f704406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:09.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.875+0000 7f70567fc700 1 -- 172.21.15.84:0/3929971888 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f705c08a2f0 con 0x7f706006c9f0 2023-07-14T11:13:09.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.875+0000 7f706519a700 1 --2- 172.21.15.84:0/3929971888 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f704406ace0 0x7f704406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:09.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.876+0000 7f706519a700 1 --2- 172.21.15.84:0/3929971888 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f704406ace0 0x7f704406d190 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f706014d780 tx=0x7f7050009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:09.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:09.879+0000 7f70567fc700 1 -- 172.21.15.84:0/3929971888 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f705c055650 con 0x7f706006c9f0 2023-07-14T11:13:10.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.079+0000 7f7067bff700 1 -- 172.21.15.84:0/3929971888 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f70600ce680 con 0x7f706006c9f0 2023-07-14T11:13:10.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.080+0000 7f70567fc700 1 -- 172.21.15.84:0/3929971888 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7f705c02c3b0 con 0x7f706006c9f0 2023-07-14T11:13:10.082 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-07-14T11:13:10.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.082+0000 7f7067bff700 1 -- 172.21.15.84:0/3929971888 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f704406ace0 msgr2=0x7f704406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:10.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.082+0000 7f7067bff700 1 --2- 172.21.15.84:0/3929971888 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f704406ace0 0x7f704406d190 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f706014d780 tx=0x7f7050009040 comp rx=0 tx=0).stop 2023-07-14T11:13:10.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.082+0000 7f7067bff700 1 -- 172.21.15.84:0/3929971888 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f706006c9f0 msgr2=0x7f70601e59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:10.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.082+0000 7f7067bff700 1 --2- 172.21.15.84:0/3929971888 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f706006c9f0 0x7f70601e59f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f705c014040 tx=0x7f705c004750 comp rx=0 tx=0).stop 2023-07-14T11:13:10.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.082+0000 7f7067bff700 1 -- 172.21.15.84:0/3929971888 shutdown_connections 2023-07-14T11:13:10.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.082+0000 7f7067bff700 1 --2- 172.21.15.84:0/3929971888 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f706015d9d0 0x7f70601e45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:10.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.082+0000 7f7067bff700 1 --2- 172.21.15.84:0/3929971888 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f706006c9f0 0x7f70601e59f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:10.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.082+0000 7f7067bff700 1 --2- 172.21.15.84:0/3929971888 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f704406ace0 0x7f704406d190 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:10.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.082+0000 7f7067bff700 1 --2- 172.21.15.84:0/3929971888 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7060071170 0x7f70601e40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:10.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.082+0000 7f7067bff700 1 -- 172.21.15.84:0/3929971888 >> 172.21.15.84:0/3929971888 conn(0x7f70600b05d0 msgr2=0x7f70600c9fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:10.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.083+0000 7f7067bff700 1 -- 172.21.15.84:0/3929971888 shutdown_connections 2023-07-14T11:13:10.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.083+0000 7f7067bff700 1 -- 172.21.15.84:0/3929971888 wait complete. 2023-07-14T11:13:10.102 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T11:13:10.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.296+0000 7f9367dff700 1 Processor -- start 2023-07-14T11:13:10.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.296+0000 7f9367dff700 1 -- start start 2023-07-14T11:13:10.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.297+0000 7f9367dff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f93600d1220 0x7f93600b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:10.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.297+0000 7f9367dff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f93600b1e00 0x7f93600afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:10.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.297+0000 7f9367dff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93600d2ce0 con 0x7f936015c950 2023-07-14T11:13:10.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.297+0000 7f9367dff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93600b3350 con 0x7f93600d1220 2023-07-14T11:13:10.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.297+0000 7f9367dff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93600b3630 con 0x7f93600b1e00 2023-07-14T11:13:10.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.298+0000 7f936539a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f93600d1220 0x7f93600b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:10.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.298+0000 7f936539a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f93600d1220 0x7f93600b43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44112/0 (socket says 172.21.15.84:44112) 2023-07-14T11:13:10.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.298+0000 7f936539a700 1 -- 172.21.15.84:0/280333922 learned_addr learned my addr 172.21.15.84:0/280333922 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:10.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.298+0000 7f936639c700 1 --2- 172.21.15.84:0/280333922 >> v2:172.21.15.179:3300/0 conn(0x7f93600b1e00 0x7f93600afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:10.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.298+0000 7f936539a700 1 -- 172.21.15.84:0/280333922 >> v2:172.21.15.179:3300/0 conn(0x7f93600b1e00 msgr2=0x7f93600afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:10.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.298+0000 7f936539a700 1 --2- 172.21.15.84:0/280333922 >> v2:172.21.15.179:3300/0 conn(0x7f93600b1e00 0x7f93600afac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:10.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.298+0000 7f936539a700 1 -- 172.21.15.84:0/280333922 >> v1:172.21.15.179:6789/0 conn(0x7f936015c950 legacy=0x7f93600d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:10.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.298+0000 7f936539a700 1 -- 172.21.15.84:0/280333922 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93600b3910 con 0x7f93600d1220 2023-07-14T11:13:10.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.298+0000 7f936639c700 1 --2- 172.21.15.84:0/280333922 >> v2:172.21.15.179:3300/0 conn(0x7f93600b1e00 0x7f93600afac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:13:10.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.298+0000 7f936539a700 1 --2- 172.21.15.84:0/280333922 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93600d1220 0x7f93600b43f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f936008c300 tx=0x7f9350009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dff1f5b18caf150 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:10.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.298+0000 7f9364b99700 1 -- 172.21.15.84:0/280333922 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9350004230 con 0x7f93600d1220 2023-07-14T11:13:10.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.299+0000 7f9364b99700 1 -- 172.21.15.84:0/280333922 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9350004390 con 0x7f93600d1220 2023-07-14T11:13:10.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.299+0000 7f9364b99700 1 -- 172.21.15.84:0/280333922 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93500036a0 con 0x7f93600d1220 2023-07-14T11:13:10.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.299+0000 7f9367dff700 1 -- 172.21.15.84:0/280333922 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93600d1220 msgr2=0x7f93600b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:10.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.299+0000 7f9367dff700 1 --2- 172.21.15.84:0/280333922 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93600d1220 0x7f93600b43f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f936008c300 tx=0x7f9350009bd0 comp rx=0 tx=0).stop 2023-07-14T11:13:10.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.299+0000 7f9367dff700 1 -- 172.21.15.84:0/280333922 shutdown_connections 2023-07-14T11:13:10.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.299+0000 7f9367dff700 1 --2- 172.21.15.84:0/280333922 >> v2:172.21.15.179:3300/0 conn(0x7f93600b1e00 0x7f93600afac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:10.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.299+0000 7f9367dff700 1 --2- 172.21.15.84:0/280333922 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93600d1220 0x7f93600b43f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:10.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.299+0000 7f9367dff700 1 -- 172.21.15.84:0/280333922 >> 172.21.15.84:0/280333922 conn(0x7f936009c1d0 msgr2=0x7f93600d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:10.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.299+0000 7f9367dff700 1 -- 172.21.15.84:0/280333922 shutdown_connections 2023-07-14T11:13:10.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.299+0000 7f9367dff700 1 -- 172.21.15.84:0/280333922 wait complete. 2023-07-14T11:13:10.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.301+0000 7f9367dff700 1 Processor -- start 2023-07-14T11:13:10.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.301+0000 7f9367dff700 1 -- start start 2023-07-14T11:13:10.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.302+0000 7f9367dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93600b1e00 0x7f9360152a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:10.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.302+0000 7f9367dff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93600d1220 0x7f93600b5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:10.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.302+0000 7f9367dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f936015c950 0x7f936006ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:10.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.302+0000 7f9367dff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93600cafb0 con 0x7f93600d1220 2023-07-14T11:13:10.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.302+0000 7f9367dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93600b6830 con 0x7f93600b1e00 2023-07-14T11:13:10.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.302+0000 7f9367dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93600b6b10 con 0x7f936015c950 2023-07-14T11:13:10.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.302+0000 7f936539a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93600d1220 0x7f93600b5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:10.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.302+0000 7f936539a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93600d1220 0x7f93600b5d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44126/0 (socket says 172.21.15.84:44126) 2023-07-14T11:13:10.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.302+0000 7f936539a700 1 -- 172.21.15.84:0/3601288646 learned_addr learned my addr 172.21.15.84:0/3601288646 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:10.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.302+0000 7f936639c700 1 --2- 172.21.15.84:0/3601288646 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f936015c950 0x7f936006ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:10.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.302+0000 7f9365b9b700 1 --2- 172.21.15.84:0/3601288646 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93600b1e00 0x7f9360152a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:10.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.303+0000 7f936539a700 1 -- 172.21.15.84:0/3601288646 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f936015c950 msgr2=0x7f936006ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:10.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.303+0000 7f936539a700 1 --2- 172.21.15.84:0/3601288646 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f936015c950 0x7f936006ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:10.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.303+0000 7f936539a700 1 -- 172.21.15.84:0/3601288646 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93600b1e00 msgr2=0x7f9360152a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:10.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.303+0000 7f936539a700 1 --2- 172.21.15.84:0/3601288646 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93600b1e00 0x7f9360152a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:10.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.303+0000 7f936539a700 1 -- 172.21.15.84:0/3601288646 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9350009550 con 0x7f93600d1220 2023-07-14T11:13:10.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.303+0000 7f936539a700 1 --2- 172.21.15.84:0/3601288646 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93600d1220 0x7f93600b5d70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9350009130 tx=0x7f9350004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:10.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.303+0000 7f93567fc700 1 -- 172.21.15.84:0/3601288646 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9350003dc0 con 0x7f93600d1220 2023-07-14T11:13:10.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.303+0000 7f93567fc700 1 -- 172.21.15.84:0/3601288646 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f935001f070 con 0x7f93600d1220 2023-07-14T11:13:10.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.303+0000 7f9367dff700 1 -- 172.21.15.84:0/3601288646 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93600b6df0 con 0x7f93600d1220 2023-07-14T11:13:10.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.303+0000 7f93567fc700 1 -- 172.21.15.84:0/3601288646 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9350011850 con 0x7f93600d1220 2023-07-14T11:13:10.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.303+0000 7f9367dff700 1 -- 172.21.15.84:0/3601288646 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93600cffc0 con 0x7f93600d1220 2023-07-14T11:13:10.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.304+0000 7f9367dff700 1 -- 172.21.15.84:0/3601288646 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f936004e280 con 0x7f93600d1220 2023-07-14T11:13:10.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.305+0000 7f93567fc700 1 -- 172.21.15.84:0/3601288646 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9350021030 con 0x7f93600d1220 2023-07-14T11:13:10.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.307+0000 7f93567fc700 1 --2- 172.21.15.84:0/3601288646 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f934406ace0 0x7f934406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:10.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.307+0000 7f93567fc700 1 -- 172.21.15.84:0/3601288646 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f935008a840 con 0x7f93600d1220 2023-07-14T11:13:10.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.307+0000 7f9365b9b700 1 --2- 172.21.15.84:0/3601288646 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f934406ace0 0x7f934406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:10.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.307+0000 7f9365b9b700 1 --2- 172.21.15.84:0/3601288646 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f934406ace0 0x7f934406d190 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f935c006fd0 tx=0x7f935c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:10.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.311+0000 7f93567fc700 1 -- 172.21.15.84:0/3601288646 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f9350055c30 con 0x7f93600d1220 2023-07-14T11:13:10.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.545+0000 7f9367dff700 1 -- 172.21.15.84:0/3601288646 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f93600cd000 con 0x7f93600d1220 2023-07-14T11:13:10.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.546+0000 7f93567fc700 1 -- 172.21.15.84:0/3601288646 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3524 (secure 0 0 0) 0x7f9350029de0 con 0x7f93600d1220 2023-07-14T11:13:10.548 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:13:10.549 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4296,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/811241790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":811241790},{"type":"v1","addr":"172.21.15.84:6836","nonce":811241790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4299,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/729998896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":729998896},{"type":"v1","addr":"172.21.15.84:6837","nonce":729998896}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4305,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3512017231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3512017231},{"type":"v1","addr":"172.21.15.179:6834","nonce":3512017231}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4308,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3903854892","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":3903854892},{"type":"v1","addr":"172.21.15.179:6835","nonce":3903854892}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-07-14T11:13:10.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.548+0000 7f9367dff700 1 -- 172.21.15.84:0/3601288646 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f934406ace0 msgr2=0x7f934406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:10.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.548+0000 7f9367dff700 1 --2- 172.21.15.84:0/3601288646 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f934406ace0 0x7f934406d190 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f935c006fd0 tx=0x7f935c008040 comp rx=0 tx=0).stop 2023-07-14T11:13:10.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.548+0000 7f9367dff700 1 -- 172.21.15.84:0/3601288646 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93600d1220 msgr2=0x7f93600b5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:10.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.548+0000 7f9367dff700 1 --2- 172.21.15.84:0/3601288646 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93600d1220 0x7f93600b5d70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9350009130 tx=0x7f9350004750 comp rx=0 tx=0).stop 2023-07-14T11:13:10.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.548+0000 7f9367dff700 1 -- 172.21.15.84:0/3601288646 shutdown_connections 2023-07-14T11:13:10.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.548+0000 7f9367dff700 1 --2- 172.21.15.84:0/3601288646 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f934406ace0 0x7f934406d190 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:10.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.548+0000 7f9367dff700 1 --2- 172.21.15.84:0/3601288646 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f936015c950 0x7f936006ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:10.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.548+0000 7f9367dff700 1 --2- 172.21.15.84:0/3601288646 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93600b1e00 0x7f9360152a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:10.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.548+0000 7f9367dff700 1 --2- 172.21.15.84:0/3601288646 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93600d1220 0x7f93600b5d70 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:10.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.548+0000 7f9367dff700 1 -- 172.21.15.84:0/3601288646 >> 172.21.15.84:0/3601288646 conn(0x7f936009c1d0 msgr2=0x7f9360158670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:10.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.548+0000 7f9367dff700 1 -- 172.21.15.84:0/3601288646 shutdown_connections 2023-07-14T11:13:10.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.548+0000 7f9367dff700 1 -- 172.21.15.84:0/3601288646 wait complete. 2023-07-14T11:13:10.552 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 3 2023-07-14T11:13:10.568 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:13:10.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.760+0000 7f5db75ff700 1 Processor -- start 2023-07-14T11:13:10.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.760+0000 7f5db75ff700 1 -- start start 2023-07-14T11:13:10.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.761+0000 7f5db75ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5db00d1220 0x7f5db00b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:10.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.761+0000 7f5db75ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5db00d2ce0 con 0x7f5db015c950 2023-07-14T11:13:10.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.762+0000 7f5db75ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5db00b3350 con 0x7f5db00b1e00 2023-07-14T11:13:10.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.762+0000 7f5db75ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5db00b3630 con 0x7f5db00d1220 2023-07-14T11:13:10.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.762+0000 7f5db539b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f5db015c950 0x7f5db00d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:43170/0 (socket says 172.21.15.84:43170) 2023-07-14T11:13:10.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.762+0000 7f5db539b700 1 -- 172.21.15.84:0/24299074 learned_addr learned my addr 172.21.15.84:0/24299074 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:13:10.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.762+0000 7f5db4b9a700 1 --2- 172.21.15.84:0/24299074 >> v2:172.21.15.179:3300/0 conn(0x7f5db00d1220 0x7f5db00b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:10.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.762+0000 7f5da7fff700 1 -- 172.21.15.84:0/24299074 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2675702777 0 0) 0x7f5db00d2ce0 con 0x7f5db015c950 2023-07-14T11:13:10.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.762+0000 7f5da7fff700 1 -- 172.21.15.84:0/24299074 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d9c0035b0 con 0x7f5db015c950 2023-07-14T11:13:10.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.762+0000 7f5db4b9a700 1 -- 172.21.15.84:0/24299074 >> v1:172.21.15.179:6789/0 conn(0x7f5db00b1e00 legacy=0x7f5db00afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:10.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.762+0000 7f5db4b9a700 1 -- 172.21.15.84:0/24299074 >> v1:172.21.15.84:6789/0 conn(0x7f5db015c950 legacy=0x7f5db00d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:10.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.762+0000 7f5db4b9a700 1 -- 172.21.15.84:0/24299074 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5db00b3910 con 0x7f5db00d1220 2023-07-14T11:13:10.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.763+0000 7f5db4b9a700 1 --2- 172.21.15.84:0/24299074 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5db00d1220 0x7f5db00b43f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5da0009840 tx=0x7f5da0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf51b40a1cc23bf9 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:10.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.764+0000 7f5da7fff700 1 -- 172.21.15.84:0/24299074 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da0011830 con 0x7f5db00d1220 2023-07-14T11:13:10.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.764+0000 7f5da7fff700 1 -- 172.21.15.84:0/24299074 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5da0011990 con 0x7f5db00d1220 2023-07-14T11:13:10.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.764+0000 7f5da7fff700 1 -- 172.21.15.84:0/24299074 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da0011d20 con 0x7f5db00d1220 2023-07-14T11:13:10.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.764+0000 7f5db75ff700 1 -- 172.21.15.84:0/24299074 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5db00d1220 msgr2=0x7f5db00b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:10.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.764+0000 7f5db75ff700 1 --2- 172.21.15.84:0/24299074 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5db00d1220 0x7f5db00b43f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5da0009840 tx=0x7f5da0009b50 comp rx=0 tx=0).stop 2023-07-14T11:13:10.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.764+0000 7f5db75ff700 1 -- 172.21.15.84:0/24299074 shutdown_connections 2023-07-14T11:13:10.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.764+0000 7f5db75ff700 1 --2- 172.21.15.84:0/24299074 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5db00d1220 0x7f5db00b43f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:10.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.764+0000 7f5db75ff700 1 -- 172.21.15.84:0/24299074 >> 172.21.15.84:0/24299074 conn(0x7f5db009c1d0 msgr2=0x7f5db00d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:10.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.764+0000 7f5db75ff700 1 -- 172.21.15.84:0/24299074 shutdown_connections 2023-07-14T11:13:10.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.764+0000 7f5db75ff700 1 -- 172.21.15.84:0/24299074 wait complete. 2023-07-14T11:13:10.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.766+0000 7f5db75ff700 1 Processor -- start 2023-07-14T11:13:10.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.766+0000 7f5db75ff700 1 -- start start 2023-07-14T11:13:10.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.767+0000 7f5db75ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5db00b1e00 0x7f5db00c9240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:10.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.767+0000 7f5db75ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5db00d1220 0x7f5db00cfe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:10.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.767+0000 7f5db75ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5db015c950 0x7f5db006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:10.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.767+0000 7f5db75ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5db014fce0 con 0x7f5db015c950 2023-07-14T11:13:10.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.767+0000 7f5db75ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5db00c9780 con 0x7f5db00b1e00 2023-07-14T11:13:10.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.767+0000 7f5db75ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5db00d0360 con 0x7f5db00d1220 2023-07-14T11:13:10.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.767+0000 7f5db5b9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5db015c950 0x7f5db006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:10.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.767+0000 7f5db5b9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5db015c950 0x7f5db006b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44140/0 (socket says 172.21.15.84:44140) 2023-07-14T11:13:10.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.767+0000 7f5db5b9c700 1 -- 172.21.15.84:0/1210435139 learned_addr learned my addr 172.21.15.84:0/1210435139 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:10.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.767+0000 7f5db4b9a700 1 --2- 172.21.15.84:0/1210435139 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5db00d1220 0x7f5db00cfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:10.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.767+0000 7f5db539b700 1 --2- 172.21.15.84:0/1210435139 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5db00b1e00 0x7f5db00c9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:10.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.768+0000 7f5db5b9c700 1 -- 172.21.15.84:0/1210435139 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5db00d1220 msgr2=0x7f5db00cfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:10.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.768+0000 7f5db5b9c700 1 --2- 172.21.15.84:0/1210435139 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5db00d1220 0x7f5db00cfe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:10.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.768+0000 7f5db5b9c700 1 -- 172.21.15.84:0/1210435139 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5db00b1e00 msgr2=0x7f5db00c9240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:10.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.768+0000 7f5db5b9c700 1 --2- 172.21.15.84:0/1210435139 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5db00b1e00 0x7f5db00c9240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:10.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.768+0000 7f5db5b9c700 1 -- 172.21.15.84:0/1210435139 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5da00094a0 con 0x7f5db015c950 2023-07-14T11:13:10.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.768+0000 7f5db5b9c700 1 --2- 172.21.15.84:0/1210435139 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5db015c950 0x7f5db006b750 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5da800cc50 tx=0x7f5da800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:10.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.768+0000 7f5da5ffb700 1 -- 172.21.15.84:0/1210435139 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da8003c00 con 0x7f5db015c950 2023-07-14T11:13:10.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.768+0000 7f5da5ffb700 1 -- 172.21.15.84:0/1210435139 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5da8003d60 con 0x7f5db015c950 2023-07-14T11:13:10.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.768+0000 7f5da5ffb700 1 -- 172.21.15.84:0/1210435139 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da800aab0 con 0x7f5db015c950 2023-07-14T11:13:10.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.768+0000 7f5db75ff700 1 -- 172.21.15.84:0/1210435139 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5db00c6c10 con 0x7f5db015c950 2023-07-14T11:13:10.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.768+0000 7f5db75ff700 1 -- 172.21.15.84:0/1210435139 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5db00b5e10 con 0x7f5db015c950 2023-07-14T11:13:10.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.769+0000 7f5db75ff700 1 -- 172.21.15.84:0/1210435139 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5db006a3e0 con 0x7f5db015c950 2023-07-14T11:13:10.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.770+0000 7f5da5ffb700 1 -- 172.21.15.84:0/1210435139 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5da800ac10 con 0x7f5db015c950 2023-07-14T11:13:10.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.771+0000 7f5da5ffb700 1 --2- 172.21.15.84:0/1210435139 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f5d9406ace0 0x7f5d9406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:10.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.771+0000 7f5da5ffb700 1 -- 172.21.15.84:0/1210435139 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f5da8089160 con 0x7f5db015c950 2023-07-14T11:13:10.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.771+0000 7f5db539b700 1 --2- 172.21.15.84:0/1210435139 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f5d9406ace0 0x7f5d9406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:10.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.772+0000 7f5db539b700 1 --2- 172.21.15.84:0/1210435139 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f5d9406ace0 0x7f5d9406d190 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5dac0010e0 tx=0x7f5dac007c70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:10.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.775+0000 7f5da5ffb700 1 -- 172.21.15.84:0/1210435139 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f5da80544c0 con 0x7f5db015c950 2023-07-14T11:13:10.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.973+0000 7f5db75ff700 1 -- 172.21.15.84:0/1210435139 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5db004e280 con 0x7f5db015c950 2023-07-14T11:13:10.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.974+0000 7f5da5ffb700 1 -- 172.21.15.84:0/1210435139 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+14612 (secure 0 0 0) 0x7f5da8057ae0 con 0x7f5db015c950 2023-07-14T11:13:10.977 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:13:10.977 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":19,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:13:09.751745+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:13:10.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.976+0000 7f5db75ff700 1 -- 172.21.15.84:0/1210435139 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f5d9406ace0 msgr2=0x7f5d9406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:10.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.976+0000 7f5db75ff700 1 --2- 172.21.15.84:0/1210435139 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f5d9406ace0 0x7f5d9406d190 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5dac0010e0 tx=0x7f5dac007c70 comp rx=0 tx=0).stop 2023-07-14T11:13:10.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.976+0000 7f5db75ff700 1 -- 172.21.15.84:0/1210435139 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5db015c950 msgr2=0x7f5db006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:10.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.976+0000 7f5db75ff700 1 --2- 172.21.15.84:0/1210435139 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5db015c950 0x7f5db006b750 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5da800cc50 tx=0x7f5da800cf60 comp rx=0 tx=0).stop 2023-07-14T11:13:10.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.977+0000 7f5db75ff700 1 -- 172.21.15.84:0/1210435139 shutdown_connections 2023-07-14T11:13:10.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.977+0000 7f5db75ff700 1 --2- 172.21.15.84:0/1210435139 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5db015c950 0x7f5db006b750 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:10.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.977+0000 7f5db75ff700 1 --2- 172.21.15.84:0/1210435139 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5db00b1e00 0x7f5db00c9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:10.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.977+0000 7f5db75ff700 1 --2- 172.21.15.84:0/1210435139 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f5d9406ace0 0x7f5d9406d190 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:10.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.977+0000 7f5db75ff700 1 --2- 172.21.15.84:0/1210435139 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5db00d1220 0x7f5db00cfe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:10.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.977+0000 7f5db75ff700 1 -- 172.21.15.84:0/1210435139 >> 172.21.15.84:0/1210435139 conn(0x7f5db009c1d0 msgr2=0x7f5db00b5280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:10.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.977+0000 7f5db75ff700 1 -- 172.21.15.84:0/1210435139 shutdown_connections 2023-07-14T11:13:10.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:10.977+0000 7f5db75ff700 1 -- 172.21.15.84:0/1210435139 wait complete. 2023-07-14T11:13:10.996 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T11:13:00.125395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T11:13:06.803994+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T11:13:10.997 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T11:13:11.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.193+0000 7f52215ff700 1 Processor -- start 2023-07-14T11:13:11.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.194+0000 7f52215ff700 1 -- start start 2023-07-14T11:13:11.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.195+0000 7f52215ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f521c0b8a60 0x7f521c0b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:11.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.195+0000 7f52215ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f521c0d1220 0x7f521c0b0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:11.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.195+0000 7f52215ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f521c0b8e30 con 0x7f521c0b4530 2023-07-14T11:13:11.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.195+0000 7f52215ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f521c0afaa0 con 0x7f521c0d1220 2023-07-14T11:13:11.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.195+0000 7f52215ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f521c0afd80 con 0x7f521c0b8a60 2023-07-14T11:13:11.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.195+0000 7f5213fff700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f521c0b4530 0x7f521c0d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.84:42942/0 (socket says 172.21.15.84:42942) 2023-07-14T11:13:11.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.195+0000 7f5213fff700 1 -- 172.21.15.84:0/3110061461 learned_addr learned my addr 172.21.15.84:0/3110061461 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:13:11.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.196+0000 7f521affd700 1 --2- 172.21.15.84:0/3110061461 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f521c0b8a60 0x7f521c0b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:11.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.196+0000 7f521b7fe700 1 --2- 172.21.15.84:0/3110061461 >> v2:172.21.15.179:3300/0 conn(0x7f521c0d1220 0x7f521c0b0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:11.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.196+0000 7f521a7fc700 1 -- 172.21.15.84:0/3110061461 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4294919912 0 0) 0x7f521c0b8e30 con 0x7f521c0b4530 2023-07-14T11:13:11.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.196+0000 7f521a7fc700 1 -- 172.21.15.84:0/3110061461 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52080035b0 con 0x7f521c0b4530 2023-07-14T11:13:11.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.196+0000 7f521affd700 1 -- 172.21.15.84:0/3110061461 >> v2:172.21.15.179:3300/0 conn(0x7f521c0d1220 msgr2=0x7f521c0b0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:11.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.196+0000 7f521affd700 1 --2- 172.21.15.84:0/3110061461 >> v2:172.21.15.179:3300/0 conn(0x7f521c0d1220 0x7f521c0b0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:11.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.196+0000 7f521affd700 1 -- 172.21.15.84:0/3110061461 >> v1:172.21.15.179:6789/0 conn(0x7f521c0b4530 legacy=0x7f521c0d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:11.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.196+0000 7f521affd700 1 -- 172.21.15.84:0/3110061461 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f521c0b0060 con 0x7f521c0b8a60 2023-07-14T11:13:11.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.196+0000 7f521affd700 1 --2- 172.21.15.84:0/3110061461 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f521c0b8a60 0x7f521c0b3ff0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f520c009840 tx=0x7f520c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21358dbe810419ee server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:11.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.197+0000 7f521a7fc700 1 -- 172.21.15.84:0/3110061461 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f520c011830 con 0x7f521c0b8a60 2023-07-14T11:13:11.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.197+0000 7f521a7fc700 1 -- 172.21.15.84:0/3110061461 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f520c011990 con 0x7f521c0b8a60 2023-07-14T11:13:11.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.197+0000 7f521a7fc700 1 -- 172.21.15.84:0/3110061461 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f520c011d20 con 0x7f521c0b8a60 2023-07-14T11:13:11.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.197+0000 7f52215ff700 1 -- 172.21.15.84:0/3110061461 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f521c0b8a60 msgr2=0x7f521c0b3ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:11.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.197+0000 7f52215ff700 1 --2- 172.21.15.84:0/3110061461 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f521c0b8a60 0x7f521c0b3ff0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f520c009840 tx=0x7f520c009b50 comp rx=0 tx=0).stop 2023-07-14T11:13:11.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.197+0000 7f52215ff700 1 -- 172.21.15.84:0/3110061461 shutdown_connections 2023-07-14T11:13:11.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.197+0000 7f52215ff700 1 --2- 172.21.15.84:0/3110061461 >> v2:172.21.15.179:3300/0 conn(0x7f521c0d1220 0x7f521c0b0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:11.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.197+0000 7f52215ff700 1 --2- 172.21.15.84:0/3110061461 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f521c0b8a60 0x7f521c0b3ff0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:11.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.197+0000 7f52215ff700 1 -- 172.21.15.84:0/3110061461 >> 172.21.15.84:0/3110061461 conn(0x7f521c09c1b0 msgr2=0x7f521c0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:11.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.197+0000 7f52215ff700 1 -- 172.21.15.84:0/3110061461 shutdown_connections 2023-07-14T11:13:11.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.197+0000 7f52215ff700 1 -- 172.21.15.84:0/3110061461 wait complete. 2023-07-14T11:13:11.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.199+0000 7f52215ff700 1 Processor -- start 2023-07-14T11:13:11.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.199+0000 7f52215ff700 1 -- start start 2023-07-14T11:13:11.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.200+0000 7f52215ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f521c0b4530 0x7f521c152360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:11.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.200+0000 7f52215ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f521c0b8a60 0x7f521c0cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:11.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.200+0000 7f52215ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f521c0d1220 0x7f521c1f33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:11.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.200+0000 7f52215ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f521c0ce090 con 0x7f521c0b4530 2023-07-14T11:13:11.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.200+0000 7f52215ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f521c0cd6f0 con 0x7f521c0b8a60 2023-07-14T11:13:11.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.200+0000 7f52215ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f521c0cd9d0 con 0x7f521c0d1220 2023-07-14T11:13:11.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.200+0000 7f521affd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f521c0b4530 0x7f521c152360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:11.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.200+0000 7f521affd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f521c0b4530 0x7f521c152360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44152/0 (socket says 172.21.15.84:44152) 2023-07-14T11:13:11.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.200+0000 7f521affd700 1 -- 172.21.15.84:0/2615628430 learned_addr learned my addr 172.21.15.84:0/2615628430 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:11.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.201+0000 7f5213fff700 1 --2- 172.21.15.84:0/2615628430 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f521c0b8a60 0x7f521c0cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:11.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.201+0000 7f521b7fe700 1 --2- 172.21.15.84:0/2615628430 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f521c0d1220 0x7f521c1f33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:11.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.201+0000 7f521affd700 1 -- 172.21.15.84:0/2615628430 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f521c0d1220 msgr2=0x7f521c1f33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:11.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.201+0000 7f521affd700 1 --2- 172.21.15.84:0/2615628430 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f521c0d1220 0x7f521c1f33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:11.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.201+0000 7f521affd700 1 -- 172.21.15.84:0/2615628430 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f521c0b8a60 msgr2=0x7f521c0cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:11.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.201+0000 7f521affd700 1 --2- 172.21.15.84:0/2615628430 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f521c0b8a60 0x7f521c0cbc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:11.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.201+0000 7f521affd700 1 -- 172.21.15.84:0/2615628430 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f520c0094a0 con 0x7f521c0b4530 2023-07-14T11:13:11.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.201+0000 7f5213fff700 1 --2- 172.21.15.84:0/2615628430 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f521c0b8a60 0x7f521c0cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:13:11.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.201+0000 7f521affd700 1 --2- 172.21.15.84:0/2615628430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f521c0b4530 0x7f521c152360 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f520c0090b0 tx=0x7f520c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:11.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.201+0000 7f52137fe700 1 -- 172.21.15.84:0/2615628430 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f520c0036a0 con 0x7f521c0b4530 2023-07-14T11:13:11.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.201+0000 7f52137fe700 1 -- 172.21.15.84:0/2615628430 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f520c01f070 con 0x7f521c0b4530 2023-07-14T11:13:11.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.201+0000 7f52137fe700 1 -- 172.21.15.84:0/2615628430 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f520c003a00 con 0x7f521c0b4530 2023-07-14T11:13:11.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.201+0000 7f52215ff700 1 -- 172.21.15.84:0/2615628430 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f521c0cdcb0 con 0x7f521c0b4530 2023-07-14T11:13:11.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.201+0000 7f52215ff700 1 -- 172.21.15.84:0/2615628430 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f521c0cc1b0 con 0x7f521c0b4530 2023-07-14T11:13:11.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.202+0000 7f52215ff700 1 -- 172.21.15.84:0/2615628430 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f521c0ce1d0 con 0x7f521c0b4530 2023-07-14T11:13:11.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.203+0000 7f52137fe700 1 -- 172.21.15.84:0/2615628430 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f520c003b60 con 0x7f521c0b4530 2023-07-14T11:13:11.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.204+0000 7f52137fe700 1 --2- 172.21.15.84:0/2615628430 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f51fc06ace0 0x7f51fc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:11.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.204+0000 7f52137fe700 1 -- 172.21.15.84:0/2615628430 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f520c021070 con 0x7f521c0b4530 2023-07-14T11:13:11.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.204+0000 7f5213fff700 1 --2- 172.21.15.84:0/2615628430 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f51fc06ace0 0x7f51fc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:11.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.205+0000 7f5213fff700 1 --2- 172.21.15.84:0/2615628430 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f51fc06ace0 0x7f51fc06d190 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f521c15baa0 tx=0x7f5204009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:11.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.208+0000 7f52137fe700 1 -- 172.21.15.84:0/2615628430 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f520c055ea0 con 0x7f521c0b4530 2023-07-14T11:13:11.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.399+0000 7f52215ff700 1 -- 172.21.15.84:0/2615628430 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f521c074350 con 0x7f521c0b4530 2023-07-14T11:13:11.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.399+0000 7f52137fe700 1 -- 172.21.15.84:0/2615628430 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7f520c0594c0 con 0x7f521c0b4530 2023-07-14T11:13:11.402 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-07-14T11:13:11.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.402+0000 7f52215ff700 1 -- 172.21.15.84:0/2615628430 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f51fc06ace0 msgr2=0x7f51fc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:11.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.402+0000 7f52215ff700 1 --2- 172.21.15.84:0/2615628430 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f51fc06ace0 0x7f51fc06d190 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f521c15baa0 tx=0x7f5204009040 comp rx=0 tx=0).stop 2023-07-14T11:13:11.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.402+0000 7f52215ff700 1 -- 172.21.15.84:0/2615628430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f521c0b4530 msgr2=0x7f521c152360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:11.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.402+0000 7f52215ff700 1 --2- 172.21.15.84:0/2615628430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f521c0b4530 0x7f521c152360 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f520c0090b0 tx=0x7f520c004750 comp rx=0 tx=0).stop 2023-07-14T11:13:11.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.402+0000 7f52215ff700 1 -- 172.21.15.84:0/2615628430 shutdown_connections 2023-07-14T11:13:11.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.402+0000 7f52215ff700 1 --2- 172.21.15.84:0/2615628430 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f51fc06ace0 0x7f51fc06d190 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:11.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.402+0000 7f52215ff700 1 --2- 172.21.15.84:0/2615628430 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f521c0d1220 0x7f521c1f33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:11.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.402+0000 7f52215ff700 1 --2- 172.21.15.84:0/2615628430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f521c0b4530 0x7f521c152360 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:11.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.402+0000 7f52215ff700 1 --2- 172.21.15.84:0/2615628430 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f521c0b8a60 0x7f521c0cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:11.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.402+0000 7f52215ff700 1 -- 172.21.15.84:0/2615628430 >> 172.21.15.84:0/2615628430 conn(0x7f521c09c1b0 msgr2=0x7f521c0d0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:11.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.402+0000 7f52215ff700 1 -- 172.21.15.84:0/2615628430 shutdown_connections 2023-07-14T11:13:11.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.402+0000 7f52215ff700 1 -- 172.21.15.84:0/2615628430 wait complete. 2023-07-14T11:13:11.421 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T11:13:11.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.616+0000 7f10865ff700 1 Processor -- start 2023-07-14T11:13:11.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.616+0000 7f10865ff700 1 -- start start 2023-07-14T11:13:11.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.618+0000 7f10865ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f10800b8a60 0x7f10800b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:11.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.618+0000 7f10865ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10800d1220 0x7f10800b0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:11.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.618+0000 7f10865ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10800b8e30 con 0x7f10800b4530 2023-07-14T11:13:11.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.618+0000 7f10865ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10800afaa0 con 0x7f10800b8a60 2023-07-14T11:13:11.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.618+0000 7f10865ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10800afd80 con 0x7f10800d1220 2023-07-14T11:13:11.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.618+0000 7f107ffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f10800b8a60 0x7f10800b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:11.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.618+0000 7f107ffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f10800b8a60 0x7f10800b3ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44162/0 (socket says 172.21.15.84:44162) 2023-07-14T11:13:11.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.618+0000 7f107ffff700 1 -- 172.21.15.84:0/1536456235 learned_addr learned my addr 172.21.15.84:0/1536456235 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:11.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.618+0000 7f107ffff700 1 -- 172.21.15.84:0/1536456235 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10800d1220 msgr2=0x7f10800b0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:11.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.619+0000 7f107ffff700 1 --2- 172.21.15.84:0/1536456235 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10800d1220 0x7f10800b0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:11.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.619+0000 7f107ffff700 1 -- 172.21.15.84:0/1536456235 >> v1:172.21.15.179:6789/0 conn(0x7f10800b4530 legacy=0x7f10800d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:11.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.619+0000 7f107ffff700 1 -- 172.21.15.84:0/1536456235 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10800b0060 con 0x7f10800b8a60 2023-07-14T11:13:11.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.619+0000 7f107ffff700 1 --2- 172.21.15.84:0/1536456235 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f10800b8a60 0x7f10800b3ff0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f10700098f0 tx=0x7f1070009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bbfa53636f21a60 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:11.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.619+0000 7f107effd700 1 -- 172.21.15.84:0/1536456235 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1070004230 con 0x7f10800b8a60 2023-07-14T11:13:11.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.619+0000 7f107effd700 1 -- 172.21.15.84:0/1536456235 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1070004390 con 0x7f10800b8a60 2023-07-14T11:13:11.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.619+0000 7f107effd700 1 -- 172.21.15.84:0/1536456235 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10700036a0 con 0x7f10800b8a60 2023-07-14T11:13:11.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.619+0000 7f10865ff700 1 -- 172.21.15.84:0/1536456235 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f10800b8a60 msgr2=0x7f10800b3ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:11.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.620+0000 7f10865ff700 1 --2- 172.21.15.84:0/1536456235 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f10800b8a60 0x7f10800b3ff0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f10700098f0 tx=0x7f1070009c00 comp rx=0 tx=0).stop 2023-07-14T11:13:11.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.620+0000 7f10865ff700 1 -- 172.21.15.84:0/1536456235 shutdown_connections 2023-07-14T11:13:11.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.620+0000 7f10865ff700 1 --2- 172.21.15.84:0/1536456235 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10800d1220 0x7f10800b0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:11.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.620+0000 7f10865ff700 1 --2- 172.21.15.84:0/1536456235 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f10800b8a60 0x7f10800b3ff0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:11.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.620+0000 7f10865ff700 1 -- 172.21.15.84:0/1536456235 >> 172.21.15.84:0/1536456235 conn(0x7f108009c1b0 msgr2=0x7f10800d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:11.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.620+0000 7f10865ff700 1 -- 172.21.15.84:0/1536456235 shutdown_connections 2023-07-14T11:13:11.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.620+0000 7f10865ff700 1 -- 172.21.15.84:0/1536456235 wait complete. 2023-07-14T11:13:11.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.622+0000 7f10865ff700 1 Processor -- start 2023-07-14T11:13:11.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.622+0000 7f10865ff700 1 -- start start 2023-07-14T11:13:11.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.623+0000 7f10865ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10800b4530 0x7f10801f5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:11.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.623+0000 7f10865ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10800b8a60 0x7f10800cbc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:11.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.623+0000 7f10865ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f10800d1220 0x7f108015f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:11.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.624+0000 7f10865ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10800ce020 con 0x7f10800d1220 2023-07-14T11:13:11.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.624+0000 7f10865ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10800cd6f0 con 0x7f10800b4530 2023-07-14T11:13:11.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.624+0000 7f10865ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10800cd9d0 con 0x7f10800b8a60 2023-07-14T11:13:11.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.624+0000 7f107ffff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10800b4530 0x7f10801f5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:11.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.624+0000 7f1084b9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f10800d1220 0x7f108015f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:11.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.624+0000 7f107ffff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10800b4530 0x7f10801f5b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.84:46674/0 (socket says 172.21.15.84:46674) 2023-07-14T11:13:11.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.624+0000 7f107ffff700 1 -- 172.21.15.84:0/3715441707 learned_addr learned my addr 172.21.15.84:0/3715441707 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:11.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.624+0000 7f107f7fe700 1 --2- 172.21.15.84:0/3715441707 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10800b8a60 0x7f10800cbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:11.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.624+0000 7f1084b9c700 1 -- 172.21.15.84:0/3715441707 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10800b8a60 msgr2=0x7f10800cbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:11.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.624+0000 7f1084b9c700 1 --2- 172.21.15.84:0/3715441707 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10800b8a60 0x7f10800cbc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:11.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.624+0000 7f1084b9c700 1 -- 172.21.15.84:0/3715441707 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10800b4530 msgr2=0x7f10801f5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:11.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.624+0000 7f1084b9c700 1 --2- 172.21.15.84:0/3715441707 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10800b4530 0x7f10801f5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:11.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.624+0000 7f1084b9c700 1 -- 172.21.15.84:0/3715441707 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1070009550 con 0x7f10800d1220 2023-07-14T11:13:11.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.624+0000 7f107ffff700 1 --2- 172.21.15.84:0/3715441707 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10800b4530 0x7f10801f5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:13:11.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.624+0000 7f1084b9c700 1 --2- 172.21.15.84:0/3715441707 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f10800d1220 0x7f108015f330 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f108008d270 tx=0x7f1078009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:11.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.625+0000 7f107cff9700 1 -- 172.21.15.84:0/3715441707 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f107800cad0 con 0x7f10800d1220 2023-07-14T11:13:11.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.625+0000 7f107cff9700 1 -- 172.21.15.84:0/3715441707 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f107800cc70 con 0x7f10800d1220 2023-07-14T11:13:11.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.625+0000 7f10865ff700 1 -- 172.21.15.84:0/3715441707 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10800cdcb0 con 0x7f10800d1220 2023-07-14T11:13:11.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.625+0000 7f107cff9700 1 -- 172.21.15.84:0/3715441707 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1078014440 con 0x7f10800d1220 2023-07-14T11:13:11.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.625+0000 7f10865ff700 1 -- 172.21.15.84:0/3715441707 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10801f6280 con 0x7f10800d1220 2023-07-14T11:13:11.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.626+0000 7f10865ff700 1 -- 172.21.15.84:0/3715441707 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10800ce1d0 con 0x7f10800d1220 2023-07-14T11:13:11.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.627+0000 7f107cff9700 1 -- 172.21.15.84:0/3715441707 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f10780145a0 con 0x7f10800d1220 2023-07-14T11:13:11.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.628+0000 7f107cff9700 1 --2- 172.21.15.84:0/3715441707 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f106c06ace0 0x7f106c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:11.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.628+0000 7f107cff9700 1 -- 172.21.15.84:0/3715441707 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f1078088c20 con 0x7f10800d1220 2023-07-14T11:13:11.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.628+0000 7f107ffff700 1 --2- 172.21.15.84:0/3715441707 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f106c06ace0 0x7f106c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:11.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.629+0000 7f107ffff700 1 --2- 172.21.15.84:0/3715441707 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f106c06ace0 0x7f106c06d190 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1070004720 tx=0x7f1070008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:11.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.632+0000 7f107cff9700 1 -- 172.21.15.84:0/3715441707 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f10800ce1d0 con 0x7f10800d1220 2023-07-14T11:13:11.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.829+0000 7f10865ff700 1 -- 172.21.15.84:0/3715441707 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f10801f6280 con 0x7f10800d1220 2023-07-14T11:13:11.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.830+0000 7f107cff9700 1 -- 172.21.15.84:0/3715441707 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7f10801f6280 con 0x7f10800d1220 2023-07-14T11:13:11.832 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-07-14T11:13:11.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.832+0000 7f10865ff700 1 -- 172.21.15.84:0/3715441707 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f106c06ace0 msgr2=0x7f106c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:11.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.832+0000 7f10865ff700 1 --2- 172.21.15.84:0/3715441707 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f106c06ace0 0x7f106c06d190 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1070004720 tx=0x7f1070008030 comp rx=0 tx=0).stop 2023-07-14T11:13:11.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.832+0000 7f10865ff700 1 -- 172.21.15.84:0/3715441707 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f10800d1220 msgr2=0x7f108015f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:11.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.832+0000 7f10865ff700 1 --2- 172.21.15.84:0/3715441707 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f10800d1220 0x7f108015f330 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f108008d270 tx=0x7f1078009ed0 comp rx=0 tx=0).stop 2023-07-14T11:13:11.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.832+0000 7f10865ff700 1 -- 172.21.15.84:0/3715441707 shutdown_connections 2023-07-14T11:13:11.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.832+0000 7f10865ff700 1 --2- 172.21.15.84:0/3715441707 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f10800d1220 0x7f108015f330 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:11.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.832+0000 7f10865ff700 1 --2- 172.21.15.84:0/3715441707 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10800b4530 0x7f10801f5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:11.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.832+0000 7f10865ff700 1 --2- 172.21.15.84:0/3715441707 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f106c06ace0 0x7f106c06d190 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:11.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.832+0000 7f10865ff700 1 --2- 172.21.15.84:0/3715441707 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10800b8a60 0x7f10800cbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:11.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.832+0000 7f10865ff700 1 -- 172.21.15.84:0/3715441707 >> 172.21.15.84:0/3715441707 conn(0x7f108009c1b0 msgr2=0x7f10800d0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:11.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.832+0000 7f10865ff700 1 -- 172.21.15.84:0/3715441707 shutdown_connections 2023-07-14T11:13:11.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:11.832+0000 7f10865ff700 1 -- 172.21.15.84:0/3715441707 wait complete. 2023-07-14T11:13:11.852 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-14T11:13:12.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.047+0000 7f73591ff700 1 Processor -- start 2023-07-14T11:13:12.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.047+0000 7f73591ff700 1 -- start start 2023-07-14T11:13:12.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.048+0000 7f73591ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f73540d1220 0x7f73540b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:12.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.048+0000 7f73591ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f73540b1e00 0x7f73540afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:12.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.048+0000 7f73591ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73540d2ce0 con 0x7f735415c950 2023-07-14T11:13:12.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.048+0000 7f73591ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73540b3350 con 0x7f73540b1e00 2023-07-14T11:13:12.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.048+0000 7f73591ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73540b3630 con 0x7f73540d1220 2023-07-14T11:13:12.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.049+0000 7f7352d9d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f735415c950 0x7f73540d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:43178/0 (socket says 172.21.15.84:43178) 2023-07-14T11:13:12.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.049+0000 7f7352d9d700 1 -- 172.21.15.84:0/3634997105 learned_addr learned my addr 172.21.15.84:0/3634997105 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:13:12.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.049+0000 7f735359e700 1 --2- 172.21.15.84:0/3634997105 >> v2:172.21.15.84:3300/0 conn(0x7f73540b1e00 0x7f73540afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:12.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.049+0000 7f735259c700 1 --2- 172.21.15.84:0/3634997105 >> v2:172.21.15.179:3300/0 conn(0x7f73540d1220 0x7f73540b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:12.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.049+0000 7f7351d9b700 1 -- 172.21.15.84:0/3634997105 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3521532517 0 0) 0x7f73540d2ce0 con 0x7f735415c950 2023-07-14T11:13:12.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.049+0000 7f7351d9b700 1 -- 172.21.15.84:0/3634997105 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f733c0035b0 con 0x7f735415c950 2023-07-14T11:13:12.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.049+0000 7f735359e700 1 -- 172.21.15.84:0/3634997105 >> v2:172.21.15.179:3300/0 conn(0x7f73540d1220 msgr2=0x7f73540b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:12.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.049+0000 7f735359e700 1 --2- 172.21.15.84:0/3634997105 >> v2:172.21.15.179:3300/0 conn(0x7f73540d1220 0x7f73540b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:12.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.049+0000 7f735359e700 1 -- 172.21.15.84:0/3634997105 >> v1:172.21.15.84:6789/0 conn(0x7f735415c950 legacy=0x7f73540d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:12.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.049+0000 7f735359e700 1 -- 172.21.15.84:0/3634997105 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73540b3910 con 0x7f73540b1e00 2023-07-14T11:13:12.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.049+0000 7f735359e700 1 --2- 172.21.15.84:0/3634997105 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73540b1e00 0x7f73540afac0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7354072140 tx=0x7f734c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=399c10108355d4a9 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:12.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.050+0000 7f7351d9b700 1 -- 172.21.15.84:0/3634997105 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f734c00e070 con 0x7f73540b1e00 2023-07-14T11:13:12.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.050+0000 7f7351d9b700 1 -- 172.21.15.84:0/3634997105 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f734c00bb20 con 0x7f73540b1e00 2023-07-14T11:13:12.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.050+0000 7f7351d9b700 1 -- 172.21.15.84:0/3634997105 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f734c012430 con 0x7f73540b1e00 2023-07-14T11:13:12.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.050+0000 7f73591ff700 1 -- 172.21.15.84:0/3634997105 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73540b1e00 msgr2=0x7f73540afac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:12.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.050+0000 7f73591ff700 1 --2- 172.21.15.84:0/3634997105 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73540b1e00 0x7f73540afac0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7354072140 tx=0x7f734c00b330 comp rx=0 tx=0).stop 2023-07-14T11:13:12.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.050+0000 7f73591ff700 1 -- 172.21.15.84:0/3634997105 shutdown_connections 2023-07-14T11:13:12.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.050+0000 7f73591ff700 1 --2- 172.21.15.84:0/3634997105 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73540b1e00 0x7f73540afac0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:12.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.050+0000 7f73591ff700 1 --2- 172.21.15.84:0/3634997105 >> v2:172.21.15.179:3300/0 conn(0x7f73540d1220 0x7f73540b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:12.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.050+0000 7f73591ff700 1 -- 172.21.15.84:0/3634997105 >> 172.21.15.84:0/3634997105 conn(0x7f735409c1d0 msgr2=0x7f73540d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:12.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.050+0000 7f73591ff700 1 -- 172.21.15.84:0/3634997105 shutdown_connections 2023-07-14T11:13:12.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.050+0000 7f73591ff700 1 -- 172.21.15.84:0/3634997105 wait complete. 2023-07-14T11:13:12.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.052+0000 7f73591ff700 1 Processor -- start 2023-07-14T11:13:12.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.052+0000 7f73591ff700 1 -- start start 2023-07-14T11:13:12.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.053+0000 7f73591ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73540b1e00 0x7f73540c6a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:12.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.053+0000 7f73591ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73540d1220 0x7f7354157900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:12.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.053+0000 7f73591ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f735415c950 0x7f73540c86c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:12.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.053+0000 7f73591ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73540c8c00 con 0x7f73540d1220 2023-07-14T11:13:12.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.053+0000 7f73591ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73540c7170 con 0x7f735415c950 2023-07-14T11:13:12.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.053+0000 7f73591ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73540c7450 con 0x7f73540b1e00 2023-07-14T11:13:12.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.053+0000 7f735259c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73540d1220 0x7f7354157900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:12.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.053+0000 7f735259c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73540d1220 0x7f7354157900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44188/0 (socket says 172.21.15.84:44188) 2023-07-14T11:13:12.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.053+0000 7f735259c700 1 -- 172.21.15.84:0/2984743465 learned_addr learned my addr 172.21.15.84:0/2984743465 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:12.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.054+0000 7f7352d9d700 1 --2- 172.21.15.84:0/2984743465 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73540b1e00 0x7f73540c6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:12.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.054+0000 7f735359e700 1 --2- 172.21.15.84:0/2984743465 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f735415c950 0x7f73540c86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:12.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.054+0000 7f735259c700 1 -- 172.21.15.84:0/2984743465 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73540b1e00 msgr2=0x7f73540c6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:12.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.054+0000 7f735259c700 1 --2- 172.21.15.84:0/2984743465 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73540b1e00 0x7f73540c6a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:12.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.054+0000 7f735259c700 1 -- 172.21.15.84:0/2984743465 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f735415c950 msgr2=0x7f73540c86c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:12.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.054+0000 7f735259c700 1 --2- 172.21.15.84:0/2984743465 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f735415c950 0x7f73540c86c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:12.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.054+0000 7f735259c700 1 -- 172.21.15.84:0/2984743465 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f734c009a70 con 0x7f73540d1220 2023-07-14T11:13:12.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.054+0000 7f7352d9d700 1 --2- 172.21.15.84:0/2984743465 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73540b1e00 0x7f73540c6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:13:12.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.054+0000 7f735359e700 1 --2- 172.21.15.84:0/2984743465 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f735415c950 0x7f73540c86c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:13:12.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.054+0000 7f735259c700 1 --2- 172.21.15.84:0/2984743465 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73540d1220 0x7f7354157900 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f734800e810 tx=0x7f734800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:12.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.054+0000 7f733b7fe700 1 -- 172.21.15.84:0/2984743465 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7348013610 con 0x7f73540d1220 2023-07-14T11:13:12.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.054+0000 7f733b7fe700 1 -- 172.21.15.84:0/2984743465 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7348013770 con 0x7f73540d1220 2023-07-14T11:13:12.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.054+0000 7f73591ff700 1 -- 172.21.15.84:0/2984743465 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73540c7730 con 0x7f73540d1220 2023-07-14T11:13:12.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.054+0000 7f733b7fe700 1 -- 172.21.15.84:0/2984743465 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7348013b00 con 0x7f73540d1220 2023-07-14T11:13:12.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.054+0000 7f73591ff700 1 -- 172.21.15.84:0/2984743465 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73540ca490 con 0x7f73540d1220 2023-07-14T11:13:12.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.055+0000 7f73591ff700 1 -- 172.21.15.84:0/2984743465 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73540ca800 con 0x7f73540d1220 2023-07-14T11:13:12.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.056+0000 7f733b7fe700 1 -- 172.21.15.84:0/2984743465 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7348013c60 con 0x7f73540d1220 2023-07-14T11:13:12.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.057+0000 7f733b7fe700 1 --2- 172.21.15.84:0/2984743465 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f734006ace0 0x7f734006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:12.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.057+0000 7f733b7fe700 1 -- 172.21.15.84:0/2984743465 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f7348088e20 con 0x7f73540d1220 2023-07-14T11:13:12.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.057+0000 7f7352d9d700 1 --2- 172.21.15.84:0/2984743465 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f734006ace0 0x7f734006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:12.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.058+0000 7f7352d9d700 1 --2- 172.21.15.84:0/2984743465 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f734006ace0 0x7f734006d190 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f73440010e0 tx=0x7f7344009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:12.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.062+0000 7f733b7fe700 1 -- 172.21.15.84:0/2984743465 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7348057ca0 con 0x7f73540d1220 2023-07-14T11:13:12.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.260+0000 7f73591ff700 1 -- 172.21.15.84:0/2984743465 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f73540ca2f0 con 0x7f73540d1220 2023-07-14T11:13:12.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.261+0000 7f733b7fe700 1 -- 172.21.15.84:0/2984743465 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) v1 ==== 84+0+126 (secure 0 0 0) 0x7f7348021090 con 0x7f73540d1220 2023-07-14T11:13:12.263 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:13:12.263 INFO:teuthology.orchestra.run.smithi084.stdout:[ 2023-07-14T11:13:12.263 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:13:12.264 INFO:teuthology.orchestra.run.smithi084.stdout: "poolnum": 1, 2023-07-14T11:13:12.264 INFO:teuthology.orchestra.run.smithi084.stdout: "poolname": ".mgr" 2023-07-14T11:13:12.264 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:13:12.264 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:13:12.264 INFO:teuthology.orchestra.run.smithi084.stdout: "poolnum": 2, 2023-07-14T11:13:12.264 INFO:teuthology.orchestra.run.smithi084.stdout: "poolname": "rbd" 2023-07-14T11:13:12.264 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:13:12.265 INFO:teuthology.orchestra.run.smithi084.stdout:] 2023-07-14T11:13:12.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.263+0000 7f73591ff700 1 -- 172.21.15.84:0/2984743465 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f734006ace0 msgr2=0x7f734006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:12.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.263+0000 7f73591ff700 1 --2- 172.21.15.84:0/2984743465 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f734006ace0 0x7f734006d190 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f73440010e0 tx=0x7f7344009040 comp rx=0 tx=0).stop 2023-07-14T11:13:12.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.263+0000 7f73591ff700 1 -- 172.21.15.84:0/2984743465 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73540d1220 msgr2=0x7f7354157900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:12.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.263+0000 7f73591ff700 1 --2- 172.21.15.84:0/2984743465 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73540d1220 0x7f7354157900 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f734800e810 tx=0x7f734800ebd0 comp rx=0 tx=0).stop 2023-07-14T11:13:12.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.263+0000 7f73591ff700 1 -- 172.21.15.84:0/2984743465 shutdown_connections 2023-07-14T11:13:12.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.263+0000 7f73591ff700 1 --2- 172.21.15.84:0/2984743465 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f734006ace0 0x7f734006d190 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:12.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.263+0000 7f73591ff700 1 --2- 172.21.15.84:0/2984743465 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73540b1e00 0x7f73540c6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:12.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.263+0000 7f73591ff700 1 --2- 172.21.15.84:0/2984743465 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f735415c950 0x7f73540c86c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:12.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.263+0000 7f73591ff700 1 --2- 172.21.15.84:0/2984743465 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73540d1220 0x7f7354157900 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:12.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.263+0000 7f73591ff700 1 -- 172.21.15.84:0/2984743465 >> 172.21.15.84:0/2984743465 conn(0x7f735409c1d0 msgr2=0x7f735406bf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:12.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.263+0000 7f73591ff700 1 -- 172.21.15.84:0/2984743465 shutdown_connections 2023-07-14T11:13:12.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.263+0000 7f73591ff700 1 -- 172.21.15.84:0/2984743465 wait complete. 2023-07-14T11:13:12.283 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-14T11:13:12.283 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-14T11:13:12.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.480+0000 7fa518dff700 1 Processor -- start 2023-07-14T11:13:12.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.481+0000 7fa518dff700 1 -- start start 2023-07-14T11:13:12.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.482+0000 7fa518dff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa51415c890 0x7fa5140d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:12.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.482+0000 7fa518dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa5140b2440 0x7fa5140d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:12.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.482+0000 7fa518dff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa51406c240 0x7fa5140cf840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:12.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.482+0000 7fa518dff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa51415cc60 con 0x7fa51406c240 2023-07-14T11:13:12.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.482+0000 7fa518dff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa51406a7f0 con 0x7fa51415c890 2023-07-14T11:13:12.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.482+0000 7fa518dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa51406b760 con 0x7fa5140b2440 2023-07-14T11:13:12.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.482+0000 7fa512d9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa51406c240 0x7fa5140cf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:12.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.482+0000 7fa512d9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa51406c240 0x7fa5140cf840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44200/0 (socket says 172.21.15.84:44200) 2023-07-14T11:13:12.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.482+0000 7fa512d9d700 1 -- 172.21.15.84:0/2421353539 learned_addr learned my addr 172.21.15.84:0/2421353539 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:12.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.482+0000 7fa51259c700 1 --2- 172.21.15.84:0/2421353539 >> v2:172.21.15.179:3300/0 conn(0x7fa51415c890 0x7fa5140d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:12.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.482+0000 7fa50bfff700 1 --2- 172.21.15.84:0/2421353539 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa5140b2440 0x7fa5140d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:12.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.482+0000 7fa512d9d700 1 -- 172.21.15.84:0/2421353539 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa5140b2440 msgr2=0x7fa5140d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:12.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.482+0000 7fa512d9d700 1 --2- 172.21.15.84:0/2421353539 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa5140b2440 0x7fa5140d0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:12.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.482+0000 7fa512d9d700 1 -- 172.21.15.84:0/2421353539 >> v2:172.21.15.179:3300/0 conn(0x7fa51415c890 msgr2=0x7fa5140d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:12.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.482+0000 7fa512d9d700 1 --2- 172.21.15.84:0/2421353539 >> v2:172.21.15.179:3300/0 conn(0x7fa51415c890 0x7fa5140d0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:12.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.482+0000 7fa512d9d700 1 -- 172.21.15.84:0/2421353539 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa51406ba40 con 0x7fa51406c240 2023-07-14T11:13:12.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.483+0000 7fa512d9d700 1 --2- 172.21.15.84:0/2421353539 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa51406c240 0x7fa5140cf840 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa51406a650 tx=0x7fa50c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e105dd5d0c064d2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:12.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.483+0000 7fa511d9b700 1 -- 172.21.15.84:0/2421353539 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50c00e070 con 0x7fa51406c240 2023-07-14T11:13:12.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.483+0000 7fa511d9b700 1 -- 172.21.15.84:0/2421353539 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa50c00b9c0 con 0x7fa51406c240 2023-07-14T11:13:12.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.483+0000 7fa511d9b700 1 -- 172.21.15.84:0/2421353539 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50c00bd70 con 0x7fa51406c240 2023-07-14T11:13:12.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.483+0000 7fa518dff700 1 -- 172.21.15.84:0/2421353539 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa51406c240 msgr2=0x7fa5140cf840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:12.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.483+0000 7fa518dff700 1 --2- 172.21.15.84:0/2421353539 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa51406c240 0x7fa5140cf840 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa51406a650 tx=0x7fa50c00b330 comp rx=0 tx=0).stop 2023-07-14T11:13:12.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.483+0000 7fa518dff700 1 -- 172.21.15.84:0/2421353539 shutdown_connections 2023-07-14T11:13:12.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.483+0000 7fa518dff700 1 --2- 172.21.15.84:0/2421353539 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa51406c240 0x7fa5140cf840 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:12.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.483+0000 7fa518dff700 1 --2- 172.21.15.84:0/2421353539 >> v2:172.21.15.179:3300/0 conn(0x7fa51415c890 0x7fa5140d0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:12.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.483+0000 7fa518dff700 1 --2- 172.21.15.84:0/2421353539 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa5140b2440 0x7fa5140d0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:12.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.483+0000 7fa518dff700 1 -- 172.21.15.84:0/2421353539 >> 172.21.15.84:0/2421353539 conn(0x7fa51409c170 msgr2=0x7fa5140d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:12.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.484+0000 7fa518dff700 1 -- 172.21.15.84:0/2421353539 shutdown_connections 2023-07-14T11:13:12.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.484+0000 7fa518dff700 1 -- 172.21.15.84:0/2421353539 wait complete. 2023-07-14T11:13:12.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.485+0000 7fa518dff700 1 Processor -- start 2023-07-14T11:13:12.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.485+0000 7fa518dff700 1 -- start start 2023-07-14T11:13:12.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.486+0000 7fa518dff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa51406c240 0x7fa5140b5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:12.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.486+0000 7fa518dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa5140b2440 0x7fa5141481e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:12.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.486+0000 7fa518dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa51415c890 0x7fa5140d2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:12.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.486+0000 7fa518dff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5140b5610 con 0x7fa51406c240 2023-07-14T11:13:12.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.486+0000 7fa518dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5140b61f0 con 0x7fa51415c890 2023-07-14T11:13:12.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.486+0000 7fa518dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5140b8cc0 con 0x7fa5140b2440 2023-07-14T11:13:12.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.486+0000 7fa51259c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa51406c240 0x7fa5140b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:12.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.486+0000 7fa51259c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa51406c240 0x7fa5140b5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44216/0 (socket says 172.21.15.84:44216) 2023-07-14T11:13:12.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.486+0000 7fa51259c700 1 -- 172.21.15.84:0/919393011 learned_addr learned my addr 172.21.15.84:0/919393011 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:12.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.487+0000 7fa50bfff700 1 --2- 172.21.15.84:0/919393011 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa5140b2440 0x7fa5141481e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:12.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.487+0000 7fa51259c700 1 -- 172.21.15.84:0/919393011 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa5140b2440 msgr2=0x7fa5141481e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:12.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.487+0000 7fa512d9d700 1 --2- 172.21.15.84:0/919393011 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa51415c890 0x7fa5140d2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:12.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.487+0000 7fa51259c700 1 --2- 172.21.15.84:0/919393011 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa5140b2440 0x7fa5141481e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:12.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.487+0000 7fa51259c700 1 -- 172.21.15.84:0/919393011 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa51415c890 msgr2=0x7fa5140d2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:12.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.487+0000 7fa51259c700 1 --2- 172.21.15.84:0/919393011 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa51415c890 0x7fa5140d2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:12.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.487+0000 7fa51259c700 1 -- 172.21.15.84:0/919393011 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa50c009b30 con 0x7fa51406c240 2023-07-14T11:13:12.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.487+0000 7fa50bfff700 1 --2- 172.21.15.84:0/919393011 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa5140b2440 0x7fa5141481e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:13:12.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.487+0000 7fa512d9d700 1 --2- 172.21.15.84:0/919393011 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa51415c890 0x7fa5140d2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:13:12.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.487+0000 7fa51259c700 1 --2- 172.21.15.84:0/919393011 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa51406c240 0x7fa5140b5cb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa50400d800 tx=0x7fa50400dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:12.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.487+0000 7fa50affd700 1 -- 172.21.15.84:0/919393011 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5040125f0 con 0x7fa51406c240 2023-07-14T11:13:12.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.487+0000 7fa50affd700 1 -- 172.21.15.84:0/919393011 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa504012750 con 0x7fa51406c240 2023-07-14T11:13:12.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.487+0000 7fa518dff700 1 -- 172.21.15.84:0/919393011 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5140b2980 con 0x7fa51406c240 2023-07-14T11:13:12.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.487+0000 7fa50affd700 1 -- 172.21.15.84:0/919393011 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa504012b00 con 0x7fa51406c240 2023-07-14T11:13:12.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.487+0000 7fa518dff700 1 -- 172.21.15.84:0/919393011 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5140b2f40 con 0x7fa51406c240 2023-07-14T11:13:12.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.488+0000 7fa518dff700 1 -- 172.21.15.84:0/919393011 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa514074350 con 0x7fa51406c240 2023-07-14T11:13:12.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.489+0000 7fa50affd700 1 -- 172.21.15.84:0/919393011 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa504012c60 con 0x7fa51406c240 2023-07-14T11:13:12.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.490+0000 7fa50affd700 1 --2- 172.21.15.84:0/919393011 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa4f406ace0 0x7fa4f406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:12.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.490+0000 7fa50affd700 1 -- 172.21.15.84:0/919393011 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa504089590 con 0x7fa51406c240 2023-07-14T11:13:12.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.490+0000 7fa50bfff700 1 --2- 172.21.15.84:0/919393011 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa4f406ace0 0x7fa4f406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:12.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.491+0000 7fa50bfff700 1 --2- 172.21.15.84:0/919393011 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa4f406ace0 0x7fa4f406d190 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa5140b4de0 tx=0x7fa4fc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:12.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.494+0000 7fa50affd700 1 -- 172.21.15.84:0/919393011 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fa5040548f0 con 0x7fa51406c240 2023-07-14T11:13:12.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.689+0000 7fa518dff700 1 -- 172.21.15.84:0/919393011 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fa51406aab0 con 0x7fa51406c240 2023-07-14T11:13:12.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.958+0000 7fa50affd700 1 -- 172.21.15.84:0/919393011 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) v1 ==== 138+0+0 (secure 0 0 0) 0x7fa504057f10 con 0x7fa51406c240 2023-07-14T11:13:12.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.963+0000 7fa518dff700 1 -- 172.21.15.84:0/919393011 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa4f406ace0 msgr2=0x7fa4f406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:12.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.963+0000 7fa518dff700 1 --2- 172.21.15.84:0/919393011 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa4f406ace0 0x7fa4f406d190 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa5140b4de0 tx=0x7fa4fc008040 comp rx=0 tx=0).stop 2023-07-14T11:13:12.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.963+0000 7fa518dff700 1 -- 172.21.15.84:0/919393011 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa51406c240 msgr2=0x7fa5140b5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:12.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.963+0000 7fa518dff700 1 --2- 172.21.15.84:0/919393011 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa51406c240 0x7fa5140b5cb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa50400d800 tx=0x7fa50400dbc0 comp rx=0 tx=0).stop 2023-07-14T11:13:12.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.963+0000 7fa518dff700 1 -- 172.21.15.84:0/919393011 shutdown_connections 2023-07-14T11:13:12.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.963+0000 7fa518dff700 1 --2- 172.21.15.84:0/919393011 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa51415c890 0x7fa5140d2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:12.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.963+0000 7fa518dff700 1 --2- 172.21.15.84:0/919393011 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa51406c240 0x7fa5140b5cb0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:12.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.963+0000 7fa518dff700 1 --2- 172.21.15.84:0/919393011 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa4f406ace0 0x7fa4f406d190 secure :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa5140b4de0 tx=0x7fa4fc008040 comp rx=0 tx=0).stop 2023-07-14T11:13:12.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.963+0000 7fa518dff700 1 --2- 172.21.15.84:0/919393011 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa5140b2440 0x7fa5141481e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:12.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.963+0000 7fa518dff700 1 -- 172.21.15.84:0/919393011 >> 172.21.15.84:0/919393011 conn(0x7fa51409c170 msgr2=0x7fa5140b1500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:12.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.964+0000 7fa518dff700 1 -- 172.21.15.84:0/919393011 shutdown_connections 2023-07-14T11:13:12.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:12.964+0000 7fa518dff700 1 -- 172.21.15.84:0/919393011 wait complete. 2023-07-14T11:13:12.968 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_metadata' created 2023-07-14T11:13:12.986 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-14T11:13:13.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.186+0000 7f3b27fff700 1 Processor -- start 2023-07-14T11:13:13.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.186+0000 7f3b27fff700 1 -- start start 2023-07-14T11:13:13.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.187+0000 7f3b27fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3b200b8a60 0x7f3b200b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:13.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.187+0000 7f3b27fff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b200b8e30 con 0x7f3b200d1220 2023-07-14T11:13:13.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.187+0000 7f3b27fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b200afaa0 con 0x7f3b200b4530 2023-07-14T11:13:13.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.187+0000 7f3b27fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b200afd80 con 0x7f3b200b8a60 2023-07-14T11:13:13.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.188+0000 7f3b2659c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f3b200d1220 0x7f3b200b0e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:43190/0 (socket says 172.21.15.84:43190) 2023-07-14T11:13:13.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.188+0000 7f3b2659c700 1 -- 172.21.15.84:0/4142241841 learned_addr learned my addr 172.21.15.84:0/4142241841 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:13:13.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.188+0000 7f3b25d9b700 1 --2- 172.21.15.84:0/4142241841 >> v2:172.21.15.179:3300/0 conn(0x7f3b200b8a60 0x7f3b200b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:13.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.188+0000 7f3b24d99700 1 -- 172.21.15.84:0/4142241841 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2093999062 0 0) 0x7f3b200b8e30 con 0x7f3b200d1220 2023-07-14T11:13:13.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.188+0000 7f3b24d99700 1 -- 172.21.15.84:0/4142241841 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b0c0035b0 con 0x7f3b200d1220 2023-07-14T11:13:13.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.188+0000 7f3b24d99700 1 -- 172.21.15.84:0/4142241841 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 546599014 0 0) 0x7f3b200afaa0 con 0x7f3b200b4530 2023-07-14T11:13:13.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.188+0000 7f3b24d99700 1 -- 172.21.15.84:0/4142241841 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b200b8e30 con 0x7f3b200b4530 2023-07-14T11:13:13.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.188+0000 7f3b24d99700 1 -- 172.21.15.84:0/4142241841 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1236537784 0 0) 0x7f3b0c0035b0 con 0x7f3b200d1220 2023-07-14T11:13:13.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.188+0000 7f3b24d99700 1 -- 172.21.15.84:0/4142241841 >> v2:172.21.15.179:3300/0 conn(0x7f3b200b8a60 msgr2=0x7f3b200b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:13.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.188+0000 7f3b24d99700 1 --2- 172.21.15.84:0/4142241841 >> v2:172.21.15.179:3300/0 conn(0x7f3b200b8a60 0x7f3b200b3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:13.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.188+0000 7f3b24d99700 1 -- 172.21.15.84:0/4142241841 >> v1:172.21.15.179:6789/0 conn(0x7f3b200b4530 legacy=0x7f3b200d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:13.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.188+0000 7f3b24d99700 1 -- 172.21.15.84:0/4142241841 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b200b0060 con 0x7f3b200d1220 2023-07-14T11:13:13.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.188+0000 7f3b24d99700 1 -- 172.21.15.84:0/4142241841 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7f3b180019f0 con 0x7f3b200d1220 2023-07-14T11:13:13.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.188+0000 7f3b24d99700 1 -- 172.21.15.84:0/4142241841 >> v1:172.21.15.84:6789/0 conn(0x7f3b200d1220 legacy=0x7f3b200b0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:13.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.188+0000 7f3b24d99700 1 --2- 172.21.15.84:0/4142241841 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b0c003b90 0x7f3b0c003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:13.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.188+0000 7f3b24d99700 1 --2- 172.21.15.84:0/4142241841 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b0c004850 0x7f3b0c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:13.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.188+0000 7f3b24d99700 1 --2- 172.21.15.84:0/4142241841 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b0c005200 0x7f3b0c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:13.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.188+0000 7f3b24d99700 1 -- 172.21.15.84:0/4142241841 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b200afd80 con 0x7f3b0c003b90 2023-07-14T11:13:13.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.188+0000 7f3b24d99700 1 -- 172.21.15.84:0/4142241841 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0c00c000 con 0x7f3b0c004850 2023-07-14T11:13:13.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.188+0000 7f3b24d99700 1 -- 172.21.15.84:0/4142241841 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0c00c190 con 0x7f3b0c005200 2023-07-14T11:13:13.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.189+0000 7f3b25d9b700 1 --2- 172.21.15.84:0/4142241841 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b0c003b90 0x7f3b0c003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:13.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.189+0000 7f3b2659c700 1 --2- 172.21.15.84:0/4142241841 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b0c005200 0x7f3b0c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:13.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.189+0000 7f3b2559a700 1 --2- 172.21.15.84:0/4142241841 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b0c004850 0x7f3b0c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:13.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.189+0000 7f3b25d9b700 1 -- 172.21.15.84:0/4142241841 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b0c005200 msgr2=0x7f3b0c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:13.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.189+0000 7f3b25d9b700 1 --2- 172.21.15.84:0/4142241841 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b0c005200 0x7f3b0c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:13.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.189+0000 7f3b25d9b700 1 -- 172.21.15.84:0/4142241841 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b0c004850 msgr2=0x7f3b0c004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:13.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.189+0000 7f3b25d9b700 1 --2- 172.21.15.84:0/4142241841 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b0c004850 0x7f3b0c004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:13.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.189+0000 7f3b25d9b700 1 -- 172.21.15.84:0/4142241841 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b0c0035b0 con 0x7f3b0c003b90 2023-07-14T11:13:13.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.189+0000 7f3b2659c700 1 -- 172.21.15.84:0/4142241841 reap_dead start 2023-07-14T11:13:13.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.189+0000 7f3b2559a700 1 --2- 172.21.15.84:0/4142241841 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b0c004850 0x7f3b0c004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:13:13.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.189+0000 7f3b25d9b700 1 --2- 172.21.15.84:0/4142241841 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b0c003b90 0x7f3b0c003f80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c009b60 tx=0x7f3b0c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62e43b85606ff120 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:13.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.189+0000 7f3b24d99700 1 -- 172.21.15.84:0/4142241841 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1c00e6c0 con 0x7f3b0c003b90 2023-07-14T11:13:13.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.190+0000 7f3b24d99700 1 -- 172.21.15.84:0/4142241841 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b1c00e820 con 0x7f3b0c003b90 2023-07-14T11:13:13.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.190+0000 7f3b24d99700 1 -- 172.21.15.84:0/4142241841 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1c00eb90 con 0x7f3b0c003b90 2023-07-14T11:13:13.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.190+0000 7f3b27fff700 1 -- 172.21.15.84:0/4142241841 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b0c003b90 msgr2=0x7f3b0c003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:13.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.190+0000 7f3b27fff700 1 --2- 172.21.15.84:0/4142241841 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b0c003b90 0x7f3b0c003f80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c009b60 tx=0x7f3b0c005880 comp rx=0 tx=0).stop 2023-07-14T11:13:13.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.190+0000 7f3b27fff700 1 -- 172.21.15.84:0/4142241841 shutdown_connections 2023-07-14T11:13:13.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.190+0000 7f3b27fff700 1 --2- 172.21.15.84:0/4142241841 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b0c003b90 0x7f3b0c003f80 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:13.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.190+0000 7f3b27fff700 1 -- 172.21.15.84:0/4142241841 >> 172.21.15.84:0/4142241841 conn(0x7f3b2009c1b0 msgr2=0x7f3b200d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:13.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.190+0000 7f3b27fff700 1 -- 172.21.15.84:0/4142241841 shutdown_connections 2023-07-14T11:13:13.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.190+0000 7f3b27fff700 1 -- 172.21.15.84:0/4142241841 wait complete. 2023-07-14T11:13:13.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.192+0000 7f3b27fff700 1 Processor -- start 2023-07-14T11:13:13.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.192+0000 7f3b27fff700 1 -- start start 2023-07-14T11:13:13.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.193+0000 7f3b27fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b0c003b90 0x7f3b2015fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:13.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.193+0000 7f3b27fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b2015cdb0 0x7f3b201f1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:13.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.193+0000 7f3b27fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b2015b2c0 0x7f3b200cef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:13.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.193+0000 7f3b27fff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b200cd780 con 0x7f3b0c003b90 2023-07-14T11:13:13.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.193+0000 7f3b27fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b201f2dd0 con 0x7f3b2015cdb0 2023-07-14T11:13:13.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.193+0000 7f3b27fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2015d220 con 0x7f3b2015b2c0 2023-07-14T11:13:13.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.194+0000 7f3b25d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b0c003b90 0x7f3b2015fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:13.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.194+0000 7f3b25d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b0c003b90 0x7f3b2015fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44236/0 (socket says 172.21.15.84:44236) 2023-07-14T11:13:13.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.194+0000 7f3b25d9b700 1 -- 172.21.15.84:0/1313694418 learned_addr learned my addr 172.21.15.84:0/1313694418 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:13.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.194+0000 7f3b2559a700 1 --2- 172.21.15.84:0/1313694418 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b2015cdb0 0x7f3b201f1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:13.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.194+0000 7f3b2659c700 1 --2- 172.21.15.84:0/1313694418 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b2015b2c0 0x7f3b200cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:13.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.194+0000 7f3b25d9b700 1 -- 172.21.15.84:0/1313694418 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b2015b2c0 msgr2=0x7f3b200cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:13.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.194+0000 7f3b25d9b700 1 --2- 172.21.15.84:0/1313694418 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b2015b2c0 0x7f3b200cef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:13.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.194+0000 7f3b25d9b700 1 -- 172.21.15.84:0/1313694418 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b2015cdb0 msgr2=0x7f3b201f1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:13.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.194+0000 7f3b25d9b700 1 --2- 172.21.15.84:0/1313694418 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b2015cdb0 0x7f3b201f1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:13.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.194+0000 7f3b25d9b700 1 -- 172.21.15.84:0/1313694418 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b201f22f0 con 0x7f3b0c003b90 2023-07-14T11:13:13.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.194+0000 7f3b25d9b700 1 --2- 172.21.15.84:0/1313694418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b0c003b90 0x7f3b2015fa80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c00a010 tx=0x7f3b1c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:13.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.195+0000 7f3b167fc700 1 -- 172.21.15.84:0/1313694418 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1c00e6c0 con 0x7f3b0c003b90 2023-07-14T11:13:13.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.195+0000 7f3b167fc700 1 -- 172.21.15.84:0/1313694418 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b1c003ad0 con 0x7f3b0c003b90 2023-07-14T11:13:13.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.195+0000 7f3b167fc700 1 -- 172.21.15.84:0/1313694418 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1c0045d0 con 0x7f3b0c003b90 2023-07-14T11:13:13.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.195+0000 7f3b27fff700 1 -- 172.21.15.84:0/1313694418 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b201f2530 con 0x7f3b0c003b90 2023-07-14T11:13:13.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.195+0000 7f3b27fff700 1 -- 172.21.15.84:0/1313694418 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b201f2af0 con 0x7f3b0c003b90 2023-07-14T11:13:13.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.196+0000 7f3b27fff700 1 -- 172.21.15.84:0/1313694418 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b200cd550 con 0x7f3b0c003b90 2023-07-14T11:13:13.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.197+0000 7f3b167fc700 1 -- 172.21.15.84:0/1313694418 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3b1c013470 con 0x7f3b0c003b90 2023-07-14T11:13:13.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.198+0000 7f3b167fc700 1 --2- 172.21.15.84:0/1313694418 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f3b0406ace0 0x7f3b0406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:13.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.198+0000 7f3b167fc700 1 -- 172.21.15.84:0/1313694418 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f3b1c08a920 con 0x7f3b0c003b90 2023-07-14T11:13:13.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.198+0000 7f3b2559a700 1 --2- 172.21.15.84:0/1313694418 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f3b0406ace0 0x7f3b0406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:13.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.198+0000 7f3b2559a700 1 --2- 172.21.15.84:0/1313694418 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f3b0406ace0 0x7f3b0406d190 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3b2015eb70 tx=0x7f3b10009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:13.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.202+0000 7f3b167fc700 1 -- 172.21.15.84:0/1313694418 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3b200cd550 con 0x7f3b0c003b90 2023-07-14T11:13:13.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.397+0000 7f3b27fff700 1 -- 172.21.15.84:0/1313694418 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f3b201f22f0 con 0x7f3b0c003b90 2023-07-14T11:13:13.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.964+0000 7f3b167fc700 1 -- 172.21.15.84:0/1313694418 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v21) v1 ==== 170+0+0 (secure 0 0 0) 0x7f3b201f22f0 con 0x7f3b0c003b90 2023-07-14T11:13:13.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.970+0000 7f3b27fff700 1 -- 172.21.15.84:0/1313694418 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f3b0406ace0 msgr2=0x7f3b0406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:13.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.970+0000 7f3b27fff700 1 --2- 172.21.15.84:0/1313694418 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f3b0406ace0 0x7f3b0406d190 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3b2015eb70 tx=0x7f3b10009040 comp rx=0 tx=0).stop 2023-07-14T11:13:13.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.970+0000 7f3b27fff700 1 -- 172.21.15.84:0/1313694418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b0c003b90 msgr2=0x7f3b2015fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:13.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.970+0000 7f3b27fff700 1 --2- 172.21.15.84:0/1313694418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b0c003b90 0x7f3b2015fa80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c00a010 tx=0x7f3b1c0047c0 comp rx=0 tx=0).stop 2023-07-14T11:13:13.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.973+0000 7f3b27fff700 1 -- 172.21.15.84:0/1313694418 shutdown_connections 2023-07-14T11:13:13.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.973+0000 7f3b27fff700 1 --2- 172.21.15.84:0/1313694418 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f3b0406ace0 0x7f3b0406d190 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:13.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.973+0000 7f3b27fff700 1 --2- 172.21.15.84:0/1313694418 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b2015b2c0 0x7f3b200cef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:13.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.973+0000 7f3b27fff700 1 --2- 172.21.15.84:0/1313694418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b0c003b90 0x7f3b2015fa80 secure :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c00a010 tx=0x7f3b1c0047c0 comp rx=0 tx=0).stop 2023-07-14T11:13:13.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.973+0000 7f3b27fff700 1 --2- 172.21.15.84:0/1313694418 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b2015cdb0 0x7f3b201f1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:13.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.973+0000 7f3b27fff700 1 -- 172.21.15.84:0/1313694418 >> 172.21.15.84:0/1313694418 conn(0x7f3b2009c1b0 msgr2=0x7f3b200b0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:13.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.976+0000 7f3b27fff700 1 -- 172.21.15.84:0/1313694418 shutdown_connections 2023-07-14T11:13:13.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:13.976+0000 7f3b27fff700 1 -- 172.21.15.84:0/1313694418 wait complete. 2023-07-14T11:13:13.985 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data' created 2023-07-14T11:13:14.006 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-14T11:13:14.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:14.203+0000 7fab7d1ff700 1 Processor -- start 2023-07-14T11:13:14.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:14.203+0000 7fab7d1ff700 1 -- start start 2023-07-14T11:13:14.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:14.204+0000 7fab7d1ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fab780b8a60 0x7fab780b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:14.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:14.204+0000 7fab7d1ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fab780b4530 0x7fab780d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:14.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:14.205+0000 7fab7d1ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab780d1490 con 0x7fab780d1050 2023-07-14T11:13:14.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:14.205+0000 7fab7d1ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab780b8e30 con 0x7fab780b4530 2023-07-14T11:13:14.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:14.205+0000 7fab7d1ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab780b1e30 con 0x7fab780b8a60 2023-07-14T11:13:14.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:14.205+0000 7fab7659c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fab780b4530 0x7fab780d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:14.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:14.205+0000 7fab7659c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fab780b4530 0x7fab780d0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44252/0 (socket says 172.21.15.84:44252) 2023-07-14T11:13:14.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:14.205+0000 7fab7659c700 1 -- 172.21.15.84:0/2894095077 learned_addr learned my addr 172.21.15.84:0/2894095077 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:14.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:14.205+0000 7fab76d9d700 1 --2- 172.21.15.84:0/2894095077 >> v2:172.21.15.179:3300/0 conn(0x7fab780b8a60 0x7fab780b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:14.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:14.205+0000 7fab7659c700 1 -- 172.21.15.84:0/2894095077 >> v2:172.21.15.179:3300/0 conn(0x7fab780b8a60 msgr2=0x7fab780b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:14.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:14.205+0000 7fab7659c700 1 --2- 172.21.15.84:0/2894095077 >> v2:172.21.15.179:3300/0 conn(0x7fab780b8a60 0x7fab780b3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:14.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:14.205+0000 7fab7659c700 1 -- 172.21.15.84:0/2894095077 >> v1:172.21.15.84:6789/0 conn(0x7fab780d1050 legacy=0x7fab780b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:14.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:14.205+0000 7fab7659c700 1 -- 172.21.15.84:0/2894095077 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab780afaa0 con 0x7fab780b4530 2023-07-14T11:13:14.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:14.205+0000 7fab75d9b700 1 -- 172.21.15.84:0/2894095077 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2495188715 0 0) 0x7fab780d1490 con 0x7fab780d1050 2023-07-14T11:13:14.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:14.206+0000 7fab7659c700 1 --2- 172.21.15.84:0/2894095077 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab780b4530 0x7fab780d0b10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fab780b5b00 tx=0x7fab6c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab5fae3c7fd40ff7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:14.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:14.206+0000 7fab75d9b700 1 -- 172.21.15.84:0/2894095077 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6c011830 con 0x7fab780b4530 2023-07-14T11:13:14.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:14.206+0000 7fab75d9b700 1 -- 172.21.15.84:0/2894095077 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab6c011990 con 0x7fab780b4530 2023-07-14T11:13:14.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:14.206+0000 7fab75d9b700 1 -- 172.21.15.84:0/2894095077 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6c011d20 con 0x7fab780b4530 2023-07-14T11:13:14.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:14.206+0000 7fab7d1ff700 1 -- 172.21.15.84:0/2894095077 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab780b4530 msgr2=0x7fab780d0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:14.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:14.206+0000 7fab7d1ff700 1 --2- 172.21.15.84:0/2894095077 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab780b4530 0x7fab780d0b10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fab780b5b00 tx=0x7fab6c009bd0 comp rx=0 tx=0).stop 2023-07-14T11:13:14.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:14.206+0000 7fab7d1ff700 1 -- 172.21.15.84:0/2894095077 shutdown_connections 2023-07-14T11:13:14.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:14.206+0000 7fab7d1ff700 1 --2- 172.21.15.84:0/2894095077 >> v2:172.21.15.179:3300/0 conn(0x7fab780b8a60 0x7fab780b3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:14.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:14.206+0000 7fab7d1ff700 1 --2- 172.21.15.84:0/2894095077 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab780b4530 0x7fab780d0b10 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:14.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:14.206+0000 7fab7d1ff700 1 -- 172.21.15.84:0/2894095077 >> 172.21.15.84:0/2894095077 conn(0x7fab7809c1b0 msgr2=0x7fab780d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:14.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:14.206+0000 7fab7d1ff700 1 -- 172.21.15.84:0/2894095077 shutdown_connections 2023-07-14T11:13:14.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:14.207+0000 7fab7d1ff700 1 -- 172.21.15.84:0/2894095077 wait complete. 2023-07-14T11:13:14.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:14.208+0000 7fab7d1ff700 1 Processor -- start 2023-07-14T11:13:14.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:14.208+0000 7fab7d1ff700 1 -- start start 2023-07-14T11:13:14.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:14.209+0000 7fab7d1ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab780b4530 0x7fab7814e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:14.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:14.209+0000 7fab7d1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab780b8a60 0x7fab780cc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:14.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:14.209+0000 7fab7d1ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab780d1050 0x7fab780cc720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:14.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:14.209+0000 7fab7d1ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab780cda20 con 0x7fab780d1050 2023-07-14T11:13:14.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:14.209+0000 7fab7d1ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab78151a90 con 0x7fab780b4530 2023-07-14T11:13:14.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:14.209+0000 7fab7d1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab7815f750 con 0x7fab780b8a60 2023-07-14T11:13:14.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:14.210+0000 7fab7759e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab780d1050 0x7fab780cc720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:14.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:14.210+0000 7fab7759e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab780d1050 0x7fab780cc720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44262/0 (socket says 172.21.15.84:44262) 2023-07-14T11:13:14.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:14.210+0000 7fab76d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab780b4530 0x7fab7814e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:14.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:14.210+0000 7fab7759e700 1 -- 172.21.15.84:0/1831435333 learned_addr learned my addr 172.21.15.84:0/1831435333 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:14.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:14.210+0000 7fab7659c700 1 --2- 172.21.15.84:0/1831435333 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab780b8a60 0x7fab780cc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:14.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:14.210+0000 7fab7759e700 1 -- 172.21.15.84:0/1831435333 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab780b8a60 msgr2=0x7fab780cc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:14.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:14.210+0000 7fab7759e700 1 --2- 172.21.15.84:0/1831435333 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab780b8a60 0x7fab780cc1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:14.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:14.210+0000 7fab7759e700 1 -- 172.21.15.84:0/1831435333 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab780b4530 msgr2=0x7fab7814e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:14.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:14.210+0000 7fab7759e700 1 --2- 172.21.15.84:0/1831435333 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab780b4530 0x7fab7814e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:14.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:14.210+0000 7fab7759e700 1 -- 172.21.15.84:0/1831435333 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab6c009550 con 0x7fab780d1050 2023-07-14T11:13:14.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:14.210+0000 7fab7759e700 1 --2- 172.21.15.84:0/1831435333 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab780d1050 0x7fab780cc720 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fab7000c7a0 tx=0x7fab7000cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:14.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:14.210+0000 7fab5f7fe700 1 -- 172.21.15.84:0/1831435333 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab70003e30 con 0x7fab780d1050 2023-07-14T11:13:14.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:14.211+0000 7fab5f7fe700 1 -- 172.21.15.84:0/1831435333 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab70005070 con 0x7fab780d1050 2023-07-14T11:13:14.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:14.211+0000 7fab7d1ff700 1 -- 172.21.15.84:0/1831435333 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab780cd680 con 0x7fab780d1050 2023-07-14T11:13:14.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:14.211+0000 7fab5f7fe700 1 -- 172.21.15.84:0/1831435333 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab70005420 con 0x7fab780d1050 2023-07-14T11:13:14.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:14.211+0000 7fab7d1ff700 1 -- 172.21.15.84:0/1831435333 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab7815f470 con 0x7fab780d1050 2023-07-14T11:13:14.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:14.212+0000 7fab7d1ff700 1 -- 172.21.15.84:0/1831435333 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab780cdb60 con 0x7fab780d1050 2023-07-14T11:13:14.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:14.213+0000 7fab5f7fe700 1 -- 172.21.15.84:0/1831435333 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fab70005580 con 0x7fab780d1050 2023-07-14T11:13:14.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:14.213+0000 7fab5f7fe700 1 --2- 172.21.15.84:0/1831435333 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fab6406ace0 0x7fab6406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:14.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:14.214+0000 7fab5f7fe700 1 -- 172.21.15.84:0/1831435333 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5962+0+0 (secure 0 0 0) 0x7fab700889e0 con 0x7fab780d1050 2023-07-14T11:13:14.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:14.214+0000 7fab76d9d700 1 --2- 172.21.15.84:0/1831435333 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fab6406ace0 0x7fab6406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:14.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:14.214+0000 7fab76d9d700 1 --2- 172.21.15.84:0/1831435333 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fab6406ace0 0x7fab6406d190 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fab68009be0 tx=0x7fab68009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:14.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:14.218+0000 7fab5f7fe700 1 -- 172.21.15.84:0/1831435333 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fab780cdb60 con 0x7fab780d1050 2023-07-14T11:13:14.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:14.456+0000 7fab7d1ff700 1 -- 172.21.15.84:0/1831435333 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fab780cdb60 con 0x7fab780d1050 2023-07-14T11:13:15.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:14.998+0000 7fab5f7fe700 1 -- 172.21.15.84:0/1831435333 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fab780cdb60 con 0x7fab780d1050 2023-07-14T11:13:15.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.006+0000 7fab7d1ff700 1 -- 172.21.15.84:0/1831435333 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fab6406ace0 msgr2=0x7fab6406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:15.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.006+0000 7fab7d1ff700 1 --2- 172.21.15.84:0/1831435333 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fab6406ace0 0x7fab6406d190 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fab68009be0 tx=0x7fab68009210 comp rx=0 tx=0).stop 2023-07-14T11:13:15.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.006+0000 7fab7d1ff700 1 -- 172.21.15.84:0/1831435333 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab780d1050 msgr2=0x7fab780cc720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:15.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.006+0000 7fab7d1ff700 1 --2- 172.21.15.84:0/1831435333 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab780d1050 0x7fab780cc720 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fab7000c7a0 tx=0x7fab7000cab0 comp rx=0 tx=0).stop 2023-07-14T11:13:15.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.008+0000 7fab7d1ff700 1 -- 172.21.15.84:0/1831435333 shutdown_connections 2023-07-14T11:13:15.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.008+0000 7fab7d1ff700 1 --2- 172.21.15.84:0/1831435333 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab780d1050 0x7fab780cc720 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:15.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.008+0000 7fab7d1ff700 1 --2- 172.21.15.84:0/1831435333 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab780b4530 0x7fab7814e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:15.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.008+0000 7fab7d1ff700 1 --2- 172.21.15.84:0/1831435333 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fab6406ace0 0x7fab6406d190 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:15.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.008+0000 7fab7d1ff700 1 --2- 172.21.15.84:0/1831435333 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab780b8a60 0x7fab780cc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:15.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.008+0000 7fab7d1ff700 1 -- 172.21.15.84:0/1831435333 >> 172.21.15.84:0/1831435333 conn(0x7fab7809c1b0 msgr2=0x7fab7815c480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:15.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.014+0000 7fab7d1ff700 1 -- 172.21.15.84:0/1831435333 shutdown_connections 2023-07-14T11:13:15.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.018+0000 7fab7d1ff700 1 -- 172.21.15.84:0/1831435333 wait complete. 2023-07-14T11:13:15.022 INFO:teuthology.orchestra.run.smithi084.stderr:new fs with metadata pool 3 and data pool 4 2023-07-14T11:13:15.042 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:13:15.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.237+0000 7f7538fff700 1 Processor -- start 2023-07-14T11:13:15.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.237+0000 7f7538fff700 1 -- start start 2023-07-14T11:13:15.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.238+0000 7f7538fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f753415c710 0x7f75340cf510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:15.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.238+0000 7f7538fff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75340cd320 con 0x7f7534069f30 2023-07-14T11:13:15.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.239+0000 7f7538fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75340ce750 con 0x7f753406db30 2023-07-14T11:13:15.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.239+0000 7f7538fff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75340cea30 con 0x7f753415c710 2023-07-14T11:13:15.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.239+0000 7f753259c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f753415c710 0x7f75340cf510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:15.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.239+0000 7f753259c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f753415c710 0x7f75340cf510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44270/0 (socket says 172.21.15.84:44270) 2023-07-14T11:13:15.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.239+0000 7f7531d9b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f7534069f30 0x7f753406d420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:43220/0 (socket says 172.21.15.84:43220) 2023-07-14T11:13:15.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.239+0000 7f753259c700 1 -- 172.21.15.84:0/3069600026 learned_addr learned my addr 172.21.15.84:0/3069600026 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:15.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.239+0000 7f753259c700 1 -- 172.21.15.84:0/3069600026 >> v1:172.21.15.179:6789/0 conn(0x7f753406db30 legacy=0x7f7534070950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:15.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.239+0000 7f753259c700 1 -- 172.21.15.84:0/3069600026 >> v1:172.21.15.84:6789/0 conn(0x7f7534069f30 legacy=0x7f753406d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:15.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.239+0000 7f753259c700 1 -- 172.21.15.84:0/3069600026 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75340ced10 con 0x7f753415c710 2023-07-14T11:13:15.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.239+0000 7f753259c700 1 --2- 172.21.15.84:0/3069600026 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f753415c710 0x7f75340cf510 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f75240098f0 tx=0x7f7524009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a5b6c0446b59e9e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:15.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.240+0000 7f753159a700 1 -- 172.21.15.84:0/3069600026 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7524004230 con 0x7f753415c710 2023-07-14T11:13:15.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.240+0000 7f753159a700 1 -- 172.21.15.84:0/3069600026 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7524004390 con 0x7f753415c710 2023-07-14T11:13:15.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.240+0000 7f753159a700 1 -- 172.21.15.84:0/3069600026 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75240036a0 con 0x7f753415c710 2023-07-14T11:13:15.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.240+0000 7f7538fff700 1 -- 172.21.15.84:0/3069600026 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f753415c710 msgr2=0x7f75340cf510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:15.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.240+0000 7f7538fff700 1 --2- 172.21.15.84:0/3069600026 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f753415c710 0x7f75340cf510 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f75240098f0 tx=0x7f7524009c00 comp rx=0 tx=0).stop 2023-07-14T11:13:15.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.240+0000 7f7538fff700 1 -- 172.21.15.84:0/3069600026 shutdown_connections 2023-07-14T11:13:15.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.240+0000 7f7538fff700 1 --2- 172.21.15.84:0/3069600026 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f753415c710 0x7f75340cf510 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:15.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.240+0000 7f7538fff700 1 -- 172.21.15.84:0/3069600026 >> 172.21.15.84:0/3069600026 conn(0x7f75340b16c0 msgr2=0x7f75340b1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:15.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.240+0000 7f7538fff700 1 -- 172.21.15.84:0/3069600026 shutdown_connections 2023-07-14T11:13:15.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.240+0000 7f7538fff700 1 -- 172.21.15.84:0/3069600026 wait complete. 2023-07-14T11:13:15.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.242+0000 7f7538fff700 1 Processor -- start 2023-07-14T11:13:15.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.242+0000 7f7538fff700 1 -- start start 2023-07-14T11:13:15.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.243+0000 7f7538fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7534069f30 0x7f75340b5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:15.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.243+0000 7f7538fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f753406db30 0x7f7534147e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:15.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.243+0000 7f7538fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75340b3990 0x7f75340b3e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:15.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.243+0000 7f7538fff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75340b59c0 con 0x7f753406db30 2023-07-14T11:13:15.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.243+0000 7f7538fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75340b43e0 con 0x7f75340b3990 2023-07-14T11:13:15.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.243+0000 7f7538fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75340b46c0 con 0x7f7534069f30 2023-07-14T11:13:15.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.243+0000 7f7531d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f753406db30 0x7f7534147e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:15.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.243+0000 7f7531d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f753406db30 0x7f7534147e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44286/0 (socket says 172.21.15.84:44286) 2023-07-14T11:13:15.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.243+0000 7f7531d9b700 1 -- 172.21.15.84:0/310100357 learned_addr learned my addr 172.21.15.84:0/310100357 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:15.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.244+0000 7f753259c700 1 --2- 172.21.15.84:0/310100357 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7534069f30 0x7f75340b5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:15.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.244+0000 7f7532d9d700 1 --2- 172.21.15.84:0/310100357 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75340b3990 0x7f75340b3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:15.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.244+0000 7f7531d9b700 1 -- 172.21.15.84:0/310100357 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7534069f30 msgr2=0x7f75340b5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:15.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.244+0000 7f7531d9b700 1 --2- 172.21.15.84:0/310100357 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7534069f30 0x7f75340b5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:15.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.244+0000 7f7531d9b700 1 -- 172.21.15.84:0/310100357 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75340b3990 msgr2=0x7f75340b3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:15.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.244+0000 7f7531d9b700 1 --2- 172.21.15.84:0/310100357 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75340b3990 0x7f75340b3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:15.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.244+0000 7f7531d9b700 1 -- 172.21.15.84:0/310100357 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7524009550 con 0x7f753406db30 2023-07-14T11:13:15.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.244+0000 7f753259c700 1 --2- 172.21.15.84:0/310100357 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7534069f30 0x7f75340b5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:13:15.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.244+0000 7f7532d9d700 1 --2- 172.21.15.84:0/310100357 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75340b3990 0x7f75340b3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:13:15.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.244+0000 7f7531d9b700 1 --2- 172.21.15.84:0/310100357 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f753406db30 0x7f7534147e80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f752800c490 tx=0x7f752800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:15.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.244+0000 7f7522ffd700 1 -- 172.21.15.84:0/310100357 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7528005cb0 con 0x7f753406db30 2023-07-14T11:13:15.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.244+0000 7f7522ffd700 1 -- 172.21.15.84:0/310100357 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7528005e10 con 0x7f753406db30 2023-07-14T11:13:15.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.244+0000 7f7538fff700 1 -- 172.21.15.84:0/310100357 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f753406ac20 con 0x7f753406db30 2023-07-14T11:13:15.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.244+0000 7f7522ffd700 1 -- 172.21.15.84:0/310100357 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75280072d0 con 0x7f753406db30 2023-07-14T11:13:15.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.244+0000 7f7538fff700 1 -- 172.21.15.84:0/310100357 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75340b4c80 con 0x7f753406db30 2023-07-14T11:13:15.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.245+0000 7f7538fff700 1 -- 172.21.15.84:0/310100357 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f753404e280 con 0x7f753406db30 2023-07-14T11:13:15.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.246+0000 7f7522ffd700 1 -- 172.21.15.84:0/310100357 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7528007430 con 0x7f753406db30 2023-07-14T11:13:15.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.247+0000 7f7522ffd700 1 --2- 172.21.15.84:0/310100357 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f751406ace0 0x7f751406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:15.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.247+0000 7f7522ffd700 1 -- 172.21.15.84:0/310100357 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f75280888c0 con 0x7f753406db30 2023-07-14T11:13:15.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.247+0000 7f753259c700 1 --2- 172.21.15.84:0/310100357 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f751406ace0 0x7f751406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:15.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.248+0000 7f753259c700 1 --2- 172.21.15.84:0/310100357 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f751406ace0 0x7f751406d190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7524009c40 tx=0x7f7524008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:15.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.252+0000 7f7522ffd700 1 -- 172.21.15.84:0/310100357 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7528053980 con 0x7f753406db30 2023-07-14T11:13:15.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.448+0000 7f7538fff700 1 -- 172.21.15.84:0/310100357 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f75340678a0 con 0x7f753406db30 2023-07-14T11:13:15.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.449+0000 7f7522ffd700 1 -- 172.21.15.84:0/310100357 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+18268 (secure 0 0 0) 0x7f7528017090 con 0x7f753406db30 2023-07-14T11:13:15.452 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:13:15.452 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":22,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:13:14.457377+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-14T11:13:12.727811+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-14T11:13:13.436391+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:13:15.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.452+0000 7f7538fff700 1 -- 172.21.15.84:0/310100357 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f751406ace0 msgr2=0x7f751406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:15.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.452+0000 7f7538fff700 1 --2- 172.21.15.84:0/310100357 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f751406ace0 0x7f751406d190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7524009c40 tx=0x7f7524008030 comp rx=0 tx=0).stop 2023-07-14T11:13:15.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.452+0000 7f7538fff700 1 -- 172.21.15.84:0/310100357 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f753406db30 msgr2=0x7f7534147e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:15.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.452+0000 7f7538fff700 1 --2- 172.21.15.84:0/310100357 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f753406db30 0x7f7534147e80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f752800c490 tx=0x7f752800c850 comp rx=0 tx=0).stop 2023-07-14T11:13:15.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.452+0000 7f7538fff700 1 -- 172.21.15.84:0/310100357 shutdown_connections 2023-07-14T11:13:15.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.452+0000 7f7538fff700 1 --2- 172.21.15.84:0/310100357 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f751406ace0 0x7f751406d190 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:15.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.452+0000 7f7538fff700 1 --2- 172.21.15.84:0/310100357 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7534069f30 0x7f75340b5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:15.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.452+0000 7f7538fff700 1 --2- 172.21.15.84:0/310100357 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75340b3990 0x7f75340b3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:15.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.452+0000 7f7538fff700 1 --2- 172.21.15.84:0/310100357 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f753406db30 0x7f7534147e80 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:15.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.452+0000 7f7538fff700 1 -- 172.21.15.84:0/310100357 >> 172.21.15.84:0/310100357 conn(0x7f75340b16c0 msgr2=0x7f75340af550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:15.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.452+0000 7f7538fff700 1 -- 172.21.15.84:0/310100357 shutdown_connections 2023-07-14T11:13:15.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.452+0000 7f7538fff700 1 -- 172.21.15.84:0/310100357 wait complete. 2023-07-14T11:13:15.472 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:13:15.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.664+0000 7f3b0d3ff700 1 Processor -- start 2023-07-14T11:13:15.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.664+0000 7f3b0d3ff700 1 -- start start 2023-07-14T11:13:15.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.665+0000 7f3b0d3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b080b4510 0x7f3b080b6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:15.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.665+0000 7f3b0d3ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3b080d0b10 0x7f3b080d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:15.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.665+0000 7f3b0d3ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b080b7f50 con 0x7f3b080b5d90 2023-07-14T11:13:15.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.665+0000 7f3b0d3ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b080b48e0 con 0x7f3b080d0b10 2023-07-14T11:13:15.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.665+0000 7f3b0d3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b080d14d0 con 0x7f3b080b4510 2023-07-14T11:13:15.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.666+0000 7f3b06ffd700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b080b4510 0x7f3b080b6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:15.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.666+0000 7f3b067fc700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f3b080b5d90 0x7f3b080cd590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.84:42986/0 (socket says 172.21.15.84:42986) 2023-07-14T11:13:15.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.666+0000 7f3b067fc700 1 -- 172.21.15.84:0/193785043 learned_addr learned my addr 172.21.15.84:0/193785043 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:13:15.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.666+0000 7f3b077fe700 1 --2- 172.21.15.84:0/193785043 >> v2:172.21.15.179:3300/0 conn(0x7f3b080d0b10 0x7f3b080d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:15.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.666+0000 7f3b06ffd700 1 -- 172.21.15.84:0/193785043 >> v2:172.21.15.179:3300/0 conn(0x7f3b080d0b10 msgr2=0x7f3b080d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:15.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.666+0000 7f3b06ffd700 1 --2- 172.21.15.84:0/193785043 >> v2:172.21.15.179:3300/0 conn(0x7f3b080d0b10 0x7f3b080d0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:15.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.666+0000 7f3b06ffd700 1 -- 172.21.15.84:0/193785043 >> v1:172.21.15.179:6789/0 conn(0x7f3b080b5d90 legacy=0x7f3b080cd590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:15.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.666+0000 7f3b05ffb700 1 -- 172.21.15.84:0/193785043 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3355157325 0 0) 0x7f3b080b7f50 con 0x7f3b080b5d90 2023-07-14T11:13:15.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.666+0000 7f3b06ffd700 1 -- 172.21.15.84:0/193785043 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b080cdca0 con 0x7f3b080b4510 2023-07-14T11:13:15.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.666+0000 7f3b06ffd700 1 --2- 172.21.15.84:0/193785043 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b080b4510 0x7f3b080b6c80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3af8009820 tx=0x7f3af8009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80556499cb2bf00d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:15.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.667+0000 7f3b05ffb700 1 -- 172.21.15.84:0/193785043 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af8005e30 con 0x7f3b080b4510 2023-07-14T11:13:15.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.667+0000 7f3b05ffb700 1 -- 172.21.15.84:0/193785043 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3af8006030 con 0x7f3b080b4510 2023-07-14T11:13:15.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.667+0000 7f3b05ffb700 1 -- 172.21.15.84:0/193785043 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af80063c0 con 0x7f3b080b4510 2023-07-14T11:13:15.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.667+0000 7f3b0d3ff700 1 -- 172.21.15.84:0/193785043 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b080b4510 msgr2=0x7f3b080b6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:15.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.667+0000 7f3b0d3ff700 1 --2- 172.21.15.84:0/193785043 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b080b4510 0x7f3b080b6c80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3af8009820 tx=0x7f3af8009b30 comp rx=0 tx=0).stop 2023-07-14T11:13:15.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.667+0000 7f3b0d3ff700 1 -- 172.21.15.84:0/193785043 shutdown_connections 2023-07-14T11:13:15.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.667+0000 7f3b0d3ff700 1 --2- 172.21.15.84:0/193785043 >> v2:172.21.15.179:3300/0 conn(0x7f3b080d0b10 0x7f3b080d0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:15.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.667+0000 7f3b0d3ff700 1 --2- 172.21.15.84:0/193785043 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b080b4510 0x7f3b080b6c80 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:15.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.667+0000 7f3b0d3ff700 1 -- 172.21.15.84:0/193785043 >> 172.21.15.84:0/193785043 conn(0x7f3b0809c1d0 msgr2=0x7f3b080d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:15.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.667+0000 7f3b0d3ff700 1 -- 172.21.15.84:0/193785043 shutdown_connections 2023-07-14T11:13:15.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.668+0000 7f3b0d3ff700 1 -- 172.21.15.84:0/193785043 wait complete. 2023-07-14T11:13:15.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.669+0000 7f3b0d3ff700 1 Processor -- start 2023-07-14T11:13:15.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.669+0000 7f3b0d3ff700 1 -- start start 2023-07-14T11:13:15.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.670+0000 7f3b0d3ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b080b4510 0x7f3b081f4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:15.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.670+0000 7f3b0d3ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b080b5d90 0x7f3b0806b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:15.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.670+0000 7f3b0d3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b080d0b10 0x7f3b0806be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:15.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.670+0000 7f3b0d3ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b081f5270 con 0x7f3b080b5d90 2023-07-14T11:13:15.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.670+0000 7f3b0d3ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b081563c0 con 0x7f3b080b4510 2023-07-14T11:13:15.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.670+0000 7f3b0d3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b081566a0 con 0x7f3b080d0b10 2023-07-14T11:13:15.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.671+0000 7f3b067fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b080b5d90 0x7f3b0806b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:15.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.671+0000 7f3b06ffd700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b080b4510 0x7f3b081f4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:15.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.671+0000 7f3b067fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b080b5d90 0x7f3b0806b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44288/0 (socket says 172.21.15.84:44288) 2023-07-14T11:13:15.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.671+0000 7f3b067fc700 1 -- 172.21.15.84:0/63832192 learned_addr learned my addr 172.21.15.84:0/63832192 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:15.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.671+0000 7f3b077fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b080d0b10 0x7f3b0806be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:15.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.671+0000 7f3b067fc700 1 -- 172.21.15.84:0/63832192 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b080d0b10 msgr2=0x7f3b0806be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:15.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.671+0000 7f3b067fc700 1 --2- 172.21.15.84:0/63832192 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b080d0b10 0x7f3b0806be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:15.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.671+0000 7f3b067fc700 1 -- 172.21.15.84:0/63832192 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b080b4510 msgr2=0x7f3b081f4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:15.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.671+0000 7f3b067fc700 1 --2- 172.21.15.84:0/63832192 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b080b4510 0x7f3b081f4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:15.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.671+0000 7f3b067fc700 1 -- 172.21.15.84:0/63832192 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af8009430 con 0x7f3b080b5d90 2023-07-14T11:13:15.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.671+0000 7f3b067fc700 1 --2- 172.21.15.84:0/63832192 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b080b5d90 0x7f3b0806b8c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3afc0011e0 tx=0x7f3afc00ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:15.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.671+0000 7f3aef7fe700 1 -- 172.21.15.84:0/63832192 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3afc004c80 con 0x7f3b080b5d90 2023-07-14T11:13:15.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.671+0000 7f3aef7fe700 1 -- 172.21.15.84:0/63832192 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3afc004e00 con 0x7f3b080b5d90 2023-07-14T11:13:15.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.671+0000 7f3aef7fe700 1 -- 172.21.15.84:0/63832192 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3afc007310 con 0x7f3b080b5d90 2023-07-14T11:13:15.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.671+0000 7f3b0d3ff700 1 -- 172.21.15.84:0/63832192 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b08156980 con 0x7f3b080b5d90 2023-07-14T11:13:15.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.672+0000 7f3b0d3ff700 1 -- 172.21.15.84:0/63832192 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b08156f40 con 0x7f3b080b5d90 2023-07-14T11:13:15.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.673+0000 7f3b0d3ff700 1 -- 172.21.15.84:0/63832192 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b08157160 con 0x7f3b080b5d90 2023-07-14T11:13:15.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.673+0000 7f3aef7fe700 1 -- 172.21.15.84:0/63832192 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3afc007470 con 0x7f3b080b5d90 2023-07-14T11:13:15.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.674+0000 7f3aef7fe700 1 --2- 172.21.15.84:0/63832192 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f3af406ace0 0x7f3af406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:15.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.674+0000 7f3aef7fe700 1 -- 172.21.15.84:0/63832192 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3afc089020 con 0x7f3b080b5d90 2023-07-14T11:13:15.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.675+0000 7f3b06ffd700 1 --2- 172.21.15.84:0/63832192 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f3af406ace0 0x7f3af406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:15.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.675+0000 7f3b06ffd700 1 --2- 172.21.15.84:0/63832192 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f3af406ace0 0x7f3af406d190 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3af8000c00 tx=0x7f3af8008070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:15.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.678+0000 7f3aef7fe700 1 -- 172.21.15.84:0/63832192 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3afc054160 con 0x7f3b080b5d90 2023-07-14T11:13:15.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.873+0000 7f3b0d3ff700 1 -- 172.21.15.84:0/63832192 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3b0804e280 con 0x7f3b080b5d90 2023-07-14T11:13:15.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.874+0000 7f3aef7fe700 1 -- 172.21.15.84:0/63832192 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+18268 (secure 0 0 0) 0x7f3afc057780 con 0x7f3b080b5d90 2023-07-14T11:13:15.876 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:13:15.877 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":22,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:13:14.457377+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-14T11:13:12.727811+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-14T11:13:13.436391+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:13:15.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.876+0000 7f3b0d3ff700 1 -- 172.21.15.84:0/63832192 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f3af406ace0 msgr2=0x7f3af406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:15.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.876+0000 7f3b0d3ff700 1 --2- 172.21.15.84:0/63832192 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f3af406ace0 0x7f3af406d190 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3af8000c00 tx=0x7f3af8008070 comp rx=0 tx=0).stop 2023-07-14T11:13:15.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.876+0000 7f3b0d3ff700 1 -- 172.21.15.84:0/63832192 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b080b5d90 msgr2=0x7f3b0806b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:15.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.876+0000 7f3b0d3ff700 1 --2- 172.21.15.84:0/63832192 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b080b5d90 0x7f3b0806b8c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3afc0011e0 tx=0x7f3afc00ca30 comp rx=0 tx=0).stop 2023-07-14T11:13:15.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.876+0000 7f3b0d3ff700 1 -- 172.21.15.84:0/63832192 shutdown_connections 2023-07-14T11:13:15.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.876+0000 7f3b0d3ff700 1 --2- 172.21.15.84:0/63832192 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f3af406ace0 0x7f3af406d190 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:15.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.876+0000 7f3b0d3ff700 1 --2- 172.21.15.84:0/63832192 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b080d0b10 0x7f3b0806be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:15.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.876+0000 7f3b0d3ff700 1 --2- 172.21.15.84:0/63832192 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b080b4510 0x7f3b081f4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:15.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.876+0000 7f3b0d3ff700 1 --2- 172.21.15.84:0/63832192 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b080b5d90 0x7f3b0806b8c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:15.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.876+0000 7f3b0d3ff700 1 -- 172.21.15.84:0/63832192 >> 172.21.15.84:0/63832192 conn(0x7f3b0809c1d0 msgr2=0x7f3b080ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:15.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.876+0000 7f3b0d3ff700 1 -- 172.21.15.84:0/63832192 shutdown_connections 2023-07-14T11:13:15.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:15.876+0000 7f3b0d3ff700 1 -- 172.21.15.84:0/63832192 wait complete. 2023-07-14T11:13:15.896 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-14T11:13:16.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:16.097+0000 7f55833ff700 1 Processor -- start 2023-07-14T11:13:16.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:16.097+0000 7f55833ff700 1 -- start start 2023-07-14T11:13:16.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:16.098+0000 7f55833ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f557c0b8a60 0x7f557c0b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:16.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:16.098+0000 7f55833ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f557c0b4530 0x7f557c0d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:16.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:16.098+0000 7f55833ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f557c0b8e30 con 0x7f557c0d1050 2023-07-14T11:13:16.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:16.098+0000 7f55833ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f557c0d14d0 con 0x7f557c0b4530 2023-07-14T11:13:16.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:16.098+0000 7f55833ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f557c0b1e30 con 0x7f557c0b8a60 2023-07-14T11:13:16.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:16.099+0000 7f558099a700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f557c0b4530 0x7f557c0d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:16.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:16.099+0000 7f558119b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f557c0b8a60 0x7f557c0b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:16.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:16.099+0000 7f558199c700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f557c0d1050 0x7f557c0b25d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.84:43000/0 (socket says 172.21.15.84:43000) 2023-07-14T11:13:16.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:16.099+0000 7f558199c700 1 -- 172.21.15.84:0/475602711 learned_addr learned my addr 172.21.15.84:0/475602711 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:13:16.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:16.099+0000 7f5573fff700 1 -- 172.21.15.84:0/475602711 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1965940485 0 0) 0x7f557c0b8e30 con 0x7f557c0d1050 2023-07-14T11:13:16.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:16.099+0000 7f5573fff700 1 -- 172.21.15.84:0/475602711 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55680035b0 con 0x7f557c0d1050 2023-07-14T11:13:16.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:16.099+0000 7f558119b700 1 -- 172.21.15.84:0/475602711 >> v2:172.21.15.179:3300/0 conn(0x7f557c0b4530 msgr2=0x7f557c0d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:16.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:16.099+0000 7f558119b700 1 --2- 172.21.15.84:0/475602711 >> v2:172.21.15.179:3300/0 conn(0x7f557c0b4530 0x7f557c0d0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:16.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:16.099+0000 7f558119b700 1 -- 172.21.15.84:0/475602711 >> v1:172.21.15.179:6789/0 conn(0x7f557c0d1050 legacy=0x7f557c0b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:16.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:16.099+0000 7f558119b700 1 -- 172.21.15.84:0/475602711 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f557c0afaa0 con 0x7f557c0b8a60 2023-07-14T11:13:16.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:16.100+0000 7f558119b700 1 --2- 172.21.15.84:0/475602711 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f557c0b8a60 0x7f557c0b3ff0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5578009840 tx=0x7f5578009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26de8b151d809e3d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:16.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:16.100+0000 7f5573fff700 1 -- 172.21.15.84:0/475602711 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5578011830 con 0x7f557c0b8a60 2023-07-14T11:13:16.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:16.100+0000 7f5573fff700 1 -- 172.21.15.84:0/475602711 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5578011990 con 0x7f557c0b8a60 2023-07-14T11:13:16.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:16.100+0000 7f5573fff700 1 -- 172.21.15.84:0/475602711 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5578011d20 con 0x7f557c0b8a60 2023-07-14T11:13:16.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:16.100+0000 7f55833ff700 1 -- 172.21.15.84:0/475602711 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f557c0b8a60 msgr2=0x7f557c0b3ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:16.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:16.100+0000 7f55833ff700 1 --2- 172.21.15.84:0/475602711 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f557c0b8a60 0x7f557c0b3ff0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5578009840 tx=0x7f5578009b50 comp rx=0 tx=0).stop 2023-07-14T11:13:16.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:16.100+0000 7f55833ff700 1 -- 172.21.15.84:0/475602711 shutdown_connections 2023-07-14T11:13:16.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:16.100+0000 7f55833ff700 1 --2- 172.21.15.84:0/475602711 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f557c0b8a60 0x7f557c0b3ff0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:16.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:16.100+0000 7f55833ff700 1 --2- 172.21.15.84:0/475602711 >> v2:172.21.15.179:3300/0 conn(0x7f557c0b4530 0x7f557c0d0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:16.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:16.100+0000 7f55833ff700 1 -- 172.21.15.84:0/475602711 >> 172.21.15.84:0/475602711 conn(0x7f557c09c1b0 msgr2=0x7f557c0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:16.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:16.101+0000 7f55833ff700 1 -- 172.21.15.84:0/475602711 shutdown_connections 2023-07-14T11:13:16.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:16.101+0000 7f55833ff700 1 -- 172.21.15.84:0/475602711 wait complete. 2023-07-14T11:13:16.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:16.102+0000 7f55833ff700 1 Processor -- start 2023-07-14T11:13:16.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:16.102+0000 7f55833ff700 1 -- start start 2023-07-14T11:13:16.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:16.103+0000 7f55833ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f557c0b4530 0x7f557c1f63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:16.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:16.103+0000 7f55833ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f557c0b8a60 0x7f557c1f21d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:16.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:16.103+0000 7f55833ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f557c0d1050 0x7f557c0cf480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:16.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:16.103+0000 7f55833ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f557c15d140 con 0x7f557c0b8a60 2023-07-14T11:13:16.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:16.103+0000 7f55833ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f557c1f28a0 con 0x7f557c0d1050 2023-07-14T11:13:16.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:16.103+0000 7f55833ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f557c1f2b80 con 0x7f557c0b4530 2023-07-14T11:13:16.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:16.103+0000 7f558099a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f557c0b8a60 0x7f557c1f21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:16.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:16.104+0000 7f558099a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f557c0b8a60 0x7f557c1f21d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44298/0 (socket says 172.21.15.84:44298) 2023-07-14T11:13:16.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:16.104+0000 7f558099a700 1 -- 172.21.15.84:0/222289831 learned_addr learned my addr 172.21.15.84:0/222289831 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:16.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:16.104+0000 7f558199c700 1 --2- 172.21.15.84:0/222289831 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f557c0d1050 0x7f557c0cf480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:16.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:16.104+0000 7f558119b700 1 --2- 172.21.15.84:0/222289831 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f557c0b4530 0x7f557c1f63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:16.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:16.104+0000 7f558099a700 1 -- 172.21.15.84:0/222289831 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f557c0b4530 msgr2=0x7f557c1f63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:16.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:16.104+0000 7f558099a700 1 --2- 172.21.15.84:0/222289831 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f557c0b4530 0x7f557c1f63e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:16.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:16.104+0000 7f558099a700 1 -- 172.21.15.84:0/222289831 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f557c0d1050 msgr2=0x7f557c0cf480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:16.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:16.104+0000 7f558099a700 1 --2- 172.21.15.84:0/222289831 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f557c0d1050 0x7f557c0cf480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:16.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:16.104+0000 7f558099a700 1 -- 172.21.15.84:0/222289831 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55780094a0 con 0x7f557c0b8a60 2023-07-14T11:13:16.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:16.104+0000 7f558099a700 1 --2- 172.21.15.84:0/222289831 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f557c0b8a60 0x7f557c1f21d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f556c00e9b0 tx=0x7f556c00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:16.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:16.104+0000 7f5571ffb700 1 -- 172.21.15.84:0/222289831 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f556c009710 con 0x7f557c0b8a60 2023-07-14T11:13:16.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:16.104+0000 7f5571ffb700 1 -- 172.21.15.84:0/222289831 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f556c00ee50 con 0x7f557c0b8a60 2023-07-14T11:13:16.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:16.104+0000 7f55833ff700 1 -- 172.21.15.84:0/222289831 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f557c1f2e60 con 0x7f557c0b8a60 2023-07-14T11:13:16.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:16.105+0000 7f5571ffb700 1 -- 172.21.15.84:0/222289831 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f556c00ca50 con 0x7f557c0b8a60 2023-07-14T11:13:16.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:16.105+0000 7f55833ff700 1 -- 172.21.15.84:0/222289831 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f557c1f3140 con 0x7f557c0b8a60 2023-07-14T11:13:16.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:16.106+0000 7f55833ff700 1 -- 172.21.15.84:0/222289831 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f557c074350 con 0x7f557c0b8a60 2023-07-14T11:13:16.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:16.107+0000 7f5571ffb700 1 -- 172.21.15.84:0/222289831 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f556c00cbb0 con 0x7f557c0b8a60 2023-07-14T11:13:16.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:16.108+0000 7f5571ffb700 1 --2- 172.21.15.84:0/222289831 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f556006ace0 0x7f556006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:16.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:16.108+0000 7f5571ffb700 1 -- 172.21.15.84:0/222289831 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f556c089540 con 0x7f557c0b8a60 2023-07-14T11:13:16.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:16.108+0000 7f558119b700 1 --2- 172.21.15.84:0/222289831 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f556006ace0 0x7f556006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:16.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:16.109+0000 7f558119b700 1 --2- 172.21.15.84:0/222289831 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f556006ace0 0x7f556006d190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5578000c00 tx=0x7f5578008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:16.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:16.112+0000 7f5571ffb700 1 -- 172.21.15.84:0/222289831 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f556c057fe0 con 0x7f557c0b8a60 2023-07-14T11:13:16.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:16.348+0000 7f55833ff700 1 -- 172.21.15.84:0/222289831 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f557c0b2000 con 0x7f557c0b8a60 2023-07-14T11:13:17.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.003+0000 7f5571ffb700 1 -- 172.21.15.84:0/222289831 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f556c00ce60 con 0x7f557c0b8a60 2023-07-14T11:13:17.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.005+0000 7f55833ff700 1 -- 172.21.15.84:0/222289831 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f556006ace0 msgr2=0x7f556006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:17.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.005+0000 7f55833ff700 1 --2- 172.21.15.84:0/222289831 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f556006ace0 0x7f556006d190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5578000c00 tx=0x7f5578008030 comp rx=0 tx=0).stop 2023-07-14T11:13:17.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.005+0000 7f55833ff700 1 -- 172.21.15.84:0/222289831 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f557c0b8a60 msgr2=0x7f557c1f21d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:17.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.005+0000 7f55833ff700 1 --2- 172.21.15.84:0/222289831 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f557c0b8a60 0x7f557c1f21d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f556c00e9b0 tx=0x7f556c00ecc0 comp rx=0 tx=0).stop 2023-07-14T11:13:17.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.006+0000 7f55833ff700 1 -- 172.21.15.84:0/222289831 shutdown_connections 2023-07-14T11:13:17.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.006+0000 7f55833ff700 1 --2- 172.21.15.84:0/222289831 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f556006ace0 0x7f556006d190 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:17.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.006+0000 7f55833ff700 1 --2- 172.21.15.84:0/222289831 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f557c0b4530 0x7f557c1f63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:17.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.006+0000 7f55833ff700 1 --2- 172.21.15.84:0/222289831 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f557c0d1050 0x7f557c0cf480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:17.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.006+0000 7f55833ff700 1 --2- 172.21.15.84:0/222289831 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f557c0b8a60 0x7f557c1f21d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:17.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.006+0000 7f55833ff700 1 -- 172.21.15.84:0/222289831 >> 172.21.15.84:0/222289831 conn(0x7f557c09c1b0 msgr2=0x7f557c0b39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:17.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.006+0000 7f55833ff700 1 -- 172.21.15.84:0/222289831 shutdown_connections 2023-07-14T11:13:17.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.006+0000 7f55833ff700 1 -- 172.21.15.84:0/222289831 wait complete. 2023-07-14T11:13:17.027 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-14T11:13:17.028 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-14T11:13:17.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.229+0000 7fbd539ff700 1 Processor -- start 2023-07-14T11:13:17.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.229+0000 7fbd539ff700 1 -- start start 2023-07-14T11:13:17.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.230+0000 7fbd539ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbd4c0d0b10 0x7fbd4c0d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:17.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.230+0000 7fbd539ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd4c0b8e30 con 0x7fbd4c0b8a60 2023-07-14T11:13:17.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.230+0000 7fbd539ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd4c0afaa0 con 0x7fbd4c0b0e20 2023-07-14T11:13:17.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.230+0000 7fbd539ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd4c0d14d0 con 0x7fbd4c0d0b10 2023-07-14T11:13:17.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.230+0000 7fbd5179b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fbd4c0b8a60 0x7fbd4c0b3ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:43230/0 (socket says 172.21.15.84:43230) 2023-07-14T11:13:17.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.230+0000 7fbd5179b700 1 -- 172.21.15.84:0/1850329543 learned_addr learned my addr 172.21.15.84:0/1850329543 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:13:17.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.231+0000 7fbd50f9a700 1 --2- 172.21.15.84:0/1850329543 >> v2:172.21.15.179:3300/0 conn(0x7fbd4c0d0b10 0x7fbd4c0d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:17.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.231+0000 7fbd43fff700 1 -- 172.21.15.84:0/1850329543 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4112308326 0 0) 0x7fbd4c0b8e30 con 0x7fbd4c0b8a60 2023-07-14T11:13:17.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.231+0000 7fbd43fff700 1 -- 172.21.15.84:0/1850329543 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd380035b0 con 0x7fbd4c0b8a60 2023-07-14T11:13:17.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.231+0000 7fbd43fff700 1 -- 172.21.15.84:0/1850329543 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3407769315 0 0) 0x7fbd380035b0 con 0x7fbd4c0b8a60 2023-07-14T11:13:17.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.231+0000 7fbd43fff700 1 -- 172.21.15.84:0/1850329543 >> v2:172.21.15.179:3300/0 conn(0x7fbd4c0d0b10 msgr2=0x7fbd4c0d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:17.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.231+0000 7fbd43fff700 1 --2- 172.21.15.84:0/1850329543 >> v2:172.21.15.179:3300/0 conn(0x7fbd4c0d0b10 0x7fbd4c0d0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:17.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.231+0000 7fbd43fff700 1 -- 172.21.15.84:0/1850329543 >> v1:172.21.15.179:6789/0 conn(0x7fbd4c0b0e20 legacy=0x7fbd4c0b1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:17.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.231+0000 7fbd43fff700 1 -- 172.21.15.84:0/1850329543 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd4c0afd80 con 0x7fbd4c0b8a60 2023-07-14T11:13:17.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.231+0000 7fbd43fff700 1 -- 172.21.15.84:0/1850329543 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7fbd48001670 con 0x7fbd4c0b8a60 2023-07-14T11:13:17.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.231+0000 7fbd43fff700 1 -- 172.21.15.84:0/1850329543 >> v1:172.21.15.84:6789/0 conn(0x7fbd4c0b8a60 legacy=0x7fbd4c0b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:17.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.231+0000 7fbd43fff700 1 --2- 172.21.15.84:0/1850329543 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd38003a50 0x7fbd38003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:17.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.231+0000 7fbd43fff700 1 --2- 172.21.15.84:0/1850329543 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd38004850 0x7fbd38004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:17.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.231+0000 7fbd43fff700 1 --2- 172.21.15.84:0/1850329543 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd38005200 0x7fbd3800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:17.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.231+0000 7fbd43fff700 1 -- 172.21.15.84:0/1850329543 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4c0d14d0 con 0x7fbd38004850 2023-07-14T11:13:17.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.231+0000 7fbd43fff700 1 -- 172.21.15.84:0/1850329543 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd3800c0c0 con 0x7fbd38005200 2023-07-14T11:13:17.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.231+0000 7fbd43fff700 1 -- 172.21.15.84:0/1850329543 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd3800c280 con 0x7fbd38003a50 2023-07-14T11:13:17.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.231+0000 7fbd50f9a700 1 --2- 172.21.15.84:0/1850329543 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd38004850 0x7fbd38004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:17.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.231+0000 7fbd5179b700 1 --2- 172.21.15.84:0/1850329543 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd38003a50 0x7fbd38003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:17.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.231+0000 7fbd51f9c700 1 --2- 172.21.15.84:0/1850329543 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd38005200 0x7fbd3800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:17.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.232+0000 7fbd50f9a700 1 -- 172.21.15.84:0/1850329543 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd38003a50 msgr2=0x7fbd38003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:17.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.232+0000 7fbd50f9a700 1 --2- 172.21.15.84:0/1850329543 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd38003a50 0x7fbd38003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:17.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.232+0000 7fbd50f9a700 1 -- 172.21.15.84:0/1850329543 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd38005200 msgr2=0x7fbd3800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:17.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.232+0000 7fbd50f9a700 1 --2- 172.21.15.84:0/1850329543 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd38005200 0x7fbd3800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:17.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.232+0000 7fbd50f9a700 1 -- 172.21.15.84:0/1850329543 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd380035b0 con 0x7fbd38004850 2023-07-14T11:13:17.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.232+0000 7fbd51f9c700 1 --2- 172.21.15.84:0/1850329543 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd38005200 0x7fbd3800ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:13:17.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.232+0000 7fbd51f9c700 1 -- 172.21.15.84:0/1850329543 reap_dead start 2023-07-14T11:13:17.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.232+0000 7fbd50f9a700 1 --2- 172.21.15.84:0/1850329543 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd38004850 0x7fbd38004cc0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c009b60 tx=0x7fbd38005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e90645831165e207 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:17.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.232+0000 7fbd43fff700 1 -- 172.21.15.84:0/1850329543 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3c00e6c0 con 0x7fbd38004850 2023-07-14T11:13:17.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.232+0000 7fbd43fff700 1 -- 172.21.15.84:0/1850329543 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd3c00e820 con 0x7fbd38004850 2023-07-14T11:13:17.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.232+0000 7fbd43fff700 1 -- 172.21.15.84:0/1850329543 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3c00eb90 con 0x7fbd38004850 2023-07-14T11:13:17.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.233+0000 7fbd539ff700 1 -- 172.21.15.84:0/1850329543 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd38004850 msgr2=0x7fbd38004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:17.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.233+0000 7fbd539ff700 1 --2- 172.21.15.84:0/1850329543 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd38004850 0x7fbd38004cc0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c009b60 tx=0x7fbd38005880 comp rx=0 tx=0).stop 2023-07-14T11:13:17.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.233+0000 7fbd539ff700 1 -- 172.21.15.84:0/1850329543 shutdown_connections 2023-07-14T11:13:17.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.233+0000 7fbd539ff700 1 --2- 172.21.15.84:0/1850329543 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd38004850 0x7fbd38004cc0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:17.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.233+0000 7fbd539ff700 1 -- 172.21.15.84:0/1850329543 >> 172.21.15.84:0/1850329543 conn(0x7fbd4c09c1b0 msgr2=0x7fbd4c0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:17.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.233+0000 7fbd539ff700 1 -- 172.21.15.84:0/1850329543 shutdown_connections 2023-07-14T11:13:17.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.233+0000 7fbd539ff700 1 -- 172.21.15.84:0/1850329543 wait complete. 2023-07-14T11:13:17.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.235+0000 7fbd539ff700 1 Processor -- start 2023-07-14T11:13:17.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.235+0000 7fbd539ff700 1 -- start start 2023-07-14T11:13:17.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.236+0000 7fbd539ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd38004850 0x7fbd4c15ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:17.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.237+0000 7fbd539ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd4c15a870 0x7fbd4c15faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:17.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.237+0000 7fbd539ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd4c1f2340 0x7fbd4c1f27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:17.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.237+0000 7fbd539ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4c15ce50 con 0x7fbd4c15a870 2023-07-14T11:13:17.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.237+0000 7fbd539ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4c15d130 con 0x7fbd4c1f2340 2023-07-14T11:13:17.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.237+0000 7fbd539ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4c15d410 con 0x7fbd38004850 2023-07-14T11:13:17.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.237+0000 7fbd50f9a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd4c15a870 0x7fbd4c15faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:17.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.237+0000 7fbd50f9a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd4c15a870 0x7fbd4c15faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44316/0 (socket says 172.21.15.84:44316) 2023-07-14T11:13:17.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.237+0000 7fbd50f9a700 1 -- 172.21.15.84:0/3714348187 learned_addr learned my addr 172.21.15.84:0/3714348187 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:17.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.237+0000 7fbd5179b700 1 --2- 172.21.15.84:0/3714348187 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd38004850 0x7fbd4c15ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:17.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.237+0000 7fbd51f9c700 1 --2- 172.21.15.84:0/3714348187 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd4c1f2340 0x7fbd4c1f27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:17.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.237+0000 7fbd50f9a700 1 -- 172.21.15.84:0/3714348187 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd38004850 msgr2=0x7fbd4c15ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:17.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.237+0000 7fbd50f9a700 1 --2- 172.21.15.84:0/3714348187 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd38004850 0x7fbd4c15ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:17.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.237+0000 7fbd50f9a700 1 -- 172.21.15.84:0/3714348187 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd4c1f2340 msgr2=0x7fbd4c1f27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:17.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.237+0000 7fbd50f9a700 1 --2- 172.21.15.84:0/3714348187 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd4c1f2340 0x7fbd4c1f27c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:17.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.237+0000 7fbd50f9a700 1 -- 172.21.15.84:0/3714348187 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd4c15d6f0 con 0x7fbd4c15a870 2023-07-14T11:13:17.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.237+0000 7fbd50f9a700 1 --2- 172.21.15.84:0/3714348187 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd4c15a870 0x7fbd4c15faa0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbd3800c090 tx=0x7fbd3c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:17.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.238+0000 7fbd41ffb700 1 -- 172.21.15.84:0/3714348187 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3c00e6c0 con 0x7fbd4c15a870 2023-07-14T11:13:17.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.238+0000 7fbd41ffb700 1 -- 172.21.15.84:0/3714348187 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd3c003ad0 con 0x7fbd4c15a870 2023-07-14T11:13:17.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.238+0000 7fbd539ff700 1 -- 172.21.15.84:0/3714348187 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd4c15d9d0 con 0x7fbd4c15a870 2023-07-14T11:13:17.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.238+0000 7fbd41ffb700 1 -- 172.21.15.84:0/3714348187 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3c003e80 con 0x7fbd4c15a870 2023-07-14T11:13:17.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.238+0000 7fbd539ff700 1 -- 172.21.15.84:0/3714348187 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd4c15b580 con 0x7fbd4c15a870 2023-07-14T11:13:17.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.239+0000 7fbd539ff700 1 -- 172.21.15.84:0/3714348187 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd4c15db90 con 0x7fbd4c15a870 2023-07-14T11:13:17.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.240+0000 7fbd41ffb700 1 -- 172.21.15.84:0/3714348187 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbd3c013470 con 0x7fbd4c15a870 2023-07-14T11:13:17.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.240+0000 7fbd41ffb700 1 --2- 172.21.15.84:0/3714348187 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fbd3006ace0 0x7fbd3006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:17.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.241+0000 7fbd41ffb700 1 -- 172.21.15.84:0/3714348187 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbd3c08abc0 con 0x7fbd4c15a870 2023-07-14T11:13:17.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.241+0000 7fbd5179b700 1 --2- 172.21.15.84:0/3714348187 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fbd3006ace0 0x7fbd3006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:17.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.241+0000 7fbd5179b700 1 --2- 172.21.15.84:0/3714348187 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fbd3006ace0 0x7fbd3006d190 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c0b5de0 tx=0x7fbd48000fc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:17.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.245+0000 7fbd41ffb700 1 -- 172.21.15.84:0/3714348187 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fbd3c055c60 con 0x7fbd4c15a870 2023-07-14T11:13:17.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:17.486+0000 7fbd539ff700 1 -- 172.21.15.84:0/3714348187 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fbd4c074350 con 0x7fbd4c15a870 2023-07-14T11:13:18.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.008+0000 7fbd41ffb700 1 -- 172.21.15.84:0/3714348187 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7fbd3c0170c0 con 0x7fbd4c15a870 2023-07-14T11:13:18.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.011+0000 7fbd539ff700 1 -- 172.21.15.84:0/3714348187 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fbd3006ace0 msgr2=0x7fbd3006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:18.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.011+0000 7fbd539ff700 1 --2- 172.21.15.84:0/3714348187 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fbd3006ace0 0x7fbd3006d190 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c0b5de0 tx=0x7fbd48000fc0 comp rx=0 tx=0).stop 2023-07-14T11:13:18.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.011+0000 7fbd539ff700 1 -- 172.21.15.84:0/3714348187 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd4c15a870 msgr2=0x7fbd4c15faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:18.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.011+0000 7fbd539ff700 1 --2- 172.21.15.84:0/3714348187 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd4c15a870 0x7fbd4c15faa0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbd3800c090 tx=0x7fbd3c0047c0 comp rx=0 tx=0).stop 2023-07-14T11:13:18.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.011+0000 7fbd539ff700 1 -- 172.21.15.84:0/3714348187 shutdown_connections 2023-07-14T11:13:18.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.011+0000 7fbd539ff700 1 --2- 172.21.15.84:0/3714348187 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fbd3006ace0 0x7fbd3006d190 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:18.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.011+0000 7fbd539ff700 1 --2- 172.21.15.84:0/3714348187 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd38004850 0x7fbd4c15ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:18.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.011+0000 7fbd539ff700 1 --2- 172.21.15.84:0/3714348187 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd4c1f2340 0x7fbd4c1f27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:18.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.011+0000 7fbd539ff700 1 --2- 172.21.15.84:0/3714348187 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd4c15a870 0x7fbd4c15faa0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:18.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.011+0000 7fbd539ff700 1 -- 172.21.15.84:0/3714348187 >> 172.21.15.84:0/3714348187 conn(0x7fbd4c09c1b0 msgr2=0x7fbd4c0b39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:18.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.011+0000 7fbd539ff700 1 -- 172.21.15.84:0/3714348187 shutdown_connections 2023-07-14T11:13:18.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.011+0000 7fbd539ff700 1 -- 172.21.15.84:0/3714348187 wait complete. 2023-07-14T11:13:18.032 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-14T11:13:18.032 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T11:13:18.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.226+0000 7f99e63ff700 1 Processor -- start 2023-07-14T11:13:18.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.226+0000 7f99e63ff700 1 -- start start 2023-07-14T11:13:18.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.227+0000 7f99e63ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f99e00b5d90 0x7f99e00b6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:18.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.227+0000 7f99e63ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99e00b7f50 con 0x7f99e00b4510 2023-07-14T11:13:18.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.227+0000 7f99e63ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99e00cdca0 con 0x7f99e00d0b10 2023-07-14T11:13:18.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.227+0000 7f99e63ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99e00b48e0 con 0x7f99e00b5d90 2023-07-14T11:13:18.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.227+0000 7f99df7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f99e00b5d90 0x7f99e00b6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:18.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.228+0000 7f99df7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f99e00b5d90 0x7f99e00b6c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44324/0 (socket says 172.21.15.84:44324) 2023-07-14T11:13:18.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.228+0000 7f99df7fe700 1 -- 172.21.15.84:0/3490419350 learned_addr learned my addr 172.21.15.84:0/3490419350 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:18.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.228+0000 7f99df7fe700 1 -- 172.21.15.84:0/3490419350 >> v1:172.21.15.179:6789/0 conn(0x7f99e00d0b10 legacy=0x7f99e00b83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:18.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.228+0000 7f99df7fe700 1 -- 172.21.15.84:0/3490419350 >> v1:172.21.15.84:6789/0 conn(0x7f99e00b4510 legacy=0x7f99e00cd590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:18.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.228+0000 7f99deffd700 1 -- 172.21.15.84:0/3490419350 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2833084724 0 0) 0x7f99e00b7f50 con 0x7f99e00b4510 2023-07-14T11:13:18.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.228+0000 7f99df7fe700 1 -- 172.21.15.84:0/3490419350 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e00b7340 con 0x7f99e00b5d90 2023-07-14T11:13:18.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.228+0000 7f99df7fe700 1 --2- 172.21.15.84:0/3490419350 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99e00b5d90 0x7f99e00b6c80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f99d40098f0 tx=0x7f99d4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cd904a4a41d8f01 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:18.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.228+0000 7f99deffd700 1 -- 172.21.15.84:0/3490419350 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d400b8a0 con 0x7f99e00b5d90 2023-07-14T11:13:18.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.228+0000 7f99deffd700 1 -- 172.21.15.84:0/3490419350 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99d400ba00 con 0x7f99e00b5d90 2023-07-14T11:13:18.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.228+0000 7f99deffd700 1 -- 172.21.15.84:0/3490419350 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d400bd90 con 0x7f99e00b5d90 2023-07-14T11:13:18.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.229+0000 7f99e63ff700 1 -- 172.21.15.84:0/3490419350 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99e00b5d90 msgr2=0x7f99e00b6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:18.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.229+0000 7f99e63ff700 1 --2- 172.21.15.84:0/3490419350 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99e00b5d90 0x7f99e00b6c80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f99d40098f0 tx=0x7f99d4009c00 comp rx=0 tx=0).stop 2023-07-14T11:13:18.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.229+0000 7f99e63ff700 1 -- 172.21.15.84:0/3490419350 shutdown_connections 2023-07-14T11:13:18.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.229+0000 7f99e63ff700 1 --2- 172.21.15.84:0/3490419350 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99e00b5d90 0x7f99e00b6c80 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:18.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.229+0000 7f99e63ff700 1 -- 172.21.15.84:0/3490419350 >> 172.21.15.84:0/3490419350 conn(0x7f99e009c1d0 msgr2=0x7f99e00d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:18.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.229+0000 7f99e63ff700 1 -- 172.21.15.84:0/3490419350 shutdown_connections 2023-07-14T11:13:18.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.229+0000 7f99e63ff700 1 -- 172.21.15.84:0/3490419350 wait complete. 2023-07-14T11:13:18.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.231+0000 7f99e63ff700 1 Processor -- start 2023-07-14T11:13:18.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.231+0000 7f99e63ff700 1 -- start start 2023-07-14T11:13:18.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.232+0000 7f99e63ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99e00b4510 0x7f99e01470d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:18.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.232+0000 7f99e63ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99e00b5d90 0x7f99e01552f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:18.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.232+0000 7f99e63ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99e00d0b10 0x7f99e00c7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:18.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.232+0000 7f99e63ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e0157fb0 con 0x7f99e00d0b10 2023-07-14T11:13:18.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.232+0000 7f99e63ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e0158290 con 0x7f99e00b5d90 2023-07-14T11:13:18.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.232+0000 7f99e63ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99e0158570 con 0x7f99e00b4510 2023-07-14T11:13:18.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.232+0000 7f99e499c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99e00d0b10 0x7f99e00c7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:18.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.232+0000 7f99e499c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99e00d0b10 0x7f99e00c7ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44340/0 (socket says 172.21.15.84:44340) 2023-07-14T11:13:18.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.232+0000 7f99e499c700 1 -- 172.21.15.84:0/469114839 learned_addr learned my addr 172.21.15.84:0/469114839 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:18.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.232+0000 7f99dffff700 1 --2- 172.21.15.84:0/469114839 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99e00b4510 0x7f99e01470d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:18.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.232+0000 7f99df7fe700 1 --2- 172.21.15.84:0/469114839 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99e00b5d90 0x7f99e01552f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:18.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.232+0000 7f99e499c700 1 -- 172.21.15.84:0/469114839 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99e00b4510 msgr2=0x7f99e01470d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:18.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.232+0000 7f99e499c700 1 --2- 172.21.15.84:0/469114839 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99e00b4510 0x7f99e01470d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:18.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.232+0000 7f99e499c700 1 -- 172.21.15.84:0/469114839 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99e00b5d90 msgr2=0x7f99e01552f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:18.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.232+0000 7f99e499c700 1 --2- 172.21.15.84:0/469114839 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99e00b5d90 0x7f99e01552f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:18.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.232+0000 7f99e499c700 1 -- 172.21.15.84:0/469114839 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99d4009550 con 0x7f99e00d0b10 2023-07-14T11:13:18.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.233+0000 7f99e499c700 1 --2- 172.21.15.84:0/469114839 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99e00d0b10 0x7f99e00c7ac0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f99d800cc50 tx=0x7f99d800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:18.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.233+0000 7f99dcff9700 1 -- 172.21.15.84:0/469114839 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d8003c00 con 0x7f99e00d0b10 2023-07-14T11:13:18.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.233+0000 7f99dcff9700 1 -- 172.21.15.84:0/469114839 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99d8003d60 con 0x7f99e00d0b10 2023-07-14T11:13:18.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.233+0000 7f99e63ff700 1 -- 172.21.15.84:0/469114839 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99e0152590 con 0x7f99e00d0b10 2023-07-14T11:13:18.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.233+0000 7f99dcff9700 1 -- 172.21.15.84:0/469114839 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d800aab0 con 0x7f99e00d0b10 2023-07-14T11:13:18.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.233+0000 7f99e63ff700 1 -- 172.21.15.84:0/469114839 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99e0147610 con 0x7f99e00d0b10 2023-07-14T11:13:18.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.234+0000 7f99e63ff700 1 -- 172.21.15.84:0/469114839 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99e0152be0 con 0x7f99e00d0b10 2023-07-14T11:13:18.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.235+0000 7f99dcff9700 1 -- 172.21.15.84:0/469114839 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f99d800ac10 con 0x7f99e00d0b10 2023-07-14T11:13:18.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.236+0000 7f99dcff9700 1 --2- 172.21.15.84:0/469114839 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f99cc06ace0 0x7f99cc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:18.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.236+0000 7f99dcff9700 1 -- 172.21.15.84:0/469114839 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f99d80894b0 con 0x7f99e00d0b10 2023-07-14T11:13:18.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.236+0000 7f99dffff700 1 --2- 172.21.15.84:0/469114839 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f99cc06ace0 0x7f99cc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:18.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.236+0000 7f99dffff700 1 --2- 172.21.15.84:0/469114839 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f99cc06ace0 0x7f99cc06d190 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f99d0007fd0 tx=0x7f99d0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:18.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.240+0000 7f99dcff9700 1 -- 172.21.15.84:0/469114839 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f99d80544c0 con 0x7f99e00d0b10 2023-07-14T11:13:18.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.481+0000 7f99e63ff700 1 -- 172.21.15.84:0/469114839 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f99e01477a0 con 0x7f99e00d0b10 2023-07-14T11:13:18.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.482+0000 7f99dcff9700 1 -- 172.21.15.84:0/469114839 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4703 (secure 0 0 0) 0x7f99d8057ae0 con 0x7f99e00d0b10 2023-07-14T11:13:18.484 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:13:18.485 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4296,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/811241790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":811241790},{"type":"v1","addr":"172.21.15.84:6836","nonce":811241790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4299,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/729998896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":729998896},{"type":"v1","addr":"172.21.15.84:6837","nonce":729998896}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4305,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3512017231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3512017231},{"type":"v1","addr":"172.21.15.179:6834","nonce":3512017231}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T11:13:14.457746+0000","modified":"2023-07-14T11:13:18.001606+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4308},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4308":{"gid":4308,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/3903854892","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":3903854892},{"type":"v1","addr":"172.21.15.179:6835","nonce":3903854892}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-14T11:13:18.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.484+0000 7f99e63ff700 1 -- 172.21.15.84:0/469114839 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f99cc06ace0 msgr2=0x7f99cc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:18.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.484+0000 7f99e63ff700 1 --2- 172.21.15.84:0/469114839 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f99cc06ace0 0x7f99cc06d190 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f99d0007fd0 tx=0x7f99d0009040 comp rx=0 tx=0).stop 2023-07-14T11:13:18.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.484+0000 7f99e63ff700 1 -- 172.21.15.84:0/469114839 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99e00d0b10 msgr2=0x7f99e00c7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:18.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.484+0000 7f99e63ff700 1 --2- 172.21.15.84:0/469114839 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99e00d0b10 0x7f99e00c7ac0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f99d800cc50 tx=0x7f99d800cf60 comp rx=0 tx=0).stop 2023-07-14T11:13:18.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.484+0000 7f99e63ff700 1 -- 172.21.15.84:0/469114839 shutdown_connections 2023-07-14T11:13:18.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.484+0000 7f99e63ff700 1 --2- 172.21.15.84:0/469114839 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f99cc06ace0 0x7f99cc06d190 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:18.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.484+0000 7f99e63ff700 1 --2- 172.21.15.84:0/469114839 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99e00b4510 0x7f99e01470d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:18.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.484+0000 7f99e63ff700 1 --2- 172.21.15.84:0/469114839 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99e00d0b10 0x7f99e00c7ac0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:18.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.484+0000 7f99e63ff700 1 --2- 172.21.15.84:0/469114839 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99e00b5d90 0x7f99e01552f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:18.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.484+0000 7f99e63ff700 1 -- 172.21.15.84:0/469114839 >> 172.21.15.84:0/469114839 conn(0x7f99e009c1d0 msgr2=0x7f99e00d3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:18.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.484+0000 7f99e63ff700 1 -- 172.21.15.84:0/469114839 shutdown_connections 2023-07-14T11:13:18.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.485+0000 7f99e63ff700 1 -- 172.21.15.84:0/469114839 wait complete. 2023-07-14T11:13:18.488 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 8 2023-07-14T11:13:18.504 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:13:18.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.696+0000 7f71459ff700 1 Processor -- start 2023-07-14T11:13:18.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.696+0000 7f71459ff700 1 -- start start 2023-07-14T11:13:18.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.698+0000 7f71459ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f714015c950 0x7f71400b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:18.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.698+0000 7f71459ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f71400b1e00 0x7f71400d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:18.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.698+0000 7f71459ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71400d2ce0 con 0x7f71400b2350 2023-07-14T11:13:18.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.698+0000 7f71459ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71400b3350 con 0x7f714015c950 2023-07-14T11:13:18.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.698+0000 7f71459ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71400b3630 con 0x7f71400b1e00 2023-07-14T11:13:18.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.698+0000 7f713effd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f714015c950 0x7f71400b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:18.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.698+0000 7f713effd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f714015c950 0x7f71400b43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44348/0 (socket says 172.21.15.84:44348) 2023-07-14T11:13:18.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.698+0000 7f713effd700 1 -- 172.21.15.84:0/324078252 learned_addr learned my addr 172.21.15.84:0/324078252 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:18.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.699+0000 7f7137fff700 1 --2- 172.21.15.84:0/324078252 >> v2:172.21.15.179:3300/0 conn(0x7f71400b1e00 0x7f71400d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:18.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.699+0000 7f713effd700 1 -- 172.21.15.84:0/324078252 >> v2:172.21.15.179:3300/0 conn(0x7f71400b1e00 msgr2=0x7f71400d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:18.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.699+0000 7f713effd700 1 --2- 172.21.15.84:0/324078252 >> v2:172.21.15.179:3300/0 conn(0x7f71400b1e00 0x7f71400d0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:18.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.699+0000 7f713effd700 1 -- 172.21.15.84:0/324078252 >> v1:172.21.15.179:6789/0 conn(0x7f71400b2350 legacy=0x7f71400afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:18.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.699+0000 7f713effd700 1 -- 172.21.15.84:0/324078252 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71400b3910 con 0x7f714015c950 2023-07-14T11:13:18.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.699+0000 7f713effd700 1 --2- 172.21.15.84:0/324078252 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f714015c950 0x7f71400b43f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7140072140 tx=0x7f7130009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9893638d068e55ce server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:18.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.699+0000 7f713e7fc700 1 -- 172.21.15.84:0/324078252 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7130005e30 con 0x7f714015c950 2023-07-14T11:13:18.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.699+0000 7f713e7fc700 1 -- 172.21.15.84:0/324078252 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7130004030 con 0x7f714015c950 2023-07-14T11:13:18.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.699+0000 7f713e7fc700 1 -- 172.21.15.84:0/324078252 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71300043e0 con 0x7f714015c950 2023-07-14T11:13:18.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.700+0000 7f71459ff700 1 -- 172.21.15.84:0/324078252 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f714015c950 msgr2=0x7f71400b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:18.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.700+0000 7f71459ff700 1 --2- 172.21.15.84:0/324078252 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f714015c950 0x7f71400b43f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7140072140 tx=0x7f7130009bd0 comp rx=0 tx=0).stop 2023-07-14T11:13:18.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.700+0000 7f71459ff700 1 -- 172.21.15.84:0/324078252 shutdown_connections 2023-07-14T11:13:18.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.700+0000 7f71459ff700 1 --2- 172.21.15.84:0/324078252 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f714015c950 0x7f71400b43f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:18.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.700+0000 7f71459ff700 1 --2- 172.21.15.84:0/324078252 >> v2:172.21.15.179:3300/0 conn(0x7f71400b1e00 0x7f71400d0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:18.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.700+0000 7f71459ff700 1 -- 172.21.15.84:0/324078252 >> 172.21.15.84:0/324078252 conn(0x7f714009c1d0 msgr2=0x7f71400d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:18.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.700+0000 7f71459ff700 1 -- 172.21.15.84:0/324078252 shutdown_connections 2023-07-14T11:13:18.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.700+0000 7f71459ff700 1 -- 172.21.15.84:0/324078252 wait complete. 2023-07-14T11:13:18.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.702+0000 7f71459ff700 1 Processor -- start 2023-07-14T11:13:18.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.702+0000 7f71459ff700 1 -- start start 2023-07-14T11:13:18.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.703+0000 7f71459ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71400b1e00 0x7f714014fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:18.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.703+0000 7f71459ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71400b2350 0x7f71400ca010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:18.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.703+0000 7f71459ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f714015c950 0x7f71400ca550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:18.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.703+0000 7f71459ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71400c6b10 con 0x7f71400b2350 2023-07-14T11:13:18.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.703+0000 7f71459ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71400c6db0 con 0x7f714015c950 2023-07-14T11:13:18.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.703+0000 7f71459ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71400c7090 con 0x7f71400b1e00 2023-07-14T11:13:18.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.703+0000 7f7137fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71400b2350 0x7f71400ca010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:18.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.703+0000 7f7137fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71400b2350 0x7f71400ca010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44362/0 (socket says 172.21.15.84:44362) 2023-07-14T11:13:18.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.703+0000 7f7137fff700 1 -- 172.21.15.84:0/469043226 learned_addr learned my addr 172.21.15.84:0/469043226 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:18.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.703+0000 7f713effd700 1 --2- 172.21.15.84:0/469043226 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71400b1e00 0x7f714014fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:18.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.703+0000 7f713f7fe700 1 --2- 172.21.15.84:0/469043226 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f714015c950 0x7f71400ca550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:18.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.704+0000 7f7137fff700 1 -- 172.21.15.84:0/469043226 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71400b1e00 msgr2=0x7f714014fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:18.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.704+0000 7f7137fff700 1 --2- 172.21.15.84:0/469043226 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71400b1e00 0x7f714014fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:18.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.704+0000 7f7137fff700 1 -- 172.21.15.84:0/469043226 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f714015c950 msgr2=0x7f71400ca550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:18.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.704+0000 7f7137fff700 1 --2- 172.21.15.84:0/469043226 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f714015c950 0x7f71400ca550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:18.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.704+0000 7f7137fff700 1 -- 172.21.15.84:0/469043226 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7130009500 con 0x7f71400b2350 2023-07-14T11:13:18.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.704+0000 7f713effd700 1 --2- 172.21.15.84:0/469043226 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71400b1e00 0x7f714014fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:13:18.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.704+0000 7f7137fff700 1 --2- 172.21.15.84:0/469043226 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71400b2350 0x7f71400ca010 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f712800e810 tx=0x7f712800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:18.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.704+0000 7f713cff9700 1 -- 172.21.15.84:0/469043226 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7128013610 con 0x7f71400b2350 2023-07-14T11:13:18.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.704+0000 7f713cff9700 1 -- 172.21.15.84:0/469043226 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71280137b0 con 0x7f71400b2350 2023-07-14T11:13:18.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.704+0000 7f71459ff700 1 -- 172.21.15.84:0/469043226 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71400c7370 con 0x7f71400b2350 2023-07-14T11:13:18.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.704+0000 7f713cff9700 1 -- 172.21.15.84:0/469043226 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7128013b60 con 0x7f71400b2350 2023-07-14T11:13:18.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.704+0000 7f71459ff700 1 -- 172.21.15.84:0/469043226 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7140150350 con 0x7f71400b2350 2023-07-14T11:13:18.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.705+0000 7f71459ff700 1 -- 172.21.15.84:0/469043226 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71400c7890 con 0x7f71400b2350 2023-07-14T11:13:18.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.706+0000 7f713cff9700 1 -- 172.21.15.84:0/469043226 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7128013cc0 con 0x7f71400b2350 2023-07-14T11:13:18.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.707+0000 7f713cff9700 1 --2- 172.21.15.84:0/469043226 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f712006ace0 0x7f712006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:18.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.707+0000 7f713cff9700 1 -- 172.21.15.84:0/469043226 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7128089160 con 0x7f71400b2350 2023-07-14T11:13:18.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.707+0000 7f713effd700 1 --2- 172.21.15.84:0/469043226 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f712006ace0 0x7f712006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:18.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.708+0000 7f713effd700 1 --2- 172.21.15.84:0/469043226 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f712006ace0 0x7f712006d190 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7140072140 tx=0x7f7130008070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:18.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.711+0000 7f713cff9700 1 -- 172.21.15.84:0/469043226 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f71400c7890 con 0x7f71400b2350 2023-07-14T11:13:18.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.907+0000 7f71459ff700 1 -- 172.21.15.84:0/469043226 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f71400c7890 con 0x7f71400b2350 2023-07-14T11:13:18.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.909+0000 7f713cff9700 1 -- 172.21.15.84:0/469043226 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18255 (secure 0 0 0) 0x7f71400c7890 con 0x7f71400b2350 2023-07-14T11:13:18.911 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:13:18.911 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":23,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:13:15.989292+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-14T11:13:12.727811+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-14T11:13:13.436391+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:13:18.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.911+0000 7f71459ff700 1 -- 172.21.15.84:0/469043226 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f712006ace0 msgr2=0x7f712006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:18.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.911+0000 7f71459ff700 1 --2- 172.21.15.84:0/469043226 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f712006ace0 0x7f712006d190 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7140072140 tx=0x7f7130008070 comp rx=0 tx=0).stop 2023-07-14T11:13:18.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.911+0000 7f71459ff700 1 -- 172.21.15.84:0/469043226 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71400b2350 msgr2=0x7f71400ca010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:18.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.911+0000 7f71459ff700 1 --2- 172.21.15.84:0/469043226 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71400b2350 0x7f71400ca010 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f712800e810 tx=0x7f712800eb20 comp rx=0 tx=0).stop 2023-07-14T11:13:18.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.911+0000 7f71459ff700 1 -- 172.21.15.84:0/469043226 shutdown_connections 2023-07-14T11:13:18.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.911+0000 7f71459ff700 1 --2- 172.21.15.84:0/469043226 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f712006ace0 0x7f712006d190 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:18.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.911+0000 7f71459ff700 1 --2- 172.21.15.84:0/469043226 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71400b1e00 0x7f714014fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:18.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.911+0000 7f71459ff700 1 --2- 172.21.15.84:0/469043226 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f714015c950 0x7f71400ca550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:18.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.911+0000 7f71459ff700 1 --2- 172.21.15.84:0/469043226 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71400b2350 0x7f71400ca010 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:18.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.911+0000 7f71459ff700 1 -- 172.21.15.84:0/469043226 >> 172.21.15.84:0/469043226 conn(0x7f714009c1d0 msgr2=0x7f71400b0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:18.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.911+0000 7f71459ff700 1 -- 172.21.15.84:0/469043226 shutdown_connections 2023-07-14T11:13:18.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:18.911+0000 7f71459ff700 1 -- 172.21.15.84:0/469043226 wait complete. 2023-07-14T11:13:18.931 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-14T11:13:18.932 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T11:13:19.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.126+0000 7f23969ff700 1 Processor -- start 2023-07-14T11:13:19.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.127+0000 7f23969ff700 1 -- start start 2023-07-14T11:13:19.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.128+0000 7f23969ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f23900b1e00 0x7f23900b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:19.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.128+0000 7f23969ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23900d2ce0 con 0x7f239015c950 2023-07-14T11:13:19.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.128+0000 7f23969ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23900b3350 con 0x7f23900d1220 2023-07-14T11:13:19.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.128+0000 7f23969ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23900b3630 con 0x7f23900b1e00 2023-07-14T11:13:19.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.128+0000 7f238ffff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f239015c950 0x7f23900d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:37646/0 (socket says 172.21.15.84:37646) 2023-07-14T11:13:19.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.128+0000 7f238ffff700 1 -- 172.21.15.84:0/3745426683 learned_addr learned my addr 172.21.15.84:0/3745426683 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:13:19.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.128+0000 7f2394f9c700 1 --2- 172.21.15.84:0/3745426683 >> v2:172.21.15.84:3300/0 conn(0x7f23900b1e00 0x7f23900b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:19.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.128+0000 7f238f7fe700 1 -- 172.21.15.84:0/3745426683 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 446104222 0 0) 0x7f23900d2ce0 con 0x7f239015c950 2023-07-14T11:13:19.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.128+0000 7f238f7fe700 1 -- 172.21.15.84:0/3745426683 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f237c0035b0 con 0x7f239015c950 2023-07-14T11:13:19.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.128+0000 7f2394f9c700 1 -- 172.21.15.84:0/3745426683 >> v1:172.21.15.179:6789/0 conn(0x7f23900d1220 legacy=0x7f23900afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:19.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.129+0000 7f238f7fe700 1 -- 172.21.15.84:0/3745426683 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3038324447 0 0) 0x7f23900b3350 con 0x7f23900d1220 2023-07-14T11:13:19.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.129+0000 7f2394f9c700 1 -- 172.21.15.84:0/3745426683 >> v1:172.21.15.84:6789/0 conn(0x7f239015c950 legacy=0x7f23900d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:19.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.129+0000 7f2394f9c700 1 -- 172.21.15.84:0/3745426683 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23900b3910 con 0x7f23900b1e00 2023-07-14T11:13:19.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.129+0000 7f2394f9c700 1 --2- 172.21.15.84:0/3745426683 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23900b1e00 0x7f23900b43f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2388009d90 tx=0x7f238800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87843d485797e55c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:19.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.129+0000 7f238f7fe700 1 -- 172.21.15.84:0/3745426683 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238800e070 con 0x7f23900b1e00 2023-07-14T11:13:19.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.129+0000 7f238f7fe700 1 -- 172.21.15.84:0/3745426683 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f238800bb20 con 0x7f23900b1e00 2023-07-14T11:13:19.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.129+0000 7f238f7fe700 1 -- 172.21.15.84:0/3745426683 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238800bed0 con 0x7f23900b1e00 2023-07-14T11:13:19.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.129+0000 7f23969ff700 1 -- 172.21.15.84:0/3745426683 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23900b1e00 msgr2=0x7f23900b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:19.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.129+0000 7f23969ff700 1 --2- 172.21.15.84:0/3745426683 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23900b1e00 0x7f23900b43f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2388009d90 tx=0x7f238800b330 comp rx=0 tx=0).stop 2023-07-14T11:13:19.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.130+0000 7f23969ff700 1 -- 172.21.15.84:0/3745426683 shutdown_connections 2023-07-14T11:13:19.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.130+0000 7f23969ff700 1 --2- 172.21.15.84:0/3745426683 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23900b1e00 0x7f23900b43f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:19.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.130+0000 7f23969ff700 1 -- 172.21.15.84:0/3745426683 >> 172.21.15.84:0/3745426683 conn(0x7f239009c1d0 msgr2=0x7f23900d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:19.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.130+0000 7f23969ff700 1 -- 172.21.15.84:0/3745426683 shutdown_connections 2023-07-14T11:13:19.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.130+0000 7f23969ff700 1 -- 172.21.15.84:0/3745426683 wait complete. 2023-07-14T11:13:19.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.132+0000 7f23969ff700 1 Processor -- start 2023-07-14T11:13:19.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.132+0000 7f23969ff700 1 -- start start 2023-07-14T11:13:19.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.133+0000 7f23969ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23900b1e00 0x7f23901f1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:19.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.133+0000 7f23969ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23900d1220 0x7f2390157240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:19.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.133+0000 7f23969ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f239015c950 0x7f23900ceb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:19.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.133+0000 7f23969ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23900ce940 con 0x7f239015c950 2023-07-14T11:13:19.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.133+0000 7f23969ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2390152eb0 con 0x7f23900d1220 2023-07-14T11:13:19.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.133+0000 7f23969ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23900ce660 con 0x7f23900b1e00 2023-07-14T11:13:19.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.134+0000 7f2394f9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f239015c950 0x7f23900ceb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:19.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.134+0000 7f2394f9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f239015c950 0x7f23900ceb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33902/0 (socket says 172.21.15.84:33902) 2023-07-14T11:13:19.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.134+0000 7f2394f9c700 1 -- 172.21.15.84:0/594535843 learned_addr learned my addr 172.21.15.84:0/594535843 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:19.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.134+0000 7f238ffff700 1 --2- 172.21.15.84:0/594535843 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23900b1e00 0x7f23901f1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:19.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.134+0000 7f2387fff700 1 --2- 172.21.15.84:0/594535843 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23900d1220 0x7f2390157240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:19.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.134+0000 7f2394f9c700 1 -- 172.21.15.84:0/594535843 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23900b1e00 msgr2=0x7f23901f1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:19.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.134+0000 7f2394f9c700 1 --2- 172.21.15.84:0/594535843 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23900b1e00 0x7f23901f1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:19.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.134+0000 7f2394f9c700 1 -- 172.21.15.84:0/594535843 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23900d1220 msgr2=0x7f2390157240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:19.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.134+0000 7f2394f9c700 1 --2- 172.21.15.84:0/594535843 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23900d1220 0x7f2390157240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:19.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.134+0000 7f2394f9c700 1 -- 172.21.15.84:0/594535843 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2388009a70 con 0x7f239015c950 2023-07-14T11:13:19.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.134+0000 7f238ffff700 1 --2- 172.21.15.84:0/594535843 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23900b1e00 0x7f23901f1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:13:19.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.134+0000 7f2387fff700 1 --2- 172.21.15.84:0/594535843 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23900d1220 0x7f2390157240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:13:19.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.134+0000 7f2394f9c700 1 --2- 172.21.15.84:0/594535843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f239015c950 0x7f23900ceb10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f23900673b0 tx=0x7f2388004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:19.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.135+0000 7f238d7fa700 1 -- 172.21.15.84:0/594535843 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238801b810 con 0x7f239015c950 2023-07-14T11:13:19.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.135+0000 7f238d7fa700 1 -- 172.21.15.84:0/594535843 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2388020070 con 0x7f239015c950 2023-07-14T11:13:19.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.135+0000 7f23969ff700 1 -- 172.21.15.84:0/594535843 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2390156760 con 0x7f239015c950 2023-07-14T11:13:19.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.135+0000 7f238d7fa700 1 -- 172.21.15.84:0/594535843 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238801bbb0 con 0x7f239015c950 2023-07-14T11:13:19.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.135+0000 7f23969ff700 1 -- 172.21.15.84:0/594535843 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2390156d20 con 0x7f239015c950 2023-07-14T11:13:19.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.136+0000 7f23969ff700 1 -- 172.21.15.84:0/594535843 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23901565c0 con 0x7f239015c950 2023-07-14T11:13:19.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.137+0000 7f238d7fa700 1 -- 172.21.15.84:0/594535843 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f238801bd10 con 0x7f239015c950 2023-07-14T11:13:19.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.137+0000 7f238d7fa700 1 --2- 172.21.15.84:0/594535843 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f237006ace0 0x7f237006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:19.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.138+0000 7f238d7fa700 1 -- 172.21.15.84:0/594535843 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2388022070 con 0x7f239015c950 2023-07-14T11:13:19.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.138+0000 7f238ffff700 1 --2- 172.21.15.84:0/594535843 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f237006ace0 0x7f237006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:19.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.138+0000 7f238ffff700 1 --2- 172.21.15.84:0/594535843 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f237006ace0 0x7f237006d190 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2380001360 tx=0x7f2380009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:19.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.142+0000 7f238d7fa700 1 -- 172.21.15.84:0/594535843 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f23901565c0 con 0x7f239015c950 2023-07-14T11:13:19.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.332+0000 7f23969ff700 1 -- 172.21.15.84:0/594535843 --> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f23900b3ed0 con 0x7f237006ace0 2023-07-14T11:13:19.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.342+0000 7f238d7fa700 1 -- 172.21.15.84:0/594535843 <== mgr.4104 v2:172.21.15.84:6832/379617029 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286642 (secure 0 0 0) 0x7f23800070d0 con 0x7f237006ace0 2023-07-14T11:13:19.347 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:13:19.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.346+0000 7f23969ff700 1 -- 172.21.15.84:0/594535843 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f237006ace0 msgr2=0x7f237006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:19.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.346+0000 7f23969ff700 1 --2- 172.21.15.84:0/594535843 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f237006ace0 0x7f237006d190 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2380001360 tx=0x7f2380009040 comp rx=0 tx=0).stop 2023-07-14T11:13:19.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.346+0000 7f23969ff700 1 -- 172.21.15.84:0/594535843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f239015c950 msgr2=0x7f23900ceb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:19.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.346+0000 7f23969ff700 1 --2- 172.21.15.84:0/594535843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f239015c950 0x7f23900ceb10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f23900673b0 tx=0x7f2388004ad0 comp rx=0 tx=0).stop 2023-07-14T11:13:19.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.346+0000 7f23969ff700 1 -- 172.21.15.84:0/594535843 shutdown_connections 2023-07-14T11:13:19.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.346+0000 7f23969ff700 1 --2- 172.21.15.84:0/594535843 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f237006ace0 0x7f237006d190 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:19.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.346+0000 7f23969ff700 1 --2- 172.21.15.84:0/594535843 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23900b1e00 0x7f23901f1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:19.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.346+0000 7f23969ff700 1 --2- 172.21.15.84:0/594535843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f239015c950 0x7f23900ceb10 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:19.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.346+0000 7f23969ff700 1 --2- 172.21.15.84:0/594535843 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23900d1220 0x7f2390157240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:19.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.346+0000 7f23969ff700 1 -- 172.21.15.84:0/594535843 >> 172.21.15.84:0/594535843 conn(0x7f239009c1d0 msgr2=0x7f23900afac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:19.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.346+0000 7f23969ff700 1 -- 172.21.15.84:0/594535843 shutdown_connections 2023-07-14T11:13:19.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.346+0000 7f23969ff700 1 -- 172.21.15.84:0/594535843 wait complete. 2023-07-14T11:13:19.351 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-07-14T11:13:19.366 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-14T11:13:18.067238+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":33,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218544,"kb_used_data":2928,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754756176,"statfs":{"total":773094113280,"available":772870324224,"internally_reserved":0,"allocated":2998272,"data_stored":1817994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.110018"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.017085+0000","last_change":"2023-07-14T11:13:15.012043+0000","last_active":"2023-07-14T11:13:15.017085+0000","last_peered":"2023-07-14T11:13:15.017085+0000","last_clean":"2023-07-14T11:13:15.017085+0000","last_became_active":"2023-07-14T11:13:15.011781+0000","last_became_peered":"2023-07-14T11:13:15.011781+0000","last_unstale":"2023-07-14T11:13:15.017085+0000","last_undegraded":"2023-07-14T11:13:15.017085+0000","last_fullsized":"2023-07-14T11:13:15.017085+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:58:38.845550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.008180+0000","last_change":"2023-07-14T11:13:15.000344+0000","last_active":"2023-07-14T11:13:15.008180+0000","last_peered":"2023-07-14T11:13:15.008180+0000","last_clean":"2023-07-14T11:13:15.008180+0000","last_became_active":"2023-07-14T11:13:15.000039+0000","last_became_peered":"2023-07-14T11:13:15.000039+0000","last_unstale":"2023-07-14T11:13:15.008180+0000","last_undegraded":"2023-07-14T11:13:15.008180+0000","last_fullsized":"2023-07-14T11:13:15.008180+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:03:17.140553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.016243+0000","last_change":"2023-07-14T11:13:15.014928+0000","last_active":"2023-07-14T11:13:15.016243+0000","last_peered":"2023-07-14T11:13:15.016243+0000","last_clean":"2023-07-14T11:13:15.016243+0000","last_became_active":"2023-07-14T11:13:15.014663+0000","last_became_peered":"2023-07-14T11:13:15.014663+0000","last_unstale":"2023-07-14T11:13:15.016243+0000","last_undegraded":"2023-07-14T11:13:15.016243+0000","last_fullsized":"2023-07-14T11:13:15.016243+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:58:38.845550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.009990+0000","last_change":"2023-07-14T11:13:15.007462+0000","last_active":"2023-07-14T11:13:15.009990+0000","last_peered":"2023-07-14T11:13:15.009990+0000","last_clean":"2023-07-14T11:13:15.009990+0000","last_became_active":"2023-07-14T11:13:15.007180+0000","last_became_peered":"2023-07-14T11:13:15.007180+0000","last_unstale":"2023-07-14T11:13:15.009990+0000","last_undegraded":"2023-07-14T11:13:15.009990+0000","last_fullsized":"2023-07-14T11:13:15.009990+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:43:57.824230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.019042+0000","last_change":"2023-07-14T11:13:15.013824+0000","last_active":"2023-07-14T11:13:15.019042+0000","last_peered":"2023-07-14T11:13:15.019042+0000","last_clean":"2023-07-14T11:13:15.019042+0000","last_became_active":"2023-07-14T11:13:15.012925+0000","last_became_peered":"2023-07-14T11:13:15.012925+0000","last_unstale":"2023-07-14T11:13:15.019042+0000","last_undegraded":"2023-07-14T11:13:15.019042+0000","last_fullsized":"2023-07-14T11:13:15.019042+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:46:55.007943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.016287+0000","last_change":"2023-07-14T11:13:15.015095+0000","last_active":"2023-07-14T11:13:15.016287+0000","last_peered":"2023-07-14T11:13:15.016287+0000","last_clean":"2023-07-14T11:13:15.016287+0000","last_became_active":"2023-07-14T11:13:15.014838+0000","last_became_peered":"2023-07-14T11:13:15.014838+0000","last_unstale":"2023-07-14T11:13:15.016287+0000","last_undegraded":"2023-07-14T11:13:15.016287+0000","last_fullsized":"2023-07-14T11:13:15.016287+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:00:49.901677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.004581+0000","last_change":"2023-07-14T11:13:15.000923+0000","last_active":"2023-07-14T11:13:15.004581+0000","last_peered":"2023-07-14T11:13:15.004581+0000","last_clean":"2023-07-14T11:13:15.004581+0000","last_became_active":"2023-07-14T11:13:15.000141+0000","last_became_peered":"2023-07-14T11:13:15.000141+0000","last_unstale":"2023-07-14T11:13:15.004581+0000","last_undegraded":"2023-07-14T11:13:15.004581+0000","last_fullsized":"2023-07-14T11:13:15.004581+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:00:15.112821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.023330+0000","last_change":"2023-07-14T11:13:15.007538+0000","last_active":"2023-07-14T11:13:15.023330+0000","last_peered":"2023-07-14T11:13:15.023330+0000","last_clean":"2023-07-14T11:13:15.023330+0000","last_became_active":"2023-07-14T11:13:15.007221+0000","last_became_peered":"2023-07-14T11:13:15.007221+0000","last_unstale":"2023-07-14T11:13:15.023330+0000","last_undegraded":"2023-07-14T11:13:15.023330+0000","last_fullsized":"2023-07-14T11:13:15.023330+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:58:38.845550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.018727+0000","last_change":"2023-07-14T11:13:15.014209+0000","last_active":"2023-07-14T11:13:15.018727+0000","last_peered":"2023-07-14T11:13:15.018727+0000","last_clean":"2023-07-14T11:13:15.018727+0000","last_became_active":"2023-07-14T11:13:15.013525+0000","last_became_peered":"2023-07-14T11:13:15.013525+0000","last_unstale":"2023-07-14T11:13:15.018727+0000","last_undegraded":"2023-07-14T11:13:15.018727+0000","last_fullsized":"2023-07-14T11:13:15.018727+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:47:42.967958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.023393+0000","last_change":"2023-07-14T11:13:15.008305+0000","last_active":"2023-07-14T11:13:15.023393+0000","last_peered":"2023-07-14T11:13:15.023393+0000","last_clean":"2023-07-14T11:13:15.023393+0000","last_became_active":"2023-07-14T11:13:15.008009+0000","last_became_peered":"2023-07-14T11:13:15.008009+0000","last_unstale":"2023-07-14T11:13:15.023393+0000","last_undegraded":"2023-07-14T11:13:15.023393+0000","last_fullsized":"2023-07-14T11:13:15.023393+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:59:05.719375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.027625+0000","last_change":"2023-07-14T11:13:15.019530+0000","last_active":"2023-07-14T11:13:15.027625+0000","last_peered":"2023-07-14T11:13:15.027625+0000","last_clean":"2023-07-14T11:13:15.027625+0000","last_became_active":"2023-07-14T11:13:15.019260+0000","last_became_peered":"2023-07-14T11:13:15.019260+0000","last_unstale":"2023-07-14T11:13:15.027625+0000","last_undegraded":"2023-07-14T11:13:15.027625+0000","last_fullsized":"2023-07-14T11:13:15.027625+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:59:05.719375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.018622+0000","last_change":"2023-07-14T11:13:15.017282+0000","last_active":"2023-07-14T11:13:15.018622+0000","last_peered":"2023-07-14T11:13:15.018622+0000","last_clean":"2023-07-14T11:13:15.018622+0000","last_became_active":"2023-07-14T11:13:15.016949+0000","last_became_peered":"2023-07-14T11:13:15.016949+0000","last_unstale":"2023-07-14T11:13:15.018622+0000","last_undegraded":"2023-07-14T11:13:15.018622+0000","last_fullsized":"2023-07-14T11:13:15.018622+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:27:27.142803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.016826+0000","last_change":"2023-07-14T11:13:15.007583+0000","last_active":"2023-07-14T11:13:15.016826+0000","last_peered":"2023-07-14T11:13:15.016826+0000","last_clean":"2023-07-14T11:13:15.016826+0000","last_became_active":"2023-07-14T11:13:15.007308+0000","last_became_peered":"2023-07-14T11:13:15.007308+0000","last_unstale":"2023-07-14T11:13:15.016826+0000","last_undegraded":"2023-07-14T11:13:15.016826+0000","last_fullsized":"2023-07-14T11:13:15.016826+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:43:57.824230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.009307+0000","last_change":"2023-07-14T11:13:15.001617+0000","last_active":"2023-07-14T11:13:15.009307+0000","last_peered":"2023-07-14T11:13:15.009307+0000","last_clean":"2023-07-14T11:13:15.009307+0000","last_became_active":"2023-07-14T11:13:15.001328+0000","last_became_peered":"2023-07-14T11:13:15.001328+0000","last_unstale":"2023-07-14T11:13:15.009307+0000","last_undegraded":"2023-07-14T11:13:15.009307+0000","last_fullsized":"2023-07-14T11:13:15.009307+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:00:49.901677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.004556+0000","last_change":"2023-07-14T11:13:15.000610+0000","last_active":"2023-07-14T11:13:15.004556+0000","last_peered":"2023-07-14T11:13:15.004556+0000","last_clean":"2023-07-14T11:13:15.004556+0000","last_became_active":"2023-07-14T11:13:14.999771+0000","last_became_peered":"2023-07-14T11:13:14.999771+0000","last_unstale":"2023-07-14T11:13:15.004556+0000","last_undegraded":"2023-07-14T11:13:15.004556+0000","last_fullsized":"2023-07-14T11:13:15.004556+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:16:01.290597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.014628+0000","last_change":"2023-07-14T11:13:15.012608+0000","last_active":"2023-07-14T11:13:15.014628+0000","last_peered":"2023-07-14T11:13:15.014628+0000","last_clean":"2023-07-14T11:13:15.014628+0000","last_became_active":"2023-07-14T11:13:15.008876+0000","last_became_peered":"2023-07-14T11:13:15.008876+0000","last_unstale":"2023-07-14T11:13:15.014628+0000","last_undegraded":"2023-07-14T11:13:15.014628+0000","last_fullsized":"2023-07-14T11:13:15.014628+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:41:53.585750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.018710+0000","last_change":"2023-07-14T11:13:15.013846+0000","last_active":"2023-07-14T11:13:15.018710+0000","last_peered":"2023-07-14T11:13:15.018710+0000","last_clean":"2023-07-14T11:13:15.018710+0000","last_became_active":"2023-07-14T11:13:15.013207+0000","last_became_peered":"2023-07-14T11:13:15.013207+0000","last_unstale":"2023-07-14T11:13:15.018710+0000","last_undegraded":"2023-07-14T11:13:15.018710+0000","last_fullsized":"2023-07-14T11:13:15.018710+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:42:28.587522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.027513+0000","last_change":"2023-07-14T11:13:15.016833+0000","last_active":"2023-07-14T11:13:15.027513+0000","last_peered":"2023-07-14T11:13:15.027513+0000","last_clean":"2023-07-14T11:13:15.027513+0000","last_became_active":"2023-07-14T11:13:15.016507+0000","last_became_peered":"2023-07-14T11:13:15.016507+0000","last_unstale":"2023-07-14T11:13:15.027513+0000","last_undegraded":"2023-07-14T11:13:15.027513+0000","last_fullsized":"2023-07-14T11:13:15.027513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:59:16.072212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.002809+0000","last_change":"2023-07-14T11:13:14.994609+0000","last_active":"2023-07-14T11:13:15.002809+0000","last_peered":"2023-07-14T11:13:15.002809+0000","last_clean":"2023-07-14T11:13:15.002809+0000","last_became_active":"2023-07-14T11:13:14.994280+0000","last_became_peered":"2023-07-14T11:13:14.994280+0000","last_unstale":"2023-07-14T11:13:15.002809+0000","last_undegraded":"2023-07-14T11:13:15.002809+0000","last_fullsized":"2023-07-14T11:13:15.002809+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:59:16.072212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.015715+0000","last_change":"2023-07-14T11:13:15.013542+0000","last_active":"2023-07-14T11:13:15.015715+0000","last_peered":"2023-07-14T11:13:15.015715+0000","last_clean":"2023-07-14T11:13:15.015715+0000","last_became_active":"2023-07-14T11:13:15.013278+0000","last_became_peered":"2023-07-14T11:13:15.013278+0000","last_unstale":"2023-07-14T11:13:15.015715+0000","last_undegraded":"2023-07-14T11:13:15.015715+0000","last_fullsized":"2023-07-14T11:13:15.015715+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:43:57.824230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.026012+0000","last_change":"2023-07-14T11:13:15.022035+0000","last_active":"2023-07-14T11:13:15.026012+0000","last_peered":"2023-07-14T11:13:15.026012+0000","last_clean":"2023-07-14T11:13:15.026012+0000","last_became_active":"2023-07-14T11:13:15.021666+0000","last_became_peered":"2023-07-14T11:13:15.021666+0000","last_unstale":"2023-07-14T11:13:15.026012+0000","last_undegraded":"2023-07-14T11:13:15.026012+0000","last_fullsized":"2023-07-14T11:13:15.026012+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:25:49.179942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.018603+0000","last_change":"2023-07-14T11:13:15.013591+0000","last_active":"2023-07-14T11:13:15.018603+0000","last_peered":"2023-07-14T11:13:15.018603+0000","last_clean":"2023-07-14T11:13:15.018603+0000","last_became_active":"2023-07-14T11:13:15.013300+0000","last_became_peered":"2023-07-14T11:13:15.013300+0000","last_unstale":"2023-07-14T11:13:15.018603+0000","last_undegraded":"2023-07-14T11:13:15.018603+0000","last_fullsized":"2023-07-14T11:13:15.018603+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:00:49.901677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.016471+0000","last_change":"2023-07-14T11:13:15.008804+0000","last_active":"2023-07-14T11:13:15.016471+0000","last_peered":"2023-07-14T11:13:15.016471+0000","last_clean":"2023-07-14T11:13:15.016471+0000","last_became_active":"2023-07-14T11:13:15.007948+0000","last_became_peered":"2023-07-14T11:13:15.007948+0000","last_unstale":"2023-07-14T11:13:15.016471+0000","last_undegraded":"2023-07-14T11:13:15.016471+0000","last_fullsized":"2023-07-14T11:13:15.016471+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:58:38.845550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.009281+0000","last_change":"2023-07-14T11:13:15.006574+0000","last_active":"2023-07-14T11:13:15.009281+0000","last_peered":"2023-07-14T11:13:15.009281+0000","last_clean":"2023-07-14T11:13:15.009281+0000","last_became_active":"2023-07-14T11:13:15.006129+0000","last_became_peered":"2023-07-14T11:13:15.006129+0000","last_unstale":"2023-07-14T11:13:15.009281+0000","last_undegraded":"2023-07-14T11:13:15.009281+0000","last_fullsized":"2023-07-14T11:13:15.009281+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:19:17.400582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:14.999667+0000","last_change":"2023-07-14T11:13:14.995683+0000","last_active":"2023-07-14T11:13:14.999667+0000","last_peered":"2023-07-14T11:13:14.999667+0000","last_clean":"2023-07-14T11:13:14.999667+0000","last_became_active":"2023-07-14T11:13:14.995379+0000","last_became_peered":"2023-07-14T11:13:14.995379+0000","last_unstale":"2023-07-14T11:13:14.999667+0000","last_undegraded":"2023-07-14T11:13:14.999667+0000","last_fullsized":"2023-07-14T11:13:14.999667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:59:05.719375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.011968+0000","last_change":"2023-07-14T11:13:15.001711+0000","last_active":"2023-07-14T11:13:15.011968+0000","last_peered":"2023-07-14T11:13:15.011968+0000","last_clean":"2023-07-14T11:13:15.011968+0000","last_became_active":"2023-07-14T11:13:15.000809+0000","last_became_peered":"2023-07-14T11:13:15.000809+0000","last_unstale":"2023-07-14T11:13:15.011968+0000","last_undegraded":"2023-07-14T11:13:15.011968+0000","last_fullsized":"2023-07-14T11:13:15.011968+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:36:50.668482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.007747+0000","last_change":"2023-07-14T11:13:15.001781+0000","last_active":"2023-07-14T11:13:15.007747+0000","last_peered":"2023-07-14T11:13:15.007747+0000","last_clean":"2023-07-14T11:13:15.007747+0000","last_became_active":"2023-07-14T11:13:15.001509+0000","last_became_peered":"2023-07-14T11:13:15.001509+0000","last_unstale":"2023-07-14T11:13:15.007747+0000","last_undegraded":"2023-07-14T11:13:15.007747+0000","last_fullsized":"2023-07-14T11:13:15.007747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:14:42.298292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.029107+0000","last_change":"2023-07-14T11:13:13.986413+0000","last_active":"2023-07-14T11:13:15.029107+0000","last_peered":"2023-07-14T11:13:15.029107+0000","last_clean":"2023-07-14T11:13:15.029107+0000","last_became_active":"2023-07-14T11:13:13.986200+0000","last_became_peered":"2023-07-14T11:13:13.986200+0000","last_unstale":"2023-07-14T11:13:15.029107+0000","last_undegraded":"2023-07-14T11:13:15.029107+0000","last_fullsized":"2023-07-14T11:13:15.029107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:45:00.022408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.019039+0000","last_change":"2023-07-14T11:13:15.013058+0000","last_active":"2023-07-14T11:13:15.019039+0000","last_peered":"2023-07-14T11:13:15.019039+0000","last_clean":"2023-07-14T11:13:15.019039+0000","last_became_active":"2023-07-14T11:13:15.012721+0000","last_became_peered":"2023-07-14T11:13:15.012721+0000","last_unstale":"2023-07-14T11:13:15.019039+0000","last_undegraded":"2023-07-14T11:13:15.019039+0000","last_fullsized":"2023-07-14T11:13:15.019039+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:59:16.072212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:14.983656+0000","last_change":"2023-07-14T11:13:13.982240+0000","last_active":"2023-07-14T11:13:14.983656+0000","last_peered":"2023-07-14T11:13:14.983656+0000","last_clean":"2023-07-14T11:13:14.983656+0000","last_became_active":"2023-07-14T11:13:13.981974+0000","last_became_peered":"2023-07-14T11:13:13.981974+0000","last_unstale":"2023-07-14T11:13:14.983656+0000","last_undegraded":"2023-07-14T11:13:14.983656+0000","last_fullsized":"2023-07-14T11:13:14.983656+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:59:15.067078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.027282+0000","last_change":"2023-07-14T11:13:15.024726+0000","last_active":"2023-07-14T11:13:15.027282+0000","last_peered":"2023-07-14T11:13:15.027282+0000","last_clean":"2023-07-14T11:13:15.027282+0000","last_became_active":"2023-07-14T11:13:15.024453+0000","last_became_peered":"2023-07-14T11:13:15.024453+0000","last_unstale":"2023-07-14T11:13:15.027282+0000","last_undegraded":"2023-07-14T11:13:15.027282+0000","last_fullsized":"2023-07-14T11:13:15.027282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:11:14.713367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:14.994171+0000","last_change":"2023-07-14T11:13:13.979433+0000","last_active":"2023-07-14T11:13:14.994171+0000","last_peered":"2023-07-14T11:13:14.994171+0000","last_clean":"2023-07-14T11:13:14.994171+0000","last_became_active":"2023-07-14T11:13:13.979120+0000","last_became_peered":"2023-07-14T11:13:13.979120+0000","last_unstale":"2023-07-14T11:13:14.994171+0000","last_undegraded":"2023-07-14T11:13:14.994171+0000","last_fullsized":"2023-07-14T11:13:14.994171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:00:48.896543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.004384+0000","last_change":"2023-07-14T11:13:14.998412+0000","last_active":"2023-07-14T11:13:15.004384+0000","last_peered":"2023-07-14T11:13:15.004384+0000","last_clean":"2023-07-14T11:13:15.004384+0000","last_became_active":"2023-07-14T11:13:14.998117+0000","last_became_peered":"2023-07-14T11:13:14.998117+0000","last_unstale":"2023-07-14T11:13:15.004384+0000","last_undegraded":"2023-07-14T11:13:15.004384+0000","last_fullsized":"2023-07-14T11:13:15.004384+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:47:42.967958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:14.993484+0000","last_change":"2023-07-14T11:13:13.990938+0000","last_active":"2023-07-14T11:13:14.993484+0000","last_peered":"2023-07-14T11:13:14.993484+0000","last_clean":"2023-07-14T11:13:14.993484+0000","last_became_active":"2023-07-14T11:13:13.990590+0000","last_became_peered":"2023-07-14T11:13:13.990590+0000","last_unstale":"2023-07-14T11:13:14.993484+0000","last_undegraded":"2023-07-14T11:13:14.993484+0000","last_fullsized":"2023-07-14T11:13:14.993484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:40:55.858851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.018934+0000","last_change":"2023-07-14T11:13:15.012816+0000","last_active":"2023-07-14T11:13:15.018934+0000","last_peered":"2023-07-14T11:13:15.018934+0000","last_clean":"2023-07-14T11:13:15.018934+0000","last_became_active":"2023-07-14T11:13:15.012565+0000","last_became_peered":"2023-07-14T11:13:15.012565+0000","last_unstale":"2023-07-14T11:13:15.018934+0000","last_undegraded":"2023-07-14T11:13:15.018934+0000","last_fullsized":"2023-07-14T11:13:15.018934+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:11:28.195310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:14.987036+0000","last_change":"2023-07-14T11:13:13.979704+0000","last_active":"2023-07-14T11:13:14.987036+0000","last_peered":"2023-07-14T11:13:14.987036+0000","last_clean":"2023-07-14T11:13:14.987036+0000","last_became_active":"2023-07-14T11:13:13.978362+0000","last_became_peered":"2023-07-14T11:13:13.978362+0000","last_unstale":"2023-07-14T11:13:14.987036+0000","last_undegraded":"2023-07-14T11:13:14.987036+0000","last_fullsized":"2023-07-14T11:13:14.987036+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:36:49.663348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.016509+0000","last_change":"2023-07-14T11:13:15.009208+0000","last_active":"2023-07-14T11:13:15.016509+0000","last_peered":"2023-07-14T11:13:15.016509+0000","last_clean":"2023-07-14T11:13:15.016509+0000","last_became_active":"2023-07-14T11:13:15.008572+0000","last_became_peered":"2023-07-14T11:13:15.008572+0000","last_unstale":"2023-07-14T11:13:15.016509+0000","last_undegraded":"2023-07-14T11:13:15.016509+0000","last_fullsized":"2023-07-14T11:13:15.016509+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:13:04.773850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.031418+0000","last_change":"2023-07-14T11:13:13.984123+0000","last_active":"2023-07-14T11:13:15.031418+0000","last_peered":"2023-07-14T11:13:15.031418+0000","last_clean":"2023-07-14T11:13:15.031418+0000","last_became_active":"2023-07-14T11:13:13.983850+0000","last_became_peered":"2023-07-14T11:13:13.983850+0000","last_unstale":"2023-07-14T11:13:15.031418+0000","last_undegraded":"2023-07-14T11:13:15.031418+0000","last_fullsized":"2023-07-14T11:13:15.031418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:24:32.366039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.008874+0000","last_change":"2023-07-14T11:13:14.996379+0000","last_active":"2023-07-14T11:13:15.008874+0000","last_peered":"2023-07-14T11:13:15.008874+0000","last_clean":"2023-07-14T11:13:15.008874+0000","last_became_active":"2023-07-14T11:13:14.996054+0000","last_became_peered":"2023-07-14T11:13:14.996054+0000","last_unstale":"2023-07-14T11:13:15.008874+0000","last_undegraded":"2023-07-14T11:13:15.008874+0000","last_fullsized":"2023-07-14T11:13:15.008874+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:43:57.824230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"22'6","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.032601+0000","last_change":"2023-07-14T11:13:13.985526+0000","last_active":"2023-07-14T11:13:15.032601+0000","last_peered":"2023-07-14T11:13:15.032601+0000","last_clean":"2023-07-14T11:13:15.032601+0000","last_became_active":"2023-07-14T11:13:13.985067+0000","last_became_peered":"2023-07-14T11:13:13.985067+0000","last_unstale":"2023-07-14T11:13:15.032601+0000","last_undegraded":"2023-07-14T11:13:15.032601+0000","last_fullsized":"2023-07-14T11:13:15.032601+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:11:13.708234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.027455+0000","last_change":"2023-07-14T11:13:15.016170+0000","last_active":"2023-07-14T11:13:15.027455+0000","last_peered":"2023-07-14T11:13:15.027455+0000","last_clean":"2023-07-14T11:13:15.027455+0000","last_became_active":"2023-07-14T11:13:15.015912+0000","last_became_peered":"2023-07-14T11:13:15.015912+0000","last_unstale":"2023-07-14T11:13:15.027455+0000","last_undegraded":"2023-07-14T11:13:15.027455+0000","last_fullsized":"2023-07-14T11:13:15.027455+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:03:17.140553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.029682+0000","last_change":"2023-07-14T11:13:13.992370+0000","last_active":"2023-07-14T11:13:15.029682+0000","last_peered":"2023-07-14T11:13:15.029682+0000","last_clean":"2023-07-14T11:13:15.029682+0000","last_became_active":"2023-07-14T11:13:13.992063+0000","last_became_peered":"2023-07-14T11:13:13.992063+0000","last_unstale":"2023-07-14T11:13:15.029682+0000","last_undegraded":"2023-07-14T11:13:15.029682+0000","last_fullsized":"2023-07-14T11:13:15.029682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:48:45.385596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.017829+0000","last_change":"2023-07-14T11:13:15.010039+0000","last_active":"2023-07-14T11:13:15.017829+0000","last_peered":"2023-07-14T11:13:15.017829+0000","last_clean":"2023-07-14T11:13:15.017829+0000","last_became_active":"2023-07-14T11:13:15.009733+0000","last_became_peered":"2023-07-14T11:13:15.009733+0000","last_unstale":"2023-07-14T11:13:15.017829+0000","last_undegraded":"2023-07-14T11:13:15.017829+0000","last_fullsized":"2023-07-14T11:13:15.017829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:27:27.142803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:14.997308+0000","last_change":"2023-07-14T11:13:13.977355+0000","last_active":"2023-07-14T11:13:14.997308+0000","last_peered":"2023-07-14T11:13:14.997308+0000","last_clean":"2023-07-14T11:13:14.997308+0000","last_became_active":"2023-07-14T11:13:13.977018+0000","last_became_peered":"2023-07-14T11:13:13.977018+0000","last_unstale":"2023-07-14T11:13:14.997308+0000","last_undegraded":"2023-07-14T11:13:14.997308+0000","last_fullsized":"2023-07-14T11:13:14.997308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:59:04.714241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.007728+0000","last_change":"2023-07-14T11:13:15.000625+0000","last_active":"2023-07-14T11:13:15.007728+0000","last_peered":"2023-07-14T11:13:15.007728+0000","last_clean":"2023-07-14T11:13:15.007728+0000","last_became_active":"2023-07-14T11:13:15.000327+0000","last_became_peered":"2023-07-14T11:13:15.000327+0000","last_unstale":"2023-07-14T11:13:15.007728+0000","last_undegraded":"2023-07-14T11:13:15.007728+0000","last_fullsized":"2023-07-14T11:13:15.007728+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:11:14.713367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:14.989207+0000","last_change":"2023-07-14T11:13:13.991381+0000","last_active":"2023-07-14T11:13:14.989207+0000","last_peered":"2023-07-14T11:13:14.989207+0000","last_clean":"2023-07-14T11:13:14.989207+0000","last_became_active":"2023-07-14T11:13:13.991045+0000","last_became_peered":"2023-07-14T11:13:13.991045+0000","last_unstale":"2023-07-14T11:13:14.989207+0000","last_undegraded":"2023-07-14T11:13:14.989207+0000","last_fullsized":"2023-07-14T11:13:14.989207+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:44:31.620403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.018647+0000","last_change":"2023-07-14T11:13:15.014077+0000","last_active":"2023-07-14T11:13:15.018647+0000","last_peered":"2023-07-14T11:13:15.018647+0000","last_clean":"2023-07-14T11:13:15.018647+0000","last_became_active":"2023-07-14T11:13:15.013318+0000","last_became_peered":"2023-07-14T11:13:15.013318+0000","last_unstale":"2023-07-14T11:13:15.018647+0000","last_undegraded":"2023-07-14T11:13:15.018647+0000","last_fullsized":"2023-07-14T11:13:15.018647+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:03:17.140553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.022375+0000","last_change":"2023-07-14T11:13:13.991024+0000","last_active":"2023-07-14T11:13:15.022375+0000","last_peered":"2023-07-14T11:13:15.022375+0000","last_clean":"2023-07-14T11:13:15.022375+0000","last_became_active":"2023-07-14T11:13:13.990641+0000","last_became_peered":"2023-07-14T11:13:13.990641+0000","last_unstale":"2023-07-14T11:13:15.022375+0000","last_undegraded":"2023-07-14T11:13:15.022375+0000","last_fullsized":"2023-07-14T11:13:15.022375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:58:37.840416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.011435+0000","last_change":"2023-07-14T11:13:15.004063+0000","last_active":"2023-07-14T11:13:15.011435+0000","last_peered":"2023-07-14T11:13:15.011435+0000","last_clean":"2023-07-14T11:13:15.011435+0000","last_became_active":"2023-07-14T11:13:15.003754+0000","last_became_peered":"2023-07-14T11:13:15.003754+0000","last_unstale":"2023-07-14T11:13:15.011435+0000","last_undegraded":"2023-07-14T11:13:15.011435+0000","last_fullsized":"2023-07-14T11:13:15.011435+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:42:28.587522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.026809+0000","last_change":"2023-07-14T11:13:13.991618+0000","last_active":"2023-07-14T11:13:15.026809+0000","last_peered":"2023-07-14T11:13:15.026809+0000","last_clean":"2023-07-14T11:13:15.026809+0000","last_became_active":"2023-07-14T11:13:13.991310+0000","last_became_peered":"2023-07-14T11:13:13.991310+0000","last_unstale":"2023-07-14T11:13:15.026809+0000","last_undegraded":"2023-07-14T11:13:15.026809+0000","last_fullsized":"2023-07-14T11:13:15.026809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:43:56.126136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.007681+0000","last_change":"2023-07-14T11:13:15.000022+0000","last_active":"2023-07-14T11:13:15.007681+0000","last_peered":"2023-07-14T11:13:15.007681+0000","last_clean":"2023-07-14T11:13:15.007681+0000","last_became_active":"2023-07-14T11:13:14.999632+0000","last_became_peered":"2023-07-14T11:13:14.999632+0000","last_unstale":"2023-07-14T11:13:15.007681+0000","last_undegraded":"2023-07-14T11:13:15.007681+0000","last_fullsized":"2023-07-14T11:13:15.007681+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:13:04.773850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.029057+0000","last_change":"2023-07-14T11:13:13.991415+0000","last_active":"2023-07-14T11:13:15.029057+0000","last_peered":"2023-07-14T11:13:15.029057+0000","last_clean":"2023-07-14T11:13:15.029057+0000","last_became_active":"2023-07-14T11:13:13.991182+0000","last_became_peered":"2023-07-14T11:13:13.991182+0000","last_unstale":"2023-07-14T11:13:15.029057+0000","last_undegraded":"2023-07-14T11:13:15.029057+0000","last_fullsized":"2023-07-14T11:13:15.029057+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:48:04.402813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.027851+0000","last_change":"2023-07-14T11:13:15.022123+0000","last_active":"2023-07-14T11:13:15.027851+0000","last_peered":"2023-07-14T11:13:15.027851+0000","last_clean":"2023-07-14T11:13:15.027851+0000","last_became_active":"2023-07-14T11:13:15.016892+0000","last_became_peered":"2023-07-14T11:13:15.016892+0000","last_unstale":"2023-07-14T11:13:15.027851+0000","last_undegraded":"2023-07-14T11:13:15.027851+0000","last_fullsized":"2023-07-14T11:13:15.027851+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:11:28.195310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.029632+0000","last_change":"2023-07-14T11:13:13.989926+0000","last_active":"2023-07-14T11:13:15.029632+0000","last_peered":"2023-07-14T11:13:15.029632+0000","last_clean":"2023-07-14T11:13:15.029632+0000","last_became_active":"2023-07-14T11:13:13.989600+0000","last_became_peered":"2023-07-14T11:13:13.989600+0000","last_unstale":"2023-07-14T11:13:15.029632+0000","last_undegraded":"2023-07-14T11:13:15.029632+0000","last_fullsized":"2023-07-14T11:13:15.029632+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:46:46.842842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.010591+0000","last_change":"2023-07-14T11:13:15.004391+0000","last_active":"2023-07-14T11:13:15.010591+0000","last_peered":"2023-07-14T11:13:15.010591+0000","last_clean":"2023-07-14T11:13:15.010591+0000","last_became_active":"2023-07-14T11:13:14.999504+0000","last_became_peered":"2023-07-14T11:13:14.999504+0000","last_unstale":"2023-07-14T11:13:15.010591+0000","last_undegraded":"2023-07-14T11:13:15.010591+0000","last_fullsized":"2023-07-14T11:13:15.010591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:42:28.587522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:14.986898+0000","last_change":"2023-07-14T11:13:13.979533+0000","last_active":"2023-07-14T11:13:14.986898+0000","last_peered":"2023-07-14T11:13:14.986898+0000","last_clean":"2023-07-14T11:13:14.986898+0000","last_became_active":"2023-07-14T11:13:13.979160+0000","last_became_peered":"2023-07-14T11:13:13.979160+0000","last_unstale":"2023-07-14T11:13:14.986898+0000","last_undegraded":"2023-07-14T11:13:14.986898+0000","last_fullsized":"2023-07-14T11:13:14.986898+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:45:00.022408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.019921+0000","last_change":"2023-07-14T11:13:15.016320+0000","last_active":"2023-07-14T11:13:15.019921+0000","last_peered":"2023-07-14T11:13:15.019921+0000","last_clean":"2023-07-14T11:13:15.019921+0000","last_became_active":"2023-07-14T11:13:15.016023+0000","last_became_peered":"2023-07-14T11:13:15.016023+0000","last_unstale":"2023-07-14T11:13:15.019921+0000","last_undegraded":"2023-07-14T11:13:15.019921+0000","last_fullsized":"2023-07-14T11:13:15.019921+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:43:57.824230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.025574+0000","last_change":"2023-07-14T11:13:13.987628+0000","last_active":"2023-07-14T11:13:15.025574+0000","last_peered":"2023-07-14T11:13:15.025574+0000","last_clean":"2023-07-14T11:13:15.025574+0000","last_became_active":"2023-07-14T11:13:13.987361+0000","last_became_peered":"2023-07-14T11:13:13.987361+0000","last_unstale":"2023-07-14T11:13:15.025574+0000","last_undegraded":"2023-07-14T11:13:15.025574+0000","last_fullsized":"2023-07-14T11:13:15.025574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:03:16.135420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.027782+0000","last_change":"2023-07-14T11:13:15.021655+0000","last_active":"2023-07-14T11:13:15.027782+0000","last_peered":"2023-07-14T11:13:15.027782+0000","last_clean":"2023-07-14T11:13:15.027782+0000","last_became_active":"2023-07-14T11:13:15.018683+0000","last_became_peered":"2023-07-14T11:13:15.018683+0000","last_unstale":"2023-07-14T11:13:15.027782+0000","last_undegraded":"2023-07-14T11:13:15.027782+0000","last_fullsized":"2023-07-14T11:13:15.027782+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:40:56.863985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:14.990225+0000","last_change":"2023-07-14T11:13:13.992123+0000","last_active":"2023-07-14T11:13:14.990225+0000","last_peered":"2023-07-14T11:13:14.990225+0000","last_clean":"2023-07-14T11:13:14.990225+0000","last_became_active":"2023-07-14T11:13:13.991832+0000","last_became_peered":"2023-07-14T11:13:13.991832+0000","last_unstale":"2023-07-14T11:13:14.990225+0000","last_undegraded":"2023-07-14T11:13:14.990225+0000","last_fullsized":"2023-07-14T11:13:14.990225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:40:55.858851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.027576+0000","last_change":"2023-07-14T11:13:15.019054+0000","last_active":"2023-07-14T11:13:15.027576+0000","last_peered":"2023-07-14T11:13:15.027576+0000","last_clean":"2023-07-14T11:13:15.027576+0000","last_became_active":"2023-07-14T11:13:15.018737+0000","last_became_peered":"2023-07-14T11:13:15.018737+0000","last_unstale":"2023-07-14T11:13:15.027576+0000","last_undegraded":"2023-07-14T11:13:15.027576+0000","last_fullsized":"2023-07-14T11:13:15.027576+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:27:27.142803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.004322+0000","last_change":"2023-07-14T11:13:13.986400+0000","last_active":"2023-07-14T11:13:15.004322+0000","last_peered":"2023-07-14T11:13:15.004322+0000","last_clean":"2023-07-14T11:13:15.004322+0000","last_became_active":"2023-07-14T11:13:13.986081+0000","last_became_peered":"2023-07-14T11:13:13.986081+0000","last_unstale":"2023-07-14T11:13:15.004322+0000","last_undegraded":"2023-07-14T11:13:15.004322+0000","last_fullsized":"2023-07-14T11:13:15.004322+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:46:54.002810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.013281+0000","last_change":"2023-07-14T11:13:15.011241+0000","last_active":"2023-07-14T11:13:15.013281+0000","last_peered":"2023-07-14T11:13:15.013281+0000","last_clean":"2023-07-14T11:13:15.013281+0000","last_became_active":"2023-07-14T11:13:15.010955+0000","last_became_peered":"2023-07-14T11:13:15.010955+0000","last_unstale":"2023-07-14T11:13:15.013281+0000","last_undegraded":"2023-07-14T11:13:15.013281+0000","last_fullsized":"2023-07-14T11:13:15.013281+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:47:42.967958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:14.995486+0000","last_change":"2023-07-14T11:13:13.982073+0000","last_active":"2023-07-14T11:13:14.995486+0000","last_peered":"2023-07-14T11:13:14.995486+0000","last_clean":"2023-07-14T11:13:14.995486+0000","last_became_active":"2023-07-14T11:13:13.981729+0000","last_became_peered":"2023-07-14T11:13:13.981729+0000","last_unstale":"2023-07-14T11:13:14.995486+0000","last_undegraded":"2023-07-14T11:13:14.995486+0000","last_fullsized":"2023-07-14T11:13:14.995486+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:46:54.002810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.018666+0000","last_change":"2023-07-14T11:13:15.008740+0000","last_active":"2023-07-14T11:13:15.018666+0000","last_peered":"2023-07-14T11:13:15.018666+0000","last_clean":"2023-07-14T11:13:15.018666+0000","last_became_active":"2023-07-14T11:13:15.008487+0000","last_became_peered":"2023-07-14T11:13:15.008487+0000","last_unstale":"2023-07-14T11:13:15.018666+0000","last_undegraded":"2023-07-14T11:13:15.018666+0000","last_fullsized":"2023-07-14T11:13:15.018666+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:45:01.027542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:14.985540+0000","last_change":"2023-07-14T11:13:08.923786+0000","last_active":"2023-07-14T11:13:14.985540+0000","last_peered":"2023-07-14T11:13:14.985540+0000","last_clean":"2023-07-14T11:13:14.985540+0000","last_became_active":"2023-07-14T11:13:08.923384+0000","last_became_peered":"2023-07-14T11:13:08.923384+0000","last_unstale":"2023-07-14T11:13:14.985540+0000","last_undegraded":"2023-07-14T11:13:14.985540+0000","last_fullsized":"2023-07-14T11:13:14.985540+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:46:48.794410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:14.989662+0000","last_change":"2023-07-14T11:13:13.979901+0000","last_active":"2023-07-14T11:13:14.989662+0000","last_peered":"2023-07-14T11:13:14.989662+0000","last_clean":"2023-07-14T11:13:14.989662+0000","last_became_active":"2023-07-14T11:13:13.979617+0000","last_became_peered":"2023-07-14T11:13:13.979617+0000","last_unstale":"2023-07-14T11:13:14.989662+0000","last_undegraded":"2023-07-14T11:13:14.989662+0000","last_fullsized":"2023-07-14T11:13:14.989662+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:00:14.107687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.011855+0000","last_change":"2023-07-14T11:13:14.999336+0000","last_active":"2023-07-14T11:13:15.011855+0000","last_peered":"2023-07-14T11:13:15.011855+0000","last_clean":"2023-07-14T11:13:15.011855+0000","last_became_active":"2023-07-14T11:13:14.999023+0000","last_became_peered":"2023-07-14T11:13:14.999023+0000","last_unstale":"2023-07-14T11:13:15.011855+0000","last_undegraded":"2023-07-14T11:13:15.011855+0000","last_fullsized":"2023-07-14T11:13:15.011855+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:00:49.901677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:14.987963+0000","last_change":"2023-07-14T11:13:08.758749+0000","last_active":"2023-07-14T11:13:14.987963+0000","last_peered":"2023-07-14T11:13:14.987963+0000","last_clean":"2023-07-14T11:13:14.987963+0000","last_became_active":"2023-07-14T11:13:08.757956+0000","last_became_peered":"2023-07-14T11:13:08.757956+0000","last_unstale":"2023-07-14T11:13:14.987963+0000","last_undegraded":"2023-07-14T11:13:14.987963+0000","last_fullsized":"2023-07-14T11:13:14.987963+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:47:59.194413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.004154+0000","last_change":"2023-07-14T11:13:13.987810+0000","last_active":"2023-07-14T11:13:15.004154+0000","last_peered":"2023-07-14T11:13:15.004154+0000","last_clean":"2023-07-14T11:13:15.004154+0000","last_became_active":"2023-07-14T11:13:13.987575+0000","last_became_peered":"2023-07-14T11:13:13.987575+0000","last_unstale":"2023-07-14T11:13:15.004154+0000","last_undegraded":"2023-07-14T11:13:15.004154+0000","last_fullsized":"2023-07-14T11:13:15.004154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:13:03.768716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.012080+0000","last_change":"2023-07-14T11:13:15.000483+0000","last_active":"2023-07-14T11:13:15.012080+0000","last_peered":"2023-07-14T11:13:15.012080+0000","last_clean":"2023-07-14T11:13:15.012080+0000","last_became_active":"2023-07-14T11:13:15.000027+0000","last_became_peered":"2023-07-14T11:13:15.000027+0000","last_unstale":"2023-07-14T11:13:15.012080+0000","last_undegraded":"2023-07-14T11:13:15.012080+0000","last_fullsized":"2023-07-14T11:13:15.012080+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:13:04.773850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:14.985256+0000","last_change":"2023-07-14T11:13:08.862331+0000","last_active":"2023-07-14T11:13:14.985256+0000","last_peered":"2023-07-14T11:13:14.985256+0000","last_clean":"2023-07-14T11:13:14.985256+0000","last_became_active":"2023-07-14T11:13:08.861817+0000","last_became_peered":"2023-07-14T11:13:08.861817+0000","last_unstale":"2023-07-14T11:13:14.985256+0000","last_undegraded":"2023-07-14T11:13:14.985256+0000","last_fullsized":"2023-07-14T11:13:14.985256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:00:01.976611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:14.984002+0000","last_change":"2023-07-14T11:13:13.979826+0000","last_active":"2023-07-14T11:13:14.984002+0000","last_peered":"2023-07-14T11:13:14.984002+0000","last_clean":"2023-07-14T11:13:14.984002+0000","last_became_active":"2023-07-14T11:13:13.979506+0000","last_became_peered":"2023-07-14T11:13:13.979506+0000","last_unstale":"2023-07-14T11:13:14.984002+0000","last_undegraded":"2023-07-14T11:13:14.984002+0000","last_fullsized":"2023-07-14T11:13:14.984002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:27:26.137669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.011915+0000","last_change":"2023-07-14T11:13:14.999511+0000","last_active":"2023-07-14T11:13:15.011915+0000","last_peered":"2023-07-14T11:13:15.011915+0000","last_clean":"2023-07-14T11:13:15.011915+0000","last_became_active":"2023-07-14T11:13:14.999201+0000","last_became_peered":"2023-07-14T11:13:14.999201+0000","last_unstale":"2023-07-14T11:13:15.011915+0000","last_undegraded":"2023-07-14T11:13:15.011915+0000","last_fullsized":"2023-07-14T11:13:15.011915+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:11:14.713367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:14.985089+0000","last_change":"2023-07-14T11:13:08.757882+0000","last_active":"2023-07-14T11:13:14.985089+0000","last_peered":"2023-07-14T11:13:14.985089+0000","last_clean":"2023-07-14T11:13:14.985089+0000","last_became_active":"2023-07-14T11:13:08.757541+0000","last_became_peered":"2023-07-14T11:13:08.757541+0000","last_unstale":"2023-07-14T11:13:14.985089+0000","last_undegraded":"2023-07-14T11:13:14.985089+0000","last_fullsized":"2023-07-14T11:13:14.985089+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:27:20.929269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":173,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:14.989962+0000","last_change":"2023-07-14T11:13:01.370649+0000","last_active":"2023-07-14T11:13:14.989962+0000","last_peered":"2023-07-14T11:13:14.989962+0000","last_clean":"2023-07-14T11:13:14.989962+0000","last_became_active":"2023-07-14T11:13:01.369478+0000","last_became_peered":"2023-07-14T11:13:01.369478+0000","last_unstale":"2023-07-14T11:13:14.989962+0000","last_undegraded":"2023-07-14T11:13:14.989962+0000","last_fullsized":"2023-07-14T11:13:14.989962+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:00.254800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:00.254800+0000","last_clean_scrub_stamp":"2023-07-14T11:13:00.254800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:01:54.821359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:14.992492+0000","last_change":"2023-07-14T11:13:13.989456+0000","last_active":"2023-07-14T11:13:14.992492+0000","last_peered":"2023-07-14T11:13:14.992492+0000","last_clean":"2023-07-14T11:13:14.992492+0000","last_became_active":"2023-07-14T11:13:13.989210+0000","last_became_peered":"2023-07-14T11:13:13.989210+0000","last_unstale":"2023-07-14T11:13:14.992492+0000","last_undegraded":"2023-07-14T11:13:14.992492+0000","last_fullsized":"2023-07-14T11:13:14.992492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:47:41.962824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.023903+0000","last_change":"2023-07-14T11:13:15.020682+0000","last_active":"2023-07-14T11:13:15.023903+0000","last_peered":"2023-07-14T11:13:15.023903+0000","last_clean":"2023-07-14T11:13:15.023903+0000","last_became_active":"2023-07-14T11:13:15.020395+0000","last_became_peered":"2023-07-14T11:13:15.020395+0000","last_unstale":"2023-07-14T11:13:15.023903+0000","last_undegraded":"2023-07-14T11:13:15.023903+0000","last_fullsized":"2023-07-14T11:13:15.023903+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:59:16.072212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:14.991078+0000","last_change":"2023-07-14T11:13:08.760609+0000","last_active":"2023-07-14T11:13:14.991078+0000","last_peered":"2023-07-14T11:13:14.991078+0000","last_clean":"2023-07-14T11:13:14.991078+0000","last_became_active":"2023-07-14T11:13:08.760285+0000","last_became_peered":"2023-07-14T11:13:08.760285+0000","last_unstale":"2023-07-14T11:13:14.991078+0000","last_undegraded":"2023-07-14T11:13:14.991078+0000","last_fullsized":"2023-07-14T11:13:14.991078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:15:21.263931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:14.993438+0000","last_change":"2023-07-14T11:13:13.985223+0000","last_active":"2023-07-14T11:13:14.993438+0000","last_peered":"2023-07-14T11:13:14.993438+0000","last_clean":"2023-07-14T11:13:14.993438+0000","last_became_active":"2023-07-14T11:13:13.984889+0000","last_became_peered":"2023-07-14T11:13:13.984889+0000","last_unstale":"2023-07-14T11:13:14.993438+0000","last_undegraded":"2023-07-14T11:13:14.993438+0000","last_fullsized":"2023-07-14T11:13:14.993438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:00:07.185011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.018665+0000","last_change":"2023-07-14T11:13:15.014139+0000","last_active":"2023-07-14T11:13:15.018665+0000","last_peered":"2023-07-14T11:13:15.018665+0000","last_clean":"2023-07-14T11:13:15.018665+0000","last_became_active":"2023-07-14T11:13:15.013656+0000","last_became_peered":"2023-07-14T11:13:15.013656+0000","last_unstale":"2023-07-14T11:13:15.018665+0000","last_undegraded":"2023-07-14T11:13:15.018665+0000","last_fullsized":"2023-07-14T11:13:15.018665+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:58:38.845550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:14.990274+0000","last_change":"2023-07-14T11:13:08.923899+0000","last_active":"2023-07-14T11:13:14.990274+0000","last_peered":"2023-07-14T11:13:14.990274+0000","last_clean":"2023-07-14T11:13:14.990274+0000","last_became_active":"2023-07-14T11:13:08.923513+0000","last_became_peered":"2023-07-14T11:13:08.923513+0000","last_unstale":"2023-07-14T11:13:14.990274+0000","last_undegraded":"2023-07-14T11:13:14.990274+0000","last_fullsized":"2023-07-14T11:13:14.990274+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:25:21.744503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:14.985798+0000","last_change":"2023-07-14T11:13:13.980381+0000","last_active":"2023-07-14T11:13:14.985798+0000","last_peered":"2023-07-14T11:13:14.985798+0000","last_clean":"2023-07-14T11:13:14.985798+0000","last_became_active":"2023-07-14T11:13:13.980136+0000","last_became_peered":"2023-07-14T11:13:13.980136+0000","last_unstale":"2023-07-14T11:13:14.985798+0000","last_undegraded":"2023-07-14T11:13:14.985798+0000","last_fullsized":"2023-07-14T11:13:14.985798+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:14:41.293158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.012808+0000","last_change":"2023-07-14T11:13:15.006407+0000","last_active":"2023-07-14T11:13:15.012808+0000","last_peered":"2023-07-14T11:13:15.012808+0000","last_clean":"2023-07-14T11:13:15.012808+0000","last_became_active":"2023-07-14T11:13:15.006104+0000","last_became_peered":"2023-07-14T11:13:15.006104+0000","last_unstale":"2023-07-14T11:13:15.012808+0000","last_undegraded":"2023-07-14T11:13:15.012808+0000","last_fullsized":"2023-07-14T11:13:15.012808+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:27:27.142803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.022645+0000","last_change":"2023-07-14T11:13:13.979833+0000","last_active":"2023-07-14T11:13:15.022645+0000","last_peered":"2023-07-14T11:13:15.022645+0000","last_clean":"2023-07-14T11:13:15.022645+0000","last_became_active":"2023-07-14T11:13:13.979564+0000","last_became_peered":"2023-07-14T11:13:13.979564+0000","last_unstale":"2023-07-14T11:13:15.022645+0000","last_undegraded":"2023-07-14T11:13:15.022645+0000","last_fullsized":"2023-07-14T11:13:15.022645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:14:41.293158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:14.985109+0000","last_change":"2023-07-14T11:13:08.761726+0000","last_active":"2023-07-14T11:13:14.985109+0000","last_peered":"2023-07-14T11:13:14.985109+0000","last_clean":"2023-07-14T11:13:14.985109+0000","last_became_active":"2023-07-14T11:13:08.761365+0000","last_became_peered":"2023-07-14T11:13:08.761365+0000","last_unstale":"2023-07-14T11:13:14.985109+0000","last_undegraded":"2023-07-14T11:13:14.985109+0000","last_fullsized":"2023-07-14T11:13:14.985109+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:03:10.927020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.010354+0000","last_change":"2023-07-14T11:13:15.004961+0000","last_active":"2023-07-14T11:13:15.010354+0000","last_peered":"2023-07-14T11:13:15.010354+0000","last_clean":"2023-07-14T11:13:15.010354+0000","last_became_active":"2023-07-14T11:13:15.004656+0000","last_became_peered":"2023-07-14T11:13:15.004656+0000","last_unstale":"2023-07-14T11:13:15.010354+0000","last_undegraded":"2023-07-14T11:13:15.010354+0000","last_fullsized":"2023-07-14T11:13:15.010354+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:43:57.824230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:14.990156+0000","last_change":"2023-07-14T11:13:08.762084+0000","last_active":"2023-07-14T11:13:14.990156+0000","last_peered":"2023-07-14T11:13:14.990156+0000","last_clean":"2023-07-14T11:13:14.990156+0000","last_became_active":"2023-07-14T11:13:08.761763+0000","last_became_peered":"2023-07-14T11:13:08.761763+0000","last_unstale":"2023-07-14T11:13:14.990156+0000","last_undegraded":"2023-07-14T11:13:14.990156+0000","last_fullsized":"2023-07-14T11:13:14.990156+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:00:01.976611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:14.999305+0000","last_change":"2023-07-14T11:13:13.985679+0000","last_active":"2023-07-14T11:13:14.999305+0000","last_peered":"2023-07-14T11:13:14.999305+0000","last_clean":"2023-07-14T11:13:14.999305+0000","last_became_active":"2023-07-14T11:13:13.985432+0000","last_became_peered":"2023-07-14T11:13:13.985432+0000","last_unstale":"2023-07-14T11:13:14.999305+0000","last_undegraded":"2023-07-14T11:13:14.999305+0000","last_fullsized":"2023-07-14T11:13:14.999305+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:13:03.768716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.013655+0000","last_change":"2023-07-14T11:13:15.006256+0000","last_active":"2023-07-14T11:13:15.013655+0000","last_peered":"2023-07-14T11:13:15.013655+0000","last_clean":"2023-07-14T11:13:15.013655+0000","last_became_active":"2023-07-14T11:13:15.005979+0000","last_became_peered":"2023-07-14T11:13:15.005979+0000","last_unstale":"2023-07-14T11:13:15.013655+0000","last_undegraded":"2023-07-14T11:13:15.013655+0000","last_fullsized":"2023-07-14T11:13:15.013655+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:59:21.188485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.026658+0000","last_change":"2023-07-14T11:13:13.987238+0000","last_active":"2023-07-14T11:13:15.026658+0000","last_peered":"2023-07-14T11:13:15.026658+0000","last_clean":"2023-07-14T11:13:15.026658+0000","last_became_active":"2023-07-14T11:13:13.986985+0000","last_became_peered":"2023-07-14T11:13:13.986985+0000","last_unstale":"2023-07-14T11:13:15.026658+0000","last_undegraded":"2023-07-14T11:13:15.026658+0000","last_fullsized":"2023-07-14T11:13:15.026658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:14:41.293158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.009363+0000","last_change":"2023-07-14T11:13:14.998910+0000","last_active":"2023-07-14T11:13:15.009363+0000","last_peered":"2023-07-14T11:13:15.009363+0000","last_clean":"2023-07-14T11:13:15.009363+0000","last_became_active":"2023-07-14T11:13:14.998599+0000","last_became_peered":"2023-07-14T11:13:14.998599+0000","last_unstale":"2023-07-14T11:13:15.009363+0000","last_undegraded":"2023-07-14T11:13:15.009363+0000","last_fullsized":"2023-07-14T11:13:15.009363+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:40:56.863985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.028350+0000","last_change":"2023-07-14T11:13:13.978096+0000","last_active":"2023-07-14T11:13:15.028350+0000","last_peered":"2023-07-14T11:13:15.028350+0000","last_clean":"2023-07-14T11:13:15.028350+0000","last_became_active":"2023-07-14T11:13:13.977725+0000","last_became_peered":"2023-07-14T11:13:13.977725+0000","last_unstale":"2023-07-14T11:13:15.028350+0000","last_undegraded":"2023-07-14T11:13:15.028350+0000","last_fullsized":"2023-07-14T11:13:15.028350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:46:54.002810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.027770+0000","last_change":"2023-07-14T11:13:15.022976+0000","last_active":"2023-07-14T11:13:15.027770+0000","last_peered":"2023-07-14T11:13:15.027770+0000","last_clean":"2023-07-14T11:13:15.027770+0000","last_became_active":"2023-07-14T11:13:15.022716+0000","last_became_peered":"2023-07-14T11:13:15.022716+0000","last_unstale":"2023-07-14T11:13:15.027770+0000","last_undegraded":"2023-07-14T11:13:15.027770+0000","last_fullsized":"2023-07-14T11:13:15.027770+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:36:50.668482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.028433+0000","last_change":"2023-07-14T11:13:13.978838+0000","last_active":"2023-07-14T11:13:15.028433+0000","last_peered":"2023-07-14T11:13:15.028433+0000","last_clean":"2023-07-14T11:13:15.028433+0000","last_became_active":"2023-07-14T11:13:13.977771+0000","last_became_peered":"2023-07-14T11:13:13.977771+0000","last_unstale":"2023-07-14T11:13:15.028433+0000","last_undegraded":"2023-07-14T11:13:15.028433+0000","last_fullsized":"2023-07-14T11:13:15.028433+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:48:45.385596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.027832+0000","last_change":"2023-07-14T11:13:15.019154+0000","last_active":"2023-07-14T11:13:15.027832+0000","last_peered":"2023-07-14T11:13:15.027832+0000","last_clean":"2023-07-14T11:13:15.027832+0000","last_became_active":"2023-07-14T11:13:15.018878+0000","last_became_peered":"2023-07-14T11:13:15.018878+0000","last_unstale":"2023-07-14T11:13:15.027832+0000","last_undegraded":"2023-07-14T11:13:15.027832+0000","last_fullsized":"2023-07-14T11:13:15.027832+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:00:08.190145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.023488+0000","last_change":"2023-07-14T11:13:13.989944+0000","last_active":"2023-07-14T11:13:15.023488+0000","last_peered":"2023-07-14T11:13:15.023488+0000","last_clean":"2023-07-14T11:13:15.023488+0000","last_became_active":"2023-07-14T11:13:13.989576+0000","last_became_peered":"2023-07-14T11:13:13.989576+0000","last_unstale":"2023-07-14T11:13:15.023488+0000","last_undegraded":"2023-07-14T11:13:15.023488+0000","last_fullsized":"2023-07-14T11:13:15.023488+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:00:07.185011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.016491+0000","last_change":"2023-07-14T11:13:15.009006+0000","last_active":"2023-07-14T11:13:15.016491+0000","last_peered":"2023-07-14T11:13:15.016491+0000","last_clean":"2023-07-14T11:13:15.016491+0000","last_became_active":"2023-07-14T11:13:15.008256+0000","last_became_peered":"2023-07-14T11:13:15.008256+0000","last_unstale":"2023-07-14T11:13:15.016491+0000","last_undegraded":"2023-07-14T11:13:15.016491+0000","last_fullsized":"2023-07-14T11:13:15.016491+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:59:05.719375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.025183+0000","last_change":"2023-07-14T11:13:13.991268+0000","last_active":"2023-07-14T11:13:15.025183+0000","last_peered":"2023-07-14T11:13:15.025183+0000","last_clean":"2023-07-14T11:13:15.025183+0000","last_became_active":"2023-07-14T11:13:13.991022+0000","last_became_peered":"2023-07-14T11:13:13.991022+0000","last_unstale":"2023-07-14T11:13:15.025183+0000","last_undegraded":"2023-07-14T11:13:15.025183+0000","last_fullsized":"2023-07-14T11:13:15.025183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:59:15.067078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.014649+0000","last_change":"2023-07-14T11:13:15.012788+0000","last_active":"2023-07-14T11:13:15.014649+0000","last_peered":"2023-07-14T11:13:15.014649+0000","last_clean":"2023-07-14T11:13:15.014649+0000","last_became_active":"2023-07-14T11:13:15.012357+0000","last_became_peered":"2023-07-14T11:13:15.012357+0000","last_unstale":"2023-07-14T11:13:15.014649+0000","last_undegraded":"2023-07-14T11:13:15.014649+0000","last_fullsized":"2023-07-14T11:13:15.014649+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:42:28.587522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.007557+0000","last_change":"2023-07-14T11:13:15.002966+0000","last_active":"2023-07-14T11:13:15.007557+0000","last_peered":"2023-07-14T11:13:15.007557+0000","last_clean":"2023-07-14T11:13:15.007557+0000","last_became_active":"2023-07-14T11:13:15.002577+0000","last_became_peered":"2023-07-14T11:13:15.002577+0000","last_unstale":"2023-07-14T11:13:15.007557+0000","last_undegraded":"2023-07-14T11:13:15.007557+0000","last_fullsized":"2023-07-14T11:13:15.007557+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:27:27.142803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.019066+0000","last_change":"2023-07-14T11:13:15.013713+0000","last_active":"2023-07-14T11:13:15.019066+0000","last_peered":"2023-07-14T11:13:15.019066+0000","last_clean":"2023-07-14T11:13:15.019066+0000","last_became_active":"2023-07-14T11:13:15.013385+0000","last_became_peered":"2023-07-14T11:13:15.013385+0000","last_unstale":"2023-07-14T11:13:15.019066+0000","last_undegraded":"2023-07-14T11:13:15.019066+0000","last_fullsized":"2023-07-14T11:13:15.019066+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:11:14.713367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.016269+0000","last_change":"2023-07-14T11:13:15.013904+0000","last_active":"2023-07-14T11:13:15.016269+0000","last_peered":"2023-07-14T11:13:15.016269+0000","last_clean":"2023-07-14T11:13:15.016269+0000","last_became_active":"2023-07-14T11:13:15.013654+0000","last_became_peered":"2023-07-14T11:13:15.013654+0000","last_unstale":"2023-07-14T11:13:15.016269+0000","last_undegraded":"2023-07-14T11:13:15.016269+0000","last_fullsized":"2023-07-14T11:13:15.016269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:14:42.298292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.010319+0000","last_change":"2023-07-14T11:13:15.004331+0000","last_active":"2023-07-14T11:13:15.010319+0000","last_peered":"2023-07-14T11:13:15.010319+0000","last_clean":"2023-07-14T11:13:15.010319+0000","last_became_active":"2023-07-14T11:13:15.003862+0000","last_became_peered":"2023-07-14T11:13:15.003862+0000","last_unstale":"2023-07-14T11:13:15.010319+0000","last_undegraded":"2023-07-14T11:13:15.010319+0000","last_fullsized":"2023-07-14T11:13:15.010319+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:40:56.863985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.012092+0000","last_change":"2023-07-14T11:13:15.005637+0000","last_active":"2023-07-14T11:13:15.012092+0000","last_peered":"2023-07-14T11:13:15.012092+0000","last_clean":"2023-07-14T11:13:15.012092+0000","last_became_active":"2023-07-14T11:13:15.005359+0000","last_became_peered":"2023-07-14T11:13:15.005359+0000","last_unstale":"2023-07-14T11:13:15.012092+0000","last_undegraded":"2023-07-14T11:13:15.012092+0000","last_fullsized":"2023-07-14T11:13:15.012092+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:58:38.845550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27744,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":811008,"data_stored":666186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":75818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.155}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.107}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":229376,"data_stored":82946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.363}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3759999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2569999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4590000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":827392,"data_stored":673896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0029999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":75818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":75818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":249856,"data_stored":84566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0569999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":229376,"data_stored":82946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T11:13:19.375 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T11:13:19.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.598+0000 7fb0dc9ff700 1 Processor -- start 2023-07-14T11:13:19.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.599+0000 7fb0dc9ff700 1 -- start start 2023-07-14T11:13:19.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.600+0000 7fb0dc9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0d815c950 0x7fb0d80b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:19.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.600+0000 7fb0dc9ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0d80d2ce0 con 0x7fb0d80d1220 2023-07-14T11:13:19.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.600+0000 7fb0dc9ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0d80b3350 con 0x7fb0d80b1e00 2023-07-14T11:13:19.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.600+0000 7fb0dc9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d80b3630 con 0x7fb0d815c950 2023-07-14T11:13:19.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.600+0000 7fb0d6d9d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fb0d80d1220 0x7fb0d80afac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:37654/0 (socket says 172.21.15.84:37654) 2023-07-14T11:13:19.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.600+0000 7fb0d6d9d700 1 -- 172.21.15.84:0/601908748 learned_addr learned my addr 172.21.15.84:0/601908748 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:13:19.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.600+0000 7fb0d659c700 1 --2- 172.21.15.84:0/601908748 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0d815c950 0x7fb0d80b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:19.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.600+0000 7fb0d5d9b700 1 -- 172.21.15.84:0/601908748 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2422769045 0 0) 0x7fb0d80d2ce0 con 0x7fb0d80d1220 2023-07-14T11:13:19.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.601+0000 7fb0d5d9b700 1 -- 172.21.15.84:0/601908748 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0c40035b0 con 0x7fb0d80d1220 2023-07-14T11:13:19.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.601+0000 7fb0d5d9b700 1 -- 172.21.15.84:0/601908748 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2272929657 0 0) 0x7fb0d80b3350 con 0x7fb0d80b1e00 2023-07-14T11:13:19.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.601+0000 7fb0d5d9b700 1 -- 172.21.15.84:0/601908748 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0d80d2ce0 con 0x7fb0d80b1e00 2023-07-14T11:13:19.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.601+0000 7fb0d5d9b700 1 -- 172.21.15.84:0/601908748 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2726780043 0 0) 0x7fb0c40035b0 con 0x7fb0d80d1220 2023-07-14T11:13:19.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.601+0000 7fb0d659c700 1 -- 172.21.15.84:0/601908748 >> v1:172.21.15.179:6789/0 conn(0x7fb0d80b1e00 legacy=0x7fb0d80d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:19.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.601+0000 7fb0d659c700 1 -- 172.21.15.84:0/601908748 >> v1:172.21.15.84:6789/0 conn(0x7fb0d80d1220 legacy=0x7fb0d80afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:19.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.601+0000 7fb0d659c700 1 -- 172.21.15.84:0/601908748 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0d80b3910 con 0x7fb0d815c950 2023-07-14T11:13:19.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.601+0000 7fb0d659c700 1 --2- 172.21.15.84:0/601908748 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0d815c950 0x7fb0d80b43f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb0c8009850 tx=0x7fb0c8009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e548b5397bc48c72 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:19.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.601+0000 7fb0d5d9b700 1 -- 172.21.15.84:0/601908748 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d00019f0 con 0x7fb0d815c950 2023-07-14T11:13:19.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.601+0000 7fb0d5d9b700 1 -- 172.21.15.84:0/601908748 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0c8005c30 con 0x7fb0d815c950 2023-07-14T11:13:19.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.601+0000 7fb0d5d9b700 1 -- 172.21.15.84:0/601908748 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c8004030 con 0x7fb0d815c950 2023-07-14T11:13:19.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.602+0000 7fb0dc9ff700 1 -- 172.21.15.84:0/601908748 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0d815c950 msgr2=0x7fb0d80b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:19.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.602+0000 7fb0dc9ff700 1 --2- 172.21.15.84:0/601908748 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0d815c950 0x7fb0d80b43f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb0c8009850 tx=0x7fb0c8009b60 comp rx=0 tx=0).stop 2023-07-14T11:13:19.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.602+0000 7fb0dc9ff700 1 -- 172.21.15.84:0/601908748 shutdown_connections 2023-07-14T11:13:19.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.602+0000 7fb0dc9ff700 1 --2- 172.21.15.84:0/601908748 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0d815c950 0x7fb0d80b43f0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:19.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.602+0000 7fb0dc9ff700 1 -- 172.21.15.84:0/601908748 >> 172.21.15.84:0/601908748 conn(0x7fb0d809c1d0 msgr2=0x7fb0d80d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:19.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.602+0000 7fb0dc9ff700 1 -- 172.21.15.84:0/601908748 shutdown_connections 2023-07-14T11:13:19.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.602+0000 7fb0dc9ff700 1 -- 172.21.15.84:0/601908748 wait complete. 2023-07-14T11:13:19.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.604+0000 7fb0dc9ff700 1 Processor -- start 2023-07-14T11:13:19.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.604+0000 7fb0dc9ff700 1 -- start start 2023-07-14T11:13:19.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.605+0000 7fb0dc9ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0d80b1e00 0x7fb0d80cede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:19.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.605+0000 7fb0dc9ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0d80d1220 0x7fb0d814f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:19.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.605+0000 7fb0dc9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0d815c950 0x7fb0d81e7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:19.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.605+0000 7fb0dc9ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d80d01b0 con 0x7fb0d80d1220 2023-07-14T11:13:19.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.605+0000 7fb0dc9ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d80cf3c0 con 0x7fb0d80b1e00 2023-07-14T11:13:19.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.605+0000 7fb0dc9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d80cf810 con 0x7fb0d815c950 2023-07-14T11:13:19.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.605+0000 7fb0cffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0d80d1220 0x7fb0d814f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:19.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.605+0000 7fb0cffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0d80d1220 0x7fb0d814f980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33908/0 (socket says 172.21.15.84:33908) 2023-07-14T11:13:19.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.605+0000 7fb0cffff700 1 -- 172.21.15.84:0/1999129325 learned_addr learned my addr 172.21.15.84:0/1999129325 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:19.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.605+0000 7fb0d659c700 1 --2- 172.21.15.84:0/1999129325 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0d80b1e00 0x7fb0d80cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:19.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.605+0000 7fb0d6d9d700 1 --2- 172.21.15.84:0/1999129325 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0d815c950 0x7fb0d81e7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:19.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.605+0000 7fb0cffff700 1 -- 172.21.15.84:0/1999129325 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0d815c950 msgr2=0x7fb0d81e7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:19.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.605+0000 7fb0cffff700 1 --2- 172.21.15.84:0/1999129325 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0d815c950 0x7fb0d81e7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:19.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.605+0000 7fb0cffff700 1 -- 172.21.15.84:0/1999129325 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0d80b1e00 msgr2=0x7fb0d80cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:19.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.605+0000 7fb0cffff700 1 --2- 172.21.15.84:0/1999129325 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0d80b1e00 0x7fb0d80cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:19.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.605+0000 7fb0cffff700 1 -- 172.21.15.84:0/1999129325 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0c8009430 con 0x7fb0d80d1220 2023-07-14T11:13:19.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.605+0000 7fb0d659c700 1 --2- 172.21.15.84:0/1999129325 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0d80b1e00 0x7fb0d80cede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:13:19.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.605+0000 7fb0d6d9d700 1 --2- 172.21.15.84:0/1999129325 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0d815c950 0x7fb0d81e7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:13:19.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.606+0000 7fb0cffff700 1 --2- 172.21.15.84:0/1999129325 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0d80d1220 0x7fb0d814f980 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb0c000c520 tx=0x7fb0c000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:19.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.606+0000 7fb0ceffd700 1 -- 172.21.15.84:0/1999129325 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c00052d0 con 0x7fb0d80d1220 2023-07-14T11:13:19.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.606+0000 7fb0ceffd700 1 -- 172.21.15.84:0/1999129325 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0c0005430 con 0x7fb0d80d1220 2023-07-14T11:13:19.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.606+0000 7fb0ceffd700 1 -- 172.21.15.84:0/1999129325 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c00038c0 con 0x7fb0d80d1220 2023-07-14T11:13:19.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.606+0000 7fb0dc9ff700 1 -- 172.21.15.84:0/1999129325 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0d80cfaf0 con 0x7fb0d80d1220 2023-07-14T11:13:19.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.606+0000 7fb0dc9ff700 1 -- 172.21.15.84:0/1999129325 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0d8150690 con 0x7fb0d80d1220 2023-07-14T11:13:19.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.607+0000 7fb0dc9ff700 1 -- 172.21.15.84:0/1999129325 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0d804e280 con 0x7fb0d80d1220 2023-07-14T11:13:19.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.608+0000 7fb0ceffd700 1 -- 172.21.15.84:0/1999129325 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb0c0003a20 con 0x7fb0d80d1220 2023-07-14T11:13:19.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.609+0000 7fb0ceffd700 1 --2- 172.21.15.84:0/1999129325 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fb0b806ace0 0x7fb0b806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:19.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.609+0000 7fb0ceffd700 1 -- 172.21.15.84:0/1999129325 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb0c0088af0 con 0x7fb0d80d1220 2023-07-14T11:13:19.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.609+0000 7fb0d659c700 1 --2- 172.21.15.84:0/1999129325 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fb0b806ace0 0x7fb0b806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:19.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.609+0000 7fb0d659c700 1 --2- 172.21.15.84:0/1999129325 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fb0b806ace0 0x7fb0b806d190 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb0c80097a0 tx=0x7fb0c8008070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:19.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.613+0000 7fb0ceffd700 1 -- 172.21.15.84:0/1999129325 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fb0c0053b00 con 0x7fb0d80d1220 2023-07-14T11:13:19.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.802+0000 7fb0dc9ff700 1 -- 172.21.15.84:0/1999129325 --> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb0d80b3ed0 con 0x7fb0b806ace0 2023-07-14T11:13:19.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.810+0000 7fb0ceffd700 1 -- 172.21.15.84:0/1999129325 <== mgr.4104 v2:172.21.15.84:6832/379617029 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286642 (secure 0 0 0) 0x7fb0c8004150 con 0x7fb0b806ace0 2023-07-14T11:13:19.815 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:13:19.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.814+0000 7fb0dc9ff700 1 -- 172.21.15.84:0/1999129325 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fb0b806ace0 msgr2=0x7fb0b806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:19.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.814+0000 7fb0dc9ff700 1 --2- 172.21.15.84:0/1999129325 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fb0b806ace0 0x7fb0b806d190 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb0c80097a0 tx=0x7fb0c8008070 comp rx=0 tx=0).stop 2023-07-14T11:13:19.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.814+0000 7fb0dc9ff700 1 -- 172.21.15.84:0/1999129325 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0d80d1220 msgr2=0x7fb0d814f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:19.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.814+0000 7fb0dc9ff700 1 --2- 172.21.15.84:0/1999129325 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0d80d1220 0x7fb0d814f980 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb0c000c520 tx=0x7fb0c000c8e0 comp rx=0 tx=0).stop 2023-07-14T11:13:19.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.814+0000 7fb0dc9ff700 1 -- 172.21.15.84:0/1999129325 shutdown_connections 2023-07-14T11:13:19.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.814+0000 7fb0dc9ff700 1 --2- 172.21.15.84:0/1999129325 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fb0b806ace0 0x7fb0b806d190 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:19.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.814+0000 7fb0dc9ff700 1 --2- 172.21.15.84:0/1999129325 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0d815c950 0x7fb0d81e7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:19.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.814+0000 7fb0dc9ff700 1 --2- 172.21.15.84:0/1999129325 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0d80b1e00 0x7fb0d80cede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:19.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.814+0000 7fb0dc9ff700 1 --2- 172.21.15.84:0/1999129325 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0d80d1220 0x7fb0d814f980 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:19.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.814+0000 7fb0dc9ff700 1 -- 172.21.15.84:0/1999129325 >> 172.21.15.84:0/1999129325 conn(0x7fb0d809c1d0 msgr2=0x7fb0d80b5260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:19.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.814+0000 7fb0dc9ff700 1 -- 172.21.15.84:0/1999129325 shutdown_connections 2023-07-14T11:13:19.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:19.815+0000 7fb0dc9ff700 1 -- 172.21.15.84:0/1999129325 wait complete. 2023-07-14T11:13:19.819 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-07-14T11:13:19.834 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-14T11:13:18.067238+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":33,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218544,"kb_used_data":2928,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754756176,"statfs":{"total":773094113280,"available":772870324224,"internally_reserved":0,"allocated":2998272,"data_stored":1817994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.110018"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.017085+0000","last_change":"2023-07-14T11:13:15.012043+0000","last_active":"2023-07-14T11:13:15.017085+0000","last_peered":"2023-07-14T11:13:15.017085+0000","last_clean":"2023-07-14T11:13:15.017085+0000","last_became_active":"2023-07-14T11:13:15.011781+0000","last_became_peered":"2023-07-14T11:13:15.011781+0000","last_unstale":"2023-07-14T11:13:15.017085+0000","last_undegraded":"2023-07-14T11:13:15.017085+0000","last_fullsized":"2023-07-14T11:13:15.017085+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:58:38.845550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.008180+0000","last_change":"2023-07-14T11:13:15.000344+0000","last_active":"2023-07-14T11:13:15.008180+0000","last_peered":"2023-07-14T11:13:15.008180+0000","last_clean":"2023-07-14T11:13:15.008180+0000","last_became_active":"2023-07-14T11:13:15.000039+0000","last_became_peered":"2023-07-14T11:13:15.000039+0000","last_unstale":"2023-07-14T11:13:15.008180+0000","last_undegraded":"2023-07-14T11:13:15.008180+0000","last_fullsized":"2023-07-14T11:13:15.008180+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:03:17.140553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.016243+0000","last_change":"2023-07-14T11:13:15.014928+0000","last_active":"2023-07-14T11:13:15.016243+0000","last_peered":"2023-07-14T11:13:15.016243+0000","last_clean":"2023-07-14T11:13:15.016243+0000","last_became_active":"2023-07-14T11:13:15.014663+0000","last_became_peered":"2023-07-14T11:13:15.014663+0000","last_unstale":"2023-07-14T11:13:15.016243+0000","last_undegraded":"2023-07-14T11:13:15.016243+0000","last_fullsized":"2023-07-14T11:13:15.016243+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:58:38.845550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.009990+0000","last_change":"2023-07-14T11:13:15.007462+0000","last_active":"2023-07-14T11:13:15.009990+0000","last_peered":"2023-07-14T11:13:15.009990+0000","last_clean":"2023-07-14T11:13:15.009990+0000","last_became_active":"2023-07-14T11:13:15.007180+0000","last_became_peered":"2023-07-14T11:13:15.007180+0000","last_unstale":"2023-07-14T11:13:15.009990+0000","last_undegraded":"2023-07-14T11:13:15.009990+0000","last_fullsized":"2023-07-14T11:13:15.009990+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:43:57.824230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.019042+0000","last_change":"2023-07-14T11:13:15.013824+0000","last_active":"2023-07-14T11:13:15.019042+0000","last_peered":"2023-07-14T11:13:15.019042+0000","last_clean":"2023-07-14T11:13:15.019042+0000","last_became_active":"2023-07-14T11:13:15.012925+0000","last_became_peered":"2023-07-14T11:13:15.012925+0000","last_unstale":"2023-07-14T11:13:15.019042+0000","last_undegraded":"2023-07-14T11:13:15.019042+0000","last_fullsized":"2023-07-14T11:13:15.019042+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:46:55.007943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.016287+0000","last_change":"2023-07-14T11:13:15.015095+0000","last_active":"2023-07-14T11:13:15.016287+0000","last_peered":"2023-07-14T11:13:15.016287+0000","last_clean":"2023-07-14T11:13:15.016287+0000","last_became_active":"2023-07-14T11:13:15.014838+0000","last_became_peered":"2023-07-14T11:13:15.014838+0000","last_unstale":"2023-07-14T11:13:15.016287+0000","last_undegraded":"2023-07-14T11:13:15.016287+0000","last_fullsized":"2023-07-14T11:13:15.016287+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:00:49.901677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.004581+0000","last_change":"2023-07-14T11:13:15.000923+0000","last_active":"2023-07-14T11:13:15.004581+0000","last_peered":"2023-07-14T11:13:15.004581+0000","last_clean":"2023-07-14T11:13:15.004581+0000","last_became_active":"2023-07-14T11:13:15.000141+0000","last_became_peered":"2023-07-14T11:13:15.000141+0000","last_unstale":"2023-07-14T11:13:15.004581+0000","last_undegraded":"2023-07-14T11:13:15.004581+0000","last_fullsized":"2023-07-14T11:13:15.004581+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:00:15.112821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.023330+0000","last_change":"2023-07-14T11:13:15.007538+0000","last_active":"2023-07-14T11:13:15.023330+0000","last_peered":"2023-07-14T11:13:15.023330+0000","last_clean":"2023-07-14T11:13:15.023330+0000","last_became_active":"2023-07-14T11:13:15.007221+0000","last_became_peered":"2023-07-14T11:13:15.007221+0000","last_unstale":"2023-07-14T11:13:15.023330+0000","last_undegraded":"2023-07-14T11:13:15.023330+0000","last_fullsized":"2023-07-14T11:13:15.023330+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:58:38.845550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.018727+0000","last_change":"2023-07-14T11:13:15.014209+0000","last_active":"2023-07-14T11:13:15.018727+0000","last_peered":"2023-07-14T11:13:15.018727+0000","last_clean":"2023-07-14T11:13:15.018727+0000","last_became_active":"2023-07-14T11:13:15.013525+0000","last_became_peered":"2023-07-14T11:13:15.013525+0000","last_unstale":"2023-07-14T11:13:15.018727+0000","last_undegraded":"2023-07-14T11:13:15.018727+0000","last_fullsized":"2023-07-14T11:13:15.018727+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:47:42.967958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.023393+0000","last_change":"2023-07-14T11:13:15.008305+0000","last_active":"2023-07-14T11:13:15.023393+0000","last_peered":"2023-07-14T11:13:15.023393+0000","last_clean":"2023-07-14T11:13:15.023393+0000","last_became_active":"2023-07-14T11:13:15.008009+0000","last_became_peered":"2023-07-14T11:13:15.008009+0000","last_unstale":"2023-07-14T11:13:15.023393+0000","last_undegraded":"2023-07-14T11:13:15.023393+0000","last_fullsized":"2023-07-14T11:13:15.023393+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:59:05.719375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.027625+0000","last_change":"2023-07-14T11:13:15.019530+0000","last_active":"2023-07-14T11:13:15.027625+0000","last_peered":"2023-07-14T11:13:15.027625+0000","last_clean":"2023-07-14T11:13:15.027625+0000","last_became_active":"2023-07-14T11:13:15.019260+0000","last_became_peered":"2023-07-14T11:13:15.019260+0000","last_unstale":"2023-07-14T11:13:15.027625+0000","last_undegraded":"2023-07-14T11:13:15.027625+0000","last_fullsized":"2023-07-14T11:13:15.027625+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:59:05.719375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.018622+0000","last_change":"2023-07-14T11:13:15.017282+0000","last_active":"2023-07-14T11:13:15.018622+0000","last_peered":"2023-07-14T11:13:15.018622+0000","last_clean":"2023-07-14T11:13:15.018622+0000","last_became_active":"2023-07-14T11:13:15.016949+0000","last_became_peered":"2023-07-14T11:13:15.016949+0000","last_unstale":"2023-07-14T11:13:15.018622+0000","last_undegraded":"2023-07-14T11:13:15.018622+0000","last_fullsized":"2023-07-14T11:13:15.018622+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:27:27.142803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.016826+0000","last_change":"2023-07-14T11:13:15.007583+0000","last_active":"2023-07-14T11:13:15.016826+0000","last_peered":"2023-07-14T11:13:15.016826+0000","last_clean":"2023-07-14T11:13:15.016826+0000","last_became_active":"2023-07-14T11:13:15.007308+0000","last_became_peered":"2023-07-14T11:13:15.007308+0000","last_unstale":"2023-07-14T11:13:15.016826+0000","last_undegraded":"2023-07-14T11:13:15.016826+0000","last_fullsized":"2023-07-14T11:13:15.016826+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:43:57.824230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.009307+0000","last_change":"2023-07-14T11:13:15.001617+0000","last_active":"2023-07-14T11:13:15.009307+0000","last_peered":"2023-07-14T11:13:15.009307+0000","last_clean":"2023-07-14T11:13:15.009307+0000","last_became_active":"2023-07-14T11:13:15.001328+0000","last_became_peered":"2023-07-14T11:13:15.001328+0000","last_unstale":"2023-07-14T11:13:15.009307+0000","last_undegraded":"2023-07-14T11:13:15.009307+0000","last_fullsized":"2023-07-14T11:13:15.009307+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:00:49.901677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.004556+0000","last_change":"2023-07-14T11:13:15.000610+0000","last_active":"2023-07-14T11:13:15.004556+0000","last_peered":"2023-07-14T11:13:15.004556+0000","last_clean":"2023-07-14T11:13:15.004556+0000","last_became_active":"2023-07-14T11:13:14.999771+0000","last_became_peered":"2023-07-14T11:13:14.999771+0000","last_unstale":"2023-07-14T11:13:15.004556+0000","last_undegraded":"2023-07-14T11:13:15.004556+0000","last_fullsized":"2023-07-14T11:13:15.004556+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:16:01.290597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.014628+0000","last_change":"2023-07-14T11:13:15.012608+0000","last_active":"2023-07-14T11:13:15.014628+0000","last_peered":"2023-07-14T11:13:15.014628+0000","last_clean":"2023-07-14T11:13:15.014628+0000","last_became_active":"2023-07-14T11:13:15.008876+0000","last_became_peered":"2023-07-14T11:13:15.008876+0000","last_unstale":"2023-07-14T11:13:15.014628+0000","last_undegraded":"2023-07-14T11:13:15.014628+0000","last_fullsized":"2023-07-14T11:13:15.014628+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:41:53.585750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.018710+0000","last_change":"2023-07-14T11:13:15.013846+0000","last_active":"2023-07-14T11:13:15.018710+0000","last_peered":"2023-07-14T11:13:15.018710+0000","last_clean":"2023-07-14T11:13:15.018710+0000","last_became_active":"2023-07-14T11:13:15.013207+0000","last_became_peered":"2023-07-14T11:13:15.013207+0000","last_unstale":"2023-07-14T11:13:15.018710+0000","last_undegraded":"2023-07-14T11:13:15.018710+0000","last_fullsized":"2023-07-14T11:13:15.018710+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:42:28.587522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.027513+0000","last_change":"2023-07-14T11:13:15.016833+0000","last_active":"2023-07-14T11:13:15.027513+0000","last_peered":"2023-07-14T11:13:15.027513+0000","last_clean":"2023-07-14T11:13:15.027513+0000","last_became_active":"2023-07-14T11:13:15.016507+0000","last_became_peered":"2023-07-14T11:13:15.016507+0000","last_unstale":"2023-07-14T11:13:15.027513+0000","last_undegraded":"2023-07-14T11:13:15.027513+0000","last_fullsized":"2023-07-14T11:13:15.027513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:59:16.072212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.002809+0000","last_change":"2023-07-14T11:13:14.994609+0000","last_active":"2023-07-14T11:13:15.002809+0000","last_peered":"2023-07-14T11:13:15.002809+0000","last_clean":"2023-07-14T11:13:15.002809+0000","last_became_active":"2023-07-14T11:13:14.994280+0000","last_became_peered":"2023-07-14T11:13:14.994280+0000","last_unstale":"2023-07-14T11:13:15.002809+0000","last_undegraded":"2023-07-14T11:13:15.002809+0000","last_fullsized":"2023-07-14T11:13:15.002809+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:59:16.072212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.015715+0000","last_change":"2023-07-14T11:13:15.013542+0000","last_active":"2023-07-14T11:13:15.015715+0000","last_peered":"2023-07-14T11:13:15.015715+0000","last_clean":"2023-07-14T11:13:15.015715+0000","last_became_active":"2023-07-14T11:13:15.013278+0000","last_became_peered":"2023-07-14T11:13:15.013278+0000","last_unstale":"2023-07-14T11:13:15.015715+0000","last_undegraded":"2023-07-14T11:13:15.015715+0000","last_fullsized":"2023-07-14T11:13:15.015715+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:43:57.824230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.026012+0000","last_change":"2023-07-14T11:13:15.022035+0000","last_active":"2023-07-14T11:13:15.026012+0000","last_peered":"2023-07-14T11:13:15.026012+0000","last_clean":"2023-07-14T11:13:15.026012+0000","last_became_active":"2023-07-14T11:13:15.021666+0000","last_became_peered":"2023-07-14T11:13:15.021666+0000","last_unstale":"2023-07-14T11:13:15.026012+0000","last_undegraded":"2023-07-14T11:13:15.026012+0000","last_fullsized":"2023-07-14T11:13:15.026012+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:25:49.179942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.018603+0000","last_change":"2023-07-14T11:13:15.013591+0000","last_active":"2023-07-14T11:13:15.018603+0000","last_peered":"2023-07-14T11:13:15.018603+0000","last_clean":"2023-07-14T11:13:15.018603+0000","last_became_active":"2023-07-14T11:13:15.013300+0000","last_became_peered":"2023-07-14T11:13:15.013300+0000","last_unstale":"2023-07-14T11:13:15.018603+0000","last_undegraded":"2023-07-14T11:13:15.018603+0000","last_fullsized":"2023-07-14T11:13:15.018603+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:00:49.901677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.016471+0000","last_change":"2023-07-14T11:13:15.008804+0000","last_active":"2023-07-14T11:13:15.016471+0000","last_peered":"2023-07-14T11:13:15.016471+0000","last_clean":"2023-07-14T11:13:15.016471+0000","last_became_active":"2023-07-14T11:13:15.007948+0000","last_became_peered":"2023-07-14T11:13:15.007948+0000","last_unstale":"2023-07-14T11:13:15.016471+0000","last_undegraded":"2023-07-14T11:13:15.016471+0000","last_fullsized":"2023-07-14T11:13:15.016471+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:58:38.845550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.009281+0000","last_change":"2023-07-14T11:13:15.006574+0000","last_active":"2023-07-14T11:13:15.009281+0000","last_peered":"2023-07-14T11:13:15.009281+0000","last_clean":"2023-07-14T11:13:15.009281+0000","last_became_active":"2023-07-14T11:13:15.006129+0000","last_became_peered":"2023-07-14T11:13:15.006129+0000","last_unstale":"2023-07-14T11:13:15.009281+0000","last_undegraded":"2023-07-14T11:13:15.009281+0000","last_fullsized":"2023-07-14T11:13:15.009281+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:19:17.400582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:14.999667+0000","last_change":"2023-07-14T11:13:14.995683+0000","last_active":"2023-07-14T11:13:14.999667+0000","last_peered":"2023-07-14T11:13:14.999667+0000","last_clean":"2023-07-14T11:13:14.999667+0000","last_became_active":"2023-07-14T11:13:14.995379+0000","last_became_peered":"2023-07-14T11:13:14.995379+0000","last_unstale":"2023-07-14T11:13:14.999667+0000","last_undegraded":"2023-07-14T11:13:14.999667+0000","last_fullsized":"2023-07-14T11:13:14.999667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:59:05.719375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.011968+0000","last_change":"2023-07-14T11:13:15.001711+0000","last_active":"2023-07-14T11:13:15.011968+0000","last_peered":"2023-07-14T11:13:15.011968+0000","last_clean":"2023-07-14T11:13:15.011968+0000","last_became_active":"2023-07-14T11:13:15.000809+0000","last_became_peered":"2023-07-14T11:13:15.000809+0000","last_unstale":"2023-07-14T11:13:15.011968+0000","last_undegraded":"2023-07-14T11:13:15.011968+0000","last_fullsized":"2023-07-14T11:13:15.011968+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:36:50.668482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.007747+0000","last_change":"2023-07-14T11:13:15.001781+0000","last_active":"2023-07-14T11:13:15.007747+0000","last_peered":"2023-07-14T11:13:15.007747+0000","last_clean":"2023-07-14T11:13:15.007747+0000","last_became_active":"2023-07-14T11:13:15.001509+0000","last_became_peered":"2023-07-14T11:13:15.001509+0000","last_unstale":"2023-07-14T11:13:15.007747+0000","last_undegraded":"2023-07-14T11:13:15.007747+0000","last_fullsized":"2023-07-14T11:13:15.007747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:14:42.298292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.029107+0000","last_change":"2023-07-14T11:13:13.986413+0000","last_active":"2023-07-14T11:13:15.029107+0000","last_peered":"2023-07-14T11:13:15.029107+0000","last_clean":"2023-07-14T11:13:15.029107+0000","last_became_active":"2023-07-14T11:13:13.986200+0000","last_became_peered":"2023-07-14T11:13:13.986200+0000","last_unstale":"2023-07-14T11:13:15.029107+0000","last_undegraded":"2023-07-14T11:13:15.029107+0000","last_fullsized":"2023-07-14T11:13:15.029107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:45:00.022408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.019039+0000","last_change":"2023-07-14T11:13:15.013058+0000","last_active":"2023-07-14T11:13:15.019039+0000","last_peered":"2023-07-14T11:13:15.019039+0000","last_clean":"2023-07-14T11:13:15.019039+0000","last_became_active":"2023-07-14T11:13:15.012721+0000","last_became_peered":"2023-07-14T11:13:15.012721+0000","last_unstale":"2023-07-14T11:13:15.019039+0000","last_undegraded":"2023-07-14T11:13:15.019039+0000","last_fullsized":"2023-07-14T11:13:15.019039+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:59:16.072212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:14.983656+0000","last_change":"2023-07-14T11:13:13.982240+0000","last_active":"2023-07-14T11:13:14.983656+0000","last_peered":"2023-07-14T11:13:14.983656+0000","last_clean":"2023-07-14T11:13:14.983656+0000","last_became_active":"2023-07-14T11:13:13.981974+0000","last_became_peered":"2023-07-14T11:13:13.981974+0000","last_unstale":"2023-07-14T11:13:14.983656+0000","last_undegraded":"2023-07-14T11:13:14.983656+0000","last_fullsized":"2023-07-14T11:13:14.983656+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:59:15.067078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.027282+0000","last_change":"2023-07-14T11:13:15.024726+0000","last_active":"2023-07-14T11:13:15.027282+0000","last_peered":"2023-07-14T11:13:15.027282+0000","last_clean":"2023-07-14T11:13:15.027282+0000","last_became_active":"2023-07-14T11:13:15.024453+0000","last_became_peered":"2023-07-14T11:13:15.024453+0000","last_unstale":"2023-07-14T11:13:15.027282+0000","last_undegraded":"2023-07-14T11:13:15.027282+0000","last_fullsized":"2023-07-14T11:13:15.027282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:11:14.713367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:14.994171+0000","last_change":"2023-07-14T11:13:13.979433+0000","last_active":"2023-07-14T11:13:14.994171+0000","last_peered":"2023-07-14T11:13:14.994171+0000","last_clean":"2023-07-14T11:13:14.994171+0000","last_became_active":"2023-07-14T11:13:13.979120+0000","last_became_peered":"2023-07-14T11:13:13.979120+0000","last_unstale":"2023-07-14T11:13:14.994171+0000","last_undegraded":"2023-07-14T11:13:14.994171+0000","last_fullsized":"2023-07-14T11:13:14.994171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:00:48.896543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.004384+0000","last_change":"2023-07-14T11:13:14.998412+0000","last_active":"2023-07-14T11:13:15.004384+0000","last_peered":"2023-07-14T11:13:15.004384+0000","last_clean":"2023-07-14T11:13:15.004384+0000","last_became_active":"2023-07-14T11:13:14.998117+0000","last_became_peered":"2023-07-14T11:13:14.998117+0000","last_unstale":"2023-07-14T11:13:15.004384+0000","last_undegraded":"2023-07-14T11:13:15.004384+0000","last_fullsized":"2023-07-14T11:13:15.004384+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:47:42.967958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:14.993484+0000","last_change":"2023-07-14T11:13:13.990938+0000","last_active":"2023-07-14T11:13:14.993484+0000","last_peered":"2023-07-14T11:13:14.993484+0000","last_clean":"2023-07-14T11:13:14.993484+0000","last_became_active":"2023-07-14T11:13:13.990590+0000","last_became_peered":"2023-07-14T11:13:13.990590+0000","last_unstale":"2023-07-14T11:13:14.993484+0000","last_undegraded":"2023-07-14T11:13:14.993484+0000","last_fullsized":"2023-07-14T11:13:14.993484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:40:55.858851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.018934+0000","last_change":"2023-07-14T11:13:15.012816+0000","last_active":"2023-07-14T11:13:15.018934+0000","last_peered":"2023-07-14T11:13:15.018934+0000","last_clean":"2023-07-14T11:13:15.018934+0000","last_became_active":"2023-07-14T11:13:15.012565+0000","last_became_peered":"2023-07-14T11:13:15.012565+0000","last_unstale":"2023-07-14T11:13:15.018934+0000","last_undegraded":"2023-07-14T11:13:15.018934+0000","last_fullsized":"2023-07-14T11:13:15.018934+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:11:28.195310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:14.987036+0000","last_change":"2023-07-14T11:13:13.979704+0000","last_active":"2023-07-14T11:13:14.987036+0000","last_peered":"2023-07-14T11:13:14.987036+0000","last_clean":"2023-07-14T11:13:14.987036+0000","last_became_active":"2023-07-14T11:13:13.978362+0000","last_became_peered":"2023-07-14T11:13:13.978362+0000","last_unstale":"2023-07-14T11:13:14.987036+0000","last_undegraded":"2023-07-14T11:13:14.987036+0000","last_fullsized":"2023-07-14T11:13:14.987036+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:36:49.663348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.016509+0000","last_change":"2023-07-14T11:13:15.009208+0000","last_active":"2023-07-14T11:13:15.016509+0000","last_peered":"2023-07-14T11:13:15.016509+0000","last_clean":"2023-07-14T11:13:15.016509+0000","last_became_active":"2023-07-14T11:13:15.008572+0000","last_became_peered":"2023-07-14T11:13:15.008572+0000","last_unstale":"2023-07-14T11:13:15.016509+0000","last_undegraded":"2023-07-14T11:13:15.016509+0000","last_fullsized":"2023-07-14T11:13:15.016509+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:13:04.773850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.031418+0000","last_change":"2023-07-14T11:13:13.984123+0000","last_active":"2023-07-14T11:13:15.031418+0000","last_peered":"2023-07-14T11:13:15.031418+0000","last_clean":"2023-07-14T11:13:15.031418+0000","last_became_active":"2023-07-14T11:13:13.983850+0000","last_became_peered":"2023-07-14T11:13:13.983850+0000","last_unstale":"2023-07-14T11:13:15.031418+0000","last_undegraded":"2023-07-14T11:13:15.031418+0000","last_fullsized":"2023-07-14T11:13:15.031418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:24:32.366039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.008874+0000","last_change":"2023-07-14T11:13:14.996379+0000","last_active":"2023-07-14T11:13:15.008874+0000","last_peered":"2023-07-14T11:13:15.008874+0000","last_clean":"2023-07-14T11:13:15.008874+0000","last_became_active":"2023-07-14T11:13:14.996054+0000","last_became_peered":"2023-07-14T11:13:14.996054+0000","last_unstale":"2023-07-14T11:13:15.008874+0000","last_undegraded":"2023-07-14T11:13:15.008874+0000","last_fullsized":"2023-07-14T11:13:15.008874+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:43:57.824230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"22'6","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.032601+0000","last_change":"2023-07-14T11:13:13.985526+0000","last_active":"2023-07-14T11:13:15.032601+0000","last_peered":"2023-07-14T11:13:15.032601+0000","last_clean":"2023-07-14T11:13:15.032601+0000","last_became_active":"2023-07-14T11:13:13.985067+0000","last_became_peered":"2023-07-14T11:13:13.985067+0000","last_unstale":"2023-07-14T11:13:15.032601+0000","last_undegraded":"2023-07-14T11:13:15.032601+0000","last_fullsized":"2023-07-14T11:13:15.032601+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:11:13.708234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.027455+0000","last_change":"2023-07-14T11:13:15.016170+0000","last_active":"2023-07-14T11:13:15.027455+0000","last_peered":"2023-07-14T11:13:15.027455+0000","last_clean":"2023-07-14T11:13:15.027455+0000","last_became_active":"2023-07-14T11:13:15.015912+0000","last_became_peered":"2023-07-14T11:13:15.015912+0000","last_unstale":"2023-07-14T11:13:15.027455+0000","last_undegraded":"2023-07-14T11:13:15.027455+0000","last_fullsized":"2023-07-14T11:13:15.027455+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:03:17.140553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.029682+0000","last_change":"2023-07-14T11:13:13.992370+0000","last_active":"2023-07-14T11:13:15.029682+0000","last_peered":"2023-07-14T11:13:15.029682+0000","last_clean":"2023-07-14T11:13:15.029682+0000","last_became_active":"2023-07-14T11:13:13.992063+0000","last_became_peered":"2023-07-14T11:13:13.992063+0000","last_unstale":"2023-07-14T11:13:15.029682+0000","last_undegraded":"2023-07-14T11:13:15.029682+0000","last_fullsized":"2023-07-14T11:13:15.029682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:48:45.385596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.017829+0000","last_change":"2023-07-14T11:13:15.010039+0000","last_active":"2023-07-14T11:13:15.017829+0000","last_peered":"2023-07-14T11:13:15.017829+0000","last_clean":"2023-07-14T11:13:15.017829+0000","last_became_active":"2023-07-14T11:13:15.009733+0000","last_became_peered":"2023-07-14T11:13:15.009733+0000","last_unstale":"2023-07-14T11:13:15.017829+0000","last_undegraded":"2023-07-14T11:13:15.017829+0000","last_fullsized":"2023-07-14T11:13:15.017829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:27:27.142803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:14.997308+0000","last_change":"2023-07-14T11:13:13.977355+0000","last_active":"2023-07-14T11:13:14.997308+0000","last_peered":"2023-07-14T11:13:14.997308+0000","last_clean":"2023-07-14T11:13:14.997308+0000","last_became_active":"2023-07-14T11:13:13.977018+0000","last_became_peered":"2023-07-14T11:13:13.977018+0000","last_unstale":"2023-07-14T11:13:14.997308+0000","last_undegraded":"2023-07-14T11:13:14.997308+0000","last_fullsized":"2023-07-14T11:13:14.997308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:59:04.714241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.007728+0000","last_change":"2023-07-14T11:13:15.000625+0000","last_active":"2023-07-14T11:13:15.007728+0000","last_peered":"2023-07-14T11:13:15.007728+0000","last_clean":"2023-07-14T11:13:15.007728+0000","last_became_active":"2023-07-14T11:13:15.000327+0000","last_became_peered":"2023-07-14T11:13:15.000327+0000","last_unstale":"2023-07-14T11:13:15.007728+0000","last_undegraded":"2023-07-14T11:13:15.007728+0000","last_fullsized":"2023-07-14T11:13:15.007728+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:11:14.713367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:14.989207+0000","last_change":"2023-07-14T11:13:13.991381+0000","last_active":"2023-07-14T11:13:14.989207+0000","last_peered":"2023-07-14T11:13:14.989207+0000","last_clean":"2023-07-14T11:13:14.989207+0000","last_became_active":"2023-07-14T11:13:13.991045+0000","last_became_peered":"2023-07-14T11:13:13.991045+0000","last_unstale":"2023-07-14T11:13:14.989207+0000","last_undegraded":"2023-07-14T11:13:14.989207+0000","last_fullsized":"2023-07-14T11:13:14.989207+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:44:31.620403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.018647+0000","last_change":"2023-07-14T11:13:15.014077+0000","last_active":"2023-07-14T11:13:15.018647+0000","last_peered":"2023-07-14T11:13:15.018647+0000","last_clean":"2023-07-14T11:13:15.018647+0000","last_became_active":"2023-07-14T11:13:15.013318+0000","last_became_peered":"2023-07-14T11:13:15.013318+0000","last_unstale":"2023-07-14T11:13:15.018647+0000","last_undegraded":"2023-07-14T11:13:15.018647+0000","last_fullsized":"2023-07-14T11:13:15.018647+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:03:17.140553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.022375+0000","last_change":"2023-07-14T11:13:13.991024+0000","last_active":"2023-07-14T11:13:15.022375+0000","last_peered":"2023-07-14T11:13:15.022375+0000","last_clean":"2023-07-14T11:13:15.022375+0000","last_became_active":"2023-07-14T11:13:13.990641+0000","last_became_peered":"2023-07-14T11:13:13.990641+0000","last_unstale":"2023-07-14T11:13:15.022375+0000","last_undegraded":"2023-07-14T11:13:15.022375+0000","last_fullsized":"2023-07-14T11:13:15.022375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:58:37.840416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.011435+0000","last_change":"2023-07-14T11:13:15.004063+0000","last_active":"2023-07-14T11:13:15.011435+0000","last_peered":"2023-07-14T11:13:15.011435+0000","last_clean":"2023-07-14T11:13:15.011435+0000","last_became_active":"2023-07-14T11:13:15.003754+0000","last_became_peered":"2023-07-14T11:13:15.003754+0000","last_unstale":"2023-07-14T11:13:15.011435+0000","last_undegraded":"2023-07-14T11:13:15.011435+0000","last_fullsized":"2023-07-14T11:13:15.011435+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:42:28.587522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.026809+0000","last_change":"2023-07-14T11:13:13.991618+0000","last_active":"2023-07-14T11:13:15.026809+0000","last_peered":"2023-07-14T11:13:15.026809+0000","last_clean":"2023-07-14T11:13:15.026809+0000","last_became_active":"2023-07-14T11:13:13.991310+0000","last_became_peered":"2023-07-14T11:13:13.991310+0000","last_unstale":"2023-07-14T11:13:15.026809+0000","last_undegraded":"2023-07-14T11:13:15.026809+0000","last_fullsized":"2023-07-14T11:13:15.026809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:43:56.126136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.007681+0000","last_change":"2023-07-14T11:13:15.000022+0000","last_active":"2023-07-14T11:13:15.007681+0000","last_peered":"2023-07-14T11:13:15.007681+0000","last_clean":"2023-07-14T11:13:15.007681+0000","last_became_active":"2023-07-14T11:13:14.999632+0000","last_became_peered":"2023-07-14T11:13:14.999632+0000","last_unstale":"2023-07-14T11:13:15.007681+0000","last_undegraded":"2023-07-14T11:13:15.007681+0000","last_fullsized":"2023-07-14T11:13:15.007681+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:13:04.773850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.029057+0000","last_change":"2023-07-14T11:13:13.991415+0000","last_active":"2023-07-14T11:13:15.029057+0000","last_peered":"2023-07-14T11:13:15.029057+0000","last_clean":"2023-07-14T11:13:15.029057+0000","last_became_active":"2023-07-14T11:13:13.991182+0000","last_became_peered":"2023-07-14T11:13:13.991182+0000","last_unstale":"2023-07-14T11:13:15.029057+0000","last_undegraded":"2023-07-14T11:13:15.029057+0000","last_fullsized":"2023-07-14T11:13:15.029057+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:48:04.402813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.027851+0000","last_change":"2023-07-14T11:13:15.022123+0000","last_active":"2023-07-14T11:13:15.027851+0000","last_peered":"2023-07-14T11:13:15.027851+0000","last_clean":"2023-07-14T11:13:15.027851+0000","last_became_active":"2023-07-14T11:13:15.016892+0000","last_became_peered":"2023-07-14T11:13:15.016892+0000","last_unstale":"2023-07-14T11:13:15.027851+0000","last_undegraded":"2023-07-14T11:13:15.027851+0000","last_fullsized":"2023-07-14T11:13:15.027851+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:11:28.195310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.029632+0000","last_change":"2023-07-14T11:13:13.989926+0000","last_active":"2023-07-14T11:13:15.029632+0000","last_peered":"2023-07-14T11:13:15.029632+0000","last_clean":"2023-07-14T11:13:15.029632+0000","last_became_active":"2023-07-14T11:13:13.989600+0000","last_became_peered":"2023-07-14T11:13:13.989600+0000","last_unstale":"2023-07-14T11:13:15.029632+0000","last_undegraded":"2023-07-14T11:13:15.029632+0000","last_fullsized":"2023-07-14T11:13:15.029632+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:46:46.842842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.010591+0000","last_change":"2023-07-14T11:13:15.004391+0000","last_active":"2023-07-14T11:13:15.010591+0000","last_peered":"2023-07-14T11:13:15.010591+0000","last_clean":"2023-07-14T11:13:15.010591+0000","last_became_active":"2023-07-14T11:13:14.999504+0000","last_became_peered":"2023-07-14T11:13:14.999504+0000","last_unstale":"2023-07-14T11:13:15.010591+0000","last_undegraded":"2023-07-14T11:13:15.010591+0000","last_fullsized":"2023-07-14T11:13:15.010591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:42:28.587522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:14.986898+0000","last_change":"2023-07-14T11:13:13.979533+0000","last_active":"2023-07-14T11:13:14.986898+0000","last_peered":"2023-07-14T11:13:14.986898+0000","last_clean":"2023-07-14T11:13:14.986898+0000","last_became_active":"2023-07-14T11:13:13.979160+0000","last_became_peered":"2023-07-14T11:13:13.979160+0000","last_unstale":"2023-07-14T11:13:14.986898+0000","last_undegraded":"2023-07-14T11:13:14.986898+0000","last_fullsized":"2023-07-14T11:13:14.986898+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:45:00.022408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.019921+0000","last_change":"2023-07-14T11:13:15.016320+0000","last_active":"2023-07-14T11:13:15.019921+0000","last_peered":"2023-07-14T11:13:15.019921+0000","last_clean":"2023-07-14T11:13:15.019921+0000","last_became_active":"2023-07-14T11:13:15.016023+0000","last_became_peered":"2023-07-14T11:13:15.016023+0000","last_unstale":"2023-07-14T11:13:15.019921+0000","last_undegraded":"2023-07-14T11:13:15.019921+0000","last_fullsized":"2023-07-14T11:13:15.019921+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:43:57.824230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.025574+0000","last_change":"2023-07-14T11:13:13.987628+0000","last_active":"2023-07-14T11:13:15.025574+0000","last_peered":"2023-07-14T11:13:15.025574+0000","last_clean":"2023-07-14T11:13:15.025574+0000","last_became_active":"2023-07-14T11:13:13.987361+0000","last_became_peered":"2023-07-14T11:13:13.987361+0000","last_unstale":"2023-07-14T11:13:15.025574+0000","last_undegraded":"2023-07-14T11:13:15.025574+0000","last_fullsized":"2023-07-14T11:13:15.025574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:03:16.135420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.027782+0000","last_change":"2023-07-14T11:13:15.021655+0000","last_active":"2023-07-14T11:13:15.027782+0000","last_peered":"2023-07-14T11:13:15.027782+0000","last_clean":"2023-07-14T11:13:15.027782+0000","last_became_active":"2023-07-14T11:13:15.018683+0000","last_became_peered":"2023-07-14T11:13:15.018683+0000","last_unstale":"2023-07-14T11:13:15.027782+0000","last_undegraded":"2023-07-14T11:13:15.027782+0000","last_fullsized":"2023-07-14T11:13:15.027782+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:40:56.863985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:14.990225+0000","last_change":"2023-07-14T11:13:13.992123+0000","last_active":"2023-07-14T11:13:14.990225+0000","last_peered":"2023-07-14T11:13:14.990225+0000","last_clean":"2023-07-14T11:13:14.990225+0000","last_became_active":"2023-07-14T11:13:13.991832+0000","last_became_peered":"2023-07-14T11:13:13.991832+0000","last_unstale":"2023-07-14T11:13:14.990225+0000","last_undegraded":"2023-07-14T11:13:14.990225+0000","last_fullsized":"2023-07-14T11:13:14.990225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:40:55.858851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.027576+0000","last_change":"2023-07-14T11:13:15.019054+0000","last_active":"2023-07-14T11:13:15.027576+0000","last_peered":"2023-07-14T11:13:15.027576+0000","last_clean":"2023-07-14T11:13:15.027576+0000","last_became_active":"2023-07-14T11:13:15.018737+0000","last_became_peered":"2023-07-14T11:13:15.018737+0000","last_unstale":"2023-07-14T11:13:15.027576+0000","last_undegraded":"2023-07-14T11:13:15.027576+0000","last_fullsized":"2023-07-14T11:13:15.027576+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:27:27.142803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.004322+0000","last_change":"2023-07-14T11:13:13.986400+0000","last_active":"2023-07-14T11:13:15.004322+0000","last_peered":"2023-07-14T11:13:15.004322+0000","last_clean":"2023-07-14T11:13:15.004322+0000","last_became_active":"2023-07-14T11:13:13.986081+0000","last_became_peered":"2023-07-14T11:13:13.986081+0000","last_unstale":"2023-07-14T11:13:15.004322+0000","last_undegraded":"2023-07-14T11:13:15.004322+0000","last_fullsized":"2023-07-14T11:13:15.004322+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:46:54.002810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.013281+0000","last_change":"2023-07-14T11:13:15.011241+0000","last_active":"2023-07-14T11:13:15.013281+0000","last_peered":"2023-07-14T11:13:15.013281+0000","last_clean":"2023-07-14T11:13:15.013281+0000","last_became_active":"2023-07-14T11:13:15.010955+0000","last_became_peered":"2023-07-14T11:13:15.010955+0000","last_unstale":"2023-07-14T11:13:15.013281+0000","last_undegraded":"2023-07-14T11:13:15.013281+0000","last_fullsized":"2023-07-14T11:13:15.013281+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:47:42.967958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:14.995486+0000","last_change":"2023-07-14T11:13:13.982073+0000","last_active":"2023-07-14T11:13:14.995486+0000","last_peered":"2023-07-14T11:13:14.995486+0000","last_clean":"2023-07-14T11:13:14.995486+0000","last_became_active":"2023-07-14T11:13:13.981729+0000","last_became_peered":"2023-07-14T11:13:13.981729+0000","last_unstale":"2023-07-14T11:13:14.995486+0000","last_undegraded":"2023-07-14T11:13:14.995486+0000","last_fullsized":"2023-07-14T11:13:14.995486+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:46:54.002810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.018666+0000","last_change":"2023-07-14T11:13:15.008740+0000","last_active":"2023-07-14T11:13:15.018666+0000","last_peered":"2023-07-14T11:13:15.018666+0000","last_clean":"2023-07-14T11:13:15.018666+0000","last_became_active":"2023-07-14T11:13:15.008487+0000","last_became_peered":"2023-07-14T11:13:15.008487+0000","last_unstale":"2023-07-14T11:13:15.018666+0000","last_undegraded":"2023-07-14T11:13:15.018666+0000","last_fullsized":"2023-07-14T11:13:15.018666+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:45:01.027542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:14.985540+0000","last_change":"2023-07-14T11:13:08.923786+0000","last_active":"2023-07-14T11:13:14.985540+0000","last_peered":"2023-07-14T11:13:14.985540+0000","last_clean":"2023-07-14T11:13:14.985540+0000","last_became_active":"2023-07-14T11:13:08.923384+0000","last_became_peered":"2023-07-14T11:13:08.923384+0000","last_unstale":"2023-07-14T11:13:14.985540+0000","last_undegraded":"2023-07-14T11:13:14.985540+0000","last_fullsized":"2023-07-14T11:13:14.985540+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:46:48.794410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:14.989662+0000","last_change":"2023-07-14T11:13:13.979901+0000","last_active":"2023-07-14T11:13:14.989662+0000","last_peered":"2023-07-14T11:13:14.989662+0000","last_clean":"2023-07-14T11:13:14.989662+0000","last_became_active":"2023-07-14T11:13:13.979617+0000","last_became_peered":"2023-07-14T11:13:13.979617+0000","last_unstale":"2023-07-14T11:13:14.989662+0000","last_undegraded":"2023-07-14T11:13:14.989662+0000","last_fullsized":"2023-07-14T11:13:14.989662+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:00:14.107687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.011855+0000","last_change":"2023-07-14T11:13:14.999336+0000","last_active":"2023-07-14T11:13:15.011855+0000","last_peered":"2023-07-14T11:13:15.011855+0000","last_clean":"2023-07-14T11:13:15.011855+0000","last_became_active":"2023-07-14T11:13:14.999023+0000","last_became_peered":"2023-07-14T11:13:14.999023+0000","last_unstale":"2023-07-14T11:13:15.011855+0000","last_undegraded":"2023-07-14T11:13:15.011855+0000","last_fullsized":"2023-07-14T11:13:15.011855+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:00:49.901677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:14.987963+0000","last_change":"2023-07-14T11:13:08.758749+0000","last_active":"2023-07-14T11:13:14.987963+0000","last_peered":"2023-07-14T11:13:14.987963+0000","last_clean":"2023-07-14T11:13:14.987963+0000","last_became_active":"2023-07-14T11:13:08.757956+0000","last_became_peered":"2023-07-14T11:13:08.757956+0000","last_unstale":"2023-07-14T11:13:14.987963+0000","last_undegraded":"2023-07-14T11:13:14.987963+0000","last_fullsized":"2023-07-14T11:13:14.987963+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:47:59.194413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.004154+0000","last_change":"2023-07-14T11:13:13.987810+0000","last_active":"2023-07-14T11:13:15.004154+0000","last_peered":"2023-07-14T11:13:15.004154+0000","last_clean":"2023-07-14T11:13:15.004154+0000","last_became_active":"2023-07-14T11:13:13.987575+0000","last_became_peered":"2023-07-14T11:13:13.987575+0000","last_unstale":"2023-07-14T11:13:15.004154+0000","last_undegraded":"2023-07-14T11:13:15.004154+0000","last_fullsized":"2023-07-14T11:13:15.004154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:13:03.768716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.012080+0000","last_change":"2023-07-14T11:13:15.000483+0000","last_active":"2023-07-14T11:13:15.012080+0000","last_peered":"2023-07-14T11:13:15.012080+0000","last_clean":"2023-07-14T11:13:15.012080+0000","last_became_active":"2023-07-14T11:13:15.000027+0000","last_became_peered":"2023-07-14T11:13:15.000027+0000","last_unstale":"2023-07-14T11:13:15.012080+0000","last_undegraded":"2023-07-14T11:13:15.012080+0000","last_fullsized":"2023-07-14T11:13:15.012080+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:13:04.773850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:14.985256+0000","last_change":"2023-07-14T11:13:08.862331+0000","last_active":"2023-07-14T11:13:14.985256+0000","last_peered":"2023-07-14T11:13:14.985256+0000","last_clean":"2023-07-14T11:13:14.985256+0000","last_became_active":"2023-07-14T11:13:08.861817+0000","last_became_peered":"2023-07-14T11:13:08.861817+0000","last_unstale":"2023-07-14T11:13:14.985256+0000","last_undegraded":"2023-07-14T11:13:14.985256+0000","last_fullsized":"2023-07-14T11:13:14.985256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:00:01.976611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:14.984002+0000","last_change":"2023-07-14T11:13:13.979826+0000","last_active":"2023-07-14T11:13:14.984002+0000","last_peered":"2023-07-14T11:13:14.984002+0000","last_clean":"2023-07-14T11:13:14.984002+0000","last_became_active":"2023-07-14T11:13:13.979506+0000","last_became_peered":"2023-07-14T11:13:13.979506+0000","last_unstale":"2023-07-14T11:13:14.984002+0000","last_undegraded":"2023-07-14T11:13:14.984002+0000","last_fullsized":"2023-07-14T11:13:14.984002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:27:26.137669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.011915+0000","last_change":"2023-07-14T11:13:14.999511+0000","last_active":"2023-07-14T11:13:15.011915+0000","last_peered":"2023-07-14T11:13:15.011915+0000","last_clean":"2023-07-14T11:13:15.011915+0000","last_became_active":"2023-07-14T11:13:14.999201+0000","last_became_peered":"2023-07-14T11:13:14.999201+0000","last_unstale":"2023-07-14T11:13:15.011915+0000","last_undegraded":"2023-07-14T11:13:15.011915+0000","last_fullsized":"2023-07-14T11:13:15.011915+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:11:14.713367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:14.985089+0000","last_change":"2023-07-14T11:13:08.757882+0000","last_active":"2023-07-14T11:13:14.985089+0000","last_peered":"2023-07-14T11:13:14.985089+0000","last_clean":"2023-07-14T11:13:14.985089+0000","last_became_active":"2023-07-14T11:13:08.757541+0000","last_became_peered":"2023-07-14T11:13:08.757541+0000","last_unstale":"2023-07-14T11:13:14.985089+0000","last_undegraded":"2023-07-14T11:13:14.985089+0000","last_fullsized":"2023-07-14T11:13:14.985089+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:27:20.929269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":173,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:14.989962+0000","last_change":"2023-07-14T11:13:01.370649+0000","last_active":"2023-07-14T11:13:14.989962+0000","last_peered":"2023-07-14T11:13:14.989962+0000","last_clean":"2023-07-14T11:13:14.989962+0000","last_became_active":"2023-07-14T11:13:01.369478+0000","last_became_peered":"2023-07-14T11:13:01.369478+0000","last_unstale":"2023-07-14T11:13:14.989962+0000","last_undegraded":"2023-07-14T11:13:14.989962+0000","last_fullsized":"2023-07-14T11:13:14.989962+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:00.254800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:00.254800+0000","last_clean_scrub_stamp":"2023-07-14T11:13:00.254800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:01:54.821359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:14.992492+0000","last_change":"2023-07-14T11:13:13.989456+0000","last_active":"2023-07-14T11:13:14.992492+0000","last_peered":"2023-07-14T11:13:14.992492+0000","last_clean":"2023-07-14T11:13:14.992492+0000","last_became_active":"2023-07-14T11:13:13.989210+0000","last_became_peered":"2023-07-14T11:13:13.989210+0000","last_unstale":"2023-07-14T11:13:14.992492+0000","last_undegraded":"2023-07-14T11:13:14.992492+0000","last_fullsized":"2023-07-14T11:13:14.992492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:47:41.962824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.023903+0000","last_change":"2023-07-14T11:13:15.020682+0000","last_active":"2023-07-14T11:13:15.023903+0000","last_peered":"2023-07-14T11:13:15.023903+0000","last_clean":"2023-07-14T11:13:15.023903+0000","last_became_active":"2023-07-14T11:13:15.020395+0000","last_became_peered":"2023-07-14T11:13:15.020395+0000","last_unstale":"2023-07-14T11:13:15.023903+0000","last_undegraded":"2023-07-14T11:13:15.023903+0000","last_fullsized":"2023-07-14T11:13:15.023903+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:59:16.072212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:14.991078+0000","last_change":"2023-07-14T11:13:08.760609+0000","last_active":"2023-07-14T11:13:14.991078+0000","last_peered":"2023-07-14T11:13:14.991078+0000","last_clean":"2023-07-14T11:13:14.991078+0000","last_became_active":"2023-07-14T11:13:08.760285+0000","last_became_peered":"2023-07-14T11:13:08.760285+0000","last_unstale":"2023-07-14T11:13:14.991078+0000","last_undegraded":"2023-07-14T11:13:14.991078+0000","last_fullsized":"2023-07-14T11:13:14.991078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:15:21.263931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:14.993438+0000","last_change":"2023-07-14T11:13:13.985223+0000","last_active":"2023-07-14T11:13:14.993438+0000","last_peered":"2023-07-14T11:13:14.993438+0000","last_clean":"2023-07-14T11:13:14.993438+0000","last_became_active":"2023-07-14T11:13:13.984889+0000","last_became_peered":"2023-07-14T11:13:13.984889+0000","last_unstale":"2023-07-14T11:13:14.993438+0000","last_undegraded":"2023-07-14T11:13:14.993438+0000","last_fullsized":"2023-07-14T11:13:14.993438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:00:07.185011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.018665+0000","last_change":"2023-07-14T11:13:15.014139+0000","last_active":"2023-07-14T11:13:15.018665+0000","last_peered":"2023-07-14T11:13:15.018665+0000","last_clean":"2023-07-14T11:13:15.018665+0000","last_became_active":"2023-07-14T11:13:15.013656+0000","last_became_peered":"2023-07-14T11:13:15.013656+0000","last_unstale":"2023-07-14T11:13:15.018665+0000","last_undegraded":"2023-07-14T11:13:15.018665+0000","last_fullsized":"2023-07-14T11:13:15.018665+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:58:38.845550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:14.990274+0000","last_change":"2023-07-14T11:13:08.923899+0000","last_active":"2023-07-14T11:13:14.990274+0000","last_peered":"2023-07-14T11:13:14.990274+0000","last_clean":"2023-07-14T11:13:14.990274+0000","last_became_active":"2023-07-14T11:13:08.923513+0000","last_became_peered":"2023-07-14T11:13:08.923513+0000","last_unstale":"2023-07-14T11:13:14.990274+0000","last_undegraded":"2023-07-14T11:13:14.990274+0000","last_fullsized":"2023-07-14T11:13:14.990274+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:25:21.744503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:14.985798+0000","last_change":"2023-07-14T11:13:13.980381+0000","last_active":"2023-07-14T11:13:14.985798+0000","last_peered":"2023-07-14T11:13:14.985798+0000","last_clean":"2023-07-14T11:13:14.985798+0000","last_became_active":"2023-07-14T11:13:13.980136+0000","last_became_peered":"2023-07-14T11:13:13.980136+0000","last_unstale":"2023-07-14T11:13:14.985798+0000","last_undegraded":"2023-07-14T11:13:14.985798+0000","last_fullsized":"2023-07-14T11:13:14.985798+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:14:41.293158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.012808+0000","last_change":"2023-07-14T11:13:15.006407+0000","last_active":"2023-07-14T11:13:15.012808+0000","last_peered":"2023-07-14T11:13:15.012808+0000","last_clean":"2023-07-14T11:13:15.012808+0000","last_became_active":"2023-07-14T11:13:15.006104+0000","last_became_peered":"2023-07-14T11:13:15.006104+0000","last_unstale":"2023-07-14T11:13:15.012808+0000","last_undegraded":"2023-07-14T11:13:15.012808+0000","last_fullsized":"2023-07-14T11:13:15.012808+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:27:27.142803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.022645+0000","last_change":"2023-07-14T11:13:13.979833+0000","last_active":"2023-07-14T11:13:15.022645+0000","last_peered":"2023-07-14T11:13:15.022645+0000","last_clean":"2023-07-14T11:13:15.022645+0000","last_became_active":"2023-07-14T11:13:13.979564+0000","last_became_peered":"2023-07-14T11:13:13.979564+0000","last_unstale":"2023-07-14T11:13:15.022645+0000","last_undegraded":"2023-07-14T11:13:15.022645+0000","last_fullsized":"2023-07-14T11:13:15.022645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:14:41.293158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:14.985109+0000","last_change":"2023-07-14T11:13:08.761726+0000","last_active":"2023-07-14T11:13:14.985109+0000","last_peered":"2023-07-14T11:13:14.985109+0000","last_clean":"2023-07-14T11:13:14.985109+0000","last_became_active":"2023-07-14T11:13:08.761365+0000","last_became_peered":"2023-07-14T11:13:08.761365+0000","last_unstale":"2023-07-14T11:13:14.985109+0000","last_undegraded":"2023-07-14T11:13:14.985109+0000","last_fullsized":"2023-07-14T11:13:14.985109+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:03:10.927020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.010354+0000","last_change":"2023-07-14T11:13:15.004961+0000","last_active":"2023-07-14T11:13:15.010354+0000","last_peered":"2023-07-14T11:13:15.010354+0000","last_clean":"2023-07-14T11:13:15.010354+0000","last_became_active":"2023-07-14T11:13:15.004656+0000","last_became_peered":"2023-07-14T11:13:15.004656+0000","last_unstale":"2023-07-14T11:13:15.010354+0000","last_undegraded":"2023-07-14T11:13:15.010354+0000","last_fullsized":"2023-07-14T11:13:15.010354+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:43:57.824230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:14.990156+0000","last_change":"2023-07-14T11:13:08.762084+0000","last_active":"2023-07-14T11:13:14.990156+0000","last_peered":"2023-07-14T11:13:14.990156+0000","last_clean":"2023-07-14T11:13:14.990156+0000","last_became_active":"2023-07-14T11:13:08.761763+0000","last_became_peered":"2023-07-14T11:13:08.761763+0000","last_unstale":"2023-07-14T11:13:14.990156+0000","last_undegraded":"2023-07-14T11:13:14.990156+0000","last_fullsized":"2023-07-14T11:13:14.990156+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:00:01.976611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:14.999305+0000","last_change":"2023-07-14T11:13:13.985679+0000","last_active":"2023-07-14T11:13:14.999305+0000","last_peered":"2023-07-14T11:13:14.999305+0000","last_clean":"2023-07-14T11:13:14.999305+0000","last_became_active":"2023-07-14T11:13:13.985432+0000","last_became_peered":"2023-07-14T11:13:13.985432+0000","last_unstale":"2023-07-14T11:13:14.999305+0000","last_undegraded":"2023-07-14T11:13:14.999305+0000","last_fullsized":"2023-07-14T11:13:14.999305+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:13:03.768716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.013655+0000","last_change":"2023-07-14T11:13:15.006256+0000","last_active":"2023-07-14T11:13:15.013655+0000","last_peered":"2023-07-14T11:13:15.013655+0000","last_clean":"2023-07-14T11:13:15.013655+0000","last_became_active":"2023-07-14T11:13:15.005979+0000","last_became_peered":"2023-07-14T11:13:15.005979+0000","last_unstale":"2023-07-14T11:13:15.013655+0000","last_undegraded":"2023-07-14T11:13:15.013655+0000","last_fullsized":"2023-07-14T11:13:15.013655+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:59:21.188485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.026658+0000","last_change":"2023-07-14T11:13:13.987238+0000","last_active":"2023-07-14T11:13:15.026658+0000","last_peered":"2023-07-14T11:13:15.026658+0000","last_clean":"2023-07-14T11:13:15.026658+0000","last_became_active":"2023-07-14T11:13:13.986985+0000","last_became_peered":"2023-07-14T11:13:13.986985+0000","last_unstale":"2023-07-14T11:13:15.026658+0000","last_undegraded":"2023-07-14T11:13:15.026658+0000","last_fullsized":"2023-07-14T11:13:15.026658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:14:41.293158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.009363+0000","last_change":"2023-07-14T11:13:14.998910+0000","last_active":"2023-07-14T11:13:15.009363+0000","last_peered":"2023-07-14T11:13:15.009363+0000","last_clean":"2023-07-14T11:13:15.009363+0000","last_became_active":"2023-07-14T11:13:14.998599+0000","last_became_peered":"2023-07-14T11:13:14.998599+0000","last_unstale":"2023-07-14T11:13:15.009363+0000","last_undegraded":"2023-07-14T11:13:15.009363+0000","last_fullsized":"2023-07-14T11:13:15.009363+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:40:56.863985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.028350+0000","last_change":"2023-07-14T11:13:13.978096+0000","last_active":"2023-07-14T11:13:15.028350+0000","last_peered":"2023-07-14T11:13:15.028350+0000","last_clean":"2023-07-14T11:13:15.028350+0000","last_became_active":"2023-07-14T11:13:13.977725+0000","last_became_peered":"2023-07-14T11:13:13.977725+0000","last_unstale":"2023-07-14T11:13:15.028350+0000","last_undegraded":"2023-07-14T11:13:15.028350+0000","last_fullsized":"2023-07-14T11:13:15.028350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:46:54.002810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.027770+0000","last_change":"2023-07-14T11:13:15.022976+0000","last_active":"2023-07-14T11:13:15.027770+0000","last_peered":"2023-07-14T11:13:15.027770+0000","last_clean":"2023-07-14T11:13:15.027770+0000","last_became_active":"2023-07-14T11:13:15.022716+0000","last_became_peered":"2023-07-14T11:13:15.022716+0000","last_unstale":"2023-07-14T11:13:15.027770+0000","last_undegraded":"2023-07-14T11:13:15.027770+0000","last_fullsized":"2023-07-14T11:13:15.027770+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:36:50.668482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.028433+0000","last_change":"2023-07-14T11:13:13.978838+0000","last_active":"2023-07-14T11:13:15.028433+0000","last_peered":"2023-07-14T11:13:15.028433+0000","last_clean":"2023-07-14T11:13:15.028433+0000","last_became_active":"2023-07-14T11:13:13.977771+0000","last_became_peered":"2023-07-14T11:13:13.977771+0000","last_unstale":"2023-07-14T11:13:15.028433+0000","last_undegraded":"2023-07-14T11:13:15.028433+0000","last_fullsized":"2023-07-14T11:13:15.028433+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:48:45.385596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.027832+0000","last_change":"2023-07-14T11:13:15.019154+0000","last_active":"2023-07-14T11:13:15.027832+0000","last_peered":"2023-07-14T11:13:15.027832+0000","last_clean":"2023-07-14T11:13:15.027832+0000","last_became_active":"2023-07-14T11:13:15.018878+0000","last_became_peered":"2023-07-14T11:13:15.018878+0000","last_unstale":"2023-07-14T11:13:15.027832+0000","last_undegraded":"2023-07-14T11:13:15.027832+0000","last_fullsized":"2023-07-14T11:13:15.027832+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:00:08.190145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.023488+0000","last_change":"2023-07-14T11:13:13.989944+0000","last_active":"2023-07-14T11:13:15.023488+0000","last_peered":"2023-07-14T11:13:15.023488+0000","last_clean":"2023-07-14T11:13:15.023488+0000","last_became_active":"2023-07-14T11:13:13.989576+0000","last_became_peered":"2023-07-14T11:13:13.989576+0000","last_unstale":"2023-07-14T11:13:15.023488+0000","last_undegraded":"2023-07-14T11:13:15.023488+0000","last_fullsized":"2023-07-14T11:13:15.023488+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:00:07.185011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.016491+0000","last_change":"2023-07-14T11:13:15.009006+0000","last_active":"2023-07-14T11:13:15.016491+0000","last_peered":"2023-07-14T11:13:15.016491+0000","last_clean":"2023-07-14T11:13:15.016491+0000","last_became_active":"2023-07-14T11:13:15.008256+0000","last_became_peered":"2023-07-14T11:13:15.008256+0000","last_unstale":"2023-07-14T11:13:15.016491+0000","last_undegraded":"2023-07-14T11:13:15.016491+0000","last_fullsized":"2023-07-14T11:13:15.016491+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:59:05.719375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.025183+0000","last_change":"2023-07-14T11:13:13.991268+0000","last_active":"2023-07-14T11:13:15.025183+0000","last_peered":"2023-07-14T11:13:15.025183+0000","last_clean":"2023-07-14T11:13:15.025183+0000","last_became_active":"2023-07-14T11:13:13.991022+0000","last_became_peered":"2023-07-14T11:13:13.991022+0000","last_unstale":"2023-07-14T11:13:15.025183+0000","last_undegraded":"2023-07-14T11:13:15.025183+0000","last_fullsized":"2023-07-14T11:13:15.025183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:59:15.067078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.014649+0000","last_change":"2023-07-14T11:13:15.012788+0000","last_active":"2023-07-14T11:13:15.014649+0000","last_peered":"2023-07-14T11:13:15.014649+0000","last_clean":"2023-07-14T11:13:15.014649+0000","last_became_active":"2023-07-14T11:13:15.012357+0000","last_became_peered":"2023-07-14T11:13:15.012357+0000","last_unstale":"2023-07-14T11:13:15.014649+0000","last_undegraded":"2023-07-14T11:13:15.014649+0000","last_fullsized":"2023-07-14T11:13:15.014649+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:42:28.587522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.007557+0000","last_change":"2023-07-14T11:13:15.002966+0000","last_active":"2023-07-14T11:13:15.007557+0000","last_peered":"2023-07-14T11:13:15.007557+0000","last_clean":"2023-07-14T11:13:15.007557+0000","last_became_active":"2023-07-14T11:13:15.002577+0000","last_became_peered":"2023-07-14T11:13:15.002577+0000","last_unstale":"2023-07-14T11:13:15.007557+0000","last_undegraded":"2023-07-14T11:13:15.007557+0000","last_fullsized":"2023-07-14T11:13:15.007557+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:27:27.142803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.019066+0000","last_change":"2023-07-14T11:13:15.013713+0000","last_active":"2023-07-14T11:13:15.019066+0000","last_peered":"2023-07-14T11:13:15.019066+0000","last_clean":"2023-07-14T11:13:15.019066+0000","last_became_active":"2023-07-14T11:13:15.013385+0000","last_became_peered":"2023-07-14T11:13:15.013385+0000","last_unstale":"2023-07-14T11:13:15.019066+0000","last_undegraded":"2023-07-14T11:13:15.019066+0000","last_fullsized":"2023-07-14T11:13:15.019066+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:11:14.713367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.016269+0000","last_change":"2023-07-14T11:13:15.013904+0000","last_active":"2023-07-14T11:13:15.016269+0000","last_peered":"2023-07-14T11:13:15.016269+0000","last_clean":"2023-07-14T11:13:15.016269+0000","last_became_active":"2023-07-14T11:13:15.013654+0000","last_became_peered":"2023-07-14T11:13:15.013654+0000","last_unstale":"2023-07-14T11:13:15.016269+0000","last_undegraded":"2023-07-14T11:13:15.016269+0000","last_fullsized":"2023-07-14T11:13:15.016269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:14:42.298292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.010319+0000","last_change":"2023-07-14T11:13:15.004331+0000","last_active":"2023-07-14T11:13:15.010319+0000","last_peered":"2023-07-14T11:13:15.010319+0000","last_clean":"2023-07-14T11:13:15.010319+0000","last_became_active":"2023-07-14T11:13:15.003862+0000","last_became_peered":"2023-07-14T11:13:15.003862+0000","last_unstale":"2023-07-14T11:13:15.010319+0000","last_undegraded":"2023-07-14T11:13:15.010319+0000","last_fullsized":"2023-07-14T11:13:15.010319+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:40:56.863985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.012092+0000","last_change":"2023-07-14T11:13:15.005637+0000","last_active":"2023-07-14T11:13:15.012092+0000","last_peered":"2023-07-14T11:13:15.012092+0000","last_clean":"2023-07-14T11:13:15.012092+0000","last_became_active":"2023-07-14T11:13:15.005359+0000","last_became_peered":"2023-07-14T11:13:15.005359+0000","last_unstale":"2023-07-14T11:13:15.012092+0000","last_undegraded":"2023-07-14T11:13:15.012092+0000","last_fullsized":"2023-07-14T11:13:15.012092+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:58:38.845550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27744,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":811008,"data_stored":666186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":75818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.155}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.107}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":229376,"data_stored":82946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.363}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3759999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2569999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4590000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":827392,"data_stored":673896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0029999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":75818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":75818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":249856,"data_stored":84566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0569999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":229376,"data_stored":82946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T11:13:19.841 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-14T11:13:19.841 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-07-14T11:13:19.841 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-07-14T11:13:19.842 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-07-14T11:13:19.842 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-07-14T11:13:19.957 INFO:tasks.ceph.mds.b.smithi179.stderr:2023-07-14T11:13:19.955+0000 7f53491f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-14T11:13:20.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.070+0000 7f1d101ff700 1 Processor -- start 2023-07-14T11:13:20.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.071+0000 7f1d101ff700 1 -- start start 2023-07-14T11:13:20.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.072+0000 7f1d101ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d080d1220 0x7f1d080b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:20.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.072+0000 7f1d101ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1d080b1e00 0x7f1d080afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:20.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.072+0000 7f1d101ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d080d2ce0 con 0x7f1d0815c950 2023-07-14T11:13:20.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.072+0000 7f1d101ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d080b3350 con 0x7f1d080b1e00 2023-07-14T11:13:20.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.072+0000 7f1d101ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d080b3630 con 0x7f1d080d1220 2023-07-14T11:13:20.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.072+0000 7f1d0e79c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1d080b1e00 0x7f1d080afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:20.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.072+0000 7f1d0e79c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1d080b1e00 0x7f1d080afac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33914/0 (socket says 172.21.15.84:33914) 2023-07-14T11:13:20.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.072+0000 7f1d0e79c700 1 -- 172.21.15.84:0/514843859 learned_addr learned my addr 172.21.15.84:0/514843859 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:20.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.072+0000 7f1d0e79c700 1 -- 172.21.15.84:0/514843859 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d080d1220 msgr2=0x7f1d080b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:20.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.072+0000 7f1d0e79c700 1 --2- 172.21.15.84:0/514843859 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d080d1220 0x7f1d080b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:20.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.072+0000 7f1d0e79c700 1 -- 172.21.15.84:0/514843859 >> v1:172.21.15.179:6789/0 conn(0x7f1d0815c950 legacy=0x7f1d080d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:20.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.072+0000 7f1d0e79c700 1 -- 172.21.15.84:0/514843859 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d080b3910 con 0x7f1d080b1e00 2023-07-14T11:13:20.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.073+0000 7f1d0e79c700 1 --2- 172.21.15.84:0/514843859 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d080b1e00 0x7f1d080afac0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1d00009e50 tx=0x7f1d0000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2892405c91746a7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:20.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.073+0000 7f1d0cf99700 1 -- 172.21.15.84:0/514843859 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d0000e070 con 0x7f1d080b1e00 2023-07-14T11:13:20.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.073+0000 7f1d0cf99700 1 -- 172.21.15.84:0/514843859 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d00003a20 con 0x7f1d080b1e00 2023-07-14T11:13:20.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.073+0000 7f1d0cf99700 1 -- 172.21.15.84:0/514843859 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d00003dd0 con 0x7f1d080b1e00 2023-07-14T11:13:20.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.073+0000 7f1d101ff700 1 -- 172.21.15.84:0/514843859 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d080b1e00 msgr2=0x7f1d080afac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:20.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.073+0000 7f1d101ff700 1 --2- 172.21.15.84:0/514843859 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d080b1e00 0x7f1d080afac0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1d00009e50 tx=0x7f1d0000b330 comp rx=0 tx=0).stop 2023-07-14T11:13:20.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.073+0000 7f1d101ff700 1 -- 172.21.15.84:0/514843859 shutdown_connections 2023-07-14T11:13:20.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.073+0000 7f1d101ff700 1 --2- 172.21.15.84:0/514843859 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d080b1e00 0x7f1d080afac0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:20.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.073+0000 7f1d101ff700 1 --2- 172.21.15.84:0/514843859 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d080d1220 0x7f1d080b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:20.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.073+0000 7f1d101ff700 1 -- 172.21.15.84:0/514843859 >> 172.21.15.84:0/514843859 conn(0x7f1d0809c1d0 msgr2=0x7f1d080d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:20.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.074+0000 7f1d101ff700 1 -- 172.21.15.84:0/514843859 shutdown_connections 2023-07-14T11:13:20.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.074+0000 7f1d101ff700 1 -- 172.21.15.84:0/514843859 wait complete. 2023-07-14T11:13:20.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.075+0000 7f1d101ff700 1 Processor -- start 2023-07-14T11:13:20.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.075+0000 7f1d101ff700 1 -- start start 2023-07-14T11:13:20.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.076+0000 7f1d101ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d080b1e00 0x7f1d08157a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:20.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.076+0000 7f1d101ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d080d1220 0x7f1d080cfd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:20.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.076+0000 7f1d101ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d0815c950 0x7f1d081f1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:20.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.076+0000 7f1d101ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d080d0420 con 0x7f1d0815c950 2023-07-14T11:13:20.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.076+0000 7f1d101ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d080b5d70 con 0x7f1d080b1e00 2023-07-14T11:13:20.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.076+0000 7f1d101ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d080cbaf0 con 0x7f1d080d1220 2023-07-14T11:13:20.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.076+0000 7f1d0e79c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d0815c950 0x7f1d081f1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:20.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.077+0000 7f1d0e79c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d0815c950 0x7f1d081f1b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33928/0 (socket says 172.21.15.84:33928) 2023-07-14T11:13:20.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.077+0000 7f1d0e79c700 1 -- 172.21.15.84:0/915251786 learned_addr learned my addr 172.21.15.84:0/915251786 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:20.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.077+0000 7f1d0df9b700 1 --2- 172.21.15.84:0/915251786 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d080b1e00 0x7f1d08157a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:20.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.077+0000 7f1d0d79a700 1 --2- 172.21.15.84:0/915251786 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d080d1220 0x7f1d080cfd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:20.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.077+0000 7f1d0e79c700 1 -- 172.21.15.84:0/915251786 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d080d1220 msgr2=0x7f1d080cfd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:20.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.077+0000 7f1d0e79c700 1 --2- 172.21.15.84:0/915251786 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d080d1220 0x7f1d080cfd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:20.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.077+0000 7f1d0e79c700 1 -- 172.21.15.84:0/915251786 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d080b1e00 msgr2=0x7f1d08157a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:20.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.077+0000 7f1d0e79c700 1 --2- 172.21.15.84:0/915251786 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d080b1e00 0x7f1d08157a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:20.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.077+0000 7f1d0e79c700 1 -- 172.21.15.84:0/915251786 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d00009b30 con 0x7f1d0815c950 2023-07-14T11:13:20.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.077+0000 7f1d0df9b700 1 --2- 172.21.15.84:0/915251786 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d080b1e00 0x7f1d08157a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:13:20.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.077+0000 7f1d0e79c700 1 --2- 172.21.15.84:0/915251786 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d0815c950 0x7f1d081f1b30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1d080673b0 tx=0x7f1d00004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:20.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.077+0000 7f1cfe7fc700 1 -- 172.21.15.84:0/915251786 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d00004240 con 0x7f1d0815c950 2023-07-14T11:13:20.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.077+0000 7f1cfe7fc700 1 -- 172.21.15.84:0/915251786 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d000043a0 con 0x7f1d0815c950 2023-07-14T11:13:20.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.077+0000 7f1cfe7fc700 1 -- 172.21.15.84:0/915251786 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d00004750 con 0x7f1d0815c950 2023-07-14T11:13:20.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.077+0000 7f1d101ff700 1 -- 172.21.15.84:0/915251786 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d080b5f60 con 0x7f1d0815c950 2023-07-14T11:13:20.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.078+0000 7f1d101ff700 1 -- 172.21.15.84:0/915251786 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d080cb1c0 con 0x7f1d0815c950 2023-07-14T11:13:20.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.079+0000 7f1d101ff700 1 -- 172.21.15.84:0/915251786 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d080cbc60 con 0x7f1d0815c950 2023-07-14T11:13:20.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.079+0000 7f1cfe7fc700 1 -- 172.21.15.84:0/915251786 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1d00019070 con 0x7f1d0815c950 2023-07-14T11:13:20.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.081+0000 7f1cfe7fc700 1 --2- 172.21.15.84:0/915251786 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1cec06ace0 0x7f1cec06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:20.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.081+0000 7f1cfe7fc700 1 -- 172.21.15.84:0/915251786 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1d0008a4d0 con 0x7f1d0815c950 2023-07-14T11:13:20.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.081+0000 7f1d0df9b700 1 --2- 172.21.15.84:0/915251786 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1cec06ace0 0x7f1cec06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:20.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.081+0000 7f1d0df9b700 1 --2- 172.21.15.84:0/915251786 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1cec06ace0 0x7f1cec06d190 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1d04006fd0 tx=0x7f1d04008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:20.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.085+0000 7f1cfe7fc700 1 -- 172.21.15.84:0/915251786 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f1d000554f0 con 0x7f1d0815c950 2023-07-14T11:13:20.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.335+0000 7f1d101ff700 1 -- 172.21.15.84:0/915251786 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f1d0804e280 con 0x7f1d0815c950 2023-07-14T11:13:20.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.339+0000 7f1cfe7fc700 1 -- 172.21.15.84:0/915251786 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+170839 (secure 0 0 0) 0x7f1d00058b10 con 0x7f1d0815c950 2023-07-14T11:13:20.342 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:13:20.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.342+0000 7f1d101ff700 1 -- 172.21.15.84:0/915251786 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1cec06ace0 msgr2=0x7f1cec06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:20.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.342+0000 7f1d101ff700 1 --2- 172.21.15.84:0/915251786 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1cec06ace0 0x7f1cec06d190 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1d04006fd0 tx=0x7f1d04008040 comp rx=0 tx=0).stop 2023-07-14T11:13:20.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.342+0000 7f1d101ff700 1 -- 172.21.15.84:0/915251786 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d0815c950 msgr2=0x7f1d081f1b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:20.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.342+0000 7f1d101ff700 1 --2- 172.21.15.84:0/915251786 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d0815c950 0x7f1d081f1b30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1d080673b0 tx=0x7f1d00004ad0 comp rx=0 tx=0).stop 2023-07-14T11:13:20.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.342+0000 7f1d101ff700 1 -- 172.21.15.84:0/915251786 shutdown_connections 2023-07-14T11:13:20.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.342+0000 7f1d101ff700 1 --2- 172.21.15.84:0/915251786 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d0815c950 0x7f1d081f1b30 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:20.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.342+0000 7f1d101ff700 1 --2- 172.21.15.84:0/915251786 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d080b1e00 0x7f1d08157a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:20.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.342+0000 7f1d101ff700 1 --2- 172.21.15.84:0/915251786 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1cec06ace0 0x7f1cec06d190 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:20.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.342+0000 7f1d101ff700 1 --2- 172.21.15.84:0/915251786 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d080d1220 0x7f1d080cfd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:20.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.342+0000 7f1d101ff700 1 -- 172.21.15.84:0/915251786 >> 172.21.15.84:0/915251786 conn(0x7f1d0809c1d0 msgr2=0x7f1d080b43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:20.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.342+0000 7f1d101ff700 1 -- 172.21.15.84:0/915251786 shutdown_connections 2023-07-14T11:13:20.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.342+0000 7f1d101ff700 1 -- 172.21.15.84:0/915251786 wait complete. 2023-07-14T11:13:20.362 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":5,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":379617029},{"type":"v1","addr":"172.21.15.84:6833","nonce":379617029}]},"active_addr":"172.21.15.84:6833/379617029","active_change":"2023-07-14T11:12:54.051634+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4100,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":1410429649}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":2017899455}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":3082191159}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":1609666652}]}]} 2023-07-14T11:13:20.366 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-07-14T11:13:20.366 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-07-14T11:13:20.367 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:13:20.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.560+0000 7f447f1ff700 1 Processor -- start 2023-07-14T11:13:20.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.561+0000 7f447f1ff700 1 -- start start 2023-07-14T11:13:20.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.562+0000 7f447f1ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f447815c950 0x7f44780b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:20.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.562+0000 7f447f1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44780b1e00 0x7f44780d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:20.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.562+0000 7f447f1ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44780d2ce0 con 0x7f44780b2350 2023-07-14T11:13:20.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.562+0000 7f447f1ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44780b3350 con 0x7f447815c950 2023-07-14T11:13:20.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.562+0000 7f447f1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44780b3630 con 0x7f44780b1e00 2023-07-14T11:13:20.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.562+0000 7f447cf9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f447815c950 0x7f44780b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:20.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.562+0000 7f447d79c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f44780b2350 0x7f44780afac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:37664/0 (socket says 172.21.15.84:37664) 2023-07-14T11:13:20.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.562+0000 7f447d79c700 1 -- 172.21.15.84:0/160183827 learned_addr learned my addr 172.21.15.84:0/160183827 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:13:20.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.562+0000 7f4477fff700 1 --2- 172.21.15.84:0/160183827 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44780b1e00 0x7f44780d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:20.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.562+0000 7f447cf9b700 1 -- 172.21.15.84:0/160183827 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44780b1e00 msgr2=0x7f44780d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:20.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.562+0000 7f447cf9b700 1 --2- 172.21.15.84:0/160183827 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44780b1e00 0x7f44780d0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:20.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.562+0000 7f447cf9b700 1 -- 172.21.15.84:0/160183827 >> v1:172.21.15.84:6789/0 conn(0x7f44780b2350 legacy=0x7f44780afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:20.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.563+0000 7f447cf9b700 1 -- 172.21.15.84:0/160183827 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44780b3910 con 0x7f447815c950 2023-07-14T11:13:20.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.563+0000 7f44777fe700 1 -- 172.21.15.84:0/160183827 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3872242566 0 0) 0x7f44780d2ce0 con 0x7f44780b2350 2023-07-14T11:13:20.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.563+0000 7f447cf9b700 1 --2- 172.21.15.84:0/160183827 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f447815c950 0x7f44780b43f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f446c009830 tx=0x7f446c009b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed9f08ad116fa11 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:20.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.563+0000 7f44777fe700 1 -- 172.21.15.84:0/160183827 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f446c011830 con 0x7f447815c950 2023-07-14T11:13:20.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.563+0000 7f44777fe700 1 -- 172.21.15.84:0/160183827 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f446c011990 con 0x7f447815c950 2023-07-14T11:13:20.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.563+0000 7f44777fe700 1 -- 172.21.15.84:0/160183827 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f446c011d40 con 0x7f447815c950 2023-07-14T11:13:20.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.563+0000 7f447f1ff700 1 -- 172.21.15.84:0/160183827 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f447815c950 msgr2=0x7f44780b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:20.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.563+0000 7f447f1ff700 1 --2- 172.21.15.84:0/160183827 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f447815c950 0x7f44780b43f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f446c009830 tx=0x7f446c009b40 comp rx=0 tx=0).stop 2023-07-14T11:13:20.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.564+0000 7f447f1ff700 1 -- 172.21.15.84:0/160183827 shutdown_connections 2023-07-14T11:13:20.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.564+0000 7f447f1ff700 1 --2- 172.21.15.84:0/160183827 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f447815c950 0x7f44780b43f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:20.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.564+0000 7f447f1ff700 1 --2- 172.21.15.84:0/160183827 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44780b1e00 0x7f44780d0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:20.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.564+0000 7f447f1ff700 1 -- 172.21.15.84:0/160183827 >> 172.21.15.84:0/160183827 conn(0x7f447809c1d0 msgr2=0x7f44780d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:20.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.564+0000 7f447f1ff700 1 -- 172.21.15.84:0/160183827 shutdown_connections 2023-07-14T11:13:20.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.564+0000 7f447f1ff700 1 -- 172.21.15.84:0/160183827 wait complete. 2023-07-14T11:13:20.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.565+0000 7f447f1ff700 1 Processor -- start 2023-07-14T11:13:20.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.566+0000 7f447f1ff700 1 -- start start 2023-07-14T11:13:20.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.566+0000 7f447f1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44780b1e00 0x7f44780ce180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:20.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.566+0000 7f447f1ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44780b2350 0x7f447814a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:20.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.566+0000 7f447f1ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f447815c950 0x7f44780cec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:20.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.567+0000 7f447f1ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44780cfa50 con 0x7f447815c950 2023-07-14T11:13:20.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.567+0000 7f447f1ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4478157b50 con 0x7f44780b2350 2023-07-14T11:13:20.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.567+0000 7f447f1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44780ce6c0 con 0x7f44780b1e00 2023-07-14T11:13:20.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.567+0000 7f447d79c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f447815c950 0x7f44780cec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:20.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.567+0000 7f447d79c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f447815c950 0x7f44780cec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33946/0 (socket says 172.21.15.84:33946) 2023-07-14T11:13:20.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.567+0000 7f447d79c700 1 -- 172.21.15.84:0/1930823861 learned_addr learned my addr 172.21.15.84:0/1930823861 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:20.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.567+0000 7f4477fff700 1 --2- 172.21.15.84:0/1930823861 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44780b2350 0x7f447814a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:20.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.567+0000 7f447cf9b700 1 --2- 172.21.15.84:0/1930823861 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44780b1e00 0x7f44780ce180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:20.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.567+0000 7f447d79c700 1 -- 172.21.15.84:0/1930823861 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44780b1e00 msgr2=0x7f44780ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:20.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.567+0000 7f447d79c700 1 --2- 172.21.15.84:0/1930823861 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44780b1e00 0x7f44780ce180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:20.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.567+0000 7f447d79c700 1 -- 172.21.15.84:0/1930823861 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44780b2350 msgr2=0x7f447814a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:20.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.567+0000 7f447d79c700 1 --2- 172.21.15.84:0/1930823861 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44780b2350 0x7f447814a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:20.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.567+0000 7f447d79c700 1 -- 172.21.15.84:0/1930823861 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f446c009440 con 0x7f447815c950 2023-07-14T11:13:20.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.567+0000 7f447d79c700 1 --2- 172.21.15.84:0/1930823861 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f447815c950 0x7f44780cec00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4470002230 tx=0x7f447000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:20.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.567+0000 7f44757fa700 1 -- 172.21.15.84:0/1930823861 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447000ac20 con 0x7f447815c950 2023-07-14T11:13:20.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.567+0000 7f44757fa700 1 -- 172.21.15.84:0/1930823861 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f447000ada0 con 0x7f447815c950 2023-07-14T11:13:20.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.568+0000 7f44757fa700 1 -- 172.21.15.84:0/1930823861 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4470007310 con 0x7f447815c950 2023-07-14T11:13:20.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.568+0000 7f447f1ff700 1 -- 172.21.15.84:0/1930823861 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44780cf770 con 0x7f447815c950 2023-07-14T11:13:20.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.568+0000 7f447f1ff700 1 -- 172.21.15.84:0/1930823861 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44780cd980 con 0x7f447815c950 2023-07-14T11:13:20.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.569+0000 7f447f1ff700 1 -- 172.21.15.84:0/1930823861 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f447804e280 con 0x7f447815c950 2023-07-14T11:13:20.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.570+0000 7f44757fa700 1 -- 172.21.15.84:0/1930823861 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4470007470 con 0x7f447815c950 2023-07-14T11:13:20.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.571+0000 7f44757fa700 1 --2- 172.21.15.84:0/1930823861 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f445c06ace0 0x7f445c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:20.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.571+0000 7f44757fa700 1 -- 172.21.15.84:0/1930823861 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4470088f50 con 0x7f447815c950 2023-07-14T11:13:20.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.571+0000 7f447cf9b700 1 --2- 172.21.15.84:0/1930823861 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f445c06ace0 0x7f445c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:20.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.572+0000 7f447cf9b700 1 --2- 172.21.15.84:0/1930823861 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f445c06ace0 0x7f445c06d190 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f446c000c00 tx=0x7f446c01c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:20.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.575+0000 7f44757fa700 1 -- 172.21.15.84:0/1930823861 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f4470054090 con 0x7f447815c950 2023-07-14T11:13:20.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.771+0000 7f447f1ff700 1 -- 172.21.15.84:0/1930823861 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f447808c5a0 con 0x7f447815c950 2023-07-14T11:13:20.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.772+0000 7f44757fa700 1 -- 172.21.15.84:0/1930823861 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18255 (secure 0 0 0) 0x7f4470018090 con 0x7f447815c950 2023-07-14T11:13:20.776 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:13:20.776 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":23,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:13:15.989292+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-14T11:13:12.727811+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-14T11:13:13.436391+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:13:20.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.775+0000 7f447f1ff700 1 -- 172.21.15.84:0/1930823861 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f445c06ace0 msgr2=0x7f445c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:20.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.775+0000 7f447f1ff700 1 --2- 172.21.15.84:0/1930823861 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f445c06ace0 0x7f445c06d190 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f446c000c00 tx=0x7f446c01c040 comp rx=0 tx=0).stop 2023-07-14T11:13:20.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.775+0000 7f447f1ff700 1 -- 172.21.15.84:0/1930823861 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f447815c950 msgr2=0x7f44780cec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:20.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.775+0000 7f447f1ff700 1 --2- 172.21.15.84:0/1930823861 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f447815c950 0x7f44780cec00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4470002230 tx=0x7f447000a060 comp rx=0 tx=0).stop 2023-07-14T11:13:20.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.775+0000 7f447f1ff700 1 -- 172.21.15.84:0/1930823861 shutdown_connections 2023-07-14T11:13:20.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.775+0000 7f447f1ff700 1 --2- 172.21.15.84:0/1930823861 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f445c06ace0 0x7f445c06d190 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:20.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.775+0000 7f447f1ff700 1 --2- 172.21.15.84:0/1930823861 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44780b1e00 0x7f44780ce180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:20.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.775+0000 7f447f1ff700 1 --2- 172.21.15.84:0/1930823861 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f447815c950 0x7f44780cec00 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:20.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.775+0000 7f447f1ff700 1 --2- 172.21.15.84:0/1930823861 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44780b2350 0x7f447814a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:20.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.775+0000 7f447f1ff700 1 -- 172.21.15.84:0/1930823861 >> 172.21.15.84:0/1930823861 conn(0x7f447809c1d0 msgr2=0x7f44780d3170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:20.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.775+0000 7f447f1ff700 1 -- 172.21.15.84:0/1930823861 shutdown_connections 2023-07-14T11:13:20.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.775+0000 7f447f1ff700 1 -- 172.21.15.84:0/1930823861 wait complete. 2023-07-14T11:13:20.795 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-07-14T11:13:20.795 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:13:20.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.988+0000 7f2686fff700 1 Processor -- start 2023-07-14T11:13:20.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.989+0000 7f2686fff700 1 -- start start 2023-07-14T11:13:20.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.990+0000 7f2686fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f26800d1220 0x7f26800b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:20.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.990+0000 7f2686fff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26800d2ce0 con 0x7f26800b1e00 2023-07-14T11:13:20.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.990+0000 7f2686fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26800b3350 con 0x7f268015c950 2023-07-14T11:13:20.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.990+0000 7f2686fff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26800b3630 con 0x7f26800d1220 2023-07-14T11:13:20.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.990+0000 7f267ffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f26800d1220 0x7f26800b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:20.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.990+0000 7f268559c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f26800b1e00 0x7f26800afac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:37666/0 (socket says 172.21.15.84:37666) 2023-07-14T11:13:20.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.990+0000 7f268559c700 1 -- 172.21.15.84:0/2557382746 learned_addr learned my addr 172.21.15.84:0/2557382746 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:13:20.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.990+0000 7f267ffff700 1 -- 172.21.15.84:0/2557382746 >> v1:172.21.15.179:6789/0 conn(0x7f268015c950 legacy=0x7f26800d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:20.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.990+0000 7f267ffff700 1 -- 172.21.15.84:0/2557382746 >> v1:172.21.15.84:6789/0 conn(0x7f26800b1e00 legacy=0x7f26800afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:20.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.990+0000 7f267ffff700 1 -- 172.21.15.84:0/2557382746 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26800b3910 con 0x7f26800d1220 2023-07-14T11:13:20.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.991+0000 7f267ffff700 1 --2- 172.21.15.84:0/2557382746 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26800d1220 0x7f26800b43f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f266c009840 tx=0x7f266c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d5324e505ec461d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:20.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.991+0000 7f267f7fe700 1 -- 172.21.15.84:0/2557382746 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266c011830 con 0x7f26800d1220 2023-07-14T11:13:20.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.991+0000 7f267f7fe700 1 -- 172.21.15.84:0/2557382746 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f266c011990 con 0x7f26800d1220 2023-07-14T11:13:20.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.991+0000 7f267f7fe700 1 -- 172.21.15.84:0/2557382746 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266c011d20 con 0x7f26800d1220 2023-07-14T11:13:20.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.991+0000 7f2686fff700 1 -- 172.21.15.84:0/2557382746 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26800d1220 msgr2=0x7f26800b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:20.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.991+0000 7f2686fff700 1 --2- 172.21.15.84:0/2557382746 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26800d1220 0x7f26800b43f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f266c009840 tx=0x7f266c009b50 comp rx=0 tx=0).stop 2023-07-14T11:13:20.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.992+0000 7f2686fff700 1 -- 172.21.15.84:0/2557382746 shutdown_connections 2023-07-14T11:13:20.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.992+0000 7f2686fff700 1 --2- 172.21.15.84:0/2557382746 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26800d1220 0x7f26800b43f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:20.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.992+0000 7f2686fff700 1 -- 172.21.15.84:0/2557382746 >> 172.21.15.84:0/2557382746 conn(0x7f268009c1d0 msgr2=0x7f26800d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:20.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.992+0000 7f2686fff700 1 -- 172.21.15.84:0/2557382746 shutdown_connections 2023-07-14T11:13:20.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.992+0000 7f2686fff700 1 -- 172.21.15.84:0/2557382746 wait complete. 2023-07-14T11:13:20.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.993+0000 7f2686fff700 1 Processor -- start 2023-07-14T11:13:20.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.993+0000 7f2686fff700 1 -- start start 2023-07-14T11:13:20.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.994+0000 7f2686fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26800b1e00 0x7f26800ca3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:20.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.994+0000 7f2686fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26800d1220 0x7f26800b7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:20.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.994+0000 7f2686fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f268015c950 0x7f26801513c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:20.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.994+0000 7f2686fff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26800c7820 con 0x7f26800b1e00 2023-07-14T11:13:20.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.994+0000 7f2686fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26800c6c10 con 0x7f26800d1220 2023-07-14T11:13:20.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.994+0000 7f2686fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26800c6ef0 con 0x7f268015c950 2023-07-14T11:13:20.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.995+0000 7f2684d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26800b1e00 0x7f26800ca3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:20.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.995+0000 7f2684d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26800b1e00 0x7f26800ca3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33956/0 (socket says 172.21.15.84:33956) 2023-07-14T11:13:20.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.995+0000 7f2684d9b700 1 -- 172.21.15.84:0/3650904649 learned_addr learned my addr 172.21.15.84:0/3650904649 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:20.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.995+0000 7f268559c700 1 --2- 172.21.15.84:0/3650904649 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f268015c950 0x7f26801513c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:20.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.995+0000 7f267ffff700 1 --2- 172.21.15.84:0/3650904649 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26800d1220 0x7f26800b7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:20.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.995+0000 7f2684d9b700 1 -- 172.21.15.84:0/3650904649 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f268015c950 msgr2=0x7f26801513c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:20.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.995+0000 7f2684d9b700 1 --2- 172.21.15.84:0/3650904649 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f268015c950 0x7f26801513c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:20.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.995+0000 7f2684d9b700 1 -- 172.21.15.84:0/3650904649 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26800d1220 msgr2=0x7f26800b7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:21.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.995+0000 7f2684d9b700 1 --2- 172.21.15.84:0/3650904649 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26800d1220 0x7f26800b7a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:21.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.995+0000 7f2684d9b700 1 -- 172.21.15.84:0/3650904649 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f266c0094a0 con 0x7f26800b1e00 2023-07-14T11:13:21.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.995+0000 7f2684d9b700 1 --2- 172.21.15.84:0/3650904649 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26800b1e00 0x7f26800ca3f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f267400c4d0 tx=0x7f267400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:21.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.996+0000 7f267d7fa700 1 -- 172.21.15.84:0/3650904649 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26740052d0 con 0x7f26800b1e00 2023-07-14T11:13:21.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.996+0000 7f267d7fa700 1 -- 172.21.15.84:0/3650904649 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2674005430 con 0x7f26800b1e00 2023-07-14T11:13:21.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.996+0000 7f267d7fa700 1 -- 172.21.15.84:0/3650904649 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26740038f0 con 0x7f26800b1e00 2023-07-14T11:13:21.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.996+0000 7f2686fff700 1 -- 172.21.15.84:0/3650904649 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26800c71d0 con 0x7f26800b1e00 2023-07-14T11:13:21.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.996+0000 7f2686fff700 1 -- 172.21.15.84:0/3650904649 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2680151900 con 0x7f26800b1e00 2023-07-14T11:13:21.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.997+0000 7f2686fff700 1 -- 172.21.15.84:0/3650904649 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f268004e280 con 0x7f26800b1e00 2023-07-14T11:13:21.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.998+0000 7f267d7fa700 1 -- 172.21.15.84:0/3650904649 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2674003a50 con 0x7f26800b1e00 2023-07-14T11:13:21.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.999+0000 7f267d7fa700 1 --2- 172.21.15.84:0/3650904649 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f266406ace0 0x7f266406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:21.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.999+0000 7f267d7fa700 1 -- 172.21.15.84:0/3650904649 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2674088930 con 0x7f26800b1e00 2023-07-14T11:13:21.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:20.999+0000 7f267ffff700 1 --2- 172.21.15.84:0/3650904649 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f266406ace0 0x7f266406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:21.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.000+0000 7f267ffff700 1 --2- 172.21.15.84:0/3650904649 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f266406ace0 0x7f266406d190 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f26800d1610 tx=0x7f266c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:21.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.003+0000 7f267d7fa700 1 -- 172.21.15.84:0/3650904649 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f26740539e0 con 0x7f26800b1e00 2023-07-14T11:13:21.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.202+0000 7f2686fff700 1 -- 172.21.15.84:0/3650904649 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f268008c5a0 con 0x7f26800b1e00 2023-07-14T11:13:21.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.204+0000 7f267d7fa700 1 -- 172.21.15.84:0/3650904649 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18255 (secure 0 0 0) 0x7f2674057000 con 0x7f26800b1e00 2023-07-14T11:13:21.206 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:13:21.206 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":23,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:13:15.989292+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-14T11:13:12.727811+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-14T11:13:13.436391+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:13:21.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.206+0000 7f2686fff700 1 -- 172.21.15.84:0/3650904649 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f266406ace0 msgr2=0x7f266406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:21.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.206+0000 7f2686fff700 1 --2- 172.21.15.84:0/3650904649 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f266406ace0 0x7f266406d190 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f26800d1610 tx=0x7f266c008030 comp rx=0 tx=0).stop 2023-07-14T11:13:21.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.206+0000 7f2686fff700 1 -- 172.21.15.84:0/3650904649 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26800b1e00 msgr2=0x7f26800ca3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:21.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.206+0000 7f2686fff700 1 --2- 172.21.15.84:0/3650904649 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26800b1e00 0x7f26800ca3f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f267400c4d0 tx=0x7f267400c890 comp rx=0 tx=0).stop 2023-07-14T11:13:21.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.206+0000 7f2686fff700 1 -- 172.21.15.84:0/3650904649 shutdown_connections 2023-07-14T11:13:21.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.206+0000 7f2686fff700 1 --2- 172.21.15.84:0/3650904649 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f266406ace0 0x7f266406d190 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:21.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.206+0000 7f2686fff700 1 --2- 172.21.15.84:0/3650904649 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f268015c950 0x7f26801513c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:21.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.206+0000 7f2686fff700 1 --2- 172.21.15.84:0/3650904649 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26800b1e00 0x7f26800ca3f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:21.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.206+0000 7f2686fff700 1 --2- 172.21.15.84:0/3650904649 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26800d1220 0x7f26800b7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:21.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.206+0000 7f2686fff700 1 -- 172.21.15.84:0/3650904649 >> 172.21.15.84:0/3650904649 conn(0x7f268009c1d0 msgr2=0x7f26801578d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:21.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.206+0000 7f2686fff700 1 -- 172.21.15.84:0/3650904649 shutdown_connections 2023-07-14T11:13:21.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.206+0000 7f2686fff700 1 -- 172.21.15.84:0/3650904649 wait complete. 2023-07-14T11:13:21.226 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-07-14T11:13:21.227 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-07-14T11:13:21.227 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-07-14T11:13:21.228 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-07-14T11:13:21.228 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-07-14T11:13:21.229 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-07-14T11:13:21.229 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-07-14T11:13:21.229 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-07-14T11:13:21.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.583+0000 7f3a6d5ff700 1 Processor -- start 2023-07-14T11:13:21.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.583+0000 7f3a6d5ff700 1 -- start start 2023-07-14T11:13:21.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.585+0000 7f3a6d5ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3a680ce3b0 0x7f3a680cb700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:21.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.585+0000 7f3a6d5ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a680cab60 con 0x7f3a680cdf40 2023-07-14T11:13:21.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.585+0000 7f3a6d5ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a6806bcc0 con 0x7f3a681587d0 2023-07-14T11:13:21.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.585+0000 7f3a6d5ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a68158ba0 con 0x7f3a680ce3b0 2023-07-14T11:13:21.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.587+0000 7f3a667fc700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f3a680cdf40 0x7f3a680caff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:37670/0 (socket says 172.21.15.84:37670) 2023-07-14T11:13:21.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.587+0000 7f3a667fc700 1 -- 172.21.15.84:0/4202493415 learned_addr learned my addr 172.21.15.84:0/4202493415 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:13:21.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.587+0000 7f3a677fe700 1 --2- 172.21.15.84:0/4202493415 >> v2:172.21.15.179:3300/0 conn(0x7f3a680ce3b0 0x7f3a680cb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:21.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.588+0000 7f03377ff700 1 Processor -- start 2023-07-14T11:13:21.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.588+0000 7f3a65ffb700 1 -- 172.21.15.84:0/4202493415 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4281978622 0 0) 0x7f3a6806bcc0 con 0x7f3a681587d0 2023-07-14T11:13:21.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.588+0000 7f3a65ffb700 1 -- 172.21.15.84:0/4202493415 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a500057c0 con 0x7f3a681587d0 2023-07-14T11:13:21.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.588+0000 7f3a677fe700 1 -- 172.21.15.84:0/4202493415 >> v1:172.21.15.179:6789/0 conn(0x7f3a681587d0 legacy=0x7f3a6806b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:21.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.588+0000 7f3a677fe700 1 -- 172.21.15.84:0/4202493415 >> v1:172.21.15.84:6789/0 conn(0x7f3a680cdf40 legacy=0x7f3a680caff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:21.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.588+0000 7f3a677fe700 1 -- 172.21.15.84:0/4202493415 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a680ce850 con 0x7f3a680ce3b0 2023-07-14T11:13:21.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.588+0000 7f03377ff700 1 -- start start 2023-07-14T11:13:21.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.589+0000 7f3a677fe700 1 --2- 172.21.15.84:0/4202493415 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a680ce3b0 0x7f3a680cb700 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c009840 tx=0x7f3a5c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ba0f324f8f2e7bf server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:21.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.589+0000 7f0a217ff700 1 Processor -- start 2023-07-14T11:13:21.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.589+0000 7f0a217ff700 1 -- start start 2023-07-14T11:13:21.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.589+0000 7f3a65ffb700 1 -- 172.21.15.84:0/4202493415 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c010830 con 0x7f3a680ce3b0 2023-07-14T11:13:21.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.590+0000 7f3a65ffb700 1 -- 172.21.15.84:0/4202493415 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a5c010990 con 0x7f3a680ce3b0 2023-07-14T11:13:21.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.590+0000 7f3a65ffb700 1 -- 172.21.15.84:0/4202493415 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c010d20 con 0x7f3a680ce3b0 2023-07-14T11:13:21.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.590+0000 7f3a6d5ff700 1 -- 172.21.15.84:0/4202493415 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a680ce3b0 msgr2=0x7f3a680cb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:21.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.590+0000 7f3a6d5ff700 1 --2- 172.21.15.84:0/4202493415 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a680ce3b0 0x7f3a680cb700 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c009840 tx=0x7f3a5c009b50 comp rx=0 tx=0).stop 2023-07-14T11:13:21.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.591+0000 7f3a6d5ff700 1 -- 172.21.15.84:0/4202493415 shutdown_connections 2023-07-14T11:13:21.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.591+0000 7f3a6d5ff700 1 --2- 172.21.15.84:0/4202493415 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a680ce3b0 0x7f3a680cb700 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:21.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.591+0000 7f3a6d5ff700 1 -- 172.21.15.84:0/4202493415 >> 172.21.15.84:0/4202493415 conn(0x7f3a680b05d0 msgr2=0x7f3a680b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:21.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.591+0000 7f0a217ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0a1c0cab10 0x7f0a1c15b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:21.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.591+0000 7f0a217ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a1c0cb360 0x7f0a1c0cb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:21.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.591+0000 7f0a217ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0a1c157700 0x7f0a1c157b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:21.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.591+0000 7f0a217ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a1c15b980 con 0x7f0a1c0cab10 2023-07-14T11:13:21.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.591+0000 7f0a217ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a1c06b8e0 con 0x7f0a1c157700 2023-07-14T11:13:21.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.591+0000 7f0a217ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1c06bbc0 con 0x7f0a1c0cb360 2023-07-14T11:13:21.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.593+0000 7f0a1affd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0a1c0cab10 0x7f0a1c15b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:21.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.593+0000 7f0a1affd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0a1c0cab10 0x7f0a1c15b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33970/0 (socket says 172.21.15.84:33970) 2023-07-14T11:13:21.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.593+0000 7f0a1affd700 1 -- 172.21.15.84:0/2049713539 learned_addr learned my addr 172.21.15.84:0/2049713539 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:21.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.593+0000 7f0a127fc700 1 --2- 172.21.15.84:0/2049713539 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a1c0cb360 0x7f0a1c0cb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:21.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.593+0000 7f0a1b7fe700 1 --2- 172.21.15.84:0/2049713539 >> v2:172.21.15.179:3300/0 conn(0x7f0a1c157700 0x7f0a1c157b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:21.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.594+0000 7f0a1affd700 1 -- 172.21.15.84:0/2049713539 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a1c0cb360 msgr2=0x7f0a1c0cb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:21.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.594+0000 7f0a1affd700 1 --2- 172.21.15.84:0/2049713539 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a1c0cb360 0x7f0a1c0cb7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:21.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.594+0000 7f0a1affd700 1 -- 172.21.15.84:0/2049713539 >> v2:172.21.15.179:3300/0 conn(0x7f0a1c157700 msgr2=0x7f0a1c157b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:21.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.594+0000 7f0a1affd700 1 --2- 172.21.15.84:0/2049713539 >> v2:172.21.15.179:3300/0 conn(0x7f0a1c157700 0x7f0a1c157b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:21.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.594+0000 7f0a1affd700 1 -- 172.21.15.84:0/2049713539 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a1c06bea0 con 0x7f0a1c0cab10 2023-07-14T11:13:21.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.595+0000 7f0a1affd700 1 --2- 172.21.15.84:0/2049713539 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a1c0cab10 0x7f0a1c15b440 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c067390 tx=0x7f0a0c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=798be0d0367b72b1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:21.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.591+0000 7f3a6d5ff700 1 -- 172.21.15.84:0/4202493415 shutdown_connections 2023-07-14T11:13:21.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.591+0000 7f3a6d5ff700 1 -- 172.21.15.84:0/4202493415 wait complete. 2023-07-14T11:13:21.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.594+0000 7f3a6d5ff700 1 Processor -- start 2023-07-14T11:13:21.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.590+0000 7f03377ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f03300b10b0 0x7f0330158560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:21.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.590+0000 7f03377ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03300ce650 0x7f03300caff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:21.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.590+0000 7f03377ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03300cab60 con 0x7f033006b5b0 2023-07-14T11:13:21.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.590+0000 7f03377ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f033006c250 con 0x7f03300b10b0 2023-07-14T11:13:21.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.590+0000 7f03377ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f033006c530 con 0x7f03300ce650 2023-07-14T11:13:21.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.591+0000 7f0334d9a700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f033006b5b0 0x7f03300cdf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:37674/0 (socket says 172.21.15.84:37674) 2023-07-14T11:13:21.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.591+0000 7f0334d9a700 1 -- 172.21.15.84:0/3997200858 learned_addr learned my addr 172.21.15.84:0/3997200858 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:13:21.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.592+0000 7f0335d9c700 1 --2- 172.21.15.84:0/3997200858 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03300ce650 0x7f03300caff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:21.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.593+0000 7f033559b700 1 --2- 172.21.15.84:0/3997200858 >> v2:172.21.15.179:3300/0 conn(0x7f03300b10b0 0x7f0330158560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:21.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.593+0000 7f0335d9c700 1 -- 172.21.15.84:0/3997200858 >> v2:172.21.15.179:3300/0 conn(0x7f03300b10b0 msgr2=0x7f0330158560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:21.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.593+0000 7f0335d9c700 1 --2- 172.21.15.84:0/3997200858 >> v2:172.21.15.179:3300/0 conn(0x7f03300b10b0 0x7f0330158560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:21.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.593+0000 7f0335d9c700 1 -- 172.21.15.84:0/3997200858 >> v1:172.21.15.84:6789/0 conn(0x7f033006b5b0 legacy=0x7f03300cdf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:21.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.593+0000 7f0335d9c700 1 -- 172.21.15.84:0/3997200858 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03300ca7f0 con 0x7f03300ce650 2023-07-14T11:13:21.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.594+0000 7f0335d9c700 1 --2- 172.21.15.84:0/3997200858 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03300ce650 0x7f03300caff0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0320009840 tx=0x7f0320009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47d2cdfba2588d78 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:21.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.595+0000 7f032ffff700 1 -- 172.21.15.84:0/3997200858 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0320011830 con 0x7f03300ce650 2023-07-14T11:13:21.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.595+0000 7f032ffff700 1 -- 172.21.15.84:0/3997200858 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0320011990 con 0x7f03300ce650 2023-07-14T11:13:21.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.595+0000 7f032ffff700 1 -- 172.21.15.84:0/3997200858 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0320011d20 con 0x7f03300ce650 2023-07-14T11:13:21.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.596+0000 7f03377ff700 1 -- 172.21.15.84:0/3997200858 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03300ce650 msgr2=0x7f03300caff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:21.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.596+0000 7f03377ff700 1 --2- 172.21.15.84:0/3997200858 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03300ce650 0x7f03300caff0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0320009840 tx=0x7f0320009b50 comp rx=0 tx=0).stop 2023-07-14T11:13:21.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.596+0000 7f03377ff700 1 -- 172.21.15.84:0/3997200858 shutdown_connections 2023-07-14T11:13:21.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.596+0000 7f03377ff700 1 --2- 172.21.15.84:0/3997200858 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03300ce650 0x7f03300caff0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:21.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.596+0000 7f03377ff700 1 --2- 172.21.15.84:0/3997200858 >> v2:172.21.15.179:3300/0 conn(0x7f03300b10b0 0x7f0330158560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:21.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.596+0000 7f03377ff700 1 -- 172.21.15.84:0/3997200858 >> 172.21.15.84:0/3997200858 conn(0x7f03300b05d0 msgr2=0x7f03300b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:21.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.596+0000 7f03377ff700 1 -- 172.21.15.84:0/3997200858 shutdown_connections 2023-07-14T11:13:21.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.597+0000 7f0a1a7fc700 1 -- 172.21.15.84:0/2049713539 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0c010a90 con 0x7f0a1c0cab10 2023-07-14T11:13:21.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.597+0000 7f0a1a7fc700 1 -- 172.21.15.84:0/2049713539 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a0c010bf0 con 0x7f0a1c0cab10 2023-07-14T11:13:21.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.597+0000 7f0a1a7fc700 1 -- 172.21.15.84:0/2049713539 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0c018440 con 0x7f0a1c0cab10 2023-07-14T11:13:21.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.598+0000 7f0a217ff700 1 -- 172.21.15.84:0/2049713539 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a1c0cab10 msgr2=0x7f0a1c15b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:21.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.598+0000 7f0a217ff700 1 --2- 172.21.15.84:0/2049713539 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a1c0cab10 0x7f0a1c15b440 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c067390 tx=0x7f0a0c009bd0 comp rx=0 tx=0).stop 2023-07-14T11:13:21.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.594+0000 7f3a6d5ff700 1 -- start start 2023-07-14T11:13:21.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.596+0000 7f3a6d5ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a680cdf40 0x7f3a680c8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:21.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.596+0000 7f3a6d5ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a680ce3b0 0x7f3a6815b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:21.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.596+0000 7f3a6d5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a681587d0 0x7f3a680c6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:21.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.596+0000 7f3a6d5ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a68159a20 con 0x7f3a680cdf40 2023-07-14T11:13:21.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.596+0000 7f3a6d5ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a68157bc0 con 0x7f3a680ce3b0 2023-07-14T11:13:21.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.596+0000 7f3a6d5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a68158e10 con 0x7f3a681587d0 2023-07-14T11:13:21.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.597+0000 7f3a667fc700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a680ce3b0 0x7f3a6815b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:21.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.597+0000 7f3a667fc700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a680ce3b0 0x7f3a6815b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.84:51712/0 (socket says 172.21.15.84:51712) 2023-07-14T11:13:21.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.597+0000 7f3a667fc700 1 -- 172.21.15.84:0/3380876352 learned_addr learned my addr 172.21.15.84:0/3380876352 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:21.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.598+0000 7f3a677fe700 1 --2- 172.21.15.84:0/3380876352 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a681587d0 0x7f3a680c6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:21.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.596+0000 7f03377ff700 1 -- 172.21.15.84:0/3997200858 wait complete. 2023-07-14T11:13:21.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.598+0000 7f3a66ffd700 1 --2- 172.21.15.84:0/3380876352 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a680cdf40 0x7f3a680c8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:21.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.598+0000 7f0efa3ff700 1 Processor -- start 2023-07-14T11:13:21.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.597+0000 7f1703dff700 1 Processor -- start 2023-07-14T11:13:21.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.598+0000 7f1703dff700 1 -- start start 2023-07-14T11:13:21.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.599+0000 7f3a66ffd700 1 -- 172.21.15.84:0/3380876352 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a681587d0 msgr2=0x7f3a680c6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:21.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.599+0000 7f3a66ffd700 1 --2- 172.21.15.84:0/3380876352 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a681587d0 0x7f3a680c6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:21.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.599+0000 7f3a66ffd700 1 -- 172.21.15.84:0/3380876352 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a680ce3b0 msgr2=0x7f3a6815b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:21.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.599+0000 7f3a66ffd700 1 --2- 172.21.15.84:0/3380876352 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a680ce3b0 0x7f3a6815b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:21.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.599+0000 7f3a66ffd700 1 -- 172.21.15.84:0/3380876352 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a5c0094a0 con 0x7f3a680cdf40 2023-07-14T11:13:21.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.600+0000 7f3a66ffd700 1 --2- 172.21.15.84:0/3380876352 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a680cdf40 0x7f3a680c8840 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3a5800c450 tx=0x7f3a5800c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:21.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.599+0000 7f0efa3ff700 1 -- start start 2023-07-14T11:13:21.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.600+0000 7f1703dff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f16fc06b5b0 0x7f16fc06b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:21.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.600+0000 7f1703dff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16fc08a840 con 0x7f16fc0cce50 2023-07-14T11:13:21.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.600+0000 7f1703dff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16fc0ce580 con 0x7f16fc0ce030 2023-07-14T11:13:21.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.600+0000 7f1703dff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16fc0cd380 con 0x7f16fc06b5b0 2023-07-14T11:13:21.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.600+0000 7f170139a700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f16fc0cce50 0x7f16fc06bec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:37676/0 (socket says 172.21.15.84:37676) 2023-07-14T11:13:21.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.600+0000 7f170139a700 1 -- 172.21.15.84:0/4193341837 learned_addr learned my addr 172.21.15.84:0/4193341837 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:13:21.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.600+0000 7f1701b9b700 1 --2- 172.21.15.84:0/4193341837 >> v2:172.21.15.84:3300/0 conn(0x7f16fc06b5b0 0x7f16fc06b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:21.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.601+0000 7f3a4f7fe700 1 -- 172.21.15.84:0/3380876352 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a580052d0 con 0x7f3a680cdf40 2023-07-14T11:13:21.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.601+0000 7f3a4f7fe700 1 -- 172.21.15.84:0/3380876352 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a58005430 con 0x7f3a680cdf40 2023-07-14T11:13:21.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.601+0000 7f3a4f7fe700 1 -- 172.21.15.84:0/3380876352 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a580038c0 con 0x7f3a680cdf40 2023-07-14T11:13:21.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.601+0000 7f0efa3ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0ef40b10b0 0x7f0ef4158560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:21.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.601+0000 7f0efa3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ef406b5b0 0x7f0ef40cdf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:21.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.601+0000 7f0efa3ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ef40cc000 con 0x7f0ef406ba20 2023-07-14T11:13:21.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.601+0000 7f1700b99700 1 -- 172.21.15.84:0/4193341837 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1172376659 0 0) 0x7f16fc0ce580 con 0x7f16fc0ce030 2023-07-14T11:13:21.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.601+0000 7f1700b99700 1 -- 172.21.15.84:0/4193341837 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16e80035b0 con 0x7f16fc0ce030 2023-07-14T11:13:21.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.601+0000 7f0efa3ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ef40cab60 con 0x7f0ef40b10b0 2023-07-14T11:13:21.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.599+0000 7f03377ff700 1 Processor -- start 2023-07-14T11:13:21.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.599+0000 7f03377ff700 1 -- start start 2023-07-14T11:13:21.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.601+0000 7f0efa3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef415f5d0 con 0x7f0ef406b5b0 2023-07-14T11:13:21.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.601+0000 7f03377ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f033006b5b0 0x7f033015a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:21.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.601+0000 7f03377ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03300b10b0 0x7f033015ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:21.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.601+0000 7f03377ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03300ce650 0x7f03300c4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:21.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.601+0000 7f03377ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03300b2440 con 0x7f03300ce650 2023-07-14T11:13:21.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.601+0000 7f03377ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0330157950 con 0x7f033006b5b0 2023-07-14T11:13:21.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.601+0000 7f03377ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f033014a030 con 0x7f03300b10b0 2023-07-14T11:13:21.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.602+0000 7f0ef3fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0ef40b10b0 0x7f0ef4158560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:21.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.602+0000 7f0a217ff700 1 -- 172.21.15.84:0/2049713539 shutdown_connections 2023-07-14T11:13:21.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.602+0000 7f0a217ff700 1 --2- 172.21.15.84:0/2049713539 >> v2:172.21.15.179:3300/0 conn(0x7f0a1c157700 0x7f0a1c157b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:21.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.602+0000 7f0a217ff700 1 --2- 172.21.15.84:0/2049713539 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a1c0cab10 0x7f0a1c15b440 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:21.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.602+0000 7f0a217ff700 1 --2- 172.21.15.84:0/2049713539 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a1c0cb360 0x7f0a1c0cb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:21.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.602+0000 7f0a217ff700 1 -- 172.21.15.84:0/2049713539 >> 172.21.15.84:0/2049713539 conn(0x7f0a1c0b05d0 msgr2=0x7f0a1c0b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:21.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.602+0000 7f0ef3fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0ef40b10b0 0x7f0ef4158560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.84:51734/0 (socket says 172.21.15.84:51734) 2023-07-14T11:13:21.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.602+0000 7f0ef3fff700 1 -- 172.21.15.84:0/367797242 learned_addr learned my addr 172.21.15.84:0/367797242 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:21.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.602+0000 7f0ef37fe700 1 --2- 172.21.15.84:0/367797242 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ef406b5b0 0x7f0ef40cdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:21.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.602+0000 7f0a217ff700 1 -- 172.21.15.84:0/2049713539 shutdown_connections 2023-07-14T11:13:21.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.602+0000 7f1700b99700 1 -- 172.21.15.84:0/4193341837 <== mon.1 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3017475529 0 0) 0x7f16e80035b0 con 0x7f16fc0ce030 2023-07-14T11:13:21.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.602+0000 7f1700b99700 1 -- 172.21.15.84:0/4193341837 >> v2:172.21.15.84:3300/0 conn(0x7f16fc06b5b0 msgr2=0x7f16fc06b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:21.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.602+0000 7f1700b99700 1 --2- 172.21.15.84:0/4193341837 >> v2:172.21.15.84:3300/0 conn(0x7f16fc06b5b0 0x7f16fc06b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:21.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.602+0000 7f1700b99700 1 -- 172.21.15.84:0/4193341837 >> v1:172.21.15.84:6789/0 conn(0x7f16fc0cce50 legacy=0x7f16fc06bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:21.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.602+0000 7f1700b99700 1 -- 172.21.15.84:0/4193341837 --> v1:172.21.15.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16fc0cd660 con 0x7f16fc0ce030 2023-07-14T11:13:21.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.602+0000 7f1700b99700 1 -- 172.21.15.84:0/4193341837 <== mon.1 v1:172.21.15.179:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7f16f40019f0 con 0x7f16fc0ce030 2023-07-14T11:13:21.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.602+0000 7f1700b99700 1 -- 172.21.15.84:0/4193341837 >> v1:172.21.15.179:6789/0 conn(0x7f16fc0ce030 legacy=0x7f16fc0ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:21.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.602+0000 7f1700b99700 1 --2- 172.21.15.84:0/4193341837 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16e8003a00 0x7f16e8003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:21.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.602+0000 7f1700b99700 1 --2- 172.21.15.84:0/4193341837 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16e8004850 0x7f16e8004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:21.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.602+0000 7f1700b99700 1 --2- 172.21.15.84:0/4193341837 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16e8005200 0x7f16e800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:21.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.602+0000 7f1700b99700 1 -- 172.21.15.84:0/4193341837 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16fc0cd380 con 0x7f16e8003a00 2023-07-14T11:13:21.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.602+0000 7f1700b99700 1 -- 172.21.15.84:0/4193341837 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e8014920 con 0x7f16e8005200 2023-07-14T11:13:21.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.602+0000 7f1700b99700 1 -- 172.21.15.84:0/4193341837 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16e8014ae0 con 0x7f16e8004850 2023-07-14T11:13:21.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.603+0000 7f170239c700 1 --2- 172.21.15.84:0/4193341837 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16e8005200 0x7f16e800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:21.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.602+0000 7f0334d9a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03300b10b0 0x7f033015ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:21.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.602+0000 7f0334d9a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03300b10b0 0x7f033015ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.84:35948/0 (socket says 172.21.15.84:35948) 2023-07-14T11:13:21.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.602+0000 7f0334d9a700 1 -- 172.21.15.84:0/4028023730 learned_addr learned my addr 172.21.15.84:0/4028023730 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:21.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.603+0000 7f0335d9c700 1 --2- 172.21.15.84:0/4028023730 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03300ce650 0x7f03300c4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:21.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.603+0000 7f033559b700 1 --2- 172.21.15.84:0/4028023730 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f033006b5b0 0x7f033015a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:21.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.602+0000 7f0ef3fff700 1 -- 172.21.15.84:0/367797242 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ef406b5b0 msgr2=0x7f0ef40cdf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:21.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.602+0000 7f0ef3fff700 1 --2- 172.21.15.84:0/367797242 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ef406b5b0 0x7f0ef40cdf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:21.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.602+0000 7f0ef3fff700 1 -- 172.21.15.84:0/367797242 >> v1:172.21.15.84:6789/0 conn(0x7f0ef406ba20 legacy=0x7f0ef40cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:21.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.602+0000 7f0ef3fff700 1 -- 172.21.15.84:0/367797242 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ef406c250 con 0x7f0ef40b10b0 2023-07-14T11:13:21.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.603+0000 7f0ef3fff700 1 --2- 172.21.15.84:0/367797242 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ef40b10b0 0x7f0ef4158560 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0eec009e50 tx=0x7f0eec00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67380cb004b36cff server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:21.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.601+0000 7f3a6d5ff700 1 -- 172.21.15.84:0/3380876352 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a681590f0 con 0x7f3a680cdf40 2023-07-14T11:13:21.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.601+0000 7f3a6d5ff700 1 -- 172.21.15.84:0/3380876352 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a681596b0 con 0x7f3a680cdf40 2023-07-14T11:13:21.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.604+0000 7f0ef2ffd700 1 -- 172.21.15.84:0/367797242 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eec00e070 con 0x7f0ef40b10b0 2023-07-14T11:13:21.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.604+0000 7f0ef2ffd700 1 -- 172.21.15.84:0/367797242 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eec003a20 con 0x7f0ef40b10b0 2023-07-14T11:13:21.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.604+0000 7f0ef2ffd700 1 -- 172.21.15.84:0/367797242 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eec003db0 con 0x7f0ef40b10b0 2023-07-14T11:13:21.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.605+0000 7f3a6d5ff700 1 -- 172.21.15.84:0/3380876352 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3a6806c250 con 0x7f3a680cdf40 2023-07-14T11:13:21.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.602+0000 7f0a217ff700 1 -- 172.21.15.84:0/2049713539 wait complete. 2023-07-14T11:13:21.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.605+0000 7f0a217ff700 1 Processor -- start 2023-07-14T11:13:21.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.605+0000 7f0a217ff700 1 -- start start 2023-07-14T11:13:21.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.607+0000 7f0a217ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a1c0cab10 0x7f0a1c15c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:21.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.607+0000 7f0a217ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a1c0cb360 0x7f0a1c0c2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:21.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.607+0000 7f0a217ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a1c157700 0x7f0a1c0c2d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:21.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.607+0000 7f0a217ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1c0c3280 con 0x7f0a1c0cb360 2023-07-14T11:13:21.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.607+0000 7f0a217ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1c2033b0 con 0x7f0a1c157700 2023-07-14T11:13:21.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.607+0000 7f0a217ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1c2025f0 con 0x7f0a1c0cab10 2023-07-14T11:13:21.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.607+0000 7f0a1affd700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a1c0cab10 0x7f0a1c15c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:21.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.607+0000 7f0a1affd700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a1c0cab10 0x7f0a1c15c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.84:35964/0 (socket says 172.21.15.84:35964) 2023-07-14T11:13:21.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.607+0000 7f0a1affd700 1 -- 172.21.15.84:0/3815650747 learned_addr learned my addr 172.21.15.84:0/3815650747 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:21.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.608+0000 7f0a127fc700 1 --2- 172.21.15.84:0/3815650747 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a1c0cb360 0x7f0a1c0c2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:21.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.604+0000 7f0334d9a700 1 -- 172.21.15.84:0/4028023730 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f033006b5b0 msgr2=0x7f033015a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:21.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.604+0000 7f0334d9a700 1 --2- 172.21.15.84:0/4028023730 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f033006b5b0 0x7f033015a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:21.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.604+0000 7f0334d9a700 1 -- 172.21.15.84:0/4028023730 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03300ce650 msgr2=0x7f03300c4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:21.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.604+0000 7f0334d9a700 1 --2- 172.21.15.84:0/4028023730 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03300ce650 0x7f03300c4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:21.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.604+0000 7f0334d9a700 1 -- 172.21.15.84:0/4028023730 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03200094a0 con 0x7f03300b10b0 2023-07-14T11:13:21.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.605+0000 7f0334d9a700 1 --2- 172.21.15.84:0/4028023730 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03300b10b0 0x7f033015ac90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f032400c500 tx=0x7f032400c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:21.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.605+0000 7f032dffb700 1 -- 172.21.15.84:0/4028023730 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0324005d70 con 0x7f03300b10b0 2023-07-14T11:13:21.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.606+0000 7f032dffb700 1 -- 172.21.15.84:0/4028023730 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03240070d0 con 0x7f03300b10b0 2023-07-14T11:13:21.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.606+0000 7f032dffb700 1 -- 172.21.15.84:0/4028023730 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0324007440 con 0x7f03300b10b0 2023-07-14T11:13:21.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.606+0000 7f0efa3ff700 1 -- 172.21.15.84:0/367797242 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ef40b10b0 msgr2=0x7f0ef4158560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:21.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.606+0000 7f0efa3ff700 1 --2- 172.21.15.84:0/367797242 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ef40b10b0 0x7f0ef4158560 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0eec009e50 tx=0x7f0eec00b330 comp rx=0 tx=0).stop 2023-07-14T11:13:21.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.608+0000 7f0efa3ff700 1 -- 172.21.15.84:0/367797242 shutdown_connections 2023-07-14T11:13:21.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.608+0000 7f0efa3ff700 1 --2- 172.21.15.84:0/367797242 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ef40b10b0 0x7f0ef4158560 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:21.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.608+0000 7f0efa3ff700 1 --2- 172.21.15.84:0/367797242 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ef406b5b0 0x7f0ef40cdf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:21.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.608+0000 7f0efa3ff700 1 -- 172.21.15.84:0/367797242 >> 172.21.15.84:0/367797242 conn(0x7f0ef40b05d0 msgr2=0x7f0ef40b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:21.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.605+0000 7f170239c700 1 -- 172.21.15.84:0/4193341837 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16e8004850 msgr2=0x7f16e8004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:21.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.605+0000 7f170239c700 1 --2- 172.21.15.84:0/4193341837 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16e8004850 0x7f16e8004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:21.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.605+0000 7f170239c700 1 -- 172.21.15.84:0/4193341837 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16e8003a00 msgr2=0x7f16e8003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:21.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.605+0000 7f170239c700 1 --2- 172.21.15.84:0/4193341837 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16e8003a00 0x7f16e8003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:21.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.605+0000 7f170239c700 1 -- 172.21.15.84:0/4193341837 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16fc0cd660 con 0x7f16e8005200 2023-07-14T11:13:21.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.605+0000 7f170239c700 1 -- 172.21.15.84:0/4193341837 reap_dead start 2023-07-14T11:13:21.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.607+0000 7f170239c700 1 --2- 172.21.15.84:0/4193341837 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16e8005200 0x7f16e800ba10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f16f400a970 tx=0x7f16e8005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e7078877a30e09a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:21.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.604+0000 7f3d6adff700 1 Processor -- start 2023-07-14T11:13:21.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.605+0000 7f3d6adff700 1 -- start start 2023-07-14T11:13:21.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.607+0000 7f3d6adff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3d64164e20 0x7f3d640ce060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:21.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.607+0000 7f3d6adff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d640cda00 con 0x7f3d640cdbe0 2023-07-14T11:13:21.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.607+0000 7f3d6adff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d64161000 con 0x7f3d64160c30 2023-07-14T11:13:21.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.607+0000 7f3d6adff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d640ce5a0 con 0x7f3d64164e20 2023-07-14T11:13:21.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.608+0000 7f3d6939c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3d64164e20 0x7f3d640ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:21.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.608+0000 7f3d68b9b700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f3d64160c30 0x7f3d640cd2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.84:50226/0 (socket says 172.21.15.84:50226) 2023-07-14T11:13:21.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.608+0000 7f3d68b9b700 1 -- 172.21.15.84:0/2802796805 learned_addr learned my addr 172.21.15.84:0/2802796805 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:13:21.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.608+0000 7f3a4f7fe700 1 -- 172.21.15.84:0/3380876352 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3a58003a20 con 0x7f3a680cdf40 2023-07-14T11:13:21.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.608+0000 7f1700b99700 1 -- 172.21.15.84:0/4193341837 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f400a360 con 0x7f16e8005200 2023-07-14T11:13:21.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.608+0000 7f1700b99700 1 -- 172.21.15.84:0/4193341837 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16f4012620 con 0x7f16e8005200 2023-07-14T11:13:21.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.608+0000 7f1700b99700 1 -- 172.21.15.84:0/4193341837 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f40129b0 con 0x7f16e8005200 2023-07-14T11:13:21.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.608+0000 7f0a1affd700 1 -- 172.21.15.84:0/3815650747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a1c157700 msgr2=0x7f0a1c0c2d40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-14T11:13:21.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.608+0000 7f0a1affd700 1 --2- 172.21.15.84:0/3815650747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a1c157700 0x7f0a1c0c2d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:21.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.608+0000 7f0a1affd700 1 -- 172.21.15.84:0/3815650747 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a1c0cb360 msgr2=0x7f0a1c0c2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:21.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.608+0000 7f0a1affd700 1 --2- 172.21.15.84:0/3815650747 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a1c0cb360 0x7f0a1c0c2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:21.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.608+0000 7f0a1affd700 1 -- 172.21.15.84:0/3815650747 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a0c009550 con 0x7f0a1c0cab10 2023-07-14T11:13:21.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.608+0000 7f0efa3ff700 1 -- 172.21.15.84:0/367797242 shutdown_connections 2023-07-14T11:13:21.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.608+0000 7f0efa3ff700 1 -- 172.21.15.84:0/367797242 wait complete. 2023-07-14T11:13:21.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.609+0000 7f1703dff700 1 -- 172.21.15.84:0/4193341837 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16e8005200 msgr2=0x7f16e800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:21.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.609+0000 7f1703dff700 1 --2- 172.21.15.84:0/4193341837 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16e8005200 0x7f16e800ba10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f16f400a970 tx=0x7f16e8005880 comp rx=0 tx=0).stop 2023-07-14T11:13:21.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.609+0000 7f3d637fe700 1 -- 172.21.15.84:0/2802796805 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 581669557 0 0) 0x7f3d64161000 con 0x7f3d64160c30 2023-07-14T11:13:21.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.609+0000 7f3d637fe700 1 -- 172.21.15.84:0/2802796805 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d4c0035b0 con 0x7f3d64160c30 2023-07-14T11:13:21.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.609+0000 7f0a1affd700 1 --2- 172.21.15.84:0/3815650747 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a1c0cab10 0x7f0a1c15c6b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c000c00 tx=0x7f0a0c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:21.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.610+0000 7f03377ff700 1 -- 172.21.15.84:0/4028023730 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03300b2650 con 0x7f03300b10b0 2023-07-14T11:13:21.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.610+0000 7f03377ff700 1 -- 172.21.15.84:0/4028023730 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0330157da0 con 0x7f03300b10b0 2023-07-14T11:13:21.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.609+0000 7f3a4f7fe700 1 --2- 172.21.15.84:0/3380876352 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f3a5406adb0 0x7f3a5406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:21.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.609+0000 7f3a4f7fe700 1 -- 172.21.15.84:0/3380876352 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3a580888e0 con 0x7f3a680cdf40 2023-07-14T11:13:21.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.610+0000 7f3a4f7fe700 1 --2- 172.21.15.84:0/3380876352 >> [v2:172.21.15.84:6824/1060220522,v1:172.21.15.84:6825/1060220522] conn(0x7f3a54073660 0x7f3a54075a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:21.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.610+0000 7f3a4f7fe700 1 -- 172.21.15.84:0/3380876352 --> [v2:172.21.15.84:6824/1060220522,v1:172.21.15.84:6825/1060220522] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3a54076120 con 0x7f3a54073660 2023-07-14T11:13:21.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.610+0000 7f3a4f7fe700 1 -- 172.21.15.84:0/3380876352 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3a5808d220 con 0x7f3a680cdf40 2023-07-14T11:13:21.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.610+0000 7f1703dff700 1 -- 172.21.15.84:0/4193341837 shutdown_connections 2023-07-14T11:13:21.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.610+0000 7f1703dff700 1 --2- 172.21.15.84:0/4193341837 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16e8005200 0x7f16e800ba10 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:21.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.610+0000 7f1703dff700 1 -- 172.21.15.84:0/4193341837 >> 172.21.15.84:0/4193341837 conn(0x7f16fc0b05d0 msgr2=0x7f16fc0b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:21.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.610+0000 7f3a667fc700 1 --2- 172.21.15.84:0/3380876352 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f3a5406adb0 0x7f3a5406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:21.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.610+0000 7f0a13fff700 1 -- 172.21.15.84:0/3815650747 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0c0103a0 con 0x7f0a1c0cab10 2023-07-14T11:13:21.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.610+0000 7f0a13fff700 1 -- 172.21.15.84:0/3815650747 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a0c0036a0 con 0x7f0a1c0cab10 2023-07-14T11:13:21.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.610+0000 7f0a13fff700 1 -- 172.21.15.84:0/3815650747 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0c003a50 con 0x7f0a1c0cab10 2023-07-14T11:13:21.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.610+0000 7f0a217ff700 1 -- 172.21.15.84:0/3815650747 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a1c2028d0 con 0x7f0a1c0cab10 2023-07-14T11:13:21.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.610+0000 7f0a217ff700 1 -- 172.21.15.84:0/3815650747 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a1c202e90 con 0x7f0a1c0cab10 2023-07-14T11:13:21.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.611+0000 7f0a217ff700 1 -- 172.21.15.84:0/3815650747 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0a1c06c460 con 0x7f0a1c0cab10 2023-07-14T11:13:21.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.611+0000 7f3a677fe700 1 --2- 172.21.15.84:0/3380876352 >> [v2:172.21.15.84:6824/1060220522,v1:172.21.15.84:6825/1060220522] conn(0x7f3a54073660 0x7f3a54075a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:21.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.612+0000 7f3a677fe700 1 --2- 172.21.15.84:0/3380876352 >> [v2:172.21.15.84:6824/1060220522,v1:172.21.15.84:6825/1060220522] conn(0x7f3a54073660 0x7f3a54075a70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:21.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.611+0000 7f03377ff700 1 -- 172.21.15.84:0/4028023730 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f033014a530 con 0x7f03300b10b0 2023-07-14T11:13:21.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.611+0000 7f0efa3ff700 1 Processor -- start 2023-07-14T11:13:21.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.611+0000 7f0efa3ff700 1 -- start start 2023-07-14T11:13:21.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.612+0000 7f0efa3ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ef406b5b0 0x7f0ef40b4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:21.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.612+0000 7f0efa3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ef406ba20 0x7f0ef40c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:21.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.612+0000 7f0efa3ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ef40b10b0 0x7f0ef4145f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:21.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.612+0000 7f0efa3ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef40c62f0 con 0x7f0ef40b10b0 2023-07-14T11:13:21.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.612+0000 7f0efa3ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef4146d80 con 0x7f0ef406b5b0 2023-07-14T11:13:21.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.612+0000 7f0efa3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef40b4740 con 0x7f0ef406ba20 2023-07-14T11:13:21.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.612+0000 7f0ef3fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ef406b5b0 0x7f0ef40b4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:21.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.612+0000 7f0ef3fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ef406b5b0 0x7f0ef40b4200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.84:51788/0 (socket says 172.21.15.84:51788) 2023-07-14T11:13:21.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.612+0000 7f0ef3fff700 1 -- 172.21.15.84:0/2742419612 learned_addr learned my addr 172.21.15.84:0/2742419612 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:21.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.610+0000 7f3d637fe700 1 -- 172.21.15.84:0/2802796805 <== mon.1 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1250605356 0 0) 0x7f3d4c0035b0 con 0x7f3d64160c30 2023-07-14T11:13:21.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.610+0000 7f3d637fe700 1 -- 172.21.15.84:0/2802796805 >> v2:172.21.15.179:3300/0 conn(0x7f3d64164e20 msgr2=0x7f3d640ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:21.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.610+0000 7f3d637fe700 1 --2- 172.21.15.84:0/2802796805 >> v2:172.21.15.179:3300/0 conn(0x7f3d64164e20 0x7f3d640ce060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:21.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.610+0000 7f3d637fe700 1 -- 172.21.15.84:0/2802796805 >> v1:172.21.15.84:6789/0 conn(0x7f3d640cdbe0 legacy=0x7f3d64164710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:21.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.610+0000 7f3d637fe700 1 -- 172.21.15.84:0/2802796805 --> v1:172.21.15.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d64165400 con 0x7f3d64160c30 2023-07-14T11:13:21.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.610+0000 7f3d637fe700 1 -- 172.21.15.84:0/2802796805 <== mon.1 v1:172.21.15.179:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7f3d54001670 con 0x7f3d64160c30 2023-07-14T11:13:21.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.611+0000 7f3d637fe700 1 -- 172.21.15.84:0/2802796805 >> v1:172.21.15.179:6789/0 conn(0x7f3d64160c30 legacy=0x7f3d640cd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:21.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.611+0000 7f3d637fe700 1 --2- 172.21.15.84:0/2802796805 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d4c003a00 0x7f3d4c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:21.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.611+0000 7f3d637fe700 1 --2- 172.21.15.84:0/2802796805 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d4c004850 0x7f3d4c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:21.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.611+0000 7f3d637fe700 1 --2- 172.21.15.84:0/2802796805 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d4c005200 0x7f3d4c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:21.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.611+0000 7f3d637fe700 1 -- 172.21.15.84:0/2802796805 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d640ce5a0 con 0x7f3d4c003a00 2023-07-14T11:13:21.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.611+0000 7f3d637fe700 1 -- 172.21.15.84:0/2802796805 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4c00c080 con 0x7f3d4c004850 2023-07-14T11:13:21.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.611+0000 7f3d637fe700 1 -- 172.21.15.84:0/2802796805 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4c00c240 con 0x7f3d4c005200 2023-07-14T11:13:21.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.611+0000 7f3d63fff700 1 --2- 172.21.15.84:0/2802796805 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d4c004850 0x7f3d4c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:21.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.611+0000 7f3d68b9b700 1 --2- 172.21.15.84:0/2802796805 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d4c003a00 0x7f3d4c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:21.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.612+0000 7f3d6939c700 1 --2- 172.21.15.84:0/2802796805 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d4c005200 0x7f3d4c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:21.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.612+0000 7fa3753ff700 1 Processor -- start 2023-07-14T11:13:21.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.610+0000 7f1703dff700 1 -- 172.21.15.84:0/4193341837 shutdown_connections 2023-07-14T11:13:21.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.611+0000 7f1703dff700 1 -- 172.21.15.84:0/4193341837 wait complete. 2023-07-14T11:13:21.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.613+0000 7f3a4f7fe700 1 -- 172.21.15.84:0/3380876352 <== osd.1 v2:172.21.15.84:6824/1060220522 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f3a54076120 con 0x7f3a54073660 2023-07-14T11:13:21.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.612+0000 7fa3753ff700 1 -- start start 2023-07-14T11:13:21.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.613+0000 7f0ef37fe700 1 --2- 172.21.15.84:0/2742419612 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ef406ba20 0x7f0ef40c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:21.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.613+0000 7f3d6939c700 1 -- 172.21.15.84:0/2802796805 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d4c004850 msgr2=0x7f3d4c004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:21.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.613+0000 7f3d6939c700 1 --2- 172.21.15.84:0/2802796805 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d4c004850 0x7f3d4c004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:21.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.613+0000 7f3d6939c700 1 -- 172.21.15.84:0/2802796805 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d4c003a00 msgr2=0x7f3d4c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:21.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.613+0000 7f3d6939c700 1 --2- 172.21.15.84:0/2802796805 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d4c003a00 0x7f3d4c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:21.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.613+0000 7f3d6939c700 1 -- 172.21.15.84:0/2802796805 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d64165400 con 0x7f3d4c005200 2023-07-14T11:13:21.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.613+0000 7f3d6939c700 1 -- 172.21.15.84:0/2802796805 reap_dead start 2023-07-14T11:13:21.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.613+0000 7f0ef3fff700 1 -- 172.21.15.84:0/2742419612 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ef406ba20 msgr2=0x7f0ef40c83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:21.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.613+0000 7f0ef3fff700 1 --2- 172.21.15.84:0/2742419612 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ef406ba20 0x7f0ef40c83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:21.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.613+0000 7f0ef3fff700 1 -- 172.21.15.84:0/2742419612 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ef40b10b0 msgr2=0x7f0ef4145f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:21.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.613+0000 7f0ef3fff700 1 --2- 172.21.15.84:0/2742419612 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ef40b10b0 0x7f0ef4145f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:21.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.613+0000 7f0ef3fff700 1 -- 172.21.15.84:0/2742419612 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eec009b30 con 0x7f0ef406b5b0 2023-07-14T11:13:21.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.614+0000 7f0ef3fff700 1 --2- 172.21.15.84:0/2742419612 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ef406b5b0 0x7f0ef40b4200 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0eec00b370 tx=0x7f0eec004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:21.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.614+0000 7f3d6939c700 1 --2- 172.21.15.84:0/2802796805 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d4c005200 0x7f3d4c00ba10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c009fc0 tx=0x7f3d4c005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7459b3c988efd456 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:21.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.615+0000 7f0ef0ff9700 1 -- 172.21.15.84:0/2742419612 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eec004440 con 0x7f0ef406b5b0 2023-07-14T11:13:21.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.615+0000 7f0ef0ff9700 1 -- 172.21.15.84:0/2742419612 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eec0045a0 con 0x7f0ef406b5b0 2023-07-14T11:13:21.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.615+0000 7f0ef0ff9700 1 -- 172.21.15.84:0/2742419612 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eec004950 con 0x7f0ef406b5b0 2023-07-14T11:13:21.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.615+0000 7f0efa3ff700 1 -- 172.21.15.84:0/2742419612 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ef40c5d30 con 0x7f0ef406b5b0 2023-07-14T11:13:21.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.615+0000 7f0efa3ff700 1 -- 172.21.15.84:0/2742419612 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ef4146a10 con 0x7f0ef406b5b0 2023-07-14T11:13:21.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.614+0000 7f3d637fe700 1 -- 172.21.15.84:0/2802796805 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d5c003a20 con 0x7f3d4c005200 2023-07-14T11:13:21.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.614+0000 7f3d637fe700 1 -- 172.21.15.84:0/2802796805 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d5c00f040 con 0x7f3d4c005200 2023-07-14T11:13:21.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.614+0000 7f3d637fe700 1 -- 172.21.15.84:0/2802796805 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d5c003da0 con 0x7f3d4c005200 2023-07-14T11:13:21.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.615+0000 7f3d6adff700 1 -- 172.21.15.84:0/2802796805 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d4c005200 msgr2=0x7f3d4c00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:21.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.615+0000 7f3d6adff700 1 --2- 172.21.15.84:0/2802796805 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d4c005200 0x7f3d4c00ba10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c009fc0 tx=0x7f3d4c005880 comp rx=0 tx=0).stop 2023-07-14T11:13:21.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.613+0000 7f1703dff700 1 Processor -- start 2023-07-14T11:13:21.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.614+0000 7f1703dff700 1 -- start start 2023-07-14T11:13:21.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.615+0000 7f3d6adff700 1 -- 172.21.15.84:0/2802796805 shutdown_connections 2023-07-14T11:13:21.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.615+0000 7f3d6adff700 1 --2- 172.21.15.84:0/2802796805 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d4c005200 0x7f3d4c00ba10 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:21.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.615+0000 7f3d6adff700 1 -- 172.21.15.84:0/2802796805 >> 172.21.15.84:0/2802796805 conn(0x7f3d640b05d0 msgr2=0x7f3d640b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:21.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.615+0000 7fa3753ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa370160d50 0x7fa370161a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:21.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.615+0000 7fa3753ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa37006cd60 0x7fa3700cc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:21.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.615+0000 7fa3753ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3700cd530 con 0x7fa3700cd940 2023-07-14T11:13:21.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.615+0000 7fa3753ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3701615d0 con 0x7fa370160d50 2023-07-14T11:13:21.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.615+0000 7fa3753ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3700ccf70 con 0x7fa37006cd60 2023-07-14T11:13:21.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.615+0000 7f09a11ff700 1 Processor -- start 2023-07-14T11:13:21.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.616+0000 7f09a11ff700 1 -- start start 2023-07-14T11:13:21.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.616+0000 7f032dffb700 1 -- 172.21.15.84:0/4028023730 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f03240075a0 con 0x7f03300b10b0 2023-07-14T11:13:21.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.617+0000 7f3a667fc700 1 --2- 172.21.15.84:0/3380876352 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f3a5406adb0 0x7f3a5406d260 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3a680b3d70 tx=0x7f3a60006310 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:21.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.617+0000 7f1703dff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16e8005200 0x7f16fc16b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:21.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.617+0000 7f1703dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16fc16bef0 0x7f16fc0c44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:21.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.617+0000 7f1703dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16fc1f23f0 0x7f16fc1f2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:21.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.617+0000 7f1703dff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16fc16ac40 con 0x7f16e8005200 2023-07-14T11:13:21.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.617+0000 7f1703dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16fc16a030 con 0x7f16fc16bef0 2023-07-14T11:13:21.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.617+0000 7f1703dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16fc16a310 con 0x7f16fc1f23f0 2023-07-14T11:13:21.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.615+0000 7f0a13fff700 1 -- 172.21.15.84:0/3815650747 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0a0c003bb0 con 0x7f0a1c0cab10 2023-07-14T11:13:21.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.617+0000 7f0a13fff700 1 --2- 172.21.15.84:0/3815650747 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f0a0006adb0 0x7f0a0006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:21.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.617+0000 7f0a13fff700 1 -- 172.21.15.84:0/3815650747 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0a0c08ac20 con 0x7f0a1c0cab10 2023-07-14T11:13:21.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.617+0000 7f0a13fff700 1 --2- 172.21.15.84:0/3815650747 >> [v2:172.21.15.84:6808/288822924,v1:172.21.15.84:6809/288822924] conn(0x7f0a00073660 0x7f0a00075a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:21.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.617+0000 7f0a13fff700 1 -- 172.21.15.84:0/3815650747 --> [v2:172.21.15.84:6808/288822924,v1:172.21.15.84:6809/288822924] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0a00076120 con 0x7f0a00073660 2023-07-14T11:13:21.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.617+0000 7f0a13fff700 1 -- 172.21.15.84:0/3815650747 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a0c08afd0 con 0x7f0a1c0cab10 2023-07-14T11:13:21.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.618+0000 7f0a127fc700 1 --2- 172.21.15.84:0/3815650747 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f0a0006adb0 0x7f0a0006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:21.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.617+0000 7f032dffb700 1 --2- 172.21.15.84:0/4028023730 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f031c06adb0 0x7f031c06d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:21.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.618+0000 7f032dffb700 1 -- 172.21.15.84:0/4028023730 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0324088f30 con 0x7f03300b10b0 2023-07-14T11:13:21.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.618+0000 7f032dffb700 1 --2- 172.21.15.84:0/4028023730 >> [v2:172.21.15.84:6800/3001671542,v1:172.21.15.84:6801/3001671542] conn(0x7f031c073660 0x7f031c075a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:21.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.618+0000 7f032dffb700 1 -- 172.21.15.84:0/4028023730 --> [v2:172.21.15.84:6800/3001671542,v1:172.21.15.84:6801/3001671542] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f031c076120 con 0x7f031c073660 2023-07-14T11:13:21.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.618+0000 7f032dffb700 1 -- 172.21.15.84:0/4028023730 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f03240892e0 con 0x7f03300b10b0 2023-07-14T11:13:21.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.616+0000 7fa36e7fc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa370160d50 0x7fa370161a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:21.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.616+0000 7fa36e7fc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa370160d50 0x7fa370161a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34032/0 (socket says 172.21.15.84:34032) 2023-07-14T11:13:21.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.616+0000 7fa36e7fc700 1 -- 172.21.15.84:0/598347314 learned_addr learned my addr 172.21.15.84:0/598347314 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:21.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.617+0000 7fa36e7fc700 1 -- 172.21.15.84:0/598347314 >> v2:172.21.15.179:3300/0 conn(0x7fa37006cd60 msgr2=0x7fa3700cc690 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T11:13:21.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.617+0000 7fa36e7fc700 1 --2- 172.21.15.84:0/598347314 >> v2:172.21.15.179:3300/0 conn(0x7fa37006cd60 0x7fa3700cc690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:21.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.617+0000 7fa36e7fc700 1 -- 172.21.15.84:0/598347314 >> v1:172.21.15.179:6789/0 conn(0x7fa3700cd940 legacy=0x7fa3700cdd10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T11:13:21.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.617+0000 7fa36e7fc700 1 -- 172.21.15.84:0/598347314 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3700cd250 con 0x7fa370160d50 2023-07-14T11:13:21.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.617+0000 7fa36e7fc700 1 --2- 172.21.15.84:0/598347314 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa370160d50 0x7fa370161a60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa3700b13f0 tx=0x7fa360009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6475650d1cd80a4 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:21.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.618+0000 7f09a11ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f099c0cab10 0x7f099c15b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:21.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.618+0000 7f09a11ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f099c0cb360 0x7f099c0cb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:21.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.618+0000 7f09a11ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f099c15b980 con 0x7f099c157700 2023-07-14T11:13:21.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.618+0000 7f09a11ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f099c071b10 con 0x7f099c0cab10 2023-07-14T11:13:21.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.618+0000 7f09a11ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f099c06b8e0 con 0x7f099c0cb360 2023-07-14T11:13:21.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.618+0000 7f099b59e700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f099c157700 0x7f099c157b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.84:50248/0 (socket says 172.21.15.84:50248) 2023-07-14T11:13:21.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.618+0000 7f099b59e700 1 -- 172.21.15.84:0/2147315458 learned_addr learned my addr 172.21.15.84:0/2147315458 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:13:21.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.619+0000 7f099ad9d700 1 --2- 172.21.15.84:0/2147315458 >> v2:172.21.15.84:3300/0 conn(0x7f099c0cab10 0x7f099c15b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:21.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.619+0000 7f099a59c700 1 --2- 172.21.15.84:0/2147315458 >> v2:172.21.15.179:3300/0 conn(0x7f099c0cb360 0x7f099c0cb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:21.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.619+0000 7f0335d9c700 1 --2- 172.21.15.84:0/4028023730 >> [v2:172.21.15.84:6800/3001671542,v1:172.21.15.84:6801/3001671542] conn(0x7f031c073660 0x7f031c075a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:21.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.619+0000 7f033559b700 1 --2- 172.21.15.84:0/4028023730 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f031c06adb0 0x7f031c06d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:21.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.619+0000 7fa36dffb700 1 -- 172.21.15.84:0/598347314 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa360004230 con 0x7fa370160d50 2023-07-14T11:13:21.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.619+0000 7fa36dffb700 1 -- 172.21.15.84:0/598347314 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa360004390 con 0x7fa370160d50 2023-07-14T11:13:21.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.619+0000 7fa36dffb700 1 -- 172.21.15.84:0/598347314 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3600036a0 con 0x7fa370160d50 2023-07-14T11:13:21.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.619+0000 7f099ad9d700 1 -- 172.21.15.84:0/2147315458 >> v2:172.21.15.179:3300/0 conn(0x7f099c0cb360 msgr2=0x7f099c0cb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:21.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.619+0000 7f099ad9d700 1 --2- 172.21.15.84:0/2147315458 >> v2:172.21.15.179:3300/0 conn(0x7f099c0cb360 0x7f099c0cb7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:21.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.619+0000 7f099ad9d700 1 -- 172.21.15.84:0/2147315458 >> v1:172.21.15.179:6789/0 conn(0x7f099c157700 legacy=0x7f099c157b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:21.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.619+0000 7f099ad9d700 1 -- 172.21.15.84:0/2147315458 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f099c06bbc0 con 0x7f099c0cab10 2023-07-14T11:13:21.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.619+0000 7f0ef0ff9700 1 -- 172.21.15.84:0/2742419612 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0eec019070 con 0x7f0ef406b5b0 2023-07-14T11:13:21.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.618+0000 7f0a1b7fe700 1 --2- 172.21.15.84:0/3815650747 >> [v2:172.21.15.84:6808/288822924,v1:172.21.15.84:6809/288822924] conn(0x7f0a00073660 0x7f0a00075a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:21.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.620+0000 7f0335d9c700 1 --2- 172.21.15.84:0/4028023730 >> [v2:172.21.15.84:6800/3001671542,v1:172.21.15.84:6801/3001671542] conn(0x7f031c073660 0x7f031c075a70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:21.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.620+0000 7f033559b700 1 --2- 172.21.15.84:0/4028023730 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f031c06adb0 0x7f031c06d260 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0328009b00 tx=0x7f0328003a20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:21.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.620+0000 7f099ad9d700 1 --2- 172.21.15.84:0/2147315458 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f099c0cab10 0x7f099c15b440 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f099c06f520 tx=0x7f098c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ec92c3b77caf595 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:21.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.620+0000 7f0a1b7fe700 1 --2- 172.21.15.84:0/3815650747 >> [v2:172.21.15.84:6808/288822924,v1:172.21.15.84:6809/288822924] conn(0x7f0a00073660 0x7f0a00075a70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:21.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.620+0000 7fa3753ff700 1 -- 172.21.15.84:0/598347314 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa370160d50 msgr2=0x7fa370161a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:21.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.620+0000 7fa3753ff700 1 --2- 172.21.15.84:0/598347314 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa370160d50 0x7fa370161a60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa3700b13f0 tx=0x7fa360009bd0 comp rx=0 tx=0).stop 2023-07-14T11:13:21.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.620+0000 7f170239c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16fc1f23f0 0x7f16fc1f2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:21.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.620+0000 7f170139a700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16fc16bef0 0x7f16fc0c44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:21.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.620+0000 7f0ef0ff9700 1 --2- 172.21.15.84:0/2742419612 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f0ee006adb0 0x7f0ee006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:21.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.620+0000 7f0ef0ff9700 1 -- 172.21.15.84:0/2742419612 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0eec08a4c0 con 0x7f0ef406b5b0 2023-07-14T11:13:21.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.620+0000 7f170139a700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16fc16bef0 0x7f16fc0c44f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.84:51808/0 (socket says 172.21.15.84:51808) 2023-07-14T11:13:21.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.620+0000 7f170139a700 1 -- 172.21.15.84:0/631339036 learned_addr learned my addr 172.21.15.84:0/631339036 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:21.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.620+0000 7fa3753ff700 1 -- 172.21.15.84:0/598347314 shutdown_connections 2023-07-14T11:13:21.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.620+0000 7fa3753ff700 1 --2- 172.21.15.84:0/598347314 >> v2:172.21.15.179:3300/0 conn(0x7fa37006cd60 0x7fa3700cc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:21.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.620+0000 7fa3753ff700 1 --2- 172.21.15.84:0/598347314 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa370160d50 0x7fa370161a60 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:21.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.620+0000 7fa3753ff700 1 -- 172.21.15.84:0/598347314 >> 172.21.15.84:0/598347314 conn(0x7fa3700b05d0 msgr2=0x7fa3700b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:21.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.620+0000 7f0999d9b700 1 -- 172.21.15.84:0/2147315458 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098c004230 con 0x7f099c0cab10 2023-07-14T11:13:21.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.620+0000 7f0999d9b700 1 -- 172.21.15.84:0/2147315458 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f098c004390 con 0x7f099c0cab10 2023-07-14T11:13:21.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.620+0000 7f0999d9b700 1 -- 172.21.15.84:0/2147315458 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098c0036a0 con 0x7f099c0cab10 2023-07-14T11:13:21.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.620+0000 7f0a127fc700 1 --2- 172.21.15.84:0/3815650747 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f0a0006adb0 0x7f0a0006d260 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c0b49c0 tx=0x7f0a04008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:21.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.621+0000 7f0ef37fe700 1 --2- 172.21.15.84:0/2742419612 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f0ee006adb0 0x7f0ee006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:21.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.621+0000 7f1701b9b700 1 --2- 172.21.15.84:0/631339036 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16e8005200 0x7f16fc16b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:21.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.621+0000 7f170139a700 1 -- 172.21.15.84:0/631339036 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16fc1f23f0 msgr2=0x7f16fc1f2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:21.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.621+0000 7f170139a700 1 --2- 172.21.15.84:0/631339036 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16fc1f23f0 0x7f16fc1f2850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:21.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.621+0000 7f170139a700 1 -- 172.21.15.84:0/631339036 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16e8005200 msgr2=0x7f16fc16b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:21.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.621+0000 7f170139a700 1 --2- 172.21.15.84:0/631339036 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16e8005200 0x7f16fc16b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:21.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.621+0000 7f170139a700 1 -- 172.21.15.84:0/631339036 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16fc16a5f0 con 0x7f16fc16bef0 2023-07-14T11:13:21.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.621+0000 7f1701b9b700 1 --2- 172.21.15.84:0/631339036 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16e8005200 0x7f16fc16b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:13:21.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.621+0000 7f3d6adff700 1 -- 172.21.15.84:0/2802796805 shutdown_connections 2023-07-14T11:13:21.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.621+0000 7fa3753ff700 1 -- 172.21.15.84:0/598347314 shutdown_connections 2023-07-14T11:13:21.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.622+0000 7f0a13fff700 1 -- 172.21.15.84:0/3815650747 <== osd.0 v2:172.21.15.84:6808/288822924 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f0a00076120 con 0x7f0a00073660 2023-07-14T11:13:21.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.621+0000 7f09a11ff700 1 -- 172.21.15.84:0/2147315458 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f099c0cab10 msgr2=0x7f099c15b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:21.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.621+0000 7f09a11ff700 1 --2- 172.21.15.84:0/2147315458 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f099c0cab10 0x7f099c15b440 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f099c06f520 tx=0x7f098c009b20 comp rx=0 tx=0).stop 2023-07-14T11:13:21.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.622+0000 7f0ef37fe700 1 --2- 172.21.15.84:0/2742419612 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f0ee006adb0 0x7f0ee006d260 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0ef40c2440 tx=0x7f0ee8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:21.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.622+0000 7f09a11ff700 1 -- 172.21.15.84:0/2147315458 shutdown_connections 2023-07-14T11:13:21.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.622+0000 7f09a11ff700 1 --2- 172.21.15.84:0/2147315458 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f099c0cab10 0x7f099c15b440 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:21.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.622+0000 7f09a11ff700 1 --2- 172.21.15.84:0/2147315458 >> v2:172.21.15.179:3300/0 conn(0x7f099c0cb360 0x7f099c0cb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:21.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.622+0000 7f09a11ff700 1 -- 172.21.15.84:0/2147315458 >> 172.21.15.84:0/2147315458 conn(0x7f099c0b05d0 msgr2=0x7f099c0b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:21.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.622+0000 7f170139a700 1 --2- 172.21.15.84:0/631339036 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16fc16bef0 0x7f16fc0c44f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f16f800c390 tx=0x7f16f800c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:21.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.621+0000 7fa3753ff700 1 -- 172.21.15.84:0/598347314 wait complete. 2023-07-14T11:13:21.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.622+0000 7f0efa3ff700 1 --2- 172.21.15.84:0/2742419612 >> [v2:172.21.15.84:6816/3292558976,v1:172.21.15.84:6817/3292558976] conn(0x7f0ed40015e0 0x7f0ed4003a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:21.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.622+0000 7f0efa3ff700 1 -- 172.21.15.84:0/2742419612 --> [v2:172.21.15.84:6816/3292558976,v1:172.21.15.84:6817/3292558976] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0ed4006bc0 con 0x7f0ed40015e0 2023-07-14T11:13:21.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.622+0000 7f16ee7fc700 1 -- 172.21.15.84:0/631339036 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f8005d70 con 0x7f16fc16bef0 2023-07-14T11:13:21.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.622+0000 7f16ee7fc700 1 -- 172.21.15.84:0/631339036 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16f800ce50 con 0x7f16fc16bef0 2023-07-14T11:13:21.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.622+0000 7f16ee7fc700 1 -- 172.21.15.84:0/631339036 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f8007310 con 0x7f16fc16bef0 2023-07-14T11:13:21.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.622+0000 7f1703dff700 1 -- 172.21.15.84:0/631339036 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16fc16a8d0 con 0x7f16fc16bef0 2023-07-14T11:13:21.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.622+0000 7f1703dff700 1 -- 172.21.15.84:0/631339036 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16fc0c4c10 con 0x7f16fc16bef0 2023-07-14T11:13:21.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.623+0000 7f032dffb700 1 -- 172.21.15.84:0/4028023730 <== osd.2 v2:172.21.15.84:6800/3001671542 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f031c076120 con 0x7f031c073660 2023-07-14T11:13:21.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.623+0000 7f0ef899c700 1 --2- 172.21.15.84:0/2742419612 >> [v2:172.21.15.84:6816/3292558976,v1:172.21.15.84:6817/3292558976] conn(0x7f0ed40015e0 0x7f0ed4003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:21.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.623+0000 7f0ef899c700 1 --2- 172.21.15.84:0/2742419612 >> [v2:172.21.15.84:6816/3292558976,v1:172.21.15.84:6817/3292558976] conn(0x7f0ed40015e0 0x7f0ed4003a90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:21.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.624+0000 7f1703dff700 1 -- 172.21.15.84:0/631339036 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f16fc0cd940 con 0x7f16fc16bef0 2023-07-14T11:13:21.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.623+0000 7f3d6adff700 1 -- 172.21.15.84:0/2802796805 wait complete. 2023-07-14T11:13:21.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.626+0000 7f3d6adff700 1 Processor -- start 2023-07-14T11:13:21.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.624+0000 7fa3753ff700 1 Processor -- start 2023-07-14T11:13:21.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.624+0000 7fa3753ff700 1 -- start start 2023-07-14T11:13:21.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.626+0000 7fa3753ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa37006cd60 0x7fa37015c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:21.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.626+0000 7fa3753ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3700cd940 0x7fa3700b18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:21.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.626+0000 7fa3753ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa370160d50 0x7fa3701526b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:21.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.626+0000 7fa3753ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3700c4020 con 0x7fa37006cd60 2023-07-14T11:13:21.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.626+0000 7fa3753ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa37015bf20 con 0x7fa370160d50 2023-07-14T11:13:21.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.626+0000 7fa3753ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa37015bc40 con 0x7fa3700cd940 2023-07-14T11:13:21.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.624+0000 7f09a11ff700 1 -- 172.21.15.84:0/2147315458 shutdown_connections 2023-07-14T11:13:21.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.624+0000 7f09a11ff700 1 -- 172.21.15.84:0/2147315458 wait complete. 2023-07-14T11:13:21.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.626+0000 7f09a11ff700 1 Processor -- start 2023-07-14T11:13:21.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.626+0000 7f09a11ff700 1 -- start start 2023-07-14T11:13:21.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.626+0000 7f16ee7fc700 1 -- 172.21.15.84:0/631339036 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f16f8007470 con 0x7f16fc16bef0 2023-07-14T11:13:21.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.628+0000 7f16ee7fc700 1 --2- 172.21.15.84:0/631339036 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f16e006ad10 0x7f16e006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:21.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.628+0000 7f16ee7fc700 1 -- 172.21.15.84:0/631339036 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f16f8088650 con 0x7f16fc16bef0 2023-07-14T11:13:21.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.628+0000 7f16ee7fc700 1 --2- 172.21.15.84:0/631339036 >> [v2:172.21.15.179:6800/3819177669,v1:172.21.15.179:6801/3819177669] conn(0x7f16e0073540 0x7f16e0075950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:21.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.628+0000 7f16ee7fc700 1 -- 172.21.15.84:0/631339036 --> [v2:172.21.15.179:6800/3819177669,v1:172.21.15.179:6801/3819177669] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f16e0076000 con 0x7f16e0073540 2023-07-14T11:13:21.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.628+0000 7f1701b9b700 1 --2- 172.21.15.84:0/631339036 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f16e006ad10 0x7f16e006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:21.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.629+0000 7f16ee7fc700 1 -- 172.21.15.84:0/631339036 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f16f8004b80 con 0x7f16fc16bef0 2023-07-14T11:13:21.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.629+0000 7f1701b9b700 1 --2- 172.21.15.84:0/631339036 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f16e006ad10 0x7f16e006d1c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f16f000afd0 tx=0x7f16f000e040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:21.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.627+0000 7f3d6adff700 1 -- start start 2023-07-14T11:13:21.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.629+0000 7f3d6adff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d4c005200 0x7f3d640b3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:21.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.629+0000 7f3d6adff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d64160270 0x7f3d640b3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:21.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.629+0000 7f3d6adff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d640c6750 0x7f3d640c6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:21.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.629+0000 7f3d6adff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d640c7510 con 0x7f3d4c005200 2023-07-14T11:13:21.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.629+0000 7f3d6adff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d64149500 con 0x7f3d64160270 2023-07-14T11:13:21.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.629+0000 7f3d6adff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d641497e0 con 0x7f3d640c6750 2023-07-14T11:13:21.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.627+0000 7fa36f7fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa370160d50 0x7fa3701526b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:21.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.627+0000 7fa36e7fc700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3700cd940 0x7fa3700b18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:21.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.627+0000 7fa36e7fc700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3700cd940 0x7fa3700b18f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.84:36000/0 (socket says 172.21.15.84:36000) 2023-07-14T11:13:21.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.627+0000 7fa36e7fc700 1 -- 172.21.15.84:0/3927609251 learned_addr learned my addr 172.21.15.84:0/3927609251 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:21.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.627+0000 7fa36effd700 1 --2- 172.21.15.84:0/3927609251 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa37006cd60 0x7fa37015c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:21.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.627+0000 7fa36e7fc700 1 -- 172.21.15.84:0/3927609251 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa370160d50 msgr2=0x7fa3701526b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:21.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.627+0000 7fa36e7fc700 1 --2- 172.21.15.84:0/3927609251 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa370160d50 0x7fa3701526b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:21.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.627+0000 7fa36e7fc700 1 -- 172.21.15.84:0/3927609251 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa37006cd60 msgr2=0x7fa37015c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:21.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.627+0000 7fa36e7fc700 1 --2- 172.21.15.84:0/3927609251 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa37006cd60 0x7fa37015c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:21.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.627+0000 7fa36e7fc700 1 -- 172.21.15.84:0/3927609251 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa360009550 con 0x7fa3700cd940 2023-07-14T11:13:21.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.628+0000 7fa36e7fc700 1 --2- 172.21.15.84:0/3927609251 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3700cd940 0x7fa3700b18f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa360004000 tx=0x7fa360004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:21.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.629+0000 7fa3577fe700 1 -- 172.21.15.84:0/3927609251 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa360011630 con 0x7fa3700cd940 2023-07-14T11:13:21.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.629+0000 7fa3577fe700 1 -- 172.21.15.84:0/3927609251 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa360011790 con 0x7fa3700cd940 2023-07-14T11:13:21.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.629+0000 7fa3577fe700 1 -- 172.21.15.84:0/3927609251 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa360011b00 con 0x7fa3700cd940 2023-07-14T11:13:21.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.627+0000 7f09a11ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f099c0cab10 0x7f099c1568d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:21.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.627+0000 7f09a11ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f099c0cb360 0x7f099c1560d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:21.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.627+0000 7f09a11ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f099c157700 0x7f099c15c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:21.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.627+0000 7f09a11ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f099c0b2660 con 0x7f099c157700 2023-07-14T11:13:21.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.627+0000 7f09a11ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f099c0c3000 con 0x7f099c0cab10 2023-07-14T11:13:21.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.627+0000 7f09a11ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f099c0c3270 con 0x7f099c0cb360 2023-07-14T11:13:21.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.627+0000 7f099a59c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f099c0cb360 0x7f099c1560d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:21.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.627+0000 7f099a59c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f099c0cb360 0x7f099c1560d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.84:36002/0 (socket says 172.21.15.84:36002) 2023-07-14T11:13:21.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.628+0000 7f099a59c700 1 -- 172.21.15.84:0/348720221 learned_addr learned my addr 172.21.15.84:0/348720221 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:21.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.628+0000 7f099ad9d700 1 --2- 172.21.15.84:0/348720221 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f099c0cab10 0x7f099c1568d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:21.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.628+0000 7f099b59e700 1 --2- 172.21.15.84:0/348720221 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f099c157700 0x7f099c15c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:21.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.629+0000 7f099ad9d700 1 -- 172.21.15.84:0/348720221 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f099c0cb360 msgr2=0x7f099c1560d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:21.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.629+0000 7f099ad9d700 1 --2- 172.21.15.84:0/348720221 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f099c0cb360 0x7f099c1560d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:21.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.629+0000 7f099ad9d700 1 -- 172.21.15.84:0/348720221 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f099c157700 msgr2=0x7f099c15c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:21.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.629+0000 7f099ad9d700 1 --2- 172.21.15.84:0/348720221 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f099c157700 0x7f099c15c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:21.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.629+0000 7f099ad9d700 1 -- 172.21.15.84:0/348720221 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f098c0094a0 con 0x7f099c0cab10 2023-07-14T11:13:21.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.628+0000 7f0ef0ff9700 1 -- 172.21.15.84:0/2742419612 <== osd.3 v2:172.21.15.84:6816/3292558976 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f0ed4006bc0 con 0x7f0ed40015e0 2023-07-14T11:13:21.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.630+0000 7f099ad9d700 1 --2- 172.21.15.84:0/348720221 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f099c0cab10 0x7f099c1568d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f098c015000 tx=0x7f098c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:21.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.630+0000 7fa3753ff700 1 -- 172.21.15.84:0/3927609251 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3700c39d0 con 0x7fa3700cd940 2023-07-14T11:13:21.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.630+0000 7fa3753ff700 1 -- 172.21.15.84:0/3927609251 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa370152bf0 con 0x7fa3700cd940 2023-07-14T11:13:21.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.630+0000 7f3d68b9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d4c005200 0x7f3d640b3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:21.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.630+0000 7f3d68b9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d4c005200 0x7f3d640b3900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34094/0 (socket says 172.21.15.84:34094) 2023-07-14T11:13:21.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.630+0000 7f3d68b9b700 1 -- 172.21.15.84:0/2076755739 learned_addr learned my addr 172.21.15.84:0/2076755739 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:21.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.630+0000 7f3d63fff700 1 --2- 172.21.15.84:0/2076755739 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d64160270 0x7f3d640b3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:21.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.630+0000 7f3d6939c700 1 --2- 172.21.15.84:0/2076755739 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d640c6750 0x7f3d640c6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:21.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.630+0000 7f09837fe700 1 -- 172.21.15.84:0/348720221 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098c003e60 con 0x7f099c0cab10 2023-07-14T11:13:21.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.630+0000 7f09837fe700 1 -- 172.21.15.84:0/348720221 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f098c01e070 con 0x7f099c0cab10 2023-07-14T11:13:21.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.630+0000 7f09837fe700 1 -- 172.21.15.84:0/348720221 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098c011850 con 0x7f099c0cab10 2023-07-14T11:13:21.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.630+0000 7f09a11ff700 1 -- 172.21.15.84:0/348720221 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f099c0c3550 con 0x7f099c0cab10 2023-07-14T11:13:21.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.631+0000 7f09a11ff700 1 -- 172.21.15.84:0/348720221 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f099c0c2b40 con 0x7f099c0cab10 2023-07-14T11:13:21.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.631+0000 7f3d63fff700 1 -- 172.21.15.84:0/2076755739 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d640c6750 msgr2=0x7f3d640c6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:21.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.631+0000 7f3d63fff700 1 --2- 172.21.15.84:0/2076755739 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d640c6750 0x7f3d640c6bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:21.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.631+0000 7f3d63fff700 1 -- 172.21.15.84:0/2076755739 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d4c005200 msgr2=0x7f3d640b3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:21.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.631+0000 7f3d63fff700 1 --2- 172.21.15.84:0/2076755739 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d4c005200 0x7f3d640b3900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:21.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.631+0000 7f3d63fff700 1 -- 172.21.15.84:0/2076755739 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d64149ac0 con 0x7f3d64160270 2023-07-14T11:13:21.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.632+0000 7f170239c700 1 --2- 172.21.15.84:0/631339036 >> [v2:172.21.15.179:6800/3819177669,v1:172.21.15.179:6801/3819177669] conn(0x7f16e0073540 0x7f16e0075950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:21.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.632+0000 7f09a11ff700 1 -- 172.21.15.84:0/348720221 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f099c06c180 con 0x7f099c0cab10 2023-07-14T11:13:21.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.632+0000 7fa3753ff700 1 -- 172.21.15.84:0/3927609251 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa370161fa0 con 0x7fa3700cd940 2023-07-14T11:13:21.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.632+0000 7f3d63fff700 1 --2- 172.21.15.84:0/2076755739 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d64160270 0x7f3d640b3e40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3d58007fd0 tx=0x7f3d5800f820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:21.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.632+0000 7f3d617fa700 1 -- 172.21.15.84:0/2076755739 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d5800fea0 con 0x7f3d64160270 2023-07-14T11:13:21.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.632+0000 7f3d617fa700 1 -- 172.21.15.84:0/2076755739 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d580052e0 con 0x7f3d64160270 2023-07-14T11:13:21.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.632+0000 7f3d617fa700 1 -- 172.21.15.84:0/2076755739 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d58003680 con 0x7f3d64160270 2023-07-14T11:13:21.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.633+0000 7f3d6adff700 1 -- 172.21.15.84:0/2076755739 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d64149da0 con 0x7f3d64160270 2023-07-14T11:13:21.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.633+0000 7f3d6adff700 1 -- 172.21.15.84:0/2076755739 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d641625f0 con 0x7f3d64160270 2023-07-14T11:13:21.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.634+0000 7f09837fe700 1 -- 172.21.15.84:0/348720221 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f098c0119b0 con 0x7f099c0cab10 2023-07-14T11:13:21.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.635+0000 7f3d6adff700 1 -- 172.21.15.84:0/2076755739 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3d640ccaf0 con 0x7f3d64160270 2023-07-14T11:13:21.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.635+0000 7f170239c700 1 --2- 172.21.15.84:0/631339036 >> [v2:172.21.15.179:6800/3819177669,v1:172.21.15.179:6801/3819177669] conn(0x7f16e0073540 0x7f16e0075950 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:21.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.636+0000 7f09837fe700 1 --2- 172.21.15.84:0/348720221 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f098806adb0 0x7f098806d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:21.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.636+0000 7f09837fe700 1 -- 172.21.15.84:0/348720221 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f098c08aa10 con 0x7f099c0cab10 2023-07-14T11:13:21.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.634+0000 7fa3577fe700 1 -- 172.21.15.84:0/3927609251 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa360021070 con 0x7fa3700cd940 2023-07-14T11:13:21.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.635+0000 7fa3577fe700 1 --2- 172.21.15.84:0/3927609251 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa35c06adb0 0x7fa35c06d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:21.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.635+0000 7fa3577fe700 1 -- 172.21.15.84:0/3927609251 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa36008a990 con 0x7fa3700cd940 2023-07-14T11:13:21.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.636+0000 7fa3577fe700 1 --2- 172.21.15.84:0/3927609251 >> [v2:172.21.15.179:6808/174345035,v1:172.21.15.179:6809/174345035] conn(0x7fa35c073660 0x7fa35c075a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:21.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.636+0000 7fa3577fe700 1 -- 172.21.15.84:0/3927609251 --> [v2:172.21.15.179:6808/174345035,v1:172.21.15.179:6809/174345035] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa35c076120 con 0x7fa35c073660 2023-07-14T11:13:21.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.636+0000 7fa3577fe700 1 -- 172.21.15.84:0/3927609251 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa36008f2a0 con 0x7fa3700cd940 2023-07-14T11:13:21.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.636+0000 7f09837fe700 1 --2- 172.21.15.84:0/348720221 >> [v2:172.21.15.179:6821/2934497681,v1:172.21.15.179:6823/2934497681] conn(0x7f0988073660 0x7f0988075a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:21.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.636+0000 7f09837fe700 1 -- 172.21.15.84:0/348720221 --> [v2:172.21.15.179:6821/2934497681,v1:172.21.15.179:6823/2934497681] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0988076120 con 0x7f0988073660 2023-07-14T11:13:21.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.636+0000 7f09837fe700 1 -- 172.21.15.84:0/348720221 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f098c08adc0 con 0x7f099c0cab10 2023-07-14T11:13:21.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.637+0000 7f16ee7fc700 1 -- 172.21.15.84:0/631339036 <== osd.4 v2:172.21.15.179:6800/3819177669 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f16e0076000 con 0x7f16e0073540 2023-07-14T11:13:21.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.636+0000 7fa36effd700 1 --2- 172.21.15.84:0/3927609251 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa35c06adb0 0x7fa35c06d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:21.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.637+0000 7fa36f7fe700 1 --2- 172.21.15.84:0/3927609251 >> [v2:172.21.15.179:6808/174345035,v1:172.21.15.179:6809/174345035] conn(0x7fa35c073660 0x7fa35c075a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:21.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.638+0000 7fa36effd700 1 --2- 172.21.15.84:0/3927609251 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa35c06adb0 0x7fa35c06d260 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa368009f60 tx=0x7fa3680094f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:21.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.637+0000 7f099a59c700 1 --2- 172.21.15.84:0/348720221 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f098806adb0 0x7f098806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:21.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.638+0000 7f099a59c700 1 --2- 172.21.15.84:0/348720221 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f098806adb0 0x7f098806d260 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0990009ca0 tx=0x7f0990009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:21.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.638+0000 7f099b59e700 1 --2- 172.21.15.84:0/348720221 >> [v2:172.21.15.179:6821/2934497681,v1:172.21.15.179:6823/2934497681] conn(0x7f0988073660 0x7f0988075a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:21.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.637+0000 7f3d617fa700 1 -- 172.21.15.84:0/2076755739 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3d580037e0 con 0x7f3d64160270 2023-07-14T11:13:21.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.639+0000 7f3d617fa700 1 --2- 172.21.15.84:0/2076755739 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f3d5006adb0 0x7f3d5006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:21.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.639+0000 7f3d617fa700 1 -- 172.21.15.84:0/2076755739 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3d58089340 con 0x7f3d64160270 2023-07-14T11:13:21.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.639+0000 7f3d617fa700 1 --2- 172.21.15.84:0/2076755739 >> [v2:172.21.15.179:6816/446039797,v1:172.21.15.179:6817/446039797] conn(0x7f3d50073660 0x7f3d50075a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:21.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.639+0000 7f3d617fa700 1 -- 172.21.15.84:0/2076755739 --> [v2:172.21.15.179:6816/446039797,v1:172.21.15.179:6817/446039797] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3d50076120 con 0x7f3d50073660 2023-07-14T11:13:21.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.639+0000 7f3d617fa700 1 -- 172.21.15.84:0/2076755739 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3d580896f0 con 0x7f3d64160270 2023-07-14T11:13:21.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.639+0000 7f3d68b9b700 1 --2- 172.21.15.84:0/2076755739 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f3d5006adb0 0x7f3d5006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:21.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.640+0000 7f3d6939c700 1 --2- 172.21.15.84:0/2076755739 >> [v2:172.21.15.179:6816/446039797,v1:172.21.15.179:6817/446039797] conn(0x7f3d50073660 0x7f3d50075a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:21.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.640+0000 7f099b59e700 1 --2- 172.21.15.84:0/348720221 >> [v2:172.21.15.179:6821/2934497681,v1:172.21.15.179:6823/2934497681] conn(0x7f0988073660 0x7f0988075a70 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:21.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.640+0000 7f3d68b9b700 1 --2- 172.21.15.84:0/2076755739 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f3d5006adb0 0x7f3d5006d260 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3d540017a0 tx=0x7f3d54007040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:21.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.641+0000 7fa36f7fe700 1 --2- 172.21.15.84:0/3927609251 >> [v2:172.21.15.179:6808/174345035,v1:172.21.15.179:6809/174345035] conn(0x7fa35c073660 0x7fa35c075a70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:21.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.641+0000 7f3d6939c700 1 --2- 172.21.15.84:0/2076755739 >> [v2:172.21.15.179:6816/446039797,v1:172.21.15.179:6817/446039797] conn(0x7f3d50073660 0x7f3d50075a70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:21.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.641+0000 7f09837fe700 1 -- 172.21.15.84:0/348720221 <== osd.7 v2:172.21.15.179:6821/2934497681 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f0988076120 con 0x7f0988073660 2023-07-14T11:13:21.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.643+0000 7f3d617fa700 1 -- 172.21.15.84:0/2076755739 <== osd.5 v2:172.21.15.179:6816/446039797 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f3d50076120 con 0x7f3d50073660 2023-07-14T11:13:21.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.643+0000 7fa3577fe700 1 -- 172.21.15.84:0/3927609251 <== osd.6 v2:172.21.15.179:6808/174345035 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fa35c076120 con 0x7fa35c073660 2023-07-14T11:13:21.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.651+0000 7f3a6d5ff700 1 -- 172.21.15.84:0/3380876352 --> [v2:172.21.15.84:6824/1060220522,v1:172.21.15.84:6825/1060220522] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3a6806bf70 con 0x7f3a54073660 2023-07-14T11:13:21.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.653+0000 7f3a4f7fe700 1 -- 172.21.15.84:0/3380876352 <== osd.1 v2:172.21.15.84:6824/1060220522 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3a5c010b00 con 0x7f3a54073660 2023-07-14T11:13:21.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.651+0000 7f0efa3ff700 1 -- 172.21.15.84:0/2742419612 --> [v2:172.21.15.84:6816/3292558976,v1:172.21.15.84:6817/3292558976] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0ed4005ca0 con 0x7f0ed40015e0 2023-07-14T11:13:21.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.652+0000 7f0ef0ff9700 1 -- 172.21.15.84:0/2742419612 <== osd.3 v2:172.21.15.84:6816/3292558976 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0ed4005ca0 con 0x7f0ed40015e0 2023-07-14T11:13:21.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.653+0000 7f0efa3ff700 1 -- 172.21.15.84:0/2742419612 >> [v2:172.21.15.84:6816/3292558976,v1:172.21.15.84:6817/3292558976] conn(0x7f0ed40015e0 msgr2=0x7f0ed4003a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:21.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.653+0000 7f0efa3ff700 1 --2- 172.21.15.84:0/2742419612 >> [v2:172.21.15.84:6816/3292558976,v1:172.21.15.84:6817/3292558976] conn(0x7f0ed40015e0 0x7f0ed4003a90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:21.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.654+0000 7f0efa3ff700 1 -- 172.21.15.84:0/2742419612 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f0ee006adb0 msgr2=0x7f0ee006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:21.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.654+0000 7f0efa3ff700 1 --2- 172.21.15.84:0/2742419612 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f0ee006adb0 0x7f0ee006d260 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0ef40c2440 tx=0x7f0ee8008040 comp rx=0 tx=0).stop 2023-07-14T11:13:21.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.654+0000 7f0efa3ff700 1 -- 172.21.15.84:0/2742419612 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ef406b5b0 msgr2=0x7f0ef40b4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:21.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.654+0000 7f0efa3ff700 1 --2- 172.21.15.84:0/2742419612 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ef406b5b0 0x7f0ef40b4200 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0eec00b370 tx=0x7f0eec004ad0 comp rx=0 tx=0).stop 2023-07-14T11:13:21.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.654+0000 7f0ef899c700 1 -- 172.21.15.84:0/2742419612 reap_dead start 2023-07-14T11:13:21.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.654+0000 7f3a6d5ff700 1 -- 172.21.15.84:0/3380876352 >> [v2:172.21.15.84:6824/1060220522,v1:172.21.15.84:6825/1060220522] conn(0x7f3a54073660 msgr2=0x7f3a54075a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:21.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.654+0000 7f3a6d5ff700 1 --2- 172.21.15.84:0/3380876352 >> [v2:172.21.15.84:6824/1060220522,v1:172.21.15.84:6825/1060220522] conn(0x7f3a54073660 0x7f3a54075a70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:21.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.655+0000 7f3a6d5ff700 1 -- 172.21.15.84:0/3380876352 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f3a5406adb0 msgr2=0x7f3a5406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:21.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.655+0000 7f3a6d5ff700 1 --2- 172.21.15.84:0/3380876352 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f3a5406adb0 0x7f3a5406d260 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3a680b3d70 tx=0x7f3a60006310 comp rx=0 tx=0).stop 2023-07-14T11:13:21.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.655+0000 7f3a6d5ff700 1 -- 172.21.15.84:0/3380876352 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a680cdf40 msgr2=0x7f3a680c8840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:21.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.655+0000 7f3a6d5ff700 1 --2- 172.21.15.84:0/3380876352 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a680cdf40 0x7f3a680c8840 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3a5800c450 tx=0x7f3a5800c760 comp rx=0 tx=0).stop 2023-07-14T11:13:21.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.655+0000 7f3a677fe700 1 -- 172.21.15.84:0/3380876352 reap_dead start 2023-07-14T11:13:21.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.655+0000 7f3a6d5ff700 1 -- 172.21.15.84:0/3380876352 shutdown_connections 2023-07-14T11:13:21.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.655+0000 7f3a6d5ff700 1 -- 172.21.15.84:0/3380876352 >> 172.21.15.84:0/3380876352 conn(0x7f3a680b05d0 msgr2=0x7f3a68153940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:21.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.655+0000 7f0efa3ff700 1 -- 172.21.15.84:0/2742419612 shutdown_connections 2023-07-14T11:13:21.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.655+0000 7f0efa3ff700 1 -- 172.21.15.84:0/2742419612 >> 172.21.15.84:0/2742419612 conn(0x7f0ef40b05d0 msgr2=0x7f0ef406f830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:21.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.657+0000 7f3a6d5ff700 1 -- 172.21.15.84:0/3380876352 shutdown_connections 2023-07-14T11:13:21.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.657+0000 7f3a6d5ff700 1 -- 172.21.15.84:0/3380876352 wait complete. 2023-07-14T11:13:21.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.657+0000 7f03377ff700 1 -- 172.21.15.84:0/4028023730 --> [v2:172.21.15.84:6800/3001671542,v1:172.21.15.84:6801/3001671542] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f033006f830 con 0x7f031c073660 2023-07-14T11:13:21.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.658+0000 7f0efa3ff700 1 -- 172.21.15.84:0/2742419612 shutdown_connections 2023-07-14T11:13:21.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.658+0000 7f0efa3ff700 1 -- 172.21.15.84:0/2742419612 wait complete. 2023-07-14T11:13:21.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.661+0000 7f032dffb700 1 -- 172.21.15.84:0/4028023730 <== osd.2 v2:172.21.15.84:6800/3001671542 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0320022040 con 0x7f031c073660 2023-07-14T11:13:21.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.662+0000 7f03377ff700 1 -- 172.21.15.84:0/4028023730 >> [v2:172.21.15.84:6800/3001671542,v1:172.21.15.84:6801/3001671542] conn(0x7f031c073660 msgr2=0x7f031c075a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:21.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.662+0000 7f03377ff700 1 --2- 172.21.15.84:0/4028023730 >> [v2:172.21.15.84:6800/3001671542,v1:172.21.15.84:6801/3001671542] conn(0x7f031c073660 0x7f031c075a70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:21.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.663+0000 7f03377ff700 1 -- 172.21.15.84:0/4028023730 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f031c06adb0 msgr2=0x7f031c06d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:21.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.663+0000 7f03377ff700 1 --2- 172.21.15.84:0/4028023730 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f031c06adb0 0x7f031c06d260 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0328009b00 tx=0x7f0328003a20 comp rx=0 tx=0).stop 2023-07-14T11:13:21.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.663+0000 7f03377ff700 1 -- 172.21.15.84:0/4028023730 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03300b10b0 msgr2=0x7f033015ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:21.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.663+0000 7f03377ff700 1 --2- 172.21.15.84:0/4028023730 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03300b10b0 0x7f033015ac90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f032400c500 tx=0x7f032400c810 comp rx=0 tx=0).stop 2023-07-14T11:13:21.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.663+0000 7f0335d9c700 1 -- 172.21.15.84:0/4028023730 reap_dead start 2023-07-14T11:13:21.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.663+0000 7f0a217ff700 1 -- 172.21.15.84:0/3815650747 --> [v2:172.21.15.84:6808/288822924,v1:172.21.15.84:6809/288822924] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0a1c06c180 con 0x7f0a00073660 2023-07-14T11:13:21.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.663+0000 7f03377ff700 1 -- 172.21.15.84:0/4028023730 shutdown_connections 2023-07-14T11:13:21.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.663+0000 7f03377ff700 1 -- 172.21.15.84:0/4028023730 >> 172.21.15.84:0/4028023730 conn(0x7f03300b05d0 msgr2=0x7f03300b3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:21.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.664+0000 7f03377ff700 1 -- 172.21.15.84:0/4028023730 shutdown_connections 2023-07-14T11:13:21.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.664+0000 7f03377ff700 1 -- 172.21.15.84:0/4028023730 wait complete. 2023-07-14T11:13:21.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.667+0000 7f0a13fff700 1 -- 172.21.15.84:0/3815650747 <== osd.0 v2:172.21.15.84:6808/288822924 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0a1400f040 con 0x7f0a00073660 2023-07-14T11:13:21.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.667+0000 7f1703dff700 1 -- 172.21.15.84:0/631339036 --> [v2:172.21.15.179:6800/3819177669,v1:172.21.15.179:6801/3819177669] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f16fc0c4c10 con 0x7f16e0073540 2023-07-14T11:13:21.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.667+0000 7f09a11ff700 1 -- 172.21.15.84:0/348720221 --> [v2:172.21.15.179:6821/2934497681,v1:172.21.15.179:6823/2934497681] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f099c06bea0 con 0x7f0988073660 2023-07-14T11:13:21.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.668+0000 7f09837fe700 1 -- 172.21.15.84:0/348720221 <== osd.7 v2:172.21.15.179:6821/2934497681 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0994013040 con 0x7f0988073660 2023-07-14T11:13:21.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.668+0000 7f0a217ff700 1 -- 172.21.15.84:0/3815650747 >> [v2:172.21.15.84:6808/288822924,v1:172.21.15.84:6809/288822924] conn(0x7f0a00073660 msgr2=0x7f0a00075a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:21.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.668+0000 7f0a217ff700 1 --2- 172.21.15.84:0/3815650747 >> [v2:172.21.15.84:6808/288822924,v1:172.21.15.84:6809/288822924] conn(0x7f0a00073660 0x7f0a00075a70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:21.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.669+0000 7f0a217ff700 1 -- 172.21.15.84:0/3815650747 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f0a0006adb0 msgr2=0x7f0a0006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:21.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.669+0000 7f0a217ff700 1 --2- 172.21.15.84:0/3815650747 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f0a0006adb0 0x7f0a0006d260 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c0b49c0 tx=0x7f0a04008040 comp rx=0 tx=0).stop 2023-07-14T11:13:21.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.669+0000 7f0a217ff700 1 -- 172.21.15.84:0/3815650747 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a1c0cab10 msgr2=0x7f0a1c15c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:21.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.669+0000 7f0a217ff700 1 --2- 172.21.15.84:0/3815650747 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a1c0cab10 0x7f0a1c15c6b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c000c00 tx=0x7f0a0c004750 comp rx=0 tx=0).stop 2023-07-14T11:13:21.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.669+0000 7f0a1b7fe700 1 -- 172.21.15.84:0/3815650747 reap_dead start 2023-07-14T11:13:21.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.669+0000 7f0a217ff700 1 -- 172.21.15.84:0/3815650747 shutdown_connections 2023-07-14T11:13:21.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.669+0000 7f0a217ff700 1 -- 172.21.15.84:0/3815650747 >> 172.21.15.84:0/3815650747 conn(0x7f0a1c0b05d0 msgr2=0x7f0a1c0714d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:21.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.669+0000 7f16ee7fc700 1 -- 172.21.15.84:0/631339036 <== osd.4 v2:172.21.15.179:6800/3819177669 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f16fc0c4c10 con 0x7f16e0073540 2023-07-14T11:13:21.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.670+0000 7f09a11ff700 1 -- 172.21.15.84:0/348720221 >> [v2:172.21.15.179:6821/2934497681,v1:172.21.15.179:6823/2934497681] conn(0x7f0988073660 msgr2=0x7f0988075a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:21.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.670+0000 7f09a11ff700 1 --2- 172.21.15.84:0/348720221 >> [v2:172.21.15.179:6821/2934497681,v1:172.21.15.179:6823/2934497681] conn(0x7f0988073660 0x7f0988075a70 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:21.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.670+0000 7f09a11ff700 1 -- 172.21.15.84:0/348720221 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f098806adb0 msgr2=0x7f098806d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:21.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.670+0000 7f09a11ff700 1 --2- 172.21.15.84:0/348720221 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f098806adb0 0x7f098806d260 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0990009ca0 tx=0x7f0990009210 comp rx=0 tx=0).stop 2023-07-14T11:13:21.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.670+0000 7f09a11ff700 1 -- 172.21.15.84:0/348720221 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f099c0cab10 msgr2=0x7f099c1568d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:21.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.670+0000 7f09a11ff700 1 --2- 172.21.15.84:0/348720221 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f099c0cab10 0x7f099c1568d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f098c015000 tx=0x7f098c004750 comp rx=0 tx=0).stop 2023-07-14T11:13:21.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.670+0000 7f099b59e700 1 -- 172.21.15.84:0/348720221 reap_dead start 2023-07-14T11:13:21.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.670+0000 7f1703dff700 1 -- 172.21.15.84:0/631339036 >> [v2:172.21.15.179:6800/3819177669,v1:172.21.15.179:6801/3819177669] conn(0x7f16e0073540 msgr2=0x7f16e0075950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:21.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.670+0000 7f1703dff700 1 --2- 172.21.15.84:0/631339036 >> [v2:172.21.15.179:6800/3819177669,v1:172.21.15.179:6801/3819177669] conn(0x7f16e0073540 0x7f16e0075950 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:21.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.670+0000 7f1703dff700 1 -- 172.21.15.84:0/631339036 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f16e006ad10 msgr2=0x7f16e006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:21.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.671+0000 7f1703dff700 1 --2- 172.21.15.84:0/631339036 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f16e006ad10 0x7f16e006d1c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f16f000afd0 tx=0x7f16f000e040 comp rx=0 tx=0).stop 2023-07-14T11:13:21.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.671+0000 7f1703dff700 1 -- 172.21.15.84:0/631339036 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16fc16bef0 msgr2=0x7f16fc0c44f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:21.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.671+0000 7f1703dff700 1 --2- 172.21.15.84:0/631339036 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16fc16bef0 0x7f16fc0c44f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f16f800c390 tx=0x7f16f800c6a0 comp rx=0 tx=0).stop 2023-07-14T11:13:21.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.670+0000 7f09a11ff700 1 -- 172.21.15.84:0/348720221 shutdown_connections 2023-07-14T11:13:21.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.670+0000 7f09a11ff700 1 -- 172.21.15.84:0/348720221 >> 172.21.15.84:0/348720221 conn(0x7f099c0b05d0 msgr2=0x7f099c0cf050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:21.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.671+0000 7f170239c700 1 -- 172.21.15.84:0/631339036 reap_dead start 2023-07-14T11:13:21.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.671+0000 7f1703dff700 1 -- 172.21.15.84:0/631339036 shutdown_connections 2023-07-14T11:13:21.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.671+0000 7f1703dff700 1 -- 172.21.15.84:0/631339036 >> 172.21.15.84:0/631339036 conn(0x7f16fc0b05d0 msgr2=0x7f16fc0b18f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:21.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.671+0000 7f0a217ff700 1 -- 172.21.15.84:0/3815650747 shutdown_connections 2023-07-14T11:13:21.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.671+0000 7f0a217ff700 1 -- 172.21.15.84:0/3815650747 wait complete. 2023-07-14T11:13:21.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.674+0000 7f09a11ff700 1 -- 172.21.15.84:0/348720221 shutdown_connections 2023-07-14T11:13:21.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.674+0000 7f09a11ff700 1 -- 172.21.15.84:0/348720221 wait complete. 2023-07-14T11:13:21.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.674+0000 7f1703dff700 1 -- 172.21.15.84:0/631339036 shutdown_connections 2023-07-14T11:13:21.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.675+0000 7f1703dff700 1 -- 172.21.15.84:0/631339036 wait complete. 2023-07-14T11:13:21.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.677+0000 7f3d6adff700 1 -- 172.21.15.84:0/2076755739 --> [v2:172.21.15.179:6816/446039797,v1:172.21.15.179:6817/446039797] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3d640cc810 con 0x7f3d50073660 2023-07-14T11:13:21.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.678+0000 7f3d617fa700 1 -- 172.21.15.84:0/2076755739 <== osd.5 v2:172.21.15.179:6816/446039797 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3d5c003b80 con 0x7f3d50073660 2023-07-14T11:13:21.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.679+0000 7f3d6adff700 1 -- 172.21.15.84:0/2076755739 >> [v2:172.21.15.179:6816/446039797,v1:172.21.15.179:6817/446039797] conn(0x7f3d50073660 msgr2=0x7f3d50075a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:21.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.679+0000 7f3d6adff700 1 --2- 172.21.15.84:0/2076755739 >> [v2:172.21.15.179:6816/446039797,v1:172.21.15.179:6817/446039797] conn(0x7f3d50073660 0x7f3d50075a70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:21.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.679+0000 7f3d6adff700 1 -- 172.21.15.84:0/2076755739 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f3d5006adb0 msgr2=0x7f3d5006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:21.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.679+0000 7f3d6adff700 1 --2- 172.21.15.84:0/2076755739 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f3d5006adb0 0x7f3d5006d260 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3d540017a0 tx=0x7f3d54007040 comp rx=0 tx=0).stop 2023-07-14T11:13:21.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.679+0000 7f3d6adff700 1 -- 172.21.15.84:0/2076755739 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d64160270 msgr2=0x7f3d640b3e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:21.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.679+0000 7f3d6adff700 1 --2- 172.21.15.84:0/2076755739 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d64160270 0x7f3d640b3e40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3d58007fd0 tx=0x7f3d5800f820 comp rx=0 tx=0).stop 2023-07-14T11:13:21.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.679+0000 7f3d6939c700 1 -- 172.21.15.84:0/2076755739 reap_dead start 2023-07-14T11:13:21.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.680+0000 7f3d6adff700 1 -- 172.21.15.84:0/2076755739 shutdown_connections 2023-07-14T11:13:21.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.680+0000 7f3d6adff700 1 -- 172.21.15.84:0/2076755739 >> 172.21.15.84:0/2076755739 conn(0x7f3d640b05d0 msgr2=0x7f3d640aea80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:21.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.680+0000 7f3d6adff700 1 -- 172.21.15.84:0/2076755739 shutdown_connections 2023-07-14T11:13:21.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.680+0000 7f3d6adff700 1 -- 172.21.15.84:0/2076755739 wait complete. 2023-07-14T11:13:21.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.680+0000 7fa3753ff700 1 -- 172.21.15.84:0/3927609251 --> [v2:172.21.15.179:6808/174345035,v1:172.21.15.179:6809/174345035] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa370161260 con 0x7fa35c073660 2023-07-14T11:13:21.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.681+0000 7fa3577fe700 1 -- 172.21.15.84:0/3927609251 <== osd.6 v2:172.21.15.179:6808/174345035 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa364009480 con 0x7fa35c073660 2023-07-14T11:13:21.719 INFO:teuthology.orchestra.run.smithi084.stdout:55834574854 2023-07-14T11:13:21.719 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-07-14T11:13:21.720 INFO:teuthology.orchestra.run.smithi084.stdout:55834574856 2023-07-14T11:13:21.720 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-07-14T11:13:21.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.690+0000 7fa3753ff700 1 -- 172.21.15.84:0/3927609251 >> [v2:172.21.15.179:6808/174345035,v1:172.21.15.179:6809/174345035] conn(0x7fa35c073660 msgr2=0x7fa35c075a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:21.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.690+0000 7fa3753ff700 1 --2- 172.21.15.84:0/3927609251 >> [v2:172.21.15.179:6808/174345035,v1:172.21.15.179:6809/174345035] conn(0x7fa35c073660 0x7fa35c075a70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:21.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.691+0000 7fa3753ff700 1 -- 172.21.15.84:0/3927609251 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa35c06adb0 msgr2=0x7fa35c06d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:21.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.691+0000 7fa3753ff700 1 --2- 172.21.15.84:0/3927609251 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa35c06adb0 0x7fa35c06d260 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa368009f60 tx=0x7fa3680094f0 comp rx=0 tx=0).stop 2023-07-14T11:13:21.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.691+0000 7fa3753ff700 1 -- 172.21.15.84:0/3927609251 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3700cd940 msgr2=0x7fa3700b18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:21.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.691+0000 7fa3753ff700 1 --2- 172.21.15.84:0/3927609251 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3700cd940 0x7fa3700b18f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa360004000 tx=0x7fa360004750 comp rx=0 tx=0).stop 2023-07-14T11:13:21.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.691+0000 7fa36f7fe700 1 -- 172.21.15.84:0/3927609251 reap_dead start 2023-07-14T11:13:21.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.691+0000 7fa3753ff700 1 -- 172.21.15.84:0/3927609251 shutdown_connections 2023-07-14T11:13:21.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.691+0000 7fa3753ff700 1 -- 172.21.15.84:0/3927609251 >> 172.21.15.84:0/3927609251 conn(0x7fa3700b05d0 msgr2=0x7fa3701621b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:21.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.692+0000 7fa3753ff700 1 -- 172.21.15.84:0/3927609251 shutdown_connections 2023-07-14T11:13:21.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:21.694+0000 7fa3753ff700 1 -- 172.21.15.84:0/3927609251 wait complete. 2023-07-14T11:13:21.723 INFO:teuthology.orchestra.run.smithi084.stdout:55834574854 2023-07-14T11:13:21.723 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-07-14T11:13:21.724 INFO:teuthology.orchestra.run.smithi084.stdout:55834574854 2023-07-14T11:13:21.724 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-07-14T11:13:21.725 INFO:teuthology.orchestra.run.smithi084.stdout:55834574854 2023-07-14T11:13:21.725 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-07-14T11:13:21.726 INFO:teuthology.orchestra.run.smithi084.stdout:55834574856 2023-07-14T11:13:21.727 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-07-14T11:13:21.727 INFO:teuthology.orchestra.run.smithi084.stdout:55834574856 2023-07-14T11:13:21.728 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-07-14T11:13:21.728 INFO:teuthology.orchestra.run.smithi084.stdout:55834574857 2023-07-14T11:13:21.729 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-07-14T11:13:22.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.109+0000 7fea55dff700 1 Processor -- start 2023-07-14T11:13:22.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.110+0000 7fea55dff700 1 -- start start 2023-07-14T11:13:22.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.111+0000 7fc6e21ff700 1 Processor -- start 2023-07-14T11:13:22.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.112+0000 7fc6e21ff700 1 -- start start 2023-07-14T11:13:22.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.112+0000 7fea55dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea500b10b0 0x7fea50158740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:22.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.112+0000 7fea55dff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fea500ce650 0x7fea500caff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:22.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.112+0000 7fea55dff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea500cab60 con 0x7fea5006b5b0 2023-07-14T11:13:22.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.112+0000 7fea55dff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea50158c80 con 0x7fea500ce650 2023-07-14T11:13:22.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.112+0000 7fea55dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea5006bf70 con 0x7fea500b10b0 2023-07-14T11:13:22.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.113+0000 7fea4effd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fea5006b5b0 0x7fea500cdf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:37698/0 (socket says 172.21.15.84:37698) 2023-07-14T11:13:22.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.113+0000 7fea4effd700 1 -- 172.21.15.84:0/2295924264 learned_addr learned my addr 172.21.15.84:0/2295924264 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:13:22.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.114+0000 7fc6e21ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc6dc06c990 0x7fc6dc0adaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:22.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.114+0000 7fc6e21ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6dc06c1c0 0x7fc6dc0cb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:22.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.114+0000 7fc6e21ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6dc0cb2c0 con 0x7fc6dc06d920 2023-07-14T11:13:22.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.114+0000 7fc6e21ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6dc0ae030 con 0x7fc6dc06c990 2023-07-14T11:13:22.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.114+0000 7fc6e21ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6dc06b6e0 con 0x7fc6dc06c1c0 2023-07-14T11:13:22.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.114+0000 7fea4e7fc700 1 -- 172.21.15.84:0/2295924264 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1671544813 0 0) 0x7fea500cab60 con 0x7fea5006b5b0 2023-07-14T11:13:22.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.114+0000 7fea4e7fc700 1 -- 172.21.15.84:0/2295924264 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea380035b0 con 0x7fea5006b5b0 2023-07-14T11:13:22.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.114+0000 7fea4e7fc700 1 -- 172.21.15.84:0/2295924264 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4023505153 0 0) 0x7fea380035b0 con 0x7fea5006b5b0 2023-07-14T11:13:22.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.114+0000 7fea4e7fc700 1 -- 172.21.15.84:0/2295924264 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea500b10b0 msgr2=0x7fea50158740 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-14T11:13:22.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.114+0000 7fea4e7fc700 1 --2- 172.21.15.84:0/2295924264 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea500b10b0 0x7fea50158740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.114+0000 7fea4e7fc700 1 -- 172.21.15.84:0/2295924264 >> v2:172.21.15.179:3300/0 conn(0x7fea500ce650 msgr2=0x7fea500caff0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T11:13:22.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.114+0000 7fea4e7fc700 1 --2- 172.21.15.84:0/2295924264 >> v2:172.21.15.179:3300/0 conn(0x7fea500ce650 0x7fea500caff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.114+0000 7fea4e7fc700 1 -- 172.21.15.84:0/2295924264 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea5006c250 con 0x7fea5006b5b0 2023-07-14T11:13:22.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.115+0000 7fea4e7fc700 1 -- 172.21.15.84:0/2295924264 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7fea44001670 con 0x7fea5006b5b0 2023-07-14T11:13:22.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.115+0000 7fea4e7fc700 1 -- 172.21.15.84:0/2295924264 >> v1:172.21.15.84:6789/0 conn(0x7fea5006b5b0 legacy=0x7fea500cdf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:22.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.115+0000 7fea4e7fc700 1 --2- 172.21.15.84:0/2295924264 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea38003a00 0x7fea38003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:22.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.115+0000 7fea4e7fc700 1 --2- 172.21.15.84:0/2295924264 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea38004850 0x7fea38004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:22.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.115+0000 7fea4e7fc700 1 --2- 172.21.15.84:0/2295924264 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea38005250 0x7fea3800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:22.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.115+0000 7fea4e7fc700 1 -- 172.21.15.84:0/2295924264 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea50158c80 con 0x7fea38004850 2023-07-14T11:13:22.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.115+0000 7fea4e7fc700 1 -- 172.21.15.84:0/2295924264 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea5006bf70 con 0x7fea38005250 2023-07-14T11:13:22.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.115+0000 7fea4e7fc700 1 -- 172.21.15.84:0/2295924264 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea3800c1a0 con 0x7fea38003a00 2023-07-14T11:13:22.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.116+0000 7fc6daffd700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fc6dc06d920 0x7fc6dc0ca5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.84:50250/0 (socket says 172.21.15.84:50250) 2023-07-14T11:13:22.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.116+0000 7fc6daffd700 1 -- 172.21.15.84:0/3044153902 learned_addr learned my addr 172.21.15.84:0/3044153902 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:13:22.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.116+0000 7fea4effd700 1 --2- 172.21.15.84:0/2295924264 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea38004850 0x7fea38004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:22.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.116+0000 7fc6dbfff700 1 --2- 172.21.15.84:0/3044153902 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6dc06c1c0 0x7fc6dc0cb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:22.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.116+0000 7fea4effd700 1 -- 172.21.15.84:0/2295924264 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea38003a00 msgr2=0x7fea38003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:22.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.116+0000 7fea4f7fe700 1 --2- 172.21.15.84:0/2295924264 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea38003a00 0x7fea38003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:22.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.117+0000 7fea4effd700 1 --2- 172.21.15.84:0/2295924264 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea38003a00 0x7fea38003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.117+0000 7fea4effd700 1 -- 172.21.15.84:0/2295924264 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea38005250 msgr2=0x7fea3800ba10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-14T11:13:22.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.117+0000 7fea4effd700 1 --2- 172.21.15.84:0/2295924264 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea38005250 0x7fea3800ba10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.117+0000 7fea4effd700 1 -- 172.21.15.84:0/2295924264 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea5006c250 con 0x7fea38004850 2023-07-14T11:13:22.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.117+0000 7fea4f7fe700 1 --2- 172.21.15.84:0/2295924264 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea38003a00 0x7fea38003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:13:22.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.117+0000 7fc6dbfff700 1 -- 172.21.15.84:0/3044153902 >> v2:172.21.15.84:3300/0 conn(0x7fc6dc06c990 msgr2=0x7fc6dc0adaf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-14T11:13:22.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.117+0000 7fc6dbfff700 1 --2- 172.21.15.84:0/3044153902 >> v2:172.21.15.84:3300/0 conn(0x7fc6dc06c990 0x7fc6dc0adaf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.117+0000 7fc6dbfff700 1 -- 172.21.15.84:0/3044153902 >> v1:172.21.15.179:6789/0 conn(0x7fc6dc06d920 legacy=0x7fc6dc0ca5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:22.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.117+0000 7fc6dbfff700 1 -- 172.21.15.84:0/3044153902 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6dc06b9c0 con 0x7fc6dc06c1c0 2023-07-14T11:13:22.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.117+0000 7fea4effd700 1 --2- 172.21.15.84:0/2295924264 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea38004850 0x7fea38004cc0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fea5006d720 tx=0x7fea38005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53220c907446ef24 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:22.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.118+0000 7fea4e7fc700 1 -- 172.21.15.84:0/2295924264 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4400ce30 con 0x7fea38004850 2023-07-14T11:13:22.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.118+0000 7fc6dbfff700 1 --2- 172.21.15.84:0/3044153902 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6dc06c1c0 0x7fc6dc0cb4d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc6d0009840 tx=0x7fc6d0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=580e3c5fbd03f4ac server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:22.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.118+0000 7fea4e7fc700 1 -- 172.21.15.84:0/2295924264 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea44005960 con 0x7fea38004850 2023-07-14T11:13:22.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.118+0000 7fea4e7fc700 1 -- 172.21.15.84:0/2295924264 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea44005d10 con 0x7fea38004850 2023-07-14T11:13:22.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.119+0000 7fc6da7fc700 1 -- 172.21.15.84:0/3044153902 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d0011830 con 0x7fc6dc06c1c0 2023-07-14T11:13:22.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.120+0000 7fc6da7fc700 1 -- 172.21.15.84:0/3044153902 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6d0011990 con 0x7fc6dc06c1c0 2023-07-14T11:13:22.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.120+0000 7fc6da7fc700 1 -- 172.21.15.84:0/3044153902 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d0011d20 con 0x7fc6dc06c1c0 2023-07-14T11:13:22.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.119+0000 7fea55dff700 1 -- 172.21.15.84:0/2295924264 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea38004850 msgr2=0x7fea38004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:22.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.119+0000 7fea55dff700 1 --2- 172.21.15.84:0/2295924264 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea38004850 0x7fea38004cc0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fea5006d720 tx=0x7fea38005880 comp rx=0 tx=0).stop 2023-07-14T11:13:22.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.119+0000 7fea4ffff700 1 -- 172.21.15.84:0/2295924264 reap_dead start 2023-07-14T11:13:22.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.121+0000 7fea55dff700 1 -- 172.21.15.84:0/2295924264 shutdown_connections 2023-07-14T11:13:22.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.121+0000 7fea55dff700 1 -- 172.21.15.84:0/2295924264 >> 172.21.15.84:0/2295924264 conn(0x7fea500b05d0 msgr2=0x7fea500b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:22.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.121+0000 7fc6e21ff700 1 -- 172.21.15.84:0/3044153902 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6dc06c1c0 msgr2=0x7fc6dc0cb4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:22.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.121+0000 7fc6e21ff700 1 --2- 172.21.15.84:0/3044153902 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6dc06c1c0 0x7fc6dc0cb4d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc6d0009840 tx=0x7fc6d0009b50 comp rx=0 tx=0).stop 2023-07-14T11:13:22.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.121+0000 7fc6e21ff700 1 -- 172.21.15.84:0/3044153902 shutdown_connections 2023-07-14T11:13:22.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.121+0000 7fc6e21ff700 1 --2- 172.21.15.84:0/3044153902 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6dc06c1c0 0x7fc6dc0cb4d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.121+0000 7fc6e21ff700 1 --2- 172.21.15.84:0/3044153902 >> v2:172.21.15.84:3300/0 conn(0x7fc6dc06c990 0x7fc6dc0adaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.121+0000 7fc6e21ff700 1 -- 172.21.15.84:0/3044153902 >> 172.21.15.84:0/3044153902 conn(0x7fc6dc0b05d0 msgr2=0x7fc6dc0b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:22.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.121+0000 7fc6e21ff700 1 -- 172.21.15.84:0/3044153902 shutdown_connections 2023-07-14T11:13:22.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.121+0000 7fc6e21ff700 1 -- 172.21.15.84:0/3044153902 wait complete. 2023-07-14T11:13:22.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.122+0000 7fea55dff700 1 -- 172.21.15.84:0/2295924264 shutdown_connections 2023-07-14T11:13:22.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.122+0000 7fea55dff700 1 -- 172.21.15.84:0/2295924264 wait complete. 2023-07-14T11:13:22.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.124+0000 7fc6e21ff700 1 Processor -- start 2023-07-14T11:13:22.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.125+0000 7fc6e21ff700 1 -- start start 2023-07-14T11:13:22.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.126+0000 7fc6e21ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6dc06c1c0 0x7fc6dc158080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:22.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.126+0000 7fc6e21ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6dc06c990 0x7fc6dc0c4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:22.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.126+0000 7fc6e21ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6dc06d920 0x7fc6dc0c5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:22.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.126+0000 7fc6e21ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6dc1681c0 con 0x7fc6dc06c1c0 2023-07-14T11:13:22.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.126+0000 7fc6e21ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6dc1684a0 con 0x7fc6dc06c990 2023-07-14T11:13:22.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.126+0000 7fc6e21ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6dc168780 con 0x7fc6dc06d920 2023-07-14T11:13:22.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.126+0000 7fea55dff700 1 Processor -- start 2023-07-14T11:13:22.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.127+0000 7fc6daffd700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6dc06c990 0x7fc6dc0c4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:22.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.127+0000 7fc6daffd700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6dc06c990 0x7fc6dc0c4ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.84:51862/0 (socket says 172.21.15.84:51862) 2023-07-14T11:13:22.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.127+0000 7fc6daffd700 1 -- 172.21.15.84:0/807291472 learned_addr learned my addr 172.21.15.84:0/807291472 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:22.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.126+0000 7fea55dff700 1 -- start start 2023-07-14T11:13:22.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.128+0000 7fc6daffd700 1 -- 172.21.15.84:0/807291472 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6dc06d920 msgr2=0x7fc6dc0c5010 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-14T11:13:22.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.128+0000 7fc6daffd700 1 --2- 172.21.15.84:0/807291472 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6dc06d920 0x7fc6dc0c5010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.128+0000 7fc6daffd700 1 -- 172.21.15.84:0/807291472 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6dc06c1c0 msgr2=0x7fc6dc158080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:22.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.128+0000 7fc6daffd700 1 --2- 172.21.15.84:0/807291472 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6dc06c1c0 0x7fc6dc158080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.128+0000 7fc6daffd700 1 -- 172.21.15.84:0/807291472 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6d00094a0 con 0x7fc6dc06c990 2023-07-14T11:13:22.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.128+0000 7fea55dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea38004850 0x7fea500b3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:22.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.128+0000 7fea55dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea50149890 0x7fea500c3210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:22.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.128+0000 7fea55dff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea50149d00 0x7fea500c3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:22.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.128+0000 7fea55dff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea5015ab30 con 0x7fea50149d00 2023-07-14T11:13:22.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.128+0000 7fea55dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea5015ae10 con 0x7fea38004850 2023-07-14T11:13:22.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.128+0000 7fea55dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea5015b0f0 con 0x7fea50149890 2023-07-14T11:13:22.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.128+0000 7f13ed9ff700 1 Processor -- start 2023-07-14T11:13:22.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.129+0000 7fc6daffd700 1 --2- 172.21.15.84:0/807291472 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6dc06c990 0x7fc6dc0c4ad0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc6d400cb10 tx=0x7fc6d400ced0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:22.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.129+0000 7fea4f7fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea38004850 0x7fea500b3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:22.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.129+0000 7fea4f7fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea38004850 0x7fea500b3d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.84:51878/0 (socket says 172.21.15.84:51878) 2023-07-14T11:13:22.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.129+0000 7fea4f7fe700 1 -- 172.21.15.84:0/1983106631 learned_addr learned my addr 172.21.15.84:0/1983106631 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:22.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.129+0000 7fea4ffff700 1 --2- 172.21.15.84:0/1983106631 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea50149d00 0x7fea500c3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:22.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.129+0000 7fea4effd700 1 --2- 172.21.15.84:0/1983106631 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea50149890 0x7fea500c3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:22.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.130+0000 7fc6c3fff700 1 -- 172.21.15.84:0/807291472 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d400aac0 con 0x7fc6dc06c990 2023-07-14T11:13:22.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.130+0000 7fc6c3fff700 1 -- 172.21.15.84:0/807291472 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6d400ac20 con 0x7fc6dc06c990 2023-07-14T11:13:22.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.130+0000 7fc6c3fff700 1 -- 172.21.15.84:0/807291472 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d4012400 con 0x7fc6dc06c990 2023-07-14T11:13:22.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.130+0000 7fc6e21ff700 1 -- 172.21.15.84:0/807291472 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6dc168a60 con 0x7fc6dc06c990 2023-07-14T11:13:22.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.130+0000 7fc6e21ff700 1 -- 172.21.15.84:0/807291472 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6dc169020 con 0x7fc6dc06c990 2023-07-14T11:13:22.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.133+0000 7fc6e21ff700 1 -- 172.21.15.84:0/807291472 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6bc0052f0 con 0x7fc6dc06c990 2023-07-14T11:13:22.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.130+0000 7fea4ffff700 1 -- 172.21.15.84:0/1983106631 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea50149890 msgr2=0x7fea500c3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:22.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.130+0000 7fea4ffff700 1 --2- 172.21.15.84:0/1983106631 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea50149890 0x7fea500c3210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.130+0000 7fea4ffff700 1 -- 172.21.15.84:0/1983106631 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea38004850 msgr2=0x7fea500b3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:22.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.130+0000 7fea4ffff700 1 --2- 172.21.15.84:0/1983106631 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea38004850 0x7fea500b3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.130+0000 7fea4ffff700 1 -- 172.21.15.84:0/1983106631 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea5015b3d0 con 0x7fea50149d00 2023-07-14T11:13:22.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.131+0000 7fea4ffff700 1 --2- 172.21.15.84:0/1983106631 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea50149d00 0x7fea500c3750 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fea5015c220 tx=0x7fea4800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:22.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.132+0000 7fea37fff700 1 -- 172.21.15.84:0/1983106631 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4800ca90 con 0x7fea50149d00 2023-07-14T11:13:22.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.132+0000 7fea37fff700 1 -- 172.21.15.84:0/1983106631 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea4800cbf0 con 0x7fea50149d00 2023-07-14T11:13:22.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.132+0000 7fea37fff700 1 -- 172.21.15.84:0/1983106631 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea48015470 con 0x7fea50149d00 2023-07-14T11:13:22.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.129+0000 7f13ed9ff700 1 -- start start 2023-07-14T11:13:22.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.130+0000 7f13ed9ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f13e81587d0 0x7f13e806b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:22.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.131+0000 7f13ed9ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13e80cab60 con 0x7f13e80ce650 2023-07-14T11:13:22.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.131+0000 7f13ed9ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13e8158ba0 con 0x7f13e806baf0 2023-07-14T11:13:22.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.131+0000 7f13ed9ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13e806bf70 con 0x7f13e81587d0 2023-07-14T11:13:22.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.131+0000 7f13e77fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f13e80ce650 0x7f13e80caff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:37712/0 (socket says 172.21.15.84:37712) 2023-07-14T11:13:22.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.131+0000 7f13e77fe700 1 -- 172.21.15.84:0/4027156275 learned_addr learned my addr 172.21.15.84:0/4027156275 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:13:22.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.132+0000 7f13e5ffb700 1 -- 172.21.15.84:0/4027156275 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 353059741 0 0) 0x7f13e80cab60 con 0x7f13e80ce650 2023-07-14T11:13:22.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.132+0000 7f13e5ffb700 1 -- 172.21.15.84:0/4027156275 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13d00035b0 con 0x7f13e80ce650 2023-07-14T11:13:22.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.133+0000 7f13e5ffb700 1 -- 172.21.15.84:0/4027156275 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2146274933 0 0) 0x7f13d00035b0 con 0x7f13e80ce650 2023-07-14T11:13:22.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.133+0000 7f13e5ffb700 1 -- 172.21.15.84:0/4027156275 >> v2:172.21.15.84:3300/0 conn(0x7f13e81587d0 msgr2=0x7f13e806b5b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-14T11:13:22.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.133+0000 7f13e5ffb700 1 --2- 172.21.15.84:0/4027156275 >> v2:172.21.15.84:3300/0 conn(0x7f13e81587d0 0x7f13e806b5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.133+0000 7f13e5ffb700 1 -- 172.21.15.84:0/4027156275 >> v1:172.21.15.179:6789/0 conn(0x7f13e806baf0 legacy=0x7f13e80cdf40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T11:13:22.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.133+0000 7f13e5ffb700 1 -- 172.21.15.84:0/4027156275 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13e806c250 con 0x7f13e80ce650 2023-07-14T11:13:22.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.133+0000 7f13e5ffb700 1 -- 172.21.15.84:0/4027156275 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7f13e00019f0 con 0x7f13e80ce650 2023-07-14T11:13:22.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.133+0000 7f13e5ffb700 1 -- 172.21.15.84:0/4027156275 >> v1:172.21.15.84:6789/0 conn(0x7f13e80ce650 legacy=0x7f13e80caff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:22.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.133+0000 7f13e5ffb700 1 --2- 172.21.15.84:0/4027156275 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13d0003a00 0x7f13d0003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:22.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.133+0000 7f13e5ffb700 1 --2- 172.21.15.84:0/4027156275 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13d0004850 0x7f13d0004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:22.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.133+0000 7f13e5ffb700 1 --2- 172.21.15.84:0/4027156275 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13d0005320 0x7f13d000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:22.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.133+0000 7f13e5ffb700 1 -- 172.21.15.84:0/4027156275 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e806bf70 con 0x7f13d0005320 2023-07-14T11:13:22.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.133+0000 7f13e5ffb700 1 -- 172.21.15.84:0/4027156275 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13d000c000 con 0x7f13d0004850 2023-07-14T11:13:22.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.133+0000 7f13e5ffb700 1 -- 172.21.15.84:0/4027156275 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13d000c1c0 con 0x7f13d0003a00 2023-07-14T11:13:22.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.134+0000 7f13e77fe700 1 --2- 172.21.15.84:0/4027156275 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13d0005320 0x7f13d000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:22.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.134+0000 7f13e6ffd700 1 --2- 172.21.15.84:0/4027156275 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13d0003a00 0x7f13d0003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:22.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.134+0000 7f13e67fc700 1 --2- 172.21.15.84:0/4027156275 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13d0004850 0x7f13d0004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:22.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.134+0000 7fbd115ff700 1 Processor -- start 2023-07-14T11:13:22.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.133+0000 7fc7e51ff700 1 Processor -- start 2023-07-14T11:13:22.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.134+0000 7fc7e51ff700 1 -- start start 2023-07-14T11:13:22.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.134+0000 7f13e77fe700 1 -- 172.21.15.84:0/4027156275 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13d0003a00 msgr2=0x7f13d0003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:22.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.134+0000 7f13e77fe700 1 --2- 172.21.15.84:0/4027156275 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13d0003a00 0x7f13d0003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.134+0000 7f13e77fe700 1 -- 172.21.15.84:0/4027156275 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13d0004850 msgr2=0x7f13d0004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:22.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.134+0000 7f13e77fe700 1 --2- 172.21.15.84:0/4027156275 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13d0004850 0x7f13d0004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.134+0000 7f13e77fe700 1 -- 172.21.15.84:0/4027156275 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13e806c250 con 0x7f13d0005320 2023-07-14T11:13:22.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.135+0000 7f13e77fe700 1 -- 172.21.15.84:0/4027156275 reap_dead start 2023-07-14T11:13:22.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.135+0000 7fea55dff700 1 -- 172.21.15.84:0/1983106631 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea5015b6b0 con 0x7fea50149d00 2023-07-14T11:13:22.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.136+0000 7fea55dff700 1 -- 172.21.15.84:0/1983106631 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea5015a750 con 0x7fea50149d00 2023-07-14T11:13:22.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.135+0000 7f13e77fe700 1 --2- 172.21.15.84:0/4027156275 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13d0005320 0x7f13d000ba10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f13e8071ce0 tx=0x7f13d0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7ffb22be818be3c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:22.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.135+0000 7f13e5ffb700 1 -- 172.21.15.84:0/4027156275 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e000a360 con 0x7f13d0005320 2023-07-14T11:13:22.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.135+0000 7f13e5ffb700 1 -- 172.21.15.84:0/4027156275 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13e0012620 con 0x7f13d0005320 2023-07-14T11:13:22.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.135+0000 7f13e5ffb700 1 -- 172.21.15.84:0/4027156275 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e00129d0 con 0x7f13d0005320 2023-07-14T11:13:22.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.136+0000 7f13ed9ff700 1 -- 172.21.15.84:0/4027156275 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13d0005320 msgr2=0x7f13d000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:22.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.136+0000 7f13ed9ff700 1 --2- 172.21.15.84:0/4027156275 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13d0005320 0x7f13d000ba10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f13e8071ce0 tx=0x7f13d0005880 comp rx=0 tx=0).stop 2023-07-14T11:13:22.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.136+0000 7f13ed9ff700 1 -- 172.21.15.84:0/4027156275 shutdown_connections 2023-07-14T11:13:22.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.136+0000 7f13ed9ff700 1 --2- 172.21.15.84:0/4027156275 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13d0005320 0x7f13d000ba10 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.137+0000 7f13ed9ff700 1 -- 172.21.15.84:0/4027156275 >> 172.21.15.84:0/4027156275 conn(0x7f13e80b05d0 msgr2=0x7f13e80b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:22.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.136+0000 7fc7e51ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc7e00cdbe0 0x7fc7e00ce060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:22.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.136+0000 7fc7e51ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7e00cda00 con 0x7fc7e0164710 2023-07-14T11:13:22.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.136+0000 7fc7e51ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7e0161000 con 0x7fc7e0160c30 2023-07-14T11:13:22.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.136+0000 7fc7e51ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7e00ce5a0 con 0x7fc7e00cdbe0 2023-07-14T11:13:22.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.137+0000 7fc7df59e700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fc7e0164710 0x7fc7e0164b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:37720/0 (socket says 172.21.15.84:37720) 2023-07-14T11:13:22.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.137+0000 7fc7df59e700 1 -- 172.21.15.84:0/3660137060 learned_addr learned my addr 172.21.15.84:0/3660137060 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:13:22.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.137+0000 7fc7ddd9b700 1 -- 172.21.15.84:0/3660137060 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2181203758 0 0) 0x7fc7e00cda00 con 0x7fc7e0164710 2023-07-14T11:13:22.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.137+0000 7fc7ddd9b700 1 -- 172.21.15.84:0/3660137060 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7c80035b0 con 0x7fc7e0164710 2023-07-14T11:13:22.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.134+0000 7fbd115ff700 1 -- start start 2023-07-14T11:13:22.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.136+0000 7fbd115ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbd0c0cdf40 0x7fbd0c0ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:22.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.136+0000 7fbd115ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbd0c0caff0 0x7fbd0c0cb490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:22.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.136+0000 7fbd115ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd0c0cab60 con 0x7fbd0c1587d0 2023-07-14T11:13:22.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.136+0000 7fbd115ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd0c0ce8f0 con 0x7fbd0c0caff0 2023-07-14T11:13:22.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.136+0000 7fbd115ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd0c06bcc0 con 0x7fbd0c0cdf40 2023-07-14T11:13:22.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.136+0000 7fbd0a7fc700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbd0c0cdf40 0x7fbd0c0ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:22.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.137+0000 7fbd0a7fc700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbd0c0cdf40 0x7fbd0c0ce3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.84:51890/0 (socket says 172.21.15.84:51890) 2023-07-14T11:13:22.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.137+0000 7fbd0a7fc700 1 -- 172.21.15.84:0/1818968405 learned_addr learned my addr 172.21.15.84:0/1818968405 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:22.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.138+0000 7fc7de59c700 1 --2- 172.21.15.84:0/3660137060 >> v2:172.21.15.179:3300/0 conn(0x7fc7e00cdbe0 0x7fc7e00ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:22.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.138+0000 7fc7ddd9b700 1 -- 172.21.15.84:0/3660137060 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3393204780 0 0) 0x7fc7c80035b0 con 0x7fc7e0164710 2023-07-14T11:13:22.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.138+0000 7fc7ddd9b700 1 -- 172.21.15.84:0/3660137060 >> v2:172.21.15.179:3300/0 conn(0x7fc7e00cdbe0 msgr2=0x7fc7e00ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:22.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.138+0000 7fc7ddd9b700 1 --2- 172.21.15.84:0/3660137060 >> v2:172.21.15.179:3300/0 conn(0x7fc7e00cdbe0 0x7fc7e00ce060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.138+0000 7fc7ddd9b700 1 -- 172.21.15.84:0/3660137060 >> v1:172.21.15.179:6789/0 conn(0x7fc7e0160c30 legacy=0x7fc7e00cd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:22.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.138+0000 7fc7ddd9b700 1 -- 172.21.15.84:0/3660137060 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e0165400 con 0x7fc7e0164710 2023-07-14T11:13:22.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.138+0000 7fc7ddd9b700 1 -- 172.21.15.84:0/3660137060 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7fc7d00019f0 con 0x7fc7e0164710 2023-07-14T11:13:22.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.138+0000 7fc7ddd9b700 1 -- 172.21.15.84:0/3660137060 >> v1:172.21.15.84:6789/0 conn(0x7fc7e0164710 legacy=0x7fc7e0164b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:22.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.138+0000 7fc7ddd9b700 1 --2- 172.21.15.84:0/3660137060 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc7c8003a00 0x7fc7c8003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:22.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.138+0000 7fc7ddd9b700 1 --2- 172.21.15.84:0/3660137060 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc7c8004850 0x7fc7c8004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:22.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.138+0000 7fc7ddd9b700 1 --2- 172.21.15.84:0/3660137060 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7c8005200 0x7fc7c800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:22.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.138+0000 7fc7ddd9b700 1 -- 172.21.15.84:0/3660137060 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e00ce5a0 con 0x7fc7c8005200 2023-07-14T11:13:22.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.138+0000 7fc7ddd9b700 1 -- 172.21.15.84:0/3660137060 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c800c110 con 0x7fc7c8004850 2023-07-14T11:13:22.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.138+0000 7fc7ddd9b700 1 -- 172.21.15.84:0/3660137060 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c800c2d0 con 0x7fc7c8003a00 2023-07-14T11:13:22.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.138+0000 7fbd0b7fe700 1 --2- 172.21.15.84:0/1818968405 >> v2:172.21.15.84:3300/0 conn(0x7fbd0c0caff0 0x7fbd0c0cb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:22.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.138+0000 7efe2e5ff700 1 Processor -- start 2023-07-14T11:13:22.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.138+0000 7fc7df59e700 1 --2- 172.21.15.84:0/3660137060 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7c8005200 0x7fc7c800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:22.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.138+0000 7fc7de59c700 1 --2- 172.21.15.84:0/3660137060 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc7c8004850 0x7fc7c8004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:22.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.138+0000 7fc6c3fff700 1 -- 172.21.15.84:0/807291472 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc6d401b3b0 con 0x7fc6dc06c990 2023-07-14T11:13:22.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.139+0000 7fc7ded9d700 1 --2- 172.21.15.84:0/3660137060 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc7c8003a00 0x7fc7c8003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:22.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.139+0000 7fc7df59e700 1 -- 172.21.15.84:0/3660137060 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc7c8003a00 msgr2=0x7fc7c8003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:22.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.139+0000 7fc7df59e700 1 --2- 172.21.15.84:0/3660137060 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc7c8003a00 0x7fc7c8003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.139+0000 7fc7df59e700 1 -- 172.21.15.84:0/3660137060 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc7c8004850 msgr2=0x7fc7c8004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:22.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.139+0000 7fc7df59e700 1 --2- 172.21.15.84:0/3660137060 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc7c8004850 0x7fc7c8004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.139+0000 7fc7df59e700 1 -- 172.21.15.84:0/3660137060 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e0165400 con 0x7fc7c8005200 2023-07-14T11:13:22.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.139+0000 7fbd0b7fe700 1 -- 172.21.15.84:0/1818968405 >> v2:172.21.15.179:3300/0 conn(0x7fbd0c0cdf40 msgr2=0x7fbd0c0ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:22.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.139+0000 7fbd0b7fe700 1 --2- 172.21.15.84:0/1818968405 >> v2:172.21.15.179:3300/0 conn(0x7fbd0c0cdf40 0x7fbd0c0ce3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.139+0000 7fbd0b7fe700 1 -- 172.21.15.84:0/1818968405 >> v1:172.21.15.179:6789/0 conn(0x7fbd0c1587d0 legacy=0x7fbd0c06b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:22.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.139+0000 7fbd0b7fe700 1 -- 172.21.15.84:0/1818968405 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd0c158ba0 con 0x7fbd0c0caff0 2023-07-14T11:13:22.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.139+0000 7fc7df59e700 1 -- 172.21.15.84:0/3660137060 reap_dead start 2023-07-14T11:13:22.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.139+0000 7f13ed9ff700 1 -- 172.21.15.84:0/4027156275 shutdown_connections 2023-07-14T11:13:22.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.139+0000 7fea55dff700 1 -- 172.21.15.84:0/1983106631 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea50074350 con 0x7fea50149d00 2023-07-14T11:13:22.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.139+0000 7fbd0b7fe700 1 --2- 172.21.15.84:0/1818968405 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd0c0caff0 0x7fbd0c0cb490 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c0cdaf0 tx=0x7fbd00009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7e350d87a16f1e5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:22.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.140+0000 7fc7df59e700 1 --2- 172.21.15.84:0/3660137060 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7c8005200 0x7fc7c800ba10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc7d000a8b0 tx=0x7fc7c8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbceb7a2b1bc9e04 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:22.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.140+0000 7fc6c3fff700 1 --2- 172.21.15.84:0/807291472 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc6c806adb0 0x7fc6c806d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:22.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.140+0000 7fc6c3fff700 1 -- 172.21.15.84:0/807291472 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc6d4089480 con 0x7fc6dc06c990 2023-07-14T11:13:22.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.139+0000 7f13ed9ff700 1 -- 172.21.15.84:0/4027156275 wait complete. 2023-07-14T11:13:22.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.140+0000 7fc7ddd9b700 1 -- 172.21.15.84:0/3660137060 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d0012600 con 0x7fc7c8005200 2023-07-14T11:13:22.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.140+0000 7fc7ddd9b700 1 -- 172.21.15.84:0/3660137060 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7d0012780 con 0x7fc7c8005200 2023-07-14T11:13:22.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.140+0000 7fc7ddd9b700 1 -- 172.21.15.84:0/3660137060 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d0012b30 con 0x7fc7c8005200 2023-07-14T11:13:22.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.141+0000 7fc6c3fff700 1 -- 172.21.15.84:0/807291472 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fc6d40581a0 con 0x7fc6dc06c990 2023-07-14T11:13:22.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.141+0000 7fea37fff700 1 -- 172.21.15.84:0/1983106631 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fea48012070 con 0x7fea50149d00 2023-07-14T11:13:22.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.141+0000 7efe2e5ff700 1 -- start start 2023-07-14T11:13:22.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.141+0000 7fc7e51ff700 1 -- 172.21.15.84:0/3660137060 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7c8005200 msgr2=0x7fc7c800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:22.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.141+0000 7fc7e51ff700 1 --2- 172.21.15.84:0/3660137060 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7c8005200 0x7fc7c800ba10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc7d000a8b0 tx=0x7fc7c8005880 comp rx=0 tx=0).stop 2023-07-14T11:13:22.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.141+0000 7fc7e51ff700 1 -- 172.21.15.84:0/3660137060 shutdown_connections 2023-07-14T11:13:22.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.141+0000 7fc7e51ff700 1 --2- 172.21.15.84:0/3660137060 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7c8005200 0x7fc7c800ba10 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.141+0000 7fc7e51ff700 1 -- 172.21.15.84:0/3660137060 >> 172.21.15.84:0/3660137060 conn(0x7fc7e00b05d0 msgr2=0x7fc7e00b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:22.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.142+0000 7fbd09ffb700 1 -- 172.21.15.84:0/1818968405 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd00011830 con 0x7fbd0c0caff0 2023-07-14T11:13:22.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.142+0000 7fbd09ffb700 1 -- 172.21.15.84:0/1818968405 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd00011990 con 0x7fbd0c0caff0 2023-07-14T11:13:22.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.142+0000 7fbd09ffb700 1 -- 172.21.15.84:0/1818968405 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd00011d20 con 0x7fbd0c0caff0 2023-07-14T11:13:22.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.142+0000 7f13ed9ff700 1 Processor -- start 2023-07-14T11:13:22.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.143+0000 7f13ed9ff700 1 -- start start 2023-07-14T11:13:22.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.143+0000 7efe2e5ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7efe2806cd60 0x7efe280cc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:22.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.143+0000 7efe2e5ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe280cd530 con 0x7efe280cd940 2023-07-14T11:13:22.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.143+0000 7efe2e5ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe281615d0 con 0x7efe28160d50 2023-07-14T11:13:22.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.143+0000 7fea37fff700 1 --2- 172.21.15.84:0/1983106631 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fea3c06adb0 0x7fea3c06d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:22.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.143+0000 7fea37fff700 1 -- 172.21.15.84:0/1983106631 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fea48089270 con 0x7fea50149d00 2023-07-14T11:13:22.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.143+0000 7efe2e5ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe280ccf70 con 0x7efe2806cd60 2023-07-14T11:13:22.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.143+0000 7fbd115ff700 1 -- 172.21.15.84:0/1818968405 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd0c0caff0 msgr2=0x7fbd0c0cb490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:22.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.143+0000 7fbd115ff700 1 --2- 172.21.15.84:0/1818968405 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd0c0caff0 0x7fbd0c0cb490 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c0cdaf0 tx=0x7fbd00009b20 comp rx=0 tx=0).stop 2023-07-14T11:13:22.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.143+0000 7fbd115ff700 1 -- 172.21.15.84:0/1818968405 shutdown_connections 2023-07-14T11:13:22.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.143+0000 7fbd115ff700 1 --2- 172.21.15.84:0/1818968405 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd0c0caff0 0x7fbd0c0cb490 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.143+0000 7fbd115ff700 1 --2- 172.21.15.84:0/1818968405 >> v2:172.21.15.179:3300/0 conn(0x7fbd0c0cdf40 0x7fbd0c0ce3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.143+0000 7fbd115ff700 1 -- 172.21.15.84:0/1818968405 >> 172.21.15.84:0/1818968405 conn(0x7fbd0c0b05d0 msgr2=0x7fbd0c0b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:22.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.143+0000 7fc6db7fe700 1 --2- 172.21.15.84:0/807291472 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc6c806adb0 0x7fc6c806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:22.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.144+0000 7efe277fe700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7efe28160d50 0x7efe28161a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.84:50288/0 (socket says 172.21.15.84:50288) 2023-07-14T11:13:22.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.144+0000 7efe277fe700 1 -- 172.21.15.84:0/4286500275 learned_addr learned my addr 172.21.15.84:0/4286500275 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:13:22.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.144+0000 7efe2cb9c700 1 --2- 172.21.15.84:0/4286500275 >> v2:172.21.15.179:3300/0 conn(0x7efe2806cd60 0x7efe280cc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:22.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.144+0000 7efe26ffd700 1 -- 172.21.15.84:0/4286500275 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 583006481 0 0) 0x7efe281615d0 con 0x7efe28160d50 2023-07-14T11:13:22.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.144+0000 7efe26ffd700 1 -- 172.21.15.84:0/4286500275 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe100035b0 con 0x7efe28160d50 2023-07-14T11:13:22.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.145+0000 7fbd115ff700 1 -- 172.21.15.84:0/1818968405 shutdown_connections 2023-07-14T11:13:22.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.145+0000 7fc6db7fe700 1 --2- 172.21.15.84:0/807291472 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc6c806adb0 0x7fc6c806d260 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc0b4200 tx=0x7fc6cc006cd0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:22.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.145+0000 7fea4f7fe700 1 --2- 172.21.15.84:0/1983106631 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fea3c06adb0 0x7fea3c06d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:22.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.145+0000 7f13ed9ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13d0005320 0x7f13e81f5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:22.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.145+0000 7f13ed9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13e8152930 0x7f13e8152da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:22.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.145+0000 7f13ed9ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13e80b3bf0 0x7f13e80b4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:22.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.145+0000 7f13ed9ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e81532e0 con 0x7f13e80b3bf0 2023-07-14T11:13:22.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.145+0000 7f13ed9ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e81f6240 con 0x7f13d0005320 2023-07-14T11:13:22.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.145+0000 7f13ed9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13e81f9a80 con 0x7f13e8152930 2023-07-14T11:13:22.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.145+0000 7efe26ffd700 1 -- 172.21.15.84:0/4286500275 <== mon.1 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3886599899 0 0) 0x7efe100035b0 con 0x7efe28160d50 2023-07-14T11:13:22.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.145+0000 7efe26ffd700 1 -- 172.21.15.84:0/4286500275 >> v2:172.21.15.179:3300/0 conn(0x7efe2806cd60 msgr2=0x7efe280cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:22.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.145+0000 7efe26ffd700 1 --2- 172.21.15.84:0/4286500275 >> v2:172.21.15.179:3300/0 conn(0x7efe2806cd60 0x7efe280cc690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.145+0000 7efe26ffd700 1 -- 172.21.15.84:0/4286500275 >> v1:172.21.15.84:6789/0 conn(0x7efe280cd940 legacy=0x7efe280cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:22.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.145+0000 7efe26ffd700 1 -- 172.21.15.84:0/4286500275 --> v1:172.21.15.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe280cd250 con 0x7efe28160d50 2023-07-14T11:13:22.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.145+0000 7efe26ffd700 1 -- 172.21.15.84:0/4286500275 <== mon.1 v1:172.21.15.179:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7efe20001a30 con 0x7efe28160d50 2023-07-14T11:13:22.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.145+0000 7efe26ffd700 1 -- 172.21.15.84:0/4286500275 >> v1:172.21.15.179:6789/0 conn(0x7efe28160d50 legacy=0x7efe28161a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:22.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.145+0000 7efe26ffd700 1 --2- 172.21.15.84:0/4286500275 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efe10003a50 0x7efe10003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:22.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.145+0000 7efe26ffd700 1 --2- 172.21.15.84:0/4286500275 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efe10004850 0x7efe10004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:22.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.145+0000 7efe26ffd700 1 --2- 172.21.15.84:0/4286500275 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe10005200 0x7efe1000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:22.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.145+0000 7efe26ffd700 1 -- 172.21.15.84:0/4286500275 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe280ccf70 con 0x7efe10005200 2023-07-14T11:13:22.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.145+0000 7efe26ffd700 1 -- 172.21.15.84:0/4286500275 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe1000c0e0 con 0x7efe10004850 2023-07-14T11:13:22.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.145+0000 7efe26ffd700 1 -- 172.21.15.84:0/4286500275 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe1000c2a0 con 0x7efe10003a50 2023-07-14T11:13:22.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.145+0000 7efe2cb9c700 1 --2- 172.21.15.84:0/4286500275 >> v2:172.21.15.179:3300/0 conn(0x7efe2806cd60 0x7efe280cc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:13:22.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.146+0000 7efe277fe700 1 --2- 172.21.15.84:0/4286500275 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efe10004850 0x7efe10004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:22.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.146+0000 7fea4f7fe700 1 --2- 172.21.15.84:0/1983106631 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fea3c06adb0 0x7fea3c06d260 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fea4000a9f0 tx=0x7fea40008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:22.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.145+0000 7f13e6ffd700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13d0005320 0x7f13e81f5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:22.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.145+0000 7f13e6ffd700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13d0005320 0x7f13e81f5d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.84:51920/0 (socket says 172.21.15.84:51920) 2023-07-14T11:13:22.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.145+0000 7f13e6ffd700 1 -- 172.21.15.84:0/2410873227 learned_addr learned my addr 172.21.15.84:0/2410873227 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:22.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.146+0000 7f13e77fe700 1 --2- 172.21.15.84:0/2410873227 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13e80b3bf0 0x7f13e80b4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:22.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.146+0000 7f13e6ffd700 1 -- 172.21.15.84:0/2410873227 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13e8152930 msgr2=0x7f13e8152da0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-14T11:13:22.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.146+0000 7f13e6ffd700 1 --2- 172.21.15.84:0/2410873227 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13e8152930 0x7f13e8152da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.146+0000 7f13e6ffd700 1 -- 172.21.15.84:0/2410873227 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13e80b3bf0 msgr2=0x7f13e80b4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:22.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.146+0000 7f13e6ffd700 1 --2- 172.21.15.84:0/2410873227 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13e80b3bf0 0x7f13e80b4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.146+0000 7f13e6ffd700 1 -- 172.21.15.84:0/2410873227 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13e81f9d60 con 0x7f13d0005320 2023-07-14T11:13:22.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.147+0000 7f13e6ffd700 1 --2- 172.21.15.84:0/2410873227 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13d0005320 0x7f13e81f5d00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f13dc00e7d0 tx=0x7f13dc00eb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:22.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.146+0000 7efe27fff700 1 --2- 172.21.15.84:0/4286500275 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efe10003a50 0x7efe10003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:22.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.146+0000 7efe2cb9c700 1 --2- 172.21.15.84:0/4286500275 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe10005200 0x7efe1000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:22.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.147+0000 7efe277fe700 1 -- 172.21.15.84:0/4286500275 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efe10003a50 msgr2=0x7efe10003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:22.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.147+0000 7efe277fe700 1 --2- 172.21.15.84:0/4286500275 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efe10003a50 0x7efe10003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.147+0000 7efe277fe700 1 -- 172.21.15.84:0/4286500275 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe10005200 msgr2=0x7efe1000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:22.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.147+0000 7efe277fe700 1 --2- 172.21.15.84:0/4286500275 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe10005200 0x7efe1000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.147+0000 7efe277fe700 1 -- 172.21.15.84:0/4286500275 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe100035b0 con 0x7efe10004850 2023-07-14T11:13:22.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.147+0000 7efe2cb9c700 1 -- 172.21.15.84:0/4286500275 reap_dead start 2023-07-14T11:13:22.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.147+0000 7efe277fe700 1 --2- 172.21.15.84:0/4286500275 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efe10004850 0x7efe10004cc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7efe2000a780 tx=0x7efe10005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45841334ae02b894 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:22.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.146+0000 7fc7e51ff700 1 -- 172.21.15.84:0/3660137060 shutdown_connections 2023-07-14T11:13:22.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.147+0000 7fc7e51ff700 1 -- 172.21.15.84:0/3660137060 wait complete. 2023-07-14T11:13:22.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.147+0000 7efe26ffd700 1 -- 172.21.15.84:0/4286500275 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe200072d0 con 0x7efe10004850 2023-07-14T11:13:22.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.147+0000 7efe26ffd700 1 -- 172.21.15.84:0/4286500275 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe20007450 con 0x7efe10004850 2023-07-14T11:13:22.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.147+0000 7efe26ffd700 1 -- 172.21.15.84:0/4286500275 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe20007800 con 0x7efe10004850 2023-07-14T11:13:22.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.148+0000 7efe2e5ff700 1 -- 172.21.15.84:0/4286500275 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efe10004850 msgr2=0x7efe10004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:22.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.148+0000 7efe2e5ff700 1 --2- 172.21.15.84:0/4286500275 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efe10004850 0x7efe10004cc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7efe2000a780 tx=0x7efe10005880 comp rx=0 tx=0).stop 2023-07-14T11:13:22.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.148+0000 7efe2e5ff700 1 -- 172.21.15.84:0/4286500275 shutdown_connections 2023-07-14T11:13:22.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.148+0000 7efe2e5ff700 1 --2- 172.21.15.84:0/4286500275 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efe10004850 0x7efe10004cc0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.148+0000 7efe2e5ff700 1 -- 172.21.15.84:0/4286500275 >> 172.21.15.84:0/4286500275 conn(0x7efe280b05d0 msgr2=0x7efe280b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:22.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.148+0000 7efe2e5ff700 1 -- 172.21.15.84:0/4286500275 shutdown_connections 2023-07-14T11:13:22.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.147+0000 7f13cffff700 1 -- 172.21.15.84:0/2410873227 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13dc013680 con 0x7f13d0005320 2023-07-14T11:13:22.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.147+0000 7f13cffff700 1 -- 172.21.15.84:0/2410873227 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13dc0137e0 con 0x7f13d0005320 2023-07-14T11:13:22.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.147+0000 7f13cffff700 1 -- 172.21.15.84:0/2410873227 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13dc013b70 con 0x7f13d0005320 2023-07-14T11:13:22.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.148+0000 7efe2e5ff700 1 -- 172.21.15.84:0/4286500275 wait complete. 2023-07-14T11:13:22.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.148+0000 7f13ed9ff700 1 -- 172.21.15.84:0/2410873227 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13e81fa040 con 0x7f13d0005320 2023-07-14T11:13:22.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.149+0000 7f13ed9ff700 1 -- 172.21.15.84:0/2410873227 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13e81fa600 con 0x7f13d0005320 2023-07-14T11:13:22.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.146+0000 7fbd115ff700 1 -- 172.21.15.84:0/1818968405 wait complete. 2023-07-14T11:13:22.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.149+0000 7fbd115ff700 1 Processor -- start 2023-07-14T11:13:22.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.150+0000 7f13ed9ff700 1 -- 172.21.15.84:0/2410873227 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13e8074350 con 0x7f13d0005320 2023-07-14T11:13:22.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.151+0000 7efe2e5ff700 1 Processor -- start 2023-07-14T11:13:22.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.149+0000 7fbd115ff700 1 -- start start 2023-07-14T11:13:22.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.151+0000 7fbd115ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd0c0caff0 0x7fbd0c1567d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:22.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.151+0000 7fbd115ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd0c1587d0 0x7fbd0c0b4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:22.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.151+0000 7fbd115ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd0c1f70e0 0x7fbd0c070780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:22.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.151+0000 7fbd115ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0c1fa970 con 0x7fbd0c0caff0 2023-07-14T11:13:22.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.151+0000 7fbd115ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0c1f7580 con 0x7fbd0c1587d0 2023-07-14T11:13:22.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.151+0000 7fbd115ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0c0c1d20 con 0x7fbd0c1f70e0 2023-07-14T11:13:22.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.149+0000 7fc7e51ff700 1 Processor -- start 2023-07-14T11:13:22.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.149+0000 7fc7e51ff700 1 -- start start 2023-07-14T11:13:22.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.151+0000 7fc7e51ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc7c8005200 0x7fc7e0162c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:22.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.151+0000 7fc7e51ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7e0163a00 0x7fc7e0206be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:22.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.151+0000 7fc7e51ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc7e0070e50 0x7fc7e00712d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:22.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.151+0000 7fc7e51ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e0071810 con 0x7fc7e0163a00 2023-07-14T11:13:22.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.151+0000 7fc7e51ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e00b45c0 con 0x7fc7e0070e50 2023-07-14T11:13:22.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.151+0000 7fc7e51ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e00b32d0 con 0x7fc7c8005200 2023-07-14T11:13:22.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.151+0000 7efe2e5ff700 1 -- start start 2023-07-14T11:13:22.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.152+0000 7efe2e5ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe10004850 0x7efe280c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:22.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.152+0000 7efe2e5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efe280c5b90 0x7efe280b4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:22.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.152+0000 7efe2e5ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efe28201db0 0x7efe280b09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:22.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.152+0000 7efe2e5ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe280c6000 con 0x7efe10004850 2023-07-14T11:13:22.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.152+0000 7efe2e5ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe280b1aa0 con 0x7efe28201db0 2023-07-14T11:13:22.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.152+0000 7efe2e5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe280b1d80 con 0x7efe280c5b90 2023-07-14T11:13:22.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.152+0000 7fc7df59e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc7e0070e50 0x7fc7e00712d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:22.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.152+0000 7fc7df59e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc7e0070e50 0x7fc7e00712d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.84:51948/0 (socket says 172.21.15.84:51948) 2023-07-14T11:13:22.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.152+0000 7fc7df59e700 1 -- 172.21.15.84:0/2073717005 learned_addr learned my addr 172.21.15.84:0/2073717005 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:22.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.153+0000 7efe277fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efe280c5b90 0x7efe280b4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:22.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.153+0000 7efe277fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efe280c5b90 0x7efe280b4350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.84:36120/0 (socket says 172.21.15.84:36120) 2023-07-14T11:13:22.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.153+0000 7efe277fe700 1 -- 172.21.15.84:0/720761997 learned_addr learned my addr 172.21.15.84:0/720761997 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:22.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.153+0000 7fbd0a7fc700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd0c1587d0 0x7fbd0c0b4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:22.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.153+0000 7fbd0a7fc700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd0c1587d0 0x7fbd0c0b4350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.84:51934/0 (socket says 172.21.15.84:51934) 2023-07-14T11:13:22.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.153+0000 7fbd0a7fc700 1 -- 172.21.15.84:0/2981847319 learned_addr learned my addr 172.21.15.84:0/2981847319 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:22.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.153+0000 7efe2cb9c700 1 --2- 172.21.15.84:0/720761997 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efe28201db0 0x7efe280b09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:22.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.153+0000 7fc7de59c700 1 --2- 172.21.15.84:0/2073717005 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7e0163a00 0x7fc7e0206be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:22.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.153+0000 7fc7df59e700 1 -- 172.21.15.84:0/2073717005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc7c8005200 msgr2=0x7fc7e0162c50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-14T11:13:22.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.153+0000 7fc7df59e700 1 --2- 172.21.15.84:0/2073717005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc7c8005200 0x7fc7e0162c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.153+0000 7fc7df59e700 1 -- 172.21.15.84:0/2073717005 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7e0163a00 msgr2=0x7fc7e0206be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:22.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.153+0000 7fc7df59e700 1 --2- 172.21.15.84:0/2073717005 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7e0163a00 0x7fc7e0206be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.153+0000 7fc7df59e700 1 -- 172.21.15.84:0/2073717005 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e0163190 con 0x7fc7e0070e50 2023-07-14T11:13:22.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.154+0000 7efe277fe700 1 -- 172.21.15.84:0/720761997 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efe28201db0 msgr2=0x7efe280b09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:22.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.154+0000 7efe277fe700 1 --2- 172.21.15.84:0/720761997 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efe28201db0 0x7efe280b09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.154+0000 7efe277fe700 1 -- 172.21.15.84:0/720761997 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe10004850 msgr2=0x7efe280c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:22.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.154+0000 7efe277fe700 1 --2- 172.21.15.84:0/720761997 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe10004850 0x7efe280c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.154+0000 7fbd0affd700 1 --2- 172.21.15.84:0/2981847319 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd0c0caff0 0x7fbd0c1567d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:22.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.154+0000 7efe277fe700 1 -- 172.21.15.84:0/720761997 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe280b2060 con 0x7efe280c5b90 2023-07-14T11:13:22.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.154+0000 7fbd0b7fe700 1 --2- 172.21.15.84:0/2981847319 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd0c1f70e0 0x7fbd0c070780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:22.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.154+0000 7efe277fe700 1 --2- 172.21.15.84:0/720761997 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efe280c5b90 0x7efe280b4350 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7efe20002230 tx=0x7efe20001cf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:22.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.154+0000 7fc7df59e700 1 --2- 172.21.15.84:0/2073717005 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc7e0070e50 0x7fc7e00712d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc7e006af10 tx=0x7fc7d0001cb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:22.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.155+0000 7fbd0affd700 1 -- 172.21.15.84:0/2981847319 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd0c1f70e0 msgr2=0x7fbd0c070780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:22.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.155+0000 7fbd0affd700 1 --2- 172.21.15.84:0/2981847319 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd0c1f70e0 0x7fbd0c070780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.155+0000 7fbd0affd700 1 -- 172.21.15.84:0/2981847319 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd0c1587d0 msgr2=0x7fbd0c0b4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:22.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.155+0000 7fea37fff700 1 -- 172.21.15.84:0/1983106631 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fea48054390 con 0x7fea50149d00 2023-07-14T11:13:22.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.155+0000 7fbd0affd700 1 --2- 172.21.15.84:0/2981847319 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd0c1587d0 0x7fbd0c0b4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.155+0000 7fbd0affd700 1 -- 172.21.15.84:0/2981847319 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd000094a0 con 0x7fbd0c0caff0 2023-07-14T11:13:22.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.155+0000 7fbd0affd700 1 --2- 172.21.15.84:0/2981847319 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd0c0caff0 0x7fbd0c1567d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbd0400cbb0 tx=0x7fbd0400cec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:22.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.154+0000 7f13cffff700 1 -- 172.21.15.84:0/2410873227 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f13dc013cd0 con 0x7f13d0005320 2023-07-14T11:13:22.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.155+0000 7f13cffff700 1 --2- 172.21.15.84:0/2410873227 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f13d406ad30 0x7f13d406d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:22.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.156+0000 7f13cffff700 1 -- 172.21.15.84:0/2410873227 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f13dc0892a0 con 0x7f13d0005320 2023-07-14T11:13:22.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.156+0000 7fbcf37fe700 1 -- 172.21.15.84:0/2981847319 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd04003c00 con 0x7fbd0c0caff0 2023-07-14T11:13:22.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.156+0000 7fbcf37fe700 1 -- 172.21.15.84:0/2981847319 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd04003d60 con 0x7fbd0c0caff0 2023-07-14T11:13:22.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.156+0000 7fbcf37fe700 1 -- 172.21.15.84:0/2981847319 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0400ab40 con 0x7fbd0c0caff0 2023-07-14T11:13:22.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.156+0000 7fbd115ff700 1 -- 172.21.15.84:0/2981847319 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd0c1f9cf0 con 0x7fbd0c0caff0 2023-07-14T11:13:22.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.156+0000 7fbd115ff700 1 -- 172.21.15.84:0/2981847319 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd0c1fa2b0 con 0x7fbd0c0caff0 2023-07-14T11:13:22.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.157+0000 7f13cffff700 1 -- 172.21.15.84:0/2410873227 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f13dc0543c0 con 0x7f13d0005320 2023-07-14T11:13:22.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.157+0000 7efe24ff9700 1 -- 172.21.15.84:0/720761997 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe20007b80 con 0x7efe280c5b90 2023-07-14T11:13:22.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.157+0000 7efe24ff9700 1 -- 172.21.15.84:0/720761997 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe20001250 con 0x7efe280c5b90 2023-07-14T11:13:22.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.157+0000 7efe24ff9700 1 -- 172.21.15.84:0/720761997 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe20012620 con 0x7efe280c5b90 2023-07-14T11:13:22.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.157+0000 7efe2e5ff700 1 -- 172.21.15.84:0/720761997 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe280c81c0 con 0x7efe280c5b90 2023-07-14T11:13:22.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.157+0000 7efe2e5ff700 1 -- 172.21.15.84:0/720761997 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe28202220 con 0x7efe280c5b90 2023-07-14T11:13:22.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.157+0000 7fc7c77fe700 1 -- 172.21.15.84:0/2073717005 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d00019c0 con 0x7fc7e0070e50 2023-07-14T11:13:22.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.157+0000 7fc7c77fe700 1 -- 172.21.15.84:0/2073717005 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7d000a2a0 con 0x7fc7e0070e50 2023-07-14T11:13:22.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.157+0000 7fc7c77fe700 1 -- 172.21.15.84:0/2073717005 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d001d620 con 0x7fc7e0070e50 2023-07-14T11:13:22.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.157+0000 7fc7e51ff700 1 -- 172.21.15.84:0/2073717005 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7e00b3520 con 0x7fc7e0070e50 2023-07-14T11:13:22.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.157+0000 7fc7e51ff700 1 -- 172.21.15.84:0/2073717005 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7e00b3ae0 con 0x7fc7e0070e50 2023-07-14T11:13:22.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.159+0000 7f13e67fc700 1 --2- 172.21.15.84:0/2410873227 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f13d406ad30 0x7f13d406d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:22.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.160+0000 7efe2e5ff700 1 -- 172.21.15.84:0/720761997 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe080052f0 con 0x7efe280c5b90 2023-07-14T11:13:22.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.160+0000 7f13e67fc700 1 --2- 172.21.15.84:0/2410873227 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f13d406ad30 0x7f13d406d1e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f13e80c6240 tx=0x7f13d8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:22.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.160+0000 7fbd115ff700 1 -- 172.21.15.84:0/2981847319 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd0c074350 con 0x7fbd0c0caff0 2023-07-14T11:13:22.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.159+0000 7f4d8ddff700 1 Processor -- start 2023-07-14T11:13:22.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.159+0000 7f4d8ddff700 1 -- start start 2023-07-14T11:13:22.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.161+0000 7f4d8ddff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4d880cea20 0x7f4d8816bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:22.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.161+0000 7f4d8ddff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d88164830 con 0x7f4d880c9d60 2023-07-14T11:13:22.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.161+0000 7f4d8ddff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d88165690 con 0x7f4d88160be0 2023-07-14T11:13:22.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.161+0000 7f4d8ddff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d88070700 con 0x7f4d880cea20 2023-07-14T11:13:22.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.162+0000 7f4d87fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4d880cea20 0x7f4d8816bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:22.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.162+0000 7f4d87fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4d880cea20 0x7f4d8816bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.84:51964/0 (socket says 172.21.15.84:51964) 2023-07-14T11:13:22.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.162+0000 7f4d87fff700 1 -- 172.21.15.84:0/744571165 learned_addr learned my addr 172.21.15.84:0/744571165 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:22.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.160+0000 7fc7e51ff700 1 -- 172.21.15.84:0/2073717005 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7c00052f0 con 0x7fc7e0070e50 2023-07-14T11:13:22.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.163+0000 7efe24ff9700 1 -- 172.21.15.84:0/720761997 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efe2001a070 con 0x7efe280c5b90 2023-07-14T11:13:22.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.161+0000 7fbcf37fe700 1 -- 172.21.15.84:0/2981847319 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbd0400aca0 con 0x7fbd0c0caff0 2023-07-14T11:13:22.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.162+0000 7fbcf37fe700 1 --2- 172.21.15.84:0/2981847319 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fbcf806adb0 0x7fbcf806d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:22.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.163+0000 7fbcf37fe700 1 -- 172.21.15.84:0/2981847319 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbd040894d0 con 0x7fbd0c0caff0 2023-07-14T11:13:22.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.163+0000 7f4d87fff700 1 -- 172.21.15.84:0/744571165 >> v1:172.21.15.179:6789/0 conn(0x7f4d88160be0 legacy=0x7f4d880c9560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:22.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.163+0000 7f4d87fff700 1 -- 172.21.15.84:0/744571165 >> v1:172.21.15.84:6789/0 conn(0x7f4d880c9d60 legacy=0x7f4d880c1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:22.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.163+0000 7f4d87fff700 1 -- 172.21.15.84:0/744571165 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d88164a80 con 0x7f4d880cea20 2023-07-14T11:13:22.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.164+0000 7efe24ff9700 1 --2- 172.21.15.84:0/720761997 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7efe1406ad30 0x7efe1406d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:22.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.162+0000 7fc7c77fe700 1 -- 172.21.15.84:0/2073717005 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc7d001d780 con 0x7fc7e0070e50 2023-07-14T11:13:22.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.164+0000 7fc7c77fe700 1 --2- 172.21.15.84:0/2073717005 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc7cc06adb0 0x7fc7cc06d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:22.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.164+0000 7fc7c77fe700 1 -- 172.21.15.84:0/2073717005 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc7d008b530 con 0x7fc7e0070e50 2023-07-14T11:13:22.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.164+0000 7efe24ff9700 1 -- 172.21.15.84:0/720761997 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efe2008b9f0 con 0x7efe280c5b90 2023-07-14T11:13:22.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.165+0000 7fc7ded9d700 1 --2- 172.21.15.84:0/2073717005 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc7cc06adb0 0x7fc7cc06d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:22.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.166+0000 7efe27fff700 1 --2- 172.21.15.84:0/720761997 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7efe1406ad30 0x7efe1406d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:22.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.166+0000 7fbd0a7fc700 1 --2- 172.21.15.84:0/2981847319 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fbcf806adb0 0x7fbcf806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:22.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.165+0000 7f4d87fff700 1 --2- 172.21.15.84:0/744571165 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d880cea20 0x7f4d8816bb60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4d80009e50 tx=0x7f4d8000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fdc9bafe17041f87 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:22.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.166+0000 7f4d867fc700 1 -- 172.21.15.84:0/744571165 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d8000e070 con 0x7f4d880cea20 2023-07-14T11:13:22.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.166+0000 7f4d867fc700 1 -- 172.21.15.84:0/744571165 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d8000b9c0 con 0x7f4d880cea20 2023-07-14T11:13:22.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.166+0000 7f4d867fc700 1 -- 172.21.15.84:0/744571165 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d8000bd70 con 0x7f4d880cea20 2023-07-14T11:13:22.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.167+0000 7f9c81fff700 1 Processor -- start 2023-07-14T11:13:22.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.167+0000 7fc7c77fe700 1 -- 172.21.15.84:0/2073717005 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fc7d0056650 con 0x7fc7e0070e50 2023-07-14T11:13:22.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.167+0000 7f4d8ddff700 1 -- 172.21.15.84:0/744571165 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d880cea20 msgr2=0x7f4d8816bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:22.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.167+0000 7f4d8ddff700 1 --2- 172.21.15.84:0/744571165 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d880cea20 0x7f4d8816bb60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4d80009e50 tx=0x7f4d8000b330 comp rx=0 tx=0).stop 2023-07-14T11:13:22.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.168+0000 7efe24ff9700 1 -- 172.21.15.84:0/720761997 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7efe20056c30 con 0x7efe280c5b90 2023-07-14T11:13:22.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.168+0000 7f9c81fff700 1 -- start start 2023-07-14T11:13:22.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.168+0000 7efe27fff700 1 --2- 172.21.15.84:0/720761997 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7efe1406ad30 0x7efe1406d1e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7efe18007b30 tx=0x7efe18009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:22.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.169+0000 7fbd0a7fc700 1 --2- 172.21.15.84:0/2981847319 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fbcf806adb0 0x7fbcf806d260 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c0715d0 tx=0x7fbcfc006d10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:22.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.169+0000 7f4d8ddff700 1 -- 172.21.15.84:0/744571165 shutdown_connections 2023-07-14T11:13:22.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.169+0000 7f4d8ddff700 1 --2- 172.21.15.84:0/744571165 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d880cea20 0x7f4d8816bb60 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.169+0000 7f4d8ddff700 1 -- 172.21.15.84:0/744571165 >> 172.21.15.84:0/744571165 conn(0x7f4d880cef10 msgr2=0x7f4d880cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:22.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.169+0000 7fc7ded9d700 1 --2- 172.21.15.84:0/2073717005 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc7cc06adb0 0x7fc7cc06d260 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc7e015fe10 tx=0x7fc7d8007d50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:22.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.170+0000 7f9c81fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c7c1587d0 0x7f9c7c06b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:22.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.170+0000 7f9c81fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9c7c0ce650 0x7f9c7c0caff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:22.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.170+0000 7f9c81fff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c7c0cab60 con 0x7f9c7c06baf0 2023-07-14T11:13:22.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.170+0000 7f9c81fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c7c158ba0 con 0x7f9c7c0ce650 2023-07-14T11:13:22.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.170+0000 7f9c81fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7c06bf70 con 0x7f9c7c1587d0 2023-07-14T11:13:22.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.171+0000 7f9c7b7fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c7c1587d0 0x7f9c7c06b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:22.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.171+0000 7f9c7b7fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c7c1587d0 0x7f9c7c06b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.84:36136/0 (socket says 172.21.15.84:36136) 2023-07-14T11:13:22.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.171+0000 7f9c7b7fe700 1 -- 172.21.15.84:0/1355153478 learned_addr learned my addr 172.21.15.84:0/1355153478 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:22.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.171+0000 7f9c7bfff700 1 --2- 172.21.15.84:0/1355153478 >> v2:172.21.15.179:3300/0 conn(0x7f9c7c0ce650 0x7f9c7c0caff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:22.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.172+0000 7f9c7bfff700 1 -- 172.21.15.84:0/1355153478 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c7c1587d0 msgr2=0x7f9c7c06b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:22.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.172+0000 7f9c7bfff700 1 --2- 172.21.15.84:0/1355153478 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c7c1587d0 0x7f9c7c06b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.172+0000 7f9c7bfff700 1 -- 172.21.15.84:0/1355153478 >> v1:172.21.15.84:6789/0 conn(0x7f9c7c06baf0 legacy=0x7f9c7c0cdf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:22.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.172+0000 7f9c7bfff700 1 -- 172.21.15.84:0/1355153478 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c7c06c250 con 0x7f9c7c0ce650 2023-07-14T11:13:22.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.172+0000 7f9c7bfff700 1 --2- 172.21.15.84:0/1355153478 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c7c0ce650 0x7f9c7c0caff0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9c74009e10 tx=0x7f9c7400d540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80a84fd7518468a9 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:22.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.172+0000 7f9c7a7fc700 1 -- 172.21.15.84:0/1355153478 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c74003a20 con 0x7f9c7c0ce650 2023-07-14T11:13:22.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.173+0000 7f9c7a7fc700 1 -- 172.21.15.84:0/1355153478 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c74003b80 con 0x7f9c7c0ce650 2023-07-14T11:13:22.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.173+0000 7f9c7a7fc700 1 -- 172.21.15.84:0/1355153478 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c74004030 con 0x7f9c7c0ce650 2023-07-14T11:13:22.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.174+0000 7f9c81fff700 1 -- 172.21.15.84:0/1355153478 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c7c0ce650 msgr2=0x7f9c7c0caff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:22.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.174+0000 7f9c81fff700 1 --2- 172.21.15.84:0/1355153478 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c7c0ce650 0x7f9c7c0caff0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9c74009e10 tx=0x7f9c7400d540 comp rx=0 tx=0).stop 2023-07-14T11:13:22.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.174+0000 7fbcf37fe700 1 -- 172.21.15.84:0/2981847319 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fbd04054560 con 0x7fbd0c0caff0 2023-07-14T11:13:22.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.175+0000 7f4d8ddff700 1 -- 172.21.15.84:0/744571165 shutdown_connections 2023-07-14T11:13:22.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.175+0000 7f4d8ddff700 1 -- 172.21.15.84:0/744571165 wait complete. 2023-07-14T11:13:22.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.178+0000 7f4d8ddff700 1 Processor -- start 2023-07-14T11:13:22.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.178+0000 7f4d8ddff700 1 -- start start 2023-07-14T11:13:22.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.180+0000 7f4d8ddff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d880c9d60 0x7f4d881fe9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:22.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.180+0000 7f4d8ddff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d880cea20 0x7f4d8815c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:22.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.180+0000 7f4d8ddff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d88160be0 0x7f4d8815cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:22.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.180+0000 7f4d8ddff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8815e4e0 con 0x7f4d88160be0 2023-07-14T11:13:22.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.180+0000 7f4d8ddff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d881618e0 con 0x7f4d880c9d60 2023-07-14T11:13:22.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.180+0000 7f4d8ddff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d880b4850 con 0x7f4d880cea20 2023-07-14T11:13:22.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.180+0000 7f4d877fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d880c9d60 0x7f4d881fe9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:22.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.180+0000 7f4d877fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d880c9d60 0x7f4d881fe9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.84:51988/0 (socket says 172.21.15.84:51988) 2023-07-14T11:13:22.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.180+0000 7f4d877fe700 1 -- 172.21.15.84:0/1536090134 learned_addr learned my addr 172.21.15.84:0/1536090134 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:22.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.180+0000 7f4d86ffd700 1 --2- 172.21.15.84:0/1536090134 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d880cea20 0x7f4d8815c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:22.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.181+0000 7f4d877fe700 1 -- 172.21.15.84:0/1536090134 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d880cea20 msgr2=0x7f4d8815c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:22.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.181+0000 7f4d877fe700 1 --2- 172.21.15.84:0/1536090134 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d880cea20 0x7f4d8815c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.181+0000 7f4d877fe700 1 -- 172.21.15.84:0/1536090134 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d88160be0 msgr2=0x7f4d8815cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:22.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.181+0000 7f4d877fe700 1 --2- 172.21.15.84:0/1536090134 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d88160be0 0x7f4d8815cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.181+0000 7f4d877fe700 1 -- 172.21.15.84:0/1536090134 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d80009b30 con 0x7f4d880c9d60 2023-07-14T11:13:22.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.183+0000 7f9c81fff700 1 -- 172.21.15.84:0/1355153478 shutdown_connections 2023-07-14T11:13:22.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.183+0000 7f9c81fff700 1 --2- 172.21.15.84:0/1355153478 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c7c0ce650 0x7f9c7c0caff0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.183+0000 7f9c81fff700 1 --2- 172.21.15.84:0/1355153478 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c7c1587d0 0x7f9c7c06b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.183+0000 7f9c81fff700 1 -- 172.21.15.84:0/1355153478 >> 172.21.15.84:0/1355153478 conn(0x7f9c7c0b05d0 msgr2=0x7f9c7c0b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:22.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.184+0000 7f4d877fe700 1 --2- 172.21.15.84:0/1536090134 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d880c9d60 0x7f4d881fe9e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4d7800c4e0 tx=0x7f4d7800c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:22.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.184+0000 7f9c81fff700 1 -- 172.21.15.84:0/1355153478 shutdown_connections 2023-07-14T11:13:22.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.184+0000 7f9c81fff700 1 -- 172.21.15.84:0/1355153478 wait complete. 2023-07-14T11:13:22.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.188+0000 7f4d6ffff700 1 -- 172.21.15.84:0/1536090134 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d780052d0 con 0x7f4d880c9d60 2023-07-14T11:13:22.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.188+0000 7f4d6ffff700 1 -- 172.21.15.84:0/1536090134 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d78005430 con 0x7f4d880c9d60 2023-07-14T11:13:22.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.188+0000 7f4d6ffff700 1 -- 172.21.15.84:0/1536090134 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d780038c0 con 0x7f4d880c9d60 2023-07-14T11:13:22.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.187+0000 7f9c81fff700 1 Processor -- start 2023-07-14T11:13:22.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.188+0000 7f9c81fff700 1 -- start start 2023-07-14T11:13:22.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.189+0000 7f9c81fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c7c0ce650 0x7f9c7c1f3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:22.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.189+0000 7f9c81fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c7c1587d0 0x7f9c7c0c6be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:22.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.189+0000 7f9c81fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c7c0c7120 0x7f9c7c0cb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:22.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.189+0000 7f9c81fff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7c0c3640 con 0x7f9c7c0c7120 2023-07-14T11:13:22.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.189+0000 7f9c81fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7c0c3030 con 0x7f9c7c0ce650 2023-07-14T11:13:22.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.189+0000 7f9c81fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7c0c7bb0 con 0x7f9c7c1587d0 2023-07-14T11:13:22.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.190+0000 7f9c7b7fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c7c0ce650 0x7f9c7c1f3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:22.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.190+0000 7f9c7b7fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c7c0ce650 0x7f9c7c1f3230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.84:52004/0 (socket says 172.21.15.84:52004) 2023-07-14T11:13:22.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.190+0000 7f9c7b7fe700 1 -- 172.21.15.84:0/3322048584 learned_addr learned my addr 172.21.15.84:0/3322048584 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:22.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.190+0000 7f9c7affd700 1 --2- 172.21.15.84:0/3322048584 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c7c1587d0 0x7f9c7c0c6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:22.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.191+0000 7f9c7affd700 1 -- 172.21.15.84:0/3322048584 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c7c0ce650 msgr2=0x7f9c7c1f3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:22.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.191+0000 7f9c7affd700 1 --2- 172.21.15.84:0/3322048584 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c7c0ce650 0x7f9c7c1f3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.191+0000 7f9c7affd700 1 -- 172.21.15.84:0/3322048584 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c7c0c7120 msgr2=0x7f9c7c0cb7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:22.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.191+0000 7f9c7affd700 1 --2- 172.21.15.84:0/3322048584 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c7c0c7120 0x7f9c7c0cb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.191+0000 7f9c7affd700 1 -- 172.21.15.84:0/3322048584 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c74009a70 con 0x7f9c7c1587d0 2023-07-14T11:13:22.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.191+0000 7f9c7affd700 1 --2- 172.21.15.84:0/3322048584 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c7c1587d0 0x7f9c7c0c6be0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c06d720 tx=0x7f9c7000c790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:22.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.192+0000 7f9c6bfff700 1 -- 172.21.15.84:0/3322048584 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c700054e0 con 0x7f9c7c1587d0 2023-07-14T11:13:22.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.192+0000 7f9c6bfff700 1 -- 172.21.15.84:0/3322048584 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c70003680 con 0x7f9c7c1587d0 2023-07-14T11:13:22.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.192+0000 7f9c6bfff700 1 -- 172.21.15.84:0/3322048584 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c70003a30 con 0x7f9c7c1587d0 2023-07-14T11:13:22.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.192+0000 7f9c81fff700 1 -- 172.21.15.84:0/3322048584 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c7c1f3770 con 0x7f9c7c1587d0 2023-07-14T11:13:22.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.192+0000 7f9c81fff700 1 -- 172.21.15.84:0/3322048584 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c7c0c78d0 con 0x7f9c7c1587d0 2023-07-14T11:13:22.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.190+0000 7f4d8ddff700 1 -- 172.21.15.84:0/1536090134 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d88160fb0 con 0x7f4d880c9d60 2023-07-14T11:13:22.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.190+0000 7f4d8ddff700 1 -- 172.21.15.84:0/1536090134 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d88161570 con 0x7f4d880c9d60 2023-07-14T11:13:22.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.194+0000 7f4d8ddff700 1 -- 172.21.15.84:0/1536090134 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d88164d60 con 0x7f4d880c9d60 2023-07-14T11:13:22.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.194+0000 7f9c81fff700 1 -- 172.21.15.84:0/3322048584 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c7c0c3780 con 0x7f9c7c1587d0 2023-07-14T11:13:22.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.197+0000 7f9c6bfff700 1 -- 172.21.15.84:0/3322048584 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9c70003b90 con 0x7f9c7c1587d0 2023-07-14T11:13:22.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.198+0000 7f9c6bfff700 1 --2- 172.21.15.84:0/3322048584 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f9c6006acb0 0x7f9c6006d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:22.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.198+0000 7f9c6bfff700 1 -- 172.21.15.84:0/3322048584 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9c70088540 con 0x7f9c7c1587d0 2023-07-14T11:13:22.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.198+0000 7f4d6ffff700 1 -- 172.21.15.84:0/1536090134 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4d78003a20 con 0x7f4d880c9d60 2023-07-14T11:13:22.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.199+0000 7f4d6ffff700 1 --2- 172.21.15.84:0/1536090134 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f4d7406adb0 0x7f4d7406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:22.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.199+0000 7f4d6ffff700 1 -- 172.21.15.84:0/1536090134 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4d78088e10 con 0x7f4d880c9d60 2023-07-14T11:13:22.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.200+0000 7f4d6ffff700 1 -- 172.21.15.84:0/1536090134 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f4d78053ea0 con 0x7f4d880c9d60 2023-07-14T11:13:22.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.200+0000 7f9c7b7fe700 1 --2- 172.21.15.84:0/3322048584 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f9c6006acb0 0x7f9c6006d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:22.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.201+0000 7f9c7b7fe700 1 --2- 172.21.15.84:0/3322048584 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f9c6006acb0 0x7f9c6006d160 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c1f4460 tx=0x7f9c6c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:22.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.203+0000 7f9c6bfff700 1 -- 172.21.15.84:0/3322048584 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f9c7c0c3780 con 0x7f9c7c1587d0 2023-07-14T11:13:22.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.205+0000 7f4d86ffd700 1 --2- 172.21.15.84:0/1536090134 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f4d7406adb0 0x7f4d7406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:22.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.206+0000 7f4d86ffd700 1 --2- 172.21.15.84:0/1536090134 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f4d7406adb0 0x7f4d7406d260 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4d880b29c0 tx=0x7f4d7c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:22.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.568+0000 7fc6e21ff700 1 -- 172.21.15.84:0/807291472 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc6bc005870 con 0x7fc6dc06c990 2023-07-14T11:13:22.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.569+0000 7fc6c3fff700 1 -- 172.21.15.84:0/807291472 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc6d4057d30 con 0x7fc6dc06c990 2023-07-14T11:13:22.574 INFO:teuthology.orchestra.run.smithi084.stdout:55834574854 2023-07-14T11:13:22.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.574+0000 7fc6e21ff700 1 -- 172.21.15.84:0/807291472 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc6c806adb0 msgr2=0x7fc6c806d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:22.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.574+0000 7fc6e21ff700 1 --2- 172.21.15.84:0/807291472 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc6c806adb0 0x7fc6c806d260 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc0b4200 tx=0x7fc6cc006cd0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.574+0000 7fc6e21ff700 1 -- 172.21.15.84:0/807291472 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6dc06c990 msgr2=0x7fc6dc0c4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:22.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.574+0000 7fc6e21ff700 1 --2- 172.21.15.84:0/807291472 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6dc06c990 0x7fc6dc0c4ad0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc6d400cb10 tx=0x7fc6d400ced0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.575+0000 7fc6e21ff700 1 -- 172.21.15.84:0/807291472 shutdown_connections 2023-07-14T11:13:22.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.575+0000 7fc6e21ff700 1 --2- 172.21.15.84:0/807291472 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc6c806adb0 0x7fc6c806d260 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.575+0000 7fc6e21ff700 1 --2- 172.21.15.84:0/807291472 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6dc06d920 0x7fc6dc0c5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.575+0000 7fc6e21ff700 1 --2- 172.21.15.84:0/807291472 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6dc06c1c0 0x7fc6dc158080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.575+0000 7fc6e21ff700 1 --2- 172.21.15.84:0/807291472 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6dc06c990 0x7fc6dc0c4ad0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.575+0000 7fc6e21ff700 1 -- 172.21.15.84:0/807291472 >> 172.21.15.84:0/807291472 conn(0x7fc6dc0b05d0 msgr2=0x7fc6dc15add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:22.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.575+0000 7fc6e21ff700 1 -- 172.21.15.84:0/807291472 shutdown_connections 2023-07-14T11:13:22.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.575+0000 7fc6e21ff700 1 -- 172.21.15.84:0/807291472 wait complete. 2023-07-14T11:13:22.608 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574854 for osd.1 2023-07-14T11:13:22.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.607+0000 7fea55dff700 1 -- 172.21.15.84:0/1983106631 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fea5015b230 con 0x7fea50149d00 2023-07-14T11:13:22.610 INFO:teuthology.orchestra.run.smithi084.stdout:55834574852 2023-07-14T11:13:22.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.608+0000 7fea37fff700 1 -- 172.21.15.84:0/1983106631 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fea5015b230 con 0x7fea50149d00 2023-07-14T11:13:22.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.611+0000 7fea55dff700 1 -- 172.21.15.84:0/1983106631 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fea3c06adb0 msgr2=0x7fea3c06d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:22.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.612+0000 7fea55dff700 1 --2- 172.21.15.84:0/1983106631 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fea3c06adb0 0x7fea3c06d260 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fea4000a9f0 tx=0x7fea40008040 comp rx=0 tx=0).stop 2023-07-14T11:13:22.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.612+0000 7fea55dff700 1 -- 172.21.15.84:0/1983106631 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea50149d00 msgr2=0x7fea500c3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:22.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.612+0000 7fea55dff700 1 --2- 172.21.15.84:0/1983106631 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea50149d00 0x7fea500c3750 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fea5015c220 tx=0x7fea4800be30 comp rx=0 tx=0).stop 2023-07-14T11:13:22.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.612+0000 7fea55dff700 1 -- 172.21.15.84:0/1983106631 shutdown_connections 2023-07-14T11:13:22.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.612+0000 7fea55dff700 1 --2- 172.21.15.84:0/1983106631 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea50149d00 0x7fea500c3750 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.612+0000 7fea55dff700 1 --2- 172.21.15.84:0/1983106631 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea38004850 0x7fea500b3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.612+0000 7fea55dff700 1 --2- 172.21.15.84:0/1983106631 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fea3c06adb0 0x7fea3c06d260 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.612+0000 7fea55dff700 1 --2- 172.21.15.84:0/1983106631 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea50149890 0x7fea500c3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.612+0000 7fea55dff700 1 -- 172.21.15.84:0/1983106631 >> 172.21.15.84:0/1983106631 conn(0x7fea500b05d0 msgr2=0x7fea5014e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:22.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.613+0000 7fea55dff700 1 -- 172.21.15.84:0/1983106631 shutdown_connections 2023-07-14T11:13:22.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.613+0000 7fea55dff700 1 -- 172.21.15.84:0/1983106631 wait complete. 2023-07-14T11:13:22.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.615+0000 7f13ed9ff700 1 -- 172.21.15.84:0/2410873227 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f13e806ca40 con 0x7f13d0005320 2023-07-14T11:13:22.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.616+0000 7f13cffff700 1 -- 172.21.15.84:0/2410873227 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f13dc017090 con 0x7f13d0005320 2023-07-14T11:13:22.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.617+0000 7efe2e5ff700 1 -- 172.21.15.84:0/720761997 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7efe08005870 con 0x7efe280c5b90 2023-07-14T11:13:22.622 INFO:teuthology.orchestra.run.smithi084.stdout:55834574852 2023-07-14T11:13:22.622 INFO:teuthology.orchestra.run.smithi084.stdout:55834574852 2023-07-14T11:13:22.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.618+0000 7efe24ff9700 1 -- 172.21.15.84:0/720761997 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efe20018090 con 0x7efe280c5b90 2023-07-14T11:13:22.623 INFO:teuthology.orchestra.run.smithi084.stdout:55834574852 2023-07-14T11:13:22.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.617+0000 7fc7e51ff700 1 -- 172.21.15.84:0/2073717005 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fc7c0005870 con 0x7fc7e0070e50 2023-07-14T11:13:22.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.618+0000 7fc7c77fe700 1 -- 172.21.15.84:0/2073717005 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc7d0022090 con 0x7fc7e0070e50 2023-07-14T11:13:22.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.621+0000 7f13ed9ff700 1 -- 172.21.15.84:0/2410873227 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f13d406ad30 msgr2=0x7f13d406d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:22.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.621+0000 7f13ed9ff700 1 --2- 172.21.15.84:0/2410873227 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f13d406ad30 0x7f13d406d1e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f13e80c6240 tx=0x7f13d8008040 comp rx=0 tx=0).stop 2023-07-14T11:13:22.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.621+0000 7f13ed9ff700 1 -- 172.21.15.84:0/2410873227 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13d0005320 msgr2=0x7f13e81f5d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:22.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.621+0000 7f13ed9ff700 1 --2- 172.21.15.84:0/2410873227 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13d0005320 0x7f13e81f5d00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f13dc00e7d0 tx=0x7f13dc00eb90 comp rx=0 tx=0).stop 2023-07-14T11:13:22.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.621+0000 7fbd115ff700 1 -- 172.21.15.84:0/2981847319 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fbd0c06ca40 con 0x7fbd0c0caff0 2023-07-14T11:13:22.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.621+0000 7f13ed9ff700 1 -- 172.21.15.84:0/2410873227 shutdown_connections 2023-07-14T11:13:22.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.621+0000 7f13ed9ff700 1 --2- 172.21.15.84:0/2410873227 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13e80b3bf0 0x7f13e80b4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.621+0000 7f13ed9ff700 1 --2- 172.21.15.84:0/2410873227 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13d0005320 0x7f13e81f5d00 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.621+0000 7f13ed9ff700 1 --2- 172.21.15.84:0/2410873227 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f13d406ad30 0x7f13d406d1e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.621+0000 7f13ed9ff700 1 --2- 172.21.15.84:0/2410873227 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13e8152930 0x7f13e8152da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.621+0000 7f13ed9ff700 1 -- 172.21.15.84:0/2410873227 >> 172.21.15.84:0/2410873227 conn(0x7f13e80b05d0 msgr2=0x7f13e80c9610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:22.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.621+0000 7f13ed9ff700 1 -- 172.21.15.84:0/2410873227 shutdown_connections 2023-07-14T11:13:22.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.622+0000 7f13ed9ff700 1 -- 172.21.15.84:0/2410873227 wait complete. 2023-07-14T11:13:22.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.622+0000 7efe2e5ff700 1 -- 172.21.15.84:0/720761997 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7efe1406ad30 msgr2=0x7efe1406d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:22.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.622+0000 7efe2e5ff700 1 --2- 172.21.15.84:0/720761997 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7efe1406ad30 0x7efe1406d1e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7efe18007b30 tx=0x7efe18009040 comp rx=0 tx=0).stop 2023-07-14T11:13:22.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.622+0000 7efe2e5ff700 1 -- 172.21.15.84:0/720761997 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efe280c5b90 msgr2=0x7efe280b4350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:22.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.622+0000 7efe2e5ff700 1 --2- 172.21.15.84:0/720761997 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efe280c5b90 0x7efe280b4350 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7efe20002230 tx=0x7efe20001cf0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.622+0000 7fc7e51ff700 1 -- 172.21.15.84:0/2073717005 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc7cc06adb0 msgr2=0x7fc7cc06d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:22.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.622+0000 7fc7e51ff700 1 --2- 172.21.15.84:0/2073717005 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc7cc06adb0 0x7fc7cc06d260 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc7e015fe10 tx=0x7fc7d8007d50 comp rx=0 tx=0).stop 2023-07-14T11:13:22.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.622+0000 7fc7e51ff700 1 -- 172.21.15.84:0/2073717005 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc7e0070e50 msgr2=0x7fc7e00712d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:22.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.622+0000 7fc7e51ff700 1 --2- 172.21.15.84:0/2073717005 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc7e0070e50 0x7fc7e00712d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc7e006af10 tx=0x7fc7d0001cb0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.622+0000 7fc7e51ff700 1 -- 172.21.15.84:0/2073717005 shutdown_connections 2023-07-14T11:13:22.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.622+0000 7fc7e51ff700 1 --2- 172.21.15.84:0/2073717005 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc7cc06adb0 0x7fc7cc06d260 secure :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc7e015fe10 tx=0x7fc7d8007d50 comp rx=0 tx=0).stop 2023-07-14T11:13:22.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.622+0000 7fc7e51ff700 1 --2- 172.21.15.84:0/2073717005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc7c8005200 0x7fc7e0162c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.622+0000 7fc7e51ff700 1 --2- 172.21.15.84:0/2073717005 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc7e0070e50 0x7fc7e00712d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.622+0000 7fc7e51ff700 1 --2- 172.21.15.84:0/2073717005 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7e0163a00 0x7fc7e0206be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.622+0000 7fc7e51ff700 1 -- 172.21.15.84:0/2073717005 >> 172.21.15.84:0/2073717005 conn(0x7fc7e00b05d0 msgr2=0x7fc7e00aeda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:22.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.622+0000 7fbcf37fe700 1 -- 172.21.15.84:0/2981847319 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbd04057b80 con 0x7fbd0c0caff0 2023-07-14T11:13:22.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.622+0000 7efe2e5ff700 1 -- 172.21.15.84:0/720761997 shutdown_connections 2023-07-14T11:13:22.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.622+0000 7efe2e5ff700 1 --2- 172.21.15.84:0/720761997 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efe28201db0 0x7efe280b09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.622+0000 7efe2e5ff700 1 --2- 172.21.15.84:0/720761997 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe10004850 0x7efe280c89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.622+0000 7efe2e5ff700 1 --2- 172.21.15.84:0/720761997 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7efe1406ad30 0x7efe1406d1e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.622+0000 7efe2e5ff700 1 --2- 172.21.15.84:0/720761997 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efe280c5b90 0x7efe280b4350 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.622+0000 7efe2e5ff700 1 -- 172.21.15.84:0/720761997 >> 172.21.15.84:0/720761997 conn(0x7efe280b05d0 msgr2=0x7efe281645a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:22.630 INFO:teuthology.orchestra.run.smithi084.stdout:55834574854 2023-07-14T11:13:22.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.622+0000 7efe2e5ff700 1 -- 172.21.15.84:0/720761997 shutdown_connections 2023-07-14T11:13:22.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.623+0000 7efe2e5ff700 1 -- 172.21.15.84:0/720761997 wait complete. 2023-07-14T11:13:22.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.622+0000 7fc7e51ff700 1 -- 172.21.15.84:0/2073717005 shutdown_connections 2023-07-14T11:13:22.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.623+0000 7fc7e51ff700 1 -- 172.21.15.84:0/2073717005 wait complete. 2023-07-14T11:13:22.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.626+0000 7fbd115ff700 1 -- 172.21.15.84:0/2981847319 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fbcf806adb0 msgr2=0x7fbcf806d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:22.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.626+0000 7fbd115ff700 1 --2- 172.21.15.84:0/2981847319 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fbcf806adb0 0x7fbcf806d260 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c0715d0 tx=0x7fbcfc006d10 comp rx=0 tx=0).stop 2023-07-14T11:13:22.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.626+0000 7fbd115ff700 1 -- 172.21.15.84:0/2981847319 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd0c0caff0 msgr2=0x7fbd0c1567d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:22.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.626+0000 7fbd115ff700 1 --2- 172.21.15.84:0/2981847319 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd0c0caff0 0x7fbd0c1567d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbd0400cbb0 tx=0x7fbd0400cec0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.630+0000 7fbd115ff700 1 -- 172.21.15.84:0/2981847319 shutdown_connections 2023-07-14T11:13:22.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.630+0000 7fbd115ff700 1 --2- 172.21.15.84:0/2981847319 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fbcf806adb0 0x7fbcf806d260 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.630+0000 7fbd115ff700 1 --2- 172.21.15.84:0/2981847319 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd0c1f70e0 0x7fbd0c070780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.630+0000 7fbd115ff700 1 --2- 172.21.15.84:0/2981847319 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd0c0caff0 0x7fbd0c1567d0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.630+0000 7fbd115ff700 1 --2- 172.21.15.84:0/2981847319 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd0c1587d0 0x7fbd0c0b4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.630+0000 7fbd115ff700 1 -- 172.21.15.84:0/2981847319 >> 172.21.15.84:0/2981847319 conn(0x7fbd0c0b05d0 msgr2=0x7fbd0c0b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:22.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.630+0000 7fbd115ff700 1 -- 172.21.15.84:0/2981847319 shutdown_connections 2023-07-14T11:13:22.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.630+0000 7fbd115ff700 1 -- 172.21.15.84:0/2981847319 wait complete. 2023-07-14T11:13:22.638 INFO:teuthology.orchestra.run.smithi084.stdout:55834574855 2023-07-14T11:13:22.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.634+0000 7f9c81fff700 1 -- 172.21.15.84:0/3322048584 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f9c7c0c3780 con 0x7f9c7c1587d0 2023-07-14T11:13:22.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.635+0000 7f9c6bfff700 1 -- 172.21.15.84:0/3322048584 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9c7c0c3780 con 0x7f9c7c1587d0 2023-07-14T11:13:22.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.639+0000 7f9c81fff700 1 -- 172.21.15.84:0/3322048584 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f9c6006acb0 msgr2=0x7f9c6006d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:22.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.639+0000 7f9c81fff700 1 --2- 172.21.15.84:0/3322048584 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f9c6006acb0 0x7f9c6006d160 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c1f4460 tx=0x7f9c6c008040 comp rx=0 tx=0).stop 2023-07-14T11:13:22.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.639+0000 7f9c81fff700 1 -- 172.21.15.84:0/3322048584 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c7c1587d0 msgr2=0x7f9c7c0c6be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:22.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.639+0000 7f9c81fff700 1 --2- 172.21.15.84:0/3322048584 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c7c1587d0 0x7f9c7c0c6be0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c06d720 tx=0x7f9c7000c790 comp rx=0 tx=0).stop 2023-07-14T11:13:22.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.640+0000 7f9c81fff700 1 -- 172.21.15.84:0/3322048584 shutdown_connections 2023-07-14T11:13:22.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.640+0000 7f9c81fff700 1 --2- 172.21.15.84:0/3322048584 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c7c0c7120 0x7f9c7c0cb7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.640+0000 7f9c81fff700 1 --2- 172.21.15.84:0/3322048584 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c7c0ce650 0x7f9c7c1f3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.640+0000 7f9c81fff700 1 --2- 172.21.15.84:0/3322048584 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f9c6006acb0 0x7f9c6006d160 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.640+0000 7f9c81fff700 1 --2- 172.21.15.84:0/3322048584 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c7c1587d0 0x7f9c7c0c6be0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.640+0000 7f9c81fff700 1 -- 172.21.15.84:0/3322048584 >> 172.21.15.84:0/3322048584 conn(0x7f9c7c0b05d0 msgr2=0x7f9c7c0cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:22.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.640+0000 7f9c81fff700 1 -- 172.21.15.84:0/3322048584 shutdown_connections 2023-07-14T11:13:22.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.640+0000 7f9c81fff700 1 -- 172.21.15.84:0/3322048584 wait complete. 2023-07-14T11:13:22.646 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574852 for osd.3 2023-07-14T11:13:22.650 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574852 for osd.2 2023-07-14T11:13:22.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.649+0000 7f4d8ddff700 1 -- 172.21.15.84:0/1536090134 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f4d88074350 con 0x7f4d880c9d60 2023-07-14T11:13:22.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.650+0000 7f4d6ffff700 1 -- 172.21.15.84:0/1536090134 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4d780574c0 con 0x7f4d880c9d60 2023-07-14T11:13:22.652 INFO:teuthology.orchestra.run.smithi084.stdout:55834574854 2023-07-14T11:13:22.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.653+0000 7f4d8ddff700 1 -- 172.21.15.84:0/1536090134 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f4d7406adb0 msgr2=0x7f4d7406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:22.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.653+0000 7f4d8ddff700 1 --2- 172.21.15.84:0/1536090134 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f4d7406adb0 0x7f4d7406d260 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4d880b29c0 tx=0x7f4d7c009040 comp rx=0 tx=0).stop 2023-07-14T11:13:22.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.653+0000 7f4d8ddff700 1 -- 172.21.15.84:0/1536090134 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d880c9d60 msgr2=0x7f4d881fe9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:22.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.653+0000 7f4d8ddff700 1 --2- 172.21.15.84:0/1536090134 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d880c9d60 0x7f4d881fe9e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4d7800c4e0 tx=0x7f4d7800c8a0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.653+0000 7f4d8ddff700 1 -- 172.21.15.84:0/1536090134 shutdown_connections 2023-07-14T11:13:22.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.653+0000 7f4d8ddff700 1 --2- 172.21.15.84:0/1536090134 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d88160be0 0x7f4d8815cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.653+0000 7f4d8ddff700 1 --2- 172.21.15.84:0/1536090134 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d880c9d60 0x7f4d881fe9e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.653+0000 7f4d8ddff700 1 --2- 172.21.15.84:0/1536090134 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f4d7406adb0 0x7f4d7406d260 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.653+0000 7f4d8ddff700 1 --2- 172.21.15.84:0/1536090134 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d880cea20 0x7f4d8815c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:22.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.653+0000 7f4d8ddff700 1 -- 172.21.15.84:0/1536090134 >> 172.21.15.84:0/1536090134 conn(0x7f4d880cef10 msgr2=0x7f4d8806df00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:22.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.653+0000 7f4d8ddff700 1 -- 172.21.15.84:0/1536090134 shutdown_connections 2023-07-14T11:13:22.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:22.653+0000 7f4d8ddff700 1 -- 172.21.15.84:0/1536090134 wait complete. 2023-07-14T11:13:22.659 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574852 for osd.0 2023-07-14T11:13:22.660 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574852 for osd.4 2023-07-14T11:13:22.661 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574854 for osd.7 2023-07-14T11:13:22.670 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574855 for osd.6 2023-07-14T11:13:22.675 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574854 for osd.5 2023-07-14T11:13:23.609 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-07-14T11:13:23.647 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-07-14T11:13:23.650 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-07-14T11:13:23.660 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-07-14T11:13:23.660 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-07-14T11:13:23.661 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-07-14T11:13:23.670 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-07-14T11:13:23.676 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-07-14T11:13:23.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.917+0000 7fee533ff700 1 Processor -- start 2023-07-14T11:13:23.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.918+0000 7fee533ff700 1 -- start start 2023-07-14T11:13:23.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.920+0000 7fee533ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fee4c160c30 0x7fee4c0cd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:23.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.920+0000 7fee533ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fee4c0cdbe0 0x7fee4c0ce060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:23.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.920+0000 7fee533ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee4c161000 con 0x7fee4c164710 2023-07-14T11:13:23.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.920+0000 7fee533ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee4c0ce5a0 con 0x7fee4c0cdbe0 2023-07-14T11:13:23.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.920+0000 7fee533ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee4c165400 con 0x7fee4c160c30 2023-07-14T11:13:23.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.921+0000 7fee5119b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fee4c160c30 0x7fee4c0cd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:23.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.921+0000 7fee5119b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fee4c160c30 0x7fee4c0cd2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.84:52020/0 (socket says 172.21.15.84:52020) 2023-07-14T11:13:23.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.921+0000 7fee5119b700 1 -- 172.21.15.84:0/2729976927 learned_addr learned my addr 172.21.15.84:0/2729976927 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:23.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.922+0000 7fee5119b700 1 -- 172.21.15.84:0/2729976927 >> v2:172.21.15.84:3300/0 conn(0x7fee4c0cdbe0 msgr2=0x7fee4c0ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:23.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.922+0000 7fee5119b700 1 --2- 172.21.15.84:0/2729976927 >> v2:172.21.15.84:3300/0 conn(0x7fee4c0cdbe0 0x7fee4c0ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:23.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.922+0000 7fee5119b700 1 -- 172.21.15.84:0/2729976927 >> v1:172.21.15.179:6789/0 conn(0x7fee4c164710 legacy=0x7fee4c164b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:23.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.922+0000 7fee5119b700 1 -- 172.21.15.84:0/2729976927 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee4c0cc810 con 0x7fee4c160c30 2023-07-14T11:13:23.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.922+0000 7fee5119b700 1 --2- 172.21.15.84:0/2729976927 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee4c160c30 0x7fee4c0cd2f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fee4c072250 tx=0x7fee4400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b977a70dd718535 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:23.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.924+0000 7fee43fff700 1 -- 172.21.15.84:0/2729976927 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4400e070 con 0x7fee4c160c30 2023-07-14T11:13:23.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.924+0000 7fee43fff700 1 -- 172.21.15.84:0/2729976927 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee44003a20 con 0x7fee4c160c30 2023-07-14T11:13:23.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.924+0000 7fee43fff700 1 -- 172.21.15.84:0/2729976927 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee44003dd0 con 0x7fee4c160c30 2023-07-14T11:13:23.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.925+0000 7fee533ff700 1 -- 172.21.15.84:0/2729976927 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee4c160c30 msgr2=0x7fee4c0cd2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:23.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.925+0000 7fee533ff700 1 --2- 172.21.15.84:0/2729976927 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee4c160c30 0x7fee4c0cd2f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fee4c072250 tx=0x7fee4400b330 comp rx=0 tx=0).stop 2023-07-14T11:13:23.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.926+0000 7fee533ff700 1 -- 172.21.15.84:0/2729976927 shutdown_connections 2023-07-14T11:13:23.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.926+0000 7fee533ff700 1 --2- 172.21.15.84:0/2729976927 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee4c160c30 0x7fee4c0cd2f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:23.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.926+0000 7fee533ff700 1 --2- 172.21.15.84:0/2729976927 >> v2:172.21.15.84:3300/0 conn(0x7fee4c0cdbe0 0x7fee4c0ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:23.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.926+0000 7fee533ff700 1 -- 172.21.15.84:0/2729976927 >> 172.21.15.84:0/2729976927 conn(0x7fee4c0b05d0 msgr2=0x7fee4c0b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:23.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.927+0000 7fee533ff700 1 -- 172.21.15.84:0/2729976927 shutdown_connections 2023-07-14T11:13:23.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.927+0000 7fee533ff700 1 -- 172.21.15.84:0/2729976927 wait complete. 2023-07-14T11:13:23.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.930+0000 7fee533ff700 1 Processor -- start 2023-07-14T11:13:23.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.931+0000 7fee533ff700 1 -- start start 2023-07-14T11:13:23.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.932+0000 7fee533ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee4c0cdbe0 0x7fee4c14fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:23.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.932+0000 7fee533ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee4c160c30 0x7fee4c0c25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:23.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.932+0000 7fee533ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee4c164710 0x7fee4c0c2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:23.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.933+0000 7fee533ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee4c0c3730 con 0x7fee4c164710 2023-07-14T11:13:23.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.933+0000 7fee533ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee4c0c3a10 con 0x7fee4c0cdbe0 2023-07-14T11:13:23.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.933+0000 7fee533ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee4c0c3cf0 con 0x7fee4c160c30 2023-07-14T11:13:23.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.935+0000 7fee5199c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee4c164710 0x7fee4c0c2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:23.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.935+0000 7fee5199c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee4c164710 0x7fee4c0c2b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34230/0 (socket says 172.21.15.84:34230) 2023-07-14T11:13:23.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.935+0000 7fee5199c700 1 -- 172.21.15.84:0/4197876310 learned_addr learned my addr 172.21.15.84:0/4197876310 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:23.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.936+0000 7fee5199c700 1 -- 172.21.15.84:0/4197876310 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee4c160c30 msgr2=0x7fee4c0c25f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-14T11:13:23.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.936+0000 7fee5199c700 1 --2- 172.21.15.84:0/4197876310 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee4c160c30 0x7fee4c0c25f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:23.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.936+0000 7fee5199c700 1 -- 172.21.15.84:0/4197876310 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee4c0cdbe0 msgr2=0x7fee4c14fbb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-14T11:13:23.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.936+0000 7fee5199c700 1 --2- 172.21.15.84:0/4197876310 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee4c0cdbe0 0x7fee4c14fbb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:23.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.936+0000 7fee5199c700 1 -- 172.21.15.84:0/4197876310 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee44009b30 con 0x7fee4c164710 2023-07-14T11:13:23.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.937+0000 7fee5199c700 1 --2- 172.21.15.84:0/4197876310 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee4c164710 0x7fee4c0c2b30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fee3c00b3e0 tx=0x7fee3c00b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:23.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.938+0000 7fee41ffb700 1 -- 172.21.15.84:0/4197876310 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee3c011830 con 0x7fee4c164710 2023-07-14T11:13:23.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.938+0000 7fee41ffb700 1 -- 172.21.15.84:0/4197876310 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee3c0119b0 con 0x7fee4c164710 2023-07-14T11:13:23.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.938+0000 7fee41ffb700 1 -- 172.21.15.84:0/4197876310 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee3c011d60 con 0x7fee4c164710 2023-07-14T11:13:23.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.938+0000 7fee533ff700 1 -- 172.21.15.84:0/4197876310 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee4c0c3fd0 con 0x7fee4c164710 2023-07-14T11:13:23.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.938+0000 7fee533ff700 1 -- 172.21.15.84:0/4197876310 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee4c1500f0 con 0x7fee4c164710 2023-07-14T11:13:23.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.944+0000 7fee41ffb700 1 -- 172.21.15.84:0/4197876310 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fee3c01a400 con 0x7fee4c164710 2023-07-14T11:13:23.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.945+0000 7fee41ffb700 1 --2- 172.21.15.84:0/4197876310 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fee3006adb0 0x7fee3006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:23.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.946+0000 7fee41ffb700 1 -- 172.21.15.84:0/4197876310 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fee3c089440 con 0x7fee4c164710 2023-07-14T11:13:23.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.948+0000 7fee533ff700 1 -- 172.21.15.84:0/4197876310 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee2c0052f0 con 0x7fee4c164710 2023-07-14T11:13:23.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.948+0000 7fee5119b700 1 --2- 172.21.15.84:0/4197876310 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fee3006adb0 0x7fee3006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:23.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.949+0000 7fee5119b700 1 --2- 172.21.15.84:0/4197876310 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fee3006adb0 0x7fee3006d260 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fee4c0b3b00 tx=0x7fee44009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:23.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.958+0000 7fee41ffb700 1 -- 172.21.15.84:0/4197876310 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fee3c0544f0 con 0x7fee4c164710 2023-07-14T11:13:23.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.984+0000 7f98b4fff700 1 Processor -- start 2023-07-14T11:13:23.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.984+0000 7f98b4fff700 1 -- start start 2023-07-14T11:13:23.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.986+0000 7f98b4fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f98b00cdf40 0x7f98b00ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:23.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.986+0000 7f98b4fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f98b00caff0 0x7f98b00cb490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:23.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.986+0000 7f98b4fff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98b00cab60 con 0x7f98b01587d0 2023-07-14T11:13:23.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.986+0000 7f98b4fff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98b00ce8f0 con 0x7f98b00caff0 2023-07-14T11:13:23.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.986+0000 7f98b4fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98b006bcc0 con 0x7f98b00cdf40 2023-07-14T11:13:23.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.988+0000 7f98aed9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f98b00caff0 0x7f98b00cb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:23.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.988+0000 7f98aed9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f98b00caff0 0x7f98b00cb490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34232/0 (socket says 172.21.15.84:34232) 2023-07-14T11:13:23.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.988+0000 7f98aed9d700 1 -- 172.21.15.84:0/3896911642 learned_addr learned my addr 172.21.15.84:0/3896911642 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:23.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.988+0000 7f98aed9d700 1 -- 172.21.15.84:0/3896911642 >> v2:172.21.15.179:3300/0 conn(0x7f98b00cdf40 msgr2=0x7f98b00ce3b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T11:13:23.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.988+0000 7f98aed9d700 1 --2- 172.21.15.84:0/3896911642 >> v2:172.21.15.179:3300/0 conn(0x7f98b00cdf40 0x7f98b00ce3b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:23.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.988+0000 7f98aed9d700 1 -- 172.21.15.84:0/3896911642 >> v1:172.21.15.84:6789/0 conn(0x7f98b01587d0 legacy=0x7f98b006b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:23.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.988+0000 7f98aed9d700 1 -- 172.21.15.84:0/3896911642 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98b0158ba0 con 0x7f98b00caff0 2023-07-14T11:13:23.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.989+0000 7f98aed9d700 1 --2- 172.21.15.84:0/3896911642 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98b00caff0 0x7f98b00cb490 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f98b00cdaf0 tx=0x7f98a400d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c44adbf50c3969 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:23.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.990+0000 7f98ad59a700 1 -- 172.21.15.84:0/3896911642 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a4010070 con 0x7f98b00caff0 2023-07-14T11:13:23.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.990+0000 7f98ad59a700 1 -- 172.21.15.84:0/3896911642 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98a400da40 con 0x7f98b00caff0 2023-07-14T11:13:23.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.990+0000 7f98ad59a700 1 -- 172.21.15.84:0/3896911642 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a400ddd0 con 0x7f98b00caff0 2023-07-14T11:13:23.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.991+0000 7f98b4fff700 1 -- 172.21.15.84:0/3896911642 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98b00caff0 msgr2=0x7f98b00cb490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:23.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.991+0000 7f98b4fff700 1 --2- 172.21.15.84:0/3896911642 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98b00caff0 0x7f98b00cb490 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f98b00cdaf0 tx=0x7f98a400d330 comp rx=0 tx=0).stop 2023-07-14T11:13:23.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.992+0000 7f98b4fff700 1 -- 172.21.15.84:0/3896911642 shutdown_connections 2023-07-14T11:13:23.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.992+0000 7f98b4fff700 1 --2- 172.21.15.84:0/3896911642 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98b00caff0 0x7f98b00cb490 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:23.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.992+0000 7f98b4fff700 1 --2- 172.21.15.84:0/3896911642 >> v2:172.21.15.179:3300/0 conn(0x7f98b00cdf40 0x7f98b00ce3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:23.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.992+0000 7f98b4fff700 1 -- 172.21.15.84:0/3896911642 >> 172.21.15.84:0/3896911642 conn(0x7f98b00b05d0 msgr2=0x7f98b00b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:23.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.993+0000 7f98b4fff700 1 -- 172.21.15.84:0/3896911642 shutdown_connections 2023-07-14T11:13:23.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.993+0000 7f98b4fff700 1 -- 172.21.15.84:0/3896911642 wait complete. 2023-07-14T11:13:23.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.996+0000 7f98b4fff700 1 Processor -- start 2023-07-14T11:13:23.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:23.996+0000 7f98b4fff700 1 -- start start 2023-07-14T11:13:24.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.000+0000 7f98b4fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98b00caff0 0x7f98b00cbad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:24.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.000+0000 7f98b4fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98b00cdf40 0x7f98b0159c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:24.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.000+0000 7f98b4fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98b01587d0 0x7f98b01574f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:24.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.000+0000 7f98b4fff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b01597c0 con 0x7f98b00caff0 2023-07-14T11:13:24.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.000+0000 7f98b4fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b0158e90 con 0x7f98b01587d0 2023-07-14T11:13:24.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.000+0000 7f98b4fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98b0159170 con 0x7f98b00cdf40 2023-07-14T11:13:24.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.001+0000 7f98add9b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98b00cdf40 0x7f98b0159c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:24.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.001+0000 7f98add9b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98b00cdf40 0x7f98b0159c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.84:36172/0 (socket says 172.21.15.84:36172) 2023-07-14T11:13:24.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.001+0000 7f98add9b700 1 -- 172.21.15.84:0/1089477377 learned_addr learned my addr 172.21.15.84:0/1089477377 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:24.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.001+0000 7f98aed9d700 1 --2- 172.21.15.84:0/1089477377 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98b01587d0 0x7f98b01574f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:24.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.002+0000 7f98ae59c700 1 --2- 172.21.15.84:0/1089477377 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98b00caff0 0x7f98b00cbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:24.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.003+0000 7f98ae59c700 1 -- 172.21.15.84:0/1089477377 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98b00cdf40 msgr2=0x7f98b0159c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:24.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.003+0000 7f98ae59c700 1 --2- 172.21.15.84:0/1089477377 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98b00cdf40 0x7f98b0159c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:24.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.003+0000 7f98ae59c700 1 -- 172.21.15.84:0/1089477377 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98b01587d0 msgr2=0x7f98b01574f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:24.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.003+0000 7f98ae59c700 1 --2- 172.21.15.84:0/1089477377 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98b01587d0 0x7f98b01574f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:24.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.003+0000 7f98ae59c700 1 -- 172.21.15.84:0/1089477377 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98a40085d0 con 0x7f98b00caff0 2023-07-14T11:13:24.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.003+0000 7f98aed9d700 1 --2- 172.21.15.84:0/1089477377 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98b01587d0 0x7f98b01574f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:13:24.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.003+0000 7f98add9b700 1 --2- 172.21.15.84:0/1089477377 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98b00cdf40 0x7f98b0159c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:13:24.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.004+0000 7f98ae59c700 1 --2- 172.21.15.84:0/1089477377 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98b00caff0 0x7f98b00cbad0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f98a800c780 tx=0x7f98a800ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:24.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.004+0000 7f989effd700 1 -- 172.21.15.84:0/1089477377 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a8003e10 con 0x7f98b00caff0 2023-07-14T11:13:24.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.004+0000 7f989effd700 1 -- 172.21.15.84:0/1089477377 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98a8005070 con 0x7f98b00caff0 2023-07-14T11:13:24.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.004+0000 7f989effd700 1 -- 172.21.15.84:0/1089477377 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a8005420 con 0x7f98b00caff0 2023-07-14T11:13:24.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.004+0000 7f98b4fff700 1 -- 172.21.15.84:0/1089477377 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98b0159450 con 0x7f98b00caff0 2023-07-14T11:13:24.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.004+0000 7f98b4fff700 1 -- 172.21.15.84:0/1089477377 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98b015b530 con 0x7f98b00caff0 2023-07-14T11:13:24.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.006+0000 7f98b4fff700 1 -- 172.21.15.84:0/1089477377 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98940052f0 con 0x7f98b00caff0 2023-07-14T11:13:24.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.010+0000 7f989effd700 1 -- 172.21.15.84:0/1089477377 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f98a8005580 con 0x7f98b00caff0 2023-07-14T11:13:24.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.012+0000 7f989effd700 1 --2- 172.21.15.84:0/1089477377 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f989006adb0 0x7f989006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:24.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.012+0000 7f989effd700 1 -- 172.21.15.84:0/1089477377 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f98a8088ee0 con 0x7f98b00caff0 2023-07-14T11:13:24.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.016+0000 7f98add9b700 1 --2- 172.21.15.84:0/1089477377 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f989006adb0 0x7f989006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:24.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.017+0000 7f98add9b700 1 --2- 172.21.15.84:0/1089477377 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f989006adb0 0x7f989006d260 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f98a0009dc0 tx=0x7f98a0009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:24.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.018+0000 7f989effd700 1 -- 172.21.15.84:0/1089477377 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f98a8054000 con 0x7f98b00caff0 2023-07-14T11:13:24.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.013+0000 7f60e15ff700 1 Processor -- start 2023-07-14T11:13:24.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.013+0000 7f60e15ff700 1 -- start start 2023-07-14T11:13:24.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.015+0000 7f60e15ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60dc160c30 0x7f60dc0cd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:24.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.015+0000 7f60e15ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f60dc0cdbe0 0x7f60dc0ce030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:24.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.015+0000 7f60e15ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f60dc164710 0x7f60dc164b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:24.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.015+0000 7f60e15ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60dc0ce570 con 0x7f60dc164710 2023-07-14T11:13:24.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.015+0000 7f60e15ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60dc161000 con 0x7f60dc0cdbe0 2023-07-14T11:13:24.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.015+0000 7f60e15ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60dc165400 con 0x7f60dc160c30 2023-07-14T11:13:24.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.016+0000 7f60da7fc700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f60dc0cdbe0 0x7f60dc0ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:24.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.016+0000 7f60da7fc700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f60dc0cdbe0 0x7f60dc0ce030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.84:52060/0 (socket says 172.21.15.84:52060) 2023-07-14T11:13:24.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.016+0000 7f60da7fc700 1 -- 172.21.15.84:0/3548250532 learned_addr learned my addr 172.21.15.84:0/3548250532 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:24.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.016+0000 7f60daffd700 1 --2- 172.21.15.84:0/3548250532 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60dc160c30 0x7f60dc0cd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:24.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.017+0000 7f60da7fc700 1 -- 172.21.15.84:0/3548250532 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60dc160c30 msgr2=0x7f60dc0cd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:24.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.017+0000 7f60da7fc700 1 --2- 172.21.15.84:0/3548250532 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60dc160c30 0x7f60dc0cd2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:24.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.017+0000 7f60da7fc700 1 -- 172.21.15.84:0/3548250532 >> v2:172.21.15.84:3300/0 conn(0x7f60dc164710 msgr2=0x7f60dc164b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:24.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.017+0000 7f60da7fc700 1 --2- 172.21.15.84:0/3548250532 >> v2:172.21.15.84:3300/0 conn(0x7f60dc164710 0x7f60dc164b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:24.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.017+0000 7f60da7fc700 1 -- 172.21.15.84:0/3548250532 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60dc0cc810 con 0x7f60dc0cdbe0 2023-07-14T11:13:24.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.014+0000 7efdc81ff700 1 Processor -- start 2023-07-14T11:13:24.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.015+0000 7efdc81ff700 1 -- start start 2023-07-14T11:13:24.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.017+0000 7efdc81ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7efdc01587d0 0x7efdc006b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:24.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.017+0000 7efdc81ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efdc006baf0 0x7efdc00cdf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:24.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.017+0000 7efdc81ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdc00cc000 con 0x7efdc00ce480 2023-07-14T11:13:24.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.017+0000 7efdc81ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdc00ce8f0 con 0x7efdc01587d0 2023-07-14T11:13:24.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.017+0000 7efdc81ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdc00cab60 con 0x7efdc006baf0 2023-07-14T11:13:24.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.017+0000 7faf0b1ff700 1 Processor -- start 2023-07-14T11:13:24.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.017+0000 7faf0b1ff700 1 -- start start 2023-07-14T11:13:24.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.019+0000 7faf0b1ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7faf0416cfa0 0x7faf040cc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:24.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.019+0000 7faf0b1ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf040cd910 con 0x7faf0416d7f0 2023-07-14T11:13:24.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.019+0000 7faf0b1ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf040ccfe0 con 0x7faf040ce2f0 2023-07-14T11:13:24.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.019+0000 7faf0b1ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf0416d370 con 0x7faf0416cfa0 2023-07-14T11:13:24.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.020+0000 7f60da7fc700 1 --2- 172.21.15.84:0/3548250532 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60dc0cdbe0 0x7f60dc0ce030 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f60dc067540 tx=0x7f60d0009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0d9fe5cec30849a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:24.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.021+0000 7f60d9ffb700 1 -- 172.21.15.84:0/3548250532 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d0011830 con 0x7f60dc0cdbe0 2023-07-14T11:13:24.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.021+0000 7f60d9ffb700 1 -- 172.21.15.84:0/3548250532 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60d0011990 con 0x7f60dc0cdbe0 2023-07-14T11:13:24.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.021+0000 7f60d9ffb700 1 -- 172.21.15.84:0/3548250532 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d0011d20 con 0x7f60dc0cdbe0 2023-07-14T11:13:24.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.020+0000 7faf0979c700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7faf040ce2f0 0x7faf04174310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.84:50316/0 (socket says 172.21.15.84:50316) 2023-07-14T11:13:24.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.020+0000 7faf0979c700 1 -- 172.21.15.84:0/3243223992 learned_addr learned my addr 172.21.15.84:0/3243223992 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:13:24.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.021+0000 7faf08f9b700 1 --2- 172.21.15.84:0/3243223992 >> v2:172.21.15.84:3300/0 conn(0x7faf0416cfa0 0x7faf040cc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:24.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.021+0000 7faf037fe700 1 -- 172.21.15.84:0/3243223992 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 383512795 0 0) 0x7faf040ccfe0 con 0x7faf040ce2f0 2023-07-14T11:13:24.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.021+0000 7faf037fe700 1 -- 172.21.15.84:0/3243223992 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faeec0035b0 con 0x7faf040ce2f0 2023-07-14T11:13:24.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.018+0000 7efdc5f9b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7efdc01587d0 0x7efdc006b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:24.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.018+0000 7efdc5f9b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7efdc01587d0 0x7efdc006b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.84:52068/0 (socket says 172.21.15.84:52068) 2023-07-14T11:13:24.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.018+0000 7efdc5f9b700 1 -- 172.21.15.84:0/2377452490 learned_addr learned my addr 172.21.15.84:0/2377452490 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:24.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.018+0000 7efdc579a700 1 --2- 172.21.15.84:0/2377452490 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efdc006baf0 0x7efdc00cdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:24.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.019+0000 7efdc579a700 1 -- 172.21.15.84:0/2377452490 >> v2:172.21.15.179:3300/0 conn(0x7efdc01587d0 msgr2=0x7efdc006b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:24.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.019+0000 7efdc579a700 1 --2- 172.21.15.84:0/2377452490 >> v2:172.21.15.179:3300/0 conn(0x7efdc01587d0 0x7efdc006b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:24.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.019+0000 7efdc579a700 1 -- 172.21.15.84:0/2377452490 >> v1:172.21.15.179:6789/0 conn(0x7efdc00ce480 legacy=0x7efdc00cc690 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T11:13:24.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.019+0000 7efdc579a700 1 -- 172.21.15.84:0/2377452490 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdc0158ba0 con 0x7efdc006baf0 2023-07-14T11:13:24.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.020+0000 7efdc579a700 1 --2- 172.21.15.84:0/2377452490 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efdc006baf0 0x7efdc00cdf40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7efdbc00dc60 tx=0x7efdbc00df70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10bf7fcf55c27350 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:24.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.022+0000 7f60e15ff700 1 -- 172.21.15.84:0/3548250532 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60dc0cdbe0 msgr2=0x7f60dc0ce030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:24.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.022+0000 7f60e15ff700 1 --2- 172.21.15.84:0/3548250532 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60dc0cdbe0 0x7f60dc0ce030 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f60dc067540 tx=0x7f60d0009bd0 comp rx=0 tx=0).stop 2023-07-14T11:13:24.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.022+0000 7faf037fe700 1 -- 172.21.15.84:0/3243223992 <== mon.1 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2777941816 0 0) 0x7faeec0035b0 con 0x7faf040ce2f0 2023-07-14T11:13:24.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.022+0000 7faf037fe700 1 -- 172.21.15.84:0/3243223992 >> v2:172.21.15.84:3300/0 conn(0x7faf0416cfa0 msgr2=0x7faf040cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:24.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.022+0000 7faf037fe700 1 --2- 172.21.15.84:0/3243223992 >> v2:172.21.15.84:3300/0 conn(0x7faf0416cfa0 0x7faf040cc690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:24.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.022+0000 7faf037fe700 1 -- 172.21.15.84:0/3243223992 >> v1:172.21.15.84:6789/0 conn(0x7faf0416d7f0 legacy=0x7faf040cdbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:24.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.022+0000 7faf037fe700 1 -- 172.21.15.84:0/3243223992 --> v1:172.21.15.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf040cd2c0 con 0x7faf040ce2f0 2023-07-14T11:13:24.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.022+0000 7faf037fe700 1 -- 172.21.15.84:0/3243223992 <== mon.1 v1:172.21.15.179:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7faefc0019f0 con 0x7faf040ce2f0 2023-07-14T11:13:24.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.022+0000 7faf037fe700 1 -- 172.21.15.84:0/3243223992 >> v1:172.21.15.179:6789/0 conn(0x7faf040ce2f0 legacy=0x7faf04174310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:24.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.022+0000 7faf037fe700 1 --2- 172.21.15.84:0/3243223992 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faeec003a00 0x7faeec003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:24.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.022+0000 7faf037fe700 1 --2- 172.21.15.84:0/3243223992 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faeec004850 0x7faeec004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:24.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.022+0000 7faf037fe700 1 --2- 172.21.15.84:0/3243223992 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faeec009a00 0x7faeec005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:24.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.022+0000 7faf037fe700 1 -- 172.21.15.84:0/3243223992 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeec014870 con 0x7faeec003a00 2023-07-14T11:13:24.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.022+0000 7faf037fe700 1 -- 172.21.15.84:0/3243223992 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeec0149e0 con 0x7faeec004850 2023-07-14T11:13:24.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.022+0000 7faf037fe700 1 -- 172.21.15.84:0/3243223992 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeec014ba0 con 0x7faeec009a00 2023-07-14T11:13:24.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.023+0000 7faf03fff700 1 --2- 172.21.15.84:0/3243223992 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faeec004850 0x7faeec004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:24.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.023+0000 7faf08f9b700 1 --2- 172.21.15.84:0/3243223992 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faeec003a00 0x7faeec003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:24.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.023+0000 7faf03fff700 1 -- 172.21.15.84:0/3243223992 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faeec009a00 msgr2=0x7faeec005200 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T11:13:24.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.023+0000 7faf03fff700 1 --2- 172.21.15.84:0/3243223992 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faeec009a00 0x7faeec005200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:24.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.023+0000 7faf03fff700 1 -- 172.21.15.84:0/3243223992 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faeec003a00 msgr2=0x7faeec003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:24.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.023+0000 7faf03fff700 1 --2- 172.21.15.84:0/3243223992 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faeec003a00 0x7faeec003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:24.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.023+0000 7faf03fff700 1 -- 172.21.15.84:0/3243223992 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf040cd2c0 con 0x7faeec004850 2023-07-14T11:13:24.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.024+0000 7faf03fff700 1 --2- 172.21.15.84:0/3243223992 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faeec004850 0x7faeec004cc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7faef8007fd0 tx=0x7faeec005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=509d2691382ab233 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:24.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.023+0000 7efdc4f99700 1 -- 172.21.15.84:0/2377452490 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdbc004230 con 0x7efdc006baf0 2023-07-14T11:13:24.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.023+0000 7efdc4f99700 1 -- 172.21.15.84:0/2377452490 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdbc004390 con 0x7efdc006baf0 2023-07-14T11:13:24.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.023+0000 7efdc4f99700 1 -- 172.21.15.84:0/2377452490 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdbc00d280 con 0x7efdc006baf0 2023-07-14T11:13:24.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.024+0000 7faf0979c700 1 -- 172.21.15.84:0/3243223992 reap_dead start 2023-07-14T11:13:24.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.024+0000 7faf037fe700 1 -- 172.21.15.84:0/3243223992 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef80052d0 con 0x7faeec004850 2023-07-14T11:13:24.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.024+0000 7faf037fe700 1 -- 172.21.15.84:0/3243223992 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faef8005430 con 0x7faeec004850 2023-07-14T11:13:24.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.024+0000 7faf037fe700 1 -- 172.21.15.84:0/3243223992 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef80038c0 con 0x7faeec004850 2023-07-14T11:13:24.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.025+0000 7faf0b1ff700 1 -- 172.21.15.84:0/3243223992 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faeec004850 msgr2=0x7faeec004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:24.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.025+0000 7faf0b1ff700 1 --2- 172.21.15.84:0/3243223992 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faeec004850 0x7faeec004cc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7faef8007fd0 tx=0x7faeec005880 comp rx=0 tx=0).stop 2023-07-14T11:13:24.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.025+0000 7faf0b1ff700 1 -- 172.21.15.84:0/3243223992 shutdown_connections 2023-07-14T11:13:24.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.025+0000 7faf0b1ff700 1 --2- 172.21.15.84:0/3243223992 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faeec004850 0x7faeec004cc0 secure :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7faef8007fd0 tx=0x7faeec005880 comp rx=0 tx=0).stop 2023-07-14T11:13:24.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.025+0000 7faf0b1ff700 1 -- 172.21.15.84:0/3243223992 >> 172.21.15.84:0/3243223992 conn(0x7faf040b05d0 msgr2=0x7faf040b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:24.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.025+0000 7faf0b1ff700 1 -- 172.21.15.84:0/3243223992 shutdown_connections 2023-07-14T11:13:24.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.025+0000 7faf0b1ff700 1 -- 172.21.15.84:0/3243223992 wait complete. 2023-07-14T11:13:24.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.027+0000 7faf0b1ff700 1 Processor -- start 2023-07-14T11:13:24.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.028+0000 7faf0b1ff700 1 -- start start 2023-07-14T11:13:24.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.029+0000 7faf0b1ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf040898d0 0x7faf0416b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:24.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.029+0000 7faf0b1ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf04089ca0 0x7faf040c6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:24.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.029+0000 7faf0b1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf040c8100 0x7faf040c8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:24.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.029+0000 7faf0b1ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf040c7890 con 0x7faf040898d0 2023-07-14T11:13:24.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.029+0000 7faf0b1ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf040c8ac0 con 0x7faf04089ca0 2023-07-14T11:13:24.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.029+0000 7faf0b1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf040c6a90 con 0x7faf040c8100 2023-07-14T11:13:24.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.030+0000 7faf08f9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf040898d0 0x7faf0416b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:24.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.030+0000 7faf08f9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf040898d0 0x7faf0416b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34288/0 (socket says 172.21.15.84:34288) 2023-07-14T11:13:24.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.030+0000 7faf08f9b700 1 -- 172.21.15.84:0/769997441 learned_addr learned my addr 172.21.15.84:0/769997441 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:24.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.031+0000 7faf03fff700 1 --2- 172.21.15.84:0/769997441 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf04089ca0 0x7faf040c6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:24.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.031+0000 7faf0979c700 1 --2- 172.21.15.84:0/769997441 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf040c8100 0x7faf040c8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:24.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.031+0000 7faf08f9b700 1 -- 172.21.15.84:0/769997441 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf040c8100 msgr2=0x7faf040c8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:24.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.031+0000 7faf08f9b700 1 --2- 172.21.15.84:0/769997441 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf040c8100 0x7faf040c8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:24.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.032+0000 7faf08f9b700 1 -- 172.21.15.84:0/769997441 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf04089ca0 msgr2=0x7faf040c6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:24.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.032+0000 7faf08f9b700 1 --2- 172.21.15.84:0/769997441 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf04089ca0 0x7faf040c6550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:24.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.032+0000 7faf08f9b700 1 -- 172.21.15.84:0/769997441 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf04163ec0 con 0x7faf040898d0 2023-07-14T11:13:24.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.032+0000 7efdc81ff700 1 -- 172.21.15.84:0/2377452490 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efdc006baf0 msgr2=0x7efdc00cdf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:24.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.032+0000 7efdc81ff700 1 --2- 172.21.15.84:0/2377452490 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efdc006baf0 0x7efdc00cdf40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7efdbc00dc60 tx=0x7efdbc00df70 comp rx=0 tx=0).stop 2023-07-14T11:13:24.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.032+0000 7faf08f9b700 1 --2- 172.21.15.84:0/769997441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf040898d0 0x7faf0416b920 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7faef4003980 tx=0x7faef4003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:24.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.023+0000 7f60e15ff700 1 -- 172.21.15.84:0/3548250532 shutdown_connections 2023-07-14T11:13:24.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.023+0000 7f60e15ff700 1 --2- 172.21.15.84:0/3548250532 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60dc160c30 0x7f60dc0cd2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:24.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.023+0000 7f60e15ff700 1 --2- 172.21.15.84:0/3548250532 >> v2:172.21.15.84:3300/0 conn(0x7f60dc164710 0x7f60dc164b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:24.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.023+0000 7f60e15ff700 1 --2- 172.21.15.84:0/3548250532 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60dc0cdbe0 0x7f60dc0ce030 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:24.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.023+0000 7f60e15ff700 1 -- 172.21.15.84:0/3548250532 >> 172.21.15.84:0/3548250532 conn(0x7f60dc0b05d0 msgr2=0x7f60dc0b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:24.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.023+0000 7f60e15ff700 1 -- 172.21.15.84:0/3548250532 shutdown_connections 2023-07-14T11:13:24.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.023+0000 7f60e15ff700 1 -- 172.21.15.84:0/3548250532 wait complete. 2023-07-14T11:13:24.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.026+0000 7f60e15ff700 1 Processor -- start 2023-07-14T11:13:24.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.026+0000 7f60e15ff700 1 -- start start 2023-07-14T11:13:24.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.027+0000 7f60e15ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60dc0cdbe0 0x7f60dc162e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:24.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.027+0000 7f60e15ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60dc160c30 0x7f60dc1491e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:24.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.027+0000 7f60e15ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60dc164710 0x7f60dc149720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:24.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.027+0000 7f60e15ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60dc160780 con 0x7f60dc0cdbe0 2023-07-14T11:13:24.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.027+0000 7f60e15ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60dc071ab0 con 0x7f60dc160c30 2023-07-14T11:13:24.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.027+0000 7f60e15ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60dc15cb10 con 0x7f60dc164710 2023-07-14T11:13:24.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.028+0000 7f60db7fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60dc164710 0x7f60dc149720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:24.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.028+0000 7f60db7fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60dc164710 0x7f60dc149720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.84:36206/0 (socket says 172.21.15.84:36206) 2023-07-14T11:13:24.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.028+0000 7f60db7fe700 1 -- 172.21.15.84:0/940891545 learned_addr learned my addr 172.21.15.84:0/940891545 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:24.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.028+0000 7f60db7fe700 1 -- 172.21.15.84:0/940891545 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60dc160c30 msgr2=0x7f60dc1491e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-14T11:13:24.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.028+0000 7f60db7fe700 1 --2- 172.21.15.84:0/940891545 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60dc160c30 0x7f60dc1491e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:24.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.028+0000 7f60db7fe700 1 -- 172.21.15.84:0/940891545 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60dc0cdbe0 msgr2=0x7f60dc162e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:24.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.029+0000 7f60db7fe700 1 --2- 172.21.15.84:0/940891545 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60dc0cdbe0 0x7f60dc162e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:24.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.029+0000 7f60db7fe700 1 -- 172.21.15.84:0/940891545 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60d0009550 con 0x7f60dc164710 2023-07-14T11:13:24.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.029+0000 7f60db7fe700 1 --2- 172.21.15.84:0/940891545 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60dc164710 0x7f60dc149720 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f60d400b970 tx=0x7f60d400bd30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:24.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.030+0000 7f60c37fe700 1 -- 172.21.15.84:0/940891545 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d400c9b0 con 0x7f60dc164710 2023-07-14T11:13:24.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.030+0000 7f60c37fe700 1 -- 172.21.15.84:0/940891545 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60d400cb30 con 0x7f60dc164710 2023-07-14T11:13:24.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.030+0000 7f60c37fe700 1 -- 172.21.15.84:0/940891545 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d4014440 con 0x7f60dc164710 2023-07-14T11:13:24.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.031+0000 7f60e15ff700 1 -- 172.21.15.84:0/940891545 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60dc1636a0 con 0x7f60dc164710 2023-07-14T11:13:24.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.031+0000 7f60e15ff700 1 -- 172.21.15.84:0/940891545 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60dc163c60 con 0x7f60dc164710 2023-07-14T11:13:24.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.034+0000 7f60e15ff700 1 -- 172.21.15.84:0/940891545 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60dc15cd30 con 0x7f60dc164710 2023-07-14T11:13:24.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.034+0000 7faf017fa700 1 -- 172.21.15.84:0/769997441 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef4011cf0 con 0x7faf040898d0 2023-07-14T11:13:24.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.034+0000 7faf017fa700 1 -- 172.21.15.84:0/769997441 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faef4011e50 con 0x7faf040898d0 2023-07-14T11:13:24.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.034+0000 7faf017fa700 1 -- 172.21.15.84:0/769997441 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef401a660 con 0x7faf040898d0 2023-07-14T11:13:24.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.035+0000 7efdc81ff700 1 -- 172.21.15.84:0/2377452490 shutdown_connections 2023-07-14T11:13:24.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.035+0000 7efdc81ff700 1 --2- 172.21.15.84:0/2377452490 >> v2:172.21.15.179:3300/0 conn(0x7efdc01587d0 0x7efdc006b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:24.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.035+0000 7efdc81ff700 1 --2- 172.21.15.84:0/2377452490 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efdc006baf0 0x7efdc00cdf40 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:24.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.035+0000 7efdc81ff700 1 -- 172.21.15.84:0/2377452490 >> 172.21.15.84:0/2377452490 conn(0x7efdc00b05d0 msgr2=0x7efdc00b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:24.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.035+0000 7faf0b1ff700 1 -- 172.21.15.84:0/769997441 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf040c6d10 con 0x7faf040898d0 2023-07-14T11:13:24.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.035+0000 7faf0b1ff700 1 -- 172.21.15.84:0/769997441 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf040c72d0 con 0x7faf040898d0 2023-07-14T11:13:24.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.037+0000 7f60c37fe700 1 -- 172.21.15.84:0/940891545 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f60d401d3b0 con 0x7f60dc164710 2023-07-14T11:13:24.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.037+0000 7faf0b1ff700 1 -- 172.21.15.84:0/769997441 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf04074350 con 0x7faf040898d0 2023-07-14T11:13:24.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.038+0000 7f60c37fe700 1 --2- 172.21.15.84:0/940891545 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f60c806adb0 0x7f60c806d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:24.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.038+0000 7f60c37fe700 1 -- 172.21.15.84:0/940891545 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f60d4006e40 con 0x7f60dc164710 2023-07-14T11:13:24.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.039+0000 7efdc81ff700 1 -- 172.21.15.84:0/2377452490 shutdown_connections 2023-07-14T11:13:24.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.039+0000 7f60daffd700 1 --2- 172.21.15.84:0/940891545 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f60c806adb0 0x7f60c806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:24.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.040+0000 7f60daffd700 1 --2- 172.21.15.84:0/940891545 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f60c806adb0 0x7f60c806d260 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f60cc006b20 tx=0x7f60cc006ab0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:24.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.039+0000 7efdc81ff700 1 -- 172.21.15.84:0/2377452490 wait complete. 2023-07-14T11:13:24.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.042+0000 7efdc81ff700 1 Processor -- start 2023-07-14T11:13:24.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.040+0000 7faf017fa700 1 -- 172.21.15.84:0/769997441 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7faef4023440 con 0x7faf040898d0 2023-07-14T11:13:24.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.042+0000 7faf017fa700 1 --2- 172.21.15.84:0/769997441 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7faef006adb0 0x7faef006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:24.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.042+0000 7faf017fa700 1 -- 172.21.15.84:0/769997441 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7faef408a180 con 0x7faf040898d0 2023-07-14T11:13:24.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.043+0000 7f60c37fe700 1 -- 172.21.15.84:0/940891545 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f60dc15cd30 con 0x7f60dc164710 2023-07-14T11:13:24.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.042+0000 7efdc81ff700 1 -- start start 2023-07-14T11:13:24.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.043+0000 7efdc81ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efdc00ce480 0x7efdc01ed780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:24.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.043+0000 7efdc81ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efdc01587d0 0x7efdc01e18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:24.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.043+0000 7efdc81ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdc015ba70 0x7efdc00b18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:24.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.043+0000 7efdc81ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc0146910 con 0x7efdc015ba70 2023-07-14T11:13:24.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.043+0000 7efdc81ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc01e2220 con 0x7efdc00ce480 2023-07-14T11:13:24.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.043+0000 7efdc81ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdc01e2500 con 0x7efdc01587d0 2023-07-14T11:13:24.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.044+0000 7efdc5f9b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efdc00ce480 0x7efdc01ed780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:24.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.044+0000 7efdc5f9b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efdc00ce480 0x7efdc01ed780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.84:52104/0 (socket says 172.21.15.84:52104) 2023-07-14T11:13:24.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.044+0000 7efdc5f9b700 1 -- 172.21.15.84:0/3050708315 learned_addr learned my addr 172.21.15.84:0/3050708315 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:24.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.044+0000 7efdc579a700 1 --2- 172.21.15.84:0/3050708315 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efdc01587d0 0x7efdc01e18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:24.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.045+0000 7efdc5f9b700 1 -- 172.21.15.84:0/3050708315 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efdc01587d0 msgr2=0x7efdc01e18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:24.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.045+0000 7efdc5f9b700 1 --2- 172.21.15.84:0/3050708315 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efdc01587d0 0x7efdc01e18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:24.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.045+0000 7efdc5f9b700 1 -- 172.21.15.84:0/3050708315 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdc015ba70 msgr2=0x7efdc00b18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:24.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.045+0000 7efdc5f9b700 1 --2- 172.21.15.84:0/3050708315 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdc015ba70 0x7efdc00b18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:24.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.045+0000 7efdc5f9b700 1 -- 172.21.15.84:0/3050708315 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdbc00d940 con 0x7efdc00ce480 2023-07-14T11:13:24.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.043+0000 7faf03fff700 1 --2- 172.21.15.84:0/769997441 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7faef006adb0 0x7faef006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:24.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.045+0000 7faf03fff700 1 --2- 172.21.15.84:0/769997441 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7faef006adb0 0x7faef006d260 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7faef8007fd0 tx=0x7faef8009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:24.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.045+0000 7efdc5f9b700 1 --2- 172.21.15.84:0/3050708315 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efdc00ce480 0x7efdc01ed780 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7efdb8007ee0 tx=0x7efdb800b320 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:24.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.043+0000 7f5ede1ff700 1 Processor -- start 2023-07-14T11:13:24.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.045+0000 7efdb67fc700 1 -- 172.21.15.84:0/3050708315 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb8010070 con 0x7efdc00ce480 2023-07-14T11:13:24.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.045+0000 7efdb67fc700 1 -- 172.21.15.84:0/3050708315 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdb800bc60 con 0x7efdc00ce480 2023-07-14T11:13:24.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.045+0000 7efdb67fc700 1 -- 172.21.15.84:0/3050708315 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb800a2d0 con 0x7efdc00ce480 2023-07-14T11:13:24.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.045+0000 7efdc81ff700 1 -- 172.21.15.84:0/3050708315 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdc01e27e0 con 0x7efdc00ce480 2023-07-14T11:13:24.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.046+0000 7efdc81ff700 1 -- 172.21.15.84:0/3050708315 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdc01edcc0 con 0x7efdc00ce480 2023-07-14T11:13:24.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.047+0000 7f5ede1ff700 1 -- start start 2023-07-14T11:13:24.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.048+0000 7f5ede1ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5ed806b5b0 0x7f5ed80cdf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:24.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.048+0000 7f5ede1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ed806ba20 0x7f5ed80ce480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:24.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.049+0000 7f5ede1ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ed80cab60 con 0x7f5ed80b10b0 2023-07-14T11:13:24.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.049+0000 7f5ede1ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ed8158c70 con 0x7f5ed806b5b0 2023-07-14T11:13:24.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.049+0000 7f5ede1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed80cc000 con 0x7f5ed806ba20 2023-07-14T11:13:24.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.049+0000 7f5ed7fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ed806ba20 0x7f5ed80ce480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:24.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.049+0000 7f5ed7fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ed806ba20 0x7f5ed80ce480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.84:36236/0 (socket says 172.21.15.84:36236) 2023-07-14T11:13:24.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.049+0000 7f5ed7fff700 1 -- 172.21.15.84:0/781299785 learned_addr learned my addr 172.21.15.84:0/781299785 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:24.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.049+0000 7efdc81ff700 1 -- 172.21.15.84:0/3050708315 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efda80052f0 con 0x7efdc00ce480 2023-07-14T11:13:24.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.050+0000 7f5ed67fc700 1 -- 172.21.15.84:0/781299785 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 736614198 0 0) 0x7f5ed80cab60 con 0x7f5ed80b10b0 2023-07-14T11:13:24.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.050+0000 7f5ed67fc700 1 -- 172.21.15.84:0/781299785 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ec00035b0 con 0x7f5ed80b10b0 2023-07-14T11:13:24.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.050+0000 7f5ed7fff700 1 -- 172.21.15.84:0/781299785 >> v2:172.21.15.84:3300/0 conn(0x7f5ed806b5b0 msgr2=0x7f5ed80cdf40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-14T11:13:24.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.050+0000 7f5ed7fff700 1 --2- 172.21.15.84:0/781299785 >> v2:172.21.15.84:3300/0 conn(0x7f5ed806b5b0 0x7f5ed80cdf40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:24.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.050+0000 7f5ed7fff700 1 -- 172.21.15.84:0/781299785 >> v1:172.21.15.179:6789/0 conn(0x7f5ed80b10b0 legacy=0x7f5ed8158560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:24.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.050+0000 7f5ed7fff700 1 -- 172.21.15.84:0/781299785 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed806c250 con 0x7f5ed806ba20 2023-07-14T11:13:24.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.050+0000 7efdb67fc700 1 -- 172.21.15.84:0/3050708315 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efdb800a430 con 0x7efdc00ce480 2023-07-14T11:13:24.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.051+0000 7f5ed7fff700 1 --2- 172.21.15.84:0/781299785 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ed806ba20 0x7f5ed80ce480 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5ed0009e50 tx=0x7f5ed000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a43e300acc91f832 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:24.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.052+0000 7faf017fa700 1 -- 172.21.15.84:0/769997441 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7faef4055210 con 0x7faf040898d0 2023-07-14T11:13:24.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.052+0000 7efdb67fc700 1 --2- 172.21.15.84:0/3050708315 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7efda406ad30 0x7efda406d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:24.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.052+0000 7efdb67fc700 1 -- 172.21.15.84:0/3050708315 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efdb80891b0 con 0x7efdc00ce480 2023-07-14T11:13:24.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.052+0000 7efdc579a700 1 --2- 172.21.15.84:0/3050708315 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7efda406ad30 0x7efda406d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:24.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.052+0000 7f5ed67fc700 1 -- 172.21.15.84:0/781299785 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed000e070 con 0x7f5ed806ba20 2023-07-14T11:13:24.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.052+0000 7f5ed67fc700 1 -- 172.21.15.84:0/781299785 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed000b910 con 0x7f5ed806ba20 2023-07-14T11:13:24.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.052+0000 7f5ed67fc700 1 -- 172.21.15.84:0/781299785 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed000bcc0 con 0x7f5ed806ba20 2023-07-14T11:13:24.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.053+0000 7f5ede1ff700 1 -- 172.21.15.84:0/781299785 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ed806ba20 msgr2=0x7f5ed80ce480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:24.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.053+0000 7f5ede1ff700 1 --2- 172.21.15.84:0/781299785 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ed806ba20 0x7f5ed80ce480 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5ed0009e50 tx=0x7f5ed000b330 comp rx=0 tx=0).stop 2023-07-14T11:13:24.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.054+0000 7efdc579a700 1 --2- 172.21.15.84:0/3050708315 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7efda406ad30 0x7efda406d1e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7efdbc00dc60 tx=0x7efdbc00d000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:24.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.054+0000 7f5ede1ff700 1 -- 172.21.15.84:0/781299785 shutdown_connections 2023-07-14T11:13:24.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.054+0000 7f5ede1ff700 1 --2- 172.21.15.84:0/781299785 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ed806ba20 0x7f5ed80ce480 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:24.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.054+0000 7f5ede1ff700 1 --2- 172.21.15.84:0/781299785 >> v2:172.21.15.84:3300/0 conn(0x7f5ed806b5b0 0x7f5ed80cdf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:24.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.054+0000 7f5ede1ff700 1 -- 172.21.15.84:0/781299785 >> 172.21.15.84:0/781299785 conn(0x7f5ed80b05d0 msgr2=0x7f5ed80b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:24.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.054+0000 7f5ede1ff700 1 -- 172.21.15.84:0/781299785 shutdown_connections 2023-07-14T11:13:24.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.054+0000 7f5ede1ff700 1 -- 172.21.15.84:0/781299785 wait complete. 2023-07-14T11:13:24.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.057+0000 7f5ede1ff700 1 Processor -- start 2023-07-14T11:13:24.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.057+0000 7f5ede1ff700 1 -- start start 2023-07-14T11:13:24.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.058+0000 7f5ede1ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ed806b5b0 0x7f5ed8152f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:24.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.058+0000 7f5ede1ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ed806ba20 0x7f5ed80c25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:24.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.058+0000 7f5ede1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ed80b10b0 0x7f5ed80aead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:24.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.058+0000 7f5ede1ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed815a3a0 con 0x7f5ed806b5b0 2023-07-14T11:13:24.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.058+0000 7f5ede1ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed80c2fd0 con 0x7f5ed806ba20 2023-07-14T11:13:24.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.058+0000 7f5ede1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed80c32b0 con 0x7f5ed80b10b0 2023-07-14T11:13:24.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.056+0000 7efdb67fc700 1 -- 172.21.15.84:0/3050708315 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7efdb8054380 con 0x7efdc00ce480 2023-07-14T11:13:24.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.061+0000 7f5ed77fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ed806b5b0 0x7f5ed8152f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:24.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.061+0000 7f5ed77fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ed806b5b0 0x7f5ed8152f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34298/0 (socket says 172.21.15.84:34298) 2023-07-14T11:13:24.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.061+0000 7f5ed77fe700 1 -- 172.21.15.84:0/1100380362 learned_addr learned my addr 172.21.15.84:0/1100380362 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:24.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.062+0000 7f5ed77fe700 1 -- 172.21.15.84:0/1100380362 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ed80b10b0 msgr2=0x7f5ed80aead0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-14T11:13:24.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.062+0000 7f5ed77fe700 1 --2- 172.21.15.84:0/1100380362 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ed80b10b0 0x7f5ed80aead0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:24.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.062+0000 7f5ed77fe700 1 -- 172.21.15.84:0/1100380362 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ed806ba20 msgr2=0x7f5ed80c25f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T11:13:24.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.062+0000 7f5ed77fe700 1 --2- 172.21.15.84:0/1100380362 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ed806ba20 0x7f5ed80c25f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:24.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.062+0000 7f5ed77fe700 1 -- 172.21.15.84:0/1100380362 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed0009b30 con 0x7f5ed806b5b0 2023-07-14T11:13:24.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.063+0000 7f5ed77fe700 1 --2- 172.21.15.84:0/1100380362 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ed806b5b0 0x7f5ed8152f10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc00c500 tx=0x7f5ecc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:24.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.065+0000 7f5ebffff700 1 -- 172.21.15.84:0/1100380362 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc0052d0 con 0x7f5ed806b5b0 2023-07-14T11:13:24.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.065+0000 7f5ebffff700 1 -- 172.21.15.84:0/1100380362 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ecc005430 con 0x7f5ed806b5b0 2023-07-14T11:13:24.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.065+0000 7f5ebffff700 1 -- 172.21.15.84:0/1100380362 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc0038c0 con 0x7f5ed806b5b0 2023-07-14T11:13:24.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.066+0000 7f5ede1ff700 1 -- 172.21.15.84:0/1100380362 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ed80c3590 con 0x7f5ed806b5b0 2023-07-14T11:13:24.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.066+0000 7f5ede1ff700 1 -- 172.21.15.84:0/1100380362 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ed8153450 con 0x7f5ed806b5b0 2023-07-14T11:13:24.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.068+0000 7f5ede1ff700 1 -- 172.21.15.84:0/1100380362 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ed8074350 con 0x7f5ed806b5b0 2023-07-14T11:13:24.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.071+0000 7f5ebffff700 1 -- 172.21.15.84:0/1100380362 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5ecc003a20 con 0x7f5ed806b5b0 2023-07-14T11:13:24.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.073+0000 7f5ebffff700 1 --2- 172.21.15.84:0/1100380362 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f5ec406adb0 0x7f5ec406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:24.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.073+0000 7f5ebffff700 1 -- 172.21.15.84:0/1100380362 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5ecc089060 con 0x7f5ed806b5b0 2023-07-14T11:13:24.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.075+0000 7f5ed6ffd700 1 --2- 172.21.15.84:0/1100380362 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f5ec406adb0 0x7f5ec406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:24.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.076+0000 7f5ed6ffd700 1 --2- 172.21.15.84:0/1100380362 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f5ec406adb0 0x7f5ec406d260 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5ed81f9810 tx=0x7f5ec8006c60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:24.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.079+0000 7f5ebffff700 1 -- 172.21.15.84:0/1100380362 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f5ecc0541a0 con 0x7f5ed806b5b0 2023-07-14T11:13:24.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.083+0000 7f1cec3ff700 1 Processor -- start 2023-07-14T11:13:24.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.083+0000 7f1cec3ff700 1 -- start start 2023-07-14T11:13:24.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.085+0000 7f1cec3ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1ce406db90 0x7f1ce40ae5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:24.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.086+0000 7f1cec3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ce406b410 0x7f1ce41650a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:24.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.086+0000 7f1cec3ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ce40ce790 con 0x7f1ce40c2280 2023-07-14T11:13:24.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.086+0000 7f1cec3ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ce4164c80 con 0x7f1ce406db90 2023-07-14T11:13:24.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.086+0000 7f1cec3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce41611a0 con 0x7f1ce406b410 2023-07-14T11:13:24.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.087+0000 7f1cea99c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f1ce40c2280 0x7f1ce4069f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:37772/0 (socket says 172.21.15.84:37772) 2023-07-14T11:13:24.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.087+0000 7f1cea99c700 1 -- 172.21.15.84:0/2313253813 learned_addr learned my addr 172.21.15.84:0/2313253813 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:13:24.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.087+0000 7f1cea19b700 1 --2- 172.21.15.84:0/2313253813 >> v2:172.21.15.84:3300/0 conn(0x7f1ce406db90 0x7f1ce40ae5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:24.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.088+0000 7f1ce999a700 1 --2- 172.21.15.84:0/2313253813 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ce406b410 0x7f1ce41650a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:24.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.088+0000 7f9c327ff700 1 Processor -- start 2023-07-14T11:13:24.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.088+0000 7f9c327ff700 1 -- start start 2023-07-14T11:13:24.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.090+0000 7f9c327ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9c2c0cdf40 0x7f9c2c0ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:24.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.090+0000 7f9c327ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c2c0caff0 0x7f9c2c0cb460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:24.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.090+0000 7f9c327ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c2c0cab60 con 0x7f9c2c1587d0 2023-07-14T11:13:24.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.090+0000 7f9c327ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c2c0ce8f0 con 0x7f9c2c0cdf40 2023-07-14T11:13:24.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.090+0000 7f9c327ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c2c06bcc0 con 0x7f9c2c0caff0 2023-07-14T11:13:24.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.097+0000 7f9c2b7fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9c2c0cdf40 0x7f9c2c0ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:24.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.097+0000 7f9c2b7fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9c2c0cdf40 0x7f9c2c0ce3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.84:52122/0 (socket says 172.21.15.84:52122) 2023-07-14T11:13:24.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.097+0000 7f9c2b7fe700 1 -- 172.21.15.84:0/3623279964 learned_addr learned my addr 172.21.15.84:0/3623279964 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:24.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.088+0000 7f1cea19b700 1 -- 172.21.15.84:0/2313253813 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ce406b410 msgr2=0x7f1ce41650a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:24.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.088+0000 7f1cea19b700 1 --2- 172.21.15.84:0/2313253813 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ce406b410 0x7f1ce41650a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:24.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.088+0000 7f1cea19b700 1 -- 172.21.15.84:0/2313253813 >> v1:172.21.15.84:6789/0 conn(0x7f1ce40c2280 legacy=0x7f1ce4069f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:24.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.088+0000 7f1cea19b700 1 -- 172.21.15.84:0/2313253813 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce406b860 con 0x7f1ce406db90 2023-07-14T11:13:24.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.089+0000 7f1cea19b700 1 --2- 172.21.15.84:0/2313253813 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ce406db90 0x7f1ce40ae5e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1cd4009840 tx=0x7f1cd4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc618510fb4b8c0c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:24.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.089+0000 7f1ce9199700 1 -- 172.21.15.84:0/2313253813 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd4011830 con 0x7f1ce406db90 2023-07-14T11:13:24.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.089+0000 7f1ce9199700 1 -- 172.21.15.84:0/2313253813 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cd4011990 con 0x7f1ce406db90 2023-07-14T11:13:24.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.089+0000 7f1ce9199700 1 -- 172.21.15.84:0/2313253813 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd4011d20 con 0x7f1ce406db90 2023-07-14T11:13:24.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.090+0000 7f1cec3ff700 1 -- 172.21.15.84:0/2313253813 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ce406db90 msgr2=0x7f1ce40ae5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:24.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.090+0000 7f1cec3ff700 1 --2- 172.21.15.84:0/2313253813 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ce406db90 0x7f1ce40ae5e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1cd4009840 tx=0x7f1cd4009b50 comp rx=0 tx=0).stop 2023-07-14T11:13:24.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.091+0000 7f1cec3ff700 1 -- 172.21.15.84:0/2313253813 shutdown_connections 2023-07-14T11:13:24.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.091+0000 7f1cec3ff700 1 --2- 172.21.15.84:0/2313253813 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ce406db90 0x7f1ce40ae5e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:24.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.091+0000 7f1cec3ff700 1 --2- 172.21.15.84:0/2313253813 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ce406b410 0x7f1ce41650a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:24.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.091+0000 7f1cec3ff700 1 -- 172.21.15.84:0/2313253813 >> 172.21.15.84:0/2313253813 conn(0x7f1ce40cc990 msgr2=0x7f1ce40cf2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:24.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.091+0000 7f1cec3ff700 1 -- 172.21.15.84:0/2313253813 shutdown_connections 2023-07-14T11:13:24.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.092+0000 7f1cec3ff700 1 -- 172.21.15.84:0/2313253813 wait complete. 2023-07-14T11:13:24.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.094+0000 7f1cec3ff700 1 Processor -- start 2023-07-14T11:13:24.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.095+0000 7f1cec3ff700 1 -- start start 2023-07-14T11:13:24.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.096+0000 7f1cec3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ce406b410 0x7f1ce4089a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:24.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.096+0000 7f1cec3ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ce406db90 0x7f1ce40c2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:24.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.096+0000 7f1cec3ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ce40c2280 0x7f1ce40c3320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:24.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.096+0000 7f1cec3ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce40c4590 con 0x7f1ce406db90 2023-07-14T11:13:24.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.096+0000 7f1cec3ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce4089f80 con 0x7f1ce40c2280 2023-07-14T11:13:24.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.096+0000 7f1cec3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce40c49b0 con 0x7f1ce406b410 2023-07-14T11:13:24.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.097+0000 7f1ce999a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ce406db90 0x7f1ce40c2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:24.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.097+0000 7f1ce999a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ce406db90 0x7f1ce40c2de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34326/0 (socket says 172.21.15.84:34326) 2023-07-14T11:13:24.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.097+0000 7f1ce999a700 1 -- 172.21.15.84:0/2833910106 learned_addr learned my addr 172.21.15.84:0/2833910106 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:24.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.098+0000 7f1ce999a700 1 -- 172.21.15.84:0/2833910106 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ce406b410 msgr2=0x7f1ce4089a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:24.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.098+0000 7f1ce999a700 1 --2- 172.21.15.84:0/2833910106 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ce406b410 0x7f1ce4089a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:24.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.098+0000 7f1ce999a700 1 -- 172.21.15.84:0/2833910106 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ce40c2280 msgr2=0x7f1ce40c3320 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-14T11:13:24.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.098+0000 7f1ce999a700 1 --2- 172.21.15.84:0/2833910106 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ce40c2280 0x7f1ce40c3320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:24.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.098+0000 7f1ce999a700 1 -- 172.21.15.84:0/2833910106 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cd40094a0 con 0x7f1ce406db90 2023-07-14T11:13:24.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.099+0000 7f1ce999a700 1 --2- 172.21.15.84:0/2833910106 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ce406db90 0x7f1ce40c2de0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1ce0050800 tx=0x7f1ce0050bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:24.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.099+0000 7f9c30d9c700 1 --2- 172.21.15.84:0/3623279964 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c2c0caff0 0x7f9c2c0cb460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:24.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.099+0000 7f1cdaffd700 1 -- 172.21.15.84:0/2833910106 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce0055610 con 0x7f1ce406db90 2023-07-14T11:13:24.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.099+0000 7f1cdaffd700 1 -- 172.21.15.84:0/2833910106 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ce0055770 con 0x7f1ce406db90 2023-07-14T11:13:24.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.099+0000 7f1cdaffd700 1 -- 172.21.15.84:0/2833910106 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce0055ae0 con 0x7f1ce406db90 2023-07-14T11:13:24.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.099+0000 7f1cec3ff700 1 -- 172.21.15.84:0/2833910106 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ce40c7d60 con 0x7f1ce406db90 2023-07-14T11:13:24.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.100+0000 7f1cec3ff700 1 -- 172.21.15.84:0/2833910106 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ce40c3bf0 con 0x7f1ce406db90 2023-07-14T11:13:24.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.104+0000 7f1cdaffd700 1 -- 172.21.15.84:0/2833910106 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1ce0055c40 con 0x7f1ce406db90 2023-07-14T11:13:24.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.106+0000 7f1cdaffd700 1 --2- 172.21.15.84:0/2833910106 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1cc806ad30 0x7f1cc806d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:24.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.106+0000 7f1cdaffd700 1 -- 172.21.15.84:0/2833910106 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1ce00cd300 con 0x7f1ce406db90 2023-07-14T11:13:24.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.104+0000 7f9c2affd700 1 -- 172.21.15.84:0/3623279964 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 81459104 0 0) 0x7f9c2c0cab60 con 0x7f9c2c1587d0 2023-07-14T11:13:24.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.104+0000 7f9c2affd700 1 -- 172.21.15.84:0/3623279964 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c140035b0 con 0x7f9c2c1587d0 2023-07-14T11:13:24.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.104+0000 7f9c2b7fe700 1 -- 172.21.15.84:0/3623279964 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c2c0caff0 msgr2=0x7f9c2c0cb460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:24.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.104+0000 7f9c2b7fe700 1 --2- 172.21.15.84:0/3623279964 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c2c0caff0 0x7f9c2c0cb460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:24.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.104+0000 7f9c2b7fe700 1 -- 172.21.15.84:0/3623279964 >> v1:172.21.15.179:6789/0 conn(0x7f9c2c1587d0 legacy=0x7f9c2c06b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:24.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.104+0000 7f9c2b7fe700 1 -- 172.21.15.84:0/3623279964 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c2c158ba0 con 0x7f9c2c0cdf40 2023-07-14T11:13:24.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.106+0000 7f9c2b7fe700 1 --2- 172.21.15.84:0/3623279964 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c2c0cdf40 0x7f9c2c0ce3b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c0088f0 tx=0x7f9c1c00d330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94cde1ec5e21b80b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:24.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.107+0000 7f9c2affd700 1 -- 172.21.15.84:0/3623279964 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1c010070 con 0x7f9c2c0cdf40 2023-07-14T11:13:24.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.107+0000 7f9c2affd700 1 -- 172.21.15.84:0/3623279964 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c1c00d9d0 con 0x7f9c2c0cdf40 2023-07-14T11:13:24.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.107+0000 7f9c2affd700 1 -- 172.21.15.84:0/3623279964 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1c00dd60 con 0x7f9c2c0cdf40 2023-07-14T11:13:24.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.108+0000 7f9c327ff700 1 -- 172.21.15.84:0/3623279964 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c2c0cdf40 msgr2=0x7f9c2c0ce3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:24.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.108+0000 7f9c327ff700 1 --2- 172.21.15.84:0/3623279964 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c2c0cdf40 0x7f9c2c0ce3b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c0088f0 tx=0x7f9c1c00d330 comp rx=0 tx=0).stop 2023-07-14T11:13:24.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.108+0000 7f9c327ff700 1 -- 172.21.15.84:0/3623279964 shutdown_connections 2023-07-14T11:13:24.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.108+0000 7f9c327ff700 1 --2- 172.21.15.84:0/3623279964 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c2c0caff0 0x7f9c2c0cb460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:24.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.108+0000 7f9c327ff700 1 --2- 172.21.15.84:0/3623279964 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c2c0cdf40 0x7f9c2c0ce3b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:24.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.108+0000 7f9c327ff700 1 -- 172.21.15.84:0/3623279964 >> 172.21.15.84:0/3623279964 conn(0x7f9c2c0b05d0 msgr2=0x7f9c2c0b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:24.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.108+0000 7f1cea19b700 1 --2- 172.21.15.84:0/2833910106 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1cc806ad30 0x7f1cc806d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:24.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.110+0000 7f1cea19b700 1 --2- 172.21.15.84:0/2833910106 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1cc806ad30 0x7f1cc806d1e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1cd4009b90 tx=0x7f1cd4010000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:24.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.110+0000 7f1cec3ff700 1 -- 172.21.15.84:0/2833910106 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ce40d01b0 con 0x7f1ce406db90 2023-07-14T11:13:24.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.110+0000 7f9c327ff700 1 -- 172.21.15.84:0/3623279964 shutdown_connections 2023-07-14T11:13:24.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.110+0000 7f9c327ff700 1 -- 172.21.15.84:0/3623279964 wait complete. 2023-07-14T11:13:24.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.113+0000 7f9c327ff700 1 Processor -- start 2023-07-14T11:13:24.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.114+0000 7f9c327ff700 1 -- start start 2023-07-14T11:13:24.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.115+0000 7f9c327ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c2c0caff0 0x7f9c2c201730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:24.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.115+0000 7f9c327ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c2c0cdf40 0x7f9c2c0c4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:24.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.116+0000 7f9c327ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c2c1587d0 0x7f9c2c0c4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:24.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.116+0000 7f9c327ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c2c0c7720 con 0x7f9c2c0cdf40 2023-07-14T11:13:24.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.116+0000 7f9c327ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c2c0c7a00 con 0x7f9c2c0caff0 2023-07-14T11:13:24.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.116+0000 7f9c327ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c2c0c7ce0 con 0x7f9c2c1587d0 2023-07-14T11:13:24.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.120+0000 7f1cdaffd700 1 -- 172.21.15.84:0/2833910106 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f1ce0098300 con 0x7f1ce406db90 2023-07-14T11:13:24.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.119+0000 7f9c2b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c2c0cdf40 0x7f9c2c0c4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:24.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.119+0000 7f9c2b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c2c0cdf40 0x7f9c2c0c4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34330/0 (socket says 172.21.15.84:34330) 2023-07-14T11:13:24.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.119+0000 7f9c2b7fe700 1 -- 172.21.15.84:0/1146250596 learned_addr learned my addr 172.21.15.84:0/1146250596 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:24.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.120+0000 7f9c2b7fe700 1 -- 172.21.15.84:0/1146250596 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c2c1587d0 msgr2=0x7f9c2c0c4b50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-14T11:13:24.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.120+0000 7f9c2b7fe700 1 --2- 172.21.15.84:0/1146250596 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c2c1587d0 0x7f9c2c0c4b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:24.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.120+0000 7f9c2b7fe700 1 -- 172.21.15.84:0/1146250596 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c2c0caff0 msgr2=0x7f9c2c201730 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-14T11:13:24.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.120+0000 7f9c2b7fe700 1 --2- 172.21.15.84:0/1146250596 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c2c0caff0 0x7f9c2c201730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:24.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.120+0000 7f9c2b7fe700 1 -- 172.21.15.84:0/1146250596 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c1c0085d0 con 0x7f9c2c0cdf40 2023-07-14T11:13:24.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.120+0000 7f9c2b7fe700 1 --2- 172.21.15.84:0/1146250596 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c2c0cdf40 0x7f9c2c0c4610 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c00d370 tx=0x7f9c1c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:24.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.122+0000 7f9c28ff9700 1 -- 172.21.15.84:0/1146250596 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1c024070 con 0x7f9c2c0cdf40 2023-07-14T11:13:24.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.122+0000 7f9c28ff9700 1 -- 172.21.15.84:0/1146250596 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c1c004310 con 0x7f9c2c0cdf40 2023-07-14T11:13:24.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.122+0000 7f9c28ff9700 1 -- 172.21.15.84:0/1146250596 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1c0036a0 con 0x7f9c2c0cdf40 2023-07-14T11:13:24.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.122+0000 7f9c327ff700 1 -- 172.21.15.84:0/1146250596 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c2c0c7fc0 con 0x7f9c2c0cdf40 2023-07-14T11:13:24.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.122+0000 7f9c327ff700 1 -- 172.21.15.84:0/1146250596 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c2c1e2de0 con 0x7f9c2c0cdf40 2023-07-14T11:13:24.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.124+0000 7f9c327ff700 1 -- 172.21.15.84:0/1146250596 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c2c0c84e0 con 0x7f9c2c0cdf40 2023-07-14T11:13:24.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.126+0000 7f9c28ff9700 1 -- 172.21.15.84:0/1146250596 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9c1c003800 con 0x7f9c2c0cdf40 2023-07-14T11:13:24.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.139+0000 7f9c28ff9700 1 --2- 172.21.15.84:0/1146250596 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f9c1806adb0 0x7f9c1806d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:24.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.139+0000 7f9c28ff9700 1 -- 172.21.15.84:0/1146250596 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9c1c08a420 con 0x7f9c2c0cdf40 2023-07-14T11:13:24.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.139+0000 7f9c28ff9700 1 -- 172.21.15.84:0/1146250596 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f9c2c0c84e0 con 0x7f9c2c0cdf40 2023-07-14T11:13:24.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.149+0000 7f9c2bfff700 1 --2- 172.21.15.84:0/1146250596 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f9c1806adb0 0x7f9c1806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:24.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.180+0000 7f9c2bfff700 1 --2- 172.21.15.84:0/1146250596 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f9c1806adb0 0x7f9c1806d260 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9c24002100 tx=0x7f9c24001710 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:24.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.399+0000 7fee533ff700 1 -- 172.21.15.84:0/4197876310 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fee2c0055a0 con 0x7fee4c164710 2023-07-14T11:13:24.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.400+0000 7fee41ffb700 1 -- 172.21.15.84:0/4197876310 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fee3c015030 con 0x7fee4c164710 2023-07-14T11:13:24.405 INFO:teuthology.orchestra.run.smithi084.stdout:55834574856 2023-07-14T11:13:24.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.404+0000 7fee533ff700 1 -- 172.21.15.84:0/4197876310 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fee3006adb0 msgr2=0x7fee3006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:24.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.404+0000 7fee533ff700 1 --2- 172.21.15.84:0/4197876310 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fee3006adb0 0x7fee3006d260 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fee4c0b3b00 tx=0x7fee44009000 comp rx=0 tx=0).stop 2023-07-14T11:13:24.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.404+0000 7fee533ff700 1 -- 172.21.15.84:0/4197876310 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee4c164710 msgr2=0x7fee4c0c2b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:24.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.404+0000 7fee533ff700 1 --2- 172.21.15.84:0/4197876310 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee4c164710 0x7fee4c0c2b30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fee3c00b3e0 tx=0x7fee3c00b7a0 comp rx=0 tx=0).stop 2023-07-14T11:13:24.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.405+0000 7fee533ff700 1 -- 172.21.15.84:0/4197876310 shutdown_connections 2023-07-14T11:13:24.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.405+0000 7fee533ff700 1 --2- 172.21.15.84:0/4197876310 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee4c164710 0x7fee4c0c2b30 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:24.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.405+0000 7fee533ff700 1 --2- 172.21.15.84:0/4197876310 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee4c0cdbe0 0x7fee4c14fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:24.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.405+0000 7fee533ff700 1 --2- 172.21.15.84:0/4197876310 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fee3006adb0 0x7fee3006d260 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:24.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.405+0000 7fee533ff700 1 --2- 172.21.15.84:0/4197876310 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee4c160c30 0x7fee4c0c25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:24.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.405+0000 7fee533ff700 1 -- 172.21.15.84:0/4197876310 >> 172.21.15.84:0/4197876310 conn(0x7fee4c0b05d0 msgr2=0x7fee4c0caac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:24.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.406+0000 7fee533ff700 1 -- 172.21.15.84:0/4197876310 shutdown_connections 2023-07-14T11:13:24.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.406+0000 7fee533ff700 1 -- 172.21.15.84:0/4197876310 wait complete. 2023-07-14T11:13:24.438 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.1 2023-07-14T11:13:24.439 DEBUG:teuthology.parallel:result is None 2023-07-14T11:13:24.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.452+0000 7f98b4fff700 1 -- 172.21.15.84:0/1089477377 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9894005870 con 0x7f98b00caff0 2023-07-14T11:13:24.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.453+0000 7f989effd700 1 -- 172.21.15.84:0/1089477377 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f98a8017090 con 0x7f98b00caff0 2023-07-14T11:13:24.455 INFO:teuthology.orchestra.run.smithi084.stdout:55834574854 2023-07-14T11:13:24.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.455+0000 7f98b4fff700 1 -- 172.21.15.84:0/1089477377 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f989006adb0 msgr2=0x7f989006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:24.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.455+0000 7f98b4fff700 1 --2- 172.21.15.84:0/1089477377 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f989006adb0 0x7f989006d260 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f98a0009dc0 tx=0x7f98a0009190 comp rx=0 tx=0).stop 2023-07-14T11:13:24.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.455+0000 7f98b4fff700 1 -- 172.21.15.84:0/1089477377 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98b00caff0 msgr2=0x7f98b00cbad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:24.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.455+0000 7f98b4fff700 1 --2- 172.21.15.84:0/1089477377 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98b00caff0 0x7f98b00cbad0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f98a800c780 tx=0x7f98a800ca90 comp rx=0 tx=0).stop 2023-07-14T11:13:24.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.456+0000 7f98b4fff700 1 -- 172.21.15.84:0/1089477377 shutdown_connections 2023-07-14T11:13:24.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.456+0000 7f98b4fff700 1 --2- 172.21.15.84:0/1089477377 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98b01587d0 0x7f98b01574f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:24.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.456+0000 7f98b4fff700 1 --2- 172.21.15.84:0/1089477377 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98b00caff0 0x7f98b00cbad0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:24.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.456+0000 7f98b4fff700 1 --2- 172.21.15.84:0/1089477377 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f989006adb0 0x7f989006d260 secure :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f98a0009dc0 tx=0x7f98a0009190 comp rx=0 tx=0).stop 2023-07-14T11:13:24.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.456+0000 7f98b4fff700 1 --2- 172.21.15.84:0/1089477377 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98b00cdf40 0x7f98b0159c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:24.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.456+0000 7f98b4fff700 1 -- 172.21.15.84:0/1089477377 >> 172.21.15.84:0/1089477377 conn(0x7f98b00b05d0 msgr2=0x7f98b00cb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:24.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.456+0000 7f98b4fff700 1 -- 172.21.15.84:0/1089477377 shutdown_connections 2023-07-14T11:13:24.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.458+0000 7f98b4fff700 1 -- 172.21.15.84:0/1089477377 wait complete. 2023-07-14T11:13:24.478 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.3 2023-07-14T11:13:24.478 DEBUG:teuthology.parallel:result is None 2023-07-14T11:13:24.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.486+0000 7f60e15ff700 1 -- 172.21.15.84:0/940891545 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f60dc06c690 con 0x7f60dc164710 2023-07-14T11:13:24.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.487+0000 7f60c37fe700 1 -- 172.21.15.84:0/940891545 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f60d4054380 con 0x7f60dc164710 2023-07-14T11:13:24.489 INFO:teuthology.orchestra.run.smithi084.stdout:55834574854 2023-07-14T11:13:24.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.489+0000 7efdc81ff700 1 -- 172.21.15.84:0/3050708315 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7efda80055a0 con 0x7efdc00ce480 2023-07-14T11:13:24.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.489+0000 7efdb67fc700 1 -- 172.21.15.84:0/3050708315 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efdb80579a0 con 0x7efdc00ce480 2023-07-14T11:13:24.492 INFO:teuthology.orchestra.run.smithi084.stdout:55834574854 2023-07-14T11:13:24.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.491+0000 7f60e15ff700 1 -- 172.21.15.84:0/940891545 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f60c806adb0 msgr2=0x7f60c806d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:24.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.491+0000 7f60e15ff700 1 --2- 172.21.15.84:0/940891545 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f60c806adb0 0x7f60c806d260 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f60cc006b20 tx=0x7f60cc006ab0 comp rx=0 tx=0).stop 2023-07-14T11:13:24.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.491+0000 7f60e15ff700 1 -- 172.21.15.84:0/940891545 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60dc164710 msgr2=0x7f60dc149720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:24.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.491+0000 7f60e15ff700 1 --2- 172.21.15.84:0/940891545 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60dc164710 0x7f60dc149720 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f60d400b970 tx=0x7f60d400bd30 comp rx=0 tx=0).stop 2023-07-14T11:13:24.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.491+0000 7f60e15ff700 1 -- 172.21.15.84:0/940891545 shutdown_connections 2023-07-14T11:13:24.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.491+0000 7f60e15ff700 1 --2- 172.21.15.84:0/940891545 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f60c806adb0 0x7f60c806d260 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:24.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.491+0000 7f60e15ff700 1 --2- 172.21.15.84:0/940891545 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60dc164710 0x7f60dc149720 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:24.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.491+0000 7f60e15ff700 1 --2- 172.21.15.84:0/940891545 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60dc0cdbe0 0x7f60dc162e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:24.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.491+0000 7f60e15ff700 1 --2- 172.21.15.84:0/940891545 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60dc160c30 0x7f60dc1491e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:24.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.491+0000 7f60e15ff700 1 -- 172.21.15.84:0/940891545 >> 172.21.15.84:0/940891545 conn(0x7f60dc0b05d0 msgr2=0x7f60dc0ae490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:24.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.491+0000 7f60e15ff700 1 -- 172.21.15.84:0/940891545 shutdown_connections 2023-07-14T11:13:24.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.491+0000 7f60e15ff700 1 -- 172.21.15.84:0/940891545 wait complete. 2023-07-14T11:13:24.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.493+0000 7efdc81ff700 1 -- 172.21.15.84:0/3050708315 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7efda406ad30 msgr2=0x7efda406d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:24.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.493+0000 7efdc81ff700 1 --2- 172.21.15.84:0/3050708315 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7efda406ad30 0x7efda406d1e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7efdbc00dc60 tx=0x7efdbc00d000 comp rx=0 tx=0).stop 2023-07-14T11:13:24.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.493+0000 7efdc81ff700 1 -- 172.21.15.84:0/3050708315 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efdc00ce480 msgr2=0x7efdc01ed780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:24.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.493+0000 7efdc81ff700 1 --2- 172.21.15.84:0/3050708315 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efdc00ce480 0x7efdc01ed780 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7efdb8007ee0 tx=0x7efdb800b320 comp rx=0 tx=0).stop 2023-07-14T11:13:24.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.493+0000 7efdc81ff700 1 -- 172.21.15.84:0/3050708315 shutdown_connections 2023-07-14T11:13:24.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.493+0000 7efdc81ff700 1 --2- 172.21.15.84:0/3050708315 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdc015ba70 0x7efdc00b18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:24.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.493+0000 7efdc81ff700 1 --2- 172.21.15.84:0/3050708315 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efdc00ce480 0x7efdc01ed780 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:24.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.494+0000 7efdc81ff700 1 --2- 172.21.15.84:0/3050708315 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7efda406ad30 0x7efda406d1e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:24.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.494+0000 7efdc81ff700 1 --2- 172.21.15.84:0/3050708315 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efdc01587d0 0x7efdc01e18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:24.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.494+0000 7efdc81ff700 1 -- 172.21.15.84:0/3050708315 >> 172.21.15.84:0/3050708315 conn(0x7efdc00b05d0 msgr2=0x7efdc006f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:24.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.495+0000 7efdc81ff700 1 -- 172.21.15.84:0/3050708315 shutdown_connections 2023-07-14T11:13:24.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.495+0000 7efdc81ff700 1 -- 172.21.15.84:0/3050708315 wait complete. 2023-07-14T11:13:24.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.508+0000 7faf0b1ff700 1 -- 172.21.15.84:0/769997441 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7faf04164050 con 0x7faf040898d0 2023-07-14T11:13:24.511 INFO:teuthology.orchestra.run.smithi084.stdout:55834574854 2023-07-14T11:13:24.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.508+0000 7faf017fa700 1 -- 172.21.15.84:0/769997441 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7faef4058830 con 0x7faf040898d0 2023-07-14T11:13:24.514 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.2 2023-07-14T11:13:24.515 DEBUG:teuthology.parallel:result is None 2023-07-14T11:13:24.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.512+0000 7faf0b1ff700 1 -- 172.21.15.84:0/769997441 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7faef006adb0 msgr2=0x7faef006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:24.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.512+0000 7faf0b1ff700 1 --2- 172.21.15.84:0/769997441 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7faef006adb0 0x7faef006d260 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7faef8007fd0 tx=0x7faef8009030 comp rx=0 tx=0).stop 2023-07-14T11:13:24.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.512+0000 7faf0b1ff700 1 -- 172.21.15.84:0/769997441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf040898d0 msgr2=0x7faf0416b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:24.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.512+0000 7faf0b1ff700 1 --2- 172.21.15.84:0/769997441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf040898d0 0x7faf0416b920 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7faef4003980 tx=0x7faef4003d40 comp rx=0 tx=0).stop 2023-07-14T11:13:24.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.512+0000 7faf0b1ff700 1 -- 172.21.15.84:0/769997441 shutdown_connections 2023-07-14T11:13:24.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.512+0000 7faf0b1ff700 1 --2- 172.21.15.84:0/769997441 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7faef006adb0 0x7faef006d260 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:24.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.513+0000 7faf0b1ff700 1 --2- 172.21.15.84:0/769997441 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf040c8100 0x7faf040c8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:24.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.513+0000 7faf0b1ff700 1 --2- 172.21.15.84:0/769997441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf040898d0 0x7faf0416b920 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:24.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.513+0000 7faf0b1ff700 1 --2- 172.21.15.84:0/769997441 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf04089ca0 0x7faf040c6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:24.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.513+0000 7faf0b1ff700 1 -- 172.21.15.84:0/769997441 >> 172.21.15.84:0/769997441 conn(0x7faf040b05d0 msgr2=0x7faf0406ce60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:24.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.513+0000 7faf0b1ff700 1 -- 172.21.15.84:0/769997441 shutdown_connections 2023-07-14T11:13:24.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.513+0000 7faf0b1ff700 1 -- 172.21.15.84:0/769997441 wait complete. 2023-07-14T11:13:24.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.515+0000 7f5ede1ff700 1 -- 172.21.15.84:0/1100380362 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f5ed80aff30 con 0x7f5ed806b5b0 2023-07-14T11:13:24.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.516+0000 7f5ebffff700 1 -- 172.21.15.84:0/1100380362 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5ecc017020 con 0x7f5ed806b5b0 2023-07-14T11:13:24.518 INFO:teuthology.orchestra.run.smithi084.stdout:55834574856 2023-07-14T11:13:24.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.518+0000 7f5ede1ff700 1 -- 172.21.15.84:0/1100380362 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f5ec406adb0 msgr2=0x7f5ec406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:24.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.518+0000 7f5ede1ff700 1 --2- 172.21.15.84:0/1100380362 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f5ec406adb0 0x7f5ec406d260 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5ed81f9810 tx=0x7f5ec8006c60 comp rx=0 tx=0).stop 2023-07-14T11:13:24.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.518+0000 7f5ede1ff700 1 -- 172.21.15.84:0/1100380362 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ed806b5b0 msgr2=0x7f5ed8152f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:24.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.518+0000 7f5ede1ff700 1 --2- 172.21.15.84:0/1100380362 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ed806b5b0 0x7f5ed8152f10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc00c500 tx=0x7f5ecc00c8c0 comp rx=0 tx=0).stop 2023-07-14T11:13:24.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.518+0000 7f5ede1ff700 1 -- 172.21.15.84:0/1100380362 shutdown_connections 2023-07-14T11:13:24.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.518+0000 7f5ede1ff700 1 --2- 172.21.15.84:0/1100380362 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f5ec406adb0 0x7f5ec406d260 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:24.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.518+0000 7f5ede1ff700 1 --2- 172.21.15.84:0/1100380362 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ed80b10b0 0x7f5ed80aead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:24.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.518+0000 7f5ede1ff700 1 --2- 172.21.15.84:0/1100380362 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ed806b5b0 0x7f5ed8152f10 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:24.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.518+0000 7f5ede1ff700 1 --2- 172.21.15.84:0/1100380362 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ed806ba20 0x7f5ed80c25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:24.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.518+0000 7f5ede1ff700 1 -- 172.21.15.84:0/1100380362 >> 172.21.15.84:0/1100380362 conn(0x7f5ed80b05d0 msgr2=0x7f5ed8154060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:24.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.519+0000 7f5ede1ff700 1 -- 172.21.15.84:0/1100380362 shutdown_connections 2023-07-14T11:13:24.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.519+0000 7f5ede1ff700 1 -- 172.21.15.84:0/1100380362 wait complete. 2023-07-14T11:13:24.526 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.0 2023-07-14T11:13:24.526 DEBUG:teuthology.parallel:result is None 2023-07-14T11:13:24.537 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2023-07-14T11:13:24.537 DEBUG:teuthology.parallel:result is None 2023-07-14T11:13:24.541 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.7 2023-07-14T11:13:24.541 DEBUG:teuthology.parallel:result is None 2023-07-14T11:13:24.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.566+0000 7f1cec3ff700 1 -- 172.21.15.84:0/2833910106 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f1ce4074350 con 0x7f1ce406db90 2023-07-14T11:13:24.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.567+0000 7f1cdaffd700 1 -- 172.21.15.84:0/2833910106 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1ce0063030 con 0x7f1ce406db90 2023-07-14T11:13:24.569 INFO:teuthology.orchestra.run.smithi084.stdout:55834574857 2023-07-14T11:13:24.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.569+0000 7f1cec3ff700 1 -- 172.21.15.84:0/2833910106 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1cc806ad30 msgr2=0x7f1cc806d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:24.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.569+0000 7f1cec3ff700 1 --2- 172.21.15.84:0/2833910106 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1cc806ad30 0x7f1cc806d1e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1cd4009b90 tx=0x7f1cd4010000 comp rx=0 tx=0).stop 2023-07-14T11:13:24.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.569+0000 7f1cec3ff700 1 -- 172.21.15.84:0/2833910106 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ce406db90 msgr2=0x7f1ce40c2de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:24.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.569+0000 7f1cec3ff700 1 --2- 172.21.15.84:0/2833910106 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ce406db90 0x7f1ce40c2de0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1ce0050800 tx=0x7f1ce0050bc0 comp rx=0 tx=0).stop 2023-07-14T11:13:24.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.570+0000 7f1cec3ff700 1 -- 172.21.15.84:0/2833910106 shutdown_connections 2023-07-14T11:13:24.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.570+0000 7f1cec3ff700 1 --2- 172.21.15.84:0/2833910106 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1cc806ad30 0x7f1cc806d1e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:24.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.570+0000 7f1cec3ff700 1 --2- 172.21.15.84:0/2833910106 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ce406b410 0x7f1ce4089a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:24.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.570+0000 7f1cec3ff700 1 --2- 172.21.15.84:0/2833910106 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ce40c2280 0x7f1ce40c3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:24.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.570+0000 7f1cec3ff700 1 --2- 172.21.15.84:0/2833910106 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ce406db90 0x7f1ce40c2de0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:24.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.570+0000 7f1cec3ff700 1 -- 172.21.15.84:0/2833910106 >> 172.21.15.84:0/2833910106 conn(0x7f1ce40cc990 msgr2=0x7f1ce408a6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:24.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.570+0000 7f1cec3ff700 1 -- 172.21.15.84:0/2833910106 shutdown_connections 2023-07-14T11:13:24.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.570+0000 7f1cec3ff700 1 -- 172.21.15.84:0/2833910106 wait complete. 2023-07-14T11:13:24.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.577+0000 7f9c327ff700 1 -- 172.21.15.84:0/1146250596 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f9c2c0c84e0 con 0x7f9c2c0cdf40 2023-07-14T11:13:24.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.577+0000 7f9c28ff9700 1 -- 172.21.15.84:0/1146250596 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9c2c0c84e0 con 0x7f9c2c0cdf40 2023-07-14T11:13:24.579 INFO:teuthology.orchestra.run.smithi084.stdout:55834574856 2023-07-14T11:13:24.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.579+0000 7f9c327ff700 1 -- 172.21.15.84:0/1146250596 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f9c1806adb0 msgr2=0x7f9c1806d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:24.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.580+0000 7f9c327ff700 1 --2- 172.21.15.84:0/1146250596 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f9c1806adb0 0x7f9c1806d260 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9c24002100 tx=0x7f9c24001710 comp rx=0 tx=0).stop 2023-07-14T11:13:24.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.580+0000 7f9c327ff700 1 -- 172.21.15.84:0/1146250596 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c2c0cdf40 msgr2=0x7f9c2c0c4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:24.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.580+0000 7f9c327ff700 1 --2- 172.21.15.84:0/1146250596 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c2c0cdf40 0x7f9c2c0c4610 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c00d370 tx=0x7f9c1c004750 comp rx=0 tx=0).stop 2023-07-14T11:13:24.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.580+0000 7f9c327ff700 1 -- 172.21.15.84:0/1146250596 shutdown_connections 2023-07-14T11:13:24.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.580+0000 7f9c327ff700 1 --2- 172.21.15.84:0/1146250596 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f9c1806adb0 0x7f9c1806d260 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:24.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.580+0000 7f9c327ff700 1 --2- 172.21.15.84:0/1146250596 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c2c1587d0 0x7f9c2c0c4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:24.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.580+0000 7f9c327ff700 1 --2- 172.21.15.84:0/1146250596 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c2c0caff0 0x7f9c2c201730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:24.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.580+0000 7f9c327ff700 1 --2- 172.21.15.84:0/1146250596 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c2c0cdf40 0x7f9c2c0c4610 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:24.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.580+0000 7f9c327ff700 1 -- 172.21.15.84:0/1146250596 >> 172.21.15.84:0/1146250596 conn(0x7f9c2c0b05d0 msgr2=0x7f9c2c0cb440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:24.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.580+0000 7f9c327ff700 1 -- 172.21.15.84:0/1146250596 shutdown_connections 2023-07-14T11:13:24.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.580+0000 7f9c327ff700 1 -- 172.21.15.84:0/1146250596 wait complete. 2023-07-14T11:13:24.590 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.6 2023-07-14T11:13:24.590 DEBUG:teuthology.parallel:result is None 2023-07-14T11:13:24.600 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.5 2023-07-14T11:13:24.600 DEBUG:teuthology.parallel:result is None 2023-07-14T11:13:24.600 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-07-14T11:13:24.601 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T11:13:24.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.833+0000 7f8e793ff700 1 Processor -- start 2023-07-14T11:13:24.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.833+0000 7f8e793ff700 1 -- start start 2023-07-14T11:13:24.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.834+0000 7f8e793ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8e7415c950 0x7f8e740b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:24.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.834+0000 7f8e793ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8e740d1220 0x7f8e740afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:24.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.834+0000 7f8e793ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e740d2ce0 con 0x7f8e740b1e00 2023-07-14T11:13:24.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.834+0000 7f8e793ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e740b3350 con 0x7f8e740d1220 2023-07-14T11:13:24.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.834+0000 7f8e793ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e740b3630 con 0x7f8e7415c950 2023-07-14T11:13:24.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.835+0000 7f8e737fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8e740d1220 0x7f8e740afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:24.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.835+0000 7f8e727fc700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f8e740b1e00 0x7f8e740d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:37784/0 (socket says 172.21.15.84:37784) 2023-07-14T11:13:24.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.835+0000 7f8e727fc700 1 -- 172.21.15.84:0/2464350269 learned_addr learned my addr 172.21.15.84:0/2464350269 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:13:24.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.835+0000 7f8e72ffd700 1 --2- 172.21.15.84:0/2464350269 >> v2:172.21.15.179:3300/0 conn(0x7f8e7415c950 0x7f8e740b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:24.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.835+0000 7f8e737fe700 1 -- 172.21.15.84:0/2464350269 >> v2:172.21.15.179:3300/0 conn(0x7f8e7415c950 msgr2=0x7f8e740b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:24.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.835+0000 7f8e737fe700 1 --2- 172.21.15.84:0/2464350269 >> v2:172.21.15.179:3300/0 conn(0x7f8e7415c950 0x7f8e740b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:24.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.835+0000 7f8e737fe700 1 -- 172.21.15.84:0/2464350269 >> v1:172.21.15.84:6789/0 conn(0x7f8e740b1e00 legacy=0x7f8e740d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:24.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.835+0000 7f8e737fe700 1 -- 172.21.15.84:0/2464350269 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e740b3910 con 0x7f8e740d1220 2023-07-14T11:13:24.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.835+0000 7f8e71ffb700 1 -- 172.21.15.84:0/2464350269 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1911674200 0 0) 0x7f8e740d2ce0 con 0x7f8e740b1e00 2023-07-14T11:13:24.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.835+0000 7f8e72ffd700 1 --2- 172.21.15.84:0/2464350269 >> v2:172.21.15.179:3300/0 conn(0x7f8e7415c950 0x7f8e740b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:13:24.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.835+0000 7f8e737fe700 1 --2- 172.21.15.84:0/2464350269 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e740d1220 0x7f8e740afac0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8e7408d170 tx=0x7f8e6c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d54eefa30d90cb7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:24.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.835+0000 7f8e71ffb700 1 -- 172.21.15.84:0/2464350269 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6c00e070 con 0x7f8e740d1220 2023-07-14T11:13:24.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.836+0000 7f8e71ffb700 1 -- 172.21.15.84:0/2464350269 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e6c00bbd0 con 0x7f8e740d1220 2023-07-14T11:13:24.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.836+0000 7f8e71ffb700 1 -- 172.21.15.84:0/2464350269 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6c012430 con 0x7f8e740d1220 2023-07-14T11:13:24.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.836+0000 7f8e793ff700 1 -- 172.21.15.84:0/2464350269 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e740d1220 msgr2=0x7f8e740afac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:24.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.836+0000 7f8e793ff700 1 --2- 172.21.15.84:0/2464350269 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e740d1220 0x7f8e740afac0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8e7408d170 tx=0x7f8e6c00b330 comp rx=0 tx=0).stop 2023-07-14T11:13:24.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.836+0000 7f8e793ff700 1 -- 172.21.15.84:0/2464350269 shutdown_connections 2023-07-14T11:13:24.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.836+0000 7f8e793ff700 1 --2- 172.21.15.84:0/2464350269 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e740d1220 0x7f8e740afac0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:24.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.836+0000 7f8e793ff700 1 --2- 172.21.15.84:0/2464350269 >> v2:172.21.15.179:3300/0 conn(0x7f8e7415c950 0x7f8e740b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:24.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.836+0000 7f8e793ff700 1 -- 172.21.15.84:0/2464350269 >> 172.21.15.84:0/2464350269 conn(0x7f8e7409c1d0 msgr2=0x7f8e740d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:24.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.836+0000 7f8e793ff700 1 -- 172.21.15.84:0/2464350269 shutdown_connections 2023-07-14T11:13:24.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.836+0000 7f8e793ff700 1 -- 172.21.15.84:0/2464350269 wait complete. 2023-07-14T11:13:24.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.838+0000 7f8e793ff700 1 Processor -- start 2023-07-14T11:13:24.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.838+0000 7f8e793ff700 1 -- start start 2023-07-14T11:13:24.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.839+0000 7f8e793ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e740b1e00 0x7f8e740cd570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:24.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.839+0000 7f8e793ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e740d1220 0x7f8e740c94e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:24.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.839+0000 7f8e793ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e7415c950 0x7f8e740cf9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:24.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.839+0000 7f8e793ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e740cdb50 con 0x7f8e740b1e00 2023-07-14T11:13:24.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.839+0000 7f8e793ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e740cde30 con 0x7f8e740d1220 2023-07-14T11:13:24.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.839+0000 7f8e793ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e740ce110 con 0x7f8e7415c950 2023-07-14T11:13:24.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.839+0000 7f8e72ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e740b1e00 0x7f8e740cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:24.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.839+0000 7f8e72ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e740b1e00 0x7f8e740cd570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34346/0 (socket says 172.21.15.84:34346) 2023-07-14T11:13:24.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.839+0000 7f8e72ffd700 1 -- 172.21.15.84:0/3182649790 learned_addr learned my addr 172.21.15.84:0/3182649790 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:24.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.839+0000 7f8e727fc700 1 --2- 172.21.15.84:0/3182649790 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e740d1220 0x7f8e740c94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:24.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.839+0000 7f8e737fe700 1 --2- 172.21.15.84:0/3182649790 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e7415c950 0x7f8e740cf9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:24.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.839+0000 7f8e72ffd700 1 -- 172.21.15.84:0/3182649790 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e7415c950 msgr2=0x7f8e740cf9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:24.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.839+0000 7f8e72ffd700 1 --2- 172.21.15.84:0/3182649790 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e7415c950 0x7f8e740cf9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:24.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.840+0000 7f8e72ffd700 1 -- 172.21.15.84:0/3182649790 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e740d1220 msgr2=0x7f8e740c94e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:24.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.840+0000 7f8e72ffd700 1 --2- 172.21.15.84:0/3182649790 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e740d1220 0x7f8e740c94e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:24.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.840+0000 7f8e72ffd700 1 -- 172.21.15.84:0/3182649790 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e6c009a70 con 0x7f8e740b1e00 2023-07-14T11:13:24.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.840+0000 7f8e737fe700 1 --2- 172.21.15.84:0/3182649790 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e7415c950 0x7f8e740cf9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:13:24.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.840+0000 7f8e72ffd700 1 --2- 172.21.15.84:0/3182649790 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e740b1e00 0x7f8e740cd570 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8e6400c7f0 tx=0x7f8e6400cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:24.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.840+0000 7f8e5b7fe700 1 -- 172.21.15.84:0/3182649790 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e64005c20 con 0x7f8e740b1e00 2023-07-14T11:13:24.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.840+0000 7f8e5b7fe700 1 -- 172.21.15.84:0/3182649790 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e64005d80 con 0x7f8e740b1e00 2023-07-14T11:13:24.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.840+0000 7f8e793ff700 1 -- 172.21.15.84:0/3182649790 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e740ce3f0 con 0x7f8e740b1e00 2023-07-14T11:13:24.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.840+0000 7f8e5b7fe700 1 -- 172.21.15.84:0/3182649790 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e64011800 con 0x7f8e740b1e00 2023-07-14T11:13:24.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.840+0000 7f8e793ff700 1 -- 172.21.15.84:0/3182649790 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e74151b20 con 0x7f8e740b1e00 2023-07-14T11:13:24.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.841+0000 7f8e793ff700 1 -- 172.21.15.84:0/3182649790 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e740c6a70 con 0x7f8e740b1e00 2023-07-14T11:13:24.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.842+0000 7f8e5b7fe700 1 -- 172.21.15.84:0/3182649790 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8e64011960 con 0x7f8e740b1e00 2023-07-14T11:13:24.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.843+0000 7f8e5b7fe700 1 --2- 172.21.15.84:0/3182649790 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f8e6006ace0 0x7f8e6006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:24.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.843+0000 7f8e5b7fe700 1 -- 172.21.15.84:0/3182649790 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8e640892e0 con 0x7f8e740b1e00 2023-07-14T11:13:24.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.843+0000 7f8e727fc700 1 --2- 172.21.15.84:0/3182649790 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f8e6006ace0 0x7f8e6006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:24.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.843+0000 7f8e727fc700 1 --2- 172.21.15.84:0/3182649790 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f8e6006ace0 0x7f8e6006d190 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8e7409c8d0 tx=0x7f8e68007be0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:24.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:24.847+0000 7f8e5b7fe700 1 -- 172.21.15.84:0/3182649790 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f8e64057e00 con 0x7f8e740b1e00 2023-07-14T11:13:25.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.042+0000 7f8e793ff700 1 -- 172.21.15.84:0/3182649790 --> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8e740cdfa0 con 0x7f8e6006ace0 2023-07-14T11:13:25.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.051+0000 7f8e5b7fe700 1 -- 172.21.15.84:0/3182649790 <== mgr.4104 v2:172.21.15.84:6832/379617029 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286662 (secure 0 0 0) 0x7f8e740cdfa0 con 0x7f8e6006ace0 2023-07-14T11:13:25.056 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:13:25.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.055+0000 7f8e793ff700 1 -- 172.21.15.84:0/3182649790 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f8e6006ace0 msgr2=0x7f8e6006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:25.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.055+0000 7f8e793ff700 1 --2- 172.21.15.84:0/3182649790 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f8e6006ace0 0x7f8e6006d190 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8e7409c8d0 tx=0x7f8e68007be0 comp rx=0 tx=0).stop 2023-07-14T11:13:25.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.055+0000 7f8e793ff700 1 -- 172.21.15.84:0/3182649790 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e740b1e00 msgr2=0x7f8e740cd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:25.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.055+0000 7f8e793ff700 1 --2- 172.21.15.84:0/3182649790 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e740b1e00 0x7f8e740cd570 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8e6400c7f0 tx=0x7f8e6400cbb0 comp rx=0 tx=0).stop 2023-07-14T11:13:25.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.055+0000 7f8e793ff700 1 -- 172.21.15.84:0/3182649790 shutdown_connections 2023-07-14T11:13:25.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.055+0000 7f8e793ff700 1 --2- 172.21.15.84:0/3182649790 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f8e6006ace0 0x7f8e6006d190 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:25.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.055+0000 7f8e793ff700 1 --2- 172.21.15.84:0/3182649790 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e7415c950 0x7f8e740cf9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:25.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.055+0000 7f8e793ff700 1 --2- 172.21.15.84:0/3182649790 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e740b1e00 0x7f8e740cd570 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:25.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.055+0000 7f8e793ff700 1 --2- 172.21.15.84:0/3182649790 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e740d1220 0x7f8e740c94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:25.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.055+0000 7f8e793ff700 1 -- 172.21.15.84:0/3182649790 >> 172.21.15.84:0/3182649790 conn(0x7f8e7409c1d0 msgr2=0x7f8e740d1620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:25.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.055+0000 7f8e793ff700 1 -- 172.21.15.84:0/3182649790 shutdown_connections 2023-07-14T11:13:25.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.055+0000 7f8e793ff700 1 -- 172.21.15.84:0/3182649790 wait complete. 2023-07-14T11:13:25.060 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-07-14T11:13:25.075 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2023-07-14T11:13:24.074828+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218728,"kb_used_data":3112,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755992,"statfs":{"total":773094113280,"available":772870135808,"internally_reserved":0,"allocated":3186688,"data_stored":1902252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.093251"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.999827+0000","last_change":"2023-07-14T11:13:15.012043+0000","last_active":"2023-07-14T11:13:15.999827+0000","last_peered":"2023-07-14T11:13:15.999827+0000","last_clean":"2023-07-14T11:13:15.999827+0000","last_became_active":"2023-07-14T11:13:15.011781+0000","last_became_peered":"2023-07-14T11:13:15.011781+0000","last_unstale":"2023-07-14T11:13:15.999827+0000","last_undegraded":"2023-07-14T11:13:15.999827+0000","last_fullsized":"2023-07-14T11:13:15.999827+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:14:42.298292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.999486+0000","last_change":"2023-07-14T11:13:15.000344+0000","last_active":"2023-07-14T11:13:15.999486+0000","last_peered":"2023-07-14T11:13:15.999486+0000","last_clean":"2023-07-14T11:13:15.999486+0000","last_became_active":"2023-07-14T11:13:15.000039+0000","last_became_peered":"2023-07-14T11:13:15.000039+0000","last_unstale":"2023-07-14T11:13:15.999486+0000","last_undegraded":"2023-07-14T11:13:15.999486+0000","last_fullsized":"2023-07-14T11:13:15.999486+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:49:56.489161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.153368+0000","last_change":"2023-07-14T11:13:15.014928+0000","last_active":"2023-07-14T11:13:17.153368+0000","last_peered":"2023-07-14T11:13:17.153368+0000","last_clean":"2023-07-14T11:13:17.153368+0000","last_became_active":"2023-07-14T11:13:15.014663+0000","last_became_peered":"2023-07-14T11:13:15.014663+0000","last_unstale":"2023-07-14T11:13:17.153368+0000","last_undegraded":"2023-07-14T11:13:17.153368+0000","last_fullsized":"2023-07-14T11:13:17.153368+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:35:09.741442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.153229+0000","last_change":"2023-07-14T11:13:15.007462+0000","last_active":"2023-07-14T11:13:17.153229+0000","last_peered":"2023-07-14T11:13:17.153229+0000","last_clean":"2023-07-14T11:13:17.153229+0000","last_became_active":"2023-07-14T11:13:15.007180+0000","last_became_peered":"2023-07-14T11:13:15.007180+0000","last_unstale":"2023-07-14T11:13:17.153229+0000","last_undegraded":"2023-07-14T11:13:17.153229+0000","last_fullsized":"2023-07-14T11:13:17.153229+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:46:55.007943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.033473+0000","last_change":"2023-07-14T11:13:15.013824+0000","last_active":"2023-07-14T11:13:17.033473+0000","last_peered":"2023-07-14T11:13:17.033473+0000","last_clean":"2023-07-14T11:13:17.033473+0000","last_became_active":"2023-07-14T11:13:15.012925+0000","last_became_peered":"2023-07-14T11:13:15.012925+0000","last_unstale":"2023-07-14T11:13:17.033473+0000","last_undegraded":"2023-07-14T11:13:17.033473+0000","last_fullsized":"2023-07-14T11:13:17.033473+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:43:57.131270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.152537+0000","last_change":"2023-07-14T11:13:15.015095+0000","last_active":"2023-07-14T11:13:17.152537+0000","last_peered":"2023-07-14T11:13:17.152537+0000","last_clean":"2023-07-14T11:13:17.152537+0000","last_became_active":"2023-07-14T11:13:15.014838+0000","last_became_peered":"2023-07-14T11:13:15.014838+0000","last_unstale":"2023-07-14T11:13:17.152537+0000","last_undegraded":"2023-07-14T11:13:17.152537+0000","last_fullsized":"2023-07-14T11:13:17.152537+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:24:33.371173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.078380+0000","last_change":"2023-07-14T11:13:15.000923+0000","last_active":"2023-07-14T11:13:17.078380+0000","last_peered":"2023-07-14T11:13:17.078380+0000","last_clean":"2023-07-14T11:13:17.078380+0000","last_became_active":"2023-07-14T11:13:15.000141+0000","last_became_peered":"2023-07-14T11:13:15.000141+0000","last_unstale":"2023-07-14T11:13:17.078380+0000","last_undegraded":"2023-07-14T11:13:17.078380+0000","last_fullsized":"2023-07-14T11:13:17.078380+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:21:23.494380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.999143+0000","last_change":"2023-07-14T11:13:15.007538+0000","last_active":"2023-07-14T11:13:15.999143+0000","last_peered":"2023-07-14T11:13:15.999143+0000","last_clean":"2023-07-14T11:13:15.999143+0000","last_became_active":"2023-07-14T11:13:15.007221+0000","last_became_peered":"2023-07-14T11:13:15.007221+0000","last_unstale":"2023-07-14T11:13:15.999143+0000","last_undegraded":"2023-07-14T11:13:15.999143+0000","last_fullsized":"2023-07-14T11:13:15.999143+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:46:47.847976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.033875+0000","last_change":"2023-07-14T11:13:15.014209+0000","last_active":"2023-07-14T11:13:17.033875+0000","last_peered":"2023-07-14T11:13:17.033875+0000","last_clean":"2023-07-14T11:13:17.033875+0000","last_became_active":"2023-07-14T11:13:15.013525+0000","last_became_peered":"2023-07-14T11:13:15.013525+0000","last_unstale":"2023-07-14T11:13:17.033875+0000","last_undegraded":"2023-07-14T11:13:17.033875+0000","last_fullsized":"2023-07-14T11:13:17.033875+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:19:17.400582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.999679+0000","last_change":"2023-07-14T11:13:15.008305+0000","last_active":"2023-07-14T11:13:15.999679+0000","last_peered":"2023-07-14T11:13:15.999679+0000","last_clean":"2023-07-14T11:13:15.999679+0000","last_became_active":"2023-07-14T11:13:15.008009+0000","last_became_peered":"2023-07-14T11:13:15.008009+0000","last_unstale":"2023-07-14T11:13:15.999679+0000","last_undegraded":"2023-07-14T11:13:15.999679+0000","last_fullsized":"2023-07-14T11:13:15.999679+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:35:58.605091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.153500+0000","last_change":"2023-07-14T11:13:15.019530+0000","last_active":"2023-07-14T11:13:17.153500+0000","last_peered":"2023-07-14T11:13:17.153500+0000","last_clean":"2023-07-14T11:13:17.153500+0000","last_became_active":"2023-07-14T11:13:15.019260+0000","last_became_peered":"2023-07-14T11:13:15.019260+0000","last_unstale":"2023-07-14T11:13:17.153500+0000","last_undegraded":"2023-07-14T11:13:17.153500+0000","last_fullsized":"2023-07-14T11:13:17.153500+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:21:23.494380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.999400+0000","last_change":"2023-07-14T11:13:15.017282+0000","last_active":"2023-07-14T11:13:15.999400+0000","last_peered":"2023-07-14T11:13:15.999400+0000","last_clean":"2023-07-14T11:13:15.999400+0000","last_became_active":"2023-07-14T11:13:15.016949+0000","last_became_peered":"2023-07-14T11:13:15.016949+0000","last_unstale":"2023-07-14T11:13:15.999400+0000","last_undegraded":"2023-07-14T11:13:15.999400+0000","last_fullsized":"2023-07-14T11:13:15.999400+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:13:04.773850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.999008+0000","last_change":"2023-07-14T11:13:15.007583+0000","last_active":"2023-07-14T11:13:15.999008+0000","last_peered":"2023-07-14T11:13:15.999008+0000","last_clean":"2023-07-14T11:13:15.999008+0000","last_became_active":"2023-07-14T11:13:15.007308+0000","last_became_peered":"2023-07-14T11:13:15.007308+0000","last_unstale":"2023-07-14T11:13:15.999008+0000","last_undegraded":"2023-07-14T11:13:15.999008+0000","last_fullsized":"2023-07-14T11:13:15.999008+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:11:14.713367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.999086+0000","last_change":"2023-07-14T11:13:15.001617+0000","last_active":"2023-07-14T11:13:15.999086+0000","last_peered":"2023-07-14T11:13:15.999086+0000","last_clean":"2023-07-14T11:13:15.999086+0000","last_became_active":"2023-07-14T11:13:15.001328+0000","last_became_peered":"2023-07-14T11:13:15.001328+0000","last_unstale":"2023-07-14T11:13:15.999086+0000","last_undegraded":"2023-07-14T11:13:15.999086+0000","last_fullsized":"2023-07-14T11:13:15.999086+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:16:01.290597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.078731+0000","last_change":"2023-07-14T11:13:15.000610+0000","last_active":"2023-07-14T11:13:17.078731+0000","last_peered":"2023-07-14T11:13:17.078731+0000","last_clean":"2023-07-14T11:13:17.078731+0000","last_became_active":"2023-07-14T11:13:14.999771+0000","last_became_peered":"2023-07-14T11:13:14.999771+0000","last_unstale":"2023-07-14T11:13:17.078731+0000","last_undegraded":"2023-07-14T11:13:17.078731+0000","last_fullsized":"2023-07-14T11:13:17.078731+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:59:11.011459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.152501+0000","last_change":"2023-07-14T11:13:15.012608+0000","last_active":"2023-07-14T11:13:17.152501+0000","last_peered":"2023-07-14T11:13:17.152501+0000","last_clean":"2023-07-14T11:13:17.152501+0000","last_became_active":"2023-07-14T11:13:15.008876+0000","last_became_peered":"2023-07-14T11:13:15.008876+0000","last_unstale":"2023-07-14T11:13:17.152501+0000","last_undegraded":"2023-07-14T11:13:17.152501+0000","last_fullsized":"2023-07-14T11:13:17.152501+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:43:57.131270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.034050+0000","last_change":"2023-07-14T11:13:15.013846+0000","last_active":"2023-07-14T11:13:17.034050+0000","last_peered":"2023-07-14T11:13:17.034050+0000","last_clean":"2023-07-14T11:13:17.034050+0000","last_became_active":"2023-07-14T11:13:15.013207+0000","last_became_peered":"2023-07-14T11:13:15.013207+0000","last_unstale":"2023-07-14T11:13:17.034050+0000","last_undegraded":"2023-07-14T11:13:17.034050+0000","last_fullsized":"2023-07-14T11:13:17.034050+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:31:23.154081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.153367+0000","last_change":"2023-07-14T11:13:15.016833+0000","last_active":"2023-07-14T11:13:17.153367+0000","last_peered":"2023-07-14T11:13:17.153367+0000","last_clean":"2023-07-14T11:13:17.153367+0000","last_became_active":"2023-07-14T11:13:15.016507+0000","last_became_peered":"2023-07-14T11:13:15.016507+0000","last_unstale":"2023-07-14T11:13:17.153367+0000","last_undegraded":"2023-07-14T11:13:17.153367+0000","last_fullsized":"2023-07-14T11:13:17.153367+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:13:19.248345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.998956+0000","last_change":"2023-07-14T11:13:14.994609+0000","last_active":"2023-07-14T11:13:15.998956+0000","last_peered":"2023-07-14T11:13:15.998956+0000","last_clean":"2023-07-14T11:13:15.998956+0000","last_became_active":"2023-07-14T11:13:14.994280+0000","last_became_peered":"2023-07-14T11:13:14.994280+0000","last_unstale":"2023-07-14T11:13:15.998956+0000","last_undegraded":"2023-07-14T11:13:15.998956+0000","last_fullsized":"2023-07-14T11:13:15.998956+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:03:17.140553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.152720+0000","last_change":"2023-07-14T11:13:15.013542+0000","last_active":"2023-07-14T11:13:17.152720+0000","last_peered":"2023-07-14T11:13:17.152720+0000","last_clean":"2023-07-14T11:13:17.152720+0000","last_became_active":"2023-07-14T11:13:15.013278+0000","last_became_peered":"2023-07-14T11:13:15.013278+0000","last_unstale":"2023-07-14T11:13:17.152720+0000","last_undegraded":"2023-07-14T11:13:17.152720+0000","last_fullsized":"2023-07-14T11:13:17.152720+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:16:01.290597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.078631+0000","last_change":"2023-07-14T11:13:15.022035+0000","last_active":"2023-07-14T11:13:17.078631+0000","last_peered":"2023-07-14T11:13:17.078631+0000","last_clean":"2023-07-14T11:13:17.078631+0000","last_became_active":"2023-07-14T11:13:15.021666+0000","last_became_peered":"2023-07-14T11:13:15.021666+0000","last_unstale":"2023-07-14T11:13:17.078631+0000","last_undegraded":"2023-07-14T11:13:17.078631+0000","last_fullsized":"2023-07-14T11:13:17.078631+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:22:45.686858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.033457+0000","last_change":"2023-07-14T11:13:15.013591+0000","last_active":"2023-07-14T11:13:17.033457+0000","last_peered":"2023-07-14T11:13:17.033457+0000","last_clean":"2023-07-14T11:13:17.033457+0000","last_became_active":"2023-07-14T11:13:15.013300+0000","last_became_peered":"2023-07-14T11:13:15.013300+0000","last_unstale":"2023-07-14T11:13:17.033457+0000","last_undegraded":"2023-07-14T11:13:17.033457+0000","last_fullsized":"2023-07-14T11:13:17.033457+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:25:49.179942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.049049+0000","last_change":"2023-07-14T11:13:15.008804+0000","last_active":"2023-07-14T11:13:17.049049+0000","last_peered":"2023-07-14T11:13:17.049049+0000","last_clean":"2023-07-14T11:13:17.049049+0000","last_became_active":"2023-07-14T11:13:15.007948+0000","last_became_peered":"2023-07-14T11:13:15.007948+0000","last_unstale":"2023-07-14T11:13:17.049049+0000","last_undegraded":"2023-07-14T11:13:17.049049+0000","last_fullsized":"2023-07-14T11:13:17.049049+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:25:27.958037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.078749+0000","last_change":"2023-07-14T11:13:15.006574+0000","last_active":"2023-07-14T11:13:17.078749+0000","last_peered":"2023-07-14T11:13:17.078749+0000","last_clean":"2023-07-14T11:13:17.078749+0000","last_became_active":"2023-07-14T11:13:15.006129+0000","last_became_peered":"2023-07-14T11:13:15.006129+0000","last_unstale":"2023-07-14T11:13:17.078749+0000","last_undegraded":"2023-07-14T11:13:17.078749+0000","last_fullsized":"2023-07-14T11:13:17.078749+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:20:46.443943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.999626+0000","last_change":"2023-07-14T11:13:14.995683+0000","last_active":"2023-07-14T11:13:15.999626+0000","last_peered":"2023-07-14T11:13:15.999626+0000","last_clean":"2023-07-14T11:13:15.999626+0000","last_became_active":"2023-07-14T11:13:14.995379+0000","last_became_peered":"2023-07-14T11:13:14.995379+0000","last_unstale":"2023-07-14T11:13:15.999626+0000","last_undegraded":"2023-07-14T11:13:15.999626+0000","last_fullsized":"2023-07-14T11:13:15.999626+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:46:47.847976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.999694+0000","last_change":"2023-07-14T11:13:15.001711+0000","last_active":"2023-07-14T11:13:15.999694+0000","last_peered":"2023-07-14T11:13:15.999694+0000","last_clean":"2023-07-14T11:13:15.999694+0000","last_became_active":"2023-07-14T11:13:15.000809+0000","last_became_peered":"2023-07-14T11:13:15.000809+0000","last_unstale":"2023-07-14T11:13:15.999694+0000","last_undegraded":"2023-07-14T11:13:15.999694+0000","last_fullsized":"2023-07-14T11:13:15.999694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:19:17.400582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.999194+0000","last_change":"2023-07-14T11:13:15.001781+0000","last_active":"2023-07-14T11:13:15.999194+0000","last_peered":"2023-07-14T11:13:15.999194+0000","last_clean":"2023-07-14T11:13:15.999194+0000","last_became_active":"2023-07-14T11:13:15.001509+0000","last_became_peered":"2023-07-14T11:13:15.001509+0000","last_unstale":"2023-07-14T11:13:15.999194+0000","last_undegraded":"2023-07-14T11:13:15.999194+0000","last_fullsized":"2023-07-14T11:13:15.999194+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:19:17.400582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.152738+0000","last_change":"2023-07-14T11:13:13.986413+0000","last_active":"2023-07-14T11:13:17.152738+0000","last_peered":"2023-07-14T11:13:17.152738+0000","last_clean":"2023-07-14T11:13:17.152738+0000","last_became_active":"2023-07-14T11:13:13.986200+0000","last_became_peered":"2023-07-14T11:13:13.986200+0000","last_unstale":"2023-07-14T11:13:17.152738+0000","last_undegraded":"2023-07-14T11:13:17.152738+0000","last_fullsized":"2023-07-14T11:13:17.152738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:46:46.842842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.049124+0000","last_change":"2023-07-14T11:13:15.013058+0000","last_active":"2023-07-14T11:13:17.049124+0000","last_peered":"2023-07-14T11:13:17.049124+0000","last_clean":"2023-07-14T11:13:17.049124+0000","last_became_active":"2023-07-14T11:13:15.012721+0000","last_became_peered":"2023-07-14T11:13:15.012721+0000","last_unstale":"2023-07-14T11:13:17.049124+0000","last_undegraded":"2023-07-14T11:13:17.049124+0000","last_fullsized":"2023-07-14T11:13:17.049124+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:46:47.847976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.998128+0000","last_change":"2023-07-14T11:13:13.982240+0000","last_active":"2023-07-14T11:13:15.998128+0000","last_peered":"2023-07-14T11:13:15.998128+0000","last_clean":"2023-07-14T11:13:15.998128+0000","last_became_active":"2023-07-14T11:13:13.981974+0000","last_became_peered":"2023-07-14T11:13:13.981974+0000","last_unstale":"2023-07-14T11:13:15.998128+0000","last_undegraded":"2023-07-14T11:13:15.998128+0000","last_fullsized":"2023-07-14T11:13:15.998128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:48:45.385596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.033906+0000","last_change":"2023-07-14T11:13:15.024726+0000","last_active":"2023-07-14T11:13:17.033906+0000","last_peered":"2023-07-14T11:13:17.033906+0000","last_clean":"2023-07-14T11:13:17.033906+0000","last_became_active":"2023-07-14T11:13:15.024453+0000","last_became_peered":"2023-07-14T11:13:15.024453+0000","last_unstale":"2023-07-14T11:13:17.033906+0000","last_undegraded":"2023-07-14T11:13:17.033906+0000","last_fullsized":"2023-07-14T11:13:17.033906+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:02:08.522821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.048863+0000","last_change":"2023-07-14T11:13:13.979433+0000","last_active":"2023-07-14T11:13:17.048863+0000","last_peered":"2023-07-14T11:13:17.048863+0000","last_clean":"2023-07-14T11:13:17.048863+0000","last_became_active":"2023-07-14T11:13:13.979120+0000","last_became_peered":"2023-07-14T11:13:13.979120+0000","last_unstale":"2023-07-14T11:13:17.048863+0000","last_undegraded":"2023-07-14T11:13:17.048863+0000","last_fullsized":"2023-07-14T11:13:17.048863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:44:31.620403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.153793+0000","last_change":"2023-07-14T11:13:14.998412+0000","last_active":"2023-07-14T11:13:17.153793+0000","last_peered":"2023-07-14T11:13:17.153793+0000","last_clean":"2023-07-14T11:13:17.153793+0000","last_became_active":"2023-07-14T11:13:14.998117+0000","last_became_peered":"2023-07-14T11:13:14.998117+0000","last_unstale":"2023-07-14T11:13:17.153793+0000","last_undegraded":"2023-07-14T11:13:17.153793+0000","last_fullsized":"2023-07-14T11:13:17.153793+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:00:15.112821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.034072+0000","last_change":"2023-07-14T11:13:13.990938+0000","last_active":"2023-07-14T11:13:17.034072+0000","last_peered":"2023-07-14T11:13:17.034072+0000","last_clean":"2023-07-14T11:13:17.034072+0000","last_became_active":"2023-07-14T11:13:13.990590+0000","last_became_peered":"2023-07-14T11:13:13.990590+0000","last_unstale":"2023-07-14T11:13:17.034072+0000","last_undegraded":"2023-07-14T11:13:17.034072+0000","last_fullsized":"2023-07-14T11:13:17.034072+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:49:55.484027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.048946+0000","last_change":"2023-07-14T11:13:15.012816+0000","last_active":"2023-07-14T11:13:17.048946+0000","last_peered":"2023-07-14T11:13:17.048946+0000","last_clean":"2023-07-14T11:13:17.048946+0000","last_became_active":"2023-07-14T11:13:15.012565+0000","last_became_peered":"2023-07-14T11:13:15.012565+0000","last_unstale":"2023-07-14T11:13:17.048946+0000","last_undegraded":"2023-07-14T11:13:17.048946+0000","last_fullsized":"2023-07-14T11:13:17.048946+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:24:33.371173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.999538+0000","last_change":"2023-07-14T11:13:13.979704+0000","last_active":"2023-07-14T11:13:15.999538+0000","last_peered":"2023-07-14T11:13:15.999538+0000","last_clean":"2023-07-14T11:13:15.999538+0000","last_became_active":"2023-07-14T11:13:13.978362+0000","last_became_peered":"2023-07-14T11:13:13.978362+0000","last_unstale":"2023-07-14T11:13:15.999538+0000","last_undegraded":"2023-07-14T11:13:15.999538+0000","last_fullsized":"2023-07-14T11:13:15.999538+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:04:24.868340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.048894+0000","last_change":"2023-07-14T11:13:15.009208+0000","last_active":"2023-07-14T11:13:17.048894+0000","last_peered":"2023-07-14T11:13:17.048894+0000","last_clean":"2023-07-14T11:13:17.048894+0000","last_became_active":"2023-07-14T11:13:15.008572+0000","last_became_peered":"2023-07-14T11:13:15.008572+0000","last_unstale":"2023-07-14T11:13:17.048894+0000","last_undegraded":"2023-07-14T11:13:17.048894+0000","last_fullsized":"2023-07-14T11:13:17.048894+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:43:57.131270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.078743+0000","last_change":"2023-07-14T11:13:13.984123+0000","last_active":"2023-07-14T11:13:17.078743+0000","last_peered":"2023-07-14T11:13:17.078743+0000","last_clean":"2023-07-14T11:13:17.078743+0000","last_became_active":"2023-07-14T11:13:13.983850+0000","last_became_peered":"2023-07-14T11:13:13.983850+0000","last_unstale":"2023-07-14T11:13:17.078743+0000","last_undegraded":"2023-07-14T11:13:17.078743+0000","last_fullsized":"2023-07-14T11:13:17.078743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:11:25.673538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.998331+0000","last_change":"2023-07-14T11:13:14.996379+0000","last_active":"2023-07-14T11:13:15.998331+0000","last_peered":"2023-07-14T11:13:15.998331+0000","last_clean":"2023-07-14T11:13:15.998331+0000","last_became_active":"2023-07-14T11:13:14.996054+0000","last_became_peered":"2023-07-14T11:13:14.996054+0000","last_unstale":"2023-07-14T11:13:15.998331+0000","last_undegraded":"2023-07-14T11:13:15.998331+0000","last_fullsized":"2023-07-14T11:13:15.998331+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:25:49.179942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"22'6","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.152871+0000","last_change":"2023-07-14T11:13:13.985526+0000","last_active":"2023-07-14T11:13:17.152871+0000","last_peered":"2023-07-14T11:13:17.152871+0000","last_clean":"2023-07-14T11:13:17.152871+0000","last_became_active":"2023-07-14T11:13:13.985067+0000","last_became_peered":"2023-07-14T11:13:13.985067+0000","last_unstale":"2023-07-14T11:13:17.152871+0000","last_undegraded":"2023-07-14T11:13:17.152871+0000","last_fullsized":"2023-07-14T11:13:17.152871+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:02:07.517687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.152843+0000","last_change":"2023-07-14T11:13:15.016170+0000","last_active":"2023-07-14T11:13:17.152843+0000","last_peered":"2023-07-14T11:13:17.152843+0000","last_clean":"2023-07-14T11:13:17.152843+0000","last_became_active":"2023-07-14T11:13:15.015912+0000","last_became_peered":"2023-07-14T11:13:15.015912+0000","last_unstale":"2023-07-14T11:13:17.152843+0000","last_undegraded":"2023-07-14T11:13:17.152843+0000","last_fullsized":"2023-07-14T11:13:17.152843+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:04:25.873474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.078520+0000","last_change":"2023-07-14T11:13:13.992370+0000","last_active":"2023-07-14T11:13:17.078520+0000","last_peered":"2023-07-14T11:13:17.078520+0000","last_clean":"2023-07-14T11:13:17.078520+0000","last_became_active":"2023-07-14T11:13:13.992063+0000","last_became_peered":"2023-07-14T11:13:13.992063+0000","last_unstale":"2023-07-14T11:13:17.078520+0000","last_undegraded":"2023-07-14T11:13:17.078520+0000","last_fullsized":"2023-07-14T11:13:17.078520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:13:18.243212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.049117+0000","last_change":"2023-07-14T11:13:15.010039+0000","last_active":"2023-07-14T11:13:17.049117+0000","last_peered":"2023-07-14T11:13:17.049117+0000","last_clean":"2023-07-14T11:13:17.049117+0000","last_became_active":"2023-07-14T11:13:15.009733+0000","last_became_peered":"2023-07-14T11:13:15.009733+0000","last_unstale":"2023-07-14T11:13:17.049117+0000","last_undegraded":"2023-07-14T11:13:17.049117+0000","last_fullsized":"2023-07-14T11:13:17.049117+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:16:01.290597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.033307+0000","last_change":"2023-07-14T11:13:13.977355+0000","last_active":"2023-07-14T11:13:17.033307+0000","last_peered":"2023-07-14T11:13:17.033307+0000","last_clean":"2023-07-14T11:13:17.033307+0000","last_became_active":"2023-07-14T11:13:13.977018+0000","last_became_peered":"2023-07-14T11:13:13.977018+0000","last_unstale":"2023-07-14T11:13:17.033307+0000","last_undegraded":"2023-07-14T11:13:17.033307+0000","last_fullsized":"2023-07-14T11:13:17.033307+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:44:31.620403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.999436+0000","last_change":"2023-07-14T11:13:15.000625+0000","last_active":"2023-07-14T11:13:15.999436+0000","last_peered":"2023-07-14T11:13:15.999436+0000","last_clean":"2023-07-14T11:13:15.999436+0000","last_became_active":"2023-07-14T11:13:15.000327+0000","last_became_peered":"2023-07-14T11:13:15.000327+0000","last_unstale":"2023-07-14T11:13:15.999436+0000","last_undegraded":"2023-07-14T11:13:15.999436+0000","last_fullsized":"2023-07-14T11:13:15.999436+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:31:23.154081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.078502+0000","last_change":"2023-07-14T11:13:13.991381+0000","last_active":"2023-07-14T11:13:17.078502+0000","last_peered":"2023-07-14T11:13:17.078502+0000","last_clean":"2023-07-14T11:13:17.078502+0000","last_became_active":"2023-07-14T11:13:13.991045+0000","last_became_peered":"2023-07-14T11:13:13.991045+0000","last_unstale":"2023-07-14T11:13:17.078502+0000","last_undegraded":"2023-07-14T11:13:17.078502+0000","last_fullsized":"2023-07-14T11:13:17.078502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:35:57.599958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.033823+0000","last_change":"2023-07-14T11:13:15.014077+0000","last_active":"2023-07-14T11:13:17.033823+0000","last_peered":"2023-07-14T11:13:17.033823+0000","last_clean":"2023-07-14T11:13:17.033823+0000","last_became_active":"2023-07-14T11:13:15.013318+0000","last_became_peered":"2023-07-14T11:13:15.013318+0000","last_unstale":"2023-07-14T11:13:17.033823+0000","last_undegraded":"2023-07-14T11:13:17.033823+0000","last_fullsized":"2023-07-14T11:13:17.033823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:46:47.847976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.152378+0000","last_change":"2023-07-14T11:13:13.991024+0000","last_active":"2023-07-14T11:13:17.152378+0000","last_peered":"2023-07-14T11:13:17.152378+0000","last_clean":"2023-07-14T11:13:17.152378+0000","last_became_active":"2023-07-14T11:13:13.990641+0000","last_became_peered":"2023-07-14T11:13:13.990641+0000","last_unstale":"2023-07-14T11:13:17.152378+0000","last_undegraded":"2023-07-14T11:13:17.152378+0000","last_fullsized":"2023-07-14T11:13:17.152378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:11:13.708234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.049449+0000","last_change":"2023-07-14T11:13:15.004063+0000","last_active":"2023-07-14T11:13:17.049449+0000","last_peered":"2023-07-14T11:13:17.049449+0000","last_clean":"2023-07-14T11:13:17.049449+0000","last_became_active":"2023-07-14T11:13:15.003754+0000","last_became_peered":"2023-07-14T11:13:15.003754+0000","last_unstale":"2023-07-14T11:13:17.049449+0000","last_undegraded":"2023-07-14T11:13:17.049449+0000","last_fullsized":"2023-07-14T11:13:17.049449+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:49:56.489161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.079017+0000","last_change":"2023-07-14T11:13:13.991618+0000","last_active":"2023-07-14T11:13:17.079017+0000","last_peered":"2023-07-14T11:13:17.079017+0000","last_clean":"2023-07-14T11:13:17.079017+0000","last_became_active":"2023-07-14T11:13:13.991310+0000","last_became_peered":"2023-07-14T11:13:13.991310+0000","last_unstale":"2023-07-14T11:13:17.079017+0000","last_undegraded":"2023-07-14T11:13:17.079017+0000","last_fullsized":"2023-07-14T11:13:17.079017+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:30:47.895193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.999010+0000","last_change":"2023-07-14T11:13:15.000022+0000","last_active":"2023-07-14T11:13:15.999010+0000","last_peered":"2023-07-14T11:13:15.999010+0000","last_clean":"2023-07-14T11:13:15.999010+0000","last_became_active":"2023-07-14T11:13:14.999632+0000","last_became_peered":"2023-07-14T11:13:14.999632+0000","last_unstale":"2023-07-14T11:13:15.999010+0000","last_undegraded":"2023-07-14T11:13:15.999010+0000","last_fullsized":"2023-07-14T11:13:15.999010+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:24:33.371173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.078866+0000","last_change":"2023-07-14T11:13:13.991415+0000","last_active":"2023-07-14T11:13:17.078866+0000","last_peered":"2023-07-14T11:13:17.078866+0000","last_clean":"2023-07-14T11:13:17.078866+0000","last_became_active":"2023-07-14T11:13:13.991182+0000","last_became_peered":"2023-07-14T11:13:13.991182+0000","last_unstale":"2023-07-14T11:13:17.078866+0000","last_undegraded":"2023-07-14T11:13:17.078866+0000","last_fullsized":"2023-07-14T11:13:17.078866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:59:00.823913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.152670+0000","last_change":"2023-07-14T11:13:15.022123+0000","last_active":"2023-07-14T11:13:17.152670+0000","last_peered":"2023-07-14T11:13:17.152670+0000","last_clean":"2023-07-14T11:13:17.152670+0000","last_became_active":"2023-07-14T11:13:15.016892+0000","last_became_peered":"2023-07-14T11:13:15.016892+0000","last_unstale":"2023-07-14T11:13:17.152670+0000","last_undegraded":"2023-07-14T11:13:17.152670+0000","last_fullsized":"2023-07-14T11:13:17.152670+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:25:27.958037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.078935+0000","last_change":"2023-07-14T11:13:13.989926+0000","last_active":"2023-07-14T11:13:17.078935+0000","last_peered":"2023-07-14T11:13:17.078935+0000","last_clean":"2023-07-14T11:13:17.078935+0000","last_became_active":"2023-07-14T11:13:13.989600+0000","last_became_peered":"2023-07-14T11:13:13.989600+0000","last_unstale":"2023-07-14T11:13:17.078935+0000","last_undegraded":"2023-07-14T11:13:17.078935+0000","last_fullsized":"2023-07-14T11:13:17.078935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:22:13.780840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.153225+0000","last_change":"2023-07-14T11:13:15.004391+0000","last_active":"2023-07-14T11:13:17.153225+0000","last_peered":"2023-07-14T11:13:17.153225+0000","last_clean":"2023-07-14T11:13:17.153225+0000","last_became_active":"2023-07-14T11:13:14.999504+0000","last_became_peered":"2023-07-14T11:13:14.999504+0000","last_unstale":"2023-07-14T11:13:17.153225+0000","last_undegraded":"2023-07-14T11:13:17.153225+0000","last_fullsized":"2023-07-14T11:13:17.153225+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:14:42.298292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.999372+0000","last_change":"2023-07-14T11:13:13.979533+0000","last_active":"2023-07-14T11:13:15.999372+0000","last_peered":"2023-07-14T11:13:15.999372+0000","last_clean":"2023-07-14T11:13:15.999372+0000","last_became_active":"2023-07-14T11:13:13.979160+0000","last_became_peered":"2023-07-14T11:13:13.979160+0000","last_unstale":"2023-07-14T11:13:15.999372+0000","last_undegraded":"2023-07-14T11:13:15.999372+0000","last_fullsized":"2023-07-14T11:13:15.999372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:17:30.634477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.033756+0000","last_change":"2023-07-14T11:13:15.016320+0000","last_active":"2023-07-14T11:13:17.033756+0000","last_peered":"2023-07-14T11:13:17.033756+0000","last_clean":"2023-07-14T11:13:17.033756+0000","last_became_active":"2023-07-14T11:13:15.016023+0000","last_became_peered":"2023-07-14T11:13:15.016023+0000","last_unstale":"2023-07-14T11:13:17.033756+0000","last_undegraded":"2023-07-14T11:13:17.033756+0000","last_fullsized":"2023-07-14T11:13:17.033756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:16:01.290597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.049338+0000","last_change":"2023-07-14T11:13:13.987628+0000","last_active":"2023-07-14T11:13:17.049338+0000","last_peered":"2023-07-14T11:13:17.049338+0000","last_clean":"2023-07-14T11:13:17.049338+0000","last_became_active":"2023-07-14T11:13:13.987361+0000","last_became_peered":"2023-07-14T11:13:13.987361+0000","last_unstale":"2023-07-14T11:13:17.049338+0000","last_undegraded":"2023-07-14T11:13:17.049338+0000","last_fullsized":"2023-07-14T11:13:17.049338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:02:07.517687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.152811+0000","last_change":"2023-07-14T11:13:15.021655+0000","last_active":"2023-07-14T11:13:17.152811+0000","last_peered":"2023-07-14T11:13:17.152811+0000","last_clean":"2023-07-14T11:13:17.152811+0000","last_became_active":"2023-07-14T11:13:15.018683+0000","last_became_peered":"2023-07-14T11:13:15.018683+0000","last_unstale":"2023-07-14T11:13:17.152811+0000","last_undegraded":"2023-07-14T11:13:17.152811+0000","last_fullsized":"2023-07-14T11:13:17.152811+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:17:31.639610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.153156+0000","last_change":"2023-07-14T11:13:13.992123+0000","last_active":"2023-07-14T11:13:17.153156+0000","last_peered":"2023-07-14T11:13:17.153156+0000","last_clean":"2023-07-14T11:13:17.153156+0000","last_became_active":"2023-07-14T11:13:13.991832+0000","last_became_peered":"2023-07-14T11:13:13.991832+0000","last_unstale":"2023-07-14T11:13:17.153156+0000","last_undegraded":"2023-07-14T11:13:17.153156+0000","last_fullsized":"2023-07-14T11:13:17.153156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:13:03.768716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.153630+0000","last_change":"2023-07-14T11:13:15.019054+0000","last_active":"2023-07-14T11:13:17.153630+0000","last_peered":"2023-07-14T11:13:17.153630+0000","last_clean":"2023-07-14T11:13:17.153630+0000","last_became_active":"2023-07-14T11:13:15.018737+0000","last_became_peered":"2023-07-14T11:13:15.018737+0000","last_unstale":"2023-07-14T11:13:17.153630+0000","last_undegraded":"2023-07-14T11:13:17.153630+0000","last_fullsized":"2023-07-14T11:13:17.153630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:59:11.011459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.152859+0000","last_change":"2023-07-14T11:13:13.986400+0000","last_active":"2023-07-14T11:13:17.152859+0000","last_peered":"2023-07-14T11:13:17.152859+0000","last_clean":"2023-07-14T11:13:17.152859+0000","last_became_active":"2023-07-14T11:13:13.986081+0000","last_became_peered":"2023-07-14T11:13:13.986081+0000","last_unstale":"2023-07-14T11:13:17.152859+0000","last_undegraded":"2023-07-14T11:13:17.152859+0000","last_fullsized":"2023-07-14T11:13:17.152859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:15:26.472331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.153489+0000","last_change":"2023-07-14T11:13:15.011241+0000","last_active":"2023-07-14T11:13:17.153489+0000","last_peered":"2023-07-14T11:13:17.153489+0000","last_clean":"2023-07-14T11:13:17.153489+0000","last_became_active":"2023-07-14T11:13:15.010955+0000","last_became_peered":"2023-07-14T11:13:15.010955+0000","last_unstale":"2023-07-14T11:13:17.153489+0000","last_undegraded":"2023-07-14T11:13:17.153489+0000","last_fullsized":"2023-07-14T11:13:17.153489+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:22:45.686858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.048695+0000","last_change":"2023-07-14T11:13:13.982073+0000","last_active":"2023-07-14T11:13:17.048695+0000","last_peered":"2023-07-14T11:13:17.048695+0000","last_clean":"2023-07-14T11:13:17.048695+0000","last_became_active":"2023-07-14T11:13:13.981729+0000","last_became_peered":"2023-07-14T11:13:13.981729+0000","last_unstale":"2023-07-14T11:13:17.048695+0000","last_undegraded":"2023-07-14T11:13:17.048695+0000","last_fullsized":"2023-07-14T11:13:17.048695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:00:14.107687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.999908+0000","last_change":"2023-07-14T11:13:15.008740+0000","last_active":"2023-07-14T11:13:15.999908+0000","last_peered":"2023-07-14T11:13:15.999908+0000","last_clean":"2023-07-14T11:13:15.999908+0000","last_became_active":"2023-07-14T11:13:15.008487+0000","last_became_peered":"2023-07-14T11:13:15.008487+0000","last_unstale":"2023-07-14T11:13:15.999908+0000","last_undegraded":"2023-07-14T11:13:15.999908+0000","last_fullsized":"2023-07-14T11:13:15.999908+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:15:27.477464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.998417+0000","last_change":"2023-07-14T11:13:08.923786+0000","last_active":"2023-07-14T11:13:15.998417+0000","last_peered":"2023-07-14T11:13:15.998417+0000","last_clean":"2023-07-14T11:13:15.998417+0000","last_became_active":"2023-07-14T11:13:08.923384+0000","last_became_peered":"2023-07-14T11:13:08.923384+0000","last_unstale":"2023-07-14T11:13:15.998417+0000","last_undegraded":"2023-07-14T11:13:15.998417+0000","last_fullsized":"2023-07-14T11:13:15.998417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:43:50.917736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.999590+0000","last_change":"2023-07-14T11:13:13.979901+0000","last_active":"2023-07-14T11:13:15.999590+0000","last_peered":"2023-07-14T11:13:15.999590+0000","last_clean":"2023-07-14T11:13:15.999590+0000","last_became_active":"2023-07-14T11:13:13.979617+0000","last_became_peered":"2023-07-14T11:13:13.979617+0000","last_unstale":"2023-07-14T11:13:15.999590+0000","last_undegraded":"2023-07-14T11:13:15.999590+0000","last_fullsized":"2023-07-14T11:13:15.999590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:59:05.056670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.998532+0000","last_change":"2023-07-14T11:13:14.999336+0000","last_active":"2023-07-14T11:13:15.998532+0000","last_peered":"2023-07-14T11:13:15.998532+0000","last_clean":"2023-07-14T11:13:15.998532+0000","last_became_active":"2023-07-14T11:13:14.999023+0000","last_became_peered":"2023-07-14T11:13:14.999023+0000","last_unstale":"2023-07-14T11:13:15.998532+0000","last_undegraded":"2023-07-14T11:13:15.998532+0000","last_fullsized":"2023-07-14T11:13:15.998532+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:24:33.371173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.999056+0000","last_change":"2023-07-14T11:13:08.758749+0000","last_active":"2023-07-14T11:13:15.999056+0000","last_peered":"2023-07-14T11:13:15.999056+0000","last_clean":"2023-07-14T11:13:15.999056+0000","last_became_active":"2023-07-14T11:13:08.757956+0000","last_became_peered":"2023-07-14T11:13:08.757956+0000","last_unstale":"2023-07-14T11:13:15.999056+0000","last_undegraded":"2023-07-14T11:13:15.999056+0000","last_fullsized":"2023-07-14T11:13:15.999056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:25:21.744503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.152941+0000","last_change":"2023-07-14T11:13:13.987810+0000","last_active":"2023-07-14T11:13:17.152941+0000","last_peered":"2023-07-14T11:13:17.152941+0000","last_clean":"2023-07-14T11:13:17.152941+0000","last_became_active":"2023-07-14T11:13:13.987575+0000","last_became_peered":"2023-07-14T11:13:13.987575+0000","last_unstale":"2023-07-14T11:13:17.152941+0000","last_undegraded":"2023-07-14T11:13:17.152941+0000","last_fullsized":"2023-07-14T11:13:17.152941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:31:22.148947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.998552+0000","last_change":"2023-07-14T11:13:15.000483+0000","last_active":"2023-07-14T11:13:15.998552+0000","last_peered":"2023-07-14T11:13:15.998552+0000","last_clean":"2023-07-14T11:13:15.998552+0000","last_became_active":"2023-07-14T11:13:15.000027+0000","last_became_peered":"2023-07-14T11:13:15.000027+0000","last_unstale":"2023-07-14T11:13:15.998552+0000","last_undegraded":"2023-07-14T11:13:15.998552+0000","last_fullsized":"2023-07-14T11:13:15.998552+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:25:27.958037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.998899+0000","last_change":"2023-07-14T11:13:08.862331+0000","last_active":"2023-07-14T11:13:15.998899+0000","last_peered":"2023-07-14T11:13:15.998899+0000","last_clean":"2023-07-14T11:13:15.998899+0000","last_became_active":"2023-07-14T11:13:08.861817+0000","last_became_peered":"2023-07-14T11:13:08.861817+0000","last_unstale":"2023-07-14T11:13:15.998899+0000","last_undegraded":"2023-07-14T11:13:15.998899+0000","last_fullsized":"2023-07-14T11:13:15.998899+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:58:59.505841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.998031+0000","last_change":"2023-07-14T11:13:13.979826+0000","last_active":"2023-07-14T11:13:15.998031+0000","last_peered":"2023-07-14T11:13:15.998031+0000","last_clean":"2023-07-14T11:13:15.998031+0000","last_became_active":"2023-07-14T11:13:13.979506+0000","last_became_peered":"2023-07-14T11:13:13.979506+0000","last_unstale":"2023-07-14T11:13:15.998031+0000","last_undegraded":"2023-07-14T11:13:15.998031+0000","last_fullsized":"2023-07-14T11:13:15.998031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:00:14.107687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.999898+0000","last_change":"2023-07-14T11:13:14.999511+0000","last_active":"2023-07-14T11:13:15.999898+0000","last_peered":"2023-07-14T11:13:15.999898+0000","last_clean":"2023-07-14T11:13:15.999898+0000","last_became_active":"2023-07-14T11:13:14.999201+0000","last_became_peered":"2023-07-14T11:13:14.999201+0000","last_unstale":"2023-07-14T11:13:15.999898+0000","last_undegraded":"2023-07-14T11:13:15.999898+0000","last_fullsized":"2023-07-14T11:13:15.999898+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:17:31.639610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.999358+0000","last_change":"2023-07-14T11:13:08.757882+0000","last_active":"2023-07-14T11:13:15.999358+0000","last_peered":"2023-07-14T11:13:15.999358+0000","last_clean":"2023-07-14T11:13:15.999358+0000","last_became_active":"2023-07-14T11:13:08.757541+0000","last_became_peered":"2023-07-14T11:13:08.757541+0000","last_unstale":"2023-07-14T11:13:15.999358+0000","last_undegraded":"2023-07-14T11:13:15.999358+0000","last_fullsized":"2023-07-14T11:13:15.999358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:15:21.263931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":175,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.078502+0000","last_change":"2023-07-14T11:13:01.370649+0000","last_active":"2023-07-14T11:13:17.078502+0000","last_peered":"2023-07-14T11:13:17.078502+0000","last_clean":"2023-07-14T11:13:17.078502+0000","last_became_active":"2023-07-14T11:13:01.369478+0000","last_became_peered":"2023-07-14T11:13:01.369478+0000","last_unstale":"2023-07-14T11:13:17.078502+0000","last_undegraded":"2023-07-14T11:13:17.078502+0000","last_fullsized":"2023-07-14T11:13:17.078502+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:00.254800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:00.254800+0000","last_clean_scrub_stamp":"2023-07-14T11:13:00.254800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:34:56.039980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.048856+0000","last_change":"2023-07-14T11:13:13.989456+0000","last_active":"2023-07-14T11:13:17.048856+0000","last_peered":"2023-07-14T11:13:17.048856+0000","last_clean":"2023-07-14T11:13:17.048856+0000","last_became_active":"2023-07-14T11:13:13.989210+0000","last_became_peered":"2023-07-14T11:13:13.989210+0000","last_unstale":"2023-07-14T11:13:17.048856+0000","last_undegraded":"2023-07-14T11:13:17.048856+0000","last_fullsized":"2023-07-14T11:13:17.048856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:25:48.174808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.153350+0000","last_change":"2023-07-14T11:13:15.020682+0000","last_active":"2023-07-14T11:13:17.153350+0000","last_peered":"2023-07-14T11:13:17.153350+0000","last_clean":"2023-07-14T11:13:17.153350+0000","last_became_active":"2023-07-14T11:13:15.020395+0000","last_became_peered":"2023-07-14T11:13:15.020395+0000","last_unstale":"2023-07-14T11:13:17.153350+0000","last_undegraded":"2023-07-14T11:13:17.153350+0000","last_fullsized":"2023-07-14T11:13:17.153350+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:36:50.668482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.078216+0000","last_change":"2023-07-14T11:13:08.760609+0000","last_active":"2023-07-14T11:13:17.078216+0000","last_peered":"2023-07-14T11:13:17.078216+0000","last_clean":"2023-07-14T11:13:17.078216+0000","last_became_active":"2023-07-14T11:13:08.760285+0000","last_became_peered":"2023-07-14T11:13:08.760285+0000","last_unstale":"2023-07-14T11:13:17.078216+0000","last_undegraded":"2023-07-14T11:13:17.078216+0000","last_fullsized":"2023-07-14T11:13:17.078216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:58:59.848270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.033281+0000","last_change":"2023-07-14T11:13:13.985223+0000","last_active":"2023-07-14T11:13:17.033281+0000","last_peered":"2023-07-14T11:13:17.033281+0000","last_clean":"2023-07-14T11:13:17.033281+0000","last_became_active":"2023-07-14T11:13:13.984889+0000","last_became_peered":"2023-07-14T11:13:13.984889+0000","last_unstale":"2023-07-14T11:13:17.033281+0000","last_undegraded":"2023-07-14T11:13:17.033281+0000","last_fullsized":"2023-07-14T11:13:17.033281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:48:45.385596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.034029+0000","last_change":"2023-07-14T11:13:15.014139+0000","last_active":"2023-07-14T11:13:17.034029+0000","last_peered":"2023-07-14T11:13:17.034029+0000","last_clean":"2023-07-14T11:13:17.034029+0000","last_became_active":"2023-07-14T11:13:15.013656+0000","last_became_peered":"2023-07-14T11:13:15.013656+0000","last_unstale":"2023-07-14T11:13:17.034029+0000","last_undegraded":"2023-07-14T11:13:17.034029+0000","last_fullsized":"2023-07-14T11:13:17.034029+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:17:31.639610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.078825+0000","last_change":"2023-07-14T11:13:08.923899+0000","last_active":"2023-07-14T11:13:17.078825+0000","last_peered":"2023-07-14T11:13:17.078825+0000","last_clean":"2023-07-14T11:13:17.078825+0000","last_became_active":"2023-07-14T11:13:08.923513+0000","last_became_peered":"2023-07-14T11:13:08.923513+0000","last_unstale":"2023-07-14T11:13:17.078825+0000","last_undegraded":"2023-07-14T11:13:17.078825+0000","last_fullsized":"2023-07-14T11:13:17.078825+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:45:01.516820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.998671+0000","last_change":"2023-07-14T11:13:13.980381+0000","last_active":"2023-07-14T11:13:15.998671+0000","last_peered":"2023-07-14T11:13:15.998671+0000","last_clean":"2023-07-14T11:13:15.998671+0000","last_became_active":"2023-07-14T11:13:13.980136+0000","last_became_peered":"2023-07-14T11:13:13.980136+0000","last_unstale":"2023-07-14T11:13:15.998671+0000","last_undegraded":"2023-07-14T11:13:15.998671+0000","last_fullsized":"2023-07-14T11:13:15.998671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:16:00.285463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.033518+0000","last_change":"2023-07-14T11:13:15.006407+0000","last_active":"2023-07-14T11:13:17.033518+0000","last_peered":"2023-07-14T11:13:17.033518+0000","last_clean":"2023-07-14T11:13:17.033518+0000","last_became_active":"2023-07-14T11:13:15.006104+0000","last_became_peered":"2023-07-14T11:13:15.006104+0000","last_unstale":"2023-07-14T11:13:17.033518+0000","last_undegraded":"2023-07-14T11:13:17.033518+0000","last_fullsized":"2023-07-14T11:13:17.033518+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:24:33.371173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.049380+0000","last_change":"2023-07-14T11:13:13.979833+0000","last_active":"2023-07-14T11:13:17.049380+0000","last_peered":"2023-07-14T11:13:17.049380+0000","last_clean":"2023-07-14T11:13:17.049380+0000","last_became_active":"2023-07-14T11:13:13.979564+0000","last_became_peered":"2023-07-14T11:13:13.979564+0000","last_unstale":"2023-07-14T11:13:17.049380+0000","last_undegraded":"2023-07-14T11:13:17.049380+0000","last_fullsized":"2023-07-14T11:13:17.049380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:15:26.472331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.999751+0000","last_change":"2023-07-14T11:13:08.761726+0000","last_active":"2023-07-14T11:13:15.999751+0000","last_peered":"2023-07-14T11:13:15.999751+0000","last_clean":"2023-07-14T11:13:15.999751+0000","last_became_active":"2023-07-14T11:13:08.761365+0000","last_became_peered":"2023-07-14T11:13:08.761365+0000","last_unstale":"2023-07-14T11:13:15.999751+0000","last_undegraded":"2023-07-14T11:13:15.999751+0000","last_fullsized":"2023-07-14T11:13:15.999751+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:02:02.309287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.048645+0000","last_change":"2023-07-14T11:13:15.004961+0000","last_active":"2023-07-14T11:13:17.048645+0000","last_peered":"2023-07-14T11:13:17.048645+0000","last_clean":"2023-07-14T11:13:17.048645+0000","last_became_active":"2023-07-14T11:13:15.004656+0000","last_became_peered":"2023-07-14T11:13:15.004656+0000","last_unstale":"2023-07-14T11:13:17.048645+0000","last_undegraded":"2023-07-14T11:13:17.048645+0000","last_fullsized":"2023-07-14T11:13:17.048645+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:48:05.407947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.153709+0000","last_change":"2023-07-14T11:13:08.762084+0000","last_active":"2023-07-14T11:13:17.153709+0000","last_peered":"2023-07-14T11:13:17.153709+0000","last_clean":"2023-07-14T11:13:17.153709+0000","last_became_active":"2023-07-14T11:13:08.761763+0000","last_became_peered":"2023-07-14T11:13:08.761763+0000","last_unstale":"2023-07-14T11:13:17.153709+0000","last_undegraded":"2023-07-14T11:13:17.153709+0000","last_fullsized":"2023-07-14T11:13:17.153709+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:47:59.194413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.033950+0000","last_change":"2023-07-14T11:13:13.985679+0000","last_active":"2023-07-14T11:13:17.033950+0000","last_peered":"2023-07-14T11:13:17.033950+0000","last_clean":"2023-07-14T11:13:17.033950+0000","last_became_active":"2023-07-14T11:13:13.985432+0000","last_became_peered":"2023-07-14T11:13:13.985432+0000","last_unstale":"2023-07-14T11:13:17.033950+0000","last_undegraded":"2023-07-14T11:13:17.033950+0000","last_fullsized":"2023-07-14T11:13:17.033950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:15:26.472331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.152753+0000","last_change":"2023-07-14T11:13:15.006256+0000","last_active":"2023-07-14T11:13:17.152753+0000","last_peered":"2023-07-14T11:13:17.152753+0000","last_clean":"2023-07-14T11:13:17.152753+0000","last_became_active":"2023-07-14T11:13:15.005979+0000","last_became_peered":"2023-07-14T11:13:15.005979+0000","last_unstale":"2023-07-14T11:13:17.152753+0000","last_undegraded":"2023-07-14T11:13:17.152753+0000","last_fullsized":"2023-07-14T11:13:17.152753+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:19:17.400582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.033617+0000","last_change":"2023-07-14T11:13:13.987238+0000","last_active":"2023-07-14T11:13:17.033617+0000","last_peered":"2023-07-14T11:13:17.033617+0000","last_clean":"2023-07-14T11:13:17.033617+0000","last_became_active":"2023-07-14T11:13:13.986985+0000","last_became_peered":"2023-07-14T11:13:13.986985+0000","last_unstale":"2023-07-14T11:13:17.033617+0000","last_undegraded":"2023-07-14T11:13:17.033617+0000","last_fullsized":"2023-07-14T11:13:17.033617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:25:26.952904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.999527+0000","last_change":"2023-07-14T11:13:14.998910+0000","last_active":"2023-07-14T11:13:15.999527+0000","last_peered":"2023-07-14T11:13:15.999527+0000","last_clean":"2023-07-14T11:13:15.999527+0000","last_became_active":"2023-07-14T11:13:14.998599+0000","last_became_peered":"2023-07-14T11:13:14.998599+0000","last_unstale":"2023-07-14T11:13:15.999527+0000","last_undegraded":"2023-07-14T11:13:15.999527+0000","last_fullsized":"2023-07-14T11:13:15.999527+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:46:55.007943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.999207+0000","last_change":"2023-07-14T11:13:13.978096+0000","last_active":"2023-07-14T11:13:15.999207+0000","last_peered":"2023-07-14T11:13:15.999207+0000","last_clean":"2023-07-14T11:13:15.999207+0000","last_became_active":"2023-07-14T11:13:13.977725+0000","last_became_peered":"2023-07-14T11:13:13.977725+0000","last_unstale":"2023-07-14T11:13:15.999207+0000","last_undegraded":"2023-07-14T11:13:15.999207+0000","last_fullsized":"2023-07-14T11:13:15.999207+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:02:07.517687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.153133+0000","last_change":"2023-07-14T11:13:15.022976+0000","last_active":"2023-07-14T11:13:17.153133+0000","last_peered":"2023-07-14T11:13:17.153133+0000","last_clean":"2023-07-14T11:13:17.153133+0000","last_became_active":"2023-07-14T11:13:15.022716+0000","last_became_peered":"2023-07-14T11:13:15.022716+0000","last_unstale":"2023-07-14T11:13:17.153133+0000","last_undegraded":"2023-07-14T11:13:17.153133+0000","last_fullsized":"2023-07-14T11:13:17.153133+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:35:58.605091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.999708+0000","last_change":"2023-07-14T11:13:13.978838+0000","last_active":"2023-07-14T11:13:15.999708+0000","last_peered":"2023-07-14T11:13:15.999708+0000","last_clean":"2023-07-14T11:13:15.999708+0000","last_became_active":"2023-07-14T11:13:13.977771+0000","last_became_peered":"2023-07-14T11:13:13.977771+0000","last_unstale":"2023-07-14T11:13:15.999708+0000","last_undegraded":"2023-07-14T11:13:15.999708+0000","last_fullsized":"2023-07-14T11:13:15.999708+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:35:08.736309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.152969+0000","last_change":"2023-07-14T11:13:15.019154+0000","last_active":"2023-07-14T11:13:17.152969+0000","last_peered":"2023-07-14T11:13:17.152969+0000","last_clean":"2023-07-14T11:13:17.152969+0000","last_became_active":"2023-07-14T11:13:15.018878+0000","last_became_peered":"2023-07-14T11:13:15.018878+0000","last_unstale":"2023-07-14T11:13:17.152969+0000","last_undegraded":"2023-07-14T11:13:17.152969+0000","last_fullsized":"2023-07-14T11:13:17.152969+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:49:56.489161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.049132+0000","last_change":"2023-07-14T11:13:13.989944+0000","last_active":"2023-07-14T11:13:17.049132+0000","last_peered":"2023-07-14T11:13:17.049132+0000","last_clean":"2023-07-14T11:13:17.049132+0000","last_became_active":"2023-07-14T11:13:13.989576+0000","last_became_peered":"2023-07-14T11:13:13.989576+0000","last_unstale":"2023-07-14T11:13:17.049132+0000","last_undegraded":"2023-07-14T11:13:17.049132+0000","last_fullsized":"2023-07-14T11:13:17.049132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:19:16.395448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.048726+0000","last_change":"2023-07-14T11:13:15.009006+0000","last_active":"2023-07-14T11:13:17.048726+0000","last_peered":"2023-07-14T11:13:17.048726+0000","last_clean":"2023-07-14T11:13:17.048726+0000","last_became_active":"2023-07-14T11:13:15.008256+0000","last_became_peered":"2023-07-14T11:13:15.008256+0000","last_unstale":"2023-07-14T11:13:17.048726+0000","last_undegraded":"2023-07-14T11:13:17.048726+0000","last_fullsized":"2023-07-14T11:13:17.048726+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:48:46.390730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.034135+0000","last_change":"2023-07-14T11:13:13.991268+0000","last_active":"2023-07-14T11:13:17.034135+0000","last_peered":"2023-07-14T11:13:17.034135+0000","last_clean":"2023-07-14T11:13:17.034135+0000","last_became_active":"2023-07-14T11:13:13.991022+0000","last_became_peered":"2023-07-14T11:13:13.991022+0000","last_unstale":"2023-07-14T11:13:17.034135+0000","last_undegraded":"2023-07-14T11:13:17.034135+0000","last_fullsized":"2023-07-14T11:13:17.034135+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:04:24.868340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.152358+0000","last_change":"2023-07-14T11:13:15.012788+0000","last_active":"2023-07-14T11:13:17.152358+0000","last_peered":"2023-07-14T11:13:17.152358+0000","last_clean":"2023-07-14T11:13:17.152358+0000","last_became_active":"2023-07-14T11:13:15.012357+0000","last_became_peered":"2023-07-14T11:13:15.012357+0000","last_unstale":"2023-07-14T11:13:17.152358+0000","last_undegraded":"2023-07-14T11:13:17.152358+0000","last_fullsized":"2023-07-14T11:13:17.152358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:25:49.179942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.153325+0000","last_change":"2023-07-14T11:13:15.002966+0000","last_active":"2023-07-14T11:13:17.153325+0000","last_peered":"2023-07-14T11:13:17.153325+0000","last_clean":"2023-07-14T11:13:17.153325+0000","last_became_active":"2023-07-14T11:13:15.002577+0000","last_became_peered":"2023-07-14T11:13:15.002577+0000","last_unstale":"2023-07-14T11:13:17.153325+0000","last_undegraded":"2023-07-14T11:13:17.153325+0000","last_fullsized":"2023-07-14T11:13:17.153325+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:45:01.027542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.049399+0000","last_change":"2023-07-14T11:13:15.013713+0000","last_active":"2023-07-14T11:13:17.049399+0000","last_peered":"2023-07-14T11:13:17.049399+0000","last_clean":"2023-07-14T11:13:17.049399+0000","last_became_active":"2023-07-14T11:13:15.013385+0000","last_became_peered":"2023-07-14T11:13:15.013385+0000","last_unstale":"2023-07-14T11:13:17.049399+0000","last_undegraded":"2023-07-14T11:13:17.049399+0000","last_fullsized":"2023-07-14T11:13:17.049399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:31:23.154081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.153036+0000","last_change":"2023-07-14T11:13:15.013904+0000","last_active":"2023-07-14T11:13:17.153036+0000","last_peered":"2023-07-14T11:13:17.153036+0000","last_clean":"2023-07-14T11:13:17.153036+0000","last_became_active":"2023-07-14T11:13:15.013654+0000","last_became_peered":"2023-07-14T11:13:15.013654+0000","last_unstale":"2023-07-14T11:13:17.153036+0000","last_undegraded":"2023-07-14T11:13:17.153036+0000","last_fullsized":"2023-07-14T11:13:17.153036+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:59:06.061804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.049388+0000","last_change":"2023-07-14T11:13:15.004331+0000","last_active":"2023-07-14T11:13:17.049388+0000","last_peered":"2023-07-14T11:13:17.049388+0000","last_clean":"2023-07-14T11:13:17.049388+0000","last_became_active":"2023-07-14T11:13:15.003862+0000","last_became_peered":"2023-07-14T11:13:15.003862+0000","last_unstale":"2023-07-14T11:13:17.049388+0000","last_undegraded":"2023-07-14T11:13:17.049388+0000","last_fullsized":"2023-07-14T11:13:17.049388+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:17:31.639610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.998297+0000","last_change":"2023-07-14T11:13:15.005637+0000","last_active":"2023-07-14T11:13:15.998297+0000","last_peered":"2023-07-14T11:13:15.998297+0000","last_clean":"2023-07-14T11:13:15.998297+0000","last_became_active":"2023-07-14T11:13:15.005359+0000","last_became_peered":"2023-07-14T11:13:15.005359+0000","last_unstale":"2023-07-14T11:13:15.998297+0000","last_undegraded":"2023-07-14T11:13:15.998297+0000","last_fullsized":"2023-07-14T11:13:15.998297+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:44:32.625537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":864256,"data_stored":681747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.466}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.0289999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.0010000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94199999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27772,"kb_used_data":820,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344068,"statfs":{"total":96636764160,"available":96608325632,"internally_reserved":0,"allocated":839680,"data_stored":680549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98299999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":245760,"data_stored":89689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":262144,"data_stored":91219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":249856,"data_stored":90251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T11:13:25.081 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T11:13:25.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.310+0000 7f93f5fff700 1 Processor -- start 2023-07-14T11:13:25.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.310+0000 7f93f5fff700 1 -- start start 2023-07-14T11:13:25.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.312+0000 7f93f5fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f93f00b1e00 0x7f93f00b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:25.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.312+0000 7f93f5fff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93f00d2ce0 con 0x7f93f00d1220 2023-07-14T11:13:25.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.312+0000 7f93f5fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93f00b3350 con 0x7f93f015c950 2023-07-14T11:13:25.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.312+0000 7f93f5fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93f00b3630 con 0x7f93f00b1e00 2023-07-14T11:13:25.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.312+0000 7f93e7fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f93f00d1220 0x7f93f00afac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:37794/0 (socket says 172.21.15.84:37794) 2023-07-14T11:13:25.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.312+0000 7f93e7fff700 1 -- 172.21.15.84:0/810665464 learned_addr learned my addr 172.21.15.84:0/810665464 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:13:25.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.312+0000 7f93effff700 1 --2- 172.21.15.84:0/810665464 >> v2:172.21.15.179:3300/0 conn(0x7f93f00b1e00 0x7f93f00b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:25.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.312+0000 7f93eeffd700 1 -- 172.21.15.84:0/810665464 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 482904999 0 0) 0x7f93f00d2ce0 con 0x7f93f00d1220 2023-07-14T11:13:25.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.312+0000 7f93eeffd700 1 -- 172.21.15.84:0/810665464 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93dc0035b0 con 0x7f93f00d1220 2023-07-14T11:13:25.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.313+0000 7f93eeffd700 1 -- 172.21.15.84:0/810665464 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 646240142 0 0) 0x7f93f00b3350 con 0x7f93f015c950 2023-07-14T11:13:25.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.313+0000 7f93eeffd700 1 -- 172.21.15.84:0/810665464 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93f00d2ce0 con 0x7f93f015c950 2023-07-14T11:13:25.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.313+0000 7f93eeffd700 1 -- 172.21.15.84:0/810665464 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4206367810 0 0) 0x7f93dc0035b0 con 0x7f93f00d1220 2023-07-14T11:13:25.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.313+0000 7f93eeffd700 1 -- 172.21.15.84:0/810665464 >> v2:172.21.15.179:3300/0 conn(0x7f93f00b1e00 msgr2=0x7f93f00b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:25.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.313+0000 7f93eeffd700 1 --2- 172.21.15.84:0/810665464 >> v2:172.21.15.179:3300/0 conn(0x7f93f00b1e00 0x7f93f00b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:25.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.313+0000 7f93eeffd700 1 -- 172.21.15.84:0/810665464 >> v1:172.21.15.179:6789/0 conn(0x7f93f015c950 legacy=0x7f93f00d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:25.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.313+0000 7f93eeffd700 1 -- 172.21.15.84:0/810665464 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93f00b3910 con 0x7f93f00d1220 2023-07-14T11:13:25.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.313+0000 7f93eeffd700 1 -- 172.21.15.84:0/810665464 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7f93d80015f0 con 0x7f93f00d1220 2023-07-14T11:13:25.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.313+0000 7f93eeffd700 1 -- 172.21.15.84:0/810665464 >> v1:172.21.15.84:6789/0 conn(0x7f93f00d1220 legacy=0x7f93f00afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:25.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.313+0000 7f93eeffd700 1 --2- 172.21.15.84:0/810665464 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93dc003be0 0x7f93dc003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:25.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.313+0000 7f93eeffd700 1 --2- 172.21.15.84:0/810665464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93dc004850 0x7f93dc004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:25.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.313+0000 7f93eeffd700 1 --2- 172.21.15.84:0/810665464 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93dc005250 0x7f93dc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:25.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.313+0000 7f93eeffd700 1 -- 172.21.15.84:0/810665464 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f00b3630 con 0x7f93dc004850 2023-07-14T11:13:25.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.313+0000 7f93eeffd700 1 -- 172.21.15.84:0/810665464 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93dc00c160 con 0x7f93dc005250 2023-07-14T11:13:25.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.313+0000 7f93eeffd700 1 -- 172.21.15.84:0/810665464 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93dc00c320 con 0x7f93dc003be0 2023-07-14T11:13:25.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.313+0000 7f93effff700 1 --2- 172.21.15.84:0/810665464 >> v2:172.21.15.179:3300/0 conn(0x7f93f00b1e00 0x7f93f00b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:13:25.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.313+0000 7f93e7fff700 1 --2- 172.21.15.84:0/810665464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93dc004850 0x7f93dc004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:25.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.313+0000 7f93ef7fe700 1 --2- 172.21.15.84:0/810665464 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93dc003be0 0x7f93dc003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:25.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.313+0000 7f93effff700 1 --2- 172.21.15.84:0/810665464 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93dc005250 0x7f93dc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:25.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.313+0000 7f93e7fff700 1 -- 172.21.15.84:0/810665464 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93dc003be0 msgr2=0x7f93dc003fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:25.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.313+0000 7f93e7fff700 1 --2- 172.21.15.84:0/810665464 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93dc003be0 0x7f93dc003fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:25.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.313+0000 7f93e7fff700 1 -- 172.21.15.84:0/810665464 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93dc005250 msgr2=0x7f93dc00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:25.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.313+0000 7f93e7fff700 1 --2- 172.21.15.84:0/810665464 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93dc005250 0x7f93dc00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:25.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.313+0000 7f93effff700 1 -- 172.21.15.84:0/810665464 reap_dead start 2023-07-14T11:13:25.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.313+0000 7f93e7fff700 1 -- 172.21.15.84:0/810665464 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93dc0035b0 con 0x7f93dc004850 2023-07-14T11:13:25.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.314+0000 7f93e7fff700 1 --2- 172.21.15.84:0/810665464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93dc004850 0x7f93dc004cc0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f93f00d1610 tx=0x7f93dc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5907acb4a9d1d4a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:25.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.314+0000 7f93eeffd700 1 -- 172.21.15.84:0/810665464 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d8007a60 con 0x7f93dc004850 2023-07-14T11:13:25.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.314+0000 7f93eeffd700 1 -- 172.21.15.84:0/810665464 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93d800cbf0 con 0x7f93dc004850 2023-07-14T11:13:25.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.314+0000 7f93eeffd700 1 -- 172.21.15.84:0/810665464 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d8005960 con 0x7f93dc004850 2023-07-14T11:13:25.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.314+0000 7f93f5fff700 1 -- 172.21.15.84:0/810665464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93dc004850 msgr2=0x7f93dc004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:25.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.314+0000 7f93f5fff700 1 --2- 172.21.15.84:0/810665464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93dc004850 0x7f93dc004cc0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f93f00d1610 tx=0x7f93dc005880 comp rx=0 tx=0).stop 2023-07-14T11:13:25.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.314+0000 7f93f5fff700 1 -- 172.21.15.84:0/810665464 shutdown_connections 2023-07-14T11:13:25.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.314+0000 7f93f5fff700 1 --2- 172.21.15.84:0/810665464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93dc004850 0x7f93dc004cc0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:25.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.315+0000 7f93f5fff700 1 -- 172.21.15.84:0/810665464 >> 172.21.15.84:0/810665464 conn(0x7f93f009c1d0 msgr2=0x7f93f00d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:25.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.315+0000 7f93f5fff700 1 -- 172.21.15.84:0/810665464 shutdown_connections 2023-07-14T11:13:25.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.315+0000 7f93f5fff700 1 -- 172.21.15.84:0/810665464 wait complete. 2023-07-14T11:13:25.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.316+0000 7f93f5fff700 1 Processor -- start 2023-07-14T11:13:25.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.316+0000 7f93f5fff700 1 -- start start 2023-07-14T11:13:25.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.317+0000 7f93f5fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93dc004850 0x7f93f0151770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:25.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.317+0000 7f93f5fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93f00b7a50 0x7f93f00b7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:25.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.317+0000 7f93f5fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93f01545c0 0x7f93f0154a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:25.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.317+0000 7f93f5fff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f0151cb0 con 0x7f93f00b7a50 2023-07-14T11:13:25.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.317+0000 7f93f5fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f0154f70 con 0x7f93f01545c0 2023-07-14T11:13:25.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.317+0000 7f93f5fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93f00b84d0 con 0x7f93dc004850 2023-07-14T11:13:25.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.318+0000 7f93e7fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93f00b7a50 0x7f93f00b7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:25.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.318+0000 7f93ef7fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93dc004850 0x7f93f0151770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:25.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.318+0000 7f93e7fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93f00b7a50 0x7f93f00b7ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34358/0 (socket says 172.21.15.84:34358) 2023-07-14T11:13:25.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.318+0000 7f93e7fff700 1 -- 172.21.15.84:0/1158850043 learned_addr learned my addr 172.21.15.84:0/1158850043 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:25.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.318+0000 7f93effff700 1 --2- 172.21.15.84:0/1158850043 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93f01545c0 0x7f93f0154a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:25.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.318+0000 7f93e7fff700 1 -- 172.21.15.84:0/1158850043 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93dc004850 msgr2=0x7f93f0151770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:25.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.318+0000 7f93e7fff700 1 --2- 172.21.15.84:0/1158850043 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93dc004850 0x7f93f0151770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:25.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.318+0000 7f93e7fff700 1 -- 172.21.15.84:0/1158850043 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93f01545c0 msgr2=0x7f93f0154a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:25.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.318+0000 7f93e7fff700 1 --2- 172.21.15.84:0/1158850043 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93f01545c0 0x7f93f0154a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:25.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.318+0000 7f93e7fff700 1 -- 172.21.15.84:0/1158850043 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93f00b87b0 con 0x7f93f00b7a50 2023-07-14T11:13:25.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.318+0000 7f93e7fff700 1 --2- 172.21.15.84:0/1158850043 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93f00b7a50 0x7f93f00b7ec0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f93dc00c130 tx=0x7f93d80018b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:25.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.319+0000 7f93ecff9700 1 -- 172.21.15.84:0/1158850043 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d8001590 con 0x7f93f00b7a50 2023-07-14T11:13:25.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.319+0000 7f93ecff9700 1 -- 172.21.15.84:0/1158850043 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93d80070d0 con 0x7f93f00b7a50 2023-07-14T11:13:25.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.319+0000 7f93f5fff700 1 -- 172.21.15.84:0/1158850043 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93f00b8a90 con 0x7f93f00b7a50 2023-07-14T11:13:25.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.319+0000 7f93ecff9700 1 -- 172.21.15.84:0/1158850043 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d8007480 con 0x7f93f00b7a50 2023-07-14T11:13:25.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.319+0000 7f93f5fff700 1 -- 172.21.15.84:0/1158850043 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93f00b76b0 con 0x7f93f00b7a50 2023-07-14T11:13:25.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.320+0000 7f93f5fff700 1 -- 172.21.15.84:0/1158850043 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93f00b8cd0 con 0x7f93f00b7a50 2023-07-14T11:13:25.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.321+0000 7f93ecff9700 1 -- 172.21.15.84:0/1158850043 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f93d80075e0 con 0x7f93f00b7a50 2023-07-14T11:13:25.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.322+0000 7f93ecff9700 1 --2- 172.21.15.84:0/1158850043 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f93d006ace0 0x7f93d006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:25.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.322+0000 7f93ecff9700 1 -- 172.21.15.84:0/1158850043 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f93d808a7a0 con 0x7f93f00b7a50 2023-07-14T11:13:25.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.322+0000 7f93ef7fe700 1 --2- 172.21.15.84:0/1158850043 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f93d006ace0 0x7f93d006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:25.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.322+0000 7f93ef7fe700 1 --2- 172.21.15.84:0/1158850043 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f93d006ace0 0x7f93d006d190 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f93e00019f0 tx=0x7f93e0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:25.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.326+0000 7f93ecff9700 1 -- 172.21.15.84:0/1158850043 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f93f00b8cd0 con 0x7f93f00b7a50 2023-07-14T11:13:25.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.517+0000 7f93f5fff700 1 -- 172.21.15.84:0/1158850043 --> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f93f00b3ed0 con 0x7f93d006ace0 2023-07-14T11:13:25.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.525+0000 7f93ecff9700 1 -- 172.21.15.84:0/1158850043 <== mgr.4104 v2:172.21.15.84:6832/379617029 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286662 (secure 0 0 0) 0x7f93e0012730 con 0x7f93d006ace0 2023-07-14T11:13:25.531 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:13:25.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.529+0000 7f93f5fff700 1 -- 172.21.15.84:0/1158850043 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f93d006ace0 msgr2=0x7f93d006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:25.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.529+0000 7f93f5fff700 1 --2- 172.21.15.84:0/1158850043 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f93d006ace0 0x7f93d006d190 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f93e00019f0 tx=0x7f93e0009040 comp rx=0 tx=0).stop 2023-07-14T11:13:25.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.529+0000 7f93f5fff700 1 -- 172.21.15.84:0/1158850043 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93f00b7a50 msgr2=0x7f93f00b7ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:25.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.529+0000 7f93f5fff700 1 --2- 172.21.15.84:0/1158850043 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93f00b7a50 0x7f93f00b7ec0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f93dc00c130 tx=0x7f93d80018b0 comp rx=0 tx=0).stop 2023-07-14T11:13:25.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.529+0000 7f93f5fff700 1 -- 172.21.15.84:0/1158850043 shutdown_connections 2023-07-14T11:13:25.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.529+0000 7f93f5fff700 1 --2- 172.21.15.84:0/1158850043 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f93d006ace0 0x7f93d006d190 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:25.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.529+0000 7f93f5fff700 1 --2- 172.21.15.84:0/1158850043 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93dc004850 0x7f93f0151770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:25.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.529+0000 7f93f5fff700 1 --2- 172.21.15.84:0/1158850043 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93f01545c0 0x7f93f0154a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:25.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.529+0000 7f93f5fff700 1 --2- 172.21.15.84:0/1158850043 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93f00b7a50 0x7f93f00b7ec0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:25.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.529+0000 7f93f5fff700 1 -- 172.21.15.84:0/1158850043 >> 172.21.15.84:0/1158850043 conn(0x7f93f009c1d0 msgr2=0x7f93f00b43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:25.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.530+0000 7f93f5fff700 1 -- 172.21.15.84:0/1158850043 shutdown_connections 2023-07-14T11:13:25.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.530+0000 7f93f5fff700 1 -- 172.21.15.84:0/1158850043 wait complete. 2023-07-14T11:13:25.535 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-07-14T11:13:25.551 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2023-07-14T11:13:24.074828+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218728,"kb_used_data":3112,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755992,"statfs":{"total":773094113280,"available":772870135808,"internally_reserved":0,"allocated":3186688,"data_stored":1902252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.093251"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.999827+0000","last_change":"2023-07-14T11:13:15.012043+0000","last_active":"2023-07-14T11:13:15.999827+0000","last_peered":"2023-07-14T11:13:15.999827+0000","last_clean":"2023-07-14T11:13:15.999827+0000","last_became_active":"2023-07-14T11:13:15.011781+0000","last_became_peered":"2023-07-14T11:13:15.011781+0000","last_unstale":"2023-07-14T11:13:15.999827+0000","last_undegraded":"2023-07-14T11:13:15.999827+0000","last_fullsized":"2023-07-14T11:13:15.999827+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:14:42.298292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.999486+0000","last_change":"2023-07-14T11:13:15.000344+0000","last_active":"2023-07-14T11:13:15.999486+0000","last_peered":"2023-07-14T11:13:15.999486+0000","last_clean":"2023-07-14T11:13:15.999486+0000","last_became_active":"2023-07-14T11:13:15.000039+0000","last_became_peered":"2023-07-14T11:13:15.000039+0000","last_unstale":"2023-07-14T11:13:15.999486+0000","last_undegraded":"2023-07-14T11:13:15.999486+0000","last_fullsized":"2023-07-14T11:13:15.999486+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:49:56.489161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.153368+0000","last_change":"2023-07-14T11:13:15.014928+0000","last_active":"2023-07-14T11:13:17.153368+0000","last_peered":"2023-07-14T11:13:17.153368+0000","last_clean":"2023-07-14T11:13:17.153368+0000","last_became_active":"2023-07-14T11:13:15.014663+0000","last_became_peered":"2023-07-14T11:13:15.014663+0000","last_unstale":"2023-07-14T11:13:17.153368+0000","last_undegraded":"2023-07-14T11:13:17.153368+0000","last_fullsized":"2023-07-14T11:13:17.153368+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:35:09.741442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.153229+0000","last_change":"2023-07-14T11:13:15.007462+0000","last_active":"2023-07-14T11:13:17.153229+0000","last_peered":"2023-07-14T11:13:17.153229+0000","last_clean":"2023-07-14T11:13:17.153229+0000","last_became_active":"2023-07-14T11:13:15.007180+0000","last_became_peered":"2023-07-14T11:13:15.007180+0000","last_unstale":"2023-07-14T11:13:17.153229+0000","last_undegraded":"2023-07-14T11:13:17.153229+0000","last_fullsized":"2023-07-14T11:13:17.153229+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:46:55.007943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.033473+0000","last_change":"2023-07-14T11:13:15.013824+0000","last_active":"2023-07-14T11:13:17.033473+0000","last_peered":"2023-07-14T11:13:17.033473+0000","last_clean":"2023-07-14T11:13:17.033473+0000","last_became_active":"2023-07-14T11:13:15.012925+0000","last_became_peered":"2023-07-14T11:13:15.012925+0000","last_unstale":"2023-07-14T11:13:17.033473+0000","last_undegraded":"2023-07-14T11:13:17.033473+0000","last_fullsized":"2023-07-14T11:13:17.033473+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:43:57.131270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.152537+0000","last_change":"2023-07-14T11:13:15.015095+0000","last_active":"2023-07-14T11:13:17.152537+0000","last_peered":"2023-07-14T11:13:17.152537+0000","last_clean":"2023-07-14T11:13:17.152537+0000","last_became_active":"2023-07-14T11:13:15.014838+0000","last_became_peered":"2023-07-14T11:13:15.014838+0000","last_unstale":"2023-07-14T11:13:17.152537+0000","last_undegraded":"2023-07-14T11:13:17.152537+0000","last_fullsized":"2023-07-14T11:13:17.152537+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:24:33.371173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.078380+0000","last_change":"2023-07-14T11:13:15.000923+0000","last_active":"2023-07-14T11:13:17.078380+0000","last_peered":"2023-07-14T11:13:17.078380+0000","last_clean":"2023-07-14T11:13:17.078380+0000","last_became_active":"2023-07-14T11:13:15.000141+0000","last_became_peered":"2023-07-14T11:13:15.000141+0000","last_unstale":"2023-07-14T11:13:17.078380+0000","last_undegraded":"2023-07-14T11:13:17.078380+0000","last_fullsized":"2023-07-14T11:13:17.078380+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:21:23.494380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.999143+0000","last_change":"2023-07-14T11:13:15.007538+0000","last_active":"2023-07-14T11:13:15.999143+0000","last_peered":"2023-07-14T11:13:15.999143+0000","last_clean":"2023-07-14T11:13:15.999143+0000","last_became_active":"2023-07-14T11:13:15.007221+0000","last_became_peered":"2023-07-14T11:13:15.007221+0000","last_unstale":"2023-07-14T11:13:15.999143+0000","last_undegraded":"2023-07-14T11:13:15.999143+0000","last_fullsized":"2023-07-14T11:13:15.999143+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:46:47.847976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.033875+0000","last_change":"2023-07-14T11:13:15.014209+0000","last_active":"2023-07-14T11:13:17.033875+0000","last_peered":"2023-07-14T11:13:17.033875+0000","last_clean":"2023-07-14T11:13:17.033875+0000","last_became_active":"2023-07-14T11:13:15.013525+0000","last_became_peered":"2023-07-14T11:13:15.013525+0000","last_unstale":"2023-07-14T11:13:17.033875+0000","last_undegraded":"2023-07-14T11:13:17.033875+0000","last_fullsized":"2023-07-14T11:13:17.033875+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:19:17.400582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.999679+0000","last_change":"2023-07-14T11:13:15.008305+0000","last_active":"2023-07-14T11:13:15.999679+0000","last_peered":"2023-07-14T11:13:15.999679+0000","last_clean":"2023-07-14T11:13:15.999679+0000","last_became_active":"2023-07-14T11:13:15.008009+0000","last_became_peered":"2023-07-14T11:13:15.008009+0000","last_unstale":"2023-07-14T11:13:15.999679+0000","last_undegraded":"2023-07-14T11:13:15.999679+0000","last_fullsized":"2023-07-14T11:13:15.999679+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:35:58.605091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.153500+0000","last_change":"2023-07-14T11:13:15.019530+0000","last_active":"2023-07-14T11:13:17.153500+0000","last_peered":"2023-07-14T11:13:17.153500+0000","last_clean":"2023-07-14T11:13:17.153500+0000","last_became_active":"2023-07-14T11:13:15.019260+0000","last_became_peered":"2023-07-14T11:13:15.019260+0000","last_unstale":"2023-07-14T11:13:17.153500+0000","last_undegraded":"2023-07-14T11:13:17.153500+0000","last_fullsized":"2023-07-14T11:13:17.153500+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:21:23.494380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.999400+0000","last_change":"2023-07-14T11:13:15.017282+0000","last_active":"2023-07-14T11:13:15.999400+0000","last_peered":"2023-07-14T11:13:15.999400+0000","last_clean":"2023-07-14T11:13:15.999400+0000","last_became_active":"2023-07-14T11:13:15.016949+0000","last_became_peered":"2023-07-14T11:13:15.016949+0000","last_unstale":"2023-07-14T11:13:15.999400+0000","last_undegraded":"2023-07-14T11:13:15.999400+0000","last_fullsized":"2023-07-14T11:13:15.999400+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:13:04.773850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.999008+0000","last_change":"2023-07-14T11:13:15.007583+0000","last_active":"2023-07-14T11:13:15.999008+0000","last_peered":"2023-07-14T11:13:15.999008+0000","last_clean":"2023-07-14T11:13:15.999008+0000","last_became_active":"2023-07-14T11:13:15.007308+0000","last_became_peered":"2023-07-14T11:13:15.007308+0000","last_unstale":"2023-07-14T11:13:15.999008+0000","last_undegraded":"2023-07-14T11:13:15.999008+0000","last_fullsized":"2023-07-14T11:13:15.999008+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:11:14.713367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.999086+0000","last_change":"2023-07-14T11:13:15.001617+0000","last_active":"2023-07-14T11:13:15.999086+0000","last_peered":"2023-07-14T11:13:15.999086+0000","last_clean":"2023-07-14T11:13:15.999086+0000","last_became_active":"2023-07-14T11:13:15.001328+0000","last_became_peered":"2023-07-14T11:13:15.001328+0000","last_unstale":"2023-07-14T11:13:15.999086+0000","last_undegraded":"2023-07-14T11:13:15.999086+0000","last_fullsized":"2023-07-14T11:13:15.999086+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:16:01.290597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.078731+0000","last_change":"2023-07-14T11:13:15.000610+0000","last_active":"2023-07-14T11:13:17.078731+0000","last_peered":"2023-07-14T11:13:17.078731+0000","last_clean":"2023-07-14T11:13:17.078731+0000","last_became_active":"2023-07-14T11:13:14.999771+0000","last_became_peered":"2023-07-14T11:13:14.999771+0000","last_unstale":"2023-07-14T11:13:17.078731+0000","last_undegraded":"2023-07-14T11:13:17.078731+0000","last_fullsized":"2023-07-14T11:13:17.078731+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:59:11.011459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.152501+0000","last_change":"2023-07-14T11:13:15.012608+0000","last_active":"2023-07-14T11:13:17.152501+0000","last_peered":"2023-07-14T11:13:17.152501+0000","last_clean":"2023-07-14T11:13:17.152501+0000","last_became_active":"2023-07-14T11:13:15.008876+0000","last_became_peered":"2023-07-14T11:13:15.008876+0000","last_unstale":"2023-07-14T11:13:17.152501+0000","last_undegraded":"2023-07-14T11:13:17.152501+0000","last_fullsized":"2023-07-14T11:13:17.152501+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:43:57.131270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.034050+0000","last_change":"2023-07-14T11:13:15.013846+0000","last_active":"2023-07-14T11:13:17.034050+0000","last_peered":"2023-07-14T11:13:17.034050+0000","last_clean":"2023-07-14T11:13:17.034050+0000","last_became_active":"2023-07-14T11:13:15.013207+0000","last_became_peered":"2023-07-14T11:13:15.013207+0000","last_unstale":"2023-07-14T11:13:17.034050+0000","last_undegraded":"2023-07-14T11:13:17.034050+0000","last_fullsized":"2023-07-14T11:13:17.034050+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:31:23.154081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.153367+0000","last_change":"2023-07-14T11:13:15.016833+0000","last_active":"2023-07-14T11:13:17.153367+0000","last_peered":"2023-07-14T11:13:17.153367+0000","last_clean":"2023-07-14T11:13:17.153367+0000","last_became_active":"2023-07-14T11:13:15.016507+0000","last_became_peered":"2023-07-14T11:13:15.016507+0000","last_unstale":"2023-07-14T11:13:17.153367+0000","last_undegraded":"2023-07-14T11:13:17.153367+0000","last_fullsized":"2023-07-14T11:13:17.153367+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:13:19.248345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.998956+0000","last_change":"2023-07-14T11:13:14.994609+0000","last_active":"2023-07-14T11:13:15.998956+0000","last_peered":"2023-07-14T11:13:15.998956+0000","last_clean":"2023-07-14T11:13:15.998956+0000","last_became_active":"2023-07-14T11:13:14.994280+0000","last_became_peered":"2023-07-14T11:13:14.994280+0000","last_unstale":"2023-07-14T11:13:15.998956+0000","last_undegraded":"2023-07-14T11:13:15.998956+0000","last_fullsized":"2023-07-14T11:13:15.998956+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:03:17.140553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.152720+0000","last_change":"2023-07-14T11:13:15.013542+0000","last_active":"2023-07-14T11:13:17.152720+0000","last_peered":"2023-07-14T11:13:17.152720+0000","last_clean":"2023-07-14T11:13:17.152720+0000","last_became_active":"2023-07-14T11:13:15.013278+0000","last_became_peered":"2023-07-14T11:13:15.013278+0000","last_unstale":"2023-07-14T11:13:17.152720+0000","last_undegraded":"2023-07-14T11:13:17.152720+0000","last_fullsized":"2023-07-14T11:13:17.152720+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:16:01.290597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.078631+0000","last_change":"2023-07-14T11:13:15.022035+0000","last_active":"2023-07-14T11:13:17.078631+0000","last_peered":"2023-07-14T11:13:17.078631+0000","last_clean":"2023-07-14T11:13:17.078631+0000","last_became_active":"2023-07-14T11:13:15.021666+0000","last_became_peered":"2023-07-14T11:13:15.021666+0000","last_unstale":"2023-07-14T11:13:17.078631+0000","last_undegraded":"2023-07-14T11:13:17.078631+0000","last_fullsized":"2023-07-14T11:13:17.078631+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:22:45.686858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.033457+0000","last_change":"2023-07-14T11:13:15.013591+0000","last_active":"2023-07-14T11:13:17.033457+0000","last_peered":"2023-07-14T11:13:17.033457+0000","last_clean":"2023-07-14T11:13:17.033457+0000","last_became_active":"2023-07-14T11:13:15.013300+0000","last_became_peered":"2023-07-14T11:13:15.013300+0000","last_unstale":"2023-07-14T11:13:17.033457+0000","last_undegraded":"2023-07-14T11:13:17.033457+0000","last_fullsized":"2023-07-14T11:13:17.033457+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:25:49.179942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.049049+0000","last_change":"2023-07-14T11:13:15.008804+0000","last_active":"2023-07-14T11:13:17.049049+0000","last_peered":"2023-07-14T11:13:17.049049+0000","last_clean":"2023-07-14T11:13:17.049049+0000","last_became_active":"2023-07-14T11:13:15.007948+0000","last_became_peered":"2023-07-14T11:13:15.007948+0000","last_unstale":"2023-07-14T11:13:17.049049+0000","last_undegraded":"2023-07-14T11:13:17.049049+0000","last_fullsized":"2023-07-14T11:13:17.049049+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:25:27.958037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.078749+0000","last_change":"2023-07-14T11:13:15.006574+0000","last_active":"2023-07-14T11:13:17.078749+0000","last_peered":"2023-07-14T11:13:17.078749+0000","last_clean":"2023-07-14T11:13:17.078749+0000","last_became_active":"2023-07-14T11:13:15.006129+0000","last_became_peered":"2023-07-14T11:13:15.006129+0000","last_unstale":"2023-07-14T11:13:17.078749+0000","last_undegraded":"2023-07-14T11:13:17.078749+0000","last_fullsized":"2023-07-14T11:13:17.078749+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:20:46.443943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.999626+0000","last_change":"2023-07-14T11:13:14.995683+0000","last_active":"2023-07-14T11:13:15.999626+0000","last_peered":"2023-07-14T11:13:15.999626+0000","last_clean":"2023-07-14T11:13:15.999626+0000","last_became_active":"2023-07-14T11:13:14.995379+0000","last_became_peered":"2023-07-14T11:13:14.995379+0000","last_unstale":"2023-07-14T11:13:15.999626+0000","last_undegraded":"2023-07-14T11:13:15.999626+0000","last_fullsized":"2023-07-14T11:13:15.999626+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:46:47.847976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.999694+0000","last_change":"2023-07-14T11:13:15.001711+0000","last_active":"2023-07-14T11:13:15.999694+0000","last_peered":"2023-07-14T11:13:15.999694+0000","last_clean":"2023-07-14T11:13:15.999694+0000","last_became_active":"2023-07-14T11:13:15.000809+0000","last_became_peered":"2023-07-14T11:13:15.000809+0000","last_unstale":"2023-07-14T11:13:15.999694+0000","last_undegraded":"2023-07-14T11:13:15.999694+0000","last_fullsized":"2023-07-14T11:13:15.999694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:19:17.400582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.999194+0000","last_change":"2023-07-14T11:13:15.001781+0000","last_active":"2023-07-14T11:13:15.999194+0000","last_peered":"2023-07-14T11:13:15.999194+0000","last_clean":"2023-07-14T11:13:15.999194+0000","last_became_active":"2023-07-14T11:13:15.001509+0000","last_became_peered":"2023-07-14T11:13:15.001509+0000","last_unstale":"2023-07-14T11:13:15.999194+0000","last_undegraded":"2023-07-14T11:13:15.999194+0000","last_fullsized":"2023-07-14T11:13:15.999194+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:19:17.400582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.152738+0000","last_change":"2023-07-14T11:13:13.986413+0000","last_active":"2023-07-14T11:13:17.152738+0000","last_peered":"2023-07-14T11:13:17.152738+0000","last_clean":"2023-07-14T11:13:17.152738+0000","last_became_active":"2023-07-14T11:13:13.986200+0000","last_became_peered":"2023-07-14T11:13:13.986200+0000","last_unstale":"2023-07-14T11:13:17.152738+0000","last_undegraded":"2023-07-14T11:13:17.152738+0000","last_fullsized":"2023-07-14T11:13:17.152738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:46:46.842842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.049124+0000","last_change":"2023-07-14T11:13:15.013058+0000","last_active":"2023-07-14T11:13:17.049124+0000","last_peered":"2023-07-14T11:13:17.049124+0000","last_clean":"2023-07-14T11:13:17.049124+0000","last_became_active":"2023-07-14T11:13:15.012721+0000","last_became_peered":"2023-07-14T11:13:15.012721+0000","last_unstale":"2023-07-14T11:13:17.049124+0000","last_undegraded":"2023-07-14T11:13:17.049124+0000","last_fullsized":"2023-07-14T11:13:17.049124+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:46:47.847976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.998128+0000","last_change":"2023-07-14T11:13:13.982240+0000","last_active":"2023-07-14T11:13:15.998128+0000","last_peered":"2023-07-14T11:13:15.998128+0000","last_clean":"2023-07-14T11:13:15.998128+0000","last_became_active":"2023-07-14T11:13:13.981974+0000","last_became_peered":"2023-07-14T11:13:13.981974+0000","last_unstale":"2023-07-14T11:13:15.998128+0000","last_undegraded":"2023-07-14T11:13:15.998128+0000","last_fullsized":"2023-07-14T11:13:15.998128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:48:45.385596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.033906+0000","last_change":"2023-07-14T11:13:15.024726+0000","last_active":"2023-07-14T11:13:17.033906+0000","last_peered":"2023-07-14T11:13:17.033906+0000","last_clean":"2023-07-14T11:13:17.033906+0000","last_became_active":"2023-07-14T11:13:15.024453+0000","last_became_peered":"2023-07-14T11:13:15.024453+0000","last_unstale":"2023-07-14T11:13:17.033906+0000","last_undegraded":"2023-07-14T11:13:17.033906+0000","last_fullsized":"2023-07-14T11:13:17.033906+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:02:08.522821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.048863+0000","last_change":"2023-07-14T11:13:13.979433+0000","last_active":"2023-07-14T11:13:17.048863+0000","last_peered":"2023-07-14T11:13:17.048863+0000","last_clean":"2023-07-14T11:13:17.048863+0000","last_became_active":"2023-07-14T11:13:13.979120+0000","last_became_peered":"2023-07-14T11:13:13.979120+0000","last_unstale":"2023-07-14T11:13:17.048863+0000","last_undegraded":"2023-07-14T11:13:17.048863+0000","last_fullsized":"2023-07-14T11:13:17.048863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:44:31.620403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.153793+0000","last_change":"2023-07-14T11:13:14.998412+0000","last_active":"2023-07-14T11:13:17.153793+0000","last_peered":"2023-07-14T11:13:17.153793+0000","last_clean":"2023-07-14T11:13:17.153793+0000","last_became_active":"2023-07-14T11:13:14.998117+0000","last_became_peered":"2023-07-14T11:13:14.998117+0000","last_unstale":"2023-07-14T11:13:17.153793+0000","last_undegraded":"2023-07-14T11:13:17.153793+0000","last_fullsized":"2023-07-14T11:13:17.153793+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:00:15.112821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.034072+0000","last_change":"2023-07-14T11:13:13.990938+0000","last_active":"2023-07-14T11:13:17.034072+0000","last_peered":"2023-07-14T11:13:17.034072+0000","last_clean":"2023-07-14T11:13:17.034072+0000","last_became_active":"2023-07-14T11:13:13.990590+0000","last_became_peered":"2023-07-14T11:13:13.990590+0000","last_unstale":"2023-07-14T11:13:17.034072+0000","last_undegraded":"2023-07-14T11:13:17.034072+0000","last_fullsized":"2023-07-14T11:13:17.034072+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:49:55.484027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.048946+0000","last_change":"2023-07-14T11:13:15.012816+0000","last_active":"2023-07-14T11:13:17.048946+0000","last_peered":"2023-07-14T11:13:17.048946+0000","last_clean":"2023-07-14T11:13:17.048946+0000","last_became_active":"2023-07-14T11:13:15.012565+0000","last_became_peered":"2023-07-14T11:13:15.012565+0000","last_unstale":"2023-07-14T11:13:17.048946+0000","last_undegraded":"2023-07-14T11:13:17.048946+0000","last_fullsized":"2023-07-14T11:13:17.048946+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:24:33.371173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.999538+0000","last_change":"2023-07-14T11:13:13.979704+0000","last_active":"2023-07-14T11:13:15.999538+0000","last_peered":"2023-07-14T11:13:15.999538+0000","last_clean":"2023-07-14T11:13:15.999538+0000","last_became_active":"2023-07-14T11:13:13.978362+0000","last_became_peered":"2023-07-14T11:13:13.978362+0000","last_unstale":"2023-07-14T11:13:15.999538+0000","last_undegraded":"2023-07-14T11:13:15.999538+0000","last_fullsized":"2023-07-14T11:13:15.999538+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:04:24.868340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.048894+0000","last_change":"2023-07-14T11:13:15.009208+0000","last_active":"2023-07-14T11:13:17.048894+0000","last_peered":"2023-07-14T11:13:17.048894+0000","last_clean":"2023-07-14T11:13:17.048894+0000","last_became_active":"2023-07-14T11:13:15.008572+0000","last_became_peered":"2023-07-14T11:13:15.008572+0000","last_unstale":"2023-07-14T11:13:17.048894+0000","last_undegraded":"2023-07-14T11:13:17.048894+0000","last_fullsized":"2023-07-14T11:13:17.048894+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:43:57.131270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.078743+0000","last_change":"2023-07-14T11:13:13.984123+0000","last_active":"2023-07-14T11:13:17.078743+0000","last_peered":"2023-07-14T11:13:17.078743+0000","last_clean":"2023-07-14T11:13:17.078743+0000","last_became_active":"2023-07-14T11:13:13.983850+0000","last_became_peered":"2023-07-14T11:13:13.983850+0000","last_unstale":"2023-07-14T11:13:17.078743+0000","last_undegraded":"2023-07-14T11:13:17.078743+0000","last_fullsized":"2023-07-14T11:13:17.078743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:11:25.673538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.998331+0000","last_change":"2023-07-14T11:13:14.996379+0000","last_active":"2023-07-14T11:13:15.998331+0000","last_peered":"2023-07-14T11:13:15.998331+0000","last_clean":"2023-07-14T11:13:15.998331+0000","last_became_active":"2023-07-14T11:13:14.996054+0000","last_became_peered":"2023-07-14T11:13:14.996054+0000","last_unstale":"2023-07-14T11:13:15.998331+0000","last_undegraded":"2023-07-14T11:13:15.998331+0000","last_fullsized":"2023-07-14T11:13:15.998331+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:25:49.179942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"22'6","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.152871+0000","last_change":"2023-07-14T11:13:13.985526+0000","last_active":"2023-07-14T11:13:17.152871+0000","last_peered":"2023-07-14T11:13:17.152871+0000","last_clean":"2023-07-14T11:13:17.152871+0000","last_became_active":"2023-07-14T11:13:13.985067+0000","last_became_peered":"2023-07-14T11:13:13.985067+0000","last_unstale":"2023-07-14T11:13:17.152871+0000","last_undegraded":"2023-07-14T11:13:17.152871+0000","last_fullsized":"2023-07-14T11:13:17.152871+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:02:07.517687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.152843+0000","last_change":"2023-07-14T11:13:15.016170+0000","last_active":"2023-07-14T11:13:17.152843+0000","last_peered":"2023-07-14T11:13:17.152843+0000","last_clean":"2023-07-14T11:13:17.152843+0000","last_became_active":"2023-07-14T11:13:15.015912+0000","last_became_peered":"2023-07-14T11:13:15.015912+0000","last_unstale":"2023-07-14T11:13:17.152843+0000","last_undegraded":"2023-07-14T11:13:17.152843+0000","last_fullsized":"2023-07-14T11:13:17.152843+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:04:25.873474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.078520+0000","last_change":"2023-07-14T11:13:13.992370+0000","last_active":"2023-07-14T11:13:17.078520+0000","last_peered":"2023-07-14T11:13:17.078520+0000","last_clean":"2023-07-14T11:13:17.078520+0000","last_became_active":"2023-07-14T11:13:13.992063+0000","last_became_peered":"2023-07-14T11:13:13.992063+0000","last_unstale":"2023-07-14T11:13:17.078520+0000","last_undegraded":"2023-07-14T11:13:17.078520+0000","last_fullsized":"2023-07-14T11:13:17.078520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:13:18.243212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.049117+0000","last_change":"2023-07-14T11:13:15.010039+0000","last_active":"2023-07-14T11:13:17.049117+0000","last_peered":"2023-07-14T11:13:17.049117+0000","last_clean":"2023-07-14T11:13:17.049117+0000","last_became_active":"2023-07-14T11:13:15.009733+0000","last_became_peered":"2023-07-14T11:13:15.009733+0000","last_unstale":"2023-07-14T11:13:17.049117+0000","last_undegraded":"2023-07-14T11:13:17.049117+0000","last_fullsized":"2023-07-14T11:13:17.049117+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:16:01.290597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.033307+0000","last_change":"2023-07-14T11:13:13.977355+0000","last_active":"2023-07-14T11:13:17.033307+0000","last_peered":"2023-07-14T11:13:17.033307+0000","last_clean":"2023-07-14T11:13:17.033307+0000","last_became_active":"2023-07-14T11:13:13.977018+0000","last_became_peered":"2023-07-14T11:13:13.977018+0000","last_unstale":"2023-07-14T11:13:17.033307+0000","last_undegraded":"2023-07-14T11:13:17.033307+0000","last_fullsized":"2023-07-14T11:13:17.033307+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:44:31.620403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.999436+0000","last_change":"2023-07-14T11:13:15.000625+0000","last_active":"2023-07-14T11:13:15.999436+0000","last_peered":"2023-07-14T11:13:15.999436+0000","last_clean":"2023-07-14T11:13:15.999436+0000","last_became_active":"2023-07-14T11:13:15.000327+0000","last_became_peered":"2023-07-14T11:13:15.000327+0000","last_unstale":"2023-07-14T11:13:15.999436+0000","last_undegraded":"2023-07-14T11:13:15.999436+0000","last_fullsized":"2023-07-14T11:13:15.999436+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:31:23.154081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.078502+0000","last_change":"2023-07-14T11:13:13.991381+0000","last_active":"2023-07-14T11:13:17.078502+0000","last_peered":"2023-07-14T11:13:17.078502+0000","last_clean":"2023-07-14T11:13:17.078502+0000","last_became_active":"2023-07-14T11:13:13.991045+0000","last_became_peered":"2023-07-14T11:13:13.991045+0000","last_unstale":"2023-07-14T11:13:17.078502+0000","last_undegraded":"2023-07-14T11:13:17.078502+0000","last_fullsized":"2023-07-14T11:13:17.078502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:35:57.599958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.033823+0000","last_change":"2023-07-14T11:13:15.014077+0000","last_active":"2023-07-14T11:13:17.033823+0000","last_peered":"2023-07-14T11:13:17.033823+0000","last_clean":"2023-07-14T11:13:17.033823+0000","last_became_active":"2023-07-14T11:13:15.013318+0000","last_became_peered":"2023-07-14T11:13:15.013318+0000","last_unstale":"2023-07-14T11:13:17.033823+0000","last_undegraded":"2023-07-14T11:13:17.033823+0000","last_fullsized":"2023-07-14T11:13:17.033823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:46:47.847976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.152378+0000","last_change":"2023-07-14T11:13:13.991024+0000","last_active":"2023-07-14T11:13:17.152378+0000","last_peered":"2023-07-14T11:13:17.152378+0000","last_clean":"2023-07-14T11:13:17.152378+0000","last_became_active":"2023-07-14T11:13:13.990641+0000","last_became_peered":"2023-07-14T11:13:13.990641+0000","last_unstale":"2023-07-14T11:13:17.152378+0000","last_undegraded":"2023-07-14T11:13:17.152378+0000","last_fullsized":"2023-07-14T11:13:17.152378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:11:13.708234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.049449+0000","last_change":"2023-07-14T11:13:15.004063+0000","last_active":"2023-07-14T11:13:17.049449+0000","last_peered":"2023-07-14T11:13:17.049449+0000","last_clean":"2023-07-14T11:13:17.049449+0000","last_became_active":"2023-07-14T11:13:15.003754+0000","last_became_peered":"2023-07-14T11:13:15.003754+0000","last_unstale":"2023-07-14T11:13:17.049449+0000","last_undegraded":"2023-07-14T11:13:17.049449+0000","last_fullsized":"2023-07-14T11:13:17.049449+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:49:56.489161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.079017+0000","last_change":"2023-07-14T11:13:13.991618+0000","last_active":"2023-07-14T11:13:17.079017+0000","last_peered":"2023-07-14T11:13:17.079017+0000","last_clean":"2023-07-14T11:13:17.079017+0000","last_became_active":"2023-07-14T11:13:13.991310+0000","last_became_peered":"2023-07-14T11:13:13.991310+0000","last_unstale":"2023-07-14T11:13:17.079017+0000","last_undegraded":"2023-07-14T11:13:17.079017+0000","last_fullsized":"2023-07-14T11:13:17.079017+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:30:47.895193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.999010+0000","last_change":"2023-07-14T11:13:15.000022+0000","last_active":"2023-07-14T11:13:15.999010+0000","last_peered":"2023-07-14T11:13:15.999010+0000","last_clean":"2023-07-14T11:13:15.999010+0000","last_became_active":"2023-07-14T11:13:14.999632+0000","last_became_peered":"2023-07-14T11:13:14.999632+0000","last_unstale":"2023-07-14T11:13:15.999010+0000","last_undegraded":"2023-07-14T11:13:15.999010+0000","last_fullsized":"2023-07-14T11:13:15.999010+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:24:33.371173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.078866+0000","last_change":"2023-07-14T11:13:13.991415+0000","last_active":"2023-07-14T11:13:17.078866+0000","last_peered":"2023-07-14T11:13:17.078866+0000","last_clean":"2023-07-14T11:13:17.078866+0000","last_became_active":"2023-07-14T11:13:13.991182+0000","last_became_peered":"2023-07-14T11:13:13.991182+0000","last_unstale":"2023-07-14T11:13:17.078866+0000","last_undegraded":"2023-07-14T11:13:17.078866+0000","last_fullsized":"2023-07-14T11:13:17.078866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:59:00.823913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.152670+0000","last_change":"2023-07-14T11:13:15.022123+0000","last_active":"2023-07-14T11:13:17.152670+0000","last_peered":"2023-07-14T11:13:17.152670+0000","last_clean":"2023-07-14T11:13:17.152670+0000","last_became_active":"2023-07-14T11:13:15.016892+0000","last_became_peered":"2023-07-14T11:13:15.016892+0000","last_unstale":"2023-07-14T11:13:17.152670+0000","last_undegraded":"2023-07-14T11:13:17.152670+0000","last_fullsized":"2023-07-14T11:13:17.152670+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:25:27.958037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.078935+0000","last_change":"2023-07-14T11:13:13.989926+0000","last_active":"2023-07-14T11:13:17.078935+0000","last_peered":"2023-07-14T11:13:17.078935+0000","last_clean":"2023-07-14T11:13:17.078935+0000","last_became_active":"2023-07-14T11:13:13.989600+0000","last_became_peered":"2023-07-14T11:13:13.989600+0000","last_unstale":"2023-07-14T11:13:17.078935+0000","last_undegraded":"2023-07-14T11:13:17.078935+0000","last_fullsized":"2023-07-14T11:13:17.078935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:22:13.780840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.153225+0000","last_change":"2023-07-14T11:13:15.004391+0000","last_active":"2023-07-14T11:13:17.153225+0000","last_peered":"2023-07-14T11:13:17.153225+0000","last_clean":"2023-07-14T11:13:17.153225+0000","last_became_active":"2023-07-14T11:13:14.999504+0000","last_became_peered":"2023-07-14T11:13:14.999504+0000","last_unstale":"2023-07-14T11:13:17.153225+0000","last_undegraded":"2023-07-14T11:13:17.153225+0000","last_fullsized":"2023-07-14T11:13:17.153225+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:14:42.298292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.999372+0000","last_change":"2023-07-14T11:13:13.979533+0000","last_active":"2023-07-14T11:13:15.999372+0000","last_peered":"2023-07-14T11:13:15.999372+0000","last_clean":"2023-07-14T11:13:15.999372+0000","last_became_active":"2023-07-14T11:13:13.979160+0000","last_became_peered":"2023-07-14T11:13:13.979160+0000","last_unstale":"2023-07-14T11:13:15.999372+0000","last_undegraded":"2023-07-14T11:13:15.999372+0000","last_fullsized":"2023-07-14T11:13:15.999372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:17:30.634477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.033756+0000","last_change":"2023-07-14T11:13:15.016320+0000","last_active":"2023-07-14T11:13:17.033756+0000","last_peered":"2023-07-14T11:13:17.033756+0000","last_clean":"2023-07-14T11:13:17.033756+0000","last_became_active":"2023-07-14T11:13:15.016023+0000","last_became_peered":"2023-07-14T11:13:15.016023+0000","last_unstale":"2023-07-14T11:13:17.033756+0000","last_undegraded":"2023-07-14T11:13:17.033756+0000","last_fullsized":"2023-07-14T11:13:17.033756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:16:01.290597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.049338+0000","last_change":"2023-07-14T11:13:13.987628+0000","last_active":"2023-07-14T11:13:17.049338+0000","last_peered":"2023-07-14T11:13:17.049338+0000","last_clean":"2023-07-14T11:13:17.049338+0000","last_became_active":"2023-07-14T11:13:13.987361+0000","last_became_peered":"2023-07-14T11:13:13.987361+0000","last_unstale":"2023-07-14T11:13:17.049338+0000","last_undegraded":"2023-07-14T11:13:17.049338+0000","last_fullsized":"2023-07-14T11:13:17.049338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:02:07.517687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.152811+0000","last_change":"2023-07-14T11:13:15.021655+0000","last_active":"2023-07-14T11:13:17.152811+0000","last_peered":"2023-07-14T11:13:17.152811+0000","last_clean":"2023-07-14T11:13:17.152811+0000","last_became_active":"2023-07-14T11:13:15.018683+0000","last_became_peered":"2023-07-14T11:13:15.018683+0000","last_unstale":"2023-07-14T11:13:17.152811+0000","last_undegraded":"2023-07-14T11:13:17.152811+0000","last_fullsized":"2023-07-14T11:13:17.152811+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:17:31.639610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.153156+0000","last_change":"2023-07-14T11:13:13.992123+0000","last_active":"2023-07-14T11:13:17.153156+0000","last_peered":"2023-07-14T11:13:17.153156+0000","last_clean":"2023-07-14T11:13:17.153156+0000","last_became_active":"2023-07-14T11:13:13.991832+0000","last_became_peered":"2023-07-14T11:13:13.991832+0000","last_unstale":"2023-07-14T11:13:17.153156+0000","last_undegraded":"2023-07-14T11:13:17.153156+0000","last_fullsized":"2023-07-14T11:13:17.153156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:13:03.768716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.153630+0000","last_change":"2023-07-14T11:13:15.019054+0000","last_active":"2023-07-14T11:13:17.153630+0000","last_peered":"2023-07-14T11:13:17.153630+0000","last_clean":"2023-07-14T11:13:17.153630+0000","last_became_active":"2023-07-14T11:13:15.018737+0000","last_became_peered":"2023-07-14T11:13:15.018737+0000","last_unstale":"2023-07-14T11:13:17.153630+0000","last_undegraded":"2023-07-14T11:13:17.153630+0000","last_fullsized":"2023-07-14T11:13:17.153630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:59:11.011459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.152859+0000","last_change":"2023-07-14T11:13:13.986400+0000","last_active":"2023-07-14T11:13:17.152859+0000","last_peered":"2023-07-14T11:13:17.152859+0000","last_clean":"2023-07-14T11:13:17.152859+0000","last_became_active":"2023-07-14T11:13:13.986081+0000","last_became_peered":"2023-07-14T11:13:13.986081+0000","last_unstale":"2023-07-14T11:13:17.152859+0000","last_undegraded":"2023-07-14T11:13:17.152859+0000","last_fullsized":"2023-07-14T11:13:17.152859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:15:26.472331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.153489+0000","last_change":"2023-07-14T11:13:15.011241+0000","last_active":"2023-07-14T11:13:17.153489+0000","last_peered":"2023-07-14T11:13:17.153489+0000","last_clean":"2023-07-14T11:13:17.153489+0000","last_became_active":"2023-07-14T11:13:15.010955+0000","last_became_peered":"2023-07-14T11:13:15.010955+0000","last_unstale":"2023-07-14T11:13:17.153489+0000","last_undegraded":"2023-07-14T11:13:17.153489+0000","last_fullsized":"2023-07-14T11:13:17.153489+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:22:45.686858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.048695+0000","last_change":"2023-07-14T11:13:13.982073+0000","last_active":"2023-07-14T11:13:17.048695+0000","last_peered":"2023-07-14T11:13:17.048695+0000","last_clean":"2023-07-14T11:13:17.048695+0000","last_became_active":"2023-07-14T11:13:13.981729+0000","last_became_peered":"2023-07-14T11:13:13.981729+0000","last_unstale":"2023-07-14T11:13:17.048695+0000","last_undegraded":"2023-07-14T11:13:17.048695+0000","last_fullsized":"2023-07-14T11:13:17.048695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:00:14.107687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.999908+0000","last_change":"2023-07-14T11:13:15.008740+0000","last_active":"2023-07-14T11:13:15.999908+0000","last_peered":"2023-07-14T11:13:15.999908+0000","last_clean":"2023-07-14T11:13:15.999908+0000","last_became_active":"2023-07-14T11:13:15.008487+0000","last_became_peered":"2023-07-14T11:13:15.008487+0000","last_unstale":"2023-07-14T11:13:15.999908+0000","last_undegraded":"2023-07-14T11:13:15.999908+0000","last_fullsized":"2023-07-14T11:13:15.999908+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:15:27.477464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.998417+0000","last_change":"2023-07-14T11:13:08.923786+0000","last_active":"2023-07-14T11:13:15.998417+0000","last_peered":"2023-07-14T11:13:15.998417+0000","last_clean":"2023-07-14T11:13:15.998417+0000","last_became_active":"2023-07-14T11:13:08.923384+0000","last_became_peered":"2023-07-14T11:13:08.923384+0000","last_unstale":"2023-07-14T11:13:15.998417+0000","last_undegraded":"2023-07-14T11:13:15.998417+0000","last_fullsized":"2023-07-14T11:13:15.998417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:43:50.917736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.999590+0000","last_change":"2023-07-14T11:13:13.979901+0000","last_active":"2023-07-14T11:13:15.999590+0000","last_peered":"2023-07-14T11:13:15.999590+0000","last_clean":"2023-07-14T11:13:15.999590+0000","last_became_active":"2023-07-14T11:13:13.979617+0000","last_became_peered":"2023-07-14T11:13:13.979617+0000","last_unstale":"2023-07-14T11:13:15.999590+0000","last_undegraded":"2023-07-14T11:13:15.999590+0000","last_fullsized":"2023-07-14T11:13:15.999590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:59:05.056670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.998532+0000","last_change":"2023-07-14T11:13:14.999336+0000","last_active":"2023-07-14T11:13:15.998532+0000","last_peered":"2023-07-14T11:13:15.998532+0000","last_clean":"2023-07-14T11:13:15.998532+0000","last_became_active":"2023-07-14T11:13:14.999023+0000","last_became_peered":"2023-07-14T11:13:14.999023+0000","last_unstale":"2023-07-14T11:13:15.998532+0000","last_undegraded":"2023-07-14T11:13:15.998532+0000","last_fullsized":"2023-07-14T11:13:15.998532+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:24:33.371173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.999056+0000","last_change":"2023-07-14T11:13:08.758749+0000","last_active":"2023-07-14T11:13:15.999056+0000","last_peered":"2023-07-14T11:13:15.999056+0000","last_clean":"2023-07-14T11:13:15.999056+0000","last_became_active":"2023-07-14T11:13:08.757956+0000","last_became_peered":"2023-07-14T11:13:08.757956+0000","last_unstale":"2023-07-14T11:13:15.999056+0000","last_undegraded":"2023-07-14T11:13:15.999056+0000","last_fullsized":"2023-07-14T11:13:15.999056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:25:21.744503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.152941+0000","last_change":"2023-07-14T11:13:13.987810+0000","last_active":"2023-07-14T11:13:17.152941+0000","last_peered":"2023-07-14T11:13:17.152941+0000","last_clean":"2023-07-14T11:13:17.152941+0000","last_became_active":"2023-07-14T11:13:13.987575+0000","last_became_peered":"2023-07-14T11:13:13.987575+0000","last_unstale":"2023-07-14T11:13:17.152941+0000","last_undegraded":"2023-07-14T11:13:17.152941+0000","last_fullsized":"2023-07-14T11:13:17.152941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:31:22.148947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.998552+0000","last_change":"2023-07-14T11:13:15.000483+0000","last_active":"2023-07-14T11:13:15.998552+0000","last_peered":"2023-07-14T11:13:15.998552+0000","last_clean":"2023-07-14T11:13:15.998552+0000","last_became_active":"2023-07-14T11:13:15.000027+0000","last_became_peered":"2023-07-14T11:13:15.000027+0000","last_unstale":"2023-07-14T11:13:15.998552+0000","last_undegraded":"2023-07-14T11:13:15.998552+0000","last_fullsized":"2023-07-14T11:13:15.998552+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:25:27.958037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.998899+0000","last_change":"2023-07-14T11:13:08.862331+0000","last_active":"2023-07-14T11:13:15.998899+0000","last_peered":"2023-07-14T11:13:15.998899+0000","last_clean":"2023-07-14T11:13:15.998899+0000","last_became_active":"2023-07-14T11:13:08.861817+0000","last_became_peered":"2023-07-14T11:13:08.861817+0000","last_unstale":"2023-07-14T11:13:15.998899+0000","last_undegraded":"2023-07-14T11:13:15.998899+0000","last_fullsized":"2023-07-14T11:13:15.998899+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:58:59.505841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.998031+0000","last_change":"2023-07-14T11:13:13.979826+0000","last_active":"2023-07-14T11:13:15.998031+0000","last_peered":"2023-07-14T11:13:15.998031+0000","last_clean":"2023-07-14T11:13:15.998031+0000","last_became_active":"2023-07-14T11:13:13.979506+0000","last_became_peered":"2023-07-14T11:13:13.979506+0000","last_unstale":"2023-07-14T11:13:15.998031+0000","last_undegraded":"2023-07-14T11:13:15.998031+0000","last_fullsized":"2023-07-14T11:13:15.998031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:00:14.107687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.999898+0000","last_change":"2023-07-14T11:13:14.999511+0000","last_active":"2023-07-14T11:13:15.999898+0000","last_peered":"2023-07-14T11:13:15.999898+0000","last_clean":"2023-07-14T11:13:15.999898+0000","last_became_active":"2023-07-14T11:13:14.999201+0000","last_became_peered":"2023-07-14T11:13:14.999201+0000","last_unstale":"2023-07-14T11:13:15.999898+0000","last_undegraded":"2023-07-14T11:13:15.999898+0000","last_fullsized":"2023-07-14T11:13:15.999898+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:17:31.639610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.999358+0000","last_change":"2023-07-14T11:13:08.757882+0000","last_active":"2023-07-14T11:13:15.999358+0000","last_peered":"2023-07-14T11:13:15.999358+0000","last_clean":"2023-07-14T11:13:15.999358+0000","last_became_active":"2023-07-14T11:13:08.757541+0000","last_became_peered":"2023-07-14T11:13:08.757541+0000","last_unstale":"2023-07-14T11:13:15.999358+0000","last_undegraded":"2023-07-14T11:13:15.999358+0000","last_fullsized":"2023-07-14T11:13:15.999358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:15:21.263931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":175,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.078502+0000","last_change":"2023-07-14T11:13:01.370649+0000","last_active":"2023-07-14T11:13:17.078502+0000","last_peered":"2023-07-14T11:13:17.078502+0000","last_clean":"2023-07-14T11:13:17.078502+0000","last_became_active":"2023-07-14T11:13:01.369478+0000","last_became_peered":"2023-07-14T11:13:01.369478+0000","last_unstale":"2023-07-14T11:13:17.078502+0000","last_undegraded":"2023-07-14T11:13:17.078502+0000","last_fullsized":"2023-07-14T11:13:17.078502+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:00.254800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:00.254800+0000","last_clean_scrub_stamp":"2023-07-14T11:13:00.254800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:34:56.039980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.048856+0000","last_change":"2023-07-14T11:13:13.989456+0000","last_active":"2023-07-14T11:13:17.048856+0000","last_peered":"2023-07-14T11:13:17.048856+0000","last_clean":"2023-07-14T11:13:17.048856+0000","last_became_active":"2023-07-14T11:13:13.989210+0000","last_became_peered":"2023-07-14T11:13:13.989210+0000","last_unstale":"2023-07-14T11:13:17.048856+0000","last_undegraded":"2023-07-14T11:13:17.048856+0000","last_fullsized":"2023-07-14T11:13:17.048856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:25:48.174808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.153350+0000","last_change":"2023-07-14T11:13:15.020682+0000","last_active":"2023-07-14T11:13:17.153350+0000","last_peered":"2023-07-14T11:13:17.153350+0000","last_clean":"2023-07-14T11:13:17.153350+0000","last_became_active":"2023-07-14T11:13:15.020395+0000","last_became_peered":"2023-07-14T11:13:15.020395+0000","last_unstale":"2023-07-14T11:13:17.153350+0000","last_undegraded":"2023-07-14T11:13:17.153350+0000","last_fullsized":"2023-07-14T11:13:17.153350+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:36:50.668482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.078216+0000","last_change":"2023-07-14T11:13:08.760609+0000","last_active":"2023-07-14T11:13:17.078216+0000","last_peered":"2023-07-14T11:13:17.078216+0000","last_clean":"2023-07-14T11:13:17.078216+0000","last_became_active":"2023-07-14T11:13:08.760285+0000","last_became_peered":"2023-07-14T11:13:08.760285+0000","last_unstale":"2023-07-14T11:13:17.078216+0000","last_undegraded":"2023-07-14T11:13:17.078216+0000","last_fullsized":"2023-07-14T11:13:17.078216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:58:59.848270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.033281+0000","last_change":"2023-07-14T11:13:13.985223+0000","last_active":"2023-07-14T11:13:17.033281+0000","last_peered":"2023-07-14T11:13:17.033281+0000","last_clean":"2023-07-14T11:13:17.033281+0000","last_became_active":"2023-07-14T11:13:13.984889+0000","last_became_peered":"2023-07-14T11:13:13.984889+0000","last_unstale":"2023-07-14T11:13:17.033281+0000","last_undegraded":"2023-07-14T11:13:17.033281+0000","last_fullsized":"2023-07-14T11:13:17.033281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:48:45.385596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.034029+0000","last_change":"2023-07-14T11:13:15.014139+0000","last_active":"2023-07-14T11:13:17.034029+0000","last_peered":"2023-07-14T11:13:17.034029+0000","last_clean":"2023-07-14T11:13:17.034029+0000","last_became_active":"2023-07-14T11:13:15.013656+0000","last_became_peered":"2023-07-14T11:13:15.013656+0000","last_unstale":"2023-07-14T11:13:17.034029+0000","last_undegraded":"2023-07-14T11:13:17.034029+0000","last_fullsized":"2023-07-14T11:13:17.034029+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:17:31.639610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.078825+0000","last_change":"2023-07-14T11:13:08.923899+0000","last_active":"2023-07-14T11:13:17.078825+0000","last_peered":"2023-07-14T11:13:17.078825+0000","last_clean":"2023-07-14T11:13:17.078825+0000","last_became_active":"2023-07-14T11:13:08.923513+0000","last_became_peered":"2023-07-14T11:13:08.923513+0000","last_unstale":"2023-07-14T11:13:17.078825+0000","last_undegraded":"2023-07-14T11:13:17.078825+0000","last_fullsized":"2023-07-14T11:13:17.078825+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:45:01.516820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.998671+0000","last_change":"2023-07-14T11:13:13.980381+0000","last_active":"2023-07-14T11:13:15.998671+0000","last_peered":"2023-07-14T11:13:15.998671+0000","last_clean":"2023-07-14T11:13:15.998671+0000","last_became_active":"2023-07-14T11:13:13.980136+0000","last_became_peered":"2023-07-14T11:13:13.980136+0000","last_unstale":"2023-07-14T11:13:15.998671+0000","last_undegraded":"2023-07-14T11:13:15.998671+0000","last_fullsized":"2023-07-14T11:13:15.998671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:16:00.285463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.033518+0000","last_change":"2023-07-14T11:13:15.006407+0000","last_active":"2023-07-14T11:13:17.033518+0000","last_peered":"2023-07-14T11:13:17.033518+0000","last_clean":"2023-07-14T11:13:17.033518+0000","last_became_active":"2023-07-14T11:13:15.006104+0000","last_became_peered":"2023-07-14T11:13:15.006104+0000","last_unstale":"2023-07-14T11:13:17.033518+0000","last_undegraded":"2023-07-14T11:13:17.033518+0000","last_fullsized":"2023-07-14T11:13:17.033518+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:24:33.371173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.049380+0000","last_change":"2023-07-14T11:13:13.979833+0000","last_active":"2023-07-14T11:13:17.049380+0000","last_peered":"2023-07-14T11:13:17.049380+0000","last_clean":"2023-07-14T11:13:17.049380+0000","last_became_active":"2023-07-14T11:13:13.979564+0000","last_became_peered":"2023-07-14T11:13:13.979564+0000","last_unstale":"2023-07-14T11:13:17.049380+0000","last_undegraded":"2023-07-14T11:13:17.049380+0000","last_fullsized":"2023-07-14T11:13:17.049380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:15:26.472331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.999751+0000","last_change":"2023-07-14T11:13:08.761726+0000","last_active":"2023-07-14T11:13:15.999751+0000","last_peered":"2023-07-14T11:13:15.999751+0000","last_clean":"2023-07-14T11:13:15.999751+0000","last_became_active":"2023-07-14T11:13:08.761365+0000","last_became_peered":"2023-07-14T11:13:08.761365+0000","last_unstale":"2023-07-14T11:13:15.999751+0000","last_undegraded":"2023-07-14T11:13:15.999751+0000","last_fullsized":"2023-07-14T11:13:15.999751+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:02:02.309287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.048645+0000","last_change":"2023-07-14T11:13:15.004961+0000","last_active":"2023-07-14T11:13:17.048645+0000","last_peered":"2023-07-14T11:13:17.048645+0000","last_clean":"2023-07-14T11:13:17.048645+0000","last_became_active":"2023-07-14T11:13:15.004656+0000","last_became_peered":"2023-07-14T11:13:15.004656+0000","last_unstale":"2023-07-14T11:13:17.048645+0000","last_undegraded":"2023-07-14T11:13:17.048645+0000","last_fullsized":"2023-07-14T11:13:17.048645+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:48:05.407947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.153709+0000","last_change":"2023-07-14T11:13:08.762084+0000","last_active":"2023-07-14T11:13:17.153709+0000","last_peered":"2023-07-14T11:13:17.153709+0000","last_clean":"2023-07-14T11:13:17.153709+0000","last_became_active":"2023-07-14T11:13:08.761763+0000","last_became_peered":"2023-07-14T11:13:08.761763+0000","last_unstale":"2023-07-14T11:13:17.153709+0000","last_undegraded":"2023-07-14T11:13:17.153709+0000","last_fullsized":"2023-07-14T11:13:17.153709+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:47:59.194413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.033950+0000","last_change":"2023-07-14T11:13:13.985679+0000","last_active":"2023-07-14T11:13:17.033950+0000","last_peered":"2023-07-14T11:13:17.033950+0000","last_clean":"2023-07-14T11:13:17.033950+0000","last_became_active":"2023-07-14T11:13:13.985432+0000","last_became_peered":"2023-07-14T11:13:13.985432+0000","last_unstale":"2023-07-14T11:13:17.033950+0000","last_undegraded":"2023-07-14T11:13:17.033950+0000","last_fullsized":"2023-07-14T11:13:17.033950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:15:26.472331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.152753+0000","last_change":"2023-07-14T11:13:15.006256+0000","last_active":"2023-07-14T11:13:17.152753+0000","last_peered":"2023-07-14T11:13:17.152753+0000","last_clean":"2023-07-14T11:13:17.152753+0000","last_became_active":"2023-07-14T11:13:15.005979+0000","last_became_peered":"2023-07-14T11:13:15.005979+0000","last_unstale":"2023-07-14T11:13:17.152753+0000","last_undegraded":"2023-07-14T11:13:17.152753+0000","last_fullsized":"2023-07-14T11:13:17.152753+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:19:17.400582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.033617+0000","last_change":"2023-07-14T11:13:13.987238+0000","last_active":"2023-07-14T11:13:17.033617+0000","last_peered":"2023-07-14T11:13:17.033617+0000","last_clean":"2023-07-14T11:13:17.033617+0000","last_became_active":"2023-07-14T11:13:13.986985+0000","last_became_peered":"2023-07-14T11:13:13.986985+0000","last_unstale":"2023-07-14T11:13:17.033617+0000","last_undegraded":"2023-07-14T11:13:17.033617+0000","last_fullsized":"2023-07-14T11:13:17.033617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:25:26.952904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.999527+0000","last_change":"2023-07-14T11:13:14.998910+0000","last_active":"2023-07-14T11:13:15.999527+0000","last_peered":"2023-07-14T11:13:15.999527+0000","last_clean":"2023-07-14T11:13:15.999527+0000","last_became_active":"2023-07-14T11:13:14.998599+0000","last_became_peered":"2023-07-14T11:13:14.998599+0000","last_unstale":"2023-07-14T11:13:15.999527+0000","last_undegraded":"2023-07-14T11:13:15.999527+0000","last_fullsized":"2023-07-14T11:13:15.999527+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:46:55.007943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.999207+0000","last_change":"2023-07-14T11:13:13.978096+0000","last_active":"2023-07-14T11:13:15.999207+0000","last_peered":"2023-07-14T11:13:15.999207+0000","last_clean":"2023-07-14T11:13:15.999207+0000","last_became_active":"2023-07-14T11:13:13.977725+0000","last_became_peered":"2023-07-14T11:13:13.977725+0000","last_unstale":"2023-07-14T11:13:15.999207+0000","last_undegraded":"2023-07-14T11:13:15.999207+0000","last_fullsized":"2023-07-14T11:13:15.999207+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:02:07.517687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.153133+0000","last_change":"2023-07-14T11:13:15.022976+0000","last_active":"2023-07-14T11:13:17.153133+0000","last_peered":"2023-07-14T11:13:17.153133+0000","last_clean":"2023-07-14T11:13:17.153133+0000","last_became_active":"2023-07-14T11:13:15.022716+0000","last_became_peered":"2023-07-14T11:13:15.022716+0000","last_unstale":"2023-07-14T11:13:17.153133+0000","last_undegraded":"2023-07-14T11:13:17.153133+0000","last_fullsized":"2023-07-14T11:13:17.153133+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:35:58.605091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.999708+0000","last_change":"2023-07-14T11:13:13.978838+0000","last_active":"2023-07-14T11:13:15.999708+0000","last_peered":"2023-07-14T11:13:15.999708+0000","last_clean":"2023-07-14T11:13:15.999708+0000","last_became_active":"2023-07-14T11:13:13.977771+0000","last_became_peered":"2023-07-14T11:13:13.977771+0000","last_unstale":"2023-07-14T11:13:15.999708+0000","last_undegraded":"2023-07-14T11:13:15.999708+0000","last_fullsized":"2023-07-14T11:13:15.999708+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:35:08.736309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.152969+0000","last_change":"2023-07-14T11:13:15.019154+0000","last_active":"2023-07-14T11:13:17.152969+0000","last_peered":"2023-07-14T11:13:17.152969+0000","last_clean":"2023-07-14T11:13:17.152969+0000","last_became_active":"2023-07-14T11:13:15.018878+0000","last_became_peered":"2023-07-14T11:13:15.018878+0000","last_unstale":"2023-07-14T11:13:17.152969+0000","last_undegraded":"2023-07-14T11:13:17.152969+0000","last_fullsized":"2023-07-14T11:13:17.152969+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:49:56.489161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.049132+0000","last_change":"2023-07-14T11:13:13.989944+0000","last_active":"2023-07-14T11:13:17.049132+0000","last_peered":"2023-07-14T11:13:17.049132+0000","last_clean":"2023-07-14T11:13:17.049132+0000","last_became_active":"2023-07-14T11:13:13.989576+0000","last_became_peered":"2023-07-14T11:13:13.989576+0000","last_unstale":"2023-07-14T11:13:17.049132+0000","last_undegraded":"2023-07-14T11:13:17.049132+0000","last_fullsized":"2023-07-14T11:13:17.049132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:19:16.395448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.048726+0000","last_change":"2023-07-14T11:13:15.009006+0000","last_active":"2023-07-14T11:13:17.048726+0000","last_peered":"2023-07-14T11:13:17.048726+0000","last_clean":"2023-07-14T11:13:17.048726+0000","last_became_active":"2023-07-14T11:13:15.008256+0000","last_became_peered":"2023-07-14T11:13:15.008256+0000","last_unstale":"2023-07-14T11:13:17.048726+0000","last_undegraded":"2023-07-14T11:13:17.048726+0000","last_fullsized":"2023-07-14T11:13:17.048726+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:48:46.390730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.034135+0000","last_change":"2023-07-14T11:13:13.991268+0000","last_active":"2023-07-14T11:13:17.034135+0000","last_peered":"2023-07-14T11:13:17.034135+0000","last_clean":"2023-07-14T11:13:17.034135+0000","last_became_active":"2023-07-14T11:13:13.991022+0000","last_became_peered":"2023-07-14T11:13:13.991022+0000","last_unstale":"2023-07-14T11:13:17.034135+0000","last_undegraded":"2023-07-14T11:13:17.034135+0000","last_fullsized":"2023-07-14T11:13:17.034135+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:12.951128+0000","last_clean_scrub_stamp":"2023-07-14T11:13:12.951128+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:04:24.868340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.152358+0000","last_change":"2023-07-14T11:13:15.012788+0000","last_active":"2023-07-14T11:13:17.152358+0000","last_peered":"2023-07-14T11:13:17.152358+0000","last_clean":"2023-07-14T11:13:17.152358+0000","last_became_active":"2023-07-14T11:13:15.012357+0000","last_became_peered":"2023-07-14T11:13:15.012357+0000","last_unstale":"2023-07-14T11:13:17.152358+0000","last_undegraded":"2023-07-14T11:13:17.152358+0000","last_fullsized":"2023-07-14T11:13:17.152358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:25:49.179942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.153325+0000","last_change":"2023-07-14T11:13:15.002966+0000","last_active":"2023-07-14T11:13:17.153325+0000","last_peered":"2023-07-14T11:13:17.153325+0000","last_clean":"2023-07-14T11:13:17.153325+0000","last_became_active":"2023-07-14T11:13:15.002577+0000","last_became_peered":"2023-07-14T11:13:15.002577+0000","last_unstale":"2023-07-14T11:13:17.153325+0000","last_undegraded":"2023-07-14T11:13:17.153325+0000","last_fullsized":"2023-07-14T11:13:17.153325+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:45:01.027542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.049399+0000","last_change":"2023-07-14T11:13:15.013713+0000","last_active":"2023-07-14T11:13:17.049399+0000","last_peered":"2023-07-14T11:13:17.049399+0000","last_clean":"2023-07-14T11:13:17.049399+0000","last_became_active":"2023-07-14T11:13:15.013385+0000","last_became_peered":"2023-07-14T11:13:15.013385+0000","last_unstale":"2023-07-14T11:13:17.049399+0000","last_undegraded":"2023-07-14T11:13:17.049399+0000","last_fullsized":"2023-07-14T11:13:17.049399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:31:23.154081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.153036+0000","last_change":"2023-07-14T11:13:15.013904+0000","last_active":"2023-07-14T11:13:17.153036+0000","last_peered":"2023-07-14T11:13:17.153036+0000","last_clean":"2023-07-14T11:13:17.153036+0000","last_became_active":"2023-07-14T11:13:15.013654+0000","last_became_peered":"2023-07-14T11:13:15.013654+0000","last_unstale":"2023-07-14T11:13:17.153036+0000","last_undegraded":"2023-07-14T11:13:17.153036+0000","last_fullsized":"2023-07-14T11:13:17.153036+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:59:06.061804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:17.049388+0000","last_change":"2023-07-14T11:13:15.004331+0000","last_active":"2023-07-14T11:13:17.049388+0000","last_peered":"2023-07-14T11:13:17.049388+0000","last_clean":"2023-07-14T11:13:17.049388+0000","last_became_active":"2023-07-14T11:13:15.003862+0000","last_became_peered":"2023-07-14T11:13:15.003862+0000","last_unstale":"2023-07-14T11:13:17.049388+0000","last_undegraded":"2023-07-14T11:13:17.049388+0000","last_fullsized":"2023-07-14T11:13:17.049388+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:17:31.639610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T11:13:15.998297+0000","last_change":"2023-07-14T11:13:15.005637+0000","last_active":"2023-07-14T11:13:15.998297+0000","last_peered":"2023-07-14T11:13:15.998297+0000","last_clean":"2023-07-14T11:13:15.998297+0000","last_became_active":"2023-07-14T11:13:15.005359+0000","last_became_peered":"2023-07-14T11:13:15.005359+0000","last_unstale":"2023-07-14T11:13:15.998297+0000","last_undegraded":"2023-07-14T11:13:15.998297+0000","last_fullsized":"2023-07-14T11:13:15.998297+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:13.956261+0000","last_clean_scrub_stamp":"2023-07-14T11:13:13.956261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:44:32.625537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":864256,"data_stored":681747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.466}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.0289999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.0010000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94199999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27772,"kb_used_data":820,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344068,"statfs":{"total":96636764160,"available":96608325632,"internally_reserved":0,"allocated":839680,"data_stored":680549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98299999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":245760,"data_stored":89689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":262144,"data_stored":91219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":249856,"data_stored":90251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T11:13:25.557 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-07-14T11:13:25.557 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-07-14T11:13:25.557 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-07-14T11:13:25.557 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-07-14T11:13:25.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.779+0000 7f326a3ff700 1 Processor -- start 2023-07-14T11:13:25.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.780+0000 7f326a3ff700 1 -- start start 2023-07-14T11:13:25.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.781+0000 7f326a3ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f32640d1220 0x7f32640b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:25.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.781+0000 7f326a3ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32640d2ce0 con 0x7f32640b1e00 2023-07-14T11:13:25.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.781+0000 7f326a3ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32640b3350 con 0x7f326415c950 2023-07-14T11:13:25.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.781+0000 7f326a3ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32640b3630 con 0x7f32640d1220 2023-07-14T11:13:25.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.781+0000 7f326899c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f32640b1e00 0x7f32640afac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:37800/0 (socket says 172.21.15.84:37800) 2023-07-14T11:13:25.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.781+0000 7f326899c700 1 -- 172.21.15.84:0/1660376238 learned_addr learned my addr 172.21.15.84:0/1660376238 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:13:25.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.781+0000 7f32637fe700 1 --2- 172.21.15.84:0/1660376238 >> v2:172.21.15.179:3300/0 conn(0x7f32640d1220 0x7f32640b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:25.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.781+0000 7f3262ffd700 1 -- 172.21.15.84:0/1660376238 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2853362412 0 0) 0x7f32640d2ce0 con 0x7f32640b1e00 2023-07-14T11:13:25.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.781+0000 7f3262ffd700 1 -- 172.21.15.84:0/1660376238 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f324c0035b0 con 0x7f32640b1e00 2023-07-14T11:13:25.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.782+0000 7f3262ffd700 1 -- 172.21.15.84:0/1660376238 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3648822986 0 0) 0x7f32640b3350 con 0x7f326415c950 2023-07-14T11:13:25.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.782+0000 7f3262ffd700 1 -- 172.21.15.84:0/1660376238 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32640d2ce0 con 0x7f326415c950 2023-07-14T11:13:25.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.782+0000 7f32637fe700 1 -- 172.21.15.84:0/1660376238 >> v1:172.21.15.179:6789/0 conn(0x7f326415c950 legacy=0x7f32640d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:25.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.782+0000 7f32637fe700 1 -- 172.21.15.84:0/1660376238 >> v1:172.21.15.84:6789/0 conn(0x7f32640b1e00 legacy=0x7f32640afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:25.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.782+0000 7f32637fe700 1 -- 172.21.15.84:0/1660376238 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32640b3910 con 0x7f32640d1220 2023-07-14T11:13:25.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.782+0000 7f32637fe700 1 --2- 172.21.15.84:0/1660376238 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32640d1220 0x7f32640b43f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3258009840 tx=0x7f3258009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d12409c9e591efc server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:25.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.782+0000 7f3262ffd700 1 -- 172.21.15.84:0/1660376238 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3258011830 con 0x7f32640d1220 2023-07-14T11:13:25.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.782+0000 7f3262ffd700 1 -- 172.21.15.84:0/1660376238 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3258011990 con 0x7f32640d1220 2023-07-14T11:13:25.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.782+0000 7f3262ffd700 1 -- 172.21.15.84:0/1660376238 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3258011d20 con 0x7f32640d1220 2023-07-14T11:13:25.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.783+0000 7f326a3ff700 1 -- 172.21.15.84:0/1660376238 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32640d1220 msgr2=0x7f32640b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:25.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.783+0000 7f326a3ff700 1 --2- 172.21.15.84:0/1660376238 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32640d1220 0x7f32640b43f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3258009840 tx=0x7f3258009b50 comp rx=0 tx=0).stop 2023-07-14T11:13:25.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.783+0000 7f326a3ff700 1 -- 172.21.15.84:0/1660376238 shutdown_connections 2023-07-14T11:13:25.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.783+0000 7f326a3ff700 1 --2- 172.21.15.84:0/1660376238 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32640d1220 0x7f32640b43f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:25.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.783+0000 7f326a3ff700 1 -- 172.21.15.84:0/1660376238 >> 172.21.15.84:0/1660376238 conn(0x7f326409c1d0 msgr2=0x7f32640d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:25.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.783+0000 7f326a3ff700 1 -- 172.21.15.84:0/1660376238 shutdown_connections 2023-07-14T11:13:25.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.783+0000 7f326a3ff700 1 -- 172.21.15.84:0/1660376238 wait complete. 2023-07-14T11:13:25.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.785+0000 7f326a3ff700 1 Processor -- start 2023-07-14T11:13:25.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.785+0000 7f326a3ff700 1 -- start start 2023-07-14T11:13:25.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.786+0000 7f326a3ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32640b1e00 0x7f32640cb060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:25.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.786+0000 7f326a3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32640d1220 0x7f32640cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:25.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.786+0000 7f326a3ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f326415c950 0x7f32640cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:25.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.786+0000 7f326a3ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32640cc020 con 0x7f32640b1e00 2023-07-14T11:13:25.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.786+0000 7f326a3ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32640ce000 con 0x7f326415c950 2023-07-14T11:13:25.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.786+0000 7f326a3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32641579f0 con 0x7f32640d1220 2023-07-14T11:13:25.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.786+0000 7f326899c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f326415c950 0x7f32640cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:25.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.786+0000 7f32637fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32640d1220 0x7f32640cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:25.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.786+0000 7f32637fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32640d1220 0x7f32640cb5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.84:36306/0 (socket says 172.21.15.84:36306) 2023-07-14T11:13:25.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.786+0000 7f32637fe700 1 -- 172.21.15.84:0/2268597457 learned_addr learned my addr 172.21.15.84:0/2268597457 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:25.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.786+0000 7f3263fff700 1 --2- 172.21.15.84:0/2268597457 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32640b1e00 0x7f32640cb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:25.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.787+0000 7f32637fe700 1 -- 172.21.15.84:0/2268597457 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f326415c950 msgr2=0x7f32640cbae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:25.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.787+0000 7f32637fe700 1 --2- 172.21.15.84:0/2268597457 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f326415c950 0x7f32640cbae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:25.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.787+0000 7f32637fe700 1 -- 172.21.15.84:0/2268597457 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32640b1e00 msgr2=0x7f32640cb060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:25.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.787+0000 7f32637fe700 1 --2- 172.21.15.84:0/2268597457 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32640b1e00 0x7f32640cb060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:25.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.787+0000 7f32637fe700 1 -- 172.21.15.84:0/2268597457 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32580094a0 con 0x7f32640d1220 2023-07-14T11:13:25.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.787+0000 7f32637fe700 1 --2- 172.21.15.84:0/2268597457 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32640d1220 0x7f32640cb5a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3258009b90 tx=0x7f3258004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:25.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.787+0000 7f3260ff9700 1 -- 172.21.15.84:0/2268597457 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f325801a760 con 0x7f32640d1220 2023-07-14T11:13:25.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.787+0000 7f3260ff9700 1 -- 172.21.15.84:0/2268597457 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f325801a8c0 con 0x7f32640d1220 2023-07-14T11:13:25.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.787+0000 7f326a3ff700 1 -- 172.21.15.84:0/2268597457 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32640cc210 con 0x7f32640d1220 2023-07-14T11:13:25.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.787+0000 7f3260ff9700 1 -- 172.21.15.84:0/2268597457 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f325801ac70 con 0x7f32640d1220 2023-07-14T11:13:25.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.788+0000 7f326a3ff700 1 -- 172.21.15.84:0/2268597457 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32640cc7d0 con 0x7f32640d1220 2023-07-14T11:13:25.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.788+0000 7f326a3ff700 1 -- 172.21.15.84:0/2268597457 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32640cc9c0 con 0x7f32640d1220 2023-07-14T11:13:25.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.790+0000 7f3260ff9700 1 -- 172.21.15.84:0/2268597457 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3258022070 con 0x7f32640d1220 2023-07-14T11:13:25.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.790+0000 7f3260ff9700 1 --2- 172.21.15.84:0/2268597457 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f325006ace0 0x7f325006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:25.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.790+0000 7f3260ff9700 1 -- 172.21.15.84:0/2268597457 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f325808a6e0 con 0x7f32640d1220 2023-07-14T11:13:25.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.791+0000 7f3263fff700 1 --2- 172.21.15.84:0/2268597457 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f325006ace0 0x7f325006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:25.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.791+0000 7f3263fff700 1 --2- 172.21.15.84:0/2268597457 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f325006ace0 0x7f325006d190 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3254007fd0 tx=0x7f3254009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:25.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:25.794+0000 7f3260ff9700 1 -- 172.21.15.84:0/2268597457 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3258055800 con 0x7f32640d1220 2023-07-14T11:13:26.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.030+0000 7f326a3ff700 1 -- 172.21.15.84:0/2268597457 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f32640d35c0 con 0x7f32640d1220 2023-07-14T11:13:26.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.032+0000 7f3260ff9700 1 -- 172.21.15.84:0/2268597457 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f3258058e20 con 0x7f32640d1220 2023-07-14T11:13:26.034 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:13:26.034 INFO:teuthology.orchestra.run.smithi084.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-07-14T11:13:26.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.033+0000 7f326a3ff700 1 -- 172.21.15.84:0/2268597457 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f325006ace0 msgr2=0x7f325006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:26.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.033+0000 7f326a3ff700 1 --2- 172.21.15.84:0/2268597457 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f325006ace0 0x7f325006d190 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3254007fd0 tx=0x7f3254009040 comp rx=0 tx=0).stop 2023-07-14T11:13:26.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.033+0000 7f326a3ff700 1 -- 172.21.15.84:0/2268597457 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32640d1220 msgr2=0x7f32640cb5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:26.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.033+0000 7f326a3ff700 1 --2- 172.21.15.84:0/2268597457 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32640d1220 0x7f32640cb5a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3258009b90 tx=0x7f3258004750 comp rx=0 tx=0).stop 2023-07-14T11:13:26.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.033+0000 7f326a3ff700 1 -- 172.21.15.84:0/2268597457 shutdown_connections 2023-07-14T11:13:26.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.033+0000 7f326a3ff700 1 --2- 172.21.15.84:0/2268597457 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f326415c950 0x7f32640cbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:26.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.033+0000 7f326a3ff700 1 --2- 172.21.15.84:0/2268597457 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32640b1e00 0x7f32640cb060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:26.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.033+0000 7f326a3ff700 1 --2- 172.21.15.84:0/2268597457 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f325006ace0 0x7f325006d190 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:26.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.033+0000 7f326a3ff700 1 --2- 172.21.15.84:0/2268597457 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32640d1220 0x7f32640cb5a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:26.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.033+0000 7f326a3ff700 1 -- 172.21.15.84:0/2268597457 >> 172.21.15.84:0/2268597457 conn(0x7f326409c1d0 msgr2=0x7f32640b5280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:26.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.034+0000 7f326a3ff700 1 -- 172.21.15.84:0/2268597457 shutdown_connections 2023-07-14T11:13:26.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.034+0000 7f326a3ff700 1 -- 172.21.15.84:0/2268597457 wait complete. 2023-07-14T11:13:26.054 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-07-14T11:13:26.055 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:13:26.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.248+0000 7f6b5e9ff700 1 Processor -- start 2023-07-14T11:13:26.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.248+0000 7f6b5e9ff700 1 -- start start 2023-07-14T11:13:26.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.249+0000 7f6b5e9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b580d1220 0x7f6b580b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:26.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.249+0000 7f6b5e9ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6b580b1e00 0x7f6b580afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:26.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.249+0000 7f6b5e9ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b580d2ce0 con 0x7f6b5815c950 2023-07-14T11:13:26.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.250+0000 7f6b5e9ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b580b3350 con 0x7f6b580b1e00 2023-07-14T11:13:26.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.250+0000 7f6b5e9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b580b3630 con 0x7f6b580d1220 2023-07-14T11:13:26.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.250+0000 7f6b57fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f6b5815c950 0x7f6b580d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:37812/0 (socket says 172.21.15.84:37812) 2023-07-14T11:13:26.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.250+0000 7f6b57fff700 1 -- 172.21.15.84:0/1356884234 learned_addr learned my addr 172.21.15.84:0/1356884234 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:13:26.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.250+0000 7f6b577fe700 1 --2- 172.21.15.84:0/1356884234 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b580d1220 0x7f6b580b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:26.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.250+0000 7f6b5cf9c700 1 --2- 172.21.15.84:0/1356884234 >> v2:172.21.15.179:3300/0 conn(0x7f6b580b1e00 0x7f6b580afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:26.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.250+0000 7f6b56ffd700 1 -- 172.21.15.84:0/1356884234 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1599892085 0 0) 0x7f6b580d2ce0 con 0x7f6b5815c950 2023-07-14T11:13:26.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.250+0000 7f6b56ffd700 1 -- 172.21.15.84:0/1356884234 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b400035b0 con 0x7f6b5815c950 2023-07-14T11:13:26.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.250+0000 7f6b56ffd700 1 -- 172.21.15.84:0/1356884234 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2603551608 0 0) 0x7f6b400035b0 con 0x7f6b5815c950 2023-07-14T11:13:26.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.250+0000 7f6b56ffd700 1 -- 172.21.15.84:0/1356884234 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b580d1220 msgr2=0x7f6b580b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:26.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.250+0000 7f6b56ffd700 1 --2- 172.21.15.84:0/1356884234 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b580d1220 0x7f6b580b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:26.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.250+0000 7f6b56ffd700 1 -- 172.21.15.84:0/1356884234 >> v2:172.21.15.179:3300/0 conn(0x7f6b580b1e00 msgr2=0x7f6b580afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:26.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.250+0000 7f6b56ffd700 1 --2- 172.21.15.84:0/1356884234 >> v2:172.21.15.179:3300/0 conn(0x7f6b580b1e00 0x7f6b580afac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:26.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.250+0000 7f6b56ffd700 1 -- 172.21.15.84:0/1356884234 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b580b3910 con 0x7f6b5815c950 2023-07-14T11:13:26.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.250+0000 7f6b56ffd700 1 -- 172.21.15.84:0/1356884234 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7f6b480017f0 con 0x7f6b5815c950 2023-07-14T11:13:26.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.251+0000 7f6b56ffd700 1 -- 172.21.15.84:0/1356884234 >> v1:172.21.15.84:6789/0 conn(0x7f6b5815c950 legacy=0x7f6b580d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:26.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.251+0000 7f6b56ffd700 1 --2- 172.21.15.84:0/1356884234 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b580d1220 0x7f6b40003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:26.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.251+0000 7f6b56ffd700 1 --2- 172.21.15.84:0/1356884234 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b40003fd0 0x7f6b40004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:26.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.251+0000 7f6b56ffd700 1 --2- 172.21.15.84:0/1356884234 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b40004d90 0x7f6b40005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:26.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.251+0000 7f6b56ffd700 1 -- 172.21.15.84:0/1356884234 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b580b3350 con 0x7f6b40004d90 2023-07-14T11:13:26.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.251+0000 7f6b56ffd700 1 -- 172.21.15.84:0/1356884234 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b580b3630 con 0x7f6b40003fd0 2023-07-14T11:13:26.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.251+0000 7f6b56ffd700 1 -- 172.21.15.84:0/1356884234 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4000ba90 con 0x7f6b580d1220 2023-07-14T11:13:26.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.251+0000 7f6b5cf9c700 1 --2- 172.21.15.84:0/1356884234 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b40004d90 0x7f6b40005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:26.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.251+0000 7f6b577fe700 1 --2- 172.21.15.84:0/1356884234 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b40003fd0 0x7f6b40004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:26.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.251+0000 7f6b57fff700 1 --2- 172.21.15.84:0/1356884234 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b580d1220 0x7f6b40003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:26.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.251+0000 7f6b5cf9c700 1 -- 172.21.15.84:0/1356884234 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b580d1220 msgr2=0x7f6b40003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:26.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.251+0000 7f6b5cf9c700 1 --2- 172.21.15.84:0/1356884234 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b580d1220 0x7f6b40003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:26.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.251+0000 7f6b5cf9c700 1 -- 172.21.15.84:0/1356884234 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b40003fd0 msgr2=0x7f6b40004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:26.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.251+0000 7f6b5cf9c700 1 --2- 172.21.15.84:0/1356884234 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b40003fd0 0x7f6b40004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:26.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.251+0000 7f6b5cf9c700 1 -- 172.21.15.84:0/1356884234 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b400035b0 con 0x7f6b40004d90 2023-07-14T11:13:26.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.252+0000 7f6b5cf9c700 1 --2- 172.21.15.84:0/1356884234 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b40004d90 0x7f6b40005200 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6b50009fc0 tx=0x7f6b40005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61cdb1a4875e339e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:26.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.252+0000 7f6b56ffd700 1 -- 172.21.15.84:0/1356884234 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b5000ec30 con 0x7f6b40004d90 2023-07-14T11:13:26.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.252+0000 7f6b56ffd700 1 -- 172.21.15.84:0/1356884234 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b5000f040 con 0x7f6b40004d90 2023-07-14T11:13:26.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.252+0000 7f6b56ffd700 1 -- 172.21.15.84:0/1356884234 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b50014480 con 0x7f6b40004d90 2023-07-14T11:13:26.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.252+0000 7f6b5e9ff700 1 -- 172.21.15.84:0/1356884234 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b40004d90 msgr2=0x7f6b40005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:26.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.252+0000 7f6b5e9ff700 1 --2- 172.21.15.84:0/1356884234 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b40004d90 0x7f6b40005200 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6b50009fc0 tx=0x7f6b40005880 comp rx=0 tx=0).stop 2023-07-14T11:13:26.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.252+0000 7f6b5cf9c700 1 -- 172.21.15.84:0/1356884234 reap_dead start 2023-07-14T11:13:26.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.252+0000 7f6b5e9ff700 1 -- 172.21.15.84:0/1356884234 shutdown_connections 2023-07-14T11:13:26.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.252+0000 7f6b5e9ff700 1 -- 172.21.15.84:0/1356884234 >> 172.21.15.84:0/1356884234 conn(0x7f6b5809c1d0 msgr2=0x7f6b580d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:26.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.252+0000 7f6b5e9ff700 1 -- 172.21.15.84:0/1356884234 shutdown_connections 2023-07-14T11:13:26.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.252+0000 7f6b5e9ff700 1 -- 172.21.15.84:0/1356884234 wait complete. 2023-07-14T11:13:26.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.254+0000 7f6b5e9ff700 1 Processor -- start 2023-07-14T11:13:26.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.254+0000 7f6b5e9ff700 1 -- start start 2023-07-14T11:13:26.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.255+0000 7f6b5e9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b40004d90 0x7f6b58157720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:26.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.255+0000 7f6b5e9ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b580c6a70 0x7f6b58159730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:26.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.255+0000 7f6b5e9ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b5815e280 0x7f6b5815e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:26.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.255+0000 7f6b5e9ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5815ec40 con 0x7f6b5815e280 2023-07-14T11:13:26.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.255+0000 7f6b5e9ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b58157c60 con 0x7f6b580c6a70 2023-07-14T11:13:26.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.255+0000 7f6b5e9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b580c6f00 con 0x7f6b40004d90 2023-07-14T11:13:26.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.255+0000 7f6b5cf9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b5815e280 0x7f6b5815e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:26.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.255+0000 7f6b5cf9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b5815e280 0x7f6b5815e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34384/0 (socket says 172.21.15.84:34384) 2023-07-14T11:13:26.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.255+0000 7f6b5cf9c700 1 -- 172.21.15.84:0/4071806412 learned_addr learned my addr 172.21.15.84:0/4071806412 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:26.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.255+0000 7f6b577fe700 1 --2- 172.21.15.84:0/4071806412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b580c6a70 0x7f6b58159730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:26.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.256+0000 7f6b57fff700 1 --2- 172.21.15.84:0/4071806412 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b40004d90 0x7f6b58157720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:26.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.256+0000 7f6b5cf9c700 1 -- 172.21.15.84:0/4071806412 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b40004d90 msgr2=0x7f6b58157720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:26.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.256+0000 7f6b5cf9c700 1 --2- 172.21.15.84:0/4071806412 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b40004d90 0x7f6b58157720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:26.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.256+0000 7f6b5cf9c700 1 -- 172.21.15.84:0/4071806412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b580c6a70 msgr2=0x7f6b58159730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:26.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.256+0000 7f6b5cf9c700 1 --2- 172.21.15.84:0/4071806412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b580c6a70 0x7f6b58159730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:26.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.256+0000 7f6b5cf9c700 1 -- 172.21.15.84:0/4071806412 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b580c71e0 con 0x7f6b5815e280 2023-07-14T11:13:26.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.256+0000 7f6b5cf9c700 1 --2- 172.21.15.84:0/4071806412 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b5815e280 0x7f6b5815e700 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6b50017040 tx=0x7f6b50009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:26.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.256+0000 7f6b54ff9700 1 -- 172.21.15.84:0/4071806412 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b50007000 con 0x7f6b5815e280 2023-07-14T11:13:26.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.256+0000 7f6b54ff9700 1 -- 172.21.15.84:0/4071806412 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b50003e50 con 0x7f6b5815e280 2023-07-14T11:13:26.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.256+0000 7f6b54ff9700 1 -- 172.21.15.84:0/4071806412 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b50014b50 con 0x7f6b5815e280 2023-07-14T11:13:26.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.256+0000 7f6b5e9ff700 1 -- 172.21.15.84:0/4071806412 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b580c74c0 con 0x7f6b5815e280 2023-07-14T11:13:26.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.256+0000 7f6b5e9ff700 1 -- 172.21.15.84:0/4071806412 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b58159c70 con 0x7f6b5815e280 2023-07-14T11:13:26.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.257+0000 7f6b5e9ff700 1 -- 172.21.15.84:0/4071806412 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b580c79e0 con 0x7f6b5815e280 2023-07-14T11:13:26.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.258+0000 7f6b54ff9700 1 -- 172.21.15.84:0/4071806412 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6b50024020 con 0x7f6b5815e280 2023-07-14T11:13:26.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.259+0000 7f6b54ff9700 1 --2- 172.21.15.84:0/4071806412 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6b4406ace0 0x7f6b4406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:26.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.259+0000 7f6b54ff9700 1 -- 172.21.15.84:0/4071806412 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6b5008adf0 con 0x7f6b5815e280 2023-07-14T11:13:26.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.259+0000 7f6b57fff700 1 --2- 172.21.15.84:0/4071806412 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6b4406ace0 0x7f6b4406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:26.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.260+0000 7f6b57fff700 1 --2- 172.21.15.84:0/4071806412 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6b4406ace0 0x7f6b4406d190 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6b480011d0 tx=0x7f6b48009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:26.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.263+0000 7f6b54ff9700 1 -- 172.21.15.84:0/4071806412 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f6b580c79e0 con 0x7f6b5815e280 2023-07-14T11:13:26.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.456+0000 7f6b5e9ff700 1 -- 172.21.15.84:0/4071806412 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6b580c79e0 con 0x7f6b5815e280 2023-07-14T11:13:26.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.457+0000 7f6b54ff9700 1 -- 172.21.15.84:0/4071806412 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18255 (secure 0 0 0) 0x7f6b580c79e0 con 0x7f6b5815e280 2023-07-14T11:13:26.461 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:13:26.461 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":23,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:13:15.989292+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-14T11:13:12.727811+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-14T11:13:13.436391+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:13:26.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.460+0000 7f6b5e9ff700 1 -- 172.21.15.84:0/4071806412 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6b4406ace0 msgr2=0x7f6b4406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:26.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.460+0000 7f6b5e9ff700 1 --2- 172.21.15.84:0/4071806412 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6b4406ace0 0x7f6b4406d190 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6b480011d0 tx=0x7f6b48009040 comp rx=0 tx=0).stop 2023-07-14T11:13:26.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.460+0000 7f6b5e9ff700 1 -- 172.21.15.84:0/4071806412 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b5815e280 msgr2=0x7f6b5815e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:26.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.460+0000 7f6b5e9ff700 1 --2- 172.21.15.84:0/4071806412 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b5815e280 0x7f6b5815e700 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6b50017040 tx=0x7f6b50009750 comp rx=0 tx=0).stop 2023-07-14T11:13:26.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.460+0000 7f6b5e9ff700 1 -- 172.21.15.84:0/4071806412 shutdown_connections 2023-07-14T11:13:26.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.460+0000 7f6b5e9ff700 1 --2- 172.21.15.84:0/4071806412 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6b4406ace0 0x7f6b4406d190 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:26.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.460+0000 7f6b5e9ff700 1 --2- 172.21.15.84:0/4071806412 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b40004d90 0x7f6b58157720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:26.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.460+0000 7f6b5e9ff700 1 --2- 172.21.15.84:0/4071806412 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b5815e280 0x7f6b5815e700 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:26.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.460+0000 7f6b5e9ff700 1 --2- 172.21.15.84:0/4071806412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b580c6a70 0x7f6b58159730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:26.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.460+0000 7f6b5e9ff700 1 -- 172.21.15.84:0/4071806412 >> 172.21.15.84:0/4071806412 conn(0x7f6b5809c1d0 msgr2=0x7f6b580afac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:26.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.460+0000 7f6b5e9ff700 1 -- 172.21.15.84:0/4071806412 shutdown_connections 2023-07-14T11:13:26.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.460+0000 7f6b5e9ff700 1 -- 172.21.15.84:0/4071806412 wait complete. 2023-07-14T11:13:26.481 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T11:13:00.125395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T11:13:06.803994+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T11:13:12.727811+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T11:13:13.436391+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T11:13:26.481 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T11:13:26.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.676+0000 7fb4fe9ff700 1 Processor -- start 2023-07-14T11:13:26.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.677+0000 7fb4fe9ff700 1 -- start start 2023-07-14T11:13:26.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.678+0000 7fb4fe9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4f80b8a60 0x7fb4f80b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:26.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.678+0000 7fb4fe9ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb4f80d1220 0x7fb4f80b0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:26.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.678+0000 7fb4fe9ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4f80b8e30 con 0x7fb4f80b4530 2023-07-14T11:13:26.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.678+0000 7fb4fe9ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4f80afaa0 con 0x7fb4f80d1220 2023-07-14T11:13:26.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.678+0000 7fb4fe9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f80afd80 con 0x7fb4f80b8a60 2023-07-14T11:13:26.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.678+0000 7fb4fcf9c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb4f80d1220 0x7fb4f80b0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:26.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.678+0000 7fb4fcf9c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb4f80d1220 0x7fb4f80b0e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34396/0 (socket says 172.21.15.84:34396) 2023-07-14T11:13:26.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.678+0000 7fb4fcf9c700 1 -- 172.21.15.84:0/4238109412 learned_addr learned my addr 172.21.15.84:0/4238109412 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:26.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.678+0000 7fb4f7fff700 1 --2- 172.21.15.84:0/4238109412 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4f80b8a60 0x7fb4f80b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:26.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.678+0000 7fb4fcf9c700 1 -- 172.21.15.84:0/4238109412 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4f80b8a60 msgr2=0x7fb4f80b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:26.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.678+0000 7fb4fcf9c700 1 --2- 172.21.15.84:0/4238109412 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4f80b8a60 0x7fb4f80b3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:26.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.679+0000 7fb4fcf9c700 1 -- 172.21.15.84:0/4238109412 >> v1:172.21.15.179:6789/0 conn(0x7fb4f80b4530 legacy=0x7fb4f80d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:26.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.679+0000 7fb4fcf9c700 1 -- 172.21.15.84:0/4238109412 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f80b0060 con 0x7fb4f80d1220 2023-07-14T11:13:26.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.679+0000 7fb4fcf9c700 1 --2- 172.21.15.84:0/4238109412 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4f80d1220 0x7fb4f80b0e20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb4f0009e50 tx=0x7fb4f000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ede79f22cb66af49 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:26.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.679+0000 7fb4f77fe700 1 -- 172.21.15.84:0/4238109412 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f000e070 con 0x7fb4f80d1220 2023-07-14T11:13:26.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.679+0000 7fb4f77fe700 1 -- 172.21.15.84:0/4238109412 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4f000b9c0 con 0x7fb4f80d1220 2023-07-14T11:13:26.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.679+0000 7fb4f77fe700 1 -- 172.21.15.84:0/4238109412 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f000bd70 con 0x7fb4f80d1220 2023-07-14T11:13:26.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.680+0000 7fb4fe9ff700 1 -- 172.21.15.84:0/4238109412 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4f80d1220 msgr2=0x7fb4f80b0e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:26.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.680+0000 7fb4fe9ff700 1 --2- 172.21.15.84:0/4238109412 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4f80d1220 0x7fb4f80b0e20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb4f0009e50 tx=0x7fb4f000b330 comp rx=0 tx=0).stop 2023-07-14T11:13:26.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.680+0000 7fb4fe9ff700 1 -- 172.21.15.84:0/4238109412 shutdown_connections 2023-07-14T11:13:26.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.680+0000 7fb4fe9ff700 1 --2- 172.21.15.84:0/4238109412 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4f80d1220 0x7fb4f80b0e20 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:26.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.680+0000 7fb4fe9ff700 1 --2- 172.21.15.84:0/4238109412 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4f80b8a60 0x7fb4f80b3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:26.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.680+0000 7fb4fe9ff700 1 -- 172.21.15.84:0/4238109412 >> 172.21.15.84:0/4238109412 conn(0x7fb4f809c1b0 msgr2=0x7fb4f80d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:26.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.680+0000 7fb4fe9ff700 1 -- 172.21.15.84:0/4238109412 shutdown_connections 2023-07-14T11:13:26.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.680+0000 7fb4fe9ff700 1 -- 172.21.15.84:0/4238109412 wait complete. 2023-07-14T11:13:26.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.681+0000 7fb4fe9ff700 1 Processor -- start 2023-07-14T11:13:26.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.681+0000 7fb4fe9ff700 1 -- start start 2023-07-14T11:13:26.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.682+0000 7fb4fe9ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb4f80b4530 0x7fb4f80cfc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:26.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.682+0000 7fb4fe9ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4f80b8a60 0x7fb4f80cb060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:26.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.682+0000 7fb4fe9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4f80d1220 0x7fb4f80cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:26.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.682+0000 7fb4fe9ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f80cc850 con 0x7fb4f80b8a60 2023-07-14T11:13:26.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.682+0000 7fb4fe9ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f80cbc40 con 0x7fb4f80b4530 2023-07-14T11:13:26.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.682+0000 7fb4fe9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f80cbf20 con 0x7fb4f80d1220 2023-07-14T11:13:26.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.683+0000 7fb4effff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4f80b8a60 0x7fb4f80cb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:26.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.683+0000 7fb4effff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4f80b8a60 0x7fb4f80cb060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34404/0 (socket says 172.21.15.84:34404) 2023-07-14T11:13:26.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.683+0000 7fb4effff700 1 -- 172.21.15.84:0/1566893266 learned_addr learned my addr 172.21.15.84:0/1566893266 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:26.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.683+0000 7fb4f7fff700 1 --2- 172.21.15.84:0/1566893266 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb4f80b4530 0x7fb4f80cfc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:26.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.683+0000 7fb4fcf9c700 1 --2- 172.21.15.84:0/1566893266 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4f80d1220 0x7fb4f80cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:26.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.683+0000 7fb4effff700 1 -- 172.21.15.84:0/1566893266 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4f80d1220 msgr2=0x7fb4f80cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:26.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.683+0000 7fb4effff700 1 --2- 172.21.15.84:0/1566893266 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4f80d1220 0x7fb4f80cb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:26.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.683+0000 7fb4effff700 1 -- 172.21.15.84:0/1566893266 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb4f80b4530 msgr2=0x7fb4f80cfc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:26.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.683+0000 7fb4effff700 1 --2- 172.21.15.84:0/1566893266 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb4f80b4530 0x7fb4f80cfc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:26.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.683+0000 7fb4effff700 1 -- 172.21.15.84:0/1566893266 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f0009b30 con 0x7fb4f80b8a60 2023-07-14T11:13:26.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.683+0000 7fb4effff700 1 --2- 172.21.15.84:0/1566893266 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4f80b8a60 0x7fb4f80cb060 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb4e000c4e0 tx=0x7fb4e000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:26.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.684+0000 7fb4f57fa700 1 -- 172.21.15.84:0/1566893266 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e00052d0 con 0x7fb4f80b8a60 2023-07-14T11:13:26.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.684+0000 7fb4f57fa700 1 -- 172.21.15.84:0/1566893266 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4e0005430 con 0x7fb4f80b8a60 2023-07-14T11:13:26.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.684+0000 7fb4fe9ff700 1 -- 172.21.15.84:0/1566893266 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4f80cc200 con 0x7fb4f80b8a60 2023-07-14T11:13:26.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.684+0000 7fb4f57fa700 1 -- 172.21.15.84:0/1566893266 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e00038c0 con 0x7fb4f80b8a60 2023-07-14T11:13:26.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.684+0000 7fb4fe9ff700 1 -- 172.21.15.84:0/1566893266 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4f81f55a0 con 0x7fb4f80b8a60 2023-07-14T11:13:26.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.685+0000 7fb4fe9ff700 1 -- 172.21.15.84:0/1566893266 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4f80cc9c0 con 0x7fb4f80b8a60 2023-07-14T11:13:26.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.686+0000 7fb4f57fa700 1 -- 172.21.15.84:0/1566893266 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb4e0003a20 con 0x7fb4f80b8a60 2023-07-14T11:13:26.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.687+0000 7fb4f57fa700 1 --2- 172.21.15.84:0/1566893266 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fb4d806ad10 0x7fb4d806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:26.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.687+0000 7fb4f57fa700 1 -- 172.21.15.84:0/1566893266 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb4e0088830 con 0x7fb4f80b8a60 2023-07-14T11:13:26.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.687+0000 7fb4f7fff700 1 --2- 172.21.15.84:0/1566893266 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fb4d806ad10 0x7fb4d806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:26.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.688+0000 7fb4f7fff700 1 --2- 172.21.15.84:0/1566893266 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fb4d806ad10 0x7fb4d806d1c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb4e8006b20 tx=0x7fb4e8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:26.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.691+0000 7fb4f57fa700 1 -- 172.21.15.84:0/1566893266 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fb4e00538d0 con 0x7fb4f80b8a60 2023-07-14T11:13:26.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.885+0000 7fb4fe9ff700 1 -- 172.21.15.84:0/1566893266 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb4f8074350 con 0x7fb4f80b8a60 2023-07-14T11:13:26.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.885+0000 7fb4f57fa700 1 -- 172.21.15.84:0/1566893266 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb4e0056ef0 con 0x7fb4f80b8a60 2023-07-14T11:13:26.888 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-07-14T11:13:26.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.887+0000 7fb4fe9ff700 1 -- 172.21.15.84:0/1566893266 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fb4d806ad10 msgr2=0x7fb4d806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:26.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.887+0000 7fb4fe9ff700 1 --2- 172.21.15.84:0/1566893266 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fb4d806ad10 0x7fb4d806d1c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb4e8006b20 tx=0x7fb4e8008040 comp rx=0 tx=0).stop 2023-07-14T11:13:26.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.887+0000 7fb4fe9ff700 1 -- 172.21.15.84:0/1566893266 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4f80b8a60 msgr2=0x7fb4f80cb060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:26.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.887+0000 7fb4fe9ff700 1 --2- 172.21.15.84:0/1566893266 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4f80b8a60 0x7fb4f80cb060 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb4e000c4e0 tx=0x7fb4e000c7f0 comp rx=0 tx=0).stop 2023-07-14T11:13:26.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.887+0000 7fb4fe9ff700 1 -- 172.21.15.84:0/1566893266 shutdown_connections 2023-07-14T11:13:26.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.887+0000 7fb4fe9ff700 1 --2- 172.21.15.84:0/1566893266 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fb4d806ad10 0x7fb4d806d1c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:26.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.887+0000 7fb4fe9ff700 1 --2- 172.21.15.84:0/1566893266 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4f80d1220 0x7fb4f80cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:26.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.887+0000 7fb4fe9ff700 1 --2- 172.21.15.84:0/1566893266 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb4f80b4530 0x7fb4f80cfc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:26.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.887+0000 7fb4fe9ff700 1 --2- 172.21.15.84:0/1566893266 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4f80b8a60 0x7fb4f80cb060 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:26.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.887+0000 7fb4fe9ff700 1 -- 172.21.15.84:0/1566893266 >> 172.21.15.84:0/1566893266 conn(0x7fb4f809c1b0 msgr2=0x7fb4f80b0e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:26.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.887+0000 7fb4fe9ff700 1 -- 172.21.15.84:0/1566893266 shutdown_connections 2023-07-14T11:13:26.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:26.887+0000 7fb4fe9ff700 1 -- 172.21.15.84:0/1566893266 wait complete. 2023-07-14T11:13:26.908 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T11:13:27.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.103+0000 7f57c35ff700 1 Processor -- start 2023-07-14T11:13:27.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.104+0000 7f57c35ff700 1 -- start start 2023-07-14T11:13:27.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.105+0000 7f57c35ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f57bc0d0f90 0x7f57bc0b1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:27.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.105+0000 7f57c35ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57bc0b8e30 con 0x7f57bc0b8a60 2023-07-14T11:13:27.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.105+0000 7f57c35ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57bc0d1410 con 0x7f57bc0d0b10 2023-07-14T11:13:27.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.105+0000 7f57c35ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57bc0afaa0 con 0x7f57bc0d0f90 2023-07-14T11:13:27.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.105+0000 7f57c139b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f57bc0b8a60 0x7f57bc0b3ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:37820/0 (socket says 172.21.15.84:37820) 2023-07-14T11:13:27.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.105+0000 7f57c139b700 1 -- 172.21.15.84:0/2116395506 learned_addr learned my addr 172.21.15.84:0/2116395506 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:13:27.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.105+0000 7f57c1b9c700 1 --2- 172.21.15.84:0/2116395506 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f57bc0d0f90 0x7f57bc0b1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:27.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.105+0000 7f57b3fff700 1 -- 172.21.15.84:0/2116395506 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3077247446 0 0) 0x7f57bc0b8e30 con 0x7f57bc0b8a60 2023-07-14T11:13:27.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.105+0000 7f57b3fff700 1 -- 172.21.15.84:0/2116395506 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57a80035b0 con 0x7f57bc0b8a60 2023-07-14T11:13:27.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.106+0000 7f57b3fff700 1 -- 172.21.15.84:0/2116395506 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3185047074 0 0) 0x7f57a80035b0 con 0x7f57bc0b8a60 2023-07-14T11:13:27.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.106+0000 7f57b3fff700 1 -- 172.21.15.84:0/2116395506 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f57bc0d0f90 msgr2=0x7f57bc0b1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:27.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.106+0000 7f57b3fff700 1 --2- 172.21.15.84:0/2116395506 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f57bc0d0f90 0x7f57bc0b1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:27.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.106+0000 7f57b3fff700 1 -- 172.21.15.84:0/2116395506 >> v1:172.21.15.179:6789/0 conn(0x7f57bc0d0b10 legacy=0x7f57bc0b0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:27.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.106+0000 7f57b3fff700 1 -- 172.21.15.84:0/2116395506 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57bc0afd80 con 0x7f57bc0b8a60 2023-07-14T11:13:27.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.106+0000 7f57b3fff700 1 -- 172.21.15.84:0/2116395506 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7f57b8001670 con 0x7f57bc0b8a60 2023-07-14T11:13:27.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.106+0000 7f57b3fff700 1 -- 172.21.15.84:0/2116395506 >> v1:172.21.15.84:6789/0 conn(0x7f57bc0b8a60 legacy=0x7f57bc0b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:27.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.106+0000 7f57b3fff700 1 --2- 172.21.15.84:0/2116395506 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57a8003a30 0x7f57a8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:27.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.106+0000 7f57b3fff700 1 --2- 172.21.15.84:0/2116395506 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57a80043d0 0x7f57a8004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:27.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.106+0000 7f57b3fff700 1 --2- 172.21.15.84:0/2116395506 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f57bc0d0f90 0x7f57a80050f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:27.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.106+0000 7f57b3fff700 1 -- 172.21.15.84:0/2116395506 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57bc0afaa0 con 0x7f57a8003a30 2023-07-14T11:13:27.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.106+0000 7f57b3fff700 1 -- 172.21.15.84:0/2116395506 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a800ba10 con 0x7f57a80043d0 2023-07-14T11:13:27.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.106+0000 7f57b3fff700 1 -- 172.21.15.84:0/2116395506 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57a800bba0 con 0x7f57bc0d0f90 2023-07-14T11:13:27.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.106+0000 7f57c139b700 1 --2- 172.21.15.84:0/2116395506 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57a8003a30 0x7f57a8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:27.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.106+0000 7f57c1b9c700 1 --2- 172.21.15.84:0/2116395506 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f57bc0d0f90 0x7f57a80050f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:27.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.106+0000 7f57c0b9a700 1 --2- 172.21.15.84:0/2116395506 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57a80043d0 0x7f57a8004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:27.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.106+0000 7f57c139b700 1 -- 172.21.15.84:0/2116395506 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f57bc0d0f90 msgr2=0x7f57a80050f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:27.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.106+0000 7f57c139b700 1 --2- 172.21.15.84:0/2116395506 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f57bc0d0f90 0x7f57a80050f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:27.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.106+0000 7f57c139b700 1 -- 172.21.15.84:0/2116395506 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57a80043d0 msgr2=0x7f57a8004890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:27.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.106+0000 7f57c139b700 1 --2- 172.21.15.84:0/2116395506 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57a80043d0 0x7f57a8004890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:27.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.106+0000 7f57c139b700 1 -- 172.21.15.84:0/2116395506 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57a80035b0 con 0x7f57a8003a30 2023-07-14T11:13:27.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.107+0000 7f57c139b700 1 --2- 172.21.15.84:0/2116395506 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57a8003a30 0x7f57a8003e00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f57b800c2f0 tx=0x7f57a8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=390a46f63f496490 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:27.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.107+0000 7f57b3fff700 1 -- 172.21.15.84:0/2116395506 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b800ce30 con 0x7f57a8003a30 2023-07-14T11:13:27.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.107+0000 7f57b3fff700 1 -- 172.21.15.84:0/2116395506 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57b8005960 con 0x7f57a8003a30 2023-07-14T11:13:27.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.107+0000 7f57b3fff700 1 -- 172.21.15.84:0/2116395506 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b8005d10 con 0x7f57a8003a30 2023-07-14T11:13:27.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.107+0000 7f57c35ff700 1 -- 172.21.15.84:0/2116395506 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57a8003a30 msgr2=0x7f57a8003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:27.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.107+0000 7f57c35ff700 1 --2- 172.21.15.84:0/2116395506 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57a8003a30 0x7f57a8003e00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f57b800c2f0 tx=0x7f57a8005880 comp rx=0 tx=0).stop 2023-07-14T11:13:27.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.107+0000 7f57c1b9c700 1 -- 172.21.15.84:0/2116395506 reap_dead start 2023-07-14T11:13:27.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.107+0000 7f57c35ff700 1 -- 172.21.15.84:0/2116395506 shutdown_connections 2023-07-14T11:13:27.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.107+0000 7f57c35ff700 1 -- 172.21.15.84:0/2116395506 >> 172.21.15.84:0/2116395506 conn(0x7f57bc09c1b0 msgr2=0x7f57bc0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:27.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.108+0000 7f57c35ff700 1 -- 172.21.15.84:0/2116395506 shutdown_connections 2023-07-14T11:13:27.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.108+0000 7f57c35ff700 1 -- 172.21.15.84:0/2116395506 wait complete. 2023-07-14T11:13:27.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.109+0000 7f57c35ff700 1 Processor -- start 2023-07-14T11:13:27.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.109+0000 7f57c35ff700 1 -- start start 2023-07-14T11:13:27.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.110+0000 7f57c35ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57a8003a30 0x7f57bc15bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:27.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.110+0000 7f57c35ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57bc1f2b50 0x7f57bc0cc150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:27.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.110+0000 7f57c35ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f57bc0cc690 0x7f57bc0ca160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:27.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.110+0000 7f57c35ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57bc15e120 con 0x7f57bc1f2b50 2023-07-14T11:13:27.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.110+0000 7f57c35ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57bc15c0c0 con 0x7f57a8003a30 2023-07-14T11:13:27.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.110+0000 7f57c35ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57bc0ccb50 con 0x7f57bc0cc690 2023-07-14T11:13:27.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.111+0000 7f57c0b9a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57bc1f2b50 0x7f57bc0cc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:27.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.111+0000 7f57c0b9a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57bc1f2b50 0x7f57bc0cc150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34408/0 (socket says 172.21.15.84:34408) 2023-07-14T11:13:27.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.111+0000 7f57c0b9a700 1 -- 172.21.15.84:0/1914678892 learned_addr learned my addr 172.21.15.84:0/1914678892 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:27.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.111+0000 7f57c0b9a700 1 -- 172.21.15.84:0/1914678892 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f57bc0cc690 msgr2=0x7f57bc0ca160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:27.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.111+0000 7f57c0b9a700 1 --2- 172.21.15.84:0/1914678892 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f57bc0cc690 0x7f57bc0ca160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:27.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.111+0000 7f57c0b9a700 1 -- 172.21.15.84:0/1914678892 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57a8003a30 msgr2=0x7f57bc15bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:27.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.111+0000 7f57c0b9a700 1 --2- 172.21.15.84:0/1914678892 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57a8003a30 0x7f57bc15bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:27.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.111+0000 7f57c0b9a700 1 -- 172.21.15.84:0/1914678892 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57bc0cce30 con 0x7f57bc1f2b50 2023-07-14T11:13:27.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.111+0000 7f57c0b9a700 1 --2- 172.21.15.84:0/1914678892 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57bc1f2b50 0x7f57bc0cc150 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f57ac00e780 tx=0x7f57ac00eb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:27.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.111+0000 7f57b1ffb700 1 -- 172.21.15.84:0/1914678892 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ac0052e0 con 0x7f57bc1f2b50 2023-07-14T11:13:27.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.111+0000 7f57b1ffb700 1 -- 172.21.15.84:0/1914678892 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57ac005440 con 0x7f57bc1f2b50 2023-07-14T11:13:27.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.111+0000 7f57c35ff700 1 -- 172.21.15.84:0/1914678892 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57bc15e390 con 0x7f57bc1f2b50 2023-07-14T11:13:27.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.111+0000 7f57b1ffb700 1 -- 172.21.15.84:0/1914678892 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ac0038c0 con 0x7f57bc1f2b50 2023-07-14T11:13:27.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.112+0000 7f57c35ff700 1 -- 172.21.15.84:0/1914678892 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57bc0ca6a0 con 0x7f57bc1f2b50 2023-07-14T11:13:27.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.113+0000 7f57c35ff700 1 -- 172.21.15.84:0/1914678892 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57bc15e5d0 con 0x7f57bc1f2b50 2023-07-14T11:13:27.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.113+0000 7f57b1ffb700 1 -- 172.21.15.84:0/1914678892 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f57ac003a20 con 0x7f57bc1f2b50 2023-07-14T11:13:27.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.114+0000 7f57b1ffb700 1 --2- 172.21.15.84:0/1914678892 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f57a006ace0 0x7f57a006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:27.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.114+0000 7f57b1ffb700 1 -- 172.21.15.84:0/1914678892 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f57ac088de0 con 0x7f57bc1f2b50 2023-07-14T11:13:27.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.115+0000 7f57c139b700 1 --2- 172.21.15.84:0/1914678892 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f57a006ace0 0x7f57a006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:27.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.115+0000 7f57c139b700 1 --2- 172.21.15.84:0/1914678892 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f57a006ace0 0x7f57a006d190 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f57bc0cbf40 tx=0x7f57b800a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:27.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.119+0000 7f57b1ffb700 1 -- 172.21.15.84:0/1914678892 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f57bc15e5d0 con 0x7f57bc1f2b50 2023-07-14T11:13:27.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.315+0000 7f57c35ff700 1 -- 172.21.15.84:0/1914678892 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f57bc15e5d0 con 0x7f57bc1f2b50 2023-07-14T11:13:27.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.315+0000 7f57b1ffb700 1 -- 172.21.15.84:0/1914678892 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f57ac019020 con 0x7f57bc1f2b50 2023-07-14T11:13:27.318 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-07-14T11:13:27.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.318+0000 7f57c35ff700 1 -- 172.21.15.84:0/1914678892 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f57a006ace0 msgr2=0x7f57a006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:27.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.318+0000 7f57c35ff700 1 --2- 172.21.15.84:0/1914678892 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f57a006ace0 0x7f57a006d190 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f57bc0cbf40 tx=0x7f57b800a000 comp rx=0 tx=0).stop 2023-07-14T11:13:27.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.318+0000 7f57c35ff700 1 -- 172.21.15.84:0/1914678892 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57bc1f2b50 msgr2=0x7f57bc0cc150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:27.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.318+0000 7f57c35ff700 1 --2- 172.21.15.84:0/1914678892 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57bc1f2b50 0x7f57bc0cc150 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f57ac00e780 tx=0x7f57ac00eb40 comp rx=0 tx=0).stop 2023-07-14T11:13:27.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.318+0000 7f57c35ff700 1 -- 172.21.15.84:0/1914678892 shutdown_connections 2023-07-14T11:13:27.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.318+0000 7f57c35ff700 1 --2- 172.21.15.84:0/1914678892 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f57a006ace0 0x7f57a006d190 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:27.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.318+0000 7f57c35ff700 1 --2- 172.21.15.84:0/1914678892 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f57bc0cc690 0x7f57bc0ca160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:27.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.318+0000 7f57c35ff700 1 --2- 172.21.15.84:0/1914678892 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57a8003a30 0x7f57bc15bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:27.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.318+0000 7f57c35ff700 1 --2- 172.21.15.84:0/1914678892 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57bc1f2b50 0x7f57bc0cc150 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:27.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.318+0000 7f57c35ff700 1 -- 172.21.15.84:0/1914678892 >> 172.21.15.84:0/1914678892 conn(0x7f57bc09c1b0 msgr2=0x7f57bc0b0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:27.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.318+0000 7f57c35ff700 1 -- 172.21.15.84:0/1914678892 shutdown_connections 2023-07-14T11:13:27.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.318+0000 7f57c35ff700 1 -- 172.21.15.84:0/1914678892 wait complete. 2023-07-14T11:13:27.339 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T11:13:27.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.534+0000 7fb11e7ff700 1 Processor -- start 2023-07-14T11:13:27.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.535+0000 7fb11e7ff700 1 -- start start 2023-07-14T11:13:27.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.536+0000 7fb11e7ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb1180b8660 0x7fb1180cd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:27.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.536+0000 7fb11e7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1180cd970 0x7fb1180b4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:27.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.536+0000 7fb11e7ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb1180b4da0 0x7fb1181601f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:27.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.536+0000 7fb11e7ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1180d02a0 con 0x7fb1180b8660 2023-07-14T11:13:27.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.536+0000 7fb11e7ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1180b51c0 con 0x7fb1180b4da0 2023-07-14T11:13:27.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.536+0000 7fb11e7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1180cfce0 con 0x7fb1180cd970 2023-07-14T11:13:27.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.536+0000 7fb117fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb1180b8660 0x7fb1180cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:27.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.536+0000 7fb117fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb1180b8660 0x7fb1180cd430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34416/0 (socket says 172.21.15.84:34416) 2023-07-14T11:13:27.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.536+0000 7fb117fff700 1 -- 172.21.15.84:0/2367831737 learned_addr learned my addr 172.21.15.84:0/2367831737 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:27.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.536+0000 7fb1177fe700 1 --2- 172.21.15.84:0/2367831737 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1180cd970 0x7fb1180b4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:27.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.536+0000 7fb11cd9c700 1 --2- 172.21.15.84:0/2367831737 >> v2:172.21.15.179:3300/0 conn(0x7fb1180b4da0 0x7fb1181601f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:27.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.536+0000 7fb117fff700 1 -- 172.21.15.84:0/2367831737 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1180cd970 msgr2=0x7fb1180b4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:27.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.536+0000 7fb117fff700 1 --2- 172.21.15.84:0/2367831737 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1180cd970 0x7fb1180b4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:27.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.537+0000 7fb117fff700 1 -- 172.21.15.84:0/2367831737 >> v2:172.21.15.179:3300/0 conn(0x7fb1180b4da0 msgr2=0x7fb1181601f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:27.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.537+0000 7fb117fff700 1 --2- 172.21.15.84:0/2367831737 >> v2:172.21.15.179:3300/0 conn(0x7fb1180b4da0 0x7fb1181601f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:27.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.537+0000 7fb117fff700 1 -- 172.21.15.84:0/2367831737 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1180cffc0 con 0x7fb1180b8660 2023-07-14T11:13:27.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.537+0000 7fb1177fe700 1 --2- 172.21.15.84:0/2367831737 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1180cd970 0x7fb1180b4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:13:27.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.537+0000 7fb11cd9c700 1 --2- 172.21.15.84:0/2367831737 >> v2:172.21.15.179:3300/0 conn(0x7fb1180b4da0 0x7fb1181601f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:13:27.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.537+0000 7fb117fff700 1 --2- 172.21.15.84:0/2367831737 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1180b8660 0x7fb1180cd430 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb118160130 tx=0x7fb108009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60f7468e9096fc66 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:27.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.537+0000 7fb116ffd700 1 -- 172.21.15.84:0/2367831737 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb10800b870 con 0x7fb1180b8660 2023-07-14T11:13:27.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.537+0000 7fb116ffd700 1 -- 172.21.15.84:0/2367831737 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb10800b9d0 con 0x7fb1180b8660 2023-07-14T11:13:27.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.537+0000 7fb116ffd700 1 -- 172.21.15.84:0/2367831737 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb10800bd60 con 0x7fb1180b8660 2023-07-14T11:13:27.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.537+0000 7fb11e7ff700 1 -- 172.21.15.84:0/2367831737 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1180b8660 msgr2=0x7fb1180cd430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:27.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.537+0000 7fb11e7ff700 1 --2- 172.21.15.84:0/2367831737 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1180b8660 0x7fb1180cd430 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb118160130 tx=0x7fb108009bd0 comp rx=0 tx=0).stop 2023-07-14T11:13:27.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.538+0000 7fb11e7ff700 1 -- 172.21.15.84:0/2367831737 shutdown_connections 2023-07-14T11:13:27.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.538+0000 7fb11e7ff700 1 --2- 172.21.15.84:0/2367831737 >> v2:172.21.15.179:3300/0 conn(0x7fb1180b4da0 0x7fb1181601f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:27.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.538+0000 7fb11e7ff700 1 --2- 172.21.15.84:0/2367831737 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1180b8660 0x7fb1180cd430 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:27.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.538+0000 7fb11e7ff700 1 --2- 172.21.15.84:0/2367831737 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1180cd970 0x7fb1180b4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:27.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.538+0000 7fb11e7ff700 1 -- 172.21.15.84:0/2367831737 >> 172.21.15.84:0/2367831737 conn(0x7fb118066860 msgr2=0x7fb11806a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:27.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.538+0000 7fb11e7ff700 1 -- 172.21.15.84:0/2367831737 shutdown_connections 2023-07-14T11:13:27.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.538+0000 7fb11e7ff700 1 -- 172.21.15.84:0/2367831737 wait complete. 2023-07-14T11:13:27.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.539+0000 7fb11e7ff700 1 Processor -- start 2023-07-14T11:13:27.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.540+0000 7fb11e7ff700 1 -- start start 2023-07-14T11:13:27.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.540+0000 7fb11e7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1180b4da0 0x7fb1181f5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:27.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.541+0000 7fb11e7ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1180b8660 0x7fb1180c6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:27.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.541+0000 7fb11e7ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1180cd970 0x7fb1180c6e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:27.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.541+0000 7fb11e7ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1180c90c0 con 0x7fb1180b8660 2023-07-14T11:13:27.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.541+0000 7fb11e7ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1181f5950 con 0x7fb1180cd970 2023-07-14T11:13:27.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.541+0000 7fb11e7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1180cb680 con 0x7fb1180b4da0 2023-07-14T11:13:27.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.541+0000 7fb1177fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1180b8660 0x7fb1180c6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:27.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.541+0000 7fb1177fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1180b8660 0x7fb1180c6910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34426/0 (socket says 172.21.15.84:34426) 2023-07-14T11:13:27.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.541+0000 7fb1177fe700 1 -- 172.21.15.84:0/1014141245 learned_addr learned my addr 172.21.15.84:0/1014141245 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:27.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.541+0000 7fb117fff700 1 --2- 172.21.15.84:0/1014141245 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1180b4da0 0x7fb1181f5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:27.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.541+0000 7fb1177fe700 1 -- 172.21.15.84:0/1014141245 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1180b4da0 msgr2=0x7fb1181f5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:27.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.541+0000 7fb1177fe700 1 --2- 172.21.15.84:0/1014141245 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1180b4da0 0x7fb1181f5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:27.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.541+0000 7fb11cd9c700 1 --2- 172.21.15.84:0/1014141245 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1180cd970 0x7fb1180c6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:27.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.541+0000 7fb1177fe700 1 -- 172.21.15.84:0/1014141245 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1180cd970 msgr2=0x7fb1180c6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:27.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.541+0000 7fb1177fe700 1 --2- 172.21.15.84:0/1014141245 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1180cd970 0x7fb1180c6e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:27.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.541+0000 7fb1177fe700 1 -- 172.21.15.84:0/1014141245 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb108009550 con 0x7fb1180b8660 2023-07-14T11:13:27.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.541+0000 7fb117fff700 1 --2- 172.21.15.84:0/1014141245 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1180b4da0 0x7fb1181f5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:13:27.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.541+0000 7fb11cd9c700 1 --2- 172.21.15.84:0/1014141245 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1180cd970 0x7fb1180c6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:13:27.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.541+0000 7fb1177fe700 1 --2- 172.21.15.84:0/1014141245 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1180b8660 0x7fb1180c6910 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb10c00e7e0 tx=0x7fb10c00eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:27.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.542+0000 7fb114ff9700 1 -- 172.21.15.84:0/1014141245 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb10c00c030 con 0x7fb1180b8660 2023-07-14T11:13:27.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.542+0000 7fb114ff9700 1 -- 172.21.15.84:0/1014141245 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb10c004220 con 0x7fb1180b8660 2023-07-14T11:13:27.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.542+0000 7fb114ff9700 1 -- 172.21.15.84:0/1014141245 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb10c004590 con 0x7fb1180b8660 2023-07-14T11:13:27.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.542+0000 7fb11e7ff700 1 -- 172.21.15.84:0/1014141245 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1180cb960 con 0x7fb1180b8660 2023-07-14T11:13:27.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.542+0000 7fb11e7ff700 1 -- 172.21.15.84:0/1014141245 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1180cbf20 con 0x7fb1180b8660 2023-07-14T11:13:27.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.543+0000 7fb11e7ff700 1 -- 172.21.15.84:0/1014141245 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1180b5570 con 0x7fb1180b8660 2023-07-14T11:13:27.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.544+0000 7fb114ff9700 1 -- 172.21.15.84:0/1014141245 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb10c0036a0 con 0x7fb1180b8660 2023-07-14T11:13:27.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.544+0000 7fb114ff9700 1 --2- 172.21.15.84:0/1014141245 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fb10406ace0 0x7fb10406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:27.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.545+0000 7fb114ff9700 1 -- 172.21.15.84:0/1014141245 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb10c089240 con 0x7fb1180b8660 2023-07-14T11:13:27.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.545+0000 7fb117fff700 1 --2- 172.21.15.84:0/1014141245 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fb10406ace0 0x7fb10406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:27.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.545+0000 7fb117fff700 1 --2- 172.21.15.84:0/1014141245 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fb10406ace0 0x7fb10406d190 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb108009130 tx=0x7fb108008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:27.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.549+0000 7fb114ff9700 1 -- 172.21.15.84:0/1014141245 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fb10c057d70 con 0x7fb1180b8660 2023-07-14T11:13:27.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.741+0000 7fb11e7ff700 1 -- 172.21.15.84:0/1014141245 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb118074350 con 0x7fb1180b8660 2023-07-14T11:13:27.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.741+0000 7fb114ff9700 1 -- 172.21.15.84:0/1014141245 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb10c057900 con 0x7fb1180b8660 2023-07-14T11:13:27.745 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-07-14T11:13:27.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.743+0000 7fb11e7ff700 1 -- 172.21.15.84:0/1014141245 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fb10406ace0 msgr2=0x7fb10406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:27.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.743+0000 7fb11e7ff700 1 --2- 172.21.15.84:0/1014141245 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fb10406ace0 0x7fb10406d190 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb108009130 tx=0x7fb108008030 comp rx=0 tx=0).stop 2023-07-14T11:13:27.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.743+0000 7fb11e7ff700 1 -- 172.21.15.84:0/1014141245 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1180b8660 msgr2=0x7fb1180c6910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:27.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.743+0000 7fb11e7ff700 1 --2- 172.21.15.84:0/1014141245 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1180b8660 0x7fb1180c6910 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb10c00e7e0 tx=0x7fb10c00eba0 comp rx=0 tx=0).stop 2023-07-14T11:13:27.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.743+0000 7fb11e7ff700 1 -- 172.21.15.84:0/1014141245 shutdown_connections 2023-07-14T11:13:27.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.743+0000 7fb11e7ff700 1 --2- 172.21.15.84:0/1014141245 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fb10406ace0 0x7fb10406d190 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:27.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.743+0000 7fb11e7ff700 1 --2- 172.21.15.84:0/1014141245 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1180b4da0 0x7fb1181f5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:27.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.744+0000 7fb11e7ff700 1 --2- 172.21.15.84:0/1014141245 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1180cd970 0x7fb1180c6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:27.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.744+0000 7fb11e7ff700 1 --2- 172.21.15.84:0/1014141245 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1180b8660 0x7fb1180c6910 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:27.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.744+0000 7fb11e7ff700 1 -- 172.21.15.84:0/1014141245 >> 172.21.15.84:0/1014141245 conn(0x7fb118066860 msgr2=0x7fb1180b4590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:27.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.744+0000 7fb11e7ff700 1 -- 172.21.15.84:0/1014141245 shutdown_connections 2023-07-14T11:13:27.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.744+0000 7fb11e7ff700 1 -- 172.21.15.84:0/1014141245 wait complete. 2023-07-14T11:13:27.764 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T11:13:27.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.958+0000 7f214dbff700 1 Processor -- start 2023-07-14T11:13:27.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.958+0000 7f214dbff700 1 -- start start 2023-07-14T11:13:27.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.960+0000 7f214dbff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f21480c92d0 0x7f21480ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:27.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.960+0000 7f214dbff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f21480b12f0 0x7f21480c96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:27.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.960+0000 7f214dbff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f214815ce70 con 0x7f21480adea0 2023-07-14T11:13:27.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.960+0000 7f214dbff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f214815da60 con 0x7f21480b12f0 2023-07-14T11:13:27.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.960+0000 7f214dbff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21480c9be0 con 0x7f21480c92d0 2023-07-14T11:13:27.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.960+0000 7f213ffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f21480b12f0 0x7f21480c96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:27.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.960+0000 7f213ffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f21480b12f0 0x7f21480c96a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34432/0 (socket says 172.21.15.84:34432) 2023-07-14T11:13:27.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.960+0000 7f213ffff700 1 -- 172.21.15.84:0/4230190833 learned_addr learned my addr 172.21.15.84:0/4230190833 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:27.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.960+0000 7f21477fe700 1 --2- 172.21.15.84:0/4230190833 >> v2:172.21.15.179:3300/0 conn(0x7f21480c92d0 0x7f21480ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:27.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.960+0000 7f213ffff700 1 -- 172.21.15.84:0/4230190833 >> v2:172.21.15.179:3300/0 conn(0x7f21480c92d0 msgr2=0x7f21480ad8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:27.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.960+0000 7f213ffff700 1 --2- 172.21.15.84:0/4230190833 >> v2:172.21.15.179:3300/0 conn(0x7f21480c92d0 0x7f21480ad8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:27.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.960+0000 7f213ffff700 1 -- 172.21.15.84:0/4230190833 >> v1:172.21.15.179:6789/0 conn(0x7f21480adea0 legacy=0x7f214806c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:27.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.960+0000 7f213ffff700 1 -- 172.21.15.84:0/4230190833 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f214815d0c0 con 0x7f21480b12f0 2023-07-14T11:13:27.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.961+0000 7f213ffff700 1 --2- 172.21.15.84:0/4230190833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21480b12f0 0x7f21480c96a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f214806f630 tx=0x7f2130009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae764aba7671c98e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:27.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.961+0000 7f2146ffd700 1 -- 172.21.15.84:0/4230190833 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2130011830 con 0x7f21480b12f0 2023-07-14T11:13:27.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.961+0000 7f2146ffd700 1 -- 172.21.15.84:0/4230190833 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2130011990 con 0x7f21480b12f0 2023-07-14T11:13:27.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.961+0000 7f2146ffd700 1 -- 172.21.15.84:0/4230190833 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2130011d20 con 0x7f21480b12f0 2023-07-14T11:13:27.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.961+0000 7f214dbff700 1 -- 172.21.15.84:0/4230190833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21480b12f0 msgr2=0x7f21480c96a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:27.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.961+0000 7f214dbff700 1 --2- 172.21.15.84:0/4230190833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21480b12f0 0x7f21480c96a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f214806f630 tx=0x7f2130009bd0 comp rx=0 tx=0).stop 2023-07-14T11:13:27.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.961+0000 7f214dbff700 1 -- 172.21.15.84:0/4230190833 shutdown_connections 2023-07-14T11:13:27.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.961+0000 7f214dbff700 1 --2- 172.21.15.84:0/4230190833 >> v2:172.21.15.179:3300/0 conn(0x7f21480c92d0 0x7f21480ad8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:27.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.961+0000 7f214dbff700 1 --2- 172.21.15.84:0/4230190833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21480b12f0 0x7f21480c96a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:27.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.962+0000 7f214dbff700 1 -- 172.21.15.84:0/4230190833 >> 172.21.15.84:0/4230190833 conn(0x7f21480b05d0 msgr2=0x7f21480b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:27.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.962+0000 7f214dbff700 1 -- 172.21.15.84:0/4230190833 shutdown_connections 2023-07-14T11:13:27.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.962+0000 7f214dbff700 1 -- 172.21.15.84:0/4230190833 wait complete. 2023-07-14T11:13:27.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.964+0000 7f214dbff700 1 Processor -- start 2023-07-14T11:13:27.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.964+0000 7f214dbff700 1 -- start start 2023-07-14T11:13:27.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.965+0000 7f214dbff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21480adea0 0x7f2148146ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:27.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.965+0000 7f214dbff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21480b12f0 0x7f214815b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:27.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.965+0000 7f214dbff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21480c92d0 0x7f214815b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:27.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.965+0000 7f214dbff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2148147420 con 0x7f21480c92d0 2023-07-14T11:13:27.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.965+0000 7f214dbff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2148159ac0 con 0x7f21480b12f0 2023-07-14T11:13:27.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.965+0000 7f214dbff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f214815bfd0 con 0x7f21480adea0 2023-07-14T11:13:27.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.966+0000 7f2147fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21480c92d0 0x7f214815b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:27.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.966+0000 7f213ffff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21480b12f0 0x7f214815b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:27.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.966+0000 7f21477fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21480adea0 0x7f2148146ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:27.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.966+0000 7f213ffff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21480b12f0 0x7f214815b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.84:52266/0 (socket says 172.21.15.84:52266) 2023-07-14T11:13:27.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.966+0000 7f213ffff700 1 -- 172.21.15.84:0/4186615156 learned_addr learned my addr 172.21.15.84:0/4186615156 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:27.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.966+0000 7f2147fff700 1 --2- 172.21.15.84:0/4186615156 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21480c92d0 0x7f214815b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34440/0 (socket says 172.21.15.84:34440) 2023-07-14T11:13:27.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.966+0000 7f213ffff700 1 -- 172.21.15.84:0/4186615156 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21480adea0 msgr2=0x7f2148146ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:27.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.966+0000 7f213ffff700 1 --2- 172.21.15.84:0/4186615156 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21480adea0 0x7f2148146ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:27.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.966+0000 7f213ffff700 1 -- 172.21.15.84:0/4186615156 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21480c92d0 msgr2=0x7f214815b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:27.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.966+0000 7f213ffff700 1 --2- 172.21.15.84:0/4186615156 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21480c92d0 0x7f214815b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:27.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.966+0000 7f213ffff700 1 -- 172.21.15.84:0/4186615156 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2130009550 con 0x7f21480b12f0 2023-07-14T11:13:27.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.966+0000 7f2147fff700 1 --2- 172.21.15.84:0/4186615156 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21480c92d0 0x7f214815b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:13:27.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.967+0000 7f213ffff700 1 --2- 172.21.15.84:0/4186615156 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21480b12f0 0x7f214815b150 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2130000c00 tx=0x7f2130004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:27.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.967+0000 7f2144ff9700 1 -- 172.21.15.84:0/4186615156 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2130004400 con 0x7f21480b12f0 2023-07-14T11:13:27.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.967+0000 7f2144ff9700 1 -- 172.21.15.84:0/4186615156 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f213001f070 con 0x7f21480b12f0 2023-07-14T11:13:27.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.967+0000 7f214dbff700 1 -- 172.21.15.84:0/4186615156 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f214815c2b0 con 0x7f21480b12f0 2023-07-14T11:13:27.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.967+0000 7f2144ff9700 1 -- 172.21.15.84:0/4186615156 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21300038e0 con 0x7f21480b12f0 2023-07-14T11:13:27.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.967+0000 7f214dbff700 1 -- 172.21.15.84:0/4186615156 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2148154500 con 0x7f21480b12f0 2023-07-14T11:13:27.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.968+0000 7f214dbff700 1 -- 172.21.15.84:0/4186615156 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f214815c7d0 con 0x7f21480b12f0 2023-07-14T11:13:27.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.969+0000 7f2144ff9700 1 -- 172.21.15.84:0/4186615156 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2130021030 con 0x7f21480b12f0 2023-07-14T11:13:27.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.970+0000 7f2144ff9700 1 --2- 172.21.15.84:0/4186615156 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f212806ace0 0x7f212806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:27.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.970+0000 7f2144ff9700 1 -- 172.21.15.84:0/4186615156 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f213008a950 con 0x7f21480b12f0 2023-07-14T11:13:27.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.970+0000 7f21477fe700 1 --2- 172.21.15.84:0/4186615156 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f212806ace0 0x7f212806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:27.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.971+0000 7f21477fe700 1 --2- 172.21.15.84:0/4186615156 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f212806ace0 0x7f212806d190 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2138009b40 tx=0x7f2138009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:27.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:27.975+0000 7f2144ff9700 1 -- 172.21.15.84:0/4186615156 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f214815c7d0 con 0x7f21480b12f0 2023-07-14T11:13:28.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.172+0000 7f214dbff700 1 -- 172.21.15.84:0/4186615156 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f214815c7d0 con 0x7f21480b12f0 2023-07-14T11:13:28.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.173+0000 7f2144ff9700 1 -- 172.21.15.84:0/4186615156 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f214815c7d0 con 0x7f21480b12f0 2023-07-14T11:13:28.177 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-07-14T11:13:28.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.176+0000 7f214dbff700 1 -- 172.21.15.84:0/4186615156 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f212806ace0 msgr2=0x7f212806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:28.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.176+0000 7f214dbff700 1 --2- 172.21.15.84:0/4186615156 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f212806ace0 0x7f212806d190 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2138009b40 tx=0x7f2138009210 comp rx=0 tx=0).stop 2023-07-14T11:13:28.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.176+0000 7f214dbff700 1 -- 172.21.15.84:0/4186615156 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21480b12f0 msgr2=0x7f214815b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:28.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.176+0000 7f214dbff700 1 --2- 172.21.15.84:0/4186615156 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21480b12f0 0x7f214815b150 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2130000c00 tx=0x7f2130004750 comp rx=0 tx=0).stop 2023-07-14T11:13:28.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.176+0000 7f214dbff700 1 -- 172.21.15.84:0/4186615156 shutdown_connections 2023-07-14T11:13:28.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.176+0000 7f214dbff700 1 --2- 172.21.15.84:0/4186615156 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f212806ace0 0x7f212806d190 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:28.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.176+0000 7f214dbff700 1 --2- 172.21.15.84:0/4186615156 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21480adea0 0x7f2148146ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:28.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.176+0000 7f214dbff700 1 --2- 172.21.15.84:0/4186615156 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21480c92d0 0x7f214815b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:28.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.176+0000 7f214dbff700 1 --2- 172.21.15.84:0/4186615156 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21480b12f0 0x7f214815b150 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:28.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.176+0000 7f214dbff700 1 -- 172.21.15.84:0/4186615156 >> 172.21.15.84:0/4186615156 conn(0x7f21480b05d0 msgr2=0x7f21480ac860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:28.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.176+0000 7f214dbff700 1 -- 172.21.15.84:0/4186615156 shutdown_connections 2023-07-14T11:13:28.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.176+0000 7f214dbff700 1 -- 172.21.15.84:0/4186615156 wait complete. 2023-07-14T11:13:28.197 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T11:13:28.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.388+0000 7fe9e13ff700 1 Processor -- start 2023-07-14T11:13:28.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.388+0000 7fe9e13ff700 1 -- start start 2023-07-14T11:13:28.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.389+0000 7fe9e13ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9dc0b4510 0x7fe9dc0b6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:28.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.389+0000 7fe9e13ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe9dc0b5d90 0x7fe9dc0cd590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:28.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.390+0000 7fe9e13ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9dc0b7f50 con 0x7fe9dc0d0b10 2023-07-14T11:13:28.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.390+0000 7fe9e13ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9dc0b48e0 con 0x7fe9dc0b5d90 2023-07-14T11:13:28.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.390+0000 7fe9e13ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9dc0b7340 con 0x7fe9dc0b4510 2023-07-14T11:13:28.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.390+0000 7fe9d3fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe9dc0b5d90 0x7fe9dc0cd590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:28.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.390+0000 7fe9d3fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe9dc0b5d90 0x7fe9dc0cd590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34448/0 (socket says 172.21.15.84:34448) 2023-07-14T11:13:28.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.390+0000 7fe9d3fff700 1 -- 172.21.15.84:0/774598154 learned_addr learned my addr 172.21.15.84:0/774598154 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:28.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.390+0000 7fe9daffd700 1 --2- 172.21.15.84:0/774598154 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9dc0b4510 0x7fe9dc0b6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:28.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.390+0000 7fe9d3fff700 1 -- 172.21.15.84:0/774598154 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9dc0b4510 msgr2=0x7fe9dc0b6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:28.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.390+0000 7fe9d3fff700 1 --2- 172.21.15.84:0/774598154 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9dc0b4510 0x7fe9dc0b6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:28.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.390+0000 7fe9d3fff700 1 -- 172.21.15.84:0/774598154 >> v1:172.21.15.179:6789/0 conn(0x7fe9dc0d0b10 legacy=0x7fe9dc0b83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:28.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.390+0000 7fe9d3fff700 1 -- 172.21.15.84:0/774598154 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9dc0b7620 con 0x7fe9dc0b5d90 2023-07-14T11:13:28.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.390+0000 7fe9daffd700 1 --2- 172.21.15.84:0/774598154 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9dc0b4510 0x7fe9dc0b6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:13:28.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.391+0000 7fe9d3fff700 1 --2- 172.21.15.84:0/774598154 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9dc0b5d90 0x7fe9dc0cd590 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe9c40098f0 tx=0x7fe9c4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3225697da3f94e0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:28.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.391+0000 7fe9da7fc700 1 -- 172.21.15.84:0/774598154 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c400b8a0 con 0x7fe9dc0b5d90 2023-07-14T11:13:28.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.391+0000 7fe9da7fc700 1 -- 172.21.15.84:0/774598154 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9c400ba00 con 0x7fe9dc0b5d90 2023-07-14T11:13:28.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.391+0000 7fe9da7fc700 1 -- 172.21.15.84:0/774598154 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c400bd90 con 0x7fe9dc0b5d90 2023-07-14T11:13:28.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.391+0000 7fe9e13ff700 1 -- 172.21.15.84:0/774598154 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9dc0b5d90 msgr2=0x7fe9dc0cd590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:28.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.391+0000 7fe9e13ff700 1 --2- 172.21.15.84:0/774598154 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9dc0b5d90 0x7fe9dc0cd590 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe9c40098f0 tx=0x7fe9c4009c00 comp rx=0 tx=0).stop 2023-07-14T11:13:28.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.391+0000 7fe9e13ff700 1 -- 172.21.15.84:0/774598154 shutdown_connections 2023-07-14T11:13:28.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.391+0000 7fe9e13ff700 1 --2- 172.21.15.84:0/774598154 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9dc0b4510 0x7fe9dc0b6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:28.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.391+0000 7fe9e13ff700 1 --2- 172.21.15.84:0/774598154 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9dc0b5d90 0x7fe9dc0cd590 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:28.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.391+0000 7fe9e13ff700 1 -- 172.21.15.84:0/774598154 >> 172.21.15.84:0/774598154 conn(0x7fe9dc09c1d0 msgr2=0x7fe9dc0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:28.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.391+0000 7fe9e13ff700 1 -- 172.21.15.84:0/774598154 shutdown_connections 2023-07-14T11:13:28.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.392+0000 7fe9e13ff700 1 -- 172.21.15.84:0/774598154 wait complete. 2023-07-14T11:13:28.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.393+0000 7fe9e13ff700 1 Processor -- start 2023-07-14T11:13:28.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.393+0000 7fe9e13ff700 1 -- start start 2023-07-14T11:13:28.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.394+0000 7fe9e13ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9dc0b4510 0x7fe9dc1f1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:28.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.394+0000 7fe9e13ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9dc0b5d90 0x7fe9dc0c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:28.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.394+0000 7fe9e13ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe9dc0d0b10 0x7fe9dc0c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:28.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.394+0000 7fe9e13ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9dc156900 con 0x7fe9dc0b4510 2023-07-14T11:13:28.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.394+0000 7fe9e13ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9dc0c9710 con 0x7fe9dc0d0b10 2023-07-14T11:13:28.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.394+0000 7fe9e13ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9dc156ba0 con 0x7fe9dc0b5d90 2023-07-14T11:13:28.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.394+0000 7fe9daffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9dc0b4510 0x7fe9dc1f1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:28.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.394+0000 7fe9daffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9dc0b4510 0x7fe9dc1f1ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34452/0 (socket says 172.21.15.84:34452) 2023-07-14T11:13:28.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.394+0000 7fe9daffd700 1 -- 172.21.15.84:0/2606266307 learned_addr learned my addr 172.21.15.84:0/2606266307 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:28.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.395+0000 7fe9d3fff700 1 --2- 172.21.15.84:0/2606266307 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9dc0b5d90 0x7fe9dc0c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:28.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.395+0000 7fe9db7fe700 1 --2- 172.21.15.84:0/2606266307 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe9dc0d0b10 0x7fe9dc0c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:28.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.395+0000 7fe9daffd700 1 -- 172.21.15.84:0/2606266307 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9dc0b5d90 msgr2=0x7fe9dc0c8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:28.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.395+0000 7fe9daffd700 1 --2- 172.21.15.84:0/2606266307 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9dc0b5d90 0x7fe9dc0c8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:28.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.395+0000 7fe9daffd700 1 -- 172.21.15.84:0/2606266307 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe9dc0d0b10 msgr2=0x7fe9dc0c8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:28.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.395+0000 7fe9daffd700 1 --2- 172.21.15.84:0/2606266307 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe9dc0d0b10 0x7fe9dc0c8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:28.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.395+0000 7fe9daffd700 1 -- 172.21.15.84:0/2606266307 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9c4009550 con 0x7fe9dc0b4510 2023-07-14T11:13:28.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.395+0000 7fe9db7fe700 1 --2- 172.21.15.84:0/2606266307 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe9dc0d0b10 0x7fe9dc0c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:13:28.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.395+0000 7fe9daffd700 1 --2- 172.21.15.84:0/2606266307 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9dc0b4510 0x7fe9dc1f1ec0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc00c7f0 tx=0x7fe9cc00cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:28.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.395+0000 7fe9d37fe700 1 -- 172.21.15.84:0/2606266307 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9cc005c20 con 0x7fe9dc0b4510 2023-07-14T11:13:28.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.395+0000 7fe9d37fe700 1 -- 172.21.15.84:0/2606266307 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9cc005d80 con 0x7fe9dc0b4510 2023-07-14T11:13:28.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.395+0000 7fe9d37fe700 1 -- 172.21.15.84:0/2606266307 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9cc011820 con 0x7fe9dc0b4510 2023-07-14T11:13:28.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.395+0000 7fe9e13ff700 1 -- 172.21.15.84:0/2606266307 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9dc156e80 con 0x7fe9dc0b4510 2023-07-14T11:13:28.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.396+0000 7fe9e13ff700 1 -- 172.21.15.84:0/2606266307 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9dc0c6fe0 con 0x7fe9dc0b4510 2023-07-14T11:13:28.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.397+0000 7fe9e13ff700 1 -- 172.21.15.84:0/2606266307 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9dc0c98d0 con 0x7fe9dc0b4510 2023-07-14T11:13:28.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.397+0000 7fe9d37fe700 1 -- 172.21.15.84:0/2606266307 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe9cc011980 con 0x7fe9dc0b4510 2023-07-14T11:13:28.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.398+0000 7fe9d37fe700 1 --2- 172.21.15.84:0/2606266307 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe9bc06ace0 0x7fe9bc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:28.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.398+0000 7fe9d37fe700 1 -- 172.21.15.84:0/2606266307 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe9cc089410 con 0x7fe9dc0b4510 2023-07-14T11:13:28.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.398+0000 7fe9d3fff700 1 --2- 172.21.15.84:0/2606266307 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe9bc06ace0 0x7fe9bc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:28.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.399+0000 7fe9d3fff700 1 --2- 172.21.15.84:0/2606266307 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe9bc06ace0 0x7fe9bc06d190 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe9c4009c40 tx=0x7fe9c4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:28.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.403+0000 7fe9d37fe700 1 -- 172.21.15.84:0/2606266307 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe9cc057e20 con 0x7fe9dc0b4510 2023-07-14T11:13:28.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.641+0000 7fe9e13ff700 1 -- 172.21.15.84:0/2606266307 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe9dc157010 con 0x7fe9dc0b4510 2023-07-14T11:13:28.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.642+0000 7fe9d37fe700 1 -- 172.21.15.84:0/2606266307 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4703 (secure 0 0 0) 0x7fe9cc0579b0 con 0x7fe9dc0b4510 2023-07-14T11:13:28.645 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:13:28.645 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4296,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/811241790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":811241790},{"type":"v1","addr":"172.21.15.84:6836","nonce":811241790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4299,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/729998896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":729998896},{"type":"v1","addr":"172.21.15.84:6837","nonce":729998896}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4305,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3512017231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3512017231},{"type":"v1","addr":"172.21.15.179:6834","nonce":3512017231}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T11:13:14.457746+0000","modified":"2023-07-14T11:13:18.001606+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4308},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4308":{"gid":4308,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/3903854892","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":3903854892},{"type":"v1","addr":"172.21.15.179:6835","nonce":3903854892}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-14T11:13:28.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.644+0000 7fe9e13ff700 1 -- 172.21.15.84:0/2606266307 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe9bc06ace0 msgr2=0x7fe9bc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:28.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.644+0000 7fe9e13ff700 1 --2- 172.21.15.84:0/2606266307 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe9bc06ace0 0x7fe9bc06d190 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe9c4009c40 tx=0x7fe9c4008030 comp rx=0 tx=0).stop 2023-07-14T11:13:28.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.644+0000 7fe9e13ff700 1 -- 172.21.15.84:0/2606266307 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9dc0b4510 msgr2=0x7fe9dc1f1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:28.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.644+0000 7fe9e13ff700 1 --2- 172.21.15.84:0/2606266307 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9dc0b4510 0x7fe9dc1f1ec0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc00c7f0 tx=0x7fe9cc00cbb0 comp rx=0 tx=0).stop 2023-07-14T11:13:28.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.645+0000 7fe9e13ff700 1 -- 172.21.15.84:0/2606266307 shutdown_connections 2023-07-14T11:13:28.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.645+0000 7fe9e13ff700 1 --2- 172.21.15.84:0/2606266307 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe9dc0d0b10 0x7fe9dc0c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:28.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.645+0000 7fe9e13ff700 1 --2- 172.21.15.84:0/2606266307 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9dc0b4510 0x7fe9dc1f1ec0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:28.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.645+0000 7fe9e13ff700 1 --2- 172.21.15.84:0/2606266307 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe9bc06ace0 0x7fe9bc06d190 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:28.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.645+0000 7fe9e13ff700 1 --2- 172.21.15.84:0/2606266307 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9dc0b5d90 0x7fe9dc0c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:28.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.645+0000 7fe9e13ff700 1 -- 172.21.15.84:0/2606266307 >> 172.21.15.84:0/2606266307 conn(0x7fe9dc09c1d0 msgr2=0x7fe9dc0b83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:28.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.645+0000 7fe9e13ff700 1 -- 172.21.15.84:0/2606266307 shutdown_connections 2023-07-14T11:13:28.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.645+0000 7fe9e13ff700 1 -- 172.21.15.84:0/2606266307 wait complete. 2023-07-14T11:13:28.649 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 8 2023-07-14T11:13:28.665 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:13:28.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.858+0000 7f50391ff700 1 Processor -- start 2023-07-14T11:13:28.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.858+0000 7f50391ff700 1 -- start start 2023-07-14T11:13:28.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.859+0000 7f50391ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f50340b1e00 0x7f50340b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:28.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.859+0000 7f50391ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50340d2ce0 con 0x7f50340d1220 2023-07-14T11:13:28.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.859+0000 7f50391ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50340b3350 con 0x7f503415c950 2023-07-14T11:13:28.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.859+0000 7f50391ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50340b3630 con 0x7f50340b1e00 2023-07-14T11:13:28.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.859+0000 7f503359e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f50340b1e00 0x7f50340b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:28.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.859+0000 7f503259c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f50340d1220 0x7f50340afac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51694/0 (socket says 172.21.15.84:51694) 2023-07-14T11:13:28.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.859+0000 7f503259c700 1 -- 172.21.15.84:0/1699401741 learned_addr learned my addr 172.21.15.84:0/1699401741 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:13:28.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.860+0000 7f503359e700 1 -- 172.21.15.84:0/1699401741 >> v1:172.21.15.179:6789/0 conn(0x7f503415c950 legacy=0x7f50340d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:28.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.860+0000 7f503359e700 1 -- 172.21.15.84:0/1699401741 >> v1:172.21.15.84:6789/0 conn(0x7f50340d1220 legacy=0x7f50340afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:28.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.860+0000 7f503359e700 1 -- 172.21.15.84:0/1699401741 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50340b3910 con 0x7f50340b1e00 2023-07-14T11:13:28.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.860+0000 7f5031d9b700 1 -- 172.21.15.84:0/1699401741 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1267323093 0 0) 0x7f50340d2ce0 con 0x7f50340d1220 2023-07-14T11:13:28.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.860+0000 7f503359e700 1 --2- 172.21.15.84:0/1699401741 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50340b1e00 0x7f50340b43f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f502c009d90 tx=0x7f502c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69b816fa42fa46f3 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:28.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.860+0000 7f5031d9b700 1 -- 172.21.15.84:0/1699401741 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502c00e070 con 0x7f50340b1e00 2023-07-14T11:13:28.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.860+0000 7f5031d9b700 1 -- 172.21.15.84:0/1699401741 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f502c00bbd0 con 0x7f50340b1e00 2023-07-14T11:13:28.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.860+0000 7f5031d9b700 1 -- 172.21.15.84:0/1699401741 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502c012430 con 0x7f50340b1e00 2023-07-14T11:13:28.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.861+0000 7f50391ff700 1 -- 172.21.15.84:0/1699401741 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50340b1e00 msgr2=0x7f50340b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:28.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.861+0000 7f50391ff700 1 --2- 172.21.15.84:0/1699401741 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50340b1e00 0x7f50340b43f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f502c009d90 tx=0x7f502c00b330 comp rx=0 tx=0).stop 2023-07-14T11:13:28.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.861+0000 7f50391ff700 1 -- 172.21.15.84:0/1699401741 shutdown_connections 2023-07-14T11:13:28.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.861+0000 7f50391ff700 1 --2- 172.21.15.84:0/1699401741 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50340b1e00 0x7f50340b43f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:28.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.861+0000 7f50391ff700 1 -- 172.21.15.84:0/1699401741 >> 172.21.15.84:0/1699401741 conn(0x7f503409c1d0 msgr2=0x7f50340d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:28.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.861+0000 7f50391ff700 1 -- 172.21.15.84:0/1699401741 shutdown_connections 2023-07-14T11:13:28.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.861+0000 7f50391ff700 1 -- 172.21.15.84:0/1699401741 wait complete. 2023-07-14T11:13:28.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.863+0000 7f50391ff700 1 Processor -- start 2023-07-14T11:13:28.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.863+0000 7f50391ff700 1 -- start start 2023-07-14T11:13:28.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.864+0000 7f50391ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50340b1e00 0x7f50340c8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:28.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.864+0000 7f50391ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50340d1220 0x7f50341f6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:28.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.864+0000 7f50391ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f503415c950 0x7f50340b7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:28.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.864+0000 7f50391ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50341f6740 con 0x7f503415c950 2023-07-14T11:13:28.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.864+0000 7f50391ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50340c8730 con 0x7f50340b1e00 2023-07-14T11:13:28.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.864+0000 7f50391ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50340c8a10 con 0x7f50340d1220 2023-07-14T11:13:28.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.864+0000 7f503359e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f503415c950 0x7f50340b7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:28.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.864+0000 7f503359e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f503415c950 0x7f50340b7330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53948/0 (socket says 172.21.15.84:53948) 2023-07-14T11:13:28.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.864+0000 7f503359e700 1 -- 172.21.15.84:0/3153860838 learned_addr learned my addr 172.21.15.84:0/3153860838 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:28.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.864+0000 7f5032d9d700 1 --2- 172.21.15.84:0/3153860838 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50340b1e00 0x7f50340c8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:28.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.864+0000 7f503259c700 1 --2- 172.21.15.84:0/3153860838 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50340d1220 0x7f50341f6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:28.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.864+0000 7f503359e700 1 -- 172.21.15.84:0/3153860838 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50340d1220 msgr2=0x7f50341f6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:28.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.864+0000 7f503359e700 1 --2- 172.21.15.84:0/3153860838 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50340d1220 0x7f50341f6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:28.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.864+0000 7f503359e700 1 -- 172.21.15.84:0/3153860838 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50340b1e00 msgr2=0x7f50340c8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:28.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.864+0000 7f503359e700 1 --2- 172.21.15.84:0/3153860838 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50340b1e00 0x7f50340c8150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:28.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.864+0000 7f503359e700 1 -- 172.21.15.84:0/3153860838 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f502c009a70 con 0x7f503415c950 2023-07-14T11:13:28.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.865+0000 7f503259c700 1 --2- 172.21.15.84:0/3153860838 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50340d1220 0x7f50341f6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:13:28.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.865+0000 7f503359e700 1 --2- 172.21.15.84:0/3153860838 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f503415c950 0x7f50340b7330 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f502c014040 tx=0x7f502c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:28.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.865+0000 7f501b7fe700 1 -- 172.21.15.84:0/3153860838 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502c01b810 con 0x7f503415c950 2023-07-14T11:13:28.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.865+0000 7f501b7fe700 1 -- 172.21.15.84:0/3153860838 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f502c020070 con 0x7f503415c950 2023-07-14T11:13:28.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.865+0000 7f501b7fe700 1 -- 172.21.15.84:0/3153860838 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502c01bbf0 con 0x7f503415c950 2023-07-14T11:13:28.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.865+0000 7f50391ff700 1 -- 172.21.15.84:0/3153860838 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50340c8cf0 con 0x7f503415c950 2023-07-14T11:13:28.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.865+0000 7f50391ff700 1 -- 172.21.15.84:0/3153860838 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50340c92b0 con 0x7f503415c950 2023-07-14T11:13:28.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.866+0000 7f50391ff700 1 -- 172.21.15.84:0/3153860838 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f503404e280 con 0x7f503415c950 2023-07-14T11:13:28.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.867+0000 7f501b7fe700 1 -- 172.21.15.84:0/3153860838 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f502c01bd50 con 0x7f503415c950 2023-07-14T11:13:28.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.868+0000 7f501b7fe700 1 --2- 172.21.15.84:0/3153860838 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f502006ace0 0x7f502006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:28.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.868+0000 7f501b7fe700 1 -- 172.21.15.84:0/3153860838 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f502c022070 con 0x7f503415c950 2023-07-14T11:13:28.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.868+0000 7f5032d9d700 1 --2- 172.21.15.84:0/3153860838 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f502006ace0 0x7f502006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:28.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.869+0000 7f5032d9d700 1 --2- 172.21.15.84:0/3153860838 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f502006ace0 0x7f502006d190 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5024000fb0 tx=0x7f5024009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:28.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:28.873+0000 7f501b7fe700 1 -- 172.21.15.84:0/3153860838 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f502c05a210 con 0x7f503415c950 2023-07-14T11:13:29.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.069+0000 7f50391ff700 1 -- 172.21.15.84:0/3153860838 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f503408c5a0 con 0x7f503415c950 2023-07-14T11:13:29.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.071+0000 7f501b7fe700 1 -- 172.21.15.84:0/3153860838 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18255 (secure 0 0 0) 0x7f502c059da0 con 0x7f503415c950 2023-07-14T11:13:29.074 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:13:29.074 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":23,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:13:15.989292+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-14T11:13:12.727811+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-14T11:13:13.436391+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:13:29.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.073+0000 7f50391ff700 1 -- 172.21.15.84:0/3153860838 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f502006ace0 msgr2=0x7f502006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:29.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.073+0000 7f50391ff700 1 --2- 172.21.15.84:0/3153860838 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f502006ace0 0x7f502006d190 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5024000fb0 tx=0x7f5024009040 comp rx=0 tx=0).stop 2023-07-14T11:13:29.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.073+0000 7f50391ff700 1 -- 172.21.15.84:0/3153860838 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f503415c950 msgr2=0x7f50340b7330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:29.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.073+0000 7f50391ff700 1 --2- 172.21.15.84:0/3153860838 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f503415c950 0x7f50340b7330 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f502c014040 tx=0x7f502c004ad0 comp rx=0 tx=0).stop 2023-07-14T11:13:29.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.073+0000 7f50391ff700 1 -- 172.21.15.84:0/3153860838 shutdown_connections 2023-07-14T11:13:29.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.073+0000 7f50391ff700 1 --2- 172.21.15.84:0/3153860838 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f503415c950 0x7f50340b7330 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:29.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.073+0000 7f50391ff700 1 --2- 172.21.15.84:0/3153860838 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50340b1e00 0x7f50340c8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:29.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.073+0000 7f50391ff700 1 --2- 172.21.15.84:0/3153860838 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f502006ace0 0x7f502006d190 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:29.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.073+0000 7f50391ff700 1 --2- 172.21.15.84:0/3153860838 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50340d1220 0x7f50341f6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:29.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.073+0000 7f50391ff700 1 -- 172.21.15.84:0/3153860838 >> 172.21.15.84:0/3153860838 conn(0x7f503409c1d0 msgr2=0x7f50340b15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:29.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.073+0000 7f50391ff700 1 -- 172.21.15.84:0/3153860838 shutdown_connections 2023-07-14T11:13:29.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.073+0000 7f50391ff700 1 -- 172.21.15.84:0/3153860838 wait complete. 2023-07-14T11:13:29.094 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T11:13:00.125395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T11:13:06.803994+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T11:13:12.727811+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T11:13:13.436391+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T11:13:29.094 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T11:13:29.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.291+0000 7f8ca57ff700 1 Processor -- start 2023-07-14T11:13:29.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.291+0000 7f8ca57ff700 1 -- start start 2023-07-14T11:13:29.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.293+0000 7f8ca57ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8ca00d0f90 0x7f8ca00b1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:29.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.293+0000 7f8ca57ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ca00b8e30 con 0x7f8ca00d0b10 2023-07-14T11:13:29.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.293+0000 7f8ca57ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ca00afaa0 con 0x7f8ca00b8a60 2023-07-14T11:13:29.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.293+0000 7f8ca57ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ca00afd80 con 0x7f8ca00d0f90 2023-07-14T11:13:29.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.293+0000 7f8c9f7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8ca00d0f90 0x7f8ca00b1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:29.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.293+0000 7f8c9f7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8ca00d0f90 0x7f8ca00b1530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53952/0 (socket says 172.21.15.84:53952) 2023-07-14T11:13:29.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.293+0000 7f8c9f7fe700 1 -- 172.21.15.84:0/3496243355 learned_addr learned my addr 172.21.15.84:0/3496243355 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:29.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.293+0000 7f8c97fff700 1 --1- 172.21.15.84:0/3496243355 >> v1:172.21.15.84:6789/0 conn(0x7f8ca00d0b10 0x7f8ca00b0e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51702/0 (socket says 172.21.15.84:51702) 2023-07-14T11:13:29.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.293+0000 7f8c9f7fe700 1 -- 172.21.15.84:0/3496243355 >> v1:172.21.15.179:6789/0 conn(0x7f8ca00b8a60 legacy=0x7f8ca00b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:29.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.293+0000 7f8c9f7fe700 1 -- 172.21.15.84:0/3496243355 >> v1:172.21.15.84:6789/0 conn(0x7f8ca00d0b10 legacy=0x7f8ca00b0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:29.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.293+0000 7f8c9f7fe700 1 -- 172.21.15.84:0/3496243355 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ca00b0060 con 0x7f8ca00d0f90 2023-07-14T11:13:29.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.293+0000 7f8c9f7fe700 1 --2- 172.21.15.84:0/3496243355 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ca00d0f90 0x7f8ca00b1530 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8c98009e50 tx=0x7f8c9800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a28a50c34351d548 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:29.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.294+0000 7f8c9e7fc700 1 -- 172.21.15.84:0/3496243355 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9800e070 con 0x7f8ca00d0f90 2023-07-14T11:13:29.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.294+0000 7f8c9e7fc700 1 -- 172.21.15.84:0/3496243355 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c9800b9c0 con 0x7f8ca00d0f90 2023-07-14T11:13:29.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.294+0000 7f8c9e7fc700 1 -- 172.21.15.84:0/3496243355 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9800bd70 con 0x7f8ca00d0f90 2023-07-14T11:13:29.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.294+0000 7f8ca57ff700 1 -- 172.21.15.84:0/3496243355 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ca00d0f90 msgr2=0x7f8ca00b1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:29.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.294+0000 7f8ca57ff700 1 --2- 172.21.15.84:0/3496243355 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ca00d0f90 0x7f8ca00b1530 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8c98009e50 tx=0x7f8c9800b330 comp rx=0 tx=0).stop 2023-07-14T11:13:29.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.294+0000 7f8ca57ff700 1 -- 172.21.15.84:0/3496243355 shutdown_connections 2023-07-14T11:13:29.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.294+0000 7f8ca57ff700 1 --2- 172.21.15.84:0/3496243355 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ca00d0f90 0x7f8ca00b1530 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:29.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.294+0000 7f8ca57ff700 1 -- 172.21.15.84:0/3496243355 >> 172.21.15.84:0/3496243355 conn(0x7f8ca009c1b0 msgr2=0x7f8ca00d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:29.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.294+0000 7f8ca57ff700 1 -- 172.21.15.84:0/3496243355 shutdown_connections 2023-07-14T11:13:29.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.295+0000 7f8ca57ff700 1 -- 172.21.15.84:0/3496243355 wait complete. 2023-07-14T11:13:29.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.296+0000 7f8ca57ff700 1 Processor -- start 2023-07-14T11:13:29.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.296+0000 7f8ca57ff700 1 -- start start 2023-07-14T11:13:29.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.297+0000 7f8ca57ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ca00b8a60 0x7f8ca01f5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:29.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.297+0000 7f8ca57ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ca00d0b10 0x7f8ca01f5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:29.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.297+0000 7f8ca57ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ca00d0f90 0x7f8ca00cf590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:29.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.297+0000 7f8ca57ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca00ca3b0 con 0x7f8ca00d0b10 2023-07-14T11:13:29.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.297+0000 7f8ca57ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca00cc370 con 0x7f8ca00b8a60 2023-07-14T11:13:29.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.297+0000 7f8ca57ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca00d0250 con 0x7f8ca00d0f90 2023-07-14T11:13:29.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.297+0000 7f8c97fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ca00d0b10 0x7f8ca01f5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:29.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.297+0000 7f8c97fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ca00d0b10 0x7f8ca01f5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53958/0 (socket says 172.21.15.84:53958) 2023-07-14T11:13:29.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.298+0000 7f8c97fff700 1 -- 172.21.15.84:0/3135762001 learned_addr learned my addr 172.21.15.84:0/3135762001 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:29.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.298+0000 7f8c9effd700 1 --2- 172.21.15.84:0/3135762001 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ca00b8a60 0x7f8ca01f5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:29.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.298+0000 7f8c9f7fe700 1 --2- 172.21.15.84:0/3135762001 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ca00d0f90 0x7f8ca00cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:29.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.298+0000 7f8c97fff700 1 -- 172.21.15.84:0/3135762001 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ca00d0f90 msgr2=0x7f8ca00cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:29.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.298+0000 7f8c97fff700 1 --2- 172.21.15.84:0/3135762001 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ca00d0f90 0x7f8ca00cf590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:29.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.298+0000 7f8c97fff700 1 -- 172.21.15.84:0/3135762001 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ca00b8a60 msgr2=0x7f8ca01f5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:29.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.298+0000 7f8c97fff700 1 --2- 172.21.15.84:0/3135762001 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ca00b8a60 0x7f8ca01f5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:29.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.298+0000 7f8c97fff700 1 -- 172.21.15.84:0/3135762001 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c98009b30 con 0x7f8ca00d0b10 2023-07-14T11:13:29.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.298+0000 7f8c9f7fe700 1 --2- 172.21.15.84:0/3135762001 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ca00d0f90 0x7f8ca00cf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:13:29.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.298+0000 7f8c9effd700 1 --2- 172.21.15.84:0/3135762001 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ca00b8a60 0x7f8ca01f5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:13:29.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.298+0000 7f8c97fff700 1 --2- 172.21.15.84:0/3135762001 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ca00d0b10 0x7f8ca01f5a70 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8c8800c520 tx=0x7f8c8800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:29.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.298+0000 7f8c977fe700 1 -- 172.21.15.84:0/3135762001 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c88005cb0 con 0x7f8ca00d0b10 2023-07-14T11:13:29.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.298+0000 7f8c977fe700 1 -- 172.21.15.84:0/3135762001 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c88005e10 con 0x7f8ca00d0b10 2023-07-14T11:13:29.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.298+0000 7f8ca57ff700 1 -- 172.21.15.84:0/3135762001 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ca00cc5c0 con 0x7f8ca00d0b10 2023-07-14T11:13:29.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.298+0000 7f8c977fe700 1 -- 172.21.15.84:0/3135762001 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c880072d0 con 0x7f8ca00d0b10 2023-07-14T11:13:29.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.299+0000 7f8ca57ff700 1 -- 172.21.15.84:0/3135762001 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ca00ccb80 con 0x7f8ca00d0b10 2023-07-14T11:13:29.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.299+0000 7f8ca57ff700 1 -- 172.21.15.84:0/3135762001 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ca0074350 con 0x7f8ca00d0b10 2023-07-14T11:13:29.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.300+0000 7f8c977fe700 1 -- 172.21.15.84:0/3135762001 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8c88007430 con 0x7f8ca00d0b10 2023-07-14T11:13:29.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.301+0000 7f8c977fe700 1 --2- 172.21.15.84:0/3135762001 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f8c8006ace0 0x7f8c8006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:29.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.301+0000 7f8c977fe700 1 -- 172.21.15.84:0/3135762001 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8c88088890 con 0x7f8ca00d0b10 2023-07-14T11:13:29.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.301+0000 7f8c9effd700 1 --2- 172.21.15.84:0/3135762001 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f8c8006ace0 0x7f8c8006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:29.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.302+0000 7f8c9effd700 1 --2- 172.21.15.84:0/3135762001 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f8c8006ace0 0x7f8c8006d190 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8c90000f60 tx=0x7f8c90009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:29.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.305+0000 7f8c977fe700 1 -- 172.21.15.84:0/3135762001 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f8c880539e0 con 0x7f8ca00d0b10 2023-07-14T11:13:29.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.502+0000 7f8ca57ff700 1 -- 172.21.15.84:0/3135762001 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8ca00ccd40 con 0x7f8ca00d0b10 2023-07-14T11:13:29.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.503+0000 7f8c977fe700 1 -- 172.21.15.84:0/3135762001 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8c88017020 con 0x7f8ca00d0b10 2023-07-14T11:13:29.506 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-07-14T11:13:29.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.505+0000 7f8ca57ff700 1 -- 172.21.15.84:0/3135762001 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f8c8006ace0 msgr2=0x7f8c8006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:29.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.505+0000 7f8ca57ff700 1 --2- 172.21.15.84:0/3135762001 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f8c8006ace0 0x7f8c8006d190 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8c90000f60 tx=0x7f8c90009040 comp rx=0 tx=0).stop 2023-07-14T11:13:29.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.505+0000 7f8ca57ff700 1 -- 172.21.15.84:0/3135762001 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ca00d0b10 msgr2=0x7f8ca01f5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:29.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.505+0000 7f8ca57ff700 1 --2- 172.21.15.84:0/3135762001 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ca00d0b10 0x7f8ca01f5a70 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8c8800c520 tx=0x7f8c8800c8e0 comp rx=0 tx=0).stop 2023-07-14T11:13:29.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.505+0000 7f8ca57ff700 1 -- 172.21.15.84:0/3135762001 shutdown_connections 2023-07-14T11:13:29.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.505+0000 7f8ca57ff700 1 --2- 172.21.15.84:0/3135762001 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f8c8006ace0 0x7f8c8006d190 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:29.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.505+0000 7f8ca57ff700 1 --2- 172.21.15.84:0/3135762001 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ca00d0f90 0x7f8ca00cf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:29.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.505+0000 7f8ca57ff700 1 --2- 172.21.15.84:0/3135762001 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ca00b8a60 0x7f8ca01f5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:29.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.505+0000 7f8ca57ff700 1 --2- 172.21.15.84:0/3135762001 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ca00d0b10 0x7f8ca01f5a70 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:29.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.505+0000 7f8ca57ff700 1 -- 172.21.15.84:0/3135762001 >> 172.21.15.84:0/3135762001 conn(0x7f8ca009c1b0 msgr2=0x7f8ca006ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:29.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.505+0000 7f8ca57ff700 1 -- 172.21.15.84:0/3135762001 shutdown_connections 2023-07-14T11:13:29.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.506+0000 7f8ca57ff700 1 -- 172.21.15.84:0/3135762001 wait complete. 2023-07-14T11:13:29.526 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T11:13:29.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.720+0000 7f2b911ff700 1 Processor -- start 2023-07-14T11:13:29.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.721+0000 7f2b911ff700 1 -- start start 2023-07-14T11:13:29.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.722+0000 7f2b911ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b8c0b8a60 0x7f2b8c0b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:29.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.722+0000 7f2b911ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2b8c0d1220 0x7f2b8c0b0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:29.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.722+0000 7f2b911ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b8c0b8e30 con 0x7f2b8c0b4530 2023-07-14T11:13:29.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.722+0000 7f2b911ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b8c0afaa0 con 0x7f2b8c0d1220 2023-07-14T11:13:29.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.722+0000 7f2b911ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8c0afd80 con 0x7f2b8c0b8a60 2023-07-14T11:13:29.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.722+0000 7f2b83fff700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f2b8c0b4530 0x7f2b8c0d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.84:43874/0 (socket says 172.21.15.84:43874) 2023-07-14T11:13:29.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.722+0000 7f2b83fff700 1 -- 172.21.15.84:0/3094768839 learned_addr learned my addr 172.21.15.84:0/3094768839 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:13:29.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.722+0000 7f2b8ad9d700 1 --2- 172.21.15.84:0/3094768839 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b8c0b8a60 0x7f2b8c0b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:29.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.722+0000 7f2b8b59e700 1 --2- 172.21.15.84:0/3094768839 >> v2:172.21.15.179:3300/0 conn(0x7f2b8c0d1220 0x7f2b8c0b0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:29.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.723+0000 7f2b8a59c700 1 -- 172.21.15.84:0/3094768839 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 347362194 0 0) 0x7f2b8c0b8e30 con 0x7f2b8c0b4530 2023-07-14T11:13:29.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.723+0000 7f2b8a59c700 1 -- 172.21.15.84:0/3094768839 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b780035b0 con 0x7f2b8c0b4530 2023-07-14T11:13:29.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.723+0000 7f2b8ad9d700 1 -- 172.21.15.84:0/3094768839 >> v2:172.21.15.179:3300/0 conn(0x7f2b8c0d1220 msgr2=0x7f2b8c0b0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:29.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.723+0000 7f2b8ad9d700 1 --2- 172.21.15.84:0/3094768839 >> v2:172.21.15.179:3300/0 conn(0x7f2b8c0d1220 0x7f2b8c0b0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:29.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.723+0000 7f2b8ad9d700 1 -- 172.21.15.84:0/3094768839 >> v1:172.21.15.179:6789/0 conn(0x7f2b8c0b4530 legacy=0x7f2b8c0d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:29.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.723+0000 7f2b8ad9d700 1 -- 172.21.15.84:0/3094768839 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b8c0b0060 con 0x7f2b8c0b8a60 2023-07-14T11:13:29.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.723+0000 7f2b8b59e700 1 --2- 172.21.15.84:0/3094768839 >> v2:172.21.15.179:3300/0 conn(0x7f2b8c0d1220 0x7f2b8c0b0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:13:29.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.723+0000 7f2b8ad9d700 1 --2- 172.21.15.84:0/3094768839 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b8c0b8a60 0x7f2b8c0b3ff0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c009840 tx=0x7f2b7c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75cf4fd5a3c9154d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:29.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.723+0000 7f2b8a59c700 1 -- 172.21.15.84:0/3094768839 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b7c011830 con 0x7f2b8c0b8a60 2023-07-14T11:13:29.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.723+0000 7f2b8a59c700 1 -- 172.21.15.84:0/3094768839 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b7c011990 con 0x7f2b8c0b8a60 2023-07-14T11:13:29.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.723+0000 7f2b8a59c700 1 -- 172.21.15.84:0/3094768839 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b7c011d20 con 0x7f2b8c0b8a60 2023-07-14T11:13:29.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.724+0000 7f2b911ff700 1 -- 172.21.15.84:0/3094768839 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b8c0b8a60 msgr2=0x7f2b8c0b3ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:29.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.724+0000 7f2b911ff700 1 --2- 172.21.15.84:0/3094768839 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b8c0b8a60 0x7f2b8c0b3ff0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c009840 tx=0x7f2b7c009b50 comp rx=0 tx=0).stop 2023-07-14T11:13:29.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.724+0000 7f2b911ff700 1 -- 172.21.15.84:0/3094768839 shutdown_connections 2023-07-14T11:13:29.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.724+0000 7f2b911ff700 1 --2- 172.21.15.84:0/3094768839 >> v2:172.21.15.179:3300/0 conn(0x7f2b8c0d1220 0x7f2b8c0b0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:29.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.724+0000 7f2b911ff700 1 --2- 172.21.15.84:0/3094768839 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b8c0b8a60 0x7f2b8c0b3ff0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:29.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.724+0000 7f2b911ff700 1 -- 172.21.15.84:0/3094768839 >> 172.21.15.84:0/3094768839 conn(0x7f2b8c09c1b0 msgr2=0x7f2b8c0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:29.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.724+0000 7f2b911ff700 1 -- 172.21.15.84:0/3094768839 shutdown_connections 2023-07-14T11:13:29.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.724+0000 7f2b911ff700 1 -- 172.21.15.84:0/3094768839 wait complete. 2023-07-14T11:13:29.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.726+0000 7f2b911ff700 1 Processor -- start 2023-07-14T11:13:29.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.726+0000 7f2b911ff700 1 -- start start 2023-07-14T11:13:29.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.727+0000 7f2b911ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b8c0b4530 0x7f2b8c152440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:29.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.727+0000 7f2b911ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b8c0b8a60 0x7f2b8c0cd550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:29.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.727+0000 7f2b911ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b8c0d1220 0x7f2b8c1f5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:29.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.727+0000 7f2b911ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8c0cf040 con 0x7f2b8c0d1220 2023-07-14T11:13:29.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.727+0000 7f2b911ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8c0cdfa0 con 0x7f2b8c0b4530 2023-07-14T11:13:29.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.727+0000 7f2b911ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8c0ce280 con 0x7f2b8c0b8a60 2023-07-14T11:13:29.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.727+0000 7f2b8b59e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b8c0d1220 0x7f2b8c1f5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:29.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.727+0000 7f2b8b59e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b8c0d1220 0x7f2b8c1f5760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53974/0 (socket says 172.21.15.84:53974) 2023-07-14T11:13:29.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.727+0000 7f2b8b59e700 1 -- 172.21.15.84:0/1432159713 learned_addr learned my addr 172.21.15.84:0/1432159713 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:29.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.727+0000 7f2b83fff700 1 --2- 172.21.15.84:0/1432159713 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b8c0b8a60 0x7f2b8c0cd550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:29.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.727+0000 7f2b8ad9d700 1 --2- 172.21.15.84:0/1432159713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b8c0b4530 0x7f2b8c152440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:29.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.728+0000 7f2b8b59e700 1 -- 172.21.15.84:0/1432159713 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b8c0b8a60 msgr2=0x7f2b8c0cd550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:29.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.728+0000 7f2b8b59e700 1 --2- 172.21.15.84:0/1432159713 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b8c0b8a60 0x7f2b8c0cd550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:29.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.728+0000 7f2b8b59e700 1 -- 172.21.15.84:0/1432159713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b8c0b4530 msgr2=0x7f2b8c152440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:29.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.728+0000 7f2b8b59e700 1 --2- 172.21.15.84:0/1432159713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b8c0b4530 0x7f2b8c152440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:29.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.728+0000 7f2b8b59e700 1 -- 172.21.15.84:0/1432159713 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b84009a70 con 0x7f2b8c0d1220 2023-07-14T11:13:29.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.728+0000 7f2b8b59e700 1 --2- 172.21.15.84:0/1432159713 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b8c0d1220 0x7f2b8c1f5760 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2b8400efc0 tx=0x7f2b8400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:29.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.728+0000 7f2b837fe700 1 -- 172.21.15.84:0/1432159713 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8400cc90 con 0x7f2b8c0d1220 2023-07-14T11:13:29.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.728+0000 7f2b837fe700 1 -- 172.21.15.84:0/1432159713 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b8400f040 con 0x7f2b8c0d1220 2023-07-14T11:13:29.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.728+0000 7f2b837fe700 1 -- 172.21.15.84:0/1432159713 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b840146c0 con 0x7f2b8c0d1220 2023-07-14T11:13:29.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.728+0000 7f2b911ff700 1 -- 172.21.15.84:0/1432159713 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b7c0094a0 con 0x7f2b8c0d1220 2023-07-14T11:13:29.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.728+0000 7f2b911ff700 1 -- 172.21.15.84:0/1432159713 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b8c0ce840 con 0x7f2b8c0d1220 2023-07-14T11:13:29.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.729+0000 7f2b911ff700 1 -- 172.21.15.84:0/1432159713 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b8c074350 con 0x7f2b8c0d1220 2023-07-14T11:13:29.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.730+0000 7f2b837fe700 1 -- 172.21.15.84:0/1432159713 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2b84014820 con 0x7f2b8c0d1220 2023-07-14T11:13:29.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.731+0000 7f2b837fe700 1 --2- 172.21.15.84:0/1432159713 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f2b6c06ace0 0x7f2b6c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:29.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.731+0000 7f2b837fe700 1 -- 172.21.15.84:0/1432159713 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2b8408a080 con 0x7f2b8c0d1220 2023-07-14T11:13:29.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.731+0000 7f2b8ad9d700 1 --2- 172.21.15.84:0/1432159713 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f2b6c06ace0 0x7f2b6c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:29.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.732+0000 7f2b8ad9d700 1 --2- 172.21.15.84:0/1432159713 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f2b6c06ace0 0x7f2b6c06d190 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c000c00 tx=0x7f2b7c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:29.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.736+0000 7f2b837fe700 1 -- 172.21.15.84:0/1432159713 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f2b840bc330 con 0x7f2b8c0d1220 2023-07-14T11:13:29.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.930+0000 7f2b911ff700 1 -- 172.21.15.84:0/1432159713 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2b8c0d23e0 con 0x7f2b8c0d1220 2023-07-14T11:13:29.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.930+0000 7f2b837fe700 1 -- 172.21.15.84:0/1432159713 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2b84055150 con 0x7f2b8c0d1220 2023-07-14T11:13:29.934 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-07-14T11:13:29.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.933+0000 7f2b911ff700 1 -- 172.21.15.84:0/1432159713 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f2b6c06ace0 msgr2=0x7f2b6c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:29.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.933+0000 7f2b911ff700 1 --2- 172.21.15.84:0/1432159713 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f2b6c06ace0 0x7f2b6c06d190 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c000c00 tx=0x7f2b7c008030 comp rx=0 tx=0).stop 2023-07-14T11:13:29.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.933+0000 7f2b911ff700 1 -- 172.21.15.84:0/1432159713 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b8c0d1220 msgr2=0x7f2b8c1f5760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:29.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.933+0000 7f2b911ff700 1 --2- 172.21.15.84:0/1432159713 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b8c0d1220 0x7f2b8c1f5760 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2b8400efc0 tx=0x7f2b8400c3a0 comp rx=0 tx=0).stop 2023-07-14T11:13:29.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.933+0000 7f2b911ff700 1 -- 172.21.15.84:0/1432159713 shutdown_connections 2023-07-14T11:13:29.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.933+0000 7f2b911ff700 1 --2- 172.21.15.84:0/1432159713 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b8c0d1220 0x7f2b8c1f5760 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:29.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.933+0000 7f2b911ff700 1 --2- 172.21.15.84:0/1432159713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b8c0b4530 0x7f2b8c152440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:29.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.933+0000 7f2b911ff700 1 --2- 172.21.15.84:0/1432159713 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f2b6c06ace0 0x7f2b6c06d190 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:29.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.933+0000 7f2b911ff700 1 --2- 172.21.15.84:0/1432159713 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b8c0b8a60 0x7f2b8c0cd550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:29.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.933+0000 7f2b911ff700 1 -- 172.21.15.84:0/1432159713 >> 172.21.15.84:0/1432159713 conn(0x7f2b8c09c1b0 msgr2=0x7f2b8c0d0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:29.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.933+0000 7f2b911ff700 1 -- 172.21.15.84:0/1432159713 shutdown_connections 2023-07-14T11:13:29.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:29.933+0000 7f2b911ff700 1 -- 172.21.15.84:0/1432159713 wait complete. 2023-07-14T11:13:29.954 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T11:13:30.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.152+0000 7fe34e7ff700 1 Processor -- start 2023-07-14T11:13:30.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.152+0000 7fe34e7ff700 1 -- start start 2023-07-14T11:13:30.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.154+0000 7fe34e7ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe3480ceb80 0x7fe3480cef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:30.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.154+0000 7fe34e7ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe3480cf490 0x7fe34815e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:30.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.154+0000 7fe34e7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe34815e630 0x7fe34815ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:30.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.154+0000 7fe34e7ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3480cc060 con 0x7fe3480cf490 2023-07-14T11:13:30.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.154+0000 7fe34e7ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3480cf970 con 0x7fe3480ceb80 2023-07-14T11:13:30.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.154+0000 7fe34e7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3480cfc50 con 0x7fe34815e630 2023-07-14T11:13:30.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.154+0000 7fe3477fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe3480cf490 0x7fe34815e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:30.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.154+0000 7fe3477fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe3480cf490 0x7fe34815e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53984/0 (socket says 172.21.15.84:53984) 2023-07-14T11:13:30.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.154+0000 7fe3477fe700 1 -- 172.21.15.84:0/2020375703 learned_addr learned my addr 172.21.15.84:0/2020375703 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:30.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.154+0000 7fe347fff700 1 --2- 172.21.15.84:0/2020375703 >> v2:172.21.15.179:3300/0 conn(0x7fe3480ceb80 0x7fe3480cef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:30.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.154+0000 7fe34cd9c700 1 --2- 172.21.15.84:0/2020375703 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe34815e630 0x7fe34815ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:30.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.154+0000 7fe3477fe700 1 -- 172.21.15.84:0/2020375703 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe34815e630 msgr2=0x7fe34815ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:30.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.154+0000 7fe3477fe700 1 --2- 172.21.15.84:0/2020375703 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe34815e630 0x7fe34815ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:30.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.154+0000 7fe3477fe700 1 -- 172.21.15.84:0/2020375703 >> v2:172.21.15.179:3300/0 conn(0x7fe3480ceb80 msgr2=0x7fe3480cef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:30.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.154+0000 7fe3477fe700 1 --2- 172.21.15.84:0/2020375703 >> v2:172.21.15.179:3300/0 conn(0x7fe3480ceb80 0x7fe3480cef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:30.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.154+0000 7fe3477fe700 1 -- 172.21.15.84:0/2020375703 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3480cff30 con 0x7fe3480cf490 2023-07-14T11:13:30.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.155+0000 7fe3477fe700 1 --2- 172.21.15.84:0/2020375703 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3480cf490 0x7fe34815e0f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe34806ea00 tx=0x7fe33c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcee74a862a36551 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:30.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.155+0000 7fe346ffd700 1 -- 172.21.15.84:0/2020375703 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe33c011830 con 0x7fe3480cf490 2023-07-14T11:13:30.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.155+0000 7fe346ffd700 1 -- 172.21.15.84:0/2020375703 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe33c011990 con 0x7fe3480cf490 2023-07-14T11:13:30.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.155+0000 7fe346ffd700 1 -- 172.21.15.84:0/2020375703 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe33c011d20 con 0x7fe3480cf490 2023-07-14T11:13:30.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.155+0000 7fe34e7ff700 1 -- 172.21.15.84:0/2020375703 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3480cf490 msgr2=0x7fe34815e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:30.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.155+0000 7fe34e7ff700 1 --2- 172.21.15.84:0/2020375703 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3480cf490 0x7fe34815e0f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe34806ea00 tx=0x7fe33c009bd0 comp rx=0 tx=0).stop 2023-07-14T11:13:30.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.155+0000 7fe34e7ff700 1 -- 172.21.15.84:0/2020375703 shutdown_connections 2023-07-14T11:13:30.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.155+0000 7fe34e7ff700 1 --2- 172.21.15.84:0/2020375703 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe34815e630 0x7fe34815ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:30.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.156+0000 7fe34e7ff700 1 --2- 172.21.15.84:0/2020375703 >> v2:172.21.15.179:3300/0 conn(0x7fe3480ceb80 0x7fe3480cef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:30.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.156+0000 7fe34e7ff700 1 --2- 172.21.15.84:0/2020375703 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3480cf490 0x7fe34815e0f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:30.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.156+0000 7fe34e7ff700 1 -- 172.21.15.84:0/2020375703 >> 172.21.15.84:0/2020375703 conn(0x7fe34806d980 msgr2=0x7fe34806dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:30.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.156+0000 7fe34e7ff700 1 -- 172.21.15.84:0/2020375703 shutdown_connections 2023-07-14T11:13:30.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.156+0000 7fe34e7ff700 1 -- 172.21.15.84:0/2020375703 wait complete. 2023-07-14T11:13:30.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.158+0000 7fe34e7ff700 1 Processor -- start 2023-07-14T11:13:30.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.158+0000 7fe34e7ff700 1 -- start start 2023-07-14T11:13:30.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.159+0000 7fe34e7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3480ceb80 0x7fe3480c8690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:30.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.159+0000 7fe34e7ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3480cf490 0x7fe3480c59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:30.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.159+0000 7fe34e7ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe34815e630 0x7fe348159dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:30.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.159+0000 7fe34e7ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3480c65e0 con 0x7fe3480cf490 2023-07-14T11:13:30.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.159+0000 7fe34e7ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3480c6c40 con 0x7fe34815e630 2023-07-14T11:13:30.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.159+0000 7fe34e7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3480b3c10 con 0x7fe3480ceb80 2023-07-14T11:13:30.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.159+0000 7fe3477fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3480cf490 0x7fe3480c59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:30.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.160+0000 7fe3477fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3480cf490 0x7fe3480c59a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53998/0 (socket says 172.21.15.84:53998) 2023-07-14T11:13:30.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.160+0000 7fe3477fe700 1 -- 172.21.15.84:0/3765646493 learned_addr learned my addr 172.21.15.84:0/3765646493 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:30.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.160+0000 7fe34cd9c700 1 --2- 172.21.15.84:0/3765646493 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe34815e630 0x7fe348159dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:30.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.160+0000 7fe347fff700 1 --2- 172.21.15.84:0/3765646493 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3480ceb80 0x7fe3480c8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:30.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.160+0000 7fe3477fe700 1 -- 172.21.15.84:0/3765646493 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3480ceb80 msgr2=0x7fe3480c8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:30.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.160+0000 7fe3477fe700 1 --2- 172.21.15.84:0/3765646493 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3480ceb80 0x7fe3480c8690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:30.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.160+0000 7fe3477fe700 1 -- 172.21.15.84:0/3765646493 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe34815e630 msgr2=0x7fe348159dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:30.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.160+0000 7fe3477fe700 1 --2- 172.21.15.84:0/3765646493 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe34815e630 0x7fe348159dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:30.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.160+0000 7fe3477fe700 1 -- 172.21.15.84:0/3765646493 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe33c009550 con 0x7fe3480cf490 2023-07-14T11:13:30.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.160+0000 7fe3477fe700 1 --2- 172.21.15.84:0/3765646493 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3480cf490 0x7fe3480c59a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe33c009c10 tx=0x7fe33c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:30.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.160+0000 7fe344ff9700 1 -- 172.21.15.84:0/3765646493 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe33c004300 con 0x7fe3480cf490 2023-07-14T11:13:30.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.160+0000 7fe344ff9700 1 -- 172.21.15.84:0/3765646493 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe33c01f070 con 0x7fe3480cf490 2023-07-14T11:13:30.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.160+0000 7fe344ff9700 1 -- 172.21.15.84:0/3765646493 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe33c0036a0 con 0x7fe3480cf490 2023-07-14T11:13:30.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.161+0000 7fe34e7ff700 1 -- 172.21.15.84:0/3765646493 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3480c69f0 con 0x7fe3480cf490 2023-07-14T11:13:30.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.161+0000 7fe34e7ff700 1 -- 172.21.15.84:0/3765646493 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3480caa60 con 0x7fe3480cf490 2023-07-14T11:13:30.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.162+0000 7fe34e7ff700 1 -- 172.21.15.84:0/3765646493 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3480b3dc0 con 0x7fe3480cf490 2023-07-14T11:13:30.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.163+0000 7fe344ff9700 1 -- 172.21.15.84:0/3765646493 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe33c021030 con 0x7fe3480cf490 2023-07-14T11:13:30.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.164+0000 7fe344ff9700 1 --2- 172.21.15.84:0/3765646493 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe33406ace0 0x7fe33406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:30.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.164+0000 7fe344ff9700 1 -- 172.21.15.84:0/3765646493 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe33c08a780 con 0x7fe3480cf490 2023-07-14T11:13:30.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.164+0000 7fe347fff700 1 --2- 172.21.15.84:0/3765646493 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe33406ace0 0x7fe33406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:30.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.164+0000 7fe347fff700 1 --2- 172.21.15.84:0/3765646493 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe33406ace0 0x7fe33406d190 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe3480b2490 tx=0x7fe338008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:30.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.168+0000 7fe344ff9700 1 -- 172.21.15.84:0/3765646493 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe33c055940 con 0x7fe3480cf490 2023-07-14T11:13:30.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.365+0000 7fe34e7ff700 1 -- 172.21.15.84:0/3765646493 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe348074350 con 0x7fe3480cf490 2023-07-14T11:13:30.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.365+0000 7fe344ff9700 1 -- 172.21.15.84:0/3765646493 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe33c058f60 con 0x7fe3480cf490 2023-07-14T11:13:30.369 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-07-14T11:13:30.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.368+0000 7fe34e7ff700 1 -- 172.21.15.84:0/3765646493 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe33406ace0 msgr2=0x7fe33406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:30.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.368+0000 7fe34e7ff700 1 --2- 172.21.15.84:0/3765646493 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe33406ace0 0x7fe33406d190 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe3480b2490 tx=0x7fe338008040 comp rx=0 tx=0).stop 2023-07-14T11:13:30.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.368+0000 7fe34e7ff700 1 -- 172.21.15.84:0/3765646493 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3480cf490 msgr2=0x7fe3480c59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:30.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.368+0000 7fe34e7ff700 1 --2- 172.21.15.84:0/3765646493 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3480cf490 0x7fe3480c59a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe33c009c10 tx=0x7fe33c004750 comp rx=0 tx=0).stop 2023-07-14T11:13:30.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.368+0000 7fe34e7ff700 1 -- 172.21.15.84:0/3765646493 shutdown_connections 2023-07-14T11:13:30.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.368+0000 7fe34e7ff700 1 --2- 172.21.15.84:0/3765646493 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe33406ace0 0x7fe33406d190 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:30.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.368+0000 7fe34e7ff700 1 --2- 172.21.15.84:0/3765646493 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3480ceb80 0x7fe3480c8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:30.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.368+0000 7fe34e7ff700 1 --2- 172.21.15.84:0/3765646493 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe34815e630 0x7fe348159dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:30.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.368+0000 7fe34e7ff700 1 --2- 172.21.15.84:0/3765646493 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3480cf490 0x7fe3480c59a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:30.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.368+0000 7fe34e7ff700 1 -- 172.21.15.84:0/3765646493 >> 172.21.15.84:0/3765646493 conn(0x7fe34806d980 msgr2=0x7fe3480b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:30.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.368+0000 7fe34e7ff700 1 -- 172.21.15.84:0/3765646493 shutdown_connections 2023-07-14T11:13:30.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.368+0000 7fe34e7ff700 1 -- 172.21.15.84:0/3765646493 wait complete. 2023-07-14T11:13:30.389 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T11:13:30.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.583+0000 7f90e959d700 1 Processor -- start 2023-07-14T11:13:30.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.583+0000 7f90e959d700 1 -- start start 2023-07-14T11:13:30.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.584+0000 7f90e959d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f90e40cd9c0 0x7f90e40b1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:30.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.584+0000 7f90e959d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90e40b1dc0 0x7f90e40d0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:30.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.584+0000 7f90e959d700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90e4160460 con 0x7f90e415c870 2023-07-14T11:13:30.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.584+0000 7f90e959d700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90e41611e0 con 0x7f90e40cd9c0 2023-07-14T11:13:30.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.584+0000 7f90e959d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90e415cc40 con 0x7f90e40b1dc0 2023-07-14T11:13:30.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.584+0000 7f90e37fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f90e40cd9c0 0x7f90e40b1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:30.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.584+0000 7f90e3fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f90e415c870 0x7f90e40cd2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51718/0 (socket says 172.21.15.84:51718) 2023-07-14T11:13:30.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.584+0000 7f90e3fff700 1 -- 172.21.15.84:0/648322603 learned_addr learned my addr 172.21.15.84:0/648322603 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:13:30.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.585+0000 7f90e37fe700 1 -- 172.21.15.84:0/648322603 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90e40b1dc0 msgr2=0x7f90e40d0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:30.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.585+0000 7f90e8d9c700 1 --2- 172.21.15.84:0/648322603 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90e40b1dc0 0x7f90e40d0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:30.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.585+0000 7f90e37fe700 1 --2- 172.21.15.84:0/648322603 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90e40b1dc0 0x7f90e40d0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:30.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.585+0000 7f90e37fe700 1 -- 172.21.15.84:0/648322603 >> v1:172.21.15.84:6789/0 conn(0x7f90e415c870 legacy=0x7f90e40cd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:30.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.585+0000 7f90e2ffd700 1 -- 172.21.15.84:0/648322603 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2977897854 0 0) 0x7f90e4160460 con 0x7f90e415c870 2023-07-14T11:13:30.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.585+0000 7f90e37fe700 1 -- 172.21.15.84:0/648322603 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e4160700 con 0x7f90e40cd9c0 2023-07-14T11:13:30.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.585+0000 7f90e8d9c700 1 --2- 172.21.15.84:0/648322603 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90e40b1dc0 0x7f90e40d0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:13:30.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.585+0000 7f90e37fe700 1 --2- 172.21.15.84:0/648322603 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90e40cd9c0 0x7f90e40b1880 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f90d8009870 tx=0x7f90d8009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b896aae9f505f02c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:30.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.585+0000 7f90e2ffd700 1 -- 172.21.15.84:0/648322603 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d8011830 con 0x7f90e40cd9c0 2023-07-14T11:13:30.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.585+0000 7f90e2ffd700 1 -- 172.21.15.84:0/648322603 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90d8011990 con 0x7f90e40cd9c0 2023-07-14T11:13:30.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.585+0000 7f90e2ffd700 1 -- 172.21.15.84:0/648322603 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d8011d20 con 0x7f90e40cd9c0 2023-07-14T11:13:30.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.586+0000 7f90e959d700 1 -- 172.21.15.84:0/648322603 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90e40cd9c0 msgr2=0x7f90e40b1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:30.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.586+0000 7f90e959d700 1 --2- 172.21.15.84:0/648322603 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90e40cd9c0 0x7f90e40b1880 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f90d8009870 tx=0x7f90d8009b80 comp rx=0 tx=0).stop 2023-07-14T11:13:30.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.586+0000 7f90e959d700 1 -- 172.21.15.84:0/648322603 shutdown_connections 2023-07-14T11:13:30.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.586+0000 7f90e959d700 1 --2- 172.21.15.84:0/648322603 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90e40b1dc0 0x7f90e40d0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:30.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.586+0000 7f90e959d700 1 --2- 172.21.15.84:0/648322603 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90e40cd9c0 0x7f90e40b1880 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:30.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.586+0000 7f90e959d700 1 -- 172.21.15.84:0/648322603 >> 172.21.15.84:0/648322603 conn(0x7f90e406a520 msgr2=0x7f90e406a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:30.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.586+0000 7f90e959d700 1 -- 172.21.15.84:0/648322603 shutdown_connections 2023-07-14T11:13:30.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.586+0000 7f90e959d700 1 -- 172.21.15.84:0/648322603 wait complete. 2023-07-14T11:13:30.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.588+0000 7f90e959d700 1 Processor -- start 2023-07-14T11:13:30.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.588+0000 7f90e959d700 1 -- start start 2023-07-14T11:13:30.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.589+0000 7f90e959d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90e40b1dc0 0x7f90e41f6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:30.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.589+0000 7f90e959d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90e40cd9c0 0x7f90e40c6f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:30.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.589+0000 7f90e959d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90e415c870 0x7f90e41f5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:30.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.589+0000 7f90e959d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90e41f6fe0 con 0x7f90e40b1dc0 2023-07-14T11:13:30.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.589+0000 7f90e959d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90e40c74a0 con 0x7f90e40cd9c0 2023-07-14T11:13:30.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.589+0000 7f90e959d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90e40b4570 con 0x7f90e415c870 2023-07-14T11:13:30.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.589+0000 7f90e3fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90e40b1dc0 0x7f90e41f6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:30.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.589+0000 7f90e3fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90e40b1dc0 0x7f90e41f6aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54014/0 (socket says 172.21.15.84:54014) 2023-07-14T11:13:30.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.589+0000 7f90e3fff700 1 -- 172.21.15.84:0/3477654990 learned_addr learned my addr 172.21.15.84:0/3477654990 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:30.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.589+0000 7f90e3fff700 1 -- 172.21.15.84:0/3477654990 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90e415c870 msgr2=0x7f90e41f5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:30.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.589+0000 7f90e3fff700 1 --2- 172.21.15.84:0/3477654990 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90e415c870 0x7f90e41f5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:30.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.589+0000 7f90e3fff700 1 -- 172.21.15.84:0/3477654990 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90e40cd9c0 msgr2=0x7f90e40c6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:30.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.589+0000 7f90e3fff700 1 --2- 172.21.15.84:0/3477654990 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90e40cd9c0 0x7f90e40c6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:30.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.589+0000 7f90e3fff700 1 -- 172.21.15.84:0/3477654990 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d80094a0 con 0x7f90e40b1dc0 2023-07-14T11:13:30.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.589+0000 7f90e3fff700 1 --2- 172.21.15.84:0/3477654990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90e40b1dc0 0x7f90e41f6aa0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f90d400c550 tx=0x7f90d400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:30.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.590+0000 7f90e0ff9700 1 -- 172.21.15.84:0/3477654990 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d4004c80 con 0x7f90e40b1dc0 2023-07-14T11:13:30.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.590+0000 7f90e0ff9700 1 -- 172.21.15.84:0/3477654990 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90d4004e00 con 0x7f90e40b1dc0 2023-07-14T11:13:30.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.590+0000 7f90e0ff9700 1 -- 172.21.15.84:0/3477654990 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d4007310 con 0x7f90e40b1dc0 2023-07-14T11:13:30.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.590+0000 7f90e959d700 1 -- 172.21.15.84:0/3477654990 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90e41f9a40 con 0x7f90e40b1dc0 2023-07-14T11:13:30.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.590+0000 7f90e959d700 1 -- 172.21.15.84:0/3477654990 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90e41fa000 con 0x7f90e40b1dc0 2023-07-14T11:13:30.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.591+0000 7f90e959d700 1 -- 172.21.15.84:0/3477654990 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90e40b46e0 con 0x7f90e40b1dc0 2023-07-14T11:13:30.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.592+0000 7f90e0ff9700 1 -- 172.21.15.84:0/3477654990 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f90d4007470 con 0x7f90e40b1dc0 2023-07-14T11:13:30.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.593+0000 7f90e0ff9700 1 --2- 172.21.15.84:0/3477654990 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f90d006ace0 0x7f90d006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:30.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.593+0000 7f90e0ff9700 1 -- 172.21.15.84:0/3477654990 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f90d4089160 con 0x7f90e40b1dc0 2023-07-14T11:13:30.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.593+0000 7f90e37fe700 1 --2- 172.21.15.84:0/3477654990 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f90d006ace0 0x7f90d006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:30.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.594+0000 7f90e37fe700 1 --2- 172.21.15.84:0/3477654990 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f90d006ace0 0x7f90d006d190 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f90e40cddb0 tx=0x7f90d8010000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:30.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.597+0000 7f90e0ff9700 1 -- 172.21.15.84:0/3477654990 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f90d4054200 con 0x7f90e40b1dc0 2023-07-14T11:13:30.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.789+0000 7f90e959d700 1 -- 172.21.15.84:0/3477654990 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f90e4067350 con 0x7f90e40b1dc0 2023-07-14T11:13:30.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.790+0000 7f90e0ff9700 1 -- 172.21.15.84:0/3477654990 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f90d4057820 con 0x7f90e40b1dc0 2023-07-14T11:13:30.793 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-07-14T11:13:30.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.792+0000 7f90e959d700 1 -- 172.21.15.84:0/3477654990 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f90d006ace0 msgr2=0x7f90d006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:30.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.792+0000 7f90e959d700 1 --2- 172.21.15.84:0/3477654990 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f90d006ace0 0x7f90d006d190 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f90e40cddb0 tx=0x7f90d8010000 comp rx=0 tx=0).stop 2023-07-14T11:13:30.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.792+0000 7f90e959d700 1 -- 172.21.15.84:0/3477654990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90e40b1dc0 msgr2=0x7f90e41f6aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:30.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.792+0000 7f90e959d700 1 --2- 172.21.15.84:0/3477654990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90e40b1dc0 0x7f90e41f6aa0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f90d400c550 tx=0x7f90d400c910 comp rx=0 tx=0).stop 2023-07-14T11:13:30.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.792+0000 7f90e959d700 1 -- 172.21.15.84:0/3477654990 shutdown_connections 2023-07-14T11:13:30.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.792+0000 7f90e959d700 1 --2- 172.21.15.84:0/3477654990 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f90d006ace0 0x7f90d006d190 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:30.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.792+0000 7f90e959d700 1 --2- 172.21.15.84:0/3477654990 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90e415c870 0x7f90e41f5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:30.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.792+0000 7f90e959d700 1 --2- 172.21.15.84:0/3477654990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90e40b1dc0 0x7f90e41f6aa0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:30.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.792+0000 7f90e959d700 1 --2- 172.21.15.84:0/3477654990 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90e40cd9c0 0x7f90e40c6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:30.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.792+0000 7f90e959d700 1 -- 172.21.15.84:0/3477654990 >> 172.21.15.84:0/3477654990 conn(0x7f90e406a520 msgr2=0x7f90e4158900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:30.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.792+0000 7f90e959d700 1 -- 172.21.15.84:0/3477654990 shutdown_connections 2023-07-14T11:13:30.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:30.792+0000 7f90e959d700 1 -- 172.21.15.84:0/3477654990 wait complete. 2023-07-14T11:13:30.813 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T11:13:31.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.006+0000 7f27c41ff700 1 Processor -- start 2023-07-14T11:13:31.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.006+0000 7f27c41ff700 1 -- start start 2023-07-14T11:13:31.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.007+0000 7f27c41ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27bc0cfc60 0x7f27bc160860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:31.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.007+0000 7f27c41ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f27bc06ae40 0x7f27bc0d0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:31.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.007+0000 7f27c41ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27bc0cd4e0 con 0x7f27bc0b87d0 2023-07-14T11:13:31.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.007+0000 7f27c41ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27bc0cdcf0 con 0x7f27bc06ae40 2023-07-14T11:13:31.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.007+0000 7f27c41ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27bc0d00d0 con 0x7f27bc0cfc60 2023-07-14T11:13:31.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.008+0000 7f27c179a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27bc0cfc60 0x7f27bc160860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:31.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.008+0000 7f27c1f9b700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f27bc0b87d0 0x7f27bc160150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.84:43890/0 (socket says 172.21.15.84:43890) 2023-07-14T11:13:31.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.008+0000 7f27c1f9b700 1 -- 172.21.15.84:0/441443740 learned_addr learned my addr 172.21.15.84:0/441443740 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:13:31.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.008+0000 7f27c279c700 1 --2- 172.21.15.84:0/441443740 >> v2:172.21.15.179:3300/0 conn(0x7f27bc06ae40 0x7f27bc0d0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:31.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.008+0000 7f27c0f99700 1 -- 172.21.15.84:0/441443740 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3417563368 0 0) 0x7f27bc0cd4e0 con 0x7f27bc0b87d0 2023-07-14T11:13:31.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.008+0000 7f27c179a700 1 -- 172.21.15.84:0/441443740 >> v2:172.21.15.179:3300/0 conn(0x7f27bc06ae40 msgr2=0x7f27bc0d0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:31.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.008+0000 7f27c179a700 1 --2- 172.21.15.84:0/441443740 >> v2:172.21.15.179:3300/0 conn(0x7f27bc06ae40 0x7f27bc0d0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:31.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.008+0000 7f27c179a700 1 -- 172.21.15.84:0/441443740 >> v1:172.21.15.179:6789/0 conn(0x7f27bc0b87d0 legacy=0x7f27bc160150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:31.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.008+0000 7f27c179a700 1 -- 172.21.15.84:0/441443740 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27bc0cd730 con 0x7f27bc0cfc60 2023-07-14T11:13:31.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.008+0000 7f27c179a700 1 --2- 172.21.15.84:0/441443740 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27bc0cfc60 0x7f27bc160860 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f27ac009840 tx=0x7f27ac009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e92e57e01e73807 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:31.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.009+0000 7f27c0f99700 1 -- 172.21.15.84:0/441443740 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ac011830 con 0x7f27bc0cfc60 2023-07-14T11:13:31.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.009+0000 7f27c0f99700 1 -- 172.21.15.84:0/441443740 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27ac011990 con 0x7f27bc0cfc60 2023-07-14T11:13:31.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.009+0000 7f27c0f99700 1 -- 172.21.15.84:0/441443740 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ac011d20 con 0x7f27bc0cfc60 2023-07-14T11:13:31.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.009+0000 7f27c41ff700 1 -- 172.21.15.84:0/441443740 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27bc0cfc60 msgr2=0x7f27bc160860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:31.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.009+0000 7f27c41ff700 1 --2- 172.21.15.84:0/441443740 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27bc0cfc60 0x7f27bc160860 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f27ac009840 tx=0x7f27ac009b50 comp rx=0 tx=0).stop 2023-07-14T11:13:31.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.009+0000 7f27c41ff700 1 -- 172.21.15.84:0/441443740 shutdown_connections 2023-07-14T11:13:31.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.009+0000 7f27c41ff700 1 --2- 172.21.15.84:0/441443740 >> v2:172.21.15.179:3300/0 conn(0x7f27bc06ae40 0x7f27bc0d0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:31.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.009+0000 7f27c41ff700 1 --2- 172.21.15.84:0/441443740 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27bc0cfc60 0x7f27bc160860 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:31.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.009+0000 7f27c41ff700 1 -- 172.21.15.84:0/441443740 >> 172.21.15.84:0/441443740 conn(0x7f27bc06c140 msgr2=0x7f27bc06c510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:31.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.009+0000 7f27c41ff700 1 -- 172.21.15.84:0/441443740 shutdown_connections 2023-07-14T11:13:31.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.009+0000 7f27c41ff700 1 -- 172.21.15.84:0/441443740 wait complete. 2023-07-14T11:13:31.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.012+0000 7f27c41ff700 1 Processor -- start 2023-07-14T11:13:31.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.012+0000 7f27c41ff700 1 -- start start 2023-07-14T11:13:31.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.013+0000 7f27c41ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27bc0b87d0 0x7f27bc070c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:31.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.013+0000 7f27c41ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27bc0cfc60 0x7f27bc06e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:31.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.013+0000 7f27c41ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f27bc0701e0 0x7f27bc0c9570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:31.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.013+0000 7f27c41ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27bc06ef10 con 0x7f27bc0b87d0 2023-07-14T11:13:31.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.013+0000 7f27c41ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27bc06f140 con 0x7f27bc0701e0 2023-07-14T11:13:31.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.013+0000 7f27c41ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27bc06f420 con 0x7f27bc0cfc60 2023-07-14T11:13:31.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.013+0000 7f27c1f9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27bc0b87d0 0x7f27bc070c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:31.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.013+0000 7f27c1f9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27bc0b87d0 0x7f27bc070c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54024/0 (socket says 172.21.15.84:54024) 2023-07-14T11:13:31.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.013+0000 7f27c1f9b700 1 -- 172.21.15.84:0/1895089542 learned_addr learned my addr 172.21.15.84:0/1895089542 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:31.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.013+0000 7f27c179a700 1 --2- 172.21.15.84:0/1895089542 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27bc0cfc60 0x7f27bc06e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:31.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.014+0000 7f27c279c700 1 --2- 172.21.15.84:0/1895089542 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f27bc0701e0 0x7f27bc0c9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:31.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.014+0000 7f27c1f9b700 1 -- 172.21.15.84:0/1895089542 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27bc0cfc60 msgr2=0x7f27bc06e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:31.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.014+0000 7f27c1f9b700 1 --2- 172.21.15.84:0/1895089542 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27bc0cfc60 0x7f27bc06e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:31.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.014+0000 7f27c1f9b700 1 -- 172.21.15.84:0/1895089542 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f27bc0701e0 msgr2=0x7f27bc0c9570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:31.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.014+0000 7f27c1f9b700 1 --2- 172.21.15.84:0/1895089542 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f27bc0701e0 0x7f27bc0c9570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:31.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.014+0000 7f27c1f9b700 1 -- 172.21.15.84:0/1895089542 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27ac0094a0 con 0x7f27bc0b87d0 2023-07-14T11:13:31.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.014+0000 7f27c179a700 1 --2- 172.21.15.84:0/1895089542 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27bc0cfc60 0x7f27bc06e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:13:31.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.014+0000 7f27c1f9b700 1 --2- 172.21.15.84:0/1895089542 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27bc0b87d0 0x7f27bc070c30 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f27b80011e0 tx=0x7f27b800ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:31.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.014+0000 7f27b27fc700 1 -- 172.21.15.84:0/1895089542 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b8004c80 con 0x7f27bc0b87d0 2023-07-14T11:13:31.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.014+0000 7f27b27fc700 1 -- 172.21.15.84:0/1895089542 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27b8004e00 con 0x7f27bc0b87d0 2023-07-14T11:13:31.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.014+0000 7f27c41ff700 1 -- 172.21.15.84:0/1895089542 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27bc06f700 con 0x7f27bc0b87d0 2023-07-14T11:13:31.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.014+0000 7f27b27fc700 1 -- 172.21.15.84:0/1895089542 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b8007310 con 0x7f27bc0b87d0 2023-07-14T11:13:31.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.015+0000 7f27c41ff700 1 -- 172.21.15.84:0/1895089542 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27bc06fcc0 con 0x7f27bc0b87d0 2023-07-14T11:13:31.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.016+0000 7f27c41ff700 1 -- 172.21.15.84:0/1895089542 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27bc06feb0 con 0x7f27bc0b87d0 2023-07-14T11:13:31.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.017+0000 7f27b27fc700 1 -- 172.21.15.84:0/1895089542 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f27b8007470 con 0x7f27bc0b87d0 2023-07-14T11:13:31.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.018+0000 7f27b27fc700 1 --2- 172.21.15.84:0/1895089542 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f27a006ace0 0x7f27a006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:31.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.018+0000 7f27b27fc700 1 -- 172.21.15.84:0/1895089542 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f27b8089150 con 0x7f27bc0b87d0 2023-07-14T11:13:31.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.018+0000 7f27c179a700 1 --2- 172.21.15.84:0/1895089542 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f27a006ace0 0x7f27a006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:31.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.018+0000 7f27c179a700 1 --2- 172.21.15.84:0/1895089542 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f27a006ace0 0x7f27a006d190 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f27ac0090b0 tx=0x7f27ac008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:31.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.022+0000 7f27b27fc700 1 -- 172.21.15.84:0/1895089542 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f27b8054160 con 0x7f27bc0b87d0 2023-07-14T11:13:31.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.262+0000 7f27c41ff700 1 -- 172.21.15.84:0/1895089542 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f27bc04e280 con 0x7f27bc0b87d0 2023-07-14T11:13:31.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.262+0000 7f27b27fc700 1 -- 172.21.15.84:0/1895089542 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4703 (secure 0 0 0) 0x7f27b8057780 con 0x7f27bc0b87d0 2023-07-14T11:13:31.266 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:13:31.266 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4296,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/811241790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":811241790},{"type":"v1","addr":"172.21.15.84:6836","nonce":811241790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4299,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/729998896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":729998896},{"type":"v1","addr":"172.21.15.84:6837","nonce":729998896}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4305,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3512017231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3512017231},{"type":"v1","addr":"172.21.15.179:6834","nonce":3512017231}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T11:13:14.457746+0000","modified":"2023-07-14T11:13:18.001606+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4308},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4308":{"gid":4308,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/3903854892","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":3903854892},{"type":"v1","addr":"172.21.15.179:6835","nonce":3903854892}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-14T11:13:31.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.265+0000 7f27c41ff700 1 -- 172.21.15.84:0/1895089542 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f27a006ace0 msgr2=0x7f27a006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:31.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.265+0000 7f27c41ff700 1 --2- 172.21.15.84:0/1895089542 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f27a006ace0 0x7f27a006d190 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f27ac0090b0 tx=0x7f27ac008030 comp rx=0 tx=0).stop 2023-07-14T11:13:31.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.265+0000 7f27c41ff700 1 -- 172.21.15.84:0/1895089542 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27bc0b87d0 msgr2=0x7f27bc070c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:31.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.265+0000 7f27c41ff700 1 --2- 172.21.15.84:0/1895089542 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27bc0b87d0 0x7f27bc070c30 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f27b80011e0 tx=0x7f27b800ca30 comp rx=0 tx=0).stop 2023-07-14T11:13:31.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.265+0000 7f27c41ff700 1 -- 172.21.15.84:0/1895089542 shutdown_connections 2023-07-14T11:13:31.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.265+0000 7f27c41ff700 1 --2- 172.21.15.84:0/1895089542 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f27bc0701e0 0x7f27bc0c9570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:31.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.265+0000 7f27c41ff700 1 --2- 172.21.15.84:0/1895089542 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27bc0b87d0 0x7f27bc070c30 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:31.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.265+0000 7f27c41ff700 1 --2- 172.21.15.84:0/1895089542 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f27a006ace0 0x7f27a006d190 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:31.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.265+0000 7f27c41ff700 1 --2- 172.21.15.84:0/1895089542 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27bc0cfc60 0x7f27bc06e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:31.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.265+0000 7f27c41ff700 1 -- 172.21.15.84:0/1895089542 >> 172.21.15.84:0/1895089542 conn(0x7f27bc06c140 msgr2=0x7f27bc0d0d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:31.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.265+0000 7f27c41ff700 1 -- 172.21.15.84:0/1895089542 shutdown_connections 2023-07-14T11:13:31.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.265+0000 7f27c41ff700 1 -- 172.21.15.84:0/1895089542 wait complete. 2023-07-14T11:13:31.270 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 8 2023-07-14T11:13:31.286 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:13:31.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.476+0000 7f00051ff700 1 Processor -- start 2023-07-14T11:13:31.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.476+0000 7f00051ff700 1 -- start start 2023-07-14T11:13:31.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.478+0000 7f00051ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f00001500d0 0x7f0000070350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:31.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.478+0000 7f00051ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00000cdf90 con 0x7f00000cea50 2023-07-14T11:13:31.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.478+0000 7f00051ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f000015a2f0 con 0x7f0000070890 2023-07-14T11:13:31.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.478+0000 7f00051ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f000015a5d0 con 0x7f00001500d0 2023-07-14T11:13:31.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.478+0000 7effff59e700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f00000cea50 0x7f00000b2690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51724/0 (socket says 172.21.15.84:51724) 2023-07-14T11:13:31.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.478+0000 7effff59e700 1 -- 172.21.15.84:0/199170404 learned_addr learned my addr 172.21.15.84:0/199170404 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:13:31.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.478+0000 7efffdd9b700 1 -- 172.21.15.84:0/199170404 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1656630982 0 0) 0x7f00000cdf90 con 0x7f00000cea50 2023-07-14T11:13:31.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.478+0000 7efffed9d700 1 --2- 172.21.15.84:0/199170404 >> v2:172.21.15.179:3300/0 conn(0x7f00001500d0 0x7f0000070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:31.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.478+0000 7efffdd9b700 1 -- 172.21.15.84:0/199170404 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effe80035b0 con 0x7f00000cea50 2023-07-14T11:13:31.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.479+0000 7efffdd9b700 1 -- 172.21.15.84:0/199170404 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 578161435 0 0) 0x7effe80035b0 con 0x7f00000cea50 2023-07-14T11:13:31.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.479+0000 7efffdd9b700 1 -- 172.21.15.84:0/199170404 >> v2:172.21.15.179:3300/0 conn(0x7f00001500d0 msgr2=0x7f0000070350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:31.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.479+0000 7efffdd9b700 1 --2- 172.21.15.84:0/199170404 >> v2:172.21.15.179:3300/0 conn(0x7f00001500d0 0x7f0000070350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:31.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.479+0000 7efffdd9b700 1 -- 172.21.15.84:0/199170404 >> v1:172.21.15.179:6789/0 conn(0x7f0000070890 legacy=0x7f00001597c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:31.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.479+0000 7efffdd9b700 1 -- 172.21.15.84:0/199170404 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00000ce250 con 0x7f00000cea50 2023-07-14T11:13:31.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.479+0000 7efffdd9b700 1 -- 172.21.15.84:0/199170404 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7efff80019f0 con 0x7f00000cea50 2023-07-14T11:13:31.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.479+0000 7efffdd9b700 1 -- 172.21.15.84:0/199170404 >> v1:172.21.15.84:6789/0 conn(0x7f00000cea50 legacy=0x7f00000b2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:31.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.479+0000 7efffdd9b700 1 --2- 172.21.15.84:0/199170404 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7effe8003a00 0x7effe8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:31.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.479+0000 7efffdd9b700 1 --2- 172.21.15.84:0/199170404 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7effe8004850 0x7effe8004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:31.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.479+0000 7efffdd9b700 1 --2- 172.21.15.84:0/199170404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7effe8005200 0x7effe800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:31.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.479+0000 7efffdd9b700 1 -- 172.21.15.84:0/199170404 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f000015a5d0 con 0x7effe8005200 2023-07-14T11:13:31.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.479+0000 7efffdd9b700 1 -- 172.21.15.84:0/199170404 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effe800c110 con 0x7effe8004850 2023-07-14T11:13:31.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.479+0000 7efffdd9b700 1 -- 172.21.15.84:0/199170404 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effe800c2d0 con 0x7effe8003a00 2023-07-14T11:13:31.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.479+0000 7effff59e700 1 --2- 172.21.15.84:0/199170404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7effe8005200 0x7effe800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:31.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.479+0000 7efffe59c700 1 --2- 172.21.15.84:0/199170404 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7effe8004850 0x7effe8004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:31.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.479+0000 7efffed9d700 1 --2- 172.21.15.84:0/199170404 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7effe8003a00 0x7effe8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:31.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.479+0000 7effff59e700 1 -- 172.21.15.84:0/199170404 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7effe8003a00 msgr2=0x7effe8003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:31.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.479+0000 7effff59e700 1 --2- 172.21.15.84:0/199170404 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7effe8003a00 0x7effe8003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:31.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.479+0000 7effff59e700 1 -- 172.21.15.84:0/199170404 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7effe8004850 msgr2=0x7effe8004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:31.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.479+0000 7effff59e700 1 --2- 172.21.15.84:0/199170404 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7effe8004850 0x7effe8004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:31.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.479+0000 7effff59e700 1 -- 172.21.15.84:0/199170404 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effe80035b0 con 0x7effe8005200 2023-07-14T11:13:31.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.479+0000 7efffed9d700 1 --2- 172.21.15.84:0/199170404 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7effe8003a00 0x7effe8003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:13:31.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.479+0000 7efffe59c700 1 --2- 172.21.15.84:0/199170404 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7effe8004850 0x7effe8004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:13:31.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.479+0000 7effff59e700 1 -- 172.21.15.84:0/199170404 reap_dead start 2023-07-14T11:13:31.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.480+0000 7effff59e700 1 --2- 172.21.15.84:0/199170404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7effe8005200 0x7effe800ba10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7efff800a830 tx=0x7effe8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9500462bb5ff311a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:31.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.480+0000 7efffdd9b700 1 -- 172.21.15.84:0/199170404 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff800a2f0 con 0x7effe8005200 2023-07-14T11:13:31.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.480+0000 7efffdd9b700 1 -- 172.21.15.84:0/199170404 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efff8012620 con 0x7effe8005200 2023-07-14T11:13:31.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.480+0000 7efffdd9b700 1 -- 172.21.15.84:0/199170404 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff80129d0 con 0x7effe8005200 2023-07-14T11:13:31.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.480+0000 7f00051ff700 1 -- 172.21.15.84:0/199170404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7effe8005200 msgr2=0x7effe800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:31.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.480+0000 7f00051ff700 1 --2- 172.21.15.84:0/199170404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7effe8005200 0x7effe800ba10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7efff800a830 tx=0x7effe8005880 comp rx=0 tx=0).stop 2023-07-14T11:13:31.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.480+0000 7f00051ff700 1 -- 172.21.15.84:0/199170404 shutdown_connections 2023-07-14T11:13:31.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.480+0000 7f00051ff700 1 --2- 172.21.15.84:0/199170404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7effe8005200 0x7effe800ba10 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:31.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.480+0000 7f00051ff700 1 -- 172.21.15.84:0/199170404 >> 172.21.15.84:0/199170404 conn(0x7f0000069f30 msgr2=0x7f000006a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:31.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.481+0000 7f00051ff700 1 -- 172.21.15.84:0/199170404 shutdown_connections 2023-07-14T11:13:31.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.481+0000 7f00051ff700 1 -- 172.21.15.84:0/199170404 wait complete. 2023-07-14T11:13:31.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.482+0000 7f00051ff700 1 Processor -- start 2023-07-14T11:13:31.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.482+0000 7f00051ff700 1 -- start start 2023-07-14T11:13:31.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.483+0000 7f00051ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7effe8005200 0x7f0000149a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:31.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.483+0000 7f00051ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00001f0490 0x7f000014ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:31.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.483+0000 7f00051ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f000014cf50 0x7f0000152fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:31.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.483+0000 7f00051ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0000149f40 con 0x7f00001f0490 2023-07-14T11:13:31.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.483+0000 7f00051ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00001df970 con 0x7effe8005200 2023-07-14T11:13:31.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.483+0000 7f00051ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00001dfc50 con 0x7f000014cf50 2023-07-14T11:13:31.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.484+0000 7efffe59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00001f0490 0x7f000014ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:31.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.484+0000 7efffe59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00001f0490 0x7f000014ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54034/0 (socket says 172.21.15.84:54034) 2023-07-14T11:13:31.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.484+0000 7efffe59c700 1 -- 172.21.15.84:0/1567838553 learned_addr learned my addr 172.21.15.84:0/1567838553 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:31.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.484+0000 7effff59e700 1 --2- 172.21.15.84:0/1567838553 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f000014cf50 0x7f0000152fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:31.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.484+0000 7efffed9d700 1 --2- 172.21.15.84:0/1567838553 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7effe8005200 0x7f0000149a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:31.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.484+0000 7efffe59c700 1 -- 172.21.15.84:0/1567838553 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f000014cf50 msgr2=0x7f0000152fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:31.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.484+0000 7efffe59c700 1 --2- 172.21.15.84:0/1567838553 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f000014cf50 0x7f0000152fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:31.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.484+0000 7efffe59c700 1 -- 172.21.15.84:0/1567838553 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7effe8005200 msgr2=0x7f0000149a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:31.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.484+0000 7efffe59c700 1 --2- 172.21.15.84:0/1567838553 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7effe8005200 0x7f0000149a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:31.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.484+0000 7efffe59c700 1 -- 172.21.15.84:0/1567838553 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00001dff30 con 0x7f00001f0490 2023-07-14T11:13:31.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.484+0000 7effff59e700 1 --2- 172.21.15.84:0/1567838553 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f000014cf50 0x7f0000152fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:13:31.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.484+0000 7efffed9d700 1 --2- 172.21.15.84:0/1567838553 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7effe8005200 0x7f0000149a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:13:31.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.484+0000 7efffe59c700 1 --2- 172.21.15.84:0/1567838553 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00001f0490 0x7f000014ca10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7efff400e550 tx=0x7efff400e910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:31.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.484+0000 7effe77fe700 1 -- 172.21.15.84:0/1567838553 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff40052e0 con 0x7f00001f0490 2023-07-14T11:13:31.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.484+0000 7effe77fe700 1 -- 172.21.15.84:0/1567838553 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efff4005440 con 0x7f00001f0490 2023-07-14T11:13:31.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.484+0000 7f00051ff700 1 -- 172.21.15.84:0/1567838553 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00001e0210 con 0x7f00001f0490 2023-07-14T11:13:31.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.484+0000 7effe77fe700 1 -- 172.21.15.84:0/1567838553 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff40038a0 con 0x7f00001f0490 2023-07-14T11:13:31.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.485+0000 7f00051ff700 1 -- 172.21.15.84:0/1567838553 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00001f0900 con 0x7f00001f0490 2023-07-14T11:13:31.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.486+0000 7f00051ff700 1 -- 172.21.15.84:0/1567838553 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f000004e280 con 0x7f00001f0490 2023-07-14T11:13:31.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.486+0000 7effe77fe700 1 -- 172.21.15.84:0/1567838553 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efff4003a00 con 0x7f00001f0490 2023-07-14T11:13:31.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.487+0000 7effe77fe700 1 --2- 172.21.15.84:0/1567838553 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7effec06ace0 0x7effec06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:31.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.487+0000 7effe77fe700 1 -- 172.21.15.84:0/1567838553 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efff4088b90 con 0x7f00001f0490 2023-07-14T11:13:31.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.488+0000 7efffed9d700 1 --2- 172.21.15.84:0/1567838553 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7effec06ace0 0x7effec06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:31.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.488+0000 7efffed9d700 1 --2- 172.21.15.84:0/1567838553 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7effec06ace0 0x7effec06d190 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7efff0009a80 tx=0x7efff0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:31.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.492+0000 7effe77fe700 1 -- 172.21.15.84:0/1567838553 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7efff4053d10 con 0x7f00001f0490 2023-07-14T11:13:31.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.689+0000 7f00051ff700 1 -- 172.21.15.84:0/1567838553 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f00000cb2a0 con 0x7f00001f0490 2023-07-14T11:13:31.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.690+0000 7effe77fe700 1 -- 172.21.15.84:0/1567838553 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18255 (secure 0 0 0) 0x7efff4019090 con 0x7f00001f0490 2023-07-14T11:13:31.694 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:13:31.694 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":23,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:13:15.989292+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-14T11:13:12.727811+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-14T11:13:13.436391+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:13:31.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.692+0000 7f00051ff700 1 -- 172.21.15.84:0/1567838553 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7effec06ace0 msgr2=0x7effec06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:31.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.692+0000 7f00051ff700 1 --2- 172.21.15.84:0/1567838553 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7effec06ace0 0x7effec06d190 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7efff0009a80 tx=0x7efff0008040 comp rx=0 tx=0).stop 2023-07-14T11:13:31.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.692+0000 7f00051ff700 1 -- 172.21.15.84:0/1567838553 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00001f0490 msgr2=0x7f000014ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:31.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.693+0000 7f00051ff700 1 --2- 172.21.15.84:0/1567838553 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00001f0490 0x7f000014ca10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7efff400e550 tx=0x7efff400e910 comp rx=0 tx=0).stop 2023-07-14T11:13:31.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.693+0000 7f00051ff700 1 -- 172.21.15.84:0/1567838553 shutdown_connections 2023-07-14T11:13:31.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.693+0000 7f00051ff700 1 --2- 172.21.15.84:0/1567838553 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7effec06ace0 0x7effec06d190 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:31.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.693+0000 7f00051ff700 1 --2- 172.21.15.84:0/1567838553 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f000014cf50 0x7f0000152fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:31.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.693+0000 7f00051ff700 1 --2- 172.21.15.84:0/1567838553 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7effe8005200 0x7f0000149a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:31.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.693+0000 7f00051ff700 1 --2- 172.21.15.84:0/1567838553 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00001f0490 0x7f000014ca10 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:31.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.693+0000 7f00051ff700 1 -- 172.21.15.84:0/1567838553 >> 172.21.15.84:0/1567838553 conn(0x7f0000069f30 msgr2=0x7f00000cd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:31.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.693+0000 7f00051ff700 1 -- 172.21.15.84:0/1567838553 shutdown_connections 2023-07-14T11:13:31.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.693+0000 7f00051ff700 1 -- 172.21.15.84:0/1567838553 wait complete. 2023-07-14T11:13:31.713 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T11:13:31.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.904+0000 7f6de2dff700 1 Processor -- start 2023-07-14T11:13:31.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.904+0000 7f6de2dff700 1 -- start start 2023-07-14T11:13:31.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.905+0000 7f6de2dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ddc15c950 0x7f6ddc0b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:31.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.905+0000 7f6de2dff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6ddc0b1e00 0x7f6ddc0d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:31.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.905+0000 7f6de2dff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6ddc0b2350 0x7f6ddc0d1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:31.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.905+0000 7f6de2dff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ddc0d2ce0 con 0x7f6ddc0b2350 2023-07-14T11:13:31.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.905+0000 7f6de2dff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ddc0b3350 con 0x7f6ddc0b1e00 2023-07-14T11:13:31.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.905+0000 7f6de2dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ddc0b3630 con 0x7f6ddc15c950 2023-07-14T11:13:31.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.905+0000 7f6de139c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6ddc0b2350 0x7f6ddc0d1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:31.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.905+0000 7f6de139c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6ddc0b2350 0x7f6ddc0d1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54040/0 (socket says 172.21.15.84:54040) 2023-07-14T11:13:31.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.905+0000 7f6de139c700 1 -- 172.21.15.84:0/1455192946 learned_addr learned my addr 172.21.15.84:0/1455192946 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:31.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.905+0000 7f6de0b9b700 1 --2- 172.21.15.84:0/1455192946 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ddc15c950 0x7f6ddc0b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:31.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.905+0000 7f6ddbfff700 1 --2- 172.21.15.84:0/1455192946 >> v2:172.21.15.179:3300/0 conn(0x7f6ddc0b1e00 0x7f6ddc0d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:31.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.905+0000 7f6de139c700 1 -- 172.21.15.84:0/1455192946 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ddc15c950 msgr2=0x7f6ddc0b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:31.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.906+0000 7f6de139c700 1 --2- 172.21.15.84:0/1455192946 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ddc15c950 0x7f6ddc0b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:31.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.906+0000 7f6de139c700 1 -- 172.21.15.84:0/1455192946 >> v2:172.21.15.179:3300/0 conn(0x7f6ddc0b1e00 msgr2=0x7f6ddc0d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:31.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.906+0000 7f6de139c700 1 --2- 172.21.15.84:0/1455192946 >> v2:172.21.15.179:3300/0 conn(0x7f6ddc0b1e00 0x7f6ddc0d0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:31.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.906+0000 7f6de139c700 1 -- 172.21.15.84:0/1455192946 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ddc0b3910 con 0x7f6ddc0b2350 2023-07-14T11:13:31.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.906+0000 7f6de139c700 1 --2- 172.21.15.84:0/1455192946 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ddc0b2350 0x7f6ddc0d1050 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc08baa0 tx=0x7f6dd400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=176848ef2177bbbf server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:31.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.906+0000 7f6ddb7fe700 1 -- 172.21.15.84:0/1455192946 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd400e070 con 0x7f6ddc0b2350 2023-07-14T11:13:31.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.906+0000 7f6ddb7fe700 1 -- 172.21.15.84:0/1455192946 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dd400b910 con 0x7f6ddc0b2350 2023-07-14T11:13:31.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.906+0000 7f6ddb7fe700 1 -- 172.21.15.84:0/1455192946 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd400bcc0 con 0x7f6ddc0b2350 2023-07-14T11:13:31.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.907+0000 7f6de2dff700 1 -- 172.21.15.84:0/1455192946 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ddc0b2350 msgr2=0x7f6ddc0d1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:31.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.907+0000 7f6de2dff700 1 --2- 172.21.15.84:0/1455192946 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ddc0b2350 0x7f6ddc0d1050 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc08baa0 tx=0x7f6dd400b330 comp rx=0 tx=0).stop 2023-07-14T11:13:31.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.907+0000 7f6de2dff700 1 -- 172.21.15.84:0/1455192946 shutdown_connections 2023-07-14T11:13:31.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.907+0000 7f6de2dff700 1 --2- 172.21.15.84:0/1455192946 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ddc15c950 0x7f6ddc0b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:31.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.907+0000 7f6de2dff700 1 --2- 172.21.15.84:0/1455192946 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ddc0b2350 0x7f6ddc0d1050 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:31.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.907+0000 7f6de2dff700 1 --2- 172.21.15.84:0/1455192946 >> v2:172.21.15.179:3300/0 conn(0x7f6ddc0b1e00 0x7f6ddc0d0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:31.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.907+0000 7f6de2dff700 1 -- 172.21.15.84:0/1455192946 >> 172.21.15.84:0/1455192946 conn(0x7f6ddc09c1d0 msgr2=0x7f6ddc0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:31.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.907+0000 7f6de2dff700 1 -- 172.21.15.84:0/1455192946 shutdown_connections 2023-07-14T11:13:31.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.907+0000 7f6de2dff700 1 -- 172.21.15.84:0/1455192946 wait complete. 2023-07-14T11:13:31.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.908+0000 7f6de2dff700 1 Processor -- start 2023-07-14T11:13:31.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.909+0000 7f6de2dff700 1 -- start start 2023-07-14T11:13:31.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.909+0000 7f6de2dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ddc0b1e00 0x7f6ddc0b1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:31.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.909+0000 7f6de2dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ddc0b2350 0x7f6ddc0c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:31.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.909+0000 7f6de2dff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ddc15c950 0x7f6ddc1518c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:31.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.909+0000 7f6de2dff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ddc159590 con 0x7f6ddc15c950 2023-07-14T11:13:31.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.909+0000 7f6de2dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ddc1589a0 con 0x7f6ddc0b1e00 2023-07-14T11:13:31.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.909+0000 7f6de2dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ddc158bf0 con 0x7f6ddc0b2350 2023-07-14T11:13:31.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.910+0000 7f6de139c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ddc15c950 0x7f6ddc1518c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:31.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.910+0000 7f6de139c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ddc15c950 0x7f6ddc1518c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54044/0 (socket says 172.21.15.84:54044) 2023-07-14T11:13:31.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.910+0000 7f6de139c700 1 -- 172.21.15.84:0/608499416 learned_addr learned my addr 172.21.15.84:0/608499416 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:31.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.910+0000 7f6ddbfff700 1 --2- 172.21.15.84:0/608499416 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ddc0b2350 0x7f6ddc0c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:31.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.910+0000 7f6de0b9b700 1 --2- 172.21.15.84:0/608499416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ddc0b1e00 0x7f6ddc0b1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:31.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.910+0000 7f6de139c700 1 -- 172.21.15.84:0/608499416 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ddc0b2350 msgr2=0x7f6ddc0c84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:31.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.910+0000 7f6de139c700 1 --2- 172.21.15.84:0/608499416 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ddc0b2350 0x7f6ddc0c84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:31.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.910+0000 7f6de139c700 1 -- 172.21.15.84:0/608499416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ddc0b1e00 msgr2=0x7f6ddc0b1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:31.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.910+0000 7f6de139c700 1 --2- 172.21.15.84:0/608499416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ddc0b1e00 0x7f6ddc0b1390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:31.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.910+0000 7f6de139c700 1 -- 172.21.15.84:0/608499416 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd4009b30 con 0x7f6ddc15c950 2023-07-14T11:13:31.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.910+0000 7f6de139c700 1 --2- 172.21.15.84:0/608499416 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ddc15c950 0x7f6ddc1518c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6dd400b370 tx=0x7f6dd4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:31.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.911+0000 7f6dd97fa700 1 -- 172.21.15.84:0/608499416 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd400ce80 con 0x7f6ddc15c950 2023-07-14T11:13:31.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.911+0000 7f6dd97fa700 1 -- 172.21.15.84:0/608499416 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dd4004250 con 0x7f6ddc15c950 2023-07-14T11:13:31.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.911+0000 7f6de2dff700 1 -- 172.21.15.84:0/608499416 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ddc158ed0 con 0x7f6ddc15c950 2023-07-14T11:13:31.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.911+0000 7f6dd97fa700 1 -- 172.21.15.84:0/608499416 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd4004600 con 0x7f6ddc15c950 2023-07-14T11:13:31.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.911+0000 7f6de2dff700 1 -- 172.21.15.84:0/608499416 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ddc0b8700 con 0x7f6ddc15c950 2023-07-14T11:13:31.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.912+0000 7f6de2dff700 1 -- 172.21.15.84:0/608499416 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ddc04e280 con 0x7f6ddc15c950 2023-07-14T11:13:31.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.913+0000 7f6dd97fa700 1 -- 172.21.15.84:0/608499416 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6dd4004760 con 0x7f6ddc15c950 2023-07-14T11:13:31.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.914+0000 7f6dd97fa700 1 --2- 172.21.15.84:0/608499416 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6dc006ace0 0x7f6dc006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:31.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.914+0000 7f6dd97fa700 1 -- 172.21.15.84:0/608499416 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6dd408a7f0 con 0x7f6ddc15c950 2023-07-14T11:13:31.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.914+0000 7f6de0b9b700 1 --2- 172.21.15.84:0/608499416 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6dc006ace0 0x7f6dc006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:31.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.914+0000 7f6de0b9b700 1 --2- 172.21.15.84:0/608499416 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6dc006ace0 0x7f6dc006d190 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6dd0009ab0 tx=0x7f6dd0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:31.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:31.918+0000 7f6dd97fa700 1 -- 172.21.15.84:0/608499416 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f6dd4055890 con 0x7f6ddc15c950 2023-07-14T11:13:32.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.157+0000 7f6de2dff700 1 -- 172.21.15.84:0/608499416 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6ddc15bc00 con 0x7f6ddc15c950 2023-07-14T11:13:32.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.157+0000 7f6dd97fa700 1 -- 172.21.15.84:0/608499416 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4703 (secure 0 0 0) 0x7f6dd4058eb0 con 0x7f6ddc15c950 2023-07-14T11:13:32.161 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:13:32.161 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4296,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/811241790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":811241790},{"type":"v1","addr":"172.21.15.84:6836","nonce":811241790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4299,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/729998896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":729998896},{"type":"v1","addr":"172.21.15.84:6837","nonce":729998896}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4305,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3512017231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3512017231},{"type":"v1","addr":"172.21.15.179:6834","nonce":3512017231}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T11:13:14.457746+0000","modified":"2023-07-14T11:13:18.001606+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4308},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4308":{"gid":4308,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/3903854892","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":3903854892},{"type":"v1","addr":"172.21.15.179:6835","nonce":3903854892}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-14T11:13:32.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.159+0000 7f6de2dff700 1 -- 172.21.15.84:0/608499416 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6dc006ace0 msgr2=0x7f6dc006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:32.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.159+0000 7f6de2dff700 1 --2- 172.21.15.84:0/608499416 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6dc006ace0 0x7f6dc006d190 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6dd0009ab0 tx=0x7f6dd0008040 comp rx=0 tx=0).stop 2023-07-14T11:13:32.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.160+0000 7f6de2dff700 1 -- 172.21.15.84:0/608499416 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ddc15c950 msgr2=0x7f6ddc1518c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:32.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.160+0000 7f6de2dff700 1 --2- 172.21.15.84:0/608499416 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ddc15c950 0x7f6ddc1518c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6dd400b370 tx=0x7f6dd4004ad0 comp rx=0 tx=0).stop 2023-07-14T11:13:32.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.160+0000 7f6de2dff700 1 -- 172.21.15.84:0/608499416 shutdown_connections 2023-07-14T11:13:32.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.160+0000 7f6de2dff700 1 --2- 172.21.15.84:0/608499416 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ddc15c950 0x7f6ddc1518c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:32.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.160+0000 7f6de2dff700 1 --2- 172.21.15.84:0/608499416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ddc0b1e00 0x7f6ddc0b1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:32.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.160+0000 7f6de2dff700 1 --2- 172.21.15.84:0/608499416 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6dc006ace0 0x7f6dc006d190 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:32.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.160+0000 7f6de2dff700 1 --2- 172.21.15.84:0/608499416 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ddc0b2350 0x7f6ddc0c84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:32.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.160+0000 7f6de2dff700 1 -- 172.21.15.84:0/608499416 >> 172.21.15.84:0/608499416 conn(0x7f6ddc09c1d0 msgr2=0x7f6ddc06a920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:32.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.160+0000 7f6de2dff700 1 -- 172.21.15.84:0/608499416 shutdown_connections 2023-07-14T11:13:32.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.160+0000 7f6de2dff700 1 -- 172.21.15.84:0/608499416 wait complete. 2023-07-14T11:13:32.165 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 8 2023-07-14T11:13:32.583 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-14T11:13:14.457746+0000', 'modified': '2023-07-14T11:13:18.001606+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4308}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4308': {'gid': 4308, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.179:6835/3903854892', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6833', 'nonce': 3903854892}, {'type': 'v1', 'addr': '172.21.15.179:6835', 'nonce': 3903854892}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-14T11:13:32.583 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-14T11:13:32.583 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-07-14T11:13:32.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.776+0000 7f22a93ff700 1 Processor -- start 2023-07-14T11:13:32.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.776+0000 7f22a93ff700 1 -- start start 2023-07-14T11:13:32.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.777+0000 7f22a93ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f22a40c92d0 0x7f22a40ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:32.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.777+0000 7f22a93ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22a40adea0 0x7f22a40cc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:32.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.778+0000 7f22a93ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22a415ce70 con 0x7f22a40b12f0 2023-07-14T11:13:32.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.778+0000 7f22a93ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22a415da60 con 0x7f22a40c92d0 2023-07-14T11:13:32.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.778+0000 7f22a93ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22a415d0c0 con 0x7f22a40adea0 2023-07-14T11:13:32.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.778+0000 7f229bfff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f22a40b12f0 0x7f22a40c96a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51738/0 (socket says 172.21.15.84:51738) 2023-07-14T11:13:32.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.778+0000 7f229bfff700 1 -- 172.21.15.84:0/2244856662 learned_addr learned my addr 172.21.15.84:0/2244856662 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:13:32.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.778+0000 7f22a2ffd700 1 --2- 172.21.15.84:0/2244856662 >> v2:172.21.15.179:3300/0 conn(0x7f22a40c92d0 0x7f22a40ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:32.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.778+0000 7f22a37fe700 1 --2- 172.21.15.84:0/2244856662 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22a40adea0 0x7f22a40cc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:32.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.778+0000 7f22a27fc700 1 -- 172.21.15.84:0/2244856662 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3698682072 0 0) 0x7f22a415ce70 con 0x7f22a40b12f0 2023-07-14T11:13:32.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.778+0000 7f22a27fc700 1 -- 172.21.15.84:0/2244856662 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22900035b0 con 0x7f22a40b12f0 2023-07-14T11:13:32.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.778+0000 7f22a27fc700 1 -- 172.21.15.84:0/2244856662 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1246535488 0 0) 0x7f22900035b0 con 0x7f22a40b12f0 2023-07-14T11:13:32.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.778+0000 7f22a27fc700 1 -- 172.21.15.84:0/2244856662 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22a40adea0 msgr2=0x7f22a40cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:32.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.778+0000 7f22a27fc700 1 --2- 172.21.15.84:0/2244856662 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22a40adea0 0x7f22a40cc690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:32.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.778+0000 7f22a27fc700 1 -- 172.21.15.84:0/2244856662 >> v2:172.21.15.179:3300/0 conn(0x7f22a40c92d0 msgr2=0x7f22a40ad8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:32.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.778+0000 7f22a27fc700 1 --2- 172.21.15.84:0/2244856662 >> v2:172.21.15.179:3300/0 conn(0x7f22a40c92d0 0x7f22a40ad8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:32.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.778+0000 7f22a27fc700 1 -- 172.21.15.84:0/2244856662 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22a415d3a0 con 0x7f22a40b12f0 2023-07-14T11:13:32.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.779+0000 7f22a27fc700 1 -- 172.21.15.84:0/2244856662 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7f228c001670 con 0x7f22a40b12f0 2023-07-14T11:13:32.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.779+0000 7f22a27fc700 1 -- 172.21.15.84:0/2244856662 >> v1:172.21.15.84:6789/0 conn(0x7f22a40b12f0 legacy=0x7f22a40c96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:32.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.779+0000 7f22a27fc700 1 --2- 172.21.15.84:0/2244856662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2290003a00 0x7f2290003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:32.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.779+0000 7f22a27fc700 1 --2- 172.21.15.84:0/2244856662 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2290004430 0x7f22900048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:32.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.779+0000 7f22a27fc700 1 --2- 172.21.15.84:0/2244856662 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22a40adea0 0x7f2290005060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:32.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.779+0000 7f22a27fc700 1 -- 172.21.15.84:0/2244856662 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a415da60 con 0x7f2290003a00 2023-07-14T11:13:32.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.779+0000 7f22a27fc700 1 -- 172.21.15.84:0/2244856662 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a415d0c0 con 0x7f2290004430 2023-07-14T11:13:32.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.779+0000 7f22a27fc700 1 -- 172.21.15.84:0/2244856662 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f229000dc20 con 0x7f22a40adea0 2023-07-14T11:13:32.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.779+0000 7f22a2ffd700 1 --2- 172.21.15.84:0/2244856662 >> v2:172.21.15.179:3300/0 conn(0x7f22a40c92d0 0x7f22a40ad8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:13:32.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.779+0000 7f22a37fe700 1 --2- 172.21.15.84:0/2244856662 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22a40adea0 0x7f2290005060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:32.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.779+0000 7f22a2ffd700 1 --2- 172.21.15.84:0/2244856662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2290003a00 0x7f2290003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:32.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.779+0000 7f229bfff700 1 --2- 172.21.15.84:0/2244856662 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2290004430 0x7f22900048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:32.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.779+0000 7f22a2ffd700 1 -- 172.21.15.84:0/2244856662 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22a40adea0 msgr2=0x7f2290005060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:32.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.779+0000 7f22a2ffd700 1 --2- 172.21.15.84:0/2244856662 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22a40adea0 0x7f2290005060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:32.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.779+0000 7f22a2ffd700 1 -- 172.21.15.84:0/2244856662 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2290004430 msgr2=0x7f22900048f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:32.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.779+0000 7f22a2ffd700 1 --2- 172.21.15.84:0/2244856662 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2290004430 0x7f22900048f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:32.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.779+0000 7f22a2ffd700 1 -- 172.21.15.84:0/2244856662 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22900035b0 con 0x7f2290003a00 2023-07-14T11:13:32.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.780+0000 7f22a2ffd700 1 --2- 172.21.15.84:0/2244856662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2290003a00 0x7f2290003e10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2294009d40 tx=0x7f2290005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1c6ef8a9017d0ab server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:32.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.780+0000 7f22a27fc700 1 -- 172.21.15.84:0/2244856662 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2294009e90 con 0x7f2290003a00 2023-07-14T11:13:32.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.780+0000 7f22a27fc700 1 -- 172.21.15.84:0/2244856662 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f229400e9a0 con 0x7f2290003a00 2023-07-14T11:13:32.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.780+0000 7f22a27fc700 1 -- 172.21.15.84:0/2244856662 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f229400ed10 con 0x7f2290003a00 2023-07-14T11:13:32.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.780+0000 7f22a93ff700 1 -- 172.21.15.84:0/2244856662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2290003a00 msgr2=0x7f2290003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:32.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.780+0000 7f22a93ff700 1 --2- 172.21.15.84:0/2244856662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2290003a00 0x7f2290003e10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2294009d40 tx=0x7f2290005880 comp rx=0 tx=0).stop 2023-07-14T11:13:32.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.780+0000 7f22a37fe700 1 -- 172.21.15.84:0/2244856662 reap_dead start 2023-07-14T11:13:32.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.780+0000 7f22a93ff700 1 -- 172.21.15.84:0/2244856662 shutdown_connections 2023-07-14T11:13:32.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.780+0000 7f22a93ff700 1 -- 172.21.15.84:0/2244856662 >> 172.21.15.84:0/2244856662 conn(0x7f22a40b05d0 msgr2=0x7f22a40b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:32.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.780+0000 7f22a93ff700 1 -- 172.21.15.84:0/2244856662 shutdown_connections 2023-07-14T11:13:32.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.781+0000 7f22a93ff700 1 -- 172.21.15.84:0/2244856662 wait complete. 2023-07-14T11:13:32.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.782+0000 7f22a93ff700 1 Processor -- start 2023-07-14T11:13:32.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.782+0000 7f22a93ff700 1 -- start start 2023-07-14T11:13:32.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.783+0000 7f22a93ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2290003a00 0x7f22a40c84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:32.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.783+0000 7f22a93ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22a41522b0 0x7f22a415b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:32.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.783+0000 7f22a93ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22a4152720 0x7f22a415b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:32.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.783+0000 7f22a93ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a40c89e0 con 0x7f22a4152720 2023-07-14T11:13:32.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.783+0000 7f22a93ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a4159cb0 con 0x7f22a41522b0 2023-07-14T11:13:32.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.783+0000 7f22a93ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22a415c1d0 con 0x7f2290003a00 2023-07-14T11:13:32.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.784+0000 7f22a37fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22a4152720 0x7f22a415b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:32.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.784+0000 7f22a37fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22a4152720 0x7f22a415b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54068/0 (socket says 172.21.15.84:54068) 2023-07-14T11:13:32.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.784+0000 7f22a37fe700 1 -- 172.21.15.84:0/1010762685 learned_addr learned my addr 172.21.15.84:0/1010762685 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:32.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.784+0000 7f22a2ffd700 1 --2- 172.21.15.84:0/1010762685 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2290003a00 0x7f22a40c84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:32.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.784+0000 7f229bfff700 1 --2- 172.21.15.84:0/1010762685 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22a41522b0 0x7f22a415b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:32.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.784+0000 7f22a37fe700 1 -- 172.21.15.84:0/1010762685 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2290003a00 msgr2=0x7f22a40c84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:32.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.784+0000 7f22a37fe700 1 --2- 172.21.15.84:0/1010762685 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2290003a00 0x7f22a40c84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:32.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.784+0000 7f22a37fe700 1 -- 172.21.15.84:0/1010762685 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22a41522b0 msgr2=0x7f22a415b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:32.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.784+0000 7f22a37fe700 1 --2- 172.21.15.84:0/1010762685 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22a41522b0 0x7f22a415b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:32.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.784+0000 7f22a37fe700 1 -- 172.21.15.84:0/1010762685 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22a415c4b0 con 0x7f22a4152720 2023-07-14T11:13:32.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.784+0000 7f22a37fe700 1 --2- 172.21.15.84:0/1010762685 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22a4152720 0x7f22a415b9b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f22a406f5e0 tx=0x7f229c011f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:32.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.784+0000 7f229b7fe700 1 -- 172.21.15.84:0/1010762685 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f229c00e040 con 0x7f22a4152720 2023-07-14T11:13:32.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.784+0000 7f229b7fe700 1 -- 172.21.15.84:0/1010762685 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f229c00f040 con 0x7f22a4152720 2023-07-14T11:13:32.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.784+0000 7f229b7fe700 1 -- 172.21.15.84:0/1010762685 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f229c00fa00 con 0x7f22a4152720 2023-07-14T11:13:32.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.785+0000 7f22a93ff700 1 -- 172.21.15.84:0/1010762685 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22a415bef0 con 0x7f22a4152720 2023-07-14T11:13:32.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.785+0000 7f22a93ff700 1 -- 172.21.15.84:0/1010762685 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22a4153320 con 0x7f22a4152720 2023-07-14T11:13:32.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.787+0000 7f229b7fe700 1 -- 172.21.15.84:0/1010762685 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f229c00fb60 con 0x7f22a4152720 2023-07-14T11:13:32.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.787+0000 7f229b7fe700 1 --2- 172.21.15.84:0/1010762685 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f228406ace0 0x7f228406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:32.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.787+0000 7f229b7fe700 1 -- 172.21.15.84:0/1010762685 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f229c089c30 con 0x7f22a4152720 2023-07-14T11:13:32.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.788+0000 7f22a2ffd700 1 --2- 172.21.15.84:0/1010762685 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f228406ace0 0x7f228406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:32.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.788+0000 7f22a2ffd700 1 --2- 172.21.15.84:0/1010762685 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f228406ace0 0x7f228406d190 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f22940090b0 tx=0x7f2294008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:32.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.789+0000 7f22bcd78b80 1 Processor -- start 2023-07-14T11:13:32.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.790+0000 7f22bcd78b80 1 -- start start 2023-07-14T11:13:32.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.790+0000 7f22bcd78b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d1df620cc0 0x55d1df6035e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:32.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.790+0000 7f22bcd78b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1df621760 0x55d1df603b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:32.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.790+0000 7f22bcd78b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d1df5d75e0 0x55d1df5d3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:32.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.791+0000 7f22bcd78b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1df54dea0 con 0x55d1df621760 2023-07-14T11:13:32.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.791+0000 7f22bcd78b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1df4c1600 con 0x55d1df5d75e0 2023-07-14T11:13:32.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.791+0000 7f22bcd78b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d1df530910 con 0x55d1df620cc0 2023-07-14T11:13:32.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.791+0000 7f229bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1df621760 0x55d1df603b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:32.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.791+0000 7f229bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1df621760 0x55d1df603b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54078/0 (socket says 172.21.15.84:54078) 2023-07-14T11:13:32.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.791+0000 7f229bfff700 1 -- 172.21.15.84:0/594672087 learned_addr learned my addr 172.21.15.84:0/594672087 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:32.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.791+0000 7f22a2ffd700 1 --2- 172.21.15.84:0/594672087 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d1df620cc0 0x55d1df6035e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:32.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.791+0000 7f22a37fe700 1 --2- 172.21.15.84:0/594672087 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d1df5d75e0 0x55d1df5d3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:32.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.791+0000 7f229bfff700 1 -- 172.21.15.84:0/594672087 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d1df620cc0 msgr2=0x55d1df6035e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:32.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.791+0000 7f229bfff700 1 --2- 172.21.15.84:0/594672087 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d1df620cc0 0x55d1df6035e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:32.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.791+0000 7f229bfff700 1 -- 172.21.15.84:0/594672087 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d1df5d75e0 msgr2=0x55d1df5d3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:32.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.791+0000 7f229bfff700 1 --2- 172.21.15.84:0/594672087 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d1df5d75e0 0x55d1df5d3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:32.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.791+0000 7f229bfff700 1 -- 172.21.15.84:0/594672087 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d1df31d790 con 0x55d1df621760 2023-07-14T11:13:32.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.791+0000 7f229bfff700 1 --2- 172.21.15.84:0/594672087 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1df621760 0x55d1df603b20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f228c000fd0 tx=0x7f228c001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d4d1fb8ef883cc7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:32.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.792+0000 7f2298ff9700 1 -- 172.21.15.84:0/594672087 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228c007180 con 0x55d1df621760 2023-07-14T11:13:32.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.792+0000 7f2298ff9700 1 -- 172.21.15.84:0/594672087 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f228c0072e0 con 0x55d1df621760 2023-07-14T11:13:32.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.792+0000 7f2298ff9700 1 -- 172.21.15.84:0/594672087 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228c007670 con 0x55d1df621760 2023-07-14T11:13:32.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.792+0000 7f22bcd78b80 1 -- 172.21.15.84:0/594672087 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1df621760 msgr2=0x55d1df603b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:32.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.792+0000 7f22bcd78b80 1 --2- 172.21.15.84:0/594672087 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1df621760 0x55d1df603b20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f228c000fd0 tx=0x7f228c001710 comp rx=0 tx=0).stop 2023-07-14T11:13:32.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.792+0000 7f22bcd78b80 1 -- 172.21.15.84:0/594672087 shutdown_connections 2023-07-14T11:13:32.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.792+0000 7f22bcd78b80 1 --2- 172.21.15.84:0/594672087 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d1df620cc0 0x55d1df6035e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:32.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.792+0000 7f22bcd78b80 1 --2- 172.21.15.84:0/594672087 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d1df5d75e0 0x55d1df5d3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:32.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.792+0000 7f22bcd78b80 1 --2- 172.21.15.84:0/594672087 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1df621760 0x55d1df603b20 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:32.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.792+0000 7f22bcd78b80 1 -- 172.21.15.84:0/594672087 >> 172.21.15.84:0/594672087 conn(0x55d1df5ce3b0 msgr2=0x55d1df5d9550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:32.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.792+0000 7f22bcd78b80 1 -- 172.21.15.84:0/594672087 shutdown_connections 2023-07-14T11:13:32.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.792+0000 7f22bcd78b80 1 -- 172.21.15.84:0/594672087 wait complete. 2023-07-14T11:13:32.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.793+0000 7f22bcd78b80 1 -- start start 2023-07-14T11:13:32.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.794+0000 7f22bcd78b80 1 Processor -- start 2023-07-14T11:13:32.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.795+0000 7f22bcd78b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1df5d75e0 0x55d1df618110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:32.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.795+0000 7f22bcd78b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d1df620cc0 0x55d1df603440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:32.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.795+0000 7f22bcd78b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d1df621760 0x55d1df603980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:32.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.795+0000 7f22bcd78b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1df529be0 con 0x55d1df5d75e0 2023-07-14T11:13:32.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.795+0000 7f22bcd78b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1df4e75b0 con 0x55d1df621760 2023-07-14T11:13:32.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.795+0000 7f22bcd78b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d1df4cd910 con 0x55d1df620cc0 2023-07-14T11:13:32.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.795+0000 7f22bcd78b80 10 client.0 _ll_register_callbacks cb 0x55d1df4e5b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T11:13:32.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.796+0000 7f22a2ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1df5d75e0 0x55d1df618110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:32.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.796+0000 7f22a2ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1df5d75e0 0x55d1df618110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54084/0 (socket says 172.21.15.84:54084) 2023-07-14T11:13:32.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.796+0000 7f22a2ffd700 1 -- 172.21.15.84:0/1633195085 learned_addr learned my addr 172.21.15.84:0/1633195085 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:32.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.796+0000 7f229bfff700 1 --2- 172.21.15.84:0/1633195085 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d1df620cc0 0x55d1df603440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:32.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.796+0000 7f22a37fe700 1 --2- 172.21.15.84:0/1633195085 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d1df621760 0x55d1df603980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:32.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.796+0000 7f22a2ffd700 1 -- 172.21.15.84:0/1633195085 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d1df620cc0 msgr2=0x55d1df603440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:32.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.796+0000 7f22a2ffd700 1 --2- 172.21.15.84:0/1633195085 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d1df620cc0 0x55d1df603440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:32.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.796+0000 7f22a2ffd700 1 -- 172.21.15.84:0/1633195085 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d1df621760 msgr2=0x55d1df603980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:32.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.796+0000 7f22a2ffd700 1 --2- 172.21.15.84:0/1633195085 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d1df621760 0x55d1df603980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:32.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.796+0000 7f22a2ffd700 1 -- 172.21.15.84:0/1633195085 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22a415d3a0 con 0x55d1df5d75e0 2023-07-14T11:13:32.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.796+0000 7f22a2ffd700 1 --2- 172.21.15.84:0/1633195085 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1df5d75e0 0x55d1df618110 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2294004000 tx=0x7f2294004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e346023e8578d39 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:32.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.796+0000 7f2281ffb700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-07-14T11:13:32.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.796+0000 7f2281ffb700 1 -- 172.21.15.84:0/1633195085 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22940038a0 con 0x55d1df5d75e0 2023-07-14T11:13:32.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.797+0000 7f2281ffb700 1 -- 172.21.15.84:0/1633195085 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2294003a00 con 0x55d1df5d75e0 2023-07-14T11:13:32.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.797+0000 7f22bcd78b80 1 -- 172.21.15.84:0/1633195085 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d1df5cb9c0 con 0x55d1df5d75e0 2023-07-14T11:13:32.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.797+0000 7f2281ffb700 1 -- 172.21.15.84:0/1633195085 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2294003c00 con 0x55d1df5d75e0 2023-07-14T11:13:32.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.797+0000 7f22bcd78b80 10 client.4659 fetch_fsmap learned FSMap version 8 2023-07-14T11:13:32.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.797+0000 7f22bcd78b80 1 -- 172.21.15.84:0/1633195085 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55d1df40a0a0 con 0x55d1df5d75e0 2023-07-14T11:13:32.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.797+0000 7f2281ffb700 1 -- 172.21.15.84:0/1633195085 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d1df5cb9c0 con 0x55d1df5d75e0 2023-07-14T11:13:32.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.797+0000 7f2281ffb700 1 -- 172.21.15.84:0/1633195085 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 8) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f2294013470 con 0x55d1df5d75e0 2023-07-14T11:13:32.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.797+0000 7f22bcd78b80 10 client.4659 fetch_fsmap finished waiting for FSMap version 8 2023-07-14T11:13:32.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.797+0000 7f22bcd78b80 10 client.4659 resolve_mds: resolved name 'b' to daemon mds.b 2023-07-14T11:13:32.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.797+0000 7f22bcd78b80 20 client.4659 populate_metadata read hostname 'smithi084' 2023-07-14T11:13:32.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.797+0000 7f22bcd78b80 1 --2- 172.21.15.84:0/1633195085 >> [v2:172.21.15.179:6833/3903854892,v1:172.21.15.179:6835/3903854892] conn(0x55d1df604e20 0x55d1df63f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:32.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.797+0000 7f22bcd78b80 4 client.4659 mds_command: new command op to 4308 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T11:13:32.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.797+0000 7f22bcd78b80 1 -- 172.21.15.84:0/1633195085 --> [v2:172.21.15.179:6833/3903854892,v1:172.21.15.179:6835/3903854892] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d1df5a8170 con 0x55d1df604e20 2023-07-14T11:13:32.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.798+0000 7f229bfff700 1 --2- 172.21.15.84:0/1633195085 >> [v2:172.21.15.179:6833/3903854892,v1:172.21.15.179:6835/3903854892] conn(0x55d1df604e20 0x55d1df63f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:32.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.798+0000 7f2281ffb700 10 client.4659 ms_handle_connect on v2:172.21.15.179:6833/3903854892 2023-07-14T11:13:32.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.798+0000 7f229bfff700 1 --2- 172.21.15.84:0/1633195085 >> [v2:172.21.15.179:6833/3903854892,v1:172.21.15.179:6835/3903854892] conn(0x55d1df604e20 0x55d1df63f650 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c40d31d96c621c7 server_cookie=5b142423225200c9 in_seq=0 out_seq=0 2023-07-14T11:13:32.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.799+0000 7f2281ffb700 1 -- 172.21.15.84:0/1633195085 <== mds.0 v2:172.21.15.179:6833/3903854892 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55d1df5a8170 con 0x55d1df604e20 2023-07-14T11:13:32.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.799+0000 7f2281ffb700 10 client.4659 handle_command_reply: tid=0 2023-07-14T11:13:32.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.799+0000 7f22bcd78b80 1 client.4659 shutdown 2023-07-14T11:13:32.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.799+0000 7f22bcd78b80 1 -- 172.21.15.84:0/1633195085 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1df5d75e0 msgr2=0x55d1df618110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:32.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.799+0000 7f22bcd78b80 1 --2- 172.21.15.84:0/1633195085 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1df5d75e0 0x55d1df618110 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2294004000 tx=0x7f2294004750 comp rx=0 tx=0).stop 2023-07-14T11:13:32.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.799+0000 7f22bcd78b80 1 -- 172.21.15.84:0/1633195085 shutdown_connections 2023-07-14T11:13:32.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.799+0000 7f22bcd78b80 1 --2- 172.21.15.84:0/1633195085 >> [v2:172.21.15.179:6833/3903854892,v1:172.21.15.179:6835/3903854892] conn(0x55d1df604e20 0x55d1df63f650 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:32.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.799+0000 7f22bcd78b80 1 --2- 172.21.15.84:0/1633195085 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d1df621760 0x55d1df603980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:32.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.799+0000 7f22bcd78b80 1 --2- 172.21.15.84:0/1633195085 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1df5d75e0 0x55d1df618110 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:32.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.799+0000 7f2281ffb700 0 client.4659 ms_handle_reset on v2:172.21.15.179:6833/3903854892 2023-07-14T11:13:32.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.799+0000 7f22bcd78b80 1 --2- 172.21.15.84:0/1633195085 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d1df620cc0 0x55d1df603440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:32.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.799+0000 7f22bcd78b80 1 -- 172.21.15.84:0/1633195085 >> 172.21.15.84:0/1633195085 conn(0x55d1df5ce3b0 msgr2=0x55d1df5d6a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:32.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.800+0000 7f22bcd78b80 1 -- 172.21.15.84:0/1633195085 shutdown_connections 2023-07-14T11:13:32.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.800+0000 7f22bcd78b80 1 -- 172.21.15.84:0/1633195085 wait complete. 2023-07-14T11:13:32.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.800+0000 7f22bcd78b80 20 client.4659 trim_cache size 0 max 16384 2023-07-14T11:13:32.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.817+0000 7f22bcd78b80 1 Processor -- start 2023-07-14T11:13:32.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.818+0000 7f22bcd78b80 1 -- start start 2023-07-14T11:13:32.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.818+0000 7f22bcd78b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d1df5d75e0 0x55d1df603440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:32.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.818+0000 7f22bcd78b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1df620cc0 0x55d1df603980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:32.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.818+0000 7f22bcd78b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d1df621760 0x55d1df5ee330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:32.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.819+0000 7f22bcd78b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1df31e390 con 0x55d1df620cc0 2023-07-14T11:13:32.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.819+0000 7f22bcd78b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1df6441d0 con 0x55d1df5d75e0 2023-07-14T11:13:32.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.819+0000 7f22bcd78b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d1df634d10 con 0x55d1df621760 2023-07-14T11:13:32.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.819+0000 7f229bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1df620cc0 0x55d1df603980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:32.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.819+0000 7f229bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1df620cc0 0x55d1df603980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54098/0 (socket says 172.21.15.84:54098) 2023-07-14T11:13:32.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.819+0000 7f229bfff700 1 -- 172.21.15.84:0/1127532888 learned_addr learned my addr 172.21.15.84:0/1127532888 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:32.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.819+0000 7f22a37fe700 1 --2- 172.21.15.84:0/1127532888 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d1df621760 0x55d1df5ee330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:32.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.819+0000 7f22a2ffd700 1 --2- 172.21.15.84:0/1127532888 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d1df5d75e0 0x55d1df603440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:32.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.819+0000 7f229bfff700 1 -- 172.21.15.84:0/1127532888 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d1df621760 msgr2=0x55d1df5ee330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:32.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.819+0000 7f229bfff700 1 --2- 172.21.15.84:0/1127532888 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d1df621760 0x55d1df5ee330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:32.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.819+0000 7f229bfff700 1 -- 172.21.15.84:0/1127532888 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d1df5d75e0 msgr2=0x55d1df603440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:32.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.819+0000 7f229bfff700 1 --2- 172.21.15.84:0/1127532888 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d1df5d75e0 0x55d1df603440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:32.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.819+0000 7f229bfff700 1 -- 172.21.15.84:0/1127532888 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d1df5d5150 con 0x55d1df620cc0 2023-07-14T11:13:32.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.819+0000 7f229bfff700 1 --2- 172.21.15.84:0/1127532888 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1df620cc0 0x55d1df603980 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f228c019040 tx=0x7f228c00f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd5fee4154aa3978 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:32.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.819+0000 7f22997fa700 1 -- 172.21.15.84:0/1127532888 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228c026070 con 0x55d1df620cc0 2023-07-14T11:13:32.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.819+0000 7f22997fa700 1 -- 172.21.15.84:0/1127532888 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f228c007550 con 0x55d1df620cc0 2023-07-14T11:13:32.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.820+0000 7f22997fa700 1 -- 172.21.15.84:0/1127532888 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228c015430 con 0x55d1df620cc0 2023-07-14T11:13:32.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.820+0000 7f22bcd78b80 1 -- 172.21.15.84:0/1127532888 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1df620cc0 msgr2=0x55d1df603980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:32.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.820+0000 7f22bcd78b80 1 --2- 172.21.15.84:0/1127532888 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1df620cc0 0x55d1df603980 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f228c019040 tx=0x7f228c00f000 comp rx=0 tx=0).stop 2023-07-14T11:13:32.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.820+0000 7f22bcd78b80 1 -- 172.21.15.84:0/1127532888 shutdown_connections 2023-07-14T11:13:32.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.820+0000 7f22bcd78b80 1 --2- 172.21.15.84:0/1127532888 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d1df621760 0x55d1df5ee330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:32.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.820+0000 7f22bcd78b80 1 --2- 172.21.15.84:0/1127532888 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d1df5d75e0 0x55d1df603440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:32.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.820+0000 7f22bcd78b80 1 --2- 172.21.15.84:0/1127532888 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1df620cc0 0x55d1df603980 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:32.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.820+0000 7f22bcd78b80 1 -- 172.21.15.84:0/1127532888 >> 172.21.15.84:0/1127532888 conn(0x55d1df5ce3b0 msgr2=0x55d1df5d9520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:32.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.820+0000 7f22bcd78b80 1 -- 172.21.15.84:0/1127532888 shutdown_connections 2023-07-14T11:13:32.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.820+0000 7f22bcd78b80 1 -- 172.21.15.84:0/1127532888 wait complete. 2023-07-14T11:13:32.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.821+0000 7f22bcd78b80 1 -- start start 2023-07-14T11:13:32.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.821+0000 7f22bcd78b80 1 Processor -- start 2023-07-14T11:13:32.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.823+0000 7f22bcd78b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1df5d75e0 0x55d1df603a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:32.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.823+0000 7f22bcd78b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d1df620cc0 0x55d1df689280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:32.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.823+0000 7f22bcd78b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d1df621760 0x55d1df620310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:32.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.823+0000 7f22bcd78b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1df616720 con 0x55d1df5d75e0 2023-07-14T11:13:32.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.823+0000 7f22bcd78b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1df6897c0 con 0x55d1df620cc0 2023-07-14T11:13:32.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.823+0000 7f22bcd78b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d1df68cea0 con 0x55d1df621760 2023-07-14T11:13:32.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.823+0000 7f22bcd78b80 10 client.0 _ll_register_callbacks cb 0x7f2294009b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T11:13:32.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.823+0000 7f22a2ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1df5d75e0 0x55d1df603a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:32.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.823+0000 7f22a2ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1df5d75e0 0x55d1df603a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54114/0 (socket says 172.21.15.84:54114) 2023-07-14T11:13:32.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.823+0000 7f22a2ffd700 1 -- 172.21.15.84:0/1313241388 learned_addr learned my addr 172.21.15.84:0/1313241388 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:32.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.823+0000 7f22a37fe700 1 --2- 172.21.15.84:0/1313241388 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d1df621760 0x55d1df620310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:32.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.823+0000 7f229bfff700 1 --2- 172.21.15.84:0/1313241388 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d1df620cc0 0x55d1df689280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:32.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.823+0000 7f22a2ffd700 1 -- 172.21.15.84:0/1313241388 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d1df621760 msgr2=0x55d1df620310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:32.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.823+0000 7f22a2ffd700 1 --2- 172.21.15.84:0/1313241388 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d1df621760 0x55d1df620310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:32.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.823+0000 7f22a2ffd700 1 -- 172.21.15.84:0/1313241388 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d1df620cc0 msgr2=0x55d1df689280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:32.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.823+0000 7f22a2ffd700 1 --2- 172.21.15.84:0/1313241388 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d1df620cc0 0x55d1df689280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:32.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.823+0000 7f22a2ffd700 1 -- 172.21.15.84:0/1313241388 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d1df31d790 con 0x55d1df5d75e0 2023-07-14T11:13:32.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.824+0000 7f22a2ffd700 1 --2- 172.21.15.84:0/1313241388 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1df5d75e0 0x55d1df603a20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2294013f90 tx=0x7f2294009210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ccf1ed4f0a7a06d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:32.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.824+0000 7f2281ffb700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-07-14T11:13:32.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.824+0000 7f2281ffb700 1 -- 172.21.15.84:0/1313241388 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22940038a0 con 0x55d1df5d75e0 2023-07-14T11:13:32.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.824+0000 7f22bcd78b80 1 -- 172.21.15.84:0/1313241388 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f228c0072e0 con 0x55d1df5d75e0 2023-07-14T11:13:32.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.824+0000 7f2281ffb700 1 -- 172.21.15.84:0/1313241388 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2294013980 con 0x55d1df5d75e0 2023-07-14T11:13:32.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.824+0000 7f2281ffb700 1 -- 172.21.15.84:0/1313241388 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2294006c60 con 0x55d1df5d75e0 2023-07-14T11:13:32.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.824+0000 7f22bcd78b80 10 client.4665 fetch_fsmap learned FSMap version 8 2023-07-14T11:13:32.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.824+0000 7f22bcd78b80 1 -- 172.21.15.84:0/1313241388 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55d1df4efb10 con 0x55d1df5d75e0 2023-07-14T11:13:32.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.824+0000 7f2281ffb700 1 -- 172.21.15.84:0/1313241388 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f228c0072e0 con 0x55d1df5d75e0 2023-07-14T11:13:32.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.824+0000 7f2281ffb700 1 -- 172.21.15.84:0/1313241388 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 8) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f2294003a00 con 0x55d1df5d75e0 2023-07-14T11:13:32.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.824+0000 7f22bcd78b80 10 client.4665 fetch_fsmap finished waiting for FSMap version 8 2023-07-14T11:13:32.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.824+0000 7f22bcd78b80 10 client.4665 resolve_mds: resolved name 'b' to daemon mds.b 2023-07-14T11:13:32.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.824+0000 7f22bcd78b80 20 client.4665 populate_metadata read hostname 'smithi084' 2023-07-14T11:13:32.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.824+0000 7f22bcd78b80 1 --2- 172.21.15.84:0/1313241388 >> [v2:172.21.15.179:6833/3903854892,v1:172.21.15.179:6835/3903854892] conn(0x55d1df5ee590 0x55d1df5d57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:32.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.824+0000 7f22bcd78b80 4 client.4665 mds_command: new command op to 4308 tid=0[{"prefix": "status"}] 2023-07-14T11:13:32.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.824+0000 7f22bcd78b80 1 -- 172.21.15.84:0/1313241388 --> [v2:172.21.15.179:6833/3903854892,v1:172.21.15.179:6835/3903854892] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d1df522d20 con 0x55d1df5ee590 2023-07-14T11:13:32.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.825+0000 7f229bfff700 1 --2- 172.21.15.84:0/1313241388 >> [v2:172.21.15.179:6833/3903854892,v1:172.21.15.179:6835/3903854892] conn(0x55d1df5ee590 0x55d1df5d57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:32.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.825+0000 7f229bfff700 1 --2- 172.21.15.84:0/1313241388 >> [v2:172.21.15.179:6833/3903854892,v1:172.21.15.179:6835/3903854892] conn(0x55d1df5ee590 0x55d1df5d57f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e9d36316c2db1ec server_cookie=e7fc22a814a1bca8 in_seq=0 out_seq=0 2023-07-14T11:13:32.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.825+0000 7f2281ffb700 10 client.4665 ms_handle_connect on v2:172.21.15.179:6833/3903854892 2023-07-14T11:13:32.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.826+0000 7f2281ffb700 1 -- 172.21.15.84:0/1313241388 <== mds.0 v2:172.21.15.179:6833/3903854892 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55d1df522d20 con 0x55d1df5ee590 2023-07-14T11:13:32.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.826+0000 7f2281ffb700 10 client.4665 handle_command_reply: tid=0 2023-07-14T11:13:32.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.826+0000 7f22bcd78b80 1 client.4665 shutdown 2023-07-14T11:13:32.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.826+0000 7f22bcd78b80 1 -- 172.21.15.84:0/1313241388 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1df5d75e0 msgr2=0x55d1df603a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:32.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.826+0000 7f22bcd78b80 1 --2- 172.21.15.84:0/1313241388 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1df5d75e0 0x55d1df603a20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2294013f90 tx=0x7f2294009210 comp rx=0 tx=0).stop 2023-07-14T11:13:32.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.826+0000 7f22bcd78b80 1 -- 172.21.15.84:0/1313241388 shutdown_connections 2023-07-14T11:13:32.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.826+0000 7f22bcd78b80 1 --2- 172.21.15.84:0/1313241388 >> [v2:172.21.15.179:6833/3903854892,v1:172.21.15.179:6835/3903854892] conn(0x55d1df5ee590 0x55d1df5d57f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:32.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.826+0000 7f22bcd78b80 1 --2- 172.21.15.84:0/1313241388 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d1df621760 0x55d1df620310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:32.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.826+0000 7f22bcd78b80 1 --2- 172.21.15.84:0/1313241388 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1df5d75e0 0x55d1df603a20 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:32.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.826+0000 7f22bcd78b80 1 --2- 172.21.15.84:0/1313241388 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d1df620cc0 0x55d1df689280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:32.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.826+0000 7f2281ffb700 0 client.4665 ms_handle_reset on v2:172.21.15.179:6833/3903854892 2023-07-14T11:13:32.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.826+0000 7f22bcd78b80 1 -- 172.21.15.84:0/1313241388 >> 172.21.15.84:0/1313241388 conn(0x55d1df5ce3b0 msgr2=0x55d1df6174c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:32.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.826+0000 7f22bcd78b80 1 -- 172.21.15.84:0/1313241388 shutdown_connections 2023-07-14T11:13:32.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.826+0000 7f22bcd78b80 1 -- 172.21.15.84:0/1313241388 wait complete. 2023-07-14T11:13:32.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.826+0000 7f22bcd78b80 20 client.4665 trim_cache size 0 max 16384 2023-07-14T11:13:32.836 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-07-14T11:13:32.837 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f", 2023-07-14T11:13:32.837 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 0, 2023-07-14T11:13:32.837 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 4308, 2023-07-14T11:13:32.837 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2023-07-14T11:13:32.837 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2023-07-14T11:13:32.837 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2023-07-14T11:13:32.837 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 17.836675493000001, 2023-07-14T11:13:32.837 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 8, 2023-07-14T11:13:32.838 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 23, 2023-07-14T11:13:32.838 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 23, 2023-07-14T11:13:32.838 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 23.873464301999999 2023-07-14T11:13:32.838 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-07-14T11:13:32.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.827+0000 7f22a93ff700 1 -- 172.21.15.84:0/1010762685 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f228406ace0 msgr2=0x7f228406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:32.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.827+0000 7f22a93ff700 1 --2- 172.21.15.84:0/1010762685 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f228406ace0 0x7f228406d190 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f22940090b0 tx=0x7f2294008030 comp rx=0 tx=0).stop 2023-07-14T11:13:32.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.827+0000 7f22a93ff700 1 -- 172.21.15.84:0/1010762685 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22a4152720 msgr2=0x7f22a415b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:32.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.827+0000 7f22a93ff700 1 --2- 172.21.15.84:0/1010762685 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22a4152720 0x7f22a415b9b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f22a406f5e0 tx=0x7f229c011f80 comp rx=0 tx=0).stop 2023-07-14T11:13:32.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.827+0000 7f22a93ff700 1 -- 172.21.15.84:0/1010762685 shutdown_connections 2023-07-14T11:13:32.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.827+0000 7f22a93ff700 1 --2- 172.21.15.84:0/1010762685 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f228406ace0 0x7f228406d190 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:32.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.827+0000 7f22a93ff700 1 --2- 172.21.15.84:0/1010762685 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2290003a00 0x7f22a40c84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:32.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.827+0000 7f22a93ff700 1 --2- 172.21.15.84:0/1010762685 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22a4152720 0x7f22a415b9b0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:32.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.827+0000 7f22a93ff700 1 --2- 172.21.15.84:0/1010762685 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22a41522b0 0x7f22a415b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:32.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.827+0000 7f22a93ff700 1 -- 172.21.15.84:0/1010762685 >> 172.21.15.84:0/1010762685 conn(0x7f22a40b05d0 msgr2=0x7f22a406f7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:32.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.827+0000 7f22a93ff700 1 -- 172.21.15.84:0/1010762685 shutdown_connections 2023-07-14T11:13:32.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:32.827+0000 7f22a93ff700 1 -- 172.21.15.84:0/1010762685 wait complete. 2023-07-14T11:13:32.847 INFO:teuthology.run_tasks:Running task kclient... 2023-07-14T11:13:32.869 INFO:tasks.kclient:Mounting kernel clients... 2023-07-14T11:13:32.870 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-07-14T11:13:32.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:32.870 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2023-07-14T11:13:32.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:32.917 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link delete ceph-brx 2023-07-14T11:13:33.029 INFO:teuthology.orchestra.run.smithi084.stderr:Cannot find device "ceph-brx" 2023-07-14T11:13:33.032 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-14T11:13:33.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:33.033 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2023-07-14T11:13:33.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:33.079 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link delete ceph-brx 2023-07-14T11:13:33.190 INFO:teuthology.orchestra.run.smithi084.stderr:Cannot find device "ceph-brx" 2023-07-14T11:13:33.193 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-14T11:13:33.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:33.194 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2023-07-14T11:13:33.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:33.246 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link delete ceph-brx 2023-07-14T11:13:33.321 INFO:teuthology.orchestra.run.smithi179.stderr:Cannot find device "ceph-brx" 2023-07-14T11:13:33.324 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-14T11:13:33.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:33.325 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2023-07-14T11:13:33.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:33.371 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link delete ceph-brx 2023-07-14T11:13:33.482 INFO:teuthology.orchestra.run.smithi179.stderr:Cannot find device "ceph-brx" 2023-07-14T11:13:33.485 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-14T11:13:33.486 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2023-07-14T11:13:33.486 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-14T11:13:33.487 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-14T11:13:33.487 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-14T11:13:33.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.679+0000 7fa99bdff700 1 Processor -- start 2023-07-14T11:13:33.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.679+0000 7fa99bdff700 1 -- start start 2023-07-14T11:13:33.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.680+0000 7fa99bdff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa99415e890 0x7fa9940cee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:33.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.680+0000 7fa99bdff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa99415afd0 0x7fa9940b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:33.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.680+0000 7fa99bdff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9940ce110 con 0x7fa9940b3780 2023-07-14T11:13:33.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.680+0000 7fa99bdff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa99415b450 con 0x7fa99415e890 2023-07-14T11:13:33.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.680+0000 7fa99bdff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9940cf380 con 0x7fa99415afd0 2023-07-14T11:13:33.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.680+0000 7fa99939a700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fa9940b3780 0x7fa99415a8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51742/0 (socket says 172.21.15.84:51742) 2023-07-14T11:13:33.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.681+0000 7fa99939a700 1 -- 172.21.15.84:0/160048894 learned_addr learned my addr 172.21.15.84:0/160048894 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:13:33.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.681+0000 7fa99a39c700 1 --2- 172.21.15.84:0/160048894 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa99415afd0 0x7fa9940b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:33.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.681+0000 7fa999b9b700 1 --2- 172.21.15.84:0/160048894 >> v2:172.21.15.179:3300/0 conn(0x7fa99415e890 0x7fa9940cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:33.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.681+0000 7fa998b99700 1 -- 172.21.15.84:0/160048894 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1219121831 0 0) 0x7fa9940ce110 con 0x7fa9940b3780 2023-07-14T11:13:33.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.681+0000 7fa998b99700 1 -- 172.21.15.84:0/160048894 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9800035b0 con 0x7fa9940b3780 2023-07-14T11:13:33.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.681+0000 7fa99a39c700 1 -- 172.21.15.84:0/160048894 >> v2:172.21.15.179:3300/0 conn(0x7fa99415e890 msgr2=0x7fa9940cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:33.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.681+0000 7fa99a39c700 1 --2- 172.21.15.84:0/160048894 >> v2:172.21.15.179:3300/0 conn(0x7fa99415e890 0x7fa9940cee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:33.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.681+0000 7fa99a39c700 1 -- 172.21.15.84:0/160048894 >> v1:172.21.15.84:6789/0 conn(0x7fa9940b3780 legacy=0x7fa99415a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:33.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.681+0000 7fa998b99700 1 -- 172.21.15.84:0/160048894 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2222792681 0 0) 0x7fa9800035b0 con 0x7fa9940b3780 2023-07-14T11:13:33.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.681+0000 7fa99a39c700 1 -- 172.21.15.84:0/160048894 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa99415b660 con 0x7fa99415afd0 2023-07-14T11:13:33.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.681+0000 7fa999b9b700 1 --2- 172.21.15.84:0/160048894 >> v2:172.21.15.179:3300/0 conn(0x7fa99415e890 0x7fa9940cee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:13:33.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.681+0000 7fa99a39c700 1 --2- 172.21.15.84:0/160048894 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa99415afd0 0x7fa9940b3bf0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa98c009d90 tx=0x7fa98c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=698194d0ce9d6a3c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:33.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.682+0000 7fa998b99700 1 -- 172.21.15.84:0/160048894 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa98c00e070 con 0x7fa99415afd0 2023-07-14T11:13:33.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.682+0000 7fa998b99700 1 -- 172.21.15.84:0/160048894 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa98c003a20 con 0x7fa99415afd0 2023-07-14T11:13:33.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.682+0000 7fa998b99700 1 -- 172.21.15.84:0/160048894 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa984001670 con 0x7fa99415afd0 2023-07-14T11:13:33.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.682+0000 7fa99bdff700 1 -- 172.21.15.84:0/160048894 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa99415afd0 msgr2=0x7fa9940b3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:33.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.682+0000 7fa99bdff700 1 --2- 172.21.15.84:0/160048894 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa99415afd0 0x7fa9940b3bf0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa98c009d90 tx=0x7fa98c00b330 comp rx=0 tx=0).stop 2023-07-14T11:13:33.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.682+0000 7fa99bdff700 1 -- 172.21.15.84:0/160048894 shutdown_connections 2023-07-14T11:13:33.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.682+0000 7fa99bdff700 1 --2- 172.21.15.84:0/160048894 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa99415afd0 0x7fa9940b3bf0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:33.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.682+0000 7fa99bdff700 1 --2- 172.21.15.84:0/160048894 >> v2:172.21.15.179:3300/0 conn(0x7fa99415e890 0x7fa9940cee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:33.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.682+0000 7fa99bdff700 1 -- 172.21.15.84:0/160048894 >> 172.21.15.84:0/160048894 conn(0x7fa994069f30 msgr2=0x7fa99406a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:33.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.682+0000 7fa99bdff700 1 -- 172.21.15.84:0/160048894 shutdown_connections 2023-07-14T11:13:33.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.683+0000 7fa99bdff700 1 -- 172.21.15.84:0/160048894 wait complete. 2023-07-14T11:13:33.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.684+0000 7fa99bdff700 1 Processor -- start 2023-07-14T11:13:33.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.684+0000 7fa99bdff700 1 -- start start 2023-07-14T11:13:33.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.685+0000 7fa99bdff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9940b3780 0x7fa994070170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:33.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.685+0000 7fa99bdff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa99415afd0 0x7fa9941f6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:33.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.685+0000 7fa99bdff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa99415e890 0x7fa9940c9110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:33.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.685+0000 7fa99bdff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9941e5740 con 0x7fa9940b3780 2023-07-14T11:13:33.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.685+0000 7fa99bdff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9940706b0 con 0x7fa99415e890 2023-07-14T11:13:33.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.685+0000 7fa99bdff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9941f6e80 con 0x7fa99415afd0 2023-07-14T11:13:33.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.686+0000 7fa999b9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9940b3780 0x7fa994070170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:33.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.686+0000 7fa999b9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9940b3780 0x7fa994070170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54120/0 (socket says 172.21.15.84:54120) 2023-07-14T11:13:33.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.686+0000 7fa999b9b700 1 -- 172.21.15.84:0/3381182667 learned_addr learned my addr 172.21.15.84:0/3381182667 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:33.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.686+0000 7fa99a39c700 1 --2- 172.21.15.84:0/3381182667 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa99415e890 0x7fa9940c9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:33.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.686+0000 7fa99939a700 1 --2- 172.21.15.84:0/3381182667 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa99415afd0 0x7fa9941f6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:33.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.686+0000 7fa999b9b700 1 -- 172.21.15.84:0/3381182667 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa99415afd0 msgr2=0x7fa9941f6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:33.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.686+0000 7fa999b9b700 1 --2- 172.21.15.84:0/3381182667 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa99415afd0 0x7fa9941f6940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:33.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.686+0000 7fa999b9b700 1 -- 172.21.15.84:0/3381182667 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa99415e890 msgr2=0x7fa9940c9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:33.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.686+0000 7fa999b9b700 1 --2- 172.21.15.84:0/3381182667 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa99415e890 0x7fa9940c9110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:33.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.686+0000 7fa999b9b700 1 -- 172.21.15.84:0/3381182667 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa98c009a70 con 0x7fa9940b3780 2023-07-14T11:13:33.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.686+0000 7fa99a39c700 1 --2- 172.21.15.84:0/3381182667 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa99415e890 0x7fa9940c9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:13:33.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.686+0000 7fa99939a700 1 --2- 172.21.15.84:0/3381182667 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa99415afd0 0x7fa9941f6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:13:33.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.686+0000 7fa999b9b700 1 --2- 172.21.15.84:0/3381182667 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9940b3780 0x7fa994070170 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa99000e760 tx=0x7fa99000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:33.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.686+0000 7fa98a7fc700 1 -- 172.21.15.84:0/3381182667 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa990013610 con 0x7fa9940b3780 2023-07-14T11:13:33.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.686+0000 7fa98a7fc700 1 -- 172.21.15.84:0/3381182667 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa990013770 con 0x7fa9940b3780 2023-07-14T11:13:33.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.686+0000 7fa99bdff700 1 -- 172.21.15.84:0/3381182667 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9940708a0 con 0x7fa9940b3780 2023-07-14T11:13:33.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.687+0000 7fa98a7fc700 1 -- 172.21.15.84:0/3381182667 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa990013b20 con 0x7fa9940b3780 2023-07-14T11:13:33.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.687+0000 7fa99bdff700 1 -- 172.21.15.84:0/3381182667 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9941e5360 con 0x7fa9940b3780 2023-07-14T11:13:33.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.688+0000 7fa99bdff700 1 -- 172.21.15.84:0/3381182667 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa99406d000 con 0x7fa9940b3780 2023-07-14T11:13:33.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.689+0000 7fa98a7fc700 1 -- 172.21.15.84:0/3381182667 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa990013c80 con 0x7fa9940b3780 2023-07-14T11:13:33.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.690+0000 7fa98a7fc700 1 --2- 172.21.15.84:0/3381182667 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa97806ace0 0x7fa97806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:33.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.690+0000 7fa98a7fc700 1 -- 172.21.15.84:0/3381182667 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa9900890d0 con 0x7fa9940b3780 2023-07-14T11:13:33.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.690+0000 7fa99939a700 1 --2- 172.21.15.84:0/3381182667 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa97806ace0 0x7fa97806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:33.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.691+0000 7fa99939a700 1 --2- 172.21.15.84:0/3381182667 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa97806ace0 0x7fa97806d190 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa994070d60 tx=0x7fa984009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:33.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.694+0000 7fa98a7fc700 1 -- 172.21.15.84:0/3381182667 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fa990054180 con 0x7fa9940b3780 2023-07-14T11:13:33.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.932+0000 7fa99bdff700 1 -- 172.21.15.84:0/3381182667 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa99404e280 con 0x7fa9940b3780 2023-07-14T11:13:33.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.933+0000 7fa98a7fc700 1 -- 172.21.15.84:0/3381182667 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa9900577a0 con 0x7fa9940b3780 2023-07-14T11:13:33.936 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-14T11:13:33.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.935+0000 7fa99bdff700 1 -- 172.21.15.84:0/3381182667 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa97806ace0 msgr2=0x7fa97806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:33.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.935+0000 7fa99bdff700 1 --2- 172.21.15.84:0/3381182667 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa97806ace0 0x7fa97806d190 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa994070d60 tx=0x7fa984009040 comp rx=0 tx=0).stop 2023-07-14T11:13:33.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.935+0000 7fa99bdff700 1 -- 172.21.15.84:0/3381182667 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9940b3780 msgr2=0x7fa994070170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:33.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.935+0000 7fa99bdff700 1 --2- 172.21.15.84:0/3381182667 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9940b3780 0x7fa994070170 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa99000e760 tx=0x7fa99000eb20 comp rx=0 tx=0).stop 2023-07-14T11:13:33.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.935+0000 7fa99bdff700 1 -- 172.21.15.84:0/3381182667 shutdown_connections 2023-07-14T11:13:33.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.935+0000 7fa99bdff700 1 --2- 172.21.15.84:0/3381182667 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa99415e890 0x7fa9940c9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:33.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.935+0000 7fa99bdff700 1 --2- 172.21.15.84:0/3381182667 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9940b3780 0x7fa994070170 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:33.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.935+0000 7fa99bdff700 1 --2- 172.21.15.84:0/3381182667 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa97806ace0 0x7fa97806d190 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:33.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.935+0000 7fa99bdff700 1 --2- 172.21.15.84:0/3381182667 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa99415afd0 0x7fa9941f6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:33.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.935+0000 7fa99bdff700 1 -- 172.21.15.84:0/3381182667 >> 172.21.15.84:0/3381182667 conn(0x7fa994069f30 msgr2=0x7fa99415ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:33.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.935+0000 7fa99bdff700 1 -- 172.21.15.84:0/3381182667 shutdown_connections 2023-07-14T11:13:33.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:33.935+0000 7fa99bdff700 1 -- 172.21.15.84:0/3381182667 wait complete. 2023-07-14T11:13:33.955 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-14T11:13:33.956 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-14T11:13:33.956 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi084.front.sepia.ceph.com 2023-07-14T11:13:33.956 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-14T11:13:33.956 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-14T11:13:33.957 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-14T11:13:33.957 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-14T11:13:33.957 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-14T11:13:33.957 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-14T11:13:33.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:33.958 DEBUG:teuthology.orchestra.run.smithi084:> ip addr 2023-07-14T11:13:34.003 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-14T11:13:34.003 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-14T11:13:34.003 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2023-07-14T11:13:34.004 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:13:34.004 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2023-07-14T11:13:34.004 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:13:34.004 INFO:teuthology.orchestra.run.smithi084.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T11:13:34.004 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:68 brd ff:ff:ff:ff:ff:ff 2023-07-14T11:13:34.004 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f0 2023-07-14T11:13:34.004 INFO:teuthology.orchestra.run.smithi084.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T11:13:34.005 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:69 brd ff:ff:ff:ff:ff:ff 2023-07-14T11:13:34.005 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f1 2023-07-14T11:13:34.005 INFO:teuthology.orchestra.run.smithi084.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T11:13:34.005 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:50 brd ff:ff:ff:ff:ff:ff 2023-07-14T11:13:34.005 INFO:teuthology.orchestra.run.smithi084.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-14T11:13:34.005 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:51 brd ff:ff:ff:ff:ff:ff 2023-07-14T11:13:34.005 INFO:teuthology.orchestra.run.smithi084.stdout: inet 172.21.15.84/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-14T11:13:34.006 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft 41954sec preferred_lft 41954sec 2023-07-14T11:13:34.006 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::ec4:7aff:fe8f:d751/64 scope link 2023-07-14T11:13:34.006 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:13:34.007 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-07-14T11:13:34.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:34.007 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-07-14T11:13:34.008 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-07-14T11:13:34.008 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link add name ceph-brx type bridge 2023-07-14T11:13:34.008 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip addr flush dev ceph-brx 2023-07-14T11:13:34.008 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set ceph-brx up 2023-07-14T11:13:34.009 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-07-14T11:13:34.009 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-07-14T11:13:34.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:34.437 DEBUG:teuthology.orchestra.run.smithi084:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-14T11:13:34.547 INFO:teuthology.orchestra.run.smithi084.stdout:1 2023-07-14T11:13:34.550 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:34.550 DEBUG:teuthology.orchestra.run.smithi084:> route 2023-07-14T11:13:34.623 INFO:teuthology.orchestra.run.smithi084.stdout:Kernel IP routing table 2023-07-14T11:13:34.624 INFO:teuthology.orchestra.run.smithi084.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-14T11:13:34.624 INFO:teuthology.orchestra.run.smithi084.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-14T11:13:34.624 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-14T11:13:34.624 INFO:teuthology.orchestra.run.smithi084.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-14T11:13:34.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:34.625 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-07-14T11:13:34.626 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-07-14T11:13:34.626 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-14T11:13:34.626 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-14T11:13:34.626 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-14T11:13:34.627 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-07-14T11:13:35.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:35.336 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2023-07-14T11:13:35.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:35.383 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list-id 2023-07-14T11:13:35.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:35.469 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-07-14T11:13:35.469 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-07-14T11:13:35.470 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-14T11:13:35.470 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-07-14T11:13:35.470 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-07-14T11:13:35.612 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-07-14T11:13:35.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:35.613 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-07-14T11:13:35.613 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-07-14T11:13:35.613 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-07-14T11:13:35.613 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-07-14T11:13:35.614 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-07-14T11:13:35.614 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-07-14T11:13:35.614 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-07-14T11:13:35.614 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-07-14T11:13:35.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:35.895 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-07-14T11:13:35.895 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-07-14T11:13:35.896 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set brx.0 up 2023-07-14T11:13:35.896 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set dev brx.0 master ceph-brx 2023-07-14T11:13:35.896 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-07-14T11:13:36.067 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T11:13:36.067 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-14T11:13:36.114 INFO:teuthology.orchestra.run.smithi084.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-14T11:13:36.114 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T11:13:36.115 DEBUG:teuthology.orchestra.run.smithi084:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-14T11:13:36.199 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-07-14T11:13:36.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:36.200 DEBUG:teuthology.orchestra.run.smithi084:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-14T11:13:36.343 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-14T11:13:36.343 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-14T11:13:36.403 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T11:13:36.407 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T11:13:36.861 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-14T11:13:36.861 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-14T11:13:36.862 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-07-14T11:13:36.862 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: trying mount with new device syntax: 0@3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f.cephfs=/ 2023-07-14T11:13:36.862 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.84:3300/172.21.15.179:3300/172.21.15.179:3301" will pass to kernel 2023-07-14T11:13:36.866 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-14T11:13:36.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:36.867 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-14T11:13:36.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:36.938 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-14T11:13:37.074 INFO:teuthology.orchestra.run.smithi084.stdout:client4642 2023-07-14T11:13:37.075 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-14T11:13:37.075 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:13:37.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:37.121 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-14T11:13:37.275 INFO:teuthology.orchestra.run.smithi084.stdout:client4642 2023-07-14T11:13:37.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:37.276 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-14T11:13:37.387 INFO:teuthology.orchestra.run.smithi084.stdout:client4642 2023-07-14T11:13:37.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:37.388 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f.client4642/status') 2023-07-14T11:13:37.514 INFO:teuthology.orchestra.run.smithi084.stdout:instance: client.4642 (3)172.21.15.84:0/1507504758 2023-07-14T11:13:37.515 INFO:teuthology.orchestra.run.smithi084.stdout:blocklisted: false 2023-07-14T11:13:37.515 INFO:teuthology.orchestra.run.smithi084.stderr:0+1 records in 2023-07-14T11:13:37.515 INFO:teuthology.orchestra.run.smithi084.stderr:0+1 records out 2023-07-14T11:13:37.515 INFO:teuthology.orchestra.run.smithi084.stderr:70 bytes copied, 7.5779e-05 s, 924 kB/s 2023-07-14T11:13:37.517 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2023-07-14T11:13:37.518 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-14T11:13:37.518 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-07-14T11:13:37.518 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-14T11:13:37.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.710+0000 7fddcb5ff700 1 Processor -- start 2023-07-14T11:13:37.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.710+0000 7fddcb5ff700 1 -- start start 2023-07-14T11:13:37.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.711+0000 7fddcb5ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fddc41500d0 0x7fddc4070350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:37.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.712+0000 7fddcb5ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fddc4070890 0x7fddc41597c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:37.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.712+0000 7fddcb5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fddc4159d00 0x7fddc40cea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:37.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.712+0000 7fddcb5ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddc40cdf90 con 0x7fddc4070890 2023-07-14T11:13:37.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.712+0000 7fddcb5ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddc415a2f0 con 0x7fddc41500d0 2023-07-14T11:13:37.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.712+0000 7fddcb5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddc415a5d0 con 0x7fddc4159d00 2023-07-14T11:13:37.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.712+0000 7fddc8b9a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fddc4070890 0x7fddc41597c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:37.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.712+0000 7fddc8b9a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fddc4070890 0x7fddc41597c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54132/0 (socket says 172.21.15.84:54132) 2023-07-14T11:13:37.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.712+0000 7fddc8b9a700 1 -- 172.21.15.84:0/44075945 learned_addr learned my addr 172.21.15.84:0/44075945 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:37.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.712+0000 7fddc939b700 1 --2- 172.21.15.84:0/44075945 >> v2:172.21.15.179:3300/0 conn(0x7fddc41500d0 0x7fddc4070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:37.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.712+0000 7fddc9b9c700 1 --2- 172.21.15.84:0/44075945 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fddc4159d00 0x7fddc40cea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:37.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.712+0000 7fddc8b9a700 1 -- 172.21.15.84:0/44075945 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fddc4159d00 msgr2=0x7fddc40cea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:37.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.712+0000 7fddc8b9a700 1 --2- 172.21.15.84:0/44075945 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fddc4159d00 0x7fddc40cea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:37.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.712+0000 7fddc8b9a700 1 -- 172.21.15.84:0/44075945 >> v2:172.21.15.179:3300/0 conn(0x7fddc41500d0 msgr2=0x7fddc4070350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:37.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.712+0000 7fddc8b9a700 1 --2- 172.21.15.84:0/44075945 >> v2:172.21.15.179:3300/0 conn(0x7fddc41500d0 0x7fddc4070350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:37.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.712+0000 7fddc8b9a700 1 -- 172.21.15.84:0/44075945 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddc40ce250 con 0x7fddc4070890 2023-07-14T11:13:37.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.713+0000 7fddc8b9a700 1 --2- 172.21.15.84:0/44075945 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddc4070890 0x7fddc41597c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fddc406fa00 tx=0x7fddb400be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9feed7f2738df331 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:37.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.713+0000 7fddbbfff700 1 -- 172.21.15.84:0/44075945 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb400dd30 con 0x7fddc4070890 2023-07-14T11:13:37.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.713+0000 7fddbbfff700 1 -- 172.21.15.84:0/44075945 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddb400de90 con 0x7fddc4070890 2023-07-14T11:13:37.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.713+0000 7fddbbfff700 1 -- 172.21.15.84:0/44075945 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb4010690 con 0x7fddc4070890 2023-07-14T11:13:37.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.713+0000 7fddcb5ff700 1 -- 172.21.15.84:0/44075945 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddc4070890 msgr2=0x7fddc41597c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:37.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.713+0000 7fddcb5ff700 1 --2- 172.21.15.84:0/44075945 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddc4070890 0x7fddc41597c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fddc406fa00 tx=0x7fddb400be70 comp rx=0 tx=0).stop 2023-07-14T11:13:37.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.714+0000 7fddcb5ff700 1 -- 172.21.15.84:0/44075945 shutdown_connections 2023-07-14T11:13:37.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.714+0000 7fddcb5ff700 1 --2- 172.21.15.84:0/44075945 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fddc4159d00 0x7fddc40cea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:37.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.714+0000 7fddcb5ff700 1 --2- 172.21.15.84:0/44075945 >> v2:172.21.15.179:3300/0 conn(0x7fddc41500d0 0x7fddc4070350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:37.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.714+0000 7fddcb5ff700 1 --2- 172.21.15.84:0/44075945 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddc4070890 0x7fddc41597c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:37.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.714+0000 7fddcb5ff700 1 -- 172.21.15.84:0/44075945 >> 172.21.15.84:0/44075945 conn(0x7fddc4069f30 msgr2=0x7fddc406a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:37.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.714+0000 7fddcb5ff700 1 -- 172.21.15.84:0/44075945 shutdown_connections 2023-07-14T11:13:37.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.714+0000 7fddcb5ff700 1 -- 172.21.15.84:0/44075945 wait complete. 2023-07-14T11:13:37.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.715+0000 7fddcb5ff700 1 Processor -- start 2023-07-14T11:13:37.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.716+0000 7fddcb5ff700 1 -- start start 2023-07-14T11:13:37.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.716+0000 7fddcb5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fddc4070890 0x7fddc41f1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:37.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.716+0000 7fddcb5ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fddc41500d0 0x7fddc41f09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:37.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.717+0000 7fddcb5ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddc4159d00 0x7fddc41f0f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:37.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.717+0000 7fddcb5ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddc41ee200 con 0x7fddc4159d00 2023-07-14T11:13:37.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.717+0000 7fddcb5ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddc41ee4a0 con 0x7fddc41500d0 2023-07-14T11:13:37.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.717+0000 7fddcb5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddc41ee780 con 0x7fddc4070890 2023-07-14T11:13:37.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.717+0000 7fddc9b9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddc4159d00 0x7fddc41f0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:37.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.717+0000 7fddc9b9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddc4159d00 0x7fddc41f0f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54142/0 (socket says 172.21.15.84:54142) 2023-07-14T11:13:37.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.717+0000 7fddc9b9c700 1 -- 172.21.15.84:0/1765935218 learned_addr learned my addr 172.21.15.84:0/1765935218 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:37.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.717+0000 7fddc939b700 1 --2- 172.21.15.84:0/1765935218 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fddc4070890 0x7fddc41f1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:37.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.717+0000 7fddc8b9a700 1 --2- 172.21.15.84:0/1765935218 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fddc41500d0 0x7fddc41f09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:37.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.717+0000 7fddc9b9c700 1 -- 172.21.15.84:0/1765935218 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fddc4070890 msgr2=0x7fddc41f1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:37.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.717+0000 7fddc9b9c700 1 --2- 172.21.15.84:0/1765935218 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fddc4070890 0x7fddc41f1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:37.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.717+0000 7fddc9b9c700 1 -- 172.21.15.84:0/1765935218 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fddc41500d0 msgr2=0x7fddc41f09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:37.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.717+0000 7fddc9b9c700 1 --2- 172.21.15.84:0/1765935218 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fddc41500d0 0x7fddc41f09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:37.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.717+0000 7fddc9b9c700 1 -- 172.21.15.84:0/1765935218 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb400b7f0 con 0x7fddc4159d00 2023-07-14T11:13:37.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.717+0000 7fddc9b9c700 1 --2- 172.21.15.84:0/1765935218 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddc4159d00 0x7fddc41f0f30 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fddbc007e60 tx=0x7fddbc00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:37.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.718+0000 7fddb9ffb700 1 -- 172.21.15.84:0/1765935218 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddbc00ed30 con 0x7fddc4159d00 2023-07-14T11:13:37.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.718+0000 7fddb9ffb700 1 -- 172.21.15.84:0/1765935218 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddbc014420 con 0x7fddc4159d00 2023-07-14T11:13:37.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.718+0000 7fddb9ffb700 1 -- 172.21.15.84:0/1765935218 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddbc0147d0 con 0x7fddc4159d00 2023-07-14T11:13:37.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.718+0000 7fddcb5ff700 1 -- 172.21.15.84:0/1765935218 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddc41eea60 con 0x7fddc4159d00 2023-07-14T11:13:37.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.718+0000 7fddcb5ff700 1 -- 172.21.15.84:0/1765935218 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddc41f1dc0 con 0x7fddc4159d00 2023-07-14T11:13:37.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.719+0000 7fddcb5ff700 1 -- 172.21.15.84:0/1765935218 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddc41eef80 con 0x7fddc4159d00 2023-07-14T11:13:37.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.720+0000 7fddb9ffb700 1 -- 172.21.15.84:0/1765935218 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fddbc014930 con 0x7fddc4159d00 2023-07-14T11:13:37.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.720+0000 7fddb9ffb700 1 --2- 172.21.15.84:0/1765935218 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fdda806ace0 0x7fdda806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:37.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.721+0000 7fddb9ffb700 1 -- 172.21.15.84:0/1765935218 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fddbc089a80 con 0x7fddc4159d00 2023-07-14T11:13:37.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.721+0000 7fddc939b700 1 --2- 172.21.15.84:0/1765935218 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fdda806ace0 0x7fdda806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:37.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.721+0000 7fddc939b700 1 --2- 172.21.15.84:0/1765935218 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fdda806ace0 0x7fdda806d190 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fddc0006b20 tx=0x7fddc0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:37.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.725+0000 7fddb9ffb700 1 -- 172.21.15.84:0/1765935218 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fddc41eef80 con 0x7fddc4159d00 2023-07-14T11:13:37.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.969+0000 7fddcb5ff700 1 -- 172.21.15.84:0/1765935218 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fddc41eef80 con 0x7fddc4159d00 2023-07-14T11:13:37.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.969+0000 7fddb9ffb700 1 -- 172.21.15.84:0/1765935218 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fddc41eef80 con 0x7fddc4159d00 2023-07-14T11:13:37.972 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-14T11:13:37.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.972+0000 7fddcb5ff700 1 -- 172.21.15.84:0/1765935218 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fdda806ace0 msgr2=0x7fdda806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:37.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.972+0000 7fddcb5ff700 1 --2- 172.21.15.84:0/1765935218 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fdda806ace0 0x7fdda806d190 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fddc0006b20 tx=0x7fddc0008040 comp rx=0 tx=0).stop 2023-07-14T11:13:37.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.972+0000 7fddcb5ff700 1 -- 172.21.15.84:0/1765935218 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddc4159d00 msgr2=0x7fddc41f0f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:37.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.972+0000 7fddcb5ff700 1 --2- 172.21.15.84:0/1765935218 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddc4159d00 0x7fddc41f0f30 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fddbc007e60 tx=0x7fddbc00e3c0 comp rx=0 tx=0).stop 2023-07-14T11:13:37.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.972+0000 7fddcb5ff700 1 -- 172.21.15.84:0/1765935218 shutdown_connections 2023-07-14T11:13:37.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.972+0000 7fddcb5ff700 1 --2- 172.21.15.84:0/1765935218 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fdda806ace0 0x7fdda806d190 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:37.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.972+0000 7fddcb5ff700 1 --2- 172.21.15.84:0/1765935218 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fddc4070890 0x7fddc41f1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:37.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.972+0000 7fddcb5ff700 1 --2- 172.21.15.84:0/1765935218 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddc4159d00 0x7fddc41f0f30 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:37.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.972+0000 7fddcb5ff700 1 --2- 172.21.15.84:0/1765935218 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fddc41500d0 0x7fddc41f09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:37.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.972+0000 7fddcb5ff700 1 -- 172.21.15.84:0/1765935218 >> 172.21.15.84:0/1765935218 conn(0x7fddc4069f30 msgr2=0x7fddc4158c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:37.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.972+0000 7fddcb5ff700 1 -- 172.21.15.84:0/1765935218 shutdown_connections 2023-07-14T11:13:37.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:37.972+0000 7fddcb5ff700 1 -- 172.21.15.84:0/1765935218 wait complete. 2023-07-14T11:13:37.992 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-14T11:13:37.992 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-14T11:13:37.993 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi084.front.sepia.ceph.com 2023-07-14T11:13:37.993 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-07-14T11:13:37.993 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-07-14T11:13:37.993 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-14T11:13:37.993 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-14T11:13:37.994 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-14T11:13:37.994 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-07-14T11:13:37.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:37.994 DEBUG:teuthology.orchestra.run.smithi084:> ip addr 2023-07-14T11:13:38.040 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-14T11:13:38.041 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-14T11:13:38.041 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2023-07-14T11:13:38.041 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:13:38.041 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2023-07-14T11:13:38.041 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:13:38.041 INFO:teuthology.orchestra.run.smithi084.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T11:13:38.042 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:68 brd ff:ff:ff:ff:ff:ff 2023-07-14T11:13:38.042 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f0 2023-07-14T11:13:38.042 INFO:teuthology.orchestra.run.smithi084.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T11:13:38.042 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:69 brd ff:ff:ff:ff:ff:ff 2023-07-14T11:13:38.042 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f1 2023-07-14T11:13:38.042 INFO:teuthology.orchestra.run.smithi084.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T11:13:38.042 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:50 brd ff:ff:ff:ff:ff:ff 2023-07-14T11:13:38.043 INFO:teuthology.orchestra.run.smithi084.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-14T11:13:38.043 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:51 brd ff:ff:ff:ff:ff:ff 2023-07-14T11:13:38.043 INFO:teuthology.orchestra.run.smithi084.stdout: inet 172.21.15.84/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-14T11:13:38.043 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft 41950sec preferred_lft 41950sec 2023-07-14T11:13:38.043 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::ec4:7aff:fe8f:d751/64 scope link 2023-07-14T11:13:38.043 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:13:38.043 INFO:teuthology.orchestra.run.smithi084.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-14T11:13:38.043 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 2e:15:90:61:8f:22 brd ff:ff:ff:ff:ff:ff 2023-07-14T11:13:38.044 INFO:teuthology.orchestra.run.smithi084.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-14T11:13:38.044 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:13:38.044 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::dc90:1eff:feca:b2b4/64 scope link 2023-07-14T11:13:38.044 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:13:38.044 INFO:teuthology.orchestra.run.smithi084.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-14T11:13:38.044 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 2e:15:90:61:8f:22 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-14T11:13:38.044 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::2c15:90ff:fe61:8f22/64 scope link 2023-07-14T11:13:38.045 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:13:38.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:38.046 DEBUG:teuthology.orchestra.run.smithi084:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-14T11:13:38.112 INFO:teuthology.orchestra.run.smithi084.stdout:1 2023-07-14T11:13:38.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:38.115 DEBUG:teuthology.orchestra.run.smithi084:> route 2023-07-14T11:13:38.164 INFO:teuthology.orchestra.run.smithi084.stdout:Kernel IP routing table 2023-07-14T11:13:38.165 INFO:teuthology.orchestra.run.smithi084.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-14T11:13:38.165 INFO:teuthology.orchestra.run.smithi084.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-14T11:13:38.165 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-14T11:13:38.165 INFO:teuthology.orchestra.run.smithi084.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-14T11:13:38.166 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:38.166 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-07-14T11:13:38.167 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-07-14T11:13:38.167 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-14T11:13:38.167 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-14T11:13:38.167 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-14T11:13:38.168 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-07-14T11:13:38.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:38.335 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2023-07-14T11:13:38.381 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-14T11:13:38.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:38.383 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list-id 2023-07-14T11:13:38.468 INFO:teuthology.orchestra.run.smithi084.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-07-14T11:13:38.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:38.470 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-07-14T11:13:38.470 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-07-14T11:13:38.470 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-14T11:13:38.471 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-07-14T11:13:38.471 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-07-14T11:13:38.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:38.613 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-07-14T11:13:38.684 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-14T11:13:38.685 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-14T11:13:38.685 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2023-07-14T11:13:38.685 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:13:38.685 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2023-07-14T11:13:38.685 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:13:38.685 INFO:teuthology.orchestra.run.smithi084.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-14T11:13:38.685 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether ca:78:8e:68:d0:bc brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-14T11:13:38.686 INFO:teuthology.orchestra.run.smithi084.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-14T11:13:38.686 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:13:38.686 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::c878:8eff:fe68:d0bc/64 scope link 2023-07-14T11:13:38.686 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:13:38.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:38.688 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-07-14T11:13:38.757 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-14T11:13:38.758 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-14T11:13:38.758 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2023-07-14T11:13:38.758 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:13:38.758 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2023-07-14T11:13:38.758 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:13:38.758 INFO:teuthology.orchestra.run.smithi084.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-14T11:13:38.759 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether ca:78:8e:68:d0:bc brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-14T11:13:38.759 INFO:teuthology.orchestra.run.smithi084.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-14T11:13:38.759 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:13:38.759 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::c878:8eff:fe68:d0bc/64 scope link 2023-07-14T11:13:38.759 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:13:38.760 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-07-14T11:13:38.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:38.761 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-07-14T11:13:38.761 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-07-14T11:13:38.762 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-07-14T11:13:38.762 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-07-14T11:13:38.762 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-07-14T11:13:38.762 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-07-14T11:13:38.762 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-07-14T11:13:38.763 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-07-14T11:13:39.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:39.009 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-07-14T11:13:39.010 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-07-14T11:13:39.010 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set brx.1 up 2023-07-14T11:13:39.010 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set dev brx.1 master ceph-brx 2023-07-14T11:13:39.010 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-07-14T11:13:39.183 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T11:13:39.183 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-07-14T11:13:39.229 INFO:teuthology.orchestra.run.smithi084.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-07-14T11:13:39.229 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T11:13:39.230 DEBUG:teuthology.orchestra.run.smithi084:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-07-14T11:13:39.274 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2023-07-14T11:13:39.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:39.274 DEBUG:teuthology.orchestra.run.smithi084:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-14T11:13:39.417 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-14T11:13:39.417 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-14T11:13:39.445 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-14T11:13:39.445 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-14T11:13:39.445 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-07-14T11:13:39.445 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: trying mount with new device syntax: 2@3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f.cephfs=/ 2023-07-14T11:13:39.446 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.84:3300/172.21.15.179:3300/172.21.15.179:3301" will pass to kernel 2023-07-14T11:13:39.450 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-14T11:13:39.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:39.450 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-07-14T11:13:39.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:39.518 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-14T11:13:39.606 INFO:teuthology.orchestra.run.smithi084.stdout:client4490 2023-07-14T11:13:39.606 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-14T11:13:39.607 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:13:39.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:39.652 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-14T11:13:39.779 INFO:teuthology.orchestra.run.smithi084.stdout:client4490 2023-07-14T11:13:39.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:39.781 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-14T11:13:39.869 INFO:teuthology.orchestra.run.smithi084.stdout:client4490 2023-07-14T11:13:39.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:39.870 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f.client4490/status') 2023-07-14T11:13:39.978 INFO:teuthology.orchestra.run.smithi084.stdout:instance: client.4490 (3)172.21.15.84:0/1367151151 2023-07-14T11:13:39.978 INFO:teuthology.orchestra.run.smithi084.stdout:blocklisted: false 2023-07-14T11:13:39.978 INFO:teuthology.orchestra.run.smithi084.stderr:0+1 records in 2023-07-14T11:13:39.978 INFO:teuthology.orchestra.run.smithi084.stderr:0+1 records out 2023-07-14T11:13:39.979 INFO:teuthology.orchestra.run.smithi084.stderr:70 bytes copied, 6.8978e-05 s, 1.0 MB/s 2023-07-14T11:13:39.980 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2023-07-14T11:13:39.981 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-14T11:13:39.981 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-14T11:13:39.981 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-14T11:13:40.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:40.177+0000 7f140c7ff700 1 Processor -- start 2023-07-14T11:13:40.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:40.177+0000 7f140c7ff700 1 -- start start 2023-07-14T11:13:40.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:40.178+0000 7f140c7ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f14041500d0 0x7f1404070350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:40.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:40.178+0000 7f140c7ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14040cdf90 con 0x7f14040cea50 2023-07-14T11:13:40.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:40.178+0000 7f140c7ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f140415a2f0 con 0x7f1404070890 2023-07-14T11:13:40.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:40.178+0000 7f140c7ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f140415a5d0 con 0x7f14041500d0 2023-07-14T11:13:40.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:40.178+0000 7f140a59b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f14041500d0 0x7f1404070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:40.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:40.178+0000 7f140ad9c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f14040cea50 0x7f14040b2690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50330/0 (socket says 172.21.15.84:50330) 2023-07-14T11:13:40.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:40.178+0000 7f140a59b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f14041500d0 0x7f1404070350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55804/0 (socket says 172.21.15.84:55804) 2023-07-14T11:13:40.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:40.178+0000 7f140ad9c700 1 -- 172.21.15.84:0/2586750306 learned_addr learned my addr 172.21.15.84:0/2586750306 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:13:40.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:40.179+0000 7f140a59b700 1 -- 172.21.15.84:0/2586750306 >> v1:172.21.15.179:6789/0 conn(0x7f1404070890 legacy=0x7f14041597c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:40.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:40.179+0000 7f140a59b700 1 -- 172.21.15.84:0/2586750306 >> v1:172.21.15.84:6789/0 conn(0x7f14040cea50 legacy=0x7f14040b2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:40.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:40.179+0000 7f140a59b700 1 -- 172.21.15.84:0/2586750306 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14040ce250 con 0x7f14041500d0 2023-07-14T11:13:40.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:40.179+0000 7f1409599700 1 -- 172.21.15.84:0/2586750306 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2551807278 0 0) 0x7f14040cdf90 con 0x7f14040cea50 2023-07-14T11:13:40.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:40.179+0000 7f140a59b700 1 --2- 172.21.15.84:0/2586750306 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14041500d0 0x7f1404070350 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1400009840 tx=0x7f1400009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=890fa0571d933648 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:40.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:40.179+0000 7f1409599700 1 -- 172.21.15.84:0/2586750306 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1400011830 con 0x7f14041500d0 2023-07-14T11:13:40.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:40.179+0000 7f1409599700 1 -- 172.21.15.84:0/2586750306 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1400011990 con 0x7f14041500d0 2023-07-14T11:13:40.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:40.179+0000 7f1409599700 1 -- 172.21.15.84:0/2586750306 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1400011d20 con 0x7f14041500d0 2023-07-14T11:13:40.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:40.180+0000 7f140c7ff700 1 -- 172.21.15.84:0/2586750306 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14041500d0 msgr2=0x7f1404070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:40.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:40.180+0000 7f140c7ff700 1 --2- 172.21.15.84:0/2586750306 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14041500d0 0x7f1404070350 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1400009840 tx=0x7f1400009b50 comp rx=0 tx=0).stop 2023-07-14T11:13:40.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:40.180+0000 7f140c7ff700 1 -- 172.21.15.84:0/2586750306 shutdown_connections 2023-07-14T11:13:40.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:40.180+0000 7f140c7ff700 1 --2- 172.21.15.84:0/2586750306 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14041500d0 0x7f1404070350 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:40.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:40.180+0000 7f140c7ff700 1 -- 172.21.15.84:0/2586750306 >> 172.21.15.84:0/2586750306 conn(0x7f1404069f30 msgr2=0x7f140406a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:40.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:40.180+0000 7f140c7ff700 1 -- 172.21.15.84:0/2586750306 shutdown_connections 2023-07-14T11:13:40.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:40.180+0000 7f140c7ff700 1 -- 172.21.15.84:0/2586750306 wait complete. 2023-07-14T11:13:40.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:40.182+0000 7f140c7ff700 1 Processor -- start 2023-07-14T11:13:40.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:40.182+0000 7f140c7ff700 1 -- start start 2023-07-14T11:13:40.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:40.183+0000 7f140c7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1404070890 0x7f14041504a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:40.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:40.183+0000 7f140c7ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14040cea50 0x7f14041509e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:40.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:40.183+0000 7f140c7ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14041500d0 0x7f1404141e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:40.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:40.183+0000 7f140c7ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1404144410 con 0x7f14041500d0 2023-07-14T11:13:40.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:40.183+0000 7f140c7ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1404143b70 con 0x7f14040cea50 2023-07-14T11:13:40.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:40.183+0000 7f140c7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1404143e50 con 0x7f1404070890 2023-07-14T11:13:40.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:40.183+0000 7f140ad9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14041500d0 0x7f1404141e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:40.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:40.183+0000 7f140ad9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14041500d0 0x7f1404141e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55808/0 (socket says 172.21.15.84:55808) 2023-07-14T11:13:40.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:40.183+0000 7f140ad9c700 1 -- 172.21.15.84:0/1727439428 learned_addr learned my addr 172.21.15.84:0/1727439428 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:40.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:40.183+0000 7f1409d9a700 1 --2- 172.21.15.84:0/1727439428 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14040cea50 0x7f14041509e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:40.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:40.183+0000 7f140a59b700 1 --2- 172.21.15.84:0/1727439428 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1404070890 0x7f14041504a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:40.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:40.183+0000 7f140ad9c700 1 -- 172.21.15.84:0/1727439428 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1404070890 msgr2=0x7f14041504a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:40.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:40.183+0000 7f140ad9c700 1 --2- 172.21.15.84:0/1727439428 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1404070890 0x7f14041504a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:40.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:40.183+0000 7f140ad9c700 1 -- 172.21.15.84:0/1727439428 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14040cea50 msgr2=0x7f14041509e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:40.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:40.183+0000 7f140ad9c700 1 --2- 172.21.15.84:0/1727439428 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14040cea50 0x7f14041509e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:40.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:40.184+0000 7f140ad9c700 1 -- 172.21.15.84:0/1727439428 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14000094a0 con 0x7f14041500d0 2023-07-14T11:13:40.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:40.184+0000 7f140ad9c700 1 --2- 172.21.15.84:0/1727439428 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14041500d0 0x7f1404141e60 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f13fc00cca0 tx=0x7f13fc00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:40.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:40.184+0000 7f13faffd700 1 -- 172.21.15.84:0/1727439428 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13fc00ab70 con 0x7f14041500d0 2023-07-14T11:13:40.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:40.184+0000 7f13faffd700 1 -- 172.21.15.84:0/1727439428 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13fc00acd0 con 0x7f14041500d0 2023-07-14T11:13:40.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:40.184+0000 7f13faffd700 1 -- 172.21.15.84:0/1727439428 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13fc007310 con 0x7f14041500d0 2023-07-14T11:13:40.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:40.184+0000 7f140c7ff700 1 -- 172.21.15.84:0/1727439428 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1404144130 con 0x7f14041500d0 2023-07-14T11:13:40.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:40.184+0000 7f140c7ff700 1 -- 172.21.15.84:0/1727439428 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1404151190 con 0x7f14041500d0 2023-07-14T11:13:40.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:40.185+0000 7f140c7ff700 1 -- 172.21.15.84:0/1727439428 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1404146200 con 0x7f14041500d0 2023-07-14T11:13:40.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:40.186+0000 7f13faffd700 1 -- 172.21.15.84:0/1727439428 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f13fc007470 con 0x7f14041500d0 2023-07-14T11:13:40.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:40.187+0000 7f13faffd700 1 --2- 172.21.15.84:0/1727439428 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f13e806ace0 0x7f13e806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:40.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:40.187+0000 7f13faffd700 1 -- 172.21.15.84:0/1727439428 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f13fc089010 con 0x7f14041500d0 2023-07-14T11:13:40.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:40.187+0000 7f140a59b700 1 --2- 172.21.15.84:0/1727439428 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f13e806ace0 0x7f13e806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:40.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:40.188+0000 7f140a59b700 1 --2- 172.21.15.84:0/1727439428 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f13e806ace0 0x7f13e806d190 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f14000090b0 tx=0x7f140001c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:40.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:40.191+0000 7f13faffd700 1 -- 172.21.15.84:0/1727439428 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f1404146200 con 0x7f14041500d0 2023-07-14T11:13:40.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:40.428+0000 7f140c7ff700 1 -- 172.21.15.84:0/1727439428 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f14041465e0 con 0x7f14041500d0 2023-07-14T11:13:40.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:40.429+0000 7f13faffd700 1 -- 172.21.15.84:0/1727439428 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f14041465e0 con 0x7f14041500d0 2023-07-14T11:13:40.431 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-14T11:13:40.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:40.431+0000 7f140c7ff700 1 -- 172.21.15.84:0/1727439428 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f13e806ace0 msgr2=0x7f13e806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:40.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:40.431+0000 7f140c7ff700 1 --2- 172.21.15.84:0/1727439428 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f13e806ace0 0x7f13e806d190 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f14000090b0 tx=0x7f140001c040 comp rx=0 tx=0).stop 2023-07-14T11:13:40.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:40.431+0000 7f140c7ff700 1 -- 172.21.15.84:0/1727439428 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14041500d0 msgr2=0x7f1404141e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:40.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:40.431+0000 7f140c7ff700 1 --2- 172.21.15.84:0/1727439428 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14041500d0 0x7f1404141e60 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f13fc00cca0 tx=0x7f13fc00a060 comp rx=0 tx=0).stop 2023-07-14T11:13:40.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:40.431+0000 7f140c7ff700 1 -- 172.21.15.84:0/1727439428 shutdown_connections 2023-07-14T11:13:40.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:40.431+0000 7f140c7ff700 1 --2- 172.21.15.84:0/1727439428 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f13e806ace0 0x7f13e806d190 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:40.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:40.431+0000 7f140c7ff700 1 --2- 172.21.15.84:0/1727439428 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1404070890 0x7f14041504a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:40.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:40.431+0000 7f140c7ff700 1 --2- 172.21.15.84:0/1727439428 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14041500d0 0x7f1404141e60 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:40.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:40.431+0000 7f140c7ff700 1 --2- 172.21.15.84:0/1727439428 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14040cea50 0x7f14041509e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:40.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:40.431+0000 7f140c7ff700 1 -- 172.21.15.84:0/1727439428 >> 172.21.15.84:0/1727439428 conn(0x7f1404069f30 msgr2=0x7f14040cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:40.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:40.431+0000 7f140c7ff700 1 -- 172.21.15.84:0/1727439428 shutdown_connections 2023-07-14T11:13:40.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:40.431+0000 7f140c7ff700 1 -- 172.21.15.84:0/1727439428 wait complete. 2023-07-14T11:13:40.450 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-14T11:13:40.451 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-14T11:13:40.451 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi179.front.sepia.ceph.com 2023-07-14T11:13:40.451 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-07-14T11:13:40.451 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-14T11:13:40.451 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-14T11:13:40.452 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-14T11:13:40.452 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-14T11:13:40.452 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-14T11:13:40.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:40.453 DEBUG:teuthology.orchestra.run.smithi179:> ip addr 2023-07-14T11:13:40.503 INFO:teuthology.orchestra.run.smithi179.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-14T11:13:40.504 INFO:teuthology.orchestra.run.smithi179.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-14T11:13:40.504 INFO:teuthology.orchestra.run.smithi179.stdout: inet 127.0.0.1/8 scope host lo 2023-07-14T11:13:40.504 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:13:40.504 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 ::1/128 scope host 2023-07-14T11:13:40.504 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:13:40.504 INFO:teuthology.orchestra.run.smithi179.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T11:13:40.505 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:34 brd ff:ff:ff:ff:ff:ff 2023-07-14T11:13:40.505 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f0 2023-07-14T11:13:40.505 INFO:teuthology.orchestra.run.smithi179.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T11:13:40.505 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:35 brd ff:ff:ff:ff:ff:ff 2023-07-14T11:13:40.505 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f1 2023-07-14T11:13:40.505 INFO:teuthology.orchestra.run.smithi179.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T11:13:40.505 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5a brd ff:ff:ff:ff:ff:ff 2023-07-14T11:13:40.505 INFO:teuthology.orchestra.run.smithi179.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-14T11:13:40.506 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5b brd ff:ff:ff:ff:ff:ff 2023-07-14T11:13:40.506 INFO:teuthology.orchestra.run.smithi179.stdout: inet 172.21.15.179/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-14T11:13:40.506 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft 41835sec preferred_lft 41835sec 2023-07-14T11:13:40.506 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::ec4:7aff:fe88:725b/64 scope link 2023-07-14T11:13:40.506 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:13:40.507 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-07-14T11:13:40.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:40.508 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2023-07-14T11:13:40.508 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2023-07-14T11:13:40.508 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link add name ceph-brx type bridge 2023-07-14T11:13:40.508 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip addr flush dev ceph-brx 2023-07-14T11:13:40.508 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link set ceph-brx up 2023-07-14T11:13:40.509 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-07-14T11:13:40.509 DEBUG:teuthology.orchestra.run.smithi179:> ') 2023-07-14T11:13:40.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:40.950 DEBUG:teuthology.orchestra.run.smithi179:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-14T11:13:41.061 INFO:teuthology.orchestra.run.smithi179.stdout:1 2023-07-14T11:13:41.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:41.065 DEBUG:teuthology.orchestra.run.smithi179:> route 2023-07-14T11:13:41.126 INFO:teuthology.orchestra.run.smithi179.stdout:Kernel IP routing table 2023-07-14T11:13:41.126 INFO:teuthology.orchestra.run.smithi179.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-14T11:13:41.126 INFO:teuthology.orchestra.run.smithi179.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-14T11:13:41.126 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-14T11:13:41.127 INFO:teuthology.orchestra.run.smithi179.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-14T11:13:41.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:41.128 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2023-07-14T11:13:41.128 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2023-07-14T11:13:41.128 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-14T11:13:41.129 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-14T11:13:41.129 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-14T11:13:41.129 DEBUG:teuthology.orchestra.run.smithi179:> ') 2023-07-14T11:13:41.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:41.823 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2023-07-14T11:13:41.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:41.871 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list-id 2023-07-14T11:13:41.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:41.918 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2023-07-14T11:13:41.918 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2023-07-14T11:13:41.918 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-14T11:13:41.919 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-07-14T11:13:41.919 DEBUG:teuthology.orchestra.run.smithi179:> ') 2023-07-14T11:13:42.060 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-07-14T11:13:42.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:42.061 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2023-07-14T11:13:42.061 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2023-07-14T11:13:42.062 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-07-14T11:13:42.062 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-07-14T11:13:42.062 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-07-14T11:13:42.062 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-07-14T11:13:42.063 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-07-14T11:13:42.063 DEBUG:teuthology.orchestra.run.smithi179:> ') 2023-07-14T11:13:42.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:42.333 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2023-07-14T11:13:42.334 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2023-07-14T11:13:42.334 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link set brx.0 up 2023-07-14T11:13:42.335 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link set dev brx.0 master ceph-brx 2023-07-14T11:13:42.335 DEBUG:teuthology.orchestra.run.smithi179:> ') 2023-07-14T11:13:42.508 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T11:13:42.508 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-07-14T11:13:42.554 INFO:teuthology.orchestra.run.smithi179.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-07-14T11:13:42.554 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T11:13:42.554 DEBUG:teuthology.orchestra.run.smithi179:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-07-14T11:13:42.599 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-07-14T11:13:42.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:42.600 DEBUG:teuthology.orchestra.run.smithi179:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-14T11:13:42.744 INFO:teuthology.orchestra.run.smithi179.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-14T11:13:42.744 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-14T11:13:43.190 INFO:teuthology.orchestra.run.smithi179.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-14T11:13:43.190 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-14T11:13:43.190 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-07-14T11:13:43.190 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: trying mount with new device syntax: 1@3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f.cephfs=/ 2023-07-14T11:13:43.190 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.84:3300/172.21.15.179:3300/172.21.15.179:3301" will pass to kernel 2023-07-14T11:13:43.195 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-14T11:13:43.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:43.196 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-07-14T11:13:43.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:43.266 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-14T11:13:43.364 INFO:teuthology.orchestra.run.smithi179.stdout:client4657 2023-07-14T11:13:43.364 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-07-14T11:13:43.365 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:13:43.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:43.412 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-14T11:13:43.538 INFO:teuthology.orchestra.run.smithi179.stdout:client4657 2023-07-14T11:13:43.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:43.539 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-14T11:13:43.626 INFO:teuthology.orchestra.run.smithi179.stdout:client4657 2023-07-14T11:13:43.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:43.627 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f.client4657/status') 2023-07-14T11:13:43.734 INFO:teuthology.orchestra.run.smithi179.stdout:instance: client.4657 (3)192.168.0.1:0/1602686364 2023-07-14T11:13:43.735 INFO:teuthology.orchestra.run.smithi179.stdout:blocklisted: false 2023-07-14T11:13:43.735 INFO:teuthology.orchestra.run.smithi179.stderr:0+1 records in 2023-07-14T11:13:43.735 INFO:teuthology.orchestra.run.smithi179.stderr:0+1 records out 2023-07-14T11:13:43.735 INFO:teuthology.orchestra.run.smithi179.stderr:69 bytes copied, 4.9938e-05 s, 1.4 MB/s 2023-07-14T11:13:43.737 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2023-07-14T11:13:43.737 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-14T11:13:43.738 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-07-14T11:13:43.738 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-14T11:13:43.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:43.940+0000 7f53ae1ff700 1 Processor -- start 2023-07-14T11:13:43.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:43.940+0000 7f53ae1ff700 1 -- start start 2023-07-14T11:13:43.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:43.941+0000 7f53ae1ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f53a81500d0 0x7f53a8070350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:43.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:43.941+0000 7f53ae1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53a8070890 0x7f53a81597c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:43.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:43.941+0000 7f53ae1ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53a80cdf90 con 0x7f53a8159d00 2023-07-14T11:13:43.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:43.941+0000 7f53ae1ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53a815a2f0 con 0x7f53a81500d0 2023-07-14T11:13:43.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:43.941+0000 7f53ae1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53a815a5d0 con 0x7f53a8070890 2023-07-14T11:13:43.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:43.942+0000 7f53a77fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f53a81500d0 0x7f53a8070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:43.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:43.942+0000 7f53a7fff700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f53a8159d00 0x7f53a80cea50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.84:53210/0 (socket says 172.21.15.84:53210) 2023-07-14T11:13:43.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:43.942+0000 7f53a7fff700 1 -- 172.21.15.84:0/489192462 learned_addr learned my addr 172.21.15.84:0/489192462 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:13:43.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:43.942+0000 7f53a6ffd700 1 --2- 172.21.15.84:0/489192462 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53a8070890 0x7f53a81597c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:43.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:43.942+0000 7f53a67fc700 1 -- 172.21.15.84:0/489192462 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1603975009 0 0) 0x7f53a80cdf90 con 0x7f53a8159d00 2023-07-14T11:13:43.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:43.942+0000 7f53a67fc700 1 -- 172.21.15.84:0/489192462 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53900035b0 con 0x7f53a8159d00 2023-07-14T11:13:43.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:43.942+0000 7f53a77fe700 1 -- 172.21.15.84:0/489192462 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53a8070890 msgr2=0x7f53a81597c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:43.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:43.942+0000 7f53a77fe700 1 --2- 172.21.15.84:0/489192462 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53a8070890 0x7f53a81597c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:43.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:43.942+0000 7f53a77fe700 1 -- 172.21.15.84:0/489192462 >> v1:172.21.15.179:6789/0 conn(0x7f53a8159d00 legacy=0x7f53a80cea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:43.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:43.942+0000 7f53a77fe700 1 -- 172.21.15.84:0/489192462 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53a80ce250 con 0x7f53a81500d0 2023-07-14T11:13:43.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:43.942+0000 7f53a6ffd700 1 --2- 172.21.15.84:0/489192462 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53a8070890 0x7f53a81597c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:13:43.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:43.943+0000 7f53a77fe700 1 --2- 172.21.15.84:0/489192462 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53a81500d0 0x7f53a8070350 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5398009840 tx=0x7f5398009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=90a9dba33c80460c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:43.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:43.943+0000 7f53a67fc700 1 -- 172.21.15.84:0/489192462 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5398011830 con 0x7f53a81500d0 2023-07-14T11:13:43.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:43.943+0000 7f53a67fc700 1 -- 172.21.15.84:0/489192462 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5398011990 con 0x7f53a81500d0 2023-07-14T11:13:43.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:43.943+0000 7f53a67fc700 1 -- 172.21.15.84:0/489192462 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5398011d20 con 0x7f53a81500d0 2023-07-14T11:13:43.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:43.943+0000 7f53ae1ff700 1 -- 172.21.15.84:0/489192462 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53a81500d0 msgr2=0x7f53a8070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:43.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:43.943+0000 7f53ae1ff700 1 --2- 172.21.15.84:0/489192462 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53a81500d0 0x7f53a8070350 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5398009840 tx=0x7f5398009b50 comp rx=0 tx=0).stop 2023-07-14T11:13:43.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:43.943+0000 7f53ae1ff700 1 -- 172.21.15.84:0/489192462 shutdown_connections 2023-07-14T11:13:43.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:43.943+0000 7f53ae1ff700 1 --2- 172.21.15.84:0/489192462 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53a81500d0 0x7f53a8070350 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:43.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:43.943+0000 7f53ae1ff700 1 --2- 172.21.15.84:0/489192462 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53a8070890 0x7f53a81597c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:43.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:43.943+0000 7f53ae1ff700 1 -- 172.21.15.84:0/489192462 >> 172.21.15.84:0/489192462 conn(0x7f53a8069f30 msgr2=0x7f53a806a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:43.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:43.943+0000 7f53ae1ff700 1 -- 172.21.15.84:0/489192462 shutdown_connections 2023-07-14T11:13:43.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:43.944+0000 7f53ae1ff700 1 -- 172.21.15.84:0/489192462 wait complete. 2023-07-14T11:13:43.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:43.945+0000 7f53ae1ff700 1 Processor -- start 2023-07-14T11:13:43.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:43.945+0000 7f53ae1ff700 1 -- start start 2023-07-14T11:13:43.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:43.946+0000 7f53ae1ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53a8070890 0x7f53a8150bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:43.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:43.946+0000 7f53ae1ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53a81500d0 0x7f53a8135060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:43.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:43.946+0000 7f53ae1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53a8159d00 0x7f53a81370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:43.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:43.946+0000 7f53ae1ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a8152c00 con 0x7f53a81500d0 2023-07-14T11:13:43.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:43.946+0000 7f53ae1ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a8151110 con 0x7f53a8070890 2023-07-14T11:13:43.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:43.946+0000 7f53ae1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53a8137b70 con 0x7f53a8159d00 2023-07-14T11:13:43.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:43.947+0000 7f53a6ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53a81500d0 0x7f53a8135060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:43.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:43.947+0000 7f53a6ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53a81500d0 0x7f53a8135060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55820/0 (socket says 172.21.15.84:55820) 2023-07-14T11:13:43.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:43.947+0000 7f53a6ffd700 1 -- 172.21.15.84:0/2382174041 learned_addr learned my addr 172.21.15.84:0/2382174041 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:43.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:43.947+0000 7f53a77fe700 1 --2- 172.21.15.84:0/2382174041 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53a8070890 0x7f53a8150bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:43.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:43.947+0000 7f53a7fff700 1 --2- 172.21.15.84:0/2382174041 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53a8159d00 0x7f53a81370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:43.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:43.947+0000 7f53a6ffd700 1 -- 172.21.15.84:0/2382174041 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53a8159d00 msgr2=0x7f53a81370c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:43.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:43.947+0000 7f53a6ffd700 1 --2- 172.21.15.84:0/2382174041 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53a8159d00 0x7f53a81370c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:43.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:43.947+0000 7f53a6ffd700 1 -- 172.21.15.84:0/2382174041 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53a8070890 msgr2=0x7f53a8150bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:43.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:43.947+0000 7f53a6ffd700 1 --2- 172.21.15.84:0/2382174041 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53a8070890 0x7f53a8150bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:43.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:43.947+0000 7f53a6ffd700 1 -- 172.21.15.84:0/2382174041 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f539c0094a0 con 0x7f53a81500d0 2023-07-14T11:13:43.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:43.947+0000 7f53a6ffd700 1 --2- 172.21.15.84:0/2382174041 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53a81500d0 0x7f53a8135060 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f539c00ebe0 tx=0x7f539c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:43.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:43.947+0000 7f538ffff700 1 -- 172.21.15.84:0/2382174041 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539c00c850 con 0x7f53a81500d0 2023-07-14T11:13:43.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:43.948+0000 7f538ffff700 1 -- 172.21.15.84:0/2382174041 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f539c00c9b0 con 0x7f53a81500d0 2023-07-14T11:13:43.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:43.948+0000 7f538ffff700 1 -- 172.21.15.84:0/2382174041 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539c00cd40 con 0x7f53a81500d0 2023-07-14T11:13:43.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:43.948+0000 7f53ae1ff700 1 -- 172.21.15.84:0/2382174041 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53980094a0 con 0x7f53a81500d0 2023-07-14T11:13:43.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:43.948+0000 7f53ae1ff700 1 -- 172.21.15.84:0/2382174041 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53a8152820 con 0x7f53a81500d0 2023-07-14T11:13:43.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:43.949+0000 7f53ae1ff700 1 -- 172.21.15.84:0/2382174041 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53a8138090 con 0x7f53a81500d0 2023-07-14T11:13:43.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:43.950+0000 7f538ffff700 1 -- 172.21.15.84:0/2382174041 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f539c013470 con 0x7f53a81500d0 2023-07-14T11:13:43.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:43.950+0000 7f538ffff700 1 --2- 172.21.15.84:0/2382174041 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f539406ace0 0x7f539406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:43.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:43.951+0000 7f538ffff700 1 -- 172.21.15.84:0/2382174041 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f539c089530 con 0x7f53a81500d0 2023-07-14T11:13:43.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:43.951+0000 7f53a77fe700 1 --2- 172.21.15.84:0/2382174041 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f539406ace0 0x7f539406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:43.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:43.951+0000 7f53a77fe700 1 --2- 172.21.15.84:0/2382174041 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f539406ace0 0x7f539406d190 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5398000c00 tx=0x7f5398008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:43.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:43.955+0000 7f538ffff700 1 -- 172.21.15.84:0/2382174041 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f539c0545d0 con 0x7f53a81500d0 2023-07-14T11:13:44.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:44.192+0000 7f53ae1ff700 1 -- 172.21.15.84:0/2382174041 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f53a8152d40 con 0x7f53a81500d0 2023-07-14T11:13:44.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:44.192+0000 7f538ffff700 1 -- 172.21.15.84:0/2382174041 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f53a8152d40 con 0x7f53a81500d0 2023-07-14T11:13:44.195 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-14T11:13:44.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:44.195+0000 7f53ae1ff700 1 -- 172.21.15.84:0/2382174041 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f539406ace0 msgr2=0x7f539406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:44.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:44.195+0000 7f53ae1ff700 1 --2- 172.21.15.84:0/2382174041 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f539406ace0 0x7f539406d190 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5398000c00 tx=0x7f5398008030 comp rx=0 tx=0).stop 2023-07-14T11:13:44.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:44.195+0000 7f53ae1ff700 1 -- 172.21.15.84:0/2382174041 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53a81500d0 msgr2=0x7f53a8135060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:44.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:44.195+0000 7f53ae1ff700 1 --2- 172.21.15.84:0/2382174041 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53a81500d0 0x7f53a8135060 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f539c00ebe0 tx=0x7f539c00eef0 comp rx=0 tx=0).stop 2023-07-14T11:13:44.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:44.195+0000 7f53ae1ff700 1 -- 172.21.15.84:0/2382174041 shutdown_connections 2023-07-14T11:13:44.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:44.195+0000 7f53ae1ff700 1 --2- 172.21.15.84:0/2382174041 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f539406ace0 0x7f539406d190 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:44.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:44.195+0000 7f53ae1ff700 1 --2- 172.21.15.84:0/2382174041 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53a8159d00 0x7f53a81370c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:44.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:44.195+0000 7f53ae1ff700 1 --2- 172.21.15.84:0/2382174041 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53a8070890 0x7f53a8150bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:44.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:44.195+0000 7f53ae1ff700 1 --2- 172.21.15.84:0/2382174041 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53a81500d0 0x7f53a8135060 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:44.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:44.195+0000 7f53ae1ff700 1 -- 172.21.15.84:0/2382174041 >> 172.21.15.84:0/2382174041 conn(0x7f53a8069f30 msgr2=0x7f53a80b2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:44.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:44.195+0000 7f53ae1ff700 1 -- 172.21.15.84:0/2382174041 shutdown_connections 2023-07-14T11:13:44.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:44.195+0000 7f53ae1ff700 1 -- 172.21.15.84:0/2382174041 wait complete. 2023-07-14T11:13:44.215 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-14T11:13:44.215 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-14T11:13:44.215 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi179.front.sepia.ceph.com 2023-07-14T11:13:44.215 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-07-14T11:13:44.216 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-07-14T11:13:44.216 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-14T11:13:44.216 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-14T11:13:44.216 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-14T11:13:44.217 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-07-14T11:13:44.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:44.217 DEBUG:teuthology.orchestra.run.smithi179:> ip addr 2023-07-14T11:13:44.266 INFO:teuthology.orchestra.run.smithi179.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-14T11:13:44.266 INFO:teuthology.orchestra.run.smithi179.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-14T11:13:44.266 INFO:teuthology.orchestra.run.smithi179.stdout: inet 127.0.0.1/8 scope host lo 2023-07-14T11:13:44.266 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:13:44.267 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 ::1/128 scope host 2023-07-14T11:13:44.267 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:13:44.267 INFO:teuthology.orchestra.run.smithi179.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T11:13:44.267 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:34 brd ff:ff:ff:ff:ff:ff 2023-07-14T11:13:44.267 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f0 2023-07-14T11:13:44.267 INFO:teuthology.orchestra.run.smithi179.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T11:13:44.267 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:35 brd ff:ff:ff:ff:ff:ff 2023-07-14T11:13:44.268 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f1 2023-07-14T11:13:44.268 INFO:teuthology.orchestra.run.smithi179.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T11:13:44.268 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5a brd ff:ff:ff:ff:ff:ff 2023-07-14T11:13:44.268 INFO:teuthology.orchestra.run.smithi179.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-14T11:13:44.268 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5b brd ff:ff:ff:ff:ff:ff 2023-07-14T11:13:44.268 INFO:teuthology.orchestra.run.smithi179.stdout: inet 172.21.15.179/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-14T11:13:44.268 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft 41831sec preferred_lft 41831sec 2023-07-14T11:13:44.268 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::ec4:7aff:fe88:725b/64 scope link 2023-07-14T11:13:44.269 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:13:44.269 INFO:teuthology.orchestra.run.smithi179.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-14T11:13:44.269 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 92:db:40:bf:aa:be brd ff:ff:ff:ff:ff:ff 2023-07-14T11:13:44.269 INFO:teuthology.orchestra.run.smithi179.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-14T11:13:44.269 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:13:44.269 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::fc06:a1ff:feba:ddf1/64 scope link 2023-07-14T11:13:44.269 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:13:44.270 INFO:teuthology.orchestra.run.smithi179.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-14T11:13:44.270 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 92:db:40:bf:aa:be brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-14T11:13:44.270 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::90db:40ff:febf:aabe/64 scope link 2023-07-14T11:13:44.270 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:13:44.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:44.271 DEBUG:teuthology.orchestra.run.smithi179:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-14T11:13:44.338 INFO:teuthology.orchestra.run.smithi179.stdout:1 2023-07-14T11:13:44.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:44.341 DEBUG:teuthology.orchestra.run.smithi179:> route 2023-07-14T11:13:44.389 INFO:teuthology.orchestra.run.smithi179.stdout:Kernel IP routing table 2023-07-14T11:13:44.390 INFO:teuthology.orchestra.run.smithi179.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-14T11:13:44.390 INFO:teuthology.orchestra.run.smithi179.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-14T11:13:44.390 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-14T11:13:44.390 INFO:teuthology.orchestra.run.smithi179.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-14T11:13:44.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:44.391 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2023-07-14T11:13:44.392 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2023-07-14T11:13:44.392 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-14T11:13:44.392 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-14T11:13:44.392 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-14T11:13:44.393 DEBUG:teuthology.orchestra.run.smithi179:> ') 2023-07-14T11:13:44.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:44.562 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2023-07-14T11:13:44.607 INFO:teuthology.orchestra.run.smithi179.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-14T11:13:44.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:44.610 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list-id 2023-07-14T11:13:44.655 INFO:teuthology.orchestra.run.smithi179.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-07-14T11:13:44.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:44.657 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2023-07-14T11:13:44.658 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2023-07-14T11:13:44.658 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-07-14T11:13:44.659 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-07-14T11:13:44.659 DEBUG:teuthology.orchestra.run.smithi179:> ') 2023-07-14T11:13:44.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:44.839 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-07-14T11:13:44.908 INFO:teuthology.orchestra.run.smithi179.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-14T11:13:44.909 INFO:teuthology.orchestra.run.smithi179.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-14T11:13:44.909 INFO:teuthology.orchestra.run.smithi179.stdout: inet 127.0.0.1/8 scope host lo 2023-07-14T11:13:44.909 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:13:44.909 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 ::1/128 scope host 2023-07-14T11:13:44.909 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:13:44.909 INFO:teuthology.orchestra.run.smithi179.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-14T11:13:44.910 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 92:fe:fc:cf:a2:55 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-14T11:13:44.910 INFO:teuthology.orchestra.run.smithi179.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-14T11:13:44.910 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:13:44.910 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::90fe:fcff:fecf:a255/64 scope link 2023-07-14T11:13:44.910 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:13:44.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:44.911 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-07-14T11:13:44.982 INFO:teuthology.orchestra.run.smithi179.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-14T11:13:44.982 INFO:teuthology.orchestra.run.smithi179.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-14T11:13:44.982 INFO:teuthology.orchestra.run.smithi179.stdout: inet 127.0.0.1/8 scope host lo 2023-07-14T11:13:44.983 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:13:44.983 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 ::1/128 scope host 2023-07-14T11:13:44.983 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:13:44.983 INFO:teuthology.orchestra.run.smithi179.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-14T11:13:44.983 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 92:fe:fc:cf:a2:55 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-14T11:13:44.983 INFO:teuthology.orchestra.run.smithi179.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-14T11:13:44.983 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:13:44.984 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::90fe:fcff:fecf:a255/64 scope link 2023-07-14T11:13:44.984 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:13:44.985 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-07-14T11:13:44.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:44.986 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2023-07-14T11:13:44.986 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2023-07-14T11:13:44.986 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-07-14T11:13:44.986 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-07-14T11:13:44.987 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-07-14T11:13:44.987 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-07-14T11:13:44.987 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-07-14T11:13:44.987 DEBUG:teuthology.orchestra.run.smithi179:> ') 2023-07-14T11:13:45.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:45.226 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2023-07-14T11:13:45.227 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2023-07-14T11:13:45.227 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link set brx.1 up 2023-07-14T11:13:45.227 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link set dev brx.1 master ceph-brx 2023-07-14T11:13:45.227 DEBUG:teuthology.orchestra.run.smithi179:> ') 2023-07-14T11:13:45.398 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T11:13:45.399 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-07-14T11:13:45.444 INFO:teuthology.orchestra.run.smithi179.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-07-14T11:13:45.445 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T11:13:45.445 DEBUG:teuthology.orchestra.run.smithi179:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-07-14T11:13:45.529 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2023-07-14T11:13:45.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:45.529 DEBUG:teuthology.orchestra.run.smithi179:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-14T11:13:45.672 INFO:teuthology.orchestra.run.smithi179.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-14T11:13:45.673 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-14T11:13:45.699 INFO:teuthology.orchestra.run.smithi179.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-14T11:13:45.700 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-14T11:13:45.700 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-07-14T11:13:45.700 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: trying mount with new device syntax: 3@3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f.cephfs=/ 2023-07-14T11:13:45.700 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.84:3300/172.21.15.179:3300/172.21.15.179:3301" will pass to kernel 2023-07-14T11:13:45.704 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-14T11:13:45.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:45.705 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-07-14T11:13:45.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:45.775 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-14T11:13:45.863 INFO:teuthology.orchestra.run.smithi179.stdout:client4692 2023-07-14T11:13:45.863 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-07-14T11:13:45.864 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:13:45.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:45.909 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-14T11:13:46.037 INFO:teuthology.orchestra.run.smithi179.stdout:client4692 2023-07-14T11:13:46.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:46.037 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-14T11:13:46.124 INFO:teuthology.orchestra.run.smithi179.stdout:client4692 2023-07-14T11:13:46.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:46.125 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f.client4692/status') 2023-07-14T11:13:46.231 INFO:teuthology.orchestra.run.smithi179.stdout:instance: client.4692 (3)172.21.15.179:0/4270894337 2023-07-14T11:13:46.231 INFO:teuthology.orchestra.run.smithi179.stdout:blocklisted: false 2023-07-14T11:13:46.231 INFO:teuthology.orchestra.run.smithi179.stderr:0+1 records in 2023-07-14T11:13:46.232 INFO:teuthology.orchestra.run.smithi179.stderr:0+1 records out 2023-07-14T11:13:46.232 INFO:teuthology.orchestra.run.smithi179.stderr:71 bytes copied, 6.924e-05 s, 1.0 MB/s 2023-07-14T11:13:46.234 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-07-14T11:13:46.252 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:13:46.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.456+0000 7f472a9ff700 1 Processor -- start 2023-07-14T11:13:46.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.456+0000 7f472a9ff700 1 -- start start 2023-07-14T11:13:46.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.457+0000 7f472a9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4724141ff0 0x7f4724158fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:46.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.457+0000 7f472a9ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4724070710 0x7f47240b4000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:46.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.457+0000 7f472a9ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47240b4540 con 0x7f47240b1a70 2023-07-14T11:13:46.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.457+0000 7f472a9ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4724071140 con 0x7f4724070710 2023-07-14T11:13:46.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.457+0000 7f472a9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f472406c110 con 0x7f4724141ff0 2023-07-14T11:13:46.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.457+0000 7f47237fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4724070710 0x7f47240b4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:46.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.457+0000 7f47237fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4724070710 0x7f47240b4000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55836/0 (socket says 172.21.15.84:55836) 2023-07-14T11:13:46.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.457+0000 7f47237fe700 1 -- 172.21.15.84:0/3003035370 learned_addr learned my addr 172.21.15.84:0/3003035370 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:46.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.458+0000 7f4723fff700 1 --2- 172.21.15.84:0/3003035370 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4724141ff0 0x7f4724158fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:46.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.458+0000 7f47237fe700 1 -- 172.21.15.84:0/3003035370 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4724141ff0 msgr2=0x7f4724158fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:46.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.458+0000 7f47237fe700 1 --2- 172.21.15.84:0/3003035370 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4724141ff0 0x7f4724158fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:46.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.458+0000 7f47237fe700 1 -- 172.21.15.84:0/3003035370 >> v1:172.21.15.179:6789/0 conn(0x7f47240b1a70 legacy=0x7f472406c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:46.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.458+0000 7f47237fe700 1 -- 172.21.15.84:0/3003035370 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4724070e60 con 0x7f4724070710 2023-07-14T11:13:46.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.458+0000 7f47237fe700 1 --2- 172.21.15.84:0/3003035370 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4724070710 0x7f47240b4000 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f47180098f0 tx=0x7f4718009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6c999d7e0027710 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:46.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.458+0000 7f4722ffd700 1 -- 172.21.15.84:0/3003035370 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471800b8a0 con 0x7f4724070710 2023-07-14T11:13:46.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.458+0000 7f4722ffd700 1 -- 172.21.15.84:0/3003035370 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f471800ba00 con 0x7f4724070710 2023-07-14T11:13:46.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.458+0000 7f4722ffd700 1 -- 172.21.15.84:0/3003035370 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471800bd90 con 0x7f4724070710 2023-07-14T11:13:46.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.459+0000 7f472a9ff700 1 -- 172.21.15.84:0/3003035370 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4724070710 msgr2=0x7f47240b4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:46.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.459+0000 7f472a9ff700 1 --2- 172.21.15.84:0/3003035370 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4724070710 0x7f47240b4000 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f47180098f0 tx=0x7f4718009c00 comp rx=0 tx=0).stop 2023-07-14T11:13:46.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.459+0000 7f472a9ff700 1 -- 172.21.15.84:0/3003035370 shutdown_connections 2023-07-14T11:13:46.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.459+0000 7f472a9ff700 1 --2- 172.21.15.84:0/3003035370 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4724141ff0 0x7f4724158fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:46.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.459+0000 7f472a9ff700 1 --2- 172.21.15.84:0/3003035370 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4724070710 0x7f47240b4000 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:46.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.459+0000 7f472a9ff700 1 -- 172.21.15.84:0/3003035370 >> 172.21.15.84:0/3003035370 conn(0x7f4724069f30 msgr2=0x7f472406a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:46.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.459+0000 7f472a9ff700 1 -- 172.21.15.84:0/3003035370 shutdown_connections 2023-07-14T11:13:46.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.459+0000 7f472a9ff700 1 -- 172.21.15.84:0/3003035370 wait complete. 2023-07-14T11:13:46.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.461+0000 7f472a9ff700 1 Processor -- start 2023-07-14T11:13:46.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.461+0000 7f472a9ff700 1 -- start start 2023-07-14T11:13:46.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.462+0000 7f472a9ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4724070710 0x7f472413de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:46.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.462+0000 7f472a9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f47240b1a70 0x7f4724154a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:46.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.462+0000 7f472a9ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4724141ff0 0x7f472413c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:46.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.462+0000 7f472a9ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4724153a20 con 0x7f4724141ff0 2023-07-14T11:13:46.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.462+0000 7f472a9ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4724153cc0 con 0x7f4724070710 2023-07-14T11:13:46.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.462+0000 7f472a9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4724153fa0 con 0x7f47240b1a70 2023-07-14T11:13:46.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.462+0000 7f4728f9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4724141ff0 0x7f472413c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:46.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.462+0000 7f4728f9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4724141ff0 0x7f472413c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55848/0 (socket says 172.21.15.84:55848) 2023-07-14T11:13:46.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.462+0000 7f4728f9c700 1 -- 172.21.15.84:0/3770718430 learned_addr learned my addr 172.21.15.84:0/3770718430 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:46.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.462+0000 7f4728f9c700 1 -- 172.21.15.84:0/3770718430 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f47240b1a70 msgr2=0x7f4724154a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:46.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.462+0000 7f4728f9c700 1 --2- 172.21.15.84:0/3770718430 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f47240b1a70 0x7f4724154a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:46.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.462+0000 7f4723fff700 1 --2- 172.21.15.84:0/3770718430 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4724070710 0x7f472413de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:46.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.462+0000 7f4728f9c700 1 -- 172.21.15.84:0/3770718430 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4724070710 msgr2=0x7f472413de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:46.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.463+0000 7f4728f9c700 1 --2- 172.21.15.84:0/3770718430 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4724070710 0x7f472413de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:46.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.463+0000 7f4728f9c700 1 -- 172.21.15.84:0/3770718430 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4718009550 con 0x7f4724141ff0 2023-07-14T11:13:46.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.463+0000 7f4723fff700 1 --2- 172.21.15.84:0/3770718430 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4724070710 0x7f472413de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:13:46.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.463+0000 7f4728f9c700 1 --2- 172.21.15.84:0/3770718430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4724141ff0 0x7f472413c900 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f471c00cc50 tx=0x7f471c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:46.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.463+0000 7f4720ff9700 1 -- 172.21.15.84:0/3770718430 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471c00ad80 con 0x7f4724141ff0 2023-07-14T11:13:46.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.463+0000 7f4720ff9700 1 -- 172.21.15.84:0/3770718430 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f471c00ce50 con 0x7f4724141ff0 2023-07-14T11:13:46.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.463+0000 7f472a9ff700 1 -- 172.21.15.84:0/3770718430 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4724154280 con 0x7f4724141ff0 2023-07-14T11:13:46.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.463+0000 7f4720ff9700 1 -- 172.21.15.84:0/3770718430 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471c003c40 con 0x7f4724141ff0 2023-07-14T11:13:46.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.463+0000 7f472a9ff700 1 -- 172.21.15.84:0/3770718430 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f472413d560 con 0x7f4724141ff0 2023-07-14T11:13:46.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.464+0000 7f472a9ff700 1 -- 172.21.15.84:0/3770718430 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47241547a0 con 0x7f4724141ff0 2023-07-14T11:13:46.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.465+0000 7f4720ff9700 1 -- 172.21.15.84:0/3770718430 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f471c0050d0 con 0x7f4724141ff0 2023-07-14T11:13:46.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.466+0000 7f4720ff9700 1 --2- 172.21.15.84:0/3770718430 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f471006ace0 0x7f471006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:46.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.466+0000 7f4720ff9700 1 -- 172.21.15.84:0/3770718430 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f471c0893d0 con 0x7f4724141ff0 2023-07-14T11:13:46.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.466+0000 7f4723fff700 1 --2- 172.21.15.84:0/3770718430 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f471006ace0 0x7f471006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:46.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.467+0000 7f4723fff700 1 --2- 172.21.15.84:0/3770718430 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f471006ace0 0x7f471006d190 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f472412ef70 tx=0x7f4714008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:46.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.470+0000 7f4720ff9700 1 -- 172.21.15.84:0/3770718430 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f47241547a0 con 0x7f4724141ff0 2023-07-14T11:13:46.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.665+0000 7f472a9ff700 1 -- 172.21.15.84:0/3770718430 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f47240b4540 con 0x7f4724141ff0 2023-07-14T11:13:46.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.666+0000 7f4720ff9700 1 -- 172.21.15.84:0/3770718430 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18255 (secure 0 0 0) 0x7f47240b4540 con 0x7f4724141ff0 2023-07-14T11:13:46.669 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:13:46.669 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":23,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:13:15.989292+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-14T11:13:12.727811+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-14T11:13:13.436391+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:13:46.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.668+0000 7f472a9ff700 1 -- 172.21.15.84:0/3770718430 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f471006ace0 msgr2=0x7f471006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:46.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.668+0000 7f472a9ff700 1 --2- 172.21.15.84:0/3770718430 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f471006ace0 0x7f471006d190 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f472412ef70 tx=0x7f4714008040 comp rx=0 tx=0).stop 2023-07-14T11:13:46.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.668+0000 7f472a9ff700 1 -- 172.21.15.84:0/3770718430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4724141ff0 msgr2=0x7f472413c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:46.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.668+0000 7f472a9ff700 1 --2- 172.21.15.84:0/3770718430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4724141ff0 0x7f472413c900 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f471c00cc50 tx=0x7f471c00a340 comp rx=0 tx=0).stop 2023-07-14T11:13:46.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.668+0000 7f472a9ff700 1 -- 172.21.15.84:0/3770718430 shutdown_connections 2023-07-14T11:13:46.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.668+0000 7f472a9ff700 1 --2- 172.21.15.84:0/3770718430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4724141ff0 0x7f472413c900 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:46.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.668+0000 7f472a9ff700 1 --2- 172.21.15.84:0/3770718430 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4724070710 0x7f472413de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:46.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.668+0000 7f472a9ff700 1 --2- 172.21.15.84:0/3770718430 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f471006ace0 0x7f471006d190 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:46.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.668+0000 7f472a9ff700 1 --2- 172.21.15.84:0/3770718430 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f47240b1a70 0x7f4724154a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:46.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.668+0000 7f472a9ff700 1 -- 172.21.15.84:0/3770718430 >> 172.21.15.84:0/3770718430 conn(0x7f4724069f30 msgr2=0x7f47240714d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:46.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.669+0000 7f472a9ff700 1 -- 172.21.15.84:0/3770718430 shutdown_connections 2023-07-14T11:13:46.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.669+0000 7f472a9ff700 1 -- 172.21.15.84:0/3770718430 wait complete. 2023-07-14T11:13:46.688 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T11:13:00.125395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T11:13:06.803994+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T11:13:12.727811+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T11:13:13.436391+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T11:13:46.689 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T11:13:46.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.887+0000 7f75e5fff700 1 Processor -- start 2023-07-14T11:13:46.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.887+0000 7f75e5fff700 1 -- start start 2023-07-14T11:13:46.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.888+0000 7f75e5fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f75e00d0f90 0x7f75e00b1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:46.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.888+0000 7f75e5fff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75e00b8e30 con 0x7f75e00b8a60 2023-07-14T11:13:46.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.888+0000 7f75e5fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75e00afaa0 con 0x7f75e00d0b10 2023-07-14T11:13:46.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.888+0000 7f75e5fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75e00afd80 con 0x7f75e00d0f90 2023-07-14T11:13:46.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.888+0000 7f75df7fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f75e00b8a60 0x7f75e00b3ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50344/0 (socket says 172.21.15.84:50344) 2023-07-14T11:13:46.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.888+0000 7f75df7fe700 1 -- 172.21.15.84:0/3615750038 learned_addr learned my addr 172.21.15.84:0/3615750038 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:13:46.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.889+0000 7f75dffff700 1 --2- 172.21.15.84:0/3615750038 >> v2:172.21.15.179:3300/0 conn(0x7f75e00d0f90 0x7f75e00b1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:46.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.889+0000 7f75deffd700 1 -- 172.21.15.84:0/3615750038 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2666784508 0 0) 0x7f75e00b8e30 con 0x7f75e00b8a60 2023-07-14T11:13:46.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.889+0000 7f75deffd700 1 -- 172.21.15.84:0/3615750038 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75cc0035b0 con 0x7f75e00b8a60 2023-07-14T11:13:46.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.889+0000 7f75deffd700 1 -- 172.21.15.84:0/3615750038 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 34866938 0 0) 0x7f75cc0035b0 con 0x7f75e00b8a60 2023-07-14T11:13:46.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.889+0000 7f75deffd700 1 -- 172.21.15.84:0/3615750038 >> v2:172.21.15.179:3300/0 conn(0x7f75e00d0f90 msgr2=0x7f75e00b1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:46.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.889+0000 7f75deffd700 1 --2- 172.21.15.84:0/3615750038 >> v2:172.21.15.179:3300/0 conn(0x7f75e00d0f90 0x7f75e00b1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:46.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.889+0000 7f75deffd700 1 -- 172.21.15.84:0/3615750038 >> v1:172.21.15.179:6789/0 conn(0x7f75e00d0b10 legacy=0x7f75e00b0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:46.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.889+0000 7f75deffd700 1 -- 172.21.15.84:0/3615750038 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75e00b0060 con 0x7f75e00b8a60 2023-07-14T11:13:46.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.889+0000 7f75deffd700 1 -- 172.21.15.84:0/3615750038 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7f75d0001670 con 0x7f75e00b8a60 2023-07-14T11:13:46.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.889+0000 7f75deffd700 1 -- 172.21.15.84:0/3615750038 >> v1:172.21.15.84:6789/0 conn(0x7f75e00b8a60 legacy=0x7f75e00b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:46.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.889+0000 7f75deffd700 1 --2- 172.21.15.84:0/3615750038 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75cc003a00 0x7f75cc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:46.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.889+0000 7f75deffd700 1 --2- 172.21.15.84:0/3615750038 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75cc0043f0 0x7f75cc0048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:46.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.889+0000 7f75deffd700 1 --2- 172.21.15.84:0/3615750038 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75cc0050b0 0x7f75cc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:46.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.889+0000 7f75deffd700 1 -- 172.21.15.84:0/3615750038 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75e00afd80 con 0x7f75cc0050b0 2023-07-14T11:13:46.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.889+0000 7f75deffd700 1 -- 172.21.15.84:0/3615750038 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75cc00bf50 con 0x7f75cc0043f0 2023-07-14T11:13:46.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.889+0000 7f75deffd700 1 -- 172.21.15.84:0/3615750038 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75cc00c110 con 0x7f75cc003a00 2023-07-14T11:13:46.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.889+0000 7f75dffff700 1 --2- 172.21.15.84:0/3615750038 >> v2:172.21.15.179:3300/0 conn(0x7f75e00d0f90 0x7f75e00b1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:13:46.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.890+0000 7f75dffff700 1 --2- 172.21.15.84:0/3615750038 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75cc0050b0 0x7f75cc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:46.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.890+0000 7f75df7fe700 1 --2- 172.21.15.84:0/3615750038 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75cc003a00 0x7f75cc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:46.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.890+0000 7f75d7fff700 1 --2- 172.21.15.84:0/3615750038 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75cc0043f0 0x7f75cc0048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:46.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.890+0000 7f75dffff700 1 -- 172.21.15.84:0/3615750038 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75cc003a00 msgr2=0x7f75cc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:46.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.890+0000 7f75dffff700 1 --2- 172.21.15.84:0/3615750038 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75cc003a00 0x7f75cc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:46.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.890+0000 7f75dffff700 1 -- 172.21.15.84:0/3615750038 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75cc0043f0 msgr2=0x7f75cc0048b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:46.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.890+0000 7f75dffff700 1 --2- 172.21.15.84:0/3615750038 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75cc0043f0 0x7f75cc0048b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:46.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.890+0000 7f75dffff700 1 -- 172.21.15.84:0/3615750038 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75cc0035b0 con 0x7f75cc0050b0 2023-07-14T11:13:46.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.890+0000 7f75dffff700 1 -- 172.21.15.84:0/3615750038 reap_dead start 2023-07-14T11:13:46.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.890+0000 7f75dffff700 1 --2- 172.21.15.84:0/3615750038 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75cc0050b0 0x7f75cc00ba10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f75d800e350 tx=0x7f75cc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=138c06be4dee47a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:46.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.890+0000 7f75deffd700 1 -- 172.21.15.84:0/3615750038 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d800ee10 con 0x7f75cc0050b0 2023-07-14T11:13:46.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.890+0000 7f75deffd700 1 -- 172.21.15.84:0/3615750038 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75d800f040 con 0x7f75cc0050b0 2023-07-14T11:13:46.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.890+0000 7f75deffd700 1 -- 172.21.15.84:0/3615750038 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d8003c40 con 0x7f75cc0050b0 2023-07-14T11:13:46.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.891+0000 7f75e5fff700 1 -- 172.21.15.84:0/3615750038 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75cc0050b0 msgr2=0x7f75cc00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:46.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.891+0000 7f75e5fff700 1 --2- 172.21.15.84:0/3615750038 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75cc0050b0 0x7f75cc00ba10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f75d800e350 tx=0x7f75cc005880 comp rx=0 tx=0).stop 2023-07-14T11:13:46.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.891+0000 7f75e5fff700 1 -- 172.21.15.84:0/3615750038 shutdown_connections 2023-07-14T11:13:46.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.891+0000 7f75e5fff700 1 --2- 172.21.15.84:0/3615750038 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75cc0050b0 0x7f75cc00ba10 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:46.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.891+0000 7f75e5fff700 1 -- 172.21.15.84:0/3615750038 >> 172.21.15.84:0/3615750038 conn(0x7f75e009c1b0 msgr2=0x7f75e00d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:46.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.891+0000 7f75e5fff700 1 -- 172.21.15.84:0/3615750038 shutdown_connections 2023-07-14T11:13:46.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.891+0000 7f75e5fff700 1 -- 172.21.15.84:0/3615750038 wait complete. 2023-07-14T11:13:46.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.893+0000 7f75e5fff700 1 Processor -- start 2023-07-14T11:13:46.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.893+0000 7f75e5fff700 1 -- start start 2023-07-14T11:13:46.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.894+0000 7f75e5fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75cc0050b0 0x7f75e01f5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:46.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.894+0000 7f75e5fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75e00b7c10 0x7f75e00ca010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:46.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.894+0000 7f75e5fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75e00b6bd0 0x7f75e00b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:46.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.894+0000 7f75e5fff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75e0150c80 con 0x7f75cc0050b0 2023-07-14T11:13:46.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.894+0000 7f75e5fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75e01f6470 con 0x7f75e00b7c10 2023-07-14T11:13:46.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.894+0000 7f75e5fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75e00b7580 con 0x7f75e00b6bd0 2023-07-14T11:13:46.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.894+0000 7f75df7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75cc0050b0 0x7f75e01f5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:46.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.894+0000 7f75df7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75cc0050b0 0x7f75e01f5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55868/0 (socket says 172.21.15.84:55868) 2023-07-14T11:13:46.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.894+0000 7f75df7fe700 1 -- 172.21.15.84:0/59158474 learned_addr learned my addr 172.21.15.84:0/59158474 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:46.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.895+0000 7f75dffff700 1 --2- 172.21.15.84:0/59158474 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75e00b6bd0 0x7f75e00b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:46.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.895+0000 7f75d7fff700 1 --2- 172.21.15.84:0/59158474 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75e00b7c10 0x7f75e00ca010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:46.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.895+0000 7f75df7fe700 1 -- 172.21.15.84:0/59158474 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75e00b6bd0 msgr2=0x7f75e00b7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:46.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.895+0000 7f75df7fe700 1 --2- 172.21.15.84:0/59158474 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75e00b6bd0 0x7f75e00b7040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:46.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.895+0000 7f75df7fe700 1 -- 172.21.15.84:0/59158474 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75e00b7c10 msgr2=0x7f75e00ca010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:46.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.895+0000 7f75df7fe700 1 --2- 172.21.15.84:0/59158474 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75e00b7c10 0x7f75e00ca010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:46.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.895+0000 7f75df7fe700 1 -- 172.21.15.84:0/59158474 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75e015fd90 con 0x7f75cc0050b0 2023-07-14T11:13:46.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.895+0000 7f75df7fe700 1 --2- 172.21.15.84:0/59158474 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75cc0050b0 0x7f75e01f5f30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f75d00070c0 tx=0x7f75d00073d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:46.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.895+0000 7f75dcff9700 1 -- 172.21.15.84:0/59158474 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d0011580 con 0x7f75cc0050b0 2023-07-14T11:13:46.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.895+0000 7f75dcff9700 1 -- 172.21.15.84:0/59158474 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75d0011700 con 0x7f75cc0050b0 2023-07-14T11:13:46.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.895+0000 7f75dcff9700 1 -- 172.21.15.84:0/59158474 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d0011ab0 con 0x7f75cc0050b0 2023-07-14T11:13:46.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.895+0000 7f75e5fff700 1 -- 172.21.15.84:0/59158474 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75e00ca550 con 0x7f75cc0050b0 2023-07-14T11:13:46.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.895+0000 7f75e5fff700 1 -- 172.21.15.84:0/59158474 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75e01e5280 con 0x7f75cc0050b0 2023-07-14T11:13:46.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.896+0000 7f75e5fff700 1 -- 172.21.15.84:0/59158474 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75e0074350 con 0x7f75cc0050b0 2023-07-14T11:13:46.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.897+0000 7f75dcff9700 1 -- 172.21.15.84:0/59158474 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f75d0011c10 con 0x7f75cc0050b0 2023-07-14T11:13:46.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.898+0000 7f75dcff9700 1 --2- 172.21.15.84:0/59158474 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f75c006ace0 0x7f75c006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:46.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.898+0000 7f75dcff9700 1 -- 172.21.15.84:0/59158474 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f75d00893d0 con 0x7f75cc0050b0 2023-07-14T11:13:46.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.898+0000 7f75d7fff700 1 --2- 172.21.15.84:0/59158474 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f75c006ace0 0x7f75c006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:46.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.899+0000 7f75d7fff700 1 --2- 172.21.15.84:0/59158474 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f75c006ace0 0x7f75c006d190 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f75e01e6e30 tx=0x7f75c8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:46.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:46.903+0000 7f75dcff9700 1 -- 172.21.15.84:0/59158474 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f75d0054470 con 0x7f75cc0050b0 2023-07-14T11:13:47.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.103+0000 7f75e5fff700 1 -- 172.21.15.84:0/59158474 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f75e00d1e20 con 0x7f75cc0050b0 2023-07-14T11:13:47.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.104+0000 7f75dcff9700 1 -- 172.21.15.84:0/59158474 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f75d0057a90 con 0x7f75cc0050b0 2023-07-14T11:13:47.106 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-07-14T11:13:47.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.106+0000 7f75e5fff700 1 -- 172.21.15.84:0/59158474 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f75c006ace0 msgr2=0x7f75c006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:47.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.106+0000 7f75e5fff700 1 --2- 172.21.15.84:0/59158474 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f75c006ace0 0x7f75c006d190 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f75e01e6e30 tx=0x7f75c8009040 comp rx=0 tx=0).stop 2023-07-14T11:13:47.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.106+0000 7f75e5fff700 1 -- 172.21.15.84:0/59158474 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75cc0050b0 msgr2=0x7f75e01f5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:47.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.106+0000 7f75e5fff700 1 --2- 172.21.15.84:0/59158474 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75cc0050b0 0x7f75e01f5f30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f75d00070c0 tx=0x7f75d00073d0 comp rx=0 tx=0).stop 2023-07-14T11:13:47.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.106+0000 7f75e5fff700 1 -- 172.21.15.84:0/59158474 shutdown_connections 2023-07-14T11:13:47.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.106+0000 7f75e5fff700 1 --2- 172.21.15.84:0/59158474 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f75c006ace0 0x7f75c006d190 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:47.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.106+0000 7f75e5fff700 1 --2- 172.21.15.84:0/59158474 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75e00b6bd0 0x7f75e00b7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:47.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.106+0000 7f75e5fff700 1 --2- 172.21.15.84:0/59158474 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75cc0050b0 0x7f75e01f5f30 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:47.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.106+0000 7f75e5fff700 1 --2- 172.21.15.84:0/59158474 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75e00b7c10 0x7f75e00ca010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:47.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.106+0000 7f75e5fff700 1 -- 172.21.15.84:0/59158474 >> 172.21.15.84:0/59158474 conn(0x7f75e009c1b0 msgr2=0x7f75e00d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:47.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.106+0000 7f75e5fff700 1 -- 172.21.15.84:0/59158474 shutdown_connections 2023-07-14T11:13:47.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.106+0000 7f75e5fff700 1 -- 172.21.15.84:0/59158474 wait complete. 2023-07-14T11:13:47.127 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T11:13:47.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.322+0000 7f245edff700 1 Processor -- start 2023-07-14T11:13:47.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.323+0000 7f245edff700 1 -- start start 2023-07-14T11:13:47.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.324+0000 7f245edff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f24580d0b10 0x7f24580d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:47.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.324+0000 7f245edff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f24580b0e20 0x7f24580b1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:47.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.324+0000 7f245edff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24580b8e30 con 0x7f24580b8a60 2023-07-14T11:13:47.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.324+0000 7f245edff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24580d14d0 con 0x7f24580d0b10 2023-07-14T11:13:47.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.324+0000 7f245edff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24580afaa0 con 0x7f24580b0e20 2023-07-14T11:13:47.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.324+0000 7f2457fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f24580d0b10 0x7f24580d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:47.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.324+0000 7f2457fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f24580d0b10 0x7f24580d0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55878/0 (socket says 172.21.15.84:55878) 2023-07-14T11:13:47.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.324+0000 7f2457fff700 1 -- 172.21.15.84:0/3431960161 learned_addr learned my addr 172.21.15.84:0/3431960161 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:47.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.324+0000 7f245d39c700 1 --2- 172.21.15.84:0/3431960161 >> v2:172.21.15.179:3300/0 conn(0x7f24580b0e20 0x7f24580b1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:47.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.324+0000 7f2457fff700 1 -- 172.21.15.84:0/3431960161 >> v2:172.21.15.179:3300/0 conn(0x7f24580b0e20 msgr2=0x7f24580b1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:47.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.324+0000 7f2457fff700 1 --2- 172.21.15.84:0/3431960161 >> v2:172.21.15.179:3300/0 conn(0x7f24580b0e20 0x7f24580b1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:47.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.324+0000 7f2457fff700 1 -- 172.21.15.84:0/3431960161 >> v1:172.21.15.179:6789/0 conn(0x7f24580b8a60 legacy=0x7f24580b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:47.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.324+0000 7f2457fff700 1 -- 172.21.15.84:0/3431960161 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24580afd80 con 0x7f24580d0b10 2023-07-14T11:13:47.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.325+0000 7f2457fff700 1 --2- 172.21.15.84:0/3431960161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24580d0b10 0x7f24580d0f90 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f24580674e0 tx=0x7f2444009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2660973c858e24f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:47.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.325+0000 7f24577fe700 1 -- 172.21.15.84:0/3431960161 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2444011830 con 0x7f24580d0b10 2023-07-14T11:13:47.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.325+0000 7f24577fe700 1 -- 172.21.15.84:0/3431960161 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2444011990 con 0x7f24580d0b10 2023-07-14T11:13:47.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.325+0000 7f24577fe700 1 -- 172.21.15.84:0/3431960161 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2444011d20 con 0x7f24580d0b10 2023-07-14T11:13:47.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.325+0000 7f245edff700 1 -- 172.21.15.84:0/3431960161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24580d0b10 msgr2=0x7f24580d0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:47.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.325+0000 7f245edff700 1 --2- 172.21.15.84:0/3431960161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24580d0b10 0x7f24580d0f90 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f24580674e0 tx=0x7f2444009bd0 comp rx=0 tx=0).stop 2023-07-14T11:13:47.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.326+0000 7f245edff700 1 -- 172.21.15.84:0/3431960161 shutdown_connections 2023-07-14T11:13:47.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.326+0000 7f245edff700 1 --2- 172.21.15.84:0/3431960161 >> v2:172.21.15.179:3300/0 conn(0x7f24580b0e20 0x7f24580b1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:47.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.326+0000 7f245edff700 1 --2- 172.21.15.84:0/3431960161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24580d0b10 0x7f24580d0f90 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:47.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.326+0000 7f245edff700 1 -- 172.21.15.84:0/3431960161 >> 172.21.15.84:0/3431960161 conn(0x7f245809c1b0 msgr2=0x7f24580d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:47.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.326+0000 7f245edff700 1 -- 172.21.15.84:0/3431960161 shutdown_connections 2023-07-14T11:13:47.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.326+0000 7f245edff700 1 -- 172.21.15.84:0/3431960161 wait complete. 2023-07-14T11:13:47.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.328+0000 7f245edff700 1 Processor -- start 2023-07-14T11:13:47.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.328+0000 7f245edff700 1 -- start start 2023-07-14T11:13:47.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.329+0000 7f245edff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24580b0e20 0x7f245815b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:47.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.329+0000 7f245edff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24580b8a60 0x7f24580cb850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:47.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.329+0000 7f245edff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24580d0b10 0x7f24580cbd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:47.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.330+0000 7f245edff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f245815eab0 con 0x7f24580b8a60 2023-07-14T11:13:47.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.330+0000 7f245edff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24580c7200 con 0x7f24580d0b10 2023-07-14T11:13:47.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.330+0000 7f245edff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f245815b870 con 0x7f24580b0e20 2023-07-14T11:13:47.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.330+0000 7f2457fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24580b8a60 0x7f24580cb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:47.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.330+0000 7f2457fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24580b8a60 0x7f24580cb850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55884/0 (socket says 172.21.15.84:55884) 2023-07-14T11:13:47.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.330+0000 7f2457fff700 1 -- 172.21.15.84:0/2199353734 learned_addr learned my addr 172.21.15.84:0/2199353734 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:47.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.330+0000 7f245cb9b700 1 --2- 172.21.15.84:0/2199353734 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24580b0e20 0x7f245815b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:47.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.330+0000 7f245d39c700 1 --2- 172.21.15.84:0/2199353734 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24580d0b10 0x7f24580cbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:47.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.330+0000 7f2457fff700 1 -- 172.21.15.84:0/2199353734 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24580b0e20 msgr2=0x7f245815b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:47.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.330+0000 7f2457fff700 1 --2- 172.21.15.84:0/2199353734 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24580b0e20 0x7f245815b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:47.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.330+0000 7f2457fff700 1 -- 172.21.15.84:0/2199353734 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24580d0b10 msgr2=0x7f24580cbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:47.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.330+0000 7f2457fff700 1 --2- 172.21.15.84:0/2199353734 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24580d0b10 0x7f24580cbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:47.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.330+0000 7f2457fff700 1 -- 172.21.15.84:0/2199353734 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2444009550 con 0x7f24580b8a60 2023-07-14T11:13:47.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.331+0000 7f2457fff700 1 --2- 172.21.15.84:0/2199353734 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24580b8a60 0x7f24580cb850 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2444009c10 tx=0x7f2444004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:47.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.331+0000 7f24557fa700 1 -- 172.21.15.84:0/2199353734 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2444004510 con 0x7f24580b8a60 2023-07-14T11:13:47.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.331+0000 7f24557fa700 1 -- 172.21.15.84:0/2199353734 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f244401e070 con 0x7f24580b8a60 2023-07-14T11:13:47.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.331+0000 7f245edff700 1 -- 172.21.15.84:0/2199353734 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24580c68d0 con 0x7f24580b8a60 2023-07-14T11:13:47.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.331+0000 7f24557fa700 1 -- 172.21.15.84:0/2199353734 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24440038e0 con 0x7f24580b8a60 2023-07-14T11:13:47.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.331+0000 7f245edff700 1 -- 172.21.15.84:0/2199353734 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24580c6e90 con 0x7f24580b8a60 2023-07-14T11:13:47.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.332+0000 7f245edff700 1 -- 172.21.15.84:0/2199353734 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24580c7370 con 0x7f24580b8a60 2023-07-14T11:13:47.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.333+0000 7f24557fa700 1 -- 172.21.15.84:0/2199353734 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2444003a40 con 0x7f24580b8a60 2023-07-14T11:13:47.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.334+0000 7f24557fa700 1 --2- 172.21.15.84:0/2199353734 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f243c06ace0 0x7f243c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:47.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.334+0000 7f24557fa700 1 -- 172.21.15.84:0/2199353734 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f244408a260 con 0x7f24580b8a60 2023-07-14T11:13:47.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.334+0000 7f245cb9b700 1 --2- 172.21.15.84:0/2199353734 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f243c06ace0 0x7f243c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:47.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.335+0000 7f245cb9b700 1 --2- 172.21.15.84:0/2199353734 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f243c06ace0 0x7f243c06d190 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f244c007fd0 tx=0x7f244c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:47.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.338+0000 7f24557fa700 1 -- 172.21.15.84:0/2199353734 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f2444055300 con 0x7f24580b8a60 2023-07-14T11:13:47.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.533+0000 7f245edff700 1 -- 172.21.15.84:0/2199353734 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2458074350 con 0x7f24580b8a60 2023-07-14T11:13:47.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.534+0000 7f24557fa700 1 -- 172.21.15.84:0/2199353734 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2444058920 con 0x7f24580b8a60 2023-07-14T11:13:47.536 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-07-14T11:13:47.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.536+0000 7f245edff700 1 -- 172.21.15.84:0/2199353734 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f243c06ace0 msgr2=0x7f243c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:47.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.536+0000 7f245edff700 1 --2- 172.21.15.84:0/2199353734 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f243c06ace0 0x7f243c06d190 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f244c007fd0 tx=0x7f244c009040 comp rx=0 tx=0).stop 2023-07-14T11:13:47.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.536+0000 7f245edff700 1 -- 172.21.15.84:0/2199353734 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24580b8a60 msgr2=0x7f24580cb850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:47.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.536+0000 7f245edff700 1 --2- 172.21.15.84:0/2199353734 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24580b8a60 0x7f24580cb850 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2444009c10 tx=0x7f2444004750 comp rx=0 tx=0).stop 2023-07-14T11:13:47.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.536+0000 7f245edff700 1 -- 172.21.15.84:0/2199353734 shutdown_connections 2023-07-14T11:13:47.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.536+0000 7f245edff700 1 --2- 172.21.15.84:0/2199353734 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f243c06ace0 0x7f243c06d190 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:47.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.536+0000 7f245edff700 1 --2- 172.21.15.84:0/2199353734 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24580b0e20 0x7f245815b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:47.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.536+0000 7f245edff700 1 --2- 172.21.15.84:0/2199353734 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24580d0b10 0x7f24580cbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:47.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.536+0000 7f245edff700 1 --2- 172.21.15.84:0/2199353734 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24580b8a60 0x7f24580cb850 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:47.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.536+0000 7f245edff700 1 -- 172.21.15.84:0/2199353734 >> 172.21.15.84:0/2199353734 conn(0x7f245809c1b0 msgr2=0x7f245806a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:47.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.537+0000 7f245edff700 1 -- 172.21.15.84:0/2199353734 shutdown_connections 2023-07-14T11:13:47.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.537+0000 7f245edff700 1 -- 172.21.15.84:0/2199353734 wait complete. 2023-07-14T11:13:47.556 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T11:13:47.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.750+0000 7f6b219ff700 1 Processor -- start 2023-07-14T11:13:47.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.750+0000 7f6b219ff700 1 -- start start 2023-07-14T11:13:47.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.752+0000 7f6b219ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6b1c0d1e40 0x7f6b1c0cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:47.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.752+0000 7f6b219ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6b1c0c71b0 0x7f6b1c0b49d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:47.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.752+0000 7f6b219ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b1c0cd5a0 con 0x7f6b1c15c860 2023-07-14T11:13:47.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.752+0000 7f6b219ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b1c146740 con 0x7f6b1c0d1e40 2023-07-14T11:13:47.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.752+0000 7f6b219ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b1c0cd7f0 con 0x7f6b1c0c71b0 2023-07-14T11:13:47.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.752+0000 7f6b1affd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f6b1c15c860 0x7f6b1c0c6aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50356/0 (socket says 172.21.15.84:50356) 2023-07-14T11:13:47.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.752+0000 7f6b1affd700 1 -- 172.21.15.84:0/3746845138 learned_addr learned my addr 172.21.15.84:0/3746845138 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:13:47.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.752+0000 7f6b13fff700 1 --2- 172.21.15.84:0/3746845138 >> v2:172.21.15.84:3300/0 conn(0x7f6b1c0d1e40 0x7f6b1c0cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:47.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.752+0000 7f6b1b7fe700 1 --2- 172.21.15.84:0/3746845138 >> v2:172.21.15.179:3300/0 conn(0x7f6b1c0c71b0 0x7f6b1c0b49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:47.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.752+0000 7f6b1a7fc700 1 -- 172.21.15.84:0/3746845138 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1521507741 0 0) 0x7f6b1c0cd5a0 con 0x7f6b1c15c860 2023-07-14T11:13:47.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.752+0000 7f6b1a7fc700 1 -- 172.21.15.84:0/3746845138 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b080035b0 con 0x7f6b1c15c860 2023-07-14T11:13:47.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.752+0000 7f6b13fff700 1 -- 172.21.15.84:0/3746845138 >> v2:172.21.15.179:3300/0 conn(0x7f6b1c0c71b0 msgr2=0x7f6b1c0b49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:47.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.752+0000 7f6b13fff700 1 --2- 172.21.15.84:0/3746845138 >> v2:172.21.15.179:3300/0 conn(0x7f6b1c0c71b0 0x7f6b1c0b49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:47.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.752+0000 7f6b13fff700 1 -- 172.21.15.84:0/3746845138 >> v1:172.21.15.84:6789/0 conn(0x7f6b1c15c860 legacy=0x7f6b1c0c6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:47.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.752+0000 7f6b13fff700 1 -- 172.21.15.84:0/3746845138 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b1c0cdad0 con 0x7f6b1c0d1e40 2023-07-14T11:13:47.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.753+0000 7f6b13fff700 1 --2- 172.21.15.84:0/3746845138 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b1c0d1e40 0x7f6b1c0cf2a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c0d0ab0 tx=0x7f6b04009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ec3ca89553eb285 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:47.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.753+0000 7f6b1a7fc700 1 -- 172.21.15.84:0/3746845138 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b04011830 con 0x7f6b1c0d1e40 2023-07-14T11:13:47.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.753+0000 7f6b1a7fc700 1 -- 172.21.15.84:0/3746845138 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b04011990 con 0x7f6b1c0d1e40 2023-07-14T11:13:47.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.753+0000 7f6b1a7fc700 1 -- 172.21.15.84:0/3746845138 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b04011d20 con 0x7f6b1c0d1e40 2023-07-14T11:13:47.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.753+0000 7f6b219ff700 1 -- 172.21.15.84:0/3746845138 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b1c0d1e40 msgr2=0x7f6b1c0cf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:47.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.753+0000 7f6b219ff700 1 --2- 172.21.15.84:0/3746845138 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b1c0d1e40 0x7f6b1c0cf2a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c0d0ab0 tx=0x7f6b04009b20 comp rx=0 tx=0).stop 2023-07-14T11:13:47.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.753+0000 7f6b219ff700 1 -- 172.21.15.84:0/3746845138 shutdown_connections 2023-07-14T11:13:47.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.753+0000 7f6b219ff700 1 --2- 172.21.15.84:0/3746845138 >> v2:172.21.15.179:3300/0 conn(0x7f6b1c0c71b0 0x7f6b1c0b49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:47.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.753+0000 7f6b219ff700 1 --2- 172.21.15.84:0/3746845138 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b1c0d1e40 0x7f6b1c0cf2a0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:47.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.753+0000 7f6b219ff700 1 -- 172.21.15.84:0/3746845138 >> 172.21.15.84:0/3746845138 conn(0x7f6b1c065bd0 msgr2=0x7f6b1c065fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:47.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.754+0000 7f6b219ff700 1 -- 172.21.15.84:0/3746845138 shutdown_connections 2023-07-14T11:13:47.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.754+0000 7f6b219ff700 1 -- 172.21.15.84:0/3746845138 wait complete. 2023-07-14T11:13:47.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.755+0000 7f6b219ff700 1 Processor -- start 2023-07-14T11:13:47.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.755+0000 7f6b219ff700 1 -- start start 2023-07-14T11:13:47.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.756+0000 7f6b219ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b1c0c71b0 0x7f6b1c1f1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:47.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.756+0000 7f6b219ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b1c0d1e40 0x7f6b1c159c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:47.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.756+0000 7f6b219ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b1c15c860 0x7f6b1c15a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:47.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.756+0000 7f6b219ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1c1f2e90 con 0x7f6b1c0d1e40 2023-07-14T11:13:47.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.756+0000 7f6b219ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1c1f3000 con 0x7f6b1c15c860 2023-07-14T11:13:47.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.756+0000 7f6b219ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1c1f28d0 con 0x7f6b1c0c71b0 2023-07-14T11:13:47.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.756+0000 7f6b13fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b1c0d1e40 0x7f6b1c159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:47.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.757+0000 7f6b13fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b1c0d1e40 0x7f6b1c159c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55912/0 (socket says 172.21.15.84:55912) 2023-07-14T11:13:47.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.757+0000 7f6b13fff700 1 -- 172.21.15.84:0/4225792373 learned_addr learned my addr 172.21.15.84:0/4225792373 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:47.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.757+0000 7f6b13fff700 1 -- 172.21.15.84:0/4225792373 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b1c0c71b0 msgr2=0x7f6b1c1f1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:47.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.757+0000 7f6b13fff700 1 --2- 172.21.15.84:0/4225792373 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b1c0c71b0 0x7f6b1c1f1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:47.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.757+0000 7f6b13fff700 1 -- 172.21.15.84:0/4225792373 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b1c15c860 msgr2=0x7f6b1c15a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:47.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.757+0000 7f6b1b7fe700 1 --2- 172.21.15.84:0/4225792373 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b1c15c860 0x7f6b1c15a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:47.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.757+0000 7f6b13fff700 1 --2- 172.21.15.84:0/4225792373 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b1c15c860 0x7f6b1c15a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:47.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.757+0000 7f6b13fff700 1 -- 172.21.15.84:0/4225792373 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b040094a0 con 0x7f6b1c0d1e40 2023-07-14T11:13:47.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.757+0000 7f6b13fff700 1 --2- 172.21.15.84:0/4225792373 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b1c0d1e40 0x7f6b1c159c10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6b04009b60 tx=0x7f6b04004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:47.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.757+0000 7f6b18ff9700 1 -- 172.21.15.84:0/4225792373 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b040038a0 con 0x7f6b1c0d1e40 2023-07-14T11:13:47.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.757+0000 7f6b18ff9700 1 -- 172.21.15.84:0/4225792373 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b0401f070 con 0x7f6b1c0d1e40 2023-07-14T11:13:47.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.757+0000 7f6b18ff9700 1 -- 172.21.15.84:0/4225792373 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b04003c00 con 0x7f6b1c0d1e40 2023-07-14T11:13:47.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.757+0000 7f6b219ff700 1 -- 172.21.15.84:0/4225792373 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b1c1f2bb0 con 0x7f6b1c0d1e40 2023-07-14T11:13:47.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.758+0000 7f6b219ff700 1 -- 172.21.15.84:0/4225792373 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b1c0cb8c0 con 0x7f6b1c0d1e40 2023-07-14T11:13:47.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.759+0000 7f6b219ff700 1 -- 172.21.15.84:0/4225792373 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b1c0cb440 con 0x7f6b1c0d1e40 2023-07-14T11:13:47.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.759+0000 7f6b18ff9700 1 -- 172.21.15.84:0/4225792373 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6b0401a430 con 0x7f6b1c0d1e40 2023-07-14T11:13:47.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.760+0000 7f6b18ff9700 1 --2- 172.21.15.84:0/4225792373 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6afc06ace0 0x7f6afc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:47.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.760+0000 7f6b18ff9700 1 -- 172.21.15.84:0/4225792373 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6b04021070 con 0x7f6b1c0d1e40 2023-07-14T11:13:47.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.761+0000 7f6b1affd700 1 --2- 172.21.15.84:0/4225792373 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6afc06ace0 0x7f6afc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:47.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.761+0000 7f6b1affd700 1 --2- 172.21.15.84:0/4225792373 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6afc06ace0 0x7f6afc06d190 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c1561f0 tx=0x7f6b0c0079c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:47.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.765+0000 7f6b18ff9700 1 -- 172.21.15.84:0/4225792373 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f6b1c0cb440 con 0x7f6b1c0d1e40 2023-07-14T11:13:47.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.958+0000 7f6b219ff700 1 -- 172.21.15.84:0/4225792373 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6b1c0cb440 con 0x7f6b1c0d1e40 2023-07-14T11:13:47.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.958+0000 7f6b18ff9700 1 -- 172.21.15.84:0/4225792373 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6b0402b020 con 0x7f6b1c0d1e40 2023-07-14T11:13:47.960 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-07-14T11:13:47.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.960+0000 7f6b219ff700 1 -- 172.21.15.84:0/4225792373 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6afc06ace0 msgr2=0x7f6afc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:47.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.960+0000 7f6b219ff700 1 --2- 172.21.15.84:0/4225792373 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6afc06ace0 0x7f6afc06d190 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c1561f0 tx=0x7f6b0c0079c0 comp rx=0 tx=0).stop 2023-07-14T11:13:47.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.960+0000 7f6b219ff700 1 -- 172.21.15.84:0/4225792373 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b1c0d1e40 msgr2=0x7f6b1c159c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:47.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.960+0000 7f6b219ff700 1 --2- 172.21.15.84:0/4225792373 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b1c0d1e40 0x7f6b1c159c10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6b04009b60 tx=0x7f6b04004750 comp rx=0 tx=0).stop 2023-07-14T11:13:47.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.960+0000 7f6b219ff700 1 -- 172.21.15.84:0/4225792373 shutdown_connections 2023-07-14T11:13:47.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.960+0000 7f6b219ff700 1 --2- 172.21.15.84:0/4225792373 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6afc06ace0 0x7f6afc06d190 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:47.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.960+0000 7f6b219ff700 1 --2- 172.21.15.84:0/4225792373 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b1c0c71b0 0x7f6b1c1f1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:47.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.960+0000 7f6b219ff700 1 --2- 172.21.15.84:0/4225792373 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b1c15c860 0x7f6b1c15a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:47.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.960+0000 7f6b219ff700 1 --2- 172.21.15.84:0/4225792373 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b1c0d1e40 0x7f6b1c159c10 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:47.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.960+0000 7f6b219ff700 1 -- 172.21.15.84:0/4225792373 >> 172.21.15.84:0/4225792373 conn(0x7f6b1c065bd0 msgr2=0x7f6b1c0d3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:47.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.961+0000 7f6b219ff700 1 -- 172.21.15.84:0/4225792373 shutdown_connections 2023-07-14T11:13:47.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:47.961+0000 7f6b219ff700 1 -- 172.21.15.84:0/4225792373 wait complete. 2023-07-14T11:13:47.981 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T11:13:48.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.178+0000 7f2a565ff700 1 Processor -- start 2023-07-14T11:13:48.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.178+0000 7f2a565ff700 1 -- start start 2023-07-14T11:13:48.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.180+0000 7f2a565ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2a500d0f90 0x7f2a500b1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:48.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.180+0000 7f2a565ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a500b8e30 con 0x7f2a500b8a60 2023-07-14T11:13:48.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.180+0000 7f2a565ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a500afaa0 con 0x7f2a500d0b10 2023-07-14T11:13:48.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.180+0000 7f2a565ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a500afd80 con 0x7f2a500d0f90 2023-07-14T11:13:48.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.180+0000 7f2a54b9c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2a500d0f90 0x7f2a500b1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:48.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.180+0000 7f2a4ffff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f2a500b8a60 0x7f2a500b3ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50360/0 (socket says 172.21.15.84:50360) 2023-07-14T11:13:48.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.180+0000 7f2a4ffff700 1 -- 172.21.15.84:0/148965916 learned_addr learned my addr 172.21.15.84:0/148965916 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:13:48.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.180+0000 7f2a54b9c700 1 -- 172.21.15.84:0/148965916 >> v1:172.21.15.179:6789/0 conn(0x7f2a500d0b10 legacy=0x7f2a500b0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:48.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.180+0000 7f2a54b9c700 1 -- 172.21.15.84:0/148965916 >> v1:172.21.15.84:6789/0 conn(0x7f2a500b8a60 legacy=0x7f2a500b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:48.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.180+0000 7f2a54b9c700 1 -- 172.21.15.84:0/148965916 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a500b0060 con 0x7f2a500d0f90 2023-07-14T11:13:48.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.180+0000 7f2a4f7fe700 1 -- 172.21.15.84:0/148965916 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3683686390 0 0) 0x7f2a500b8e30 con 0x7f2a500b8a60 2023-07-14T11:13:48.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.181+0000 7f2a54b9c700 1 --2- 172.21.15.84:0/148965916 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a500d0f90 0x7f2a500b1530 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2a48009d90 tx=0x7f2a4800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e41af5fbbbbe6f9 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:48.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.181+0000 7f2a4f7fe700 1 -- 172.21.15.84:0/148965916 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4800e070 con 0x7f2a500d0f90 2023-07-14T11:13:48.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.181+0000 7f2a4f7fe700 1 -- 172.21.15.84:0/148965916 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a4800bbd0 con 0x7f2a500d0f90 2023-07-14T11:13:48.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.181+0000 7f2a4f7fe700 1 -- 172.21.15.84:0/148965916 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a48012430 con 0x7f2a500d0f90 2023-07-14T11:13:48.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.181+0000 7f2a565ff700 1 -- 172.21.15.84:0/148965916 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a500d0f90 msgr2=0x7f2a500b1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:48.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.181+0000 7f2a565ff700 1 --2- 172.21.15.84:0/148965916 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a500d0f90 0x7f2a500b1530 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2a48009d90 tx=0x7f2a4800b330 comp rx=0 tx=0).stop 2023-07-14T11:13:48.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.181+0000 7f2a565ff700 1 -- 172.21.15.84:0/148965916 shutdown_connections 2023-07-14T11:13:48.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.181+0000 7f2a565ff700 1 --2- 172.21.15.84:0/148965916 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a500d0f90 0x7f2a500b1530 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:48.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.181+0000 7f2a565ff700 1 -- 172.21.15.84:0/148965916 >> 172.21.15.84:0/148965916 conn(0x7f2a5009c1b0 msgr2=0x7f2a500d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:48.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.182+0000 7f2a565ff700 1 -- 172.21.15.84:0/148965916 shutdown_connections 2023-07-14T11:13:48.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.182+0000 7f2a565ff700 1 -- 172.21.15.84:0/148965916 wait complete. 2023-07-14T11:13:48.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.183+0000 7f2a565ff700 1 Processor -- start 2023-07-14T11:13:48.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.183+0000 7f2a565ff700 1 -- start start 2023-07-14T11:13:48.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.184+0000 7f2a565ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a500b8a60 0x7f2a5015f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:48.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.184+0000 7f2a565ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a500d0b10 0x7f2a5015af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:48.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.184+0000 7f2a565ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a500d0f90 0x7f2a5015b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:48.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.184+0000 7f2a565ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a500ca010 con 0x7f2a500b8a60 2023-07-14T11:13:48.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.184+0000 7f2a565ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a501f6430 con 0x7f2a500d0f90 2023-07-14T11:13:48.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.184+0000 7f2a565ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a501f2eb0 con 0x7f2a500d0b10 2023-07-14T11:13:48.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.185+0000 7f2a4ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a500b8a60 0x7f2a5015f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:48.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.185+0000 7f2a4ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a500b8a60 0x7f2a5015f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55936/0 (socket says 172.21.15.84:55936) 2023-07-14T11:13:48.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.185+0000 7f2a4ffff700 1 -- 172.21.15.84:0/1731994088 learned_addr learned my addr 172.21.15.84:0/1731994088 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:48.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.185+0000 7f2a47fff700 1 --2- 172.21.15.84:0/1731994088 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a500d0b10 0x7f2a5015af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:48.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.185+0000 7f2a54b9c700 1 --2- 172.21.15.84:0/1731994088 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a500d0f90 0x7f2a5015b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:48.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.185+0000 7f2a4ffff700 1 -- 172.21.15.84:0/1731994088 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a500d0b10 msgr2=0x7f2a5015af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:48.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.185+0000 7f2a4ffff700 1 --2- 172.21.15.84:0/1731994088 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a500d0b10 0x7f2a5015af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:48.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.185+0000 7f2a4ffff700 1 -- 172.21.15.84:0/1731994088 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a500d0f90 msgr2=0x7f2a5015b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:48.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.185+0000 7f2a4ffff700 1 --2- 172.21.15.84:0/1731994088 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a500d0f90 0x7f2a5015b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:48.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.185+0000 7f2a4ffff700 1 -- 172.21.15.84:0/1731994088 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a48009a70 con 0x7f2a500b8a60 2023-07-14T11:13:48.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.185+0000 7f2a47fff700 1 --2- 172.21.15.84:0/1731994088 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a500d0b10 0x7f2a5015af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:13:48.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.185+0000 7f2a54b9c700 1 --2- 172.21.15.84:0/1731994088 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a500d0f90 0x7f2a5015b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:13:48.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.185+0000 7f2a4ffff700 1 --2- 172.21.15.84:0/1731994088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a500b8a60 0x7f2a5015f470 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2a4000c580 tx=0x7f2a4000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:48.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.186+0000 7f2a4d7fa700 1 -- 172.21.15.84:0/1731994088 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a40004c80 con 0x7f2a500b8a60 2023-07-14T11:13:48.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.186+0000 7f2a4d7fa700 1 -- 172.21.15.84:0/1731994088 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a40004e00 con 0x7f2a500b8a60 2023-07-14T11:13:48.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.186+0000 7f2a565ff700 1 -- 172.21.15.84:0/1731994088 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a501f5670 con 0x7f2a500b8a60 2023-07-14T11:13:48.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.186+0000 7f2a4d7fa700 1 -- 172.21.15.84:0/1731994088 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a40007310 con 0x7f2a500b8a60 2023-07-14T11:13:48.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.186+0000 7f2a565ff700 1 -- 172.21.15.84:0/1731994088 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a501f5c30 con 0x7f2a500b8a60 2023-07-14T11:13:48.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.187+0000 7f2a565ff700 1 -- 172.21.15.84:0/1731994088 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a50074350 con 0x7f2a500b8a60 2023-07-14T11:13:48.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.188+0000 7f2a4d7fa700 1 -- 172.21.15.84:0/1731994088 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2a40007470 con 0x7f2a500b8a60 2023-07-14T11:13:48.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.188+0000 7f2a4d7fa700 1 --2- 172.21.15.84:0/1731994088 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f2a3006ace0 0x7f2a3006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:48.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.188+0000 7f2a4d7fa700 1 -- 172.21.15.84:0/1731994088 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2a40089110 con 0x7f2a500b8a60 2023-07-14T11:13:48.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.189+0000 7f2a47fff700 1 --2- 172.21.15.84:0/1731994088 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f2a3006ace0 0x7f2a3006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:48.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.189+0000 7f2a47fff700 1 --2- 172.21.15.84:0/1731994088 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f2a3006ace0 0x7f2a3006d190 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2a500b1fa0 tx=0x7f2a38009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:48.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.193+0000 7f2a4d7fa700 1 -- 172.21.15.84:0/1731994088 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f2a40054250 con 0x7f2a500b8a60 2023-07-14T11:13:48.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.385+0000 7f2a565ff700 1 -- 172.21.15.84:0/1731994088 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2a5008ceb0 con 0x7f2a500b8a60 2023-07-14T11:13:48.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.386+0000 7f2a4d7fa700 1 -- 172.21.15.84:0/1731994088 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2a40057870 con 0x7f2a500b8a60 2023-07-14T11:13:48.388 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-07-14T11:13:48.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.388+0000 7f2a565ff700 1 -- 172.21.15.84:0/1731994088 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f2a3006ace0 msgr2=0x7f2a3006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:48.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.388+0000 7f2a565ff700 1 --2- 172.21.15.84:0/1731994088 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f2a3006ace0 0x7f2a3006d190 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2a500b1fa0 tx=0x7f2a38009040 comp rx=0 tx=0).stop 2023-07-14T11:13:48.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.388+0000 7f2a565ff700 1 -- 172.21.15.84:0/1731994088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a500b8a60 msgr2=0x7f2a5015f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:48.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.388+0000 7f2a565ff700 1 --2- 172.21.15.84:0/1731994088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a500b8a60 0x7f2a5015f470 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2a4000c580 tx=0x7f2a4000c940 comp rx=0 tx=0).stop 2023-07-14T11:13:48.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.388+0000 7f2a565ff700 1 -- 172.21.15.84:0/1731994088 shutdown_connections 2023-07-14T11:13:48.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.388+0000 7f2a565ff700 1 --2- 172.21.15.84:0/1731994088 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a500d0f90 0x7f2a5015b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:48.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.388+0000 7f2a565ff700 1 --2- 172.21.15.84:0/1731994088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a500b8a60 0x7f2a5015f470 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:48.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.388+0000 7f2a565ff700 1 --2- 172.21.15.84:0/1731994088 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f2a3006ace0 0x7f2a3006d190 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:48.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.388+0000 7f2a565ff700 1 --2- 172.21.15.84:0/1731994088 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a500d0b10 0x7f2a5015af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:48.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.388+0000 7f2a565ff700 1 -- 172.21.15.84:0/1731994088 >> 172.21.15.84:0/1731994088 conn(0x7f2a5009c1b0 msgr2=0x7f2a5006a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:48.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.388+0000 7f2a565ff700 1 -- 172.21.15.84:0/1731994088 shutdown_connections 2023-07-14T11:13:48.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.388+0000 7f2a565ff700 1 -- 172.21.15.84:0/1731994088 wait complete. 2023-07-14T11:13:48.408 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:13:48.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.600+0000 7fa0cf9ff700 1 Processor -- start 2023-07-14T11:13:48.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.600+0000 7fa0cf9ff700 1 -- start start 2023-07-14T11:13:48.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.601+0000 7fa0cf9ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa0c80d1160 0x7fa0c806c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:48.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.601+0000 7fa0cf9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa0c80b5cd0 0x7fa0c80b0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:48.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.601+0000 7fa0cf9ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0c80d2cc0 con 0x7fa0c8160030 2023-07-14T11:13:48.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.601+0000 7fa0cf9ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0c80afbb0 con 0x7fa0c80d1160 2023-07-14T11:13:48.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.601+0000 7fa0cf9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c80afe90 con 0x7fa0c80b5cd0 2023-07-14T11:13:48.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.601+0000 7fa0ccf9a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa0c80d1160 0x7fa0c806c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:48.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.601+0000 7fa0cd79b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fa0c8160030 0x7fa0c80d0a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50374/0 (socket says 172.21.15.84:50374) 2023-07-14T11:13:48.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.601+0000 7fa0cd79b700 1 -- 172.21.15.84:0/3404164919 learned_addr learned my addr 172.21.15.84:0/3404164919 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:13:48.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.602+0000 7fa0cdf9c700 1 --2- 172.21.15.84:0/3404164919 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa0c80b5cd0 0x7fa0c80b0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:48.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.602+0000 7fa0ccf9a700 1 -- 172.21.15.84:0/3404164919 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa0c80b5cd0 msgr2=0x7fa0c80b0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:48.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.602+0000 7fa0ccf9a700 1 --2- 172.21.15.84:0/3404164919 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa0c80b5cd0 0x7fa0c80b0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:48.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.602+0000 7fa0ccf9a700 1 -- 172.21.15.84:0/3404164919 >> v1:172.21.15.84:6789/0 conn(0x7fa0c8160030 legacy=0x7fa0c80d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:48.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.602+0000 7fa0ccf9a700 1 -- 172.21.15.84:0/3404164919 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0c80b0170 con 0x7fa0c80d1160 2023-07-14T11:13:48.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.602+0000 7fa0bffff700 1 -- 172.21.15.84:0/3404164919 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 335483965 0 0) 0x7fa0c80d2cc0 con 0x7fa0c8160030 2023-07-14T11:13:48.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.602+0000 7fa0ccf9a700 1 --2- 172.21.15.84:0/3404164919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0c80d1160 0x7fa0c806c0f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa0b8009840 tx=0x7fa0b8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dac918c525d1aa80 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:48.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.602+0000 7fa0bffff700 1 -- 172.21.15.84:0/3404164919 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b8011830 con 0x7fa0c80d1160 2023-07-14T11:13:48.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.602+0000 7fa0bffff700 1 -- 172.21.15.84:0/3404164919 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0b8011990 con 0x7fa0c80d1160 2023-07-14T11:13:48.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.602+0000 7fa0bffff700 1 -- 172.21.15.84:0/3404164919 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b8011d20 con 0x7fa0c80d1160 2023-07-14T11:13:48.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.603+0000 7fa0cf9ff700 1 -- 172.21.15.84:0/3404164919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0c80d1160 msgr2=0x7fa0c806c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:48.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.603+0000 7fa0cf9ff700 1 --2- 172.21.15.84:0/3404164919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0c80d1160 0x7fa0c806c0f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa0b8009840 tx=0x7fa0b8009b50 comp rx=0 tx=0).stop 2023-07-14T11:13:48.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.603+0000 7fa0cf9ff700 1 -- 172.21.15.84:0/3404164919 shutdown_connections 2023-07-14T11:13:48.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.603+0000 7fa0cf9ff700 1 --2- 172.21.15.84:0/3404164919 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa0c80b5cd0 0x7fa0c80b0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:48.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.603+0000 7fa0cf9ff700 1 --2- 172.21.15.84:0/3404164919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0c80d1160 0x7fa0c806c0f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:48.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.603+0000 7fa0cf9ff700 1 -- 172.21.15.84:0/3404164919 >> 172.21.15.84:0/3404164919 conn(0x7fa0c809c190 msgr2=0x7fa0c80d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:48.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.603+0000 7fa0cf9ff700 1 -- 172.21.15.84:0/3404164919 shutdown_connections 2023-07-14T11:13:48.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.603+0000 7fa0cf9ff700 1 -- 172.21.15.84:0/3404164919 wait complete. 2023-07-14T11:13:48.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.605+0000 7fa0cf9ff700 1 Processor -- start 2023-07-14T11:13:48.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.605+0000 7fa0cf9ff700 1 -- start start 2023-07-14T11:13:48.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.606+0000 7fa0cf9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa0c80b5cd0 0x7fa0c8156ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:48.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.606+0000 7fa0cf9ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0c80d1160 0x7fa0c815a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:48.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.606+0000 7fa0cf9ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0c8160030 0x7fa0c8157470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:48.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.606+0000 7fa0cf9ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c815c8b0 con 0x7fa0c8160030 2023-07-14T11:13:48.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.606+0000 7fa0cf9ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c815cb50 con 0x7fa0c80d1160 2023-07-14T11:13:48.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.606+0000 7fa0cf9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c815ce30 con 0x7fa0c80b5cd0 2023-07-14T11:13:48.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.606+0000 7fa0cdf9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0c8160030 0x7fa0c8157470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:48.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.606+0000 7fa0cdf9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0c8160030 0x7fa0c8157470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55950/0 (socket says 172.21.15.84:55950) 2023-07-14T11:13:48.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.606+0000 7fa0cdf9c700 1 -- 172.21.15.84:0/1850444017 learned_addr learned my addr 172.21.15.84:0/1850444017 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:48.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.606+0000 7fa0ccf9a700 1 --2- 172.21.15.84:0/1850444017 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0c80d1160 0x7fa0c815a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:48.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.606+0000 7fa0cd79b700 1 --2- 172.21.15.84:0/1850444017 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa0c80b5cd0 0x7fa0c8156ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:48.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.607+0000 7fa0cdf9c700 1 -- 172.21.15.84:0/1850444017 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa0c80b5cd0 msgr2=0x7fa0c8156ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:48.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.607+0000 7fa0cdf9c700 1 --2- 172.21.15.84:0/1850444017 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa0c80b5cd0 0x7fa0c8156ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:48.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.607+0000 7fa0cdf9c700 1 -- 172.21.15.84:0/1850444017 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0c80d1160 msgr2=0x7fa0c815a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:48.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.607+0000 7fa0cdf9c700 1 --2- 172.21.15.84:0/1850444017 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0c80d1160 0x7fa0c815a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:48.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.607+0000 7fa0cdf9c700 1 -- 172.21.15.84:0/1850444017 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0b80094a0 con 0x7fa0c8160030 2023-07-14T11:13:48.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.607+0000 7fa0cdf9c700 1 --2- 172.21.15.84:0/1850444017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0c8160030 0x7fa0c8157470 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa0c000ef90 tx=0x7fa0c000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:48.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.607+0000 7fa0bdffb700 1 -- 172.21.15.84:0/1850444017 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c000cc90 con 0x7fa0c8160030 2023-07-14T11:13:48.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.607+0000 7fa0bdffb700 1 -- 172.21.15.84:0/1850444017 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0c000f040 con 0x7fa0c8160030 2023-07-14T11:13:48.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.607+0000 7fa0cf9ff700 1 -- 172.21.15.84:0/1850444017 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0c815a9f0 con 0x7fa0c8160030 2023-07-14T11:13:48.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.607+0000 7fa0bdffb700 1 -- 172.21.15.84:0/1850444017 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c0014480 con 0x7fa0c8160030 2023-07-14T11:13:48.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.607+0000 7fa0cf9ff700 1 -- 172.21.15.84:0/1850444017 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0c81571e0 con 0x7fa0c8160030 2023-07-14T11:13:48.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.608+0000 7fa0cf9ff700 1 -- 172.21.15.84:0/1850444017 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0c815af10 con 0x7fa0c8160030 2023-07-14T11:13:48.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.609+0000 7fa0bdffb700 1 -- 172.21.15.84:0/1850444017 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa0c00145e0 con 0x7fa0c8160030 2023-07-14T11:13:48.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.610+0000 7fa0bdffb700 1 --2- 172.21.15.84:0/1850444017 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa0ac06ace0 0x7fa0ac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:48.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.610+0000 7fa0bdffb700 1 -- 172.21.15.84:0/1850444017 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa0c0089fb0 con 0x7fa0c8160030 2023-07-14T11:13:48.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.610+0000 7fa0cd79b700 1 --2- 172.21.15.84:0/1850444017 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa0ac06ace0 0x7fa0ac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:48.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.611+0000 7fa0cd79b700 1 --2- 172.21.15.84:0/1850444017 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa0ac06ace0 0x7fa0ac06d190 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa0c4000f60 tx=0x7fa0c4007e70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:48.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.614+0000 7fa0bdffb700 1 -- 172.21.15.84:0/1850444017 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fa0c00bc330 con 0x7fa0c8160030 2023-07-14T11:13:48.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.811+0000 7fa0cf9ff700 1 -- 172.21.15.84:0/1850444017 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa0c804e280 con 0x7fa0c8160030 2023-07-14T11:13:48.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.812+0000 7fa0bdffb700 1 -- 172.21.15.84:0/1850444017 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18255 (secure 0 0 0) 0x7fa0c0018090 con 0x7fa0c8160030 2023-07-14T11:13:48.815 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:13:48.815 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":23,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:13:15.989292+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-14T11:13:12.727811+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-14T11:13:13.436391+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:13:48.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.814+0000 7fa0cf9ff700 1 -- 172.21.15.84:0/1850444017 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa0ac06ace0 msgr2=0x7fa0ac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:48.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.814+0000 7fa0cf9ff700 1 --2- 172.21.15.84:0/1850444017 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa0ac06ace0 0x7fa0ac06d190 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa0c4000f60 tx=0x7fa0c4007e70 comp rx=0 tx=0).stop 2023-07-14T11:13:48.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.814+0000 7fa0cf9ff700 1 -- 172.21.15.84:0/1850444017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0c8160030 msgr2=0x7fa0c8157470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:48.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.814+0000 7fa0cf9ff700 1 --2- 172.21.15.84:0/1850444017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0c8160030 0x7fa0c8157470 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa0c000ef90 tx=0x7fa0c000c3a0 comp rx=0 tx=0).stop 2023-07-14T11:13:48.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.814+0000 7fa0cf9ff700 1 -- 172.21.15.84:0/1850444017 shutdown_connections 2023-07-14T11:13:48.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.814+0000 7fa0cf9ff700 1 --2- 172.21.15.84:0/1850444017 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa0ac06ace0 0x7fa0ac06d190 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:48.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.815+0000 7fa0cf9ff700 1 --2- 172.21.15.84:0/1850444017 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa0c80b5cd0 0x7fa0c8156ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:48.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.815+0000 7fa0cf9ff700 1 --2- 172.21.15.84:0/1850444017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0c8160030 0x7fa0c8157470 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:48.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.815+0000 7fa0cf9ff700 1 --2- 172.21.15.84:0/1850444017 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0c80d1160 0x7fa0c815a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:48.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.815+0000 7fa0cf9ff700 1 -- 172.21.15.84:0/1850444017 >> 172.21.15.84:0/1850444017 conn(0x7fa0c809c190 msgr2=0x7fa0c815f400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:48.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.815+0000 7fa0cf9ff700 1 -- 172.21.15.84:0/1850444017 shutdown_connections 2023-07-14T11:13:48.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:48.815+0000 7fa0cf9ff700 1 -- 172.21.15.84:0/1850444017 wait complete. 2023-07-14T11:13:48.835 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T11:13:00.125395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T11:13:06.803994+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T11:13:12.727811+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T11:13:13.436391+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T11:13:48.836 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T11:13:49.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.034+0000 7fbaef1ff700 1 Processor -- start 2023-07-14T11:13:49.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.034+0000 7fbaef1ff700 1 -- start start 2023-07-14T11:13:49.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.035+0000 7fbaef1ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbae80b8a60 0x7fbae80b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:49.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.035+0000 7fbaef1ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbae80b8e30 con 0x7fbae80b4530 2023-07-14T11:13:49.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.035+0000 7fbaef1ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbae80afaa0 con 0x7fbae80d1220 2023-07-14T11:13:49.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.035+0000 7fbaef1ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbae80afd80 con 0x7fbae80b8a60 2023-07-14T11:13:49.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.035+0000 7fbae7fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fbae80b4530 0x7fbae80d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:56572/0 (socket says 172.21.15.84:56572) 2023-07-14T11:13:49.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.036+0000 7fbae7fff700 1 -- 172.21.15.84:0/2086225206 learned_addr learned my addr 172.21.15.84:0/2086225206 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:13:49.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.036+0000 7fbaecf9b700 1 --2- 172.21.15.84:0/2086225206 >> v2:172.21.15.84:3300/0 conn(0x7fbae80b8a60 0x7fbae80b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:49.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.036+0000 7fbaecf9b700 1 -- 172.21.15.84:0/2086225206 >> v1:172.21.15.179:6789/0 conn(0x7fbae80d1220 legacy=0x7fbae80b0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:49.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.036+0000 7fbaecf9b700 1 -- 172.21.15.84:0/2086225206 >> v1:172.21.15.84:6789/0 conn(0x7fbae80b4530 legacy=0x7fbae80d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:49.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.036+0000 7fbaecf9b700 1 -- 172.21.15.84:0/2086225206 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbae80b0060 con 0x7fbae80b8a60 2023-07-14T11:13:49.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.036+0000 7fbae77fe700 1 -- 172.21.15.84:0/2086225206 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2359375954 0 0) 0x7fbae80b8e30 con 0x7fbae80b4530 2023-07-14T11:13:49.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.036+0000 7fbaecf9b700 1 --2- 172.21.15.84:0/2086225206 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbae80b8a60 0x7fbae80b3ff0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fbadc009840 tx=0x7fbadc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=607861c47cd539da server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:49.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.036+0000 7fbae77fe700 1 -- 172.21.15.84:0/2086225206 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbadc011830 con 0x7fbae80b8a60 2023-07-14T11:13:49.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.036+0000 7fbae77fe700 1 -- 172.21.15.84:0/2086225206 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbadc011990 con 0x7fbae80b8a60 2023-07-14T11:13:49.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.036+0000 7fbae77fe700 1 -- 172.21.15.84:0/2086225206 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbadc011d20 con 0x7fbae80b8a60 2023-07-14T11:13:49.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.037+0000 7fbaef1ff700 1 -- 172.21.15.84:0/2086225206 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbae80b8a60 msgr2=0x7fbae80b3ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:49.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.037+0000 7fbaef1ff700 1 --2- 172.21.15.84:0/2086225206 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbae80b8a60 0x7fbae80b3ff0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fbadc009840 tx=0x7fbadc009b50 comp rx=0 tx=0).stop 2023-07-14T11:13:49.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.037+0000 7fbaef1ff700 1 -- 172.21.15.84:0/2086225206 shutdown_connections 2023-07-14T11:13:49.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.037+0000 7fbaef1ff700 1 --2- 172.21.15.84:0/2086225206 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbae80b8a60 0x7fbae80b3ff0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:49.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.037+0000 7fbaef1ff700 1 -- 172.21.15.84:0/2086225206 >> 172.21.15.84:0/2086225206 conn(0x7fbae809c1b0 msgr2=0x7fbae80d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:49.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.037+0000 7fbaef1ff700 1 -- 172.21.15.84:0/2086225206 shutdown_connections 2023-07-14T11:13:49.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.037+0000 7fbaef1ff700 1 -- 172.21.15.84:0/2086225206 wait complete. 2023-07-14T11:13:49.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.039+0000 7fbaef1ff700 1 Processor -- start 2023-07-14T11:13:49.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.039+0000 7fbaef1ff700 1 -- start start 2023-07-14T11:13:49.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.040+0000 7fbaef1ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbae80b4530 0x7fbae8149320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:49.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.040+0000 7fbaef1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbae80b8a60 0x7fbae815f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:49.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.040+0000 7fbaef1ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbae80d1220 0x7fbae815fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:49.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.040+0000 7fbaef1ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae80c9610 con 0x7fbae80d1220 2023-07-14T11:13:49.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.040+0000 7fbaef1ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae80ca130 con 0x7fbae80b4530 2023-07-14T11:13:49.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.040+0000 7fbaef1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbae80ca410 con 0x7fbae80b8a60 2023-07-14T11:13:49.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.040+0000 7fbaed79c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbae80d1220 0x7fbae815fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:49.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.040+0000 7fbaed79c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbae80d1220 0x7fbae815fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49636/0 (socket says 172.21.15.84:49636) 2023-07-14T11:13:49.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.040+0000 7fbaed79c700 1 -- 172.21.15.84:0/1324889479 learned_addr learned my addr 172.21.15.84:0/1324889479 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:49.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.040+0000 7fbaecf9b700 1 --2- 172.21.15.84:0/1324889479 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbae80b4530 0x7fbae8149320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:49.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.040+0000 7fbae7fff700 1 --2- 172.21.15.84:0/1324889479 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbae80b8a60 0x7fbae815f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:49.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.041+0000 7fbaed79c700 1 -- 172.21.15.84:0/1324889479 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbae80b8a60 msgr2=0x7fbae815f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:49.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.041+0000 7fbaed79c700 1 --2- 172.21.15.84:0/1324889479 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbae80b8a60 0x7fbae815f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:49.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.041+0000 7fbaed79c700 1 -- 172.21.15.84:0/1324889479 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbae80b4530 msgr2=0x7fbae8149320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:49.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.041+0000 7fbaed79c700 1 --2- 172.21.15.84:0/1324889479 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbae80b4530 0x7fbae8149320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:49.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.041+0000 7fbaed79c700 1 -- 172.21.15.84:0/1324889479 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbadc0094a0 con 0x7fbae80d1220 2023-07-14T11:13:49.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.041+0000 7fbaecf9b700 1 --2- 172.21.15.84:0/1324889479 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbae80b4530 0x7fbae8149320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:13:49.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.041+0000 7fbae7fff700 1 --2- 172.21.15.84:0/1324889479 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbae80b8a60 0x7fbae815f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:13:49.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.041+0000 7fbaed79c700 1 --2- 172.21.15.84:0/1324889479 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbae80d1220 0x7fbae815fab0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fbae000cbc0 tx=0x7fbae000cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:49.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.041+0000 7fbae57fa700 1 -- 172.21.15.84:0/1324889479 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae0003c00 con 0x7fbae80d1220 2023-07-14T11:13:49.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.041+0000 7fbae57fa700 1 -- 172.21.15.84:0/1324889479 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbae0003d60 con 0x7fbae80d1220 2023-07-14T11:13:49.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.041+0000 7fbaef1ff700 1 -- 172.21.15.84:0/1324889479 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbae80ca6f0 con 0x7fbae80d1220 2023-07-14T11:13:49.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.041+0000 7fbae57fa700 1 -- 172.21.15.84:0/1324889479 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae000ab90 con 0x7fbae80d1220 2023-07-14T11:13:49.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.041+0000 7fbaef1ff700 1 -- 172.21.15.84:0/1324889479 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbae80cacb0 con 0x7fbae80d1220 2023-07-14T11:13:49.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.042+0000 7fbaef1ff700 1 -- 172.21.15.84:0/1324889479 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbae8074350 con 0x7fbae80d1220 2023-07-14T11:13:49.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.043+0000 7fbae57fa700 1 -- 172.21.15.84:0/1324889479 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbae000acf0 con 0x7fbae80d1220 2023-07-14T11:13:49.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.044+0000 7fbae57fa700 1 --2- 172.21.15.84:0/1324889479 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fbacc06ace0 0x7fbacc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:49.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.044+0000 7fbae57fa700 1 -- 172.21.15.84:0/1324889479 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbae0089560 con 0x7fbae80d1220 2023-07-14T11:13:49.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.044+0000 7fbaecf9b700 1 --2- 172.21.15.84:0/1324889479 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fbacc06ace0 0x7fbacc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:49.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.045+0000 7fbaecf9b700 1 --2- 172.21.15.84:0/1324889479 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fbacc06ace0 0x7fbacc06d190 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fbadc000c00 tx=0x7fbadc01c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:49.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.048+0000 7fbae57fa700 1 -- 172.21.15.84:0/1324889479 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fbae0054570 con 0x7fbae80d1220 2023-07-14T11:13:49.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.242+0000 7fbaef1ff700 1 -- 172.21.15.84:0/1324889479 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbae80d1000 con 0x7fbae80d1220 2023-07-14T11:13:49.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.243+0000 7fbae57fa700 1 -- 172.21.15.84:0/1324889479 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbae0057b90 con 0x7fbae80d1220 2023-07-14T11:13:49.245 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-07-14T11:13:49.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.245+0000 7fbaef1ff700 1 -- 172.21.15.84:0/1324889479 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fbacc06ace0 msgr2=0x7fbacc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:49.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.245+0000 7fbaef1ff700 1 --2- 172.21.15.84:0/1324889479 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fbacc06ace0 0x7fbacc06d190 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fbadc000c00 tx=0x7fbadc01c040 comp rx=0 tx=0).stop 2023-07-14T11:13:49.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.245+0000 7fbaef1ff700 1 -- 172.21.15.84:0/1324889479 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbae80d1220 msgr2=0x7fbae815fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:49.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.245+0000 7fbaef1ff700 1 --2- 172.21.15.84:0/1324889479 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbae80d1220 0x7fbae815fab0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fbae000cbc0 tx=0x7fbae000cf80 comp rx=0 tx=0).stop 2023-07-14T11:13:49.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.245+0000 7fbaef1ff700 1 -- 172.21.15.84:0/1324889479 shutdown_connections 2023-07-14T11:13:49.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.245+0000 7fbaef1ff700 1 --2- 172.21.15.84:0/1324889479 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbae80d1220 0x7fbae815fab0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:49.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.245+0000 7fbaef1ff700 1 --2- 172.21.15.84:0/1324889479 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbae80b4530 0x7fbae8149320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:49.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.245+0000 7fbaef1ff700 1 --2- 172.21.15.84:0/1324889479 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fbacc06ace0 0x7fbacc06d190 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:49.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.245+0000 7fbaef1ff700 1 --2- 172.21.15.84:0/1324889479 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbae80b8a60 0x7fbae815f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:49.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.245+0000 7fbaef1ff700 1 -- 172.21.15.84:0/1324889479 >> 172.21.15.84:0/1324889479 conn(0x7fbae809c1b0 msgr2=0x7fbae80b25b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:49.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.245+0000 7fbaef1ff700 1 -- 172.21.15.84:0/1324889479 shutdown_connections 2023-07-14T11:13:49.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.245+0000 7fbaef1ff700 1 -- 172.21.15.84:0/1324889479 wait complete. 2023-07-14T11:13:49.265 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T11:13:49.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.461+0000 7ff7ce3ff700 1 Processor -- start 2023-07-14T11:13:49.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.462+0000 7ff7ce3ff700 1 -- start start 2023-07-14T11:13:49.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.463+0000 7ff7ce3ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff7c80d0f90 0x7ff7c80b1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:49.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.463+0000 7ff7ce3ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7c80b8e30 con 0x7ff7c80b8a60 2023-07-14T11:13:49.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.463+0000 7ff7ce3ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7c80afaa0 con 0x7ff7c80d0b10 2023-07-14T11:13:49.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.463+0000 7ff7ce3ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7c80afd80 con 0x7ff7c80d0f90 2023-07-14T11:13:49.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.463+0000 7ff7c7fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7ff7c80b8a60 0x7ff7c80b3ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:56588/0 (socket says 172.21.15.84:56588) 2023-07-14T11:13:49.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.463+0000 7ff7c7fff700 1 -- 172.21.15.84:0/3339873962 learned_addr learned my addr 172.21.15.84:0/3339873962 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:13:49.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.463+0000 7ff7cc99c700 1 --2- 172.21.15.84:0/3339873962 >> v2:172.21.15.179:3300/0 conn(0x7ff7c80d0f90 0x7ff7c80b1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:49.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.463+0000 7ff7c6ffd700 1 -- 172.21.15.84:0/3339873962 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1007160048 0 0) 0x7ff7c80b8e30 con 0x7ff7c80b8a60 2023-07-14T11:13:49.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.463+0000 7ff7c6ffd700 1 -- 172.21.15.84:0/3339873962 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7b00035b0 con 0x7ff7c80b8a60 2023-07-14T11:13:49.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.464+0000 7ff7c6ffd700 1 -- 172.21.15.84:0/3339873962 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 906981444 0 0) 0x7ff7c80afaa0 con 0x7ff7c80d0b10 2023-07-14T11:13:49.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.464+0000 7ff7c6ffd700 1 -- 172.21.15.84:0/3339873962 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7c80b8e30 con 0x7ff7c80d0b10 2023-07-14T11:13:49.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.464+0000 7ff7c6ffd700 1 -- 172.21.15.84:0/3339873962 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1182330476 0 0) 0x7ff7b00035b0 con 0x7ff7c80b8a60 2023-07-14T11:13:49.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.464+0000 7ff7c6ffd700 1 -- 172.21.15.84:0/3339873962 >> v2:172.21.15.179:3300/0 conn(0x7ff7c80d0f90 msgr2=0x7ff7c80b1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:49.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.464+0000 7ff7c6ffd700 1 --2- 172.21.15.84:0/3339873962 >> v2:172.21.15.179:3300/0 conn(0x7ff7c80d0f90 0x7ff7c80b1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:49.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.464+0000 7ff7c6ffd700 1 -- 172.21.15.84:0/3339873962 >> v1:172.21.15.179:6789/0 conn(0x7ff7c80d0b10 legacy=0x7ff7c80b0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:49.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.464+0000 7ff7c6ffd700 1 -- 172.21.15.84:0/3339873962 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c80b0060 con 0x7ff7c80b8a60 2023-07-14T11:13:49.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.464+0000 7ff7c6ffd700 1 -- 172.21.15.84:0/3339873962 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7ff7b8001670 con 0x7ff7c80b8a60 2023-07-14T11:13:49.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.464+0000 7ff7cc99c700 1 --2- 172.21.15.84:0/3339873962 >> v2:172.21.15.179:3300/0 conn(0x7ff7c80d0f90 0x7ff7c80b1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:13:49.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.464+0000 7ff7c6ffd700 1 -- 172.21.15.84:0/3339873962 >> v1:172.21.15.84:6789/0 conn(0x7ff7c80b8a60 legacy=0x7ff7c80b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:49.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.464+0000 7ff7c6ffd700 1 --2- 172.21.15.84:0/3339873962 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7b0003be0 0x7ff7b0003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:49.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.464+0000 7ff7c6ffd700 1 --2- 172.21.15.84:0/3339873962 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7b0004850 0x7ff7b0004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:49.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.464+0000 7ff7c6ffd700 1 --2- 172.21.15.84:0/3339873962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7b0005200 0x7ff7b000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:49.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.464+0000 7ff7c6ffd700 1 -- 172.21.15.84:0/3339873962 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c80afd80 con 0x7ff7b0003be0 2023-07-14T11:13:49.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.464+0000 7ff7c6ffd700 1 -- 172.21.15.84:0/3339873962 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b000c030 con 0x7ff7b0004850 2023-07-14T11:13:49.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.464+0000 7ff7c6ffd700 1 -- 172.21.15.84:0/3339873962 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b000c1f0 con 0x7ff7b0005200 2023-07-14T11:13:49.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.464+0000 7ff7c7fff700 1 --2- 172.21.15.84:0/3339873962 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7b0003be0 0x7ff7b0003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:49.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.464+0000 7ff7c77fe700 1 --2- 172.21.15.84:0/3339873962 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7b0004850 0x7ff7b0004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:49.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.464+0000 7ff7cc99c700 1 --2- 172.21.15.84:0/3339873962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7b0005200 0x7ff7b000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:49.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.465+0000 7ff7c7fff700 1 -- 172.21.15.84:0/3339873962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7b0005200 msgr2=0x7ff7b000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:49.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.465+0000 7ff7c7fff700 1 --2- 172.21.15.84:0/3339873962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7b0005200 0x7ff7b000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:49.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.465+0000 7ff7c7fff700 1 -- 172.21.15.84:0/3339873962 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7b0004850 msgr2=0x7ff7b0004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:49.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.465+0000 7ff7c7fff700 1 --2- 172.21.15.84:0/3339873962 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7b0004850 0x7ff7b0004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:49.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.465+0000 7ff7c7fff700 1 -- 172.21.15.84:0/3339873962 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b00035b0 con 0x7ff7b0003be0 2023-07-14T11:13:49.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.465+0000 7ff7cc99c700 1 -- 172.21.15.84:0/3339873962 reap_dead start 2023-07-14T11:13:49.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.465+0000 7ff7c7fff700 1 --2- 172.21.15.84:0/3339873962 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7b0003be0 0x7ff7b0003fd0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff7b800c110 tx=0x7ff7b0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81e65fbb6f96add7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:49.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.465+0000 7ff7c6ffd700 1 -- 172.21.15.84:0/3339873962 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b800ccb0 con 0x7ff7b0003be0 2023-07-14T11:13:49.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.465+0000 7ff7c6ffd700 1 -- 172.21.15.84:0/3339873962 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b800ce10 con 0x7ff7b0003be0 2023-07-14T11:13:49.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.465+0000 7ff7c6ffd700 1 -- 172.21.15.84:0/3339873962 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b8005ba0 con 0x7ff7b0003be0 2023-07-14T11:13:49.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.466+0000 7ff7ce3ff700 1 -- 172.21.15.84:0/3339873962 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7b0003be0 msgr2=0x7ff7b0003fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:49.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.466+0000 7ff7ce3ff700 1 --2- 172.21.15.84:0/3339873962 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7b0003be0 0x7ff7b0003fd0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff7b800c110 tx=0x7ff7b0005880 comp rx=0 tx=0).stop 2023-07-14T11:13:49.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.466+0000 7ff7ce3ff700 1 -- 172.21.15.84:0/3339873962 shutdown_connections 2023-07-14T11:13:49.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.466+0000 7ff7ce3ff700 1 --2- 172.21.15.84:0/3339873962 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7b0003be0 0x7ff7b0003fd0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:49.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.466+0000 7ff7ce3ff700 1 -- 172.21.15.84:0/3339873962 >> 172.21.15.84:0/3339873962 conn(0x7ff7c809c1b0 msgr2=0x7ff7c80d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:49.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.466+0000 7ff7ce3ff700 1 -- 172.21.15.84:0/3339873962 shutdown_connections 2023-07-14T11:13:49.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.466+0000 7ff7ce3ff700 1 -- 172.21.15.84:0/3339873962 wait complete. 2023-07-14T11:13:49.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.468+0000 7ff7ce3ff700 1 Processor -- start 2023-07-14T11:13:49.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.468+0000 7ff7ce3ff700 1 -- start start 2023-07-14T11:13:49.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.469+0000 7ff7ce3ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7b0003be0 0x7ff7c80cd570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:49.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.469+0000 7ff7ce3ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7c80ccc60 0x7ff7c8150440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:49.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.469+0000 7ff7ce3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7c80ceed0 0x7ff7c80cf340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:49.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.469+0000 7ff7ce3ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c80d0820 con 0x7ff7c80ccc60 2023-07-14T11:13:49.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.469+0000 7ff7ce3ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c8150980 con 0x7ff7b0003be0 2023-07-14T11:13:49.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.469+0000 7ff7ce3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c80cfba0 con 0x7ff7c80ceed0 2023-07-14T11:13:49.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.469+0000 7ff7c77fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7c80ccc60 0x7ff7c8150440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:49.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.469+0000 7ff7c77fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7c80ccc60 0x7ff7c8150440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49646/0 (socket says 172.21.15.84:49646) 2023-07-14T11:13:49.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.469+0000 7ff7c77fe700 1 -- 172.21.15.84:0/3514575010 learned_addr learned my addr 172.21.15.84:0/3514575010 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:49.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.469+0000 7ff7c7fff700 1 --2- 172.21.15.84:0/3514575010 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7b0003be0 0x7ff7c80cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:49.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.469+0000 7ff7cc99c700 1 --2- 172.21.15.84:0/3514575010 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7c80ceed0 0x7ff7c80cf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:49.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.469+0000 7ff7c77fe700 1 -- 172.21.15.84:0/3514575010 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7c80ceed0 msgr2=0x7ff7c80cf340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:49.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.469+0000 7ff7c77fe700 1 --2- 172.21.15.84:0/3514575010 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7c80ceed0 0x7ff7c80cf340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:49.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.469+0000 7ff7c77fe700 1 -- 172.21.15.84:0/3514575010 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7b0003be0 msgr2=0x7ff7c80cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:49.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.469+0000 7ff7c77fe700 1 --2- 172.21.15.84:0/3514575010 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7b0003be0 0x7ff7c80cd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:49.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.469+0000 7ff7c77fe700 1 -- 172.21.15.84:0/3514575010 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c80cfe80 con 0x7ff7c80ccc60 2023-07-14T11:13:49.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.470+0000 7ff7c77fe700 1 --2- 172.21.15.84:0/3514575010 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7c80ccc60 0x7ff7c8150440 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc00f770 tx=0x7ff7bc00fb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:49.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.470+0000 7ff7c4ff9700 1 -- 172.21.15.84:0/3514575010 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc005320 con 0x7ff7c80ccc60 2023-07-14T11:13:49.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.470+0000 7ff7c4ff9700 1 -- 172.21.15.84:0/3514575010 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7bc0054a0 con 0x7ff7c80ccc60 2023-07-14T11:13:49.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.470+0000 7ff7ce3ff700 1 -- 172.21.15.84:0/3514575010 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7c80d0160 con 0x7ff7c80ccc60 2023-07-14T11:13:49.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.470+0000 7ff7c4ff9700 1 -- 172.21.15.84:0/3514575010 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc006aa0 con 0x7ff7c80ccc60 2023-07-14T11:13:49.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.470+0000 7ff7ce3ff700 1 -- 172.21.15.84:0/3514575010 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7c80cd0d0 con 0x7ff7c80ccc60 2023-07-14T11:13:49.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.471+0000 7ff7ce3ff700 1 -- 172.21.15.84:0/3514575010 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7c80d0960 con 0x7ff7c80ccc60 2023-07-14T11:13:49.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.472+0000 7ff7c4ff9700 1 -- 172.21.15.84:0/3514575010 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff7bc006c00 con 0x7ff7c80ccc60 2023-07-14T11:13:49.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.473+0000 7ff7c4ff9700 1 --2- 172.21.15.84:0/3514575010 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff7b406ace0 0x7ff7b406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:49.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.473+0000 7ff7c4ff9700 1 -- 172.21.15.84:0/3514575010 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff7bc088af0 con 0x7ff7c80ccc60 2023-07-14T11:13:49.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.473+0000 7ff7c7fff700 1 --2- 172.21.15.84:0/3514575010 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff7b406ace0 0x7ff7b406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:49.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.474+0000 7ff7c7fff700 1 --2- 172.21.15.84:0/3514575010 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff7b406ace0 0x7ff7b406d190 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff7b800c110 tx=0x7ff7b8007000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:49.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.477+0000 7ff7c4ff9700 1 -- 172.21.15.84:0/3514575010 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ff7bc053b10 con 0x7ff7c80ccc60 2023-07-14T11:13:49.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.673+0000 7ff7ce3ff700 1 -- 172.21.15.84:0/3514575010 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff7c8074350 con 0x7ff7c80ccc60 2023-07-14T11:13:49.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.673+0000 7ff7c4ff9700 1 -- 172.21.15.84:0/3514575010 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff7bc01a020 con 0x7ff7c80ccc60 2023-07-14T11:13:49.675 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-07-14T11:13:49.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.675+0000 7ff7ce3ff700 1 -- 172.21.15.84:0/3514575010 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff7b406ace0 msgr2=0x7ff7b406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:49.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.675+0000 7ff7ce3ff700 1 --2- 172.21.15.84:0/3514575010 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff7b406ace0 0x7ff7b406d190 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff7b800c110 tx=0x7ff7b8007000 comp rx=0 tx=0).stop 2023-07-14T11:13:49.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.675+0000 7ff7ce3ff700 1 -- 172.21.15.84:0/3514575010 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7c80ccc60 msgr2=0x7ff7c8150440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:49.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.675+0000 7ff7ce3ff700 1 --2- 172.21.15.84:0/3514575010 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7c80ccc60 0x7ff7c8150440 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc00f770 tx=0x7ff7bc00fb30 comp rx=0 tx=0).stop 2023-07-14T11:13:49.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.675+0000 7ff7ce3ff700 1 -- 172.21.15.84:0/3514575010 shutdown_connections 2023-07-14T11:13:49.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.675+0000 7ff7ce3ff700 1 --2- 172.21.15.84:0/3514575010 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff7b406ace0 0x7ff7b406d190 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:49.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.675+0000 7ff7ce3ff700 1 --2- 172.21.15.84:0/3514575010 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7c80ceed0 0x7ff7c80cf340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:49.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.675+0000 7ff7ce3ff700 1 --2- 172.21.15.84:0/3514575010 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7b0003be0 0x7ff7c80cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:49.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.675+0000 7ff7ce3ff700 1 --2- 172.21.15.84:0/3514575010 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7c80ccc60 0x7ff7c8150440 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:49.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.675+0000 7ff7ce3ff700 1 -- 172.21.15.84:0/3514575010 >> 172.21.15.84:0/3514575010 conn(0x7ff7c809c1b0 msgr2=0x7ff7c80d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:49.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.676+0000 7ff7ce3ff700 1 -- 172.21.15.84:0/3514575010 shutdown_connections 2023-07-14T11:13:49.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.676+0000 7ff7ce3ff700 1 -- 172.21.15.84:0/3514575010 wait complete. 2023-07-14T11:13:49.696 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T11:13:49.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.893+0000 7fa84e9ff700 1 Processor -- start 2023-07-14T11:13:49.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.893+0000 7fa84e9ff700 1 -- start start 2023-07-14T11:13:49.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.894+0000 7fa84e9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa84806f010 0x7fa848071650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:49.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.894+0000 7fa84e9ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa84806a640 0x7fa8481601d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:49.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.894+0000 7fa84e9ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8480cdba0 con 0x7fa8480ce030 2023-07-14T11:13:49.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.894+0000 7fa84e9ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa84806f3e0 con 0x7fa84806a640 2023-07-14T11:13:49.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.894+0000 7fa84e9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8480cf370 con 0x7fa84806f010 2023-07-14T11:13:49.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.895+0000 7fa84cf9c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa84806a640 0x7fa8481601d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:49.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.895+0000 7fa847fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa84806f010 0x7fa848071650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:49.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.895+0000 7fa84cf9c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa84806a640 0x7fa8481601d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.84:47286/0 (socket says 172.21.15.84:47286) 2023-07-14T11:13:49.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.895+0000 7fa84cf9c700 1 -- 172.21.15.84:0/839992685 learned_addr learned my addr 172.21.15.84:0/839992685 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:49.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.895+0000 7fa8477fe700 1 --1- 172.21.15.84:0/839992685 >> v1:172.21.15.179:6789/0 conn(0x7fa8480ce030 0x7fa848069f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.84:54594/0 (socket says 172.21.15.84:54594) 2023-07-14T11:13:49.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.895+0000 7fa84cf9c700 1 -- 172.21.15.84:0/839992685 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa84806f010 msgr2=0x7fa848071650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:49.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.895+0000 7fa84cf9c700 1 --2- 172.21.15.84:0/839992685 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa84806f010 0x7fa848071650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:49.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.895+0000 7fa84cf9c700 1 -- 172.21.15.84:0/839992685 >> v1:172.21.15.179:6789/0 conn(0x7fa8480ce030 legacy=0x7fa848069f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:49.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.895+0000 7fa84cf9c700 1 -- 172.21.15.84:0/839992685 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8480cf650 con 0x7fa84806a640 2023-07-14T11:13:49.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.896+0000 7fa84cf9c700 1 --2- 172.21.15.84:0/839992685 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa84806a640 0x7fa8481601d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa840009e50 tx=0x7fa84000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b86691dbca62127 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:49.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.896+0000 7fa846ffd700 1 -- 172.21.15.84:0/839992685 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa84000e070 con 0x7fa84806a640 2023-07-14T11:13:49.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.896+0000 7fa846ffd700 1 -- 172.21.15.84:0/839992685 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa84000b910 con 0x7fa84806a640 2023-07-14T11:13:49.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.896+0000 7fa846ffd700 1 -- 172.21.15.84:0/839992685 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa84000bcc0 con 0x7fa84806a640 2023-07-14T11:13:49.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.896+0000 7fa84e9ff700 1 -- 172.21.15.84:0/839992685 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa84806a640 msgr2=0x7fa8481601d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:49.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.896+0000 7fa84e9ff700 1 --2- 172.21.15.84:0/839992685 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa84806a640 0x7fa8481601d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa840009e50 tx=0x7fa84000b330 comp rx=0 tx=0).stop 2023-07-14T11:13:49.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.896+0000 7fa84e9ff700 1 -- 172.21.15.84:0/839992685 shutdown_connections 2023-07-14T11:13:49.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.896+0000 7fa84e9ff700 1 --2- 172.21.15.84:0/839992685 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa84806a640 0x7fa8481601d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:49.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.896+0000 7fa84e9ff700 1 --2- 172.21.15.84:0/839992685 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa84806f010 0x7fa848071650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:49.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.896+0000 7fa84e9ff700 1 -- 172.21.15.84:0/839992685 >> 172.21.15.84:0/839992685 conn(0x7fa8480cc640 msgr2=0x7fa8480cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:49.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.897+0000 7fa84e9ff700 1 -- 172.21.15.84:0/839992685 shutdown_connections 2023-07-14T11:13:49.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.897+0000 7fa84e9ff700 1 -- 172.21.15.84:0/839992685 wait complete. 2023-07-14T11:13:49.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.898+0000 7fa84e9ff700 1 Processor -- start 2023-07-14T11:13:49.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.898+0000 7fa84e9ff700 1 -- start start 2023-07-14T11:13:49.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.899+0000 7fa84e9ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa84806a640 0x7fa848152df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:49.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.899+0000 7fa84e9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa84806f010 0x7fa84815e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:49.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.899+0000 7fa84e9ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8480ce030 0x7fa84815ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:49.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.899+0000 7fa84e9ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa84815c240 con 0x7fa84806a640 2023-07-14T11:13:49.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.899+0000 7fa84e9ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8480b2e00 con 0x7fa8480ce030 2023-07-14T11:13:49.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.899+0000 7fa84e9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8480c74c0 con 0x7fa84806f010 2023-07-14T11:13:49.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.900+0000 7fa847fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa84806a640 0x7fa848152df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:49.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.900+0000 7fa847fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa84806a640 0x7fa848152df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49648/0 (socket says 172.21.15.84:49648) 2023-07-14T11:13:49.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.900+0000 7fa847fff700 1 -- 172.21.15.84:0/2413943612 learned_addr learned my addr 172.21.15.84:0/2413943612 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:49.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.900+0000 7fa84cf9c700 1 --2- 172.21.15.84:0/2413943612 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8480ce030 0x7fa84815ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:49.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.900+0000 7fa8477fe700 1 --2- 172.21.15.84:0/2413943612 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa84806f010 0x7fa84815e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:49.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.900+0000 7fa847fff700 1 -- 172.21.15.84:0/2413943612 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa84806f010 msgr2=0x7fa84815e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:49.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.900+0000 7fa847fff700 1 --2- 172.21.15.84:0/2413943612 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa84806f010 0x7fa84815e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:49.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.900+0000 7fa847fff700 1 -- 172.21.15.84:0/2413943612 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8480ce030 msgr2=0x7fa84815ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:49.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.900+0000 7fa847fff700 1 --2- 172.21.15.84:0/2413943612 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8480ce030 0x7fa84815ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:49.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.900+0000 7fa847fff700 1 -- 172.21.15.84:0/2413943612 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa840009b30 con 0x7fa84806a640 2023-07-14T11:13:49.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.900+0000 7fa847fff700 1 --2- 172.21.15.84:0/2413943612 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa84806a640 0x7fa848152df0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa83800e9b0 tx=0x7fa83800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:49.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.901+0000 7fa844ff9700 1 -- 172.21.15.84:0/2413943612 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa838009710 con 0x7fa84806a640 2023-07-14T11:13:49.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.901+0000 7fa844ff9700 1 -- 172.21.15.84:0/2413943612 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa83800ee50 con 0x7fa84806a640 2023-07-14T11:13:49.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.901+0000 7fa84e9ff700 1 -- 172.21.15.84:0/2413943612 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa84815dba0 con 0x7fa84806a640 2023-07-14T11:13:49.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.901+0000 7fa844ff9700 1 -- 172.21.15.84:0/2413943612 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83800ca50 con 0x7fa84806a640 2023-07-14T11:13:49.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.901+0000 7fa84e9ff700 1 -- 172.21.15.84:0/2413943612 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa84815d8c0 con 0x7fa84806a640 2023-07-14T11:13:49.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.902+0000 7fa84e9ff700 1 -- 172.21.15.84:0/2413943612 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa848074350 con 0x7fa84806a640 2023-07-14T11:13:49.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.903+0000 7fa844ff9700 1 -- 172.21.15.84:0/2413943612 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa83800cbb0 con 0x7fa84806a640 2023-07-14T11:13:49.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.904+0000 7fa844ff9700 1 --2- 172.21.15.84:0/2413943612 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa83406ace0 0x7fa83406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:49.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.904+0000 7fa844ff9700 1 -- 172.21.15.84:0/2413943612 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa8380893d0 con 0x7fa84806a640 2023-07-14T11:13:49.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.904+0000 7fa8477fe700 1 --2- 172.21.15.84:0/2413943612 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa83406ace0 0x7fa83406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:49.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.905+0000 7fa8477fe700 1 --2- 172.21.15.84:0/2413943612 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa83406ace0 0x7fa83406d190 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa8481f5800 tx=0x7fa83c007ed0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:49.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:49.908+0000 7fa844ff9700 1 -- 172.21.15.84:0/2413943612 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fa838057fa0 con 0x7fa84806a640 2023-07-14T11:13:50.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.103+0000 7fa84e9ff700 1 -- 172.21.15.84:0/2413943612 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa8480c3040 con 0x7fa84806a640 2023-07-14T11:13:50.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.104+0000 7fa844ff9700 1 -- 172.21.15.84:0/2413943612 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa83800ce60 con 0x7fa84806a640 2023-07-14T11:13:50.106 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-07-14T11:13:50.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.106+0000 7fa84e9ff700 1 -- 172.21.15.84:0/2413943612 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa83406ace0 msgr2=0x7fa83406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:50.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.106+0000 7fa84e9ff700 1 --2- 172.21.15.84:0/2413943612 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa83406ace0 0x7fa83406d190 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa8481f5800 tx=0x7fa83c007ed0 comp rx=0 tx=0).stop 2023-07-14T11:13:50.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.106+0000 7fa84e9ff700 1 -- 172.21.15.84:0/2413943612 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa84806a640 msgr2=0x7fa848152df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:50.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.106+0000 7fa84e9ff700 1 --2- 172.21.15.84:0/2413943612 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa84806a640 0x7fa848152df0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa83800e9b0 tx=0x7fa83800ecc0 comp rx=0 tx=0).stop 2023-07-14T11:13:50.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.106+0000 7fa84e9ff700 1 -- 172.21.15.84:0/2413943612 shutdown_connections 2023-07-14T11:13:50.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.106+0000 7fa84e9ff700 1 --2- 172.21.15.84:0/2413943612 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8480ce030 0x7fa84815ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:50.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.106+0000 7fa84e9ff700 1 --2- 172.21.15.84:0/2413943612 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa84806a640 0x7fa848152df0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:50.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.106+0000 7fa84e9ff700 1 --2- 172.21.15.84:0/2413943612 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa83406ace0 0x7fa83406d190 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:50.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.106+0000 7fa84e9ff700 1 --2- 172.21.15.84:0/2413943612 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa84806f010 0x7fa84815e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:50.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.106+0000 7fa84e9ff700 1 -- 172.21.15.84:0/2413943612 >> 172.21.15.84:0/2413943612 conn(0x7fa8480cc640 msgr2=0x7fa84806e350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:50.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.106+0000 7fa84e9ff700 1 -- 172.21.15.84:0/2413943612 shutdown_connections 2023-07-14T11:13:50.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.106+0000 7fa84e9ff700 1 -- 172.21.15.84:0/2413943612 wait complete. 2023-07-14T11:13:50.126 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T11:13:50.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.324+0000 7fd297dff700 1 Processor -- start 2023-07-14T11:13:50.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.324+0000 7fd297dff700 1 -- start start 2023-07-14T11:13:50.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.325+0000 7fd297dff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd2900d0b10 0x7fd2900d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:50.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.325+0000 7fd297dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2900b0e20 0x7fd2900b12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:50.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.325+0000 7fd297dff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2900b8e30 con 0x7fd2900b8a60 2023-07-14T11:13:50.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.325+0000 7fd297dff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2900d14d0 con 0x7fd2900d0b10 2023-07-14T11:13:50.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.325+0000 7fd297dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2900afaa0 con 0x7fd2900b0e20 2023-07-14T11:13:50.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.325+0000 7fd295b9b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fd2900b8a60 0x7fd2900b3ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:56602/0 (socket says 172.21.15.84:56602) 2023-07-14T11:13:50.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.325+0000 7fd295b9b700 1 -- 172.21.15.84:0/2276099580 learned_addr learned my addr 172.21.15.84:0/2276099580 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:13:50.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.326+0000 7fd29639c700 1 --2- 172.21.15.84:0/2276099580 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2900b0e20 0x7fd2900b12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:50.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.326+0000 7fd29539a700 1 --2- 172.21.15.84:0/2276099580 >> v2:172.21.15.179:3300/0 conn(0x7fd2900d0b10 0x7fd2900d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:50.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.326+0000 7fd294b99700 1 -- 172.21.15.84:0/2276099580 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3819932525 0 0) 0x7fd2900b8e30 con 0x7fd2900b8a60 2023-07-14T11:13:50.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.326+0000 7fd294b99700 1 -- 172.21.15.84:0/2276099580 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd27c0035b0 con 0x7fd2900b8a60 2023-07-14T11:13:50.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.326+0000 7fd294b99700 1 -- 172.21.15.84:0/2276099580 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2044146663 0 0) 0x7fd27c0035b0 con 0x7fd2900b8a60 2023-07-14T11:13:50.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.326+0000 7fd294b99700 1 -- 172.21.15.84:0/2276099580 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2900b0e20 msgr2=0x7fd2900b12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:50.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.326+0000 7fd294b99700 1 --2- 172.21.15.84:0/2276099580 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2900b0e20 0x7fd2900b12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:50.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.326+0000 7fd294b99700 1 -- 172.21.15.84:0/2276099580 >> v2:172.21.15.179:3300/0 conn(0x7fd2900d0b10 msgr2=0x7fd2900d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:50.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.326+0000 7fd294b99700 1 --2- 172.21.15.84:0/2276099580 >> v2:172.21.15.179:3300/0 conn(0x7fd2900d0b10 0x7fd2900d0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:50.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.326+0000 7fd294b99700 1 -- 172.21.15.84:0/2276099580 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2900afd80 con 0x7fd2900b8a60 2023-07-14T11:13:50.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.326+0000 7fd294b99700 1 -- 172.21.15.84:0/2276099580 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7fd28c001670 con 0x7fd2900b8a60 2023-07-14T11:13:50.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.326+0000 7fd294b99700 1 -- 172.21.15.84:0/2276099580 >> v1:172.21.15.84:6789/0 conn(0x7fd2900b8a60 legacy=0x7fd2900b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:50.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.326+0000 7fd294b99700 1 --2- 172.21.15.84:0/2276099580 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2900b0e20 0x7fd27c003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:50.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.326+0000 7fd294b99700 1 --2- 172.21.15.84:0/2276099580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd27c003fd0 0x7fd27c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:50.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.326+0000 7fd294b99700 1 --2- 172.21.15.84:0/2276099580 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd27c004d90 0x7fd27c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:50.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.326+0000 7fd294b99700 1 -- 172.21.15.84:0/2276099580 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2900d14d0 con 0x7fd27c003fd0 2023-07-14T11:13:50.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.326+0000 7fd294b99700 1 -- 172.21.15.84:0/2276099580 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2900afaa0 con 0x7fd27c004d90 2023-07-14T11:13:50.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.326+0000 7fd294b99700 1 -- 172.21.15.84:0/2276099580 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd27c00ba90 con 0x7fd2900b0e20 2023-07-14T11:13:50.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.327+0000 7fd29539a700 1 --2- 172.21.15.84:0/2276099580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd27c003fd0 0x7fd27c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:50.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.327+0000 7fd295b9b700 1 --2- 172.21.15.84:0/2276099580 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2900b0e20 0x7fd27c003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:50.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.327+0000 7fd29639c700 1 --2- 172.21.15.84:0/2276099580 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd27c004d90 0x7fd27c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:50.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.327+0000 7fd29539a700 1 -- 172.21.15.84:0/2276099580 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2900b0e20 msgr2=0x7fd27c003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:50.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.327+0000 7fd29539a700 1 --2- 172.21.15.84:0/2276099580 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2900b0e20 0x7fd27c003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:50.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.327+0000 7fd29539a700 1 -- 172.21.15.84:0/2276099580 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd27c004d90 msgr2=0x7fd27c005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:50.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.327+0000 7fd29539a700 1 --2- 172.21.15.84:0/2276099580 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd27c004d90 0x7fd27c005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:50.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.327+0000 7fd29539a700 1 -- 172.21.15.84:0/2276099580 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd27c0035b0 con 0x7fd27c003fd0 2023-07-14T11:13:50.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.327+0000 7fd29539a700 1 --2- 172.21.15.84:0/2276099580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd27c003fd0 0x7fd27c004850 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd280009b60 tx=0x7fd27c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d455d0264a5548ec server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:50.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.327+0000 7fd294b99700 1 -- 172.21.15.84:0/2276099580 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd28000e6c0 con 0x7fd27c003fd0 2023-07-14T11:13:50.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.327+0000 7fd294b99700 1 -- 172.21.15.84:0/2276099580 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd28000e820 con 0x7fd27c003fd0 2023-07-14T11:13:50.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.327+0000 7fd294b99700 1 -- 172.21.15.84:0/2276099580 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd28000eb90 con 0x7fd27c003fd0 2023-07-14T11:13:50.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.328+0000 7fd297dff700 1 -- 172.21.15.84:0/2276099580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd27c003fd0 msgr2=0x7fd27c004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:50.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.328+0000 7fd297dff700 1 --2- 172.21.15.84:0/2276099580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd27c003fd0 0x7fd27c004850 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd280009b60 tx=0x7fd27c005880 comp rx=0 tx=0).stop 2023-07-14T11:13:50.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.328+0000 7fd29639c700 1 -- 172.21.15.84:0/2276099580 reap_dead start 2023-07-14T11:13:50.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.328+0000 7fd297dff700 1 -- 172.21.15.84:0/2276099580 shutdown_connections 2023-07-14T11:13:50.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.328+0000 7fd297dff700 1 -- 172.21.15.84:0/2276099580 >> 172.21.15.84:0/2276099580 conn(0x7fd29009c1b0 msgr2=0x7fd2900d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:50.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.328+0000 7fd297dff700 1 -- 172.21.15.84:0/2276099580 shutdown_connections 2023-07-14T11:13:50.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.328+0000 7fd297dff700 1 -- 172.21.15.84:0/2276099580 wait complete. 2023-07-14T11:13:50.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.330+0000 7fd297dff700 1 Processor -- start 2023-07-14T11:13:50.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.330+0000 7fd297dff700 1 -- start start 2023-07-14T11:13:50.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.331+0000 7fd297dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd27c003fd0 0x7fd2901f1960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:50.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.331+0000 7fd297dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2900b5d70 0x7fd2900b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:50.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.331+0000 7fd297dff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2900b6720 0x7fd29015ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:50.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.331+0000 7fd297dff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2900ca520 con 0x7fd2900b6720 2023-07-14T11:13:50.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.331+0000 7fd297dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd29015cdb0 con 0x7fd27c003fd0 2023-07-14T11:13:50.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.331+0000 7fd297dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd29015d5c0 con 0x7fd2900b5d70 2023-07-14T11:13:50.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.331+0000 7fd29639c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2900b6720 0x7fd29015ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:50.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.331+0000 7fd29639c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2900b6720 0x7fd29015ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49664/0 (socket says 172.21.15.84:49664) 2023-07-14T11:13:50.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.331+0000 7fd29639c700 1 -- 172.21.15.84:0/391317187 learned_addr learned my addr 172.21.15.84:0/391317187 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:50.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.332+0000 7fd295b9b700 1 --2- 172.21.15.84:0/391317187 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd27c003fd0 0x7fd2901f1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:50.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.332+0000 7fd29539a700 1 --2- 172.21.15.84:0/391317187 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2900b5d70 0x7fd2900b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:50.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.332+0000 7fd29639c700 1 -- 172.21.15.84:0/391317187 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2900b5d70 msgr2=0x7fd2900b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:50.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.332+0000 7fd29639c700 1 --2- 172.21.15.84:0/391317187 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2900b5d70 0x7fd2900b61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:50.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.332+0000 7fd29639c700 1 -- 172.21.15.84:0/391317187 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd27c003fd0 msgr2=0x7fd2901f1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:50.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.332+0000 7fd29639c700 1 --2- 172.21.15.84:0/391317187 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd27c003fd0 0x7fd2901f1960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:50.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.332+0000 7fd29639c700 1 -- 172.21.15.84:0/391317187 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2900b6b90 con 0x7fd2900b6720 2023-07-14T11:13:50.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.332+0000 7fd295b9b700 1 --2- 172.21.15.84:0/391317187 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd27c003fd0 0x7fd2901f1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:13:50.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.332+0000 7fd29539a700 1 --2- 172.21.15.84:0/391317187 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2900b5d70 0x7fd2900b61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:13:50.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.332+0000 7fd29639c700 1 --2- 172.21.15.84:0/391317187 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2900b6720 0x7fd29015ea20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd2900a0df0 tx=0x7fd288011f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:50.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.332+0000 7fd2867fc700 1 -- 172.21.15.84:0/391317187 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd28800e040 con 0x7fd2900b6720 2023-07-14T11:13:50.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.332+0000 7fd2867fc700 1 -- 172.21.15.84:0/391317187 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd28800f040 con 0x7fd2900b6720 2023-07-14T11:13:50.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.332+0000 7fd297dff700 1 -- 172.21.15.84:0/391317187 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd29015d000 con 0x7fd2900b6720 2023-07-14T11:13:50.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.332+0000 7fd2867fc700 1 -- 172.21.15.84:0/391317187 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd28800fde0 con 0x7fd2900b6720 2023-07-14T11:13:50.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.332+0000 7fd297dff700 1 -- 172.21.15.84:0/391317187 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2900ca1b0 con 0x7fd2900b6720 2023-07-14T11:13:50.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.334+0000 7fd297dff700 1 -- 172.21.15.84:0/391317187 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2900d0960 con 0x7fd2900b6720 2023-07-14T11:13:50.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.334+0000 7fd2867fc700 1 -- 172.21.15.84:0/391317187 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd288022460 con 0x7fd2900b6720 2023-07-14T11:13:50.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.335+0000 7fd2867fc700 1 --2- 172.21.15.84:0/391317187 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fd27406ace0 0x7fd27406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:50.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.335+0000 7fd2867fc700 1 -- 172.21.15.84:0/391317187 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd288089a10 con 0x7fd2900b6720 2023-07-14T11:13:50.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.335+0000 7fd295b9b700 1 --2- 172.21.15.84:0/391317187 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fd27406ace0 0x7fd27406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:50.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.336+0000 7fd295b9b700 1 --2- 172.21.15.84:0/391317187 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fd27406ace0 0x7fd27406d190 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd28c000c00 tx=0x7fd28c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:50.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.339+0000 7fd2867fc700 1 -- 172.21.15.84:0/391317187 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fd2880584b0 con 0x7fd2900b6720 2023-07-14T11:13:50.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.533+0000 7fd297dff700 1 -- 172.21.15.84:0/391317187 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd2900ca010 con 0x7fd2900b6720 2023-07-14T11:13:50.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.534+0000 7fd2867fc700 1 -- 172.21.15.84:0/391317187 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd2900ca010 con 0x7fd2900b6720 2023-07-14T11:13:50.536 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-07-14T11:13:50.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.536+0000 7fd297dff700 1 -- 172.21.15.84:0/391317187 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fd27406ace0 msgr2=0x7fd27406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:50.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.536+0000 7fd297dff700 1 --2- 172.21.15.84:0/391317187 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fd27406ace0 0x7fd27406d190 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd28c000c00 tx=0x7fd28c009040 comp rx=0 tx=0).stop 2023-07-14T11:13:50.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.536+0000 7fd297dff700 1 -- 172.21.15.84:0/391317187 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2900b6720 msgr2=0x7fd29015ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:50.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.536+0000 7fd297dff700 1 --2- 172.21.15.84:0/391317187 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2900b6720 0x7fd29015ea20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd2900a0df0 tx=0x7fd288011f80 comp rx=0 tx=0).stop 2023-07-14T11:13:50.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.536+0000 7fd297dff700 1 -- 172.21.15.84:0/391317187 shutdown_connections 2023-07-14T11:13:50.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.536+0000 7fd297dff700 1 --2- 172.21.15.84:0/391317187 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2900b6720 0x7fd29015ea20 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:50.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.536+0000 7fd297dff700 1 --2- 172.21.15.84:0/391317187 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd27c003fd0 0x7fd2901f1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:50.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.536+0000 7fd297dff700 1 --2- 172.21.15.84:0/391317187 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fd27406ace0 0x7fd27406d190 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:50.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.536+0000 7fd297dff700 1 --2- 172.21.15.84:0/391317187 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2900b5d70 0x7fd2900b61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:50.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.536+0000 7fd297dff700 1 -- 172.21.15.84:0/391317187 >> 172.21.15.84:0/391317187 conn(0x7fd29009c1b0 msgr2=0x7fd2900b4ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:50.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.536+0000 7fd297dff700 1 -- 172.21.15.84:0/391317187 shutdown_connections 2023-07-14T11:13:50.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.536+0000 7fd297dff700 1 -- 172.21.15.84:0/391317187 wait complete. 2023-07-14T11:13:50.556 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:13:50.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.750+0000 7f256e7ff700 1 Processor -- start 2023-07-14T11:13:50.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.750+0000 7f256e7ff700 1 -- start start 2023-07-14T11:13:50.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.751+0000 7f256e7ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f25680d1220 0x7f25680b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:50.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.751+0000 7f256e7ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f25680b1e00 0x7f25680afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:50.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.751+0000 7f256e7ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25680d2ce0 con 0x7f256815c950 2023-07-14T11:13:50.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.751+0000 7f256e7ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25680b3350 con 0x7f25680b1e00 2023-07-14T11:13:50.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.751+0000 7f256e7ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25680b3630 con 0x7f25680d1220 2023-07-14T11:13:50.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.752+0000 7f256cd9c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f25680b1e00 0x7f25680afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:50.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.752+0000 7f255ffff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f25680d1220 0x7f25680b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:50.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.752+0000 7f256cd9c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f25680b1e00 0x7f25680afac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49666/0 (socket says 172.21.15.84:49666) 2023-07-14T11:13:50.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.752+0000 7f256cd9c700 1 -- 172.21.15.84:0/2577930831 learned_addr learned my addr 172.21.15.84:0/2577930831 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:50.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.752+0000 7f256cd9c700 1 -- 172.21.15.84:0/2577930831 >> v2:172.21.15.179:3300/0 conn(0x7f25680d1220 msgr2=0x7f25680b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:50.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.752+0000 7f256cd9c700 1 --2- 172.21.15.84:0/2577930831 >> v2:172.21.15.179:3300/0 conn(0x7f25680d1220 0x7f25680b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:50.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.752+0000 7f256cd9c700 1 -- 172.21.15.84:0/2577930831 >> v1:172.21.15.179:6789/0 conn(0x7f256815c950 legacy=0x7f25680d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:50.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.752+0000 7f256cd9c700 1 -- 172.21.15.84:0/2577930831 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25680b3910 con 0x7f25680b1e00 2023-07-14T11:13:50.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.753+0000 7f256cd9c700 1 --2- 172.21.15.84:0/2577930831 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25680b1e00 0x7f25680afac0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2568072140 tx=0x7f256000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=994e6231ecea6140 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:50.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.753+0000 7f25677fe700 1 -- 172.21.15.84:0/2577930831 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256000e070 con 0x7f25680b1e00 2023-07-14T11:13:50.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.753+0000 7f25677fe700 1 -- 172.21.15.84:0/2577930831 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f256000b910 con 0x7f25680b1e00 2023-07-14T11:13:50.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.753+0000 7f25677fe700 1 -- 172.21.15.84:0/2577930831 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256000bcc0 con 0x7f25680b1e00 2023-07-14T11:13:50.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.753+0000 7f256e7ff700 1 -- 172.21.15.84:0/2577930831 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25680b1e00 msgr2=0x7f25680afac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:50.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.753+0000 7f256e7ff700 1 --2- 172.21.15.84:0/2577930831 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25680b1e00 0x7f25680afac0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2568072140 tx=0x7f256000b330 comp rx=0 tx=0).stop 2023-07-14T11:13:50.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.753+0000 7f256e7ff700 1 -- 172.21.15.84:0/2577930831 shutdown_connections 2023-07-14T11:13:50.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.753+0000 7f256e7ff700 1 --2- 172.21.15.84:0/2577930831 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25680b1e00 0x7f25680afac0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:50.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.753+0000 7f256e7ff700 1 --2- 172.21.15.84:0/2577930831 >> v2:172.21.15.179:3300/0 conn(0x7f25680d1220 0x7f25680b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:50.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.753+0000 7f256e7ff700 1 -- 172.21.15.84:0/2577930831 >> 172.21.15.84:0/2577930831 conn(0x7f256809c1d0 msgr2=0x7f25680d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:50.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.753+0000 7f256e7ff700 1 -- 172.21.15.84:0/2577930831 shutdown_connections 2023-07-14T11:13:50.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.753+0000 7f256e7ff700 1 -- 172.21.15.84:0/2577930831 wait complete. 2023-07-14T11:13:50.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.756+0000 7f256e7ff700 1 Processor -- start 2023-07-14T11:13:50.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.756+0000 7f256e7ff700 1 -- start start 2023-07-14T11:13:50.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.757+0000 7f256e7ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f25680b1e00 0x7f2568156d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:50.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.757+0000 7f256e7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25680d1220 0x7f25680cc810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:50.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.757+0000 7f256e7ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f256815c950 0x7f25680c8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:50.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.757+0000 7f256e7ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25681572c0 con 0x7f256815c950 2023-07-14T11:13:50.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.757+0000 7f256e7ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25680cb770 con 0x7f25680b1e00 2023-07-14T11:13:50.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.757+0000 7f256e7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25680cba50 con 0x7f25680d1220 2023-07-14T11:13:50.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.757+0000 7f256cd9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f256815c950 0x7f25680c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:50.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.757+0000 7f256cd9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f256815c950 0x7f25680c8310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49668/0 (socket says 172.21.15.84:49668) 2023-07-14T11:13:50.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.758+0000 7f256cd9c700 1 -- 172.21.15.84:0/3432133131 learned_addr learned my addr 172.21.15.84:0/3432133131 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:50.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.758+0000 7f255ffff700 1 --2- 172.21.15.84:0/3432133131 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25680d1220 0x7f25680cc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:50.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.758+0000 7f2567fff700 1 --2- 172.21.15.84:0/3432133131 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f25680b1e00 0x7f2568156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:50.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.758+0000 7f256cd9c700 1 -- 172.21.15.84:0/3432133131 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25680d1220 msgr2=0x7f25680cc810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:50.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.758+0000 7f256cd9c700 1 --2- 172.21.15.84:0/3432133131 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25680d1220 0x7f25680cc810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:50.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.758+0000 7f256cd9c700 1 -- 172.21.15.84:0/3432133131 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f25680b1e00 msgr2=0x7f2568156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:50.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.758+0000 7f256cd9c700 1 --2- 172.21.15.84:0/3432133131 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f25680b1e00 0x7f2568156d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:50.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.758+0000 7f256cd9c700 1 -- 172.21.15.84:0/3432133131 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2560009b30 con 0x7f256815c950 2023-07-14T11:13:50.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.758+0000 7f256cd9c700 1 --2- 172.21.15.84:0/3432133131 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f256815c950 0x7f25680c8310 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f256000b370 tx=0x7f2560004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:50.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.758+0000 7f25657fa700 1 -- 172.21.15.84:0/3432133131 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25600099b0 con 0x7f256815c950 2023-07-14T11:13:50.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.758+0000 7f25657fa700 1 -- 172.21.15.84:0/3432133131 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25600092e0 con 0x7f256815c950 2023-07-14T11:13:50.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.758+0000 7f256e7ff700 1 -- 172.21.15.84:0/3432133131 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25680cbd30 con 0x7f256815c950 2023-07-14T11:13:50.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.758+0000 7f25657fa700 1 -- 172.21.15.84:0/3432133131 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256001c660 con 0x7f256815c950 2023-07-14T11:13:50.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.759+0000 7f256e7ff700 1 -- 172.21.15.84:0/3432133131 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25680cc2f0 con 0x7f256815c950 2023-07-14T11:13:50.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.760+0000 7f256e7ff700 1 -- 172.21.15.84:0/3432133131 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25680cc510 con 0x7f256815c950 2023-07-14T11:13:50.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.760+0000 7f25657fa700 1 -- 172.21.15.84:0/3432133131 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f256001c7c0 con 0x7f256815c950 2023-07-14T11:13:50.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.761+0000 7f25657fa700 1 --2- 172.21.15.84:0/3432133131 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f254806ace0 0x7f254806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:50.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.761+0000 7f25657fa700 1 -- 172.21.15.84:0/3432133131 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f256008ae30 con 0x7f256815c950 2023-07-14T11:13:50.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.762+0000 7f2567fff700 1 --2- 172.21.15.84:0/3432133131 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f254806ace0 0x7f254806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:50.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.762+0000 7f2567fff700 1 --2- 172.21.15.84:0/3432133131 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f254806ace0 0x7f254806d190 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f25680a0e10 tx=0x7f2558009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:50.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.766+0000 7f25657fa700 1 -- 172.21.15.84:0/3432133131 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f2560055f70 con 0x7f256815c950 2023-07-14T11:13:50.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.965+0000 7f256e7ff700 1 -- 172.21.15.84:0/3432133131 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f256804e280 con 0x7f256815c950 2023-07-14T11:13:50.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.966+0000 7f25657fa700 1 -- 172.21.15.84:0/3432133131 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18255 (secure 0 0 0) 0x7f2560059590 con 0x7f256815c950 2023-07-14T11:13:50.969 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:13:50.969 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":23,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:13:15.989292+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-14T11:13:12.727811+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-14T11:13:13.436391+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:13:50.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.969+0000 7f256e7ff700 1 -- 172.21.15.84:0/3432133131 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f254806ace0 msgr2=0x7f254806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:50.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.969+0000 7f256e7ff700 1 --2- 172.21.15.84:0/3432133131 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f254806ace0 0x7f254806d190 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f25680a0e10 tx=0x7f2558009040 comp rx=0 tx=0).stop 2023-07-14T11:13:50.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.969+0000 7f256e7ff700 1 -- 172.21.15.84:0/3432133131 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f256815c950 msgr2=0x7f25680c8310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:50.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.969+0000 7f256e7ff700 1 --2- 172.21.15.84:0/3432133131 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f256815c950 0x7f25680c8310 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f256000b370 tx=0x7f2560004ad0 comp rx=0 tx=0).stop 2023-07-14T11:13:50.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.969+0000 7f256e7ff700 1 -- 172.21.15.84:0/3432133131 shutdown_connections 2023-07-14T11:13:50.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.969+0000 7f256e7ff700 1 --2- 172.21.15.84:0/3432133131 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f256815c950 0x7f25680c8310 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:50.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.969+0000 7f256e7ff700 1 --2- 172.21.15.84:0/3432133131 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f25680b1e00 0x7f2568156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:50.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.969+0000 7f256e7ff700 1 --2- 172.21.15.84:0/3432133131 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f254806ace0 0x7f254806d190 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:50.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.969+0000 7f256e7ff700 1 --2- 172.21.15.84:0/3432133131 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25680d1220 0x7f25680cc810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:50.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.969+0000 7f256e7ff700 1 -- 172.21.15.84:0/3432133131 >> 172.21.15.84:0/3432133131 conn(0x7f256809c1d0 msgr2=0x7f25680b0730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:50.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.969+0000 7f256e7ff700 1 -- 172.21.15.84:0/3432133131 shutdown_connections 2023-07-14T11:13:50.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:50.969+0000 7f256e7ff700 1 -- 172.21.15.84:0/3432133131 wait complete. 2023-07-14T11:13:50.989 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T11:13:00.125395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T11:13:06.803994+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T11:13:12.727811+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T11:13:13.436391+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T11:13:50.989 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T11:13:51.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.186+0000 7f906e1ff700 1 Processor -- start 2023-07-14T11:13:51.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.187+0000 7f906e1ff700 1 -- start start 2023-07-14T11:13:51.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.188+0000 7f906e1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90680b8a60 0x7f90680b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:51.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.188+0000 7f906e1ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f90680b4530 0x7f90680d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:51.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.188+0000 7f906e1ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90680b8e30 con 0x7f90680d1050 2023-07-14T11:13:51.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.188+0000 7f906e1ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90680d14d0 con 0x7f90680b4530 2023-07-14T11:13:51.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.188+0000 7f906e1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90680b1e30 con 0x7f90680b8a60 2023-07-14T11:13:51.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.188+0000 7f9067fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f90680d1050 0x7f90680b25d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:56606/0 (socket says 172.21.15.84:56606) 2023-07-14T11:13:51.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.188+0000 7f9067fff700 1 -- 172.21.15.84:0/3995975513 learned_addr learned my addr 172.21.15.84:0/3995975513 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:13:51.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.188+0000 7f90677fe700 1 --2- 172.21.15.84:0/3995975513 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90680b8a60 0x7f90680b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:51.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.188+0000 7f9066ffd700 1 --2- 172.21.15.84:0/3995975513 >> v2:172.21.15.179:3300/0 conn(0x7f90680b4530 0x7f90680d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:51.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.188+0000 7f90667fc700 1 -- 172.21.15.84:0/3995975513 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2407645943 0 0) 0x7f90680b8e30 con 0x7f90680d1050 2023-07-14T11:13:51.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.188+0000 7f90667fc700 1 -- 172.21.15.84:0/3995975513 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90500035b0 con 0x7f90680d1050 2023-07-14T11:13:51.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.189+0000 7f90667fc700 1 -- 172.21.15.84:0/3995975513 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3566697006 0 0) 0x7f90500035b0 con 0x7f90680d1050 2023-07-14T11:13:51.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.189+0000 7f90667fc700 1 -- 172.21.15.84:0/3995975513 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90680b8a60 msgr2=0x7f90680b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:51.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.189+0000 7f90667fc700 1 --2- 172.21.15.84:0/3995975513 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90680b8a60 0x7f90680b3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:51.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.189+0000 7f90667fc700 1 -- 172.21.15.84:0/3995975513 >> v2:172.21.15.179:3300/0 conn(0x7f90680b4530 msgr2=0x7f90680d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:51.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.189+0000 7f90667fc700 1 --2- 172.21.15.84:0/3995975513 >> v2:172.21.15.179:3300/0 conn(0x7f90680b4530 0x7f90680d0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:51.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.189+0000 7f90667fc700 1 -- 172.21.15.84:0/3995975513 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90680afaa0 con 0x7f90680d1050 2023-07-14T11:13:51.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.189+0000 7f90667fc700 1 -- 172.21.15.84:0/3995975513 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7f90600019f0 con 0x7f90680d1050 2023-07-14T11:13:51.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.189+0000 7f90667fc700 1 -- 172.21.15.84:0/3995975513 >> v1:172.21.15.84:6789/0 conn(0x7f90680d1050 legacy=0x7f90680b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:51.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.189+0000 7f90667fc700 1 --2- 172.21.15.84:0/3995975513 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90680b8a60 0x7f9050003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:51.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.189+0000 7f90667fc700 1 --2- 172.21.15.84:0/3995975513 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9050003fd0 0x7f9050004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:51.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.189+0000 7f90667fc700 1 --2- 172.21.15.84:0/3995975513 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9050004d90 0x7f9050005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:51.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.189+0000 7f90667fc700 1 -- 172.21.15.84:0/3995975513 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90680d14d0 con 0x7f9050003fd0 2023-07-14T11:13:51.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.189+0000 7f90667fc700 1 -- 172.21.15.84:0/3995975513 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90680b1e30 con 0x7f9050004d90 2023-07-14T11:13:51.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.189+0000 7f90667fc700 1 -- 172.21.15.84:0/3995975513 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f905000ba90 con 0x7f90680b8a60 2023-07-14T11:13:51.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.189+0000 7f9066ffd700 1 --2- 172.21.15.84:0/3995975513 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9050003fd0 0x7f9050004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:51.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.189+0000 7f90677fe700 1 --2- 172.21.15.84:0/3995975513 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90680b8a60 0x7f9050003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:51.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.189+0000 7f9067fff700 1 --2- 172.21.15.84:0/3995975513 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9050004d90 0x7f9050005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:51.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.190+0000 7f9066ffd700 1 -- 172.21.15.84:0/3995975513 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90680b8a60 msgr2=0x7f9050003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:51.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.190+0000 7f9066ffd700 1 --2- 172.21.15.84:0/3995975513 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90680b8a60 0x7f9050003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:51.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.190+0000 7f9066ffd700 1 -- 172.21.15.84:0/3995975513 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9050004d90 msgr2=0x7f9050005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:51.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.190+0000 7f9066ffd700 1 --2- 172.21.15.84:0/3995975513 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9050004d90 0x7f9050005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:51.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.190+0000 7f9066ffd700 1 -- 172.21.15.84:0/3995975513 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90500035b0 con 0x7f9050003fd0 2023-07-14T11:13:51.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.190+0000 7f9067fff700 1 --2- 172.21.15.84:0/3995975513 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9050004d90 0x7f9050005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:13:51.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.190+0000 7f9066ffd700 1 --2- 172.21.15.84:0/3995975513 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9050003fd0 0x7f9050004850 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f905c009b60 tx=0x7f9050005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6634f510a4e28b0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:51.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.190+0000 7f90667fc700 1 -- 172.21.15.84:0/3995975513 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f905c00e6c0 con 0x7f9050003fd0 2023-07-14T11:13:51.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.190+0000 7f90667fc700 1 -- 172.21.15.84:0/3995975513 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f905c00e820 con 0x7f9050003fd0 2023-07-14T11:13:51.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.190+0000 7f90667fc700 1 -- 172.21.15.84:0/3995975513 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f905c00eb90 con 0x7f9050003fd0 2023-07-14T11:13:51.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.190+0000 7f906e1ff700 1 -- 172.21.15.84:0/3995975513 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9050003fd0 msgr2=0x7f9050004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:51.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.190+0000 7f906e1ff700 1 --2- 172.21.15.84:0/3995975513 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9050003fd0 0x7f9050004850 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f905c009b60 tx=0x7f9050005880 comp rx=0 tx=0).stop 2023-07-14T11:13:51.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.190+0000 7f9067fff700 1 -- 172.21.15.84:0/3995975513 reap_dead start 2023-07-14T11:13:51.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.191+0000 7f906e1ff700 1 -- 172.21.15.84:0/3995975513 shutdown_connections 2023-07-14T11:13:51.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.191+0000 7f906e1ff700 1 -- 172.21.15.84:0/3995975513 >> 172.21.15.84:0/3995975513 conn(0x7f906809c1b0 msgr2=0x7f90680d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:51.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.191+0000 7f906e1ff700 1 -- 172.21.15.84:0/3995975513 shutdown_connections 2023-07-14T11:13:51.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.191+0000 7f906e1ff700 1 -- 172.21.15.84:0/3995975513 wait complete. 2023-07-14T11:13:51.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.192+0000 7f906e1ff700 1 Processor -- start 2023-07-14T11:13:51.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.193+0000 7f906e1ff700 1 -- start start 2023-07-14T11:13:51.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.193+0000 7f906e1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9050003fd0 0x7f90680c8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:51.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.193+0000 7f906e1ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9068158540 0x7f9068148e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:51.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.193+0000 7f906e1ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9068157ed0 0x7f90681493c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:51.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.194+0000 7f906e1ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90680d0720 con 0x7f9068157ed0 2023-07-14T11:13:51.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.194+0000 7f906e1ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90680cfd80 con 0x7f9068158540 2023-07-14T11:13:51.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.194+0000 7f906e1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90680d0060 con 0x7f9050003fd0 2023-07-14T11:13:51.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.194+0000 7f9067fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9068157ed0 0x7f90681493c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:51.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.194+0000 7f9067fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9068157ed0 0x7f90681493c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49694/0 (socket says 172.21.15.84:49694) 2023-07-14T11:13:51.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.194+0000 7f9067fff700 1 -- 172.21.15.84:0/2064605601 learned_addr learned my addr 172.21.15.84:0/2064605601 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:51.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.194+0000 7f90677fe700 1 --2- 172.21.15.84:0/2064605601 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9050003fd0 0x7f90680c8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:51.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.194+0000 7f9066ffd700 1 --2- 172.21.15.84:0/2064605601 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9068158540 0x7f9068148e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:51.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.194+0000 7f9067fff700 1 -- 172.21.15.84:0/2064605601 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9050003fd0 msgr2=0x7f90680c8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:51.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.194+0000 7f9067fff700 1 --2- 172.21.15.84:0/2064605601 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9050003fd0 0x7f90680c8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:51.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.194+0000 7f9067fff700 1 -- 172.21.15.84:0/2064605601 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9068158540 msgr2=0x7f9068148e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:51.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.194+0000 7f9067fff700 1 --2- 172.21.15.84:0/2064605601 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9068158540 0x7f9068148e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:51.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.194+0000 7f9067fff700 1 -- 172.21.15.84:0/2064605601 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90680d0340 con 0x7f9068157ed0 2023-07-14T11:13:51.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.194+0000 7f90677fe700 1 --2- 172.21.15.84:0/2064605601 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9050003fd0 0x7f90680c8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:13:51.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.194+0000 7f9066ffd700 1 --2- 172.21.15.84:0/2064605601 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9068158540 0x7f9068148e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:13:51.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.194+0000 7f9067fff700 1 --2- 172.21.15.84:0/2064605601 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9068157ed0 0x7f90681493c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f90680d1420 tx=0x7f906000e4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:51.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.195+0000 7f904ffff700 1 -- 172.21.15.84:0/2064605601 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f906000ed80 con 0x7f9068157ed0 2023-07-14T11:13:51.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.195+0000 7f904ffff700 1 -- 172.21.15.84:0/2064605601 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9060013420 con 0x7f9068157ed0 2023-07-14T11:13:51.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.195+0000 7f906e1ff700 1 -- 172.21.15.84:0/2064605601 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9068149900 con 0x7f9068157ed0 2023-07-14T11:13:51.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.195+0000 7f904ffff700 1 -- 172.21.15.84:0/2064605601 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90600137d0 con 0x7f9068157ed0 2023-07-14T11:13:51.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.195+0000 7f906e1ff700 1 -- 172.21.15.84:0/2064605601 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90680ceaf0 con 0x7f9068157ed0 2023-07-14T11:13:51.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.196+0000 7f906e1ff700 1 -- 172.21.15.84:0/2064605601 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90680b5d70 con 0x7f9068157ed0 2023-07-14T11:13:51.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.197+0000 7f904ffff700 1 -- 172.21.15.84:0/2064605601 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9060013930 con 0x7f9068157ed0 2023-07-14T11:13:51.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.198+0000 7f904ffff700 1 --2- 172.21.15.84:0/2064605601 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f905406ad10 0x7f905406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:51.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.198+0000 7f904ffff700 1 -- 172.21.15.84:0/2064605601 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9060089b20 con 0x7f9068157ed0 2023-07-14T11:13:51.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.198+0000 7f90677fe700 1 --2- 172.21.15.84:0/2064605601 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f905406ad10 0x7f905406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:51.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.199+0000 7f90677fe700 1 --2- 172.21.15.84:0/2064605601 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f905406ad10 0x7f905406d1c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9058009a80 tx=0x7f9058008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:51.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.202+0000 7f904ffff700 1 -- 172.21.15.84:0/2064605601 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f90680b5d70 con 0x7f9068157ed0 2023-07-14T11:13:51.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.396+0000 7f906e1ff700 1 -- 172.21.15.84:0/2064605601 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f90680b5d70 con 0x7f9068157ed0 2023-07-14T11:13:51.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.396+0000 7f904ffff700 1 -- 172.21.15.84:0/2064605601 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f90680b5d70 con 0x7f9068157ed0 2023-07-14T11:13:51.399 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-07-14T11:13:51.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.399+0000 7f906e1ff700 1 -- 172.21.15.84:0/2064605601 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f905406ad10 msgr2=0x7f905406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:51.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.399+0000 7f906e1ff700 1 --2- 172.21.15.84:0/2064605601 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f905406ad10 0x7f905406d1c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9058009a80 tx=0x7f9058008040 comp rx=0 tx=0).stop 2023-07-14T11:13:51.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.399+0000 7f906e1ff700 1 -- 172.21.15.84:0/2064605601 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9068157ed0 msgr2=0x7f90681493c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:51.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.399+0000 7f906e1ff700 1 --2- 172.21.15.84:0/2064605601 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9068157ed0 0x7f90681493c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f90680d1420 tx=0x7f906000e4f0 comp rx=0 tx=0).stop 2023-07-14T11:13:51.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.399+0000 7f906e1ff700 1 -- 172.21.15.84:0/2064605601 shutdown_connections 2023-07-14T11:13:51.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.399+0000 7f906e1ff700 1 --2- 172.21.15.84:0/2064605601 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f905406ad10 0x7f905406d1c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:51.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.399+0000 7f906e1ff700 1 --2- 172.21.15.84:0/2064605601 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9050003fd0 0x7f90680c8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:51.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.399+0000 7f906e1ff700 1 --2- 172.21.15.84:0/2064605601 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9068157ed0 0x7f90681493c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:51.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.399+0000 7f906e1ff700 1 --2- 172.21.15.84:0/2064605601 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9068158540 0x7f9068148e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:51.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.399+0000 7f906e1ff700 1 -- 172.21.15.84:0/2064605601 >> 172.21.15.84:0/2064605601 conn(0x7f906809c1b0 msgr2=0x7f90680b4a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:51.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.399+0000 7f906e1ff700 1 -- 172.21.15.84:0/2064605601 shutdown_connections 2023-07-14T11:13:51.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.399+0000 7f906e1ff700 1 -- 172.21.15.84:0/2064605601 wait complete. 2023-07-14T11:13:51.418 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T11:13:51.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.614+0000 7efd763ff700 1 Processor -- start 2023-07-14T11:13:51.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.614+0000 7efd763ff700 1 -- start start 2023-07-14T11:13:51.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.615+0000 7efd763ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7efd700b8a60 0x7efd700b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:51.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.615+0000 7efd763ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd700b8e30 con 0x7efd700d1220 2023-07-14T11:13:51.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.616+0000 7efd763ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd700afaa0 con 0x7efd700b4530 2023-07-14T11:13:51.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.616+0000 7efd763ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd700afd80 con 0x7efd700b8a60 2023-07-14T11:13:51.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.616+0000 7efd7499c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7efd700d1220 0x7efd700b0e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:56616/0 (socket says 172.21.15.84:56616) 2023-07-14T11:13:51.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.616+0000 7efd7499c700 1 -- 172.21.15.84:0/4115742455 learned_addr learned my addr 172.21.15.84:0/4115742455 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:13:51.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.616+0000 7efd6ffff700 1 --2- 172.21.15.84:0/4115742455 >> v2:172.21.15.179:3300/0 conn(0x7efd700b8a60 0x7efd700b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:51.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.616+0000 7efd6f7fe700 1 -- 172.21.15.84:0/4115742455 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1414305810 0 0) 0x7efd700b8e30 con 0x7efd700d1220 2023-07-14T11:13:51.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.616+0000 7efd6f7fe700 1 -- 172.21.15.84:0/4115742455 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd5c0035b0 con 0x7efd700d1220 2023-07-14T11:13:51.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.617+0000 7efd6f7fe700 1 -- 172.21.15.84:0/4115742455 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1335619710 0 0) 0x7efd5c0035b0 con 0x7efd700d1220 2023-07-14T11:13:51.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.617+0000 7efd6ffff700 1 -- 172.21.15.84:0/4115742455 >> v1:172.21.15.179:6789/0 conn(0x7efd700b4530 legacy=0x7efd700d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:51.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.617+0000 7efd6ffff700 1 -- 172.21.15.84:0/4115742455 >> v1:172.21.15.84:6789/0 conn(0x7efd700d1220 legacy=0x7efd700b0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:51.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.617+0000 7efd6ffff700 1 -- 172.21.15.84:0/4115742455 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd700b0060 con 0x7efd700b8a60 2023-07-14T11:13:51.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.617+0000 7efd6ffff700 1 --2- 172.21.15.84:0/4115742455 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd700b8a60 0x7efd700b3ff0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7efd60009840 tx=0x7efd60009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=567c74e2afccdbe server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:51.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.617+0000 7efd6f7fe700 1 -- 172.21.15.84:0/4115742455 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd680019f0 con 0x7efd700b8a60 2023-07-14T11:13:51.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.617+0000 7efd6f7fe700 1 -- 172.21.15.84:0/4115742455 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd60004030 con 0x7efd700b8a60 2023-07-14T11:13:51.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.617+0000 7efd6f7fe700 1 -- 172.21.15.84:0/4115742455 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd600043c0 con 0x7efd700b8a60 2023-07-14T11:13:51.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.618+0000 7efd763ff700 1 -- 172.21.15.84:0/4115742455 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd700b8a60 msgr2=0x7efd700b3ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:51.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.618+0000 7efd763ff700 1 --2- 172.21.15.84:0/4115742455 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd700b8a60 0x7efd700b3ff0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7efd60009840 tx=0x7efd60009b50 comp rx=0 tx=0).stop 2023-07-14T11:13:51.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.618+0000 7efd763ff700 1 -- 172.21.15.84:0/4115742455 shutdown_connections 2023-07-14T11:13:51.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.618+0000 7efd763ff700 1 --2- 172.21.15.84:0/4115742455 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd700b8a60 0x7efd700b3ff0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:51.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.618+0000 7efd763ff700 1 -- 172.21.15.84:0/4115742455 >> 172.21.15.84:0/4115742455 conn(0x7efd7009c1b0 msgr2=0x7efd700d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:51.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.618+0000 7efd763ff700 1 -- 172.21.15.84:0/4115742455 shutdown_connections 2023-07-14T11:13:51.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.618+0000 7efd763ff700 1 -- 172.21.15.84:0/4115742455 wait complete. 2023-07-14T11:13:51.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.620+0000 7efd763ff700 1 Processor -- start 2023-07-14T11:13:51.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.620+0000 7efd763ff700 1 -- start start 2023-07-14T11:13:51.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.621+0000 7efd763ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd700b4530 0x7efd7015f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:51.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.621+0000 7efd763ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efd700b8a60 0x7efd70151d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:51.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.621+0000 7efd763ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd700d1220 0x7efd701f5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:51.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.621+0000 7efd763ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd700ce950 con 0x7efd700d1220 2023-07-14T11:13:51.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.621+0000 7efd763ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd70152250 con 0x7efd700b4530 2023-07-14T11:13:51.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.621+0000 7efd763ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd701f69a0 con 0x7efd700b8a60 2023-07-14T11:13:51.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.621+0000 7efd7499c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd700d1220 0x7efd701f5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:51.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.621+0000 7efd6ffff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd700b4530 0x7efd7015f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:51.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.621+0000 7efd7499c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd700d1220 0x7efd701f5b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49702/0 (socket says 172.21.15.84:49702) 2023-07-14T11:13:51.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.621+0000 7efd7499c700 1 -- 172.21.15.84:0/485328778 learned_addr learned my addr 172.21.15.84:0/485328778 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:51.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.621+0000 7efd67fff700 1 --2- 172.21.15.84:0/485328778 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efd700b8a60 0x7efd70151d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:51.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.621+0000 7efd7499c700 1 -- 172.21.15.84:0/485328778 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efd700b8a60 msgr2=0x7efd70151d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:51.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.621+0000 7efd7499c700 1 --2- 172.21.15.84:0/485328778 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efd700b8a60 0x7efd70151d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:51.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.621+0000 7efd7499c700 1 -- 172.21.15.84:0/485328778 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd700b4530 msgr2=0x7efd7015f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:51.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.621+0000 7efd7499c700 1 --2- 172.21.15.84:0/485328778 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd700b4530 0x7efd7015f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:51.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.621+0000 7efd7499c700 1 -- 172.21.15.84:0/485328778 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd600094a0 con 0x7efd700d1220 2023-07-14T11:13:51.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.622+0000 7efd7499c700 1 --2- 172.21.15.84:0/485328778 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd700d1220 0x7efd701f5b00 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7efd68001560 tx=0x7efd6800cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:51.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.622+0000 7efd6d7fa700 1 -- 172.21.15.84:0/485328778 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6800aa40 con 0x7efd700d1220 2023-07-14T11:13:51.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.622+0000 7efd6d7fa700 1 -- 172.21.15.84:0/485328778 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd6800aba0 con 0x7efd700d1220 2023-07-14T11:13:51.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.622+0000 7efd763ff700 1 -- 172.21.15.84:0/485328778 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd700ce020 con 0x7efd700d1220 2023-07-14T11:13:51.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.622+0000 7efd6d7fa700 1 -- 172.21.15.84:0/485328778 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd680070d0 con 0x7efd700d1220 2023-07-14T11:13:51.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.622+0000 7efd763ff700 1 -- 172.21.15.84:0/485328778 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd700ce5e0 con 0x7efd700d1220 2023-07-14T11:13:51.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.623+0000 7efd763ff700 1 -- 172.21.15.84:0/485328778 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd700ced10 con 0x7efd700d1220 2023-07-14T11:13:51.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.624+0000 7efd6d7fa700 1 -- 172.21.15.84:0/485328778 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efd68007230 con 0x7efd700d1220 2023-07-14T11:13:51.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.625+0000 7efd6d7fa700 1 --2- 172.21.15.84:0/485328778 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7efd5006ad10 0x7efd5006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:51.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.626+0000 7efd6d7fa700 1 -- 172.21.15.84:0/485328778 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efd68088ef0 con 0x7efd700d1220 2023-07-14T11:13:51.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.626+0000 7efd6ffff700 1 --2- 172.21.15.84:0/485328778 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7efd5006ad10 0x7efd5006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:51.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.626+0000 7efd6ffff700 1 --2- 172.21.15.84:0/485328778 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7efd5006ad10 0x7efd5006d1c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7efd600090b0 tx=0x7efd60008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:51.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.630+0000 7efd6d7fa700 1 -- 172.21.15.84:0/485328778 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7efd700ced10 con 0x7efd700d1220 2023-07-14T11:13:51.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.825+0000 7efd763ff700 1 -- 172.21.15.84:0/485328778 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7efd70074350 con 0x7efd700d1220 2023-07-14T11:13:51.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.826+0000 7efd6d7fa700 1 -- 172.21.15.84:0/485328778 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7efd68018020 con 0x7efd700d1220 2023-07-14T11:13:51.828 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-07-14T11:13:51.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.828+0000 7efd763ff700 1 -- 172.21.15.84:0/485328778 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7efd5006ad10 msgr2=0x7efd5006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:51.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.828+0000 7efd763ff700 1 --2- 172.21.15.84:0/485328778 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7efd5006ad10 0x7efd5006d1c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7efd600090b0 tx=0x7efd60008030 comp rx=0 tx=0).stop 2023-07-14T11:13:51.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.828+0000 7efd763ff700 1 -- 172.21.15.84:0/485328778 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd700d1220 msgr2=0x7efd701f5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:51.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.828+0000 7efd763ff700 1 --2- 172.21.15.84:0/485328778 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd700d1220 0x7efd701f5b00 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7efd68001560 tx=0x7efd6800cee0 comp rx=0 tx=0).stop 2023-07-14T11:13:51.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.828+0000 7efd763ff700 1 -- 172.21.15.84:0/485328778 shutdown_connections 2023-07-14T11:13:51.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.828+0000 7efd763ff700 1 --2- 172.21.15.84:0/485328778 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd700d1220 0x7efd701f5b00 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:51.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.828+0000 7efd763ff700 1 --2- 172.21.15.84:0/485328778 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd700b4530 0x7efd7015f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:51.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.828+0000 7efd763ff700 1 --2- 172.21.15.84:0/485328778 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7efd5006ad10 0x7efd5006d1c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:51.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.828+0000 7efd763ff700 1 --2- 172.21.15.84:0/485328778 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efd700b8a60 0x7efd70151d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:51.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.828+0000 7efd763ff700 1 -- 172.21.15.84:0/485328778 >> 172.21.15.84:0/485328778 conn(0x7efd7009c1b0 msgr2=0x7efd700b25b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:51.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.828+0000 7efd763ff700 1 -- 172.21.15.84:0/485328778 shutdown_connections 2023-07-14T11:13:51.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:51.828+0000 7efd763ff700 1 -- 172.21.15.84:0/485328778 wait complete. 2023-07-14T11:13:51.848 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T11:13:52.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.044+0000 7fd4adbff700 1 Processor -- start 2023-07-14T11:13:52.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.044+0000 7fd4adbff700 1 -- start start 2023-07-14T11:13:52.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.045+0000 7fd4adbff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd4a80d0b10 0x7fd4a80d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:52.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.045+0000 7fd4adbff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4a80b0e20 0x7fd4a80b12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:52.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.046+0000 7fd4adbff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4a80b8e30 con 0x7fd4a80b8a60 2023-07-14T11:13:52.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.046+0000 7fd4adbff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4a80d14d0 con 0x7fd4a80d0b10 2023-07-14T11:13:52.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.046+0000 7fd4adbff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a80afaa0 con 0x7fd4a80b0e20 2023-07-14T11:13:52.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.046+0000 7fd4a77fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fd4a80b8a60 0x7fd4a80b3ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:56620/0 (socket says 172.21.15.84:56620) 2023-07-14T11:13:52.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.046+0000 7fd4a77fe700 1 -- 172.21.15.84:0/214484225 learned_addr learned my addr 172.21.15.84:0/214484225 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:13:52.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.046+0000 7fd49ffff700 1 --2- 172.21.15.84:0/214484225 >> v2:172.21.15.84:3300/0 conn(0x7fd4a80d0b10 0x7fd4a80d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:52.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.046+0000 7fd4a7fff700 1 --2- 172.21.15.84:0/214484225 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4a80b0e20 0x7fd4a80b12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:52.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.046+0000 7fd4a6ffd700 1 -- 172.21.15.84:0/214484225 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4170614890 0 0) 0x7fd4a80b8e30 con 0x7fd4a80b8a60 2023-07-14T11:13:52.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.046+0000 7fd4a6ffd700 1 -- 172.21.15.84:0/214484225 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4940035b0 con 0x7fd4a80b8a60 2023-07-14T11:13:52.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.046+0000 7fd49ffff700 1 -- 172.21.15.84:0/214484225 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4a80b0e20 msgr2=0x7fd4a80b12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:52.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.046+0000 7fd49ffff700 1 --2- 172.21.15.84:0/214484225 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4a80b0e20 0x7fd4a80b12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:52.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.046+0000 7fd49ffff700 1 -- 172.21.15.84:0/214484225 >> v1:172.21.15.84:6789/0 conn(0x7fd4a80b8a60 legacy=0x7fd4a80b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:52.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.046+0000 7fd49ffff700 1 -- 172.21.15.84:0/214484225 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4a80afd80 con 0x7fd4a80d0b10 2023-07-14T11:13:52.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.046+0000 7fd4a7fff700 1 --2- 172.21.15.84:0/214484225 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4a80b0e20 0x7fd4a80b12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:13:52.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.047+0000 7fd49ffff700 1 --2- 172.21.15.84:0/214484225 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4a80d0b10 0x7fd4a80d0f90 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd490009840 tx=0x7fd490009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe38c7318a5c015c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:52.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.047+0000 7fd4a6ffd700 1 -- 172.21.15.84:0/214484225 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd490011830 con 0x7fd4a80d0b10 2023-07-14T11:13:52.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.047+0000 7fd4a6ffd700 1 -- 172.21.15.84:0/214484225 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd490011990 con 0x7fd4a80d0b10 2023-07-14T11:13:52.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.047+0000 7fd4a6ffd700 1 -- 172.21.15.84:0/214484225 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd490011d20 con 0x7fd4a80d0b10 2023-07-14T11:13:52.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.047+0000 7fd4adbff700 1 -- 172.21.15.84:0/214484225 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4a80d0b10 msgr2=0x7fd4a80d0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:52.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.047+0000 7fd4adbff700 1 --2- 172.21.15.84:0/214484225 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4a80d0b10 0x7fd4a80d0f90 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd490009840 tx=0x7fd490009b50 comp rx=0 tx=0).stop 2023-07-14T11:13:52.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.047+0000 7fd4adbff700 1 -- 172.21.15.84:0/214484225 shutdown_connections 2023-07-14T11:13:52.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.047+0000 7fd4adbff700 1 --2- 172.21.15.84:0/214484225 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4a80b0e20 0x7fd4a80b12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:52.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.047+0000 7fd4adbff700 1 --2- 172.21.15.84:0/214484225 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4a80d0b10 0x7fd4a80d0f90 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:52.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.047+0000 7fd4adbff700 1 -- 172.21.15.84:0/214484225 >> 172.21.15.84:0/214484225 conn(0x7fd4a809c1b0 msgr2=0x7fd4a80d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:52.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.047+0000 7fd4adbff700 1 -- 172.21.15.84:0/214484225 shutdown_connections 2023-07-14T11:13:52.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.048+0000 7fd4adbff700 1 -- 172.21.15.84:0/214484225 wait complete. 2023-07-14T11:13:52.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.050+0000 7fd4adbff700 1 Processor -- start 2023-07-14T11:13:52.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.050+0000 7fd4adbff700 1 -- start start 2023-07-14T11:13:52.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.051+0000 7fd4adbff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4a80b0e20 0x7fd4a80cfd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:52.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.051+0000 7fd4adbff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4a80b8a60 0x7fd4a80ceb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:52.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.051+0000 7fd4adbff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4a80d0b10 0x7fd4a80cf090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:52.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.051+0000 7fd4adbff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a80cadc0 con 0x7fd4a80b0e20 2023-07-14T11:13:52.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.051+0000 7fd4adbff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a80cf5d0 con 0x7fd4a80b8a60 2023-07-14T11:13:52.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.051+0000 7fd4adbff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a80ca140 con 0x7fd4a80d0b10 2023-07-14T11:13:52.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.051+0000 7fd4a77fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4a80b0e20 0x7fd4a80cfd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:52.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.052+0000 7fd4a77fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4a80b0e20 0x7fd4a80cfd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49730/0 (socket says 172.21.15.84:49730) 2023-07-14T11:13:52.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.052+0000 7fd4a77fe700 1 -- 172.21.15.84:0/2353139642 learned_addr learned my addr 172.21.15.84:0/2353139642 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:52.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.052+0000 7fd4a7fff700 1 --2- 172.21.15.84:0/2353139642 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4a80d0b10 0x7fd4a80cf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:52.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.052+0000 7fd49ffff700 1 --2- 172.21.15.84:0/2353139642 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4a80b8a60 0x7fd4a80ceb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:52.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.052+0000 7fd4a77fe700 1 -- 172.21.15.84:0/2353139642 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4a80d0b10 msgr2=0x7fd4a80cf090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:52.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.052+0000 7fd4a77fe700 1 --2- 172.21.15.84:0/2353139642 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4a80d0b10 0x7fd4a80cf090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:52.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.052+0000 7fd4a77fe700 1 -- 172.21.15.84:0/2353139642 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4a80b8a60 msgr2=0x7fd4a80ceb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:52.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.052+0000 7fd4a77fe700 1 --2- 172.21.15.84:0/2353139642 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4a80b8a60 0x7fd4a80ceb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:52.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.052+0000 7fd4a77fe700 1 -- 172.21.15.84:0/2353139642 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4900094a0 con 0x7fd4a80b0e20 2023-07-14T11:13:52.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.052+0000 7fd49ffff700 1 --2- 172.21.15.84:0/2353139642 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4a80b8a60 0x7fd4a80ceb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:13:52.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.052+0000 7fd4a7fff700 1 --2- 172.21.15.84:0/2353139642 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4a80d0b10 0x7fd4a80cf090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:13:52.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.052+0000 7fd4a77fe700 1 --2- 172.21.15.84:0/2353139642 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4a80b0e20 0x7fd4a80cfd20 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd49800c700 tx=0x7fd49800cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:52.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.052+0000 7fd4a4ff9700 1 -- 172.21.15.84:0/2353139642 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd498005d70 con 0x7fd4a80b0e20 2023-07-14T11:13:52.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.052+0000 7fd4a4ff9700 1 -- 172.21.15.84:0/2353139642 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4980070d0 con 0x7fd4a80b0e20 2023-07-14T11:13:52.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.052+0000 7fd4a4ff9700 1 -- 172.21.15.84:0/2353139642 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd498007460 con 0x7fd4a80b0e20 2023-07-14T11:13:52.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.052+0000 7fd4adbff700 1 -- 172.21.15.84:0/2353139642 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4a80ca420 con 0x7fd4a80b0e20 2023-07-14T11:13:52.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.053+0000 7fd4adbff700 1 -- 172.21.15.84:0/2353139642 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4a80ca9e0 con 0x7fd4a80b0e20 2023-07-14T11:13:52.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.054+0000 7fd4adbff700 1 -- 172.21.15.84:0/2353139642 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4a8074350 con 0x7fd4a80b0e20 2023-07-14T11:13:52.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.055+0000 7fd4a4ff9700 1 -- 172.21.15.84:0/2353139642 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd4980075c0 con 0x7fd4a80b0e20 2023-07-14T11:13:52.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.055+0000 7fd4a4ff9700 1 --2- 172.21.15.84:0/2353139642 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fd48806ace0 0x7fd48806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:52.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.056+0000 7fd4a4ff9700 1 -- 172.21.15.84:0/2353139642 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd498088a90 con 0x7fd4a80b0e20 2023-07-14T11:13:52.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.056+0000 7fd49ffff700 1 --2- 172.21.15.84:0/2353139642 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fd48806ace0 0x7fd48806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:52.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.056+0000 7fd49ffff700 1 --2- 172.21.15.84:0/2353139642 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fd48806ace0 0x7fd48806d190 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd490000c00 tx=0x7fd490008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:52.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.060+0000 7fd4a4ff9700 1 -- 172.21.15.84:0/2353139642 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fd498053b50 con 0x7fd4a80b0e20 2023-07-14T11:13:52.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.254+0000 7fd4adbff700 1 -- 172.21.15.84:0/2353139642 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd4a806ae60 con 0x7fd4a80b0e20 2023-07-14T11:13:52.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.255+0000 7fd4a4ff9700 1 -- 172.21.15.84:0/2353139642 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd498057170 con 0x7fd4a80b0e20 2023-07-14T11:13:52.257 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-07-14T11:13:52.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.257+0000 7fd4adbff700 1 -- 172.21.15.84:0/2353139642 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fd48806ace0 msgr2=0x7fd48806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:52.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.257+0000 7fd4adbff700 1 --2- 172.21.15.84:0/2353139642 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fd48806ace0 0x7fd48806d190 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd490000c00 tx=0x7fd490008030 comp rx=0 tx=0).stop 2023-07-14T11:13:52.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.257+0000 7fd4adbff700 1 -- 172.21.15.84:0/2353139642 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4a80b0e20 msgr2=0x7fd4a80cfd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:52.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.257+0000 7fd4adbff700 1 --2- 172.21.15.84:0/2353139642 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4a80b0e20 0x7fd4a80cfd20 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd49800c700 tx=0x7fd49800cac0 comp rx=0 tx=0).stop 2023-07-14T11:13:52.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.257+0000 7fd4adbff700 1 -- 172.21.15.84:0/2353139642 shutdown_connections 2023-07-14T11:13:52.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.257+0000 7fd4adbff700 1 --2- 172.21.15.84:0/2353139642 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fd48806ace0 0x7fd48806d190 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:52.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.257+0000 7fd4adbff700 1 --2- 172.21.15.84:0/2353139642 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4a80d0b10 0x7fd4a80cf090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:52.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.257+0000 7fd4adbff700 1 --2- 172.21.15.84:0/2353139642 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4a80b0e20 0x7fd4a80cfd20 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:52.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.257+0000 7fd4adbff700 1 --2- 172.21.15.84:0/2353139642 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4a80b8a60 0x7fd4a80ceb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:52.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.257+0000 7fd4adbff700 1 -- 172.21.15.84:0/2353139642 >> 172.21.15.84:0/2353139642 conn(0x7fd4a809c1b0 msgr2=0x7fd4a806b080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:52.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.257+0000 7fd4adbff700 1 -- 172.21.15.84:0/2353139642 shutdown_connections 2023-07-14T11:13:52.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.257+0000 7fd4adbff700 1 -- 172.21.15.84:0/2353139642 wait complete. 2023-07-14T11:13:52.276 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T11:13:52.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.471+0000 7f4476dff700 1 Processor -- start 2023-07-14T11:13:52.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.472+0000 7f4476dff700 1 -- start start 2023-07-14T11:13:52.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.473+0000 7f4476dff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f44700b8a60 0x7f44700b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:52.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.473+0000 7f4476dff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f44700d1220 0x7f44700b0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:52.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.473+0000 7f4476dff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44700b8e30 con 0x7f44700b4530 2023-07-14T11:13:52.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.473+0000 7f4476dff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44700afaa0 con 0x7f44700b8a60 2023-07-14T11:13:52.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.473+0000 7f4476dff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44700afd80 con 0x7f44700d1220 2023-07-14T11:13:52.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.473+0000 7f4474b9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f44700b8a60 0x7f44700b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:52.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.473+0000 7f4474b9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f44700b8a60 0x7f44700b3ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49738/0 (socket says 172.21.15.84:49738) 2023-07-14T11:13:52.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.473+0000 7f4474b9b700 1 -- 172.21.15.84:0/2824993881 learned_addr learned my addr 172.21.15.84:0/2824993881 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:52.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.473+0000 7f447539c700 1 --2- 172.21.15.84:0/2824993881 >> v2:172.21.15.179:3300/0 conn(0x7f44700d1220 0x7f44700b0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:52.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.473+0000 7f4474b9b700 1 -- 172.21.15.84:0/2824993881 >> v2:172.21.15.179:3300/0 conn(0x7f44700d1220 msgr2=0x7f44700b0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:52.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.473+0000 7f4474b9b700 1 --2- 172.21.15.84:0/2824993881 >> v2:172.21.15.179:3300/0 conn(0x7f44700d1220 0x7f44700b0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:52.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.474+0000 7f4474b9b700 1 -- 172.21.15.84:0/2824993881 >> v1:172.21.15.179:6789/0 conn(0x7f44700b4530 legacy=0x7f44700d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:52.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.474+0000 7f4474b9b700 1 -- 172.21.15.84:0/2824993881 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44700b0060 con 0x7f44700b8a60 2023-07-14T11:13:52.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.474+0000 7f4474b9b700 1 --2- 172.21.15.84:0/2824993881 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44700b8a60 0x7f44700b3ff0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f44700674e0 tx=0x7f4464009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7fa520546585697 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:52.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.474+0000 7f446f7fe700 1 -- 172.21.15.84:0/2824993881 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f446400b870 con 0x7f44700b8a60 2023-07-14T11:13:52.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.474+0000 7f446f7fe700 1 -- 172.21.15.84:0/2824993881 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f446400b9d0 con 0x7f44700b8a60 2023-07-14T11:13:52.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.474+0000 7f446f7fe700 1 -- 172.21.15.84:0/2824993881 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f446400bd60 con 0x7f44700b8a60 2023-07-14T11:13:52.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.475+0000 7f4476dff700 1 -- 172.21.15.84:0/2824993881 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44700b8a60 msgr2=0x7f44700b3ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:52.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.475+0000 7f4476dff700 1 --2- 172.21.15.84:0/2824993881 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44700b8a60 0x7f44700b3ff0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f44700674e0 tx=0x7f4464009bd0 comp rx=0 tx=0).stop 2023-07-14T11:13:52.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.475+0000 7f4476dff700 1 -- 172.21.15.84:0/2824993881 shutdown_connections 2023-07-14T11:13:52.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.475+0000 7f4476dff700 1 --2- 172.21.15.84:0/2824993881 >> v2:172.21.15.179:3300/0 conn(0x7f44700d1220 0x7f44700b0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:52.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.475+0000 7f4476dff700 1 --2- 172.21.15.84:0/2824993881 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44700b8a60 0x7f44700b3ff0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:52.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.475+0000 7f4476dff700 1 -- 172.21.15.84:0/2824993881 >> 172.21.15.84:0/2824993881 conn(0x7f447009c1b0 msgr2=0x7f44700d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:52.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.475+0000 7f4476dff700 1 -- 172.21.15.84:0/2824993881 shutdown_connections 2023-07-14T11:13:52.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.475+0000 7f4476dff700 1 -- 172.21.15.84:0/2824993881 wait complete. 2023-07-14T11:13:52.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.476+0000 7f4476dff700 1 Processor -- start 2023-07-14T11:13:52.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.477+0000 7f4476dff700 1 -- start start 2023-07-14T11:13:52.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.477+0000 7f4476dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44700b4530 0x7f44701f2770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:52.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.477+0000 7f4476dff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44700b8a60 0x7f4470151f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:52.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.478+0000 7f4476dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44700d1220 0x7f4470153620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:52.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.478+0000 7f4476dff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44701529d0 con 0x7f44700b8a60 2023-07-14T11:13:52.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.478+0000 7f4476dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44701524c0 con 0x7f44700d1220 2023-07-14T11:13:52.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.478+0000 7f4476dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f447015ec70 con 0x7f44700b4530 2023-07-14T11:13:52.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.478+0000 7f446ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44700b8a60 0x7f4470151f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:52.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.478+0000 7f446ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44700b8a60 0x7f4470151f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49746/0 (socket says 172.21.15.84:49746) 2023-07-14T11:13:52.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.478+0000 7f446ffff700 1 -- 172.21.15.84:0/3616955159 learned_addr learned my addr 172.21.15.84:0/3616955159 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:52.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.478+0000 7f4474b9b700 1 --2- 172.21.15.84:0/3616955159 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44700b4530 0x7f44701f2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:52.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.478+0000 7f447539c700 1 --2- 172.21.15.84:0/3616955159 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44700d1220 0x7f4470153620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:52.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.478+0000 7f446ffff700 1 -- 172.21.15.84:0/3616955159 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44700b4530 msgr2=0x7f44701f2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:52.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.478+0000 7f446ffff700 1 --2- 172.21.15.84:0/3616955159 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44700b4530 0x7f44701f2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:52.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.478+0000 7f446ffff700 1 -- 172.21.15.84:0/3616955159 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44700d1220 msgr2=0x7f4470153620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:52.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.478+0000 7f446ffff700 1 --2- 172.21.15.84:0/3616955159 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44700d1220 0x7f4470153620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:52.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.478+0000 7f446ffff700 1 -- 172.21.15.84:0/3616955159 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4464009550 con 0x7f44700b8a60 2023-07-14T11:13:52.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.478+0000 7f4474b9b700 1 --2- 172.21.15.84:0/3616955159 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44700b4530 0x7f44701f2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:13:52.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.478+0000 7f446ffff700 1 --2- 172.21.15.84:0/3616955159 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44700b8a60 0x7f4470151f80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f445c00c4e0 tx=0x7f445c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:52.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.479+0000 7f446d7fa700 1 -- 172.21.15.84:0/3616955159 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445c0052d0 con 0x7f44700b8a60 2023-07-14T11:13:52.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.479+0000 7f446d7fa700 1 -- 172.21.15.84:0/3616955159 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f445c005430 con 0x7f44700b8a60 2023-07-14T11:13:52.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.479+0000 7f4476dff700 1 -- 172.21.15.84:0/3616955159 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f447015ddc0 con 0x7f44700b8a60 2023-07-14T11:13:52.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.479+0000 7f446d7fa700 1 -- 172.21.15.84:0/3616955159 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445c0038c0 con 0x7f44700b8a60 2023-07-14T11:13:52.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.479+0000 7f4476dff700 1 -- 172.21.15.84:0/3616955159 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f447015e340 con 0x7f44700b8a60 2023-07-14T11:13:52.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.480+0000 7f4476dff700 1 -- 172.21.15.84:0/3616955159 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44700d0960 con 0x7f44700b8a60 2023-07-14T11:13:52.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.481+0000 7f446d7fa700 1 -- 172.21.15.84:0/3616955159 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f445c003a20 con 0x7f44700b8a60 2023-07-14T11:13:52.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.482+0000 7f446d7fa700 1 --2- 172.21.15.84:0/3616955159 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f445406ace0 0x7f445406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:52.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.482+0000 7f446d7fa700 1 -- 172.21.15.84:0/3616955159 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f445c0889a0 con 0x7f44700b8a60 2023-07-14T11:13:52.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.482+0000 7f4474b9b700 1 --2- 172.21.15.84:0/3616955159 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f445406ace0 0x7f445406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:52.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.483+0000 7f4474b9b700 1 --2- 172.21.15.84:0/3616955159 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f445406ace0 0x7f445406d190 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4464000c00 tx=0x7f4464008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:52.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.486+0000 7f446d7fa700 1 -- 172.21.15.84:0/3616955159 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f445c053a40 con 0x7f44700b8a60 2023-07-14T11:13:52.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.677+0000 7f4476dff700 1 -- 172.21.15.84:0/3616955159 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f447008b870 con 0x7f44700b8a60 2023-07-14T11:13:52.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.677+0000 7f446d7fa700 1 -- 172.21.15.84:0/3616955159 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f445c017020 con 0x7f44700b8a60 2023-07-14T11:13:52.680 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-07-14T11:13:52.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.679+0000 7f4476dff700 1 -- 172.21.15.84:0/3616955159 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f445406ace0 msgr2=0x7f445406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:52.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.679+0000 7f4476dff700 1 --2- 172.21.15.84:0/3616955159 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f445406ace0 0x7f445406d190 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4464000c00 tx=0x7f4464008030 comp rx=0 tx=0).stop 2023-07-14T11:13:52.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.679+0000 7f4476dff700 1 -- 172.21.15.84:0/3616955159 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44700b8a60 msgr2=0x7f4470151f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:52.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.679+0000 7f4476dff700 1 --2- 172.21.15.84:0/3616955159 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44700b8a60 0x7f4470151f80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f445c00c4e0 tx=0x7f445c00c8a0 comp rx=0 tx=0).stop 2023-07-14T11:13:52.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.680+0000 7f4476dff700 1 -- 172.21.15.84:0/3616955159 shutdown_connections 2023-07-14T11:13:52.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.680+0000 7f4476dff700 1 --2- 172.21.15.84:0/3616955159 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f445406ace0 0x7f445406d190 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:52.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.680+0000 7f4476dff700 1 --2- 172.21.15.84:0/3616955159 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44700b4530 0x7f44701f2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:52.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.680+0000 7f4476dff700 1 --2- 172.21.15.84:0/3616955159 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44700d1220 0x7f4470153620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:52.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.680+0000 7f4476dff700 1 --2- 172.21.15.84:0/3616955159 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44700b8a60 0x7f4470151f80 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:52.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.680+0000 7f4476dff700 1 -- 172.21.15.84:0/3616955159 >> 172.21.15.84:0/3616955159 conn(0x7f447009c1b0 msgr2=0x7f447006a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:52.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.680+0000 7f4476dff700 1 -- 172.21.15.84:0/3616955159 shutdown_connections 2023-07-14T11:13:52.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.680+0000 7f4476dff700 1 -- 172.21.15.84:0/3616955159 wait complete. 2023-07-14T11:13:52.700 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:13:52.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.895+0000 7f08175ff700 1 Processor -- start 2023-07-14T11:13:52.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.895+0000 7f08175ff700 1 -- start start 2023-07-14T11:13:52.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.896+0000 7f08175ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f08100d1220 0x7f08100b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:52.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.896+0000 7f08175ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08100d2ce0 con 0x7f081015c950 2023-07-14T11:13:52.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.896+0000 7f08175ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08100b3350 con 0x7f08100b1e00 2023-07-14T11:13:52.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.896+0000 7f08175ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08100b3630 con 0x7f08100d1220 2023-07-14T11:13:52.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.896+0000 7f081539b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f081015c950 0x7f08100d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:56624/0 (socket says 172.21.15.84:56624) 2023-07-14T11:13:52.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.896+0000 7f081539b700 1 -- 172.21.15.84:0/4150899157 learned_addr learned my addr 172.21.15.84:0/4150899157 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:13:52.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.896+0000 7f0807fff700 1 -- 172.21.15.84:0/4150899157 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3102084068 0 0) 0x7f08100d2ce0 con 0x7f081015c950 2023-07-14T11:13:52.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.896+0000 7f0807fff700 1 -- 172.21.15.84:0/4150899157 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07fc0035b0 con 0x7f081015c950 2023-07-14T11:13:52.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.896+0000 7f0814b9a700 1 --2- 172.21.15.84:0/4150899157 >> v2:172.21.15.179:3300/0 conn(0x7f08100d1220 0x7f08100b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:52.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.897+0000 7f0807fff700 1 -- 172.21.15.84:0/4150899157 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2436405870 0 0) 0x7f07fc0035b0 con 0x7f081015c950 2023-07-14T11:13:52.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.897+0000 7f0807fff700 1 -- 172.21.15.84:0/4150899157 >> v2:172.21.15.179:3300/0 conn(0x7f08100d1220 msgr2=0x7f08100b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:52.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.897+0000 7f0807fff700 1 --2- 172.21.15.84:0/4150899157 >> v2:172.21.15.179:3300/0 conn(0x7f08100d1220 0x7f08100b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:52.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.897+0000 7f0807fff700 1 -- 172.21.15.84:0/4150899157 >> v1:172.21.15.179:6789/0 conn(0x7f08100b1e00 legacy=0x7f08100afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:52.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.897+0000 7f0807fff700 1 -- 172.21.15.84:0/4150899157 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08100b3910 con 0x7f081015c950 2023-07-14T11:13:52.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.897+0000 7f0807fff700 1 -- 172.21.15.84:0/4150899157 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7f080c0017f0 con 0x7f081015c950 2023-07-14T11:13:52.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.897+0000 7f0807fff700 1 -- 172.21.15.84:0/4150899157 >> v1:172.21.15.84:6789/0 conn(0x7f081015c950 legacy=0x7f08100d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:52.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.897+0000 7f0807fff700 1 --2- 172.21.15.84:0/4150899157 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07fc003a50 0x7f07fc003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:52.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.897+0000 7f0807fff700 1 --2- 172.21.15.84:0/4150899157 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07fc004850 0x7f07fc004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:52.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.897+0000 7f0807fff700 1 --2- 172.21.15.84:0/4150899157 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07fc005320 0x7f07fc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:52.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.897+0000 7f0807fff700 1 -- 172.21.15.84:0/4150899157 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08100b3630 con 0x7f07fc005320 2023-07-14T11:13:52.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.897+0000 7f0807fff700 1 -- 172.21.15.84:0/4150899157 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07fc00c210 con 0x7f07fc003a50 2023-07-14T11:13:52.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.897+0000 7f0807fff700 1 -- 172.21.15.84:0/4150899157 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07fc00c3d0 con 0x7f07fc004850 2023-07-14T11:13:52.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.897+0000 7f0815b9c700 1 --2- 172.21.15.84:0/4150899157 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07fc005320 0x7f07fc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:52.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.897+0000 7f081539b700 1 --2- 172.21.15.84:0/4150899157 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07fc003a50 0x7f07fc003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:52.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.897+0000 7f0814b9a700 1 --2- 172.21.15.84:0/4150899157 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07fc004850 0x7f07fc004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:52.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.898+0000 7f0815b9c700 1 -- 172.21.15.84:0/4150899157 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07fc004850 msgr2=0x7f07fc004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:52.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.898+0000 7f0815b9c700 1 --2- 172.21.15.84:0/4150899157 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07fc004850 0x7f07fc004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:52.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.898+0000 7f0815b9c700 1 -- 172.21.15.84:0/4150899157 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07fc003a50 msgr2=0x7f07fc003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:52.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.898+0000 7f0815b9c700 1 --2- 172.21.15.84:0/4150899157 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07fc003a50 0x7f07fc003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:52.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.898+0000 7f0815b9c700 1 -- 172.21.15.84:0/4150899157 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07fc0035b0 con 0x7f07fc005320 2023-07-14T11:13:52.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.898+0000 7f0815b9c700 1 -- 172.21.15.84:0/4150899157 reap_dead start 2023-07-14T11:13:52.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.898+0000 7f0815b9c700 1 --2- 172.21.15.84:0/4150899157 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07fc005320 0x7f07fc00ba10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f080800c190 tx=0x7f07fc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81a49b0734ebb58c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:52.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.898+0000 7f0807fff700 1 -- 172.21.15.84:0/4150899157 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0808001dd0 con 0x7f07fc005320 2023-07-14T11:13:52.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.898+0000 7f0807fff700 1 -- 172.21.15.84:0/4150899157 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f080800cd70 con 0x7f07fc005320 2023-07-14T11:13:52.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.898+0000 7f0807fff700 1 -- 172.21.15.84:0/4150899157 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0808003c40 con 0x7f07fc005320 2023-07-14T11:13:52.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.899+0000 7f08175ff700 1 -- 172.21.15.84:0/4150899157 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07fc005320 msgr2=0x7f07fc00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:52.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.899+0000 7f08175ff700 1 --2- 172.21.15.84:0/4150899157 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07fc005320 0x7f07fc00ba10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f080800c190 tx=0x7f07fc005880 comp rx=0 tx=0).stop 2023-07-14T11:13:52.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.899+0000 7f08175ff700 1 -- 172.21.15.84:0/4150899157 shutdown_connections 2023-07-14T11:13:52.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.899+0000 7f08175ff700 1 --2- 172.21.15.84:0/4150899157 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07fc005320 0x7f07fc00ba10 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:52.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.899+0000 7f08175ff700 1 -- 172.21.15.84:0/4150899157 >> 172.21.15.84:0/4150899157 conn(0x7f081009c1d0 msgr2=0x7f08100d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:52.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.899+0000 7f08175ff700 1 -- 172.21.15.84:0/4150899157 shutdown_connections 2023-07-14T11:13:52.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.899+0000 7f08175ff700 1 -- 172.21.15.84:0/4150899157 wait complete. 2023-07-14T11:13:52.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.900+0000 7f08175ff700 1 Processor -- start 2023-07-14T11:13:52.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.901+0000 7f08175ff700 1 -- start start 2023-07-14T11:13:52.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.901+0000 7f08175ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07fc005320 0x7f0810157640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:52.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.901+0000 7f08175ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08100b0b10 0x7f08100c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:52.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.901+0000 7f08175ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f081015a790 0x7f08100c9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:52.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.901+0000 7f08175ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f081015ad20 con 0x7f07fc005320 2023-07-14T11:13:52.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.901+0000 7f08175ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f081015b000 con 0x7f08100b0b10 2023-07-14T11:13:52.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.901+0000 7f08175ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f081015b2e0 con 0x7f081015a790 2023-07-14T11:13:52.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.902+0000 7f081539b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07fc005320 0x7f0810157640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:52.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.902+0000 7f081539b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07fc005320 0x7f0810157640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49756/0 (socket says 172.21.15.84:49756) 2023-07-14T11:13:52.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.902+0000 7f081539b700 1 -- 172.21.15.84:0/3414492527 learned_addr learned my addr 172.21.15.84:0/3414492527 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:52.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.902+0000 7f0814b9a700 1 --2- 172.21.15.84:0/3414492527 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08100b0b10 0x7f08100c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:52.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.902+0000 7f0815b9c700 1 --2- 172.21.15.84:0/3414492527 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f081015a790 0x7f08100c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:52.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.902+0000 7f081539b700 1 -- 172.21.15.84:0/3414492527 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f081015a790 msgr2=0x7f08100c9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:52.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.902+0000 7f081539b700 1 --2- 172.21.15.84:0/3414492527 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f081015a790 0x7f08100c9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:52.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.902+0000 7f081539b700 1 -- 172.21.15.84:0/3414492527 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08100b0b10 msgr2=0x7f08100c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:52.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.902+0000 7f081539b700 1 --2- 172.21.15.84:0/3414492527 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08100b0b10 0x7f08100c8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:52.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.902+0000 7f081539b700 1 -- 172.21.15.84:0/3414492527 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f081015b5c0 con 0x7f07fc005320 2023-07-14T11:13:52.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.902+0000 7f0814b9a700 1 --2- 172.21.15.84:0/3414492527 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08100b0b10 0x7f08100c8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:13:52.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.902+0000 7f081539b700 1 --2- 172.21.15.84:0/3414492527 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07fc005320 0x7f0810157640 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f080c006f20 tx=0x7f080c007320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:52.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.903+0000 7f0805ffb700 1 -- 172.21.15.84:0/3414492527 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f080c011580 con 0x7f07fc005320 2023-07-14T11:13:52.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.903+0000 7f0805ffb700 1 -- 172.21.15.84:0/3414492527 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f080c0116e0 con 0x7f07fc005320 2023-07-14T11:13:52.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.903+0000 7f0805ffb700 1 -- 172.21.15.84:0/3414492527 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f080c011a50 con 0x7f07fc005320 2023-07-14T11:13:52.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.903+0000 7f08175ff700 1 -- 172.21.15.84:0/3414492527 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0810159010 con 0x7f07fc005320 2023-07-14T11:13:52.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.903+0000 7f08175ff700 1 -- 172.21.15.84:0/3414492527 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f081015cd20 con 0x7f07fc005320 2023-07-14T11:13:52.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.904+0000 7f08175ff700 1 -- 172.21.15.84:0/3414492527 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f081004e280 con 0x7f07fc005320 2023-07-14T11:13:52.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.905+0000 7f0805ffb700 1 -- 172.21.15.84:0/3414492527 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f080c011bb0 con 0x7f07fc005320 2023-07-14T11:13:52.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.905+0000 7f0805ffb700 1 --2- 172.21.15.84:0/3414492527 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f07f406ace0 0x7f07f406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:52.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.906+0000 7f0805ffb700 1 -- 172.21.15.84:0/3414492527 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f080c089580 con 0x7f07fc005320 2023-07-14T11:13:52.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.906+0000 7f0814b9a700 1 --2- 172.21.15.84:0/3414492527 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f07f406ace0 0x7f07f406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:52.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.906+0000 7f0814b9a700 1 --2- 172.21.15.84:0/3414492527 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f07f406ace0 0x7f07f406d190 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f08100c9880 tx=0x7f0800008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:52.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:52.910+0000 7f0805ffb700 1 -- 172.21.15.84:0/3414492527 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f080c058160 con 0x7f07fc005320 2023-07-14T11:13:53.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.107+0000 7f08175ff700 1 -- 172.21.15.84:0/3414492527 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f081015de50 con 0x7f07fc005320 2023-07-14T11:13:53.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.108+0000 7f0805ffb700 1 -- 172.21.15.84:0/3414492527 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18255 (secure 0 0 0) 0x7f080c011e60 con 0x7f07fc005320 2023-07-14T11:13:53.110 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:13:53.111 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":23,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:13:15.989292+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-14T11:13:12.727811+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-14T11:13:13.436391+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:13:53.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.110+0000 7f08175ff700 1 -- 172.21.15.84:0/3414492527 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f07f406ace0 msgr2=0x7f07f406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:53.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.110+0000 7f08175ff700 1 --2- 172.21.15.84:0/3414492527 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f07f406ace0 0x7f07f406d190 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f08100c9880 tx=0x7f0800008040 comp rx=0 tx=0).stop 2023-07-14T11:13:53.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.110+0000 7f08175ff700 1 -- 172.21.15.84:0/3414492527 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07fc005320 msgr2=0x7f0810157640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:53.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.110+0000 7f08175ff700 1 --2- 172.21.15.84:0/3414492527 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07fc005320 0x7f0810157640 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f080c006f20 tx=0x7f080c007320 comp rx=0 tx=0).stop 2023-07-14T11:13:53.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.110+0000 7f08175ff700 1 -- 172.21.15.84:0/3414492527 shutdown_connections 2023-07-14T11:13:53.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.110+0000 7f08175ff700 1 --2- 172.21.15.84:0/3414492527 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f07f406ace0 0x7f07f406d190 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:53.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.110+0000 7f08175ff700 1 --2- 172.21.15.84:0/3414492527 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f081015a790 0x7f08100c9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:53.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.110+0000 7f08175ff700 1 --2- 172.21.15.84:0/3414492527 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07fc005320 0x7f0810157640 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:53.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.110+0000 7f08175ff700 1 --2- 172.21.15.84:0/3414492527 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08100b0b10 0x7f08100c8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:53.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.110+0000 7f08175ff700 1 -- 172.21.15.84:0/3414492527 >> 172.21.15.84:0/3414492527 conn(0x7f081009c1d0 msgr2=0x7f08100b1610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:53.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.111+0000 7f08175ff700 1 -- 172.21.15.84:0/3414492527 shutdown_connections 2023-07-14T11:13:53.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.111+0000 7f08175ff700 1 -- 172.21.15.84:0/3414492527 wait complete. 2023-07-14T11:13:53.131 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T11:13:00.125395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T11:13:06.803994+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T11:13:12.727811+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T11:13:13.436391+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T11:13:53.131 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T11:13:53.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.328+0000 7f7b5b5ff700 1 Processor -- start 2023-07-14T11:13:53.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.329+0000 7f7b5b5ff700 1 -- start start 2023-07-14T11:13:53.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.330+0000 7f7b5b5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b540c92d0 0x7f7b540ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:53.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.330+0000 7f7b5b5ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7b540b12f0 0x7f7b540c96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:53.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.330+0000 7f7b5b5ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b5415ce70 con 0x7f7b540adea0 2023-07-14T11:13:53.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.330+0000 7f7b5b5ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b5415da60 con 0x7f7b540b12f0 2023-07-14T11:13:53.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.330+0000 7f7b5b5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b540c9be0 con 0x7f7b540c92d0 2023-07-14T11:13:53.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.330+0000 7f7b59b9c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f7b540adea0 0x7f7b5406c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:56636/0 (socket says 172.21.15.84:56636) 2023-07-14T11:13:53.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.330+0000 7f7b58b9a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7b540b12f0 0x7f7b540c96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:53.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.330+0000 7f7b59b9c700 1 -- 172.21.15.84:0/4260616226 learned_addr learned my addr 172.21.15.84:0/4260616226 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:13:53.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.330+0000 7f7b5939b700 1 --2- 172.21.15.84:0/4260616226 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b540c92d0 0x7f7b540ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:53.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.331+0000 7f7b58b9a700 1 -- 172.21.15.84:0/4260616226 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b540c92d0 msgr2=0x7f7b540ad8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:53.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.331+0000 7f7b58b9a700 1 --2- 172.21.15.84:0/4260616226 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b540c92d0 0x7f7b540ad8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:53.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.331+0000 7f7b58b9a700 1 -- 172.21.15.84:0/4260616226 >> v1:172.21.15.84:6789/0 conn(0x7f7b540adea0 legacy=0x7f7b5406c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:53.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.331+0000 7f7b58b9a700 1 -- 172.21.15.84:0/4260616226 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b5415d0c0 con 0x7f7b540b12f0 2023-07-14T11:13:53.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.331+0000 7f7b58b9a700 1 --2- 172.21.15.84:0/4260616226 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b540b12f0 0x7f7b540c96a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7b44009840 tx=0x7f7b44009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de6cfe01917fe739 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:53.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.331+0000 7f7b4bfff700 1 -- 172.21.15.84:0/4260616226 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b44011830 con 0x7f7b540b12f0 2023-07-14T11:13:53.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.331+0000 7f7b4bfff700 1 -- 172.21.15.84:0/4260616226 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b44011990 con 0x7f7b540b12f0 2023-07-14T11:13:53.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.331+0000 7f7b4bfff700 1 -- 172.21.15.84:0/4260616226 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b44011d20 con 0x7f7b540b12f0 2023-07-14T11:13:53.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.332+0000 7f7b5b5ff700 1 -- 172.21.15.84:0/4260616226 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b540b12f0 msgr2=0x7f7b540c96a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:53.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.332+0000 7f7b5b5ff700 1 --2- 172.21.15.84:0/4260616226 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b540b12f0 0x7f7b540c96a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7b44009840 tx=0x7f7b44009b50 comp rx=0 tx=0).stop 2023-07-14T11:13:53.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.332+0000 7f7b5b5ff700 1 -- 172.21.15.84:0/4260616226 shutdown_connections 2023-07-14T11:13:53.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.332+0000 7f7b5b5ff700 1 --2- 172.21.15.84:0/4260616226 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b540c92d0 0x7f7b540ad8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:53.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.332+0000 7f7b5b5ff700 1 --2- 172.21.15.84:0/4260616226 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b540b12f0 0x7f7b540c96a0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:53.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.332+0000 7f7b5b5ff700 1 -- 172.21.15.84:0/4260616226 >> 172.21.15.84:0/4260616226 conn(0x7f7b540b05d0 msgr2=0x7f7b540b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:53.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.332+0000 7f7b5b5ff700 1 -- 172.21.15.84:0/4260616226 shutdown_connections 2023-07-14T11:13:53.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.332+0000 7f7b5b5ff700 1 -- 172.21.15.84:0/4260616226 wait complete. 2023-07-14T11:13:53.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.333+0000 7f7b5b5ff700 1 Processor -- start 2023-07-14T11:13:53.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.334+0000 7f7b5b5ff700 1 -- start start 2023-07-14T11:13:53.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.335+0000 7f7b5b5ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b540adea0 0x7f7b54152eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:53.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.335+0000 7f7b5b5ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b540b12f0 0x7f7b541528e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:53.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.335+0000 7f7b5b5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b540c92d0 0x7f7b540ac860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:53.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.335+0000 7f7b5b5ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b540c5b90 con 0x7f7b540b12f0 2023-07-14T11:13:53.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.335+0000 7f7b5b5ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b540c7a30 con 0x7f7b540adea0 2023-07-14T11:13:53.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.335+0000 7f7b5b5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b540c5de0 con 0x7f7b540c92d0 2023-07-14T11:13:53.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.335+0000 7f7b58b9a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b540b12f0 0x7f7b541528e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:53.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.335+0000 7f7b58b9a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b540b12f0 0x7f7b541528e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49778/0 (socket says 172.21.15.84:49778) 2023-07-14T11:13:53.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.335+0000 7f7b58b9a700 1 -- 172.21.15.84:0/3998693314 learned_addr learned my addr 172.21.15.84:0/3998693314 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:53.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.335+0000 7f7b5939b700 1 --2- 172.21.15.84:0/3998693314 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b540adea0 0x7f7b54152eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:53.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.335+0000 7f7b59b9c700 1 --2- 172.21.15.84:0/3998693314 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b540c92d0 0x7f7b540ac860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:53.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.335+0000 7f7b58b9a700 1 -- 172.21.15.84:0/3998693314 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b540c92d0 msgr2=0x7f7b540ac860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:53.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.335+0000 7f7b58b9a700 1 --2- 172.21.15.84:0/3998693314 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b540c92d0 0x7f7b540ac860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:53.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.335+0000 7f7b58b9a700 1 -- 172.21.15.84:0/3998693314 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b540adea0 msgr2=0x7f7b54152eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:53.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.335+0000 7f7b58b9a700 1 --2- 172.21.15.84:0/3998693314 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b540adea0 0x7f7b54152eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:53.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.335+0000 7f7b58b9a700 1 -- 172.21.15.84:0/3998693314 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b440094a0 con 0x7f7b540b12f0 2023-07-14T11:13:53.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.336+0000 7f7b58b9a700 1 --2- 172.21.15.84:0/3998693314 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b540b12f0 0x7f7b541528e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7b44009fd0 tx=0x7f7b44004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:53.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.336+0000 7f7b49ffb700 1 -- 172.21.15.84:0/3998693314 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b440036a0 con 0x7f7b540b12f0 2023-07-14T11:13:53.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.336+0000 7f7b49ffb700 1 -- 172.21.15.84:0/3998693314 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b4401f070 con 0x7f7b540b12f0 2023-07-14T11:13:53.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.336+0000 7f7b5b5ff700 1 -- 172.21.15.84:0/3998693314 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b540c60c0 con 0x7f7b540b12f0 2023-07-14T11:13:53.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.336+0000 7f7b49ffb700 1 -- 172.21.15.84:0/3998693314 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b44003a60 con 0x7f7b540b12f0 2023-07-14T11:13:53.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.336+0000 7f7b5b5ff700 1 -- 172.21.15.84:0/3998693314 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b541535c0 con 0x7f7b540b12f0 2023-07-14T11:13:53.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.337+0000 7f7b5b5ff700 1 -- 172.21.15.84:0/3998693314 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b54153750 con 0x7f7b540b12f0 2023-07-14T11:13:53.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.338+0000 7f7b49ffb700 1 -- 172.21.15.84:0/3998693314 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7b44003bc0 con 0x7f7b540b12f0 2023-07-14T11:13:53.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.339+0000 7f7b49ffb700 1 --2- 172.21.15.84:0/3998693314 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f7b3806ace0 0x7f7b3806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:53.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.339+0000 7f7b49ffb700 1 -- 172.21.15.84:0/3998693314 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7b44021070 con 0x7f7b540b12f0 2023-07-14T11:13:53.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.339+0000 7f7b5939b700 1 --2- 172.21.15.84:0/3998693314 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f7b3806ace0 0x7f7b3806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:53.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.339+0000 7f7b5939b700 1 --2- 172.21.15.84:0/3998693314 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f7b3806ace0 0x7f7b3806d190 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7b540b4a10 tx=0x7f7b50009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:53.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.343+0000 7f7b49ffb700 1 -- 172.21.15.84:0/3998693314 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7b44055d30 con 0x7f7b540b12f0 2023-07-14T11:13:53.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.536+0000 7f7b5b5ff700 1 -- 172.21.15.84:0/3998693314 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7b540c65e0 con 0x7f7b540b12f0 2023-07-14T11:13:53.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.536+0000 7f7b49ffb700 1 -- 172.21.15.84:0/3998693314 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7b540c65e0 con 0x7f7b540b12f0 2023-07-14T11:13:53.538 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-07-14T11:13:53.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.538+0000 7f7b5b5ff700 1 -- 172.21.15.84:0/3998693314 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f7b3806ace0 msgr2=0x7f7b3806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:53.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.538+0000 7f7b5b5ff700 1 --2- 172.21.15.84:0/3998693314 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f7b3806ace0 0x7f7b3806d190 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7b540b4a10 tx=0x7f7b50009210 comp rx=0 tx=0).stop 2023-07-14T11:13:53.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.538+0000 7f7b5b5ff700 1 -- 172.21.15.84:0/3998693314 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b540b12f0 msgr2=0x7f7b541528e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:53.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.538+0000 7f7b5b5ff700 1 --2- 172.21.15.84:0/3998693314 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b540b12f0 0x7f7b541528e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7b44009fd0 tx=0x7f7b44004750 comp rx=0 tx=0).stop 2023-07-14T11:13:53.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.538+0000 7f7b5b5ff700 1 -- 172.21.15.84:0/3998693314 shutdown_connections 2023-07-14T11:13:53.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.538+0000 7f7b5b5ff700 1 --2- 172.21.15.84:0/3998693314 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f7b3806ace0 0x7f7b3806d190 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:53.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.538+0000 7f7b5b5ff700 1 --2- 172.21.15.84:0/3998693314 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b540c92d0 0x7f7b540ac860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:53.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.538+0000 7f7b5b5ff700 1 --2- 172.21.15.84:0/3998693314 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b540adea0 0x7f7b54152eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:53.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.538+0000 7f7b5b5ff700 1 --2- 172.21.15.84:0/3998693314 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b540b12f0 0x7f7b541528e0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:53.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.538+0000 7f7b5b5ff700 1 -- 172.21.15.84:0/3998693314 >> 172.21.15.84:0/3998693314 conn(0x7f7b540b05d0 msgr2=0x7f7b540afda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:53.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.539+0000 7f7b5b5ff700 1 -- 172.21.15.84:0/3998693314 shutdown_connections 2023-07-14T11:13:53.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.539+0000 7f7b5b5ff700 1 -- 172.21.15.84:0/3998693314 wait complete. 2023-07-14T11:13:53.558 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T11:13:53.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.753+0000 7fcbd51ff700 1 Processor -- start 2023-07-14T11:13:53.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.754+0000 7fcbd51ff700 1 -- start start 2023-07-14T11:13:53.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.755+0000 7fcbd51ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcbd00d0b10 0x7fcbd00d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:53.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.755+0000 7fcbd51ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbd00b8e30 con 0x7fcbd00b0e20 2023-07-14T11:13:53.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.755+0000 7fcbd51ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbd00afaa0 con 0x7fcbd00b8a60 2023-07-14T11:13:53.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.755+0000 7fcbd51ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbd00d14d0 con 0x7fcbd00d0b10 2023-07-14T11:13:53.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.755+0000 7fcbce59c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcbd00d0b10 0x7fcbd00d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:53.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.755+0000 7fcbce59c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcbd00d0b10 0x7fcbd00d0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49794/0 (socket says 172.21.15.84:49794) 2023-07-14T11:13:53.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.755+0000 7fcbce59c700 1 -- 172.21.15.84:0/2220258296 learned_addr learned my addr 172.21.15.84:0/2220258296 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:53.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.755+0000 7fcbce59c700 1 -- 172.21.15.84:0/2220258296 >> v1:172.21.15.179:6789/0 conn(0x7fcbd00b8a60 legacy=0x7fcbd00b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:53.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.755+0000 7fcbce59c700 1 -- 172.21.15.84:0/2220258296 >> v1:172.21.15.84:6789/0 conn(0x7fcbd00b0e20 legacy=0x7fcbd00b1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:53.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.755+0000 7fcbce59c700 1 -- 172.21.15.84:0/2220258296 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbd00afd80 con 0x7fcbd00d0b10 2023-07-14T11:13:53.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.755+0000 7fcbcdd9b700 1 -- 172.21.15.84:0/2220258296 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3116416778 0 0) 0x7fcbd00b8e30 con 0x7fcbd00b0e20 2023-07-14T11:13:53.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.756+0000 7fcbce59c700 1 --2- 172.21.15.84:0/2220258296 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcbd00d0b10 0x7fcbd00d0f90 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fcbc40098f0 tx=0x7fcbc4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2b02f372f197ef7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:53.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.756+0000 7fcbcdd9b700 1 -- 172.21.15.84:0/2220258296 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc400b8a0 con 0x7fcbd00d0b10 2023-07-14T11:13:53.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.756+0000 7fcbcdd9b700 1 -- 172.21.15.84:0/2220258296 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbc400ba00 con 0x7fcbd00d0b10 2023-07-14T11:13:53.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.756+0000 7fcbcdd9b700 1 -- 172.21.15.84:0/2220258296 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc400bd90 con 0x7fcbd00d0b10 2023-07-14T11:13:53.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.756+0000 7fcbd51ff700 1 -- 172.21.15.84:0/2220258296 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcbd00d0b10 msgr2=0x7fcbd00d0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:53.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.756+0000 7fcbd51ff700 1 --2- 172.21.15.84:0/2220258296 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcbd00d0b10 0x7fcbd00d0f90 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fcbc40098f0 tx=0x7fcbc4009c00 comp rx=0 tx=0).stop 2023-07-14T11:13:53.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.757+0000 7fcbd51ff700 1 -- 172.21.15.84:0/2220258296 shutdown_connections 2023-07-14T11:13:53.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.757+0000 7fcbd51ff700 1 --2- 172.21.15.84:0/2220258296 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcbd00d0b10 0x7fcbd00d0f90 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:53.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.757+0000 7fcbd51ff700 1 -- 172.21.15.84:0/2220258296 >> 172.21.15.84:0/2220258296 conn(0x7fcbd009c1b0 msgr2=0x7fcbd00d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:53.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.757+0000 7fcbd51ff700 1 -- 172.21.15.84:0/2220258296 shutdown_connections 2023-07-14T11:13:53.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.757+0000 7fcbd51ff700 1 -- 172.21.15.84:0/2220258296 wait complete. 2023-07-14T11:13:53.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.758+0000 7fcbd51ff700 1 Processor -- start 2023-07-14T11:13:53.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.758+0000 7fcbd51ff700 1 -- start start 2023-07-14T11:13:53.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.759+0000 7fcbd51ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcbd00b0e20 0x7fcbd00c67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:53.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.759+0000 7fcbd51ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcbd00b8a60 0x7fcbd00c95d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:53.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.759+0000 7fcbd51ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcbd00d0b10 0x7fcbd01f1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:53.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.759+0000 7fcbd51ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd00c9b10 con 0x7fcbd00b0e20 2023-07-14T11:13:53.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.759+0000 7fcbd51ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd00c6ea0 con 0x7fcbd00b8a60 2023-07-14T11:13:53.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.759+0000 7fcbd51ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd00b8080 con 0x7fcbd00d0b10 2023-07-14T11:13:53.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.760+0000 7fcbced9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcbd00b0e20 0x7fcbd00c67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:53.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.760+0000 7fcbced9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcbd00b0e20 0x7fcbd00c67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49796/0 (socket says 172.21.15.84:49796) 2023-07-14T11:13:53.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.760+0000 7fcbced9d700 1 -- 172.21.15.84:0/3278780071 learned_addr learned my addr 172.21.15.84:0/3278780071 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:53.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.760+0000 7fcbce59c700 1 --2- 172.21.15.84:0/3278780071 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcbd00b8a60 0x7fcbd00c95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:53.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.760+0000 7fcbcf59e700 1 --2- 172.21.15.84:0/3278780071 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcbd00d0b10 0x7fcbd01f1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:53.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.760+0000 7fcbced9d700 1 -- 172.21.15.84:0/3278780071 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcbd00d0b10 msgr2=0x7fcbd01f1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:53.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.760+0000 7fcbced9d700 1 --2- 172.21.15.84:0/3278780071 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcbd00d0b10 0x7fcbd01f1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:53.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.760+0000 7fcbced9d700 1 -- 172.21.15.84:0/3278780071 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcbd00b8a60 msgr2=0x7fcbd00c95d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:53.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.760+0000 7fcbced9d700 1 --2- 172.21.15.84:0/3278780071 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcbd00b8a60 0x7fcbd00c95d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:53.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.760+0000 7fcbced9d700 1 -- 172.21.15.84:0/3278780071 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc4009550 con 0x7fcbd00b0e20 2023-07-14T11:13:53.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.760+0000 7fcbcf59e700 1 --2- 172.21.15.84:0/3278780071 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcbd00d0b10 0x7fcbd01f1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:13:53.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.760+0000 7fcbced9d700 1 --2- 172.21.15.84:0/3278780071 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcbd00b0e20 0x7fcbd00c67a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fcbc000c700 tx=0x7fcbc000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:53.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.760+0000 7fcbb77fe700 1 -- 172.21.15.84:0/3278780071 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc00052d0 con 0x7fcbd00b0e20 2023-07-14T11:13:53.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.760+0000 7fcbb77fe700 1 -- 172.21.15.84:0/3278780071 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbc0005430 con 0x7fcbd00b0e20 2023-07-14T11:13:53.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.760+0000 7fcbb77fe700 1 -- 172.21.15.84:0/3278780071 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc0003880 con 0x7fcbd00b0e20 2023-07-14T11:13:53.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.761+0000 7fcbd51ff700 1 -- 172.21.15.84:0/3278780071 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbd00b72c0 con 0x7fcbd00b0e20 2023-07-14T11:13:53.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.761+0000 7fcbd51ff700 1 -- 172.21.15.84:0/3278780071 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbd00b7880 con 0x7fcbd00b0e20 2023-07-14T11:13:53.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.762+0000 7fcbd51ff700 1 -- 172.21.15.84:0/3278780071 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbd0074350 con 0x7fcbd00b0e20 2023-07-14T11:13:53.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.763+0000 7fcbb77fe700 1 -- 172.21.15.84:0/3278780071 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcbc00039e0 con 0x7fcbd00b0e20 2023-07-14T11:13:53.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.763+0000 7fcbb77fe700 1 --2- 172.21.15.84:0/3278780071 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fcbbc06ace0 0x7fcbbc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:53.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.764+0000 7fcbb77fe700 1 -- 172.21.15.84:0/3278780071 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcbc00888c0 con 0x7fcbd00b0e20 2023-07-14T11:13:53.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.764+0000 7fcbce59c700 1 --2- 172.21.15.84:0/3278780071 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fcbbc06ace0 0x7fcbbc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:53.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.764+0000 7fcbce59c700 1 --2- 172.21.15.84:0/3278780071 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fcbbc06ace0 0x7fcbbc06d190 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fcbc4014040 tx=0x7fcbc401c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:53.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.768+0000 7fcbb77fe700 1 -- 172.21.15.84:0/3278780071 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fcbc0053980 con 0x7fcbd00b0e20 2023-07-14T11:13:53.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.965+0000 7fcbd51ff700 1 -- 172.21.15.84:0/3278780071 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fcbd008b870 con 0x7fcbd00b0e20 2023-07-14T11:13:53.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.965+0000 7fcbb77fe700 1 -- 172.21.15.84:0/3278780071 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7fcbc0017020 con 0x7fcbd00b0e20 2023-07-14T11:13:53.968 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-07-14T11:13:53.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.967+0000 7fcbd51ff700 1 -- 172.21.15.84:0/3278780071 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fcbbc06ace0 msgr2=0x7fcbbc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:53.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.967+0000 7fcbd51ff700 1 --2- 172.21.15.84:0/3278780071 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fcbbc06ace0 0x7fcbbc06d190 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fcbc4014040 tx=0x7fcbc401c040 comp rx=0 tx=0).stop 2023-07-14T11:13:53.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.967+0000 7fcbd51ff700 1 -- 172.21.15.84:0/3278780071 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcbd00b0e20 msgr2=0x7fcbd00c67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:53.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.967+0000 7fcbd51ff700 1 --2- 172.21.15.84:0/3278780071 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcbd00b0e20 0x7fcbd00c67a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fcbc000c700 tx=0x7fcbc000ca10 comp rx=0 tx=0).stop 2023-07-14T11:13:53.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.967+0000 7fcbd51ff700 1 -- 172.21.15.84:0/3278780071 shutdown_connections 2023-07-14T11:13:53.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.967+0000 7fcbd51ff700 1 --2- 172.21.15.84:0/3278780071 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fcbbc06ace0 0x7fcbbc06d190 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:53.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.967+0000 7fcbd51ff700 1 --2- 172.21.15.84:0/3278780071 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcbd00d0b10 0x7fcbd01f1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:53.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.967+0000 7fcbd51ff700 1 --2- 172.21.15.84:0/3278780071 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcbd00b0e20 0x7fcbd00c67a0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:53.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.967+0000 7fcbd51ff700 1 --2- 172.21.15.84:0/3278780071 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcbd00b8a60 0x7fcbd00c95d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:53.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.967+0000 7fcbd51ff700 1 -- 172.21.15.84:0/3278780071 >> 172.21.15.84:0/3278780071 conn(0x7fcbd009c1b0 msgr2=0x7fcbd00b25b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:53.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.967+0000 7fcbd51ff700 1 -- 172.21.15.84:0/3278780071 shutdown_connections 2023-07-14T11:13:53.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:53.967+0000 7fcbd51ff700 1 -- 172.21.15.84:0/3278780071 wait complete. 2023-07-14T11:13:53.987 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T11:13:54.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.188+0000 7f2cf27ff700 1 Processor -- start 2023-07-14T11:13:54.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.188+0000 7f2cf27ff700 1 -- start start 2023-07-14T11:13:54.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.190+0000 7f2cf27ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2cec156f90 0x7f2cec0cd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:54.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.190+0000 7f2cf27ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2cec0cdb30 0x7f2cec0cf7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:54.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.190+0000 7f2cf27ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2cec0cfd00 0x7f2cec160530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:54.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.190+0000 7f2cf27ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cec0d0140 con 0x7f2cec0cfd00 2023-07-14T11:13:54.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.190+0000 7f2cf27ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cec15de80 con 0x7f2cec156f90 2023-07-14T11:13:54.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.190+0000 7f2cf27ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cec15cf40 con 0x7f2cec0cdb30 2023-07-14T11:13:54.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.190+0000 7f2cf0d9c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2cec0cfd00 0x7f2cec160530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:54.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.190+0000 7f2cf0d9c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2cec0cfd00 0x7f2cec160530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49806/0 (socket says 172.21.15.84:49806) 2023-07-14T11:13:54.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.190+0000 7f2cf0d9c700 1 -- 172.21.15.84:0/1552318544 learned_addr learned my addr 172.21.15.84:0/1552318544 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:54.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.190+0000 7f2ceb7fe700 1 --2- 172.21.15.84:0/1552318544 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2cec0cdb30 0x7f2cec0cf7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:54.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.190+0000 7f2cebfff700 1 --2- 172.21.15.84:0/1552318544 >> v2:172.21.15.179:3300/0 conn(0x7f2cec156f90 0x7f2cec0cd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:54.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.190+0000 7f2cf0d9c700 1 -- 172.21.15.84:0/1552318544 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2cec0cdb30 msgr2=0x7f2cec0cf7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:54.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.190+0000 7f2cf0d9c700 1 --2- 172.21.15.84:0/1552318544 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2cec0cdb30 0x7f2cec0cf7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:54.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.190+0000 7f2cf0d9c700 1 -- 172.21.15.84:0/1552318544 >> v2:172.21.15.179:3300/0 conn(0x7f2cec156f90 msgr2=0x7f2cec0cd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:54.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.190+0000 7f2cf0d9c700 1 --2- 172.21.15.84:0/1552318544 >> v2:172.21.15.179:3300/0 conn(0x7f2cec156f90 0x7f2cec0cd5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:54.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.190+0000 7f2cf0d9c700 1 -- 172.21.15.84:0/1552318544 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cec15d200 con 0x7f2cec0cfd00 2023-07-14T11:13:54.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.191+0000 7f2cf0d9c700 1 --2- 172.21.15.84:0/1552318544 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cec0cfd00 0x7f2cec160530 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2cec0b50a0 tx=0x7f2ce400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=109e2a7b3d758b40 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:54.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.191+0000 7f2ceaffd700 1 -- 172.21.15.84:0/1552318544 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce400e070 con 0x7f2cec0cfd00 2023-07-14T11:13:54.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.191+0000 7f2ceaffd700 1 -- 172.21.15.84:0/1552318544 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ce400b9c0 con 0x7f2cec0cfd00 2023-07-14T11:13:54.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.191+0000 7f2ceaffd700 1 -- 172.21.15.84:0/1552318544 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce400bd70 con 0x7f2cec0cfd00 2023-07-14T11:13:54.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.191+0000 7f2cf27ff700 1 -- 172.21.15.84:0/1552318544 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cec0cfd00 msgr2=0x7f2cec160530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:54.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.191+0000 7f2cf27ff700 1 --2- 172.21.15.84:0/1552318544 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cec0cfd00 0x7f2cec160530 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2cec0b50a0 tx=0x7f2ce400b330 comp rx=0 tx=0).stop 2023-07-14T11:13:54.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.192+0000 7f2cf27ff700 1 -- 172.21.15.84:0/1552318544 shutdown_connections 2023-07-14T11:13:54.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.192+0000 7f2cf27ff700 1 --2- 172.21.15.84:0/1552318544 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cec0cfd00 0x7f2cec160530 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:54.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.192+0000 7f2cf27ff700 1 --2- 172.21.15.84:0/1552318544 >> v2:172.21.15.179:3300/0 conn(0x7f2cec156f90 0x7f2cec0cd5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:54.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.192+0000 7f2cf27ff700 1 --2- 172.21.15.84:0/1552318544 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2cec0cdb30 0x7f2cec0cf7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:54.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.192+0000 7f2cf27ff700 1 -- 172.21.15.84:0/1552318544 >> 172.21.15.84:0/1552318544 conn(0x7f2cec06a5c0 msgr2=0x7f2cec06a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:54.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.192+0000 7f2cf27ff700 1 -- 172.21.15.84:0/1552318544 shutdown_connections 2023-07-14T11:13:54.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.192+0000 7f2cf27ff700 1 -- 172.21.15.84:0/1552318544 wait complete. 2023-07-14T11:13:54.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.193+0000 7f2cf27ff700 1 Processor -- start 2023-07-14T11:13:54.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.193+0000 7f2cf27ff700 1 -- start start 2023-07-14T11:13:54.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.194+0000 7f2cf27ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2cec0cdb30 0x7f2cec1f6030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:54.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.194+0000 7f2cf27ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cec0cfd00 0x7f2cec1560f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:54.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.194+0000 7f2cf27ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2cec156f90 0x7f2cec154de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:54.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.194+0000 7f2cf27ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cec0cb280 con 0x7f2cec0cfd00 2023-07-14T11:13:54.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.194+0000 7f2cf27ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cec1f6570 con 0x7f2cec156f90 2023-07-14T11:13:54.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.194+0000 7f2cf27ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cec0cc370 con 0x7f2cec0cdb30 2023-07-14T11:13:54.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.195+0000 7f2ceb7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cec0cfd00 0x7f2cec1560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:54.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.195+0000 7f2ceb7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cec0cfd00 0x7f2cec1560f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49822/0 (socket says 172.21.15.84:49822) 2023-07-14T11:13:54.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.195+0000 7f2ceb7fe700 1 -- 172.21.15.84:0/3887843606 learned_addr learned my addr 172.21.15.84:0/3887843606 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:54.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.195+0000 7f2cebfff700 1 --2- 172.21.15.84:0/3887843606 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2cec0cdb30 0x7f2cec1f6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:54.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.195+0000 7f2cf0d9c700 1 --2- 172.21.15.84:0/3887843606 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2cec156f90 0x7f2cec154de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:54.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.195+0000 7f2ceb7fe700 1 -- 172.21.15.84:0/3887843606 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2cec0cdb30 msgr2=0x7f2cec1f6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:54.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.195+0000 7f2ceb7fe700 1 --2- 172.21.15.84:0/3887843606 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2cec0cdb30 0x7f2cec1f6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:54.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.195+0000 7f2ceb7fe700 1 -- 172.21.15.84:0/3887843606 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2cec156f90 msgr2=0x7f2cec154de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:54.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.195+0000 7f2ceb7fe700 1 --2- 172.21.15.84:0/3887843606 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2cec156f90 0x7f2cec154de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:54.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.195+0000 7f2ceb7fe700 1 -- 172.21.15.84:0/3887843606 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce4009b30 con 0x7f2cec0cfd00 2023-07-14T11:13:54.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.195+0000 7f2ceb7fe700 1 --2- 172.21.15.84:0/3887843606 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cec0cfd00 0x7f2cec1560f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2ce000e840 tx=0x7f2ce000eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:54.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.195+0000 7f2ce8ff9700 1 -- 172.21.15.84:0/3887843606 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce000c070 con 0x7f2cec0cfd00 2023-07-14T11:13:54.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.196+0000 7f2ce8ff9700 1 -- 172.21.15.84:0/3887843606 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ce0013610 con 0x7f2cec0cfd00 2023-07-14T11:13:54.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.196+0000 7f2ce8ff9700 1 -- 172.21.15.84:0/3887843606 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce00139c0 con 0x7f2cec0cfd00 2023-07-14T11:13:54.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.196+0000 7f2cf27ff700 1 -- 172.21.15.84:0/3887843606 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cec0cc5f0 con 0x7f2cec0cfd00 2023-07-14T11:13:54.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.196+0000 7f2cf27ff700 1 -- 172.21.15.84:0/3887843606 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cec0cc8b0 con 0x7f2cec0cfd00 2023-07-14T11:13:54.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.197+0000 7f2cf27ff700 1 -- 172.21.15.84:0/3887843606 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cec04e210 con 0x7f2cec0cfd00 2023-07-14T11:13:54.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.198+0000 7f2ce8ff9700 1 -- 172.21.15.84:0/3887843606 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2ce0013b20 con 0x7f2cec0cfd00 2023-07-14T11:13:54.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.198+0000 7f2ce8ff9700 1 --2- 172.21.15.84:0/3887843606 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f2cd806ace0 0x7f2cd806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:54.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.198+0000 7f2ce8ff9700 1 -- 172.21.15.84:0/3887843606 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2ce0089160 con 0x7f2cec0cfd00 2023-07-14T11:13:54.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.199+0000 7f2cebfff700 1 --2- 172.21.15.84:0/3887843606 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f2cd806ace0 0x7f2cd806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:54.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.199+0000 7f2cebfff700 1 --2- 172.21.15.84:0/3887843606 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f2cd806ace0 0x7f2cd806d190 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc006b20 tx=0x7f2cdc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:54.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.203+0000 7f2ce8ff9700 1 -- 172.21.15.84:0/3887843606 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f2ce0054210 con 0x7f2cec0cfd00 2023-07-14T11:13:54.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.395+0000 7f2cf27ff700 1 -- 172.21.15.84:0/3887843606 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2cec0d3a30 con 0x7f2cec0cfd00 2023-07-14T11:13:54.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.396+0000 7f2ce8ff9700 1 -- 172.21.15.84:0/3887843606 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2ce0057830 con 0x7f2cec0cfd00 2023-07-14T11:13:54.398 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-07-14T11:13:54.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.398+0000 7f2cf27ff700 1 -- 172.21.15.84:0/3887843606 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f2cd806ace0 msgr2=0x7f2cd806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:54.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.398+0000 7f2cf27ff700 1 --2- 172.21.15.84:0/3887843606 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f2cd806ace0 0x7f2cd806d190 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc006b20 tx=0x7f2cdc008040 comp rx=0 tx=0).stop 2023-07-14T11:13:54.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.398+0000 7f2cf27ff700 1 -- 172.21.15.84:0/3887843606 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cec0cfd00 msgr2=0x7f2cec1560f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:54.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.398+0000 7f2cf27ff700 1 --2- 172.21.15.84:0/3887843606 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cec0cfd00 0x7f2cec1560f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2ce000e840 tx=0x7f2ce000eb50 comp rx=0 tx=0).stop 2023-07-14T11:13:54.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.398+0000 7f2cf27ff700 1 -- 172.21.15.84:0/3887843606 shutdown_connections 2023-07-14T11:13:54.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.398+0000 7f2cf27ff700 1 --2- 172.21.15.84:0/3887843606 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f2cd806ace0 0x7f2cd806d190 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:54.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.398+0000 7f2cf27ff700 1 --2- 172.21.15.84:0/3887843606 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2cec0cdb30 0x7f2cec1f6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:54.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.398+0000 7f2cf27ff700 1 --2- 172.21.15.84:0/3887843606 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2cec156f90 0x7f2cec154de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:54.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.398+0000 7f2cf27ff700 1 --2- 172.21.15.84:0/3887843606 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cec0cfd00 0x7f2cec1560f0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:54.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.398+0000 7f2cf27ff700 1 -- 172.21.15.84:0/3887843606 >> 172.21.15.84:0/3887843606 conn(0x7f2cec06a5c0 msgr2=0x7f2cec15e050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:54.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.398+0000 7f2cf27ff700 1 -- 172.21.15.84:0/3887843606 shutdown_connections 2023-07-14T11:13:54.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.398+0000 7f2cf27ff700 1 -- 172.21.15.84:0/3887843606 wait complete. 2023-07-14T11:13:54.419 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T11:13:54.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.615+0000 7f34639ff700 1 Processor -- start 2023-07-14T11:13:54.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.616+0000 7f34639ff700 1 -- start start 2023-07-14T11:13:54.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.617+0000 7f34639ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f345c0b8a60 0x7f345c0b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:54.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.617+0000 7f34639ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f345c0d1220 0x7f345c0b0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:54.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.617+0000 7f34639ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f345c0b8e30 con 0x7f345c0b4530 2023-07-14T11:13:54.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.617+0000 7f34639ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f345c0afaa0 con 0x7f345c0b8a60 2023-07-14T11:13:54.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.617+0000 7f34639ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f345c0afd80 con 0x7f345c0d1220 2023-07-14T11:13:54.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.617+0000 7f3460f9a700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f345c0b4530 0x7f345c0d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:56658/0 (socket says 172.21.15.84:56658) 2023-07-14T11:13:54.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.617+0000 7f3460f9a700 1 -- 172.21.15.84:0/2129811080 learned_addr learned my addr 172.21.15.84:0/2129811080 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:13:54.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.617+0000 7f346179b700 1 --2- 172.21.15.84:0/2129811080 >> v2:172.21.15.84:3300/0 conn(0x7f345c0b8a60 0x7f345c0b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:54.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.618+0000 7f3461f9c700 1 --2- 172.21.15.84:0/2129811080 >> v2:172.21.15.179:3300/0 conn(0x7f345c0d1220 0x7f345c0b0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:54.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.618+0000 7f3453fff700 1 -- 172.21.15.84:0/2129811080 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2094746858 0 0) 0x7f345c0b8e30 con 0x7f345c0b4530 2023-07-14T11:13:54.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.618+0000 7f3453fff700 1 -- 172.21.15.84:0/2129811080 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34480035b0 con 0x7f345c0b4530 2023-07-14T11:13:54.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.618+0000 7f346179b700 1 -- 172.21.15.84:0/2129811080 >> v2:172.21.15.179:3300/0 conn(0x7f345c0d1220 msgr2=0x7f345c0b0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:54.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.618+0000 7f346179b700 1 --2- 172.21.15.84:0/2129811080 >> v2:172.21.15.179:3300/0 conn(0x7f345c0d1220 0x7f345c0b0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:54.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.618+0000 7f346179b700 1 -- 172.21.15.84:0/2129811080 >> v1:172.21.15.84:6789/0 conn(0x7f345c0b4530 legacy=0x7f345c0d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:54.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.618+0000 7f346179b700 1 -- 172.21.15.84:0/2129811080 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f345c0b0060 con 0x7f345c0b8a60 2023-07-14T11:13:54.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.618+0000 7f346179b700 1 --2- 172.21.15.84:0/2129811080 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f345c0b8a60 0x7f345c0b3ff0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f345c0674e0 tx=0x7f3458009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=265da0b5004ec4a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:54.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.618+0000 7f3453fff700 1 -- 172.21.15.84:0/2129811080 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3458011830 con 0x7f345c0b8a60 2023-07-14T11:13:54.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.618+0000 7f3453fff700 1 -- 172.21.15.84:0/2129811080 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3458011990 con 0x7f345c0b8a60 2023-07-14T11:13:54.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.618+0000 7f3453fff700 1 -- 172.21.15.84:0/2129811080 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3458011d20 con 0x7f345c0b8a60 2023-07-14T11:13:54.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.619+0000 7f34639ff700 1 -- 172.21.15.84:0/2129811080 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f345c0b8a60 msgr2=0x7f345c0b3ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:54.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.619+0000 7f34639ff700 1 --2- 172.21.15.84:0/2129811080 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f345c0b8a60 0x7f345c0b3ff0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f345c0674e0 tx=0x7f3458009b20 comp rx=0 tx=0).stop 2023-07-14T11:13:54.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.619+0000 7f34639ff700 1 -- 172.21.15.84:0/2129811080 shutdown_connections 2023-07-14T11:13:54.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.619+0000 7f34639ff700 1 --2- 172.21.15.84:0/2129811080 >> v2:172.21.15.179:3300/0 conn(0x7f345c0d1220 0x7f345c0b0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:54.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.619+0000 7f34639ff700 1 --2- 172.21.15.84:0/2129811080 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f345c0b8a60 0x7f345c0b3ff0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:54.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.619+0000 7f34639ff700 1 -- 172.21.15.84:0/2129811080 >> 172.21.15.84:0/2129811080 conn(0x7f345c09c1b0 msgr2=0x7f345c0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:54.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.619+0000 7f34639ff700 1 -- 172.21.15.84:0/2129811080 shutdown_connections 2023-07-14T11:13:54.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.619+0000 7f34639ff700 1 -- 172.21.15.84:0/2129811080 wait complete. 2023-07-14T11:13:54.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.621+0000 7f34639ff700 1 Processor -- start 2023-07-14T11:13:54.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.621+0000 7f34639ff700 1 -- start start 2023-07-14T11:13:54.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.622+0000 7f34639ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f345c0b4530 0x7f345c15fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:54.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.622+0000 7f34639ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f345c0b8a60 0x7f345c155470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:54.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.622+0000 7f34639ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f345c0d1220 0x7f345c15ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:54.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.622+0000 7f34639ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f345c156070 con 0x7f345c0b4530 2023-07-14T11:13:54.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.622+0000 7f34639ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f345c15f780 con 0x7f345c0d1220 2023-07-14T11:13:54.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.622+0000 7f34639ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f345c156330 con 0x7f345c0b8a60 2023-07-14T11:13:54.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.622+0000 7f346179b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f345c0b4530 0x7f345c15fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:54.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.622+0000 7f346179b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f345c0b4530 0x7f345c15fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49840/0 (socket says 172.21.15.84:49840) 2023-07-14T11:13:54.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.622+0000 7f346179b700 1 -- 172.21.15.84:0/4260332379 learned_addr learned my addr 172.21.15.84:0/4260332379 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:54.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.622+0000 7f346179b700 1 -- 172.21.15.84:0/4260332379 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f345c0b8a60 msgr2=0x7f345c155470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:54.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.622+0000 7f346179b700 1 --2- 172.21.15.84:0/4260332379 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f345c0b8a60 0x7f345c155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:54.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.622+0000 7f346179b700 1 -- 172.21.15.84:0/4260332379 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f345c0d1220 msgr2=0x7f345c15ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:54.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.622+0000 7f346179b700 1 --2- 172.21.15.84:0/4260332379 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f345c0d1220 0x7f345c15ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:54.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.622+0000 7f346179b700 1 -- 172.21.15.84:0/4260332379 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34580094a0 con 0x7f345c0b4530 2023-07-14T11:13:54.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.623+0000 7f346179b700 1 --2- 172.21.15.84:0/4260332379 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f345c0b4530 0x7f345c15fa30 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3458009b60 tx=0x7f3458004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:54.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.623+0000 7f3451ffb700 1 -- 172.21.15.84:0/4260332379 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34580036a0 con 0x7f345c0b4530 2023-07-14T11:13:54.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.623+0000 7f3451ffb700 1 -- 172.21.15.84:0/4260332379 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f345801f070 con 0x7f345c0b4530 2023-07-14T11:13:54.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.623+0000 7f3451ffb700 1 -- 172.21.15.84:0/4260332379 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3458003a20 con 0x7f345c0b4530 2023-07-14T11:13:54.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.623+0000 7f34639ff700 1 -- 172.21.15.84:0/4260332379 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f345c15a410 con 0x7f345c0b4530 2023-07-14T11:13:54.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.623+0000 7f34639ff700 1 -- 172.21.15.84:0/4260332379 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f345c156610 con 0x7f345c0b4530 2023-07-14T11:13:54.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.624+0000 7f34639ff700 1 -- 172.21.15.84:0/4260332379 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f345c074350 con 0x7f345c0b4530 2023-07-14T11:13:54.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.625+0000 7f3451ffb700 1 -- 172.21.15.84:0/4260332379 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3458003b80 con 0x7f345c0b4530 2023-07-14T11:13:54.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.626+0000 7f3451ffb700 1 --2- 172.21.15.84:0/4260332379 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f344006ad10 0x7f344006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:54.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.626+0000 7f3451ffb700 1 -- 172.21.15.84:0/4260332379 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3458021070 con 0x7f345c0b4530 2023-07-14T11:13:54.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.626+0000 7f3460f9a700 1 --2- 172.21.15.84:0/4260332379 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f344006ad10 0x7f344006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:54.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.626+0000 7f3460f9a700 1 --2- 172.21.15.84:0/4260332379 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f344006ad10 0x7f344006d1c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f345c15c6f0 tx=0x7f344c0079c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:54.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.630+0000 7f3451ffb700 1 -- 172.21.15.84:0/4260332379 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3458055eb0 con 0x7f345c0b4530 2023-07-14T11:13:54.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.831+0000 7f34639ff700 1 -- 172.21.15.84:0/4260332379 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f345c0d23e0 con 0x7f345c0b4530 2023-07-14T11:13:54.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.832+0000 7f3451ffb700 1 -- 172.21.15.84:0/4260332379 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f34580150a0 con 0x7f345c0b4530 2023-07-14T11:13:54.834 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-07-14T11:13:54.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.834+0000 7f34639ff700 1 -- 172.21.15.84:0/4260332379 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f344006ad10 msgr2=0x7f344006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:54.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.834+0000 7f34639ff700 1 --2- 172.21.15.84:0/4260332379 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f344006ad10 0x7f344006d1c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f345c15c6f0 tx=0x7f344c0079c0 comp rx=0 tx=0).stop 2023-07-14T11:13:54.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.834+0000 7f34639ff700 1 -- 172.21.15.84:0/4260332379 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f345c0b4530 msgr2=0x7f345c15fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:54.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.834+0000 7f34639ff700 1 --2- 172.21.15.84:0/4260332379 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f345c0b4530 0x7f345c15fa30 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3458009b60 tx=0x7f3458004750 comp rx=0 tx=0).stop 2023-07-14T11:13:54.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.834+0000 7f34639ff700 1 -- 172.21.15.84:0/4260332379 shutdown_connections 2023-07-14T11:13:54.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.834+0000 7f34639ff700 1 --2- 172.21.15.84:0/4260332379 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f345c0d1220 0x7f345c15ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:54.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.834+0000 7f34639ff700 1 --2- 172.21.15.84:0/4260332379 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f345c0b4530 0x7f345c15fa30 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:54.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.834+0000 7f34639ff700 1 --2- 172.21.15.84:0/4260332379 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f344006ad10 0x7f344006d1c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:54.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.834+0000 7f34639ff700 1 --2- 172.21.15.84:0/4260332379 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f345c0b8a60 0x7f345c155470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:54.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.834+0000 7f34639ff700 1 -- 172.21.15.84:0/4260332379 >> 172.21.15.84:0/4260332379 conn(0x7f345c09c1b0 msgr2=0x7f345c0b7da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:54.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.834+0000 7f34639ff700 1 -- 172.21.15.84:0/4260332379 shutdown_connections 2023-07-14T11:13:54.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:54.834+0000 7f34639ff700 1 -- 172.21.15.84:0/4260332379 wait complete. 2023-07-14T11:13:54.965 INFO:tasks.cephfs_test_runner:Starting test: test_binary_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) 2023-07-14T11:13:54.966 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade' 2023-07-14T11:13:55.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:55.165+0000 7f60d9bff700 1 Processor -- start 2023-07-14T11:13:55.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:55.165+0000 7f60d9bff700 1 -- start start 2023-07-14T11:13:55.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:55.166+0000 7f60d9bff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f60d4071560 0x7f60d40cc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:55.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:55.166+0000 7f60d9bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60d40ce2c0 0x7f60d40ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:55.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:55.166+0000 7f60d9bff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60d406b040 con 0x7f60d415a650 2023-07-14T11:13:55.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:55.166+0000 7f60d9bff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60d406fb50 con 0x7f60d4071560 2023-07-14T11:13:55.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:55.166+0000 7f60d9bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60d406f870 con 0x7f60d40ce2c0 2023-07-14T11:13:55.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:55.166+0000 7f60d2ffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f60d4071560 0x7f60d40cc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:55.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:55.166+0000 7f60d2ffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f60d4071560 0x7f60d40cc690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49854/0 (socket says 172.21.15.84:49854) 2023-07-14T11:13:55.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:55.166+0000 7f60d2ffd700 1 -- 172.21.15.84:0/2800243237 learned_addr learned my addr 172.21.15.84:0/2800243237 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:55.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:55.167+0000 7f60d3fff700 1 --2- 172.21.15.84:0/2800243237 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60d40ce2c0 0x7f60d40ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:55.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:55.167+0000 7f60d2ffd700 1 -- 172.21.15.84:0/2800243237 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60d40ce2c0 msgr2=0x7f60d40ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:55.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:55.167+0000 7f60d2ffd700 1 --2- 172.21.15.84:0/2800243237 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60d40ce2c0 0x7f60d40ccbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:55.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:55.167+0000 7f60d2ffd700 1 -- 172.21.15.84:0/2800243237 >> v1:172.21.15.179:6789/0 conn(0x7f60d415a650 legacy=0x7f60d4070e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:55.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:55.167+0000 7f60d2ffd700 1 -- 172.21.15.84:0/2800243237 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60d4070890 con 0x7f60d4071560 2023-07-14T11:13:55.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:55.167+0000 7f60d2ffd700 1 --2- 172.21.15.84:0/2800243237 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60d4071560 0x7f60d40cc690 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f60c80098f0 tx=0x7f60c8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3321571f5739055a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:55.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:55.167+0000 7f60d27fc700 1 -- 172.21.15.84:0/2800243237 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c8004230 con 0x7f60d4071560 2023-07-14T11:13:55.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:55.167+0000 7f60d27fc700 1 -- 172.21.15.84:0/2800243237 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60c8004390 con 0x7f60d4071560 2023-07-14T11:13:55.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:55.167+0000 7f60d27fc700 1 -- 172.21.15.84:0/2800243237 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c80036a0 con 0x7f60d4071560 2023-07-14T11:13:55.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:55.168+0000 7f60d9bff700 1 -- 172.21.15.84:0/2800243237 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60d4071560 msgr2=0x7f60d40cc690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:55.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:55.168+0000 7f60d9bff700 1 --2- 172.21.15.84:0/2800243237 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60d4071560 0x7f60d40cc690 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f60c80098f0 tx=0x7f60c8009c00 comp rx=0 tx=0).stop 2023-07-14T11:13:55.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:55.168+0000 7f60d9bff700 1 -- 172.21.15.84:0/2800243237 shutdown_connections 2023-07-14T11:13:55.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:55.168+0000 7f60d9bff700 1 --2- 172.21.15.84:0/2800243237 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60d40ce2c0 0x7f60d40ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:55.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:55.168+0000 7f60d9bff700 1 --2- 172.21.15.84:0/2800243237 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60d4071560 0x7f60d40cc690 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:55.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:55.168+0000 7f60d9bff700 1 -- 172.21.15.84:0/2800243237 >> 172.21.15.84:0/2800243237 conn(0x7f60d406ab70 msgr2=0x7f60d40b05d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:55.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:55.168+0000 7f60d9bff700 1 -- 172.21.15.84:0/2800243237 shutdown_connections 2023-07-14T11:13:55.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:55.168+0000 7f60d9bff700 1 -- 172.21.15.84:0/2800243237 wait complete. 2023-07-14T11:13:55.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:55.170+0000 7f60d9bff700 1 Processor -- start 2023-07-14T11:13:55.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:55.170+0000 7f60d9bff700 1 -- start start 2023-07-14T11:13:55.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:55.171+0000 7f60d9bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60d4071560 0x7f60d415cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:55.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:55.171+0000 7f60d9bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60d40ce2c0 0x7f60d41ef630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:55.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:55.171+0000 7f60d9bff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60d415a650 0x7f60d415c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:55.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:55.171+0000 7f60d9bff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60d41efb70 con 0x7f60d415a650 2023-07-14T11:13:55.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:55.171+0000 7f60d9bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60d41efdf0 con 0x7f60d4071560 2023-07-14T11:13:55.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:55.171+0000 7f60d9bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60d41f0090 con 0x7f60d40ce2c0 2023-07-14T11:13:55.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:55.171+0000 7f60d3fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60d415a650 0x7f60d415c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:55.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:55.171+0000 7f60d3fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60d415a650 0x7f60d415c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49870/0 (socket says 172.21.15.84:49870) 2023-07-14T11:13:55.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:55.171+0000 7f60d3fff700 1 -- 172.21.15.84:0/4260109248 learned_addr learned my addr 172.21.15.84:0/4260109248 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:55.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:55.172+0000 7f60d37fe700 1 --2- 172.21.15.84:0/4260109248 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60d4071560 0x7f60d415cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:55.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:55.172+0000 7f60d2ffd700 1 --2- 172.21.15.84:0/4260109248 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60d40ce2c0 0x7f60d41ef630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:55.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:55.172+0000 7f60d3fff700 1 -- 172.21.15.84:0/4260109248 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60d40ce2c0 msgr2=0x7f60d41ef630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:55.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:55.172+0000 7f60d3fff700 1 --2- 172.21.15.84:0/4260109248 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60d40ce2c0 0x7f60d41ef630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:55.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:55.172+0000 7f60d3fff700 1 -- 172.21.15.84:0/4260109248 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60d4071560 msgr2=0x7f60d415cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:55.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:55.172+0000 7f60d3fff700 1 --2- 172.21.15.84:0/4260109248 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60d4071560 0x7f60d415cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:55.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:55.172+0000 7f60d3fff700 1 -- 172.21.15.84:0/4260109248 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60c8009550 con 0x7f60d415a650 2023-07-14T11:13:55.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:55.172+0000 7f60d2ffd700 1 --2- 172.21.15.84:0/4260109248 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60d40ce2c0 0x7f60d41ef630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:13:55.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:55.172+0000 7f60d3fff700 1 --2- 172.21.15.84:0/4260109248 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60d415a650 0x7f60d415c1b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f60cc007e40 tx=0x7f60cc00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:55.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:55.172+0000 7f60bbfff700 1 -- 172.21.15.84:0/4260109248 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60cc00eea0 con 0x7f60d415a650 2023-07-14T11:13:55.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:55.172+0000 7f60bbfff700 1 -- 172.21.15.84:0/4260109248 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60cc014420 con 0x7f60d415a650 2023-07-14T11:13:55.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:55.172+0000 7f60bbfff700 1 -- 172.21.15.84:0/4260109248 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60cc0147b0 con 0x7f60d415a650 2023-07-14T11:13:55.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:55.172+0000 7f60d9bff700 1 -- 172.21.15.84:0/4260109248 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60d41f0370 con 0x7f60d415a650 2023-07-14T11:13:55.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:55.172+0000 7f60d9bff700 1 -- 172.21.15.84:0/4260109248 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60d41f0930 con 0x7f60d415a650 2023-07-14T11:13:55.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:55.173+0000 7f60d9bff700 1 -- 172.21.15.84:0/4260109248 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60d41f0ac0 con 0x7f60d415a650 2023-07-14T11:13:55.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:55.174+0000 7f60bbfff700 1 -- 172.21.15.84:0/4260109248 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f60cc014910 con 0x7f60d415a650 2023-07-14T11:13:55.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:55.175+0000 7f60bbfff700 1 --2- 172.21.15.84:0/4260109248 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f60c006ace0 0x7f60c006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:55.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:55.175+0000 7f60bbfff700 1 -- 172.21.15.84:0/4260109248 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f60cc089d10 con 0x7f60d415a650 2023-07-14T11:13:55.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:55.175+0000 7f60d37fe700 1 --2- 172.21.15.84:0/4260109248 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f60c006ace0 0x7f60c006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:55.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:55.176+0000 7f60d37fe700 1 --2- 172.21.15.84:0/4260109248 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f60c006ace0 0x7f60c006d190 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f60c4009870 tx=0x7f60c4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:55.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:55.179+0000 7f60bbfff700 1 -- 172.21.15.84:0/4260109248 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f60cc08f020 con 0x7f60d415a650 2023-07-14T11:13:55.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:55.458+0000 7f60d9bff700 1 -- 172.21.15.84:0/4260109248 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade"]} v 0) v1 -- 0x7f60d4074350 con 0x7f60d415a650 2023-07-14T11:13:55.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:55.837+0000 7f60bbfff700 1 -- 172.21.15.84:0/4260109248 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade"]}]=0 v63) v1 ==== 161+0+0 (secure 0 0 0) 0x7f60cc054d70 con 0x7f60d415a650 2023-07-14T11:13:55.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:55.839+0000 7f60d9bff700 1 -- 172.21.15.84:0/4260109248 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f60c006ace0 msgr2=0x7f60c006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:55.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:55.839+0000 7f60d9bff700 1 --2- 172.21.15.84:0/4260109248 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f60c006ace0 0x7f60c006d190 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f60c4009870 tx=0x7f60c4008040 comp rx=0 tx=0).stop 2023-07-14T11:13:55.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:55.839+0000 7f60d9bff700 1 -- 172.21.15.84:0/4260109248 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60d415a650 msgr2=0x7f60d415c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:55.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:55.839+0000 7f60d9bff700 1 --2- 172.21.15.84:0/4260109248 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60d415a650 0x7f60d415c1b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f60cc007e40 tx=0x7f60cc00e3c0 comp rx=0 tx=0).stop 2023-07-14T11:13:55.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:55.839+0000 7f60d9bff700 1 -- 172.21.15.84:0/4260109248 shutdown_connections 2023-07-14T11:13:55.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:55.839+0000 7f60d9bff700 1 --2- 172.21.15.84:0/4260109248 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60d415a650 0x7f60d415c1b0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:55.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:55.839+0000 7f60d9bff700 1 --2- 172.21.15.84:0/4260109248 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60d4071560 0x7f60d415cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:55.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:55.839+0000 7f60d9bff700 1 --2- 172.21.15.84:0/4260109248 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f60c006ace0 0x7f60c006d190 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:55.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:55.839+0000 7f60d9bff700 1 --2- 172.21.15.84:0/4260109248 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60d40ce2c0 0x7f60d41ef630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:55.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:55.839+0000 7f60d9bff700 1 -- 172.21.15.84:0/4260109248 >> 172.21.15.84:0/4260109248 conn(0x7f60d406ab70 msgr2=0x7f60d40ccdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:55.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:55.839+0000 7f60d9bff700 1 -- 172.21.15.84:0/4260109248 shutdown_connections 2023-07-14T11:13:55.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:55.839+0000 7f60d9bff700 1 -- 172.21.15.84:0/4260109248 wait complete. 2023-07-14T11:13:55.862 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-14T11:13:56.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.059+0000 7f3c4d3ff700 1 Processor -- start 2023-07-14T11:13:56.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.060+0000 7f3c4d3ff700 1 -- start start 2023-07-14T11:13:56.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.061+0000 7f3c4d3ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3c480b4860 0x7f3c480b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:56.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.061+0000 7f3c4d3ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3c480d12c0 0x7f3c480d16e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:56.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.061+0000 7f3c4d3ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c480d02a0 con 0x7f3c480b8660 2023-07-14T11:13:56.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.061+0000 7f3c4d3ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c480b5240 con 0x7f3c480d12c0 2023-07-14T11:13:56.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.061+0000 7f3c4d3ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c480cfce0 con 0x7f3c480b4860 2023-07-14T11:13:56.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.061+0000 7f3c477fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3c480d12c0 0x7f3c480d16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:56.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.061+0000 7f3c477fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3c480d12c0 0x7f3c480d16e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49882/0 (socket says 172.21.15.84:49882) 2023-07-14T11:13:56.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.061+0000 7f3c477fe700 1 -- 172.21.15.84:0/534960577 learned_addr learned my addr 172.21.15.84:0/534960577 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:56.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.061+0000 7f3c3ffff700 1 --2- 172.21.15.84:0/534960577 >> v2:172.21.15.179:3300/0 conn(0x7f3c480b4860 0x7f3c480b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:56.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.062+0000 7f3c477fe700 1 -- 172.21.15.84:0/534960577 >> v2:172.21.15.179:3300/0 conn(0x7f3c480b4860 msgr2=0x7f3c480b4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:56.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.062+0000 7f3c477fe700 1 --2- 172.21.15.84:0/534960577 >> v2:172.21.15.179:3300/0 conn(0x7f3c480b4860 0x7f3c480b4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:56.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.062+0000 7f3c477fe700 1 -- 172.21.15.84:0/534960577 >> v1:172.21.15.179:6789/0 conn(0x7f3c480b8660 legacy=0x7f3c480cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:56.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.062+0000 7f3c477fe700 1 -- 172.21.15.84:0/534960577 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c480cffc0 con 0x7f3c480d12c0 2023-07-14T11:13:56.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.062+0000 7f3c477fe700 1 --2- 172.21.15.84:0/534960577 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c480d12c0 0x7f3c480d16e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3c48160130 tx=0x7f3c4000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4f254604f3d92c9 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:56.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.062+0000 7f3c467fc700 1 -- 172.21.15.84:0/534960577 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4000e070 con 0x7f3c480d12c0 2023-07-14T11:13:56.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.062+0000 7f3c467fc700 1 -- 172.21.15.84:0/534960577 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c4000b910 con 0x7f3c480d12c0 2023-07-14T11:13:56.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.062+0000 7f3c467fc700 1 -- 172.21.15.84:0/534960577 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4000bcc0 con 0x7f3c480d12c0 2023-07-14T11:13:56.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.063+0000 7f3c4d3ff700 1 -- 172.21.15.84:0/534960577 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c480d12c0 msgr2=0x7f3c480d16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:56.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.063+0000 7f3c4d3ff700 1 --2- 172.21.15.84:0/534960577 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c480d12c0 0x7f3c480d16e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3c48160130 tx=0x7f3c4000b330 comp rx=0 tx=0).stop 2023-07-14T11:13:56.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.063+0000 7f3c4d3ff700 1 -- 172.21.15.84:0/534960577 shutdown_connections 2023-07-14T11:13:56.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.063+0000 7f3c4d3ff700 1 --2- 172.21.15.84:0/534960577 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c480d12c0 0x7f3c480d16e0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:56.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.063+0000 7f3c4d3ff700 1 --2- 172.21.15.84:0/534960577 >> v2:172.21.15.179:3300/0 conn(0x7f3c480b4860 0x7f3c480b4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:56.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.063+0000 7f3c4d3ff700 1 -- 172.21.15.84:0/534960577 >> 172.21.15.84:0/534960577 conn(0x7f3c48066860 msgr2=0x7f3c4806a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:56.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.063+0000 7f3c4d3ff700 1 -- 172.21.15.84:0/534960577 shutdown_connections 2023-07-14T11:13:56.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.063+0000 7f3c4d3ff700 1 -- 172.21.15.84:0/534960577 wait complete. 2023-07-14T11:13:56.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.064+0000 7f3c4d3ff700 1 Processor -- start 2023-07-14T11:13:56.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.064+0000 7f3c4d3ff700 1 -- start start 2023-07-14T11:13:56.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.065+0000 7f3c4d3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c480b4860 0x7f3c480b3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:56.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.065+0000 7f3c4d3ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c480b8660 0x7f3c481e5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:56.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.065+0000 7f3c4d3ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c480d12c0 0x7f3c4814b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:56.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.065+0000 7f3c4d3ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c481f5aa0 con 0x7f3c480d12c0 2023-07-14T11:13:56.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.065+0000 7f3c4d3ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c481f5d80 con 0x7f3c480b8660 2023-07-14T11:13:56.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.065+0000 7f3c4d3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c481f6060 con 0x7f3c480b4860 2023-07-14T11:13:56.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.066+0000 7f3c477fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c480d12c0 0x7f3c4814b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:56.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.066+0000 7f3c477fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c480d12c0 0x7f3c4814b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49898/0 (socket says 172.21.15.84:49898) 2023-07-14T11:13:56.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.066+0000 7f3c477fe700 1 -- 172.21.15.84:0/1266312408 learned_addr learned my addr 172.21.15.84:0/1266312408 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:56.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.066+0000 7f3c3ffff700 1 --2- 172.21.15.84:0/1266312408 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c480b8660 0x7f3c481e5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:56.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.066+0000 7f3c46ffd700 1 --2- 172.21.15.84:0/1266312408 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c480b4860 0x7f3c480b3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:56.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.066+0000 7f3c477fe700 1 -- 172.21.15.84:0/1266312408 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c480b4860 msgr2=0x7f3c480b3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:56.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.066+0000 7f3c477fe700 1 --2- 172.21.15.84:0/1266312408 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c480b4860 0x7f3c480b3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:56.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.066+0000 7f3c477fe700 1 -- 172.21.15.84:0/1266312408 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c480b8660 msgr2=0x7f3c481e5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:56.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.066+0000 7f3c477fe700 1 --2- 172.21.15.84:0/1266312408 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c480b8660 0x7f3c481e5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:56.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.066+0000 7f3c477fe700 1 -- 172.21.15.84:0/1266312408 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c40009b30 con 0x7f3c480d12c0 2023-07-14T11:13:56.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.066+0000 7f3c46ffd700 1 --2- 172.21.15.84:0/1266312408 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c480b4860 0x7f3c480b3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:13:56.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.066+0000 7f3c477fe700 1 --2- 172.21.15.84:0/1266312408 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c480d12c0 0x7f3c4814b120 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3c480673b0 tx=0x7f3c40004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:56.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.066+0000 7f3c3f7fe700 1 -- 172.21.15.84:0/1266312408 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c40004930 con 0x7f3c480d12c0 2023-07-14T11:13:56.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.067+0000 7f3c3f7fe700 1 -- 172.21.15.84:0/1266312408 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c400092e0 con 0x7f3c480d12c0 2023-07-14T11:13:56.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.067+0000 7f3c3f7fe700 1 -- 172.21.15.84:0/1266312408 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4001b650 con 0x7f3c480d12c0 2023-07-14T11:13:56.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.067+0000 7f3c4d3ff700 1 -- 172.21.15.84:0/1266312408 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c481f6340 con 0x7f3c480d12c0 2023-07-14T11:13:56.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.067+0000 7f3c4d3ff700 1 -- 172.21.15.84:0/1266312408 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c480b43d0 con 0x7f3c480d12c0 2023-07-14T11:13:56.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.068+0000 7f3c4d3ff700 1 -- 172.21.15.84:0/1266312408 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c481f6860 con 0x7f3c480d12c0 2023-07-14T11:13:56.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.069+0000 7f3c3f7fe700 1 -- 172.21.15.84:0/1266312408 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3c4001b7b0 con 0x7f3c480d12c0 2023-07-14T11:13:56.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.069+0000 7f3c3f7fe700 1 --2- 172.21.15.84:0/1266312408 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f3c2806ace0 0x7f3c2806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:56.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.070+0000 7f3c3f7fe700 1 -- 172.21.15.84:0/1266312408 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f3c4008a8c0 con 0x7f3c480d12c0 2023-07-14T11:13:56.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.070+0000 7f3c46ffd700 1 --2- 172.21.15.84:0/1266312408 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f3c2806ace0 0x7f3c2806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:56.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.070+0000 7f3c46ffd700 1 --2- 172.21.15.84:0/1266312408 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f3c2806ace0 0x7f3c2806d190 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3c481f5960 tx=0x7f3c38009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:56.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.074+0000 7f3c3f7fe700 1 -- 172.21.15.84:0/1266312408 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3c481f6860 con 0x7f3c480d12c0 2023-07-14T11:13:56.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.273+0000 7f3c4d3ff700 1 -- 172.21.15.84:0/1266312408 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f3c480b43d0 con 0x7f3c480d12c0 2023-07-14T11:13:56.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.277+0000 7f3c3f7fe700 1 -- 172.21.15.84:0/1266312408 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3c480b43d0 con 0x7f3c480d12c0 2023-07-14T11:13:56.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.280+0000 7f3c4d3ff700 1 -- 172.21.15.84:0/1266312408 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f3c2806ace0 msgr2=0x7f3c2806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:56.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.280+0000 7f3c4d3ff700 1 --2- 172.21.15.84:0/1266312408 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f3c2806ace0 0x7f3c2806d190 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3c481f5960 tx=0x7f3c38009040 comp rx=0 tx=0).stop 2023-07-14T11:13:56.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.280+0000 7f3c4d3ff700 1 -- 172.21.15.84:0/1266312408 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c480d12c0 msgr2=0x7f3c4814b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:56.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.280+0000 7f3c4d3ff700 1 --2- 172.21.15.84:0/1266312408 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c480d12c0 0x7f3c4814b120 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3c480673b0 tx=0x7f3c40004ad0 comp rx=0 tx=0).stop 2023-07-14T11:13:56.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.280+0000 7f3c4d3ff700 1 -- 172.21.15.84:0/1266312408 shutdown_connections 2023-07-14T11:13:56.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.280+0000 7f3c4d3ff700 1 --2- 172.21.15.84:0/1266312408 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f3c2806ace0 0x7f3c2806d190 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:56.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.280+0000 7f3c4d3ff700 1 --2- 172.21.15.84:0/1266312408 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c480b4860 0x7f3c480b3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:56.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.280+0000 7f3c4d3ff700 1 --2- 172.21.15.84:0/1266312408 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c480d12c0 0x7f3c4814b120 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:56.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.280+0000 7f3c4d3ff700 1 --2- 172.21.15.84:0/1266312408 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c480b8660 0x7f3c481e5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:56.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.280+0000 7f3c4d3ff700 1 -- 172.21.15.84:0/1266312408 >> 172.21.15.84:0/1266312408 conn(0x7f3c48066860 msgr2=0x7f3c480d1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:56.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.280+0000 7f3c4d3ff700 1 -- 172.21.15.84:0/1266312408 shutdown_connections 2023-07-14T11:13:56.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.280+0000 7f3c4d3ff700 1 -- 172.21.15.84:0/1266312408 wait complete. 2023-07-14T11:13:56.300 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-14T11:13:56.300 DEBUG:teuthology.orchestra.run.smithi084:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-14T11:13:56.399 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-14T11:13:56.517 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-14T11:13:56.517 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-14T11:13:56.518 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:13:56.564 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-14T11:13:56.564 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:13:56.649 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-14T11:13:56.650 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:13:56.735 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:13:56.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.969+0000 7f4d07dff700 1 Processor -- start 2023-07-14T11:13:56.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.970+0000 7f4d07dff700 1 -- start start 2023-07-14T11:13:56.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.971+0000 7f4d07dff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4d0015c950 0x7f4d000b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:56.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.971+0000 7f4d07dff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d000d2ce0 con 0x7f4d000d1220 2023-07-14T11:13:56.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.971+0000 7f4d07dff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d000b3350 con 0x7f4d000b1e00 2023-07-14T11:13:56.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.971+0000 7f4d07dff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d000b3630 con 0x7f4d0015c950 2023-07-14T11:13:56.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.971+0000 7f4d05b9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4d0015c950 0x7f4d000b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:56.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.971+0000 7f4d0639c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f4d000d1220 0x7f4d000afac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:56666/0 (socket says 172.21.15.84:56666) 2023-07-14T11:13:56.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.971+0000 7f4d0639c700 1 -- 172.21.15.84:0/1533362455 learned_addr learned my addr 172.21.15.84:0/1533362455 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:13:56.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.971+0000 7f4d04b99700 1 -- 172.21.15.84:0/1533362455 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1761618319 0 0) 0x7f4d000d2ce0 con 0x7f4d000d1220 2023-07-14T11:13:56.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.971+0000 7f4d04b99700 1 -- 172.21.15.84:0/1533362455 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4cec0035b0 con 0x7f4d000d1220 2023-07-14T11:13:56.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.971+0000 7f4d05b9b700 1 -- 172.21.15.84:0/1533362455 >> v1:172.21.15.179:6789/0 conn(0x7f4d000b1e00 legacy=0x7f4d000d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:56.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.971+0000 7f4d05b9b700 1 -- 172.21.15.84:0/1533362455 >> v1:172.21.15.84:6789/0 conn(0x7f4d000d1220 legacy=0x7f4d000afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:56.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.971+0000 7f4d05b9b700 1 -- 172.21.15.84:0/1533362455 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d000b3910 con 0x7f4d0015c950 2023-07-14T11:13:56.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.972+0000 7f4d05b9b700 1 --2- 172.21.15.84:0/1533362455 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d0015c950 0x7f4d000b43f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc009820 tx=0x7f4cfc009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d315df4535afe6d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:56.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.972+0000 7f4d04b99700 1 -- 172.21.15.84:0/1533362455 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc005e30 con 0x7f4d0015c950 2023-07-14T11:13:56.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.972+0000 7f4d04b99700 1 -- 172.21.15.84:0/1533362455 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cfc004030 con 0x7f4d0015c950 2023-07-14T11:13:56.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.972+0000 7f4d04b99700 1 -- 172.21.15.84:0/1533362455 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc0043c0 con 0x7f4d0015c950 2023-07-14T11:13:56.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.973+0000 7f4d07dff700 1 -- 172.21.15.84:0/1533362455 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d0015c950 msgr2=0x7f4d000b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:56.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.973+0000 7f4d07dff700 1 --2- 172.21.15.84:0/1533362455 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d0015c950 0x7f4d000b43f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc009820 tx=0x7f4cfc009b30 comp rx=0 tx=0).stop 2023-07-14T11:13:56.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.973+0000 7f4d07dff700 1 -- 172.21.15.84:0/1533362455 shutdown_connections 2023-07-14T11:13:56.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.973+0000 7f4d07dff700 1 --2- 172.21.15.84:0/1533362455 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d0015c950 0x7f4d000b43f0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:56.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.973+0000 7f4d07dff700 1 -- 172.21.15.84:0/1533362455 >> 172.21.15.84:0/1533362455 conn(0x7f4d0009c1d0 msgr2=0x7f4d000d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:56.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.973+0000 7f4d07dff700 1 -- 172.21.15.84:0/1533362455 shutdown_connections 2023-07-14T11:13:56.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.973+0000 7f4d07dff700 1 -- 172.21.15.84:0/1533362455 wait complete. 2023-07-14T11:13:56.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.974+0000 7f4d07dff700 1 Processor -- start 2023-07-14T11:13:56.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.975+0000 7f4d07dff700 1 -- start start 2023-07-14T11:13:56.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.976+0000 7f4d07dff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d000b1e00 0x7f4d00158f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:56.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.976+0000 7f4d07dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d000d1220 0x7f4d00156e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:56.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.976+0000 7f4d07dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d0015c950 0x7f4d000b0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:56.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.976+0000 7f4d07dff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d000c6c10 con 0x7f4d000b1e00 2023-07-14T11:13:56.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.976+0000 7f4d07dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d000c6ef0 con 0x7f4d0015c950 2023-07-14T11:13:56.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.976+0000 7f4d07dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d000c71d0 con 0x7f4d000d1220 2023-07-14T11:13:56.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.976+0000 7f4d05b9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d000b1e00 0x7f4d00158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:56.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.976+0000 7f4d05b9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d000b1e00 0x7f4d00158f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49920/0 (socket says 172.21.15.84:49920) 2023-07-14T11:13:56.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.976+0000 7f4d05b9b700 1 -- 172.21.15.84:0/587482011 learned_addr learned my addr 172.21.15.84:0/587482011 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:56.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.976+0000 7f4d05b9b700 1 -- 172.21.15.84:0/587482011 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d000d1220 msgr2=0x7f4d00156e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:56.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.976+0000 7f4d05b9b700 1 --2- 172.21.15.84:0/587482011 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d000d1220 0x7f4d00156e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:56.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.976+0000 7f4d05b9b700 1 -- 172.21.15.84:0/587482011 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d0015c950 msgr2=0x7f4d000b0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:56.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.976+0000 7f4d05b9b700 1 --2- 172.21.15.84:0/587482011 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d0015c950 0x7f4d000b0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:56.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.976+0000 7f4d05b9b700 1 -- 172.21.15.84:0/587482011 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cfc009430 con 0x7f4d000b1e00 2023-07-14T11:13:56.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.976+0000 7f4d05b9b700 1 --2- 172.21.15.84:0/587482011 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d000b1e00 0x7f4d00158f60 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc000c00 tx=0x7f4cfc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:56.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.977+0000 7f4cf67fc700 1 -- 172.21.15.84:0/587482011 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc01c620 con 0x7f4d000b1e00 2023-07-14T11:13:56.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.977+0000 7f4cf67fc700 1 -- 172.21.15.84:0/587482011 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cfc01c780 con 0x7f4d000b1e00 2023-07-14T11:13:56.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.977+0000 7f4cf67fc700 1 -- 172.21.15.84:0/587482011 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc01cb10 con 0x7f4d000b1e00 2023-07-14T11:13:56.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.977+0000 7f4d07dff700 1 -- 172.21.15.84:0/587482011 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d000c74b0 con 0x7f4d000b1e00 2023-07-14T11:13:56.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.977+0000 7f4d07dff700 1 -- 172.21.15.84:0/587482011 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d001594a0 con 0x7f4d000b1e00 2023-07-14T11:13:56.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.978+0000 7f4d07dff700 1 -- 172.21.15.84:0/587482011 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d000c79d0 con 0x7f4d000b1e00 2023-07-14T11:13:56.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.979+0000 7f4cf67fc700 1 -- 172.21.15.84:0/587482011 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4cfc01cc70 con 0x7f4d000b1e00 2023-07-14T11:13:56.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.980+0000 7f4cf67fc700 1 --2- 172.21.15.84:0/587482011 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f4ce406ace0 0x7f4ce406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:56.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.980+0000 7f4cf67fc700 1 -- 172.21.15.84:0/587482011 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f4cfc08a860 con 0x7f4d000b1e00 2023-07-14T11:13:56.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.980+0000 7f4d0539a700 1 --2- 172.21.15.84:0/587482011 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f4ce406ace0 0x7f4ce406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:56.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.981+0000 7f4d0539a700 1 --2- 172.21.15.84:0/587482011 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f4ce406ace0 0x7f4ce406d190 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4cf0003df0 tx=0x7f4cf0007a40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:56.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:56.984+0000 7f4cf67fc700 1 -- 172.21.15.84:0/587482011 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f4d000c79d0 con 0x7f4d000b1e00 2023-07-14T11:13:57.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.183+0000 7f4d07dff700 1 -- 172.21.15.84:0/587482011 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4d000c79d0 con 0x7f4d000b1e00 2023-07-14T11:13:57.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.184+0000 7f4cf67fc700 1 -- 172.21.15.84:0/587482011 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18351 (secure 0 0 0) 0x7f4d000c79d0 con 0x7f4d000b1e00 2023-07-14T11:13:57.187 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:13:57.187 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":25,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:13:55.825723+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-14T11:13:12.727811+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-14T11:13:13.436391+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.17","mappings":[{"from":3,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:13:57.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.186+0000 7f4d07dff700 1 -- 172.21.15.84:0/587482011 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f4ce406ace0 msgr2=0x7f4ce406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:57.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.186+0000 7f4d07dff700 1 --2- 172.21.15.84:0/587482011 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f4ce406ace0 0x7f4ce406d190 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4cf0003df0 tx=0x7f4cf0007a40 comp rx=0 tx=0).stop 2023-07-14T11:13:57.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.186+0000 7f4d07dff700 1 -- 172.21.15.84:0/587482011 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d000b1e00 msgr2=0x7f4d00158f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:57.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.186+0000 7f4d07dff700 1 --2- 172.21.15.84:0/587482011 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d000b1e00 0x7f4d00158f60 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc000c00 tx=0x7f4cfc004750 comp rx=0 tx=0).stop 2023-07-14T11:13:57.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.186+0000 7f4d07dff700 1 -- 172.21.15.84:0/587482011 shutdown_connections 2023-07-14T11:13:57.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.186+0000 7f4d07dff700 1 --2- 172.21.15.84:0/587482011 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d0015c950 0x7f4d000b0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:57.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.186+0000 7f4d07dff700 1 --2- 172.21.15.84:0/587482011 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d000b1e00 0x7f4d00158f60 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:57.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.186+0000 7f4d07dff700 1 --2- 172.21.15.84:0/587482011 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f4ce406ace0 0x7f4ce406d190 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:57.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.186+0000 7f4d07dff700 1 --2- 172.21.15.84:0/587482011 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d000d1220 0x7f4d00156e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:57.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.187+0000 7f4d07dff700 1 -- 172.21.15.84:0/587482011 >> 172.21.15.84:0/587482011 conn(0x7f4d0009c1d0 msgr2=0x7f4d000b1580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:57.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.187+0000 7f4d07dff700 1 -- 172.21.15.84:0/587482011 shutdown_connections 2023-07-14T11:13:57.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.187+0000 7f4d07dff700 1 -- 172.21.15.84:0/587482011 wait complete. 2023-07-14T11:13:57.206 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T11:13:00.125395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T11:13:06.803994+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T11:13:12.727811+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T11:13:13.436391+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T11:13:57.207 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T11:13:57.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.402+0000 7f18b5bff700 1 Processor -- start 2023-07-14T11:13:57.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.403+0000 7f18b5bff700 1 -- start start 2023-07-14T11:13:57.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.404+0000 7f18b5bff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f18b00b8a60 0x7f18b00b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:57.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.404+0000 7f18b5bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18b00b4530 0x7f18b00d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:57.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.404+0000 7f18b5bff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18b00b8e30 con 0x7f18b00d1050 2023-07-14T11:13:57.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.404+0000 7f18b5bff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18b00d14d0 con 0x7f18b00b8a60 2023-07-14T11:13:57.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.404+0000 7f18b5bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18b00b1e30 con 0x7f18b00b4530 2023-07-14T11:13:57.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.404+0000 7f18affff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f18b00d1050 0x7f18b00b25d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:56680/0 (socket says 172.21.15.84:56680) 2023-07-14T11:13:57.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.404+0000 7f18affff700 1 -- 172.21.15.84:0/2281029984 learned_addr learned my addr 172.21.15.84:0/2281029984 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:13:57.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.404+0000 7f18af7fe700 1 --2- 172.21.15.84:0/2281029984 >> v2:172.21.15.179:3300/0 conn(0x7f18b00b8a60 0x7f18b00b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:57.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.404+0000 7f18a7fff700 1 --2- 172.21.15.84:0/2281029984 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18b00b4530 0x7f18b00d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:57.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.404+0000 7f18aeffd700 1 -- 172.21.15.84:0/2281029984 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1390279681 0 0) 0x7f18b00b8e30 con 0x7f18b00d1050 2023-07-14T11:13:57.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.404+0000 7f18aeffd700 1 -- 172.21.15.84:0/2281029984 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f189c0035b0 con 0x7f18b00d1050 2023-07-14T11:13:57.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.405+0000 7f18af7fe700 1 -- 172.21.15.84:0/2281029984 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18b00b4530 msgr2=0x7f18b00d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:57.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.405+0000 7f18af7fe700 1 --2- 172.21.15.84:0/2281029984 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18b00b4530 0x7f18b00d0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:57.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.405+0000 7f18af7fe700 1 -- 172.21.15.84:0/2281029984 >> v1:172.21.15.84:6789/0 conn(0x7f18b00d1050 legacy=0x7f18b00b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:57.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.405+0000 7f18af7fe700 1 -- 172.21.15.84:0/2281029984 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18b00afaa0 con 0x7f18b00b8a60 2023-07-14T11:13:57.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.405+0000 7f18a7fff700 1 --2- 172.21.15.84:0/2281029984 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18b00b4530 0x7f18b00d0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:13:57.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.405+0000 7f18af7fe700 1 --2- 172.21.15.84:0/2281029984 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18b00b8a60 0x7f18b00b3ff0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f18a0009840 tx=0x7f18a0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b777d2b459780f0f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:57.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.405+0000 7f18aeffd700 1 -- 172.21.15.84:0/2281029984 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a0011830 con 0x7f18b00b8a60 2023-07-14T11:13:57.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.405+0000 7f18aeffd700 1 -- 172.21.15.84:0/2281029984 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18a0011990 con 0x7f18b00b8a60 2023-07-14T11:13:57.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.405+0000 7f18aeffd700 1 -- 172.21.15.84:0/2281029984 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a0011d20 con 0x7f18b00b8a60 2023-07-14T11:13:57.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.406+0000 7f18b5bff700 1 -- 172.21.15.84:0/2281029984 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18b00b8a60 msgr2=0x7f18b00b3ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:57.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.406+0000 7f18b5bff700 1 --2- 172.21.15.84:0/2281029984 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18b00b8a60 0x7f18b00b3ff0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f18a0009840 tx=0x7f18a0009b50 comp rx=0 tx=0).stop 2023-07-14T11:13:57.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.406+0000 7f18b5bff700 1 -- 172.21.15.84:0/2281029984 shutdown_connections 2023-07-14T11:13:57.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.406+0000 7f18b5bff700 1 --2- 172.21.15.84:0/2281029984 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18b00b8a60 0x7f18b00b3ff0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:57.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.406+0000 7f18b5bff700 1 --2- 172.21.15.84:0/2281029984 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18b00b4530 0x7f18b00d0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:57.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.406+0000 7f18b5bff700 1 -- 172.21.15.84:0/2281029984 >> 172.21.15.84:0/2281029984 conn(0x7f18b009c1b0 msgr2=0x7f18b00d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:57.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.406+0000 7f18b5bff700 1 -- 172.21.15.84:0/2281029984 shutdown_connections 2023-07-14T11:13:57.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.406+0000 7f18b5bff700 1 -- 172.21.15.84:0/2281029984 wait complete. 2023-07-14T11:13:57.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.408+0000 7f18b5bff700 1 Processor -- start 2023-07-14T11:13:57.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.408+0000 7f18b5bff700 1 -- start start 2023-07-14T11:13:57.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.409+0000 7f18b5bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18b00b4530 0x7f18b0143e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:57.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.409+0000 7f18b5bff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18b00b8a60 0x7f18b00ca280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:57.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.409+0000 7f18b5bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18b00d1050 0x7f18b00cc990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:57.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.409+0000 7f18b5bff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b01e5120 con 0x7f18b00b8a60 2023-07-14T11:13:57.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.409+0000 7f18b5bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b01e5400 con 0x7f18b00d1050 2023-07-14T11:13:57.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.409+0000 7f18b5bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18b01e56e0 con 0x7f18b00b4530 2023-07-14T11:13:57.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.409+0000 7f18a7fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18b00b8a60 0x7f18b00ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:57.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.409+0000 7f18a7fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18b00b8a60 0x7f18b00ca280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49924/0 (socket says 172.21.15.84:49924) 2023-07-14T11:13:57.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.409+0000 7f18a7fff700 1 -- 172.21.15.84:0/1567739352 learned_addr learned my addr 172.21.15.84:0/1567739352 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:57.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.409+0000 7f18affff700 1 --2- 172.21.15.84:0/1567739352 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18b00d1050 0x7f18b00cc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:57.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.409+0000 7f18af7fe700 1 --2- 172.21.15.84:0/1567739352 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18b00b4530 0x7f18b0143e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:57.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.409+0000 7f18a7fff700 1 -- 172.21.15.84:0/1567739352 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18b00b4530 msgr2=0x7f18b0143e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:57.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.409+0000 7f18a7fff700 1 --2- 172.21.15.84:0/1567739352 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18b00b4530 0x7f18b0143e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:57.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.409+0000 7f18a7fff700 1 -- 172.21.15.84:0/1567739352 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18b00d1050 msgr2=0x7f18b00cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:57.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.409+0000 7f18a7fff700 1 --2- 172.21.15.84:0/1567739352 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18b00d1050 0x7f18b00cc990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:57.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.409+0000 7f18a7fff700 1 -- 172.21.15.84:0/1567739352 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18980094a0 con 0x7f18b00b8a60 2023-07-14T11:13:57.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.410+0000 7f18a7fff700 1 --2- 172.21.15.84:0/1567739352 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18b00b8a60 0x7f18b00ca280 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f189800ebe0 tx=0x7f189800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:57.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.410+0000 7f18acff9700 1 -- 172.21.15.84:0/1567739352 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189800c850 con 0x7f18b00b8a60 2023-07-14T11:13:57.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.410+0000 7f18acff9700 1 -- 172.21.15.84:0/1567739352 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f189800c9b0 con 0x7f18b00b8a60 2023-07-14T11:13:57.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.410+0000 7f18b5bff700 1 -- 172.21.15.84:0/1567739352 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18a00094a0 con 0x7f18b00b8a60 2023-07-14T11:13:57.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.410+0000 7f18acff9700 1 -- 172.21.15.84:0/1567739352 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189800cd40 con 0x7f18b00b8a60 2023-07-14T11:13:57.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.410+0000 7f18b5bff700 1 -- 172.21.15.84:0/1567739352 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18b01e5ca0 con 0x7f18b00b8a60 2023-07-14T11:13:57.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.411+0000 7f18b5bff700 1 -- 172.21.15.84:0/1567739352 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18b01e6010 con 0x7f18b00b8a60 2023-07-14T11:13:57.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.412+0000 7f18acff9700 1 -- 172.21.15.84:0/1567739352 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1898013470 con 0x7f18b00b8a60 2023-07-14T11:13:57.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.413+0000 7f18acff9700 1 --2- 172.21.15.84:0/1567739352 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f189006ace0 0x7f189006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:57.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.413+0000 7f18acff9700 1 -- 172.21.15.84:0/1567739352 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f1898089550 con 0x7f18b00b8a60 2023-07-14T11:13:57.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.413+0000 7f18af7fe700 1 --2- 172.21.15.84:0/1567739352 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f189006ace0 0x7f189006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:57.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.414+0000 7f18af7fe700 1 --2- 172.21.15.84:0/1567739352 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f189006ace0 0x7f189006d190 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f18a0000c00 tx=0x7f18a0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:57.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.417+0000 7f18acff9700 1 -- 172.21.15.84:0/1567739352 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f18980545c0 con 0x7f18b00b8a60 2023-07-14T11:13:57.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.610+0000 7f18b5bff700 1 -- 172.21.15.84:0/1567739352 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f18b0074350 con 0x7f18b00b8a60 2023-07-14T11:13:57.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.610+0000 7f18acff9700 1 -- 172.21.15.84:0/1567739352 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f189800cea0 con 0x7f18b00b8a60 2023-07-14T11:13:57.612 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-07-14T11:13:57.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.612+0000 7f18b5bff700 1 -- 172.21.15.84:0/1567739352 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f189006ace0 msgr2=0x7f189006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:57.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.612+0000 7f18b5bff700 1 --2- 172.21.15.84:0/1567739352 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f189006ace0 0x7f189006d190 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f18a0000c00 tx=0x7f18a0008030 comp rx=0 tx=0).stop 2023-07-14T11:13:57.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.612+0000 7f18b5bff700 1 -- 172.21.15.84:0/1567739352 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18b00b8a60 msgr2=0x7f18b00ca280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:57.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.612+0000 7f18b5bff700 1 --2- 172.21.15.84:0/1567739352 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18b00b8a60 0x7f18b00ca280 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f189800ebe0 tx=0x7f189800eef0 comp rx=0 tx=0).stop 2023-07-14T11:13:57.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.612+0000 7f18b5bff700 1 -- 172.21.15.84:0/1567739352 shutdown_connections 2023-07-14T11:13:57.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.612+0000 7f18b5bff700 1 --2- 172.21.15.84:0/1567739352 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f189006ace0 0x7f189006d190 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:57.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.612+0000 7f18b5bff700 1 --2- 172.21.15.84:0/1567739352 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18b00b4530 0x7f18b0143e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:57.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.612+0000 7f18b5bff700 1 --2- 172.21.15.84:0/1567739352 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18b00d1050 0x7f18b00cc990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:57.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.612+0000 7f18b5bff700 1 --2- 172.21.15.84:0/1567739352 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18b00b8a60 0x7f18b00ca280 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:57.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.612+0000 7f18b5bff700 1 -- 172.21.15.84:0/1567739352 >> 172.21.15.84:0/1567739352 conn(0x7f18b009c1b0 msgr2=0x7f18b006b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:57.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.612+0000 7f18b5bff700 1 -- 172.21.15.84:0/1567739352 shutdown_connections 2023-07-14T11:13:57.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.612+0000 7f18b5bff700 1 -- 172.21.15.84:0/1567739352 wait complete. 2023-07-14T11:13:57.632 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T11:13:57.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.829+0000 7fa877dff700 1 Processor -- start 2023-07-14T11:13:57.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.829+0000 7fa877dff700 1 -- start start 2023-07-14T11:13:57.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.830+0000 7fa877dff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa8700cbe40 0x7fa870158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:57.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.830+0000 7fa877dff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa8700cd0a0 0x7fa8700cb540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:57.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.830+0000 7fa877dff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8701590f0 con 0x7fa8700cda40 2023-07-14T11:13:57.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.830+0000 7fa877dff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa87006b5b0 con 0x7fa8700cbe40 2023-07-14T11:13:57.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.830+0000 7fa877dff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa870071500 con 0x7fa8700cd0a0 2023-07-14T11:13:57.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.830+0000 7fa875b9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa8700cbe40 0x7fa870158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:57.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.830+0000 7fa875b9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa8700cbe40 0x7fa870158bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49936/0 (socket says 172.21.15.84:49936) 2023-07-14T11:13:57.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.830+0000 7fa875b9b700 1 -- 172.21.15.84:0/2295281381 learned_addr learned my addr 172.21.15.84:0/2295281381 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:57.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.830+0000 7fa87539a700 1 --2- 172.21.15.84:0/2295281381 >> v2:172.21.15.179:3300/0 conn(0x7fa8700cd0a0 0x7fa8700cb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:57.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.831+0000 7fa875b9b700 1 -- 172.21.15.84:0/2295281381 >> v2:172.21.15.179:3300/0 conn(0x7fa8700cd0a0 msgr2=0x7fa8700cb540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:57.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.831+0000 7fa875b9b700 1 --2- 172.21.15.84:0/2295281381 >> v2:172.21.15.179:3300/0 conn(0x7fa8700cd0a0 0x7fa8700cb540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:57.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.831+0000 7fa875b9b700 1 -- 172.21.15.84:0/2295281381 >> v1:172.21.15.179:6789/0 conn(0x7fa8700cda40 legacy=0x7fa8700cde40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:57.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.831+0000 7fa875b9b700 1 -- 172.21.15.84:0/2295281381 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8700ce8c0 con 0x7fa8700cbe40 2023-07-14T11:13:57.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.831+0000 7fa875b9b700 1 --2- 172.21.15.84:0/2295281381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8700cbe40 0x7fa870158bb0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa870072040 tx=0x7fa86c00be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dffb9701fd0322d1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:57.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.831+0000 7fa874b99700 1 -- 172.21.15.84:0/2295281381 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa86c00dc70 con 0x7fa8700cbe40 2023-07-14T11:13:57.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.831+0000 7fa874b99700 1 -- 172.21.15.84:0/2295281381 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa86c00ddd0 con 0x7fa8700cbe40 2023-07-14T11:13:57.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.831+0000 7fa874b99700 1 -- 172.21.15.84:0/2295281381 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa86c010690 con 0x7fa8700cbe40 2023-07-14T11:13:57.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.832+0000 7fa877dff700 1 -- 172.21.15.84:0/2295281381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8700cbe40 msgr2=0x7fa870158bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:57.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.832+0000 7fa877dff700 1 --2- 172.21.15.84:0/2295281381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8700cbe40 0x7fa870158bb0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa870072040 tx=0x7fa86c00be70 comp rx=0 tx=0).stop 2023-07-14T11:13:57.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.832+0000 7fa877dff700 1 -- 172.21.15.84:0/2295281381 shutdown_connections 2023-07-14T11:13:57.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.832+0000 7fa877dff700 1 --2- 172.21.15.84:0/2295281381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8700cbe40 0x7fa870158bb0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:57.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.832+0000 7fa877dff700 1 --2- 172.21.15.84:0/2295281381 >> v2:172.21.15.179:3300/0 conn(0x7fa8700cd0a0 0x7fa8700cb540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:57.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.832+0000 7fa877dff700 1 -- 172.21.15.84:0/2295281381 >> 172.21.15.84:0/2295281381 conn(0x7fa8700b05d0 msgr2=0x7fa8700b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:57.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.832+0000 7fa877dff700 1 -- 172.21.15.84:0/2295281381 shutdown_connections 2023-07-14T11:13:57.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.832+0000 7fa877dff700 1 -- 172.21.15.84:0/2295281381 wait complete. 2023-07-14T11:13:57.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.834+0000 7fa877dff700 1 Processor -- start 2023-07-14T11:13:57.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.834+0000 7fa877dff700 1 -- start start 2023-07-14T11:13:57.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.835+0000 7fa877dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8700cbe40 0x7fa8701550c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:57.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.835+0000 7fa877dff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8700cd0a0 0x7fa8700b09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:57.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.835+0000 7fa877dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8700cda40 0x7fa8700b0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:57.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.835+0000 7fa877dff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8701f2000 con 0x7fa8700cd0a0 2023-07-14T11:13:57.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.835+0000 7fa877dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8701f2fa0 con 0x7fa8700cda40 2023-07-14T11:13:57.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.835+0000 7fa877dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8700c5b90 con 0x7fa8700cbe40 2023-07-14T11:13:57.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.835+0000 7fa87539a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8700cd0a0 0x7fa8700b09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:57.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.835+0000 7fa87539a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8700cd0a0 0x7fa8700b09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49948/0 (socket says 172.21.15.84:49948) 2023-07-14T11:13:57.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.835+0000 7fa87539a700 1 -- 172.21.15.84:0/278160482 learned_addr learned my addr 172.21.15.84:0/278160482 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:57.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.835+0000 7fa875b9b700 1 --2- 172.21.15.84:0/278160482 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8700cbe40 0x7fa8701550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:57.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.835+0000 7fa87639c700 1 --2- 172.21.15.84:0/278160482 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8700cda40 0x7fa8700b0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:57.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.835+0000 7fa87539a700 1 -- 172.21.15.84:0/278160482 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8700cbe40 msgr2=0x7fa8701550c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:57.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.835+0000 7fa87539a700 1 --2- 172.21.15.84:0/278160482 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8700cbe40 0x7fa8701550c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:57.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.835+0000 7fa87539a700 1 -- 172.21.15.84:0/278160482 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8700cda40 msgr2=0x7fa8700b0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:57.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.835+0000 7fa87539a700 1 --2- 172.21.15.84:0/278160482 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8700cda40 0x7fa8700b0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:57.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.835+0000 7fa87539a700 1 -- 172.21.15.84:0/278160482 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa86c00b7f0 con 0x7fa8700cd0a0 2023-07-14T11:13:57.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.836+0000 7fa87539a700 1 --2- 172.21.15.84:0/278160482 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8700cd0a0 0x7fa8700b09a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa86000e9e0 tx=0x7fa86000ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:57.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.836+0000 7fa8667fc700 1 -- 172.21.15.84:0/278160482 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa860009710 con 0x7fa8700cd0a0 2023-07-14T11:13:57.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.836+0000 7fa8667fc700 1 -- 172.21.15.84:0/278160482 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa86000c850 con 0x7fa8700cd0a0 2023-07-14T11:13:57.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.836+0000 7fa8667fc700 1 -- 172.21.15.84:0/278160482 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa86000cbc0 con 0x7fa8700cd0a0 2023-07-14T11:13:57.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.836+0000 7fa877dff700 1 -- 172.21.15.84:0/278160482 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8700c83c0 con 0x7fa8700cd0a0 2023-07-14T11:13:57.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.836+0000 7fa877dff700 1 -- 172.21.15.84:0/278160482 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8701f24c0 con 0x7fa8700cd0a0 2023-07-14T11:13:57.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.837+0000 7fa877dff700 1 -- 172.21.15.84:0/278160482 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa870074350 con 0x7fa8700cd0a0 2023-07-14T11:13:57.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.838+0000 7fa8667fc700 1 -- 172.21.15.84:0/278160482 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa86000cd20 con 0x7fa8700cd0a0 2023-07-14T11:13:57.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.839+0000 7fa8667fc700 1 --2- 172.21.15.84:0/278160482 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa85406ace0 0x7fa85406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:57.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.839+0000 7fa8667fc700 1 -- 172.21.15.84:0/278160482 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fa8600895b0 con 0x7fa8700cd0a0 2023-07-14T11:13:57.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.839+0000 7fa875b9b700 1 --2- 172.21.15.84:0/278160482 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa85406ace0 0x7fa85406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:57.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.839+0000 7fa875b9b700 1 --2- 172.21.15.84:0/278160482 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa85406ace0 0x7fa85406d190 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa86c00beb0 tx=0x7fa86c01c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:57.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:57.843+0000 7fa8667fc700 1 -- 172.21.15.84:0/278160482 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fa860054620 con 0x7fa8700cd0a0 2023-07-14T11:13:58.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.037+0000 7fa877dff700 1 -- 172.21.15.84:0/278160482 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa8700b4a40 con 0x7fa8700cd0a0 2023-07-14T11:13:58.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.038+0000 7fa8667fc700 1 -- 172.21.15.84:0/278160482 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa860057c40 con 0x7fa8700cd0a0 2023-07-14T11:13:58.040 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-07-14T11:13:58.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.040+0000 7fa877dff700 1 -- 172.21.15.84:0/278160482 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa85406ace0 msgr2=0x7fa85406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:58.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.040+0000 7fa877dff700 1 --2- 172.21.15.84:0/278160482 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa85406ace0 0x7fa85406d190 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa86c00beb0 tx=0x7fa86c01c040 comp rx=0 tx=0).stop 2023-07-14T11:13:58.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.040+0000 7fa877dff700 1 -- 172.21.15.84:0/278160482 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8700cd0a0 msgr2=0x7fa8700b09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:58.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.040+0000 7fa877dff700 1 --2- 172.21.15.84:0/278160482 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8700cd0a0 0x7fa8700b09a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa86000e9e0 tx=0x7fa86000ecf0 comp rx=0 tx=0).stop 2023-07-14T11:13:58.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.040+0000 7fa877dff700 1 -- 172.21.15.84:0/278160482 shutdown_connections 2023-07-14T11:13:58.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.040+0000 7fa877dff700 1 --2- 172.21.15.84:0/278160482 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa85406ace0 0x7fa85406d190 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:58.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.040+0000 7fa877dff700 1 --2- 172.21.15.84:0/278160482 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8700cbe40 0x7fa8701550c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:58.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.040+0000 7fa877dff700 1 --2- 172.21.15.84:0/278160482 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8700cda40 0x7fa8700b0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:58.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.040+0000 7fa877dff700 1 --2- 172.21.15.84:0/278160482 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8700cd0a0 0x7fa8700b09a0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:58.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.040+0000 7fa877dff700 1 -- 172.21.15.84:0/278160482 >> 172.21.15.84:0/278160482 conn(0x7fa8700b05d0 msgr2=0x7fa87006c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:58.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.040+0000 7fa877dff700 1 -- 172.21.15.84:0/278160482 shutdown_connections 2023-07-14T11:13:58.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.040+0000 7fa877dff700 1 -- 172.21.15.84:0/278160482 wait complete. 2023-07-14T11:13:58.060 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T11:13:58.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.257+0000 7f2c0c5ff700 1 Processor -- start 2023-07-14T11:13:58.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.257+0000 7f2c0c5ff700 1 -- start start 2023-07-14T11:13:58.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.258+0000 7f2c0c5ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2c040b8660 0x7f2c040cd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:58.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.258+0000 7f2c0c5ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2c040cd970 0x7f2c040b4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:58.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.258+0000 7f2c0c5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2c040b4da0 0x7f2c041601f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:58.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.258+0000 7f2c0c5ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c040d02a0 con 0x7f2c040cd970 2023-07-14T11:13:58.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.258+0000 7f2c0c5ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c040b51b0 con 0x7f2c040b8660 2023-07-14T11:13:58.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.259+0000 7f2c0c5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c040cfce0 con 0x7f2c040b4da0 2023-07-14T11:13:58.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.259+0000 7f2c09b9a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2c040cd970 0x7f2c040b4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:58.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.259+0000 7f2c09b9a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2c040cd970 0x7f2c040b4860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49952/0 (socket says 172.21.15.84:49952) 2023-07-14T11:13:58.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.259+0000 7f2c09b9a700 1 -- 172.21.15.84:0/2811233089 learned_addr learned my addr 172.21.15.84:0/2811233089 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:58.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.259+0000 7f2c0a39b700 1 --2- 172.21.15.84:0/2811233089 >> v2:172.21.15.179:3300/0 conn(0x7f2c040b8660 0x7f2c040cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:58.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.259+0000 7f2c0ab9c700 1 --2- 172.21.15.84:0/2811233089 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2c040b4da0 0x7f2c041601f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:58.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.259+0000 7f2c09b9a700 1 -- 172.21.15.84:0/2811233089 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2c040b4da0 msgr2=0x7f2c041601f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:58.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.259+0000 7f2c09b9a700 1 --2- 172.21.15.84:0/2811233089 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2c040b4da0 0x7f2c041601f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:58.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.259+0000 7f2c09b9a700 1 -- 172.21.15.84:0/2811233089 >> v2:172.21.15.179:3300/0 conn(0x7f2c040b8660 msgr2=0x7f2c040cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:58.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.259+0000 7f2c09b9a700 1 --2- 172.21.15.84:0/2811233089 >> v2:172.21.15.179:3300/0 conn(0x7f2c040b8660 0x7f2c040cd430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:58.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.259+0000 7f2c09b9a700 1 -- 172.21.15.84:0/2811233089 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c040cffc0 con 0x7f2c040cd970 2023-07-14T11:13:58.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.259+0000 7f2c0a39b700 1 --2- 172.21.15.84:0/2811233089 >> v2:172.21.15.179:3300/0 conn(0x7f2c040b8660 0x7f2c040cd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:13:58.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.259+0000 7f2c09b9a700 1 --2- 172.21.15.84:0/2811233089 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c040cd970 0x7f2c040b4860 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2c040c9e60 tx=0x7f2bf4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4ea5efb3a5df48f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:58.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.260+0000 7f2c09399700 1 -- 172.21.15.84:0/2811233089 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf400b870 con 0x7f2c040cd970 2023-07-14T11:13:58.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.260+0000 7f2c09399700 1 -- 172.21.15.84:0/2811233089 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bf400b9d0 con 0x7f2c040cd970 2023-07-14T11:13:58.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.260+0000 7f2c09399700 1 -- 172.21.15.84:0/2811233089 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf400bd60 con 0x7f2c040cd970 2023-07-14T11:13:58.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.260+0000 7f2c0c5ff700 1 -- 172.21.15.84:0/2811233089 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c040cd970 msgr2=0x7f2c040b4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:58.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.260+0000 7f2c0c5ff700 1 --2- 172.21.15.84:0/2811233089 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c040cd970 0x7f2c040b4860 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2c040c9e60 tx=0x7f2bf4009bd0 comp rx=0 tx=0).stop 2023-07-14T11:13:58.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.260+0000 7f2c0c5ff700 1 -- 172.21.15.84:0/2811233089 shutdown_connections 2023-07-14T11:13:58.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.260+0000 7f2c0c5ff700 1 --2- 172.21.15.84:0/2811233089 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2c040b4da0 0x7f2c041601f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:58.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.260+0000 7f2c0c5ff700 1 --2- 172.21.15.84:0/2811233089 >> v2:172.21.15.179:3300/0 conn(0x7f2c040b8660 0x7f2c040cd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:58.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.260+0000 7f2c0c5ff700 1 --2- 172.21.15.84:0/2811233089 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c040cd970 0x7f2c040b4860 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:58.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.260+0000 7f2c0c5ff700 1 -- 172.21.15.84:0/2811233089 >> 172.21.15.84:0/2811233089 conn(0x7f2c04066860 msgr2=0x7f2c0406a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:58.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.260+0000 7f2c0c5ff700 1 -- 172.21.15.84:0/2811233089 shutdown_connections 2023-07-14T11:13:58.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.260+0000 7f2c0c5ff700 1 -- 172.21.15.84:0/2811233089 wait complete. 2023-07-14T11:13:58.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.262+0000 7f2c0c5ff700 1 Processor -- start 2023-07-14T11:13:58.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.262+0000 7f2c0c5ff700 1 -- start start 2023-07-14T11:13:58.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.263+0000 7f2c0c5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2c040b4da0 0x7f2c040cb910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:58.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.263+0000 7f2c0c5ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2c040b8660 0x7f2c0415a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:58.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.263+0000 7f2c0c5ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c040cd970 0x7f2c040c9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:58.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.263+0000 7f2c0c5ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c040c6a30 con 0x7f2c040cd970 2023-07-14T11:13:58.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.263+0000 7f2c0c5ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c0415ac50 con 0x7f2c040b8660 2023-07-14T11:13:58.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.263+0000 7f2c0c5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c040cbef0 con 0x7f2c040b4da0 2023-07-14T11:13:58.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.263+0000 7f2c0ab9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c040cd970 0x7f2c040c9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:58.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.263+0000 7f2c0ab9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c040cd970 0x7f2c040c9290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49962/0 (socket says 172.21.15.84:49962) 2023-07-14T11:13:58.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.263+0000 7f2c0ab9c700 1 -- 172.21.15.84:0/3677281330 learned_addr learned my addr 172.21.15.84:0/3677281330 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:58.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.264+0000 7f2c0a39b700 1 --2- 172.21.15.84:0/3677281330 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2c040b4da0 0x7f2c040cb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:58.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.264+0000 7f2c09b9a700 1 --2- 172.21.15.84:0/3677281330 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2c040b8660 0x7f2c0415a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:58.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.264+0000 7f2c0ab9c700 1 -- 172.21.15.84:0/3677281330 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2c040b4da0 msgr2=0x7f2c040cb910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:58.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.264+0000 7f2c0ab9c700 1 --2- 172.21.15.84:0/3677281330 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2c040b4da0 0x7f2c040cb910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:58.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.264+0000 7f2c0ab9c700 1 -- 172.21.15.84:0/3677281330 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2c040b8660 msgr2=0x7f2c0415a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:58.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.264+0000 7f2c0ab9c700 1 --2- 172.21.15.84:0/3677281330 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2c040b8660 0x7f2c0415a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:58.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.264+0000 7f2c0ab9c700 1 -- 172.21.15.84:0/3677281330 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bf4009550 con 0x7f2c040cd970 2023-07-14T11:13:58.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.264+0000 7f2c0ab9c700 1 --2- 172.21.15.84:0/3677281330 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c040cd970 0x7f2c040c9290 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc007e60 tx=0x7f2bfc00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:58.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.264+0000 7f2bfaffd700 1 -- 172.21.15.84:0/3677281330 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bfc00ed30 con 0x7f2c040cd970 2023-07-14T11:13:58.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.264+0000 7f2bfaffd700 1 -- 172.21.15.84:0/3677281330 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bfc014420 con 0x7f2c040cd970 2023-07-14T11:13:58.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.264+0000 7f2bfaffd700 1 -- 172.21.15.84:0/3677281330 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bfc0147d0 con 0x7f2c040cd970 2023-07-14T11:13:58.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.264+0000 7f2c0c5ff700 1 -- 172.21.15.84:0/3677281330 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c040cc1d0 con 0x7f2c040cd970 2023-07-14T11:13:58.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.265+0000 7f2c0c5ff700 1 -- 172.21.15.84:0/3677281330 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c040cc790 con 0x7f2c040cd970 2023-07-14T11:13:58.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.266+0000 7f2c0c5ff700 1 -- 172.21.15.84:0/3677281330 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c0406a330 con 0x7f2c040cd970 2023-07-14T11:13:58.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.266+0000 7f2bfaffd700 1 -- 172.21.15.84:0/3677281330 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2bfc014930 con 0x7f2c040cd970 2023-07-14T11:13:58.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.267+0000 7f2bfaffd700 1 --2- 172.21.15.84:0/3677281330 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f2be806ace0 0x7f2be806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:58.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.267+0000 7f2bfaffd700 1 -- 172.21.15.84:0/3677281330 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f2bfc089be0 con 0x7f2c040cd970 2023-07-14T11:13:58.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.268+0000 7f2c0a39b700 1 --2- 172.21.15.84:0/3677281330 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f2be806ace0 0x7f2be806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:58.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.268+0000 7f2c0a39b700 1 --2- 172.21.15.84:0/3677281330 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f2be806ace0 0x7f2be806d190 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2c040ccce0 tx=0x7f2c00008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:58.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.272+0000 7f2bfaffd700 1 -- 172.21.15.84:0/3677281330 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f2bfc054be0 con 0x7f2c040cd970 2023-07-14T11:13:58.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.463+0000 7f2c0c5ff700 1 -- 172.21.15.84:0/3677281330 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2c04074350 con 0x7f2c040cd970 2023-07-14T11:13:58.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.464+0000 7f2bfaffd700 1 -- 172.21.15.84:0/3677281330 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2bfc058200 con 0x7f2c040cd970 2023-07-14T11:13:58.466 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-07-14T11:13:58.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.466+0000 7f2c0c5ff700 1 -- 172.21.15.84:0/3677281330 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f2be806ace0 msgr2=0x7f2be806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:58.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.466+0000 7f2c0c5ff700 1 --2- 172.21.15.84:0/3677281330 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f2be806ace0 0x7f2be806d190 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2c040ccce0 tx=0x7f2c00008040 comp rx=0 tx=0).stop 2023-07-14T11:13:58.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.466+0000 7f2c0c5ff700 1 -- 172.21.15.84:0/3677281330 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c040cd970 msgr2=0x7f2c040c9290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:58.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.466+0000 7f2c0c5ff700 1 --2- 172.21.15.84:0/3677281330 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c040cd970 0x7f2c040c9290 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc007e60 tx=0x7f2bfc00e3c0 comp rx=0 tx=0).stop 2023-07-14T11:13:58.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.466+0000 7f2c0c5ff700 1 -- 172.21.15.84:0/3677281330 shutdown_connections 2023-07-14T11:13:58.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.466+0000 7f2c0c5ff700 1 --2- 172.21.15.84:0/3677281330 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f2be806ace0 0x7f2be806d190 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:58.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.466+0000 7f2c0c5ff700 1 --2- 172.21.15.84:0/3677281330 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2c040b4da0 0x7f2c040cb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:58.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.466+0000 7f2c0c5ff700 1 --2- 172.21.15.84:0/3677281330 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c040cd970 0x7f2c040c9290 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:58.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.466+0000 7f2c0c5ff700 1 --2- 172.21.15.84:0/3677281330 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2c040b8660 0x7f2c0415a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:58.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.466+0000 7f2c0c5ff700 1 -- 172.21.15.84:0/3677281330 >> 172.21.15.84:0/3677281330 conn(0x7f2c04066860 msgr2=0x7f2c040d2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:58.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.467+0000 7f2c0c5ff700 1 -- 172.21.15.84:0/3677281330 shutdown_connections 2023-07-14T11:13:58.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.467+0000 7f2c0c5ff700 1 -- 172.21.15.84:0/3677281330 wait complete. 2023-07-14T11:13:58.486 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T11:13:58.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.683+0000 7f89a5bff700 1 Processor -- start 2023-07-14T11:13:58.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.684+0000 7f89a5bff700 1 -- start start 2023-07-14T11:13:58.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.685+0000 7f89a5bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89a00b4860 0x7f89a00b4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:58.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.685+0000 7f89a5bff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89a00d02a0 con 0x7f89a00b8660 2023-07-14T11:13:58.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.685+0000 7f89a5bff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89a00cfce0 con 0x7f89a00d12c0 2023-07-14T11:13:58.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.685+0000 7f89a5bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89a00b5210 con 0x7f89a00b4860 2023-07-14T11:13:58.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.685+0000 7f899f7fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f89a00b8660 0x7f89a00cd430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:56688/0 (socket says 172.21.15.84:56688) 2023-07-14T11:13:58.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.685+0000 7f899f7fe700 1 -- 172.21.15.84:0/482707045 learned_addr learned my addr 172.21.15.84:0/482707045 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:13:58.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.685+0000 7f899effd700 1 --2- 172.21.15.84:0/482707045 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89a00b4860 0x7f89a00b4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:58.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.685+0000 7f899e7fc700 1 -- 172.21.15.84:0/482707045 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 378006742 0 0) 0x7f89a00d02a0 con 0x7f89a00b8660 2023-07-14T11:13:58.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.685+0000 7f899e7fc700 1 -- 172.21.15.84:0/482707045 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89880035b0 con 0x7f89a00b8660 2023-07-14T11:13:58.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.686+0000 7f899e7fc700 1 -- 172.21.15.84:0/482707045 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 698862357 0 0) 0x7f89a00cfce0 con 0x7f89a00d12c0 2023-07-14T11:13:58.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.686+0000 7f899e7fc700 1 -- 172.21.15.84:0/482707045 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89a00d02a0 con 0x7f89a00d12c0 2023-07-14T11:13:58.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.686+0000 7f899effd700 1 -- 172.21.15.84:0/482707045 >> v1:172.21.15.179:6789/0 conn(0x7f89a00d12c0 legacy=0x7f89a00d1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:58.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.686+0000 7f899effd700 1 -- 172.21.15.84:0/482707045 >> v1:172.21.15.84:6789/0 conn(0x7f89a00b8660 legacy=0x7f89a00cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:58.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.686+0000 7f899effd700 1 -- 172.21.15.84:0/482707045 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a00cffc0 con 0x7f89a00b4860 2023-07-14T11:13:58.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.686+0000 7f899effd700 1 --2- 172.21.15.84:0/482707045 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89a00b4860 0x7f89a00b4cd0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8994009870 tx=0x7f8994009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=694df6fa55ed0686 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:58.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.686+0000 7f899e7fc700 1 -- 172.21.15.84:0/482707045 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8994011830 con 0x7f89a00b4860 2023-07-14T11:13:58.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.686+0000 7f899e7fc700 1 -- 172.21.15.84:0/482707045 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8994011990 con 0x7f89a00b4860 2023-07-14T11:13:58.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.686+0000 7f899e7fc700 1 -- 172.21.15.84:0/482707045 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8994011d20 con 0x7f89a00b4860 2023-07-14T11:13:58.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.687+0000 7f89a5bff700 1 -- 172.21.15.84:0/482707045 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89a00b4860 msgr2=0x7f89a00b4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:58.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.687+0000 7f89a5bff700 1 --2- 172.21.15.84:0/482707045 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89a00b4860 0x7f89a00b4cd0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8994009870 tx=0x7f8994009b80 comp rx=0 tx=0).stop 2023-07-14T11:13:58.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.687+0000 7f89a5bff700 1 -- 172.21.15.84:0/482707045 shutdown_connections 2023-07-14T11:13:58.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.687+0000 7f89a5bff700 1 --2- 172.21.15.84:0/482707045 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89a00b4860 0x7f89a00b4cd0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:58.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.687+0000 7f89a5bff700 1 -- 172.21.15.84:0/482707045 >> 172.21.15.84:0/482707045 conn(0x7f89a0066860 msgr2=0x7f89a006a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:58.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.687+0000 7f89a5bff700 1 -- 172.21.15.84:0/482707045 shutdown_connections 2023-07-14T11:13:58.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.687+0000 7f89a5bff700 1 -- 172.21.15.84:0/482707045 wait complete. 2023-07-14T11:13:58.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.689+0000 7f89a5bff700 1 Processor -- start 2023-07-14T11:13:58.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.689+0000 7f89a5bff700 1 -- start start 2023-07-14T11:13:58.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.690+0000 7f89a5bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89a00b4860 0x7f89a01576c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:58.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.690+0000 7f89a5bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89a00b8660 0x7f89a01e5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:58.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.690+0000 7f89a5bff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89a00d12c0 0x7f89a01599f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:58.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.690+0000 7f89a5bff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a01e6570 con 0x7f89a00d12c0 2023-07-14T11:13:58.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.690+0000 7f89a5bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a01e6850 con 0x7f89a00b4860 2023-07-14T11:13:58.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.690+0000 7f89a5bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89a01e6b30 con 0x7f89a00b8660 2023-07-14T11:13:58.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.690+0000 7f899ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89a00d12c0 0x7f89a01599f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:58.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.690+0000 7f899ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89a00d12c0 0x7f89a01599f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49976/0 (socket says 172.21.15.84:49976) 2023-07-14T11:13:58.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.690+0000 7f899ffff700 1 -- 172.21.15.84:0/1518236981 learned_addr learned my addr 172.21.15.84:0/1518236981 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:58.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.690+0000 7f899effd700 1 --2- 172.21.15.84:0/1518236981 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89a00b8660 0x7f89a01e5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:58.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.690+0000 7f899f7fe700 1 --2- 172.21.15.84:0/1518236981 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89a00b4860 0x7f89a01576c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:58.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.690+0000 7f899ffff700 1 -- 172.21.15.84:0/1518236981 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89a00b8660 msgr2=0x7f89a01e5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:58.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.690+0000 7f899ffff700 1 --2- 172.21.15.84:0/1518236981 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89a00b8660 0x7f89a01e5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:58.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.690+0000 7f899ffff700 1 -- 172.21.15.84:0/1518236981 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89a00b4860 msgr2=0x7f89a01576c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:58.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.690+0000 7f899ffff700 1 --2- 172.21.15.84:0/1518236981 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89a00b4860 0x7f89a01576c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:58.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.690+0000 7f899ffff700 1 -- 172.21.15.84:0/1518236981 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89940094a0 con 0x7f89a00d12c0 2023-07-14T11:13:58.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.691+0000 7f899ffff700 1 --2- 172.21.15.84:0/1518236981 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89a00d12c0 0x7f89a01599f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f899800cbc0 tx=0x7f899800ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:58.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.691+0000 7f8987fff700 1 -- 172.21.15.84:0/1518236981 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8998003c00 con 0x7f89a00d12c0 2023-07-14T11:13:58.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.691+0000 7f8987fff700 1 -- 172.21.15.84:0/1518236981 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8998003d60 con 0x7f89a00d12c0 2023-07-14T11:13:58.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.691+0000 7f89a5bff700 1 -- 172.21.15.84:0/1518236981 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89a01e6e10 con 0x7f89a00d12c0 2023-07-14T11:13:58.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.691+0000 7f8987fff700 1 -- 172.21.15.84:0/1518236981 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f899800aaa0 con 0x7f89a00d12c0 2023-07-14T11:13:58.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.691+0000 7f89a5bff700 1 -- 172.21.15.84:0/1518236981 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89a0157c00 con 0x7f89a00d12c0 2023-07-14T11:13:58.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.692+0000 7f89a5bff700 1 -- 172.21.15.84:0/1518236981 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89a01e7330 con 0x7f89a00d12c0 2023-07-14T11:13:58.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.693+0000 7f8987fff700 1 -- 172.21.15.84:0/1518236981 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f899800ac00 con 0x7f89a00d12c0 2023-07-14T11:13:58.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.694+0000 7f8987fff700 1 --2- 172.21.15.84:0/1518236981 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f898c06ace0 0x7f898c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:58.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.694+0000 7f8987fff700 1 -- 172.21.15.84:0/1518236981 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f8998089520 con 0x7f89a00d12c0 2023-07-14T11:13:58.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.694+0000 7f899f7fe700 1 --2- 172.21.15.84:0/1518236981 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f898c06ace0 0x7f898c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:58.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.695+0000 7f899f7fe700 1 --2- 172.21.15.84:0/1518236981 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f898c06ace0 0x7f898c06d190 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8990007fd0 tx=0x7f8990007dc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:58.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.698+0000 7f8987fff700 1 -- 172.21.15.84:0/1518236981 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f89a01e7330 con 0x7f89a00d12c0 2023-07-14T11:13:58.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.892+0000 7f89a5bff700 1 -- 172.21.15.84:0/1518236981 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f89a01e7330 con 0x7f89a00d12c0 2023-07-14T11:13:58.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.892+0000 7f8987fff700 1 -- 172.21.15.84:0/1518236981 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f89a01e7330 con 0x7f89a00d12c0 2023-07-14T11:13:58.895 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-07-14T11:13:58.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.895+0000 7f89a5bff700 1 -- 172.21.15.84:0/1518236981 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f898c06ace0 msgr2=0x7f898c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:58.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.895+0000 7f89a5bff700 1 --2- 172.21.15.84:0/1518236981 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f898c06ace0 0x7f898c06d190 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8990007fd0 tx=0x7f8990007dc0 comp rx=0 tx=0).stop 2023-07-14T11:13:58.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.895+0000 7f89a5bff700 1 -- 172.21.15.84:0/1518236981 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89a00d12c0 msgr2=0x7f89a01599f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:58.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.895+0000 7f89a5bff700 1 --2- 172.21.15.84:0/1518236981 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89a00d12c0 0x7f89a01599f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f899800cbc0 tx=0x7f899800ced0 comp rx=0 tx=0).stop 2023-07-14T11:13:58.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.895+0000 7f89a5bff700 1 -- 172.21.15.84:0/1518236981 shutdown_connections 2023-07-14T11:13:58.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.895+0000 7f89a5bff700 1 --2- 172.21.15.84:0/1518236981 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89a00d12c0 0x7f89a01599f0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:58.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.895+0000 7f89a5bff700 1 --2- 172.21.15.84:0/1518236981 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89a00b4860 0x7f89a01576c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:58.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.895+0000 7f89a5bff700 1 --2- 172.21.15.84:0/1518236981 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f898c06ace0 0x7f898c06d190 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:58.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.895+0000 7f89a5bff700 1 --2- 172.21.15.84:0/1518236981 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89a00b8660 0x7f89a01e5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:58.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.895+0000 7f89a5bff700 1 -- 172.21.15.84:0/1518236981 >> 172.21.15.84:0/1518236981 conn(0x7f89a0066860 msgr2=0x7f89a00d2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:58.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.895+0000 7f89a5bff700 1 -- 172.21.15.84:0/1518236981 shutdown_connections 2023-07-14T11:13:58.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:58.895+0000 7f89a5bff700 1 -- 172.21.15.84:0/1518236981 wait complete. 2023-07-14T11:13:58.915 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-14T11:13:59.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.109+0000 7f52d17ff700 1 Processor -- start 2023-07-14T11:13:59.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.109+0000 7f52d17ff700 1 -- start start 2023-07-14T11:13:59.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.110+0000 7f52d17ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f52cc0adea0 0x7f52cc0ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:59.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.110+0000 7f52d17ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52cc15ce70 con 0x7f52cc0c92d0 2023-07-14T11:13:59.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.110+0000 7f52d17ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52cc15d0c0 con 0x7f52cc0b12f0 2023-07-14T11:13:59.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.110+0000 7f52d17ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52cc15da60 con 0x7f52cc0adea0 2023-07-14T11:13:59.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.111+0000 7f52caffd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f52cc0c92d0 0x7f52cc0c96a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55566/0 (socket says 172.21.15.84:55566) 2023-07-14T11:13:59.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.111+0000 7f52caffd700 1 -- 172.21.15.84:0/2595115353 learned_addr learned my addr 172.21.15.84:0/2595115353 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:13:59.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.111+0000 7f52cb7fe700 1 --2- 172.21.15.84:0/2595115353 >> v2:172.21.15.179:3300/0 conn(0x7f52cc0adea0 0x7f52cc0ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:59.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.111+0000 7f52c9ffb700 1 -- 172.21.15.84:0/2595115353 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3834390760 0 0) 0x7f52cc15ce70 con 0x7f52cc0c92d0 2023-07-14T11:13:59.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.111+0000 7f52c9ffb700 1 -- 172.21.15.84:0/2595115353 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52b40035b0 con 0x7f52cc0c92d0 2023-07-14T11:13:59.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.111+0000 7f52c9ffb700 1 -- 172.21.15.84:0/2595115353 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1814418043 0 0) 0x7f52b40035b0 con 0x7f52cc0c92d0 2023-07-14T11:13:59.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.111+0000 7f52c9ffb700 1 -- 172.21.15.84:0/2595115353 >> v2:172.21.15.179:3300/0 conn(0x7f52cc0adea0 msgr2=0x7f52cc0ad8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:59.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.111+0000 7f52c9ffb700 1 --2- 172.21.15.84:0/2595115353 >> v2:172.21.15.179:3300/0 conn(0x7f52cc0adea0 0x7f52cc0ad8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:59.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.111+0000 7f52c9ffb700 1 -- 172.21.15.84:0/2595115353 >> v1:172.21.15.179:6789/0 conn(0x7f52cc0b12f0 legacy=0x7f52cc0cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:59.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.111+0000 7f52c9ffb700 1 -- 172.21.15.84:0/2595115353 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52cc15d3a0 con 0x7f52cc0c92d0 2023-07-14T11:13:59.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.111+0000 7f52c9ffb700 1 -- 172.21.15.84:0/2595115353 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7f52bc001670 con 0x7f52cc0c92d0 2023-07-14T11:13:59.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.112+0000 7f52c9ffb700 1 -- 172.21.15.84:0/2595115353 >> v1:172.21.15.84:6789/0 conn(0x7f52cc0c92d0 legacy=0x7f52cc0c96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:59.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.112+0000 7f52c9ffb700 1 --2- 172.21.15.84:0/2595115353 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52b4003a00 0x7f52b4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:59.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.112+0000 7f52c9ffb700 1 --2- 172.21.15.84:0/2595115353 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52b4004850 0x7f52b4004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:59.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.112+0000 7f52c9ffb700 1 --2- 172.21.15.84:0/2595115353 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52b4005200 0x7f52b400dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:59.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.112+0000 7f52c9ffb700 1 -- 172.21.15.84:0/2595115353 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52cc15da60 con 0x7f52b4005200 2023-07-14T11:13:59.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.112+0000 7f52c9ffb700 1 -- 172.21.15.84:0/2595115353 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52b400e2f0 con 0x7f52b4003a00 2023-07-14T11:13:59.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.112+0000 7f52c9ffb700 1 -- 172.21.15.84:0/2595115353 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52b400e4b0 con 0x7f52b4004850 2023-07-14T11:13:59.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.112+0000 7f52caffd700 1 --2- 172.21.15.84:0/2595115353 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52b4003a00 0x7f52b4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:59.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.112+0000 7f52cb7fe700 1 --2- 172.21.15.84:0/2595115353 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52b4005200 0x7f52b400dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:59.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.112+0000 7f52ca7fc700 1 --2- 172.21.15.84:0/2595115353 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52b4004850 0x7f52b4004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:59.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.112+0000 7f52cb7fe700 1 -- 172.21.15.84:0/2595115353 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52b4004850 msgr2=0x7f52b4004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:59.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.112+0000 7f52cb7fe700 1 --2- 172.21.15.84:0/2595115353 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52b4004850 0x7f52b4004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:59.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.112+0000 7f52cb7fe700 1 -- 172.21.15.84:0/2595115353 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52b4003a00 msgr2=0x7f52b4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:59.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.112+0000 7f52cb7fe700 1 --2- 172.21.15.84:0/2595115353 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52b4003a00 0x7f52b4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:59.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.112+0000 7f52cb7fe700 1 -- 172.21.15.84:0/2595115353 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52b40035b0 con 0x7f52b4005200 2023-07-14T11:13:59.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.112+0000 7f52cb7fe700 1 -- 172.21.15.84:0/2595115353 reap_dead start 2023-07-14T11:13:59.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.113+0000 7f52cb7fe700 1 --2- 172.21.15.84:0/2595115353 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52b4005200 0x7f52b400dc20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f52c4009f90 tx=0x7f52b4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2fc70f02ac6de48 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:59.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.113+0000 7f52c9ffb700 1 -- 172.21.15.84:0/2595115353 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c4003a20 con 0x7f52b4005200 2023-07-14T11:13:59.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.113+0000 7f52c9ffb700 1 -- 172.21.15.84:0/2595115353 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52c400f040 con 0x7f52b4005200 2023-07-14T11:13:59.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.113+0000 7f52c9ffb700 1 -- 172.21.15.84:0/2595115353 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c4003dc0 con 0x7f52b4005200 2023-07-14T11:13:59.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.113+0000 7f52d17ff700 1 -- 172.21.15.84:0/2595115353 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52b4005200 msgr2=0x7f52b400dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:59.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.113+0000 7f52d17ff700 1 --2- 172.21.15.84:0/2595115353 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52b4005200 0x7f52b400dc20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f52c4009f90 tx=0x7f52b4005880 comp rx=0 tx=0).stop 2023-07-14T11:13:59.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.113+0000 7f52d17ff700 1 -- 172.21.15.84:0/2595115353 shutdown_connections 2023-07-14T11:13:59.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.113+0000 7f52d17ff700 1 --2- 172.21.15.84:0/2595115353 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52b4005200 0x7f52b400dc20 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:59.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.113+0000 7f52d17ff700 1 -- 172.21.15.84:0/2595115353 >> 172.21.15.84:0/2595115353 conn(0x7f52cc0b05d0 msgr2=0x7f52cc0b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:59.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.114+0000 7f52d17ff700 1 -- 172.21.15.84:0/2595115353 shutdown_connections 2023-07-14T11:13:59.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.114+0000 7f52d17ff700 1 -- 172.21.15.84:0/2595115353 wait complete. 2023-07-14T11:13:59.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.115+0000 7f52d17ff700 1 Processor -- start 2023-07-14T11:13:59.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.115+0000 7f52d17ff700 1 -- start start 2023-07-14T11:13:59.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.116+0000 7f52d17ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52b4005200 0x7f52cc0acad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:59.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.116+0000 7f52d17ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52cc0c6be0 0x7f52cc0c7050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:59.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.116+0000 7f52d17ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52cc14bb00 0x7f52cc14bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:59.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.116+0000 7f52d17ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52cc1533f0 con 0x7f52cc0c6be0 2023-07-14T11:13:59.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.116+0000 7f52d17ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52cc0c7590 con 0x7f52cc14bb00 2023-07-14T11:13:59.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.116+0000 7f52d17ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52cc14c4b0 con 0x7f52b4005200 2023-07-14T11:13:59.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.117+0000 7f52ca7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52cc0c6be0 0x7f52cc0c7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:59.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.117+0000 7f52ca7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52cc0c6be0 0x7f52cc0c7050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55414/0 (socket says 172.21.15.84:55414) 2023-07-14T11:13:59.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.117+0000 7f52ca7fc700 1 -- 172.21.15.84:0/1891480341 learned_addr learned my addr 172.21.15.84:0/1891480341 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:59.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.117+0000 7f52cb7fe700 1 --2- 172.21.15.84:0/1891480341 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52cc14bb00 0x7f52cc14bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:59.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.117+0000 7f52caffd700 1 --2- 172.21.15.84:0/1891480341 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52b4005200 0x7f52cc0acad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:59.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.117+0000 7f52ca7fc700 1 -- 172.21.15.84:0/1891480341 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52b4005200 msgr2=0x7f52cc0acad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:59.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.117+0000 7f52ca7fc700 1 --2- 172.21.15.84:0/1891480341 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52b4005200 0x7f52cc0acad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:59.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.117+0000 7f52ca7fc700 1 -- 172.21.15.84:0/1891480341 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52cc14bb00 msgr2=0x7f52cc14bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:59.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.117+0000 7f52ca7fc700 1 --2- 172.21.15.84:0/1891480341 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52cc14bb00 0x7f52cc14bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:59.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.117+0000 7f52ca7fc700 1 -- 172.21.15.84:0/1891480341 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52cc0c77f0 con 0x7f52cc0c6be0 2023-07-14T11:13:59.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.117+0000 7f52caffd700 1 --2- 172.21.15.84:0/1891480341 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52b4005200 0x7f52cc0acad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:13:59.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.117+0000 7f52ca7fc700 1 --2- 172.21.15.84:0/1891480341 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52cc0c6be0 0x7f52cc0c7050 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f52c000f7c0 tx=0x7f52c000fad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:59.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.117+0000 7f52b37fe700 1 -- 172.21.15.84:0/1891480341 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c00052e0 con 0x7f52cc0c6be0 2023-07-14T11:13:59.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.117+0000 7f52b37fe700 1 -- 172.21.15.84:0/1891480341 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52c0005460 con 0x7f52cc0c6be0 2023-07-14T11:13:59.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.117+0000 7f52b37fe700 1 -- 172.21.15.84:0/1891480341 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c00038c0 con 0x7f52cc0c6be0 2023-07-14T11:13:59.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.117+0000 7f52d17ff700 1 -- 172.21.15.84:0/1891480341 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52cc0c7ad0 con 0x7f52cc0c6be0 2023-07-14T11:13:59.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.118+0000 7f52d17ff700 1 -- 172.21.15.84:0/1891480341 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52cc0c8090 con 0x7f52cc0c6be0 2023-07-14T11:13:59.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.119+0000 7f52d17ff700 1 -- 172.21.15.84:0/1891480341 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52cc074350 con 0x7f52cc0c6be0 2023-07-14T11:13:59.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.120+0000 7f52b37fe700 1 -- 172.21.15.84:0/1891480341 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f52c0003a20 con 0x7f52cc0c6be0 2023-07-14T11:13:59.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.120+0000 7f52b37fe700 1 --2- 172.21.15.84:0/1891480341 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f52b806ad10 0x7f52b806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:59.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.121+0000 7f52b37fe700 1 -- 172.21.15.84:0/1891480341 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f52c0089360 con 0x7f52cc0c6be0 2023-07-14T11:13:59.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.121+0000 7f52caffd700 1 --2- 172.21.15.84:0/1891480341 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f52b806ad10 0x7f52b806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:59.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.121+0000 7f52caffd700 1 --2- 172.21.15.84:0/1891480341 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f52b806ad10 0x7f52b806d1c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f52bc007c70 tx=0x7f52bc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:59.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.125+0000 7f52b37fe700 1 -- 172.21.15.84:0/1891480341 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f52c00542b0 con 0x7f52cc0c6be0 2023-07-14T11:13:59.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.330+0000 7f52d17ff700 1 -- 172.21.15.84:0/1891480341 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f52cc0b4a40 con 0x7f52cc0c6be0 2023-07-14T11:13:59.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.331+0000 7f52b37fe700 1 -- 172.21.15.84:0/1891480341 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7f52c00578d0 con 0x7f52cc0c6be0 2023-07-14T11:13:59.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.333+0000 7f52d17ff700 1 -- 172.21.15.84:0/1891480341 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f52b806ad10 msgr2=0x7f52b806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:59.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.333+0000 7f52d17ff700 1 --2- 172.21.15.84:0/1891480341 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f52b806ad10 0x7f52b806d1c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f52bc007c70 tx=0x7f52bc009040 comp rx=0 tx=0).stop 2023-07-14T11:13:59.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.333+0000 7f52d17ff700 1 -- 172.21.15.84:0/1891480341 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52cc0c6be0 msgr2=0x7f52cc0c7050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:59.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.333+0000 7f52d17ff700 1 --2- 172.21.15.84:0/1891480341 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52cc0c6be0 0x7f52cc0c7050 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f52c000f7c0 tx=0x7f52c000fad0 comp rx=0 tx=0).stop 2023-07-14T11:13:59.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.333+0000 7f52d17ff700 1 -- 172.21.15.84:0/1891480341 shutdown_connections 2023-07-14T11:13:59.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.333+0000 7f52d17ff700 1 --2- 172.21.15.84:0/1891480341 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f52b806ad10 0x7f52b806d1c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:59.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.333+0000 7f52d17ff700 1 --2- 172.21.15.84:0/1891480341 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52b4005200 0x7f52cc0acad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:59.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.333+0000 7f52d17ff700 1 --2- 172.21.15.84:0/1891480341 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52cc14bb00 0x7f52cc14bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:59.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.333+0000 7f52d17ff700 1 --2- 172.21.15.84:0/1891480341 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52cc0c6be0 0x7f52cc0c7050 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:59.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.333+0000 7f52d17ff700 1 -- 172.21.15.84:0/1891480341 >> 172.21.15.84:0/1891480341 conn(0x7f52cc0b05d0 msgr2=0x7f52cc06f730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:59.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.333+0000 7f52d17ff700 1 -- 172.21.15.84:0/1891480341 shutdown_connections 2023-07-14T11:13:59.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.333+0000 7f52d17ff700 1 -- 172.21.15.84:0/1891480341 wait complete. 2023-07-14T11:13:59.338 INFO:teuthology.orchestra.run.smithi084.stderr:listed 0 entries 2023-07-14T11:13:59.353 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-14T11:13:59.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:59.353 DEBUG:teuthology.orchestra.run.smithi084:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-07-14T11:13:59.437 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi084.front.sepia.ceph.com 2023-07-14T11:13:59.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:13:59.438 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-14T11:13:59.502 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-07-14T11:13:59.502 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:13:59.554 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-07-14T11:13:59.554 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:13:59.602 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-07-14T11:13:59.602 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:13:59.688 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:13:59.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.881+0000 7fbb96dff700 1 Processor -- start 2023-07-14T11:13:59.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.881+0000 7fbb96dff700 1 -- start start 2023-07-14T11:13:59.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.882+0000 7fbb96dff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbb900b4510 0x7fbb900b6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:59.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.882+0000 7fbb96dff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb900b7f50 con 0x7fbb900d0b10 2023-07-14T11:13:59.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.882+0000 7fbb96dff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb900cdca0 con 0x7fbb900b5d90 2023-07-14T11:13:59.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.882+0000 7fbb96dff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb900b48e0 con 0x7fbb900b4510 2023-07-14T11:13:59.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.883+0000 7fbb9539c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fbb900d0b10 0x7fbb900b83e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55568/0 (socket says 172.21.15.84:55568) 2023-07-14T11:13:59.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.883+0000 7fbb9539c700 1 -- 172.21.15.84:0/1774230368 learned_addr learned my addr 172.21.15.84:0/1774230368 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:13:59.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.883+0000 7fbb94b9b700 1 --2- 172.21.15.84:0/1774230368 >> v2:172.21.15.179:3300/0 conn(0x7fbb900b4510 0x7fbb900b6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:59.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.883+0000 7fbb8f7fe700 1 -- 172.21.15.84:0/1774230368 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2940123812 0 0) 0x7fbb900b7f50 con 0x7fbb900d0b10 2023-07-14T11:13:59.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.883+0000 7fbb8f7fe700 1 -- 172.21.15.84:0/1774230368 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb800035b0 con 0x7fbb900d0b10 2023-07-14T11:13:59.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.883+0000 7fbb8f7fe700 1 -- 172.21.15.84:0/1774230368 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1580244827 0 0) 0x7fbb800035b0 con 0x7fbb900d0b10 2023-07-14T11:13:59.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.883+0000 7fbb8f7fe700 1 -- 172.21.15.84:0/1774230368 >> v2:172.21.15.179:3300/0 conn(0x7fbb900b4510 msgr2=0x7fbb900b6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:59.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.883+0000 7fbb8f7fe700 1 --2- 172.21.15.84:0/1774230368 >> v2:172.21.15.179:3300/0 conn(0x7fbb900b4510 0x7fbb900b6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:59.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.883+0000 7fbb8f7fe700 1 -- 172.21.15.84:0/1774230368 >> v1:172.21.15.179:6789/0 conn(0x7fbb900b5d90 legacy=0x7fbb900cd590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:59.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.883+0000 7fbb8f7fe700 1 -- 172.21.15.84:0/1774230368 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb900b7340 con 0x7fbb900d0b10 2023-07-14T11:13:59.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.883+0000 7fbb8f7fe700 1 -- 172.21.15.84:0/1774230368 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7fbb880019f0 con 0x7fbb900d0b10 2023-07-14T11:13:59.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.883+0000 7fbb8f7fe700 1 -- 172.21.15.84:0/1774230368 >> v1:172.21.15.84:6789/0 conn(0x7fbb900d0b10 legacy=0x7fbb900b83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:59.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.883+0000 7fbb8f7fe700 1 --2- 172.21.15.84:0/1774230368 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb80003a50 0x7fbb80003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:59.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.883+0000 7fbb8f7fe700 1 --2- 172.21.15.84:0/1774230368 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb80004850 0x7fbb80004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:59.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.883+0000 7fbb8f7fe700 1 --2- 172.21.15.84:0/1774230368 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb800052d0 0x7fbb8000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:59.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.883+0000 7fbb8f7fe700 1 -- 172.21.15.84:0/1774230368 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8000c1d0 con 0x7fbb80004850 2023-07-14T11:13:59.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.883+0000 7fbb8f7fe700 1 -- 172.21.15.84:0/1774230368 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8000c340 con 0x7fbb80003a50 2023-07-14T11:13:59.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.883+0000 7fbb8f7fe700 1 -- 172.21.15.84:0/1774230368 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8000c500 con 0x7fbb800052d0 2023-07-14T11:13:59.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.884+0000 7fbb8ffff700 1 --2- 172.21.15.84:0/1774230368 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb80004850 0x7fbb80004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:59.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.884+0000 7fbb94b9b700 1 --2- 172.21.15.84:0/1774230368 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb80003a50 0x7fbb80003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:59.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.884+0000 7fbb9539c700 1 --2- 172.21.15.84:0/1774230368 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb800052d0 0x7fbb8000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:59.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.884+0000 7fbb8ffff700 1 -- 172.21.15.84:0/1774230368 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb800052d0 msgr2=0x7fbb8000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:59.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.884+0000 7fbb8ffff700 1 --2- 172.21.15.84:0/1774230368 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb800052d0 0x7fbb8000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:59.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.884+0000 7fbb8ffff700 1 -- 172.21.15.84:0/1774230368 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb80003a50 msgr2=0x7fbb80003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:13:59.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.884+0000 7fbb8ffff700 1 --2- 172.21.15.84:0/1774230368 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb80003a50 0x7fbb80003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:59.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.884+0000 7fbb8ffff700 1 -- 172.21.15.84:0/1774230368 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb800035b0 con 0x7fbb80004850 2023-07-14T11:13:59.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.884+0000 7fbb9539c700 1 -- 172.21.15.84:0/1774230368 reap_dead start 2023-07-14T11:13:59.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.884+0000 7fbb8ffff700 1 --2- 172.21.15.84:0/1774230368 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb80004850 0x7fbb80004cc0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c0017c0 tx=0x7fbb80005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23866a568d45a83e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:59.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.884+0000 7fbb8f7fe700 1 -- 172.21.15.84:0/1774230368 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb7c0052d0 con 0x7fbb80004850 2023-07-14T11:13:59.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.885+0000 7fbb8f7fe700 1 -- 172.21.15.84:0/1774230368 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb7c005430 con 0x7fbb80004850 2023-07-14T11:13:59.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.885+0000 7fbb8f7fe700 1 -- 172.21.15.84:0/1774230368 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb7c0038c0 con 0x7fbb80004850 2023-07-14T11:13:59.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.885+0000 7fbb96dff700 1 -- 172.21.15.84:0/1774230368 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb80004850 msgr2=0x7fbb80004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:59.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.885+0000 7fbb96dff700 1 --2- 172.21.15.84:0/1774230368 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb80004850 0x7fbb80004cc0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c0017c0 tx=0x7fbb80005880 comp rx=0 tx=0).stop 2023-07-14T11:13:59.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.885+0000 7fbb96dff700 1 -- 172.21.15.84:0/1774230368 shutdown_connections 2023-07-14T11:13:59.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.885+0000 7fbb96dff700 1 --2- 172.21.15.84:0/1774230368 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb80004850 0x7fbb80004cc0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:59.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.885+0000 7fbb96dff700 1 -- 172.21.15.84:0/1774230368 >> 172.21.15.84:0/1774230368 conn(0x7fbb9009c1d0 msgr2=0x7fbb900d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:13:59.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.885+0000 7fbb96dff700 1 -- 172.21.15.84:0/1774230368 shutdown_connections 2023-07-14T11:13:59.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.885+0000 7fbb96dff700 1 -- 172.21.15.84:0/1774230368 wait complete. 2023-07-14T11:13:59.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.887+0000 7fbb96dff700 1 Processor -- start 2023-07-14T11:13:59.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.887+0000 7fbb96dff700 1 -- start start 2023-07-14T11:13:59.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.888+0000 7fbb96dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb80004850 0x7fbb9015b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:59.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.888+0000 7fbb96dff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb901f6100 0x7fbb9015ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:59.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.888+0000 7fbb96dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb9015f3d0 0x7fbb900b82e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:59.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.888+0000 7fbb96dff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9015fe10 con 0x7fbb901f6100 2023-07-14T11:13:59.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.888+0000 7fbb96dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9015ba30 con 0x7fbb80004850 2023-07-14T11:13:59.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.888+0000 7fbb96dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9015f850 con 0x7fbb9015f3d0 2023-07-14T11:13:59.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.888+0000 7fbb8ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb901f6100 0x7fbb9015ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:59.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.888+0000 7fbb94b9b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb80004850 0x7fbb9015b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:59.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.888+0000 7fbb8ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb901f6100 0x7fbb9015ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55432/0 (socket says 172.21.15.84:55432) 2023-07-14T11:13:59.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.888+0000 7fbb8ffff700 1 -- 172.21.15.84:0/70818096 learned_addr learned my addr 172.21.15.84:0/70818096 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:13:59.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.889+0000 7fbb9539c700 1 --2- 172.21.15.84:0/70818096 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb9015f3d0 0x7fbb900b82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:59.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.889+0000 7fbb94b9b700 1 -- 172.21.15.84:0/70818096 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb9015f3d0 msgr2=0x7fbb900b82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:59.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.889+0000 7fbb94b9b700 1 --2- 172.21.15.84:0/70818096 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb9015f3d0 0x7fbb900b82e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:59.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.889+0000 7fbb94b9b700 1 -- 172.21.15.84:0/70818096 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb901f6100 msgr2=0x7fbb9015ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:13:59.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.889+0000 7fbb94b9b700 1 --2- 172.21.15.84:0/70818096 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb901f6100 0x7fbb9015ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:13:59.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.889+0000 7fbb94b9b700 1 -- 172.21.15.84:0/70818096 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb9015fb30 con 0x7fbb80004850 2023-07-14T11:13:59.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.889+0000 7fbb8ffff700 1 --2- 172.21.15.84:0/70818096 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb901f6100 0x7fbb9015ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:13:59.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.889+0000 7fbb94b9b700 1 --2- 172.21.15.84:0/70818096 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb80004850 0x7fbb9015b4f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbb900685c0 tx=0x7fbb84011b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:59.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.889+0000 7fbb8d7fa700 1 -- 172.21.15.84:0/70818096 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb84004240 con 0x7fbb80004850 2023-07-14T11:13:59.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.889+0000 7fbb8d7fa700 1 -- 172.21.15.84:0/70818096 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb840043a0 con 0x7fbb80004850 2023-07-14T11:13:59.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.889+0000 7fbb8d7fa700 1 -- 172.21.15.84:0/70818096 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb840036a0 con 0x7fbb80004850 2023-07-14T11:13:59.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.889+0000 7fbb96dff700 1 -- 172.21.15.84:0/70818096 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb901f5900 con 0x7fbb80004850 2023-07-14T11:13:59.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.890+0000 7fbb96dff700 1 -- 172.21.15.84:0/70818096 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb901f6570 con 0x7fbb80004850 2023-07-14T11:13:59.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.890+0000 7fbb96dff700 1 -- 172.21.15.84:0/70818096 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb901f5f50 con 0x7fbb80004850 2023-07-14T11:13:59.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.892+0000 7fbb8d7fa700 1 -- 172.21.15.84:0/70818096 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbb84003800 con 0x7fbb80004850 2023-07-14T11:13:59.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.893+0000 7fbb8d7fa700 1 --2- 172.21.15.84:0/70818096 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fbb7406ace0 0x7fbb7406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:13:59.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.893+0000 7fbb8d7fa700 1 -- 172.21.15.84:0/70818096 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fbb84089a00 con 0x7fbb80004850 2023-07-14T11:13:59.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.893+0000 7fbb8ffff700 1 --2- 172.21.15.84:0/70818096 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fbb7406ace0 0x7fbb7406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:13:59.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.893+0000 7fbb8ffff700 1 --2- 172.21.15.84:0/70818096 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fbb7406ace0 0x7fbb7406d190 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c000c00 tx=0x7fbb7c009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:13:59.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:13:59.896+0000 7fbb8d7fa700 1 -- 172.21.15.84:0/70818096 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fbb840584e0 con 0x7fbb80004850 2023-07-14T11:14:00.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.090+0000 7fbb96dff700 1 -- 172.21.15.84:0/70818096 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbb901f5760 con 0x7fbb80004850 2023-07-14T11:14:00.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.092+0000 7fbb8d7fa700 1 -- 172.21.15.84:0/70818096 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18351 (secure 0 0 0) 0x7fbb901f5760 con 0x7fbb80004850 2023-07-14T11:14:00.094 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:14:00.095 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":25,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:13:55.825723+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-14T11:13:12.727811+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-14T11:13:13.436391+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.17","mappings":[{"from":3,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:14:00.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.094+0000 7fbb96dff700 1 -- 172.21.15.84:0/70818096 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fbb7406ace0 msgr2=0x7fbb7406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:00.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.094+0000 7fbb96dff700 1 --2- 172.21.15.84:0/70818096 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fbb7406ace0 0x7fbb7406d190 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c000c00 tx=0x7fbb7c009030 comp rx=0 tx=0).stop 2023-07-14T11:14:00.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.094+0000 7fbb96dff700 1 -- 172.21.15.84:0/70818096 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb80004850 msgr2=0x7fbb9015b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:00.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.094+0000 7fbb96dff700 1 --2- 172.21.15.84:0/70818096 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb80004850 0x7fbb9015b4f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbb900685c0 tx=0x7fbb84011b40 comp rx=0 tx=0).stop 2023-07-14T11:14:00.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.094+0000 7fbb96dff700 1 -- 172.21.15.84:0/70818096 shutdown_connections 2023-07-14T11:14:00.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.094+0000 7fbb96dff700 1 --2- 172.21.15.84:0/70818096 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fbb7406ace0 0x7fbb7406d190 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:00.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.094+0000 7fbb96dff700 1 --2- 172.21.15.84:0/70818096 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb9015f3d0 0x7fbb900b82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:00.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.094+0000 7fbb96dff700 1 --2- 172.21.15.84:0/70818096 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb80004850 0x7fbb9015b4f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:00.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.094+0000 7fbb96dff700 1 --2- 172.21.15.84:0/70818096 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb901f6100 0x7fbb9015ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:00.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.094+0000 7fbb96dff700 1 -- 172.21.15.84:0/70818096 >> 172.21.15.84:0/70818096 conn(0x7fbb9009c1d0 msgr2=0x7fbb9006bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:00.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.094+0000 7fbb96dff700 1 -- 172.21.15.84:0/70818096 shutdown_connections 2023-07-14T11:14:00.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.095+0000 7fbb96dff700 1 -- 172.21.15.84:0/70818096 wait complete. 2023-07-14T11:14:00.114 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T11:13:00.125395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T11:13:06.803994+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T11:13:12.727811+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T11:13:13.436391+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T11:14:00.115 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T11:14:00.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.312+0000 7f6a563ff700 1 Processor -- start 2023-07-14T11:14:00.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.312+0000 7f6a563ff700 1 -- start start 2023-07-14T11:14:00.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.313+0000 7f6a563ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a5015c860 0x7f6a500d1e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:00.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.313+0000 7f6a563ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6a500cf2a0 0x7f6a500c6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:00.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.313+0000 7f6a563ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a500cf710 con 0x7f6a500c6fe0 2023-07-14T11:14:00.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.313+0000 7f6a563ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a50146740 con 0x7f6a500cf2a0 2023-07-14T11:14:00.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.313+0000 7f6a563ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a500cd5a0 con 0x7f6a5015c860 2023-07-14T11:14:00.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.314+0000 7f6a4ffff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a5015c860 0x7f6a500d1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:00.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.314+0000 7f6a4ffff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a5015c860 0x7f6a500d1e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.84:35632/0 (socket says 172.21.15.84:35632) 2023-07-14T11:14:00.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.314+0000 7f6a4ffff700 1 -- 172.21.15.84:0/4192674897 learned_addr learned my addr 172.21.15.84:0/4192674897 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:00.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.314+0000 7f6a4f7fe700 1 --2- 172.21.15.84:0/4192674897 >> v2:172.21.15.179:3300/0 conn(0x7f6a500cf2a0 0x7f6a500c6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:00.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.314+0000 7f6a4ffff700 1 -- 172.21.15.84:0/4192674897 >> v2:172.21.15.179:3300/0 conn(0x7f6a500cf2a0 msgr2=0x7f6a500c6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:00.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.314+0000 7f6a4ffff700 1 --2- 172.21.15.84:0/4192674897 >> v2:172.21.15.179:3300/0 conn(0x7f6a500cf2a0 0x7f6a500c6aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:00.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.314+0000 7f6a4ffff700 1 -- 172.21.15.84:0/4192674897 >> v1:172.21.15.179:6789/0 conn(0x7f6a500c6fe0 legacy=0x7f6a500cf960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:00.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.314+0000 7f6a4ffff700 1 -- 172.21.15.84:0/4192674897 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a500cd7f0 con 0x7f6a5015c860 2023-07-14T11:14:00.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.315+0000 7f6a4ffff700 1 --2- 172.21.15.84:0/4192674897 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a5015c860 0x7f6a500d1e40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6a400098f0 tx=0x7f6a40009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=877db9e9007c4ee0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:00.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.315+0000 7f6a4effd700 1 -- 172.21.15.84:0/4192674897 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a40011830 con 0x7f6a5015c860 2023-07-14T11:14:00.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.315+0000 7f6a4effd700 1 -- 172.21.15.84:0/4192674897 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a40011990 con 0x7f6a5015c860 2023-07-14T11:14:00.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.315+0000 7f6a4effd700 1 -- 172.21.15.84:0/4192674897 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a40011d20 con 0x7f6a5015c860 2023-07-14T11:14:00.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.315+0000 7f6a563ff700 1 -- 172.21.15.84:0/4192674897 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a5015c860 msgr2=0x7f6a500d1e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:00.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.315+0000 7f6a563ff700 1 --2- 172.21.15.84:0/4192674897 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a5015c860 0x7f6a500d1e40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6a400098f0 tx=0x7f6a40009c00 comp rx=0 tx=0).stop 2023-07-14T11:14:00.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.315+0000 7f6a563ff700 1 -- 172.21.15.84:0/4192674897 shutdown_connections 2023-07-14T11:14:00.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.315+0000 7f6a563ff700 1 --2- 172.21.15.84:0/4192674897 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a5015c860 0x7f6a500d1e40 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:00.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.315+0000 7f6a563ff700 1 --2- 172.21.15.84:0/4192674897 >> v2:172.21.15.179:3300/0 conn(0x7f6a500cf2a0 0x7f6a500c6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:00.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.315+0000 7f6a563ff700 1 -- 172.21.15.84:0/4192674897 >> 172.21.15.84:0/4192674897 conn(0x7f6a50065bd0 msgr2=0x7f6a50065fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:00.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.316+0000 7f6a563ff700 1 -- 172.21.15.84:0/4192674897 shutdown_connections 2023-07-14T11:14:00.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.316+0000 7f6a563ff700 1 -- 172.21.15.84:0/4192674897 wait complete. 2023-07-14T11:14:00.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.317+0000 7f6a563ff700 1 Processor -- start 2023-07-14T11:14:00.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.317+0000 7f6a563ff700 1 -- start start 2023-07-14T11:14:00.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.318+0000 7f6a563ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a500c6fe0 0x7f6a500cc660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:00.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.318+0000 7f6a563ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a500cf2a0 0x7f6a500ca020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:00.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.318+0000 7f6a563ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a5015c860 0x7f6a501590f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:00.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.318+0000 7f6a563ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a500ca720 con 0x7f6a500c6fe0 2023-07-14T11:14:00.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.318+0000 7f6a563ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a500caa00 con 0x7f6a5015c860 2023-07-14T11:14:00.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.318+0000 7f6a563ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a500cace0 con 0x7f6a500cf2a0 2023-07-14T11:14:00.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.319+0000 7f6a4ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a500c6fe0 0x7f6a500cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:00.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.319+0000 7f6a4ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a500c6fe0 0x7f6a500cc660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55438/0 (socket says 172.21.15.84:55438) 2023-07-14T11:14:00.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.319+0000 7f6a4ffff700 1 -- 172.21.15.84:0/155978006 learned_addr learned my addr 172.21.15.84:0/155978006 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:00.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.319+0000 7f6a4f7fe700 1 --2- 172.21.15.84:0/155978006 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a500cf2a0 0x7f6a500ca020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:00.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.319+0000 7f6a5499c700 1 --2- 172.21.15.84:0/155978006 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a5015c860 0x7f6a501590f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:00.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.319+0000 7f6a4ffff700 1 -- 172.21.15.84:0/155978006 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a500cf2a0 msgr2=0x7f6a500ca020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:00.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.319+0000 7f6a4ffff700 1 --2- 172.21.15.84:0/155978006 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a500cf2a0 0x7f6a500ca020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:00.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.319+0000 7f6a4ffff700 1 -- 172.21.15.84:0/155978006 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a5015c860 msgr2=0x7f6a501590f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:00.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.319+0000 7f6a4ffff700 1 --2- 172.21.15.84:0/155978006 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a5015c860 0x7f6a501590f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:00.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.319+0000 7f6a4ffff700 1 -- 172.21.15.84:0/155978006 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a40009550 con 0x7f6a500c6fe0 2023-07-14T11:14:00.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.319+0000 7f6a4ffff700 1 --2- 172.21.15.84:0/155978006 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a500c6fe0 0x7f6a500cc660 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f6a40009c40 tx=0x7f6a40004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:00.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.319+0000 7f6a4cff9700 1 -- 172.21.15.84:0/155978006 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a40004480 con 0x7f6a500c6fe0 2023-07-14T11:14:00.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.320+0000 7f6a563ff700 1 -- 172.21.15.84:0/155978006 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a500cafc0 con 0x7f6a500c6fe0 2023-07-14T11:14:00.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.320+0000 7f6a4cff9700 1 -- 172.21.15.84:0/155978006 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a4001f070 con 0x7f6a500c6fe0 2023-07-14T11:14:00.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.320+0000 7f6a4cff9700 1 -- 172.21.15.84:0/155978006 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a400038e0 con 0x7f6a500c6fe0 2023-07-14T11:14:00.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.320+0000 7f6a563ff700 1 -- 172.21.15.84:0/155978006 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a50159630 con 0x7f6a500c6fe0 2023-07-14T11:14:00.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.321+0000 7f6a563ff700 1 -- 172.21.15.84:0/155978006 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a5015d6b0 con 0x7f6a500c6fe0 2023-07-14T11:14:00.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.322+0000 7f6a4cff9700 1 -- 172.21.15.84:0/155978006 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6a40021030 con 0x7f6a500c6fe0 2023-07-14T11:14:00.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.323+0000 7f6a4cff9700 1 --2- 172.21.15.84:0/155978006 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6a3c06ad10 0x7f6a3c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:00.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.323+0000 7f6a4cff9700 1 -- 172.21.15.84:0/155978006 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f6a4008a850 con 0x7f6a500c6fe0 2023-07-14T11:14:00.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.323+0000 7f6a4f7fe700 1 --2- 172.21.15.84:0/155978006 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6a3c06ad10 0x7f6a3c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:00.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.324+0000 7f6a4f7fe700 1 --2- 172.21.15.84:0/155978006 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6a3c06ad10 0x7f6a3c06d1c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6a500cd4c0 tx=0x7f6a44009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:00.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.328+0000 7f6a4cff9700 1 -- 172.21.15.84:0/155978006 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f6a5015d6b0 con 0x7f6a500c6fe0 2023-07-14T11:14:00.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.520+0000 7f6a563ff700 1 -- 172.21.15.84:0/155978006 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6a5015da90 con 0x7f6a500c6fe0 2023-07-14T11:14:00.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.521+0000 7f6a4cff9700 1 -- 172.21.15.84:0/155978006 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6a5015da90 con 0x7f6a500c6fe0 2023-07-14T11:14:00.523 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-07-14T11:14:00.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.523+0000 7f6a563ff700 1 -- 172.21.15.84:0/155978006 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6a3c06ad10 msgr2=0x7f6a3c06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:00.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.523+0000 7f6a563ff700 1 --2- 172.21.15.84:0/155978006 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6a3c06ad10 0x7f6a3c06d1c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6a500cd4c0 tx=0x7f6a44009210 comp rx=0 tx=0).stop 2023-07-14T11:14:00.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.523+0000 7f6a563ff700 1 -- 172.21.15.84:0/155978006 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a500c6fe0 msgr2=0x7f6a500cc660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:00.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.523+0000 7f6a563ff700 1 --2- 172.21.15.84:0/155978006 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a500c6fe0 0x7f6a500cc660 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f6a40009c40 tx=0x7f6a40004750 comp rx=0 tx=0).stop 2023-07-14T11:14:00.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.523+0000 7f6a563ff700 1 -- 172.21.15.84:0/155978006 shutdown_connections 2023-07-14T11:14:00.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.523+0000 7f6a563ff700 1 --2- 172.21.15.84:0/155978006 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a5015c860 0x7f6a501590f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:00.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.523+0000 7f6a563ff700 1 --2- 172.21.15.84:0/155978006 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a500c6fe0 0x7f6a500cc660 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:00.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.523+0000 7f6a563ff700 1 --2- 172.21.15.84:0/155978006 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6a3c06ad10 0x7f6a3c06d1c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:00.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.523+0000 7f6a563ff700 1 --2- 172.21.15.84:0/155978006 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a500cf2a0 0x7f6a500ca020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:00.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.523+0000 7f6a563ff700 1 -- 172.21.15.84:0/155978006 >> 172.21.15.84:0/155978006 conn(0x7f6a50065bd0 msgr2=0x7f6a500c7a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:00.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.523+0000 7f6a563ff700 1 -- 172.21.15.84:0/155978006 shutdown_connections 2023-07-14T11:14:00.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.523+0000 7f6a563ff700 1 -- 172.21.15.84:0/155978006 wait complete. 2023-07-14T11:14:00.543 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T11:14:00.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.739+0000 7f6c5e7ff700 1 Processor -- start 2023-07-14T11:14:00.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.739+0000 7f6c5e7ff700 1 -- start start 2023-07-14T11:14:00.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.740+0000 7f6c5e7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c580b8a60 0x7f6c580b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:00.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.740+0000 7f6c5e7ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6c580b4530 0x7f6c580d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:00.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.740+0000 7f6c5e7ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c580b8e30 con 0x7f6c580d1050 2023-07-14T11:14:00.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.740+0000 7f6c5e7ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c580d14d0 con 0x7f6c580b4530 2023-07-14T11:14:00.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.740+0000 7f6c5e7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c580b1e30 con 0x7f6c580b8a60 2023-07-14T11:14:00.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.740+0000 7f6c4ffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6c580b4530 0x7f6c580d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:00.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.740+0000 7f6c4ffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6c580b4530 0x7f6c580d0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55448/0 (socket says 172.21.15.84:55448) 2023-07-14T11:14:00.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.740+0000 7f6c4ffff700 1 -- 172.21.15.84:0/300232718 learned_addr learned my addr 172.21.15.84:0/300232718 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:00.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.740+0000 7f6c57fff700 1 --2- 172.21.15.84:0/300232718 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c580b8a60 0x7f6c580b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:00.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.740+0000 7f6c4ffff700 1 -- 172.21.15.84:0/300232718 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c580b8a60 msgr2=0x7f6c580b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:00.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.741+0000 7f6c4ffff700 1 --2- 172.21.15.84:0/300232718 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c580b8a60 0x7f6c580b3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:00.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.741+0000 7f6c4ffff700 1 -- 172.21.15.84:0/300232718 >> v1:172.21.15.179:6789/0 conn(0x7f6c580d1050 legacy=0x7f6c580b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:00.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.741+0000 7f6c4ffff700 1 -- 172.21.15.84:0/300232718 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c580afaa0 con 0x7f6c580b4530 2023-07-14T11:14:00.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.741+0000 7f6c57fff700 1 --2- 172.21.15.84:0/300232718 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c580b8a60 0x7f6c580b3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:14:00.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.741+0000 7f6c4ffff700 1 --2- 172.21.15.84:0/300232718 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c580b4530 0x7f6c580d0b10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6c400098f0 tx=0x7f6c40009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d30c90f8efd4bbf3 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:00.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.741+0000 7f6c577fe700 1 -- 172.21.15.84:0/300232718 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4000b8a0 con 0x7f6c580b4530 2023-07-14T11:14:00.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.741+0000 7f6c577fe700 1 -- 172.21.15.84:0/300232718 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c4000ba00 con 0x7f6c580b4530 2023-07-14T11:14:00.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.741+0000 7f6c577fe700 1 -- 172.21.15.84:0/300232718 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4000bd90 con 0x7f6c580b4530 2023-07-14T11:14:00.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.742+0000 7f6c5e7ff700 1 -- 172.21.15.84:0/300232718 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c580b4530 msgr2=0x7f6c580d0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:00.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.742+0000 7f6c5e7ff700 1 --2- 172.21.15.84:0/300232718 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c580b4530 0x7f6c580d0b10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6c400098f0 tx=0x7f6c40009c00 comp rx=0 tx=0).stop 2023-07-14T11:14:00.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.742+0000 7f6c5e7ff700 1 -- 172.21.15.84:0/300232718 shutdown_connections 2023-07-14T11:14:00.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.742+0000 7f6c5e7ff700 1 --2- 172.21.15.84:0/300232718 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c580b8a60 0x7f6c580b3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:00.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.742+0000 7f6c5e7ff700 1 --2- 172.21.15.84:0/300232718 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c580b4530 0x7f6c580d0b10 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:00.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.742+0000 7f6c5e7ff700 1 -- 172.21.15.84:0/300232718 >> 172.21.15.84:0/300232718 conn(0x7f6c5809c1b0 msgr2=0x7f6c580d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:00.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.742+0000 7f6c5e7ff700 1 -- 172.21.15.84:0/300232718 shutdown_connections 2023-07-14T11:14:00.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.742+0000 7f6c5e7ff700 1 -- 172.21.15.84:0/300232718 wait complete. 2023-07-14T11:14:00.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.743+0000 7f6c5e7ff700 1 Processor -- start 2023-07-14T11:14:00.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.744+0000 7f6c5e7ff700 1 -- start start 2023-07-14T11:14:00.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.744+0000 7f6c5e7ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c580b4530 0x7f6c58158d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:00.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.744+0000 7f6c5e7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c580b8a60 0x7f6c580d0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:00.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.744+0000 7f6c5e7ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c580d1050 0x7f6c5815f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:00.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.744+0000 7f6c5e7ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5815f080 con 0x7f6c580b4530 2023-07-14T11:14:00.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.744+0000 7f6c5e7ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5815e400 con 0x7f6c580d1050 2023-07-14T11:14:00.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.745+0000 7f6c5e7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5815e6e0 con 0x7f6c580b8a60 2023-07-14T11:14:00.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.745+0000 7f6c57fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c580b4530 0x7f6c58158d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:00.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.745+0000 7f6c57fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c580b4530 0x7f6c58158d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55464/0 (socket says 172.21.15.84:55464) 2023-07-14T11:14:00.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.745+0000 7f6c57fff700 1 -- 172.21.15.84:0/180922545 learned_addr learned my addr 172.21.15.84:0/180922545 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:00.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.745+0000 7f6c4ffff700 1 --2- 172.21.15.84:0/180922545 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c580b8a60 0x7f6c580d0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:00.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.745+0000 7f6c5cd9c700 1 --2- 172.21.15.84:0/180922545 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c580d1050 0x7f6c5815f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:00.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.745+0000 7f6c57fff700 1 -- 172.21.15.84:0/180922545 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c580b8a60 msgr2=0x7f6c580d0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:00.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.745+0000 7f6c57fff700 1 --2- 172.21.15.84:0/180922545 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c580b8a60 0x7f6c580d0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:00.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.745+0000 7f6c57fff700 1 -- 172.21.15.84:0/180922545 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c580d1050 msgr2=0x7f6c5815f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:00.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.745+0000 7f6c57fff700 1 --2- 172.21.15.84:0/180922545 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c580d1050 0x7f6c5815f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:00.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.745+0000 7f6c57fff700 1 -- 172.21.15.84:0/180922545 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c40009550 con 0x7f6c580b4530 2023-07-14T11:14:00.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.745+0000 7f6c57fff700 1 --2- 172.21.15.84:0/180922545 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c580b4530 0x7f6c58158d10 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6c4800e810 tx=0x7f6c4800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:00.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.746+0000 7f6c557fa700 1 -- 172.21.15.84:0/180922545 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c48013610 con 0x7f6c580b4530 2023-07-14T11:14:00.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.746+0000 7f6c557fa700 1 -- 172.21.15.84:0/180922545 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c48013770 con 0x7f6c580b4530 2023-07-14T11:14:00.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.746+0000 7f6c5e7ff700 1 -- 172.21.15.84:0/180922545 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c5815e9c0 con 0x7f6c580b4530 2023-07-14T11:14:00.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.746+0000 7f6c557fa700 1 -- 172.21.15.84:0/180922545 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c48013b20 con 0x7f6c580b4530 2023-07-14T11:14:00.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.746+0000 7f6c5e7ff700 1 -- 172.21.15.84:0/180922545 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c58159250 con 0x7f6c580b4530 2023-07-14T11:14:00.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.747+0000 7f6c5e7ff700 1 -- 172.21.15.84:0/180922545 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c58074350 con 0x7f6c580b4530 2023-07-14T11:14:00.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.748+0000 7f6c557fa700 1 -- 172.21.15.84:0/180922545 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6c48013c80 con 0x7f6c580b4530 2023-07-14T11:14:00.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.748+0000 7f6c557fa700 1 --2- 172.21.15.84:0/180922545 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6c3806ace0 0x7f6c3806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:00.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.749+0000 7f6c557fa700 1 -- 172.21.15.84:0/180922545 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f6c480890e0 con 0x7f6c580b4530 2023-07-14T11:14:00.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.749+0000 7f6c4ffff700 1 --2- 172.21.15.84:0/180922545 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6c3806ace0 0x7f6c3806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:00.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.749+0000 7f6c4ffff700 1 --2- 172.21.15.84:0/180922545 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6c3806ace0 0x7f6c3806d190 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6c40009c40 tx=0x7f6c40008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:00.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.753+0000 7f6c557fa700 1 -- 172.21.15.84:0/180922545 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f6c48057be0 con 0x7f6c580b4530 2023-07-14T11:14:00.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.949+0000 7f6c5e7ff700 1 -- 172.21.15.84:0/180922545 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6c580b7d10 con 0x7f6c580b4530 2023-07-14T11:14:00.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.949+0000 7f6c557fa700 1 -- 172.21.15.84:0/180922545 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6c48057770 con 0x7f6c580b4530 2023-07-14T11:14:00.952 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-07-14T11:14:00.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.951+0000 7f6c5e7ff700 1 -- 172.21.15.84:0/180922545 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6c3806ace0 msgr2=0x7f6c3806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:00.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.951+0000 7f6c5e7ff700 1 --2- 172.21.15.84:0/180922545 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6c3806ace0 0x7f6c3806d190 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6c40009c40 tx=0x7f6c40008030 comp rx=0 tx=0).stop 2023-07-14T11:14:00.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.951+0000 7f6c5e7ff700 1 -- 172.21.15.84:0/180922545 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c580b4530 msgr2=0x7f6c58158d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:00.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.951+0000 7f6c5e7ff700 1 --2- 172.21.15.84:0/180922545 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c580b4530 0x7f6c58158d10 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6c4800e810 tx=0x7f6c4800eb20 comp rx=0 tx=0).stop 2023-07-14T11:14:00.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.952+0000 7f6c5e7ff700 1 -- 172.21.15.84:0/180922545 shutdown_connections 2023-07-14T11:14:00.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.952+0000 7f6c5e7ff700 1 --2- 172.21.15.84:0/180922545 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c580d1050 0x7f6c5815f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:00.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.952+0000 7f6c5e7ff700 1 --2- 172.21.15.84:0/180922545 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c580b4530 0x7f6c58158d10 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:00.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.952+0000 7f6c5e7ff700 1 --2- 172.21.15.84:0/180922545 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6c3806ace0 0x7f6c3806d190 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:00.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.952+0000 7f6c5e7ff700 1 --2- 172.21.15.84:0/180922545 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c580b8a60 0x7f6c580d0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:00.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.952+0000 7f6c5e7ff700 1 -- 172.21.15.84:0/180922545 >> 172.21.15.84:0/180922545 conn(0x7f6c5809c1b0 msgr2=0x7f6c5815b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:00.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.952+0000 7f6c5e7ff700 1 -- 172.21.15.84:0/180922545 shutdown_connections 2023-07-14T11:14:00.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:00.952+0000 7f6c5e7ff700 1 -- 172.21.15.84:0/180922545 wait complete. 2023-07-14T11:14:00.971 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T11:14:01.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.168+0000 7f9c563ff700 1 Processor -- start 2023-07-14T11:14:01.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.169+0000 7f9c563ff700 1 -- start start 2023-07-14T11:14:01.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.170+0000 7f9c563ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9c5015d9d0 0x7f9c5006b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:01.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.170+0000 7f9c563ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9c50071170 0x7f9c500715f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:01.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.170+0000 7f9c563ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c50071b30 con 0x7f9c5006c9f0 2023-07-14T11:14:01.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.170+0000 7f9c563ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c5006c4e0 con 0x7f9c50071170 2023-07-14T11:14:01.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.170+0000 7f9c563ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c500b2020 con 0x7f9c5015d9d0 2023-07-14T11:14:01.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.170+0000 7f9c47fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f9c5006c9f0 0x7f9c500b1910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55572/0 (socket says 172.21.15.84:55572) 2023-07-14T11:14:01.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.170+0000 7f9c47fff700 1 -- 172.21.15.84:0/3259374589 learned_addr learned my addr 172.21.15.84:0/3259374589 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:14:01.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.170+0000 7f9c5499c700 1 --2- 172.21.15.84:0/3259374589 >> v2:172.21.15.84:3300/0 conn(0x7f9c50071170 0x7f9c500715f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:01.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.170+0000 7f9c4f7fe700 1 -- 172.21.15.84:0/3259374589 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2006155445 0 0) 0x7f9c50071b30 con 0x7f9c5006c9f0 2023-07-14T11:14:01.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.170+0000 7f9c4f7fe700 1 -- 172.21.15.84:0/3259374589 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c3c0035b0 con 0x7f9c5006c9f0 2023-07-14T11:14:01.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.170+0000 7f9c4ffff700 1 --2- 172.21.15.84:0/3259374589 >> v2:172.21.15.179:3300/0 conn(0x7f9c5015d9d0 0x7f9c5006b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:01.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.171+0000 7f9c5499c700 1 -- 172.21.15.84:0/3259374589 >> v2:172.21.15.179:3300/0 conn(0x7f9c5015d9d0 msgr2=0x7f9c5006b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:01.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.171+0000 7f9c5499c700 1 --2- 172.21.15.84:0/3259374589 >> v2:172.21.15.179:3300/0 conn(0x7f9c5015d9d0 0x7f9c5006b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:01.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.171+0000 7f9c5499c700 1 -- 172.21.15.84:0/3259374589 >> v1:172.21.15.84:6789/0 conn(0x7f9c5006c9f0 legacy=0x7f9c500b1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:01.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.171+0000 7f9c5499c700 1 -- 172.21.15.84:0/3259374589 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c5015dda0 con 0x7f9c50071170 2023-07-14T11:14:01.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.171+0000 7f9c5499c700 1 --2- 172.21.15.84:0/3259374589 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c50071170 0x7f9c500715f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9c5006dcc0 tx=0x7f9c4800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=779ca4aabb8cdd5e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:01.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.171+0000 7f9c4f7fe700 1 -- 172.21.15.84:0/3259374589 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c4800e070 con 0x7f9c50071170 2023-07-14T11:14:01.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.171+0000 7f9c4f7fe700 1 -- 172.21.15.84:0/3259374589 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c4800bb20 con 0x7f9c50071170 2023-07-14T11:14:01.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.171+0000 7f9c4f7fe700 1 -- 172.21.15.84:0/3259374589 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c48012430 con 0x7f9c50071170 2023-07-14T11:14:01.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.172+0000 7f9c563ff700 1 -- 172.21.15.84:0/3259374589 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c50071170 msgr2=0x7f9c500715f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:01.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.172+0000 7f9c563ff700 1 --2- 172.21.15.84:0/3259374589 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c50071170 0x7f9c500715f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9c5006dcc0 tx=0x7f9c4800b330 comp rx=0 tx=0).stop 2023-07-14T11:14:01.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.172+0000 7f9c563ff700 1 -- 172.21.15.84:0/3259374589 shutdown_connections 2023-07-14T11:14:01.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.172+0000 7f9c563ff700 1 --2- 172.21.15.84:0/3259374589 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c50071170 0x7f9c500715f0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:01.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.172+0000 7f9c563ff700 1 --2- 172.21.15.84:0/3259374589 >> v2:172.21.15.179:3300/0 conn(0x7f9c5015d9d0 0x7f9c5006b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:01.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.172+0000 7f9c563ff700 1 -- 172.21.15.84:0/3259374589 >> 172.21.15.84:0/3259374589 conn(0x7f9c500b05d0 msgr2=0x7f9c500b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:01.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.172+0000 7f9c563ff700 1 -- 172.21.15.84:0/3259374589 shutdown_connections 2023-07-14T11:14:01.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.172+0000 7f9c563ff700 1 -- 172.21.15.84:0/3259374589 wait complete. 2023-07-14T11:14:01.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.173+0000 7f9c563ff700 1 Processor -- start 2023-07-14T11:14:01.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.174+0000 7f9c563ff700 1 -- start start 2023-07-14T11:14:01.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.175+0000 7f9c563ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c5006c9f0 0x7f9c500c4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:01.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.175+0000 7f9c563ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c50071170 0x7f9c501e4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:01.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.175+0000 7f9c563ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c5015d9d0 0x7f9c5014fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:01.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.175+0000 7f9c563ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c500c4f90 con 0x7f9c5015d9d0 2023-07-14T11:14:01.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.175+0000 7f9c563ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c500c33e0 con 0x7f9c5006c9f0 2023-07-14T11:14:01.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.175+0000 7f9c563ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c500c36c0 con 0x7f9c50071170 2023-07-14T11:14:01.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.175+0000 7f9c5499c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c5015d9d0 0x7f9c5014fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:01.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.175+0000 7f9c4ffff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c5006c9f0 0x7f9c500c4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:01.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.175+0000 7f9c5499c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c5015d9d0 0x7f9c5014fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55488/0 (socket says 172.21.15.84:55488) 2023-07-14T11:14:01.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.175+0000 7f9c5499c700 1 -- 172.21.15.84:0/448465543 learned_addr learned my addr 172.21.15.84:0/448465543 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:01.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.175+0000 7f9c47fff700 1 --2- 172.21.15.84:0/448465543 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c50071170 0x7f9c501e4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:01.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.175+0000 7f9c5499c700 1 -- 172.21.15.84:0/448465543 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c50071170 msgr2=0x7f9c501e4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:01.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.175+0000 7f9c5499c700 1 --2- 172.21.15.84:0/448465543 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c50071170 0x7f9c501e4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:01.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.175+0000 7f9c5499c700 1 -- 172.21.15.84:0/448465543 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c5006c9f0 msgr2=0x7f9c500c4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:01.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.175+0000 7f9c5499c700 1 --2- 172.21.15.84:0/448465543 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c5006c9f0 0x7f9c500c4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:01.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.175+0000 7f9c5499c700 1 -- 172.21.15.84:0/448465543 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c48009a70 con 0x7f9c5015d9d0 2023-07-14T11:14:01.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.176+0000 7f9c5499c700 1 --2- 172.21.15.84:0/448465543 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c5015d9d0 0x7f9c5014fb40 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f9c48014040 tx=0x7f9c48004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:01.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.176+0000 7f9c4d7fa700 1 -- 172.21.15.84:0/448465543 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c48012430 con 0x7f9c5015d9d0 2023-07-14T11:14:01.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.176+0000 7f9c4d7fa700 1 -- 172.21.15.84:0/448465543 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c48020070 con 0x7f9c5015d9d0 2023-07-14T11:14:01.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.176+0000 7f9c4d7fa700 1 -- 172.21.15.84:0/448465543 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c480098f0 con 0x7f9c5015d9d0 2023-07-14T11:14:01.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.176+0000 7f9c563ff700 1 -- 172.21.15.84:0/448465543 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c500c39a0 con 0x7f9c5015d9d0 2023-07-14T11:14:01.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.176+0000 7f9c563ff700 1 -- 172.21.15.84:0/448465543 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c500c3f60 con 0x7f9c5015d9d0 2023-07-14T11:14:01.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.177+0000 7f9c563ff700 1 -- 172.21.15.84:0/448465543 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c50074350 con 0x7f9c5015d9d0 2023-07-14T11:14:01.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.178+0000 7f9c4d7fa700 1 -- 172.21.15.84:0/448465543 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9c48004040 con 0x7f9c5015d9d0 2023-07-14T11:14:01.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.179+0000 7f9c4d7fa700 1 --2- 172.21.15.84:0/448465543 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f9c3006ad10 0x7f9c3006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:01.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.179+0000 7f9c4d7fa700 1 -- 172.21.15.84:0/448465543 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f9c48022070 con 0x7f9c5015d9d0 2023-07-14T11:14:01.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.179+0000 7f9c4ffff700 1 --2- 172.21.15.84:0/448465543 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f9c3006ad10 0x7f9c3006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:01.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.180+0000 7f9c4ffff700 1 --2- 172.21.15.84:0/448465543 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f9c3006ad10 0x7f9c3006d1c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9c40006b20 tx=0x7f9c40008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:01.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.183+0000 7f9c4d7fa700 1 -- 172.21.15.84:0/448465543 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f9c48056130 con 0x7f9c5015d9d0 2023-07-14T11:14:01.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.375+0000 7f9c563ff700 1 -- 172.21.15.84:0/448465543 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9c5006d9f0 con 0x7f9c5015d9d0 2023-07-14T11:14:01.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.376+0000 7f9c4d7fa700 1 -- 172.21.15.84:0/448465543 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9c4802c0a0 con 0x7f9c5015d9d0 2023-07-14T11:14:01.378 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-07-14T11:14:01.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.378+0000 7f9c563ff700 1 -- 172.21.15.84:0/448465543 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f9c3006ad10 msgr2=0x7f9c3006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:01.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.378+0000 7f9c563ff700 1 --2- 172.21.15.84:0/448465543 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f9c3006ad10 0x7f9c3006d1c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9c40006b20 tx=0x7f9c40008040 comp rx=0 tx=0).stop 2023-07-14T11:14:01.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.378+0000 7f9c563ff700 1 -- 172.21.15.84:0/448465543 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c5015d9d0 msgr2=0x7f9c5014fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:01.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.378+0000 7f9c563ff700 1 --2- 172.21.15.84:0/448465543 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c5015d9d0 0x7f9c5014fb40 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f9c48014040 tx=0x7f9c48004ad0 comp rx=0 tx=0).stop 2023-07-14T11:14:01.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.378+0000 7f9c563ff700 1 -- 172.21.15.84:0/448465543 shutdown_connections 2023-07-14T11:14:01.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.378+0000 7f9c563ff700 1 --2- 172.21.15.84:0/448465543 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c5015d9d0 0x7f9c5014fb40 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:01.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.378+0000 7f9c563ff700 1 --2- 172.21.15.84:0/448465543 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c5006c9f0 0x7f9c500c4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:01.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.378+0000 7f9c563ff700 1 --2- 172.21.15.84:0/448465543 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f9c3006ad10 0x7f9c3006d1c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:01.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.378+0000 7f9c563ff700 1 --2- 172.21.15.84:0/448465543 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c50071170 0x7f9c501e4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:01.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.378+0000 7f9c563ff700 1 -- 172.21.15.84:0/448465543 >> 172.21.15.84:0/448465543 conn(0x7f9c500b05d0 msgr2=0x7f9c5006b640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:01.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.378+0000 7f9c563ff700 1 -- 172.21.15.84:0/448465543 shutdown_connections 2023-07-14T11:14:01.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.378+0000 7f9c563ff700 1 -- 172.21.15.84:0/448465543 wait complete. 2023-07-14T11:14:01.398 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T11:14:01.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.593+0000 7fd5117ff700 1 Processor -- start 2023-07-14T11:14:01.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.593+0000 7fd5117ff700 1 -- start start 2023-07-14T11:14:01.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.594+0000 7fd5117ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd50c0d0b10 0x7fd50c0d0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:01.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.595+0000 7fd5117ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd50c0d14a0 con 0x7fd50c0b8a60 2023-07-14T11:14:01.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.595+0000 7fd5117ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd50c0b8e30 con 0x7fd50c0b0e20 2023-07-14T11:14:01.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.595+0000 7fd5117ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd50c0afaa0 con 0x7fd50c0d0b10 2023-07-14T11:14:01.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.595+0000 7fd50affd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fd50c0b8a60 0x7fd50c0b3ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55584/0 (socket says 172.21.15.84:55584) 2023-07-14T11:14:01.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.595+0000 7fd50affd700 1 -- 172.21.15.84:0/1663791504 learned_addr learned my addr 172.21.15.84:0/1663791504 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:14:01.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.595+0000 7fd509ffb700 1 -- 172.21.15.84:0/1663791504 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2051042063 0 0) 0x7fd4fc001110 con 0x7fd50c0b8a60 2023-07-14T11:14:01.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.595+0000 7fd509ffb700 1 -- 172.21.15.84:0/1663791504 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4f40035b0 con 0x7fd50c0b8a60 2023-07-14T11:14:01.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.595+0000 7fd50a7fc700 1 --2- 172.21.15.84:0/1663791504 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd50c0d0b10 0x7fd50c0d0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:01.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.595+0000 7fd509ffb700 1 -- 172.21.15.84:0/1663791504 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1347145157 0 0) 0x7fd4f40035b0 con 0x7fd50c0b8a60 2023-07-14T11:14:01.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.596+0000 7fd509ffb700 1 -- 172.21.15.84:0/1663791504 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd50c0d0b10 msgr2=0x7fd50c0d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:01.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.596+0000 7fd509ffb700 1 --2- 172.21.15.84:0/1663791504 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd50c0d0b10 0x7fd50c0d0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:01.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.596+0000 7fd509ffb700 1 -- 172.21.15.84:0/1663791504 >> v1:172.21.15.179:6789/0 conn(0x7fd50c0b0e20 legacy=0x7fd50c0b12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:01.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.596+0000 7fd509ffb700 1 -- 172.21.15.84:0/1663791504 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd50c0afd80 con 0x7fd50c0b8a60 2023-07-14T11:14:01.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.596+0000 7fd509ffb700 1 -- 172.21.15.84:0/1663791504 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7fd4fc001800 con 0x7fd50c0b8a60 2023-07-14T11:14:01.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.596+0000 7fd509ffb700 1 -- 172.21.15.84:0/1663791504 >> v1:172.21.15.84:6789/0 conn(0x7fd50c0b8a60 legacy=0x7fd50c0b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:01.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.596+0000 7fd509ffb700 1 --2- 172.21.15.84:0/1663791504 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4f4003a30 0x7fd4f4003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:01.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.596+0000 7fd509ffb700 1 --2- 172.21.15.84:0/1663791504 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd50c0d0b10 0x7fd4f4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:01.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.596+0000 7fd509ffb700 1 --2- 172.21.15.84:0/1663791504 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4f4004d90 0x7fd4f4005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:01.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.596+0000 7fd509ffb700 1 -- 172.21.15.84:0/1663791504 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd50c0afaa0 con 0x7fd4f4003a30 2023-07-14T11:14:01.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.596+0000 7fd509ffb700 1 -- 172.21.15.84:0/1663791504 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4f400bb50 con 0x7fd4f4004d90 2023-07-14T11:14:01.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.596+0000 7fd509ffb700 1 -- 172.21.15.84:0/1663791504 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4f400bce0 con 0x7fd50c0d0b10 2023-07-14T11:14:01.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.596+0000 7fd50affd700 1 --2- 172.21.15.84:0/1663791504 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4f4003a30 0x7fd4f4003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:01.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.596+0000 7fd50a7fc700 1 --2- 172.21.15.84:0/1663791504 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd50c0d0b10 0x7fd4f4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:01.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.596+0000 7fd50b7fe700 1 --2- 172.21.15.84:0/1663791504 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4f4004d90 0x7fd4f4005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:01.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.596+0000 7fd50affd700 1 -- 172.21.15.84:0/1663791504 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd50c0d0b10 msgr2=0x7fd4f4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:01.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.596+0000 7fd50affd700 1 --2- 172.21.15.84:0/1663791504 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd50c0d0b10 0x7fd4f4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:01.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.596+0000 7fd50affd700 1 -- 172.21.15.84:0/1663791504 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4f4004d90 msgr2=0x7fd4f4005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:01.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.596+0000 7fd50affd700 1 --2- 172.21.15.84:0/1663791504 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4f4004d90 0x7fd4f4005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:01.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.596+0000 7fd50affd700 1 -- 172.21.15.84:0/1663791504 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4f40035b0 con 0x7fd4f4003a30 2023-07-14T11:14:01.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.596+0000 7fd50b7fe700 1 --2- 172.21.15.84:0/1663791504 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4f4004d90 0x7fd4f4005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:14:01.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.597+0000 7fd50affd700 1 --2- 172.21.15.84:0/1663791504 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4f4003a30 0x7fd4f4003e40 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc00c240 tx=0x7fd4f4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51542c0d94e0fe6c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:01.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.597+0000 7fd509ffb700 1 -- 172.21.15.84:0/1663791504 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4fc007db0 con 0x7fd4f4003a30 2023-07-14T11:14:01.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.597+0000 7fd509ffb700 1 -- 172.21.15.84:0/1663791504 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4fc00ce00 con 0x7fd4f4003a30 2023-07-14T11:14:01.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.597+0000 7fd509ffb700 1 -- 172.21.15.84:0/1663791504 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4fc005ba0 con 0x7fd4f4003a30 2023-07-14T11:14:01.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.597+0000 7fd5117ff700 1 -- 172.21.15.84:0/1663791504 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4f4003a30 msgr2=0x7fd4f4003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:01.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.597+0000 7fd5117ff700 1 --2- 172.21.15.84:0/1663791504 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4f4003a30 0x7fd4f4003e40 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc00c240 tx=0x7fd4f4005880 comp rx=0 tx=0).stop 2023-07-14T11:14:01.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.597+0000 7fd50b7fe700 1 -- 172.21.15.84:0/1663791504 reap_dead start 2023-07-14T11:14:01.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.597+0000 7fd5117ff700 1 -- 172.21.15.84:0/1663791504 shutdown_connections 2023-07-14T11:14:01.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.597+0000 7fd5117ff700 1 -- 172.21.15.84:0/1663791504 >> 172.21.15.84:0/1663791504 conn(0x7fd50c09c1b0 msgr2=0x7fd50c0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:01.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.598+0000 7fd5117ff700 1 -- 172.21.15.84:0/1663791504 shutdown_connections 2023-07-14T11:14:01.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.598+0000 7fd5117ff700 1 -- 172.21.15.84:0/1663791504 wait complete. 2023-07-14T11:14:01.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.599+0000 7fd5117ff700 1 Processor -- start 2023-07-14T11:14:01.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.599+0000 7fd5117ff700 1 -- start start 2023-07-14T11:14:01.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.600+0000 7fd5117ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4f4003a30 0x7fd50c0ccf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:01.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.600+0000 7fd5117ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd50c0cc0f0 0x7fd50c151cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:01.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.600+0000 7fd5117ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd50c0cc560 0x7fd50c152230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:01.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.600+0000 7fd5117ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd50c0cd8d0 con 0x7fd50c0cc560 2023-07-14T11:14:01.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.600+0000 7fd5117ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd50c15f870 con 0x7fd50c0cc0f0 2023-07-14T11:14:01.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.600+0000 7fd5117ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd50c0cdb20 con 0x7fd4f4003a30 2023-07-14T11:14:01.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.601+0000 7fd50b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd50c0cc560 0x7fd50c152230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:01.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.601+0000 7fd50b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd50c0cc560 0x7fd50c152230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55506/0 (socket says 172.21.15.84:55506) 2023-07-14T11:14:01.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.601+0000 7fd50b7fe700 1 -- 172.21.15.84:0/4153379993 learned_addr learned my addr 172.21.15.84:0/4153379993 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:01.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.601+0000 7fd50affd700 1 --2- 172.21.15.84:0/4153379993 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4f4003a30 0x7fd50c0ccf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:01.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.601+0000 7fd50a7fc700 1 --2- 172.21.15.84:0/4153379993 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd50c0cc0f0 0x7fd50c151cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:01.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.601+0000 7fd50b7fe700 1 -- 172.21.15.84:0/4153379993 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4f4003a30 msgr2=0x7fd50c0ccf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:01.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.601+0000 7fd50b7fe700 1 --2- 172.21.15.84:0/4153379993 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4f4003a30 0x7fd50c0ccf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:01.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.601+0000 7fd50b7fe700 1 -- 172.21.15.84:0/4153379993 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd50c0cc0f0 msgr2=0x7fd50c151cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:01.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.601+0000 7fd50b7fe700 1 --2- 172.21.15.84:0/4153379993 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd50c0cc0f0 0x7fd50c151cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:01.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.601+0000 7fd50b7fe700 1 -- 172.21.15.84:0/4153379993 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd50c0cde00 con 0x7fd50c0cc560 2023-07-14T11:14:01.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.601+0000 7fd50affd700 1 --2- 172.21.15.84:0/4153379993 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4f4003a30 0x7fd50c0ccf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:14:01.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.601+0000 7fd50b7fe700 1 --2- 172.21.15.84:0/4153379993 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd50c0cc560 0x7fd50c152230 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd50c09c8e0 tx=0x7fd50400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:01.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.601+0000 7fd4f37fe700 1 -- 172.21.15.84:0/4153379993 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd504003c10 con 0x7fd50c0cc560 2023-07-14T11:14:01.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.601+0000 7fd4f37fe700 1 -- 172.21.15.84:0/4153379993 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd504003d90 con 0x7fd50c0cc560 2023-07-14T11:14:01.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.601+0000 7fd5117ff700 1 -- 172.21.15.84:0/4153379993 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd50c0ce0e0 con 0x7fd50c0cc560 2023-07-14T11:14:01.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.601+0000 7fd4f37fe700 1 -- 172.21.15.84:0/4153379993 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd504005310 con 0x7fd50c0cc560 2023-07-14T11:14:01.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.602+0000 7fd5117ff700 1 -- 172.21.15.84:0/4153379993 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd50c0ce7e0 con 0x7fd50c0cc560 2023-07-14T11:14:01.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.603+0000 7fd5117ff700 1 -- 172.21.15.84:0/4153379993 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd50c0ce2d0 con 0x7fd50c0cc560 2023-07-14T11:14:01.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.604+0000 7fd4f37fe700 1 -- 172.21.15.84:0/4153379993 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd504005470 con 0x7fd50c0cc560 2023-07-14T11:14:01.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.605+0000 7fd4f37fe700 1 --2- 172.21.15.84:0/4153379993 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fd4f806ad10 0x7fd4f806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:01.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.605+0000 7fd4f37fe700 1 -- 172.21.15.84:0/4153379993 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fd5040894d0 con 0x7fd50c0cc560 2023-07-14T11:14:01.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.605+0000 7fd50affd700 1 --2- 172.21.15.84:0/4153379993 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fd4f806ad10 0x7fd4f806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:01.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.606+0000 7fd50affd700 1 --2- 172.21.15.84:0/4153379993 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fd4f806ad10 0x7fd4f806d1c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc001ac0 tx=0x7fd4fc007000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:01.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.610+0000 7fd4f37fe700 1 -- 172.21.15.84:0/4153379993 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fd5040544b0 con 0x7fd50c0cc560 2023-07-14T11:14:01.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.806+0000 7fd5117ff700 1 -- 172.21.15.84:0/4153379993 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd50c074350 con 0x7fd50c0cc560 2023-07-14T11:14:01.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.806+0000 7fd4f37fe700 1 -- 172.21.15.84:0/4153379993 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd504057ad0 con 0x7fd50c0cc560 2023-07-14T11:14:01.808 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-07-14T11:14:01.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.808+0000 7fd5117ff700 1 -- 172.21.15.84:0/4153379993 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fd4f806ad10 msgr2=0x7fd4f806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:01.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.808+0000 7fd5117ff700 1 --2- 172.21.15.84:0/4153379993 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fd4f806ad10 0x7fd4f806d1c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc001ac0 tx=0x7fd4fc007000 comp rx=0 tx=0).stop 2023-07-14T11:14:01.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.808+0000 7fd5117ff700 1 -- 172.21.15.84:0/4153379993 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd50c0cc560 msgr2=0x7fd50c152230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:01.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.808+0000 7fd5117ff700 1 --2- 172.21.15.84:0/4153379993 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd50c0cc560 0x7fd50c152230 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd50c09c8e0 tx=0x7fd50400ee70 comp rx=0 tx=0).stop 2023-07-14T11:14:01.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.808+0000 7fd5117ff700 1 -- 172.21.15.84:0/4153379993 shutdown_connections 2023-07-14T11:14:01.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.808+0000 7fd5117ff700 1 --2- 172.21.15.84:0/4153379993 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fd4f806ad10 0x7fd4f806d1c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:01.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.808+0000 7fd5117ff700 1 --2- 172.21.15.84:0/4153379993 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4f4003a30 0x7fd50c0ccf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:01.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.808+0000 7fd5117ff700 1 --2- 172.21.15.84:0/4153379993 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd50c0cc560 0x7fd50c152230 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:01.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.808+0000 7fd5117ff700 1 --2- 172.21.15.84:0/4153379993 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd50c0cc0f0 0x7fd50c151cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:01.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.808+0000 7fd5117ff700 1 -- 172.21.15.84:0/4153379993 >> 172.21.15.84:0/4153379993 conn(0x7fd50c09c1b0 msgr2=0x7fd50c0b7d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:01.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.809+0000 7fd5117ff700 1 -- 172.21.15.84:0/4153379993 shutdown_connections 2023-07-14T11:14:01.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:01.809+0000 7fd5117ff700 1 -- 172.21.15.84:0/4153379993 wait complete. 2023-07-14T11:14:01.828 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-14T11:14:02.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.026+0000 7f1c389ff700 1 Processor -- start 2023-07-14T11:14:02.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.026+0000 7f1c389ff700 1 -- start start 2023-07-14T11:14:02.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.028+0000 7f1c389ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1c3406f010 0x7f1c34071650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:02.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.028+0000 7f1c389ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c340ce030 0x7f1c34069f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:02.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.028+0000 7f1c389ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c340cdba0 con 0x7f1c3406a470 2023-07-14T11:14:02.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.028+0000 7f1c389ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c3406f3e0 con 0x7f1c3406f010 2023-07-14T11:14:02.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.028+0000 7f1c389ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3406a8f0 con 0x7f1c340ce030 2023-07-14T11:14:02.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.028+0000 7f1c32d9d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f1c3406a470 0x7f1c341601d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55590/0 (socket says 172.21.15.84:55590) 2023-07-14T11:14:02.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.028+0000 7f1c32d9d700 1 -- 172.21.15.84:0/2631414830 learned_addr learned my addr 172.21.15.84:0/2631414830 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:14:02.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.029+0000 7f1c3259c700 1 --2- 172.21.15.84:0/2631414830 >> v2:172.21.15.179:3300/0 conn(0x7f1c3406f010 0x7f1c34071650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:02.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.029+0000 7f1c2bfff700 1 --2- 172.21.15.84:0/2631414830 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c340ce030 0x7f1c34069f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:02.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.029+0000 7f1c31d9b700 1 -- 172.21.15.84:0/2631414830 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3269736790 0 0) 0x7f1c340cdba0 con 0x7f1c3406a470 2023-07-14T11:14:02.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.029+0000 7f1c31d9b700 1 -- 172.21.15.84:0/2631414830 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c200035b0 con 0x7f1c3406a470 2023-07-14T11:14:02.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.029+0000 7f1c3259c700 1 -- 172.21.15.84:0/2631414830 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c340ce030 msgr2=0x7f1c34069f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:02.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.029+0000 7f1c3259c700 1 --2- 172.21.15.84:0/2631414830 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c340ce030 0x7f1c34069f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:02.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.029+0000 7f1c3259c700 1 -- 172.21.15.84:0/2631414830 >> v1:172.21.15.84:6789/0 conn(0x7f1c3406a470 legacy=0x7f1c341601d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:02.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.029+0000 7f1c3259c700 1 -- 172.21.15.84:0/2631414830 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c340cf370 con 0x7f1c3406f010 2023-07-14T11:14:02.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.029+0000 7f1c3259c700 1 --2- 172.21.15.84:0/2631414830 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c3406f010 0x7f1c34071650 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1c24009840 tx=0x7f1c24009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20edb583289925f1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:02.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.030+0000 7f1c31d9b700 1 -- 172.21.15.84:0/2631414830 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c24011830 con 0x7f1c3406f010 2023-07-14T11:14:02.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.030+0000 7f1c31d9b700 1 -- 172.21.15.84:0/2631414830 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c24011990 con 0x7f1c3406f010 2023-07-14T11:14:02.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.030+0000 7f1c31d9b700 1 -- 172.21.15.84:0/2631414830 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c24011d20 con 0x7f1c3406f010 2023-07-14T11:14:02.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.030+0000 7f1c389ff700 1 -- 172.21.15.84:0/2631414830 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c3406f010 msgr2=0x7f1c34071650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:02.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.030+0000 7f1c389ff700 1 --2- 172.21.15.84:0/2631414830 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c3406f010 0x7f1c34071650 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1c24009840 tx=0x7f1c24009b50 comp rx=0 tx=0).stop 2023-07-14T11:14:02.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.030+0000 7f1c389ff700 1 -- 172.21.15.84:0/2631414830 shutdown_connections 2023-07-14T11:14:02.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.030+0000 7f1c389ff700 1 --2- 172.21.15.84:0/2631414830 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c3406f010 0x7f1c34071650 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:02.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.030+0000 7f1c389ff700 1 --2- 172.21.15.84:0/2631414830 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c340ce030 0x7f1c34069f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:02.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.030+0000 7f1c389ff700 1 -- 172.21.15.84:0/2631414830 >> 172.21.15.84:0/2631414830 conn(0x7f1c340cc640 msgr2=0x7f1c340cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:02.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.030+0000 7f1c389ff700 1 -- 172.21.15.84:0/2631414830 shutdown_connections 2023-07-14T11:14:02.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.031+0000 7f1c389ff700 1 -- 172.21.15.84:0/2631414830 wait complete. 2023-07-14T11:14:02.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.033+0000 7f1c389ff700 1 Processor -- start 2023-07-14T11:14:02.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.033+0000 7f1c389ff700 1 -- start start 2023-07-14T11:14:02.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.034+0000 7f1c389ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c3406a470 0x7f1c3415f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:02.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.034+0000 7f1c389ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c3406f010 0x7f1c3415d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:02.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.034+0000 7f1c389ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c340ce030 0x7f1c340c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:02.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.034+0000 7f1c389ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c340c8a50 con 0x7f1c340ce030 2023-07-14T11:14:02.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.034+0000 7f1c389ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3415ab70 con 0x7f1c3406f010 2023-07-14T11:14:02.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.034+0000 7f1c389ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c340c7dd0 con 0x7f1c3406a470 2023-07-14T11:14:02.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.035+0000 7f1c32d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c340ce030 0x7f1c340c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:02.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.035+0000 7f1c32d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c340ce030 0x7f1c340c8e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55514/0 (socket says 172.21.15.84:55514) 2023-07-14T11:14:02.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.035+0000 7f1c32d9d700 1 -- 172.21.15.84:0/2542883973 learned_addr learned my addr 172.21.15.84:0/2542883973 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:02.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.035+0000 7f1c3259c700 1 --2- 172.21.15.84:0/2542883973 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c3406a470 0x7f1c3415f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:02.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.035+0000 7f1c2bfff700 1 --2- 172.21.15.84:0/2542883973 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c3406f010 0x7f1c3415d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:02.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.035+0000 7f1c32d9d700 1 -- 172.21.15.84:0/2542883973 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c3406a470 msgr2=0x7f1c3415f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:02.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.035+0000 7f1c32d9d700 1 --2- 172.21.15.84:0/2542883973 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c3406a470 0x7f1c3415f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:02.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.035+0000 7f1c32d9d700 1 -- 172.21.15.84:0/2542883973 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c3406f010 msgr2=0x7f1c3415d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:02.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.035+0000 7f1c32d9d700 1 --2- 172.21.15.84:0/2542883973 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c3406f010 0x7f1c3415d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:02.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.035+0000 7f1c32d9d700 1 -- 172.21.15.84:0/2542883973 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c240094a0 con 0x7f1c340ce030 2023-07-14T11:14:02.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.035+0000 7f1c3259c700 1 --2- 172.21.15.84:0/2542883973 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c3406a470 0x7f1c3415f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:14:02.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.035+0000 7f1c32d9d700 1 --2- 172.21.15.84:0/2542883973 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c340ce030 0x7f1c340c8e70 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c00cb40 tx=0x7f1c2c00cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:02.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.035+0000 7f1c2affd700 1 -- 172.21.15.84:0/2542883973 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c2c00ab50 con 0x7f1c340ce030 2023-07-14T11:14:02.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.036+0000 7f1c2affd700 1 -- 172.21.15.84:0/2542883973 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c2c00acb0 con 0x7f1c340ce030 2023-07-14T11:14:02.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.036+0000 7f1c2affd700 1 -- 172.21.15.84:0/2542883973 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c2c012620 con 0x7f1c340ce030 2023-07-14T11:14:02.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.036+0000 7f1c389ff700 1 -- 172.21.15.84:0/2542883973 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c340c80b0 con 0x7f1c340ce030 2023-07-14T11:14:02.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.036+0000 7f1c389ff700 1 -- 172.21.15.84:0/2542883973 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c340c8670 con 0x7f1c340ce030 2023-07-14T11:14:02.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.037+0000 7f1c389ff700 1 -- 172.21.15.84:0/2542883973 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c340c8b90 con 0x7f1c340ce030 2023-07-14T11:14:02.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.038+0000 7f1c2affd700 1 -- 172.21.15.84:0/2542883973 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1c2c01b3b0 con 0x7f1c340ce030 2023-07-14T11:14:02.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.039+0000 7f1c2affd700 1 --2- 172.21.15.84:0/2542883973 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1c1406ace0 0x7f1c1406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:02.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.039+0000 7f1c2affd700 1 -- 172.21.15.84:0/2542883973 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f1c2c089320 con 0x7f1c340ce030 2023-07-14T11:14:02.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.039+0000 7f1c3259c700 1 --2- 172.21.15.84:0/2542883973 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1c1406ace0 0x7f1c1406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:02.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.039+0000 7f1c3259c700 1 --2- 172.21.15.84:0/2542883973 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1c1406ace0 0x7f1c1406d190 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1c24009fd0 tx=0x7f1c24008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:02.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.043+0000 7f1c2affd700 1 -- 172.21.15.84:0/2542883973 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f1c340c8b90 con 0x7f1c340ce030 2023-07-14T11:14:02.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.254+0000 7f1c389ff700 1 -- 172.21.15.84:0/2542883973 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f1c340c8b90 con 0x7f1c340ce030 2023-07-14T11:14:02.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.254+0000 7f1c2affd700 1 -- 172.21.15.84:0/2542883973 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1c340c8b90 con 0x7f1c340ce030 2023-07-14T11:14:02.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.256+0000 7f1c389ff700 1 -- 172.21.15.84:0/2542883973 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1c1406ace0 msgr2=0x7f1c1406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:02.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.256+0000 7f1c389ff700 1 --2- 172.21.15.84:0/2542883973 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1c1406ace0 0x7f1c1406d190 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1c24009fd0 tx=0x7f1c24008030 comp rx=0 tx=0).stop 2023-07-14T11:14:02.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.256+0000 7f1c389ff700 1 -- 172.21.15.84:0/2542883973 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c340ce030 msgr2=0x7f1c340c8e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:02.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.256+0000 7f1c389ff700 1 --2- 172.21.15.84:0/2542883973 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c340ce030 0x7f1c340c8e70 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c00cb40 tx=0x7f1c2c00cf00 comp rx=0 tx=0).stop 2023-07-14T11:14:02.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.256+0000 7f1c389ff700 1 -- 172.21.15.84:0/2542883973 shutdown_connections 2023-07-14T11:14:02.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.256+0000 7f1c389ff700 1 --2- 172.21.15.84:0/2542883973 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1c1406ace0 0x7f1c1406d190 secure :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1c24009fd0 tx=0x7f1c24008030 comp rx=0 tx=0).stop 2023-07-14T11:14:02.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.256+0000 7f1c389ff700 1 --2- 172.21.15.84:0/2542883973 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c3406a470 0x7f1c3415f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:02.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.256+0000 7f1c389ff700 1 --2- 172.21.15.84:0/2542883973 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c340ce030 0x7f1c340c8e70 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:02.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.256+0000 7f1c389ff700 1 --2- 172.21.15.84:0/2542883973 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c3406f010 0x7f1c3415d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:02.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.257+0000 7f1c389ff700 1 -- 172.21.15.84:0/2542883973 >> 172.21.15.84:0/2542883973 conn(0x7f1c340cc640 msgr2=0x7f1c3406d7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:02.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.257+0000 7f1c389ff700 1 -- 172.21.15.84:0/2542883973 shutdown_connections 2023-07-14T11:14:02.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.257+0000 7f1c389ff700 1 -- 172.21.15.84:0/2542883973 wait complete. 2023-07-14T11:14:02.261 INFO:teuthology.orchestra.run.smithi084.stderr:listed 0 entries 2023-07-14T11:14:02.276 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-07-14T11:14:02.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:14:02.277 DEBUG:teuthology.orchestra.run.smithi179:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-07-14T11:14:02.373 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi179.front.sepia.ceph.com 2023-07-14T11:14:02.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:14:02.374 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-14T11:14:02.431 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-14T11:14:02.432 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:14:02.478 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-14T11:14:02.478 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:14:02.563 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-14T11:14:02.563 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:14:02.648 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:14:02.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.881+0000 7fa6acfff700 1 Processor -- start 2023-07-14T11:14:02.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.881+0000 7fa6acfff700 1 -- start start 2023-07-14T11:14:02.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.882+0000 7fa6acfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa6a80b5d90 0x7fa6a80b6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:02.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.882+0000 7fa6acfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa6a80d0b10 0x7fa6a80d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:02.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.882+0000 7fa6acfff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6a80b7f50 con 0x7fa6a80b4510 2023-07-14T11:14:02.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.882+0000 7fa6acfff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6a80b48e0 con 0x7fa6a80d0b10 2023-07-14T11:14:02.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.882+0000 7fa6acfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a80d14d0 con 0x7fa6a80b5d90 2023-07-14T11:14:02.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.883+0000 7fa6a6d9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa6a80d0b10 0x7fa6a80d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:02.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.883+0000 7fa6a6d9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa6a80d0b10 0x7fa6a80d0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55526/0 (socket says 172.21.15.84:55526) 2023-07-14T11:14:02.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.883+0000 7fa6a6d9d700 1 -- 172.21.15.84:0/4044523165 learned_addr learned my addr 172.21.15.84:0/4044523165 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:02.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.883+0000 7fa6a5d9b700 1 --2- 172.21.15.84:0/4044523165 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa6a80b5d90 0x7fa6a80b6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:02.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.883+0000 7fa6a6d9d700 1 -- 172.21.15.84:0/4044523165 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa6a80b5d90 msgr2=0x7fa6a80b6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:02.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.883+0000 7fa6a6d9d700 1 --2- 172.21.15.84:0/4044523165 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa6a80b5d90 0x7fa6a80b6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:02.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.883+0000 7fa6a6d9d700 1 -- 172.21.15.84:0/4044523165 >> v1:172.21.15.179:6789/0 conn(0x7fa6a80b4510 legacy=0x7fa6a80cd590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:02.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.883+0000 7fa6a6d9d700 1 -- 172.21.15.84:0/4044523165 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6a80cdca0 con 0x7fa6a80d0b10 2023-07-14T11:14:02.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.883+0000 7fa6a5d9b700 1 --2- 172.21.15.84:0/4044523165 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa6a80b5d90 0x7fa6a80b6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:14:02.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.883+0000 7fa6a6d9d700 1 --2- 172.21.15.84:0/4044523165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6a80d0b10 0x7fa6a80d0f90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa6a0009e50 tx=0x7fa6a000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36133ebefaac9afa server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:02.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.883+0000 7fa6a559a700 1 -- 172.21.15.84:0/4044523165 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a000e070 con 0x7fa6a80d0b10 2023-07-14T11:14:02.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.884+0000 7fa6a559a700 1 -- 172.21.15.84:0/4044523165 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6a0003a20 con 0x7fa6a80d0b10 2023-07-14T11:14:02.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.884+0000 7fa6a559a700 1 -- 172.21.15.84:0/4044523165 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a0003dd0 con 0x7fa6a80d0b10 2023-07-14T11:14:02.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.884+0000 7fa6acfff700 1 -- 172.21.15.84:0/4044523165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6a80d0b10 msgr2=0x7fa6a80d0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:02.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.884+0000 7fa6acfff700 1 --2- 172.21.15.84:0/4044523165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6a80d0b10 0x7fa6a80d0f90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa6a0009e50 tx=0x7fa6a000b330 comp rx=0 tx=0).stop 2023-07-14T11:14:02.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.884+0000 7fa6acfff700 1 -- 172.21.15.84:0/4044523165 shutdown_connections 2023-07-14T11:14:02.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.884+0000 7fa6acfff700 1 --2- 172.21.15.84:0/4044523165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6a80d0b10 0x7fa6a80d0f90 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:02.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.884+0000 7fa6acfff700 1 --2- 172.21.15.84:0/4044523165 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa6a80b5d90 0x7fa6a80b6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:02.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.884+0000 7fa6acfff700 1 -- 172.21.15.84:0/4044523165 >> 172.21.15.84:0/4044523165 conn(0x7fa6a809c1d0 msgr2=0x7fa6a80d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:02.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.884+0000 7fa6acfff700 1 -- 172.21.15.84:0/4044523165 shutdown_connections 2023-07-14T11:14:02.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.884+0000 7fa6acfff700 1 -- 172.21.15.84:0/4044523165 wait complete. 2023-07-14T11:14:02.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.886+0000 7fa6acfff700 1 Processor -- start 2023-07-14T11:14:02.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.886+0000 7fa6acfff700 1 -- start start 2023-07-14T11:14:02.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.887+0000 7fa6acfff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6a80b4510 0x7fa6a80cc140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:02.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.887+0000 7fa6acfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa6a80b5d90 0x7fa6a81f1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:02.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.887+0000 7fa6acfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6a80d0b10 0x7fa6a815f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:02.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.887+0000 7fa6acfff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a81f5800 con 0x7fa6a80d0b10 2023-07-14T11:14:02.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.887+0000 7fa6acfff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a81f2ef0 con 0x7fa6a80b4510 2023-07-14T11:14:02.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.887+0000 7fa6acfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a81f2650 con 0x7fa6a80b5d90 2023-07-14T11:14:02.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.887+0000 7fa6a6d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6a80d0b10 0x7fa6a815f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:02.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.887+0000 7fa6a6d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6a80d0b10 0x7fa6a815f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55530/0 (socket says 172.21.15.84:55530) 2023-07-14T11:14:02.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.887+0000 7fa6a6d9d700 1 -- 172.21.15.84:0/4039461214 learned_addr learned my addr 172.21.15.84:0/4039461214 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:02.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.888+0000 7fa6a5d9b700 1 --2- 172.21.15.84:0/4039461214 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa6a80b5d90 0x7fa6a81f1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:02.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.888+0000 7fa6a6d9d700 1 -- 172.21.15.84:0/4039461214 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa6a80b5d90 msgr2=0x7fa6a81f1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:02.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.888+0000 7fa6a659c700 1 --2- 172.21.15.84:0/4039461214 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6a80b4510 0x7fa6a80cc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:02.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.888+0000 7fa6a6d9d700 1 --2- 172.21.15.84:0/4039461214 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa6a80b5d90 0x7fa6a81f1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:02.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.888+0000 7fa6a6d9d700 1 -- 172.21.15.84:0/4039461214 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6a80b4510 msgr2=0x7fa6a80cc140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:02.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.888+0000 7fa6a6d9d700 1 --2- 172.21.15.84:0/4039461214 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6a80b4510 0x7fa6a80cc140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:02.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.888+0000 7fa6a6d9d700 1 -- 172.21.15.84:0/4039461214 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6a0009b30 con 0x7fa6a80d0b10 2023-07-14T11:14:02.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.888+0000 7fa6a5d9b700 1 --2- 172.21.15.84:0/4039461214 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa6a80b5d90 0x7fa6a81f1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:14:02.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.888+0000 7fa6a659c700 1 --2- 172.21.15.84:0/4039461214 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6a80b4510 0x7fa6a80cc140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:14:02.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.888+0000 7fa6a6d9d700 1 --2- 172.21.15.84:0/4039461214 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6a80d0b10 0x7fa6a815f6e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fa6a8067360 tx=0x7fa6a0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:02.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.888+0000 7fa696ffd700 1 -- 172.21.15.84:0/4039461214 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a0004240 con 0x7fa6a80d0b10 2023-07-14T11:14:02.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.888+0000 7fa696ffd700 1 -- 172.21.15.84:0/4039461214 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6a00043c0 con 0x7fa6a80d0b10 2023-07-14T11:14:02.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.888+0000 7fa6acfff700 1 -- 172.21.15.84:0/4039461214 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6a81f2930 con 0x7fa6a80d0b10 2023-07-14T11:14:02.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.888+0000 7fa696ffd700 1 -- 172.21.15.84:0/4039461214 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a0004770 con 0x7fa6a80d0b10 2023-07-14T11:14:02.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.888+0000 7fa6acfff700 1 -- 172.21.15.84:0/4039461214 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6a80cbb20 con 0x7fa6a80d0b10 2023-07-14T11:14:02.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.889+0000 7fa6acfff700 1 -- 172.21.15.84:0/4039461214 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6a804e280 con 0x7fa6a80d0b10 2023-07-14T11:14:02.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.890+0000 7fa696ffd700 1 -- 172.21.15.84:0/4039461214 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa6a0019070 con 0x7fa6a80d0b10 2023-07-14T11:14:02.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.891+0000 7fa696ffd700 1 --2- 172.21.15.84:0/4039461214 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa68806ace0 0x7fa68806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:02.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.891+0000 7fa696ffd700 1 -- 172.21.15.84:0/4039461214 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fa6a008a7c0 con 0x7fa6a80d0b10 2023-07-14T11:14:02.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.891+0000 7fa6a659c700 1 --2- 172.21.15.84:0/4039461214 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa68806ace0 0x7fa68806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:02.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.892+0000 7fa6a659c700 1 --2- 172.21.15.84:0/4039461214 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa68806ace0 0x7fa68806d190 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa69800a8b0 tx=0x7fa698008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:02.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:02.895+0000 7fa696ffd700 1 -- 172.21.15.84:0/4039461214 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fa6a0055820 con 0x7fa6a80d0b10 2023-07-14T11:14:03.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.095+0000 7fa6acfff700 1 -- 172.21.15.84:0/4039461214 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa6a80ce3b0 con 0x7fa6a80d0b10 2023-07-14T11:14:03.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.096+0000 7fa696ffd700 1 -- 172.21.15.84:0/4039461214 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18351 (secure 0 0 0) 0x7fa6a0058e40 con 0x7fa6a80d0b10 2023-07-14T11:14:03.099 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:14:03.099 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":25,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:13:55.825723+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-14T11:13:12.727811+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-14T11:13:13.436391+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.17","mappings":[{"from":3,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:14:03.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.099+0000 7fa6acfff700 1 -- 172.21.15.84:0/4039461214 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa68806ace0 msgr2=0x7fa68806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:03.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.099+0000 7fa6acfff700 1 --2- 172.21.15.84:0/4039461214 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa68806ace0 0x7fa68806d190 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa69800a8b0 tx=0x7fa698008040 comp rx=0 tx=0).stop 2023-07-14T11:14:03.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.099+0000 7fa6acfff700 1 -- 172.21.15.84:0/4039461214 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6a80d0b10 msgr2=0x7fa6a815f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:03.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.099+0000 7fa6acfff700 1 --2- 172.21.15.84:0/4039461214 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6a80d0b10 0x7fa6a815f6e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fa6a8067360 tx=0x7fa6a0004ad0 comp rx=0 tx=0).stop 2023-07-14T11:14:03.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.099+0000 7fa6acfff700 1 -- 172.21.15.84:0/4039461214 shutdown_connections 2023-07-14T11:14:03.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.099+0000 7fa6acfff700 1 --2- 172.21.15.84:0/4039461214 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6a80d0b10 0x7fa6a815f6e0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:03.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.099+0000 7fa6acfff700 1 --2- 172.21.15.84:0/4039461214 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6a80b4510 0x7fa6a80cc140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:03.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.099+0000 7fa6acfff700 1 --2- 172.21.15.84:0/4039461214 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa68806ace0 0x7fa68806d190 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:03.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.099+0000 7fa6acfff700 1 --2- 172.21.15.84:0/4039461214 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa6a80b5d90 0x7fa6a81f1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:03.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.099+0000 7fa6acfff700 1 -- 172.21.15.84:0/4039461214 >> 172.21.15.84:0/4039461214 conn(0x7fa6a809c1d0 msgr2=0x7fa6a806a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:03.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.099+0000 7fa6acfff700 1 -- 172.21.15.84:0/4039461214 shutdown_connections 2023-07-14T11:14:03.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.099+0000 7fa6acfff700 1 -- 172.21.15.84:0/4039461214 wait complete. 2023-07-14T11:14:03.119 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T11:13:00.125395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T11:13:06.803994+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T11:13:12.727811+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T11:13:13.436391+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T11:14:03.120 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T11:14:03.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.315+0000 7f5a1a1ff700 1 Processor -- start 2023-07-14T11:14:03.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.315+0000 7f5a1a1ff700 1 -- start start 2023-07-14T11:14:03.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.316+0000 7f5a1a1ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5a140b4860 0x7f5a140b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:03.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.316+0000 7f5a1a1ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5a140d12c0 0x7f5a140d16e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:03.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.316+0000 7f5a1a1ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a140d02a0 con 0x7f5a140b8660 2023-07-14T11:14:03.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.316+0000 7f5a1a1ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a140b5240 con 0x7f5a140d12c0 2023-07-14T11:14:03.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.316+0000 7f5a1a1ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a140cfce0 con 0x7f5a140b4860 2023-07-14T11:14:03.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.316+0000 7f5a13fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5a140d12c0 0x7f5a140d16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:03.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.317+0000 7f5a13fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5a140d12c0 0x7f5a140d16e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55538/0 (socket says 172.21.15.84:55538) 2023-07-14T11:14:03.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.317+0000 7f5a13fff700 1 -- 172.21.15.84:0/236459399 learned_addr learned my addr 172.21.15.84:0/236459399 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:03.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.317+0000 7f5a12ffd700 1 --2- 172.21.15.84:0/236459399 >> v2:172.21.15.179:3300/0 conn(0x7f5a140b4860 0x7f5a140b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:03.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.317+0000 7f5a13fff700 1 -- 172.21.15.84:0/236459399 >> v2:172.21.15.179:3300/0 conn(0x7f5a140b4860 msgr2=0x7f5a140b4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:03.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.317+0000 7f5a13fff700 1 --2- 172.21.15.84:0/236459399 >> v2:172.21.15.179:3300/0 conn(0x7f5a140b4860 0x7f5a140b4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:03.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.317+0000 7f5a13fff700 1 -- 172.21.15.84:0/236459399 >> v1:172.21.15.179:6789/0 conn(0x7f5a140b8660 legacy=0x7f5a140cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:03.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.317+0000 7f5a13fff700 1 -- 172.21.15.84:0/236459399 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a140cffc0 con 0x7f5a140d12c0 2023-07-14T11:14:03.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.317+0000 7f5a13fff700 1 --2- 172.21.15.84:0/236459399 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a140d12c0 0x7f5a140d16e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5a14160130 tx=0x7f5a0c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=331d04c61fd56af6 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:03.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.317+0000 7f5a127fc700 1 -- 172.21.15.84:0/236459399 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a0c00e070 con 0x7f5a140d12c0 2023-07-14T11:14:03.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.318+0000 7f5a127fc700 1 -- 172.21.15.84:0/236459399 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a0c003a20 con 0x7f5a140d12c0 2023-07-14T11:14:03.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.318+0000 7f5a127fc700 1 -- 172.21.15.84:0/236459399 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a0c003dd0 con 0x7f5a140d12c0 2023-07-14T11:14:03.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.318+0000 7f5a1a1ff700 1 -- 172.21.15.84:0/236459399 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a140d12c0 msgr2=0x7f5a140d16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:03.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.318+0000 7f5a1a1ff700 1 --2- 172.21.15.84:0/236459399 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a140d12c0 0x7f5a140d16e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5a14160130 tx=0x7f5a0c00b330 comp rx=0 tx=0).stop 2023-07-14T11:14:03.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.318+0000 7f5a1a1ff700 1 -- 172.21.15.84:0/236459399 shutdown_connections 2023-07-14T11:14:03.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.318+0000 7f5a1a1ff700 1 --2- 172.21.15.84:0/236459399 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a140d12c0 0x7f5a140d16e0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:03.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.318+0000 7f5a1a1ff700 1 --2- 172.21.15.84:0/236459399 >> v2:172.21.15.179:3300/0 conn(0x7f5a140b4860 0x7f5a140b4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:03.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.318+0000 7f5a1a1ff700 1 -- 172.21.15.84:0/236459399 >> 172.21.15.84:0/236459399 conn(0x7f5a14066860 msgr2=0x7f5a1406a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:03.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.318+0000 7f5a1a1ff700 1 -- 172.21.15.84:0/236459399 shutdown_connections 2023-07-14T11:14:03.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.318+0000 7f5a1a1ff700 1 -- 172.21.15.84:0/236459399 wait complete. 2023-07-14T11:14:03.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.320+0000 7f5a1a1ff700 1 Processor -- start 2023-07-14T11:14:03.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.320+0000 7f5a1a1ff700 1 -- start start 2023-07-14T11:14:03.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.321+0000 7f5a1a1ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a140b4860 0x7f5a1415a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:03.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.321+0000 7f5a1a1ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a140b8660 0x7f5a14157c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:03.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.321+0000 7f5a1a1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a140d12c0 0x7f5a14157430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:03.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.321+0000 7f5a1a1ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1415f320 con 0x7f5a140b8660 2023-07-14T11:14:03.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.321+0000 7f5a1a1ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a14158370 con 0x7f5a140b4860 2023-07-14T11:14:03.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.321+0000 7f5a1a1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a14158650 con 0x7f5a140d12c0 2023-07-14T11:14:03.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.321+0000 7f5a12ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a140b8660 0x7f5a14157c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:03.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.321+0000 7f5a12ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a140b8660 0x7f5a14157c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55544/0 (socket says 172.21.15.84:55544) 2023-07-14T11:14:03.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.321+0000 7f5a12ffd700 1 -- 172.21.15.84:0/3938070522 learned_addr learned my addr 172.21.15.84:0/3938070522 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:03.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.321+0000 7f5a137fe700 1 --2- 172.21.15.84:0/3938070522 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a140b4860 0x7f5a1415a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:03.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.321+0000 7f5a13fff700 1 --2- 172.21.15.84:0/3938070522 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a140d12c0 0x7f5a14157430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:03.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.322+0000 7f5a12ffd700 1 -- 172.21.15.84:0/3938070522 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a140d12c0 msgr2=0x7f5a14157430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:03.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.322+0000 7f5a12ffd700 1 --2- 172.21.15.84:0/3938070522 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a140d12c0 0x7f5a14157430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:03.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.322+0000 7f5a12ffd700 1 -- 172.21.15.84:0/3938070522 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a140b4860 msgr2=0x7f5a1415a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:03.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.322+0000 7f5a12ffd700 1 --2- 172.21.15.84:0/3938070522 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a140b4860 0x7f5a1415a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:03.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.322+0000 7f5a12ffd700 1 -- 172.21.15.84:0/3938070522 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a0c009b30 con 0x7f5a140b8660 2023-07-14T11:14:03.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.322+0000 7f5a12ffd700 1 --2- 172.21.15.84:0/3938070522 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a140b8660 0x7f5a14157c70 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5a0800e810 tx=0x7f5a0800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:03.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.322+0000 7f59fbfff700 1 -- 172.21.15.84:0/3938070522 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a08013610 con 0x7f5a140b8660 2023-07-14T11:14:03.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.322+0000 7f59fbfff700 1 -- 172.21.15.84:0/3938070522 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a08013770 con 0x7f5a140b8660 2023-07-14T11:14:03.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.322+0000 7f59fbfff700 1 -- 172.21.15.84:0/3938070522 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a08013b20 con 0x7f5a140b8660 2023-07-14T11:14:03.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.322+0000 7f5a1a1ff700 1 -- 172.21.15.84:0/3938070522 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a14158930 con 0x7f5a140b8660 2023-07-14T11:14:03.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.322+0000 7f5a1a1ff700 1 -- 172.21.15.84:0/3938070522 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a140ca6e0 con 0x7f5a140b8660 2023-07-14T11:14:03.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.323+0000 7f5a1a1ff700 1 -- 172.21.15.84:0/3938070522 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a14074350 con 0x7f5a140b8660 2023-07-14T11:14:03.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.324+0000 7f59fbfff700 1 -- 172.21.15.84:0/3938070522 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5a08013c80 con 0x7f5a140b8660 2023-07-14T11:14:03.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.325+0000 7f59fbfff700 1 --2- 172.21.15.84:0/3938070522 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f5a0006ace0 0x7f5a0006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:03.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.325+0000 7f59fbfff700 1 -- 172.21.15.84:0/3938070522 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f5a08089140 con 0x7f5a140b8660 2023-07-14T11:14:03.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.325+0000 7f5a137fe700 1 --2- 172.21.15.84:0/3938070522 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f5a0006ace0 0x7f5a0006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:03.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.326+0000 7f5a137fe700 1 --2- 172.21.15.84:0/3938070522 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f5a0006ace0 0x7f5a0006d190 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5a04004f30 tx=0x7f5a04009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:03.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.329+0000 7f59fbfff700 1 -- 172.21.15.84:0/3938070522 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f5a080541c0 con 0x7f5a140b8660 2023-07-14T11:14:03.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.520+0000 7f5a1a1ff700 1 -- 172.21.15.84:0/3938070522 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5a140b2150 con 0x7f5a140b8660 2023-07-14T11:14:03.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.520+0000 7f59fbfff700 1 -- 172.21.15.84:0/3938070522 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5a080577e0 con 0x7f5a140b8660 2023-07-14T11:14:03.523 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-07-14T11:14:03.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.522+0000 7f5a1a1ff700 1 -- 172.21.15.84:0/3938070522 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f5a0006ace0 msgr2=0x7f5a0006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:03.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.522+0000 7f5a1a1ff700 1 --2- 172.21.15.84:0/3938070522 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f5a0006ace0 0x7f5a0006d190 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5a04004f30 tx=0x7f5a04009040 comp rx=0 tx=0).stop 2023-07-14T11:14:03.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.522+0000 7f5a1a1ff700 1 -- 172.21.15.84:0/3938070522 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a140b8660 msgr2=0x7f5a14157c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:03.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.522+0000 7f5a1a1ff700 1 --2- 172.21.15.84:0/3938070522 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a140b8660 0x7f5a14157c70 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5a0800e810 tx=0x7f5a0800ebd0 comp rx=0 tx=0).stop 2023-07-14T11:14:03.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.523+0000 7f5a1a1ff700 1 -- 172.21.15.84:0/3938070522 shutdown_connections 2023-07-14T11:14:03.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.523+0000 7f5a1a1ff700 1 --2- 172.21.15.84:0/3938070522 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f5a0006ace0 0x7f5a0006d190 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:03.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.523+0000 7f5a1a1ff700 1 --2- 172.21.15.84:0/3938070522 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a140d12c0 0x7f5a14157430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:03.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.523+0000 7f5a1a1ff700 1 --2- 172.21.15.84:0/3938070522 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a140b4860 0x7f5a1415a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:03.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.523+0000 7f5a1a1ff700 1 --2- 172.21.15.84:0/3938070522 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a140b8660 0x7f5a14157c70 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:03.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.523+0000 7f5a1a1ff700 1 -- 172.21.15.84:0/3938070522 >> 172.21.15.84:0/3938070522 conn(0x7f5a14066860 msgr2=0x7f5a140b3fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:03.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.523+0000 7f5a1a1ff700 1 -- 172.21.15.84:0/3938070522 shutdown_connections 2023-07-14T11:14:03.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.523+0000 7f5a1a1ff700 1 -- 172.21.15.84:0/3938070522 wait complete. 2023-07-14T11:14:03.542 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T11:14:03.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.739+0000 7f2e66dff700 1 Processor -- start 2023-07-14T11:14:03.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.739+0000 7f2e66dff700 1 -- start start 2023-07-14T11:14:03.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.740+0000 7f2e66dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e600b8a60 0x7f2e600b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:03.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.740+0000 7f2e66dff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2e600b4530 0x7f2e600d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:03.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.740+0000 7f2e66dff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e600b8e30 con 0x7f2e600d1050 2023-07-14T11:14:03.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.740+0000 7f2e66dff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e600d14d0 con 0x7f2e600b4530 2023-07-14T11:14:03.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.740+0000 7f2e66dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e600b1e30 con 0x7f2e600b8a60 2023-07-14T11:14:03.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.740+0000 7f2e5ffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2e600b4530 0x7f2e600d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:03.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.740+0000 7f2e6539c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f2e600d1050 0x7f2e600b25d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55606/0 (socket says 172.21.15.84:55606) 2023-07-14T11:14:03.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.740+0000 7f2e6539c700 1 -- 172.21.15.84:0/3474766823 learned_addr learned my addr 172.21.15.84:0/3474766823 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:14:03.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.740+0000 7f2e64b9b700 1 --2- 172.21.15.84:0/3474766823 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e600b8a60 0x7f2e600b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:03.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.741+0000 7f2e5ffff700 1 -- 172.21.15.84:0/3474766823 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e600b8a60 msgr2=0x7f2e600b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:03.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.741+0000 7f2e5ffff700 1 --2- 172.21.15.84:0/3474766823 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e600b8a60 0x7f2e600b3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:03.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.741+0000 7f2e5ffff700 1 -- 172.21.15.84:0/3474766823 >> v1:172.21.15.84:6789/0 conn(0x7f2e600d1050 legacy=0x7f2e600b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:03.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.741+0000 7f2e5ffff700 1 -- 172.21.15.84:0/3474766823 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e600afaa0 con 0x7f2e600b4530 2023-07-14T11:14:03.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.741+0000 7f2e64b9b700 1 --2- 172.21.15.84:0/3474766823 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e600b8a60 0x7f2e600b3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:14:03.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.741+0000 7f2e5ffff700 1 --2- 172.21.15.84:0/3474766823 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e600b4530 0x7f2e600d0b10 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c009840 tx=0x7f2e4c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b86cafcfed650c7d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:03.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.741+0000 7f2e5f7fe700 1 -- 172.21.15.84:0/3474766823 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c011830 con 0x7f2e600b4530 2023-07-14T11:14:03.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.741+0000 7f2e5f7fe700 1 -- 172.21.15.84:0/3474766823 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e4c011990 con 0x7f2e600b4530 2023-07-14T11:14:03.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.741+0000 7f2e5f7fe700 1 -- 172.21.15.84:0/3474766823 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c011d20 con 0x7f2e600b4530 2023-07-14T11:14:03.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.742+0000 7f2e66dff700 1 -- 172.21.15.84:0/3474766823 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e600b4530 msgr2=0x7f2e600d0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:03.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.742+0000 7f2e66dff700 1 --2- 172.21.15.84:0/3474766823 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e600b4530 0x7f2e600d0b10 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c009840 tx=0x7f2e4c009b50 comp rx=0 tx=0).stop 2023-07-14T11:14:03.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.742+0000 7f2e66dff700 1 -- 172.21.15.84:0/3474766823 shutdown_connections 2023-07-14T11:14:03.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.742+0000 7f2e66dff700 1 --2- 172.21.15.84:0/3474766823 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e600b8a60 0x7f2e600b3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:03.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.742+0000 7f2e66dff700 1 --2- 172.21.15.84:0/3474766823 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e600b4530 0x7f2e600d0b10 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:03.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.742+0000 7f2e66dff700 1 -- 172.21.15.84:0/3474766823 >> 172.21.15.84:0/3474766823 conn(0x7f2e6009c1b0 msgr2=0x7f2e600d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:03.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.742+0000 7f2e66dff700 1 -- 172.21.15.84:0/3474766823 shutdown_connections 2023-07-14T11:14:03.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.742+0000 7f2e66dff700 1 -- 172.21.15.84:0/3474766823 wait complete. 2023-07-14T11:14:03.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.743+0000 7f2e66dff700 1 Processor -- start 2023-07-14T11:14:03.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.744+0000 7f2e66dff700 1 -- start start 2023-07-14T11:14:03.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.744+0000 7f2e66dff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e600b4530 0x7f2e60158d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:03.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.744+0000 7f2e66dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e600b8a60 0x7f2e600d0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:03.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.744+0000 7f2e66dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e600d1050 0x7f2e6015f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:03.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.744+0000 7f2e66dff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6015f080 con 0x7f2e600b4530 2023-07-14T11:14:03.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.745+0000 7f2e66dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6015e400 con 0x7f2e600d1050 2023-07-14T11:14:03.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.745+0000 7f2e66dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6015e6e0 con 0x7f2e600b8a60 2023-07-14T11:14:03.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.745+0000 7f2e64b9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e600b4530 0x7f2e60158d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:03.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.745+0000 7f2e64b9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e600b4530 0x7f2e60158d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55570/0 (socket says 172.21.15.84:55570) 2023-07-14T11:14:03.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.745+0000 7f2e64b9b700 1 -- 172.21.15.84:0/1098324419 learned_addr learned my addr 172.21.15.84:0/1098324419 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:03.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.745+0000 7f2e5ffff700 1 --2- 172.21.15.84:0/1098324419 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e600b8a60 0x7f2e600d0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:03.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.745+0000 7f2e6539c700 1 --2- 172.21.15.84:0/1098324419 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e600d1050 0x7f2e6015f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:03.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.745+0000 7f2e64b9b700 1 -- 172.21.15.84:0/1098324419 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e600b8a60 msgr2=0x7f2e600d0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:03.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.745+0000 7f2e64b9b700 1 --2- 172.21.15.84:0/1098324419 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e600b8a60 0x7f2e600d0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:03.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.745+0000 7f2e64b9b700 1 -- 172.21.15.84:0/1098324419 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e600d1050 msgr2=0x7f2e6015f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:03.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.745+0000 7f2e64b9b700 1 --2- 172.21.15.84:0/1098324419 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e600d1050 0x7f2e6015f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:03.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.745+0000 7f2e64b9b700 1 -- 172.21.15.84:0/1098324419 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e4c0094a0 con 0x7f2e600b4530 2023-07-14T11:14:03.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.745+0000 7f2e64b9b700 1 --2- 172.21.15.84:0/1098324419 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e600b4530 0x7f2e60158d10 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2e5400e810 tx=0x7f2e5400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:03.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.745+0000 7f2e5d7fa700 1 -- 172.21.15.84:0/1098324419 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e54013610 con 0x7f2e600b4530 2023-07-14T11:14:03.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.745+0000 7f2e5d7fa700 1 -- 172.21.15.84:0/1098324419 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e54013770 con 0x7f2e600b4530 2023-07-14T11:14:03.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.745+0000 7f2e66dff700 1 -- 172.21.15.84:0/1098324419 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e6015e9c0 con 0x7f2e600b4530 2023-07-14T11:14:03.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.746+0000 7f2e5d7fa700 1 -- 172.21.15.84:0/1098324419 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e54013b20 con 0x7f2e600b4530 2023-07-14T11:14:03.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.746+0000 7f2e66dff700 1 -- 172.21.15.84:0/1098324419 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e60159250 con 0x7f2e600b4530 2023-07-14T11:14:03.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.747+0000 7f2e66dff700 1 -- 172.21.15.84:0/1098324419 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e60074350 con 0x7f2e600b4530 2023-07-14T11:14:03.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.747+0000 7f2e5d7fa700 1 -- 172.21.15.84:0/1098324419 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2e54013c80 con 0x7f2e600b4530 2023-07-14T11:14:03.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.749+0000 7f2e5d7fa700 1 --2- 172.21.15.84:0/1098324419 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f2e4406ace0 0x7f2e4406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:03.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.749+0000 7f2e5d7fa700 1 -- 172.21.15.84:0/1098324419 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f2e54089190 con 0x7f2e600b4530 2023-07-14T11:14:03.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.749+0000 7f2e5ffff700 1 --2- 172.21.15.84:0/1098324419 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f2e4406ace0 0x7f2e4406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:03.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.749+0000 7f2e5ffff700 1 --2- 172.21.15.84:0/1098324419 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f2e4406ace0 0x7f2e4406d190 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c0090b0 tx=0x7f2e4c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:03.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.752+0000 7f2e5d7fa700 1 -- 172.21.15.84:0/1098324419 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f2e54057c90 con 0x7f2e600b4530 2023-07-14T11:14:03.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.947+0000 7f2e66dff700 1 -- 172.21.15.84:0/1098324419 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2e600b7d10 con 0x7f2e600b4530 2023-07-14T11:14:03.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.948+0000 7f2e5d7fa700 1 -- 172.21.15.84:0/1098324419 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2e54057820 con 0x7f2e600b4530 2023-07-14T11:14:03.950 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-07-14T11:14:03.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.950+0000 7f2e66dff700 1 -- 172.21.15.84:0/1098324419 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f2e4406ace0 msgr2=0x7f2e4406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:03.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.950+0000 7f2e66dff700 1 --2- 172.21.15.84:0/1098324419 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f2e4406ace0 0x7f2e4406d190 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c0090b0 tx=0x7f2e4c008030 comp rx=0 tx=0).stop 2023-07-14T11:14:03.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.950+0000 7f2e66dff700 1 -- 172.21.15.84:0/1098324419 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e600b4530 msgr2=0x7f2e60158d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:03.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.950+0000 7f2e66dff700 1 --2- 172.21.15.84:0/1098324419 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e600b4530 0x7f2e60158d10 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2e5400e810 tx=0x7f2e5400ebd0 comp rx=0 tx=0).stop 2023-07-14T11:14:03.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.950+0000 7f2e66dff700 1 -- 172.21.15.84:0/1098324419 shutdown_connections 2023-07-14T11:14:03.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.950+0000 7f2e66dff700 1 --2- 172.21.15.84:0/1098324419 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e600d1050 0x7f2e6015f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:03.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.950+0000 7f2e66dff700 1 --2- 172.21.15.84:0/1098324419 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e600b4530 0x7f2e60158d10 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:03.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.950+0000 7f2e66dff700 1 --2- 172.21.15.84:0/1098324419 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f2e4406ace0 0x7f2e4406d190 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:03.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.950+0000 7f2e66dff700 1 --2- 172.21.15.84:0/1098324419 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e600b8a60 0x7f2e600d0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:03.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.950+0000 7f2e66dff700 1 -- 172.21.15.84:0/1098324419 >> 172.21.15.84:0/1098324419 conn(0x7f2e6009c1b0 msgr2=0x7f2e6015b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:03.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.950+0000 7f2e66dff700 1 -- 172.21.15.84:0/1098324419 shutdown_connections 2023-07-14T11:14:03.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:03.950+0000 7f2e66dff700 1 -- 172.21.15.84:0/1098324419 wait complete. 2023-07-14T11:14:03.970 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T11:14:04.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.168+0000 7f2a4b5ff700 1 Processor -- start 2023-07-14T11:14:04.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.168+0000 7f2a4b5ff700 1 -- start start 2023-07-14T11:14:04.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.169+0000 7f2a4b5ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2a440b8a60 0x7f2a440b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:04.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.169+0000 7f2a4b5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a440b4530 0x7f2a440d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:04.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.169+0000 7f2a4b5ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a440b8e30 con 0x7f2a440d1050 2023-07-14T11:14:04.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.169+0000 7f2a4b5ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a440d14d0 con 0x7f2a440b8a60 2023-07-14T11:14:04.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.169+0000 7f2a4b5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a440b1e30 con 0x7f2a440b4530 2023-07-14T11:14:04.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.170+0000 7f2a4939b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2a440b8a60 0x7f2a440b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:04.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.170+0000 7f2a48b9a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a440b4530 0x7f2a440d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:04.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.170+0000 7f2a49b9c700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f2a440d1050 0x7f2a440b25d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.84:48524/0 (socket says 172.21.15.84:48524) 2023-07-14T11:14:04.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.170+0000 7f2a49b9c700 1 -- 172.21.15.84:0/174398030 learned_addr learned my addr 172.21.15.84:0/174398030 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:14:04.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.170+0000 7f2a4939b700 1 -- 172.21.15.84:0/174398030 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a440b4530 msgr2=0x7f2a440d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:04.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.170+0000 7f2a4939b700 1 --2- 172.21.15.84:0/174398030 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a440b4530 0x7f2a440d0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:04.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.170+0000 7f2a4939b700 1 -- 172.21.15.84:0/174398030 >> v1:172.21.15.179:6789/0 conn(0x7f2a440d1050 legacy=0x7f2a440b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:04.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.170+0000 7f2a4939b700 1 -- 172.21.15.84:0/174398030 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a440afaa0 con 0x7f2a440b8a60 2023-07-14T11:14:04.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.171+0000 7f2a4939b700 1 --2- 172.21.15.84:0/174398030 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a440b8a60 0x7f2a440b3ff0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2a40009840 tx=0x7f2a40009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13d8c6172a075da8 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:04.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.171+0000 7f2a3bfff700 1 -- 172.21.15.84:0/174398030 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a40011830 con 0x7f2a440b8a60 2023-07-14T11:14:04.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.171+0000 7f2a3bfff700 1 -- 172.21.15.84:0/174398030 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a40011990 con 0x7f2a440b8a60 2023-07-14T11:14:04.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.171+0000 7f2a3bfff700 1 -- 172.21.15.84:0/174398030 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a40011d20 con 0x7f2a440b8a60 2023-07-14T11:14:04.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.171+0000 7f2a4b5ff700 1 -- 172.21.15.84:0/174398030 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a440b8a60 msgr2=0x7f2a440b3ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:04.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.171+0000 7f2a4b5ff700 1 --2- 172.21.15.84:0/174398030 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a440b8a60 0x7f2a440b3ff0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2a40009840 tx=0x7f2a40009b50 comp rx=0 tx=0).stop 2023-07-14T11:14:04.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.172+0000 7f2a4b5ff700 1 -- 172.21.15.84:0/174398030 shutdown_connections 2023-07-14T11:14:04.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.172+0000 7f2a4b5ff700 1 --2- 172.21.15.84:0/174398030 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a440b8a60 0x7f2a440b3ff0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:04.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.172+0000 7f2a4b5ff700 1 --2- 172.21.15.84:0/174398030 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a440b4530 0x7f2a440d0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:04.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.172+0000 7f2a4b5ff700 1 -- 172.21.15.84:0/174398030 >> 172.21.15.84:0/174398030 conn(0x7f2a4409c1b0 msgr2=0x7f2a440d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:04.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.172+0000 7f2a4b5ff700 1 -- 172.21.15.84:0/174398030 shutdown_connections 2023-07-14T11:14:04.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.172+0000 7f2a4b5ff700 1 -- 172.21.15.84:0/174398030 wait complete. 2023-07-14T11:14:04.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.173+0000 7f2a4b5ff700 1 Processor -- start 2023-07-14T11:14:04.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.173+0000 7f2a4b5ff700 1 -- start start 2023-07-14T11:14:04.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.174+0000 7f2a4b5ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a440b4530 0x7f2a441524b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:04.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.174+0000 7f2a4b5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a440b8a60 0x7f2a441f4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:04.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.174+0000 7f2a4b5ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a440d1050 0x7f2a441f34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:04.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.174+0000 7f2a4b5ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a441529f0 con 0x7f2a440b4530 2023-07-14T11:14:04.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.174+0000 7f2a4b5ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a441f3f20 con 0x7f2a440d1050 2023-07-14T11:14:04.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.174+0000 7f2a4b5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a441f4200 con 0x7f2a440b8a60 2023-07-14T11:14:04.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.175+0000 7f2a4939b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a440b4530 0x7f2a441524b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:04.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.175+0000 7f2a4939b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a440b4530 0x7f2a441524b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55574/0 (socket says 172.21.15.84:55574) 2023-07-14T11:14:04.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.175+0000 7f2a4939b700 1 -- 172.21.15.84:0/1820810950 learned_addr learned my addr 172.21.15.84:0/1820810950 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:04.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.175+0000 7f2a48b9a700 1 --2- 172.21.15.84:0/1820810950 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a440b8a60 0x7f2a441f4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:04.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.175+0000 7f2a49b9c700 1 --2- 172.21.15.84:0/1820810950 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a440d1050 0x7f2a441f34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:04.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.175+0000 7f2a4939b700 1 -- 172.21.15.84:0/1820810950 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a440b8a60 msgr2=0x7f2a441f4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:04.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.175+0000 7f2a4939b700 1 --2- 172.21.15.84:0/1820810950 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a440b8a60 0x7f2a441f4fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:04.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.175+0000 7f2a4939b700 1 -- 172.21.15.84:0/1820810950 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a440d1050 msgr2=0x7f2a441f34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:04.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.175+0000 7f2a4939b700 1 --2- 172.21.15.84:0/1820810950 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a440d1050 0x7f2a441f34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:04.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.175+0000 7f2a4939b700 1 -- 172.21.15.84:0/1820810950 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a400094a0 con 0x7f2a440b4530 2023-07-14T11:14:04.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.175+0000 7f2a48b9a700 1 --2- 172.21.15.84:0/1820810950 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a440b8a60 0x7f2a441f4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:14:04.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.175+0000 7f2a49b9c700 1 --2- 172.21.15.84:0/1820810950 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a440d1050 0x7f2a441f34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:14:04.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.175+0000 7f2a4939b700 1 --2- 172.21.15.84:0/1820810950 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a440b4530 0x7f2a441524b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f2a40009fd0 tx=0x7f2a40004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:04.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.175+0000 7f2a39ffb700 1 -- 172.21.15.84:0/1820810950 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a400038a0 con 0x7f2a440b4530 2023-07-14T11:14:04.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.176+0000 7f2a39ffb700 1 -- 172.21.15.84:0/1820810950 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a4001f070 con 0x7f2a440b4530 2023-07-14T11:14:04.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.176+0000 7f2a39ffb700 1 -- 172.21.15.84:0/1820810950 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a40003c20 con 0x7f2a440b4530 2023-07-14T11:14:04.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.176+0000 7f2a4b5ff700 1 -- 172.21.15.84:0/1820810950 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a441f44e0 con 0x7f2a440b4530 2023-07-14T11:14:04.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.176+0000 7f2a4b5ff700 1 -- 172.21.15.84:0/1820810950 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a441f4aa0 con 0x7f2a440b4530 2023-07-14T11:14:04.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.177+0000 7f2a4b5ff700 1 -- 172.21.15.84:0/1820810950 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a440d0960 con 0x7f2a440b4530 2023-07-14T11:14:04.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.178+0000 7f2a39ffb700 1 -- 172.21.15.84:0/1820810950 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2a40026480 con 0x7f2a440b4530 2023-07-14T11:14:04.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.179+0000 7f2a39ffb700 1 --2- 172.21.15.84:0/1820810950 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f2a2806ace0 0x7f2a2806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:04.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.179+0000 7f2a39ffb700 1 -- 172.21.15.84:0/1820810950 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f2a40021070 con 0x7f2a440b4530 2023-07-14T11:14:04.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.179+0000 7f2a48b9a700 1 --2- 172.21.15.84:0/1820810950 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f2a2806ace0 0x7f2a2806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:04.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.180+0000 7f2a48b9a700 1 --2- 172.21.15.84:0/1820810950 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f2a2806ace0 0x7f2a2806d190 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2a44159730 tx=0x7f2a34008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:04.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.183+0000 7f2a39ffb700 1 -- 172.21.15.84:0/1820810950 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f2a40055ef0 con 0x7f2a440b4530 2023-07-14T11:14:04.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.376+0000 7f2a4b5ff700 1 -- 172.21.15.84:0/1820810950 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2a441f4c90 con 0x7f2a440b4530 2023-07-14T11:14:04.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.376+0000 7f2a39ffb700 1 -- 172.21.15.84:0/1820810950 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2a40059510 con 0x7f2a440b4530 2023-07-14T11:14:04.378 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-07-14T11:14:04.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.378+0000 7f2a4b5ff700 1 -- 172.21.15.84:0/1820810950 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f2a2806ace0 msgr2=0x7f2a2806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:04.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.378+0000 7f2a4b5ff700 1 --2- 172.21.15.84:0/1820810950 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f2a2806ace0 0x7f2a2806d190 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2a44159730 tx=0x7f2a34008040 comp rx=0 tx=0).stop 2023-07-14T11:14:04.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.378+0000 7f2a4b5ff700 1 -- 172.21.15.84:0/1820810950 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a440b4530 msgr2=0x7f2a441524b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:04.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.378+0000 7f2a4b5ff700 1 --2- 172.21.15.84:0/1820810950 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a440b4530 0x7f2a441524b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f2a40009fd0 tx=0x7f2a40004750 comp rx=0 tx=0).stop 2023-07-14T11:14:04.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.378+0000 7f2a4b5ff700 1 -- 172.21.15.84:0/1820810950 shutdown_connections 2023-07-14T11:14:04.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.378+0000 7f2a4b5ff700 1 --2- 172.21.15.84:0/1820810950 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a440d1050 0x7f2a441f34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:04.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.378+0000 7f2a4b5ff700 1 --2- 172.21.15.84:0/1820810950 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a440b4530 0x7f2a441524b0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:04.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.378+0000 7f2a4b5ff700 1 --2- 172.21.15.84:0/1820810950 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f2a2806ace0 0x7f2a2806d190 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:04.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.378+0000 7f2a4b5ff700 1 --2- 172.21.15.84:0/1820810950 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a440b8a60 0x7f2a441f4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:04.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.378+0000 7f2a4b5ff700 1 -- 172.21.15.84:0/1820810950 >> 172.21.15.84:0/1820810950 conn(0x7f2a4409c1b0 msgr2=0x7f2a440c9710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:04.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.378+0000 7f2a4b5ff700 1 -- 172.21.15.84:0/1820810950 shutdown_connections 2023-07-14T11:14:04.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.378+0000 7f2a4b5ff700 1 -- 172.21.15.84:0/1820810950 wait complete. 2023-07-14T11:14:04.398 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T11:14:04.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.593+0000 7f847b1ff700 1 Processor -- start 2023-07-14T11:14:04.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.593+0000 7f847b1ff700 1 -- start start 2023-07-14T11:14:04.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.594+0000 7f847b1ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f84740d0b10 0x7f84740d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:04.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.594+0000 7f847b1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84740b0e20 0x7f84740b12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:04.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.594+0000 7f847b1ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84740b8e30 con 0x7f84740b8a60 2023-07-14T11:14:04.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.594+0000 7f847b1ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84740d14d0 con 0x7f84740d0b10 2023-07-14T11:14:04.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.595+0000 7f847b1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84740afaa0 con 0x7f84740b0e20 2023-07-14T11:14:04.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.595+0000 7f8478f9b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f84740b8a60 0x7f84740b3ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55612/0 (socket says 172.21.15.84:55612) 2023-07-14T11:14:04.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.595+0000 7f8478f9b700 1 -- 172.21.15.84:0/1775075478 learned_addr learned my addr 172.21.15.84:0/1775075478 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:14:04.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.595+0000 7f8473fff700 1 --2- 172.21.15.84:0/1775075478 >> v2:172.21.15.84:3300/0 conn(0x7f84740d0b10 0x7f84740d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:04.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.595+0000 7f847979c700 1 --2- 172.21.15.84:0/1775075478 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84740b0e20 0x7f84740b12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:04.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.595+0000 7f8473fff700 1 -- 172.21.15.84:0/1775075478 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84740b0e20 msgr2=0x7f84740b12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:04.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.595+0000 7f8473fff700 1 --2- 172.21.15.84:0/1775075478 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84740b0e20 0x7f84740b12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:04.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.595+0000 7f8473fff700 1 -- 172.21.15.84:0/1775075478 >> v1:172.21.15.84:6789/0 conn(0x7f84740b8a60 legacy=0x7f84740b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:04.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.595+0000 7f8473fff700 1 -- 172.21.15.84:0/1775075478 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84740afd80 con 0x7f84740d0b10 2023-07-14T11:14:04.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.595+0000 7f847979c700 1 --2- 172.21.15.84:0/1775075478 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84740b0e20 0x7f84740b12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:14:04.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.595+0000 7f84737fe700 1 -- 172.21.15.84:0/1775075478 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4229546836 0 0) 0x7f84740b8e30 con 0x7f84740b8a60 2023-07-14T11:14:04.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.595+0000 7f8473fff700 1 --2- 172.21.15.84:0/1775075478 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84740d0b10 0x7f84740d0f90 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f8460009840 tx=0x7f8460009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d311d7fba4b18a31 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:04.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.596+0000 7f84737fe700 1 -- 172.21.15.84:0/1775075478 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8460011830 con 0x7f84740d0b10 2023-07-14T11:14:04.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.596+0000 7f84737fe700 1 -- 172.21.15.84:0/1775075478 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8460011990 con 0x7f84740d0b10 2023-07-14T11:14:04.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.596+0000 7f84737fe700 1 -- 172.21.15.84:0/1775075478 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8460011d20 con 0x7f84740d0b10 2023-07-14T11:14:04.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.596+0000 7f847b1ff700 1 -- 172.21.15.84:0/1775075478 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84740d0b10 msgr2=0x7f84740d0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:04.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.596+0000 7f847b1ff700 1 --2- 172.21.15.84:0/1775075478 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84740d0b10 0x7f84740d0f90 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f8460009840 tx=0x7f8460009b50 comp rx=0 tx=0).stop 2023-07-14T11:14:04.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.596+0000 7f847b1ff700 1 -- 172.21.15.84:0/1775075478 shutdown_connections 2023-07-14T11:14:04.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.596+0000 7f847b1ff700 1 --2- 172.21.15.84:0/1775075478 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84740b0e20 0x7f84740b12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:04.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.596+0000 7f847b1ff700 1 --2- 172.21.15.84:0/1775075478 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84740d0b10 0x7f84740d0f90 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:04.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.596+0000 7f847b1ff700 1 -- 172.21.15.84:0/1775075478 >> 172.21.15.84:0/1775075478 conn(0x7f847409c1b0 msgr2=0x7f84740d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:04.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.596+0000 7f847b1ff700 1 -- 172.21.15.84:0/1775075478 shutdown_connections 2023-07-14T11:14:04.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.596+0000 7f847b1ff700 1 -- 172.21.15.84:0/1775075478 wait complete. 2023-07-14T11:14:04.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.598+0000 7f847b1ff700 1 Processor -- start 2023-07-14T11:14:04.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.598+0000 7f847b1ff700 1 -- start start 2023-07-14T11:14:04.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.599+0000 7f847b1ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84740b0e20 0x7f847414cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:04.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.599+0000 7f847b1ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84740b8a60 0x7f84740cf6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:04.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.599+0000 7f847b1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84740d0b10 0x7f84741f1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:04.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.599+0000 7f847b1ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84740b6c00 con 0x7f84740b0e20 2023-07-14T11:14:04.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.599+0000 7f847b1ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8474149c80 con 0x7f84740b8a60 2023-07-14T11:14:04.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.599+0000 7f847b1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84740cfc30 con 0x7f84740d0b10 2023-07-14T11:14:04.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.599+0000 7f8478f9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84740b0e20 0x7f847414cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:04.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.599+0000 7f8478f9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84740b0e20 0x7f847414cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55594/0 (socket says 172.21.15.84:55594) 2023-07-14T11:14:04.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.599+0000 7f8478f9b700 1 -- 172.21.15.84:0/2476917176 learned_addr learned my addr 172.21.15.84:0/2476917176 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:04.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.600+0000 7f8473fff700 1 --2- 172.21.15.84:0/2476917176 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84740b8a60 0x7f84740cf6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:04.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.600+0000 7f847979c700 1 --2- 172.21.15.84:0/2476917176 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84740d0b10 0x7f84741f1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:04.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.600+0000 7f8478f9b700 1 -- 172.21.15.84:0/2476917176 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84740d0b10 msgr2=0x7f84741f1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:04.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.600+0000 7f8478f9b700 1 --2- 172.21.15.84:0/2476917176 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84740d0b10 0x7f84741f1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:04.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.600+0000 7f8478f9b700 1 -- 172.21.15.84:0/2476917176 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84740b8a60 msgr2=0x7f84740cf6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:04.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.600+0000 7f8478f9b700 1 --2- 172.21.15.84:0/2476917176 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84740b8a60 0x7f84740cf6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:04.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.600+0000 7f8478f9b700 1 -- 172.21.15.84:0/2476917176 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84600094a0 con 0x7f84740b0e20 2023-07-14T11:14:04.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.600+0000 7f8473fff700 1 --2- 172.21.15.84:0/2476917176 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84740b8a60 0x7f84740cf6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:14:04.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.600+0000 7f8478f9b700 1 --2- 172.21.15.84:0/2476917176 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84740b0e20 0x7f847414cb70 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f84680011e0 tx=0x7f846800cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:04.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.600+0000 7f84717fa700 1 -- 172.21.15.84:0/2476917176 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8468004c80 con 0x7f84740b0e20 2023-07-14T11:14:04.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.600+0000 7f84717fa700 1 -- 172.21.15.84:0/2476917176 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8468004e00 con 0x7f84740b0e20 2023-07-14T11:14:04.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.600+0000 7f847b1ff700 1 -- 172.21.15.84:0/2476917176 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84740cfee0 con 0x7f84740b0e20 2023-07-14T11:14:04.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.600+0000 7f84717fa700 1 -- 172.21.15.84:0/2476917176 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8468007310 con 0x7f84740b0e20 2023-07-14T11:14:04.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.600+0000 7f847b1ff700 1 -- 172.21.15.84:0/2476917176 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84740b6890 con 0x7f84740b0e20 2023-07-14T11:14:04.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.602+0000 7f847b1ff700 1 -- 172.21.15.84:0/2476917176 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84740d0400 con 0x7f84740b0e20 2023-07-14T11:14:04.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.602+0000 7f84717fa700 1 -- 172.21.15.84:0/2476917176 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8468007470 con 0x7f84740b0e20 2023-07-14T11:14:04.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.603+0000 7f84717fa700 1 --2- 172.21.15.84:0/2476917176 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f845806ace0 0x7f845806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:04.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.604+0000 7f84717fa700 1 -- 172.21.15.84:0/2476917176 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f84680891d0 con 0x7f84740b0e20 2023-07-14T11:14:04.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.604+0000 7f8473fff700 1 --2- 172.21.15.84:0/2476917176 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f845806ace0 0x7f845806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:04.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.604+0000 7f8473fff700 1 --2- 172.21.15.84:0/2476917176 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f845806ace0 0x7f845806d190 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f84600090b0 tx=0x7f8460008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:04.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.607+0000 7f84717fa700 1 -- 172.21.15.84:0/2476917176 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f84740d0400 con 0x7f84740b0e20 2023-07-14T11:14:04.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.800+0000 7f847b1ff700 1 -- 172.21.15.84:0/2476917176 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f84740b66f0 con 0x7f84740b0e20 2023-07-14T11:14:04.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.800+0000 7f84717fa700 1 -- 172.21.15.84:0/2476917176 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f84740b66f0 con 0x7f84740b0e20 2023-07-14T11:14:04.803 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-07-14T11:14:04.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.802+0000 7f847b1ff700 1 -- 172.21.15.84:0/2476917176 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f845806ace0 msgr2=0x7f845806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:04.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.802+0000 7f847b1ff700 1 --2- 172.21.15.84:0/2476917176 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f845806ace0 0x7f845806d190 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f84600090b0 tx=0x7f8460008030 comp rx=0 tx=0).stop 2023-07-14T11:14:04.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.802+0000 7f847b1ff700 1 -- 172.21.15.84:0/2476917176 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84740b0e20 msgr2=0x7f847414cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:04.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.802+0000 7f847b1ff700 1 --2- 172.21.15.84:0/2476917176 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84740b0e20 0x7f847414cb70 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f84680011e0 tx=0x7f846800cae0 comp rx=0 tx=0).stop 2023-07-14T11:14:04.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.803+0000 7f847b1ff700 1 -- 172.21.15.84:0/2476917176 shutdown_connections 2023-07-14T11:14:04.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.803+0000 7f847b1ff700 1 --2- 172.21.15.84:0/2476917176 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f845806ace0 0x7f845806d190 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:04.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.803+0000 7f847b1ff700 1 --2- 172.21.15.84:0/2476917176 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84740d0b10 0x7f84741f1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:04.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.803+0000 7f847b1ff700 1 --2- 172.21.15.84:0/2476917176 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84740b0e20 0x7f847414cb70 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:04.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.803+0000 7f847b1ff700 1 --2- 172.21.15.84:0/2476917176 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84740b8a60 0x7f84740cf6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:04.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.803+0000 7f847b1ff700 1 -- 172.21.15.84:0/2476917176 >> 172.21.15.84:0/2476917176 conn(0x7f847409c1b0 msgr2=0x7f847406bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:04.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.803+0000 7f847b1ff700 1 -- 172.21.15.84:0/2476917176 shutdown_connections 2023-07-14T11:14:04.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:04.803+0000 7f847b1ff700 1 -- 172.21.15.84:0/2476917176 wait complete. 2023-07-14T11:14:04.823 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-14T11:14:05.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.019+0000 7f2013dff700 1 Processor -- start 2023-07-14T11:14:05.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.020+0000 7f2013dff700 1 -- start start 2023-07-14T11:14:05.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.021+0000 7f2013dff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f200c0b8a60 0x7f200c0b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:05.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.021+0000 7f2013dff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f200c0d1220 0x7f200c0b0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:05.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.021+0000 7f2013dff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f200c0b8e30 con 0x7f200c0b4530 2023-07-14T11:14:05.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.021+0000 7f2013dff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f200c0afaa0 con 0x7f200c0b8a60 2023-07-14T11:14:05.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.021+0000 7f2013dff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f200c0afd80 con 0x7f200c0d1220 2023-07-14T11:14:05.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.021+0000 7f2011b9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f200c0b8a60 0x7f200c0b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:05.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.021+0000 7f201139a700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f200c0b4530 0x7f200c0d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55620/0 (socket says 172.21.15.84:55620) 2023-07-14T11:14:05.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.021+0000 7f201139a700 1 -- 172.21.15.84:0/1243001501 learned_addr learned my addr 172.21.15.84:0/1243001501 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:14:05.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.021+0000 7f201239c700 1 --2- 172.21.15.84:0/1243001501 >> v2:172.21.15.179:3300/0 conn(0x7f200c0d1220 0x7f200c0b0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:05.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.022+0000 7f2011b9b700 1 -- 172.21.15.84:0/1243001501 >> v2:172.21.15.179:3300/0 conn(0x7f200c0d1220 msgr2=0x7f200c0b0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:05.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.022+0000 7f2011b9b700 1 --2- 172.21.15.84:0/1243001501 >> v2:172.21.15.179:3300/0 conn(0x7f200c0d1220 0x7f200c0b0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:05.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.022+0000 7f2011b9b700 1 -- 172.21.15.84:0/1243001501 >> v1:172.21.15.84:6789/0 conn(0x7f200c0b4530 legacy=0x7f200c0d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:05.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.022+0000 7f2011b9b700 1 -- 172.21.15.84:0/1243001501 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f200c0b0060 con 0x7f200c0b8a60 2023-07-14T11:14:05.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.022+0000 7f201239c700 1 --2- 172.21.15.84:0/1243001501 >> v2:172.21.15.179:3300/0 conn(0x7f200c0d1220 0x7f200c0b0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:14:05.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.022+0000 7f2010b99700 1 -- 172.21.15.84:0/1243001501 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 517711110 0 0) 0x7f200c0b8e30 con 0x7f200c0b4530 2023-07-14T11:14:05.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.022+0000 7f2011b9b700 1 --2- 172.21.15.84:0/1243001501 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f200c0b8a60 0x7f200c0b3ff0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f200c0674e0 tx=0x7f2008009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=396adeb3c8db3a3a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:05.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.022+0000 7f2010b99700 1 -- 172.21.15.84:0/1243001501 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2008011830 con 0x7f200c0b8a60 2023-07-14T11:14:05.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.022+0000 7f2010b99700 1 -- 172.21.15.84:0/1243001501 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2008011990 con 0x7f200c0b8a60 2023-07-14T11:14:05.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.022+0000 7f2010b99700 1 -- 172.21.15.84:0/1243001501 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2008011d20 con 0x7f200c0b8a60 2023-07-14T11:14:05.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.023+0000 7f2013dff700 1 -- 172.21.15.84:0/1243001501 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f200c0b8a60 msgr2=0x7f200c0b3ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:05.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.023+0000 7f2013dff700 1 --2- 172.21.15.84:0/1243001501 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f200c0b8a60 0x7f200c0b3ff0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f200c0674e0 tx=0x7f2008009b20 comp rx=0 tx=0).stop 2023-07-14T11:14:05.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.023+0000 7f2013dff700 1 -- 172.21.15.84:0/1243001501 shutdown_connections 2023-07-14T11:14:05.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.023+0000 7f2013dff700 1 --2- 172.21.15.84:0/1243001501 >> v2:172.21.15.179:3300/0 conn(0x7f200c0d1220 0x7f200c0b0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:05.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.023+0000 7f2013dff700 1 --2- 172.21.15.84:0/1243001501 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f200c0b8a60 0x7f200c0b3ff0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:05.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.023+0000 7f2013dff700 1 -- 172.21.15.84:0/1243001501 >> 172.21.15.84:0/1243001501 conn(0x7f200c09c1b0 msgr2=0x7f200c0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:05.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.023+0000 7f2013dff700 1 -- 172.21.15.84:0/1243001501 shutdown_connections 2023-07-14T11:14:05.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.023+0000 7f2013dff700 1 -- 172.21.15.84:0/1243001501 wait complete. 2023-07-14T11:14:05.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.025+0000 7f2013dff700 1 Processor -- start 2023-07-14T11:14:05.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.025+0000 7f2013dff700 1 -- start start 2023-07-14T11:14:05.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.026+0000 7f2013dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f200c0b4530 0x7f200c154b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:05.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.026+0000 7f2013dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f200c0b8a60 0x7f200c156070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:05.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.026+0000 7f2013dff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f200c0d1220 0x7f200c1e6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:05.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.026+0000 7f2013dff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f200c155050 con 0x7f200c0d1220 2023-07-14T11:14:05.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.026+0000 7f2013dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f200c1f6a90 con 0x7f200c0b4530 2023-07-14T11:14:05.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.026+0000 7f2013dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f200c1f6600 con 0x7f200c0b8a60 2023-07-14T11:14:05.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.026+0000 7f201239c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f200c0d1220 0x7f200c1e6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:05.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.026+0000 7f201239c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f200c0d1220 0x7f200c1e6330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55616/0 (socket says 172.21.15.84:55616) 2023-07-14T11:14:05.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.026+0000 7f201239c700 1 -- 172.21.15.84:0/157926819 learned_addr learned my addr 172.21.15.84:0/157926819 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:05.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.026+0000 7f2011b9b700 1 --2- 172.21.15.84:0/157926819 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f200c0b4530 0x7f200c154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:05.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.026+0000 7f201139a700 1 --2- 172.21.15.84:0/157926819 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f200c0b8a60 0x7f200c156070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:05.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.026+0000 7f201239c700 1 -- 172.21.15.84:0/157926819 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f200c0b8a60 msgr2=0x7f200c156070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:05.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.026+0000 7f201239c700 1 --2- 172.21.15.84:0/157926819 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f200c0b8a60 0x7f200c156070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:05.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.026+0000 7f201239c700 1 -- 172.21.15.84:0/157926819 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f200c0b4530 msgr2=0x7f200c154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:05.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.026+0000 7f201239c700 1 --2- 172.21.15.84:0/157926819 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f200c0b4530 0x7f200c154b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:05.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.026+0000 7f201239c700 1 -- 172.21.15.84:0/157926819 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20080094a0 con 0x7f200c0d1220 2023-07-14T11:14:05.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.027+0000 7f201239c700 1 --2- 172.21.15.84:0/157926819 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f200c0d1220 0x7f200c1e6330 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2004007ef0 tx=0x7f200400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:05.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.027+0000 7f20027fc700 1 -- 172.21.15.84:0/157926819 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2004015400 con 0x7f200c0d1220 2023-07-14T11:14:05.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.027+0000 7f20027fc700 1 -- 172.21.15.84:0/157926819 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f200400f040 con 0x7f200c0d1220 2023-07-14T11:14:05.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.027+0000 7f20027fc700 1 -- 172.21.15.84:0/157926819 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20040157a0 con 0x7f200c0d1220 2023-07-14T11:14:05.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.027+0000 7f2013dff700 1 -- 172.21.15.84:0/157926819 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f200c156b10 con 0x7f200c0d1220 2023-07-14T11:14:05.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.027+0000 7f2013dff700 1 -- 172.21.15.84:0/157926819 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f200c1f5fb0 con 0x7f200c0d1220 2023-07-14T11:14:05.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.028+0000 7f2013dff700 1 -- 172.21.15.84:0/157926819 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f200c0723e0 con 0x7f200c0d1220 2023-07-14T11:14:05.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.029+0000 7f20027fc700 1 -- 172.21.15.84:0/157926819 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f200401e3b0 con 0x7f200c0d1220 2023-07-14T11:14:05.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.030+0000 7f20027fc700 1 --2- 172.21.15.84:0/157926819 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1ff006ace0 0x7f1ff006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:05.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.030+0000 7f20027fc700 1 -- 172.21.15.84:0/157926819 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f2004089700 con 0x7f200c0d1220 2023-07-14T11:14:05.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.030+0000 7f2011b9b700 1 --2- 172.21.15.84:0/157926819 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1ff006ace0 0x7f1ff006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:05.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.031+0000 7f2011b9b700 1 --2- 172.21.15.84:0/157926819 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1ff006ace0 0x7f1ff006d190 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f20080090b0 tx=0x7f2008008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:05.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.035+0000 7f20027fc700 1 -- 172.21.15.84:0/157926819 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f2004054770 con 0x7f200c0d1220 2023-07-14T11:14:05.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.245+0000 7f2013dff700 1 -- 172.21.15.84:0/157926819 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f200c0b8610 con 0x7f200c0d1220 2023-07-14T11:14:05.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.245+0000 7f20027fc700 1 -- 172.21.15.84:0/157926819 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2004057d90 con 0x7f200c0d1220 2023-07-14T11:14:05.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.247+0000 7f2013dff700 1 -- 172.21.15.84:0/157926819 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1ff006ace0 msgr2=0x7f1ff006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:05.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.247+0000 7f2013dff700 1 --2- 172.21.15.84:0/157926819 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1ff006ace0 0x7f1ff006d190 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f20080090b0 tx=0x7f2008008030 comp rx=0 tx=0).stop 2023-07-14T11:14:05.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.247+0000 7f2013dff700 1 -- 172.21.15.84:0/157926819 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f200c0d1220 msgr2=0x7f200c1e6330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:05.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.247+0000 7f2013dff700 1 --2- 172.21.15.84:0/157926819 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f200c0d1220 0x7f200c1e6330 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2004007ef0 tx=0x7f200400d3b0 comp rx=0 tx=0).stop 2023-07-14T11:14:05.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.248+0000 7f2013dff700 1 -- 172.21.15.84:0/157926819 shutdown_connections 2023-07-14T11:14:05.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.248+0000 7f2013dff700 1 --2- 172.21.15.84:0/157926819 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f200c0d1220 0x7f200c1e6330 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:05.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.248+0000 7f2013dff700 1 --2- 172.21.15.84:0/157926819 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f200c0b4530 0x7f200c154b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:05.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.248+0000 7f2013dff700 1 --2- 172.21.15.84:0/157926819 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1ff006ace0 0x7f1ff006d190 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:05.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.248+0000 7f2013dff700 1 --2- 172.21.15.84:0/157926819 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f200c0b8a60 0x7f200c156070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:05.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.248+0000 7f2013dff700 1 -- 172.21.15.84:0/157926819 >> 172.21.15.84:0/157926819 conn(0x7f200c09c1b0 msgr2=0x7f200c0d0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:05.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.248+0000 7f2013dff700 1 -- 172.21.15.84:0/157926819 shutdown_connections 2023-07-14T11:14:05.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.248+0000 7f2013dff700 1 -- 172.21.15.84:0/157926819 wait complete. 2023-07-14T11:14:05.252 INFO:teuthology.orchestra.run.smithi084.stderr:listed 0 entries 2023-07-14T11:14:05.267 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-07-14T11:14:05.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:14:05.268 DEBUG:teuthology.orchestra.run.smithi084:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-07-14T11:14:05.353 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi084.front.sepia.ceph.com 2023-07-14T11:14:05.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:14:05.354 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-07-14T11:14:05.400 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-07-14T11:14:05.401 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:14:05.452 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-07-14T11:14:05.453 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:14:05.500 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-07-14T11:14:05.501 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:14:05.587 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:14:05.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.781+0000 7f7ee6fff700 1 Processor -- start 2023-07-14T11:14:05.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.781+0000 7f7ee6fff700 1 -- start start 2023-07-14T11:14:05.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.782+0000 7f7ee6fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ee0160030 0x7f7ee006c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:05.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.782+0000 7f7ee6fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7ee00b5cd0 0x7f7ee00d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:05.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.783+0000 7f7ee6fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7ee00b1f70 0x7f7ee00d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:05.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.783+0000 7f7ee6fff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ee00d2cc0 con 0x7f7ee00b1f70 2023-07-14T11:14:05.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.783+0000 7f7ee6fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ee00afbb0 con 0x7f7ee00b5cd0 2023-07-14T11:14:05.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.783+0000 7f7ee6fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee00afe90 con 0x7f7ee0160030 2023-07-14T11:14:05.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.783+0000 7f7ee559c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7ee00b1f70 0x7f7ee00d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:05.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.783+0000 7f7ee559c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7ee00b1f70 0x7f7ee00d0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55632/0 (socket says 172.21.15.84:55632) 2023-07-14T11:14:05.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.783+0000 7f7ee559c700 1 -- 172.21.15.84:0/16127366 learned_addr learned my addr 172.21.15.84:0/16127366 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:05.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.783+0000 7f7ee4d9b700 1 --2- 172.21.15.84:0/16127366 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ee0160030 0x7f7ee006c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:05.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.783+0000 7f7edffff700 1 --2- 172.21.15.84:0/16127366 >> v2:172.21.15.179:3300/0 conn(0x7f7ee00b5cd0 0x7f7ee00d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:05.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.783+0000 7f7ee559c700 1 -- 172.21.15.84:0/16127366 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ee0160030 msgr2=0x7f7ee006c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:05.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.783+0000 7f7ee559c700 1 --2- 172.21.15.84:0/16127366 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ee0160030 0x7f7ee006c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:05.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.783+0000 7f7ee559c700 1 -- 172.21.15.84:0/16127366 >> v2:172.21.15.179:3300/0 conn(0x7f7ee00b5cd0 msgr2=0x7f7ee00d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:05.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.783+0000 7f7ee559c700 1 --2- 172.21.15.84:0/16127366 >> v2:172.21.15.179:3300/0 conn(0x7f7ee00b5cd0 0x7f7ee00d0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:05.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.783+0000 7f7ee559c700 1 -- 172.21.15.84:0/16127366 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee00b0170 con 0x7f7ee00b1f70 2023-07-14T11:14:05.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.783+0000 7f7ee4d9b700 1 --2- 172.21.15.84:0/16127366 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ee0160030 0x7f7ee006c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:14:05.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.783+0000 7f7edffff700 1 --2- 172.21.15.84:0/16127366 >> v2:172.21.15.179:3300/0 conn(0x7f7ee00b5cd0 0x7f7ee00d0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:14:05.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.783+0000 7f7ee559c700 1 --2- 172.21.15.84:0/16127366 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ee00b1f70 0x7f7ee00d0f90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7ee008c020 tx=0x7f7ed800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37003ae50435f79 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:05.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.784+0000 7f7edf7fe700 1 -- 172.21.15.84:0/16127366 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed800e070 con 0x7f7ee00b1f70 2023-07-14T11:14:05.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.784+0000 7f7edf7fe700 1 -- 172.21.15.84:0/16127366 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed800b9c0 con 0x7f7ee00b1f70 2023-07-14T11:14:05.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.784+0000 7f7edf7fe700 1 -- 172.21.15.84:0/16127366 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed800bd70 con 0x7f7ee00b1f70 2023-07-14T11:14:05.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.784+0000 7f7ee6fff700 1 -- 172.21.15.84:0/16127366 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ee00b1f70 msgr2=0x7f7ee00d0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:05.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.784+0000 7f7ee6fff700 1 --2- 172.21.15.84:0/16127366 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ee00b1f70 0x7f7ee00d0f90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7ee008c020 tx=0x7f7ed800b330 comp rx=0 tx=0).stop 2023-07-14T11:14:05.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.784+0000 7f7ee6fff700 1 -- 172.21.15.84:0/16127366 shutdown_connections 2023-07-14T11:14:05.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.784+0000 7f7ee6fff700 1 --2- 172.21.15.84:0/16127366 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ee0160030 0x7f7ee006c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:05.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.784+0000 7f7ee6fff700 1 --2- 172.21.15.84:0/16127366 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ee00b1f70 0x7f7ee00d0f90 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:05.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.784+0000 7f7ee6fff700 1 --2- 172.21.15.84:0/16127366 >> v2:172.21.15.179:3300/0 conn(0x7f7ee00b5cd0 0x7f7ee00d0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:05.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.784+0000 7f7ee6fff700 1 -- 172.21.15.84:0/16127366 >> 172.21.15.84:0/16127366 conn(0x7f7ee009c190 msgr2=0x7f7ee00d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:05.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.784+0000 7f7ee6fff700 1 -- 172.21.15.84:0/16127366 shutdown_connections 2023-07-14T11:14:05.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.784+0000 7f7ee6fff700 1 -- 172.21.15.84:0/16127366 wait complete. 2023-07-14T11:14:05.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.786+0000 7f7ee6fff700 1 Processor -- start 2023-07-14T11:14:05.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.786+0000 7f7ee6fff700 1 -- start start 2023-07-14T11:14:05.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.787+0000 7f7ee6fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ee00b1f70 0x7f7ee01f1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:05.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.787+0000 7f7ee6fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ee00b5cd0 0x7f7ee015ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:05.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.787+0000 7f7ee6fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ee0160030 0x7f7ee0156c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:05.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.787+0000 7f7ee6fff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee0158bd0 con 0x7f7ee00b1f70 2023-07-14T11:14:05.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.787+0000 7f7ee6fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee0158e00 con 0x7f7ee0160030 2023-07-14T11:14:05.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.787+0000 7f7ee6fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee01590e0 con 0x7f7ee00b5cd0 2023-07-14T11:14:05.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.787+0000 7f7ee4d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ee00b1f70 0x7f7ee01f1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:05.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.787+0000 7f7ee4d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ee00b1f70 0x7f7ee01f1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55636/0 (socket says 172.21.15.84:55636) 2023-07-14T11:14:05.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.787+0000 7f7ee4d9b700 1 -- 172.21.15.84:0/1498487695 learned_addr learned my addr 172.21.15.84:0/1498487695 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:05.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.788+0000 7f7edffff700 1 --2- 172.21.15.84:0/1498487695 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ee00b5cd0 0x7f7ee015ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:05.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.788+0000 7f7ee559c700 1 --2- 172.21.15.84:0/1498487695 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ee0160030 0x7f7ee0156c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:05.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.788+0000 7f7ee4d9b700 1 -- 172.21.15.84:0/1498487695 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ee00b5cd0 msgr2=0x7f7ee015ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:05.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.788+0000 7f7ee4d9b700 1 --2- 172.21.15.84:0/1498487695 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ee00b5cd0 0x7f7ee015ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:05.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.788+0000 7f7ee4d9b700 1 -- 172.21.15.84:0/1498487695 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ee0160030 msgr2=0x7f7ee0156c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:05.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.788+0000 7f7ee4d9b700 1 --2- 172.21.15.84:0/1498487695 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ee0160030 0x7f7ee0156c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:05.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.788+0000 7f7ee4d9b700 1 -- 172.21.15.84:0/1498487695 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed8009b30 con 0x7f7ee00b1f70 2023-07-14T11:14:05.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.788+0000 7f7edffff700 1 --2- 172.21.15.84:0/1498487695 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ee00b5cd0 0x7f7ee015ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:14:05.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.788+0000 7f7ee559c700 1 --2- 172.21.15.84:0/1498487695 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ee0160030 0x7f7ee0156c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:14:05.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.788+0000 7f7ee4d9b700 1 --2- 172.21.15.84:0/1498487695 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ee00b1f70 0x7f7ee01f1bc0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7ed400e810 tx=0x7f7ed400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:05.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.788+0000 7f7edd7fa700 1 -- 172.21.15.84:0/1498487695 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed400c020 con 0x7f7ee00b1f70 2023-07-14T11:14:05.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.788+0000 7f7edd7fa700 1 -- 172.21.15.84:0/1498487695 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed4004250 con 0x7f7ee00b1f70 2023-07-14T11:14:05.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.788+0000 7f7edd7fa700 1 -- 172.21.15.84:0/1498487695 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed40036a0 con 0x7f7ee00b1f70 2023-07-14T11:14:05.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.788+0000 7f7ee6fff700 1 -- 172.21.15.84:0/1498487695 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ee01593c0 con 0x7f7ee00b1f70 2023-07-14T11:14:05.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.788+0000 7f7ee6fff700 1 -- 172.21.15.84:0/1498487695 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ee0159980 con 0x7f7ee00b1f70 2023-07-14T11:14:05.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.789+0000 7f7ee6fff700 1 -- 172.21.15.84:0/1498487695 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ee0159cf0 con 0x7f7ee00b1f70 2023-07-14T11:14:05.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.790+0000 7f7edd7fa700 1 -- 172.21.15.84:0/1498487695 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7ed4003800 con 0x7f7ee00b1f70 2023-07-14T11:14:05.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.791+0000 7f7edd7fa700 1 --2- 172.21.15.84:0/1498487695 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f7ec406ace0 0x7f7ec406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:05.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.792+0000 7f7edd7fa700 1 -- 172.21.15.84:0/1498487695 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f7ed4089280 con 0x7f7ee00b1f70 2023-07-14T11:14:05.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.792+0000 7f7edffff700 1 --2- 172.21.15.84:0/1498487695 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f7ec406ace0 0x7f7ec406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:05.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.792+0000 7f7edffff700 1 --2- 172.21.15.84:0/1498487695 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f7ec406ace0 0x7f7ec406d190 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7ee00a0dd0 tx=0x7f7ecc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:05.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.795+0000 7f7edd7fa700 1 -- 172.21.15.84:0/1498487695 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7ed40542e0 con 0x7f7ee00b1f70 2023-07-14T11:14:05.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.989+0000 7f7ee6fff700 1 -- 172.21.15.84:0/1498487695 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ee0159b10 con 0x7f7ee00b1f70 2023-07-14T11:14:05.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.990+0000 7f7edd7fa700 1 -- 172.21.15.84:0/1498487695 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18351 (secure 0 0 0) 0x7f7ed4057900 con 0x7f7ee00b1f70 2023-07-14T11:14:05.993 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:14:05.993 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":25,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:13:55.825723+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-14T11:13:12.727811+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-14T11:13:13.436391+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.17","mappings":[{"from":3,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:14:05.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.993+0000 7f7ee6fff700 1 -- 172.21.15.84:0/1498487695 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f7ec406ace0 msgr2=0x7f7ec406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:05.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.993+0000 7f7ee6fff700 1 --2- 172.21.15.84:0/1498487695 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f7ec406ace0 0x7f7ec406d190 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7ee00a0dd0 tx=0x7f7ecc008040 comp rx=0 tx=0).stop 2023-07-14T11:14:05.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.993+0000 7f7ee6fff700 1 -- 172.21.15.84:0/1498487695 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ee00b1f70 msgr2=0x7f7ee01f1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:05.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.993+0000 7f7ee6fff700 1 --2- 172.21.15.84:0/1498487695 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ee00b1f70 0x7f7ee01f1bc0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7ed400e810 tx=0x7f7ed400ebd0 comp rx=0 tx=0).stop 2023-07-14T11:14:05.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.993+0000 7f7ee6fff700 1 -- 172.21.15.84:0/1498487695 shutdown_connections 2023-07-14T11:14:05.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.993+0000 7f7ee6fff700 1 --2- 172.21.15.84:0/1498487695 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ee0160030 0x7f7ee0156c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:05.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.993+0000 7f7ee6fff700 1 --2- 172.21.15.84:0/1498487695 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ee00b1f70 0x7f7ee01f1bc0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:05.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.993+0000 7f7ee6fff700 1 --2- 172.21.15.84:0/1498487695 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f7ec406ace0 0x7f7ec406d190 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:05.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.993+0000 7f7ee6fff700 1 --2- 172.21.15.84:0/1498487695 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ee00b5cd0 0x7f7ee015ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:05.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.993+0000 7f7ee6fff700 1 -- 172.21.15.84:0/1498487695 >> 172.21.15.84:0/1498487695 conn(0x7f7ee009c190 msgr2=0x7f7ee00d2e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:05.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.993+0000 7f7ee6fff700 1 -- 172.21.15.84:0/1498487695 shutdown_connections 2023-07-14T11:14:05.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:05.993+0000 7f7ee6fff700 1 -- 172.21.15.84:0/1498487695 wait complete. 2023-07-14T11:14:06.013 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T11:13:00.125395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T11:13:06.803994+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T11:13:12.727811+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T11:13:13.436391+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T11:14:06.014 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T11:14:06.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.213+0000 7f5eaedff700 1 Processor -- start 2023-07-14T11:14:06.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.213+0000 7f5eaedff700 1 -- start start 2023-07-14T11:14:06.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.215+0000 7f5eaedff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5ea815c860 0x7f5ea80d1e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:06.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.215+0000 7f5eaedff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ea80cd5a0 con 0x7f5ea80cf2a0 2023-07-14T11:14:06.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.215+0000 7f5eaedff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ea80cd7f0 con 0x7f5ea80c71b0 2023-07-14T11:14:06.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.215+0000 7f5eaedff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ea8146740 con 0x7f5ea815c860 2023-07-14T11:14:06.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.215+0000 7f5ea7fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f5ea80cf2a0 0x7f5ea80c6aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55626/0 (socket says 172.21.15.84:55626) 2023-07-14T11:14:06.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.215+0000 7f5ea7fff700 1 -- 172.21.15.84:0/1353883242 learned_addr learned my addr 172.21.15.84:0/1353883242 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:14:06.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.215+0000 7f5eacb9b700 1 --2- 172.21.15.84:0/1353883242 >> v2:172.21.15.84:3300/0 conn(0x7f5ea815c860 0x7f5ea80d1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:06.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.216+0000 7f5ea77fe700 1 -- 172.21.15.84:0/1353883242 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 659888651 0 0) 0x7f5ea80cd5a0 con 0x7f5ea80cf2a0 2023-07-14T11:14:06.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.216+0000 7f5eacb9b700 1 -- 172.21.15.84:0/1353883242 >> v1:172.21.15.179:6789/0 conn(0x7f5ea80c71b0 legacy=0x7f5ea80b49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:06.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.216+0000 7f5eacb9b700 1 -- 172.21.15.84:0/1353883242 >> v1:172.21.15.84:6789/0 conn(0x7f5ea80cf2a0 legacy=0x7f5ea80c6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:06.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.216+0000 7f5eacb9b700 1 -- 172.21.15.84:0/1353883242 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ea80cdad0 con 0x7f5ea815c860 2023-07-14T11:14:06.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.216+0000 7f5eacb9b700 1 --2- 172.21.15.84:0/1353883242 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ea815c860 0x7f5ea80d1e40 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c009840 tx=0x7f5e9c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6565b8ec5d42118 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:06.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.216+0000 7f5ea77fe700 1 -- 172.21.15.84:0/1353883242 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9c011830 con 0x7f5ea815c860 2023-07-14T11:14:06.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.216+0000 7f5ea77fe700 1 -- 172.21.15.84:0/1353883242 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e9c011990 con 0x7f5ea815c860 2023-07-14T11:14:06.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.216+0000 7f5ea77fe700 1 -- 172.21.15.84:0/1353883242 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9c011d20 con 0x7f5ea815c860 2023-07-14T11:14:06.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.217+0000 7f5eaedff700 1 -- 172.21.15.84:0/1353883242 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ea815c860 msgr2=0x7f5ea80d1e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:06.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.217+0000 7f5eaedff700 1 --2- 172.21.15.84:0/1353883242 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ea815c860 0x7f5ea80d1e40 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c009840 tx=0x7f5e9c009b50 comp rx=0 tx=0).stop 2023-07-14T11:14:06.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.217+0000 7f5eaedff700 1 -- 172.21.15.84:0/1353883242 shutdown_connections 2023-07-14T11:14:06.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.217+0000 7f5eaedff700 1 --2- 172.21.15.84:0/1353883242 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ea815c860 0x7f5ea80d1e40 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:06.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.217+0000 7f5eaedff700 1 -- 172.21.15.84:0/1353883242 >> 172.21.15.84:0/1353883242 conn(0x7f5ea8065bd0 msgr2=0x7f5ea8065fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:06.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.217+0000 7f5eaedff700 1 -- 172.21.15.84:0/1353883242 shutdown_connections 2023-07-14T11:14:06.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.217+0000 7f5eaedff700 1 -- 172.21.15.84:0/1353883242 wait complete. 2023-07-14T11:14:06.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.219+0000 7f5eaedff700 1 Processor -- start 2023-07-14T11:14:06.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.219+0000 7f5eaedff700 1 -- start start 2023-07-14T11:14:06.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.220+0000 7f5eaedff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ea80c71b0 0x7f5ea81580f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:06.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.220+0000 7f5eaedff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ea80cf2a0 0x7f5ea80c5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:06.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.220+0000 7f5eaedff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ea815c860 0x7f5ea80c5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:06.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.220+0000 7f5eaedff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea81544b0 con 0x7f5ea80cf2a0 2023-07-14T11:14:06.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.220+0000 7f5eaedff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea80c6290 con 0x7f5ea815c860 2023-07-14T11:14:06.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.220+0000 7f5eaedff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea80b5f20 con 0x7f5ea80c71b0 2023-07-14T11:14:06.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.220+0000 7f5ea7fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ea80cf2a0 0x7f5ea80c5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:06.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.220+0000 7f5ea7fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ea80cf2a0 0x7f5ea80c5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55644/0 (socket says 172.21.15.84:55644) 2023-07-14T11:14:06.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.220+0000 7f5ea7fff700 1 -- 172.21.15.84:0/3811043663 learned_addr learned my addr 172.21.15.84:0/3811043663 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:06.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.220+0000 7f5ead39c700 1 --2- 172.21.15.84:0/3811043663 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ea815c860 0x7f5ea80c5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:06.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.220+0000 7f5eacb9b700 1 --2- 172.21.15.84:0/3811043663 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ea80c71b0 0x7f5ea81580f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:06.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.220+0000 7f5ea7fff700 1 -- 172.21.15.84:0/3811043663 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ea80c71b0 msgr2=0x7f5ea81580f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:06.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.220+0000 7f5ea7fff700 1 --2- 172.21.15.84:0/3811043663 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ea80c71b0 0x7f5ea81580f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:06.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.220+0000 7f5ea7fff700 1 -- 172.21.15.84:0/3811043663 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ea815c860 msgr2=0x7f5ea80c5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:06.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.220+0000 7f5ea7fff700 1 --2- 172.21.15.84:0/3811043663 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ea815c860 0x7f5ea80c5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:06.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.220+0000 7f5ea7fff700 1 -- 172.21.15.84:0/3811043663 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e9c0094a0 con 0x7f5ea80cf2a0 2023-07-14T11:14:06.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.221+0000 7f5ea7fff700 1 --2- 172.21.15.84:0/3811043663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ea80cf2a0 0x7f5ea80c5810 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f5e9400c520 tx=0x7f5e9400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:06.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.221+0000 7f5ea57fa700 1 -- 172.21.15.84:0/3811043663 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e94004c80 con 0x7f5ea80cf2a0 2023-07-14T11:14:06.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.221+0000 7f5ea57fa700 1 -- 172.21.15.84:0/3811043663 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e94004de0 con 0x7f5ea80cf2a0 2023-07-14T11:14:06.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.221+0000 7f5eaedff700 1 -- 172.21.15.84:0/3811043663 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ea80b6200 con 0x7f5ea80cf2a0 2023-07-14T11:14:06.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.221+0000 7f5ea57fa700 1 -- 172.21.15.84:0/3811043663 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e94007310 con 0x7f5ea80cf2a0 2023-07-14T11:14:06.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.221+0000 7f5eaedff700 1 -- 172.21.15.84:0/3811043663 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ea80b67c0 con 0x7f5ea80cf2a0 2023-07-14T11:14:06.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.222+0000 7f5eaedff700 1 -- 172.21.15.84:0/3811043663 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ea80b69e0 con 0x7f5ea80cf2a0 2023-07-14T11:14:06.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.223+0000 7f5ea57fa700 1 -- 172.21.15.84:0/3811043663 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5e94007470 con 0x7f5ea80cf2a0 2023-07-14T11:14:06.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.224+0000 7f5ea57fa700 1 --2- 172.21.15.84:0/3811043663 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f5e8c06ad10 0x7f5e8c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:06.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.224+0000 7f5ea57fa700 1 -- 172.21.15.84:0/3811043663 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f5e94089120 con 0x7f5ea80cf2a0 2023-07-14T11:14:06.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.224+0000 7f5eacb9b700 1 --2- 172.21.15.84:0/3811043663 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f5e8c06ad10 0x7f5e8c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:06.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.225+0000 7f5eacb9b700 1 --2- 172.21.15.84:0/3811043663 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f5e8c06ad10 0x7f5e8c06d1c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c0090b0 tx=0x7f5e9c01c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:06.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.228+0000 7f5ea57fa700 1 -- 172.21.15.84:0/3811043663 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f5e94054190 con 0x7f5ea80cf2a0 2023-07-14T11:14:06.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.420+0000 7f5eaedff700 1 -- 172.21.15.84:0/3811043663 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5ea80723e0 con 0x7f5ea80cf2a0 2023-07-14T11:14:06.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.420+0000 7f5ea57fa700 1 -- 172.21.15.84:0/3811043663 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5e940577b0 con 0x7f5ea80cf2a0 2023-07-14T11:14:06.422 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-07-14T11:14:06.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.422+0000 7f5eaedff700 1 -- 172.21.15.84:0/3811043663 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f5e8c06ad10 msgr2=0x7f5e8c06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:06.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.422+0000 7f5eaedff700 1 --2- 172.21.15.84:0/3811043663 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f5e8c06ad10 0x7f5e8c06d1c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c0090b0 tx=0x7f5e9c01c040 comp rx=0 tx=0).stop 2023-07-14T11:14:06.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.422+0000 7f5eaedff700 1 -- 172.21.15.84:0/3811043663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ea80cf2a0 msgr2=0x7f5ea80c5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:06.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.422+0000 7f5eaedff700 1 --2- 172.21.15.84:0/3811043663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ea80cf2a0 0x7f5ea80c5810 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f5e9400c520 tx=0x7f5e9400c830 comp rx=0 tx=0).stop 2023-07-14T11:14:06.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.422+0000 7f5eaedff700 1 -- 172.21.15.84:0/3811043663 shutdown_connections 2023-07-14T11:14:06.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.422+0000 7f5eaedff700 1 --2- 172.21.15.84:0/3811043663 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f5e8c06ad10 0x7f5e8c06d1c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:06.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.422+0000 7f5eaedff700 1 --2- 172.21.15.84:0/3811043663 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ea80c71b0 0x7f5ea81580f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:06.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.422+0000 7f5eaedff700 1 --2- 172.21.15.84:0/3811043663 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ea815c860 0x7f5ea80c5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:06.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.422+0000 7f5eaedff700 1 --2- 172.21.15.84:0/3811043663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ea80cf2a0 0x7f5ea80c5810 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:06.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.422+0000 7f5eaedff700 1 -- 172.21.15.84:0/3811043663 >> 172.21.15.84:0/3811043663 conn(0x7f5ea8065bd0 msgr2=0x7f5ea8159ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:06.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.423+0000 7f5eaedff700 1 -- 172.21.15.84:0/3811043663 shutdown_connections 2023-07-14T11:14:06.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.423+0000 7f5eaedff700 1 -- 172.21.15.84:0/3811043663 wait complete. 2023-07-14T11:14:06.442 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T11:14:06.522 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T11:14:06.526 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T11:14:06.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.644+0000 7f58e559d700 1 Processor -- start 2023-07-14T11:14:06.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.644+0000 7f58e559d700 1 -- start start 2023-07-14T11:14:06.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.645+0000 7f58e559d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f58e015c870 0x7f58e00cd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:06.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.645+0000 7f58e559d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58e00cd7f0 0x7f58e00b1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:06.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.645+0000 7f58e559d700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58e00cdc40 con 0x7f58e00b1dc0 2023-07-14T11:14:06.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.645+0000 7f58e559d700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58e01611e0 con 0x7f58e015c870 2023-07-14T11:14:06.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.645+0000 7f58e559d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58e015cc40 con 0x7f58e00cd7f0 2023-07-14T11:14:06.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.645+0000 7f58dffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f58e015c870 0x7f58e00cd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:06.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.646+0000 7f58dffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f58e015c870 0x7f58e00cd2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55646/0 (socket says 172.21.15.84:55646) 2023-07-14T11:14:06.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.646+0000 7f58dffff700 1 -- 172.21.15.84:0/3659107219 learned_addr learned my addr 172.21.15.84:0/3659107219 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:06.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.645+0000 7f58e4d9c700 1 --1- 172.21.15.84:0/3659107219 >> v1:172.21.15.84:6789/0 conn(0x7f58e00b1dc0 0x7f58e00b46e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55632/0 (socket says 172.21.15.84:55632) 2023-07-14T11:14:06.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.646+0000 7f58df7fe700 1 --2- 172.21.15.84:0/3659107219 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58e00cd7f0 0x7f58e00b1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:06.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.646+0000 7f58dffff700 1 -- 172.21.15.84:0/3659107219 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58e00cd7f0 msgr2=0x7f58e00b1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:06.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.646+0000 7f58dffff700 1 --2- 172.21.15.84:0/3659107219 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58e00cd7f0 0x7f58e00b1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:06.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.646+0000 7f58dffff700 1 -- 172.21.15.84:0/3659107219 >> v1:172.21.15.84:6789/0 conn(0x7f58e00b1dc0 legacy=0x7f58e00b46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:06.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.646+0000 7f58dffff700 1 -- 172.21.15.84:0/3659107219 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58e0160460 con 0x7f58e015c870 2023-07-14T11:14:06.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.646+0000 7f58dffff700 1 --2- 172.21.15.84:0/3659107219 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58e015c870 0x7f58e00cd2b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f58d0009920 tx=0x7f58d0009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db11d7c2f4949891 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:06.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.646+0000 7f58deffd700 1 -- 172.21.15.84:0/3659107219 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d0011830 con 0x7f58e015c870 2023-07-14T11:14:06.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.647+0000 7f58deffd700 1 -- 172.21.15.84:0/3659107219 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58d0011990 con 0x7f58e015c870 2023-07-14T11:14:06.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.647+0000 7f58deffd700 1 -- 172.21.15.84:0/3659107219 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d0011d20 con 0x7f58e015c870 2023-07-14T11:14:06.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.647+0000 7f58e559d700 1 -- 172.21.15.84:0/3659107219 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58e015c870 msgr2=0x7f58e00cd2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:06.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.647+0000 7f58e559d700 1 --2- 172.21.15.84:0/3659107219 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58e015c870 0x7f58e00cd2b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f58d0009920 tx=0x7f58d0009c30 comp rx=0 tx=0).stop 2023-07-14T11:14:06.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.647+0000 7f58e559d700 1 -- 172.21.15.84:0/3659107219 shutdown_connections 2023-07-14T11:14:06.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.647+0000 7f58e559d700 1 --2- 172.21.15.84:0/3659107219 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58e015c870 0x7f58e00cd2b0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:06.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.647+0000 7f58e559d700 1 --2- 172.21.15.84:0/3659107219 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58e00cd7f0 0x7f58e00b1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:06.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.647+0000 7f58e559d700 1 -- 172.21.15.84:0/3659107219 >> 172.21.15.84:0/3659107219 conn(0x7f58e006a520 msgr2=0x7f58e006a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:06.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.647+0000 7f58e559d700 1 -- 172.21.15.84:0/3659107219 shutdown_connections 2023-07-14T11:14:06.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.647+0000 7f58e559d700 1 -- 172.21.15.84:0/3659107219 wait complete. 2023-07-14T11:14:06.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.649+0000 7f58e559d700 1 Processor -- start 2023-07-14T11:14:06.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.649+0000 7f58e559d700 1 -- start start 2023-07-14T11:14:06.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.650+0000 7f58e559d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58e00b1dc0 0x7f58e00b28f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:06.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.650+0000 7f58e559d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58e00cd7f0 0x7f58e00c6790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:06.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.650+0000 7f58e559d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58e015c870 0x7f58e014c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:06.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.650+0000 7f58e559d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58e014d580 con 0x7f58e00cd7f0 2023-07-14T11:14:06.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.650+0000 7f58e559d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58e00c7710 con 0x7f58e00b1dc0 2023-07-14T11:14:06.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.650+0000 7f58e559d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58e00c6e70 con 0x7f58e015c870 2023-07-14T11:14:06.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.650+0000 7f58df7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58e00cd7f0 0x7f58e00c6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:06.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.650+0000 7f58df7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58e00cd7f0 0x7f58e00c6790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55658/0 (socket says 172.21.15.84:55658) 2023-07-14T11:14:06.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.650+0000 7f58df7fe700 1 -- 172.21.15.84:0/3438369713 learned_addr learned my addr 172.21.15.84:0/3438369713 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:06.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.650+0000 7f58e4d9c700 1 --2- 172.21.15.84:0/3438369713 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58e015c870 0x7f58e014c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:06.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.650+0000 7f58dffff700 1 --2- 172.21.15.84:0/3438369713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58e00b1dc0 0x7f58e00b28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:06.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.651+0000 7f58df7fe700 1 -- 172.21.15.84:0/3438369713 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58e015c870 msgr2=0x7f58e014c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:06.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.651+0000 7f58df7fe700 1 --2- 172.21.15.84:0/3438369713 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58e015c870 0x7f58e014c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:06.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.651+0000 7f58df7fe700 1 -- 172.21.15.84:0/3438369713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58e00b1dc0 msgr2=0x7f58e00b28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:06.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.651+0000 7f58df7fe700 1 --2- 172.21.15.84:0/3438369713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58e00b1dc0 0x7f58e00b28f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:06.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.651+0000 7f58df7fe700 1 -- 172.21.15.84:0/3438369713 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d0009550 con 0x7f58e00cd7f0 2023-07-14T11:14:06.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.651+0000 7f58dffff700 1 --2- 172.21.15.84:0/3438369713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58e00b1dc0 0x7f58e00b28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:14:06.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.651+0000 7f58df7fe700 1 --2- 172.21.15.84:0/3438369713 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58e00cd7f0 0x7f58e00c6790 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f58d400e9d0 tx=0x7f58d400ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:06.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.651+0000 7f58dcff9700 1 -- 172.21.15.84:0/3438369713 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d4009730 con 0x7f58e00cd7f0 2023-07-14T11:14:06.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.651+0000 7f58dcff9700 1 -- 172.21.15.84:0/3438369713 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58d400c850 con 0x7f58e00cd7f0 2023-07-14T11:14:06.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.651+0000 7f58dcff9700 1 -- 172.21.15.84:0/3438369713 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d400cbe0 con 0x7f58e00cd7f0 2023-07-14T11:14:06.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.651+0000 7f58e559d700 1 -- 172.21.15.84:0/3438369713 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58e00c7150 con 0x7f58e00cd7f0 2023-07-14T11:14:06.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.651+0000 7f58e559d700 1 -- 172.21.15.84:0/3438369713 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58e00c7e80 con 0x7f58e00cd7f0 2023-07-14T11:14:06.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.652+0000 7f58e559d700 1 -- 172.21.15.84:0/3438369713 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58e00c80a0 con 0x7f58e00cd7f0 2023-07-14T11:14:06.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.653+0000 7f58dcff9700 1 -- 172.21.15.84:0/3438369713 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f58d400cd40 con 0x7f58e00cd7f0 2023-07-14T11:14:06.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.654+0000 7f58dcff9700 1 --2- 172.21.15.84:0/3438369713 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f58cc06ace0 0x7f58cc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:06.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.654+0000 7f58dcff9700 1 -- 172.21.15.84:0/3438369713 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f58d40896c0 con 0x7f58e00cd7f0 2023-07-14T11:14:06.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.654+0000 7f58dffff700 1 --2- 172.21.15.84:0/3438369713 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f58cc06ace0 0x7f58cc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:06.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.655+0000 7f58dffff700 1 --2- 172.21.15.84:0/3438369713 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f58cc06ace0 0x7f58cc06d190 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f58d0000c00 tx=0x7f58d0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:06.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.658+0000 7f58dcff9700 1 -- 172.21.15.84:0/3438369713 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f58d4058120 con 0x7f58e00cd7f0 2023-07-14T11:14:06.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.857+0000 7f58e559d700 1 -- 172.21.15.84:0/3438369713 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f58e0067350 con 0x7f58e00cd7f0 2023-07-14T11:14:06.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.857+0000 7f58dcff9700 1 -- 172.21.15.84:0/3438369713 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f58d4057cb0 con 0x7f58e00cd7f0 2023-07-14T11:14:06.860 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-07-14T11:14:06.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.860+0000 7f58e559d700 1 -- 172.21.15.84:0/3438369713 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f58cc06ace0 msgr2=0x7f58cc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:06.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.860+0000 7f58e559d700 1 --2- 172.21.15.84:0/3438369713 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f58cc06ace0 0x7f58cc06d190 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f58d0000c00 tx=0x7f58d0008030 comp rx=0 tx=0).stop 2023-07-14T11:14:06.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.860+0000 7f58e559d700 1 -- 172.21.15.84:0/3438369713 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58e00cd7f0 msgr2=0x7f58e00c6790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:06.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.860+0000 7f58e559d700 1 --2- 172.21.15.84:0/3438369713 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58e00cd7f0 0x7f58e00c6790 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f58d400e9d0 tx=0x7f58d400ed90 comp rx=0 tx=0).stop 2023-07-14T11:14:06.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.860+0000 7f58e559d700 1 -- 172.21.15.84:0/3438369713 shutdown_connections 2023-07-14T11:14:06.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.860+0000 7f58e559d700 1 --2- 172.21.15.84:0/3438369713 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f58cc06ace0 0x7f58cc06d190 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:06.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.860+0000 7f58e559d700 1 --2- 172.21.15.84:0/3438369713 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58e015c870 0x7f58e014c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:06.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.860+0000 7f58e559d700 1 --2- 172.21.15.84:0/3438369713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58e00b1dc0 0x7f58e00b28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:06.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.860+0000 7f58e559d700 1 --2- 172.21.15.84:0/3438369713 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58e00cd7f0 0x7f58e00c6790 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:06.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.860+0000 7f58e559d700 1 -- 172.21.15.84:0/3438369713 >> 172.21.15.84:0/3438369713 conn(0x7f58e006a520 msgr2=0x7f58e00d1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:06.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.860+0000 7f58e559d700 1 -- 172.21.15.84:0/3438369713 shutdown_connections 2023-07-14T11:14:06.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:06.860+0000 7f58e559d700 1 -- 172.21.15.84:0/3438369713 wait complete. 2023-07-14T11:14:06.880 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T11:14:07.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.117+0000 7f40e51ff700 1 Processor -- start 2023-07-14T11:14:07.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.118+0000 7f40e51ff700 1 -- start start 2023-07-14T11:14:07.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.119+0000 7f40e51ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f40e00b8a60 0x7f40e00b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:07.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.119+0000 7f40e51ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f40e00b4530 0x7f40e00d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:07.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.119+0000 7f40e51ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40e00d1050 0x7f40e00b25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:07.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.119+0000 7f40e51ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40e00d14d0 con 0x7f40e00b4530 2023-07-14T11:14:07.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.119+0000 7f40e51ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40e00b8e30 con 0x7f40e00b8a60 2023-07-14T11:14:07.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.119+0000 7f40e51ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40e00afaa0 con 0x7f40e00d1050 2023-07-14T11:14:07.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.119+0000 7f40d7fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f40e00b4530 0x7f40e00d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:07.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.119+0000 7f40d7fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f40e00b4530 0x7f40e00d0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55664/0 (socket says 172.21.15.84:55664) 2023-07-14T11:14:07.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.119+0000 7f40d7fff700 1 -- 172.21.15.84:0/3265440844 learned_addr learned my addr 172.21.15.84:0/3265440844 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:07.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.119+0000 7f40ded9d700 1 --2- 172.21.15.84:0/3265440844 >> v2:172.21.15.179:3300/0 conn(0x7f40e00b8a60 0x7f40e00b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:07.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.119+0000 7f40df59e700 1 --2- 172.21.15.84:0/3265440844 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40e00d1050 0x7f40e00b25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:07.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.119+0000 7f40d7fff700 1 -- 172.21.15.84:0/3265440844 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40e00d1050 msgr2=0x7f40e00b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:07.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.119+0000 7f40d7fff700 1 --2- 172.21.15.84:0/3265440844 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40e00d1050 0x7f40e00b25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:07.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.119+0000 7f40d7fff700 1 -- 172.21.15.84:0/3265440844 >> v2:172.21.15.179:3300/0 conn(0x7f40e00b8a60 msgr2=0x7f40e00b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:07.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.119+0000 7f40d7fff700 1 --2- 172.21.15.84:0/3265440844 >> v2:172.21.15.179:3300/0 conn(0x7f40e00b8a60 0x7f40e00b3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:07.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.120+0000 7f40d7fff700 1 -- 172.21.15.84:0/3265440844 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e00afd80 con 0x7f40e00b4530 2023-07-14T11:14:07.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.120+0000 7f40df59e700 1 --2- 172.21.15.84:0/3265440844 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40e00d1050 0x7f40e00b25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:14:07.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.120+0000 7f40ded9d700 1 --2- 172.21.15.84:0/3265440844 >> v2:172.21.15.179:3300/0 conn(0x7f40e00b8a60 0x7f40e00b3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:14:07.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.120+0000 7f40d7fff700 1 --2- 172.21.15.84:0/3265440844 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40e00b4530 0x7f40e00d0b10 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f40e00b5b00 tx=0x7f40c8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ab25c159caf5467 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:07.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.120+0000 7f40de59c700 1 -- 172.21.15.84:0/3265440844 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c800b870 con 0x7f40e00b4530 2023-07-14T11:14:07.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.120+0000 7f40de59c700 1 -- 172.21.15.84:0/3265440844 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c800b9d0 con 0x7f40e00b4530 2023-07-14T11:14:07.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.120+0000 7f40de59c700 1 -- 172.21.15.84:0/3265440844 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c800bd60 con 0x7f40e00b4530 2023-07-14T11:14:07.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.121+0000 7f40e51ff700 1 -- 172.21.15.84:0/3265440844 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40e00b4530 msgr2=0x7f40e00d0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:07.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.121+0000 7f40e51ff700 1 --2- 172.21.15.84:0/3265440844 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40e00b4530 0x7f40e00d0b10 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f40e00b5b00 tx=0x7f40c8009bd0 comp rx=0 tx=0).stop 2023-07-14T11:14:07.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.121+0000 7f40e51ff700 1 -- 172.21.15.84:0/3265440844 shutdown_connections 2023-07-14T11:14:07.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.121+0000 7f40e51ff700 1 --2- 172.21.15.84:0/3265440844 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40e00d1050 0x7f40e00b25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:07.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.121+0000 7f40e51ff700 1 --2- 172.21.15.84:0/3265440844 >> v2:172.21.15.179:3300/0 conn(0x7f40e00b8a60 0x7f40e00b3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:07.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.121+0000 7f40e51ff700 1 --2- 172.21.15.84:0/3265440844 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40e00b4530 0x7f40e00d0b10 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:07.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.121+0000 7f40e51ff700 1 -- 172.21.15.84:0/3265440844 >> 172.21.15.84:0/3265440844 conn(0x7f40e009c1b0 msgr2=0x7f40e00d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:07.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.121+0000 7f40e51ff700 1 -- 172.21.15.84:0/3265440844 shutdown_connections 2023-07-14T11:14:07.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.121+0000 7f40e51ff700 1 -- 172.21.15.84:0/3265440844 wait complete. 2023-07-14T11:14:07.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.122+0000 7f40e51ff700 1 Processor -- start 2023-07-14T11:14:07.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.123+0000 7f40e51ff700 1 -- start start 2023-07-14T11:14:07.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.123+0000 7f40e51ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40e00b4530 0x7f40e015cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:07.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.123+0000 7f40e51ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40e00b8a60 0x7f40e015b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:07.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.124+0000 7f40e51ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40e00d1050 0x7f40e00cc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:07.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.124+0000 7f40e51ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e00cd810 con 0x7f40e00b4530 2023-07-14T11:14:07.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.124+0000 7f40e51ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e015d690 con 0x7f40e00d1050 2023-07-14T11:14:07.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.124+0000 7f40e51ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40e015d970 con 0x7f40e00b8a60 2023-07-14T11:14:07.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.124+0000 7f40ded9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40e00b4530 0x7f40e015cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:07.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.124+0000 7f40ded9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40e00b4530 0x7f40e015cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55676/0 (socket says 172.21.15.84:55676) 2023-07-14T11:14:07.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.124+0000 7f40ded9d700 1 -- 172.21.15.84:0/3374595360 learned_addr learned my addr 172.21.15.84:0/3374595360 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:07.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.124+0000 7f40d7fff700 1 --2- 172.21.15.84:0/3374595360 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40e00b8a60 0x7f40e015b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:07.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.124+0000 7f40df59e700 1 --2- 172.21.15.84:0/3374595360 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40e00d1050 0x7f40e00cc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:07.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.124+0000 7f40ded9d700 1 -- 172.21.15.84:0/3374595360 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40e00b8a60 msgr2=0x7f40e015b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:07.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.124+0000 7f40ded9d700 1 --2- 172.21.15.84:0/3374595360 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40e00b8a60 0x7f40e015b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:07.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.124+0000 7f40ded9d700 1 -- 172.21.15.84:0/3374595360 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40e00d1050 msgr2=0x7f40e00cc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:07.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.124+0000 7f40ded9d700 1 --2- 172.21.15.84:0/3374595360 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40e00d1050 0x7f40e00cc1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:07.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.124+0000 7f40ded9d700 1 -- 172.21.15.84:0/3374595360 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c8009550 con 0x7f40e00b4530 2023-07-14T11:14:07.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.124+0000 7f40df59e700 1 --2- 172.21.15.84:0/3374595360 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40e00d1050 0x7f40e00cc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:14:07.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.124+0000 7f40ded9d700 1 --2- 172.21.15.84:0/3374595360 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40e00b4530 0x7f40e015cdb0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f40d000d800 tx=0x7f40d000dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:07.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.124+0000 7f40d77fe700 1 -- 172.21.15.84:0/3374595360 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d0004030 con 0x7f40e00b4530 2023-07-14T11:14:07.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.125+0000 7f40d77fe700 1 -- 172.21.15.84:0/3374595360 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40d0004190 con 0x7f40e00b4530 2023-07-14T11:14:07.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.125+0000 7f40d77fe700 1 -- 172.21.15.84:0/3374595360 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d0004520 con 0x7f40e00b4530 2023-07-14T11:14:07.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.125+0000 7f40e51ff700 1 -- 172.21.15.84:0/3374595360 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40e015dc50 con 0x7f40e00b4530 2023-07-14T11:14:07.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.125+0000 7f40e51ff700 1 -- 172.21.15.84:0/3374595360 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40e015b670 con 0x7f40e00b4530 2023-07-14T11:14:07.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.126+0000 7f40e51ff700 1 -- 172.21.15.84:0/3374595360 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40e00cd570 con 0x7f40e00b4530 2023-07-14T11:14:07.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.127+0000 7f40d77fe700 1 -- 172.21.15.84:0/3374595360 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f40d00036a0 con 0x7f40e00b4530 2023-07-14T11:14:07.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.128+0000 7f40d77fe700 1 --2- 172.21.15.84:0/3374595360 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f40c006ace0 0x7f40c006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:07.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.128+0000 7f40d77fe700 1 -- 172.21.15.84:0/3374595360 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f40d0089940 con 0x7f40e00b4530 2023-07-14T11:14:07.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.128+0000 7f40d7fff700 1 --2- 172.21.15.84:0/3374595360 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f40c006ace0 0x7f40c006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:07.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.128+0000 7f40d7fff700 1 --2- 172.21.15.84:0/3374595360 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f40c006ace0 0x7f40c006d190 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f40c8009130 tx=0x7f40c8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:07.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.132+0000 7f40d77fe700 1 -- 172.21.15.84:0/3374595360 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f40e00cd570 con 0x7f40e00b4530 2023-07-14T11:14:07.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.327+0000 7f40e51ff700 1 -- 172.21.15.84:0/3374595360 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f40e00cd570 con 0x7f40e00b4530 2023-07-14T11:14:07.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.328+0000 7f40d77fe700 1 -- 172.21.15.84:0/3374595360 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f40e00cd570 con 0x7f40e00b4530 2023-07-14T11:14:07.330 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-07-14T11:14:07.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.330+0000 7f40e51ff700 1 -- 172.21.15.84:0/3374595360 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f40c006ace0 msgr2=0x7f40c006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:07.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.330+0000 7f40e51ff700 1 --2- 172.21.15.84:0/3374595360 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f40c006ace0 0x7f40c006d190 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f40c8009130 tx=0x7f40c8008030 comp rx=0 tx=0).stop 2023-07-14T11:14:07.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.330+0000 7f40e51ff700 1 -- 172.21.15.84:0/3374595360 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40e00b4530 msgr2=0x7f40e015cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:07.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.330+0000 7f40e51ff700 1 --2- 172.21.15.84:0/3374595360 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40e00b4530 0x7f40e015cdb0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f40d000d800 tx=0x7f40d000dbc0 comp rx=0 tx=0).stop 2023-07-14T11:14:07.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.330+0000 7f40e51ff700 1 -- 172.21.15.84:0/3374595360 shutdown_connections 2023-07-14T11:14:07.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.330+0000 7f40e51ff700 1 --2- 172.21.15.84:0/3374595360 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40e00d1050 0x7f40e00cc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:07.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.330+0000 7f40e51ff700 1 --2- 172.21.15.84:0/3374595360 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40e00b4530 0x7f40e015cdb0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:07.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.330+0000 7f40e51ff700 1 --2- 172.21.15.84:0/3374595360 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f40c006ace0 0x7f40c006d190 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:07.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.330+0000 7f40e51ff700 1 --2- 172.21.15.84:0/3374595360 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40e00b8a60 0x7f40e015b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:07.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.330+0000 7f40e51ff700 1 -- 172.21.15.84:0/3374595360 >> 172.21.15.84:0/3374595360 conn(0x7f40e009c1b0 msgr2=0x7f40e00b2530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:07.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.330+0000 7f40e51ff700 1 -- 172.21.15.84:0/3374595360 shutdown_connections 2023-07-14T11:14:07.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.330+0000 7f40e51ff700 1 -- 172.21.15.84:0/3374595360 wait complete. 2023-07-14T11:14:07.350 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T11:14:07.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.547+0000 7f1ef15ff700 1 Processor -- start 2023-07-14T11:14:07.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.547+0000 7f1ef15ff700 1 -- start start 2023-07-14T11:14:07.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.548+0000 7f1ef15ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1eec0d0b10 0x7f1eec0d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:07.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.548+0000 7f1ef15ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1eec0b0e20 0x7f1eec0b12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:07.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.548+0000 7f1ef15ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1eec0b8e30 con 0x7f1eec0b8a60 2023-07-14T11:14:07.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.548+0000 7f1ef15ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1eec0d14d0 con 0x7f1eec0d0b10 2023-07-14T11:14:07.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.548+0000 7f1ef15ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eec0afaa0 con 0x7f1eec0b0e20 2023-07-14T11:14:07.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.548+0000 7f1eeaffd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f1eec0b8a60 0x7f1eec0b3ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55634/0 (socket says 172.21.15.84:55634) 2023-07-14T11:14:07.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.549+0000 7f1eeaffd700 1 -- 172.21.15.84:0/789508786 learned_addr learned my addr 172.21.15.84:0/789508786 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:14:07.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.549+0000 7f1ee9ffb700 1 -- 172.21.15.84:0/789508786 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2147246198 0 0) 0x7f1eec0b8e30 con 0x7f1eec0b8a60 2023-07-14T11:14:07.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.549+0000 7f1ee9ffb700 1 -- 172.21.15.84:0/789508786 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ed40035b0 con 0x7f1eec0b8a60 2023-07-14T11:14:07.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.549+0000 7f1eea7fc700 1 --2- 172.21.15.84:0/789508786 >> v2:172.21.15.179:3300/0 conn(0x7f1eec0d0b10 0x7f1eec0d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:07.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.549+0000 7f1eeb7fe700 1 --2- 172.21.15.84:0/789508786 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1eec0b0e20 0x7f1eec0b12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:07.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.549+0000 7f1ee9ffb700 1 -- 172.21.15.84:0/789508786 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 375993296 0 0) 0x7f1ed40035b0 con 0x7f1eec0b8a60 2023-07-14T11:14:07.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.549+0000 7f1ee9ffb700 1 -- 172.21.15.84:0/789508786 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1eec0b0e20 msgr2=0x7f1eec0b12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:07.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.549+0000 7f1ee9ffb700 1 --2- 172.21.15.84:0/789508786 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1eec0b0e20 0x7f1eec0b12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:07.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.549+0000 7f1ee9ffb700 1 -- 172.21.15.84:0/789508786 >> v2:172.21.15.179:3300/0 conn(0x7f1eec0d0b10 msgr2=0x7f1eec0d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:07.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.549+0000 7f1ee9ffb700 1 --2- 172.21.15.84:0/789508786 >> v2:172.21.15.179:3300/0 conn(0x7f1eec0d0b10 0x7f1eec0d0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:07.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.549+0000 7f1ee9ffb700 1 -- 172.21.15.84:0/789508786 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eec0afd80 con 0x7f1eec0b8a60 2023-07-14T11:14:07.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.549+0000 7f1ee9ffb700 1 -- 172.21.15.84:0/789508786 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7f1edc001670 con 0x7f1eec0b8a60 2023-07-14T11:14:07.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.549+0000 7f1ee9ffb700 1 -- 172.21.15.84:0/789508786 >> v1:172.21.15.84:6789/0 conn(0x7f1eec0b8a60 legacy=0x7f1eec0b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:07.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.549+0000 7f1ee9ffb700 1 --2- 172.21.15.84:0/789508786 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ed4003a00 0x7f1ed4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:07.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.549+0000 7f1ee9ffb700 1 --2- 172.21.15.84:0/789508786 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ed4004850 0x7f1ed4004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:07.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.549+0000 7f1ee9ffb700 1 --2- 172.21.15.84:0/789508786 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1eec0b0e20 0x7f1ed4005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:07.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.550+0000 7f1ee9ffb700 1 -- 172.21.15.84:0/789508786 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eec0d14d0 con 0x7f1ed4004850 2023-07-14T11:14:07.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.550+0000 7f1ee9ffb700 1 -- 172.21.15.84:0/789508786 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eec0afaa0 con 0x7f1ed4003a00 2023-07-14T11:14:07.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.550+0000 7f1ee9ffb700 1 -- 172.21.15.84:0/789508786 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed400ba10 con 0x7f1eec0b0e20 2023-07-14T11:14:07.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.550+0000 7f1eea7fc700 1 --2- 172.21.15.84:0/789508786 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ed4004850 0x7f1ed4004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:07.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.550+0000 7f1eeaffd700 1 --2- 172.21.15.84:0/789508786 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ed4003a00 0x7f1ed4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:07.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.550+0000 7f1eeb7fe700 1 --2- 172.21.15.84:0/789508786 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1eec0b0e20 0x7f1ed4005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:07.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.550+0000 7f1eea7fc700 1 -- 172.21.15.84:0/789508786 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1eec0b0e20 msgr2=0x7f1ed4005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:07.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.550+0000 7f1eea7fc700 1 --2- 172.21.15.84:0/789508786 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1eec0b0e20 0x7f1ed4005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:07.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.550+0000 7f1eea7fc700 1 -- 172.21.15.84:0/789508786 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ed4003a00 msgr2=0x7f1ed4003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:07.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.550+0000 7f1eea7fc700 1 --2- 172.21.15.84:0/789508786 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ed4003a00 0x7f1ed4003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:07.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.550+0000 7f1eea7fc700 1 -- 172.21.15.84:0/789508786 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ed40035b0 con 0x7f1ed4004850 2023-07-14T11:14:07.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.550+0000 7f1eea7fc700 1 --2- 172.21.15.84:0/789508786 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ed4004850 0x7f1ed4004cc0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1ee0009b60 tx=0x7f1ed4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6e2a0af95bfae23 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:07.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.551+0000 7f1ee9ffb700 1 -- 172.21.15.84:0/789508786 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee000e6c0 con 0x7f1ed4004850 2023-07-14T11:14:07.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.551+0000 7f1ee9ffb700 1 -- 172.21.15.84:0/789508786 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ee000e820 con 0x7f1ed4004850 2023-07-14T11:14:07.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.551+0000 7f1ee9ffb700 1 -- 172.21.15.84:0/789508786 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee000eb90 con 0x7f1ed4004850 2023-07-14T11:14:07.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.551+0000 7f1ef15ff700 1 -- 172.21.15.84:0/789508786 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ed4004850 msgr2=0x7f1ed4004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:07.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.551+0000 7f1ef15ff700 1 --2- 172.21.15.84:0/789508786 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ed4004850 0x7f1ed4004cc0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1ee0009b60 tx=0x7f1ed4005880 comp rx=0 tx=0).stop 2023-07-14T11:14:07.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.551+0000 7f1eeb7fe700 1 -- 172.21.15.84:0/789508786 reap_dead start 2023-07-14T11:14:07.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.551+0000 7f1ef15ff700 1 -- 172.21.15.84:0/789508786 shutdown_connections 2023-07-14T11:14:07.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.551+0000 7f1ef15ff700 1 -- 172.21.15.84:0/789508786 >> 172.21.15.84:0/789508786 conn(0x7f1eec09c1b0 msgr2=0x7f1eec0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:07.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.551+0000 7f1ef15ff700 1 -- 172.21.15.84:0/789508786 shutdown_connections 2023-07-14T11:14:07.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.551+0000 7f1ef15ff700 1 -- 172.21.15.84:0/789508786 wait complete. 2023-07-14T11:14:07.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.553+0000 7f1ef15ff700 1 Processor -- start 2023-07-14T11:14:07.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.553+0000 7f1ef15ff700 1 -- start start 2023-07-14T11:14:07.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.554+0000 7f1ef15ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ed4004850 0x7f1eec156170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:07.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.554+0000 7f1ef15ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1eec1587c0 0x7f1eec15c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:07.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.554+0000 7f1ef15ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1eec1f14a0 0x7f1eec1f1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:07.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.554+0000 7f1ef15ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eec159200 con 0x7f1eec1f14a0 2023-07-14T11:14:07.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.554+0000 7f1ef15ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eec156800 con 0x7f1ed4004850 2023-07-14T11:14:07.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.554+0000 7f1ef15ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eec158c40 con 0x7f1eec1587c0 2023-07-14T11:14:07.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.554+0000 7f1eeb7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1eec1f14a0 0x7f1eec1f1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:07.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.554+0000 7f1eeb7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1eec1f14a0 0x7f1eec1f1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55692/0 (socket says 172.21.15.84:55692) 2023-07-14T11:14:07.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.554+0000 7f1eeb7fe700 1 -- 172.21.15.84:0/4006633727 learned_addr learned my addr 172.21.15.84:0/4006633727 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:07.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.555+0000 7f1eeb7fe700 1 -- 172.21.15.84:0/4006633727 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1eec1587c0 msgr2=0x7f1eec15c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:07.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.555+0000 7f1eeb7fe700 1 --2- 172.21.15.84:0/4006633727 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1eec1587c0 0x7f1eec15c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:07.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.555+0000 7f1eeb7fe700 1 -- 172.21.15.84:0/4006633727 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ed4004850 msgr2=0x7f1eec156170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:07.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.555+0000 7f1eeb7fe700 1 --2- 172.21.15.84:0/4006633727 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ed4004850 0x7f1eec156170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:07.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.555+0000 7f1eeb7fe700 1 -- 172.21.15.84:0/4006633727 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eec158f20 con 0x7f1eec1f14a0 2023-07-14T11:14:07.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.555+0000 7f1eeb7fe700 1 --2- 172.21.15.84:0/4006633727 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1eec1f14a0 0x7f1eec1f1920 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1eec0d0ee0 tx=0x7f1ee40114b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:07.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.555+0000 7f1ed37fe700 1 -- 172.21.15.84:0/4006633727 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee400e070 con 0x7f1eec1f14a0 2023-07-14T11:14:07.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.555+0000 7f1ed37fe700 1 -- 172.21.15.84:0/4006633727 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ee4003c30 con 0x7f1eec1f14a0 2023-07-14T11:14:07.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.555+0000 7f1ed37fe700 1 -- 172.21.15.84:0/4006633727 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee4003dc0 con 0x7f1eec1f14a0 2023-07-14T11:14:07.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.555+0000 7f1ef15ff700 1 -- 172.21.15.84:0/4006633727 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1eec15c650 con 0x7f1eec1f14a0 2023-07-14T11:14:07.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.555+0000 7f1ef15ff700 1 -- 172.21.15.84:0/4006633727 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1eec1f2040 con 0x7f1eec1f14a0 2023-07-14T11:14:07.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.556+0000 7f1ef15ff700 1 -- 172.21.15.84:0/4006633727 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1eec15e010 con 0x7f1eec1f14a0 2023-07-14T11:14:07.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.557+0000 7f1ed37fe700 1 -- 172.21.15.84:0/4006633727 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1ee4011a10 con 0x7f1eec1f14a0 2023-07-14T11:14:07.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.558+0000 7f1ed37fe700 1 --2- 172.21.15.84:0/4006633727 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1ed806ace0 0x7f1ed806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:07.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.559+0000 7f1ed37fe700 1 -- 172.21.15.84:0/4006633727 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f1ee4089850 con 0x7f1eec1f14a0 2023-07-14T11:14:07.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.559+0000 7f1eeaffd700 1 --2- 172.21.15.84:0/4006633727 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1ed806ace0 0x7f1ed806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:07.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.559+0000 7f1eeaffd700 1 --2- 172.21.15.84:0/4006633727 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1ed806ace0 0x7f1ed806d190 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1edc007c50 tx=0x7f1edc000f50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:07.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.563+0000 7f1ed37fe700 1 -- 172.21.15.84:0/4006633727 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f1eec15e010 con 0x7f1eec1f14a0 2023-07-14T11:14:07.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.755+0000 7f1ef15ff700 1 -- 172.21.15.84:0/4006633727 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1eec15e010 con 0x7f1eec1f14a0 2023-07-14T11:14:07.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.756+0000 7f1ed37fe700 1 -- 172.21.15.84:0/4006633727 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1eec15e010 con 0x7f1eec1f14a0 2023-07-14T11:14:07.759 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-07-14T11:14:07.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.758+0000 7f1ef15ff700 1 -- 172.21.15.84:0/4006633727 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1ed806ace0 msgr2=0x7f1ed806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:07.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.758+0000 7f1ef15ff700 1 --2- 172.21.15.84:0/4006633727 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1ed806ace0 0x7f1ed806d190 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1edc007c50 tx=0x7f1edc000f50 comp rx=0 tx=0).stop 2023-07-14T11:14:07.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.758+0000 7f1ef15ff700 1 -- 172.21.15.84:0/4006633727 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1eec1f14a0 msgr2=0x7f1eec1f1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:07.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.758+0000 7f1ef15ff700 1 --2- 172.21.15.84:0/4006633727 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1eec1f14a0 0x7f1eec1f1920 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1eec0d0ee0 tx=0x7f1ee40114b0 comp rx=0 tx=0).stop 2023-07-14T11:14:07.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.758+0000 7f1ef15ff700 1 -- 172.21.15.84:0/4006633727 shutdown_connections 2023-07-14T11:14:07.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.758+0000 7f1ef15ff700 1 --2- 172.21.15.84:0/4006633727 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1eec1f14a0 0x7f1eec1f1920 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:07.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.758+0000 7f1ef15ff700 1 --2- 172.21.15.84:0/4006633727 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ed4004850 0x7f1eec156170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:07.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.758+0000 7f1ef15ff700 1 --2- 172.21.15.84:0/4006633727 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1ed806ace0 0x7f1ed806d190 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:07.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.758+0000 7f1ef15ff700 1 --2- 172.21.15.84:0/4006633727 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1eec1587c0 0x7f1eec15c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:07.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.758+0000 7f1ef15ff700 1 -- 172.21.15.84:0/4006633727 >> 172.21.15.84:0/4006633727 conn(0x7f1eec09c1b0 msgr2=0x7f1eec0b25b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:07.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.758+0000 7f1ef15ff700 1 -- 172.21.15.84:0/4006633727 shutdown_connections 2023-07-14T11:14:07.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.758+0000 7f1ef15ff700 1 -- 172.21.15.84:0/4006633727 wait complete. 2023-07-14T11:14:07.778 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-14T11:14:07.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.973+0000 7f23f1dff700 1 Processor -- start 2023-07-14T11:14:07.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.973+0000 7f23f1dff700 1 -- start start 2023-07-14T11:14:07.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.974+0000 7f23f1dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23ec06c9f0 0x7f23ec0b1910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:07.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.974+0000 7f23f1dff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f23ec0b1e50 0x7f23ec071170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:07.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.974+0000 7f23f1dff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23ec06bcc0 con 0x7f23ec15d9d0 2023-07-14T11:14:07.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.975+0000 7f23f1dff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23ec06c4e0 con 0x7f23ec0b1e50 2023-07-14T11:14:07.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.975+0000 7f23f1dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23ec15dda0 con 0x7f23ec06c9f0 2023-07-14T11:14:07.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.975+0000 7f23eb7fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f23ec15d9d0 0x7f23ec06b5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55646/0 (socket says 172.21.15.84:55646) 2023-07-14T11:14:07.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.975+0000 7f23eb7fe700 1 -- 172.21.15.84:0/3746308650 learned_addr learned my addr 172.21.15.84:0/3746308650 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:14:07.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.975+0000 7f23eaffd700 1 --2- 172.21.15.84:0/3746308650 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23ec06c9f0 0x7f23ec0b1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:07.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.975+0000 7f23ebfff700 1 --2- 172.21.15.84:0/3746308650 >> v2:172.21.15.179:3300/0 conn(0x7f23ec0b1e50 0x7f23ec071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:07.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.975+0000 7f23ea7fc700 1 -- 172.21.15.84:0/3746308650 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3272650033 0 0) 0x7f23ec06bcc0 con 0x7f23ec15d9d0 2023-07-14T11:14:07.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.975+0000 7f23ea7fc700 1 -- 172.21.15.84:0/3746308650 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23d40035b0 con 0x7f23ec15d9d0 2023-07-14T11:14:07.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.975+0000 7f23eaffd700 1 -- 172.21.15.84:0/3746308650 >> v2:172.21.15.179:3300/0 conn(0x7f23ec0b1e50 msgr2=0x7f23ec071170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:07.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.975+0000 7f23eaffd700 1 --2- 172.21.15.84:0/3746308650 >> v2:172.21.15.179:3300/0 conn(0x7f23ec0b1e50 0x7f23ec071170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:07.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.975+0000 7f23eaffd700 1 -- 172.21.15.84:0/3746308650 >> v1:172.21.15.84:6789/0 conn(0x7f23ec15d9d0 legacy=0x7f23ec06b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:07.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.975+0000 7f23eaffd700 1 -- 172.21.15.84:0/3746308650 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23ec06bf20 con 0x7f23ec06c9f0 2023-07-14T11:14:07.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.975+0000 7f23ebfff700 1 --2- 172.21.15.84:0/3746308650 >> v2:172.21.15.179:3300/0 conn(0x7f23ec0b1e50 0x7f23ec071170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:14:07.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.976+0000 7f23eaffd700 1 --2- 172.21.15.84:0/3746308650 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23ec06c9f0 0x7f23ec0b1910 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f23e0009840 tx=0x7f23e0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f99e87f7476ac63a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:07.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.976+0000 7f23ea7fc700 1 -- 172.21.15.84:0/3746308650 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e0011830 con 0x7f23ec06c9f0 2023-07-14T11:14:07.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.976+0000 7f23ea7fc700 1 -- 172.21.15.84:0/3746308650 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23e0011990 con 0x7f23ec06c9f0 2023-07-14T11:14:07.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.976+0000 7f23ea7fc700 1 -- 172.21.15.84:0/3746308650 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e0011d20 con 0x7f23ec06c9f0 2023-07-14T11:14:07.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.976+0000 7f23f1dff700 1 -- 172.21.15.84:0/3746308650 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23ec06c9f0 msgr2=0x7f23ec0b1910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:07.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.976+0000 7f23f1dff700 1 --2- 172.21.15.84:0/3746308650 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23ec06c9f0 0x7f23ec0b1910 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f23e0009840 tx=0x7f23e0009b50 comp rx=0 tx=0).stop 2023-07-14T11:14:07.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.977+0000 7f23f1dff700 1 -- 172.21.15.84:0/3746308650 shutdown_connections 2023-07-14T11:14:07.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.977+0000 7f23f1dff700 1 --2- 172.21.15.84:0/3746308650 >> v2:172.21.15.179:3300/0 conn(0x7f23ec0b1e50 0x7f23ec071170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:07.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.977+0000 7f23f1dff700 1 --2- 172.21.15.84:0/3746308650 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23ec06c9f0 0x7f23ec0b1910 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:07.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.977+0000 7f23f1dff700 1 -- 172.21.15.84:0/3746308650 >> 172.21.15.84:0/3746308650 conn(0x7f23ec0b05d0 msgr2=0x7f23ec0b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:07.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.977+0000 7f23f1dff700 1 -- 172.21.15.84:0/3746308650 shutdown_connections 2023-07-14T11:14:07.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.977+0000 7f23f1dff700 1 -- 172.21.15.84:0/3746308650 wait complete. 2023-07-14T11:14:07.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.978+0000 7f23f1dff700 1 Processor -- start 2023-07-14T11:14:07.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.978+0000 7f23f1dff700 1 -- start start 2023-07-14T11:14:07.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.979+0000 7f23f1dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23ec06c9f0 0x7f23ec0cd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:07.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.979+0000 7f23f1dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23ec0b1e50 0x7f23ec1f17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:07.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.979+0000 7f23f1dff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23ec15d9d0 0x7f23ec0c3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:07.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.979+0000 7f23f1dff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23ec152b00 con 0x7f23ec15d9d0 2023-07-14T11:14:07.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.979+0000 7f23f1dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23ec0cd730 con 0x7f23ec0b1e50 2023-07-14T11:14:07.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.979+0000 7f23f1dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23ec0cda10 con 0x7f23ec06c9f0 2023-07-14T11:14:07.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.980+0000 7f23ebfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23ec15d9d0 0x7f23ec0c3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:07.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.980+0000 7f23ebfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23ec15d9d0 0x7f23ec0c3350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55704/0 (socket says 172.21.15.84:55704) 2023-07-14T11:14:07.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.980+0000 7f23ebfff700 1 -- 172.21.15.84:0/1013786591 learned_addr learned my addr 172.21.15.84:0/1013786591 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:07.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.980+0000 7f23eb7fe700 1 --2- 172.21.15.84:0/1013786591 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23ec06c9f0 0x7f23ec0cd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:07.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.980+0000 7f23eaffd700 1 --2- 172.21.15.84:0/1013786591 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23ec0b1e50 0x7f23ec1f17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:07.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.980+0000 7f23ebfff700 1 -- 172.21.15.84:0/1013786591 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23ec06c9f0 msgr2=0x7f23ec0cd0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:07.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.980+0000 7f23ebfff700 1 --2- 172.21.15.84:0/1013786591 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23ec06c9f0 0x7f23ec0cd0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:07.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.980+0000 7f23ebfff700 1 -- 172.21.15.84:0/1013786591 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23ec0b1e50 msgr2=0x7f23ec1f17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:07.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.980+0000 7f23ebfff700 1 --2- 172.21.15.84:0/1013786591 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23ec0b1e50 0x7f23ec1f17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:07.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.980+0000 7f23ebfff700 1 -- 172.21.15.84:0/1013786591 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23e4009a70 con 0x7f23ec15d9d0 2023-07-14T11:14:07.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.980+0000 7f23ebfff700 1 --2- 172.21.15.84:0/1013786591 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23ec15d9d0 0x7f23ec0c3350 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f23e400efc0 tx=0x7f23e400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:07.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.981+0000 7f23d3fff700 1 -- 172.21.15.84:0/1013786591 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e400cc90 con 0x7f23ec15d9d0 2023-07-14T11:14:07.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.981+0000 7f23d3fff700 1 -- 172.21.15.84:0/1013786591 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23e400f040 con 0x7f23ec15d9d0 2023-07-14T11:14:07.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.981+0000 7f23d3fff700 1 -- 172.21.15.84:0/1013786591 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e40146c0 con 0x7f23ec15d9d0 2023-07-14T11:14:07.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.981+0000 7f23f1dff700 1 -- 172.21.15.84:0/1013786591 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23e00094a0 con 0x7f23ec15d9d0 2023-07-14T11:14:07.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.981+0000 7f23f1dff700 1 -- 172.21.15.84:0/1013786591 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23ec1f1e70 con 0x7f23ec15d9d0 2023-07-14T11:14:07.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.982+0000 7f23f1dff700 1 -- 172.21.15.84:0/1013786591 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23ec074350 con 0x7f23ec15d9d0 2023-07-14T11:14:07.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.983+0000 7f23d3fff700 1 -- 172.21.15.84:0/1013786591 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f23e4014820 con 0x7f23ec15d9d0 2023-07-14T11:14:07.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.984+0000 7f23d3fff700 1 --2- 172.21.15.84:0/1013786591 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f23d806ace0 0x7f23d806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:07.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.984+0000 7f23d3fff700 1 -- 172.21.15.84:0/1013786591 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f23e408a180 con 0x7f23ec15d9d0 2023-07-14T11:14:07.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.984+0000 7f23eb7fe700 1 --2- 172.21.15.84:0/1013786591 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f23d806ace0 0x7f23d806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:07.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.984+0000 7f23eb7fe700 1 --2- 172.21.15.84:0/1013786591 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f23d806ace0 0x7f23d806d190 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f23dc007fd0 tx=0x7f23dc007dc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:07.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:07.988+0000 7f23d3fff700 1 -- 172.21.15.84:0/1013786591 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f23e4055150 con 0x7f23ec15d9d0 2023-07-14T11:14:08.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.196+0000 7f23f1dff700 1 -- 172.21.15.84:0/1013786591 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f23ec0cc080 con 0x7f23ec15d9d0 2023-07-14T11:14:08.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.196+0000 7f23d3fff700 1 -- 172.21.15.84:0/1013786591 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7f23e4058770 con 0x7f23ec15d9d0 2023-07-14T11:14:08.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.199+0000 7f23f1dff700 1 -- 172.21.15.84:0/1013786591 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f23d806ace0 msgr2=0x7f23d806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:08.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.199+0000 7f23f1dff700 1 --2- 172.21.15.84:0/1013786591 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f23d806ace0 0x7f23d806d190 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f23dc007fd0 tx=0x7f23dc007dc0 comp rx=0 tx=0).stop 2023-07-14T11:14:08.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.199+0000 7f23f1dff700 1 -- 172.21.15.84:0/1013786591 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23ec15d9d0 msgr2=0x7f23ec0c3350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:08.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.199+0000 7f23f1dff700 1 --2- 172.21.15.84:0/1013786591 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23ec15d9d0 0x7f23ec0c3350 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f23e400efc0 tx=0x7f23e400c3a0 comp rx=0 tx=0).stop 2023-07-14T11:14:08.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.199+0000 7f23f1dff700 1 -- 172.21.15.84:0/1013786591 shutdown_connections 2023-07-14T11:14:08.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.199+0000 7f23f1dff700 1 --2- 172.21.15.84:0/1013786591 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f23d806ace0 0x7f23d806d190 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:08.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.199+0000 7f23f1dff700 1 --2- 172.21.15.84:0/1013786591 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23ec06c9f0 0x7f23ec0cd0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:08.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.199+0000 7f23f1dff700 1 --2- 172.21.15.84:0/1013786591 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23ec15d9d0 0x7f23ec0c3350 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:08.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.199+0000 7f23f1dff700 1 --2- 172.21.15.84:0/1013786591 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23ec0b1e50 0x7f23ec1f17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:08.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.199+0000 7f23f1dff700 1 -- 172.21.15.84:0/1013786591 >> 172.21.15.84:0/1013786591 conn(0x7f23ec0b05d0 msgr2=0x7f23ec0afab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:08.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.199+0000 7f23f1dff700 1 -- 172.21.15.84:0/1013786591 shutdown_connections 2023-07-14T11:14:08.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.199+0000 7f23f1dff700 1 -- 172.21.15.84:0/1013786591 wait complete. 2023-07-14T11:14:08.203 INFO:teuthology.orchestra.run.smithi084.stderr:listed 0 entries 2023-07-14T11:14:08.218 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-07-14T11:14:08.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:14:08.219 DEBUG:teuthology.orchestra.run.smithi179:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-07-14T11:14:08.311 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi179.front.sepia.ceph.com 2023-07-14T11:14:08.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:14:08.312 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-07-14T11:14:08.360 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-14T11:14:08.360 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T11:14:08.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.554+0000 7fbd2fdff700 1 Processor -- start 2023-07-14T11:14:08.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.555+0000 7fbd2fdff700 1 -- start start 2023-07-14T11:14:08.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.556+0000 7fbd2fdff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbd280d1220 0x7fbd280b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:08.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.556+0000 7fbd2fdff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd280b1e00 0x7fbd280afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:08.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.556+0000 7fbd2fdff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd280d2ce0 con 0x7fbd2815c950 2023-07-14T11:14:08.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.556+0000 7fbd2fdff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd280b3350 con 0x7fbd280d1220 2023-07-14T11:14:08.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.556+0000 7fbd2fdff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd280b3630 con 0x7fbd280b1e00 2023-07-14T11:14:08.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.556+0000 7fbd2e39c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd280b1e00 0x7fbd280afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:08.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.556+0000 7fbd2d39a700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbd280d1220 0x7fbd280b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:08.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.556+0000 7fbd2db9b700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fbd2815c950 0x7fbd280d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.84:48540/0 (socket says 172.21.15.84:48540) 2023-07-14T11:14:08.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.556+0000 7fbd2e39c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd280b1e00 0x7fbd280afac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.84:35942/0 (socket says 172.21.15.84:35942) 2023-07-14T11:14:08.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.556+0000 7fbd2db9b700 1 -- 172.21.15.84:0/2856940444 learned_addr learned my addr 172.21.15.84:0/2856940444 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:14:08.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.557+0000 7fbd2cb99700 1 -- 172.21.15.84:0/2856940444 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3075756919 0 0) 0x7fbd280d2ce0 con 0x7fbd2815c950 2023-07-14T11:14:08.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.557+0000 7fbd2e39c700 1 -- 172.21.15.84:0/2856940444 >> v2:172.21.15.179:3300/0 conn(0x7fbd280d1220 msgr2=0x7fbd280b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:08.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.557+0000 7fbd2e39c700 1 --2- 172.21.15.84:0/2856940444 >> v2:172.21.15.179:3300/0 conn(0x7fbd280d1220 0x7fbd280b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:08.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.557+0000 7fbd2e39c700 1 -- 172.21.15.84:0/2856940444 >> v1:172.21.15.179:6789/0 conn(0x7fbd2815c950 legacy=0x7fbd280d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:08.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.557+0000 7fbd2e39c700 1 -- 172.21.15.84:0/2856940444 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd280b3910 con 0x7fbd280b1e00 2023-07-14T11:14:08.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.557+0000 7fbd2d39a700 1 --2- 172.21.15.84:0/2856940444 >> v2:172.21.15.179:3300/0 conn(0x7fbd280d1220 0x7fbd280b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:14:08.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.557+0000 7fbd2e39c700 1 --2- 172.21.15.84:0/2856940444 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd280b1e00 0x7fbd280afac0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbd20009d90 tx=0x7fbd2000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c447e3bb8679d2e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:08.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.557+0000 7fbd2cb99700 1 -- 172.21.15.84:0/2856940444 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2000e070 con 0x7fbd280b1e00 2023-07-14T11:14:08.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.557+0000 7fbd2cb99700 1 -- 172.21.15.84:0/2856940444 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd2000bb20 con 0x7fbd280b1e00 2023-07-14T11:14:08.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.557+0000 7fbd2cb99700 1 -- 172.21.15.84:0/2856940444 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd20012430 con 0x7fbd280b1e00 2023-07-14T11:14:08.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.558+0000 7fbd2fdff700 1 -- 172.21.15.84:0/2856940444 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd280b1e00 msgr2=0x7fbd280afac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:08.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.558+0000 7fbd2fdff700 1 --2- 172.21.15.84:0/2856940444 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd280b1e00 0x7fbd280afac0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbd20009d90 tx=0x7fbd2000b330 comp rx=0 tx=0).stop 2023-07-14T11:14:08.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.558+0000 7fbd2fdff700 1 -- 172.21.15.84:0/2856940444 shutdown_connections 2023-07-14T11:14:08.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.558+0000 7fbd2fdff700 1 --2- 172.21.15.84:0/2856940444 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd280b1e00 0x7fbd280afac0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:08.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.558+0000 7fbd2fdff700 1 --2- 172.21.15.84:0/2856940444 >> v2:172.21.15.179:3300/0 conn(0x7fbd280d1220 0x7fbd280b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:08.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.558+0000 7fbd2fdff700 1 -- 172.21.15.84:0/2856940444 >> 172.21.15.84:0/2856940444 conn(0x7fbd2809c1d0 msgr2=0x7fbd280d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:08.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.558+0000 7fbd2fdff700 1 -- 172.21.15.84:0/2856940444 shutdown_connections 2023-07-14T11:14:08.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.558+0000 7fbd2fdff700 1 -- 172.21.15.84:0/2856940444 wait complete. 2023-07-14T11:14:08.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.560+0000 7fbd2fdff700 1 Processor -- start 2023-07-14T11:14:08.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.560+0000 7fbd2fdff700 1 -- start start 2023-07-14T11:14:08.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.561+0000 7fbd2fdff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd280b1e00 0x7fbd2815dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:08.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.561+0000 7fbd2fdff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd280d1220 0x7fbd280cfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:08.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.561+0000 7fbd2fdff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd2815c950 0x7fbd2815f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:08.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.561+0000 7fbd2fdff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd280cec30 con 0x7fbd280b1e00 2023-07-14T11:14:08.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.561+0000 7fbd2fdff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd280cef10 con 0x7fbd2815c950 2023-07-14T11:14:08.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.561+0000 7fbd2fdff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd280cf1f0 con 0x7fbd280d1220 2023-07-14T11:14:08.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.561+0000 7fbd2db9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd280b1e00 0x7fbd2815dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:08.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.561+0000 7fbd2db9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd280b1e00 0x7fbd2815dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55714/0 (socket says 172.21.15.84:55714) 2023-07-14T11:14:08.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.561+0000 7fbd2db9b700 1 -- 172.21.15.84:0/2891718708 learned_addr learned my addr 172.21.15.84:0/2891718708 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:08.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.561+0000 7fbd2d39a700 1 --2- 172.21.15.84:0/2891718708 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd280d1220 0x7fbd280cfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:08.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.561+0000 7fbd2e39c700 1 --2- 172.21.15.84:0/2891718708 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd2815c950 0x7fbd2815f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:08.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.562+0000 7fbd2db9b700 1 -- 172.21.15.84:0/2891718708 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd280d1220 msgr2=0x7fbd280cfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:08.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.562+0000 7fbd2db9b700 1 --2- 172.21.15.84:0/2891718708 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd280d1220 0x7fbd280cfcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:08.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.562+0000 7fbd2db9b700 1 -- 172.21.15.84:0/2891718708 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd2815c950 msgr2=0x7fbd2815f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:08.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.562+0000 7fbd2db9b700 1 --2- 172.21.15.84:0/2891718708 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd2815c950 0x7fbd2815f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:08.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.562+0000 7fbd2db9b700 1 -- 172.21.15.84:0/2891718708 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd180094a0 con 0x7fbd280b1e00 2023-07-14T11:14:08.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.562+0000 7fbd2db9b700 1 --2- 172.21.15.84:0/2891718708 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd280b1e00 0x7fbd2815dfb0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fbd2400c430 tx=0x7fbd2400c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:08.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.562+0000 7fbd1e7fc700 1 -- 172.21.15.84:0/2891718708 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd24004cd0 con 0x7fbd280b1e00 2023-07-14T11:14:08.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.562+0000 7fbd1e7fc700 1 -- 172.21.15.84:0/2891718708 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd24004e30 con 0x7fbd280b1e00 2023-07-14T11:14:08.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.562+0000 7fbd1e7fc700 1 -- 172.21.15.84:0/2891718708 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd24007310 con 0x7fbd280b1e00 2023-07-14T11:14:08.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.562+0000 7fbd2fdff700 1 -- 172.21.15.84:0/2891718708 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd20009a70 con 0x7fbd280b1e00 2023-07-14T11:14:08.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.562+0000 7fbd2fdff700 1 -- 172.21.15.84:0/2891718708 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd280cf7b0 con 0x7fbd280b1e00 2023-07-14T11:14:08.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.563+0000 7fbd2fdff700 1 -- 172.21.15.84:0/2891718708 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd280cf9d0 con 0x7fbd280b1e00 2023-07-14T11:14:08.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.564+0000 7fbd1e7fc700 1 -- 172.21.15.84:0/2891718708 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbd24007470 con 0x7fbd280b1e00 2023-07-14T11:14:08.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.565+0000 7fbd1e7fc700 1 --2- 172.21.15.84:0/2891718708 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fbd0c06ace0 0x7fbd0c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:08.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.565+0000 7fbd1e7fc700 1 -- 172.21.15.84:0/2891718708 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fbd24089060 con 0x7fbd280b1e00 2023-07-14T11:14:08.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.565+0000 7fbd2d39a700 1 --2- 172.21.15.84:0/2891718708 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fbd0c06ace0 0x7fbd0c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:08.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.566+0000 7fbd2d39a700 1 --2- 172.21.15.84:0/2891718708 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fbd0c06ace0 0x7fbd0c06d190 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fbd28160210 tx=0x7fbd18009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:08.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.569+0000 7fbd1e7fc700 1 -- 172.21.15.84:0/2891718708 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fbd240bb330 con 0x7fbd280b1e00 2023-07-14T11:14:08.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.807+0000 7fbd2fdff700 1 -- 172.21.15.84:0/2891718708 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbd280c6660 con 0x7fbd280b1e00 2023-07-14T11:14:08.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.807+0000 7fbd1e7fc700 1 -- 172.21.15.84:0/2891718708 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4703 (secure 0 0 0) 0x7fbd2405b270 con 0x7fbd280b1e00 2023-07-14T11:14:08.810 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:14:08.810 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4296,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/811241790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":811241790},{"type":"v1","addr":"172.21.15.84:6836","nonce":811241790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4299,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/729998896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":729998896},{"type":"v1","addr":"172.21.15.84:6837","nonce":729998896}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4305,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3512017231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3512017231},{"type":"v1","addr":"172.21.15.179:6834","nonce":3512017231}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T11:13:14.457746+0000","modified":"2023-07-14T11:13:18.001606+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4308},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4308":{"gid":4308,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/3903854892","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":3903854892},{"type":"v1","addr":"172.21.15.179:6835","nonce":3903854892}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-14T11:14:08.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.810+0000 7fbd2fdff700 1 -- 172.21.15.84:0/2891718708 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fbd0c06ace0 msgr2=0x7fbd0c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:08.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.810+0000 7fbd2fdff700 1 --2- 172.21.15.84:0/2891718708 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fbd0c06ace0 0x7fbd0c06d190 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fbd28160210 tx=0x7fbd18009210 comp rx=0 tx=0).stop 2023-07-14T11:14:08.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.810+0000 7fbd2fdff700 1 -- 172.21.15.84:0/2891718708 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd280b1e00 msgr2=0x7fbd2815dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:08.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.810+0000 7fbd2fdff700 1 --2- 172.21.15.84:0/2891718708 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd280b1e00 0x7fbd2815dfb0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fbd2400c430 tx=0x7fbd2400c740 comp rx=0 tx=0).stop 2023-07-14T11:14:08.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.810+0000 7fbd2fdff700 1 -- 172.21.15.84:0/2891718708 shutdown_connections 2023-07-14T11:14:08.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.810+0000 7fbd2fdff700 1 --2- 172.21.15.84:0/2891718708 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd2815c950 0x7fbd2815f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:08.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.810+0000 7fbd2fdff700 1 --2- 172.21.15.84:0/2891718708 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd280b1e00 0x7fbd2815dfb0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:08.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.810+0000 7fbd2fdff700 1 --2- 172.21.15.84:0/2891718708 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fbd0c06ace0 0x7fbd0c06d190 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:08.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.810+0000 7fbd2fdff700 1 --2- 172.21.15.84:0/2891718708 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd280d1220 0x7fbd280cfcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:08.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.810+0000 7fbd2fdff700 1 -- 172.21.15.84:0/2891718708 >> 172.21.15.84:0/2891718708 conn(0x7fbd2809c1d0 msgr2=0x7fbd2806bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:08.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.810+0000 7fbd2fdff700 1 -- 172.21.15.84:0/2891718708 shutdown_connections 2023-07-14T11:14:08.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:08.810+0000 7fbd2fdff700 1 -- 172.21.15.84:0/2891718708 wait complete. 2023-07-14T11:14:08.814 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 8 2023-07-14T11:14:08.830 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:14:09.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.024+0000 7f49f51ff700 1 Processor -- start 2023-07-14T11:14:09.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.025+0000 7f49f51ff700 1 -- start start 2023-07-14T11:14:09.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.026+0000 7f49f51ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f49f00b2180 0x7f49f0158fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:09.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.026+0000 7f49f51ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49f0070710 0x7f49f00b4000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:09.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.026+0000 7f49f51ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49f00b4540 con 0x7f49f0141ff0 2023-07-14T11:14:09.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.026+0000 7f49f51ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49f0071140 con 0x7f49f00b2180 2023-07-14T11:14:09.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.026+0000 7f49f51ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49f006c110 con 0x7f49f0070710 2023-07-14T11:14:09.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.026+0000 7f49ee59c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f49f00b2180 0x7f49f0158fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:09.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.026+0000 7f49ee59c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f49f00b2180 0x7f49f0158fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58060/0 (socket says 172.21.15.84:58060) 2023-07-14T11:14:09.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.026+0000 7f49ee59c700 1 -- 172.21.15.84:0/1240722745 learned_addr learned my addr 172.21.15.84:0/1240722745 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:09.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.026+0000 7f49ee59c700 1 -- 172.21.15.84:0/1240722745 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49f0070710 msgr2=0x7f49f00b4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:09.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.026+0000 7f49ef59e700 1 --2- 172.21.15.84:0/1240722745 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49f0070710 0x7f49f00b4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:09.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.027+0000 7f49ee59c700 1 --2- 172.21.15.84:0/1240722745 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49f0070710 0x7f49f00b4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:09.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.027+0000 7f49ee59c700 1 -- 172.21.15.84:0/1240722745 >> v1:172.21.15.179:6789/0 conn(0x7f49f0141ff0 legacy=0x7f49f00b1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:09.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.027+0000 7f49ee59c700 1 -- 172.21.15.84:0/1240722745 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49f0070b90 con 0x7f49f00b2180 2023-07-14T11:14:09.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.027+0000 7f49ef59e700 1 --2- 172.21.15.84:0/1240722745 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49f0070710 0x7f49f00b4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:14:09.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.027+0000 7f49ee59c700 1 --2- 172.21.15.84:0/1240722745 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49f00b2180 0x7f49f0158fd0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f49e40098f0 tx=0x7f49e4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d403677b0703ae1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:09.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.027+0000 7f49edd9b700 1 -- 172.21.15.84:0/1240722745 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e4004230 con 0x7f49f00b2180 2023-07-14T11:14:09.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.027+0000 7f49edd9b700 1 -- 172.21.15.84:0/1240722745 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49e4004390 con 0x7f49f00b2180 2023-07-14T11:14:09.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.027+0000 7f49edd9b700 1 -- 172.21.15.84:0/1240722745 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e40036a0 con 0x7f49f00b2180 2023-07-14T11:14:09.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.028+0000 7f49f51ff700 1 -- 172.21.15.84:0/1240722745 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49f00b2180 msgr2=0x7f49f0158fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:09.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.028+0000 7f49f51ff700 1 --2- 172.21.15.84:0/1240722745 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49f00b2180 0x7f49f0158fd0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f49e40098f0 tx=0x7f49e4009c00 comp rx=0 tx=0).stop 2023-07-14T11:14:09.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.028+0000 7f49f51ff700 1 -- 172.21.15.84:0/1240722745 shutdown_connections 2023-07-14T11:14:09.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.028+0000 7f49f51ff700 1 --2- 172.21.15.84:0/1240722745 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49f0070710 0x7f49f00b4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:09.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.028+0000 7f49f51ff700 1 --2- 172.21.15.84:0/1240722745 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49f00b2180 0x7f49f0158fd0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:09.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.028+0000 7f49f51ff700 1 -- 172.21.15.84:0/1240722745 >> 172.21.15.84:0/1240722745 conn(0x7f49f0069f30 msgr2=0x7f49f006a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:09.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.028+0000 7f49f51ff700 1 -- 172.21.15.84:0/1240722745 shutdown_connections 2023-07-14T11:14:09.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.028+0000 7f49f51ff700 1 -- 172.21.15.84:0/1240722745 wait complete. 2023-07-14T11:14:09.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.030+0000 7f49f51ff700 1 Processor -- start 2023-07-14T11:14:09.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.030+0000 7f49f51ff700 1 -- start start 2023-07-14T11:14:09.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.031+0000 7f49f51ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49f0070710 0x7f49f0158fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:09.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.031+0000 7f49f51ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49f00b2180 0x7f49f01f3210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:09.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.031+0000 7f49f51ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49f0141ff0 0x7f49f015a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:09.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.031+0000 7f49f51ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f01f3750 con 0x7f49f0141ff0 2023-07-14T11:14:09.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.031+0000 7f49f51ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f015a2f0 con 0x7f49f00b2180 2023-07-14T11:14:09.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.031+0000 7f49f51ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49f01596e0 con 0x7f49f0070710 2023-07-14T11:14:09.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.031+0000 7f49ef59e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49f0141ff0 0x7f49f015a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:09.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.031+0000 7f49ef59e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49f0141ff0 0x7f49f015a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58072/0 (socket says 172.21.15.84:58072) 2023-07-14T11:14:09.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.031+0000 7f49ef59e700 1 -- 172.21.15.84:0/1521458039 learned_addr learned my addr 172.21.15.84:0/1521458039 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:09.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.031+0000 7f49eed9d700 1 --2- 172.21.15.84:0/1521458039 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49f0070710 0x7f49f0158fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:09.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.031+0000 7f49ee59c700 1 --2- 172.21.15.84:0/1521458039 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49f00b2180 0x7f49f01f3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:09.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.031+0000 7f49ef59e700 1 -- 172.21.15.84:0/1521458039 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49f0070710 msgr2=0x7f49f0158fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:09.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.031+0000 7f49ef59e700 1 --2- 172.21.15.84:0/1521458039 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49f0070710 0x7f49f0158fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:09.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.031+0000 7f49ef59e700 1 -- 172.21.15.84:0/1521458039 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49f00b2180 msgr2=0x7f49f01f3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:09.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.031+0000 7f49ef59e700 1 --2- 172.21.15.84:0/1521458039 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49f00b2180 0x7f49f01f3210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:09.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.031+0000 7f49ef59e700 1 -- 172.21.15.84:0/1521458039 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e4009550 con 0x7f49f0141ff0 2023-07-14T11:14:09.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.032+0000 7f49ef59e700 1 --2- 172.21.15.84:0/1521458039 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49f0141ff0 0x7f49f015a780 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f49e800cd50 tx=0x7f49e800a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:09.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.032+0000 7f49d77fe700 1 -- 172.21.15.84:0/1521458039 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e800cea0 con 0x7f49f0141ff0 2023-07-14T11:14:09.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.032+0000 7f49d77fe700 1 -- 172.21.15.84:0/1521458039 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49e800f480 con 0x7f49f0141ff0 2023-07-14T11:14:09.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.032+0000 7f49d77fe700 1 -- 172.21.15.84:0/1521458039 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e800f830 con 0x7f49f0141ff0 2023-07-14T11:14:09.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.032+0000 7f49f51ff700 1 -- 172.21.15.84:0/1521458039 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49f01599c0 con 0x7f49f0141ff0 2023-07-14T11:14:09.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.032+0000 7f49f51ff700 1 -- 172.21.15.84:0/1521458039 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49f0159f80 con 0x7f49f0141ff0 2023-07-14T11:14:09.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.033+0000 7f49f51ff700 1 -- 172.21.15.84:0/1521458039 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49f015a460 con 0x7f49f0141ff0 2023-07-14T11:14:09.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.034+0000 7f49d77fe700 1 -- 172.21.15.84:0/1521458039 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f49e800b040 con 0x7f49f0141ff0 2023-07-14T11:14:09.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.035+0000 7f49d77fe700 1 --2- 172.21.15.84:0/1521458039 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f49dc06ace0 0x7f49dc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:09.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.035+0000 7f49d77fe700 1 -- 172.21.15.84:0/1521458039 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f49e8089ba0 con 0x7f49f0141ff0 2023-07-14T11:14:09.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.036+0000 7f49eed9d700 1 --2- 172.21.15.84:0/1521458039 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f49dc06ace0 0x7f49dc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:09.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.036+0000 7f49eed9d700 1 --2- 172.21.15.84:0/1521458039 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f49dc06ace0 0x7f49dc06d190 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f49e0007fd0 tx=0x7f49e0007ec0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:09.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.040+0000 7f49d77fe700 1 -- 172.21.15.84:0/1521458039 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f49e8054c00 con 0x7f49f0141ff0 2023-07-14T11:14:09.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.236+0000 7f49f51ff700 1 -- 172.21.15.84:0/1521458039 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f49f006ba90 con 0x7f49f0141ff0 2023-07-14T11:14:09.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.238+0000 7f49d77fe700 1 -- 172.21.15.84:0/1521458039 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18351 (secure 0 0 0) 0x7f49e801d090 con 0x7f49f0141ff0 2023-07-14T11:14:09.240 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:14:09.240 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":25,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:13:55.825723+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-14T11:13:12.727811+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-14T11:13:13.436391+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.17","mappings":[{"from":3,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:14:09.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.240+0000 7f49f51ff700 1 -- 172.21.15.84:0/1521458039 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f49dc06ace0 msgr2=0x7f49dc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:09.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.240+0000 7f49f51ff700 1 --2- 172.21.15.84:0/1521458039 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f49dc06ace0 0x7f49dc06d190 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f49e0007fd0 tx=0x7f49e0007ec0 comp rx=0 tx=0).stop 2023-07-14T11:14:09.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.240+0000 7f49f51ff700 1 -- 172.21.15.84:0/1521458039 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49f0141ff0 msgr2=0x7f49f015a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:09.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.240+0000 7f49f51ff700 1 --2- 172.21.15.84:0/1521458039 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49f0141ff0 0x7f49f015a780 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f49e800cd50 tx=0x7f49e800a560 comp rx=0 tx=0).stop 2023-07-14T11:14:09.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.240+0000 7f49f51ff700 1 -- 172.21.15.84:0/1521458039 shutdown_connections 2023-07-14T11:14:09.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.240+0000 7f49f51ff700 1 --2- 172.21.15.84:0/1521458039 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f49dc06ace0 0x7f49dc06d190 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:09.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.240+0000 7f49f51ff700 1 --2- 172.21.15.84:0/1521458039 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49f0070710 0x7f49f0158fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:09.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.240+0000 7f49f51ff700 1 --2- 172.21.15.84:0/1521458039 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49f0141ff0 0x7f49f015a780 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:09.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.240+0000 7f49f51ff700 1 --2- 172.21.15.84:0/1521458039 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49f00b2180 0x7f49f01f3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:09.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.240+0000 7f49f51ff700 1 -- 172.21.15.84:0/1521458039 >> 172.21.15.84:0/1521458039 conn(0x7f49f0069f30 msgr2=0x7f49f00cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:09.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.240+0000 7f49f51ff700 1 -- 172.21.15.84:0/1521458039 shutdown_connections 2023-07-14T11:14:09.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.240+0000 7f49f51ff700 1 -- 172.21.15.84:0/1521458039 wait complete. 2023-07-14T11:14:09.261 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T11:13:00.125395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T11:13:06.803994+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T11:13:12.727811+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T11:13:13.436391+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T11:14:09.262 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T11:14:09.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.457+0000 7fcf7c5ff700 1 Processor -- start 2023-07-14T11:14:09.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.457+0000 7fcf7c5ff700 1 -- start start 2023-07-14T11:14:09.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.458+0000 7fcf7c5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf740b8a60 0x7fcf740b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:09.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.458+0000 7fcf7c5ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcf740d1220 0x7fcf740b0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:09.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.458+0000 7fcf7c5ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf740b8e30 con 0x7fcf740b4530 2023-07-14T11:14:09.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.458+0000 7fcf7c5ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf740afaa0 con 0x7fcf740d1220 2023-07-14T11:14:09.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.458+0000 7fcf7c5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf740afd80 con 0x7fcf740b8a60 2023-07-14T11:14:09.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.459+0000 7fcf79b9a700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fcf740b4530 0x7fcf740d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:59450/0 (socket says 172.21.15.84:59450) 2023-07-14T11:14:09.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.459+0000 7fcf79b9a700 1 -- 172.21.15.84:0/2393674273 learned_addr learned my addr 172.21.15.84:0/2393674273 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:14:09.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.459+0000 7fcf7ab9c700 1 --2- 172.21.15.84:0/2393674273 >> v2:172.21.15.84:3300/0 conn(0x7fcf740d1220 0x7fcf740b0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:09.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.459+0000 7fcf7a39b700 1 --2- 172.21.15.84:0/2393674273 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf740b8a60 0x7fcf740b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:09.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.459+0000 7fcf79399700 1 -- 172.21.15.84:0/2393674273 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1941128310 0 0) 0x7fcf740b8e30 con 0x7fcf740b4530 2023-07-14T11:14:09.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.459+0000 7fcf79399700 1 -- 172.21.15.84:0/2393674273 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf600035b0 con 0x7fcf740b4530 2023-07-14T11:14:09.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.459+0000 7fcf7ab9c700 1 -- 172.21.15.84:0/2393674273 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf740b8a60 msgr2=0x7fcf740b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:09.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.459+0000 7fcf7ab9c700 1 --2- 172.21.15.84:0/2393674273 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf740b8a60 0x7fcf740b3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:09.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.459+0000 7fcf7ab9c700 1 -- 172.21.15.84:0/2393674273 >> v1:172.21.15.84:6789/0 conn(0x7fcf740b4530 legacy=0x7fcf740d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:09.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.459+0000 7fcf7ab9c700 1 -- 172.21.15.84:0/2393674273 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf740b0060 con 0x7fcf740d1220 2023-07-14T11:14:09.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.459+0000 7fcf7ab9c700 1 --2- 172.21.15.84:0/2393674273 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf740d1220 0x7fcf740b0e20 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c009d90 tx=0x7fcf6c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb5b0f34411e16a4 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:09.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.460+0000 7fcf79399700 1 -- 172.21.15.84:0/2393674273 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf6c00e070 con 0x7fcf740d1220 2023-07-14T11:14:09.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.460+0000 7fcf79399700 1 -- 172.21.15.84:0/2393674273 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf6c00bb20 con 0x7fcf740d1220 2023-07-14T11:14:09.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.460+0000 7fcf79399700 1 -- 172.21.15.84:0/2393674273 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf6c012430 con 0x7fcf740d1220 2023-07-14T11:14:09.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.460+0000 7fcf7c5ff700 1 -- 172.21.15.84:0/2393674273 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf740d1220 msgr2=0x7fcf740b0e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:09.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.460+0000 7fcf7c5ff700 1 --2- 172.21.15.84:0/2393674273 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf740d1220 0x7fcf740b0e20 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c009d90 tx=0x7fcf6c00b330 comp rx=0 tx=0).stop 2023-07-14T11:14:09.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.460+0000 7fcf7c5ff700 1 -- 172.21.15.84:0/2393674273 shutdown_connections 2023-07-14T11:14:09.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.460+0000 7fcf7c5ff700 1 --2- 172.21.15.84:0/2393674273 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf740d1220 0x7fcf740b0e20 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:09.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.460+0000 7fcf7c5ff700 1 --2- 172.21.15.84:0/2393674273 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf740b8a60 0x7fcf740b3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:09.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.460+0000 7fcf7c5ff700 1 -- 172.21.15.84:0/2393674273 >> 172.21.15.84:0/2393674273 conn(0x7fcf7409c1b0 msgr2=0x7fcf740d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:09.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.460+0000 7fcf7c5ff700 1 -- 172.21.15.84:0/2393674273 shutdown_connections 2023-07-14T11:14:09.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.460+0000 7fcf7c5ff700 1 -- 172.21.15.84:0/2393674273 wait complete. 2023-07-14T11:14:09.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.462+0000 7fcf7c5ff700 1 Processor -- start 2023-07-14T11:14:09.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.462+0000 7fcf7c5ff700 1 -- start start 2023-07-14T11:14:09.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.463+0000 7fcf7c5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf740b4530 0x7fcf741526f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:09.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.463+0000 7fcf7c5ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf740b8a60 0x7fcf740b3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:09.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.463+0000 7fcf7c5ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf740d1220 0x7fcf740b3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:09.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.463+0000 7fcf7c5ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf740cd550 con 0x7fcf740b8a60 2023-07-14T11:14:09.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.463+0000 7fcf7c5ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7415a7d0 con 0x7fcf740d1220 2023-07-14T11:14:09.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.463+0000 7fcf7c5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7415aab0 con 0x7fcf740b4530 2023-07-14T11:14:09.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.463+0000 7fcf79b9a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf740b8a60 0x7fcf740b3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:09.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.464+0000 7fcf79b9a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf740b8a60 0x7fcf740b3670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58078/0 (socket says 172.21.15.84:58078) 2023-07-14T11:14:09.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.464+0000 7fcf79b9a700 1 -- 172.21.15.84:0/1506787099 learned_addr learned my addr 172.21.15.84:0/1506787099 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:09.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.464+0000 7fcf7a39b700 1 --2- 172.21.15.84:0/1506787099 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf740b4530 0x7fcf741526f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:09.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.464+0000 7fcf7ab9c700 1 --2- 172.21.15.84:0/1506787099 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf740d1220 0x7fcf740b3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:09.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.464+0000 7fcf79b9a700 1 -- 172.21.15.84:0/1506787099 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf740b4530 msgr2=0x7fcf741526f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:09.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.464+0000 7fcf79b9a700 1 --2- 172.21.15.84:0/1506787099 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf740b4530 0x7fcf741526f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:09.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.464+0000 7fcf79b9a700 1 -- 172.21.15.84:0/1506787099 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf740d1220 msgr2=0x7fcf740b3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:09.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.464+0000 7fcf79b9a700 1 --2- 172.21.15.84:0/1506787099 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf740d1220 0x7fcf740b3bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:09.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.464+0000 7fcf79b9a700 1 -- 172.21.15.84:0/1506787099 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf6c009a70 con 0x7fcf740b8a60 2023-07-14T11:14:09.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.464+0000 7fcf7ab9c700 1 --2- 172.21.15.84:0/1506787099 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf740d1220 0x7fcf740b3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:14:09.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.464+0000 7fcf79b9a700 1 --2- 172.21.15.84:0/1506787099 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf740b8a60 0x7fcf740b3670 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fcf6400c700 tx=0x7fcf6400cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:09.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.464+0000 7fcf6affd700 1 -- 172.21.15.84:0/1506787099 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf64005d70 con 0x7fcf740b8a60 2023-07-14T11:14:09.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.464+0000 7fcf6affd700 1 -- 172.21.15.84:0/1506787099 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf640070d0 con 0x7fcf740b8a60 2023-07-14T11:14:09.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.464+0000 7fcf6affd700 1 -- 172.21.15.84:0/1506787099 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf64007460 con 0x7fcf740b8a60 2023-07-14T11:14:09.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.464+0000 7fcf7c5ff700 1 -- 172.21.15.84:0/1506787099 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf740cd7a0 con 0x7fcf740b8a60 2023-07-14T11:14:09.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.465+0000 7fcf7c5ff700 1 -- 172.21.15.84:0/1506787099 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf74152c30 con 0x7fcf740b8a60 2023-07-14T11:14:09.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.466+0000 7fcf7c5ff700 1 -- 172.21.15.84:0/1506787099 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf740cdcc0 con 0x7fcf740b8a60 2023-07-14T11:14:09.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.466+0000 7fcf6affd700 1 -- 172.21.15.84:0/1506787099 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcf640075c0 con 0x7fcf740b8a60 2023-07-14T11:14:09.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.467+0000 7fcf6affd700 1 --2- 172.21.15.84:0/1506787099 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fcf5806ace0 0x7fcf5806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:09.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.467+0000 7fcf6affd700 1 -- 172.21.15.84:0/1506787099 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fcf64088b70 con 0x7fcf740b8a60 2023-07-14T11:14:09.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.468+0000 7fcf7a39b700 1 --2- 172.21.15.84:0/1506787099 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fcf5806ace0 0x7fcf5806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:09.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.468+0000 7fcf7a39b700 1 --2- 172.21.15.84:0/1506787099 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fcf5806ace0 0x7fcf5806d190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fcf70009b70 tx=0x7fcf70008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:09.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.472+0000 7fcf6affd700 1 -- 172.21.15.84:0/1506787099 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fcf740cdcc0 con 0x7fcf740b8a60 2023-07-14T11:14:09.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.664+0000 7fcf7c5ff700 1 -- 172.21.15.84:0/1506787099 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcf740cdcc0 con 0x7fcf740b8a60 2023-07-14T11:14:09.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.664+0000 7fcf6affd700 1 -- 172.21.15.84:0/1506787099 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcf740cdcc0 con 0x7fcf740b8a60 2023-07-14T11:14:09.667 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-07-14T11:14:09.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.666+0000 7fcf7c5ff700 1 -- 172.21.15.84:0/1506787099 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fcf5806ace0 msgr2=0x7fcf5806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:09.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.666+0000 7fcf7c5ff700 1 --2- 172.21.15.84:0/1506787099 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fcf5806ace0 0x7fcf5806d190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fcf70009b70 tx=0x7fcf70008040 comp rx=0 tx=0).stop 2023-07-14T11:14:09.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.666+0000 7fcf7c5ff700 1 -- 172.21.15.84:0/1506787099 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf740b8a60 msgr2=0x7fcf740b3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:09.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.666+0000 7fcf7c5ff700 1 --2- 172.21.15.84:0/1506787099 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf740b8a60 0x7fcf740b3670 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fcf6400c700 tx=0x7fcf6400cac0 comp rx=0 tx=0).stop 2023-07-14T11:14:09.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.667+0000 7fcf7c5ff700 1 -- 172.21.15.84:0/1506787099 shutdown_connections 2023-07-14T11:14:09.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.667+0000 7fcf7c5ff700 1 --2- 172.21.15.84:0/1506787099 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fcf5806ace0 0x7fcf5806d190 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:09.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.667+0000 7fcf7c5ff700 1 --2- 172.21.15.84:0/1506787099 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf740b4530 0x7fcf741526f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:09.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.667+0000 7fcf7c5ff700 1 --2- 172.21.15.84:0/1506787099 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf740d1220 0x7fcf740b3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:09.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.667+0000 7fcf7c5ff700 1 --2- 172.21.15.84:0/1506787099 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf740b8a60 0x7fcf740b3670 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:09.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.667+0000 7fcf7c5ff700 1 -- 172.21.15.84:0/1506787099 >> 172.21.15.84:0/1506787099 conn(0x7fcf7409c1b0 msgr2=0x7fcf7415c490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:09.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.667+0000 7fcf7c5ff700 1 -- 172.21.15.84:0/1506787099 shutdown_connections 2023-07-14T11:14:09.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.667+0000 7fcf7c5ff700 1 -- 172.21.15.84:0/1506787099 wait complete. 2023-07-14T11:14:09.687 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T11:14:09.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.882+0000 7f91e97ff700 1 Processor -- start 2023-07-14T11:14:09.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.882+0000 7f91e97ff700 1 -- start start 2023-07-14T11:14:09.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.884+0000 7f91e97ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f91e40d0010 0x7f91e40b5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:09.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.884+0000 7f91e97ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f91e40d0480 0x7f91e40b6430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:09.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.884+0000 7f91e97ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91e415cd60 con 0x7f91e40b4600 2023-07-14T11:14:09.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.884+0000 7f91e97ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91e40d1550 con 0x7f91e40d0010 2023-07-14T11:14:09.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.884+0000 7f91e97ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91e40d2d90 con 0x7f91e40d0480 2023-07-14T11:14:09.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.884+0000 7f91e27fc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f91e40d0010 0x7f91e40b5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:09.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.884+0000 7f91e27fc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f91e40d0010 0x7f91e40b5ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58086/0 (socket says 172.21.15.84:58086) 2023-07-14T11:14:09.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.884+0000 7f91e27fc700 1 -- 172.21.15.84:0/423217270 learned_addr learned my addr 172.21.15.84:0/423217270 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:09.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.884+0000 7f91e27fc700 1 -- 172.21.15.84:0/423217270 >> v2:172.21.15.179:3300/0 conn(0x7f91e40d0480 msgr2=0x7f91e40b6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:09.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.884+0000 7f91e27fc700 1 --2- 172.21.15.84:0/423217270 >> v2:172.21.15.179:3300/0 conn(0x7f91e40d0480 0x7f91e40b6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:09.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.884+0000 7f91e27fc700 1 -- 172.21.15.84:0/423217270 >> v1:172.21.15.179:6789/0 conn(0x7f91e40b4600 legacy=0x7f91e40cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:09.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.884+0000 7f91e27fc700 1 -- 172.21.15.84:0/423217270 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e40cf340 con 0x7f91e40d0010 2023-07-14T11:14:09.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.885+0000 7f91e27fc700 1 --2- 172.21.15.84:0/423217270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91e40d0010 0x7f91e40b5ef0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f91e408d400 tx=0x7f91d8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21e988554e458da7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:09.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.885+0000 7f91e1ffb700 1 -- 172.21.15.84:0/423217270 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d8004230 con 0x7f91e40d0010 2023-07-14T11:14:09.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.885+0000 7f91e1ffb700 1 -- 172.21.15.84:0/423217270 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91d8004390 con 0x7f91e40d0010 2023-07-14T11:14:09.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.885+0000 7f91e1ffb700 1 -- 172.21.15.84:0/423217270 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d80036a0 con 0x7f91e40d0010 2023-07-14T11:14:09.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.885+0000 7f91e97ff700 1 -- 172.21.15.84:0/423217270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91e40d0010 msgr2=0x7f91e40b5ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:09.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.885+0000 7f91e97ff700 1 --2- 172.21.15.84:0/423217270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91e40d0010 0x7f91e40b5ef0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f91e408d400 tx=0x7f91d8009bd0 comp rx=0 tx=0).stop 2023-07-14T11:14:09.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.885+0000 7f91e97ff700 1 -- 172.21.15.84:0/423217270 shutdown_connections 2023-07-14T11:14:09.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.885+0000 7f91e97ff700 1 --2- 172.21.15.84:0/423217270 >> v2:172.21.15.179:3300/0 conn(0x7f91e40d0480 0x7f91e40b6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:09.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.885+0000 7f91e97ff700 1 --2- 172.21.15.84:0/423217270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91e40d0010 0x7f91e40b5ef0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:09.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.885+0000 7f91e97ff700 1 -- 172.21.15.84:0/423217270 >> 172.21.15.84:0/423217270 conn(0x7f91e409c200 msgr2=0x7f91e40d2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:09.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.885+0000 7f91e97ff700 1 -- 172.21.15.84:0/423217270 shutdown_connections 2023-07-14T11:14:09.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.886+0000 7f91e97ff700 1 -- 172.21.15.84:0/423217270 wait complete. 2023-07-14T11:14:09.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.887+0000 7f91e97ff700 1 Processor -- start 2023-07-14T11:14:09.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.887+0000 7f91e97ff700 1 -- start start 2023-07-14T11:14:09.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.888+0000 7f91e97ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91e40d0010 0x7f91e40b15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:09.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.888+0000 7f91e97ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91e40d0480 0x7f91e409d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:09.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.888+0000 7f91e97ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91e40c8e60 0x7f91e415b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:09.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.888+0000 7f91e97ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e40b2910 con 0x7f91e40c8e60 2023-07-14T11:14:09.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.888+0000 7f91e97ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e40b2d30 con 0x7f91e40d0480 2023-07-14T11:14:09.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.888+0000 7f91e97ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91e40b1c90 con 0x7f91e40d0010 2023-07-14T11:14:09.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.888+0000 7f91e37fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91e40c8e60 0x7f91e415b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:09.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.888+0000 7f91e37fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91e40c8e60 0x7f91e415b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58096/0 (socket says 172.21.15.84:58096) 2023-07-14T11:14:09.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.888+0000 7f91e37fe700 1 -- 172.21.15.84:0/3986598245 learned_addr learned my addr 172.21.15.84:0/3986598245 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:09.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.889+0000 7f91e27fc700 1 --2- 172.21.15.84:0/3986598245 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91e40d0480 0x7f91e409d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:09.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.889+0000 7f91e2ffd700 1 --2- 172.21.15.84:0/3986598245 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91e40d0010 0x7f91e40b15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:09.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.889+0000 7f91e37fe700 1 -- 172.21.15.84:0/3986598245 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91e40d0010 msgr2=0x7f91e40b15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:09.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.889+0000 7f91e37fe700 1 --2- 172.21.15.84:0/3986598245 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91e40d0010 0x7f91e40b15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:09.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.889+0000 7f91e37fe700 1 -- 172.21.15.84:0/3986598245 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91e40d0480 msgr2=0x7f91e409d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:09.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.889+0000 7f91e37fe700 1 --2- 172.21.15.84:0/3986598245 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91e40d0480 0x7f91e409d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:09.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.889+0000 7f91e37fe700 1 -- 172.21.15.84:0/3986598245 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91d8009550 con 0x7f91e40c8e60 2023-07-14T11:14:09.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.889+0000 7f91e2ffd700 1 --2- 172.21.15.84:0/3986598245 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91e40d0010 0x7f91e40b15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:14:09.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.889+0000 7f91e27fc700 1 --2- 172.21.15.84:0/3986598245 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91e40d0480 0x7f91e409d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:14:09.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.889+0000 7f91e37fe700 1 --2- 172.21.15.84:0/3986598245 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91e40c8e60 0x7f91e415b760 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f91dc00b970 tx=0x7f91dc00bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:09.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.889+0000 7f91cb7fe700 1 -- 172.21.15.84:0/3986598245 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91dc00c9b0 con 0x7f91e40c8e60 2023-07-14T11:14:09.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.889+0000 7f91cb7fe700 1 -- 172.21.15.84:0/3986598245 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91dc00cb30 con 0x7f91e40c8e60 2023-07-14T11:14:09.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.889+0000 7f91cb7fe700 1 -- 172.21.15.84:0/3986598245 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91dc014440 con 0x7f91e40c8e60 2023-07-14T11:14:09.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.889+0000 7f91e97ff700 1 -- 172.21.15.84:0/3986598245 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91e40b1f70 con 0x7f91e40c8e60 2023-07-14T11:14:09.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.890+0000 7f91e97ff700 1 -- 172.21.15.84:0/3986598245 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91e40b2530 con 0x7f91e40c8e60 2023-07-14T11:14:09.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.890+0000 7f91e97ff700 1 -- 172.21.15.84:0/3986598245 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91e4074350 con 0x7f91e40c8e60 2023-07-14T11:14:09.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.891+0000 7f91cb7fe700 1 -- 172.21.15.84:0/3986598245 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f91dc01d3b0 con 0x7f91e40c8e60 2023-07-14T11:14:09.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.892+0000 7f91cb7fe700 1 --2- 172.21.15.84:0/3986598245 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f91d006ace0 0x7f91d006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:09.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.892+0000 7f91cb7fe700 1 -- 172.21.15.84:0/3986598245 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f91dc089280 con 0x7f91e40c8e60 2023-07-14T11:14:09.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.893+0000 7f91e2ffd700 1 --2- 172.21.15.84:0/3986598245 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f91d006ace0 0x7f91d006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:09.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.893+0000 7f91e2ffd700 1 --2- 172.21.15.84:0/3986598245 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f91d006ace0 0x7f91d006d190 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f91e40b5f60 tx=0x7f91d4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:09.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:09.900+0000 7f91cb7fe700 1 -- 172.21.15.84:0/3986598245 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f91dc0542e0 con 0x7f91e40c8e60 2023-07-14T11:14:10.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.098+0000 7f91e97ff700 1 -- 172.21.15.84:0/3986598245 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f91e415fd60 con 0x7f91e40c8e60 2023-07-14T11:14:10.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.098+0000 7f91cb7fe700 1 -- 172.21.15.84:0/3986598245 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f91dc019020 con 0x7f91e40c8e60 2023-07-14T11:14:10.101 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-07-14T11:14:10.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.101+0000 7f91e97ff700 1 -- 172.21.15.84:0/3986598245 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f91d006ace0 msgr2=0x7f91d006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:10.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.101+0000 7f91e97ff700 1 --2- 172.21.15.84:0/3986598245 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f91d006ace0 0x7f91d006d190 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f91e40b5f60 tx=0x7f91d4009040 comp rx=0 tx=0).stop 2023-07-14T11:14:10.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.101+0000 7f91e97ff700 1 -- 172.21.15.84:0/3986598245 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91e40c8e60 msgr2=0x7f91e415b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:10.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.101+0000 7f91e97ff700 1 --2- 172.21.15.84:0/3986598245 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91e40c8e60 0x7f91e415b760 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f91dc00b970 tx=0x7f91dc00bd30 comp rx=0 tx=0).stop 2023-07-14T11:14:10.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.101+0000 7f91e97ff700 1 -- 172.21.15.84:0/3986598245 shutdown_connections 2023-07-14T11:14:10.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.101+0000 7f91e97ff700 1 --2- 172.21.15.84:0/3986598245 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f91d006ace0 0x7f91d006d190 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:10.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.101+0000 7f91e97ff700 1 --2- 172.21.15.84:0/3986598245 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91e40d0010 0x7f91e40b15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:10.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.101+0000 7f91e97ff700 1 --2- 172.21.15.84:0/3986598245 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91e40c8e60 0x7f91e415b760 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:10.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.101+0000 7f91e97ff700 1 --2- 172.21.15.84:0/3986598245 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91e40d0480 0x7f91e409d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:10.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.101+0000 7f91e97ff700 1 -- 172.21.15.84:0/3986598245 >> 172.21.15.84:0/3986598245 conn(0x7f91e409c200 msgr2=0x7f91e415ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:10.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.101+0000 7f91e97ff700 1 -- 172.21.15.84:0/3986598245 shutdown_connections 2023-07-14T11:14:10.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.101+0000 7f91e97ff700 1 -- 172.21.15.84:0/3986598245 wait complete. 2023-07-14T11:14:10.121 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T11:14:10.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.318+0000 7fa43cdff700 1 Processor -- start 2023-07-14T11:14:10.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.318+0000 7fa43cdff700 1 -- start start 2023-07-14T11:14:10.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.319+0000 7fa43cdff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa43806f010 0x7fa438071650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:10.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.319+0000 7fa43cdff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa4380ce030 0x7fa438069f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:10.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.319+0000 7fa43cdff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4380cdba0 con 0x7fa43806a470 2023-07-14T11:14:10.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.319+0000 7fa43cdff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa43806f3e0 con 0x7fa4380ce030 2023-07-14T11:14:10.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.319+0000 7fa43cdff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa43806a8f0 con 0x7fa43806f010 2023-07-14T11:14:10.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.319+0000 7fa435d9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa4380ce030 0x7fa438069f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:10.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.320+0000 7fa435d9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa4380ce030 0x7fa438069f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58104/0 (socket says 172.21.15.84:58104) 2023-07-14T11:14:10.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.320+0000 7fa435d9b700 1 -- 172.21.15.84:0/3097700674 learned_addr learned my addr 172.21.15.84:0/3097700674 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:10.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.320+0000 7fa435d9b700 1 -- 172.21.15.84:0/3097700674 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa43806f010 msgr2=0x7fa438071650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:10.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.320+0000 7fa435d9b700 1 --2- 172.21.15.84:0/3097700674 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa43806f010 0x7fa438071650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:10.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.320+0000 7fa435d9b700 1 -- 172.21.15.84:0/3097700674 >> v1:172.21.15.179:6789/0 conn(0x7fa43806a470 legacy=0x7fa4381601d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:10.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.320+0000 7fa435d9b700 1 -- 172.21.15.84:0/3097700674 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4380cf370 con 0x7fa4380ce030 2023-07-14T11:14:10.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.320+0000 7fa435d9b700 1 --2- 172.21.15.84:0/3097700674 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4380ce030 0x7fa438069f30 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa42c0098f0 tx=0x7fa42c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a16e8410b789510c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:10.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.320+0000 7fa43559a700 1 -- 172.21.15.84:0/3097700674 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42c004230 con 0x7fa4380ce030 2023-07-14T11:14:10.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.320+0000 7fa43559a700 1 -- 172.21.15.84:0/3097700674 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa42c004390 con 0x7fa4380ce030 2023-07-14T11:14:10.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.320+0000 7fa43559a700 1 -- 172.21.15.84:0/3097700674 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42c0036a0 con 0x7fa4380ce030 2023-07-14T11:14:10.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.321+0000 7fa43cdff700 1 -- 172.21.15.84:0/3097700674 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4380ce030 msgr2=0x7fa438069f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:10.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.321+0000 7fa43cdff700 1 --2- 172.21.15.84:0/3097700674 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4380ce030 0x7fa438069f30 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa42c0098f0 tx=0x7fa42c009c00 comp rx=0 tx=0).stop 2023-07-14T11:14:10.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.321+0000 7fa43cdff700 1 -- 172.21.15.84:0/3097700674 shutdown_connections 2023-07-14T11:14:10.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.321+0000 7fa43cdff700 1 --2- 172.21.15.84:0/3097700674 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa43806f010 0x7fa438071650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:10.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.321+0000 7fa43cdff700 1 --2- 172.21.15.84:0/3097700674 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4380ce030 0x7fa438069f30 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:10.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.321+0000 7fa43cdff700 1 -- 172.21.15.84:0/3097700674 >> 172.21.15.84:0/3097700674 conn(0x7fa4380cc640 msgr2=0x7fa4380cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:10.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.321+0000 7fa43cdff700 1 -- 172.21.15.84:0/3097700674 shutdown_connections 2023-07-14T11:14:10.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.321+0000 7fa43cdff700 1 -- 172.21.15.84:0/3097700674 wait complete. 2023-07-14T11:14:10.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.323+0000 7fa43cdff700 1 Processor -- start 2023-07-14T11:14:10.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.323+0000 7fa43cdff700 1 -- start start 2023-07-14T11:14:10.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.324+0000 7fa43cdff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa43806a470 0x7fa4380b5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:10.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.324+0000 7fa43cdff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa43806f010 0x7fa438150280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:10.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.324+0000 7fa43cdff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4380ce030 0x7fa4380b1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:10.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.324+0000 7fa43cdff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4380b02d0 con 0x7fa43806f010 2023-07-14T11:14:10.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.324+0000 7fa43cdff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4380af400 con 0x7fa43806a470 2023-07-14T11:14:10.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.324+0000 7fa43cdff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4380af650 con 0x7fa4380ce030 2023-07-14T11:14:10.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.324+0000 7fa435d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa43806f010 0x7fa438150280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:10.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.324+0000 7fa435d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa43806f010 0x7fa438150280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58116/0 (socket says 172.21.15.84:58116) 2023-07-14T11:14:10.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.324+0000 7fa435d9b700 1 -- 172.21.15.84:0/754325410 learned_addr learned my addr 172.21.15.84:0/754325410 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:10.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.324+0000 7fa43659c700 1 --2- 172.21.15.84:0/754325410 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa43806a470 0x7fa4380b5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:10.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.325+0000 7fa435d9b700 1 -- 172.21.15.84:0/754325410 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4380ce030 msgr2=0x7fa4380b1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:10.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.325+0000 7fa435d9b700 1 --2- 172.21.15.84:0/754325410 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4380ce030 0x7fa4380b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:10.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.325+0000 7fa435d9b700 1 -- 172.21.15.84:0/754325410 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa43806a470 msgr2=0x7fa4380b5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:10.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.325+0000 7fa435d9b700 1 --2- 172.21.15.84:0/754325410 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa43806a470 0x7fa4380b5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:10.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.325+0000 7fa435d9b700 1 -- 172.21.15.84:0/754325410 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa42c009550 con 0x7fa43806f010 2023-07-14T11:14:10.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.325+0000 7fa435d9b700 1 --2- 172.21.15.84:0/754325410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa43806f010 0x7fa438150280 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa4380b27b0 tx=0x7fa42c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:10.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.325+0000 7fa426ffd700 1 -- 172.21.15.84:0/754325410 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42c00b860 con 0x7fa43806f010 2023-07-14T11:14:10.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.325+0000 7fa426ffd700 1 -- 172.21.15.84:0/754325410 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa42c00b9e0 con 0x7fa43806f010 2023-07-14T11:14:10.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.325+0000 7fa426ffd700 1 -- 172.21.15.84:0/754325410 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42c00bd90 con 0x7fa43806f010 2023-07-14T11:14:10.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.325+0000 7fa43cdff700 1 -- 172.21.15.84:0/754325410 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4380af930 con 0x7fa43806f010 2023-07-14T11:14:10.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.325+0000 7fa43cdff700 1 -- 172.21.15.84:0/754325410 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4380afef0 con 0x7fa43806f010 2023-07-14T11:14:10.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.326+0000 7fa43cdff700 1 -- 172.21.15.84:0/754325410 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4380c3270 con 0x7fa43806f010 2023-07-14T11:14:10.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.327+0000 7fa426ffd700 1 -- 172.21.15.84:0/754325410 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa42c01b440 con 0x7fa43806f010 2023-07-14T11:14:10.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.328+0000 7fa426ffd700 1 --2- 172.21.15.84:0/754325410 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa41806ace0 0x7fa41806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:10.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.328+0000 7fa426ffd700 1 -- 172.21.15.84:0/754325410 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fa42c08af30 con 0x7fa43806f010 2023-07-14T11:14:10.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.328+0000 7fa43659c700 1 --2- 172.21.15.84:0/754325410 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa41806ace0 0x7fa41806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:10.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.329+0000 7fa43659c700 1 --2- 172.21.15.84:0/754325410 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa41806ace0 0x7fa41806d190 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa428006fd0 tx=0x7fa428008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:10.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.332+0000 7fa426ffd700 1 -- 172.21.15.84:0/754325410 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fa42c055f90 con 0x7fa43806f010 2023-07-14T11:14:10.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.527+0000 7fa43cdff700 1 -- 172.21.15.84:0/754325410 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa438074350 con 0x7fa43806f010 2023-07-14T11:14:10.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.528+0000 7fa426ffd700 1 -- 172.21.15.84:0/754325410 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa42c0595b0 con 0x7fa43806f010 2023-07-14T11:14:10.530 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-07-14T11:14:10.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.530+0000 7fa43cdff700 1 -- 172.21.15.84:0/754325410 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa41806ace0 msgr2=0x7fa41806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:10.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.530+0000 7fa43cdff700 1 --2- 172.21.15.84:0/754325410 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa41806ace0 0x7fa41806d190 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa428006fd0 tx=0x7fa428008040 comp rx=0 tx=0).stop 2023-07-14T11:14:10.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.530+0000 7fa43cdff700 1 -- 172.21.15.84:0/754325410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa43806f010 msgr2=0x7fa438150280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:10.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.530+0000 7fa43cdff700 1 --2- 172.21.15.84:0/754325410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa43806f010 0x7fa438150280 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa4380b27b0 tx=0x7fa42c004750 comp rx=0 tx=0).stop 2023-07-14T11:14:10.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.530+0000 7fa43cdff700 1 -- 172.21.15.84:0/754325410 shutdown_connections 2023-07-14T11:14:10.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.530+0000 7fa43cdff700 1 --2- 172.21.15.84:0/754325410 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa41806ace0 0x7fa41806d190 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:10.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.530+0000 7fa43cdff700 1 --2- 172.21.15.84:0/754325410 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4380ce030 0x7fa4380b1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:10.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.530+0000 7fa43cdff700 1 --2- 172.21.15.84:0/754325410 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa43806a470 0x7fa4380b5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:10.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.530+0000 7fa43cdff700 1 --2- 172.21.15.84:0/754325410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa43806f010 0x7fa438150280 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:10.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.530+0000 7fa43cdff700 1 -- 172.21.15.84:0/754325410 >> 172.21.15.84:0/754325410 conn(0x7fa4380cc640 msgr2=0x7fa43806dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:10.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.530+0000 7fa43cdff700 1 -- 172.21.15.84:0/754325410 shutdown_connections 2023-07-14T11:14:10.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.531+0000 7fa43cdff700 1 -- 172.21.15.84:0/754325410 wait complete. 2023-07-14T11:14:10.550 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T11:14:10.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.746+0000 7f83cf3ff700 1 Processor -- start 2023-07-14T11:14:10.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.746+0000 7f83cf3ff700 1 -- start start 2023-07-14T11:14:10.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.747+0000 7f83cf3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83c80d0b10 0x7f83c80d0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:10.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.747+0000 7f83cf3ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83c80d14a0 con 0x7f83c80b8a60 2023-07-14T11:14:10.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.747+0000 7f83cf3ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83c80b8e30 con 0x7f83c80b0e20 2023-07-14T11:14:10.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.747+0000 7f83cf3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83c80afaa0 con 0x7f83c80d0b10 2023-07-14T11:14:10.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.747+0000 7f83cd19b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f83c80b8a60 0x7f83c80b3ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:59458/0 (socket says 172.21.15.84:59458) 2023-07-14T11:14:10.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.747+0000 7f83cd19b700 1 -- 172.21.15.84:0/1987110643 learned_addr learned my addr 172.21.15.84:0/1987110643 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:14:10.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.748+0000 7f83cc99a700 1 --2- 172.21.15.84:0/1987110643 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83c80d0b10 0x7f83c80d0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:10.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.748+0000 7f83bffff700 1 -- 172.21.15.84:0/1987110643 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2975637622 0 0) 0x7f83c4001110 con 0x7f83c80b8a60 2023-07-14T11:14:10.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.748+0000 7f83bffff700 1 -- 172.21.15.84:0/1987110643 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83b40035b0 con 0x7f83c80b8a60 2023-07-14T11:14:10.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.748+0000 7f83bffff700 1 -- 172.21.15.84:0/1987110643 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3717147167 0 0) 0x7f83b40035b0 con 0x7f83c80b8a60 2023-07-14T11:14:10.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.748+0000 7f83bffff700 1 -- 172.21.15.84:0/1987110643 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83c80d0b10 msgr2=0x7f83c80d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:10.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.748+0000 7f83bffff700 1 --2- 172.21.15.84:0/1987110643 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83c80d0b10 0x7f83c80d0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:10.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.748+0000 7f83bffff700 1 -- 172.21.15.84:0/1987110643 >> v1:172.21.15.179:6789/0 conn(0x7f83c80b0e20 legacy=0x7f83c80b12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:10.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.748+0000 7f83bffff700 1 -- 172.21.15.84:0/1987110643 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c80afd80 con 0x7f83c80b8a60 2023-07-14T11:14:10.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.748+0000 7f83bffff700 1 -- 172.21.15.84:0/1987110643 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7f83c4001800 con 0x7f83c80b8a60 2023-07-14T11:14:10.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.748+0000 7f83bffff700 1 -- 172.21.15.84:0/1987110643 >> v1:172.21.15.84:6789/0 conn(0x7f83c80b8a60 legacy=0x7f83c80b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:10.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.748+0000 7f83bffff700 1 --2- 172.21.15.84:0/1987110643 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83b4003a30 0x7f83b4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:10.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.748+0000 7f83bffff700 1 --2- 172.21.15.84:0/1987110643 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83c80d0b10 0x7f83b4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:10.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.748+0000 7f83bffff700 1 --2- 172.21.15.84:0/1987110643 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83b4004d90 0x7f83b4005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:10.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.748+0000 7f83bffff700 1 -- 172.21.15.84:0/1987110643 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c80afaa0 con 0x7f83b4004d90 2023-07-14T11:14:10.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.748+0000 7f83bffff700 1 -- 172.21.15.84:0/1987110643 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b400bb50 con 0x7f83b4003a30 2023-07-14T11:14:10.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.748+0000 7f83bffff700 1 -- 172.21.15.84:0/1987110643 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83b400bcc0 con 0x7f83c80d0b10 2023-07-14T11:14:10.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.748+0000 7f83cd99c700 1 --2- 172.21.15.84:0/1987110643 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83b4004d90 0x7f83b4005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:10.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.749+0000 7f83cd19b700 1 --2- 172.21.15.84:0/1987110643 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83b4003a30 0x7f83b4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:10.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.749+0000 7f83cc99a700 1 --2- 172.21.15.84:0/1987110643 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83c80d0b10 0x7f83b4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:10.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.749+0000 7f83cd99c700 1 -- 172.21.15.84:0/1987110643 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83c80d0b10 msgr2=0x7f83b4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:10.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.749+0000 7f83cd99c700 1 --2- 172.21.15.84:0/1987110643 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83c80d0b10 0x7f83b4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:10.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.749+0000 7f83cd99c700 1 -- 172.21.15.84:0/1987110643 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83b4003a30 msgr2=0x7f83b4003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:10.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.749+0000 7f83cd99c700 1 --2- 172.21.15.84:0/1987110643 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83b4003a30 0x7f83b4003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:10.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.749+0000 7f83cd99c700 1 -- 172.21.15.84:0/1987110643 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b40035b0 con 0x7f83b4004d90 2023-07-14T11:14:10.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.749+0000 7f83cd99c700 1 --2- 172.21.15.84:0/1987110643 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83b4004d90 0x7f83b4005200 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f83c0001de0 tx=0x7f83b4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0ed2182dcb4297b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:10.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.749+0000 7f83bffff700 1 -- 172.21.15.84:0/1987110643 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c0001850 con 0x7f83b4004d90 2023-07-14T11:14:10.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.749+0000 7f83bffff700 1 -- 172.21.15.84:0/1987110643 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83c0003c20 con 0x7f83b4004d90 2023-07-14T11:14:10.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.749+0000 7f83bffff700 1 -- 172.21.15.84:0/1987110643 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c00050d0 con 0x7f83b4004d90 2023-07-14T11:14:10.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.750+0000 7f83cf3ff700 1 -- 172.21.15.84:0/1987110643 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83b4004d90 msgr2=0x7f83b4005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:10.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.750+0000 7f83cf3ff700 1 --2- 172.21.15.84:0/1987110643 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83b4004d90 0x7f83b4005200 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f83c0001de0 tx=0x7f83b4005880 comp rx=0 tx=0).stop 2023-07-14T11:14:10.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.750+0000 7f83cd99c700 1 -- 172.21.15.84:0/1987110643 reap_dead start 2023-07-14T11:14:10.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.750+0000 7f83cf3ff700 1 -- 172.21.15.84:0/1987110643 shutdown_connections 2023-07-14T11:14:10.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.750+0000 7f83cf3ff700 1 -- 172.21.15.84:0/1987110643 >> 172.21.15.84:0/1987110643 conn(0x7f83c809c1b0 msgr2=0x7f83c80d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:10.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.750+0000 7f83cf3ff700 1 -- 172.21.15.84:0/1987110643 shutdown_connections 2023-07-14T11:14:10.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.750+0000 7f83cf3ff700 1 -- 172.21.15.84:0/1987110643 wait complete. 2023-07-14T11:14:10.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.752+0000 7f83cf3ff700 1 Processor -- start 2023-07-14T11:14:10.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.752+0000 7f83cf3ff700 1 -- start start 2023-07-14T11:14:10.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.753+0000 7f83cf3ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83b4004d90 0x7f83c815d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:10.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.753+0000 7f83cf3ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83c815e760 0x7f83c81523d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:10.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.753+0000 7f83cf3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83c815b590 0x7f83c80cf140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:10.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.753+0000 7f83cf3ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c80ce800 con 0x7f83c815e760 2023-07-14T11:14:10.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.753+0000 7f83cf3ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c815d6c0 con 0x7f83b4004d90 2023-07-14T11:14:10.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.753+0000 7f83cf3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83c815d9a0 con 0x7f83c815b590 2023-07-14T11:14:10.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.753+0000 7f83cc99a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83c815e760 0x7f83c81523d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:10.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.753+0000 7f83cc99a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83c815e760 0x7f83c81523d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58132/0 (socket says 172.21.15.84:58132) 2023-07-14T11:14:10.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.753+0000 7f83cc99a700 1 -- 172.21.15.84:0/2282174130 learned_addr learned my addr 172.21.15.84:0/2282174130 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:10.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.753+0000 7f83cd19b700 1 --2- 172.21.15.84:0/2282174130 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83b4004d90 0x7f83c815d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:10.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.753+0000 7f83cd99c700 1 --2- 172.21.15.84:0/2282174130 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83c815b590 0x7f83c80cf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:10.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.753+0000 7f83cc99a700 1 -- 172.21.15.84:0/2282174130 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83c815b590 msgr2=0x7f83c80cf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:10.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.753+0000 7f83cc99a700 1 --2- 172.21.15.84:0/2282174130 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83c815b590 0x7f83c80cf140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:10.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.753+0000 7f83cc99a700 1 -- 172.21.15.84:0/2282174130 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83b4004d90 msgr2=0x7f83c815d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:10.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.753+0000 7f83cc99a700 1 --2- 172.21.15.84:0/2282174130 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83b4004d90 0x7f83c815d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:10.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.753+0000 7f83cc99a700 1 -- 172.21.15.84:0/2282174130 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c815dc80 con 0x7f83c815e760 2023-07-14T11:14:10.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.753+0000 7f83cd19b700 1 --2- 172.21.15.84:0/2282174130 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83b4004d90 0x7f83c815d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:14:10.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.754+0000 7f83cc99a700 1 --2- 172.21.15.84:0/2282174130 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83c815e760 0x7f83c81523d0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f83b8011aa0 tx=0x7f83b8011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:10.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.754+0000 7f83bdffb700 1 -- 172.21.15.84:0/2282174130 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b800f980 con 0x7f83c815e760 2023-07-14T11:14:10.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.754+0000 7f83bdffb700 1 -- 172.21.15.84:0/2282174130 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83b800fae0 con 0x7f83c815e760 2023-07-14T11:14:10.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.754+0000 7f83bdffb700 1 -- 172.21.15.84:0/2282174130 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b800fe90 con 0x7f83c815e760 2023-07-14T11:14:10.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.754+0000 7f83cf3ff700 1 -- 172.21.15.84:0/2282174130 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83c815df60 con 0x7f83c815e760 2023-07-14T11:14:10.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.754+0000 7f83cf3ff700 1 -- 172.21.15.84:0/2282174130 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83c8152910 con 0x7f83c815e760 2023-07-14T11:14:10.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.755+0000 7f83cf3ff700 1 -- 172.21.15.84:0/2282174130 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83c815e5b0 con 0x7f83c815e760 2023-07-14T11:14:10.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.756+0000 7f83bdffb700 1 -- 172.21.15.84:0/2282174130 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f83b8014440 con 0x7f83c815e760 2023-07-14T11:14:10.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.756+0000 7f83bdffb700 1 --2- 172.21.15.84:0/2282174130 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f83ac06ace0 0x7f83ac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:10.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.757+0000 7f83bdffb700 1 -- 172.21.15.84:0/2282174130 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f83b8089cb0 con 0x7f83c815e760 2023-07-14T11:14:10.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.757+0000 7f83cd19b700 1 --2- 172.21.15.84:0/2282174130 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f83ac06ace0 0x7f83ac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:10.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.757+0000 7f83cd19b700 1 --2- 172.21.15.84:0/2282174130 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f83ac06ace0 0x7f83ac06d190 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f83c40012b0 tx=0x7f83c4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:10.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.761+0000 7f83bdffb700 1 -- 172.21.15.84:0/2282174130 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f83b8058870 con 0x7f83c815e760 2023-07-14T11:14:10.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.954+0000 7f83cf3ff700 1 -- 172.21.15.84:0/2282174130 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f83c815cad0 con 0x7f83c815e760 2023-07-14T11:14:10.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.954+0000 7f83bdffb700 1 -- 172.21.15.84:0/2282174130 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f83b80220a0 con 0x7f83c815e760 2023-07-14T11:14:10.957 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-07-14T11:14:10.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.957+0000 7f83cf3ff700 1 -- 172.21.15.84:0/2282174130 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f83ac06ace0 msgr2=0x7f83ac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:10.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.957+0000 7f83cf3ff700 1 --2- 172.21.15.84:0/2282174130 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f83ac06ace0 0x7f83ac06d190 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f83c40012b0 tx=0x7f83c4009040 comp rx=0 tx=0).stop 2023-07-14T11:14:10.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.957+0000 7f83cf3ff700 1 -- 172.21.15.84:0/2282174130 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83c815e760 msgr2=0x7f83c81523d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:10.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.957+0000 7f83cf3ff700 1 --2- 172.21.15.84:0/2282174130 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83c815e760 0x7f83c81523d0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f83b8011aa0 tx=0x7f83b8011e60 comp rx=0 tx=0).stop 2023-07-14T11:14:10.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.957+0000 7f83cf3ff700 1 -- 172.21.15.84:0/2282174130 shutdown_connections 2023-07-14T11:14:10.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.957+0000 7f83cf3ff700 1 --2- 172.21.15.84:0/2282174130 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f83ac06ace0 0x7f83ac06d190 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:10.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.957+0000 7f83cf3ff700 1 --2- 172.21.15.84:0/2282174130 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83c815b590 0x7f83c80cf140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:10.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.957+0000 7f83cf3ff700 1 --2- 172.21.15.84:0/2282174130 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83b4004d90 0x7f83c815d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:10.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.957+0000 7f83cf3ff700 1 --2- 172.21.15.84:0/2282174130 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83c815e760 0x7f83c81523d0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:10.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.957+0000 7f83cf3ff700 1 -- 172.21.15.84:0/2282174130 >> 172.21.15.84:0/2282174130 conn(0x7f83c809c1b0 msgr2=0x7f83c80b25b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:10.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.957+0000 7f83cf3ff700 1 -- 172.21.15.84:0/2282174130 shutdown_connections 2023-07-14T11:14:10.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:10.957+0000 7f83cf3ff700 1 -- 172.21.15.84:0/2282174130 wait complete. 2023-07-14T11:14:10.977 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T11:14:11.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.172+0000 7fbf2c9ff700 1 Processor -- start 2023-07-14T11:14:11.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.172+0000 7fbf2c9ff700 1 -- start start 2023-07-14T11:14:11.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.173+0000 7fbf2c9ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbf280b4510 0x7fbf280b6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:11.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.173+0000 7fbf2c9ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbf280d0b10 0x7fbf280d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:11.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.173+0000 7fbf2c9ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf280b7f50 con 0x7fbf280b5d90 2023-07-14T11:14:11.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.173+0000 7fbf2c9ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf280b48e0 con 0x7fbf280b4510 2023-07-14T11:14:11.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.173+0000 7fbf2c9ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf280d14d0 con 0x7fbf280d0b10 2023-07-14T11:14:11.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.174+0000 7fbf2659c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbf280b4510 0x7fbf280b6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:11.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.174+0000 7fbf2659c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbf280b4510 0x7fbf280b6c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58140/0 (socket says 172.21.15.84:58140) 2023-07-14T11:14:11.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.174+0000 7fbf2659c700 1 -- 172.21.15.84:0/1191857188 learned_addr learned my addr 172.21.15.84:0/1191857188 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:11.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.174+0000 7fbf25d9b700 1 --1- 172.21.15.84:0/1191857188 >> v1:172.21.15.84:6789/0 conn(0x7fbf280b5d90 0x7fbf280cd590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:59462/0 (socket says 172.21.15.84:59462) 2023-07-14T11:14:11.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.174+0000 7fbf26d9d700 1 --2- 172.21.15.84:0/1191857188 >> v2:172.21.15.179:3300/0 conn(0x7fbf280d0b10 0x7fbf280d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:11.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.174+0000 7fbf2659c700 1 -- 172.21.15.84:0/1191857188 >> v2:172.21.15.179:3300/0 conn(0x7fbf280d0b10 msgr2=0x7fbf280d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:11.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.174+0000 7fbf2659c700 1 --2- 172.21.15.84:0/1191857188 >> v2:172.21.15.179:3300/0 conn(0x7fbf280d0b10 0x7fbf280d0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:11.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.174+0000 7fbf2659c700 1 -- 172.21.15.84:0/1191857188 >> v1:172.21.15.84:6789/0 conn(0x7fbf280b5d90 legacy=0x7fbf280cd590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:11.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.174+0000 7fbf2659c700 1 -- 172.21.15.84:0/1191857188 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf280cdca0 con 0x7fbf280b4510 2023-07-14T11:14:11.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.174+0000 7fbf26d9d700 1 --2- 172.21.15.84:0/1191857188 >> v2:172.21.15.179:3300/0 conn(0x7fbf280d0b10 0x7fbf280d0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:14:11.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.174+0000 7fbf2559a700 1 -- 172.21.15.84:0/1191857188 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3111878413 0 0) 0x7fbf280b7f50 con 0x7fbf280b5d90 2023-07-14T11:14:11.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.174+0000 7fbf2659c700 1 --2- 172.21.15.84:0/1191857188 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf280b4510 0x7fbf280b6c80 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fbf28067390 tx=0x7fbf18009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b83ba545c6e7e65 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:11.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.175+0000 7fbf2559a700 1 -- 172.21.15.84:0/1191857188 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf18005e30 con 0x7fbf280b4510 2023-07-14T11:14:11.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.175+0000 7fbf2559a700 1 -- 172.21.15.84:0/1191857188 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf18004030 con 0x7fbf280b4510 2023-07-14T11:14:11.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.175+0000 7fbf2559a700 1 -- 172.21.15.84:0/1191857188 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf180043e0 con 0x7fbf280b4510 2023-07-14T11:14:11.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.175+0000 7fbf2c9ff700 1 -- 172.21.15.84:0/1191857188 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf280b4510 msgr2=0x7fbf280b6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:11.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.175+0000 7fbf2c9ff700 1 --2- 172.21.15.84:0/1191857188 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf280b4510 0x7fbf280b6c80 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fbf28067390 tx=0x7fbf18009bd0 comp rx=0 tx=0).stop 2023-07-14T11:14:11.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.175+0000 7fbf2c9ff700 1 -- 172.21.15.84:0/1191857188 shutdown_connections 2023-07-14T11:14:11.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.175+0000 7fbf2c9ff700 1 --2- 172.21.15.84:0/1191857188 >> v2:172.21.15.179:3300/0 conn(0x7fbf280d0b10 0x7fbf280d0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:11.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.175+0000 7fbf2c9ff700 1 --2- 172.21.15.84:0/1191857188 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf280b4510 0x7fbf280b6c80 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:11.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.175+0000 7fbf2c9ff700 1 -- 172.21.15.84:0/1191857188 >> 172.21.15.84:0/1191857188 conn(0x7fbf2809c1d0 msgr2=0x7fbf280d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:11.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.175+0000 7fbf2c9ff700 1 -- 172.21.15.84:0/1191857188 shutdown_connections 2023-07-14T11:14:11.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.175+0000 7fbf2c9ff700 1 -- 172.21.15.84:0/1191857188 wait complete. 2023-07-14T11:14:11.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.177+0000 7fbf2c9ff700 1 Processor -- start 2023-07-14T11:14:11.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.177+0000 7fbf2c9ff700 1 -- start start 2023-07-14T11:14:11.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.178+0000 7fbf2c9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf280b4510 0x7fbf281f54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:11.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.178+0000 7fbf2c9ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf280b5d90 0x7fbf281551f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:11.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.178+0000 7fbf2c9ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf280d0b10 0x7fbf280c7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:11.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.178+0000 7fbf2c9ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf28151660 con 0x7fbf280d0b10 2023-07-14T11:14:11.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.178+0000 7fbf2c9ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf28152340 con 0x7fbf280b5d90 2023-07-14T11:14:11.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.178+0000 7fbf2c9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf28152620 con 0x7fbf280b4510 2023-07-14T11:14:11.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.178+0000 7fbf26d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf280d0b10 0x7fbf280c7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:11.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.178+0000 7fbf26d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf280d0b10 0x7fbf280c7ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58142/0 (socket says 172.21.15.84:58142) 2023-07-14T11:14:11.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.178+0000 7fbf26d9d700 1 -- 172.21.15.84:0/2609464198 learned_addr learned my addr 172.21.15.84:0/2609464198 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:11.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.179+0000 7fbf2659c700 1 --2- 172.21.15.84:0/2609464198 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf280b4510 0x7fbf281f54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:11.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.179+0000 7fbf25d9b700 1 --2- 172.21.15.84:0/2609464198 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf280b5d90 0x7fbf281551f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:11.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.179+0000 7fbf26d9d700 1 -- 172.21.15.84:0/2609464198 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf280b4510 msgr2=0x7fbf281f54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:11.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.179+0000 7fbf26d9d700 1 --2- 172.21.15.84:0/2609464198 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf280b4510 0x7fbf281f54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:11.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.179+0000 7fbf26d9d700 1 -- 172.21.15.84:0/2609464198 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf280b5d90 msgr2=0x7fbf281551f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:11.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.179+0000 7fbf26d9d700 1 --2- 172.21.15.84:0/2609464198 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf280b5d90 0x7fbf281551f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:11.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.179+0000 7fbf26d9d700 1 -- 172.21.15.84:0/2609464198 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf18009500 con 0x7fbf280d0b10 2023-07-14T11:14:11.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.179+0000 7fbf25d9b700 1 --2- 172.21.15.84:0/2609464198 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf280b5d90 0x7fbf281551f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:14:11.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.179+0000 7fbf2659c700 1 --2- 172.21.15.84:0/2609464198 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf280b4510 0x7fbf281f54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:14:11.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.179+0000 7fbf26d9d700 1 --2- 172.21.15.84:0/2609464198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf280d0b10 0x7fbf280c7ac0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fbf20007f20 tx=0x7fbf2000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:11.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.179+0000 7fbf16ffd700 1 -- 172.21.15.84:0/2609464198 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf2000de90 con 0x7fbf280d0b10 2023-07-14T11:14:11.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.179+0000 7fbf16ffd700 1 -- 172.21.15.84:0/2609464198 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf2000f040 con 0x7fbf280d0b10 2023-07-14T11:14:11.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.179+0000 7fbf16ffd700 1 -- 172.21.15.84:0/2609464198 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf20003c60 con 0x7fbf280d0b10 2023-07-14T11:14:11.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.179+0000 7fbf2c9ff700 1 -- 172.21.15.84:0/2609464198 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf281f5a00 con 0x7fbf280d0b10 2023-07-14T11:14:11.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.179+0000 7fbf2c9ff700 1 -- 172.21.15.84:0/2609464198 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf281580f0 con 0x7fbf280d0b10 2023-07-14T11:14:11.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.180+0000 7fbf2c9ff700 1 -- 172.21.15.84:0/2609464198 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf2804e280 con 0x7fbf280d0b10 2023-07-14T11:14:11.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.181+0000 7fbf16ffd700 1 -- 172.21.15.84:0/2609464198 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbf20004030 con 0x7fbf280d0b10 2023-07-14T11:14:11.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.182+0000 7fbf16ffd700 1 --2- 172.21.15.84:0/2609464198 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fbf0806ace0 0x7fbf0806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:11.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.182+0000 7fbf16ffd700 1 -- 172.21.15.84:0/2609464198 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fbf20089800 con 0x7fbf280d0b10 2023-07-14T11:14:11.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.183+0000 7fbf2659c700 1 --2- 172.21.15.84:0/2609464198 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fbf0806ace0 0x7fbf0806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:11.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.183+0000 7fbf2659c700 1 --2- 172.21.15.84:0/2609464198 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fbf0806ace0 0x7fbf0806d190 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbf28067390 tx=0x7fbf18008070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:11.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.186+0000 7fbf16ffd700 1 -- 172.21.15.84:0/2609464198 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fbf20054740 con 0x7fbf280d0b10 2023-07-14T11:14:11.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.420+0000 7fbf2c9ff700 1 -- 172.21.15.84:0/2609464198 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbf28152760 con 0x7fbf280d0b10 2023-07-14T11:14:11.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.421+0000 7fbf16ffd700 1 -- 172.21.15.84:0/2609464198 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4703 (secure 0 0 0) 0x7fbf20057d60 con 0x7fbf280d0b10 2023-07-14T11:14:11.423 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:14:11.424 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4296,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/811241790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":811241790},{"type":"v1","addr":"172.21.15.84:6836","nonce":811241790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4299,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/729998896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":729998896},{"type":"v1","addr":"172.21.15.84:6837","nonce":729998896}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4305,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3512017231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3512017231},{"type":"v1","addr":"172.21.15.179:6834","nonce":3512017231}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T11:13:14.457746+0000","modified":"2023-07-14T11:13:18.001606+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4308},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4308":{"gid":4308,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/3903854892","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":3903854892},{"type":"v1","addr":"172.21.15.179:6835","nonce":3903854892}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-14T11:14:11.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.423+0000 7fbf2c9ff700 1 -- 172.21.15.84:0/2609464198 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fbf0806ace0 msgr2=0x7fbf0806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:11.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.423+0000 7fbf2c9ff700 1 --2- 172.21.15.84:0/2609464198 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fbf0806ace0 0x7fbf0806d190 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbf28067390 tx=0x7fbf18008070 comp rx=0 tx=0).stop 2023-07-14T11:14:11.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.423+0000 7fbf2c9ff700 1 -- 172.21.15.84:0/2609464198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf280d0b10 msgr2=0x7fbf280c7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:11.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.423+0000 7fbf2c9ff700 1 --2- 172.21.15.84:0/2609464198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf280d0b10 0x7fbf280c7ac0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fbf20007f20 tx=0x7fbf2000d3b0 comp rx=0 tx=0).stop 2023-07-14T11:14:11.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.423+0000 7fbf2c9ff700 1 -- 172.21.15.84:0/2609464198 shutdown_connections 2023-07-14T11:14:11.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.423+0000 7fbf2c9ff700 1 --2- 172.21.15.84:0/2609464198 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fbf0806ace0 0x7fbf0806d190 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:11.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.423+0000 7fbf2c9ff700 1 --2- 172.21.15.84:0/2609464198 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf280b4510 0x7fbf281f54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:11.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.423+0000 7fbf2c9ff700 1 --2- 172.21.15.84:0/2609464198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf280d0b10 0x7fbf280c7ac0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:11.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.423+0000 7fbf2c9ff700 1 --2- 172.21.15.84:0/2609464198 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf280b5d90 0x7fbf281551f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:11.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.423+0000 7fbf2c9ff700 1 -- 172.21.15.84:0/2609464198 >> 172.21.15.84:0/2609464198 conn(0x7fbf2809c1d0 msgr2=0x7fbf280d3650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:11.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.423+0000 7fbf2c9ff700 1 -- 172.21.15.84:0/2609464198 shutdown_connections 2023-07-14T11:14:11.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.423+0000 7fbf2c9ff700 1 -- 172.21.15.84:0/2609464198 wait complete. 2023-07-14T11:14:11.427 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 8 2023-07-14T11:14:11.443 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:14:11.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.637+0000 7fec4a3ff700 1 Processor -- start 2023-07-14T11:14:11.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.637+0000 7fec4a3ff700 1 -- start start 2023-07-14T11:14:11.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.639+0000 7fec4a3ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fec440cf510 0x7fec4406d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:11.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.639+0000 7fec4a3ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fec4406d960 0x7fec44070950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:11.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.639+0000 7fec4a3ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec4406dda0 con 0x7fec4415c710 2023-07-14T11:14:11.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.639+0000 7fec4a3ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec440cf980 con 0x7fec4406d960 2023-07-14T11:14:11.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.639+0000 7fec4a3ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec440cd320 con 0x7fec440cf510 2023-07-14T11:14:11.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.639+0000 7fec43fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fec4415c710 0x7fec44069f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:59470/0 (socket says 172.21.15.84:59470) 2023-07-14T11:14:11.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.639+0000 7fec43fff700 1 -- 172.21.15.84:0/3261459725 learned_addr learned my addr 172.21.15.84:0/3261459725 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:14:11.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.639+0000 7fec4899c700 1 --2- 172.21.15.84:0/3261459725 >> v2:172.21.15.84:3300/0 conn(0x7fec4406d960 0x7fec44070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:11.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.639+0000 7fec3bfff700 1 --2- 172.21.15.84:0/3261459725 >> v2:172.21.15.179:3300/0 conn(0x7fec440cf510 0x7fec4406d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:11.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.639+0000 7fec4899c700 1 -- 172.21.15.84:0/3261459725 >> v2:172.21.15.179:3300/0 conn(0x7fec440cf510 msgr2=0x7fec4406d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:11.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.639+0000 7fec437fe700 1 -- 172.21.15.84:0/3261459725 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1513866595 0 0) 0x7fec4406dda0 con 0x7fec4415c710 2023-07-14T11:14:11.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.639+0000 7fec4899c700 1 --2- 172.21.15.84:0/3261459725 >> v2:172.21.15.179:3300/0 conn(0x7fec440cf510 0x7fec4406d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:11.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.639+0000 7fec4899c700 1 -- 172.21.15.84:0/3261459725 >> v1:172.21.15.84:6789/0 conn(0x7fec4415c710 legacy=0x7fec44069f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:11.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.639+0000 7fec4899c700 1 -- 172.21.15.84:0/3261459725 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec440ce750 con 0x7fec4406d960 2023-07-14T11:14:11.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.639+0000 7fec3bfff700 1 --2- 172.21.15.84:0/3261459725 >> v2:172.21.15.179:3300/0 conn(0x7fec440cf510 0x7fec4406d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:14:11.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.640+0000 7fec4899c700 1 --2- 172.21.15.84:0/3261459725 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec4406d960 0x7fec44070950 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fec440d0bd0 tx=0x7fec3c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38cfca8f40b8b98e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:11.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.640+0000 7fec437fe700 1 -- 172.21.15.84:0/3261459725 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec3c00e070 con 0x7fec4406d960 2023-07-14T11:14:11.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.640+0000 7fec437fe700 1 -- 172.21.15.84:0/3261459725 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec3c00bbd0 con 0x7fec4406d960 2023-07-14T11:14:11.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.640+0000 7fec437fe700 1 -- 172.21.15.84:0/3261459725 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec3c012430 con 0x7fec4406d960 2023-07-14T11:14:11.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.640+0000 7fec4a3ff700 1 -- 172.21.15.84:0/3261459725 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec4406d960 msgr2=0x7fec44070950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:11.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.640+0000 7fec4a3ff700 1 --2- 172.21.15.84:0/3261459725 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec4406d960 0x7fec44070950 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fec440d0bd0 tx=0x7fec3c00b330 comp rx=0 tx=0).stop 2023-07-14T11:14:11.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.640+0000 7fec4a3ff700 1 -- 172.21.15.84:0/3261459725 shutdown_connections 2023-07-14T11:14:11.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.640+0000 7fec4a3ff700 1 --2- 172.21.15.84:0/3261459725 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec4406d960 0x7fec44070950 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:11.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.640+0000 7fec4a3ff700 1 --2- 172.21.15.84:0/3261459725 >> v2:172.21.15.179:3300/0 conn(0x7fec440cf510 0x7fec4406d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:11.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.640+0000 7fec4a3ff700 1 -- 172.21.15.84:0/3261459725 >> 172.21.15.84:0/3261459725 conn(0x7fec440b16c0 msgr2=0x7fec440b1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:11.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.641+0000 7fec4a3ff700 1 -- 172.21.15.84:0/3261459725 shutdown_connections 2023-07-14T11:14:11.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.641+0000 7fec4a3ff700 1 -- 172.21.15.84:0/3261459725 wait complete. 2023-07-14T11:14:11.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.643+0000 7fec4a3ff700 1 Processor -- start 2023-07-14T11:14:11.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.643+0000 7fec4a3ff700 1 -- start start 2023-07-14T11:14:11.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.644+0000 7fec4a3ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec4406d960 0x7fec440b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:11.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.644+0000 7fec4a3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec440cf510 0x7fec440b4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:11.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.644+0000 7fec4a3ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec440b5490 0x7fec4415dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:11.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.644+0000 7fec4a3ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec440b5910 con 0x7fec4406d960 2023-07-14T11:14:11.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.644+0000 7fec4a3ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec4415e8c0 con 0x7fec440b5490 2023-07-14T11:14:11.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.644+0000 7fec4a3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec4415eba0 con 0x7fec440cf510 2023-07-14T11:14:11.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.645+0000 7fec43fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec4406d960 0x7fec440b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:11.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.645+0000 7fec43fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec4406d960 0x7fec440b41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58160/0 (socket says 172.21.15.84:58160) 2023-07-14T11:14:11.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.645+0000 7fec43fff700 1 -- 172.21.15.84:0/45100228 learned_addr learned my addr 172.21.15.84:0/45100228 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:11.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.645+0000 7fec3bfff700 1 --2- 172.21.15.84:0/45100228 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec440cf510 0x7fec440b4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:11.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.645+0000 7fec4899c700 1 --2- 172.21.15.84:0/45100228 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec440b5490 0x7fec4415dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:11.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.645+0000 7fec43fff700 1 -- 172.21.15.84:0/45100228 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec440cf510 msgr2=0x7fec440b4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:11.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.645+0000 7fec43fff700 1 --2- 172.21.15.84:0/45100228 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec440cf510 0x7fec440b4f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:11.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.645+0000 7fec43fff700 1 -- 172.21.15.84:0/45100228 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec440b5490 msgr2=0x7fec4415dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:11.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.645+0000 7fec43fff700 1 --2- 172.21.15.84:0/45100228 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec440b5490 0x7fec4415dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:11.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.645+0000 7fec43fff700 1 -- 172.21.15.84:0/45100228 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec3c009a70 con 0x7fec4406d960 2023-07-14T11:14:11.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.645+0000 7fec43fff700 1 --2- 172.21.15.84:0/45100228 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec4406d960 0x7fec440b41b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fec3400c550 tx=0x7fec3400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:11.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.645+0000 7fec417fa700 1 -- 172.21.15.84:0/45100228 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec34004c80 con 0x7fec4406d960 2023-07-14T11:14:11.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.646+0000 7fec417fa700 1 -- 172.21.15.84:0/45100228 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec34004e00 con 0x7fec4406d960 2023-07-14T11:14:11.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.646+0000 7fec4a3ff700 1 -- 172.21.15.84:0/45100228 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec4415ee80 con 0x7fec4406d960 2023-07-14T11:14:11.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.646+0000 7fec417fa700 1 -- 172.21.15.84:0/45100228 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec34007310 con 0x7fec4406d960 2023-07-14T11:14:11.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.646+0000 7fec4a3ff700 1 -- 172.21.15.84:0/45100228 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec4415f440 con 0x7fec4406d960 2023-07-14T11:14:11.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.647+0000 7fec4a3ff700 1 -- 172.21.15.84:0/45100228 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec4404e280 con 0x7fec4406d960 2023-07-14T11:14:11.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.648+0000 7fec417fa700 1 -- 172.21.15.84:0/45100228 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fec34007470 con 0x7fec4406d960 2023-07-14T11:14:11.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.648+0000 7fec417fa700 1 --2- 172.21.15.84:0/45100228 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fec2406ace0 0x7fec2406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:11.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.648+0000 7fec417fa700 1 -- 172.21.15.84:0/45100228 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fec34089270 con 0x7fec4406d960 2023-07-14T11:14:11.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.649+0000 7fec3bfff700 1 --2- 172.21.15.84:0/45100228 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fec2406ace0 0x7fec2406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:11.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.649+0000 7fec3bfff700 1 --2- 172.21.15.84:0/45100228 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fec2406ace0 0x7fec2406d190 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fec440b4bb0 tx=0x7fec2c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:11.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.653+0000 7fec417fa700 1 -- 172.21.15.84:0/45100228 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fec34054240 con 0x7fec4406d960 2023-07-14T11:14:11.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.851+0000 7fec4a3ff700 1 -- 172.21.15.84:0/45100228 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fec44158ee0 con 0x7fec4406d960 2023-07-14T11:14:11.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.852+0000 7fec417fa700 1 -- 172.21.15.84:0/45100228 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18351 (secure 0 0 0) 0x7fec34057860 con 0x7fec4406d960 2023-07-14T11:14:11.855 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:14:11.855 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":25,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:13:55.825723+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-14T11:13:12.727811+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-14T11:13:13.436391+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.17","mappings":[{"from":3,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:14:11.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.855+0000 7fec4a3ff700 1 -- 172.21.15.84:0/45100228 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fec2406ace0 msgr2=0x7fec2406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:11.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.855+0000 7fec4a3ff700 1 --2- 172.21.15.84:0/45100228 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fec2406ace0 0x7fec2406d190 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fec440b4bb0 tx=0x7fec2c008040 comp rx=0 tx=0).stop 2023-07-14T11:14:11.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.855+0000 7fec4a3ff700 1 -- 172.21.15.84:0/45100228 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec4406d960 msgr2=0x7fec440b41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:11.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.855+0000 7fec4a3ff700 1 --2- 172.21.15.84:0/45100228 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec4406d960 0x7fec440b41b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fec3400c550 tx=0x7fec3400c910 comp rx=0 tx=0).stop 2023-07-14T11:14:11.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.855+0000 7fec4a3ff700 1 -- 172.21.15.84:0/45100228 shutdown_connections 2023-07-14T11:14:11.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.855+0000 7fec4a3ff700 1 --2- 172.21.15.84:0/45100228 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec440b5490 0x7fec4415dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:11.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.855+0000 7fec4a3ff700 1 --2- 172.21.15.84:0/45100228 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec4406d960 0x7fec440b41b0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:11.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.855+0000 7fec4a3ff700 1 --2- 172.21.15.84:0/45100228 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fec2406ace0 0x7fec2406d190 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:11.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.855+0000 7fec4a3ff700 1 --2- 172.21.15.84:0/45100228 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec440cf510 0x7fec440b4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:11.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.855+0000 7fec4a3ff700 1 -- 172.21.15.84:0/45100228 >> 172.21.15.84:0/45100228 conn(0x7fec440b16c0 msgr2=0x7fec4406a010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:11.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.855+0000 7fec4a3ff700 1 -- 172.21.15.84:0/45100228 shutdown_connections 2023-07-14T11:14:11.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:11.855+0000 7fec4a3ff700 1 -- 172.21.15.84:0/45100228 wait complete. 2023-07-14T11:14:11.875 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-14T11:14:11.875 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T11:14:12.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.069+0000 7f98c7dff700 1 Processor -- start 2023-07-14T11:14:12.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.069+0000 7f98c7dff700 1 -- start start 2023-07-14T11:14:12.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.071+0000 7f98c7dff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f98c0141ff0 0x7f98c0158fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:12.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.071+0000 7f98c7dff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f98c0070710 0x7f98c00b4000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:12.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.071+0000 7f98c7dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98c00b1a70 0x7f98c00b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:12.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.071+0000 7f98c7dff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98c0071140 con 0x7f98c0141ff0 2023-07-14T11:14:12.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.071+0000 7f98c7dff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98c00b2430 con 0x7f98c0070710 2023-07-14T11:14:12.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.071+0000 7f98c7dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98c00b4540 con 0x7f98c00b1a70 2023-07-14T11:14:12.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.071+0000 7f98c5b9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f98c0141ff0 0x7f98c0158fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:12.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.071+0000 7f98c5b9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f98c0141ff0 0x7f98c0158fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58164/0 (socket says 172.21.15.84:58164) 2023-07-14T11:14:12.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.071+0000 7f98c5b9b700 1 -- 172.21.15.84:0/862055524 learned_addr learned my addr 172.21.15.84:0/862055524 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:12.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.071+0000 7f98c539a700 1 --2- 172.21.15.84:0/862055524 >> v2:172.21.15.179:3300/0 conn(0x7f98c0070710 0x7f98c00b4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:12.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.071+0000 7f98c639c700 1 --2- 172.21.15.84:0/862055524 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98c00b1a70 0x7f98c00b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:12.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.071+0000 7f98c5b9b700 1 -- 172.21.15.84:0/862055524 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98c00b1a70 msgr2=0x7f98c00b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:12.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.071+0000 7f98c5b9b700 1 --2- 172.21.15.84:0/862055524 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98c00b1a70 0x7f98c00b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:12.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.071+0000 7f98c5b9b700 1 -- 172.21.15.84:0/862055524 >> v2:172.21.15.179:3300/0 conn(0x7f98c0070710 msgr2=0x7f98c00b4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:12.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.071+0000 7f98c5b9b700 1 --2- 172.21.15.84:0/862055524 >> v2:172.21.15.179:3300/0 conn(0x7f98c0070710 0x7f98c00b4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:12.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.071+0000 7f98c5b9b700 1 -- 172.21.15.84:0/862055524 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c006c110 con 0x7f98c0141ff0 2023-07-14T11:14:12.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.072+0000 7f98c5b9b700 1 --2- 172.21.15.84:0/862055524 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98c0141ff0 0x7f98c0158fd0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f98c0071460 tx=0x7f98bc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b62c5ced5c6a9e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:12.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.072+0000 7f98c4b99700 1 -- 172.21.15.84:0/862055524 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98bc00b870 con 0x7f98c0141ff0 2023-07-14T11:14:12.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.072+0000 7f98c4b99700 1 -- 172.21.15.84:0/862055524 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98bc00b9d0 con 0x7f98c0141ff0 2023-07-14T11:14:12.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.072+0000 7f98c4b99700 1 -- 172.21.15.84:0/862055524 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98bc00bd60 con 0x7f98c0141ff0 2023-07-14T11:14:12.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.072+0000 7f98c7dff700 1 -- 172.21.15.84:0/862055524 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98c0141ff0 msgr2=0x7f98c0158fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:12.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.072+0000 7f98c7dff700 1 --2- 172.21.15.84:0/862055524 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98c0141ff0 0x7f98c0158fd0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f98c0071460 tx=0x7f98bc009bd0 comp rx=0 tx=0).stop 2023-07-14T11:14:12.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.073+0000 7f98c7dff700 1 -- 172.21.15.84:0/862055524 shutdown_connections 2023-07-14T11:14:12.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.073+0000 7f98c7dff700 1 --2- 172.21.15.84:0/862055524 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98c00b1a70 0x7f98c00b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:12.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.073+0000 7f98c7dff700 1 --2- 172.21.15.84:0/862055524 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98c0141ff0 0x7f98c0158fd0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:12.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.073+0000 7f98c7dff700 1 --2- 172.21.15.84:0/862055524 >> v2:172.21.15.179:3300/0 conn(0x7f98c0070710 0x7f98c00b4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:12.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.073+0000 7f98c7dff700 1 -- 172.21.15.84:0/862055524 >> 172.21.15.84:0/862055524 conn(0x7f98c0069f30 msgr2=0x7f98c006a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:12.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.073+0000 7f98c7dff700 1 -- 172.21.15.84:0/862055524 shutdown_connections 2023-07-14T11:14:12.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.073+0000 7f98c7dff700 1 -- 172.21.15.84:0/862055524 wait complete. 2023-07-14T11:14:12.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.074+0000 7f98c7dff700 1 Processor -- start 2023-07-14T11:14:12.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.075+0000 7f98c7dff700 1 -- start start 2023-07-14T11:14:12.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.075+0000 7f98c7dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98c0070710 0x7f98c013f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:12.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.075+0000 7f98c7dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98c00b1a70 0x7f98c0141260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:12.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.076+0000 7f98c7dff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98c0141ff0 0x7f98c0138ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:12.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.076+0000 7f98c7dff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98c013ea60 con 0x7f98c0141ff0 2023-07-14T11:14:12.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.076+0000 7f98c7dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98c01429d0 con 0x7f98c0070710 2023-07-14T11:14:12.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.076+0000 7f98c7dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98c0142c20 con 0x7f98c00b1a70 2023-07-14T11:14:12.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.076+0000 7f98c639c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98c0141ff0 0x7f98c0138ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:12.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.076+0000 7f98c639c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98c0141ff0 0x7f98c0138ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58176/0 (socket says 172.21.15.84:58176) 2023-07-14T11:14:12.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.076+0000 7f98c639c700 1 -- 172.21.15.84:0/3628619372 learned_addr learned my addr 172.21.15.84:0/3628619372 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:12.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.076+0000 7f98c539a700 1 --2- 172.21.15.84:0/3628619372 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98c00b1a70 0x7f98c0141260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:12.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.076+0000 7f98c639c700 1 -- 172.21.15.84:0/3628619372 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98c00b1a70 msgr2=0x7f98c0141260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:12.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.076+0000 7f98c639c700 1 --2- 172.21.15.84:0/3628619372 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98c00b1a70 0x7f98c0141260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:12.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.076+0000 7f98c639c700 1 -- 172.21.15.84:0/3628619372 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98c0070710 msgr2=0x7f98c013f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:12.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.076+0000 7f98c639c700 1 --2- 172.21.15.84:0/3628619372 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98c0070710 0x7f98c013f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:12.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.076+0000 7f98c639c700 1 -- 172.21.15.84:0/3628619372 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98bc009550 con 0x7f98c0141ff0 2023-07-14T11:14:12.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.076+0000 7f98c639c700 1 --2- 172.21.15.84:0/3628619372 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98c0141ff0 0x7f98c0138ce0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f98b8007e60 tx=0x7f98b800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:12.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.077+0000 7f98b67fc700 1 -- 172.21.15.84:0/3628619372 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b800ede0 con 0x7f98c0141ff0 2023-07-14T11:14:12.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.077+0000 7f98b67fc700 1 -- 172.21.15.84:0/3628619372 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98b8014420 con 0x7f98c0141ff0 2023-07-14T11:14:12.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.077+0000 7f98b67fc700 1 -- 172.21.15.84:0/3628619372 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b80147d0 con 0x7f98c0141ff0 2023-07-14T11:14:12.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.077+0000 7f98c7dff700 1 -- 172.21.15.84:0/3628619372 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98c0142f00 con 0x7f98c0141ff0 2023-07-14T11:14:12.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.077+0000 7f98c7dff700 1 -- 172.21.15.84:0/3628619372 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98c01434c0 con 0x7f98c0141ff0 2023-07-14T11:14:12.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.078+0000 7f98c7dff700 1 -- 172.21.15.84:0/3628619372 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98c00b0e00 con 0x7f98c0141ff0 2023-07-14T11:14:12.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.079+0000 7f98b67fc700 1 -- 172.21.15.84:0/3628619372 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f98b8014930 con 0x7f98c0141ff0 2023-07-14T11:14:12.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.080+0000 7f98b67fc700 1 --2- 172.21.15.84:0/3628619372 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f98a406ace0 0x7f98a406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:12.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.080+0000 7f98b67fc700 1 -- 172.21.15.84:0/3628619372 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f98b8089c30 con 0x7f98c0141ff0 2023-07-14T11:14:12.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.080+0000 7f98c5b9b700 1 --2- 172.21.15.84:0/3628619372 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f98a406ace0 0x7f98a406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:12.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.081+0000 7f98c5b9b700 1 --2- 172.21.15.84:0/3628619372 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f98a406ace0 0x7f98a406d190 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f98bc009c10 tx=0x7f98bc010000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:12.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.085+0000 7f98b67fc700 1 -- 172.21.15.84:0/3628619372 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f98b8054c00 con 0x7f98c0141ff0 2023-07-14T11:14:12.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.321+0000 7f98c7dff700 1 -- 172.21.15.84:0/3628619372 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f98c0066f00 con 0x7f98c0141ff0 2023-07-14T11:14:12.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.321+0000 7f98b67fc700 1 -- 172.21.15.84:0/3628619372 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4703 (secure 0 0 0) 0x7f98b8058220 con 0x7f98c0141ff0 2023-07-14T11:14:12.324 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:14:12.324 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4296,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/811241790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":811241790},{"type":"v1","addr":"172.21.15.84:6836","nonce":811241790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4299,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/729998896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":729998896},{"type":"v1","addr":"172.21.15.84:6837","nonce":729998896}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4305,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3512017231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3512017231},{"type":"v1","addr":"172.21.15.179:6834","nonce":3512017231}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T11:13:14.457746+0000","modified":"2023-07-14T11:13:18.001606+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4308},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4308":{"gid":4308,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/3903854892","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":3903854892},{"type":"v1","addr":"172.21.15.179:6835","nonce":3903854892}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-14T11:14:12.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.324+0000 7f98c7dff700 1 -- 172.21.15.84:0/3628619372 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f98a406ace0 msgr2=0x7f98a406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:12.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.324+0000 7f98c7dff700 1 --2- 172.21.15.84:0/3628619372 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f98a406ace0 0x7f98a406d190 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f98bc009c10 tx=0x7f98bc010000 comp rx=0 tx=0).stop 2023-07-14T11:14:12.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.324+0000 7f98c7dff700 1 -- 172.21.15.84:0/3628619372 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98c0141ff0 msgr2=0x7f98c0138ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:12.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.324+0000 7f98c7dff700 1 --2- 172.21.15.84:0/3628619372 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98c0141ff0 0x7f98c0138ce0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f98b8007e60 tx=0x7f98b800e3c0 comp rx=0 tx=0).stop 2023-07-14T11:14:12.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.324+0000 7f98c7dff700 1 -- 172.21.15.84:0/3628619372 shutdown_connections 2023-07-14T11:14:12.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.324+0000 7f98c7dff700 1 --2- 172.21.15.84:0/3628619372 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98c0141ff0 0x7f98c0138ce0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:12.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.324+0000 7f98c7dff700 1 --2- 172.21.15.84:0/3628619372 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98c0070710 0x7f98c013f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:12.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.324+0000 7f98c7dff700 1 --2- 172.21.15.84:0/3628619372 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f98a406ace0 0x7f98a406d190 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:12.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.324+0000 7f98c7dff700 1 --2- 172.21.15.84:0/3628619372 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98c00b1a70 0x7f98c0141260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:12.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.324+0000 7f98c7dff700 1 -- 172.21.15.84:0/3628619372 >> 172.21.15.84:0/3628619372 conn(0x7f98c0069f30 msgr2=0x7f98c00b06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:12.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.324+0000 7f98c7dff700 1 -- 172.21.15.84:0/3628619372 shutdown_connections 2023-07-14T11:14:12.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.324+0000 7f98c7dff700 1 -- 172.21.15.84:0/3628619372 wait complete. 2023-07-14T11:14:12.328 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 8 2023-07-14T11:14:12.344 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T11:14:12.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.537+0000 7fdb4b7ff700 1 Processor -- start 2023-07-14T11:14:12.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.537+0000 7fdb4b7ff700 1 -- start start 2023-07-14T11:14:12.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.538+0000 7fdb4b7ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fdb441500d0 0x7fdb44070350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:12.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.538+0000 7fdb4b7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb440cea50 0x7fdb440ceeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:12.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.538+0000 7fdb4b7ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb440cdf90 con 0x7fdb44070890 2023-07-14T11:14:12.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.539+0000 7fdb4b7ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb4415a2f0 con 0x7fdb441500d0 2023-07-14T11:14:12.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.539+0000 7fdb4b7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4415a5d0 con 0x7fdb440cea50 2023-07-14T11:14:12.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.539+0000 7fdb49d9c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb440cea50 0x7fdb440ceeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:12.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.539+0000 7fdb4959b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fdb441500d0 0x7fdb44070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:12.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.539+0000 7fdb48d9a700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fdb44070890 0x7fdb441597c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.84:54926/0 (socket says 172.21.15.84:54926) 2023-07-14T11:14:12.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.539+0000 7fdb48d9a700 1 -- 172.21.15.84:0/475539433 learned_addr learned my addr 172.21.15.84:0/475539433 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:14:12.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.539+0000 7fdb3bfff700 1 -- 172.21.15.84:0/475539433 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 563277650 0 0) 0x7fdb440cdf90 con 0x7fdb44070890 2023-07-14T11:14:12.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.539+0000 7fdb3bfff700 1 -- 172.21.15.84:0/475539433 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb300035b0 con 0x7fdb44070890 2023-07-14T11:14:12.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.539+0000 7fdb4959b700 1 -- 172.21.15.84:0/475539433 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb440cea50 msgr2=0x7fdb440ceeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:12.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.540+0000 7fdb4959b700 1 --2- 172.21.15.84:0/475539433 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb440cea50 0x7fdb440ceeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:12.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.540+0000 7fdb4959b700 1 -- 172.21.15.84:0/475539433 >> v1:172.21.15.179:6789/0 conn(0x7fdb44070890 legacy=0x7fdb441597c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:12.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.540+0000 7fdb4959b700 1 -- 172.21.15.84:0/475539433 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb440ce250 con 0x7fdb441500d0 2023-07-14T11:14:12.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.540+0000 7fdb49d9c700 1 --2- 172.21.15.84:0/475539433 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb440cea50 0x7fdb440ceeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:14:12.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.540+0000 7fdb4959b700 1 --2- 172.21.15.84:0/475539433 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb441500d0 0x7fdb44070350 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fdb40009840 tx=0x7fdb40009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20ec249edb005662 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:12.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.540+0000 7fdb3bfff700 1 -- 172.21.15.84:0/475539433 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb40011830 con 0x7fdb441500d0 2023-07-14T11:14:12.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.540+0000 7fdb3bfff700 1 -- 172.21.15.84:0/475539433 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb40011990 con 0x7fdb441500d0 2023-07-14T11:14:12.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.540+0000 7fdb3bfff700 1 -- 172.21.15.84:0/475539433 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb40011d20 con 0x7fdb441500d0 2023-07-14T11:14:12.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.541+0000 7fdb4b7ff700 1 -- 172.21.15.84:0/475539433 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb441500d0 msgr2=0x7fdb44070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:12.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.541+0000 7fdb4b7ff700 1 --2- 172.21.15.84:0/475539433 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb441500d0 0x7fdb44070350 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fdb40009840 tx=0x7fdb40009b50 comp rx=0 tx=0).stop 2023-07-14T11:14:12.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.541+0000 7fdb4b7ff700 1 -- 172.21.15.84:0/475539433 shutdown_connections 2023-07-14T11:14:12.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.541+0000 7fdb4b7ff700 1 --2- 172.21.15.84:0/475539433 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb440cea50 0x7fdb440ceeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:12.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.541+0000 7fdb4b7ff700 1 --2- 172.21.15.84:0/475539433 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb441500d0 0x7fdb44070350 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:12.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.541+0000 7fdb4b7ff700 1 -- 172.21.15.84:0/475539433 >> 172.21.15.84:0/475539433 conn(0x7fdb44069f30 msgr2=0x7fdb4406a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:12.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.541+0000 7fdb4b7ff700 1 -- 172.21.15.84:0/475539433 shutdown_connections 2023-07-14T11:14:12.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.541+0000 7fdb4b7ff700 1 -- 172.21.15.84:0/475539433 wait complete. 2023-07-14T11:14:12.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.542+0000 7fdb4b7ff700 1 Processor -- start 2023-07-14T11:14:12.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.543+0000 7fdb4b7ff700 1 -- start start 2023-07-14T11:14:12.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.543+0000 7fdb4b7ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb44070890 0x7fdb44145460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:12.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.543+0000 7fdb4b7ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb440cea50 0x7fdb441528e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:12.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.543+0000 7fdb4b7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb441500d0 0x7fdb4414cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:12.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.543+0000 7fdb4b7ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb44151840 con 0x7fdb440cea50 2023-07-14T11:14:12.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.543+0000 7fdb4b7ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb44151b20 con 0x7fdb44070890 2023-07-14T11:14:12.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.543+0000 7fdb4b7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb44151e00 con 0x7fdb441500d0 2023-07-14T11:14:12.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.544+0000 7fdb48d9a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb440cea50 0x7fdb441528e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:12.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.544+0000 7fdb48d9a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb440cea50 0x7fdb441528e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58178/0 (socket says 172.21.15.84:58178) 2023-07-14T11:14:12.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.544+0000 7fdb48d9a700 1 -- 172.21.15.84:0/1573682675 learned_addr learned my addr 172.21.15.84:0/1573682675 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:12.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.544+0000 7fdb4959b700 1 --2- 172.21.15.84:0/1573682675 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb44070890 0x7fdb44145460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:12.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.544+0000 7fdb49d9c700 1 --2- 172.21.15.84:0/1573682675 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb441500d0 0x7fdb4414cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:12.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.544+0000 7fdb48d9a700 1 -- 172.21.15.84:0/1573682675 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb441500d0 msgr2=0x7fdb4414cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:12.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.544+0000 7fdb48d9a700 1 --2- 172.21.15.84:0/1573682675 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb441500d0 0x7fdb4414cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:12.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.544+0000 7fdb48d9a700 1 -- 172.21.15.84:0/1573682675 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb44070890 msgr2=0x7fdb44145460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:12.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.544+0000 7fdb48d9a700 1 --2- 172.21.15.84:0/1573682675 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb44070890 0x7fdb44145460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:12.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.544+0000 7fdb48d9a700 1 -- 172.21.15.84:0/1573682675 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb3c009a70 con 0x7fdb440cea50 2023-07-14T11:14:12.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.544+0000 7fdb48d9a700 1 --2- 172.21.15.84:0/1573682675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb440cea50 0x7fdb441528e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fdb3400c700 tx=0x7fdb3400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:12.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.544+0000 7fdb39ffb700 1 -- 172.21.15.84:0/1573682675 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb34005d70 con 0x7fdb440cea50 2023-07-14T11:14:12.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.545+0000 7fdb39ffb700 1 -- 172.21.15.84:0/1573682675 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb340070d0 con 0x7fdb440cea50 2023-07-14T11:14:12.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.545+0000 7fdb4b7ff700 1 -- 172.21.15.84:0/1573682675 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb400094a0 con 0x7fdb440cea50 2023-07-14T11:14:12.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.545+0000 7fdb39ffb700 1 -- 172.21.15.84:0/1573682675 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb34007460 con 0x7fdb440cea50 2023-07-14T11:14:12.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.545+0000 7fdb4b7ff700 1 -- 172.21.15.84:0/1573682675 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb441523c0 con 0x7fdb440cea50 2023-07-14T11:14:12.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.546+0000 7fdb4b7ff700 1 -- 172.21.15.84:0/1573682675 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb4404e280 con 0x7fdb440cea50 2023-07-14T11:14:12.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.547+0000 7fdb39ffb700 1 -- 172.21.15.84:0/1573682675 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdb340075c0 con 0x7fdb440cea50 2023-07-14T11:14:12.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.548+0000 7fdb39ffb700 1 --2- 172.21.15.84:0/1573682675 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fdb2806ace0 0x7fdb2806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:12.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.548+0000 7fdb39ffb700 1 -- 172.21.15.84:0/1573682675 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fdb34088a50 con 0x7fdb440cea50 2023-07-14T11:14:12.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.548+0000 7fdb4959b700 1 --2- 172.21.15.84:0/1573682675 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fdb2806ace0 0x7fdb2806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:12.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.549+0000 7fdb4959b700 1 --2- 172.21.15.84:0/1573682675 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fdb2806ace0 0x7fdb2806d190 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fdb40000c00 tx=0x7fdb4001c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:12.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.552+0000 7fdb39ffb700 1 -- 172.21.15.84:0/1573682675 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fdb34053a30 con 0x7fdb440cea50 2023-07-14T11:14:12.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.788+0000 7fdb4b7ff700 1 -- 172.21.15.84:0/1573682675 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdb44070130 con 0x7fdb440cea50 2023-07-14T11:14:12.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.789+0000 7fdb39ffb700 1 -- 172.21.15.84:0/1573682675 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4703 (secure 0 0 0) 0x7fdb34057050 con 0x7fdb440cea50 2023-07-14T11:14:12.791 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:14:12.792 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4296,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/811241790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":811241790},{"type":"v1","addr":"172.21.15.84:6836","nonce":811241790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4299,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/729998896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":729998896},{"type":"v1","addr":"172.21.15.84:6837","nonce":729998896}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4305,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3512017231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3512017231},{"type":"v1","addr":"172.21.15.179:6834","nonce":3512017231}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T11:13:14.457746+0000","modified":"2023-07-14T11:13:18.001606+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4308},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4308":{"gid":4308,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/3903854892","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":3903854892},{"type":"v1","addr":"172.21.15.179:6835","nonce":3903854892}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-14T11:14:12.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.791+0000 7fdb4b7ff700 1 -- 172.21.15.84:0/1573682675 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fdb2806ace0 msgr2=0x7fdb2806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:12.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.791+0000 7fdb4b7ff700 1 --2- 172.21.15.84:0/1573682675 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fdb2806ace0 0x7fdb2806d190 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fdb40000c00 tx=0x7fdb4001c040 comp rx=0 tx=0).stop 2023-07-14T11:14:12.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.791+0000 7fdb4b7ff700 1 -- 172.21.15.84:0/1573682675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb440cea50 msgr2=0x7fdb441528e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:12.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.791+0000 7fdb4b7ff700 1 --2- 172.21.15.84:0/1573682675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb440cea50 0x7fdb441528e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fdb3400c700 tx=0x7fdb3400ca10 comp rx=0 tx=0).stop 2023-07-14T11:14:12.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.791+0000 7fdb4b7ff700 1 -- 172.21.15.84:0/1573682675 shutdown_connections 2023-07-14T11:14:12.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.791+0000 7fdb4b7ff700 1 --2- 172.21.15.84:0/1573682675 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fdb2806ace0 0x7fdb2806d190 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:12.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.791+0000 7fdb4b7ff700 1 --2- 172.21.15.84:0/1573682675 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb441500d0 0x7fdb4414cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:12.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.791+0000 7fdb4b7ff700 1 --2- 172.21.15.84:0/1573682675 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb44070890 0x7fdb44145460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:12.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.791+0000 7fdb4b7ff700 1 --2- 172.21.15.84:0/1573682675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb440cea50 0x7fdb441528e0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:12.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.791+0000 7fdb4b7ff700 1 -- 172.21.15.84:0/1573682675 >> 172.21.15.84:0/1573682675 conn(0x7fdb44069f30 msgr2=0x7fdb440ccfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:12.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.792+0000 7fdb4b7ff700 1 -- 172.21.15.84:0/1573682675 shutdown_connections 2023-07-14T11:14:12.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:12.792+0000 7fdb4b7ff700 1 -- 172.21.15.84:0/1573682675 wait complete. 2023-07-14T11:14:12.795 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 8 2023-07-14T11:14:12.811 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:14:13.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.007+0000 7f596bdff700 1 Processor -- start 2023-07-14T11:14:13.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.007+0000 7f596bdff700 1 -- start start 2023-07-14T11:14:13.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.008+0000 7f596bdff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f59640d1160 0x7f596406c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:13.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.008+0000 7f596bdff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59640b5cd0 0x7f59640b0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:13.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.008+0000 7f596bdff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59640d2cc0 con 0x7f5964160030 2023-07-14T11:14:13.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.008+0000 7f596bdff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59640afbb0 con 0x7f59640d1160 2023-07-14T11:14:13.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.009+0000 7f596bdff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59640afe90 con 0x7f59640b5cd0 2023-07-14T11:14:13.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.009+0000 7f596939a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f59640d1160 0x7f596406c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:13.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.009+0000 7f596939a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f59640d1160 0x7f596406c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58192/0 (socket says 172.21.15.84:58192) 2023-07-14T11:14:13.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.009+0000 7f596939a700 1 -- 172.21.15.84:0/228477293 learned_addr learned my addr 172.21.15.84:0/228477293 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:13.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.009+0000 7f596a39c700 1 --2- 172.21.15.84:0/228477293 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59640b5cd0 0x7f59640b0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:13.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.009+0000 7f596939a700 1 -- 172.21.15.84:0/228477293 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59640b5cd0 msgr2=0x7f59640b0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:13.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.009+0000 7f596939a700 1 --2- 172.21.15.84:0/228477293 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59640b5cd0 0x7f59640b0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:13.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.009+0000 7f596939a700 1 -- 172.21.15.84:0/228477293 >> v1:172.21.15.179:6789/0 conn(0x7f5964160030 legacy=0x7f59640d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:13.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.009+0000 7f596939a700 1 -- 172.21.15.84:0/228477293 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59640b0170 con 0x7f59640d1160 2023-07-14T11:14:13.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.009+0000 7f5968b99700 1 -- 172.21.15.84:0/228477293 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4019706833 0 0) 0x7f59640d2cc0 con 0x7f5964160030 2023-07-14T11:14:13.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.010+0000 7f596939a700 1 --2- 172.21.15.84:0/228477293 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59640d1160 0x7f596406c0f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f59540098f0 tx=0x7f5954009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4fc7469c08f4f9a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:13.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.010+0000 7f5968b99700 1 -- 172.21.15.84:0/228477293 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5954011830 con 0x7f59640d1160 2023-07-14T11:14:13.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.010+0000 7f5968b99700 1 -- 172.21.15.84:0/228477293 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5954011990 con 0x7f59640d1160 2023-07-14T11:14:13.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.010+0000 7f5968b99700 1 -- 172.21.15.84:0/228477293 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5954011d20 con 0x7f59640d1160 2023-07-14T11:14:13.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.010+0000 7f596bdff700 1 -- 172.21.15.84:0/228477293 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59640d1160 msgr2=0x7f596406c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:13.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.010+0000 7f596bdff700 1 --2- 172.21.15.84:0/228477293 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59640d1160 0x7f596406c0f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f59540098f0 tx=0x7f5954009c00 comp rx=0 tx=0).stop 2023-07-14T11:14:13.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.010+0000 7f596bdff700 1 -- 172.21.15.84:0/228477293 shutdown_connections 2023-07-14T11:14:13.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.010+0000 7f596bdff700 1 --2- 172.21.15.84:0/228477293 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59640b5cd0 0x7f59640b0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:13.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.010+0000 7f596bdff700 1 --2- 172.21.15.84:0/228477293 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59640d1160 0x7f596406c0f0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:13.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.010+0000 7f596bdff700 1 -- 172.21.15.84:0/228477293 >> 172.21.15.84:0/228477293 conn(0x7f596409c190 msgr2=0x7f59640d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:13.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.011+0000 7f596bdff700 1 -- 172.21.15.84:0/228477293 shutdown_connections 2023-07-14T11:14:13.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.011+0000 7f596bdff700 1 -- 172.21.15.84:0/228477293 wait complete. 2023-07-14T11:14:13.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.012+0000 7f596bdff700 1 Processor -- start 2023-07-14T11:14:13.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.012+0000 7f596bdff700 1 -- start start 2023-07-14T11:14:13.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.013+0000 7f596bdff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59640b5cd0 0x7f5964156ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:13.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.013+0000 7f596bdff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59640d1160 0x7f596415a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:13.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.013+0000 7f596bdff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5964160030 0x7f5964157470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:13.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.013+0000 7f596bdff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f596415c8b0 con 0x7f5964160030 2023-07-14T11:14:13.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.013+0000 7f596bdff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f596415cb50 con 0x7f59640b5cd0 2023-07-14T11:14:13.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.013+0000 7f596bdff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f596415ce30 con 0x7f59640d1160 2023-07-14T11:14:13.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.013+0000 7f596a39c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5964160030 0x7f5964157470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:13.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.014+0000 7f596a39c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5964160030 0x7f5964157470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58194/0 (socket says 172.21.15.84:58194) 2023-07-14T11:14:13.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.014+0000 7f596a39c700 1 -- 172.21.15.84:0/2319933822 learned_addr learned my addr 172.21.15.84:0/2319933822 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:13.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.014+0000 7f596939a700 1 --2- 172.21.15.84:0/2319933822 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59640d1160 0x7f596415a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:13.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.014+0000 7f5969b9b700 1 --2- 172.21.15.84:0/2319933822 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59640b5cd0 0x7f5964156ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:13.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.014+0000 7f596a39c700 1 -- 172.21.15.84:0/2319933822 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59640d1160 msgr2=0x7f596415a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:13.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.014+0000 7f596a39c700 1 --2- 172.21.15.84:0/2319933822 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59640d1160 0x7f596415a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:13.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.014+0000 7f596a39c700 1 -- 172.21.15.84:0/2319933822 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59640b5cd0 msgr2=0x7f5964156ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:13.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.014+0000 7f596a39c700 1 --2- 172.21.15.84:0/2319933822 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59640b5cd0 0x7f5964156ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:13.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.014+0000 7f596a39c700 1 -- 172.21.15.84:0/2319933822 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5954009550 con 0x7f5964160030 2023-07-14T11:14:13.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.014+0000 7f596a39c700 1 --2- 172.21.15.84:0/2319933822 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5964160030 0x7f5964157470 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f595c00ef90 tx=0x7f595c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:13.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.014+0000 7f595a7fc700 1 -- 172.21.15.84:0/2319933822 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595c00cc90 con 0x7f5964160030 2023-07-14T11:14:13.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.015+0000 7f595a7fc700 1 -- 172.21.15.84:0/2319933822 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f595c00f040 con 0x7f5964160030 2023-07-14T11:14:13.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.015+0000 7f596bdff700 1 -- 172.21.15.84:0/2319933822 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f596415a9f0 con 0x7f5964160030 2023-07-14T11:14:13.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.015+0000 7f595a7fc700 1 -- 172.21.15.84:0/2319933822 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595c014480 con 0x7f5964160030 2023-07-14T11:14:13.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.015+0000 7f596bdff700 1 -- 172.21.15.84:0/2319933822 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59641571e0 con 0x7f5964160030 2023-07-14T11:14:13.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.016+0000 7f596bdff700 1 -- 172.21.15.84:0/2319933822 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f596415af10 con 0x7f5964160030 2023-07-14T11:14:13.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.017+0000 7f595a7fc700 1 -- 172.21.15.84:0/2319933822 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f595c0145e0 con 0x7f5964160030 2023-07-14T11:14:13.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.017+0000 7f595a7fc700 1 --2- 172.21.15.84:0/2319933822 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f594806ace0 0x7f594806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:13.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.017+0000 7f595a7fc700 1 -- 172.21.15.84:0/2319933822 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f595c08a090 con 0x7f5964160030 2023-07-14T11:14:13.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.018+0000 7f5969b9b700 1 --2- 172.21.15.84:0/2319933822 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f594806ace0 0x7f594806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:13.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.018+0000 7f5969b9b700 1 --2- 172.21.15.84:0/2319933822 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f594806ace0 0x7f594806d190 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5960000f60 tx=0x7f5960009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:13.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.022+0000 7f595a7fc700 1 -- 172.21.15.84:0/2319933822 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f596415af10 con 0x7f5964160030 2023-07-14T11:14:13.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.217+0000 7f596bdff700 1 -- 172.21.15.84:0/2319933822 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f596415af10 con 0x7f5964160030 2023-07-14T11:14:13.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.218+0000 7f595a7fc700 1 -- 172.21.15.84:0/2319933822 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18351 (secure 0 0 0) 0x7f596415af10 con 0x7f5964160030 2023-07-14T11:14:13.220 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:14:13.221 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":25,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:13:55.825723+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-14T11:13:12.727811+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-14T11:13:13.436391+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.17","mappings":[{"from":3,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:14:13.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.220+0000 7f596bdff700 1 -- 172.21.15.84:0/2319933822 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f594806ace0 msgr2=0x7f594806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:13.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.220+0000 7f596bdff700 1 --2- 172.21.15.84:0/2319933822 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f594806ace0 0x7f594806d190 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5960000f60 tx=0x7f5960009040 comp rx=0 tx=0).stop 2023-07-14T11:14:13.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.220+0000 7f596bdff700 1 -- 172.21.15.84:0/2319933822 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5964160030 msgr2=0x7f5964157470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:13.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.220+0000 7f596bdff700 1 --2- 172.21.15.84:0/2319933822 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5964160030 0x7f5964157470 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f595c00ef90 tx=0x7f595c00c3a0 comp rx=0 tx=0).stop 2023-07-14T11:14:13.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.221+0000 7f596bdff700 1 -- 172.21.15.84:0/2319933822 shutdown_connections 2023-07-14T11:14:13.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.221+0000 7f596bdff700 1 --2- 172.21.15.84:0/2319933822 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5964160030 0x7f5964157470 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:13.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.221+0000 7f596bdff700 1 --2- 172.21.15.84:0/2319933822 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59640b5cd0 0x7f5964156ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:13.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.221+0000 7f596bdff700 1 --2- 172.21.15.84:0/2319933822 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f594806ace0 0x7f594806d190 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:13.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.221+0000 7f596bdff700 1 --2- 172.21.15.84:0/2319933822 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59640d1160 0x7f596415a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:13.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.221+0000 7f596bdff700 1 -- 172.21.15.84:0/2319933822 >> 172.21.15.84:0/2319933822 conn(0x7f596409c190 msgr2=0x7f596415f400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:13.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.221+0000 7f596bdff700 1 -- 172.21.15.84:0/2319933822 shutdown_connections 2023-07-14T11:14:13.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.221+0000 7f596bdff700 1 -- 172.21.15.84:0/2319933822 wait complete. 2023-07-14T11:14:13.241 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-14T11:14:13.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.436+0000 7f83d2dff700 1 Processor -- start 2023-07-14T11:14:13.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.437+0000 7f83d2dff700 1 -- start start 2023-07-14T11:14:13.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.438+0000 7f83d2dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83cc0c92d0 0x7f83cc0ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:13.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.438+0000 7f83d2dff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f83cc0b12f0 0x7f83cc0c96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:13.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.438+0000 7f83d2dff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83cc15ce70 con 0x7f83cc0adea0 2023-07-14T11:14:13.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.438+0000 7f83d2dff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83cc15da60 con 0x7f83cc0b12f0 2023-07-14T11:14:13.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.438+0000 7f83d2dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83cc0c9be0 con 0x7f83cc0c92d0 2023-07-14T11:14:13.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.438+0000 7f83d0b9b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83cc0c92d0 0x7f83cc0ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:13.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.438+0000 7f83cbfff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f83cc0b12f0 0x7f83cc0c96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:13.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.438+0000 7f83d0b9b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83cc0c92d0 0x7f83cc0ad8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.84:54248/0 (socket says 172.21.15.84:54248) 2023-07-14T11:14:13.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.438+0000 7f83d139c700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f83cc0adea0 0x7f83cc06c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.84:54946/0 (socket says 172.21.15.84:54946) 2023-07-14T11:14:13.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.438+0000 7f83d0b9b700 1 -- 172.21.15.84:0/4275266139 learned_addr learned my addr 172.21.15.84:0/4275266139 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:13.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.439+0000 7f83cb7fe700 1 -- 172.21.15.84:0/4275266139 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1277919307 0 0) 0x7f83cc15ce70 con 0x7f83cc0adea0 2023-07-14T11:14:13.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.439+0000 7f83cb7fe700 1 -- 172.21.15.84:0/4275266139 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83bc0035b0 con 0x7f83cc0adea0 2023-07-14T11:14:13.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.439+0000 7f83cbfff700 1 -- 172.21.15.84:0/4275266139 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83cc0c92d0 msgr2=0x7f83cc0ad8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:13.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.439+0000 7f83cbfff700 1 --2- 172.21.15.84:0/4275266139 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83cc0c92d0 0x7f83cc0ad8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:13.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.439+0000 7f83cbfff700 1 -- 172.21.15.84:0/4275266139 >> v1:172.21.15.179:6789/0 conn(0x7f83cc0adea0 legacy=0x7f83cc06c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:13.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.439+0000 7f83cbfff700 1 -- 172.21.15.84:0/4275266139 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83cc15d0c0 con 0x7f83cc0b12f0 2023-07-14T11:14:13.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.439+0000 7f83d0b9b700 1 --2- 172.21.15.84:0/4275266139 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83cc0c92d0 0x7f83cc0ad8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:14:13.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.439+0000 7f83cbfff700 1 --2- 172.21.15.84:0/4275266139 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83cc0b12f0 0x7f83cc0c96a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f83b8009840 tx=0x7f83b8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cbf854b109226fe0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:13.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.439+0000 7f83cb7fe700 1 -- 172.21.15.84:0/4275266139 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b8011830 con 0x7f83cc0b12f0 2023-07-14T11:14:13.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.439+0000 7f83cb7fe700 1 -- 172.21.15.84:0/4275266139 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83b8011990 con 0x7f83cc0b12f0 2023-07-14T11:14:13.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.439+0000 7f83cb7fe700 1 -- 172.21.15.84:0/4275266139 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b8011d20 con 0x7f83cc0b12f0 2023-07-14T11:14:13.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.440+0000 7f83d2dff700 1 -- 172.21.15.84:0/4275266139 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83cc0b12f0 msgr2=0x7f83cc0c96a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:13.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.440+0000 7f83d2dff700 1 --2- 172.21.15.84:0/4275266139 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83cc0b12f0 0x7f83cc0c96a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f83b8009840 tx=0x7f83b8009b50 comp rx=0 tx=0).stop 2023-07-14T11:14:13.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.440+0000 7f83d2dff700 1 -- 172.21.15.84:0/4275266139 shutdown_connections 2023-07-14T11:14:13.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.440+0000 7f83d2dff700 1 --2- 172.21.15.84:0/4275266139 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83cc0c92d0 0x7f83cc0ad8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:13.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.440+0000 7f83d2dff700 1 --2- 172.21.15.84:0/4275266139 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83cc0b12f0 0x7f83cc0c96a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:13.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.440+0000 7f83d2dff700 1 -- 172.21.15.84:0/4275266139 >> 172.21.15.84:0/4275266139 conn(0x7f83cc0b05d0 msgr2=0x7f83cc0b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:13.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.440+0000 7f83d2dff700 1 -- 172.21.15.84:0/4275266139 shutdown_connections 2023-07-14T11:14:13.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.440+0000 7f83d2dff700 1 -- 172.21.15.84:0/4275266139 wait complete. 2023-07-14T11:14:13.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.442+0000 7f83d2dff700 1 Processor -- start 2023-07-14T11:14:13.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.442+0000 7f83d2dff700 1 -- start start 2023-07-14T11:14:13.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.443+0000 7f83d2dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83cc0adea0 0x7f83cc1532e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:13.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.443+0000 7f83d2dff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83cc0b12f0 0x7f83cc0c7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:13.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.443+0000 7f83d2dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83cc0c92d0 0x7f83cc150e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:13.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.443+0000 7f83d2dff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83cc1f5bd0 con 0x7f83cc0b12f0 2023-07-14T11:14:13.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.443+0000 7f83d2dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83cc1f5eb0 con 0x7f83cc0adea0 2023-07-14T11:14:13.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.443+0000 7f83d2dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83cc1f6190 con 0x7f83cc0c92d0 2023-07-14T11:14:13.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.443+0000 7f83cbfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83cc0b12f0 0x7f83cc0c7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:13.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.443+0000 7f83cbfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83cc0b12f0 0x7f83cc0c7580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58204/0 (socket says 172.21.15.84:58204) 2023-07-14T11:14:13.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.443+0000 7f83cbfff700 1 -- 172.21.15.84:0/251152870 learned_addr learned my addr 172.21.15.84:0/251152870 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:13.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.443+0000 7f83d139c700 1 --2- 172.21.15.84:0/251152870 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83cc0c92d0 0x7f83cc150e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:13.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.443+0000 7f83d0b9b700 1 --2- 172.21.15.84:0/251152870 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83cc0adea0 0x7f83cc1532e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:13.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.443+0000 7f83cbfff700 1 -- 172.21.15.84:0/251152870 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83cc0c92d0 msgr2=0x7f83cc150e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:13.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.443+0000 7f83cbfff700 1 --2- 172.21.15.84:0/251152870 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83cc0c92d0 0x7f83cc150e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:13.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.443+0000 7f83cbfff700 1 -- 172.21.15.84:0/251152870 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83cc0adea0 msgr2=0x7f83cc1532e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:13.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.443+0000 7f83cbfff700 1 --2- 172.21.15.84:0/251152870 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83cc0adea0 0x7f83cc1532e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:13.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.444+0000 7f83cbfff700 1 -- 172.21.15.84:0/251152870 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c000b7f0 con 0x7f83cc0b12f0 2023-07-14T11:14:13.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.444+0000 7f83cbfff700 1 --2- 172.21.15.84:0/251152870 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83cc0b12f0 0x7f83cc0c7580 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f83b80090b0 tx=0x7f83b8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:13.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.444+0000 7f83c97fa700 1 -- 172.21.15.84:0/251152870 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b8004590 con 0x7f83cc0b12f0 2023-07-14T11:14:13.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.444+0000 7f83c97fa700 1 -- 172.21.15.84:0/251152870 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83b801f070 con 0x7f83cc0b12f0 2023-07-14T11:14:13.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.444+0000 7f83d2dff700 1 -- 172.21.15.84:0/251152870 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83b80094a0 con 0x7f83cc0b12f0 2023-07-14T11:14:13.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.444+0000 7f83c97fa700 1 -- 172.21.15.84:0/251152870 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b80038e0 con 0x7f83cc0b12f0 2023-07-14T11:14:13.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.444+0000 7f83d2dff700 1 -- 172.21.15.84:0/251152870 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83cc151730 con 0x7f83cc0b12f0 2023-07-14T11:14:13.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.445+0000 7f83d2dff700 1 -- 172.21.15.84:0/251152870 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83cc0ce270 con 0x7f83cc0b12f0 2023-07-14T11:14:13.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.446+0000 7f83c97fa700 1 -- 172.21.15.84:0/251152870 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f83b8003a40 con 0x7f83cc0b12f0 2023-07-14T11:14:13.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.447+0000 7f83c97fa700 1 --2- 172.21.15.84:0/251152870 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f83b006ace0 0x7f83b006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:13.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.447+0000 7f83c97fa700 1 -- 172.21.15.84:0/251152870 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f83b8021070 con 0x7f83cc0b12f0 2023-07-14T11:14:13.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.448+0000 7f83d0b9b700 1 --2- 172.21.15.84:0/251152870 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f83b006ace0 0x7f83b006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:13.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.448+0000 7f83d0b9b700 1 --2- 172.21.15.84:0/251152870 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f83b006ace0 0x7f83b006d190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f83c000b240 tx=0x7f83c000b4d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:13.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.451+0000 7f83c97fa700 1 -- 172.21.15.84:0/251152870 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f83b8055d20 con 0x7f83cc0b12f0 2023-07-14T11:14:13.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.690+0000 7f83d2dff700 1 -- 172.21.15.84:0/251152870 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f83cc15cee0 con 0x7f83cc0b12f0 2023-07-14T11:14:13.693 INFO:tasks.ceph.mon.a.smithi084.stderr:2023-07-14T11:14:13.691+0000 7f5e043f4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-14T11:14:13.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.696+0000 7f83c97fa700 1 -- 172.21.15.84:0/251152870 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f83b8059340 con 0x7f83cc0b12f0 2023-07-14T11:14:13.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.699+0000 7f83d2dff700 1 -- 172.21.15.84:0/251152870 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f83b006ace0 msgr2=0x7f83b006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:13.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.699+0000 7f83d2dff700 1 --2- 172.21.15.84:0/251152870 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f83b006ace0 0x7f83b006d190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f83c000b240 tx=0x7f83c000b4d0 comp rx=0 tx=0).stop 2023-07-14T11:14:13.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.699+0000 7f83d2dff700 1 -- 172.21.15.84:0/251152870 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83cc0b12f0 msgr2=0x7f83cc0c7580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:13.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.699+0000 7f83d2dff700 1 --2- 172.21.15.84:0/251152870 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83cc0b12f0 0x7f83cc0c7580 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f83b80090b0 tx=0x7f83b8004750 comp rx=0 tx=0).stop 2023-07-14T11:14:13.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.699+0000 7f83d2dff700 1 -- 172.21.15.84:0/251152870 shutdown_connections 2023-07-14T11:14:13.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.699+0000 7f83d2dff700 1 --2- 172.21.15.84:0/251152870 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f83b006ace0 0x7f83b006d190 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:13.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.699+0000 7f83d2dff700 1 --2- 172.21.15.84:0/251152870 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83cc0c92d0 0x7f83cc150e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:13.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.699+0000 7f83d2dff700 1 --2- 172.21.15.84:0/251152870 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83cc0adea0 0x7f83cc1532e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:13.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.699+0000 7f83d2dff700 1 --2- 172.21.15.84:0/251152870 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83cc0b12f0 0x7f83cc0c7580 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:13.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.699+0000 7f83d2dff700 1 -- 172.21.15.84:0/251152870 >> 172.21.15.84:0/251152870 conn(0x7f83cc0b05d0 msgr2=0x7f83cc0cb2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:13.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.699+0000 7f83d2dff700 1 -- 172.21.15.84:0/251152870 shutdown_connections 2023-07-14T11:14:13.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.699+0000 7f83d2dff700 1 -- 172.21.15.84:0/251152870 wait complete. 2023-07-14T11:14:13.703 INFO:teuthology.orchestra.run.smithi084.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-14T11:14:13.719 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-14T11:14:13.766 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2023-07-14T11:14:13.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.914+0000 7f02589ff700 1 Processor -- start 2023-07-14T11:14:13.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.914+0000 7f02589ff700 1 -- start start 2023-07-14T11:14:13.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.915+0000 7f02589ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f025415fc00 0x7f02540ae1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:13.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.915+0000 7f02589ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02540b21b0 con 0x7f02540cd8c0 2023-07-14T11:14:13.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.915+0000 7f02589ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f025406b8a0 con 0x7f02540ae730 2023-07-14T11:14:13.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.915+0000 7f02589ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f025406ad20 con 0x7f025415fc00 2023-07-14T11:14:13.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.915+0000 7f0252d9d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f02540cd8c0 0x7f02540b2650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:59484/0 (socket says 172.21.15.84:59484) 2023-07-14T11:14:13.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.916+0000 7f0252d9d700 1 -- 172.21.15.84:0/2268388646 learned_addr learned my addr 172.21.15.84:0/2268388646 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:14:13.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.916+0000 7f025259c700 1 --2- 172.21.15.84:0/2268388646 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f025415fc00 0x7f02540ae1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:13.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.916+0000 7f0251d9b700 1 -- 172.21.15.84:0/2268388646 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3283142263 0 0) 0x7f02540b21b0 con 0x7f02540cd8c0 2023-07-14T11:14:13.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.916+0000 7f0251d9b700 1 -- 172.21.15.84:0/2268388646 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02400035b0 con 0x7f02540cd8c0 2023-07-14T11:14:13.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.916+0000 7f025259c700 1 -- 172.21.15.84:0/2268388646 >> v1:172.21.15.179:6789/0 conn(0x7f02540ae730 legacy=0x7f02540cd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:13.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.916+0000 7f025259c700 1 -- 172.21.15.84:0/2268388646 >> v1:172.21.15.84:6789/0 conn(0x7f02540cd8c0 legacy=0x7f02540b2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:13.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.916+0000 7f025259c700 1 -- 172.21.15.84:0/2268388646 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f025406b000 con 0x7f025415fc00 2023-07-14T11:14:13.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.916+0000 7f025259c700 1 --2- 172.21.15.84:0/2268388646 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f025415fc00 0x7f02540ae1f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0244009870 tx=0x7f0244009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2805d05c8b8c09e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:13.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.917+0000 7f0251d9b700 1 -- 172.21.15.84:0/2268388646 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0244004230 con 0x7f025415fc00 2023-07-14T11:14:13.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.917+0000 7f0251d9b700 1 -- 172.21.15.84:0/2268388646 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0244004390 con 0x7f025415fc00 2023-07-14T11:14:13.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.917+0000 7f0251d9b700 1 -- 172.21.15.84:0/2268388646 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02440036a0 con 0x7f025415fc00 2023-07-14T11:14:13.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.917+0000 7f02589ff700 1 -- 172.21.15.84:0/2268388646 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f025415fc00 msgr2=0x7f02540ae1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:13.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.917+0000 7f02589ff700 1 --2- 172.21.15.84:0/2268388646 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f025415fc00 0x7f02540ae1f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0244009870 tx=0x7f0244009b80 comp rx=0 tx=0).stop 2023-07-14T11:14:13.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.917+0000 7f02589ff700 1 -- 172.21.15.84:0/2268388646 shutdown_connections 2023-07-14T11:14:13.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.917+0000 7f02589ff700 1 --2- 172.21.15.84:0/2268388646 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f025415fc00 0x7f02540ae1f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:13.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.917+0000 7f02589ff700 1 -- 172.21.15.84:0/2268388646 >> 172.21.15.84:0/2268388646 conn(0x7f02540cc990 msgr2=0x7f02540cf2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:13.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.917+0000 7f02589ff700 1 -- 172.21.15.84:0/2268388646 shutdown_connections 2023-07-14T11:14:13.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.917+0000 7f02589ff700 1 -- 172.21.15.84:0/2268388646 wait complete. 2023-07-14T11:14:13.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.919+0000 7f02589ff700 1 Processor -- start 2023-07-14T11:14:13.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.919+0000 7f02589ff700 1 -- start start 2023-07-14T11:14:13.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.920+0000 7f02589ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f02540ae730 0x7f02540b1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:13.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.920+0000 7f02589ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02540cd8c0 0x7f02540c2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:13.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.920+0000 7f02589ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f025415fc00 0x7f02540c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:13.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.920+0000 7f02589ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02540c3320 con 0x7f025415fc00 2023-07-14T11:14:13.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.920+0000 7f02589ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02540c5480 con 0x7f02540ae730 2023-07-14T11:14:13.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.920+0000 7f02589ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02540c5760 con 0x7f02540cd8c0 2023-07-14T11:14:13.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.920+0000 7f0252d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f025415fc00 0x7f02540c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:13.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.920+0000 7f0252d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f025415fc00 0x7f02540c4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58216/0 (socket says 172.21.15.84:58216) 2023-07-14T11:14:13.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.920+0000 7f0252d9d700 1 -- 172.21.15.84:0/3033807338 learned_addr learned my addr 172.21.15.84:0/3033807338 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:13.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.921+0000 7f025259c700 1 --2- 172.21.15.84:0/3033807338 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f02540ae730 0x7f02540b1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:13.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.921+0000 7f0252d9d700 1 -- 172.21.15.84:0/3033807338 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02540cd8c0 msgr2=0x7f02540c2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:13.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.921+0000 7f0252d9d700 1 --2- 172.21.15.84:0/3033807338 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02540cd8c0 0x7f02540c2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:13.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.921+0000 7f0252d9d700 1 -- 172.21.15.84:0/3033807338 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f02540ae730 msgr2=0x7f02540b1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:13.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.921+0000 7f0252d9d700 1 --2- 172.21.15.84:0/3033807338 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f02540ae730 0x7f02540b1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:13.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.921+0000 7f0252d9d700 1 -- 172.21.15.84:0/3033807338 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02440094a0 con 0x7f025415fc00 2023-07-14T11:14:13.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.921+0000 7f025259c700 1 --2- 172.21.15.84:0/3033807338 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f02540ae730 0x7f02540b1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:14:13.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.921+0000 7f0252d9d700 1 --2- 172.21.15.84:0/3033807338 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f025415fc00 0x7f02540c4a90 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f024c00cbb0 tx=0x7f024c00cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:13.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.921+0000 7f024affd700 1 -- 172.21.15.84:0/3033807338 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f024c00ab50 con 0x7f025415fc00 2023-07-14T11:14:13.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.921+0000 7f024affd700 1 -- 172.21.15.84:0/3033807338 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f024c00acb0 con 0x7f025415fc00 2023-07-14T11:14:13.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.921+0000 7f02589ff700 1 -- 172.21.15.84:0/3033807338 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02540c5a40 con 0x7f025415fc00 2023-07-14T11:14:13.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.921+0000 7f024affd700 1 -- 172.21.15.84:0/3033807338 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f024c012600 con 0x7f025415fc00 2023-07-14T11:14:13.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.921+0000 7f02589ff700 1 -- 172.21.15.84:0/3033807338 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02540c4fd0 con 0x7f025415fc00 2023-07-14T11:14:13.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.922+0000 7f02589ff700 1 -- 172.21.15.84:0/3033807338 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02540c51f0 con 0x7f025415fc00 2023-07-14T11:14:13.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.924+0000 7f024affd700 1 -- 172.21.15.84:0/3033807338 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f024c012760 con 0x7f025415fc00 2023-07-14T11:14:13.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.924+0000 7f024affd700 1 --2- 172.21.15.84:0/3033807338 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f023406ace0 0x7f023406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:13.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.925+0000 7f024affd700 1 -- 172.21.15.84:0/3033807338 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6206+0+0 (secure 0 0 0) 0x7f024c089140 con 0x7f025415fc00 2023-07-14T11:14:13.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.925+0000 7f025259c700 1 --2- 172.21.15.84:0/3033807338 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f023406ace0 0x7f023406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:13.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.925+0000 7f025259c700 1 --2- 172.21.15.84:0/3033807338 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f023406ace0 0x7f023406d190 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f02440097c0 tx=0x7f0244008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:13.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:13.929+0000 7f024affd700 1 -- 172.21.15.84:0/3033807338 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f024c054200 con 0x7f025415fc00 2023-07-14T11:14:14.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:14.169+0000 7f02589ff700 1 -- 172.21.15.84:0/3033807338 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f0254074350 con 0x7f025415fc00 2023-07-14T11:14:14.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:14.697+0000 7f024affd700 1 -- 172.21.15.84:0/3033807338 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f024c057820 con 0x7f025415fc00 2023-07-14T11:14:14.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:14.700+0000 7f02589ff700 1 -- 172.21.15.84:0/3033807338 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f023406ace0 msgr2=0x7f023406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:14.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:14.700+0000 7f02589ff700 1 --2- 172.21.15.84:0/3033807338 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f023406ace0 0x7f023406d190 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f02440097c0 tx=0x7f0244008030 comp rx=0 tx=0).stop 2023-07-14T11:14:14.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:14.700+0000 7f02589ff700 1 -- 172.21.15.84:0/3033807338 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f025415fc00 msgr2=0x7f02540c4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:14.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:14.700+0000 7f02589ff700 1 --2- 172.21.15.84:0/3033807338 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f025415fc00 0x7f02540c4a90 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f024c00cbb0 tx=0x7f024c00cf70 comp rx=0 tx=0).stop 2023-07-14T11:14:14.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:14.700+0000 7f02589ff700 1 -- 172.21.15.84:0/3033807338 shutdown_connections 2023-07-14T11:14:14.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:14.700+0000 7f02589ff700 1 --2- 172.21.15.84:0/3033807338 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f025415fc00 0x7f02540c4a90 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:14.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:14.700+0000 7f02589ff700 1 --2- 172.21.15.84:0/3033807338 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f02540ae730 0x7f02540b1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:14.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:14.700+0000 7f02589ff700 1 --2- 172.21.15.84:0/3033807338 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f023406ace0 0x7f023406d190 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:14.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:14.700+0000 7f02589ff700 1 --2- 172.21.15.84:0/3033807338 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02540cd8c0 0x7f02540c2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:14.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:14.700+0000 7f02589ff700 1 -- 172.21.15.84:0/3033807338 >> 172.21.15.84:0/3033807338 conn(0x7f02540cc990 msgr2=0x7f025406c5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:14.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:14.700+0000 7f02589ff700 1 -- 172.21.15.84:0/3033807338 shutdown_connections 2023-07-14T11:14:14.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:14.700+0000 7f02589ff700 1 -- 172.21.15.84:0/3033807338 wait complete. 2023-07-14T11:14:14.722 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-14T11:14:14.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:14.919+0000 7f1452d9d700 1 Processor -- start 2023-07-14T11:14:14.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:14.919+0000 7f1452d9d700 1 -- start start 2023-07-14T11:14:14.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:14.920+0000 7f1452d9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f144c15c690 0x7f144c0d1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:14.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:14.920+0000 7f1452d9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f144c0cd260 0x7f144c0cd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:14.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:14.920+0000 7f1452d9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f144c0cdbf0 con 0x7f144c0b5a60 2023-07-14T11:14:14.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:14.920+0000 7f1452d9d700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f144c0d0ba0 con 0x7f144c0cd260 2023-07-14T11:14:14.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:14.920+0000 7f1452d9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f144c15ca60 con 0x7f144c15c690 2023-07-14T11:14:14.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:14.921+0000 7f145159a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f144c0cd260 0x7f144c0cd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:14.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:14.921+0000 7f145159a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f144c0cd260 0x7f144c0cd6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58232/0 (socket says 172.21.15.84:58232) 2023-07-14T11:14:14.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:14.921+0000 7f145159a700 1 -- 172.21.15.84:0/2027509038 learned_addr learned my addr 172.21.15.84:0/2027509038 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:14.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:14.921+0000 7f1451d9b700 1 --2- 172.21.15.84:0/2027509038 >> v2:172.21.15.179:3300/0 conn(0x7f144c15c690 0x7f144c0d1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:14.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:14.921+0000 7f145159a700 1 -- 172.21.15.84:0/2027509038 >> v2:172.21.15.179:3300/0 conn(0x7f144c15c690 msgr2=0x7f144c0d1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:14.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:14.921+0000 7f145159a700 1 --2- 172.21.15.84:0/2027509038 >> v2:172.21.15.179:3300/0 conn(0x7f144c15c690 0x7f144c0d1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:14.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:14.921+0000 7f145159a700 1 -- 172.21.15.84:0/2027509038 >> v1:172.21.15.179:6789/0 conn(0x7f144c0b5a60 legacy=0x7f144c0b5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:14.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:14.921+0000 7f145159a700 1 -- 172.21.15.84:0/2027509038 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f144c0d3930 con 0x7f144c0cd260 2023-07-14T11:14:14.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:14.921+0000 7f145159a700 1 --2- 172.21.15.84:0/2027509038 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f144c0cd260 0x7f144c0cd6b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f144c0b4f00 tx=0x7f143c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa46a5787f1c5130 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:14.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:14.922+0000 7f1450d99700 1 -- 172.21.15.84:0/2027509038 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f143c011830 con 0x7f144c0cd260 2023-07-14T11:14:14.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:14.922+0000 7f1450d99700 1 -- 172.21.15.84:0/2027509038 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f143c011990 con 0x7f144c0cd260 2023-07-14T11:14:14.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:14.922+0000 7f1450d99700 1 -- 172.21.15.84:0/2027509038 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f143c011d20 con 0x7f144c0cd260 2023-07-14T11:14:14.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:14.922+0000 7f1452d9d700 1 -- 172.21.15.84:0/2027509038 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f144c0cd260 msgr2=0x7f144c0cd6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:14.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:14.922+0000 7f1452d9d700 1 --2- 172.21.15.84:0/2027509038 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f144c0cd260 0x7f144c0cd6b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f144c0b4f00 tx=0x7f143c009bd0 comp rx=0 tx=0).stop 2023-07-14T11:14:14.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:14.922+0000 7f1452d9d700 1 -- 172.21.15.84:0/2027509038 shutdown_connections 2023-07-14T11:14:14.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:14.922+0000 7f1452d9d700 1 --2- 172.21.15.84:0/2027509038 >> v2:172.21.15.179:3300/0 conn(0x7f144c15c690 0x7f144c0d1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:14.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:14.922+0000 7f1452d9d700 1 --2- 172.21.15.84:0/2027509038 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f144c0cd260 0x7f144c0cd6b0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:14.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:14.922+0000 7f1452d9d700 1 -- 172.21.15.84:0/2027509038 >> 172.21.15.84:0/2027509038 conn(0x7f144c06a470 msgr2=0x7f144c06a840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:14.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:14.922+0000 7f1452d9d700 1 -- 172.21.15.84:0/2027509038 shutdown_connections 2023-07-14T11:14:14.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:14.922+0000 7f1452d9d700 1 -- 172.21.15.84:0/2027509038 wait complete. 2023-07-14T11:14:14.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:14.924+0000 7f1452d9d700 1 Processor -- start 2023-07-14T11:14:14.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:14.924+0000 7f1452d9d700 1 -- start start 2023-07-14T11:14:14.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:14.925+0000 7f1452d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f144c0b5a60 0x7f144c0ca1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:14.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:14.925+0000 7f1452d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f144c0cd260 0x7f144c1f29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:14.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:14.925+0000 7f1452d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f144c15c690 0x7f144c0b3c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:14.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:14.925+0000 7f1452d9d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f144c1f2f10 con 0x7f144c0b5a60 2023-07-14T11:14:14.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:14.925+0000 7f1452d9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f144c0b41a0 con 0x7f144c0cd260 2023-07-14T11:14:14.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:14.925+0000 7f1452d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f144c0ca8a0 con 0x7f144c15c690 2023-07-14T11:14:14.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:14.925+0000 7f1451d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f144c0b5a60 0x7f144c0ca1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:14.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:14.925+0000 7f1451d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f144c0b5a60 0x7f144c0ca1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58248/0 (socket says 172.21.15.84:58248) 2023-07-14T11:14:14.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:14.925+0000 7f1451d9b700 1 -- 172.21.15.84:0/811104444 learned_addr learned my addr 172.21.15.84:0/811104444 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:14.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:14.926+0000 7f145159a700 1 --2- 172.21.15.84:0/811104444 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f144c0cd260 0x7f144c1f29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:14.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:14.926+0000 7f145259c700 1 --2- 172.21.15.84:0/811104444 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f144c15c690 0x7f144c0b3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:14.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:14.926+0000 7f1451d9b700 1 -- 172.21.15.84:0/811104444 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f144c15c690 msgr2=0x7f144c0b3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:14.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:14.926+0000 7f1451d9b700 1 --2- 172.21.15.84:0/811104444 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f144c15c690 0x7f144c0b3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:14.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:14.926+0000 7f1451d9b700 1 -- 172.21.15.84:0/811104444 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f144c0cd260 msgr2=0x7f144c1f29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:14.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:14.926+0000 7f1451d9b700 1 --2- 172.21.15.84:0/811104444 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f144c0cd260 0x7f144c1f29d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:14.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:14.926+0000 7f1451d9b700 1 -- 172.21.15.84:0/811104444 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f143c009550 con 0x7f144c0b5a60 2023-07-14T11:14:14.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:14.926+0000 7f145259c700 1 --2- 172.21.15.84:0/811104444 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f144c15c690 0x7f144c0b3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:14:14.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:14.926+0000 7f1451d9b700 1 --2- 172.21.15.84:0/811104444 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f144c0b5a60 0x7f144c0ca1a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f144800e870 tx=0x7f144800ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:14.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:14.926+0000 7f14427fc700 1 -- 172.21.15.84:0/811104444 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1448009590 con 0x7f144c0b5a60 2023-07-14T11:14:14.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:14.926+0000 7f14427fc700 1 -- 172.21.15.84:0/811104444 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f144800ee70 con 0x7f144c0b5a60 2023-07-14T11:14:14.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:14.926+0000 7f1452d9d700 1 -- 172.21.15.84:0/811104444 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f144c0cab80 con 0x7f144c0b5a60 2023-07-14T11:14:14.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:14.926+0000 7f14427fc700 1 -- 172.21.15.84:0/811104444 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f144800ca50 con 0x7f144c0b5a60 2023-07-14T11:14:14.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:14.927+0000 7f1452d9d700 1 -- 172.21.15.84:0/811104444 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f144c1efc30 con 0x7f144c0b5a60 2023-07-14T11:14:14.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:14.928+0000 7f1452d9d700 1 -- 172.21.15.84:0/811104444 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f144c0b48c0 con 0x7f144c0b5a60 2023-07-14T11:14:14.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:14.928+0000 7f14427fc700 1 -- 172.21.15.84:0/811104444 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f144800cbb0 con 0x7f144c0b5a60 2023-07-14T11:14:14.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:14.929+0000 7f14427fc700 1 --2- 172.21.15.84:0/811104444 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f143006ace0 0x7f143006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:14.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:14.929+0000 7f14427fc700 1 -- 172.21.15.84:0/811104444 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6206+0+0 (secure 0 0 0) 0x7f1448089580 con 0x7f144c0b5a60 2023-07-14T11:14:14.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:14.930+0000 7f145159a700 1 --2- 172.21.15.84:0/811104444 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f143006ace0 0x7f143006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:14.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:14.930+0000 7f145159a700 1 --2- 172.21.15.84:0/811104444 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f143006ace0 0x7f143006d190 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f143c009c10 tx=0x7f143c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:14.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:14.933+0000 7f14427fc700 1 -- 172.21.15.84:0/811104444 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f1448057f90 con 0x7f144c0b5a60 2023-07-14T11:14:15.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:15.129+0000 7f1452d9d700 1 -- 172.21.15.84:0/811104444 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f144c04e210 con 0x7f144c0b5a60 2023-07-14T11:14:15.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:15.920+0000 7f14427fc700 1 -- 172.21.15.84:0/811104444 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v27) v1 ==== 181+0+0 (secure 0 0 0) 0x7f144800ce60 con 0x7f144c0b5a60 2023-07-14T11:14:15.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:15.924+0000 7f1452d9d700 1 -- 172.21.15.84:0/811104444 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f143006ace0 msgr2=0x7f143006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:15.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:15.924+0000 7f1452d9d700 1 --2- 172.21.15.84:0/811104444 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f143006ace0 0x7f143006d190 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f143c009c10 tx=0x7f143c008030 comp rx=0 tx=0).stop 2023-07-14T11:14:15.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:15.924+0000 7f1452d9d700 1 -- 172.21.15.84:0/811104444 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f144c0b5a60 msgr2=0x7f144c0ca1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:15.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:15.924+0000 7f1452d9d700 1 --2- 172.21.15.84:0/811104444 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f144c0b5a60 0x7f144c0ca1a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f144800e870 tx=0x7f144800ec30 comp rx=0 tx=0).stop 2023-07-14T11:14:15.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:15.924+0000 7f1452d9d700 1 -- 172.21.15.84:0/811104444 shutdown_connections 2023-07-14T11:14:15.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:15.924+0000 7f1452d9d700 1 --2- 172.21.15.84:0/811104444 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f143006ace0 0x7f143006d190 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:15.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:15.924+0000 7f1452d9d700 1 --2- 172.21.15.84:0/811104444 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f144c15c690 0x7f144c0b3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:15.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:15.924+0000 7f1452d9d700 1 --2- 172.21.15.84:0/811104444 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f144c0b5a60 0x7f144c0ca1a0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:15.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:15.924+0000 7f1452d9d700 1 --2- 172.21.15.84:0/811104444 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f144c0cd260 0x7f144c1f29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:15.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:15.924+0000 7f1452d9d700 1 -- 172.21.15.84:0/811104444 >> 172.21.15.84:0/811104444 conn(0x7f144c06a470 msgr2=0x7f144c15a040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:15.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:15.924+0000 7f1452d9d700 1 -- 172.21.15.84:0/811104444 shutdown_connections 2023-07-14T11:14:15.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:15.924+0000 7f1452d9d700 1 -- 172.21.15.84:0/811104444 wait complete. 2023-07-14T11:14:15.928 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_metadata' removed 2023-07-14T11:14:15.949 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-14T11:14:16.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:16.150+0000 7fb95adff700 1 Processor -- start 2023-07-14T11:14:16.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:16.150+0000 7fb95adff700 1 -- start start 2023-07-14T11:14:16.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:16.152+0000 7fb95adff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb95415d810 0x7fb9540b2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:16.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:16.152+0000 7fb95adff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb9540b2770 0x7fb95406fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:16.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:16.152+0000 7fb95adff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb954159fb0 con 0x7fb954156e40 2023-07-14T11:14:16.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:16.152+0000 7fb95adff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb954159db0 con 0x7fb95415d810 2023-07-14T11:14:16.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:16.152+0000 7fb95adff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb95415a290 con 0x7fb9540b2770 2023-07-14T11:14:16.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:16.152+0000 7fb953fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb95415d810 0x7fb9540b2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:16.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:16.152+0000 7fb958b9b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fb954156e40 0x7fb9541596a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:59494/0 (socket says 172.21.15.84:59494) 2023-07-14T11:14:16.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:16.152+0000 7fb953fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb95415d810 0x7fb9540b2230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58264/0 (socket says 172.21.15.84:58264) 2023-07-14T11:14:16.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:16.152+0000 7fb958b9b700 1 -- 172.21.15.84:0/1766567565 learned_addr learned my addr 172.21.15.84:0/1766567565 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:14:16.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:16.152+0000 7fb953fff700 1 -- 172.21.15.84:0/1766567565 >> v2:172.21.15.179:3300/0 conn(0x7fb9540b2770 msgr2=0x7fb95406fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:16.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:16.152+0000 7fb95939c700 1 --2- 172.21.15.84:0/1766567565 >> v2:172.21.15.179:3300/0 conn(0x7fb9540b2770 0x7fb95406fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:16.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:16.152+0000 7fb953fff700 1 --2- 172.21.15.84:0/1766567565 >> v2:172.21.15.179:3300/0 conn(0x7fb9540b2770 0x7fb95406fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:16.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:16.152+0000 7fb9537fe700 1 -- 172.21.15.84:0/1766567565 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2816611845 0 0) 0x7fb954159fb0 con 0x7fb954156e40 2023-07-14T11:14:16.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:16.152+0000 7fb953fff700 1 -- 172.21.15.84:0/1766567565 >> v1:172.21.15.84:6789/0 conn(0x7fb954156e40 legacy=0x7fb9541596a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:16.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:16.152+0000 7fb953fff700 1 -- 172.21.15.84:0/1766567565 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb95415a570 con 0x7fb95415d810 2023-07-14T11:14:16.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:16.152+0000 7fb95939c700 1 --2- 172.21.15.84:0/1766567565 >> v2:172.21.15.179:3300/0 conn(0x7fb9540b2770 0x7fb95406fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:14:16.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:16.153+0000 7fb953fff700 1 --2- 172.21.15.84:0/1766567565 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb95415d810 0x7fb9540b2230 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb95415cc10 tx=0x7fb94000bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef3667b67cd025c3 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:16.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:16.153+0000 7fb9537fe700 1 -- 172.21.15.84:0/1766567565 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94000dc70 con 0x7fb95415d810 2023-07-14T11:14:16.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:16.153+0000 7fb9537fe700 1 -- 172.21.15.84:0/1766567565 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb94000ddd0 con 0x7fb95415d810 2023-07-14T11:14:16.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:16.153+0000 7fb9537fe700 1 -- 172.21.15.84:0/1766567565 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb940010690 con 0x7fb95415d810 2023-07-14T11:14:16.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:16.153+0000 7fb95adff700 1 -- 172.21.15.84:0/1766567565 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb95415d810 msgr2=0x7fb9540b2230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:16.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:16.153+0000 7fb95adff700 1 --2- 172.21.15.84:0/1766567565 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb95415d810 0x7fb9540b2230 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb95415cc10 tx=0x7fb94000bdc0 comp rx=0 tx=0).stop 2023-07-14T11:14:16.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:16.153+0000 7fb95adff700 1 -- 172.21.15.84:0/1766567565 shutdown_connections 2023-07-14T11:14:16.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:16.153+0000 7fb95adff700 1 --2- 172.21.15.84:0/1766567565 >> v2:172.21.15.179:3300/0 conn(0x7fb9540b2770 0x7fb95406fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:16.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:16.153+0000 7fb95adff700 1 --2- 172.21.15.84:0/1766567565 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb95415d810 0x7fb9540b2230 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:16.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:16.153+0000 7fb95adff700 1 -- 172.21.15.84:0/1766567565 >> 172.21.15.84:0/1766567565 conn(0x7fb954065bd0 msgr2=0x7fb954065fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:16.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:16.154+0000 7fb95adff700 1 -- 172.21.15.84:0/1766567565 shutdown_connections 2023-07-14T11:14:16.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:16.154+0000 7fb95adff700 1 -- 172.21.15.84:0/1766567565 wait complete. 2023-07-14T11:14:16.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:16.155+0000 7fb95adff700 1 Processor -- start 2023-07-14T11:14:16.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:16.155+0000 7fb95adff700 1 -- start start 2023-07-14T11:14:16.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:16.156+0000 7fb95adff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9540b2770 0x7fb9540b1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:16.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:16.156+0000 7fb95adff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb954156e40 0x7fb9540ccc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:16.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:16.156+0000 7fb95adff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb95415d810 0x7fb9540afec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:16.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:16.156+0000 7fb95adff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9540cd1b0 con 0x7fb95415d810 2023-07-14T11:14:16.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:16.156+0000 7fb95adff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9541e8390 con 0x7fb954156e40 2023-07-14T11:14:16.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:16.156+0000 7fb95adff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9540b06a0 con 0x7fb9540b2770 2023-07-14T11:14:16.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:16.157+0000 7fb95939c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb95415d810 0x7fb9540afec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:16.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:16.157+0000 7fb95939c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb95415d810 0x7fb9540afec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58278/0 (socket says 172.21.15.84:58278) 2023-07-14T11:14:16.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:16.157+0000 7fb95939c700 1 -- 172.21.15.84:0/1331245869 learned_addr learned my addr 172.21.15.84:0/1331245869 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:16.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:16.157+0000 7fb958b9b700 1 --2- 172.21.15.84:0/1331245869 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9540b2770 0x7fb9540b1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:16.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:16.157+0000 7fb953fff700 1 --2- 172.21.15.84:0/1331245869 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb954156e40 0x7fb9540ccc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:16.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:16.157+0000 7fb95939c700 1 -- 172.21.15.84:0/1331245869 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9540b2770 msgr2=0x7fb9540b1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:16.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:16.157+0000 7fb95939c700 1 --2- 172.21.15.84:0/1331245869 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9540b2770 0x7fb9540b1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:16.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:16.157+0000 7fb95939c700 1 -- 172.21.15.84:0/1331245869 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb954156e40 msgr2=0x7fb9540ccc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:16.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:16.157+0000 7fb95939c700 1 --2- 172.21.15.84:0/1331245869 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb954156e40 0x7fb9540ccc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:16.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:16.157+0000 7fb95939c700 1 -- 172.21.15.84:0/1331245869 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb94000b740 con 0x7fb95415d810 2023-07-14T11:14:16.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:16.157+0000 7fb95939c700 1 --2- 172.21.15.84:0/1331245869 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb95415d810 0x7fb9540afec0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb94c00ce80 tx=0x7fb94c00ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:16.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:16.158+0000 7fb9517fa700 1 -- 172.21.15.84:0/1331245869 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94c00ad40 con 0x7fb95415d810 2023-07-14T11:14:16.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:16.158+0000 7fb9517fa700 1 -- 172.21.15.84:0/1331245869 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb94c015440 con 0x7fb95415d810 2023-07-14T11:14:16.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:16.158+0000 7fb9517fa700 1 -- 172.21.15.84:0/1331245869 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94c00aea0 con 0x7fb95415d810 2023-07-14T11:14:16.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:16.158+0000 7fb95adff700 1 -- 172.21.15.84:0/1331245869 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9540cbef0 con 0x7fb95415d810 2023-07-14T11:14:16.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:16.158+0000 7fb95adff700 1 -- 172.21.15.84:0/1331245869 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9540cc190 con 0x7fb95415d810 2023-07-14T11:14:16.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:16.159+0000 7fb95adff700 1 -- 172.21.15.84:0/1331245869 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb954074350 con 0x7fb95415d810 2023-07-14T11:14:16.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:16.160+0000 7fb9517fa700 1 -- 172.21.15.84:0/1331245869 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb94c00d430 con 0x7fb95415d810 2023-07-14T11:14:16.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:16.161+0000 7fb9517fa700 1 --2- 172.21.15.84:0/1331245869 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fb93806ace0 0x7fb93806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:16.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:16.161+0000 7fb9517fa700 1 -- 172.21.15.84:0/1331245869 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5768+0+0 (secure 0 0 0) 0x7fb94c0897f0 con 0x7fb95415d810 2023-07-14T11:14:16.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:16.161+0000 7fb958b9b700 1 --2- 172.21.15.84:0/1331245869 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fb93806ace0 0x7fb93806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:16.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:16.162+0000 7fb958b9b700 1 --2- 172.21.15.84:0/1331245869 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fb93806ace0 0x7fb93806d190 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb948007fd0 tx=0x7fb948007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:16.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:16.165+0000 7fb9517fa700 1 -- 172.21.15.84:0/1331245869 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fb94c0549b0 con 0x7fb95415d810 2023-07-14T11:14:16.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:16.358+0000 7fb95adff700 1 -- 172.21.15.84:0/1331245869 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb95415cca0 con 0x7fb95415d810 2023-07-14T11:14:16.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:16.933+0000 7fb9517fa700 1 -- 172.21.15.84:0/1331245869 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v28) v1 ==== 169+0+0 (secure 0 0 0) 0x7fb94c057fd0 con 0x7fb95415d810 2023-07-14T11:14:16.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:16.937+0000 7fb95adff700 1 -- 172.21.15.84:0/1331245869 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fb93806ace0 msgr2=0x7fb93806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:16.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:16.937+0000 7fb95adff700 1 --2- 172.21.15.84:0/1331245869 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fb93806ace0 0x7fb93806d190 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb948007fd0 tx=0x7fb948007de0 comp rx=0 tx=0).stop 2023-07-14T11:14:16.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:16.937+0000 7fb95adff700 1 -- 172.21.15.84:0/1331245869 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb95415d810 msgr2=0x7fb9540afec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:16.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:16.937+0000 7fb95adff700 1 --2- 172.21.15.84:0/1331245869 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb95415d810 0x7fb9540afec0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb94c00ce80 tx=0x7fb94c00ceb0 comp rx=0 tx=0).stop 2023-07-14T11:14:16.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:16.938+0000 7fb95adff700 1 -- 172.21.15.84:0/1331245869 shutdown_connections 2023-07-14T11:14:16.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:16.938+0000 7fb95adff700 1 --2- 172.21.15.84:0/1331245869 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fb93806ace0 0x7fb93806d190 secure :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb948007fd0 tx=0x7fb948007de0 comp rx=0 tx=0).stop 2023-07-14T11:14:16.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:16.938+0000 7fb95adff700 1 --2- 172.21.15.84:0/1331245869 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9540b2770 0x7fb9540b1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:16.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:16.938+0000 7fb95adff700 1 --2- 172.21.15.84:0/1331245869 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb95415d810 0x7fb9540afec0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:16.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:16.938+0000 7fb95adff700 1 --2- 172.21.15.84:0/1331245869 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb954156e40 0x7fb9540ccc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:16.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:16.938+0000 7fb95adff700 1 -- 172.21.15.84:0/1331245869 >> 172.21.15.84:0/1331245869 conn(0x7fb954065bd0 msgr2=0x7fb9540ac850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:16.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:16.938+0000 7fb95adff700 1 -- 172.21.15.84:0/1331245869 shutdown_connections 2023-07-14T11:14:16.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:16.938+0000 7fb95adff700 1 -- 172.21.15.84:0/1331245869 wait complete. 2023-07-14T11:14:16.943 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data' removed 2023-07-14T11:14:16.962 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-14T11:14:16.962 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-14T11:14:16.962 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-14T11:14:16.963 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T11:14:16.963 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-14T11:14:16.963 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-14T11:14:16.963 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-14T11:14:16.964 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T11:14:16.964 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-14T11:14:16.964 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-14T11:14:16.964 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-14T11:14:16.964 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T11:14:16.965 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-14T11:14:16.965 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-14T11:14:16.965 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-14T11:14:16.965 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T11:14:16.978 INFO:tasks.ceph.mds.a:Stopped 2023-07-14T11:14:16.978 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-14T11:14:16.979 INFO:tasks.ceph.mds.c:Stopped 2023-07-14T11:14:16.979 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-14T11:14:16.983 INFO:tasks.ceph.mds.b:Stopped 2023-07-14T11:14:16.983 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-14T11:14:17.022 INFO:tasks.ceph.mds.a:Started 2023-07-14T11:14:17.023 DEBUG:teuthology.parallel:result is None 2023-07-14T11:14:17.026 INFO:tasks.ceph.mds.c:Started 2023-07-14T11:14:17.026 DEBUG:teuthology.parallel:result is None 2023-07-14T11:14:17.028 INFO:tasks.ceph.mds.b:Started 2023-07-14T11:14:17.029 DEBUG:teuthology.parallel:result is None 2023-07-14T11:14:17.170 INFO:tasks.ceph.mds.a.smithi084.stdout:starting mds.a at 2023-07-14T11:14:17.170 INFO:tasks.ceph.mds.c.smithi084.stdout:starting mds.c at 2023-07-14T11:14:17.174 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2023-07-14T11:14:21.910 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-07-14T11:14:22.985 INFO:tasks.ceph.mds.d:Stopped 2023-07-14T11:14:22.986 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-14T11:14:22.991 INFO:tasks.ceph.mds.d:Started 2023-07-14T11:14:22.991 DEBUG:teuthology.parallel:result is None 2023-07-14T11:14:22.991 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-14T11:14:23.141 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2023-07-14T11:14:23.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:23.195+0000 7f19dcbff700 1 Processor -- start 2023-07-14T11:14:23.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:23.195+0000 7f19dcbff700 1 -- start start 2023-07-14T11:14:23.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:23.196+0000 7f19dcbff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f19d80c92d0 0x7f19d80ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:23.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:23.196+0000 7f19dcbff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f19d80b12f0 0x7f19d80c96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:23.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:23.196+0000 7f19dcbff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19d80adea0 0x7f19d806c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:23.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:23.196+0000 7f19dcbff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19d815da60 con 0x7f19d80c92d0 2023-07-14T11:14:23.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:23.196+0000 7f19dcbff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19d815ce70 con 0x7f19d80b12f0 2023-07-14T11:14:23.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:23.196+0000 7f19dcbff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19d80c9be0 con 0x7f19d80adea0 2023-07-14T11:14:23.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:23.196+0000 7f19d659c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f19d80c92d0 0x7f19d80ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:23.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:23.196+0000 7f19d659c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f19d80c92d0 0x7f19d80ad8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46086/0 (socket says 172.21.15.84:46086) 2023-07-14T11:14:23.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:23.196+0000 7f19d659c700 1 -- 172.21.15.84:0/510623443 learned_addr learned my addr 172.21.15.84:0/510623443 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:23.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:23.197+0000 7f19d5d9b700 1 --2- 172.21.15.84:0/510623443 >> v2:172.21.15.179:3300/0 conn(0x7f19d80b12f0 0x7f19d80c96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:23.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:23.197+0000 7f19d6d9d700 1 --2- 172.21.15.84:0/510623443 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19d80adea0 0x7f19d806c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:23.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:23.197+0000 7f19d659c700 1 -- 172.21.15.84:0/510623443 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19d80adea0 msgr2=0x7f19d806c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:23.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:23.197+0000 7f19d659c700 1 --2- 172.21.15.84:0/510623443 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19d80adea0 0x7f19d806c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:23.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:23.197+0000 7f19d659c700 1 -- 172.21.15.84:0/510623443 >> v2:172.21.15.179:3300/0 conn(0x7f19d80b12f0 msgr2=0x7f19d80c96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:23.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:23.197+0000 7f19d659c700 1 --2- 172.21.15.84:0/510623443 >> v2:172.21.15.179:3300/0 conn(0x7f19d80b12f0 0x7f19d80c96a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:23.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:23.197+0000 7f19d659c700 1 -- 172.21.15.84:0/510623443 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d815d0c0 con 0x7f19d80c92d0 2023-07-14T11:14:23.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:23.197+0000 7f19d6d9d700 1 --2- 172.21.15.84:0/510623443 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19d80adea0 0x7f19d806c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:14:23.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:23.197+0000 7f19d5d9b700 1 --2- 172.21.15.84:0/510623443 >> v2:172.21.15.179:3300/0 conn(0x7f19d80b12f0 0x7f19d80c96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:14:23.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:23.197+0000 7f19d659c700 1 --2- 172.21.15.84:0/510623443 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19d80c92d0 0x7f19d80ad8f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f19d806d890 tx=0x7f19c8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d676f8e6dfd9119 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:23.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:23.197+0000 7f19d559a700 1 -- 172.21.15.84:0/510623443 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c800f8a0 con 0x7f19d80c92d0 2023-07-14T11:14:23.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:23.197+0000 7f19d559a700 1 -- 172.21.15.84:0/510623443 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19c800fa00 con 0x7f19d80c92d0 2023-07-14T11:14:23.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:23.197+0000 7f19d559a700 1 -- 172.21.15.84:0/510623443 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c800fd90 con 0x7f19d80c92d0 2023-07-14T11:14:23.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:23.198+0000 7f19dcbff700 1 -- 172.21.15.84:0/510623443 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19d80c92d0 msgr2=0x7f19d80ad8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:23.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:23.198+0000 7f19dcbff700 1 --2- 172.21.15.84:0/510623443 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19d80c92d0 0x7f19d80ad8f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f19d806d890 tx=0x7f19c8009bd0 comp rx=0 tx=0).stop 2023-07-14T11:14:23.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:23.198+0000 7f19dcbff700 1 -- 172.21.15.84:0/510623443 shutdown_connections 2023-07-14T11:14:23.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:23.198+0000 7f19dcbff700 1 --2- 172.21.15.84:0/510623443 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19d80adea0 0x7f19d806c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:23.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:23.198+0000 7f19dcbff700 1 --2- 172.21.15.84:0/510623443 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19d80c92d0 0x7f19d80ad8f0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:23.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:23.198+0000 7f19dcbff700 1 --2- 172.21.15.84:0/510623443 >> v2:172.21.15.179:3300/0 conn(0x7f19d80b12f0 0x7f19d80c96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:23.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:23.198+0000 7f19dcbff700 1 -- 172.21.15.84:0/510623443 >> 172.21.15.84:0/510623443 conn(0x7f19d80b05d0 msgr2=0x7f19d80b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:23.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:23.198+0000 7f19dcbff700 1 -- 172.21.15.84:0/510623443 shutdown_connections 2023-07-14T11:14:23.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:23.198+0000 7f19dcbff700 1 -- 172.21.15.84:0/510623443 wait complete. 2023-07-14T11:14:23.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:23.200+0000 7f19dcbff700 1 Processor -- start 2023-07-14T11:14:23.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:23.200+0000 7f19dcbff700 1 -- start start 2023-07-14T11:14:23.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:23.201+0000 7f19dcbff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19d80adea0 0x7f19d80c47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:23.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:23.201+0000 7f19dcbff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19d80b12f0 0x7f19d80b18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:23.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:23.201+0000 7f19dcbff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19d80c92d0 0x7f19d80b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:23.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:23.201+0000 7f19dcbff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d80b4360 con 0x7f19d80adea0 2023-07-14T11:14:23.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:23.201+0000 7f19dcbff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d80b4640 con 0x7f19d80c92d0 2023-07-14T11:14:23.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:23.201+0000 7f19dcbff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19d8152190 con 0x7f19d80b12f0 2023-07-14T11:14:23.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:23.201+0000 7f19d659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19d80adea0 0x7f19d80c47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:23.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:23.201+0000 7f19d659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19d80adea0 0x7f19d80c47c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46092/0 (socket says 172.21.15.84:46092) 2023-07-14T11:14:23.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:23.201+0000 7f19d659c700 1 -- 172.21.15.84:0/1266752664 learned_addr learned my addr 172.21.15.84:0/1266752664 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:23.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:23.201+0000 7f19d5d9b700 1 --2- 172.21.15.84:0/1266752664 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19d80b12f0 0x7f19d80b18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:23.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:23.201+0000 7f19d6d9d700 1 --2- 172.21.15.84:0/1266752664 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19d80c92d0 0x7f19d80b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:23.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:23.201+0000 7f19d659c700 1 -- 172.21.15.84:0/1266752664 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19d80b12f0 msgr2=0x7f19d80b18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:23.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:23.201+0000 7f19d659c700 1 --2- 172.21.15.84:0/1266752664 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19d80b12f0 0x7f19d80b18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:23.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:23.202+0000 7f19d659c700 1 -- 172.21.15.84:0/1266752664 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19d80c92d0 msgr2=0x7f19d80b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:23.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:23.202+0000 7f19d659c700 1 --2- 172.21.15.84:0/1266752664 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19d80c92d0 0x7f19d80b1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:23.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:23.202+0000 7f19d659c700 1 -- 172.21.15.84:0/1266752664 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c8009550 con 0x7f19d80adea0 2023-07-14T11:14:23.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:23.202+0000 7f19d6d9d700 1 --2- 172.21.15.84:0/1266752664 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19d80c92d0 0x7f19d80b1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:14:23.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:23.202+0000 7f19d659c700 1 --2- 172.21.15.84:0/1266752664 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19d80adea0 0x7f19d80c47c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f19d806d8c0 tx=0x7f19c8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:23.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:23.202+0000 7f19c6ffd700 1 -- 172.21.15.84:0/1266752664 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c8010da0 con 0x7f19d80adea0 2023-07-14T11:14:23.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:23.202+0000 7f19c6ffd700 1 -- 172.21.15.84:0/1266752664 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19c8004050 con 0x7f19d80adea0 2023-07-14T11:14:23.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:23.202+0000 7f19c6ffd700 1 -- 172.21.15.84:0/1266752664 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c80043e0 con 0x7f19d80adea0 2023-07-14T11:14:23.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:23.202+0000 7f19dcbff700 1 -- 172.21.15.84:0/1266752664 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19d8152470 con 0x7f19d80adea0 2023-07-14T11:14:23.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:23.202+0000 7f19dcbff700 1 -- 172.21.15.84:0/1266752664 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19d80c4d00 con 0x7f19d80adea0 2023-07-14T11:14:23.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:23.203+0000 7f19dcbff700 1 -- 172.21.15.84:0/1266752664 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19d8151fd0 con 0x7f19d80adea0 2023-07-14T11:14:23.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:23.204+0000 7f19c6ffd700 1 -- 172.21.15.84:0/1266752664 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f19c80036a0 con 0x7f19d80adea0 2023-07-14T11:14:23.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:23.205+0000 7f19c6ffd700 1 --2- 172.21.15.84:0/1266752664 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f19b806ace0 0x7f19b806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:23.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:23.205+0000 7f19c6ffd700 1 -- 172.21.15.84:0/1266752664 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f19c808a2e0 con 0x7f19d80adea0 2023-07-14T11:14:23.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:23.205+0000 7f19d5d9b700 1 --2- 172.21.15.84:0/1266752664 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f19b806ace0 0x7f19b806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:23.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:23.206+0000 7f19d5d9b700 1 --2- 172.21.15.84:0/1266752664 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f19b806ace0 0x7f19b806d190 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f19d8153ae0 tx=0x7f19cc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:23.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:23.210+0000 7f19c6ffd700 1 -- 172.21.15.84:0/1266752664 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f19c80556a0 con 0x7f19d80adea0 2023-07-14T11:14:23.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:23.419+0000 7f19dcbff700 1 -- 172.21.15.84:0/1266752664 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f19d8074350 con 0x7f19d80adea0 2023-07-14T11:14:24.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:24.959+0000 7f19c6ffd700 1 -- 172.21.15.84:0/1266752664 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v33) v1 ==== 97+0+0 (secure 0 0 0) 0x7f19c8058cc0 con 0x7f19d80adea0 2023-07-14T11:14:24.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:24.962+0000 7f19dcbff700 1 -- 172.21.15.84:0/1266752664 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f19b806ace0 msgr2=0x7f19b806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:24.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:24.962+0000 7f19dcbff700 1 --2- 172.21.15.84:0/1266752664 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f19b806ace0 0x7f19b806d190 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f19d8153ae0 tx=0x7f19cc008040 comp rx=0 tx=0).stop 2023-07-14T11:14:24.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:24.962+0000 7f19dcbff700 1 -- 172.21.15.84:0/1266752664 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19d80adea0 msgr2=0x7f19d80c47c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:24.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:24.962+0000 7f19dcbff700 1 --2- 172.21.15.84:0/1266752664 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19d80adea0 0x7f19d80c47c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f19d806d8c0 tx=0x7f19c8004750 comp rx=0 tx=0).stop 2023-07-14T11:14:24.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:24.962+0000 7f19dcbff700 1 -- 172.21.15.84:0/1266752664 shutdown_connections 2023-07-14T11:14:24.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:24.962+0000 7f19dcbff700 1 --2- 172.21.15.84:0/1266752664 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19d80c92d0 0x7f19d80b1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:24.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:24.962+0000 7f19dcbff700 1 --2- 172.21.15.84:0/1266752664 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19d80adea0 0x7f19d80c47c0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:24.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:24.962+0000 7f19dcbff700 1 --2- 172.21.15.84:0/1266752664 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f19b806ace0 0x7f19b806d190 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:24.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:24.962+0000 7f19dcbff700 1 --2- 172.21.15.84:0/1266752664 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19d80b12f0 0x7f19d80b18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:24.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:24.962+0000 7f19dcbff700 1 -- 172.21.15.84:0/1266752664 >> 172.21.15.84:0/1266752664 conn(0x7f19d80b05d0 msgr2=0x7f19d80ad240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:24.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:24.962+0000 7f19dcbff700 1 -- 172.21.15.84:0/1266752664 shutdown_connections 2023-07-14T11:14:24.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:24.962+0000 7f19dcbff700 1 -- 172.21.15.84:0/1266752664 wait complete. 2023-07-14T11:14:24.967 INFO:teuthology.orchestra.run.smithi084.stderr: removed all blocklist entries 2023-07-14T11:14:24.986 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-14T11:14:25.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.184+0000 7f4dcabff700 1 Processor -- start 2023-07-14T11:14:25.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.184+0000 7f4dcabff700 1 -- start start 2023-07-14T11:14:25.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.185+0000 7f4dcabff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4dc40d1220 0x7f4dc40b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:25.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.185+0000 7f4dcabff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4dc40b1e00 0x7f4dc40afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:25.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.185+0000 7f4dcabff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dc40d2ce0 con 0x7f4dc415c950 2023-07-14T11:14:25.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.185+0000 7f4dcabff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dc40b3350 con 0x7f4dc40b1e00 2023-07-14T11:14:25.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.185+0000 7f4dcabff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dc40b3630 con 0x7f4dc40d1220 2023-07-14T11:14:25.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.186+0000 7f4dc919c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4dc40b1e00 0x7f4dc40afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:25.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.186+0000 7f4dc899b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f4dc415c950 0x7f4dc40d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:44612/0 (socket says 172.21.15.84:44612) 2023-07-14T11:14:25.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.186+0000 7f4dc899b700 1 -- 172.21.15.84:0/3288030910 learned_addr learned my addr 172.21.15.84:0/3288030910 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:14:25.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.186+0000 7f4dc3fff700 1 --2- 172.21.15.84:0/3288030910 >> v2:172.21.15.179:3300/0 conn(0x7f4dc40d1220 0x7f4dc40b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:25.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.186+0000 7f4dc919c700 1 -- 172.21.15.84:0/3288030910 >> v2:172.21.15.179:3300/0 conn(0x7f4dc40d1220 msgr2=0x7f4dc40b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:25.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.186+0000 7f4dc919c700 1 --2- 172.21.15.84:0/3288030910 >> v2:172.21.15.179:3300/0 conn(0x7f4dc40d1220 0x7f4dc40b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:25.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.186+0000 7f4dc919c700 1 -- 172.21.15.84:0/3288030910 >> v1:172.21.15.84:6789/0 conn(0x7f4dc415c950 legacy=0x7f4dc40d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:25.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.186+0000 7f4dc919c700 1 -- 172.21.15.84:0/3288030910 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc40b3910 con 0x7f4dc40b1e00 2023-07-14T11:14:25.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.186+0000 7f4dc3fff700 1 --2- 172.21.15.84:0/3288030910 >> v2:172.21.15.179:3300/0 conn(0x7f4dc40d1220 0x7f4dc40b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:14:25.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.186+0000 7f4dc37fe700 1 -- 172.21.15.84:0/3288030910 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 899395991 0 0) 0x7f4dc40d2ce0 con 0x7f4dc415c950 2023-07-14T11:14:25.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.186+0000 7f4dc919c700 1 --2- 172.21.15.84:0/3288030910 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4dc40b1e00 0x7f4dc40afac0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4072140 tx=0x7f4dbc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b202d458677d6ede server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:25.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.187+0000 7f4dc37fe700 1 -- 172.21.15.84:0/3288030910 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc00e070 con 0x7f4dc40b1e00 2023-07-14T11:14:25.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.187+0000 7f4dc37fe700 1 -- 172.21.15.84:0/3288030910 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dbc00bbd0 con 0x7f4dc40b1e00 2023-07-14T11:14:25.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.187+0000 7f4dc37fe700 1 -- 172.21.15.84:0/3288030910 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc012430 con 0x7f4dc40b1e00 2023-07-14T11:14:25.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.187+0000 7f4dcabff700 1 -- 172.21.15.84:0/3288030910 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4dc40b1e00 msgr2=0x7f4dc40afac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:25.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.187+0000 7f4dcabff700 1 --2- 172.21.15.84:0/3288030910 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4dc40b1e00 0x7f4dc40afac0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4072140 tx=0x7f4dbc00b330 comp rx=0 tx=0).stop 2023-07-14T11:14:25.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.187+0000 7f4dcabff700 1 -- 172.21.15.84:0/3288030910 shutdown_connections 2023-07-14T11:14:25.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.187+0000 7f4dcabff700 1 --2- 172.21.15.84:0/3288030910 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4dc40b1e00 0x7f4dc40afac0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:25.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.187+0000 7f4dcabff700 1 --2- 172.21.15.84:0/3288030910 >> v2:172.21.15.179:3300/0 conn(0x7f4dc40d1220 0x7f4dc40b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:25.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.187+0000 7f4dcabff700 1 -- 172.21.15.84:0/3288030910 >> 172.21.15.84:0/3288030910 conn(0x7f4dc409c1d0 msgr2=0x7f4dc40d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:25.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.187+0000 7f4dcabff700 1 -- 172.21.15.84:0/3288030910 shutdown_connections 2023-07-14T11:14:25.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.187+0000 7f4dcabff700 1 -- 172.21.15.84:0/3288030910 wait complete. 2023-07-14T11:14:25.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.189+0000 7f4dcabff700 1 Processor -- start 2023-07-14T11:14:25.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.189+0000 7f4dcabff700 1 -- start start 2023-07-14T11:14:25.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.190+0000 7f4dcabff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4dc40b1e00 0x7f4dc41e82b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:25.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.190+0000 7f4dcabff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4dc40d1220 0x7f4dc40cf500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:25.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.190+0000 7f4dcabff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4dc415c950 0x7f4dc40cd550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:25.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.190+0000 7f4dcabff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc40c78f0 con 0x7f4dc415c950 2023-07-14T11:14:25.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.190+0000 7f4dcabff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc40c72c0 con 0x7f4dc40d1220 2023-07-14T11:14:25.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.190+0000 7f4dcabff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc41e87f0 con 0x7f4dc40b1e00 2023-07-14T11:14:25.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.190+0000 7f4dc919c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4dc415c950 0x7f4dc40cd550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:25.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.190+0000 7f4dc919c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4dc415c950 0x7f4dc40cd550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46100/0 (socket says 172.21.15.84:46100) 2023-07-14T11:14:25.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.190+0000 7f4dc919c700 1 -- 172.21.15.84:0/536693496 learned_addr learned my addr 172.21.15.84:0/536693496 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:25.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.190+0000 7f4dc899b700 1 --2- 172.21.15.84:0/536693496 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4dc40b1e00 0x7f4dc41e82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:25.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.191+0000 7f4dc3fff700 1 --2- 172.21.15.84:0/536693496 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4dc40d1220 0x7f4dc40cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:25.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.191+0000 7f4dc919c700 1 -- 172.21.15.84:0/536693496 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4dc40b1e00 msgr2=0x7f4dc41e82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:25.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.191+0000 7f4dc919c700 1 --2- 172.21.15.84:0/536693496 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4dc40b1e00 0x7f4dc41e82b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:25.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.191+0000 7f4dc919c700 1 -- 172.21.15.84:0/536693496 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4dc40d1220 msgr2=0x7f4dc40cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:25.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.191+0000 7f4dc919c700 1 --2- 172.21.15.84:0/536693496 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4dc40d1220 0x7f4dc40cf500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:25.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.191+0000 7f4dc919c700 1 -- 172.21.15.84:0/536693496 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dbc009a70 con 0x7f4dc415c950 2023-07-14T11:14:25.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.191+0000 7f4dc899b700 1 --2- 172.21.15.84:0/536693496 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4dc40b1e00 0x7f4dc41e82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:14:25.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.191+0000 7f4dc919c700 1 --2- 172.21.15.84:0/536693496 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4dc415c950 0x7f4dc40cd550 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f4dc40673b0 tx=0x7f4dbc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:25.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.191+0000 7f4dc17fa700 1 -- 172.21.15.84:0/536693496 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc012430 con 0x7f4dc415c950 2023-07-14T11:14:25.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.191+0000 7f4dc17fa700 1 -- 172.21.15.84:0/536693496 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dbc020070 con 0x7f4dc415c950 2023-07-14T11:14:25.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.191+0000 7f4dcabff700 1 -- 172.21.15.84:0/536693496 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dc40cff70 con 0x7f4dc415c950 2023-07-14T11:14:25.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.191+0000 7f4dc17fa700 1 -- 172.21.15.84:0/536693496 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc004280 con 0x7f4dc415c950 2023-07-14T11:14:25.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.191+0000 7f4dcabff700 1 -- 172.21.15.84:0/536693496 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dc40c7510 con 0x7f4dc415c950 2023-07-14T11:14:25.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.192+0000 7f4dcabff700 1 -- 172.21.15.84:0/536693496 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dc40c7a30 con 0x7f4dc415c950 2023-07-14T11:14:25.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.193+0000 7f4dc17fa700 1 -- 172.21.15.84:0/536693496 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4dbc0043e0 con 0x7f4dc415c950 2023-07-14T11:14:25.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.194+0000 7f4dc17fa700 1 --2- 172.21.15.84:0/536693496 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f4da806ace0 0x7f4da806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:25.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.195+0000 7f4dc17fa700 1 -- 172.21.15.84:0/536693496 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f4dbc022070 con 0x7f4dc415c950 2023-07-14T11:14:25.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.195+0000 7f4dc899b700 1 --2- 172.21.15.84:0/536693496 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f4da806ace0 0x7f4da806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:25.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.195+0000 7f4dc899b700 1 --2- 172.21.15.84:0/536693496 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f4da806ace0 0x7f4da806d190 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4db80017b0 tx=0x7f4db8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:25.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.198+0000 7f4dc17fa700 1 -- 172.21.15.84:0/536693496 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f4dc40c7a30 con 0x7f4dc415c950 2023-07-14T11:14:25.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.471+0000 7f4dcabff700 1 -- 172.21.15.84:0/536693496 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f4dc40c7a30 con 0x7f4dc415c950 2023-07-14T11:14:25.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.472+0000 7f4dc17fa700 1 -- 172.21.15.84:0/536693496 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v8) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f4dc40c7a30 con 0x7f4dc415c950 2023-07-14T11:14:25.475 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:14:25.475 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-07-14T11:14:25.475 INFO:teuthology.orchestra.run.smithi084.stdout: "auth_dump": [ 2023-07-14T11:14:25.476 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:14:25.476 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.a", 2023-07-14T11:14:25.476 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCJLbFkprwsJhAAIZa03ewirqLtc0mn7ki6Vw==", 2023-07-14T11:14:25.476 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:14:25.476 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-07-14T11:14:25.476 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-07-14T11:14:25.476 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-07-14T11:14:25.477 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:14:25.477 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:14:25.477 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:14:25.477 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:14:25.477 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.b", 2023-07-14T11:14:25.477 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCKLbFkfYOoAhAAQcpDkBRXNSDyfnZp1A/BJw==", 2023-07-14T11:14:25.477 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:14:25.478 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-07-14T11:14:25.478 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-07-14T11:14:25.478 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-07-14T11:14:25.478 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:14:25.478 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:14:25.478 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:14:25.478 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:14:25.478 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.c", 2023-07-14T11:14:25.479 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCJLbFk9MZ4MhAAY2CpAoK7Bx7NyoccpK7MLA==", 2023-07-14T11:14:25.479 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:14:25.479 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-07-14T11:14:25.479 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-07-14T11:14:25.479 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-07-14T11:14:25.479 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:14:25.479 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:14:25.479 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:14:25.480 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:14:25.480 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.d", 2023-07-14T11:14:25.480 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCKLbFkfxxFDhAAFPvGUrg0RW1nYTAdACvEAA==", 2023-07-14T11:14:25.480 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:14:25.480 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-07-14T11:14:25.480 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-07-14T11:14:25.480 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-07-14T11:14:25.481 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:14:25.481 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:14:25.481 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:14:25.481 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:14:25.481 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.0", 2023-07-14T11:14:25.481 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCOLbFkd18mDBAA2tneRYzoJkGwIZNDW6+Z7w==", 2023-07-14T11:14:25.481 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:14:25.481 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-07-14T11:14:25.482 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-07-14T11:14:25.482 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:14:25.482 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:14:25.482 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:14:25.482 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:14:25.482 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.1", 2023-07-14T11:14:25.482 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCRLbFkwBlAEBAAoEG62Dam3KHra4oNXBGyfw==", 2023-07-14T11:14:25.482 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:14:25.483 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-07-14T11:14:25.483 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-07-14T11:14:25.483 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:14:25.483 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:14:25.483 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:14:25.483 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:14:25.483 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.2", 2023-07-14T11:14:25.483 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCULbFkCln2ExAAKM+sAwMtcH6yEbNUqHbN4Q==", 2023-07-14T11:14:25.484 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:14:25.484 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-07-14T11:14:25.484 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-07-14T11:14:25.484 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:14:25.484 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:14:25.484 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:14:25.484 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:14:25.485 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.3", 2023-07-14T11:14:25.485 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCXLbFk0ZGgFxAAgOEUoX5jqzic6bOxtG7qSw==", 2023-07-14T11:14:25.485 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:14:25.485 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-07-14T11:14:25.485 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-07-14T11:14:25.485 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:14:25.485 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:14:25.485 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:14:25.486 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:14:25.486 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.4", 2023-07-14T11:14:25.486 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCdLbFknOESLBAA9usIfRfkbbLiMOCvUR+pXQ==", 2023-07-14T11:14:25.486 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:14:25.486 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-07-14T11:14:25.486 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-07-14T11:14:25.486 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:14:25.486 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:14:25.487 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:14:25.487 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:14:25.487 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.5", 2023-07-14T11:14:25.487 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCgLbFk+Rk/LxAAGqk3ueTaGaSINPuxoW53Gw==", 2023-07-14T11:14:25.487 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:14:25.487 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-07-14T11:14:25.487 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-07-14T11:14:25.488 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:14:25.488 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:14:25.488 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:14:25.488 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:14:25.488 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.6", 2023-07-14T11:14:25.488 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCjLbFk1/QfMxAABnWxus7LXfn7R0iwMVTWiA==", 2023-07-14T11:14:25.488 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:14:25.488 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-07-14T11:14:25.489 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-07-14T11:14:25.489 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:14:25.489 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:14:25.489 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:14:25.489 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:14:25.489 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.7", 2023-07-14T11:14:25.489 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCmLbFkNnhmNhAAz85GY1Sb1NuKINJCyWpPGQ==", 2023-07-14T11:14:25.489 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:14:25.490 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-07-14T11:14:25.490 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-07-14T11:14:25.490 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:14:25.490 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:14:25.490 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:14:25.490 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:14:25.490 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.0", 2023-07-14T11:14:25.490 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCKLbFkKSl5GBAAwPK4Zs6+gv/6YKHh4JI3WA==", 2023-07-14T11:14:25.491 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:14:25.491 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-07-14T11:14:25.491 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-07-14T11:14:25.491 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-07-14T11:14:25.491 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-07-14T11:14:25.491 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:14:25.491 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:14:25.492 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:14:25.492 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.1", 2023-07-14T11:14:25.492 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCKLbFkieNzJxAARri6UfCWdcXA3NpeFfvILw==", 2023-07-14T11:14:25.492 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:14:25.492 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-07-14T11:14:25.492 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-07-14T11:14:25.492 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-07-14T11:14:25.492 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-07-14T11:14:25.493 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:14:25.493 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:14:25.493 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:14:25.493 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.2", 2023-07-14T11:14:25.493 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCKLbFkLhv6HxAACUfTJK618qRsXETPJagZXQ==", 2023-07-14T11:14:25.493 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:14:25.493 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-07-14T11:14:25.493 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-07-14T11:14:25.494 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-07-14T11:14:25.494 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-07-14T11:14:25.494 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:14:25.494 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:14:25.494 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:14:25.494 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.3", 2023-07-14T11:14:25.494 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCKLbFka9HxLhAA4OsQY/t7A2FIYLEyYgJ19Q==", 2023-07-14T11:14:25.495 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:14:25.495 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-07-14T11:14:25.495 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-07-14T11:14:25.495 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-07-14T11:14:25.495 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-07-14T11:14:25.495 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:14:25.495 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:14:25.495 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:14:25.496 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.admin", 2023-07-14T11:14:25.496 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCILbFkmVPbKRAAffsYBVR51b7R8sXpbdF0MQ==", 2023-07-14T11:14:25.496 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:14:25.496 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow *", 2023-07-14T11:14:25.496 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-07-14T11:14:25.496 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-07-14T11:14:25.496 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:14:25.497 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:14:25.497 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:14:25.497 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:14:25.497 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.bootstrap-mds", 2023-07-14T11:14:25.497 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCuLbFkFjVSORAAs7MsPd3/wUWPz7a5Za6Elg==", 2023-07-14T11:14:25.497 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:14:25.497 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile bootstrap-mds" 2023-07-14T11:14:25.497 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:14:25.498 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:14:25.498 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:14:25.498 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.bootstrap-mgr", 2023-07-14T11:14:25.498 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCuLbFk8j5SORAAD4QdEMV2tYIV38UPWKceQQ==", 2023-07-14T11:14:25.498 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:14:25.498 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile bootstrap-mgr" 2023-07-14T11:14:25.498 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:14:25.498 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:14:25.499 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:14:25.499 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.bootstrap-osd", 2023-07-14T11:14:25.499 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCuLbFkP0lSORAA4Quv6+xVyNCwaOKo78i5Ng==", 2023-07-14T11:14:25.499 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:14:25.499 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile bootstrap-osd" 2023-07-14T11:14:25.499 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:14:25.499 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:14:25.499 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:14:25.500 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.bootstrap-rbd", 2023-07-14T11:14:25.500 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCuLbFky1FSORAANJfvcLtthMI+fEfbjo0shg==", 2023-07-14T11:14:25.500 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:14:25.500 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile bootstrap-rbd" 2023-07-14T11:14:25.500 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:14:25.500 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:14:25.500 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:14:25.501 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-07-14T11:14:25.501 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCuLbFkW1pSORAANC2RYJ7Y3K8Si37ZYRGDJA==", 2023-07-14T11:14:25.501 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:14:25.501 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-07-14T11:14:25.501 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:14:25.501 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:14:25.501 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:14:25.502 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.bootstrap-rgw", 2023-07-14T11:14:25.502 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCuLbFkx2RSORAAJA3MBDAySExLOdWzB2Vdbw==", 2023-07-14T11:14:25.502 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:14:25.502 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile bootstrap-rgw" 2023-07-14T11:14:25.502 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:14:25.502 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:14:25.502 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:14:25.502 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mgr.x", 2023-07-14T11:14:25.503 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCJLbFk28xTHhAAAlmm5bW9VTtgE+OujO+G2w==", 2023-07-14T11:14:25.503 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:14:25.503 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow *", 2023-07-14T11:14:25.503 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile mgr", 2023-07-14T11:14:25.503 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:14:25.503 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:14:25.503 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:14:25.503 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:14:25.504 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mgr.y", 2023-07-14T11:14:25.504 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCJLbFk5dM1FhAAJWbB+GogsfcSkaBdHrFg4A==", 2023-07-14T11:14:25.504 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:14:25.504 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow *", 2023-07-14T11:14:25.504 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile mgr", 2023-07-14T11:14:25.504 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:14:25.504 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:14:25.505 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:14:25.505 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2023-07-14T11:14:25.505 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-07-14T11:14:25.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.474+0000 7f4dcabff700 1 -- 172.21.15.84:0/536693496 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f4da806ace0 msgr2=0x7f4da806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:25.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.474+0000 7f4dcabff700 1 --2- 172.21.15.84:0/536693496 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f4da806ace0 0x7f4da806d190 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4db80017b0 tx=0x7f4db8009040 comp rx=0 tx=0).stop 2023-07-14T11:14:25.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.474+0000 7f4dcabff700 1 -- 172.21.15.84:0/536693496 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4dc415c950 msgr2=0x7f4dc40cd550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:25.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.474+0000 7f4dcabff700 1 --2- 172.21.15.84:0/536693496 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4dc415c950 0x7f4dc40cd550 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f4dc40673b0 tx=0x7f4dbc004ad0 comp rx=0 tx=0).stop 2023-07-14T11:14:25.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.474+0000 7f4dcabff700 1 -- 172.21.15.84:0/536693496 shutdown_connections 2023-07-14T11:14:25.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.474+0000 7f4dcabff700 1 --2- 172.21.15.84:0/536693496 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f4da806ace0 0x7f4da806d190 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:25.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.474+0000 7f4dcabff700 1 --2- 172.21.15.84:0/536693496 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4dc40b1e00 0x7f4dc41e82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:25.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.474+0000 7f4dcabff700 1 --2- 172.21.15.84:0/536693496 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4dc415c950 0x7f4dc40cd550 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:25.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.474+0000 7f4dcabff700 1 --2- 172.21.15.84:0/536693496 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4dc40d1220 0x7f4dc40cf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:25.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.474+0000 7f4dcabff700 1 -- 172.21.15.84:0/536693496 >> 172.21.15.84:0/536693496 conn(0x7f4dc409c1d0 msgr2=0x7f4dc40d0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:25.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.474+0000 7f4dcabff700 1 -- 172.21.15.84:0/536693496 shutdown_connections 2023-07-14T11:14:25.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.474+0000 7f4dcabff700 1 -- 172.21.15.84:0/536693496 wait complete. 2023-07-14T11:14:25.508 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-07-14T11:14:25.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.700+0000 7fa1785ff700 1 Processor -- start 2023-07-14T11:14:25.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.701+0000 7fa1785ff700 1 -- start start 2023-07-14T11:14:25.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.702+0000 7fa1785ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa1700b4860 0x7fa1700b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:25.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.702+0000 7fa1785ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa1700d12c0 0x7fa1700d16e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:25.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.702+0000 7fa1785ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1700d02a0 con 0x7fa1700b8660 2023-07-14T11:14:25.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.702+0000 7fa1785ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1700b5240 con 0x7fa1700d12c0 2023-07-14T11:14:25.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.702+0000 7fa1785ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1700cfce0 con 0x7fa1700b4860 2023-07-14T11:14:25.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.702+0000 7fa176b9c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa1700d12c0 0x7fa1700d16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:25.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.702+0000 7fa176b9c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa1700d12c0 0x7fa1700d16e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46106/0 (socket says 172.21.15.84:46106) 2023-07-14T11:14:25.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.702+0000 7fa176b9c700 1 -- 172.21.15.84:0/367079254 learned_addr learned my addr 172.21.15.84:0/367079254 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:25.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.702+0000 7fa175b9a700 1 --2- 172.21.15.84:0/367079254 >> v2:172.21.15.179:3300/0 conn(0x7fa1700b4860 0x7fa1700b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:25.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.703+0000 7fa176b9c700 1 -- 172.21.15.84:0/367079254 >> v2:172.21.15.179:3300/0 conn(0x7fa1700b4860 msgr2=0x7fa1700b4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:25.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.703+0000 7fa176b9c700 1 --2- 172.21.15.84:0/367079254 >> v2:172.21.15.179:3300/0 conn(0x7fa1700b4860 0x7fa1700b4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:25.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.703+0000 7fa176b9c700 1 -- 172.21.15.84:0/367079254 >> v1:172.21.15.179:6789/0 conn(0x7fa1700b8660 legacy=0x7fa1700cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:25.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.703+0000 7fa176b9c700 1 -- 172.21.15.84:0/367079254 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1700cffc0 con 0x7fa1700d12c0 2023-07-14T11:14:25.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.703+0000 7fa176b9c700 1 --2- 172.21.15.84:0/367079254 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa1700d12c0 0x7fa1700d16e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa170160130 tx=0x7fa16800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad8ae0b0bb2203b8 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:25.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.703+0000 7fa175399700 1 -- 172.21.15.84:0/367079254 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa16800e070 con 0x7fa1700d12c0 2023-07-14T11:14:25.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.703+0000 7fa175399700 1 -- 172.21.15.84:0/367079254 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa16800b910 con 0x7fa1700d12c0 2023-07-14T11:14:25.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.703+0000 7fa175399700 1 -- 172.21.15.84:0/367079254 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa16800bcc0 con 0x7fa1700d12c0 2023-07-14T11:14:25.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.704+0000 7fa1785ff700 1 -- 172.21.15.84:0/367079254 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa1700d12c0 msgr2=0x7fa1700d16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:25.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.704+0000 7fa1785ff700 1 --2- 172.21.15.84:0/367079254 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa1700d12c0 0x7fa1700d16e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa170160130 tx=0x7fa16800b330 comp rx=0 tx=0).stop 2023-07-14T11:14:25.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.704+0000 7fa1785ff700 1 -- 172.21.15.84:0/367079254 shutdown_connections 2023-07-14T11:14:25.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.704+0000 7fa1785ff700 1 --2- 172.21.15.84:0/367079254 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa1700d12c0 0x7fa1700d16e0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:25.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.704+0000 7fa1785ff700 1 --2- 172.21.15.84:0/367079254 >> v2:172.21.15.179:3300/0 conn(0x7fa1700b4860 0x7fa1700b4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:25.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.704+0000 7fa1785ff700 1 -- 172.21.15.84:0/367079254 >> 172.21.15.84:0/367079254 conn(0x7fa170066860 msgr2=0x7fa17006a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:25.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.704+0000 7fa1785ff700 1 -- 172.21.15.84:0/367079254 shutdown_connections 2023-07-14T11:14:25.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.704+0000 7fa1785ff700 1 -- 172.21.15.84:0/367079254 wait complete. 2023-07-14T11:14:25.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.705+0000 7fa1785ff700 1 Processor -- start 2023-07-14T11:14:25.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.706+0000 7fa1785ff700 1 -- start start 2023-07-14T11:14:25.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.706+0000 7fa1785ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa1700b4860 0x7fa1700b3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:25.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.706+0000 7fa1785ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa1700b8660 0x7fa1701e5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:25.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.707+0000 7fa1785ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1700d12c0 0x7fa17014b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:25.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.707+0000 7fa1785ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1701f5aa0 con 0x7fa1700b8660 2023-07-14T11:14:25.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.707+0000 7fa1785ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1701f5d80 con 0x7fa1700b4860 2023-07-14T11:14:25.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.707+0000 7fa1785ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1701f6060 con 0x7fa1700d12c0 2023-07-14T11:14:25.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.707+0000 7fa175b9a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa1700b8660 0x7fa1701e5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:25.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.707+0000 7fa175b9a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa1700b8660 0x7fa1701e5120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46118/0 (socket says 172.21.15.84:46118) 2023-07-14T11:14:25.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.707+0000 7fa175b9a700 1 -- 172.21.15.84:0/3127059411 learned_addr learned my addr 172.21.15.84:0/3127059411 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:25.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.707+0000 7fa176b9c700 1 --2- 172.21.15.84:0/3127059411 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1700d12c0 0x7fa17014b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:25.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.707+0000 7fa17639b700 1 --2- 172.21.15.84:0/3127059411 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa1700b4860 0x7fa1700b3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:25.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.707+0000 7fa175b9a700 1 -- 172.21.15.84:0/3127059411 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1700d12c0 msgr2=0x7fa17014b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:25.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.707+0000 7fa175b9a700 1 --2- 172.21.15.84:0/3127059411 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1700d12c0 0x7fa17014b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:25.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.707+0000 7fa175b9a700 1 -- 172.21.15.84:0/3127059411 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa1700b4860 msgr2=0x7fa1700b3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:25.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.707+0000 7fa175b9a700 1 --2- 172.21.15.84:0/3127059411 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa1700b4860 0x7fa1700b3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:25.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.707+0000 7fa175b9a700 1 -- 172.21.15.84:0/3127059411 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa168009b30 con 0x7fa1700b8660 2023-07-14T11:14:25.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.707+0000 7fa176b9c700 1 --2- 172.21.15.84:0/3127059411 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1700d12c0 0x7fa17014b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:14:25.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.707+0000 7fa17639b700 1 --2- 172.21.15.84:0/3127059411 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa1700b4860 0x7fa1700b3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:14:25.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.707+0000 7fa175b9a700 1 --2- 172.21.15.84:0/3127059411 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa1700b8660 0x7fa1701e5120 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fa16000e9b0 tx=0x7fa16000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:25.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.708+0000 7fa166ffd700 1 -- 172.21.15.84:0/3127059411 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa160009710 con 0x7fa1700b8660 2023-07-14T11:14:25.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.708+0000 7fa1785ff700 1 -- 172.21.15.84:0/3127059411 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1701f6340 con 0x7fa1700b8660 2023-07-14T11:14:25.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.708+0000 7fa166ffd700 1 -- 172.21.15.84:0/3127059411 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa16000c850 con 0x7fa1700b8660 2023-07-14T11:14:25.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.708+0000 7fa166ffd700 1 -- 172.21.15.84:0/3127059411 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa16000cbc0 con 0x7fa1700b8660 2023-07-14T11:14:25.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.708+0000 7fa1785ff700 1 -- 172.21.15.84:0/3127059411 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1700b43d0 con 0x7fa1700b8660 2023-07-14T11:14:25.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.709+0000 7fa1785ff700 1 -- 172.21.15.84:0/3127059411 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1701f66b0 con 0x7fa1700b8660 2023-07-14T11:14:25.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.710+0000 7fa166ffd700 1 -- 172.21.15.84:0/3127059411 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa16000cd20 con 0x7fa1700b8660 2023-07-14T11:14:25.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.711+0000 7fa166ffd700 1 --2- 172.21.15.84:0/3127059411 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa15406ace0 0x7fa15406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:25.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.711+0000 7fa166ffd700 1 -- 172.21.15.84:0/3127059411 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa1600891a0 con 0x7fa1700b8660 2023-07-14T11:14:25.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.711+0000 7fa17639b700 1 --2- 172.21.15.84:0/3127059411 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa15406ace0 0x7fa15406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:25.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.712+0000 7fa17639b700 1 --2- 172.21.15.84:0/3127059411 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa15406ace0 0x7fa15406d190 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa1701f5960 tx=0x7fa16c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:25.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.715+0000 7fa166ffd700 1 -- 172.21.15.84:0/3127059411 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fa160057f10 con 0x7fa1700b8660 2023-07-14T11:14:25.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.988+0000 7fa1785ff700 1 -- 172.21.15.84:0/3127059411 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fa1700b43d0 con 0x7fa1700b8660 2023-07-14T11:14:25.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.993+0000 7fa166ffd700 1 -- 172.21.15.84:0/3127059411 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7fa1700b43d0 con 0x7fa1700b8660 2023-07-14T11:14:25.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.996+0000 7fa1785ff700 1 -- 172.21.15.84:0/3127059411 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa15406ace0 msgr2=0x7fa15406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:25.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.996+0000 7fa1785ff700 1 --2- 172.21.15.84:0/3127059411 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa15406ace0 0x7fa15406d190 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa1701f5960 tx=0x7fa16c009040 comp rx=0 tx=0).stop 2023-07-14T11:14:25.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.996+0000 7fa1785ff700 1 -- 172.21.15.84:0/3127059411 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa1700b8660 msgr2=0x7fa1701e5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:25.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.996+0000 7fa1785ff700 1 --2- 172.21.15.84:0/3127059411 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa1700b8660 0x7fa1701e5120 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fa16000e9b0 tx=0x7fa16000ed70 comp rx=0 tx=0).stop 2023-07-14T11:14:25.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.996+0000 7fa1785ff700 1 -- 172.21.15.84:0/3127059411 shutdown_connections 2023-07-14T11:14:26.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.996+0000 7fa1785ff700 1 --2- 172.21.15.84:0/3127059411 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa15406ace0 0x7fa15406d190 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:26.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.996+0000 7fa1785ff700 1 --2- 172.21.15.84:0/3127059411 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1700d12c0 0x7fa17014b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:26.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.996+0000 7fa1785ff700 1 --2- 172.21.15.84:0/3127059411 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa1700b4860 0x7fa1700b3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:26.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.996+0000 7fa1785ff700 1 --2- 172.21.15.84:0/3127059411 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa1700b8660 0x7fa1701e5120 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:26.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.996+0000 7fa1785ff700 1 -- 172.21.15.84:0/3127059411 >> 172.21.15.84:0/3127059411 conn(0x7fa170066860 msgr2=0x7fa1700d1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:26.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.996+0000 7fa1785ff700 1 -- 172.21.15.84:0/3127059411 shutdown_connections 2023-07-14T11:14:26.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:25.996+0000 7fa1785ff700 1 -- 172.21.15.84:0/3127059411 wait complete. 2023-07-14T11:14:26.016 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-07-14T11:14:26.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.211+0000 7f8c5adff700 1 Processor -- start 2023-07-14T11:14:26.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.211+0000 7f8c5adff700 1 -- start start 2023-07-14T11:14:26.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.212+0000 7f8c5adff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8c540b8a60 0x7f8c540b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:26.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.212+0000 7f8c5adff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c540d1220 0x7f8c540b0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:26.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.212+0000 7f8c5adff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c540b8e30 con 0x7f8c540b4530 2023-07-14T11:14:26.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.212+0000 7f8c5adff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c540afaa0 con 0x7f8c540b8a60 2023-07-14T11:14:26.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.212+0000 7f8c5adff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c540afd80 con 0x7f8c540d1220 2023-07-14T11:14:26.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.212+0000 7f8c58b9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8c540b8a60 0x7f8c540b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:26.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.212+0000 7f8c58b9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8c540b8a60 0x7f8c540b3ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46124/0 (socket says 172.21.15.84:46124) 2023-07-14T11:14:26.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.212+0000 7f8c58b9b700 1 -- 172.21.15.84:0/1950933283 learned_addr learned my addr 172.21.15.84:0/1950933283 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:26.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.213+0000 7f8c58b9b700 1 -- 172.21.15.84:0/1950933283 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c540d1220 msgr2=0x7f8c540b0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:26.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.213+0000 7f8c58b9b700 1 --2- 172.21.15.84:0/1950933283 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c540d1220 0x7f8c540b0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:26.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.213+0000 7f8c58b9b700 1 -- 172.21.15.84:0/1950933283 >> v1:172.21.15.179:6789/0 conn(0x7f8c540b4530 legacy=0x7f8c540d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:26.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.213+0000 7f8c58b9b700 1 -- 172.21.15.84:0/1950933283 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c540b0060 con 0x7f8c540b8a60 2023-07-14T11:14:26.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.213+0000 7f8c58b9b700 1 --2- 172.21.15.84:0/1950933283 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c540b8a60 0x7f8c540b3ff0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f8c48009e50 tx=0x7f8c4800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f4d26d5472e450a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:26.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.213+0000 7f8c537fe700 1 -- 172.21.15.84:0/1950933283 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c4800e070 con 0x7f8c540b8a60 2023-07-14T11:14:26.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.213+0000 7f8c537fe700 1 -- 172.21.15.84:0/1950933283 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c48003a20 con 0x7f8c540b8a60 2023-07-14T11:14:26.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.213+0000 7f8c537fe700 1 -- 172.21.15.84:0/1950933283 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c48003dd0 con 0x7f8c540b8a60 2023-07-14T11:14:26.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.214+0000 7f8c5adff700 1 -- 172.21.15.84:0/1950933283 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c540b8a60 msgr2=0x7f8c540b3ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:26.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.214+0000 7f8c5adff700 1 --2- 172.21.15.84:0/1950933283 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c540b8a60 0x7f8c540b3ff0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f8c48009e50 tx=0x7f8c4800b330 comp rx=0 tx=0).stop 2023-07-14T11:14:26.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.214+0000 7f8c5adff700 1 -- 172.21.15.84:0/1950933283 shutdown_connections 2023-07-14T11:14:26.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.214+0000 7f8c5adff700 1 --2- 172.21.15.84:0/1950933283 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c540d1220 0x7f8c540b0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:26.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.214+0000 7f8c5adff700 1 --2- 172.21.15.84:0/1950933283 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c540b8a60 0x7f8c540b3ff0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:26.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.214+0000 7f8c5adff700 1 -- 172.21.15.84:0/1950933283 >> 172.21.15.84:0/1950933283 conn(0x7f8c5409c1b0 msgr2=0x7f8c540d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:26.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.214+0000 7f8c5adff700 1 -- 172.21.15.84:0/1950933283 shutdown_connections 2023-07-14T11:14:26.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.214+0000 7f8c5adff700 1 -- 172.21.15.84:0/1950933283 wait complete. 2023-07-14T11:14:26.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.216+0000 7f8c5adff700 1 Processor -- start 2023-07-14T11:14:26.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.216+0000 7f8c5adff700 1 -- start start 2023-07-14T11:14:26.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.217+0000 7f8c5adff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c540b4530 0x7f8c5415fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:26.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.217+0000 7f8c5adff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c540b8a60 0x7f8c54159c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:26.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.217+0000 7f8c5adff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c540d1220 0x7f8c5415e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:26.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.217+0000 7f8c5adff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c54153c90 con 0x7f8c540d1220 2023-07-14T11:14:26.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.217+0000 7f8c5adff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5415a150 con 0x7f8c540b4530 2023-07-14T11:14:26.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.217+0000 7f8c5adff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c540cfdc0 con 0x7f8c540b8a60 2023-07-14T11:14:26.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.217+0000 7f8c5939c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c540d1220 0x7f8c5415e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:26.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.217+0000 7f8c5939c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c540d1220 0x7f8c5415e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46138/0 (socket says 172.21.15.84:46138) 2023-07-14T11:14:26.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.217+0000 7f8c5939c700 1 -- 172.21.15.84:0/748606383 learned_addr learned my addr 172.21.15.84:0/748606383 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:26.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.217+0000 7f8c53fff700 1 --2- 172.21.15.84:0/748606383 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c540b8a60 0x7f8c54159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:26.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.217+0000 7f8c58b9b700 1 --2- 172.21.15.84:0/748606383 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c540b4530 0x7f8c5415fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:26.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.217+0000 7f8c5939c700 1 -- 172.21.15.84:0/748606383 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c540b8a60 msgr2=0x7f8c54159c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:26.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.217+0000 7f8c5939c700 1 --2- 172.21.15.84:0/748606383 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c540b8a60 0x7f8c54159c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:26.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.217+0000 7f8c5939c700 1 -- 172.21.15.84:0/748606383 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c540b4530 msgr2=0x7f8c5415fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:26.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.217+0000 7f8c5939c700 1 --2- 172.21.15.84:0/748606383 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c540b4530 0x7f8c5415fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:26.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.217+0000 7f8c5939c700 1 -- 172.21.15.84:0/748606383 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c48009b30 con 0x7f8c540d1220 2023-07-14T11:14:26.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.217+0000 7f8c53fff700 1 --2- 172.21.15.84:0/748606383 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c540b8a60 0x7f8c54159c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:14:26.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.218+0000 7f8c5939c700 1 --2- 172.21.15.84:0/748606383 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c540d1220 0x7f8c5415e590 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c00b3c0 tx=0x7f8c4c00b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:26.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.218+0000 7f8c517fa700 1 -- 172.21.15.84:0/748606383 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c4c011830 con 0x7f8c540d1220 2023-07-14T11:14:26.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.218+0000 7f8c517fa700 1 -- 172.21.15.84:0/748606383 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c4c0119b0 con 0x7f8c540d1220 2023-07-14T11:14:26.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.218+0000 7f8c517fa700 1 -- 172.21.15.84:0/748606383 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c4c011d60 con 0x7f8c540d1220 2023-07-14T11:14:26.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.218+0000 7f8c5adff700 1 -- 172.21.15.84:0/748606383 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c540d00a0 con 0x7f8c540d1220 2023-07-14T11:14:26.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.218+0000 7f8c5adff700 1 -- 172.21.15.84:0/748606383 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c54153ec0 con 0x7f8c540d1220 2023-07-14T11:14:26.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.219+0000 7f8c5adff700 1 -- 172.21.15.84:0/748606383 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c54074350 con 0x7f8c540d1220 2023-07-14T11:14:26.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.220+0000 7f8c517fa700 1 -- 172.21.15.84:0/748606383 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8c4c01a400 con 0x7f8c540d1220 2023-07-14T11:14:26.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.221+0000 7f8c517fa700 1 --2- 172.21.15.84:0/748606383 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f8c3806ace0 0x7f8c3806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:26.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.221+0000 7f8c517fa700 1 -- 172.21.15.84:0/748606383 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8c4c089170 con 0x7f8c540d1220 2023-07-14T11:14:26.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.221+0000 7f8c58b9b700 1 --2- 172.21.15.84:0/748606383 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f8c3806ace0 0x7f8c3806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:26.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.222+0000 7f8c58b9b700 1 --2- 172.21.15.84:0/748606383 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f8c3806ace0 0x7f8c3806d190 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8c48015040 tx=0x7f8c48009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:26.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.225+0000 7f8c517fa700 1 -- 172.21.15.84:0/748606383 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f8c4c0544d0 con 0x7f8c540d1220 2023-07-14T11:14:26.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.497+0000 7f8c5adff700 1 -- 172.21.15.84:0/748606383 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f8c540d23e0 con 0x7f8c540d1220 2023-07-14T11:14:26.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.503+0000 7f8c517fa700 1 -- 172.21.15.84:0/748606383 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f8c4c057af0 con 0x7f8c540d1220 2023-07-14T11:14:26.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.505+0000 7f8c5adff700 1 -- 172.21.15.84:0/748606383 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f8c3806ace0 msgr2=0x7f8c3806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:26.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.505+0000 7f8c5adff700 1 --2- 172.21.15.84:0/748606383 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f8c3806ace0 0x7f8c3806d190 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8c48015040 tx=0x7f8c48009000 comp rx=0 tx=0).stop 2023-07-14T11:14:26.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.505+0000 7f8c5adff700 1 -- 172.21.15.84:0/748606383 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c540d1220 msgr2=0x7f8c5415e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:26.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.505+0000 7f8c5adff700 1 --2- 172.21.15.84:0/748606383 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c540d1220 0x7f8c5415e590 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c00b3c0 tx=0x7f8c4c00b780 comp rx=0 tx=0).stop 2023-07-14T11:14:26.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.505+0000 7f8c5adff700 1 -- 172.21.15.84:0/748606383 shutdown_connections 2023-07-14T11:14:26.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.505+0000 7f8c5adff700 1 --2- 172.21.15.84:0/748606383 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c540d1220 0x7f8c5415e590 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:26.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.505+0000 7f8c5adff700 1 --2- 172.21.15.84:0/748606383 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c540b4530 0x7f8c5415fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:26.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.505+0000 7f8c5adff700 1 --2- 172.21.15.84:0/748606383 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f8c3806ace0 0x7f8c3806d190 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:26.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.505+0000 7f8c5adff700 1 --2- 172.21.15.84:0/748606383 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c540b8a60 0x7f8c54159c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:26.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.505+0000 7f8c5adff700 1 -- 172.21.15.84:0/748606383 >> 172.21.15.84:0/748606383 conn(0x7f8c5409c1b0 msgr2=0x7f8c540b25b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:26.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.505+0000 7f8c5adff700 1 -- 172.21.15.84:0/748606383 shutdown_connections 2023-07-14T11:14:26.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.506+0000 7f8c5adff700 1 -- 172.21.15.84:0/748606383 wait complete. 2023-07-14T11:14:26.526 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-07-14T11:14:26.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.719+0000 7fc9881ff700 1 Processor -- start 2023-07-14T11:14:26.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.719+0000 7fc9881ff700 1 -- start start 2023-07-14T11:14:26.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.720+0000 7fc9881ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc98015d9d0 0x7fc98006b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:26.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.720+0000 7fc9881ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc980071170 0x7fc9800715c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:26.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.720+0000 7fc9881ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc980071b00 con 0x7fc98006c9f0 2023-07-14T11:14:26.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.720+0000 7fc9881ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc98006c4e0 con 0x7fc98015d9d0 2023-07-14T11:14:26.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.720+0000 7fc9881ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9800b2020 con 0x7fc980071170 2023-07-14T11:14:26.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.720+0000 7fc98579a700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fc98006c9f0 0x7fc9800b1910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:44614/0 (socket says 172.21.15.84:44614) 2023-07-14T11:14:26.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.720+0000 7fc98579a700 1 -- 172.21.15.84:0/1064887431 learned_addr learned my addr 172.21.15.84:0/1064887431 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:14:26.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.720+0000 7fc98679c700 1 --2- 172.21.15.84:0/1064887431 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc980071170 0x7fc9800715c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:26.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.721+0000 7fc985f9b700 1 --2- 172.21.15.84:0/1064887431 >> v2:172.21.15.179:3300/0 conn(0x7fc98015d9d0 0x7fc98006b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:26.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.721+0000 7fc984f99700 1 -- 172.21.15.84:0/1064887431 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4176601933 0 0) 0x7fc980071b00 con 0x7fc98006c9f0 2023-07-14T11:14:26.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.721+0000 7fc984f99700 1 -- 172.21.15.84:0/1064887431 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc96c0035b0 con 0x7fc98006c9f0 2023-07-14T11:14:26.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.721+0000 7fc985f9b700 1 -- 172.21.15.84:0/1064887431 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc980071170 msgr2=0x7fc9800715c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:26.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.721+0000 7fc985f9b700 1 --2- 172.21.15.84:0/1064887431 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc980071170 0x7fc9800715c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:26.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.721+0000 7fc985f9b700 1 -- 172.21.15.84:0/1064887431 >> v1:172.21.15.84:6789/0 conn(0x7fc98006c9f0 legacy=0x7fc9800b1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:26.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.721+0000 7fc985f9b700 1 -- 172.21.15.84:0/1064887431 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc98015dda0 con 0x7fc98015d9d0 2023-07-14T11:14:26.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.721+0000 7fc98679c700 1 --2- 172.21.15.84:0/1064887431 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc980071170 0x7fc9800715c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:14:26.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.721+0000 7fc985f9b700 1 --2- 172.21.15.84:0/1064887431 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc98015d9d0 0x7fc98006b5b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc97c009840 tx=0x7fc97c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=509bb5607ad428ad server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:26.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.722+0000 7fc984f99700 1 -- 172.21.15.84:0/1064887431 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97c011830 con 0x7fc98015d9d0 2023-07-14T11:14:26.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.722+0000 7fc984f99700 1 -- 172.21.15.84:0/1064887431 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc97c011990 con 0x7fc98015d9d0 2023-07-14T11:14:26.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.722+0000 7fc984f99700 1 -- 172.21.15.84:0/1064887431 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97c011d20 con 0x7fc98015d9d0 2023-07-14T11:14:26.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.722+0000 7fc9881ff700 1 -- 172.21.15.84:0/1064887431 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc98015d9d0 msgr2=0x7fc98006b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:26.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.722+0000 7fc9881ff700 1 --2- 172.21.15.84:0/1064887431 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc98015d9d0 0x7fc98006b5b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc97c009840 tx=0x7fc97c009b50 comp rx=0 tx=0).stop 2023-07-14T11:14:26.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.722+0000 7fc9881ff700 1 -- 172.21.15.84:0/1064887431 shutdown_connections 2023-07-14T11:14:26.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.722+0000 7fc9881ff700 1 --2- 172.21.15.84:0/1064887431 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc980071170 0x7fc9800715c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:26.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.722+0000 7fc9881ff700 1 --2- 172.21.15.84:0/1064887431 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc98015d9d0 0x7fc98006b5b0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:26.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.722+0000 7fc9881ff700 1 -- 172.21.15.84:0/1064887431 >> 172.21.15.84:0/1064887431 conn(0x7fc9800b05d0 msgr2=0x7fc9800b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:26.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.722+0000 7fc9881ff700 1 -- 172.21.15.84:0/1064887431 shutdown_connections 2023-07-14T11:14:26.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.722+0000 7fc9881ff700 1 -- 172.21.15.84:0/1064887431 wait complete. 2023-07-14T11:14:26.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.724+0000 7fc9881ff700 1 Processor -- start 2023-07-14T11:14:26.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.724+0000 7fc9881ff700 1 -- start start 2023-07-14T11:14:26.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.725+0000 7fc9881ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc98006c9f0 0x7fc98014b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:26.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.725+0000 7fc9881ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc980071170 0x7fc9800a8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:26.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.725+0000 7fc9881ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc98015d9d0 0x7fc9800a8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:26.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.725+0000 7fc9881ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9800c2f30 con 0x7fc98006c9f0 2023-07-14T11:14:26.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.725+0000 7fc9881ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9800c3210 con 0x7fc980071170 2023-07-14T11:14:26.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.725+0000 7fc9881ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9800c34f0 con 0x7fc98015d9d0 2023-07-14T11:14:26.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.725+0000 7fc985f9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc98006c9f0 0x7fc98014b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:26.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.725+0000 7fc985f9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc98006c9f0 0x7fc98014b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46150/0 (socket says 172.21.15.84:46150) 2023-07-14T11:14:26.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.725+0000 7fc985f9b700 1 -- 172.21.15.84:0/4060860590 learned_addr learned my addr 172.21.15.84:0/4060860590 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:26.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.726+0000 7fc98579a700 1 --2- 172.21.15.84:0/4060860590 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc980071170 0x7fc9800a8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:26.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.726+0000 7fc98679c700 1 --2- 172.21.15.84:0/4060860590 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc98015d9d0 0x7fc9800a8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:26.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.726+0000 7fc985f9b700 1 -- 172.21.15.84:0/4060860590 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc98015d9d0 msgr2=0x7fc9800a8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:26.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.726+0000 7fc985f9b700 1 --2- 172.21.15.84:0/4060860590 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc98015d9d0 0x7fc9800a8990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:26.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.726+0000 7fc985f9b700 1 -- 172.21.15.84:0/4060860590 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc980071170 msgr2=0x7fc9800a8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:26.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.726+0000 7fc985f9b700 1 --2- 172.21.15.84:0/4060860590 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc980071170 0x7fc9800a8450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:26.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.726+0000 7fc985f9b700 1 -- 172.21.15.84:0/4060860590 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc978009a70 con 0x7fc98006c9f0 2023-07-14T11:14:26.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.726+0000 7fc98579a700 1 --2- 172.21.15.84:0/4060860590 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc980071170 0x7fc9800a8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:14:26.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.726+0000 7fc98679c700 1 --2- 172.21.15.84:0/4060860590 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc98015d9d0 0x7fc9800a8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:14:26.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.726+0000 7fc985f9b700 1 --2- 172.21.15.84:0/4060860590 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc98006c9f0 0x7fc98014b240 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fc97c009fd0 tx=0x7fc97c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:26.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.726+0000 7fc9767fc700 1 -- 172.21.15.84:0/4060860590 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97c0036a0 con 0x7fc98006c9f0 2023-07-14T11:14:26.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.726+0000 7fc9767fc700 1 -- 172.21.15.84:0/4060860590 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc97c01e070 con 0x7fc98006c9f0 2023-07-14T11:14:26.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.726+0000 7fc9881ff700 1 -- 172.21.15.84:0/4060860590 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc97c0094a0 con 0x7fc98006c9f0 2023-07-14T11:14:26.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.726+0000 7fc9767fc700 1 -- 172.21.15.84:0/4060860590 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97c003a60 con 0x7fc98006c9f0 2023-07-14T11:14:26.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.726+0000 7fc9881ff700 1 -- 172.21.15.84:0/4060860590 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9800c3ab0 con 0x7fc98006c9f0 2023-07-14T11:14:26.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.727+0000 7fc9881ff700 1 -- 172.21.15.84:0/4060860590 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc980074350 con 0x7fc98006c9f0 2023-07-14T11:14:26.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.728+0000 7fc9767fc700 1 -- 172.21.15.84:0/4060860590 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc97c003bc0 con 0x7fc98006c9f0 2023-07-14T11:14:26.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.729+0000 7fc9767fc700 1 --2- 172.21.15.84:0/4060860590 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc96406ace0 0x7fc96406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:26.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.729+0000 7fc9767fc700 1 -- 172.21.15.84:0/4060860590 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fc97c08a090 con 0x7fc98006c9f0 2023-07-14T11:14:26.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.729+0000 7fc98579a700 1 --2- 172.21.15.84:0/4060860590 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc96406ace0 0x7fc96406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:26.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.730+0000 7fc98579a700 1 --2- 172.21.15.84:0/4060860590 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc96406ace0 0x7fc96406d190 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc9801f5090 tx=0x7fc970009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:26.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:26.733+0000 7fc9767fc700 1 -- 172.21.15.84:0/4060860590 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fc97c055530 con 0x7fc98006c9f0 2023-07-14T11:14:27.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.005+0000 7fc9881ff700 1 -- 172.21.15.84:0/4060860590 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fc980070c40 con 0x7fc98006c9f0 2023-07-14T11:14:27.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.010+0000 7fc9767fc700 1 -- 172.21.15.84:0/4060860590 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v11) v1 ==== 90+0+0 (secure 0 0 0) 0x7fc97c0200a0 con 0x7fc98006c9f0 2023-07-14T11:14:27.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.013+0000 7fc9881ff700 1 -- 172.21.15.84:0/4060860590 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc96406ace0 msgr2=0x7fc96406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:27.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.013+0000 7fc9881ff700 1 --2- 172.21.15.84:0/4060860590 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc96406ace0 0x7fc96406d190 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc9801f5090 tx=0x7fc970009040 comp rx=0 tx=0).stop 2023-07-14T11:14:27.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.013+0000 7fc9881ff700 1 -- 172.21.15.84:0/4060860590 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc98006c9f0 msgr2=0x7fc98014b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:27.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.013+0000 7fc9881ff700 1 --2- 172.21.15.84:0/4060860590 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc98006c9f0 0x7fc98014b240 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fc97c009fd0 tx=0x7fc97c004750 comp rx=0 tx=0).stop 2023-07-14T11:14:27.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.013+0000 7fc9881ff700 1 -- 172.21.15.84:0/4060860590 shutdown_connections 2023-07-14T11:14:27.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.013+0000 7fc9881ff700 1 --2- 172.21.15.84:0/4060860590 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc96406ace0 0x7fc96406d190 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:27.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.013+0000 7fc9881ff700 1 --2- 172.21.15.84:0/4060860590 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc98015d9d0 0x7fc9800a8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:27.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.013+0000 7fc9881ff700 1 --2- 172.21.15.84:0/4060860590 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc98006c9f0 0x7fc98014b240 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:27.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.013+0000 7fc9881ff700 1 --2- 172.21.15.84:0/4060860590 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc980071170 0x7fc9800a8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:27.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.013+0000 7fc9881ff700 1 -- 172.21.15.84:0/4060860590 >> 172.21.15.84:0/4060860590 conn(0x7fc9800b05d0 msgr2=0x7fc9800ce140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:27.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.013+0000 7fc9881ff700 1 -- 172.21.15.84:0/4060860590 shutdown_connections 2023-07-14T11:14:27.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.013+0000 7fc9881ff700 1 -- 172.21.15.84:0/4060860590 wait complete. 2023-07-14T11:14:27.034 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-07-14T11:14:27.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.228+0000 7f8dc17ff700 1 Processor -- start 2023-07-14T11:14:27.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.228+0000 7f8dc17ff700 1 -- start start 2023-07-14T11:14:27.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.229+0000 7f8dc17ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8dbc0cbe40 0x7f8dbc0cda40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:27.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.229+0000 7f8dc17ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8dbc0cdf80 0x7f8dbc06ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:27.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.229+0000 7f8dc17ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dbc0ce3e0 con 0x7f8dbc158bb0 2023-07-14T11:14:27.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.229+0000 7f8dc17ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dbc06b5b0 con 0x7f8dbc0cbe40 2023-07-14T11:14:27.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.229+0000 7f8dc17ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dbc071500 con 0x7f8dbc0cdf80 2023-07-14T11:14:27.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.229+0000 7f8dba7fc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8dbc0cbe40 0x7f8dbc0cda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:27.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.230+0000 7f8dba7fc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8dbc0cbe40 0x7f8dbc0cda40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46156/0 (socket says 172.21.15.84:46156) 2023-07-14T11:14:27.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.230+0000 7f8dba7fc700 1 -- 172.21.15.84:0/936627654 learned_addr learned my addr 172.21.15.84:0/936627654 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:27.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.230+0000 7f8dbb7fe700 1 --2- 172.21.15.84:0/936627654 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8dbc0cdf80 0x7f8dbc06ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:27.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.230+0000 7f8dba7fc700 1 -- 172.21.15.84:0/936627654 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8dbc0cdf80 msgr2=0x7f8dbc06ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:27.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.230+0000 7f8dba7fc700 1 --2- 172.21.15.84:0/936627654 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8dbc0cdf80 0x7f8dbc06ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:27.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.230+0000 7f8dba7fc700 1 -- 172.21.15.84:0/936627654 >> v1:172.21.15.179:6789/0 conn(0x7f8dbc158bb0 legacy=0x7f8dbc0cd0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:27.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.230+0000 7f8dba7fc700 1 -- 172.21.15.84:0/936627654 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dbc0ce8c0 con 0x7f8dbc0cbe40 2023-07-14T11:14:27.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.230+0000 7f8dba7fc700 1 --2- 172.21.15.84:0/936627654 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8dbc0cbe40 0x7f8dbc0cda40 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f8db000aa90 tx=0x7f8db000ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68c71831aaf00687 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:27.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.230+0000 7f8db9ffb700 1 -- 172.21.15.84:0/936627654 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db000cb70 con 0x7f8dbc0cbe40 2023-07-14T11:14:27.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.230+0000 7f8db9ffb700 1 -- 172.21.15.84:0/936627654 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8db000ccd0 con 0x7f8dbc0cbe40 2023-07-14T11:14:27.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.231+0000 7f8db9ffb700 1 -- 172.21.15.84:0/936627654 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db0018620 con 0x7f8dbc0cbe40 2023-07-14T11:14:27.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.231+0000 7f8dc17ff700 1 -- 172.21.15.84:0/936627654 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8dbc0cbe40 msgr2=0x7f8dbc0cda40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:27.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.231+0000 7f8dc17ff700 1 --2- 172.21.15.84:0/936627654 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8dbc0cbe40 0x7f8dbc0cda40 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f8db000aa90 tx=0x7f8db000ada0 comp rx=0 tx=0).stop 2023-07-14T11:14:27.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.231+0000 7f8dc17ff700 1 -- 172.21.15.84:0/936627654 shutdown_connections 2023-07-14T11:14:27.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.231+0000 7f8dc17ff700 1 --2- 172.21.15.84:0/936627654 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8dbc0cdf80 0x7f8dbc06ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:27.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.231+0000 7f8dc17ff700 1 --2- 172.21.15.84:0/936627654 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8dbc0cbe40 0x7f8dbc0cda40 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:27.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.231+0000 7f8dc17ff700 1 -- 172.21.15.84:0/936627654 >> 172.21.15.84:0/936627654 conn(0x7f8dbc0b05d0 msgr2=0x7f8dbc0b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:27.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.231+0000 7f8dc17ff700 1 -- 172.21.15.84:0/936627654 shutdown_connections 2023-07-14T11:14:27.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.231+0000 7f8dc17ff700 1 -- 172.21.15.84:0/936627654 wait complete. 2023-07-14T11:14:27.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.233+0000 7f8dc17ff700 1 Processor -- start 2023-07-14T11:14:27.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.233+0000 7f8dc17ff700 1 -- start start 2023-07-14T11:14:27.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.234+0000 7f8dc17ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8dbc0cbe40 0x7f8dbc0c6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:27.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.234+0000 7f8dc17ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8dbc0cdf80 0x7f8dbc1e3450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:27.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.234+0000 7f8dc17ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8dbc158bb0 0x7f8dbc0705b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:27.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.234+0000 7f8dc17ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dbc0c80e0 con 0x7f8dbc0cbe40 2023-07-14T11:14:27.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.234+0000 7f8dc17ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dbc0c7460 con 0x7f8dbc158bb0 2023-07-14T11:14:27.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.234+0000 7f8dc17ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dbc0c7740 con 0x7f8dbc0cdf80 2023-07-14T11:14:27.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.234+0000 7f8dbaffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8dbc0cbe40 0x7f8dbc0c6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:27.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.234+0000 7f8dbaffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8dbc0cbe40 0x7f8dbc0c6d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46164/0 (socket says 172.21.15.84:46164) 2023-07-14T11:14:27.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.234+0000 7f8dbaffd700 1 -- 172.21.15.84:0/4102801766 learned_addr learned my addr 172.21.15.84:0/4102801766 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:27.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.234+0000 7f8dba7fc700 1 --2- 172.21.15.84:0/4102801766 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8dbc0cdf80 0x7f8dbc1e3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:27.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.234+0000 7f8dbb7fe700 1 --2- 172.21.15.84:0/4102801766 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8dbc158bb0 0x7f8dbc0705b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:27.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.235+0000 7f8dbaffd700 1 -- 172.21.15.84:0/4102801766 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8dbc0cdf80 msgr2=0x7f8dbc1e3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:27.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.235+0000 7f8dbaffd700 1 --2- 172.21.15.84:0/4102801766 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8dbc0cdf80 0x7f8dbc1e3450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:27.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.235+0000 7f8dbaffd700 1 -- 172.21.15.84:0/4102801766 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8dbc158bb0 msgr2=0x7f8dbc0705b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:27.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.235+0000 7f8dbaffd700 1 --2- 172.21.15.84:0/4102801766 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8dbc158bb0 0x7f8dbc0705b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:27.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.235+0000 7f8dbaffd700 1 -- 172.21.15.84:0/4102801766 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8db000a6f0 con 0x7f8dbc0cbe40 2023-07-14T11:14:27.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.235+0000 7f8dbaffd700 1 --2- 172.21.15.84:0/4102801766 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8dbc0cbe40 0x7f8dbc0c6d80 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f8dac00c450 tx=0x7f8dac00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:27.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.235+0000 7f8da37fe700 1 -- 172.21.15.84:0/4102801766 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dac0052d0 con 0x7f8dbc0cbe40 2023-07-14T11:14:27.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.235+0000 7f8da37fe700 1 -- 172.21.15.84:0/4102801766 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dac005430 con 0x7f8dbc0cbe40 2023-07-14T11:14:27.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.235+0000 7f8da37fe700 1 -- 172.21.15.84:0/4102801766 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dac0038c0 con 0x7f8dbc0cbe40 2023-07-14T11:14:27.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.235+0000 7f8dc17ff700 1 -- 172.21.15.84:0/4102801766 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dbc0c7a20 con 0x7f8dbc0cbe40 2023-07-14T11:14:27.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.235+0000 7f8dc17ff700 1 -- 172.21.15.84:0/4102801766 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dbc1e3990 con 0x7f8dbc0cbe40 2023-07-14T11:14:27.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.236+0000 7f8dc17ff700 1 -- 172.21.15.84:0/4102801766 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dbc0c8350 con 0x7f8dbc0cbe40 2023-07-14T11:14:27.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.237+0000 7f8da37fe700 1 -- 172.21.15.84:0/4102801766 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8dac003a20 con 0x7f8dbc0cbe40 2023-07-14T11:14:27.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.238+0000 7f8da37fe700 1 --2- 172.21.15.84:0/4102801766 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f8da806ace0 0x7f8da806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:27.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.238+0000 7f8da37fe700 1 -- 172.21.15.84:0/4102801766 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8dac0884e0 con 0x7f8dbc0cbe40 2023-07-14T11:14:27.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.238+0000 7f8dba7fc700 1 --2- 172.21.15.84:0/4102801766 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f8da806ace0 0x7f8da806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:27.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.239+0000 7f8dba7fc700 1 --2- 172.21.15.84:0/4102801766 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f8da806ace0 0x7f8da806d190 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc0b10d0 tx=0x7f8db001a040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:27.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.243+0000 7f8da37fe700 1 -- 172.21.15.84:0/4102801766 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f8dac0538d0 con 0x7f8dbc0cbe40 2023-07-14T11:14:27.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.512+0000 7f8dc17ff700 1 -- 172.21.15.84:0/4102801766 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f8dbc074350 con 0x7f8dbc0cbe40 2023-07-14T11:14:27.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.518+0000 7f8da37fe700 1 -- 172.21.15.84:0/4102801766 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f8dac056ef0 con 0x7f8dbc0cbe40 2023-07-14T11:14:27.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.520+0000 7f8dc17ff700 1 -- 172.21.15.84:0/4102801766 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f8da806ace0 msgr2=0x7f8da806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:27.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.520+0000 7f8dc17ff700 1 --2- 172.21.15.84:0/4102801766 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f8da806ace0 0x7f8da806d190 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc0b10d0 tx=0x7f8db001a040 comp rx=0 tx=0).stop 2023-07-14T11:14:27.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.520+0000 7f8dc17ff700 1 -- 172.21.15.84:0/4102801766 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8dbc0cbe40 msgr2=0x7f8dbc0c6d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:27.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.520+0000 7f8dc17ff700 1 --2- 172.21.15.84:0/4102801766 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8dbc0cbe40 0x7f8dbc0c6d80 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f8dac00c450 tx=0x7f8dac00c810 comp rx=0 tx=0).stop 2023-07-14T11:14:27.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.520+0000 7f8dc17ff700 1 -- 172.21.15.84:0/4102801766 shutdown_connections 2023-07-14T11:14:27.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.520+0000 7f8dc17ff700 1 --2- 172.21.15.84:0/4102801766 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8dbc158bb0 0x7f8dbc0705b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:27.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.520+0000 7f8dc17ff700 1 --2- 172.21.15.84:0/4102801766 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8dbc0cbe40 0x7f8dbc0c6d80 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:27.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.520+0000 7f8dc17ff700 1 --2- 172.21.15.84:0/4102801766 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f8da806ace0 0x7f8da806d190 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:27.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.520+0000 7f8dc17ff700 1 --2- 172.21.15.84:0/4102801766 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8dbc0cdf80 0x7f8dbc1e3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:27.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.521+0000 7f8dc17ff700 1 -- 172.21.15.84:0/4102801766 >> 172.21.15.84:0/4102801766 conn(0x7f8dbc0b05d0 msgr2=0x7f8dbc0cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:27.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.521+0000 7f8dc17ff700 1 -- 172.21.15.84:0/4102801766 shutdown_connections 2023-07-14T11:14:27.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.521+0000 7f8dc17ff700 1 -- 172.21.15.84:0/4102801766 wait complete. 2023-07-14T11:14:27.542 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-07-14T11:14:27.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.735+0000 7fecbb1ff700 1 Processor -- start 2023-07-14T11:14:27.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.735+0000 7fecbb1ff700 1 -- start start 2023-07-14T11:14:27.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.736+0000 7fecbb1ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fecb40b8a60 0x7fecb40b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:27.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.736+0000 7fecbb1ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecb40b8e30 con 0x7fecb40d1220 2023-07-14T11:14:27.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.736+0000 7fecbb1ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecb40afaa0 con 0x7fecb40b4530 2023-07-14T11:14:27.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.736+0000 7fecbb1ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecb40afd80 con 0x7fecb40b8a60 2023-07-14T11:14:27.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.737+0000 7fecb979c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fecb40d1220 0x7fecb40b0e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:44620/0 (socket says 172.21.15.84:44620) 2023-07-14T11:14:27.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.737+0000 7fecb979c700 1 -- 172.21.15.84:0/1734472954 learned_addr learned my addr 172.21.15.84:0/1734472954 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:14:27.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.737+0000 7fecb8f9b700 1 --2- 172.21.15.84:0/1734472954 >> v2:172.21.15.179:3300/0 conn(0x7fecb40b8a60 0x7fecb40b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:27.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.737+0000 7fecb37fe700 1 -- 172.21.15.84:0/1734472954 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3809244157 0 0) 0x7fecb40b8e30 con 0x7fecb40d1220 2023-07-14T11:14:27.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.737+0000 7fecb37fe700 1 -- 172.21.15.84:0/1734472954 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feca40035b0 con 0x7fecb40d1220 2023-07-14T11:14:27.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.737+0000 7fecb37fe700 1 -- 172.21.15.84:0/1734472954 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3068891146 0 0) 0x7feca40035b0 con 0x7fecb40d1220 2023-07-14T11:14:27.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.737+0000 7fecb37fe700 1 -- 172.21.15.84:0/1734472954 >> v2:172.21.15.179:3300/0 conn(0x7fecb40b8a60 msgr2=0x7fecb40b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:27.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.737+0000 7fecb37fe700 1 --2- 172.21.15.84:0/1734472954 >> v2:172.21.15.179:3300/0 conn(0x7fecb40b8a60 0x7fecb40b3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:27.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.737+0000 7fecb37fe700 1 -- 172.21.15.84:0/1734472954 >> v1:172.21.15.179:6789/0 conn(0x7fecb40b4530 legacy=0x7fecb40d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:27.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.737+0000 7fecb37fe700 1 -- 172.21.15.84:0/1734472954 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb40b0060 con 0x7fecb40d1220 2023-07-14T11:14:27.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.737+0000 7fecb37fe700 1 -- 172.21.15.84:0/1734472954 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7fecac0019f0 con 0x7fecb40d1220 2023-07-14T11:14:27.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.737+0000 7fecb37fe700 1 -- 172.21.15.84:0/1734472954 >> v1:172.21.15.84:6789/0 conn(0x7fecb40d1220 legacy=0x7fecb40b0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:27.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.737+0000 7fecb37fe700 1 --2- 172.21.15.84:0/1734472954 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feca4003a00 0x7feca4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:27.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.737+0000 7fecb37fe700 1 --2- 172.21.15.84:0/1734472954 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feca40043f0 0x7feca40048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:27.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.737+0000 7fecb37fe700 1 --2- 172.21.15.84:0/1734472954 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feca40050b0 0x7feca400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:27.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.737+0000 7fecb37fe700 1 -- 172.21.15.84:0/1734472954 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb40afd80 con 0x7feca4003a00 2023-07-14T11:14:27.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.737+0000 7fecb37fe700 1 -- 172.21.15.84:0/1734472954 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca400bf50 con 0x7feca40050b0 2023-07-14T11:14:27.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.737+0000 7fecb37fe700 1 -- 172.21.15.84:0/1734472954 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feca400c110 con 0x7feca40043f0 2023-07-14T11:14:27.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.738+0000 7fecb8f9b700 1 --2- 172.21.15.84:0/1734472954 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feca4003a00 0x7feca4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:27.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.738+0000 7fecb979c700 1 --2- 172.21.15.84:0/1734472954 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feca40050b0 0x7feca400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:27.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.738+0000 7fecb3fff700 1 --2- 172.21.15.84:0/1734472954 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feca40043f0 0x7feca40048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:27.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.738+0000 7fecb8f9b700 1 -- 172.21.15.84:0/1734472954 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feca40043f0 msgr2=0x7feca40048b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:27.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.738+0000 7fecb8f9b700 1 --2- 172.21.15.84:0/1734472954 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feca40043f0 0x7feca40048b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:27.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.738+0000 7fecb8f9b700 1 -- 172.21.15.84:0/1734472954 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feca40050b0 msgr2=0x7feca400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:27.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.738+0000 7fecb8f9b700 1 --2- 172.21.15.84:0/1734472954 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feca40050b0 0x7feca400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:27.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.738+0000 7fecb8f9b700 1 -- 172.21.15.84:0/1734472954 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca40035b0 con 0x7feca4003a00 2023-07-14T11:14:27.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.738+0000 7fecb3fff700 1 --2- 172.21.15.84:0/1734472954 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feca40043f0 0x7feca40048b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:14:27.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.738+0000 7fecb979c700 1 --2- 172.21.15.84:0/1734472954 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feca40050b0 0x7feca400ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:14:27.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.738+0000 7fecb979c700 1 -- 172.21.15.84:0/1734472954 reap_dead start 2023-07-14T11:14:27.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.738+0000 7fecb8f9b700 1 --2- 172.21.15.84:0/1734472954 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feca4003a00 0x7feca4003dd0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7feca8009b60 tx=0x7feca4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2810b3f7a0ec5870 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:27.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.739+0000 7fecb37fe700 1 -- 172.21.15.84:0/1734472954 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca800e6c0 con 0x7feca4003a00 2023-07-14T11:14:27.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.739+0000 7fecb37fe700 1 -- 172.21.15.84:0/1734472954 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feca800e820 con 0x7feca4003a00 2023-07-14T11:14:27.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.739+0000 7fecb37fe700 1 -- 172.21.15.84:0/1734472954 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca800eb90 con 0x7feca4003a00 2023-07-14T11:14:27.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.739+0000 7fecbb1ff700 1 -- 172.21.15.84:0/1734472954 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feca4003a00 msgr2=0x7feca4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:27.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.739+0000 7fecbb1ff700 1 --2- 172.21.15.84:0/1734472954 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feca4003a00 0x7feca4003dd0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7feca8009b60 tx=0x7feca4005880 comp rx=0 tx=0).stop 2023-07-14T11:14:27.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.739+0000 7fecbb1ff700 1 -- 172.21.15.84:0/1734472954 shutdown_connections 2023-07-14T11:14:27.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.739+0000 7fecbb1ff700 1 --2- 172.21.15.84:0/1734472954 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feca4003a00 0x7feca4003dd0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:27.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.739+0000 7fecbb1ff700 1 -- 172.21.15.84:0/1734472954 >> 172.21.15.84:0/1734472954 conn(0x7fecb409c1b0 msgr2=0x7fecb40d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:27.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.739+0000 7fecbb1ff700 1 -- 172.21.15.84:0/1734472954 shutdown_connections 2023-07-14T11:14:27.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.739+0000 7fecbb1ff700 1 -- 172.21.15.84:0/1734472954 wait complete. 2023-07-14T11:14:27.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.741+0000 7fecbb1ff700 1 Processor -- start 2023-07-14T11:14:27.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.741+0000 7fecbb1ff700 1 -- start start 2023-07-14T11:14:27.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.742+0000 7fecbb1ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feca4003a00 0x7fecb414b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:27.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.742+0000 7fecbb1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fecb415c3f0 0x7fecb414e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:27.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.742+0000 7fecbb1ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fecb40b2b50 0x7fecb40b2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:27.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.742+0000 7fecbb1ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb40b3500 con 0x7fecb40b2b50 2023-07-14T11:14:27.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.742+0000 7fecbb1ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb414bba0 con 0x7feca4003a00 2023-07-14T11:14:27.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.742+0000 7fecbb1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecb414ee20 con 0x7fecb415c3f0 2023-07-14T11:14:27.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.742+0000 7fecb979c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fecb40b2b50 0x7fecb40b2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:27.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.742+0000 7fecb979c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fecb40b2b50 0x7fecb40b2fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46186/0 (socket says 172.21.15.84:46186) 2023-07-14T11:14:27.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.742+0000 7fecb979c700 1 -- 172.21.15.84:0/1609897208 learned_addr learned my addr 172.21.15.84:0/1609897208 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:27.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.743+0000 7fecb8f9b700 1 --2- 172.21.15.84:0/1609897208 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feca4003a00 0x7fecb414b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:27.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.743+0000 7fecb3fff700 1 --2- 172.21.15.84:0/1609897208 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fecb415c3f0 0x7fecb414e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:27.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.743+0000 7fecb979c700 1 -- 172.21.15.84:0/1609897208 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fecb415c3f0 msgr2=0x7fecb414e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:27.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.743+0000 7fecb979c700 1 --2- 172.21.15.84:0/1609897208 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fecb415c3f0 0x7fecb414e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:27.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.743+0000 7fecb979c700 1 -- 172.21.15.84:0/1609897208 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feca4003a00 msgr2=0x7fecb414b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:27.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.743+0000 7fecb979c700 1 --2- 172.21.15.84:0/1609897208 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feca4003a00 0x7fecb414b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:27.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.743+0000 7fecb979c700 1 -- 172.21.15.84:0/1609897208 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb415c990 con 0x7fecb40b2b50 2023-07-14T11:14:27.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.743+0000 7fecb3fff700 1 --2- 172.21.15.84:0/1609897208 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fecb415c3f0 0x7fecb414e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:14:27.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.743+0000 7fecb979c700 1 --2- 172.21.15.84:0/1609897208 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fecb40b2b50 0x7fecb40b2fc0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fecb40a0df0 tx=0x7fecac00e440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:27.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.743+0000 7fecb17fa700 1 -- 172.21.15.84:0/1609897208 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecac00ec00 con 0x7fecb40b2b50 2023-07-14T11:14:27.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.743+0000 7fecb17fa700 1 -- 172.21.15.84:0/1609897208 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecac00ed60 con 0x7fecb40b2b50 2023-07-14T11:14:27.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.743+0000 7fecbb1ff700 1 -- 172.21.15.84:0/1609897208 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecb415cc70 con 0x7fecb40b2b50 2023-07-14T11:14:27.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.743+0000 7fecb17fa700 1 -- 172.21.15.84:0/1609897208 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecac013640 con 0x7fecb40b2b50 2023-07-14T11:14:27.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.743+0000 7fecbb1ff700 1 -- 172.21.15.84:0/1609897208 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecb415d230 con 0x7fecb40b2b50 2023-07-14T11:14:27.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.744+0000 7fecbb1ff700 1 -- 172.21.15.84:0/1609897208 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecb415d3f0 con 0x7fecb40b2b50 2023-07-14T11:14:27.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.745+0000 7fecb17fa700 1 -- 172.21.15.84:0/1609897208 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fecac0137a0 con 0x7fecb40b2b50 2023-07-14T11:14:27.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.746+0000 7fecb17fa700 1 --2- 172.21.15.84:0/1609897208 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fec9806ad10 0x7fec9806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:27.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.747+0000 7fecb17fa700 1 -- 172.21.15.84:0/1609897208 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fecac0895d0 con 0x7fecb40b2b50 2023-07-14T11:14:27.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.747+0000 7fecb8f9b700 1 --2- 172.21.15.84:0/1609897208 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fec9806ad10 0x7fec9806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:27.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.747+0000 7fecb8f9b700 1 --2- 172.21.15.84:0/1609897208 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fec9806ad10 0x7fec9806d1c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7feca8000c00 tx=0x7feca801e040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:27.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:27.750+0000 7fecb17fa700 1 -- 172.21.15.84:0/1609897208 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fecac054a60 con 0x7fecb40b2b50 2023-07-14T11:14:28.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.027+0000 7fecbb1ff700 1 -- 172.21.15.84:0/1609897208 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fecb415e120 con 0x7fecb40b2b50 2023-07-14T11:14:28.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.033+0000 7fecb17fa700 1 -- 172.21.15.84:0/1609897208 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v13) v1 ==== 97+0+0 (secure 0 0 0) 0x7fecb415e120 con 0x7fecb40b2b50 2023-07-14T11:14:28.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.035+0000 7fecbb1ff700 1 -- 172.21.15.84:0/1609897208 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fec9806ad10 msgr2=0x7fec9806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:28.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.035+0000 7fecbb1ff700 1 --2- 172.21.15.84:0/1609897208 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fec9806ad10 0x7fec9806d1c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7feca8000c00 tx=0x7feca801e040 comp rx=0 tx=0).stop 2023-07-14T11:14:28.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.035+0000 7fecbb1ff700 1 -- 172.21.15.84:0/1609897208 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fecb40b2b50 msgr2=0x7fecb40b2fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:28.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.035+0000 7fecbb1ff700 1 --2- 172.21.15.84:0/1609897208 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fecb40b2b50 0x7fecb40b2fc0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fecb40a0df0 tx=0x7fecac00e440 comp rx=0 tx=0).stop 2023-07-14T11:14:28.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.035+0000 7fecbb1ff700 1 -- 172.21.15.84:0/1609897208 shutdown_connections 2023-07-14T11:14:28.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.035+0000 7fecbb1ff700 1 --2- 172.21.15.84:0/1609897208 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fecb40b2b50 0x7fecb40b2fc0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:28.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.035+0000 7fecbb1ff700 1 --2- 172.21.15.84:0/1609897208 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feca4003a00 0x7fecb414b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:28.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.035+0000 7fecbb1ff700 1 --2- 172.21.15.84:0/1609897208 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fec9806ad10 0x7fec9806d1c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:28.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.035+0000 7fecbb1ff700 1 --2- 172.21.15.84:0/1609897208 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fecb415c3f0 0x7fecb414e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:28.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.035+0000 7fecbb1ff700 1 -- 172.21.15.84:0/1609897208 >> 172.21.15.84:0/1609897208 conn(0x7fecb409c1b0 msgr2=0x7fecb40b5d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:28.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.035+0000 7fecbb1ff700 1 -- 172.21.15.84:0/1609897208 shutdown_connections 2023-07-14T11:14:28.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.035+0000 7fecbb1ff700 1 -- 172.21.15.84:0/1609897208 wait complete. 2023-07-14T11:14:28.056 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-07-14T11:14:28.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.250+0000 7f79867ff700 1 Processor -- start 2023-07-14T11:14:28.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.250+0000 7f79867ff700 1 -- start start 2023-07-14T11:14:28.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.251+0000 7f79867ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f798015d9d0 0x7f798006b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:28.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.251+0000 7f79867ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f798006c9f0 0x7f79800b1910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:28.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.251+0000 7f79867ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f798006c4e0 con 0x7f79800b1e50 2023-07-14T11:14:28.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.251+0000 7f79867ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f798015dda0 con 0x7f798006c9f0 2023-07-14T11:14:28.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.251+0000 7f79867ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f798006bf20 con 0x7f798015d9d0 2023-07-14T11:14:28.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.251+0000 7f797f7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f798006c9f0 0x7f79800b1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:28.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.251+0000 7f797f7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f798006c9f0 0x7f79800b1910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46200/0 (socket says 172.21.15.84:46200) 2023-07-14T11:14:28.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.251+0000 7f797f7fe700 1 -- 172.21.15.84:0/2703484864 learned_addr learned my addr 172.21.15.84:0/2703484864 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:28.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.252+0000 7f797ffff700 1 --2- 172.21.15.84:0/2703484864 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f798015d9d0 0x7f798006b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:28.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.252+0000 7f797f7fe700 1 -- 172.21.15.84:0/2703484864 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f798015d9d0 msgr2=0x7f798006b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:28.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.252+0000 7f797f7fe700 1 --2- 172.21.15.84:0/2703484864 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f798015d9d0 0x7f798006b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:28.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.252+0000 7f797f7fe700 1 -- 172.21.15.84:0/2703484864 >> v1:172.21.15.179:6789/0 conn(0x7f79800b1e50 legacy=0x7f7980071170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:28.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.252+0000 7f797f7fe700 1 -- 172.21.15.84:0/2703484864 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f798006c200 con 0x7f798006c9f0 2023-07-14T11:14:28.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.252+0000 7f797ffff700 1 --2- 172.21.15.84:0/2703484864 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f798015d9d0 0x7f798006b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:14:28.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.252+0000 7f797f7fe700 1 --2- 172.21.15.84:0/2703484864 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f798006c9f0 0x7f79800b1910 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f798006c6d0 tx=0x7f7974009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a63162e44fe3f991 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:28.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.252+0000 7f797effd700 1 -- 172.21.15.84:0/2703484864 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7974011830 con 0x7f798006c9f0 2023-07-14T11:14:28.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.252+0000 7f797effd700 1 -- 172.21.15.84:0/2703484864 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7974011990 con 0x7f798006c9f0 2023-07-14T11:14:28.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.252+0000 7f797effd700 1 -- 172.21.15.84:0/2703484864 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7974011d20 con 0x7f798006c9f0 2023-07-14T11:14:28.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.253+0000 7f79867ff700 1 -- 172.21.15.84:0/2703484864 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f798006c9f0 msgr2=0x7f79800b1910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:28.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.253+0000 7f79867ff700 1 --2- 172.21.15.84:0/2703484864 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f798006c9f0 0x7f79800b1910 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f798006c6d0 tx=0x7f7974009bd0 comp rx=0 tx=0).stop 2023-07-14T11:14:28.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.253+0000 7f79867ff700 1 -- 172.21.15.84:0/2703484864 shutdown_connections 2023-07-14T11:14:28.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.253+0000 7f79867ff700 1 --2- 172.21.15.84:0/2703484864 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f798015d9d0 0x7f798006b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:28.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.253+0000 7f79867ff700 1 --2- 172.21.15.84:0/2703484864 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f798006c9f0 0x7f79800b1910 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:28.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.253+0000 7f79867ff700 1 -- 172.21.15.84:0/2703484864 >> 172.21.15.84:0/2703484864 conn(0x7f79800b05d0 msgr2=0x7f79800b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:28.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.253+0000 7f79867ff700 1 -- 172.21.15.84:0/2703484864 shutdown_connections 2023-07-14T11:14:28.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.253+0000 7f79867ff700 1 -- 172.21.15.84:0/2703484864 wait complete. 2023-07-14T11:14:28.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.255+0000 7f79867ff700 1 Processor -- start 2023-07-14T11:14:28.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.255+0000 7f79867ff700 1 -- start start 2023-07-14T11:14:28.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.256+0000 7f79867ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f798006c9f0 0x7f79800c4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:28.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.256+0000 7f79867ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79800b1e50 0x7f7980152390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:28.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.256+0000 7f79867ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f798015d9d0 0x7f7980157cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:28.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.256+0000 7f79867ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79801e33a0 con 0x7f79800b1e50 2023-07-14T11:14:28.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.256+0000 7f79867ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79800c5520 con 0x7f798015d9d0 2023-07-14T11:14:28.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.256+0000 7f79867ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79800c3f10 con 0x7f798006c9f0 2023-07-14T11:14:28.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.256+0000 7f797f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79800b1e50 0x7f7980152390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:28.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.256+0000 7f797f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79800b1e50 0x7f7980152390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46212/0 (socket says 172.21.15.84:46212) 2023-07-14T11:14:28.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.256+0000 7f797f7fe700 1 -- 172.21.15.84:0/3007458606 learned_addr learned my addr 172.21.15.84:0/3007458606 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:28.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.256+0000 7f797ffff700 1 --2- 172.21.15.84:0/3007458606 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f798006c9f0 0x7f79800c4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:28.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.256+0000 7f7984d9c700 1 --2- 172.21.15.84:0/3007458606 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f798015d9d0 0x7f7980157cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:28.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.256+0000 7f797f7fe700 1 -- 172.21.15.84:0/3007458606 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f798006c9f0 msgr2=0x7f79800c4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:28.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.256+0000 7f797f7fe700 1 --2- 172.21.15.84:0/3007458606 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f798006c9f0 0x7f79800c4fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:28.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.256+0000 7f797f7fe700 1 -- 172.21.15.84:0/3007458606 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f798015d9d0 msgr2=0x7f7980157cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:28.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.256+0000 7f797f7fe700 1 --2- 172.21.15.84:0/3007458606 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f798015d9d0 0x7f7980157cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:28.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.256+0000 7f797f7fe700 1 -- 172.21.15.84:0/3007458606 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7974009550 con 0x7f79800b1e50 2023-07-14T11:14:28.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.256+0000 7f797f7fe700 1 --2- 172.21.15.84:0/3007458606 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79800b1e50 0x7f7980152390 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f7974013000 tx=0x7f7974004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:28.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.257+0000 7f797cff9700 1 -- 172.21.15.84:0/3007458606 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7974004400 con 0x7f79800b1e50 2023-07-14T11:14:28.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.257+0000 7f797cff9700 1 -- 172.21.15.84:0/3007458606 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f797401f070 con 0x7f79800b1e50 2023-07-14T11:14:28.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.257+0000 7f797cff9700 1 -- 172.21.15.84:0/3007458606 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79740038c0 con 0x7f79800b1e50 2023-07-14T11:14:28.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.257+0000 7f79867ff700 1 -- 172.21.15.84:0/3007458606 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79800c41f0 con 0x7f79800b1e50 2023-07-14T11:14:28.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.257+0000 7f79867ff700 1 -- 172.21.15.84:0/3007458606 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79801e2fc0 con 0x7f79800b1e50 2023-07-14T11:14:28.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.258+0000 7f79867ff700 1 -- 172.21.15.84:0/3007458606 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79801e34e0 con 0x7f79800b1e50 2023-07-14T11:14:28.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.259+0000 7f797cff9700 1 -- 172.21.15.84:0/3007458606 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7974021030 con 0x7f79800b1e50 2023-07-14T11:14:28.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.259+0000 7f797cff9700 1 --2- 172.21.15.84:0/3007458606 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f796c06ace0 0x7f796c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:28.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.260+0000 7f797cff9700 1 -- 172.21.15.84:0/3007458606 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f797408a5b0 con 0x7f79800b1e50 2023-07-14T11:14:28.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.260+0000 7f797ffff700 1 --2- 172.21.15.84:0/3007458606 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f796c06ace0 0x7f796c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:28.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.260+0000 7f797ffff700 1 --2- 172.21.15.84:0/3007458606 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f796c06ace0 0x7f796c06d190 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7970006fd0 tx=0x7f7970008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:28.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.264+0000 7f797cff9700 1 -- 172.21.15.84:0/3007458606 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f79801e34e0 con 0x7f79800b1e50 2023-07-14T11:14:28.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.538+0000 7f79867ff700 1 -- 172.21.15.84:0/3007458606 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f79801e34e0 con 0x7f79800b1e50 2023-07-14T11:14:28.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.544+0000 7f797cff9700 1 -- 172.21.15.84:0/3007458606 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v14) v1 ==== 90+0+0 (secure 0 0 0) 0x7f79801e34e0 con 0x7f79800b1e50 2023-07-14T11:14:28.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.546+0000 7f79867ff700 1 -- 172.21.15.84:0/3007458606 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f796c06ace0 msgr2=0x7f796c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:28.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.546+0000 7f79867ff700 1 --2- 172.21.15.84:0/3007458606 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f796c06ace0 0x7f796c06d190 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7970006fd0 tx=0x7f7970008040 comp rx=0 tx=0).stop 2023-07-14T11:14:28.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.546+0000 7f79867ff700 1 -- 172.21.15.84:0/3007458606 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79800b1e50 msgr2=0x7f7980152390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:28.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.546+0000 7f79867ff700 1 --2- 172.21.15.84:0/3007458606 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79800b1e50 0x7f7980152390 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f7974013000 tx=0x7f7974004750 comp rx=0 tx=0).stop 2023-07-14T11:14:28.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.547+0000 7f79867ff700 1 -- 172.21.15.84:0/3007458606 shutdown_connections 2023-07-14T11:14:28.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.547+0000 7f79867ff700 1 --2- 172.21.15.84:0/3007458606 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f796c06ace0 0x7f796c06d190 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:28.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.547+0000 7f79867ff700 1 --2- 172.21.15.84:0/3007458606 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f798006c9f0 0x7f79800c4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:28.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.547+0000 7f79867ff700 1 --2- 172.21.15.84:0/3007458606 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f798015d9d0 0x7f7980157cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:28.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.547+0000 7f79867ff700 1 --2- 172.21.15.84:0/3007458606 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79800b1e50 0x7f7980152390 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:28.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.547+0000 7f79867ff700 1 -- 172.21.15.84:0/3007458606 >> 172.21.15.84:0/3007458606 conn(0x7f79800b05d0 msgr2=0x7f79800ae540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:28.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.547+0000 7f79867ff700 1 -- 172.21.15.84:0/3007458606 shutdown_connections 2023-07-14T11:14:28.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.547+0000 7f79867ff700 1 -- 172.21.15.84:0/3007458606 wait complete. 2023-07-14T11:14:28.568 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:14:28.618 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-07-14T11:14:28.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.761+0000 7f096b9ff700 1 Processor -- start 2023-07-14T11:14:28.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.761+0000 7f096b9ff700 1 -- start start 2023-07-14T11:14:28.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.762+0000 7f096b9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09640b5d90 0x7f09640b6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:28.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.762+0000 7f096b9ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f09640d0b10 0x7f09640d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:28.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.762+0000 7f096b9ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09640b7f50 con 0x7f09640b4510 2023-07-14T11:14:28.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.762+0000 7f096b9ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09640b48e0 con 0x7f09640d0b10 2023-07-14T11:14:28.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.762+0000 7f096b9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09640d14d0 con 0x7f09640b5d90 2023-07-14T11:14:28.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.763+0000 7f0969f9c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f09640d0b10 0x7f09640d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:28.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.763+0000 7f0969f9c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f09640d0b10 0x7f09640d0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46228/0 (socket says 172.21.15.84:46228) 2023-07-14T11:14:28.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.763+0000 7f0969f9c700 1 -- 172.21.15.84:0/3270179304 learned_addr learned my addr 172.21.15.84:0/3270179304 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:28.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.763+0000 7f0968f9a700 1 --2- 172.21.15.84:0/3270179304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09640b5d90 0x7f09640b6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:28.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.763+0000 7f0969f9c700 1 -- 172.21.15.84:0/3270179304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09640b5d90 msgr2=0x7f09640b6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:28.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.763+0000 7f0969f9c700 1 --2- 172.21.15.84:0/3270179304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09640b5d90 0x7f09640b6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:28.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.763+0000 7f0969f9c700 1 -- 172.21.15.84:0/3270179304 >> v1:172.21.15.179:6789/0 conn(0x7f09640b4510 legacy=0x7f09640cd590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:28.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.763+0000 7f0969f9c700 1 -- 172.21.15.84:0/3270179304 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09640cdca0 con 0x7f09640d0b10 2023-07-14T11:14:28.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.763+0000 7f0969f9c700 1 --2- 172.21.15.84:0/3270179304 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09640d0b10 0x7f09640d0f90 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f095c009e50 tx=0x7f095c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50ad9c762940f576 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:28.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.764+0000 7f095bfff700 1 -- 172.21.15.84:0/3270179304 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f095c00e070 con 0x7f09640d0b10 2023-07-14T11:14:28.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.764+0000 7f095bfff700 1 -- 172.21.15.84:0/3270179304 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f095c00b910 con 0x7f09640d0b10 2023-07-14T11:14:28.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.764+0000 7f095bfff700 1 -- 172.21.15.84:0/3270179304 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f095c00bcc0 con 0x7f09640d0b10 2023-07-14T11:14:28.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.764+0000 7f096b9ff700 1 -- 172.21.15.84:0/3270179304 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09640d0b10 msgr2=0x7f09640d0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:28.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.764+0000 7f096b9ff700 1 --2- 172.21.15.84:0/3270179304 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09640d0b10 0x7f09640d0f90 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f095c009e50 tx=0x7f095c00b330 comp rx=0 tx=0).stop 2023-07-14T11:14:28.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.764+0000 7f096b9ff700 1 -- 172.21.15.84:0/3270179304 shutdown_connections 2023-07-14T11:14:28.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.764+0000 7f096b9ff700 1 --2- 172.21.15.84:0/3270179304 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09640d0b10 0x7f09640d0f90 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:28.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.764+0000 7f096b9ff700 1 --2- 172.21.15.84:0/3270179304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09640b5d90 0x7f09640b6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:28.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.764+0000 7f096b9ff700 1 -- 172.21.15.84:0/3270179304 >> 172.21.15.84:0/3270179304 conn(0x7f096409c1d0 msgr2=0x7f09640d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:28.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.764+0000 7f096b9ff700 1 -- 172.21.15.84:0/3270179304 shutdown_connections 2023-07-14T11:14:28.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.764+0000 7f096b9ff700 1 -- 172.21.15.84:0/3270179304 wait complete. 2023-07-14T11:14:28.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.766+0000 7f096b9ff700 1 Processor -- start 2023-07-14T11:14:28.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.766+0000 7f096b9ff700 1 -- start start 2023-07-14T11:14:28.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.767+0000 7f096b9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09640b4510 0x7f09640c7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:28.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.767+0000 7f096b9ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09640b5d90 0x7f0964151d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:28.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.767+0000 7f096b9ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09640d0b10 0x7f096415e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:28.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.767+0000 7f096b9ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0964152860 con 0x7f09640b5d90 2023-07-14T11:14:28.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.767+0000 7f096b9ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09640c79c0 con 0x7f09640d0b10 2023-07-14T11:14:28.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.767+0000 7f096b9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09641f2c30 con 0x7f09640b4510 2023-07-14T11:14:28.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.767+0000 7f0968f9a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09640b5d90 0x7f0964151d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:28.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.767+0000 7f0968f9a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09640b5d90 0x7f0964151d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46230/0 (socket says 172.21.15.84:46230) 2023-07-14T11:14:28.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.767+0000 7f0968f9a700 1 -- 172.21.15.84:0/789487039 learned_addr learned my addr 172.21.15.84:0/789487039 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:28.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.768+0000 7f0969f9c700 1 --2- 172.21.15.84:0/789487039 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09640d0b10 0x7f096415e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:28.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.768+0000 7f096979b700 1 --2- 172.21.15.84:0/789487039 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09640b4510 0x7f09640c7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:28.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.768+0000 7f0968f9a700 1 -- 172.21.15.84:0/789487039 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09640b4510 msgr2=0x7f09640c7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:28.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.768+0000 7f0968f9a700 1 --2- 172.21.15.84:0/789487039 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09640b4510 0x7f09640c7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:28.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.768+0000 7f0968f9a700 1 -- 172.21.15.84:0/789487039 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09640d0b10 msgr2=0x7f096415e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:28.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.768+0000 7f0968f9a700 1 --2- 172.21.15.84:0/789487039 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09640d0b10 0x7f096415e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:28.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.768+0000 7f0968f9a700 1 -- 172.21.15.84:0/789487039 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f095c009b30 con 0x7f09640b5d90 2023-07-14T11:14:28.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.768+0000 7f096979b700 1 --2- 172.21.15.84:0/789487039 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09640b4510 0x7f09640c7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:14:28.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.768+0000 7f0968f9a700 1 --2- 172.21.15.84:0/789487039 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09640b5d90 0x7f0964151d50 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f095400e9b0 tx=0x7f095400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:28.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.768+0000 7f0959ffb700 1 -- 172.21.15.84:0/789487039 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0954009710 con 0x7f09640b5d90 2023-07-14T11:14:28.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.768+0000 7f0959ffb700 1 -- 172.21.15.84:0/789487039 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f095400c850 con 0x7f09640b5d90 2023-07-14T11:14:28.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.768+0000 7f0959ffb700 1 -- 172.21.15.84:0/789487039 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f095400cbc0 con 0x7f09640b5d90 2023-07-14T11:14:28.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.768+0000 7f096b9ff700 1 -- 172.21.15.84:0/789487039 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09641f2f10 con 0x7f09640b5d90 2023-07-14T11:14:28.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.769+0000 7f096b9ff700 1 -- 172.21.15.84:0/789487039 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09641f34d0 con 0x7f09640b5d90 2023-07-14T11:14:28.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.769+0000 7f096b9ff700 1 -- 172.21.15.84:0/789487039 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f096404e280 con 0x7f09640b5d90 2023-07-14T11:14:28.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.770+0000 7f0959ffb700 1 -- 172.21.15.84:0/789487039 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f095400cd20 con 0x7f09640b5d90 2023-07-14T11:14:28.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.771+0000 7f0959ffb700 1 --2- 172.21.15.84:0/789487039 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f094806ace0 0x7f094806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:28.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.771+0000 7f0959ffb700 1 -- 172.21.15.84:0/789487039 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f09540892c0 con 0x7f09640b5d90 2023-07-14T11:14:28.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.772+0000 7f096979b700 1 --2- 172.21.15.84:0/789487039 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f094806ace0 0x7f094806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:28.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.772+0000 7f096979b700 1 --2- 172.21.15.84:0/789487039 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f094806ace0 0x7f094806d190 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0960000fb0 tx=0x7f0960009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:28.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.775+0000 7f0959ffb700 1 -- 172.21.15.84:0/789487039 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f0954054620 con 0x7f09640b5d90 2023-07-14T11:14:28.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.972+0000 7f096b9ff700 1 -- 172.21.15.84:0/789487039 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f09640b8c50 con 0x7f09640b5d90 2023-07-14T11:14:28.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.973+0000 7f0959ffb700 1 -- 172.21.15.84:0/789487039 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+14615 (secure 0 0 0) 0x7f0954057c40 con 0x7f09640b5d90 2023-07-14T11:14:28.976 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:14:28.976 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":33,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:14:24.954881+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:14:28.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.975+0000 7f096b9ff700 1 -- 172.21.15.84:0/789487039 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f094806ace0 msgr2=0x7f094806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:28.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.975+0000 7f096b9ff700 1 --2- 172.21.15.84:0/789487039 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f094806ace0 0x7f094806d190 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0960000fb0 tx=0x7f0960009040 comp rx=0 tx=0).stop 2023-07-14T11:14:28.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.975+0000 7f096b9ff700 1 -- 172.21.15.84:0/789487039 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09640b5d90 msgr2=0x7f0964151d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:28.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.975+0000 7f096b9ff700 1 --2- 172.21.15.84:0/789487039 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09640b5d90 0x7f0964151d50 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f095400e9b0 tx=0x7f095400ecc0 comp rx=0 tx=0).stop 2023-07-14T11:14:28.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.975+0000 7f096b9ff700 1 -- 172.21.15.84:0/789487039 shutdown_connections 2023-07-14T11:14:28.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.975+0000 7f096b9ff700 1 --2- 172.21.15.84:0/789487039 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f094806ace0 0x7f094806d190 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:28.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.975+0000 7f096b9ff700 1 --2- 172.21.15.84:0/789487039 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09640b4510 0x7f09640c7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:28.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.975+0000 7f096b9ff700 1 --2- 172.21.15.84:0/789487039 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09640d0b10 0x7f096415e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:28.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.975+0000 7f096b9ff700 1 --2- 172.21.15.84:0/789487039 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09640b5d90 0x7f0964151d50 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:28.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.975+0000 7f096b9ff700 1 -- 172.21.15.84:0/789487039 >> 172.21.15.84:0/789487039 conn(0x7f096409c1d0 msgr2=0x7f09640ce250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:28.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.975+0000 7f096b9ff700 1 -- 172.21.15.84:0/789487039 shutdown_connections 2023-07-14T11:14:28.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:28.976+0000 7f096b9ff700 1 -- 172.21.15.84:0/789487039 wait complete. 2023-07-14T11:14:28.997 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T11:13:00.125395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T11:13:06.803994+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T11:14:28.997 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T11:14:29.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.194+0000 7f48ee5ff700 1 Processor -- start 2023-07-14T11:14:29.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.195+0000 7f48ee5ff700 1 -- start start 2023-07-14T11:14:29.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.196+0000 7f48ee5ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f48e80b4860 0x7f48e80b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:29.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.196+0000 7f48ee5ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48e80d02a0 con 0x7f48e80d12c0 2023-07-14T11:14:29.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.196+0000 7f48ee5ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48e80cfce0 con 0x7f48e80b8660 2023-07-14T11:14:29.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.196+0000 7f48ee5ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48e80b5240 con 0x7f48e80b4860 2023-07-14T11:14:29.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.196+0000 7f48ecb9c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f48e80d12c0 0x7f48e80d16e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:47052/0 (socket says 172.21.15.84:47052) 2023-07-14T11:14:29.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.196+0000 7f48ecb9c700 1 -- 172.21.15.84:0/3419885421 learned_addr learned my addr 172.21.15.84:0/3419885421 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:14:29.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.196+0000 7f48dffff700 1 --2- 172.21.15.84:0/3419885421 >> v2:172.21.15.84:3300/0 conn(0x7f48e80b4860 0x7f48e80b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:29.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.196+0000 7f48e77fe700 1 -- 172.21.15.84:0/3419885421 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 44461656 0 0) 0x7f48e80d02a0 con 0x7f48e80d12c0 2023-07-14T11:14:29.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.196+0000 7f48e77fe700 1 -- 172.21.15.84:0/3419885421 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48d40035b0 con 0x7f48e80d12c0 2023-07-14T11:14:29.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.197+0000 7f48dffff700 1 -- 172.21.15.84:0/3419885421 >> v1:172.21.15.179:6789/0 conn(0x7f48e80b8660 legacy=0x7f48e80cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:29.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.197+0000 7f48e77fe700 1 -- 172.21.15.84:0/3419885421 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2760400316 0 0) 0x7f48e80cfce0 con 0x7f48e80b8660 2023-07-14T11:14:29.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.197+0000 7f48dffff700 1 -- 172.21.15.84:0/3419885421 >> v1:172.21.15.84:6789/0 conn(0x7f48e80d12c0 legacy=0x7f48e80d16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:29.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.197+0000 7f48dffff700 1 -- 172.21.15.84:0/3419885421 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48e80cffc0 con 0x7f48e80b4860 2023-07-14T11:14:29.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.197+0000 7f48dffff700 1 --2- 172.21.15.84:0/3419885421 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48e80b4860 0x7f48e80b4d00 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f48d0009840 tx=0x7f48d0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90ba269d1793e061 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:29.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.197+0000 7f48e77fe700 1 -- 172.21.15.84:0/3419885421 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d0011830 con 0x7f48e80b4860 2023-07-14T11:14:29.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.197+0000 7f48e77fe700 1 -- 172.21.15.84:0/3419885421 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d0011990 con 0x7f48e80b4860 2023-07-14T11:14:29.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.197+0000 7f48e77fe700 1 -- 172.21.15.84:0/3419885421 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d0011d20 con 0x7f48e80b4860 2023-07-14T11:14:29.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.198+0000 7f48ee5ff700 1 -- 172.21.15.84:0/3419885421 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48e80b4860 msgr2=0x7f48e80b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:29.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.198+0000 7f48ee5ff700 1 --2- 172.21.15.84:0/3419885421 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48e80b4860 0x7f48e80b4d00 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f48d0009840 tx=0x7f48d0009b50 comp rx=0 tx=0).stop 2023-07-14T11:14:29.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.198+0000 7f48ee5ff700 1 -- 172.21.15.84:0/3419885421 shutdown_connections 2023-07-14T11:14:29.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.198+0000 7f48ee5ff700 1 --2- 172.21.15.84:0/3419885421 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48e80b4860 0x7f48e80b4d00 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:29.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.198+0000 7f48ee5ff700 1 -- 172.21.15.84:0/3419885421 >> 172.21.15.84:0/3419885421 conn(0x7f48e8066860 msgr2=0x7f48e806a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:29.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.198+0000 7f48ee5ff700 1 -- 172.21.15.84:0/3419885421 shutdown_connections 2023-07-14T11:14:29.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.198+0000 7f48ee5ff700 1 -- 172.21.15.84:0/3419885421 wait complete. 2023-07-14T11:14:29.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.199+0000 7f48ee5ff700 1 Processor -- start 2023-07-14T11:14:29.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.200+0000 7f48ee5ff700 1 -- start start 2023-07-14T11:14:29.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.200+0000 7f48ee5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48e80b4860 0x7f48e81f1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:29.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.200+0000 7f48ee5ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48e80b8660 0x7f48e81f5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:29.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.200+0000 7f48ee5ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48e80d12c0 0x7f48e81f5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:29.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.200+0000 7f48ee5ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e80c9eb0 con 0x7f48e80d12c0 2023-07-14T11:14:29.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.200+0000 7f48ee5ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e81f1c60 con 0x7f48e80b8660 2023-07-14T11:14:29.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.200+0000 7f48ee5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48e80c9460 con 0x7f48e80b4860 2023-07-14T11:14:29.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.201+0000 7f48ecb9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48e80d12c0 0x7f48e81f5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:29.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.201+0000 7f48ecb9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48e80d12c0 0x7f48e81f5870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34144/0 (socket says 172.21.15.84:34144) 2023-07-14T11:14:29.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.201+0000 7f48ecb9c700 1 -- 172.21.15.84:0/2968639665 learned_addr learned my addr 172.21.15.84:0/2968639665 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:29.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.201+0000 7f48e7fff700 1 --2- 172.21.15.84:0/2968639665 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48e80b4860 0x7f48e81f1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:29.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.201+0000 7f48dffff700 1 --2- 172.21.15.84:0/2968639665 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48e80b8660 0x7f48e81f5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:29.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.201+0000 7f48ecb9c700 1 -- 172.21.15.84:0/2968639665 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48e80b4860 msgr2=0x7f48e81f1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:29.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.201+0000 7f48ecb9c700 1 --2- 172.21.15.84:0/2968639665 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48e80b4860 0x7f48e81f1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:29.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.201+0000 7f48ecb9c700 1 -- 172.21.15.84:0/2968639665 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48e80b8660 msgr2=0x7f48e81f5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:29.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.201+0000 7f48ecb9c700 1 --2- 172.21.15.84:0/2968639665 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48e80b8660 0x7f48e81f5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:29.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.201+0000 7f48ecb9c700 1 -- 172.21.15.84:0/2968639665 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48d00094a0 con 0x7f48e80d12c0 2023-07-14T11:14:29.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.201+0000 7f48ecb9c700 1 --2- 172.21.15.84:0/2968639665 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48e80d12c0 0x7f48e81f5870 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f48e000cad0 tx=0x7f48e000ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:29.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.201+0000 7f48e57fa700 1 -- 172.21.15.84:0/2968639665 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e000aac0 con 0x7f48e80d12c0 2023-07-14T11:14:29.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.202+0000 7f48e57fa700 1 -- 172.21.15.84:0/2968639665 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48e000ac20 con 0x7f48e80d12c0 2023-07-14T11:14:29.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.202+0000 7f48e57fa700 1 -- 172.21.15.84:0/2968639665 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e0012400 con 0x7f48e80d12c0 2023-07-14T11:14:29.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.202+0000 7f48ee5ff700 1 -- 172.21.15.84:0/2968639665 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48e80ca100 con 0x7f48e80d12c0 2023-07-14T11:14:29.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.202+0000 7f48ee5ff700 1 -- 172.21.15.84:0/2968639665 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48e80ca6c0 con 0x7f48e80d12c0 2023-07-14T11:14:29.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.203+0000 7f48ee5ff700 1 -- 172.21.15.84:0/2968639665 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48e80ca8b0 con 0x7f48e80d12c0 2023-07-14T11:14:29.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.204+0000 7f48e57fa700 1 -- 172.21.15.84:0/2968639665 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f48e001b3b0 con 0x7f48e80d12c0 2023-07-14T11:14:29.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.205+0000 7f48e57fa700 1 --2- 172.21.15.84:0/2968639665 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f48c806ace0 0x7f48c806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:29.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.205+0000 7f48e57fa700 1 -- 172.21.15.84:0/2968639665 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f48e0088e60 con 0x7f48e80d12c0 2023-07-14T11:14:29.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.205+0000 7f48e7fff700 1 --2- 172.21.15.84:0/2968639665 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f48c806ace0 0x7f48c806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:29.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.205+0000 7f48e7fff700 1 --2- 172.21.15.84:0/2968639665 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f48c806ace0 0x7f48c806d190 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f48d8000f60 tx=0x7f48d8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:29.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.209+0000 7f48e57fa700 1 -- 172.21.15.84:0/2968639665 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f48e00542f0 con 0x7f48e80d12c0 2023-07-14T11:14:29.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.404+0000 7f48ee5ff700 1 -- 172.21.15.84:0/2968639665 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f48e8074350 con 0x7f48e80d12c0 2023-07-14T11:14:29.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.405+0000 7f48e57fa700 1 -- 172.21.15.84:0/2968639665 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v33) v1 ==== 93+0+10 (secure 0 0 0) 0x7f48e00170a0 con 0x7f48e80d12c0 2023-07-14T11:14:29.408 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-07-14T11:14:29.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.408+0000 7f48ee5ff700 1 -- 172.21.15.84:0/2968639665 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f48c806ace0 msgr2=0x7f48c806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:29.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.408+0000 7f48ee5ff700 1 --2- 172.21.15.84:0/2968639665 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f48c806ace0 0x7f48c806d190 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f48d8000f60 tx=0x7f48d8009040 comp rx=0 tx=0).stop 2023-07-14T11:14:29.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.408+0000 7f48ee5ff700 1 -- 172.21.15.84:0/2968639665 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48e80d12c0 msgr2=0x7f48e81f5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:29.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.408+0000 7f48ee5ff700 1 --2- 172.21.15.84:0/2968639665 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48e80d12c0 0x7f48e81f5870 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f48e000cad0 tx=0x7f48e000ce90 comp rx=0 tx=0).stop 2023-07-14T11:14:29.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.408+0000 7f48ee5ff700 1 -- 172.21.15.84:0/2968639665 shutdown_connections 2023-07-14T11:14:29.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.408+0000 7f48ee5ff700 1 --2- 172.21.15.84:0/2968639665 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f48c806ace0 0x7f48c806d190 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:29.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.408+0000 7f48ee5ff700 1 --2- 172.21.15.84:0/2968639665 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48e80b4860 0x7f48e81f1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:29.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.408+0000 7f48ee5ff700 1 --2- 172.21.15.84:0/2968639665 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48e80d12c0 0x7f48e81f5870 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:29.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.408+0000 7f48ee5ff700 1 --2- 172.21.15.84:0/2968639665 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48e80b8660 0x7f48e81f5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:29.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.408+0000 7f48ee5ff700 1 -- 172.21.15.84:0/2968639665 >> 172.21.15.84:0/2968639665 conn(0x7f48e8066860 msgr2=0x7f48e80b6aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:29.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.408+0000 7f48ee5ff700 1 -- 172.21.15.84:0/2968639665 shutdown_connections 2023-07-14T11:14:29.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.408+0000 7f48ee5ff700 1 -- 172.21.15.84:0/2968639665 wait complete. 2023-07-14T11:14:29.428 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T11:14:29.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.624+0000 7f60e27ff700 1 Processor -- start 2023-07-14T11:14:29.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.624+0000 7f60e27ff700 1 -- start start 2023-07-14T11:14:29.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.624+0000 7f60e27ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f60dc0b8a60 0x7f60dc0b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:29.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.624+0000 7f60e27ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60dc0b8e30 con 0x7f60dc0d1220 2023-07-14T11:14:29.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.624+0000 7f60e27ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60dc0afaa0 con 0x7f60dc0b4530 2023-07-14T11:14:29.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.624+0000 7f60e27ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60dc0afd80 con 0x7f60dc0b8a60 2023-07-14T11:14:29.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.624+0000 7f60e0d9c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f60dc0d1220 0x7f60dc0b0e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:47054/0 (socket says 172.21.15.84:47054) 2023-07-14T11:14:29.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.624+0000 7f60e0d9c700 1 -- 172.21.15.84:0/213847246 learned_addr learned my addr 172.21.15.84:0/213847246 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:14:29.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.625+0000 7f60dbfff700 1 --2- 172.21.15.84:0/213847246 >> v2:172.21.15.179:3300/0 conn(0x7f60dc0b8a60 0x7f60dc0b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:29.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.625+0000 7f60daffd700 1 -- 172.21.15.84:0/213847246 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1560138993 0 0) 0x7f60dc0b8e30 con 0x7f60dc0d1220 2023-07-14T11:14:29.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.625+0000 7f60daffd700 1 -- 172.21.15.84:0/213847246 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60c40035b0 con 0x7f60dc0d1220 2023-07-14T11:14:29.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.625+0000 7f60dbfff700 1 -- 172.21.15.84:0/213847246 >> v1:172.21.15.179:6789/0 conn(0x7f60dc0b4530 legacy=0x7f60dc0d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:29.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.625+0000 7f60dbfff700 1 -- 172.21.15.84:0/213847246 >> v1:172.21.15.84:6789/0 conn(0x7f60dc0d1220 legacy=0x7f60dc0b0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:29.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.625+0000 7f60dbfff700 1 -- 172.21.15.84:0/213847246 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60dc0b0060 con 0x7f60dc0b8a60 2023-07-14T11:14:29.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.625+0000 7f60dbfff700 1 --2- 172.21.15.84:0/213847246 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60dc0b8a60 0x7f60dc0b3ff0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f60cc009840 tx=0x7f60cc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6544d2257d9bbb0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:29.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.626+0000 7f60daffd700 1 -- 172.21.15.84:0/213847246 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60cc011830 con 0x7f60dc0b8a60 2023-07-14T11:14:29.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.626+0000 7f60daffd700 1 -- 172.21.15.84:0/213847246 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60cc011990 con 0x7f60dc0b8a60 2023-07-14T11:14:29.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.626+0000 7f60daffd700 1 -- 172.21.15.84:0/213847246 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60cc011d20 con 0x7f60dc0b8a60 2023-07-14T11:14:29.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.626+0000 7f60e27ff700 1 -- 172.21.15.84:0/213847246 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60dc0b8a60 msgr2=0x7f60dc0b3ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:29.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.626+0000 7f60e27ff700 1 --2- 172.21.15.84:0/213847246 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60dc0b8a60 0x7f60dc0b3ff0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f60cc009840 tx=0x7f60cc009b50 comp rx=0 tx=0).stop 2023-07-14T11:14:29.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.626+0000 7f60e27ff700 1 -- 172.21.15.84:0/213847246 shutdown_connections 2023-07-14T11:14:29.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.626+0000 7f60e27ff700 1 --2- 172.21.15.84:0/213847246 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60dc0b8a60 0x7f60dc0b3ff0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:29.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.626+0000 7f60e27ff700 1 -- 172.21.15.84:0/213847246 >> 172.21.15.84:0/213847246 conn(0x7f60dc09c1b0 msgr2=0x7f60dc0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:29.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.626+0000 7f60e27ff700 1 -- 172.21.15.84:0/213847246 shutdown_connections 2023-07-14T11:14:29.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.626+0000 7f60e27ff700 1 -- 172.21.15.84:0/213847246 wait complete. 2023-07-14T11:14:29.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.628+0000 7f60e27ff700 1 Processor -- start 2023-07-14T11:14:29.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.628+0000 7f60e27ff700 1 -- start start 2023-07-14T11:14:29.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.629+0000 7f60e27ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60dc0b4530 0x7f60dc15cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:29.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.629+0000 7f60e27ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60dc0b8a60 0x7f60dc0cf990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:29.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.629+0000 7f60e27ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60dc0d1220 0x7f60dc0cc370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:29.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.629+0000 7f60e27ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60dc0cb640 con 0x7f60dc0b8a60 2023-07-14T11:14:29.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.629+0000 7f60e27ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60dc0cb0c0 con 0x7f60dc0b4530 2023-07-14T11:14:29.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.629+0000 7f60e27ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60dc0cb890 con 0x7f60dc0d1220 2023-07-14T11:14:29.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.629+0000 7f60db7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60dc0b8a60 0x7f60dc0cf990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:29.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.629+0000 7f60db7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60dc0b8a60 0x7f60dc0cf990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34156/0 (socket says 172.21.15.84:34156) 2023-07-14T11:14:29.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.629+0000 7f60db7fe700 1 -- 172.21.15.84:0/3084482144 learned_addr learned my addr 172.21.15.84:0/3084482144 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:29.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.630+0000 7f60dbfff700 1 --2- 172.21.15.84:0/3084482144 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60dc0b4530 0x7f60dc15cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:29.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.630+0000 7f60e0d9c700 1 --2- 172.21.15.84:0/3084482144 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60dc0d1220 0x7f60dc0cc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:29.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.630+0000 7f60db7fe700 1 -- 172.21.15.84:0/3084482144 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60dc0d1220 msgr2=0x7f60dc0cc370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:29.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.630+0000 7f60db7fe700 1 --2- 172.21.15.84:0/3084482144 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60dc0d1220 0x7f60dc0cc370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:29.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.630+0000 7f60db7fe700 1 -- 172.21.15.84:0/3084482144 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60dc0b4530 msgr2=0x7f60dc15cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:29.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.630+0000 7f60db7fe700 1 --2- 172.21.15.84:0/3084482144 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60dc0b4530 0x7f60dc15cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:29.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.630+0000 7f60db7fe700 1 -- 172.21.15.84:0/3084482144 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60cc0094a0 con 0x7f60dc0b8a60 2023-07-14T11:14:29.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.630+0000 7f60dbfff700 1 --2- 172.21.15.84:0/3084482144 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60dc0b4530 0x7f60dc15cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:14:29.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.630+0000 7f60db7fe700 1 --2- 172.21.15.84:0/3084482144 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60dc0b8a60 0x7f60dc0cf990 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f60d000c4e0 tx=0x7f60d000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:29.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.630+0000 7f60d8ff9700 1 -- 172.21.15.84:0/3084482144 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d00052d0 con 0x7f60dc0b8a60 2023-07-14T11:14:29.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.630+0000 7f60d8ff9700 1 -- 172.21.15.84:0/3084482144 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60d0005430 con 0x7f60dc0b8a60 2023-07-14T11:14:29.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.630+0000 7f60d8ff9700 1 -- 172.21.15.84:0/3084482144 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d00038c0 con 0x7f60dc0b8a60 2023-07-14T11:14:29.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.630+0000 7f60e27ff700 1 -- 172.21.15.84:0/3084482144 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60dc0cbb70 con 0x7f60dc0b8a60 2023-07-14T11:14:29.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.630+0000 7f60e27ff700 1 -- 172.21.15.84:0/3084482144 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60dc15d2f0 con 0x7f60dc0b8a60 2023-07-14T11:14:29.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.632+0000 7f60e27ff700 1 -- 172.21.15.84:0/3084482144 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60dc0cc090 con 0x7f60dc0b8a60 2023-07-14T11:14:29.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.633+0000 7f60d8ff9700 1 -- 172.21.15.84:0/3084482144 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f60d0003a20 con 0x7f60dc0b8a60 2023-07-14T11:14:29.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.633+0000 7f60d8ff9700 1 --2- 172.21.15.84:0/3084482144 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f60c806ace0 0x7f60c806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:29.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.633+0000 7f60d8ff9700 1 -- 172.21.15.84:0/3084482144 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f60d0088650 con 0x7f60dc0b8a60 2023-07-14T11:14:29.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.634+0000 7f60dbfff700 1 --2- 172.21.15.84:0/3084482144 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f60c806ace0 0x7f60c806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:29.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.634+0000 7f60dbfff700 1 --2- 172.21.15.84:0/3084482144 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f60c806ace0 0x7f60c806d190 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f60cc0090b0 tx=0x7f60cc008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:29.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.639+0000 7f60d8ff9700 1 -- 172.21.15.84:0/3084482144 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f60dc0cc090 con 0x7f60dc0b8a60 2023-07-14T11:14:29.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.829+0000 7f60e27ff700 1 -- 172.21.15.84:0/3084482144 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f60dc0cc090 con 0x7f60dc0b8a60 2023-07-14T11:14:29.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.829+0000 7f60d8ff9700 1 -- 172.21.15.84:0/3084482144 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v33) v1 ==== 92+0+10 (secure 0 0 0) 0x7f60dc0cc090 con 0x7f60dc0b8a60 2023-07-14T11:14:29.833 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-07-14T11:14:29.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.831+0000 7f60e27ff700 1 -- 172.21.15.84:0/3084482144 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f60c806ace0 msgr2=0x7f60c806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:29.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.831+0000 7f60e27ff700 1 --2- 172.21.15.84:0/3084482144 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f60c806ace0 0x7f60c806d190 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f60cc0090b0 tx=0x7f60cc008030 comp rx=0 tx=0).stop 2023-07-14T11:14:29.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.831+0000 7f60e27ff700 1 -- 172.21.15.84:0/3084482144 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60dc0b8a60 msgr2=0x7f60dc0cf990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:29.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.831+0000 7f60e27ff700 1 --2- 172.21.15.84:0/3084482144 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60dc0b8a60 0x7f60dc0cf990 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f60d000c4e0 tx=0x7f60d000c8a0 comp rx=0 tx=0).stop 2023-07-14T11:14:29.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.831+0000 7f60e27ff700 1 -- 172.21.15.84:0/3084482144 shutdown_connections 2023-07-14T11:14:29.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.831+0000 7f60e27ff700 1 --2- 172.21.15.84:0/3084482144 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f60c806ace0 0x7f60c806d190 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:29.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.831+0000 7f60e27ff700 1 --2- 172.21.15.84:0/3084482144 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60dc0d1220 0x7f60dc0cc370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:29.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.831+0000 7f60e27ff700 1 --2- 172.21.15.84:0/3084482144 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60dc0b4530 0x7f60dc15cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:29.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.831+0000 7f60e27ff700 1 --2- 172.21.15.84:0/3084482144 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60dc0b8a60 0x7f60dc0cf990 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:29.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.831+0000 7f60e27ff700 1 -- 172.21.15.84:0/3084482144 >> 172.21.15.84:0/3084482144 conn(0x7f60dc09c1b0 msgr2=0x7f60dc0b25b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:29.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.832+0000 7f60e27ff700 1 -- 172.21.15.84:0/3084482144 shutdown_connections 2023-07-14T11:14:29.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:29.832+0000 7f60e27ff700 1 -- 172.21.15.84:0/3084482144 wait complete. 2023-07-14T11:14:29.853 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-14T11:14:30.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.048+0000 7fe7ddfff700 1 Processor -- start 2023-07-14T11:14:30.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.048+0000 7fe7ddfff700 1 -- start start 2023-07-14T11:14:30.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.049+0000 7fe7ddfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7d815c950 0x7fe7d80b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:30.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.049+0000 7fe7ddfff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7d80d2ce0 con 0x7fe7d80b1e00 2023-07-14T11:14:30.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.049+0000 7fe7ddfff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7d80b3350 con 0x7fe7d80d1220 2023-07-14T11:14:30.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.049+0000 7fe7ddfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d80b3630 con 0x7fe7d815c950 2023-07-14T11:14:30.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.049+0000 7fe7d77fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7d815c950 0x7fe7d80b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:30.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.049+0000 7fe7d6ffd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fe7d80b1e00 0x7fe7d80d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:47068/0 (socket says 172.21.15.84:47068) 2023-07-14T11:14:30.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.049+0000 7fe7d6ffd700 1 -- 172.21.15.84:0/1109188157 learned_addr learned my addr 172.21.15.84:0/1109188157 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:14:30.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.051+0000 7fe7d67fc700 1 -- 172.21.15.84:0/1109188157 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 233316674 0 0) 0x7fe7d80d2ce0 con 0x7fe7d80b1e00 2023-07-14T11:14:30.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.051+0000 7fe7d67fc700 1 -- 172.21.15.84:0/1109188157 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7c00035b0 con 0x7fe7d80b1e00 2023-07-14T11:14:30.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.051+0000 7fe7d67fc700 1 -- 172.21.15.84:0/1109188157 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2366662071 0 0) 0x7fe7d80b3350 con 0x7fe7d80d1220 2023-07-14T11:14:30.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.051+0000 7fe7d77fe700 1 -- 172.21.15.84:0/1109188157 >> v1:172.21.15.179:6789/0 conn(0x7fe7d80d1220 legacy=0x7fe7d80afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:30.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.051+0000 7fe7d77fe700 1 -- 172.21.15.84:0/1109188157 >> v1:172.21.15.84:6789/0 conn(0x7fe7d80b1e00 legacy=0x7fe7d80d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:30.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.051+0000 7fe7d77fe700 1 -- 172.21.15.84:0/1109188157 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7d80b3910 con 0x7fe7d815c950 2023-07-14T11:14:30.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.051+0000 7fe7d77fe700 1 --2- 172.21.15.84:0/1109188157 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7d815c950 0x7fe7d80b43f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe7c8009850 tx=0x7fe7c8009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ebc899b5cebc139 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:30.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.051+0000 7fe7d67fc700 1 -- 172.21.15.84:0/1109188157 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c8005e30 con 0x7fe7d815c950 2023-07-14T11:14:30.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.052+0000 7fe7d67fc700 1 -- 172.21.15.84:0/1109188157 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7c8006030 con 0x7fe7d815c950 2023-07-14T11:14:30.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.052+0000 7fe7d67fc700 1 -- 172.21.15.84:0/1109188157 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c80063e0 con 0x7fe7d815c950 2023-07-14T11:14:30.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.052+0000 7fe7ddfff700 1 -- 172.21.15.84:0/1109188157 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7d815c950 msgr2=0x7fe7d80b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:30.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.052+0000 7fe7ddfff700 1 --2- 172.21.15.84:0/1109188157 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7d815c950 0x7fe7d80b43f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe7c8009850 tx=0x7fe7c8009b60 comp rx=0 tx=0).stop 2023-07-14T11:14:30.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.052+0000 7fe7ddfff700 1 -- 172.21.15.84:0/1109188157 shutdown_connections 2023-07-14T11:14:30.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.052+0000 7fe7ddfff700 1 --2- 172.21.15.84:0/1109188157 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7d815c950 0x7fe7d80b43f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:30.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.052+0000 7fe7ddfff700 1 -- 172.21.15.84:0/1109188157 >> 172.21.15.84:0/1109188157 conn(0x7fe7d809c1d0 msgr2=0x7fe7d80d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:30.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.052+0000 7fe7ddfff700 1 -- 172.21.15.84:0/1109188157 shutdown_connections 2023-07-14T11:14:30.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.052+0000 7fe7ddfff700 1 -- 172.21.15.84:0/1109188157 wait complete. 2023-07-14T11:14:30.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.053+0000 7fe7ddfff700 1 Processor -- start 2023-07-14T11:14:30.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.053+0000 7fe7ddfff700 1 -- start start 2023-07-14T11:14:30.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.054+0000 7fe7ddfff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7d80b1e00 0x7fe7d81f5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:30.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.054+0000 7fe7ddfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7d80d1220 0x7fe7d80b87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:30.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.054+0000 7fe7ddfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7d815c950 0x7fe7d8157640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:30.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.054+0000 7fe7ddfff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d81f7380 con 0x7fe7d815c950 2023-07-14T11:14:30.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.054+0000 7fe7ddfff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d80b8d10 con 0x7fe7d80b1e00 2023-07-14T11:14:30.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.054+0000 7fe7ddfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d8157b80 con 0x7fe7d80d1220 2023-07-14T11:14:30.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.054+0000 7fe7d7fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7d815c950 0x7fe7d8157640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:30.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.054+0000 7fe7d7fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7d815c950 0x7fe7d8157640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34166/0 (socket says 172.21.15.84:34166) 2023-07-14T11:14:30.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.054+0000 7fe7d7fff700 1 -- 172.21.15.84:0/405545591 learned_addr learned my addr 172.21.15.84:0/405545591 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:30.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.055+0000 7fe7d7fff700 1 -- 172.21.15.84:0/405545591 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7d80d1220 msgr2=0x7fe7d80b87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:30.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.055+0000 7fe7d6ffd700 1 --2- 172.21.15.84:0/405545591 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7d80d1220 0x7fe7d80b87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:30.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.055+0000 7fe7d77fe700 1 --2- 172.21.15.84:0/405545591 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7d80b1e00 0x7fe7d81f5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:30.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.055+0000 7fe7d7fff700 1 --2- 172.21.15.84:0/405545591 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7d80d1220 0x7fe7d80b87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:30.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.055+0000 7fe7d7fff700 1 -- 172.21.15.84:0/405545591 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7d80b1e00 msgr2=0x7fe7d81f5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:30.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.055+0000 7fe7d7fff700 1 --2- 172.21.15.84:0/405545591 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7d80b1e00 0x7fe7d81f5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:30.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.055+0000 7fe7d7fff700 1 -- 172.21.15.84:0/405545591 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7c8009430 con 0x7fe7d815c950 2023-07-14T11:14:30.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.055+0000 7fe7d77fe700 1 --2- 172.21.15.84:0/405545591 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7d80b1e00 0x7fe7d81f5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:14:30.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.055+0000 7fe7d6ffd700 1 --2- 172.21.15.84:0/405545591 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7d80d1220 0x7fe7d80b87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:14:30.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.055+0000 7fe7d7fff700 1 --2- 172.21.15.84:0/405545591 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7d815c950 0x7fe7d8157640 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe7d000c7f0 tx=0x7fe7d000cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:30.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.055+0000 7fe7bffff700 1 -- 172.21.15.84:0/405545591 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d0003e30 con 0x7fe7d815c950 2023-07-14T11:14:30.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.055+0000 7fe7bffff700 1 -- 172.21.15.84:0/405545591 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7d0005070 con 0x7fe7d815c950 2023-07-14T11:14:30.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.055+0000 7fe7bffff700 1 -- 172.21.15.84:0/405545591 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d00053e0 con 0x7fe7d815c950 2023-07-14T11:14:30.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.055+0000 7fe7ddfff700 1 -- 172.21.15.84:0/405545591 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7d81f6690 con 0x7fe7d815c950 2023-07-14T11:14:30.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.055+0000 7fe7ddfff700 1 -- 172.21.15.84:0/405545591 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7d81f6c50 con 0x7fe7d815c950 2023-07-14T11:14:30.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.057+0000 7fe7ddfff700 1 -- 172.21.15.84:0/405545591 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7d81f74c0 con 0x7fe7d815c950 2023-07-14T11:14:30.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.058+0000 7fe7bffff700 1 -- 172.21.15.84:0/405545591 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe7d0005540 con 0x7fe7d815c950 2023-07-14T11:14:30.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.058+0000 7fe7bffff700 1 --2- 172.21.15.84:0/405545591 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe7c406ace0 0x7fe7c406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:30.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.058+0000 7fe7bffff700 1 -- 172.21.15.84:0/405545591 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fe7d0088780 con 0x7fe7d815c950 2023-07-14T11:14:30.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.058+0000 7fe7d77fe700 1 --2- 172.21.15.84:0/405545591 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe7c406ace0 0x7fe7c406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:30.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.059+0000 7fe7d77fe700 1 --2- 172.21.15.84:0/405545591 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe7c406ace0 0x7fe7c406d190 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe7d80cf9b0 tx=0x7fe7c8008070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:30.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.064+0000 7fe7bffff700 1 -- 172.21.15.84:0/405545591 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe7d81f74c0 con 0x7fe7d815c950 2023-07-14T11:14:30.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.263+0000 7fe7ddfff700 1 -- 172.21.15.84:0/405545591 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fe7d81f74c0 con 0x7fe7d815c950 2023-07-14T11:14:30.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.263+0000 7fe7bffff700 1 -- 172.21.15.84:0/405545591 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v33) v1 ==== 84+0+126 (secure 0 0 0) 0x7fe7d81f74c0 con 0x7fe7d815c950 2023-07-14T11:14:30.266 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:14:30.267 INFO:teuthology.orchestra.run.smithi084.stdout:[ 2023-07-14T11:14:30.267 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:14:30.267 INFO:teuthology.orchestra.run.smithi084.stdout: "poolnum": 1, 2023-07-14T11:14:30.268 INFO:teuthology.orchestra.run.smithi084.stdout: "poolname": ".mgr" 2023-07-14T11:14:30.268 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:14:30.268 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:14:30.268 INFO:teuthology.orchestra.run.smithi084.stdout: "poolnum": 2, 2023-07-14T11:14:30.269 INFO:teuthology.orchestra.run.smithi084.stdout: "poolname": "rbd" 2023-07-14T11:14:30.269 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:14:30.269 INFO:teuthology.orchestra.run.smithi084.stdout:] 2023-07-14T11:14:30.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.266+0000 7fe7ddfff700 1 -- 172.21.15.84:0/405545591 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe7c406ace0 msgr2=0x7fe7c406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:30.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.266+0000 7fe7ddfff700 1 --2- 172.21.15.84:0/405545591 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe7c406ace0 0x7fe7c406d190 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe7d80cf9b0 tx=0x7fe7c8008070 comp rx=0 tx=0).stop 2023-07-14T11:14:30.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.266+0000 7fe7ddfff700 1 -- 172.21.15.84:0/405545591 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7d815c950 msgr2=0x7fe7d8157640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:30.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.266+0000 7fe7ddfff700 1 --2- 172.21.15.84:0/405545591 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7d815c950 0x7fe7d8157640 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe7d000c7f0 tx=0x7fe7d000cbb0 comp rx=0 tx=0).stop 2023-07-14T11:14:30.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.266+0000 7fe7ddfff700 1 -- 172.21.15.84:0/405545591 shutdown_connections 2023-07-14T11:14:30.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.266+0000 7fe7ddfff700 1 --2- 172.21.15.84:0/405545591 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7d815c950 0x7fe7d8157640 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:30.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.266+0000 7fe7ddfff700 1 --2- 172.21.15.84:0/405545591 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7d80b1e00 0x7fe7d81f5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:30.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.266+0000 7fe7ddfff700 1 --2- 172.21.15.84:0/405545591 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe7c406ace0 0x7fe7c406d190 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:30.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.266+0000 7fe7ddfff700 1 --2- 172.21.15.84:0/405545591 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7d80d1220 0x7fe7d80b87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:30.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.266+0000 7fe7ddfff700 1 -- 172.21.15.84:0/405545591 >> 172.21.15.84:0/405545591 conn(0x7fe7d809c1d0 msgr2=0x7fe7d80d1640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:30.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.266+0000 7fe7ddfff700 1 -- 172.21.15.84:0/405545591 shutdown_connections 2023-07-14T11:14:30.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.266+0000 7fe7ddfff700 1 -- 172.21.15.84:0/405545591 wait complete. 2023-07-14T11:14:30.285 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-14T11:14:30.286 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-14T11:14:30.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.483+0000 7f16d89ff700 1 Processor -- start 2023-07-14T11:14:30.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.483+0000 7f16d89ff700 1 -- start start 2023-07-14T11:14:30.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.484+0000 7f16d89ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f16d415c890 0x7f16d40d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:30.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.484+0000 7f16d89ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16d40b2440 0x7f16d40d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:30.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.485+0000 7f16d89ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16d415cc60 con 0x7f16d406c240 2023-07-14T11:14:30.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.485+0000 7f16d89ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16d406a7f0 con 0x7f16d415c890 2023-07-14T11:14:30.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.485+0000 7f16d89ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16d406b760 con 0x7f16d40b2440 2023-07-14T11:14:30.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.485+0000 7f16d2d9d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f16d406c240 0x7f16d40cf840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:47076/0 (socket says 172.21.15.84:47076) 2023-07-14T11:14:30.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.485+0000 7f16d2d9d700 1 -- 172.21.15.84:0/2556427330 learned_addr learned my addr 172.21.15.84:0/2556427330 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:14:30.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.485+0000 7f16d259c700 1 --2- 172.21.15.84:0/2556427330 >> v2:172.21.15.179:3300/0 conn(0x7f16d415c890 0x7f16d40d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:30.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.485+0000 7f16cbfff700 1 --2- 172.21.15.84:0/2556427330 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16d40b2440 0x7f16d40d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:30.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.485+0000 7f16d1d9b700 1 -- 172.21.15.84:0/2556427330 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 302082686 0 0) 0x7f16d415cc60 con 0x7f16d406c240 2023-07-14T11:14:30.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.485+0000 7f16d1d9b700 1 -- 172.21.15.84:0/2556427330 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16c00035b0 con 0x7f16d406c240 2023-07-14T11:14:30.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.485+0000 7f16cbfff700 1 -- 172.21.15.84:0/2556427330 >> v2:172.21.15.179:3300/0 conn(0x7f16d415c890 msgr2=0x7f16d40d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:30.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.485+0000 7f16cbfff700 1 --2- 172.21.15.84:0/2556427330 >> v2:172.21.15.179:3300/0 conn(0x7f16d415c890 0x7f16d40d0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:30.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.485+0000 7f16cbfff700 1 -- 172.21.15.84:0/2556427330 >> v1:172.21.15.84:6789/0 conn(0x7f16d406c240 legacy=0x7f16d40cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:30.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.485+0000 7f16cbfff700 1 -- 172.21.15.84:0/2556427330 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16d406ba40 con 0x7f16d40b2440 2023-07-14T11:14:30.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.486+0000 7f16cbfff700 1 --2- 172.21.15.84:0/2556427330 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16d40b2440 0x7f16d40d0f90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f16bc009840 tx=0x7f16bc009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eba3e2fefa8bde8e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:30.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.486+0000 7f16d1d9b700 1 -- 172.21.15.84:0/2556427330 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16bc011830 con 0x7f16d40b2440 2023-07-14T11:14:30.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.486+0000 7f16d1d9b700 1 -- 172.21.15.84:0/2556427330 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16bc011990 con 0x7f16d40b2440 2023-07-14T11:14:30.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.486+0000 7f16d1d9b700 1 -- 172.21.15.84:0/2556427330 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16bc011d00 con 0x7f16d40b2440 2023-07-14T11:14:30.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.487+0000 7f16d89ff700 1 -- 172.21.15.84:0/2556427330 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16d40b2440 msgr2=0x7f16d40d0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:30.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.487+0000 7f16d89ff700 1 --2- 172.21.15.84:0/2556427330 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16d40b2440 0x7f16d40d0f90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f16bc009840 tx=0x7f16bc009b50 comp rx=0 tx=0).stop 2023-07-14T11:14:30.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.487+0000 7f16d89ff700 1 -- 172.21.15.84:0/2556427330 shutdown_connections 2023-07-14T11:14:30.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.487+0000 7f16d89ff700 1 --2- 172.21.15.84:0/2556427330 >> v2:172.21.15.179:3300/0 conn(0x7f16d415c890 0x7f16d40d0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:30.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.487+0000 7f16d89ff700 1 --2- 172.21.15.84:0/2556427330 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16d40b2440 0x7f16d40d0f90 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:30.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.487+0000 7f16d89ff700 1 -- 172.21.15.84:0/2556427330 >> 172.21.15.84:0/2556427330 conn(0x7f16d409c170 msgr2=0x7f16d40d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:30.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.487+0000 7f16d89ff700 1 -- 172.21.15.84:0/2556427330 shutdown_connections 2023-07-14T11:14:30.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.487+0000 7f16d89ff700 1 -- 172.21.15.84:0/2556427330 wait complete. 2023-07-14T11:14:30.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.489+0000 7f16d89ff700 1 Processor -- start 2023-07-14T11:14:30.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.489+0000 7f16d89ff700 1 -- start start 2023-07-14T11:14:30.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.490+0000 7f16d89ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16d406c240 0x7f16d4148370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:30.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.490+0000 7f16d89ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16d40b2440 0x7f16d41f5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:30.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.490+0000 7f16d89ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16d415c890 0x7f16d40b02d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:30.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.490+0000 7f16d89ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16d41f2350 con 0x7f16d406c240 2023-07-14T11:14:30.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.490+0000 7f16d89ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16d41f1a80 con 0x7f16d40b2440 2023-07-14T11:14:30.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.490+0000 7f16d89ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16d41f5fc0 con 0x7f16d415c890 2023-07-14T11:14:30.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.490+0000 7f16d259c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16d406c240 0x7f16d4148370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:30.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.490+0000 7f16d259c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16d406c240 0x7f16d4148370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34180/0 (socket says 172.21.15.84:34180) 2023-07-14T11:14:30.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.490+0000 7f16d259c700 1 -- 172.21.15.84:0/3985431205 learned_addr learned my addr 172.21.15.84:0/3985431205 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:30.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.490+0000 7f16cbfff700 1 --2- 172.21.15.84:0/3985431205 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16d40b2440 0x7f16d41f5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:30.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.490+0000 7f16d2d9d700 1 --2- 172.21.15.84:0/3985431205 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16d415c890 0x7f16d40b02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:30.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.490+0000 7f16d259c700 1 -- 172.21.15.84:0/3985431205 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16d415c890 msgr2=0x7f16d40b02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:30.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.490+0000 7f16d259c700 1 --2- 172.21.15.84:0/3985431205 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16d415c890 0x7f16d40b02d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:30.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.490+0000 7f16d259c700 1 -- 172.21.15.84:0/3985431205 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16d40b2440 msgr2=0x7f16d41f5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:30.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.490+0000 7f16d259c700 1 --2- 172.21.15.84:0/3985431205 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16d40b2440 0x7f16d41f5a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:30.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.490+0000 7f16d259c700 1 -- 172.21.15.84:0/3985431205 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16bc0094a0 con 0x7f16d406c240 2023-07-14T11:14:30.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.490+0000 7f16d2d9d700 1 --2- 172.21.15.84:0/3985431205 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16d415c890 0x7f16d40b02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:14:30.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.490+0000 7f16d259c700 1 --2- 172.21.15.84:0/3985431205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16d406c240 0x7f16d4148370 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f16c400e9b0 tx=0x7f16c400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:30.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.491+0000 7f16caffd700 1 -- 172.21.15.84:0/3985431205 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c4009710 con 0x7f16d406c240 2023-07-14T11:14:30.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.491+0000 7f16caffd700 1 -- 172.21.15.84:0/3985431205 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16c400c850 con 0x7f16d406c240 2023-07-14T11:14:30.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.491+0000 7f16caffd700 1 -- 172.21.15.84:0/3985431205 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c400cbc0 con 0x7f16d406c240 2023-07-14T11:14:30.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.491+0000 7f16d89ff700 1 -- 172.21.15.84:0/3985431205 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16d40b55d0 con 0x7f16d406c240 2023-07-14T11:14:30.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.491+0000 7f16d89ff700 1 -- 172.21.15.84:0/3985431205 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16d41f1fe0 con 0x7f16d406c240 2023-07-14T11:14:30.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.492+0000 7f16d89ff700 1 -- 172.21.15.84:0/3985431205 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16d415c050 con 0x7f16d406c240 2023-07-14T11:14:30.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.493+0000 7f16caffd700 1 -- 172.21.15.84:0/3985431205 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f16c400cd20 con 0x7f16d406c240 2023-07-14T11:14:30.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.494+0000 7f16caffd700 1 --2- 172.21.15.84:0/3985431205 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f16b406ace0 0x7f16b406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:30.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.494+0000 7f16caffd700 1 -- 172.21.15.84:0/3985431205 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f16c4089340 con 0x7f16d406c240 2023-07-14T11:14:30.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.494+0000 7f16cbfff700 1 --2- 172.21.15.84:0/3985431205 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f16b406ace0 0x7f16b406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:30.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.495+0000 7f16cbfff700 1 --2- 172.21.15.84:0/3985431205 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f16b406ace0 0x7f16b406d190 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f16bc009fd0 tx=0x7f16bc008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:30.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.499+0000 7f16caffd700 1 -- 172.21.15.84:0/3985431205 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f16c4058130 con 0x7f16d406c240 2023-07-14T11:14:30.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:30.692+0000 7f16d89ff700 1 -- 172.21.15.84:0/3985431205 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f16d4074350 con 0x7f16d406c240 2023-07-14T11:14:31.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.011+0000 7f16caffd700 1 -- 172.21.15.84:0/3985431205 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v34) v1 ==== 138+0+0 (secure 0 0 0) 0x7f16c4057cc0 con 0x7f16d406c240 2023-07-14T11:14:31.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.015+0000 7f16d89ff700 1 -- 172.21.15.84:0/3985431205 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f16b406ace0 msgr2=0x7f16b406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:31.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.015+0000 7f16d89ff700 1 --2- 172.21.15.84:0/3985431205 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f16b406ace0 0x7f16b406d190 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f16bc009fd0 tx=0x7f16bc008030 comp rx=0 tx=0).stop 2023-07-14T11:14:31.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.015+0000 7f16d89ff700 1 -- 172.21.15.84:0/3985431205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16d406c240 msgr2=0x7f16d4148370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:31.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.015+0000 7f16d89ff700 1 --2- 172.21.15.84:0/3985431205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16d406c240 0x7f16d4148370 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f16c400e9b0 tx=0x7f16c400ed70 comp rx=0 tx=0).stop 2023-07-14T11:14:31.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.015+0000 7f16d89ff700 1 -- 172.21.15.84:0/3985431205 shutdown_connections 2023-07-14T11:14:31.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.015+0000 7f16d89ff700 1 --2- 172.21.15.84:0/3985431205 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f16b406ace0 0x7f16b406d190 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:31.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.015+0000 7f16d89ff700 1 --2- 172.21.15.84:0/3985431205 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16d415c890 0x7f16d40b02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:31.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.015+0000 7f16d89ff700 1 --2- 172.21.15.84:0/3985431205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16d406c240 0x7f16d4148370 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:31.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.015+0000 7f16d89ff700 1 --2- 172.21.15.84:0/3985431205 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16d40b2440 0x7f16d41f5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:31.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.015+0000 7f16d89ff700 1 -- 172.21.15.84:0/3985431205 >> 172.21.15.84:0/3985431205 conn(0x7f16d409c170 msgr2=0x7f16d40afbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:31.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.016+0000 7f16d89ff700 1 -- 172.21.15.84:0/3985431205 shutdown_connections 2023-07-14T11:14:31.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.016+0000 7f16d89ff700 1 -- 172.21.15.84:0/3985431205 wait complete. 2023-07-14T11:14:31.019 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_metadata' created 2023-07-14T11:14:31.038 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-14T11:14:31.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.236+0000 7fe5d8bff700 1 Processor -- start 2023-07-14T11:14:31.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.236+0000 7fe5d8bff700 1 -- start start 2023-07-14T11:14:31.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.237+0000 7fe5d8bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5d40c92d0 0x7fe5d40ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:31.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.237+0000 7fe5d8bff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe5d40adea0 0x7fe5d40cc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:31.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.237+0000 7fe5d8bff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5d415ce70 con 0x7fe5d40b12f0 2023-07-14T11:14:31.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.237+0000 7fe5d8bff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5d415da60 con 0x7fe5d40adea0 2023-07-14T11:14:31.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.237+0000 7fe5d8bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d415d0c0 con 0x7fe5d40c92d0 2023-07-14T11:14:31.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.238+0000 7fe5d259c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5d40c92d0 0x7fe5d40ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:31.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.238+0000 7fe5d2d9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe5d40adea0 0x7fe5d40cc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:31.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.238+0000 7fe5d259c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5d40c92d0 0x7fe5d40ad8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.84:44652/0 (socket says 172.21.15.84:44652) 2023-07-14T11:14:31.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.238+0000 7fe5d259c700 1 -- 172.21.15.84:0/2408982218 learned_addr learned my addr 172.21.15.84:0/2408982218 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:31.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.238+0000 7fe5cbfff700 1 --1- 172.21.15.84:0/2408982218 >> v1:172.21.15.179:6789/0 conn(0x7fe5d40b12f0 0x7fe5d40c96a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.84:53106/0 (socket says 172.21.15.84:53106) 2023-07-14T11:14:31.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.238+0000 7fe5d1d9b700 1 -- 172.21.15.84:0/2408982218 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3007333576 0 0) 0x7fe5d415ce70 con 0x7fe5d40b12f0 2023-07-14T11:14:31.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.238+0000 7fe5d1d9b700 1 -- 172.21.15.84:0/2408982218 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5c00035b0 con 0x7fe5d40b12f0 2023-07-14T11:14:31.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.238+0000 7fe5d2d9d700 1 -- 172.21.15.84:0/2408982218 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5d40c92d0 msgr2=0x7fe5d40ad8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:31.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.238+0000 7fe5d2d9d700 1 --2- 172.21.15.84:0/2408982218 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5d40c92d0 0x7fe5d40ad8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:31.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.238+0000 7fe5d2d9d700 1 -- 172.21.15.84:0/2408982218 >> v1:172.21.15.179:6789/0 conn(0x7fe5d40b12f0 legacy=0x7fe5d40c96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:31.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.238+0000 7fe5d2d9d700 1 -- 172.21.15.84:0/2408982218 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5d415d3a0 con 0x7fe5d40adea0 2023-07-14T11:14:31.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.238+0000 7fe5d259c700 1 --2- 172.21.15.84:0/2408982218 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5d40c92d0 0x7fe5d40ad8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:14:31.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.239+0000 7fe5d2d9d700 1 --2- 172.21.15.84:0/2408982218 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5d40adea0 0x7fe5d40cc690 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc009d90 tx=0x7fe5cc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4a8084ef4d63e75 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:31.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.239+0000 7fe5d1d9b700 1 -- 172.21.15.84:0/2408982218 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5cc00e070 con 0x7fe5d40adea0 2023-07-14T11:14:31.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.239+0000 7fe5d1d9b700 1 -- 172.21.15.84:0/2408982218 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5cc00bb20 con 0x7fe5d40adea0 2023-07-14T11:14:31.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.239+0000 7fe5d1d9b700 1 -- 172.21.15.84:0/2408982218 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5cc012430 con 0x7fe5d40adea0 2023-07-14T11:14:31.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.239+0000 7fe5d8bff700 1 -- 172.21.15.84:0/2408982218 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5d40adea0 msgr2=0x7fe5d40cc690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:31.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.239+0000 7fe5d8bff700 1 --2- 172.21.15.84:0/2408982218 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5d40adea0 0x7fe5d40cc690 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc009d90 tx=0x7fe5cc00b330 comp rx=0 tx=0).stop 2023-07-14T11:14:31.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.240+0000 7fe5d8bff700 1 -- 172.21.15.84:0/2408982218 shutdown_connections 2023-07-14T11:14:31.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.240+0000 7fe5d8bff700 1 --2- 172.21.15.84:0/2408982218 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5d40adea0 0x7fe5d40cc690 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:31.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.240+0000 7fe5d8bff700 1 --2- 172.21.15.84:0/2408982218 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5d40c92d0 0x7fe5d40ad8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:31.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.240+0000 7fe5d8bff700 1 -- 172.21.15.84:0/2408982218 >> 172.21.15.84:0/2408982218 conn(0x7fe5d40b05d0 msgr2=0x7fe5d40b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:31.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.240+0000 7fe5d8bff700 1 -- 172.21.15.84:0/2408982218 shutdown_connections 2023-07-14T11:14:31.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.240+0000 7fe5d8bff700 1 -- 172.21.15.84:0/2408982218 wait complete. 2023-07-14T11:14:31.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.241+0000 7fe5d8bff700 1 Processor -- start 2023-07-14T11:14:31.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.242+0000 7fe5d8bff700 1 -- start start 2023-07-14T11:14:31.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.243+0000 7fe5d8bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5d40adea0 0x7fe5d40c7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:31.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.243+0000 7fe5d8bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5d40b12f0 0x7fe5d40c6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:31.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.243+0000 7fe5d8bff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5d40c92d0 0x7fe5d4155080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:31.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.243+0000 7fe5d8bff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d40c62f0 con 0x7fe5d40c92d0 2023-07-14T11:14:31.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.243+0000 7fe5d8bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d40c8090 con 0x7fe5d40adea0 2023-07-14T11:14:31.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.243+0000 7fe5d8bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d4155b00 con 0x7fe5d40b12f0 2023-07-14T11:14:31.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.243+0000 7fe5d2d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5d40c92d0 0x7fe5d4155080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:31.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.243+0000 7fe5d2d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5d40c92d0 0x7fe5d4155080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34188/0 (socket says 172.21.15.84:34188) 2023-07-14T11:14:31.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.243+0000 7fe5d2d9d700 1 -- 172.21.15.84:0/1465308048 learned_addr learned my addr 172.21.15.84:0/1465308048 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:31.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.243+0000 7fe5cbfff700 1 --2- 172.21.15.84:0/1465308048 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5d40b12f0 0x7fe5d40c6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:31.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.243+0000 7fe5d259c700 1 --2- 172.21.15.84:0/1465308048 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5d40adea0 0x7fe5d40c7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:31.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.243+0000 7fe5d2d9d700 1 -- 172.21.15.84:0/1465308048 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5d40b12f0 msgr2=0x7fe5d40c6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:31.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.243+0000 7fe5d2d9d700 1 --2- 172.21.15.84:0/1465308048 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5d40b12f0 0x7fe5d40c6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:31.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.243+0000 7fe5d2d9d700 1 -- 172.21.15.84:0/1465308048 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5d40adea0 msgr2=0x7fe5d40c7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:31.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.243+0000 7fe5d2d9d700 1 --2- 172.21.15.84:0/1465308048 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5d40adea0 0x7fe5d40c7b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:31.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.243+0000 7fe5d2d9d700 1 -- 172.21.15.84:0/1465308048 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5c400b7f0 con 0x7fe5d40c92d0 2023-07-14T11:14:31.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.243+0000 7fe5d259c700 1 --2- 172.21.15.84:0/1465308048 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5d40adea0 0x7fe5d40c7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:14:31.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.244+0000 7fe5d2d9d700 1 --2- 172.21.15.84:0/1465308048 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5d40c92d0 0x7fe5d4155080 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc014040 tx=0x7fe5cc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:31.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.244+0000 7fe5caffd700 1 -- 172.21.15.84:0/1465308048 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5cc0129f0 con 0x7fe5d40c92d0 2023-07-14T11:14:31.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.244+0000 7fe5caffd700 1 -- 172.21.15.84:0/1465308048 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5cc020070 con 0x7fe5d40c92d0 2023-07-14T11:14:31.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.244+0000 7fe5d8bff700 1 -- 172.21.15.84:0/1465308048 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5cc009a70 con 0x7fe5d40c92d0 2023-07-14T11:14:31.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.244+0000 7fe5caffd700 1 -- 172.21.15.84:0/1465308048 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5cc012db0 con 0x7fe5d40c92d0 2023-07-14T11:14:31.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.244+0000 7fe5d8bff700 1 -- 172.21.15.84:0/1465308048 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5d40c5c30 con 0x7fe5d40c92d0 2023-07-14T11:14:31.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.245+0000 7fe5d8bff700 1 -- 172.21.15.84:0/1465308048 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5d4074350 con 0x7fe5d40c92d0 2023-07-14T11:14:31.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.247+0000 7fe5caffd700 1 -- 172.21.15.84:0/1465308048 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe5cc004040 con 0x7fe5d40c92d0 2023-07-14T11:14:31.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.248+0000 7fe5caffd700 1 --2- 172.21.15.84:0/1465308048 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe5b406ace0 0x7fe5b406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:31.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.248+0000 7fe5caffd700 1 -- 172.21.15.84:0/1465308048 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5580+0+0 (secure 0 0 0) 0x7fe5cc022070 con 0x7fe5d40c92d0 2023-07-14T11:14:31.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.248+0000 7fe5d259c700 1 --2- 172.21.15.84:0/1465308048 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe5b406ace0 0x7fe5b406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:31.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.249+0000 7fe5d259c700 1 --2- 172.21.15.84:0/1465308048 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe5b406ace0 0x7fe5b406d190 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe5c400be90 tx=0x7fe5c400b4d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:31.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.252+0000 7fe5caffd700 1 -- 172.21.15.84:0/1465308048 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe5cc0568f0 con 0x7fe5d40c92d0 2023-07-14T11:14:31.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:31.447+0000 7fe5d8bff700 1 -- 172.21.15.84:0/1465308048 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fe5d40ad4a0 con 0x7fe5d40c92d0 2023-07-14T11:14:32.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.013+0000 7fe5caffd700 1 -- 172.21.15.84:0/1465308048 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v35) v1 ==== 170+0+0 (secure 0 0 0) 0x7fe5cc02c0d0 con 0x7fe5d40c92d0 2023-07-14T11:14:32.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.025+0000 7fe5d8bff700 1 -- 172.21.15.84:0/1465308048 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe5b406ace0 msgr2=0x7fe5b406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:32.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.025+0000 7fe5d8bff700 1 --2- 172.21.15.84:0/1465308048 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe5b406ace0 0x7fe5b406d190 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe5c400be90 tx=0x7fe5c400b4d0 comp rx=0 tx=0).stop 2023-07-14T11:14:32.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.025+0000 7fe5d8bff700 1 -- 172.21.15.84:0/1465308048 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5d40c92d0 msgr2=0x7fe5d4155080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:32.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.025+0000 7fe5d8bff700 1 --2- 172.21.15.84:0/1465308048 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5d40c92d0 0x7fe5d4155080 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc014040 tx=0x7fe5cc004ad0 comp rx=0 tx=0).stop 2023-07-14T11:14:32.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.027+0000 7fe5d8bff700 1 -- 172.21.15.84:0/1465308048 shutdown_connections 2023-07-14T11:14:32.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.027+0000 7fe5d8bff700 1 --2- 172.21.15.84:0/1465308048 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5d40c92d0 0x7fe5d4155080 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:32.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.027+0000 7fe5d8bff700 1 --2- 172.21.15.84:0/1465308048 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5d40adea0 0x7fe5d40c7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:32.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.027+0000 7fe5d8bff700 1 --2- 172.21.15.84:0/1465308048 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe5b406ace0 0x7fe5b406d190 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:32.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.027+0000 7fe5d8bff700 1 --2- 172.21.15.84:0/1465308048 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5d40b12f0 0x7fe5d40c6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:32.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.027+0000 7fe5d8bff700 1 -- 172.21.15.84:0/1465308048 >> 172.21.15.84:0/1465308048 conn(0x7fe5d40b05d0 msgr2=0x7fe5d406f730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:32.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.028+0000 7fe5d8bff700 1 -- 172.21.15.84:0/1465308048 shutdown_connections 2023-07-14T11:14:32.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.028+0000 7fe5d8bff700 1 -- 172.21.15.84:0/1465308048 wait complete. 2023-07-14T11:14:32.033 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data' created 2023-07-14T11:14:32.052 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-14T11:14:32.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.250+0000 7f633b1ff700 1 Processor -- start 2023-07-14T11:14:32.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.250+0000 7f633b1ff700 1 -- start start 2023-07-14T11:14:32.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.251+0000 7f633b1ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f63340c92d0 0x7f63340ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:32.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.251+0000 7f633b1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63340b12f0 0x7f63340c96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:32.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.251+0000 7f633b1ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f63340adea0 0x7f633406c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:32.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.251+0000 7f633b1ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f633415da60 con 0x7f63340c92d0 2023-07-14T11:14:32.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.251+0000 7f633b1ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f633415ce70 con 0x7f63340adea0 2023-07-14T11:14:32.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.251+0000 7f633b1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63340c9be0 con 0x7f63340b12f0 2023-07-14T11:14:32.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.251+0000 7f6338f9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f63340c92d0 0x7f63340ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:32.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.251+0000 7f6338f9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f63340c92d0 0x7f63340ad8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34204/0 (socket says 172.21.15.84:34204) 2023-07-14T11:14:32.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.251+0000 7f6338f9b700 1 -- 172.21.15.84:0/245132733 learned_addr learned my addr 172.21.15.84:0/245132733 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:32.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.252+0000 7f6333fff700 1 --2- 172.21.15.84:0/245132733 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63340b12f0 0x7f63340c96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:32.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.252+0000 7f633979c700 1 --2- 172.21.15.84:0/245132733 >> v2:172.21.15.179:3300/0 conn(0x7f63340adea0 0x7f633406c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:32.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.252+0000 7f6338f9b700 1 -- 172.21.15.84:0/245132733 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63340b12f0 msgr2=0x7f63340c96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:32.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.252+0000 7f6338f9b700 1 --2- 172.21.15.84:0/245132733 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63340b12f0 0x7f63340c96a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:32.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.252+0000 7f6338f9b700 1 -- 172.21.15.84:0/245132733 >> v2:172.21.15.179:3300/0 conn(0x7f63340adea0 msgr2=0x7f633406c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:32.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.252+0000 7f6338f9b700 1 --2- 172.21.15.84:0/245132733 >> v2:172.21.15.179:3300/0 conn(0x7f63340adea0 0x7f633406c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:32.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.252+0000 7f6338f9b700 1 -- 172.21.15.84:0/245132733 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f633415d0c0 con 0x7f63340c92d0 2023-07-14T11:14:32.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.252+0000 7f6338f9b700 1 --2- 172.21.15.84:0/245132733 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63340c92d0 0x7f63340ad8f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f633406f5e0 tx=0x7f6328009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=891961301e14000c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:32.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.252+0000 7f63337fe700 1 -- 172.21.15.84:0/245132733 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632800b870 con 0x7f63340c92d0 2023-07-14T11:14:32.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.252+0000 7f63337fe700 1 -- 172.21.15.84:0/245132733 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f632800b9d0 con 0x7f63340c92d0 2023-07-14T11:14:32.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.252+0000 7f63337fe700 1 -- 172.21.15.84:0/245132733 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632800bd60 con 0x7f63340c92d0 2023-07-14T11:14:32.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.253+0000 7f633b1ff700 1 -- 172.21.15.84:0/245132733 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63340c92d0 msgr2=0x7f63340ad8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:32.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.253+0000 7f633b1ff700 1 --2- 172.21.15.84:0/245132733 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63340c92d0 0x7f63340ad8f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f633406f5e0 tx=0x7f6328009bd0 comp rx=0 tx=0).stop 2023-07-14T11:14:32.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.253+0000 7f633b1ff700 1 -- 172.21.15.84:0/245132733 shutdown_connections 2023-07-14T11:14:32.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.253+0000 7f633b1ff700 1 --2- 172.21.15.84:0/245132733 >> v2:172.21.15.179:3300/0 conn(0x7f63340adea0 0x7f633406c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:32.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.253+0000 7f633b1ff700 1 --2- 172.21.15.84:0/245132733 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63340c92d0 0x7f63340ad8f0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:32.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.253+0000 7f633b1ff700 1 --2- 172.21.15.84:0/245132733 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63340b12f0 0x7f63340c96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:32.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.253+0000 7f633b1ff700 1 -- 172.21.15.84:0/245132733 >> 172.21.15.84:0/245132733 conn(0x7f63340b05d0 msgr2=0x7f63340b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:32.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.253+0000 7f633b1ff700 1 -- 172.21.15.84:0/245132733 shutdown_connections 2023-07-14T11:14:32.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.253+0000 7f633b1ff700 1 -- 172.21.15.84:0/245132733 wait complete. 2023-07-14T11:14:32.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.255+0000 7f633b1ff700 1 Processor -- start 2023-07-14T11:14:32.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.255+0000 7f633b1ff700 1 -- start start 2023-07-14T11:14:32.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.256+0000 7f633b1ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63340adea0 0x7f6334153b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:32.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.256+0000 7f633b1ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63340b12f0 0x7f6334159910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:32.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.256+0000 7f633b1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63340c92d0 0x7f63340cb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:32.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.256+0000 7f633b1ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63340b1b70 con 0x7f63340b12f0 2023-07-14T11:14:32.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.256+0000 7f633b1ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63340b1e50 con 0x7f63340adea0 2023-07-14T11:14:32.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.256+0000 7f633b1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f633415bea0 con 0x7f63340c92d0 2023-07-14T11:14:32.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.256+0000 7f6333fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63340b12f0 0x7f6334159910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:32.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.256+0000 7f6333fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63340b12f0 0x7f6334159910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34208/0 (socket says 172.21.15.84:34208) 2023-07-14T11:14:32.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.256+0000 7f6333fff700 1 -- 172.21.15.84:0/1977805474 learned_addr learned my addr 172.21.15.84:0/1977805474 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:32.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.256+0000 7f633979c700 1 --2- 172.21.15.84:0/1977805474 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63340c92d0 0x7f63340cb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:32.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.257+0000 7f6338f9b700 1 --2- 172.21.15.84:0/1977805474 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63340adea0 0x7f6334153b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:32.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.257+0000 7f6333fff700 1 -- 172.21.15.84:0/1977805474 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63340c92d0 msgr2=0x7f63340cb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:32.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.257+0000 7f6333fff700 1 --2- 172.21.15.84:0/1977805474 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63340c92d0 0x7f63340cb2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:32.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.257+0000 7f6333fff700 1 -- 172.21.15.84:0/1977805474 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63340adea0 msgr2=0x7f6334153b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:32.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.257+0000 7f6333fff700 1 --2- 172.21.15.84:0/1977805474 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63340adea0 0x7f6334153b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:32.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.257+0000 7f6333fff700 1 -- 172.21.15.84:0/1977805474 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6328009550 con 0x7f63340b12f0 2023-07-14T11:14:32.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.257+0000 7f633979c700 1 --2- 172.21.15.84:0/1977805474 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63340c92d0 0x7f63340cb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:14:32.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.257+0000 7f6338f9b700 1 --2- 172.21.15.84:0/1977805474 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63340adea0 0x7f6334153b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:14:32.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.257+0000 7f6333fff700 1 --2- 172.21.15.84:0/1977805474 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63340b12f0 0x7f6334159910 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f632000e810 tx=0x7f632000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:32.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.257+0000 7f63317fa700 1 -- 172.21.15.84:0/1977805474 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6320013610 con 0x7f63340b12f0 2023-07-14T11:14:32.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.257+0000 7f63317fa700 1 -- 172.21.15.84:0/1977805474 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6320013770 con 0x7f63340b12f0 2023-07-14T11:14:32.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.257+0000 7f633b1ff700 1 -- 172.21.15.84:0/1977805474 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f633415c100 con 0x7f63340b12f0 2023-07-14T11:14:32.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.257+0000 7f63317fa700 1 -- 172.21.15.84:0/1977805474 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6320013b20 con 0x7f63340b12f0 2023-07-14T11:14:32.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.257+0000 7f633b1ff700 1 -- 172.21.15.84:0/1977805474 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f633415c6c0 con 0x7f63340b12f0 2023-07-14T11:14:32.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.258+0000 7f633b1ff700 1 -- 172.21.15.84:0/1977805474 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6334074350 con 0x7f63340b12f0 2023-07-14T11:14:32.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.259+0000 7f63317fa700 1 -- 172.21.15.84:0/1977805474 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6320013c80 con 0x7f63340b12f0 2023-07-14T11:14:32.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.260+0000 7f63317fa700 1 --2- 172.21.15.84:0/1977805474 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f631806ace0 0x7f631806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:32.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.260+0000 7f63317fa700 1 -- 172.21.15.84:0/1977805474 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f63200891f0 con 0x7f63340b12f0 2023-07-14T11:14:32.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.261+0000 7f6338f9b700 1 --2- 172.21.15.84:0/1977805474 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f631806ace0 0x7f631806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:32.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.261+0000 7f6338f9b700 1 --2- 172.21.15.84:0/1977805474 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f631806ace0 0x7f631806d190 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6328009130 tx=0x7f6328008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:32.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.265+0000 7f63317fa700 1 -- 172.21.15.84:0/1977805474 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f6320054270 con 0x7f63340b12f0 2023-07-14T11:14:32.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:32.503+0000 7f633b1ff700 1 -- 172.21.15.84:0/1977805474 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f63340cf660 con 0x7f63340b12f0 2023-07-14T11:14:33.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.041+0000 7f63317fa700 1 -- 172.21.15.84:0/1977805474 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7f6320057890 con 0x7f63340b12f0 2023-07-14T11:14:33.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.051+0000 7f633b1ff700 1 -- 172.21.15.84:0/1977805474 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f631806ace0 msgr2=0x7f631806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:33.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.051+0000 7f633b1ff700 1 --2- 172.21.15.84:0/1977805474 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f631806ace0 0x7f631806d190 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6328009130 tx=0x7f6328008030 comp rx=0 tx=0).stop 2023-07-14T11:14:33.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.051+0000 7f633b1ff700 1 -- 172.21.15.84:0/1977805474 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63340b12f0 msgr2=0x7f6334159910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:33.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.051+0000 7f633b1ff700 1 --2- 172.21.15.84:0/1977805474 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63340b12f0 0x7f6334159910 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f632000e810 tx=0x7f632000ebd0 comp rx=0 tx=0).stop 2023-07-14T11:14:33.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.053+0000 7f633b1ff700 1 -- 172.21.15.84:0/1977805474 shutdown_connections 2023-07-14T11:14:33.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.053+0000 7f633b1ff700 1 --2- 172.21.15.84:0/1977805474 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f631806ace0 0x7f631806d190 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:33.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.053+0000 7f633b1ff700 1 --2- 172.21.15.84:0/1977805474 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63340c92d0 0x7f63340cb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:33.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.053+0000 7f633b1ff700 1 --2- 172.21.15.84:0/1977805474 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63340adea0 0x7f6334153b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:33.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.053+0000 7f633b1ff700 1 --2- 172.21.15.84:0/1977805474 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63340b12f0 0x7f6334159910 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:33.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.053+0000 7f633b1ff700 1 -- 172.21.15.84:0/1977805474 >> 172.21.15.84:0/1977805474 conn(0x7f63340b05d0 msgr2=0x7f63340b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:33.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.054+0000 7f633b1ff700 1 -- 172.21.15.84:0/1977805474 shutdown_connections 2023-07-14T11:14:33.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.055+0000 7f633b1ff700 1 -- 172.21.15.84:0/1977805474 wait complete. 2023-07-14T11:14:33.062 INFO:teuthology.orchestra.run.smithi084.stderr:new fs with metadata pool 5 and data pool 6 2023-07-14T11:14:33.079 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:14:33.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.272+0000 7fda64dff700 1 Processor -- start 2023-07-14T11:14:33.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.272+0000 7fda64dff700 1 -- start start 2023-07-14T11:14:33.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.273+0000 7fda64dff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fda6015c950 0x7fda600b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:33.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.273+0000 7fda64dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda600d1220 0x7fda600afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:33.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.273+0000 7fda64dff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda600d2ce0 con 0x7fda600b1e00 2023-07-14T11:14:33.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.273+0000 7fda64dff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda600b3350 con 0x7fda6015c950 2023-07-14T11:14:33.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.273+0000 7fda64dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda600b3630 con 0x7fda600d1220 2023-07-14T11:14:33.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.274+0000 7fda57fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fda600b1e00 0x7fda600d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:47078/0 (socket says 172.21.15.84:47078) 2023-07-14T11:14:33.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.274+0000 7fda57fff700 1 -- 172.21.15.84:0/2856655876 learned_addr learned my addr 172.21.15.84:0/2856655876 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:14:33.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.274+0000 7fda5e59c700 1 --2- 172.21.15.84:0/2856655876 >> v2:172.21.15.179:3300/0 conn(0x7fda6015c950 0x7fda600b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:33.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.274+0000 7fda5ed9d700 1 --2- 172.21.15.84:0/2856655876 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda600d1220 0x7fda600afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:33.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.274+0000 7fda5dd9b700 1 -- 172.21.15.84:0/2856655876 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2777339132 0 0) 0x7fda600d2ce0 con 0x7fda600b1e00 2023-07-14T11:14:33.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.274+0000 7fda5dd9b700 1 -- 172.21.15.84:0/2856655876 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda4c0035b0 con 0x7fda600b1e00 2023-07-14T11:14:33.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.274+0000 7fda5dd9b700 1 -- 172.21.15.84:0/2856655876 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3226300423 0 0) 0x7fda4c0035b0 con 0x7fda600b1e00 2023-07-14T11:14:33.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.274+0000 7fda5dd9b700 1 -- 172.21.15.84:0/2856655876 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda600d1220 msgr2=0x7fda600afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:33.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.274+0000 7fda5dd9b700 1 --2- 172.21.15.84:0/2856655876 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda600d1220 0x7fda600afac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:33.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.274+0000 7fda5dd9b700 1 -- 172.21.15.84:0/2856655876 >> v2:172.21.15.179:3300/0 conn(0x7fda6015c950 msgr2=0x7fda600b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:33.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.274+0000 7fda5dd9b700 1 --2- 172.21.15.84:0/2856655876 >> v2:172.21.15.179:3300/0 conn(0x7fda6015c950 0x7fda600b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:33.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.274+0000 7fda5dd9b700 1 -- 172.21.15.84:0/2856655876 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda600b3910 con 0x7fda600b1e00 2023-07-14T11:14:33.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.274+0000 7fda5dd9b700 1 -- 172.21.15.84:0/2856655876 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7fda48001670 con 0x7fda600b1e00 2023-07-14T11:14:33.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.275+0000 7fda5dd9b700 1 -- 172.21.15.84:0/2856655876 >> v1:172.21.15.84:6789/0 conn(0x7fda600b1e00 legacy=0x7fda600d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:33.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.275+0000 7fda5dd9b700 1 --2- 172.21.15.84:0/2856655876 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda4c003a00 0x7fda4c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:33.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.275+0000 7fda5dd9b700 1 --2- 172.21.15.84:0/2856655876 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda600d1220 0x7fda4c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:33.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.275+0000 7fda5dd9b700 1 --2- 172.21.15.84:0/2856655876 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda4c004d90 0x7fda4c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:33.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.275+0000 7fda5dd9b700 1 -- 172.21.15.84:0/2856655876 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda600b3350 con 0x7fda4c004d90 2023-07-14T11:14:33.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.275+0000 7fda5dd9b700 1 -- 172.21.15.84:0/2856655876 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda600b3630 con 0x7fda4c003a00 2023-07-14T11:14:33.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.275+0000 7fda5dd9b700 1 -- 172.21.15.84:0/2856655876 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda4c00ba60 con 0x7fda600d1220 2023-07-14T11:14:33.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.275+0000 7fda5ed9d700 1 --2- 172.21.15.84:0/2856655876 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda4c004d90 0x7fda4c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:33.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.275+0000 7fda5e59c700 1 --2- 172.21.15.84:0/2856655876 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda4c003a00 0x7fda4c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:33.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.275+0000 7fda57fff700 1 --2- 172.21.15.84:0/2856655876 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda600d1220 0x7fda4c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:33.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.275+0000 7fda5ed9d700 1 -- 172.21.15.84:0/2856655876 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda600d1220 msgr2=0x7fda4c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:33.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.275+0000 7fda5ed9d700 1 --2- 172.21.15.84:0/2856655876 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda600d1220 0x7fda4c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:33.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.275+0000 7fda5ed9d700 1 -- 172.21.15.84:0/2856655876 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda4c003a00 msgr2=0x7fda4c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:33.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.275+0000 7fda5ed9d700 1 --2- 172.21.15.84:0/2856655876 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda4c003a00 0x7fda4c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:33.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.275+0000 7fda5ed9d700 1 -- 172.21.15.84:0/2856655876 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda4c0035b0 con 0x7fda4c004d90 2023-07-14T11:14:33.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.275+0000 7fda57fff700 1 --2- 172.21.15.84:0/2856655876 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda600d1220 0x7fda4c004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:14:33.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.276+0000 7fda5ed9d700 1 --2- 172.21.15.84:0/2856655876 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda4c004d90 0x7fda4c005200 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fda58009fc0 tx=0x7fda4c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e98a4661441712c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:33.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.276+0000 7fda5dd9b700 1 -- 172.21.15.84:0/2856655876 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5800ec30 con 0x7fda4c004d90 2023-07-14T11:14:33.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.276+0000 7fda5dd9b700 1 -- 172.21.15.84:0/2856655876 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda5800f040 con 0x7fda4c004d90 2023-07-14T11:14:33.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.276+0000 7fda5dd9b700 1 -- 172.21.15.84:0/2856655876 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda58014480 con 0x7fda4c004d90 2023-07-14T11:14:33.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.276+0000 7fda64dff700 1 -- 172.21.15.84:0/2856655876 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda4c004d90 msgr2=0x7fda4c005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:33.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.276+0000 7fda64dff700 1 --2- 172.21.15.84:0/2856655876 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda4c004d90 0x7fda4c005200 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fda58009fc0 tx=0x7fda4c005880 comp rx=0 tx=0).stop 2023-07-14T11:14:33.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.276+0000 7fda5ed9d700 1 -- 172.21.15.84:0/2856655876 reap_dead start 2023-07-14T11:14:33.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.276+0000 7fda64dff700 1 -- 172.21.15.84:0/2856655876 shutdown_connections 2023-07-14T11:14:33.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.276+0000 7fda64dff700 1 -- 172.21.15.84:0/2856655876 >> 172.21.15.84:0/2856655876 conn(0x7fda6009c1d0 msgr2=0x7fda600d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:33.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.276+0000 7fda64dff700 1 -- 172.21.15.84:0/2856655876 shutdown_connections 2023-07-14T11:14:33.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.277+0000 7fda64dff700 1 -- 172.21.15.84:0/2856655876 wait complete. 2023-07-14T11:14:33.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.278+0000 7fda64dff700 1 Processor -- start 2023-07-14T11:14:33.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.278+0000 7fda64dff700 1 -- start start 2023-07-14T11:14:33.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.279+0000 7fda64dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda4c004d90 0x7fda601525b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:33.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.279+0000 7fda64dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda6006a700 0x7fda6006ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:33.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.279+0000 7fda64dff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda600c7b80 0x7fda600c7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:33.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.279+0000 7fda64dff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda600b5d70 con 0x7fda600c7b80 2023-07-14T11:14:33.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.279+0000 7fda64dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda6006b0b0 con 0x7fda6006a700 2023-07-14T11:14:33.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.279+0000 7fda64dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda600c88f0 con 0x7fda4c004d90 2023-07-14T11:14:33.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.280+0000 7fda5ed9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda600c7b80 0x7fda600c7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:33.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.280+0000 7fda5ed9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda600c7b80 0x7fda600c7ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34228/0 (socket says 172.21.15.84:34228) 2023-07-14T11:14:33.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.280+0000 7fda5ed9d700 1 -- 172.21.15.84:0/110988299 learned_addr learned my addr 172.21.15.84:0/110988299 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:33.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.280+0000 7fda5ed9d700 1 -- 172.21.15.84:0/110988299 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda4c004d90 msgr2=0x7fda601525b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:33.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.280+0000 7fda5ed9d700 1 --2- 172.21.15.84:0/110988299 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda4c004d90 0x7fda601525b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:33.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.280+0000 7fda5ed9d700 1 -- 172.21.15.84:0/110988299 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda6006a700 msgr2=0x7fda6006ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:33.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.280+0000 7fda5ed9d700 1 --2- 172.21.15.84:0/110988299 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda6006a700 0x7fda6006ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:33.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.280+0000 7fda5ed9d700 1 -- 172.21.15.84:0/110988299 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda600c8bd0 con 0x7fda600c7b80 2023-07-14T11:14:33.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.280+0000 7fda5ed9d700 1 --2- 172.21.15.84:0/110988299 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda600c7b80 0x7fda600c7ff0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fda58016000 tx=0x7fda58009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:33.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.280+0000 7fda56ffd700 1 -- 172.21.15.84:0/110988299 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda58014890 con 0x7fda600c7b80 2023-07-14T11:14:33.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.281+0000 7fda56ffd700 1 -- 172.21.15.84:0/110988299 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda58014a30 con 0x7fda600c7b80 2023-07-14T11:14:33.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.281+0000 7fda56ffd700 1 -- 172.21.15.84:0/110988299 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda58014de0 con 0x7fda600c7b80 2023-07-14T11:14:33.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.281+0000 7fda64dff700 1 -- 172.21.15.84:0/110988299 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda600b5f50 con 0x7fda600c7b80 2023-07-14T11:14:33.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.281+0000 7fda64dff700 1 -- 172.21.15.84:0/110988299 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda60152af0 con 0x7fda600c7b80 2023-07-14T11:14:33.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.282+0000 7fda64dff700 1 -- 172.21.15.84:0/110988299 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda600b6470 con 0x7fda600c7b80 2023-07-14T11:14:33.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.283+0000 7fda56ffd700 1 -- 172.21.15.84:0/110988299 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fda58023070 con 0x7fda600c7b80 2023-07-14T11:14:33.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.284+0000 7fda56ffd700 1 --2- 172.21.15.84:0/110988299 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fda4006ad10 0x7fda4006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:33.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.284+0000 7fda56ffd700 1 -- 172.21.15.84:0/110988299 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fda5808a4a0 con 0x7fda600c7b80 2023-07-14T11:14:33.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.284+0000 7fda5e59c700 1 --2- 172.21.15.84:0/110988299 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fda4006ad10 0x7fda4006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:33.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.284+0000 7fda5e59c700 1 --2- 172.21.15.84:0/110988299 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fda4006ad10 0x7fda4006d1c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fda50009b30 tx=0x7fda50009650 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:33.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.288+0000 7fda56ffd700 1 -- 172.21.15.84:0/110988299 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fda600b6470 con 0x7fda600c7b80 2023-07-14T11:14:33.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.486+0000 7fda64dff700 1 -- 172.21.15.84:0/110988299 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fda600b6470 con 0x7fda600c7b80 2023-07-14T11:14:33.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.487+0000 7fda56ffd700 1 -- 172.21.15.84:0/110988299 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+18340 (secure 0 0 0) 0x7fda600b6470 con 0x7fda600c7b80 2023-07-14T11:14:33.489 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:14:33.490 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":36,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:14:32.504260+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-14T11:14:30.730753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-14T11:14:31.485809+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:14:33.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.489+0000 7fda64dff700 1 -- 172.21.15.84:0/110988299 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fda4006ad10 msgr2=0x7fda4006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:33.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.489+0000 7fda64dff700 1 --2- 172.21.15.84:0/110988299 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fda4006ad10 0x7fda4006d1c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fda50009b30 tx=0x7fda50009650 comp rx=0 tx=0).stop 2023-07-14T11:14:33.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.490+0000 7fda64dff700 1 -- 172.21.15.84:0/110988299 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda600c7b80 msgr2=0x7fda600c7ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:33.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.490+0000 7fda64dff700 1 --2- 172.21.15.84:0/110988299 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda600c7b80 0x7fda600c7ff0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fda58016000 tx=0x7fda58009750 comp rx=0 tx=0).stop 2023-07-14T11:14:33.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.490+0000 7fda64dff700 1 -- 172.21.15.84:0/110988299 shutdown_connections 2023-07-14T11:14:33.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.490+0000 7fda64dff700 1 --2- 172.21.15.84:0/110988299 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fda4006ad10 0x7fda4006d1c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:33.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.490+0000 7fda64dff700 1 --2- 172.21.15.84:0/110988299 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda4c004d90 0x7fda601525b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:33.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.490+0000 7fda64dff700 1 --2- 172.21.15.84:0/110988299 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda600c7b80 0x7fda600c7ff0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:33.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.490+0000 7fda64dff700 1 --2- 172.21.15.84:0/110988299 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda6006a700 0x7fda6006ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:33.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.490+0000 7fda64dff700 1 -- 172.21.15.84:0/110988299 >> 172.21.15.84:0/110988299 conn(0x7fda6009c1d0 msgr2=0x7fda600b1580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:33.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.490+0000 7fda64dff700 1 -- 172.21.15.84:0/110988299 shutdown_connections 2023-07-14T11:14:33.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.490+0000 7fda64dff700 1 -- 172.21.15.84:0/110988299 wait complete. 2023-07-14T11:14:33.510 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:14:33.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.703+0000 7f3dd61ff700 1 Processor -- start 2023-07-14T11:14:33.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.703+0000 7f3dd61ff700 1 -- start start 2023-07-14T11:14:33.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.705+0000 7f3dd61ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3dd0158fd0 0x7f3dd0070710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:33.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.705+0000 7f3dd61ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3dd00b4000 0x7f3dd00b1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:33.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.705+0000 7f3dd61ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dd006c110 con 0x7f3dd0141ff0 2023-07-14T11:14:33.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.705+0000 7f3dd61ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dd0071140 con 0x7f3dd00b4000 2023-07-14T11:14:33.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.705+0000 7f3dd61ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd0070c50 con 0x7f3dd0158fd0 2023-07-14T11:14:33.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.705+0000 7f3dcffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3dd00b4000 0x7f3dd00b1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:33.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.705+0000 7f3dcf7fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f3dd0141ff0 0x7f3dd00cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:47094/0 (socket says 172.21.15.84:47094) 2023-07-14T11:14:33.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.705+0000 7f3dcf7fe700 1 -- 172.21.15.84:0/1160381510 learned_addr learned my addr 172.21.15.84:0/1160381510 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:14:33.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.705+0000 7f3dceffd700 1 --2- 172.21.15.84:0/1160381510 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3dd0158fd0 0x7f3dd0070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:33.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.705+0000 7f3dcffff700 1 -- 172.21.15.84:0/1160381510 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3dd0158fd0 msgr2=0x7f3dd0070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:33.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.705+0000 7f3dcffff700 1 --2- 172.21.15.84:0/1160381510 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3dd0158fd0 0x7f3dd0070710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:33.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.705+0000 7f3dcffff700 1 -- 172.21.15.84:0/1160381510 >> v1:172.21.15.84:6789/0 conn(0x7f3dd0141ff0 legacy=0x7f3dd00cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:33.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.705+0000 7f3dcffff700 1 -- 172.21.15.84:0/1160381510 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dd0159440 con 0x7f3dd00b4000 2023-07-14T11:14:33.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.705+0000 7f3dceffd700 1 --2- 172.21.15.84:0/1160381510 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3dd0158fd0 0x7f3dd0070710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:14:33.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.706+0000 7f3dcffff700 1 --2- 172.21.15.84:0/1160381510 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3dd00b4000 0x7f3dd00b1a70 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8009d90 tx=0x7f3dc800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edbc6c42a3e118b7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:33.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.706+0000 7f3dce7fc700 1 -- 172.21.15.84:0/1160381510 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc800bdd0 con 0x7f3dd00b4000 2023-07-14T11:14:33.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.706+0000 7f3dce7fc700 1 -- 172.21.15.84:0/1160381510 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dc8011460 con 0x7f3dd00b4000 2023-07-14T11:14:33.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.706+0000 7f3dce7fc700 1 -- 172.21.15.84:0/1160381510 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc8011810 con 0x7f3dd00b4000 2023-07-14T11:14:33.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.706+0000 7f3dd61ff700 1 -- 172.21.15.84:0/1160381510 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3dd00b4000 msgr2=0x7f3dd00b1a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:33.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.706+0000 7f3dd61ff700 1 --2- 172.21.15.84:0/1160381510 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3dd00b4000 0x7f3dd00b1a70 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8009d90 tx=0x7f3dc800b330 comp rx=0 tx=0).stop 2023-07-14T11:14:33.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.706+0000 7f3dd61ff700 1 -- 172.21.15.84:0/1160381510 shutdown_connections 2023-07-14T11:14:33.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.706+0000 7f3dd61ff700 1 --2- 172.21.15.84:0/1160381510 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3dd00b4000 0x7f3dd00b1a70 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:33.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.706+0000 7f3dd61ff700 1 --2- 172.21.15.84:0/1160381510 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3dd0158fd0 0x7f3dd0070710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:33.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.706+0000 7f3dd61ff700 1 -- 172.21.15.84:0/1160381510 >> 172.21.15.84:0/1160381510 conn(0x7f3dd0069f30 msgr2=0x7f3dd006a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:33.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.707+0000 7f3dd61ff700 1 -- 172.21.15.84:0/1160381510 shutdown_connections 2023-07-14T11:14:33.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.707+0000 7f3dd61ff700 1 -- 172.21.15.84:0/1160381510 wait complete. 2023-07-14T11:14:33.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.708+0000 7f3dd61ff700 1 Processor -- start 2023-07-14T11:14:33.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.708+0000 7f3dd61ff700 1 -- start start 2023-07-14T11:14:33.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.709+0000 7f3dd61ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3dd00b4000 0x7f3dd006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:33.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.709+0000 7f3dd61ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3dd0141ff0 0x7f3dd01f6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:33.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.709+0000 7f3dd61ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3dd0158fd0 0x7f3dd0156440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:33.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.709+0000 7f3dd61ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd006d830 con 0x7f3dd00b4000 2023-07-14T11:14:33.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.709+0000 7f3dd61ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd01f2910 con 0x7f3dd0158fd0 2023-07-14T11:14:33.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.709+0000 7f3dd61ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd013a050 con 0x7f3dd0141ff0 2023-07-14T11:14:33.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.709+0000 7f3dcf7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3dd00b4000 0x7f3dd006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:33.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.710+0000 7f3dcf7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3dd00b4000 0x7f3dd006d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34252/0 (socket says 172.21.15.84:34252) 2023-07-14T11:14:33.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.710+0000 7f3dcf7fe700 1 -- 172.21.15.84:0/2526849410 learned_addr learned my addr 172.21.15.84:0/2526849410 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:33.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.710+0000 7f3dceffd700 1 --2- 172.21.15.84:0/2526849410 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3dd0141ff0 0x7f3dd01f6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:33.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.710+0000 7f3dcffff700 1 --2- 172.21.15.84:0/2526849410 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3dd0158fd0 0x7f3dd0156440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:33.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.710+0000 7f3dcf7fe700 1 -- 172.21.15.84:0/2526849410 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3dd0141ff0 msgr2=0x7f3dd01f6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:33.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.710+0000 7f3dcf7fe700 1 --2- 172.21.15.84:0/2526849410 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3dd0141ff0 0x7f3dd01f6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:33.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.710+0000 7f3dcf7fe700 1 -- 172.21.15.84:0/2526849410 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3dd0158fd0 msgr2=0x7f3dd0156440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:33.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.710+0000 7f3dcf7fe700 1 --2- 172.21.15.84:0/2526849410 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3dd0158fd0 0x7f3dd0156440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:33.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.710+0000 7f3dcf7fe700 1 -- 172.21.15.84:0/2526849410 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dc8009a70 con 0x7f3dd00b4000 2023-07-14T11:14:33.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.710+0000 7f3dcf7fe700 1 --2- 172.21.15.84:0/2526849410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3dd00b4000 0x7f3dd006d1a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f3dc000c520 tx=0x7f3dc000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:33.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.710+0000 7f3db7fff700 1 -- 172.21.15.84:0/2526849410 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc0005d70 con 0x7f3dd00b4000 2023-07-14T11:14:33.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.711+0000 7f3db7fff700 1 -- 172.21.15.84:0/2526849410 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dc00070d0 con 0x7f3dd00b4000 2023-07-14T11:14:33.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.711+0000 7f3dd61ff700 1 -- 172.21.15.84:0/2526849410 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dd01f25c0 con 0x7f3dd00b4000 2023-07-14T11:14:33.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.711+0000 7f3db7fff700 1 -- 172.21.15.84:0/2526849410 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc0007440 con 0x7f3dd00b4000 2023-07-14T11:14:33.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.711+0000 7f3dd61ff700 1 -- 172.21.15.84:0/2526849410 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dd00aeb60 con 0x7f3dd00b4000 2023-07-14T11:14:33.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.712+0000 7f3dd61ff700 1 -- 172.21.15.84:0/2526849410 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dd004e280 con 0x7f3dd00b4000 2023-07-14T11:14:33.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.712+0000 7f3db7fff700 1 -- 172.21.15.84:0/2526849410 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3dc00075a0 con 0x7f3dd00b4000 2023-07-14T11:14:33.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.713+0000 7f3db7fff700 1 --2- 172.21.15.84:0/2526849410 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f3dbc06ace0 0x7f3dbc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:33.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.713+0000 7f3db7fff700 1 -- 172.21.15.84:0/2526849410 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3dc0088730 con 0x7f3dd00b4000 2023-07-14T11:14:33.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.714+0000 7f3dceffd700 1 --2- 172.21.15.84:0/2526849410 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f3dbc06ace0 0x7f3dbc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:33.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.714+0000 7f3dceffd700 1 --2- 172.21.15.84:0/2526849410 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f3dbc06ace0 0x7f3dbc06d190 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3dd006d130 tx=0x7f3dc4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:33.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.718+0000 7f3db7fff700 1 -- 172.21.15.84:0/2526849410 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3dc0053890 con 0x7f3dd00b4000 2023-07-14T11:14:33.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.912+0000 7f3dd61ff700 1 -- 172.21.15.84:0/2526849410 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3dd006f900 con 0x7f3dd00b4000 2023-07-14T11:14:33.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.914+0000 7f3db7fff700 1 -- 172.21.15.84:0/2526849410 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+18340 (secure 0 0 0) 0x7f3dc0056eb0 con 0x7f3dd00b4000 2023-07-14T11:14:33.916 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:14:33.916 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":36,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:14:32.504260+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-14T11:14:30.730753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-14T11:14:31.485809+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:14:33.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.916+0000 7f3dd61ff700 1 -- 172.21.15.84:0/2526849410 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f3dbc06ace0 msgr2=0x7f3dbc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:33.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.916+0000 7f3dd61ff700 1 --2- 172.21.15.84:0/2526849410 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f3dbc06ace0 0x7f3dbc06d190 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3dd006d130 tx=0x7f3dc4008040 comp rx=0 tx=0).stop 2023-07-14T11:14:33.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.916+0000 7f3dd61ff700 1 -- 172.21.15.84:0/2526849410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3dd00b4000 msgr2=0x7f3dd006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:33.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.916+0000 7f3dd61ff700 1 --2- 172.21.15.84:0/2526849410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3dd00b4000 0x7f3dd006d1a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f3dc000c520 tx=0x7f3dc000c830 comp rx=0 tx=0).stop 2023-07-14T11:14:33.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.916+0000 7f3dd61ff700 1 -- 172.21.15.84:0/2526849410 shutdown_connections 2023-07-14T11:14:33.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.916+0000 7f3dd61ff700 1 --2- 172.21.15.84:0/2526849410 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3dd0158fd0 0x7f3dd0156440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:33.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.916+0000 7f3dd61ff700 1 --2- 172.21.15.84:0/2526849410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3dd00b4000 0x7f3dd006d1a0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:33.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.916+0000 7f3dd61ff700 1 --2- 172.21.15.84:0/2526849410 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f3dbc06ace0 0x7f3dbc06d190 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:33.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.916+0000 7f3dd61ff700 1 --2- 172.21.15.84:0/2526849410 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3dd0141ff0 0x7f3dd01f6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:33.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.916+0000 7f3dd61ff700 1 -- 172.21.15.84:0/2526849410 >> 172.21.15.84:0/2526849410 conn(0x7f3dd0069f30 msgr2=0x7f3dd0158350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:33.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.916+0000 7f3dd61ff700 1 -- 172.21.15.84:0/2526849410 shutdown_connections 2023-07-14T11:14:33.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:33.916+0000 7f3dd61ff700 1 -- 172.21.15.84:0/2526849410 wait complete. 2023-07-14T11:14:33.936 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-14T11:14:34.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:34.136+0000 7f6a75fff700 1 Processor -- start 2023-07-14T11:14:34.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:34.137+0000 7f6a75fff700 1 -- start start 2023-07-14T11:14:34.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:34.138+0000 7f6a75fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6a700d0b10 0x7f6a700d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:34.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:34.138+0000 7f6a75fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6a700b0e20 0x7f6a700b1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:34.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:34.138+0000 7f6a75fff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a700b8e30 con 0x7f6a700b8a60 2023-07-14T11:14:34.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:34.138+0000 7f6a75fff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a700d14d0 con 0x7f6a700b0e20 2023-07-14T11:14:34.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:34.138+0000 7f6a75fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a700afaa0 con 0x7f6a700d0b10 2023-07-14T11:14:34.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:34.138+0000 7f6a6f7fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f6a700b8a60 0x7f6a700b3ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:47106/0 (socket says 172.21.15.84:47106) 2023-07-14T11:14:34.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:34.138+0000 7f6a6f7fe700 1 -- 172.21.15.84:0/3734022856 learned_addr learned my addr 172.21.15.84:0/3734022856 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:14:34.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:34.138+0000 7f6a6ffff700 1 --2- 172.21.15.84:0/3734022856 >> v2:172.21.15.84:3300/0 conn(0x7f6a700b0e20 0x7f6a700b1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:34.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:34.138+0000 7f6a67fff700 1 --2- 172.21.15.84:0/3734022856 >> v2:172.21.15.179:3300/0 conn(0x7f6a700d0b10 0x7f6a700d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:34.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:34.138+0000 7f6a6effd700 1 -- 172.21.15.84:0/3734022856 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 955419771 0 0) 0x7f6a700b8e30 con 0x7f6a700b8a60 2023-07-14T11:14:34.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:34.138+0000 7f6a6effd700 1 -- 172.21.15.84:0/3734022856 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a5c0035b0 con 0x7f6a700b8a60 2023-07-14T11:14:34.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:34.139+0000 7f6a6ffff700 1 -- 172.21.15.84:0/3734022856 >> v2:172.21.15.179:3300/0 conn(0x7f6a700d0b10 msgr2=0x7f6a700d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:34.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:34.139+0000 7f6a6ffff700 1 --2- 172.21.15.84:0/3734022856 >> v2:172.21.15.179:3300/0 conn(0x7f6a700d0b10 0x7f6a700d0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:34.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:34.139+0000 7f6a6ffff700 1 -- 172.21.15.84:0/3734022856 >> v1:172.21.15.84:6789/0 conn(0x7f6a700b8a60 legacy=0x7f6a700b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:34.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:34.139+0000 7f6a6ffff700 1 -- 172.21.15.84:0/3734022856 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a700afd80 con 0x7f6a700b0e20 2023-07-14T11:14:34.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:34.139+0000 7f6a6ffff700 1 --2- 172.21.15.84:0/3734022856 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a700b0e20 0x7f6a700b1260 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f6a7009c8e0 tx=0x7f6a6800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bccb99ff42ab1134 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:34.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:34.139+0000 7f6a6effd700 1 -- 172.21.15.84:0/3734022856 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6800e070 con 0x7f6a700b0e20 2023-07-14T11:14:34.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:34.139+0000 7f6a6effd700 1 -- 172.21.15.84:0/3734022856 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a6800bb20 con 0x7f6a700b0e20 2023-07-14T11:14:34.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:34.139+0000 7f6a6effd700 1 -- 172.21.15.84:0/3734022856 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a68012430 con 0x7f6a700b0e20 2023-07-14T11:14:34.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:34.140+0000 7f6a75fff700 1 -- 172.21.15.84:0/3734022856 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a700b0e20 msgr2=0x7f6a700b1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:34.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:34.140+0000 7f6a75fff700 1 --2- 172.21.15.84:0/3734022856 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a700b0e20 0x7f6a700b1260 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f6a7009c8e0 tx=0x7f6a6800b330 comp rx=0 tx=0).stop 2023-07-14T11:14:34.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:34.140+0000 7f6a75fff700 1 -- 172.21.15.84:0/3734022856 shutdown_connections 2023-07-14T11:14:34.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:34.140+0000 7f6a75fff700 1 --2- 172.21.15.84:0/3734022856 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a700b0e20 0x7f6a700b1260 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:34.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:34.140+0000 7f6a75fff700 1 --2- 172.21.15.84:0/3734022856 >> v2:172.21.15.179:3300/0 conn(0x7f6a700d0b10 0x7f6a700d0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:34.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:34.140+0000 7f6a75fff700 1 -- 172.21.15.84:0/3734022856 >> 172.21.15.84:0/3734022856 conn(0x7f6a7009c1b0 msgr2=0x7f6a700d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:34.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:34.140+0000 7f6a75fff700 1 -- 172.21.15.84:0/3734022856 shutdown_connections 2023-07-14T11:14:34.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:34.140+0000 7f6a75fff700 1 -- 172.21.15.84:0/3734022856 wait complete. 2023-07-14T11:14:34.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:34.141+0000 7f6a75fff700 1 Processor -- start 2023-07-14T11:14:34.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:34.142+0000 7f6a75fff700 1 -- start start 2023-07-14T11:14:34.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:34.142+0000 7f6a75fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a700b0e20 0x7f6a7015a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:34.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:34.142+0000 7f6a75fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a700b8a60 0x7f6a7015ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:34.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:34.142+0000 7f6a75fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a700d0b10 0x7f6a700cb720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:34.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:34.142+0000 7f6a75fff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7015ac40 con 0x7f6a700b8a60 2023-07-14T11:14:34.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:34.142+0000 7f6a75fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a700cb2c0 con 0x7f6a700d0b10 2023-07-14T11:14:34.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:34.142+0000 7f6a75fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7015dbe0 con 0x7f6a700b0e20 2023-07-14T11:14:34.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:34.143+0000 7f6a67fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a700b8a60 0x7f6a7015ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:34.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:34.143+0000 7f6a67fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a700b8a60 0x7f6a7015ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34268/0 (socket says 172.21.15.84:34268) 2023-07-14T11:14:34.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:34.143+0000 7f6a67fff700 1 -- 172.21.15.84:0/4133223544 learned_addr learned my addr 172.21.15.84:0/4133223544 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:34.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:34.143+0000 7f6a6f7fe700 1 --2- 172.21.15.84:0/4133223544 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a700b0e20 0x7f6a7015a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:34.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:34.143+0000 7f6a6ffff700 1 --2- 172.21.15.84:0/4133223544 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a700d0b10 0x7f6a700cb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:34.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:34.143+0000 7f6a67fff700 1 -- 172.21.15.84:0/4133223544 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a700b0e20 msgr2=0x7f6a7015a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:34.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:34.143+0000 7f6a67fff700 1 --2- 172.21.15.84:0/4133223544 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a700b0e20 0x7f6a7015a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:34.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:34.143+0000 7f6a67fff700 1 -- 172.21.15.84:0/4133223544 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a700d0b10 msgr2=0x7f6a700cb720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:34.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:34.143+0000 7f6a67fff700 1 --2- 172.21.15.84:0/4133223544 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a700d0b10 0x7f6a700cb720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:34.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:34.143+0000 7f6a67fff700 1 -- 172.21.15.84:0/4133223544 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a68009a70 con 0x7f6a700b8a60 2023-07-14T11:14:34.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:34.143+0000 7f6a67fff700 1 --2- 172.21.15.84:0/4133223544 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a700b8a60 0x7f6a7015ed60 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f6a5800e870 tx=0x7f6a5800eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:34.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:34.144+0000 7f6a6cff9700 1 -- 172.21.15.84:0/4133223544 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a58009590 con 0x7f6a700b8a60 2023-07-14T11:14:34.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:34.144+0000 7f6a6cff9700 1 -- 172.21.15.84:0/4133223544 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a58013680 con 0x7f6a700b8a60 2023-07-14T11:14:34.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:34.144+0000 7f6a6cff9700 1 -- 172.21.15.84:0/4133223544 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a580139f0 con 0x7f6a700b8a60 2023-07-14T11:14:34.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:34.144+0000 7f6a75fff700 1 -- 172.21.15.84:0/4133223544 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a7015dec0 con 0x7f6a700b8a60 2023-07-14T11:14:34.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:34.144+0000 7f6a75fff700 1 -- 172.21.15.84:0/4133223544 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a7015e480 con 0x7f6a700b8a60 2023-07-14T11:14:34.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:34.145+0000 7f6a75fff700 1 -- 172.21.15.84:0/4133223544 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a70074350 con 0x7f6a700b8a60 2023-07-14T11:14:34.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:34.146+0000 7f6a6cff9700 1 -- 172.21.15.84:0/4133223544 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6a58013b50 con 0x7f6a700b8a60 2023-07-14T11:14:34.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:34.147+0000 7f6a6cff9700 1 --2- 172.21.15.84:0/4133223544 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6a5006ace0 0x7f6a5006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:34.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:34.147+0000 7f6a6cff9700 1 -- 172.21.15.84:0/4133223544 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6a58089350 con 0x7f6a700b8a60 2023-07-14T11:14:34.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:34.147+0000 7f6a6f7fe700 1 --2- 172.21.15.84:0/4133223544 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6a5006ace0 0x7f6a5006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:34.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:34.147+0000 7f6a6f7fe700 1 --2- 172.21.15.84:0/4133223544 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6a5006ace0 0x7f6a5006d190 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6a60007fd0 tx=0x7f6a60007dc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:34.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:34.151+0000 7f6a6cff9700 1 -- 172.21.15.84:0/4133223544 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f6a58057e80 con 0x7f6a700b8a60 2023-07-14T11:14:34.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:34.389+0000 7f6a75fff700 1 -- 172.21.15.84:0/4133223544 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f6a700d3d10 con 0x7f6a700b8a60 2023-07-14T11:14:35.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:35.049+0000 7f6a6cff9700 1 -- 172.21.15.84:0/4133223544 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) v1 ==== 118+0+0 (secure 0 0 0) 0x7f6a58057a10 con 0x7f6a700b8a60 2023-07-14T11:14:35.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:35.052+0000 7f6a75fff700 1 -- 172.21.15.84:0/4133223544 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6a5006ace0 msgr2=0x7f6a5006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:35.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:35.052+0000 7f6a75fff700 1 --2- 172.21.15.84:0/4133223544 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6a5006ace0 0x7f6a5006d190 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6a60007fd0 tx=0x7f6a60007dc0 comp rx=0 tx=0).stop 2023-07-14T11:14:35.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:35.052+0000 7f6a75fff700 1 -- 172.21.15.84:0/4133223544 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a700b8a60 msgr2=0x7f6a7015ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:35.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:35.052+0000 7f6a75fff700 1 --2- 172.21.15.84:0/4133223544 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a700b8a60 0x7f6a7015ed60 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f6a5800e870 tx=0x7f6a5800eb80 comp rx=0 tx=0).stop 2023-07-14T11:14:35.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:35.052+0000 7f6a75fff700 1 -- 172.21.15.84:0/4133223544 shutdown_connections 2023-07-14T11:14:35.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:35.052+0000 7f6a75fff700 1 --2- 172.21.15.84:0/4133223544 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6a5006ace0 0x7f6a5006d190 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:35.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:35.052+0000 7f6a75fff700 1 --2- 172.21.15.84:0/4133223544 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a700b0e20 0x7f6a7015a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:35.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:35.052+0000 7f6a75fff700 1 --2- 172.21.15.84:0/4133223544 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a700d0b10 0x7f6a700cb720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:35.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:35.052+0000 7f6a75fff700 1 --2- 172.21.15.84:0/4133223544 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a700b8a60 0x7f6a7015ed60 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:35.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:35.052+0000 7f6a75fff700 1 -- 172.21.15.84:0/4133223544 >> 172.21.15.84:0/4133223544 conn(0x7f6a7009c1b0 msgr2=0x7f6a700b4780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:35.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:35.052+0000 7f6a75fff700 1 -- 172.21.15.84:0/4133223544 shutdown_connections 2023-07-14T11:14:35.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:35.052+0000 7f6a75fff700 1 -- 172.21.15.84:0/4133223544 wait complete. 2023-07-14T11:14:35.074 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-14T11:14:35.075 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-14T11:14:35.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:35.275+0000 7fc08cbff700 1 Processor -- start 2023-07-14T11:14:35.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:35.275+0000 7fc08cbff700 1 -- start start 2023-07-14T11:14:35.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:35.276+0000 7fc08cbff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc0880d0b10 0x7fc0880d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:35.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:35.276+0000 7fc08cbff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0880b8e30 con 0x7fc0880b8a60 2023-07-14T11:14:35.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:35.276+0000 7fc08cbff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0880afaa0 con 0x7fc0880b0e20 2023-07-14T11:14:35.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:35.276+0000 7fc08cbff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0880d14d0 con 0x7fc0880d0b10 2023-07-14T11:14:35.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:35.276+0000 7fc08659c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fc0880b8a60 0x7fc0880b3ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:47114/0 (socket says 172.21.15.84:47114) 2023-07-14T11:14:35.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:35.276+0000 7fc08659c700 1 -- 172.21.15.84:0/3234005411 learned_addr learned my addr 172.21.15.84:0/3234005411 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:14:35.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:35.276+0000 7fc085d9b700 1 --2- 172.21.15.84:0/3234005411 >> v2:172.21.15.84:3300/0 conn(0x7fc0880d0b10 0x7fc0880d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:35.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:35.277+0000 7fc08559a700 1 -- 172.21.15.84:0/3234005411 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1181213507 0 0) 0x7fc0880b8e30 con 0x7fc0880b8a60 2023-07-14T11:14:35.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:35.277+0000 7fc08559a700 1 -- 172.21.15.84:0/3234005411 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0700035b0 con 0x7fc0880b8a60 2023-07-14T11:14:35.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:35.277+0000 7fc085d9b700 1 -- 172.21.15.84:0/3234005411 >> v1:172.21.15.179:6789/0 conn(0x7fc0880b0e20 legacy=0x7fc0880b1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:35.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:35.277+0000 7fc085d9b700 1 -- 172.21.15.84:0/3234005411 >> v1:172.21.15.84:6789/0 conn(0x7fc0880b8a60 legacy=0x7fc0880b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:35.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:35.277+0000 7fc085d9b700 1 -- 172.21.15.84:0/3234005411 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0880afd80 con 0x7fc0880d0b10 2023-07-14T11:14:35.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:35.277+0000 7fc085d9b700 1 --2- 172.21.15.84:0/3234005411 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0880d0b10 0x7fc0880d0f90 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fc07c009840 tx=0x7fc07c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc0d7d7a431ec2ff server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:35.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:35.277+0000 7fc08559a700 1 -- 172.21.15.84:0/3234005411 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07c004230 con 0x7fc0880d0b10 2023-07-14T11:14:35.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:35.277+0000 7fc08559a700 1 -- 172.21.15.84:0/3234005411 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc07c004390 con 0x7fc0880d0b10 2023-07-14T11:14:35.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:35.277+0000 7fc08559a700 1 -- 172.21.15.84:0/3234005411 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07c0036a0 con 0x7fc0880d0b10 2023-07-14T11:14:35.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:35.278+0000 7fc08cbff700 1 -- 172.21.15.84:0/3234005411 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0880d0b10 msgr2=0x7fc0880d0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:35.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:35.278+0000 7fc08cbff700 1 --2- 172.21.15.84:0/3234005411 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0880d0b10 0x7fc0880d0f90 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fc07c009840 tx=0x7fc07c009b50 comp rx=0 tx=0).stop 2023-07-14T11:14:35.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:35.278+0000 7fc08cbff700 1 -- 172.21.15.84:0/3234005411 shutdown_connections 2023-07-14T11:14:35.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:35.278+0000 7fc08cbff700 1 --2- 172.21.15.84:0/3234005411 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0880d0b10 0x7fc0880d0f90 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:35.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:35.278+0000 7fc08cbff700 1 -- 172.21.15.84:0/3234005411 >> 172.21.15.84:0/3234005411 conn(0x7fc08809c1b0 msgr2=0x7fc0880d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:35.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:35.278+0000 7fc08cbff700 1 -- 172.21.15.84:0/3234005411 shutdown_connections 2023-07-14T11:14:35.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:35.278+0000 7fc08cbff700 1 -- 172.21.15.84:0/3234005411 wait complete. 2023-07-14T11:14:35.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:35.280+0000 7fc08cbff700 1 Processor -- start 2023-07-14T11:14:35.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:35.280+0000 7fc08cbff700 1 -- start start 2023-07-14T11:14:35.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:35.281+0000 7fc08cbff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0880b0e20 0x7fc0880a0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:35.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:35.281+0000 7fc08cbff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0880b8a60 0x7fc0880c8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:35.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:35.281+0000 7fc08cbff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0880d0b10 0x7fc0880c9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:35.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:35.281+0000 7fc08cbff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc08809d360 con 0x7fc0880b8a60 2023-07-14T11:14:35.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:35.281+0000 7fc08cbff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0880a0ab0 con 0x7fc0880d0b10 2023-07-14T11:14:35.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:35.281+0000 7fc08cbff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0880c69d0 con 0x7fc0880b0e20 2023-07-14T11:14:35.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:35.281+0000 7fc085d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0880b8a60 0x7fc0880c8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:35.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:35.281+0000 7fc085d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0880b8a60 0x7fc0880c8c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34290/0 (socket says 172.21.15.84:34290) 2023-07-14T11:14:35.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:35.281+0000 7fc085d9b700 1 -- 172.21.15.84:0/1857801499 learned_addr learned my addr 172.21.15.84:0/1857801499 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:35.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:35.281+0000 7fc08659c700 1 --2- 172.21.15.84:0/1857801499 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0880b0e20 0x7fc0880a0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:35.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:35.281+0000 7fc085d9b700 1 -- 172.21.15.84:0/1857801499 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0880b0e20 msgr2=0x7fc0880a0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:35.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:35.281+0000 7fc085d9b700 1 --2- 172.21.15.84:0/1857801499 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0880b0e20 0x7fc0880a0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:35.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:35.281+0000 7fc085d9b700 1 -- 172.21.15.84:0/1857801499 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0880d0b10 msgr2=0x7fc0880c9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:35.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:35.281+0000 7fc086d9d700 1 --2- 172.21.15.84:0/1857801499 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0880d0b10 0x7fc0880c9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:35.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:35.282+0000 7fc085d9b700 1 --2- 172.21.15.84:0/1857801499 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0880d0b10 0x7fc0880c9160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:35.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:35.282+0000 7fc085d9b700 1 -- 172.21.15.84:0/1857801499 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc07c0094a0 con 0x7fc0880b8a60 2023-07-14T11:14:35.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:35.282+0000 7fc08659c700 1 --2- 172.21.15.84:0/1857801499 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0880b0e20 0x7fc0880a0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:14:35.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:35.282+0000 7fc086d9d700 1 --2- 172.21.15.84:0/1857801499 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0880d0b10 0x7fc0880c9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:14:35.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:35.282+0000 7fc085d9b700 1 --2- 172.21.15.84:0/1857801499 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0880b8a60 0x7fc0880c8c20 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fc07c004000 tx=0x7fc07c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:35.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:35.282+0000 7fc076ffd700 1 -- 172.21.15.84:0/1857801499 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07c011630 con 0x7fc0880b8a60 2023-07-14T11:14:35.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:35.282+0000 7fc076ffd700 1 -- 172.21.15.84:0/1857801499 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc07c011790 con 0x7fc0880b8a60 2023-07-14T11:14:35.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:35.282+0000 7fc08cbff700 1 -- 172.21.15.84:0/1857801499 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0880b72b0 con 0x7fc0880b8a60 2023-07-14T11:14:35.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:35.282+0000 7fc076ffd700 1 -- 172.21.15.84:0/1857801499 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07c011b20 con 0x7fc0880b8a60 2023-07-14T11:14:35.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:35.282+0000 7fc08cbff700 1 -- 172.21.15.84:0/1857801499 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0880b7870 con 0x7fc0880b8a60 2023-07-14T11:14:35.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:35.283+0000 7fc08cbff700 1 -- 172.21.15.84:0/1857801499 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0880c67a0 con 0x7fc0880b8a60 2023-07-14T11:14:35.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:35.284+0000 7fc076ffd700 1 -- 172.21.15.84:0/1857801499 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc07c011c80 con 0x7fc0880b8a60 2023-07-14T11:14:35.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:35.285+0000 7fc076ffd700 1 --2- 172.21.15.84:0/1857801499 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc06806ace0 0x7fc06806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:35.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:35.285+0000 7fc076ffd700 1 -- 172.21.15.84:0/1857801499 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc07c08ad40 con 0x7fc0880b8a60 2023-07-14T11:14:35.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:35.285+0000 7fc08659c700 1 --2- 172.21.15.84:0/1857801499 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc06806ace0 0x7fc06806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:35.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:35.286+0000 7fc08659c700 1 --2- 172.21.15.84:0/1857801499 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc06806ace0 0x7fc06806d190 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc0780011e0 tx=0x7fc078009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:35.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:35.289+0000 7fc076ffd700 1 -- 172.21.15.84:0/1857801499 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fc07c055de0 con 0x7fc0880b8a60 2023-07-14T11:14:35.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:35.531+0000 7fc08cbff700 1 -- 172.21.15.84:0/1857801499 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fc088074350 con 0x7fc0880b8a60 2023-07-14T11:14:36.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.051+0000 7fc076ffd700 1 -- 172.21.15.84:0/1857801499 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc07c059400 con 0x7fc0880b8a60 2023-07-14T11:14:36.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.054+0000 7fc08cbff700 1 -- 172.21.15.84:0/1857801499 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc06806ace0 msgr2=0x7fc06806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:36.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.054+0000 7fc08cbff700 1 --2- 172.21.15.84:0/1857801499 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc06806ace0 0x7fc06806d190 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc0780011e0 tx=0x7fc078009040 comp rx=0 tx=0).stop 2023-07-14T11:14:36.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.054+0000 7fc08cbff700 1 -- 172.21.15.84:0/1857801499 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0880b8a60 msgr2=0x7fc0880c8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:36.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.054+0000 7fc08cbff700 1 --2- 172.21.15.84:0/1857801499 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0880b8a60 0x7fc0880c8c20 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fc07c004000 tx=0x7fc07c0047c0 comp rx=0 tx=0).stop 2023-07-14T11:14:36.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.055+0000 7fc08cbff700 1 -- 172.21.15.84:0/1857801499 shutdown_connections 2023-07-14T11:14:36.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.055+0000 7fc08cbff700 1 --2- 172.21.15.84:0/1857801499 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc06806ace0 0x7fc06806d190 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:36.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.055+0000 7fc08cbff700 1 --2- 172.21.15.84:0/1857801499 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0880b0e20 0x7fc0880a0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:36.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.055+0000 7fc08cbff700 1 --2- 172.21.15.84:0/1857801499 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0880d0b10 0x7fc0880c9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:36.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.055+0000 7fc08cbff700 1 --2- 172.21.15.84:0/1857801499 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0880b8a60 0x7fc0880c8c20 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:36.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.055+0000 7fc08cbff700 1 -- 172.21.15.84:0/1857801499 >> 172.21.15.84:0/1857801499 conn(0x7fc08809c1b0 msgr2=0x7fc0880d1640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:36.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.055+0000 7fc08cbff700 1 -- 172.21.15.84:0/1857801499 shutdown_connections 2023-07-14T11:14:36.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.055+0000 7fc08cbff700 1 -- 172.21.15.84:0/1857801499 wait complete. 2023-07-14T11:14:36.076 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-14T11:14:36.076 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T11:14:36.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.271+0000 7f5ea6dff700 1 Processor -- start 2023-07-14T11:14:36.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.271+0000 7f5ea6dff700 1 -- start start 2023-07-14T11:14:36.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.273+0000 7f5ea6dff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5ea0160030 0x7f5ea006c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:36.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.273+0000 7f5ea6dff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ea00d2cc0 con 0x7f5ea00b5cd0 2023-07-14T11:14:36.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.273+0000 7f5ea6dff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ea00afbb0 con 0x7f5ea00d1160 2023-07-14T11:14:36.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.273+0000 7f5ea6dff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ea00afe90 con 0x7f5ea0160030 2023-07-14T11:14:36.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.273+0000 7f5e9ffff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f5ea00b5cd0 0x7f5ea00d0a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:47116/0 (socket says 172.21.15.84:47116) 2023-07-14T11:14:36.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.273+0000 7f5e9ffff700 1 -- 172.21.15.84:0/3872258990 learned_addr learned my addr 172.21.15.84:0/3872258990 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:14:36.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.273+0000 7f5ea4b9b700 1 --2- 172.21.15.84:0/3872258990 >> v2:172.21.15.179:3300/0 conn(0x7f5ea0160030 0x7f5ea006c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:36.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.273+0000 7f5e9f7fe700 1 -- 172.21.15.84:0/3872258990 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 682684857 0 0) 0x7f5ea00d2cc0 con 0x7f5ea00b5cd0 2023-07-14T11:14:36.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.273+0000 7f5e9f7fe700 1 -- 172.21.15.84:0/3872258990 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e900035b0 con 0x7f5ea00b5cd0 2023-07-14T11:14:36.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.274+0000 7f5e9f7fe700 1 -- 172.21.15.84:0/3872258990 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3984673898 0 0) 0x7f5e900035b0 con 0x7f5ea00b5cd0 2023-07-14T11:14:36.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.274+0000 7f5e9f7fe700 1 -- 172.21.15.84:0/3872258990 >> v2:172.21.15.179:3300/0 conn(0x7f5ea0160030 msgr2=0x7f5ea006c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:36.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.274+0000 7f5e9f7fe700 1 --2- 172.21.15.84:0/3872258990 >> v2:172.21.15.179:3300/0 conn(0x7f5ea0160030 0x7f5ea006c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:36.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.274+0000 7f5e9f7fe700 1 -- 172.21.15.84:0/3872258990 >> v1:172.21.15.179:6789/0 conn(0x7f5ea00d1160 legacy=0x7f5ea00b0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:36.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.274+0000 7f5e9f7fe700 1 -- 172.21.15.84:0/3872258990 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ea00b0170 con 0x7f5ea00b5cd0 2023-07-14T11:14:36.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.274+0000 7f5e9f7fe700 1 -- 172.21.15.84:0/3872258990 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7f5e8c001670 con 0x7f5ea00b5cd0 2023-07-14T11:14:36.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.274+0000 7f5e9f7fe700 1 -- 172.21.15.84:0/3872258990 >> v1:172.21.15.84:6789/0 conn(0x7f5ea00b5cd0 legacy=0x7f5ea00d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:36.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.274+0000 7f5e9f7fe700 1 --2- 172.21.15.84:0/3872258990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e90003a50 0x7f5e90003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:36.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.274+0000 7f5e9f7fe700 1 --2- 172.21.15.84:0/3872258990 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e90004850 0x7f5e90004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:36.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.274+0000 7f5e9f7fe700 1 --2- 172.21.15.84:0/3872258990 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e900052d0 0x7f5e9000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:36.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.274+0000 7f5e9f7fe700 1 -- 172.21.15.84:0/3872258990 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea00afe90 con 0x7f5e90003a50 2023-07-14T11:14:36.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.274+0000 7f5e9f7fe700 1 -- 172.21.15.84:0/3872258990 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9000c200 con 0x7f5e900052d0 2023-07-14T11:14:36.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.274+0000 7f5e9f7fe700 1 -- 172.21.15.84:0/3872258990 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9000c3c0 con 0x7f5e90004850 2023-07-14T11:14:36.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.274+0000 7f5ea4b9b700 1 --2- 172.21.15.84:0/3872258990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e90003a50 0x7f5e90003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:36.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.274+0000 7f5ea539c700 1 --2- 172.21.15.84:0/3872258990 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e900052d0 0x7f5e9000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:36.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.274+0000 7f5e9ffff700 1 --2- 172.21.15.84:0/3872258990 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e90004850 0x7f5e90004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:36.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.274+0000 7f5ea4b9b700 1 -- 172.21.15.84:0/3872258990 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e90004850 msgr2=0x7f5e90004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:36.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.274+0000 7f5ea4b9b700 1 --2- 172.21.15.84:0/3872258990 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e90004850 0x7f5e90004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:36.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.274+0000 7f5ea4b9b700 1 -- 172.21.15.84:0/3872258990 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e900052d0 msgr2=0x7f5e9000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:36.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.274+0000 7f5ea4b9b700 1 --2- 172.21.15.84:0/3872258990 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e900052d0 0x7f5e9000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:36.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.274+0000 7f5ea4b9b700 1 -- 172.21.15.84:0/3872258990 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e900035b0 con 0x7f5e90003a50 2023-07-14T11:14:36.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.274+0000 7f5e9ffff700 1 --2- 172.21.15.84:0/3872258990 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e90004850 0x7f5e90004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:14:36.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.274+0000 7f5ea539c700 1 --2- 172.21.15.84:0/3872258990 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e900052d0 0x7f5e9000ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:14:36.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.274+0000 7f5ea539c700 1 -- 172.21.15.84:0/3872258990 reap_dead start 2023-07-14T11:14:36.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.275+0000 7f5ea4b9b700 1 --2- 172.21.15.84:0/3872258990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e90003a50 0x7f5e90003e60 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f5e94009b60 tx=0x7f5e90005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66673dd9ee80204d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:36.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.275+0000 7f5e9f7fe700 1 -- 172.21.15.84:0/3872258990 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9400e6c0 con 0x7f5e90003a50 2023-07-14T11:14:36.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.275+0000 7f5e9f7fe700 1 -- 172.21.15.84:0/3872258990 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e9400e820 con 0x7f5e90003a50 2023-07-14T11:14:36.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.275+0000 7f5e9f7fe700 1 -- 172.21.15.84:0/3872258990 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9400eb90 con 0x7f5e90003a50 2023-07-14T11:14:36.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.275+0000 7f5ea6dff700 1 -- 172.21.15.84:0/3872258990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e90003a50 msgr2=0x7f5e90003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:36.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.275+0000 7f5ea6dff700 1 --2- 172.21.15.84:0/3872258990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e90003a50 0x7f5e90003e60 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f5e94009b60 tx=0x7f5e90005880 comp rx=0 tx=0).stop 2023-07-14T11:14:36.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.275+0000 7f5ea6dff700 1 -- 172.21.15.84:0/3872258990 shutdown_connections 2023-07-14T11:14:36.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.275+0000 7f5ea6dff700 1 --2- 172.21.15.84:0/3872258990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e90003a50 0x7f5e90003e60 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:36.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.275+0000 7f5ea6dff700 1 -- 172.21.15.84:0/3872258990 >> 172.21.15.84:0/3872258990 conn(0x7f5ea009c190 msgr2=0x7f5ea00d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:36.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.275+0000 7f5ea6dff700 1 -- 172.21.15.84:0/3872258990 shutdown_connections 2023-07-14T11:14:36.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.275+0000 7f5ea6dff700 1 -- 172.21.15.84:0/3872258990 wait complete. 2023-07-14T11:14:36.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.277+0000 7f5ea6dff700 1 Processor -- start 2023-07-14T11:14:36.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.277+0000 7f5ea6dff700 1 -- start start 2023-07-14T11:14:36.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.278+0000 7f5ea6dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e90003a50 0x7f5ea0158130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:36.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.278+0000 7f5ea6dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ea00b31d0 0x7f5ea00b3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:36.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.278+0000 7f5ea6dff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ea0158920 0x7f5ea0158d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:36.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.278+0000 7f5ea6dff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea01592d0 con 0x7f5ea0158920 2023-07-14T11:14:36.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.278+0000 7f5ea6dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea01563c0 con 0x7f5e90003a50 2023-07-14T11:14:36.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.278+0000 7f5ea6dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea00b41e0 con 0x7f5ea00b31d0 2023-07-14T11:14:36.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.278+0000 7f5ea539c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ea0158920 0x7f5ea0158d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:36.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.279+0000 7f5ea539c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ea0158920 0x7f5ea0158d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34310/0 (socket says 172.21.15.84:34310) 2023-07-14T11:14:36.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.279+0000 7f5ea539c700 1 -- 172.21.15.84:0/3638481724 learned_addr learned my addr 172.21.15.84:0/3638481724 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:36.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.279+0000 7f5ea4b9b700 1 --2- 172.21.15.84:0/3638481724 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e90003a50 0x7f5ea0158130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:36.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.279+0000 7f5e9ffff700 1 --2- 172.21.15.84:0/3638481724 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ea00b31d0 0x7f5ea00b3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:36.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.279+0000 7f5ea539c700 1 -- 172.21.15.84:0/3638481724 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ea00b31d0 msgr2=0x7f5ea00b3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:36.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.279+0000 7f5ea539c700 1 --2- 172.21.15.84:0/3638481724 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ea00b31d0 0x7f5ea00b3640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:36.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.279+0000 7f5ea539c700 1 -- 172.21.15.84:0/3638481724 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e90003a50 msgr2=0x7f5ea0158130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:36.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.279+0000 7f5ea539c700 1 --2- 172.21.15.84:0/3638481724 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e90003a50 0x7f5ea0158130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:36.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.279+0000 7f5ea539c700 1 -- 172.21.15.84:0/3638481724 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ea00b3c20 con 0x7f5ea0158920 2023-07-14T11:14:36.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.279+0000 7f5ea539c700 1 --2- 172.21.15.84:0/3638481724 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ea0158920 0x7f5ea0158d90 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f5ea00c9f00 tx=0x7f5e9800de00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:36.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.279+0000 7f5e9d7fa700 1 -- 172.21.15.84:0/3638481724 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e98003e10 con 0x7f5ea0158920 2023-07-14T11:14:36.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.279+0000 7f5e9d7fa700 1 -- 172.21.15.84:0/3638481724 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e9800b680 con 0x7f5ea0158920 2023-07-14T11:14:36.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.279+0000 7f5e9d7fa700 1 -- 172.21.15.84:0/3638481724 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9800ba30 con 0x7f5ea0158920 2023-07-14T11:14:36.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.279+0000 7f5ea6dff700 1 -- 172.21.15.84:0/3638481724 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ea00b3f00 con 0x7f5ea0158920 2023-07-14T11:14:36.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.279+0000 7f5ea6dff700 1 -- 172.21.15.84:0/3638481724 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ea0158670 con 0x7f5ea0158920 2023-07-14T11:14:36.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.280+0000 7f5ea6dff700 1 -- 172.21.15.84:0/3638481724 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ea0156550 con 0x7f5ea0158920 2023-07-14T11:14:36.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.281+0000 7f5e9d7fa700 1 -- 172.21.15.84:0/3638481724 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5e9800bb90 con 0x7f5ea0158920 2023-07-14T11:14:36.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.283+0000 7f5e9d7fa700 1 --2- 172.21.15.84:0/3638481724 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f5e8406ace0 0x7f5e8406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:36.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.283+0000 7f5e9d7fa700 1 -- 172.21.15.84:0/3638481724 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5e98089100 con 0x7f5ea0158920 2023-07-14T11:14:36.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.283+0000 7f5ea4b9b700 1 --2- 172.21.15.84:0/3638481724 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f5e8406ace0 0x7f5e8406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:36.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.284+0000 7f5ea4b9b700 1 --2- 172.21.15.84:0/3638481724 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f5e8406ace0 0x7f5e8406d190 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5e940090b0 tx=0x7f5e94008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:36.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.287+0000 7f5e9d7fa700 1 -- 172.21.15.84:0/3638481724 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f5e980541a0 con 0x7f5ea0158920 2023-07-14T11:14:36.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.525+0000 7f5ea6dff700 1 -- 172.21.15.84:0/3638481724 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5ea004e280 con 0x7f5ea0158920 2023-07-14T11:14:36.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.525+0000 7f5e9d7fa700 1 -- 172.21.15.84:0/3638481724 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4700 (secure 0 0 0) 0x7f5e980577c0 con 0x7f5ea0158920 2023-07-14T11:14:36.528 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:14:36.528 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4751,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/76454361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":76454361},{"type":"v1","addr":"172.21.15.179:6833","nonce":76454361}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4757,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/534886511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":534886511},{"type":"v1","addr":"172.21.15.179:6835","nonce":534886511}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5118,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/930551517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":930551517},{"type":"v1","addr":"172.21.15.84:6836","nonce":930551517}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T11:14:32.504609+0000","modified":"2023-07-14T11:14:36.048621+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5121},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5121":{"gid":5121,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.84:6837/932986208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":932986208},{"type":"v1","addr":"172.21.15.84:6837","nonce":932986208}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-14T11:14:36.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.528+0000 7f5ea6dff700 1 -- 172.21.15.84:0/3638481724 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f5e8406ace0 msgr2=0x7f5e8406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:36.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.528+0000 7f5ea6dff700 1 --2- 172.21.15.84:0/3638481724 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f5e8406ace0 0x7f5e8406d190 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5e940090b0 tx=0x7f5e94008030 comp rx=0 tx=0).stop 2023-07-14T11:14:36.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.528+0000 7f5ea6dff700 1 -- 172.21.15.84:0/3638481724 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ea0158920 msgr2=0x7f5ea0158d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:36.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.528+0000 7f5ea6dff700 1 --2- 172.21.15.84:0/3638481724 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ea0158920 0x7f5ea0158d90 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f5ea00c9f00 tx=0x7f5e9800de00 comp rx=0 tx=0).stop 2023-07-14T11:14:36.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.528+0000 7f5ea6dff700 1 -- 172.21.15.84:0/3638481724 shutdown_connections 2023-07-14T11:14:36.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.528+0000 7f5ea6dff700 1 --2- 172.21.15.84:0/3638481724 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ea0158920 0x7f5ea0158d90 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:36.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.528+0000 7f5ea6dff700 1 --2- 172.21.15.84:0/3638481724 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e90003a50 0x7f5ea0158130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:36.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.528+0000 7f5ea6dff700 1 --2- 172.21.15.84:0/3638481724 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f5e8406ace0 0x7f5e8406d190 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:36.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.528+0000 7f5ea6dff700 1 --2- 172.21.15.84:0/3638481724 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ea00b31d0 0x7f5ea00b3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:36.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.528+0000 7f5ea6dff700 1 -- 172.21.15.84:0/3638481724 >> 172.21.15.84:0/3638481724 conn(0x7f5ea009c190 msgr2=0x7f5ea00b7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:36.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.528+0000 7f5ea6dff700 1 -- 172.21.15.84:0/3638481724 shutdown_connections 2023-07-14T11:14:36.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.528+0000 7f5ea6dff700 1 -- 172.21.15.84:0/3638481724 wait complete. 2023-07-14T11:14:36.532 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 18 2023-07-14T11:14:36.548 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:14:36.640 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T11:14:36.646 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T11:14:36.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.752+0000 7f89ac9ff700 1 Processor -- start 2023-07-14T11:14:36.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.752+0000 7f89ac9ff700 1 -- start start 2023-07-14T11:14:36.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.753+0000 7f89ac9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89a815c710 0x7f89a80cf510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:36.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.753+0000 7f89ac9ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89a80cd320 con 0x7f89a806db30 2023-07-14T11:14:36.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.753+0000 7f89ac9ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89a80ce750 con 0x7f89a8069f30 2023-07-14T11:14:36.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.753+0000 7f89ac9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89a80cea30 con 0x7f89a815c710 2023-07-14T11:14:36.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.754+0000 7f89a6d9d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f89a806db30 0x7f89a8070950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:47130/0 (socket says 172.21.15.84:47130) 2023-07-14T11:14:36.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.754+0000 7f89a6d9d700 1 -- 172.21.15.84:0/3096890363 learned_addr learned my addr 172.21.15.84:0/3096890363 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:14:36.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.754+0000 7f89a659c700 1 --2- 172.21.15.84:0/3096890363 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89a815c710 0x7f89a80cf510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:36.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.754+0000 7f89a559a700 1 -- 172.21.15.84:0/3096890363 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 216308775 0 0) 0x7f89a80cd320 con 0x7f89a806db30 2023-07-14T11:14:36.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.754+0000 7f89a559a700 1 -- 172.21.15.84:0/3096890363 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89900035b0 con 0x7f89a806db30 2023-07-14T11:14:36.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.754+0000 7f89a559a700 1 -- 172.21.15.84:0/3096890363 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 849123778 0 0) 0x7f89a80ce750 con 0x7f89a8069f30 2023-07-14T11:14:36.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.754+0000 7f89a559a700 1 -- 172.21.15.84:0/3096890363 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89a80cd320 con 0x7f89a8069f30 2023-07-14T11:14:36.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.754+0000 7f89a659c700 1 -- 172.21.15.84:0/3096890363 >> v1:172.21.15.179:6789/0 conn(0x7f89a8069f30 legacy=0x7f89a806d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:36.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.754+0000 7f89a659c700 1 -- 172.21.15.84:0/3096890363 >> v1:172.21.15.84:6789/0 conn(0x7f89a806db30 legacy=0x7f89a8070950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:36.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.754+0000 7f89a659c700 1 -- 172.21.15.84:0/3096890363 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a80ced10 con 0x7f89a815c710 2023-07-14T11:14:36.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.755+0000 7f89a659c700 1 --2- 172.21.15.84:0/3096890363 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89a815c710 0x7f89a80cf510 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8998009870 tx=0x7f8998009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=379bf35e609e7128 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:36.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.755+0000 7f89a559a700 1 -- 172.21.15.84:0/3096890363 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8998011830 con 0x7f89a815c710 2023-07-14T11:14:36.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.755+0000 7f89a559a700 1 -- 172.21.15.84:0/3096890363 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8998011990 con 0x7f89a815c710 2023-07-14T11:14:36.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.755+0000 7f89a559a700 1 -- 172.21.15.84:0/3096890363 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8998011d20 con 0x7f89a815c710 2023-07-14T11:14:36.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.755+0000 7f89ac9ff700 1 -- 172.21.15.84:0/3096890363 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89a815c710 msgr2=0x7f89a80cf510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:36.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.755+0000 7f89ac9ff700 1 --2- 172.21.15.84:0/3096890363 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89a815c710 0x7f89a80cf510 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8998009870 tx=0x7f8998009b80 comp rx=0 tx=0).stop 2023-07-14T11:14:36.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.755+0000 7f89ac9ff700 1 -- 172.21.15.84:0/3096890363 shutdown_connections 2023-07-14T11:14:36.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.755+0000 7f89ac9ff700 1 --2- 172.21.15.84:0/3096890363 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89a815c710 0x7f89a80cf510 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:36.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.755+0000 7f89ac9ff700 1 -- 172.21.15.84:0/3096890363 >> 172.21.15.84:0/3096890363 conn(0x7f89a80b16c0 msgr2=0x7f89a80b1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:36.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.756+0000 7f89ac9ff700 1 -- 172.21.15.84:0/3096890363 shutdown_connections 2023-07-14T11:14:36.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.756+0000 7f89ac9ff700 1 -- 172.21.15.84:0/3096890363 wait complete. 2023-07-14T11:14:36.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.757+0000 7f89ac9ff700 1 Processor -- start 2023-07-14T11:14:36.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.757+0000 7f89ac9ff700 1 -- start start 2023-07-14T11:14:36.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.758+0000 7f89ac9ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89a8069f30 0x7f89a815cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:36.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.758+0000 7f89ac9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89a806db30 0x7f89a8150430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:36.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.758+0000 7f89ac9ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89a815f950 0x7f89a815e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:36.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.758+0000 7f89ac9ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a8151440 con 0x7f89a8069f30 2023-07-14T11:14:36.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.758+0000 7f89ac9ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a8150970 con 0x7f89a815f950 2023-07-14T11:14:36.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.758+0000 7f89ac9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89a80b5980 con 0x7f89a806db30 2023-07-14T11:14:36.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.759+0000 7f89a659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89a8069f30 0x7f89a815cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:36.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.759+0000 7f89a659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89a8069f30 0x7f89a815cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34320/0 (socket says 172.21.15.84:34320) 2023-07-14T11:14:36.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.759+0000 7f89a659c700 1 -- 172.21.15.84:0/2632063046 learned_addr learned my addr 172.21.15.84:0/2632063046 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:36.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.759+0000 7f89a5d9b700 1 --2- 172.21.15.84:0/2632063046 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89a806db30 0x7f89a8150430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:36.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.759+0000 7f89a6d9d700 1 --2- 172.21.15.84:0/2632063046 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89a815f950 0x7f89a815e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:36.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.759+0000 7f89a659c700 1 -- 172.21.15.84:0/2632063046 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89a806db30 msgr2=0x7f89a8150430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:36.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.759+0000 7f89a659c700 1 --2- 172.21.15.84:0/2632063046 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89a806db30 0x7f89a8150430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:36.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.759+0000 7f89a659c700 1 -- 172.21.15.84:0/2632063046 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89a815f950 msgr2=0x7f89a815e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:36.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.759+0000 7f89a659c700 1 --2- 172.21.15.84:0/2632063046 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89a815f950 0x7f89a815e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:36.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.759+0000 7f89a659c700 1 -- 172.21.15.84:0/2632063046 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89980094a0 con 0x7f89a8069f30 2023-07-14T11:14:36.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.759+0000 7f89a659c700 1 --2- 172.21.15.84:0/2632063046 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89a8069f30 0x7f89a815cb20 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f8998014040 tx=0x7f8998004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:36.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.760+0000 7f8996ffd700 1 -- 172.21.15.84:0/2632063046 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f899801a6e0 con 0x7f89a8069f30 2023-07-14T11:14:36.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.760+0000 7f8996ffd700 1 -- 172.21.15.84:0/2632063046 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f899801a840 con 0x7f89a8069f30 2023-07-14T11:14:36.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.760+0000 7f8996ffd700 1 -- 172.21.15.84:0/2632063046 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f899801abb0 con 0x7f89a8069f30 2023-07-14T11:14:36.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.760+0000 7f89ac9ff700 1 -- 172.21.15.84:0/2632063046 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89a806ac20 con 0x7f89a8069f30 2023-07-14T11:14:36.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.760+0000 7f89ac9ff700 1 -- 172.21.15.84:0/2632063046 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89a80b56a0 con 0x7f89a8069f30 2023-07-14T11:14:36.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.761+0000 7f89ac9ff700 1 -- 172.21.15.84:0/2632063046 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89a804e280 con 0x7f89a8069f30 2023-07-14T11:14:36.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.763+0000 7f8996ffd700 1 -- 172.21.15.84:0/2632063046 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8998022070 con 0x7f89a8069f30 2023-07-14T11:14:36.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.764+0000 7f8996ffd700 1 --2- 172.21.15.84:0/2632063046 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f898806ace0 0x7f898806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:36.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.764+0000 7f8996ffd700 1 -- 172.21.15.84:0/2632063046 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8998089f40 con 0x7f89a8069f30 2023-07-14T11:14:36.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.764+0000 7f89a5d9b700 1 --2- 172.21.15.84:0/2632063046 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f898806ace0 0x7f898806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:36.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.765+0000 7f89a5d9b700 1 --2- 172.21.15.84:0/2632063046 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f898806ace0 0x7f898806d190 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f89a80b4ae0 tx=0x7f899c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:36.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.769+0000 7f8996ffd700 1 -- 172.21.15.84:0/2632063046 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f8998055130 con 0x7f89a8069f30 2023-07-14T11:14:36.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.964+0000 7f89ac9ff700 1 -- 172.21.15.84:0/2632063046 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f89a8065f40 con 0x7f89a8069f30 2023-07-14T11:14:36.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.966+0000 7f8996ffd700 1 -- 172.21.15.84:0/2632063046 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18327 (secure 0 0 0) 0x7f8998029090 con 0x7f89a8069f30 2023-07-14T11:14:36.968 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:14:36.969 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":37,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:14:34.030805+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-14T11:14:30.730753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-14T11:14:31.485809+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:14:36.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.968+0000 7f89ac9ff700 1 -- 172.21.15.84:0/2632063046 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f898806ace0 msgr2=0x7f898806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:36.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.968+0000 7f89ac9ff700 1 --2- 172.21.15.84:0/2632063046 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f898806ace0 0x7f898806d190 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f89a80b4ae0 tx=0x7f899c009040 comp rx=0 tx=0).stop 2023-07-14T11:14:36.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.968+0000 7f89ac9ff700 1 -- 172.21.15.84:0/2632063046 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89a8069f30 msgr2=0x7f89a815cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:36.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.968+0000 7f89ac9ff700 1 --2- 172.21.15.84:0/2632063046 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89a8069f30 0x7f89a815cb20 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f8998014040 tx=0x7f8998004750 comp rx=0 tx=0).stop 2023-07-14T11:14:36.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.968+0000 7f89ac9ff700 1 -- 172.21.15.84:0/2632063046 shutdown_connections 2023-07-14T11:14:36.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.968+0000 7f89ac9ff700 1 --2- 172.21.15.84:0/2632063046 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89a815f950 0x7f89a815e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:36.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.968+0000 7f89ac9ff700 1 --2- 172.21.15.84:0/2632063046 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89a8069f30 0x7f89a815cb20 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:36.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.968+0000 7f89ac9ff700 1 --2- 172.21.15.84:0/2632063046 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f898806ace0 0x7f898806d190 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:36.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.968+0000 7f89ac9ff700 1 --2- 172.21.15.84:0/2632063046 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89a806db30 0x7f89a8150430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:36.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.968+0000 7f89ac9ff700 1 -- 172.21.15.84:0/2632063046 >> 172.21.15.84:0/2632063046 conn(0x7f89a80b16c0 msgr2=0x7f89a806d420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:36.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.968+0000 7f89ac9ff700 1 -- 172.21.15.84:0/2632063046 shutdown_connections 2023-07-14T11:14:36.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:36.968+0000 7f89ac9ff700 1 -- 172.21.15.84:0/2632063046 wait complete. 2023-07-14T11:14:36.988 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-14T11:14:36.989 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T11:14:37.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.224+0000 7f930d7ff700 1 Processor -- start 2023-07-14T11:14:37.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.224+0000 7f930d7ff700 1 -- start start 2023-07-14T11:14:37.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.225+0000 7f930d7ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f93080cd360 0x7f9308167ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:37.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.225+0000 7f930d7ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9308072080 con 0x7f93080b4570 2023-07-14T11:14:37.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.225+0000 7f930d7ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f930806a2b0 con 0x7f93080ccf10 2023-07-14T11:14:37.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.225+0000 7f930d7ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f930806d7a0 con 0x7f93080cd360 2023-07-14T11:14:37.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.225+0000 7f9306ffd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f93080b4570 0x7f93080b4940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:47144/0 (socket says 172.21.15.84:47144) 2023-07-14T11:14:37.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.225+0000 7f9306ffd700 1 -- 172.21.15.84:0/2001767113 learned_addr learned my addr 172.21.15.84:0/2001767113 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:14:37.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.226+0000 7f93077fe700 1 --2- 172.21.15.84:0/2001767113 >> v2:172.21.15.179:3300/0 conn(0x7f93080cd360 0x7f9308167ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:37.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.226+0000 7f9305ffb700 1 -- 172.21.15.84:0/2001767113 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 149849233 0 0) 0x7f9308072080 con 0x7f93080b4570 2023-07-14T11:14:37.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.226+0000 7f9305ffb700 1 -- 172.21.15.84:0/2001767113 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92f00035b0 con 0x7f93080b4570 2023-07-14T11:14:37.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.226+0000 7f9305ffb700 1 -- 172.21.15.84:0/2001767113 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2859138927 0 0) 0x7f930806a2b0 con 0x7f93080ccf10 2023-07-14T11:14:37.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.226+0000 7f9305ffb700 1 -- 172.21.15.84:0/2001767113 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9308072080 con 0x7f93080ccf10 2023-07-14T11:14:37.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.226+0000 7f93077fe700 1 -- 172.21.15.84:0/2001767113 >> v1:172.21.15.179:6789/0 conn(0x7f93080ccf10 legacy=0x7f930806cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:37.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.226+0000 7f93077fe700 1 -- 172.21.15.84:0/2001767113 >> v1:172.21.15.84:6789/0 conn(0x7f93080b4570 legacy=0x7f93080b4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:37.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.226+0000 7f93077fe700 1 -- 172.21.15.84:0/2001767113 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f930806d9b0 con 0x7f93080cd360 2023-07-14T11:14:37.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.226+0000 7f93077fe700 1 --2- 172.21.15.84:0/2001767113 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93080cd360 0x7f9308167ea0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9300009d90 tx=0x7f930000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eac8b7ef94287cb2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:37.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.227+0000 7f9305ffb700 1 -- 172.21.15.84:0/2001767113 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f930000e070 con 0x7f93080cd360 2023-07-14T11:14:37.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.227+0000 7f9305ffb700 1 -- 172.21.15.84:0/2001767113 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f930000bb20 con 0x7f93080cd360 2023-07-14T11:14:37.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.227+0000 7f9305ffb700 1 -- 172.21.15.84:0/2001767113 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9300012430 con 0x7f93080cd360 2023-07-14T11:14:37.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.227+0000 7f930d7ff700 1 -- 172.21.15.84:0/2001767113 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93080cd360 msgr2=0x7f9308167ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:37.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.227+0000 7f930d7ff700 1 --2- 172.21.15.84:0/2001767113 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93080cd360 0x7f9308167ea0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9300009d90 tx=0x7f930000b330 comp rx=0 tx=0).stop 2023-07-14T11:14:37.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.227+0000 7f930d7ff700 1 -- 172.21.15.84:0/2001767113 shutdown_connections 2023-07-14T11:14:37.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.227+0000 7f930d7ff700 1 --2- 172.21.15.84:0/2001767113 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93080cd360 0x7f9308167ea0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:37.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.227+0000 7f930d7ff700 1 -- 172.21.15.84:0/2001767113 >> 172.21.15.84:0/2001767113 conn(0x7f93080b2ef0 msgr2=0x7f9308071530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:37.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.227+0000 7f930d7ff700 1 -- 172.21.15.84:0/2001767113 shutdown_connections 2023-07-14T11:14:37.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.227+0000 7f930d7ff700 1 -- 172.21.15.84:0/2001767113 wait complete. 2023-07-14T11:14:37.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.229+0000 7f930d7ff700 1 Processor -- start 2023-07-14T11:14:37.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.229+0000 7f930d7ff700 1 -- start start 2023-07-14T11:14:37.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.230+0000 7f930d7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93080b4570 0x7f93081f2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:37.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.230+0000 7f930d7ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93080ccf10 0x7f930815ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:37.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.230+0000 7f930d7ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93080cd360 0x7f93080ade70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:37.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.230+0000 7f930d7ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f930815fd20 con 0x7f93080cd360 2023-07-14T11:14:37.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.230+0000 7f930d7ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93080adb20 con 0x7f93080ccf10 2023-07-14T11:14:37.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.230+0000 7f930d7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f930815ff70 con 0x7f93080b4570 2023-07-14T11:14:37.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.230+0000 7f93077fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93080cd360 0x7f93080ade70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:37.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.230+0000 7f93077fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93080cd360 0x7f93080ade70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34336/0 (socket says 172.21.15.84:34336) 2023-07-14T11:14:37.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.230+0000 7f93077fe700 1 -- 172.21.15.84:0/93859328 learned_addr learned my addr 172.21.15.84:0/93859328 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:37.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.231+0000 7f93077fe700 1 -- 172.21.15.84:0/93859328 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93080b4570 msgr2=0x7f93081f2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:37.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.231+0000 7f93077fe700 1 --2- 172.21.15.84:0/93859328 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93080b4570 0x7f93081f2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:37.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.231+0000 7f93077fe700 1 -- 172.21.15.84:0/93859328 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93080ccf10 msgr2=0x7f930815ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:37.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.231+0000 7f93077fe700 1 --2- 172.21.15.84:0/93859328 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93080ccf10 0x7f930815ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:37.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.231+0000 7f93077fe700 1 -- 172.21.15.84:0/93859328 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9300009a70 con 0x7f93080cd360 2023-07-14T11:14:37.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.231+0000 7f93077fe700 1 --2- 172.21.15.84:0/93859328 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93080cd360 0x7f93080ade70 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f9300013000 tx=0x7f9300004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:37.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.231+0000 7f92ef7fe700 1 -- 172.21.15.84:0/93859328 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f930001b810 con 0x7f93080cd360 2023-07-14T11:14:37.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.231+0000 7f92ef7fe700 1 -- 172.21.15.84:0/93859328 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9300020070 con 0x7f93080cd360 2023-07-14T11:14:37.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.231+0000 7f930d7ff700 1 -- 172.21.15.84:0/93859328 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93080ad840 con 0x7f93080cd360 2023-07-14T11:14:37.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.231+0000 7f92ef7fe700 1 -- 172.21.15.84:0/93859328 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f930001bbf0 con 0x7f93080cd360 2023-07-14T11:14:37.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.231+0000 7f930d7ff700 1 -- 172.21.15.84:0/93859328 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f930815f6c0 con 0x7f93080cd360 2023-07-14T11:14:37.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.232+0000 7f930d7ff700 1 -- 172.21.15.84:0/93859328 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93080c4de0 con 0x7f93080cd360 2023-07-14T11:14:37.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.233+0000 7f92ef7fe700 1 -- 172.21.15.84:0/93859328 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f930001bd50 con 0x7f93080cd360 2023-07-14T11:14:37.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.234+0000 7f92ef7fe700 1 --2- 172.21.15.84:0/93859328 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f92f406ace0 0x7f92f406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:37.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.234+0000 7f92ef7fe700 1 -- 172.21.15.84:0/93859328 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9300022070 con 0x7f93080cd360 2023-07-14T11:14:37.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.234+0000 7f9306ffd700 1 --2- 172.21.15.84:0/93859328 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f92f406ace0 0x7f92f406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:37.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.235+0000 7f9306ffd700 1 --2- 172.21.15.84:0/93859328 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f92f406ace0 0x7f92f406d190 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f92f8005910 tx=0x7f92f80079e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:37.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.238+0000 7f92ef7fe700 1 -- 172.21.15.84:0/93859328 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f93080c4de0 con 0x7f93080cd360 2023-07-14T11:14:37.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.429+0000 7f930d7ff700 1 -- 172.21.15.84:0/93859328 --> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f93080d01e0 con 0x7f92f406ace0 2023-07-14T11:14:37.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.439+0000 7f92ef7fe700 1 -- 172.21.15.84:0/93859328 <== mgr.4104 v2:172.21.15.84:6832/379617029 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310908 (secure 0 0 0) 0x7f92f8001350 con 0x7f92f406ace0 2023-07-14T11:14:37.445 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:14:37.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.443+0000 7f930d7ff700 1 -- 172.21.15.84:0/93859328 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f92f406ace0 msgr2=0x7f92f406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:37.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.443+0000 7f930d7ff700 1 --2- 172.21.15.84:0/93859328 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f92f406ace0 0x7f92f406d190 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f92f8005910 tx=0x7f92f80079e0 comp rx=0 tx=0).stop 2023-07-14T11:14:37.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.443+0000 7f930d7ff700 1 -- 172.21.15.84:0/93859328 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93080cd360 msgr2=0x7f93080ade70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:37.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.443+0000 7f930d7ff700 1 --2- 172.21.15.84:0/93859328 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93080cd360 0x7f93080ade70 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f9300013000 tx=0x7f9300004ad0 comp rx=0 tx=0).stop 2023-07-14T11:14:37.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.444+0000 7f930d7ff700 1 -- 172.21.15.84:0/93859328 shutdown_connections 2023-07-14T11:14:37.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.444+0000 7f930d7ff700 1 --2- 172.21.15.84:0/93859328 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f92f406ace0 0x7f92f406d190 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:37.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.444+0000 7f930d7ff700 1 --2- 172.21.15.84:0/93859328 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93080b4570 0x7f93081f2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:37.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.444+0000 7f930d7ff700 1 --2- 172.21.15.84:0/93859328 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93080cd360 0x7f93080ade70 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:37.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.444+0000 7f930d7ff700 1 --2- 172.21.15.84:0/93859328 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93080ccf10 0x7f930815ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:37.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.444+0000 7f930d7ff700 1 -- 172.21.15.84:0/93859328 >> 172.21.15.84:0/93859328 conn(0x7f93080b2ef0 msgr2=0x7f93080ce3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:37.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.444+0000 7f930d7ff700 1 -- 172.21.15.84:0/93859328 shutdown_connections 2023-07-14T11:14:37.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.444+0000 7f930d7ff700 1 -- 172.21.15.84:0/93859328 wait complete. 2023-07-14T11:14:37.448 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-07-14T11:14:37.464 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":78,"stamp":"2023-07-14T11:14:36.088475+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":151,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220088,"kb_used_data":4472,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754754632,"statfs":{"total":773094113280,"available":772868743168,"internally_reserved":0,"allocated":4579328,"data_stored":2561888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.079070"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.639929+0000","last_change":"2023-07-14T11:14:33.057562+0000","last_active":"2023-07-14T11:14:34.639929+0000","last_peered":"2023-07-14T11:14:34.639929+0000","last_clean":"2023-07-14T11:14:34.639929+0000","last_became_active":"2023-07-14T11:14:33.057300+0000","last_became_peered":"2023-07-14T11:14:33.057300+0000","last_unstale":"2023-07-14T11:14:34.639929+0000","last_undegraded":"2023-07-14T11:14:34.639929+0000","last_fullsized":"2023-07-14T11:14:34.639929+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:31:18.643967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.639993+0000","last_change":"2023-07-14T11:14:33.040869+0000","last_active":"2023-07-14T11:14:34.639993+0000","last_peered":"2023-07-14T11:14:34.639993+0000","last_clean":"2023-07-14T11:14:34.639993+0000","last_became_active":"2023-07-14T11:14:33.040460+0000","last_became_peered":"2023-07-14T11:14:33.040460+0000","last_unstale":"2023-07-14T11:14:34.639993+0000","last_undegraded":"2023-07-14T11:14:34.639993+0000","last_fullsized":"2023-07-14T11:14:34.639993+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:56:02.633239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.062957+0000","last_change":"2023-07-14T11:14:33.056417+0000","last_active":"2023-07-14T11:14:33.062957+0000","last_peered":"2023-07-14T11:14:33.062957+0000","last_clean":"2023-07-14T11:14:33.062957+0000","last_became_active":"2023-07-14T11:14:33.056213+0000","last_became_peered":"2023-07-14T11:14:33.056213+0000","last_unstale":"2023-07-14T11:14:33.062957+0000","last_undegraded":"2023-07-14T11:14:33.062957+0000","last_fullsized":"2023-07-14T11:14:33.062957+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:00:42.807003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.040340+0000","last_change":"2023-07-14T11:14:33.043957+0000","last_active":"2023-07-14T11:14:34.040340+0000","last_peered":"2023-07-14T11:14:34.040340+0000","last_clean":"2023-07-14T11:14:34.040340+0000","last_became_active":"2023-07-14T11:14:33.043466+0000","last_became_peered":"2023-07-14T11:14:33.043466+0000","last_unstale":"2023-07-14T11:14:34.040340+0000","last_undegraded":"2023-07-14T11:14:34.040340+0000","last_fullsized":"2023-07-14T11:14:34.040340+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:29:51.449238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.040106+0000","last_change":"2023-07-14T11:14:33.043247+0000","last_active":"2023-07-14T11:14:34.040106+0000","last_peered":"2023-07-14T11:14:34.040106+0000","last_clean":"2023-07-14T11:14:34.040106+0000","last_became_active":"2023-07-14T11:14:33.042782+0000","last_became_peered":"2023-07-14T11:14:33.042782+0000","last_unstale":"2023-07-14T11:14:34.040106+0000","last_undegraded":"2023-07-14T11:14:34.040106+0000","last_fullsized":"2023-07-14T11:14:34.040106+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:35:06.611719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.038948+0000","last_change":"2023-07-14T11:14:33.041873+0000","last_active":"2023-07-14T11:14:34.038948+0000","last_peered":"2023-07-14T11:14:34.038948+0000","last_clean":"2023-07-14T11:14:34.038948+0000","last_became_active":"2023-07-14T11:14:33.041590+0000","last_became_peered":"2023-07-14T11:14:33.041590+0000","last_unstale":"2023-07-14T11:14:34.038948+0000","last_undegraded":"2023-07-14T11:14:34.038948+0000","last_fullsized":"2023-07-14T11:14:34.038948+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:04:20.820987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.039601+0000","last_change":"2023-07-14T11:14:33.045113+0000","last_active":"2023-07-14T11:14:34.039601+0000","last_peered":"2023-07-14T11:14:34.039601+0000","last_clean":"2023-07-14T11:14:34.039601+0000","last_became_active":"2023-07-14T11:14:33.044827+0000","last_became_peered":"2023-07-14T11:14:33.044827+0000","last_unstale":"2023-07-14T11:14:34.039601+0000","last_undegraded":"2023-07-14T11:14:34.039601+0000","last_fullsized":"2023-07-14T11:14:34.039601+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:27:02.057195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.639651+0000","last_change":"2023-07-14T11:14:33.054584+0000","last_active":"2023-07-14T11:14:34.639651+0000","last_peered":"2023-07-14T11:14:34.639651+0000","last_clean":"2023-07-14T11:14:34.639651+0000","last_became_active":"2023-07-14T11:14:33.054306+0000","last_became_peered":"2023-07-14T11:14:33.054306+0000","last_unstale":"2023-07-14T11:14:34.639651+0000","last_undegraded":"2023-07-14T11:14:34.639651+0000","last_fullsized":"2023-07-14T11:14:34.639651+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:24:21.374319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.062981+0000","last_change":"2023-07-14T11:14:33.054741+0000","last_active":"2023-07-14T11:14:33.062981+0000","last_peered":"2023-07-14T11:14:33.062981+0000","last_clean":"2023-07-14T11:14:33.062981+0000","last_became_active":"2023-07-14T11:14:33.054233+0000","last_became_peered":"2023-07-14T11:14:33.054233+0000","last_unstale":"2023-07-14T11:14:33.062981+0000","last_undegraded":"2023-07-14T11:14:33.062981+0000","last_fullsized":"2023-07-14T11:14:33.062981+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:41:30.697733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.040118+0000","last_change":"2023-07-14T11:14:33.053943+0000","last_active":"2023-07-14T11:14:34.040118+0000","last_peered":"2023-07-14T11:14:34.040118+0000","last_clean":"2023-07-14T11:14:34.040118+0000","last_became_active":"2023-07-14T11:14:33.053618+0000","last_became_peered":"2023-07-14T11:14:33.053618+0000","last_unstale":"2023-07-14T11:14:34.040118+0000","last_undegraded":"2023-07-14T11:14:34.040118+0000","last_fullsized":"2023-07-14T11:14:34.040118+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:08:22.219306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.040449+0000","last_change":"2023-07-14T11:14:33.053887+0000","last_active":"2023-07-14T11:14:34.040449+0000","last_peered":"2023-07-14T11:14:34.040449+0000","last_clean":"2023-07-14T11:14:34.040449+0000","last_became_active":"2023-07-14T11:14:33.053595+0000","last_became_peered":"2023-07-14T11:14:33.053595+0000","last_unstale":"2023-07-14T11:14:34.040449+0000","last_undegraded":"2023-07-14T11:14:34.040449+0000","last_fullsized":"2023-07-14T11:14:34.040449+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:33:04.330827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.060204+0000","last_change":"2023-07-14T11:14:33.052449+0000","last_active":"2023-07-14T11:14:33.060204+0000","last_peered":"2023-07-14T11:14:33.060204+0000","last_clean":"2023-07-14T11:14:33.060204+0000","last_became_active":"2023-07-14T11:14:33.052132+0000","last_became_peered":"2023-07-14T11:14:33.052132+0000","last_unstale":"2023-07-14T11:14:33.060204+0000","last_undegraded":"2023-07-14T11:14:33.060204+0000","last_fullsized":"2023-07-14T11:14:33.060204+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:10:14.555560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.039768+0000","last_change":"2023-07-14T11:14:33.055155+0000","last_active":"2023-07-14T11:14:34.039768+0000","last_peered":"2023-07-14T11:14:34.039768+0000","last_clean":"2023-07-14T11:14:34.039768+0000","last_became_active":"2023-07-14T11:14:33.054650+0000","last_became_peered":"2023-07-14T11:14:33.054650+0000","last_unstale":"2023-07-14T11:14:34.039768+0000","last_undegraded":"2023-07-14T11:14:34.039768+0000","last_fullsized":"2023-07-14T11:14:34.039768+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:08:53.497925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.052546+0000","last_change":"2023-07-14T11:14:33.047908+0000","last_active":"2023-07-14T11:14:33.052546+0000","last_peered":"2023-07-14T11:14:33.052546+0000","last_clean":"2023-07-14T11:14:33.052546+0000","last_became_active":"2023-07-14T11:14:33.047567+0000","last_became_peered":"2023-07-14T11:14:33.047567+0000","last_unstale":"2023-07-14T11:14:33.052546+0000","last_undegraded":"2023-07-14T11:14:33.052546+0000","last_fullsized":"2023-07-14T11:14:33.052546+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:33:35.066799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.039809+0000","last_change":"2023-07-14T11:14:33.051764+0000","last_active":"2023-07-14T11:14:34.039809+0000","last_peered":"2023-07-14T11:14:34.039809+0000","last_clean":"2023-07-14T11:14:34.039809+0000","last_became_active":"2023-07-14T11:14:33.051452+0000","last_became_peered":"2023-07-14T11:14:33.051452+0000","last_unstale":"2023-07-14T11:14:34.039809+0000","last_undegraded":"2023-07-14T11:14:34.039809+0000","last_fullsized":"2023-07-14T11:14:34.039809+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:54:54.997480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.063901+0000","last_change":"2023-07-14T11:14:33.059555+0000","last_active":"2023-07-14T11:14:33.063901+0000","last_peered":"2023-07-14T11:14:33.063901+0000","last_clean":"2023-07-14T11:14:33.063901+0000","last_became_active":"2023-07-14T11:14:33.059065+0000","last_became_peered":"2023-07-14T11:14:33.059065+0000","last_unstale":"2023-07-14T11:14:33.063901+0000","last_undegraded":"2023-07-14T11:14:33.063901+0000","last_fullsized":"2023-07-14T11:14:33.063901+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:27:02.057195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.060426+0000","last_change":"2023-07-14T11:14:33.056183+0000","last_active":"2023-07-14T11:14:33.060426+0000","last_peered":"2023-07-14T11:14:33.060426+0000","last_clean":"2023-07-14T11:14:33.060426+0000","last_became_active":"2023-07-14T11:14:33.055884+0000","last_became_peered":"2023-07-14T11:14:33.055884+0000","last_unstale":"2023-07-14T11:14:33.060426+0000","last_undegraded":"2023-07-14T11:14:33.060426+0000","last_fullsized":"2023-07-14T11:14:33.060426+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:48:48.956070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.959765+0000","last_change":"2023-07-14T11:14:33.046446+0000","last_active":"2023-07-14T11:14:34.959765+0000","last_peered":"2023-07-14T11:14:34.959765+0000","last_clean":"2023-07-14T11:14:34.959765+0000","last_became_active":"2023-07-14T11:14:33.046129+0000","last_became_peered":"2023-07-14T11:14:33.046129+0000","last_unstale":"2023-07-14T11:14:34.959765+0000","last_undegraded":"2023-07-14T11:14:34.959765+0000","last_fullsized":"2023-07-14T11:14:34.959765+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:29:55.676526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.040418+0000","last_change":"2023-07-14T11:14:33.047508+0000","last_active":"2023-07-14T11:14:34.040418+0000","last_peered":"2023-07-14T11:14:34.040418+0000","last_clean":"2023-07-14T11:14:34.040418+0000","last_became_active":"2023-07-14T11:14:33.047175+0000","last_became_peered":"2023-07-14T11:14:33.047175+0000","last_unstale":"2023-07-14T11:14:34.040418+0000","last_undegraded":"2023-07-14T11:14:34.040418+0000","last_fullsized":"2023-07-14T11:14:34.040418+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:11:21.769797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.959624+0000","last_change":"2023-07-14T11:14:33.045116+0000","last_active":"2023-07-14T11:14:34.959624+0000","last_peered":"2023-07-14T11:14:34.959624+0000","last_clean":"2023-07-14T11:14:34.959624+0000","last_became_active":"2023-07-14T11:14:33.044818+0000","last_became_peered":"2023-07-14T11:14:33.044818+0000","last_unstale":"2023-07-14T11:14:34.959624+0000","last_undegraded":"2023-07-14T11:14:34.959624+0000","last_fullsized":"2023-07-14T11:14:34.959624+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:56:31.896366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.039959+0000","last_change":"2023-07-14T11:14:33.054922+0000","last_active":"2023-07-14T11:14:34.039959+0000","last_peered":"2023-07-14T11:14:34.039959+0000","last_clean":"2023-07-14T11:14:34.039959+0000","last_became_active":"2023-07-14T11:14:33.054340+0000","last_became_peered":"2023-07-14T11:14:33.054340+0000","last_unstale":"2023-07-14T11:14:34.039959+0000","last_undegraded":"2023-07-14T11:14:34.039959+0000","last_fullsized":"2023-07-14T11:14:34.039959+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:33:34.783973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.052528+0000","last_change":"2023-07-14T11:14:33.047310+0000","last_active":"2023-07-14T11:14:33.052528+0000","last_peered":"2023-07-14T11:14:33.052528+0000","last_clean":"2023-07-14T11:14:33.052528+0000","last_became_active":"2023-07-14T11:14:33.047016+0000","last_became_peered":"2023-07-14T11:14:33.047016+0000","last_unstale":"2023-07-14T11:14:33.052528+0000","last_undegraded":"2023-07-14T11:14:33.052528+0000","last_fullsized":"2023-07-14T11:14:33.052528+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:13:31.772383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.058648+0000","last_change":"2023-07-14T11:14:33.053097+0000","last_active":"2023-07-14T11:14:33.058648+0000","last_peered":"2023-07-14T11:14:33.058648+0000","last_clean":"2023-07-14T11:14:33.058648+0000","last_became_active":"2023-07-14T11:14:33.052726+0000","last_became_peered":"2023-07-14T11:14:33.052726+0000","last_unstale":"2023-07-14T11:14:33.058648+0000","last_undegraded":"2023-07-14T11:14:33.058648+0000","last_fullsized":"2023-07-14T11:14:33.058648+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:02:38.157600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.039982+0000","last_change":"2023-07-14T11:14:33.042149+0000","last_active":"2023-07-14T11:14:34.039982+0000","last_peered":"2023-07-14T11:14:34.039982+0000","last_clean":"2023-07-14T11:14:34.039982+0000","last_became_active":"2023-07-14T11:14:33.041877+0000","last_became_peered":"2023-07-14T11:14:33.041877+0000","last_unstale":"2023-07-14T11:14:34.039982+0000","last_undegraded":"2023-07-14T11:14:34.039982+0000","last_fullsized":"2023-07-14T11:14:34.039982+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:39:11.139094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.959755+0000","last_change":"2023-07-14T11:14:33.059904+0000","last_active":"2023-07-14T11:14:34.959755+0000","last_peered":"2023-07-14T11:14:34.959755+0000","last_clean":"2023-07-14T11:14:34.959755+0000","last_became_active":"2023-07-14T11:14:33.059539+0000","last_became_peered":"2023-07-14T11:14:33.059539+0000","last_unstale":"2023-07-14T11:14:34.959755+0000","last_undegraded":"2023-07-14T11:14:34.959755+0000","last_fullsized":"2023-07-14T11:14:34.959755+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:32:49.813492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.039340+0000","last_change":"2023-07-14T11:14:33.047302+0000","last_active":"2023-07-14T11:14:34.039340+0000","last_peered":"2023-07-14T11:14:34.039340+0000","last_clean":"2023-07-14T11:14:34.039340+0000","last_became_active":"2023-07-14T11:14:33.047059+0000","last_became_peered":"2023-07-14T11:14:33.047059+0000","last_unstale":"2023-07-14T11:14:34.039340+0000","last_undegraded":"2023-07-14T11:14:34.039340+0000","last_fullsized":"2023-07-14T11:14:34.039340+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:27:02.057195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.959706+0000","last_change":"2023-07-14T11:14:33.043048+0000","last_active":"2023-07-14T11:14:34.959706+0000","last_peered":"2023-07-14T11:14:34.959706+0000","last_clean":"2023-07-14T11:14:34.959706+0000","last_became_active":"2023-07-14T11:14:33.042736+0000","last_became_peered":"2023-07-14T11:14:33.042736+0000","last_unstale":"2023-07-14T11:14:34.959706+0000","last_undegraded":"2023-07-14T11:14:34.959706+0000","last_fullsized":"2023-07-14T11:14:34.959706+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:39:15.997805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.039853+0000","last_change":"2023-07-14T11:14:33.045766+0000","last_active":"2023-07-14T11:14:34.039853+0000","last_peered":"2023-07-14T11:14:34.039853+0000","last_clean":"2023-07-14T11:14:34.039853+0000","last_became_active":"2023-07-14T11:14:33.045353+0000","last_became_peered":"2023-07-14T11:14:33.045353+0000","last_unstale":"2023-07-14T11:14:34.039853+0000","last_undegraded":"2023-07-14T11:14:34.039853+0000","last_fullsized":"2023-07-14T11:14:34.039853+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:34:09.482159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.959447+0000","last_change":"2023-07-14T11:14:33.043842+0000","last_active":"2023-07-14T11:14:34.959447+0000","last_peered":"2023-07-14T11:14:34.959447+0000","last_clean":"2023-07-14T11:14:34.959447+0000","last_became_active":"2023-07-14T11:14:33.043570+0000","last_became_peered":"2023-07-14T11:14:33.043570+0000","last_unstale":"2023-07-14T11:14:34.959447+0000","last_undegraded":"2023-07-14T11:14:34.959447+0000","last_fullsized":"2023-07-14T11:14:34.959447+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:39:17.319814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.959594+0000","last_change":"2023-07-14T11:14:33.044581+0000","last_active":"2023-07-14T11:14:34.959594+0000","last_peered":"2023-07-14T11:14:34.959594+0000","last_clean":"2023-07-14T11:14:34.959594+0000","last_became_active":"2023-07-14T11:14:33.044301+0000","last_became_peered":"2023-07-14T11:14:33.044301+0000","last_unstale":"2023-07-14T11:14:34.959594+0000","last_undegraded":"2023-07-14T11:14:34.959594+0000","last_fullsized":"2023-07-14T11:14:34.959594+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:18:16.426862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.058613+0000","last_change":"2023-07-14T11:14:33.052996+0000","last_active":"2023-07-14T11:14:33.058613+0000","last_peered":"2023-07-14T11:14:33.058613+0000","last_clean":"2023-07-14T11:14:33.058613+0000","last_became_active":"2023-07-14T11:14:33.052346+0000","last_became_peered":"2023-07-14T11:14:33.052346+0000","last_unstale":"2023-07-14T11:14:33.058613+0000","last_undegraded":"2023-07-14T11:14:33.058613+0000","last_fullsized":"2023-07-14T11:14:33.058613+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:46:30.241388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.038621+0000","last_change":"2023-07-14T11:14:33.039236+0000","last_active":"2023-07-14T11:14:34.038621+0000","last_peered":"2023-07-14T11:14:34.038621+0000","last_clean":"2023-07-14T11:14:34.038621+0000","last_became_active":"2023-07-14T11:14:33.038976+0000","last_became_peered":"2023-07-14T11:14:33.038976+0000","last_unstale":"2023-07-14T11:14:34.038621+0000","last_undegraded":"2023-07-14T11:14:34.038621+0000","last_fullsized":"2023-07-14T11:14:34.038621+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:33:35.066799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.060953+0000","last_change":"2023-07-14T11:14:33.057372+0000","last_active":"2023-07-14T11:14:33.060953+0000","last_peered":"2023-07-14T11:14:33.060953+0000","last_clean":"2023-07-14T11:14:33.060953+0000","last_became_active":"2023-07-14T11:14:33.057002+0000","last_became_peered":"2023-07-14T11:14:33.057002+0000","last_unstale":"2023-07-14T11:14:33.060953+0000","last_undegraded":"2023-07-14T11:14:33.060953+0000","last_fullsized":"2023-07-14T11:14:33.060953+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:00:03.367995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"36'4","reported_seq":17,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.959801+0000","last_change":"2023-07-14T11:14:32.038267+0000","last_active":"2023-07-14T11:14:34.959801+0000","last_peered":"2023-07-14T11:14:34.959801+0000","last_clean":"2023-07-14T11:14:34.959801+0000","last_became_active":"2023-07-14T11:14:32.037523+0000","last_became_peered":"2023-07-14T11:14:32.037523+0000","last_unstale":"2023-07-14T11:14:34.959801+0000","last_undegraded":"2023-07-14T11:14:34.959801+0000","last_fullsized":"2023-07-14T11:14:34.959801+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_clean_scrub_stamp":"2023-07-14T11:14:31.003451+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:52:03.437010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.039353+0000","last_change":"2023-07-14T11:14:33.056137+0000","last_active":"2023-07-14T11:14:34.039353+0000","last_peered":"2023-07-14T11:14:34.039353+0000","last_clean":"2023-07-14T11:14:34.039353+0000","last_became_active":"2023-07-14T11:14:33.055738+0000","last_became_peered":"2023-07-14T11:14:33.055738+0000","last_unstale":"2023-07-14T11:14:34.039353+0000","last_undegraded":"2023-07-14T11:14:34.039353+0000","last_fullsized":"2023-07-14T11:14:34.039353+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:43:39.661372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"36'1","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.054031+0000","last_change":"2023-07-14T11:14:32.036812+0000","last_active":"2023-07-14T11:14:33.054031+0000","last_peered":"2023-07-14T11:14:33.054031+0000","last_clean":"2023-07-14T11:14:33.054031+0000","last_became_active":"2023-07-14T11:14:32.036524+0000","last_became_peered":"2023-07-14T11:14:32.036524+0000","last_unstale":"2023-07-14T11:14:33.054031+0000","last_undegraded":"2023-07-14T11:14:33.054031+0000","last_fullsized":"2023-07-14T11:14:33.054031+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_clean_scrub_stamp":"2023-07-14T11:14:31.003451+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:21:38.428435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.057497+0000","last_change":"2023-07-14T11:14:33.054015+0000","last_active":"2023-07-14T11:14:33.057497+0000","last_peered":"2023-07-14T11:14:33.057497+0000","last_clean":"2023-07-14T11:14:33.057497+0000","last_became_active":"2023-07-14T11:14:33.053759+0000","last_became_peered":"2023-07-14T11:14:33.053759+0000","last_unstale":"2023-07-14T11:14:33.057497+0000","last_undegraded":"2023-07-14T11:14:33.057497+0000","last_fullsized":"2023-07-14T11:14:33.057497+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:02:38.157600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"36'2","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.039432+0000","last_change":"2023-07-14T11:14:32.020091+0000","last_active":"2023-07-14T11:14:34.039432+0000","last_peered":"2023-07-14T11:14:34.039432+0000","last_clean":"2023-07-14T11:14:34.039432+0000","last_became_active":"2023-07-14T11:14:32.019791+0000","last_became_peered":"2023-07-14T11:14:32.019791+0000","last_unstale":"2023-07-14T11:14:34.039432+0000","last_undegraded":"2023-07-14T11:14:34.039432+0000","last_fullsized":"2023-07-14T11:14:34.039432+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_clean_scrub_stamp":"2023-07-14T11:14:31.003451+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:34:08.477077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.640033+0000","last_change":"2023-07-14T11:14:33.050705+0000","last_active":"2023-07-14T11:14:34.640033+0000","last_peered":"2023-07-14T11:14:34.640033+0000","last_clean":"2023-07-14T11:14:34.640033+0000","last_became_active":"2023-07-14T11:14:33.050443+0000","last_became_peered":"2023-07-14T11:14:33.050443+0000","last_unstale":"2023-07-14T11:14:34.640033+0000","last_undegraded":"2023-07-14T11:14:34.640033+0000","last_fullsized":"2023-07-14T11:14:34.640033+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:46:30.241388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"36'2","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.061135+0000","last_change":"2023-07-14T11:14:32.028816+0000","last_active":"2023-07-14T11:14:33.061135+0000","last_peered":"2023-07-14T11:14:33.061135+0000","last_clean":"2023-07-14T11:14:33.061135+0000","last_became_active":"2023-07-14T11:14:32.028540+0000","last_became_peered":"2023-07-14T11:14:32.028540+0000","last_unstale":"2023-07-14T11:14:33.061135+0000","last_undegraded":"2023-07-14T11:14:33.061135+0000","last_fullsized":"2023-07-14T11:14:33.061135+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_clean_scrub_stamp":"2023-07-14T11:14:31.003451+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:46:29.236307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.060110+0000","last_change":"2023-07-14T11:14:33.048481+0000","last_active":"2023-07-14T11:14:33.060110+0000","last_peered":"2023-07-14T11:14:33.060110+0000","last_clean":"2023-07-14T11:14:33.060110+0000","last_became_active":"2023-07-14T11:14:33.048213+0000","last_became_peered":"2023-07-14T11:14:33.048213+0000","last_unstale":"2023-07-14T11:14:33.060110+0000","last_undegraded":"2023-07-14T11:14:33.060110+0000","last_fullsized":"2023-07-14T11:14:33.060110+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:48:57.505125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"36'1","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.040164+0000","last_change":"2023-07-14T11:14:32.032279+0000","last_active":"2023-07-14T11:14:34.040164+0000","last_peered":"2023-07-14T11:14:34.040164+0000","last_clean":"2023-07-14T11:14:34.040164+0000","last_became_active":"2023-07-14T11:14:32.031528+0000","last_became_peered":"2023-07-14T11:14:32.031528+0000","last_unstale":"2023-07-14T11:14:34.040164+0000","last_undegraded":"2023-07-14T11:14:34.040164+0000","last_fullsized":"2023-07-14T11:14:34.040164+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_clean_scrub_stamp":"2023-07-14T11:14:31.003451+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:48:13.552595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.039896+0000","last_change":"2023-07-14T11:14:33.047939+0000","last_active":"2023-07-14T11:14:34.039896+0000","last_peered":"2023-07-14T11:14:34.039896+0000","last_clean":"2023-07-14T11:14:34.039896+0000","last_became_active":"2023-07-14T11:14:33.047666+0000","last_became_peered":"2023-07-14T11:14:33.047666+0000","last_unstale":"2023-07-14T11:14:34.039896+0000","last_undegraded":"2023-07-14T11:14:34.039896+0000","last_fullsized":"2023-07-14T11:14:34.039896+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:06:22.581713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"36'1","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.061799+0000","last_change":"2023-07-14T11:14:32.039399+0000","last_active":"2023-07-14T11:14:33.061799+0000","last_peered":"2023-07-14T11:14:33.061799+0000","last_clean":"2023-07-14T11:14:33.061799+0000","last_became_active":"2023-07-14T11:14:32.039117+0000","last_became_peered":"2023-07-14T11:14:32.039117+0000","last_unstale":"2023-07-14T11:14:33.061799+0000","last_undegraded":"2023-07-14T11:14:33.061799+0000","last_fullsized":"2023-07-14T11:14:33.061799+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_clean_scrub_stamp":"2023-07-14T11:14:31.003451+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:33:34.061717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.061415+0000","last_change":"2023-07-14T11:14:33.058162+0000","last_active":"2023-07-14T11:14:33.061415+0000","last_peered":"2023-07-14T11:14:33.061415+0000","last_clean":"2023-07-14T11:14:33.061415+0000","last_became_active":"2023-07-14T11:14:33.057703+0000","last_became_peered":"2023-07-14T11:14:33.057703+0000","last_unstale":"2023-07-14T11:14:33.061415+0000","last_undegraded":"2023-07-14T11:14:33.061415+0000","last_fullsized":"2023-07-14T11:14:33.061415+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:56:02.633239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.039006+0000","last_change":"2023-07-14T11:14:32.031978+0000","last_active":"2023-07-14T11:14:34.039006+0000","last_peered":"2023-07-14T11:14:34.039006+0000","last_clean":"2023-07-14T11:14:34.039006+0000","last_became_active":"2023-07-14T11:14:32.031246+0000","last_became_peered":"2023-07-14T11:14:32.031246+0000","last_unstale":"2023-07-14T11:14:34.039006+0000","last_undegraded":"2023-07-14T11:14:34.039006+0000","last_fullsized":"2023-07-14T11:14:34.039006+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_clean_scrub_stamp":"2023-07-14T11:14:31.003451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:02:37.152518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.639988+0000","last_change":"2023-07-14T11:14:33.048623+0000","last_active":"2023-07-14T11:14:34.639988+0000","last_peered":"2023-07-14T11:14:34.639988+0000","last_clean":"2023-07-14T11:14:34.639988+0000","last_became_active":"2023-07-14T11:14:33.048370+0000","last_became_peered":"2023-07-14T11:14:33.048370+0000","last_unstale":"2023-07-14T11:14:34.639988+0000","last_undegraded":"2023-07-14T11:14:34.639988+0000","last_fullsized":"2023-07-14T11:14:34.639988+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:13:31.772383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.035512+0000","last_change":"2023-07-14T11:14:32.034572+0000","last_active":"2023-07-14T11:14:33.035512+0000","last_peered":"2023-07-14T11:14:33.035512+0000","last_clean":"2023-07-14T11:14:33.035512+0000","last_became_active":"2023-07-14T11:14:32.034289+0000","last_became_peered":"2023-07-14T11:14:32.034289+0000","last_unstale":"2023-07-14T11:14:33.035512+0000","last_undegraded":"2023-07-14T11:14:33.035512+0000","last_fullsized":"2023-07-14T11:14:33.035512+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_clean_scrub_stamp":"2023-07-14T11:14:31.003451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:31:05.568313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.040476+0000","last_change":"2023-07-14T11:14:33.043706+0000","last_active":"2023-07-14T11:14:34.040476+0000","last_peered":"2023-07-14T11:14:34.040476+0000","last_clean":"2023-07-14T11:14:34.040476+0000","last_became_active":"2023-07-14T11:14:33.043074+0000","last_became_peered":"2023-07-14T11:14:33.043074+0000","last_unstale":"2023-07-14T11:14:34.040476+0000","last_undegraded":"2023-07-14T11:14:34.040476+0000","last_fullsized":"2023-07-14T11:14:34.040476+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:39:17.319814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.640079+0000","last_change":"2023-07-14T11:14:32.028109+0000","last_active":"2023-07-14T11:14:34.640079+0000","last_peered":"2023-07-14T11:14:34.640079+0000","last_clean":"2023-07-14T11:14:34.640079+0000","last_became_active":"2023-07-14T11:14:32.027824+0000","last_became_peered":"2023-07-14T11:14:32.027824+0000","last_unstale":"2023-07-14T11:14:34.640079+0000","last_undegraded":"2023-07-14T11:14:34.640079+0000","last_fullsized":"2023-07-14T11:14:34.640079+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_clean_scrub_stamp":"2023-07-14T11:14:31.003451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:37:30.269906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.058585+0000","last_change":"2023-07-14T11:14:33.052450+0000","last_active":"2023-07-14T11:14:33.058585+0000","last_peered":"2023-07-14T11:14:33.058585+0000","last_clean":"2023-07-14T11:14:33.058585+0000","last_became_active":"2023-07-14T11:14:33.051726+0000","last_became_peered":"2023-07-14T11:14:33.051726+0000","last_unstale":"2023-07-14T11:14:33.058585+0000","last_undegraded":"2023-07-14T11:14:33.058585+0000","last_fullsized":"2023-07-14T11:14:33.058585+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:37:31.274987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.040386+0000","last_change":"2023-07-14T11:14:32.032479+0000","last_active":"2023-07-14T11:14:34.040386+0000","last_peered":"2023-07-14T11:14:34.040386+0000","last_clean":"2023-07-14T11:14:34.040386+0000","last_became_active":"2023-07-14T11:14:32.032158+0000","last_became_peered":"2023-07-14T11:14:32.032158+0000","last_unstale":"2023-07-14T11:14:34.040386+0000","last_undegraded":"2023-07-14T11:14:34.040386+0000","last_fullsized":"2023-07-14T11:14:34.040386+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_clean_scrub_stamp":"2023-07-14T11:14:31.003451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:58:02.918362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.062911+0000","last_change":"2023-07-14T11:14:33.054524+0000","last_active":"2023-07-14T11:14:33.062911+0000","last_peered":"2023-07-14T11:14:33.062911+0000","last_clean":"2023-07-14T11:14:33.062911+0000","last_became_active":"2023-07-14T11:14:33.054232+0000","last_became_peered":"2023-07-14T11:14:33.054232+0000","last_unstale":"2023-07-14T11:14:33.062911+0000","last_undegraded":"2023-07-14T11:14:33.062911+0000","last_fullsized":"2023-07-14T11:14:33.062911+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:28:30.508977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"36'3","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.040464+0000","last_change":"2023-07-14T11:14:32.031215+0000","last_active":"2023-07-14T11:14:34.040464+0000","last_peered":"2023-07-14T11:14:34.040464+0000","last_clean":"2023-07-14T11:14:34.040464+0000","last_became_active":"2023-07-14T11:14:32.030897+0000","last_became_peered":"2023-07-14T11:14:32.030897+0000","last_unstale":"2023-07-14T11:14:34.040464+0000","last_undegraded":"2023-07-14T11:14:34.040464+0000","last_fullsized":"2023-07-14T11:14:34.040464+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_clean_scrub_stamp":"2023-07-14T11:14:31.003451+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:24:49.564314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.052672+0000","last_change":"2023-07-14T11:14:33.048015+0000","last_active":"2023-07-14T11:14:33.052672+0000","last_peered":"2023-07-14T11:14:33.052672+0000","last_clean":"2023-07-14T11:14:33.052672+0000","last_became_active":"2023-07-14T11:14:33.046825+0000","last_became_peered":"2023-07-14T11:14:33.046825+0000","last_unstale":"2023-07-14T11:14:33.052672+0000","last_undegraded":"2023-07-14T11:14:33.052672+0000","last_fullsized":"2023-07-14T11:14:33.052672+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:31:18.643967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"36'6","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.640117+0000","last_change":"2023-07-14T11:14:32.039917+0000","last_active":"2023-07-14T11:14:34.640117+0000","last_peered":"2023-07-14T11:14:34.640117+0000","last_clean":"2023-07-14T11:14:34.640117+0000","last_became_active":"2023-07-14T11:14:32.039638+0000","last_became_peered":"2023-07-14T11:14:32.039638+0000","last_unstale":"2023-07-14T11:14:34.640117+0000","last_undegraded":"2023-07-14T11:14:34.640117+0000","last_fullsized":"2023-07-14T11:14:34.640117+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_clean_scrub_stamp":"2023-07-14T11:14:31.003451+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:04:19.815906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.062931+0000","last_change":"2023-07-14T11:14:33.054546+0000","last_active":"2023-07-14T11:14:33.062931+0000","last_peered":"2023-07-14T11:14:33.062931+0000","last_clean":"2023-07-14T11:14:33.062931+0000","last_became_active":"2023-07-14T11:14:33.054211+0000","last_became_peered":"2023-07-14T11:14:33.054211+0000","last_unstale":"2023-07-14T11:14:33.062931+0000","last_undegraded":"2023-07-14T11:14:33.062931+0000","last_fullsized":"2023-07-14T11:14:33.062931+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:32:22.588132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"36'2","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.639975+0000","last_change":"2023-07-14T11:14:32.030006+0000","last_active":"2023-07-14T11:14:34.639975+0000","last_peered":"2023-07-14T11:14:34.639975+0000","last_clean":"2023-07-14T11:14:34.639975+0000","last_became_active":"2023-07-14T11:14:32.029739+0000","last_became_peered":"2023-07-14T11:14:32.029739+0000","last_unstale":"2023-07-14T11:14:34.639975+0000","last_undegraded":"2023-07-14T11:14:34.639975+0000","last_fullsized":"2023-07-14T11:14:34.639975+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_clean_scrub_stamp":"2023-07-14T11:14:31.003451+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:31:05.568313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.639651+0000","last_change":"2023-07-14T11:14:33.057456+0000","last_active":"2023-07-14T11:14:34.639651+0000","last_peered":"2023-07-14T11:14:34.639651+0000","last_clean":"2023-07-14T11:14:34.639651+0000","last_became_active":"2023-07-14T11:14:33.057088+0000","last_became_peered":"2023-07-14T11:14:33.057088+0000","last_unstale":"2023-07-14T11:14:34.639651+0000","last_undegraded":"2023-07-14T11:14:34.639651+0000","last_fullsized":"2023-07-14T11:14:34.639651+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:49:17.421344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.039086+0000","last_change":"2023-07-14T11:14:32.027055+0000","last_active":"2023-07-14T11:14:34.039086+0000","last_peered":"2023-07-14T11:14:34.039086+0000","last_clean":"2023-07-14T11:14:34.039086+0000","last_became_active":"2023-07-14T11:14:32.026764+0000","last_became_peered":"2023-07-14T11:14:32.026764+0000","last_unstale":"2023-07-14T11:14:34.039086+0000","last_undegraded":"2023-07-14T11:14:34.039086+0000","last_fullsized":"2023-07-14T11:14:34.039086+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_clean_scrub_stamp":"2023-07-14T11:14:31.003451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:11:55.766479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.058525+0000","last_change":"2023-07-14T11:14:33.053103+0000","last_active":"2023-07-14T11:14:33.058525+0000","last_peered":"2023-07-14T11:14:33.058525+0000","last_clean":"2023-07-14T11:14:33.058525+0000","last_became_active":"2023-07-14T11:14:33.052800+0000","last_became_peered":"2023-07-14T11:14:33.052800+0000","last_unstale":"2023-07-14T11:14:33.058525+0000","last_undegraded":"2023-07-14T11:14:33.058525+0000","last_fullsized":"2023-07-14T11:14:33.058525+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:13:31.772383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.959376+0000","last_change":"2023-07-14T11:14:32.037772+0000","last_active":"2023-07-14T11:14:34.959376+0000","last_peered":"2023-07-14T11:14:34.959376+0000","last_clean":"2023-07-14T11:14:34.959376+0000","last_became_active":"2023-07-14T11:14:32.037416+0000","last_became_peered":"2023-07-14T11:14:32.037416+0000","last_unstale":"2023-07-14T11:14:34.959376+0000","last_undegraded":"2023-07-14T11:14:34.959376+0000","last_fullsized":"2023-07-14T11:14:34.959376+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_clean_scrub_stamp":"2023-07-14T11:14:31.003451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:16:43.131221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.639813+0000","last_change":"2023-07-14T11:14:33.057332+0000","last_active":"2023-07-14T11:14:34.639813+0000","last_peered":"2023-07-14T11:14:34.639813+0000","last_clean":"2023-07-14T11:14:34.639813+0000","last_became_active":"2023-07-14T11:14:33.057044+0000","last_became_peered":"2023-07-14T11:14:33.057044+0000","last_unstale":"2023-07-14T11:14:34.639813+0000","last_undegraded":"2023-07-14T11:14:34.639813+0000","last_fullsized":"2023-07-14T11:14:34.639813+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:49:06.685581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"36'8","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.067469+0000","last_change":"2023-07-14T11:14:32.040934+0000","last_active":"2023-07-14T11:14:33.067469+0000","last_peered":"2023-07-14T11:14:33.067469+0000","last_clean":"2023-07-14T11:14:33.067469+0000","last_became_active":"2023-07-14T11:14:32.040567+0000","last_became_peered":"2023-07-14T11:14:32.040567+0000","last_unstale":"2023-07-14T11:14:33.067469+0000","last_undegraded":"2023-07-14T11:14:33.067469+0000","last_fullsized":"2023-07-14T11:14:33.067469+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_clean_scrub_stamp":"2023-07-14T11:14:31.003451+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:08:52.492843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.640053+0000","last_change":"2023-07-14T11:14:33.050440+0000","last_active":"2023-07-14T11:14:34.640053+0000","last_peered":"2023-07-14T11:14:34.640053+0000","last_clean":"2023-07-14T11:14:34.640053+0000","last_became_active":"2023-07-14T11:14:33.050169+0000","last_became_peered":"2023-07-14T11:14:33.050169+0000","last_unstale":"2023-07-14T11:14:34.640053+0000","last_undegraded":"2023-07-14T11:14:34.640053+0000","last_fullsized":"2023-07-14T11:14:34.640053+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:33:35.066799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'1","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.040193+0000","last_change":"2023-07-14T11:14:32.038627+0000","last_active":"2023-07-14T11:14:34.040193+0000","last_peered":"2023-07-14T11:14:34.040193+0000","last_clean":"2023-07-14T11:14:34.040193+0000","last_became_active":"2023-07-14T11:14:32.037684+0000","last_became_peered":"2023-07-14T11:14:32.037684+0000","last_unstale":"2023-07-14T11:14:34.040193+0000","last_undegraded":"2023-07-14T11:14:34.040193+0000","last_fullsized":"2023-07-14T11:14:34.040193+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_clean_scrub_stamp":"2023-07-14T11:14:31.003451+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:22:17.389343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.040367+0000","last_change":"2023-07-14T11:14:33.055013+0000","last_active":"2023-07-14T11:14:34.040367+0000","last_peered":"2023-07-14T11:14:34.040367+0000","last_clean":"2023-07-14T11:14:34.040367+0000","last_became_active":"2023-07-14T11:14:33.054171+0000","last_became_peered":"2023-07-14T11:14:33.054171+0000","last_unstale":"2023-07-14T11:14:34.040367+0000","last_undegraded":"2023-07-14T11:14:34.040367+0000","last_fullsized":"2023-07-14T11:14:34.040367+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:47:53.028834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"36'2","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.063825+0000","last_change":"2023-07-14T11:14:32.034007+0000","last_active":"2023-07-14T11:14:33.063825+0000","last_peered":"2023-07-14T11:14:33.063825+0000","last_clean":"2023-07-14T11:14:33.063825+0000","last_became_active":"2023-07-14T11:14:32.033578+0000","last_became_peered":"2023-07-14T11:14:32.033578+0000","last_unstale":"2023-07-14T11:14:33.063825+0000","last_undegraded":"2023-07-14T11:14:33.063825+0000","last_fullsized":"2023-07-14T11:14:33.063825+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_clean_scrub_stamp":"2023-07-14T11:14:31.003451+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:11:55.766479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.055111+0000","last_change":"2023-07-14T11:14:33.048114+0000","last_active":"2023-07-14T11:14:33.055111+0000","last_peered":"2023-07-14T11:14:33.055111+0000","last_clean":"2023-07-14T11:14:33.055111+0000","last_became_active":"2023-07-14T11:14:33.047628+0000","last_became_peered":"2023-07-14T11:14:33.047628+0000","last_unstale":"2023-07-14T11:14:33.055111+0000","last_undegraded":"2023-07-14T11:14:33.055111+0000","last_fullsized":"2023-07-14T11:14:33.055111+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:04:20.820987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"36'1","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.040286+0000","last_change":"2023-07-14T11:14:32.036861+0000","last_active":"2023-07-14T11:14:34.040286+0000","last_peered":"2023-07-14T11:14:34.040286+0000","last_clean":"2023-07-14T11:14:34.040286+0000","last_became_active":"2023-07-14T11:14:32.036560+0000","last_became_peered":"2023-07-14T11:14:32.036560+0000","last_unstale":"2023-07-14T11:14:34.040286+0000","last_undegraded":"2023-07-14T11:14:34.040286+0000","last_fullsized":"2023-07-14T11:14:34.040286+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_clean_scrub_stamp":"2023-07-14T11:14:31.003451+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:21:38.877631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.040462+0000","last_change":"2023-07-14T11:14:33.041013+0000","last_active":"2023-07-14T11:14:34.040462+0000","last_peered":"2023-07-14T11:14:34.040462+0000","last_clean":"2023-07-14T11:14:34.040462+0000","last_became_active":"2023-07-14T11:14:33.040668+0000","last_became_peered":"2023-07-14T11:14:33.040668+0000","last_unstale":"2023-07-14T11:14:34.040462+0000","last_undegraded":"2023-07-14T11:14:34.040462+0000","last_fullsized":"2023-07-14T11:14:34.040462+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:16:44.136303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.039179+0000","last_change":"2023-07-14T11:14:32.021535+0000","last_active":"2023-07-14T11:14:34.039179+0000","last_peered":"2023-07-14T11:14:34.039179+0000","last_clean":"2023-07-14T11:14:34.039179+0000","last_became_active":"2023-07-14T11:14:32.021206+0000","last_became_peered":"2023-07-14T11:14:32.021206+0000","last_unstale":"2023-07-14T11:14:34.039179+0000","last_undegraded":"2023-07-14T11:14:34.039179+0000","last_fullsized":"2023-07-14T11:14:34.039179+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_clean_scrub_stamp":"2023-07-14T11:14:31.003451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:48:47.950989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.063882+0000","last_change":"2023-07-14T11:14:33.059379+0000","last_active":"2023-07-14T11:14:33.063882+0000","last_peered":"2023-07-14T11:14:33.063882+0000","last_clean":"2023-07-14T11:14:33.063882+0000","last_became_active":"2023-07-14T11:14:33.058680+0000","last_became_peered":"2023-07-14T11:14:33.058680+0000","last_unstale":"2023-07-14T11:14:33.063882+0000","last_undegraded":"2023-07-14T11:14:33.063882+0000","last_fullsized":"2023-07-14T11:14:33.063882+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:43:39.661372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"36'2","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.040313+0000","last_change":"2023-07-14T11:14:32.030415+0000","last_active":"2023-07-14T11:14:34.040313+0000","last_peered":"2023-07-14T11:14:34.040313+0000","last_clean":"2023-07-14T11:14:34.040313+0000","last_became_active":"2023-07-14T11:14:32.030159+0000","last_became_peered":"2023-07-14T11:14:32.030159+0000","last_unstale":"2023-07-14T11:14:34.040313+0000","last_undegraded":"2023-07-14T11:14:34.040313+0000","last_fullsized":"2023-07-14T11:14:34.040313+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_clean_scrub_stamp":"2023-07-14T11:14:31.003451+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:19:30.047747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.060079+0000","last_change":"2023-07-14T11:14:33.047462+0000","last_active":"2023-07-14T11:14:33.060079+0000","last_peered":"2023-07-14T11:14:33.060079+0000","last_clean":"2023-07-14T11:14:33.060079+0000","last_became_active":"2023-07-14T11:14:33.047212+0000","last_became_peered":"2023-07-14T11:14:33.047212+0000","last_unstale":"2023-07-14T11:14:33.060079+0000","last_undegraded":"2023-07-14T11:14:33.060079+0000","last_fullsized":"2023-07-14T11:14:33.060079+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:38:31.511137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.040300+0000","last_change":"2023-07-14T11:14:32.035287+0000","last_active":"2023-07-14T11:14:34.040300+0000","last_peered":"2023-07-14T11:14:34.040300+0000","last_clean":"2023-07-14T11:14:34.040300+0000","last_became_active":"2023-07-14T11:14:32.034981+0000","last_became_peered":"2023-07-14T11:14:32.034981+0000","last_unstale":"2023-07-14T11:14:34.040300+0000","last_undegraded":"2023-07-14T11:14:34.040300+0000","last_fullsized":"2023-07-14T11:14:34.040300+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_clean_scrub_stamp":"2023-07-14T11:14:31.003451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:53:39.743257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.039675+0000","last_change":"2023-07-14T11:14:33.044096+0000","last_active":"2023-07-14T11:14:34.039675+0000","last_peered":"2023-07-14T11:14:34.039675+0000","last_clean":"2023-07-14T11:14:34.039675+0000","last_became_active":"2023-07-14T11:14:33.043116+0000","last_became_peered":"2023-07-14T11:14:33.043116+0000","last_unstale":"2023-07-14T11:14:34.039675+0000","last_undegraded":"2023-07-14T11:14:34.039675+0000","last_fullsized":"2023-07-14T11:14:34.039675+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:43:39.661372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.037261+0000","last_change":"2023-07-14T11:14:32.039174+0000","last_active":"2023-07-14T11:14:33.037261+0000","last_peered":"2023-07-14T11:14:33.037261+0000","last_clean":"2023-07-14T11:14:33.037261+0000","last_became_active":"2023-07-14T11:14:32.038870+0000","last_became_peered":"2023-07-14T11:14:32.038870+0000","last_unstale":"2023-07-14T11:14:33.037261+0000","last_undegraded":"2023-07-14T11:14:33.037261+0000","last_fullsized":"2023-07-14T11:14:33.037261+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_clean_scrub_stamp":"2023-07-14T11:14:31.003451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:06:21.576631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.639811+0000","last_change":"2023-07-14T11:14:33.053715+0000","last_active":"2023-07-14T11:14:34.639811+0000","last_peered":"2023-07-14T11:14:34.639811+0000","last_clean":"2023-07-14T11:14:34.639811+0000","last_became_active":"2023-07-14T11:14:33.053416+0000","last_became_peered":"2023-07-14T11:14:33.053416+0000","last_unstale":"2023-07-14T11:14:34.639811+0000","last_undegraded":"2023-07-14T11:14:34.639811+0000","last_fullsized":"2023-07-14T11:14:34.639811+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:51:29.549114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.039921+0000","last_change":"2023-07-14T11:14:32.027842+0000","last_active":"2023-07-14T11:14:34.039921+0000","last_peered":"2023-07-14T11:14:34.039921+0000","last_clean":"2023-07-14T11:14:34.039921+0000","last_became_active":"2023-07-14T11:14:32.027563+0000","last_became_peered":"2023-07-14T11:14:32.027563+0000","last_unstale":"2023-07-14T11:14:34.039921+0000","last_undegraded":"2023-07-14T11:14:34.039921+0000","last_fullsized":"2023-07-14T11:14:34.039921+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_clean_scrub_stamp":"2023-07-14T11:14:31.003451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:16:35.343816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.059854+0000","last_change":"2023-07-14T11:14:33.046992+0000","last_active":"2023-07-14T11:14:33.059854+0000","last_peered":"2023-07-14T11:14:33.059854+0000","last_clean":"2023-07-14T11:14:33.059854+0000","last_became_active":"2023-07-14T11:14:33.046661+0000","last_became_peered":"2023-07-14T11:14:33.046661+0000","last_unstale":"2023-07-14T11:14:33.059854+0000","last_undegraded":"2023-07-14T11:14:33.059854+0000","last_fullsized":"2023-07-14T11:14:33.059854+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:43:35.099354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.035539+0000","last_change":"2023-07-14T11:14:32.035537+0000","last_active":"2023-07-14T11:14:33.035539+0000","last_peered":"2023-07-14T11:14:33.035539+0000","last_clean":"2023-07-14T11:14:33.035539+0000","last_became_active":"2023-07-14T11:14:32.035269+0000","last_became_peered":"2023-07-14T11:14:32.035269+0000","last_unstale":"2023-07-14T11:14:33.035539+0000","last_undegraded":"2023-07-14T11:14:33.035539+0000","last_fullsized":"2023-07-14T11:14:33.035539+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_clean_scrub_stamp":"2023-07-14T11:14:31.003451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:09:21.708773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.039163+0000","last_change":"2023-07-14T11:13:08.923786+0000","last_active":"2023-07-14T11:14:34.039163+0000","last_peered":"2023-07-14T11:14:34.039163+0000","last_clean":"2023-07-14T11:14:34.039163+0000","last_became_active":"2023-07-14T11:13:08.923384+0000","last_became_peered":"2023-07-14T11:13:08.923384+0000","last_unstale":"2023-07-14T11:14:34.039163+0000","last_undegraded":"2023-07-14T11:14:34.039163+0000","last_fullsized":"2023-07-14T11:14:34.039163+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:53:30.731675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.639975+0000","last_change":"2023-07-14T11:14:33.047045+0000","last_active":"2023-07-14T11:14:34.639975+0000","last_peered":"2023-07-14T11:14:34.639975+0000","last_clean":"2023-07-14T11:14:34.639975+0000","last_became_active":"2023-07-14T11:14:33.046711+0000","last_became_peered":"2023-07-14T11:14:33.046711+0000","last_unstale":"2023-07-14T11:14:34.639975+0000","last_undegraded":"2023-07-14T11:14:34.639975+0000","last_fullsized":"2023-07-14T11:14:34.639975+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:55:13.967423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.034799+0000","last_change":"2023-07-14T11:14:32.031005+0000","last_active":"2023-07-14T11:14:33.034799+0000","last_peered":"2023-07-14T11:14:33.034799+0000","last_clean":"2023-07-14T11:14:33.034799+0000","last_became_active":"2023-07-14T11:14:32.030719+0000","last_became_peered":"2023-07-14T11:14:32.030719+0000","last_unstale":"2023-07-14T11:14:33.034799+0000","last_undegraded":"2023-07-14T11:14:33.034799+0000","last_fullsized":"2023-07-14T11:14:33.034799+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_clean_scrub_stamp":"2023-07-14T11:14:31.003451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:57:29.229391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.040018+0000","last_change":"2023-07-14T11:13:08.758749+0000","last_active":"2023-07-14T11:14:34.040018+0000","last_peered":"2023-07-14T11:14:34.040018+0000","last_clean":"2023-07-14T11:14:34.040018+0000","last_became_active":"2023-07-14T11:13:08.757956+0000","last_became_peered":"2023-07-14T11:13:08.757956+0000","last_unstale":"2023-07-14T11:14:34.040018+0000","last_undegraded":"2023-07-14T11:14:34.040018+0000","last_fullsized":"2023-07-14T11:14:34.040018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:52:20.366790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.058567+0000","last_change":"2023-07-14T11:14:33.053078+0000","last_active":"2023-07-14T11:14:33.058567+0000","last_peered":"2023-07-14T11:14:33.058567+0000","last_clean":"2023-07-14T11:14:33.058567+0000","last_became_active":"2023-07-14T11:14:33.052170+0000","last_became_peered":"2023-07-14T11:14:33.052170+0000","last_unstale":"2023-07-14T11:14:33.058567+0000","last_undegraded":"2023-07-14T11:14:33.058567+0000","last_fullsized":"2023-07-14T11:14:33.058567+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:04:20.820987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.040609+0000","last_change":"2023-07-14T11:14:32.035583+0000","last_active":"2023-07-14T11:14:34.040609+0000","last_peered":"2023-07-14T11:14:34.040609+0000","last_clean":"2023-07-14T11:14:34.040609+0000","last_became_active":"2023-07-14T11:14:32.035357+0000","last_became_peered":"2023-07-14T11:14:32.035357+0000","last_unstale":"2023-07-14T11:14:34.040609+0000","last_undegraded":"2023-07-14T11:14:34.040609+0000","last_fullsized":"2023-07-14T11:14:34.040609+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_clean_scrub_stamp":"2023-07-14T11:14:31.003451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:20:31.702502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.040023+0000","last_change":"2023-07-14T11:13:08.862331+0000","last_active":"2023-07-14T11:14:34.040023+0000","last_peered":"2023-07-14T11:14:34.040023+0000","last_clean":"2023-07-14T11:14:34.040023+0000","last_became_active":"2023-07-14T11:13:08.861817+0000","last_became_peered":"2023-07-14T11:13:08.861817+0000","last_unstale":"2023-07-14T11:14:34.040023+0000","last_undegraded":"2023-07-14T11:14:34.040023+0000","last_fullsized":"2023-07-14T11:14:34.040023+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:23:13.892012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.039980+0000","last_change":"2023-07-14T11:14:33.046271+0000","last_active":"2023-07-14T11:14:34.039980+0000","last_peered":"2023-07-14T11:14:34.039980+0000","last_clean":"2023-07-14T11:14:34.039980+0000","last_became_active":"2023-07-14T11:14:33.046019+0000","last_became_peered":"2023-07-14T11:14:33.046019+0000","last_unstale":"2023-07-14T11:14:34.039980+0000","last_undegraded":"2023-07-14T11:14:34.039980+0000","last_fullsized":"2023-07-14T11:14:34.039980+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:43:21.247508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.035612+0000","last_change":"2023-07-14T11:14:32.039262+0000","last_active":"2023-07-14T11:14:33.035612+0000","last_peered":"2023-07-14T11:14:33.035612+0000","last_clean":"2023-07-14T11:14:33.035612+0000","last_became_active":"2023-07-14T11:14:32.038947+0000","last_became_peered":"2023-07-14T11:14:32.038947+0000","last_unstale":"2023-07-14T11:14:33.035612+0000","last_undegraded":"2023-07-14T11:14:33.035612+0000","last_fullsized":"2023-07-14T11:14:33.035612+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_clean_scrub_stamp":"2023-07-14T11:14:31.003451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:54:53.992398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.040066+0000","last_change":"2023-07-14T11:13:08.757882+0000","last_active":"2023-07-14T11:14:34.040066+0000","last_peered":"2023-07-14T11:14:34.040066+0000","last_clean":"2023-07-14T11:14:34.040066+0000","last_became_active":"2023-07-14T11:13:08.757541+0000","last_became_peered":"2023-07-14T11:13:08.757541+0000","last_unstale":"2023-07-14T11:14:34.040066+0000","last_undegraded":"2023-07-14T11:14:34.040066+0000","last_fullsized":"2023-07-14T11:14:34.040066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:11:43.350238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":197,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.037175+0000","last_change":"2023-07-14T11:13:01.370649+0000","last_active":"2023-07-14T11:14:33.037175+0000","last_peered":"2023-07-14T11:14:33.037175+0000","last_clean":"2023-07-14T11:14:33.037175+0000","last_became_active":"2023-07-14T11:13:01.369478+0000","last_became_peered":"2023-07-14T11:13:01.369478+0000","last_unstale":"2023-07-14T11:14:33.037175+0000","last_undegraded":"2023-07-14T11:14:33.037175+0000","last_fullsized":"2023-07-14T11:14:33.037175+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:00.254800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:00.254800+0000","last_clean_scrub_stamp":"2023-07-14T11:13:00.254800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:32:37.728426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.039096+0000","last_change":"2023-07-14T11:14:33.046954+0000","last_active":"2023-07-14T11:14:34.039096+0000","last_peered":"2023-07-14T11:14:34.039096+0000","last_clean":"2023-07-14T11:14:34.039096+0000","last_became_active":"2023-07-14T11:14:33.046646+0000","last_became_peered":"2023-07-14T11:14:33.046646+0000","last_unstale":"2023-07-14T11:14:34.039096+0000","last_undegraded":"2023-07-14T11:14:34.039096+0000","last_fullsized":"2023-07-14T11:14:34.039096+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:00:03.367995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"36'2","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.040506+0000","last_change":"2023-07-14T11:14:32.031245+0000","last_active":"2023-07-14T11:14:34.040506+0000","last_peered":"2023-07-14T11:14:34.040506+0000","last_clean":"2023-07-14T11:14:34.040506+0000","last_became_active":"2023-07-14T11:14:32.030982+0000","last_became_peered":"2023-07-14T11:14:32.030982+0000","last_unstale":"2023-07-14T11:14:34.040506+0000","last_undegraded":"2023-07-14T11:14:34.040506+0000","last_fullsized":"2023-07-14T11:14:34.040506+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_clean_scrub_stamp":"2023-07-14T11:14:31.003451+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:32:37.595410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.037304+0000","last_change":"2023-07-14T11:13:08.760609+0000","last_active":"2023-07-14T11:14:33.037304+0000","last_peered":"2023-07-14T11:14:33.037304+0000","last_clean":"2023-07-14T11:14:33.037304+0000","last_became_active":"2023-07-14T11:13:08.760285+0000","last_became_peered":"2023-07-14T11:13:08.760285+0000","last_unstale":"2023-07-14T11:14:33.037304+0000","last_undegraded":"2023-07-14T11:14:33.037304+0000","last_fullsized":"2023-07-14T11:14:33.037304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:32:10.518168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.038868+0000","last_change":"2023-07-14T11:14:33.037196+0000","last_active":"2023-07-14T11:14:34.038868+0000","last_peered":"2023-07-14T11:14:34.038868+0000","last_clean":"2023-07-14T11:14:34.038868+0000","last_became_active":"2023-07-14T11:14:33.036858+0000","last_became_peered":"2023-07-14T11:14:33.036858+0000","last_unstale":"2023-07-14T11:14:34.038868+0000","last_undegraded":"2023-07-14T11:14:34.038868+0000","last_fullsized":"2023-07-14T11:14:34.038868+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:37:31.274987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.959508+0000","last_change":"2023-07-14T11:14:32.033642+0000","last_active":"2023-07-14T11:14:34.959508+0000","last_peered":"2023-07-14T11:14:34.959508+0000","last_clean":"2023-07-14T11:14:34.959508+0000","last_became_active":"2023-07-14T11:14:32.033335+0000","last_became_peered":"2023-07-14T11:14:32.033335+0000","last_unstale":"2023-07-14T11:14:34.959508+0000","last_undegraded":"2023-07-14T11:14:34.959508+0000","last_fullsized":"2023-07-14T11:14:34.959508+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_clean_scrub_stamp":"2023-07-14T11:14:31.003451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:20:31.702502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.034961+0000","last_change":"2023-07-14T11:13:08.923899+0000","last_active":"2023-07-14T11:14:33.034961+0000","last_peered":"2023-07-14T11:14:33.034961+0000","last_clean":"2023-07-14T11:14:33.034961+0000","last_became_active":"2023-07-14T11:13:08.923513+0000","last_became_peered":"2023-07-14T11:13:08.923513+0000","last_unstale":"2023-07-14T11:14:33.034961+0000","last_undegraded":"2023-07-14T11:14:33.034961+0000","last_fullsized":"2023-07-14T11:14:33.034961+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:10:32.505755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.044419+0000","last_change":"2023-07-14T11:14:33.041353+0000","last_active":"2023-07-14T11:14:33.044419+0000","last_peered":"2023-07-14T11:14:33.044419+0000","last_clean":"2023-07-14T11:14:33.044419+0000","last_became_active":"2023-07-14T11:14:33.041077+0000","last_became_peered":"2023-07-14T11:14:33.041077+0000","last_unstale":"2023-07-14T11:14:33.044419+0000","last_undegraded":"2023-07-14T11:14:33.044419+0000","last_fullsized":"2023-07-14T11:14:33.044419+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:55:13.967423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.036355+0000","last_change":"2023-07-14T11:14:32.029312+0000","last_active":"2023-07-14T11:14:33.036355+0000","last_peered":"2023-07-14T11:14:33.036355+0000","last_clean":"2023-07-14T11:14:33.036355+0000","last_became_active":"2023-07-14T11:14:32.029074+0000","last_became_peered":"2023-07-14T11:14:32.029074+0000","last_unstale":"2023-07-14T11:14:33.036355+0000","last_undegraded":"2023-07-14T11:14:33.036355+0000","last_fullsized":"2023-07-14T11:14:33.036355+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_clean_scrub_stamp":"2023-07-14T11:14:31.003451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:37:30.269906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.039353+0000","last_change":"2023-07-14T11:13:08.761726+0000","last_active":"2023-07-14T11:14:34.039353+0000","last_peered":"2023-07-14T11:14:34.039353+0000","last_clean":"2023-07-14T11:14:34.039353+0000","last_became_active":"2023-07-14T11:13:08.761365+0000","last_became_peered":"2023-07-14T11:13:08.761365+0000","last_unstale":"2023-07-14T11:14:34.039353+0000","last_undegraded":"2023-07-14T11:14:34.039353+0000","last_fullsized":"2023-07-14T11:14:34.039353+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:07:29.232120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.052635+0000","last_change":"2023-07-14T11:14:33.046382+0000","last_active":"2023-07-14T11:14:33.052635+0000","last_peered":"2023-07-14T11:14:33.052635+0000","last_clean":"2023-07-14T11:14:33.052635+0000","last_became_active":"2023-07-14T11:14:33.046093+0000","last_became_peered":"2023-07-14T11:14:33.046093+0000","last_unstale":"2023-07-14T11:14:33.052635+0000","last_undegraded":"2023-07-14T11:14:33.052635+0000","last_fullsized":"2023-07-14T11:14:33.052635+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:56:02.633239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.639680+0000","last_change":"2023-07-14T11:14:32.028140+0000","last_active":"2023-07-14T11:14:34.639680+0000","last_peered":"2023-07-14T11:14:34.639680+0000","last_clean":"2023-07-14T11:14:34.639680+0000","last_became_active":"2023-07-14T11:14:32.027886+0000","last_became_peered":"2023-07-14T11:14:32.027886+0000","last_unstale":"2023-07-14T11:14:34.639680+0000","last_undegraded":"2023-07-14T11:14:34.639680+0000","last_fullsized":"2023-07-14T11:14:34.639680+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_clean_scrub_stamp":"2023-07-14T11:14:31.003451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:25:16.939854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.959833+0000","last_change":"2023-07-14T11:13:08.762084+0000","last_active":"2023-07-14T11:14:34.959833+0000","last_peered":"2023-07-14T11:14:34.959833+0000","last_clean":"2023-07-14T11:14:34.959833+0000","last_became_active":"2023-07-14T11:13:08.761763+0000","last_became_peered":"2023-07-14T11:13:08.761763+0000","last_unstale":"2023-07-14T11:14:34.959833+0000","last_undegraded":"2023-07-14T11:14:34.959833+0000","last_fullsized":"2023-07-14T11:14:34.959833+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:37:07.245332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27948,"kb_used_data":996,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343892,"statfs":{"total":96636764160,"available":96608145408,"internally_reserved":0,"allocated":1019904,"data_stored":760729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:14:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":8.4339999999999993,"5min":8.4339999999999993,"15min":8.4339999999999993},"last":0.47199999999999998},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":8.4559999999999995,"5min":8.4559999999999995,"15min":8.4559999999999995},"last":0.72499999999999998}]},{"osd":1,"last update":"Fri Jul 14 11:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":6.3520000000000003,"5min":6.3520000000000003,"15min":6.3520000000000003},"last":0.56499999999999995},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":6.8550000000000004,"5min":6.8550000000000004,"15min":6.8550000000000004},"last":0.66000000000000003}]},{"osd":2,"last update":"Fri Jul 14 11:14:00 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.25,"15min":1.25},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":7.0289999999999999,"5min":7.0289999999999999,"15min":7.0289999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.52700000000000002}]},{"osd":3,"last update":"Fri Jul 14 11:14:00 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.319,"15min":1.319},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":10.337,"5min":10.337,"15min":10.337},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.921,"5min":1.921,"15min":1.921},"last":0.60199999999999998}]},{"osd":4,"last update":"Fri Jul 14 11:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.495},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.626}]},{"osd":5,"last update":"Fri Jul 14 11:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.82699999999999996}]},{"osd":6,"last update":"Fri Jul 14 11:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.80100000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":413696,"data_stored":169309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":1.0229999999999999},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.69399999999999995}]},{"osd":1,"last update":"Fri Jul 14 11:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.79300000000000004}]},{"osd":2,"last update":"Fri Jul 14 11:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.995}]},{"osd":3,"last update":"Fri Jul 14 11:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.83799999999999997}]},{"osd":4,"last update":"Fri Jul 14 11:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.50900000000000001}]},{"osd":5,"last update":"Fri Jul 14 11:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.93500000000000005}]},{"osd":7,"last update":"Fri Jul 14 11:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.623},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.76800000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":425984,"data_stored":175470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.44700000000000001}]},{"osd":2,"last update":"Fri Jul 14 11:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":2.476,"5min":2.476,"15min":2.476},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":2.6299999999999999,"5min":2.6299999999999999,"15min":2.6299999999999999},"last":0.49099999999999999}]},{"osd":3,"last update":"Fri Jul 14 11:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.50900000000000001}]},{"osd":4,"last update":"Fri Jul 14 11:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":1.0149999999999999},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":1.054}]},{"osd":5,"last update":"Fri Jul 14 11:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":1.1739999999999999},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.095}]},{"osd":6,"last update":"Fri Jul 14 11:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":1.141},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":1.123}]},{"osd":7,"last update":"Fri Jul 14 11:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.2010000000000001},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.86099999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":1007616,"data_stored":759129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.252},{"interface":"front","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.40799999999999997}]},{"osd":2,"last update":"Fri Jul 14 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.376}]},{"osd":3,"last update":"Fri Jul 14 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.42099999999999999}]},{"osd":4,"last update":"Fri Jul 14 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.57099999999999995}]},{"osd":5,"last update":"Fri Jul 14 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.502},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.61499999999999999}]},{"osd":6,"last update":"Fri Jul 14 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.52200000000000002}]},{"osd":7,"last update":"Fri Jul 14 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.63200000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":425984,"data_stored":175450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:14:04 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.35699999999999998}]},{"osd":1,"last update":"Fri Jul 14 11:14:04 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.46200000000000002}]},{"osd":3,"last update":"Fri Jul 14 11:14:04 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.44900000000000001}]},{"osd":4,"last update":"Fri Jul 14 11:14:04 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.72999999999999998}]},{"osd":5,"last update":"Fri Jul 14 11:14:04 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.71899999999999997}]},{"osd":6,"last update":"Fri Jul 14 11:14:04 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.70599999999999996}]},{"osd":7,"last update":"Fri Jul 14 11:14:04 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.75900000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":428,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":438272,"data_stored":176978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.40600000000000003}]},{"osd":1,"last update":"Fri Jul 14 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.436},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.51500000000000001}]},{"osd":2,"last update":"Fri Jul 14 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":0.59799999999999998}]},{"osd":4,"last update":"Fri Jul 14 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.74399999999999999}]},{"osd":5,"last update":"Fri Jul 14 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.657,"5min":1.657,"15min":1.657},"last":0.85399999999999998}]},{"osd":6,"last update":"Fri Jul 14 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.726,"5min":1.726,"15min":1.726},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":0.83899999999999997}]},{"osd":7,"last update":"Fri Jul 14 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.873}]}]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":408,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":417792,"data_stored":169331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.63800000000000001}]},{"osd":1,"last update":"Fri Jul 14 11:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.748},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.59799999999999998}]},{"osd":2,"last update":"Fri Jul 14 11:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.77100000000000002}]},{"osd":3,"last update":"Fri Jul 14 11:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.79400000000000004}]},{"osd":5,"last update":"Fri Jul 14 11:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.71799999999999997}]},{"osd":6,"last update":"Fri Jul 14 11:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.65800000000000003}]},{"osd":7,"last update":"Fri Jul 14 11:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.85799999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":420,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":430080,"data_stored":175492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.59599999999999997}]},{"osd":1,"last update":"Fri Jul 14 11:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.54700000000000004}]},{"osd":2,"last update":"Fri Jul 14 11:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.65800000000000003}]},{"osd":3,"last update":"Fri Jul 14 11:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.806,"5min":1.806,"15min":1.806},"last":0.71699999999999997}]},{"osd":4,"last update":"Fri Jul 14 11:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.64100000000000001}]},{"osd":6,"last update":"Fri Jul 14 11:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.67400000000000004}]},{"osd":7,"last update":"Fri Jul 14 11:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.74099999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T11:14:37.471 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T11:14:37.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.696+0000 7fad6adff700 1 Processor -- start 2023-07-14T11:14:37.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.696+0000 7fad6adff700 1 -- start start 2023-07-14T11:14:37.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.697+0000 7fad6adff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fad6415c950 0x7fad640b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:37.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.697+0000 7fad6adff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fad640b1e00 0x7fad640d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:37.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.697+0000 7fad6adff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad640d2ce0 con 0x7fad640b2350 2023-07-14T11:14:37.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.697+0000 7fad6adff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad640b3350 con 0x7fad6415c950 2023-07-14T11:14:37.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.697+0000 7fad6adff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad640b3630 con 0x7fad640b1e00 2023-07-14T11:14:37.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.697+0000 7fad68b9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fad6415c950 0x7fad640b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:37.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.697+0000 7fad68b9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fad6415c950 0x7fad640b43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34352/0 (socket says 172.21.15.84:34352) 2023-07-14T11:14:37.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.697+0000 7fad68b9b700 1 -- 172.21.15.84:0/2816317295 learned_addr learned my addr 172.21.15.84:0/2816317295 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:37.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.697+0000 7fad63fff700 1 --2- 172.21.15.84:0/2816317295 >> v2:172.21.15.179:3300/0 conn(0x7fad640b1e00 0x7fad640d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:37.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.698+0000 7fad68b9b700 1 -- 172.21.15.84:0/2816317295 >> v2:172.21.15.179:3300/0 conn(0x7fad640b1e00 msgr2=0x7fad640d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:37.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.698+0000 7fad68b9b700 1 --2- 172.21.15.84:0/2816317295 >> v2:172.21.15.179:3300/0 conn(0x7fad640b1e00 0x7fad640d0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:37.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.698+0000 7fad68b9b700 1 -- 172.21.15.84:0/2816317295 >> v1:172.21.15.179:6789/0 conn(0x7fad640b2350 legacy=0x7fad640afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:37.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.698+0000 7fad68b9b700 1 -- 172.21.15.84:0/2816317295 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad640b3910 con 0x7fad6415c950 2023-07-14T11:14:37.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.698+0000 7fad68b9b700 1 --2- 172.21.15.84:0/2816317295 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad6415c950 0x7fad640b43f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fad64072140 tx=0x7fad58009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c77c5b27cc9aed07 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:37.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.698+0000 7fad637fe700 1 -- 172.21.15.84:0/2816317295 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad58005e30 con 0x7fad6415c950 2023-07-14T11:14:37.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.698+0000 7fad637fe700 1 -- 172.21.15.84:0/2816317295 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad58006030 con 0x7fad6415c950 2023-07-14T11:14:37.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.698+0000 7fad637fe700 1 -- 172.21.15.84:0/2816317295 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad580063e0 con 0x7fad6415c950 2023-07-14T11:14:37.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.699+0000 7fad6adff700 1 -- 172.21.15.84:0/2816317295 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad6415c950 msgr2=0x7fad640b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:37.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.699+0000 7fad6adff700 1 --2- 172.21.15.84:0/2816317295 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad6415c950 0x7fad640b43f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fad64072140 tx=0x7fad58009bd0 comp rx=0 tx=0).stop 2023-07-14T11:14:37.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.699+0000 7fad6adff700 1 -- 172.21.15.84:0/2816317295 shutdown_connections 2023-07-14T11:14:37.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.699+0000 7fad6adff700 1 --2- 172.21.15.84:0/2816317295 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad6415c950 0x7fad640b43f0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:37.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.699+0000 7fad6adff700 1 --2- 172.21.15.84:0/2816317295 >> v2:172.21.15.179:3300/0 conn(0x7fad640b1e00 0x7fad640d0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:37.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.699+0000 7fad6adff700 1 -- 172.21.15.84:0/2816317295 >> 172.21.15.84:0/2816317295 conn(0x7fad6409c1d0 msgr2=0x7fad640d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:37.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.699+0000 7fad6adff700 1 -- 172.21.15.84:0/2816317295 shutdown_connections 2023-07-14T11:14:37.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.699+0000 7fad6adff700 1 -- 172.21.15.84:0/2816317295 wait complete. 2023-07-14T11:14:37.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.700+0000 7fad6adff700 1 Processor -- start 2023-07-14T11:14:37.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.701+0000 7fad6adff700 1 -- start start 2023-07-14T11:14:37.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.701+0000 7fad6adff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fad640b1e00 0x7fad64157060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:37.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.701+0000 7fad6adff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad640b2350 0x7fad640cd550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:37.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.702+0000 7fad6adff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad6415c950 0x7fad640cda90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:37.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.702+0000 7fad6adff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad641e5c70 con 0x7fad640b2350 2023-07-14T11:14:37.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.702+0000 7fad6adff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad64157b90 con 0x7fad6415c950 2023-07-14T11:14:37.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.702+0000 7fad6adff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad640ce0a0 con 0x7fad640b1e00 2023-07-14T11:14:37.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.702+0000 7fad63fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad640b2350 0x7fad640cd550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:37.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.702+0000 7fad63fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad640b2350 0x7fad640cd550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34356/0 (socket says 172.21.15.84:34356) 2023-07-14T11:14:37.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.702+0000 7fad63fff700 1 -- 172.21.15.84:0/52947444 learned_addr learned my addr 172.21.15.84:0/52947444 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:37.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.702+0000 7fad68b9b700 1 --2- 172.21.15.84:0/52947444 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fad640b1e00 0x7fad64157060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:37.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.702+0000 7fad6939c700 1 --2- 172.21.15.84:0/52947444 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad6415c950 0x7fad640cda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:37.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.702+0000 7fad63fff700 1 -- 172.21.15.84:0/52947444 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fad640b1e00 msgr2=0x7fad64157060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:37.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.702+0000 7fad63fff700 1 --2- 172.21.15.84:0/52947444 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fad640b1e00 0x7fad64157060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:37.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.702+0000 7fad63fff700 1 -- 172.21.15.84:0/52947444 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad6415c950 msgr2=0x7fad640cda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:37.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.702+0000 7fad63fff700 1 --2- 172.21.15.84:0/52947444 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad6415c950 0x7fad640cda90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:37.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.702+0000 7fad63fff700 1 -- 172.21.15.84:0/52947444 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad58009500 con 0x7fad640b2350 2023-07-14T11:14:37.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.702+0000 7fad6939c700 1 --2- 172.21.15.84:0/52947444 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad6415c950 0x7fad640cda90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:14:37.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.702+0000 7fad63fff700 1 --2- 172.21.15.84:0/52947444 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad640b2350 0x7fad640cd550 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fad5000e810 tx=0x7fad5000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:37.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.703+0000 7fad617fa700 1 -- 172.21.15.84:0/52947444 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad50013610 con 0x7fad640b2350 2023-07-14T11:14:37.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.703+0000 7fad617fa700 1 -- 172.21.15.84:0/52947444 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad50013770 con 0x7fad640b2350 2023-07-14T11:14:37.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.703+0000 7fad6adff700 1 -- 172.21.15.84:0/52947444 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad640ce380 con 0x7fad640b2350 2023-07-14T11:14:37.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.703+0000 7fad617fa700 1 -- 172.21.15.84:0/52947444 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad50013b20 con 0x7fad640b2350 2023-07-14T11:14:37.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.703+0000 7fad6adff700 1 -- 172.21.15.84:0/52947444 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad640b6050 con 0x7fad640b2350 2023-07-14T11:14:37.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.704+0000 7fad6adff700 1 -- 172.21.15.84:0/52947444 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad6404e280 con 0x7fad640b2350 2023-07-14T11:14:37.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.705+0000 7fad617fa700 1 -- 172.21.15.84:0/52947444 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fad50013c80 con 0x7fad640b2350 2023-07-14T11:14:37.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.706+0000 7fad617fa700 1 --2- 172.21.15.84:0/52947444 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fad4806ace0 0x7fad4806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:37.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.706+0000 7fad617fa700 1 -- 172.21.15.84:0/52947444 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fad50089060 con 0x7fad640b2350 2023-07-14T11:14:37.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.706+0000 7fad68b9b700 1 --2- 172.21.15.84:0/52947444 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fad4806ace0 0x7fad4806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:37.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.707+0000 7fad68b9b700 1 --2- 172.21.15.84:0/52947444 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fad4806ace0 0x7fad4806d190 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fad64072140 tx=0x7fad58008070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:37.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.710+0000 7fad617fa700 1 -- 172.21.15.84:0/52947444 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fad50057bb0 con 0x7fad640b2350 2023-07-14T11:14:37.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.903+0000 7fad6adff700 1 -- 172.21.15.84:0/52947444 --> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fad640b3ed0 con 0x7fad4806ace0 2023-07-14T11:14:37.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.911+0000 7fad617fa700 1 -- 172.21.15.84:0/52947444 <== mgr.4104 v2:172.21.15.84:6832/379617029 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310908 (secure 0 0 0) 0x7fad58006cb0 con 0x7fad4806ace0 2023-07-14T11:14:37.917 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:14:37.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.916+0000 7fad6adff700 1 -- 172.21.15.84:0/52947444 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fad4806ace0 msgr2=0x7fad4806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:37.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.916+0000 7fad6adff700 1 --2- 172.21.15.84:0/52947444 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fad4806ace0 0x7fad4806d190 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fad64072140 tx=0x7fad58008070 comp rx=0 tx=0).stop 2023-07-14T11:14:37.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.916+0000 7fad6adff700 1 -- 172.21.15.84:0/52947444 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad640b2350 msgr2=0x7fad640cd550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:37.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.916+0000 7fad6adff700 1 --2- 172.21.15.84:0/52947444 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad640b2350 0x7fad640cd550 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fad5000e810 tx=0x7fad5000eb20 comp rx=0 tx=0).stop 2023-07-14T11:14:37.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.916+0000 7fad6adff700 1 -- 172.21.15.84:0/52947444 shutdown_connections 2023-07-14T11:14:37.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.916+0000 7fad6adff700 1 --2- 172.21.15.84:0/52947444 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fad4806ace0 0x7fad4806d190 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:37.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.916+0000 7fad6adff700 1 --2- 172.21.15.84:0/52947444 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fad640b1e00 0x7fad64157060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:37.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.916+0000 7fad6adff700 1 --2- 172.21.15.84:0/52947444 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad6415c950 0x7fad640cda90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:37.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.916+0000 7fad6adff700 1 --2- 172.21.15.84:0/52947444 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad640b2350 0x7fad640cd550 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:37.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.916+0000 7fad6adff700 1 -- 172.21.15.84:0/52947444 >> 172.21.15.84:0/52947444 conn(0x7fad6409c1d0 msgr2=0x7fad640b4c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:37.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.916+0000 7fad6adff700 1 -- 172.21.15.84:0/52947444 shutdown_connections 2023-07-14T11:14:37.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:37.916+0000 7fad6adff700 1 -- 172.21.15.84:0/52947444 wait complete. 2023-07-14T11:14:37.922 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-07-14T11:14:37.937 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":78,"stamp":"2023-07-14T11:14:36.088475+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":151,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220088,"kb_used_data":4472,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754754632,"statfs":{"total":773094113280,"available":772868743168,"internally_reserved":0,"allocated":4579328,"data_stored":2561888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.079070"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.639929+0000","last_change":"2023-07-14T11:14:33.057562+0000","last_active":"2023-07-14T11:14:34.639929+0000","last_peered":"2023-07-14T11:14:34.639929+0000","last_clean":"2023-07-14T11:14:34.639929+0000","last_became_active":"2023-07-14T11:14:33.057300+0000","last_became_peered":"2023-07-14T11:14:33.057300+0000","last_unstale":"2023-07-14T11:14:34.639929+0000","last_undegraded":"2023-07-14T11:14:34.639929+0000","last_fullsized":"2023-07-14T11:14:34.639929+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:31:18.643967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.639993+0000","last_change":"2023-07-14T11:14:33.040869+0000","last_active":"2023-07-14T11:14:34.639993+0000","last_peered":"2023-07-14T11:14:34.639993+0000","last_clean":"2023-07-14T11:14:34.639993+0000","last_became_active":"2023-07-14T11:14:33.040460+0000","last_became_peered":"2023-07-14T11:14:33.040460+0000","last_unstale":"2023-07-14T11:14:34.639993+0000","last_undegraded":"2023-07-14T11:14:34.639993+0000","last_fullsized":"2023-07-14T11:14:34.639993+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:56:02.633239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.062957+0000","last_change":"2023-07-14T11:14:33.056417+0000","last_active":"2023-07-14T11:14:33.062957+0000","last_peered":"2023-07-14T11:14:33.062957+0000","last_clean":"2023-07-14T11:14:33.062957+0000","last_became_active":"2023-07-14T11:14:33.056213+0000","last_became_peered":"2023-07-14T11:14:33.056213+0000","last_unstale":"2023-07-14T11:14:33.062957+0000","last_undegraded":"2023-07-14T11:14:33.062957+0000","last_fullsized":"2023-07-14T11:14:33.062957+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:00:42.807003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.040340+0000","last_change":"2023-07-14T11:14:33.043957+0000","last_active":"2023-07-14T11:14:34.040340+0000","last_peered":"2023-07-14T11:14:34.040340+0000","last_clean":"2023-07-14T11:14:34.040340+0000","last_became_active":"2023-07-14T11:14:33.043466+0000","last_became_peered":"2023-07-14T11:14:33.043466+0000","last_unstale":"2023-07-14T11:14:34.040340+0000","last_undegraded":"2023-07-14T11:14:34.040340+0000","last_fullsized":"2023-07-14T11:14:34.040340+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:29:51.449238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.040106+0000","last_change":"2023-07-14T11:14:33.043247+0000","last_active":"2023-07-14T11:14:34.040106+0000","last_peered":"2023-07-14T11:14:34.040106+0000","last_clean":"2023-07-14T11:14:34.040106+0000","last_became_active":"2023-07-14T11:14:33.042782+0000","last_became_peered":"2023-07-14T11:14:33.042782+0000","last_unstale":"2023-07-14T11:14:34.040106+0000","last_undegraded":"2023-07-14T11:14:34.040106+0000","last_fullsized":"2023-07-14T11:14:34.040106+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:35:06.611719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.038948+0000","last_change":"2023-07-14T11:14:33.041873+0000","last_active":"2023-07-14T11:14:34.038948+0000","last_peered":"2023-07-14T11:14:34.038948+0000","last_clean":"2023-07-14T11:14:34.038948+0000","last_became_active":"2023-07-14T11:14:33.041590+0000","last_became_peered":"2023-07-14T11:14:33.041590+0000","last_unstale":"2023-07-14T11:14:34.038948+0000","last_undegraded":"2023-07-14T11:14:34.038948+0000","last_fullsized":"2023-07-14T11:14:34.038948+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:04:20.820987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.039601+0000","last_change":"2023-07-14T11:14:33.045113+0000","last_active":"2023-07-14T11:14:34.039601+0000","last_peered":"2023-07-14T11:14:34.039601+0000","last_clean":"2023-07-14T11:14:34.039601+0000","last_became_active":"2023-07-14T11:14:33.044827+0000","last_became_peered":"2023-07-14T11:14:33.044827+0000","last_unstale":"2023-07-14T11:14:34.039601+0000","last_undegraded":"2023-07-14T11:14:34.039601+0000","last_fullsized":"2023-07-14T11:14:34.039601+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:27:02.057195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.639651+0000","last_change":"2023-07-14T11:14:33.054584+0000","last_active":"2023-07-14T11:14:34.639651+0000","last_peered":"2023-07-14T11:14:34.639651+0000","last_clean":"2023-07-14T11:14:34.639651+0000","last_became_active":"2023-07-14T11:14:33.054306+0000","last_became_peered":"2023-07-14T11:14:33.054306+0000","last_unstale":"2023-07-14T11:14:34.639651+0000","last_undegraded":"2023-07-14T11:14:34.639651+0000","last_fullsized":"2023-07-14T11:14:34.639651+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:24:21.374319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.062981+0000","last_change":"2023-07-14T11:14:33.054741+0000","last_active":"2023-07-14T11:14:33.062981+0000","last_peered":"2023-07-14T11:14:33.062981+0000","last_clean":"2023-07-14T11:14:33.062981+0000","last_became_active":"2023-07-14T11:14:33.054233+0000","last_became_peered":"2023-07-14T11:14:33.054233+0000","last_unstale":"2023-07-14T11:14:33.062981+0000","last_undegraded":"2023-07-14T11:14:33.062981+0000","last_fullsized":"2023-07-14T11:14:33.062981+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:41:30.697733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.040118+0000","last_change":"2023-07-14T11:14:33.053943+0000","last_active":"2023-07-14T11:14:34.040118+0000","last_peered":"2023-07-14T11:14:34.040118+0000","last_clean":"2023-07-14T11:14:34.040118+0000","last_became_active":"2023-07-14T11:14:33.053618+0000","last_became_peered":"2023-07-14T11:14:33.053618+0000","last_unstale":"2023-07-14T11:14:34.040118+0000","last_undegraded":"2023-07-14T11:14:34.040118+0000","last_fullsized":"2023-07-14T11:14:34.040118+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:08:22.219306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.040449+0000","last_change":"2023-07-14T11:14:33.053887+0000","last_active":"2023-07-14T11:14:34.040449+0000","last_peered":"2023-07-14T11:14:34.040449+0000","last_clean":"2023-07-14T11:14:34.040449+0000","last_became_active":"2023-07-14T11:14:33.053595+0000","last_became_peered":"2023-07-14T11:14:33.053595+0000","last_unstale":"2023-07-14T11:14:34.040449+0000","last_undegraded":"2023-07-14T11:14:34.040449+0000","last_fullsized":"2023-07-14T11:14:34.040449+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:33:04.330827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.060204+0000","last_change":"2023-07-14T11:14:33.052449+0000","last_active":"2023-07-14T11:14:33.060204+0000","last_peered":"2023-07-14T11:14:33.060204+0000","last_clean":"2023-07-14T11:14:33.060204+0000","last_became_active":"2023-07-14T11:14:33.052132+0000","last_became_peered":"2023-07-14T11:14:33.052132+0000","last_unstale":"2023-07-14T11:14:33.060204+0000","last_undegraded":"2023-07-14T11:14:33.060204+0000","last_fullsized":"2023-07-14T11:14:33.060204+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:10:14.555560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.039768+0000","last_change":"2023-07-14T11:14:33.055155+0000","last_active":"2023-07-14T11:14:34.039768+0000","last_peered":"2023-07-14T11:14:34.039768+0000","last_clean":"2023-07-14T11:14:34.039768+0000","last_became_active":"2023-07-14T11:14:33.054650+0000","last_became_peered":"2023-07-14T11:14:33.054650+0000","last_unstale":"2023-07-14T11:14:34.039768+0000","last_undegraded":"2023-07-14T11:14:34.039768+0000","last_fullsized":"2023-07-14T11:14:34.039768+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:08:53.497925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.052546+0000","last_change":"2023-07-14T11:14:33.047908+0000","last_active":"2023-07-14T11:14:33.052546+0000","last_peered":"2023-07-14T11:14:33.052546+0000","last_clean":"2023-07-14T11:14:33.052546+0000","last_became_active":"2023-07-14T11:14:33.047567+0000","last_became_peered":"2023-07-14T11:14:33.047567+0000","last_unstale":"2023-07-14T11:14:33.052546+0000","last_undegraded":"2023-07-14T11:14:33.052546+0000","last_fullsized":"2023-07-14T11:14:33.052546+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:33:35.066799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.039809+0000","last_change":"2023-07-14T11:14:33.051764+0000","last_active":"2023-07-14T11:14:34.039809+0000","last_peered":"2023-07-14T11:14:34.039809+0000","last_clean":"2023-07-14T11:14:34.039809+0000","last_became_active":"2023-07-14T11:14:33.051452+0000","last_became_peered":"2023-07-14T11:14:33.051452+0000","last_unstale":"2023-07-14T11:14:34.039809+0000","last_undegraded":"2023-07-14T11:14:34.039809+0000","last_fullsized":"2023-07-14T11:14:34.039809+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:54:54.997480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.063901+0000","last_change":"2023-07-14T11:14:33.059555+0000","last_active":"2023-07-14T11:14:33.063901+0000","last_peered":"2023-07-14T11:14:33.063901+0000","last_clean":"2023-07-14T11:14:33.063901+0000","last_became_active":"2023-07-14T11:14:33.059065+0000","last_became_peered":"2023-07-14T11:14:33.059065+0000","last_unstale":"2023-07-14T11:14:33.063901+0000","last_undegraded":"2023-07-14T11:14:33.063901+0000","last_fullsized":"2023-07-14T11:14:33.063901+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:27:02.057195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.060426+0000","last_change":"2023-07-14T11:14:33.056183+0000","last_active":"2023-07-14T11:14:33.060426+0000","last_peered":"2023-07-14T11:14:33.060426+0000","last_clean":"2023-07-14T11:14:33.060426+0000","last_became_active":"2023-07-14T11:14:33.055884+0000","last_became_peered":"2023-07-14T11:14:33.055884+0000","last_unstale":"2023-07-14T11:14:33.060426+0000","last_undegraded":"2023-07-14T11:14:33.060426+0000","last_fullsized":"2023-07-14T11:14:33.060426+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:48:48.956070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.959765+0000","last_change":"2023-07-14T11:14:33.046446+0000","last_active":"2023-07-14T11:14:34.959765+0000","last_peered":"2023-07-14T11:14:34.959765+0000","last_clean":"2023-07-14T11:14:34.959765+0000","last_became_active":"2023-07-14T11:14:33.046129+0000","last_became_peered":"2023-07-14T11:14:33.046129+0000","last_unstale":"2023-07-14T11:14:34.959765+0000","last_undegraded":"2023-07-14T11:14:34.959765+0000","last_fullsized":"2023-07-14T11:14:34.959765+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:29:55.676526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.040418+0000","last_change":"2023-07-14T11:14:33.047508+0000","last_active":"2023-07-14T11:14:34.040418+0000","last_peered":"2023-07-14T11:14:34.040418+0000","last_clean":"2023-07-14T11:14:34.040418+0000","last_became_active":"2023-07-14T11:14:33.047175+0000","last_became_peered":"2023-07-14T11:14:33.047175+0000","last_unstale":"2023-07-14T11:14:34.040418+0000","last_undegraded":"2023-07-14T11:14:34.040418+0000","last_fullsized":"2023-07-14T11:14:34.040418+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:11:21.769797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.959624+0000","last_change":"2023-07-14T11:14:33.045116+0000","last_active":"2023-07-14T11:14:34.959624+0000","last_peered":"2023-07-14T11:14:34.959624+0000","last_clean":"2023-07-14T11:14:34.959624+0000","last_became_active":"2023-07-14T11:14:33.044818+0000","last_became_peered":"2023-07-14T11:14:33.044818+0000","last_unstale":"2023-07-14T11:14:34.959624+0000","last_undegraded":"2023-07-14T11:14:34.959624+0000","last_fullsized":"2023-07-14T11:14:34.959624+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:56:31.896366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.039959+0000","last_change":"2023-07-14T11:14:33.054922+0000","last_active":"2023-07-14T11:14:34.039959+0000","last_peered":"2023-07-14T11:14:34.039959+0000","last_clean":"2023-07-14T11:14:34.039959+0000","last_became_active":"2023-07-14T11:14:33.054340+0000","last_became_peered":"2023-07-14T11:14:33.054340+0000","last_unstale":"2023-07-14T11:14:34.039959+0000","last_undegraded":"2023-07-14T11:14:34.039959+0000","last_fullsized":"2023-07-14T11:14:34.039959+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:33:34.783973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.052528+0000","last_change":"2023-07-14T11:14:33.047310+0000","last_active":"2023-07-14T11:14:33.052528+0000","last_peered":"2023-07-14T11:14:33.052528+0000","last_clean":"2023-07-14T11:14:33.052528+0000","last_became_active":"2023-07-14T11:14:33.047016+0000","last_became_peered":"2023-07-14T11:14:33.047016+0000","last_unstale":"2023-07-14T11:14:33.052528+0000","last_undegraded":"2023-07-14T11:14:33.052528+0000","last_fullsized":"2023-07-14T11:14:33.052528+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:13:31.772383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.058648+0000","last_change":"2023-07-14T11:14:33.053097+0000","last_active":"2023-07-14T11:14:33.058648+0000","last_peered":"2023-07-14T11:14:33.058648+0000","last_clean":"2023-07-14T11:14:33.058648+0000","last_became_active":"2023-07-14T11:14:33.052726+0000","last_became_peered":"2023-07-14T11:14:33.052726+0000","last_unstale":"2023-07-14T11:14:33.058648+0000","last_undegraded":"2023-07-14T11:14:33.058648+0000","last_fullsized":"2023-07-14T11:14:33.058648+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:02:38.157600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.039982+0000","last_change":"2023-07-14T11:14:33.042149+0000","last_active":"2023-07-14T11:14:34.039982+0000","last_peered":"2023-07-14T11:14:34.039982+0000","last_clean":"2023-07-14T11:14:34.039982+0000","last_became_active":"2023-07-14T11:14:33.041877+0000","last_became_peered":"2023-07-14T11:14:33.041877+0000","last_unstale":"2023-07-14T11:14:34.039982+0000","last_undegraded":"2023-07-14T11:14:34.039982+0000","last_fullsized":"2023-07-14T11:14:34.039982+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:39:11.139094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.959755+0000","last_change":"2023-07-14T11:14:33.059904+0000","last_active":"2023-07-14T11:14:34.959755+0000","last_peered":"2023-07-14T11:14:34.959755+0000","last_clean":"2023-07-14T11:14:34.959755+0000","last_became_active":"2023-07-14T11:14:33.059539+0000","last_became_peered":"2023-07-14T11:14:33.059539+0000","last_unstale":"2023-07-14T11:14:34.959755+0000","last_undegraded":"2023-07-14T11:14:34.959755+0000","last_fullsized":"2023-07-14T11:14:34.959755+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:32:49.813492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.039340+0000","last_change":"2023-07-14T11:14:33.047302+0000","last_active":"2023-07-14T11:14:34.039340+0000","last_peered":"2023-07-14T11:14:34.039340+0000","last_clean":"2023-07-14T11:14:34.039340+0000","last_became_active":"2023-07-14T11:14:33.047059+0000","last_became_peered":"2023-07-14T11:14:33.047059+0000","last_unstale":"2023-07-14T11:14:34.039340+0000","last_undegraded":"2023-07-14T11:14:34.039340+0000","last_fullsized":"2023-07-14T11:14:34.039340+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:27:02.057195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.959706+0000","last_change":"2023-07-14T11:14:33.043048+0000","last_active":"2023-07-14T11:14:34.959706+0000","last_peered":"2023-07-14T11:14:34.959706+0000","last_clean":"2023-07-14T11:14:34.959706+0000","last_became_active":"2023-07-14T11:14:33.042736+0000","last_became_peered":"2023-07-14T11:14:33.042736+0000","last_unstale":"2023-07-14T11:14:34.959706+0000","last_undegraded":"2023-07-14T11:14:34.959706+0000","last_fullsized":"2023-07-14T11:14:34.959706+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:39:15.997805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.039853+0000","last_change":"2023-07-14T11:14:33.045766+0000","last_active":"2023-07-14T11:14:34.039853+0000","last_peered":"2023-07-14T11:14:34.039853+0000","last_clean":"2023-07-14T11:14:34.039853+0000","last_became_active":"2023-07-14T11:14:33.045353+0000","last_became_peered":"2023-07-14T11:14:33.045353+0000","last_unstale":"2023-07-14T11:14:34.039853+0000","last_undegraded":"2023-07-14T11:14:34.039853+0000","last_fullsized":"2023-07-14T11:14:34.039853+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:34:09.482159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.959447+0000","last_change":"2023-07-14T11:14:33.043842+0000","last_active":"2023-07-14T11:14:34.959447+0000","last_peered":"2023-07-14T11:14:34.959447+0000","last_clean":"2023-07-14T11:14:34.959447+0000","last_became_active":"2023-07-14T11:14:33.043570+0000","last_became_peered":"2023-07-14T11:14:33.043570+0000","last_unstale":"2023-07-14T11:14:34.959447+0000","last_undegraded":"2023-07-14T11:14:34.959447+0000","last_fullsized":"2023-07-14T11:14:34.959447+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:39:17.319814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.959594+0000","last_change":"2023-07-14T11:14:33.044581+0000","last_active":"2023-07-14T11:14:34.959594+0000","last_peered":"2023-07-14T11:14:34.959594+0000","last_clean":"2023-07-14T11:14:34.959594+0000","last_became_active":"2023-07-14T11:14:33.044301+0000","last_became_peered":"2023-07-14T11:14:33.044301+0000","last_unstale":"2023-07-14T11:14:34.959594+0000","last_undegraded":"2023-07-14T11:14:34.959594+0000","last_fullsized":"2023-07-14T11:14:34.959594+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:18:16.426862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.058613+0000","last_change":"2023-07-14T11:14:33.052996+0000","last_active":"2023-07-14T11:14:33.058613+0000","last_peered":"2023-07-14T11:14:33.058613+0000","last_clean":"2023-07-14T11:14:33.058613+0000","last_became_active":"2023-07-14T11:14:33.052346+0000","last_became_peered":"2023-07-14T11:14:33.052346+0000","last_unstale":"2023-07-14T11:14:33.058613+0000","last_undegraded":"2023-07-14T11:14:33.058613+0000","last_fullsized":"2023-07-14T11:14:33.058613+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:46:30.241388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.038621+0000","last_change":"2023-07-14T11:14:33.039236+0000","last_active":"2023-07-14T11:14:34.038621+0000","last_peered":"2023-07-14T11:14:34.038621+0000","last_clean":"2023-07-14T11:14:34.038621+0000","last_became_active":"2023-07-14T11:14:33.038976+0000","last_became_peered":"2023-07-14T11:14:33.038976+0000","last_unstale":"2023-07-14T11:14:34.038621+0000","last_undegraded":"2023-07-14T11:14:34.038621+0000","last_fullsized":"2023-07-14T11:14:34.038621+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:33:35.066799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.060953+0000","last_change":"2023-07-14T11:14:33.057372+0000","last_active":"2023-07-14T11:14:33.060953+0000","last_peered":"2023-07-14T11:14:33.060953+0000","last_clean":"2023-07-14T11:14:33.060953+0000","last_became_active":"2023-07-14T11:14:33.057002+0000","last_became_peered":"2023-07-14T11:14:33.057002+0000","last_unstale":"2023-07-14T11:14:33.060953+0000","last_undegraded":"2023-07-14T11:14:33.060953+0000","last_fullsized":"2023-07-14T11:14:33.060953+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:00:03.367995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"36'4","reported_seq":17,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.959801+0000","last_change":"2023-07-14T11:14:32.038267+0000","last_active":"2023-07-14T11:14:34.959801+0000","last_peered":"2023-07-14T11:14:34.959801+0000","last_clean":"2023-07-14T11:14:34.959801+0000","last_became_active":"2023-07-14T11:14:32.037523+0000","last_became_peered":"2023-07-14T11:14:32.037523+0000","last_unstale":"2023-07-14T11:14:34.959801+0000","last_undegraded":"2023-07-14T11:14:34.959801+0000","last_fullsized":"2023-07-14T11:14:34.959801+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_clean_scrub_stamp":"2023-07-14T11:14:31.003451+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:52:03.437010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.039353+0000","last_change":"2023-07-14T11:14:33.056137+0000","last_active":"2023-07-14T11:14:34.039353+0000","last_peered":"2023-07-14T11:14:34.039353+0000","last_clean":"2023-07-14T11:14:34.039353+0000","last_became_active":"2023-07-14T11:14:33.055738+0000","last_became_peered":"2023-07-14T11:14:33.055738+0000","last_unstale":"2023-07-14T11:14:34.039353+0000","last_undegraded":"2023-07-14T11:14:34.039353+0000","last_fullsized":"2023-07-14T11:14:34.039353+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:43:39.661372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"36'1","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.054031+0000","last_change":"2023-07-14T11:14:32.036812+0000","last_active":"2023-07-14T11:14:33.054031+0000","last_peered":"2023-07-14T11:14:33.054031+0000","last_clean":"2023-07-14T11:14:33.054031+0000","last_became_active":"2023-07-14T11:14:32.036524+0000","last_became_peered":"2023-07-14T11:14:32.036524+0000","last_unstale":"2023-07-14T11:14:33.054031+0000","last_undegraded":"2023-07-14T11:14:33.054031+0000","last_fullsized":"2023-07-14T11:14:33.054031+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_clean_scrub_stamp":"2023-07-14T11:14:31.003451+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:21:38.428435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.057497+0000","last_change":"2023-07-14T11:14:33.054015+0000","last_active":"2023-07-14T11:14:33.057497+0000","last_peered":"2023-07-14T11:14:33.057497+0000","last_clean":"2023-07-14T11:14:33.057497+0000","last_became_active":"2023-07-14T11:14:33.053759+0000","last_became_peered":"2023-07-14T11:14:33.053759+0000","last_unstale":"2023-07-14T11:14:33.057497+0000","last_undegraded":"2023-07-14T11:14:33.057497+0000","last_fullsized":"2023-07-14T11:14:33.057497+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:02:38.157600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"36'2","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.039432+0000","last_change":"2023-07-14T11:14:32.020091+0000","last_active":"2023-07-14T11:14:34.039432+0000","last_peered":"2023-07-14T11:14:34.039432+0000","last_clean":"2023-07-14T11:14:34.039432+0000","last_became_active":"2023-07-14T11:14:32.019791+0000","last_became_peered":"2023-07-14T11:14:32.019791+0000","last_unstale":"2023-07-14T11:14:34.039432+0000","last_undegraded":"2023-07-14T11:14:34.039432+0000","last_fullsized":"2023-07-14T11:14:34.039432+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_clean_scrub_stamp":"2023-07-14T11:14:31.003451+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:34:08.477077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.640033+0000","last_change":"2023-07-14T11:14:33.050705+0000","last_active":"2023-07-14T11:14:34.640033+0000","last_peered":"2023-07-14T11:14:34.640033+0000","last_clean":"2023-07-14T11:14:34.640033+0000","last_became_active":"2023-07-14T11:14:33.050443+0000","last_became_peered":"2023-07-14T11:14:33.050443+0000","last_unstale":"2023-07-14T11:14:34.640033+0000","last_undegraded":"2023-07-14T11:14:34.640033+0000","last_fullsized":"2023-07-14T11:14:34.640033+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:46:30.241388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"36'2","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.061135+0000","last_change":"2023-07-14T11:14:32.028816+0000","last_active":"2023-07-14T11:14:33.061135+0000","last_peered":"2023-07-14T11:14:33.061135+0000","last_clean":"2023-07-14T11:14:33.061135+0000","last_became_active":"2023-07-14T11:14:32.028540+0000","last_became_peered":"2023-07-14T11:14:32.028540+0000","last_unstale":"2023-07-14T11:14:33.061135+0000","last_undegraded":"2023-07-14T11:14:33.061135+0000","last_fullsized":"2023-07-14T11:14:33.061135+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_clean_scrub_stamp":"2023-07-14T11:14:31.003451+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:46:29.236307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.060110+0000","last_change":"2023-07-14T11:14:33.048481+0000","last_active":"2023-07-14T11:14:33.060110+0000","last_peered":"2023-07-14T11:14:33.060110+0000","last_clean":"2023-07-14T11:14:33.060110+0000","last_became_active":"2023-07-14T11:14:33.048213+0000","last_became_peered":"2023-07-14T11:14:33.048213+0000","last_unstale":"2023-07-14T11:14:33.060110+0000","last_undegraded":"2023-07-14T11:14:33.060110+0000","last_fullsized":"2023-07-14T11:14:33.060110+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:48:57.505125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"36'1","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.040164+0000","last_change":"2023-07-14T11:14:32.032279+0000","last_active":"2023-07-14T11:14:34.040164+0000","last_peered":"2023-07-14T11:14:34.040164+0000","last_clean":"2023-07-14T11:14:34.040164+0000","last_became_active":"2023-07-14T11:14:32.031528+0000","last_became_peered":"2023-07-14T11:14:32.031528+0000","last_unstale":"2023-07-14T11:14:34.040164+0000","last_undegraded":"2023-07-14T11:14:34.040164+0000","last_fullsized":"2023-07-14T11:14:34.040164+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_clean_scrub_stamp":"2023-07-14T11:14:31.003451+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:48:13.552595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.039896+0000","last_change":"2023-07-14T11:14:33.047939+0000","last_active":"2023-07-14T11:14:34.039896+0000","last_peered":"2023-07-14T11:14:34.039896+0000","last_clean":"2023-07-14T11:14:34.039896+0000","last_became_active":"2023-07-14T11:14:33.047666+0000","last_became_peered":"2023-07-14T11:14:33.047666+0000","last_unstale":"2023-07-14T11:14:34.039896+0000","last_undegraded":"2023-07-14T11:14:34.039896+0000","last_fullsized":"2023-07-14T11:14:34.039896+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:06:22.581713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"36'1","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.061799+0000","last_change":"2023-07-14T11:14:32.039399+0000","last_active":"2023-07-14T11:14:33.061799+0000","last_peered":"2023-07-14T11:14:33.061799+0000","last_clean":"2023-07-14T11:14:33.061799+0000","last_became_active":"2023-07-14T11:14:32.039117+0000","last_became_peered":"2023-07-14T11:14:32.039117+0000","last_unstale":"2023-07-14T11:14:33.061799+0000","last_undegraded":"2023-07-14T11:14:33.061799+0000","last_fullsized":"2023-07-14T11:14:33.061799+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_clean_scrub_stamp":"2023-07-14T11:14:31.003451+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:33:34.061717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.061415+0000","last_change":"2023-07-14T11:14:33.058162+0000","last_active":"2023-07-14T11:14:33.061415+0000","last_peered":"2023-07-14T11:14:33.061415+0000","last_clean":"2023-07-14T11:14:33.061415+0000","last_became_active":"2023-07-14T11:14:33.057703+0000","last_became_peered":"2023-07-14T11:14:33.057703+0000","last_unstale":"2023-07-14T11:14:33.061415+0000","last_undegraded":"2023-07-14T11:14:33.061415+0000","last_fullsized":"2023-07-14T11:14:33.061415+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:56:02.633239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.039006+0000","last_change":"2023-07-14T11:14:32.031978+0000","last_active":"2023-07-14T11:14:34.039006+0000","last_peered":"2023-07-14T11:14:34.039006+0000","last_clean":"2023-07-14T11:14:34.039006+0000","last_became_active":"2023-07-14T11:14:32.031246+0000","last_became_peered":"2023-07-14T11:14:32.031246+0000","last_unstale":"2023-07-14T11:14:34.039006+0000","last_undegraded":"2023-07-14T11:14:34.039006+0000","last_fullsized":"2023-07-14T11:14:34.039006+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_clean_scrub_stamp":"2023-07-14T11:14:31.003451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:02:37.152518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.639988+0000","last_change":"2023-07-14T11:14:33.048623+0000","last_active":"2023-07-14T11:14:34.639988+0000","last_peered":"2023-07-14T11:14:34.639988+0000","last_clean":"2023-07-14T11:14:34.639988+0000","last_became_active":"2023-07-14T11:14:33.048370+0000","last_became_peered":"2023-07-14T11:14:33.048370+0000","last_unstale":"2023-07-14T11:14:34.639988+0000","last_undegraded":"2023-07-14T11:14:34.639988+0000","last_fullsized":"2023-07-14T11:14:34.639988+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:13:31.772383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.035512+0000","last_change":"2023-07-14T11:14:32.034572+0000","last_active":"2023-07-14T11:14:33.035512+0000","last_peered":"2023-07-14T11:14:33.035512+0000","last_clean":"2023-07-14T11:14:33.035512+0000","last_became_active":"2023-07-14T11:14:32.034289+0000","last_became_peered":"2023-07-14T11:14:32.034289+0000","last_unstale":"2023-07-14T11:14:33.035512+0000","last_undegraded":"2023-07-14T11:14:33.035512+0000","last_fullsized":"2023-07-14T11:14:33.035512+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_clean_scrub_stamp":"2023-07-14T11:14:31.003451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:31:05.568313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.040476+0000","last_change":"2023-07-14T11:14:33.043706+0000","last_active":"2023-07-14T11:14:34.040476+0000","last_peered":"2023-07-14T11:14:34.040476+0000","last_clean":"2023-07-14T11:14:34.040476+0000","last_became_active":"2023-07-14T11:14:33.043074+0000","last_became_peered":"2023-07-14T11:14:33.043074+0000","last_unstale":"2023-07-14T11:14:34.040476+0000","last_undegraded":"2023-07-14T11:14:34.040476+0000","last_fullsized":"2023-07-14T11:14:34.040476+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:39:17.319814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.640079+0000","last_change":"2023-07-14T11:14:32.028109+0000","last_active":"2023-07-14T11:14:34.640079+0000","last_peered":"2023-07-14T11:14:34.640079+0000","last_clean":"2023-07-14T11:14:34.640079+0000","last_became_active":"2023-07-14T11:14:32.027824+0000","last_became_peered":"2023-07-14T11:14:32.027824+0000","last_unstale":"2023-07-14T11:14:34.640079+0000","last_undegraded":"2023-07-14T11:14:34.640079+0000","last_fullsized":"2023-07-14T11:14:34.640079+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_clean_scrub_stamp":"2023-07-14T11:14:31.003451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:37:30.269906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.058585+0000","last_change":"2023-07-14T11:14:33.052450+0000","last_active":"2023-07-14T11:14:33.058585+0000","last_peered":"2023-07-14T11:14:33.058585+0000","last_clean":"2023-07-14T11:14:33.058585+0000","last_became_active":"2023-07-14T11:14:33.051726+0000","last_became_peered":"2023-07-14T11:14:33.051726+0000","last_unstale":"2023-07-14T11:14:33.058585+0000","last_undegraded":"2023-07-14T11:14:33.058585+0000","last_fullsized":"2023-07-14T11:14:33.058585+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:37:31.274987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.040386+0000","last_change":"2023-07-14T11:14:32.032479+0000","last_active":"2023-07-14T11:14:34.040386+0000","last_peered":"2023-07-14T11:14:34.040386+0000","last_clean":"2023-07-14T11:14:34.040386+0000","last_became_active":"2023-07-14T11:14:32.032158+0000","last_became_peered":"2023-07-14T11:14:32.032158+0000","last_unstale":"2023-07-14T11:14:34.040386+0000","last_undegraded":"2023-07-14T11:14:34.040386+0000","last_fullsized":"2023-07-14T11:14:34.040386+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_clean_scrub_stamp":"2023-07-14T11:14:31.003451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:58:02.918362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.062911+0000","last_change":"2023-07-14T11:14:33.054524+0000","last_active":"2023-07-14T11:14:33.062911+0000","last_peered":"2023-07-14T11:14:33.062911+0000","last_clean":"2023-07-14T11:14:33.062911+0000","last_became_active":"2023-07-14T11:14:33.054232+0000","last_became_peered":"2023-07-14T11:14:33.054232+0000","last_unstale":"2023-07-14T11:14:33.062911+0000","last_undegraded":"2023-07-14T11:14:33.062911+0000","last_fullsized":"2023-07-14T11:14:33.062911+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:28:30.508977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"36'3","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.040464+0000","last_change":"2023-07-14T11:14:32.031215+0000","last_active":"2023-07-14T11:14:34.040464+0000","last_peered":"2023-07-14T11:14:34.040464+0000","last_clean":"2023-07-14T11:14:34.040464+0000","last_became_active":"2023-07-14T11:14:32.030897+0000","last_became_peered":"2023-07-14T11:14:32.030897+0000","last_unstale":"2023-07-14T11:14:34.040464+0000","last_undegraded":"2023-07-14T11:14:34.040464+0000","last_fullsized":"2023-07-14T11:14:34.040464+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_clean_scrub_stamp":"2023-07-14T11:14:31.003451+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:24:49.564314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.052672+0000","last_change":"2023-07-14T11:14:33.048015+0000","last_active":"2023-07-14T11:14:33.052672+0000","last_peered":"2023-07-14T11:14:33.052672+0000","last_clean":"2023-07-14T11:14:33.052672+0000","last_became_active":"2023-07-14T11:14:33.046825+0000","last_became_peered":"2023-07-14T11:14:33.046825+0000","last_unstale":"2023-07-14T11:14:33.052672+0000","last_undegraded":"2023-07-14T11:14:33.052672+0000","last_fullsized":"2023-07-14T11:14:33.052672+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:31:18.643967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"36'6","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.640117+0000","last_change":"2023-07-14T11:14:32.039917+0000","last_active":"2023-07-14T11:14:34.640117+0000","last_peered":"2023-07-14T11:14:34.640117+0000","last_clean":"2023-07-14T11:14:34.640117+0000","last_became_active":"2023-07-14T11:14:32.039638+0000","last_became_peered":"2023-07-14T11:14:32.039638+0000","last_unstale":"2023-07-14T11:14:34.640117+0000","last_undegraded":"2023-07-14T11:14:34.640117+0000","last_fullsized":"2023-07-14T11:14:34.640117+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_clean_scrub_stamp":"2023-07-14T11:14:31.003451+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:04:19.815906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.062931+0000","last_change":"2023-07-14T11:14:33.054546+0000","last_active":"2023-07-14T11:14:33.062931+0000","last_peered":"2023-07-14T11:14:33.062931+0000","last_clean":"2023-07-14T11:14:33.062931+0000","last_became_active":"2023-07-14T11:14:33.054211+0000","last_became_peered":"2023-07-14T11:14:33.054211+0000","last_unstale":"2023-07-14T11:14:33.062931+0000","last_undegraded":"2023-07-14T11:14:33.062931+0000","last_fullsized":"2023-07-14T11:14:33.062931+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:32:22.588132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"36'2","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.639975+0000","last_change":"2023-07-14T11:14:32.030006+0000","last_active":"2023-07-14T11:14:34.639975+0000","last_peered":"2023-07-14T11:14:34.639975+0000","last_clean":"2023-07-14T11:14:34.639975+0000","last_became_active":"2023-07-14T11:14:32.029739+0000","last_became_peered":"2023-07-14T11:14:32.029739+0000","last_unstale":"2023-07-14T11:14:34.639975+0000","last_undegraded":"2023-07-14T11:14:34.639975+0000","last_fullsized":"2023-07-14T11:14:34.639975+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_clean_scrub_stamp":"2023-07-14T11:14:31.003451+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:31:05.568313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.639651+0000","last_change":"2023-07-14T11:14:33.057456+0000","last_active":"2023-07-14T11:14:34.639651+0000","last_peered":"2023-07-14T11:14:34.639651+0000","last_clean":"2023-07-14T11:14:34.639651+0000","last_became_active":"2023-07-14T11:14:33.057088+0000","last_became_peered":"2023-07-14T11:14:33.057088+0000","last_unstale":"2023-07-14T11:14:34.639651+0000","last_undegraded":"2023-07-14T11:14:34.639651+0000","last_fullsized":"2023-07-14T11:14:34.639651+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:49:17.421344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.039086+0000","last_change":"2023-07-14T11:14:32.027055+0000","last_active":"2023-07-14T11:14:34.039086+0000","last_peered":"2023-07-14T11:14:34.039086+0000","last_clean":"2023-07-14T11:14:34.039086+0000","last_became_active":"2023-07-14T11:14:32.026764+0000","last_became_peered":"2023-07-14T11:14:32.026764+0000","last_unstale":"2023-07-14T11:14:34.039086+0000","last_undegraded":"2023-07-14T11:14:34.039086+0000","last_fullsized":"2023-07-14T11:14:34.039086+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_clean_scrub_stamp":"2023-07-14T11:14:31.003451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:11:55.766479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.058525+0000","last_change":"2023-07-14T11:14:33.053103+0000","last_active":"2023-07-14T11:14:33.058525+0000","last_peered":"2023-07-14T11:14:33.058525+0000","last_clean":"2023-07-14T11:14:33.058525+0000","last_became_active":"2023-07-14T11:14:33.052800+0000","last_became_peered":"2023-07-14T11:14:33.052800+0000","last_unstale":"2023-07-14T11:14:33.058525+0000","last_undegraded":"2023-07-14T11:14:33.058525+0000","last_fullsized":"2023-07-14T11:14:33.058525+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:13:31.772383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.959376+0000","last_change":"2023-07-14T11:14:32.037772+0000","last_active":"2023-07-14T11:14:34.959376+0000","last_peered":"2023-07-14T11:14:34.959376+0000","last_clean":"2023-07-14T11:14:34.959376+0000","last_became_active":"2023-07-14T11:14:32.037416+0000","last_became_peered":"2023-07-14T11:14:32.037416+0000","last_unstale":"2023-07-14T11:14:34.959376+0000","last_undegraded":"2023-07-14T11:14:34.959376+0000","last_fullsized":"2023-07-14T11:14:34.959376+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_clean_scrub_stamp":"2023-07-14T11:14:31.003451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:16:43.131221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.639813+0000","last_change":"2023-07-14T11:14:33.057332+0000","last_active":"2023-07-14T11:14:34.639813+0000","last_peered":"2023-07-14T11:14:34.639813+0000","last_clean":"2023-07-14T11:14:34.639813+0000","last_became_active":"2023-07-14T11:14:33.057044+0000","last_became_peered":"2023-07-14T11:14:33.057044+0000","last_unstale":"2023-07-14T11:14:34.639813+0000","last_undegraded":"2023-07-14T11:14:34.639813+0000","last_fullsized":"2023-07-14T11:14:34.639813+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:49:06.685581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"36'8","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.067469+0000","last_change":"2023-07-14T11:14:32.040934+0000","last_active":"2023-07-14T11:14:33.067469+0000","last_peered":"2023-07-14T11:14:33.067469+0000","last_clean":"2023-07-14T11:14:33.067469+0000","last_became_active":"2023-07-14T11:14:32.040567+0000","last_became_peered":"2023-07-14T11:14:32.040567+0000","last_unstale":"2023-07-14T11:14:33.067469+0000","last_undegraded":"2023-07-14T11:14:33.067469+0000","last_fullsized":"2023-07-14T11:14:33.067469+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_clean_scrub_stamp":"2023-07-14T11:14:31.003451+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:08:52.492843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.640053+0000","last_change":"2023-07-14T11:14:33.050440+0000","last_active":"2023-07-14T11:14:34.640053+0000","last_peered":"2023-07-14T11:14:34.640053+0000","last_clean":"2023-07-14T11:14:34.640053+0000","last_became_active":"2023-07-14T11:14:33.050169+0000","last_became_peered":"2023-07-14T11:14:33.050169+0000","last_unstale":"2023-07-14T11:14:34.640053+0000","last_undegraded":"2023-07-14T11:14:34.640053+0000","last_fullsized":"2023-07-14T11:14:34.640053+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:33:35.066799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'1","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.040193+0000","last_change":"2023-07-14T11:14:32.038627+0000","last_active":"2023-07-14T11:14:34.040193+0000","last_peered":"2023-07-14T11:14:34.040193+0000","last_clean":"2023-07-14T11:14:34.040193+0000","last_became_active":"2023-07-14T11:14:32.037684+0000","last_became_peered":"2023-07-14T11:14:32.037684+0000","last_unstale":"2023-07-14T11:14:34.040193+0000","last_undegraded":"2023-07-14T11:14:34.040193+0000","last_fullsized":"2023-07-14T11:14:34.040193+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_clean_scrub_stamp":"2023-07-14T11:14:31.003451+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:22:17.389343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.040367+0000","last_change":"2023-07-14T11:14:33.055013+0000","last_active":"2023-07-14T11:14:34.040367+0000","last_peered":"2023-07-14T11:14:34.040367+0000","last_clean":"2023-07-14T11:14:34.040367+0000","last_became_active":"2023-07-14T11:14:33.054171+0000","last_became_peered":"2023-07-14T11:14:33.054171+0000","last_unstale":"2023-07-14T11:14:34.040367+0000","last_undegraded":"2023-07-14T11:14:34.040367+0000","last_fullsized":"2023-07-14T11:14:34.040367+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:47:53.028834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"36'2","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.063825+0000","last_change":"2023-07-14T11:14:32.034007+0000","last_active":"2023-07-14T11:14:33.063825+0000","last_peered":"2023-07-14T11:14:33.063825+0000","last_clean":"2023-07-14T11:14:33.063825+0000","last_became_active":"2023-07-14T11:14:32.033578+0000","last_became_peered":"2023-07-14T11:14:32.033578+0000","last_unstale":"2023-07-14T11:14:33.063825+0000","last_undegraded":"2023-07-14T11:14:33.063825+0000","last_fullsized":"2023-07-14T11:14:33.063825+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_clean_scrub_stamp":"2023-07-14T11:14:31.003451+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:11:55.766479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.055111+0000","last_change":"2023-07-14T11:14:33.048114+0000","last_active":"2023-07-14T11:14:33.055111+0000","last_peered":"2023-07-14T11:14:33.055111+0000","last_clean":"2023-07-14T11:14:33.055111+0000","last_became_active":"2023-07-14T11:14:33.047628+0000","last_became_peered":"2023-07-14T11:14:33.047628+0000","last_unstale":"2023-07-14T11:14:33.055111+0000","last_undegraded":"2023-07-14T11:14:33.055111+0000","last_fullsized":"2023-07-14T11:14:33.055111+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:04:20.820987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"36'1","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.040286+0000","last_change":"2023-07-14T11:14:32.036861+0000","last_active":"2023-07-14T11:14:34.040286+0000","last_peered":"2023-07-14T11:14:34.040286+0000","last_clean":"2023-07-14T11:14:34.040286+0000","last_became_active":"2023-07-14T11:14:32.036560+0000","last_became_peered":"2023-07-14T11:14:32.036560+0000","last_unstale":"2023-07-14T11:14:34.040286+0000","last_undegraded":"2023-07-14T11:14:34.040286+0000","last_fullsized":"2023-07-14T11:14:34.040286+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_clean_scrub_stamp":"2023-07-14T11:14:31.003451+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:21:38.877631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.040462+0000","last_change":"2023-07-14T11:14:33.041013+0000","last_active":"2023-07-14T11:14:34.040462+0000","last_peered":"2023-07-14T11:14:34.040462+0000","last_clean":"2023-07-14T11:14:34.040462+0000","last_became_active":"2023-07-14T11:14:33.040668+0000","last_became_peered":"2023-07-14T11:14:33.040668+0000","last_unstale":"2023-07-14T11:14:34.040462+0000","last_undegraded":"2023-07-14T11:14:34.040462+0000","last_fullsized":"2023-07-14T11:14:34.040462+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:16:44.136303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.039179+0000","last_change":"2023-07-14T11:14:32.021535+0000","last_active":"2023-07-14T11:14:34.039179+0000","last_peered":"2023-07-14T11:14:34.039179+0000","last_clean":"2023-07-14T11:14:34.039179+0000","last_became_active":"2023-07-14T11:14:32.021206+0000","last_became_peered":"2023-07-14T11:14:32.021206+0000","last_unstale":"2023-07-14T11:14:34.039179+0000","last_undegraded":"2023-07-14T11:14:34.039179+0000","last_fullsized":"2023-07-14T11:14:34.039179+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_clean_scrub_stamp":"2023-07-14T11:14:31.003451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:48:47.950989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.063882+0000","last_change":"2023-07-14T11:14:33.059379+0000","last_active":"2023-07-14T11:14:33.063882+0000","last_peered":"2023-07-14T11:14:33.063882+0000","last_clean":"2023-07-14T11:14:33.063882+0000","last_became_active":"2023-07-14T11:14:33.058680+0000","last_became_peered":"2023-07-14T11:14:33.058680+0000","last_unstale":"2023-07-14T11:14:33.063882+0000","last_undegraded":"2023-07-14T11:14:33.063882+0000","last_fullsized":"2023-07-14T11:14:33.063882+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:43:39.661372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"36'2","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.040313+0000","last_change":"2023-07-14T11:14:32.030415+0000","last_active":"2023-07-14T11:14:34.040313+0000","last_peered":"2023-07-14T11:14:34.040313+0000","last_clean":"2023-07-14T11:14:34.040313+0000","last_became_active":"2023-07-14T11:14:32.030159+0000","last_became_peered":"2023-07-14T11:14:32.030159+0000","last_unstale":"2023-07-14T11:14:34.040313+0000","last_undegraded":"2023-07-14T11:14:34.040313+0000","last_fullsized":"2023-07-14T11:14:34.040313+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_clean_scrub_stamp":"2023-07-14T11:14:31.003451+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:19:30.047747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.060079+0000","last_change":"2023-07-14T11:14:33.047462+0000","last_active":"2023-07-14T11:14:33.060079+0000","last_peered":"2023-07-14T11:14:33.060079+0000","last_clean":"2023-07-14T11:14:33.060079+0000","last_became_active":"2023-07-14T11:14:33.047212+0000","last_became_peered":"2023-07-14T11:14:33.047212+0000","last_unstale":"2023-07-14T11:14:33.060079+0000","last_undegraded":"2023-07-14T11:14:33.060079+0000","last_fullsized":"2023-07-14T11:14:33.060079+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:38:31.511137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.040300+0000","last_change":"2023-07-14T11:14:32.035287+0000","last_active":"2023-07-14T11:14:34.040300+0000","last_peered":"2023-07-14T11:14:34.040300+0000","last_clean":"2023-07-14T11:14:34.040300+0000","last_became_active":"2023-07-14T11:14:32.034981+0000","last_became_peered":"2023-07-14T11:14:32.034981+0000","last_unstale":"2023-07-14T11:14:34.040300+0000","last_undegraded":"2023-07-14T11:14:34.040300+0000","last_fullsized":"2023-07-14T11:14:34.040300+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_clean_scrub_stamp":"2023-07-14T11:14:31.003451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:53:39.743257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.039675+0000","last_change":"2023-07-14T11:14:33.044096+0000","last_active":"2023-07-14T11:14:34.039675+0000","last_peered":"2023-07-14T11:14:34.039675+0000","last_clean":"2023-07-14T11:14:34.039675+0000","last_became_active":"2023-07-14T11:14:33.043116+0000","last_became_peered":"2023-07-14T11:14:33.043116+0000","last_unstale":"2023-07-14T11:14:34.039675+0000","last_undegraded":"2023-07-14T11:14:34.039675+0000","last_fullsized":"2023-07-14T11:14:34.039675+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:43:39.661372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.037261+0000","last_change":"2023-07-14T11:14:32.039174+0000","last_active":"2023-07-14T11:14:33.037261+0000","last_peered":"2023-07-14T11:14:33.037261+0000","last_clean":"2023-07-14T11:14:33.037261+0000","last_became_active":"2023-07-14T11:14:32.038870+0000","last_became_peered":"2023-07-14T11:14:32.038870+0000","last_unstale":"2023-07-14T11:14:33.037261+0000","last_undegraded":"2023-07-14T11:14:33.037261+0000","last_fullsized":"2023-07-14T11:14:33.037261+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_clean_scrub_stamp":"2023-07-14T11:14:31.003451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:06:21.576631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.639811+0000","last_change":"2023-07-14T11:14:33.053715+0000","last_active":"2023-07-14T11:14:34.639811+0000","last_peered":"2023-07-14T11:14:34.639811+0000","last_clean":"2023-07-14T11:14:34.639811+0000","last_became_active":"2023-07-14T11:14:33.053416+0000","last_became_peered":"2023-07-14T11:14:33.053416+0000","last_unstale":"2023-07-14T11:14:34.639811+0000","last_undegraded":"2023-07-14T11:14:34.639811+0000","last_fullsized":"2023-07-14T11:14:34.639811+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:51:29.549114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.039921+0000","last_change":"2023-07-14T11:14:32.027842+0000","last_active":"2023-07-14T11:14:34.039921+0000","last_peered":"2023-07-14T11:14:34.039921+0000","last_clean":"2023-07-14T11:14:34.039921+0000","last_became_active":"2023-07-14T11:14:32.027563+0000","last_became_peered":"2023-07-14T11:14:32.027563+0000","last_unstale":"2023-07-14T11:14:34.039921+0000","last_undegraded":"2023-07-14T11:14:34.039921+0000","last_fullsized":"2023-07-14T11:14:34.039921+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_clean_scrub_stamp":"2023-07-14T11:14:31.003451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:16:35.343816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.059854+0000","last_change":"2023-07-14T11:14:33.046992+0000","last_active":"2023-07-14T11:14:33.059854+0000","last_peered":"2023-07-14T11:14:33.059854+0000","last_clean":"2023-07-14T11:14:33.059854+0000","last_became_active":"2023-07-14T11:14:33.046661+0000","last_became_peered":"2023-07-14T11:14:33.046661+0000","last_unstale":"2023-07-14T11:14:33.059854+0000","last_undegraded":"2023-07-14T11:14:33.059854+0000","last_fullsized":"2023-07-14T11:14:33.059854+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:43:35.099354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.035539+0000","last_change":"2023-07-14T11:14:32.035537+0000","last_active":"2023-07-14T11:14:33.035539+0000","last_peered":"2023-07-14T11:14:33.035539+0000","last_clean":"2023-07-14T11:14:33.035539+0000","last_became_active":"2023-07-14T11:14:32.035269+0000","last_became_peered":"2023-07-14T11:14:32.035269+0000","last_unstale":"2023-07-14T11:14:33.035539+0000","last_undegraded":"2023-07-14T11:14:33.035539+0000","last_fullsized":"2023-07-14T11:14:33.035539+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_clean_scrub_stamp":"2023-07-14T11:14:31.003451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:09:21.708773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.039163+0000","last_change":"2023-07-14T11:13:08.923786+0000","last_active":"2023-07-14T11:14:34.039163+0000","last_peered":"2023-07-14T11:14:34.039163+0000","last_clean":"2023-07-14T11:14:34.039163+0000","last_became_active":"2023-07-14T11:13:08.923384+0000","last_became_peered":"2023-07-14T11:13:08.923384+0000","last_unstale":"2023-07-14T11:14:34.039163+0000","last_undegraded":"2023-07-14T11:14:34.039163+0000","last_fullsized":"2023-07-14T11:14:34.039163+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:53:30.731675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.639975+0000","last_change":"2023-07-14T11:14:33.047045+0000","last_active":"2023-07-14T11:14:34.639975+0000","last_peered":"2023-07-14T11:14:34.639975+0000","last_clean":"2023-07-14T11:14:34.639975+0000","last_became_active":"2023-07-14T11:14:33.046711+0000","last_became_peered":"2023-07-14T11:14:33.046711+0000","last_unstale":"2023-07-14T11:14:34.639975+0000","last_undegraded":"2023-07-14T11:14:34.639975+0000","last_fullsized":"2023-07-14T11:14:34.639975+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:55:13.967423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.034799+0000","last_change":"2023-07-14T11:14:32.031005+0000","last_active":"2023-07-14T11:14:33.034799+0000","last_peered":"2023-07-14T11:14:33.034799+0000","last_clean":"2023-07-14T11:14:33.034799+0000","last_became_active":"2023-07-14T11:14:32.030719+0000","last_became_peered":"2023-07-14T11:14:32.030719+0000","last_unstale":"2023-07-14T11:14:33.034799+0000","last_undegraded":"2023-07-14T11:14:33.034799+0000","last_fullsized":"2023-07-14T11:14:33.034799+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_clean_scrub_stamp":"2023-07-14T11:14:31.003451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:57:29.229391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.040018+0000","last_change":"2023-07-14T11:13:08.758749+0000","last_active":"2023-07-14T11:14:34.040018+0000","last_peered":"2023-07-14T11:14:34.040018+0000","last_clean":"2023-07-14T11:14:34.040018+0000","last_became_active":"2023-07-14T11:13:08.757956+0000","last_became_peered":"2023-07-14T11:13:08.757956+0000","last_unstale":"2023-07-14T11:14:34.040018+0000","last_undegraded":"2023-07-14T11:14:34.040018+0000","last_fullsized":"2023-07-14T11:14:34.040018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:52:20.366790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.058567+0000","last_change":"2023-07-14T11:14:33.053078+0000","last_active":"2023-07-14T11:14:33.058567+0000","last_peered":"2023-07-14T11:14:33.058567+0000","last_clean":"2023-07-14T11:14:33.058567+0000","last_became_active":"2023-07-14T11:14:33.052170+0000","last_became_peered":"2023-07-14T11:14:33.052170+0000","last_unstale":"2023-07-14T11:14:33.058567+0000","last_undegraded":"2023-07-14T11:14:33.058567+0000","last_fullsized":"2023-07-14T11:14:33.058567+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:04:20.820987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.040609+0000","last_change":"2023-07-14T11:14:32.035583+0000","last_active":"2023-07-14T11:14:34.040609+0000","last_peered":"2023-07-14T11:14:34.040609+0000","last_clean":"2023-07-14T11:14:34.040609+0000","last_became_active":"2023-07-14T11:14:32.035357+0000","last_became_peered":"2023-07-14T11:14:32.035357+0000","last_unstale":"2023-07-14T11:14:34.040609+0000","last_undegraded":"2023-07-14T11:14:34.040609+0000","last_fullsized":"2023-07-14T11:14:34.040609+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_clean_scrub_stamp":"2023-07-14T11:14:31.003451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:20:31.702502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.040023+0000","last_change":"2023-07-14T11:13:08.862331+0000","last_active":"2023-07-14T11:14:34.040023+0000","last_peered":"2023-07-14T11:14:34.040023+0000","last_clean":"2023-07-14T11:14:34.040023+0000","last_became_active":"2023-07-14T11:13:08.861817+0000","last_became_peered":"2023-07-14T11:13:08.861817+0000","last_unstale":"2023-07-14T11:14:34.040023+0000","last_undegraded":"2023-07-14T11:14:34.040023+0000","last_fullsized":"2023-07-14T11:14:34.040023+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:23:13.892012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.039980+0000","last_change":"2023-07-14T11:14:33.046271+0000","last_active":"2023-07-14T11:14:34.039980+0000","last_peered":"2023-07-14T11:14:34.039980+0000","last_clean":"2023-07-14T11:14:34.039980+0000","last_became_active":"2023-07-14T11:14:33.046019+0000","last_became_peered":"2023-07-14T11:14:33.046019+0000","last_unstale":"2023-07-14T11:14:34.039980+0000","last_undegraded":"2023-07-14T11:14:34.039980+0000","last_fullsized":"2023-07-14T11:14:34.039980+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:43:21.247508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.035612+0000","last_change":"2023-07-14T11:14:32.039262+0000","last_active":"2023-07-14T11:14:33.035612+0000","last_peered":"2023-07-14T11:14:33.035612+0000","last_clean":"2023-07-14T11:14:33.035612+0000","last_became_active":"2023-07-14T11:14:32.038947+0000","last_became_peered":"2023-07-14T11:14:32.038947+0000","last_unstale":"2023-07-14T11:14:33.035612+0000","last_undegraded":"2023-07-14T11:14:33.035612+0000","last_fullsized":"2023-07-14T11:14:33.035612+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_clean_scrub_stamp":"2023-07-14T11:14:31.003451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:54:53.992398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.040066+0000","last_change":"2023-07-14T11:13:08.757882+0000","last_active":"2023-07-14T11:14:34.040066+0000","last_peered":"2023-07-14T11:14:34.040066+0000","last_clean":"2023-07-14T11:14:34.040066+0000","last_became_active":"2023-07-14T11:13:08.757541+0000","last_became_peered":"2023-07-14T11:13:08.757541+0000","last_unstale":"2023-07-14T11:14:34.040066+0000","last_undegraded":"2023-07-14T11:14:34.040066+0000","last_fullsized":"2023-07-14T11:14:34.040066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:11:43.350238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":197,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.037175+0000","last_change":"2023-07-14T11:13:01.370649+0000","last_active":"2023-07-14T11:14:33.037175+0000","last_peered":"2023-07-14T11:14:33.037175+0000","last_clean":"2023-07-14T11:14:33.037175+0000","last_became_active":"2023-07-14T11:13:01.369478+0000","last_became_peered":"2023-07-14T11:13:01.369478+0000","last_unstale":"2023-07-14T11:14:33.037175+0000","last_undegraded":"2023-07-14T11:14:33.037175+0000","last_fullsized":"2023-07-14T11:14:33.037175+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:00.254800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:00.254800+0000","last_clean_scrub_stamp":"2023-07-14T11:13:00.254800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:32:37.728426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.039096+0000","last_change":"2023-07-14T11:14:33.046954+0000","last_active":"2023-07-14T11:14:34.039096+0000","last_peered":"2023-07-14T11:14:34.039096+0000","last_clean":"2023-07-14T11:14:34.039096+0000","last_became_active":"2023-07-14T11:14:33.046646+0000","last_became_peered":"2023-07-14T11:14:33.046646+0000","last_unstale":"2023-07-14T11:14:34.039096+0000","last_undegraded":"2023-07-14T11:14:34.039096+0000","last_fullsized":"2023-07-14T11:14:34.039096+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:00:03.367995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"36'2","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.040506+0000","last_change":"2023-07-14T11:14:32.031245+0000","last_active":"2023-07-14T11:14:34.040506+0000","last_peered":"2023-07-14T11:14:34.040506+0000","last_clean":"2023-07-14T11:14:34.040506+0000","last_became_active":"2023-07-14T11:14:32.030982+0000","last_became_peered":"2023-07-14T11:14:32.030982+0000","last_unstale":"2023-07-14T11:14:34.040506+0000","last_undegraded":"2023-07-14T11:14:34.040506+0000","last_fullsized":"2023-07-14T11:14:34.040506+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_clean_scrub_stamp":"2023-07-14T11:14:31.003451+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:32:37.595410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.037304+0000","last_change":"2023-07-14T11:13:08.760609+0000","last_active":"2023-07-14T11:14:33.037304+0000","last_peered":"2023-07-14T11:14:33.037304+0000","last_clean":"2023-07-14T11:14:33.037304+0000","last_became_active":"2023-07-14T11:13:08.760285+0000","last_became_peered":"2023-07-14T11:13:08.760285+0000","last_unstale":"2023-07-14T11:14:33.037304+0000","last_undegraded":"2023-07-14T11:14:33.037304+0000","last_fullsized":"2023-07-14T11:14:33.037304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:32:10.518168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.038868+0000","last_change":"2023-07-14T11:14:33.037196+0000","last_active":"2023-07-14T11:14:34.038868+0000","last_peered":"2023-07-14T11:14:34.038868+0000","last_clean":"2023-07-14T11:14:34.038868+0000","last_became_active":"2023-07-14T11:14:33.036858+0000","last_became_peered":"2023-07-14T11:14:33.036858+0000","last_unstale":"2023-07-14T11:14:34.038868+0000","last_undegraded":"2023-07-14T11:14:34.038868+0000","last_fullsized":"2023-07-14T11:14:34.038868+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:37:31.274987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.959508+0000","last_change":"2023-07-14T11:14:32.033642+0000","last_active":"2023-07-14T11:14:34.959508+0000","last_peered":"2023-07-14T11:14:34.959508+0000","last_clean":"2023-07-14T11:14:34.959508+0000","last_became_active":"2023-07-14T11:14:32.033335+0000","last_became_peered":"2023-07-14T11:14:32.033335+0000","last_unstale":"2023-07-14T11:14:34.959508+0000","last_undegraded":"2023-07-14T11:14:34.959508+0000","last_fullsized":"2023-07-14T11:14:34.959508+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_clean_scrub_stamp":"2023-07-14T11:14:31.003451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:20:31.702502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.034961+0000","last_change":"2023-07-14T11:13:08.923899+0000","last_active":"2023-07-14T11:14:33.034961+0000","last_peered":"2023-07-14T11:14:33.034961+0000","last_clean":"2023-07-14T11:14:33.034961+0000","last_became_active":"2023-07-14T11:13:08.923513+0000","last_became_peered":"2023-07-14T11:13:08.923513+0000","last_unstale":"2023-07-14T11:14:33.034961+0000","last_undegraded":"2023-07-14T11:14:33.034961+0000","last_fullsized":"2023-07-14T11:14:33.034961+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:10:32.505755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.044419+0000","last_change":"2023-07-14T11:14:33.041353+0000","last_active":"2023-07-14T11:14:33.044419+0000","last_peered":"2023-07-14T11:14:33.044419+0000","last_clean":"2023-07-14T11:14:33.044419+0000","last_became_active":"2023-07-14T11:14:33.041077+0000","last_became_peered":"2023-07-14T11:14:33.041077+0000","last_unstale":"2023-07-14T11:14:33.044419+0000","last_undegraded":"2023-07-14T11:14:33.044419+0000","last_fullsized":"2023-07-14T11:14:33.044419+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:55:13.967423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.036355+0000","last_change":"2023-07-14T11:14:32.029312+0000","last_active":"2023-07-14T11:14:33.036355+0000","last_peered":"2023-07-14T11:14:33.036355+0000","last_clean":"2023-07-14T11:14:33.036355+0000","last_became_active":"2023-07-14T11:14:32.029074+0000","last_became_peered":"2023-07-14T11:14:32.029074+0000","last_unstale":"2023-07-14T11:14:33.036355+0000","last_undegraded":"2023-07-14T11:14:33.036355+0000","last_fullsized":"2023-07-14T11:14:33.036355+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_clean_scrub_stamp":"2023-07-14T11:14:31.003451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:37:30.269906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.039353+0000","last_change":"2023-07-14T11:13:08.761726+0000","last_active":"2023-07-14T11:14:34.039353+0000","last_peered":"2023-07-14T11:14:34.039353+0000","last_clean":"2023-07-14T11:14:34.039353+0000","last_became_active":"2023-07-14T11:13:08.761365+0000","last_became_peered":"2023-07-14T11:13:08.761365+0000","last_unstale":"2023-07-14T11:14:34.039353+0000","last_undegraded":"2023-07-14T11:14:34.039353+0000","last_fullsized":"2023-07-14T11:14:34.039353+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:07:29.232120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T11:14:33.052635+0000","last_change":"2023-07-14T11:14:33.046382+0000","last_active":"2023-07-14T11:14:33.052635+0000","last_peered":"2023-07-14T11:14:33.052635+0000","last_clean":"2023-07-14T11:14:33.052635+0000","last_became_active":"2023-07-14T11:14:33.046093+0000","last_became_peered":"2023-07-14T11:14:33.046093+0000","last_unstale":"2023-07-14T11:14:33.052635+0000","last_undegraded":"2023-07-14T11:14:33.052635+0000","last_fullsized":"2023-07-14T11:14:33.052635+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:32.008533+0000","last_clean_scrub_stamp":"2023-07-14T11:14:32.008533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:56:02.633239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.639680+0000","last_change":"2023-07-14T11:14:32.028140+0000","last_active":"2023-07-14T11:14:34.639680+0000","last_peered":"2023-07-14T11:14:34.639680+0000","last_clean":"2023-07-14T11:14:34.639680+0000","last_became_active":"2023-07-14T11:14:32.027886+0000","last_became_peered":"2023-07-14T11:14:32.027886+0000","last_unstale":"2023-07-14T11:14:34.639680+0000","last_undegraded":"2023-07-14T11:14:34.639680+0000","last_fullsized":"2023-07-14T11:14:34.639680+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:14:31.003451+0000","last_clean_scrub_stamp":"2023-07-14T11:14:31.003451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:25:16.939854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T11:14:34.959833+0000","last_change":"2023-07-14T11:13:08.762084+0000","last_active":"2023-07-14T11:14:34.959833+0000","last_peered":"2023-07-14T11:14:34.959833+0000","last_clean":"2023-07-14T11:14:34.959833+0000","last_became_active":"2023-07-14T11:13:08.761763+0000","last_became_peered":"2023-07-14T11:13:08.761763+0000","last_unstale":"2023-07-14T11:14:34.959833+0000","last_undegraded":"2023-07-14T11:14:34.959833+0000","last_fullsized":"2023-07-14T11:14:34.959833+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:37:07.245332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27948,"kb_used_data":996,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343892,"statfs":{"total":96636764160,"available":96608145408,"internally_reserved":0,"allocated":1019904,"data_stored":760729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:14:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":8.4339999999999993,"5min":8.4339999999999993,"15min":8.4339999999999993},"last":0.47199999999999998},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":8.4559999999999995,"5min":8.4559999999999995,"15min":8.4559999999999995},"last":0.72499999999999998}]},{"osd":1,"last update":"Fri Jul 14 11:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":6.3520000000000003,"5min":6.3520000000000003,"15min":6.3520000000000003},"last":0.56499999999999995},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":6.8550000000000004,"5min":6.8550000000000004,"15min":6.8550000000000004},"last":0.66000000000000003}]},{"osd":2,"last update":"Fri Jul 14 11:14:00 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.25,"15min":1.25},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":7.0289999999999999,"5min":7.0289999999999999,"15min":7.0289999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.52700000000000002}]},{"osd":3,"last update":"Fri Jul 14 11:14:00 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.319,"15min":1.319},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":10.337,"5min":10.337,"15min":10.337},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.921,"5min":1.921,"15min":1.921},"last":0.60199999999999998}]},{"osd":4,"last update":"Fri Jul 14 11:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.495},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.626}]},{"osd":5,"last update":"Fri Jul 14 11:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.82699999999999996}]},{"osd":6,"last update":"Fri Jul 14 11:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.80100000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":413696,"data_stored":169309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":1.0229999999999999},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.69399999999999995}]},{"osd":1,"last update":"Fri Jul 14 11:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.79300000000000004}]},{"osd":2,"last update":"Fri Jul 14 11:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.995}]},{"osd":3,"last update":"Fri Jul 14 11:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.83799999999999997}]},{"osd":4,"last update":"Fri Jul 14 11:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.50900000000000001}]},{"osd":5,"last update":"Fri Jul 14 11:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.93500000000000005}]},{"osd":7,"last update":"Fri Jul 14 11:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.623},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.76800000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":425984,"data_stored":175470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.44700000000000001}]},{"osd":2,"last update":"Fri Jul 14 11:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":2.476,"5min":2.476,"15min":2.476},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":2.6299999999999999,"5min":2.6299999999999999,"15min":2.6299999999999999},"last":0.49099999999999999}]},{"osd":3,"last update":"Fri Jul 14 11:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.50900000000000001}]},{"osd":4,"last update":"Fri Jul 14 11:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":1.0149999999999999},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":1.054}]},{"osd":5,"last update":"Fri Jul 14 11:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":1.1739999999999999},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.095}]},{"osd":6,"last update":"Fri Jul 14 11:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":1.141},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":1.123}]},{"osd":7,"last update":"Fri Jul 14 11:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.2010000000000001},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.86099999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":1007616,"data_stored":759129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.252},{"interface":"front","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.40799999999999997}]},{"osd":2,"last update":"Fri Jul 14 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.376}]},{"osd":3,"last update":"Fri Jul 14 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.42099999999999999}]},{"osd":4,"last update":"Fri Jul 14 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.57099999999999995}]},{"osd":5,"last update":"Fri Jul 14 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.502},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.61499999999999999}]},{"osd":6,"last update":"Fri Jul 14 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.52200000000000002}]},{"osd":7,"last update":"Fri Jul 14 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.63200000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":425984,"data_stored":175450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:14:04 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.35699999999999998}]},{"osd":1,"last update":"Fri Jul 14 11:14:04 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.46200000000000002}]},{"osd":3,"last update":"Fri Jul 14 11:14:04 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.44900000000000001}]},{"osd":4,"last update":"Fri Jul 14 11:14:04 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.72999999999999998}]},{"osd":5,"last update":"Fri Jul 14 11:14:04 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.71899999999999997}]},{"osd":6,"last update":"Fri Jul 14 11:14:04 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.70599999999999996}]},{"osd":7,"last update":"Fri Jul 14 11:14:04 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.75900000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":428,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":438272,"data_stored":176978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.40600000000000003}]},{"osd":1,"last update":"Fri Jul 14 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.436},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.51500000000000001}]},{"osd":2,"last update":"Fri Jul 14 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":0.59799999999999998}]},{"osd":4,"last update":"Fri Jul 14 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.74399999999999999}]},{"osd":5,"last update":"Fri Jul 14 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.657,"5min":1.657,"15min":1.657},"last":0.85399999999999998}]},{"osd":6,"last update":"Fri Jul 14 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.726,"5min":1.726,"15min":1.726},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":0.83899999999999997}]},{"osd":7,"last update":"Fri Jul 14 11:14:01 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.873}]}]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":408,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":417792,"data_stored":169331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.63800000000000001}]},{"osd":1,"last update":"Fri Jul 14 11:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.748},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.59799999999999998}]},{"osd":2,"last update":"Fri Jul 14 11:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.77100000000000002}]},{"osd":3,"last update":"Fri Jul 14 11:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.79400000000000004}]},{"osd":5,"last update":"Fri Jul 14 11:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.71799999999999997}]},{"osd":6,"last update":"Fri Jul 14 11:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.65800000000000003}]},{"osd":7,"last update":"Fri Jul 14 11:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.85799999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":420,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":430080,"data_stored":175492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.59599999999999997}]},{"osd":1,"last update":"Fri Jul 14 11:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.54700000000000004}]},{"osd":2,"last update":"Fri Jul 14 11:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.65800000000000003}]},{"osd":3,"last update":"Fri Jul 14 11:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.806,"5min":1.806,"15min":1.806},"last":0.71699999999999997}]},{"osd":4,"last update":"Fri Jul 14 11:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.64100000000000001}]},{"osd":6,"last update":"Fri Jul 14 11:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.67400000000000004}]},{"osd":7,"last update":"Fri Jul 14 11:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.74099999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T11:14:37.945 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-14T11:14:37.945 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-14T11:14:38.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.179+0000 7f3792dff700 1 Processor -- start 2023-07-14T11:14:38.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.179+0000 7f3792dff700 1 -- start start 2023-07-14T11:14:38.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.180+0000 7f3792dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f378c0b4860 0x7f378c0b4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:38.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.180+0000 7f3792dff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f378c0d12c0 0x7f378c0d1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:38.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.180+0000 7f3792dff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f378c0d02a0 con 0x7f378c0b8660 2023-07-14T11:14:38.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.180+0000 7f3792dff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f378c0b5210 con 0x7f378c0d12c0 2023-07-14T11:14:38.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.180+0000 7f3792dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f378c0cfce0 con 0x7f378c0b4860 2023-07-14T11:14:38.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.180+0000 7f379139c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f378c0d12c0 0x7f378c0d1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:38.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.180+0000 7f379139c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f378c0d12c0 0x7f378c0d1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34362/0 (socket says 172.21.15.84:34362) 2023-07-14T11:14:38.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.181+0000 7f379139c700 1 -- 172.21.15.84:0/2758400538 learned_addr learned my addr 172.21.15.84:0/2758400538 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:38.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.181+0000 7f378bfff700 1 --2- 172.21.15.84:0/2758400538 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f378c0b4860 0x7f378c0b4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:38.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.181+0000 7f379139c700 1 -- 172.21.15.84:0/2758400538 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f378c0b4860 msgr2=0x7f378c0b4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:38.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.181+0000 7f379139c700 1 --2- 172.21.15.84:0/2758400538 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f378c0b4860 0x7f378c0b4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:38.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.181+0000 7f379139c700 1 -- 172.21.15.84:0/2758400538 >> v1:172.21.15.179:6789/0 conn(0x7f378c0b8660 legacy=0x7f378c0cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:38.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.181+0000 7f379139c700 1 -- 172.21.15.84:0/2758400538 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f378c0cffc0 con 0x7f378c0d12c0 2023-07-14T11:14:38.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.181+0000 7f379139c700 1 --2- 172.21.15.84:0/2758400538 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f378c0d12c0 0x7f378c0d1700 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f3784009e50 tx=0x7f378400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18d026592fcb3d7a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:38.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.181+0000 7f378b7fe700 1 -- 172.21.15.84:0/2758400538 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378400e070 con 0x7f378c0d12c0 2023-07-14T11:14:38.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.181+0000 7f378b7fe700 1 -- 172.21.15.84:0/2758400538 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f378400b9c0 con 0x7f378c0d12c0 2023-07-14T11:14:38.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.181+0000 7f378b7fe700 1 -- 172.21.15.84:0/2758400538 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378400bd70 con 0x7f378c0d12c0 2023-07-14T11:14:38.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.182+0000 7f3792dff700 1 -- 172.21.15.84:0/2758400538 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f378c0d12c0 msgr2=0x7f378c0d1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:38.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.182+0000 7f3792dff700 1 --2- 172.21.15.84:0/2758400538 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f378c0d12c0 0x7f378c0d1700 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f3784009e50 tx=0x7f378400b330 comp rx=0 tx=0).stop 2023-07-14T11:14:38.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.182+0000 7f3792dff700 1 -- 172.21.15.84:0/2758400538 shutdown_connections 2023-07-14T11:14:38.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.182+0000 7f3792dff700 1 --2- 172.21.15.84:0/2758400538 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f378c0d12c0 0x7f378c0d1700 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:38.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.182+0000 7f3792dff700 1 --2- 172.21.15.84:0/2758400538 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f378c0b4860 0x7f378c0b4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:38.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.182+0000 7f3792dff700 1 -- 172.21.15.84:0/2758400538 >> 172.21.15.84:0/2758400538 conn(0x7f378c066860 msgr2=0x7f378c06a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:38.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.182+0000 7f3792dff700 1 -- 172.21.15.84:0/2758400538 shutdown_connections 2023-07-14T11:14:38.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.182+0000 7f3792dff700 1 -- 172.21.15.84:0/2758400538 wait complete. 2023-07-14T11:14:38.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.184+0000 7f3792dff700 1 Processor -- start 2023-07-14T11:14:38.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.184+0000 7f3792dff700 1 -- start start 2023-07-14T11:14:38.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.185+0000 7f3792dff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f378c0b4860 0x7f378c0c6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:38.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.185+0000 7f3792dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f378c0b8660 0x7f378c0c9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:38.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.185+0000 7f3792dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f378c0d12c0 0x7f378c157fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:38.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.185+0000 7f3792dff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f378c0cae70 con 0x7f378c0b4860 2023-07-14T11:14:38.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.185+0000 7f3792dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f378c15f5b0 con 0x7f378c0b8660 2023-07-14T11:14:38.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.185+0000 7f3792dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f378c15f890 con 0x7f378c0d12c0 2023-07-14T11:14:38.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.185+0000 7f3790b9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f378c0b4860 0x7f378c0c6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:38.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.185+0000 7f3790b9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f378c0b4860 0x7f378c0c6910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34368/0 (socket says 172.21.15.84:34368) 2023-07-14T11:14:38.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.185+0000 7f3790b9b700 1 -- 172.21.15.84:0/1985054789 learned_addr learned my addr 172.21.15.84:0/1985054789 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:38.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.185+0000 7f379139c700 1 --2- 172.21.15.84:0/1985054789 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f378c0d12c0 0x7f378c157fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:38.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.185+0000 7f378bfff700 1 --2- 172.21.15.84:0/1985054789 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f378c0b8660 0x7f378c0c9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:38.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.185+0000 7f3790b9b700 1 -- 172.21.15.84:0/1985054789 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f378c0d12c0 msgr2=0x7f378c157fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:38.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.185+0000 7f3790b9b700 1 --2- 172.21.15.84:0/1985054789 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f378c0d12c0 0x7f378c157fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:38.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.185+0000 7f3790b9b700 1 -- 172.21.15.84:0/1985054789 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f378c0b8660 msgr2=0x7f378c0c9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:38.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.185+0000 7f3790b9b700 1 --2- 172.21.15.84:0/1985054789 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f378c0b8660 0x7f378c0c9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:38.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.185+0000 7f3790b9b700 1 -- 172.21.15.84:0/1985054789 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3784009b30 con 0x7f378c0b4860 2023-07-14T11:14:38.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.186+0000 7f379139c700 1 --2- 172.21.15.84:0/1985054789 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f378c0d12c0 0x7f378c157fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:14:38.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.186+0000 7f3790b9b700 1 --2- 172.21.15.84:0/1985054789 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f378c0b4860 0x7f378c0c6910 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f378000c700 tx=0x7f378000cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:38.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.186+0000 7f37897fa700 1 -- 172.21.15.84:0/1985054789 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37800052d0 con 0x7f378c0b4860 2023-07-14T11:14:38.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.186+0000 7f37897fa700 1 -- 172.21.15.84:0/1985054789 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3780005430 con 0x7f378c0b4860 2023-07-14T11:14:38.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.186+0000 7f3792dff700 1 -- 172.21.15.84:0/1985054789 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f378c0cb080 con 0x7f378c0b4860 2023-07-14T11:14:38.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.186+0000 7f37897fa700 1 -- 172.21.15.84:0/1985054789 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37800038a0 con 0x7f378c0b4860 2023-07-14T11:14:38.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.186+0000 7f3792dff700 1 -- 172.21.15.84:0/1985054789 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f378c1592e0 con 0x7f378c0b4860 2023-07-14T11:14:38.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.187+0000 7f3792dff700 1 -- 172.21.15.84:0/1985054789 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f378c0b7ef0 con 0x7f378c0b4860 2023-07-14T11:14:38.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.188+0000 7f37897fa700 1 -- 172.21.15.84:0/1985054789 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3780003a00 con 0x7f378c0b4860 2023-07-14T11:14:38.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.189+0000 7f37897fa700 1 --2- 172.21.15.84:0/1985054789 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f377006ace0 0x7f377006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:38.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.189+0000 7f37897fa700 1 -- 172.21.15.84:0/1985054789 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3780088aa0 con 0x7f378c0b4860 2023-07-14T11:14:38.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.189+0000 7f378bfff700 1 --2- 172.21.15.84:0/1985054789 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f377006ace0 0x7f377006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:38.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.190+0000 7f378bfff700 1 --2- 172.21.15.84:0/1985054789 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f377006ace0 0x7f377006d190 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f378c0c6e50 tx=0x7f3778008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:38.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.193+0000 7f37897fa700 1 -- 172.21.15.84:0/1985054789 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3780053ac0 con 0x7f378c0b4860 2023-07-14T11:14:38.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.465+0000 7f3792dff700 1 -- 172.21.15.84:0/1985054789 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f378c074350 con 0x7f378c0b4860 2023-07-14T11:14:38.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.469+0000 7f37897fa700 1 -- 172.21.15.84:0/1985054789 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+147 (secure 0 0 0) 0x7f3780003cb0 con 0x7f378c0b4860 2023-07-14T11:14:38.471 INFO:teuthology.orchestra.run.smithi084.stdout:[client.0] 2023-07-14T11:14:38.472 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCKLbFkKSl5GBAAwPK4Zs6+gv/6YKHh4JI3WA== 2023-07-14T11:14:38.472 INFO:teuthology.orchestra.run.smithi084.stdout: caps mds = "allow" 2023-07-14T11:14:38.472 INFO:teuthology.orchestra.run.smithi084.stdout: caps mon = "allow r" 2023-07-14T11:14:38.472 INFO:teuthology.orchestra.run.smithi084.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-14T11:14:38.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.471+0000 7f3792dff700 1 -- 172.21.15.84:0/1985054789 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f377006ace0 msgr2=0x7f377006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:38.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.471+0000 7f3792dff700 1 --2- 172.21.15.84:0/1985054789 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f377006ace0 0x7f377006d190 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f378c0c6e50 tx=0x7f3778008040 comp rx=0 tx=0).stop 2023-07-14T11:14:38.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.471+0000 7f3792dff700 1 -- 172.21.15.84:0/1985054789 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f378c0b4860 msgr2=0x7f378c0c6910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:38.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.471+0000 7f3792dff700 1 --2- 172.21.15.84:0/1985054789 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f378c0b4860 0x7f378c0c6910 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f378000c700 tx=0x7f378000cac0 comp rx=0 tx=0).stop 2023-07-14T11:14:38.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.472+0000 7f3792dff700 1 -- 172.21.15.84:0/1985054789 shutdown_connections 2023-07-14T11:14:38.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.472+0000 7f3792dff700 1 --2- 172.21.15.84:0/1985054789 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f377006ace0 0x7f377006d190 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:38.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.472+0000 7f3792dff700 1 --2- 172.21.15.84:0/1985054789 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f378c0d12c0 0x7f378c157fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:38.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.472+0000 7f3792dff700 1 --2- 172.21.15.84:0/1985054789 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f378c0b4860 0x7f378c0c6910 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:38.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.472+0000 7f3792dff700 1 --2- 172.21.15.84:0/1985054789 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f378c0b8660 0x7f378c0c9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:38.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.472+0000 7f3792dff700 1 -- 172.21.15.84:0/1985054789 >> 172.21.15.84:0/1985054789 conn(0x7f378c066860 msgr2=0x7f378c0cf460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:38.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.472+0000 7f3792dff700 1 -- 172.21.15.84:0/1985054789 shutdown_connections 2023-07-14T11:14:38.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.472+0000 7f3792dff700 1 -- 172.21.15.84:0/1985054789 wait complete. 2023-07-14T11:14:38.476 INFO:teuthology.orchestra.run.smithi084.stderr:updated caps for client.0 2023-07-14T11:14:38.491 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T11:14:38.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.684+0000 7f1598bff700 1 Processor -- start 2023-07-14T11:14:38.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.684+0000 7f1598bff700 1 -- start start 2023-07-14T11:14:38.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.685+0000 7f1598bff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f15940b5d90 0x7f15940b6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:38.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.685+0000 7f1598bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15940d0b10 0x7f15940d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:38.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.686+0000 7f1598bff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15940b7f50 con 0x7f15940b4510 2023-07-14T11:14:38.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.686+0000 7f1598bff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15940b48e0 con 0x7f15940b5d90 2023-07-14T11:14:38.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.686+0000 7f1598bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15940d14d0 con 0x7f15940d0b10 2023-07-14T11:14:38.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.686+0000 7f159259c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f15940b4510 0x7f15940cd590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:47154/0 (socket says 172.21.15.84:47154) 2023-07-14T11:14:38.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.686+0000 7f159259c700 1 -- 172.21.15.84:0/2565069286 learned_addr learned my addr 172.21.15.84:0/2565069286 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:14:38.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.686+0000 7f158bfff700 1 --2- 172.21.15.84:0/2565069286 >> v2:172.21.15.179:3300/0 conn(0x7f15940b5d90 0x7f15940b6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:38.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.686+0000 7f1591d9b700 1 -- 172.21.15.84:0/2565069286 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 957560647 0 0) 0x7f15940b7f50 con 0x7f15940b4510 2023-07-14T11:14:38.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.686+0000 7f1592d9d700 1 --2- 172.21.15.84:0/2565069286 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15940d0b10 0x7f15940d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:38.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.686+0000 7f1591d9b700 1 -- 172.21.15.84:0/2565069286 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15800035b0 con 0x7f15940b4510 2023-07-14T11:14:38.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.686+0000 7f1591d9b700 1 -- 172.21.15.84:0/2565069286 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2687968625 0 0) 0x7f15800035b0 con 0x7f15940b4510 2023-07-14T11:14:38.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.686+0000 7f1591d9b700 1 -- 172.21.15.84:0/2565069286 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15940d0b10 msgr2=0x7f15940d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:38.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.687+0000 7f1591d9b700 1 --2- 172.21.15.84:0/2565069286 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15940d0b10 0x7f15940d0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:38.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.687+0000 7f1591d9b700 1 -- 172.21.15.84:0/2565069286 >> v2:172.21.15.179:3300/0 conn(0x7f15940b5d90 msgr2=0x7f15940b6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:38.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.687+0000 7f1591d9b700 1 --2- 172.21.15.84:0/2565069286 >> v2:172.21.15.179:3300/0 conn(0x7f15940b5d90 0x7f15940b6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:38.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.687+0000 7f1591d9b700 1 -- 172.21.15.84:0/2565069286 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15940cdca0 con 0x7f15940b4510 2023-07-14T11:14:38.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.687+0000 7f1591d9b700 1 -- 172.21.15.84:0/2565069286 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7f15840017f0 con 0x7f15940b4510 2023-07-14T11:14:38.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.687+0000 7f1591d9b700 1 -- 172.21.15.84:0/2565069286 >> v1:172.21.15.84:6789/0 conn(0x7f15940b4510 legacy=0x7f15940cd590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:38.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.687+0000 7f1591d9b700 1 --2- 172.21.15.84:0/2565069286 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1580003a00 0x7f1580003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:38.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.687+0000 7f1591d9b700 1 --2- 172.21.15.84:0/2565069286 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15940d0b10 0x7f1580004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:38.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.687+0000 7f1591d9b700 1 --2- 172.21.15.84:0/2565069286 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1580004d90 0x7f1580005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:38.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.687+0000 7f1591d9b700 1 -- 172.21.15.84:0/2565069286 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15940d14d0 con 0x7f1580004d90 2023-07-14T11:14:38.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.687+0000 7f1591d9b700 1 -- 172.21.15.84:0/2565069286 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f158000ba40 con 0x7f1580003a00 2023-07-14T11:14:38.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.687+0000 7f1591d9b700 1 -- 172.21.15.84:0/2565069286 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f158000bc00 con 0x7f15940d0b10 2023-07-14T11:14:38.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.687+0000 7f1592d9d700 1 --2- 172.21.15.84:0/2565069286 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1580004d90 0x7f1580005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:38.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.687+0000 7f159259c700 1 --2- 172.21.15.84:0/2565069286 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1580003a00 0x7f1580003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:38.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.687+0000 7f158bfff700 1 --2- 172.21.15.84:0/2565069286 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15940d0b10 0x7f1580004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:38.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.687+0000 7f1592d9d700 1 -- 172.21.15.84:0/2565069286 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15940d0b10 msgr2=0x7f1580004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:38.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.687+0000 7f1592d9d700 1 --2- 172.21.15.84:0/2565069286 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15940d0b10 0x7f1580004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:38.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.687+0000 7f1592d9d700 1 -- 172.21.15.84:0/2565069286 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1580003a00 msgr2=0x7f1580003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:38.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.687+0000 7f1592d9d700 1 --2- 172.21.15.84:0/2565069286 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1580003a00 0x7f1580003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:38.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.687+0000 7f1592d9d700 1 -- 172.21.15.84:0/2565069286 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15800035b0 con 0x7f1580004d90 2023-07-14T11:14:38.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.688+0000 7f1592d9d700 1 --2- 172.21.15.84:0/2565069286 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1580004d90 0x7f1580005200 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f158c009fc0 tx=0x7f1580005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cacd14b210e271f7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:38.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.688+0000 7f1591d9b700 1 -- 172.21.15.84:0/2565069286 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158c00ec30 con 0x7f1580004d90 2023-07-14T11:14:38.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.688+0000 7f1591d9b700 1 -- 172.21.15.84:0/2565069286 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f158c00f040 con 0x7f1580004d90 2023-07-14T11:14:38.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.688+0000 7f1591d9b700 1 -- 172.21.15.84:0/2565069286 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158c014480 con 0x7f1580004d90 2023-07-14T11:14:38.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.688+0000 7f1598bff700 1 -- 172.21.15.84:0/2565069286 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1580004d90 msgr2=0x7f1580005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:38.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.688+0000 7f1598bff700 1 --2- 172.21.15.84:0/2565069286 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1580004d90 0x7f1580005200 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f158c009fc0 tx=0x7f1580005880 comp rx=0 tx=0).stop 2023-07-14T11:14:38.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.688+0000 7f1592d9d700 1 -- 172.21.15.84:0/2565069286 reap_dead start 2023-07-14T11:14:38.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.688+0000 7f1598bff700 1 -- 172.21.15.84:0/2565069286 shutdown_connections 2023-07-14T11:14:38.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.688+0000 7f1598bff700 1 -- 172.21.15.84:0/2565069286 >> 172.21.15.84:0/2565069286 conn(0x7f159409c1d0 msgr2=0x7f15940d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:38.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.689+0000 7f1598bff700 1 -- 172.21.15.84:0/2565069286 shutdown_connections 2023-07-14T11:14:38.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.689+0000 7f1598bff700 1 -- 172.21.15.84:0/2565069286 wait complete. 2023-07-14T11:14:38.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.690+0000 7f1598bff700 1 Processor -- start 2023-07-14T11:14:38.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.690+0000 7f1598bff700 1 -- start start 2023-07-14T11:14:38.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.691+0000 7f1598bff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1580004d90 0x7f15941f2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:38.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.691+0000 7f1598bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15940b2470 0x7f15940cb190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:38.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.691+0000 7f1598bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15940a04a0 0x7f159415bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:38.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.691+0000 7f1598bff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15940cbb00 con 0x7f1580004d90 2023-07-14T11:14:38.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.691+0000 7f1598bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15940cbde0 con 0x7f15940b2470 2023-07-14T11:14:38.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.691+0000 7f1598bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15940cc0c0 con 0x7f15940a04a0 2023-07-14T11:14:38.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.692+0000 7f159259c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1580004d90 0x7f15941f2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:38.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.692+0000 7f159259c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1580004d90 0x7f15941f2210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34396/0 (socket says 172.21.15.84:34396) 2023-07-14T11:14:38.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.692+0000 7f159259c700 1 -- 172.21.15.84:0/4271248969 learned_addr learned my addr 172.21.15.84:0/4271248969 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:38.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.692+0000 7f158bfff700 1 --2- 172.21.15.84:0/4271248969 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15940b2470 0x7f15940cb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:38.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.692+0000 7f159259c700 1 -- 172.21.15.84:0/4271248969 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15940a04a0 msgr2=0x7f159415bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:38.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.692+0000 7f159259c700 1 --2- 172.21.15.84:0/4271248969 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15940a04a0 0x7f159415bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:38.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.692+0000 7f159259c700 1 -- 172.21.15.84:0/4271248969 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15940b2470 msgr2=0x7f15940cb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:38.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.692+0000 7f159259c700 1 --2- 172.21.15.84:0/4271248969 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15940b2470 0x7f15940cb190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:38.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.692+0000 7f159259c700 1 -- 172.21.15.84:0/4271248969 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15940afac0 con 0x7f1580004d90 2023-07-14T11:14:38.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.692+0000 7f158bfff700 1 --2- 172.21.15.84:0/4271248969 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15940b2470 0x7f15940cb190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:14:38.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.692+0000 7f159259c700 1 --2- 172.21.15.84:0/4271248969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1580004d90 0x7f15941f2210 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f15840079a0 tx=0x7f158400fc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:38.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.692+0000 7f158affd700 1 -- 172.21.15.84:0/4271248969 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158400fe50 con 0x7f1580004d90 2023-07-14T11:14:38.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.693+0000 7f158affd700 1 -- 172.21.15.84:0/4271248969 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15840072e0 con 0x7f1580004d90 2023-07-14T11:14:38.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.693+0000 7f158affd700 1 -- 172.21.15.84:0/4271248969 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1584007690 con 0x7f1580004d90 2023-07-14T11:14:38.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.693+0000 7f1598bff700 1 -- 172.21.15.84:0/4271248969 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15940afda0 con 0x7f1580004d90 2023-07-14T11:14:38.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.693+0000 7f1598bff700 1 -- 172.21.15.84:0/4271248969 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15940cb6d0 con 0x7f1580004d90 2023-07-14T11:14:38.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.694+0000 7f1598bff700 1 -- 172.21.15.84:0/4271248969 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f159404e280 con 0x7f1580004d90 2023-07-14T11:14:38.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.695+0000 7f158affd700 1 -- 172.21.15.84:0/4271248969 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1584005830 con 0x7f1580004d90 2023-07-14T11:14:38.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.696+0000 7f158affd700 1 --2- 172.21.15.84:0/4271248969 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f157406ad10 0x7f157406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:38.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.696+0000 7f158affd700 1 -- 172.21.15.84:0/4271248969 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f15840894a0 con 0x7f1580004d90 2023-07-14T11:14:38.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.696+0000 7f158bfff700 1 --2- 172.21.15.84:0/4271248969 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f157406ad10 0x7f157406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:38.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.697+0000 7f158bfff700 1 --2- 172.21.15.84:0/4271248969 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f157406ad10 0x7f157406d1c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f15940cd3d0 tx=0x7f157c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:38.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.700+0000 7f158affd700 1 -- 172.21.15.84:0/4271248969 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f1584057fe0 con 0x7f1580004d90 2023-07-14T11:14:38.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.936+0000 7f1598bff700 1 -- 172.21.15.84:0/4271248969 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f159406b580 con 0x7f1580004d90 2023-07-14T11:14:38.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.937+0000 7f158affd700 1 -- 172.21.15.84:0/4271248969 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4700 (secure 0 0 0) 0x7f1584057b70 con 0x7f1580004d90 2023-07-14T11:14:38.939 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:14:38.939 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4751,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/76454361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":76454361},{"type":"v1","addr":"172.21.15.179:6833","nonce":76454361}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4757,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/534886511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":534886511},{"type":"v1","addr":"172.21.15.179:6835","nonce":534886511}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5118,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/930551517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":930551517},{"type":"v1","addr":"172.21.15.84:6836","nonce":930551517}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T11:14:32.504609+0000","modified":"2023-07-14T11:14:36.048621+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5121},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5121":{"gid":5121,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.84:6837/932986208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":932986208},{"type":"v1","addr":"172.21.15.84:6837","nonce":932986208}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-14T11:14:38.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.939+0000 7f1598bff700 1 -- 172.21.15.84:0/4271248969 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f157406ad10 msgr2=0x7f157406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:38.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.939+0000 7f1598bff700 1 --2- 172.21.15.84:0/4271248969 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f157406ad10 0x7f157406d1c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f15940cd3d0 tx=0x7f157c008040 comp rx=0 tx=0).stop 2023-07-14T11:14:38.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.939+0000 7f1598bff700 1 -- 172.21.15.84:0/4271248969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1580004d90 msgr2=0x7f15941f2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:38.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.939+0000 7f1598bff700 1 --2- 172.21.15.84:0/4271248969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1580004d90 0x7f15941f2210 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f15840079a0 tx=0x7f158400fc10 comp rx=0 tx=0).stop 2023-07-14T11:14:38.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.939+0000 7f1598bff700 1 -- 172.21.15.84:0/4271248969 shutdown_connections 2023-07-14T11:14:38.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.939+0000 7f1598bff700 1 --2- 172.21.15.84:0/4271248969 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f157406ad10 0x7f157406d1c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:38.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.939+0000 7f1598bff700 1 --2- 172.21.15.84:0/4271248969 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15940a04a0 0x7f159415bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:38.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.939+0000 7f1598bff700 1 --2- 172.21.15.84:0/4271248969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1580004d90 0x7f15941f2210 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:38.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.939+0000 7f1598bff700 1 --2- 172.21.15.84:0/4271248969 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15940b2470 0x7f15940cb190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:38.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.939+0000 7f1598bff700 1 -- 172.21.15.84:0/4271248969 >> 172.21.15.84:0/4271248969 conn(0x7f159409c1d0 msgr2=0x7f15940d1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:38.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.939+0000 7f1598bff700 1 -- 172.21.15.84:0/4271248969 shutdown_connections 2023-07-14T11:14:38.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:38.940+0000 7f1598bff700 1 -- 172.21.15.84:0/4271248969 wait complete. 2023-07-14T11:14:38.943 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 18 2023-07-14T11:14:38.954 INFO:tasks.ceph.mds.c.smithi084.stderr:2023-07-14T11:14:38.952+0000 7f8ae25f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-14T11:14:39.360 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-14T11:14:32.504609+0000', 'modified': '2023-07-14T11:14:36.048621+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5121}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5121': {'gid': 5121, 'name': 'c', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.84:6837/932986208', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6835', 'nonce': 932986208}, {'type': 'v1', 'addr': '172.21.15.84:6837', 'nonce': 932986208}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-14T11:14:39.361 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-14T11:14:39.361 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-07-14T11:14:39.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.555+0000 7fc4d6dff700 1 Processor -- start 2023-07-14T11:14:39.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.555+0000 7fc4d6dff700 1 -- start start 2023-07-14T11:14:39.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.556+0000 7fc4d6dff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc4d00cbe40 0x7fc4d00cda40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:39.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.556+0000 7fc4d6dff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc4d00cdf80 0x7fc4d006ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:39.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.556+0000 7fc4d6dff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4d00ce3a0 con 0x7fc4d0158bb0 2023-07-14T11:14:39.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.556+0000 7fc4d6dff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4d006b5b0 con 0x7fc4d00cbe40 2023-07-14T11:14:39.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.556+0000 7fc4d6dff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4d0071500 con 0x7fc4d00cdf80 2023-07-14T11:14:39.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.556+0000 7fc4cffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc4d00cbe40 0x7fc4d00cda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:39.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.556+0000 7fc4cffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc4d00cbe40 0x7fc4d00cda40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53720/0 (socket says 172.21.15.84:53720) 2023-07-14T11:14:39.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.556+0000 7fc4cffff700 1 -- 172.21.15.84:0/670017501 learned_addr learned my addr 172.21.15.84:0/670017501 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:39.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.557+0000 7fc4d539c700 1 --2- 172.21.15.84:0/670017501 >> v2:172.21.15.179:3300/0 conn(0x7fc4d00cdf80 0x7fc4d006ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:39.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.557+0000 7fc4cffff700 1 -- 172.21.15.84:0/670017501 >> v2:172.21.15.179:3300/0 conn(0x7fc4d00cdf80 msgr2=0x7fc4d006ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:39.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.557+0000 7fc4cffff700 1 --2- 172.21.15.84:0/670017501 >> v2:172.21.15.179:3300/0 conn(0x7fc4d00cdf80 0x7fc4d006ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:39.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.557+0000 7fc4cffff700 1 -- 172.21.15.84:0/670017501 >> v1:172.21.15.179:6789/0 conn(0x7fc4d0158bb0 legacy=0x7fc4d00cd0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:39.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.557+0000 7fc4cffff700 1 -- 172.21.15.84:0/670017501 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4d00ce8c0 con 0x7fc4d00cbe40 2023-07-14T11:14:39.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.557+0000 7fc4cffff700 1 --2- 172.21.15.84:0/670017501 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4d00cbe40 0x7fc4d00cda40 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fc4d006d430 tx=0x7fc4bc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c593ebe84e7d4437 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:39.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.557+0000 7fc4cf7fe700 1 -- 172.21.15.84:0/670017501 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4bc00b870 con 0x7fc4d00cbe40 2023-07-14T11:14:39.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.557+0000 7fc4cf7fe700 1 -- 172.21.15.84:0/670017501 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4bc00b9d0 con 0x7fc4d00cbe40 2023-07-14T11:14:39.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.557+0000 7fc4cf7fe700 1 -- 172.21.15.84:0/670017501 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4bc00bd60 con 0x7fc4d00cbe40 2023-07-14T11:14:39.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.558+0000 7fc4d6dff700 1 -- 172.21.15.84:0/670017501 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4d00cbe40 msgr2=0x7fc4d00cda40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:39.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.558+0000 7fc4d6dff700 1 --2- 172.21.15.84:0/670017501 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4d00cbe40 0x7fc4d00cda40 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fc4d006d430 tx=0x7fc4bc009bd0 comp rx=0 tx=0).stop 2023-07-14T11:14:39.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.558+0000 7fc4d6dff700 1 -- 172.21.15.84:0/670017501 shutdown_connections 2023-07-14T11:14:39.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.558+0000 7fc4d6dff700 1 --2- 172.21.15.84:0/670017501 >> v2:172.21.15.179:3300/0 conn(0x7fc4d00cdf80 0x7fc4d006ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:39.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.558+0000 7fc4d6dff700 1 --2- 172.21.15.84:0/670017501 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4d00cbe40 0x7fc4d00cda40 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:39.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.558+0000 7fc4d6dff700 1 -- 172.21.15.84:0/670017501 >> 172.21.15.84:0/670017501 conn(0x7fc4d00b05d0 msgr2=0x7fc4d00b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:39.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.558+0000 7fc4d6dff700 1 -- 172.21.15.84:0/670017501 shutdown_connections 2023-07-14T11:14:39.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.558+0000 7fc4d6dff700 1 -- 172.21.15.84:0/670017501 wait complete. 2023-07-14T11:14:39.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.560+0000 7fc4d6dff700 1 Processor -- start 2023-07-14T11:14:39.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.561+0000 7fc4d6dff700 1 -- start start 2023-07-14T11:14:39.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.562+0000 7fc4d6dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc4d00cbe40 0x7fc4d00b2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:39.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.562+0000 7fc4d6dff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4d00cdf80 0x7fc4d015b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:39.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.562+0000 7fc4d6dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc4d0158bb0 0x7fc4d0164cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:39.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.562+0000 7fc4d6dff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d01f22d0 con 0x7fc4d00cdf80 2023-07-14T11:14:39.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.562+0000 7fc4d6dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d01f2590 con 0x7fc4d0158bb0 2023-07-14T11:14:39.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.562+0000 7fc4d6dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d01f2870 con 0x7fc4d00cbe40 2023-07-14T11:14:39.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.562+0000 7fc4cffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4d00cdf80 0x7fc4d015b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:39.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.562+0000 7fc4cffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4d00cdf80 0x7fc4d015b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53726/0 (socket says 172.21.15.84:53726) 2023-07-14T11:14:39.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.562+0000 7fc4cffff700 1 -- 172.21.15.84:0/2450153195 learned_addr learned my addr 172.21.15.84:0/2450153195 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:39.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.562+0000 7fc4d539c700 1 --2- 172.21.15.84:0/2450153195 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc4d0158bb0 0x7fc4d0164cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:39.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.562+0000 7fc4d4b9b700 1 --2- 172.21.15.84:0/2450153195 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc4d00cbe40 0x7fc4d00b2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:39.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.562+0000 7fc4cffff700 1 -- 172.21.15.84:0/2450153195 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc4d00cbe40 msgr2=0x7fc4d00b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:39.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.562+0000 7fc4cffff700 1 --2- 172.21.15.84:0/2450153195 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc4d00cbe40 0x7fc4d00b2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:39.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.562+0000 7fc4cffff700 1 -- 172.21.15.84:0/2450153195 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc4d0158bb0 msgr2=0x7fc4d0164cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:39.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.562+0000 7fc4cffff700 1 --2- 172.21.15.84:0/2450153195 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc4d0158bb0 0x7fc4d0164cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:39.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.562+0000 7fc4cffff700 1 -- 172.21.15.84:0/2450153195 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4bc009550 con 0x7fc4d00cdf80 2023-07-14T11:14:39.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.562+0000 7fc4d4b9b700 1 --2- 172.21.15.84:0/2450153195 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc4d00cbe40 0x7fc4d00b2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:14:39.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.563+0000 7fc4cffff700 1 --2- 172.21.15.84:0/2450153195 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4d00cdf80 0x7fc4d015b690 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc000c00 tx=0x7fc4bc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:39.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.563+0000 7fc4cd7fa700 1 -- 172.21.15.84:0/2450153195 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4bc004540 con 0x7fc4d00cdf80 2023-07-14T11:14:39.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.563+0000 7fc4cd7fa700 1 -- 172.21.15.84:0/2450153195 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4bc0036a0 con 0x7fc4d00cdf80 2023-07-14T11:14:39.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.563+0000 7fc4d6dff700 1 -- 172.21.15.84:0/2450153195 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4d01f2b50 con 0x7fc4d00cdf80 2023-07-14T11:14:39.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.563+0000 7fc4cd7fa700 1 -- 172.21.15.84:0/2450153195 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4bc003a30 con 0x7fc4d00cdf80 2023-07-14T11:14:39.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.563+0000 7fc4d6dff700 1 -- 172.21.15.84:0/2450153195 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4d00b2590 con 0x7fc4d00cdf80 2023-07-14T11:14:39.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.565+0000 7fc4cd7fa700 1 -- 172.21.15.84:0/2450153195 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc4bc021070 con 0x7fc4d00cdf80 2023-07-14T11:14:39.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.566+0000 7fc4cd7fa700 1 --2- 172.21.15.84:0/2450153195 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc4b406ace0 0x7fc4b406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:39.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.566+0000 7fc4cd7fa700 1 -- 172.21.15.84:0/2450153195 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc4bc08ac20 con 0x7fc4d00cdf80 2023-07-14T11:14:39.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.566+0000 7fc4d4b9b700 1 --2- 172.21.15.84:0/2450153195 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc4b406ace0 0x7fc4b406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:39.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.567+0000 7fc4d4b9b700 1 --2- 172.21.15.84:0/2450153195 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc4b406ace0 0x7fc4b406d190 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc4c4000f60 tx=0x7fc4c4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:39.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.568+0000 7fc4ea6c4b80 1 Processor -- start 2023-07-14T11:14:39.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.568+0000 7fc4ea6c4b80 1 -- start start 2023-07-14T11:14:39.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.569+0000 7fc4ea6c4b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55719c82a880 0x55719c85a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:39.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.569+0000 7fc4ea6c4b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55719c82cdc0 0x55719c85ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:39.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.569+0000 7fc4ea6c4b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55719c82ac50 0x55719c845120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:39.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.569+0000 7fc4ea6c4b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55719c7a4ea0 con 0x55719c82ac50 2023-07-14T11:14:39.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.569+0000 7fc4ea6c4b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55719c718600 con 0x55719c82a880 2023-07-14T11:14:39.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.569+0000 7fc4ea6c4b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55719c787910 con 0x55719c82cdc0 2023-07-14T11:14:39.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.569+0000 7fc4d539c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55719c82ac50 0x55719c845120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:39.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.569+0000 7fc4d539c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55719c82ac50 0x55719c845120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53736/0 (socket says 172.21.15.84:53736) 2023-07-14T11:14:39.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.569+0000 7fc4d539c700 1 -- 172.21.15.84:0/377690142 learned_addr learned my addr 172.21.15.84:0/377690142 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:39.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.570+0000 7fc4cffff700 1 --2- 172.21.15.84:0/377690142 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55719c82cdc0 0x55719c85ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:39.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.569+0000 7fc4d4b9b700 1 --2- 172.21.15.84:0/377690142 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55719c82a880 0x55719c85a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:39.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.570+0000 7fc4d539c700 1 -- 172.21.15.84:0/377690142 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55719c82cdc0 msgr2=0x55719c85ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:39.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.570+0000 7fc4d539c700 1 --2- 172.21.15.84:0/377690142 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55719c82cdc0 0x55719c85ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:39.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.570+0000 7fc4d539c700 1 -- 172.21.15.84:0/377690142 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55719c82a880 msgr2=0x55719c85a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:39.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.570+0000 7fc4d539c700 1 --2- 172.21.15.84:0/377690142 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55719c82a880 0x55719c85a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:39.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.570+0000 7fc4d539c700 1 -- 172.21.15.84:0/377690142 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55719c574790 con 0x55719c82ac50 2023-07-14T11:14:39.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.570+0000 7fc4d539c700 1 --2- 172.21.15.84:0/377690142 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55719c82ac50 0x55719c845120 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fc4c8007410 tx=0x7fc4c8007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ebe184ea96872c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:39.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.570+0000 7fc4ba7fc700 1 -- 172.21.15.84:0/377690142 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c8015670 con 0x55719c82ac50 2023-07-14T11:14:39.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.570+0000 7fc4ba7fc700 1 -- 172.21.15.84:0/377690142 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4c800f050 con 0x55719c82ac50 2023-07-14T11:14:39.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.570+0000 7fc4ba7fc700 1 -- 172.21.15.84:0/377690142 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c80159d0 con 0x55719c82ac50 2023-07-14T11:14:39.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.571+0000 7fc4ea6c4b80 1 -- 172.21.15.84:0/377690142 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55719c82ac50 msgr2=0x55719c845120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:39.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.571+0000 7fc4ea6c4b80 1 --2- 172.21.15.84:0/377690142 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55719c82ac50 0x55719c845120 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fc4c8007410 tx=0x7fc4c8007720 comp rx=0 tx=0).stop 2023-07-14T11:14:39.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.571+0000 7fc4ea6c4b80 1 -- 172.21.15.84:0/377690142 shutdown_connections 2023-07-14T11:14:39.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.571+0000 7fc4ea6c4b80 1 --2- 172.21.15.84:0/377690142 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55719c82ac50 0x55719c845120 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:39.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.571+0000 7fc4ea6c4b80 1 --2- 172.21.15.84:0/377690142 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55719c82a880 0x55719c85a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:39.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.571+0000 7fc4ea6c4b80 1 --2- 172.21.15.84:0/377690142 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55719c82cdc0 0x55719c85ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:39.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.571+0000 7fc4ea6c4b80 1 -- 172.21.15.84:0/377690142 >> 172.21.15.84:0/377690142 conn(0x55719c8253b0 msgr2=0x55719c830550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:39.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.571+0000 7fc4ea6c4b80 1 -- 172.21.15.84:0/377690142 shutdown_connections 2023-07-14T11:14:39.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.571+0000 7fc4ea6c4b80 1 -- 172.21.15.84:0/377690142 wait complete. 2023-07-14T11:14:39.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.572+0000 7fc4ea6c4b80 1 -- start start 2023-07-14T11:14:39.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.572+0000 7fc4ea6c4b80 1 Processor -- start 2023-07-14T11:14:39.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.573+0000 7fc4ea6c4b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55719c82a880 0x55719c8847d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:39.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.573+0000 7fc4ea6c4b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55719c82ac50 0x55719c85a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:39.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.573+0000 7fc4ea6c4b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55719c82cdc0 0x55719c82b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:39.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.573+0000 7fc4ea6c4b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55719c780be0 con 0x55719c82ac50 2023-07-14T11:14:39.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.573+0000 7fc4ea6c4b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55719c73e5b0 con 0x55719c82a880 2023-07-14T11:14:39.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.573+0000 7fc4ea6c4b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55719c724910 con 0x55719c82cdc0 2023-07-14T11:14:39.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.573+0000 7fc4ea6c4b80 10 client.0 _ll_register_callbacks cb 0x55719c73cb70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T11:14:39.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.573+0000 7fc4cffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55719c82ac50 0x55719c85a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:39.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.573+0000 7fc4cffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55719c82ac50 0x55719c85a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53746/0 (socket says 172.21.15.84:53746) 2023-07-14T11:14:39.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.573+0000 7fc4cffff700 1 -- 172.21.15.84:0/218437782 learned_addr learned my addr 172.21.15.84:0/218437782 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:39.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.574+0000 7fc4d4b9b700 1 --2- 172.21.15.84:0/218437782 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55719c82a880 0x55719c8847d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:39.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.574+0000 7fc4d539c700 1 --2- 172.21.15.84:0/218437782 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55719c82cdc0 0x55719c82b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:39.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.574+0000 7fc4cffff700 1 -- 172.21.15.84:0/218437782 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55719c82cdc0 msgr2=0x55719c82b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:39.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.574+0000 7fc4cffff700 1 --2- 172.21.15.84:0/218437782 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55719c82cdc0 0x55719c82b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:39.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.574+0000 7fc4cffff700 1 -- 172.21.15.84:0/218437782 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55719c82a880 msgr2=0x55719c8847d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:39.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.574+0000 7fc4cffff700 1 --2- 172.21.15.84:0/218437782 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55719c82a880 0x55719c8847d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:39.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.574+0000 7fc4cffff700 1 -- 172.21.15.84:0/218437782 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4c8009c90 con 0x55719c82ac50 2023-07-14T11:14:39.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.574+0000 7fc4d539c700 1 --2- 172.21.15.84:0/218437782 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55719c82cdc0 0x55719c82b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:14:39.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.574+0000 7fc4cffff700 1 --2- 172.21.15.84:0/218437782 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55719c82ac50 0x55719c85a160 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc009fd0 tx=0x7fc4bc057ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cd4ebc2aa320321 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:39.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.574+0000 7fc4af7fe700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-07-14T11:14:39.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.574+0000 7fc4af7fe700 1 -- 172.21.15.84:0/218437782 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4bc061c00 con 0x55719c82ac50 2023-07-14T11:14:39.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.574+0000 7fc4af7fe700 1 -- 172.21.15.84:0/218437782 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc4bc003b90 con 0x55719c82ac50 2023-07-14T11:14:39.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.574+0000 7fc4ea6c4b80 1 -- 172.21.15.84:0/218437782 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55719c8229c0 con 0x55719c82ac50 2023-07-14T11:14:39.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.574+0000 7fc4af7fe700 1 -- 172.21.15.84:0/218437782 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc4bc003d50 con 0x55719c82ac50 2023-07-14T11:14:39.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.574+0000 7fc4ea6c4b80 10 client.5304 fetch_fsmap learned FSMap version 18 2023-07-14T11:14:39.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.574+0000 7fc4ea6c4b80 1 -- 172.21.15.84:0/218437782 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x55719c6610a0 con 0x55719c82ac50 2023-07-14T11:14:39.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.575+0000 7fc4af7fe700 1 -- 172.21.15.84:0/218437782 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55719c8229c0 con 0x55719c82ac50 2023-07-14T11:14:39.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.575+0000 7fc4af7fe700 1 -- 172.21.15.84:0/218437782 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 18) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fc4bc055930 con 0x55719c82ac50 2023-07-14T11:14:39.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.575+0000 7fc4ea6c4b80 10 client.5304 fetch_fsmap finished waiting for FSMap version 18 2023-07-14T11:14:39.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.575+0000 7fc4ea6c4b80 10 client.5304 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-14T11:14:39.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.575+0000 7fc4ea6c4b80 20 client.5304 populate_metadata read hostname 'smithi084' 2023-07-14T11:14:39.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.575+0000 7fc4ea6c4b80 1 --2- 172.21.15.84:0/218437782 >> [v2:172.21.15.84:6835/932986208,v1:172.21.15.84:6837/932986208] conn(0x55719c856fb0 0x55719c857380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:39.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.575+0000 7fc4ea6c4b80 4 client.5304 mds_command: new command op to 5121 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T11:14:39.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.575+0000 7fc4ea6c4b80 1 -- 172.21.15.84:0/218437782 --> [v2:172.21.15.84:6835/932986208,v1:172.21.15.84:6837/932986208] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55719c7ff170 con 0x55719c856fb0 2023-07-14T11:14:39.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.575+0000 7fc4d4b9b700 1 --2- 172.21.15.84:0/218437782 >> [v2:172.21.15.84:6835/932986208,v1:172.21.15.84:6837/932986208] conn(0x55719c856fb0 0x55719c857380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:39.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.575+0000 7fc4af7fe700 10 client.5304 ms_handle_connect on v2:172.21.15.84:6835/932986208 2023-07-14T11:14:39.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.575+0000 7fc4d4b9b700 1 --2- 172.21.15.84:0/218437782 >> [v2:172.21.15.84:6835/932986208,v1:172.21.15.84:6837/932986208] conn(0x55719c856fb0 0x55719c857380 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c237cefa330f19f9 server_cookie=9e1d02c58cd08cf7 in_seq=0 out_seq=0 2023-07-14T11:14:39.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.576+0000 7fc4af7fe700 1 -- 172.21.15.84:0/218437782 <== mds.0 v2:172.21.15.84:6835/932986208 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55719c7ff170 con 0x55719c856fb0 2023-07-14T11:14:39.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.576+0000 7fc4af7fe700 10 client.5304 handle_command_reply: tid=0 2023-07-14T11:14:39.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.576+0000 7fc4ea6c4b80 1 client.5304 shutdown 2023-07-14T11:14:39.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.576+0000 7fc4ea6c4b80 1 -- 172.21.15.84:0/218437782 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55719c82ac50 msgr2=0x55719c85a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:39.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.576+0000 7fc4ea6c4b80 1 --2- 172.21.15.84:0/218437782 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55719c82ac50 0x55719c85a160 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc009fd0 tx=0x7fc4bc057ee0 comp rx=0 tx=0).stop 2023-07-14T11:14:39.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.577+0000 7fc4ea6c4b80 1 -- 172.21.15.84:0/218437782 shutdown_connections 2023-07-14T11:14:39.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.577+0000 7fc4ea6c4b80 1 --2- 172.21.15.84:0/218437782 >> [v2:172.21.15.84:6835/932986208,v1:172.21.15.84:6837/932986208] conn(0x55719c856fb0 0x55719c857380 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:39.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.577+0000 7fc4ea6c4b80 1 --2- 172.21.15.84:0/218437782 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55719c82cdc0 0x55719c82b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:39.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.577+0000 7fc4ea6c4b80 1 --2- 172.21.15.84:0/218437782 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55719c82a880 0x55719c8847d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:39.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.577+0000 7fc4ea6c4b80 1 --2- 172.21.15.84:0/218437782 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55719c82ac50 0x55719c85a160 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:39.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.577+0000 7fc4af7fe700 0 client.5304 ms_handle_reset on v2:172.21.15.84:6835/932986208 2023-07-14T11:14:39.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.577+0000 7fc4ea6c4b80 1 -- 172.21.15.84:0/218437782 >> 172.21.15.84:0/218437782 conn(0x55719c8253b0 msgr2=0x55719c82fd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:39.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.577+0000 7fc4ea6c4b80 1 -- 172.21.15.84:0/218437782 shutdown_connections 2023-07-14T11:14:39.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.577+0000 7fc4ea6c4b80 1 -- 172.21.15.84:0/218437782 wait complete. 2023-07-14T11:14:39.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.577+0000 7fc4ea6c4b80 20 client.5304 trim_cache size 0 max 16384 2023-07-14T11:14:39.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.595+0000 7fc4ea6c4b80 1 Processor -- start 2023-07-14T11:14:39.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.595+0000 7fc4ea6c4b80 1 -- start start 2023-07-14T11:14:39.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.595+0000 7fc4ea6c4b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55719c82a880 0x55719c857380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:39.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.595+0000 7fc4ea6c4b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55719c82ac50 0x55719c8578c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:39.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.595+0000 7fc4ea6c4b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55719c82cdc0 0x55719c8843a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:39.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.595+0000 7fc4ea6c4b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55719c575390 con 0x55719c82a880 2023-07-14T11:14:39.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.595+0000 7fc4ea6c4b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55719c831d60 con 0x55719c82ac50 2023-07-14T11:14:39.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.595+0000 7fc4ea6c4b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55719c82e040 con 0x55719c82cdc0 2023-07-14T11:14:39.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.596+0000 7fc4d4b9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55719c82a880 0x55719c857380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:39.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.596+0000 7fc4d4b9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55719c82a880 0x55719c857380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53748/0 (socket says 172.21.15.84:53748) 2023-07-14T11:14:39.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.596+0000 7fc4d4b9b700 1 -- 172.21.15.84:0/1915712416 learned_addr learned my addr 172.21.15.84:0/1915712416 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:39.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.596+0000 7fc4cffff700 1 --2- 172.21.15.84:0/1915712416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55719c82ac50 0x55719c8578c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:39.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.596+0000 7fc4d4b9b700 1 -- 172.21.15.84:0/1915712416 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55719c82cdc0 msgr2=0x55719c8843a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:39.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.596+0000 7fc4d4b9b700 1 --2- 172.21.15.84:0/1915712416 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55719c82cdc0 0x55719c8843a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:39.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.596+0000 7fc4d4b9b700 1 -- 172.21.15.84:0/1915712416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55719c82ac50 msgr2=0x55719c8578c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:39.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.596+0000 7fc4d4b9b700 1 --2- 172.21.15.84:0/1915712416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55719c82ac50 0x55719c8578c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:39.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.596+0000 7fc4d4b9b700 1 -- 172.21.15.84:0/1915712416 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55719c746b10 con 0x55719c82a880 2023-07-14T11:14:39.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.596+0000 7fc4cffff700 1 --2- 172.21.15.84:0/1915712416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55719c82ac50 0x55719c8578c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:14:39.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.596+0000 7fc4d4b9b700 1 --2- 172.21.15.84:0/1915712416 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55719c82a880 0x55719c857380 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x55719c859b10 tx=0x7fc4c4001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a5f79131a8e6741 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:39.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.597+0000 7fc4baffd700 1 -- 172.21.15.84:0/1915712416 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c4027070 con 0x55719c82a880 2023-07-14T11:14:39.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.597+0000 7fc4baffd700 1 -- 172.21.15.84:0/1915712416 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4c4014e60 con 0x55719c82a880 2023-07-14T11:14:39.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.597+0000 7fc4baffd700 1 -- 172.21.15.84:0/1915712416 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c4006a60 con 0x55719c82a880 2023-07-14T11:14:39.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.597+0000 7fc4ea6c4b80 1 -- 172.21.15.84:0/1915712416 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55719c82a880 msgr2=0x55719c857380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:39.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.597+0000 7fc4ea6c4b80 1 --2- 172.21.15.84:0/1915712416 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55719c82a880 0x55719c857380 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x55719c859b10 tx=0x7fc4c4001e70 comp rx=0 tx=0).stop 2023-07-14T11:14:39.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.597+0000 7fc4ea6c4b80 1 -- 172.21.15.84:0/1915712416 shutdown_connections 2023-07-14T11:14:39.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.597+0000 7fc4ea6c4b80 1 --2- 172.21.15.84:0/1915712416 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55719c82cdc0 0x55719c8843a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:39.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.597+0000 7fc4ea6c4b80 1 --2- 172.21.15.84:0/1915712416 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55719c82a880 0x55719c857380 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:39.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.597+0000 7fc4ea6c4b80 1 --2- 172.21.15.84:0/1915712416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55719c82ac50 0x55719c8578c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:39.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.597+0000 7fc4ea6c4b80 1 -- 172.21.15.84:0/1915712416 >> 172.21.15.84:0/1915712416 conn(0x55719c8253b0 msgr2=0x55719c830520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:39.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.597+0000 7fc4ea6c4b80 1 -- 172.21.15.84:0/1915712416 shutdown_connections 2023-07-14T11:14:39.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.597+0000 7fc4ea6c4b80 1 -- 172.21.15.84:0/1915712416 wait complete. 2023-07-14T11:14:39.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.598+0000 7fc4ea6c4b80 1 -- start start 2023-07-14T11:14:39.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.598+0000 7fc4ea6c4b80 1 Processor -- start 2023-07-14T11:14:39.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.599+0000 7fc4ea6c4b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55719c82a880 0x55719c8dc360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:39.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.599+0000 7fc4ea6c4b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55719c82ac50 0x55719c878910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:39.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.599+0000 7fc4ea6c4b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55719c82cdc0 0x55719c884330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:39.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.599+0000 7fc4ea6c4b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55719c86d1f0 con 0x55719c82a880 2023-07-14T11:14:39.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.599+0000 7fc4ea6c4b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55719c8dcc60 con 0x55719c82ac50 2023-07-14T11:14:39.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.599+0000 7fc4ea6c4b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55719c878480 con 0x55719c82cdc0 2023-07-14T11:14:39.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.599+0000 7fc4ea6c4b80 10 client.0 _ll_register_callbacks cb 0x7fc4bc05db20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T11:14:39.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.599+0000 7fc4d4b9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55719c82a880 0x55719c8dc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:39.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.599+0000 7fc4d4b9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55719c82a880 0x55719c8dc360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53752/0 (socket says 172.21.15.84:53752) 2023-07-14T11:14:39.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.600+0000 7fc4d4b9b700 1 -- 172.21.15.84:0/3846301256 learned_addr learned my addr 172.21.15.84:0/3846301256 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:39.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.600+0000 7fc4d4b9b700 1 -- 172.21.15.84:0/3846301256 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55719c82cdc0 msgr2=0x55719c884330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:39.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.600+0000 7fc4d4b9b700 1 --2- 172.21.15.84:0/3846301256 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55719c82cdc0 0x55719c884330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:39.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.600+0000 7fc4d4b9b700 1 -- 172.21.15.84:0/3846301256 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55719c82ac50 msgr2=0x55719c878910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:39.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.600+0000 7fc4d4b9b700 1 --2- 172.21.15.84:0/3846301256 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55719c82ac50 0x55719c878910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:39.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.600+0000 7fc4d4b9b700 1 -- 172.21.15.84:0/3846301256 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4d00ce3a0 con 0x55719c82a880 2023-07-14T11:14:39.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.600+0000 7fc4d4b9b700 1 --2- 172.21.15.84:0/3846301256 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55719c82a880 0x55719c8dc360 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fc4c4014fd0 tx=0x7fc4c4010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7770c6ff3c70071e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:39.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.600+0000 7fc4af7fe700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-07-14T11:14:39.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.600+0000 7fc4af7fe700 1 -- 172.21.15.84:0/3846301256 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c4027070 con 0x55719c82a880 2023-07-14T11:14:39.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.600+0000 7fc4af7fe700 1 -- 172.21.15.84:0/3846301256 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc4c4022b80 con 0x55719c82a880 2023-07-14T11:14:39.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.600+0000 7fc4ea6c4b80 1 -- 172.21.15.84:0/3846301256 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc4c800f050 con 0x55719c82a880 2023-07-14T11:14:39.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.601+0000 7fc4af7fe700 1 -- 172.21.15.84:0/3846301256 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc4c4022d40 con 0x55719c82a880 2023-07-14T11:14:39.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.601+0000 7fc4ea6c4b80 10 client.5310 fetch_fsmap learned FSMap version 18 2023-07-14T11:14:39.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.601+0000 7fc4ea6c4b80 1 -- 172.21.15.84:0/3846301256 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x55719c5d51d0 con 0x55719c82a880 2023-07-14T11:14:39.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.601+0000 7fc4af7fe700 1 -- 172.21.15.84:0/3846301256 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4c800f050 con 0x55719c82a880 2023-07-14T11:14:39.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.601+0000 7fc4af7fe700 1 -- 172.21.15.84:0/3846301256 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 18) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fc4c4007030 con 0x55719c82a880 2023-07-14T11:14:39.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.601+0000 7fc4ea6c4b80 10 client.5310 fetch_fsmap finished waiting for FSMap version 18 2023-07-14T11:14:39.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.601+0000 7fc4ea6c4b80 10 client.5310 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-14T11:14:39.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.601+0000 7fc4ea6c4b80 20 client.5310 populate_metadata read hostname 'smithi084' 2023-07-14T11:14:39.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.601+0000 7fc4ea6c4b80 1 --2- 172.21.15.84:0/3846301256 >> [v2:172.21.15.84:6835/932986208,v1:172.21.15.84:6837/932986208] conn(0x55719c878f60 0x55719c884870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:39.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.601+0000 7fc4ea6c4b80 4 client.5310 mds_command: new command op to 5121 tid=0[{"prefix": "status"}] 2023-07-14T11:14:39.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.601+0000 7fc4ea6c4b80 1 -- 172.21.15.84:0/3846301256 --> [v2:172.21.15.84:6835/932986208,v1:172.21.15.84:6837/932986208] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55719c779d20 con 0x55719c878f60 2023-07-14T11:14:39.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.601+0000 7fc4cffff700 1 --2- 172.21.15.84:0/3846301256 >> [v2:172.21.15.84:6835/932986208,v1:172.21.15.84:6837/932986208] conn(0x55719c878f60 0x55719c884870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:39.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.602+0000 7fc4af7fe700 10 client.5310 ms_handle_connect on v2:172.21.15.84:6835/932986208 2023-07-14T11:14:39.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.602+0000 7fc4cffff700 1 --2- 172.21.15.84:0/3846301256 >> [v2:172.21.15.84:6835/932986208,v1:172.21.15.84:6837/932986208] conn(0x55719c878f60 0x55719c884870 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f434a62b0843d60f server_cookie=c9f9e3dc41d8d142 in_seq=0 out_seq=0 2023-07-14T11:14:39.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.602+0000 7fc4af7fe700 1 -- 172.21.15.84:0/3846301256 <== mds.0 v2:172.21.15.84:6835/932986208 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55719c779d20 con 0x55719c878f60 2023-07-14T11:14:39.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.602+0000 7fc4af7fe700 10 client.5310 handle_command_reply: tid=0 2023-07-14T11:14:39.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.602+0000 7fc4ea6c4b80 1 client.5310 shutdown 2023-07-14T11:14:39.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.602+0000 7fc4ea6c4b80 1 -- 172.21.15.84:0/3846301256 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55719c82a880 msgr2=0x55719c8dc360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:39.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.602+0000 7fc4ea6c4b80 1 --2- 172.21.15.84:0/3846301256 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55719c82a880 0x55719c8dc360 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fc4c4014fd0 tx=0x7fc4c4010000 comp rx=0 tx=0).stop 2023-07-14T11:14:39.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.602+0000 7fc4ea6c4b80 1 -- 172.21.15.84:0/3846301256 shutdown_connections 2023-07-14T11:14:39.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.602+0000 7fc4ea6c4b80 1 --2- 172.21.15.84:0/3846301256 >> [v2:172.21.15.84:6835/932986208,v1:172.21.15.84:6837/932986208] conn(0x55719c878f60 0x55719c884870 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:39.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.602+0000 7fc4ea6c4b80 1 --2- 172.21.15.84:0/3846301256 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55719c82cdc0 0x55719c884330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:39.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.602+0000 7fc4ea6c4b80 1 --2- 172.21.15.84:0/3846301256 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55719c82a880 0x55719c8dc360 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:39.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.602+0000 7fc4af7fe700 0 client.5310 ms_handle_reset on v2:172.21.15.84:6835/932986208 2023-07-14T11:14:39.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.602+0000 7fc4ea6c4b80 1 --2- 172.21.15.84:0/3846301256 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55719c82ac50 0x55719c878910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:39.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.602+0000 7fc4ea6c4b80 1 -- 172.21.15.84:0/3846301256 >> 172.21.15.84:0/3846301256 conn(0x55719c8253b0 msgr2=0x55719c85e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:39.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.602+0000 7fc4ea6c4b80 1 -- 172.21.15.84:0/3846301256 shutdown_connections 2023-07-14T11:14:39.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.602+0000 7fc4ea6c4b80 1 -- 172.21.15.84:0/3846301256 wait complete. 2023-07-14T11:14:39.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.602+0000 7fc4ea6c4b80 20 client.5310 trim_cache size 0 max 16384 2023-07-14T11:14:39.612 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-07-14T11:14:39.613 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f", 2023-07-14T11:14:39.613 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 0, 2023-07-14T11:14:39.613 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 5121, 2023-07-14T11:14:39.613 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2023-07-14T11:14:39.613 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2023-07-14T11:14:39.613 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2023-07-14T11:14:39.613 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 6.5715786969999996, 2023-07-14T11:14:39.614 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 18, 2023-07-14T11:14:39.614 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 37, 2023-07-14T11:14:39.614 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 37, 2023-07-14T11:14:39.614 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 22.429581593000002 2023-07-14T11:14:39.614 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-07-14T11:14:39.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.603+0000 7fc4d6dff700 1 -- 172.21.15.84:0/2450153195 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc4b406ace0 msgr2=0x7fc4b406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:39.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.603+0000 7fc4d6dff700 1 --2- 172.21.15.84:0/2450153195 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc4b406ace0 0x7fc4b406d190 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc4c4000f60 tx=0x7fc4c4009040 comp rx=0 tx=0).stop 2023-07-14T11:14:39.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.603+0000 7fc4d6dff700 1 -- 172.21.15.84:0/2450153195 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4d00cdf80 msgr2=0x7fc4d015b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:39.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.603+0000 7fc4d6dff700 1 --2- 172.21.15.84:0/2450153195 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4d00cdf80 0x7fc4d015b690 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc000c00 tx=0x7fc4bc004750 comp rx=0 tx=0).stop 2023-07-14T11:14:39.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.603+0000 7fc4d6dff700 1 -- 172.21.15.84:0/2450153195 shutdown_connections 2023-07-14T11:14:39.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.603+0000 7fc4d6dff700 1 --2- 172.21.15.84:0/2450153195 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc4b406ace0 0x7fc4b406d190 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:39.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.603+0000 7fc4d6dff700 1 --2- 172.21.15.84:0/2450153195 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc4d00cbe40 0x7fc4d00b2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:39.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.603+0000 7fc4d6dff700 1 --2- 172.21.15.84:0/2450153195 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc4d0158bb0 0x7fc4d0164cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:39.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.603+0000 7fc4d6dff700 1 --2- 172.21.15.84:0/2450153195 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4d00cdf80 0x7fc4d015b690 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:39.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.603+0000 7fc4d6dff700 1 -- 172.21.15.84:0/2450153195 >> 172.21.15.84:0/2450153195 conn(0x7fc4d00b05d0 msgr2=0x7fc4d00b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:39.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.603+0000 7fc4d6dff700 1 -- 172.21.15.84:0/2450153195 shutdown_connections 2023-07-14T11:14:39.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.603+0000 7fc4d6dff700 1 -- 172.21.15.84:0/2450153195 wait complete. 2023-07-14T11:14:39.622 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-14T11:14:39.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.814+0000 7ff8dd7ff700 1 Processor -- start 2023-07-14T11:14:39.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.814+0000 7ff8dd7ff700 1 -- start start 2023-07-14T11:14:39.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.815+0000 7ff8dd7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8d815c950 0x7ff8d80b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:39.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.816+0000 7ff8dd7ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff8d80b1e00 0x7ff8d80d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:39.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.816+0000 7ff8dd7ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff8d80b2350 0x7ff8d80d1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:39.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.816+0000 7ff8dd7ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8d80d2ce0 con 0x7ff8d80b1e00 2023-07-14T11:14:39.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.816+0000 7ff8dd7ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8d80b3350 con 0x7ff8d80b2350 2023-07-14T11:14:39.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.816+0000 7ff8dd7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d80b3630 con 0x7ff8d815c950 2023-07-14T11:14:39.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.816+0000 7ff8cffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff8d80b1e00 0x7ff8d80d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:39.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.816+0000 7ff8cffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff8d80b1e00 0x7ff8d80d0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53764/0 (socket says 172.21.15.84:53764) 2023-07-14T11:14:39.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.816+0000 7ff8cffff700 1 -- 172.21.15.84:0/3458014828 learned_addr learned my addr 172.21.15.84:0/3458014828 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:39.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.816+0000 7ff8d77fe700 1 --2- 172.21.15.84:0/3458014828 >> v2:172.21.15.179:3300/0 conn(0x7ff8d80b2350 0x7ff8d80d1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:39.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.816+0000 7ff8d6ffd700 1 --2- 172.21.15.84:0/3458014828 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8d815c950 0x7ff8d80b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:39.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.816+0000 7ff8cffff700 1 -- 172.21.15.84:0/3458014828 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8d815c950 msgr2=0x7ff8d80b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:39.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.816+0000 7ff8cffff700 1 --2- 172.21.15.84:0/3458014828 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8d815c950 0x7ff8d80b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:39.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.816+0000 7ff8cffff700 1 -- 172.21.15.84:0/3458014828 >> v2:172.21.15.179:3300/0 conn(0x7ff8d80b2350 msgr2=0x7ff8d80d1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:39.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.816+0000 7ff8cffff700 1 --2- 172.21.15.84:0/3458014828 >> v2:172.21.15.179:3300/0 conn(0x7ff8d80b2350 0x7ff8d80d1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:39.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.816+0000 7ff8cffff700 1 -- 172.21.15.84:0/3458014828 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8d80b3910 con 0x7ff8d80b1e00 2023-07-14T11:14:39.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.816+0000 7ff8d77fe700 1 --2- 172.21.15.84:0/3458014828 >> v2:172.21.15.179:3300/0 conn(0x7ff8d80b2350 0x7ff8d80d1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:14:39.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.817+0000 7ff8cffff700 1 --2- 172.21.15.84:0/3458014828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8d80b1e00 0x7ff8d80d0b10 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7ff8d80b3280 tx=0x7ff8c0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2922556f75a56e39 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:39.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.817+0000 7ff8d67fc700 1 -- 172.21.15.84:0/3458014828 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c000b870 con 0x7ff8d80b1e00 2023-07-14T11:14:39.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.817+0000 7ff8d67fc700 1 -- 172.21.15.84:0/3458014828 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8c000b9d0 con 0x7ff8d80b1e00 2023-07-14T11:14:39.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.817+0000 7ff8d67fc700 1 -- 172.21.15.84:0/3458014828 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c000bd60 con 0x7ff8d80b1e00 2023-07-14T11:14:39.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.817+0000 7ff8dd7ff700 1 -- 172.21.15.84:0/3458014828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8d80b1e00 msgr2=0x7ff8d80d0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:39.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.817+0000 7ff8dd7ff700 1 --2- 172.21.15.84:0/3458014828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8d80b1e00 0x7ff8d80d0b10 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7ff8d80b3280 tx=0x7ff8c0009bd0 comp rx=0 tx=0).stop 2023-07-14T11:14:39.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.818+0000 7ff8dd7ff700 1 -- 172.21.15.84:0/3458014828 shutdown_connections 2023-07-14T11:14:39.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.818+0000 7ff8dd7ff700 1 --2- 172.21.15.84:0/3458014828 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8d815c950 0x7ff8d80b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:39.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.818+0000 7ff8dd7ff700 1 --2- 172.21.15.84:0/3458014828 >> v2:172.21.15.179:3300/0 conn(0x7ff8d80b2350 0x7ff8d80d1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:39.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.818+0000 7ff8dd7ff700 1 --2- 172.21.15.84:0/3458014828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8d80b1e00 0x7ff8d80d0b10 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:39.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.818+0000 7ff8dd7ff700 1 -- 172.21.15.84:0/3458014828 >> 172.21.15.84:0/3458014828 conn(0x7ff8d809c1d0 msgr2=0x7ff8d80d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:39.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.818+0000 7ff8dd7ff700 1 -- 172.21.15.84:0/3458014828 shutdown_connections 2023-07-14T11:14:39.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.818+0000 7ff8dd7ff700 1 -- 172.21.15.84:0/3458014828 wait complete. 2023-07-14T11:14:39.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.819+0000 7ff8dd7ff700 1 Processor -- start 2023-07-14T11:14:39.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.820+0000 7ff8dd7ff700 1 -- start start 2023-07-14T11:14:39.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.820+0000 7ff8dd7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8d80b1e00 0x7ff8d80c5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:39.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.820+0000 7ff8dd7ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff8d80b2350 0x7ff8d81e86a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:39.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.820+0000 7ff8dd7ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8d815c950 0x7ff8d8147b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:39.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.820+0000 7ff8dd7ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d80b77d0 con 0x7ff8d815c950 2023-07-14T11:14:39.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.820+0000 7ff8dd7ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d80b7210 con 0x7ff8d80b2350 2023-07-14T11:14:39.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.820+0000 7ff8dd7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d80b74f0 con 0x7ff8d80b1e00 2023-07-14T11:14:39.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.821+0000 7ff8d77fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8d815c950 0x7ff8d8147b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:39.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.821+0000 7ff8d77fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8d815c950 0x7ff8d8147b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53766/0 (socket says 172.21.15.84:53766) 2023-07-14T11:14:39.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.821+0000 7ff8d77fe700 1 -- 172.21.15.84:0/2974557325 learned_addr learned my addr 172.21.15.84:0/2974557325 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:39.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.821+0000 7ff8d6ffd700 1 --2- 172.21.15.84:0/2974557325 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8d80b1e00 0x7ff8d80c5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:39.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.821+0000 7ff8cffff700 1 --2- 172.21.15.84:0/2974557325 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff8d80b2350 0x7ff8d81e86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:39.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.821+0000 7ff8d77fe700 1 -- 172.21.15.84:0/2974557325 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8d80b1e00 msgr2=0x7ff8d80c5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:39.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.821+0000 7ff8d77fe700 1 --2- 172.21.15.84:0/2974557325 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8d80b1e00 0x7ff8d80c5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:39.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.821+0000 7ff8d77fe700 1 -- 172.21.15.84:0/2974557325 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff8d80b2350 msgr2=0x7ff8d81e86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:39.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.821+0000 7ff8d77fe700 1 --2- 172.21.15.84:0/2974557325 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff8d80b2350 0x7ff8d81e86a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:39.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.821+0000 7ff8d77fe700 1 -- 172.21.15.84:0/2974557325 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8c0009550 con 0x7ff8d815c950 2023-07-14T11:14:39.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.821+0000 7ff8cffff700 1 --2- 172.21.15.84:0/2974557325 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff8d80b2350 0x7ff8d81e86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:14:39.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.821+0000 7ff8d77fe700 1 --2- 172.21.15.84:0/2974557325 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8d815c950 0x7ff8d8147b40 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7ff8d0007e10 tx=0x7ff8d000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:39.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.822+0000 7ff8cf7fe700 1 -- 172.21.15.84:0/2974557325 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d000de90 con 0x7ff8d815c950 2023-07-14T11:14:39.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.822+0000 7ff8cf7fe700 1 -- 172.21.15.84:0/2974557325 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8d000f040 con 0x7ff8d815c950 2023-07-14T11:14:39.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.822+0000 7ff8dd7ff700 1 -- 172.21.15.84:0/2974557325 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8d80b7b30 con 0x7ff8d815c950 2023-07-14T11:14:39.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.822+0000 7ff8cf7fe700 1 -- 172.21.15.84:0/2974557325 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d0003c60 con 0x7ff8d815c950 2023-07-14T11:14:39.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.822+0000 7ff8dd7ff700 1 -- 172.21.15.84:0/2974557325 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8d81e8be0 con 0x7ff8d815c950 2023-07-14T11:14:39.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.823+0000 7ff8dd7ff700 1 -- 172.21.15.84:0/2974557325 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8d80b8050 con 0x7ff8d815c950 2023-07-14T11:14:39.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.824+0000 7ff8cf7fe700 1 -- 172.21.15.84:0/2974557325 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff8d0004030 con 0x7ff8d815c950 2023-07-14T11:14:39.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.825+0000 7ff8cf7fe700 1 --2- 172.21.15.84:0/2974557325 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff8b806ace0 0x7ff8b806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:39.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.825+0000 7ff8cf7fe700 1 -- 172.21.15.84:0/2974557325 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff8d0089580 con 0x7ff8d815c950 2023-07-14T11:14:39.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.825+0000 7ff8d6ffd700 1 --2- 172.21.15.84:0/2974557325 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff8b806ace0 0x7ff8b806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:39.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.825+0000 7ff8d6ffd700 1 --2- 172.21.15.84:0/2974557325 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff8b806ace0 0x7ff8b806d190 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff8c8006fd0 tx=0x7ff8c8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:39.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:39.829+0000 7ff8cf7fe700 1 -- 172.21.15.84:0/2974557325 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ff8d80b8050 con 0x7ff8d815c950 2023-07-14T11:14:40.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:40.070+0000 7ff8dd7ff700 1 -- 172.21.15.84:0/2974557325 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff8d80b8050 con 0x7ff8d815c950 2023-07-14T11:14:40.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:40.071+0000 7ff8cf7fe700 1 -- 172.21.15.84:0/2974557325 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff8d80b8050 con 0x7ff8d815c950 2023-07-14T11:14:40.073 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-14T11:14:40.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:40.074+0000 7ff8dd7ff700 1 -- 172.21.15.84:0/2974557325 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff8b806ace0 msgr2=0x7ff8b806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:40.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:40.074+0000 7ff8dd7ff700 1 --2- 172.21.15.84:0/2974557325 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff8b806ace0 0x7ff8b806d190 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff8c8006fd0 tx=0x7ff8c8008040 comp rx=0 tx=0).stop 2023-07-14T11:14:40.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:40.074+0000 7ff8dd7ff700 1 -- 172.21.15.84:0/2974557325 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8d815c950 msgr2=0x7ff8d8147b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:40.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:40.074+0000 7ff8dd7ff700 1 --2- 172.21.15.84:0/2974557325 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8d815c950 0x7ff8d8147b40 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7ff8d0007e10 tx=0x7ff8d000d3b0 comp rx=0 tx=0).stop 2023-07-14T11:14:40.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:40.074+0000 7ff8dd7ff700 1 -- 172.21.15.84:0/2974557325 shutdown_connections 2023-07-14T11:14:40.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:40.074+0000 7ff8dd7ff700 1 --2- 172.21.15.84:0/2974557325 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff8b806ace0 0x7ff8b806d190 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:40.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:40.074+0000 7ff8dd7ff700 1 --2- 172.21.15.84:0/2974557325 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8d80b1e00 0x7ff8d80c5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:40.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:40.074+0000 7ff8dd7ff700 1 --2- 172.21.15.84:0/2974557325 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8d815c950 0x7ff8d8147b40 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:40.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:40.074+0000 7ff8dd7ff700 1 --2- 172.21.15.84:0/2974557325 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff8d80b2350 0x7ff8d81e86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:40.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:40.074+0000 7ff8dd7ff700 1 -- 172.21.15.84:0/2974557325 >> 172.21.15.84:0/2974557325 conn(0x7ff8d809c1d0 msgr2=0x7ff8d80b43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:40.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:40.074+0000 7ff8dd7ff700 1 -- 172.21.15.84:0/2974557325 shutdown_connections 2023-07-14T11:14:40.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:40.074+0000 7ff8dd7ff700 1 -- 172.21.15.84:0/2974557325 wait complete. 2023-07-14T11:14:40.094 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-14T11:14:40.094 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-14T11:14:40.094 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi084.front.sepia.ceph.com 2023-07-14T11:14:40.095 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-14T11:14:40.095 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-14T11:14:40.095 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-14T11:14:40.095 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-14T11:14:40.096 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-14T11:14:40.096 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-14T11:14:40.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:14:40.097 DEBUG:teuthology.orchestra.run.smithi084:> ip addr 2023-07-14T11:14:40.144 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-14T11:14:40.144 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-14T11:14:40.144 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2023-07-14T11:14:40.144 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:14:40.145 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2023-07-14T11:14:40.145 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:14:40.145 INFO:teuthology.orchestra.run.smithi084.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T11:14:40.145 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:68 brd ff:ff:ff:ff:ff:ff 2023-07-14T11:14:40.145 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f0 2023-07-14T11:14:40.145 INFO:teuthology.orchestra.run.smithi084.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T11:14:40.145 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:69 brd ff:ff:ff:ff:ff:ff 2023-07-14T11:14:40.145 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f1 2023-07-14T11:14:40.146 INFO:teuthology.orchestra.run.smithi084.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T11:14:40.146 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:50 brd ff:ff:ff:ff:ff:ff 2023-07-14T11:14:40.146 INFO:teuthology.orchestra.run.smithi084.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-14T11:14:40.146 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:51 brd ff:ff:ff:ff:ff:ff 2023-07-14T11:14:40.146 INFO:teuthology.orchestra.run.smithi084.stdout: inet 172.21.15.84/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-14T11:14:40.146 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft 41888sec preferred_lft 41888sec 2023-07-14T11:14:40.146 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::ec4:7aff:fe8f:d751/64 scope link 2023-07-14T11:14:40.147 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:14:40.147 INFO:teuthology.orchestra.run.smithi084.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-14T11:14:40.147 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 2e:15:90:61:8f:22 brd ff:ff:ff:ff:ff:ff 2023-07-14T11:14:40.147 INFO:teuthology.orchestra.run.smithi084.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-14T11:14:40.147 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:14:40.147 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::dc90:1eff:feca:b2b4/64 scope link 2023-07-14T11:14:40.147 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:14:40.147 INFO:teuthology.orchestra.run.smithi084.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-14T11:14:40.148 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 2e:15:90:61:8f:22 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-14T11:14:40.148 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::2c15:90ff:fe61:8f22/64 scope link 2023-07-14T11:14:40.148 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:14:40.148 INFO:teuthology.orchestra.run.smithi084.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-14T11:14:40.148 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 5e:77:8b:e6:63:60 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-14T11:14:40.148 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::5c77:8bff:fee6:6360/64 scope link 2023-07-14T11:14:40.148 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:14:40.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:14:40.149 DEBUG:teuthology.orchestra.run.smithi084:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-14T11:14:40.218 INFO:teuthology.orchestra.run.smithi084.stdout:1 2023-07-14T11:14:40.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:14:40.221 DEBUG:teuthology.orchestra.run.smithi084:> route 2023-07-14T11:14:40.269 INFO:teuthology.orchestra.run.smithi084.stdout:Kernel IP routing table 2023-07-14T11:14:40.269 INFO:teuthology.orchestra.run.smithi084.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-14T11:14:40.269 INFO:teuthology.orchestra.run.smithi084.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-14T11:14:40.269 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-14T11:14:40.270 INFO:teuthology.orchestra.run.smithi084.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-14T11:14:40.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:14:40.271 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-07-14T11:14:40.271 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-07-14T11:14:40.272 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-14T11:14:40.272 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-14T11:14:40.272 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-14T11:14:40.272 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-07-14T11:14:40.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:14:40.441 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2023-07-14T11:14:40.486 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-14T11:14:40.486 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-14T11:14:40.487 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-14T11:14:40.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:14:40.488 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set brx.0 up 2023-07-14T11:14:40.558 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T11:14:40.558 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-14T11:14:40.604 INFO:teuthology.orchestra.run.smithi084.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-14T11:14:40.604 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T11:14:40.604 DEBUG:teuthology.orchestra.run.smithi084:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-14T11:14:40.649 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-07-14T11:14:40.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:14:40.649 DEBUG:teuthology.orchestra.run.smithi084:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-14T11:14:40.792 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-14T11:14:40.793 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-14T11:14:40.820 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-14T11:14:40.821 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-14T11:14:40.821 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-07-14T11:14:40.821 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: trying mount with new device syntax: 0@3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f.cephfs=/ 2023-07-14T11:14:40.821 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.84:3300/172.21.15.179:3300/172.21.15.179:3301" will pass to kernel 2023-07-14T11:14:40.826 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-14T11:14:40.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:14:40.827 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-14T11:14:40.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:14:40.897 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-14T11:14:41.000 INFO:teuthology.orchestra.run.smithi084.stdout:client5179 2023-07-14T11:14:41.000 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-14T11:14:41.001 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:14:41.047 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-14T11:14:41.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.281+0000 7f877c9ff700 1 Processor -- start 2023-07-14T11:14:41.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.281+0000 7f877c9ff700 1 -- start start 2023-07-14T11:14:41.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.282+0000 7f877c9ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f87781597c0 0x7f8778159c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:41.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.282+0000 7f877c9ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87780cdf90 con 0x7f87781500d0 2023-07-14T11:14:41.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.282+0000 7f877c9ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f877815a2f0 con 0x7f87780cea50 2023-07-14T11:14:41.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.282+0000 7f877c9ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f877815a5d0 con 0x7f87781597c0 2023-07-14T11:14:41.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.283+0000 7f877659c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f87781500d0 0x7f8778070350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51220/0 (socket says 172.21.15.84:51220) 2023-07-14T11:14:41.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.283+0000 7f877659c700 1 -- 172.21.15.84:0/2040777451 learned_addr learned my addr 172.21.15.84:0/2040777451 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:14:41.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.283+0000 7f8775d9b700 1 --2- 172.21.15.84:0/2040777451 >> v2:172.21.15.179:3300/0 conn(0x7f87781597c0 0x7f8778159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:41.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.283+0000 7f877559a700 1 -- 172.21.15.84:0/2040777451 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 618938297 0 0) 0x7f87780cdf90 con 0x7f87781500d0 2023-07-14T11:14:41.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.283+0000 7f877559a700 1 -- 172.21.15.84:0/2040777451 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87600035b0 con 0x7f87781500d0 2023-07-14T11:14:41.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.283+0000 7f877559a700 1 -- 172.21.15.84:0/2040777451 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 436287905 0 0) 0x7f87600035b0 con 0x7f87781500d0 2023-07-14T11:14:41.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.284+0000 7f877559a700 1 -- 172.21.15.84:0/2040777451 >> v2:172.21.15.179:3300/0 conn(0x7f87781597c0 msgr2=0x7f8778159c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:41.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.284+0000 7f877559a700 1 --2- 172.21.15.84:0/2040777451 >> v2:172.21.15.179:3300/0 conn(0x7f87781597c0 0x7f8778159c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:41.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.284+0000 7f877559a700 1 -- 172.21.15.84:0/2040777451 >> v1:172.21.15.179:6789/0 conn(0x7f87780cea50 legacy=0x7f87780b2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:41.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.284+0000 7f877559a700 1 -- 172.21.15.84:0/2040777451 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87780ce250 con 0x7f87781500d0 2023-07-14T11:14:41.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.284+0000 7f877559a700 1 -- 172.21.15.84:0/2040777451 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7f8768001670 con 0x7f87781500d0 2023-07-14T11:14:41.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.284+0000 7f877559a700 1 -- 172.21.15.84:0/2040777451 >> v1:172.21.15.84:6789/0 conn(0x7f87781500d0 legacy=0x7f8778070350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:41.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.284+0000 7f877559a700 1 --2- 172.21.15.84:0/2040777451 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8760003a00 0x7f8760003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:41.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.284+0000 7f877559a700 1 --2- 172.21.15.84:0/2040777451 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8760004850 0x7f8760004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:41.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.284+0000 7f877559a700 1 --2- 172.21.15.84:0/2040777451 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8760005200 0x7f876000dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:41.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.284+0000 7f877559a700 1 -- 172.21.15.84:0/2040777451 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f877815a5d0 con 0x7f8760003a00 2023-07-14T11:14:41.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.284+0000 7f877559a700 1 -- 172.21.15.84:0/2040777451 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f876000e320 con 0x7f8760004850 2023-07-14T11:14:41.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.284+0000 7f877559a700 1 -- 172.21.15.84:0/2040777451 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f876000e4e0 con 0x7f8760005200 2023-07-14T11:14:41.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.284+0000 7f877659c700 1 --2- 172.21.15.84:0/2040777451 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8760003a00 0x7f8760003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:41.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.284+0000 7f8775d9b700 1 --2- 172.21.15.84:0/2040777451 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8760004850 0x7f8760004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:41.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.284+0000 7f8776d9d700 1 --2- 172.21.15.84:0/2040777451 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8760005200 0x7f876000dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:41.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.284+0000 7f877659c700 1 -- 172.21.15.84:0/2040777451 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8760005200 msgr2=0x7f876000dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:41.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.284+0000 7f877659c700 1 --2- 172.21.15.84:0/2040777451 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8760005200 0x7f876000dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:41.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.284+0000 7f877659c700 1 -- 172.21.15.84:0/2040777451 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8760004850 msgr2=0x7f8760004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:41.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.284+0000 7f877659c700 1 --2- 172.21.15.84:0/2040777451 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8760004850 0x7f8760004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:41.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.284+0000 7f877659c700 1 -- 172.21.15.84:0/2040777451 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87600035b0 con 0x7f8760003a00 2023-07-14T11:14:41.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.284+0000 7f8776d9d700 1 --2- 172.21.15.84:0/2040777451 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8760005200 0x7f876000dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:14:41.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.284+0000 7f8776d9d700 1 -- 172.21.15.84:0/2040777451 reap_dead start 2023-07-14T11:14:41.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.285+0000 7f877659c700 1 --2- 172.21.15.84:0/2040777451 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8760003a00 0x7f8760003e10 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f876800c240 tx=0x7f8760005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c4dcd477e894bda server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:41.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.285+0000 7f877559a700 1 -- 172.21.15.84:0/2040777451 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8768007c10 con 0x7f8760003a00 2023-07-14T11:14:41.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.285+0000 7f877559a700 1 -- 172.21.15.84:0/2040777451 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f876800cde0 con 0x7f8760003a00 2023-07-14T11:14:41.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.285+0000 7f877559a700 1 -- 172.21.15.84:0/2040777451 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8768005ba0 con 0x7f8760003a00 2023-07-14T11:14:41.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.285+0000 7f877c9ff700 1 -- 172.21.15.84:0/2040777451 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8760003a00 msgr2=0x7f8760003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:41.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.285+0000 7f877c9ff700 1 --2- 172.21.15.84:0/2040777451 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8760003a00 0x7f8760003e10 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f876800c240 tx=0x7f8760005880 comp rx=0 tx=0).stop 2023-07-14T11:14:41.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.285+0000 7f877c9ff700 1 -- 172.21.15.84:0/2040777451 shutdown_connections 2023-07-14T11:14:41.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.285+0000 7f877c9ff700 1 --2- 172.21.15.84:0/2040777451 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8760003a00 0x7f8760003e10 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:41.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.285+0000 7f877c9ff700 1 -- 172.21.15.84:0/2040777451 >> 172.21.15.84:0/2040777451 conn(0x7f8778069f30 msgr2=0x7f877806a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:41.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.285+0000 7f877c9ff700 1 -- 172.21.15.84:0/2040777451 shutdown_connections 2023-07-14T11:14:41.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.286+0000 7f877c9ff700 1 -- 172.21.15.84:0/2040777451 wait complete. 2023-07-14T11:14:41.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.287+0000 7f877c9ff700 1 Processor -- start 2023-07-14T11:14:41.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.287+0000 7f877c9ff700 1 -- start start 2023-07-14T11:14:41.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.288+0000 7f877c9ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8760003a00 0x7f8778147b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:41.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.288+0000 7f877c9ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f87781e6600 0x7f87781504a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:41.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.288+0000 7f877c9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87781509e0 0x7f8778152fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:41.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.288+0000 7f877c9ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8778150e50 con 0x7f87781e6600 2023-07-14T11:14:41.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.288+0000 7f877c9ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87781480b0 con 0x7f8760003a00 2023-07-14T11:14:41.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.288+0000 7f877c9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8778148af0 con 0x7f87781509e0 2023-07-14T11:14:41.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.289+0000 7f8775d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f87781e6600 0x7f87781504a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:41.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.289+0000 7f8775d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f87781e6600 0x7f87781504a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53786/0 (socket says 172.21.15.84:53786) 2023-07-14T11:14:41.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.289+0000 7f8775d9b700 1 -- 172.21.15.84:0/267141967 learned_addr learned my addr 172.21.15.84:0/267141967 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:41.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.289+0000 7f877659c700 1 --2- 172.21.15.84:0/267141967 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8760003a00 0x7f8778147b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:41.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.289+0000 7f8776d9d700 1 --2- 172.21.15.84:0/267141967 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87781509e0 0x7f8778152fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:41.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.289+0000 7f8775d9b700 1 -- 172.21.15.84:0/267141967 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87781509e0 msgr2=0x7f8778152fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:41.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.289+0000 7f8775d9b700 1 --2- 172.21.15.84:0/267141967 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87781509e0 0x7f8778152fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:41.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.289+0000 7f8775d9b700 1 -- 172.21.15.84:0/267141967 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8760003a00 msgr2=0x7f8778147b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:41.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.289+0000 7f8775d9b700 1 --2- 172.21.15.84:0/267141967 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8760003a00 0x7f8778147b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:41.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.289+0000 7f8775d9b700 1 -- 172.21.15.84:0/267141967 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8778153b80 con 0x7f87781e6600 2023-07-14T11:14:41.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.289+0000 7f8775d9b700 1 --2- 172.21.15.84:0/267141967 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f87781e6600 0x7f87781504a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f876c0115d0 tx=0x7f876c0118e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:41.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.289+0000 7f8766ffd700 1 -- 172.21.15.84:0/267141967 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f876c015870 con 0x7f87781e6600 2023-07-14T11:14:41.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.290+0000 7f8766ffd700 1 -- 172.21.15.84:0/267141967 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f876c0159d0 con 0x7f87781e6600 2023-07-14T11:14:41.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.290+0000 7f8766ffd700 1 -- 172.21.15.84:0/267141967 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f876c015d40 con 0x7f87781e6600 2023-07-14T11:14:41.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.290+0000 7f877c9ff700 1 -- 172.21.15.84:0/267141967 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f877814ca90 con 0x7f87781e6600 2023-07-14T11:14:41.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.290+0000 7f877c9ff700 1 -- 172.21.15.84:0/267141967 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f877814d050 con 0x7f87781e6600 2023-07-14T11:14:41.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.291+0000 7f877c9ff700 1 -- 172.21.15.84:0/267141967 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f877804e280 con 0x7f87781e6600 2023-07-14T11:14:41.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.292+0000 7f8766ffd700 1 -- 172.21.15.84:0/267141967 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f876c0143e0 con 0x7f87781e6600 2023-07-14T11:14:41.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.292+0000 7f8766ffd700 1 --2- 172.21.15.84:0/267141967 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f875806ace0 0x7f875806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:41.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.293+0000 7f8766ffd700 1 -- 172.21.15.84:0/267141967 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f876c0895a0 con 0x7f87781e6600 2023-07-14T11:14:41.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.293+0000 7f877659c700 1 --2- 172.21.15.84:0/267141967 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f875806ace0 0x7f875806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:41.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.293+0000 7f877659c700 1 --2- 172.21.15.84:0/267141967 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f875806ace0 0x7f875806d190 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8768000c00 tx=0x7f8768007000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:41.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.297+0000 7f8766ffd700 1 -- 172.21.15.84:0/267141967 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f876c054640 con 0x7f87781e6600 2023-07-14T11:14:41.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.534+0000 7f877c9ff700 1 -- 172.21.15.84:0/267141967 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f87780cb2a0 con 0x7f87781e6600 2023-07-14T11:14:41.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.535+0000 7f8766ffd700 1 -- 172.21.15.84:0/267141967 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+73 (secure 0 0 0) 0x7f876c057c60 con 0x7f87781e6600 2023-07-14T11:14:41.537 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-14T11:14:41.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.537+0000 7f877c9ff700 1 -- 172.21.15.84:0/267141967 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f875806ace0 msgr2=0x7f875806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:41.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.537+0000 7f877c9ff700 1 --2- 172.21.15.84:0/267141967 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f875806ace0 0x7f875806d190 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8768000c00 tx=0x7f8768007000 comp rx=0 tx=0).stop 2023-07-14T11:14:41.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.537+0000 7f877c9ff700 1 -- 172.21.15.84:0/267141967 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f87781e6600 msgr2=0x7f87781504a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:41.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.537+0000 7f877c9ff700 1 --2- 172.21.15.84:0/267141967 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f87781e6600 0x7f87781504a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f876c0115d0 tx=0x7f876c0118e0 comp rx=0 tx=0).stop 2023-07-14T11:14:41.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.537+0000 7f877c9ff700 1 -- 172.21.15.84:0/267141967 shutdown_connections 2023-07-14T11:14:41.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.537+0000 7f877c9ff700 1 --2- 172.21.15.84:0/267141967 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f875806ace0 0x7f875806d190 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:41.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.537+0000 7f877c9ff700 1 --2- 172.21.15.84:0/267141967 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87781509e0 0x7f8778152fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:41.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.537+0000 7f877c9ff700 1 --2- 172.21.15.84:0/267141967 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8760003a00 0x7f8778147b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:41.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.537+0000 7f877c9ff700 1 --2- 172.21.15.84:0/267141967 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f87781e6600 0x7f87781504a0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:41.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.537+0000 7f877c9ff700 1 -- 172.21.15.84:0/267141967 >> 172.21.15.84:0/267141967 conn(0x7f8778069f30 msgr2=0x7f87780cc090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:41.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.537+0000 7f877c9ff700 1 -- 172.21.15.84:0/267141967 shutdown_connections 2023-07-14T11:14:41.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:41.537+0000 7f877c9ff700 1 -- 172.21.15.84:0/267141967 wait complete. 2023-07-14T11:14:41.557 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-14T11:14:41.558 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-14T11:14:41.558 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi179.front.sepia.ceph.com 2023-07-14T11:14:41.558 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-07-14T11:14:41.558 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-14T11:14:41.559 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-14T11:14:41.559 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-14T11:14:41.559 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-14T11:14:41.559 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-14T11:14:41.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:14:41.560 DEBUG:teuthology.orchestra.run.smithi179:> ip addr 2023-07-14T11:14:41.612 INFO:teuthology.orchestra.run.smithi179.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-14T11:14:41.612 INFO:teuthology.orchestra.run.smithi179.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-14T11:14:41.612 INFO:teuthology.orchestra.run.smithi179.stdout: inet 127.0.0.1/8 scope host lo 2023-07-14T11:14:41.613 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:14:41.613 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 ::1/128 scope host 2023-07-14T11:14:41.613 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:14:41.613 INFO:teuthology.orchestra.run.smithi179.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T11:14:41.613 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:34 brd ff:ff:ff:ff:ff:ff 2023-07-14T11:14:41.613 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f0 2023-07-14T11:14:41.614 INFO:teuthology.orchestra.run.smithi179.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T11:14:41.614 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:35 brd ff:ff:ff:ff:ff:ff 2023-07-14T11:14:41.614 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f1 2023-07-14T11:14:41.614 INFO:teuthology.orchestra.run.smithi179.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T11:14:41.614 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5a brd ff:ff:ff:ff:ff:ff 2023-07-14T11:14:41.614 INFO:teuthology.orchestra.run.smithi179.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-14T11:14:41.614 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5b brd ff:ff:ff:ff:ff:ff 2023-07-14T11:14:41.615 INFO:teuthology.orchestra.run.smithi179.stdout: inet 172.21.15.179/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-14T11:14:41.615 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft 41774sec preferred_lft 41774sec 2023-07-14T11:14:41.615 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::ec4:7aff:fe88:725b/64 scope link 2023-07-14T11:14:41.615 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:14:41.615 INFO:teuthology.orchestra.run.smithi179.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-14T11:14:41.615 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 46:75:18:db:4e:84 brd ff:ff:ff:ff:ff:ff 2023-07-14T11:14:41.615 INFO:teuthology.orchestra.run.smithi179.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-14T11:14:41.616 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:14:41.616 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::fc06:a1ff:feba:ddf1/64 scope link 2023-07-14T11:14:41.616 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:14:41.616 INFO:teuthology.orchestra.run.smithi179.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-14T11:14:41.616 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 92:db:40:bf:aa:be brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-14T11:14:41.616 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::90db:40ff:febf:aabe/64 scope link 2023-07-14T11:14:41.616 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:14:41.617 INFO:teuthology.orchestra.run.smithi179.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-14T11:14:41.617 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 46:75:18:db:4e:84 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-07-14T11:14:41.617 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::4475:18ff:fedb:4e84/64 scope link 2023-07-14T11:14:41.617 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:14:41.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:14:41.618 DEBUG:teuthology.orchestra.run.smithi179:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-14T11:14:41.688 INFO:teuthology.orchestra.run.smithi179.stdout:1 2023-07-14T11:14:41.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:14:41.692 DEBUG:teuthology.orchestra.run.smithi179:> route 2023-07-14T11:14:41.740 INFO:teuthology.orchestra.run.smithi179.stdout:Kernel IP routing table 2023-07-14T11:14:41.740 INFO:teuthology.orchestra.run.smithi179.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-14T11:14:41.741 INFO:teuthology.orchestra.run.smithi179.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-14T11:14:41.741 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-14T11:14:41.741 INFO:teuthology.orchestra.run.smithi179.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-14T11:14:41.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:14:41.742 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2023-07-14T11:14:41.742 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2023-07-14T11:14:41.743 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-14T11:14:41.743 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-14T11:14:41.743 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-14T11:14:41.744 DEBUG:teuthology.orchestra.run.smithi179:> ') 2023-07-14T11:14:41.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:14:41.913 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2023-07-14T11:14:41.959 INFO:teuthology.orchestra.run.smithi179.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-07-14T11:14:41.959 INFO:teuthology.orchestra.run.smithi179.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-14T11:14:41.961 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-14T11:14:41.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:14:41.962 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link set brx.0 up 2023-07-14T11:14:42.071 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T11:14:42.071 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-07-14T11:14:42.117 INFO:teuthology.orchestra.run.smithi179.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-07-14T11:14:42.117 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T11:14:42.118 DEBUG:teuthology.orchestra.run.smithi179:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-07-14T11:14:42.204 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-07-14T11:14:42.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:14:42.205 DEBUG:teuthology.orchestra.run.smithi179:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-14T11:14:42.348 INFO:teuthology.orchestra.run.smithi179.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-14T11:14:42.349 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-14T11:14:42.376 INFO:teuthology.orchestra.run.smithi179.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-14T11:14:42.376 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-14T11:14:42.376 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-07-14T11:14:42.377 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: trying mount with new device syntax: 1@3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f.cephfs=/ 2023-07-14T11:14:42.377 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.84:3300/172.21.15.179:3300/172.21.15.179:3301" will pass to kernel 2023-07-14T11:14:42.380 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-14T11:14:42.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:14:42.381 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-07-14T11:14:42.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:14:42.452 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-14T11:14:42.539 INFO:teuthology.orchestra.run.smithi179.stdout:client5191 2023-07-14T11:14:42.539 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-07-14T11:14:42.540 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:14:42.585 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-07-14T11:14:42.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:42.788+0000 7fb23fdff700 1 Processor -- start 2023-07-14T11:14:42.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:42.788+0000 7fb23fdff700 1 -- start start 2023-07-14T11:14:42.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:42.789+0000 7fb23fdff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2380d1160 0x7fb2380cd4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:42.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:42.789+0000 7fb23fdff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb2380b2440 0x7fb2380cda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:42.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:42.789+0000 7fb23fdff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb23815cc60 con 0x7fb23815c890 2023-07-14T11:14:42.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:42.789+0000 7fb23fdff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb23806a7f0 con 0x7fb2380b2440 2023-07-14T11:14:42.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:42.789+0000 7fb23fdff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb23806b760 con 0x7fb2380d1160 2023-07-14T11:14:42.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:42.790+0000 7fb23e39c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb2380b2440 0x7fb2380cda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:42.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:42.790+0000 7fb23e39c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb2380b2440 0x7fb2380cda10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.84:53018/0 (socket says 172.21.15.84:53018) 2023-07-14T11:14:42.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:42.790+0000 7fb23d39a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2380d1160 0x7fb2380cd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:42.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:42.790+0000 7fb23e39c700 1 -- 172.21.15.84:0/2551736661 learned_addr learned my addr 172.21.15.84:0/2551736661 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:42.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:42.790+0000 7fb23e39c700 1 -- 172.21.15.84:0/2551736661 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2380d1160 msgr2=0x7fb2380cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:42.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:42.790+0000 7fb23e39c700 1 --2- 172.21.15.84:0/2551736661 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2380d1160 0x7fb2380cd4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:42.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:42.790+0000 7fb23e39c700 1 -- 172.21.15.84:0/2551736661 >> v1:172.21.15.179:6789/0 conn(0x7fb23815c890 legacy=0x7fb2380d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:42.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:42.790+0000 7fb23e39c700 1 -- 172.21.15.84:0/2551736661 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb23806ba40 con 0x7fb2380b2440 2023-07-14T11:14:42.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:42.790+0000 7fb23e39c700 1 --2- 172.21.15.84:0/2551736661 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb2380b2440 0x7fb2380cda10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb230009e50 tx=0x7fb23000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7009fb1b7e63639e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:42.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:42.790+0000 7fb23cb99700 1 -- 172.21.15.84:0/2551736661 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb23000e070 con 0x7fb2380b2440 2023-07-14T11:14:42.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:42.791+0000 7fb23cb99700 1 -- 172.21.15.84:0/2551736661 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb23000b910 con 0x7fb2380b2440 2023-07-14T11:14:42.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:42.791+0000 7fb23cb99700 1 -- 172.21.15.84:0/2551736661 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb23000bcc0 con 0x7fb2380b2440 2023-07-14T11:14:42.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:42.791+0000 7fb23fdff700 1 -- 172.21.15.84:0/2551736661 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb2380b2440 msgr2=0x7fb2380cda10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:42.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:42.791+0000 7fb23fdff700 1 --2- 172.21.15.84:0/2551736661 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb2380b2440 0x7fb2380cda10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb230009e50 tx=0x7fb23000b330 comp rx=0 tx=0).stop 2023-07-14T11:14:42.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:42.791+0000 7fb23fdff700 1 -- 172.21.15.84:0/2551736661 shutdown_connections 2023-07-14T11:14:42.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:42.791+0000 7fb23fdff700 1 --2- 172.21.15.84:0/2551736661 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb2380b2440 0x7fb2380cda10 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:42.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:42.791+0000 7fb23fdff700 1 --2- 172.21.15.84:0/2551736661 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2380d1160 0x7fb2380cd4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:42.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:42.791+0000 7fb23fdff700 1 -- 172.21.15.84:0/2551736661 >> 172.21.15.84:0/2551736661 conn(0x7fb23809c170 msgr2=0x7fb2380d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:42.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:42.791+0000 7fb23fdff700 1 -- 172.21.15.84:0/2551736661 shutdown_connections 2023-07-14T11:14:42.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:42.791+0000 7fb23fdff700 1 -- 172.21.15.84:0/2551736661 wait complete. 2023-07-14T11:14:42.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:42.793+0000 7fb23fdff700 1 Processor -- start 2023-07-14T11:14:42.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:42.793+0000 7fb23fdff700 1 -- start start 2023-07-14T11:14:42.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:42.794+0000 7fb23fdff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2380b2440 0x7fb23814cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:42.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:42.794+0000 7fb23fdff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb2380d1160 0x7fb2380b5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:42.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:42.794+0000 7fb23fdff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb23815c890 0x7fb2380b7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:42.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:42.794+0000 7fb23fdff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb23814d4d0 con 0x7fb2380b2440 2023-07-14T11:14:42.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:42.794+0000 7fb23fdff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2380b6620 con 0x7fb2380d1160 2023-07-14T11:14:42.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:42.794+0000 7fb23fdff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2380b6900 con 0x7fb23815c890 2023-07-14T11:14:42.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:42.794+0000 7fb23db9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2380b2440 0x7fb23814cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:42.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:42.794+0000 7fb23db9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2380b2440 0x7fb23814cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53792/0 (socket says 172.21.15.84:53792) 2023-07-14T11:14:42.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:42.794+0000 7fb23db9b700 1 -- 172.21.15.84:0/817273521 learned_addr learned my addr 172.21.15.84:0/817273521 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:42.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:42.794+0000 7fb23d39a700 1 --2- 172.21.15.84:0/817273521 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb2380d1160 0x7fb2380b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:42.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:42.794+0000 7fb23e39c700 1 --2- 172.21.15.84:0/817273521 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb23815c890 0x7fb2380b7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:42.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:42.795+0000 7fb23db9b700 1 -- 172.21.15.84:0/817273521 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb23815c890 msgr2=0x7fb2380b7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:42.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:42.795+0000 7fb23db9b700 1 --2- 172.21.15.84:0/817273521 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb23815c890 0x7fb2380b7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:42.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:42.795+0000 7fb23db9b700 1 -- 172.21.15.84:0/817273521 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb2380d1160 msgr2=0x7fb2380b5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:42.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:42.795+0000 7fb23db9b700 1 --2- 172.21.15.84:0/817273521 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb2380d1160 0x7fb2380b5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:42.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:42.795+0000 7fb23db9b700 1 -- 172.21.15.84:0/817273521 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb230009b30 con 0x7fb2380b2440 2023-07-14T11:14:42.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:42.795+0000 7fb23d39a700 1 --2- 172.21.15.84:0/817273521 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb2380d1160 0x7fb2380b5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:14:42.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:42.795+0000 7fb23db9b700 1 --2- 172.21.15.84:0/817273521 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2380b2440 0x7fb23814cf90 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fb23400c450 tx=0x7fb23400c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:42.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:42.795+0000 7fb22e7fc700 1 -- 172.21.15.84:0/817273521 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2340052d0 con 0x7fb2380b2440 2023-07-14T11:14:42.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:42.795+0000 7fb22e7fc700 1 -- 172.21.15.84:0/817273521 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb234005430 con 0x7fb2380b2440 2023-07-14T11:14:42.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:42.795+0000 7fb22e7fc700 1 -- 172.21.15.84:0/817273521 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2340038c0 con 0x7fb2380b2440 2023-07-14T11:14:42.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:42.795+0000 7fb23fdff700 1 -- 172.21.15.84:0/817273521 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2380b6be0 con 0x7fb2380b2440 2023-07-14T11:14:42.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:42.795+0000 7fb23fdff700 1 -- 172.21.15.84:0/817273521 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2380b71a0 con 0x7fb2380b2440 2023-07-14T11:14:42.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:42.797+0000 7fb23fdff700 1 -- 172.21.15.84:0/817273521 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2380b7360 con 0x7fb2380b2440 2023-07-14T11:14:42.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:42.797+0000 7fb22e7fc700 1 -- 172.21.15.84:0/817273521 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb234003a20 con 0x7fb2380b2440 2023-07-14T11:14:42.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:42.798+0000 7fb22e7fc700 1 --2- 172.21.15.84:0/817273521 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fb21c06ad10 0x7fb21c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:42.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:42.798+0000 7fb22e7fc700 1 -- 172.21.15.84:0/817273521 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb234088810 con 0x7fb2380b2440 2023-07-14T11:14:42.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:42.799+0000 7fb23d39a700 1 --2- 172.21.15.84:0/817273521 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fb21c06ad10 0x7fb21c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:42.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:42.799+0000 7fb23d39a700 1 --2- 172.21.15.84:0/817273521 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fb21c06ad10 0x7fb21c06d1c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb238157ae0 tx=0x7fb228009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:42.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:42.803+0000 7fb22e7fc700 1 -- 172.21.15.84:0/817273521 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fb234053830 con 0x7fb2380b2440 2023-07-14T11:14:43.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:43.043+0000 7fb23fdff700 1 -- 172.21.15.84:0/817273521 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb238074350 con 0x7fb2380b2440 2023-07-14T11:14:43.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:43.768+0000 7fb22e7fc700 1 -- 172.21.15.84:0/817273521 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v19) v1 ==== 136+0+0 (secure 0 0 0) 0x7fb23400ce60 con 0x7fb2380b2440 2023-07-14T11:14:43.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:43.772+0000 7fb23fdff700 1 -- 172.21.15.84:0/817273521 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fb21c06ad10 msgr2=0x7fb21c06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:43.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:43.772+0000 7fb23fdff700 1 --2- 172.21.15.84:0/817273521 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fb21c06ad10 0x7fb21c06d1c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb238157ae0 tx=0x7fb228009210 comp rx=0 tx=0).stop 2023-07-14T11:14:43.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:43.772+0000 7fb23fdff700 1 -- 172.21.15.84:0/817273521 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2380b2440 msgr2=0x7fb23814cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:43.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:43.772+0000 7fb23fdff700 1 --2- 172.21.15.84:0/817273521 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2380b2440 0x7fb23814cf90 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fb23400c450 tx=0x7fb23400c760 comp rx=0 tx=0).stop 2023-07-14T11:14:43.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:43.772+0000 7fb23fdff700 1 -- 172.21.15.84:0/817273521 shutdown_connections 2023-07-14T11:14:43.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:43.772+0000 7fb23fdff700 1 --2- 172.21.15.84:0/817273521 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fb21c06ad10 0x7fb21c06d1c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:43.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:43.772+0000 7fb23fdff700 1 --2- 172.21.15.84:0/817273521 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb23815c890 0x7fb2380b7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:43.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:43.772+0000 7fb23fdff700 1 --2- 172.21.15.84:0/817273521 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2380b2440 0x7fb23814cf90 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:43.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:43.772+0000 7fb23fdff700 1 --2- 172.21.15.84:0/817273521 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb2380d1160 0x7fb2380b5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:43.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:43.772+0000 7fb23fdff700 1 -- 172.21.15.84:0/817273521 >> 172.21.15.84:0/817273521 conn(0x7fb23809c170 msgr2=0x7fb23815b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:43.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:43.772+0000 7fb23fdff700 1 -- 172.21.15.84:0/817273521 shutdown_connections 2023-07-14T11:14:43.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:43.772+0000 7fb23fdff700 1 -- 172.21.15.84:0/817273521 wait complete. 2023-07-14T11:14:43.795 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-07-14T11:14:43.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:43.993+0000 7f83331ff700 1 Processor -- start 2023-07-14T11:14:43.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:43.993+0000 7f83331ff700 1 -- start start 2023-07-14T11:14:43.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:43.994+0000 7f83331ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f832c0b8660 0x7f832c0cd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:43.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:43.994+0000 7f83331ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f832c0d02a0 con 0x7f832c0b4f70 2023-07-14T11:14:43.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:43.994+0000 7f83331ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f832c0cfce0 con 0x7f832c0cd970 2023-07-14T11:14:43.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:43.994+0000 7f83331ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f832c0cffc0 con 0x7f832c0b8660 2023-07-14T11:14:43.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:43.994+0000 7f833179c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f832c0b4f70 0x7f832c0d12c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51230/0 (socket says 172.21.15.84:51230) 2023-07-14T11:14:43.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:43.994+0000 7f833179c700 1 -- 172.21.15.84:0/3056244046 learned_addr learned my addr 172.21.15.84:0/3056244046 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:14:43.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:43.995+0000 7f8330f9b700 1 --2- 172.21.15.84:0/3056244046 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f832c0b8660 0x7f832c0cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:43.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:43.995+0000 7f832b7fe700 1 -- 172.21.15.84:0/3056244046 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 45335715 0 0) 0x7f832c0d02a0 con 0x7f832c0b4f70 2023-07-14T11:14:43.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:43.995+0000 7f832b7fe700 1 -- 172.21.15.84:0/3056244046 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f831c0035b0 con 0x7f832c0b4f70 2023-07-14T11:14:43.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:43.995+0000 7f832b7fe700 1 -- 172.21.15.84:0/3056244046 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 848595423 0 0) 0x7f831c0035b0 con 0x7f832c0b4f70 2023-07-14T11:14:44.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:43.995+0000 7f832b7fe700 1 -- 172.21.15.84:0/3056244046 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f832c0b8660 msgr2=0x7f832c0cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:44.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:43.995+0000 7f832b7fe700 1 --2- 172.21.15.84:0/3056244046 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f832c0b8660 0x7f832c0cd430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:44.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:43.995+0000 7f832b7fe700 1 -- 172.21.15.84:0/3056244046 >> v1:172.21.15.179:6789/0 conn(0x7f832c0cd970 legacy=0x7f832c0b4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:44.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:43.995+0000 7f832b7fe700 1 -- 172.21.15.84:0/3056244046 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f832c0d0ac0 con 0x7f832c0b4f70 2023-07-14T11:14:44.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:43.995+0000 7f832b7fe700 1 -- 172.21.15.84:0/3056244046 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7f83240019f0 con 0x7f832c0b4f70 2023-07-14T11:14:44.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:43.995+0000 7f832b7fe700 1 -- 172.21.15.84:0/3056244046 >> v1:172.21.15.84:6789/0 conn(0x7f832c0b4f70 legacy=0x7f832c0d12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:44.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:43.995+0000 7f832b7fe700 1 --2- 172.21.15.84:0/3056244046 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f832c0b8660 0x7f831c003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:44.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:43.995+0000 7f832b7fe700 1 --2- 172.21.15.84:0/3056244046 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f831c003f70 0x7f831c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:44.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:43.995+0000 7f832b7fe700 1 --2- 172.21.15.84:0/3056244046 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f831c004d90 0x7f831c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:44.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:43.995+0000 7f832b7fe700 1 -- 172.21.15.84:0/3056244046 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f832c0cffc0 con 0x7f831c003f70 2023-07-14T11:14:44.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:43.995+0000 7f832b7fe700 1 -- 172.21.15.84:0/3056244046 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f831c00ba40 con 0x7f831c004d90 2023-07-14T11:14:44.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:43.995+0000 7f832b7fe700 1 -- 172.21.15.84:0/3056244046 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f831c00bc00 con 0x7f832c0b8660 2023-07-14T11:14:44.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:43.996+0000 7f832bfff700 1 --2- 172.21.15.84:0/3056244046 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f831c003f70 0x7f831c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:44.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:43.996+0000 7f8330f9b700 1 --2- 172.21.15.84:0/3056244046 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f832c0b8660 0x7f831c003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:44.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:43.996+0000 7f833179c700 1 --2- 172.21.15.84:0/3056244046 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f831c004d90 0x7f831c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:44.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:43.996+0000 7f832bfff700 1 -- 172.21.15.84:0/3056244046 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f832c0b8660 msgr2=0x7f831c003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:44.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:43.996+0000 7f832bfff700 1 --2- 172.21.15.84:0/3056244046 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f832c0b8660 0x7f831c003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:44.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:43.996+0000 7f832bfff700 1 -- 172.21.15.84:0/3056244046 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f831c004d90 msgr2=0x7f831c005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:44.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:43.996+0000 7f832bfff700 1 --2- 172.21.15.84:0/3056244046 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f831c004d90 0x7f831c005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:44.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:43.996+0000 7f832bfff700 1 -- 172.21.15.84:0/3056244046 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f831c0035b0 con 0x7f831c003f70 2023-07-14T11:14:44.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:43.996+0000 7f832bfff700 1 --2- 172.21.15.84:0/3056244046 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f831c003f70 0x7f831c004850 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f832c0cdd80 tx=0x7f831c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f15bb46531d59de7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:44.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:43.996+0000 7f832b7fe700 1 -- 172.21.15.84:0/3056244046 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831800c660 con 0x7f831c003f70 2023-07-14T11:14:44.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:43.996+0000 7f832b7fe700 1 -- 172.21.15.84:0/3056244046 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f831800c7c0 con 0x7f831c003f70 2023-07-14T11:14:44.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:43.996+0000 7f832b7fe700 1 -- 172.21.15.84:0/3056244046 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831800cb70 con 0x7f831c003f70 2023-07-14T11:14:44.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:43.997+0000 7f83331ff700 1 -- 172.21.15.84:0/3056244046 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f831c003f70 msgr2=0x7f831c004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:44.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:43.997+0000 7f83331ff700 1 --2- 172.21.15.84:0/3056244046 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f831c003f70 0x7f831c004850 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f832c0cdd80 tx=0x7f831c005880 comp rx=0 tx=0).stop 2023-07-14T11:14:44.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:43.997+0000 7f833179c700 1 -- 172.21.15.84:0/3056244046 reap_dead start 2023-07-14T11:14:44.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:43.997+0000 7f83331ff700 1 -- 172.21.15.84:0/3056244046 shutdown_connections 2023-07-14T11:14:44.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:43.997+0000 7f83331ff700 1 -- 172.21.15.84:0/3056244046 >> 172.21.15.84:0/3056244046 conn(0x7f832c066860 msgr2=0x7f832c06a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:44.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:43.997+0000 7f83331ff700 1 -- 172.21.15.84:0/3056244046 shutdown_connections 2023-07-14T11:14:44.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:43.997+0000 7f83331ff700 1 -- 172.21.15.84:0/3056244046 wait complete. 2023-07-14T11:14:44.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:43.999+0000 7f83331ff700 1 Processor -- start 2023-07-14T11:14:44.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:43.999+0000 7f83331ff700 1 -- start start 2023-07-14T11:14:44.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.000+0000 7f83331ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f831c003f70 0x7f832c14ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:44.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.000+0000 7f83331ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f832c14c7d0 0x7f832c14cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:44.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.000+0000 7f83331ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f832c14d4c0 0x7f832c14d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:44.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.000+0000 7f83331ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f832c158110 con 0x7f832c14d4c0 2023-07-14T11:14:44.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.000+0000 7f83331ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f832c157500 con 0x7f832c14c7d0 2023-07-14T11:14:44.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.000+0000 7f83331ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f832c1577e0 con 0x7f831c003f70 2023-07-14T11:14:44.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.000+0000 7f833179c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f832c14d4c0 0x7f832c14d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:44.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.000+0000 7f833179c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f832c14d4c0 0x7f832c14d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53802/0 (socket says 172.21.15.84:53802) 2023-07-14T11:14:44.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.000+0000 7f833179c700 1 -- 172.21.15.84:0/1106898909 learned_addr learned my addr 172.21.15.84:0/1106898909 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:44.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.000+0000 7f832bfff700 1 --2- 172.21.15.84:0/1106898909 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f832c14c7d0 0x7f832c14cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:44.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.000+0000 7f8330f9b700 1 --2- 172.21.15.84:0/1106898909 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f831c003f70 0x7f832c14ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:44.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.001+0000 7f833179c700 1 -- 172.21.15.84:0/1106898909 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f831c003f70 msgr2=0x7f832c14ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:44.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.001+0000 7f833179c700 1 --2- 172.21.15.84:0/1106898909 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f831c003f70 0x7f832c14ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:44.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.001+0000 7f833179c700 1 -- 172.21.15.84:0/1106898909 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f832c14c7d0 msgr2=0x7f832c14cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:44.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.001+0000 7f833179c700 1 --2- 172.21.15.84:0/1106898909 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f832c14c7d0 0x7f832c14cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:44.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.001+0000 7f833179c700 1 -- 172.21.15.84:0/1106898909 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f832c157ac0 con 0x7f832c14d4c0 2023-07-14T11:14:44.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.001+0000 7f833179c700 1 --2- 172.21.15.84:0/1106898909 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f832c14d4c0 0x7f832c14d930 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f832c0b5970 tx=0x7f832400a600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:44.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.001+0000 7f83297fa700 1 -- 172.21.15.84:0/1106898909 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f832400adb0 con 0x7f832c14d4c0 2023-07-14T11:14:44.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.001+0000 7f83297fa700 1 -- 172.21.15.84:0/1106898909 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83240133f0 con 0x7f832c14d4c0 2023-07-14T11:14:44.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.001+0000 7f83297fa700 1 -- 172.21.15.84:0/1106898909 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83240137a0 con 0x7f832c14d4c0 2023-07-14T11:14:44.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.001+0000 7f83331ff700 1 -- 172.21.15.84:0/1106898909 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f832c157da0 con 0x7f832c14d4c0 2023-07-14T11:14:44.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.001+0000 7f83331ff700 1 -- 172.21.15.84:0/1106898909 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f832c1588d0 con 0x7f832c14d4c0 2023-07-14T11:14:44.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.002+0000 7f83331ff700 1 -- 172.21.15.84:0/1106898909 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f832c158280 con 0x7f832c14d4c0 2023-07-14T11:14:44.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.003+0000 7f83297fa700 1 -- 172.21.15.84:0/1106898909 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8324013900 con 0x7f832c14d4c0 2023-07-14T11:14:44.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.004+0000 7f83297fa700 1 --2- 172.21.15.84:0/1106898909 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f831006ace0 0x7f831006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:44.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.004+0000 7f83297fa700 1 -- 172.21.15.84:0/1106898909 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8324089de0 con 0x7f832c14d4c0 2023-07-14T11:14:44.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.004+0000 7f8330f9b700 1 --2- 172.21.15.84:0/1106898909 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f831006ace0 0x7f831006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:44.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.005+0000 7f8330f9b700 1 --2- 172.21.15.84:0/1106898909 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f831006ace0 0x7f831006d190 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8320009ba0 tx=0x7f8320008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:44.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.008+0000 7f83297fa700 1 -- 172.21.15.84:0/1106898909 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f8324054e00 con 0x7f832c14d4c0 2023-07-14T11:14:44.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.233+0000 7f83331ff700 1 -- 172.21.15.84:0/1106898909 --> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f832c0d0da0 con 0x7f831006ace0 2023-07-14T11:14:44.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.235+0000 7f83297fa700 1 -- 172.21.15.84:0/1106898909 <== mgr.4104 v2:172.21.15.84:6832/379617029 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f83200097f0 con 0x7f831006ace0 2023-07-14T11:14:44.237 INFO:teuthology.orchestra.run.smithi084.stdout:[ 2023-07-14T11:14:44.237 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:14:44.237 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "cephfs" 2023-07-14T11:14:44.237 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:14:44.238 INFO:teuthology.orchestra.run.smithi084.stdout:] 2023-07-14T11:14:44.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.237+0000 7f83331ff700 1 -- 172.21.15.84:0/1106898909 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f831006ace0 msgr2=0x7f831006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:44.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.237+0000 7f83331ff700 1 --2- 172.21.15.84:0/1106898909 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f831006ace0 0x7f831006d190 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8320009ba0 tx=0x7f8320008040 comp rx=0 tx=0).stop 2023-07-14T11:14:44.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.237+0000 7f83331ff700 1 -- 172.21.15.84:0/1106898909 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f832c14d4c0 msgr2=0x7f832c14d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:44.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.237+0000 7f83331ff700 1 --2- 172.21.15.84:0/1106898909 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f832c14d4c0 0x7f832c14d930 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f832c0b5970 tx=0x7f832400a600 comp rx=0 tx=0).stop 2023-07-14T11:14:44.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.237+0000 7f83331ff700 1 -- 172.21.15.84:0/1106898909 shutdown_connections 2023-07-14T11:14:44.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.237+0000 7f83331ff700 1 --2- 172.21.15.84:0/1106898909 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f831006ace0 0x7f831006d190 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:44.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.237+0000 7f83331ff700 1 --2- 172.21.15.84:0/1106898909 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f831c003f70 0x7f832c14ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:44.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.237+0000 7f83331ff700 1 --2- 172.21.15.84:0/1106898909 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f832c14d4c0 0x7f832c14d930 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:44.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.237+0000 7f83331ff700 1 --2- 172.21.15.84:0/1106898909 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f832c14c7d0 0x7f832c14cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:44.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.237+0000 7f83331ff700 1 -- 172.21.15.84:0/1106898909 >> 172.21.15.84:0/1106898909 conn(0x7f832c066860 msgr2=0x7f832c155c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:44.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.237+0000 7f83331ff700 1 -- 172.21.15.84:0/1106898909 shutdown_connections 2023-07-14T11:14:44.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.237+0000 7f83331ff700 1 -- 172.21.15.84:0/1106898909 wait complete. 2023-07-14T11:14:44.257 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-14T11:14:44.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.453+0000 7fa6445ff700 1 Processor -- start 2023-07-14T11:14:44.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.453+0000 7fa6445ff700 1 -- start start 2023-07-14T11:14:44.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.454+0000 7fa6445ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa63c0cbe40 0x7fa63c0cda40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:44.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.454+0000 7fa6445ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa63c0cdf80 0x7fa63c06ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:44.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.455+0000 7fa6445ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa63c0ce8c0 con 0x7fa63c158bb0 2023-07-14T11:14:44.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.455+0000 7fa6445ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa63c06b5b0 con 0x7fa63c0cdf80 2023-07-14T11:14:44.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.455+0000 7fa6445ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa63c0ce400 con 0x7fa63c0cbe40 2023-07-14T11:14:44.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.455+0000 7fa642b9c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa63c0cdf80 0x7fa63c06ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:44.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.455+0000 7fa641b9a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa63c0cbe40 0x7fa63c0cda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:44.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.455+0000 7fa642b9c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa63c0cdf80 0x7fa63c06ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.84:53066/0 (socket says 172.21.15.84:53066) 2023-07-14T11:14:44.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.455+0000 7fa642b9c700 1 -- 172.21.15.84:0/3047985071 learned_addr learned my addr 172.21.15.84:0/3047985071 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:44.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.455+0000 7fa64239b700 1 --1- 172.21.15.84:0/3047985071 >> v1:172.21.15.179:6789/0 conn(0x7fa63c158bb0 0x7fa63c0cd0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.84:43162/0 (socket says 172.21.15.84:43162) 2023-07-14T11:14:44.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.456+0000 7fa641b9a700 1 -- 172.21.15.84:0/3047985071 >> v2:172.21.15.179:3300/0 conn(0x7fa63c0cdf80 msgr2=0x7fa63c06ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:44.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.456+0000 7fa641b9a700 1 --2- 172.21.15.84:0/3047985071 >> v2:172.21.15.179:3300/0 conn(0x7fa63c0cdf80 0x7fa63c06ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:44.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.456+0000 7fa641b9a700 1 -- 172.21.15.84:0/3047985071 >> v1:172.21.15.179:6789/0 conn(0x7fa63c158bb0 legacy=0x7fa63c0cd0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:44.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.456+0000 7fa641b9a700 1 -- 172.21.15.84:0/3047985071 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa63c0cc2b0 con 0x7fa63c0cbe40 2023-07-14T11:14:44.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.456+0000 7fa641b9a700 1 --2- 172.21.15.84:0/3047985071 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa63c0cbe40 0x7fa63c0cda40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa62c00bae0 tx=0x7fa62c00bdf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2af82d136aceb183 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:44.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.456+0000 7fa641399700 1 -- 172.21.15.84:0/3047985071 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa62c00db60 con 0x7fa63c0cbe40 2023-07-14T11:14:44.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.456+0000 7fa641399700 1 -- 172.21.15.84:0/3047985071 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa62c00dcc0 con 0x7fa63c0cbe40 2023-07-14T11:14:44.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.456+0000 7fa641399700 1 -- 172.21.15.84:0/3047985071 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa62c017630 con 0x7fa63c0cbe40 2023-07-14T11:14:44.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.457+0000 7fa6445ff700 1 -- 172.21.15.84:0/3047985071 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa63c0cbe40 msgr2=0x7fa63c0cda40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:44.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.457+0000 7fa6445ff700 1 --2- 172.21.15.84:0/3047985071 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa63c0cbe40 0x7fa63c0cda40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa62c00bae0 tx=0x7fa62c00bdf0 comp rx=0 tx=0).stop 2023-07-14T11:14:44.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.457+0000 7fa6445ff700 1 -- 172.21.15.84:0/3047985071 shutdown_connections 2023-07-14T11:14:44.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.457+0000 7fa6445ff700 1 --2- 172.21.15.84:0/3047985071 >> v2:172.21.15.179:3300/0 conn(0x7fa63c0cdf80 0x7fa63c06ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:44.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.457+0000 7fa6445ff700 1 --2- 172.21.15.84:0/3047985071 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa63c0cbe40 0x7fa63c0cda40 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:44.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.457+0000 7fa6445ff700 1 -- 172.21.15.84:0/3047985071 >> 172.21.15.84:0/3047985071 conn(0x7fa63c0b05d0 msgr2=0x7fa63c0b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:44.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.457+0000 7fa6445ff700 1 -- 172.21.15.84:0/3047985071 shutdown_connections 2023-07-14T11:14:44.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.457+0000 7fa6445ff700 1 -- 172.21.15.84:0/3047985071 wait complete. 2023-07-14T11:14:44.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.458+0000 7fa6445ff700 1 Processor -- start 2023-07-14T11:14:44.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.459+0000 7fa6445ff700 1 -- start start 2023-07-14T11:14:44.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.459+0000 7fa6445ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa63c0cbe40 0x7fa63c151910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:44.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.459+0000 7fa6445ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa63c0cdf80 0x7fa63c0c25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:44.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.460+0000 7fa6445ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa63c158bb0 0x7fa63c0ae0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:44.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.460+0000 7fa6445ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa63c0c3b70 con 0x7fa63c158bb0 2023-07-14T11:14:44.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.460+0000 7fa6445ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa63c0c3f90 con 0x7fa63c0cdf80 2023-07-14T11:14:44.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.460+0000 7fa6445ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa63c0c2ef0 con 0x7fa63c0cbe40 2023-07-14T11:14:44.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.460+0000 7fa642b9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa63c158bb0 0x7fa63c0ae0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:44.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.460+0000 7fa642b9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa63c158bb0 0x7fa63c0ae0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53806/0 (socket says 172.21.15.84:53806) 2023-07-14T11:14:44.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.460+0000 7fa642b9c700 1 -- 172.21.15.84:0/4206267423 learned_addr learned my addr 172.21.15.84:0/4206267423 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:44.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.460+0000 7fa64239b700 1 --2- 172.21.15.84:0/4206267423 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa63c0cbe40 0x7fa63c151910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:44.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.460+0000 7fa641b9a700 1 --2- 172.21.15.84:0/4206267423 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa63c0cdf80 0x7fa63c0c25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:44.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.460+0000 7fa642b9c700 1 -- 172.21.15.84:0/4206267423 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa63c0cbe40 msgr2=0x7fa63c151910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:44.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.460+0000 7fa642b9c700 1 --2- 172.21.15.84:0/4206267423 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa63c0cbe40 0x7fa63c151910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:44.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.460+0000 7fa642b9c700 1 -- 172.21.15.84:0/4206267423 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa63c0cdf80 msgr2=0x7fa63c0c25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:44.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.460+0000 7fa642b9c700 1 --2- 172.21.15.84:0/4206267423 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa63c0cdf80 0x7fa63c0c25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:44.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.460+0000 7fa642b9c700 1 -- 172.21.15.84:0/4206267423 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa62c00b740 con 0x7fa63c158bb0 2023-07-14T11:14:44.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.460+0000 7fa642b9c700 1 --2- 172.21.15.84:0/4206267423 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa63c158bb0 0x7fa63c0ae0f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fa63400efc0 tx=0x7fa63400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:44.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.461+0000 7fa632ffd700 1 -- 172.21.15.84:0/4206267423 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa634003c20 con 0x7fa63c158bb0 2023-07-14T11:14:44.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.461+0000 7fa632ffd700 1 -- 172.21.15.84:0/4206267423 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa63400f040 con 0x7fa63c158bb0 2023-07-14T11:14:44.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.461+0000 7fa632ffd700 1 -- 172.21.15.84:0/4206267423 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63400c930 con 0x7fa63c158bb0 2023-07-14T11:14:44.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.461+0000 7fa6445ff700 1 -- 172.21.15.84:0/4206267423 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa63c0c31d0 con 0x7fa63c158bb0 2023-07-14T11:14:44.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.461+0000 7fa6445ff700 1 -- 172.21.15.84:0/4206267423 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa63c0c3790 con 0x7fa63c158bb0 2023-07-14T11:14:44.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.462+0000 7fa6445ff700 1 -- 172.21.15.84:0/4206267423 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa63c0714e0 con 0x7fa63c158bb0 2023-07-14T11:14:44.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.463+0000 7fa632ffd700 1 -- 172.21.15.84:0/4206267423 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa63400ca90 con 0x7fa63c158bb0 2023-07-14T11:14:44.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.463+0000 7fa632ffd700 1 --2- 172.21.15.84:0/4206267423 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa62006ace0 0x7fa62006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:44.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.464+0000 7fa632ffd700 1 -- 172.21.15.84:0/4206267423 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa634089a90 con 0x7fa63c158bb0 2023-07-14T11:14:44.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.464+0000 7fa64239b700 1 --2- 172.21.15.84:0/4206267423 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa62006ace0 0x7fa62006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:44.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.464+0000 7fa64239b700 1 --2- 172.21.15.84:0/4206267423 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa62006ace0 0x7fa62006d190 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa638000f60 tx=0x7fa638007d10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:44.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.468+0000 7fa632ffd700 1 -- 172.21.15.84:0/4206267423 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fa63c0714e0 con 0x7fa63c158bb0 2023-07-14T11:14:44.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.662+0000 7fa6445ff700 1 -- 172.21.15.84:0/4206267423 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fa63c0c3cb0 con 0x7fa63c158bb0 2023-07-14T11:14:44.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.663+0000 7fa632ffd700 1 -- 172.21.15.84:0/4206267423 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa63c0c3cb0 con 0x7fa63c158bb0 2023-07-14T11:14:44.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.665+0000 7fa6445ff700 1 -- 172.21.15.84:0/4206267423 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa62006ace0 msgr2=0x7fa62006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:44.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.665+0000 7fa6445ff700 1 --2- 172.21.15.84:0/4206267423 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa62006ace0 0x7fa62006d190 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa638000f60 tx=0x7fa638007d10 comp rx=0 tx=0).stop 2023-07-14T11:14:44.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.665+0000 7fa6445ff700 1 -- 172.21.15.84:0/4206267423 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa63c158bb0 msgr2=0x7fa63c0ae0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:44.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.665+0000 7fa6445ff700 1 --2- 172.21.15.84:0/4206267423 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa63c158bb0 0x7fa63c0ae0f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fa63400efc0 tx=0x7fa63400c3a0 comp rx=0 tx=0).stop 2023-07-14T11:14:44.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.665+0000 7fa6445ff700 1 -- 172.21.15.84:0/4206267423 shutdown_connections 2023-07-14T11:14:44.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.665+0000 7fa6445ff700 1 --2- 172.21.15.84:0/4206267423 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa62006ace0 0x7fa62006d190 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:44.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.665+0000 7fa6445ff700 1 --2- 172.21.15.84:0/4206267423 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa63c0cbe40 0x7fa63c151910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:44.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.665+0000 7fa6445ff700 1 --2- 172.21.15.84:0/4206267423 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa63c158bb0 0x7fa63c0ae0f0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:44.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.665+0000 7fa6445ff700 1 --2- 172.21.15.84:0/4206267423 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa63c0cdf80 0x7fa63c0c25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:44.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.665+0000 7fa6445ff700 1 -- 172.21.15.84:0/4206267423 >> 172.21.15.84:0/4206267423 conn(0x7fa63c0b05d0 msgr2=0x7fa63c0b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:44.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.665+0000 7fa6445ff700 1 -- 172.21.15.84:0/4206267423 shutdown_connections 2023-07-14T11:14:44.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:44.665+0000 7fa6445ff700 1 -- 172.21.15.84:0/4206267423 wait complete. 2023-07-14T11:14:44.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:14:44.686 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p ./volumes/group_0000000000407260/subvolume_0000000000549219) 2023-07-14T11:14:44.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:14:44.766 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool .) 2023-07-14T11:14:44.814 INFO:teuthology.orchestra.run.smithi084.stdout:cephfs_data 2023-07-14T11:14:44.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:14:44.815 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo setfattr -n ceph.dir.layout.pool -v cephfs_data ./volumes/group_0000000000407260/subvolume_0000000000549219) 2023-07-14T11:14:44.904 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-14T11:14:44.905 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/home/ubuntu/cephtest/mnt.0/./volumes/group_0000000000407260/subvolume_0000000000549219/.meta 2023-07-14T11:14:44.980 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvolume_0000000000549219 group_0000000000407260 2023-07-14T11:14:45.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.218+0000 7f8ee35ff700 1 Processor -- start 2023-07-14T11:14:45.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.218+0000 7f8ee35ff700 1 -- start start 2023-07-14T11:14:45.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.219+0000 7f8ee35ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8edc0cba30 0x7f8edc06b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:45.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.219+0000 7f8ee35ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8edc06b580 0x7f8edc0cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:45.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.219+0000 7f8ee35ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8edc06b9d0 con 0x7f8edc0cc340 2023-07-14T11:14:45.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.219+0000 7f8ee35ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8edc0cd410 con 0x7f8edc06b580 2023-07-14T11:14:45.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.219+0000 7f8ee35ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8edc0cce50 con 0x7f8edc0cba30 2023-07-14T11:14:45.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.220+0000 7f8ee0b9a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8edc06b580 0x7f8edc0cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:45.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.220+0000 7f8ee1b9c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f8edc0cc340 0x7f8edc0cd5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51234/0 (socket says 172.21.15.84:51234) 2023-07-14T11:14:45.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.220+0000 7f8ee1b9c700 1 -- 172.21.15.84:0/1062595135 learned_addr learned my addr 172.21.15.84:0/1062595135 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:14:45.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.220+0000 7f8ee139b700 1 --2- 172.21.15.84:0/1062595135 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8edc0cba30 0x7f8edc06b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:45.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.220+0000 7f8ee0b9a700 1 -- 172.21.15.84:0/1062595135 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8edc0cba30 msgr2=0x7f8edc06b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:45.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.220+0000 7f8ee0b9a700 1 --2- 172.21.15.84:0/1062595135 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8edc0cba30 0x7f8edc06b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:45.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.220+0000 7f8ee0b9a700 1 -- 172.21.15.84:0/1062595135 >> v1:172.21.15.84:6789/0 conn(0x7f8edc0cc340 legacy=0x7f8edc0cd5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:45.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.220+0000 7f8ee0b9a700 1 -- 172.21.15.84:0/1062595135 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8edc0cd130 con 0x7f8edc06b580 2023-07-14T11:14:45.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.220+0000 7f8ed3fff700 1 -- 172.21.15.84:0/1062595135 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2913533923 0 0) 0x7f8ed4001490 con 0x7f8edc0cc340 2023-07-14T11:14:45.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.220+0000 7f8ee139b700 1 --2- 172.21.15.84:0/1062595135 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8edc0cba30 0x7f8edc06b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:14:45.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.220+0000 7f8ee0b9a700 1 --2- 172.21.15.84:0/1062595135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8edc06b580 0x7f8edc0cbe00 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc009840 tx=0x7f8ecc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=900ffb5b5240da44 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:45.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.221+0000 7f8ed3fff700 1 -- 172.21.15.84:0/1062595135 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ecc011830 con 0x7f8edc06b580 2023-07-14T11:14:45.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.221+0000 7f8ed3fff700 1 -- 172.21.15.84:0/1062595135 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ecc011990 con 0x7f8edc06b580 2023-07-14T11:14:45.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.221+0000 7f8ed3fff700 1 -- 172.21.15.84:0/1062595135 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ecc011d20 con 0x7f8edc06b580 2023-07-14T11:14:45.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.221+0000 7f8ee35ff700 1 -- 172.21.15.84:0/1062595135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8edc06b580 msgr2=0x7f8edc0cbe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:45.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.221+0000 7f8ee35ff700 1 --2- 172.21.15.84:0/1062595135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8edc06b580 0x7f8edc0cbe00 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc009840 tx=0x7f8ecc009b50 comp rx=0 tx=0).stop 2023-07-14T11:14:45.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.221+0000 7f8ee35ff700 1 -- 172.21.15.84:0/1062595135 shutdown_connections 2023-07-14T11:14:45.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.221+0000 7f8ee35ff700 1 --2- 172.21.15.84:0/1062595135 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8edc0cba30 0x7f8edc06b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:45.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.221+0000 7f8ee35ff700 1 --2- 172.21.15.84:0/1062595135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8edc06b580 0x7f8edc0cbe00 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:45.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.221+0000 7f8ee35ff700 1 -- 172.21.15.84:0/1062595135 >> 172.21.15.84:0/1062595135 conn(0x7f8edc099f40 msgr2=0x7f8edc0d0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:45.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.221+0000 7f8ee35ff700 1 -- 172.21.15.84:0/1062595135 shutdown_connections 2023-07-14T11:14:45.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.221+0000 7f8ee35ff700 1 -- 172.21.15.84:0/1062595135 wait complete. 2023-07-14T11:14:45.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.223+0000 7f8ee35ff700 1 Processor -- start 2023-07-14T11:14:45.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.223+0000 7f8ee35ff700 1 -- start start 2023-07-14T11:14:45.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.224+0000 7f8ee35ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8edc06b580 0x7f8edc15a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:45.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.224+0000 7f8ee35ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8edc0cba30 0x7f8edc0c9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:45.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.224+0000 7f8ee35ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8edc0cc340 0x7f8edc0ca210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:45.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.224+0000 7f8ee35ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8edc0c7b10 con 0x7f8edc06b580 2023-07-14T11:14:45.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.224+0000 7f8ee35ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8edc0b4bd0 con 0x7f8edc0cc340 2023-07-14T11:14:45.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.224+0000 7f8ee35ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8edc1f2be0 con 0x7f8edc0cba30 2023-07-14T11:14:45.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.224+0000 7f8ee139b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8edc06b580 0x7f8edc15a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:45.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.224+0000 7f8ee139b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8edc06b580 0x7f8edc15a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53824/0 (socket says 172.21.15.84:53824) 2023-07-14T11:14:45.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.224+0000 7f8ee139b700 1 -- 172.21.15.84:0/3364082999 learned_addr learned my addr 172.21.15.84:0/3364082999 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:45.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.225+0000 7f8ee0b9a700 1 --2- 172.21.15.84:0/3364082999 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8edc0cba30 0x7f8edc0c9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:45.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.225+0000 7f8ee139b700 1 -- 172.21.15.84:0/3364082999 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8edc0cba30 msgr2=0x7f8edc0c9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:45.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.225+0000 7f8ee139b700 1 --2- 172.21.15.84:0/3364082999 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8edc0cba30 0x7f8edc0c9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:45.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.225+0000 7f8ee139b700 1 -- 172.21.15.84:0/3364082999 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8edc0cc340 msgr2=0x7f8edc0ca210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:45.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.225+0000 7f8ee139b700 1 --2- 172.21.15.84:0/3364082999 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8edc0cc340 0x7f8edc0ca210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:45.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.225+0000 7f8ee139b700 1 -- 172.21.15.84:0/3364082999 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ecc0094a0 con 0x7f8edc06b580 2023-07-14T11:14:45.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.225+0000 7f8ee0b9a700 1 --2- 172.21.15.84:0/3364082999 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8edc0cba30 0x7f8edc0c9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:14:45.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.225+0000 7f8ee139b700 1 --2- 172.21.15.84:0/3364082999 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8edc06b580 0x7f8edc15a240 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f8ed800c820 tx=0x7f8ed800cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:45.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.225+0000 7f8ed1ffb700 1 -- 172.21.15.84:0/3364082999 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed8005c20 con 0x7f8edc06b580 2023-07-14T11:14:45.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.225+0000 7f8ed1ffb700 1 -- 172.21.15.84:0/3364082999 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ed8005d80 con 0x7f8edc06b580 2023-07-14T11:14:45.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.225+0000 7f8ed1ffb700 1 -- 172.21.15.84:0/3364082999 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed8011800 con 0x7f8edc06b580 2023-07-14T11:14:45.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.225+0000 7f8ee35ff700 1 -- 172.21.15.84:0/3364082999 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8edc0b5060 con 0x7f8edc06b580 2023-07-14T11:14:45.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.225+0000 7f8ee35ff700 1 -- 172.21.15.84:0/3364082999 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8edc0b4580 con 0x7f8edc06b580 2023-07-14T11:14:45.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.226+0000 7f8ee35ff700 1 -- 172.21.15.84:0/3364082999 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8edc074350 con 0x7f8edc06b580 2023-07-14T11:14:45.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.227+0000 7f8ed1ffb700 1 -- 172.21.15.84:0/3364082999 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8ed8011960 con 0x7f8edc06b580 2023-07-14T11:14:45.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.228+0000 7f8ed1ffb700 1 --2- 172.21.15.84:0/3364082999 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f8ec006ace0 0x7f8ec006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:45.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.228+0000 7f8ed1ffb700 1 -- 172.21.15.84:0/3364082999 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8ed80897b0 con 0x7f8edc06b580 2023-07-14T11:14:45.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.228+0000 7f8ee0b9a700 1 --2- 172.21.15.84:0/3364082999 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f8ec006ace0 0x7f8ec006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:45.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.229+0000 7f8ee0b9a700 1 --2- 172.21.15.84:0/3364082999 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f8ec006ace0 0x7f8ec006d190 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8edc0b5950 tx=0x7f8ecc008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:45.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.232+0000 7f8ed1ffb700 1 -- 172.21.15.84:0/3364082999 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f8ed8054860 con 0x7f8edc06b580 2023-07-14T11:14:45.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.459+0000 7f8ee35ff700 1 -- 172.21.15.84:0/3364082999 --> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_0000000000549219", "group_name": "group_0000000000407260", "target": ["mon-mgr", ""]}) v1 -- 0x7f8edc0cebd0 con 0x7f8ec006ace0 2023-07-14T11:14:45.467 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:14:45.465+0000 7fed0d3be700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T11:14:45.467 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:14:45.465+0000 7fed0d3be700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T11:14:45.467 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:14:45.465+0000 7fed0d3be700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T11:14:45.467 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:14:45.465+0000 7fed0d3be700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T11:14:45.468 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:14:45.465+0000 7fed0d3be700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T11:14:45.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.502+0000 7f8ed1ffb700 1 -- 172.21.15.84:0/3364082999 <== mgr.4104 v2:172.21.15.84:6832/379617029 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+59 (secure 0 0 0) 0x7f8ecc011630 con 0x7f8ec006ace0 2023-07-14T11:14:45.504 INFO:teuthology.orchestra.run.smithi084.stdout:/volumes/group_0000000000407260/subvolume_0000000000549219 2023-07-14T11:14:45.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.504+0000 7f8ee35ff700 1 -- 172.21.15.84:0/3364082999 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f8ec006ace0 msgr2=0x7f8ec006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:45.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.504+0000 7f8ee35ff700 1 --2- 172.21.15.84:0/3364082999 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f8ec006ace0 0x7f8ec006d190 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8edc0b5950 tx=0x7f8ecc008030 comp rx=0 tx=0).stop 2023-07-14T11:14:45.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.504+0000 7f8ee35ff700 1 -- 172.21.15.84:0/3364082999 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8edc06b580 msgr2=0x7f8edc15a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:45.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.504+0000 7f8ee35ff700 1 --2- 172.21.15.84:0/3364082999 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8edc06b580 0x7f8edc15a240 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f8ed800c820 tx=0x7f8ed800cbe0 comp rx=0 tx=0).stop 2023-07-14T11:14:45.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.505+0000 7f8ee35ff700 1 -- 172.21.15.84:0/3364082999 shutdown_connections 2023-07-14T11:14:45.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.505+0000 7f8ee35ff700 1 --2- 172.21.15.84:0/3364082999 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8edc0cc340 0x7f8edc0ca210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:45.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.505+0000 7f8ee35ff700 1 --2- 172.21.15.84:0/3364082999 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8edc06b580 0x7f8edc15a240 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:45.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.505+0000 7f8ee35ff700 1 --2- 172.21.15.84:0/3364082999 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f8ec006ace0 0x7f8ec006d190 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:45.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.505+0000 7f8ee35ff700 1 --2- 172.21.15.84:0/3364082999 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8edc0cba30 0x7f8edc0c9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:45.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.505+0000 7f8ee35ff700 1 -- 172.21.15.84:0/3364082999 >> 172.21.15.84:0/3364082999 conn(0x7f8edc099f40 msgr2=0x7f8edc0b63d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:45.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.505+0000 7f8ee35ff700 1 -- 172.21.15.84:0/3364082999 shutdown_connections 2023-07-14T11:14:45.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.505+0000 7f8ee35ff700 1 -- 172.21.15.84:0/3364082999 wait complete. 2023-07-14T11:14:45.525 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvolume_0000000000549219 group_0000000000407260 2023-07-14T11:14:45.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.722+0000 7f971b5ff700 1 Processor -- start 2023-07-14T11:14:45.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.722+0000 7f971b5ff700 1 -- start start 2023-07-14T11:14:45.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.724+0000 7f971b5ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f971415c890 0x7f97140d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:45.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.724+0000 7f971b5ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97140d0660 con 0x7f971406c240 2023-07-14T11:14:45.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.724+0000 7f971b5ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f971415cc60 con 0x7f97140b2440 2023-07-14T11:14:45.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.724+0000 7f971b5ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f971406a7f0 con 0x7f971415c890 2023-07-14T11:14:45.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.724+0000 7f9719b9c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f971406c240 0x7f97140cff50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51236/0 (socket says 172.21.15.84:51236) 2023-07-14T11:14:45.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.724+0000 7f9719b9c700 1 -- 172.21.15.84:0/100418267 learned_addr learned my addr 172.21.15.84:0/100418267 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:14:45.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.724+0000 7f971939b700 1 --2- 172.21.15.84:0/100418267 >> v2:172.21.15.179:3300/0 conn(0x7f971415c890 0x7f97140d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:45.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.725+0000 7f970bfff700 1 -- 172.21.15.84:0/100418267 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4181105299 0 0) 0x7f97140d0660 con 0x7f971406c240 2023-07-14T11:14:45.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.725+0000 7f970bfff700 1 -- 172.21.15.84:0/100418267 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97000035b0 con 0x7f971406c240 2023-07-14T11:14:45.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.725+0000 7f970bfff700 1 -- 172.21.15.84:0/100418267 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 679404007 0 0) 0x7f971415cc60 con 0x7f97140b2440 2023-07-14T11:14:45.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.725+0000 7f970bfff700 1 -- 172.21.15.84:0/100418267 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97140d0660 con 0x7f97140b2440 2023-07-14T11:14:45.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.725+0000 7f971939b700 1 -- 172.21.15.84:0/100418267 >> v1:172.21.15.179:6789/0 conn(0x7f97140b2440 legacy=0x7f97140cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:45.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.725+0000 7f971939b700 1 -- 172.21.15.84:0/100418267 >> v1:172.21.15.84:6789/0 conn(0x7f971406c240 legacy=0x7f97140cff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:45.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.725+0000 7f971939b700 1 -- 172.21.15.84:0/100418267 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f971406b760 con 0x7f971415c890 2023-07-14T11:14:45.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.725+0000 7f971939b700 1 --2- 172.21.15.84:0/100418267 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f971415c890 0x7f97140d0a50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9710009870 tx=0x7f9710009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac607bf5b3553378 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:45.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.726+0000 7f970bfff700 1 -- 172.21.15.84:0/100418267 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9710011830 con 0x7f971415c890 2023-07-14T11:14:45.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.726+0000 7f970bfff700 1 -- 172.21.15.84:0/100418267 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9710011990 con 0x7f971415c890 2023-07-14T11:14:45.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.726+0000 7f970bfff700 1 -- 172.21.15.84:0/100418267 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9710011d00 con 0x7f971415c890 2023-07-14T11:14:45.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.726+0000 7f971b5ff700 1 -- 172.21.15.84:0/100418267 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f971415c890 msgr2=0x7f97140d0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:45.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.726+0000 7f971b5ff700 1 --2- 172.21.15.84:0/100418267 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f971415c890 0x7f97140d0a50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9710009870 tx=0x7f9710009b80 comp rx=0 tx=0).stop 2023-07-14T11:14:45.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.726+0000 7f971b5ff700 1 -- 172.21.15.84:0/100418267 shutdown_connections 2023-07-14T11:14:45.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.726+0000 7f971b5ff700 1 --2- 172.21.15.84:0/100418267 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f971415c890 0x7f97140d0a50 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:45.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.726+0000 7f971b5ff700 1 -- 172.21.15.84:0/100418267 >> 172.21.15.84:0/100418267 conn(0x7f971409c170 msgr2=0x7f97140d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:45.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.726+0000 7f971b5ff700 1 -- 172.21.15.84:0/100418267 shutdown_connections 2023-07-14T11:14:45.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.727+0000 7f971b5ff700 1 -- 172.21.15.84:0/100418267 wait complete. 2023-07-14T11:14:45.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.729+0000 7f971b5ff700 1 Processor -- start 2023-07-14T11:14:45.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.729+0000 7f971b5ff700 1 -- start start 2023-07-14T11:14:45.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.730+0000 7f971b5ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f971406c240 0x7f9714156090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:45.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.730+0000 7f971b5ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97140b2440 0x7f97140b8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:45.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.730+0000 7f971b5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f971415c890 0x7f971415eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:45.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.730+0000 7f971b5ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f971415ce50 con 0x7f97140b2440 2023-07-14T11:14:45.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.730+0000 7f971b5ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97140b7800 con 0x7f971406c240 2023-07-14T11:14:45.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.730+0000 7f971b5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97140b7ae0 con 0x7f971415c890 2023-07-14T11:14:45.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.731+0000 7f9718b9a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97140b2440 0x7f97140b8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:45.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.731+0000 7f971939b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f971406c240 0x7f9714156090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:45.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.731+0000 7f9718b9a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97140b2440 0x7f97140b8650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53858/0 (socket says 172.21.15.84:53858) 2023-07-14T11:14:45.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.731+0000 7f9718b9a700 1 -- 172.21.15.84:0/885466270 learned_addr learned my addr 172.21.15.84:0/885466270 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:45.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.731+0000 7f9719b9c700 1 --2- 172.21.15.84:0/885466270 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f971415c890 0x7f971415eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:45.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.731+0000 7f9718b9a700 1 -- 172.21.15.84:0/885466270 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f971415c890 msgr2=0x7f971415eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:45.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.731+0000 7f9718b9a700 1 --2- 172.21.15.84:0/885466270 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f971415c890 0x7f971415eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:45.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.731+0000 7f9718b9a700 1 -- 172.21.15.84:0/885466270 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f971406c240 msgr2=0x7f9714156090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:45.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.731+0000 7f9718b9a700 1 --2- 172.21.15.84:0/885466270 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f971406c240 0x7f9714156090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:45.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.731+0000 7f9718b9a700 1 -- 172.21.15.84:0/885466270 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97100094a0 con 0x7f97140b2440 2023-07-14T11:14:45.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.731+0000 7f9718b9a700 1 --2- 172.21.15.84:0/885466270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97140b2440 0x7f97140b8650 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f970400c500 tx=0x7f970400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:45.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.732+0000 7f9709ffb700 1 -- 172.21.15.84:0/885466270 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97040052d0 con 0x7f97140b2440 2023-07-14T11:14:45.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.732+0000 7f9709ffb700 1 -- 172.21.15.84:0/885466270 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9704005450 con 0x7f97140b2440 2023-07-14T11:14:45.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.732+0000 7f971b5ff700 1 -- 172.21.15.84:0/885466270 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97140b7dc0 con 0x7f97140b2440 2023-07-14T11:14:45.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.732+0000 7f9709ffb700 1 -- 172.21.15.84:0/885466270 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97040038c0 con 0x7f97140b2440 2023-07-14T11:14:45.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.732+0000 7f971b5ff700 1 -- 172.21.15.84:0/885466270 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97141565d0 con 0x7f97140b2440 2023-07-14T11:14:45.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.733+0000 7f971b5ff700 1 -- 172.21.15.84:0/885466270 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9714074350 con 0x7f97140b2440 2023-07-14T11:14:45.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.734+0000 7f9709ffb700 1 -- 172.21.15.84:0/885466270 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9704003a20 con 0x7f97140b2440 2023-07-14T11:14:45.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.734+0000 7f9709ffb700 1 --2- 172.21.15.84:0/885466270 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f96f806ace0 0x7f96f806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:45.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.735+0000 7f9709ffb700 1 -- 172.21.15.84:0/885466270 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9704088780 con 0x7f97140b2440 2023-07-14T11:14:45.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.735+0000 7f971939b700 1 --2- 172.21.15.84:0/885466270 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f96f806ace0 0x7f96f806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:45.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.735+0000 7f971939b700 1 --2- 172.21.15.84:0/885466270 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f96f806ace0 0x7f96f806d190 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f97100090b0 tx=0x7f9710008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:45.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.739+0000 7f9709ffb700 1 -- 172.21.15.84:0/885466270 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f97040538c0 con 0x7f97140b2440 2023-07-14T11:14:45.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.964+0000 7f971b5ff700 1 -- 172.21.15.84:0/885466270 --> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_0000000000549219", "group_name": "group_0000000000407260", "target": ["mon-mgr", ""]}) v1 -- 0x7f971406bd20 con 0x7f96f806ace0 2023-07-14T11:14:45.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.969+0000 7f9709ffb700 1 -- 172.21.15.84:0/885466270 <== mgr.4104 v2:172.21.15.84:6832/379617029 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+59 (secure 0 0 0) 0x7f9710011630 con 0x7f96f806ace0 2023-07-14T11:14:45.971 INFO:teuthology.orchestra.run.smithi084.stdout:/volumes/group_0000000000407260/subvolume_0000000000549219 2023-07-14T11:14:45.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.971+0000 7f971b5ff700 1 -- 172.21.15.84:0/885466270 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f96f806ace0 msgr2=0x7f96f806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:45.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.971+0000 7f971b5ff700 1 --2- 172.21.15.84:0/885466270 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f96f806ace0 0x7f96f806d190 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f97100090b0 tx=0x7f9710008030 comp rx=0 tx=0).stop 2023-07-14T11:14:45.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.971+0000 7f971b5ff700 1 -- 172.21.15.84:0/885466270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97140b2440 msgr2=0x7f97140b8650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:45.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.971+0000 7f971b5ff700 1 --2- 172.21.15.84:0/885466270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97140b2440 0x7f97140b8650 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f970400c500 tx=0x7f970400c810 comp rx=0 tx=0).stop 2023-07-14T11:14:45.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.971+0000 7f971b5ff700 1 -- 172.21.15.84:0/885466270 shutdown_connections 2023-07-14T11:14:45.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.971+0000 7f971b5ff700 1 --2- 172.21.15.84:0/885466270 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f96f806ace0 0x7f96f806d190 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:45.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.971+0000 7f971b5ff700 1 --2- 172.21.15.84:0/885466270 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f971415c890 0x7f971415eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:45.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.971+0000 7f971b5ff700 1 --2- 172.21.15.84:0/885466270 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f971406c240 0x7f9714156090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:45.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.971+0000 7f971b5ff700 1 --2- 172.21.15.84:0/885466270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97140b2440 0x7f97140b8650 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:45.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.971+0000 7f971b5ff700 1 -- 172.21.15.84:0/885466270 >> 172.21.15.84:0/885466270 conn(0x7f971409c170 msgr2=0x7f97140b4820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:45.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.972+0000 7f971b5ff700 1 -- 172.21.15.84:0/885466270 shutdown_connections 2023-07-14T11:14:45.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:45.972+0000 7f971b5ff700 1 -- 172.21.15.84:0/885466270 wait complete. 2023-07-14T11:14:45.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:14:45.992 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/_legacy/b1f2710237b3facdc960f3dd389341a6.meta) 2023-07-14T11:14:46.067 INFO:teuthology.orchestra.run.smithi084.stdout:[GLOBAL] 2023-07-14T11:14:46.067 INFO:teuthology.orchestra.run.smithi084.stdout:version = 1 2023-07-14T11:14:46.067 INFO:teuthology.orchestra.run.smithi084.stdout:type = subvolume 2023-07-14T11:14:46.068 INFO:teuthology.orchestra.run.smithi084.stdout:path = /volumes/group_0000000000407260/subvolume_0000000000549219 2023-07-14T11:14:46.068 INFO:teuthology.orchestra.run.smithi084.stdout:state = complete 2023-07-14T11:14:46.068 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:14:46.070 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvolume_0000000000549219 group_0000000000407260 2023-07-14T11:14:46.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.268+0000 7f81325ff700 1 Processor -- start 2023-07-14T11:14:46.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.268+0000 7f81325ff700 1 -- start start 2023-07-14T11:14:46.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.269+0000 7f81325ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f812c15cc70 0x7f812c0cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:46.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.269+0000 7f81325ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f812c06a640 0x7f812c1610d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:46.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.269+0000 7f81325ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f812c161610 con 0x7f812c071590 2023-07-14T11:14:46.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.269+0000 7f81325ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f812c0ca4d0 con 0x7f812c15cc70 2023-07-14T11:14:46.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.269+0000 7f81325ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f812c15d040 con 0x7f812c06a640 2023-07-14T11:14:46.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.269+0000 7f812bfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f812c15cc70 0x7f812c0cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:46.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.270+0000 7f812bfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f812c15cc70 0x7f812c0cbae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53872/0 (socket says 172.21.15.84:53872) 2023-07-14T11:14:46.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.270+0000 7f812bfff700 1 -- 172.21.15.84:0/2477461663 learned_addr learned my addr 172.21.15.84:0/2477461663 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:46.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.270+0000 7f8130b9c700 1 --2- 172.21.15.84:0/2477461663 >> v2:172.21.15.179:3300/0 conn(0x7f812c06a640 0x7f812c1610d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:46.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.270+0000 7f812bfff700 1 -- 172.21.15.84:0/2477461663 >> v2:172.21.15.179:3300/0 conn(0x7f812c06a640 msgr2=0x7f812c1610d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:46.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.270+0000 7f812bfff700 1 --2- 172.21.15.84:0/2477461663 >> v2:172.21.15.179:3300/0 conn(0x7f812c06a640 0x7f812c1610d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:46.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.270+0000 7f812bfff700 1 -- 172.21.15.84:0/2477461663 >> v1:172.21.15.179:6789/0 conn(0x7f812c071590 legacy=0x7f812c069f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:46.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.270+0000 7f812bfff700 1 -- 172.21.15.84:0/2477461663 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f812c070860 con 0x7f812c15cc70 2023-07-14T11:14:46.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.270+0000 7f812bfff700 1 --2- 172.21.15.84:0/2477461663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f812c15cc70 0x7f812c0cbae0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f812c06afc0 tx=0x7f811c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcc40356de63db8 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:46.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.270+0000 7f812affd700 1 -- 172.21.15.84:0/2477461663 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811c011830 con 0x7f812c15cc70 2023-07-14T11:14:46.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.271+0000 7f812affd700 1 -- 172.21.15.84:0/2477461663 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f811c011990 con 0x7f812c15cc70 2023-07-14T11:14:46.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.271+0000 7f812affd700 1 -- 172.21.15.84:0/2477461663 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811c011d20 con 0x7f812c15cc70 2023-07-14T11:14:46.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.271+0000 7f81325ff700 1 -- 172.21.15.84:0/2477461663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f812c15cc70 msgr2=0x7f812c0cbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:46.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.271+0000 7f81325ff700 1 --2- 172.21.15.84:0/2477461663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f812c15cc70 0x7f812c0cbae0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f812c06afc0 tx=0x7f811c009c00 comp rx=0 tx=0).stop 2023-07-14T11:14:46.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.271+0000 7f81325ff700 1 -- 172.21.15.84:0/2477461663 shutdown_connections 2023-07-14T11:14:46.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.271+0000 7f81325ff700 1 --2- 172.21.15.84:0/2477461663 >> v2:172.21.15.179:3300/0 conn(0x7f812c06a640 0x7f812c1610d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:46.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.271+0000 7f81325ff700 1 --2- 172.21.15.84:0/2477461663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f812c15cc70 0x7f812c0cbae0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:46.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.271+0000 7f81325ff700 1 -- 172.21.15.84:0/2477461663 >> 172.21.15.84:0/2477461663 conn(0x7f812c0cd180 msgr2=0x7f812c0cfac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:46.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.271+0000 7f81325ff700 1 -- 172.21.15.84:0/2477461663 shutdown_connections 2023-07-14T11:14:46.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.271+0000 7f81325ff700 1 -- 172.21.15.84:0/2477461663 wait complete. 2023-07-14T11:14:46.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.273+0000 7f81325ff700 1 Processor -- start 2023-07-14T11:14:46.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.273+0000 7f81325ff700 1 -- start start 2023-07-14T11:14:46.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.274+0000 7f81325ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f812c06a640 0x7f812c15f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:46.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.274+0000 7f81325ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f812c071590 0x7f812c0c5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:46.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.274+0000 7f81325ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f812c15cc70 0x7f812c15a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:46.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.274+0000 7f81325ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f812c0c6490 con 0x7f812c071590 2023-07-14T11:14:46.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.274+0000 7f81325ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f812c0c5880 con 0x7f812c06a640 2023-07-14T11:14:46.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.274+0000 7f81325ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f812c0c5b60 con 0x7f812c15cc70 2023-07-14T11:14:46.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.274+0000 7f812b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f812c071590 0x7f812c0c5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:46.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.274+0000 7f812b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f812c071590 0x7f812c0c5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53876/0 (socket says 172.21.15.84:53876) 2023-07-14T11:14:46.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.274+0000 7f812b7fe700 1 -- 172.21.15.84:0/1782716089 learned_addr learned my addr 172.21.15.84:0/1782716089 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:46.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.274+0000 7f812bfff700 1 --2- 172.21.15.84:0/1782716089 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f812c06a640 0x7f812c15f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:46.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.274+0000 7f8130b9c700 1 --2- 172.21.15.84:0/1782716089 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f812c15cc70 0x7f812c15a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:46.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.274+0000 7f812b7fe700 1 -- 172.21.15.84:0/1782716089 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f812c15cc70 msgr2=0x7f812c15a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:46.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.274+0000 7f812b7fe700 1 --2- 172.21.15.84:0/1782716089 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f812c15cc70 0x7f812c15a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:46.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.275+0000 7f812b7fe700 1 -- 172.21.15.84:0/1782716089 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f812c06a640 msgr2=0x7f812c15f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:46.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.275+0000 7f812b7fe700 1 --2- 172.21.15.84:0/1782716089 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f812c06a640 0x7f812c15f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:46.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.275+0000 7f812b7fe700 1 -- 172.21.15.84:0/1782716089 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f811c009550 con 0x7f812c071590 2023-07-14T11:14:46.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.275+0000 7f812bfff700 1 --2- 172.21.15.84:0/1782716089 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f812c06a640 0x7f812c15f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:14:46.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.275+0000 7f8130b9c700 1 --2- 172.21.15.84:0/1782716089 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f812c15cc70 0x7f812c15a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:14:46.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.275+0000 7f812b7fe700 1 --2- 172.21.15.84:0/1782716089 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f812c071590 0x7f812c0c5050 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f812000c4e0 tx=0x7f812000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:46.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.275+0000 7f8128ff9700 1 -- 172.21.15.84:0/1782716089 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81200052d0 con 0x7f812c071590 2023-07-14T11:14:46.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.275+0000 7f8128ff9700 1 -- 172.21.15.84:0/1782716089 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8120005430 con 0x7f812c071590 2023-07-14T11:14:46.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.275+0000 7f81325ff700 1 -- 172.21.15.84:0/1782716089 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f812c0c5e40 con 0x7f812c071590 2023-07-14T11:14:46.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.275+0000 7f8128ff9700 1 -- 172.21.15.84:0/1782716089 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81200038c0 con 0x7f812c071590 2023-07-14T11:14:46.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.275+0000 7f81325ff700 1 -- 172.21.15.84:0/1782716089 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f812c0c5590 con 0x7f812c071590 2023-07-14T11:14:46.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.276+0000 7f81325ff700 1 -- 172.21.15.84:0/1782716089 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f812c074350 con 0x7f812c071590 2023-07-14T11:14:46.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.277+0000 7f8128ff9700 1 -- 172.21.15.84:0/1782716089 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8120003a20 con 0x7f812c071590 2023-07-14T11:14:46.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.278+0000 7f8128ff9700 1 --2- 172.21.15.84:0/1782716089 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f811806ace0 0x7f811806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:46.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.279+0000 7f8128ff9700 1 -- 172.21.15.84:0/1782716089 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8120088800 con 0x7f812c071590 2023-07-14T11:14:46.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.279+0000 7f812bfff700 1 --2- 172.21.15.84:0/1782716089 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f811806ace0 0x7f811806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:46.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.279+0000 7f812bfff700 1 --2- 172.21.15.84:0/1782716089 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f811806ace0 0x7f811806d190 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f811c000c00 tx=0x7f811c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:46.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.283+0000 7f8128ff9700 1 -- 172.21.15.84:0/1782716089 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f81200538a0 con 0x7f812c071590 2023-07-14T11:14:46.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.508+0000 7f81325ff700 1 -- 172.21.15.84:0/1782716089 --> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvolume_0000000000549219", "group_name": "group_0000000000407260", "target": ["mon-mgr", ""]}) v1 -- 0x7f812c0cc180 con 0x7f811806ace0 2023-07-14T11:14:46.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.522+0000 7f8128ff9700 1 -- 172.21.15.84:0/1782716089 <== mgr.4104 v2:172.21.15.84:6832/379617029 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f811c01f070 con 0x7f811806ace0 2023-07-14T11:14:46.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.525+0000 7f81325ff700 1 -- 172.21.15.84:0/1782716089 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f811806ace0 msgr2=0x7f811806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:46.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.525+0000 7f81325ff700 1 --2- 172.21.15.84:0/1782716089 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f811806ace0 0x7f811806d190 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f811c000c00 tx=0x7f811c008030 comp rx=0 tx=0).stop 2023-07-14T11:14:46.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.525+0000 7f81325ff700 1 -- 172.21.15.84:0/1782716089 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f812c071590 msgr2=0x7f812c0c5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:46.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.525+0000 7f81325ff700 1 --2- 172.21.15.84:0/1782716089 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f812c071590 0x7f812c0c5050 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f812000c4e0 tx=0x7f812000c8a0 comp rx=0 tx=0).stop 2023-07-14T11:14:46.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.525+0000 7f81325ff700 1 -- 172.21.15.84:0/1782716089 shutdown_connections 2023-07-14T11:14:46.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.525+0000 7f81325ff700 1 --2- 172.21.15.84:0/1782716089 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f811806ace0 0x7f811806d190 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:46.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.525+0000 7f81325ff700 1 --2- 172.21.15.84:0/1782716089 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f812c15cc70 0x7f812c15a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:46.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.525+0000 7f81325ff700 1 --2- 172.21.15.84:0/1782716089 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f812c06a640 0x7f812c15f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:46.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.525+0000 7f81325ff700 1 --2- 172.21.15.84:0/1782716089 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f812c071590 0x7f812c0c5050 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:46.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.525+0000 7f81325ff700 1 -- 172.21.15.84:0/1782716089 >> 172.21.15.84:0/1782716089 conn(0x7f812c0cd180 msgr2=0x7f812c0b0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:46.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.525+0000 7f81325ff700 1 -- 172.21.15.84:0/1782716089 shutdown_connections 2023-07-14T11:14:46.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.525+0000 7f81325ff700 1 -- 172.21.15.84:0/1782716089 wait complete. 2023-07-14T11:14:46.529 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:14:46.527+0000 7fed103c4700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T11:14:46.529 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:14:46.527+0000 7fed103c4700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T11:14:46.530 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:14:46.527+0000 7fed103c4700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T11:14:46.530 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:14:46.527+0000 7fed103c4700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T11:14:46.530 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:14:46.527+0000 7fed103c4700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T11:14:46.547 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:14:46.545+0000 7fed0fbc3700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T11:14:46.547 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:14:46.545+0000 7fed0fbc3700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T11:14:46.547 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:14:46.545+0000 7fed0fbc3700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T11:14:46.547 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:14:46.545+0000 7fed0fbc3700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T11:14:46.548 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:14:46.545+0000 7fed0fbc3700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T11:14:46.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:14:46.549 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2023-07-14T11:14:46.638 INFO:teuthology.orchestra.run.smithi084.stdout:2 2023-07-14T11:14:46.639 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup rm cephfs group_0000000000407260 2023-07-14T11:14:46.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.842+0000 7f1e19fff700 1 Processor -- start 2023-07-14T11:14:46.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.842+0000 7f1e19fff700 1 -- start start 2023-07-14T11:14:46.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.843+0000 7f1e19fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1e140d0010 0x7f1e140b5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:46.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.844+0000 7f1e19fff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e1415cd60 con 0x7f1e140d0480 2023-07-14T11:14:46.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.844+0000 7f1e19fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e140cf340 con 0x7f1e140b4600 2023-07-14T11:14:46.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.844+0000 7f1e19fff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e140d1550 con 0x7f1e140d0010 2023-07-14T11:14:46.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.844+0000 7f1e0bfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1e140d0010 0x7f1e140b5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:46.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.844+0000 7f1e0bfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1e140d0010 0x7f1e140b5ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53914/0 (socket says 172.21.15.84:53914) 2023-07-14T11:14:46.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.844+0000 7f1e0bfff700 1 -- 172.21.15.84:0/1504965773 learned_addr learned my addr 172.21.15.84:0/1504965773 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:46.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.844+0000 7f1e13fff700 1 --1- 172.21.15.84:0/1504965773 >> v1:172.21.15.84:6789/0 conn(0x7f1e140d0480 0x7f1e140b6430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51252/0 (socket says 172.21.15.84:51252) 2023-07-14T11:14:46.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.844+0000 7f1e0bfff700 1 -- 172.21.15.84:0/1504965773 >> v1:172.21.15.179:6789/0 conn(0x7f1e140b4600 legacy=0x7f1e140cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:46.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.844+0000 7f1e0bfff700 1 -- 172.21.15.84:0/1504965773 >> v1:172.21.15.84:6789/0 conn(0x7f1e140d0480 legacy=0x7f1e140b6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:46.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.844+0000 7f1e0bfff700 1 -- 172.21.15.84:0/1504965773 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e140d0e90 con 0x7f1e140d0010 2023-07-14T11:14:46.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.844+0000 7f1e12ffd700 1 -- 172.21.15.84:0/1504965773 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2851731097 0 0) 0x7f1e1415cd60 con 0x7f1e140d0480 2023-07-14T11:14:46.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.845+0000 7f1e0bfff700 1 --2- 172.21.15.84:0/1504965773 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e140d0010 0x7f1e140b5ef0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc0098f0 tx=0x7f1dfc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ea747e39625ec02 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:46.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.845+0000 7f1e12ffd700 1 -- 172.21.15.84:0/1504965773 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dfc004230 con 0x7f1e140d0010 2023-07-14T11:14:46.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.845+0000 7f1e12ffd700 1 -- 172.21.15.84:0/1504965773 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dfc004390 con 0x7f1e140d0010 2023-07-14T11:14:46.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.845+0000 7f1e12ffd700 1 -- 172.21.15.84:0/1504965773 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dfc0036a0 con 0x7f1e140d0010 2023-07-14T11:14:46.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.845+0000 7f1e19fff700 1 -- 172.21.15.84:0/1504965773 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e140d0010 msgr2=0x7f1e140b5ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:46.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.845+0000 7f1e19fff700 1 --2- 172.21.15.84:0/1504965773 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e140d0010 0x7f1e140b5ef0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc0098f0 tx=0x7f1dfc009c00 comp rx=0 tx=0).stop 2023-07-14T11:14:46.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.845+0000 7f1e19fff700 1 -- 172.21.15.84:0/1504965773 shutdown_connections 2023-07-14T11:14:46.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.845+0000 7f1e19fff700 1 --2- 172.21.15.84:0/1504965773 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e140d0010 0x7f1e140b5ef0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:46.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.845+0000 7f1e19fff700 1 -- 172.21.15.84:0/1504965773 >> 172.21.15.84:0/1504965773 conn(0x7f1e1409c200 msgr2=0x7f1e140d2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:46.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.845+0000 7f1e19fff700 1 -- 172.21.15.84:0/1504965773 shutdown_connections 2023-07-14T11:14:46.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.846+0000 7f1e19fff700 1 -- 172.21.15.84:0/1504965773 wait complete. 2023-07-14T11:14:46.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.847+0000 7f1e19fff700 1 Processor -- start 2023-07-14T11:14:46.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.847+0000 7f1e19fff700 1 -- start start 2023-07-14T11:14:46.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.848+0000 7f1e19fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e140d0010 0x7f1e140afdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:46.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.848+0000 7f1e19fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e140d0480 0x7f1e1415a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:46.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.848+0000 7f1e19fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e1415aeb0 0x7f1e140b19d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:46.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.848+0000 7f1e19fff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1415b350 con 0x7f1e1415aeb0 2023-07-14T11:14:46.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.848+0000 7f1e19fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e140b27c0 con 0x7f1e140d0010 2023-07-14T11:14:46.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.848+0000 7f1e19fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e140b2aa0 con 0x7f1e140d0480 2023-07-14T11:14:46.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.848+0000 7f1e13fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e1415aeb0 0x7f1e140b19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:46.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.848+0000 7f1e13fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e1415aeb0 0x7f1e140b19d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53930/0 (socket says 172.21.15.84:53930) 2023-07-14T11:14:46.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.848+0000 7f1e13fff700 1 -- 172.21.15.84:0/2623554430 learned_addr learned my addr 172.21.15.84:0/2623554430 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:46.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.849+0000 7f1e0bfff700 1 --2- 172.21.15.84:0/2623554430 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e140d0480 0x7f1e1415a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:46.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.849+0000 7f1e137fe700 1 --2- 172.21.15.84:0/2623554430 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e140d0010 0x7f1e140afdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:46.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.849+0000 7f1e13fff700 1 -- 172.21.15.84:0/2623554430 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e140d0480 msgr2=0x7f1e1415a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:46.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.849+0000 7f1e13fff700 1 --2- 172.21.15.84:0/2623554430 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e140d0480 0x7f1e1415a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:46.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.849+0000 7f1e13fff700 1 -- 172.21.15.84:0/2623554430 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e140d0010 msgr2=0x7f1e140afdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:46.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.849+0000 7f1e13fff700 1 --2- 172.21.15.84:0/2623554430 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e140d0010 0x7f1e140afdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:46.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.849+0000 7f1e13fff700 1 -- 172.21.15.84:0/2623554430 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dfc009550 con 0x7f1e1415aeb0 2023-07-14T11:14:46.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.849+0000 7f1e137fe700 1 --2- 172.21.15.84:0/2623554430 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e140d0010 0x7f1e140afdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:14:46.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.849+0000 7f1e13fff700 1 --2- 172.21.15.84:0/2623554430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e1415aeb0 0x7f1e140b19d0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c00cb60 tx=0x7f1e0c00ce70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:46.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.849+0000 7f1e10ff9700 1 -- 172.21.15.84:0/2623554430 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0c00aaa0 con 0x7f1e1415aeb0 2023-07-14T11:14:46.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.849+0000 7f1e10ff9700 1 -- 172.21.15.84:0/2623554430 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e0c00ac00 con 0x7f1e1415aeb0 2023-07-14T11:14:46.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.849+0000 7f1e19fff700 1 -- 172.21.15.84:0/2623554430 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e140b2d80 con 0x7f1e1415aeb0 2023-07-14T11:14:46.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.849+0000 7f1e10ff9700 1 -- 172.21.15.84:0/2623554430 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0c0070d0 con 0x7f1e1415aeb0 2023-07-14T11:14:46.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.850+0000 7f1e19fff700 1 -- 172.21.15.84:0/2623554430 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e140b3340 con 0x7f1e1415aeb0 2023-07-14T11:14:46.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.851+0000 7f1e19fff700 1 -- 172.21.15.84:0/2623554430 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e140b3530 con 0x7f1e1415aeb0 2023-07-14T11:14:46.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.851+0000 7f1e10ff9700 1 -- 172.21.15.84:0/2623554430 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f1e0c007230 con 0x7f1e1415aeb0 2023-07-14T11:14:46.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.852+0000 7f1e10ff9700 1 --2- 172.21.15.84:0/2623554430 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1df406ad40 0x7f1df406d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:46.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.852+0000 7f1e10ff9700 1 -- 172.21.15.84:0/2623554430 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1e0c089140 con 0x7f1e1415aeb0 2023-07-14T11:14:46.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.852+0000 7f1e137fe700 1 --2- 172.21.15.84:0/2623554430 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1df406ad40 0x7f1df406d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:46.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.853+0000 7f1e137fe700 1 --2- 172.21.15.84:0/2623554430 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1df406ad40 0x7f1df406d1f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1e04003fc0 tx=0x7f1e04009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:46.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:46.857+0000 7f1e10ff9700 1 -- 172.21.15.84:0/2623554430 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f1e0c054070 con 0x7f1e1415aeb0 2023-07-14T11:14:47.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.080+0000 7f1e19fff700 1 -- 172.21.15.84:0/2623554430 --> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup rm", "vol_name": "cephfs", "group_name": "group_0000000000407260", "target": ["mon-mgr", ""]}) v1 -- 0x7f1e140cf620 con 0x7f1df406ad40 2023-07-14T11:14:47.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.083+0000 7f1e10ff9700 1 -- 172.21.15.84:0/2623554430 <== mgr.4104 v2:172.21.15.84:6832/379617029 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f1e04003bb0 con 0x7f1df406ad40 2023-07-14T11:14:47.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.086+0000 7f1e19fff700 1 -- 172.21.15.84:0/2623554430 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1df406ad40 msgr2=0x7f1df406d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:47.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.086+0000 7f1e19fff700 1 --2- 172.21.15.84:0/2623554430 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1df406ad40 0x7f1df406d1f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1e04003fc0 tx=0x7f1e04009040 comp rx=0 tx=0).stop 2023-07-14T11:14:47.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.086+0000 7f1e19fff700 1 -- 172.21.15.84:0/2623554430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e1415aeb0 msgr2=0x7f1e140b19d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:47.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.086+0000 7f1e19fff700 1 --2- 172.21.15.84:0/2623554430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e1415aeb0 0x7f1e140b19d0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c00cb60 tx=0x7f1e0c00ce70 comp rx=0 tx=0).stop 2023-07-14T11:14:47.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.086+0000 7f1e19fff700 1 -- 172.21.15.84:0/2623554430 shutdown_connections 2023-07-14T11:14:47.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.086+0000 7f1e19fff700 1 --2- 172.21.15.84:0/2623554430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e1415aeb0 0x7f1e140b19d0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:47.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.086+0000 7f1e19fff700 1 --2- 172.21.15.84:0/2623554430 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e140d0010 0x7f1e140afdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:47.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.086+0000 7f1e19fff700 1 --2- 172.21.15.84:0/2623554430 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1df406ad40 0x7f1df406d1f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:47.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.086+0000 7f1e19fff700 1 --2- 172.21.15.84:0/2623554430 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e140d0480 0x7f1e1415a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:47.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.086+0000 7f1e19fff700 1 -- 172.21.15.84:0/2623554430 >> 172.21.15.84:0/2623554430 conn(0x7f1e1409c200 msgr2=0x7f1e140d3770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:47.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.086+0000 7f1e19fff700 1 -- 172.21.15.84:0/2623554430 shutdown_connections 2023-07-14T11:14:47.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.086+0000 7f1e19fff700 1 -- 172.21.15.84:0/2623554430 wait complete. 2023-07-14T11:14:47.106 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-14T11:14:47.106 DEBUG:teuthology.orchestra.run.smithi084:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-14T11:14:47.211 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-14T11:14:47.326 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-14T11:14:47.326 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-14T11:14:47.326 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:14:47.373 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-14T11:14:47.373 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:14:47.458 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:14:47.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.691+0000 7efeb29ff700 1 Processor -- start 2023-07-14T11:14:47.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.691+0000 7efeb29ff700 1 -- start start 2023-07-14T11:14:47.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.692+0000 7efeb29ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7efeac0b4510 0x7efeac0b6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:47.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.692+0000 7efeb29ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7efeac0b5d90 0x7efeac0cd590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:47.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.692+0000 7efeb29ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efeac0d0b10 0x7efeac0d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:47.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.692+0000 7efeb29ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efeac0b48e0 con 0x7efeac0b4510 2023-07-14T11:14:47.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.692+0000 7efeb29ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efeac0d14d0 con 0x7efeac0b5d90 2023-07-14T11:14:47.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.692+0000 7efeb29ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeac0b7f50 con 0x7efeac0d0b10 2023-07-14T11:14:47.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.693+0000 7efeabfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7efeac0b4510 0x7efeac0b6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:47.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.693+0000 7efeabfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7efeac0b4510 0x7efeac0b6c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53940/0 (socket says 172.21.15.84:53940) 2023-07-14T11:14:47.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.693+0000 7efeabfff700 1 -- 172.21.15.84:0/3474746892 learned_addr learned my addr 172.21.15.84:0/3474746892 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:47.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.693+0000 7efeab7fe700 1 --2- 172.21.15.84:0/3474746892 >> v2:172.21.15.179:3300/0 conn(0x7efeac0b5d90 0x7efeac0cd590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:47.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.693+0000 7efeb0f9c700 1 --2- 172.21.15.84:0/3474746892 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efeac0d0b10 0x7efeac0d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:47.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.693+0000 7efeabfff700 1 -- 172.21.15.84:0/3474746892 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efeac0d0b10 msgr2=0x7efeac0d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:47.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.693+0000 7efeabfff700 1 --2- 172.21.15.84:0/3474746892 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efeac0d0b10 0x7efeac0d0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:47.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.693+0000 7efeabfff700 1 -- 172.21.15.84:0/3474746892 >> v2:172.21.15.179:3300/0 conn(0x7efeac0b5d90 msgr2=0x7efeac0cd590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:47.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.693+0000 7efeabfff700 1 --2- 172.21.15.84:0/3474746892 >> v2:172.21.15.179:3300/0 conn(0x7efeac0b5d90 0x7efeac0cd590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:47.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.693+0000 7efeabfff700 1 -- 172.21.15.84:0/3474746892 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeac0b7340 con 0x7efeac0b4510 2023-07-14T11:14:47.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.694+0000 7efeabfff700 1 --2- 172.21.15.84:0/3474746892 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efeac0b4510 0x7efeac0b6c80 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7efeac0b5b30 tx=0x7efe9c009bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddaf12032ad67365 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:47.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.694+0000 7efeaaffd700 1 -- 172.21.15.84:0/3474746892 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe9c00b8a0 con 0x7efeac0b4510 2023-07-14T11:14:47.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.694+0000 7efeaaffd700 1 -- 172.21.15.84:0/3474746892 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe9c00ba00 con 0x7efeac0b4510 2023-07-14T11:14:47.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.694+0000 7efeaaffd700 1 -- 172.21.15.84:0/3474746892 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe9c00bdb0 con 0x7efeac0b4510 2023-07-14T11:14:47.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.694+0000 7efeb29ff700 1 -- 172.21.15.84:0/3474746892 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efeac0b4510 msgr2=0x7efeac0b6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:47.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.694+0000 7efeb29ff700 1 --2- 172.21.15.84:0/3474746892 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efeac0b4510 0x7efeac0b6c80 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7efeac0b5b30 tx=0x7efe9c009bc0 comp rx=0 tx=0).stop 2023-07-14T11:14:47.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.694+0000 7efeb29ff700 1 -- 172.21.15.84:0/3474746892 shutdown_connections 2023-07-14T11:14:47.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.694+0000 7efeb29ff700 1 --2- 172.21.15.84:0/3474746892 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efeac0d0b10 0x7efeac0d0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:47.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.694+0000 7efeb29ff700 1 --2- 172.21.15.84:0/3474746892 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efeac0b4510 0x7efeac0b6c80 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:47.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.694+0000 7efeb29ff700 1 --2- 172.21.15.84:0/3474746892 >> v2:172.21.15.179:3300/0 conn(0x7efeac0b5d90 0x7efeac0cd590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:47.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.694+0000 7efeb29ff700 1 -- 172.21.15.84:0/3474746892 >> 172.21.15.84:0/3474746892 conn(0x7efeac09c1d0 msgr2=0x7efeac0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:47.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.694+0000 7efeb29ff700 1 -- 172.21.15.84:0/3474746892 shutdown_connections 2023-07-14T11:14:47.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.695+0000 7efeb29ff700 1 -- 172.21.15.84:0/3474746892 wait complete. 2023-07-14T11:14:47.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.696+0000 7efeb29ff700 1 Processor -- start 2023-07-14T11:14:47.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.696+0000 7efeb29ff700 1 -- start start 2023-07-14T11:14:47.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.697+0000 7efeb29ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efeac0b4510 0x7efeac153b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:47.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.697+0000 7efeb29ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efeac0b5d90 0x7efeac1f26e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:47.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.697+0000 7efeb29ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efeac0d0b10 0x7efeac06b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:47.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.697+0000 7efeb29ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeac154040 con 0x7efeac0b5d90 2023-07-14T11:14:47.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.697+0000 7efeb29ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeac15dd10 con 0x7efeac0d0b10 2023-07-14T11:14:47.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.697+0000 7efeb29ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeac15dff0 con 0x7efeac0b4510 2023-07-14T11:14:47.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.698+0000 7efeab7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efeac0b5d90 0x7efeac1f26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:47.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.698+0000 7efeab7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efeac0b5d90 0x7efeac1f26e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53954/0 (socket says 172.21.15.84:53954) 2023-07-14T11:14:47.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.698+0000 7efeab7fe700 1 -- 172.21.15.84:0/3407225633 learned_addr learned my addr 172.21.15.84:0/3407225633 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:47.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.698+0000 7efeb0f9c700 1 --2- 172.21.15.84:0/3407225633 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efeac0d0b10 0x7efeac06b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:47.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.698+0000 7efeabfff700 1 --2- 172.21.15.84:0/3407225633 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efeac0b4510 0x7efeac153b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:47.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.698+0000 7efeab7fe700 1 -- 172.21.15.84:0/3407225633 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efeac0b4510 msgr2=0x7efeac153b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:47.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.698+0000 7efeab7fe700 1 --2- 172.21.15.84:0/3407225633 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efeac0b4510 0x7efeac153b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:47.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.698+0000 7efeab7fe700 1 -- 172.21.15.84:0/3407225633 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efeac0d0b10 msgr2=0x7efeac06b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:47.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.698+0000 7efeab7fe700 1 --2- 172.21.15.84:0/3407225633 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efeac0d0b10 0x7efeac06b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:47.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.698+0000 7efeab7fe700 1 -- 172.21.15.84:0/3407225633 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe9c0094f0 con 0x7efeac0b5d90 2023-07-14T11:14:47.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.698+0000 7efeab7fe700 1 --2- 172.21.15.84:0/3407225633 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efeac0b5d90 0x7efeac1f26e0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7efea000e810 tx=0x7efea000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:47.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.699+0000 7efea8ff9700 1 -- 172.21.15.84:0/3407225633 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea0013610 con 0x7efeac0b5d90 2023-07-14T11:14:47.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.699+0000 7efea8ff9700 1 -- 172.21.15.84:0/3407225633 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efea0013770 con 0x7efeac0b5d90 2023-07-14T11:14:47.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.699+0000 7efea8ff9700 1 -- 172.21.15.84:0/3407225633 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea0013b00 con 0x7efeac0b5d90 2023-07-14T11:14:47.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.699+0000 7efeb29ff700 1 -- 172.21.15.84:0/3407225633 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeac15e2d0 con 0x7efeac0b5d90 2023-07-14T11:14:47.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.699+0000 7efeb29ff700 1 -- 172.21.15.84:0/3407225633 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeac15e890 con 0x7efeac0b5d90 2023-07-14T11:14:47.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.700+0000 7efeb29ff700 1 -- 172.21.15.84:0/3407225633 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efeac08b8f0 con 0x7efeac0b5d90 2023-07-14T11:14:47.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.701+0000 7efea8ff9700 1 -- 172.21.15.84:0/3407225633 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7efea0013c60 con 0x7efeac0b5d90 2023-07-14T11:14:47.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.701+0000 7efea8ff9700 1 --2- 172.21.15.84:0/3407225633 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7efe9806ad70 0x7efe9806d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:47.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.702+0000 7efea8ff9700 1 -- 172.21.15.84:0/3407225633 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efea0089270 con 0x7efeac0b5d90 2023-07-14T11:14:47.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.702+0000 7efeabfff700 1 --2- 172.21.15.84:0/3407225633 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7efe9806ad70 0x7efe9806d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:47.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.702+0000 7efeabfff700 1 --2- 172.21.15.84:0/3407225633 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7efe9806ad70 0x7efe9806d220 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7efe9c009c00 tx=0x7efe9c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:47.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.706+0000 7efea8ff9700 1 -- 172.21.15.84:0/3407225633 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7efea00541b0 con 0x7efeac0b5d90 2023-07-14T11:14:47.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.901+0000 7efeb29ff700 1 -- 172.21.15.84:0/3407225633 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efeac04e280 con 0x7efeac0b5d90 2023-07-14T11:14:47.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.903+0000 7efea8ff9700 1 -- 172.21.15.84:0/3407225633 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18327 (secure 0 0 0) 0x7efea00577d0 con 0x7efeac0b5d90 2023-07-14T11:14:47.905 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:14:47.905 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":37,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:14:34.030805+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-14T11:14:30.730753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-14T11:14:31.485809+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:14:47.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.905+0000 7efeb29ff700 1 -- 172.21.15.84:0/3407225633 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7efe9806ad70 msgr2=0x7efe9806d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:47.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.905+0000 7efeb29ff700 1 --2- 172.21.15.84:0/3407225633 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7efe9806ad70 0x7efe9806d220 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7efe9c009c00 tx=0x7efe9c008030 comp rx=0 tx=0).stop 2023-07-14T11:14:47.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.905+0000 7efeb29ff700 1 -- 172.21.15.84:0/3407225633 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efeac0b5d90 msgr2=0x7efeac1f26e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:47.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.905+0000 7efeb29ff700 1 --2- 172.21.15.84:0/3407225633 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efeac0b5d90 0x7efeac1f26e0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7efea000e810 tx=0x7efea000ebd0 comp rx=0 tx=0).stop 2023-07-14T11:14:47.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.905+0000 7efeb29ff700 1 -- 172.21.15.84:0/3407225633 shutdown_connections 2023-07-14T11:14:47.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.905+0000 7efeb29ff700 1 --2- 172.21.15.84:0/3407225633 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7efe9806ad70 0x7efe9806d220 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:47.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.905+0000 7efeb29ff700 1 --2- 172.21.15.84:0/3407225633 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efeac0b4510 0x7efeac153b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:47.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.905+0000 7efeb29ff700 1 --2- 172.21.15.84:0/3407225633 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efeac0d0b10 0x7efeac06b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:47.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.905+0000 7efeb29ff700 1 --2- 172.21.15.84:0/3407225633 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efeac0b5d90 0x7efeac1f26e0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:47.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.905+0000 7efeb29ff700 1 -- 172.21.15.84:0/3407225633 >> 172.21.15.84:0/3407225633 conn(0x7efeac09c1d0 msgr2=0x7efeac15adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:47.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.905+0000 7efeb29ff700 1 -- 172.21.15.84:0/3407225633 shutdown_connections 2023-07-14T11:14:47.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:47.905+0000 7efeb29ff700 1 -- 172.21.15.84:0/3407225633 wait complete. 2023-07-14T11:14:47.925 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T11:13:00.125395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T11:13:06.803994+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T11:14:30.730753+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T11:14:31.485809+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T11:14:47.926 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T11:14:48.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.125+0000 7feddbbff700 1 Processor -- start 2023-07-14T11:14:48.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.126+0000 7feddbbff700 1 -- start start 2023-07-14T11:14:48.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.127+0000 7feddbbff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fedd40c92d0 0x7fedd40ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:48.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.127+0000 7feddbbff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fedd40b12f0 0x7fedd40c96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:48.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.127+0000 7feddbbff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedd415ce70 con 0x7fedd40adea0 2023-07-14T11:14:48.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.127+0000 7feddbbff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedd415da60 con 0x7fedd40b12f0 2023-07-14T11:14:48.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.127+0000 7feddbbff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedd40c9be0 con 0x7fedd40c92d0 2023-07-14T11:14:48.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.127+0000 7fedd919a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fedd40b12f0 0x7fedd40c96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:48.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.127+0000 7fedd919a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fedd40b12f0 0x7fedd40c96a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53958/0 (socket says 172.21.15.84:53958) 2023-07-14T11:14:48.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.127+0000 7fedd919a700 1 -- 172.21.15.84:0/2120372120 learned_addr learned my addr 172.21.15.84:0/2120372120 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:48.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.127+0000 7fedd999b700 1 --2- 172.21.15.84:0/2120372120 >> v2:172.21.15.179:3300/0 conn(0x7fedd40c92d0 0x7fedd40ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:48.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.127+0000 7fedd919a700 1 -- 172.21.15.84:0/2120372120 >> v2:172.21.15.179:3300/0 conn(0x7fedd40c92d0 msgr2=0x7fedd40ad8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:48.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.127+0000 7fedd919a700 1 --2- 172.21.15.84:0/2120372120 >> v2:172.21.15.179:3300/0 conn(0x7fedd40c92d0 0x7fedd40ad8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:48.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.127+0000 7fedd919a700 1 -- 172.21.15.84:0/2120372120 >> v1:172.21.15.179:6789/0 conn(0x7fedd40adea0 legacy=0x7fedd406c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:48.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.128+0000 7fedd919a700 1 -- 172.21.15.84:0/2120372120 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedd415d0c0 con 0x7fedd40b12f0 2023-07-14T11:14:48.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.128+0000 7fedd919a700 1 --2- 172.21.15.84:0/2120372120 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fedd40b12f0 0x7fedd40c96a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fedd406f630 tx=0x7fedc4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f52dab503de18466 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:48.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.128+0000 7fedd8999700 1 -- 172.21.15.84:0/2120372120 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc4004230 con 0x7fedd40b12f0 2023-07-14T11:14:48.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.128+0000 7fedd8999700 1 -- 172.21.15.84:0/2120372120 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedc4004390 con 0x7fedd40b12f0 2023-07-14T11:14:48.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.128+0000 7fedd8999700 1 -- 172.21.15.84:0/2120372120 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc40036a0 con 0x7fedd40b12f0 2023-07-14T11:14:48.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.128+0000 7feddbbff700 1 -- 172.21.15.84:0/2120372120 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fedd40b12f0 msgr2=0x7fedd40c96a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:48.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.128+0000 7feddbbff700 1 --2- 172.21.15.84:0/2120372120 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fedd40b12f0 0x7fedd40c96a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fedd406f630 tx=0x7fedc4009bd0 comp rx=0 tx=0).stop 2023-07-14T11:14:48.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.129+0000 7feddbbff700 1 -- 172.21.15.84:0/2120372120 shutdown_connections 2023-07-14T11:14:48.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.129+0000 7feddbbff700 1 --2- 172.21.15.84:0/2120372120 >> v2:172.21.15.179:3300/0 conn(0x7fedd40c92d0 0x7fedd40ad8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:48.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.129+0000 7feddbbff700 1 --2- 172.21.15.84:0/2120372120 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fedd40b12f0 0x7fedd40c96a0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:48.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.129+0000 7feddbbff700 1 -- 172.21.15.84:0/2120372120 >> 172.21.15.84:0/2120372120 conn(0x7fedd40b05d0 msgr2=0x7fedd40b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:48.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.129+0000 7feddbbff700 1 -- 172.21.15.84:0/2120372120 shutdown_connections 2023-07-14T11:14:48.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.129+0000 7feddbbff700 1 -- 172.21.15.84:0/2120372120 wait complete. 2023-07-14T11:14:48.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.130+0000 7feddbbff700 1 Processor -- start 2023-07-14T11:14:48.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.130+0000 7feddbbff700 1 -- start start 2023-07-14T11:14:48.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.131+0000 7feddbbff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fedd40adea0 0x7fedd4152de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:48.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.131+0000 7feddbbff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fedd40b12f0 0x7fedd4152090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:48.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.131+0000 7feddbbff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fedd40c92d0 0x7fedd40c66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:48.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.131+0000 7feddbbff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd4153580 con 0x7fedd40adea0 2023-07-14T11:14:48.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.131+0000 7feddbbff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd4154a40 con 0x7fedd40b12f0 2023-07-14T11:14:48.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.131+0000 7feddbbff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedd4152b90 con 0x7fedd40c92d0 2023-07-14T11:14:48.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.132+0000 7fedd999b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fedd40adea0 0x7fedd4152de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:48.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.132+0000 7fedd999b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fedd40adea0 0x7fedd4152de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53962/0 (socket says 172.21.15.84:53962) 2023-07-14T11:14:48.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.132+0000 7fedd999b700 1 -- 172.21.15.84:0/1123578678 learned_addr learned my addr 172.21.15.84:0/1123578678 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:48.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.132+0000 7fedd919a700 1 --2- 172.21.15.84:0/1123578678 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fedd40b12f0 0x7fedd4152090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:48.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.132+0000 7fedda19c700 1 --2- 172.21.15.84:0/1123578678 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fedd40c92d0 0x7fedd40c66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:48.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.132+0000 7fedd999b700 1 -- 172.21.15.84:0/1123578678 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fedd40c92d0 msgr2=0x7fedd40c66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:48.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.132+0000 7fedd999b700 1 --2- 172.21.15.84:0/1123578678 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fedd40c92d0 0x7fedd40c66d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:48.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.132+0000 7fedd999b700 1 -- 172.21.15.84:0/1123578678 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fedd40b12f0 msgr2=0x7fedd4152090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:48.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.132+0000 7fedd999b700 1 --2- 172.21.15.84:0/1123578678 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fedd40b12f0 0x7fedd4152090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:48.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.132+0000 7fedd999b700 1 -- 172.21.15.84:0/1123578678 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc4009550 con 0x7fedd40adea0 2023-07-14T11:14:48.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.132+0000 7fedd999b700 1 --2- 172.21.15.84:0/1123578678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fedd40adea0 0x7fedd4152de0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fedd000d800 tx=0x7fedd000db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:48.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.132+0000 7fedca7fc700 1 -- 172.21.15.84:0/1123578678 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd00125f0 con 0x7fedd40adea0 2023-07-14T11:14:48.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.132+0000 7fedca7fc700 1 -- 172.21.15.84:0/1123578678 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedd0012750 con 0x7fedd40adea0 2023-07-14T11:14:48.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.132+0000 7fedca7fc700 1 -- 172.21.15.84:0/1123578678 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd0012b00 con 0x7fedd40adea0 2023-07-14T11:14:48.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.132+0000 7feddbbff700 1 -- 172.21.15.84:0/1123578678 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedd41528b0 con 0x7fedd40adea0 2023-07-14T11:14:48.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.133+0000 7feddbbff700 1 -- 172.21.15.84:0/1123578678 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedd41543f0 con 0x7fedd40adea0 2023-07-14T11:14:48.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.134+0000 7feddbbff700 1 -- 172.21.15.84:0/1123578678 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedd4154d20 con 0x7fedd40adea0 2023-07-14T11:14:48.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.134+0000 7fedca7fc700 1 -- 172.21.15.84:0/1123578678 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7fedd0012c60 con 0x7fedd40adea0 2023-07-14T11:14:48.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.135+0000 7fedca7fc700 1 --2- 172.21.15.84:0/1123578678 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fedb806ad70 0x7fedb806d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:48.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.135+0000 7fedca7fc700 1 -- 172.21.15.84:0/1123578678 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fedd0089830 con 0x7fedd40adea0 2023-07-14T11:14:48.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.136+0000 7fedd919a700 1 --2- 172.21.15.84:0/1123578678 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fedb806ad70 0x7fedb806d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:48.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.136+0000 7fedd919a700 1 --2- 172.21.15.84:0/1123578678 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fedb806ad70 0x7fedb806d220 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fedc4009130 tx=0x7fedc4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:48.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.140+0000 7fedca7fc700 1 -- 172.21.15.84:0/1123578678 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fedd0054880 con 0x7fedd40adea0 2023-07-14T11:14:48.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.333+0000 7feddbbff700 1 -- 172.21.15.84:0/1123578678 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fedd4074350 con 0x7fedd40adea0 2023-07-14T11:14:48.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.334+0000 7fedca7fc700 1 -- 172.21.15.84:0/1123578678 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7fedd0057ea0 con 0x7fedd40adea0 2023-07-14T11:14:48.336 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-07-14T11:14:48.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.336+0000 7feddbbff700 1 -- 172.21.15.84:0/1123578678 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fedb806ad70 msgr2=0x7fedb806d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:48.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.336+0000 7feddbbff700 1 --2- 172.21.15.84:0/1123578678 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fedb806ad70 0x7fedb806d220 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fedc4009130 tx=0x7fedc4008030 comp rx=0 tx=0).stop 2023-07-14T11:14:48.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.336+0000 7feddbbff700 1 -- 172.21.15.84:0/1123578678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fedd40adea0 msgr2=0x7fedd4152de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:48.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.336+0000 7feddbbff700 1 --2- 172.21.15.84:0/1123578678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fedd40adea0 0x7fedd4152de0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fedd000d800 tx=0x7fedd000db10 comp rx=0 tx=0).stop 2023-07-14T11:14:48.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.336+0000 7feddbbff700 1 -- 172.21.15.84:0/1123578678 shutdown_connections 2023-07-14T11:14:48.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.336+0000 7feddbbff700 1 --2- 172.21.15.84:0/1123578678 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fedb806ad70 0x7fedb806d220 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:48.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.336+0000 7feddbbff700 1 --2- 172.21.15.84:0/1123578678 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fedd40c92d0 0x7fedd40c66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:48.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.336+0000 7feddbbff700 1 --2- 172.21.15.84:0/1123578678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fedd40adea0 0x7fedd4152de0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:48.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.336+0000 7feddbbff700 1 --2- 172.21.15.84:0/1123578678 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fedd40b12f0 0x7fedd4152090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:48.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.336+0000 7feddbbff700 1 -- 172.21.15.84:0/1123578678 >> 172.21.15.84:0/1123578678 conn(0x7fedd40b05d0 msgr2=0x7fedd406f730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:48.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.337+0000 7feddbbff700 1 -- 172.21.15.84:0/1123578678 shutdown_connections 2023-07-14T11:14:48.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.337+0000 7feddbbff700 1 -- 172.21.15.84:0/1123578678 wait complete. 2023-07-14T11:14:48.356 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T11:14:48.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.552+0000 7fd465fff700 1 Processor -- start 2023-07-14T11:14:48.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.552+0000 7fd465fff700 1 -- start start 2023-07-14T11:14:48.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.553+0000 7fd465fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd4600b8a60 0x7fd4600b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:48.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.553+0000 7fd465fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd4600d1220 0x7fd4600b0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:48.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.553+0000 7fd465fff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4600b8e30 con 0x7fd4600b4530 2023-07-14T11:14:48.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.553+0000 7fd465fff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4600afaa0 con 0x7fd4600d1220 2023-07-14T11:14:48.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.553+0000 7fd465fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4600afd80 con 0x7fd4600b8a60 2023-07-14T11:14:48.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.554+0000 7fd45ffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd4600d1220 0x7fd4600b0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:48.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.554+0000 7fd457fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fd4600b4530 0x7fd4600d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51254/0 (socket says 172.21.15.84:51254) 2023-07-14T11:14:48.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.554+0000 7fd457fff700 1 -- 172.21.15.84:0/3828312198 learned_addr learned my addr 172.21.15.84:0/3828312198 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:14:48.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.554+0000 7fd45f7fe700 1 --2- 172.21.15.84:0/3828312198 >> v2:172.21.15.179:3300/0 conn(0x7fd4600b8a60 0x7fd4600b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:48.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.554+0000 7fd45ffff700 1 -- 172.21.15.84:0/3828312198 >> v2:172.21.15.179:3300/0 conn(0x7fd4600b8a60 msgr2=0x7fd4600b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:48.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.554+0000 7fd45ffff700 1 --2- 172.21.15.84:0/3828312198 >> v2:172.21.15.179:3300/0 conn(0x7fd4600b8a60 0x7fd4600b3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:48.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.554+0000 7fd45ffff700 1 -- 172.21.15.84:0/3828312198 >> v1:172.21.15.84:6789/0 conn(0x7fd4600b4530 legacy=0x7fd4600d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:48.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.554+0000 7fd45ffff700 1 -- 172.21.15.84:0/3828312198 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4600b0060 con 0x7fd4600d1220 2023-07-14T11:14:48.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.554+0000 7fd45effd700 1 -- 172.21.15.84:0/3828312198 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4074468007 0 0) 0x7fd4600b8e30 con 0x7fd4600b4530 2023-07-14T11:14:48.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.555+0000 7fd45ffff700 1 --2- 172.21.15.84:0/3828312198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4600d1220 0x7fd4600b0e20 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fd4600b5b00 tx=0x7fd45800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc3b0c8bc08064cd server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:48.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.555+0000 7fd45effd700 1 -- 172.21.15.84:0/3828312198 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45800e070 con 0x7fd4600d1220 2023-07-14T11:14:48.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.555+0000 7fd45effd700 1 -- 172.21.15.84:0/3828312198 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd45800bb20 con 0x7fd4600d1220 2023-07-14T11:14:48.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.555+0000 7fd45effd700 1 -- 172.21.15.84:0/3828312198 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd458012430 con 0x7fd4600d1220 2023-07-14T11:14:48.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.555+0000 7fd465fff700 1 -- 172.21.15.84:0/3828312198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4600d1220 msgr2=0x7fd4600b0e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:48.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.555+0000 7fd465fff700 1 --2- 172.21.15.84:0/3828312198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4600d1220 0x7fd4600b0e20 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fd4600b5b00 tx=0x7fd45800b330 comp rx=0 tx=0).stop 2023-07-14T11:14:48.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.555+0000 7fd465fff700 1 -- 172.21.15.84:0/3828312198 shutdown_connections 2023-07-14T11:14:48.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.555+0000 7fd465fff700 1 --2- 172.21.15.84:0/3828312198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4600d1220 0x7fd4600b0e20 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:48.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.555+0000 7fd465fff700 1 --2- 172.21.15.84:0/3828312198 >> v2:172.21.15.179:3300/0 conn(0x7fd4600b8a60 0x7fd4600b3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:48.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.555+0000 7fd465fff700 1 -- 172.21.15.84:0/3828312198 >> 172.21.15.84:0/3828312198 conn(0x7fd46009c1b0 msgr2=0x7fd4600d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:48.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.556+0000 7fd465fff700 1 -- 172.21.15.84:0/3828312198 shutdown_connections 2023-07-14T11:14:48.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.556+0000 7fd465fff700 1 -- 172.21.15.84:0/3828312198 wait complete. 2023-07-14T11:14:48.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.557+0000 7fd465fff700 1 Processor -- start 2023-07-14T11:14:48.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.557+0000 7fd465fff700 1 -- start start 2023-07-14T11:14:48.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.558+0000 7fd465fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4600b4530 0x7fd46015f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:48.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.558+0000 7fd465fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4600b8a60 0x7fd4600b74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:48.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.558+0000 7fd465fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4600d1220 0x7fd4601f5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:48.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.558+0000 7fd465fff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd46015aec0 con 0x7fd4600b4530 2023-07-14T11:14:48.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.558+0000 7fd465fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd46015d530 con 0x7fd4600b8a60 2023-07-14T11:14:48.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.558+0000 7fd465fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd46015d810 con 0x7fd4600d1220 2023-07-14T11:14:48.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.559+0000 7fd45f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4600b4530 0x7fd46015f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:48.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.559+0000 7fd45f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4600b4530 0x7fd46015f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53980/0 (socket says 172.21.15.84:53980) 2023-07-14T11:14:48.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.559+0000 7fd45f7fe700 1 -- 172.21.15.84:0/3363281255 learned_addr learned my addr 172.21.15.84:0/3363281255 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:48.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.559+0000 7fd457fff700 1 --2- 172.21.15.84:0/3363281255 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4600b8a60 0x7fd4600b74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:48.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.559+0000 7fd45ffff700 1 --2- 172.21.15.84:0/3363281255 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4600d1220 0x7fd4601f5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:48.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.559+0000 7fd45f7fe700 1 -- 172.21.15.84:0/3363281255 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4600d1220 msgr2=0x7fd4601f5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:48.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.559+0000 7fd45f7fe700 1 --2- 172.21.15.84:0/3363281255 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4600d1220 0x7fd4601f5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:48.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.559+0000 7fd45f7fe700 1 -- 172.21.15.84:0/3363281255 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4600b8a60 msgr2=0x7fd4600b74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:48.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.559+0000 7fd45f7fe700 1 --2- 172.21.15.84:0/3363281255 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4600b8a60 0x7fd4600b74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:48.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.559+0000 7fd45f7fe700 1 -- 172.21.15.84:0/3363281255 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd458009a70 con 0x7fd4600b4530 2023-07-14T11:14:48.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.559+0000 7fd45f7fe700 1 --2- 172.21.15.84:0/3363281255 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4600b4530 0x7fd46015f500 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fd45000e9b0 tx=0x7fd45000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:48.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.560+0000 7fd45cff9700 1 -- 172.21.15.84:0/3363281255 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd450009710 con 0x7fd4600b4530 2023-07-14T11:14:48.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.560+0000 7fd45cff9700 1 -- 172.21.15.84:0/3363281255 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd45000ee50 con 0x7fd4600b4530 2023-07-14T11:14:48.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.560+0000 7fd465fff700 1 -- 172.21.15.84:0/3363281255 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd46015daf0 con 0x7fd4600b4530 2023-07-14T11:14:48.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.560+0000 7fd45cff9700 1 -- 172.21.15.84:0/3363281255 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45000ca50 con 0x7fd4600b4530 2023-07-14T11:14:48.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.560+0000 7fd465fff700 1 -- 172.21.15.84:0/3363281255 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd46015fa40 con 0x7fd4600b4530 2023-07-14T11:14:48.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.561+0000 7fd465fff700 1 -- 172.21.15.84:0/3363281255 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4600d2440 con 0x7fd4600b4530 2023-07-14T11:14:48.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.562+0000 7fd45cff9700 1 -- 172.21.15.84:0/3363281255 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7fd45000cbb0 con 0x7fd4600b4530 2023-07-14T11:14:48.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.562+0000 7fd45cff9700 1 --2- 172.21.15.84:0/3363281255 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fd44006ad70 0x7fd44006d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:48.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.563+0000 7fd45cff9700 1 -- 172.21.15.84:0/3363281255 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd450089500 con 0x7fd4600b4530 2023-07-14T11:14:48.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.563+0000 7fd457fff700 1 --2- 172.21.15.84:0/3363281255 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fd44006ad70 0x7fd44006d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:48.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.563+0000 7fd457fff700 1 --2- 172.21.15.84:0/3363281255 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fd44006ad70 0x7fd44006d220 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd448007fd0 tx=0x7fd448007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:48.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.567+0000 7fd45cff9700 1 -- 172.21.15.84:0/3363281255 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fd450057fe0 con 0x7fd4600b4530 2023-07-14T11:14:48.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.761+0000 7fd465fff700 1 -- 172.21.15.84:0/3363281255 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd460074350 con 0x7fd4600b4530 2023-07-14T11:14:48.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.762+0000 7fd45cff9700 1 -- 172.21.15.84:0/3363281255 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v37) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd45000ce60 con 0x7fd4600b4530 2023-07-14T11:14:48.764 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-07-14T11:14:48.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.764+0000 7fd465fff700 1 -- 172.21.15.84:0/3363281255 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fd44006ad70 msgr2=0x7fd44006d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:48.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.764+0000 7fd465fff700 1 --2- 172.21.15.84:0/3363281255 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fd44006ad70 0x7fd44006d220 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd448007fd0 tx=0x7fd448007de0 comp rx=0 tx=0).stop 2023-07-14T11:14:48.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.764+0000 7fd465fff700 1 -- 172.21.15.84:0/3363281255 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4600b4530 msgr2=0x7fd46015f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:48.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.764+0000 7fd465fff700 1 --2- 172.21.15.84:0/3363281255 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4600b4530 0x7fd46015f500 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fd45000e9b0 tx=0x7fd45000ecc0 comp rx=0 tx=0).stop 2023-07-14T11:14:48.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.764+0000 7fd465fff700 1 -- 172.21.15.84:0/3363281255 shutdown_connections 2023-07-14T11:14:48.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.764+0000 7fd465fff700 1 --2- 172.21.15.84:0/3363281255 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fd44006ad70 0x7fd44006d220 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:48.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.764+0000 7fd465fff700 1 --2- 172.21.15.84:0/3363281255 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4600d1220 0x7fd4601f5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:48.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.764+0000 7fd465fff700 1 --2- 172.21.15.84:0/3363281255 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4600b4530 0x7fd46015f500 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:48.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.764+0000 7fd465fff700 1 --2- 172.21.15.84:0/3363281255 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4600b8a60 0x7fd4600b74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:48.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.765+0000 7fd465fff700 1 -- 172.21.15.84:0/3363281255 >> 172.21.15.84:0/3363281255 conn(0x7fd46009c1b0 msgr2=0x7fd4600b0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:48.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.765+0000 7fd465fff700 1 -- 172.21.15.84:0/3363281255 shutdown_connections 2023-07-14T11:14:48.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.765+0000 7fd465fff700 1 -- 172.21.15.84:0/3363281255 wait complete. 2023-07-14T11:14:48.785 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T11:14:48.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.984+0000 7f13871ff700 1 Processor -- start 2023-07-14T11:14:48.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.984+0000 7f13871ff700 1 -- start start 2023-07-14T11:14:48.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.985+0000 7f13871ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13800b4d00 0x7f13800d19d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:48.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.985+0000 7f13871ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13800d02a0 con 0x7f13800b4860 2023-07-14T11:14:48.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.985+0000 7f13871ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13800cfce0 con 0x7f13800b8660 2023-07-14T11:14:48.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.985+0000 7f13871ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13800cffc0 con 0x7f13800b4d00 2023-07-14T11:14:48.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.986+0000 7f137ffff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f13800b4860 0x7f13800d12c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49928/0 (socket says 172.21.15.84:49928) 2023-07-14T11:14:48.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.986+0000 7f137ffff700 1 -- 172.21.15.84:0/1446576461 learned_addr learned my addr 172.21.15.84:0/1446576461 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:14:48.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.986+0000 7f138579c700 1 --2- 172.21.15.84:0/1446576461 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13800b4d00 0x7f13800d19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:48.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.986+0000 7f137f7fe700 1 -- 172.21.15.84:0/1446576461 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1447290497 0 0) 0x7f13800d02a0 con 0x7f13800b4860 2023-07-14T11:14:48.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.986+0000 7f137f7fe700 1 -- 172.21.15.84:0/1446576461 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13700035b0 con 0x7f13800b4860 2023-07-14T11:14:48.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.986+0000 7f137f7fe700 1 -- 172.21.15.84:0/1446576461 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1718496093 0 0) 0x7f13800cfce0 con 0x7f13800b8660 2023-07-14T11:14:48.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.986+0000 7f137f7fe700 1 -- 172.21.15.84:0/1446576461 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13800d02a0 con 0x7f13800b8660 2023-07-14T11:14:48.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.986+0000 7f137f7fe700 1 -- 172.21.15.84:0/1446576461 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1998857263 0 0) 0x7f13700035b0 con 0x7f13800b4860 2023-07-14T11:14:48.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.986+0000 7f137f7fe700 1 -- 172.21.15.84:0/1446576461 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13800b4d00 msgr2=0x7f13800d19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:48.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.986+0000 7f137f7fe700 1 --2- 172.21.15.84:0/1446576461 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13800b4d00 0x7f13800d19d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:48.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.986+0000 7f137f7fe700 1 -- 172.21.15.84:0/1446576461 >> v1:172.21.15.179:6789/0 conn(0x7f13800b8660 legacy=0x7f13800cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:48.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.986+0000 7f137f7fe700 1 -- 172.21.15.84:0/1446576461 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13800d0ac0 con 0x7f13800b4860 2023-07-14T11:14:48.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.986+0000 7f137f7fe700 1 -- 172.21.15.84:0/1446576461 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7f136c001670 con 0x7f13800b4860 2023-07-14T11:14:48.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.986+0000 7f137f7fe700 1 -- 172.21.15.84:0/1446576461 >> v1:172.21.15.84:6789/0 conn(0x7f13800b4860 legacy=0x7f13800d12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:48.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.987+0000 7f137f7fe700 1 --2- 172.21.15.84:0/1446576461 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1370003bc0 0x7f1370003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:48.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.987+0000 7f137f7fe700 1 --2- 172.21.15.84:0/1446576461 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13800b4d00 0x7f1370004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:48.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.987+0000 7f137f7fe700 1 --2- 172.21.15.84:0/1446576461 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1370004d90 0x7f1370005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:48.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.987+0000 7f137f7fe700 1 -- 172.21.15.84:0/1446576461 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13800cffc0 con 0x7f1370003bc0 2023-07-14T11:14:48.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.987+0000 7f137f7fe700 1 -- 172.21.15.84:0/1446576461 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f137000bac0 con 0x7f1370004d90 2023-07-14T11:14:48.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.987+0000 7f137f7fe700 1 -- 172.21.15.84:0/1446576461 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f137000bc50 con 0x7f13800b4d00 2023-07-14T11:14:48.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.987+0000 7f1384f9b700 1 --2- 172.21.15.84:0/1446576461 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1370003bc0 0x7f1370003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:48.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.987+0000 7f138579c700 1 --2- 172.21.15.84:0/1446576461 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1370004d90 0x7f1370005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:48.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.987+0000 7f137ffff700 1 --2- 172.21.15.84:0/1446576461 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13800b4d00 0x7f1370004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:48.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.987+0000 7f1384f9b700 1 -- 172.21.15.84:0/1446576461 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13800b4d00 msgr2=0x7f1370004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:48.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.987+0000 7f1384f9b700 1 --2- 172.21.15.84:0/1446576461 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13800b4d00 0x7f1370004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:48.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.987+0000 7f1384f9b700 1 -- 172.21.15.84:0/1446576461 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1370004d90 msgr2=0x7f1370005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:48.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.987+0000 7f1384f9b700 1 --2- 172.21.15.84:0/1446576461 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1370004d90 0x7f1370005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:48.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.987+0000 7f1384f9b700 1 -- 172.21.15.84:0/1446576461 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13700035b0 con 0x7f1370003bc0 2023-07-14T11:14:48.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.987+0000 7f137ffff700 1 --2- 172.21.15.84:0/1446576461 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13800b4d00 0x7f1370004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:14:48.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.987+0000 7f1384f9b700 1 --2- 172.21.15.84:0/1446576461 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1370003bc0 0x7f1370003fb0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f137400c2f0 tx=0x7f1370005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=124d737a6c7b6556 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:48.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.988+0000 7f137f7fe700 1 -- 172.21.15.84:0/1446576461 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1374001f30 con 0x7f1370003bc0 2023-07-14T11:14:48.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.988+0000 7f137f7fe700 1 -- 172.21.15.84:0/1446576461 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f137400ce90 con 0x7f1370003bc0 2023-07-14T11:14:48.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.988+0000 7f137f7fe700 1 -- 172.21.15.84:0/1446576461 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1374003c40 con 0x7f1370003bc0 2023-07-14T11:14:48.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.988+0000 7f13871ff700 1 -- 172.21.15.84:0/1446576461 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1370003bc0 msgr2=0x7f1370003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:48.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.988+0000 7f13871ff700 1 --2- 172.21.15.84:0/1446576461 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1370003bc0 0x7f1370003fb0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f137400c2f0 tx=0x7f1370005880 comp rx=0 tx=0).stop 2023-07-14T11:14:48.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.988+0000 7f138579c700 1 -- 172.21.15.84:0/1446576461 reap_dead start 2023-07-14T11:14:48.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.988+0000 7f13871ff700 1 -- 172.21.15.84:0/1446576461 shutdown_connections 2023-07-14T11:14:48.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.988+0000 7f13871ff700 1 -- 172.21.15.84:0/1446576461 >> 172.21.15.84:0/1446576461 conn(0x7f1380066860 msgr2=0x7f138006a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:48.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.988+0000 7f13871ff700 1 -- 172.21.15.84:0/1446576461 shutdown_connections 2023-07-14T11:14:48.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.988+0000 7f13871ff700 1 -- 172.21.15.84:0/1446576461 wait complete. 2023-07-14T11:14:48.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.990+0000 7f13871ff700 1 Processor -- start 2023-07-14T11:14:48.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.990+0000 7f13871ff700 1 -- start start 2023-07-14T11:14:48.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.991+0000 7f13871ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1370003bc0 0x7f13801f5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:48.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.991+0000 7f13871ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13801e5310 0x7f13801e18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:48.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.991+0000 7f13871ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13801e5780 0x7f13800ca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:48.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.991+0000 7f13871ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13801e4e80 con 0x7f1370003bc0 2023-07-14T11:14:48.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.991+0000 7f13871ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13801f5d80 con 0x7f13801e5310 2023-07-14T11:14:48.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.991+0000 7f13871ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f138014ec70 con 0x7f13801e5780 2023-07-14T11:14:48.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.991+0000 7f1384f9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1370003bc0 0x7f13801f5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:48.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.991+0000 7f1384f9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1370003bc0 0x7f13801f5840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58796/0 (socket says 172.21.15.84:58796) 2023-07-14T11:14:48.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.991+0000 7f1384f9b700 1 -- 172.21.15.84:0/1083985706 learned_addr learned my addr 172.21.15.84:0/1083985706 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:48.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.992+0000 7f138579c700 1 --2- 172.21.15.84:0/1083985706 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13801e5780 0x7f13800ca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:48.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.992+0000 7f1384f9b700 1 -- 172.21.15.84:0/1083985706 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13801e5780 msgr2=0x7f13800ca6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:48.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.992+0000 7f1384f9b700 1 --2- 172.21.15.84:0/1083985706 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13801e5780 0x7f13800ca6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:48.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.992+0000 7f137ffff700 1 --2- 172.21.15.84:0/1083985706 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13801e5310 0x7f13801e18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:48.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.992+0000 7f1384f9b700 1 -- 172.21.15.84:0/1083985706 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13801e5310 msgr2=0x7f13801e18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:48.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.992+0000 7f1384f9b700 1 --2- 172.21.15.84:0/1083985706 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13801e5310 0x7f13801e18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:48.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.992+0000 7f1384f9b700 1 -- 172.21.15.84:0/1083985706 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13801e4270 con 0x7f1370003bc0 2023-07-14T11:14:49.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.992+0000 7f138579c700 1 --2- 172.21.15.84:0/1083985706 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13801e5780 0x7f13800ca6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:14:49.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.992+0000 7f137ffff700 1 --2- 172.21.15.84:0/1083985706 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13801e5310 0x7f13801e18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:14:49.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.992+0000 7f1384f9b700 1 --2- 172.21.15.84:0/1083985706 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1370003bc0 0x7f13801f5840 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f13700047a0 tx=0x7f1374001650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:49.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.992+0000 7f137d7fa700 1 -- 172.21.15.84:0/1083985706 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13740052e0 con 0x7f1370003bc0 2023-07-14T11:14:49.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.992+0000 7f137d7fa700 1 -- 172.21.15.84:0/1083985706 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1374005440 con 0x7f1370003bc0 2023-07-14T11:14:49.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.992+0000 7f137d7fa700 1 -- 172.21.15.84:0/1083985706 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13740057d0 con 0x7f1370003bc0 2023-07-14T11:14:49.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.992+0000 7f13871ff700 1 -- 172.21.15.84:0/1083985706 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13801e4550 con 0x7f1370003bc0 2023-07-14T11:14:49.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.993+0000 7f13871ff700 1 -- 172.21.15.84:0/1083985706 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13801e4b10 con 0x7f1370003bc0 2023-07-14T11:14:49.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.993+0000 7f13871ff700 1 -- 172.21.15.84:0/1083985706 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13800b55b0 con 0x7f1370003bc0 2023-07-14T11:14:49.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.994+0000 7f137d7fa700 1 -- 172.21.15.84:0/1083985706 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 7) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f1374019070 con 0x7f1370003bc0 2023-07-14T11:14:49.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.996+0000 7f137d7fa700 1 --2- 172.21.15.84:0/1083985706 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f136406aec0 0x7f136406d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:49.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.996+0000 7f137d7fa700 1 -- 172.21.15.84:0/1083985706 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f137408abe0 con 0x7f1370003bc0 2023-07-14T11:14:49.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.996+0000 7f137ffff700 1 --2- 172.21.15.84:0/1083985706 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f136406aec0 0x7f136406d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:49.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:48.996+0000 7f137ffff700 1 --2- 172.21.15.84:0/1083985706 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f136406aec0 0x7f136406d370 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f13800d2060 tx=0x7f136c001470 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:49.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.000+0000 7f137d7fa700 1 -- 172.21.15.84:0/1083985706 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f1374055b20 con 0x7f1370003bc0 2023-07-14T11:14:49.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.200+0000 7f13871ff700 1 -- 172.21.15.84:0/1083985706 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1380074350 con 0x7f1370003bc0 2023-07-14T11:14:49.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.201+0000 7f137d7fa700 1 -- 172.21.15.84:0/1083985706 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v37) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1374017020 con 0x7f1370003bc0 2023-07-14T11:14:49.203 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-07-14T11:14:49.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.203+0000 7f13871ff700 1 -- 172.21.15.84:0/1083985706 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f136406aec0 msgr2=0x7f136406d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:49.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.203+0000 7f13871ff700 1 --2- 172.21.15.84:0/1083985706 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f136406aec0 0x7f136406d370 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f13800d2060 tx=0x7f136c001470 comp rx=0 tx=0).stop 2023-07-14T11:14:49.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.203+0000 7f13871ff700 1 -- 172.21.15.84:0/1083985706 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1370003bc0 msgr2=0x7f13801f5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:49.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.203+0000 7f13871ff700 1 --2- 172.21.15.84:0/1083985706 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1370003bc0 0x7f13801f5840 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f13700047a0 tx=0x7f1374001650 comp rx=0 tx=0).stop 2023-07-14T11:14:49.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.203+0000 7f13871ff700 1 -- 172.21.15.84:0/1083985706 shutdown_connections 2023-07-14T11:14:49.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.203+0000 7f13871ff700 1 --2- 172.21.15.84:0/1083985706 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f136406aec0 0x7f136406d370 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:49.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.203+0000 7f13871ff700 1 --2- 172.21.15.84:0/1083985706 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13801e5780 0x7f13800ca6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:49.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.203+0000 7f13871ff700 1 --2- 172.21.15.84:0/1083985706 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1370003bc0 0x7f13801f5840 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:49.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.203+0000 7f13871ff700 1 --2- 172.21.15.84:0/1083985706 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13801e5310 0x7f13801e18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:49.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.203+0000 7f13871ff700 1 -- 172.21.15.84:0/1083985706 >> 172.21.15.84:0/1083985706 conn(0x7f1380066860 msgr2=0x7f13800c8920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:49.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.203+0000 7f13871ff700 1 -- 172.21.15.84:0/1083985706 shutdown_connections 2023-07-14T11:14:49.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.203+0000 7f13871ff700 1 -- 172.21.15.84:0/1083985706 wait complete. 2023-07-14T11:14:49.223 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T11:14:49.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.418+0000 7f58473ff700 1 Processor -- start 2023-07-14T11:14:49.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.419+0000 7f58473ff700 1 -- start start 2023-07-14T11:14:49.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.420+0000 7f58473ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f584006a640 0x7f58401601d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:49.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.420+0000 7f58473ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58400cdba0 con 0x7f584006f010 2023-07-14T11:14:49.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.420+0000 7f58473ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58400cf370 con 0x7f58400ce030 2023-07-14T11:14:49.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.421+0000 7f58473ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f584006f3e0 con 0x7f584006a640 2023-07-14T11:14:49.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.421+0000 7f584519b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f584006f010 0x7f5840071650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49934/0 (socket says 172.21.15.84:49934) 2023-07-14T11:14:49.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.421+0000 7f584519b700 1 -- 172.21.15.84:0/2933577551 learned_addr learned my addr 172.21.15.84:0/2933577551 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:14:49.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.421+0000 7f5837fff700 1 -- 172.21.15.84:0/2933577551 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2615985897 0 0) 0x7f58400cdba0 con 0x7f584006f010 2023-07-14T11:14:49.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.421+0000 7f5837fff700 1 -- 172.21.15.84:0/2933577551 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f582c0035b0 con 0x7f584006f010 2023-07-14T11:14:49.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.421+0000 7f5837fff700 1 -- 172.21.15.84:0/2933577551 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3951071329 0 0) 0x7f582c0035b0 con 0x7f584006f010 2023-07-14T11:14:49.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.421+0000 7f5837fff700 1 -- 172.21.15.84:0/2933577551 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f584006a640 msgr2=0x7f58401601d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:49.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.421+0000 7f5837fff700 1 --2- 172.21.15.84:0/2933577551 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f584006a640 0x7f58401601d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:49.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.421+0000 7f5837fff700 1 -- 172.21.15.84:0/2933577551 >> v1:172.21.15.179:6789/0 conn(0x7f58400ce030 legacy=0x7f5840069f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:49.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.421+0000 7f5837fff700 1 -- 172.21.15.84:0/2933577551 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58400cf650 con 0x7f584006f010 2023-07-14T11:14:49.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.421+0000 7f5837fff700 1 -- 172.21.15.84:0/2933577551 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7f583c001670 con 0x7f584006f010 2023-07-14T11:14:49.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.421+0000 7f5837fff700 1 -- 172.21.15.84:0/2933577551 >> v1:172.21.15.84:6789/0 conn(0x7f584006f010 legacy=0x7f5840071650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:49.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.421+0000 7f5837fff700 1 --2- 172.21.15.84:0/2933577551 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f582c003a30 0x7f582c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:49.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.421+0000 7f5837fff700 1 --2- 172.21.15.84:0/2933577551 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f582c004850 0x7f582c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:49.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.421+0000 7f5837fff700 1 --2- 172.21.15.84:0/2933577551 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f584006a640 0x7f582c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:49.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.422+0000 7f5837fff700 1 -- 172.21.15.84:0/2933577551 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f584006f3e0 con 0x7f582c004850 2023-07-14T11:14:49.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.422+0000 7f5837fff700 1 -- 172.21.15.84:0/2933577551 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f582c005590 con 0x7f582c003a30 2023-07-14T11:14:49.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.422+0000 7f5837fff700 1 -- 172.21.15.84:0/2933577551 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f582c00bf50 con 0x7f584006a640 2023-07-14T11:14:49.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.422+0000 7f584499a700 1 --2- 172.21.15.84:0/2933577551 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f582c004850 0x7f582c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:49.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.422+0000 7f584499a700 1 -- 172.21.15.84:0/2933577551 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f584006a640 msgr2=0x7f582c00ba10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T11:14:49.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.422+0000 7f584499a700 1 --2- 172.21.15.84:0/2933577551 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f584006a640 0x7f582c00ba10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:49.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.422+0000 7f584499a700 1 -- 172.21.15.84:0/2933577551 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f582c003a30 msgr2=0x7f582c003e20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T11:14:49.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.422+0000 7f584499a700 1 --2- 172.21.15.84:0/2933577551 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f582c003a30 0x7f582c003e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:49.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.422+0000 7f584499a700 1 -- 172.21.15.84:0/2933577551 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f582c0035b0 con 0x7f582c004850 2023-07-14T11:14:49.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.422+0000 7f584499a700 1 --2- 172.21.15.84:0/2933577551 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f582c004850 0x7f582c004cc0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f58300016c0 tx=0x7f582c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4233ee89b64f544 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:49.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.423+0000 7f5837fff700 1 -- 172.21.15.84:0/2933577551 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58300052d0 con 0x7f582c004850 2023-07-14T11:14:49.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.423+0000 7f5837fff700 1 -- 172.21.15.84:0/2933577551 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5830005430 con 0x7f582c004850 2023-07-14T11:14:49.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.423+0000 7f5837fff700 1 -- 172.21.15.84:0/2933577551 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58300038e0 con 0x7f582c004850 2023-07-14T11:14:49.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.423+0000 7f58473ff700 1 -- 172.21.15.84:0/2933577551 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f582c004850 msgr2=0x7f582c004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:49.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.423+0000 7f58473ff700 1 --2- 172.21.15.84:0/2933577551 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f582c004850 0x7f582c004cc0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f58300016c0 tx=0x7f582c005880 comp rx=0 tx=0).stop 2023-07-14T11:14:49.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.423+0000 7f584599c700 1 -- 172.21.15.84:0/2933577551 reap_dead start 2023-07-14T11:14:49.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.423+0000 7f58473ff700 1 -- 172.21.15.84:0/2933577551 shutdown_connections 2023-07-14T11:14:49.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.423+0000 7f58473ff700 1 -- 172.21.15.84:0/2933577551 >> 172.21.15.84:0/2933577551 conn(0x7f58400cc640 msgr2=0x7f58400cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:49.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.423+0000 7f58473ff700 1 -- 172.21.15.84:0/2933577551 shutdown_connections 2023-07-14T11:14:49.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.423+0000 7f58473ff700 1 -- 172.21.15.84:0/2933577551 wait complete. 2023-07-14T11:14:49.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.425+0000 7f58473ff700 1 Processor -- start 2023-07-14T11:14:49.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.425+0000 7f58473ff700 1 -- start start 2023-07-14T11:14:49.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.426+0000 7f58473ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f582c004850 0x7f584015bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:49.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.426+0000 7f58473ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58400b1d00 0x7f584015b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:49.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.426+0000 7f58473ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58401e7860 0x7f58401e7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:49.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.426+0000 7f58473ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58401e8210 con 0x7f582c004850 2023-07-14T11:14:49.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.426+0000 7f58473ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58400b0bc0 con 0x7f58400b1d00 2023-07-14T11:14:49.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.426+0000 7f58473ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58400b2170 con 0x7f58401e7860 2023-07-14T11:14:49.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.426+0000 7f584519b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f582c004850 0x7f584015bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:49.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.426+0000 7f584519b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f582c004850 0x7f584015bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58806/0 (socket says 172.21.15.84:58806) 2023-07-14T11:14:49.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.426+0000 7f584519b700 1 -- 172.21.15.84:0/2782737187 learned_addr learned my addr 172.21.15.84:0/2782737187 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:49.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.426+0000 7f584599c700 1 --2- 172.21.15.84:0/2782737187 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58401e7860 0x7f58401e7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:49.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.427+0000 7f584519b700 1 -- 172.21.15.84:0/2782737187 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58401e7860 msgr2=0x7f58401e7cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:49.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.427+0000 7f584519b700 1 --2- 172.21.15.84:0/2782737187 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58401e7860 0x7f58401e7cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:49.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.427+0000 7f584519b700 1 -- 172.21.15.84:0/2782737187 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58400b1d00 msgr2=0x7f584015b760 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-14T11:14:49.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.427+0000 7f584519b700 1 --2- 172.21.15.84:0/2782737187 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58400b1d00 0x7f584015b760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:49.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.427+0000 7f584519b700 1 -- 172.21.15.84:0/2782737187 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58400affb0 con 0x7f582c004850 2023-07-14T11:14:49.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.427+0000 7f584519b700 1 --2- 172.21.15.84:0/2782737187 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f582c004850 0x7f584015bdd0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f583c00cb00 tx=0x7f583c00cec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:49.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.427+0000 7f5835ffb700 1 -- 172.21.15.84:0/2782737187 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f583c004a80 con 0x7f582c004850 2023-07-14T11:14:49.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.427+0000 7f5835ffb700 1 -- 172.21.15.84:0/2782737187 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f583c004c00 con 0x7f582c004850 2023-07-14T11:14:49.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.427+0000 7f5835ffb700 1 -- 172.21.15.84:0/2782737187 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f583c0070d0 con 0x7f582c004850 2023-07-14T11:14:49.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.427+0000 7f58473ff700 1 -- 172.21.15.84:0/2782737187 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58400b0290 con 0x7f582c004850 2023-07-14T11:14:49.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.427+0000 7f58473ff700 1 -- 172.21.15.84:0/2782737187 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58400b0850 con 0x7f582c004850 2023-07-14T11:14:49.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.428+0000 7f58473ff700 1 -- 172.21.15.84:0/2782737187 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5840074350 con 0x7f582c004850 2023-07-14T11:14:49.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.429+0000 7f5835ffb700 1 -- 172.21.15.84:0/2782737187 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 7) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f583c007230 con 0x7f582c004850 2023-07-14T11:14:49.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.430+0000 7f5835ffb700 1 --2- 172.21.15.84:0/2782737187 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f582406ae90 0x7f582406d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:49.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.430+0000 7f5835ffb700 1 -- 172.21.15.84:0/2782737187 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f583c088b00 con 0x7f582c004850 2023-07-14T11:14:49.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.430+0000 7f584499a700 1 --2- 172.21.15.84:0/2782737187 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f582406ae90 0x7f582406d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:49.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.431+0000 7f584499a700 1 --2- 172.21.15.84:0/2782737187 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f582406ae90 0x7f582406d340 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f5840066c70 tx=0x7f583000a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:49.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.434+0000 7f5835ffb700 1 -- 172.21.15.84:0/2782737187 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f583c08ae60 con 0x7f582c004850 2023-07-14T11:14:49.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.627+0000 7f58473ff700 1 -- 172.21.15.84:0/2782737187 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f58400b0f50 con 0x7f582c004850 2023-07-14T11:14:49.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.628+0000 7f5835ffb700 1 -- 172.21.15.84:0/2782737187 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v37) v1 ==== 100+0+11 (secure 0 0 0) 0x7f583c0180a0 con 0x7f582c004850 2023-07-14T11:14:49.630 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-07-14T11:14:49.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.630+0000 7f58473ff700 1 -- 172.21.15.84:0/2782737187 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f582406ae90 msgr2=0x7f582406d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:49.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.630+0000 7f58473ff700 1 --2- 172.21.15.84:0/2782737187 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f582406ae90 0x7f582406d340 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f5840066c70 tx=0x7f583000a000 comp rx=0 tx=0).stop 2023-07-14T11:14:49.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.630+0000 7f58473ff700 1 -- 172.21.15.84:0/2782737187 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f582c004850 msgr2=0x7f584015bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:49.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.630+0000 7f58473ff700 1 --2- 172.21.15.84:0/2782737187 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f582c004850 0x7f584015bdd0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f583c00cb00 tx=0x7f583c00cec0 comp rx=0 tx=0).stop 2023-07-14T11:14:49.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.630+0000 7f58473ff700 1 -- 172.21.15.84:0/2782737187 shutdown_connections 2023-07-14T11:14:49.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.630+0000 7f58473ff700 1 --2- 172.21.15.84:0/2782737187 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f582406ae90 0x7f582406d340 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:49.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.630+0000 7f58473ff700 1 --2- 172.21.15.84:0/2782737187 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58401e7860 0x7f58401e7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:49.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.630+0000 7f58473ff700 1 --2- 172.21.15.84:0/2782737187 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f582c004850 0x7f584015bdd0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:49.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.630+0000 7f58473ff700 1 --2- 172.21.15.84:0/2782737187 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58400b1d00 0x7f584015b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:49.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.630+0000 7f58473ff700 1 -- 172.21.15.84:0/2782737187 >> 172.21.15.84:0/2782737187 conn(0x7f58400cc640 msgr2=0x7f584006c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:49.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.630+0000 7f58473ff700 1 -- 172.21.15.84:0/2782737187 shutdown_connections 2023-07-14T11:14:49.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.630+0000 7f58473ff700 1 -- 172.21.15.84:0/2782737187 wait complete. 2023-07-14T11:14:49.650 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-14T11:14:49.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.847+0000 7f5e1a7ff700 1 Processor -- start 2023-07-14T11:14:49.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.848+0000 7f5e1a7ff700 1 -- start start 2023-07-14T11:14:49.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.849+0000 7f5e1a7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e140b8a60 0x7f5e140b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:49.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.849+0000 7f5e1a7ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e140b8e30 con 0x7f5e140d1220 2023-07-14T11:14:49.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.849+0000 7f5e1a7ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e140afaa0 con 0x7f5e140b4530 2023-07-14T11:14:49.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.849+0000 7f5e1a7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e140afd80 con 0x7f5e140b8a60 2023-07-14T11:14:49.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.849+0000 7f5e18d9c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f5e140d1220 0x7f5e140b0e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49940/0 (socket says 172.21.15.84:49940) 2023-07-14T11:14:49.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.849+0000 7f5e18d9c700 1 -- 172.21.15.84:0/1898607543 learned_addr learned my addr 172.21.15.84:0/1898607543 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:14:49.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.849+0000 7f5e13fff700 1 --2- 172.21.15.84:0/1898607543 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e140b8a60 0x7f5e140b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:49.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.850+0000 7f5e12ffd700 1 -- 172.21.15.84:0/1898607543 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 643125043 0 0) 0x7f5e140b8e30 con 0x7f5e140d1220 2023-07-14T11:14:49.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.850+0000 7f5e12ffd700 1 -- 172.21.15.84:0/1898607543 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5dfc0035b0 con 0x7f5e140d1220 2023-07-14T11:14:49.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.850+0000 7f5e12ffd700 1 -- 172.21.15.84:0/1898607543 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3356129258 0 0) 0x7f5e140afaa0 con 0x7f5e140b4530 2023-07-14T11:14:49.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.850+0000 7f5e12ffd700 1 -- 172.21.15.84:0/1898607543 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e140b8e30 con 0x7f5e140b4530 2023-07-14T11:14:49.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.850+0000 7f5e13fff700 1 -- 172.21.15.84:0/1898607543 >> v1:172.21.15.179:6789/0 conn(0x7f5e140b4530 legacy=0x7f5e140d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:49.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.850+0000 7f5e13fff700 1 -- 172.21.15.84:0/1898607543 >> v1:172.21.15.84:6789/0 conn(0x7f5e140d1220 legacy=0x7f5e140b0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:49.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.850+0000 7f5e13fff700 1 -- 172.21.15.84:0/1898607543 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e140b0060 con 0x7f5e140b8a60 2023-07-14T11:14:49.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.850+0000 7f5e13fff700 1 --2- 172.21.15.84:0/1898607543 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e140b8a60 0x7f5e140b3ff0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5e04009870 tx=0x7f5e04009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d9e0d2090681efc server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:49.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.850+0000 7f5e12ffd700 1 -- 172.21.15.84:0/1898607543 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e04011830 con 0x7f5e140b8a60 2023-07-14T11:14:49.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.850+0000 7f5e12ffd700 1 -- 172.21.15.84:0/1898607543 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e04011990 con 0x7f5e140b8a60 2023-07-14T11:14:49.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.850+0000 7f5e12ffd700 1 -- 172.21.15.84:0/1898607543 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e04011d20 con 0x7f5e140b8a60 2023-07-14T11:14:49.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.851+0000 7f5e1a7ff700 1 -- 172.21.15.84:0/1898607543 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e140b8a60 msgr2=0x7f5e140b3ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:49.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.851+0000 7f5e1a7ff700 1 --2- 172.21.15.84:0/1898607543 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e140b8a60 0x7f5e140b3ff0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5e04009870 tx=0x7f5e04009b80 comp rx=0 tx=0).stop 2023-07-14T11:14:49.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.851+0000 7f5e1a7ff700 1 -- 172.21.15.84:0/1898607543 shutdown_connections 2023-07-14T11:14:49.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.851+0000 7f5e1a7ff700 1 --2- 172.21.15.84:0/1898607543 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e140b8a60 0x7f5e140b3ff0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:49.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.851+0000 7f5e1a7ff700 1 -- 172.21.15.84:0/1898607543 >> 172.21.15.84:0/1898607543 conn(0x7f5e1409c1b0 msgr2=0x7f5e140d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:49.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.851+0000 7f5e1a7ff700 1 -- 172.21.15.84:0/1898607543 shutdown_connections 2023-07-14T11:14:49.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.851+0000 7f5e1a7ff700 1 -- 172.21.15.84:0/1898607543 wait complete. 2023-07-14T11:14:49.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.853+0000 7f5e1a7ff700 1 Processor -- start 2023-07-14T11:14:49.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.853+0000 7f5e1a7ff700 1 -- start start 2023-07-14T11:14:49.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.854+0000 7f5e1a7ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e140b4530 0x7f5e141f1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:49.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.854+0000 7f5e1a7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e140b8a60 0x7f5e1415d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:49.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.854+0000 7f5e1a7ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e140d1220 0x7f5e1415d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:49.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.854+0000 7f5e1a7ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e140cc4d0 con 0x7f5e140d1220 2023-07-14T11:14:49.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.854+0000 7f5e1a7ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e140cc7b0 con 0x7f5e140b4530 2023-07-14T11:14:49.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.854+0000 7f5e1a7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e14153520 con 0x7f5e140b8a60 2023-07-14T11:14:49.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.854+0000 7f5e18d9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e140d1220 0x7f5e1415d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:49.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.854+0000 7f5e18d9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e140d1220 0x7f5e1415d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58810/0 (socket says 172.21.15.84:58810) 2023-07-14T11:14:49.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.854+0000 7f5e18d9c700 1 -- 172.21.15.84:0/4259790308 learned_addr learned my addr 172.21.15.84:0/4259790308 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:49.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.854+0000 7f5e13fff700 1 --2- 172.21.15.84:0/4259790308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e140b4530 0x7f5e141f1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:49.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.854+0000 7f5e137fe700 1 --2- 172.21.15.84:0/4259790308 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e140b8a60 0x7f5e1415d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:49.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.855+0000 7f5e18d9c700 1 -- 172.21.15.84:0/4259790308 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e140b8a60 msgr2=0x7f5e1415d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:49.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.855+0000 7f5e18d9c700 1 --2- 172.21.15.84:0/4259790308 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e140b8a60 0x7f5e1415d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:49.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.855+0000 7f5e18d9c700 1 -- 172.21.15.84:0/4259790308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e140b4530 msgr2=0x7f5e141f1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:49.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.855+0000 7f5e18d9c700 1 --2- 172.21.15.84:0/4259790308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e140b4530 0x7f5e141f1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:49.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.855+0000 7f5e18d9c700 1 -- 172.21.15.84:0/4259790308 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e040094a0 con 0x7f5e140d1220 2023-07-14T11:14:49.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.855+0000 7f5e18d9c700 1 --2- 172.21.15.84:0/4259790308 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e140d1220 0x7f5e1415d570 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c00ca80 tx=0x7f5e0c00cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:49.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.855+0000 7f5e10ff9700 1 -- 172.21.15.84:0/4259790308 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e0c00a9a0 con 0x7f5e140d1220 2023-07-14T11:14:49.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.855+0000 7f5e10ff9700 1 -- 172.21.15.84:0/4259790308 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e0c00ab00 con 0x7f5e140d1220 2023-07-14T11:14:49.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.855+0000 7f5e10ff9700 1 -- 172.21.15.84:0/4259790308 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e0c00ae70 con 0x7f5e140d1220 2023-07-14T11:14:49.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.855+0000 7f5e1a7ff700 1 -- 172.21.15.84:0/4259790308 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e14153800 con 0x7f5e140d1220 2023-07-14T11:14:49.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.855+0000 7f5e1a7ff700 1 -- 172.21.15.84:0/4259790308 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e1415fe90 con 0x7f5e140d1220 2023-07-14T11:14:49.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.856+0000 7f5e1a7ff700 1 -- 172.21.15.84:0/4259790308 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e14074350 con 0x7f5e140d1220 2023-07-14T11:14:49.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.857+0000 7f5e10ff9700 1 -- 172.21.15.84:0/4259790308 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 7) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f5e0c01b3b0 con 0x7f5e140d1220 2023-07-14T11:14:49.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.858+0000 7f5e10ff9700 1 --2- 172.21.15.84:0/4259790308 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f5e0006ae90 0x7f5e0006d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:49.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.858+0000 7f5e10ff9700 1 -- 172.21.15.84:0/4259790308 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5e0c089280 con 0x7f5e140d1220 2023-07-14T11:14:49.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.858+0000 7f5e13fff700 1 --2- 172.21.15.84:0/4259790308 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f5e0006ae90 0x7f5e0006d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:49.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.859+0000 7f5e13fff700 1 --2- 172.21.15.84:0/4259790308 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f5e0006ae90 0x7f5e0006d340 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5e040097c0 tx=0x7f5e0401c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:49.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:49.862+0000 7f5e10ff9700 1 -- 172.21.15.84:0/4259790308 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f5e0c0540c0 con 0x7f5e140d1220 2023-07-14T11:14:50.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.074+0000 7f5e1a7ff700 1 -- 172.21.15.84:0/4259790308 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5e140d0da0 con 0x7f5e140d1220 2023-07-14T11:14:50.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.074+0000 7f5e10ff9700 1 -- 172.21.15.84:0/4259790308 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v37) v1 ==== 80+0+0 (secure 0 0 0) 0x7f5e0c0576e0 con 0x7f5e140d1220 2023-07-14T11:14:50.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.076+0000 7f5e1a7ff700 1 -- 172.21.15.84:0/4259790308 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f5e0006ae90 msgr2=0x7f5e0006d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:50.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.076+0000 7f5e1a7ff700 1 --2- 172.21.15.84:0/4259790308 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f5e0006ae90 0x7f5e0006d340 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5e040097c0 tx=0x7f5e0401c040 comp rx=0 tx=0).stop 2023-07-14T11:14:50.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.076+0000 7f5e1a7ff700 1 -- 172.21.15.84:0/4259790308 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e140d1220 msgr2=0x7f5e1415d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:50.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.076+0000 7f5e1a7ff700 1 --2- 172.21.15.84:0/4259790308 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e140d1220 0x7f5e1415d570 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c00ca80 tx=0x7f5e0c00cd90 comp rx=0 tx=0).stop 2023-07-14T11:14:50.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.077+0000 7f5e1a7ff700 1 -- 172.21.15.84:0/4259790308 shutdown_connections 2023-07-14T11:14:50.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.077+0000 7f5e1a7ff700 1 --2- 172.21.15.84:0/4259790308 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e140d1220 0x7f5e1415d570 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:50.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.077+0000 7f5e1a7ff700 1 --2- 172.21.15.84:0/4259790308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e140b4530 0x7f5e141f1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:50.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.077+0000 7f5e1a7ff700 1 --2- 172.21.15.84:0/4259790308 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f5e0006ae90 0x7f5e0006d340 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:50.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.077+0000 7f5e1a7ff700 1 --2- 172.21.15.84:0/4259790308 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e140b8a60 0x7f5e1415d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:50.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.077+0000 7f5e1a7ff700 1 -- 172.21.15.84:0/4259790308 >> 172.21.15.84:0/4259790308 conn(0x7f5e1409c1b0 msgr2=0x7f5e1406b790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:50.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.077+0000 7f5e1a7ff700 1 -- 172.21.15.84:0/4259790308 shutdown_connections 2023-07-14T11:14:50.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.077+0000 7f5e1a7ff700 1 -- 172.21.15.84:0/4259790308 wait complete. 2023-07-14T11:14:50.081 INFO:teuthology.orchestra.run.smithi084.stderr:listed 0 entries 2023-07-14T11:14:50.097 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-14T11:14:50.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:14:50.098 DEBUG:teuthology.orchestra.run.smithi084:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-14T11:14:50.207 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi084.front.sepia.ceph.com 2023-07-14T11:14:50.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:14:50.208 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-14T11:14:50.260 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-07-14T11:14:50.260 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:14:50.310 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-07-14T11:14:50.310 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:14:50.357 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:14:50.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.552+0000 7f4cb45ff700 1 Processor -- start 2023-07-14T11:14:50.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.552+0000 7f4cb45ff700 1 -- start start 2023-07-14T11:14:50.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.553+0000 7f4cb45ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4cac1500d0 0x7f4cac070350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:50.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.553+0000 7f4cb45ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4cac070890 0x7f4cac1597c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:50.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.553+0000 7f4cb45ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cac0cdf90 con 0x7f4cac159d00 2023-07-14T11:14:50.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.553+0000 7f4cb45ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cac15a2f0 con 0x7f4cac1500d0 2023-07-14T11:14:50.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.553+0000 7f4cb45ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cac15a5d0 con 0x7f4cac070890 2023-07-14T11:14:50.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.553+0000 7f4cb2b9c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f4cac159d00 0x7f4cac0cea50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49944/0 (socket says 172.21.15.84:49944) 2023-07-14T11:14:50.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.554+0000 7f4cb2b9c700 1 -- 172.21.15.84:0/4200205503 learned_addr learned my addr 172.21.15.84:0/4200205503 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:14:50.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.554+0000 7f4cb1b9a700 1 --2- 172.21.15.84:0/4200205503 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4cac070890 0x7f4cac1597c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:50.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.554+0000 7f4cb239b700 1 --2- 172.21.15.84:0/4200205503 >> v2:172.21.15.179:3300/0 conn(0x7f4cac1500d0 0x7f4cac070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:50.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.554+0000 7f4cb1399700 1 -- 172.21.15.84:0/4200205503 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 560860350 0 0) 0x7f4cac0cdf90 con 0x7f4cac159d00 2023-07-14T11:14:50.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.554+0000 7f4cb1399700 1 -- 172.21.15.84:0/4200205503 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c980035b0 con 0x7f4cac159d00 2023-07-14T11:14:50.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.554+0000 7f4cb1b9a700 1 -- 172.21.15.84:0/4200205503 >> v2:172.21.15.179:3300/0 conn(0x7f4cac1500d0 msgr2=0x7f4cac070350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:50.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.554+0000 7f4cb1b9a700 1 --2- 172.21.15.84:0/4200205503 >> v2:172.21.15.179:3300/0 conn(0x7f4cac1500d0 0x7f4cac070350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:50.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.554+0000 7f4cb1b9a700 1 -- 172.21.15.84:0/4200205503 >> v1:172.21.15.84:6789/0 conn(0x7f4cac159d00 legacy=0x7f4cac0cea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:50.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.554+0000 7f4cb1b9a700 1 -- 172.21.15.84:0/4200205503 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cac0ce250 con 0x7f4cac070890 2023-07-14T11:14:50.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.554+0000 7f4cb1b9a700 1 --2- 172.21.15.84:0/4200205503 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4cac070890 0x7f4cac1597c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c009840 tx=0x7f4c9c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5f403971662aa30 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:50.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.555+0000 7f4cb1399700 1 -- 172.21.15.84:0/4200205503 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9c011830 con 0x7f4cac070890 2023-07-14T11:14:50.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.555+0000 7f4cb1399700 1 -- 172.21.15.84:0/4200205503 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c9c011990 con 0x7f4cac070890 2023-07-14T11:14:50.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.555+0000 7f4cb1399700 1 -- 172.21.15.84:0/4200205503 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9c011d20 con 0x7f4cac070890 2023-07-14T11:14:50.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.555+0000 7f4cb45ff700 1 -- 172.21.15.84:0/4200205503 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4cac070890 msgr2=0x7f4cac1597c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:50.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.555+0000 7f4cb45ff700 1 --2- 172.21.15.84:0/4200205503 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4cac070890 0x7f4cac1597c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c009840 tx=0x7f4c9c009b50 comp rx=0 tx=0).stop 2023-07-14T11:14:50.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.555+0000 7f4cb45ff700 1 -- 172.21.15.84:0/4200205503 shutdown_connections 2023-07-14T11:14:50.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.555+0000 7f4cb45ff700 1 --2- 172.21.15.84:0/4200205503 >> v2:172.21.15.179:3300/0 conn(0x7f4cac1500d0 0x7f4cac070350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:50.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.555+0000 7f4cb45ff700 1 --2- 172.21.15.84:0/4200205503 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4cac070890 0x7f4cac1597c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:50.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.555+0000 7f4cb45ff700 1 -- 172.21.15.84:0/4200205503 >> 172.21.15.84:0/4200205503 conn(0x7f4cac069f30 msgr2=0x7f4cac06a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:50.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.555+0000 7f4cb45ff700 1 -- 172.21.15.84:0/4200205503 shutdown_connections 2023-07-14T11:14:50.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.555+0000 7f4cb45ff700 1 -- 172.21.15.84:0/4200205503 wait complete. 2023-07-14T11:14:50.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.557+0000 7f4cb45ff700 1 Processor -- start 2023-07-14T11:14:50.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.557+0000 7f4cb45ff700 1 -- start start 2023-07-14T11:14:50.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.558+0000 7f4cb45ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4cac070890 0x7f4cac1e64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:50.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.558+0000 7f4cb45ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4cac1500d0 0x7f4cac158200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:50.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.558+0000 7f4cb45ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4cac159d00 0x7f4cac158740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:50.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.558+0000 7f4cb45ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cac139c60 con 0x7f4cac1500d0 2023-07-14T11:14:50.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.558+0000 7f4cb45ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cac14a3b0 con 0x7f4cac159d00 2023-07-14T11:14:50.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.558+0000 7f4cb45ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cac14a690 con 0x7f4cac070890 2023-07-14T11:14:50.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.558+0000 7f4cb1b9a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4cac1500d0 0x7f4cac158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:50.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.558+0000 7f4cb1b9a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4cac1500d0 0x7f4cac158200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58820/0 (socket says 172.21.15.84:58820) 2023-07-14T11:14:50.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.558+0000 7f4cb1b9a700 1 -- 172.21.15.84:0/2914662123 learned_addr learned my addr 172.21.15.84:0/2914662123 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:50.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.558+0000 7f4cb239b700 1 --2- 172.21.15.84:0/2914662123 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4cac070890 0x7f4cac1e64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:50.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.559+0000 7f4cb2b9c700 1 --2- 172.21.15.84:0/2914662123 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4cac159d00 0x7f4cac158740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:50.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.559+0000 7f4cb1b9a700 1 -- 172.21.15.84:0/2914662123 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4cac070890 msgr2=0x7f4cac1e64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:50.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.559+0000 7f4cb1b9a700 1 --2- 172.21.15.84:0/2914662123 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4cac070890 0x7f4cac1e64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:50.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.559+0000 7f4cb1b9a700 1 -- 172.21.15.84:0/2914662123 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4cac159d00 msgr2=0x7f4cac158740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:50.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.559+0000 7f4cb1b9a700 1 --2- 172.21.15.84:0/2914662123 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4cac159d00 0x7f4cac158740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:50.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.559+0000 7f4cb1b9a700 1 -- 172.21.15.84:0/2914662123 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c9c0094a0 con 0x7f4cac1500d0 2023-07-14T11:14:50.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.559+0000 7f4cb1b9a700 1 --2- 172.21.15.84:0/2914662123 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4cac1500d0 0x7f4cac158200 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c0090b0 tx=0x7f4c9c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:50.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.559+0000 7f4ca2ffd700 1 -- 172.21.15.84:0/2914662123 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9c004590 con 0x7f4cac1500d0 2023-07-14T11:14:50.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.559+0000 7f4ca2ffd700 1 -- 172.21.15.84:0/2914662123 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c9c01f070 con 0x7f4cac1500d0 2023-07-14T11:14:50.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.559+0000 7f4ca2ffd700 1 -- 172.21.15.84:0/2914662123 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9c0038e0 con 0x7f4cac1500d0 2023-07-14T11:14:50.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.559+0000 7f4cb45ff700 1 -- 172.21.15.84:0/2914662123 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cac14a970 con 0x7f4cac1500d0 2023-07-14T11:14:50.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.560+0000 7f4cb45ff700 1 -- 172.21.15.84:0/2914662123 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cac14af30 con 0x7f4cac1500d0 2023-07-14T11:14:50.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.561+0000 7f4cb45ff700 1 -- 172.21.15.84:0/2914662123 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cac04e280 con 0x7f4cac1500d0 2023-07-14T11:14:50.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.561+0000 7f4ca2ffd700 1 -- 172.21.15.84:0/2914662123 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 7) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f4c9c003a40 con 0x7f4cac1500d0 2023-07-14T11:14:50.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.562+0000 7f4ca2ffd700 1 --2- 172.21.15.84:0/2914662123 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f4c9006ae90 0x7f4c9006d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:50.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.562+0000 7f4ca2ffd700 1 -- 172.21.15.84:0/2914662123 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4c9c021070 con 0x7f4cac1500d0 2023-07-14T11:14:50.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.563+0000 7f4cb239b700 1 --2- 172.21.15.84:0/2914662123 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f4c9006ae90 0x7f4c9006d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:50.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.563+0000 7f4cb239b700 1 --2- 172.21.15.84:0/2914662123 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f4c9006ae90 0x7f4c9006d340 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4ca8009be0 tx=0x7f4ca8009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:50.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.566+0000 7f4ca2ffd700 1 -- 172.21.15.84:0/2914662123 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f4c9c055dc0 con 0x7f4cac1500d0 2023-07-14T11:14:50.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.762+0000 7f4cb45ff700 1 -- 172.21.15.84:0/2914662123 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4cac070130 con 0x7f4cac1500d0 2023-07-14T11:14:50.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.763+0000 7f4ca2ffd700 1 -- 172.21.15.84:0/2914662123 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18327 (secure 0 0 0) 0x7f4c9c0593e0 con 0x7f4cac1500d0 2023-07-14T11:14:50.765 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:14:50.766 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":37,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:14:34.030805+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-14T11:14:30.730753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-14T11:14:31.485809+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:14:50.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.765+0000 7f4cb45ff700 1 -- 172.21.15.84:0/2914662123 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f4c9006ae90 msgr2=0x7f4c9006d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:50.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.765+0000 7f4cb45ff700 1 --2- 172.21.15.84:0/2914662123 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f4c9006ae90 0x7f4c9006d340 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4ca8009be0 tx=0x7f4ca8009210 comp rx=0 tx=0).stop 2023-07-14T11:14:50.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.765+0000 7f4cb45ff700 1 -- 172.21.15.84:0/2914662123 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4cac1500d0 msgr2=0x7f4cac158200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:50.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.765+0000 7f4cb45ff700 1 --2- 172.21.15.84:0/2914662123 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4cac1500d0 0x7f4cac158200 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c0090b0 tx=0x7f4c9c004750 comp rx=0 tx=0).stop 2023-07-14T11:14:50.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.765+0000 7f4cb45ff700 1 -- 172.21.15.84:0/2914662123 shutdown_connections 2023-07-14T11:14:50.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.765+0000 7f4cb45ff700 1 --2- 172.21.15.84:0/2914662123 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f4c9006ae90 0x7f4c9006d340 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:50.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.765+0000 7f4cb45ff700 1 --2- 172.21.15.84:0/2914662123 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4cac070890 0x7f4cac1e64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:50.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.765+0000 7f4cb45ff700 1 --2- 172.21.15.84:0/2914662123 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4cac159d00 0x7f4cac158740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:50.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.765+0000 7f4cb45ff700 1 --2- 172.21.15.84:0/2914662123 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4cac1500d0 0x7f4cac158200 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:50.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.765+0000 7f4cb45ff700 1 -- 172.21.15.84:0/2914662123 >> 172.21.15.84:0/2914662123 conn(0x7f4cac069f30 msgr2=0x7f4cac0ce8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:50.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.765+0000 7f4cb45ff700 1 -- 172.21.15.84:0/2914662123 shutdown_connections 2023-07-14T11:14:50.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.766+0000 7f4cb45ff700 1 -- 172.21.15.84:0/2914662123 wait complete. 2023-07-14T11:14:50.785 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T11:13:00.125395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T11:13:06.803994+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T11:14:30.730753+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T11:14:31.485809+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T11:14:50.786 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T11:14:50.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.983+0000 7f3bde7ff700 1 Processor -- start 2023-07-14T11:14:50.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.983+0000 7f3bde7ff700 1 -- start start 2023-07-14T11:14:50.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.984+0000 7f3bde7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3bd80b4600 0x7f3bd80cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:50.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.984+0000 7f3bde7ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3bd80cfe40 0x7f3bd80d02b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:50.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.984+0000 7f3bde7ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3bd80cd540 0x7f3bd80cd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:50.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.984+0000 7f3bde7ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bd80d1550 con 0x7f3bd80cfe40 2023-07-14T11:14:50.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.984+0000 7f3bde7ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bd80d2d90 con 0x7f3bd80cd540 2023-07-14T11:14:50.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.984+0000 7f3bde7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd815cd60 con 0x7f3bd80b4600 2023-07-14T11:14:50.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.984+0000 7f3bd77fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3bd80cfe40 0x7f3bd80d02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:50.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.984+0000 7f3bd77fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3bd80cfe40 0x7f3bd80d02b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58830/0 (socket says 172.21.15.84:58830) 2023-07-14T11:14:50.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.984+0000 7f3bd77fe700 1 -- 172.21.15.84:0/3902453088 learned_addr learned my addr 172.21.15.84:0/3902453088 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:50.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.984+0000 7f3bd7fff700 1 --2- 172.21.15.84:0/3902453088 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3bd80b4600 0x7f3bd80cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:50.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.984+0000 7f3bdcd9c700 1 --2- 172.21.15.84:0/3902453088 >> v2:172.21.15.179:3300/0 conn(0x7f3bd80cd540 0x7f3bd80cd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:50.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.985+0000 7f3bd77fe700 1 -- 172.21.15.84:0/3902453088 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3bd80b4600 msgr2=0x7f3bd80cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:50.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.985+0000 7f3bd77fe700 1 --2- 172.21.15.84:0/3902453088 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3bd80b4600 0x7f3bd80cf900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:50.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.985+0000 7f3bd77fe700 1 -- 172.21.15.84:0/3902453088 >> v2:172.21.15.179:3300/0 conn(0x7f3bd80cd540 msgr2=0x7f3bd80cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:50.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.985+0000 7f3bd77fe700 1 --2- 172.21.15.84:0/3902453088 >> v2:172.21.15.179:3300/0 conn(0x7f3bd80cd540 0x7f3bd80cd9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:50.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.985+0000 7f3bd77fe700 1 -- 172.21.15.84:0/3902453088 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bd80cf340 con 0x7f3bd80cfe40 2023-07-14T11:14:50.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.985+0000 7f3bd77fe700 1 --2- 172.21.15.84:0/3902453088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bd80cfe40 0x7f3bd80d02b0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f3bd808d430 tx=0x7f3bcc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28fb218c5ac48dc server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:50.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.985+0000 7f3bd6ffd700 1 -- 172.21.15.84:0/3902453088 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bcc00b860 con 0x7f3bd80cfe40 2023-07-14T11:14:50.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.985+0000 7f3bd6ffd700 1 -- 172.21.15.84:0/3902453088 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bcc00b9c0 con 0x7f3bd80cfe40 2023-07-14T11:14:50.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.985+0000 7f3bd6ffd700 1 -- 172.21.15.84:0/3902453088 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bcc00bd50 con 0x7f3bd80cfe40 2023-07-14T11:14:50.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.986+0000 7f3bde7ff700 1 -- 172.21.15.84:0/3902453088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bd80cfe40 msgr2=0x7f3bd80d02b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:50.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.986+0000 7f3bde7ff700 1 --2- 172.21.15.84:0/3902453088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bd80cfe40 0x7f3bd80d02b0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f3bd808d430 tx=0x7f3bcc009c00 comp rx=0 tx=0).stop 2023-07-14T11:14:50.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.986+0000 7f3bde7ff700 1 -- 172.21.15.84:0/3902453088 shutdown_connections 2023-07-14T11:14:50.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.986+0000 7f3bde7ff700 1 --2- 172.21.15.84:0/3902453088 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3bd80b4600 0x7f3bd80cf900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:50.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.986+0000 7f3bde7ff700 1 --2- 172.21.15.84:0/3902453088 >> v2:172.21.15.179:3300/0 conn(0x7f3bd80cd540 0x7f3bd80cd9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:50.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.986+0000 7f3bde7ff700 1 --2- 172.21.15.84:0/3902453088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bd80cfe40 0x7f3bd80d02b0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:50.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.986+0000 7f3bde7ff700 1 -- 172.21.15.84:0/3902453088 >> 172.21.15.84:0/3902453088 conn(0x7f3bd809c200 msgr2=0x7f3bd80d2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:50.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.986+0000 7f3bde7ff700 1 -- 172.21.15.84:0/3902453088 shutdown_connections 2023-07-14T11:14:50.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.986+0000 7f3bde7ff700 1 -- 172.21.15.84:0/3902453088 wait complete. 2023-07-14T11:14:50.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.987+0000 7f3bde7ff700 1 Processor -- start 2023-07-14T11:14:50.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.988+0000 7f3bde7ff700 1 -- start start 2023-07-14T11:14:50.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.988+0000 7f3bde7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3bd80cd540 0x7f3bd815b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:50.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.988+0000 7f3bde7ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3bd80cfe40 0x7f3bd80b6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:50.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.989+0000 7f3bde7ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bd80cb200 0x7f3bd80cb680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:50.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.989+0000 7f3bde7ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd815bd00 con 0x7f3bd80cb200 2023-07-14T11:14:50.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.989+0000 7f3bde7ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd80ca160 con 0x7f3bd80cfe40 2023-07-14T11:14:50.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.989+0000 7f3bde7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd80ca440 con 0x7f3bd80cd540 2023-07-14T11:14:50.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.989+0000 7f3bdcd9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bd80cb200 0x7f3bd80cb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:50.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.989+0000 7f3bdcd9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bd80cb200 0x7f3bd80cb680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58834/0 (socket says 172.21.15.84:58834) 2023-07-14T11:14:50.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.989+0000 7f3bdcd9c700 1 -- 172.21.15.84:0/3955618692 learned_addr learned my addr 172.21.15.84:0/3955618692 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:50.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.989+0000 7f3bd7fff700 1 --2- 172.21.15.84:0/3955618692 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3bd80cd540 0x7f3bd815b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:50.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.989+0000 7f3bd77fe700 1 --2- 172.21.15.84:0/3955618692 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3bd80cfe40 0x7f3bd80b6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:50.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.989+0000 7f3bdcd9c700 1 -- 172.21.15.84:0/3955618692 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3bd80cd540 msgr2=0x7f3bd815b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:50.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.989+0000 7f3bdcd9c700 1 --2- 172.21.15.84:0/3955618692 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3bd80cd540 0x7f3bd815b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:50.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.989+0000 7f3bdcd9c700 1 -- 172.21.15.84:0/3955618692 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3bd80cfe40 msgr2=0x7f3bd80b6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:50.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.989+0000 7f3bdcd9c700 1 --2- 172.21.15.84:0/3955618692 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3bd80cfe40 0x7f3bd80b6ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:50.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.989+0000 7f3bdcd9c700 1 -- 172.21.15.84:0/3955618692 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bcc009550 con 0x7f3bd80cb200 2023-07-14T11:14:50.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.990+0000 7f3bdcd9c700 1 --2- 172.21.15.84:0/3955618692 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bd80cb200 0x7f3bd80cb680 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f3bd0007e40 tx=0x7f3bd000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:50.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.990+0000 7f3bd4ff9700 1 -- 172.21.15.84:0/3955618692 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd000ed30 con 0x7f3bd80cb200 2023-07-14T11:14:50.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.990+0000 7f3bd4ff9700 1 -- 172.21.15.84:0/3955618692 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bd0014420 con 0x7f3bd80cb200 2023-07-14T11:14:50.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.990+0000 7f3bde7ff700 1 -- 172.21.15.84:0/3955618692 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bd80ca720 con 0x7f3bd80cb200 2023-07-14T11:14:50.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.990+0000 7f3bd4ff9700 1 -- 172.21.15.84:0/3955618692 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd00147d0 con 0x7f3bd80cb200 2023-07-14T11:14:50.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.990+0000 7f3bde7ff700 1 -- 172.21.15.84:0/3955618692 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bd80cace0 con 0x7f3bd80cb200 2023-07-14T11:14:50.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.991+0000 7f3bde7ff700 1 -- 172.21.15.84:0/3955618692 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bd80d0e70 con 0x7f3bd80cb200 2023-07-14T11:14:50.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.992+0000 7f3bd4ff9700 1 -- 172.21.15.84:0/3955618692 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 7) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f3bd0014930 con 0x7f3bd80cb200 2023-07-14T11:14:50.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.993+0000 7f3bd4ff9700 1 --2- 172.21.15.84:0/3955618692 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f3bc406ae90 0x7f3bc406d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:50.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.993+0000 7f3bd4ff9700 1 -- 172.21.15.84:0/3955618692 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3bd0089ea0 con 0x7f3bd80cb200 2023-07-14T11:14:50.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.993+0000 7f3bd7fff700 1 --2- 172.21.15.84:0/3955618692 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f3bc406ae90 0x7f3bc406d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:50.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.993+0000 7f3bd7fff700 1 --2- 172.21.15.84:0/3955618692 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f3bc406ae90 0x7f3bc406d340 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3bd80ccaf0 tx=0x7f3bc8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:50.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:50.997+0000 7f3bd4ff9700 1 -- 172.21.15.84:0/3955618692 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3bd80d0e70 con 0x7f3bd80cb200 2023-07-14T11:14:51.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.190+0000 7f3bde7ff700 1 -- 172.21.15.84:0/3955618692 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3bd80d0e40 con 0x7f3bd80cb200 2023-07-14T11:14:51.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.190+0000 7f3bd4ff9700 1 -- 172.21.15.84:0/3955618692 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3bd0054d70 con 0x7f3bd80cb200 2023-07-14T11:14:51.193 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-07-14T11:14:51.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.192+0000 7f3bde7ff700 1 -- 172.21.15.84:0/3955618692 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f3bc406ae90 msgr2=0x7f3bc406d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:51.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.192+0000 7f3bde7ff700 1 --2- 172.21.15.84:0/3955618692 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f3bc406ae90 0x7f3bc406d340 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3bd80ccaf0 tx=0x7f3bc8008040 comp rx=0 tx=0).stop 2023-07-14T11:14:51.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.192+0000 7f3bde7ff700 1 -- 172.21.15.84:0/3955618692 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bd80cb200 msgr2=0x7f3bd80cb680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:51.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.192+0000 7f3bde7ff700 1 --2- 172.21.15.84:0/3955618692 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bd80cb200 0x7f3bd80cb680 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f3bd0007e40 tx=0x7f3bd000e3c0 comp rx=0 tx=0).stop 2023-07-14T11:14:51.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.192+0000 7f3bde7ff700 1 -- 172.21.15.84:0/3955618692 shutdown_connections 2023-07-14T11:14:51.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.192+0000 7f3bde7ff700 1 --2- 172.21.15.84:0/3955618692 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f3bc406ae90 0x7f3bc406d340 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:51.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.192+0000 7f3bde7ff700 1 --2- 172.21.15.84:0/3955618692 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3bd80cd540 0x7f3bd815b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:51.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.192+0000 7f3bde7ff700 1 --2- 172.21.15.84:0/3955618692 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bd80cb200 0x7f3bd80cb680 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:51.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.192+0000 7f3bde7ff700 1 --2- 172.21.15.84:0/3955618692 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3bd80cfe40 0x7f3bd80b6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:51.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.192+0000 7f3bde7ff700 1 -- 172.21.15.84:0/3955618692 >> 172.21.15.84:0/3955618692 conn(0x7f3bd809c200 msgr2=0x7f3bd806a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:51.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.193+0000 7f3bde7ff700 1 -- 172.21.15.84:0/3955618692 shutdown_connections 2023-07-14T11:14:51.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.193+0000 7f3bde7ff700 1 -- 172.21.15.84:0/3955618692 wait complete. 2023-07-14T11:14:51.212 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T11:14:51.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.408+0000 7fc5b3dff700 1 Processor -- start 2023-07-14T11:14:51.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.408+0000 7fc5b3dff700 1 -- start start 2023-07-14T11:14:51.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.410+0000 7fc5b3dff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc5ac158bb0 0x7fc5ac0cd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:51.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.410+0000 7fc5b3dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5ac0cbe40 0x7fc5ac0cda40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:51.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.410+0000 7fc5b3dff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5ac0ce8c0 con 0x7fc5ac0cdf80 2023-07-14T11:14:51.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.410+0000 7fc5b3dff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5ac06b5b0 con 0x7fc5ac158bb0 2023-07-14T11:14:51.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.410+0000 7fc5b3dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ac0ce400 con 0x7fc5ac0cbe40 2023-07-14T11:14:51.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.410+0000 7fc5b1b9b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc5ac158bb0 0x7fc5ac0cd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:51.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.410+0000 7fc5b139a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5ac0cbe40 0x7fc5ac0cda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:51.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.410+0000 7fc5b239c700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fc5ac0cdf80 0x7fc5ac15c790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.84:50540/0 (socket says 172.21.15.84:50540) 2023-07-14T11:14:51.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.410+0000 7fc5b239c700 1 -- 172.21.15.84:0/3715297723 learned_addr learned my addr 172.21.15.84:0/3715297723 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:14:51.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.411+0000 7fc5b0b99700 1 -- 172.21.15.84:0/3715297723 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2481517718 0 0) 0x7fc5ac0ce8c0 con 0x7fc5ac0cdf80 2023-07-14T11:14:51.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.411+0000 7fc5b0b99700 1 -- 172.21.15.84:0/3715297723 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5980035b0 con 0x7fc5ac0cdf80 2023-07-14T11:14:51.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.411+0000 7fc5b1b9b700 1 -- 172.21.15.84:0/3715297723 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5ac0cbe40 msgr2=0x7fc5ac0cda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:51.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.411+0000 7fc5b1b9b700 1 --2- 172.21.15.84:0/3715297723 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5ac0cbe40 0x7fc5ac0cda40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:51.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.411+0000 7fc5b1b9b700 1 -- 172.21.15.84:0/3715297723 >> v1:172.21.15.179:6789/0 conn(0x7fc5ac0cdf80 legacy=0x7fc5ac15c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:51.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.411+0000 7fc5b1b9b700 1 -- 172.21.15.84:0/3715297723 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5ac0cc2b0 con 0x7fc5ac158bb0 2023-07-14T11:14:51.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.411+0000 7fc5b1b9b700 1 --2- 172.21.15.84:0/3715297723 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5ac158bb0 0x7fc5ac0cd0a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc5a8009840 tx=0x7fc5a8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4befa0599287064 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:51.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.411+0000 7fc5b0b99700 1 -- 172.21.15.84:0/3715297723 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a8011830 con 0x7fc5ac158bb0 2023-07-14T11:14:51.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.411+0000 7fc5b0b99700 1 -- 172.21.15.84:0/3715297723 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5a8011990 con 0x7fc5ac158bb0 2023-07-14T11:14:51.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.411+0000 7fc5b0b99700 1 -- 172.21.15.84:0/3715297723 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a8011d00 con 0x7fc5ac158bb0 2023-07-14T11:14:51.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.412+0000 7fc5b3dff700 1 -- 172.21.15.84:0/3715297723 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5ac158bb0 msgr2=0x7fc5ac0cd0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:51.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.412+0000 7fc5b3dff700 1 --2- 172.21.15.84:0/3715297723 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5ac158bb0 0x7fc5ac0cd0a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc5a8009840 tx=0x7fc5a8009b50 comp rx=0 tx=0).stop 2023-07-14T11:14:51.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.412+0000 7fc5b3dff700 1 -- 172.21.15.84:0/3715297723 shutdown_connections 2023-07-14T11:14:51.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.412+0000 7fc5b3dff700 1 --2- 172.21.15.84:0/3715297723 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5ac158bb0 0x7fc5ac0cd0a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:51.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.412+0000 7fc5b3dff700 1 --2- 172.21.15.84:0/3715297723 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5ac0cbe40 0x7fc5ac0cda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:51.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.412+0000 7fc5b3dff700 1 -- 172.21.15.84:0/3715297723 >> 172.21.15.84:0/3715297723 conn(0x7fc5ac0b05d0 msgr2=0x7fc5ac0b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:51.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.412+0000 7fc5b3dff700 1 -- 172.21.15.84:0/3715297723 shutdown_connections 2023-07-14T11:14:51.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.412+0000 7fc5b3dff700 1 -- 172.21.15.84:0/3715297723 wait complete. 2023-07-14T11:14:51.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.414+0000 7fc5b3dff700 1 Processor -- start 2023-07-14T11:14:51.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.414+0000 7fc5b3dff700 1 -- start start 2023-07-14T11:14:51.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.415+0000 7fc5b3dff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5ac0cbe40 0x7fc5ac1544e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:51.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.415+0000 7fc5b3dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5ac0cdf80 0x7fc5ac0c2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:51.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.415+0000 7fc5b3dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5ac158bb0 0x7fc5ac155f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:51.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.415+0000 7fc5b3dff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ac154a20 con 0x7fc5ac0cbe40 2023-07-14T11:14:51.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.415+0000 7fc5b3dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ac0c5cc0 con 0x7fc5ac0cdf80 2023-07-14T11:14:51.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.415+0000 7fc5b3dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ac0c5fa0 con 0x7fc5ac158bb0 2023-07-14T11:14:51.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.415+0000 7fc5b1b9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5ac0cbe40 0x7fc5ac1544e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:51.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.415+0000 7fc5b1b9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5ac0cbe40 0x7fc5ac1544e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58842/0 (socket says 172.21.15.84:58842) 2023-07-14T11:14:51.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.415+0000 7fc5b1b9b700 1 -- 172.21.15.84:0/2828369230 learned_addr learned my addr 172.21.15.84:0/2828369230 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:51.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.415+0000 7fc5b139a700 1 --2- 172.21.15.84:0/2828369230 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5ac0cdf80 0x7fc5ac0c2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:51.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.415+0000 7fc5b239c700 1 --2- 172.21.15.84:0/2828369230 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5ac158bb0 0x7fc5ac155f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:51.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.415+0000 7fc5b1b9b700 1 -- 172.21.15.84:0/2828369230 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5ac158bb0 msgr2=0x7fc5ac155f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:51.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.415+0000 7fc5b1b9b700 1 --2- 172.21.15.84:0/2828369230 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5ac158bb0 0x7fc5ac155f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:51.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.415+0000 7fc5b1b9b700 1 -- 172.21.15.84:0/2828369230 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5ac0cdf80 msgr2=0x7fc5ac0c2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:51.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.415+0000 7fc5b1b9b700 1 --2- 172.21.15.84:0/2828369230 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5ac0cdf80 0x7fc5ac0c2fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:51.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.416+0000 7fc5b1b9b700 1 -- 172.21.15.84:0/2828369230 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5a80094a0 con 0x7fc5ac0cbe40 2023-07-14T11:14:51.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.416+0000 7fc5b1b9b700 1 --2- 172.21.15.84:0/2828369230 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5ac0cbe40 0x7fc5ac1544e0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fc5a8009fd0 tx=0x7fc5a8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:51.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.416+0000 7fc5a27fc700 1 -- 172.21.15.84:0/2828369230 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a8004550 con 0x7fc5ac0cbe40 2023-07-14T11:14:51.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.416+0000 7fc5a27fc700 1 -- 172.21.15.84:0/2828369230 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5a801e070 con 0x7fc5ac0cbe40 2023-07-14T11:14:51.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.416+0000 7fc5a27fc700 1 -- 172.21.15.84:0/2828369230 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a80038e0 con 0x7fc5ac0cbe40 2023-07-14T11:14:51.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.416+0000 7fc5b3dff700 1 -- 172.21.15.84:0/2828369230 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5ac0c6280 con 0x7fc5ac0cbe40 2023-07-14T11:14:51.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.416+0000 7fc5b3dff700 1 -- 172.21.15.84:0/2828369230 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5ac0c6840 con 0x7fc5ac0cbe40 2023-07-14T11:14:51.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.417+0000 7fc5b3dff700 1 -- 172.21.15.84:0/2828369230 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5ac0714e0 con 0x7fc5ac0cbe40 2023-07-14T11:14:51.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.418+0000 7fc5a27fc700 1 -- 172.21.15.84:0/2828369230 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 7) v1 ==== 89190+0+0 (secure 0 0 0) 0x7fc5a8003a40 con 0x7fc5ac0cbe40 2023-07-14T11:14:51.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.419+0000 7fc5a27fc700 1 --2- 172.21.15.84:0/2828369230 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc59006aec0 0x7fc59006d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:51.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.419+0000 7fc5a27fc700 1 -- 172.21.15.84:0/2828369230 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc5a808a5b0 con 0x7fc5ac0cbe40 2023-07-14T11:14:51.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.419+0000 7fc5b139a700 1 --2- 172.21.15.84:0/2828369230 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc59006aec0 0x7fc59006d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:51.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.420+0000 7fc5b139a700 1 --2- 172.21.15.84:0/2828369230 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc59006aec0 0x7fc59006d370 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac06ce10 tx=0x7fc59c009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:51.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.423+0000 7fc5a27fc700 1 -- 172.21.15.84:0/2828369230 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fc5ac0714e0 con 0x7fc5ac0cbe40 2023-07-14T11:14:51.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.615+0000 7fc5b3dff700 1 -- 172.21.15.84:0/2828369230 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc5ac0714e0 con 0x7fc5ac0cbe40 2023-07-14T11:14:51.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.615+0000 7fc5a27fc700 1 -- 172.21.15.84:0/2828369230 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v37) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc5ac0714e0 con 0x7fc5ac0cbe40 2023-07-14T11:14:51.618 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-07-14T11:14:51.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.618+0000 7fc5b3dff700 1 -- 172.21.15.84:0/2828369230 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc59006aec0 msgr2=0x7fc59006d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:51.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.618+0000 7fc5b3dff700 1 --2- 172.21.15.84:0/2828369230 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc59006aec0 0x7fc59006d370 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac06ce10 tx=0x7fc59c009210 comp rx=0 tx=0).stop 2023-07-14T11:14:51.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.618+0000 7fc5b3dff700 1 -- 172.21.15.84:0/2828369230 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5ac0cbe40 msgr2=0x7fc5ac1544e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:51.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.618+0000 7fc5b3dff700 1 --2- 172.21.15.84:0/2828369230 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5ac0cbe40 0x7fc5ac1544e0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fc5a8009fd0 tx=0x7fc5a8004750 comp rx=0 tx=0).stop 2023-07-14T11:14:51.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.618+0000 7fc5b3dff700 1 -- 172.21.15.84:0/2828369230 shutdown_connections 2023-07-14T11:14:51.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.618+0000 7fc5b3dff700 1 --2- 172.21.15.84:0/2828369230 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc59006aec0 0x7fc59006d370 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:51.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.618+0000 7fc5b3dff700 1 --2- 172.21.15.84:0/2828369230 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5ac158bb0 0x7fc5ac155f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:51.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.618+0000 7fc5b3dff700 1 --2- 172.21.15.84:0/2828369230 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5ac0cbe40 0x7fc5ac1544e0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:51.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.618+0000 7fc5b3dff700 1 --2- 172.21.15.84:0/2828369230 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5ac0cdf80 0x7fc5ac0c2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:51.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.618+0000 7fc5b3dff700 1 -- 172.21.15.84:0/2828369230 >> 172.21.15.84:0/2828369230 conn(0x7fc5ac0b05d0 msgr2=0x7fc5ac0ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:51.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.618+0000 7fc5b3dff700 1 -- 172.21.15.84:0/2828369230 shutdown_connections 2023-07-14T11:14:51.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.618+0000 7fc5b3dff700 1 -- 172.21.15.84:0/2828369230 wait complete. 2023-07-14T11:14:51.638 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T11:14:51.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.835+0000 7fc0407ff700 1 Processor -- start 2023-07-14T11:14:51.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.835+0000 7fc0407ff700 1 -- start start 2023-07-14T11:14:51.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.837+0000 7fc0407ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0380b8a60 0x7fc0380b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:51.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.837+0000 7fc0407ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc0380b4530 0x7fc0380d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:51.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.837+0000 7fc0407ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0380b8e30 con 0x7fc0380d1050 2023-07-14T11:14:51.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.837+0000 7fc0407ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0380d14d0 con 0x7fc0380b4530 2023-07-14T11:14:51.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.837+0000 7fc0407ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0380b1e30 con 0x7fc0380b8a60 2023-07-14T11:14:51.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.837+0000 7fc03ed9c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fc0380d1050 0x7fc0380b25d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49960/0 (socket says 172.21.15.84:49960) 2023-07-14T11:14:51.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.837+0000 7fc03ed9c700 1 -- 172.21.15.84:0/3816377996 learned_addr learned my addr 172.21.15.84:0/3816377996 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:14:51.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.837+0000 7fc03e59b700 1 --2- 172.21.15.84:0/3816377996 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0380b8a60 0x7fc0380b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:51.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.837+0000 7fc03dd9a700 1 --2- 172.21.15.84:0/3816377996 >> v2:172.21.15.179:3300/0 conn(0x7fc0380b4530 0x7fc0380d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:51.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.837+0000 7fc03d599700 1 -- 172.21.15.84:0/3816377996 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2798811114 0 0) 0x7fc0380b8e30 con 0x7fc0380d1050 2023-07-14T11:14:51.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.838+0000 7fc03d599700 1 -- 172.21.15.84:0/3816377996 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0240035b0 con 0x7fc0380d1050 2023-07-14T11:14:51.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.838+0000 7fc03e59b700 1 -- 172.21.15.84:0/3816377996 >> v2:172.21.15.179:3300/0 conn(0x7fc0380b4530 msgr2=0x7fc0380d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:51.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.838+0000 7fc03e59b700 1 --2- 172.21.15.84:0/3816377996 >> v2:172.21.15.179:3300/0 conn(0x7fc0380b4530 0x7fc0380d0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:51.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.838+0000 7fc03e59b700 1 -- 172.21.15.84:0/3816377996 >> v1:172.21.15.84:6789/0 conn(0x7fc0380d1050 legacy=0x7fc0380b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:51.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.838+0000 7fc03e59b700 1 -- 172.21.15.84:0/3816377996 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0380afaa0 con 0x7fc0380b8a60 2023-07-14T11:14:51.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.838+0000 7fc03e59b700 1 --2- 172.21.15.84:0/3816377996 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0380b8a60 0x7fc0380b3ff0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc034009840 tx=0x7fc034009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44693b1f1fad40bb server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:51.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.838+0000 7fc03d599700 1 -- 172.21.15.84:0/3816377996 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc034011830 con 0x7fc0380b8a60 2023-07-14T11:14:51.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.838+0000 7fc03d599700 1 -- 172.21.15.84:0/3816377996 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc034011990 con 0x7fc0380b8a60 2023-07-14T11:14:51.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.838+0000 7fc03d599700 1 -- 172.21.15.84:0/3816377996 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc034011d20 con 0x7fc0380b8a60 2023-07-14T11:14:51.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.839+0000 7fc0407ff700 1 -- 172.21.15.84:0/3816377996 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0380b8a60 msgr2=0x7fc0380b3ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:51.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.839+0000 7fc0407ff700 1 --2- 172.21.15.84:0/3816377996 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0380b8a60 0x7fc0380b3ff0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc034009840 tx=0x7fc034009b50 comp rx=0 tx=0).stop 2023-07-14T11:14:51.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.839+0000 7fc0407ff700 1 -- 172.21.15.84:0/3816377996 shutdown_connections 2023-07-14T11:14:51.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.839+0000 7fc0407ff700 1 --2- 172.21.15.84:0/3816377996 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0380b8a60 0x7fc0380b3ff0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:51.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.839+0000 7fc0407ff700 1 --2- 172.21.15.84:0/3816377996 >> v2:172.21.15.179:3300/0 conn(0x7fc0380b4530 0x7fc0380d0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:51.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.839+0000 7fc0407ff700 1 -- 172.21.15.84:0/3816377996 >> 172.21.15.84:0/3816377996 conn(0x7fc03809c1b0 msgr2=0x7fc0380d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:51.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.839+0000 7fc0407ff700 1 -- 172.21.15.84:0/3816377996 shutdown_connections 2023-07-14T11:14:51.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.839+0000 7fc0407ff700 1 -- 172.21.15.84:0/3816377996 wait complete. 2023-07-14T11:14:51.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.841+0000 7fc0407ff700 1 Processor -- start 2023-07-14T11:14:51.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.841+0000 7fc0407ff700 1 -- start start 2023-07-14T11:14:51.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.842+0000 7fc0407ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0380b4530 0x7fc0381f63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:51.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.842+0000 7fc0407ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0380b8a60 0x7fc0381f21d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:51.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.842+0000 7fc0407ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0380d1050 0x7fc0380cf480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:51.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.842+0000 7fc0407ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc03815d140 con 0x7fc0380d1050 2023-07-14T11:14:51.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.842+0000 7fc0407ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0381f28a0 con 0x7fc0380b4530 2023-07-14T11:14:51.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.842+0000 7fc0407ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0381f2b80 con 0x7fc0380b8a60 2023-07-14T11:14:51.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.842+0000 7fc03ed9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0380d1050 0x7fc0380cf480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:51.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.842+0000 7fc03ed9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0380d1050 0x7fc0380cf480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58858/0 (socket says 172.21.15.84:58858) 2023-07-14T11:14:51.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.842+0000 7fc03ed9c700 1 -- 172.21.15.84:0/4239039715 learned_addr learned my addr 172.21.15.84:0/4239039715 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:51.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.842+0000 7fc03e59b700 1 --2- 172.21.15.84:0/4239039715 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0380b4530 0x7fc0381f63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:51.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.842+0000 7fc03dd9a700 1 --2- 172.21.15.84:0/4239039715 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0380b8a60 0x7fc0381f21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:51.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.842+0000 7fc03ed9c700 1 -- 172.21.15.84:0/4239039715 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0380b8a60 msgr2=0x7fc0381f21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:51.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.842+0000 7fc03ed9c700 1 --2- 172.21.15.84:0/4239039715 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0380b8a60 0x7fc0381f21d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:51.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.842+0000 7fc03ed9c700 1 -- 172.21.15.84:0/4239039715 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0380b4530 msgr2=0x7fc0381f63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:51.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.842+0000 7fc03ed9c700 1 --2- 172.21.15.84:0/4239039715 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0380b4530 0x7fc0381f63e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:51.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.842+0000 7fc03ed9c700 1 -- 172.21.15.84:0/4239039715 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0340094a0 con 0x7fc0380d1050 2023-07-14T11:14:51.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.842+0000 7fc03e59b700 1 --2- 172.21.15.84:0/4239039715 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0380b4530 0x7fc0381f63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:14:51.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.843+0000 7fc03ed9c700 1 --2- 172.21.15.84:0/4239039715 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0380d1050 0x7fc0380cf480 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fc03000caa0 tx=0x7fc03000ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:51.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.843+0000 7fc02effd700 1 -- 172.21.15.84:0/4239039715 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03000aa80 con 0x7fc0380d1050 2023-07-14T11:14:51.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.843+0000 7fc02effd700 1 -- 172.21.15.84:0/4239039715 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc03000abe0 con 0x7fc0380d1050 2023-07-14T11:14:51.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.843+0000 7fc0407ff700 1 -- 172.21.15.84:0/4239039715 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0381f2e60 con 0x7fc0380d1050 2023-07-14T11:14:51.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.843+0000 7fc02effd700 1 -- 172.21.15.84:0/4239039715 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc030012400 con 0x7fc0380d1050 2023-07-14T11:14:51.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.843+0000 7fc0407ff700 1 -- 172.21.15.84:0/4239039715 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0381f3140 con 0x7fc0380d1050 2023-07-14T11:14:51.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.844+0000 7fc0407ff700 1 -- 172.21.15.84:0/4239039715 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc03815d280 con 0x7fc0380d1050 2023-07-14T11:14:51.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.845+0000 7fc02effd700 1 -- 172.21.15.84:0/4239039715 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 7) v1 ==== 89190+0+0 (secure 0 0 0) 0x7fc03001b3b0 con 0x7fc0380d1050 2023-07-14T11:14:51.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.846+0000 7fc02effd700 1 --2- 172.21.15.84:0/4239039715 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc01c06ae90 0x7fc01c06d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:51.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.846+0000 7fc02effd700 1 -- 172.21.15.84:0/4239039715 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc030089610 con 0x7fc0380d1050 2023-07-14T11:14:51.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.846+0000 7fc03e59b700 1 --2- 172.21.15.84:0/4239039715 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc01c06ae90 0x7fc01c06d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:51.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.847+0000 7fc03e59b700 1 --2- 172.21.15.84:0/4239039715 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc01c06ae90 0x7fc01c06d340 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc034000c00 tx=0x7fc034008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:51.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:51.850+0000 7fc02effd700 1 -- 172.21.15.84:0/4239039715 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fc03815d280 con 0x7fc0380d1050 2023-07-14T11:14:52.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.044+0000 7fc0407ff700 1 -- 172.21.15.84:0/4239039715 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc03815d280 con 0x7fc0380d1050 2023-07-14T11:14:52.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.045+0000 7fc02effd700 1 -- 172.21.15.84:0/4239039715 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v37) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc03815d280 con 0x7fc0380d1050 2023-07-14T11:14:52.047 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-07-14T11:14:52.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.047+0000 7fc0407ff700 1 -- 172.21.15.84:0/4239039715 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc01c06ae90 msgr2=0x7fc01c06d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:52.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.047+0000 7fc0407ff700 1 --2- 172.21.15.84:0/4239039715 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc01c06ae90 0x7fc01c06d340 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc034000c00 tx=0x7fc034008030 comp rx=0 tx=0).stop 2023-07-14T11:14:52.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.047+0000 7fc0407ff700 1 -- 172.21.15.84:0/4239039715 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0380d1050 msgr2=0x7fc0380cf480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:52.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.047+0000 7fc0407ff700 1 --2- 172.21.15.84:0/4239039715 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0380d1050 0x7fc0380cf480 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fc03000caa0 tx=0x7fc03000ce60 comp rx=0 tx=0).stop 2023-07-14T11:14:52.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.047+0000 7fc0407ff700 1 -- 172.21.15.84:0/4239039715 shutdown_connections 2023-07-14T11:14:52.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.047+0000 7fc0407ff700 1 --2- 172.21.15.84:0/4239039715 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0380d1050 0x7fc0380cf480 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:52.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.047+0000 7fc0407ff700 1 --2- 172.21.15.84:0/4239039715 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0380b4530 0x7fc0381f63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:52.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.047+0000 7fc0407ff700 1 --2- 172.21.15.84:0/4239039715 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc01c06ae90 0x7fc01c06d340 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:52.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.047+0000 7fc0407ff700 1 --2- 172.21.15.84:0/4239039715 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0380b8a60 0x7fc0381f21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:52.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.047+0000 7fc0407ff700 1 -- 172.21.15.84:0/4239039715 >> 172.21.15.84:0/4239039715 conn(0x7fc03809c1b0 msgr2=0x7fc0380b39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:52.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.047+0000 7fc0407ff700 1 -- 172.21.15.84:0/4239039715 shutdown_connections 2023-07-14T11:14:52.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.047+0000 7fc0407ff700 1 -- 172.21.15.84:0/4239039715 wait complete. 2023-07-14T11:14:52.067 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T11:14:52.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.267+0000 7f40067ff700 1 Processor -- start 2023-07-14T11:14:52.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.267+0000 7f40067ff700 1 -- start start 2023-07-14T11:14:52.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.269+0000 7f40067ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f40000ce150 0x7f4000163ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:52.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.269+0000 7f40067ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40000ce8c0 con 0x7f40000cbe40 2023-07-14T11:14:52.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.269+0000 7f40067ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40000cc2b0 con 0x7f4000158bb0 2023-07-14T11:14:52.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.269+0000 7f40067ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f400006b5b0 con 0x7f40000ce150 2023-07-14T11:14:52.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.269+0000 7f3fff7fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f40000cbe40 0x7f40000cda40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49968/0 (socket says 172.21.15.84:49968) 2023-07-14T11:14:52.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.269+0000 7f3fff7fe700 1 -- 172.21.15.84:0/3389848571 learned_addr learned my addr 172.21.15.84:0/3389848571 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:14:52.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.269+0000 7f4004d9c700 1 --2- 172.21.15.84:0/3389848571 >> v2:172.21.15.84:3300/0 conn(0x7f40000ce150 0x7f4000163ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:52.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.269+0000 7f3ffeffd700 1 -- 172.21.15.84:0/3389848571 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2537669572 0 0) 0x7f40000ce8c0 con 0x7f40000cbe40 2023-07-14T11:14:52.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.269+0000 7f3ffeffd700 1 -- 172.21.15.84:0/3389848571 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fe80034d0 con 0x7f40000cbe40 2023-07-14T11:14:52.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.269+0000 7f4004d9c700 1 -- 172.21.15.84:0/3389848571 >> v1:172.21.15.179:6789/0 conn(0x7f4000158bb0 legacy=0x7f40000cd0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:52.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.269+0000 7f4004d9c700 1 -- 172.21.15.84:0/3389848571 >> v1:172.21.15.84:6789/0 conn(0x7f40000cbe40 legacy=0x7f40000cda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:52.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.269+0000 7f4004d9c700 1 -- 172.21.15.84:0/3389848571 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40000cae30 con 0x7f40000ce150 2023-07-14T11:14:52.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.270+0000 7f4004d9c700 1 --2- 172.21.15.84:0/3389848571 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40000ce150 0x7f4000163ac0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f40000cea90 tx=0x7f3ff800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=680c189344140676 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:52.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.270+0000 7f3ffeffd700 1 -- 172.21.15.84:0/3389848571 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff8016070 con 0x7f40000ce150 2023-07-14T11:14:52.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.270+0000 7f3ffeffd700 1 -- 172.21.15.84:0/3389848571 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ff800bb20 con 0x7f40000ce150 2023-07-14T11:14:52.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.270+0000 7f3ffeffd700 1 -- 172.21.15.84:0/3389848571 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff800e070 con 0x7f40000ce150 2023-07-14T11:14:52.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.270+0000 7f40067ff700 1 -- 172.21.15.84:0/3389848571 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40000ce150 msgr2=0x7f4000163ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:52.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.270+0000 7f40067ff700 1 --2- 172.21.15.84:0/3389848571 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40000ce150 0x7f4000163ac0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f40000cea90 tx=0x7f3ff800b330 comp rx=0 tx=0).stop 2023-07-14T11:14:52.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.270+0000 7f40067ff700 1 -- 172.21.15.84:0/3389848571 shutdown_connections 2023-07-14T11:14:52.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.270+0000 7f40067ff700 1 --2- 172.21.15.84:0/3389848571 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40000ce150 0x7f4000163ac0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:52.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.270+0000 7f40067ff700 1 -- 172.21.15.84:0/3389848571 >> 172.21.15.84:0/3389848571 conn(0x7f40000b05d0 msgr2=0x7f40000b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:52.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.271+0000 7f40067ff700 1 -- 172.21.15.84:0/3389848571 shutdown_connections 2023-07-14T11:14:52.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.271+0000 7f40067ff700 1 -- 172.21.15.84:0/3389848571 wait complete. 2023-07-14T11:14:52.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.273+0000 7f40067ff700 1 Processor -- start 2023-07-14T11:14:52.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.273+0000 7f40067ff700 1 -- start start 2023-07-14T11:14:52.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.274+0000 7f40067ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40000cbe40 0x7f40001523b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:52.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.274+0000 7f40067ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40000ce150 0x7f40001e2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:52.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.274+0000 7f40067ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4000158bb0 0x7f40000c7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:52.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.274+0000 7f40067ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40000b3a70 con 0x7f4000158bb0 2023-07-14T11:14:52.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.274+0000 7f40067ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40000c8a40 con 0x7f40000cbe40 2023-07-14T11:14:52.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.274+0000 7f40067ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40000b30d0 con 0x7f40000ce150 2023-07-14T11:14:52.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.275+0000 7f4004d9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4000158bb0 0x7f40000c7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:52.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.275+0000 7f4004d9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4000158bb0 0x7f40000c7b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58878/0 (socket says 172.21.15.84:58878) 2023-07-14T11:14:52.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.275+0000 7f4004d9c700 1 -- 172.21.15.84:0/748930932 learned_addr learned my addr 172.21.15.84:0/748930932 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:52.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.275+0000 7f3ffffff700 1 --2- 172.21.15.84:0/748930932 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40000cbe40 0x7f40001523b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:52.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.275+0000 7f3fff7fe700 1 --2- 172.21.15.84:0/748930932 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40000ce150 0x7f40001e2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:52.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.275+0000 7f4004d9c700 1 -- 172.21.15.84:0/748930932 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40000ce150 msgr2=0x7f40001e2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:52.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.275+0000 7f4004d9c700 1 --2- 172.21.15.84:0/748930932 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40000ce150 0x7f40001e2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:52.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.275+0000 7f4004d9c700 1 -- 172.21.15.84:0/748930932 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40000cbe40 msgr2=0x7f40001523b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:52.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.275+0000 7f4004d9c700 1 --2- 172.21.15.84:0/748930932 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40000cbe40 0x7f40001523b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:52.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.275+0000 7f4004d9c700 1 -- 172.21.15.84:0/748930932 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ff8009a70 con 0x7f4000158bb0 2023-07-14T11:14:52.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.275+0000 7f3fff7fe700 1 --2- 172.21.15.84:0/748930932 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40000ce150 0x7f40001e2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:14:52.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.275+0000 7f4004d9c700 1 --2- 172.21.15.84:0/748930932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4000158bb0 0x7f40000c7b30 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f40000cd800 tx=0x7f3ff8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:52.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.275+0000 7f3ffcff9700 1 -- 172.21.15.84:0/748930932 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff8016040 con 0x7f4000158bb0 2023-07-14T11:14:52.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.276+0000 7f3ffcff9700 1 -- 172.21.15.84:0/748930932 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ff80048f0 con 0x7f4000158bb0 2023-07-14T11:14:52.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.276+0000 7f40067ff700 1 -- 172.21.15.84:0/748930932 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40000b33b0 con 0x7f4000158bb0 2023-07-14T11:14:52.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.276+0000 7f3ffcff9700 1 -- 172.21.15.84:0/748930932 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff801b680 con 0x7f4000158bb0 2023-07-14T11:14:52.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.276+0000 7f40067ff700 1 -- 172.21.15.84:0/748930932 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40001528f0 con 0x7f4000158bb0 2023-07-14T11:14:52.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.277+0000 7f40067ff700 1 -- 172.21.15.84:0/748930932 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40000b3bb0 con 0x7f4000158bb0 2023-07-14T11:14:52.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.278+0000 7f3ffcff9700 1 -- 172.21.15.84:0/748930932 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 7) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f3ff801b7e0 con 0x7f4000158bb0 2023-07-14T11:14:52.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.279+0000 7f3ffcff9700 1 --2- 172.21.15.84:0/748930932 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f3fec06ae90 0x7f3fec06d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:52.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.279+0000 7f3ffcff9700 1 -- 172.21.15.84:0/748930932 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3ff808b2a0 con 0x7f4000158bb0 2023-07-14T11:14:52.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.279+0000 7f3ffffff700 1 --2- 172.21.15.84:0/748930932 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f3fec06ae90 0x7f3fec06d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:52.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.280+0000 7f3ffffff700 1 --2- 172.21.15.84:0/748930932 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f3fec06ae90 0x7f3fec06d340 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3ff0007fd0 tx=0x7f3ff0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:52.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.284+0000 7f3ffcff9700 1 -- 172.21.15.84:0/748930932 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f40000b3bb0 con 0x7f4000158bb0 2023-07-14T11:14:52.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.477+0000 7f40067ff700 1 -- 172.21.15.84:0/748930932 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f40000b3bb0 con 0x7f4000158bb0 2023-07-14T11:14:52.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.477+0000 7f3ffcff9700 1 -- 172.21.15.84:0/748930932 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v37) v1 ==== 100+0+11 (secure 0 0 0) 0x7f40000b3bb0 con 0x7f4000158bb0 2023-07-14T11:14:52.480 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-07-14T11:14:52.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.479+0000 7f40067ff700 1 -- 172.21.15.84:0/748930932 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f3fec06ae90 msgr2=0x7f3fec06d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:52.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.479+0000 7f40067ff700 1 --2- 172.21.15.84:0/748930932 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f3fec06ae90 0x7f3fec06d340 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3ff0007fd0 tx=0x7f3ff0009040 comp rx=0 tx=0).stop 2023-07-14T11:14:52.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.479+0000 7f40067ff700 1 -- 172.21.15.84:0/748930932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4000158bb0 msgr2=0x7f40000c7b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:52.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.479+0000 7f40067ff700 1 --2- 172.21.15.84:0/748930932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4000158bb0 0x7f40000c7b30 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f40000cd800 tx=0x7f3ff8004ad0 comp rx=0 tx=0).stop 2023-07-14T11:14:52.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.480+0000 7f40067ff700 1 -- 172.21.15.84:0/748930932 shutdown_connections 2023-07-14T11:14:52.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.480+0000 7f40067ff700 1 --2- 172.21.15.84:0/748930932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4000158bb0 0x7f40000c7b30 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:52.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.480+0000 7f40067ff700 1 --2- 172.21.15.84:0/748930932 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40000cbe40 0x7f40001523b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:52.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.480+0000 7f40067ff700 1 --2- 172.21.15.84:0/748930932 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f3fec06ae90 0x7f3fec06d340 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:52.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.480+0000 7f40067ff700 1 --2- 172.21.15.84:0/748930932 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40000ce150 0x7f40001e2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:52.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.480+0000 7f40067ff700 1 -- 172.21.15.84:0/748930932 >> 172.21.15.84:0/748930932 conn(0x7f40000b05d0 msgr2=0x7f400006b900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:52.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.480+0000 7f40067ff700 1 -- 172.21.15.84:0/748930932 shutdown_connections 2023-07-14T11:14:52.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.480+0000 7f40067ff700 1 -- 172.21.15.84:0/748930932 wait complete. 2023-07-14T11:14:52.499 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-14T11:14:52.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.694+0000 7f7a48fff700 1 Processor -- start 2023-07-14T11:14:52.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.694+0000 7f7a48fff700 1 -- start start 2023-07-14T11:14:52.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.695+0000 7f7a48fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a440c92d0 0x7f7a440ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:52.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.695+0000 7f7a48fff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a4415ce70 con 0x7f7a440b12f0 2023-07-14T11:14:52.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.695+0000 7f7a48fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a4415d0c0 con 0x7f7a440adea0 2023-07-14T11:14:52.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.695+0000 7f7a48fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4415da60 con 0x7f7a440c92d0 2023-07-14T11:14:52.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.695+0000 7f7a41d9b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f7a440b12f0 0x7f7a440c96a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49970/0 (socket says 172.21.15.84:49970) 2023-07-14T11:14:52.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.695+0000 7f7a41d9b700 1 -- 172.21.15.84:0/4186360292 learned_addr learned my addr 172.21.15.84:0/4186360292 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:14:52.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.696+0000 7f7a4259c700 1 --2- 172.21.15.84:0/4186360292 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a440c92d0 0x7f7a440ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:52.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.696+0000 7f7a4159a700 1 -- 172.21.15.84:0/4186360292 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4100221926 0 0) 0x7f7a4415ce70 con 0x7f7a440b12f0 2023-07-14T11:14:52.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.696+0000 7f7a4159a700 1 -- 172.21.15.84:0/4186360292 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a2c0035b0 con 0x7f7a440b12f0 2023-07-14T11:14:52.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.696+0000 7f7a4159a700 1 -- 172.21.15.84:0/4186360292 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2221099436 0 0) 0x7f7a4415d0c0 con 0x7f7a440adea0 2023-07-14T11:14:52.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.696+0000 7f7a4159a700 1 -- 172.21.15.84:0/4186360292 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a4415ce70 con 0x7f7a440adea0 2023-07-14T11:14:52.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.696+0000 7f7a4159a700 1 -- 172.21.15.84:0/4186360292 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2107596285 0 0) 0x7f7a2c0035b0 con 0x7f7a440b12f0 2023-07-14T11:14:52.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.696+0000 7f7a4259c700 1 -- 172.21.15.84:0/4186360292 >> v1:172.21.15.179:6789/0 conn(0x7f7a440adea0 legacy=0x7f7a440cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:52.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.696+0000 7f7a4259c700 1 -- 172.21.15.84:0/4186360292 >> v1:172.21.15.84:6789/0 conn(0x7f7a440b12f0 legacy=0x7f7a440c96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:52.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.696+0000 7f7a4259c700 1 -- 172.21.15.84:0/4186360292 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a4415d3a0 con 0x7f7a440c92d0 2023-07-14T11:14:52.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.696+0000 7f7a4259c700 1 --2- 172.21.15.84:0/4186360292 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a440c92d0 0x7f7a440ad8f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7a34009870 tx=0x7f7a34009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebc1f02263f4d570 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:52.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.697+0000 7f7a4159a700 1 -- 172.21.15.84:0/4186360292 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a38001670 con 0x7f7a440c92d0 2023-07-14T11:14:52.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.697+0000 7f7a4159a700 1 -- 172.21.15.84:0/4186360292 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a34004030 con 0x7f7a440c92d0 2023-07-14T11:14:52.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.697+0000 7f7a4159a700 1 -- 172.21.15.84:0/4186360292 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a340043c0 con 0x7f7a440c92d0 2023-07-14T11:14:52.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.697+0000 7f7a48fff700 1 -- 172.21.15.84:0/4186360292 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a440c92d0 msgr2=0x7f7a440ad8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:52.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.697+0000 7f7a48fff700 1 --2- 172.21.15.84:0/4186360292 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a440c92d0 0x7f7a440ad8f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7a34009870 tx=0x7f7a34009b80 comp rx=0 tx=0).stop 2023-07-14T11:14:52.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.697+0000 7f7a48fff700 1 -- 172.21.15.84:0/4186360292 shutdown_connections 2023-07-14T11:14:52.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.697+0000 7f7a48fff700 1 --2- 172.21.15.84:0/4186360292 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a440c92d0 0x7f7a440ad8f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:52.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.697+0000 7f7a48fff700 1 -- 172.21.15.84:0/4186360292 >> 172.21.15.84:0/4186360292 conn(0x7f7a440b05d0 msgr2=0x7f7a440b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:52.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.697+0000 7f7a48fff700 1 -- 172.21.15.84:0/4186360292 shutdown_connections 2023-07-14T11:14:52.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.697+0000 7f7a48fff700 1 -- 172.21.15.84:0/4186360292 wait complete. 2023-07-14T11:14:52.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.699+0000 7f7a48fff700 1 Processor -- start 2023-07-14T11:14:52.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.699+0000 7f7a48fff700 1 -- start start 2023-07-14T11:14:52.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.700+0000 7f7a48fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a440adea0 0x7f7a44152000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:52.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.700+0000 7f7a48fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a440b12f0 0x7f7a440c8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:52.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.700+0000 7f7a48fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a440c92d0 0x7f7a4415ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:52.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.700+0000 7f7a48fff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4415a950 con 0x7f7a440b12f0 2023-07-14T11:14:52.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.700+0000 7f7a48fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a44159cd0 con 0x7f7a440c92d0 2023-07-14T11:14:52.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.700+0000 7f7a48fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a44159fb0 con 0x7f7a440adea0 2023-07-14T11:14:52.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.700+0000 7f7a41d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a440b12f0 0x7f7a440c8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:52.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.701+0000 7f7a41d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a440b12f0 0x7f7a440c8210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58882/0 (socket says 172.21.15.84:58882) 2023-07-14T11:14:52.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.701+0000 7f7a41d9b700 1 -- 172.21.15.84:0/1990875301 learned_addr learned my addr 172.21.15.84:0/1990875301 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:52.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.701+0000 7f7a4259c700 1 --2- 172.21.15.84:0/1990875301 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a440adea0 0x7f7a44152000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:52.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.701+0000 7f7a41d9b700 1 -- 172.21.15.84:0/1990875301 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a440adea0 msgr2=0x7f7a44152000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:52.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.701+0000 7f7a42d9d700 1 --2- 172.21.15.84:0/1990875301 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a440c92d0 0x7f7a4415ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:52.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.701+0000 7f7a41d9b700 1 --2- 172.21.15.84:0/1990875301 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a440adea0 0x7f7a44152000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:52.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.701+0000 7f7a41d9b700 1 -- 172.21.15.84:0/1990875301 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a440c92d0 msgr2=0x7f7a4415ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:52.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.701+0000 7f7a41d9b700 1 --2- 172.21.15.84:0/1990875301 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a440c92d0 0x7f7a4415ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:52.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.701+0000 7f7a41d9b700 1 -- 172.21.15.84:0/1990875301 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a340094a0 con 0x7f7a440b12f0 2023-07-14T11:14:52.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.701+0000 7f7a4259c700 1 --2- 172.21.15.84:0/1990875301 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a440adea0 0x7f7a44152000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:14:52.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.701+0000 7f7a42d9d700 1 --2- 172.21.15.84:0/1990875301 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a440c92d0 0x7f7a4415ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:14:52.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.701+0000 7f7a41d9b700 1 --2- 172.21.15.84:0/1990875301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a440b12f0 0x7f7a440c8210 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f7a3800c730 tx=0x7f7a3800caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:52.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.701+0000 7f7a32ffd700 1 -- 172.21.15.84:0/1990875301 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a38004c80 con 0x7f7a440b12f0 2023-07-14T11:14:52.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.701+0000 7f7a32ffd700 1 -- 172.21.15.84:0/1990875301 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a38004e00 con 0x7f7a440b12f0 2023-07-14T11:14:52.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.701+0000 7f7a48fff700 1 -- 172.21.15.84:0/1990875301 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a4415a290 con 0x7f7a440b12f0 2023-07-14T11:14:52.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.701+0000 7f7a32ffd700 1 -- 172.21.15.84:0/1990875301 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a38007310 con 0x7f7a440b12f0 2023-07-14T11:14:52.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.702+0000 7f7a48fff700 1 -- 172.21.15.84:0/1990875301 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a44152540 con 0x7f7a440b12f0 2023-07-14T11:14:52.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.703+0000 7f7a48fff700 1 -- 172.21.15.84:0/1990875301 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a4415aa90 con 0x7f7a440b12f0 2023-07-14T11:14:52.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.703+0000 7f7a32ffd700 1 -- 172.21.15.84:0/1990875301 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 7) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f7a38007470 con 0x7f7a440b12f0 2023-07-14T11:14:52.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.704+0000 7f7a32ffd700 1 --2- 172.21.15.84:0/1990875301 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f7a2406ae90 0x7f7a2406d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:52.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.704+0000 7f7a32ffd700 1 -- 172.21.15.84:0/1990875301 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7a380896b0 con 0x7f7a440b12f0 2023-07-14T11:14:52.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.705+0000 7f7a4259c700 1 --2- 172.21.15.84:0/1990875301 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f7a2406ae90 0x7f7a2406d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:52.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.705+0000 7f7a4259c700 1 --2- 172.21.15.84:0/1990875301 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f7a2406ae90 0x7f7a2406d340 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7a34009bc0 tx=0x7f7a34013040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:52.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.709+0000 7f7a32ffd700 1 -- 172.21.15.84:0/1990875301 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7a4415aa90 con 0x7f7a440b12f0 2023-07-14T11:14:52.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.920+0000 7f7a48fff700 1 -- 172.21.15.84:0/1990875301 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7a4415aa90 con 0x7f7a440b12f0 2023-07-14T11:14:52.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.921+0000 7f7a32ffd700 1 -- 172.21.15.84:0/1990875301 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v37) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7a4415aa90 con 0x7f7a440b12f0 2023-07-14T11:14:52.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.923+0000 7f7a48fff700 1 -- 172.21.15.84:0/1990875301 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f7a2406ae90 msgr2=0x7f7a2406d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:52.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.923+0000 7f7a48fff700 1 --2- 172.21.15.84:0/1990875301 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f7a2406ae90 0x7f7a2406d340 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7a34009bc0 tx=0x7f7a34013040 comp rx=0 tx=0).stop 2023-07-14T11:14:52.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.923+0000 7f7a48fff700 1 -- 172.21.15.84:0/1990875301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a440b12f0 msgr2=0x7f7a440c8210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:52.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.923+0000 7f7a48fff700 1 --2- 172.21.15.84:0/1990875301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a440b12f0 0x7f7a440c8210 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f7a3800c730 tx=0x7f7a3800caf0 comp rx=0 tx=0).stop 2023-07-14T11:14:52.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.923+0000 7f7a48fff700 1 -- 172.21.15.84:0/1990875301 shutdown_connections 2023-07-14T11:14:52.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.923+0000 7f7a48fff700 1 --2- 172.21.15.84:0/1990875301 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f7a2406ae90 0x7f7a2406d340 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:52.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.923+0000 7f7a48fff700 1 --2- 172.21.15.84:0/1990875301 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a440adea0 0x7f7a44152000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:52.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.923+0000 7f7a48fff700 1 --2- 172.21.15.84:0/1990875301 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a440c92d0 0x7f7a4415ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:52.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.923+0000 7f7a48fff700 1 --2- 172.21.15.84:0/1990875301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a440b12f0 0x7f7a440c8210 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:52.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.923+0000 7f7a48fff700 1 -- 172.21.15.84:0/1990875301 >> 172.21.15.84:0/1990875301 conn(0x7f7a440b05d0 msgr2=0x7f7a440cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:52.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.923+0000 7f7a48fff700 1 -- 172.21.15.84:0/1990875301 shutdown_connections 2023-07-14T11:14:52.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:52.923+0000 7f7a48fff700 1 -- 172.21.15.84:0/1990875301 wait complete. 2023-07-14T11:14:52.927 INFO:teuthology.orchestra.run.smithi084.stderr:listed 0 entries 2023-07-14T11:14:52.943 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-07-14T11:14:52.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:14:52.944 DEBUG:teuthology.orchestra.run.smithi179:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-07-14T11:14:53.038 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi179.front.sepia.ceph.com 2023-07-14T11:14:53.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:14:53.039 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-14T11:14:53.087 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-14T11:14:53.087 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:14:53.134 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345568k,nr_inodes=4086392,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=35,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275008k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-07-14T11:14:53.134 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-07-14T11:14:53.134 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:14:53.181 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345528k,nr_inodes=4086382,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=40,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275000k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-07-14T11:14:53.181 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T11:14:53.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.373+0000 7fec791ff700 1 Processor -- start 2023-07-14T11:14:53.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.373+0000 7fec791ff700 1 -- start start 2023-07-14T11:14:53.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.375+0000 7fec791ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec740d1220 0x7fec740b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:53.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.375+0000 7fec791ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fec740b1e00 0x7fec740afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:53.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.375+0000 7fec791ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec740d2ce0 con 0x7fec7415c950 2023-07-14T11:14:53.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.375+0000 7fec791ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec740b3350 con 0x7fec740b1e00 2023-07-14T11:14:53.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.375+0000 7fec791ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec740b3630 con 0x7fec740d1220 2023-07-14T11:14:53.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.375+0000 7fec72d9d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fec7415c950 0x7fec740d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49980/0 (socket says 172.21.15.84:49980) 2023-07-14T11:14:53.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.375+0000 7fec72d9d700 1 -- 172.21.15.84:0/1244164288 learned_addr learned my addr 172.21.15.84:0/1244164288 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:14:53.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.375+0000 7fec6bfff700 1 --2- 172.21.15.84:0/1244164288 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec740d1220 0x7fec740b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:53.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.375+0000 7fec7359e700 1 --2- 172.21.15.84:0/1244164288 >> v2:172.21.15.179:3300/0 conn(0x7fec740b1e00 0x7fec740afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:53.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.375+0000 7fec7259c700 1 -- 172.21.15.84:0/1244164288 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1756639350 0 0) 0x7fec740d2ce0 con 0x7fec7415c950 2023-07-14T11:14:53.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.375+0000 7fec7259c700 1 -- 172.21.15.84:0/1244164288 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec600035b0 con 0x7fec7415c950 2023-07-14T11:14:53.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.375+0000 7fec6bfff700 1 -- 172.21.15.84:0/1244164288 >> v2:172.21.15.179:3300/0 conn(0x7fec740b1e00 msgr2=0x7fec740afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:53.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.375+0000 7fec6bfff700 1 --2- 172.21.15.84:0/1244164288 >> v2:172.21.15.179:3300/0 conn(0x7fec740b1e00 0x7fec740afac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:53.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.375+0000 7fec6bfff700 1 -- 172.21.15.84:0/1244164288 >> v1:172.21.15.84:6789/0 conn(0x7fec7415c950 legacy=0x7fec740d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:53.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.375+0000 7fec6bfff700 1 -- 172.21.15.84:0/1244164288 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec740b3910 con 0x7fec740d1220 2023-07-14T11:14:53.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.375+0000 7fec7359e700 1 --2- 172.21.15.84:0/1244164288 >> v2:172.21.15.179:3300/0 conn(0x7fec740b1e00 0x7fec740afac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:14:53.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.376+0000 7fec6bfff700 1 --2- 172.21.15.84:0/1244164288 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec740d1220 0x7fec740b43f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fec5c009840 tx=0x7fec5c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35cda039c66eb941 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:53.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.376+0000 7fec7259c700 1 -- 172.21.15.84:0/1244164288 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5c011830 con 0x7fec740d1220 2023-07-14T11:14:53.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.376+0000 7fec7259c700 1 -- 172.21.15.84:0/1244164288 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec5c011990 con 0x7fec740d1220 2023-07-14T11:14:53.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.376+0000 7fec7259c700 1 -- 172.21.15.84:0/1244164288 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5c011d20 con 0x7fec740d1220 2023-07-14T11:14:53.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.376+0000 7fec791ff700 1 -- 172.21.15.84:0/1244164288 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec740d1220 msgr2=0x7fec740b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:53.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.376+0000 7fec791ff700 1 --2- 172.21.15.84:0/1244164288 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec740d1220 0x7fec740b43f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fec5c009840 tx=0x7fec5c009b50 comp rx=0 tx=0).stop 2023-07-14T11:14:53.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.377+0000 7fec791ff700 1 -- 172.21.15.84:0/1244164288 shutdown_connections 2023-07-14T11:14:53.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.377+0000 7fec791ff700 1 --2- 172.21.15.84:0/1244164288 >> v2:172.21.15.179:3300/0 conn(0x7fec740b1e00 0x7fec740afac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:53.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.377+0000 7fec791ff700 1 --2- 172.21.15.84:0/1244164288 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec740d1220 0x7fec740b43f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:53.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.377+0000 7fec791ff700 1 -- 172.21.15.84:0/1244164288 >> 172.21.15.84:0/1244164288 conn(0x7fec7409c1d0 msgr2=0x7fec740d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:53.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.377+0000 7fec791ff700 1 -- 172.21.15.84:0/1244164288 shutdown_connections 2023-07-14T11:14:53.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.377+0000 7fec791ff700 1 -- 172.21.15.84:0/1244164288 wait complete. 2023-07-14T11:14:53.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.378+0000 7fec791ff700 1 Processor -- start 2023-07-14T11:14:53.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.379+0000 7fec791ff700 1 -- start start 2023-07-14T11:14:53.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.379+0000 7fec791ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec740b1e00 0x7fec740cb540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:53.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.379+0000 7fec791ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec740d1220 0x7fec740c8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:53.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.379+0000 7fec791ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec7415c950 0x7fec740cfbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:53.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.379+0000 7fec791ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec741578c0 con 0x7fec740b1e00 2023-07-14T11:14:53.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.379+0000 7fec791ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec740cf720 con 0x7fec7415c950 2023-07-14T11:14:53.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.380+0000 7fec791ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec740ceb10 con 0x7fec740d1220 2023-07-14T11:14:53.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.380+0000 7fec72d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec740b1e00 0x7fec740cb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:53.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.380+0000 7fec72d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec740b1e00 0x7fec740cb540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58894/0 (socket says 172.21.15.84:58894) 2023-07-14T11:14:53.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.380+0000 7fec72d9d700 1 -- 172.21.15.84:0/304386258 learned_addr learned my addr 172.21.15.84:0/304386258 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:53.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.380+0000 7fec6bfff700 1 --2- 172.21.15.84:0/304386258 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec740d1220 0x7fec740c8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:53.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.380+0000 7fec7359e700 1 --2- 172.21.15.84:0/304386258 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec7415c950 0x7fec740cfbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:53.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.380+0000 7fec72d9d700 1 -- 172.21.15.84:0/304386258 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec740d1220 msgr2=0x7fec740c8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:53.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.380+0000 7fec72d9d700 1 --2- 172.21.15.84:0/304386258 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec740d1220 0x7fec740c8eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:53.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.380+0000 7fec72d9d700 1 -- 172.21.15.84:0/304386258 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec7415c950 msgr2=0x7fec740cfbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:53.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.380+0000 7fec72d9d700 1 --2- 172.21.15.84:0/304386258 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec7415c950 0x7fec740cfbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:53.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.380+0000 7fec72d9d700 1 -- 172.21.15.84:0/304386258 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec6c009a70 con 0x7fec740b1e00 2023-07-14T11:14:53.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.380+0000 7fec7359e700 1 --2- 172.21.15.84:0/304386258 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec7415c950 0x7fec740cfbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:14:53.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.380+0000 7fec72d9d700 1 --2- 172.21.15.84:0/304386258 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec740b1e00 0x7fec740cb540 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fec6400c4d0 tx=0x7fec6400c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:53.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.381+0000 7fec6b7fe700 1 -- 172.21.15.84:0/304386258 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec640074e0 con 0x7fec740b1e00 2023-07-14T11:14:53.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.381+0000 7fec6b7fe700 1 -- 172.21.15.84:0/304386258 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec64007640 con 0x7fec740b1e00 2023-07-14T11:14:53.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.381+0000 7fec791ff700 1 -- 172.21.15.84:0/304386258 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec5c0094a0 con 0x7fec740b1e00 2023-07-14T11:14:53.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.381+0000 7fec6b7fe700 1 -- 172.21.15.84:0/304386258 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec64005a50 con 0x7fec740b1e00 2023-07-14T11:14:53.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.381+0000 7fec791ff700 1 -- 172.21.15.84:0/304386258 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec740cf0d0 con 0x7fec740b1e00 2023-07-14T11:14:53.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.382+0000 7fec791ff700 1 -- 172.21.15.84:0/304386258 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec740cfa00 con 0x7fec740b1e00 2023-07-14T11:14:53.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.383+0000 7fec6b7fe700 1 -- 172.21.15.84:0/304386258 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 7) v1 ==== 89190+0+0 (secure 0 0 0) 0x7fec64005bb0 con 0x7fec740b1e00 2023-07-14T11:14:53.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.383+0000 7fec6b7fe700 1 --2- 172.21.15.84:0/304386258 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fec5406ae90 0x7fec5406d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:53.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.384+0000 7fec6b7fe700 1 -- 172.21.15.84:0/304386258 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fec64088c50 con 0x7fec740b1e00 2023-07-14T11:14:53.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.384+0000 7fec6bfff700 1 --2- 172.21.15.84:0/304386258 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fec5406ae90 0x7fec5406d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:53.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.384+0000 7fec6bfff700 1 --2- 172.21.15.84:0/304386258 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fec5406ae90 0x7fec5406d340 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fec740d1610 tx=0x7fec5c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:53.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.388+0000 7fec6b7fe700 1 -- 172.21.15.84:0/304386258 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fec64053a70 con 0x7fec740b1e00 2023-07-14T11:14:53.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.623+0000 7fec791ff700 1 -- 172.21.15.84:0/304386258 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fec7404e280 con 0x7fec740b1e00 2023-07-14T11:14:53.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.624+0000 7fec6b7fe700 1 -- 172.21.15.84:0/304386258 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4700 (secure 0 0 0) 0x7fec64017090 con 0x7fec740b1e00 2023-07-14T11:14:53.626 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:14:53.627 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4751,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/76454361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":76454361},{"type":"v1","addr":"172.21.15.179:6833","nonce":76454361}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4757,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/534886511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":534886511},{"type":"v1","addr":"172.21.15.179:6835","nonce":534886511}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5118,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/930551517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":930551517},{"type":"v1","addr":"172.21.15.84:6836","nonce":930551517}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T11:14:32.504609+0000","modified":"2023-07-14T11:14:36.048621+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5121},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5121":{"gid":5121,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.84:6837/932986208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":932986208},{"type":"v1","addr":"172.21.15.84:6837","nonce":932986208}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-14T11:14:53.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.627+0000 7fec791ff700 1 -- 172.21.15.84:0/304386258 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fec5406ae90 msgr2=0x7fec5406d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:53.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.627+0000 7fec791ff700 1 --2- 172.21.15.84:0/304386258 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fec5406ae90 0x7fec5406d340 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fec740d1610 tx=0x7fec5c008030 comp rx=0 tx=0).stop 2023-07-14T11:14:53.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.627+0000 7fec791ff700 1 -- 172.21.15.84:0/304386258 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec740b1e00 msgr2=0x7fec740cb540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:53.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.627+0000 7fec791ff700 1 --2- 172.21.15.84:0/304386258 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec740b1e00 0x7fec740cb540 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fec6400c4d0 tx=0x7fec6400c7e0 comp rx=0 tx=0).stop 2023-07-14T11:14:53.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.627+0000 7fec791ff700 1 -- 172.21.15.84:0/304386258 shutdown_connections 2023-07-14T11:14:53.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.627+0000 7fec791ff700 1 --2- 172.21.15.84:0/304386258 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec7415c950 0x7fec740cfbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:53.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.627+0000 7fec791ff700 1 --2- 172.21.15.84:0/304386258 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec740b1e00 0x7fec740cb540 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:53.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.627+0000 7fec791ff700 1 --2- 172.21.15.84:0/304386258 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fec5406ae90 0x7fec5406d340 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:53.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.627+0000 7fec791ff700 1 --2- 172.21.15.84:0/304386258 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec740d1220 0x7fec740c8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:53.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.627+0000 7fec791ff700 1 -- 172.21.15.84:0/304386258 >> 172.21.15.84:0/304386258 conn(0x7fec7409c1d0 msgr2=0x7fec740b5260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:53.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.627+0000 7fec791ff700 1 -- 172.21.15.84:0/304386258 shutdown_connections 2023-07-14T11:14:53.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.627+0000 7fec791ff700 1 -- 172.21.15.84:0/304386258 wait complete. 2023-07-14T11:14:53.631 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 19 2023-07-14T11:14:53.646 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:14:53.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.840+0000 7f01f93ff700 1 Processor -- start 2023-07-14T11:14:53.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.840+0000 7f01f93ff700 1 -- start start 2023-07-14T11:14:53.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.841+0000 7f01f93ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01f415c960 0x7f01f40b1f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:53.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.841+0000 7f01f93ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f01f40cdb40 0x7f01f40d2af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:53.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.841+0000 7f01f93ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01f40d0ef0 con 0x7f01f40b1990 2023-07-14T11:14:53.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.841+0000 7f01f93ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01f415d140 con 0x7f01f40cdb40 2023-07-14T11:14:53.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.841+0000 7f01f93ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01f415d420 con 0x7f01f415c960 2023-07-14T11:14:53.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.841+0000 7f01f37fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f01f40cdb40 0x7f01f40d2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:53.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.842+0000 7f01f37fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f01f40cdb40 0x7f01f40d2af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58896/0 (socket says 172.21.15.84:58896) 2023-07-14T11:14:53.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.842+0000 7f01f27fc700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f01f40b1990 0x7f01f40cd430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49986/0 (socket says 172.21.15.84:49986) 2023-07-14T11:14:53.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.842+0000 7f01f37fe700 1 -- 172.21.15.84:0/3619945426 learned_addr learned my addr 172.21.15.84:0/3619945426 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:53.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.842+0000 7f01f2ffd700 1 --2- 172.21.15.84:0/3619945426 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01f415c960 0x7f01f40b1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:53.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.842+0000 7f01f37fe700 1 -- 172.21.15.84:0/3619945426 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01f415c960 msgr2=0x7f01f40b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:53.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.842+0000 7f01f37fe700 1 --2- 172.21.15.84:0/3619945426 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01f415c960 0x7f01f40b1f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:53.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.842+0000 7f01f37fe700 1 -- 172.21.15.84:0/3619945426 >> v1:172.21.15.84:6789/0 conn(0x7f01f40b1990 legacy=0x7f01f40cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:53.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.842+0000 7f01f37fe700 1 -- 172.21.15.84:0/3619945426 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01f415d700 con 0x7f01f40cdb40 2023-07-14T11:14:53.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.842+0000 7f01f2ffd700 1 --2- 172.21.15.84:0/3619945426 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01f415c960 0x7f01f40b1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:14:53.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.842+0000 7f01f1ffb700 1 -- 172.21.15.84:0/3619945426 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4285524959 0 0) 0x7f01f40d0ef0 con 0x7f01f40b1990 2023-07-14T11:14:53.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.842+0000 7f01f37fe700 1 --2- 172.21.15.84:0/3619945426 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01f40cdb40 0x7f01f40d2af0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f01ec009e50 tx=0x7f01ec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21a19e46ecb679ac server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:53.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.842+0000 7f01f1ffb700 1 -- 172.21.15.84:0/3619945426 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01ec00e070 con 0x7f01f40cdb40 2023-07-14T11:14:53.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.842+0000 7f01f1ffb700 1 -- 172.21.15.84:0/3619945426 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01ec00b9c0 con 0x7f01f40cdb40 2023-07-14T11:14:53.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.842+0000 7f01f1ffb700 1 -- 172.21.15.84:0/3619945426 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01ec00bd70 con 0x7f01f40cdb40 2023-07-14T11:14:53.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.843+0000 7f01f93ff700 1 -- 172.21.15.84:0/3619945426 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01f40cdb40 msgr2=0x7f01f40d2af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:53.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.843+0000 7f01f93ff700 1 --2- 172.21.15.84:0/3619945426 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01f40cdb40 0x7f01f40d2af0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f01ec009e50 tx=0x7f01ec00b330 comp rx=0 tx=0).stop 2023-07-14T11:14:53.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.843+0000 7f01f93ff700 1 -- 172.21.15.84:0/3619945426 shutdown_connections 2023-07-14T11:14:53.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.843+0000 7f01f93ff700 1 --2- 172.21.15.84:0/3619945426 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01f40cdb40 0x7f01f40d2af0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:53.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.843+0000 7f01f93ff700 1 --2- 172.21.15.84:0/3619945426 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01f415c960 0x7f01f40b1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:53.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.843+0000 7f01f93ff700 1 -- 172.21.15.84:0/3619945426 >> 172.21.15.84:0/3619945426 conn(0x7f01f406a5c0 msgr2=0x7f01f406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:53.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.843+0000 7f01f93ff700 1 -- 172.21.15.84:0/3619945426 shutdown_connections 2023-07-14T11:14:53.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.843+0000 7f01f93ff700 1 -- 172.21.15.84:0/3619945426 wait complete. 2023-07-14T11:14:53.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.845+0000 7f01f93ff700 1 Processor -- start 2023-07-14T11:14:53.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.845+0000 7f01f93ff700 1 -- start start 2023-07-14T11:14:53.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.846+0000 7f01f93ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01f40b1990 0x7f01f40cc740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:53.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.846+0000 7f01f93ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01f40cdb40 0x7f01f4156e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:53.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.846+0000 7f01f93ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01f415c960 0x7f01f4151510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:53.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.846+0000 7f01f93ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f40b5cb0 con 0x7f01f40b1990 2023-07-14T11:14:53.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.846+0000 7f01f93ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f40b5f90 con 0x7f01f415c960 2023-07-14T11:14:53.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.846+0000 7f01f93ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01f40b6270 con 0x7f01f40cdb40 2023-07-14T11:14:53.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.846+0000 7f01f2ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01f40b1990 0x7f01f40cc740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:53.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.846+0000 7f01f2ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01f40b1990 0x7f01f40cc740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58902/0 (socket says 172.21.15.84:58902) 2023-07-14T11:14:53.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.846+0000 7f01f2ffd700 1 -- 172.21.15.84:0/3451193010 learned_addr learned my addr 172.21.15.84:0/3451193010 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:53.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.846+0000 7f01f2ffd700 1 -- 172.21.15.84:0/3451193010 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01f40cdb40 msgr2=0x7f01f4156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:53.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.846+0000 7f01f2ffd700 1 --2- 172.21.15.84:0/3451193010 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01f40cdb40 0x7f01f4156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:53.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.846+0000 7f01f2ffd700 1 -- 172.21.15.84:0/3451193010 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01f415c960 msgr2=0x7f01f4151510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:53.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.846+0000 7f01f2ffd700 1 --2- 172.21.15.84:0/3451193010 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01f415c960 0x7f01f4151510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:53.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.846+0000 7f01f2ffd700 1 -- 172.21.15.84:0/3451193010 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01ec009b30 con 0x7f01f40b1990 2023-07-14T11:14:53.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.847+0000 7f01f2ffd700 1 --2- 172.21.15.84:0/3451193010 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01f40b1990 0x7f01f40cc740 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f01e400c750 tx=0x7f01e400cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:53.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.847+0000 7f01db7fe700 1 -- 172.21.15.84:0/3451193010 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e4011800 con 0x7f01f40b1990 2023-07-14T11:14:53.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.847+0000 7f01db7fe700 1 -- 172.21.15.84:0/3451193010 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01e4011960 con 0x7f01f40b1990 2023-07-14T11:14:53.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.847+0000 7f01f93ff700 1 -- 172.21.15.84:0/3451193010 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01f4156690 con 0x7f01f40b1990 2023-07-14T11:14:53.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.847+0000 7f01db7fe700 1 -- 172.21.15.84:0/3451193010 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e4011cd0 con 0x7f01f40b1990 2023-07-14T11:14:53.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.847+0000 7f01f93ff700 1 -- 172.21.15.84:0/3451193010 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01f40ccc80 con 0x7f01f40b1990 2023-07-14T11:14:53.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.848+0000 7f01f93ff700 1 -- 172.21.15.84:0/3451193010 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01f4156bb0 con 0x7f01f40b1990 2023-07-14T11:14:53.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.849+0000 7f01db7fe700 1 -- 172.21.15.84:0/3451193010 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 7) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f01e4021350 con 0x7f01f40b1990 2023-07-14T11:14:53.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.850+0000 7f01db7fe700 1 --2- 172.21.15.84:0/3451193010 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f01e006ae90 0x7f01e006d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:53.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.850+0000 7f01db7fe700 1 -- 172.21.15.84:0/3451193010 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f01e4089860 con 0x7f01f40b1990 2023-07-14T11:14:53.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.850+0000 7f01f27fc700 1 --2- 172.21.15.84:0/3451193010 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f01e006ae90 0x7f01e006d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:53.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.851+0000 7f01f27fc700 1 --2- 172.21.15.84:0/3451193010 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f01e006ae90 0x7f01e006d340 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f01f41f6500 tx=0x7f01e80079f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:53.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:53.854+0000 7f01db7fe700 1 -- 172.21.15.84:0/3451193010 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f01f4156bb0 con 0x7f01f40b1990 2023-07-14T11:14:54.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.052+0000 7f01f93ff700 1 -- 172.21.15.84:0/3451193010 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f01f4156bb0 con 0x7f01f40b1990 2023-07-14T11:14:54.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.053+0000 7f01db7fe700 1 -- 172.21.15.84:0/3451193010 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18327 (secure 0 0 0) 0x7f01e4054570 con 0x7f01f40b1990 2023-07-14T11:14:54.055 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:14:54.056 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":37,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:14:34.030805+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-14T11:14:30.730753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-14T11:14:31.485809+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:14:54.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.055+0000 7f01f93ff700 1 -- 172.21.15.84:0/3451193010 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f01e006ae90 msgr2=0x7f01e006d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:54.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.055+0000 7f01f93ff700 1 --2- 172.21.15.84:0/3451193010 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f01e006ae90 0x7f01e006d340 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f01f41f6500 tx=0x7f01e80079f0 comp rx=0 tx=0).stop 2023-07-14T11:14:54.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.055+0000 7f01f93ff700 1 -- 172.21.15.84:0/3451193010 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01f40b1990 msgr2=0x7f01f40cc740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:54.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.055+0000 7f01f93ff700 1 --2- 172.21.15.84:0/3451193010 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01f40b1990 0x7f01f40cc740 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f01e400c750 tx=0x7f01e400cb10 comp rx=0 tx=0).stop 2023-07-14T11:14:54.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.055+0000 7f01f93ff700 1 -- 172.21.15.84:0/3451193010 shutdown_connections 2023-07-14T11:14:54.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.055+0000 7f01f93ff700 1 --2- 172.21.15.84:0/3451193010 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01f415c960 0x7f01f4151510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:54.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.055+0000 7f01f93ff700 1 --2- 172.21.15.84:0/3451193010 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01f40b1990 0x7f01f40cc740 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:54.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.055+0000 7f01f93ff700 1 --2- 172.21.15.84:0/3451193010 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f01e006ae90 0x7f01e006d340 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:54.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.055+0000 7f01f93ff700 1 --2- 172.21.15.84:0/3451193010 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01f40cdb40 0x7f01f4156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:54.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.055+0000 7f01f93ff700 1 -- 172.21.15.84:0/3451193010 >> 172.21.15.84:0/3451193010 conn(0x7f01f406a5c0 msgr2=0x7f01f40d1780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:54.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.055+0000 7f01f93ff700 1 -- 172.21.15.84:0/3451193010 shutdown_connections 2023-07-14T11:14:54.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.055+0000 7f01f93ff700 1 -- 172.21.15.84:0/3451193010 wait complete. 2023-07-14T11:14:54.076 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T11:13:00.125395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T11:13:06.803994+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T11:14:30.730753+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T11:14:31.485809+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T11:14:54.076 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T11:14:54.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.273+0000 7f305b7ff700 1 Processor -- start 2023-07-14T11:14:54.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.273+0000 7f305b7ff700 1 -- start start 2023-07-14T11:14:54.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.274+0000 7f305b7ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f30540d0010 0x7f30540b5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:54.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.274+0000 7f305b7ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f30540d0480 0x7f30540b6430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:54.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.274+0000 7f305b7ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f305415cd60 con 0x7f30540b4600 2023-07-14T11:14:54.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.274+0000 7f305b7ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30540d1550 con 0x7f30540d0480 2023-07-14T11:14:54.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.274+0000 7f305b7ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30540d2d90 con 0x7f30540d0010 2023-07-14T11:14:54.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.274+0000 7f3059d9c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f30540d0480 0x7f30540b6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:54.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.275+0000 7f3059d9c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f30540d0480 0x7f30540b6430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58916/0 (socket says 172.21.15.84:58916) 2023-07-14T11:14:54.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.275+0000 7f3059d9c700 1 -- 172.21.15.84:0/2924328293 learned_addr learned my addr 172.21.15.84:0/2924328293 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:54.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.275+0000 7f3059d9c700 1 -- 172.21.15.84:0/2924328293 >> v2:172.21.15.179:3300/0 conn(0x7f30540d0010 msgr2=0x7f30540b5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:54.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.275+0000 7f3058d9a700 1 --2- 172.21.15.84:0/2924328293 >> v2:172.21.15.179:3300/0 conn(0x7f30540d0010 0x7f30540b5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:54.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.275+0000 7f3059d9c700 1 --2- 172.21.15.84:0/2924328293 >> v2:172.21.15.179:3300/0 conn(0x7f30540d0010 0x7f30540b5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:54.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.275+0000 7f3059d9c700 1 -- 172.21.15.84:0/2924328293 >> v1:172.21.15.179:6789/0 conn(0x7f30540b4600 legacy=0x7f30540cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:54.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.275+0000 7f3059d9c700 1 -- 172.21.15.84:0/2924328293 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30540cf340 con 0x7f30540d0480 2023-07-14T11:14:54.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.275+0000 7f3058d9a700 1 --2- 172.21.15.84:0/2924328293 >> v2:172.21.15.179:3300/0 conn(0x7f30540d0010 0x7f30540b5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:14:54.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.275+0000 7f3059d9c700 1 --2- 172.21.15.84:0/2924328293 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f30540d0480 0x7f30540b6430 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f305408bdb0 tx=0x7f304c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47865144686adb44 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:54.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.275+0000 7f304bfff700 1 -- 172.21.15.84:0/2924328293 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304c00e070 con 0x7f30540d0480 2023-07-14T11:14:54.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.275+0000 7f304bfff700 1 -- 172.21.15.84:0/2924328293 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f304c003a20 con 0x7f30540d0480 2023-07-14T11:14:54.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.276+0000 7f304bfff700 1 -- 172.21.15.84:0/2924328293 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304c003dd0 con 0x7f30540d0480 2023-07-14T11:14:54.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.276+0000 7f305b7ff700 1 -- 172.21.15.84:0/2924328293 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f30540d0480 msgr2=0x7f30540b6430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:54.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.276+0000 7f305b7ff700 1 --2- 172.21.15.84:0/2924328293 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f30540d0480 0x7f30540b6430 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f305408bdb0 tx=0x7f304c00b330 comp rx=0 tx=0).stop 2023-07-14T11:14:54.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.276+0000 7f305b7ff700 1 -- 172.21.15.84:0/2924328293 shutdown_connections 2023-07-14T11:14:54.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.276+0000 7f305b7ff700 1 --2- 172.21.15.84:0/2924328293 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f30540d0480 0x7f30540b6430 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:54.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.276+0000 7f305b7ff700 1 --2- 172.21.15.84:0/2924328293 >> v2:172.21.15.179:3300/0 conn(0x7f30540d0010 0x7f30540b5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:54.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.276+0000 7f305b7ff700 1 -- 172.21.15.84:0/2924328293 >> 172.21.15.84:0/2924328293 conn(0x7f305409c200 msgr2=0x7f30540d2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:54.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.276+0000 7f305b7ff700 1 -- 172.21.15.84:0/2924328293 shutdown_connections 2023-07-14T11:14:54.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.276+0000 7f305b7ff700 1 -- 172.21.15.84:0/2924328293 wait complete. 2023-07-14T11:14:54.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.278+0000 7f305b7ff700 1 Processor -- start 2023-07-14T11:14:54.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.278+0000 7f305b7ff700 1 -- start start 2023-07-14T11:14:54.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.279+0000 7f305b7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f30540d0010 0x7f3054159a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:54.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.279+0000 7f305b7ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f30540d0480 0x7f3054158070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:54.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.279+0000 7f305b7ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3054157290 0x7f305415a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:54.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.279+0000 7f305b7ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3054158970 con 0x7f30540d0480 2023-07-14T11:14:54.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.279+0000 7f305b7ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3054158c50 con 0x7f3054157290 2023-07-14T11:14:54.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.279+0000 7f305b7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3054158f30 con 0x7f30540d0010 2023-07-14T11:14:54.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.279+0000 7f3058d9a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f30540d0480 0x7f3054158070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:54.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.279+0000 7f3058d9a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f30540d0480 0x7f3054158070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58918/0 (socket says 172.21.15.84:58918) 2023-07-14T11:14:54.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.279+0000 7f3058d9a700 1 -- 172.21.15.84:0/3799973527 learned_addr learned my addr 172.21.15.84:0/3799973527 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:54.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.280+0000 7f305959b700 1 --2- 172.21.15.84:0/3799973527 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f30540d0010 0x7f3054159a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:54.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.280+0000 7f3059d9c700 1 --2- 172.21.15.84:0/3799973527 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3054157290 0x7f305415a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:54.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.280+0000 7f3058d9a700 1 -- 172.21.15.84:0/3799973527 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f30540d0010 msgr2=0x7f3054159a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:54.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.280+0000 7f3058d9a700 1 --2- 172.21.15.84:0/3799973527 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f30540d0010 0x7f3054159a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:54.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.280+0000 7f3058d9a700 1 -- 172.21.15.84:0/3799973527 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3054157290 msgr2=0x7f305415a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:54.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.280+0000 7f3058d9a700 1 --2- 172.21.15.84:0/3799973527 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3054157290 0x7f305415a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:54.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.280+0000 7f3058d9a700 1 -- 172.21.15.84:0/3799973527 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f304c009b30 con 0x7f30540d0480 2023-07-14T11:14:54.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.280+0000 7f3059d9c700 1 --2- 172.21.15.84:0/3799973527 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3054157290 0x7f305415a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:14:54.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.280+0000 7f305959b700 1 --2- 172.21.15.84:0/3799973527 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f30540d0010 0x7f3054159a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:14:54.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.280+0000 7f3058d9a700 1 --2- 172.21.15.84:0/3799973527 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f30540d0480 0x7f3054158070 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f304400c750 tx=0x7f304400cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:54.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.280+0000 7f3049ffb700 1 -- 172.21.15.84:0/3799973527 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3044011800 con 0x7f30540d0480 2023-07-14T11:14:54.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.280+0000 7f3049ffb700 1 -- 172.21.15.84:0/3799973527 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3044011960 con 0x7f30540d0480 2023-07-14T11:14:54.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.280+0000 7f3049ffb700 1 -- 172.21.15.84:0/3799973527 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3044011cd0 con 0x7f30540d0480 2023-07-14T11:14:54.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.280+0000 7f305b7ff700 1 -- 172.21.15.84:0/3799973527 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3054159210 con 0x7f30540d0480 2023-07-14T11:14:54.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.280+0000 7f305b7ff700 1 -- 172.21.15.84:0/3799973527 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30541585b0 con 0x7f30540d0480 2023-07-14T11:14:54.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.282+0000 7f305b7ff700 1 -- 172.21.15.84:0/3799973527 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3054159730 con 0x7f30540d0480 2023-07-14T11:14:54.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.282+0000 7f3049ffb700 1 -- 172.21.15.84:0/3799973527 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 7) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f3044021350 con 0x7f30540d0480 2023-07-14T11:14:54.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.283+0000 7f3049ffb700 1 --2- 172.21.15.84:0/3799973527 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f303806ae90 0x7f303806d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:54.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.283+0000 7f3049ffb700 1 -- 172.21.15.84:0/3799973527 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3044089850 con 0x7f30540d0480 2023-07-14T11:14:54.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.284+0000 7f305959b700 1 --2- 172.21.15.84:0/3799973527 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f303806ae90 0x7f303806d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:54.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.284+0000 7f305959b700 1 --2- 172.21.15.84:0/3799973527 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f303806ae90 0x7f303806d340 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3050003f40 tx=0x7f3050009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:54.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.287+0000 7f3049ffb700 1 -- 172.21.15.84:0/3799973527 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3054159730 con 0x7f30540d0480 2023-07-14T11:14:54.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.483+0000 7f305b7ff700 1 -- 172.21.15.84:0/3799973527 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f305408b8c0 con 0x7f30540d0480 2023-07-14T11:14:54.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.483+0000 7f3049ffb700 1 -- 172.21.15.84:0/3799973527 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3044054570 con 0x7f30540d0480 2023-07-14T11:14:54.486 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-07-14T11:14:54.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.485+0000 7f305b7ff700 1 -- 172.21.15.84:0/3799973527 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f303806ae90 msgr2=0x7f303806d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:54.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.485+0000 7f305b7ff700 1 --2- 172.21.15.84:0/3799973527 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f303806ae90 0x7f303806d340 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3050003f40 tx=0x7f3050009040 comp rx=0 tx=0).stop 2023-07-14T11:14:54.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.486+0000 7f305b7ff700 1 -- 172.21.15.84:0/3799973527 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f30540d0480 msgr2=0x7f3054158070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:54.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.486+0000 7f305b7ff700 1 --2- 172.21.15.84:0/3799973527 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f30540d0480 0x7f3054158070 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f304400c750 tx=0x7f304400cb10 comp rx=0 tx=0).stop 2023-07-14T11:14:54.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.486+0000 7f305b7ff700 1 -- 172.21.15.84:0/3799973527 shutdown_connections 2023-07-14T11:14:54.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.486+0000 7f305b7ff700 1 --2- 172.21.15.84:0/3799973527 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f303806ae90 0x7f303806d340 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:54.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.486+0000 7f305b7ff700 1 --2- 172.21.15.84:0/3799973527 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f30540d0010 0x7f3054159a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:54.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.486+0000 7f305b7ff700 1 --2- 172.21.15.84:0/3799973527 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3054157290 0x7f305415a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:54.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.486+0000 7f305b7ff700 1 --2- 172.21.15.84:0/3799973527 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f30540d0480 0x7f3054158070 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:54.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.486+0000 7f305b7ff700 1 -- 172.21.15.84:0/3799973527 >> 172.21.15.84:0/3799973527 conn(0x7f305409c200 msgr2=0x7f30540b5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:54.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.486+0000 7f305b7ff700 1 -- 172.21.15.84:0/3799973527 shutdown_connections 2023-07-14T11:14:54.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.486+0000 7f305b7ff700 1 -- 172.21.15.84:0/3799973527 wait complete. 2023-07-14T11:14:54.505 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T11:14:54.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.701+0000 7f1a1e7ff700 1 Processor -- start 2023-07-14T11:14:54.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.701+0000 7f1a1e7ff700 1 -- start start 2023-07-14T11:14:54.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.703+0000 7f1a1e7ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1a180b4d00 0x7f1a180d19d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:54.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.703+0000 7f1a1e7ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a180d02a0 con 0x7f1a180b8660 2023-07-14T11:14:54.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.703+0000 7f1a1e7ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a180cfce0 con 0x7f1a180b4860 2023-07-14T11:14:54.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.703+0000 7f1a1e7ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a180cffc0 con 0x7f1a180b4d00 2023-07-14T11:14:54.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.703+0000 7f1a1cd9c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1a180b4d00 0x7f1a180d19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:54.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.703+0000 7f1a17fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f1a180b8660 0x7f1a180cd430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50000/0 (socket says 172.21.15.84:50000) 2023-07-14T11:14:54.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.703+0000 7f1a17fff700 1 -- 172.21.15.84:0/3763689962 learned_addr learned my addr 172.21.15.84:0/3763689962 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:14:54.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.703+0000 7f1a1cd9c700 1 -- 172.21.15.84:0/3763689962 >> v1:172.21.15.179:6789/0 conn(0x7f1a180b4860 legacy=0x7f1a180d12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:54.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.703+0000 7f1a1cd9c700 1 -- 172.21.15.84:0/3763689962 >> v1:172.21.15.84:6789/0 conn(0x7f1a180b8660 legacy=0x7f1a180cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:54.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.703+0000 7f1a1cd9c700 1 -- 172.21.15.84:0/3763689962 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a180d0ac0 con 0x7f1a180b4d00 2023-07-14T11:14:54.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.703+0000 7f1a177fe700 1 -- 172.21.15.84:0/3763689962 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2282084855 0 0) 0x7f1a180d02a0 con 0x7f1a180b8660 2023-07-14T11:14:54.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.703+0000 7f1a1cd9c700 1 --2- 172.21.15.84:0/3763689962 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a180b4d00 0x7f1a180d19d0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f1a10009d90 tx=0x7f1a1000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8f39e582075d9fd server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:54.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.704+0000 7f1a177fe700 1 -- 172.21.15.84:0/3763689962 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1000e070 con 0x7f1a180b4d00 2023-07-14T11:14:54.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.704+0000 7f1a177fe700 1 -- 172.21.15.84:0/3763689962 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a1000bbd0 con 0x7f1a180b4d00 2023-07-14T11:14:54.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.704+0000 7f1a177fe700 1 -- 172.21.15.84:0/3763689962 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a10012430 con 0x7f1a180b4d00 2023-07-14T11:14:54.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.704+0000 7f1a1e7ff700 1 -- 172.21.15.84:0/3763689962 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a180b4d00 msgr2=0x7f1a180d19d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:54.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.704+0000 7f1a1e7ff700 1 --2- 172.21.15.84:0/3763689962 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a180b4d00 0x7f1a180d19d0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f1a10009d90 tx=0x7f1a1000b330 comp rx=0 tx=0).stop 2023-07-14T11:14:54.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.704+0000 7f1a1e7ff700 1 -- 172.21.15.84:0/3763689962 shutdown_connections 2023-07-14T11:14:54.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.704+0000 7f1a1e7ff700 1 --2- 172.21.15.84:0/3763689962 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a180b4d00 0x7f1a180d19d0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:54.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.704+0000 7f1a1e7ff700 1 -- 172.21.15.84:0/3763689962 >> 172.21.15.84:0/3763689962 conn(0x7f1a18066860 msgr2=0x7f1a1806a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:54.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.704+0000 7f1a1e7ff700 1 -- 172.21.15.84:0/3763689962 shutdown_connections 2023-07-14T11:14:54.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.704+0000 7f1a1e7ff700 1 -- 172.21.15.84:0/3763689962 wait complete. 2023-07-14T11:14:54.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.706+0000 7f1a1e7ff700 1 Processor -- start 2023-07-14T11:14:54.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.706+0000 7f1a1e7ff700 1 -- start start 2023-07-14T11:14:54.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.707+0000 7f1a1e7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a180b4860 0x7f1a1814b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:54.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.707+0000 7f1a1e7ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a180b4d00 0x7f1a180cad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:54.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.707+0000 7f1a1e7ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a180b8660 0x7f1a181e3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:54.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.707+0000 7f1a1e7ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a180cc2a0 con 0x7f1a180b8660 2023-07-14T11:14:54.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.707+0000 7f1a1e7ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1814b7d0 con 0x7f1a180b4d00 2023-07-14T11:14:54.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.707+0000 7f1a1e7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a180cb690 con 0x7f1a180b4860 2023-07-14T11:14:54.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.708+0000 7f1a1cd9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a180b8660 0x7f1a181e3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:54.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.708+0000 7f1a1cd9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a180b8660 0x7f1a181e3040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58940/0 (socket says 172.21.15.84:58940) 2023-07-14T11:14:54.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.708+0000 7f1a1cd9c700 1 -- 172.21.15.84:0/2817409421 learned_addr learned my addr 172.21.15.84:0/2817409421 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:54.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.708+0000 7f1a17fff700 1 --2- 172.21.15.84:0/2817409421 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a180b4860 0x7f1a1814b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:54.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.708+0000 7f1a1cd9c700 1 -- 172.21.15.84:0/2817409421 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a180b4860 msgr2=0x7f1a1814b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:54.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.708+0000 7f1a1cd9c700 1 --2- 172.21.15.84:0/2817409421 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a180b4860 0x7f1a1814b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:54.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.708+0000 7f1a0ffff700 1 --2- 172.21.15.84:0/2817409421 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a180b4d00 0x7f1a180cad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:54.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.708+0000 7f1a1cd9c700 1 -- 172.21.15.84:0/2817409421 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a180b4d00 msgr2=0x7f1a180cad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:54.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.708+0000 7f1a1cd9c700 1 --2- 172.21.15.84:0/2817409421 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a180b4d00 0x7f1a180cad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:54.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.708+0000 7f1a1cd9c700 1 -- 172.21.15.84:0/2817409421 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a10009a70 con 0x7f1a180b8660 2023-07-14T11:14:54.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.708+0000 7f1a17fff700 1 --2- 172.21.15.84:0/2817409421 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a180b4860 0x7f1a1814b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:14:54.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.708+0000 7f1a0ffff700 1 --2- 172.21.15.84:0/2817409421 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a180b4d00 0x7f1a180cad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:14:54.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.708+0000 7f1a1cd9c700 1 --2- 172.21.15.84:0/2817409421 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a180b8660 0x7f1a181e3040 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f1a10014040 tx=0x7f1a10004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:54.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.709+0000 7f1a157fa700 1 -- 172.21.15.84:0/2817409421 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a10012430 con 0x7f1a180b8660 2023-07-14T11:14:54.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.709+0000 7f1a157fa700 1 -- 172.21.15.84:0/2817409421 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a10020070 con 0x7f1a180b8660 2023-07-14T11:14:54.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.709+0000 7f1a157fa700 1 -- 172.21.15.84:0/2817409421 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a10004280 con 0x7f1a180b8660 2023-07-14T11:14:54.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.709+0000 7f1a1e7ff700 1 -- 172.21.15.84:0/2817409421 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a180cb970 con 0x7f1a180b8660 2023-07-14T11:14:54.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.709+0000 7f1a1e7ff700 1 -- 172.21.15.84:0/2817409421 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a180cbf30 con 0x7f1a180b8660 2023-07-14T11:14:54.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.710+0000 7f1a1e7ff700 1 -- 172.21.15.84:0/2817409421 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a18074350 con 0x7f1a180b8660 2023-07-14T11:14:54.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.711+0000 7f1a157fa700 1 -- 172.21.15.84:0/2817409421 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 7) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f1a100043e0 con 0x7f1a180b8660 2023-07-14T11:14:54.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.712+0000 7f1a157fa700 1 --2- 172.21.15.84:0/2817409421 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f19f806ae90 0x7f19f806d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:54.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.712+0000 7f1a157fa700 1 -- 172.21.15.84:0/2817409421 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1a10022070 con 0x7f1a180b8660 2023-07-14T11:14:54.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.712+0000 7f1a17fff700 1 --2- 172.21.15.84:0/2817409421 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f19f806ae90 0x7f19f806d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:54.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.713+0000 7f1a17fff700 1 --2- 172.21.15.84:0/2817409421 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f19f806ae90 0x7f19f806d340 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f1a08000f60 tx=0x7f1a08009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:54.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.716+0000 7f1a157fa700 1 -- 172.21.15.84:0/2817409421 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f1a10056580 con 0x7f1a180b8660 2023-07-14T11:14:54.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.915+0000 7f1a1e7ff700 1 -- 172.21.15.84:0/2817409421 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1a180cdb10 con 0x7f1a180b8660 2023-07-14T11:14:54.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.916+0000 7f1a157fa700 1 -- 172.21.15.84:0/2817409421 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v37) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1a10059ba0 con 0x7f1a180b8660 2023-07-14T11:14:54.918 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-07-14T11:14:54.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.918+0000 7f1a1e7ff700 1 -- 172.21.15.84:0/2817409421 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f19f806ae90 msgr2=0x7f19f806d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:54.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.918+0000 7f1a1e7ff700 1 --2- 172.21.15.84:0/2817409421 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f19f806ae90 0x7f19f806d340 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f1a08000f60 tx=0x7f1a08009040 comp rx=0 tx=0).stop 2023-07-14T11:14:54.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.918+0000 7f1a1e7ff700 1 -- 172.21.15.84:0/2817409421 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a180b8660 msgr2=0x7f1a181e3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:54.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.918+0000 7f1a1e7ff700 1 --2- 172.21.15.84:0/2817409421 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a180b8660 0x7f1a181e3040 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f1a10014040 tx=0x7f1a10004ad0 comp rx=0 tx=0).stop 2023-07-14T11:14:54.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.918+0000 7f1a1e7ff700 1 -- 172.21.15.84:0/2817409421 shutdown_connections 2023-07-14T11:14:54.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.918+0000 7f1a1e7ff700 1 --2- 172.21.15.84:0/2817409421 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f19f806ae90 0x7f19f806d340 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:54.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.918+0000 7f1a1e7ff700 1 --2- 172.21.15.84:0/2817409421 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a180b4860 0x7f1a1814b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:54.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.918+0000 7f1a1e7ff700 1 --2- 172.21.15.84:0/2817409421 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a180b8660 0x7f1a181e3040 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:54.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.918+0000 7f1a1e7ff700 1 --2- 172.21.15.84:0/2817409421 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a180b4d00 0x7f1a180cad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:54.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.918+0000 7f1a1e7ff700 1 -- 172.21.15.84:0/2817409421 >> 172.21.15.84:0/2817409421 conn(0x7f1a18066860 msgr2=0x7f1a180b6aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:54.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.918+0000 7f1a1e7ff700 1 -- 172.21.15.84:0/2817409421 shutdown_connections 2023-07-14T11:14:54.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:54.918+0000 7f1a1e7ff700 1 -- 172.21.15.84:0/2817409421 wait complete. 2023-07-14T11:14:54.938 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T11:14:55.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.132+0000 7f330a9ff700 1 Processor -- start 2023-07-14T11:14:55.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.133+0000 7f330a9ff700 1 -- start start 2023-07-14T11:14:55.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.134+0000 7f330a9ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f33040d1e40 0x7f33040cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:55.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.134+0000 7f330a9ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33040cd5a0 con 0x7f33040c71b0 2023-07-14T11:14:55.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.134+0000 7f330a9ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33040cd7f0 con 0x7f330415c860 2023-07-14T11:14:55.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.134+0000 7f330a9ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3304146740 con 0x7f33040d1e40 2023-07-14T11:14:55.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.134+0000 7f33037fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f33040d1e40 0x7f33040cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:55.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.134+0000 7f33037fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f33040d1e40 0x7f33040cf2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58954/0 (socket says 172.21.15.84:58954) 2023-07-14T11:14:55.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.134+0000 7f33037fe700 1 -- 172.21.15.84:0/4158674682 learned_addr learned my addr 172.21.15.84:0/4158674682 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:55.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.134+0000 7f3308f9c700 1 --1- 172.21.15.84:0/4158674682 >> v1:172.21.15.84:6789/0 conn(0x7f33040c71b0 0x7f33040b49d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50008/0 (socket says 172.21.15.84:50008) 2023-07-14T11:14:55.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.134+0000 7f33037fe700 1 -- 172.21.15.84:0/4158674682 >> v1:172.21.15.179:6789/0 conn(0x7f330415c860 legacy=0x7f33040c6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:55.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.134+0000 7f33037fe700 1 -- 172.21.15.84:0/4158674682 >> v1:172.21.15.84:6789/0 conn(0x7f33040c71b0 legacy=0x7f33040b49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:55.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.134+0000 7f33037fe700 1 -- 172.21.15.84:0/4158674682 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33040cdad0 con 0x7f33040d1e40 2023-07-14T11:14:55.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.135+0000 7f33037fe700 1 --2- 172.21.15.84:0/4158674682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33040d1e40 0x7f33040cf2a0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f32f80098f0 tx=0x7f32f8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe8cc2331c1454a1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:55.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.135+0000 7f3302ffd700 1 -- 172.21.15.84:0/4158674682 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f8004230 con 0x7f33040d1e40 2023-07-14T11:14:55.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.135+0000 7f3302ffd700 1 -- 172.21.15.84:0/4158674682 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32f8004390 con 0x7f33040d1e40 2023-07-14T11:14:55.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.135+0000 7f3302ffd700 1 -- 172.21.15.84:0/4158674682 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f80036a0 con 0x7f33040d1e40 2023-07-14T11:14:55.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.135+0000 7f330a9ff700 1 -- 172.21.15.84:0/4158674682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33040d1e40 msgr2=0x7f33040cf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:55.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.135+0000 7f330a9ff700 1 --2- 172.21.15.84:0/4158674682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33040d1e40 0x7f33040cf2a0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f32f80098f0 tx=0x7f32f8009c00 comp rx=0 tx=0).stop 2023-07-14T11:14:55.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.136+0000 7f330a9ff700 1 -- 172.21.15.84:0/4158674682 shutdown_connections 2023-07-14T11:14:55.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.136+0000 7f330a9ff700 1 --2- 172.21.15.84:0/4158674682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33040d1e40 0x7f33040cf2a0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:55.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.136+0000 7f330a9ff700 1 -- 172.21.15.84:0/4158674682 >> 172.21.15.84:0/4158674682 conn(0x7f3304065bd0 msgr2=0x7f3304065fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:55.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.136+0000 7f330a9ff700 1 -- 172.21.15.84:0/4158674682 shutdown_connections 2023-07-14T11:14:55.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.136+0000 7f330a9ff700 1 -- 172.21.15.84:0/4158674682 wait complete. 2023-07-14T11:14:55.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.137+0000 7f330a9ff700 1 Processor -- start 2023-07-14T11:14:55.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.137+0000 7f330a9ff700 1 -- start start 2023-07-14T11:14:55.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.138+0000 7f330a9ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33040c71b0 0x7f33040b8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:55.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.138+0000 7f330a9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33040d1e40 0x7f33041f32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:55.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.138+0000 7f330a9ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f330415c860 0x7f33041f3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:55.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.138+0000 7f330a9ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33041f3140 con 0x7f330415c860 2023-07-14T11:14:55.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.138+0000 7f330a9ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33040b7980 con 0x7f33040c71b0 2023-07-14T11:14:55.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.138+0000 7f330a9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f330415eb20 con 0x7f33040d1e40 2023-07-14T11:14:55.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.139+0000 7f3308f9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f330415c860 0x7f33041f3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:55.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.139+0000 7f3308f9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f330415c860 0x7f33041f3830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58968/0 (socket says 172.21.15.84:58968) 2023-07-14T11:14:55.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.139+0000 7f3308f9c700 1 -- 172.21.15.84:0/4070986206 learned_addr learned my addr 172.21.15.84:0/4070986206 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:55.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.139+0000 7f33037fe700 1 --2- 172.21.15.84:0/4070986206 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33040d1e40 0x7f33041f32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:55.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.139+0000 7f3303fff700 1 --2- 172.21.15.84:0/4070986206 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33040c71b0 0x7f33040b8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:55.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.139+0000 7f3308f9c700 1 -- 172.21.15.84:0/4070986206 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33040d1e40 msgr2=0x7f33041f32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:55.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.139+0000 7f3308f9c700 1 --2- 172.21.15.84:0/4070986206 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33040d1e40 0x7f33041f32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:55.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.139+0000 7f3308f9c700 1 -- 172.21.15.84:0/4070986206 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33040c71b0 msgr2=0x7f33040b8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:55.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.139+0000 7f3308f9c700 1 --2- 172.21.15.84:0/4070986206 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33040c71b0 0x7f33040b8420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:55.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.139+0000 7f3308f9c700 1 -- 172.21.15.84:0/4070986206 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32f8009550 con 0x7f330415c860 2023-07-14T11:14:55.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.139+0000 7f3308f9c700 1 --2- 172.21.15.84:0/4070986206 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f330415c860 0x7f33041f3830 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f32fc00cbd0 tx=0x7f32fc00cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:55.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.140+0000 7f3300ff9700 1 -- 172.21.15.84:0/4070986206 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32fc00aaa0 con 0x7f330415c860 2023-07-14T11:14:55.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.140+0000 7f3300ff9700 1 -- 172.21.15.84:0/4070986206 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32fc00ac00 con 0x7f330415c860 2023-07-14T11:14:55.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.140+0000 7f3300ff9700 1 -- 172.21.15.84:0/4070986206 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32fc007070 con 0x7f330415c860 2023-07-14T11:14:55.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.140+0000 7f330a9ff700 1 -- 172.21.15.84:0/4070986206 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f330415e840 con 0x7f330415c860 2023-07-14T11:14:55.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.140+0000 7f330a9ff700 1 -- 172.21.15.84:0/4070986206 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33040b7f00 con 0x7f330415c860 2023-07-14T11:14:55.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.141+0000 7f330a9ff700 1 -- 172.21.15.84:0/4070986206 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33040b77e0 con 0x7f330415c860 2023-07-14T11:14:55.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.142+0000 7f3300ff9700 1 -- 172.21.15.84:0/4070986206 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 7) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f32fc0071d0 con 0x7f330415c860 2023-07-14T11:14:55.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.142+0000 7f3300ff9700 1 --2- 172.21.15.84:0/4070986206 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f32f006ae90 0x7f32f006d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:55.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.143+0000 7f3300ff9700 1 -- 172.21.15.84:0/4070986206 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f32fc089440 con 0x7f330415c860 2023-07-14T11:14:55.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.143+0000 7f3303fff700 1 --2- 172.21.15.84:0/4070986206 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f32f006ae90 0x7f32f006d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:55.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.143+0000 7f3303fff700 1 --2- 172.21.15.84:0/4070986206 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f32f006ae90 0x7f32f006d340 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f32f4009960 tx=0x7f32f40090e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:55.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.147+0000 7f3300ff9700 1 -- 172.21.15.84:0/4070986206 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f33040b77e0 con 0x7f330415c860 2023-07-14T11:14:55.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.339+0000 7f330a9ff700 1 -- 172.21.15.84:0/4070986206 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f33040b77e0 con 0x7f330415c860 2023-07-14T11:14:55.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.340+0000 7f3300ff9700 1 -- 172.21.15.84:0/4070986206 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v37) v1 ==== 104+0+11 (secure 0 0 0) 0x7f32fc017020 con 0x7f330415c860 2023-07-14T11:14:55.342 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-07-14T11:14:55.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.342+0000 7f330a9ff700 1 -- 172.21.15.84:0/4070986206 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f32f006ae90 msgr2=0x7f32f006d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:55.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.342+0000 7f330a9ff700 1 --2- 172.21.15.84:0/4070986206 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f32f006ae90 0x7f32f006d340 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f32f4009960 tx=0x7f32f40090e0 comp rx=0 tx=0).stop 2023-07-14T11:14:55.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.342+0000 7f330a9ff700 1 -- 172.21.15.84:0/4070986206 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f330415c860 msgr2=0x7f33041f3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:55.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.342+0000 7f330a9ff700 1 --2- 172.21.15.84:0/4070986206 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f330415c860 0x7f33041f3830 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f32fc00cbd0 tx=0x7f32fc00cee0 comp rx=0 tx=0).stop 2023-07-14T11:14:55.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.342+0000 7f330a9ff700 1 -- 172.21.15.84:0/4070986206 shutdown_connections 2023-07-14T11:14:55.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.342+0000 7f330a9ff700 1 --2- 172.21.15.84:0/4070986206 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f330415c860 0x7f33041f3830 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:55.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.342+0000 7f330a9ff700 1 --2- 172.21.15.84:0/4070986206 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33040c71b0 0x7f33040b8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:55.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.342+0000 7f330a9ff700 1 --2- 172.21.15.84:0/4070986206 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f32f006ae90 0x7f32f006d340 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:55.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.342+0000 7f330a9ff700 1 --2- 172.21.15.84:0/4070986206 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33040d1e40 0x7f33041f32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:55.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.342+0000 7f330a9ff700 1 -- 172.21.15.84:0/4070986206 >> 172.21.15.84:0/4070986206 conn(0x7f3304065bd0 msgr2=0x7f33040cfeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:55.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.343+0000 7f330a9ff700 1 -- 172.21.15.84:0/4070986206 shutdown_connections 2023-07-14T11:14:55.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.343+0000 7f330a9ff700 1 -- 172.21.15.84:0/4070986206 wait complete. 2023-07-14T11:14:55.362 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T11:14:55.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.559+0000 7fc1d0dff700 1 Processor -- start 2023-07-14T11:14:55.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.559+0000 7fc1d0dff700 1 -- start start 2023-07-14T11:14:55.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.560+0000 7fc1d0dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1cc0cd1b0 0x7fc1cc0cd620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:55.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.560+0000 7fc1d0dff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc1cc0b2650 0x7fc1cc0b2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:55.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.560+0000 7fc1d0dff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1cc0b21b0 con 0x7fc1cc15fd30 2023-07-14T11:14:55.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.560+0000 7fc1d0dff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1cc06b930 con 0x7fc1cc0b2650 2023-07-14T11:14:55.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.560+0000 7fc1d0dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1cc0cdb60 con 0x7fc1cc0cd1b0 2023-07-14T11:14:55.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.561+0000 7fc1cad9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc1cc0b2650 0x7fc1cc0b2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:55.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.561+0000 7fc1cad9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc1cc0b2650 0x7fc1cc0b2ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58978/0 (socket says 172.21.15.84:58978) 2023-07-14T11:14:55.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.561+0000 7fc1cad9d700 1 -- 172.21.15.84:0/606958198 learned_addr learned my addr 172.21.15.84:0/606958198 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:55.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.561+0000 7fc1c9d9b700 1 --2- 172.21.15.84:0/606958198 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1cc0cd1b0 0x7fc1cc0cd620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:55.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.561+0000 7fc1cad9d700 1 -- 172.21.15.84:0/606958198 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1cc0cd1b0 msgr2=0x7fc1cc0cd620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:55.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.561+0000 7fc1cad9d700 1 --2- 172.21.15.84:0/606958198 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1cc0cd1b0 0x7fc1cc0cd620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:55.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.561+0000 7fc1cad9d700 1 -- 172.21.15.84:0/606958198 >> v1:172.21.15.179:6789/0 conn(0x7fc1cc15fd30 legacy=0x7fc1cc0ae1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:55.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.561+0000 7fc1cad9d700 1 -- 172.21.15.84:0/606958198 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1cc06ad20 con 0x7fc1cc0b2650 2023-07-14T11:14:55.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.561+0000 7fc1cad9d700 1 --2- 172.21.15.84:0/606958198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1cc0b2650 0x7fc1cc0b2ad0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fc1c4009e50 tx=0x7fc1c400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb79a58cf0e4d5d8 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:55.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.562+0000 7fc1c959a700 1 -- 172.21.15.84:0/606958198 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c400e070 con 0x7fc1cc0b2650 2023-07-14T11:14:55.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.562+0000 7fc1c959a700 1 -- 172.21.15.84:0/606958198 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1c400b9c0 con 0x7fc1cc0b2650 2023-07-14T11:14:55.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.562+0000 7fc1c959a700 1 -- 172.21.15.84:0/606958198 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c400bd70 con 0x7fc1cc0b2650 2023-07-14T11:14:55.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.562+0000 7fc1d0dff700 1 -- 172.21.15.84:0/606958198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1cc0b2650 msgr2=0x7fc1cc0b2ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:55.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.562+0000 7fc1d0dff700 1 --2- 172.21.15.84:0/606958198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1cc0b2650 0x7fc1cc0b2ad0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fc1c4009e50 tx=0x7fc1c400b330 comp rx=0 tx=0).stop 2023-07-14T11:14:55.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.562+0000 7fc1d0dff700 1 -- 172.21.15.84:0/606958198 shutdown_connections 2023-07-14T11:14:55.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.562+0000 7fc1d0dff700 1 --2- 172.21.15.84:0/606958198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1cc0b2650 0x7fc1cc0b2ad0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:55.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.562+0000 7fc1d0dff700 1 --2- 172.21.15.84:0/606958198 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1cc0cd1b0 0x7fc1cc0cd620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:55.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.562+0000 7fc1d0dff700 1 -- 172.21.15.84:0/606958198 >> 172.21.15.84:0/606958198 conn(0x7fc1cc0cc990 msgr2=0x7fc1cc0cf2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:55.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.562+0000 7fc1d0dff700 1 -- 172.21.15.84:0/606958198 shutdown_connections 2023-07-14T11:14:55.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.562+0000 7fc1d0dff700 1 -- 172.21.15.84:0/606958198 wait complete. 2023-07-14T11:14:55.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.564+0000 7fc1d0dff700 1 Processor -- start 2023-07-14T11:14:55.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.564+0000 7fc1d0dff700 1 -- start start 2023-07-14T11:14:55.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.565+0000 7fc1d0dff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1cc0b2650 0x7fc1cc1f6c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:55.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.565+0000 7fc1d0dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1cc0cd1b0 0x7fc1cc1e7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:55.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.565+0000 7fc1d0dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1cc15fd30 0x7fc1cc15ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:55.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.565+0000 7fc1d0dff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1cc1e8350 con 0x7fc1cc0b2650 2023-07-14T11:14:55.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.565+0000 7fc1d0dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1cc1e8630 con 0x7fc1cc15fd30 2023-07-14T11:14:55.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.565+0000 7fc1d0dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1cc1f6190 con 0x7fc1cc0cd1b0 2023-07-14T11:14:55.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.565+0000 7fc1ca59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1cc0b2650 0x7fc1cc1f6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:55.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.565+0000 7fc1ca59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1cc0b2650 0x7fc1cc1f6c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58988/0 (socket says 172.21.15.84:58988) 2023-07-14T11:14:55.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.565+0000 7fc1ca59c700 1 -- 172.21.15.84:0/3155661767 learned_addr learned my addr 172.21.15.84:0/3155661767 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:55.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.565+0000 7fc1c9d9b700 1 --2- 172.21.15.84:0/3155661767 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1cc0cd1b0 0x7fc1cc1e7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:55.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.566+0000 7fc1cad9d700 1 --2- 172.21.15.84:0/3155661767 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1cc15fd30 0x7fc1cc15ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:55.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.566+0000 7fc1ca59c700 1 -- 172.21.15.84:0/3155661767 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1cc0cd1b0 msgr2=0x7fc1cc1e7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:55.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.566+0000 7fc1ca59c700 1 --2- 172.21.15.84:0/3155661767 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1cc0cd1b0 0x7fc1cc1e7c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:55.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.566+0000 7fc1ca59c700 1 -- 172.21.15.84:0/3155661767 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1cc15fd30 msgr2=0x7fc1cc15ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:55.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.566+0000 7fc1ca59c700 1 --2- 172.21.15.84:0/3155661767 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1cc15fd30 0x7fc1cc15ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:55.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.566+0000 7fc1ca59c700 1 -- 172.21.15.84:0/3155661767 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1c4009b30 con 0x7fc1cc0b2650 2023-07-14T11:14:55.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.566+0000 7fc1ca59c700 1 --2- 172.21.15.84:0/3155661767 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1cc0b2650 0x7fc1cc1f6c70 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc00c450 tx=0x7fc1bc00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:55.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.566+0000 7fc1baffd700 1 -- 172.21.15.84:0/3155661767 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1bc0052d0 con 0x7fc1cc0b2650 2023-07-14T11:14:55.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.566+0000 7fc1baffd700 1 -- 172.21.15.84:0/3155661767 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1bc005430 con 0x7fc1cc0b2650 2023-07-14T11:14:55.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.566+0000 7fc1d0dff700 1 -- 172.21.15.84:0/3155661767 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1cc1f6470 con 0x7fc1cc0b2650 2023-07-14T11:14:55.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.566+0000 7fc1baffd700 1 -- 172.21.15.84:0/3155661767 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1bc0038c0 con 0x7fc1cc0b2650 2023-07-14T11:14:55.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.566+0000 7fc1d0dff700 1 -- 172.21.15.84:0/3155661767 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1cc15a640 con 0x7fc1cc0b2650 2023-07-14T11:14:55.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.567+0000 7fc1d0dff700 1 -- 172.21.15.84:0/3155661767 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1cc161110 con 0x7fc1cc0b2650 2023-07-14T11:14:55.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.568+0000 7fc1baffd700 1 -- 172.21.15.84:0/3155661767 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 7) v1 ==== 89190+0+0 (secure 0 0 0) 0x7fc1bc003a20 con 0x7fc1cc0b2650 2023-07-14T11:14:55.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.569+0000 7fc1baffd700 1 --2- 172.21.15.84:0/3155661767 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc1ac06ae90 0x7fc1ac06d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:55.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.569+0000 7fc1baffd700 1 -- 172.21.15.84:0/3155661767 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc1bc088be0 con 0x7fc1cc0b2650 2023-07-14T11:14:55.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.569+0000 7fc1c9d9b700 1 --2- 172.21.15.84:0/3155661767 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc1ac06ae90 0x7fc1ac06d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:55.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.570+0000 7fc1c9d9b700 1 --2- 172.21.15.84:0/3155661767 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc1ac06ae90 0x7fc1ac06d340 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc0c3fa0 tx=0x7fc1c0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:55.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.573+0000 7fc1baffd700 1 -- 172.21.15.84:0/3155661767 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fc1bc053970 con 0x7fc1cc0b2650 2023-07-14T11:14:55.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.766+0000 7fc1d0dff700 1 -- 172.21.15.84:0/3155661767 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc1cc09cd60 con 0x7fc1cc0b2650 2023-07-14T11:14:55.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.767+0000 7fc1baffd700 1 -- 172.21.15.84:0/3155661767 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v37) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc1bc056f90 con 0x7fc1cc0b2650 2023-07-14T11:14:55.769 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-07-14T11:14:55.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.769+0000 7fc1d0dff700 1 -- 172.21.15.84:0/3155661767 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc1ac06ae90 msgr2=0x7fc1ac06d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:55.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.769+0000 7fc1d0dff700 1 --2- 172.21.15.84:0/3155661767 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc1ac06ae90 0x7fc1ac06d340 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc0c3fa0 tx=0x7fc1c0008040 comp rx=0 tx=0).stop 2023-07-14T11:14:55.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.769+0000 7fc1d0dff700 1 -- 172.21.15.84:0/3155661767 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1cc0b2650 msgr2=0x7fc1cc1f6c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:55.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.769+0000 7fc1d0dff700 1 --2- 172.21.15.84:0/3155661767 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1cc0b2650 0x7fc1cc1f6c70 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc00c450 tx=0x7fc1bc00c810 comp rx=0 tx=0).stop 2023-07-14T11:14:55.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.769+0000 7fc1d0dff700 1 -- 172.21.15.84:0/3155661767 shutdown_connections 2023-07-14T11:14:55.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.769+0000 7fc1d0dff700 1 --2- 172.21.15.84:0/3155661767 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1cc15fd30 0x7fc1cc15ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:55.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.769+0000 7fc1d0dff700 1 --2- 172.21.15.84:0/3155661767 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1cc0b2650 0x7fc1cc1f6c70 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:55.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.769+0000 7fc1d0dff700 1 --2- 172.21.15.84:0/3155661767 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc1ac06ae90 0x7fc1ac06d340 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:55.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.769+0000 7fc1d0dff700 1 --2- 172.21.15.84:0/3155661767 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1cc0cd1b0 0x7fc1cc1e7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:55.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.769+0000 7fc1d0dff700 1 -- 172.21.15.84:0/3155661767 >> 172.21.15.84:0/3155661767 conn(0x7fc1cc0cc990 msgr2=0x7fc1cc0ae1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:55.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.770+0000 7fc1d0dff700 1 -- 172.21.15.84:0/3155661767 shutdown_connections 2023-07-14T11:14:55.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.770+0000 7fc1d0dff700 1 -- 172.21.15.84:0/3155661767 wait complete. 2023-07-14T11:14:55.790 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T11:14:55.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.984+0000 7fa810fff700 1 Processor -- start 2023-07-14T11:14:55.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.984+0000 7fa810fff700 1 -- start start 2023-07-14T11:14:55.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.986+0000 7fa810fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa80c0d1220 0x7fa80c0b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:55.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.986+0000 7fa810fff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa80c0d2ce0 con 0x7fa80c0b1e00 2023-07-14T11:14:55.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.986+0000 7fa810fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa80c0b3350 con 0x7fa80c15c950 2023-07-14T11:14:55.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.986+0000 7fa810fff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa80c0b3630 con 0x7fa80c0d1220 2023-07-14T11:14:55.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.986+0000 7fa809d9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa80c0d1220 0x7fa80c0b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:55.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.987+0000 7fa80ad9d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fa80c0b1e00 0x7fa80c0afac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50016/0 (socket says 172.21.15.84:50016) 2023-07-14T11:14:55.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.987+0000 7fa80ad9d700 1 -- 172.21.15.84:0/3996967149 learned_addr learned my addr 172.21.15.84:0/3996967149 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:14:55.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.987+0000 7fa80a59c700 1 --1- 172.21.15.84:0/3996967149 >> v1:172.21.15.179:6789/0 conn(0x7fa80c15c950 0x7fa80c0d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.84:50594/0 (socket says 172.21.15.84:50594) 2023-07-14T11:14:55.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.987+0000 7fa809d9b700 1 -- 172.21.15.84:0/3996967149 >> v1:172.21.15.179:6789/0 conn(0x7fa80c15c950 legacy=0x7fa80c0d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:55.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.987+0000 7fa80959a700 1 -- 172.21.15.84:0/3996967149 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3987669888 0 0) 0x7fa80c0b3350 con 0x7fa80c15c950 2023-07-14T11:14:55.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.987+0000 7fa809d9b700 1 -- 172.21.15.84:0/3996967149 >> v1:172.21.15.84:6789/0 conn(0x7fa80c0b1e00 legacy=0x7fa80c0afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:55.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.987+0000 7fa809d9b700 1 -- 172.21.15.84:0/3996967149 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa80c0b3910 con 0x7fa80c0d1220 2023-07-14T11:14:55.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.987+0000 7fa809d9b700 1 --2- 172.21.15.84:0/3996967149 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa80c0d1220 0x7fa80c0b43f0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fa800009840 tx=0x7fa800009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c736f692b62445e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:55.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.987+0000 7fa80959a700 1 -- 172.21.15.84:0/3996967149 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa800011830 con 0x7fa80c0d1220 2023-07-14T11:14:55.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.988+0000 7fa80959a700 1 -- 172.21.15.84:0/3996967149 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa800011990 con 0x7fa80c0d1220 2023-07-14T11:14:55.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.988+0000 7fa80959a700 1 -- 172.21.15.84:0/3996967149 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa800011d20 con 0x7fa80c0d1220 2023-07-14T11:14:55.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.988+0000 7fa810fff700 1 -- 172.21.15.84:0/3996967149 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa80c0d1220 msgr2=0x7fa80c0b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:55.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.988+0000 7fa810fff700 1 --2- 172.21.15.84:0/3996967149 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa80c0d1220 0x7fa80c0b43f0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fa800009840 tx=0x7fa800009b50 comp rx=0 tx=0).stop 2023-07-14T11:14:55.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.988+0000 7fa810fff700 1 -- 172.21.15.84:0/3996967149 shutdown_connections 2023-07-14T11:14:55.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.988+0000 7fa810fff700 1 --2- 172.21.15.84:0/3996967149 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa80c0d1220 0x7fa80c0b43f0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:55.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.988+0000 7fa810fff700 1 -- 172.21.15.84:0/3996967149 >> 172.21.15.84:0/3996967149 conn(0x7fa80c09c1d0 msgr2=0x7fa80c0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:55.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.988+0000 7fa810fff700 1 -- 172.21.15.84:0/3996967149 shutdown_connections 2023-07-14T11:14:55.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.988+0000 7fa810fff700 1 -- 172.21.15.84:0/3996967149 wait complete. 2023-07-14T11:14:55.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.990+0000 7fa810fff700 1 Processor -- start 2023-07-14T11:14:55.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.990+0000 7fa810fff700 1 -- start start 2023-07-14T11:14:55.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.991+0000 7fa810fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa80c0b1e00 0x7fa80c1501e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:55.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.991+0000 7fa810fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa80c0d1220 0x7fa80c0cc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:55.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.991+0000 7fa810fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa80c15c950 0x7fa80c0b7da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:55.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.991+0000 7fa810fff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa80c0cc770 con 0x7fa80c15c950 2023-07-14T11:14:55.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.991+0000 7fa810fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa80c0cca50 con 0x7fa80c0b1e00 2023-07-14T11:14:55.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.991+0000 7fa810fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa80c0ccd30 con 0x7fa80c0d1220 2023-07-14T11:14:55.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.991+0000 7fa80ad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa80c15c950 0x7fa80c0b7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:55.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.991+0000 7fa80ad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa80c15c950 0x7fa80c0b7da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59008/0 (socket says 172.21.15.84:59008) 2023-07-14T11:14:55.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.991+0000 7fa80ad9d700 1 -- 172.21.15.84:0/335635415 learned_addr learned my addr 172.21.15.84:0/335635415 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:55.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.992+0000 7fa809d9b700 1 --2- 172.21.15.84:0/335635415 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa80c0d1220 0x7fa80c0cc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:55.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.992+0000 7fa80ad9d700 1 -- 172.21.15.84:0/335635415 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa80c0d1220 msgr2=0x7fa80c0cc0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:55.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.992+0000 7fa80ad9d700 1 --2- 172.21.15.84:0/335635415 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa80c0d1220 0x7fa80c0cc0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:55.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.992+0000 7fa80ad9d700 1 -- 172.21.15.84:0/335635415 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa80c0b1e00 msgr2=0x7fa80c1501e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:55.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.992+0000 7fa80a59c700 1 --2- 172.21.15.84:0/335635415 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa80c0b1e00 0x7fa80c1501e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:55.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.992+0000 7fa80ad9d700 1 --2- 172.21.15.84:0/335635415 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa80c0b1e00 0x7fa80c1501e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:55.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.992+0000 7fa80ad9d700 1 -- 172.21.15.84:0/335635415 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8000094a0 con 0x7fa80c15c950 2023-07-14T11:14:55.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.992+0000 7fa80a59c700 1 --2- 172.21.15.84:0/335635415 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa80c0b1e00 0x7fa80c1501e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:14:55.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.992+0000 7fa80ad9d700 1 --2- 172.21.15.84:0/335635415 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa80c15c950 0x7fa80c0b7da0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fa80400cbc0 tx=0x7fa80400cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:55.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.992+0000 7fa7faffd700 1 -- 172.21.15.84:0/335635415 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80400ab50 con 0x7fa80c15c950 2023-07-14T11:14:55.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.992+0000 7fa7faffd700 1 -- 172.21.15.84:0/335635415 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa80400acb0 con 0x7fa80c15c950 2023-07-14T11:14:55.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.992+0000 7fa7faffd700 1 -- 172.21.15.84:0/335635415 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa804012600 con 0x7fa80c15c950 2023-07-14T11:14:55.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.992+0000 7fa810fff700 1 -- 172.21.15.84:0/335635415 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa80c0b5f10 con 0x7fa80c15c950 2023-07-14T11:14:55.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.992+0000 7fa810fff700 1 -- 172.21.15.84:0/335635415 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa80c0b82e0 con 0x7fa80c15c950 2023-07-14T11:14:55.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.993+0000 7fa810fff700 1 -- 172.21.15.84:0/335635415 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa80c0b5d70 con 0x7fa80c15c950 2023-07-14T11:14:55.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.994+0000 7fa7faffd700 1 -- 172.21.15.84:0/335635415 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 7) v1 ==== 89190+0+0 (secure 0 0 0) 0x7fa80401b3b0 con 0x7fa80c15c950 2023-07-14T11:14:55.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.995+0000 7fa7faffd700 1 --2- 172.21.15.84:0/335635415 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa7ec06ae90 0x7fa7ec06d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:55.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.995+0000 7fa7faffd700 1 -- 172.21.15.84:0/335635415 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6091+0+0 (secure 0 0 0) 0x7fa804089450 con 0x7fa80c15c950 2023-07-14T11:14:55.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.995+0000 7fa80a59c700 1 --2- 172.21.15.84:0/335635415 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa7ec06ae90 0x7fa7ec06d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:55.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.996+0000 7fa80a59c700 1 --2- 172.21.15.84:0/335635415 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa7ec06ae90 0x7fa7ec06d340 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa80c157820 tx=0x7fa7fc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:56.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:55.999+0000 7fa7faffd700 1 -- 172.21.15.84:0/335635415 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fa80c0b5d70 con 0x7fa80c15c950 2023-07-14T11:14:56.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.240+0000 7fa810fff700 1 -- 172.21.15.84:0/335635415 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa80c0b5d70 con 0x7fa80c15c950 2023-07-14T11:14:56.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.241+0000 7fa7faffd700 1 -- 172.21.15.84:0/335635415 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4700 (secure 0 0 0) 0x7fa80c0b5d70 con 0x7fa80c15c950 2023-07-14T11:14:56.243 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:14:56.244 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4751,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/76454361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":76454361},{"type":"v1","addr":"172.21.15.179:6833","nonce":76454361}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4757,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/534886511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":534886511},{"type":"v1","addr":"172.21.15.179:6835","nonce":534886511}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5118,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/930551517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":930551517},{"type":"v1","addr":"172.21.15.84:6836","nonce":930551517}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T11:14:32.504609+0000","modified":"2023-07-14T11:14:36.048621+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5121},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5121":{"gid":5121,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.84:6837/932986208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":932986208},{"type":"v1","addr":"172.21.15.84:6837","nonce":932986208}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-14T11:14:56.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.244+0000 7fa810fff700 1 -- 172.21.15.84:0/335635415 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa7ec06ae90 msgr2=0x7fa7ec06d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:56.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.244+0000 7fa810fff700 1 --2- 172.21.15.84:0/335635415 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa7ec06ae90 0x7fa7ec06d340 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa80c157820 tx=0x7fa7fc009040 comp rx=0 tx=0).stop 2023-07-14T11:14:56.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.244+0000 7fa810fff700 1 -- 172.21.15.84:0/335635415 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa80c15c950 msgr2=0x7fa80c0b7da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:56.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.244+0000 7fa810fff700 1 --2- 172.21.15.84:0/335635415 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa80c15c950 0x7fa80c0b7da0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fa80400cbc0 tx=0x7fa80400cf80 comp rx=0 tx=0).stop 2023-07-14T11:14:56.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.244+0000 7fa810fff700 1 -- 172.21.15.84:0/335635415 shutdown_connections 2023-07-14T11:14:56.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.244+0000 7fa810fff700 1 --2- 172.21.15.84:0/335635415 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa80c15c950 0x7fa80c0b7da0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:56.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.244+0000 7fa810fff700 1 --2- 172.21.15.84:0/335635415 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa80c0b1e00 0x7fa80c1501e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:56.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.244+0000 7fa810fff700 1 --2- 172.21.15.84:0/335635415 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa7ec06ae90 0x7fa7ec06d340 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:56.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.244+0000 7fa810fff700 1 --2- 172.21.15.84:0/335635415 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa80c0d1220 0x7fa80c0cc0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:56.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.244+0000 7fa810fff700 1 -- 172.21.15.84:0/335635415 >> 172.21.15.84:0/335635415 conn(0x7fa80c09c1d0 msgr2=0x7fa80c06a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:56.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.244+0000 7fa810fff700 1 -- 172.21.15.84:0/335635415 shutdown_connections 2023-07-14T11:14:56.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.244+0000 7fa810fff700 1 -- 172.21.15.84:0/335635415 wait complete. 2023-07-14T11:14:56.248 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 19 2023-07-14T11:14:56.263 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:14:56.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.457+0000 7f065c5ff700 1 Processor -- start 2023-07-14T11:14:56.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.457+0000 7f065c5ff700 1 -- start start 2023-07-14T11:14:56.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.459+0000 7f065c5ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f06540b1e00 0x7f06540b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:56.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.459+0000 7f065c5ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06540d2ce0 con 0x7f065415c950 2023-07-14T11:14:56.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.459+0000 7f065c5ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06540b3350 con 0x7f06540d1220 2023-07-14T11:14:56.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.459+0000 7f065c5ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06540b3630 con 0x7f06540b1e00 2023-07-14T11:14:56.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.459+0000 7f065ab9c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f06540b1e00 0x7f06540b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:56.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.459+0000 7f065a39b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f065415c950 0x7f06540d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50024/0 (socket says 172.21.15.84:50024) 2023-07-14T11:14:56.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.459+0000 7f065a39b700 1 -- 172.21.15.84:0/414376785 learned_addr learned my addr 172.21.15.84:0/414376785 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:14:56.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.459+0000 7f065ab9c700 1 -- 172.21.15.84:0/414376785 >> v1:172.21.15.179:6789/0 conn(0x7f06540d1220 legacy=0x7f06540afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:56.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.459+0000 7f065ab9c700 1 -- 172.21.15.84:0/414376785 >> v1:172.21.15.84:6789/0 conn(0x7f065415c950 legacy=0x7f06540d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:56.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.459+0000 7f065ab9c700 1 -- 172.21.15.84:0/414376785 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06540b3910 con 0x7f06540b1e00 2023-07-14T11:14:56.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.460+0000 7f065ab9c700 1 --2- 172.21.15.84:0/414376785 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06540b1e00 0x7f06540b43f0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f064c009d90 tx=0x7f064c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbd6f3234a914739 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:56.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.460+0000 7f0659399700 1 -- 172.21.15.84:0/414376785 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064c00e070 con 0x7f06540b1e00 2023-07-14T11:14:56.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.460+0000 7f0659399700 1 -- 172.21.15.84:0/414376785 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f064c00bbd0 con 0x7f06540b1e00 2023-07-14T11:14:56.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.460+0000 7f0659399700 1 -- 172.21.15.84:0/414376785 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064c012430 con 0x7f06540b1e00 2023-07-14T11:14:56.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.460+0000 7f065c5ff700 1 -- 172.21.15.84:0/414376785 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06540b1e00 msgr2=0x7f06540b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:56.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.460+0000 7f065c5ff700 1 --2- 172.21.15.84:0/414376785 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06540b1e00 0x7f06540b43f0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f064c009d90 tx=0x7f064c00b330 comp rx=0 tx=0).stop 2023-07-14T11:14:56.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.460+0000 7f065c5ff700 1 -- 172.21.15.84:0/414376785 shutdown_connections 2023-07-14T11:14:56.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.460+0000 7f065c5ff700 1 --2- 172.21.15.84:0/414376785 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06540b1e00 0x7f06540b43f0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:56.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.460+0000 7f065c5ff700 1 -- 172.21.15.84:0/414376785 >> 172.21.15.84:0/414376785 conn(0x7f065409c1d0 msgr2=0x7f06540d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:56.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.460+0000 7f065c5ff700 1 -- 172.21.15.84:0/414376785 shutdown_connections 2023-07-14T11:14:56.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.460+0000 7f065c5ff700 1 -- 172.21.15.84:0/414376785 wait complete. 2023-07-14T11:14:56.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.462+0000 7f065c5ff700 1 Processor -- start 2023-07-14T11:14:56.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.462+0000 7f065c5ff700 1 -- start start 2023-07-14T11:14:56.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.463+0000 7f065c5ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06540b1e00 0x7f06540c9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:56.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.463+0000 7f065c5ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06540d1220 0x7f06540cbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:56.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.463+0000 7f065c5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f065415c950 0x7f065414d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:56.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.463+0000 7f065c5ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f065415d1a0 con 0x7f06540d1220 2023-07-14T11:14:56.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.463+0000 7f065c5ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06540c6b80 con 0x7f06540b1e00 2023-07-14T11:14:56.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.463+0000 7f065c5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f065414e610 con 0x7f065415c950 2023-07-14T11:14:56.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.463+0000 7f0659b9a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06540d1220 0x7f06540cbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:56.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.463+0000 7f0659b9a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06540d1220 0x7f06540cbcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59036/0 (socket says 172.21.15.84:59036) 2023-07-14T11:14:56.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.463+0000 7f0659b9a700 1 -- 172.21.15.84:0/2876810147 learned_addr learned my addr 172.21.15.84:0/2876810147 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:56.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.464+0000 7f065a39b700 1 --2- 172.21.15.84:0/2876810147 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06540b1e00 0x7f06540c9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:56.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.464+0000 7f065ab9c700 1 --2- 172.21.15.84:0/2876810147 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f065415c950 0x7f065414d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:56.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.464+0000 7f0659b9a700 1 -- 172.21.15.84:0/2876810147 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f065415c950 msgr2=0x7f065414d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:56.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.464+0000 7f0659b9a700 1 --2- 172.21.15.84:0/2876810147 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f065415c950 0x7f065414d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:56.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.464+0000 7f0659b9a700 1 -- 172.21.15.84:0/2876810147 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06540b1e00 msgr2=0x7f06540c9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:56.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.464+0000 7f0659b9a700 1 --2- 172.21.15.84:0/2876810147 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06540b1e00 0x7f06540c9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:56.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.464+0000 7f0659b9a700 1 -- 172.21.15.84:0/2876810147 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f064c009a70 con 0x7f06540d1220 2023-07-14T11:14:56.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.464+0000 7f065a39b700 1 --2- 172.21.15.84:0/2876810147 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06540b1e00 0x7f06540c9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:14:56.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.464+0000 7f0659b9a700 1 --2- 172.21.15.84:0/2876810147 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06540d1220 0x7f06540cbcf0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f064400c4b0 tx=0x7f064400c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:56.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.464+0000 7f064affd700 1 -- 172.21.15.84:0/2876810147 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06440052d0 con 0x7f06540d1220 2023-07-14T11:14:56.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.464+0000 7f064affd700 1 -- 172.21.15.84:0/2876810147 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0644005430 con 0x7f06540d1220 2023-07-14T11:14:56.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.464+0000 7f064affd700 1 -- 172.21.15.84:0/2876810147 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06440038c0 con 0x7f06540d1220 2023-07-14T11:14:56.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.464+0000 7f065c5ff700 1 -- 172.21.15.84:0/2876810147 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06540cfd40 con 0x7f06540d1220 2023-07-14T11:14:56.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.464+0000 7f065c5ff700 1 -- 172.21.15.84:0/2876810147 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06540d0300 con 0x7f06540d1220 2023-07-14T11:14:56.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.465+0000 7f065c5ff700 1 -- 172.21.15.84:0/2876810147 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f065404e280 con 0x7f06540d1220 2023-07-14T11:14:56.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.466+0000 7f064affd700 1 -- 172.21.15.84:0/2876810147 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 7) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f0644003a20 con 0x7f06540d1220 2023-07-14T11:14:56.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.467+0000 7f064affd700 1 --2- 172.21.15.84:0/2876810147 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f063806ae90 0x7f063806d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:56.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.467+0000 7f064affd700 1 -- 172.21.15.84:0/2876810147 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f0644088cf0 con 0x7f06540d1220 2023-07-14T11:14:56.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.467+0000 7f065a39b700 1 --2- 172.21.15.84:0/2876810147 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f063806ae90 0x7f063806d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:56.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.468+0000 7f065a39b700 1 --2- 172.21.15.84:0/2876810147 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f063806ae90 0x7f063806d340 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f06500010e0 tx=0x7f0650009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:56.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.471+0000 7f064affd700 1 -- 172.21.15.84:0/2876810147 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f0644053a60 con 0x7f06540d1220 2023-07-14T11:14:56.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.668+0000 7f065c5ff700 1 -- 172.21.15.84:0/2876810147 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f065408c5a0 con 0x7f06540d1220 2023-07-14T11:14:56.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.669+0000 7f064affd700 1 -- 172.21.15.84:0/2876810147 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+18319 (secure 0 0 0) 0x7f0644057080 con 0x7f06540d1220 2023-07-14T11:14:56.672 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:14:56.672 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":38,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:14:55.820668+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-14T11:14:30.730753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-14T11:14:31.485809+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.d","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:14:56.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.672+0000 7f065c5ff700 1 -- 172.21.15.84:0/2876810147 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f063806ae90 msgr2=0x7f063806d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:56.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.672+0000 7f065c5ff700 1 --2- 172.21.15.84:0/2876810147 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f063806ae90 0x7f063806d340 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f06500010e0 tx=0x7f0650009040 comp rx=0 tx=0).stop 2023-07-14T11:14:56.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.672+0000 7f065c5ff700 1 -- 172.21.15.84:0/2876810147 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06540d1220 msgr2=0x7f06540cbcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:56.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.672+0000 7f065c5ff700 1 --2- 172.21.15.84:0/2876810147 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06540d1220 0x7f06540cbcf0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f064400c4b0 tx=0x7f064400c870 comp rx=0 tx=0).stop 2023-07-14T11:14:56.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.672+0000 7f065c5ff700 1 -- 172.21.15.84:0/2876810147 shutdown_connections 2023-07-14T11:14:56.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.672+0000 7f065c5ff700 1 --2- 172.21.15.84:0/2876810147 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f063806ae90 0x7f063806d340 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:56.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.672+0000 7f065c5ff700 1 --2- 172.21.15.84:0/2876810147 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f065415c950 0x7f065414d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:56.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.672+0000 7f065c5ff700 1 --2- 172.21.15.84:0/2876810147 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06540b1e00 0x7f06540c9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:56.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.672+0000 7f065c5ff700 1 --2- 172.21.15.84:0/2876810147 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06540d1220 0x7f06540cbcf0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:56.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.672+0000 7f065c5ff700 1 -- 172.21.15.84:0/2876810147 >> 172.21.15.84:0/2876810147 conn(0x7f065409c1d0 msgr2=0x7f06540afac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:56.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.672+0000 7f065c5ff700 1 -- 172.21.15.84:0/2876810147 shutdown_connections 2023-07-14T11:14:56.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.672+0000 7f065c5ff700 1 -- 172.21.15.84:0/2876810147 wait complete. 2023-07-14T11:14:56.692 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-14T11:14:56.693 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T11:14:56.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.889+0000 7fe67f3ff700 1 Processor -- start 2023-07-14T11:14:56.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.889+0000 7fe67f3ff700 1 -- start start 2023-07-14T11:14:56.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.890+0000 7fe67f3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe6781500d0 0x7fe678070350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:56.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.890+0000 7fe67f3ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe678070890 0x7fe6781597c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:56.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.890+0000 7fe67f3ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6780cdf90 con 0x7fe678159d00 2023-07-14T11:14:56.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.890+0000 7fe67f3ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe67815a2f0 con 0x7fe678070890 2023-07-14T11:14:56.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.890+0000 7fe67f3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe67815a5d0 con 0x7fe6781500d0 2023-07-14T11:14:56.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.891+0000 7fe67c99a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe678070890 0x7fe6781597c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:56.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.891+0000 7fe67c99a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe678070890 0x7fe6781597c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59038/0 (socket says 172.21.15.84:59038) 2023-07-14T11:14:56.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.891+0000 7fe67c99a700 1 -- 172.21.15.84:0/224560251 learned_addr learned my addr 172.21.15.84:0/224560251 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:56.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.891+0000 7fe67d19b700 1 --2- 172.21.15.84:0/224560251 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe6781500d0 0x7fe678070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:56.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.891+0000 7fe67c99a700 1 -- 172.21.15.84:0/224560251 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe6781500d0 msgr2=0x7fe678070350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:56.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.891+0000 7fe67c99a700 1 --2- 172.21.15.84:0/224560251 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe6781500d0 0x7fe678070350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:56.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.891+0000 7fe67c99a700 1 -- 172.21.15.84:0/224560251 >> v1:172.21.15.179:6789/0 conn(0x7fe678159d00 legacy=0x7fe6780cea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:56.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.891+0000 7fe67c99a700 1 -- 172.21.15.84:0/224560251 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6780ce250 con 0x7fe678070890 2023-07-14T11:14:56.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.891+0000 7fe67d19b700 1 --2- 172.21.15.84:0/224560251 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe6781500d0 0x7fe678070350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:14:56.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.891+0000 7fe67c99a700 1 --2- 172.21.15.84:0/224560251 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe678070890 0x7fe6781597c0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fe6680098f0 tx=0x7fe668009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29f853d3b4ae23fc server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:56.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.891+0000 7fe66ffff700 1 -- 172.21.15.84:0/224560251 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66800f8a0 con 0x7fe678070890 2023-07-14T11:14:56.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.891+0000 7fe66ffff700 1 -- 172.21.15.84:0/224560251 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe66800fa00 con 0x7fe678070890 2023-07-14T11:14:56.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.891+0000 7fe66ffff700 1 -- 172.21.15.84:0/224560251 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66800fd90 con 0x7fe678070890 2023-07-14T11:14:56.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.892+0000 7fe67f3ff700 1 -- 172.21.15.84:0/224560251 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe678070890 msgr2=0x7fe6781597c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:56.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.892+0000 7fe67f3ff700 1 --2- 172.21.15.84:0/224560251 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe678070890 0x7fe6781597c0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fe6680098f0 tx=0x7fe668009c00 comp rx=0 tx=0).stop 2023-07-14T11:14:56.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.892+0000 7fe67f3ff700 1 -- 172.21.15.84:0/224560251 shutdown_connections 2023-07-14T11:14:56.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.892+0000 7fe67f3ff700 1 --2- 172.21.15.84:0/224560251 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe6781500d0 0x7fe678070350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:56.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.892+0000 7fe67f3ff700 1 --2- 172.21.15.84:0/224560251 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe678070890 0x7fe6781597c0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:56.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.892+0000 7fe67f3ff700 1 -- 172.21.15.84:0/224560251 >> 172.21.15.84:0/224560251 conn(0x7fe678069f30 msgr2=0x7fe67806a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:56.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.892+0000 7fe67f3ff700 1 -- 172.21.15.84:0/224560251 shutdown_connections 2023-07-14T11:14:56.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.892+0000 7fe67f3ff700 1 -- 172.21.15.84:0/224560251 wait complete. 2023-07-14T11:14:56.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.894+0000 7fe67f3ff700 1 Processor -- start 2023-07-14T11:14:56.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.894+0000 7fe67f3ff700 1 -- start start 2023-07-14T11:14:56.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.895+0000 7fe67f3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe678070890 0x7fe678137260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:56.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.895+0000 7fe67f3ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe6781500d0 0x7fe6780cc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:56.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.895+0000 7fe67f3ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe678159d00 0x7fe6780ccd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:56.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.895+0000 7fe67f3ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe67814b140 con 0x7fe678159d00 2023-07-14T11:14:56.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.895+0000 7fe67f3ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe67814ae60 con 0x7fe6781500d0 2023-07-14T11:14:56.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.895+0000 7fe67f3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe678137ce0 con 0x7fe678070890 2023-07-14T11:14:56.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.895+0000 7fe67d99c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe678159d00 0x7fe6780ccd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:56.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.895+0000 7fe67d99c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe678159d00 0x7fe6780ccd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59042/0 (socket says 172.21.15.84:59042) 2023-07-14T11:14:56.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.895+0000 7fe67d99c700 1 -- 172.21.15.84:0/543311897 learned_addr learned my addr 172.21.15.84:0/543311897 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:56.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.895+0000 7fe67d19b700 1 --2- 172.21.15.84:0/543311897 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe678070890 0x7fe678137260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:56.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.895+0000 7fe67c99a700 1 --2- 172.21.15.84:0/543311897 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe6781500d0 0x7fe6780cc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:56.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.896+0000 7fe67d99c700 1 -- 172.21.15.84:0/543311897 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe678070890 msgr2=0x7fe678137260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:56.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.896+0000 7fe67d99c700 1 --2- 172.21.15.84:0/543311897 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe678070890 0x7fe678137260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:56.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.896+0000 7fe67d99c700 1 -- 172.21.15.84:0/543311897 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe6781500d0 msgr2=0x7fe6780cc7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:56.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.896+0000 7fe67d99c700 1 --2- 172.21.15.84:0/543311897 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe6781500d0 0x7fe6780cc7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:56.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.896+0000 7fe67d99c700 1 -- 172.21.15.84:0/543311897 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe668009550 con 0x7fe678159d00 2023-07-14T11:14:56.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.896+0000 7fe67d99c700 1 --2- 172.21.15.84:0/543311897 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe678159d00 0x7fe6780ccd20 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fe67000cb50 tx=0x7fe67000ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:56.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.896+0000 7fe66dffb700 1 -- 172.21.15.84:0/543311897 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe670003c00 con 0x7fe678159d00 2023-07-14T11:14:56.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.896+0000 7fe66dffb700 1 -- 172.21.15.84:0/543311897 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe670003d60 con 0x7fe678159d00 2023-07-14T11:14:56.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.896+0000 7fe66dffb700 1 -- 172.21.15.84:0/543311897 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe67000aac0 con 0x7fe678159d00 2023-07-14T11:14:56.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.896+0000 7fe67f3ff700 1 -- 172.21.15.84:0/543311897 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe678137fc0 con 0x7fe678159d00 2023-07-14T11:14:56.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.896+0000 7fe67f3ff700 1 -- 172.21.15.84:0/543311897 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6781377a0 con 0x7fe678159d00 2023-07-14T11:14:56.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.897+0000 7fe67f3ff700 1 -- 172.21.15.84:0/543311897 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6781384e0 con 0x7fe678159d00 2023-07-14T11:14:56.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.898+0000 7fe66dffb700 1 -- 172.21.15.84:0/543311897 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 7) v1 ==== 89190+0+0 (secure 0 0 0) 0x7fe67000ac20 con 0x7fe678159d00 2023-07-14T11:14:56.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.899+0000 7fe66dffb700 1 --2- 172.21.15.84:0/543311897 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe65c06aec0 0x7fe65c06d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:56.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.899+0000 7fe66dffb700 1 -- 172.21.15.84:0/543311897 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6091+0+0 (secure 0 0 0) 0x7fe670089850 con 0x7fe678159d00 2023-07-14T11:14:56.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.899+0000 7fe67d19b700 1 --2- 172.21.15.84:0/543311897 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe65c06aec0 0x7fe65c06d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:56.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.900+0000 7fe67d19b700 1 --2- 172.21.15.84:0/543311897 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe65c06aec0 0x7fe65c06d370 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe674006f10 tx=0x7fe674008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:56.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:56.903+0000 7fe66dffb700 1 -- 172.21.15.84:0/543311897 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe6781384e0 con 0x7fe678159d00 2023-07-14T11:14:57.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.146+0000 7fe67f3ff700 1 -- 172.21.15.84:0/543311897 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe6781384e0 con 0x7fe678159d00 2023-07-14T11:14:57.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.147+0000 7fe66dffb700 1 -- 172.21.15.84:0/543311897 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4700 (secure 0 0 0) 0x7fe6781384e0 con 0x7fe678159d00 2023-07-14T11:14:57.149 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:14:57.149 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4751,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/76454361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":76454361},{"type":"v1","addr":"172.21.15.179:6833","nonce":76454361}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4757,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/534886511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":534886511},{"type":"v1","addr":"172.21.15.179:6835","nonce":534886511}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5118,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/930551517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":930551517},{"type":"v1","addr":"172.21.15.84:6836","nonce":930551517}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T11:14:32.504609+0000","modified":"2023-07-14T11:14:36.048621+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5121},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5121":{"gid":5121,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.84:6837/932986208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":932986208},{"type":"v1","addr":"172.21.15.84:6837","nonce":932986208}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-14T11:14:57.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.149+0000 7fe67f3ff700 1 -- 172.21.15.84:0/543311897 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe65c06aec0 msgr2=0x7fe65c06d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:57.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.149+0000 7fe67f3ff700 1 --2- 172.21.15.84:0/543311897 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe65c06aec0 0x7fe65c06d370 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe674006f10 tx=0x7fe674008040 comp rx=0 tx=0).stop 2023-07-14T11:14:57.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.149+0000 7fe67f3ff700 1 -- 172.21.15.84:0/543311897 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe678159d00 msgr2=0x7fe6780ccd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:57.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.149+0000 7fe67f3ff700 1 --2- 172.21.15.84:0/543311897 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe678159d00 0x7fe6780ccd20 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fe67000cb50 tx=0x7fe67000ce60 comp rx=0 tx=0).stop 2023-07-14T11:14:57.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.149+0000 7fe67f3ff700 1 -- 172.21.15.84:0/543311897 shutdown_connections 2023-07-14T11:14:57.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.149+0000 7fe67f3ff700 1 --2- 172.21.15.84:0/543311897 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe65c06aec0 0x7fe65c06d370 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:57.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.149+0000 7fe67f3ff700 1 --2- 172.21.15.84:0/543311897 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe678070890 0x7fe678137260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:57.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.149+0000 7fe67f3ff700 1 --2- 172.21.15.84:0/543311897 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe678159d00 0x7fe6780ccd20 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:57.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.149+0000 7fe67f3ff700 1 --2- 172.21.15.84:0/543311897 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe6781500d0 0x7fe6780cc7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:57.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.149+0000 7fe67f3ff700 1 -- 172.21.15.84:0/543311897 >> 172.21.15.84:0/543311897 conn(0x7fe678069f30 msgr2=0x7fe6780cb760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:57.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.150+0000 7fe67f3ff700 1 -- 172.21.15.84:0/543311897 shutdown_connections 2023-07-14T11:14:57.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.150+0000 7fe67f3ff700 1 -- 172.21.15.84:0/543311897 wait complete. 2023-07-14T11:14:57.153 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 19 2023-07-14T11:14:57.169 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T11:14:57.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.362+0000 7f01b77ff700 1 Processor -- start 2023-07-14T11:14:57.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.363+0000 7f01b77ff700 1 -- start start 2023-07-14T11:14:57.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.364+0000 7f01b77ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01b015c950 0x7f01b00b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:57.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.364+0000 7f01b77ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f01b00d1220 0x7f01b00afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:57.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.364+0000 7f01b77ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01b00d2ce0 con 0x7f01b00b1e00 2023-07-14T11:14:57.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.364+0000 7f01b77ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01b00b3350 con 0x7f01b00d1220 2023-07-14T11:14:57.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.364+0000 7f01b77ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01b00b3630 con 0x7f01b015c950 2023-07-14T11:14:57.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.364+0000 7f01b5d9c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f01b00d1220 0x7f01b00afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:57.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.364+0000 7f01b5d9c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f01b00d1220 0x7f01b00afac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59044/0 (socket says 172.21.15.84:59044) 2023-07-14T11:14:57.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.364+0000 7f01b5d9c700 1 -- 172.21.15.84:0/2803999471 learned_addr learned my addr 172.21.15.84:0/2803999471 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:57.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.365+0000 7f01b559b700 1 --2- 172.21.15.84:0/2803999471 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01b015c950 0x7f01b00b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:57.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.365+0000 7f01b5d9c700 1 -- 172.21.15.84:0/2803999471 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01b015c950 msgr2=0x7f01b00b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:57.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.365+0000 7f01b5d9c700 1 --2- 172.21.15.84:0/2803999471 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01b015c950 0x7f01b00b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:57.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.365+0000 7f01b5d9c700 1 -- 172.21.15.84:0/2803999471 >> v1:172.21.15.179:6789/0 conn(0x7f01b00b1e00 legacy=0x7f01b00d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:57.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.365+0000 7f01b5d9c700 1 -- 172.21.15.84:0/2803999471 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01b00b3910 con 0x7f01b00d1220 2023-07-14T11:14:57.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.365+0000 7f01b559b700 1 --2- 172.21.15.84:0/2803999471 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01b015c950 0x7f01b00b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:14:57.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.365+0000 7f01b5d9c700 1 --2- 172.21.15.84:0/2803999471 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b00d1220 0x7f01b00afac0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f01a8009e50 tx=0x7f01a800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6046cf8090a867a5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:57.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.365+0000 7f01a7fff700 1 -- 172.21.15.84:0/2803999471 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a800e070 con 0x7f01b00d1220 2023-07-14T11:14:57.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.365+0000 7f01a7fff700 1 -- 172.21.15.84:0/2803999471 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01a8003a20 con 0x7f01b00d1220 2023-07-14T11:14:57.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.365+0000 7f01a7fff700 1 -- 172.21.15.84:0/2803999471 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a8003dd0 con 0x7f01b00d1220 2023-07-14T11:14:57.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.366+0000 7f01b77ff700 1 -- 172.21.15.84:0/2803999471 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b00d1220 msgr2=0x7f01b00afac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:57.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.366+0000 7f01b77ff700 1 --2- 172.21.15.84:0/2803999471 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b00d1220 0x7f01b00afac0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f01a8009e50 tx=0x7f01a800b330 comp rx=0 tx=0).stop 2023-07-14T11:14:57.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.366+0000 7f01b77ff700 1 -- 172.21.15.84:0/2803999471 shutdown_connections 2023-07-14T11:14:57.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.366+0000 7f01b77ff700 1 --2- 172.21.15.84:0/2803999471 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b00d1220 0x7f01b00afac0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:57.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.366+0000 7f01b77ff700 1 --2- 172.21.15.84:0/2803999471 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01b015c950 0x7f01b00b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:57.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.366+0000 7f01b77ff700 1 -- 172.21.15.84:0/2803999471 >> 172.21.15.84:0/2803999471 conn(0x7f01b009c1d0 msgr2=0x7f01b00d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:57.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.366+0000 7f01b77ff700 1 -- 172.21.15.84:0/2803999471 shutdown_connections 2023-07-14T11:14:57.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.366+0000 7f01b77ff700 1 -- 172.21.15.84:0/2803999471 wait complete. 2023-07-14T11:14:57.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.367+0000 7f01b77ff700 1 Processor -- start 2023-07-14T11:14:57.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.368+0000 7f01b77ff700 1 -- start start 2023-07-14T11:14:57.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.368+0000 7f01b77ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b00b1e00 0x7f01b0151e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:57.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.368+0000 7f01b77ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01b00d1220 0x7f01b00cdf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:57.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.368+0000 7f01b77ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01b015c950 0x7f01b00b6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:57.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.369+0000 7f01b77ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01b00c7720 con 0x7f01b00b1e00 2023-07-14T11:14:57.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.369+0000 7f01b77ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01b01523a0 con 0x7f01b00d1220 2023-07-14T11:14:57.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.369+0000 7f01b77ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01b00c6b10 con 0x7f01b015c950 2023-07-14T11:14:57.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.369+0000 7f01b559b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b00b1e00 0x7f01b0151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:57.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.369+0000 7f01b559b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b00b1e00 0x7f01b0151e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59054/0 (socket says 172.21.15.84:59054) 2023-07-14T11:14:57.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.369+0000 7f01b559b700 1 -- 172.21.15.84:0/876171589 learned_addr learned my addr 172.21.15.84:0/876171589 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:57.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.369+0000 7f01b4d9a700 1 --2- 172.21.15.84:0/876171589 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01b00d1220 0x7f01b00cdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:57.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.369+0000 7f01b5d9c700 1 --2- 172.21.15.84:0/876171589 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01b015c950 0x7f01b00b6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:57.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.369+0000 7f01b559b700 1 -- 172.21.15.84:0/876171589 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01b015c950 msgr2=0x7f01b00b6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:57.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.369+0000 7f01b559b700 1 --2- 172.21.15.84:0/876171589 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01b015c950 0x7f01b00b6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:57.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.369+0000 7f01b559b700 1 -- 172.21.15.84:0/876171589 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01b00d1220 msgr2=0x7f01b00cdf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:57.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.369+0000 7f01b559b700 1 --2- 172.21.15.84:0/876171589 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01b00d1220 0x7f01b00cdf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:57.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.369+0000 7f01b559b700 1 -- 172.21.15.84:0/876171589 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a8009b30 con 0x7f01b00b1e00 2023-07-14T11:14:57.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.369+0000 7f01b559b700 1 --2- 172.21.15.84:0/876171589 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b00b1e00 0x7f01b0151e60 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f01ac00c7f0 tx=0x7f01ac00cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:57.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.370+0000 7f01a5ffb700 1 -- 172.21.15.84:0/876171589 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01ac005c20 con 0x7f01b00b1e00 2023-07-14T11:14:57.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.370+0000 7f01a5ffb700 1 -- 172.21.15.84:0/876171589 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01ac005d80 con 0x7f01b00b1e00 2023-07-14T11:14:57.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.370+0000 7f01a5ffb700 1 -- 172.21.15.84:0/876171589 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01ac011820 con 0x7f01b00b1e00 2023-07-14T11:14:57.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.370+0000 7f01b77ff700 1 -- 172.21.15.84:0/876171589 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01b00c6df0 con 0x7f01b00b1e00 2023-07-14T11:14:57.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.370+0000 7f01b77ff700 1 -- 172.21.15.84:0/876171589 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01b00c73b0 con 0x7f01b00b1e00 2023-07-14T11:14:57.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.371+0000 7f01b77ff700 1 -- 172.21.15.84:0/876171589 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01b004e280 con 0x7f01b00b1e00 2023-07-14T11:14:57.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.372+0000 7f01a5ffb700 1 -- 172.21.15.84:0/876171589 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 7) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f01ac011980 con 0x7f01b00b1e00 2023-07-14T11:14:57.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.373+0000 7f01a5ffb700 1 --2- 172.21.15.84:0/876171589 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f019406ae90 0x7f019406d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:57.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.373+0000 7f01a5ffb700 1 -- 172.21.15.84:0/876171589 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f01ac089620 con 0x7f01b00b1e00 2023-07-14T11:14:57.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.373+0000 7f01b4d9a700 1 --2- 172.21.15.84:0/876171589 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f019406ae90 0x7f019406d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:57.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.374+0000 7f01b4d9a700 1 --2- 172.21.15.84:0/876171589 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f019406ae90 0x7f019406d340 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f01b0158c50 tx=0x7f01a0007ec0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:57.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.377+0000 7f01a5ffb700 1 -- 172.21.15.84:0/876171589 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f01ac054280 con 0x7f01b00b1e00 2023-07-14T11:14:57.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.616+0000 7f01b77ff700 1 -- 172.21.15.84:0/876171589 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f01b008c5a0 con 0x7f01b00b1e00 2023-07-14T11:14:57.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.616+0000 7f01a5ffb700 1 -- 172.21.15.84:0/876171589 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4700 (secure 0 0 0) 0x7f01ac0578a0 con 0x7f01b00b1e00 2023-07-14T11:14:57.619 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:14:57.619 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4751,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/76454361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":76454361},{"type":"v1","addr":"172.21.15.179:6833","nonce":76454361}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4757,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/534886511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":534886511},{"type":"v1","addr":"172.21.15.179:6835","nonce":534886511}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5118,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/930551517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":930551517},{"type":"v1","addr":"172.21.15.84:6836","nonce":930551517}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T11:14:32.504609+0000","modified":"2023-07-14T11:14:36.048621+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5121},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5121":{"gid":5121,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.84:6837/932986208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":932986208},{"type":"v1","addr":"172.21.15.84:6837","nonce":932986208}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-14T11:14:57.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.619+0000 7f01b77ff700 1 -- 172.21.15.84:0/876171589 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f019406ae90 msgr2=0x7f019406d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:57.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.619+0000 7f01b77ff700 1 --2- 172.21.15.84:0/876171589 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f019406ae90 0x7f019406d340 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f01b0158c50 tx=0x7f01a0007ec0 comp rx=0 tx=0).stop 2023-07-14T11:14:57.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.619+0000 7f01b77ff700 1 -- 172.21.15.84:0/876171589 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b00b1e00 msgr2=0x7f01b0151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:57.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.619+0000 7f01b77ff700 1 --2- 172.21.15.84:0/876171589 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b00b1e00 0x7f01b0151e60 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f01ac00c7f0 tx=0x7f01ac00cb00 comp rx=0 tx=0).stop 2023-07-14T11:14:57.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.619+0000 7f01b77ff700 1 -- 172.21.15.84:0/876171589 shutdown_connections 2023-07-14T11:14:57.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.619+0000 7f01b77ff700 1 --2- 172.21.15.84:0/876171589 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f019406ae90 0x7f019406d340 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:57.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.619+0000 7f01b77ff700 1 --2- 172.21.15.84:0/876171589 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01b015c950 0x7f01b00b6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:57.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.619+0000 7f01b77ff700 1 --2- 172.21.15.84:0/876171589 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b00b1e00 0x7f01b0151e60 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:57.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.619+0000 7f01b77ff700 1 --2- 172.21.15.84:0/876171589 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01b00d1220 0x7f01b00cdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:57.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.619+0000 7f01b77ff700 1 -- 172.21.15.84:0/876171589 >> 172.21.15.84:0/876171589 conn(0x7f01b009c1d0 msgr2=0x7f01b0159540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:57.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.619+0000 7f01b77ff700 1 -- 172.21.15.84:0/876171589 shutdown_connections 2023-07-14T11:14:57.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.619+0000 7f01b77ff700 1 -- 172.21.15.84:0/876171589 wait complete. 2023-07-14T11:14:57.623 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 19 2023-07-14T11:14:57.639 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:14:57.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.832+0000 7f41c3fff700 1 Processor -- start 2023-07-14T11:14:57.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.832+0000 7f41c3fff700 1 -- start start 2023-07-14T11:14:57.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.833+0000 7f41c3fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41bc15c710 0x7f41bc0cf510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:57.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.833+0000 7f41c3fff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41bc0cd320 con 0x7f41bc06db30 2023-07-14T11:14:57.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.833+0000 7f41c3fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41bc0ce750 con 0x7f41bc069f30 2023-07-14T11:14:57.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.833+0000 7f41c3fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41bc0cea30 con 0x7f41bc15c710 2023-07-14T11:14:57.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.834+0000 7f41c259c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f41bc06db30 0x7f41bc070950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50036/0 (socket says 172.21.15.84:50036) 2023-07-14T11:14:57.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.834+0000 7f41c259c700 1 -- 172.21.15.84:0/4148595756 learned_addr learned my addr 172.21.15.84:0/4148595756 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:14:57.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.834+0000 7f41c1d9b700 1 --2- 172.21.15.84:0/4148595756 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41bc15c710 0x7f41bc0cf510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:57.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.834+0000 7f41c1d9b700 1 -- 172.21.15.84:0/4148595756 >> v1:172.21.15.179:6789/0 conn(0x7f41bc069f30 legacy=0x7f41bc06d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:57.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.834+0000 7f41c1d9b700 1 -- 172.21.15.84:0/4148595756 >> v1:172.21.15.84:6789/0 conn(0x7f41bc06db30 legacy=0x7f41bc070950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:57.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.834+0000 7f41c1d9b700 1 -- 172.21.15.84:0/4148595756 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41bc0ced10 con 0x7f41bc15c710 2023-07-14T11:14:57.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.835+0000 7f41c1d9b700 1 --2- 172.21.15.84:0/4148595756 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41bc15c710 0x7f41bc0cf510 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f41b8009870 tx=0x7f41b8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27f2dad1522cdfb0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:57.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.837+0000 7f41c0d99700 1 -- 172.21.15.84:0/4148595756 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b8011830 con 0x7f41bc15c710 2023-07-14T11:14:57.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.837+0000 7f41c0d99700 1 -- 172.21.15.84:0/4148595756 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41b8011990 con 0x7f41bc15c710 2023-07-14T11:14:57.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.837+0000 7f41c0d99700 1 -- 172.21.15.84:0/4148595756 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b8011d20 con 0x7f41bc15c710 2023-07-14T11:14:57.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.838+0000 7f41c3fff700 1 -- 172.21.15.84:0/4148595756 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41bc15c710 msgr2=0x7f41bc0cf510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:57.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.838+0000 7f41c3fff700 1 --2- 172.21.15.84:0/4148595756 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41bc15c710 0x7f41bc0cf510 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f41b8009870 tx=0x7f41b8009b80 comp rx=0 tx=0).stop 2023-07-14T11:14:57.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.838+0000 7f41c3fff700 1 -- 172.21.15.84:0/4148595756 shutdown_connections 2023-07-14T11:14:57.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.838+0000 7f41c3fff700 1 --2- 172.21.15.84:0/4148595756 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41bc15c710 0x7f41bc0cf510 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:57.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.838+0000 7f41c3fff700 1 -- 172.21.15.84:0/4148595756 >> 172.21.15.84:0/4148595756 conn(0x7f41bc0b16c0 msgr2=0x7f41bc0b1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:57.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.838+0000 7f41c3fff700 1 -- 172.21.15.84:0/4148595756 shutdown_connections 2023-07-14T11:14:57.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.838+0000 7f41c3fff700 1 -- 172.21.15.84:0/4148595756 wait complete. 2023-07-14T11:14:57.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.840+0000 7f41c3fff700 1 Processor -- start 2023-07-14T11:14:57.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.840+0000 7f41c3fff700 1 -- start start 2023-07-14T11:14:57.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.841+0000 7f41c3fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41bc069f30 0x7f41bc15d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:57.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.841+0000 7f41c3fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41bc06db30 0x7f41bc1553c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:57.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.841+0000 7f41c3fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41bc155c80 0x7f41bc15efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:57.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.841+0000 7f41c3fff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41bc0b3e50 con 0x7f41bc06db30 2023-07-14T11:14:57.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.841+0000 7f41c3fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41bc15cbc0 con 0x7f41bc155c80 2023-07-14T11:14:57.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.841+0000 7f41c3fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41bc15cea0 con 0x7f41bc069f30 2023-07-14T11:14:57.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.841+0000 7f41c159a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41bc06db30 0x7f41bc1553c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:57.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.841+0000 7f41c159a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41bc06db30 0x7f41bc1553c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59064/0 (socket says 172.21.15.84:59064) 2023-07-14T11:14:57.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.841+0000 7f41c159a700 1 -- 172.21.15.84:0/3441367217 learned_addr learned my addr 172.21.15.84:0/3441367217 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:57.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.841+0000 7f41c1d9b700 1 --2- 172.21.15.84:0/3441367217 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41bc069f30 0x7f41bc15d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:57.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.841+0000 7f41c259c700 1 --2- 172.21.15.84:0/3441367217 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41bc155c80 0x7f41bc15efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:57.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.841+0000 7f41c159a700 1 -- 172.21.15.84:0/3441367217 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41bc069f30 msgr2=0x7f41bc15d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:57.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.841+0000 7f41c159a700 1 --2- 172.21.15.84:0/3441367217 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41bc069f30 0x7f41bc15d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:57.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.841+0000 7f41c159a700 1 -- 172.21.15.84:0/3441367217 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41bc155c80 msgr2=0x7f41bc15efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:57.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.841+0000 7f41c159a700 1 --2- 172.21.15.84:0/3441367217 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41bc155c80 0x7f41bc15efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:57.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.841+0000 7f41c159a700 1 -- 172.21.15.84:0/3441367217 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41b80094a0 con 0x7f41bc06db30 2023-07-14T11:14:57.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.842+0000 7f41c159a700 1 --2- 172.21.15.84:0/3441367217 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41bc06db30 0x7f41bc1553c0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f41ac00c4e0 tx=0x7f41ac00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:57.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.842+0000 7f41b27fc700 1 -- 172.21.15.84:0/3441367217 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41ac0052d0 con 0x7f41bc06db30 2023-07-14T11:14:57.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.842+0000 7f41b27fc700 1 -- 172.21.15.84:0/3441367217 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41ac005430 con 0x7f41bc06db30 2023-07-14T11:14:57.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.842+0000 7f41c3fff700 1 -- 172.21.15.84:0/3441367217 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41bc06ac20 con 0x7f41bc06db30 2023-07-14T11:14:57.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.842+0000 7f41b27fc700 1 -- 172.21.15.84:0/3441367217 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41ac0038c0 con 0x7f41bc06db30 2023-07-14T11:14:57.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.842+0000 7f41c3fff700 1 -- 172.21.15.84:0/3441367217 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41bc0b3a70 con 0x7f41bc06db30 2023-07-14T11:14:57.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.843+0000 7f41c3fff700 1 -- 172.21.15.84:0/3441367217 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41bc0b3f90 con 0x7f41bc06db30 2023-07-14T11:14:57.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.844+0000 7f41b27fc700 1 -- 172.21.15.84:0/3441367217 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 7) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f41ac003a20 con 0x7f41bc06db30 2023-07-14T11:14:57.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.845+0000 7f41b27fc700 1 --2- 172.21.15.84:0/3441367217 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f41a006ae90 0x7f41a006d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:57.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.845+0000 7f41b27fc700 1 -- 172.21.15.84:0/3441367217 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f41ac088c00 con 0x7f41bc06db30 2023-07-14T11:14:57.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.845+0000 7f41c1d9b700 1 --2- 172.21.15.84:0/3441367217 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f41a006ae90 0x7f41a006d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:57.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.846+0000 7f41c1d9b700 1 --2- 172.21.15.84:0/3441367217 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f41a006ae90 0x7f41a006d340 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f41b80097c0 tx=0x7f41b801c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:57.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:57.849+0000 7f41b27fc700 1 -- 172.21.15.84:0/3441367217 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f41bc0b3f90 con 0x7f41bc06db30 2023-07-14T11:14:58.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.047+0000 7f41c3fff700 1 -- 172.21.15.84:0/3441367217 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f41bc0b3f90 con 0x7f41bc06db30 2023-07-14T11:14:58.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.048+0000 7f41b27fc700 1 -- 172.21.15.84:0/3441367217 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+18319 (secure 0 0 0) 0x7f41bc0b3f90 con 0x7f41bc06db30 2023-07-14T11:14:58.051 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:14:58.051 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":39,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:14:56.825848+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-14T11:14:30.730753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-14T11:14:31.485809+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.d","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:14:58.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.051+0000 7f41c3fff700 1 -- 172.21.15.84:0/3441367217 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f41a006ae90 msgr2=0x7f41a006d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:58.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.051+0000 7f41c3fff700 1 --2- 172.21.15.84:0/3441367217 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f41a006ae90 0x7f41a006d340 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f41b80097c0 tx=0x7f41b801c040 comp rx=0 tx=0).stop 2023-07-14T11:14:58.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.051+0000 7f41c3fff700 1 -- 172.21.15.84:0/3441367217 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41bc06db30 msgr2=0x7f41bc1553c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:58.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.051+0000 7f41c3fff700 1 --2- 172.21.15.84:0/3441367217 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41bc06db30 0x7f41bc1553c0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f41ac00c4e0 tx=0x7f41ac00c7f0 comp rx=0 tx=0).stop 2023-07-14T11:14:58.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.051+0000 7f41c3fff700 1 -- 172.21.15.84:0/3441367217 shutdown_connections 2023-07-14T11:14:58.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.051+0000 7f41c3fff700 1 --2- 172.21.15.84:0/3441367217 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f41a006ae90 0x7f41a006d340 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:58.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.051+0000 7f41c3fff700 1 --2- 172.21.15.84:0/3441367217 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41bc069f30 0x7f41bc15d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:58.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.051+0000 7f41c3fff700 1 --2- 172.21.15.84:0/3441367217 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41bc155c80 0x7f41bc15efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:58.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.051+0000 7f41c3fff700 1 --2- 172.21.15.84:0/3441367217 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41bc06db30 0x7f41bc1553c0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:58.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.051+0000 7f41c3fff700 1 -- 172.21.15.84:0/3441367217 >> 172.21.15.84:0/3441367217 conn(0x7f41bc0b16c0 msgr2=0x7f41bc0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:58.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.051+0000 7f41c3fff700 1 -- 172.21.15.84:0/3441367217 shutdown_connections 2023-07-14T11:14:58.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.051+0000 7f41c3fff700 1 -- 172.21.15.84:0/3441367217 wait complete. 2023-07-14T11:14:58.071 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-14T11:14:58.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.265+0000 7f64811ff700 1 Processor -- start 2023-07-14T11:14:58.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.266+0000 7f64811ff700 1 -- start start 2023-07-14T11:14:58.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.267+0000 7f64811ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f647c0b4600 0x7f647c0cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:58.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.267+0000 7f64811ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f647c15cd60 con 0x7f647c0cfe40 2023-07-14T11:14:58.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.267+0000 7f64811ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f647c0ce360 con 0x7f647c0b6f00 2023-07-14T11:14:58.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.267+0000 7f64811ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f647c0d1550 con 0x7f647c0b4600 2023-07-14T11:14:58.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.267+0000 7f6473fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f647c0cfe40 0x7f647c0cd540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50040/0 (socket says 172.21.15.84:50040) 2023-07-14T11:14:58.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.267+0000 7f6473fff700 1 -- 172.21.15.84:0/3808382414 learned_addr learned my addr 172.21.15.84:0/3808382414 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:14:58.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.268+0000 7f647a59c700 1 -- 172.21.15.84:0/3808382414 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 586619908 0 0) 0x7f647c15cd60 con 0x7f647c0cfe40 2023-07-14T11:14:58.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.268+0000 7f647a59c700 1 -- 172.21.15.84:0/3808382414 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64680035b0 con 0x7f647c0cfe40 2023-07-14T11:14:58.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.268+0000 7f647ad9d700 1 --2- 172.21.15.84:0/3808382414 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f647c0b4600 0x7f647c0cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:58.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.268+0000 7f647a59c700 1 -- 172.21.15.84:0/3808382414 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2214084302 0 0) 0x7f64680035b0 con 0x7f647c0cfe40 2023-07-14T11:14:58.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.268+0000 7f647a59c700 1 -- 172.21.15.84:0/3808382414 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f647c0b4600 msgr2=0x7f647c0cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:58.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.268+0000 7f647a59c700 1 --2- 172.21.15.84:0/3808382414 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f647c0b4600 0x7f647c0cf900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:58.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.268+0000 7f647a59c700 1 -- 172.21.15.84:0/3808382414 >> v1:172.21.15.179:6789/0 conn(0x7f647c0b6f00 legacy=0x7f647c0cdc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:58.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.268+0000 7f647a59c700 1 -- 172.21.15.84:0/3808382414 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f647c0cf340 con 0x7f647c0cfe40 2023-07-14T11:14:58.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.268+0000 7f647a59c700 1 -- 172.21.15.84:0/3808382414 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7f6464001670 con 0x7f647c0cfe40 2023-07-14T11:14:58.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.268+0000 7f647a59c700 1 -- 172.21.15.84:0/3808382414 >> v1:172.21.15.84:6789/0 conn(0x7f647c0cfe40 legacy=0x7f647c0cd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:58.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.268+0000 7f647a59c700 1 --2- 172.21.15.84:0/3808382414 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6468003a30 0x7f6468003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:58.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.268+0000 7f647a59c700 1 --2- 172.21.15.84:0/3808382414 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6468004430 0x7f64680048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:58.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.268+0000 7f647a59c700 1 --2- 172.21.15.84:0/3808382414 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64680050f0 0x7f646800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:58.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.268+0000 7f647a59c700 1 -- 172.21.15.84:0/3808382414 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f647c0d1550 con 0x7f6468004430 2023-07-14T11:14:58.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.268+0000 7f647a59c700 1 -- 172.21.15.84:0/3808382414 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f646800c000 con 0x7f64680050f0 2023-07-14T11:14:58.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.268+0000 7f647a59c700 1 -- 172.21.15.84:0/3808382414 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f646800c1c0 con 0x7f6468003a30 2023-07-14T11:14:58.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.268+0000 7f6473fff700 1 --2- 172.21.15.84:0/3808382414 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6468004430 0x7f64680048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:58.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.268+0000 7f647ad9d700 1 --2- 172.21.15.84:0/3808382414 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6468003a30 0x7f6468003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:58.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.268+0000 7f647b59e700 1 --2- 172.21.15.84:0/3808382414 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64680050f0 0x7f646800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:58.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.269+0000 7f6473fff700 1 -- 172.21.15.84:0/3808382414 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6468003a30 msgr2=0x7f6468003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:58.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.269+0000 7f6473fff700 1 --2- 172.21.15.84:0/3808382414 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6468003a30 0x7f6468003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:58.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.269+0000 7f6473fff700 1 -- 172.21.15.84:0/3808382414 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64680050f0 msgr2=0x7f646800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:58.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.269+0000 7f6473fff700 1 --2- 172.21.15.84:0/3808382414 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64680050f0 0x7f646800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:58.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.269+0000 7f6473fff700 1 -- 172.21.15.84:0/3808382414 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64680035b0 con 0x7f6468004430 2023-07-14T11:14:58.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.269+0000 7f647b59e700 1 --2- 172.21.15.84:0/3808382414 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64680050f0 0x7f646800ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:14:58.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.269+0000 7f6473fff700 1 --2- 172.21.15.84:0/3808382414 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6468004430 0x7f64680048f0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f646400c240 tx=0x7f6468005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=634e85e9633a9e75 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:58.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.269+0000 7f647a59c700 1 -- 172.21.15.84:0/3808382414 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6464007c10 con 0x7f6468004430 2023-07-14T11:14:58.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.269+0000 7f647a59c700 1 -- 172.21.15.84:0/3808382414 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f646400ce00 con 0x7f6468004430 2023-07-14T11:14:58.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.269+0000 7f647a59c700 1 -- 172.21.15.84:0/3808382414 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6464005ba0 con 0x7f6468004430 2023-07-14T11:14:58.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.270+0000 7f64811ff700 1 -- 172.21.15.84:0/3808382414 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6468004430 msgr2=0x7f64680048f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:58.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.270+0000 7f64811ff700 1 --2- 172.21.15.84:0/3808382414 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6468004430 0x7f64680048f0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f646400c240 tx=0x7f6468005880 comp rx=0 tx=0).stop 2023-07-14T11:14:58.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.270+0000 7f647b59e700 1 -- 172.21.15.84:0/3808382414 reap_dead start 2023-07-14T11:14:58.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.270+0000 7f64811ff700 1 -- 172.21.15.84:0/3808382414 shutdown_connections 2023-07-14T11:14:58.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.270+0000 7f64811ff700 1 -- 172.21.15.84:0/3808382414 >> 172.21.15.84:0/3808382414 conn(0x7f647c09c200 msgr2=0x7f647c0d2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:58.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.270+0000 7f64811ff700 1 -- 172.21.15.84:0/3808382414 shutdown_connections 2023-07-14T11:14:58.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.270+0000 7f64811ff700 1 -- 172.21.15.84:0/3808382414 wait complete. 2023-07-14T11:14:58.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.271+0000 7f64811ff700 1 Processor -- start 2023-07-14T11:14:58.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.272+0000 7f64811ff700 1 -- start start 2023-07-14T11:14:58.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.272+0000 7f64811ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6468004430 0x7f647c154820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:58.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.272+0000 7f64811ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f647c149260 0x7f647c152cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:58.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.272+0000 7f64811ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f647c153200 0x7f647c15e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:58.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.273+0000 7f64811ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f647c153780 con 0x7f6468004430 2023-07-14T11:14:58.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.273+0000 7f64811ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f647c153a60 con 0x7f647c149260 2023-07-14T11:14:58.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.273+0000 7f64811ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f647c153d40 con 0x7f647c153200 2023-07-14T11:14:58.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.273+0000 7f647ad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6468004430 0x7f647c154820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:58.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.273+0000 7f647ad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6468004430 0x7f647c154820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59080/0 (socket says 172.21.15.84:59080) 2023-07-14T11:14:58.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.273+0000 7f647ad9d700 1 -- 172.21.15.84:0/1895547885 learned_addr learned my addr 172.21.15.84:0/1895547885 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:58.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.273+0000 7f647ad9d700 1 -- 172.21.15.84:0/1895547885 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f647c153200 msgr2=0x7f647c15e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:58.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.273+0000 7f647ad9d700 1 --2- 172.21.15.84:0/1895547885 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f647c153200 0x7f647c15e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:58.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.273+0000 7f647ad9d700 1 -- 172.21.15.84:0/1895547885 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f647c149260 msgr2=0x7f647c152cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:58.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.273+0000 7f647ad9d700 1 --2- 172.21.15.84:0/1895547885 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f647c149260 0x7f647c152cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:58.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.273+0000 7f647ad9d700 1 -- 172.21.15.84:0/1895547885 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f647c154020 con 0x7f6468004430 2023-07-14T11:14:58.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.273+0000 7f647ad9d700 1 --2- 172.21.15.84:0/1895547885 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6468004430 0x7f647c154820 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f646c0116c0 tx=0x7f646c011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:58.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.274+0000 7f64737fe700 1 -- 172.21.15.84:0/1895547885 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646c00c070 con 0x7f6468004430 2023-07-14T11:14:58.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.274+0000 7f64737fe700 1 -- 172.21.15.84:0/1895547885 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f646c015870 con 0x7f6468004430 2023-07-14T11:14:58.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.274+0000 7f64811ff700 1 -- 172.21.15.84:0/1895547885 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f647c154300 con 0x7f6468004430 2023-07-14T11:14:58.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.274+0000 7f64737fe700 1 -- 172.21.15.84:0/1895547885 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646c015c20 con 0x7f6468004430 2023-07-14T11:14:58.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.274+0000 7f64811ff700 1 -- 172.21.15.84:0/1895547885 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f647c1496d0 con 0x7f6468004430 2023-07-14T11:14:58.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.275+0000 7f64811ff700 1 -- 172.21.15.84:0/1895547885 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f647c154540 con 0x7f6468004430 2023-07-14T11:14:58.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.276+0000 7f64737fe700 1 -- 172.21.15.84:0/1895547885 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 7) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f646c013400 con 0x7f6468004430 2023-07-14T11:14:58.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.277+0000 7f64737fe700 1 --2- 172.21.15.84:0/1895547885 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f645c06aec0 0x7f645c06d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:58.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.277+0000 7f64737fe700 1 -- 172.21.15.84:0/1895547885 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f646c089c20 con 0x7f6468004430 2023-07-14T11:14:58.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.277+0000 7f6473fff700 1 --2- 172.21.15.84:0/1895547885 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f645c06aec0 0x7f645c06d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:58.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.277+0000 7f6473fff700 1 --2- 172.21.15.84:0/1895547885 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f645c06aec0 0x7f645c06d370 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6464000c00 tx=0x7f646400a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:58.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.281+0000 7f64737fe700 1 -- 172.21.15.84:0/1895547885 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f647c154540 con 0x7f6468004430 2023-07-14T11:14:58.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.518+0000 7f64811ff700 1 -- 172.21.15.84:0/1895547885 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f647c074350 con 0x7f6468004430 2023-07-14T11:14:58.521 INFO:tasks.ceph.mon.a.smithi084.stderr:2023-07-14T11:14:58.519+0000 7f5e043f4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-14T11:14:58.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.524+0000 7f64737fe700 1 -- 172.21.15.84:0/1895547885 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v20) v1 ==== 161+0+0 (secure 0 0 0) 0x7f646c023070 con 0x7f6468004430 2023-07-14T11:14:58.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.527+0000 7f64811ff700 1 -- 172.21.15.84:0/1895547885 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f645c06aec0 msgr2=0x7f645c06d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:58.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.527+0000 7f64811ff700 1 --2- 172.21.15.84:0/1895547885 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f645c06aec0 0x7f645c06d370 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6464000c00 tx=0x7f646400a000 comp rx=0 tx=0).stop 2023-07-14T11:14:58.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.527+0000 7f64811ff700 1 -- 172.21.15.84:0/1895547885 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6468004430 msgr2=0x7f647c154820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:58.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.527+0000 7f64811ff700 1 --2- 172.21.15.84:0/1895547885 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6468004430 0x7f647c154820 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f646c0116c0 tx=0x7f646c011a80 comp rx=0 tx=0).stop 2023-07-14T11:14:58.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.527+0000 7f64811ff700 1 -- 172.21.15.84:0/1895547885 shutdown_connections 2023-07-14T11:14:58.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.527+0000 7f64811ff700 1 --2- 172.21.15.84:0/1895547885 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f645c06aec0 0x7f645c06d370 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:58.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.527+0000 7f64811ff700 1 --2- 172.21.15.84:0/1895547885 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f647c153200 0x7f647c15e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:58.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.527+0000 7f64811ff700 1 --2- 172.21.15.84:0/1895547885 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6468004430 0x7f647c154820 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:58.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.527+0000 7f64811ff700 1 --2- 172.21.15.84:0/1895547885 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f647c149260 0x7f647c152cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:58.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.527+0000 7f64811ff700 1 -- 172.21.15.84:0/1895547885 >> 172.21.15.84:0/1895547885 conn(0x7f647c09c200 msgr2=0x7f647c06aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:58.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.527+0000 7f64811ff700 1 -- 172.21.15.84:0/1895547885 shutdown_connections 2023-07-14T11:14:58.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.527+0000 7f64811ff700 1 -- 172.21.15.84:0/1895547885 wait complete. 2023-07-14T11:14:58.531 INFO:teuthology.orchestra.run.smithi084.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-14T11:14:58.549 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-14T11:14:58.597 INFO:tasks.ceph.mds.c.smithi084.stdout:starting mds.c at 2023-07-14T11:14:58.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.746+0000 7f1f2a1ff700 1 Processor -- start 2023-07-14T11:14:58.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.746+0000 7f1f2a1ff700 1 -- start start 2023-07-14T11:14:58.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.747+0000 7f1f2a1ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1f240c92d0 0x7f1f240ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:58.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.747+0000 7f1f2a1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f240b12f0 0x7f1f240c96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:58.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.747+0000 7f1f2a1ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1f240adea0 0x7f1f2406c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:58.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.747+0000 7f1f2a1ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f2415da60 con 0x7f1f240adea0 2023-07-14T11:14:58.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.747+0000 7f1f2a1ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f2415ce70 con 0x7f1f240c92d0 2023-07-14T11:14:58.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.747+0000 7f1f2a1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f240c9be0 con 0x7f1f240b12f0 2023-07-14T11:14:58.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.748+0000 7f1f23fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1f240adea0 0x7f1f2406c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:58.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.748+0000 7f1f23fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1f240adea0 0x7f1f2406c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59102/0 (socket says 172.21.15.84:59102) 2023-07-14T11:14:58.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.748+0000 7f1f23fff700 1 -- 172.21.15.84:0/4224640477 learned_addr learned my addr 172.21.15.84:0/4224640477 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:58.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.748+0000 7f1f22ffd700 1 --2- 172.21.15.84:0/4224640477 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f240b12f0 0x7f1f240c96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:58.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.748+0000 7f1f237fe700 1 --2- 172.21.15.84:0/4224640477 >> v2:172.21.15.179:3300/0 conn(0x7f1f240c92d0 0x7f1f240ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:58.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.748+0000 7f1f23fff700 1 -- 172.21.15.84:0/4224640477 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f240b12f0 msgr2=0x7f1f240c96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:58.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.748+0000 7f1f23fff700 1 --2- 172.21.15.84:0/4224640477 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f240b12f0 0x7f1f240c96a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:58.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.748+0000 7f1f23fff700 1 -- 172.21.15.84:0/4224640477 >> v2:172.21.15.179:3300/0 conn(0x7f1f240c92d0 msgr2=0x7f1f240ad8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:58.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.748+0000 7f1f23fff700 1 --2- 172.21.15.84:0/4224640477 >> v2:172.21.15.179:3300/0 conn(0x7f1f240c92d0 0x7f1f240ad8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:58.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.748+0000 7f1f23fff700 1 -- 172.21.15.84:0/4224640477 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f2415d0c0 con 0x7f1f240adea0 2023-07-14T11:14:58.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.748+0000 7f1f23fff700 1 --2- 172.21.15.84:0/4224640477 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f240adea0 0x7f1f2406c6c0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f1f2406f630 tx=0x7f1f1c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=446095a83081874c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:58.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.748+0000 7f1f227fc700 1 -- 172.21.15.84:0/4224640477 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f1c00bbc0 con 0x7f1f240adea0 2023-07-14T11:14:58.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.749+0000 7f1f227fc700 1 -- 172.21.15.84:0/4224640477 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f1c00bd20 con 0x7f1f240adea0 2023-07-14T11:14:58.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.749+0000 7f1f227fc700 1 -- 172.21.15.84:0/4224640477 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f1c0116a0 con 0x7f1f240adea0 2023-07-14T11:14:58.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.749+0000 7f1f2a1ff700 1 -- 172.21.15.84:0/4224640477 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f240adea0 msgr2=0x7f1f2406c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:58.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.749+0000 7f1f2a1ff700 1 --2- 172.21.15.84:0/4224640477 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f240adea0 0x7f1f2406c6c0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f1f2406f630 tx=0x7f1f1c00b330 comp rx=0 tx=0).stop 2023-07-14T11:14:58.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.749+0000 7f1f2a1ff700 1 -- 172.21.15.84:0/4224640477 shutdown_connections 2023-07-14T11:14:58.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.749+0000 7f1f2a1ff700 1 --2- 172.21.15.84:0/4224640477 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f240adea0 0x7f1f2406c6c0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:58.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.749+0000 7f1f2a1ff700 1 --2- 172.21.15.84:0/4224640477 >> v2:172.21.15.179:3300/0 conn(0x7f1f240c92d0 0x7f1f240ad8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:58.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.749+0000 7f1f2a1ff700 1 --2- 172.21.15.84:0/4224640477 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f240b12f0 0x7f1f240c96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:58.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.749+0000 7f1f2a1ff700 1 -- 172.21.15.84:0/4224640477 >> 172.21.15.84:0/4224640477 conn(0x7f1f240b05d0 msgr2=0x7f1f240b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:58.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.749+0000 7f1f2a1ff700 1 -- 172.21.15.84:0/4224640477 shutdown_connections 2023-07-14T11:14:58.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.749+0000 7f1f2a1ff700 1 -- 172.21.15.84:0/4224640477 wait complete. 2023-07-14T11:14:58.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.751+0000 7f1f2a1ff700 1 Processor -- start 2023-07-14T11:14:58.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.751+0000 7f1f2a1ff700 1 -- start start 2023-07-14T11:14:58.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.752+0000 7f1f2a1ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f240adea0 0x7f1f240c47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:58.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.752+0000 7f1f2a1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f240b12f0 0x7f1f240afd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:58.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.752+0000 7f1f2a1ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f240c92d0 0x7f1f24152e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:58.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.752+0000 7f1f2a1ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f24151670 con 0x7f1f240c92d0 2023-07-14T11:14:58.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.752+0000 7f1f2a1ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f24151dc0 con 0x7f1f240adea0 2023-07-14T11:14:58.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.752+0000 7f1f2a1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f241520a0 con 0x7f1f240b12f0 2023-07-14T11:14:58.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.752+0000 7f1f23fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f240c92d0 0x7f1f24152e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:58.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.752+0000 7f1f23fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f240c92d0 0x7f1f24152e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59104/0 (socket says 172.21.15.84:59104) 2023-07-14T11:14:58.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.752+0000 7f1f23fff700 1 -- 172.21.15.84:0/2146217198 learned_addr learned my addr 172.21.15.84:0/2146217198 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:58.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.753+0000 7f1f237fe700 1 --2- 172.21.15.84:0/2146217198 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f240adea0 0x7f1f240c47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:58.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.753+0000 7f1f22ffd700 1 --2- 172.21.15.84:0/2146217198 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f240b12f0 0x7f1f240afd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:58.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.753+0000 7f1f23fff700 1 -- 172.21.15.84:0/2146217198 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f240b12f0 msgr2=0x7f1f240afd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:58.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.753+0000 7f1f23fff700 1 --2- 172.21.15.84:0/2146217198 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f240b12f0 0x7f1f240afd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:58.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.753+0000 7f1f23fff700 1 -- 172.21.15.84:0/2146217198 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f240adea0 msgr2=0x7f1f240c47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:58.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.753+0000 7f1f23fff700 1 --2- 172.21.15.84:0/2146217198 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f240adea0 0x7f1f240c47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:58.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.753+0000 7f1f23fff700 1 -- 172.21.15.84:0/2146217198 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f1c009b30 con 0x7f1f240c92d0 2023-07-14T11:14:58.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.753+0000 7f1f23fff700 1 --2- 172.21.15.84:0/2146217198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f240c92d0 0x7f1f24152e60 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c014000 tx=0x7f1f1c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:58.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.753+0000 7f1f0bfff700 1 -- 172.21.15.84:0/2146217198 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f1c00cea0 con 0x7f1f240c92d0 2023-07-14T11:14:58.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.753+0000 7f1f0bfff700 1 -- 172.21.15.84:0/2146217198 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f1c004900 con 0x7f1f240c92d0 2023-07-14T11:14:58.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.753+0000 7f1f2a1ff700 1 -- 172.21.15.84:0/2146217198 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f24152380 con 0x7f1f240c92d0 2023-07-14T11:14:58.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.753+0000 7f1f0bfff700 1 -- 172.21.15.84:0/2146217198 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f1c0116a0 con 0x7f1f240c92d0 2023-07-14T11:14:58.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.753+0000 7f1f2a1ff700 1 -- 172.21.15.84:0/2146217198 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f24152940 con 0x7f1f240c92d0 2023-07-14T11:14:58.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.754+0000 7f1f2a1ff700 1 -- 172.21.15.84:0/2146217198 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f24074350 con 0x7f1f240c92d0 2023-07-14T11:14:58.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.755+0000 7f1f0bfff700 1 -- 172.21.15.84:0/2146217198 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 7) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f1f1c011800 con 0x7f1f240c92d0 2023-07-14T11:14:58.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.756+0000 7f1f0bfff700 1 --2- 172.21.15.84:0/2146217198 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1f1006ae90 0x7f1f1006d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:58.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.756+0000 7f1f0bfff700 1 -- 172.21.15.84:0/2146217198 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f1f1c08b0f0 con 0x7f1f240c92d0 2023-07-14T11:14:58.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.756+0000 7f1f237fe700 1 --2- 172.21.15.84:0/2146217198 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1f1006ae90 0x7f1f1006d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:58.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.757+0000 7f1f237fe700 1 --2- 172.21.15.84:0/2146217198 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1f1006ae90 0x7f1f1006d340 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1f1400b9b0 tx=0x7f1f14008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:58.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:58.761+0000 7f1f0bfff700 1 -- 172.21.15.84:0/2146217198 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f1f1c055e20 con 0x7f1f240c92d0 2023-07-14T11:14:59.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.000+0000 7f1f2a1ff700 1 -- 172.21.15.84:0/2146217198 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f1f240b4a40 con 0x7f1f240c92d0 2023-07-14T11:14:59.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.525+0000 7f1f0bfff700 1 -- 172.21.15.84:0/2146217198 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1f1c059440 con 0x7f1f240c92d0 2023-07-14T11:14:59.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.528+0000 7f1f2a1ff700 1 -- 172.21.15.84:0/2146217198 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1f1006ae90 msgr2=0x7f1f1006d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:59.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.528+0000 7f1f2a1ff700 1 --2- 172.21.15.84:0/2146217198 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1f1006ae90 0x7f1f1006d340 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1f1400b9b0 tx=0x7f1f14008040 comp rx=0 tx=0).stop 2023-07-14T11:14:59.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.528+0000 7f1f2a1ff700 1 -- 172.21.15.84:0/2146217198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f240c92d0 msgr2=0x7f1f24152e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:59.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.528+0000 7f1f2a1ff700 1 --2- 172.21.15.84:0/2146217198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f240c92d0 0x7f1f24152e60 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c014000 tx=0x7f1f1c004ad0 comp rx=0 tx=0).stop 2023-07-14T11:14:59.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.528+0000 7f1f2a1ff700 1 -- 172.21.15.84:0/2146217198 shutdown_connections 2023-07-14T11:14:59.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.528+0000 7f1f2a1ff700 1 --2- 172.21.15.84:0/2146217198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f240c92d0 0x7f1f24152e60 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:59.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.528+0000 7f1f2a1ff700 1 --2- 172.21.15.84:0/2146217198 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f240adea0 0x7f1f240c47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:59.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.528+0000 7f1f2a1ff700 1 --2- 172.21.15.84:0/2146217198 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1f1006ae90 0x7f1f1006d340 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:59.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.528+0000 7f1f2a1ff700 1 --2- 172.21.15.84:0/2146217198 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f240b12f0 0x7f1f240afd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:59.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.528+0000 7f1f2a1ff700 1 -- 172.21.15.84:0/2146217198 >> 172.21.15.84:0/2146217198 conn(0x7f1f240b05d0 msgr2=0x7f1f24070ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:59.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.528+0000 7f1f2a1ff700 1 -- 172.21.15.84:0/2146217198 shutdown_connections 2023-07-14T11:14:59.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.528+0000 7f1f2a1ff700 1 -- 172.21.15.84:0/2146217198 wait complete. 2023-07-14T11:14:59.549 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-14T11:14:59.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.748+0000 7f72bd3ff700 1 Processor -- start 2023-07-14T11:14:59.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.748+0000 7f72bd3ff700 1 -- start start 2023-07-14T11:14:59.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.750+0000 7f72bd3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72b815c890 0x7f72b80d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:59.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.750+0000 7f72bd3ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f72b80b2440 0x7f72b80d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:59.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.750+0000 7f72bd3ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72b815cc60 con 0x7f72b806c240 2023-07-14T11:14:59.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.750+0000 7f72bd3ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72b806a7f0 con 0x7f72b80b2440 2023-07-14T11:14:59.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.750+0000 7f72bd3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72b806b760 con 0x7f72b815c890 2023-07-14T11:14:59.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.750+0000 7f72affff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f72b80b2440 0x7f72b80d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:59.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.750+0000 7f72b77fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f72b806c240 0x7f72b80cf840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:39762/0 (socket says 172.21.15.84:39762) 2023-07-14T11:14:59.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.750+0000 7f72b77fe700 1 -- 172.21.15.84:0/62256973 learned_addr learned my addr 172.21.15.84:0/62256973 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:14:59.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.750+0000 7f72b6ffd700 1 --2- 172.21.15.84:0/62256973 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72b815c890 0x7f72b80d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:59.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.750+0000 7f72affff700 1 -- 172.21.15.84:0/62256973 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72b815c890 msgr2=0x7f72b80d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:14:59.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.750+0000 7f72affff700 1 --2- 172.21.15.84:0/62256973 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72b815c890 0x7f72b80d0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:59.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.750+0000 7f72affff700 1 -- 172.21.15.84:0/62256973 >> v1:172.21.15.84:6789/0 conn(0x7f72b806c240 legacy=0x7f72b80cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:59.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.750+0000 7f72affff700 1 -- 172.21.15.84:0/62256973 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b806ba40 con 0x7f72b80b2440 2023-07-14T11:14:59.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.750+0000 7f72b6ffd700 1 --2- 172.21.15.84:0/62256973 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72b815c890 0x7f72b80d0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:14:59.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.750+0000 7f72b67fc700 1 -- 172.21.15.84:0/62256973 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3730719034 0 0) 0x7f72b815cc60 con 0x7f72b806c240 2023-07-14T11:14:59.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.751+0000 7f72affff700 1 --2- 172.21.15.84:0/62256973 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72b80b2440 0x7f72b80d0f90 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f72a0009840 tx=0x7f72a0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45165df8ea8ea0cb server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:59.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.751+0000 7f72b67fc700 1 -- 172.21.15.84:0/62256973 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a0011830 con 0x7f72b80b2440 2023-07-14T11:14:59.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.751+0000 7f72b67fc700 1 -- 172.21.15.84:0/62256973 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72a0011990 con 0x7f72b80b2440 2023-07-14T11:14:59.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.751+0000 7f72b67fc700 1 -- 172.21.15.84:0/62256973 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a0011d20 con 0x7f72b80b2440 2023-07-14T11:14:59.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.751+0000 7f72bd3ff700 1 -- 172.21.15.84:0/62256973 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72b80b2440 msgr2=0x7f72b80d0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:59.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.751+0000 7f72bd3ff700 1 --2- 172.21.15.84:0/62256973 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72b80b2440 0x7f72b80d0f90 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f72a0009840 tx=0x7f72a0009b50 comp rx=0 tx=0).stop 2023-07-14T11:14:59.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.751+0000 7f72bd3ff700 1 -- 172.21.15.84:0/62256973 shutdown_connections 2023-07-14T11:14:59.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.751+0000 7f72bd3ff700 1 --2- 172.21.15.84:0/62256973 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72b815c890 0x7f72b80d0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:59.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.751+0000 7f72bd3ff700 1 --2- 172.21.15.84:0/62256973 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72b80b2440 0x7f72b80d0f90 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:59.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.751+0000 7f72bd3ff700 1 -- 172.21.15.84:0/62256973 >> 172.21.15.84:0/62256973 conn(0x7f72b809c170 msgr2=0x7f72b80d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:14:59.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.752+0000 7f72bd3ff700 1 -- 172.21.15.84:0/62256973 shutdown_connections 2023-07-14T11:14:59.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.752+0000 7f72bd3ff700 1 -- 172.21.15.84:0/62256973 wait complete. 2023-07-14T11:14:59.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.753+0000 7f72bd3ff700 1 Processor -- start 2023-07-14T11:14:59.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.753+0000 7f72bd3ff700 1 -- start start 2023-07-14T11:14:59.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.754+0000 7f72bd3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72b806c240 0x7f72b8156680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:59.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.754+0000 7f72bd3ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72b80b2440 0x7f72b80b86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:59.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.754+0000 7f72bd3ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f72b815c890 0x7f72b81492f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:59.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.754+0000 7f72bd3ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b8149830 con 0x7f72b80b2440 2023-07-14T11:14:59.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.754+0000 7f72bd3ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b80b8db0 con 0x7f72b815c890 2023-07-14T11:14:59.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.754+0000 7f72bd3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72b80b0700 con 0x7f72b806c240 2023-07-14T11:14:59.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.754+0000 7f72affff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72b80b2440 0x7f72b80b86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:59.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.755+0000 7f72affff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72b80b2440 0x7f72b80b86f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47998/0 (socket says 172.21.15.84:47998) 2023-07-14T11:14:59.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.755+0000 7f72affff700 1 -- 172.21.15.84:0/686514655 learned_addr learned my addr 172.21.15.84:0/686514655 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:14:59.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.755+0000 7f72b6ffd700 1 --2- 172.21.15.84:0/686514655 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72b806c240 0x7f72b8156680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:59.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.755+0000 7f72b77fe700 1 --2- 172.21.15.84:0/686514655 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f72b815c890 0x7f72b81492f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:59.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.755+0000 7f72affff700 1 -- 172.21.15.84:0/686514655 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72b806c240 msgr2=0x7f72b8156680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:59.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.755+0000 7f72affff700 1 --2- 172.21.15.84:0/686514655 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72b806c240 0x7f72b8156680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:59.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.755+0000 7f72affff700 1 -- 172.21.15.84:0/686514655 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f72b815c890 msgr2=0x7f72b81492f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:14:59.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.755+0000 7f72affff700 1 --2- 172.21.15.84:0/686514655 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f72b815c890 0x7f72b81492f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:14:59.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.755+0000 7f72affff700 1 -- 172.21.15.84:0/686514655 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72a00094a0 con 0x7f72b80b2440 2023-07-14T11:14:59.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.755+0000 7f72b6ffd700 1 --2- 172.21.15.84:0/686514655 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72b806c240 0x7f72b8156680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:14:59.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.755+0000 7f72b77fe700 1 --2- 172.21.15.84:0/686514655 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f72b815c890 0x7f72b81492f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:14:59.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.755+0000 7f72affff700 1 --2- 172.21.15.84:0/686514655 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72b80b2440 0x7f72b80b86f0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f72a0000c00 tx=0x7f72a0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:59.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.755+0000 7f72af7fe700 1 -- 172.21.15.84:0/686514655 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a00045f0 con 0x7f72b80b2440 2023-07-14T11:14:59.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.755+0000 7f72af7fe700 1 -- 172.21.15.84:0/686514655 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72a001f070 con 0x7f72b80b2440 2023-07-14T11:14:59.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.755+0000 7f72af7fe700 1 -- 172.21.15.84:0/686514655 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a0003ae0 con 0x7f72b80b2440 2023-07-14T11:14:59.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.755+0000 7f72bd3ff700 1 -- 172.21.15.84:0/686514655 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72b80b09e0 con 0x7f72b80b2440 2023-07-14T11:14:59.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.756+0000 7f72bd3ff700 1 -- 172.21.15.84:0/686514655 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72b814b560 con 0x7f72b80b2440 2023-07-14T11:14:59.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.757+0000 7f72bd3ff700 1 -- 172.21.15.84:0/686514655 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72b814b720 con 0x7f72b80b2440 2023-07-14T11:14:59.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.757+0000 7f72af7fe700 1 -- 172.21.15.84:0/686514655 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 7) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f72a0003c40 con 0x7f72b80b2440 2023-07-14T11:14:59.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.759+0000 7f72af7fe700 1 --2- 172.21.15.84:0/686514655 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f729806ae90 0x7f729806d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:14:59.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.759+0000 7f72af7fe700 1 -- 172.21.15.84:0/686514655 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f72a0021070 con 0x7f72b80b2440 2023-07-14T11:14:59.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.759+0000 7f72b6ffd700 1 --2- 172.21.15.84:0/686514655 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f729806ae90 0x7f729806d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:14:59.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.760+0000 7f72b6ffd700 1 --2- 172.21.15.84:0/686514655 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f729806ae90 0x7f729806d340 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f72a8006fd0 tx=0x7f72a8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:14:59.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.763+0000 7f72af7fe700 1 -- 172.21.15.84:0/686514655 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f72a00560e0 con 0x7f72b80b2440 2023-07-14T11:14:59.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:14:59.958+0000 7f72bd3ff700 1 -- 172.21.15.84:0/686514655 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f72b8074350 con 0x7f72b80b2440 2023-07-14T11:15:00.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:00.850+0000 7f72af7fe700 1 -- 172.21.15.84:0/686514655 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v41) v1 ==== 181+0+0 (secure 0 0 0) 0x7f72a0059700 con 0x7f72b80b2440 2023-07-14T11:15:00.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:00.854+0000 7f72bd3ff700 1 -- 172.21.15.84:0/686514655 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f729806ae90 msgr2=0x7f729806d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:00.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:00.854+0000 7f72bd3ff700 1 --2- 172.21.15.84:0/686514655 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f729806ae90 0x7f729806d340 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f72a8006fd0 tx=0x7f72a8008040 comp rx=0 tx=0).stop 2023-07-14T11:15:00.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:00.854+0000 7f72bd3ff700 1 -- 172.21.15.84:0/686514655 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72b80b2440 msgr2=0x7f72b80b86f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:00.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:00.854+0000 7f72bd3ff700 1 --2- 172.21.15.84:0/686514655 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72b80b2440 0x7f72b80b86f0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f72a0000c00 tx=0x7f72a0004750 comp rx=0 tx=0).stop 2023-07-14T11:15:00.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:00.855+0000 7f72bd3ff700 1 -- 172.21.15.84:0/686514655 shutdown_connections 2023-07-14T11:15:00.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:00.855+0000 7f72bd3ff700 1 --2- 172.21.15.84:0/686514655 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f729806ae90 0x7f729806d340 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:00.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:00.855+0000 7f72bd3ff700 1 --2- 172.21.15.84:0/686514655 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72b806c240 0x7f72b8156680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:00.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:00.855+0000 7f72bd3ff700 1 --2- 172.21.15.84:0/686514655 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f72b815c890 0x7f72b81492f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:00.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:00.855+0000 7f72bd3ff700 1 --2- 172.21.15.84:0/686514655 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72b80b2440 0x7f72b80b86f0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:00.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:00.855+0000 7f72bd3ff700 1 -- 172.21.15.84:0/686514655 >> 172.21.15.84:0/686514655 conn(0x7f72b809c170 msgr2=0x7f72b80b1450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:00.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:00.855+0000 7f72bd3ff700 1 -- 172.21.15.84:0/686514655 shutdown_connections 2023-07-14T11:15:00.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:00.855+0000 7f72bd3ff700 1 -- 172.21.15.84:0/686514655 wait complete. 2023-07-14T11:15:00.859 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_metadata' removed 2023-07-14T11:15:00.879 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-14T11:15:01.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.076+0000 7fe1685ff700 1 Processor -- start 2023-07-14T11:15:01.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.077+0000 7fe1685ff700 1 -- start start 2023-07-14T11:15:01.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.078+0000 7fe1685ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1600d1160 0x7fe1600cd4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:01.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.078+0000 7fe1685ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe16015cc60 con 0x7fe16015c890 2023-07-14T11:15:01.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.078+0000 7fe1685ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe16006a7f0 con 0x7fe1600b2440 2023-07-14T11:15:01.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.078+0000 7fe1685ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe16006b760 con 0x7fe1600d1160 2023-07-14T11:15:01.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.078+0000 7fe16639b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fe16015c890 0x7fe1600d0a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:39764/0 (socket says 172.21.15.84:39764) 2023-07-14T11:15:01.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.078+0000 7fe16639b700 1 -- 172.21.15.84:0/3932202686 learned_addr learned my addr 172.21.15.84:0/3932202686 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:15:01.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.078+0000 7fe165b9a700 1 --2- 172.21.15.84:0/3932202686 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1600d1160 0x7fe1600cd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:01.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.079+0000 7fe165399700 1 -- 172.21.15.84:0/3932202686 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1311270258 0 0) 0x7fe16015cc60 con 0x7fe16015c890 2023-07-14T11:15:01.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.079+0000 7fe165399700 1 -- 172.21.15.84:0/3932202686 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe14c0035b0 con 0x7fe16015c890 2023-07-14T11:15:01.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.079+0000 7fe165399700 1 -- 172.21.15.84:0/3932202686 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 998281218 0 0) 0x7fe16006a7f0 con 0x7fe1600b2440 2023-07-14T11:15:01.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.079+0000 7fe165399700 1 -- 172.21.15.84:0/3932202686 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe16015cc60 con 0x7fe1600b2440 2023-07-14T11:15:01.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.079+0000 7fe165399700 1 -- 172.21.15.84:0/3932202686 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 24155329 0 0) 0x7fe14c0035b0 con 0x7fe16015c890 2023-07-14T11:15:01.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.079+0000 7fe165399700 1 -- 172.21.15.84:0/3932202686 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1600d1160 msgr2=0x7fe1600cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:01.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.079+0000 7fe165399700 1 --2- 172.21.15.84:0/3932202686 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1600d1160 0x7fe1600cd4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:01.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.079+0000 7fe165399700 1 -- 172.21.15.84:0/3932202686 >> v1:172.21.15.179:6789/0 conn(0x7fe1600b2440 legacy=0x7fe1600cda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:01.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.079+0000 7fe165399700 1 -- 172.21.15.84:0/3932202686 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe16006ba40 con 0x7fe16015c890 2023-07-14T11:15:01.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.079+0000 7fe165399700 1 -- 172.21.15.84:0/3932202686 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7fe15c001670 con 0x7fe16015c890 2023-07-14T11:15:01.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.079+0000 7fe165399700 1 -- 172.21.15.84:0/3932202686 >> v1:172.21.15.84:6789/0 conn(0x7fe16015c890 legacy=0x7fe1600d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:01.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.079+0000 7fe165399700 1 --2- 172.21.15.84:0/3932202686 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe14c003c80 0x7fe14c004070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:01.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.079+0000 7fe165399700 1 --2- 172.21.15.84:0/3932202686 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe14c004850 0x7fe14c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:01.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.079+0000 7fe165399700 1 --2- 172.21.15.84:0/3932202686 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1600d1160 0x7fe14c0052b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:01.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.079+0000 7fe165399700 1 -- 172.21.15.84:0/3932202686 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe16006b760 con 0x7fe14c004850 2023-07-14T11:15:01.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.079+0000 7fe165399700 1 -- 172.21.15.84:0/3932202686 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe14c00bba0 con 0x7fe14c003c80 2023-07-14T11:15:01.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.079+0000 7fe165399700 1 -- 172.21.15.84:0/3932202686 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe14c00bd60 con 0x7fe1600d1160 2023-07-14T11:15:01.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.079+0000 7fe165b9a700 1 --2- 172.21.15.84:0/3932202686 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe14c004850 0x7fe14c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:01.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.079+0000 7fe16639b700 1 --2- 172.21.15.84:0/3932202686 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe14c003c80 0x7fe14c004070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:01.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.079+0000 7fe166b9c700 1 --2- 172.21.15.84:0/3932202686 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1600d1160 0x7fe14c0052b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:01.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.080+0000 7fe165b9a700 1 -- 172.21.15.84:0/3932202686 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1600d1160 msgr2=0x7fe14c0052b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:01.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.080+0000 7fe165b9a700 1 --2- 172.21.15.84:0/3932202686 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1600d1160 0x7fe14c0052b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:01.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.080+0000 7fe165b9a700 1 -- 172.21.15.84:0/3932202686 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe14c003c80 msgr2=0x7fe14c004070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:01.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.080+0000 7fe165b9a700 1 --2- 172.21.15.84:0/3932202686 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe14c003c80 0x7fe14c004070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:01.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.080+0000 7fe165b9a700 1 -- 172.21.15.84:0/3932202686 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe14c0035b0 con 0x7fe14c004850 2023-07-14T11:15:01.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.080+0000 7fe165b9a700 1 --2- 172.21.15.84:0/3932202686 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe14c004850 0x7fe14c004cc0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fe150009b30 tx=0x7fe14c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54e6ac9c150316c7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:01.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.080+0000 7fe165399700 1 -- 172.21.15.84:0/3932202686 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe15000e6c0 con 0x7fe14c004850 2023-07-14T11:15:01.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.080+0000 7fe165399700 1 -- 172.21.15.84:0/3932202686 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe15000e820 con 0x7fe14c004850 2023-07-14T11:15:01.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.080+0000 7fe165399700 1 -- 172.21.15.84:0/3932202686 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe15000eb90 con 0x7fe14c004850 2023-07-14T11:15:01.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.081+0000 7fe1685ff700 1 -- 172.21.15.84:0/3932202686 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe14c004850 msgr2=0x7fe14c004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:01.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.081+0000 7fe1685ff700 1 --2- 172.21.15.84:0/3932202686 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe14c004850 0x7fe14c004cc0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fe150009b30 tx=0x7fe14c005880 comp rx=0 tx=0).stop 2023-07-14T11:15:01.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.081+0000 7fe166b9c700 1 -- 172.21.15.84:0/3932202686 reap_dead start 2023-07-14T11:15:01.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.081+0000 7fe1685ff700 1 -- 172.21.15.84:0/3932202686 shutdown_connections 2023-07-14T11:15:01.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.081+0000 7fe1685ff700 1 -- 172.21.15.84:0/3932202686 >> 172.21.15.84:0/3932202686 conn(0x7fe16009c170 msgr2=0x7fe1600d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:01.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.081+0000 7fe1685ff700 1 -- 172.21.15.84:0/3932202686 shutdown_connections 2023-07-14T11:15:01.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.081+0000 7fe1685ff700 1 -- 172.21.15.84:0/3932202686 wait complete. 2023-07-14T11:15:01.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.083+0000 7fe1685ff700 1 Processor -- start 2023-07-14T11:15:01.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.083+0000 7fe1685ff700 1 -- start start 2023-07-14T11:15:01.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.085+0000 7fe1685ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe14c004850 0x7fe160158c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:01.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.085+0000 7fe1685ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe160159190 0x7fe16015a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:01.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.085+0000 7fe1685ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe16015aee0 0x7fe16015b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:01.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.085+0000 7fe1685ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe16015f810 con 0x7fe14c004850 2023-07-14T11:15:01.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.085+0000 7fe1685ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1600c9790 con 0x7fe16015aee0 2023-07-14T11:15:01.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.085+0000 7fe1685ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe16015ec90 con 0x7fe160159190 2023-07-14T11:15:01.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.085+0000 7fe16639b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe14c004850 0x7fe160158c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:01.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.085+0000 7fe16639b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe14c004850 0x7fe160158c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48026/0 (socket says 172.21.15.84:48026) 2023-07-14T11:15:01.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.085+0000 7fe16639b700 1 -- 172.21.15.84:0/3154189158 learned_addr learned my addr 172.21.15.84:0/3154189158 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:01.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.085+0000 7fe16639b700 1 -- 172.21.15.84:0/3154189158 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe160159190 msgr2=0x7fe16015a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:01.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.085+0000 7fe165b9a700 1 --2- 172.21.15.84:0/3154189158 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe160159190 0x7fe16015a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:01.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.085+0000 7fe166b9c700 1 --2- 172.21.15.84:0/3154189158 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe16015aee0 0x7fe16015b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:01.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.085+0000 7fe16639b700 1 --2- 172.21.15.84:0/3154189158 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe160159190 0x7fe16015a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:01.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.085+0000 7fe16639b700 1 -- 172.21.15.84:0/3154189158 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe16015aee0 msgr2=0x7fe16015b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:01.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.085+0000 7fe16639b700 1 --2- 172.21.15.84:0/3154189158 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe16015aee0 0x7fe16015b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:01.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.085+0000 7fe16639b700 1 -- 172.21.15.84:0/3154189158 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe16015ef70 con 0x7fe14c004850 2023-07-14T11:15:01.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.085+0000 7fe165b9a700 1 --2- 172.21.15.84:0/3154189158 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe160159190 0x7fe16015a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:15:01.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.085+0000 7fe166b9c700 1 --2- 172.21.15.84:0/3154189158 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe16015aee0 0x7fe16015b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:15:01.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.086+0000 7fe16639b700 1 --2- 172.21.15.84:0/3154189158 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe14c004850 0x7fe160158c50 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fe15c0072c0 tx=0x7fe15c0075d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:01.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.086+0000 7fe156ffd700 1 -- 172.21.15.84:0/3154189158 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe15c00f6c0 con 0x7fe14c004850 2023-07-14T11:15:01.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.086+0000 7fe156ffd700 1 -- 172.21.15.84:0/3154189158 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe15c00f820 con 0x7fe14c004850 2023-07-14T11:15:01.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.086+0000 7fe1685ff700 1 -- 172.21.15.84:0/3154189158 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe16015f250 con 0x7fe14c004850 2023-07-14T11:15:01.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.086+0000 7fe156ffd700 1 -- 172.21.15.84:0/3154189158 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe15c00fbd0 con 0x7fe14c004850 2023-07-14T11:15:01.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.086+0000 7fe1685ff700 1 -- 172.21.15.84:0/3154189158 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe16015e880 con 0x7fe14c004850 2023-07-14T11:15:01.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.087+0000 7fe1685ff700 1 -- 172.21.15.84:0/3154189158 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe16015ea40 con 0x7fe14c004850 2023-07-14T11:15:01.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.088+0000 7fe156ffd700 1 -- 172.21.15.84:0/3154189158 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 7) v1 ==== 89190+0+0 (secure 0 0 0) 0x7fe15c00fd30 con 0x7fe14c004850 2023-07-14T11:15:01.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.089+0000 7fe156ffd700 1 --2- 172.21.15.84:0/3154189158 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe14406ae90 0x7fe14406d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:01.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.089+0000 7fe156ffd700 1 -- 172.21.15.84:0/3154189158 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5739+0+0 (secure 0 0 0) 0x7fe15c089630 con 0x7fe14c004850 2023-07-14T11:15:01.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.089+0000 7fe165b9a700 1 --2- 172.21.15.84:0/3154189158 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe14406ae90 0x7fe14406d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:01.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.090+0000 7fe165b9a700 1 --2- 172.21.15.84:0/3154189158 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe14406ae90 0x7fe14406d340 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe1500090b0 tx=0x7fe150008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:01.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.093+0000 7fe156ffd700 1 -- 172.21.15.84:0/3154189158 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe15c054650 con 0x7fe14c004850 2023-07-14T11:15:01.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.290+0000 7fe1685ff700 1 -- 172.21.15.84:0/3154189158 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe160074350 con 0x7fe14c004850 2023-07-14T11:15:01.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.851+0000 7fe156ffd700 1 -- 172.21.15.84:0/3154189158 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v42) v1 ==== 169+0+0 (secure 0 0 0) 0x7fe15c057c70 con 0x7fe14c004850 2023-07-14T11:15:01.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.854+0000 7fe1685ff700 1 -- 172.21.15.84:0/3154189158 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe14406ae90 msgr2=0x7fe14406d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:01.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.854+0000 7fe1685ff700 1 --2- 172.21.15.84:0/3154189158 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe14406ae90 0x7fe14406d340 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe1500090b0 tx=0x7fe150008030 comp rx=0 tx=0).stop 2023-07-14T11:15:01.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.854+0000 7fe1685ff700 1 -- 172.21.15.84:0/3154189158 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe14c004850 msgr2=0x7fe160158c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:01.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.854+0000 7fe1685ff700 1 --2- 172.21.15.84:0/3154189158 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe14c004850 0x7fe160158c50 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fe15c0072c0 tx=0x7fe15c0075d0 comp rx=0 tx=0).stop 2023-07-14T11:15:01.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.854+0000 7fe1685ff700 1 -- 172.21.15.84:0/3154189158 shutdown_connections 2023-07-14T11:15:01.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.854+0000 7fe1685ff700 1 --2- 172.21.15.84:0/3154189158 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe16015aee0 0x7fe16015b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:01.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.854+0000 7fe1685ff700 1 --2- 172.21.15.84:0/3154189158 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe14c004850 0x7fe160158c50 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:01.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.854+0000 7fe1685ff700 1 --2- 172.21.15.84:0/3154189158 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe14406ae90 0x7fe14406d340 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:01.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.854+0000 7fe1685ff700 1 --2- 172.21.15.84:0/3154189158 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe160159190 0x7fe16015a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:01.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.854+0000 7fe1685ff700 1 -- 172.21.15.84:0/3154189158 >> 172.21.15.84:0/3154189158 conn(0x7fe16009c170 msgr2=0x7fe1600d0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:01.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.855+0000 7fe1685ff700 1 -- 172.21.15.84:0/3154189158 shutdown_connections 2023-07-14T11:15:01.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:01.855+0000 7fe1685ff700 1 -- 172.21.15.84:0/3154189158 wait complete. 2023-07-14T11:15:01.859 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data' removed 2023-07-14T11:15:01.878 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-14T11:15:02.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.080+0000 7fc88dbff700 1 Processor -- start 2023-07-14T11:15:02.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.080+0000 7fc88dbff700 1 -- start start 2023-07-14T11:15:02.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.081+0000 7fc88dbff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc8880b8660 0x7fc8880cd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:02.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.082+0000 7fc88dbff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8880d02a0 con 0x7fc8880cd970 2023-07-14T11:15:02.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.082+0000 7fc88dbff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8880cfce0 con 0x7fc8880b4f70 2023-07-14T11:15:02.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.082+0000 7fc88dbff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8880cffc0 con 0x7fc8880b8660 2023-07-14T11:15:02.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.082+0000 7fc8877fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc8880b8660 0x7fc8880cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:02.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.082+0000 7fc886ffd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fc8880cd970 0x7fc8880b4860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:39776/0 (socket says 172.21.15.84:39776) 2023-07-14T11:15:02.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.082+0000 7fc886ffd700 1 -- 172.21.15.84:0/2868646165 learned_addr learned my addr 172.21.15.84:0/2868646165 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:15:02.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.082+0000 7fc8877fe700 1 -- 172.21.15.84:0/2868646165 >> v1:172.21.15.179:6789/0 conn(0x7fc8880b4f70 legacy=0x7fc8880d12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:02.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.082+0000 7fc8877fe700 1 -- 172.21.15.84:0/2868646165 >> v1:172.21.15.84:6789/0 conn(0x7fc8880cd970 legacy=0x7fc8880b4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:02.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.082+0000 7fc8877fe700 1 -- 172.21.15.84:0/2868646165 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8880d0ac0 con 0x7fc8880b8660 2023-07-14T11:15:02.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.082+0000 7fc8867fc700 1 -- 172.21.15.84:0/2868646165 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1260255161 0 0) 0x7fc8880d02a0 con 0x7fc8880cd970 2023-07-14T11:15:02.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.083+0000 7fc8877fe700 1 --2- 172.21.15.84:0/2868646165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8880b8660 0x7fc8880cd430 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fc878009840 tx=0x7fc878009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d1e3fd06568907a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:02.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.083+0000 7fc8867fc700 1 -- 172.21.15.84:0/2868646165 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc878011830 con 0x7fc8880b8660 2023-07-14T11:15:02.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.083+0000 7fc8867fc700 1 -- 172.21.15.84:0/2868646165 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc878011990 con 0x7fc8880b8660 2023-07-14T11:15:02.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.083+0000 7fc8867fc700 1 -- 172.21.15.84:0/2868646165 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc878011d20 con 0x7fc8880b8660 2023-07-14T11:15:02.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.083+0000 7fc88dbff700 1 -- 172.21.15.84:0/2868646165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8880b8660 msgr2=0x7fc8880cd430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:02.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.083+0000 7fc88dbff700 1 --2- 172.21.15.84:0/2868646165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8880b8660 0x7fc8880cd430 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fc878009840 tx=0x7fc878009b50 comp rx=0 tx=0).stop 2023-07-14T11:15:02.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.083+0000 7fc88dbff700 1 -- 172.21.15.84:0/2868646165 shutdown_connections 2023-07-14T11:15:02.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.083+0000 7fc88dbff700 1 --2- 172.21.15.84:0/2868646165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8880b8660 0x7fc8880cd430 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:02.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.083+0000 7fc88dbff700 1 -- 172.21.15.84:0/2868646165 >> 172.21.15.84:0/2868646165 conn(0x7fc888066860 msgr2=0x7fc88806a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:02.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.084+0000 7fc88dbff700 1 -- 172.21.15.84:0/2868646165 shutdown_connections 2023-07-14T11:15:02.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.084+0000 7fc88dbff700 1 -- 172.21.15.84:0/2868646165 wait complete. 2023-07-14T11:15:02.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.085+0000 7fc88dbff700 1 Processor -- start 2023-07-14T11:15:02.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.085+0000 7fc88dbff700 1 -- start start 2023-07-14T11:15:02.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.086+0000 7fc88dbff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8880b4f70 0x7fc888159480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:02.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.086+0000 7fc88dbff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8880b8660 0x7fc888152200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:02.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.086+0000 7fc88dbff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8880cd970 0x7fc8880cb240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:02.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.086+0000 7fc88dbff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc888158190 con 0x7fc8880cd970 2023-07-14T11:15:02.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.086+0000 7fc88dbff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8881583e0 con 0x7fc8880b8660 2023-07-14T11:15:02.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.086+0000 7fc88dbff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8881586c0 con 0x7fc8880b4f70 2023-07-14T11:15:02.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.086+0000 7fc887fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8880cd970 0x7fc8880cb240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:02.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.086+0000 7fc887fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8880cd970 0x7fc8880cb240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48050/0 (socket says 172.21.15.84:48050) 2023-07-14T11:15:02.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.086+0000 7fc887fff700 1 -- 172.21.15.84:0/2388842311 learned_addr learned my addr 172.21.15.84:0/2388842311 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:02.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.087+0000 7fc8877fe700 1 --2- 172.21.15.84:0/2388842311 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8880b4f70 0x7fc888159480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:02.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.087+0000 7fc886ffd700 1 --2- 172.21.15.84:0/2388842311 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8880b8660 0x7fc888152200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:02.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.087+0000 7fc887fff700 1 -- 172.21.15.84:0/2388842311 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8880b4f70 msgr2=0x7fc888159480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:02.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.087+0000 7fc887fff700 1 --2- 172.21.15.84:0/2388842311 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8880b4f70 0x7fc888159480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:02.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.087+0000 7fc887fff700 1 -- 172.21.15.84:0/2388842311 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8880b8660 msgr2=0x7fc888152200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:02.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.087+0000 7fc887fff700 1 --2- 172.21.15.84:0/2388842311 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8880b8660 0x7fc888152200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:02.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.087+0000 7fc887fff700 1 -- 172.21.15.84:0/2388842311 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8780094a0 con 0x7fc8880cd970 2023-07-14T11:15:02.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.087+0000 7fc887fff700 1 --2- 172.21.15.84:0/2388842311 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8880cd970 0x7fc8880cb240 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fc88000cbc0 tx=0x7fc88000cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:02.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.087+0000 7fc86ffff700 1 -- 172.21.15.84:0/2388842311 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc880003c00 con 0x7fc8880cd970 2023-07-14T11:15:02.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.087+0000 7fc86ffff700 1 -- 172.21.15.84:0/2388842311 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc880003d60 con 0x7fc8880cd970 2023-07-14T11:15:02.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.087+0000 7fc88dbff700 1 -- 172.21.15.84:0/2388842311 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8881589a0 con 0x7fc8880cd970 2023-07-14T11:15:02.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.087+0000 7fc86ffff700 1 -- 172.21.15.84:0/2388842311 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc88000abf0 con 0x7fc8880cd970 2023-07-14T11:15:02.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.088+0000 7fc88dbff700 1 -- 172.21.15.84:0/2388842311 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc888158f60 con 0x7fc8880cd970 2023-07-14T11:15:02.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.089+0000 7fc88dbff700 1 -- 172.21.15.84:0/2388842311 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8881599c0 con 0x7fc8880cd970 2023-07-14T11:15:02.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.089+0000 7fc86ffff700 1 -- 172.21.15.84:0/2388842311 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 7) v1 ==== 89190+0+0 (secure 0 0 0) 0x7fc88000ad50 con 0x7fc8880cd970 2023-07-14T11:15:02.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.090+0000 7fc86ffff700 1 --2- 172.21.15.84:0/2388842311 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc87406ae90 0x7fc87406d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:02.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.090+0000 7fc86ffff700 1 -- 172.21.15.84:0/2388842311 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fc880089570 con 0x7fc8880cd970 2023-07-14T11:15:02.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.091+0000 7fc8877fe700 1 --2- 172.21.15.84:0/2388842311 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc87406ae90 0x7fc87406d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:02.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.091+0000 7fc8877fe700 1 --2- 172.21.15.84:0/2388842311 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc87406ae90 0x7fc87406d340 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc878000c00 tx=0x7fc87801c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:02.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.095+0000 7fc86ffff700 1 -- 172.21.15.84:0/2388842311 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fc8800546b0 con 0x7fc8880cd970 2023-07-14T11:15:02.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.291+0000 7fc88dbff700 1 -- 172.21.15.84:0/2388842311 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fc888159150 con 0x7fc8880cd970 2023-07-14T11:15:02.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.295+0000 7fc86ffff700 1 -- 172.21.15.84:0/2388842311 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc880057cd0 con 0x7fc8880cd970 2023-07-14T11:15:02.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.297+0000 7fc88dbff700 1 -- 172.21.15.84:0/2388842311 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc87406ae90 msgr2=0x7fc87406d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:02.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.297+0000 7fc88dbff700 1 --2- 172.21.15.84:0/2388842311 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc87406ae90 0x7fc87406d340 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc878000c00 tx=0x7fc87801c040 comp rx=0 tx=0).stop 2023-07-14T11:15:02.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.297+0000 7fc88dbff700 1 -- 172.21.15.84:0/2388842311 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8880cd970 msgr2=0x7fc8880cb240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:02.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.297+0000 7fc88dbff700 1 --2- 172.21.15.84:0/2388842311 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8880cd970 0x7fc8880cb240 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fc88000cbc0 tx=0x7fc88000cf80 comp rx=0 tx=0).stop 2023-07-14T11:15:02.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.297+0000 7fc88dbff700 1 -- 172.21.15.84:0/2388842311 shutdown_connections 2023-07-14T11:15:02.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.297+0000 7fc88dbff700 1 --2- 172.21.15.84:0/2388842311 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc87406ae90 0x7fc87406d340 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:02.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.297+0000 7fc88dbff700 1 --2- 172.21.15.84:0/2388842311 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8880b4f70 0x7fc888159480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:02.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.297+0000 7fc88dbff700 1 --2- 172.21.15.84:0/2388842311 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8880cd970 0x7fc8880cb240 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:02.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.297+0000 7fc88dbff700 1 --2- 172.21.15.84:0/2388842311 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8880b8660 0x7fc888152200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:02.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.297+0000 7fc88dbff700 1 -- 172.21.15.84:0/2388842311 >> 172.21.15.84:0/2388842311 conn(0x7fc888066860 msgr2=0x7fc8880d1920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:02.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.298+0000 7fc88dbff700 1 -- 172.21.15.84:0/2388842311 shutdown_connections 2023-07-14T11:15:02.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.298+0000 7fc88dbff700 1 -- 172.21.15.84:0/2388842311 wait complete. 2023-07-14T11:15:02.318 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade' 2023-07-14T11:15:02.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.517+0000 7fc78bfff700 1 Processor -- start 2023-07-14T11:15:02.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.517+0000 7fc78bfff700 1 -- start start 2023-07-14T11:15:02.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.519+0000 7fc78bfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc78415cb50 0x7fc78406f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:02.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.519+0000 7fc78bfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc7840b39c0 0x7fc78406c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:02.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.519+0000 7fc78bfff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7840707a0 con 0x7fc78406c690 2023-07-14T11:15:02.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.519+0000 7fc78bfff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7840cb650 con 0x7fc7840b39c0 2023-07-14T11:15:02.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.519+0000 7fc78bfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc78406cb10 con 0x7fc78415cb50 2023-07-14T11:15:02.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.519+0000 7fc78959a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc7840b39c0 0x7fc78406c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:02.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.519+0000 7fc78a59c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fc78406c690 0x7fc78415d0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:39784/0 (socket says 172.21.15.84:39784) 2023-07-14T11:15:02.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.519+0000 7fc78959a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc7840b39c0 0x7fc78406c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48062/0 (socket says 172.21.15.84:48062) 2023-07-14T11:15:02.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.519+0000 7fc78a59c700 1 -- 172.21.15.84:0/4163542338 learned_addr learned my addr 172.21.15.84:0/4163542338 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:15:02.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.519+0000 7fc789d9b700 1 --2- 172.21.15.84:0/4163542338 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc78415cb50 0x7fc78406f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:02.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.520+0000 7fc78959a700 1 -- 172.21.15.84:0/4163542338 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc78415cb50 msgr2=0x7fc78406f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:02.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.520+0000 7fc78959a700 1 --2- 172.21.15.84:0/4163542338 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc78415cb50 0x7fc78406f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:02.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.520+0000 7fc78959a700 1 -- 172.21.15.84:0/4163542338 >> v1:172.21.15.84:6789/0 conn(0x7fc78406c690 legacy=0x7fc78415d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:02.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.520+0000 7fc78959a700 1 -- 172.21.15.84:0/4163542338 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7840ce190 con 0x7fc7840b39c0 2023-07-14T11:15:02.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.520+0000 7fc788d99700 1 -- 172.21.15.84:0/4163542338 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2798453859 0 0) 0x7fc7840707a0 con 0x7fc78406c690 2023-07-14T11:15:02.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.520+0000 7fc78959a700 1 --2- 172.21.15.84:0/4163542338 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7840b39c0 0x7fc78406c150 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fc774009840 tx=0x7fc774009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faffba55ea49b275 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:02.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.520+0000 7fc788d99700 1 -- 172.21.15.84:0/4163542338 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc774011830 con 0x7fc7840b39c0 2023-07-14T11:15:02.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.520+0000 7fc788d99700 1 -- 172.21.15.84:0/4163542338 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc774011990 con 0x7fc7840b39c0 2023-07-14T11:15:02.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.520+0000 7fc788d99700 1 -- 172.21.15.84:0/4163542338 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc774011d20 con 0x7fc7840b39c0 2023-07-14T11:15:02.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.521+0000 7fc78bfff700 1 -- 172.21.15.84:0/4163542338 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7840b39c0 msgr2=0x7fc78406c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:02.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.521+0000 7fc78bfff700 1 --2- 172.21.15.84:0/4163542338 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7840b39c0 0x7fc78406c150 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fc774009840 tx=0x7fc774009b50 comp rx=0 tx=0).stop 2023-07-14T11:15:02.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.521+0000 7fc78bfff700 1 -- 172.21.15.84:0/4163542338 shutdown_connections 2023-07-14T11:15:02.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.521+0000 7fc78bfff700 1 --2- 172.21.15.84:0/4163542338 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc78415cb50 0x7fc78406f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:02.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.521+0000 7fc78bfff700 1 --2- 172.21.15.84:0/4163542338 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7840b39c0 0x7fc78406c150 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:02.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.521+0000 7fc78bfff700 1 -- 172.21.15.84:0/4163542338 >> 172.21.15.84:0/4163542338 conn(0x7fc78406ab70 msgr2=0x7fc7840b05d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:02.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.521+0000 7fc78bfff700 1 -- 172.21.15.84:0/4163542338 shutdown_connections 2023-07-14T11:15:02.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.521+0000 7fc78bfff700 1 -- 172.21.15.84:0/4163542338 wait complete. 2023-07-14T11:15:02.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.523+0000 7fc78bfff700 1 Processor -- start 2023-07-14T11:15:02.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.523+0000 7fc78bfff700 1 -- start start 2023-07-14T11:15:02.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.524+0000 7fc78bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc78406c690 0x7fc7841599f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:02.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.524+0000 7fc78bfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc7840b39c0 0x7fc784144e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:02.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.524+0000 7fc78bfff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc78415cb50 0x7fc7841453c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:02.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.524+0000 7fc78bfff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7841efba0 con 0x7fc78406c690 2023-07-14T11:15:02.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.524+0000 7fc78bfff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7841eef20 con 0x7fc78415cb50 2023-07-14T11:15:02.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.524+0000 7fc78bfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7841ef200 con 0x7fc7840b39c0 2023-07-14T11:15:02.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.524+0000 7fc789d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc78406c690 0x7fc7841599f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:02.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.524+0000 7fc789d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc78406c690 0x7fc7841599f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48072/0 (socket says 172.21.15.84:48072) 2023-07-14T11:15:02.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.524+0000 7fc789d9b700 1 -- 172.21.15.84:0/5854486 learned_addr learned my addr 172.21.15.84:0/5854486 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:02.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.524+0000 7fc789d9b700 1 -- 172.21.15.84:0/5854486 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc7840b39c0 msgr2=0x7fc784144e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:02.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.524+0000 7fc789d9b700 1 --2- 172.21.15.84:0/5854486 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc7840b39c0 0x7fc784144e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:02.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.524+0000 7fc789d9b700 1 -- 172.21.15.84:0/5854486 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc78415cb50 msgr2=0x7fc7841453c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:02.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.524+0000 7fc789d9b700 1 --2- 172.21.15.84:0/5854486 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc78415cb50 0x7fc7841453c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:02.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.524+0000 7fc789d9b700 1 -- 172.21.15.84:0/5854486 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7740094a0 con 0x7fc78406c690 2023-07-14T11:15:02.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.524+0000 7fc789d9b700 1 --2- 172.21.15.84:0/5854486 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc78406c690 0x7fc7841599f0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fc78000e9b0 tx=0x7fc78000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:02.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.525+0000 7fc77a7fc700 1 -- 172.21.15.84:0/5854486 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc780009710 con 0x7fc78406c690 2023-07-14T11:15:02.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.525+0000 7fc77a7fc700 1 -- 172.21.15.84:0/5854486 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc78000c850 con 0x7fc78406c690 2023-07-14T11:15:02.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.525+0000 7fc77a7fc700 1 -- 172.21.15.84:0/5854486 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc78000cbc0 con 0x7fc78406c690 2023-07-14T11:15:02.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.525+0000 7fc78bfff700 1 -- 172.21.15.84:0/5854486 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7841ef4e0 con 0x7fc78406c690 2023-07-14T11:15:02.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.525+0000 7fc78bfff700 1 -- 172.21.15.84:0/5854486 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc784145900 con 0x7fc78406c690 2023-07-14T11:15:02.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.526+0000 7fc78bfff700 1 -- 172.21.15.84:0/5854486 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc784070160 con 0x7fc78406c690 2023-07-14T11:15:02.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.527+0000 7fc77a7fc700 1 -- 172.21.15.84:0/5854486 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 7) v1 ==== 89190+0+0 (secure 0 0 0) 0x7fc78000cd20 con 0x7fc78406c690 2023-07-14T11:15:02.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.528+0000 7fc77a7fc700 1 --2- 172.21.15.84:0/5854486 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc76806ae90 0x7fc76806d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:02.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.528+0000 7fc77a7fc700 1 -- 172.21.15.84:0/5854486 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fc7800895a0 con 0x7fc78406c690 2023-07-14T11:15:02.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.528+0000 7fc78959a700 1 --2- 172.21.15.84:0/5854486 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc76806ae90 0x7fc76806d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:02.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.528+0000 7fc78959a700 1 --2- 172.21.15.84:0/5854486 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc76806ae90 0x7fc76806d340 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc7740090b0 tx=0x7fc774010000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:02.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.532+0000 7fc77a7fc700 1 -- 172.21.15.84:0/5854486 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fc7800546e0 con 0x7fc78406c690 2023-07-14T11:15:02.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.807+0000 7fc78bfff700 1 -- 172.21.15.84:0/5854486 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade"]} v 0) v1 -- 0x7fc784074350 con 0x7fc78406c690 2023-07-14T11:15:02.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.869+0000 7fc77a7fc700 1 -- 172.21.15.84:0/5854486 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade"]}]=0 v127) v1 ==== 158+0+0 (secure 0 0 0) 0x7fc780057d00 con 0x7fc78406c690 2023-07-14T11:15:02.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.871+0000 7fc78bfff700 1 -- 172.21.15.84:0/5854486 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc76806ae90 msgr2=0x7fc76806d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:02.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.871+0000 7fc78bfff700 1 --2- 172.21.15.84:0/5854486 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc76806ae90 0x7fc76806d340 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc7740090b0 tx=0x7fc774010000 comp rx=0 tx=0).stop 2023-07-14T11:15:02.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.871+0000 7fc78bfff700 1 -- 172.21.15.84:0/5854486 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc78406c690 msgr2=0x7fc7841599f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:02.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.871+0000 7fc78bfff700 1 --2- 172.21.15.84:0/5854486 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc78406c690 0x7fc7841599f0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fc78000e9b0 tx=0x7fc78000ed70 comp rx=0 tx=0).stop 2023-07-14T11:15:02.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.872+0000 7fc78bfff700 1 -- 172.21.15.84:0/5854486 shutdown_connections 2023-07-14T11:15:02.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.872+0000 7fc78bfff700 1 --2- 172.21.15.84:0/5854486 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc78415cb50 0x7fc7841453c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:02.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.872+0000 7fc78bfff700 1 --2- 172.21.15.84:0/5854486 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc78406c690 0x7fc7841599f0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:02.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.872+0000 7fc78bfff700 1 --2- 172.21.15.84:0/5854486 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc76806ae90 0x7fc76806d340 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:02.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.872+0000 7fc78bfff700 1 --2- 172.21.15.84:0/5854486 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc7840b39c0 0x7fc784144e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:02.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.872+0000 7fc78bfff700 1 -- 172.21.15.84:0/5854486 >> 172.21.15.84:0/5854486 conn(0x7fc78406ab70 msgr2=0x7fc784158770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:02.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.872+0000 7fc78bfff700 1 -- 172.21.15.84:0/5854486 shutdown_connections 2023-07-14T11:15:02.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:02.872+0000 7fc78bfff700 1 -- 172.21.15.84:0/5854486 wait complete. 2023-07-14T11:15:02.891 INFO:tasks.cephfs_test_runner:test_binary_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) ... ok 2023-07-14T11:15:02.892 INFO:tasks.cephfs_test_runner:Starting test: test_connection_expiration (tasks.cephfs.test_volumes.TestMisc) 2023-07-14T11:15:02.892 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_connection_expiration' 2023-07-14T11:15:03.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.087+0000 7f91b9fff700 1 Processor -- start 2023-07-14T11:15:03.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.087+0000 7f91b9fff700 1 -- start start 2023-07-14T11:15:03.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.088+0000 7f91b9fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f91b40cd460 0x7f91b40d1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:03.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.088+0000 7f91b9fff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91b40d0d10 con 0x7f91b415cb40 2023-07-14T11:15:03.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.088+0000 7f91b9fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91b40d0ff0 con 0x7f91b40b1b70 2023-07-14T11:15:03.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.088+0000 7f91b9fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91b40d12d0 con 0x7f91b40cd460 2023-07-14T11:15:03.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.088+0000 7f91b3fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f91b415cb40 0x7f91b40b5c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:39792/0 (socket says 172.21.15.84:39792) 2023-07-14T11:15:03.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.088+0000 7f91b3fff700 1 -- 172.21.15.84:0/1359525959 learned_addr learned my addr 172.21.15.84:0/1359525959 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:15:03.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.089+0000 7f91b37fe700 1 --2- 172.21.15.84:0/1359525959 >> v2:172.21.15.179:3300/0 conn(0x7f91b40cd460 0x7f91b40d1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:03.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.089+0000 7f91b2ffd700 1 -- 172.21.15.84:0/1359525959 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4277573706 0 0) 0x7f91b40d0d10 con 0x7f91b415cb40 2023-07-14T11:15:03.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.089+0000 7f91b2ffd700 1 -- 172.21.15.84:0/1359525959 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91a00035b0 con 0x7f91b415cb40 2023-07-14T11:15:03.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.089+0000 7f91b2ffd700 1 -- 172.21.15.84:0/1359525959 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2454927345 0 0) 0x7f91a00035b0 con 0x7f91b415cb40 2023-07-14T11:15:03.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.089+0000 7f91b2ffd700 1 -- 172.21.15.84:0/1359525959 >> v2:172.21.15.179:3300/0 conn(0x7f91b40cd460 msgr2=0x7f91b40d1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:03.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.089+0000 7f91b2ffd700 1 --2- 172.21.15.84:0/1359525959 >> v2:172.21.15.179:3300/0 conn(0x7f91b40cd460 0x7f91b40d1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:03.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.089+0000 7f91b2ffd700 1 -- 172.21.15.84:0/1359525959 >> v1:172.21.15.179:6789/0 conn(0x7f91b40b1b70 legacy=0x7f91b40cd830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:03.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.089+0000 7f91b2ffd700 1 -- 172.21.15.84:0/1359525959 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b40d15b0 con 0x7f91b415cb40 2023-07-14T11:15:03.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.089+0000 7f91b2ffd700 1 -- 172.21.15.84:0/1359525959 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7f91ac0019f0 con 0x7f91b415cb40 2023-07-14T11:15:03.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.089+0000 7f91b2ffd700 1 -- 172.21.15.84:0/1359525959 >> v1:172.21.15.84:6789/0 conn(0x7f91b415cb40 legacy=0x7f91b40b5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:03.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.089+0000 7f91b2ffd700 1 --2- 172.21.15.84:0/1359525959 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91a0003a00 0x7f91a0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:03.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.089+0000 7f91b2ffd700 1 --2- 172.21.15.84:0/1359525959 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91a00043f0 0x7f91a00048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:03.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.089+0000 7f91b2ffd700 1 --2- 172.21.15.84:0/1359525959 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91a00050b0 0x7f91a000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:03.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.089+0000 7f91b2ffd700 1 -- 172.21.15.84:0/1359525959 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b40d12d0 con 0x7f91a0003a00 2023-07-14T11:15:03.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.089+0000 7f91b2ffd700 1 -- 172.21.15.84:0/1359525959 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91a000c000 con 0x7f91a00043f0 2023-07-14T11:15:03.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.089+0000 7f91b2ffd700 1 -- 172.21.15.84:0/1359525959 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91a000c1c0 con 0x7f91a00050b0 2023-07-14T11:15:03.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.089+0000 7f91b37fe700 1 --2- 172.21.15.84:0/1359525959 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91a0003a00 0x7f91a0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:03.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.090+0000 7f91abfff700 1 --2- 172.21.15.84:0/1359525959 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91a00043f0 0x7f91a00048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:03.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.090+0000 7f91b3fff700 1 --2- 172.21.15.84:0/1359525959 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91a00050b0 0x7f91a000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:03.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.090+0000 7f91b37fe700 1 -- 172.21.15.84:0/1359525959 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91a00050b0 msgr2=0x7f91a000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:03.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.090+0000 7f91b37fe700 1 --2- 172.21.15.84:0/1359525959 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91a00050b0 0x7f91a000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:03.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.090+0000 7f91b37fe700 1 -- 172.21.15.84:0/1359525959 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91a00043f0 msgr2=0x7f91a00048b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:03.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.090+0000 7f91b37fe700 1 --2- 172.21.15.84:0/1359525959 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91a00043f0 0x7f91a00048b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:03.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.090+0000 7f91b37fe700 1 -- 172.21.15.84:0/1359525959 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a00035b0 con 0x7f91a0003a00 2023-07-14T11:15:03.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.090+0000 7f91b3fff700 1 --2- 172.21.15.84:0/1359525959 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91a00050b0 0x7f91a000ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:15:03.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.090+0000 7f91abfff700 1 --2- 172.21.15.84:0/1359525959 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91a00043f0 0x7f91a00048b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:15:03.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.090+0000 7f91b3fff700 1 -- 172.21.15.84:0/1359525959 reap_dead start 2023-07-14T11:15:03.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.090+0000 7f91b37fe700 1 --2- 172.21.15.84:0/1359525959 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91a0003a00 0x7f91a0003dd0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f91a4009b60 tx=0x7f91a0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc94c39fc31e8cf1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:03.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.090+0000 7f91b2ffd700 1 -- 172.21.15.84:0/1359525959 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a400e6c0 con 0x7f91a0003a00 2023-07-14T11:15:03.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.090+0000 7f91b2ffd700 1 -- 172.21.15.84:0/1359525959 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a400e820 con 0x7f91a0003a00 2023-07-14T11:15:03.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.090+0000 7f91b2ffd700 1 -- 172.21.15.84:0/1359525959 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a400eb90 con 0x7f91a0003a00 2023-07-14T11:15:03.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.091+0000 7f91b9fff700 1 -- 172.21.15.84:0/1359525959 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91a0003a00 msgr2=0x7f91a0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:03.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.091+0000 7f91b9fff700 1 --2- 172.21.15.84:0/1359525959 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91a0003a00 0x7f91a0003dd0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f91a4009b60 tx=0x7f91a0005880 comp rx=0 tx=0).stop 2023-07-14T11:15:03.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.091+0000 7f91b9fff700 1 -- 172.21.15.84:0/1359525959 shutdown_connections 2023-07-14T11:15:03.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.091+0000 7f91b9fff700 1 --2- 172.21.15.84:0/1359525959 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91a0003a00 0x7f91a0003dd0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:03.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.091+0000 7f91b9fff700 1 -- 172.21.15.84:0/1359525959 >> 172.21.15.84:0/1359525959 conn(0x7f91b406a680 msgr2=0x7f91b406aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:03.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.091+0000 7f91b9fff700 1 -- 172.21.15.84:0/1359525959 shutdown_connections 2023-07-14T11:15:03.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.091+0000 7f91b9fff700 1 -- 172.21.15.84:0/1359525959 wait complete. 2023-07-14T11:15:03.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.093+0000 7f91b9fff700 1 Processor -- start 2023-07-14T11:15:03.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.093+0000 7f91b9fff700 1 -- start start 2023-07-14T11:15:03.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.094+0000 7f91b9fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91a0003a00 0x7f91b41f54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:03.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.094+0000 7f91b9fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91b41542c0 0x7f91b415dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:03.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.094+0000 7f91b9fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91b40b3b90 0x7f91b415ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:03.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.094+0000 7f91b9fff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b4154730 con 0x7f91b40b3b90 2023-07-14T11:15:03.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.094+0000 7f91b9fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b415e320 con 0x7f91a0003a00 2023-07-14T11:15:03.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.094+0000 7f91b9fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91b4155eb0 con 0x7f91b41542c0 2023-07-14T11:15:03.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.094+0000 7f91b3fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91b40b3b90 0x7f91b415ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:03.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.094+0000 7f91b37fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91a0003a00 0x7f91b41f54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:03.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.094+0000 7f91b3fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91b40b3b90 0x7f91b415ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48096/0 (socket says 172.21.15.84:48096) 2023-07-14T11:15:03.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.094+0000 7f91b3fff700 1 -- 172.21.15.84:0/1512326766 learned_addr learned my addr 172.21.15.84:0/1512326766 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:03.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.094+0000 7f91abfff700 1 --2- 172.21.15.84:0/1512326766 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91b41542c0 0x7f91b415dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:03.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.094+0000 7f91b3fff700 1 -- 172.21.15.84:0/1512326766 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91b41542c0 msgr2=0x7f91b415dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:03.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.094+0000 7f91b3fff700 1 --2- 172.21.15.84:0/1512326766 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91b41542c0 0x7f91b415dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:03.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.094+0000 7f91b3fff700 1 -- 172.21.15.84:0/1512326766 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91a0003a00 msgr2=0x7f91b41f54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:03.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.094+0000 7f91b3fff700 1 --2- 172.21.15.84:0/1512326766 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91a0003a00 0x7f91b41f54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:03.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.094+0000 7f91b3fff700 1 -- 172.21.15.84:0/1512326766 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b41f5ab0 con 0x7f91b40b3b90 2023-07-14T11:15:03.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.095+0000 7f91b3fff700 1 --2- 172.21.15.84:0/1512326766 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91b40b3b90 0x7f91b415ae60 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f91b415cf40 tx=0x7f91ac00df00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:03.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.095+0000 7f91b0ff9700 1 -- 172.21.15.84:0/1512326766 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ac00ba60 con 0x7f91b40b3b90 2023-07-14T11:15:03.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.095+0000 7f91b0ff9700 1 -- 172.21.15.84:0/1512326766 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91ac00bbc0 con 0x7f91b40b3b90 2023-07-14T11:15:03.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.095+0000 7f91b0ff9700 1 -- 172.21.15.84:0/1512326766 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ac007030 con 0x7f91b40b3b90 2023-07-14T11:15:03.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.095+0000 7f91b9fff700 1 -- 172.21.15.84:0/1512326766 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91b41f5d90 con 0x7f91b40b3b90 2023-07-14T11:15:03.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.095+0000 7f91b9fff700 1 -- 172.21.15.84:0/1512326766 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91b41f6350 con 0x7f91b40b3b90 2023-07-14T11:15:03.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.096+0000 7f91b9fff700 1 -- 172.21.15.84:0/1512326766 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91b415ef00 con 0x7f91b40b3b90 2023-07-14T11:15:03.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.097+0000 7f91b0ff9700 1 -- 172.21.15.84:0/1512326766 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 7) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f91ac007190 con 0x7f91b40b3b90 2023-07-14T11:15:03.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.098+0000 7f91b0ff9700 1 --2- 172.21.15.84:0/1512326766 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f919406ae90 0x7f919406d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:03.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.098+0000 7f91b0ff9700 1 -- 172.21.15.84:0/1512326766 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f91ac089370 con 0x7f91b40b3b90 2023-07-14T11:15:03.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.098+0000 7f91b37fe700 1 --2- 172.21.15.84:0/1512326766 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f919406ae90 0x7f919406d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:03.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.099+0000 7f91b37fe700 1 --2- 172.21.15.84:0/1512326766 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f919406ae90 0x7f919406d340 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f91a40090b0 tx=0x7f91a401e040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:03.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.102+0000 7f91b0ff9700 1 -- 172.21.15.84:0/1512326766 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f91ac054310 con 0x7f91b40b3b90 2023-07-14T11:15:03.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.374+0000 7f91b9fff700 1 -- 172.21.15.84:0/1512326766 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_connection_expiration"]} v 0) v1 -- 0x7f91b4074350 con 0x7f91b40b3b90 2023-07-14T11:15:03.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.872+0000 7f91b0ff9700 1 -- 172.21.15.84:0/1512326766 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_connection_expiration"]}]=0 v128) v1 ==== 143+0+0 (secure 0 0 0) 0x7f91ac0190d0 con 0x7f91b40b3b90 2023-07-14T11:15:03.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.874+0000 7f91b9fff700 1 -- 172.21.15.84:0/1512326766 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f919406ae90 msgr2=0x7f919406d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:03.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.874+0000 7f91b9fff700 1 --2- 172.21.15.84:0/1512326766 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f919406ae90 0x7f919406d340 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f91a40090b0 tx=0x7f91a401e040 comp rx=0 tx=0).stop 2023-07-14T11:15:03.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.874+0000 7f91b9fff700 1 -- 172.21.15.84:0/1512326766 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91b40b3b90 msgr2=0x7f91b415ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:03.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.874+0000 7f91b9fff700 1 --2- 172.21.15.84:0/1512326766 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91b40b3b90 0x7f91b415ae60 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f91b415cf40 tx=0x7f91ac00df00 comp rx=0 tx=0).stop 2023-07-14T11:15:03.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.874+0000 7f91b9fff700 1 -- 172.21.15.84:0/1512326766 shutdown_connections 2023-07-14T11:15:03.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.874+0000 7f91b9fff700 1 --2- 172.21.15.84:0/1512326766 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91b40b3b90 0x7f91b415ae60 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:03.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.874+0000 7f91b9fff700 1 --2- 172.21.15.84:0/1512326766 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91a0003a00 0x7f91b41f54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:03.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.874+0000 7f91b9fff700 1 --2- 172.21.15.84:0/1512326766 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f919406ae90 0x7f919406d340 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:03.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.874+0000 7f91b9fff700 1 --2- 172.21.15.84:0/1512326766 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91b41542c0 0x7f91b415dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:03.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.874+0000 7f91b9fff700 1 -- 172.21.15.84:0/1512326766 >> 172.21.15.84:0/1512326766 conn(0x7f91b406a680 msgr2=0x7f91b40b7370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:03.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.874+0000 7f91b9fff700 1 -- 172.21.15.84:0/1512326766 shutdown_connections 2023-07-14T11:15:03.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:03.875+0000 7f91b9fff700 1 -- 172.21.15.84:0/1512326766 wait complete. 2023-07-14T11:15:03.895 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-14T11:15:04.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.093+0000 7ff5187ff700 1 Processor -- start 2023-07-14T11:15:04.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.093+0000 7ff5187ff700 1 -- start start 2023-07-14T11:15:04.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.094+0000 7ff5187ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff5100d1e40 0x7ff5100cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:04.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.094+0000 7ff5187ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5100cd5a0 con 0x7ff51015c860 2023-07-14T11:15:04.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.094+0000 7ff5187ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5100cd7f0 con 0x7ff5100c71b0 2023-07-14T11:15:04.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.094+0000 7ff5187ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff510146740 con 0x7ff5100d1e40 2023-07-14T11:15:04.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.094+0000 7ff51659b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7ff51015c860 0x7ff5100c6aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:39798/0 (socket says 172.21.15.84:39798) 2023-07-14T11:15:04.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.094+0000 7ff51659b700 1 -- 172.21.15.84:0/3691865232 learned_addr learned my addr 172.21.15.84:0/3691865232 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:15:04.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.095+0000 7ff515599700 1 -- 172.21.15.84:0/3691865232 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3279810128 0 0) 0x7ff5100cd5a0 con 0x7ff51015c860 2023-07-14T11:15:04.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.095+0000 7ff515599700 1 -- 172.21.15.84:0/3691865232 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4fc0035b0 con 0x7ff51015c860 2023-07-14T11:15:04.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.095+0000 7ff515d9a700 1 --2- 172.21.15.84:0/3691865232 >> v2:172.21.15.179:3300/0 conn(0x7ff5100d1e40 0x7ff5100cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:04.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.095+0000 7ff515599700 1 -- 172.21.15.84:0/3691865232 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 534227443 0 0) 0x7ff4fc0035b0 con 0x7ff51015c860 2023-07-14T11:15:04.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.095+0000 7ff515599700 1 -- 172.21.15.84:0/3691865232 >> v2:172.21.15.179:3300/0 conn(0x7ff5100d1e40 msgr2=0x7ff5100cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:04.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.095+0000 7ff515599700 1 --2- 172.21.15.84:0/3691865232 >> v2:172.21.15.179:3300/0 conn(0x7ff5100d1e40 0x7ff5100cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:04.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.095+0000 7ff515599700 1 -- 172.21.15.84:0/3691865232 >> v1:172.21.15.179:6789/0 conn(0x7ff5100c71b0 legacy=0x7ff5100b49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:04.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.095+0000 7ff515599700 1 -- 172.21.15.84:0/3691865232 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5100cdad0 con 0x7ff51015c860 2023-07-14T11:15:04.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.095+0000 7ff515599700 1 -- 172.21.15.84:0/3691865232 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7ff50c001670 con 0x7ff51015c860 2023-07-14T11:15:04.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.095+0000 7ff515599700 1 -- 172.21.15.84:0/3691865232 >> v1:172.21.15.84:6789/0 conn(0x7ff51015c860 legacy=0x7ff5100c6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:04.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.095+0000 7ff515599700 1 --2- 172.21.15.84:0/3691865232 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4fc003a00 0x7ff4fc003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:04.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.095+0000 7ff515599700 1 --2- 172.21.15.84:0/3691865232 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4fc004850 0x7ff4fc004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:04.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.095+0000 7ff515599700 1 --2- 172.21.15.84:0/3691865232 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4fc005200 0x7ff4fc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:04.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.095+0000 7ff515599700 1 -- 172.21.15.84:0/3691865232 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4fc00c050 con 0x7ff4fc004850 2023-07-14T11:15:04.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.095+0000 7ff515599700 1 -- 172.21.15.84:0/3691865232 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4fc00c1c0 con 0x7ff4fc003a00 2023-07-14T11:15:04.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.095+0000 7ff515599700 1 -- 172.21.15.84:0/3691865232 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4fc00c380 con 0x7ff4fc005200 2023-07-14T11:15:04.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.096+0000 7ff515d9a700 1 --2- 172.21.15.84:0/3691865232 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4fc004850 0x7ff4fc004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:04.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.096+0000 7ff51659b700 1 --2- 172.21.15.84:0/3691865232 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4fc003a00 0x7ff4fc003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:04.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.096+0000 7ff516d9c700 1 --2- 172.21.15.84:0/3691865232 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4fc005200 0x7ff4fc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:04.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.096+0000 7ff515d9a700 1 -- 172.21.15.84:0/3691865232 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4fc005200 msgr2=0x7ff4fc00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:04.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.096+0000 7ff515d9a700 1 --2- 172.21.15.84:0/3691865232 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4fc005200 0x7ff4fc00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:04.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.096+0000 7ff515d9a700 1 -- 172.21.15.84:0/3691865232 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4fc003a00 msgr2=0x7ff4fc003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:04.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.096+0000 7ff515d9a700 1 --2- 172.21.15.84:0/3691865232 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4fc003a00 0x7ff4fc003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:04.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.096+0000 7ff515d9a700 1 -- 172.21.15.84:0/3691865232 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4fc0035b0 con 0x7ff4fc004850 2023-07-14T11:15:04.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.096+0000 7ff516d9c700 1 --2- 172.21.15.84:0/3691865232 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4fc005200 0x7ff4fc00ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:15:04.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.096+0000 7ff516d9c700 1 -- 172.21.15.84:0/3691865232 reap_dead start 2023-07-14T11:15:04.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.096+0000 7ff515d9a700 1 --2- 172.21.15.84:0/3691865232 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4fc004850 0x7ff4fc004cc0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7ff500009b60 tx=0x7ff4fc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=516382b6f2a8c7fb server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:04.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.096+0000 7ff515599700 1 -- 172.21.15.84:0/3691865232 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50000e6c0 con 0x7ff4fc004850 2023-07-14T11:15:04.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.096+0000 7ff515599700 1 -- 172.21.15.84:0/3691865232 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff50000e820 con 0x7ff4fc004850 2023-07-14T11:15:04.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.096+0000 7ff515599700 1 -- 172.21.15.84:0/3691865232 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50000eb90 con 0x7ff4fc004850 2023-07-14T11:15:04.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.097+0000 7ff5187ff700 1 -- 172.21.15.84:0/3691865232 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4fc004850 msgr2=0x7ff4fc004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:04.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.097+0000 7ff5187ff700 1 --2- 172.21.15.84:0/3691865232 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4fc004850 0x7ff4fc004cc0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7ff500009b60 tx=0x7ff4fc005880 comp rx=0 tx=0).stop 2023-07-14T11:15:04.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.097+0000 7ff5187ff700 1 -- 172.21.15.84:0/3691865232 shutdown_connections 2023-07-14T11:15:04.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.097+0000 7ff5187ff700 1 --2- 172.21.15.84:0/3691865232 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4fc004850 0x7ff4fc004cc0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:04.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.097+0000 7ff5187ff700 1 -- 172.21.15.84:0/3691865232 >> 172.21.15.84:0/3691865232 conn(0x7ff510065bd0 msgr2=0x7ff510065fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:04.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.097+0000 7ff5187ff700 1 -- 172.21.15.84:0/3691865232 shutdown_connections 2023-07-14T11:15:04.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.097+0000 7ff5187ff700 1 -- 172.21.15.84:0/3691865232 wait complete. 2023-07-14T11:15:04.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.099+0000 7ff5187ff700 1 Processor -- start 2023-07-14T11:15:04.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.099+0000 7ff5187ff700 1 -- start start 2023-07-14T11:15:04.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.100+0000 7ff5187ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4fc004850 0x7ff5100b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:04.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.100+0000 7ff5187ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5100c9270 0x7ff5101f4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:04.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.100+0000 7ff5187ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5100cac90 0x7ff5100cb130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:04.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.100+0000 7ff5187ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5100cb670 con 0x7ff5100cac90 2023-07-14T11:15:04.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.100+0000 7ff5187ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5100b7d80 con 0x7ff5100c9270 2023-07-14T11:15:04.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.100+0000 7ff5187ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5100b8060 con 0x7ff4fc004850 2023-07-14T11:15:04.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.100+0000 7ff516d9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5100cac90 0x7ff5100cb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:04.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.100+0000 7ff516d9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5100cac90 0x7ff5100cb130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48114/0 (socket says 172.21.15.84:48114) 2023-07-14T11:15:04.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.100+0000 7ff516d9c700 1 -- 172.21.15.84:0/3848121608 learned_addr learned my addr 172.21.15.84:0/3848121608 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:04.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.100+0000 7ff515d9a700 1 --2- 172.21.15.84:0/3848121608 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5100c9270 0x7ff5101f4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:04.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.100+0000 7ff51659b700 1 --2- 172.21.15.84:0/3848121608 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4fc004850 0x7ff5100b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:04.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.101+0000 7ff516d9c700 1 -- 172.21.15.84:0/3848121608 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4fc004850 msgr2=0x7ff5100b77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:04.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.101+0000 7ff516d9c700 1 --2- 172.21.15.84:0/3848121608 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4fc004850 0x7ff5100b77a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:04.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.101+0000 7ff516d9c700 1 -- 172.21.15.84:0/3848121608 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5100c9270 msgr2=0x7ff5101f4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:04.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.101+0000 7ff516d9c700 1 --2- 172.21.15.84:0/3848121608 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5100c9270 0x7ff5101f4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:04.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.101+0000 7ff516d9c700 1 -- 172.21.15.84:0/3848121608 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5100b8340 con 0x7ff5100cac90 2023-07-14T11:15:04.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.101+0000 7ff516d9c700 1 --2- 172.21.15.84:0/3848121608 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5100cac90 0x7ff5100cb130 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7ff51008bdb0 tx=0x7ff50800eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:04.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.101+0000 7ff506ffd700 1 -- 172.21.15.84:0/3848121608 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff508003c10 con 0x7ff5100cac90 2023-07-14T11:15:04.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.101+0000 7ff506ffd700 1 -- 172.21.15.84:0/3848121608 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff508003d90 con 0x7ff5100cac90 2023-07-14T11:15:04.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.101+0000 7ff5187ff700 1 -- 172.21.15.84:0/3848121608 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5100b8620 con 0x7ff5100cac90 2023-07-14T11:15:04.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.101+0000 7ff506ffd700 1 -- 172.21.15.84:0/3848121608 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff508005310 con 0x7ff5100cac90 2023-07-14T11:15:04.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.101+0000 7ff5187ff700 1 -- 172.21.15.84:0/3848121608 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5101f5330 con 0x7ff5100cac90 2023-07-14T11:15:04.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.102+0000 7ff5187ff700 1 -- 172.21.15.84:0/3848121608 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff510074350 con 0x7ff5100cac90 2023-07-14T11:15:04.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.103+0000 7ff506ffd700 1 -- 172.21.15.84:0/3848121608 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 7) v1 ==== 89190+0+0 (secure 0 0 0) 0x7ff508005470 con 0x7ff5100cac90 2023-07-14T11:15:04.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.104+0000 7ff506ffd700 1 --2- 172.21.15.84:0/3848121608 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff4f406ae90 0x7ff4f406d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:04.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.104+0000 7ff506ffd700 1 -- 172.21.15.84:0/3848121608 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5296+0+0 (secure 0 0 0) 0x7ff508089310 con 0x7ff5100cac90 2023-07-14T11:15:04.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.104+0000 7ff51659b700 1 --2- 172.21.15.84:0/3848121608 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff4f406ae90 0x7ff4f406d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:04.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.105+0000 7ff51659b700 1 --2- 172.21.15.84:0/3848121608 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff4f406ae90 0x7ff4f406d340 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff50c007db0 tx=0x7ff50c000ed0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:04.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.108+0000 7ff506ffd700 1 -- 172.21.15.84:0/3848121608 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ff508054450 con 0x7ff5100cac90 2023-07-14T11:15:04.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.306+0000 7ff5187ff700 1 -- 172.21.15.84:0/3848121608 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7ff5100d0650 con 0x7ff5100cac90 2023-07-14T11:15:04.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.310+0000 7ff506ffd700 1 -- 172.21.15.84:0/3848121608 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff508057a70 con 0x7ff5100cac90 2023-07-14T11:15:04.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.312+0000 7ff5187ff700 1 -- 172.21.15.84:0/3848121608 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff4f406ae90 msgr2=0x7ff4f406d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:04.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.312+0000 7ff5187ff700 1 --2- 172.21.15.84:0/3848121608 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff4f406ae90 0x7ff4f406d340 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff50c007db0 tx=0x7ff50c000ed0 comp rx=0 tx=0).stop 2023-07-14T11:15:04.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.312+0000 7ff5187ff700 1 -- 172.21.15.84:0/3848121608 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5100cac90 msgr2=0x7ff5100cb130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:04.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.312+0000 7ff5187ff700 1 --2- 172.21.15.84:0/3848121608 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5100cac90 0x7ff5100cb130 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7ff51008bdb0 tx=0x7ff50800eda0 comp rx=0 tx=0).stop 2023-07-14T11:15:04.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.313+0000 7ff5187ff700 1 -- 172.21.15.84:0/3848121608 shutdown_connections 2023-07-14T11:15:04.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.313+0000 7ff5187ff700 1 --2- 172.21.15.84:0/3848121608 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff4f406ae90 0x7ff4f406d340 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:04.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.313+0000 7ff5187ff700 1 --2- 172.21.15.84:0/3848121608 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4fc004850 0x7ff5100b77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:04.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.313+0000 7ff5187ff700 1 --2- 172.21.15.84:0/3848121608 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5100cac90 0x7ff5100cb130 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:04.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.313+0000 7ff5187ff700 1 --2- 172.21.15.84:0/3848121608 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5100c9270 0x7ff5101f4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:04.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.313+0000 7ff5187ff700 1 -- 172.21.15.84:0/3848121608 >> 172.21.15.84:0/3848121608 conn(0x7ff510065bd0 msgr2=0x7ff5100c7670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:04.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.313+0000 7ff5187ff700 1 -- 172.21.15.84:0/3848121608 shutdown_connections 2023-07-14T11:15:04.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.313+0000 7ff5187ff700 1 -- 172.21.15.84:0/3848121608 wait complete. 2023-07-14T11:15:04.332 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-14T11:15:04.333 DEBUG:teuthology.orchestra.run.smithi084:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-14T11:15:04.430 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-14T11:15:04.537 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-14T11:15:04.537 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-14T11:15:04.538 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:15:04.584 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345568k,nr_inodes=4086392,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=35,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275008k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-07-14T11:15:04.584 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-07-14T11:15:04.584 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:15:04.632 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345528k,nr_inodes=4086382,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=40,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275000k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-07-14T11:15:04.632 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-14T11:15:04.633 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:15:04.678 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345568k,nr_inodes=4086392,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=35,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275008k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-07-14T11:15:04.679 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-07-14T11:15:04.679 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:15:04.726 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345528k,nr_inodes=4086382,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=40,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275000k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-07-14T11:15:04.726 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-14T11:15:04.727 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T11:15:04.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.921+0000 7f6f103ff700 1 Processor -- start 2023-07-14T11:15:04.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.921+0000 7f6f103ff700 1 -- start start 2023-07-14T11:15:04.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.922+0000 7f6f103ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6f0815c950 0x7f6f080b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:04.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.922+0000 7f6f103ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f080b1e00 0x7f6f080d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:04.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.922+0000 7f6f103ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6f080b2350 0x7f6f080d1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:04.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.922+0000 7f6f103ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f080d2ce0 con 0x7f6f0815c950 2023-07-14T11:15:04.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.922+0000 7f6f103ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f080b3350 con 0x7f6f080b2350 2023-07-14T11:15:04.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.922+0000 7f6f103ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f080b3630 con 0x7f6f080b1e00 2023-07-14T11:15:04.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.922+0000 7f6f0e19b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6f0815c950 0x7f6f080b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:04.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.922+0000 7f6f0e19b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6f0815c950 0x7f6f080b43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48122/0 (socket says 172.21.15.84:48122) 2023-07-14T11:15:04.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.922+0000 7f6f0e19b700 1 -- 172.21.15.84:0/1729293356 learned_addr learned my addr 172.21.15.84:0/1729293356 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:04.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.923+0000 7f6f0e99c700 1 --2- 172.21.15.84:0/1729293356 >> v2:172.21.15.179:3300/0 conn(0x7f6f080b2350 0x7f6f080d1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:04.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.923+0000 7f6f0d99a700 1 --2- 172.21.15.84:0/1729293356 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f080b1e00 0x7f6f080d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:04.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.923+0000 7f6f0e19b700 1 -- 172.21.15.84:0/1729293356 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f080b1e00 msgr2=0x7f6f080d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:04.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.923+0000 7f6f0e19b700 1 --2- 172.21.15.84:0/1729293356 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f080b1e00 0x7f6f080d0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:04.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.923+0000 7f6f0e19b700 1 -- 172.21.15.84:0/1729293356 >> v2:172.21.15.179:3300/0 conn(0x7f6f080b2350 msgr2=0x7f6f080d1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:04.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.923+0000 7f6f0e19b700 1 --2- 172.21.15.84:0/1729293356 >> v2:172.21.15.179:3300/0 conn(0x7f6f080b2350 0x7f6f080d1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:04.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.923+0000 7f6f0e19b700 1 -- 172.21.15.84:0/1729293356 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f080b3910 con 0x7f6f0815c950 2023-07-14T11:15:04.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.923+0000 7f6f0d99a700 1 --2- 172.21.15.84:0/1729293356 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f080b1e00 0x7f6f080d0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:15:04.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.923+0000 7f6f0e19b700 1 --2- 172.21.15.84:0/1729293356 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f0815c950 0x7f6f080b43f0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f6f080b3280 tx=0x7f6f04009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d4106a2fb32163f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:04.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.923+0000 7f6f0d199700 1 -- 172.21.15.84:0/1729293356 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f04005e30 con 0x7f6f0815c950 2023-07-14T11:15:04.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.923+0000 7f6f0d199700 1 -- 172.21.15.84:0/1729293356 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f04004030 con 0x7f6f0815c950 2023-07-14T11:15:04.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.923+0000 7f6f0d199700 1 -- 172.21.15.84:0/1729293356 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f040043e0 con 0x7f6f0815c950 2023-07-14T11:15:04.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.924+0000 7f6f103ff700 1 -- 172.21.15.84:0/1729293356 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f0815c950 msgr2=0x7f6f080b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:04.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.924+0000 7f6f103ff700 1 --2- 172.21.15.84:0/1729293356 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f0815c950 0x7f6f080b43f0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f6f080b3280 tx=0x7f6f04009bd0 comp rx=0 tx=0).stop 2023-07-14T11:15:04.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.924+0000 7f6f103ff700 1 -- 172.21.15.84:0/1729293356 shutdown_connections 2023-07-14T11:15:04.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.924+0000 7f6f103ff700 1 --2- 172.21.15.84:0/1729293356 >> v2:172.21.15.179:3300/0 conn(0x7f6f080b2350 0x7f6f080d1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:04.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.924+0000 7f6f103ff700 1 --2- 172.21.15.84:0/1729293356 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f0815c950 0x7f6f080b43f0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:04.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.924+0000 7f6f103ff700 1 --2- 172.21.15.84:0/1729293356 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f080b1e00 0x7f6f080d0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:04.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.924+0000 7f6f103ff700 1 -- 172.21.15.84:0/1729293356 >> 172.21.15.84:0/1729293356 conn(0x7f6f0809c1d0 msgr2=0x7f6f080d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:04.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.924+0000 7f6f103ff700 1 -- 172.21.15.84:0/1729293356 shutdown_connections 2023-07-14T11:15:04.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.924+0000 7f6f103ff700 1 -- 172.21.15.84:0/1729293356 wait complete. 2023-07-14T11:15:04.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.926+0000 7f6f103ff700 1 Processor -- start 2023-07-14T11:15:04.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.926+0000 7f6f103ff700 1 -- start start 2023-07-14T11:15:04.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.927+0000 7f6f103ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f080b1e00 0x7f6f080b5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:04.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.927+0000 7f6f103ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f080b2350 0x7f6f080c9230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:04.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.927+0000 7f6f103ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f0815c950 0x7f6f080cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:04.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.927+0000 7f6f103ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f080ca840 con 0x7f6f0815c950 2023-07-14T11:15:04.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.927+0000 7f6f103ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f080c9770 con 0x7f6f080b2350 2023-07-14T11:15:04.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.927+0000 7f6f103ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f080b6400 con 0x7f6f080b1e00 2023-07-14T11:15:04.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.927+0000 7f6f0e99c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f0815c950 0x7f6f080cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:04.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.927+0000 7f6f0e99c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f0815c950 0x7f6f080cfc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48136/0 (socket says 172.21.15.84:48136) 2023-07-14T11:15:04.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.927+0000 7f6f0e99c700 1 -- 172.21.15.84:0/2353707508 learned_addr learned my addr 172.21.15.84:0/2353707508 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:04.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.927+0000 7f6f0d99a700 1 --2- 172.21.15.84:0/2353707508 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f080b2350 0x7f6f080c9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:04.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.927+0000 7f6f0e19b700 1 --2- 172.21.15.84:0/2353707508 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f080b1e00 0x7f6f080b5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:04.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.927+0000 7f6f0e99c700 1 -- 172.21.15.84:0/2353707508 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f080b1e00 msgr2=0x7f6f080b5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:04.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.927+0000 7f6f0e99c700 1 --2- 172.21.15.84:0/2353707508 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f080b1e00 0x7f6f080b5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:04.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.927+0000 7f6f0e99c700 1 -- 172.21.15.84:0/2353707508 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f080b2350 msgr2=0x7f6f080c9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:04.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.927+0000 7f6f0e99c700 1 --2- 172.21.15.84:0/2353707508 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f080b2350 0x7f6f080c9230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:04.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.927+0000 7f6f0e99c700 1 -- 172.21.15.84:0/2353707508 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f04009500 con 0x7f6f0815c950 2023-07-14T11:15:04.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.927+0000 7f6f0e19b700 1 --2- 172.21.15.84:0/2353707508 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f080b1e00 0x7f6f080b5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:15:04.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.928+0000 7f6f0e99c700 1 --2- 172.21.15.84:0/2353707508 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f0815c950 0x7f6f080cfc10 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f6f0000efc0 tx=0x7f6f0000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:04.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.928+0000 7f6efeffd700 1 -- 172.21.15.84:0/2353707508 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f00009ea0 con 0x7f6f0815c950 2023-07-14T11:15:04.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.928+0000 7f6efeffd700 1 -- 172.21.15.84:0/2353707508 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f0000f040 con 0x7f6f0815c950 2023-07-14T11:15:04.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.928+0000 7f6f103ff700 1 -- 172.21.15.84:0/2353707508 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f080b66e0 con 0x7f6f0815c950 2023-07-14T11:15:04.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.928+0000 7f6efeffd700 1 -- 172.21.15.84:0/2353707508 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f00014480 con 0x7f6f0815c950 2023-07-14T11:15:04.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.928+0000 7f6f103ff700 1 -- 172.21.15.84:0/2353707508 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f080caae0 con 0x7f6f0815c950 2023-07-14T11:15:04.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.929+0000 7f6f103ff700 1 -- 172.21.15.84:0/2353707508 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f080b6c00 con 0x7f6f0815c950 2023-07-14T11:15:04.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.930+0000 7f6efeffd700 1 -- 172.21.15.84:0/2353707508 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 7) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f6f000145e0 con 0x7f6f0815c950 2023-07-14T11:15:04.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.931+0000 7f6efeffd700 1 --2- 172.21.15.84:0/2353707508 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6eec06ae90 0x7f6eec06d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:04.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.932+0000 7f6efeffd700 1 -- 172.21.15.84:0/2353707508 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f6f00089ef0 con 0x7f6f0815c950 2023-07-14T11:15:04.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.932+0000 7f6f0e19b700 1 --2- 172.21.15.84:0/2353707508 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6eec06ae90 0x7f6eec06d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:04.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.932+0000 7f6f0e19b700 1 --2- 172.21.15.84:0/2353707508 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6eec06ae90 0x7f6eec06d340 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6f04009c10 tx=0x7f6f04008070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:04.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:04.936+0000 7f6efeffd700 1 -- 172.21.15.84:0/2353707508 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f6f080b6c00 con 0x7f6f0815c950 2023-07-14T11:15:05.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.175+0000 7f6f103ff700 1 -- 172.21.15.84:0/2353707508 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6f080b6c00 con 0x7f6f0815c950 2023-07-14T11:15:05.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.176+0000 7f6efeffd700 1 -- 172.21.15.84:0/2353707508 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+3523 (secure 0 0 0) 0x7f6f080b6c00 con 0x7f6f0815c950 2023-07-14T11:15:05.178 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:15:05.179 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":21,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4751,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/76454361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":76454361},{"type":"v1","addr":"172.21.15.179:6833","nonce":76454361}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4757,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/534886511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":534886511},{"type":"v1","addr":"172.21.15.179:6835","nonce":534886511}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5118,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/930551517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":930551517},{"type":"v1","addr":"172.21.15.84:6836","nonce":930551517}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5547,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/3672039995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":3672039995},{"type":"v1","addr":"172.21.15.84:6837","nonce":3672039995}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[]} 2023-07-14T11:15:05.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.178+0000 7f6f103ff700 1 -- 172.21.15.84:0/2353707508 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6eec06ae90 msgr2=0x7f6eec06d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:05.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.178+0000 7f6f103ff700 1 --2- 172.21.15.84:0/2353707508 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6eec06ae90 0x7f6eec06d340 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6f04009c10 tx=0x7f6f04008070 comp rx=0 tx=0).stop 2023-07-14T11:15:05.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.178+0000 7f6f103ff700 1 -- 172.21.15.84:0/2353707508 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f0815c950 msgr2=0x7f6f080cfc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:05.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.178+0000 7f6f103ff700 1 --2- 172.21.15.84:0/2353707508 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f0815c950 0x7f6f080cfc10 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f6f0000efc0 tx=0x7f6f0000c3a0 comp rx=0 tx=0).stop 2023-07-14T11:15:05.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.178+0000 7f6f103ff700 1 -- 172.21.15.84:0/2353707508 shutdown_connections 2023-07-14T11:15:05.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.178+0000 7f6f103ff700 1 --2- 172.21.15.84:0/2353707508 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6eec06ae90 0x7f6eec06d340 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:05.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.178+0000 7f6f103ff700 1 --2- 172.21.15.84:0/2353707508 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f080b1e00 0x7f6f080b5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:05.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.178+0000 7f6f103ff700 1 --2- 172.21.15.84:0/2353707508 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f0815c950 0x7f6f080cfc10 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:05.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.178+0000 7f6f103ff700 1 --2- 172.21.15.84:0/2353707508 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f080b2350 0x7f6f080c9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:05.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.178+0000 7f6f103ff700 1 -- 172.21.15.84:0/2353707508 >> 172.21.15.84:0/2353707508 conn(0x7f6f0809c1d0 msgr2=0x7f6f0806b490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:05.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.178+0000 7f6f103ff700 1 -- 172.21.15.84:0/2353707508 shutdown_connections 2023-07-14T11:15:05.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.178+0000 7f6f103ff700 1 -- 172.21.15.84:0/2353707508 wait complete. 2023-07-14T11:15:05.182 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 21 2023-07-14T11:15:05.198 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-14T11:15:05.198 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-14T11:15:05.199 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-14T11:15:05.199 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T11:15:05.199 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-14T11:15:05.199 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-14T11:15:05.200 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-14T11:15:05.200 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T11:15:05.200 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-14T11:15:05.201 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-14T11:15:05.201 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-14T11:15:05.201 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T11:15:05.201 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-14T11:15:05.201 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-14T11:15:05.202 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-14T11:15:05.202 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T11:15:05.215 INFO:tasks.ceph.mds.a:Stopped 2023-07-14T11:15:05.215 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-14T11:15:05.216 INFO:tasks.ceph.mds.c:Stopped 2023-07-14T11:15:05.217 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-14T11:15:05.221 INFO:tasks.ceph.mds.b:Stopped 2023-07-14T11:15:05.221 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-14T11:15:05.222 INFO:tasks.ceph.mds.d:Stopped 2023-07-14T11:15:05.222 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-14T11:15:05.260 INFO:tasks.ceph.mds.a:Started 2023-07-14T11:15:05.260 DEBUG:teuthology.parallel:result is None 2023-07-14T11:15:05.262 INFO:tasks.ceph.mds.c:Started 2023-07-14T11:15:05.263 DEBUG:teuthology.parallel:result is None 2023-07-14T11:15:05.265 INFO:tasks.ceph.mds.b:Started 2023-07-14T11:15:05.265 DEBUG:teuthology.parallel:result is None 2023-07-14T11:15:05.268 INFO:tasks.ceph.mds.d:Started 2023-07-14T11:15:05.268 DEBUG:teuthology.parallel:result is None 2023-07-14T11:15:05.268 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-14T11:15:05.411 INFO:tasks.ceph.mds.a.smithi084.stdout:starting mds.a at 2023-07-14T11:15:05.412 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2023-07-14T11:15:05.412 INFO:tasks.ceph.mds.c.smithi084.stdout:starting mds.c at 2023-07-14T11:15:05.412 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2023-07-14T11:15:05.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.475+0000 7f77df1ff700 1 Processor -- start 2023-07-14T11:15:05.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.475+0000 7f77df1ff700 1 -- start start 2023-07-14T11:15:05.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.476+0000 7f77df1ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f77d80c92d0 0x7f77d80ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:05.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.476+0000 7f77df1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77d80adea0 0x7f77d80cc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:05.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.476+0000 7f77df1ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77d815ce70 con 0x7f77d80b12f0 2023-07-14T11:15:05.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.476+0000 7f77df1ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77d815da60 con 0x7f77d80c92d0 2023-07-14T11:15:05.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.476+0000 7f77df1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77d815d0c0 con 0x7f77d80adea0 2023-07-14T11:15:05.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.477+0000 7f77dcf9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f77d80c92d0 0x7f77d80ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:05.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.477+0000 7f77dcf9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f77d80c92d0 0x7f77d80ad8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48176/0 (socket says 172.21.15.84:48176) 2023-07-14T11:15:05.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.477+0000 7f77dcf9b700 1 -- 172.21.15.84:0/2658077646 learned_addr learned my addr 172.21.15.84:0/2658077646 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:05.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.477+0000 7f77dd79c700 1 --2- 172.21.15.84:0/2658077646 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77d80adea0 0x7f77d80cc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:05.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.477+0000 7f77dcf9b700 1 -- 172.21.15.84:0/2658077646 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77d80adea0 msgr2=0x7f77d80cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:05.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.477+0000 7f77dcf9b700 1 --2- 172.21.15.84:0/2658077646 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77d80adea0 0x7f77d80cc690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:05.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.477+0000 7f77dcf9b700 1 -- 172.21.15.84:0/2658077646 >> v1:172.21.15.179:6789/0 conn(0x7f77d80b12f0 legacy=0x7f77d80c96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:05.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.477+0000 7f77dcf9b700 1 -- 172.21.15.84:0/2658077646 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d815d3a0 con 0x7f77d80c92d0 2023-07-14T11:15:05.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.477+0000 7f77dcf9b700 1 --2- 172.21.15.84:0/2658077646 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77d80c92d0 0x7f77d80ad8f0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f77cc0098f0 tx=0x7f77cc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98c16d9723009c87 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:05.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.478+0000 7f77d77fe700 1 -- 172.21.15.84:0/2658077646 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77cc011830 con 0x7f77d80c92d0 2023-07-14T11:15:05.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.478+0000 7f77d77fe700 1 -- 172.21.15.84:0/2658077646 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77cc011990 con 0x7f77d80c92d0 2023-07-14T11:15:05.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.478+0000 7f77d77fe700 1 -- 172.21.15.84:0/2658077646 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77cc011d20 con 0x7f77d80c92d0 2023-07-14T11:15:05.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.478+0000 7f77df1ff700 1 -- 172.21.15.84:0/2658077646 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77d80c92d0 msgr2=0x7f77d80ad8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:05.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.478+0000 7f77df1ff700 1 --2- 172.21.15.84:0/2658077646 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77d80c92d0 0x7f77d80ad8f0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f77cc0098f0 tx=0x7f77cc009c00 comp rx=0 tx=0).stop 2023-07-14T11:15:05.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.478+0000 7f77df1ff700 1 -- 172.21.15.84:0/2658077646 shutdown_connections 2023-07-14T11:15:05.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.478+0000 7f77df1ff700 1 --2- 172.21.15.84:0/2658077646 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77d80adea0 0x7f77d80cc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:05.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.478+0000 7f77df1ff700 1 --2- 172.21.15.84:0/2658077646 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77d80c92d0 0x7f77d80ad8f0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:05.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.478+0000 7f77df1ff700 1 -- 172.21.15.84:0/2658077646 >> 172.21.15.84:0/2658077646 conn(0x7f77d80b05d0 msgr2=0x7f77d80b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:05.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.478+0000 7f77df1ff700 1 -- 172.21.15.84:0/2658077646 shutdown_connections 2023-07-14T11:15:05.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.478+0000 7f77df1ff700 1 -- 172.21.15.84:0/2658077646 wait complete. 2023-07-14T11:15:05.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.480+0000 7f77df1ff700 1 Processor -- start 2023-07-14T11:15:05.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.480+0000 7f77df1ff700 1 -- start start 2023-07-14T11:15:05.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.481+0000 7f77df1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77d80adea0 0x7f77d8153d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:05.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.481+0000 7f77df1ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77d80b12f0 0x7f77d80b18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:05.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.481+0000 7f77df1ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77d80c92d0 0x7f77d81535f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:05.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.481+0000 7f77df1ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d81545b0 con 0x7f77d80b12f0 2023-07-14T11:15:05.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.481+0000 7f77df1ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d8153b30 con 0x7f77d80c92d0 2023-07-14T11:15:05.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.481+0000 7f77df1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77d80b2170 con 0x7f77d80adea0 2023-07-14T11:15:05.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.481+0000 7f77d7fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77d80b12f0 0x7f77d80b18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:05.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.481+0000 7f77d7fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77d80b12f0 0x7f77d80b18f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48192/0 (socket says 172.21.15.84:48192) 2023-07-14T11:15:05.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.481+0000 7f77d7fff700 1 -- 172.21.15.84:0/1843463342 learned_addr learned my addr 172.21.15.84:0/1843463342 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:05.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.481+0000 7f77dcf9b700 1 --2- 172.21.15.84:0/1843463342 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77d80adea0 0x7f77d8153d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:05.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.481+0000 7f77dd79c700 1 --2- 172.21.15.84:0/1843463342 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77d80c92d0 0x7f77d81535f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:05.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.482+0000 7f77dcf9b700 1 -- 172.21.15.84:0/1843463342 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77d80c92d0 msgr2=0x7f77d81535f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:05.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.482+0000 7f77dcf9b700 1 --2- 172.21.15.84:0/1843463342 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77d80c92d0 0x7f77d81535f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:05.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.482+0000 7f77dcf9b700 1 -- 172.21.15.84:0/1843463342 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77d80b12f0 msgr2=0x7f77d80b18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:05.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.482+0000 7f77dcf9b700 1 --2- 172.21.15.84:0/1843463342 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77d80b12f0 0x7f77d80b18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:05.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.482+0000 7f77dcf9b700 1 -- 172.21.15.84:0/1843463342 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77cc009550 con 0x7f77d80adea0 2023-07-14T11:15:05.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.482+0000 7f77d7fff700 1 --2- 172.21.15.84:0/1843463342 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77d80b12f0 0x7f77d80b18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:15:05.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.482+0000 7f77dcf9b700 1 --2- 172.21.15.84:0/1843463342 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77d80adea0 0x7f77d8153d30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f77cc016000 tx=0x7f77cc004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:05.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.482+0000 7f77d57fa700 1 -- 172.21.15.84:0/1843463342 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77cc004510 con 0x7f77d80adea0 2023-07-14T11:15:05.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.482+0000 7f77d57fa700 1 -- 172.21.15.84:0/1843463342 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77cc01e070 con 0x7f77d80adea0 2023-07-14T11:15:05.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.482+0000 7f77d57fa700 1 -- 172.21.15.84:0/1843463342 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77cc0038c0 con 0x7f77d80adea0 2023-07-14T11:15:05.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.482+0000 7f77df1ff700 1 -- 172.21.15.84:0/1843463342 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77d80b2450 con 0x7f77d80adea0 2023-07-14T11:15:05.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.483+0000 7f77df1ff700 1 -- 172.21.15.84:0/1843463342 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77d815a450 con 0x7f77d80adea0 2023-07-14T11:15:05.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.484+0000 7f77df1ff700 1 -- 172.21.15.84:0/1843463342 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77d80b2970 con 0x7f77d80adea0 2023-07-14T11:15:05.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.484+0000 7f77d57fa700 1 -- 172.21.15.84:0/1843463342 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 7) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f77cc003a20 con 0x7f77d80adea0 2023-07-14T11:15:05.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.486+0000 7f77d57fa700 1 --2- 172.21.15.84:0/1843463342 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f77bc06ae90 0x7f77bc06d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:05.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.486+0000 7f77d57fa700 1 -- 172.21.15.84:0/1843463342 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f77cc08a200 con 0x7f77d80adea0 2023-07-14T11:15:05.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.486+0000 7f77d7fff700 1 --2- 172.21.15.84:0/1843463342 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f77bc06ae90 0x7f77bc06d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:05.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.486+0000 7f77d7fff700 1 --2- 172.21.15.84:0/1843463342 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f77bc06ae90 0x7f77bc06d340 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f77d806d140 tx=0x7f77c4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:05.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.491+0000 7f77d57fa700 1 -- 172.21.15.84:0/1843463342 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f77cc055340 con 0x7f77d80adea0 2023-07-14T11:15:05.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.700+0000 7f77df1ff700 1 -- 172.21.15.84:0/1843463342 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f77d80b1e30 con 0x7f77d80adea0 2023-07-14T11:15:05.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.888+0000 7f77d57fa700 1 -- 172.21.15.84:0/1843463342 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v44) v1 ==== 97+0+0 (secure 0 0 0) 0x7f77cc058960 con 0x7f77d80adea0 2023-07-14T11:15:05.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.891+0000 7f77df1ff700 1 -- 172.21.15.84:0/1843463342 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f77bc06ae90 msgr2=0x7f77bc06d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:05.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.891+0000 7f77df1ff700 1 --2- 172.21.15.84:0/1843463342 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f77bc06ae90 0x7f77bc06d340 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f77d806d140 tx=0x7f77c4009040 comp rx=0 tx=0).stop 2023-07-14T11:15:05.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.891+0000 7f77df1ff700 1 -- 172.21.15.84:0/1843463342 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77d80adea0 msgr2=0x7f77d8153d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:05.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.891+0000 7f77df1ff700 1 --2- 172.21.15.84:0/1843463342 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77d80adea0 0x7f77d8153d30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f77cc016000 tx=0x7f77cc004750 comp rx=0 tx=0).stop 2023-07-14T11:15:05.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.891+0000 7f77df1ff700 1 -- 172.21.15.84:0/1843463342 shutdown_connections 2023-07-14T11:15:05.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.891+0000 7f77df1ff700 1 --2- 172.21.15.84:0/1843463342 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f77bc06ae90 0x7f77bc06d340 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:05.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.891+0000 7f77df1ff700 1 --2- 172.21.15.84:0/1843463342 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77d80adea0 0x7f77d8153d30 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:05.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.891+0000 7f77df1ff700 1 --2- 172.21.15.84:0/1843463342 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77d80c92d0 0x7f77d81535f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:05.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.891+0000 7f77df1ff700 1 --2- 172.21.15.84:0/1843463342 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77d80b12f0 0x7f77d80b18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:05.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.891+0000 7f77df1ff700 1 -- 172.21.15.84:0/1843463342 >> 172.21.15.84:0/1843463342 conn(0x7f77d80b05d0 msgr2=0x7f77d80cc670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:05.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.891+0000 7f77df1ff700 1 -- 172.21.15.84:0/1843463342 shutdown_connections 2023-07-14T11:15:05.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:05.891+0000 7f77df1ff700 1 -- 172.21.15.84:0/1843463342 wait complete. 2023-07-14T11:15:05.895 INFO:teuthology.orchestra.run.smithi084.stderr: removed all blocklist entries 2023-07-14T11:15:05.912 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-14T11:15:06.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.106+0000 7f1c481ff700 1 Processor -- start 2023-07-14T11:15:06.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.106+0000 7f1c481ff700 1 -- start start 2023-07-14T11:15:06.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.107+0000 7f1c481ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c4015e890 0x7f1c400cee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:06.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.107+0000 7f1c481ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1c400b3780 0x7f1c400b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:06.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.107+0000 7f1c481ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c400ce110 con 0x7f1c4015a8c0 2023-07-14T11:15:06.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.107+0000 7f1c481ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c4015b450 con 0x7f1c400b3780 2023-07-14T11:15:06.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.107+0000 7f1c481ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c400cf380 con 0x7f1c4015e890 2023-07-14T11:15:06.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.108+0000 7f1c45f9b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c4015e890 0x7f1c400cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:06.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.108+0000 7f1c4579a700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1c400b3780 0x7f1c400b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:06.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.108+0000 7f1c45f9b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c4015e890 0x7f1c400cee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.84:54564/0 (socket says 172.21.15.84:54564) 2023-07-14T11:15:06.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.108+0000 7f1c45f9b700 1 -- 172.21.15.84:0/305997694 learned_addr learned my addr 172.21.15.84:0/305997694 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:06.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.108+0000 7f1c4679c700 1 --1- 172.21.15.84:0/305997694 >> v1:172.21.15.179:6789/0 conn(0x7f1c4015a8c0 0x7f1c4015ad40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.84:38198/0 (socket says 172.21.15.84:38198) 2023-07-14T11:15:06.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.108+0000 7f1c45f9b700 1 -- 172.21.15.84:0/305997694 >> v2:172.21.15.179:3300/0 conn(0x7f1c400b3780 msgr2=0x7f1c400b3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:06.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.108+0000 7f1c45f9b700 1 --2- 172.21.15.84:0/305997694 >> v2:172.21.15.179:3300/0 conn(0x7f1c400b3780 0x7f1c400b3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:06.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.108+0000 7f1c44f99700 1 -- 172.21.15.84:0/305997694 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 973096668 0 0) 0x7f1c400ce110 con 0x7f1c4015a8c0 2023-07-14T11:15:06.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.108+0000 7f1c45f9b700 1 -- 172.21.15.84:0/305997694 >> v1:172.21.15.179:6789/0 conn(0x7f1c4015a8c0 legacy=0x7f1c4015ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:06.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.108+0000 7f1c45f9b700 1 -- 172.21.15.84:0/305997694 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c4015b660 con 0x7f1c4015e890 2023-07-14T11:15:06.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.108+0000 7f1c4579a700 1 --2- 172.21.15.84:0/305997694 >> v2:172.21.15.179:3300/0 conn(0x7f1c400b3780 0x7f1c400b3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:15:06.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.109+0000 7f1c45f9b700 1 --2- 172.21.15.84:0/305997694 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c4015e890 0x7f1c400cee40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c0098f0 tx=0x7f1c3c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd00ca5c89caa34c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:06.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.109+0000 7f1c44f99700 1 -- 172.21.15.84:0/305997694 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3c011830 con 0x7f1c4015e890 2023-07-14T11:15:06.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.109+0000 7f1c44f99700 1 -- 172.21.15.84:0/305997694 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c3c011990 con 0x7f1c4015e890 2023-07-14T11:15:06.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.109+0000 7f1c44f99700 1 -- 172.21.15.84:0/305997694 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3c011d20 con 0x7f1c4015e890 2023-07-14T11:15:06.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.109+0000 7f1c481ff700 1 -- 172.21.15.84:0/305997694 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c4015e890 msgr2=0x7f1c400cee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:06.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.109+0000 7f1c481ff700 1 --2- 172.21.15.84:0/305997694 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c4015e890 0x7f1c400cee40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c0098f0 tx=0x7f1c3c009c00 comp rx=0 tx=0).stop 2023-07-14T11:15:06.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.109+0000 7f1c481ff700 1 -- 172.21.15.84:0/305997694 shutdown_connections 2023-07-14T11:15:06.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.109+0000 7f1c481ff700 1 --2- 172.21.15.84:0/305997694 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c4015e890 0x7f1c400cee40 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:06.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.109+0000 7f1c481ff700 1 --2- 172.21.15.84:0/305997694 >> v2:172.21.15.179:3300/0 conn(0x7f1c400b3780 0x7f1c400b3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:06.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.110+0000 7f1c481ff700 1 -- 172.21.15.84:0/305997694 >> 172.21.15.84:0/305997694 conn(0x7f1c40069f30 msgr2=0x7f1c4006a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:06.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.110+0000 7f1c481ff700 1 -- 172.21.15.84:0/305997694 shutdown_connections 2023-07-14T11:15:06.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.110+0000 7f1c481ff700 1 -- 172.21.15.84:0/305997694 wait complete. 2023-07-14T11:15:06.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.111+0000 7f1c481ff700 1 Processor -- start 2023-07-14T11:15:06.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.111+0000 7f1c481ff700 1 -- start start 2023-07-14T11:15:06.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.112+0000 7f1c481ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c400b3780 0x7f1c4013e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:06.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.112+0000 7f1c481ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c4015a8c0 0x7f1c401e5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:06.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.112+0000 7f1c481ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c4015e890 0x7f1c401e65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:06.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.112+0000 7f1c481ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4013ebb0 con 0x7f1c4015a8c0 2023-07-14T11:15:06.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.112+0000 7f1c481ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c40142820 con 0x7f1c400b3780 2023-07-14T11:15:06.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.112+0000 7f1c481ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c40142b00 con 0x7f1c4015e890 2023-07-14T11:15:06.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.113+0000 7f1c4579a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c4015a8c0 0x7f1c401e5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:06.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.113+0000 7f1c4579a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c4015a8c0 0x7f1c401e5230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48194/0 (socket says 172.21.15.84:48194) 2023-07-14T11:15:06.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.113+0000 7f1c4579a700 1 -- 172.21.15.84:0/784603095 learned_addr learned my addr 172.21.15.84:0/784603095 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:06.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.113+0000 7f1c45f9b700 1 --2- 172.21.15.84:0/784603095 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c400b3780 0x7f1c4013e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:06.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.113+0000 7f1c4679c700 1 --2- 172.21.15.84:0/784603095 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c4015e890 0x7f1c401e65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:06.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.113+0000 7f1c4579a700 1 -- 172.21.15.84:0/784603095 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c4015e890 msgr2=0x7f1c401e65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:06.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.113+0000 7f1c4579a700 1 --2- 172.21.15.84:0/784603095 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c4015e890 0x7f1c401e65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:06.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.113+0000 7f1c4579a700 1 -- 172.21.15.84:0/784603095 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c400b3780 msgr2=0x7f1c4013e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:06.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.113+0000 7f1c4579a700 1 --2- 172.21.15.84:0/784603095 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c400b3780 0x7f1c4013e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:06.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.113+0000 7f1c4579a700 1 -- 172.21.15.84:0/784603095 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c300094a0 con 0x7f1c4015a8c0 2023-07-14T11:15:06.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.113+0000 7f1c4579a700 1 --2- 172.21.15.84:0/784603095 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c4015a8c0 0x7f1c401e5230 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f1c3000ebe0 tx=0x7f1c3000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:06.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.113+0000 7f1c367fc700 1 -- 172.21.15.84:0/784603095 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c30009760 con 0x7f1c4015a8c0 2023-07-14T11:15:06.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.114+0000 7f1c367fc700 1 -- 172.21.15.84:0/784603095 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c3000c850 con 0x7f1c4015a8c0 2023-07-14T11:15:06.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.114+0000 7f1c367fc700 1 -- 172.21.15.84:0/784603095 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3000cbe0 con 0x7f1c4015a8c0 2023-07-14T11:15:06.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.114+0000 7f1c481ff700 1 -- 172.21.15.84:0/784603095 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c3c009550 con 0x7f1c4015a8c0 2023-07-14T11:15:06.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.114+0000 7f1c481ff700 1 -- 172.21.15.84:0/784603095 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c401430c0 con 0x7f1c4015a8c0 2023-07-14T11:15:06.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.115+0000 7f1c481ff700 1 -- 172.21.15.84:0/784603095 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c4004e280 con 0x7f1c4015a8c0 2023-07-14T11:15:06.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.116+0000 7f1c367fc700 1 -- 172.21.15.84:0/784603095 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 7) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f1c3000cd40 con 0x7f1c4015a8c0 2023-07-14T11:15:06.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.117+0000 7f1c367fc700 1 --2- 172.21.15.84:0/784603095 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1c2406ae90 0x7f1c2406d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:06.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.117+0000 7f1c367fc700 1 -- 172.21.15.84:0/784603095 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f1c30089420 con 0x7f1c4015a8c0 2023-07-14T11:15:06.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.117+0000 7f1c45f9b700 1 --2- 172.21.15.84:0/784603095 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1c2406ae90 0x7f1c2406d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:06.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.118+0000 7f1c45f9b700 1 --2- 172.21.15.84:0/784603095 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1c2406ae90 0x7f1c2406d340 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c009130 tx=0x7f1c3c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:06.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.121+0000 7f1c367fc700 1 -- 172.21.15.84:0/784603095 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f1c30054590 con 0x7f1c4015a8c0 2023-07-14T11:15:06.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.397+0000 7f1c481ff700 1 -- 172.21.15.84:0/784603095 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f1c4006d240 con 0x7f1c4015a8c0 2023-07-14T11:15:06.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.398+0000 7f1c367fc700 1 -- 172.21.15.84:0/784603095 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f1c30057bb0 con 0x7f1c4015a8c0 2023-07-14T11:15:06.400 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:15:06.400 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-07-14T11:15:06.401 INFO:teuthology.orchestra.run.smithi084.stdout: "auth_dump": [ 2023-07-14T11:15:06.401 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:15:06.401 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.a", 2023-07-14T11:15:06.401 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCJLbFkprwsJhAAIZa03ewirqLtc0mn7ki6Vw==", 2023-07-14T11:15:06.401 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:15:06.401 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-07-14T11:15:06.401 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-07-14T11:15:06.402 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-07-14T11:15:06.402 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:15:06.402 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:15:06.402 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:15:06.402 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:15:06.402 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.b", 2023-07-14T11:15:06.402 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCKLbFkfYOoAhAAQcpDkBRXNSDyfnZp1A/BJw==", 2023-07-14T11:15:06.403 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:15:06.403 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-07-14T11:15:06.403 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-07-14T11:15:06.403 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-07-14T11:15:06.403 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:15:06.403 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:15:06.403 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:15:06.404 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:15:06.404 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.c", 2023-07-14T11:15:06.404 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCJLbFk9MZ4MhAAY2CpAoK7Bx7NyoccpK7MLA==", 2023-07-14T11:15:06.404 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:15:06.404 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-07-14T11:15:06.404 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-07-14T11:15:06.404 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-07-14T11:15:06.405 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:15:06.405 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:15:06.405 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:15:06.405 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:15:06.405 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.d", 2023-07-14T11:15:06.405 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCKLbFkfxxFDhAAFPvGUrg0RW1nYTAdACvEAA==", 2023-07-14T11:15:06.405 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:15:06.405 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-07-14T11:15:06.406 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-07-14T11:15:06.406 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-07-14T11:15:06.406 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:15:06.406 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:15:06.406 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:15:06.406 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:15:06.406 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.0", 2023-07-14T11:15:06.407 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCOLbFkd18mDBAA2tneRYzoJkGwIZNDW6+Z7w==", 2023-07-14T11:15:06.407 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:15:06.407 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-07-14T11:15:06.407 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-07-14T11:15:06.407 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:15:06.407 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:15:06.407 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:15:06.407 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:15:06.408 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.1", 2023-07-14T11:15:06.408 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCRLbFkwBlAEBAAoEG62Dam3KHra4oNXBGyfw==", 2023-07-14T11:15:06.408 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:15:06.408 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-07-14T11:15:06.408 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-07-14T11:15:06.408 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:15:06.408 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:15:06.409 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:15:06.409 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:15:06.409 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.2", 2023-07-14T11:15:06.409 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCULbFkCln2ExAAKM+sAwMtcH6yEbNUqHbN4Q==", 2023-07-14T11:15:06.409 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:15:06.409 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-07-14T11:15:06.409 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-07-14T11:15:06.409 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:15:06.410 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:15:06.410 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:15:06.410 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:15:06.410 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.3", 2023-07-14T11:15:06.410 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCXLbFk0ZGgFxAAgOEUoX5jqzic6bOxtG7qSw==", 2023-07-14T11:15:06.410 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:15:06.410 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-07-14T11:15:06.410 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-07-14T11:15:06.411 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:15:06.411 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:15:06.411 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:15:06.411 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:15:06.411 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.4", 2023-07-14T11:15:06.411 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCdLbFknOESLBAA9usIfRfkbbLiMOCvUR+pXQ==", 2023-07-14T11:15:06.411 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:15:06.412 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-07-14T11:15:06.412 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-07-14T11:15:06.412 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:15:06.412 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:15:06.412 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:15:06.412 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:15:06.412 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.5", 2023-07-14T11:15:06.412 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCgLbFk+Rk/LxAAGqk3ueTaGaSINPuxoW53Gw==", 2023-07-14T11:15:06.413 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:15:06.413 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-07-14T11:15:06.413 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-07-14T11:15:06.413 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:15:06.413 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:15:06.413 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:15:06.413 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:15:06.413 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.6", 2023-07-14T11:15:06.414 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCjLbFk1/QfMxAABnWxus7LXfn7R0iwMVTWiA==", 2023-07-14T11:15:06.414 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:15:06.414 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-07-14T11:15:06.414 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-07-14T11:15:06.414 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:15:06.414 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:15:06.414 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:15:06.415 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:15:06.415 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.7", 2023-07-14T11:15:06.415 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCmLbFkNnhmNhAAz85GY1Sb1NuKINJCyWpPGQ==", 2023-07-14T11:15:06.415 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:15:06.415 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-07-14T11:15:06.415 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-07-14T11:15:06.415 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:15:06.415 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:15:06.416 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:15:06.416 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:15:06.416 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.0", 2023-07-14T11:15:06.416 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCKLbFkKSl5GBAAwPK4Zs6+gv/6YKHh4JI3WA==", 2023-07-14T11:15:06.416 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:15:06.416 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-07-14T11:15:06.417 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow r", 2023-07-14T11:15:06.417 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-14T11:15:06.417 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:15:06.417 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:15:06.417 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:15:06.417 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.1", 2023-07-14T11:15:06.417 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCKLbFkieNzJxAARri6UfCWdcXA3NpeFfvILw==", 2023-07-14T11:15:06.418 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:15:06.418 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-07-14T11:15:06.418 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-07-14T11:15:06.418 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-07-14T11:15:06.418 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-07-14T11:15:06.418 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:15:06.418 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:15:06.419 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:15:06.419 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.2", 2023-07-14T11:15:06.419 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCKLbFkLhv6HxAACUfTJK618qRsXETPJagZXQ==", 2023-07-14T11:15:06.419 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:15:06.419 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-07-14T11:15:06.419 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-07-14T11:15:06.419 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-07-14T11:15:06.419 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-07-14T11:15:06.420 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:15:06.420 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:15:06.420 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:15:06.420 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.3", 2023-07-14T11:15:06.420 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCKLbFka9HxLhAA4OsQY/t7A2FIYLEyYgJ19Q==", 2023-07-14T11:15:06.420 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:15:06.420 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-07-14T11:15:06.421 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-07-14T11:15:06.421 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-07-14T11:15:06.421 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-07-14T11:15:06.421 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:15:06.421 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:15:06.421 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:15:06.421 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.admin", 2023-07-14T11:15:06.422 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCILbFkmVPbKRAAffsYBVR51b7R8sXpbdF0MQ==", 2023-07-14T11:15:06.422 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:15:06.422 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow *", 2023-07-14T11:15:06.422 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-07-14T11:15:06.422 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-07-14T11:15:06.422 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:15:06.422 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:15:06.422 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:15:06.423 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:15:06.423 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mgr.x", 2023-07-14T11:15:06.423 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCJLbFk28xTHhAAAlmm5bW9VTtgE+OujO+G2w==", 2023-07-14T11:15:06.423 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:15:06.423 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow *", 2023-07-14T11:15:06.423 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile mgr", 2023-07-14T11:15:06.423 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:15:06.423 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:15:06.424 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:15:06.424 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:15:06.424 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mgr.y", 2023-07-14T11:15:06.424 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCJLbFk5dM1FhAAJWbB+GogsfcSkaBdHrFg4A==", 2023-07-14T11:15:06.424 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:15:06.424 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow *", 2023-07-14T11:15:06.424 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile mgr", 2023-07-14T11:15:06.425 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:15:06.425 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:15:06.425 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:15:06.425 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2023-07-14T11:15:06.425 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-07-14T11:15:06.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.400+0000 7f1c481ff700 1 -- 172.21.15.84:0/784603095 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1c2406ae90 msgr2=0x7f1c2406d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:06.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.400+0000 7f1c481ff700 1 --2- 172.21.15.84:0/784603095 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1c2406ae90 0x7f1c2406d340 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c009130 tx=0x7f1c3c008030 comp rx=0 tx=0).stop 2023-07-14T11:15:06.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.400+0000 7f1c481ff700 1 -- 172.21.15.84:0/784603095 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c4015a8c0 msgr2=0x7f1c401e5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:06.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.400+0000 7f1c481ff700 1 --2- 172.21.15.84:0/784603095 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c4015a8c0 0x7f1c401e5230 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f1c3000ebe0 tx=0x7f1c3000eef0 comp rx=0 tx=0).stop 2023-07-14T11:15:06.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.400+0000 7f1c481ff700 1 -- 172.21.15.84:0/784603095 shutdown_connections 2023-07-14T11:15:06.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.400+0000 7f1c481ff700 1 --2- 172.21.15.84:0/784603095 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1c2406ae90 0x7f1c2406d340 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:06.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.400+0000 7f1c481ff700 1 --2- 172.21.15.84:0/784603095 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c4015e890 0x7f1c401e65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:06.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.400+0000 7f1c481ff700 1 --2- 172.21.15.84:0/784603095 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c400b3780 0x7f1c4013e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:06.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.400+0000 7f1c481ff700 1 --2- 172.21.15.84:0/784603095 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c4015a8c0 0x7f1c401e5230 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:06.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.400+0000 7f1c481ff700 1 -- 172.21.15.84:0/784603095 >> 172.21.15.84:0/784603095 conn(0x7f1c40069f30 msgr2=0x7f1c400cac60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:06.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.400+0000 7f1c481ff700 1 -- 172.21.15.84:0/784603095 shutdown_connections 2023-07-14T11:15:06.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.400+0000 7f1c481ff700 1 -- 172.21.15.84:0/784603095 wait complete. 2023-07-14T11:15:06.429 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:15:06.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.621+0000 7f1e291ff700 1 Processor -- start 2023-07-14T11:15:06.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.621+0000 7f1e291ff700 1 -- start start 2023-07-14T11:15:06.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.623+0000 7f1e291ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1e240d0f40 0x7f1e240cec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:06.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.623+0000 7f1e291ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e240cf1d0 con 0x7f1e2415ca30 2023-07-14T11:15:06.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.623+0000 7f1e291ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e2406c360 con 0x7f1e240ce840 2023-07-14T11:15:06.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.623+0000 7f1e291ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e2406cf00 con 0x7f1e240d0f40 2023-07-14T11:15:06.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.623+0000 7f1e22d9d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f1e2415ca30 0x7f1e2406c7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:39802/0 (socket says 172.21.15.84:39802) 2023-07-14T11:15:06.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.623+0000 7f1e22d9d700 1 -- 172.21.15.84:0/1080362204 learned_addr learned my addr 172.21.15.84:0/1080362204 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:15:06.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.623+0000 7f1e2359e700 1 --2- 172.21.15.84:0/1080362204 >> v2:172.21.15.84:3300/0 conn(0x7f1e240d0f40 0x7f1e240cec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:06.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.623+0000 7f1e2259c700 1 -- 172.21.15.84:0/1080362204 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2000627315 0 0) 0x7f1e14001110 con 0x7f1e2415ca30 2023-07-14T11:15:06.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.623+0000 7f1e2259c700 1 -- 172.21.15.84:0/1080362204 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e100035b0 con 0x7f1e2415ca30 2023-07-14T11:15:06.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.623+0000 7f1e2259c700 1 -- 172.21.15.84:0/1080362204 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 667112990 0 0) 0x7f1e2406c360 con 0x7f1e240ce840 2023-07-14T11:15:06.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.623+0000 7f1e2359e700 1 -- 172.21.15.84:0/1080362204 >> v1:172.21.15.179:6789/0 conn(0x7f1e240ce840 legacy=0x7f1e240d0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:06.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.623+0000 7f1e2359e700 1 -- 172.21.15.84:0/1080362204 >> v1:172.21.15.84:6789/0 conn(0x7f1e2415ca30 legacy=0x7f1e2406c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:06.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.623+0000 7f1e2359e700 1 -- 172.21.15.84:0/1080362204 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e2406ba50 con 0x7f1e240d0f40 2023-07-14T11:15:06.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.624+0000 7f1e2359e700 1 --2- 172.21.15.84:0/1080362204 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e240d0f40 0x7f1e240cec90 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c009d90 tx=0x7f1e1c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb8b50f100b48cd2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:06.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.624+0000 7f1e2259c700 1 -- 172.21.15.84:0/1080362204 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1c00e070 con 0x7f1e240d0f40 2023-07-14T11:15:06.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.624+0000 7f1e2259c700 1 -- 172.21.15.84:0/1080362204 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e1c00bb20 con 0x7f1e240d0f40 2023-07-14T11:15:06.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.624+0000 7f1e2259c700 1 -- 172.21.15.84:0/1080362204 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1c00bed0 con 0x7f1e240d0f40 2023-07-14T11:15:06.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.624+0000 7f1e291ff700 1 -- 172.21.15.84:0/1080362204 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e240d0f40 msgr2=0x7f1e240cec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:06.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.624+0000 7f1e291ff700 1 --2- 172.21.15.84:0/1080362204 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e240d0f40 0x7f1e240cec90 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c009d90 tx=0x7f1e1c00b330 comp rx=0 tx=0).stop 2023-07-14T11:15:06.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.624+0000 7f1e291ff700 1 -- 172.21.15.84:0/1080362204 shutdown_connections 2023-07-14T11:15:06.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.624+0000 7f1e291ff700 1 --2- 172.21.15.84:0/1080362204 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e240d0f40 0x7f1e240cec90 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:06.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.624+0000 7f1e291ff700 1 -- 172.21.15.84:0/1080362204 >> 172.21.15.84:0/1080362204 conn(0x7f1e240664f0 msgr2=0x7f1e24099fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:06.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.625+0000 7f1e291ff700 1 -- 172.21.15.84:0/1080362204 shutdown_connections 2023-07-14T11:15:06.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.625+0000 7f1e291ff700 1 -- 172.21.15.84:0/1080362204 wait complete. 2023-07-14T11:15:06.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.626+0000 7f1e291ff700 1 Processor -- start 2023-07-14T11:15:06.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.626+0000 7f1e291ff700 1 -- start start 2023-07-14T11:15:06.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.627+0000 7f1e291ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e240ce840 0x7f1e240c72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:06.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.627+0000 7f1e291ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e240d0f40 0x7f1e241f5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:06.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.627+0000 7f1e291ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e2415ca30 0x7f1e241f5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:06.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.627+0000 7f1e291ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e240c5af0 con 0x7f1e240ce840 2023-07-14T11:15:06.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.627+0000 7f1e291ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e240c4a50 con 0x7f1e2415ca30 2023-07-14T11:15:06.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.627+0000 7f1e291ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e240c4d30 con 0x7f1e240d0f40 2023-07-14T11:15:06.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.627+0000 7f1e22d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e240ce840 0x7f1e240c72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:06.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.627+0000 7f1e22d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e240ce840 0x7f1e240c72d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48208/0 (socket says 172.21.15.84:48208) 2023-07-14T11:15:06.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.627+0000 7f1e22d9d700 1 -- 172.21.15.84:0/3617872134 learned_addr learned my addr 172.21.15.84:0/3617872134 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:06.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.628+0000 7f1e2359e700 1 --2- 172.21.15.84:0/3617872134 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e2415ca30 0x7f1e241f5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:06.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.628+0000 7f1e1bfff700 1 --2- 172.21.15.84:0/3617872134 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e240d0f40 0x7f1e241f5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:06.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.628+0000 7f1e22d9d700 1 -- 172.21.15.84:0/3617872134 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e240d0f40 msgr2=0x7f1e241f5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:06.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.628+0000 7f1e22d9d700 1 --2- 172.21.15.84:0/3617872134 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e240d0f40 0x7f1e241f5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:06.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.628+0000 7f1e22d9d700 1 -- 172.21.15.84:0/3617872134 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e2415ca30 msgr2=0x7f1e241f5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:06.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.628+0000 7f1e22d9d700 1 --2- 172.21.15.84:0/3617872134 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e2415ca30 0x7f1e241f5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:06.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.628+0000 7f1e22d9d700 1 -- 172.21.15.84:0/3617872134 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e1c009a70 con 0x7f1e240ce840 2023-07-14T11:15:06.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.628+0000 7f1e1bfff700 1 --2- 172.21.15.84:0/3617872134 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e240d0f40 0x7f1e241f5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:15:06.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.628+0000 7f1e22d9d700 1 --2- 172.21.15.84:0/3617872134 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e240ce840 0x7f1e240c72d0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f1e1400c420 tx=0x7f1e1400c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:06.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.628+0000 7f1e1b7fe700 1 -- 172.21.15.84:0/3617872134 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e14005d70 con 0x7f1e240ce840 2023-07-14T11:15:06.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.628+0000 7f1e1b7fe700 1 -- 172.21.15.84:0/3617872134 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e140070d0 con 0x7f1e240ce840 2023-07-14T11:15:06.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.628+0000 7f1e291ff700 1 -- 172.21.15.84:0/3617872134 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e240c5010 con 0x7f1e240ce840 2023-07-14T11:15:06.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.628+0000 7f1e1b7fe700 1 -- 172.21.15.84:0/3617872134 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e14007480 con 0x7f1e240ce840 2023-07-14T11:15:06.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.628+0000 7f1e291ff700 1 -- 172.21.15.84:0/3617872134 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e240c55d0 con 0x7f1e240ce840 2023-07-14T11:15:06.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.630+0000 7f1e291ff700 1 -- 172.21.15.84:0/3617872134 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e240cfc20 con 0x7f1e240ce840 2023-07-14T11:15:06.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.630+0000 7f1e1b7fe700 1 -- 172.21.15.84:0/3617872134 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 7) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f1e140075e0 con 0x7f1e240ce840 2023-07-14T11:15:06.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.632+0000 7f1e1b7fe700 1 --2- 172.21.15.84:0/3617872134 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1e0406ae90 0x7f1e0406d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:06.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.632+0000 7f1e1b7fe700 1 -- 172.21.15.84:0/3617872134 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f1e140887d0 con 0x7f1e240ce840 2023-07-14T11:15:06.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.632+0000 7f1e1bfff700 1 --2- 172.21.15.84:0/3617872134 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1e0406ae90 0x7f1e0406d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:06.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.632+0000 7f1e1bfff700 1 --2- 172.21.15.84:0/3617872134 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1e0406ae90 0x7f1e0406d340 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f1e241e6e00 tx=0x7f1e0c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:06.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.636+0000 7f1e1b7fe700 1 -- 172.21.15.84:0/3617872134 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f1e14053940 con 0x7f1e240ce840 2023-07-14T11:15:06.751 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T11:15:06.755 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T11:15:06.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.843+0000 7f1e291ff700 1 -- 172.21.15.84:0/3617872134 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1e240cf1d0 con 0x7f1e240ce840 2023-07-14T11:15:06.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.844+0000 7f1e1b7fe700 1 -- 172.21.15.84:0/3617872134 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+14615 (secure 0 0 0) 0x7f1e240cf1d0 con 0x7f1e240ce840 2023-07-14T11:15:06.847 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:15:06.847 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":46,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:15:05.892759+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:15:06.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.847+0000 7f1e291ff700 1 -- 172.21.15.84:0/3617872134 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1e0406ae90 msgr2=0x7f1e0406d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:06.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.847+0000 7f1e291ff700 1 --2- 172.21.15.84:0/3617872134 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1e0406ae90 0x7f1e0406d340 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f1e241e6e00 tx=0x7f1e0c009040 comp rx=0 tx=0).stop 2023-07-14T11:15:06.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.847+0000 7f1e291ff700 1 -- 172.21.15.84:0/3617872134 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e240ce840 msgr2=0x7f1e240c72d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:06.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.847+0000 7f1e291ff700 1 --2- 172.21.15.84:0/3617872134 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e240ce840 0x7f1e240c72d0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f1e1400c420 tx=0x7f1e1400c7e0 comp rx=0 tx=0).stop 2023-07-14T11:15:06.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.847+0000 7f1e291ff700 1 -- 172.21.15.84:0/3617872134 shutdown_connections 2023-07-14T11:15:06.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.847+0000 7f1e291ff700 1 --2- 172.21.15.84:0/3617872134 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e2415ca30 0x7f1e241f5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:06.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.847+0000 7f1e291ff700 1 --2- 172.21.15.84:0/3617872134 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e240ce840 0x7f1e240c72d0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:06.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.847+0000 7f1e291ff700 1 --2- 172.21.15.84:0/3617872134 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1e0406ae90 0x7f1e0406d340 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:06.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.847+0000 7f1e291ff700 1 --2- 172.21.15.84:0/3617872134 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e240d0f40 0x7f1e241f5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:06.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.847+0000 7f1e291ff700 1 -- 172.21.15.84:0/3617872134 >> 172.21.15.84:0/3617872134 conn(0x7f1e240664f0 msgr2=0x7f1e240ae140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:06.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.847+0000 7f1e291ff700 1 -- 172.21.15.84:0/3617872134 shutdown_connections 2023-07-14T11:15:06.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:06.847+0000 7f1e291ff700 1 -- 172.21.15.84:0/3617872134 wait complete. 2023-07-14T11:15:06.868 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T11:13:00.125395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T11:13:06.803994+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T11:15:06.869 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T11:15:07.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.073+0000 7fd5995ff700 1 Processor -- start 2023-07-14T11:15:07.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.073+0000 7fd5995ff700 1 -- start start 2023-07-14T11:15:07.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.074+0000 7fd5995ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd5940cb330 0x7fd5940cc220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:07.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.074+0000 7fd5995ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5940b0560 con 0x7fd59406b750 2023-07-14T11:15:07.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.074+0000 7fd5995ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5940cc760 con 0x7fd5940d12c0 2023-07-14T11:15:07.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.074+0000 7fd5995ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5940d1690 con 0x7fd5940cb330 2023-07-14T11:15:07.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.075+0000 7fd5927fc700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fd59406b750 0x7fd5940b0cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:39812/0 (socket says 172.21.15.84:39812) 2023-07-14T11:15:07.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.075+0000 7fd5927fc700 1 -- 172.21.15.84:0/334934207 learned_addr learned my addr 172.21.15.84:0/334934207 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:15:07.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.075+0000 7fd5937fe700 1 --2- 172.21.15.84:0/334934207 >> v2:172.21.15.179:3300/0 conn(0x7fd5940cb330 0x7fd5940cc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:07.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.075+0000 7fd591ffb700 1 -- 172.21.15.84:0/334934207 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1578461379 0 0) 0x7fd5940b0560 con 0x7fd59406b750 2023-07-14T11:15:07.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.075+0000 7fd591ffb700 1 -- 172.21.15.84:0/334934207 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd57c0035b0 con 0x7fd59406b750 2023-07-14T11:15:07.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.075+0000 7fd591ffb700 1 -- 172.21.15.84:0/334934207 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 847017617 0 0) 0x7fd5940cc760 con 0x7fd5940d12c0 2023-07-14T11:15:07.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.075+0000 7fd591ffb700 1 -- 172.21.15.84:0/334934207 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5940b0560 con 0x7fd5940d12c0 2023-07-14T11:15:07.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.075+0000 7fd591ffb700 1 -- 172.21.15.84:0/334934207 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 863135314 0 0) 0x7fd57c0035b0 con 0x7fd59406b750 2023-07-14T11:15:07.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.075+0000 7fd591ffb700 1 -- 172.21.15.84:0/334934207 >> v2:172.21.15.179:3300/0 conn(0x7fd5940cb330 msgr2=0x7fd5940cc220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:07.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.075+0000 7fd591ffb700 1 --2- 172.21.15.84:0/334934207 >> v2:172.21.15.179:3300/0 conn(0x7fd5940cb330 0x7fd5940cc220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:07.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.075+0000 7fd591ffb700 1 -- 172.21.15.84:0/334934207 >> v1:172.21.15.179:6789/0 conn(0x7fd5940d12c0 legacy=0x7fd59406b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:07.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.075+0000 7fd591ffb700 1 -- 172.21.15.84:0/334934207 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd59415ced0 con 0x7fd59406b750 2023-07-14T11:15:07.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.075+0000 7fd591ffb700 1 -- 172.21.15.84:0/334934207 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7fd588001670 con 0x7fd59406b750 2023-07-14T11:15:07.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.075+0000 7fd591ffb700 1 -- 172.21.15.84:0/334934207 >> v1:172.21.15.84:6789/0 conn(0x7fd59406b750 legacy=0x7fd5940b0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:07.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.075+0000 7fd591ffb700 1 --2- 172.21.15.84:0/334934207 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd57c003be0 0x7fd57c003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:07.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.076+0000 7fd591ffb700 1 --2- 172.21.15.84:0/334934207 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd57c004850 0x7fd57c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:07.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.076+0000 7fd591ffb700 1 --2- 172.21.15.84:0/334934207 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd57c005200 0x7fd57c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:07.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.076+0000 7fd591ffb700 1 -- 172.21.15.84:0/334934207 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5940d1690 con 0x7fd57c004850 2023-07-14T11:15:07.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.076+0000 7fd591ffb700 1 -- 172.21.15.84:0/334934207 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd57c00c0e0 con 0x7fd57c003be0 2023-07-14T11:15:07.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.076+0000 7fd591ffb700 1 -- 172.21.15.84:0/334934207 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd57c00c270 con 0x7fd57c005200 2023-07-14T11:15:07.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.076+0000 7fd5927fc700 1 --2- 172.21.15.84:0/334934207 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd57c004850 0x7fd57c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:07.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.076+0000 7fd592ffd700 1 --2- 172.21.15.84:0/334934207 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd57c003be0 0x7fd57c003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:07.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.076+0000 7fd5937fe700 1 --2- 172.21.15.84:0/334934207 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd57c005200 0x7fd57c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:07.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.076+0000 7fd5927fc700 1 -- 172.21.15.84:0/334934207 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd57c005200 msgr2=0x7fd57c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:07.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.076+0000 7fd5927fc700 1 --2- 172.21.15.84:0/334934207 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd57c005200 0x7fd57c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:07.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.076+0000 7fd5927fc700 1 -- 172.21.15.84:0/334934207 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd57c003be0 msgr2=0x7fd57c003fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:07.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.076+0000 7fd5927fc700 1 --2- 172.21.15.84:0/334934207 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd57c003be0 0x7fd57c003fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:07.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.076+0000 7fd5927fc700 1 -- 172.21.15.84:0/334934207 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd57c0035b0 con 0x7fd57c004850 2023-07-14T11:15:07.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.076+0000 7fd5937fe700 1 -- 172.21.15.84:0/334934207 reap_dead start 2023-07-14T11:15:07.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.076+0000 7fd5927fc700 1 --2- 172.21.15.84:0/334934207 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd57c004850 0x7fd57c004cc0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fd59406bb40 tx=0x7fd57c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acea8ad980dc2dee server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:07.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.077+0000 7fd591ffb700 1 -- 172.21.15.84:0/334934207 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58800cc50 con 0x7fd57c004850 2023-07-14T11:15:07.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.077+0000 7fd591ffb700 1 -- 172.21.15.84:0/334934207 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd58800cdb0 con 0x7fd57c004850 2023-07-14T11:15:07.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.077+0000 7fd591ffb700 1 -- 172.21.15.84:0/334934207 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd588005ba0 con 0x7fd57c004850 2023-07-14T11:15:07.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.077+0000 7fd5995ff700 1 -- 172.21.15.84:0/334934207 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd57c004850 msgr2=0x7fd57c004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:07.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.077+0000 7fd5995ff700 1 --2- 172.21.15.84:0/334934207 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd57c004850 0x7fd57c004cc0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fd59406bb40 tx=0x7fd57c005880 comp rx=0 tx=0).stop 2023-07-14T11:15:07.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.077+0000 7fd5995ff700 1 -- 172.21.15.84:0/334934207 shutdown_connections 2023-07-14T11:15:07.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.077+0000 7fd5995ff700 1 --2- 172.21.15.84:0/334934207 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd57c004850 0x7fd57c004cc0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:07.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.077+0000 7fd5995ff700 1 -- 172.21.15.84:0/334934207 >> 172.21.15.84:0/334934207 conn(0x7fd5940999e0 msgr2=0x7fd594099de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:07.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.077+0000 7fd5995ff700 1 -- 172.21.15.84:0/334934207 shutdown_connections 2023-07-14T11:15:07.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.077+0000 7fd5995ff700 1 -- 172.21.15.84:0/334934207 wait complete. 2023-07-14T11:15:07.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.079+0000 7fd5995ff700 1 Processor -- start 2023-07-14T11:15:07.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.079+0000 7fd5995ff700 1 -- start start 2023-07-14T11:15:07.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.080+0000 7fd5995ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd57c004850 0x7fd59415d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:07.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.080+0000 7fd5995ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd59414e300 0x7fd5941f1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:07.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.080+0000 7fd5995ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5940c8790 0x7fd5940c93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:07.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.080+0000 7fd5995ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5940ad8e0 con 0x7fd59414e300 2023-07-14T11:15:07.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.080+0000 7fd5995ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5941f2400 con 0x7fd57c004850 2023-07-14T11:15:07.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.080+0000 7fd5995ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5940c8f60 con 0x7fd5940c8790 2023-07-14T11:15:07.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.080+0000 7fd5927fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd59414e300 0x7fd5941f1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:07.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.080+0000 7fd5927fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd59414e300 0x7fd5941f1ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48226/0 (socket says 172.21.15.84:48226) 2023-07-14T11:15:07.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.080+0000 7fd5927fc700 1 -- 172.21.15.84:0/1323593706 learned_addr learned my addr 172.21.15.84:0/1323593706 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:07.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.080+0000 7fd592ffd700 1 --2- 172.21.15.84:0/1323593706 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd57c004850 0x7fd59415d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:07.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.081+0000 7fd5937fe700 1 --2- 172.21.15.84:0/1323593706 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5940c8790 0x7fd5940c93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:07.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.081+0000 7fd5927fc700 1 -- 172.21.15.84:0/1323593706 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5940c8790 msgr2=0x7fd5940c93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:07.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.081+0000 7fd5927fc700 1 --2- 172.21.15.84:0/1323593706 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5940c8790 0x7fd5940c93b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:07.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.081+0000 7fd5927fc700 1 -- 172.21.15.84:0/1323593706 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd57c004850 msgr2=0x7fd59415d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:07.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.081+0000 7fd5927fc700 1 --2- 172.21.15.84:0/1323593706 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd57c004850 0x7fd59415d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:07.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.081+0000 7fd5927fc700 1 -- 172.21.15.84:0/1323593706 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5940adac0 con 0x7fd59414e300 2023-07-14T11:15:07.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.081+0000 7fd5927fc700 1 --2- 172.21.15.84:0/1323593706 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd59414e300 0x7fd5941f1ec0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fd58800c6a0 tx=0x7fd588001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:07.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.081+0000 7fd57b7fe700 1 -- 172.21.15.84:0/1323593706 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5880072d0 con 0x7fd59414e300 2023-07-14T11:15:07.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.081+0000 7fd57b7fe700 1 -- 172.21.15.84:0/1323593706 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd588007450 con 0x7fd59414e300 2023-07-14T11:15:07.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.081+0000 7fd5995ff700 1 -- 172.21.15.84:0/1323593706 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5940adda0 con 0x7fd59414e300 2023-07-14T11:15:07.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.081+0000 7fd57b7fe700 1 -- 172.21.15.84:0/1323593706 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd588007800 con 0x7fd59414e300 2023-07-14T11:15:07.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.081+0000 7fd5995ff700 1 -- 172.21.15.84:0/1323593706 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5940c8c00 con 0x7fd59414e300 2023-07-14T11:15:07.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.082+0000 7fd5995ff700 1 -- 172.21.15.84:0/1323593706 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5940ad8e0 con 0x7fd59414e300 2023-07-14T11:15:07.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.083+0000 7fd57b7fe700 1 -- 172.21.15.84:0/1323593706 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 7) v1 ==== 89190+0+0 (secure 0 0 0) 0x7fd58801e430 con 0x7fd59414e300 2023-07-14T11:15:07.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.084+0000 7fd57b7fe700 1 --2- 172.21.15.84:0/1323593706 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fd58006ae90 0x7fd58006d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:07.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.084+0000 7fd57b7fe700 1 -- 172.21.15.84:0/1323593706 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd58808a040 con 0x7fd59414e300 2023-07-14T11:15:07.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.084+0000 7fd592ffd700 1 --2- 172.21.15.84:0/1323593706 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fd58006ae90 0x7fd58006d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:07.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.085+0000 7fd592ffd700 1 --2- 172.21.15.84:0/1323593706 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fd58006ae90 0x7fd58006d340 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd584007fd0 tx=0x7fd584009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:07.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.089+0000 7fd57b7fe700 1 -- 172.21.15.84:0/1323593706 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fd588055250 con 0x7fd59414e300 2023-07-14T11:15:07.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.284+0000 7fd5995ff700 1 -- 172.21.15.84:0/1323593706 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd5940af900 con 0x7fd59414e300 2023-07-14T11:15:07.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.284+0000 7fd57b7fe700 1 -- 172.21.15.84:0/1323593706 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v46) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd588058870 con 0x7fd59414e300 2023-07-14T11:15:07.287 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-07-14T11:15:07.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.286+0000 7fd5995ff700 1 -- 172.21.15.84:0/1323593706 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fd58006ae90 msgr2=0x7fd58006d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:07.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.286+0000 7fd5995ff700 1 --2- 172.21.15.84:0/1323593706 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fd58006ae90 0x7fd58006d340 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd584007fd0 tx=0x7fd584009040 comp rx=0 tx=0).stop 2023-07-14T11:15:07.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.286+0000 7fd5995ff700 1 -- 172.21.15.84:0/1323593706 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd59414e300 msgr2=0x7fd5941f1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:07.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.286+0000 7fd5995ff700 1 --2- 172.21.15.84:0/1323593706 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd59414e300 0x7fd5941f1ec0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fd58800c6a0 tx=0x7fd588001930 comp rx=0 tx=0).stop 2023-07-14T11:15:07.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.286+0000 7fd5995ff700 1 -- 172.21.15.84:0/1323593706 shutdown_connections 2023-07-14T11:15:07.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.286+0000 7fd5995ff700 1 --2- 172.21.15.84:0/1323593706 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fd58006ae90 0x7fd58006d340 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:07.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.286+0000 7fd5995ff700 1 --2- 172.21.15.84:0/1323593706 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5940c8790 0x7fd5940c93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:07.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.286+0000 7fd5995ff700 1 --2- 172.21.15.84:0/1323593706 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd57c004850 0x7fd59415d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:07.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.286+0000 7fd5995ff700 1 --2- 172.21.15.84:0/1323593706 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd59414e300 0x7fd5941f1ec0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:07.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.287+0000 7fd5995ff700 1 -- 172.21.15.84:0/1323593706 >> 172.21.15.84:0/1323593706 conn(0x7fd5940999e0 msgr2=0x7fd5940cb810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:07.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.287+0000 7fd5995ff700 1 -- 172.21.15.84:0/1323593706 shutdown_connections 2023-07-14T11:15:07.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.287+0000 7fd5995ff700 1 -- 172.21.15.84:0/1323593706 wait complete. 2023-07-14T11:15:07.306 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T11:15:07.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.502+0000 7fe6f05ff700 1 Processor -- start 2023-07-14T11:15:07.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.503+0000 7fe6f05ff700 1 -- start start 2023-07-14T11:15:07.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.504+0000 7fe6f05ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe6e80c92d0 0x7fe6e80ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:07.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.504+0000 7fe6f05ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6e815ce70 con 0x7fe6e80b12f0 2023-07-14T11:15:07.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.504+0000 7fe6f05ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6e815d0c0 con 0x7fe6e80adea0 2023-07-14T11:15:07.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.504+0000 7fe6f05ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e815da60 con 0x7fe6e80c92d0 2023-07-14T11:15:07.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.504+0000 7fe6edb9a700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fe6e80b12f0 0x7fe6e80c96a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:39824/0 (socket says 172.21.15.84:39824) 2023-07-14T11:15:07.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.504+0000 7fe6edb9a700 1 -- 172.21.15.84:0/2734186045 learned_addr learned my addr 172.21.15.84:0/2734186045 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:15:07.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.504+0000 7fe6ee39b700 1 --2- 172.21.15.84:0/2734186045 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe6e80c92d0 0x7fe6e80ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:07.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.504+0000 7fe6ed399700 1 -- 172.21.15.84:0/2734186045 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 252955565 0 0) 0x7fe6e815ce70 con 0x7fe6e80b12f0 2023-07-14T11:15:07.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.504+0000 7fe6ed399700 1 -- 172.21.15.84:0/2734186045 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6d40035b0 con 0x7fe6e80b12f0 2023-07-14T11:15:07.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.505+0000 7fe6ed399700 1 -- 172.21.15.84:0/2734186045 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1537977671 0 0) 0x7fe6e815d0c0 con 0x7fe6e80adea0 2023-07-14T11:15:07.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.505+0000 7fe6ed399700 1 -- 172.21.15.84:0/2734186045 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6e815ce70 con 0x7fe6e80adea0 2023-07-14T11:15:07.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.505+0000 7fe6ee39b700 1 -- 172.21.15.84:0/2734186045 >> v1:172.21.15.179:6789/0 conn(0x7fe6e80adea0 legacy=0x7fe6e80cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:07.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.505+0000 7fe6ee39b700 1 -- 172.21.15.84:0/2734186045 >> v1:172.21.15.84:6789/0 conn(0x7fe6e80b12f0 legacy=0x7fe6e80c96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:07.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.505+0000 7fe6ee39b700 1 -- 172.21.15.84:0/2734186045 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e815d3a0 con 0x7fe6e80c92d0 2023-07-14T11:15:07.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.505+0000 7fe6ee39b700 1 --2- 172.21.15.84:0/2734186045 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe6e80c92d0 0x7fe6e80ad8f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe6e4009870 tx=0x7fe6e4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=311bebadfbacdff8 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:07.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.505+0000 7fe6ed399700 1 -- 172.21.15.84:0/2734186045 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e4011830 con 0x7fe6e80c92d0 2023-07-14T11:15:07.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.505+0000 7fe6ed399700 1 -- 172.21.15.84:0/2734186045 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6e4011990 con 0x7fe6e80c92d0 2023-07-14T11:15:07.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.505+0000 7fe6ed399700 1 -- 172.21.15.84:0/2734186045 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e4011d20 con 0x7fe6e80c92d0 2023-07-14T11:15:07.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.506+0000 7fe6f05ff700 1 -- 172.21.15.84:0/2734186045 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe6e80c92d0 msgr2=0x7fe6e80ad8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:07.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.506+0000 7fe6f05ff700 1 --2- 172.21.15.84:0/2734186045 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe6e80c92d0 0x7fe6e80ad8f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe6e4009870 tx=0x7fe6e4009b80 comp rx=0 tx=0).stop 2023-07-14T11:15:07.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.506+0000 7fe6f05ff700 1 -- 172.21.15.84:0/2734186045 shutdown_connections 2023-07-14T11:15:07.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.506+0000 7fe6f05ff700 1 --2- 172.21.15.84:0/2734186045 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe6e80c92d0 0x7fe6e80ad8f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:07.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.506+0000 7fe6f05ff700 1 -- 172.21.15.84:0/2734186045 >> 172.21.15.84:0/2734186045 conn(0x7fe6e80b05d0 msgr2=0x7fe6e80b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:07.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.506+0000 7fe6f05ff700 1 -- 172.21.15.84:0/2734186045 shutdown_connections 2023-07-14T11:15:07.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.506+0000 7fe6f05ff700 1 -- 172.21.15.84:0/2734186045 wait complete. 2023-07-14T11:15:07.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.507+0000 7fe6f05ff700 1 Processor -- start 2023-07-14T11:15:07.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.508+0000 7fe6f05ff700 1 -- start start 2023-07-14T11:15:07.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.508+0000 7fe6f05ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe6e80adea0 0x7fe6e806c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:07.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.508+0000 7fe6f05ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6e80b12f0 0x7fe6e806b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:07.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.509+0000 7fe6f05ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe6e80c92d0 0x7fe6e80c7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:07.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.509+0000 7fe6f05ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e81f22b0 con 0x7fe6e80b12f0 2023-07-14T11:15:07.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.509+0000 7fe6f05ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e806c880 con 0x7fe6e80c92d0 2023-07-14T11:15:07.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.509+0000 7fe6f05ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e81f5cb0 con 0x7fe6e80adea0 2023-07-14T11:15:07.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.509+0000 7fe6edb9a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6e80b12f0 0x7fe6e806b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:07.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.509+0000 7fe6edb9a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6e80b12f0 0x7fe6e806b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48230/0 (socket says 172.21.15.84:48230) 2023-07-14T11:15:07.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.509+0000 7fe6edb9a700 1 -- 172.21.15.84:0/111539155 learned_addr learned my addr 172.21.15.84:0/111539155 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:07.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.509+0000 7fe6ee39b700 1 --2- 172.21.15.84:0/111539155 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe6e80adea0 0x7fe6e806c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:07.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.509+0000 7fe6eeb9c700 1 --2- 172.21.15.84:0/111539155 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe6e80c92d0 0x7fe6e80c7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:07.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.509+0000 7fe6edb9a700 1 -- 172.21.15.84:0/111539155 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe6e80adea0 msgr2=0x7fe6e806c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:07.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.509+0000 7fe6edb9a700 1 --2- 172.21.15.84:0/111539155 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe6e80adea0 0x7fe6e806c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:07.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.509+0000 7fe6edb9a700 1 -- 172.21.15.84:0/111539155 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe6e80c92d0 msgr2=0x7fe6e80c7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:07.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.509+0000 7fe6edb9a700 1 --2- 172.21.15.84:0/111539155 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe6e80c92d0 0x7fe6e80c7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:07.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.509+0000 7fe6edb9a700 1 -- 172.21.15.84:0/111539155 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e40094a0 con 0x7fe6e80b12f0 2023-07-14T11:15:07.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.509+0000 7fe6edb9a700 1 --2- 172.21.15.84:0/111539155 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6e80b12f0 0x7fe6e806b5b0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fe6d800c700 tx=0x7fe6d800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:07.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.510+0000 7fe6deffd700 1 -- 172.21.15.84:0/111539155 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d8005d70 con 0x7fe6e80b12f0 2023-07-14T11:15:07.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.510+0000 7fe6deffd700 1 -- 172.21.15.84:0/111539155 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6d80070d0 con 0x7fe6e80b12f0 2023-07-14T11:15:07.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.510+0000 7fe6deffd700 1 -- 172.21.15.84:0/111539155 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d8007460 con 0x7fe6e80b12f0 2023-07-14T11:15:07.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.510+0000 7fe6f05ff700 1 -- 172.21.15.84:0/111539155 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6e81f5f90 con 0x7fe6e80b12f0 2023-07-14T11:15:07.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.510+0000 7fe6f05ff700 1 -- 172.21.15.84:0/111539155 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6e81f6550 con 0x7fe6e80b12f0 2023-07-14T11:15:07.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.511+0000 7fe6f05ff700 1 -- 172.21.15.84:0/111539155 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6e8074350 con 0x7fe6e80b12f0 2023-07-14T11:15:07.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.512+0000 7fe6deffd700 1 -- 172.21.15.84:0/111539155 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 7) v1 ==== 89190+0+0 (secure 0 0 0) 0x7fe6d80075c0 con 0x7fe6e80b12f0 2023-07-14T11:15:07.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.513+0000 7fe6deffd700 1 --2- 172.21.15.84:0/111539155 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe6cc06ae90 0x7fe6cc06d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:07.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.513+0000 7fe6deffd700 1 -- 172.21.15.84:0/111539155 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fe6d8088950 con 0x7fe6e80b12f0 2023-07-14T11:15:07.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.513+0000 7fe6ee39b700 1 --2- 172.21.15.84:0/111539155 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe6cc06ae90 0x7fe6cc06d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:07.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.513+0000 7fe6ee39b700 1 --2- 172.21.15.84:0/111539155 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe6cc06ae90 0x7fe6cc06d340 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe6e40090b0 tx=0x7fe6e401c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:07.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.517+0000 7fe6deffd700 1 -- 172.21.15.84:0/111539155 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe6d8053a30 con 0x7fe6e80b12f0 2023-07-14T11:15:07.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.712+0000 7fe6f05ff700 1 -- 172.21.15.84:0/111539155 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe6e80b4a40 con 0x7fe6e80b12f0 2023-07-14T11:15:07.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.713+0000 7fe6deffd700 1 -- 172.21.15.84:0/111539155 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v46) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe6d80170a0 con 0x7fe6e80b12f0 2023-07-14T11:15:07.716 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-07-14T11:15:07.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.715+0000 7fe6f05ff700 1 -- 172.21.15.84:0/111539155 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe6cc06ae90 msgr2=0x7fe6cc06d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:07.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.715+0000 7fe6f05ff700 1 --2- 172.21.15.84:0/111539155 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe6cc06ae90 0x7fe6cc06d340 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe6e40090b0 tx=0x7fe6e401c040 comp rx=0 tx=0).stop 2023-07-14T11:15:07.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.715+0000 7fe6f05ff700 1 -- 172.21.15.84:0/111539155 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6e80b12f0 msgr2=0x7fe6e806b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:07.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.715+0000 7fe6f05ff700 1 --2- 172.21.15.84:0/111539155 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6e80b12f0 0x7fe6e806b5b0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fe6d800c700 tx=0x7fe6d800ca10 comp rx=0 tx=0).stop 2023-07-14T11:15:07.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.715+0000 7fe6f05ff700 1 -- 172.21.15.84:0/111539155 shutdown_connections 2023-07-14T11:15:07.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.715+0000 7fe6f05ff700 1 --2- 172.21.15.84:0/111539155 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe6cc06ae90 0x7fe6cc06d340 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:07.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.715+0000 7fe6f05ff700 1 --2- 172.21.15.84:0/111539155 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe6e80adea0 0x7fe6e806c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:07.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.715+0000 7fe6f05ff700 1 --2- 172.21.15.84:0/111539155 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe6e80c92d0 0x7fe6e80c7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:07.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.715+0000 7fe6f05ff700 1 --2- 172.21.15.84:0/111539155 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6e80b12f0 0x7fe6e806b5b0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:07.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.715+0000 7fe6f05ff700 1 -- 172.21.15.84:0/111539155 >> 172.21.15.84:0/111539155 conn(0x7fe6e80b05d0 msgr2=0x7fe6e80ae8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:07.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.715+0000 7fe6f05ff700 1 -- 172.21.15.84:0/111539155 shutdown_connections 2023-07-14T11:15:07.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.715+0000 7fe6f05ff700 1 -- 172.21.15.84:0/111539155 wait complete. 2023-07-14T11:15:07.735 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-14T11:15:07.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.930+0000 7f1aeffff700 1 Processor -- start 2023-07-14T11:15:07.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.930+0000 7f1aeffff700 1 -- start start 2023-07-14T11:15:07.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.931+0000 7f1aeffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1ae80b5d90 0x7f1ae80b6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:07.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.931+0000 7f1aeffff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ae80b7f50 con 0x7f1ae80d0b10 2023-07-14T11:15:07.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.931+0000 7f1aeffff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ae80cdca0 con 0x7f1ae80b4510 2023-07-14T11:15:07.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.931+0000 7f1aeffff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ae80b48e0 con 0x7f1ae80b5d90 2023-07-14T11:15:07.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.932+0000 7f1aed59a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1ae80b5d90 0x7f1ae80b6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:07.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.932+0000 7f1aed59a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1ae80b5d90 0x7f1ae80b6c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48236/0 (socket says 172.21.15.84:48236) 2023-07-14T11:15:07.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.932+0000 7f1aee59c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f1ae80d0b10 0x7f1ae80b83e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:39836/0 (socket says 172.21.15.84:39836) 2023-07-14T11:15:07.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.932+0000 7f1aed59a700 1 -- 172.21.15.84:0/3551838870 learned_addr learned my addr 172.21.15.84:0/3551838870 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:07.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.932+0000 7f1aed59a700 1 -- 172.21.15.84:0/3551838870 >> v1:172.21.15.179:6789/0 conn(0x7f1ae80b4510 legacy=0x7f1ae80cd590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:07.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.932+0000 7f1aed59a700 1 -- 172.21.15.84:0/3551838870 >> v1:172.21.15.84:6789/0 conn(0x7f1ae80d0b10 legacy=0x7f1ae80b83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:07.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.932+0000 7f1aed59a700 1 -- 172.21.15.84:0/3551838870 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ae80b7340 con 0x7f1ae80b5d90 2023-07-14T11:15:07.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.932+0000 7f1aed59a700 1 --2- 172.21.15.84:0/3551838870 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ae80b5d90 0x7f1ae80b6c80 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f1ad80098f0 tx=0x7f1ad8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9d59c9ac6e605bd server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:07.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.933+0000 7f1aecd99700 1 -- 172.21.15.84:0/3551838870 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad800b8a0 con 0x7f1ae80b5d90 2023-07-14T11:15:07.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.933+0000 7f1aecd99700 1 -- 172.21.15.84:0/3551838870 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ad800ba00 con 0x7f1ae80b5d90 2023-07-14T11:15:07.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.933+0000 7f1aecd99700 1 -- 172.21.15.84:0/3551838870 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad800bd90 con 0x7f1ae80b5d90 2023-07-14T11:15:07.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.933+0000 7f1aeffff700 1 -- 172.21.15.84:0/3551838870 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ae80b5d90 msgr2=0x7f1ae80b6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:07.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.933+0000 7f1aeffff700 1 --2- 172.21.15.84:0/3551838870 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ae80b5d90 0x7f1ae80b6c80 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f1ad80098f0 tx=0x7f1ad8009c00 comp rx=0 tx=0).stop 2023-07-14T11:15:07.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.933+0000 7f1aeffff700 1 -- 172.21.15.84:0/3551838870 shutdown_connections 2023-07-14T11:15:07.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.933+0000 7f1aeffff700 1 --2- 172.21.15.84:0/3551838870 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ae80b5d90 0x7f1ae80b6c80 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:07.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.933+0000 7f1aeffff700 1 -- 172.21.15.84:0/3551838870 >> 172.21.15.84:0/3551838870 conn(0x7f1ae809c1d0 msgr2=0x7f1ae80d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:07.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.933+0000 7f1aeffff700 1 -- 172.21.15.84:0/3551838870 shutdown_connections 2023-07-14T11:15:07.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.933+0000 7f1aeffff700 1 -- 172.21.15.84:0/3551838870 wait complete. 2023-07-14T11:15:07.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.935+0000 7f1aeffff700 1 Processor -- start 2023-07-14T11:15:07.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.935+0000 7f1aeffff700 1 -- start start 2023-07-14T11:15:07.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.936+0000 7f1aeffff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ae80b4510 0x7f1ae8147260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:07.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.936+0000 7f1aeffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ae80b5d90 0x7f1ae8155380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:07.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.936+0000 7f1aeffff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ae80d0b10 0x7f1ae8156ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:07.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.936+0000 7f1aeffff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae8152590 con 0x7f1ae80b5d90 2023-07-14T11:15:07.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.936+0000 7f1aeffff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae81477a0 con 0x7f1ae80b4510 2023-07-14T11:15:07.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.936+0000 7f1aeffff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae8158690 con 0x7f1ae80d0b10 2023-07-14T11:15:07.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.936+0000 7f1aed59a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ae80b5d90 0x7f1ae8155380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:07.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.936+0000 7f1aed59a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ae80b5d90 0x7f1ae8155380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48238/0 (socket says 172.21.15.84:48238) 2023-07-14T11:15:07.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.936+0000 7f1aed59a700 1 -- 172.21.15.84:0/3043226794 learned_addr learned my addr 172.21.15.84:0/3043226794 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:07.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.937+0000 7f1aed59a700 1 -- 172.21.15.84:0/3043226794 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ae80d0b10 msgr2=0x7f1ae8156ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:07.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.937+0000 7f1aed59a700 1 --2- 172.21.15.84:0/3043226794 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ae80d0b10 0x7f1ae8156ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:07.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.937+0000 7f1aed59a700 1 -- 172.21.15.84:0/3043226794 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ae80b4510 msgr2=0x7f1ae8147260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:07.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.937+0000 7f1aed59a700 1 --2- 172.21.15.84:0/3043226794 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ae80b4510 0x7f1ae8147260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:07.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.937+0000 7f1aed59a700 1 -- 172.21.15.84:0/3043226794 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad8009550 con 0x7f1ae80b5d90 2023-07-14T11:15:07.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.937+0000 7f1aed59a700 1 --2- 172.21.15.84:0/3043226794 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ae80b5d90 0x7f1ae8155380 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f1ad8009130 tx=0x7f1ad8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:07.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.937+0000 7f1ade7fc700 1 -- 172.21.15.84:0/3043226794 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad80038a0 con 0x7f1ae80b5d90 2023-07-14T11:15:07.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.937+0000 7f1ade7fc700 1 -- 172.21.15.84:0/3043226794 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ad801e070 con 0x7f1ae80b5d90 2023-07-14T11:15:07.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.937+0000 7f1ade7fc700 1 -- 172.21.15.84:0/3043226794 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad8003c20 con 0x7f1ae80b5d90 2023-07-14T11:15:07.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.937+0000 7f1aeffff700 1 -- 172.21.15.84:0/3043226794 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ae8157df0 con 0x7f1ae80b5d90 2023-07-14T11:15:07.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.937+0000 7f1aeffff700 1 -- 172.21.15.84:0/3043226794 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ae81583b0 con 0x7f1ae80b5d90 2023-07-14T11:15:07.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.938+0000 7f1aeffff700 1 -- 172.21.15.84:0/3043226794 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ae804e280 con 0x7f1ae80b5d90 2023-07-14T11:15:07.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.939+0000 7f1ade7fc700 1 -- 172.21.15.84:0/3043226794 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 7) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f1ad8011420 con 0x7f1ae80b5d90 2023-07-14T11:15:07.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.941+0000 7f1ade7fc700 1 --2- 172.21.15.84:0/3043226794 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1acc06ae90 0x7f1acc06d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:07.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.941+0000 7f1ade7fc700 1 -- 172.21.15.84:0/3043226794 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f1ad8020070 con 0x7f1ae80b5d90 2023-07-14T11:15:07.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.941+0000 7f1aedd9b700 1 --2- 172.21.15.84:0/3043226794 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1acc06ae90 0x7f1acc06d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:07.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.941+0000 7f1aedd9b700 1 --2- 172.21.15.84:0/3043226794 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1acc06ae90 0x7f1acc06d340 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1ae4000fb0 tx=0x7f1ae4007a30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:07.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:07.945+0000 7f1ade7fc700 1 -- 172.21.15.84:0/3043226794 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f1ad8055c50 con 0x7f1ae80b5d90 2023-07-14T11:15:08.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.142+0000 7f1aeffff700 1 -- 172.21.15.84:0/3043226794 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f1ae808b890 con 0x7f1ae80b5d90 2023-07-14T11:15:08.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.142+0000 7f1ade7fc700 1 -- 172.21.15.84:0/3043226794 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v46) v1 ==== 84+0+126 (secure 0 0 0) 0x7f1ad8059270 con 0x7f1ae80b5d90 2023-07-14T11:15:08.145 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:15:08.145 INFO:teuthology.orchestra.run.smithi084.stdout:[ 2023-07-14T11:15:08.145 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:15:08.145 INFO:teuthology.orchestra.run.smithi084.stdout: "poolnum": 1, 2023-07-14T11:15:08.145 INFO:teuthology.orchestra.run.smithi084.stdout: "poolname": ".mgr" 2023-07-14T11:15:08.146 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:15:08.146 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:15:08.146 INFO:teuthology.orchestra.run.smithi084.stdout: "poolnum": 2, 2023-07-14T11:15:08.146 INFO:teuthology.orchestra.run.smithi084.stdout: "poolname": "rbd" 2023-07-14T11:15:08.146 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:15:08.146 INFO:teuthology.orchestra.run.smithi084.stdout:] 2023-07-14T11:15:08.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.144+0000 7f1aeffff700 1 -- 172.21.15.84:0/3043226794 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1acc06ae90 msgr2=0x7f1acc06d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:08.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.144+0000 7f1aeffff700 1 --2- 172.21.15.84:0/3043226794 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1acc06ae90 0x7f1acc06d340 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1ae4000fb0 tx=0x7f1ae4007a30 comp rx=0 tx=0).stop 2023-07-14T11:15:08.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.145+0000 7f1aeffff700 1 -- 172.21.15.84:0/3043226794 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ae80b5d90 msgr2=0x7f1ae8155380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:08.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.145+0000 7f1aeffff700 1 --2- 172.21.15.84:0/3043226794 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ae80b5d90 0x7f1ae8155380 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f1ad8009130 tx=0x7f1ad8004750 comp rx=0 tx=0).stop 2023-07-14T11:15:08.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.145+0000 7f1aeffff700 1 -- 172.21.15.84:0/3043226794 shutdown_connections 2023-07-14T11:15:08.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.145+0000 7f1aeffff700 1 --2- 172.21.15.84:0/3043226794 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1acc06ae90 0x7f1acc06d340 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:08.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.145+0000 7f1aeffff700 1 --2- 172.21.15.84:0/3043226794 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ae80d0b10 0x7f1ae8156ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:08.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.145+0000 7f1aeffff700 1 --2- 172.21.15.84:0/3043226794 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ae80b4510 0x7f1ae8147260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:08.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.145+0000 7f1aeffff700 1 --2- 172.21.15.84:0/3043226794 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ae80b5d90 0x7f1ae8155380 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:08.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.145+0000 7f1aeffff700 1 -- 172.21.15.84:0/3043226794 >> 172.21.15.84:0/3043226794 conn(0x7f1ae809c1d0 msgr2=0x7f1ae815b4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:08.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.145+0000 7f1aeffff700 1 -- 172.21.15.84:0/3043226794 shutdown_connections 2023-07-14T11:15:08.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.145+0000 7f1aeffff700 1 -- 172.21.15.84:0/3043226794 wait complete. 2023-07-14T11:15:08.165 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-14T11:15:08.165 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-14T11:15:08.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.361+0000 7fcf425ff700 1 Processor -- start 2023-07-14T11:15:08.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.362+0000 7fcf425ff700 1 -- start start 2023-07-14T11:15:08.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.363+0000 7fcf425ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fcf3c15a770 0x7fcf3c069f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:08.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.363+0000 7fcf425ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf3c0cbd40 0x7fcf3c06a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:08.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.363+0000 7fcf425ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf3c06e2f0 con 0x7fcf3c06f040 2023-07-14T11:15:08.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.363+0000 7fcf425ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf3c06e560 con 0x7fcf3c15a770 2023-07-14T11:15:08.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.363+0000 7fcf425ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3c06e840 con 0x7fcf3c0cbd40 2023-07-14T11:15:08.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.364+0000 7fcf40b9c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf3c0cbd40 0x7fcf3c06a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:08.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.364+0000 7fcf3b7fe700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fcf3c06f040 0x7fcf3c070860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.84:38250/0 (socket says 172.21.15.84:38250) 2023-07-14T11:15:08.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.364+0000 7fcf3b7fe700 1 -- 172.21.15.84:0/2480369213 learned_addr learned my addr 172.21.15.84:0/2480369213 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:15:08.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.364+0000 7fcf40b9c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf3c0cbd40 0x7fcf3c06a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.84:54650/0 (socket says 172.21.15.84:54650) 2023-07-14T11:15:08.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.364+0000 7fcf3bfff700 1 --2- 172.21.15.84:0/2480369213 >> v2:172.21.15.179:3300/0 conn(0x7fcf3c15a770 0x7fcf3c069f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:08.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.364+0000 7fcf3affd700 1 -- 172.21.15.84:0/2480369213 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1665007778 0 0) 0x7fcf3c06e2f0 con 0x7fcf3c06f040 2023-07-14T11:15:08.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.364+0000 7fcf3bfff700 1 -- 172.21.15.84:0/2480369213 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf3c0cbd40 msgr2=0x7fcf3c06a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:08.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.364+0000 7fcf3bfff700 1 --2- 172.21.15.84:0/2480369213 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf3c0cbd40 0x7fcf3c06a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:08.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.364+0000 7fcf3bfff700 1 -- 172.21.15.84:0/2480369213 >> v1:172.21.15.179:6789/0 conn(0x7fcf3c06f040 legacy=0x7fcf3c070860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:08.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.364+0000 7fcf3bfff700 1 -- 172.21.15.84:0/2480369213 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf3c06eb20 con 0x7fcf3c15a770 2023-07-14T11:15:08.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.364+0000 7fcf40b9c700 1 --2- 172.21.15.84:0/2480369213 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf3c0cbd40 0x7fcf3c06a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:15:08.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.364+0000 7fcf3bfff700 1 --2- 172.21.15.84:0/2480369213 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf3c15a770 0x7fcf3c069f30 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c009840 tx=0x7fcf2c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df090e979b197535 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:08.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.365+0000 7fcf3affd700 1 -- 172.21.15.84:0/2480369213 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2c011830 con 0x7fcf3c15a770 2023-07-14T11:15:08.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.365+0000 7fcf3affd700 1 -- 172.21.15.84:0/2480369213 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf2c011990 con 0x7fcf3c15a770 2023-07-14T11:15:08.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.365+0000 7fcf3affd700 1 -- 172.21.15.84:0/2480369213 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2c011d20 con 0x7fcf3c15a770 2023-07-14T11:15:08.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.365+0000 7fcf425ff700 1 -- 172.21.15.84:0/2480369213 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf3c15a770 msgr2=0x7fcf3c069f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:08.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.365+0000 7fcf425ff700 1 --2- 172.21.15.84:0/2480369213 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf3c15a770 0x7fcf3c069f30 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c009840 tx=0x7fcf2c009b50 comp rx=0 tx=0).stop 2023-07-14T11:15:08.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.365+0000 7fcf425ff700 1 -- 172.21.15.84:0/2480369213 shutdown_connections 2023-07-14T11:15:08.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.365+0000 7fcf425ff700 1 --2- 172.21.15.84:0/2480369213 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf3c0cbd40 0x7fcf3c06a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:08.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.365+0000 7fcf425ff700 1 --2- 172.21.15.84:0/2480369213 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf3c15a770 0x7fcf3c069f30 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:08.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.365+0000 7fcf425ff700 1 -- 172.21.15.84:0/2480369213 >> 172.21.15.84:0/2480369213 conn(0x7fcf3c0cd180 msgr2=0x7fcf3c0cfac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:08.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.365+0000 7fcf425ff700 1 -- 172.21.15.84:0/2480369213 shutdown_connections 2023-07-14T11:15:08.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.365+0000 7fcf425ff700 1 -- 172.21.15.84:0/2480369213 wait complete. 2023-07-14T11:15:08.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.367+0000 7fcf425ff700 1 Processor -- start 2023-07-14T11:15:08.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.367+0000 7fcf425ff700 1 -- start start 2023-07-14T11:15:08.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.368+0000 7fcf425ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf3c06f040 0x7fcf3c152cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:08.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.368+0000 7fcf425ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf3c0cbd40 0x7fcf3c0af780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:08.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.368+0000 7fcf425ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf3c15a770 0x7fcf3c154fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:08.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.368+0000 7fcf425ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3c0c8270 con 0x7fcf3c15a770 2023-07-14T11:15:08.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.368+0000 7fcf425ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3c0c8550 con 0x7fcf3c06f040 2023-07-14T11:15:08.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.368+0000 7fcf425ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3c0c8830 con 0x7fcf3c0cbd40 2023-07-14T11:15:08.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.368+0000 7fcf40b9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf3c15a770 0x7fcf3c154fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:08.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.368+0000 7fcf40b9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf3c15a770 0x7fcf3c154fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48254/0 (socket says 172.21.15.84:48254) 2023-07-14T11:15:08.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.368+0000 7fcf40b9c700 1 -- 172.21.15.84:0/2897471397 learned_addr learned my addr 172.21.15.84:0/2897471397 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:08.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.369+0000 7fcf3b7fe700 1 --2- 172.21.15.84:0/2897471397 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf3c0cbd40 0x7fcf3c0af780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:08.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.369+0000 7fcf3bfff700 1 --2- 172.21.15.84:0/2897471397 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf3c06f040 0x7fcf3c152cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:08.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.369+0000 7fcf40b9c700 1 -- 172.21.15.84:0/2897471397 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf3c0cbd40 msgr2=0x7fcf3c0af780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:08.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.369+0000 7fcf40b9c700 1 --2- 172.21.15.84:0/2897471397 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf3c0cbd40 0x7fcf3c0af780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:08.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.369+0000 7fcf40b9c700 1 -- 172.21.15.84:0/2897471397 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf3c06f040 msgr2=0x7fcf3c152cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:08.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.369+0000 7fcf40b9c700 1 --2- 172.21.15.84:0/2897471397 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf3c06f040 0x7fcf3c152cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:08.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.369+0000 7fcf40b9c700 1 -- 172.21.15.84:0/2897471397 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf34009a70 con 0x7fcf3c15a770 2023-07-14T11:15:08.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.369+0000 7fcf40b9c700 1 --2- 172.21.15.84:0/2897471397 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf3c15a770 0x7fcf3c154fc0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fcf3400efb0 tx=0x7fcf3400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:08.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.369+0000 7fcf38ff9700 1 -- 172.21.15.84:0/2897471397 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3400cc90 con 0x7fcf3c15a770 2023-07-14T11:15:08.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.369+0000 7fcf38ff9700 1 -- 172.21.15.84:0/2897471397 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf3400f040 con 0x7fcf3c15a770 2023-07-14T11:15:08.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.369+0000 7fcf38ff9700 1 -- 172.21.15.84:0/2897471397 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf34014480 con 0x7fcf3c15a770 2023-07-14T11:15:08.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.369+0000 7fcf425ff700 1 -- 172.21.15.84:0/2897471397 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf2c0094a0 con 0x7fcf3c15a770 2023-07-14T11:15:08.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.370+0000 7fcf425ff700 1 -- 172.21.15.84:0/2897471397 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf3c0c8df0 con 0x7fcf3c15a770 2023-07-14T11:15:08.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.371+0000 7fcf425ff700 1 -- 172.21.15.84:0/2897471397 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf3c074350 con 0x7fcf3c15a770 2023-07-14T11:15:08.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.372+0000 7fcf38ff9700 1 -- 172.21.15.84:0/2897471397 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 7) v1 ==== 89190+0+0 (secure 0 0 0) 0x7fcf340145e0 con 0x7fcf3c15a770 2023-07-14T11:15:08.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.372+0000 7fcf38ff9700 1 --2- 172.21.15.84:0/2897471397 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fcf2806ae90 0x7fcf2806d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:08.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.373+0000 7fcf38ff9700 1 -- 172.21.15.84:0/2897471397 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fcf3408a190 con 0x7fcf3c15a770 2023-07-14T11:15:08.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.373+0000 7fcf3bfff700 1 --2- 172.21.15.84:0/2897471397 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fcf2806ae90 0x7fcf2806d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:08.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.373+0000 7fcf3bfff700 1 --2- 172.21.15.84:0/2897471397 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fcf2806ae90 0x7fcf2806d340 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c009fd0 tx=0x7fcf2c01c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:08.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.377+0000 7fcf38ff9700 1 -- 172.21.15.84:0/2897471397 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fcf34055200 con 0x7fcf3c15a770 2023-07-14T11:15:08.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.572+0000 7fcf425ff700 1 -- 172.21.15.84:0/2897471397 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fcf3c06a4b0 con 0x7fcf3c15a770 2023-07-14T11:15:08.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.898+0000 7fcf38ff9700 1 -- 172.21.15.84:0/2897471397 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v47) v1 ==== 138+0+0 (secure 0 0 0) 0x7fcf34009d50 con 0x7fcf3c15a770 2023-07-14T11:15:08.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.902+0000 7fcf425ff700 1 -- 172.21.15.84:0/2897471397 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fcf2806ae90 msgr2=0x7fcf2806d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:08.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.902+0000 7fcf425ff700 1 --2- 172.21.15.84:0/2897471397 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fcf2806ae90 0x7fcf2806d340 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c009fd0 tx=0x7fcf2c01c040 comp rx=0 tx=0).stop 2023-07-14T11:15:08.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.902+0000 7fcf425ff700 1 -- 172.21.15.84:0/2897471397 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf3c15a770 msgr2=0x7fcf3c154fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:08.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.902+0000 7fcf425ff700 1 --2- 172.21.15.84:0/2897471397 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf3c15a770 0x7fcf3c154fc0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fcf3400efb0 tx=0x7fcf3400c3a0 comp rx=0 tx=0).stop 2023-07-14T11:15:08.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.903+0000 7fcf425ff700 1 -- 172.21.15.84:0/2897471397 shutdown_connections 2023-07-14T11:15:08.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.903+0000 7fcf425ff700 1 --2- 172.21.15.84:0/2897471397 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf3c15a770 0x7fcf3c154fc0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:08.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.903+0000 7fcf425ff700 1 --2- 172.21.15.84:0/2897471397 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf3c06f040 0x7fcf3c152cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:08.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.903+0000 7fcf425ff700 1 --2- 172.21.15.84:0/2897471397 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fcf2806ae90 0x7fcf2806d340 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:08.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.903+0000 7fcf425ff700 1 --2- 172.21.15.84:0/2897471397 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf3c0cbd40 0x7fcf3c0af780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:08.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.903+0000 7fcf425ff700 1 -- 172.21.15.84:0/2897471397 >> 172.21.15.84:0/2897471397 conn(0x7fcf3c0cd180 msgr2=0x7fcf3c070760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:08.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.903+0000 7fcf425ff700 1 -- 172.21.15.84:0/2897471397 shutdown_connections 2023-07-14T11:15:08.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:08.903+0000 7fcf425ff700 1 -- 172.21.15.84:0/2897471397 wait complete. 2023-07-14T11:15:08.907 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_metadata' created 2023-07-14T11:15:08.925 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-14T11:15:09.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:09.126+0000 7f2a87fff700 1 Processor -- start 2023-07-14T11:15:09.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:09.126+0000 7f2a87fff700 1 -- start start 2023-07-14T11:15:09.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:09.127+0000 7f2a87fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2a80158bb0 0x7f2a800cd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:09.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:09.127+0000 7f2a87fff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a800ce8c0 con 0x7f2a800ce150 2023-07-14T11:15:09.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:09.127+0000 7f2a87fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a800cc2b0 con 0x7f2a800cbe40 2023-07-14T11:15:09.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:09.127+0000 7f2a87fff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a8006b5b0 con 0x7f2a80158bb0 2023-07-14T11:15:09.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:09.127+0000 7f2a85d9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2a80158bb0 0x7f2a800cd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:09.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:09.127+0000 7f2a8659c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f2a800ce150 0x7f2a8006ba00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55228/0 (socket says 172.21.15.84:55228) 2023-07-14T11:15:09.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:09.127+0000 7f2a8659c700 1 -- 172.21.15.84:0/3115242945 learned_addr learned my addr 172.21.15.84:0/3115242945 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:15:09.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:09.128+0000 7f2a85d9b700 1 -- 172.21.15.84:0/3115242945 >> v1:172.21.15.179:6789/0 conn(0x7f2a800cbe40 legacy=0x7f2a800cda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:09.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:09.128+0000 7f2a85d9b700 1 -- 172.21.15.84:0/3115242945 >> v1:172.21.15.84:6789/0 conn(0x7f2a800ce150 legacy=0x7f2a8006ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:09.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:09.128+0000 7f2a85d9b700 1 -- 172.21.15.84:0/3115242945 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a800cae30 con 0x7f2a80158bb0 2023-07-14T11:15:09.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:09.128+0000 7f2a84d99700 1 -- 172.21.15.84:0/3115242945 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 473490613 0 0) 0x7f2a800ce8c0 con 0x7f2a800ce150 2023-07-14T11:15:09.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:09.128+0000 7f2a85d9b700 1 --2- 172.21.15.84:0/3115242945 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a80158bb0 0x7f2a800cd0a0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c00bae0 tx=0x7f2a7c00bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cde73c8b58d64685 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:09.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:09.128+0000 7f2a84d99700 1 -- 172.21.15.84:0/3115242945 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a7c00dd30 con 0x7f2a80158bb0 2023-07-14T11:15:09.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:09.128+0000 7f2a84d99700 1 -- 172.21.15.84:0/3115242945 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a7c00de90 con 0x7f2a80158bb0 2023-07-14T11:15:09.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:09.128+0000 7f2a84d99700 1 -- 172.21.15.84:0/3115242945 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a7c010690 con 0x7f2a80158bb0 2023-07-14T11:15:09.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:09.129+0000 7f2a87fff700 1 -- 172.21.15.84:0/3115242945 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a80158bb0 msgr2=0x7f2a800cd0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:09.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:09.129+0000 7f2a87fff700 1 --2- 172.21.15.84:0/3115242945 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a80158bb0 0x7f2a800cd0a0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c00bae0 tx=0x7f2a7c00bdf0 comp rx=0 tx=0).stop 2023-07-14T11:15:09.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:09.129+0000 7f2a87fff700 1 -- 172.21.15.84:0/3115242945 shutdown_connections 2023-07-14T11:15:09.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:09.129+0000 7f2a87fff700 1 --2- 172.21.15.84:0/3115242945 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a80158bb0 0x7f2a800cd0a0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:09.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:09.129+0000 7f2a87fff700 1 -- 172.21.15.84:0/3115242945 >> 172.21.15.84:0/3115242945 conn(0x7f2a800b05d0 msgr2=0x7f2a800b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:09.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:09.129+0000 7f2a87fff700 1 -- 172.21.15.84:0/3115242945 shutdown_connections 2023-07-14T11:15:09.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:09.129+0000 7f2a87fff700 1 -- 172.21.15.84:0/3115242945 wait complete. 2023-07-14T11:15:09.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:09.131+0000 7f2a87fff700 1 Processor -- start 2023-07-14T11:15:09.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:09.131+0000 7f2a87fff700 1 -- start start 2023-07-14T11:15:09.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:09.132+0000 7f2a87fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a800cbe40 0x7f2a800c25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:09.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:09.132+0000 7f2a87fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a800ce150 0x7f2a800c4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:09.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:09.132+0000 7f2a87fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a80158bb0 0x7f2a800c4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:09.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:09.132+0000 7f2a87fff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a800c4fc0 con 0x7f2a800cbe40 2023-07-14T11:15:09.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:09.132+0000 7f2a87fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a800c5250 con 0x7f2a80158bb0 2023-07-14T11:15:09.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:09.132+0000 7f2a87fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a800c5530 con 0x7f2a800ce150 2023-07-14T11:15:09.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:09.132+0000 7f2a85d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a800cbe40 0x7f2a800c25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:09.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:09.132+0000 7f2a85d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a800cbe40 0x7f2a800c25f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38538/0 (socket says 172.21.15.84:38538) 2023-07-14T11:15:09.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:09.132+0000 7f2a85d9b700 1 -- 172.21.15.84:0/2373539191 learned_addr learned my addr 172.21.15.84:0/2373539191 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:09.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:09.132+0000 7f2a85d9b700 1 -- 172.21.15.84:0/2373539191 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a800ce150 msgr2=0x7f2a800c4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:09.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:09.133+0000 7f2a85d9b700 1 --2- 172.21.15.84:0/2373539191 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a800ce150 0x7f2a800c4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:09.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:09.133+0000 7f2a85d9b700 1 -- 172.21.15.84:0/2373539191 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a80158bb0 msgr2=0x7f2a800c4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:09.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:09.133+0000 7f2a85d9b700 1 --2- 172.21.15.84:0/2373539191 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a80158bb0 0x7f2a800c4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:09.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:09.133+0000 7f2a85d9b700 1 -- 172.21.15.84:0/2373539191 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a7c00b740 con 0x7f2a800cbe40 2023-07-14T11:15:09.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:09.133+0000 7f2a85d9b700 1 --2- 172.21.15.84:0/2373539191 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a800cbe40 0x7f2a800c25f0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f2a8006ad00 tx=0x7f2a7c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:09.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:09.133+0000 7f2a767fc700 1 -- 172.21.15.84:0/2373539191 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a7c019600 con 0x7f2a800cbe40 2023-07-14T11:15:09.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:09.133+0000 7f2a767fc700 1 -- 172.21.15.84:0/2373539191 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a7c019780 con 0x7f2a800cbe40 2023-07-14T11:15:09.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:09.133+0000 7f2a767fc700 1 -- 172.21.15.84:0/2373539191 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a7c019b30 con 0x7f2a800cbe40 2023-07-14T11:15:09.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:09.133+0000 7f2a87fff700 1 -- 172.21.15.84:0/2373539191 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a8013ea60 con 0x7f2a800cbe40 2023-07-14T11:15:09.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:09.133+0000 7f2a87fff700 1 -- 172.21.15.84:0/2373539191 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a8013f020 con 0x7f2a800cbe40 2023-07-14T11:15:09.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:09.134+0000 7f2a87fff700 1 -- 172.21.15.84:0/2373539191 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a80074350 con 0x7f2a800cbe40 2023-07-14T11:15:09.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:09.135+0000 7f2a767fc700 1 -- 172.21.15.84:0/2373539191 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 7) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f2a7c02c450 con 0x7f2a800cbe40 2023-07-14T11:15:09.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:09.136+0000 7f2a767fc700 1 --2- 172.21.15.84:0/2373539191 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f2a6406ae90 0x7f2a6406d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:09.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:09.136+0000 7f2a767fc700 1 -- 172.21.15.84:0/2373539191 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f2a7c08b8e0 con 0x7f2a800cbe40 2023-07-14T11:15:09.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:09.137+0000 7f2a8559a700 1 --2- 172.21.15.84:0/2373539191 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f2a6406ae90 0x7f2a6406d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:09.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:09.137+0000 7f2a8559a700 1 --2- 172.21.15.84:0/2373539191 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f2a6406ae90 0x7f2a6406d340 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f2a80141be0 tx=0x7f2a70007a40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:09.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:09.140+0000 7f2a767fc700 1 -- 172.21.15.84:0/2373539191 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f2a7c056850 con 0x7f2a800cbe40 2023-07-14T11:15:09.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:09.334+0000 7f2a87fff700 1 -- 172.21.15.84:0/2373539191 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f2a800714e0 con 0x7f2a800cbe40 2023-07-14T11:15:09.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:09.907+0000 7f2a767fc700 1 -- 172.21.15.84:0/2373539191 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v48) v1 ==== 170+0+0 (secure 0 0 0) 0x7f2a800714e0 con 0x7f2a800cbe40 2023-07-14T11:15:09.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:09.912+0000 7f2a87fff700 1 -- 172.21.15.84:0/2373539191 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f2a6406ae90 msgr2=0x7f2a6406d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:09.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:09.912+0000 7f2a87fff700 1 --2- 172.21.15.84:0/2373539191 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f2a6406ae90 0x7f2a6406d340 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f2a80141be0 tx=0x7f2a70007a40 comp rx=0 tx=0).stop 2023-07-14T11:15:09.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:09.912+0000 7f2a87fff700 1 -- 172.21.15.84:0/2373539191 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a800cbe40 msgr2=0x7f2a800c25f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:09.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:09.912+0000 7f2a87fff700 1 --2- 172.21.15.84:0/2373539191 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a800cbe40 0x7f2a800c25f0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f2a8006ad00 tx=0x7f2a7c0047c0 comp rx=0 tx=0).stop 2023-07-14T11:15:09.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:09.913+0000 7f2a87fff700 1 -- 172.21.15.84:0/2373539191 shutdown_connections 2023-07-14T11:15:09.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:09.913+0000 7f2a87fff700 1 --2- 172.21.15.84:0/2373539191 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a80158bb0 0x7f2a800c4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:09.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:09.913+0000 7f2a87fff700 1 --2- 172.21.15.84:0/2373539191 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a800cbe40 0x7f2a800c25f0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:09.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:09.913+0000 7f2a87fff700 1 --2- 172.21.15.84:0/2373539191 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f2a6406ae90 0x7f2a6406d340 secure :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f2a80141be0 tx=0x7f2a70007a40 comp rx=0 tx=0).stop 2023-07-14T11:15:09.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:09.913+0000 7f2a87fff700 1 --2- 172.21.15.84:0/2373539191 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a800ce150 0x7f2a800c4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:09.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:09.913+0000 7f2a87fff700 1 -- 172.21.15.84:0/2373539191 >> 172.21.15.84:0/2373539191 conn(0x7f2a800b05d0 msgr2=0x7f2a800b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:09.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:09.918+0000 7f2a87fff700 1 -- 172.21.15.84:0/2373539191 shutdown_connections 2023-07-14T11:15:09.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:09.921+0000 7f2a87fff700 1 -- 172.21.15.84:0/2373539191 wait complete. 2023-07-14T11:15:09.930 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data' created 2023-07-14T11:15:09.950 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-14T11:15:10.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:10.148+0000 7fc2e9fff700 1 Processor -- start 2023-07-14T11:15:10.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:10.148+0000 7fc2e9fff700 1 -- start start 2023-07-14T11:15:10.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:10.149+0000 7fc2e9fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc2e40d0f90 0x7fc2e40b1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:10.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:10.149+0000 7fc2e9fff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2e40b8e30 con 0x7fc2e40d0b10 2023-07-14T11:15:10.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:10.149+0000 7fc2e9fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2e40afaa0 con 0x7fc2e40b8a60 2023-07-14T11:15:10.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:10.149+0000 7fc2e9fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2e40afd80 con 0x7fc2e40d0f90 2023-07-14T11:15:10.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:10.149+0000 7fc2e2ffd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fc2e40d0b10 0x7fc2e40b0e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55232/0 (socket says 172.21.15.84:55232) 2023-07-14T11:15:10.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:10.149+0000 7fc2e2ffd700 1 -- 172.21.15.84:0/3719192422 learned_addr learned my addr 172.21.15.84:0/3719192422 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:15:10.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:10.150+0000 7fc2e3fff700 1 --2- 172.21.15.84:0/3719192422 >> v2:172.21.15.179:3300/0 conn(0x7fc2e40d0f90 0x7fc2e40b1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:10.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:10.150+0000 7fc2e27fc700 1 -- 172.21.15.84:0/3719192422 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 516500975 0 0) 0x7fc2e40b8e30 con 0x7fc2e40d0b10 2023-07-14T11:15:10.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:10.150+0000 7fc2e27fc700 1 -- 172.21.15.84:0/3719192422 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2cc0035b0 con 0x7fc2e40d0b10 2023-07-14T11:15:10.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:10.150+0000 7fc2e27fc700 1 -- 172.21.15.84:0/3719192422 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 630231686 0 0) 0x7fc2e40afaa0 con 0x7fc2e40b8a60 2023-07-14T11:15:10.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:10.150+0000 7fc2e27fc700 1 -- 172.21.15.84:0/3719192422 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2e40b8e30 con 0x7fc2e40b8a60 2023-07-14T11:15:10.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:10.150+0000 7fc2e3fff700 1 -- 172.21.15.84:0/3719192422 >> v1:172.21.15.179:6789/0 conn(0x7fc2e40b8a60 legacy=0x7fc2e40b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:10.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:10.150+0000 7fc2e3fff700 1 -- 172.21.15.84:0/3719192422 >> v1:172.21.15.84:6789/0 conn(0x7fc2e40d0b10 legacy=0x7fc2e40b0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:10.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:10.150+0000 7fc2e3fff700 1 -- 172.21.15.84:0/3719192422 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e40b0060 con 0x7fc2e40d0f90 2023-07-14T11:15:10.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:10.151+0000 7fc2e3fff700 1 --2- 172.21.15.84:0/3719192422 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2e40d0f90 0x7fc2e40b1530 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc009d90 tx=0x7fc2dc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d262ca6d5e4b99a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:10.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:10.151+0000 7fc2e27fc700 1 -- 172.21.15.84:0/3719192422 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc00e070 con 0x7fc2e40d0f90 2023-07-14T11:15:10.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:10.151+0000 7fc2e27fc700 1 -- 172.21.15.84:0/3719192422 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2dc00bb20 con 0x7fc2e40d0f90 2023-07-14T11:15:10.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:10.151+0000 7fc2e27fc700 1 -- 172.21.15.84:0/3719192422 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc012430 con 0x7fc2e40d0f90 2023-07-14T11:15:10.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:10.151+0000 7fc2e9fff700 1 -- 172.21.15.84:0/3719192422 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2e40d0f90 msgr2=0x7fc2e40b1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:10.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:10.151+0000 7fc2e9fff700 1 --2- 172.21.15.84:0/3719192422 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2e40d0f90 0x7fc2e40b1530 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc009d90 tx=0x7fc2dc00b330 comp rx=0 tx=0).stop 2023-07-14T11:15:10.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:10.151+0000 7fc2e9fff700 1 -- 172.21.15.84:0/3719192422 shutdown_connections 2023-07-14T11:15:10.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:10.151+0000 7fc2e9fff700 1 --2- 172.21.15.84:0/3719192422 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2e40d0f90 0x7fc2e40b1530 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:10.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:10.152+0000 7fc2e9fff700 1 -- 172.21.15.84:0/3719192422 >> 172.21.15.84:0/3719192422 conn(0x7fc2e409c1b0 msgr2=0x7fc2e40d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:10.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:10.152+0000 7fc2e9fff700 1 -- 172.21.15.84:0/3719192422 shutdown_connections 2023-07-14T11:15:10.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:10.152+0000 7fc2e9fff700 1 -- 172.21.15.84:0/3719192422 wait complete. 2023-07-14T11:15:10.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:10.153+0000 7fc2e9fff700 1 Processor -- start 2023-07-14T11:15:10.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:10.153+0000 7fc2e9fff700 1 -- start start 2023-07-14T11:15:10.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:10.154+0000 7fc2e9fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2e40b8a60 0x7fc2e40d0200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:10.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:10.154+0000 7fc2e9fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2e40d0b10 0x7fc2e4150d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:10.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:10.154+0000 7fc2e9fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2e40d0f90 0x7fc2e40c8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:10.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:10.154+0000 7fc2e9fff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e40cec50 con 0x7fc2e40d0b10 2023-07-14T11:15:10.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:10.154+0000 7fc2e9fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e4151820 con 0x7fc2e40b8a60 2023-07-14T11:15:10.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:10.154+0000 7fc2e9fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e415e220 con 0x7fc2e40d0f90 2023-07-14T11:15:10.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:10.155+0000 7fc2e2ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2e40d0b10 0x7fc2e4150d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:10.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:10.155+0000 7fc2e37fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2e40b8a60 0x7fc2e40d0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:10.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:10.155+0000 7fc2e2ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2e40d0b10 0x7fc2e4150d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38550/0 (socket says 172.21.15.84:38550) 2023-07-14T11:15:10.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:10.155+0000 7fc2e2ffd700 1 -- 172.21.15.84:0/88903095 learned_addr learned my addr 172.21.15.84:0/88903095 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:10.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:10.155+0000 7fc2e3fff700 1 --2- 172.21.15.84:0/88903095 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2e40d0f90 0x7fc2e40c8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:10.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:10.155+0000 7fc2e3fff700 1 -- 172.21.15.84:0/88903095 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2e40b8a60 msgr2=0x7fc2e40d0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:10.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:10.155+0000 7fc2e3fff700 1 --2- 172.21.15.84:0/88903095 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2e40b8a60 0x7fc2e40d0200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:10.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:10.155+0000 7fc2e3fff700 1 -- 172.21.15.84:0/88903095 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2e40d0b10 msgr2=0x7fc2e4150d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:10.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:10.155+0000 7fc2e3fff700 1 --2- 172.21.15.84:0/88903095 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2e40d0b10 0x7fc2e4150d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:10.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:10.155+0000 7fc2e3fff700 1 -- 172.21.15.84:0/88903095 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2dc009a70 con 0x7fc2e40d0f90 2023-07-14T11:15:10.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:10.155+0000 7fc2e37fe700 1 --2- 172.21.15.84:0/88903095 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2e40b8a60 0x7fc2e40d0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:15:10.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:10.155+0000 7fc2e2ffd700 1 --2- 172.21.15.84:0/88903095 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2e40d0b10 0x7fc2e4150d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:15:10.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:10.156+0000 7fc2e3fff700 1 --2- 172.21.15.84:0/88903095 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2e40d0f90 0x7fc2e40c8970 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc2e409c8e0 tx=0x7fc2dc004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:10.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:10.156+0000 7fc2cbfff700 1 -- 172.21.15.84:0/88903095 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc012430 con 0x7fc2e40d0f90 2023-07-14T11:15:10.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:10.156+0000 7fc2cbfff700 1 -- 172.21.15.84:0/88903095 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2dc020070 con 0x7fc2e40d0f90 2023-07-14T11:15:10.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:10.156+0000 7fc2e9fff700 1 -- 172.21.15.84:0/88903095 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2e4151280 con 0x7fc2e40d0f90 2023-07-14T11:15:10.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:10.156+0000 7fc2cbfff700 1 -- 172.21.15.84:0/88903095 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc01ca50 con 0x7fc2e40d0f90 2023-07-14T11:15:10.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:10.156+0000 7fc2e9fff700 1 -- 172.21.15.84:0/88903095 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2e41f5be0 con 0x7fc2e40d0f90 2023-07-14T11:15:10.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:10.157+0000 7fc2e9fff700 1 -- 172.21.15.84:0/88903095 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2e415e3b0 con 0x7fc2e40d0f90 2023-07-14T11:15:10.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:10.158+0000 7fc2cbfff700 1 -- 172.21.15.84:0/88903095 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 7) v1 ==== 89190+0+0 (secure 0 0 0) 0x7fc2dc01cbb0 con 0x7fc2e40d0f90 2023-07-14T11:15:10.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:10.159+0000 7fc2cbfff700 1 --2- 172.21.15.84:0/88903095 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc2d006ae90 0x7fc2d006d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:10.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:10.159+0000 7fc2cbfff700 1 -- 172.21.15.84:0/88903095 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5962+0+0 (secure 0 0 0) 0x7fc2dc022070 con 0x7fc2e40d0f90 2023-07-14T11:15:10.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:10.159+0000 7fc2e37fe700 1 --2- 172.21.15.84:0/88903095 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc2d006ae90 0x7fc2d006d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:10.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:10.160+0000 7fc2e37fe700 1 --2- 172.21.15.84:0/88903095 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc2d006ae90 0x7fc2d006d340 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc2d4001220 tx=0x7fc2d4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:10.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:10.165+0000 7fc2cbfff700 1 -- 172.21.15.84:0/88903095 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fc2dc056860 con 0x7fc2e40d0f90 2023-07-14T11:15:10.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:10.406+0000 7fc2e9fff700 1 -- 172.21.15.84:0/88903095 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fc2e4074350 con 0x7fc2e40d0f90 2023-07-14T11:15:10.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:10.931+0000 7fc2cbfff700 1 -- 172.21.15.84:0/88903095 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v24) v1 ==== 172+0+0 (secure 0 0 0) 0x7fc2dc01ce60 con 0x7fc2e40d0f90 2023-07-14T11:15:10.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:10.936+0000 7fc2e9fff700 1 -- 172.21.15.84:0/88903095 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc2d006ae90 msgr2=0x7fc2d006d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:10.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:10.936+0000 7fc2e9fff700 1 --2- 172.21.15.84:0/88903095 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc2d006ae90 0x7fc2d006d340 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc2d4001220 tx=0x7fc2d4009040 comp rx=0 tx=0).stop 2023-07-14T11:15:10.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:10.936+0000 7fc2e9fff700 1 -- 172.21.15.84:0/88903095 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2e40d0f90 msgr2=0x7fc2e40c8970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:10.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:10.936+0000 7fc2e9fff700 1 --2- 172.21.15.84:0/88903095 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2e40d0f90 0x7fc2e40c8970 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc2e409c8e0 tx=0x7fc2dc004ad0 comp rx=0 tx=0).stop 2023-07-14T11:15:10.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:10.937+0000 7fc2e9fff700 1 -- 172.21.15.84:0/88903095 shutdown_connections 2023-07-14T11:15:10.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:10.937+0000 7fc2e9fff700 1 --2- 172.21.15.84:0/88903095 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc2d006ae90 0x7fc2d006d340 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:10.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:10.937+0000 7fc2e9fff700 1 --2- 172.21.15.84:0/88903095 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2e40d0f90 0x7fc2e40c8970 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:10.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:10.937+0000 7fc2e9fff700 1 --2- 172.21.15.84:0/88903095 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2e40b8a60 0x7fc2e40d0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:10.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:10.937+0000 7fc2e9fff700 1 --2- 172.21.15.84:0/88903095 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2e40d0b10 0x7fc2e4150d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:10.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:10.937+0000 7fc2e9fff700 1 -- 172.21.15.84:0/88903095 >> 172.21.15.84:0/88903095 conn(0x7fc2e409c1b0 msgr2=0x7fc2e406a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:10.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:10.940+0000 7fc2e9fff700 1 -- 172.21.15.84:0/88903095 shutdown_connections 2023-07-14T11:15:10.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:10.940+0000 7fc2e9fff700 1 -- 172.21.15.84:0/88903095 wait complete. 2023-07-14T11:15:10.945 INFO:teuthology.orchestra.run.smithi084.stderr:new fs with metadata pool 7 and data pool 8 2023-07-14T11:15:10.965 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:15:11.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.158+0000 7f698d5ff700 1 Processor -- start 2023-07-14T11:15:11.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.158+0000 7f698d5ff700 1 -- start start 2023-07-14T11:15:11.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.159+0000 7f698d5ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f69881597c0 0x7f6988159c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:11.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.159+0000 7f698d5ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69880cdf90 con 0x7f69880cea50 2023-07-14T11:15:11.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.159+0000 7f698d5ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f698815a2f0 con 0x7f69881500d0 2023-07-14T11:15:11.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.159+0000 7f698d5ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f698815a5d0 con 0x7f69881597c0 2023-07-14T11:15:11.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.159+0000 7f69867fc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f69881597c0 0x7f6988159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:11.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.160+0000 7f69877fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f69880cea50 0x7f69880b2690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55234/0 (socket says 172.21.15.84:55234) 2023-07-14T11:15:11.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.160+0000 7f69877fe700 1 -- 172.21.15.84:0/1229975763 learned_addr learned my addr 172.21.15.84:0/1229975763 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:15:11.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.160+0000 7f69867fc700 1 -- 172.21.15.84:0/1229975763 >> v1:172.21.15.179:6789/0 conn(0x7f69881500d0 legacy=0x7f6988070350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:11.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.160+0000 7f69867fc700 1 -- 172.21.15.84:0/1229975763 >> v1:172.21.15.84:6789/0 conn(0x7f69880cea50 legacy=0x7f69880b2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:11.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.160+0000 7f69867fc700 1 -- 172.21.15.84:0/1229975763 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69880ce250 con 0x7f69881597c0 2023-07-14T11:15:11.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.160+0000 7f69867fc700 1 --2- 172.21.15.84:0/1229975763 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69881597c0 0x7f6988159c60 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f697c009840 tx=0x7f697c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3033a1a3daa45a26 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:11.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.160+0000 7f6985ffb700 1 -- 172.21.15.84:0/1229975763 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697c00f8a0 con 0x7f69881597c0 2023-07-14T11:15:11.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.161+0000 7f6985ffb700 1 -- 172.21.15.84:0/1229975763 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f697c00fa00 con 0x7f69881597c0 2023-07-14T11:15:11.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.161+0000 7f6985ffb700 1 -- 172.21.15.84:0/1229975763 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697c00fd90 con 0x7f69881597c0 2023-07-14T11:15:11.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.161+0000 7f698d5ff700 1 -- 172.21.15.84:0/1229975763 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69881597c0 msgr2=0x7f6988159c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:11.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.161+0000 7f698d5ff700 1 --2- 172.21.15.84:0/1229975763 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69881597c0 0x7f6988159c60 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f697c009840 tx=0x7f697c009b50 comp rx=0 tx=0).stop 2023-07-14T11:15:11.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.161+0000 7f698d5ff700 1 -- 172.21.15.84:0/1229975763 shutdown_connections 2023-07-14T11:15:11.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.161+0000 7f698d5ff700 1 --2- 172.21.15.84:0/1229975763 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69881597c0 0x7f6988159c60 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:11.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.161+0000 7f698d5ff700 1 -- 172.21.15.84:0/1229975763 >> 172.21.15.84:0/1229975763 conn(0x7f6988069f30 msgr2=0x7f698806a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:11.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.161+0000 7f698d5ff700 1 -- 172.21.15.84:0/1229975763 shutdown_connections 2023-07-14T11:15:11.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.161+0000 7f698d5ff700 1 -- 172.21.15.84:0/1229975763 wait complete. 2023-07-14T11:15:11.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.163+0000 7f698d5ff700 1 Processor -- start 2023-07-14T11:15:11.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.163+0000 7f698d5ff700 1 -- start start 2023-07-14T11:15:11.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.164+0000 7f698d5ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69880cea50 0x7f69881f2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:11.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.164+0000 7f698d5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69881500d0 0x7f698814ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:11.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.164+0000 7f698d5ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69881597c0 0x7f69881461a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:11.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.164+0000 7f698d5ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69881f3340 con 0x7f69881597c0 2023-07-14T11:15:11.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.164+0000 7f698d5ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6988148a50 con 0x7f69880cea50 2023-07-14T11:15:11.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.164+0000 7f698d5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6988148d30 con 0x7f69881500d0 2023-07-14T11:15:11.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.164+0000 7f69877fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69881597c0 0x7f69881461a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:11.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.164+0000 7f69877fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69881597c0 0x7f69881461a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38564/0 (socket says 172.21.15.84:38564) 2023-07-14T11:15:11.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.164+0000 7f69877fe700 1 -- 172.21.15.84:0/1870088119 learned_addr learned my addr 172.21.15.84:0/1870088119 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:11.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.165+0000 7f6986ffd700 1 --2- 172.21.15.84:0/1870088119 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69880cea50 0x7f69881f2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:11.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.165+0000 7f69867fc700 1 --2- 172.21.15.84:0/1870088119 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69881500d0 0x7f698814ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:11.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.165+0000 7f69877fe700 1 -- 172.21.15.84:0/1870088119 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69881500d0 msgr2=0x7f698814ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:11.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.165+0000 7f69877fe700 1 --2- 172.21.15.84:0/1870088119 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69881500d0 0x7f698814ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:11.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.165+0000 7f69877fe700 1 -- 172.21.15.84:0/1870088119 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69880cea50 msgr2=0x7f69881f2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:11.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.165+0000 7f69877fe700 1 --2- 172.21.15.84:0/1870088119 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69880cea50 0x7f69881f2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:11.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.165+0000 7f69877fe700 1 -- 172.21.15.84:0/1870088119 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f697c0094a0 con 0x7f69881597c0 2023-07-14T11:15:11.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.165+0000 7f69877fe700 1 --2- 172.21.15.84:0/1870088119 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69881597c0 0x7f69881461a0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f698000cbc0 tx=0x7f698000ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:11.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.165+0000 7f696f7fe700 1 -- 172.21.15.84:0/1870088119 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f698000aaa0 con 0x7f69881597c0 2023-07-14T11:15:11.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.165+0000 7f696f7fe700 1 -- 172.21.15.84:0/1870088119 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f698000ac00 con 0x7f69881597c0 2023-07-14T11:15:11.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.165+0000 7f696f7fe700 1 -- 172.21.15.84:0/1870088119 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6980012400 con 0x7f69881597c0 2023-07-14T11:15:11.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.165+0000 7f698d5ff700 1 -- 172.21.15.84:0/1870088119 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6988149010 con 0x7f69881597c0 2023-07-14T11:15:11.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.166+0000 7f698d5ff700 1 -- 172.21.15.84:0/1870088119 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69881495d0 con 0x7f69881597c0 2023-07-14T11:15:11.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.167+0000 7f698d5ff700 1 -- 172.21.15.84:0/1870088119 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f698804e280 con 0x7f69881597c0 2023-07-14T11:15:11.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.168+0000 7f696f7fe700 1 -- 172.21.15.84:0/1870088119 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 7) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f698001b3b0 con 0x7f69881597c0 2023-07-14T11:15:11.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.168+0000 7f696f7fe700 1 --2- 172.21.15.84:0/1870088119 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f697406ae90 0x7f697406d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:11.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.168+0000 7f696f7fe700 1 -- 172.21.15.84:0/1870088119 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6980089350 con 0x7f69881597c0 2023-07-14T11:15:11.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.169+0000 7f6986ffd700 1 --2- 172.21.15.84:0/1870088119 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f697406ae90 0x7f697406d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:11.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.169+0000 7f6986ffd700 1 --2- 172.21.15.84:0/1870088119 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f697406ae90 0x7f697406d340 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6978007fd0 tx=0x7f6978009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:11.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.173+0000 7f696f7fe700 1 -- 172.21.15.84:0/1870088119 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f6980054220 con 0x7f69881597c0 2023-07-14T11:15:11.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.371+0000 7f698d5ff700 1 -- 172.21.15.84:0/1870088119 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6988070130 con 0x7f69881597c0 2023-07-14T11:15:11.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.372+0000 7f696f7fe700 1 -- 172.21.15.84:0/1870088119 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+18340 (secure 0 0 0) 0x7f6980057840 con 0x7f69881597c0 2023-07-14T11:15:11.375 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:15:11.376 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":49,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:15:10.408145+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-07-14T11:15:08.611029+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-07-14T11:15:09.373415+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:15:11.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.374+0000 7f698d5ff700 1 -- 172.21.15.84:0/1870088119 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f697406ae90 msgr2=0x7f697406d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:11.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.374+0000 7f698d5ff700 1 --2- 172.21.15.84:0/1870088119 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f697406ae90 0x7f697406d340 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6978007fd0 tx=0x7f6978009040 comp rx=0 tx=0).stop 2023-07-14T11:15:11.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.374+0000 7f698d5ff700 1 -- 172.21.15.84:0/1870088119 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69881597c0 msgr2=0x7f69881461a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:11.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.374+0000 7f698d5ff700 1 --2- 172.21.15.84:0/1870088119 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69881597c0 0x7f69881461a0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f698000cbc0 tx=0x7f698000ced0 comp rx=0 tx=0).stop 2023-07-14T11:15:11.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.374+0000 7f698d5ff700 1 -- 172.21.15.84:0/1870088119 shutdown_connections 2023-07-14T11:15:11.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.374+0000 7f698d5ff700 1 --2- 172.21.15.84:0/1870088119 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69881597c0 0x7f69881461a0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:11.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.374+0000 7f698d5ff700 1 --2- 172.21.15.84:0/1870088119 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69880cea50 0x7f69881f2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:11.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.374+0000 7f698d5ff700 1 --2- 172.21.15.84:0/1870088119 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f697406ae90 0x7f697406d340 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:11.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.374+0000 7f698d5ff700 1 --2- 172.21.15.84:0/1870088119 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69881500d0 0x7f698814ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:11.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.374+0000 7f698d5ff700 1 -- 172.21.15.84:0/1870088119 >> 172.21.15.84:0/1870088119 conn(0x7f6988069f30 msgr2=0x7f69880cf000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:11.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.375+0000 7f698d5ff700 1 -- 172.21.15.84:0/1870088119 shutdown_connections 2023-07-14T11:15:11.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.375+0000 7f698d5ff700 1 -- 172.21.15.84:0/1870088119 wait complete. 2023-07-14T11:15:11.396 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:15:11.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.587+0000 7f802a7ff700 1 Processor -- start 2023-07-14T11:15:11.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.587+0000 7f802a7ff700 1 -- start start 2023-07-14T11:15:11.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.588+0000 7f802a7ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f80240d1220 0x7f80240b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:11.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.589+0000 7f802a7ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80240d2ce0 con 0x7f80240b1e00 2023-07-14T11:15:11.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.589+0000 7f802a7ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80240b3350 con 0x7f802415c950 2023-07-14T11:15:11.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.589+0000 7f802a7ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80240b3630 con 0x7f80240d1220 2023-07-14T11:15:11.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.589+0000 7f8028d9c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f80240b1e00 0x7f80240afac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55240/0 (socket says 172.21.15.84:55240) 2023-07-14T11:15:11.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.589+0000 7f8028d9c700 1 -- 172.21.15.84:0/3508481566 learned_addr learned my addr 172.21.15.84:0/3508481566 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:15:11.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.589+0000 7f801bfff700 1 --2- 172.21.15.84:0/3508481566 >> v2:172.21.15.179:3300/0 conn(0x7f80240d1220 0x7f80240b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:11.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.589+0000 7f80237fe700 1 -- 172.21.15.84:0/3508481566 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4160654892 0 0) 0x7f80240d2ce0 con 0x7f80240b1e00 2023-07-14T11:15:11.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.589+0000 7f80237fe700 1 -- 172.21.15.84:0/3508481566 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80100035b0 con 0x7f80240b1e00 2023-07-14T11:15:11.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.590+0000 7f80237fe700 1 -- 172.21.15.84:0/3508481566 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2764880397 0 0) 0x7f80100035b0 con 0x7f80240b1e00 2023-07-14T11:15:11.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.590+0000 7f80237fe700 1 -- 172.21.15.84:0/3508481566 >> v2:172.21.15.179:3300/0 conn(0x7f80240d1220 msgr2=0x7f80240b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:11.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.590+0000 7f80237fe700 1 --2- 172.21.15.84:0/3508481566 >> v2:172.21.15.179:3300/0 conn(0x7f80240d1220 0x7f80240b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:11.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.590+0000 7f80237fe700 1 -- 172.21.15.84:0/3508481566 >> v1:172.21.15.179:6789/0 conn(0x7f802415c950 legacy=0x7f80240d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:11.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.590+0000 7f80237fe700 1 -- 172.21.15.84:0/3508481566 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80240b3910 con 0x7f80240b1e00 2023-07-14T11:15:11.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.590+0000 7f80237fe700 1 -- 172.21.15.84:0/3508481566 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7f801c0019f0 con 0x7f80240b1e00 2023-07-14T11:15:11.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.590+0000 7f80237fe700 1 -- 172.21.15.84:0/3508481566 >> v1:172.21.15.84:6789/0 conn(0x7f80240b1e00 legacy=0x7f80240afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:11.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.590+0000 7f80237fe700 1 --2- 172.21.15.84:0/3508481566 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8010003a00 0x7f8010003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:11.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.590+0000 7f80237fe700 1 --2- 172.21.15.84:0/3508481566 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8010004850 0x7f8010004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:11.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.590+0000 7f80237fe700 1 --2- 172.21.15.84:0/3508481566 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8010005200 0x7f801000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:11.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.590+0000 7f80237fe700 1 -- 172.21.15.84:0/3508481566 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80240b3630 con 0x7f8010004850 2023-07-14T11:15:11.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.590+0000 7f80237fe700 1 -- 172.21.15.84:0/3508481566 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f801000c110 con 0x7f8010003a00 2023-07-14T11:15:11.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.590+0000 7f80237fe700 1 -- 172.21.15.84:0/3508481566 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f801000c2d0 con 0x7f8010005200 2023-07-14T11:15:11.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.590+0000 7f801bfff700 1 --2- 172.21.15.84:0/3508481566 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8010004850 0x7f8010004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:11.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.590+0000 7f8023fff700 1 --2- 172.21.15.84:0/3508481566 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8010003a00 0x7f8010003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:11.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.590+0000 7f8028d9c700 1 --2- 172.21.15.84:0/3508481566 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8010005200 0x7f801000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:11.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.590+0000 7f801bfff700 1 -- 172.21.15.84:0/3508481566 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8010005200 msgr2=0x7f801000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:11.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.590+0000 7f801bfff700 1 --2- 172.21.15.84:0/3508481566 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8010005200 0x7f801000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:11.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.590+0000 7f801bfff700 1 -- 172.21.15.84:0/3508481566 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8010003a00 msgr2=0x7f8010003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:11.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.590+0000 7f801bfff700 1 --2- 172.21.15.84:0/3508481566 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8010003a00 0x7f8010003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:11.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.590+0000 7f801bfff700 1 -- 172.21.15.84:0/3508481566 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80100035b0 con 0x7f8010004850 2023-07-14T11:15:11.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.590+0000 7f8023fff700 1 --2- 172.21.15.84:0/3508481566 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8010003a00 0x7f8010003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:15:11.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.591+0000 7f8028d9c700 1 -- 172.21.15.84:0/3508481566 reap_dead start 2023-07-14T11:15:11.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.591+0000 7f801bfff700 1 --2- 172.21.15.84:0/3508481566 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8010004850 0x7f8010004cc0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f800c009b30 tx=0x7f8010005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9c4a056b0e65e6d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:11.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.591+0000 7f80237fe700 1 -- 172.21.15.84:0/3508481566 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800c00e6c0 con 0x7f8010004850 2023-07-14T11:15:11.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.591+0000 7f80237fe700 1 -- 172.21.15.84:0/3508481566 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f800c00e820 con 0x7f8010004850 2023-07-14T11:15:11.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.591+0000 7f80237fe700 1 -- 172.21.15.84:0/3508481566 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800c00eb90 con 0x7f8010004850 2023-07-14T11:15:11.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.591+0000 7f802a7ff700 1 -- 172.21.15.84:0/3508481566 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8010004850 msgr2=0x7f8010004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:11.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.591+0000 7f802a7ff700 1 --2- 172.21.15.84:0/3508481566 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8010004850 0x7f8010004cc0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f800c009b30 tx=0x7f8010005880 comp rx=0 tx=0).stop 2023-07-14T11:15:11.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.592+0000 7f802a7ff700 1 -- 172.21.15.84:0/3508481566 shutdown_connections 2023-07-14T11:15:11.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.592+0000 7f802a7ff700 1 --2- 172.21.15.84:0/3508481566 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8010004850 0x7f8010004cc0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:11.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.592+0000 7f802a7ff700 1 -- 172.21.15.84:0/3508481566 >> 172.21.15.84:0/3508481566 conn(0x7f802409c1d0 msgr2=0x7f80240d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:11.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.592+0000 7f802a7ff700 1 -- 172.21.15.84:0/3508481566 shutdown_connections 2023-07-14T11:15:11.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.592+0000 7f802a7ff700 1 -- 172.21.15.84:0/3508481566 wait complete. 2023-07-14T11:15:11.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.593+0000 7f802a7ff700 1 Processor -- start 2023-07-14T11:15:11.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.594+0000 7f802a7ff700 1 -- start start 2023-07-14T11:15:11.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.594+0000 7f802a7ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8010004850 0x7f80241f6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:11.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.594+0000 7f802a7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f802414e400 0x7f80240c8d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:11.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.594+0000 7f802a7ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80240c92c0 0x7f802415cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:11.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.594+0000 7f802a7ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80240c9740 con 0x7f80240c92c0 2023-07-14T11:15:11.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.594+0000 7f802a7ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80241f6780 con 0x7f8010004850 2023-07-14T11:15:11.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.594+0000 7f802a7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f802415e730 con 0x7f802414e400 2023-07-14T11:15:11.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.595+0000 7f8028d9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80240c92c0 0x7f802415cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:11.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.595+0000 7f8028d9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80240c92c0 0x7f802415cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38584/0 (socket says 172.21.15.84:38584) 2023-07-14T11:15:11.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.595+0000 7f8028d9c700 1 -- 172.21.15.84:0/3921195125 learned_addr learned my addr 172.21.15.84:0/3921195125 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:11.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.595+0000 7f8023fff700 1 --2- 172.21.15.84:0/3921195125 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8010004850 0x7f80241f6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:11.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.595+0000 7f801bfff700 1 --2- 172.21.15.84:0/3921195125 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f802414e400 0x7f80240c8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:11.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.595+0000 7f8028d9c700 1 -- 172.21.15.84:0/3921195125 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f802414e400 msgr2=0x7f80240c8d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:11.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.595+0000 7f8028d9c700 1 --2- 172.21.15.84:0/3921195125 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f802414e400 0x7f80240c8d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:11.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.595+0000 7f8028d9c700 1 -- 172.21.15.84:0/3921195125 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8010004850 msgr2=0x7f80241f6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:11.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.595+0000 7f8028d9c700 1 --2- 172.21.15.84:0/3921195125 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8010004850 0x7f80241f6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:11.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.595+0000 7f8028d9c700 1 -- 172.21.15.84:0/3921195125 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f802415ea10 con 0x7f80240c92c0 2023-07-14T11:15:11.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.595+0000 7f8028d9c700 1 --2- 172.21.15.84:0/3921195125 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80240c92c0 0x7f802415cd20 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f801c000f80 tx=0x7f801c00a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:11.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.596+0000 7f80217fa700 1 -- 172.21.15.84:0/3921195125 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801c00acb0 con 0x7f80240c92c0 2023-07-14T11:15:11.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.596+0000 7f80217fa700 1 -- 172.21.15.84:0/3921195125 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f801c00ae30 con 0x7f80240c92c0 2023-07-14T11:15:11.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.596+0000 7f802a7ff700 1 -- 172.21.15.84:0/3921195125 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f802415ecf0 con 0x7f80240c92c0 2023-07-14T11:15:11.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.596+0000 7f80217fa700 1 -- 172.21.15.84:0/3921195125 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801c013630 con 0x7f80240c92c0 2023-07-14T11:15:11.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.596+0000 7f802a7ff700 1 -- 172.21.15.84:0/3921195125 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f802415f2b0 con 0x7f80240c92c0 2023-07-14T11:15:11.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.597+0000 7f802a7ff700 1 -- 172.21.15.84:0/3921195125 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80241f21e0 con 0x7f80240c92c0 2023-07-14T11:15:11.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.598+0000 7f80217fa700 1 -- 172.21.15.84:0/3921195125 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 7) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f801c013790 con 0x7f80240c92c0 2023-07-14T11:15:11.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.599+0000 7f80217fa700 1 --2- 172.21.15.84:0/3921195125 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f800406ae90 0x7f800406d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:11.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.599+0000 7f80217fa700 1 -- 172.21.15.84:0/3921195125 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f801c089fd0 con 0x7f80240c92c0 2023-07-14T11:15:11.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.599+0000 7f8023fff700 1 --2- 172.21.15.84:0/3921195125 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f800406ae90 0x7f800406d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:11.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.599+0000 7f8023fff700 1 --2- 172.21.15.84:0/3921195125 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f800406ae90 0x7f800406d340 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8014001410 tx=0x7f8014009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:11.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.603+0000 7f80217fa700 1 -- 172.21.15.84:0/3921195125 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f801c054d60 con 0x7f80240c92c0 2023-07-14T11:15:11.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.802+0000 7f802a7ff700 1 -- 172.21.15.84:0/3921195125 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f802404e280 con 0x7f80240c92c0 2023-07-14T11:15:11.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.804+0000 7f80217fa700 1 -- 172.21.15.84:0/3921195125 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+18340 (secure 0 0 0) 0x7f801c058380 con 0x7f80240c92c0 2023-07-14T11:15:11.807 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:15:11.807 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":49,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:15:10.408145+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-07-14T11:15:08.611029+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-07-14T11:15:09.373415+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:15:11.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.806+0000 7f802a7ff700 1 -- 172.21.15.84:0/3921195125 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f800406ae90 msgr2=0x7f800406d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:11.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.806+0000 7f802a7ff700 1 --2- 172.21.15.84:0/3921195125 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f800406ae90 0x7f800406d340 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8014001410 tx=0x7f8014009040 comp rx=0 tx=0).stop 2023-07-14T11:15:11.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.806+0000 7f802a7ff700 1 -- 172.21.15.84:0/3921195125 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80240c92c0 msgr2=0x7f802415cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:11.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.806+0000 7f802a7ff700 1 --2- 172.21.15.84:0/3921195125 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80240c92c0 0x7f802415cd20 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f801c000f80 tx=0x7f801c00a5f0 comp rx=0 tx=0).stop 2023-07-14T11:15:11.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.806+0000 7f802a7ff700 1 -- 172.21.15.84:0/3921195125 shutdown_connections 2023-07-14T11:15:11.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.806+0000 7f802a7ff700 1 --2- 172.21.15.84:0/3921195125 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80240c92c0 0x7f802415cd20 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:11.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.806+0000 7f802a7ff700 1 --2- 172.21.15.84:0/3921195125 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8010004850 0x7f80241f6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:11.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.806+0000 7f802a7ff700 1 --2- 172.21.15.84:0/3921195125 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f800406ae90 0x7f800406d340 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:11.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.806+0000 7f802a7ff700 1 --2- 172.21.15.84:0/3921195125 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f802414e400 0x7f80240c8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:11.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.806+0000 7f802a7ff700 1 -- 172.21.15.84:0/3921195125 >> 172.21.15.84:0/3921195125 conn(0x7f802409c1d0 msgr2=0x7f80240b0420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:11.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.806+0000 7f802a7ff700 1 -- 172.21.15.84:0/3921195125 shutdown_connections 2023-07-14T11:15:11.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:11.806+0000 7f802a7ff700 1 -- 172.21.15.84:0/3921195125 wait complete. 2023-07-14T11:15:11.828 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-14T11:15:11.898 INFO:tasks.ceph.mds.c.smithi084.stderr:2023-07-14T11:15:11.895+0000 7f818adf1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-14T11:15:12.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.027+0000 7ff0db9ff700 1 Processor -- start 2023-07-14T11:15:12.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.028+0000 7ff0db9ff700 1 -- start start 2023-07-14T11:15:12.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.029+0000 7ff0db9ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff0d40b8a60 0x7ff0d40b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:12.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.029+0000 7ff0db9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0d40d1220 0x7ff0d40b0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:12.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.029+0000 7ff0db9ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0d40b8e30 con 0x7ff0d40b4530 2023-07-14T11:15:12.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.029+0000 7ff0db9ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0d40afaa0 con 0x7ff0d40b8a60 2023-07-14T11:15:12.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.029+0000 7ff0db9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d40afd80 con 0x7ff0d40d1220 2023-07-14T11:15:12.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.029+0000 7ff0d979b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff0d40b8a60 0x7ff0d40b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:12.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.029+0000 7ff0d979b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff0d40b8a60 0x7ff0d40b3ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38594/0 (socket says 172.21.15.84:38594) 2023-07-14T11:15:12.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.029+0000 7ff0d8f9a700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7ff0d40b4530 0x7ff0d40d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55252/0 (socket says 172.21.15.84:55252) 2023-07-14T11:15:12.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.029+0000 7ff0d979b700 1 -- 172.21.15.84:0/4229399858 learned_addr learned my addr 172.21.15.84:0/4229399858 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:12.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.029+0000 7ff0d979b700 1 -- 172.21.15.84:0/4229399858 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0d40d1220 msgr2=0x7ff0d40b0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:12.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.029+0000 7ff0d9f9c700 1 --2- 172.21.15.84:0/4229399858 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0d40d1220 0x7ff0d40b0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:12.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.030+0000 7ff0d979b700 1 --2- 172.21.15.84:0/4229399858 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0d40d1220 0x7ff0d40b0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:12.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.030+0000 7ff0d979b700 1 -- 172.21.15.84:0/4229399858 >> v1:172.21.15.84:6789/0 conn(0x7ff0d40b4530 legacy=0x7ff0d40d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:12.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.030+0000 7ff0d979b700 1 -- 172.21.15.84:0/4229399858 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d40b0060 con 0x7ff0d40b8a60 2023-07-14T11:15:12.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.030+0000 7ff0cbfff700 1 -- 172.21.15.84:0/4229399858 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 376100411 0 0) 0x7ff0d40b8e30 con 0x7ff0d40b4530 2023-07-14T11:15:12.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.030+0000 7ff0d9f9c700 1 --2- 172.21.15.84:0/4229399858 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0d40d1220 0x7ff0d40b0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:15:12.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.030+0000 7ff0d979b700 1 --2- 172.21.15.84:0/4229399858 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0d40b8a60 0x7ff0d40b3ff0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7ff0d00098f0 tx=0x7ff0d0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd350c7376b816de server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:12.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.030+0000 7ff0cbfff700 1 -- 172.21.15.84:0/4229399858 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d000b8a0 con 0x7ff0d40b8a60 2023-07-14T11:15:12.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.030+0000 7ff0cbfff700 1 -- 172.21.15.84:0/4229399858 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d000ba00 con 0x7ff0d40b8a60 2023-07-14T11:15:12.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.030+0000 7ff0cbfff700 1 -- 172.21.15.84:0/4229399858 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d000bd90 con 0x7ff0d40b8a60 2023-07-14T11:15:12.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.031+0000 7ff0db9ff700 1 -- 172.21.15.84:0/4229399858 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0d40b8a60 msgr2=0x7ff0d40b3ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:12.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.031+0000 7ff0db9ff700 1 --2- 172.21.15.84:0/4229399858 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0d40b8a60 0x7ff0d40b3ff0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7ff0d00098f0 tx=0x7ff0d0009c00 comp rx=0 tx=0).stop 2023-07-14T11:15:12.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.031+0000 7ff0db9ff700 1 -- 172.21.15.84:0/4229399858 shutdown_connections 2023-07-14T11:15:12.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.031+0000 7ff0db9ff700 1 --2- 172.21.15.84:0/4229399858 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0d40d1220 0x7ff0d40b0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:12.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.031+0000 7ff0db9ff700 1 --2- 172.21.15.84:0/4229399858 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0d40b8a60 0x7ff0d40b3ff0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:12.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.031+0000 7ff0db9ff700 1 -- 172.21.15.84:0/4229399858 >> 172.21.15.84:0/4229399858 conn(0x7ff0d409c1b0 msgr2=0x7ff0d40d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:12.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.031+0000 7ff0db9ff700 1 -- 172.21.15.84:0/4229399858 shutdown_connections 2023-07-14T11:15:12.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.031+0000 7ff0db9ff700 1 -- 172.21.15.84:0/4229399858 wait complete. 2023-07-14T11:15:12.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.033+0000 7ff0db9ff700 1 Processor -- start 2023-07-14T11:15:12.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.033+0000 7ff0db9ff700 1 -- start start 2023-07-14T11:15:12.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.034+0000 7ff0db9ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0d40b4530 0x7ff0d41f1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:12.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.034+0000 7ff0db9ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff0d40b8a60 0x7ff0d41e4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:12.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.034+0000 7ff0db9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0d40d1220 0x7ff0d40cd570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:12.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.034+0000 7ff0db9ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d4152720 con 0x7ff0d40b4530 2023-07-14T11:15:12.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.034+0000 7ff0db9ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d40cf7f0 con 0x7ff0d40b8a60 2023-07-14T11:15:12.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.034+0000 7ff0db9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d414dc30 con 0x7ff0d40d1220 2023-07-14T11:15:12.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.034+0000 7ff0d979b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0d40b4530 0x7ff0d41f1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:12.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.034+0000 7ff0d979b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0d40b4530 0x7ff0d41f1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38604/0 (socket says 172.21.15.84:38604) 2023-07-14T11:15:12.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.034+0000 7ff0d979b700 1 -- 172.21.15.84:0/276814549 learned_addr learned my addr 172.21.15.84:0/276814549 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:12.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.034+0000 7ff0d8f9a700 1 --2- 172.21.15.84:0/276814549 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff0d40b8a60 0x7ff0d41e4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:12.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.034+0000 7ff0d9f9c700 1 --2- 172.21.15.84:0/276814549 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0d40d1220 0x7ff0d40cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:12.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.034+0000 7ff0d979b700 1 -- 172.21.15.84:0/276814549 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0d40d1220 msgr2=0x7ff0d40cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:12.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.034+0000 7ff0d979b700 1 --2- 172.21.15.84:0/276814549 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0d40d1220 0x7ff0d40cd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:12.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.034+0000 7ff0d979b700 1 -- 172.21.15.84:0/276814549 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff0d40b8a60 msgr2=0x7ff0d41e4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:12.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.034+0000 7ff0d979b700 1 --2- 172.21.15.84:0/276814549 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff0d40b8a60 0x7ff0d41e4f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:12.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.034+0000 7ff0d979b700 1 -- 172.21.15.84:0/276814549 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d0009550 con 0x7ff0d40b4530 2023-07-14T11:15:12.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.034+0000 7ff0d8f9a700 1 --2- 172.21.15.84:0/276814549 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff0d40b8a60 0x7ff0d41e4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:15:12.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.034+0000 7ff0d9f9c700 1 --2- 172.21.15.84:0/276814549 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0d40d1220 0x7ff0d40cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:15:12.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.034+0000 7ff0d979b700 1 --2- 172.21.15.84:0/276814549 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0d40b4530 0x7ff0d41f1a40 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7ff0d0009c40 tx=0x7ff0d0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:12.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.035+0000 7ff0c9ffb700 1 -- 172.21.15.84:0/276814549 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d00036a0 con 0x7ff0d40b4530 2023-07-14T11:15:12.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.035+0000 7ff0c9ffb700 1 -- 172.21.15.84:0/276814549 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d0003800 con 0x7ff0d40b4530 2023-07-14T11:15:12.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.035+0000 7ff0db9ff700 1 -- 172.21.15.84:0/276814549 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0d40cf170 con 0x7ff0d40b4530 2023-07-14T11:15:12.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.035+0000 7ff0c9ffb700 1 -- 172.21.15.84:0/276814549 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d0003b70 con 0x7ff0d40b4530 2023-07-14T11:15:12.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.035+0000 7ff0db9ff700 1 -- 172.21.15.84:0/276814549 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0d4152440 con 0x7ff0d40b4530 2023-07-14T11:15:12.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.036+0000 7ff0db9ff700 1 -- 172.21.15.84:0/276814549 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0d4074350 con 0x7ff0d40b4530 2023-07-14T11:15:12.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.037+0000 7ff0c9ffb700 1 -- 172.21.15.84:0/276814549 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 7) v1 ==== 89190+0+0 (secure 0 0 0) 0x7ff0d0003cd0 con 0x7ff0d40b4530 2023-07-14T11:15:12.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.038+0000 7ff0c9ffb700 1 --2- 172.21.15.84:0/276814549 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff0b806ae90 0x7ff0b806d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:12.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.038+0000 7ff0c9ffb700 1 -- 172.21.15.84:0/276814549 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff0d0021030 con 0x7ff0d40b4530 2023-07-14T11:15:12.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.038+0000 7ff0d8f9a700 1 --2- 172.21.15.84:0/276814549 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff0b806ae90 0x7ff0b806d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:12.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.039+0000 7ff0d8f9a700 1 --2- 172.21.15.84:0/276814549 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff0b806ae90 0x7ff0b806d340 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff0d41f1f80 tx=0x7ff0c4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:12.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.042+0000 7ff0c9ffb700 1 -- 172.21.15.84:0/276814549 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ff0d0055e30 con 0x7ff0d40b4530 2023-07-14T11:15:12.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.279+0000 7ff0db9ff700 1 -- 172.21.15.84:0/276814549 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ff0d41e54c0 con 0x7ff0d40b4530 2023-07-14T11:15:12.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.938+0000 7ff0c9ffb700 1 -- 172.21.15.84:0/276814549 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v26) v1 ==== 118+0+0 (secure 0 0 0) 0x7ff0d00150b0 con 0x7ff0d40b4530 2023-07-14T11:15:12.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.941+0000 7ff0db9ff700 1 -- 172.21.15.84:0/276814549 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff0b806ae90 msgr2=0x7ff0b806d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:12.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.941+0000 7ff0db9ff700 1 --2- 172.21.15.84:0/276814549 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff0b806ae90 0x7ff0b806d340 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff0d41f1f80 tx=0x7ff0c4009040 comp rx=0 tx=0).stop 2023-07-14T11:15:12.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.941+0000 7ff0db9ff700 1 -- 172.21.15.84:0/276814549 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0d40b4530 msgr2=0x7ff0d41f1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:12.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.941+0000 7ff0db9ff700 1 --2- 172.21.15.84:0/276814549 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0d40b4530 0x7ff0d41f1a40 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7ff0d0009c40 tx=0x7ff0d0004750 comp rx=0 tx=0).stop 2023-07-14T11:15:12.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.941+0000 7ff0db9ff700 1 -- 172.21.15.84:0/276814549 shutdown_connections 2023-07-14T11:15:12.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.941+0000 7ff0db9ff700 1 --2- 172.21.15.84:0/276814549 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff0b806ae90 0x7ff0b806d340 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:12.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.941+0000 7ff0db9ff700 1 --2- 172.21.15.84:0/276814549 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0d40d1220 0x7ff0d40cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:12.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.941+0000 7ff0db9ff700 1 --2- 172.21.15.84:0/276814549 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0d40b4530 0x7ff0d41f1a40 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:12.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.941+0000 7ff0db9ff700 1 --2- 172.21.15.84:0/276814549 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff0d40b8a60 0x7ff0d41e4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:12.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.941+0000 7ff0db9ff700 1 -- 172.21.15.84:0/276814549 >> 172.21.15.84:0/276814549 conn(0x7ff0d409c1b0 msgr2=0x7ff0d406c010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:12.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.942+0000 7ff0db9ff700 1 -- 172.21.15.84:0/276814549 shutdown_connections 2023-07-14T11:15:12.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:12.942+0000 7ff0db9ff700 1 -- 172.21.15.84:0/276814549 wait complete. 2023-07-14T11:15:12.964 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-14T11:15:12.964 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-14T11:15:13.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:13.160+0000 7f11c25ff700 1 Processor -- start 2023-07-14T11:15:13.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:13.160+0000 7f11c25ff700 1 -- start start 2023-07-14T11:15:13.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:13.161+0000 7f11c25ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11bc0b8a60 0x7f11bc0b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:13.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:13.161+0000 7f11c25ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f11bc0b4530 0x7f11bc0d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:13.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:13.161+0000 7f11c25ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11bc0b8e30 con 0x7f11bc0d1050 2023-07-14T11:15:13.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:13.161+0000 7f11c25ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11bc0d14d0 con 0x7f11bc0b4530 2023-07-14T11:15:13.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:13.161+0000 7f11c25ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11bc0b1e30 con 0x7f11bc0b8a60 2023-07-14T11:15:13.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:13.161+0000 7f11bb7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f11bc0b4530 0x7f11bc0d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:13.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:13.161+0000 7f11bb7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f11bc0b4530 0x7f11bc0d0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38618/0 (socket says 172.21.15.84:38618) 2023-07-14T11:15:13.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:13.161+0000 7f11bb7fe700 1 -- 172.21.15.84:0/856501767 learned_addr learned my addr 172.21.15.84:0/856501767 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:13.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:13.162+0000 7f11bbfff700 1 --2- 172.21.15.84:0/856501767 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11bc0b8a60 0x7f11bc0b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:13.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:13.162+0000 7f11bb7fe700 1 -- 172.21.15.84:0/856501767 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11bc0b8a60 msgr2=0x7f11bc0b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:13.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:13.162+0000 7f11bb7fe700 1 --2- 172.21.15.84:0/856501767 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11bc0b8a60 0x7f11bc0b3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:13.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:13.162+0000 7f11bb7fe700 1 -- 172.21.15.84:0/856501767 >> v1:172.21.15.179:6789/0 conn(0x7f11bc0d1050 legacy=0x7f11bc0b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:13.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:13.162+0000 7f11bb7fe700 1 -- 172.21.15.84:0/856501767 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11bc0afaa0 con 0x7f11bc0b4530 2023-07-14T11:15:13.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:13.162+0000 7f11bb7fe700 1 --2- 172.21.15.84:0/856501767 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11bc0b4530 0x7f11bc0d0b10 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f11b00098f0 tx=0x7f11b0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f61262c609dfadc7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:13.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:13.162+0000 7f11baffd700 1 -- 172.21.15.84:0/856501767 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b000b8a0 con 0x7f11bc0b4530 2023-07-14T11:15:13.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:13.162+0000 7f11baffd700 1 -- 172.21.15.84:0/856501767 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11b000ba00 con 0x7f11bc0b4530 2023-07-14T11:15:13.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:13.162+0000 7f11baffd700 1 -- 172.21.15.84:0/856501767 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b000bd90 con 0x7f11bc0b4530 2023-07-14T11:15:13.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:13.163+0000 7f11c25ff700 1 -- 172.21.15.84:0/856501767 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11bc0b4530 msgr2=0x7f11bc0d0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:13.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:13.163+0000 7f11c25ff700 1 --2- 172.21.15.84:0/856501767 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11bc0b4530 0x7f11bc0d0b10 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f11b00098f0 tx=0x7f11b0009c00 comp rx=0 tx=0).stop 2023-07-14T11:15:13.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:13.163+0000 7f11c25ff700 1 -- 172.21.15.84:0/856501767 shutdown_connections 2023-07-14T11:15:13.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:13.163+0000 7f11c25ff700 1 --2- 172.21.15.84:0/856501767 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11bc0b8a60 0x7f11bc0b3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:13.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:13.163+0000 7f11c25ff700 1 --2- 172.21.15.84:0/856501767 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11bc0b4530 0x7f11bc0d0b10 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:13.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:13.163+0000 7f11c25ff700 1 -- 172.21.15.84:0/856501767 >> 172.21.15.84:0/856501767 conn(0x7f11bc09c1b0 msgr2=0x7f11bc0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:13.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:13.163+0000 7f11c25ff700 1 -- 172.21.15.84:0/856501767 shutdown_connections 2023-07-14T11:15:13.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:13.163+0000 7f11c25ff700 1 -- 172.21.15.84:0/856501767 wait complete. 2023-07-14T11:15:13.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:13.165+0000 7f11c25ff700 1 Processor -- start 2023-07-14T11:15:13.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:13.165+0000 7f11c25ff700 1 -- start start 2023-07-14T11:15:13.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:13.166+0000 7f11c25ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11bc0b4530 0x7f11bc15f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:13.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:13.166+0000 7f11c25ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11bc0b8a60 0x7f11bc0c9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:13.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:13.166+0000 7f11c25ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11bc0d1050 0x7f11bc15d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:13.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:13.166+0000 7f11c25ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11bc15fef0 con 0x7f11bc0d1050 2023-07-14T11:15:13.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:13.166+0000 7f11c25ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11bc15a990 con 0x7f11bc0b4530 2023-07-14T11:15:13.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:13.166+0000 7f11c25ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11bc1491d0 con 0x7f11bc0b8a60 2023-07-14T11:15:13.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:13.166+0000 7f11c0b9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11bc0d1050 0x7f11bc15d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:13.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:13.166+0000 7f11c0b9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11bc0d1050 0x7f11bc15d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38620/0 (socket says 172.21.15.84:38620) 2023-07-14T11:15:13.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:13.166+0000 7f11c0b9c700 1 -- 172.21.15.84:0/2225170525 learned_addr learned my addr 172.21.15.84:0/2225170525 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:13.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:13.166+0000 7f11bb7fe700 1 --2- 172.21.15.84:0/2225170525 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11bc0b8a60 0x7f11bc0c9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:13.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:13.167+0000 7f11c0b9c700 1 -- 172.21.15.84:0/2225170525 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11bc0b8a60 msgr2=0x7f11bc0c9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:13.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:13.167+0000 7f11bbfff700 1 --2- 172.21.15.84:0/2225170525 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11bc0b4530 0x7f11bc15f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:13.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:13.167+0000 7f11c0b9c700 1 --2- 172.21.15.84:0/2225170525 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11bc0b8a60 0x7f11bc0c9660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:13.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:13.167+0000 7f11c0b9c700 1 -- 172.21.15.84:0/2225170525 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11bc0b4530 msgr2=0x7f11bc15f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:13.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:13.167+0000 7f11c0b9c700 1 --2- 172.21.15.84:0/2225170525 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11bc0b4530 0x7f11bc15f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:13.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:13.167+0000 7f11c0b9c700 1 -- 172.21.15.84:0/2225170525 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b0009550 con 0x7f11bc0d1050 2023-07-14T11:15:13.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:13.167+0000 7f11bbfff700 1 --2- 172.21.15.84:0/2225170525 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11bc0b4530 0x7f11bc15f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:15:13.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:13.167+0000 7f11c0b9c700 1 --2- 172.21.15.84:0/2225170525 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11bc0d1050 0x7f11bc15d010 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f11b400cb50 tx=0x7f11b400cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:13.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:13.167+0000 7f11b8ff9700 1 -- 172.21.15.84:0/2225170525 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b4003c00 con 0x7f11bc0d1050 2023-07-14T11:15:13.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:13.167+0000 7f11b8ff9700 1 -- 172.21.15.84:0/2225170525 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11b4003d60 con 0x7f11bc0d1050 2023-07-14T11:15:13.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:13.167+0000 7f11c25ff700 1 -- 172.21.15.84:0/2225170525 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11bc1494b0 con 0x7f11bc0d1050 2023-07-14T11:15:13.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:13.167+0000 7f11b8ff9700 1 -- 172.21.15.84:0/2225170525 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b400ab70 con 0x7f11bc0d1050 2023-07-14T11:15:13.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:13.167+0000 7f11c25ff700 1 -- 172.21.15.84:0/2225170525 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11bc149a70 con 0x7f11bc0d1050 2023-07-14T11:15:13.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:13.168+0000 7f11c25ff700 1 -- 172.21.15.84:0/2225170525 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11bc074350 con 0x7f11bc0d1050 2023-07-14T11:15:13.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:13.169+0000 7f11b8ff9700 1 -- 172.21.15.84:0/2225170525 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 7) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f11b400acd0 con 0x7f11bc0d1050 2023-07-14T11:15:13.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:13.170+0000 7f11b8ff9700 1 --2- 172.21.15.84:0/2225170525 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f11a806ae90 0x7f11a806d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:13.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:13.170+0000 7f11b8ff9700 1 -- 172.21.15.84:0/2225170525 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f11b4089850 con 0x7f11bc0d1050 2023-07-14T11:15:13.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:13.170+0000 7f11bbfff700 1 --2- 172.21.15.84:0/2225170525 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f11a806ae90 0x7f11a806d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:13.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:13.171+0000 7f11bbfff700 1 --2- 172.21.15.84:0/2225170525 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f11a806ae90 0x7f11a806d340 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f11ac009a00 tx=0x7f11ac008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:13.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:13.174+0000 7f11b8ff9700 1 -- 172.21.15.84:0/2225170525 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f11b4054670 con 0x7f11bc0d1050 2023-07-14T11:15:13.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:13.411+0000 7f11c25ff700 1 -- 172.21.15.84:0/2225170525 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f11bc0b05f0 con 0x7f11bc0d1050 2023-07-14T11:15:13.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:13.938+0000 7f11b8ff9700 1 -- 172.21.15.84:0/2225170525 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v27) v1 ==== 122+0+0 (secure 0 0 0) 0x7f11b4057c90 con 0x7f11bc0d1050 2023-07-14T11:15:13.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:13.941+0000 7f11c25ff700 1 -- 172.21.15.84:0/2225170525 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f11a806ae90 msgr2=0x7f11a806d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:13.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:13.941+0000 7f11c25ff700 1 --2- 172.21.15.84:0/2225170525 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f11a806ae90 0x7f11a806d340 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f11ac009a00 tx=0x7f11ac008040 comp rx=0 tx=0).stop 2023-07-14T11:15:13.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:13.941+0000 7f11c25ff700 1 -- 172.21.15.84:0/2225170525 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11bc0d1050 msgr2=0x7f11bc15d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:13.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:13.941+0000 7f11c25ff700 1 --2- 172.21.15.84:0/2225170525 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11bc0d1050 0x7f11bc15d010 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f11b400cb50 tx=0x7f11b400cf10 comp rx=0 tx=0).stop 2023-07-14T11:15:13.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:13.942+0000 7f11c25ff700 1 -- 172.21.15.84:0/2225170525 shutdown_connections 2023-07-14T11:15:13.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:13.942+0000 7f11c25ff700 1 --2- 172.21.15.84:0/2225170525 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11bc0d1050 0x7f11bc15d010 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:13.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:13.942+0000 7f11c25ff700 1 --2- 172.21.15.84:0/2225170525 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11bc0b4530 0x7f11bc15f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:13.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:13.942+0000 7f11c25ff700 1 --2- 172.21.15.84:0/2225170525 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f11a806ae90 0x7f11a806d340 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:13.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:13.942+0000 7f11c25ff700 1 --2- 172.21.15.84:0/2225170525 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11bc0b8a60 0x7f11bc0c9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:13.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:13.942+0000 7f11c25ff700 1 -- 172.21.15.84:0/2225170525 >> 172.21.15.84:0/2225170525 conn(0x7f11bc09c1b0 msgr2=0x7f11bc06b490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:13.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:13.942+0000 7f11c25ff700 1 -- 172.21.15.84:0/2225170525 shutdown_connections 2023-07-14T11:15:13.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:13.942+0000 7f11c25ff700 1 -- 172.21.15.84:0/2225170525 wait complete. 2023-07-14T11:15:13.964 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-14T11:15:13.965 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T11:15:14.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.159+0000 7f9239fff700 1 Processor -- start 2023-07-14T11:15:14.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.159+0000 7f9239fff700 1 -- start start 2023-07-14T11:15:14.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.161+0000 7f9239fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9234160030 0x7f923406c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:14.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.161+0000 7f9239fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f92340b5cd0 0x7f92340d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:14.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.161+0000 7f9239fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92340b1f70 0x7f92340d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:14.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.161+0000 7f9239fff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92340d2cc0 con 0x7f92340b5cd0 2023-07-14T11:15:14.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.161+0000 7f9239fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92340afbb0 con 0x7f9234160030 2023-07-14T11:15:14.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.161+0000 7f9239fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92340afe90 con 0x7f92340b1f70 2023-07-14T11:15:14.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.161+0000 7f9232ffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f92340b5cd0 0x7f92340d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:14.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.161+0000 7f9232ffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f92340b5cd0 0x7f92340d0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38622/0 (socket says 172.21.15.84:38622) 2023-07-14T11:15:14.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.161+0000 7f9232ffd700 1 -- 172.21.15.84:0/3043459633 learned_addr learned my addr 172.21.15.84:0/3043459633 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:14.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.161+0000 7f9232ffd700 1 -- 172.21.15.84:0/3043459633 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92340b1f70 msgr2=0x7f92340d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:14.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.161+0000 7f9233fff700 1 --2- 172.21.15.84:0/3043459633 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92340b1f70 0x7f92340d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:14.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.161+0000 7f92337fe700 1 --2- 172.21.15.84:0/3043459633 >> v2:172.21.15.179:3300/0 conn(0x7f9234160030 0x7f923406c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:14.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.161+0000 7f9232ffd700 1 --2- 172.21.15.84:0/3043459633 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92340b1f70 0x7f92340d0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:14.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.161+0000 7f9232ffd700 1 -- 172.21.15.84:0/3043459633 >> v2:172.21.15.179:3300/0 conn(0x7f9234160030 msgr2=0x7f923406c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:14.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.161+0000 7f9232ffd700 1 --2- 172.21.15.84:0/3043459633 >> v2:172.21.15.179:3300/0 conn(0x7f9234160030 0x7f923406c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:14.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.161+0000 7f9232ffd700 1 -- 172.21.15.84:0/3043459633 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92340b0170 con 0x7f92340b5cd0 2023-07-14T11:15:14.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.161+0000 7f92337fe700 1 --2- 172.21.15.84:0/3043459633 >> v2:172.21.15.179:3300/0 conn(0x7f9234160030 0x7f923406c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:15:14.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.161+0000 7f9233fff700 1 --2- 172.21.15.84:0/3043459633 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92340b1f70 0x7f92340d0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:15:14.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.162+0000 7f9232ffd700 1 --2- 172.21.15.84:0/3043459633 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92340b5cd0 0x7f92340d0a50 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f923406d1a0 tx=0x7f9228009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59f84e5491dd44cf server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:14.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.162+0000 7f92327fc700 1 -- 172.21.15.84:0/3043459633 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f922800b870 con 0x7f92340b5cd0 2023-07-14T11:15:14.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.162+0000 7f92327fc700 1 -- 172.21.15.84:0/3043459633 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f922800b9d0 con 0x7f92340b5cd0 2023-07-14T11:15:14.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.162+0000 7f92327fc700 1 -- 172.21.15.84:0/3043459633 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f922800bd60 con 0x7f92340b5cd0 2023-07-14T11:15:14.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.162+0000 7f9239fff700 1 -- 172.21.15.84:0/3043459633 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92340b5cd0 msgr2=0x7f92340d0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:14.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.162+0000 7f9239fff700 1 --2- 172.21.15.84:0/3043459633 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92340b5cd0 0x7f92340d0a50 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f923406d1a0 tx=0x7f9228009bd0 comp rx=0 tx=0).stop 2023-07-14T11:15:14.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.162+0000 7f9239fff700 1 -- 172.21.15.84:0/3043459633 shutdown_connections 2023-07-14T11:15:14.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.162+0000 7f9239fff700 1 --2- 172.21.15.84:0/3043459633 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92340b1f70 0x7f92340d0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:14.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.162+0000 7f9239fff700 1 --2- 172.21.15.84:0/3043459633 >> v2:172.21.15.179:3300/0 conn(0x7f9234160030 0x7f923406c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:14.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.162+0000 7f9239fff700 1 --2- 172.21.15.84:0/3043459633 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92340b5cd0 0x7f92340d0a50 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:14.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.162+0000 7f9239fff700 1 -- 172.21.15.84:0/3043459633 >> 172.21.15.84:0/3043459633 conn(0x7f923409c190 msgr2=0x7f92340d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:14.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.162+0000 7f9239fff700 1 -- 172.21.15.84:0/3043459633 shutdown_connections 2023-07-14T11:15:14.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.163+0000 7f9239fff700 1 -- 172.21.15.84:0/3043459633 wait complete. 2023-07-14T11:15:14.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.164+0000 7f9239fff700 1 Processor -- start 2023-07-14T11:15:14.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.164+0000 7f9239fff700 1 -- start start 2023-07-14T11:15:14.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.165+0000 7f9239fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92340b1f70 0x7f92340c9f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:14.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.165+0000 7f9239fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92340b5cd0 0x7f92340c9030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:14.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.165+0000 7f9239fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9234160030 0x7f9234151ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:14.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.165+0000 7f9239fff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92340c85b0 con 0x7f92340b5cd0 2023-07-14T11:15:14.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.165+0000 7f9239fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92340a0760 con 0x7f9234160030 2023-07-14T11:15:14.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.165+0000 7f9239fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92340a0a40 con 0x7f92340b1f70 2023-07-14T11:15:14.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.165+0000 7f9232ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92340b5cd0 0x7f92340c9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:14.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.165+0000 7f9232ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92340b5cd0 0x7f92340c9030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38636/0 (socket says 172.21.15.84:38636) 2023-07-14T11:15:14.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.165+0000 7f9232ffd700 1 -- 172.21.15.84:0/577424071 learned_addr learned my addr 172.21.15.84:0/577424071 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:14.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.166+0000 7f92337fe700 1 --2- 172.21.15.84:0/577424071 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92340b1f70 0x7f92340c9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:14.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.166+0000 7f9233fff700 1 --2- 172.21.15.84:0/577424071 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9234160030 0x7f9234151ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:14.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.166+0000 7f9232ffd700 1 -- 172.21.15.84:0/577424071 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92340b1f70 msgr2=0x7f92340c9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:14.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.166+0000 7f9232ffd700 1 --2- 172.21.15.84:0/577424071 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92340b1f70 0x7f92340c9f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:14.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.166+0000 7f9232ffd700 1 -- 172.21.15.84:0/577424071 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9234160030 msgr2=0x7f9234151ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:14.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.166+0000 7f9232ffd700 1 --2- 172.21.15.84:0/577424071 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9234160030 0x7f9234151ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:14.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.166+0000 7f9232ffd700 1 -- 172.21.15.84:0/577424071 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9228009550 con 0x7f92340b5cd0 2023-07-14T11:15:14.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.166+0000 7f9233fff700 1 --2- 172.21.15.84:0/577424071 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9234160030 0x7f9234151ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:15:14.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.166+0000 7f9232ffd700 1 --2- 172.21.15.84:0/577424071 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92340b5cd0 0x7f92340c9030 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f9234067220 tx=0x7f9228004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:14.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.166+0000 7f921bfff700 1 -- 172.21.15.84:0/577424071 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9228004310 con 0x7f92340b5cd0 2023-07-14T11:15:14.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.166+0000 7f921bfff700 1 -- 172.21.15.84:0/577424071 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f922801f070 con 0x7f92340b5cd0 2023-07-14T11:15:14.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.166+0000 7f9239fff700 1 -- 172.21.15.84:0/577424071 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92340c8830 con 0x7f92340b5cd0 2023-07-14T11:15:14.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.166+0000 7f921bfff700 1 -- 172.21.15.84:0/577424071 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92280036a0 con 0x7f92340b5cd0 2023-07-14T11:15:14.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.167+0000 7f9239fff700 1 -- 172.21.15.84:0/577424071 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92340c9570 con 0x7f92340b5cd0 2023-07-14T11:15:14.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.167+0000 7f9239fff700 1 -- 172.21.15.84:0/577424071 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92340c8d50 con 0x7f92340b5cd0 2023-07-14T11:15:14.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.168+0000 7f921bfff700 1 -- 172.21.15.84:0/577424071 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 7) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f9228021030 con 0x7f92340b5cd0 2023-07-14T11:15:14.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.169+0000 7f921bfff700 1 --2- 172.21.15.84:0/577424071 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f922006ae90 0x7f922006d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:14.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.170+0000 7f921bfff700 1 -- 172.21.15.84:0/577424071 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f922808ac60 con 0x7f92340b5cd0 2023-07-14T11:15:14.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.170+0000 7f92337fe700 1 --2- 172.21.15.84:0/577424071 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f922006ae90 0x7f922006d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:14.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.170+0000 7f92337fe700 1 --2- 172.21.15.84:0/577424071 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f922006ae90 0x7f922006d340 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9224006fd0 tx=0x7f9224008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:14.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.174+0000 7f921bfff700 1 -- 172.21.15.84:0/577424071 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f92340c8d50 con 0x7f92340b5cd0 2023-07-14T11:15:14.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.410+0000 7f9239fff700 1 -- 172.21.15.84:0/577424071 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f92340c8d50 con 0x7f92340b5cd0 2023-07-14T11:15:14.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.411+0000 7f921bfff700 1 -- 172.21.15.84:0/577424071 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4712 (secure 0 0 0) 0x7f92340c8d50 con 0x7f92340b5cd0 2023-07-14T11:15:14.414 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:15:14.414 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5030,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3551222138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3551222138},{"type":"v1","addr":"172.21.15.179:6834","nonce":3551222138}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5036,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/1316665435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1316665435},{"type":"v1","addr":"172.21.15.84:6836","nonce":1316665435}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5416,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/611235750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":611235750},{"type":"v1","addr":"172.21.15.179:6835","nonce":611235750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T11:15:10.408480+0000","modified":"2023-07-14T11:15:13.936541+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5625},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5625":{"gid":5625,"name":"c","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/2672133286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":2672133286},{"type":"v1","addr":"172.21.15.84:6837","nonce":2672133286}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-14T11:15:14.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.413+0000 7f9239fff700 1 -- 172.21.15.84:0/577424071 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f922006ae90 msgr2=0x7f922006d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:14.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.413+0000 7f9239fff700 1 --2- 172.21.15.84:0/577424071 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f922006ae90 0x7f922006d340 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9224006fd0 tx=0x7f9224008040 comp rx=0 tx=0).stop 2023-07-14T11:15:14.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.413+0000 7f9239fff700 1 -- 172.21.15.84:0/577424071 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92340b5cd0 msgr2=0x7f92340c9030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:14.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.413+0000 7f9239fff700 1 --2- 172.21.15.84:0/577424071 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92340b5cd0 0x7f92340c9030 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f9234067220 tx=0x7f9228004750 comp rx=0 tx=0).stop 2023-07-14T11:15:14.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.413+0000 7f9239fff700 1 -- 172.21.15.84:0/577424071 shutdown_connections 2023-07-14T11:15:14.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.413+0000 7f9239fff700 1 --2- 172.21.15.84:0/577424071 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f922006ae90 0x7f922006d340 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:14.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.413+0000 7f9239fff700 1 --2- 172.21.15.84:0/577424071 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92340b1f70 0x7f92340c9f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:14.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.413+0000 7f9239fff700 1 --2- 172.21.15.84:0/577424071 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9234160030 0x7f9234151ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:14.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.413+0000 7f9239fff700 1 --2- 172.21.15.84:0/577424071 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92340b5cd0 0x7f92340c9030 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:14.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.413+0000 7f9239fff700 1 -- 172.21.15.84:0/577424071 >> 172.21.15.84:0/577424071 conn(0x7f923409c190 msgr2=0x7f92340b0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:14.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.413+0000 7f9239fff700 1 -- 172.21.15.84:0/577424071 shutdown_connections 2023-07-14T11:15:14.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.413+0000 7f9239fff700 1 -- 172.21.15.84:0/577424071 wait complete. 2023-07-14T11:15:14.418 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 27 2023-07-14T11:15:14.435 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:15:14.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.627+0000 7fbeb8bff700 1 Processor -- start 2023-07-14T11:15:14.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.627+0000 7fbeb8bff700 1 -- start start 2023-07-14T11:15:14.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.629+0000 7fbeb8bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbeb406f1d0 0x7fbeb40cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:14.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.629+0000 7fbeb8bff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbeb40ce230 0x7fbeb40cb270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:14.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.629+0000 7fbeb8bff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbeb406dd30 con 0x7fbeb40d1310 2023-07-14T11:15:14.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.629+0000 7fbeb8bff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbeb415cda0 con 0x7fbeb40ce230 2023-07-14T11:15:14.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.629+0000 7fbeb8bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb40cc8f0 con 0x7fbeb406f1d0 2023-07-14T11:15:14.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.629+0000 7fbeb259c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fbeb40d1310 0x7fbeb40cd5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55256/0 (socket says 172.21.15.84:55256) 2023-07-14T11:15:14.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.629+0000 7fbeb259c700 1 -- 172.21.15.84:0/1530860379 learned_addr learned my addr 172.21.15.84:0/1530860379 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:15:14.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.629+0000 7fbeb2d9d700 1 --2- 172.21.15.84:0/1530860379 >> v2:172.21.15.179:3300/0 conn(0x7fbeb40ce230 0x7fbeb40cb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:14.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.629+0000 7fbeb1d9b700 1 --2- 172.21.15.84:0/1530860379 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbeb406f1d0 0x7fbeb40cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:14.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.629+0000 7fbeb159a700 1 -- 172.21.15.84:0/1530860379 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2285687000 0 0) 0x7fbeb406dd30 con 0x7fbeb40d1310 2023-07-14T11:15:14.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.629+0000 7fbeb159a700 1 -- 172.21.15.84:0/1530860379 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe9c0035b0 con 0x7fbeb40d1310 2023-07-14T11:15:14.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.630+0000 7fbeb2d9d700 1 -- 172.21.15.84:0/1530860379 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbeb406f1d0 msgr2=0x7fbeb40cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:14.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.630+0000 7fbeb2d9d700 1 --2- 172.21.15.84:0/1530860379 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbeb406f1d0 0x7fbeb40cdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:14.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.630+0000 7fbeb159a700 1 -- 172.21.15.84:0/1530860379 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3457386405 0 0) 0x7fbe9c0035b0 con 0x7fbeb40d1310 2023-07-14T11:15:14.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.630+0000 7fbeb2d9d700 1 -- 172.21.15.84:0/1530860379 >> v1:172.21.15.84:6789/0 conn(0x7fbeb40d1310 legacy=0x7fbeb40cd5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:14.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.630+0000 7fbeb2d9d700 1 -- 172.21.15.84:0/1530860379 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeb40ccbd0 con 0x7fbeb40ce230 2023-07-14T11:15:14.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.630+0000 7fbeb2d9d700 1 --2- 172.21.15.84:0/1530860379 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbeb40ce230 0x7fbeb40cb270 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fbeac009d90 tx=0x7fbeac00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d3ce3095bc83f5c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:14.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.630+0000 7fbeb159a700 1 -- 172.21.15.84:0/1530860379 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeac00e070 con 0x7fbeb40ce230 2023-07-14T11:15:14.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.630+0000 7fbeb159a700 1 -- 172.21.15.84:0/1530860379 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeac003a20 con 0x7fbeb40ce230 2023-07-14T11:15:14.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.630+0000 7fbeb159a700 1 -- 172.21.15.84:0/1530860379 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea4001670 con 0x7fbeb40ce230 2023-07-14T11:15:14.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.631+0000 7fbeb8bff700 1 -- 172.21.15.84:0/1530860379 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbeb40ce230 msgr2=0x7fbeb40cb270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:14.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.631+0000 7fbeb8bff700 1 --2- 172.21.15.84:0/1530860379 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbeb40ce230 0x7fbeb40cb270 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fbeac009d90 tx=0x7fbeac00b330 comp rx=0 tx=0).stop 2023-07-14T11:15:14.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.631+0000 7fbeb8bff700 1 -- 172.21.15.84:0/1530860379 shutdown_connections 2023-07-14T11:15:14.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.631+0000 7fbeb8bff700 1 --2- 172.21.15.84:0/1530860379 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbeb40ce230 0x7fbeb40cb270 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:14.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.631+0000 7fbeb8bff700 1 --2- 172.21.15.84:0/1530860379 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbeb406f1d0 0x7fbeb40cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:14.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.631+0000 7fbeb8bff700 1 -- 172.21.15.84:0/1530860379 >> 172.21.15.84:0/1530860379 conn(0x7fbeb40999e0 msgr2=0x7fbeb4099de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:14.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.631+0000 7fbeb8bff700 1 -- 172.21.15.84:0/1530860379 shutdown_connections 2023-07-14T11:15:14.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.631+0000 7fbeb8bff700 1 -- 172.21.15.84:0/1530860379 wait complete. 2023-07-14T11:15:14.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.632+0000 7fbeb8bff700 1 Processor -- start 2023-07-14T11:15:14.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.633+0000 7fbeb8bff700 1 -- start start 2023-07-14T11:15:14.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.633+0000 7fbeb8bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbeb406f1d0 0x7fbeb40b2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:14.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.634+0000 7fbeb8bff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbeb40d1310 0x7fbeb41f5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:14.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.634+0000 7fbeb8bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbeb41f6090 0x7fbeb41f58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:14.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.634+0000 7fbeb8bff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb41f2f30 con 0x7fbeb40d1310 2023-07-14T11:15:14.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.634+0000 7fbeb8bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb40adcc0 con 0x7fbeb41f6090 2023-07-14T11:15:14.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.634+0000 7fbeb8bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb40b2ee0 con 0x7fbeb406f1d0 2023-07-14T11:15:14.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.634+0000 7fbeb1d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbeb40d1310 0x7fbeb41f5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:14.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.634+0000 7fbeb1d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbeb40d1310 0x7fbeb41f5360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38652/0 (socket says 172.21.15.84:38652) 2023-07-14T11:15:14.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.634+0000 7fbeb1d9b700 1 -- 172.21.15.84:0/759892369 learned_addr learned my addr 172.21.15.84:0/759892369 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:14.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.634+0000 7fbeb259c700 1 --2- 172.21.15.84:0/759892369 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbeb406f1d0 0x7fbeb40b2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:14.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.634+0000 7fbeb2d9d700 1 --2- 172.21.15.84:0/759892369 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbeb41f6090 0x7fbeb41f58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:14.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.634+0000 7fbeb1d9b700 1 -- 172.21.15.84:0/759892369 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbeb406f1d0 msgr2=0x7fbeb40b2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:14.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.634+0000 7fbeb1d9b700 1 --2- 172.21.15.84:0/759892369 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbeb406f1d0 0x7fbeb40b2460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:14.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.634+0000 7fbeb1d9b700 1 -- 172.21.15.84:0/759892369 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbeb41f6090 msgr2=0x7fbeb41f58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:14.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.634+0000 7fbeb1d9b700 1 --2- 172.21.15.84:0/759892369 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbeb41f6090 0x7fbeb41f58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:14.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.634+0000 7fbeb1d9b700 1 -- 172.21.15.84:0/759892369 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeac009a70 con 0x7fbeb40d1310 2023-07-14T11:15:14.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.634+0000 7fbeb2d9d700 1 --2- 172.21.15.84:0/759892369 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbeb41f6090 0x7fbeb41f58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:15:14.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.634+0000 7fbeb1d9b700 1 --2- 172.21.15.84:0/759892369 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbeb40d1310 0x7fbeb41f5360 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fbea800e9b0 tx=0x7fbea800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:14.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.635+0000 7fbea2ffd700 1 -- 172.21.15.84:0/759892369 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea8009710 con 0x7fbeb40d1310 2023-07-14T11:15:14.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.635+0000 7fbea2ffd700 1 -- 172.21.15.84:0/759892369 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbea800c850 con 0x7fbeb40d1310 2023-07-14T11:15:14.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.635+0000 7fbeb8bff700 1 -- 172.21.15.84:0/759892369 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbeb40b31c0 con 0x7fbeb40d1310 2023-07-14T11:15:14.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.635+0000 7fbea2ffd700 1 -- 172.21.15.84:0/759892369 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea800cbc0 con 0x7fbeb40d1310 2023-07-14T11:15:14.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.635+0000 7fbeb8bff700 1 -- 172.21.15.84:0/759892369 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbeb40ad950 con 0x7fbeb40d1310 2023-07-14T11:15:14.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.636+0000 7fbeb8bff700 1 -- 172.21.15.84:0/759892369 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbeb404e280 con 0x7fbeb40d1310 2023-07-14T11:15:14.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.637+0000 7fbea2ffd700 1 -- 172.21.15.84:0/759892369 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 7) v1 ==== 89190+0+0 (secure 0 0 0) 0x7fbea800cd20 con 0x7fbeb40d1310 2023-07-14T11:15:14.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.638+0000 7fbea2ffd700 1 --2- 172.21.15.84:0/759892369 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fbe9406ae90 0x7fbe9406d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:14.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.638+0000 7fbea2ffd700 1 -- 172.21.15.84:0/759892369 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbea8089820 con 0x7fbeb40d1310 2023-07-14T11:15:14.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.639+0000 7fbeb259c700 1 --2- 172.21.15.84:0/759892369 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fbe9406ae90 0x7fbe9406d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:14.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.639+0000 7fbeb259c700 1 --2- 172.21.15.84:0/759892369 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fbe9406ae90 0x7fbe9406d340 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fbea4001eb0 tx=0x7fbea4001c40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:14.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.643+0000 7fbea2ffd700 1 -- 172.21.15.84:0/759892369 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fbea80546e0 con 0x7fbeb40d1310 2023-07-14T11:15:14.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.836+0000 7fbeb8bff700 1 -- 172.21.15.84:0/759892369 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbeb40c8660 con 0x7fbeb40d1310 2023-07-14T11:15:14.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.837+0000 7fbea2ffd700 1 -- 172.21.15.84:0/759892369 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+18327 (secure 0 0 0) 0x7fbea8057d00 con 0x7fbeb40d1310 2023-07-14T11:15:14.841 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:15:14.841 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":50,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:15:11.922007+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-07-14T11:15:08.611029+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-07-14T11:15:09.373415+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:15:14.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.839+0000 7fbeb8bff700 1 -- 172.21.15.84:0/759892369 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fbe9406ae90 msgr2=0x7fbe9406d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:14.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.839+0000 7fbeb8bff700 1 --2- 172.21.15.84:0/759892369 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fbe9406ae90 0x7fbe9406d340 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fbea4001eb0 tx=0x7fbea4001c40 comp rx=0 tx=0).stop 2023-07-14T11:15:14.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.839+0000 7fbeb8bff700 1 -- 172.21.15.84:0/759892369 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbeb40d1310 msgr2=0x7fbeb41f5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:14.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.839+0000 7fbeb8bff700 1 --2- 172.21.15.84:0/759892369 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbeb40d1310 0x7fbeb41f5360 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fbea800e9b0 tx=0x7fbea800ed70 comp rx=0 tx=0).stop 2023-07-14T11:15:14.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.839+0000 7fbeb8bff700 1 -- 172.21.15.84:0/759892369 shutdown_connections 2023-07-14T11:15:14.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.839+0000 7fbeb8bff700 1 --2- 172.21.15.84:0/759892369 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fbe9406ae90 0x7fbe9406d340 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:14.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.839+0000 7fbeb8bff700 1 --2- 172.21.15.84:0/759892369 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbeb406f1d0 0x7fbeb40b2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:14.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.839+0000 7fbeb8bff700 1 --2- 172.21.15.84:0/759892369 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbeb41f6090 0x7fbeb41f58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:14.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.840+0000 7fbeb8bff700 1 --2- 172.21.15.84:0/759892369 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbeb40d1310 0x7fbeb41f5360 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:14.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.840+0000 7fbeb8bff700 1 -- 172.21.15.84:0/759892369 >> 172.21.15.84:0/759892369 conn(0x7fbeb40999e0 msgr2=0x7fbeb415c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:14.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.840+0000 7fbeb8bff700 1 -- 172.21.15.84:0/759892369 shutdown_connections 2023-07-14T11:15:14.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:14.840+0000 7fbeb8bff700 1 -- 172.21.15.84:0/759892369 wait complete. 2023-07-14T11:15:14.861 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-14T11:15:14.862 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T11:15:15.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.057+0000 7f778efff700 1 Processor -- start 2023-07-14T11:15:15.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.057+0000 7f778efff700 1 -- start start 2023-07-14T11:15:15.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.059+0000 7f778efff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77880d1160 0x7f778806c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:15.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.059+0000 7f778efff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f77880b5cd0 0x7f77880b0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:15.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.059+0000 7f778efff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77880d2cc0 con 0x7f7788160030 2023-07-14T11:15:15.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.059+0000 7f778efff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77880afbb0 con 0x7f77880b5cd0 2023-07-14T11:15:15.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.059+0000 7f778efff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77880afe90 con 0x7f77880d1160 2023-07-14T11:15:15.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.060+0000 7f7787fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77880d1160 0x7f778806c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:15.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.060+0000 7f778d59c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f77880b5cd0 0x7f77880b0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:15.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.060+0000 7f778cd9b700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f7788160030 0x7f77880d0a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.84:55798/0 (socket says 172.21.15.84:55798) 2023-07-14T11:15:15.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.060+0000 7f778cd9b700 1 -- 172.21.15.84:0/3639204597 learned_addr learned my addr 172.21.15.84:0/3639204597 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:15:15.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.060+0000 7f778d59c700 1 -- 172.21.15.84:0/3639204597 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77880d1160 msgr2=0x7f778806c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:15.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.060+0000 7f778d59c700 1 --2- 172.21.15.84:0/3639204597 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77880d1160 0x7f778806c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:15.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.060+0000 7f778d59c700 1 -- 172.21.15.84:0/3639204597 >> v1:172.21.15.179:6789/0 conn(0x7f7788160030 legacy=0x7f77880d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:15.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.060+0000 7f778d59c700 1 -- 172.21.15.84:0/3639204597 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77880b0170 con 0x7f77880b5cd0 2023-07-14T11:15:15.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.060+0000 7f7787fff700 1 --2- 172.21.15.84:0/3639204597 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77880d1160 0x7f778806c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:15:15.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.060+0000 7f778d59c700 1 --2- 172.21.15.84:0/3639204597 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77880b5cd0 0x7f77880b0c50 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7780009d90 tx=0x7f778000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c41b658fb4e723a0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:15.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.061+0000 7f77877fe700 1 -- 172.21.15.84:0/3639204597 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f778000e070 con 0x7f77880b5cd0 2023-07-14T11:15:15.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.061+0000 7f77877fe700 1 -- 172.21.15.84:0/3639204597 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f778000bb20 con 0x7f77880b5cd0 2023-07-14T11:15:15.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.061+0000 7f77877fe700 1 -- 172.21.15.84:0/3639204597 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7780012430 con 0x7f77880b5cd0 2023-07-14T11:15:15.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.061+0000 7f778efff700 1 -- 172.21.15.84:0/3639204597 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77880b5cd0 msgr2=0x7f77880b0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:15.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.061+0000 7f778efff700 1 --2- 172.21.15.84:0/3639204597 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77880b5cd0 0x7f77880b0c50 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7780009d90 tx=0x7f778000b330 comp rx=0 tx=0).stop 2023-07-14T11:15:15.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.061+0000 7f778efff700 1 -- 172.21.15.84:0/3639204597 shutdown_connections 2023-07-14T11:15:15.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.061+0000 7f778efff700 1 --2- 172.21.15.84:0/3639204597 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77880b5cd0 0x7f77880b0c50 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:15.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.061+0000 7f778efff700 1 --2- 172.21.15.84:0/3639204597 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77880d1160 0x7f778806c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:15.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.061+0000 7f778efff700 1 -- 172.21.15.84:0/3639204597 >> 172.21.15.84:0/3639204597 conn(0x7f778809c190 msgr2=0x7f77880d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:15.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.061+0000 7f778efff700 1 -- 172.21.15.84:0/3639204597 shutdown_connections 2023-07-14T11:15:15.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.061+0000 7f778efff700 1 -- 172.21.15.84:0/3639204597 wait complete. 2023-07-14T11:15:15.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.064+0000 7f778efff700 1 Processor -- start 2023-07-14T11:15:15.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.064+0000 7f778efff700 1 -- start start 2023-07-14T11:15:15.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.065+0000 7f778efff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77880b5cd0 0x7f77881f2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:15.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.065+0000 7f778efff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77880d1160 0x7f77881e88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:15.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.065+0000 7f778efff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7788160030 0x7f7788150380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:15.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.065+0000 7f778efff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77881e90e0 con 0x7f77880d1160 2023-07-14T11:15:15.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.065+0000 7f778efff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77881f39b0 con 0x7f7788160030 2023-07-14T11:15:15.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.065+0000 7f778efff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77881e8e10 con 0x7f77880b5cd0 2023-07-14T11:15:15.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.065+0000 7f7787fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77880d1160 0x7f77881e88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:15.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.065+0000 7f7787fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77880d1160 0x7f77881e88d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38662/0 (socket says 172.21.15.84:38662) 2023-07-14T11:15:15.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.065+0000 7f7787fff700 1 -- 172.21.15.84:0/1633362743 learned_addr learned my addr 172.21.15.84:0/1633362743 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:15.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.065+0000 7f778cd9b700 1 --2- 172.21.15.84:0/1633362743 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77880b5cd0 0x7f77881f2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:15.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.065+0000 7f778d59c700 1 --2- 172.21.15.84:0/1633362743 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7788160030 0x7f7788150380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:15.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.065+0000 7f7787fff700 1 -- 172.21.15.84:0/1633362743 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77880b5cd0 msgr2=0x7f77881f2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:15.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.065+0000 7f7787fff700 1 --2- 172.21.15.84:0/1633362743 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77880b5cd0 0x7f77881f2930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:15.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.065+0000 7f7787fff700 1 -- 172.21.15.84:0/1633362743 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7788160030 msgr2=0x7f7788150380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:15.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.065+0000 7f7787fff700 1 --2- 172.21.15.84:0/1633362743 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7788160030 0x7f7788150380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:15.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.065+0000 7f7787fff700 1 -- 172.21.15.84:0/1633362743 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77740094a0 con 0x7f77880d1160 2023-07-14T11:15:15.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.066+0000 7f7787fff700 1 --2- 172.21.15.84:0/1633362743 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77880d1160 0x7f77881e88d0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f777400ebe0 tx=0x7f777400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:15.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.066+0000 7f77857fa700 1 -- 172.21.15.84:0/1633362743 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77740097a0 con 0x7f77880d1160 2023-07-14T11:15:15.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.066+0000 7f77857fa700 1 -- 172.21.15.84:0/1633362743 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f777400c850 con 0x7f77880d1160 2023-07-14T11:15:15.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.066+0000 7f778efff700 1 -- 172.21.15.84:0/1633362743 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7780009a70 con 0x7f77880d1160 2023-07-14T11:15:15.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.066+0000 7f77857fa700 1 -- 172.21.15.84:0/1633362743 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f777400cbe0 con 0x7f77880d1160 2023-07-14T11:15:15.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.066+0000 7f778efff700 1 -- 172.21.15.84:0/1633362743 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77881f3360 con 0x7f77880d1160 2023-07-14T11:15:15.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.067+0000 7f778efff700 1 -- 172.21.15.84:0/1633362743 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77881f3b20 con 0x7f77880d1160 2023-07-14T11:15:15.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.068+0000 7f77857fa700 1 -- 172.21.15.84:0/1633362743 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 7) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f777400cd40 con 0x7f77880d1160 2023-07-14T11:15:15.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.070+0000 7f77857fa700 1 --2- 172.21.15.84:0/1633362743 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f776c06ae90 0x7f776c06d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:15.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.070+0000 7f77857fa700 1 -- 172.21.15.84:0/1633362743 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7774089500 con 0x7f77880d1160 2023-07-14T11:15:15.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.070+0000 7f778cd9b700 1 --2- 172.21.15.84:0/1633362743 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f776c06ae90 0x7f776c06d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:15.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.071+0000 7f778cd9b700 1 --2- 172.21.15.84:0/1633362743 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f776c06ae90 0x7f776c06d340 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f777c005910 tx=0x7f777c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:15.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.074+0000 7f77857fa700 1 -- 172.21.15.84:0/1633362743 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7774054290 con 0x7f77880d1160 2023-07-14T11:15:15.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.266+0000 7f778efff700 1 -- 172.21.15.84:0/1633362743 --> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f77880b0730 con 0x7f776c06ae90 2023-07-14T11:15:15.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.277+0000 7f77857fa700 1 -- 172.21.15.84:0/1633362743 <== mgr.4104 v2:172.21.15.84:6832/379617029 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305465 (secure 0 0 0) 0x7f777c001ce0 con 0x7f776c06ae90 2023-07-14T11:15:15.283 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:15:15.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.281+0000 7f778efff700 1 -- 172.21.15.84:0/1633362743 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f776c06ae90 msgr2=0x7f776c06d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:15.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.281+0000 7f778efff700 1 --2- 172.21.15.84:0/1633362743 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f776c06ae90 0x7f776c06d340 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f777c005910 tx=0x7f777c009040 comp rx=0 tx=0).stop 2023-07-14T11:15:15.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.281+0000 7f778efff700 1 -- 172.21.15.84:0/1633362743 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77880d1160 msgr2=0x7f77881e88d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:15.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.281+0000 7f778efff700 1 --2- 172.21.15.84:0/1633362743 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77880d1160 0x7f77881e88d0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f777400ebe0 tx=0x7f777400eef0 comp rx=0 tx=0).stop 2023-07-14T11:15:15.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.281+0000 7f778efff700 1 -- 172.21.15.84:0/1633362743 shutdown_connections 2023-07-14T11:15:15.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.281+0000 7f778efff700 1 --2- 172.21.15.84:0/1633362743 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f776c06ae90 0x7f776c06d340 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:15.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.281+0000 7f778efff700 1 --2- 172.21.15.84:0/1633362743 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77880b5cd0 0x7f77881f2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:15.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.281+0000 7f778efff700 1 --2- 172.21.15.84:0/1633362743 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7788160030 0x7f7788150380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:15.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.281+0000 7f778efff700 1 --2- 172.21.15.84:0/1633362743 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77880d1160 0x7f77881e88d0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:15.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.281+0000 7f778efff700 1 -- 172.21.15.84:0/1633362743 >> 172.21.15.84:0/1633362743 conn(0x7f778809c190 msgr2=0x7f77880b7930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:15.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.281+0000 7f778efff700 1 -- 172.21.15.84:0/1633362743 shutdown_connections 2023-07-14T11:15:15.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.281+0000 7f778efff700 1 -- 172.21.15.84:0/1633362743 wait complete. 2023-07-14T11:15:15.287 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-07-14T11:15:15.302 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":110,"stamp":"2023-07-14T11:15:14.095595+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":20,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221144,"kb_used_data":5528,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754753576,"statfs":{"total":773094113280,"available":772867661824,"internally_reserved":0,"allocated":5660672,"data_stored":3085928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.198860"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.910645+0000","last_change":"2023-07-14T11:15:09.910645+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.910645+0000","last_undegraded":"2023-07-14T11:15:09.910645+0000","last_fullsized":"2023-07-14T11:15:09.910645+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.915664+0000","last_change":"2023-07-14T11:15:09.915664+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.915664+0000","last_undegraded":"2023-07-14T11:15:09.915664+0000","last_fullsized":"2023-07-14T11:15:09.915664+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.915183+0000","last_change":"2023-07-14T11:15:09.915183+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.915183+0000","last_undegraded":"2023-07-14T11:15:09.915183+0000","last_fullsized":"2023-07-14T11:15:09.915183+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.915566+0000","last_change":"2023-07-14T11:15:09.915566+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.915566+0000","last_undegraded":"2023-07-14T11:15:09.915566+0000","last_fullsized":"2023-07-14T11:15:09.915566+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.921956+0000","last_change":"2023-07-14T11:15:09.921956+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.921956+0000","last_undegraded":"2023-07-14T11:15:09.921956+0000","last_fullsized":"2023-07-14T11:15:09.921956+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.910668+0000","last_change":"2023-07-14T11:15:09.910668+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.910668+0000","last_undegraded":"2023-07-14T11:15:09.910668+0000","last_fullsized":"2023-07-14T11:15:09.910668+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.916057+0000","last_change":"2023-07-14T11:15:09.916057+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.916057+0000","last_undegraded":"2023-07-14T11:15:09.916057+0000","last_fullsized":"2023-07-14T11:15:09.916057+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.915754+0000","last_change":"2023-07-14T11:15:09.915754+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.915754+0000","last_undegraded":"2023-07-14T11:15:09.915754+0000","last_fullsized":"2023-07-14T11:15:09.915754+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.913157+0000","last_change":"2023-07-14T11:15:09.913157+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.913157+0000","last_undegraded":"2023-07-14T11:15:09.913157+0000","last_fullsized":"2023-07-14T11:15:09.913157+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.911099+0000","last_change":"2023-07-14T11:15:09.911099+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.911099+0000","last_undegraded":"2023-07-14T11:15:09.911099+0000","last_fullsized":"2023-07-14T11:15:09.911099+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.919371+0000","last_change":"2023-07-14T11:15:09.919371+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.919371+0000","last_undegraded":"2023-07-14T11:15:09.919371+0000","last_fullsized":"2023-07-14T11:15:09.919371+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.915104+0000","last_change":"2023-07-14T11:15:09.915104+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.915104+0000","last_undegraded":"2023-07-14T11:15:09.915104+0000","last_fullsized":"2023-07-14T11:15:09.915104+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.910557+0000","last_change":"2023-07-14T11:15:09.910557+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.910557+0000","last_undegraded":"2023-07-14T11:15:09.910557+0000","last_fullsized":"2023-07-14T11:15:09.910557+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.914625+0000","last_change":"2023-07-14T11:15:09.914625+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.914625+0000","last_undegraded":"2023-07-14T11:15:09.914625+0000","last_fullsized":"2023-07-14T11:15:09.914625+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.916144+0000","last_change":"2023-07-14T11:15:09.916144+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.916144+0000","last_undegraded":"2023-07-14T11:15:09.916144+0000","last_fullsized":"2023-07-14T11:15:09.916144+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.910796+0000","last_change":"2023-07-14T11:15:09.910796+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.910796+0000","last_undegraded":"2023-07-14T11:15:09.910796+0000","last_fullsized":"2023-07-14T11:15:09.910796+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.918399+0000","last_change":"2023-07-14T11:15:09.918399+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.918399+0000","last_undegraded":"2023-07-14T11:15:09.918399+0000","last_fullsized":"2023-07-14T11:15:09.918399+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.915081+0000","last_change":"2023-07-14T11:15:09.915081+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.915081+0000","last_undegraded":"2023-07-14T11:15:09.915081+0000","last_fullsized":"2023-07-14T11:15:09.915081+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.914730+0000","last_change":"2023-07-14T11:15:09.914730+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.914730+0000","last_undegraded":"2023-07-14T11:15:09.914730+0000","last_fullsized":"2023-07-14T11:15:09.914730+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.916881+0000","last_change":"2023-07-14T11:15:09.916881+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.916881+0000","last_undegraded":"2023-07-14T11:15:09.916881+0000","last_fullsized":"2023-07-14T11:15:09.916881+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.914806+0000","last_change":"2023-07-14T11:15:09.914806+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.914806+0000","last_undegraded":"2023-07-14T11:15:09.914806+0000","last_fullsized":"2023-07-14T11:15:09.914806+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.912717+0000","last_change":"2023-07-14T11:15:09.912717+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.912717+0000","last_undegraded":"2023-07-14T11:15:09.912717+0000","last_fullsized":"2023-07-14T11:15:09.912717+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.918700+0000","last_change":"2023-07-14T11:15:09.918700+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.918700+0000","last_undegraded":"2023-07-14T11:15:09.918700+0000","last_fullsized":"2023-07-14T11:15:09.918700+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.917374+0000","last_change":"2023-07-14T11:15:09.917374+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.917374+0000","last_undegraded":"2023-07-14T11:15:09.917374+0000","last_fullsized":"2023-07-14T11:15:09.917374+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.917958+0000","last_change":"2023-07-14T11:15:09.917958+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.917958+0000","last_undegraded":"2023-07-14T11:15:09.917958+0000","last_fullsized":"2023-07-14T11:15:09.917958+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.912601+0000","last_change":"2023-07-14T11:15:09.912601+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.912601+0000","last_undegraded":"2023-07-14T11:15:09.912601+0000","last_fullsized":"2023-07-14T11:15:09.912601+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.909687+0000","last_change":"2023-07-14T11:15:09.909687+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.909687+0000","last_undegraded":"2023-07-14T11:15:09.909687+0000","last_fullsized":"2023-07-14T11:15:09.909687+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.914882+0000","last_change":"2023-07-14T11:15:09.914882+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.914882+0000","last_undegraded":"2023-07-14T11:15:09.914882+0000","last_fullsized":"2023-07-14T11:15:09.914882+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.916327+0000","last_change":"2023-07-14T11:15:09.916327+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.916327+0000","last_undegraded":"2023-07-14T11:15:09.916327+0000","last_fullsized":"2023-07-14T11:15:09.916327+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.915165+0000","last_change":"2023-07-14T11:15:09.915165+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.915165+0000","last_undegraded":"2023-07-14T11:15:09.915165+0000","last_fullsized":"2023-07-14T11:15:09.915165+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.915478+0000","last_change":"2023-07-14T11:15:09.915478+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.915478+0000","last_undegraded":"2023-07-14T11:15:09.915478+0000","last_fullsized":"2023-07-14T11:15:09.915478+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.908745+0000","last_change":"2023-07-14T11:15:09.908745+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.908745+0000","last_undegraded":"2023-07-14T11:15:09.908745+0000","last_fullsized":"2023-07-14T11:15:09.908745+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.916309+0000","last_change":"2023-07-14T11:15:09.916309+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.916309+0000","last_undegraded":"2023-07-14T11:15:09.916309+0000","last_fullsized":"2023-07-14T11:15:09.916309+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.932559+0000","last_change":"2023-07-14T11:15:09.929802+0000","last_active":"2023-07-14T11:15:09.932559+0000","last_peered":"2023-07-14T11:15:09.932559+0000","last_clean":"2023-07-14T11:15:09.932559+0000","last_became_active":"2023-07-14T11:15:09.929501+0000","last_became_peered":"2023-07-14T11:15:09.929501+0000","last_unstale":"2023-07-14T11:15:09.932559+0000","last_undegraded":"2023-07-14T11:15:09.932559+0000","last_fullsized":"2023-07-14T11:15:09.932559+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:21:21.205503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.908101+0000","last_change":"2023-07-14T11:15:09.908101+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.908101+0000","last_undegraded":"2023-07-14T11:15:09.908101+0000","last_fullsized":"2023-07-14T11:15:09.908101+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.926883+0000","last_change":"2023-07-14T11:15:09.921655+0000","last_active":"2023-07-14T11:15:09.926883+0000","last_peered":"2023-07-14T11:15:09.926883+0000","last_clean":"2023-07-14T11:15:09.926883+0000","last_became_active":"2023-07-14T11:15:09.921392+0000","last_became_peered":"2023-07-14T11:15:09.921392+0000","last_unstale":"2023-07-14T11:15:09.926883+0000","last_undegraded":"2023-07-14T11:15:09.926883+0000","last_fullsized":"2023-07-14T11:15:09.926883+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:45:33.602453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.914879+0000","last_change":"2023-07-14T11:15:09.914879+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.914879+0000","last_undegraded":"2023-07-14T11:15:09.914879+0000","last_fullsized":"2023-07-14T11:15:09.914879+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.931476+0000","last_change":"2023-07-14T11:15:09.924119+0000","last_active":"2023-07-14T11:15:09.931476+0000","last_peered":"2023-07-14T11:15:09.931476+0000","last_clean":"2023-07-14T11:15:09.931476+0000","last_became_active":"2023-07-14T11:15:09.923816+0000","last_became_peered":"2023-07-14T11:15:09.923816+0000","last_unstale":"2023-07-14T11:15:09.931476+0000","last_undegraded":"2023-07-14T11:15:09.931476+0000","last_fullsized":"2023-07-14T11:15:09.931476+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:55:43.489544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.914078+0000","last_change":"2023-07-14T11:15:09.914078+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.914078+0000","last_undegraded":"2023-07-14T11:15:09.914078+0000","last_fullsized":"2023-07-14T11:15:09.914078+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.925337+0000","last_change":"2023-07-14T11:15:09.922230+0000","last_active":"2023-07-14T11:15:09.925337+0000","last_peered":"2023-07-14T11:15:09.925337+0000","last_clean":"2023-07-14T11:15:09.925337+0000","last_became_active":"2023-07-14T11:15:09.921945+0000","last_became_peered":"2023-07-14T11:15:09.921945+0000","last_unstale":"2023-07-14T11:15:09.925337+0000","last_undegraded":"2023-07-14T11:15:09.925337+0000","last_fullsized":"2023-07-14T11:15:09.925337+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:07:38.622507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.920153+0000","last_change":"2023-07-14T11:15:09.920153+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.920153+0000","last_undegraded":"2023-07-14T11:15:09.920153+0000","last_fullsized":"2023-07-14T11:15:09.920153+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.934757+0000","last_change":"2023-07-14T11:15:09.930314+0000","last_active":"2023-07-14T11:15:09.934757+0000","last_peered":"2023-07-14T11:15:09.934757+0000","last_clean":"2023-07-14T11:15:09.934757+0000","last_became_active":"2023-07-14T11:15:09.930070+0000","last_became_peered":"2023-07-14T11:15:09.930070+0000","last_unstale":"2023-07-14T11:15:09.934757+0000","last_undegraded":"2023-07-14T11:15:09.934757+0000","last_fullsized":"2023-07-14T11:15:09.934757+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:52:42.599546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.916231+0000","last_change":"2023-07-14T11:15:09.916231+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.916231+0000","last_undegraded":"2023-07-14T11:15:09.916231+0000","last_fullsized":"2023-07-14T11:15:09.916231+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.928108+0000","last_change":"2023-07-14T11:15:09.926046+0000","last_active":"2023-07-14T11:15:09.928108+0000","last_peered":"2023-07-14T11:15:09.928108+0000","last_clean":"2023-07-14T11:15:09.928108+0000","last_became_active":"2023-07-14T11:15:09.925750+0000","last_became_peered":"2023-07-14T11:15:09.925750+0000","last_unstale":"2023-07-14T11:15:09.928108+0000","last_undegraded":"2023-07-14T11:15:09.928108+0000","last_fullsized":"2023-07-14T11:15:09.928108+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:55:34.403692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.913106+0000","last_change":"2023-07-14T11:15:09.913106+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.913106+0000","last_undegraded":"2023-07-14T11:15:09.913106+0000","last_fullsized":"2023-07-14T11:15:09.913106+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.928358+0000","last_change":"2023-07-14T11:15:09.926115+0000","last_active":"2023-07-14T11:15:09.928358+0000","last_peered":"2023-07-14T11:15:09.928358+0000","last_clean":"2023-07-14T11:15:09.928358+0000","last_became_active":"2023-07-14T11:15:09.925816+0000","last_became_peered":"2023-07-14T11:15:09.925816+0000","last_unstale":"2023-07-14T11:15:09.928358+0000","last_undegraded":"2023-07-14T11:15:09.928358+0000","last_fullsized":"2023-07-14T11:15:09.928358+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:31:20.921900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.917012+0000","last_change":"2023-07-14T11:15:09.917012+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.917012+0000","last_undegraded":"2023-07-14T11:15:09.917012+0000","last_fullsized":"2023-07-14T11:15:09.917012+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.928641+0000","last_change":"2023-07-14T11:15:09.925165+0000","last_active":"2023-07-14T11:15:09.928641+0000","last_peered":"2023-07-14T11:15:09.928641+0000","last_clean":"2023-07-14T11:15:09.928641+0000","last_became_active":"2023-07-14T11:15:09.924894+0000","last_became_peered":"2023-07-14T11:15:09.924894+0000","last_unstale":"2023-07-14T11:15:09.928641+0000","last_undegraded":"2023-07-14T11:15:09.928641+0000","last_fullsized":"2023-07-14T11:15:09.928641+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:53:03.155971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.919967+0000","last_change":"2023-07-14T11:15:09.919967+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.919967+0000","last_undegraded":"2023-07-14T11:15:09.919967+0000","last_fullsized":"2023-07-14T11:15:09.919967+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.930551+0000","last_change":"2023-07-14T11:15:09.926330+0000","last_active":"2023-07-14T11:15:09.930551+0000","last_peered":"2023-07-14T11:15:09.930551+0000","last_clean":"2023-07-14T11:15:09.930551+0000","last_became_active":"2023-07-14T11:15:09.926039+0000","last_became_peered":"2023-07-14T11:15:09.926039+0000","last_unstale":"2023-07-14T11:15:09.930551+0000","last_undegraded":"2023-07-14T11:15:09.930551+0000","last_fullsized":"2023-07-14T11:15:09.930551+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:38:33.409052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.908870+0000","last_change":"2023-07-14T11:15:09.908870+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.908870+0000","last_undegraded":"2023-07-14T11:15:09.908870+0000","last_fullsized":"2023-07-14T11:15:09.908870+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.930668+0000","last_change":"2023-07-14T11:15:09.928164+0000","last_active":"2023-07-14T11:15:09.930668+0000","last_peered":"2023-07-14T11:15:09.930668+0000","last_clean":"2023-07-14T11:15:09.930668+0000","last_became_active":"2023-07-14T11:15:09.927872+0000","last_became_peered":"2023-07-14T11:15:09.927872+0000","last_unstale":"2023-07-14T11:15:09.930668+0000","last_undegraded":"2023-07-14T11:15:09.930668+0000","last_fullsized":"2023-07-14T11:15:09.930668+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:08:46.232657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.914112+0000","last_change":"2023-07-14T11:15:09.914112+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.914112+0000","last_undegraded":"2023-07-14T11:15:09.914112+0000","last_fullsized":"2023-07-14T11:15:09.914112+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.932800+0000","last_change":"2023-07-14T11:15:09.928283+0000","last_active":"2023-07-14T11:15:09.932800+0000","last_peered":"2023-07-14T11:15:09.932800+0000","last_clean":"2023-07-14T11:15:09.932800+0000","last_became_active":"2023-07-14T11:15:09.927756+0000","last_became_peered":"2023-07-14T11:15:09.927756+0000","last_unstale":"2023-07-14T11:15:09.932800+0000","last_undegraded":"2023-07-14T11:15:09.932800+0000","last_fullsized":"2023-07-14T11:15:09.932800+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:24:57.406024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.920883+0000","last_change":"2023-07-14T11:15:09.920883+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.920883+0000","last_undegraded":"2023-07-14T11:15:09.920883+0000","last_fullsized":"2023-07-14T11:15:09.920883+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.934020+0000","last_change":"2023-07-14T11:15:09.928525+0000","last_active":"2023-07-14T11:15:09.934020+0000","last_peered":"2023-07-14T11:15:09.934020+0000","last_clean":"2023-07-14T11:15:09.934020+0000","last_became_active":"2023-07-14T11:15:09.928270+0000","last_became_peered":"2023-07-14T11:15:09.928270+0000","last_unstale":"2023-07-14T11:15:09.934020+0000","last_undegraded":"2023-07-14T11:15:09.934020+0000","last_fullsized":"2023-07-14T11:15:09.934020+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:55:34.403692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.908540+0000","last_change":"2023-07-14T11:15:09.908540+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.908540+0000","last_undegraded":"2023-07-14T11:15:09.908540+0000","last_fullsized":"2023-07-14T11:15:09.908540+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.933788+0000","last_change":"2023-07-14T11:15:09.926581+0000","last_active":"2023-07-14T11:15:09.933788+0000","last_peered":"2023-07-14T11:15:09.933788+0000","last_clean":"2023-07-14T11:15:09.933788+0000","last_became_active":"2023-07-14T11:15:09.926305+0000","last_became_peered":"2023-07-14T11:15:09.926305+0000","last_unstale":"2023-07-14T11:15:09.933788+0000","last_undegraded":"2023-07-14T11:15:09.933788+0000","last_fullsized":"2023-07-14T11:15:09.933788+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:21:54.253623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.914257+0000","last_change":"2023-07-14T11:15:09.914257+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.914257+0000","last_undegraded":"2023-07-14T11:15:09.914257+0000","last_fullsized":"2023-07-14T11:15:09.914257+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.928329+0000","last_change":"2023-07-14T11:15:09.925179+0000","last_active":"2023-07-14T11:15:09.928329+0000","last_peered":"2023-07-14T11:15:09.928329+0000","last_clean":"2023-07-14T11:15:09.928329+0000","last_became_active":"2023-07-14T11:15:09.924920+0000","last_became_peered":"2023-07-14T11:15:09.924920+0000","last_unstale":"2023-07-14T11:15:09.928329+0000","last_undegraded":"2023-07-14T11:15:09.928329+0000","last_fullsized":"2023-07-14T11:15:09.928329+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:14:48.334190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.913541+0000","last_change":"2023-07-14T11:15:09.913541+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.913541+0000","last_undegraded":"2023-07-14T11:15:09.913541+0000","last_fullsized":"2023-07-14T11:15:09.913541+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.930634+0000","last_change":"2023-07-14T11:15:09.927381+0000","last_active":"2023-07-14T11:15:09.930634+0000","last_peered":"2023-07-14T11:15:09.930634+0000","last_clean":"2023-07-14T11:15:09.930634+0000","last_became_active":"2023-07-14T11:15:09.927064+0000","last_became_peered":"2023-07-14T11:15:09.927064+0000","last_unstale":"2023-07-14T11:15:09.930634+0000","last_undegraded":"2023-07-14T11:15:09.930634+0000","last_fullsized":"2023-07-14T11:15:09.930634+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:24:31.222134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.917499+0000","last_change":"2023-07-14T11:15:09.917499+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.917499+0000","last_undegraded":"2023-07-14T11:15:09.917499+0000","last_fullsized":"2023-07-14T11:15:09.917499+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.933907+0000","last_change":"2023-07-14T11:15:09.928241+0000","last_active":"2023-07-14T11:15:09.933907+0000","last_peered":"2023-07-14T11:15:09.933907+0000","last_clean":"2023-07-14T11:15:09.933907+0000","last_became_active":"2023-07-14T11:15:09.927889+0000","last_became_peered":"2023-07-14T11:15:09.927889+0000","last_unstale":"2023-07-14T11:15:09.933907+0000","last_undegraded":"2023-07-14T11:15:09.933907+0000","last_fullsized":"2023-07-14T11:15:09.933907+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:53:21.756049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.912215+0000","last_change":"2023-07-14T11:15:09.912215+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.912215+0000","last_undegraded":"2023-07-14T11:15:09.912215+0000","last_fullsized":"2023-07-14T11:15:09.912215+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.934576+0000","last_change":"2023-07-14T11:15:09.927305+0000","last_active":"2023-07-14T11:15:09.934576+0000","last_peered":"2023-07-14T11:15:09.934576+0000","last_clean":"2023-07-14T11:15:09.934576+0000","last_became_active":"2023-07-14T11:15:09.927040+0000","last_became_peered":"2023-07-14T11:15:09.927040+0000","last_unstale":"2023-07-14T11:15:09.934576+0000","last_undegraded":"2023-07-14T11:15:09.934576+0000","last_fullsized":"2023-07-14T11:15:09.934576+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:09:11.625537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.909605+0000","last_change":"2023-07-14T11:15:09.909605+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.909605+0000","last_undegraded":"2023-07-14T11:15:09.909605+0000","last_fullsized":"2023-07-14T11:15:09.909605+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.931793+0000","last_change":"2023-07-14T11:15:09.929235+0000","last_active":"2023-07-14T11:15:09.931793+0000","last_peered":"2023-07-14T11:15:09.931793+0000","last_clean":"2023-07-14T11:15:09.931793+0000","last_became_active":"2023-07-14T11:15:09.928960+0000","last_became_peered":"2023-07-14T11:15:09.928960+0000","last_unstale":"2023-07-14T11:15:09.931793+0000","last_undegraded":"2023-07-14T11:15:09.931793+0000","last_fullsized":"2023-07-14T11:15:09.931793+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:30:17.080496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.920373+0000","last_change":"2023-07-14T11:15:09.920373+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.920373+0000","last_undegraded":"2023-07-14T11:15:09.920373+0000","last_fullsized":"2023-07-14T11:15:09.920373+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.926812+0000","last_change":"2023-07-14T11:15:09.924426+0000","last_active":"2023-07-14T11:15:09.926812+0000","last_peered":"2023-07-14T11:15:09.926812+0000","last_clean":"2023-07-14T11:15:09.926812+0000","last_became_active":"2023-07-14T11:15:09.924111+0000","last_became_peered":"2023-07-14T11:15:09.924111+0000","last_unstale":"2023-07-14T11:15:09.926812+0000","last_undegraded":"2023-07-14T11:15:09.926812+0000","last_fullsized":"2023-07-14T11:15:09.926812+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:23:37.690839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.909620+0000","last_change":"2023-07-14T11:15:09.909620+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.909620+0000","last_undegraded":"2023-07-14T11:15:09.909620+0000","last_fullsized":"2023-07-14T11:15:09.909620+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.930522+0000","last_change":"2023-07-14T11:15:09.926848+0000","last_active":"2023-07-14T11:15:09.930522+0000","last_peered":"2023-07-14T11:15:09.930522+0000","last_clean":"2023-07-14T11:15:09.930522+0000","last_became_active":"2023-07-14T11:15:09.926521+0000","last_became_peered":"2023-07-14T11:15:09.926521+0000","last_unstale":"2023-07-14T11:15:09.930522+0000","last_undegraded":"2023-07-14T11:15:09.930522+0000","last_fullsized":"2023-07-14T11:15:09.930522+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:30:17.080496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.909007+0000","last_change":"2023-07-14T11:15:09.909007+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.909007+0000","last_undegraded":"2023-07-14T11:15:09.909007+0000","last_fullsized":"2023-07-14T11:15:09.909007+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.931398+0000","last_change":"2023-07-14T11:15:09.923168+0000","last_active":"2023-07-14T11:15:09.931398+0000","last_peered":"2023-07-14T11:15:09.931398+0000","last_clean":"2023-07-14T11:15:09.931398+0000","last_became_active":"2023-07-14T11:15:09.922855+0000","last_became_peered":"2023-07-14T11:15:09.922855+0000","last_unstale":"2023-07-14T11:15:09.931398+0000","last_undegraded":"2023-07-14T11:15:09.931398+0000","last_fullsized":"2023-07-14T11:15:09.931398+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:07:59.893541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.916667+0000","last_change":"2023-07-14T11:15:09.916667+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.916667+0000","last_undegraded":"2023-07-14T11:15:09.916667+0000","last_fullsized":"2023-07-14T11:15:09.916667+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.933858+0000","last_change":"2023-07-14T11:15:09.928441+0000","last_active":"2023-07-14T11:15:09.933858+0000","last_peered":"2023-07-14T11:15:09.933858+0000","last_clean":"2023-07-14T11:15:09.933858+0000","last_became_active":"2023-07-14T11:15:09.928121+0000","last_became_peered":"2023-07-14T11:15:09.928121+0000","last_unstale":"2023-07-14T11:15:09.933858+0000","last_undegraded":"2023-07-14T11:15:09.933858+0000","last_fullsized":"2023-07-14T11:15:09.933858+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:59:02.394297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.916174+0000","last_change":"2023-07-14T11:15:09.916174+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.916174+0000","last_undegraded":"2023-07-14T11:15:09.916174+0000","last_fullsized":"2023-07-14T11:15:09.916174+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.934733+0000","last_change":"2023-07-14T11:15:09.929803+0000","last_active":"2023-07-14T11:15:09.934733+0000","last_peered":"2023-07-14T11:15:09.934733+0000","last_clean":"2023-07-14T11:15:09.934733+0000","last_became_active":"2023-07-14T11:15:09.929513+0000","last_became_peered":"2023-07-14T11:15:09.929513+0000","last_unstale":"2023-07-14T11:15:09.934733+0000","last_undegraded":"2023-07-14T11:15:09.934733+0000","last_fullsized":"2023-07-14T11:15:09.934733+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:38:06.284908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.909716+0000","last_change":"2023-07-14T11:15:09.909716+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.909716+0000","last_undegraded":"2023-07-14T11:15:09.909716+0000","last_fullsized":"2023-07-14T11:15:09.909716+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.933346+0000","last_change":"2023-07-14T11:15:09.929305+0000","last_active":"2023-07-14T11:15:09.933346+0000","last_peered":"2023-07-14T11:15:09.933346+0000","last_clean":"2023-07-14T11:15:09.933346+0000","last_became_active":"2023-07-14T11:15:09.929031+0000","last_became_peered":"2023-07-14T11:15:09.929031+0000","last_unstale":"2023-07-14T11:15:09.933346+0000","last_undegraded":"2023-07-14T11:15:09.933346+0000","last_fullsized":"2023-07-14T11:15:09.933346+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:34:20.755562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.916646+0000","last_change":"2023-07-14T11:15:09.916646+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.916646+0000","last_undegraded":"2023-07-14T11:15:09.916646+0000","last_fullsized":"2023-07-14T11:15:09.916646+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.933255+0000","last_change":"2023-07-14T11:15:09.930870+0000","last_active":"2023-07-14T11:15:09.933255+0000","last_peered":"2023-07-14T11:15:09.933255+0000","last_clean":"2023-07-14T11:15:09.933255+0000","last_became_active":"2023-07-14T11:15:09.930528+0000","last_became_peered":"2023-07-14T11:15:09.930528+0000","last_unstale":"2023-07-14T11:15:09.933255+0000","last_undegraded":"2023-07-14T11:15:09.933255+0000","last_fullsized":"2023-07-14T11:15:09.933255+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:15:43.073580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":69,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.907887+0000","last_change":"2023-07-14T11:13:08.923786+0000","last_active":"2023-07-14T11:15:09.907887+0000","last_peered":"2023-07-14T11:15:09.907887+0000","last_clean":"2023-07-14T11:15:09.907887+0000","last_became_active":"2023-07-14T11:13:08.923384+0000","last_became_peered":"2023-07-14T11:13:08.923384+0000","last_unstale":"2023-07-14T11:15:09.907887+0000","last_undegraded":"2023-07-14T11:15:09.907887+0000","last_fullsized":"2023-07-14T11:15:09.907887+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:32:41.654117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.908104+0000","last_change":"2023-07-14T11:15:09.908104+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.908104+0000","last_undegraded":"2023-07-14T11:15:09.908104+0000","last_fullsized":"2023-07-14T11:15:09.908104+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.932476+0000","last_change":"2023-07-14T11:15:09.928459+0000","last_active":"2023-07-14T11:15:09.932476+0000","last_peered":"2023-07-14T11:15:09.932476+0000","last_clean":"2023-07-14T11:15:09.932476+0000","last_became_active":"2023-07-14T11:15:09.928095+0000","last_became_peered":"2023-07-14T11:15:09.928095+0000","last_unstale":"2023-07-14T11:15:09.932476+0000","last_undegraded":"2023-07-14T11:15:09.932476+0000","last_fullsized":"2023-07-14T11:15:09.932476+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:31:37.916606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":65,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.909970+0000","last_change":"2023-07-14T11:13:08.758749+0000","last_active":"2023-07-14T11:15:09.909970+0000","last_peered":"2023-07-14T11:15:09.909970+0000","last_clean":"2023-07-14T11:15:09.909970+0000","last_became_active":"2023-07-14T11:13:08.757956+0000","last_became_peered":"2023-07-14T11:13:08.757956+0000","last_unstale":"2023-07-14T11:15:09.909970+0000","last_undegraded":"2023-07-14T11:15:09.909970+0000","last_fullsized":"2023-07-14T11:15:09.909970+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:46:12.073550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.913584+0000","last_change":"2023-07-14T11:15:09.913584+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.913584+0000","last_undegraded":"2023-07-14T11:15:09.913584+0000","last_fullsized":"2023-07-14T11:15:09.913584+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.934820+0000","last_change":"2023-07-14T11:15:09.931330+0000","last_active":"2023-07-14T11:15:09.934820+0000","last_peered":"2023-07-14T11:15:09.934820+0000","last_clean":"2023-07-14T11:15:09.934820+0000","last_became_active":"2023-07-14T11:15:09.931069+0000","last_became_peered":"2023-07-14T11:15:09.931069+0000","last_unstale":"2023-07-14T11:15:09.934820+0000","last_undegraded":"2023-07-14T11:15:09.934820+0000","last_fullsized":"2023-07-14T11:15:09.934820+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:44:55.656851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":69,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.919015+0000","last_change":"2023-07-14T11:13:08.862331+0000","last_active":"2023-07-14T11:15:09.919015+0000","last_peered":"2023-07-14T11:15:09.919015+0000","last_clean":"2023-07-14T11:15:09.919015+0000","last_became_active":"2023-07-14T11:13:08.861817+0000","last_became_peered":"2023-07-14T11:13:08.861817+0000","last_unstale":"2023-07-14T11:15:09.919015+0000","last_undegraded":"2023-07-14T11:15:09.919015+0000","last_fullsized":"2023-07-14T11:15:09.919015+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:05:29.409421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.915385+0000","last_change":"2023-07-14T11:15:09.915385+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.915385+0000","last_undegraded":"2023-07-14T11:15:09.915385+0000","last_fullsized":"2023-07-14T11:15:09.915385+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.934632+0000","last_change":"2023-07-14T11:15:09.928418+0000","last_active":"2023-07-14T11:15:09.934632+0000","last_peered":"2023-07-14T11:15:09.934632+0000","last_clean":"2023-07-14T11:15:09.934632+0000","last_became_active":"2023-07-14T11:15:09.927987+0000","last_became_peered":"2023-07-14T11:15:09.927987+0000","last_unstale":"2023-07-14T11:15:09.934632+0000","last_undegraded":"2023-07-14T11:15:09.934632+0000","last_fullsized":"2023-07-14T11:15:09.934632+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:36:26.856627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":65,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.909935+0000","last_change":"2023-07-14T11:13:08.757882+0000","last_active":"2023-07-14T11:15:09.909935+0000","last_peered":"2023-07-14T11:15:09.909935+0000","last_clean":"2023-07-14T11:15:09.909935+0000","last_became_active":"2023-07-14T11:13:08.757541+0000","last_became_peered":"2023-07-14T11:13:08.757541+0000","last_unstale":"2023-07-14T11:15:09.909935+0000","last_undegraded":"2023-07-14T11:15:09.909935+0000","last_fullsized":"2023-07-14T11:15:09.909935+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:17:11.547757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":218,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.916622+0000","last_change":"2023-07-14T11:13:01.370649+0000","last_active":"2023-07-14T11:15:09.916622+0000","last_peered":"2023-07-14T11:15:09.916622+0000","last_clean":"2023-07-14T11:15:09.916622+0000","last_became_active":"2023-07-14T11:13:01.369478+0000","last_became_peered":"2023-07-14T11:13:01.369478+0000","last_unstale":"2023-07-14T11:15:09.916622+0000","last_undegraded":"2023-07-14T11:15:09.916622+0000","last_fullsized":"2023-07-14T11:15:09.916622+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:00.254800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:00.254800+0000","last_clean_scrub_stamp":"2023-07-14T11:13:00.254800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:22:18.281189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.909627+0000","last_change":"2023-07-14T11:15:09.909627+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.909627+0000","last_undegraded":"2023-07-14T11:15:09.909627+0000","last_fullsized":"2023-07-14T11:15:09.909627+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.930646+0000","last_change":"2023-07-14T11:15:09.927770+0000","last_active":"2023-07-14T11:15:09.930646+0000","last_peered":"2023-07-14T11:15:09.930646+0000","last_clean":"2023-07-14T11:15:09.930646+0000","last_became_active":"2023-07-14T11:15:09.927446+0000","last_became_peered":"2023-07-14T11:15:09.927446+0000","last_unstale":"2023-07-14T11:15:09.930646+0000","last_undegraded":"2023-07-14T11:15:09.930646+0000","last_fullsized":"2023-07-14T11:15:09.930646+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:45:30.193517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":62,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.916836+0000","last_change":"2023-07-14T11:13:08.760609+0000","last_active":"2023-07-14T11:15:09.916836+0000","last_peered":"2023-07-14T11:15:09.916836+0000","last_clean":"2023-07-14T11:15:09.916836+0000","last_became_active":"2023-07-14T11:13:08.760285+0000","last_became_peered":"2023-07-14T11:13:08.760285+0000","last_unstale":"2023-07-14T11:15:09.916836+0000","last_undegraded":"2023-07-14T11:15:09.916836+0000","last_fullsized":"2023-07-14T11:15:09.916836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:22:55.554731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.912618+0000","last_change":"2023-07-14T11:15:09.912618+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.912618+0000","last_undegraded":"2023-07-14T11:15:09.912618+0000","last_fullsized":"2023-07-14T11:15:09.912618+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.928567+0000","last_change":"2023-07-14T11:15:09.923995+0000","last_active":"2023-07-14T11:15:09.928567+0000","last_peered":"2023-07-14T11:15:09.928567+0000","last_clean":"2023-07-14T11:15:09.928567+0000","last_became_active":"2023-07-14T11:15:09.923504+0000","last_became_peered":"2023-07-14T11:15:09.923504+0000","last_unstale":"2023-07-14T11:15:09.928567+0000","last_undegraded":"2023-07-14T11:15:09.928567+0000","last_fullsized":"2023-07-14T11:15:09.928567+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:37:53.285310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":61,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.917313+0000","last_change":"2023-07-14T11:13:08.923899+0000","last_active":"2023-07-14T11:15:09.917313+0000","last_peered":"2023-07-14T11:15:09.917313+0000","last_clean":"2023-07-14T11:15:09.917313+0000","last_became_active":"2023-07-14T11:13:08.923513+0000","last_became_peered":"2023-07-14T11:13:08.923513+0000","last_unstale":"2023-07-14T11:15:09.917313+0000","last_undegraded":"2023-07-14T11:15:09.917313+0000","last_fullsized":"2023-07-14T11:15:09.917313+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:15:01.205941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.917106+0000","last_change":"2023-07-14T11:15:09.917106+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.917106+0000","last_undegraded":"2023-07-14T11:15:09.917106+0000","last_fullsized":"2023-07-14T11:15:09.917106+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.934097+0000","last_change":"2023-07-14T11:15:09.928608+0000","last_active":"2023-07-14T11:15:09.934097+0000","last_peered":"2023-07-14T11:15:09.934097+0000","last_clean":"2023-07-14T11:15:09.934097+0000","last_became_active":"2023-07-14T11:15:09.927944+0000","last_became_peered":"2023-07-14T11:15:09.927944+0000","last_unstale":"2023-07-14T11:15:09.934097+0000","last_undegraded":"2023-07-14T11:15:09.934097+0000","last_fullsized":"2023-07-14T11:15:09.934097+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:14:29.526358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":69,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.908339+0000","last_change":"2023-07-14T11:13:08.761726+0000","last_active":"2023-07-14T11:15:09.908339+0000","last_peered":"2023-07-14T11:15:09.908339+0000","last_clean":"2023-07-14T11:15:09.908339+0000","last_became_active":"2023-07-14T11:13:08.761365+0000","last_became_peered":"2023-07-14T11:13:08.761365+0000","last_unstale":"2023-07-14T11:15:09.908339+0000","last_undegraded":"2023-07-14T11:15:09.908339+0000","last_fullsized":"2023-07-14T11:15:09.908339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:53:59.620129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.908106+0000","last_change":"2023-07-14T11:15:09.908106+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.908106+0000","last_undegraded":"2023-07-14T11:15:09.908106+0000","last_fullsized":"2023-07-14T11:15:09.908106+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.933812+0000","last_change":"2023-07-14T11:15:09.928400+0000","last_active":"2023-07-14T11:15:09.933812+0000","last_peered":"2023-07-14T11:15:09.933812+0000","last_clean":"2023-07-14T11:15:09.933812+0000","last_became_active":"2023-07-14T11:15:09.928137+0000","last_became_peered":"2023-07-14T11:15:09.928137+0000","last_unstale":"2023-07-14T11:15:09.933812+0000","last_undegraded":"2023-07-14T11:15:09.933812+0000","last_fullsized":"2023-07-14T11:15:09.933812+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:53:30.122825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":65,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.919315+0000","last_change":"2023-07-14T11:13:08.762084+0000","last_active":"2023-07-14T11:15:09.919315+0000","last_peered":"2023-07-14T11:15:09.919315+0000","last_clean":"2023-07-14T11:15:09.919315+0000","last_became_active":"2023-07-14T11:13:08.761763+0000","last_became_peered":"2023-07-14T11:13:08.761763+0000","last_unstale":"2023-07-14T11:15:09.919315+0000","last_undegraded":"2023-07-14T11:15:09.919315+0000","last_fullsized":"2023-07-14T11:15:09.919315+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:05:29.409421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574878,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28084,"kb_used_data":1132,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343756,"statfs":{"total":96636764160,"available":96608006144,"internally_reserved":0,"allocated":1159168,"data_stored":831831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.93200000000000005,"15min":0.98399999999999999},"min":{"1min":0.47199999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.877,"5min":8.4339999999999993,"15min":8.4339999999999993},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.97099999999999997,"15min":1.0209999999999999},"min":{"1min":0.52300000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.91600000000000004,"5min":8.4559999999999995,"15min":8.4559999999999995},"last":0.66600000000000004}]},{"osd":1,"last update":"Fri Jul 14 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.90000000000000002,"15min":0.94699999999999995},"min":{"1min":0.40400000000000003,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.84499999999999997,"5min":6.3520000000000003,"15min":6.3520000000000003},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":1.079,"15min":1.149},"min":{"1min":0.46400000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.86099999999999999,"5min":6.8550000000000004,"15min":6.8550000000000004},"last":0.62}]},{"osd":2,"last update":"Fri Jul 14 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":1.1359999999999999,"15min":1.212},"min":{"1min":0.51100000000000001,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.95599999999999996,"5min":7.0289999999999999,"15min":7.0289999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.69399999999999995,"15min":0.68999999999999995},"min":{"1min":0.51600000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.98199999999999998,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.48199999999999998}]},{"osd":3,"last update":"Fri Jul 14 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":1.1930000000000001,"15min":1.2769999999999999},"min":{"1min":0.58299999999999996,"5min":0.505,"15min":0.505},"max":{"1min":0.85999999999999999,"5min":10.337,"15min":10.337},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.77200000000000002,"15min":0.77300000000000002},"min":{"1min":0.60199999999999998,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.93300000000000005,"5min":1.921,"15min":1.921},"last":0.72499999999999998}]},{"osd":4,"last update":"Fri Jul 14 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.60099999999999998,"15min":0.58299999999999996},"min":{"1min":0.41499999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.70699999999999996,"15min":0.69599999999999995},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.76100000000000001}]},{"osd":5,"last update":"Fri Jul 14 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.68000000000000005,"15min":0.67200000000000004},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.74399999999999999,"15min":0.73399999999999999},"min":{"1min":0.60399999999999998,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.83099999999999996}]},{"osd":6,"last update":"Fri Jul 14 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.68200000000000005,"15min":0.66800000000000004},"min":{"1min":0.498,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.69299999999999995,"15min":0.68100000000000005},"min":{"1min":0.55800000000000005,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.59599999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574879,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":540,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":552960,"data_stored":234835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.71199999999999997,"15min":0.70699999999999996},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.752,"5min":0.72199999999999998,"15min":0.71699999999999997},"min":{"1min":0.51300000000000001,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.57399999999999995}]},{"osd":1,"last update":"Fri Jul 14 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.68200000000000005,"15min":0.67900000000000005},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.751,"5min":0.71499999999999997,"15min":0.70899999999999996},"min":{"1min":0.42299999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.63}]},{"osd":2,"last update":"Fri Jul 14 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.67400000000000004,"15min":0.67000000000000004},"min":{"1min":0.45500000000000002,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.78300000000000003,"15min":0.78500000000000003},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.53200000000000003}]},{"osd":3,"last update":"Fri Jul 14 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.749,"15min":0.749},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.749,"15min":0.74399999999999999},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.63700000000000001}]},{"osd":4,"last update":"Fri Jul 14 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.71199999999999997,"15min":0.71399999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.712,"5min":1.712,"15min":1.712},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.73499999999999999,"15min":0.73099999999999998},"min":{"1min":0.438,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.68899999999999995}]},{"osd":5,"last update":"Fri Jul 14 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.73799999999999999,"15min":0.72599999999999998},"min":{"1min":0.52700000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":2.8820000000000001,"5min":2.8820000000000001,"15min":2.8820000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.78800000000000003,"15min":0.79300000000000004},"min":{"1min":0.46100000000000002,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.95099999999999996,"5min":1.129,"15min":1.129},"last":0.47799999999999998}]},{"osd":7,"last update":"Fri Jul 14 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.80500000000000005,"15min":0.80900000000000005},"min":{"1min":0.49199999999999999,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.79500000000000004,"15min":0.79900000000000004},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.55,"5min":1.55,"15min":1.55},"last":0.59899999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":540,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":552960,"data_stored":234835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.439,"15min":0.443},"min":{"1min":0.28299999999999997,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.59099999999999997,"5min":0.996,"15min":0.996},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.47399999999999998,"15min":0.48199999999999998},"min":{"1min":0.30199999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.81599999999999995,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.38800000000000001}]},{"osd":2,"last update":"Fri Jul 14 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.56499999999999995,"15min":0.57699999999999996},"min":{"1min":0.374,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.68600000000000005,"5min":2.476,"15min":2.476},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.61099999999999999,"15min":0.63600000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.70499999999999996,"5min":2.6299999999999999,"15min":2.6299999999999999},"last":0.52900000000000003}]},{"osd":3,"last update":"Fri Jul 14 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51700000000000002,"15min":0.51800000000000002},"min":{"1min":0.39300000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.65200000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.48899999999999999,"15min":0.496},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.65700000000000003,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.57999999999999996}]},{"osd":4,"last update":"Fri Jul 14 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.75,"15min":0.753},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0149999999999999,"5min":1.363,"15min":1.363},"last":0.748},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.054,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.84699999999999998}]},{"osd":5,"last update":"Fri Jul 14 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.77900000000000003,"15min":0.77500000000000002},"min":{"1min":0.53100000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.1739999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.81799999999999995,"15min":0.82599999999999996},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.095,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.70399999999999996}]},{"osd":6,"last update":"Fri Jul 14 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.79700000000000004,"15min":0.80500000000000005},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.141,"5min":1.298,"15min":1.298},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.78600000000000003,"15min":0.79000000000000004},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.123,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.80100000000000005}]},{"osd":7,"last update":"Fri Jul 14 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.82499999999999996,"15min":0.82899999999999996},"min":{"1min":0.61899999999999999,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.2010000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.78600000000000003,"15min":0.79100000000000004},"min":{"1min":0.55000000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.92700000000000005,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.69599999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28072,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343768,"statfs":{"total":96636764160,"available":96608018432,"internally_reserved":0,"allocated":1146880,"data_stored":825203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.42999999999999999,"15min":0.432},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.64000000000000001,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.434,"15min":0.438},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.44}]},{"osd":2,"last update":"Fri Jul 14 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.45700000000000002,"15min":0.45900000000000002},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.65000000000000002,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.498,"15min":0.502},"min":{"1min":0.376,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.64300000000000002,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.71499999999999997}]},{"osd":3,"last update":"Fri Jul 14 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.42099999999999999,"15min":0.41799999999999998},"min":{"1min":0.32000000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.499,"5min":0.51900000000000002,"15min":0.52300000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.94599999999999995}]},{"osd":4,"last update":"Fri Jul 14 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.75700000000000001,"15min":0.76400000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.90500000000000003,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.753},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.69899999999999995,"15min":0.69699999999999995},"min":{"1min":0.54400000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.70599999999999996}]},{"osd":5,"last update":"Fri Jul 14 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.71499999999999997,"15min":0.71899999999999997},"min":{"1min":0.502,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.83299999999999996,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.745,"5min":0.77400000000000002,"15min":0.77900000000000003},"min":{"1min":0.54400000000000004,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.93500000000000005,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.83499999999999996}]},{"osd":6,"last update":"Fri Jul 14 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.71399999999999997,"15min":0.71799999999999997},"min":{"1min":0.59699999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.83899999999999997,"5min":1.006,"15min":1.006},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.77100000000000002,"15min":0.77800000000000002},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.89200000000000002,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.92900000000000005}]},{"osd":7,"last update":"Fri Jul 14 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.80900000000000005,"15min":0.81999999999999995},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":0.91300000000000003,"5min":1.149,"15min":1.149},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.57599999999999996,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.94899999999999995,"5min":1.081,"15min":1.081},"last":0.77400000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":540,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":552960,"data_stored":234835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.44600000000000001,"15min":0.45300000000000001},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.58199999999999996,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.442,"15min":0.44600000000000001},"min":{"1min":0.33000000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.66300000000000003,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.47799999999999998}]},{"osd":1,"last update":"Fri Jul 14 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.48399999999999999,"15min":0.48799999999999999},"min":{"1min":0.371,"5min":0.31,"15min":0.31},"max":{"1min":0.63500000000000001,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48999999999999999,"15min":0.49099999999999999},"min":{"1min":0.36199999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.60099999999999998,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.54200000000000004}]},{"osd":3,"last update":"Fri Jul 14 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.49299999999999999,"15min":0.495},"min":{"1min":0.34200000000000003,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.63200000000000001,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.58099999999999996,"15min":0.58799999999999997},"min":{"1min":0.44900000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.67300000000000004,"5min":1.034,"15min":1.034},"last":0.56000000000000005}]},{"osd":4,"last update":"Fri Jul 14 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.76400000000000001,"15min":0.77300000000000002},"min":{"1min":0.55300000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.93300000000000005,"5min":1.212,"15min":1.212},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.78200000000000003,"15min":0.79000000000000004},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.96799999999999997,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.71799999999999997}]},{"osd":5,"last update":"Fri Jul 14 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.78700000000000003,"15min":0.79600000000000004},"min":{"1min":0.57399999999999995,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.117,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.751,"5min":0.81899999999999995,"15min":0.82999999999999996},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0229999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.79200000000000004}]},{"osd":6,"last update":"Fri Jul 14 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.78600000000000003,"15min":0.79200000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.077,"5min":1.103,"15min":1.103},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.746,"5min":0.81799999999999995,"15min":0.82999999999999996},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.006,"5min":1.258,"15min":1.258},"last":0.68400000000000005}]},{"osd":7,"last update":"Fri Jul 14 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.79900000000000004,"15min":0.80600000000000005},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1339999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.79800000000000004,"15min":0.81100000000000005},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":0.98899999999999999,"5min":1.202,"15min":1.202},"last":0.69299999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":565248,"data_stored":241463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.441,"15min":0.45200000000000001},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.63900000000000001,"5min":0.754,"15min":0.754},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.441,"15min":0.44700000000000001},"min":{"1min":0.33600000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.59699999999999998,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.40699999999999997}]},{"osd":1,"last update":"Fri Jul 14 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.44900000000000001,"15min":0.45200000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.58299999999999996,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.437,"5min":0.48799999999999999,"15min":0.496},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.54700000000000004,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.39300000000000002}]},{"osd":2,"last update":"Fri Jul 14 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.53400000000000003,"15min":0.54000000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.63900000000000001,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.58699999999999997,"15min":0.59799999999999998},"min":{"1min":0.44400000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.71599999999999997,"5min":1.585,"15min":1.585},"last":0.53200000000000003}]},{"osd":4,"last update":"Fri Jul 14 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.755,"15min":0.76100000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.93000000000000005,"5min":1.216,"15min":1.216},"last":0.754},{"interface":"front","average":{"1min":0.754,"5min":0.752,"15min":0.752},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.57599999999999996}]},{"osd":5,"last update":"Fri Jul 14 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.753,"15min":0.75900000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.90700000000000003,"5min":1.413,"15min":1.413},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.753,"5min":0.84499999999999997,"15min":0.86099999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1619999999999999,"5min":1.657,"15min":1.657},"last":0.77200000000000002}]},{"osd":6,"last update":"Fri Jul 14 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.77200000000000002,"15min":0.78100000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.999,"5min":1.726,"15min":1.726},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.79300000000000004,"15min":0.80200000000000005},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.88800000000000001,"5min":1.333,"15min":1.333},"last":0.78600000000000003}]},{"osd":7,"last update":"Fri Jul 14 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.82799999999999996,"15min":0.84099999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.135,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.83499999999999996,"15min":0.84299999999999997},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.232,"5min":1.268,"15min":1.268},"last":0.61399999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":565248,"data_stored":241463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.627,"15min":0.628},"min":{"1min":0.44,"5min":0.433,"15min":0.433},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69799999999999995,"15min":0.69899999999999995},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.53900000000000003}]},{"osd":1,"last update":"Fri Jul 14 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.66800000000000004,"15min":0.67200000000000004},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.92000000000000004,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.71099999999999997,"15min":0.71299999999999997},"min":{"1min":0.51400000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.99299999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.51400000000000001}]},{"osd":2,"last update":"Fri Jul 14 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.48499999999999999,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0209999999999999,"5min":1.48,"15min":1.48},"last":0.748},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.747,"15min":0.745},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.1080000000000001,"5min":1.23,"15min":1.23},"last":0.63800000000000001}]},{"osd":3,"last update":"Fri Jul 14 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.71699999999999997,"15min":0.72099999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.746,"15min":0.74099999999999999},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.1259999999999999,"5min":1.145,"15min":1.145},"last":0.78100000000000003}]},{"osd":5,"last update":"Fri Jul 14 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.76000000000000001,"15min":0.77400000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.88900000000000001,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.77200000000000002,"15min":0.78300000000000003},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.96999999999999997,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.47599999999999998}]},{"osd":6,"last update":"Fri Jul 14 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.1659999999999999,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.77800000000000002,"15min":0.78000000000000003},"min":{"1min":0.52300000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.1479999999999999,"5min":1.3,"15min":1.3},"last":0.57199999999999995}]},{"osd":7,"last update":"Fri Jul 14 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.77400000000000002,"15min":0.77800000000000002},"min":{"1min":0.54500000000000004,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.028,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.627},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.84699999999999998,"15min":0.85699999999999998},"min":{"1min":0.53700000000000003,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.21,"5min":1.379,"15min":1.379},"last":0.70199999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":565248,"data_stored":241463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.63700000000000001,"15min":0.64200000000000002},"min":{"1min":0.41299999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.996,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.627,"5min":0.63300000000000001,"15min":0.63400000000000001},"min":{"1min":0.47199999999999998,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.873,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.52500000000000002}]},{"osd":1,"last update":"Fri Jul 14 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.67700000000000005,"15min":0.68200000000000005},"min":{"1min":0.47699999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.88800000000000001,"5min":1.343,"15min":1.343},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.46300000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.46800000000000003}]},{"osd":2,"last update":"Fri Jul 14 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.73599999999999999,"15min":0.74099999999999999},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.012,"5min":1.034,"15min":1.034},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.76300000000000001,"15min":0.77300000000000002},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.88200000000000001,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.58999999999999997}]},{"osd":3,"last update":"Fri Jul 14 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.76300000000000001,"15min":0.77300000000000002},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.95499999999999996,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.628},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.76700000000000002,"15min":0.78700000000000003},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.89000000000000001,"5min":1.806,"15min":1.806},"last":0.64400000000000002}]},{"osd":4,"last update":"Fri Jul 14 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.65600000000000003,"15min":0.65900000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.0229999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.753,"15min":0.76600000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.66300000000000003}]},{"osd":6,"last update":"Fri Jul 14 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.747,"15min":0.75700000000000001},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.93600000000000005,"5min":1.03,"15min":1.03},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.745,"5min":0.80300000000000005,"15min":0.81299999999999994},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.048,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.746}]},{"osd":7,"last update":"Fri Jul 14 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.83899999999999997,"15min":0.86099999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.95299999999999996,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.86599999999999999,"15min":0.88200000000000001},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":0.96699999999999997,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.84399999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T11:15:15.309 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T11:15:15.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.535+0000 7fbcdafff700 1 Processor -- start 2023-07-14T11:15:15.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.535+0000 7fbcdafff700 1 -- start start 2023-07-14T11:15:15.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.536+0000 7fbcdafff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbcd415c710 0x7fbcd40cf510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:15.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.536+0000 7fbcdafff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcd4069f30 0x7fbcd406a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:15.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.536+0000 7fbcdafff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcd40cd320 con 0x7fbcd406d420 2023-07-14T11:15:15.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.536+0000 7fbcdafff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcd40ce750 con 0x7fbcd415c710 2023-07-14T11:15:15.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.536+0000 7fbcdafff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd40cea30 con 0x7fbcd4069f30 2023-07-14T11:15:15.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.536+0000 7fbcd959c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fbcd406d420 0x7fbcd4070950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55262/0 (socket says 172.21.15.84:55262) 2023-07-14T11:15:15.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.536+0000 7fbcd959c700 1 -- 172.21.15.84:0/503694495 learned_addr learned my addr 172.21.15.84:0/503694495 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:15:15.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.537+0000 7fbcd3fff700 1 --2- 172.21.15.84:0/503694495 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcd4069f30 0x7fbcd406a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:15.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.537+0000 7fbcd8d9b700 1 --2- 172.21.15.84:0/503694495 >> v2:172.21.15.179:3300/0 conn(0x7fbcd415c710 0x7fbcd40cf510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:15.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.537+0000 7fbcd37fe700 1 -- 172.21.15.84:0/503694495 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1207491548 0 0) 0x7fbcd40cd320 con 0x7fbcd406d420 2023-07-14T11:15:15.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.537+0000 7fbcd37fe700 1 -- 172.21.15.84:0/503694495 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbcc40035b0 con 0x7fbcd406d420 2023-07-14T11:15:15.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.537+0000 7fbcd37fe700 1 -- 172.21.15.84:0/503694495 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 257639240 0 0) 0x7fbcc40035b0 con 0x7fbcd406d420 2023-07-14T11:15:15.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.537+0000 7fbcd37fe700 1 -- 172.21.15.84:0/503694495 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcd4069f30 msgr2=0x7fbcd406a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:15.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.537+0000 7fbcd37fe700 1 --2- 172.21.15.84:0/503694495 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcd4069f30 0x7fbcd406a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:15.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.537+0000 7fbcd37fe700 1 -- 172.21.15.84:0/503694495 >> v2:172.21.15.179:3300/0 conn(0x7fbcd415c710 msgr2=0x7fbcd40cf510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:15.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.537+0000 7fbcd37fe700 1 --2- 172.21.15.84:0/503694495 >> v2:172.21.15.179:3300/0 conn(0x7fbcd415c710 0x7fbcd40cf510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:15.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.537+0000 7fbcd37fe700 1 -- 172.21.15.84:0/503694495 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcd40ced10 con 0x7fbcd406d420 2023-07-14T11:15:15.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.537+0000 7fbcd37fe700 1 -- 172.21.15.84:0/503694495 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7fbccc0019f0 con 0x7fbcd406d420 2023-07-14T11:15:15.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.537+0000 7fbcd37fe700 1 -- 172.21.15.84:0/503694495 >> v1:172.21.15.84:6789/0 conn(0x7fbcd406d420 legacy=0x7fbcd4070950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:15.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.537+0000 7fbcd37fe700 1 --2- 172.21.15.84:0/503694495 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcd4069f30 0x7fbcc4003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:15.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.537+0000 7fbcd37fe700 1 --2- 172.21.15.84:0/503694495 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbcc4003f80 0x7fbcc4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:15.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.537+0000 7fbcd37fe700 1 --2- 172.21.15.84:0/503694495 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbcc4004d90 0x7fbcc4005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:15.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.537+0000 7fbcd37fe700 1 -- 172.21.15.84:0/503694495 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd40ce750 con 0x7fbcc4004d90 2023-07-14T11:15:15.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.537+0000 7fbcd37fe700 1 -- 172.21.15.84:0/503694495 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd40cea30 con 0x7fbcc4003f80 2023-07-14T11:15:15.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.537+0000 7fbcd37fe700 1 -- 172.21.15.84:0/503694495 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc400ba10 con 0x7fbcd4069f30 2023-07-14T11:15:15.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.537+0000 7fbcd8d9b700 1 --2- 172.21.15.84:0/503694495 >> v2:172.21.15.179:3300/0 conn(0x7fbcd415c710 0x7fbcd40cf510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:15:15.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.538+0000 7fbcd959c700 1 --2- 172.21.15.84:0/503694495 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbcc4004d90 0x7fbcc4005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:15.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.538+0000 7fbcd3fff700 1 --2- 172.21.15.84:0/503694495 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbcc4003f80 0x7fbcc4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:15.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.538+0000 7fbcd8d9b700 1 --2- 172.21.15.84:0/503694495 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcd4069f30 0x7fbcc4003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:15.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.538+0000 7fbcd959c700 1 -- 172.21.15.84:0/503694495 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcd4069f30 msgr2=0x7fbcc4003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:15.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.538+0000 7fbcd959c700 1 --2- 172.21.15.84:0/503694495 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcd4069f30 0x7fbcc4003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:15.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.538+0000 7fbcd959c700 1 -- 172.21.15.84:0/503694495 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbcc4003f80 msgr2=0x7fbcc4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:15.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.538+0000 7fbcd959c700 1 --2- 172.21.15.84:0/503694495 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbcc4003f80 0x7fbcc4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:15.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.538+0000 7fbcd959c700 1 -- 172.21.15.84:0/503694495 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcc40035b0 con 0x7fbcc4004d90 2023-07-14T11:15:15.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.538+0000 7fbcd959c700 1 --2- 172.21.15.84:0/503694495 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbcc4004d90 0x7fbcc4005200 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fbccc00a860 tx=0x7fbcc4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2668b745b00e3549 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:15.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.538+0000 7fbcd37fe700 1 -- 172.21.15.84:0/503694495 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbccc012600 con 0x7fbcc4004d90 2023-07-14T11:15:15.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.539+0000 7fbcd37fe700 1 -- 172.21.15.84:0/503694495 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbccc012780 con 0x7fbcc4004d90 2023-07-14T11:15:15.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.539+0000 7fbcd37fe700 1 -- 172.21.15.84:0/503694495 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbccc012b30 con 0x7fbcc4004d90 2023-07-14T11:15:15.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.539+0000 7fbcdafff700 1 -- 172.21.15.84:0/503694495 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbcc4004d90 msgr2=0x7fbcc4005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:15.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.539+0000 7fbcdafff700 1 --2- 172.21.15.84:0/503694495 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbcc4004d90 0x7fbcc4005200 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fbccc00a860 tx=0x7fbcc4005880 comp rx=0 tx=0).stop 2023-07-14T11:15:15.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.539+0000 7fbcd959c700 1 -- 172.21.15.84:0/503694495 reap_dead start 2023-07-14T11:15:15.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.539+0000 7fbcdafff700 1 -- 172.21.15.84:0/503694495 shutdown_connections 2023-07-14T11:15:15.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.539+0000 7fbcdafff700 1 -- 172.21.15.84:0/503694495 >> 172.21.15.84:0/503694495 conn(0x7fbcd40b16c0 msgr2=0x7fbcd40b1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:15.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.539+0000 7fbcdafff700 1 -- 172.21.15.84:0/503694495 shutdown_connections 2023-07-14T11:15:15.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.539+0000 7fbcdafff700 1 -- 172.21.15.84:0/503694495 wait complete. 2023-07-14T11:15:15.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.541+0000 7fbcdafff700 1 Processor -- start 2023-07-14T11:15:15.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.541+0000 7fbcdafff700 1 -- start start 2023-07-14T11:15:15.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.542+0000 7fbcdafff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcc4004d90 0x7fbcd41ef360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:15.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.542+0000 7fbcdafff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbcd41f2ac0 0x7fbcd415e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:15.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.542+0000 7fbcdafff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbcd40b4740 0x7fbcd40cfab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:15.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.542+0000 7fbcdafff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd41ef8a0 con 0x7fbcd41f2ac0 2023-07-14T11:15:15.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.542+0000 7fbcdafff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd40b3a10 con 0x7fbcd40b4740 2023-07-14T11:15:15.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.542+0000 7fbcdafff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd415eae0 con 0x7fbcc4004d90 2023-07-14T11:15:15.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.542+0000 7fbcd3fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbcd41f2ac0 0x7fbcd415e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:15.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.542+0000 7fbcd3fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbcd41f2ac0 0x7fbcd415e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38678/0 (socket says 172.21.15.84:38678) 2023-07-14T11:15:15.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.542+0000 7fbcd3fff700 1 -- 172.21.15.84:0/2967589741 learned_addr learned my addr 172.21.15.84:0/2967589741 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:15.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.543+0000 7fbcd959c700 1 --2- 172.21.15.84:0/2967589741 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbcd40b4740 0x7fbcd40cfab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:15.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.543+0000 7fbcd8d9b700 1 --2- 172.21.15.84:0/2967589741 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcc4004d90 0x7fbcd41ef360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:15.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.543+0000 7fbcd3fff700 1 -- 172.21.15.84:0/2967589741 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcc4004d90 msgr2=0x7fbcd41ef360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:15.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.543+0000 7fbcd3fff700 1 --2- 172.21.15.84:0/2967589741 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcc4004d90 0x7fbcd41ef360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:15.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.543+0000 7fbcd3fff700 1 -- 172.21.15.84:0/2967589741 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbcd40b4740 msgr2=0x7fbcd40cfab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:15.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.543+0000 7fbcd3fff700 1 --2- 172.21.15.84:0/2967589741 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbcd40b4740 0x7fbcd40cfab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:15.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.543+0000 7fbcd3fff700 1 -- 172.21.15.84:0/2967589741 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcd406ac20 con 0x7fbcd41f2ac0 2023-07-14T11:15:15.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.543+0000 7fbcd959c700 1 --2- 172.21.15.84:0/2967589741 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbcd40b4740 0x7fbcd40cfab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:15:15.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.543+0000 7fbcd3fff700 1 --2- 172.21.15.84:0/2967589741 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbcd41f2ac0 0x7fbcd415e220 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fbcc00119a0 tx=0x7fbcc0011d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:15.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.543+0000 7fbcd17fa700 1 -- 172.21.15.84:0/2967589741 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc000f940 con 0x7fbcd41f2ac0 2023-07-14T11:15:15.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.543+0000 7fbcd17fa700 1 -- 172.21.15.84:0/2967589741 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcc000faa0 con 0x7fbcd41f2ac0 2023-07-14T11:15:15.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.543+0000 7fbcdafff700 1 -- 172.21.15.84:0/2967589741 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcd40b3c60 con 0x7fbcd41f2ac0 2023-07-14T11:15:15.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.543+0000 7fbcd17fa700 1 -- 172.21.15.84:0/2967589741 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc000fe30 con 0x7fbcd41f2ac0 2023-07-14T11:15:15.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.543+0000 7fbcdafff700 1 -- 172.21.15.84:0/2967589741 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcd40b4220 con 0x7fbcd41f2ac0 2023-07-14T11:15:15.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.545+0000 7fbcdafff700 1 -- 172.21.15.84:0/2967589741 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcd404e280 con 0x7fbcd41f2ac0 2023-07-14T11:15:15.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.545+0000 7fbcd17fa700 1 -- 172.21.15.84:0/2967589741 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 7) v1 ==== 89190+0+0 (secure 0 0 0) 0x7fbcc0014440 con 0x7fbcd41f2ac0 2023-07-14T11:15:15.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.546+0000 7fbcd17fa700 1 --2- 172.21.15.84:0/2967589741 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fbcb806ae90 0x7fbcb806d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:15.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.547+0000 7fbcd17fa700 1 -- 172.21.15.84:0/2967589741 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbcc0089e10 con 0x7fbcd41f2ac0 2023-07-14T11:15:15.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.547+0000 7fbcd8d9b700 1 --2- 172.21.15.84:0/2967589741 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fbcb806ae90 0x7fbcb806d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:15.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.547+0000 7fbcd8d9b700 1 --2- 172.21.15.84:0/2967589741 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fbcb806ae90 0x7fbcb806d340 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fbcc8009cc0 tx=0x7fbcc8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:15.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.551+0000 7fbcd17fa700 1 -- 172.21.15.84:0/2967589741 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fbcc0054d80 con 0x7fbcd41f2ac0 2023-07-14T11:15:15.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.740+0000 7fbcdafff700 1 -- 172.21.15.84:0/2967589741 --> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbcd406aaa0 con 0x7fbcb806ae90 2023-07-14T11:15:15.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.749+0000 7fbcd17fa700 1 -- 172.21.15.84:0/2967589741 <== mgr.4104 v2:172.21.15.84:6832/379617029 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305465 (secure 0 0 0) 0x7fbcc8009e00 con 0x7fbcb806ae90 2023-07-14T11:15:15.755 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:15:15.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.753+0000 7fbcdafff700 1 -- 172.21.15.84:0/2967589741 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fbcb806ae90 msgr2=0x7fbcb806d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:15.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.753+0000 7fbcdafff700 1 --2- 172.21.15.84:0/2967589741 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fbcb806ae90 0x7fbcb806d340 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fbcc8009cc0 tx=0x7fbcc8008040 comp rx=0 tx=0).stop 2023-07-14T11:15:15.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.753+0000 7fbcdafff700 1 -- 172.21.15.84:0/2967589741 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbcd41f2ac0 msgr2=0x7fbcd415e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:15.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.753+0000 7fbcdafff700 1 --2- 172.21.15.84:0/2967589741 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbcd41f2ac0 0x7fbcd415e220 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fbcc00119a0 tx=0x7fbcc0011d60 comp rx=0 tx=0).stop 2023-07-14T11:15:15.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.753+0000 7fbcdafff700 1 -- 172.21.15.84:0/2967589741 shutdown_connections 2023-07-14T11:15:15.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.753+0000 7fbcdafff700 1 --2- 172.21.15.84:0/2967589741 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fbcb806ae90 0x7fbcb806d340 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:15.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.753+0000 7fbcdafff700 1 --2- 172.21.15.84:0/2967589741 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcc4004d90 0x7fbcd41ef360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:15.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.753+0000 7fbcdafff700 1 --2- 172.21.15.84:0/2967589741 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbcd40b4740 0x7fbcd40cfab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:15.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.753+0000 7fbcdafff700 1 --2- 172.21.15.84:0/2967589741 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbcd41f2ac0 0x7fbcd415e220 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:15.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.753+0000 7fbcdafff700 1 -- 172.21.15.84:0/2967589741 >> 172.21.15.84:0/2967589741 conn(0x7fbcd40b16c0 msgr2=0x7fbcd40ac860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:15.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.753+0000 7fbcdafff700 1 -- 172.21.15.84:0/2967589741 shutdown_connections 2023-07-14T11:15:15.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:15.753+0000 7fbcdafff700 1 -- 172.21.15.84:0/2967589741 wait complete. 2023-07-14T11:15:15.759 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-07-14T11:15:15.774 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":110,"stamp":"2023-07-14T11:15:14.095595+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":20,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221144,"kb_used_data":5528,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754753576,"statfs":{"total":773094113280,"available":772867661824,"internally_reserved":0,"allocated":5660672,"data_stored":3085928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.198860"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.910645+0000","last_change":"2023-07-14T11:15:09.910645+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.910645+0000","last_undegraded":"2023-07-14T11:15:09.910645+0000","last_fullsized":"2023-07-14T11:15:09.910645+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.915664+0000","last_change":"2023-07-14T11:15:09.915664+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.915664+0000","last_undegraded":"2023-07-14T11:15:09.915664+0000","last_fullsized":"2023-07-14T11:15:09.915664+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.915183+0000","last_change":"2023-07-14T11:15:09.915183+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.915183+0000","last_undegraded":"2023-07-14T11:15:09.915183+0000","last_fullsized":"2023-07-14T11:15:09.915183+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.915566+0000","last_change":"2023-07-14T11:15:09.915566+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.915566+0000","last_undegraded":"2023-07-14T11:15:09.915566+0000","last_fullsized":"2023-07-14T11:15:09.915566+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.921956+0000","last_change":"2023-07-14T11:15:09.921956+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.921956+0000","last_undegraded":"2023-07-14T11:15:09.921956+0000","last_fullsized":"2023-07-14T11:15:09.921956+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.910668+0000","last_change":"2023-07-14T11:15:09.910668+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.910668+0000","last_undegraded":"2023-07-14T11:15:09.910668+0000","last_fullsized":"2023-07-14T11:15:09.910668+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.916057+0000","last_change":"2023-07-14T11:15:09.916057+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.916057+0000","last_undegraded":"2023-07-14T11:15:09.916057+0000","last_fullsized":"2023-07-14T11:15:09.916057+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.915754+0000","last_change":"2023-07-14T11:15:09.915754+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.915754+0000","last_undegraded":"2023-07-14T11:15:09.915754+0000","last_fullsized":"2023-07-14T11:15:09.915754+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.913157+0000","last_change":"2023-07-14T11:15:09.913157+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.913157+0000","last_undegraded":"2023-07-14T11:15:09.913157+0000","last_fullsized":"2023-07-14T11:15:09.913157+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.911099+0000","last_change":"2023-07-14T11:15:09.911099+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.911099+0000","last_undegraded":"2023-07-14T11:15:09.911099+0000","last_fullsized":"2023-07-14T11:15:09.911099+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.919371+0000","last_change":"2023-07-14T11:15:09.919371+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.919371+0000","last_undegraded":"2023-07-14T11:15:09.919371+0000","last_fullsized":"2023-07-14T11:15:09.919371+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.915104+0000","last_change":"2023-07-14T11:15:09.915104+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.915104+0000","last_undegraded":"2023-07-14T11:15:09.915104+0000","last_fullsized":"2023-07-14T11:15:09.915104+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.910557+0000","last_change":"2023-07-14T11:15:09.910557+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.910557+0000","last_undegraded":"2023-07-14T11:15:09.910557+0000","last_fullsized":"2023-07-14T11:15:09.910557+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.914625+0000","last_change":"2023-07-14T11:15:09.914625+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.914625+0000","last_undegraded":"2023-07-14T11:15:09.914625+0000","last_fullsized":"2023-07-14T11:15:09.914625+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.916144+0000","last_change":"2023-07-14T11:15:09.916144+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.916144+0000","last_undegraded":"2023-07-14T11:15:09.916144+0000","last_fullsized":"2023-07-14T11:15:09.916144+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.910796+0000","last_change":"2023-07-14T11:15:09.910796+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.910796+0000","last_undegraded":"2023-07-14T11:15:09.910796+0000","last_fullsized":"2023-07-14T11:15:09.910796+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.918399+0000","last_change":"2023-07-14T11:15:09.918399+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.918399+0000","last_undegraded":"2023-07-14T11:15:09.918399+0000","last_fullsized":"2023-07-14T11:15:09.918399+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.915081+0000","last_change":"2023-07-14T11:15:09.915081+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.915081+0000","last_undegraded":"2023-07-14T11:15:09.915081+0000","last_fullsized":"2023-07-14T11:15:09.915081+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.914730+0000","last_change":"2023-07-14T11:15:09.914730+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.914730+0000","last_undegraded":"2023-07-14T11:15:09.914730+0000","last_fullsized":"2023-07-14T11:15:09.914730+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.916881+0000","last_change":"2023-07-14T11:15:09.916881+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.916881+0000","last_undegraded":"2023-07-14T11:15:09.916881+0000","last_fullsized":"2023-07-14T11:15:09.916881+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.914806+0000","last_change":"2023-07-14T11:15:09.914806+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.914806+0000","last_undegraded":"2023-07-14T11:15:09.914806+0000","last_fullsized":"2023-07-14T11:15:09.914806+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.912717+0000","last_change":"2023-07-14T11:15:09.912717+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.912717+0000","last_undegraded":"2023-07-14T11:15:09.912717+0000","last_fullsized":"2023-07-14T11:15:09.912717+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.918700+0000","last_change":"2023-07-14T11:15:09.918700+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.918700+0000","last_undegraded":"2023-07-14T11:15:09.918700+0000","last_fullsized":"2023-07-14T11:15:09.918700+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.917374+0000","last_change":"2023-07-14T11:15:09.917374+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.917374+0000","last_undegraded":"2023-07-14T11:15:09.917374+0000","last_fullsized":"2023-07-14T11:15:09.917374+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.917958+0000","last_change":"2023-07-14T11:15:09.917958+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.917958+0000","last_undegraded":"2023-07-14T11:15:09.917958+0000","last_fullsized":"2023-07-14T11:15:09.917958+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.912601+0000","last_change":"2023-07-14T11:15:09.912601+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.912601+0000","last_undegraded":"2023-07-14T11:15:09.912601+0000","last_fullsized":"2023-07-14T11:15:09.912601+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.909687+0000","last_change":"2023-07-14T11:15:09.909687+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.909687+0000","last_undegraded":"2023-07-14T11:15:09.909687+0000","last_fullsized":"2023-07-14T11:15:09.909687+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.914882+0000","last_change":"2023-07-14T11:15:09.914882+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.914882+0000","last_undegraded":"2023-07-14T11:15:09.914882+0000","last_fullsized":"2023-07-14T11:15:09.914882+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.916327+0000","last_change":"2023-07-14T11:15:09.916327+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.916327+0000","last_undegraded":"2023-07-14T11:15:09.916327+0000","last_fullsized":"2023-07-14T11:15:09.916327+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.915165+0000","last_change":"2023-07-14T11:15:09.915165+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.915165+0000","last_undegraded":"2023-07-14T11:15:09.915165+0000","last_fullsized":"2023-07-14T11:15:09.915165+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.915478+0000","last_change":"2023-07-14T11:15:09.915478+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.915478+0000","last_undegraded":"2023-07-14T11:15:09.915478+0000","last_fullsized":"2023-07-14T11:15:09.915478+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.908745+0000","last_change":"2023-07-14T11:15:09.908745+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.908745+0000","last_undegraded":"2023-07-14T11:15:09.908745+0000","last_fullsized":"2023-07-14T11:15:09.908745+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.916309+0000","last_change":"2023-07-14T11:15:09.916309+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.916309+0000","last_undegraded":"2023-07-14T11:15:09.916309+0000","last_fullsized":"2023-07-14T11:15:09.916309+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.932559+0000","last_change":"2023-07-14T11:15:09.929802+0000","last_active":"2023-07-14T11:15:09.932559+0000","last_peered":"2023-07-14T11:15:09.932559+0000","last_clean":"2023-07-14T11:15:09.932559+0000","last_became_active":"2023-07-14T11:15:09.929501+0000","last_became_peered":"2023-07-14T11:15:09.929501+0000","last_unstale":"2023-07-14T11:15:09.932559+0000","last_undegraded":"2023-07-14T11:15:09.932559+0000","last_fullsized":"2023-07-14T11:15:09.932559+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:21:21.205503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.908101+0000","last_change":"2023-07-14T11:15:09.908101+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.908101+0000","last_undegraded":"2023-07-14T11:15:09.908101+0000","last_fullsized":"2023-07-14T11:15:09.908101+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.926883+0000","last_change":"2023-07-14T11:15:09.921655+0000","last_active":"2023-07-14T11:15:09.926883+0000","last_peered":"2023-07-14T11:15:09.926883+0000","last_clean":"2023-07-14T11:15:09.926883+0000","last_became_active":"2023-07-14T11:15:09.921392+0000","last_became_peered":"2023-07-14T11:15:09.921392+0000","last_unstale":"2023-07-14T11:15:09.926883+0000","last_undegraded":"2023-07-14T11:15:09.926883+0000","last_fullsized":"2023-07-14T11:15:09.926883+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:45:33.602453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.914879+0000","last_change":"2023-07-14T11:15:09.914879+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.914879+0000","last_undegraded":"2023-07-14T11:15:09.914879+0000","last_fullsized":"2023-07-14T11:15:09.914879+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.931476+0000","last_change":"2023-07-14T11:15:09.924119+0000","last_active":"2023-07-14T11:15:09.931476+0000","last_peered":"2023-07-14T11:15:09.931476+0000","last_clean":"2023-07-14T11:15:09.931476+0000","last_became_active":"2023-07-14T11:15:09.923816+0000","last_became_peered":"2023-07-14T11:15:09.923816+0000","last_unstale":"2023-07-14T11:15:09.931476+0000","last_undegraded":"2023-07-14T11:15:09.931476+0000","last_fullsized":"2023-07-14T11:15:09.931476+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:55:43.489544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.914078+0000","last_change":"2023-07-14T11:15:09.914078+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.914078+0000","last_undegraded":"2023-07-14T11:15:09.914078+0000","last_fullsized":"2023-07-14T11:15:09.914078+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.925337+0000","last_change":"2023-07-14T11:15:09.922230+0000","last_active":"2023-07-14T11:15:09.925337+0000","last_peered":"2023-07-14T11:15:09.925337+0000","last_clean":"2023-07-14T11:15:09.925337+0000","last_became_active":"2023-07-14T11:15:09.921945+0000","last_became_peered":"2023-07-14T11:15:09.921945+0000","last_unstale":"2023-07-14T11:15:09.925337+0000","last_undegraded":"2023-07-14T11:15:09.925337+0000","last_fullsized":"2023-07-14T11:15:09.925337+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:07:38.622507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.920153+0000","last_change":"2023-07-14T11:15:09.920153+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.920153+0000","last_undegraded":"2023-07-14T11:15:09.920153+0000","last_fullsized":"2023-07-14T11:15:09.920153+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.934757+0000","last_change":"2023-07-14T11:15:09.930314+0000","last_active":"2023-07-14T11:15:09.934757+0000","last_peered":"2023-07-14T11:15:09.934757+0000","last_clean":"2023-07-14T11:15:09.934757+0000","last_became_active":"2023-07-14T11:15:09.930070+0000","last_became_peered":"2023-07-14T11:15:09.930070+0000","last_unstale":"2023-07-14T11:15:09.934757+0000","last_undegraded":"2023-07-14T11:15:09.934757+0000","last_fullsized":"2023-07-14T11:15:09.934757+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:52:42.599546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.916231+0000","last_change":"2023-07-14T11:15:09.916231+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.916231+0000","last_undegraded":"2023-07-14T11:15:09.916231+0000","last_fullsized":"2023-07-14T11:15:09.916231+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.928108+0000","last_change":"2023-07-14T11:15:09.926046+0000","last_active":"2023-07-14T11:15:09.928108+0000","last_peered":"2023-07-14T11:15:09.928108+0000","last_clean":"2023-07-14T11:15:09.928108+0000","last_became_active":"2023-07-14T11:15:09.925750+0000","last_became_peered":"2023-07-14T11:15:09.925750+0000","last_unstale":"2023-07-14T11:15:09.928108+0000","last_undegraded":"2023-07-14T11:15:09.928108+0000","last_fullsized":"2023-07-14T11:15:09.928108+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:55:34.403692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.913106+0000","last_change":"2023-07-14T11:15:09.913106+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.913106+0000","last_undegraded":"2023-07-14T11:15:09.913106+0000","last_fullsized":"2023-07-14T11:15:09.913106+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.928358+0000","last_change":"2023-07-14T11:15:09.926115+0000","last_active":"2023-07-14T11:15:09.928358+0000","last_peered":"2023-07-14T11:15:09.928358+0000","last_clean":"2023-07-14T11:15:09.928358+0000","last_became_active":"2023-07-14T11:15:09.925816+0000","last_became_peered":"2023-07-14T11:15:09.925816+0000","last_unstale":"2023-07-14T11:15:09.928358+0000","last_undegraded":"2023-07-14T11:15:09.928358+0000","last_fullsized":"2023-07-14T11:15:09.928358+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:31:20.921900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.917012+0000","last_change":"2023-07-14T11:15:09.917012+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.917012+0000","last_undegraded":"2023-07-14T11:15:09.917012+0000","last_fullsized":"2023-07-14T11:15:09.917012+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.928641+0000","last_change":"2023-07-14T11:15:09.925165+0000","last_active":"2023-07-14T11:15:09.928641+0000","last_peered":"2023-07-14T11:15:09.928641+0000","last_clean":"2023-07-14T11:15:09.928641+0000","last_became_active":"2023-07-14T11:15:09.924894+0000","last_became_peered":"2023-07-14T11:15:09.924894+0000","last_unstale":"2023-07-14T11:15:09.928641+0000","last_undegraded":"2023-07-14T11:15:09.928641+0000","last_fullsized":"2023-07-14T11:15:09.928641+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:53:03.155971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.919967+0000","last_change":"2023-07-14T11:15:09.919967+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.919967+0000","last_undegraded":"2023-07-14T11:15:09.919967+0000","last_fullsized":"2023-07-14T11:15:09.919967+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.930551+0000","last_change":"2023-07-14T11:15:09.926330+0000","last_active":"2023-07-14T11:15:09.930551+0000","last_peered":"2023-07-14T11:15:09.930551+0000","last_clean":"2023-07-14T11:15:09.930551+0000","last_became_active":"2023-07-14T11:15:09.926039+0000","last_became_peered":"2023-07-14T11:15:09.926039+0000","last_unstale":"2023-07-14T11:15:09.930551+0000","last_undegraded":"2023-07-14T11:15:09.930551+0000","last_fullsized":"2023-07-14T11:15:09.930551+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:38:33.409052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.908870+0000","last_change":"2023-07-14T11:15:09.908870+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.908870+0000","last_undegraded":"2023-07-14T11:15:09.908870+0000","last_fullsized":"2023-07-14T11:15:09.908870+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.930668+0000","last_change":"2023-07-14T11:15:09.928164+0000","last_active":"2023-07-14T11:15:09.930668+0000","last_peered":"2023-07-14T11:15:09.930668+0000","last_clean":"2023-07-14T11:15:09.930668+0000","last_became_active":"2023-07-14T11:15:09.927872+0000","last_became_peered":"2023-07-14T11:15:09.927872+0000","last_unstale":"2023-07-14T11:15:09.930668+0000","last_undegraded":"2023-07-14T11:15:09.930668+0000","last_fullsized":"2023-07-14T11:15:09.930668+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:08:46.232657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.914112+0000","last_change":"2023-07-14T11:15:09.914112+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.914112+0000","last_undegraded":"2023-07-14T11:15:09.914112+0000","last_fullsized":"2023-07-14T11:15:09.914112+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.932800+0000","last_change":"2023-07-14T11:15:09.928283+0000","last_active":"2023-07-14T11:15:09.932800+0000","last_peered":"2023-07-14T11:15:09.932800+0000","last_clean":"2023-07-14T11:15:09.932800+0000","last_became_active":"2023-07-14T11:15:09.927756+0000","last_became_peered":"2023-07-14T11:15:09.927756+0000","last_unstale":"2023-07-14T11:15:09.932800+0000","last_undegraded":"2023-07-14T11:15:09.932800+0000","last_fullsized":"2023-07-14T11:15:09.932800+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:24:57.406024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.920883+0000","last_change":"2023-07-14T11:15:09.920883+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.920883+0000","last_undegraded":"2023-07-14T11:15:09.920883+0000","last_fullsized":"2023-07-14T11:15:09.920883+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.934020+0000","last_change":"2023-07-14T11:15:09.928525+0000","last_active":"2023-07-14T11:15:09.934020+0000","last_peered":"2023-07-14T11:15:09.934020+0000","last_clean":"2023-07-14T11:15:09.934020+0000","last_became_active":"2023-07-14T11:15:09.928270+0000","last_became_peered":"2023-07-14T11:15:09.928270+0000","last_unstale":"2023-07-14T11:15:09.934020+0000","last_undegraded":"2023-07-14T11:15:09.934020+0000","last_fullsized":"2023-07-14T11:15:09.934020+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:55:34.403692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.908540+0000","last_change":"2023-07-14T11:15:09.908540+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.908540+0000","last_undegraded":"2023-07-14T11:15:09.908540+0000","last_fullsized":"2023-07-14T11:15:09.908540+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.933788+0000","last_change":"2023-07-14T11:15:09.926581+0000","last_active":"2023-07-14T11:15:09.933788+0000","last_peered":"2023-07-14T11:15:09.933788+0000","last_clean":"2023-07-14T11:15:09.933788+0000","last_became_active":"2023-07-14T11:15:09.926305+0000","last_became_peered":"2023-07-14T11:15:09.926305+0000","last_unstale":"2023-07-14T11:15:09.933788+0000","last_undegraded":"2023-07-14T11:15:09.933788+0000","last_fullsized":"2023-07-14T11:15:09.933788+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:21:54.253623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.914257+0000","last_change":"2023-07-14T11:15:09.914257+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.914257+0000","last_undegraded":"2023-07-14T11:15:09.914257+0000","last_fullsized":"2023-07-14T11:15:09.914257+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.928329+0000","last_change":"2023-07-14T11:15:09.925179+0000","last_active":"2023-07-14T11:15:09.928329+0000","last_peered":"2023-07-14T11:15:09.928329+0000","last_clean":"2023-07-14T11:15:09.928329+0000","last_became_active":"2023-07-14T11:15:09.924920+0000","last_became_peered":"2023-07-14T11:15:09.924920+0000","last_unstale":"2023-07-14T11:15:09.928329+0000","last_undegraded":"2023-07-14T11:15:09.928329+0000","last_fullsized":"2023-07-14T11:15:09.928329+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:14:48.334190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.913541+0000","last_change":"2023-07-14T11:15:09.913541+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.913541+0000","last_undegraded":"2023-07-14T11:15:09.913541+0000","last_fullsized":"2023-07-14T11:15:09.913541+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.930634+0000","last_change":"2023-07-14T11:15:09.927381+0000","last_active":"2023-07-14T11:15:09.930634+0000","last_peered":"2023-07-14T11:15:09.930634+0000","last_clean":"2023-07-14T11:15:09.930634+0000","last_became_active":"2023-07-14T11:15:09.927064+0000","last_became_peered":"2023-07-14T11:15:09.927064+0000","last_unstale":"2023-07-14T11:15:09.930634+0000","last_undegraded":"2023-07-14T11:15:09.930634+0000","last_fullsized":"2023-07-14T11:15:09.930634+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:24:31.222134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.917499+0000","last_change":"2023-07-14T11:15:09.917499+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.917499+0000","last_undegraded":"2023-07-14T11:15:09.917499+0000","last_fullsized":"2023-07-14T11:15:09.917499+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.933907+0000","last_change":"2023-07-14T11:15:09.928241+0000","last_active":"2023-07-14T11:15:09.933907+0000","last_peered":"2023-07-14T11:15:09.933907+0000","last_clean":"2023-07-14T11:15:09.933907+0000","last_became_active":"2023-07-14T11:15:09.927889+0000","last_became_peered":"2023-07-14T11:15:09.927889+0000","last_unstale":"2023-07-14T11:15:09.933907+0000","last_undegraded":"2023-07-14T11:15:09.933907+0000","last_fullsized":"2023-07-14T11:15:09.933907+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:53:21.756049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.912215+0000","last_change":"2023-07-14T11:15:09.912215+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.912215+0000","last_undegraded":"2023-07-14T11:15:09.912215+0000","last_fullsized":"2023-07-14T11:15:09.912215+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.934576+0000","last_change":"2023-07-14T11:15:09.927305+0000","last_active":"2023-07-14T11:15:09.934576+0000","last_peered":"2023-07-14T11:15:09.934576+0000","last_clean":"2023-07-14T11:15:09.934576+0000","last_became_active":"2023-07-14T11:15:09.927040+0000","last_became_peered":"2023-07-14T11:15:09.927040+0000","last_unstale":"2023-07-14T11:15:09.934576+0000","last_undegraded":"2023-07-14T11:15:09.934576+0000","last_fullsized":"2023-07-14T11:15:09.934576+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:09:11.625537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.909605+0000","last_change":"2023-07-14T11:15:09.909605+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.909605+0000","last_undegraded":"2023-07-14T11:15:09.909605+0000","last_fullsized":"2023-07-14T11:15:09.909605+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.931793+0000","last_change":"2023-07-14T11:15:09.929235+0000","last_active":"2023-07-14T11:15:09.931793+0000","last_peered":"2023-07-14T11:15:09.931793+0000","last_clean":"2023-07-14T11:15:09.931793+0000","last_became_active":"2023-07-14T11:15:09.928960+0000","last_became_peered":"2023-07-14T11:15:09.928960+0000","last_unstale":"2023-07-14T11:15:09.931793+0000","last_undegraded":"2023-07-14T11:15:09.931793+0000","last_fullsized":"2023-07-14T11:15:09.931793+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:30:17.080496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.920373+0000","last_change":"2023-07-14T11:15:09.920373+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.920373+0000","last_undegraded":"2023-07-14T11:15:09.920373+0000","last_fullsized":"2023-07-14T11:15:09.920373+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.926812+0000","last_change":"2023-07-14T11:15:09.924426+0000","last_active":"2023-07-14T11:15:09.926812+0000","last_peered":"2023-07-14T11:15:09.926812+0000","last_clean":"2023-07-14T11:15:09.926812+0000","last_became_active":"2023-07-14T11:15:09.924111+0000","last_became_peered":"2023-07-14T11:15:09.924111+0000","last_unstale":"2023-07-14T11:15:09.926812+0000","last_undegraded":"2023-07-14T11:15:09.926812+0000","last_fullsized":"2023-07-14T11:15:09.926812+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:23:37.690839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.909620+0000","last_change":"2023-07-14T11:15:09.909620+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.909620+0000","last_undegraded":"2023-07-14T11:15:09.909620+0000","last_fullsized":"2023-07-14T11:15:09.909620+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.930522+0000","last_change":"2023-07-14T11:15:09.926848+0000","last_active":"2023-07-14T11:15:09.930522+0000","last_peered":"2023-07-14T11:15:09.930522+0000","last_clean":"2023-07-14T11:15:09.930522+0000","last_became_active":"2023-07-14T11:15:09.926521+0000","last_became_peered":"2023-07-14T11:15:09.926521+0000","last_unstale":"2023-07-14T11:15:09.930522+0000","last_undegraded":"2023-07-14T11:15:09.930522+0000","last_fullsized":"2023-07-14T11:15:09.930522+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:30:17.080496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.909007+0000","last_change":"2023-07-14T11:15:09.909007+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.909007+0000","last_undegraded":"2023-07-14T11:15:09.909007+0000","last_fullsized":"2023-07-14T11:15:09.909007+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.931398+0000","last_change":"2023-07-14T11:15:09.923168+0000","last_active":"2023-07-14T11:15:09.931398+0000","last_peered":"2023-07-14T11:15:09.931398+0000","last_clean":"2023-07-14T11:15:09.931398+0000","last_became_active":"2023-07-14T11:15:09.922855+0000","last_became_peered":"2023-07-14T11:15:09.922855+0000","last_unstale":"2023-07-14T11:15:09.931398+0000","last_undegraded":"2023-07-14T11:15:09.931398+0000","last_fullsized":"2023-07-14T11:15:09.931398+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:07:59.893541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.916667+0000","last_change":"2023-07-14T11:15:09.916667+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.916667+0000","last_undegraded":"2023-07-14T11:15:09.916667+0000","last_fullsized":"2023-07-14T11:15:09.916667+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.933858+0000","last_change":"2023-07-14T11:15:09.928441+0000","last_active":"2023-07-14T11:15:09.933858+0000","last_peered":"2023-07-14T11:15:09.933858+0000","last_clean":"2023-07-14T11:15:09.933858+0000","last_became_active":"2023-07-14T11:15:09.928121+0000","last_became_peered":"2023-07-14T11:15:09.928121+0000","last_unstale":"2023-07-14T11:15:09.933858+0000","last_undegraded":"2023-07-14T11:15:09.933858+0000","last_fullsized":"2023-07-14T11:15:09.933858+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:59:02.394297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.916174+0000","last_change":"2023-07-14T11:15:09.916174+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.916174+0000","last_undegraded":"2023-07-14T11:15:09.916174+0000","last_fullsized":"2023-07-14T11:15:09.916174+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.934733+0000","last_change":"2023-07-14T11:15:09.929803+0000","last_active":"2023-07-14T11:15:09.934733+0000","last_peered":"2023-07-14T11:15:09.934733+0000","last_clean":"2023-07-14T11:15:09.934733+0000","last_became_active":"2023-07-14T11:15:09.929513+0000","last_became_peered":"2023-07-14T11:15:09.929513+0000","last_unstale":"2023-07-14T11:15:09.934733+0000","last_undegraded":"2023-07-14T11:15:09.934733+0000","last_fullsized":"2023-07-14T11:15:09.934733+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:38:06.284908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.909716+0000","last_change":"2023-07-14T11:15:09.909716+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.909716+0000","last_undegraded":"2023-07-14T11:15:09.909716+0000","last_fullsized":"2023-07-14T11:15:09.909716+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.933346+0000","last_change":"2023-07-14T11:15:09.929305+0000","last_active":"2023-07-14T11:15:09.933346+0000","last_peered":"2023-07-14T11:15:09.933346+0000","last_clean":"2023-07-14T11:15:09.933346+0000","last_became_active":"2023-07-14T11:15:09.929031+0000","last_became_peered":"2023-07-14T11:15:09.929031+0000","last_unstale":"2023-07-14T11:15:09.933346+0000","last_undegraded":"2023-07-14T11:15:09.933346+0000","last_fullsized":"2023-07-14T11:15:09.933346+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:34:20.755562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.916646+0000","last_change":"2023-07-14T11:15:09.916646+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.916646+0000","last_undegraded":"2023-07-14T11:15:09.916646+0000","last_fullsized":"2023-07-14T11:15:09.916646+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.933255+0000","last_change":"2023-07-14T11:15:09.930870+0000","last_active":"2023-07-14T11:15:09.933255+0000","last_peered":"2023-07-14T11:15:09.933255+0000","last_clean":"2023-07-14T11:15:09.933255+0000","last_became_active":"2023-07-14T11:15:09.930528+0000","last_became_peered":"2023-07-14T11:15:09.930528+0000","last_unstale":"2023-07-14T11:15:09.933255+0000","last_undegraded":"2023-07-14T11:15:09.933255+0000","last_fullsized":"2023-07-14T11:15:09.933255+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:15:43.073580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":69,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.907887+0000","last_change":"2023-07-14T11:13:08.923786+0000","last_active":"2023-07-14T11:15:09.907887+0000","last_peered":"2023-07-14T11:15:09.907887+0000","last_clean":"2023-07-14T11:15:09.907887+0000","last_became_active":"2023-07-14T11:13:08.923384+0000","last_became_peered":"2023-07-14T11:13:08.923384+0000","last_unstale":"2023-07-14T11:15:09.907887+0000","last_undegraded":"2023-07-14T11:15:09.907887+0000","last_fullsized":"2023-07-14T11:15:09.907887+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:32:41.654117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.908104+0000","last_change":"2023-07-14T11:15:09.908104+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.908104+0000","last_undegraded":"2023-07-14T11:15:09.908104+0000","last_fullsized":"2023-07-14T11:15:09.908104+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.932476+0000","last_change":"2023-07-14T11:15:09.928459+0000","last_active":"2023-07-14T11:15:09.932476+0000","last_peered":"2023-07-14T11:15:09.932476+0000","last_clean":"2023-07-14T11:15:09.932476+0000","last_became_active":"2023-07-14T11:15:09.928095+0000","last_became_peered":"2023-07-14T11:15:09.928095+0000","last_unstale":"2023-07-14T11:15:09.932476+0000","last_undegraded":"2023-07-14T11:15:09.932476+0000","last_fullsized":"2023-07-14T11:15:09.932476+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:31:37.916606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":65,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.909970+0000","last_change":"2023-07-14T11:13:08.758749+0000","last_active":"2023-07-14T11:15:09.909970+0000","last_peered":"2023-07-14T11:15:09.909970+0000","last_clean":"2023-07-14T11:15:09.909970+0000","last_became_active":"2023-07-14T11:13:08.757956+0000","last_became_peered":"2023-07-14T11:13:08.757956+0000","last_unstale":"2023-07-14T11:15:09.909970+0000","last_undegraded":"2023-07-14T11:15:09.909970+0000","last_fullsized":"2023-07-14T11:15:09.909970+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:46:12.073550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.913584+0000","last_change":"2023-07-14T11:15:09.913584+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.913584+0000","last_undegraded":"2023-07-14T11:15:09.913584+0000","last_fullsized":"2023-07-14T11:15:09.913584+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.934820+0000","last_change":"2023-07-14T11:15:09.931330+0000","last_active":"2023-07-14T11:15:09.934820+0000","last_peered":"2023-07-14T11:15:09.934820+0000","last_clean":"2023-07-14T11:15:09.934820+0000","last_became_active":"2023-07-14T11:15:09.931069+0000","last_became_peered":"2023-07-14T11:15:09.931069+0000","last_unstale":"2023-07-14T11:15:09.934820+0000","last_undegraded":"2023-07-14T11:15:09.934820+0000","last_fullsized":"2023-07-14T11:15:09.934820+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:44:55.656851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":69,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.919015+0000","last_change":"2023-07-14T11:13:08.862331+0000","last_active":"2023-07-14T11:15:09.919015+0000","last_peered":"2023-07-14T11:15:09.919015+0000","last_clean":"2023-07-14T11:15:09.919015+0000","last_became_active":"2023-07-14T11:13:08.861817+0000","last_became_peered":"2023-07-14T11:13:08.861817+0000","last_unstale":"2023-07-14T11:15:09.919015+0000","last_undegraded":"2023-07-14T11:15:09.919015+0000","last_fullsized":"2023-07-14T11:15:09.919015+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:05:29.409421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.915385+0000","last_change":"2023-07-14T11:15:09.915385+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.915385+0000","last_undegraded":"2023-07-14T11:15:09.915385+0000","last_fullsized":"2023-07-14T11:15:09.915385+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.934632+0000","last_change":"2023-07-14T11:15:09.928418+0000","last_active":"2023-07-14T11:15:09.934632+0000","last_peered":"2023-07-14T11:15:09.934632+0000","last_clean":"2023-07-14T11:15:09.934632+0000","last_became_active":"2023-07-14T11:15:09.927987+0000","last_became_peered":"2023-07-14T11:15:09.927987+0000","last_unstale":"2023-07-14T11:15:09.934632+0000","last_undegraded":"2023-07-14T11:15:09.934632+0000","last_fullsized":"2023-07-14T11:15:09.934632+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:36:26.856627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":65,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.909935+0000","last_change":"2023-07-14T11:13:08.757882+0000","last_active":"2023-07-14T11:15:09.909935+0000","last_peered":"2023-07-14T11:15:09.909935+0000","last_clean":"2023-07-14T11:15:09.909935+0000","last_became_active":"2023-07-14T11:13:08.757541+0000","last_became_peered":"2023-07-14T11:13:08.757541+0000","last_unstale":"2023-07-14T11:15:09.909935+0000","last_undegraded":"2023-07-14T11:15:09.909935+0000","last_fullsized":"2023-07-14T11:15:09.909935+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:17:11.547757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":218,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.916622+0000","last_change":"2023-07-14T11:13:01.370649+0000","last_active":"2023-07-14T11:15:09.916622+0000","last_peered":"2023-07-14T11:15:09.916622+0000","last_clean":"2023-07-14T11:15:09.916622+0000","last_became_active":"2023-07-14T11:13:01.369478+0000","last_became_peered":"2023-07-14T11:13:01.369478+0000","last_unstale":"2023-07-14T11:15:09.916622+0000","last_undegraded":"2023-07-14T11:15:09.916622+0000","last_fullsized":"2023-07-14T11:15:09.916622+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:00.254800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:00.254800+0000","last_clean_scrub_stamp":"2023-07-14T11:13:00.254800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:22:18.281189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.909627+0000","last_change":"2023-07-14T11:15:09.909627+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.909627+0000","last_undegraded":"2023-07-14T11:15:09.909627+0000","last_fullsized":"2023-07-14T11:15:09.909627+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.930646+0000","last_change":"2023-07-14T11:15:09.927770+0000","last_active":"2023-07-14T11:15:09.930646+0000","last_peered":"2023-07-14T11:15:09.930646+0000","last_clean":"2023-07-14T11:15:09.930646+0000","last_became_active":"2023-07-14T11:15:09.927446+0000","last_became_peered":"2023-07-14T11:15:09.927446+0000","last_unstale":"2023-07-14T11:15:09.930646+0000","last_undegraded":"2023-07-14T11:15:09.930646+0000","last_fullsized":"2023-07-14T11:15:09.930646+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:45:30.193517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":62,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.916836+0000","last_change":"2023-07-14T11:13:08.760609+0000","last_active":"2023-07-14T11:15:09.916836+0000","last_peered":"2023-07-14T11:15:09.916836+0000","last_clean":"2023-07-14T11:15:09.916836+0000","last_became_active":"2023-07-14T11:13:08.760285+0000","last_became_peered":"2023-07-14T11:13:08.760285+0000","last_unstale":"2023-07-14T11:15:09.916836+0000","last_undegraded":"2023-07-14T11:15:09.916836+0000","last_fullsized":"2023-07-14T11:15:09.916836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:22:55.554731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.912618+0000","last_change":"2023-07-14T11:15:09.912618+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.912618+0000","last_undegraded":"2023-07-14T11:15:09.912618+0000","last_fullsized":"2023-07-14T11:15:09.912618+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.928567+0000","last_change":"2023-07-14T11:15:09.923995+0000","last_active":"2023-07-14T11:15:09.928567+0000","last_peered":"2023-07-14T11:15:09.928567+0000","last_clean":"2023-07-14T11:15:09.928567+0000","last_became_active":"2023-07-14T11:15:09.923504+0000","last_became_peered":"2023-07-14T11:15:09.923504+0000","last_unstale":"2023-07-14T11:15:09.928567+0000","last_undegraded":"2023-07-14T11:15:09.928567+0000","last_fullsized":"2023-07-14T11:15:09.928567+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:37:53.285310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":61,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.917313+0000","last_change":"2023-07-14T11:13:08.923899+0000","last_active":"2023-07-14T11:15:09.917313+0000","last_peered":"2023-07-14T11:15:09.917313+0000","last_clean":"2023-07-14T11:15:09.917313+0000","last_became_active":"2023-07-14T11:13:08.923513+0000","last_became_peered":"2023-07-14T11:13:08.923513+0000","last_unstale":"2023-07-14T11:15:09.917313+0000","last_undegraded":"2023-07-14T11:15:09.917313+0000","last_fullsized":"2023-07-14T11:15:09.917313+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:15:01.205941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.917106+0000","last_change":"2023-07-14T11:15:09.917106+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.917106+0000","last_undegraded":"2023-07-14T11:15:09.917106+0000","last_fullsized":"2023-07-14T11:15:09.917106+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.934097+0000","last_change":"2023-07-14T11:15:09.928608+0000","last_active":"2023-07-14T11:15:09.934097+0000","last_peered":"2023-07-14T11:15:09.934097+0000","last_clean":"2023-07-14T11:15:09.934097+0000","last_became_active":"2023-07-14T11:15:09.927944+0000","last_became_peered":"2023-07-14T11:15:09.927944+0000","last_unstale":"2023-07-14T11:15:09.934097+0000","last_undegraded":"2023-07-14T11:15:09.934097+0000","last_fullsized":"2023-07-14T11:15:09.934097+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:14:29.526358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":69,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.908339+0000","last_change":"2023-07-14T11:13:08.761726+0000","last_active":"2023-07-14T11:15:09.908339+0000","last_peered":"2023-07-14T11:15:09.908339+0000","last_clean":"2023-07-14T11:15:09.908339+0000","last_became_active":"2023-07-14T11:13:08.761365+0000","last_became_peered":"2023-07-14T11:13:08.761365+0000","last_unstale":"2023-07-14T11:15:09.908339+0000","last_undegraded":"2023-07-14T11:15:09.908339+0000","last_fullsized":"2023-07-14T11:15:09.908339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:53:59.620129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-07-14T11:15:09.908106+0000","last_change":"2023-07-14T11:15:09.908106+0000","last_active":"2023-07-14T11:15:09.896778+0000","last_peered":"2023-07-14T11:15:09.896778+0000","last_clean":"2023-07-14T11:15:09.896778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:15:09.908106+0000","last_undegraded":"2023-07-14T11:15:09.908106+0000","last_fullsized":"2023-07-14T11:15:09.908106+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.933812+0000","last_change":"2023-07-14T11:15:09.928400+0000","last_active":"2023-07-14T11:15:09.933812+0000","last_peered":"2023-07-14T11:15:09.933812+0000","last_clean":"2023-07-14T11:15:09.933812+0000","last_became_active":"2023-07-14T11:15:09.928137+0000","last_became_peered":"2023-07-14T11:15:09.928137+0000","last_unstale":"2023-07-14T11:15:09.933812+0000","last_undegraded":"2023-07-14T11:15:09.933812+0000","last_fullsized":"2023-07-14T11:15:09.933812+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:53:30.122825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":65,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T11:15:09.919315+0000","last_change":"2023-07-14T11:13:08.762084+0000","last_active":"2023-07-14T11:15:09.919315+0000","last_peered":"2023-07-14T11:15:09.919315+0000","last_clean":"2023-07-14T11:15:09.919315+0000","last_became_active":"2023-07-14T11:13:08.761763+0000","last_became_peered":"2023-07-14T11:13:08.761763+0000","last_unstale":"2023-07-14T11:15:09.919315+0000","last_undegraded":"2023-07-14T11:15:09.919315+0000","last_fullsized":"2023-07-14T11:15:09.919315+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:05:29.409421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574878,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28084,"kb_used_data":1132,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343756,"statfs":{"total":96636764160,"available":96608006144,"internally_reserved":0,"allocated":1159168,"data_stored":831831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.93200000000000005,"15min":0.98399999999999999},"min":{"1min":0.47199999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.877,"5min":8.4339999999999993,"15min":8.4339999999999993},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.97099999999999997,"15min":1.0209999999999999},"min":{"1min":0.52300000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.91600000000000004,"5min":8.4559999999999995,"15min":8.4559999999999995},"last":0.66600000000000004}]},{"osd":1,"last update":"Fri Jul 14 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.90000000000000002,"15min":0.94699999999999995},"min":{"1min":0.40400000000000003,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.84499999999999997,"5min":6.3520000000000003,"15min":6.3520000000000003},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":1.079,"15min":1.149},"min":{"1min":0.46400000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.86099999999999999,"5min":6.8550000000000004,"15min":6.8550000000000004},"last":0.62}]},{"osd":2,"last update":"Fri Jul 14 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":1.1359999999999999,"15min":1.212},"min":{"1min":0.51100000000000001,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.95599999999999996,"5min":7.0289999999999999,"15min":7.0289999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.69399999999999995,"15min":0.68999999999999995},"min":{"1min":0.51600000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.98199999999999998,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.48199999999999998}]},{"osd":3,"last update":"Fri Jul 14 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":1.1930000000000001,"15min":1.2769999999999999},"min":{"1min":0.58299999999999996,"5min":0.505,"15min":0.505},"max":{"1min":0.85999999999999999,"5min":10.337,"15min":10.337},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.77200000000000002,"15min":0.77300000000000002},"min":{"1min":0.60199999999999998,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.93300000000000005,"5min":1.921,"15min":1.921},"last":0.72499999999999998}]},{"osd":4,"last update":"Fri Jul 14 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.60099999999999998,"15min":0.58299999999999996},"min":{"1min":0.41499999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.70699999999999996,"15min":0.69599999999999995},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.76100000000000001}]},{"osd":5,"last update":"Fri Jul 14 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.68000000000000005,"15min":0.67200000000000004},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.74399999999999999,"15min":0.73399999999999999},"min":{"1min":0.60399999999999998,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.83099999999999996}]},{"osd":6,"last update":"Fri Jul 14 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.68200000000000005,"15min":0.66800000000000004},"min":{"1min":0.498,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.69299999999999995,"15min":0.68100000000000005},"min":{"1min":0.55800000000000005,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.59599999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574879,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":540,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":552960,"data_stored":234835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.71199999999999997,"15min":0.70699999999999996},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.752,"5min":0.72199999999999998,"15min":0.71699999999999997},"min":{"1min":0.51300000000000001,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.57399999999999995}]},{"osd":1,"last update":"Fri Jul 14 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.68200000000000005,"15min":0.67900000000000005},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.751,"5min":0.71499999999999997,"15min":0.70899999999999996},"min":{"1min":0.42299999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.63}]},{"osd":2,"last update":"Fri Jul 14 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.67400000000000004,"15min":0.67000000000000004},"min":{"1min":0.45500000000000002,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.78300000000000003,"15min":0.78500000000000003},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.53200000000000003}]},{"osd":3,"last update":"Fri Jul 14 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.749,"15min":0.749},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.749,"15min":0.74399999999999999},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.63700000000000001}]},{"osd":4,"last update":"Fri Jul 14 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.71199999999999997,"15min":0.71399999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.712,"5min":1.712,"15min":1.712},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.73499999999999999,"15min":0.73099999999999998},"min":{"1min":0.438,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.68899999999999995}]},{"osd":5,"last update":"Fri Jul 14 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.73799999999999999,"15min":0.72599999999999998},"min":{"1min":0.52700000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":2.8820000000000001,"5min":2.8820000000000001,"15min":2.8820000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.78800000000000003,"15min":0.79300000000000004},"min":{"1min":0.46100000000000002,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.95099999999999996,"5min":1.129,"15min":1.129},"last":0.47799999999999998}]},{"osd":7,"last update":"Fri Jul 14 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.80500000000000005,"15min":0.80900000000000005},"min":{"1min":0.49199999999999999,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.79500000000000004,"15min":0.79900000000000004},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.55,"5min":1.55,"15min":1.55},"last":0.59899999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":540,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":552960,"data_stored":234835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.439,"15min":0.443},"min":{"1min":0.28299999999999997,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.59099999999999997,"5min":0.996,"15min":0.996},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.47399999999999998,"15min":0.48199999999999998},"min":{"1min":0.30199999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.81599999999999995,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.38800000000000001}]},{"osd":2,"last update":"Fri Jul 14 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.56499999999999995,"15min":0.57699999999999996},"min":{"1min":0.374,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.68600000000000005,"5min":2.476,"15min":2.476},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.61099999999999999,"15min":0.63600000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.70499999999999996,"5min":2.6299999999999999,"15min":2.6299999999999999},"last":0.52900000000000003}]},{"osd":3,"last update":"Fri Jul 14 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51700000000000002,"15min":0.51800000000000002},"min":{"1min":0.39300000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.65200000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.48899999999999999,"15min":0.496},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.65700000000000003,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.57999999999999996}]},{"osd":4,"last update":"Fri Jul 14 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.75,"15min":0.753},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0149999999999999,"5min":1.363,"15min":1.363},"last":0.748},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.054,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.84699999999999998}]},{"osd":5,"last update":"Fri Jul 14 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.77900000000000003,"15min":0.77500000000000002},"min":{"1min":0.53100000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.1739999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.81799999999999995,"15min":0.82599999999999996},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.095,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.70399999999999996}]},{"osd":6,"last update":"Fri Jul 14 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.79700000000000004,"15min":0.80500000000000005},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.141,"5min":1.298,"15min":1.298},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.78600000000000003,"15min":0.79000000000000004},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.123,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.80100000000000005}]},{"osd":7,"last update":"Fri Jul 14 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.82499999999999996,"15min":0.82899999999999996},"min":{"1min":0.61899999999999999,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.2010000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.78600000000000003,"15min":0.79100000000000004},"min":{"1min":0.55000000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.92700000000000005,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.69599999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28072,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343768,"statfs":{"total":96636764160,"available":96608018432,"internally_reserved":0,"allocated":1146880,"data_stored":825203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.42999999999999999,"15min":0.432},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.64000000000000001,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.434,"15min":0.438},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.44}]},{"osd":2,"last update":"Fri Jul 14 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.45700000000000002,"15min":0.45900000000000002},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.65000000000000002,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.498,"15min":0.502},"min":{"1min":0.376,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.64300000000000002,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.71499999999999997}]},{"osd":3,"last update":"Fri Jul 14 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.42099999999999999,"15min":0.41799999999999998},"min":{"1min":0.32000000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.499,"5min":0.51900000000000002,"15min":0.52300000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.94599999999999995}]},{"osd":4,"last update":"Fri Jul 14 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.75700000000000001,"15min":0.76400000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.90500000000000003,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.753},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.69899999999999995,"15min":0.69699999999999995},"min":{"1min":0.54400000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.70599999999999996}]},{"osd":5,"last update":"Fri Jul 14 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.71499999999999997,"15min":0.71899999999999997},"min":{"1min":0.502,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.83299999999999996,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.745,"5min":0.77400000000000002,"15min":0.77900000000000003},"min":{"1min":0.54400000000000004,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.93500000000000005,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.83499999999999996}]},{"osd":6,"last update":"Fri Jul 14 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.71399999999999997,"15min":0.71799999999999997},"min":{"1min":0.59699999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.83899999999999997,"5min":1.006,"15min":1.006},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.77100000000000002,"15min":0.77800000000000002},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.89200000000000002,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.92900000000000005}]},{"osd":7,"last update":"Fri Jul 14 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.80900000000000005,"15min":0.81999999999999995},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":0.91300000000000003,"5min":1.149,"15min":1.149},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.57599999999999996,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.94899999999999995,"5min":1.081,"15min":1.081},"last":0.77400000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":540,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":552960,"data_stored":234835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.44600000000000001,"15min":0.45300000000000001},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.58199999999999996,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.442,"15min":0.44600000000000001},"min":{"1min":0.33000000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.66300000000000003,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.47799999999999998}]},{"osd":1,"last update":"Fri Jul 14 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.48399999999999999,"15min":0.48799999999999999},"min":{"1min":0.371,"5min":0.31,"15min":0.31},"max":{"1min":0.63500000000000001,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48999999999999999,"15min":0.49099999999999999},"min":{"1min":0.36199999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.60099999999999998,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.54200000000000004}]},{"osd":3,"last update":"Fri Jul 14 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.49299999999999999,"15min":0.495},"min":{"1min":0.34200000000000003,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.63200000000000001,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.58099999999999996,"15min":0.58799999999999997},"min":{"1min":0.44900000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.67300000000000004,"5min":1.034,"15min":1.034},"last":0.56000000000000005}]},{"osd":4,"last update":"Fri Jul 14 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.76400000000000001,"15min":0.77300000000000002},"min":{"1min":0.55300000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.93300000000000005,"5min":1.212,"15min":1.212},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.78200000000000003,"15min":0.79000000000000004},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.96799999999999997,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.71799999999999997}]},{"osd":5,"last update":"Fri Jul 14 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.78700000000000003,"15min":0.79600000000000004},"min":{"1min":0.57399999999999995,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.117,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.751,"5min":0.81899999999999995,"15min":0.82999999999999996},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0229999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.79200000000000004}]},{"osd":6,"last update":"Fri Jul 14 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.78600000000000003,"15min":0.79200000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.077,"5min":1.103,"15min":1.103},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.746,"5min":0.81799999999999995,"15min":0.82999999999999996},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.006,"5min":1.258,"15min":1.258},"last":0.68400000000000005}]},{"osd":7,"last update":"Fri Jul 14 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.79900000000000004,"15min":0.80600000000000005},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1339999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.79800000000000004,"15min":0.81100000000000005},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":0.98899999999999999,"5min":1.202,"15min":1.202},"last":0.69299999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":565248,"data_stored":241463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.441,"15min":0.45200000000000001},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.63900000000000001,"5min":0.754,"15min":0.754},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.441,"15min":0.44700000000000001},"min":{"1min":0.33600000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.59699999999999998,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.40699999999999997}]},{"osd":1,"last update":"Fri Jul 14 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.44900000000000001,"15min":0.45200000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.58299999999999996,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.437,"5min":0.48799999999999999,"15min":0.496},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.54700000000000004,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.39300000000000002}]},{"osd":2,"last update":"Fri Jul 14 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.53400000000000003,"15min":0.54000000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.63900000000000001,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.58699999999999997,"15min":0.59799999999999998},"min":{"1min":0.44400000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.71599999999999997,"5min":1.585,"15min":1.585},"last":0.53200000000000003}]},{"osd":4,"last update":"Fri Jul 14 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.755,"15min":0.76100000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.93000000000000005,"5min":1.216,"15min":1.216},"last":0.754},{"interface":"front","average":{"1min":0.754,"5min":0.752,"15min":0.752},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.57599999999999996}]},{"osd":5,"last update":"Fri Jul 14 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.753,"15min":0.75900000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.90700000000000003,"5min":1.413,"15min":1.413},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.753,"5min":0.84499999999999997,"15min":0.86099999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1619999999999999,"5min":1.657,"15min":1.657},"last":0.77200000000000002}]},{"osd":6,"last update":"Fri Jul 14 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.77200000000000002,"15min":0.78100000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.999,"5min":1.726,"15min":1.726},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.79300000000000004,"15min":0.80200000000000005},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.88800000000000001,"5min":1.333,"15min":1.333},"last":0.78600000000000003}]},{"osd":7,"last update":"Fri Jul 14 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.82799999999999996,"15min":0.84099999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.135,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.83499999999999996,"15min":0.84299999999999997},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.232,"5min":1.268,"15min":1.268},"last":0.61399999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":565248,"data_stored":241463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.627,"15min":0.628},"min":{"1min":0.44,"5min":0.433,"15min":0.433},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69799999999999995,"15min":0.69899999999999995},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.53900000000000003}]},{"osd":1,"last update":"Fri Jul 14 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.66800000000000004,"15min":0.67200000000000004},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.92000000000000004,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.71099999999999997,"15min":0.71299999999999997},"min":{"1min":0.51400000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.99299999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.51400000000000001}]},{"osd":2,"last update":"Fri Jul 14 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.48499999999999999,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0209999999999999,"5min":1.48,"15min":1.48},"last":0.748},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.747,"15min":0.745},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.1080000000000001,"5min":1.23,"15min":1.23},"last":0.63800000000000001}]},{"osd":3,"last update":"Fri Jul 14 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.71699999999999997,"15min":0.72099999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.746,"15min":0.74099999999999999},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.1259999999999999,"5min":1.145,"15min":1.145},"last":0.78100000000000003}]},{"osd":5,"last update":"Fri Jul 14 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.76000000000000001,"15min":0.77400000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.88900000000000001,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.77200000000000002,"15min":0.78300000000000003},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.96999999999999997,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.47599999999999998}]},{"osd":6,"last update":"Fri Jul 14 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.1659999999999999,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.77800000000000002,"15min":0.78000000000000003},"min":{"1min":0.52300000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.1479999999999999,"5min":1.3,"15min":1.3},"last":0.57199999999999995}]},{"osd":7,"last update":"Fri Jul 14 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.77400000000000002,"15min":0.77800000000000002},"min":{"1min":0.54500000000000004,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.028,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.627},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.84699999999999998,"15min":0.85699999999999998},"min":{"1min":0.53700000000000003,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.21,"5min":1.379,"15min":1.379},"last":0.70199999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":565248,"data_stored":241463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.63700000000000001,"15min":0.64200000000000002},"min":{"1min":0.41299999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.996,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.627,"5min":0.63300000000000001,"15min":0.63400000000000001},"min":{"1min":0.47199999999999998,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.873,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.52500000000000002}]},{"osd":1,"last update":"Fri Jul 14 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.67700000000000005,"15min":0.68200000000000005},"min":{"1min":0.47699999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.88800000000000001,"5min":1.343,"15min":1.343},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.46300000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.46800000000000003}]},{"osd":2,"last update":"Fri Jul 14 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.73599999999999999,"15min":0.74099999999999999},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.012,"5min":1.034,"15min":1.034},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.76300000000000001,"15min":0.77300000000000002},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.88200000000000001,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.58999999999999997}]},{"osd":3,"last update":"Fri Jul 14 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.76300000000000001,"15min":0.77300000000000002},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.95499999999999996,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.628},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.76700000000000002,"15min":0.78700000000000003},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.89000000000000001,"5min":1.806,"15min":1.806},"last":0.64400000000000002}]},{"osd":4,"last update":"Fri Jul 14 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.65600000000000003,"15min":0.65900000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.0229999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.753,"15min":0.76600000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.66300000000000003}]},{"osd":6,"last update":"Fri Jul 14 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.747,"15min":0.75700000000000001},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.93600000000000005,"5min":1.03,"15min":1.03},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.745,"5min":0.80300000000000005,"15min":0.81299999999999994},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.048,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.746}]},{"osd":7,"last update":"Fri Jul 14 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.83899999999999997,"15min":0.86099999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.95299999999999996,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.86599999999999999,"15min":0.88200000000000001},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":0.96699999999999997,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.84399999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T11:15:15.781 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T11:15:16.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.008+0000 7f82fd3ff700 1 Processor -- start 2023-07-14T11:15:16.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.008+0000 7f82fd3ff700 1 -- start start 2023-07-14T11:15:16.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.010+0000 7f82fd3ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f82f8141ff0 0x7f82f8158fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:16.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.010+0000 7f82fd3ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82f806c110 con 0x7f82f8070710 2023-07-14T11:15:16.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.010+0000 7f82fd3ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82f8070e60 con 0x7f82f80b2180 2023-07-14T11:15:16.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.011+0000 7f82fd3ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82f8071140 con 0x7f82f8141ff0 2023-07-14T11:15:16.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.011+0000 7f82effff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f82f8070710 0x7f82f80b1a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55270/0 (socket says 172.21.15.84:55270) 2023-07-14T11:15:16.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.011+0000 7f82effff700 1 -- 172.21.15.84:0/469256267 learned_addr learned my addr 172.21.15.84:0/469256267 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:15:16.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.011+0000 7f82f6ffd700 1 --2- 172.21.15.84:0/469256267 >> v2:172.21.15.179:3300/0 conn(0x7f82f8141ff0 0x7f82f8158fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:16.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.011+0000 7f82f67fc700 1 -- 172.21.15.84:0/469256267 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 201634332 0 0) 0x7f82f806c110 con 0x7f82f8070710 2023-07-14T11:15:16.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.011+0000 7f82f67fc700 1 -- 172.21.15.84:0/469256267 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82e40034d0 con 0x7f82f8070710 2023-07-14T11:15:16.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.011+0000 7f82f67fc700 1 -- 172.21.15.84:0/469256267 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1008502974 0 0) 0x7f82f8070e60 con 0x7f82f80b2180 2023-07-14T11:15:16.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.011+0000 7f82f67fc700 1 -- 172.21.15.84:0/469256267 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82f806c110 con 0x7f82f80b2180 2023-07-14T11:15:16.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.011+0000 7f82f67fc700 1 -- 172.21.15.84:0/469256267 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2415110414 0 0) 0x7f82e40034d0 con 0x7f82f8070710 2023-07-14T11:15:16.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.011+0000 7f82f67fc700 1 -- 172.21.15.84:0/469256267 >> v2:172.21.15.179:3300/0 conn(0x7f82f8141ff0 msgr2=0x7f82f8158fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:16.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.011+0000 7f82f67fc700 1 --2- 172.21.15.84:0/469256267 >> v2:172.21.15.179:3300/0 conn(0x7f82f8141ff0 0x7f82f8158fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:16.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.011+0000 7f82f67fc700 1 -- 172.21.15.84:0/469256267 >> v1:172.21.15.179:6789/0 conn(0x7f82f80b2180 legacy=0x7f82f806c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:16.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.011+0000 7f82f67fc700 1 -- 172.21.15.84:0/469256267 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82f806bac0 con 0x7f82f8070710 2023-07-14T11:15:16.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.011+0000 7f82f67fc700 1 -- 172.21.15.84:0/469256267 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7f82e0001670 con 0x7f82f8070710 2023-07-14T11:15:16.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.012+0000 7f82f67fc700 1 -- 172.21.15.84:0/469256267 >> v1:172.21.15.84:6789/0 conn(0x7f82f8070710 legacy=0x7f82f80b1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:16.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.012+0000 7f82f67fc700 1 --2- 172.21.15.84:0/469256267 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82e4003cd0 0x7f82e40088e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:16.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.012+0000 7f82f67fc700 1 --2- 172.21.15.84:0/469256267 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82e40041f0 0x7f82e400aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:16.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.012+0000 7f82f67fc700 1 --2- 172.21.15.84:0/469256267 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82e400b520 0x7f82e400d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:16.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.012+0000 7f82f67fc700 1 -- 172.21.15.84:0/469256267 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f8071140 con 0x7f82e400b520 2023-07-14T11:15:16.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.012+0000 7f82f67fc700 1 -- 172.21.15.84:0/469256267 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e400e2b0 con 0x7f82e4003cd0 2023-07-14T11:15:16.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.012+0000 7f82f67fc700 1 -- 172.21.15.84:0/469256267 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82e400e470 con 0x7f82e40041f0 2023-07-14T11:15:16.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.012+0000 7f82f6ffd700 1 --2- 172.21.15.84:0/469256267 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82e4003cd0 0x7f82e40088e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:16.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.012+0000 7f82f77fe700 1 --2- 172.21.15.84:0/469256267 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82e400b520 0x7f82e400d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:16.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.012+0000 7f82effff700 1 --2- 172.21.15.84:0/469256267 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82e40041f0 0x7f82e400aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:16.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.012+0000 7f82f6ffd700 1 -- 172.21.15.84:0/469256267 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82e40041f0 msgr2=0x7f82e400aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:16.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.012+0000 7f82f6ffd700 1 --2- 172.21.15.84:0/469256267 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82e40041f0 0x7f82e400aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:16.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.012+0000 7f82f6ffd700 1 -- 172.21.15.84:0/469256267 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82e400b520 msgr2=0x7f82e400d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:16.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.012+0000 7f82f6ffd700 1 --2- 172.21.15.84:0/469256267 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82e400b520 0x7f82e400d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:16.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.012+0000 7f82f6ffd700 1 -- 172.21.15.84:0/469256267 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e40034d0 con 0x7f82e4003cd0 2023-07-14T11:15:16.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.012+0000 7f82f77fe700 1 -- 172.21.15.84:0/469256267 reap_dead start 2023-07-14T11:15:16.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.013+0000 7f82f6ffd700 1 --2- 172.21.15.84:0/469256267 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82e4003cd0 0x7f82e40088e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f82e8009b60 tx=0x7f82e4003780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72b16962f037dd82 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:16.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.013+0000 7f82f67fc700 1 -- 172.21.15.84:0/469256267 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e800e6c0 con 0x7f82e4003cd0 2023-07-14T11:15:16.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.013+0000 7f82f67fc700 1 -- 172.21.15.84:0/469256267 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82e800e820 con 0x7f82e4003cd0 2023-07-14T11:15:16.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.013+0000 7f82f67fc700 1 -- 172.21.15.84:0/469256267 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e800eb90 con 0x7f82e4003cd0 2023-07-14T11:15:16.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.013+0000 7f82fd3ff700 1 -- 172.21.15.84:0/469256267 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82e4003cd0 msgr2=0x7f82e40088e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:16.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.013+0000 7f82fd3ff700 1 --2- 172.21.15.84:0/469256267 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82e4003cd0 0x7f82e40088e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f82e8009b60 tx=0x7f82e4003780 comp rx=0 tx=0).stop 2023-07-14T11:15:16.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.014+0000 7f82fd3ff700 1 -- 172.21.15.84:0/469256267 shutdown_connections 2023-07-14T11:15:16.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.014+0000 7f82fd3ff700 1 --2- 172.21.15.84:0/469256267 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82e4003cd0 0x7f82e40088e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:16.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.014+0000 7f82fd3ff700 1 -- 172.21.15.84:0/469256267 >> 172.21.15.84:0/469256267 conn(0x7f82f8069f30 msgr2=0x7f82f806a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:16.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.014+0000 7f82fd3ff700 1 -- 172.21.15.84:0/469256267 shutdown_connections 2023-07-14T11:15:16.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.014+0000 7f82fd3ff700 1 -- 172.21.15.84:0/469256267 wait complete. 2023-07-14T11:15:16.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.015+0000 7f82fd3ff700 1 Processor -- start 2023-07-14T11:15:16.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.015+0000 7f82fd3ff700 1 -- start start 2023-07-14T11:15:16.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.016+0000 7f82fd3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82e4003cd0 0x7f82f80c4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:16.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.016+0000 7f82fd3ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82f80c6d40 0x7f82f8158410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:16.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.016+0000 7f82fd3ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82f80c5e30 0x7f82f815c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:16.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.016+0000 7f82fd3ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f80c59a0 con 0x7f82f80c6d40 2023-07-14T11:15:16.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.016+0000 7f82fd3ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f8158950 con 0x7f82f80c5e30 2023-07-14T11:15:16.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.017+0000 7f82fd3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82f80c4d90 con 0x7f82e4003cd0 2023-07-14T11:15:16.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.017+0000 7f82effff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82f80c6d40 0x7f82f8158410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:16.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.017+0000 7f82effff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82f80c6d40 0x7f82f8158410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38694/0 (socket says 172.21.15.84:38694) 2023-07-14T11:15:16.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.017+0000 7f82effff700 1 -- 172.21.15.84:0/2711241743 learned_addr learned my addr 172.21.15.84:0/2711241743 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:16.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.017+0000 7f82f77fe700 1 --2- 172.21.15.84:0/2711241743 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82f80c5e30 0x7f82f815c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:16.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.017+0000 7f82f6ffd700 1 --2- 172.21.15.84:0/2711241743 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82e4003cd0 0x7f82f80c4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:16.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.017+0000 7f82effff700 1 -- 172.21.15.84:0/2711241743 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82e4003cd0 msgr2=0x7f82f80c4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:16.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.017+0000 7f82effff700 1 --2- 172.21.15.84:0/2711241743 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82e4003cd0 0x7f82f80c4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:16.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.017+0000 7f82effff700 1 -- 172.21.15.84:0/2711241743 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82f80c5e30 msgr2=0x7f82f815c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:16.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.017+0000 7f82effff700 1 --2- 172.21.15.84:0/2711241743 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82f80c5e30 0x7f82f815c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:16.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.017+0000 7f82effff700 1 -- 172.21.15.84:0/2711241743 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82f80c5070 con 0x7f82f80c6d40 2023-07-14T11:15:16.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.017+0000 7f82effff700 1 --2- 172.21.15.84:0/2711241743 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82f80c6d40 0x7f82f8158410 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f82e0004fd0 tx=0x7f82e0007340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:16.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.018+0000 7f82ef7fe700 1 -- 172.21.15.84:0/2711241743 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e0012620 con 0x7f82f80c6d40 2023-07-14T11:15:16.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.018+0000 7f82ef7fe700 1 -- 172.21.15.84:0/2711241743 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82e00127a0 con 0x7f82f80c6d40 2023-07-14T11:15:16.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.018+0000 7f82ef7fe700 1 -- 172.21.15.84:0/2711241743 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e0012b50 con 0x7f82f80c6d40 2023-07-14T11:15:16.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.018+0000 7f82fd3ff700 1 -- 172.21.15.84:0/2711241743 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82f80c5350 con 0x7f82f80c6d40 2023-07-14T11:15:16.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.018+0000 7f82fd3ff700 1 -- 172.21.15.84:0/2711241743 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82f80c71b0 con 0x7f82f80c6d40 2023-07-14T11:15:16.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.019+0000 7f82fd3ff700 1 -- 172.21.15.84:0/2711241743 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82f80c5b50 con 0x7f82f80c6d40 2023-07-14T11:15:16.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.020+0000 7f82ef7fe700 1 -- 172.21.15.84:0/2711241743 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 7) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f82e0012cb0 con 0x7f82f80c6d40 2023-07-14T11:15:16.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.021+0000 7f82ef7fe700 1 --2- 172.21.15.84:0/2711241743 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f82d806ae90 0x7f82d806d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:16.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.021+0000 7f82ef7fe700 1 -- 172.21.15.84:0/2711241743 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f82e00896e0 con 0x7f82f80c6d40 2023-07-14T11:15:16.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.021+0000 7f82f6ffd700 1 --2- 172.21.15.84:0/2711241743 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f82d806ae90 0x7f82d806d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:16.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.021+0000 7f82f6ffd700 1 --2- 172.21.15.84:0/2711241743 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f82d806ae90 0x7f82d806d340 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f82e80090b0 tx=0x7f82e801e040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:16.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.025+0000 7f82ef7fe700 1 -- 172.21.15.84:0/2711241743 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f82f80c5b50 con 0x7f82f80c6d40 2023-07-14T11:15:16.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.220+0000 7f82fd3ff700 1 -- 172.21.15.84:0/2711241743 --> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f82f8070b80 con 0x7f82d806ae90 2023-07-14T11:15:16.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.229+0000 7f82ef7fe700 1 -- 172.21.15.84:0/2711241743 <== mgr.4104 v2:172.21.15.84:6832/379617029 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310727 (secure 0 0 0) 0x7f82e800eb10 con 0x7f82d806ae90 2023-07-14T11:15:16.235 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:15:16.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.233+0000 7f82fd3ff700 1 -- 172.21.15.84:0/2711241743 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f82d806ae90 msgr2=0x7f82d806d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:16.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.233+0000 7f82fd3ff700 1 --2- 172.21.15.84:0/2711241743 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f82d806ae90 0x7f82d806d340 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f82e80090b0 tx=0x7f82e801e040 comp rx=0 tx=0).stop 2023-07-14T11:15:16.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.233+0000 7f82fd3ff700 1 -- 172.21.15.84:0/2711241743 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82f80c6d40 msgr2=0x7f82f8158410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:16.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.233+0000 7f82fd3ff700 1 --2- 172.21.15.84:0/2711241743 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82f80c6d40 0x7f82f8158410 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f82e0004fd0 tx=0x7f82e0007340 comp rx=0 tx=0).stop 2023-07-14T11:15:16.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.233+0000 7f82fd3ff700 1 -- 172.21.15.84:0/2711241743 shutdown_connections 2023-07-14T11:15:16.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.233+0000 7f82fd3ff700 1 --2- 172.21.15.84:0/2711241743 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f82d806ae90 0x7f82d806d340 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:16.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.233+0000 7f82fd3ff700 1 --2- 172.21.15.84:0/2711241743 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82e4003cd0 0x7f82f80c4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:16.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.233+0000 7f82fd3ff700 1 --2- 172.21.15.84:0/2711241743 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82f80c5e30 0x7f82f815c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:16.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.233+0000 7f82fd3ff700 1 --2- 172.21.15.84:0/2711241743 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82f80c6d40 0x7f82f8158410 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:16.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.233+0000 7f82fd3ff700 1 -- 172.21.15.84:0/2711241743 >> 172.21.15.84:0/2711241743 conn(0x7f82f8069f30 msgr2=0x7f82f80cddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:16.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.233+0000 7f82fd3ff700 1 -- 172.21.15.84:0/2711241743 shutdown_connections 2023-07-14T11:15:16.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.233+0000 7f82fd3ff700 1 -- 172.21.15.84:0/2711241743 wait complete. 2023-07-14T11:15:16.239 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-07-14T11:15:16.254 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":111,"stamp":"2023-07-14T11:15:16.095912+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221448,"kb_used_data":5832,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754753272,"statfs":{"total":773094113280,"available":772867350528,"internally_reserved":0,"allocated":5971968,"data_stored":3227412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.189951"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.927707+0000","last_change":"2023-07-14T11:15:10.925504+0000","last_active":"2023-07-14T11:15:11.927707+0000","last_peered":"2023-07-14T11:15:11.927707+0000","last_clean":"2023-07-14T11:15:11.927707+0000","last_became_active":"2023-07-14T11:15:10.925160+0000","last_became_peered":"2023-07-14T11:15:10.925160+0000","last_unstale":"2023-07-14T11:15:11.927707+0000","last_undegraded":"2023-07-14T11:15:11.927707+0000","last_fullsized":"2023-07-14T11:15:11.927707+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:48:14.227600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.666667+0000","last_change":"2023-07-14T11:15:10.936371+0000","last_active":"2023-07-14T11:15:13.666667+0000","last_peered":"2023-07-14T11:15:13.666667+0000","last_clean":"2023-07-14T11:15:13.666667+0000","last_became_active":"2023-07-14T11:15:10.935272+0000","last_became_peered":"2023-07-14T11:15:10.935272+0000","last_unstale":"2023-07-14T11:15:13.666667+0000","last_undegraded":"2023-07-14T11:15:13.666667+0000","last_fullsized":"2023-07-14T11:15:13.666667+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:17:05.372857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.665165+0000","last_change":"2023-07-14T11:15:10.938106+0000","last_active":"2023-07-14T11:15:13.665165+0000","last_peered":"2023-07-14T11:15:13.665165+0000","last_clean":"2023-07-14T11:15:13.665165+0000","last_became_active":"2023-07-14T11:15:10.937834+0000","last_became_peered":"2023-07-14T11:15:10.937834+0000","last_unstale":"2023-07-14T11:15:13.665165+0000","last_undegraded":"2023-07-14T11:15:13.665165+0000","last_fullsized":"2023-07-14T11:15:13.665165+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:54:10.925414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.667304+0000","last_change":"2023-07-14T11:15:10.935147+0000","last_active":"2023-07-14T11:15:13.667304+0000","last_peered":"2023-07-14T11:15:13.667304+0000","last_clean":"2023-07-14T11:15:13.667304+0000","last_became_active":"2023-07-14T11:15:10.934803+0000","last_became_peered":"2023-07-14T11:15:10.934803+0000","last_unstale":"2023-07-14T11:15:13.667304+0000","last_undegraded":"2023-07-14T11:15:13.667304+0000","last_fullsized":"2023-07-14T11:15:13.667304+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:56:49.007278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.666188+0000","last_change":"2023-07-14T11:15:10.932878+0000","last_active":"2023-07-14T11:15:13.666188+0000","last_peered":"2023-07-14T11:15:13.666188+0000","last_clean":"2023-07-14T11:15:13.666188+0000","last_became_active":"2023-07-14T11:15:10.932518+0000","last_became_peered":"2023-07-14T11:15:10.932518+0000","last_unstale":"2023-07-14T11:15:13.666188+0000","last_undegraded":"2023-07-14T11:15:13.666188+0000","last_fullsized":"2023-07-14T11:15:13.666188+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:10:43.496513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.927643+0000","last_change":"2023-07-14T11:15:10.926174+0000","last_active":"2023-07-14T11:15:11.927643+0000","last_peered":"2023-07-14T11:15:11.927643+0000","last_clean":"2023-07-14T11:15:11.927643+0000","last_became_active":"2023-07-14T11:15:10.925547+0000","last_became_peered":"2023-07-14T11:15:10.925547+0000","last_unstale":"2023-07-14T11:15:11.927643+0000","last_undegraded":"2023-07-14T11:15:11.927643+0000","last_fullsized":"2023-07-14T11:15:11.927643+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:37:54.291474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.664823+0000","last_change":"2023-07-14T11:15:10.937611+0000","last_active":"2023-07-14T11:15:13.664823+0000","last_peered":"2023-07-14T11:15:13.664823+0000","last_clean":"2023-07-14T11:15:13.664823+0000","last_became_active":"2023-07-14T11:15:10.937160+0000","last_became_peered":"2023-07-14T11:15:10.937160+0000","last_unstale":"2023-07-14T11:15:13.664823+0000","last_undegraded":"2023-07-14T11:15:13.664823+0000","last_fullsized":"2023-07-14T11:15:13.664823+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:25:48.540396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.944129+0000","last_change":"2023-07-14T11:15:10.927643+0000","last_active":"2023-07-14T11:15:11.944129+0000","last_peered":"2023-07-14T11:15:11.944129+0000","last_clean":"2023-07-14T11:15:11.944129+0000","last_became_active":"2023-07-14T11:15:10.927241+0000","last_became_peered":"2023-07-14T11:15:10.927241+0000","last_unstale":"2023-07-14T11:15:11.944129+0000","last_undegraded":"2023-07-14T11:15:11.944129+0000","last_fullsized":"2023-07-14T11:15:11.944129+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:28:46.603191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.944553+0000","last_change":"2023-07-14T11:15:10.936870+0000","last_active":"2023-07-14T11:15:11.944553+0000","last_peered":"2023-07-14T11:15:11.944553+0000","last_clean":"2023-07-14T11:15:11.944553+0000","last_became_active":"2023-07-14T11:15:10.936566+0000","last_became_peered":"2023-07-14T11:15:10.936566+0000","last_unstale":"2023-07-14T11:15:11.944553+0000","last_undegraded":"2023-07-14T11:15:11.944553+0000","last_fullsized":"2023-07-14T11:15:11.944553+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:16:00.524727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.927138+0000","last_change":"2023-07-14T11:15:10.924846+0000","last_active":"2023-07-14T11:15:11.927138+0000","last_peered":"2023-07-14T11:15:11.927138+0000","last_clean":"2023-07-14T11:15:11.927138+0000","last_became_active":"2023-07-14T11:15:10.924029+0000","last_became_peered":"2023-07-14T11:15:10.924029+0000","last_unstale":"2023-07-14T11:15:11.927138+0000","last_undegraded":"2023-07-14T11:15:11.927138+0000","last_fullsized":"2023-07-14T11:15:11.927138+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:41:35.008325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.927089+0000","last_change":"2023-07-14T11:15:10.932542+0000","last_active":"2023-07-14T11:15:11.927089+0000","last_peered":"2023-07-14T11:15:11.927089+0000","last_clean":"2023-07-14T11:15:11.927089+0000","last_became_active":"2023-07-14T11:15:10.932316+0000","last_became_peered":"2023-07-14T11:15:10.932316+0000","last_unstale":"2023-07-14T11:15:11.927089+0000","last_undegraded":"2023-07-14T11:15:11.927089+0000","last_fullsized":"2023-07-14T11:15:11.927089+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:24:53.735137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.944435+0000","last_change":"2023-07-14T11:15:10.935681+0000","last_active":"2023-07-14T11:15:11.944435+0000","last_peered":"2023-07-14T11:15:11.944435+0000","last_clean":"2023-07-14T11:15:11.944435+0000","last_became_active":"2023-07-14T11:15:10.935397+0000","last_became_peered":"2023-07-14T11:15:10.935397+0000","last_unstale":"2023-07-14T11:15:11.944435+0000","last_undegraded":"2023-07-14T11:15:11.944435+0000","last_fullsized":"2023-07-14T11:15:11.944435+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:45:28.290761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.927095+0000","last_change":"2023-07-14T11:15:10.929436+0000","last_active":"2023-07-14T11:15:11.927095+0000","last_peered":"2023-07-14T11:15:11.927095+0000","last_clean":"2023-07-14T11:15:11.927095+0000","last_became_active":"2023-07-14T11:15:10.929186+0000","last_became_peered":"2023-07-14T11:15:10.929186+0000","last_unstale":"2023-07-14T11:15:11.927095+0000","last_undegraded":"2023-07-14T11:15:11.927095+0000","last_fullsized":"2023-07-14T11:15:11.927095+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:10:03.003309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.665032+0000","last_change":"2023-07-14T11:15:10.936569+0000","last_active":"2023-07-14T11:15:13.665032+0000","last_peered":"2023-07-14T11:15:13.665032+0000","last_clean":"2023-07-14T11:15:13.665032+0000","last_became_active":"2023-07-14T11:15:10.936102+0000","last_became_peered":"2023-07-14T11:15:10.936102+0000","last_unstale":"2023-07-14T11:15:13.665032+0000","last_undegraded":"2023-07-14T11:15:13.665032+0000","last_fullsized":"2023-07-14T11:15:13.665032+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:26:01.745154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.666362+0000","last_change":"2023-07-14T11:15:10.936259+0000","last_active":"2023-07-14T11:15:13.666362+0000","last_peered":"2023-07-14T11:15:13.666362+0000","last_clean":"2023-07-14T11:15:13.666362+0000","last_became_active":"2023-07-14T11:15:10.935778+0000","last_became_peered":"2023-07-14T11:15:10.935778+0000","last_unstale":"2023-07-14T11:15:13.666362+0000","last_undegraded":"2023-07-14T11:15:13.666362+0000","last_fullsized":"2023-07-14T11:15:13.666362+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:07:47.346468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.926657+0000","last_change":"2023-07-14T11:15:10.928890+0000","last_active":"2023-07-14T11:15:11.926657+0000","last_peered":"2023-07-14T11:15:11.926657+0000","last_clean":"2023-07-14T11:15:11.926657+0000","last_became_active":"2023-07-14T11:15:10.926333+0000","last_became_peered":"2023-07-14T11:15:10.926333+0000","last_unstale":"2023-07-14T11:15:11.926657+0000","last_undegraded":"2023-07-14T11:15:11.926657+0000","last_fullsized":"2023-07-14T11:15:11.926657+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:46:02.473727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.665534+0000","last_change":"2023-07-14T11:15:10.931739+0000","last_active":"2023-07-14T11:15:13.665534+0000","last_peered":"2023-07-14T11:15:13.665534+0000","last_clean":"2023-07-14T11:15:13.665534+0000","last_became_active":"2023-07-14T11:15:10.931180+0000","last_became_peered":"2023-07-14T11:15:10.931180+0000","last_unstale":"2023-07-14T11:15:13.665534+0000","last_undegraded":"2023-07-14T11:15:13.665534+0000","last_fullsized":"2023-07-14T11:15:13.665534+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:11:25.961330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.666839+0000","last_change":"2023-07-14T11:15:10.935893+0000","last_active":"2023-07-14T11:15:13.666839+0000","last_peered":"2023-07-14T11:15:13.666839+0000","last_clean":"2023-07-14T11:15:13.666839+0000","last_became_active":"2023-07-14T11:15:10.935473+0000","last_became_peered":"2023-07-14T11:15:10.935473+0000","last_unstale":"2023-07-14T11:15:13.666839+0000","last_undegraded":"2023-07-14T11:15:13.666839+0000","last_fullsized":"2023-07-14T11:15:13.666839+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:47:26.675759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.665286+0000","last_change":"2023-07-14T11:15:10.924017+0000","last_active":"2023-07-14T11:15:13.665286+0000","last_peered":"2023-07-14T11:15:13.665286+0000","last_clean":"2023-07-14T11:15:13.665286+0000","last_became_active":"2023-07-14T11:15:10.923751+0000","last_became_peered":"2023-07-14T11:15:10.923751+0000","last_unstale":"2023-07-14T11:15:13.665286+0000","last_undegraded":"2023-07-14T11:15:13.665286+0000","last_fullsized":"2023-07-14T11:15:13.665286+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:32:32.157604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.666317+0000","last_change":"2023-07-14T11:15:10.928004+0000","last_active":"2023-07-14T11:15:13.666317+0000","last_peered":"2023-07-14T11:15:13.666317+0000","last_clean":"2023-07-14T11:15:13.666317+0000","last_became_active":"2023-07-14T11:15:10.927727+0000","last_became_peered":"2023-07-14T11:15:10.927727+0000","last_unstale":"2023-07-14T11:15:13.666317+0000","last_undegraded":"2023-07-14T11:15:13.666317+0000","last_fullsized":"2023-07-14T11:15:13.666317+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:56:43.748275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.666137+0000","last_change":"2023-07-14T11:15:10.935381+0000","last_active":"2023-07-14T11:15:13.666137+0000","last_peered":"2023-07-14T11:15:13.666137+0000","last_clean":"2023-07-14T11:15:13.666137+0000","last_became_active":"2023-07-14T11:15:10.935042+0000","last_became_peered":"2023-07-14T11:15:10.935042+0000","last_unstale":"2023-07-14T11:15:13.666137+0000","last_undegraded":"2023-07-14T11:15:13.666137+0000","last_fullsized":"2023-07-14T11:15:13.666137+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:28:43.676308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.944097+0000","last_change":"2023-07-14T11:15:10.926865+0000","last_active":"2023-07-14T11:15:11.944097+0000","last_peered":"2023-07-14T11:15:11.944097+0000","last_clean":"2023-07-14T11:15:11.944097+0000","last_became_active":"2023-07-14T11:15:10.926563+0000","last_became_peered":"2023-07-14T11:15:10.926563+0000","last_unstale":"2023-07-14T11:15:11.944097+0000","last_undegraded":"2023-07-14T11:15:11.944097+0000","last_fullsized":"2023-07-14T11:15:11.944097+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:26:01.745154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.926854+0000","last_change":"2023-07-14T11:15:10.940410+0000","last_active":"2023-07-14T11:15:11.926854+0000","last_peered":"2023-07-14T11:15:11.926854+0000","last_clean":"2023-07-14T11:15:11.926854+0000","last_became_active":"2023-07-14T11:15:10.939991+0000","last_became_peered":"2023-07-14T11:15:10.939991+0000","last_unstale":"2023-07-14T11:15:11.926854+0000","last_undegraded":"2023-07-14T11:15:11.926854+0000","last_fullsized":"2023-07-14T11:15:11.926854+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:17:22.544441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.664823+0000","last_change":"2023-07-14T11:15:10.936569+0000","last_active":"2023-07-14T11:15:13.664823+0000","last_peered":"2023-07-14T11:15:13.664823+0000","last_clean":"2023-07-14T11:15:13.664823+0000","last_became_active":"2023-07-14T11:15:10.936136+0000","last_became_peered":"2023-07-14T11:15:10.936136+0000","last_unstale":"2023-07-14T11:15:13.664823+0000","last_undegraded":"2023-07-14T11:15:13.664823+0000","last_fullsized":"2023-07-14T11:15:13.664823+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:18:41.889981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.665506+0000","last_change":"2023-07-14T11:15:10.935674+0000","last_active":"2023-07-14T11:15:13.665506+0000","last_peered":"2023-07-14T11:15:13.665506+0000","last_clean":"2023-07-14T11:15:13.665506+0000","last_became_active":"2023-07-14T11:15:10.935407+0000","last_became_peered":"2023-07-14T11:15:10.935407+0000","last_unstale":"2023-07-14T11:15:13.665506+0000","last_undegraded":"2023-07-14T11:15:13.665506+0000","last_fullsized":"2023-07-14T11:15:13.665506+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:46:16.791323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.944593+0000","last_change":"2023-07-14T11:15:10.934694+0000","last_active":"2023-07-14T11:15:11.944593+0000","last_peered":"2023-07-14T11:15:11.944593+0000","last_clean":"2023-07-14T11:15:11.944593+0000","last_became_active":"2023-07-14T11:15:10.934086+0000","last_became_peered":"2023-07-14T11:15:10.934086+0000","last_unstale":"2023-07-14T11:15:11.944593+0000","last_undegraded":"2023-07-14T11:15:11.944593+0000","last_fullsized":"2023-07-14T11:15:11.944593+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:41:35.008325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.928102+0000","last_change":"2023-07-14T11:15:10.921991+0000","last_active":"2023-07-14T11:15:11.928102+0000","last_peered":"2023-07-14T11:15:11.928102+0000","last_clean":"2023-07-14T11:15:11.928102+0000","last_became_active":"2023-07-14T11:15:10.921684+0000","last_became_peered":"2023-07-14T11:15:10.921684+0000","last_unstale":"2023-07-14T11:15:11.928102+0000","last_undegraded":"2023-07-14T11:15:11.928102+0000","last_fullsized":"2023-07-14T11:15:11.928102+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:51:46.220783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.666981+0000","last_change":"2023-07-14T11:15:10.927989+0000","last_active":"2023-07-14T11:15:13.666981+0000","last_peered":"2023-07-14T11:15:13.666981+0000","last_clean":"2023-07-14T11:15:13.666981+0000","last_became_active":"2023-07-14T11:15:10.927707+0000","last_became_peered":"2023-07-14T11:15:10.927707+0000","last_unstale":"2023-07-14T11:15:13.666981+0000","last_undegraded":"2023-07-14T11:15:13.666981+0000","last_fullsized":"2023-07-14T11:15:13.666981+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:09:12.631700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.664924+0000","last_change":"2023-07-14T11:15:10.939352+0000","last_active":"2023-07-14T11:15:13.664924+0000","last_peered":"2023-07-14T11:15:13.664924+0000","last_clean":"2023-07-14T11:15:13.664924+0000","last_became_active":"2023-07-14T11:15:10.939071+0000","last_became_peered":"2023-07-14T11:15:10.939071+0000","last_unstale":"2023-07-14T11:15:13.664924+0000","last_undegraded":"2023-07-14T11:15:13.664924+0000","last_fullsized":"2023-07-14T11:15:13.664924+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:47:51.599162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.665837+0000","last_change":"2023-07-14T11:15:10.924682+0000","last_active":"2023-07-14T11:15:13.665837+0000","last_peered":"2023-07-14T11:15:13.665837+0000","last_clean":"2023-07-14T11:15:13.665837+0000","last_became_active":"2023-07-14T11:15:10.924373+0000","last_became_peered":"2023-07-14T11:15:10.924373+0000","last_unstale":"2023-07-14T11:15:13.665837+0000","last_undegraded":"2023-07-14T11:15:13.665837+0000","last_fullsized":"2023-07-14T11:15:13.665837+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:24:04.548674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.664982+0000","last_change":"2023-07-14T11:15:10.937395+0000","last_active":"2023-07-14T11:15:13.664982+0000","last_peered":"2023-07-14T11:15:13.664982+0000","last_clean":"2023-07-14T11:15:13.664982+0000","last_became_active":"2023-07-14T11:15:10.936861+0000","last_became_peered":"2023-07-14T11:15:10.936861+0000","last_unstale":"2023-07-14T11:15:13.664982+0000","last_undegraded":"2023-07-14T11:15:13.664982+0000","last_fullsized":"2023-07-14T11:15:13.664982+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:10:43.496513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.928071+0000","last_change":"2023-07-14T11:15:10.930495+0000","last_active":"2023-07-14T11:15:11.928071+0000","last_peered":"2023-07-14T11:15:11.928071+0000","last_clean":"2023-07-14T11:15:11.928071+0000","last_became_active":"2023-07-14T11:15:10.930128+0000","last_became_peered":"2023-07-14T11:15:10.930128+0000","last_unstale":"2023-07-14T11:15:11.928071+0000","last_undegraded":"2023-07-14T11:15:11.928071+0000","last_fullsized":"2023-07-14T11:15:11.928071+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:34:19.424675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.666593+0000","last_change":"2023-07-14T11:15:10.936543+0000","last_active":"2023-07-14T11:15:13.666593+0000","last_peered":"2023-07-14T11:15:13.666593+0000","last_clean":"2023-07-14T11:15:13.666593+0000","last_became_active":"2023-07-14T11:15:10.936237+0000","last_became_peered":"2023-07-14T11:15:10.936237+0000","last_unstale":"2023-07-14T11:15:13.666593+0000","last_undegraded":"2023-07-14T11:15:13.666593+0000","last_fullsized":"2023-07-14T11:15:13.666593+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:23:00.512302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"49'4","reported_seq":17,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.666777+0000","last_change":"2023-07-14T11:15:09.929802+0000","last_active":"2023-07-14T11:15:13.666777+0000","last_peered":"2023-07-14T11:15:13.666777+0000","last_clean":"2023-07-14T11:15:13.666777+0000","last_became_active":"2023-07-14T11:15:09.929501+0000","last_became_peered":"2023-07-14T11:15:09.929501+0000","last_unstale":"2023-07-14T11:15:13.666777+0000","last_undegraded":"2023-07-14T11:15:13.666777+0000","last_fullsized":"2023-07-14T11:15:13.666777+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:36:26.856627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.927840+0000","last_change":"2023-07-14T11:15:10.937809+0000","last_active":"2023-07-14T11:15:11.927840+0000","last_peered":"2023-07-14T11:15:11.927840+0000","last_clean":"2023-07-14T11:15:11.927840+0000","last_became_active":"2023-07-14T11:15:10.937523+0000","last_became_peered":"2023-07-14T11:15:10.937523+0000","last_unstale":"2023-07-14T11:15:11.927840+0000","last_undegraded":"2023-07-14T11:15:11.927840+0000","last_fullsized":"2023-07-14T11:15:11.927840+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:10:43.144347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"49'1","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.927301+0000","last_change":"2023-07-14T11:15:09.921655+0000","last_active":"2023-07-14T11:15:11.927301+0000","last_peered":"2023-07-14T11:15:11.927301+0000","last_clean":"2023-07-14T11:15:11.927301+0000","last_became_active":"2023-07-14T11:15:09.921392+0000","last_became_peered":"2023-07-14T11:15:09.921392+0000","last_unstale":"2023-07-14T11:15:11.927301+0000","last_undegraded":"2023-07-14T11:15:11.927301+0000","last_fullsized":"2023-07-14T11:15:11.927301+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:11:24.955167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.666453+0000","last_change":"2023-07-14T11:15:10.930673+0000","last_active":"2023-07-14T11:15:13.666453+0000","last_peered":"2023-07-14T11:15:13.666453+0000","last_clean":"2023-07-14T11:15:13.666453+0000","last_became_active":"2023-07-14T11:15:10.930404+0000","last_became_peered":"2023-07-14T11:15:10.930404+0000","last_unstale":"2023-07-14T11:15:13.666453+0000","last_undegraded":"2023-07-14T11:15:13.666453+0000","last_fullsized":"2023-07-14T11:15:13.666453+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:02:40.219407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"49'2","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.928081+0000","last_change":"2023-07-14T11:15:09.924119+0000","last_active":"2023-07-14T11:15:11.928081+0000","last_peered":"2023-07-14T11:15:11.928081+0000","last_clean":"2023-07-14T11:15:11.928081+0000","last_became_active":"2023-07-14T11:15:09.923816+0000","last_became_peered":"2023-07-14T11:15:09.923816+0000","last_unstale":"2023-07-14T11:15:11.928081+0000","last_undegraded":"2023-07-14T11:15:11.928081+0000","last_fullsized":"2023-07-14T11:15:11.928081+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:49:37.407502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.944206+0000","last_change":"2023-07-14T11:15:10.928459+0000","last_active":"2023-07-14T11:15:11.944206+0000","last_peered":"2023-07-14T11:15:11.944206+0000","last_clean":"2023-07-14T11:15:11.944206+0000","last_became_active":"2023-07-14T11:15:10.926974+0000","last_became_peered":"2023-07-14T11:15:10.926974+0000","last_unstale":"2023-07-14T11:15:11.944206+0000","last_undegraded":"2023-07-14T11:15:11.944206+0000","last_fullsized":"2023-07-14T11:15:11.944206+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:54:10.925414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"49'2","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.928070+0000","last_change":"2023-07-14T11:15:09.922230+0000","last_active":"2023-07-14T11:15:11.928070+0000","last_peered":"2023-07-14T11:15:11.928070+0000","last_clean":"2023-07-14T11:15:11.928070+0000","last_became_active":"2023-07-14T11:15:09.921945+0000","last_became_peered":"2023-07-14T11:15:09.921945+0000","last_unstale":"2023-07-14T11:15:11.928070+0000","last_undegraded":"2023-07-14T11:15:11.928070+0000","last_fullsized":"2023-07-14T11:15:11.928070+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:05:35.953604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.666444+0000","last_change":"2023-07-14T11:15:10.929453+0000","last_active":"2023-07-14T11:15:13.666444+0000","last_peered":"2023-07-14T11:15:13.666444+0000","last_clean":"2023-07-14T11:15:13.666444+0000","last_became_active":"2023-07-14T11:15:10.929189+0000","last_became_peered":"2023-07-14T11:15:10.929189+0000","last_unstale":"2023-07-14T11:15:13.666444+0000","last_undegraded":"2023-07-14T11:15:13.666444+0000","last_fullsized":"2023-07-14T11:15:13.666444+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:36:13.173272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"49'1","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.665006+0000","last_change":"2023-07-14T11:15:09.930314+0000","last_active":"2023-07-14T11:15:13.665006+0000","last_peered":"2023-07-14T11:15:13.665006+0000","last_clean":"2023-07-14T11:15:13.665006+0000","last_became_active":"2023-07-14T11:15:09.930070+0000","last_became_peered":"2023-07-14T11:15:09.930070+0000","last_unstale":"2023-07-14T11:15:13.665006+0000","last_undegraded":"2023-07-14T11:15:13.665006+0000","last_fullsized":"2023-07-14T11:15:13.665006+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:07:13.838418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.667346+0000","last_change":"2023-07-14T11:15:10.924358+0000","last_active":"2023-07-14T11:15:13.667346+0000","last_peered":"2023-07-14T11:15:13.667346+0000","last_clean":"2023-07-14T11:15:13.667346+0000","last_became_active":"2023-07-14T11:15:10.924097+0000","last_became_peered":"2023-07-14T11:15:10.924097+0000","last_unstale":"2023-07-14T11:15:13.667346+0000","last_undegraded":"2023-07-14T11:15:13.667346+0000","last_fullsized":"2023-07-14T11:15:13.667346+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:21:23.795838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"49'1","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.666017+0000","last_change":"2023-07-14T11:15:09.926046+0000","last_active":"2023-07-14T11:15:13.666017+0000","last_peered":"2023-07-14T11:15:13.666017+0000","last_clean":"2023-07-14T11:15:13.666017+0000","last_became_active":"2023-07-14T11:15:09.925750+0000","last_became_peered":"2023-07-14T11:15:09.925750+0000","last_unstale":"2023-07-14T11:15:13.666017+0000","last_undegraded":"2023-07-14T11:15:13.666017+0000","last_fullsized":"2023-07-14T11:15:13.666017+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:47:50.592999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.944540+0000","last_change":"2023-07-14T11:15:10.934890+0000","last_active":"2023-07-14T11:15:11.944540+0000","last_peered":"2023-07-14T11:15:11.944540+0000","last_clean":"2023-07-14T11:15:11.944540+0000","last_became_active":"2023-07-14T11:15:10.934420+0000","last_became_peered":"2023-07-14T11:15:10.934420+0000","last_unstale":"2023-07-14T11:15:11.944540+0000","last_undegraded":"2023-07-14T11:15:11.944540+0000","last_fullsized":"2023-07-14T11:15:11.944540+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:46:02.473727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.666964+0000","last_change":"2023-07-14T11:15:09.926115+0000","last_active":"2023-07-14T11:15:13.666964+0000","last_peered":"2023-07-14T11:15:13.666964+0000","last_clean":"2023-07-14T11:15:13.666964+0000","last_became_active":"2023-07-14T11:15:09.925816+0000","last_became_peered":"2023-07-14T11:15:09.925816+0000","last_unstale":"2023-07-14T11:15:13.666964+0000","last_undegraded":"2023-07-14T11:15:13.666964+0000","last_fullsized":"2023-07-14T11:15:13.666964+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:44:55.656851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.666893+0000","last_change":"2023-07-14T11:15:10.934416+0000","last_active":"2023-07-14T11:15:13.666893+0000","last_peered":"2023-07-14T11:15:13.666893+0000","last_clean":"2023-07-14T11:15:13.666893+0000","last_became_active":"2023-07-14T11:15:10.934095+0000","last_became_peered":"2023-07-14T11:15:10.934095+0000","last_unstale":"2023-07-14T11:15:13.666893+0000","last_undegraded":"2023-07-14T11:15:13.666893+0000","last_fullsized":"2023-07-14T11:15:13.666893+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:37:18.083208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.664874+0000","last_change":"2023-07-14T11:15:09.925165+0000","last_active":"2023-07-14T11:15:13.664874+0000","last_peered":"2023-07-14T11:15:13.664874+0000","last_clean":"2023-07-14T11:15:13.664874+0000","last_became_active":"2023-07-14T11:15:09.924894+0000","last_became_peered":"2023-07-14T11:15:09.924894+0000","last_unstale":"2023-07-14T11:15:13.664874+0000","last_undegraded":"2023-07-14T11:15:13.664874+0000","last_fullsized":"2023-07-14T11:15:13.664874+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:39:36.337375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.665744+0000","last_change":"2023-07-14T11:15:10.930528+0000","last_active":"2023-07-14T11:15:13.665744+0000","last_peered":"2023-07-14T11:15:13.665744+0000","last_clean":"2023-07-14T11:15:13.665744+0000","last_became_active":"2023-07-14T11:15:10.930201+0000","last_became_peered":"2023-07-14T11:15:10.930201+0000","last_unstale":"2023-07-14T11:15:13.665744+0000","last_undegraded":"2023-07-14T11:15:13.665744+0000","last_fullsized":"2023-07-14T11:15:13.665744+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:18:41.889981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.667044+0000","last_change":"2023-07-14T11:15:09.926330+0000","last_active":"2023-07-14T11:15:13.667044+0000","last_peered":"2023-07-14T11:15:13.667044+0000","last_clean":"2023-07-14T11:15:13.667044+0000","last_became_active":"2023-07-14T11:15:09.926039+0000","last_became_peered":"2023-07-14T11:15:09.926039+0000","last_unstale":"2023-07-14T11:15:13.667044+0000","last_undegraded":"2023-07-14T11:15:13.667044+0000","last_fullsized":"2023-07-14T11:15:13.667044+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:56:11.836559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.927806+0000","last_change":"2023-07-14T11:15:10.925307+0000","last_active":"2023-07-14T11:15:11.927806+0000","last_peered":"2023-07-14T11:15:11.927806+0000","last_clean":"2023-07-14T11:15:11.927806+0000","last_became_active":"2023-07-14T11:15:10.924966+0000","last_became_peered":"2023-07-14T11:15:10.924966+0000","last_unstale":"2023-07-14T11:15:11.927806+0000","last_undegraded":"2023-07-14T11:15:11.927806+0000","last_fullsized":"2023-07-14T11:15:11.927806+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:43:10.253612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.667102+0000","last_change":"2023-07-14T11:15:09.928164+0000","last_active":"2023-07-14T11:15:13.667102+0000","last_peered":"2023-07-14T11:15:13.667102+0000","last_clean":"2023-07-14T11:15:13.667102+0000","last_became_active":"2023-07-14T11:15:09.927872+0000","last_became_peered":"2023-07-14T11:15:09.927872+0000","last_unstale":"2023-07-14T11:15:13.667102+0000","last_undegraded":"2023-07-14T11:15:13.667102+0000","last_fullsized":"2023-07-14T11:15:13.667102+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:07:13.838418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.665181+0000","last_change":"2023-07-14T11:15:10.939301+0000","last_active":"2023-07-14T11:15:13.665181+0000","last_peered":"2023-07-14T11:15:13.665181+0000","last_clean":"2023-07-14T11:15:13.665181+0000","last_became_active":"2023-07-14T11:15:10.938975+0000","last_became_peered":"2023-07-14T11:15:10.938975+0000","last_unstale":"2023-07-14T11:15:13.665181+0000","last_undegraded":"2023-07-14T11:15:13.665181+0000","last_fullsized":"2023-07-14T11:15:13.665181+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:57:22.146216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"49'3","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.667452+0000","last_change":"2023-07-14T11:15:09.928283+0000","last_active":"2023-07-14T11:15:13.667452+0000","last_peered":"2023-07-14T11:15:13.667452+0000","last_clean":"2023-07-14T11:15:13.667452+0000","last_became_active":"2023-07-14T11:15:09.927756+0000","last_became_peered":"2023-07-14T11:15:09.927756+0000","last_unstale":"2023-07-14T11:15:13.667452+0000","last_undegraded":"2023-07-14T11:15:13.667452+0000","last_fullsized":"2023-07-14T11:15:13.667452+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:50:34.113216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.666219+0000","last_change":"2023-07-14T11:15:10.933062+0000","last_active":"2023-07-14T11:15:13.666219+0000","last_peered":"2023-07-14T11:15:13.666219+0000","last_clean":"2023-07-14T11:15:13.666219+0000","last_became_active":"2023-07-14T11:15:10.932772+0000","last_became_peered":"2023-07-14T11:15:10.932772+0000","last_unstale":"2023-07-14T11:15:13.666219+0000","last_undegraded":"2023-07-14T11:15:13.666219+0000","last_fullsized":"2023-07-14T11:15:13.666219+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:26:01.745154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"49'6","reported_seq":19,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.944543+0000","last_change":"2023-07-14T11:15:09.928525+0000","last_active":"2023-07-14T11:15:11.944543+0000","last_peered":"2023-07-14T11:15:11.944543+0000","last_clean":"2023-07-14T11:15:11.944543+0000","last_became_active":"2023-07-14T11:15:09.928270+0000","last_became_peered":"2023-07-14T11:15:09.928270+0000","last_unstale":"2023-07-14T11:15:11.944543+0000","last_undegraded":"2023-07-14T11:15:11.944543+0000","last_fullsized":"2023-07-14T11:15:11.944543+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:10:01.997146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.927844+0000","last_change":"2023-07-14T11:15:10.937191+0000","last_active":"2023-07-14T11:15:11.927844+0000","last_peered":"2023-07-14T11:15:11.927844+0000","last_clean":"2023-07-14T11:15:11.927844+0000","last_became_active":"2023-07-14T11:15:10.936849+0000","last_became_peered":"2023-07-14T11:15:10.936849+0000","last_unstale":"2023-07-14T11:15:11.927844+0000","last_undegraded":"2023-07-14T11:15:11.927844+0000","last_fullsized":"2023-07-14T11:15:11.927844+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:38:03.360143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"49'2","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.665085+0000","last_change":"2023-07-14T11:15:09.926581+0000","last_active":"2023-07-14T11:15:13.665085+0000","last_peered":"2023-07-14T11:15:13.665085+0000","last_clean":"2023-07-14T11:15:13.665085+0000","last_became_active":"2023-07-14T11:15:09.926305+0000","last_became_peered":"2023-07-14T11:15:09.926305+0000","last_unstale":"2023-07-14T11:15:13.665085+0000","last_undegraded":"2023-07-14T11:15:13.665085+0000","last_fullsized":"2023-07-14T11:15:13.665085+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:36:12.167108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.665327+0000","last_change":"2023-07-14T11:15:10.918903+0000","last_active":"2023-07-14T11:15:13.665327+0000","last_peered":"2023-07-14T11:15:13.665327+0000","last_clean":"2023-07-14T11:15:13.665327+0000","last_became_active":"2023-07-14T11:15:10.918595+0000","last_became_peered":"2023-07-14T11:15:10.918595+0000","last_unstale":"2023-07-14T11:15:13.665327+0000","last_undegraded":"2023-07-14T11:15:13.665327+0000","last_fullsized":"2023-07-14T11:15:13.665327+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:35:35.011670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.666593+0000","last_change":"2023-07-14T11:15:09.925179+0000","last_active":"2023-07-14T11:15:13.666593+0000","last_peered":"2023-07-14T11:15:13.666593+0000","last_clean":"2023-07-14T11:15:13.666593+0000","last_became_active":"2023-07-14T11:15:09.924920+0000","last_became_peered":"2023-07-14T11:15:09.924920+0000","last_unstale":"2023-07-14T11:15:13.666593+0000","last_undegraded":"2023-07-14T11:15:13.666593+0000","last_fullsized":"2023-07-14T11:15:13.666593+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:21:54.253623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.944459+0000","last_change":"2023-07-14T11:15:10.936810+0000","last_active":"2023-07-14T11:15:11.944459+0000","last_peered":"2023-07-14T11:15:11.944459+0000","last_clean":"2023-07-14T11:15:11.944459+0000","last_became_active":"2023-07-14T11:15:10.936529+0000","last_became_peered":"2023-07-14T11:15:10.936529+0000","last_unstale":"2023-07-14T11:15:11.944459+0000","last_undegraded":"2023-07-14T11:15:11.944459+0000","last_fullsized":"2023-07-14T11:15:11.944459+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:16:25.661287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.666497+0000","last_change":"2023-07-14T11:15:09.927381+0000","last_active":"2023-07-14T11:15:13.666497+0000","last_peered":"2023-07-14T11:15:13.666497+0000","last_clean":"2023-07-14T11:15:13.666497+0000","last_became_active":"2023-07-14T11:15:09.927064+0000","last_became_peered":"2023-07-14T11:15:09.927064+0000","last_unstale":"2023-07-14T11:15:13.666497+0000","last_undegraded":"2023-07-14T11:15:13.666497+0000","last_fullsized":"2023-07-14T11:15:13.666497+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:25:35.098442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.665450+0000","last_change":"2023-07-14T11:15:10.931492+0000","last_active":"2023-07-14T11:15:13.665450+0000","last_peered":"2023-07-14T11:15:13.665450+0000","last_clean":"2023-07-14T11:15:13.665450+0000","last_became_active":"2023-07-14T11:15:10.930836+0000","last_became_peered":"2023-07-14T11:15:10.930836+0000","last_unstale":"2023-07-14T11:15:13.665450+0000","last_undegraded":"2023-07-14T11:15:13.665450+0000","last_fullsized":"2023-07-14T11:15:13.665450+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:10:03.003309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"49'8","reported_seq":21,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.944348+0000","last_change":"2023-07-14T11:15:09.928241+0000","last_active":"2023-07-14T11:15:11.944348+0000","last_peered":"2023-07-14T11:15:11.944348+0000","last_clean":"2023-07-14T11:15:11.944348+0000","last_became_active":"2023-07-14T11:15:09.927889+0000","last_became_peered":"2023-07-14T11:15:09.927889+0000","last_unstale":"2023-07-14T11:15:11.944348+0000","last_undegraded":"2023-07-14T11:15:11.944348+0000","last_fullsized":"2023-07-14T11:15:11.944348+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:32:31.151441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.944141+0000","last_change":"2023-07-14T11:15:10.925504+0000","last_active":"2023-07-14T11:15:11.944141+0000","last_peered":"2023-07-14T11:15:11.944141+0000","last_clean":"2023-07-14T11:15:11.944141+0000","last_became_active":"2023-07-14T11:15:10.925239+0000","last_became_peered":"2023-07-14T11:15:10.925239+0000","last_unstale":"2023-07-14T11:15:11.944141+0000","last_undegraded":"2023-07-14T11:15:11.944141+0000","last_fullsized":"2023-07-14T11:15:11.944141+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:07:14.844582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"49'1","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.665400+0000","last_change":"2023-07-14T11:15:09.927305+0000","last_active":"2023-07-14T11:15:13.665400+0000","last_peered":"2023-07-14T11:15:13.665400+0000","last_clean":"2023-07-14T11:15:13.665400+0000","last_became_active":"2023-07-14T11:15:09.927040+0000","last_became_peered":"2023-07-14T11:15:09.927040+0000","last_unstale":"2023-07-14T11:15:13.665400+0000","last_undegraded":"2023-07-14T11:15:13.665400+0000","last_fullsized":"2023-07-14T11:15:13.665400+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:15:59.518564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.927332+0000","last_change":"2023-07-14T11:15:10.919741+0000","last_active":"2023-07-14T11:15:11.927332+0000","last_peered":"2023-07-14T11:15:11.927332+0000","last_clean":"2023-07-14T11:15:11.927332+0000","last_became_active":"2023-07-14T11:15:10.919457+0000","last_became_peered":"2023-07-14T11:15:10.919457+0000","last_unstale":"2023-07-14T11:15:11.927332+0000","last_undegraded":"2023-07-14T11:15:11.927332+0000","last_fullsized":"2023-07-14T11:15:11.927332+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:33:50.392750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"49'2","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.927593+0000","last_change":"2023-07-14T11:15:09.929235+0000","last_active":"2023-07-14T11:15:11.927593+0000","last_peered":"2023-07-14T11:15:11.927593+0000","last_clean":"2023-07-14T11:15:11.927593+0000","last_became_active":"2023-07-14T11:15:09.928960+0000","last_became_peered":"2023-07-14T11:15:09.928960+0000","last_unstale":"2023-07-14T11:15:11.927593+0000","last_undegraded":"2023-07-14T11:15:11.927593+0000","last_fullsized":"2023-07-14T11:15:11.927593+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:00:17.861115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.665936+0000","last_change":"2023-07-14T11:15:10.928899+0000","last_active":"2023-07-14T11:15:13.665936+0000","last_peered":"2023-07-14T11:15:13.665936+0000","last_clean":"2023-07-14T11:15:13.665936+0000","last_became_active":"2023-07-14T11:15:10.928567+0000","last_became_peered":"2023-07-14T11:15:10.928567+0000","last_unstale":"2023-07-14T11:15:13.665936+0000","last_undegraded":"2023-07-14T11:15:13.665936+0000","last_fullsized":"2023-07-14T11:15:13.665936+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:39:37.343538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"49'1","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.667166+0000","last_change":"2023-07-14T11:15:09.924426+0000","last_active":"2023-07-14T11:15:13.667166+0000","last_peered":"2023-07-14T11:15:13.667166+0000","last_clean":"2023-07-14T11:15:13.667166+0000","last_became_active":"2023-07-14T11:15:09.924111+0000","last_became_peered":"2023-07-14T11:15:09.924111+0000","last_unstale":"2023-07-14T11:15:13.667166+0000","last_undegraded":"2023-07-14T11:15:13.667166+0000","last_fullsized":"2023-07-14T11:15:13.667166+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:00:03.846732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.927363+0000","last_change":"2023-07-14T11:15:10.924665+0000","last_active":"2023-07-14T11:15:11.927363+0000","last_peered":"2023-07-14T11:15:11.927363+0000","last_clean":"2023-07-14T11:15:11.927363+0000","last_became_active":"2023-07-14T11:15:10.924404+0000","last_became_peered":"2023-07-14T11:15:10.924404+0000","last_unstale":"2023-07-14T11:15:11.927363+0000","last_undegraded":"2023-07-14T11:15:11.927363+0000","last_fullsized":"2023-07-14T11:15:11.927363+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:18:20.380084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.666564+0000","last_change":"2023-07-14T11:15:09.926848+0000","last_active":"2023-07-14T11:15:13.666564+0000","last_peered":"2023-07-14T11:15:13.666564+0000","last_clean":"2023-07-14T11:15:13.666564+0000","last_became_active":"2023-07-14T11:15:09.926521+0000","last_became_peered":"2023-07-14T11:15:09.926521+0000","last_unstale":"2023-07-14T11:15:13.666564+0000","last_undegraded":"2023-07-14T11:15:13.666564+0000","last_fullsized":"2023-07-14T11:15:13.666564+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:53:03.155971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.927854+0000","last_change":"2023-07-14T11:15:10.926591+0000","last_active":"2023-07-14T11:15:11.927854+0000","last_peered":"2023-07-14T11:15:11.927854+0000","last_clean":"2023-07-14T11:15:11.927854+0000","last_became_active":"2023-07-14T11:15:10.926265+0000","last_became_peered":"2023-07-14T11:15:10.926265+0000","last_unstale":"2023-07-14T11:15:11.927854+0000","last_undegraded":"2023-07-14T11:15:11.927854+0000","last_fullsized":"2023-07-14T11:15:11.927854+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:20:31.352270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"49'2","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.927222+0000","last_change":"2023-07-14T11:15:09.923168+0000","last_active":"2023-07-14T11:15:11.927222+0000","last_peered":"2023-07-14T11:15:11.927222+0000","last_clean":"2023-07-14T11:15:11.927222+0000","last_became_active":"2023-07-14T11:15:09.922855+0000","last_became_peered":"2023-07-14T11:15:09.922855+0000","last_unstale":"2023-07-14T11:15:11.927222+0000","last_undegraded":"2023-07-14T11:15:11.927222+0000","last_fullsized":"2023-07-14T11:15:11.927222+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:46:15.785160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.666946+0000","last_change":"2023-07-14T11:15:10.928049+0000","last_active":"2023-07-14T11:15:13.666946+0000","last_peered":"2023-07-14T11:15:13.666946+0000","last_clean":"2023-07-14T11:15:13.666946+0000","last_became_active":"2023-07-14T11:15:10.927790+0000","last_became_peered":"2023-07-14T11:15:10.927790+0000","last_unstale":"2023-07-14T11:15:13.666946+0000","last_undegraded":"2023-07-14T11:15:13.666946+0000","last_fullsized":"2023-07-14T11:15:13.666946+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:38:07.291071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.944089+0000","last_change":"2023-07-14T11:15:09.928441+0000","last_active":"2023-07-14T11:15:11.944089+0000","last_peered":"2023-07-14T11:15:11.944089+0000","last_clean":"2023-07-14T11:15:11.944089+0000","last_became_active":"2023-07-14T11:15:09.928121+0000","last_became_peered":"2023-07-14T11:15:09.928121+0000","last_unstale":"2023-07-14T11:15:11.944089+0000","last_undegraded":"2023-07-14T11:15:11.944089+0000","last_fullsized":"2023-07-14T11:15:11.944089+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:36:12.167108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.665351+0000","last_change":"2023-07-14T11:15:10.929419+0000","last_active":"2023-07-14T11:15:13.665351+0000","last_peered":"2023-07-14T11:15:13.665351+0000","last_clean":"2023-07-14T11:15:13.665351+0000","last_became_active":"2023-07-14T11:15:10.929112+0000","last_became_peered":"2023-07-14T11:15:10.929112+0000","last_unstale":"2023-07-14T11:15:13.665351+0000","last_undegraded":"2023-07-14T11:15:13.665351+0000","last_fullsized":"2023-07-14T11:15:13.665351+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:16:25.661287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.665432+0000","last_change":"2023-07-14T11:15:09.929803+0000","last_active":"2023-07-14T11:15:13.665432+0000","last_peered":"2023-07-14T11:15:13.665432+0000","last_clean":"2023-07-14T11:15:13.665432+0000","last_became_active":"2023-07-14T11:15:09.929513+0000","last_became_peered":"2023-07-14T11:15:09.929513+0000","last_unstale":"2023-07-14T11:15:13.665432+0000","last_undegraded":"2023-07-14T11:15:13.665432+0000","last_fullsized":"2023-07-14T11:15:13.665432+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:46:01.467563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.927848+0000","last_change":"2023-07-14T11:15:10.931167+0000","last_active":"2023-07-14T11:15:11.927848+0000","last_peered":"2023-07-14T11:15:11.927848+0000","last_clean":"2023-07-14T11:15:11.927848+0000","last_became_active":"2023-07-14T11:15:10.930862+0000","last_became_peered":"2023-07-14T11:15:10.930862+0000","last_unstale":"2023-07-14T11:15:11.927848+0000","last_undegraded":"2023-07-14T11:15:11.927848+0000","last_fullsized":"2023-07-14T11:15:11.927848+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:18:46.168855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.926705+0000","last_change":"2023-07-14T11:15:09.929305+0000","last_active":"2023-07-14T11:15:11.926705+0000","last_peered":"2023-07-14T11:15:11.926705+0000","last_clean":"2023-07-14T11:15:11.926705+0000","last_became_active":"2023-07-14T11:15:09.929031+0000","last_became_peered":"2023-07-14T11:15:09.929031+0000","last_unstale":"2023-07-14T11:15:11.926705+0000","last_undegraded":"2023-07-14T11:15:11.926705+0000","last_fullsized":"2023-07-14T11:15:11.926705+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:20:41.162108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.665158+0000","last_change":"2023-07-14T11:15:10.935840+0000","last_active":"2023-07-14T11:15:13.665158+0000","last_peered":"2023-07-14T11:15:13.665158+0000","last_clean":"2023-07-14T11:15:13.665158+0000","last_became_active":"2023-07-14T11:15:10.935573+0000","last_became_peered":"2023-07-14T11:15:10.935573+0000","last_unstale":"2023-07-14T11:15:13.665158+0000","last_undegraded":"2023-07-14T11:15:13.665158+0000","last_fullsized":"2023-07-14T11:15:13.665158+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:28:46.603191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.665838+0000","last_change":"2023-07-14T11:15:09.930870+0000","last_active":"2023-07-14T11:15:13.665838+0000","last_peered":"2023-07-14T11:15:13.665838+0000","last_clean":"2023-07-14T11:15:13.665838+0000","last_became_active":"2023-07-14T11:15:09.930528+0000","last_became_peered":"2023-07-14T11:15:09.930528+0000","last_unstale":"2023-07-14T11:15:13.665838+0000","last_undegraded":"2023-07-14T11:15:13.665838+0000","last_fullsized":"2023-07-14T11:15:13.665838+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:25:47.534232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":74,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.927566+0000","last_change":"2023-07-14T11:13:08.923786+0000","last_active":"2023-07-14T11:15:11.927566+0000","last_peered":"2023-07-14T11:15:11.927566+0000","last_clean":"2023-07-14T11:15:11.927566+0000","last_became_active":"2023-07-14T11:13:08.923384+0000","last_became_peered":"2023-07-14T11:13:08.923384+0000","last_unstale":"2023-07-14T11:15:11.927566+0000","last_undegraded":"2023-07-14T11:15:11.927566+0000","last_fullsized":"2023-07-14T11:15:11.927566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:05:37.474620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.927941+0000","last_change":"2023-07-14T11:15:10.928257+0000","last_active":"2023-07-14T11:15:11.927941+0000","last_peered":"2023-07-14T11:15:11.927941+0000","last_clean":"2023-07-14T11:15:11.927941+0000","last_became_active":"2023-07-14T11:15:10.927918+0000","last_became_peered":"2023-07-14T11:15:10.927918+0000","last_unstale":"2023-07-14T11:15:11.927941+0000","last_undegraded":"2023-07-14T11:15:11.927941+0000","last_fullsized":"2023-07-14T11:15:11.927941+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:46:56.463796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"49'2","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.667104+0000","last_change":"2023-07-14T11:15:09.928459+0000","last_active":"2023-07-14T11:15:13.667104+0000","last_peered":"2023-07-14T11:15:13.667104+0000","last_clean":"2023-07-14T11:15:13.667104+0000","last_became_active":"2023-07-14T11:15:09.928095+0000","last_became_peered":"2023-07-14T11:15:09.928095+0000","last_unstale":"2023-07-14T11:15:13.667104+0000","last_undegraded":"2023-07-14T11:15:13.667104+0000","last_fullsized":"2023-07-14T11:15:13.667104+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:44:18.599797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":70,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.927769+0000","last_change":"2023-07-14T11:13:08.758749+0000","last_active":"2023-07-14T11:15:11.927769+0000","last_peered":"2023-07-14T11:15:11.927769+0000","last_clean":"2023-07-14T11:15:11.927769+0000","last_became_active":"2023-07-14T11:13:08.757956+0000","last_became_peered":"2023-07-14T11:13:08.757956+0000","last_unstale":"2023-07-14T11:15:11.927769+0000","last_undegraded":"2023-07-14T11:15:11.927769+0000","last_fullsized":"2023-07-14T11:15:11.927769+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:39:52.335073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.944276+0000","last_change":"2023-07-14T11:15:10.928624+0000","last_active":"2023-07-14T11:15:11.944276+0000","last_peered":"2023-07-14T11:15:11.944276+0000","last_clean":"2023-07-14T11:15:11.944276+0000","last_became_active":"2023-07-14T11:15:10.928183+0000","last_became_peered":"2023-07-14T11:15:10.928183+0000","last_unstale":"2023-07-14T11:15:11.944276+0000","last_undegraded":"2023-07-14T11:15:11.944276+0000","last_fullsized":"2023-07-14T11:15:11.944276+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:46:07.655019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.665324+0000","last_change":"2023-07-14T11:15:09.931330+0000","last_active":"2023-07-14T11:15:13.665324+0000","last_peered":"2023-07-14T11:15:13.665324+0000","last_clean":"2023-07-14T11:15:13.665324+0000","last_became_active":"2023-07-14T11:15:09.931069+0000","last_became_peered":"2023-07-14T11:15:09.931069+0000","last_unstale":"2023-07-14T11:15:13.665324+0000","last_undegraded":"2023-07-14T11:15:13.665324+0000","last_fullsized":"2023-07-14T11:15:13.665324+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:45:27.284598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":74,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.927004+0000","last_change":"2023-07-14T11:13:08.862331+0000","last_active":"2023-07-14T11:15:11.927004+0000","last_peered":"2023-07-14T11:15:11.927004+0000","last_clean":"2023-07-14T11:15:11.927004+0000","last_became_active":"2023-07-14T11:13:08.861817+0000","last_became_peered":"2023-07-14T11:13:08.861817+0000","last_unstale":"2023-07-14T11:15:11.927004+0000","last_undegraded":"2023-07-14T11:15:11.927004+0000","last_fullsized":"2023-07-14T11:15:11.927004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:14:21.289970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.666793+0000","last_change":"2023-07-14T11:15:10.928480+0000","last_active":"2023-07-14T11:15:13.666793+0000","last_peered":"2023-07-14T11:15:13.666793+0000","last_clean":"2023-07-14T11:15:13.666793+0000","last_became_active":"2023-07-14T11:15:10.928241+0000","last_became_peered":"2023-07-14T11:15:10.928241+0000","last_unstale":"2023-07-14T11:15:13.666793+0000","last_undegraded":"2023-07-14T11:15:13.666793+0000","last_fullsized":"2023-07-14T11:15:13.666793+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:52:43.605709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.665466+0000","last_change":"2023-07-14T11:15:09.928418+0000","last_active":"2023-07-14T11:15:13.665466+0000","last_peered":"2023-07-14T11:15:13.665466+0000","last_clean":"2023-07-14T11:15:13.665466+0000","last_became_active":"2023-07-14T11:15:09.927987+0000","last_became_peered":"2023-07-14T11:15:09.927987+0000","last_unstale":"2023-07-14T11:15:13.665466+0000","last_undegraded":"2023-07-14T11:15:13.665466+0000","last_fullsized":"2023-07-14T11:15:13.665466+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:41:34.002161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":70,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.927780+0000","last_change":"2023-07-14T11:13:08.757882+0000","last_active":"2023-07-14T11:15:11.927780+0000","last_peered":"2023-07-14T11:15:11.927780+0000","last_clean":"2023-07-14T11:15:11.927780+0000","last_became_active":"2023-07-14T11:13:08.757541+0000","last_became_peered":"2023-07-14T11:13:08.757541+0000","last_unstale":"2023-07-14T11:15:11.927780+0000","last_undegraded":"2023-07-14T11:15:11.927780+0000","last_fullsized":"2023-07-14T11:15:11.927780+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:17:38.570250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":222,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.666732+0000","last_change":"2023-07-14T11:13:01.370649+0000","last_active":"2023-07-14T11:15:13.666732+0000","last_peered":"2023-07-14T11:15:13.666732+0000","last_clean":"2023-07-14T11:15:13.666732+0000","last_became_active":"2023-07-14T11:13:01.369478+0000","last_became_peered":"2023-07-14T11:13:01.369478+0000","last_unstale":"2023-07-14T11:15:13.666732+0000","last_undegraded":"2023-07-14T11:15:13.666732+0000","last_fullsized":"2023-07-14T11:15:13.666732+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:00.254800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:00.254800+0000","last_clean_scrub_stamp":"2023-07-14T11:13:00.254800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:30:38.682327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.927656+0000","last_change":"2023-07-14T11:15:10.925992+0000","last_active":"2023-07-14T11:15:11.927656+0000","last_peered":"2023-07-14T11:15:11.927656+0000","last_clean":"2023-07-14T11:15:11.927656+0000","last_became_active":"2023-07-14T11:15:10.925169+0000","last_became_peered":"2023-07-14T11:15:10.925169+0000","last_unstale":"2023-07-14T11:15:11.927656+0000","last_undegraded":"2023-07-14T11:15:11.927656+0000","last_fullsized":"2023-07-14T11:15:11.927656+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:19:13.701808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.667488+0000","last_change":"2023-07-14T11:15:09.927770+0000","last_active":"2023-07-14T11:15:13.667488+0000","last_peered":"2023-07-14T11:15:13.667488+0000","last_clean":"2023-07-14T11:15:13.667488+0000","last_became_active":"2023-07-14T11:15:09.927446+0000","last_became_peered":"2023-07-14T11:15:09.927446+0000","last_unstale":"2023-07-14T11:15:13.667488+0000","last_undegraded":"2023-07-14T11:15:13.667488+0000","last_fullsized":"2023-07-14T11:15:13.667488+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:23:32.593440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":66,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.666751+0000","last_change":"2023-07-14T11:13:08.760609+0000","last_active":"2023-07-14T11:15:13.666751+0000","last_peered":"2023-07-14T11:15:13.666751+0000","last_clean":"2023-07-14T11:15:13.666751+0000","last_became_active":"2023-07-14T11:13:08.760285+0000","last_became_peered":"2023-07-14T11:13:08.760285+0000","last_unstale":"2023-07-14T11:15:13.666751+0000","last_undegraded":"2023-07-14T11:15:13.666751+0000","last_fullsized":"2023-07-14T11:15:13.666751+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:33:22.465964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.944634+0000","last_change":"2023-07-14T11:15:10.928142+0000","last_active":"2023-07-14T11:15:11.944634+0000","last_peered":"2023-07-14T11:15:11.944634+0000","last_clean":"2023-07-14T11:15:11.944634+0000","last_became_active":"2023-07-14T11:15:10.926916+0000","last_became_peered":"2023-07-14T11:15:10.926916+0000","last_unstale":"2023-07-14T11:15:11.944634+0000","last_undegraded":"2023-07-14T11:15:11.944634+0000","last_fullsized":"2023-07-14T11:15:11.944634+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:46:16.791323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.928101+0000","last_change":"2023-07-14T11:15:09.923995+0000","last_active":"2023-07-14T11:15:11.928101+0000","last_peered":"2023-07-14T11:15:11.928101+0000","last_clean":"2023-07-14T11:15:11.928101+0000","last_became_active":"2023-07-14T11:15:09.923504+0000","last_became_peered":"2023-07-14T11:15:09.923504+0000","last_unstale":"2023-07-14T11:15:11.928101+0000","last_undegraded":"2023-07-14T11:15:11.928101+0000","last_fullsized":"2023-07-14T11:15:11.928101+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:41:49.032709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":66,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.667646+0000","last_change":"2023-07-14T11:13:08.923899+0000","last_active":"2023-07-14T11:15:13.667646+0000","last_peered":"2023-07-14T11:15:13.667646+0000","last_clean":"2023-07-14T11:15:13.667646+0000","last_became_active":"2023-07-14T11:13:08.923513+0000","last_became_peered":"2023-07-14T11:13:08.923513+0000","last_unstale":"2023-07-14T11:15:13.667646+0000","last_undegraded":"2023-07-14T11:15:13.667646+0000","last_fullsized":"2023-07-14T11:15:13.667646+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:23:52.469310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.665192+0000","last_change":"2023-07-14T11:15:10.938216+0000","last_active":"2023-07-14T11:15:13.665192+0000","last_peered":"2023-07-14T11:15:13.665192+0000","last_clean":"2023-07-14T11:15:13.665192+0000","last_became_active":"2023-07-14T11:15:10.937942+0000","last_became_peered":"2023-07-14T11:15:10.937942+0000","last_unstale":"2023-07-14T11:15:13.665192+0000","last_undegraded":"2023-07-14T11:15:13.665192+0000","last_fullsized":"2023-07-14T11:15:13.665192+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:46:07.655019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.944355+0000","last_change":"2023-07-14T11:15:09.928608+0000","last_active":"2023-07-14T11:15:11.944355+0000","last_peered":"2023-07-14T11:15:11.944355+0000","last_clean":"2023-07-14T11:15:11.944355+0000","last_became_active":"2023-07-14T11:15:09.927944+0000","last_became_peered":"2023-07-14T11:15:09.927944+0000","last_unstale":"2023-07-14T11:15:11.944355+0000","last_undegraded":"2023-07-14T11:15:11.944355+0000","last_fullsized":"2023-07-14T11:15:11.944355+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:35:34.005507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":73,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.927425+0000","last_change":"2023-07-14T11:13:08.761726+0000","last_active":"2023-07-14T11:15:11.927425+0000","last_peered":"2023-07-14T11:15:11.927425+0000","last_clean":"2023-07-14T11:15:11.927425+0000","last_became_active":"2023-07-14T11:13:08.761365+0000","last_became_peered":"2023-07-14T11:13:08.761365+0000","last_unstale":"2023-07-14T11:15:11.927425+0000","last_undegraded":"2023-07-14T11:15:11.927425+0000","last_fullsized":"2023-07-14T11:15:11.927425+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:24:20.544830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.927740+0000","last_change":"2023-07-14T11:15:10.934577+0000","last_active":"2023-07-14T11:15:11.927740+0000","last_peered":"2023-07-14T11:15:11.927740+0000","last_clean":"2023-07-14T11:15:11.927740+0000","last_became_active":"2023-07-14T11:15:10.934249+0000","last_became_peered":"2023-07-14T11:15:10.934249+0000","last_unstale":"2023-07-14T11:15:11.927740+0000","last_undegraded":"2023-07-14T11:15:11.927740+0000","last_fullsized":"2023-07-14T11:15:11.927740+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:39:50.567419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.944259+0000","last_change":"2023-07-14T11:15:09.928400+0000","last_active":"2023-07-14T11:15:11.944259+0000","last_peered":"2023-07-14T11:15:11.944259+0000","last_clean":"2023-07-14T11:15:11.944259+0000","last_became_active":"2023-07-14T11:15:09.928137+0000","last_became_peered":"2023-07-14T11:15:09.928137+0000","last_unstale":"2023-07-14T11:15:11.944259+0000","last_undegraded":"2023-07-14T11:15:11.944259+0000","last_fullsized":"2023-07-14T11:15:11.944259+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:57:21.140052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":69,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.667236+0000","last_change":"2023-07-14T11:13:08.762084+0000","last_active":"2023-07-14T11:15:13.667236+0000","last_peered":"2023-07-14T11:15:13.667236+0000","last_clean":"2023-07-14T11:15:13.667236+0000","last_became_active":"2023-07-14T11:13:08.761763+0000","last_became_peered":"2023-07-14T11:13:08.761763+0000","last_unstale":"2023-07-14T11:15:13.667236+0000","last_undegraded":"2023-07-14T11:15:13.667236+0000","last_fullsized":"2023-07-14T11:15:13.667236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:59:32.144323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574879,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28116,"kb_used_data":1164,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343724,"statfs":{"total":96636764160,"available":96607973376,"internally_reserved":0,"allocated":1191936,"data_stored":845736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.93200000000000005,"15min":0.98399999999999999},"min":{"1min":0.47199999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.877,"5min":8.4339999999999993,"15min":8.4339999999999993},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.97099999999999997,"15min":1.0209999999999999},"min":{"1min":0.52300000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.91600000000000004,"5min":8.4559999999999995,"15min":8.4559999999999995},"last":0.65900000000000003}]},{"osd":1,"last update":"Fri Jul 14 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.90000000000000002,"15min":0.94699999999999995},"min":{"1min":0.40400000000000003,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.84499999999999997,"5min":6.3520000000000003,"15min":6.3520000000000003},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":1.079,"15min":1.149},"min":{"1min":0.46400000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.86099999999999999,"5min":6.8550000000000004,"15min":6.8550000000000004},"last":0.745}]},{"osd":2,"last update":"Fri Jul 14 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":1.1359999999999999,"15min":1.212},"min":{"1min":0.51100000000000001,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.95599999999999996,"5min":7.0289999999999999,"15min":7.0289999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.69399999999999995,"15min":0.68999999999999995},"min":{"1min":0.51600000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.98199999999999998,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.72399999999999998}]},{"osd":3,"last update":"Fri Jul 14 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":1.1930000000000001,"15min":1.2769999999999999},"min":{"1min":0.58299999999999996,"5min":0.505,"15min":0.505},"max":{"1min":0.85999999999999999,"5min":10.337,"15min":10.337},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.77200000000000002,"15min":0.77300000000000002},"min":{"1min":0.60199999999999998,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.93300000000000005,"5min":1.921,"15min":1.921},"last":0.63500000000000001}]},{"osd":4,"last update":"Fri Jul 14 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.60099999999999998,"15min":0.58299999999999996},"min":{"1min":0.41499999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.70699999999999996,"15min":0.69599999999999995},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.76400000000000001}]},{"osd":5,"last update":"Fri Jul 14 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.68000000000000005,"15min":0.67200000000000004},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.74399999999999999,"15min":0.73399999999999999},"min":{"1min":0.60399999999999998,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.94399999999999995}]},{"osd":6,"last update":"Fri Jul 14 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.68200000000000005,"15min":0.66800000000000004},"min":{"1min":0.498,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.69299999999999995,"15min":0.68100000000000005},"min":{"1min":0.55800000000000005,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.81000000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574880,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27536,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":598016,"data_stored":255896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.71199999999999997,"15min":0.70699999999999996},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.752,"5min":0.72199999999999998,"15min":0.71699999999999997},"min":{"1min":0.51300000000000001,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.68100000000000005}]},{"osd":1,"last update":"Fri Jul 14 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.68200000000000005,"15min":0.67900000000000005},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.751,"5min":0.71499999999999997,"15min":0.70899999999999996},"min":{"1min":0.42299999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.60799999999999998}]},{"osd":2,"last update":"Fri Jul 14 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.67400000000000004,"15min":0.67000000000000004},"min":{"1min":0.45500000000000002,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.78300000000000003,"15min":0.78500000000000003},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.54800000000000004}]},{"osd":3,"last update":"Fri Jul 14 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.749,"15min":0.749},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.749,"15min":0.74399999999999999},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.53200000000000003}]},{"osd":4,"last update":"Fri Jul 14 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.71199999999999997,"15min":0.71399999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.712,"5min":1.712,"15min":1.712},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.73499999999999999,"15min":0.73099999999999998},"min":{"1min":0.438,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.70299999999999996}]},{"osd":5,"last update":"Fri Jul 14 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.73799999999999999,"15min":0.72599999999999998},"min":{"1min":0.52700000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":2.8820000000000001,"5min":2.8820000000000001,"15min":2.8820000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.78800000000000003,"15min":0.79300000000000004},"min":{"1min":0.46100000000000002,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.95099999999999996,"5min":1.129,"15min":1.129},"last":0.747}]},{"osd":7,"last update":"Fri Jul 14 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.80500000000000005,"15min":0.80900000000000005},"min":{"1min":0.49199999999999999,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.79500000000000004,"15min":0.79900000000000004},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.55,"5min":1.55,"15min":1.55},"last":0.625}]}]},{"osd":1,"up_from":13,"seq":55834574879,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27536,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":598016,"data_stored":255404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.439,"15min":0.443},"min":{"1min":0.28299999999999997,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.59099999999999997,"5min":0.996,"15min":0.996},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.47399999999999998,"15min":0.48199999999999998},"min":{"1min":0.30199999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.81599999999999995,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.42699999999999999}]},{"osd":2,"last update":"Fri Jul 14 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.56499999999999995,"15min":0.57699999999999996},"min":{"1min":0.374,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.68600000000000005,"5min":2.476,"15min":2.476},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.61099999999999999,"15min":0.63600000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.70499999999999996,"5min":2.6299999999999999,"15min":2.6299999999999999},"last":0.503}]},{"osd":3,"last update":"Fri Jul 14 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51700000000000002,"15min":0.51800000000000002},"min":{"1min":0.39300000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.65200000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.48899999999999999,"15min":0.496},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.65700000000000003,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.48699999999999999}]},{"osd":4,"last update":"Fri Jul 14 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.75,"15min":0.753},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0149999999999999,"5min":1.363,"15min":1.363},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.054,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.70199999999999996}]},{"osd":5,"last update":"Fri Jul 14 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.77900000000000003,"15min":0.77500000000000002},"min":{"1min":0.53100000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.1739999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.81799999999999995,"15min":0.82599999999999996},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.095,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.59299999999999997}]},{"osd":6,"last update":"Fri Jul 14 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.79700000000000004,"15min":0.80500000000000005},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.141,"5min":1.298,"15min":1.298},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.78600000000000003,"15min":0.79000000000000004},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.123,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.82099999999999995}]},{"osd":7,"last update":"Fri Jul 14 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.82499999999999996,"15min":0.82899999999999996},"min":{"1min":0.61899999999999999,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.2010000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.78600000000000003,"15min":0.79100000000000004},"min":{"1min":0.55000000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.92700000000000005,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.72799999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28116,"kb_used_data":1164,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343724,"statfs":{"total":96636764160,"available":96607973376,"internally_reserved":0,"allocated":1191936,"data_stored":845668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.42999999999999999,"15min":0.432},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.64000000000000001,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.434,"15min":0.438},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.35299999999999998}]},{"osd":2,"last update":"Fri Jul 14 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.45700000000000002,"15min":0.45900000000000002},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.65000000000000002,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.499},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.498,"15min":0.502},"min":{"1min":0.376,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.64300000000000002,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.38700000000000001}]},{"osd":3,"last update":"Fri Jul 14 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.42099999999999999,"15min":0.41799999999999998},"min":{"1min":0.32000000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.499,"5min":0.51900000000000002,"15min":0.52300000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.45800000000000002}]},{"osd":4,"last update":"Fri Jul 14 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.75700000000000001,"15min":0.76400000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.90500000000000003,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.69899999999999995,"15min":0.69699999999999995},"min":{"1min":0.54400000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.621}]},{"osd":5,"last update":"Fri Jul 14 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.71499999999999997,"15min":0.71899999999999997},"min":{"1min":0.502,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.83299999999999996,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.629},{"interface":"front","average":{"1min":0.745,"5min":0.77400000000000002,"15min":0.77900000000000003},"min":{"1min":0.54400000000000004,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.93500000000000005,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.74399999999999999}]},{"osd":6,"last update":"Fri Jul 14 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.71399999999999997,"15min":0.71799999999999997},"min":{"1min":0.59699999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.83899999999999997,"5min":1.006,"15min":1.006},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.77100000000000002,"15min":0.77800000000000002},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.89200000000000002,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.73199999999999998}]},{"osd":7,"last update":"Fri Jul 14 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.80900000000000005,"15min":0.81999999999999995},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":0.91300000000000003,"5min":1.149,"15min":1.149},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.57599999999999996,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.94899999999999995,"5min":1.081,"15min":1.081},"last":0.70399999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27540,"kb_used_data":588,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":602112,"data_stored":256808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.44600000000000001,"15min":0.45300000000000001},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.58199999999999996,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.442,"15min":0.44600000000000001},"min":{"1min":0.33000000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.66300000000000003,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.5}]},{"osd":1,"last update":"Fri Jul 14 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.48399999999999999,"15min":0.48799999999999999},"min":{"1min":0.371,"5min":0.31,"15min":0.31},"max":{"1min":0.63500000000000001,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48999999999999999,"15min":0.49099999999999999},"min":{"1min":0.36199999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.60099999999999998,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.46300000000000002}]},{"osd":3,"last update":"Fri Jul 14 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.49299999999999999,"15min":0.495},"min":{"1min":0.34200000000000003,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.63200000000000001,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.58099999999999996,"15min":0.58799999999999997},"min":{"1min":0.44900000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.67300000000000004,"5min":1.034,"15min":1.034},"last":0.44}]},{"osd":4,"last update":"Fri Jul 14 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.76400000000000001,"15min":0.77300000000000002},"min":{"1min":0.55300000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.93300000000000005,"5min":1.212,"15min":1.212},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.78200000000000003,"15min":0.79000000000000004},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.96799999999999997,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.70399999999999996}]},{"osd":5,"last update":"Fri Jul 14 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.78700000000000003,"15min":0.79600000000000004},"min":{"1min":0.57399999999999995,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.117,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.751,"5min":0.81899999999999995,"15min":0.82999999999999996},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0229999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.84899999999999998}]},{"osd":6,"last update":"Fri Jul 14 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.78600000000000003,"15min":0.79200000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.077,"5min":1.103,"15min":1.103},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.746,"5min":0.81799999999999995,"15min":0.82999999999999996},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.006,"5min":1.258,"15min":1.258},"last":0.76700000000000002}]},{"osd":7,"last update":"Fri Jul 14 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.79900000000000004,"15min":0.80600000000000005},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1339999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.79800000000000004,"15min":0.81100000000000005},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":0.98899999999999999,"5min":1.202,"15min":1.202},"last":0.79500000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27544,"kb_used_data":592,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344296,"statfs":{"total":96636764160,"available":96608559104,"internally_reserved":0,"allocated":606208,"data_stored":256830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.441,"15min":0.45200000000000001},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.63900000000000001,"5min":0.754,"15min":0.754},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.441,"15min":0.44700000000000001},"min":{"1min":0.33600000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.59699999999999998,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.372}]},{"osd":1,"last update":"Fri Jul 14 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.44900000000000001,"15min":0.45200000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.58299999999999996,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.437,"5min":0.48799999999999999,"15min":0.496},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.54700000000000004,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.57099999999999995}]},{"osd":2,"last update":"Fri Jul 14 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.53400000000000003,"15min":0.54000000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.63900000000000001,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.58699999999999997,"15min":0.59799999999999998},"min":{"1min":0.44400000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.71599999999999997,"5min":1.585,"15min":1.585},"last":0.502}]},{"osd":4,"last update":"Fri Jul 14 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.755,"15min":0.76100000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.93000000000000005,"5min":1.216,"15min":1.216},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.754,"5min":0.752,"15min":0.752},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.64500000000000002}]},{"osd":5,"last update":"Fri Jul 14 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.753,"15min":0.75900000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.90700000000000003,"5min":1.413,"15min":1.413},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.753,"5min":0.84499999999999997,"15min":0.86099999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1619999999999999,"5min":1.657,"15min":1.657},"last":0.72399999999999998}]},{"osd":6,"last update":"Fri Jul 14 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.77200000000000002,"15min":0.78100000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.999,"5min":1.726,"15min":1.726},"last":0.628},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.79300000000000004,"15min":0.80200000000000005},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.88800000000000001,"5min":1.333,"15min":1.333},"last":0.66800000000000004}]},{"osd":7,"last update":"Fri Jul 14 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.82799999999999996,"15min":0.84099999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.135,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.83499999999999996,"15min":0.84299999999999997},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.232,"5min":1.268,"15min":1.268},"last":0.75}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27532,"kb_used_data":580,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":593920,"data_stored":255826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.627,"15min":0.628},"min":{"1min":0.44,"5min":0.433,"15min":0.433},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69799999999999995,"15min":0.69899999999999995},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.38400000000000001}]},{"osd":1,"last update":"Fri Jul 14 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.66800000000000004,"15min":0.67200000000000004},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.92000000000000004,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.71099999999999997,"15min":0.71299999999999997},"min":{"1min":0.51400000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.99299999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.64300000000000002}]},{"osd":2,"last update":"Fri Jul 14 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.48499999999999999,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0209999999999999,"5min":1.48,"15min":1.48},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.747,"15min":0.745},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.1080000000000001,"5min":1.23,"15min":1.23},"last":0.57899999999999996}]},{"osd":3,"last update":"Fri Jul 14 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.71699999999999997,"15min":0.72099999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.746,"15min":0.74099999999999999},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.1259999999999999,"5min":1.145,"15min":1.145},"last":0.72599999999999998}]},{"osd":5,"last update":"Fri Jul 14 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.76000000000000001,"15min":0.77400000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.88900000000000001,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.77200000000000002,"15min":0.78300000000000003},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.96999999999999997,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.61599999999999999}]},{"osd":6,"last update":"Fri Jul 14 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.1659999999999999,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.77800000000000002,"15min":0.78000000000000003},"min":{"1min":0.52300000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.1479999999999999,"5min":1.3,"15min":1.3},"last":0.70499999999999996}]},{"osd":7,"last update":"Fri Jul 14 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.77400000000000002,"15min":0.77800000000000002},"min":{"1min":0.54500000000000004,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.028,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.84699999999999998,"15min":0.85699999999999998},"min":{"1min":0.53700000000000003,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.21,"5min":1.379,"15min":1.379},"last":0.75800000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574879,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27528,"kb_used_data":576,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":589824,"data_stored":255244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.63700000000000001,"15min":0.64200000000000002},"min":{"1min":0.41299999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.996,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.627,"5min":0.63300000000000001,"15min":0.63400000000000001},"min":{"1min":0.47199999999999998,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.873,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.73199999999999998}]},{"osd":1,"last update":"Fri Jul 14 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.67700000000000005,"15min":0.68200000000000005},"min":{"1min":0.47699999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.88800000000000001,"5min":1.343,"15min":1.343},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.46300000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.69099999999999995}]},{"osd":2,"last update":"Fri Jul 14 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.73599999999999999,"15min":0.74099999999999999},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.012,"5min":1.034,"15min":1.034},"last":0.625},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.76300000000000001,"15min":0.77300000000000002},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.88200000000000001,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.78600000000000003}]},{"osd":3,"last update":"Fri Jul 14 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.76300000000000001,"15min":0.77300000000000002},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.95499999999999996,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.76700000000000002,"15min":0.78700000000000003},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.89000000000000001,"5min":1.806,"15min":1.806},"last":0.64700000000000002}]},{"osd":4,"last update":"Fri Jul 14 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.65600000000000003,"15min":0.65900000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.0229999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.753,"15min":0.76600000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.89900000000000002}]},{"osd":6,"last update":"Fri Jul 14 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.747,"15min":0.75700000000000001},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.93600000000000005,"5min":1.03,"15min":1.03},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.745,"5min":0.80300000000000005,"15min":0.81299999999999994},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.048,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.82899999999999996}]},{"osd":7,"last update":"Fri Jul 14 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.83899999999999997,"15min":0.86099999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.95299999999999996,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.86599999999999999,"15min":0.88200000000000001},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":0.96699999999999997,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.88200000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T11:15:16.261 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-07-14T11:15:16.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.486+0000 7f5bc03ff700 1 Processor -- start 2023-07-14T11:15:16.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.486+0000 7f5bc03ff700 1 -- start start 2023-07-14T11:15:16.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.488+0000 7f5bc03ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5bb815c950 0x7f5bb80b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:16.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.488+0000 7f5bc03ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5bb80d1220 0x7f5bb80afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:16.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.488+0000 7f5bc03ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bb80d2ce0 con 0x7f5bb80b1e00 2023-07-14T11:15:16.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.488+0000 7f5bc03ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bb80b3350 con 0x7f5bb815c950 2023-07-14T11:15:16.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.488+0000 7f5bc03ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bb80b3630 con 0x7f5bb80d1220 2023-07-14T11:15:16.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.488+0000 7f5bbe19b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5bb815c950 0x7f5bb80b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:16.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.488+0000 7f5bbe19b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5bb815c950 0x7f5bb80b43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38710/0 (socket says 172.21.15.84:38710) 2023-07-14T11:15:16.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.488+0000 7f5bbe19b700 1 -- 172.21.15.84:0/2188236886 learned_addr learned my addr 172.21.15.84:0/2188236886 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:16.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.488+0000 7f5bbe99c700 1 --2- 172.21.15.84:0/2188236886 >> v2:172.21.15.179:3300/0 conn(0x7f5bb80d1220 0x7f5bb80afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:16.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.488+0000 7f5bbe19b700 1 -- 172.21.15.84:0/2188236886 >> v2:172.21.15.179:3300/0 conn(0x7f5bb80d1220 msgr2=0x7f5bb80afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:16.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.488+0000 7f5bbe19b700 1 --2- 172.21.15.84:0/2188236886 >> v2:172.21.15.179:3300/0 conn(0x7f5bb80d1220 0x7f5bb80afac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:16.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.488+0000 7f5bbe19b700 1 -- 172.21.15.84:0/2188236886 >> v1:172.21.15.179:6789/0 conn(0x7f5bb80b1e00 legacy=0x7f5bb80d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:16.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.488+0000 7f5bbe19b700 1 -- 172.21.15.84:0/2188236886 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bb80b3910 con 0x7f5bb815c950 2023-07-14T11:15:16.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.489+0000 7f5bbe19b700 1 --2- 172.21.15.84:0/2188236886 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bb815c950 0x7f5bb80b43f0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f5bb809c8e0 tx=0x7f5bb4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b086101fa10389dd server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:16.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.489+0000 7f5bbd199700 1 -- 172.21.15.84:0/2188236886 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb4005e30 con 0x7f5bb815c950 2023-07-14T11:15:16.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.489+0000 7f5bbd199700 1 -- 172.21.15.84:0/2188236886 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bb4004030 con 0x7f5bb815c950 2023-07-14T11:15:16.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.489+0000 7f5bbd199700 1 -- 172.21.15.84:0/2188236886 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb40043e0 con 0x7f5bb815c950 2023-07-14T11:15:16.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.489+0000 7f5bc03ff700 1 -- 172.21.15.84:0/2188236886 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bb815c950 msgr2=0x7f5bb80b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:16.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.489+0000 7f5bc03ff700 1 --2- 172.21.15.84:0/2188236886 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bb815c950 0x7f5bb80b43f0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f5bb809c8e0 tx=0x7f5bb4009bd0 comp rx=0 tx=0).stop 2023-07-14T11:15:16.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.490+0000 7f5bc03ff700 1 -- 172.21.15.84:0/2188236886 shutdown_connections 2023-07-14T11:15:16.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.490+0000 7f5bc03ff700 1 --2- 172.21.15.84:0/2188236886 >> v2:172.21.15.179:3300/0 conn(0x7f5bb80d1220 0x7f5bb80afac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:16.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.490+0000 7f5bc03ff700 1 --2- 172.21.15.84:0/2188236886 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bb815c950 0x7f5bb80b43f0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:16.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.490+0000 7f5bc03ff700 1 -- 172.21.15.84:0/2188236886 >> 172.21.15.84:0/2188236886 conn(0x7f5bb809c1d0 msgr2=0x7f5bb80d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:16.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.490+0000 7f5bc03ff700 1 -- 172.21.15.84:0/2188236886 shutdown_connections 2023-07-14T11:15:16.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.490+0000 7f5bc03ff700 1 -- 172.21.15.84:0/2188236886 wait complete. 2023-07-14T11:15:16.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.491+0000 7f5bc03ff700 1 Processor -- start 2023-07-14T11:15:16.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.491+0000 7f5bc03ff700 1 -- start start 2023-07-14T11:15:16.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.492+0000 7f5bc03ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5bb80b1e00 0x7f5bb80c8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:16.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.492+0000 7f5bc03ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bb80d1220 0x7f5bb81516e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:16.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.492+0000 7f5bc03ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bb815c950 0x7f5bb81f5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:16.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.492+0000 7f5bc03ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb80c9500 con 0x7f5bb80d1220 2023-07-14T11:15:16.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.492+0000 7f5bc03ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb8151c20 con 0x7f5bb80b1e00 2023-07-14T11:15:16.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.492+0000 7f5bc03ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb80c7f20 con 0x7f5bb815c950 2023-07-14T11:15:16.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.493+0000 7f5bbd99a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bb80d1220 0x7f5bb81516e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:16.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.493+0000 7f5bbd99a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bb80d1220 0x7f5bb81516e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38724/0 (socket says 172.21.15.84:38724) 2023-07-14T11:15:16.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.493+0000 7f5bbd99a700 1 -- 172.21.15.84:0/3644684055 learned_addr learned my addr 172.21.15.84:0/3644684055 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:16.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.493+0000 7f5bbe19b700 1 --2- 172.21.15.84:0/3644684055 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5bb80b1e00 0x7f5bb80c8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:16.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.493+0000 7f5bbe99c700 1 --2- 172.21.15.84:0/3644684055 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bb815c950 0x7f5bb81f5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:16.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.493+0000 7f5bbd99a700 1 -- 172.21.15.84:0/3644684055 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bb815c950 msgr2=0x7f5bb81f5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:16.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.493+0000 7f5bbd99a700 1 --2- 172.21.15.84:0/3644684055 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bb815c950 0x7f5bb81f5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:16.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.493+0000 7f5bbd99a700 1 -- 172.21.15.84:0/3644684055 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5bb80b1e00 msgr2=0x7f5bb80c8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:16.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.493+0000 7f5bbd99a700 1 --2- 172.21.15.84:0/3644684055 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5bb80b1e00 0x7f5bb80c8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:16.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.493+0000 7f5bbd99a700 1 -- 172.21.15.84:0/3644684055 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bb4009500 con 0x7f5bb80d1220 2023-07-14T11:15:16.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.493+0000 7f5bbe99c700 1 --2- 172.21.15.84:0/3644684055 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bb815c950 0x7f5bb81f5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:15:16.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.493+0000 7f5bbd99a700 1 --2- 172.21.15.84:0/3644684055 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bb80d1220 0x7f5bb81516e0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f5ba800c4e0 tx=0x7f5ba800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:16.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.494+0000 7f5baeffd700 1 -- 172.21.15.84:0/3644684055 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba80052d0 con 0x7f5bb80d1220 2023-07-14T11:15:16.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.494+0000 7f5baeffd700 1 -- 172.21.15.84:0/3644684055 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ba8005430 con 0x7f5bb80d1220 2023-07-14T11:15:16.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.494+0000 7f5bc03ff700 1 -- 172.21.15.84:0/3644684055 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bb80c8200 con 0x7f5bb80d1220 2023-07-14T11:15:16.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.494+0000 7f5baeffd700 1 -- 172.21.15.84:0/3644684055 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba80038c0 con 0x7f5bb80d1220 2023-07-14T11:15:16.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.494+0000 7f5bc03ff700 1 -- 172.21.15.84:0/3644684055 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bb80c87c0 con 0x7f5bb80d1220 2023-07-14T11:15:16.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.495+0000 7f5bc03ff700 1 -- 172.21.15.84:0/3644684055 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bb804e280 con 0x7f5bb80d1220 2023-07-14T11:15:16.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.496+0000 7f5baeffd700 1 -- 172.21.15.84:0/3644684055 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 7) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f5ba8003a20 con 0x7f5bb80d1220 2023-07-14T11:15:16.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.496+0000 7f5baeffd700 1 --2- 172.21.15.84:0/3644684055 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f5b9c06ae90 0x7f5b9c06d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:16.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.497+0000 7f5baeffd700 1 -- 172.21.15.84:0/3644684055 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5ba8088d60 con 0x7f5bb80d1220 2023-07-14T11:15:16.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.497+0000 7f5bbe19b700 1 --2- 172.21.15.84:0/3644684055 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f5b9c06ae90 0x7f5b9c06d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:16.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.497+0000 7f5bbe19b700 1 --2- 172.21.15.84:0/3644684055 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f5b9c06ae90 0x7f5b9c06d340 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5bb809c8e0 tx=0x7f5bb4008070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:16.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.501+0000 7f5baeffd700 1 -- 172.21.15.84:0/3644684055 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f5ba8053af0 con 0x7f5bb80d1220 2023-07-14T11:15:16.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.774+0000 7f5bc03ff700 1 -- 172.21.15.84:0/3644684055 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f5bb808c5a0 con 0x7f5bb80d1220 2023-07-14T11:15:16.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.774+0000 7f5baeffd700 1 -- 172.21.15.84:0/3644684055 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1034 (secure 0 0 0) 0x7f5ba8057110 con 0x7f5bb80d1220 2023-07-14T11:15:16.778 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:15:16.778 INFO:teuthology.orchestra.run.smithi084.stdout:{"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":149,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":50,"num_osds":8,"num_up_osds":8,"osd_up_since":1689333179,"num_in_osds":8,"osd_in_since":1689333170,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":41}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":226451456,"bytes_avail":772867661824,"bytes_total":773094113280,"inactive_pgs_ratio":0.60952383279800415},"fsmap":{"epoch":27,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"c","status":"up:active","gid":5625}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2023-07-14T11:14:14.084810+0000","services":{}},"progress_events":{}} 2023-07-14T11:15:16.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.777+0000 7f5bc03ff700 1 -- 172.21.15.84:0/3644684055 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f5b9c06ae90 msgr2=0x7f5b9c06d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:16.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.777+0000 7f5bc03ff700 1 --2- 172.21.15.84:0/3644684055 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f5b9c06ae90 0x7f5b9c06d340 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5bb809c8e0 tx=0x7f5bb4008070 comp rx=0 tx=0).stop 2023-07-14T11:15:16.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.777+0000 7f5bc03ff700 1 -- 172.21.15.84:0/3644684055 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bb80d1220 msgr2=0x7f5bb81516e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:16.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.777+0000 7f5bc03ff700 1 --2- 172.21.15.84:0/3644684055 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bb80d1220 0x7f5bb81516e0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f5ba800c4e0 tx=0x7f5ba800c8a0 comp rx=0 tx=0).stop 2023-07-14T11:15:16.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.777+0000 7f5bc03ff700 1 -- 172.21.15.84:0/3644684055 shutdown_connections 2023-07-14T11:15:16.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.777+0000 7f5bc03ff700 1 --2- 172.21.15.84:0/3644684055 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f5b9c06ae90 0x7f5b9c06d340 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:16.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.777+0000 7f5bc03ff700 1 --2- 172.21.15.84:0/3644684055 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bb815c950 0x7f5bb81f5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:16.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.777+0000 7f5bc03ff700 1 --2- 172.21.15.84:0/3644684055 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5bb80b1e00 0x7f5bb80c8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:16.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.777+0000 7f5bc03ff700 1 --2- 172.21.15.84:0/3644684055 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bb80d1220 0x7f5bb81516e0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:16.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.777+0000 7f5bc03ff700 1 -- 172.21.15.84:0/3644684055 >> 172.21.15.84:0/3644684055 conn(0x7f5bb809c1d0 msgr2=0x7f5bb80afac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:16.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.777+0000 7f5bc03ff700 1 -- 172.21.15.84:0/3644684055 shutdown_connections 2023-07-14T11:15:16.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.777+0000 7f5bc03ff700 1 -- 172.21.15.84:0/3644684055 wait complete. 2023-07-14T11:15:16.798 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-07-14T11:15:16.799 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T11:15:16.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.994+0000 7f0bff7ff700 1 Processor -- start 2023-07-14T11:15:16.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.994+0000 7f0bff7ff700 1 -- start start 2023-07-14T11:15:16.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.995+0000 7f0bff7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0bf815c950 0x7f0bf80b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:16.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.995+0000 7f0bff7ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0bf80b1e00 0x7f0bf80d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:16.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.995+0000 7f0bff7ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0bf80b2350 0x7f0bf80d1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:17.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.995+0000 7f0bff7ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bf80d2ce0 con 0x7f0bf80b1e00 2023-07-14T11:15:17.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.995+0000 7f0bff7ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bf80b3350 con 0x7f0bf80b2350 2023-07-14T11:15:17.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.995+0000 7f0bff7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf80b3630 con 0x7f0bf815c950 2023-07-14T11:15:17.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.995+0000 7f0bfcd9a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0bf80b1e00 0x7f0bf80d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:17.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.995+0000 7f0bfcd9a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0bf80b1e00 0x7f0bf80d0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38738/0 (socket says 172.21.15.84:38738) 2023-07-14T11:15:17.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.995+0000 7f0bfcd9a700 1 -- 172.21.15.84:0/12581741 learned_addr learned my addr 172.21.15.84:0/12581741 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:17.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.995+0000 7f0bfd59b700 1 --2- 172.21.15.84:0/12581741 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0bf815c950 0x7f0bf80b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:17.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.996+0000 7f0bfcd9a700 1 -- 172.21.15.84:0/12581741 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0bf815c950 msgr2=0x7f0bf80b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:17.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.996+0000 7f0bfcd9a700 1 --2- 172.21.15.84:0/12581741 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0bf815c950 0x7f0bf80b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:17.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.996+0000 7f0bfcd9a700 1 -- 172.21.15.84:0/12581741 >> v2:172.21.15.179:3300/0 conn(0x7f0bf80b2350 msgr2=0x7f0bf80d1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:17.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.996+0000 7f0bfcd9a700 1 --2- 172.21.15.84:0/12581741 >> v2:172.21.15.179:3300/0 conn(0x7f0bf80b2350 0x7f0bf80d1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:17.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.996+0000 7f0bfcd9a700 1 -- 172.21.15.84:0/12581741 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bf80b3910 con 0x7f0bf80b1e00 2023-07-14T11:15:17.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.996+0000 7f0bfd59b700 1 --2- 172.21.15.84:0/12581741 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0bf815c950 0x7f0bf80b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:15:17.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.996+0000 7f0bfcd9a700 1 --2- 172.21.15.84:0/12581741 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bf80b1e00 0x7f0bf80d0b10 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f0bf80b3280 tx=0x7f0be8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c161ae30e262825e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:17.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.996+0000 7f0beffff700 1 -- 172.21.15.84:0/12581741 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be800b870 con 0x7f0bf80b1e00 2023-07-14T11:15:17.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.996+0000 7f0beffff700 1 -- 172.21.15.84:0/12581741 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0be800b9d0 con 0x7f0bf80b1e00 2023-07-14T11:15:17.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.996+0000 7f0beffff700 1 -- 172.21.15.84:0/12581741 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be800bd60 con 0x7f0bf80b1e00 2023-07-14T11:15:17.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.997+0000 7f0bff7ff700 1 -- 172.21.15.84:0/12581741 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bf80b1e00 msgr2=0x7f0bf80d0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:17.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.997+0000 7f0bff7ff700 1 --2- 172.21.15.84:0/12581741 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bf80b1e00 0x7f0bf80d0b10 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f0bf80b3280 tx=0x7f0be8009bd0 comp rx=0 tx=0).stop 2023-07-14T11:15:17.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.997+0000 7f0bff7ff700 1 -- 172.21.15.84:0/12581741 shutdown_connections 2023-07-14T11:15:17.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.997+0000 7f0bff7ff700 1 --2- 172.21.15.84:0/12581741 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0bf815c950 0x7f0bf80b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:17.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.997+0000 7f0bff7ff700 1 --2- 172.21.15.84:0/12581741 >> v2:172.21.15.179:3300/0 conn(0x7f0bf80b2350 0x7f0bf80d1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:17.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.997+0000 7f0bff7ff700 1 --2- 172.21.15.84:0/12581741 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bf80b1e00 0x7f0bf80d0b10 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:17.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.997+0000 7f0bff7ff700 1 -- 172.21.15.84:0/12581741 >> 172.21.15.84:0/12581741 conn(0x7f0bf809c1d0 msgr2=0x7f0bf80d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:17.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.997+0000 7f0bff7ff700 1 -- 172.21.15.84:0/12581741 shutdown_connections 2023-07-14T11:15:17.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.997+0000 7f0bff7ff700 1 -- 172.21.15.84:0/12581741 wait complete. 2023-07-14T11:15:17.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:16.999+0000 7f0bff7ff700 1 Processor -- start 2023-07-14T11:15:17.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:17.000+0000 7f0bff7ff700 1 -- start start 2023-07-14T11:15:17.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:17.001+0000 7f0bff7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0bf80b1e00 0x7f0bf80c9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:17.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:17.001+0000 7f0bff7ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bf80b2350 0x7f0bf80b5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:17.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:17.001+0000 7f0bff7ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0bf815c950 0x7f0bf80b62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:17.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:17.001+0000 7f0bff7ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf80c9a90 con 0x7f0bf80b2350 2023-07-14T11:15:17.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:17.001+0000 7f0bff7ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf8156ac0 con 0x7f0bf815c950 2023-07-14T11:15:17.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:17.001+0000 7f0bff7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf81432c0 con 0x7f0bf80b1e00 2023-07-14T11:15:17.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:17.001+0000 7f0bfcd9a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bf80b2350 0x7f0bf80b5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:17.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:17.001+0000 7f0bfcd9a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bf80b2350 0x7f0bf80b5d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38752/0 (socket says 172.21.15.84:38752) 2023-07-14T11:15:17.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:17.001+0000 7f0bfcd9a700 1 -- 172.21.15.84:0/3664625312 learned_addr learned my addr 172.21.15.84:0/3664625312 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:17.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:17.001+0000 7f0bfcd9a700 1 -- 172.21.15.84:0/3664625312 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0bf80b1e00 msgr2=0x7f0bf80c9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:17.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:17.001+0000 7f0bfcd9a700 1 --2- 172.21.15.84:0/3664625312 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0bf80b1e00 0x7f0bf80c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:17.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:17.001+0000 7f0bfcd9a700 1 -- 172.21.15.84:0/3664625312 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0bf815c950 msgr2=0x7f0bf80b62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:17.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:17.001+0000 7f0bfcd9a700 1 --2- 172.21.15.84:0/3664625312 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0bf815c950 0x7f0bf80b62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:17.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:17.001+0000 7f0bfcd9a700 1 -- 172.21.15.84:0/3664625312 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0be8009550 con 0x7f0bf80b2350 2023-07-14T11:15:17.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:17.002+0000 7f0bfcd9a700 1 --2- 172.21.15.84:0/3664625312 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bf80b2350 0x7f0bf80b5d70 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f0be8000c00 tx=0x7f0be8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:17.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:17.002+0000 7f0bedffb700 1 -- 172.21.15.84:0/3664625312 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be8004540 con 0x7f0bf80b2350 2023-07-14T11:15:17.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:17.002+0000 7f0bedffb700 1 -- 172.21.15.84:0/3664625312 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0be80036a0 con 0x7f0bf80b2350 2023-07-14T11:15:17.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:17.002+0000 7f0bff7ff700 1 -- 172.21.15.84:0/3664625312 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bf80c97b0 con 0x7f0bf80b2350 2023-07-14T11:15:17.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:17.002+0000 7f0bedffb700 1 -- 172.21.15.84:0/3664625312 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be8003a50 con 0x7f0bf80b2350 2023-07-14T11:15:17.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:17.002+0000 7f0bff7ff700 1 -- 172.21.15.84:0/3664625312 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bf8143840 con 0x7f0bf80b2350 2023-07-14T11:15:17.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:17.003+0000 7f0bff7ff700 1 -- 172.21.15.84:0/3664625312 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bf8143120 con 0x7f0bf80b2350 2023-07-14T11:15:17.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:17.004+0000 7f0bedffb700 1 -- 172.21.15.84:0/3664625312 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 7) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f0be8021070 con 0x7f0bf80b2350 2023-07-14T11:15:17.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:17.005+0000 7f0bedffb700 1 --2- 172.21.15.84:0/3664625312 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f0bdc06ae90 0x7f0bdc06d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:17.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:17.005+0000 7f0bedffb700 1 -- 172.21.15.84:0/3664625312 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0be808aec0 con 0x7f0bf80b2350 2023-07-14T11:15:17.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:17.005+0000 7f0bfd59b700 1 --2- 172.21.15.84:0/3664625312 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f0bdc06ae90 0x7f0bdc06d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:17.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:17.006+0000 7f0bfd59b700 1 --2- 172.21.15.84:0/3664625312 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f0bdc06ae90 0x7f0bdc06d340 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f0bf4006f30 tx=0x7f0bf4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:17.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:17.009+0000 7f0bedffb700 1 -- 172.21.15.84:0/3664625312 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f0bf8143120 con 0x7f0bf80b2350 2023-07-14T11:15:17.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:17.201+0000 7f0bff7ff700 1 -- 172.21.15.84:0/3664625312 --> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0bf80b3ed0 con 0x7f0bdc06ae90 2023-07-14T11:15:17.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:17.209+0000 7f0bedffb700 1 -- 172.21.15.84:0/3664625312 <== mgr.4104 v2:172.21.15.84:6832/379617029 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310727 (secure 0 0 0) 0x7f0bf4004020 con 0x7f0bdc06ae90 2023-07-14T11:15:17.216 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:15:17.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:17.214+0000 7f0bff7ff700 1 -- 172.21.15.84:0/3664625312 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f0bdc06ae90 msgr2=0x7f0bdc06d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:17.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:17.214+0000 7f0bff7ff700 1 --2- 172.21.15.84:0/3664625312 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f0bdc06ae90 0x7f0bdc06d340 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f0bf4006f30 tx=0x7f0bf4008040 comp rx=0 tx=0).stop 2023-07-14T11:15:17.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:17.214+0000 7f0bff7ff700 1 -- 172.21.15.84:0/3664625312 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bf80b2350 msgr2=0x7f0bf80b5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:17.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:17.214+0000 7f0bff7ff700 1 --2- 172.21.15.84:0/3664625312 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bf80b2350 0x7f0bf80b5d70 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f0be8000c00 tx=0x7f0be8004750 comp rx=0 tx=0).stop 2023-07-14T11:15:17.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:17.214+0000 7f0bff7ff700 1 -- 172.21.15.84:0/3664625312 shutdown_connections 2023-07-14T11:15:17.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:17.214+0000 7f0bff7ff700 1 --2- 172.21.15.84:0/3664625312 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f0bdc06ae90 0x7f0bdc06d340 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:17.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:17.214+0000 7f0bff7ff700 1 --2- 172.21.15.84:0/3664625312 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0bf80b1e00 0x7f0bf80c9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:17.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:17.214+0000 7f0bff7ff700 1 --2- 172.21.15.84:0/3664625312 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0bf815c950 0x7f0bf80b62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:17.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:17.214+0000 7f0bff7ff700 1 --2- 172.21.15.84:0/3664625312 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bf80b2350 0x7f0bf80b5d70 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:17.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:17.214+0000 7f0bff7ff700 1 -- 172.21.15.84:0/3664625312 >> 172.21.15.84:0/3664625312 conn(0x7f0bf809c1d0 msgr2=0x7f0bf806acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:17.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:17.214+0000 7f0bff7ff700 1 -- 172.21.15.84:0/3664625312 shutdown_connections 2023-07-14T11:15:17.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:17.214+0000 7f0bff7ff700 1 -- 172.21.15.84:0/3664625312 wait complete. 2023-07-14T11:15:17.220 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-07-14T11:15:17.236 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":111,"stamp":"2023-07-14T11:15:16.095912+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221448,"kb_used_data":5832,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754753272,"statfs":{"total":773094113280,"available":772867350528,"internally_reserved":0,"allocated":5971968,"data_stored":3227412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.189951"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.927707+0000","last_change":"2023-07-14T11:15:10.925504+0000","last_active":"2023-07-14T11:15:11.927707+0000","last_peered":"2023-07-14T11:15:11.927707+0000","last_clean":"2023-07-14T11:15:11.927707+0000","last_became_active":"2023-07-14T11:15:10.925160+0000","last_became_peered":"2023-07-14T11:15:10.925160+0000","last_unstale":"2023-07-14T11:15:11.927707+0000","last_undegraded":"2023-07-14T11:15:11.927707+0000","last_fullsized":"2023-07-14T11:15:11.927707+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:48:14.227600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.666667+0000","last_change":"2023-07-14T11:15:10.936371+0000","last_active":"2023-07-14T11:15:13.666667+0000","last_peered":"2023-07-14T11:15:13.666667+0000","last_clean":"2023-07-14T11:15:13.666667+0000","last_became_active":"2023-07-14T11:15:10.935272+0000","last_became_peered":"2023-07-14T11:15:10.935272+0000","last_unstale":"2023-07-14T11:15:13.666667+0000","last_undegraded":"2023-07-14T11:15:13.666667+0000","last_fullsized":"2023-07-14T11:15:13.666667+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:17:05.372857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.665165+0000","last_change":"2023-07-14T11:15:10.938106+0000","last_active":"2023-07-14T11:15:13.665165+0000","last_peered":"2023-07-14T11:15:13.665165+0000","last_clean":"2023-07-14T11:15:13.665165+0000","last_became_active":"2023-07-14T11:15:10.937834+0000","last_became_peered":"2023-07-14T11:15:10.937834+0000","last_unstale":"2023-07-14T11:15:13.665165+0000","last_undegraded":"2023-07-14T11:15:13.665165+0000","last_fullsized":"2023-07-14T11:15:13.665165+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:54:10.925414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.667304+0000","last_change":"2023-07-14T11:15:10.935147+0000","last_active":"2023-07-14T11:15:13.667304+0000","last_peered":"2023-07-14T11:15:13.667304+0000","last_clean":"2023-07-14T11:15:13.667304+0000","last_became_active":"2023-07-14T11:15:10.934803+0000","last_became_peered":"2023-07-14T11:15:10.934803+0000","last_unstale":"2023-07-14T11:15:13.667304+0000","last_undegraded":"2023-07-14T11:15:13.667304+0000","last_fullsized":"2023-07-14T11:15:13.667304+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:56:49.007278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.666188+0000","last_change":"2023-07-14T11:15:10.932878+0000","last_active":"2023-07-14T11:15:13.666188+0000","last_peered":"2023-07-14T11:15:13.666188+0000","last_clean":"2023-07-14T11:15:13.666188+0000","last_became_active":"2023-07-14T11:15:10.932518+0000","last_became_peered":"2023-07-14T11:15:10.932518+0000","last_unstale":"2023-07-14T11:15:13.666188+0000","last_undegraded":"2023-07-14T11:15:13.666188+0000","last_fullsized":"2023-07-14T11:15:13.666188+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:10:43.496513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.927643+0000","last_change":"2023-07-14T11:15:10.926174+0000","last_active":"2023-07-14T11:15:11.927643+0000","last_peered":"2023-07-14T11:15:11.927643+0000","last_clean":"2023-07-14T11:15:11.927643+0000","last_became_active":"2023-07-14T11:15:10.925547+0000","last_became_peered":"2023-07-14T11:15:10.925547+0000","last_unstale":"2023-07-14T11:15:11.927643+0000","last_undegraded":"2023-07-14T11:15:11.927643+0000","last_fullsized":"2023-07-14T11:15:11.927643+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:37:54.291474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.664823+0000","last_change":"2023-07-14T11:15:10.937611+0000","last_active":"2023-07-14T11:15:13.664823+0000","last_peered":"2023-07-14T11:15:13.664823+0000","last_clean":"2023-07-14T11:15:13.664823+0000","last_became_active":"2023-07-14T11:15:10.937160+0000","last_became_peered":"2023-07-14T11:15:10.937160+0000","last_unstale":"2023-07-14T11:15:13.664823+0000","last_undegraded":"2023-07-14T11:15:13.664823+0000","last_fullsized":"2023-07-14T11:15:13.664823+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:25:48.540396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.944129+0000","last_change":"2023-07-14T11:15:10.927643+0000","last_active":"2023-07-14T11:15:11.944129+0000","last_peered":"2023-07-14T11:15:11.944129+0000","last_clean":"2023-07-14T11:15:11.944129+0000","last_became_active":"2023-07-14T11:15:10.927241+0000","last_became_peered":"2023-07-14T11:15:10.927241+0000","last_unstale":"2023-07-14T11:15:11.944129+0000","last_undegraded":"2023-07-14T11:15:11.944129+0000","last_fullsized":"2023-07-14T11:15:11.944129+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:28:46.603191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.944553+0000","last_change":"2023-07-14T11:15:10.936870+0000","last_active":"2023-07-14T11:15:11.944553+0000","last_peered":"2023-07-14T11:15:11.944553+0000","last_clean":"2023-07-14T11:15:11.944553+0000","last_became_active":"2023-07-14T11:15:10.936566+0000","last_became_peered":"2023-07-14T11:15:10.936566+0000","last_unstale":"2023-07-14T11:15:11.944553+0000","last_undegraded":"2023-07-14T11:15:11.944553+0000","last_fullsized":"2023-07-14T11:15:11.944553+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:16:00.524727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.927138+0000","last_change":"2023-07-14T11:15:10.924846+0000","last_active":"2023-07-14T11:15:11.927138+0000","last_peered":"2023-07-14T11:15:11.927138+0000","last_clean":"2023-07-14T11:15:11.927138+0000","last_became_active":"2023-07-14T11:15:10.924029+0000","last_became_peered":"2023-07-14T11:15:10.924029+0000","last_unstale":"2023-07-14T11:15:11.927138+0000","last_undegraded":"2023-07-14T11:15:11.927138+0000","last_fullsized":"2023-07-14T11:15:11.927138+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:41:35.008325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.927089+0000","last_change":"2023-07-14T11:15:10.932542+0000","last_active":"2023-07-14T11:15:11.927089+0000","last_peered":"2023-07-14T11:15:11.927089+0000","last_clean":"2023-07-14T11:15:11.927089+0000","last_became_active":"2023-07-14T11:15:10.932316+0000","last_became_peered":"2023-07-14T11:15:10.932316+0000","last_unstale":"2023-07-14T11:15:11.927089+0000","last_undegraded":"2023-07-14T11:15:11.927089+0000","last_fullsized":"2023-07-14T11:15:11.927089+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:24:53.735137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.944435+0000","last_change":"2023-07-14T11:15:10.935681+0000","last_active":"2023-07-14T11:15:11.944435+0000","last_peered":"2023-07-14T11:15:11.944435+0000","last_clean":"2023-07-14T11:15:11.944435+0000","last_became_active":"2023-07-14T11:15:10.935397+0000","last_became_peered":"2023-07-14T11:15:10.935397+0000","last_unstale":"2023-07-14T11:15:11.944435+0000","last_undegraded":"2023-07-14T11:15:11.944435+0000","last_fullsized":"2023-07-14T11:15:11.944435+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:45:28.290761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.927095+0000","last_change":"2023-07-14T11:15:10.929436+0000","last_active":"2023-07-14T11:15:11.927095+0000","last_peered":"2023-07-14T11:15:11.927095+0000","last_clean":"2023-07-14T11:15:11.927095+0000","last_became_active":"2023-07-14T11:15:10.929186+0000","last_became_peered":"2023-07-14T11:15:10.929186+0000","last_unstale":"2023-07-14T11:15:11.927095+0000","last_undegraded":"2023-07-14T11:15:11.927095+0000","last_fullsized":"2023-07-14T11:15:11.927095+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:10:03.003309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.665032+0000","last_change":"2023-07-14T11:15:10.936569+0000","last_active":"2023-07-14T11:15:13.665032+0000","last_peered":"2023-07-14T11:15:13.665032+0000","last_clean":"2023-07-14T11:15:13.665032+0000","last_became_active":"2023-07-14T11:15:10.936102+0000","last_became_peered":"2023-07-14T11:15:10.936102+0000","last_unstale":"2023-07-14T11:15:13.665032+0000","last_undegraded":"2023-07-14T11:15:13.665032+0000","last_fullsized":"2023-07-14T11:15:13.665032+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:26:01.745154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.666362+0000","last_change":"2023-07-14T11:15:10.936259+0000","last_active":"2023-07-14T11:15:13.666362+0000","last_peered":"2023-07-14T11:15:13.666362+0000","last_clean":"2023-07-14T11:15:13.666362+0000","last_became_active":"2023-07-14T11:15:10.935778+0000","last_became_peered":"2023-07-14T11:15:10.935778+0000","last_unstale":"2023-07-14T11:15:13.666362+0000","last_undegraded":"2023-07-14T11:15:13.666362+0000","last_fullsized":"2023-07-14T11:15:13.666362+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:07:47.346468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.926657+0000","last_change":"2023-07-14T11:15:10.928890+0000","last_active":"2023-07-14T11:15:11.926657+0000","last_peered":"2023-07-14T11:15:11.926657+0000","last_clean":"2023-07-14T11:15:11.926657+0000","last_became_active":"2023-07-14T11:15:10.926333+0000","last_became_peered":"2023-07-14T11:15:10.926333+0000","last_unstale":"2023-07-14T11:15:11.926657+0000","last_undegraded":"2023-07-14T11:15:11.926657+0000","last_fullsized":"2023-07-14T11:15:11.926657+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:46:02.473727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.665534+0000","last_change":"2023-07-14T11:15:10.931739+0000","last_active":"2023-07-14T11:15:13.665534+0000","last_peered":"2023-07-14T11:15:13.665534+0000","last_clean":"2023-07-14T11:15:13.665534+0000","last_became_active":"2023-07-14T11:15:10.931180+0000","last_became_peered":"2023-07-14T11:15:10.931180+0000","last_unstale":"2023-07-14T11:15:13.665534+0000","last_undegraded":"2023-07-14T11:15:13.665534+0000","last_fullsized":"2023-07-14T11:15:13.665534+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:11:25.961330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.666839+0000","last_change":"2023-07-14T11:15:10.935893+0000","last_active":"2023-07-14T11:15:13.666839+0000","last_peered":"2023-07-14T11:15:13.666839+0000","last_clean":"2023-07-14T11:15:13.666839+0000","last_became_active":"2023-07-14T11:15:10.935473+0000","last_became_peered":"2023-07-14T11:15:10.935473+0000","last_unstale":"2023-07-14T11:15:13.666839+0000","last_undegraded":"2023-07-14T11:15:13.666839+0000","last_fullsized":"2023-07-14T11:15:13.666839+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:47:26.675759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.665286+0000","last_change":"2023-07-14T11:15:10.924017+0000","last_active":"2023-07-14T11:15:13.665286+0000","last_peered":"2023-07-14T11:15:13.665286+0000","last_clean":"2023-07-14T11:15:13.665286+0000","last_became_active":"2023-07-14T11:15:10.923751+0000","last_became_peered":"2023-07-14T11:15:10.923751+0000","last_unstale":"2023-07-14T11:15:13.665286+0000","last_undegraded":"2023-07-14T11:15:13.665286+0000","last_fullsized":"2023-07-14T11:15:13.665286+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:32:32.157604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.666317+0000","last_change":"2023-07-14T11:15:10.928004+0000","last_active":"2023-07-14T11:15:13.666317+0000","last_peered":"2023-07-14T11:15:13.666317+0000","last_clean":"2023-07-14T11:15:13.666317+0000","last_became_active":"2023-07-14T11:15:10.927727+0000","last_became_peered":"2023-07-14T11:15:10.927727+0000","last_unstale":"2023-07-14T11:15:13.666317+0000","last_undegraded":"2023-07-14T11:15:13.666317+0000","last_fullsized":"2023-07-14T11:15:13.666317+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:56:43.748275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.666137+0000","last_change":"2023-07-14T11:15:10.935381+0000","last_active":"2023-07-14T11:15:13.666137+0000","last_peered":"2023-07-14T11:15:13.666137+0000","last_clean":"2023-07-14T11:15:13.666137+0000","last_became_active":"2023-07-14T11:15:10.935042+0000","last_became_peered":"2023-07-14T11:15:10.935042+0000","last_unstale":"2023-07-14T11:15:13.666137+0000","last_undegraded":"2023-07-14T11:15:13.666137+0000","last_fullsized":"2023-07-14T11:15:13.666137+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:28:43.676308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.944097+0000","last_change":"2023-07-14T11:15:10.926865+0000","last_active":"2023-07-14T11:15:11.944097+0000","last_peered":"2023-07-14T11:15:11.944097+0000","last_clean":"2023-07-14T11:15:11.944097+0000","last_became_active":"2023-07-14T11:15:10.926563+0000","last_became_peered":"2023-07-14T11:15:10.926563+0000","last_unstale":"2023-07-14T11:15:11.944097+0000","last_undegraded":"2023-07-14T11:15:11.944097+0000","last_fullsized":"2023-07-14T11:15:11.944097+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:26:01.745154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.926854+0000","last_change":"2023-07-14T11:15:10.940410+0000","last_active":"2023-07-14T11:15:11.926854+0000","last_peered":"2023-07-14T11:15:11.926854+0000","last_clean":"2023-07-14T11:15:11.926854+0000","last_became_active":"2023-07-14T11:15:10.939991+0000","last_became_peered":"2023-07-14T11:15:10.939991+0000","last_unstale":"2023-07-14T11:15:11.926854+0000","last_undegraded":"2023-07-14T11:15:11.926854+0000","last_fullsized":"2023-07-14T11:15:11.926854+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:17:22.544441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.664823+0000","last_change":"2023-07-14T11:15:10.936569+0000","last_active":"2023-07-14T11:15:13.664823+0000","last_peered":"2023-07-14T11:15:13.664823+0000","last_clean":"2023-07-14T11:15:13.664823+0000","last_became_active":"2023-07-14T11:15:10.936136+0000","last_became_peered":"2023-07-14T11:15:10.936136+0000","last_unstale":"2023-07-14T11:15:13.664823+0000","last_undegraded":"2023-07-14T11:15:13.664823+0000","last_fullsized":"2023-07-14T11:15:13.664823+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:18:41.889981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.665506+0000","last_change":"2023-07-14T11:15:10.935674+0000","last_active":"2023-07-14T11:15:13.665506+0000","last_peered":"2023-07-14T11:15:13.665506+0000","last_clean":"2023-07-14T11:15:13.665506+0000","last_became_active":"2023-07-14T11:15:10.935407+0000","last_became_peered":"2023-07-14T11:15:10.935407+0000","last_unstale":"2023-07-14T11:15:13.665506+0000","last_undegraded":"2023-07-14T11:15:13.665506+0000","last_fullsized":"2023-07-14T11:15:13.665506+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:46:16.791323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.944593+0000","last_change":"2023-07-14T11:15:10.934694+0000","last_active":"2023-07-14T11:15:11.944593+0000","last_peered":"2023-07-14T11:15:11.944593+0000","last_clean":"2023-07-14T11:15:11.944593+0000","last_became_active":"2023-07-14T11:15:10.934086+0000","last_became_peered":"2023-07-14T11:15:10.934086+0000","last_unstale":"2023-07-14T11:15:11.944593+0000","last_undegraded":"2023-07-14T11:15:11.944593+0000","last_fullsized":"2023-07-14T11:15:11.944593+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:41:35.008325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.928102+0000","last_change":"2023-07-14T11:15:10.921991+0000","last_active":"2023-07-14T11:15:11.928102+0000","last_peered":"2023-07-14T11:15:11.928102+0000","last_clean":"2023-07-14T11:15:11.928102+0000","last_became_active":"2023-07-14T11:15:10.921684+0000","last_became_peered":"2023-07-14T11:15:10.921684+0000","last_unstale":"2023-07-14T11:15:11.928102+0000","last_undegraded":"2023-07-14T11:15:11.928102+0000","last_fullsized":"2023-07-14T11:15:11.928102+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:51:46.220783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.666981+0000","last_change":"2023-07-14T11:15:10.927989+0000","last_active":"2023-07-14T11:15:13.666981+0000","last_peered":"2023-07-14T11:15:13.666981+0000","last_clean":"2023-07-14T11:15:13.666981+0000","last_became_active":"2023-07-14T11:15:10.927707+0000","last_became_peered":"2023-07-14T11:15:10.927707+0000","last_unstale":"2023-07-14T11:15:13.666981+0000","last_undegraded":"2023-07-14T11:15:13.666981+0000","last_fullsized":"2023-07-14T11:15:13.666981+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:09:12.631700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.664924+0000","last_change":"2023-07-14T11:15:10.939352+0000","last_active":"2023-07-14T11:15:13.664924+0000","last_peered":"2023-07-14T11:15:13.664924+0000","last_clean":"2023-07-14T11:15:13.664924+0000","last_became_active":"2023-07-14T11:15:10.939071+0000","last_became_peered":"2023-07-14T11:15:10.939071+0000","last_unstale":"2023-07-14T11:15:13.664924+0000","last_undegraded":"2023-07-14T11:15:13.664924+0000","last_fullsized":"2023-07-14T11:15:13.664924+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:47:51.599162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.665837+0000","last_change":"2023-07-14T11:15:10.924682+0000","last_active":"2023-07-14T11:15:13.665837+0000","last_peered":"2023-07-14T11:15:13.665837+0000","last_clean":"2023-07-14T11:15:13.665837+0000","last_became_active":"2023-07-14T11:15:10.924373+0000","last_became_peered":"2023-07-14T11:15:10.924373+0000","last_unstale":"2023-07-14T11:15:13.665837+0000","last_undegraded":"2023-07-14T11:15:13.665837+0000","last_fullsized":"2023-07-14T11:15:13.665837+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:24:04.548674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.664982+0000","last_change":"2023-07-14T11:15:10.937395+0000","last_active":"2023-07-14T11:15:13.664982+0000","last_peered":"2023-07-14T11:15:13.664982+0000","last_clean":"2023-07-14T11:15:13.664982+0000","last_became_active":"2023-07-14T11:15:10.936861+0000","last_became_peered":"2023-07-14T11:15:10.936861+0000","last_unstale":"2023-07-14T11:15:13.664982+0000","last_undegraded":"2023-07-14T11:15:13.664982+0000","last_fullsized":"2023-07-14T11:15:13.664982+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:10:43.496513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.928071+0000","last_change":"2023-07-14T11:15:10.930495+0000","last_active":"2023-07-14T11:15:11.928071+0000","last_peered":"2023-07-14T11:15:11.928071+0000","last_clean":"2023-07-14T11:15:11.928071+0000","last_became_active":"2023-07-14T11:15:10.930128+0000","last_became_peered":"2023-07-14T11:15:10.930128+0000","last_unstale":"2023-07-14T11:15:11.928071+0000","last_undegraded":"2023-07-14T11:15:11.928071+0000","last_fullsized":"2023-07-14T11:15:11.928071+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:34:19.424675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.666593+0000","last_change":"2023-07-14T11:15:10.936543+0000","last_active":"2023-07-14T11:15:13.666593+0000","last_peered":"2023-07-14T11:15:13.666593+0000","last_clean":"2023-07-14T11:15:13.666593+0000","last_became_active":"2023-07-14T11:15:10.936237+0000","last_became_peered":"2023-07-14T11:15:10.936237+0000","last_unstale":"2023-07-14T11:15:13.666593+0000","last_undegraded":"2023-07-14T11:15:13.666593+0000","last_fullsized":"2023-07-14T11:15:13.666593+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:23:00.512302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"49'4","reported_seq":17,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.666777+0000","last_change":"2023-07-14T11:15:09.929802+0000","last_active":"2023-07-14T11:15:13.666777+0000","last_peered":"2023-07-14T11:15:13.666777+0000","last_clean":"2023-07-14T11:15:13.666777+0000","last_became_active":"2023-07-14T11:15:09.929501+0000","last_became_peered":"2023-07-14T11:15:09.929501+0000","last_unstale":"2023-07-14T11:15:13.666777+0000","last_undegraded":"2023-07-14T11:15:13.666777+0000","last_fullsized":"2023-07-14T11:15:13.666777+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:36:26.856627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.927840+0000","last_change":"2023-07-14T11:15:10.937809+0000","last_active":"2023-07-14T11:15:11.927840+0000","last_peered":"2023-07-14T11:15:11.927840+0000","last_clean":"2023-07-14T11:15:11.927840+0000","last_became_active":"2023-07-14T11:15:10.937523+0000","last_became_peered":"2023-07-14T11:15:10.937523+0000","last_unstale":"2023-07-14T11:15:11.927840+0000","last_undegraded":"2023-07-14T11:15:11.927840+0000","last_fullsized":"2023-07-14T11:15:11.927840+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:10:43.144347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"49'1","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.927301+0000","last_change":"2023-07-14T11:15:09.921655+0000","last_active":"2023-07-14T11:15:11.927301+0000","last_peered":"2023-07-14T11:15:11.927301+0000","last_clean":"2023-07-14T11:15:11.927301+0000","last_became_active":"2023-07-14T11:15:09.921392+0000","last_became_peered":"2023-07-14T11:15:09.921392+0000","last_unstale":"2023-07-14T11:15:11.927301+0000","last_undegraded":"2023-07-14T11:15:11.927301+0000","last_fullsized":"2023-07-14T11:15:11.927301+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:11:24.955167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.666453+0000","last_change":"2023-07-14T11:15:10.930673+0000","last_active":"2023-07-14T11:15:13.666453+0000","last_peered":"2023-07-14T11:15:13.666453+0000","last_clean":"2023-07-14T11:15:13.666453+0000","last_became_active":"2023-07-14T11:15:10.930404+0000","last_became_peered":"2023-07-14T11:15:10.930404+0000","last_unstale":"2023-07-14T11:15:13.666453+0000","last_undegraded":"2023-07-14T11:15:13.666453+0000","last_fullsized":"2023-07-14T11:15:13.666453+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:02:40.219407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"49'2","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.928081+0000","last_change":"2023-07-14T11:15:09.924119+0000","last_active":"2023-07-14T11:15:11.928081+0000","last_peered":"2023-07-14T11:15:11.928081+0000","last_clean":"2023-07-14T11:15:11.928081+0000","last_became_active":"2023-07-14T11:15:09.923816+0000","last_became_peered":"2023-07-14T11:15:09.923816+0000","last_unstale":"2023-07-14T11:15:11.928081+0000","last_undegraded":"2023-07-14T11:15:11.928081+0000","last_fullsized":"2023-07-14T11:15:11.928081+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:49:37.407502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.944206+0000","last_change":"2023-07-14T11:15:10.928459+0000","last_active":"2023-07-14T11:15:11.944206+0000","last_peered":"2023-07-14T11:15:11.944206+0000","last_clean":"2023-07-14T11:15:11.944206+0000","last_became_active":"2023-07-14T11:15:10.926974+0000","last_became_peered":"2023-07-14T11:15:10.926974+0000","last_unstale":"2023-07-14T11:15:11.944206+0000","last_undegraded":"2023-07-14T11:15:11.944206+0000","last_fullsized":"2023-07-14T11:15:11.944206+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:54:10.925414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"49'2","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.928070+0000","last_change":"2023-07-14T11:15:09.922230+0000","last_active":"2023-07-14T11:15:11.928070+0000","last_peered":"2023-07-14T11:15:11.928070+0000","last_clean":"2023-07-14T11:15:11.928070+0000","last_became_active":"2023-07-14T11:15:09.921945+0000","last_became_peered":"2023-07-14T11:15:09.921945+0000","last_unstale":"2023-07-14T11:15:11.928070+0000","last_undegraded":"2023-07-14T11:15:11.928070+0000","last_fullsized":"2023-07-14T11:15:11.928070+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:05:35.953604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.666444+0000","last_change":"2023-07-14T11:15:10.929453+0000","last_active":"2023-07-14T11:15:13.666444+0000","last_peered":"2023-07-14T11:15:13.666444+0000","last_clean":"2023-07-14T11:15:13.666444+0000","last_became_active":"2023-07-14T11:15:10.929189+0000","last_became_peered":"2023-07-14T11:15:10.929189+0000","last_unstale":"2023-07-14T11:15:13.666444+0000","last_undegraded":"2023-07-14T11:15:13.666444+0000","last_fullsized":"2023-07-14T11:15:13.666444+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:36:13.173272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"49'1","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.665006+0000","last_change":"2023-07-14T11:15:09.930314+0000","last_active":"2023-07-14T11:15:13.665006+0000","last_peered":"2023-07-14T11:15:13.665006+0000","last_clean":"2023-07-14T11:15:13.665006+0000","last_became_active":"2023-07-14T11:15:09.930070+0000","last_became_peered":"2023-07-14T11:15:09.930070+0000","last_unstale":"2023-07-14T11:15:13.665006+0000","last_undegraded":"2023-07-14T11:15:13.665006+0000","last_fullsized":"2023-07-14T11:15:13.665006+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:07:13.838418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.667346+0000","last_change":"2023-07-14T11:15:10.924358+0000","last_active":"2023-07-14T11:15:13.667346+0000","last_peered":"2023-07-14T11:15:13.667346+0000","last_clean":"2023-07-14T11:15:13.667346+0000","last_became_active":"2023-07-14T11:15:10.924097+0000","last_became_peered":"2023-07-14T11:15:10.924097+0000","last_unstale":"2023-07-14T11:15:13.667346+0000","last_undegraded":"2023-07-14T11:15:13.667346+0000","last_fullsized":"2023-07-14T11:15:13.667346+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:21:23.795838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"49'1","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.666017+0000","last_change":"2023-07-14T11:15:09.926046+0000","last_active":"2023-07-14T11:15:13.666017+0000","last_peered":"2023-07-14T11:15:13.666017+0000","last_clean":"2023-07-14T11:15:13.666017+0000","last_became_active":"2023-07-14T11:15:09.925750+0000","last_became_peered":"2023-07-14T11:15:09.925750+0000","last_unstale":"2023-07-14T11:15:13.666017+0000","last_undegraded":"2023-07-14T11:15:13.666017+0000","last_fullsized":"2023-07-14T11:15:13.666017+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:47:50.592999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.944540+0000","last_change":"2023-07-14T11:15:10.934890+0000","last_active":"2023-07-14T11:15:11.944540+0000","last_peered":"2023-07-14T11:15:11.944540+0000","last_clean":"2023-07-14T11:15:11.944540+0000","last_became_active":"2023-07-14T11:15:10.934420+0000","last_became_peered":"2023-07-14T11:15:10.934420+0000","last_unstale":"2023-07-14T11:15:11.944540+0000","last_undegraded":"2023-07-14T11:15:11.944540+0000","last_fullsized":"2023-07-14T11:15:11.944540+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:46:02.473727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.666964+0000","last_change":"2023-07-14T11:15:09.926115+0000","last_active":"2023-07-14T11:15:13.666964+0000","last_peered":"2023-07-14T11:15:13.666964+0000","last_clean":"2023-07-14T11:15:13.666964+0000","last_became_active":"2023-07-14T11:15:09.925816+0000","last_became_peered":"2023-07-14T11:15:09.925816+0000","last_unstale":"2023-07-14T11:15:13.666964+0000","last_undegraded":"2023-07-14T11:15:13.666964+0000","last_fullsized":"2023-07-14T11:15:13.666964+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:44:55.656851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.666893+0000","last_change":"2023-07-14T11:15:10.934416+0000","last_active":"2023-07-14T11:15:13.666893+0000","last_peered":"2023-07-14T11:15:13.666893+0000","last_clean":"2023-07-14T11:15:13.666893+0000","last_became_active":"2023-07-14T11:15:10.934095+0000","last_became_peered":"2023-07-14T11:15:10.934095+0000","last_unstale":"2023-07-14T11:15:13.666893+0000","last_undegraded":"2023-07-14T11:15:13.666893+0000","last_fullsized":"2023-07-14T11:15:13.666893+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:37:18.083208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.664874+0000","last_change":"2023-07-14T11:15:09.925165+0000","last_active":"2023-07-14T11:15:13.664874+0000","last_peered":"2023-07-14T11:15:13.664874+0000","last_clean":"2023-07-14T11:15:13.664874+0000","last_became_active":"2023-07-14T11:15:09.924894+0000","last_became_peered":"2023-07-14T11:15:09.924894+0000","last_unstale":"2023-07-14T11:15:13.664874+0000","last_undegraded":"2023-07-14T11:15:13.664874+0000","last_fullsized":"2023-07-14T11:15:13.664874+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:39:36.337375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.665744+0000","last_change":"2023-07-14T11:15:10.930528+0000","last_active":"2023-07-14T11:15:13.665744+0000","last_peered":"2023-07-14T11:15:13.665744+0000","last_clean":"2023-07-14T11:15:13.665744+0000","last_became_active":"2023-07-14T11:15:10.930201+0000","last_became_peered":"2023-07-14T11:15:10.930201+0000","last_unstale":"2023-07-14T11:15:13.665744+0000","last_undegraded":"2023-07-14T11:15:13.665744+0000","last_fullsized":"2023-07-14T11:15:13.665744+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:18:41.889981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.667044+0000","last_change":"2023-07-14T11:15:09.926330+0000","last_active":"2023-07-14T11:15:13.667044+0000","last_peered":"2023-07-14T11:15:13.667044+0000","last_clean":"2023-07-14T11:15:13.667044+0000","last_became_active":"2023-07-14T11:15:09.926039+0000","last_became_peered":"2023-07-14T11:15:09.926039+0000","last_unstale":"2023-07-14T11:15:13.667044+0000","last_undegraded":"2023-07-14T11:15:13.667044+0000","last_fullsized":"2023-07-14T11:15:13.667044+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:56:11.836559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.927806+0000","last_change":"2023-07-14T11:15:10.925307+0000","last_active":"2023-07-14T11:15:11.927806+0000","last_peered":"2023-07-14T11:15:11.927806+0000","last_clean":"2023-07-14T11:15:11.927806+0000","last_became_active":"2023-07-14T11:15:10.924966+0000","last_became_peered":"2023-07-14T11:15:10.924966+0000","last_unstale":"2023-07-14T11:15:11.927806+0000","last_undegraded":"2023-07-14T11:15:11.927806+0000","last_fullsized":"2023-07-14T11:15:11.927806+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:43:10.253612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.667102+0000","last_change":"2023-07-14T11:15:09.928164+0000","last_active":"2023-07-14T11:15:13.667102+0000","last_peered":"2023-07-14T11:15:13.667102+0000","last_clean":"2023-07-14T11:15:13.667102+0000","last_became_active":"2023-07-14T11:15:09.927872+0000","last_became_peered":"2023-07-14T11:15:09.927872+0000","last_unstale":"2023-07-14T11:15:13.667102+0000","last_undegraded":"2023-07-14T11:15:13.667102+0000","last_fullsized":"2023-07-14T11:15:13.667102+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:07:13.838418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.665181+0000","last_change":"2023-07-14T11:15:10.939301+0000","last_active":"2023-07-14T11:15:13.665181+0000","last_peered":"2023-07-14T11:15:13.665181+0000","last_clean":"2023-07-14T11:15:13.665181+0000","last_became_active":"2023-07-14T11:15:10.938975+0000","last_became_peered":"2023-07-14T11:15:10.938975+0000","last_unstale":"2023-07-14T11:15:13.665181+0000","last_undegraded":"2023-07-14T11:15:13.665181+0000","last_fullsized":"2023-07-14T11:15:13.665181+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:57:22.146216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"49'3","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.667452+0000","last_change":"2023-07-14T11:15:09.928283+0000","last_active":"2023-07-14T11:15:13.667452+0000","last_peered":"2023-07-14T11:15:13.667452+0000","last_clean":"2023-07-14T11:15:13.667452+0000","last_became_active":"2023-07-14T11:15:09.927756+0000","last_became_peered":"2023-07-14T11:15:09.927756+0000","last_unstale":"2023-07-14T11:15:13.667452+0000","last_undegraded":"2023-07-14T11:15:13.667452+0000","last_fullsized":"2023-07-14T11:15:13.667452+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:50:34.113216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.666219+0000","last_change":"2023-07-14T11:15:10.933062+0000","last_active":"2023-07-14T11:15:13.666219+0000","last_peered":"2023-07-14T11:15:13.666219+0000","last_clean":"2023-07-14T11:15:13.666219+0000","last_became_active":"2023-07-14T11:15:10.932772+0000","last_became_peered":"2023-07-14T11:15:10.932772+0000","last_unstale":"2023-07-14T11:15:13.666219+0000","last_undegraded":"2023-07-14T11:15:13.666219+0000","last_fullsized":"2023-07-14T11:15:13.666219+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:26:01.745154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"49'6","reported_seq":19,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.944543+0000","last_change":"2023-07-14T11:15:09.928525+0000","last_active":"2023-07-14T11:15:11.944543+0000","last_peered":"2023-07-14T11:15:11.944543+0000","last_clean":"2023-07-14T11:15:11.944543+0000","last_became_active":"2023-07-14T11:15:09.928270+0000","last_became_peered":"2023-07-14T11:15:09.928270+0000","last_unstale":"2023-07-14T11:15:11.944543+0000","last_undegraded":"2023-07-14T11:15:11.944543+0000","last_fullsized":"2023-07-14T11:15:11.944543+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:10:01.997146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.927844+0000","last_change":"2023-07-14T11:15:10.937191+0000","last_active":"2023-07-14T11:15:11.927844+0000","last_peered":"2023-07-14T11:15:11.927844+0000","last_clean":"2023-07-14T11:15:11.927844+0000","last_became_active":"2023-07-14T11:15:10.936849+0000","last_became_peered":"2023-07-14T11:15:10.936849+0000","last_unstale":"2023-07-14T11:15:11.927844+0000","last_undegraded":"2023-07-14T11:15:11.927844+0000","last_fullsized":"2023-07-14T11:15:11.927844+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:38:03.360143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"49'2","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.665085+0000","last_change":"2023-07-14T11:15:09.926581+0000","last_active":"2023-07-14T11:15:13.665085+0000","last_peered":"2023-07-14T11:15:13.665085+0000","last_clean":"2023-07-14T11:15:13.665085+0000","last_became_active":"2023-07-14T11:15:09.926305+0000","last_became_peered":"2023-07-14T11:15:09.926305+0000","last_unstale":"2023-07-14T11:15:13.665085+0000","last_undegraded":"2023-07-14T11:15:13.665085+0000","last_fullsized":"2023-07-14T11:15:13.665085+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:36:12.167108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.665327+0000","last_change":"2023-07-14T11:15:10.918903+0000","last_active":"2023-07-14T11:15:13.665327+0000","last_peered":"2023-07-14T11:15:13.665327+0000","last_clean":"2023-07-14T11:15:13.665327+0000","last_became_active":"2023-07-14T11:15:10.918595+0000","last_became_peered":"2023-07-14T11:15:10.918595+0000","last_unstale":"2023-07-14T11:15:13.665327+0000","last_undegraded":"2023-07-14T11:15:13.665327+0000","last_fullsized":"2023-07-14T11:15:13.665327+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:35:35.011670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.666593+0000","last_change":"2023-07-14T11:15:09.925179+0000","last_active":"2023-07-14T11:15:13.666593+0000","last_peered":"2023-07-14T11:15:13.666593+0000","last_clean":"2023-07-14T11:15:13.666593+0000","last_became_active":"2023-07-14T11:15:09.924920+0000","last_became_peered":"2023-07-14T11:15:09.924920+0000","last_unstale":"2023-07-14T11:15:13.666593+0000","last_undegraded":"2023-07-14T11:15:13.666593+0000","last_fullsized":"2023-07-14T11:15:13.666593+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:21:54.253623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.944459+0000","last_change":"2023-07-14T11:15:10.936810+0000","last_active":"2023-07-14T11:15:11.944459+0000","last_peered":"2023-07-14T11:15:11.944459+0000","last_clean":"2023-07-14T11:15:11.944459+0000","last_became_active":"2023-07-14T11:15:10.936529+0000","last_became_peered":"2023-07-14T11:15:10.936529+0000","last_unstale":"2023-07-14T11:15:11.944459+0000","last_undegraded":"2023-07-14T11:15:11.944459+0000","last_fullsized":"2023-07-14T11:15:11.944459+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:16:25.661287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.666497+0000","last_change":"2023-07-14T11:15:09.927381+0000","last_active":"2023-07-14T11:15:13.666497+0000","last_peered":"2023-07-14T11:15:13.666497+0000","last_clean":"2023-07-14T11:15:13.666497+0000","last_became_active":"2023-07-14T11:15:09.927064+0000","last_became_peered":"2023-07-14T11:15:09.927064+0000","last_unstale":"2023-07-14T11:15:13.666497+0000","last_undegraded":"2023-07-14T11:15:13.666497+0000","last_fullsized":"2023-07-14T11:15:13.666497+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:25:35.098442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.665450+0000","last_change":"2023-07-14T11:15:10.931492+0000","last_active":"2023-07-14T11:15:13.665450+0000","last_peered":"2023-07-14T11:15:13.665450+0000","last_clean":"2023-07-14T11:15:13.665450+0000","last_became_active":"2023-07-14T11:15:10.930836+0000","last_became_peered":"2023-07-14T11:15:10.930836+0000","last_unstale":"2023-07-14T11:15:13.665450+0000","last_undegraded":"2023-07-14T11:15:13.665450+0000","last_fullsized":"2023-07-14T11:15:13.665450+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:10:03.003309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"49'8","reported_seq":21,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.944348+0000","last_change":"2023-07-14T11:15:09.928241+0000","last_active":"2023-07-14T11:15:11.944348+0000","last_peered":"2023-07-14T11:15:11.944348+0000","last_clean":"2023-07-14T11:15:11.944348+0000","last_became_active":"2023-07-14T11:15:09.927889+0000","last_became_peered":"2023-07-14T11:15:09.927889+0000","last_unstale":"2023-07-14T11:15:11.944348+0000","last_undegraded":"2023-07-14T11:15:11.944348+0000","last_fullsized":"2023-07-14T11:15:11.944348+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:32:31.151441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.944141+0000","last_change":"2023-07-14T11:15:10.925504+0000","last_active":"2023-07-14T11:15:11.944141+0000","last_peered":"2023-07-14T11:15:11.944141+0000","last_clean":"2023-07-14T11:15:11.944141+0000","last_became_active":"2023-07-14T11:15:10.925239+0000","last_became_peered":"2023-07-14T11:15:10.925239+0000","last_unstale":"2023-07-14T11:15:11.944141+0000","last_undegraded":"2023-07-14T11:15:11.944141+0000","last_fullsized":"2023-07-14T11:15:11.944141+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:07:14.844582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"49'1","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.665400+0000","last_change":"2023-07-14T11:15:09.927305+0000","last_active":"2023-07-14T11:15:13.665400+0000","last_peered":"2023-07-14T11:15:13.665400+0000","last_clean":"2023-07-14T11:15:13.665400+0000","last_became_active":"2023-07-14T11:15:09.927040+0000","last_became_peered":"2023-07-14T11:15:09.927040+0000","last_unstale":"2023-07-14T11:15:13.665400+0000","last_undegraded":"2023-07-14T11:15:13.665400+0000","last_fullsized":"2023-07-14T11:15:13.665400+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:15:59.518564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.927332+0000","last_change":"2023-07-14T11:15:10.919741+0000","last_active":"2023-07-14T11:15:11.927332+0000","last_peered":"2023-07-14T11:15:11.927332+0000","last_clean":"2023-07-14T11:15:11.927332+0000","last_became_active":"2023-07-14T11:15:10.919457+0000","last_became_peered":"2023-07-14T11:15:10.919457+0000","last_unstale":"2023-07-14T11:15:11.927332+0000","last_undegraded":"2023-07-14T11:15:11.927332+0000","last_fullsized":"2023-07-14T11:15:11.927332+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:33:50.392750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"49'2","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.927593+0000","last_change":"2023-07-14T11:15:09.929235+0000","last_active":"2023-07-14T11:15:11.927593+0000","last_peered":"2023-07-14T11:15:11.927593+0000","last_clean":"2023-07-14T11:15:11.927593+0000","last_became_active":"2023-07-14T11:15:09.928960+0000","last_became_peered":"2023-07-14T11:15:09.928960+0000","last_unstale":"2023-07-14T11:15:11.927593+0000","last_undegraded":"2023-07-14T11:15:11.927593+0000","last_fullsized":"2023-07-14T11:15:11.927593+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:00:17.861115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.665936+0000","last_change":"2023-07-14T11:15:10.928899+0000","last_active":"2023-07-14T11:15:13.665936+0000","last_peered":"2023-07-14T11:15:13.665936+0000","last_clean":"2023-07-14T11:15:13.665936+0000","last_became_active":"2023-07-14T11:15:10.928567+0000","last_became_peered":"2023-07-14T11:15:10.928567+0000","last_unstale":"2023-07-14T11:15:13.665936+0000","last_undegraded":"2023-07-14T11:15:13.665936+0000","last_fullsized":"2023-07-14T11:15:13.665936+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:39:37.343538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"49'1","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.667166+0000","last_change":"2023-07-14T11:15:09.924426+0000","last_active":"2023-07-14T11:15:13.667166+0000","last_peered":"2023-07-14T11:15:13.667166+0000","last_clean":"2023-07-14T11:15:13.667166+0000","last_became_active":"2023-07-14T11:15:09.924111+0000","last_became_peered":"2023-07-14T11:15:09.924111+0000","last_unstale":"2023-07-14T11:15:13.667166+0000","last_undegraded":"2023-07-14T11:15:13.667166+0000","last_fullsized":"2023-07-14T11:15:13.667166+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:00:03.846732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.927363+0000","last_change":"2023-07-14T11:15:10.924665+0000","last_active":"2023-07-14T11:15:11.927363+0000","last_peered":"2023-07-14T11:15:11.927363+0000","last_clean":"2023-07-14T11:15:11.927363+0000","last_became_active":"2023-07-14T11:15:10.924404+0000","last_became_peered":"2023-07-14T11:15:10.924404+0000","last_unstale":"2023-07-14T11:15:11.927363+0000","last_undegraded":"2023-07-14T11:15:11.927363+0000","last_fullsized":"2023-07-14T11:15:11.927363+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:18:20.380084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.666564+0000","last_change":"2023-07-14T11:15:09.926848+0000","last_active":"2023-07-14T11:15:13.666564+0000","last_peered":"2023-07-14T11:15:13.666564+0000","last_clean":"2023-07-14T11:15:13.666564+0000","last_became_active":"2023-07-14T11:15:09.926521+0000","last_became_peered":"2023-07-14T11:15:09.926521+0000","last_unstale":"2023-07-14T11:15:13.666564+0000","last_undegraded":"2023-07-14T11:15:13.666564+0000","last_fullsized":"2023-07-14T11:15:13.666564+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:53:03.155971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.927854+0000","last_change":"2023-07-14T11:15:10.926591+0000","last_active":"2023-07-14T11:15:11.927854+0000","last_peered":"2023-07-14T11:15:11.927854+0000","last_clean":"2023-07-14T11:15:11.927854+0000","last_became_active":"2023-07-14T11:15:10.926265+0000","last_became_peered":"2023-07-14T11:15:10.926265+0000","last_unstale":"2023-07-14T11:15:11.927854+0000","last_undegraded":"2023-07-14T11:15:11.927854+0000","last_fullsized":"2023-07-14T11:15:11.927854+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:20:31.352270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"49'2","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.927222+0000","last_change":"2023-07-14T11:15:09.923168+0000","last_active":"2023-07-14T11:15:11.927222+0000","last_peered":"2023-07-14T11:15:11.927222+0000","last_clean":"2023-07-14T11:15:11.927222+0000","last_became_active":"2023-07-14T11:15:09.922855+0000","last_became_peered":"2023-07-14T11:15:09.922855+0000","last_unstale":"2023-07-14T11:15:11.927222+0000","last_undegraded":"2023-07-14T11:15:11.927222+0000","last_fullsized":"2023-07-14T11:15:11.927222+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:46:15.785160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.666946+0000","last_change":"2023-07-14T11:15:10.928049+0000","last_active":"2023-07-14T11:15:13.666946+0000","last_peered":"2023-07-14T11:15:13.666946+0000","last_clean":"2023-07-14T11:15:13.666946+0000","last_became_active":"2023-07-14T11:15:10.927790+0000","last_became_peered":"2023-07-14T11:15:10.927790+0000","last_unstale":"2023-07-14T11:15:13.666946+0000","last_undegraded":"2023-07-14T11:15:13.666946+0000","last_fullsized":"2023-07-14T11:15:13.666946+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:38:07.291071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.944089+0000","last_change":"2023-07-14T11:15:09.928441+0000","last_active":"2023-07-14T11:15:11.944089+0000","last_peered":"2023-07-14T11:15:11.944089+0000","last_clean":"2023-07-14T11:15:11.944089+0000","last_became_active":"2023-07-14T11:15:09.928121+0000","last_became_peered":"2023-07-14T11:15:09.928121+0000","last_unstale":"2023-07-14T11:15:11.944089+0000","last_undegraded":"2023-07-14T11:15:11.944089+0000","last_fullsized":"2023-07-14T11:15:11.944089+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:36:12.167108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.665351+0000","last_change":"2023-07-14T11:15:10.929419+0000","last_active":"2023-07-14T11:15:13.665351+0000","last_peered":"2023-07-14T11:15:13.665351+0000","last_clean":"2023-07-14T11:15:13.665351+0000","last_became_active":"2023-07-14T11:15:10.929112+0000","last_became_peered":"2023-07-14T11:15:10.929112+0000","last_unstale":"2023-07-14T11:15:13.665351+0000","last_undegraded":"2023-07-14T11:15:13.665351+0000","last_fullsized":"2023-07-14T11:15:13.665351+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:16:25.661287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.665432+0000","last_change":"2023-07-14T11:15:09.929803+0000","last_active":"2023-07-14T11:15:13.665432+0000","last_peered":"2023-07-14T11:15:13.665432+0000","last_clean":"2023-07-14T11:15:13.665432+0000","last_became_active":"2023-07-14T11:15:09.929513+0000","last_became_peered":"2023-07-14T11:15:09.929513+0000","last_unstale":"2023-07-14T11:15:13.665432+0000","last_undegraded":"2023-07-14T11:15:13.665432+0000","last_fullsized":"2023-07-14T11:15:13.665432+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:46:01.467563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.927848+0000","last_change":"2023-07-14T11:15:10.931167+0000","last_active":"2023-07-14T11:15:11.927848+0000","last_peered":"2023-07-14T11:15:11.927848+0000","last_clean":"2023-07-14T11:15:11.927848+0000","last_became_active":"2023-07-14T11:15:10.930862+0000","last_became_peered":"2023-07-14T11:15:10.930862+0000","last_unstale":"2023-07-14T11:15:11.927848+0000","last_undegraded":"2023-07-14T11:15:11.927848+0000","last_fullsized":"2023-07-14T11:15:11.927848+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:18:46.168855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.926705+0000","last_change":"2023-07-14T11:15:09.929305+0000","last_active":"2023-07-14T11:15:11.926705+0000","last_peered":"2023-07-14T11:15:11.926705+0000","last_clean":"2023-07-14T11:15:11.926705+0000","last_became_active":"2023-07-14T11:15:09.929031+0000","last_became_peered":"2023-07-14T11:15:09.929031+0000","last_unstale":"2023-07-14T11:15:11.926705+0000","last_undegraded":"2023-07-14T11:15:11.926705+0000","last_fullsized":"2023-07-14T11:15:11.926705+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:20:41.162108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.665158+0000","last_change":"2023-07-14T11:15:10.935840+0000","last_active":"2023-07-14T11:15:13.665158+0000","last_peered":"2023-07-14T11:15:13.665158+0000","last_clean":"2023-07-14T11:15:13.665158+0000","last_became_active":"2023-07-14T11:15:10.935573+0000","last_became_peered":"2023-07-14T11:15:10.935573+0000","last_unstale":"2023-07-14T11:15:13.665158+0000","last_undegraded":"2023-07-14T11:15:13.665158+0000","last_fullsized":"2023-07-14T11:15:13.665158+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:28:46.603191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.665838+0000","last_change":"2023-07-14T11:15:09.930870+0000","last_active":"2023-07-14T11:15:13.665838+0000","last_peered":"2023-07-14T11:15:13.665838+0000","last_clean":"2023-07-14T11:15:13.665838+0000","last_became_active":"2023-07-14T11:15:09.930528+0000","last_became_peered":"2023-07-14T11:15:09.930528+0000","last_unstale":"2023-07-14T11:15:13.665838+0000","last_undegraded":"2023-07-14T11:15:13.665838+0000","last_fullsized":"2023-07-14T11:15:13.665838+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:25:47.534232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":74,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.927566+0000","last_change":"2023-07-14T11:13:08.923786+0000","last_active":"2023-07-14T11:15:11.927566+0000","last_peered":"2023-07-14T11:15:11.927566+0000","last_clean":"2023-07-14T11:15:11.927566+0000","last_became_active":"2023-07-14T11:13:08.923384+0000","last_became_peered":"2023-07-14T11:13:08.923384+0000","last_unstale":"2023-07-14T11:15:11.927566+0000","last_undegraded":"2023-07-14T11:15:11.927566+0000","last_fullsized":"2023-07-14T11:15:11.927566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:05:37.474620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.927941+0000","last_change":"2023-07-14T11:15:10.928257+0000","last_active":"2023-07-14T11:15:11.927941+0000","last_peered":"2023-07-14T11:15:11.927941+0000","last_clean":"2023-07-14T11:15:11.927941+0000","last_became_active":"2023-07-14T11:15:10.927918+0000","last_became_peered":"2023-07-14T11:15:10.927918+0000","last_unstale":"2023-07-14T11:15:11.927941+0000","last_undegraded":"2023-07-14T11:15:11.927941+0000","last_fullsized":"2023-07-14T11:15:11.927941+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:46:56.463796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"49'2","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.667104+0000","last_change":"2023-07-14T11:15:09.928459+0000","last_active":"2023-07-14T11:15:13.667104+0000","last_peered":"2023-07-14T11:15:13.667104+0000","last_clean":"2023-07-14T11:15:13.667104+0000","last_became_active":"2023-07-14T11:15:09.928095+0000","last_became_peered":"2023-07-14T11:15:09.928095+0000","last_unstale":"2023-07-14T11:15:13.667104+0000","last_undegraded":"2023-07-14T11:15:13.667104+0000","last_fullsized":"2023-07-14T11:15:13.667104+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:44:18.599797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":70,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.927769+0000","last_change":"2023-07-14T11:13:08.758749+0000","last_active":"2023-07-14T11:15:11.927769+0000","last_peered":"2023-07-14T11:15:11.927769+0000","last_clean":"2023-07-14T11:15:11.927769+0000","last_became_active":"2023-07-14T11:13:08.757956+0000","last_became_peered":"2023-07-14T11:13:08.757956+0000","last_unstale":"2023-07-14T11:15:11.927769+0000","last_undegraded":"2023-07-14T11:15:11.927769+0000","last_fullsized":"2023-07-14T11:15:11.927769+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:39:52.335073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.944276+0000","last_change":"2023-07-14T11:15:10.928624+0000","last_active":"2023-07-14T11:15:11.944276+0000","last_peered":"2023-07-14T11:15:11.944276+0000","last_clean":"2023-07-14T11:15:11.944276+0000","last_became_active":"2023-07-14T11:15:10.928183+0000","last_became_peered":"2023-07-14T11:15:10.928183+0000","last_unstale":"2023-07-14T11:15:11.944276+0000","last_undegraded":"2023-07-14T11:15:11.944276+0000","last_fullsized":"2023-07-14T11:15:11.944276+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:46:07.655019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.665324+0000","last_change":"2023-07-14T11:15:09.931330+0000","last_active":"2023-07-14T11:15:13.665324+0000","last_peered":"2023-07-14T11:15:13.665324+0000","last_clean":"2023-07-14T11:15:13.665324+0000","last_became_active":"2023-07-14T11:15:09.931069+0000","last_became_peered":"2023-07-14T11:15:09.931069+0000","last_unstale":"2023-07-14T11:15:13.665324+0000","last_undegraded":"2023-07-14T11:15:13.665324+0000","last_fullsized":"2023-07-14T11:15:13.665324+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:45:27.284598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":74,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.927004+0000","last_change":"2023-07-14T11:13:08.862331+0000","last_active":"2023-07-14T11:15:11.927004+0000","last_peered":"2023-07-14T11:15:11.927004+0000","last_clean":"2023-07-14T11:15:11.927004+0000","last_became_active":"2023-07-14T11:13:08.861817+0000","last_became_peered":"2023-07-14T11:13:08.861817+0000","last_unstale":"2023-07-14T11:15:11.927004+0000","last_undegraded":"2023-07-14T11:15:11.927004+0000","last_fullsized":"2023-07-14T11:15:11.927004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:14:21.289970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.666793+0000","last_change":"2023-07-14T11:15:10.928480+0000","last_active":"2023-07-14T11:15:13.666793+0000","last_peered":"2023-07-14T11:15:13.666793+0000","last_clean":"2023-07-14T11:15:13.666793+0000","last_became_active":"2023-07-14T11:15:10.928241+0000","last_became_peered":"2023-07-14T11:15:10.928241+0000","last_unstale":"2023-07-14T11:15:13.666793+0000","last_undegraded":"2023-07-14T11:15:13.666793+0000","last_fullsized":"2023-07-14T11:15:13.666793+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:52:43.605709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.665466+0000","last_change":"2023-07-14T11:15:09.928418+0000","last_active":"2023-07-14T11:15:13.665466+0000","last_peered":"2023-07-14T11:15:13.665466+0000","last_clean":"2023-07-14T11:15:13.665466+0000","last_became_active":"2023-07-14T11:15:09.927987+0000","last_became_peered":"2023-07-14T11:15:09.927987+0000","last_unstale":"2023-07-14T11:15:13.665466+0000","last_undegraded":"2023-07-14T11:15:13.665466+0000","last_fullsized":"2023-07-14T11:15:13.665466+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:41:34.002161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":70,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.927780+0000","last_change":"2023-07-14T11:13:08.757882+0000","last_active":"2023-07-14T11:15:11.927780+0000","last_peered":"2023-07-14T11:15:11.927780+0000","last_clean":"2023-07-14T11:15:11.927780+0000","last_became_active":"2023-07-14T11:13:08.757541+0000","last_became_peered":"2023-07-14T11:13:08.757541+0000","last_unstale":"2023-07-14T11:15:11.927780+0000","last_undegraded":"2023-07-14T11:15:11.927780+0000","last_fullsized":"2023-07-14T11:15:11.927780+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:17:38.570250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":222,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.666732+0000","last_change":"2023-07-14T11:13:01.370649+0000","last_active":"2023-07-14T11:15:13.666732+0000","last_peered":"2023-07-14T11:15:13.666732+0000","last_clean":"2023-07-14T11:15:13.666732+0000","last_became_active":"2023-07-14T11:13:01.369478+0000","last_became_peered":"2023-07-14T11:13:01.369478+0000","last_unstale":"2023-07-14T11:15:13.666732+0000","last_undegraded":"2023-07-14T11:15:13.666732+0000","last_fullsized":"2023-07-14T11:15:13.666732+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:00.254800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:00.254800+0000","last_clean_scrub_stamp":"2023-07-14T11:13:00.254800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:30:38.682327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.927656+0000","last_change":"2023-07-14T11:15:10.925992+0000","last_active":"2023-07-14T11:15:11.927656+0000","last_peered":"2023-07-14T11:15:11.927656+0000","last_clean":"2023-07-14T11:15:11.927656+0000","last_became_active":"2023-07-14T11:15:10.925169+0000","last_became_peered":"2023-07-14T11:15:10.925169+0000","last_unstale":"2023-07-14T11:15:11.927656+0000","last_undegraded":"2023-07-14T11:15:11.927656+0000","last_fullsized":"2023-07-14T11:15:11.927656+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:19:13.701808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.667488+0000","last_change":"2023-07-14T11:15:09.927770+0000","last_active":"2023-07-14T11:15:13.667488+0000","last_peered":"2023-07-14T11:15:13.667488+0000","last_clean":"2023-07-14T11:15:13.667488+0000","last_became_active":"2023-07-14T11:15:09.927446+0000","last_became_peered":"2023-07-14T11:15:09.927446+0000","last_unstale":"2023-07-14T11:15:13.667488+0000","last_undegraded":"2023-07-14T11:15:13.667488+0000","last_fullsized":"2023-07-14T11:15:13.667488+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:23:32.593440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":66,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.666751+0000","last_change":"2023-07-14T11:13:08.760609+0000","last_active":"2023-07-14T11:15:13.666751+0000","last_peered":"2023-07-14T11:15:13.666751+0000","last_clean":"2023-07-14T11:15:13.666751+0000","last_became_active":"2023-07-14T11:13:08.760285+0000","last_became_peered":"2023-07-14T11:13:08.760285+0000","last_unstale":"2023-07-14T11:15:13.666751+0000","last_undegraded":"2023-07-14T11:15:13.666751+0000","last_fullsized":"2023-07-14T11:15:13.666751+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:33:22.465964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.944634+0000","last_change":"2023-07-14T11:15:10.928142+0000","last_active":"2023-07-14T11:15:11.944634+0000","last_peered":"2023-07-14T11:15:11.944634+0000","last_clean":"2023-07-14T11:15:11.944634+0000","last_became_active":"2023-07-14T11:15:10.926916+0000","last_became_peered":"2023-07-14T11:15:10.926916+0000","last_unstale":"2023-07-14T11:15:11.944634+0000","last_undegraded":"2023-07-14T11:15:11.944634+0000","last_fullsized":"2023-07-14T11:15:11.944634+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:46:16.791323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.928101+0000","last_change":"2023-07-14T11:15:09.923995+0000","last_active":"2023-07-14T11:15:11.928101+0000","last_peered":"2023-07-14T11:15:11.928101+0000","last_clean":"2023-07-14T11:15:11.928101+0000","last_became_active":"2023-07-14T11:15:09.923504+0000","last_became_peered":"2023-07-14T11:15:09.923504+0000","last_unstale":"2023-07-14T11:15:11.928101+0000","last_undegraded":"2023-07-14T11:15:11.928101+0000","last_fullsized":"2023-07-14T11:15:11.928101+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:41:49.032709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":66,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.667646+0000","last_change":"2023-07-14T11:13:08.923899+0000","last_active":"2023-07-14T11:15:13.667646+0000","last_peered":"2023-07-14T11:15:13.667646+0000","last_clean":"2023-07-14T11:15:13.667646+0000","last_became_active":"2023-07-14T11:13:08.923513+0000","last_became_peered":"2023-07-14T11:13:08.923513+0000","last_unstale":"2023-07-14T11:15:13.667646+0000","last_undegraded":"2023-07-14T11:15:13.667646+0000","last_fullsized":"2023-07-14T11:15:13.667646+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:23:52.469310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.665192+0000","last_change":"2023-07-14T11:15:10.938216+0000","last_active":"2023-07-14T11:15:13.665192+0000","last_peered":"2023-07-14T11:15:13.665192+0000","last_clean":"2023-07-14T11:15:13.665192+0000","last_became_active":"2023-07-14T11:15:10.937942+0000","last_became_peered":"2023-07-14T11:15:10.937942+0000","last_unstale":"2023-07-14T11:15:13.665192+0000","last_undegraded":"2023-07-14T11:15:13.665192+0000","last_fullsized":"2023-07-14T11:15:13.665192+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:46:07.655019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.944355+0000","last_change":"2023-07-14T11:15:09.928608+0000","last_active":"2023-07-14T11:15:11.944355+0000","last_peered":"2023-07-14T11:15:11.944355+0000","last_clean":"2023-07-14T11:15:11.944355+0000","last_became_active":"2023-07-14T11:15:09.927944+0000","last_became_peered":"2023-07-14T11:15:09.927944+0000","last_unstale":"2023-07-14T11:15:11.944355+0000","last_undegraded":"2023-07-14T11:15:11.944355+0000","last_fullsized":"2023-07-14T11:15:11.944355+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:35:34.005507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":73,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.927425+0000","last_change":"2023-07-14T11:13:08.761726+0000","last_active":"2023-07-14T11:15:11.927425+0000","last_peered":"2023-07-14T11:15:11.927425+0000","last_clean":"2023-07-14T11:15:11.927425+0000","last_became_active":"2023-07-14T11:13:08.761365+0000","last_became_peered":"2023-07-14T11:13:08.761365+0000","last_unstale":"2023-07-14T11:15:11.927425+0000","last_undegraded":"2023-07-14T11:15:11.927425+0000","last_fullsized":"2023-07-14T11:15:11.927425+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:24:20.544830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.927740+0000","last_change":"2023-07-14T11:15:10.934577+0000","last_active":"2023-07-14T11:15:11.927740+0000","last_peered":"2023-07-14T11:15:11.927740+0000","last_clean":"2023-07-14T11:15:11.927740+0000","last_became_active":"2023-07-14T11:15:10.934249+0000","last_became_peered":"2023-07-14T11:15:10.934249+0000","last_unstale":"2023-07-14T11:15:11.927740+0000","last_undegraded":"2023-07-14T11:15:11.927740+0000","last_fullsized":"2023-07-14T11:15:11.927740+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:39:50.567419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.944259+0000","last_change":"2023-07-14T11:15:09.928400+0000","last_active":"2023-07-14T11:15:11.944259+0000","last_peered":"2023-07-14T11:15:11.944259+0000","last_clean":"2023-07-14T11:15:11.944259+0000","last_became_active":"2023-07-14T11:15:09.928137+0000","last_became_peered":"2023-07-14T11:15:09.928137+0000","last_unstale":"2023-07-14T11:15:11.944259+0000","last_undegraded":"2023-07-14T11:15:11.944259+0000","last_fullsized":"2023-07-14T11:15:11.944259+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:57:21.140052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":69,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.667236+0000","last_change":"2023-07-14T11:13:08.762084+0000","last_active":"2023-07-14T11:15:13.667236+0000","last_peered":"2023-07-14T11:15:13.667236+0000","last_clean":"2023-07-14T11:15:13.667236+0000","last_became_active":"2023-07-14T11:13:08.761763+0000","last_became_peered":"2023-07-14T11:13:08.761763+0000","last_unstale":"2023-07-14T11:15:13.667236+0000","last_undegraded":"2023-07-14T11:15:13.667236+0000","last_fullsized":"2023-07-14T11:15:13.667236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:59:32.144323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574879,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28116,"kb_used_data":1164,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343724,"statfs":{"total":96636764160,"available":96607973376,"internally_reserved":0,"allocated":1191936,"data_stored":845736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.93200000000000005,"15min":0.98399999999999999},"min":{"1min":0.47199999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.877,"5min":8.4339999999999993,"15min":8.4339999999999993},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.97099999999999997,"15min":1.0209999999999999},"min":{"1min":0.52300000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.91600000000000004,"5min":8.4559999999999995,"15min":8.4559999999999995},"last":0.65900000000000003}]},{"osd":1,"last update":"Fri Jul 14 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.90000000000000002,"15min":0.94699999999999995},"min":{"1min":0.40400000000000003,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.84499999999999997,"5min":6.3520000000000003,"15min":6.3520000000000003},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":1.079,"15min":1.149},"min":{"1min":0.46400000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.86099999999999999,"5min":6.8550000000000004,"15min":6.8550000000000004},"last":0.745}]},{"osd":2,"last update":"Fri Jul 14 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":1.1359999999999999,"15min":1.212},"min":{"1min":0.51100000000000001,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.95599999999999996,"5min":7.0289999999999999,"15min":7.0289999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.69399999999999995,"15min":0.68999999999999995},"min":{"1min":0.51600000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.98199999999999998,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.72399999999999998}]},{"osd":3,"last update":"Fri Jul 14 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":1.1930000000000001,"15min":1.2769999999999999},"min":{"1min":0.58299999999999996,"5min":0.505,"15min":0.505},"max":{"1min":0.85999999999999999,"5min":10.337,"15min":10.337},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.77200000000000002,"15min":0.77300000000000002},"min":{"1min":0.60199999999999998,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.93300000000000005,"5min":1.921,"15min":1.921},"last":0.63500000000000001}]},{"osd":4,"last update":"Fri Jul 14 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.60099999999999998,"15min":0.58299999999999996},"min":{"1min":0.41499999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.70699999999999996,"15min":0.69599999999999995},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.76400000000000001}]},{"osd":5,"last update":"Fri Jul 14 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.68000000000000005,"15min":0.67200000000000004},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.74399999999999999,"15min":0.73399999999999999},"min":{"1min":0.60399999999999998,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.94399999999999995}]},{"osd":6,"last update":"Fri Jul 14 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.68200000000000005,"15min":0.66800000000000004},"min":{"1min":0.498,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.69299999999999995,"15min":0.68100000000000005},"min":{"1min":0.55800000000000005,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.81000000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574880,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27536,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":598016,"data_stored":255896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.71199999999999997,"15min":0.70699999999999996},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.752,"5min":0.72199999999999998,"15min":0.71699999999999997},"min":{"1min":0.51300000000000001,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.68100000000000005}]},{"osd":1,"last update":"Fri Jul 14 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.68200000000000005,"15min":0.67900000000000005},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.751,"5min":0.71499999999999997,"15min":0.70899999999999996},"min":{"1min":0.42299999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.60799999999999998}]},{"osd":2,"last update":"Fri Jul 14 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.67400000000000004,"15min":0.67000000000000004},"min":{"1min":0.45500000000000002,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.78300000000000003,"15min":0.78500000000000003},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.54800000000000004}]},{"osd":3,"last update":"Fri Jul 14 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.749,"15min":0.749},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.749,"15min":0.74399999999999999},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.53200000000000003}]},{"osd":4,"last update":"Fri Jul 14 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.71199999999999997,"15min":0.71399999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.712,"5min":1.712,"15min":1.712},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.73499999999999999,"15min":0.73099999999999998},"min":{"1min":0.438,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.70299999999999996}]},{"osd":5,"last update":"Fri Jul 14 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.73799999999999999,"15min":0.72599999999999998},"min":{"1min":0.52700000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":2.8820000000000001,"5min":2.8820000000000001,"15min":2.8820000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.78800000000000003,"15min":0.79300000000000004},"min":{"1min":0.46100000000000002,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.95099999999999996,"5min":1.129,"15min":1.129},"last":0.747}]},{"osd":7,"last update":"Fri Jul 14 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.80500000000000005,"15min":0.80900000000000005},"min":{"1min":0.49199999999999999,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.79500000000000004,"15min":0.79900000000000004},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.55,"5min":1.55,"15min":1.55},"last":0.625}]}]},{"osd":1,"up_from":13,"seq":55834574879,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27536,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":598016,"data_stored":255404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.439,"15min":0.443},"min":{"1min":0.28299999999999997,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.59099999999999997,"5min":0.996,"15min":0.996},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.47399999999999998,"15min":0.48199999999999998},"min":{"1min":0.30199999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.81599999999999995,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.42699999999999999}]},{"osd":2,"last update":"Fri Jul 14 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.56499999999999995,"15min":0.57699999999999996},"min":{"1min":0.374,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.68600000000000005,"5min":2.476,"15min":2.476},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.61099999999999999,"15min":0.63600000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.70499999999999996,"5min":2.6299999999999999,"15min":2.6299999999999999},"last":0.503}]},{"osd":3,"last update":"Fri Jul 14 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51700000000000002,"15min":0.51800000000000002},"min":{"1min":0.39300000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.65200000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.48899999999999999,"15min":0.496},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.65700000000000003,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.48699999999999999}]},{"osd":4,"last update":"Fri Jul 14 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.75,"15min":0.753},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0149999999999999,"5min":1.363,"15min":1.363},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.054,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.70199999999999996}]},{"osd":5,"last update":"Fri Jul 14 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.77900000000000003,"15min":0.77500000000000002},"min":{"1min":0.53100000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.1739999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.81799999999999995,"15min":0.82599999999999996},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.095,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.59299999999999997}]},{"osd":6,"last update":"Fri Jul 14 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.79700000000000004,"15min":0.80500000000000005},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.141,"5min":1.298,"15min":1.298},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.78600000000000003,"15min":0.79000000000000004},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.123,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.82099999999999995}]},{"osd":7,"last update":"Fri Jul 14 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.82499999999999996,"15min":0.82899999999999996},"min":{"1min":0.61899999999999999,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.2010000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.78600000000000003,"15min":0.79100000000000004},"min":{"1min":0.55000000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.92700000000000005,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.72799999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28116,"kb_used_data":1164,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343724,"statfs":{"total":96636764160,"available":96607973376,"internally_reserved":0,"allocated":1191936,"data_stored":845668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.42999999999999999,"15min":0.432},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.64000000000000001,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.434,"15min":0.438},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.35299999999999998}]},{"osd":2,"last update":"Fri Jul 14 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.45700000000000002,"15min":0.45900000000000002},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.65000000000000002,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.499},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.498,"15min":0.502},"min":{"1min":0.376,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.64300000000000002,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.38700000000000001}]},{"osd":3,"last update":"Fri Jul 14 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.42099999999999999,"15min":0.41799999999999998},"min":{"1min":0.32000000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.499,"5min":0.51900000000000002,"15min":0.52300000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.45800000000000002}]},{"osd":4,"last update":"Fri Jul 14 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.75700000000000001,"15min":0.76400000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.90500000000000003,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.69899999999999995,"15min":0.69699999999999995},"min":{"1min":0.54400000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.621}]},{"osd":5,"last update":"Fri Jul 14 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.71499999999999997,"15min":0.71899999999999997},"min":{"1min":0.502,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.83299999999999996,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.629},{"interface":"front","average":{"1min":0.745,"5min":0.77400000000000002,"15min":0.77900000000000003},"min":{"1min":0.54400000000000004,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.93500000000000005,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.74399999999999999}]},{"osd":6,"last update":"Fri Jul 14 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.71399999999999997,"15min":0.71799999999999997},"min":{"1min":0.59699999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.83899999999999997,"5min":1.006,"15min":1.006},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.77100000000000002,"15min":0.77800000000000002},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.89200000000000002,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.73199999999999998}]},{"osd":7,"last update":"Fri Jul 14 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.80900000000000005,"15min":0.81999999999999995},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":0.91300000000000003,"5min":1.149,"15min":1.149},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.57599999999999996,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.94899999999999995,"5min":1.081,"15min":1.081},"last":0.70399999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27540,"kb_used_data":588,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":602112,"data_stored":256808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.44600000000000001,"15min":0.45300000000000001},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.58199999999999996,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.442,"15min":0.44600000000000001},"min":{"1min":0.33000000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.66300000000000003,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.5}]},{"osd":1,"last update":"Fri Jul 14 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.48399999999999999,"15min":0.48799999999999999},"min":{"1min":0.371,"5min":0.31,"15min":0.31},"max":{"1min":0.63500000000000001,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48999999999999999,"15min":0.49099999999999999},"min":{"1min":0.36199999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.60099999999999998,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.46300000000000002}]},{"osd":3,"last update":"Fri Jul 14 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.49299999999999999,"15min":0.495},"min":{"1min":0.34200000000000003,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.63200000000000001,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.58099999999999996,"15min":0.58799999999999997},"min":{"1min":0.44900000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.67300000000000004,"5min":1.034,"15min":1.034},"last":0.44}]},{"osd":4,"last update":"Fri Jul 14 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.76400000000000001,"15min":0.77300000000000002},"min":{"1min":0.55300000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.93300000000000005,"5min":1.212,"15min":1.212},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.78200000000000003,"15min":0.79000000000000004},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.96799999999999997,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.70399999999999996}]},{"osd":5,"last update":"Fri Jul 14 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.78700000000000003,"15min":0.79600000000000004},"min":{"1min":0.57399999999999995,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.117,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.751,"5min":0.81899999999999995,"15min":0.82999999999999996},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0229999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.84899999999999998}]},{"osd":6,"last update":"Fri Jul 14 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.78600000000000003,"15min":0.79200000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.077,"5min":1.103,"15min":1.103},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.746,"5min":0.81799999999999995,"15min":0.82999999999999996},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.006,"5min":1.258,"15min":1.258},"last":0.76700000000000002}]},{"osd":7,"last update":"Fri Jul 14 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.79900000000000004,"15min":0.80600000000000005},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1339999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.79800000000000004,"15min":0.81100000000000005},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":0.98899999999999999,"5min":1.202,"15min":1.202},"last":0.79500000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27544,"kb_used_data":592,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344296,"statfs":{"total":96636764160,"available":96608559104,"internally_reserved":0,"allocated":606208,"data_stored":256830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.441,"15min":0.45200000000000001},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.63900000000000001,"5min":0.754,"15min":0.754},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.441,"15min":0.44700000000000001},"min":{"1min":0.33600000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.59699999999999998,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.372}]},{"osd":1,"last update":"Fri Jul 14 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.44900000000000001,"15min":0.45200000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.58299999999999996,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.437,"5min":0.48799999999999999,"15min":0.496},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.54700000000000004,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.57099999999999995}]},{"osd":2,"last update":"Fri Jul 14 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.53400000000000003,"15min":0.54000000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.63900000000000001,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.58699999999999997,"15min":0.59799999999999998},"min":{"1min":0.44400000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.71599999999999997,"5min":1.585,"15min":1.585},"last":0.502}]},{"osd":4,"last update":"Fri Jul 14 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.755,"15min":0.76100000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.93000000000000005,"5min":1.216,"15min":1.216},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.754,"5min":0.752,"15min":0.752},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.64500000000000002}]},{"osd":5,"last update":"Fri Jul 14 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.753,"15min":0.75900000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.90700000000000003,"5min":1.413,"15min":1.413},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.753,"5min":0.84499999999999997,"15min":0.86099999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1619999999999999,"5min":1.657,"15min":1.657},"last":0.72399999999999998}]},{"osd":6,"last update":"Fri Jul 14 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.77200000000000002,"15min":0.78100000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.999,"5min":1.726,"15min":1.726},"last":0.628},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.79300000000000004,"15min":0.80200000000000005},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.88800000000000001,"5min":1.333,"15min":1.333},"last":0.66800000000000004}]},{"osd":7,"last update":"Fri Jul 14 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.82799999999999996,"15min":0.84099999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.135,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.83499999999999996,"15min":0.84299999999999997},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.232,"5min":1.268,"15min":1.268},"last":0.75}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27532,"kb_used_data":580,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":593920,"data_stored":255826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.627,"15min":0.628},"min":{"1min":0.44,"5min":0.433,"15min":0.433},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69799999999999995,"15min":0.69899999999999995},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.38400000000000001}]},{"osd":1,"last update":"Fri Jul 14 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.66800000000000004,"15min":0.67200000000000004},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.92000000000000004,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.71099999999999997,"15min":0.71299999999999997},"min":{"1min":0.51400000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.99299999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.64300000000000002}]},{"osd":2,"last update":"Fri Jul 14 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.48499999999999999,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0209999999999999,"5min":1.48,"15min":1.48},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.747,"15min":0.745},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.1080000000000001,"5min":1.23,"15min":1.23},"last":0.57899999999999996}]},{"osd":3,"last update":"Fri Jul 14 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.71699999999999997,"15min":0.72099999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.746,"15min":0.74099999999999999},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.1259999999999999,"5min":1.145,"15min":1.145},"last":0.72599999999999998}]},{"osd":5,"last update":"Fri Jul 14 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.76000000000000001,"15min":0.77400000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.88900000000000001,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.77200000000000002,"15min":0.78300000000000003},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.96999999999999997,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.61599999999999999}]},{"osd":6,"last update":"Fri Jul 14 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.1659999999999999,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.77800000000000002,"15min":0.78000000000000003},"min":{"1min":0.52300000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.1479999999999999,"5min":1.3,"15min":1.3},"last":0.70499999999999996}]},{"osd":7,"last update":"Fri Jul 14 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.77400000000000002,"15min":0.77800000000000002},"min":{"1min":0.54500000000000004,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.028,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.84699999999999998,"15min":0.85699999999999998},"min":{"1min":0.53700000000000003,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.21,"5min":1.379,"15min":1.379},"last":0.75800000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574879,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27528,"kb_used_data":576,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":589824,"data_stored":255244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.63700000000000001,"15min":0.64200000000000002},"min":{"1min":0.41299999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.996,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.627,"5min":0.63300000000000001,"15min":0.63400000000000001},"min":{"1min":0.47199999999999998,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.873,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.73199999999999998}]},{"osd":1,"last update":"Fri Jul 14 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.67700000000000005,"15min":0.68200000000000005},"min":{"1min":0.47699999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.88800000000000001,"5min":1.343,"15min":1.343},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.46300000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.69099999999999995}]},{"osd":2,"last update":"Fri Jul 14 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.73599999999999999,"15min":0.74099999999999999},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.012,"5min":1.034,"15min":1.034},"last":0.625},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.76300000000000001,"15min":0.77300000000000002},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.88200000000000001,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.78600000000000003}]},{"osd":3,"last update":"Fri Jul 14 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.76300000000000001,"15min":0.77300000000000002},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.95499999999999996,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.76700000000000002,"15min":0.78700000000000003},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.89000000000000001,"5min":1.806,"15min":1.806},"last":0.64700000000000002}]},{"osd":4,"last update":"Fri Jul 14 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.65600000000000003,"15min":0.65900000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.0229999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.753,"15min":0.76600000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.89900000000000002}]},{"osd":6,"last update":"Fri Jul 14 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.747,"15min":0.75700000000000001},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.93600000000000005,"5min":1.03,"15min":1.03},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.745,"5min":0.80300000000000005,"15min":0.81299999999999994},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.048,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.82899999999999996}]},{"osd":7,"last update":"Fri Jul 14 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.83899999999999997,"15min":0.86099999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.95299999999999996,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.86599999999999999,"15min":0.88200000000000001},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":0.96699999999999997,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.88200000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T11:15:20.243 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T11:15:20.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.446+0000 7f6fa0dff700 1 Processor -- start 2023-07-14T11:15:20.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.446+0000 7f6fa0dff700 1 -- start start 2023-07-14T11:15:20.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.447+0000 7f6fa0dff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6f9c15e890 0x7f6f9c0cee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:20.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.447+0000 7f6fa0dff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6f9c15afd0 0x7f6f9c0b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:20.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.447+0000 7f6fa0dff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f9c15b430 con 0x7f6f9c0b3780 2023-07-14T11:15:20.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.447+0000 7f6fa0dff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f9c0cf380 con 0x7f6f9c15afd0 2023-07-14T11:15:20.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.447+0000 7f6fa0dff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f9c0b4130 con 0x7f6f9c15e890 2023-07-14T11:15:20.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.447+0000 7f6f9ad9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6f9c15afd0 0x7f6f9c0b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:20.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.447+0000 7f6f9ad9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6f9c15afd0 0x7f6f9c0b3bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43446/0 (socket says 172.21.15.84:43446) 2023-07-14T11:15:20.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.447+0000 7f6f9ad9d700 1 -- 172.21.15.84:0/1658174150 learned_addr learned my addr 172.21.15.84:0/1658174150 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:20.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.448+0000 7f6f9a59c700 1 --2- 172.21.15.84:0/1658174150 >> v2:172.21.15.179:3300/0 conn(0x7f6f9c15e890 0x7f6f9c0cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:20.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.448+0000 7f6f9ad9d700 1 -- 172.21.15.84:0/1658174150 >> v2:172.21.15.179:3300/0 conn(0x7f6f9c15e890 msgr2=0x7f6f9c0cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:20.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.448+0000 7f6f9ad9d700 1 --2- 172.21.15.84:0/1658174150 >> v2:172.21.15.179:3300/0 conn(0x7f6f9c15e890 0x7f6f9c0cee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:20.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.448+0000 7f6f9ad9d700 1 -- 172.21.15.84:0/1658174150 >> v1:172.21.15.179:6789/0 conn(0x7f6f9c0b3780 legacy=0x7f6f9c15a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:20.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.448+0000 7f6f9ad9d700 1 -- 172.21.15.84:0/1658174150 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f9c0ce110 con 0x7f6f9c15afd0 2023-07-14T11:15:20.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.448+0000 7f6f9ad9d700 1 --2- 172.21.15.84:0/1658174150 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f9c15afd0 0x7f6f9c0b3bf0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c06f670 tx=0x7f6f9400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4919a9a34378d2a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:20.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.448+0000 7f6f9959a700 1 -- 172.21.15.84:0/1658174150 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f9400e070 con 0x7f6f9c15afd0 2023-07-14T11:15:20.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.448+0000 7f6f9959a700 1 -- 172.21.15.84:0/1658174150 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f94003a20 con 0x7f6f9c15afd0 2023-07-14T11:15:20.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.448+0000 7f6f9959a700 1 -- 172.21.15.84:0/1658174150 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f94003dd0 con 0x7f6f9c15afd0 2023-07-14T11:15:20.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.449+0000 7f6fa0dff700 1 -- 172.21.15.84:0/1658174150 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f9c15afd0 msgr2=0x7f6f9c0b3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:20.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.449+0000 7f6fa0dff700 1 --2- 172.21.15.84:0/1658174150 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f9c15afd0 0x7f6f9c0b3bf0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c06f670 tx=0x7f6f9400b330 comp rx=0 tx=0).stop 2023-07-14T11:15:20.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.449+0000 7f6fa0dff700 1 -- 172.21.15.84:0/1658174150 shutdown_connections 2023-07-14T11:15:20.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.449+0000 7f6fa0dff700 1 --2- 172.21.15.84:0/1658174150 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f9c15afd0 0x7f6f9c0b3bf0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:20.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.449+0000 7f6fa0dff700 1 --2- 172.21.15.84:0/1658174150 >> v2:172.21.15.179:3300/0 conn(0x7f6f9c15e890 0x7f6f9c0cee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:20.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.449+0000 7f6fa0dff700 1 -- 172.21.15.84:0/1658174150 >> 172.21.15.84:0/1658174150 conn(0x7f6f9c069f30 msgr2=0x7f6f9c06a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:20.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.449+0000 7f6fa0dff700 1 -- 172.21.15.84:0/1658174150 shutdown_connections 2023-07-14T11:15:20.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.449+0000 7f6fa0dff700 1 -- 172.21.15.84:0/1658174150 wait complete. 2023-07-14T11:15:20.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.451+0000 7f6fa0dff700 1 Processor -- start 2023-07-14T11:15:20.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.451+0000 7f6fa0dff700 1 -- start start 2023-07-14T11:15:20.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.452+0000 7f6fa0dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f9c0b3780 0x7f6f9c13e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:20.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.452+0000 7f6fa0dff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f9c15afd0 0x7f6f9c13ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:20.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.452+0000 7f6fa0dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f9c15e890 0x7f6f9c06bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:20.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.452+0000 7f6fa0dff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9c140120 con 0x7f6f9c15afd0 2023-07-14T11:15:20.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.452+0000 7f6fa0dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9c13f510 con 0x7f6f9c15e890 2023-07-14T11:15:20.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.452+0000 7f6fa0dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9c13f7f0 con 0x7f6f9c0b3780 2023-07-14T11:15:20.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.452+0000 7f6f99d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f9c15afd0 0x7f6f9c13ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:20.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.452+0000 7f6f99d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f9c15afd0 0x7f6f9c13ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43450/0 (socket says 172.21.15.84:43450) 2023-07-14T11:15:20.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.452+0000 7f6f99d9b700 1 -- 172.21.15.84:0/675171525 learned_addr learned my addr 172.21.15.84:0/675171525 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:20.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.452+0000 7f6f9a59c700 1 --2- 172.21.15.84:0/675171525 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f9c0b3780 0x7f6f9c13e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:20.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.452+0000 7f6f9ad9d700 1 --2- 172.21.15.84:0/675171525 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f9c15e890 0x7f6f9c06bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:20.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.452+0000 7f6f99d9b700 1 -- 172.21.15.84:0/675171525 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f9c0b3780 msgr2=0x7f6f9c13e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:20.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.452+0000 7f6f99d9b700 1 --2- 172.21.15.84:0/675171525 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f9c0b3780 0x7f6f9c13e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:20.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.452+0000 7f6f99d9b700 1 -- 172.21.15.84:0/675171525 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f9c15e890 msgr2=0x7f6f9c06bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:20.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.452+0000 7f6f99d9b700 1 --2- 172.21.15.84:0/675171525 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f9c15e890 0x7f6f9c06bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:20.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.453+0000 7f6f99d9b700 1 -- 172.21.15.84:0/675171525 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f94009b30 con 0x7f6f9c15afd0 2023-07-14T11:15:20.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.453+0000 7f6f9a59c700 1 --2- 172.21.15.84:0/675171525 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f9c0b3780 0x7f6f9c13e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:15:20.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.453+0000 7f6f9ad9d700 1 --2- 172.21.15.84:0/675171525 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f9c15e890 0x7f6f9c06bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:15:20.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.453+0000 7f6f99d9b700 1 --2- 172.21.15.84:0/675171525 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f9c15afd0 0x7f6f9c13ea90 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f6f9000c4d0 tx=0x7f6f9000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:20.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.453+0000 7f6f8affd700 1 -- 172.21.15.84:0/675171525 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f90011790 con 0x7f6f9c15afd0 2023-07-14T11:15:20.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.453+0000 7f6f8affd700 1 -- 172.21.15.84:0/675171525 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f900118f0 con 0x7f6f9c15afd0 2023-07-14T11:15:20.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.453+0000 7f6f8affd700 1 -- 172.21.15.84:0/675171525 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f90011ca0 con 0x7f6f9c15afd0 2023-07-14T11:15:20.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.453+0000 7f6fa0dff700 1 -- 172.21.15.84:0/675171525 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f9c13fad0 con 0x7f6f9c15afd0 2023-07-14T11:15:20.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.453+0000 7f6fa0dff700 1 -- 172.21.15.84:0/675171525 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f9c140d40 con 0x7f6f9c15afd0 2023-07-14T11:15:20.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.454+0000 7f6fa0dff700 1 -- 172.21.15.84:0/675171525 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f9c04e280 con 0x7f6f9c15afd0 2023-07-14T11:15:20.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.455+0000 7f6f8affd700 1 -- 172.21.15.84:0/675171525 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 7) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f6f9001c460 con 0x7f6f9c15afd0 2023-07-14T11:15:20.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.456+0000 7f6f8affd700 1 --2- 172.21.15.84:0/675171525 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6f7c06ae90 0x7f6f7c06d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:20.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.456+0000 7f6f8affd700 1 -- 172.21.15.84:0/675171525 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6f90089680 con 0x7f6f9c15afd0 2023-07-14T11:15:20.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.456+0000 7f6f9a59c700 1 --2- 172.21.15.84:0/675171525 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6f7c06ae90 0x7f6f7c06d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:20.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.457+0000 7f6f9a59c700 1 --2- 172.21.15.84:0/675171525 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6f7c06ae90 0x7f6f7c06d340 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c009820 tx=0x7f6f8c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:20.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.460+0000 7f6f8affd700 1 -- 172.21.15.84:0/675171525 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f6f90054410 con 0x7f6f9c15afd0 2023-07-14T11:15:20.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.650+0000 7f6fa0dff700 1 -- 172.21.15.84:0/675171525 --> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6f9c0ce360 con 0x7f6f7c06ae90 2023-07-14T11:15:20.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.658+0000 7f6f8affd700 1 -- 172.21.15.84:0/675171525 <== mgr.4104 v2:172.21.15.84:6832/379617029 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310727 (secure 0 0 0) 0x7f6f8c015440 con 0x7f6f7c06ae90 2023-07-14T11:15:20.665 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:15:20.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.663+0000 7f6fa0dff700 1 -- 172.21.15.84:0/675171525 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6f7c06ae90 msgr2=0x7f6f7c06d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:20.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.663+0000 7f6fa0dff700 1 --2- 172.21.15.84:0/675171525 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6f7c06ae90 0x7f6f7c06d340 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c009820 tx=0x7f6f8c008040 comp rx=0 tx=0).stop 2023-07-14T11:15:20.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.663+0000 7f6fa0dff700 1 -- 172.21.15.84:0/675171525 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f9c15afd0 msgr2=0x7f6f9c13ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:20.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.663+0000 7f6fa0dff700 1 --2- 172.21.15.84:0/675171525 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f9c15afd0 0x7f6f9c13ea90 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f6f9000c4d0 tx=0x7f6f9000c890 comp rx=0 tx=0).stop 2023-07-14T11:15:20.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.663+0000 7f6fa0dff700 1 -- 172.21.15.84:0/675171525 shutdown_connections 2023-07-14T11:15:20.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.663+0000 7f6fa0dff700 1 --2- 172.21.15.84:0/675171525 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6f7c06ae90 0x7f6f7c06d340 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:20.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.663+0000 7f6fa0dff700 1 --2- 172.21.15.84:0/675171525 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f9c0b3780 0x7f6f9c13e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:20.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.663+0000 7f6fa0dff700 1 --2- 172.21.15.84:0/675171525 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f9c15e890 0x7f6f9c06bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:20.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.663+0000 7f6fa0dff700 1 --2- 172.21.15.84:0/675171525 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f9c15afd0 0x7f6f9c13ea90 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:20.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.663+0000 7f6fa0dff700 1 -- 172.21.15.84:0/675171525 >> 172.21.15.84:0/675171525 conn(0x7f6f9c069f30 msgr2=0x7f6f9c15cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:20.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.663+0000 7f6fa0dff700 1 -- 172.21.15.84:0/675171525 shutdown_connections 2023-07-14T11:15:20.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.663+0000 7f6fa0dff700 1 -- 172.21.15.84:0/675171525 wait complete. 2023-07-14T11:15:20.668 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-07-14T11:15:20.684 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":113,"stamp":"2023-07-14T11:15:20.096929+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221448,"kb_used_data":5832,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754753272,"statfs":{"total":773094113280,"available":772867350528,"internally_reserved":0,"allocated":5971968,"data_stored":3227412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.188206"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.927707+0000","last_change":"2023-07-14T11:15:10.925504+0000","last_active":"2023-07-14T11:15:11.927707+0000","last_peered":"2023-07-14T11:15:11.927707+0000","last_clean":"2023-07-14T11:15:11.927707+0000","last_became_active":"2023-07-14T11:15:10.925160+0000","last_became_peered":"2023-07-14T11:15:10.925160+0000","last_unstale":"2023-07-14T11:15:11.927707+0000","last_undegraded":"2023-07-14T11:15:11.927707+0000","last_fullsized":"2023-07-14T11:15:11.927707+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:48:14.227600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.666667+0000","last_change":"2023-07-14T11:15:10.936371+0000","last_active":"2023-07-14T11:15:13.666667+0000","last_peered":"2023-07-14T11:15:13.666667+0000","last_clean":"2023-07-14T11:15:13.666667+0000","last_became_active":"2023-07-14T11:15:10.935272+0000","last_became_peered":"2023-07-14T11:15:10.935272+0000","last_unstale":"2023-07-14T11:15:13.666667+0000","last_undegraded":"2023-07-14T11:15:13.666667+0000","last_fullsized":"2023-07-14T11:15:13.666667+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:17:05.372857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.665165+0000","last_change":"2023-07-14T11:15:10.938106+0000","last_active":"2023-07-14T11:15:13.665165+0000","last_peered":"2023-07-14T11:15:13.665165+0000","last_clean":"2023-07-14T11:15:13.665165+0000","last_became_active":"2023-07-14T11:15:10.937834+0000","last_became_peered":"2023-07-14T11:15:10.937834+0000","last_unstale":"2023-07-14T11:15:13.665165+0000","last_undegraded":"2023-07-14T11:15:13.665165+0000","last_fullsized":"2023-07-14T11:15:13.665165+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:54:10.925414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.667304+0000","last_change":"2023-07-14T11:15:10.935147+0000","last_active":"2023-07-14T11:15:13.667304+0000","last_peered":"2023-07-14T11:15:13.667304+0000","last_clean":"2023-07-14T11:15:13.667304+0000","last_became_active":"2023-07-14T11:15:10.934803+0000","last_became_peered":"2023-07-14T11:15:10.934803+0000","last_unstale":"2023-07-14T11:15:13.667304+0000","last_undegraded":"2023-07-14T11:15:13.667304+0000","last_fullsized":"2023-07-14T11:15:13.667304+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:56:49.007278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.666188+0000","last_change":"2023-07-14T11:15:10.932878+0000","last_active":"2023-07-14T11:15:13.666188+0000","last_peered":"2023-07-14T11:15:13.666188+0000","last_clean":"2023-07-14T11:15:13.666188+0000","last_became_active":"2023-07-14T11:15:10.932518+0000","last_became_peered":"2023-07-14T11:15:10.932518+0000","last_unstale":"2023-07-14T11:15:13.666188+0000","last_undegraded":"2023-07-14T11:15:13.666188+0000","last_fullsized":"2023-07-14T11:15:13.666188+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:10:43.496513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.927643+0000","last_change":"2023-07-14T11:15:10.926174+0000","last_active":"2023-07-14T11:15:11.927643+0000","last_peered":"2023-07-14T11:15:11.927643+0000","last_clean":"2023-07-14T11:15:11.927643+0000","last_became_active":"2023-07-14T11:15:10.925547+0000","last_became_peered":"2023-07-14T11:15:10.925547+0000","last_unstale":"2023-07-14T11:15:11.927643+0000","last_undegraded":"2023-07-14T11:15:11.927643+0000","last_fullsized":"2023-07-14T11:15:11.927643+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:37:54.291474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.664823+0000","last_change":"2023-07-14T11:15:10.937611+0000","last_active":"2023-07-14T11:15:13.664823+0000","last_peered":"2023-07-14T11:15:13.664823+0000","last_clean":"2023-07-14T11:15:13.664823+0000","last_became_active":"2023-07-14T11:15:10.937160+0000","last_became_peered":"2023-07-14T11:15:10.937160+0000","last_unstale":"2023-07-14T11:15:13.664823+0000","last_undegraded":"2023-07-14T11:15:13.664823+0000","last_fullsized":"2023-07-14T11:15:13.664823+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:25:48.540396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.944129+0000","last_change":"2023-07-14T11:15:10.927643+0000","last_active":"2023-07-14T11:15:11.944129+0000","last_peered":"2023-07-14T11:15:11.944129+0000","last_clean":"2023-07-14T11:15:11.944129+0000","last_became_active":"2023-07-14T11:15:10.927241+0000","last_became_peered":"2023-07-14T11:15:10.927241+0000","last_unstale":"2023-07-14T11:15:11.944129+0000","last_undegraded":"2023-07-14T11:15:11.944129+0000","last_fullsized":"2023-07-14T11:15:11.944129+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:28:46.603191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.944553+0000","last_change":"2023-07-14T11:15:10.936870+0000","last_active":"2023-07-14T11:15:11.944553+0000","last_peered":"2023-07-14T11:15:11.944553+0000","last_clean":"2023-07-14T11:15:11.944553+0000","last_became_active":"2023-07-14T11:15:10.936566+0000","last_became_peered":"2023-07-14T11:15:10.936566+0000","last_unstale":"2023-07-14T11:15:11.944553+0000","last_undegraded":"2023-07-14T11:15:11.944553+0000","last_fullsized":"2023-07-14T11:15:11.944553+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:16:00.524727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.927138+0000","last_change":"2023-07-14T11:15:10.924846+0000","last_active":"2023-07-14T11:15:11.927138+0000","last_peered":"2023-07-14T11:15:11.927138+0000","last_clean":"2023-07-14T11:15:11.927138+0000","last_became_active":"2023-07-14T11:15:10.924029+0000","last_became_peered":"2023-07-14T11:15:10.924029+0000","last_unstale":"2023-07-14T11:15:11.927138+0000","last_undegraded":"2023-07-14T11:15:11.927138+0000","last_fullsized":"2023-07-14T11:15:11.927138+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:41:35.008325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.927089+0000","last_change":"2023-07-14T11:15:10.932542+0000","last_active":"2023-07-14T11:15:11.927089+0000","last_peered":"2023-07-14T11:15:11.927089+0000","last_clean":"2023-07-14T11:15:11.927089+0000","last_became_active":"2023-07-14T11:15:10.932316+0000","last_became_peered":"2023-07-14T11:15:10.932316+0000","last_unstale":"2023-07-14T11:15:11.927089+0000","last_undegraded":"2023-07-14T11:15:11.927089+0000","last_fullsized":"2023-07-14T11:15:11.927089+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:24:53.735137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.944435+0000","last_change":"2023-07-14T11:15:10.935681+0000","last_active":"2023-07-14T11:15:11.944435+0000","last_peered":"2023-07-14T11:15:11.944435+0000","last_clean":"2023-07-14T11:15:11.944435+0000","last_became_active":"2023-07-14T11:15:10.935397+0000","last_became_peered":"2023-07-14T11:15:10.935397+0000","last_unstale":"2023-07-14T11:15:11.944435+0000","last_undegraded":"2023-07-14T11:15:11.944435+0000","last_fullsized":"2023-07-14T11:15:11.944435+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:45:28.290761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.927095+0000","last_change":"2023-07-14T11:15:10.929436+0000","last_active":"2023-07-14T11:15:11.927095+0000","last_peered":"2023-07-14T11:15:11.927095+0000","last_clean":"2023-07-14T11:15:11.927095+0000","last_became_active":"2023-07-14T11:15:10.929186+0000","last_became_peered":"2023-07-14T11:15:10.929186+0000","last_unstale":"2023-07-14T11:15:11.927095+0000","last_undegraded":"2023-07-14T11:15:11.927095+0000","last_fullsized":"2023-07-14T11:15:11.927095+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:10:03.003309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.665032+0000","last_change":"2023-07-14T11:15:10.936569+0000","last_active":"2023-07-14T11:15:13.665032+0000","last_peered":"2023-07-14T11:15:13.665032+0000","last_clean":"2023-07-14T11:15:13.665032+0000","last_became_active":"2023-07-14T11:15:10.936102+0000","last_became_peered":"2023-07-14T11:15:10.936102+0000","last_unstale":"2023-07-14T11:15:13.665032+0000","last_undegraded":"2023-07-14T11:15:13.665032+0000","last_fullsized":"2023-07-14T11:15:13.665032+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:26:01.745154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.666362+0000","last_change":"2023-07-14T11:15:10.936259+0000","last_active":"2023-07-14T11:15:13.666362+0000","last_peered":"2023-07-14T11:15:13.666362+0000","last_clean":"2023-07-14T11:15:13.666362+0000","last_became_active":"2023-07-14T11:15:10.935778+0000","last_became_peered":"2023-07-14T11:15:10.935778+0000","last_unstale":"2023-07-14T11:15:13.666362+0000","last_undegraded":"2023-07-14T11:15:13.666362+0000","last_fullsized":"2023-07-14T11:15:13.666362+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:07:47.346468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.926657+0000","last_change":"2023-07-14T11:15:10.928890+0000","last_active":"2023-07-14T11:15:11.926657+0000","last_peered":"2023-07-14T11:15:11.926657+0000","last_clean":"2023-07-14T11:15:11.926657+0000","last_became_active":"2023-07-14T11:15:10.926333+0000","last_became_peered":"2023-07-14T11:15:10.926333+0000","last_unstale":"2023-07-14T11:15:11.926657+0000","last_undegraded":"2023-07-14T11:15:11.926657+0000","last_fullsized":"2023-07-14T11:15:11.926657+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:46:02.473727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.665534+0000","last_change":"2023-07-14T11:15:10.931739+0000","last_active":"2023-07-14T11:15:13.665534+0000","last_peered":"2023-07-14T11:15:13.665534+0000","last_clean":"2023-07-14T11:15:13.665534+0000","last_became_active":"2023-07-14T11:15:10.931180+0000","last_became_peered":"2023-07-14T11:15:10.931180+0000","last_unstale":"2023-07-14T11:15:13.665534+0000","last_undegraded":"2023-07-14T11:15:13.665534+0000","last_fullsized":"2023-07-14T11:15:13.665534+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:11:25.961330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.666839+0000","last_change":"2023-07-14T11:15:10.935893+0000","last_active":"2023-07-14T11:15:13.666839+0000","last_peered":"2023-07-14T11:15:13.666839+0000","last_clean":"2023-07-14T11:15:13.666839+0000","last_became_active":"2023-07-14T11:15:10.935473+0000","last_became_peered":"2023-07-14T11:15:10.935473+0000","last_unstale":"2023-07-14T11:15:13.666839+0000","last_undegraded":"2023-07-14T11:15:13.666839+0000","last_fullsized":"2023-07-14T11:15:13.666839+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:47:26.675759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.665286+0000","last_change":"2023-07-14T11:15:10.924017+0000","last_active":"2023-07-14T11:15:13.665286+0000","last_peered":"2023-07-14T11:15:13.665286+0000","last_clean":"2023-07-14T11:15:13.665286+0000","last_became_active":"2023-07-14T11:15:10.923751+0000","last_became_peered":"2023-07-14T11:15:10.923751+0000","last_unstale":"2023-07-14T11:15:13.665286+0000","last_undegraded":"2023-07-14T11:15:13.665286+0000","last_fullsized":"2023-07-14T11:15:13.665286+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:32:32.157604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.666317+0000","last_change":"2023-07-14T11:15:10.928004+0000","last_active":"2023-07-14T11:15:13.666317+0000","last_peered":"2023-07-14T11:15:13.666317+0000","last_clean":"2023-07-14T11:15:13.666317+0000","last_became_active":"2023-07-14T11:15:10.927727+0000","last_became_peered":"2023-07-14T11:15:10.927727+0000","last_unstale":"2023-07-14T11:15:13.666317+0000","last_undegraded":"2023-07-14T11:15:13.666317+0000","last_fullsized":"2023-07-14T11:15:13.666317+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:56:43.748275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.666137+0000","last_change":"2023-07-14T11:15:10.935381+0000","last_active":"2023-07-14T11:15:13.666137+0000","last_peered":"2023-07-14T11:15:13.666137+0000","last_clean":"2023-07-14T11:15:13.666137+0000","last_became_active":"2023-07-14T11:15:10.935042+0000","last_became_peered":"2023-07-14T11:15:10.935042+0000","last_unstale":"2023-07-14T11:15:13.666137+0000","last_undegraded":"2023-07-14T11:15:13.666137+0000","last_fullsized":"2023-07-14T11:15:13.666137+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:28:43.676308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.944097+0000","last_change":"2023-07-14T11:15:10.926865+0000","last_active":"2023-07-14T11:15:11.944097+0000","last_peered":"2023-07-14T11:15:11.944097+0000","last_clean":"2023-07-14T11:15:11.944097+0000","last_became_active":"2023-07-14T11:15:10.926563+0000","last_became_peered":"2023-07-14T11:15:10.926563+0000","last_unstale":"2023-07-14T11:15:11.944097+0000","last_undegraded":"2023-07-14T11:15:11.944097+0000","last_fullsized":"2023-07-14T11:15:11.944097+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:26:01.745154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.926854+0000","last_change":"2023-07-14T11:15:10.940410+0000","last_active":"2023-07-14T11:15:11.926854+0000","last_peered":"2023-07-14T11:15:11.926854+0000","last_clean":"2023-07-14T11:15:11.926854+0000","last_became_active":"2023-07-14T11:15:10.939991+0000","last_became_peered":"2023-07-14T11:15:10.939991+0000","last_unstale":"2023-07-14T11:15:11.926854+0000","last_undegraded":"2023-07-14T11:15:11.926854+0000","last_fullsized":"2023-07-14T11:15:11.926854+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:17:22.544441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.664823+0000","last_change":"2023-07-14T11:15:10.936569+0000","last_active":"2023-07-14T11:15:13.664823+0000","last_peered":"2023-07-14T11:15:13.664823+0000","last_clean":"2023-07-14T11:15:13.664823+0000","last_became_active":"2023-07-14T11:15:10.936136+0000","last_became_peered":"2023-07-14T11:15:10.936136+0000","last_unstale":"2023-07-14T11:15:13.664823+0000","last_undegraded":"2023-07-14T11:15:13.664823+0000","last_fullsized":"2023-07-14T11:15:13.664823+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:18:41.889981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.665506+0000","last_change":"2023-07-14T11:15:10.935674+0000","last_active":"2023-07-14T11:15:13.665506+0000","last_peered":"2023-07-14T11:15:13.665506+0000","last_clean":"2023-07-14T11:15:13.665506+0000","last_became_active":"2023-07-14T11:15:10.935407+0000","last_became_peered":"2023-07-14T11:15:10.935407+0000","last_unstale":"2023-07-14T11:15:13.665506+0000","last_undegraded":"2023-07-14T11:15:13.665506+0000","last_fullsized":"2023-07-14T11:15:13.665506+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:46:16.791323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.944593+0000","last_change":"2023-07-14T11:15:10.934694+0000","last_active":"2023-07-14T11:15:11.944593+0000","last_peered":"2023-07-14T11:15:11.944593+0000","last_clean":"2023-07-14T11:15:11.944593+0000","last_became_active":"2023-07-14T11:15:10.934086+0000","last_became_peered":"2023-07-14T11:15:10.934086+0000","last_unstale":"2023-07-14T11:15:11.944593+0000","last_undegraded":"2023-07-14T11:15:11.944593+0000","last_fullsized":"2023-07-14T11:15:11.944593+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:41:35.008325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.928102+0000","last_change":"2023-07-14T11:15:10.921991+0000","last_active":"2023-07-14T11:15:11.928102+0000","last_peered":"2023-07-14T11:15:11.928102+0000","last_clean":"2023-07-14T11:15:11.928102+0000","last_became_active":"2023-07-14T11:15:10.921684+0000","last_became_peered":"2023-07-14T11:15:10.921684+0000","last_unstale":"2023-07-14T11:15:11.928102+0000","last_undegraded":"2023-07-14T11:15:11.928102+0000","last_fullsized":"2023-07-14T11:15:11.928102+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:51:46.220783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.666981+0000","last_change":"2023-07-14T11:15:10.927989+0000","last_active":"2023-07-14T11:15:13.666981+0000","last_peered":"2023-07-14T11:15:13.666981+0000","last_clean":"2023-07-14T11:15:13.666981+0000","last_became_active":"2023-07-14T11:15:10.927707+0000","last_became_peered":"2023-07-14T11:15:10.927707+0000","last_unstale":"2023-07-14T11:15:13.666981+0000","last_undegraded":"2023-07-14T11:15:13.666981+0000","last_fullsized":"2023-07-14T11:15:13.666981+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:09:12.631700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.664924+0000","last_change":"2023-07-14T11:15:10.939352+0000","last_active":"2023-07-14T11:15:13.664924+0000","last_peered":"2023-07-14T11:15:13.664924+0000","last_clean":"2023-07-14T11:15:13.664924+0000","last_became_active":"2023-07-14T11:15:10.939071+0000","last_became_peered":"2023-07-14T11:15:10.939071+0000","last_unstale":"2023-07-14T11:15:13.664924+0000","last_undegraded":"2023-07-14T11:15:13.664924+0000","last_fullsized":"2023-07-14T11:15:13.664924+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:47:51.599162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.665837+0000","last_change":"2023-07-14T11:15:10.924682+0000","last_active":"2023-07-14T11:15:13.665837+0000","last_peered":"2023-07-14T11:15:13.665837+0000","last_clean":"2023-07-14T11:15:13.665837+0000","last_became_active":"2023-07-14T11:15:10.924373+0000","last_became_peered":"2023-07-14T11:15:10.924373+0000","last_unstale":"2023-07-14T11:15:13.665837+0000","last_undegraded":"2023-07-14T11:15:13.665837+0000","last_fullsized":"2023-07-14T11:15:13.665837+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:24:04.548674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.664982+0000","last_change":"2023-07-14T11:15:10.937395+0000","last_active":"2023-07-14T11:15:13.664982+0000","last_peered":"2023-07-14T11:15:13.664982+0000","last_clean":"2023-07-14T11:15:13.664982+0000","last_became_active":"2023-07-14T11:15:10.936861+0000","last_became_peered":"2023-07-14T11:15:10.936861+0000","last_unstale":"2023-07-14T11:15:13.664982+0000","last_undegraded":"2023-07-14T11:15:13.664982+0000","last_fullsized":"2023-07-14T11:15:13.664982+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:10:43.496513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.928071+0000","last_change":"2023-07-14T11:15:10.930495+0000","last_active":"2023-07-14T11:15:11.928071+0000","last_peered":"2023-07-14T11:15:11.928071+0000","last_clean":"2023-07-14T11:15:11.928071+0000","last_became_active":"2023-07-14T11:15:10.930128+0000","last_became_peered":"2023-07-14T11:15:10.930128+0000","last_unstale":"2023-07-14T11:15:11.928071+0000","last_undegraded":"2023-07-14T11:15:11.928071+0000","last_fullsized":"2023-07-14T11:15:11.928071+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:34:19.424675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.666593+0000","last_change":"2023-07-14T11:15:10.936543+0000","last_active":"2023-07-14T11:15:13.666593+0000","last_peered":"2023-07-14T11:15:13.666593+0000","last_clean":"2023-07-14T11:15:13.666593+0000","last_became_active":"2023-07-14T11:15:10.936237+0000","last_became_peered":"2023-07-14T11:15:10.936237+0000","last_unstale":"2023-07-14T11:15:13.666593+0000","last_undegraded":"2023-07-14T11:15:13.666593+0000","last_fullsized":"2023-07-14T11:15:13.666593+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:23:00.512302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"49'4","reported_seq":17,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.666777+0000","last_change":"2023-07-14T11:15:09.929802+0000","last_active":"2023-07-14T11:15:13.666777+0000","last_peered":"2023-07-14T11:15:13.666777+0000","last_clean":"2023-07-14T11:15:13.666777+0000","last_became_active":"2023-07-14T11:15:09.929501+0000","last_became_peered":"2023-07-14T11:15:09.929501+0000","last_unstale":"2023-07-14T11:15:13.666777+0000","last_undegraded":"2023-07-14T11:15:13.666777+0000","last_fullsized":"2023-07-14T11:15:13.666777+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:36:26.856627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.927840+0000","last_change":"2023-07-14T11:15:10.937809+0000","last_active":"2023-07-14T11:15:11.927840+0000","last_peered":"2023-07-14T11:15:11.927840+0000","last_clean":"2023-07-14T11:15:11.927840+0000","last_became_active":"2023-07-14T11:15:10.937523+0000","last_became_peered":"2023-07-14T11:15:10.937523+0000","last_unstale":"2023-07-14T11:15:11.927840+0000","last_undegraded":"2023-07-14T11:15:11.927840+0000","last_fullsized":"2023-07-14T11:15:11.927840+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:10:43.144347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"49'1","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.927301+0000","last_change":"2023-07-14T11:15:09.921655+0000","last_active":"2023-07-14T11:15:11.927301+0000","last_peered":"2023-07-14T11:15:11.927301+0000","last_clean":"2023-07-14T11:15:11.927301+0000","last_became_active":"2023-07-14T11:15:09.921392+0000","last_became_peered":"2023-07-14T11:15:09.921392+0000","last_unstale":"2023-07-14T11:15:11.927301+0000","last_undegraded":"2023-07-14T11:15:11.927301+0000","last_fullsized":"2023-07-14T11:15:11.927301+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:11:24.955167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.666453+0000","last_change":"2023-07-14T11:15:10.930673+0000","last_active":"2023-07-14T11:15:13.666453+0000","last_peered":"2023-07-14T11:15:13.666453+0000","last_clean":"2023-07-14T11:15:13.666453+0000","last_became_active":"2023-07-14T11:15:10.930404+0000","last_became_peered":"2023-07-14T11:15:10.930404+0000","last_unstale":"2023-07-14T11:15:13.666453+0000","last_undegraded":"2023-07-14T11:15:13.666453+0000","last_fullsized":"2023-07-14T11:15:13.666453+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:02:40.219407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"49'2","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.928081+0000","last_change":"2023-07-14T11:15:09.924119+0000","last_active":"2023-07-14T11:15:11.928081+0000","last_peered":"2023-07-14T11:15:11.928081+0000","last_clean":"2023-07-14T11:15:11.928081+0000","last_became_active":"2023-07-14T11:15:09.923816+0000","last_became_peered":"2023-07-14T11:15:09.923816+0000","last_unstale":"2023-07-14T11:15:11.928081+0000","last_undegraded":"2023-07-14T11:15:11.928081+0000","last_fullsized":"2023-07-14T11:15:11.928081+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:49:37.407502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.944206+0000","last_change":"2023-07-14T11:15:10.928459+0000","last_active":"2023-07-14T11:15:11.944206+0000","last_peered":"2023-07-14T11:15:11.944206+0000","last_clean":"2023-07-14T11:15:11.944206+0000","last_became_active":"2023-07-14T11:15:10.926974+0000","last_became_peered":"2023-07-14T11:15:10.926974+0000","last_unstale":"2023-07-14T11:15:11.944206+0000","last_undegraded":"2023-07-14T11:15:11.944206+0000","last_fullsized":"2023-07-14T11:15:11.944206+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:54:10.925414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"49'2","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.928070+0000","last_change":"2023-07-14T11:15:09.922230+0000","last_active":"2023-07-14T11:15:11.928070+0000","last_peered":"2023-07-14T11:15:11.928070+0000","last_clean":"2023-07-14T11:15:11.928070+0000","last_became_active":"2023-07-14T11:15:09.921945+0000","last_became_peered":"2023-07-14T11:15:09.921945+0000","last_unstale":"2023-07-14T11:15:11.928070+0000","last_undegraded":"2023-07-14T11:15:11.928070+0000","last_fullsized":"2023-07-14T11:15:11.928070+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:05:35.953604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.666444+0000","last_change":"2023-07-14T11:15:10.929453+0000","last_active":"2023-07-14T11:15:13.666444+0000","last_peered":"2023-07-14T11:15:13.666444+0000","last_clean":"2023-07-14T11:15:13.666444+0000","last_became_active":"2023-07-14T11:15:10.929189+0000","last_became_peered":"2023-07-14T11:15:10.929189+0000","last_unstale":"2023-07-14T11:15:13.666444+0000","last_undegraded":"2023-07-14T11:15:13.666444+0000","last_fullsized":"2023-07-14T11:15:13.666444+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:36:13.173272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"49'1","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.665006+0000","last_change":"2023-07-14T11:15:09.930314+0000","last_active":"2023-07-14T11:15:13.665006+0000","last_peered":"2023-07-14T11:15:13.665006+0000","last_clean":"2023-07-14T11:15:13.665006+0000","last_became_active":"2023-07-14T11:15:09.930070+0000","last_became_peered":"2023-07-14T11:15:09.930070+0000","last_unstale":"2023-07-14T11:15:13.665006+0000","last_undegraded":"2023-07-14T11:15:13.665006+0000","last_fullsized":"2023-07-14T11:15:13.665006+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:07:13.838418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.667346+0000","last_change":"2023-07-14T11:15:10.924358+0000","last_active":"2023-07-14T11:15:13.667346+0000","last_peered":"2023-07-14T11:15:13.667346+0000","last_clean":"2023-07-14T11:15:13.667346+0000","last_became_active":"2023-07-14T11:15:10.924097+0000","last_became_peered":"2023-07-14T11:15:10.924097+0000","last_unstale":"2023-07-14T11:15:13.667346+0000","last_undegraded":"2023-07-14T11:15:13.667346+0000","last_fullsized":"2023-07-14T11:15:13.667346+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:21:23.795838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"49'1","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.666017+0000","last_change":"2023-07-14T11:15:09.926046+0000","last_active":"2023-07-14T11:15:13.666017+0000","last_peered":"2023-07-14T11:15:13.666017+0000","last_clean":"2023-07-14T11:15:13.666017+0000","last_became_active":"2023-07-14T11:15:09.925750+0000","last_became_peered":"2023-07-14T11:15:09.925750+0000","last_unstale":"2023-07-14T11:15:13.666017+0000","last_undegraded":"2023-07-14T11:15:13.666017+0000","last_fullsized":"2023-07-14T11:15:13.666017+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:47:50.592999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.944540+0000","last_change":"2023-07-14T11:15:10.934890+0000","last_active":"2023-07-14T11:15:11.944540+0000","last_peered":"2023-07-14T11:15:11.944540+0000","last_clean":"2023-07-14T11:15:11.944540+0000","last_became_active":"2023-07-14T11:15:10.934420+0000","last_became_peered":"2023-07-14T11:15:10.934420+0000","last_unstale":"2023-07-14T11:15:11.944540+0000","last_undegraded":"2023-07-14T11:15:11.944540+0000","last_fullsized":"2023-07-14T11:15:11.944540+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:46:02.473727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.666964+0000","last_change":"2023-07-14T11:15:09.926115+0000","last_active":"2023-07-14T11:15:13.666964+0000","last_peered":"2023-07-14T11:15:13.666964+0000","last_clean":"2023-07-14T11:15:13.666964+0000","last_became_active":"2023-07-14T11:15:09.925816+0000","last_became_peered":"2023-07-14T11:15:09.925816+0000","last_unstale":"2023-07-14T11:15:13.666964+0000","last_undegraded":"2023-07-14T11:15:13.666964+0000","last_fullsized":"2023-07-14T11:15:13.666964+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:44:55.656851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.666893+0000","last_change":"2023-07-14T11:15:10.934416+0000","last_active":"2023-07-14T11:15:13.666893+0000","last_peered":"2023-07-14T11:15:13.666893+0000","last_clean":"2023-07-14T11:15:13.666893+0000","last_became_active":"2023-07-14T11:15:10.934095+0000","last_became_peered":"2023-07-14T11:15:10.934095+0000","last_unstale":"2023-07-14T11:15:13.666893+0000","last_undegraded":"2023-07-14T11:15:13.666893+0000","last_fullsized":"2023-07-14T11:15:13.666893+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:37:18.083208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.664874+0000","last_change":"2023-07-14T11:15:09.925165+0000","last_active":"2023-07-14T11:15:13.664874+0000","last_peered":"2023-07-14T11:15:13.664874+0000","last_clean":"2023-07-14T11:15:13.664874+0000","last_became_active":"2023-07-14T11:15:09.924894+0000","last_became_peered":"2023-07-14T11:15:09.924894+0000","last_unstale":"2023-07-14T11:15:13.664874+0000","last_undegraded":"2023-07-14T11:15:13.664874+0000","last_fullsized":"2023-07-14T11:15:13.664874+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:39:36.337375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.665744+0000","last_change":"2023-07-14T11:15:10.930528+0000","last_active":"2023-07-14T11:15:13.665744+0000","last_peered":"2023-07-14T11:15:13.665744+0000","last_clean":"2023-07-14T11:15:13.665744+0000","last_became_active":"2023-07-14T11:15:10.930201+0000","last_became_peered":"2023-07-14T11:15:10.930201+0000","last_unstale":"2023-07-14T11:15:13.665744+0000","last_undegraded":"2023-07-14T11:15:13.665744+0000","last_fullsized":"2023-07-14T11:15:13.665744+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:18:41.889981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.667044+0000","last_change":"2023-07-14T11:15:09.926330+0000","last_active":"2023-07-14T11:15:13.667044+0000","last_peered":"2023-07-14T11:15:13.667044+0000","last_clean":"2023-07-14T11:15:13.667044+0000","last_became_active":"2023-07-14T11:15:09.926039+0000","last_became_peered":"2023-07-14T11:15:09.926039+0000","last_unstale":"2023-07-14T11:15:13.667044+0000","last_undegraded":"2023-07-14T11:15:13.667044+0000","last_fullsized":"2023-07-14T11:15:13.667044+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:56:11.836559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.927806+0000","last_change":"2023-07-14T11:15:10.925307+0000","last_active":"2023-07-14T11:15:11.927806+0000","last_peered":"2023-07-14T11:15:11.927806+0000","last_clean":"2023-07-14T11:15:11.927806+0000","last_became_active":"2023-07-14T11:15:10.924966+0000","last_became_peered":"2023-07-14T11:15:10.924966+0000","last_unstale":"2023-07-14T11:15:11.927806+0000","last_undegraded":"2023-07-14T11:15:11.927806+0000","last_fullsized":"2023-07-14T11:15:11.927806+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:43:10.253612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.667102+0000","last_change":"2023-07-14T11:15:09.928164+0000","last_active":"2023-07-14T11:15:13.667102+0000","last_peered":"2023-07-14T11:15:13.667102+0000","last_clean":"2023-07-14T11:15:13.667102+0000","last_became_active":"2023-07-14T11:15:09.927872+0000","last_became_peered":"2023-07-14T11:15:09.927872+0000","last_unstale":"2023-07-14T11:15:13.667102+0000","last_undegraded":"2023-07-14T11:15:13.667102+0000","last_fullsized":"2023-07-14T11:15:13.667102+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:07:13.838418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.665181+0000","last_change":"2023-07-14T11:15:10.939301+0000","last_active":"2023-07-14T11:15:13.665181+0000","last_peered":"2023-07-14T11:15:13.665181+0000","last_clean":"2023-07-14T11:15:13.665181+0000","last_became_active":"2023-07-14T11:15:10.938975+0000","last_became_peered":"2023-07-14T11:15:10.938975+0000","last_unstale":"2023-07-14T11:15:13.665181+0000","last_undegraded":"2023-07-14T11:15:13.665181+0000","last_fullsized":"2023-07-14T11:15:13.665181+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:57:22.146216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"49'3","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.667452+0000","last_change":"2023-07-14T11:15:09.928283+0000","last_active":"2023-07-14T11:15:13.667452+0000","last_peered":"2023-07-14T11:15:13.667452+0000","last_clean":"2023-07-14T11:15:13.667452+0000","last_became_active":"2023-07-14T11:15:09.927756+0000","last_became_peered":"2023-07-14T11:15:09.927756+0000","last_unstale":"2023-07-14T11:15:13.667452+0000","last_undegraded":"2023-07-14T11:15:13.667452+0000","last_fullsized":"2023-07-14T11:15:13.667452+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:50:34.113216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.666219+0000","last_change":"2023-07-14T11:15:10.933062+0000","last_active":"2023-07-14T11:15:13.666219+0000","last_peered":"2023-07-14T11:15:13.666219+0000","last_clean":"2023-07-14T11:15:13.666219+0000","last_became_active":"2023-07-14T11:15:10.932772+0000","last_became_peered":"2023-07-14T11:15:10.932772+0000","last_unstale":"2023-07-14T11:15:13.666219+0000","last_undegraded":"2023-07-14T11:15:13.666219+0000","last_fullsized":"2023-07-14T11:15:13.666219+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:26:01.745154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"49'6","reported_seq":19,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.944543+0000","last_change":"2023-07-14T11:15:09.928525+0000","last_active":"2023-07-14T11:15:11.944543+0000","last_peered":"2023-07-14T11:15:11.944543+0000","last_clean":"2023-07-14T11:15:11.944543+0000","last_became_active":"2023-07-14T11:15:09.928270+0000","last_became_peered":"2023-07-14T11:15:09.928270+0000","last_unstale":"2023-07-14T11:15:11.944543+0000","last_undegraded":"2023-07-14T11:15:11.944543+0000","last_fullsized":"2023-07-14T11:15:11.944543+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:10:01.997146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.927844+0000","last_change":"2023-07-14T11:15:10.937191+0000","last_active":"2023-07-14T11:15:11.927844+0000","last_peered":"2023-07-14T11:15:11.927844+0000","last_clean":"2023-07-14T11:15:11.927844+0000","last_became_active":"2023-07-14T11:15:10.936849+0000","last_became_peered":"2023-07-14T11:15:10.936849+0000","last_unstale":"2023-07-14T11:15:11.927844+0000","last_undegraded":"2023-07-14T11:15:11.927844+0000","last_fullsized":"2023-07-14T11:15:11.927844+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:38:03.360143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"49'2","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.665085+0000","last_change":"2023-07-14T11:15:09.926581+0000","last_active":"2023-07-14T11:15:13.665085+0000","last_peered":"2023-07-14T11:15:13.665085+0000","last_clean":"2023-07-14T11:15:13.665085+0000","last_became_active":"2023-07-14T11:15:09.926305+0000","last_became_peered":"2023-07-14T11:15:09.926305+0000","last_unstale":"2023-07-14T11:15:13.665085+0000","last_undegraded":"2023-07-14T11:15:13.665085+0000","last_fullsized":"2023-07-14T11:15:13.665085+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:36:12.167108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.665327+0000","last_change":"2023-07-14T11:15:10.918903+0000","last_active":"2023-07-14T11:15:13.665327+0000","last_peered":"2023-07-14T11:15:13.665327+0000","last_clean":"2023-07-14T11:15:13.665327+0000","last_became_active":"2023-07-14T11:15:10.918595+0000","last_became_peered":"2023-07-14T11:15:10.918595+0000","last_unstale":"2023-07-14T11:15:13.665327+0000","last_undegraded":"2023-07-14T11:15:13.665327+0000","last_fullsized":"2023-07-14T11:15:13.665327+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:35:35.011670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.666593+0000","last_change":"2023-07-14T11:15:09.925179+0000","last_active":"2023-07-14T11:15:13.666593+0000","last_peered":"2023-07-14T11:15:13.666593+0000","last_clean":"2023-07-14T11:15:13.666593+0000","last_became_active":"2023-07-14T11:15:09.924920+0000","last_became_peered":"2023-07-14T11:15:09.924920+0000","last_unstale":"2023-07-14T11:15:13.666593+0000","last_undegraded":"2023-07-14T11:15:13.666593+0000","last_fullsized":"2023-07-14T11:15:13.666593+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:21:54.253623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.944459+0000","last_change":"2023-07-14T11:15:10.936810+0000","last_active":"2023-07-14T11:15:11.944459+0000","last_peered":"2023-07-14T11:15:11.944459+0000","last_clean":"2023-07-14T11:15:11.944459+0000","last_became_active":"2023-07-14T11:15:10.936529+0000","last_became_peered":"2023-07-14T11:15:10.936529+0000","last_unstale":"2023-07-14T11:15:11.944459+0000","last_undegraded":"2023-07-14T11:15:11.944459+0000","last_fullsized":"2023-07-14T11:15:11.944459+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:16:25.661287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.666497+0000","last_change":"2023-07-14T11:15:09.927381+0000","last_active":"2023-07-14T11:15:13.666497+0000","last_peered":"2023-07-14T11:15:13.666497+0000","last_clean":"2023-07-14T11:15:13.666497+0000","last_became_active":"2023-07-14T11:15:09.927064+0000","last_became_peered":"2023-07-14T11:15:09.927064+0000","last_unstale":"2023-07-14T11:15:13.666497+0000","last_undegraded":"2023-07-14T11:15:13.666497+0000","last_fullsized":"2023-07-14T11:15:13.666497+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:25:35.098442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.665450+0000","last_change":"2023-07-14T11:15:10.931492+0000","last_active":"2023-07-14T11:15:13.665450+0000","last_peered":"2023-07-14T11:15:13.665450+0000","last_clean":"2023-07-14T11:15:13.665450+0000","last_became_active":"2023-07-14T11:15:10.930836+0000","last_became_peered":"2023-07-14T11:15:10.930836+0000","last_unstale":"2023-07-14T11:15:13.665450+0000","last_undegraded":"2023-07-14T11:15:13.665450+0000","last_fullsized":"2023-07-14T11:15:13.665450+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:10:03.003309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"49'8","reported_seq":21,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.944348+0000","last_change":"2023-07-14T11:15:09.928241+0000","last_active":"2023-07-14T11:15:11.944348+0000","last_peered":"2023-07-14T11:15:11.944348+0000","last_clean":"2023-07-14T11:15:11.944348+0000","last_became_active":"2023-07-14T11:15:09.927889+0000","last_became_peered":"2023-07-14T11:15:09.927889+0000","last_unstale":"2023-07-14T11:15:11.944348+0000","last_undegraded":"2023-07-14T11:15:11.944348+0000","last_fullsized":"2023-07-14T11:15:11.944348+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:32:31.151441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.944141+0000","last_change":"2023-07-14T11:15:10.925504+0000","last_active":"2023-07-14T11:15:11.944141+0000","last_peered":"2023-07-14T11:15:11.944141+0000","last_clean":"2023-07-14T11:15:11.944141+0000","last_became_active":"2023-07-14T11:15:10.925239+0000","last_became_peered":"2023-07-14T11:15:10.925239+0000","last_unstale":"2023-07-14T11:15:11.944141+0000","last_undegraded":"2023-07-14T11:15:11.944141+0000","last_fullsized":"2023-07-14T11:15:11.944141+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:07:14.844582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"49'1","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.665400+0000","last_change":"2023-07-14T11:15:09.927305+0000","last_active":"2023-07-14T11:15:13.665400+0000","last_peered":"2023-07-14T11:15:13.665400+0000","last_clean":"2023-07-14T11:15:13.665400+0000","last_became_active":"2023-07-14T11:15:09.927040+0000","last_became_peered":"2023-07-14T11:15:09.927040+0000","last_unstale":"2023-07-14T11:15:13.665400+0000","last_undegraded":"2023-07-14T11:15:13.665400+0000","last_fullsized":"2023-07-14T11:15:13.665400+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:15:59.518564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.927332+0000","last_change":"2023-07-14T11:15:10.919741+0000","last_active":"2023-07-14T11:15:11.927332+0000","last_peered":"2023-07-14T11:15:11.927332+0000","last_clean":"2023-07-14T11:15:11.927332+0000","last_became_active":"2023-07-14T11:15:10.919457+0000","last_became_peered":"2023-07-14T11:15:10.919457+0000","last_unstale":"2023-07-14T11:15:11.927332+0000","last_undegraded":"2023-07-14T11:15:11.927332+0000","last_fullsized":"2023-07-14T11:15:11.927332+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:33:50.392750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"49'2","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.927593+0000","last_change":"2023-07-14T11:15:09.929235+0000","last_active":"2023-07-14T11:15:11.927593+0000","last_peered":"2023-07-14T11:15:11.927593+0000","last_clean":"2023-07-14T11:15:11.927593+0000","last_became_active":"2023-07-14T11:15:09.928960+0000","last_became_peered":"2023-07-14T11:15:09.928960+0000","last_unstale":"2023-07-14T11:15:11.927593+0000","last_undegraded":"2023-07-14T11:15:11.927593+0000","last_fullsized":"2023-07-14T11:15:11.927593+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:00:17.861115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.665936+0000","last_change":"2023-07-14T11:15:10.928899+0000","last_active":"2023-07-14T11:15:13.665936+0000","last_peered":"2023-07-14T11:15:13.665936+0000","last_clean":"2023-07-14T11:15:13.665936+0000","last_became_active":"2023-07-14T11:15:10.928567+0000","last_became_peered":"2023-07-14T11:15:10.928567+0000","last_unstale":"2023-07-14T11:15:13.665936+0000","last_undegraded":"2023-07-14T11:15:13.665936+0000","last_fullsized":"2023-07-14T11:15:13.665936+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:39:37.343538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"49'1","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.667166+0000","last_change":"2023-07-14T11:15:09.924426+0000","last_active":"2023-07-14T11:15:13.667166+0000","last_peered":"2023-07-14T11:15:13.667166+0000","last_clean":"2023-07-14T11:15:13.667166+0000","last_became_active":"2023-07-14T11:15:09.924111+0000","last_became_peered":"2023-07-14T11:15:09.924111+0000","last_unstale":"2023-07-14T11:15:13.667166+0000","last_undegraded":"2023-07-14T11:15:13.667166+0000","last_fullsized":"2023-07-14T11:15:13.667166+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:00:03.846732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.927363+0000","last_change":"2023-07-14T11:15:10.924665+0000","last_active":"2023-07-14T11:15:11.927363+0000","last_peered":"2023-07-14T11:15:11.927363+0000","last_clean":"2023-07-14T11:15:11.927363+0000","last_became_active":"2023-07-14T11:15:10.924404+0000","last_became_peered":"2023-07-14T11:15:10.924404+0000","last_unstale":"2023-07-14T11:15:11.927363+0000","last_undegraded":"2023-07-14T11:15:11.927363+0000","last_fullsized":"2023-07-14T11:15:11.927363+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:18:20.380084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.666564+0000","last_change":"2023-07-14T11:15:09.926848+0000","last_active":"2023-07-14T11:15:13.666564+0000","last_peered":"2023-07-14T11:15:13.666564+0000","last_clean":"2023-07-14T11:15:13.666564+0000","last_became_active":"2023-07-14T11:15:09.926521+0000","last_became_peered":"2023-07-14T11:15:09.926521+0000","last_unstale":"2023-07-14T11:15:13.666564+0000","last_undegraded":"2023-07-14T11:15:13.666564+0000","last_fullsized":"2023-07-14T11:15:13.666564+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:53:03.155971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.927854+0000","last_change":"2023-07-14T11:15:10.926591+0000","last_active":"2023-07-14T11:15:11.927854+0000","last_peered":"2023-07-14T11:15:11.927854+0000","last_clean":"2023-07-14T11:15:11.927854+0000","last_became_active":"2023-07-14T11:15:10.926265+0000","last_became_peered":"2023-07-14T11:15:10.926265+0000","last_unstale":"2023-07-14T11:15:11.927854+0000","last_undegraded":"2023-07-14T11:15:11.927854+0000","last_fullsized":"2023-07-14T11:15:11.927854+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:20:31.352270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"49'2","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.927222+0000","last_change":"2023-07-14T11:15:09.923168+0000","last_active":"2023-07-14T11:15:11.927222+0000","last_peered":"2023-07-14T11:15:11.927222+0000","last_clean":"2023-07-14T11:15:11.927222+0000","last_became_active":"2023-07-14T11:15:09.922855+0000","last_became_peered":"2023-07-14T11:15:09.922855+0000","last_unstale":"2023-07-14T11:15:11.927222+0000","last_undegraded":"2023-07-14T11:15:11.927222+0000","last_fullsized":"2023-07-14T11:15:11.927222+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:46:15.785160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.666946+0000","last_change":"2023-07-14T11:15:10.928049+0000","last_active":"2023-07-14T11:15:13.666946+0000","last_peered":"2023-07-14T11:15:13.666946+0000","last_clean":"2023-07-14T11:15:13.666946+0000","last_became_active":"2023-07-14T11:15:10.927790+0000","last_became_peered":"2023-07-14T11:15:10.927790+0000","last_unstale":"2023-07-14T11:15:13.666946+0000","last_undegraded":"2023-07-14T11:15:13.666946+0000","last_fullsized":"2023-07-14T11:15:13.666946+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:38:07.291071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.944089+0000","last_change":"2023-07-14T11:15:09.928441+0000","last_active":"2023-07-14T11:15:11.944089+0000","last_peered":"2023-07-14T11:15:11.944089+0000","last_clean":"2023-07-14T11:15:11.944089+0000","last_became_active":"2023-07-14T11:15:09.928121+0000","last_became_peered":"2023-07-14T11:15:09.928121+0000","last_unstale":"2023-07-14T11:15:11.944089+0000","last_undegraded":"2023-07-14T11:15:11.944089+0000","last_fullsized":"2023-07-14T11:15:11.944089+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:36:12.167108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.665351+0000","last_change":"2023-07-14T11:15:10.929419+0000","last_active":"2023-07-14T11:15:13.665351+0000","last_peered":"2023-07-14T11:15:13.665351+0000","last_clean":"2023-07-14T11:15:13.665351+0000","last_became_active":"2023-07-14T11:15:10.929112+0000","last_became_peered":"2023-07-14T11:15:10.929112+0000","last_unstale":"2023-07-14T11:15:13.665351+0000","last_undegraded":"2023-07-14T11:15:13.665351+0000","last_fullsized":"2023-07-14T11:15:13.665351+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:16:25.661287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.665432+0000","last_change":"2023-07-14T11:15:09.929803+0000","last_active":"2023-07-14T11:15:13.665432+0000","last_peered":"2023-07-14T11:15:13.665432+0000","last_clean":"2023-07-14T11:15:13.665432+0000","last_became_active":"2023-07-14T11:15:09.929513+0000","last_became_peered":"2023-07-14T11:15:09.929513+0000","last_unstale":"2023-07-14T11:15:13.665432+0000","last_undegraded":"2023-07-14T11:15:13.665432+0000","last_fullsized":"2023-07-14T11:15:13.665432+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:46:01.467563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.927848+0000","last_change":"2023-07-14T11:15:10.931167+0000","last_active":"2023-07-14T11:15:11.927848+0000","last_peered":"2023-07-14T11:15:11.927848+0000","last_clean":"2023-07-14T11:15:11.927848+0000","last_became_active":"2023-07-14T11:15:10.930862+0000","last_became_peered":"2023-07-14T11:15:10.930862+0000","last_unstale":"2023-07-14T11:15:11.927848+0000","last_undegraded":"2023-07-14T11:15:11.927848+0000","last_fullsized":"2023-07-14T11:15:11.927848+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:18:46.168855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.926705+0000","last_change":"2023-07-14T11:15:09.929305+0000","last_active":"2023-07-14T11:15:11.926705+0000","last_peered":"2023-07-14T11:15:11.926705+0000","last_clean":"2023-07-14T11:15:11.926705+0000","last_became_active":"2023-07-14T11:15:09.929031+0000","last_became_peered":"2023-07-14T11:15:09.929031+0000","last_unstale":"2023-07-14T11:15:11.926705+0000","last_undegraded":"2023-07-14T11:15:11.926705+0000","last_fullsized":"2023-07-14T11:15:11.926705+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:20:41.162108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.665158+0000","last_change":"2023-07-14T11:15:10.935840+0000","last_active":"2023-07-14T11:15:13.665158+0000","last_peered":"2023-07-14T11:15:13.665158+0000","last_clean":"2023-07-14T11:15:13.665158+0000","last_became_active":"2023-07-14T11:15:10.935573+0000","last_became_peered":"2023-07-14T11:15:10.935573+0000","last_unstale":"2023-07-14T11:15:13.665158+0000","last_undegraded":"2023-07-14T11:15:13.665158+0000","last_fullsized":"2023-07-14T11:15:13.665158+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:28:46.603191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.665838+0000","last_change":"2023-07-14T11:15:09.930870+0000","last_active":"2023-07-14T11:15:13.665838+0000","last_peered":"2023-07-14T11:15:13.665838+0000","last_clean":"2023-07-14T11:15:13.665838+0000","last_became_active":"2023-07-14T11:15:09.930528+0000","last_became_peered":"2023-07-14T11:15:09.930528+0000","last_unstale":"2023-07-14T11:15:13.665838+0000","last_undegraded":"2023-07-14T11:15:13.665838+0000","last_fullsized":"2023-07-14T11:15:13.665838+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:25:47.534232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":74,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.927566+0000","last_change":"2023-07-14T11:13:08.923786+0000","last_active":"2023-07-14T11:15:11.927566+0000","last_peered":"2023-07-14T11:15:11.927566+0000","last_clean":"2023-07-14T11:15:11.927566+0000","last_became_active":"2023-07-14T11:13:08.923384+0000","last_became_peered":"2023-07-14T11:13:08.923384+0000","last_unstale":"2023-07-14T11:15:11.927566+0000","last_undegraded":"2023-07-14T11:15:11.927566+0000","last_fullsized":"2023-07-14T11:15:11.927566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:05:37.474620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.927941+0000","last_change":"2023-07-14T11:15:10.928257+0000","last_active":"2023-07-14T11:15:11.927941+0000","last_peered":"2023-07-14T11:15:11.927941+0000","last_clean":"2023-07-14T11:15:11.927941+0000","last_became_active":"2023-07-14T11:15:10.927918+0000","last_became_peered":"2023-07-14T11:15:10.927918+0000","last_unstale":"2023-07-14T11:15:11.927941+0000","last_undegraded":"2023-07-14T11:15:11.927941+0000","last_fullsized":"2023-07-14T11:15:11.927941+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:46:56.463796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"49'2","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.667104+0000","last_change":"2023-07-14T11:15:09.928459+0000","last_active":"2023-07-14T11:15:13.667104+0000","last_peered":"2023-07-14T11:15:13.667104+0000","last_clean":"2023-07-14T11:15:13.667104+0000","last_became_active":"2023-07-14T11:15:09.928095+0000","last_became_peered":"2023-07-14T11:15:09.928095+0000","last_unstale":"2023-07-14T11:15:13.667104+0000","last_undegraded":"2023-07-14T11:15:13.667104+0000","last_fullsized":"2023-07-14T11:15:13.667104+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:44:18.599797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":70,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.927769+0000","last_change":"2023-07-14T11:13:08.758749+0000","last_active":"2023-07-14T11:15:11.927769+0000","last_peered":"2023-07-14T11:15:11.927769+0000","last_clean":"2023-07-14T11:15:11.927769+0000","last_became_active":"2023-07-14T11:13:08.757956+0000","last_became_peered":"2023-07-14T11:13:08.757956+0000","last_unstale":"2023-07-14T11:15:11.927769+0000","last_undegraded":"2023-07-14T11:15:11.927769+0000","last_fullsized":"2023-07-14T11:15:11.927769+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:39:52.335073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.944276+0000","last_change":"2023-07-14T11:15:10.928624+0000","last_active":"2023-07-14T11:15:11.944276+0000","last_peered":"2023-07-14T11:15:11.944276+0000","last_clean":"2023-07-14T11:15:11.944276+0000","last_became_active":"2023-07-14T11:15:10.928183+0000","last_became_peered":"2023-07-14T11:15:10.928183+0000","last_unstale":"2023-07-14T11:15:11.944276+0000","last_undegraded":"2023-07-14T11:15:11.944276+0000","last_fullsized":"2023-07-14T11:15:11.944276+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:46:07.655019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.665324+0000","last_change":"2023-07-14T11:15:09.931330+0000","last_active":"2023-07-14T11:15:13.665324+0000","last_peered":"2023-07-14T11:15:13.665324+0000","last_clean":"2023-07-14T11:15:13.665324+0000","last_became_active":"2023-07-14T11:15:09.931069+0000","last_became_peered":"2023-07-14T11:15:09.931069+0000","last_unstale":"2023-07-14T11:15:13.665324+0000","last_undegraded":"2023-07-14T11:15:13.665324+0000","last_fullsized":"2023-07-14T11:15:13.665324+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:45:27.284598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":74,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.927004+0000","last_change":"2023-07-14T11:13:08.862331+0000","last_active":"2023-07-14T11:15:11.927004+0000","last_peered":"2023-07-14T11:15:11.927004+0000","last_clean":"2023-07-14T11:15:11.927004+0000","last_became_active":"2023-07-14T11:13:08.861817+0000","last_became_peered":"2023-07-14T11:13:08.861817+0000","last_unstale":"2023-07-14T11:15:11.927004+0000","last_undegraded":"2023-07-14T11:15:11.927004+0000","last_fullsized":"2023-07-14T11:15:11.927004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:14:21.289970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.666793+0000","last_change":"2023-07-14T11:15:10.928480+0000","last_active":"2023-07-14T11:15:13.666793+0000","last_peered":"2023-07-14T11:15:13.666793+0000","last_clean":"2023-07-14T11:15:13.666793+0000","last_became_active":"2023-07-14T11:15:10.928241+0000","last_became_peered":"2023-07-14T11:15:10.928241+0000","last_unstale":"2023-07-14T11:15:13.666793+0000","last_undegraded":"2023-07-14T11:15:13.666793+0000","last_fullsized":"2023-07-14T11:15:13.666793+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:52:43.605709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.665466+0000","last_change":"2023-07-14T11:15:09.928418+0000","last_active":"2023-07-14T11:15:13.665466+0000","last_peered":"2023-07-14T11:15:13.665466+0000","last_clean":"2023-07-14T11:15:13.665466+0000","last_became_active":"2023-07-14T11:15:09.927987+0000","last_became_peered":"2023-07-14T11:15:09.927987+0000","last_unstale":"2023-07-14T11:15:13.665466+0000","last_undegraded":"2023-07-14T11:15:13.665466+0000","last_fullsized":"2023-07-14T11:15:13.665466+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:41:34.002161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":70,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.927780+0000","last_change":"2023-07-14T11:13:08.757882+0000","last_active":"2023-07-14T11:15:11.927780+0000","last_peered":"2023-07-14T11:15:11.927780+0000","last_clean":"2023-07-14T11:15:11.927780+0000","last_became_active":"2023-07-14T11:13:08.757541+0000","last_became_peered":"2023-07-14T11:13:08.757541+0000","last_unstale":"2023-07-14T11:15:11.927780+0000","last_undegraded":"2023-07-14T11:15:11.927780+0000","last_fullsized":"2023-07-14T11:15:11.927780+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:17:38.570250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":222,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.666732+0000","last_change":"2023-07-14T11:13:01.370649+0000","last_active":"2023-07-14T11:15:13.666732+0000","last_peered":"2023-07-14T11:15:13.666732+0000","last_clean":"2023-07-14T11:15:13.666732+0000","last_became_active":"2023-07-14T11:13:01.369478+0000","last_became_peered":"2023-07-14T11:13:01.369478+0000","last_unstale":"2023-07-14T11:15:13.666732+0000","last_undegraded":"2023-07-14T11:15:13.666732+0000","last_fullsized":"2023-07-14T11:15:13.666732+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:00.254800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:00.254800+0000","last_clean_scrub_stamp":"2023-07-14T11:13:00.254800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:30:38.682327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.927656+0000","last_change":"2023-07-14T11:15:10.925992+0000","last_active":"2023-07-14T11:15:11.927656+0000","last_peered":"2023-07-14T11:15:11.927656+0000","last_clean":"2023-07-14T11:15:11.927656+0000","last_became_active":"2023-07-14T11:15:10.925169+0000","last_became_peered":"2023-07-14T11:15:10.925169+0000","last_unstale":"2023-07-14T11:15:11.927656+0000","last_undegraded":"2023-07-14T11:15:11.927656+0000","last_fullsized":"2023-07-14T11:15:11.927656+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:19:13.701808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.667488+0000","last_change":"2023-07-14T11:15:09.927770+0000","last_active":"2023-07-14T11:15:13.667488+0000","last_peered":"2023-07-14T11:15:13.667488+0000","last_clean":"2023-07-14T11:15:13.667488+0000","last_became_active":"2023-07-14T11:15:09.927446+0000","last_became_peered":"2023-07-14T11:15:09.927446+0000","last_unstale":"2023-07-14T11:15:13.667488+0000","last_undegraded":"2023-07-14T11:15:13.667488+0000","last_fullsized":"2023-07-14T11:15:13.667488+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:23:32.593440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":66,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.666751+0000","last_change":"2023-07-14T11:13:08.760609+0000","last_active":"2023-07-14T11:15:13.666751+0000","last_peered":"2023-07-14T11:15:13.666751+0000","last_clean":"2023-07-14T11:15:13.666751+0000","last_became_active":"2023-07-14T11:13:08.760285+0000","last_became_peered":"2023-07-14T11:13:08.760285+0000","last_unstale":"2023-07-14T11:15:13.666751+0000","last_undegraded":"2023-07-14T11:15:13.666751+0000","last_fullsized":"2023-07-14T11:15:13.666751+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:33:22.465964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.944634+0000","last_change":"2023-07-14T11:15:10.928142+0000","last_active":"2023-07-14T11:15:11.944634+0000","last_peered":"2023-07-14T11:15:11.944634+0000","last_clean":"2023-07-14T11:15:11.944634+0000","last_became_active":"2023-07-14T11:15:10.926916+0000","last_became_peered":"2023-07-14T11:15:10.926916+0000","last_unstale":"2023-07-14T11:15:11.944634+0000","last_undegraded":"2023-07-14T11:15:11.944634+0000","last_fullsized":"2023-07-14T11:15:11.944634+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:46:16.791323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.928101+0000","last_change":"2023-07-14T11:15:09.923995+0000","last_active":"2023-07-14T11:15:11.928101+0000","last_peered":"2023-07-14T11:15:11.928101+0000","last_clean":"2023-07-14T11:15:11.928101+0000","last_became_active":"2023-07-14T11:15:09.923504+0000","last_became_peered":"2023-07-14T11:15:09.923504+0000","last_unstale":"2023-07-14T11:15:11.928101+0000","last_undegraded":"2023-07-14T11:15:11.928101+0000","last_fullsized":"2023-07-14T11:15:11.928101+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:41:49.032709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":66,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.667646+0000","last_change":"2023-07-14T11:13:08.923899+0000","last_active":"2023-07-14T11:15:13.667646+0000","last_peered":"2023-07-14T11:15:13.667646+0000","last_clean":"2023-07-14T11:15:13.667646+0000","last_became_active":"2023-07-14T11:13:08.923513+0000","last_became_peered":"2023-07-14T11:13:08.923513+0000","last_unstale":"2023-07-14T11:15:13.667646+0000","last_undegraded":"2023-07-14T11:15:13.667646+0000","last_fullsized":"2023-07-14T11:15:13.667646+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:23:52.469310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.665192+0000","last_change":"2023-07-14T11:15:10.938216+0000","last_active":"2023-07-14T11:15:13.665192+0000","last_peered":"2023-07-14T11:15:13.665192+0000","last_clean":"2023-07-14T11:15:13.665192+0000","last_became_active":"2023-07-14T11:15:10.937942+0000","last_became_peered":"2023-07-14T11:15:10.937942+0000","last_unstale":"2023-07-14T11:15:13.665192+0000","last_undegraded":"2023-07-14T11:15:13.665192+0000","last_fullsized":"2023-07-14T11:15:13.665192+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:46:07.655019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.944355+0000","last_change":"2023-07-14T11:15:09.928608+0000","last_active":"2023-07-14T11:15:11.944355+0000","last_peered":"2023-07-14T11:15:11.944355+0000","last_clean":"2023-07-14T11:15:11.944355+0000","last_became_active":"2023-07-14T11:15:09.927944+0000","last_became_peered":"2023-07-14T11:15:09.927944+0000","last_unstale":"2023-07-14T11:15:11.944355+0000","last_undegraded":"2023-07-14T11:15:11.944355+0000","last_fullsized":"2023-07-14T11:15:11.944355+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:35:34.005507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":73,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.927425+0000","last_change":"2023-07-14T11:13:08.761726+0000","last_active":"2023-07-14T11:15:11.927425+0000","last_peered":"2023-07-14T11:15:11.927425+0000","last_clean":"2023-07-14T11:15:11.927425+0000","last_became_active":"2023-07-14T11:13:08.761365+0000","last_became_peered":"2023-07-14T11:13:08.761365+0000","last_unstale":"2023-07-14T11:15:11.927425+0000","last_undegraded":"2023-07-14T11:15:11.927425+0000","last_fullsized":"2023-07-14T11:15:11.927425+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:24:20.544830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.927740+0000","last_change":"2023-07-14T11:15:10.934577+0000","last_active":"2023-07-14T11:15:11.927740+0000","last_peered":"2023-07-14T11:15:11.927740+0000","last_clean":"2023-07-14T11:15:11.927740+0000","last_became_active":"2023-07-14T11:15:10.934249+0000","last_became_peered":"2023-07-14T11:15:10.934249+0000","last_unstale":"2023-07-14T11:15:11.927740+0000","last_undegraded":"2023-07-14T11:15:11.927740+0000","last_fullsized":"2023-07-14T11:15:11.927740+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:09.896778+0000","last_clean_scrub_stamp":"2023-07-14T11:15:09.896778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:39:50.567419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:11.944259+0000","last_change":"2023-07-14T11:15:09.928400+0000","last_active":"2023-07-14T11:15:11.944259+0000","last_peered":"2023-07-14T11:15:11.944259+0000","last_clean":"2023-07-14T11:15:11.944259+0000","last_became_active":"2023-07-14T11:15:09.928137+0000","last_became_peered":"2023-07-14T11:15:09.928137+0000","last_unstale":"2023-07-14T11:15:11.944259+0000","last_undegraded":"2023-07-14T11:15:11.944259+0000","last_fullsized":"2023-07-14T11:15:11.944259+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:15:08.890615+0000","last_clean_scrub_stamp":"2023-07-14T11:15:08.890615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:57:21.140052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":69,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-07-14T11:15:13.667236+0000","last_change":"2023-07-14T11:13:08.762084+0000","last_active":"2023-07-14T11:15:13.667236+0000","last_peered":"2023-07-14T11:15:13.667236+0000","last_clean":"2023-07-14T11:15:13.667236+0000","last_became_active":"2023-07-14T11:13:08.761763+0000","last_became_peered":"2023-07-14T11:13:08.761763+0000","last_unstale":"2023-07-14T11:15:13.667236+0000","last_undegraded":"2023-07-14T11:15:13.667236+0000","last_fullsized":"2023-07-14T11:15:13.667236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:59:32.144323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574879,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28116,"kb_used_data":1164,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343724,"statfs":{"total":96636764160,"available":96607973376,"internally_reserved":0,"allocated":1191936,"data_stored":845736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.93200000000000005,"15min":0.98399999999999999},"min":{"1min":0.47199999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.877,"5min":8.4339999999999993,"15min":8.4339999999999993},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.97099999999999997,"15min":1.0209999999999999},"min":{"1min":0.52300000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.91600000000000004,"5min":8.4559999999999995,"15min":8.4559999999999995},"last":0.65900000000000003}]},{"osd":1,"last update":"Fri Jul 14 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.90000000000000002,"15min":0.94699999999999995},"min":{"1min":0.40400000000000003,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.84499999999999997,"5min":6.3520000000000003,"15min":6.3520000000000003},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":1.079,"15min":1.149},"min":{"1min":0.46400000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.86099999999999999,"5min":6.8550000000000004,"15min":6.8550000000000004},"last":0.745}]},{"osd":2,"last update":"Fri Jul 14 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":1.1359999999999999,"15min":1.212},"min":{"1min":0.51100000000000001,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.95599999999999996,"5min":7.0289999999999999,"15min":7.0289999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.69399999999999995,"15min":0.68999999999999995},"min":{"1min":0.51600000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.98199999999999998,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.72399999999999998}]},{"osd":3,"last update":"Fri Jul 14 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":1.1930000000000001,"15min":1.2769999999999999},"min":{"1min":0.58299999999999996,"5min":0.505,"15min":0.505},"max":{"1min":0.85999999999999999,"5min":10.337,"15min":10.337},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.77200000000000002,"15min":0.77300000000000002},"min":{"1min":0.60199999999999998,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.93300000000000005,"5min":1.921,"15min":1.921},"last":0.63500000000000001}]},{"osd":4,"last update":"Fri Jul 14 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.60099999999999998,"15min":0.58299999999999996},"min":{"1min":0.41499999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.70699999999999996,"15min":0.69599999999999995},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.76400000000000001}]},{"osd":5,"last update":"Fri Jul 14 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.68000000000000005,"15min":0.67200000000000004},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.74399999999999999,"15min":0.73399999999999999},"min":{"1min":0.60399999999999998,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.94399999999999995}]},{"osd":6,"last update":"Fri Jul 14 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.68200000000000005,"15min":0.66800000000000004},"min":{"1min":0.498,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.69299999999999995,"15min":0.68100000000000005},"min":{"1min":0.55800000000000005,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.81000000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574880,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27536,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":598016,"data_stored":255896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.71199999999999997,"15min":0.70699999999999996},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.752,"5min":0.72199999999999998,"15min":0.71699999999999997},"min":{"1min":0.51300000000000001,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.68100000000000005}]},{"osd":1,"last update":"Fri Jul 14 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.68200000000000005,"15min":0.67900000000000005},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.751,"5min":0.71499999999999997,"15min":0.70899999999999996},"min":{"1min":0.42299999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.60799999999999998}]},{"osd":2,"last update":"Fri Jul 14 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.67400000000000004,"15min":0.67000000000000004},"min":{"1min":0.45500000000000002,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.78300000000000003,"15min":0.78500000000000003},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.54800000000000004}]},{"osd":3,"last update":"Fri Jul 14 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.749,"15min":0.749},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.749,"15min":0.74399999999999999},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.53200000000000003}]},{"osd":4,"last update":"Fri Jul 14 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.71199999999999997,"15min":0.71399999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.712,"5min":1.712,"15min":1.712},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.73499999999999999,"15min":0.73099999999999998},"min":{"1min":0.438,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.70299999999999996}]},{"osd":5,"last update":"Fri Jul 14 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.73799999999999999,"15min":0.72599999999999998},"min":{"1min":0.52700000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":2.8820000000000001,"5min":2.8820000000000001,"15min":2.8820000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.78800000000000003,"15min":0.79300000000000004},"min":{"1min":0.46100000000000002,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.95099999999999996,"5min":1.129,"15min":1.129},"last":0.747}]},{"osd":7,"last update":"Fri Jul 14 11:15:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.80500000000000005,"15min":0.80900000000000005},"min":{"1min":0.49199999999999999,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.79500000000000004,"15min":0.79900000000000004},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.55,"5min":1.55,"15min":1.55},"last":0.625}]}]},{"osd":1,"up_from":13,"seq":55834574879,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27536,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":598016,"data_stored":255404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.439,"15min":0.443},"min":{"1min":0.28299999999999997,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.59099999999999997,"5min":0.996,"15min":0.996},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.47399999999999998,"15min":0.48199999999999998},"min":{"1min":0.30199999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.81599999999999995,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.42699999999999999}]},{"osd":2,"last update":"Fri Jul 14 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.56499999999999995,"15min":0.57699999999999996},"min":{"1min":0.374,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.68600000000000005,"5min":2.476,"15min":2.476},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.61099999999999999,"15min":0.63600000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.70499999999999996,"5min":2.6299999999999999,"15min":2.6299999999999999},"last":0.503}]},{"osd":3,"last update":"Fri Jul 14 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51700000000000002,"15min":0.51800000000000002},"min":{"1min":0.39300000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.65200000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.48899999999999999,"15min":0.496},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.65700000000000003,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.48699999999999999}]},{"osd":4,"last update":"Fri Jul 14 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.75,"15min":0.753},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0149999999999999,"5min":1.363,"15min":1.363},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.054,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.70199999999999996}]},{"osd":5,"last update":"Fri Jul 14 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.77900000000000003,"15min":0.77500000000000002},"min":{"1min":0.53100000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.1739999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.81799999999999995,"15min":0.82599999999999996},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.095,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.59299999999999997}]},{"osd":6,"last update":"Fri Jul 14 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.79700000000000004,"15min":0.80500000000000005},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.141,"5min":1.298,"15min":1.298},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.78600000000000003,"15min":0.79000000000000004},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.123,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.82099999999999995}]},{"osd":7,"last update":"Fri Jul 14 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.82499999999999996,"15min":0.82899999999999996},"min":{"1min":0.61899999999999999,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.2010000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.78600000000000003,"15min":0.79100000000000004},"min":{"1min":0.55000000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.92700000000000005,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.72799999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28116,"kb_used_data":1164,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343724,"statfs":{"total":96636764160,"available":96607973376,"internally_reserved":0,"allocated":1191936,"data_stored":845668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.42999999999999999,"15min":0.432},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.64000000000000001,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.434,"15min":0.438},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.35299999999999998}]},{"osd":2,"last update":"Fri Jul 14 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.45700000000000002,"15min":0.45900000000000002},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.65000000000000002,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.499},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.498,"15min":0.502},"min":{"1min":0.376,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.64300000000000002,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.38700000000000001}]},{"osd":3,"last update":"Fri Jul 14 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.42099999999999999,"15min":0.41799999999999998},"min":{"1min":0.32000000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.499,"5min":0.51900000000000002,"15min":0.52300000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.45800000000000002}]},{"osd":4,"last update":"Fri Jul 14 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.75700000000000001,"15min":0.76400000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.90500000000000003,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.69899999999999995,"15min":0.69699999999999995},"min":{"1min":0.54400000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.621}]},{"osd":5,"last update":"Fri Jul 14 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.71499999999999997,"15min":0.71899999999999997},"min":{"1min":0.502,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.83299999999999996,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.629},{"interface":"front","average":{"1min":0.745,"5min":0.77400000000000002,"15min":0.77900000000000003},"min":{"1min":0.54400000000000004,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.93500000000000005,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.74399999999999999}]},{"osd":6,"last update":"Fri Jul 14 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.71399999999999997,"15min":0.71799999999999997},"min":{"1min":0.59699999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.83899999999999997,"5min":1.006,"15min":1.006},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.77100000000000002,"15min":0.77800000000000002},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.89200000000000002,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.73199999999999998}]},{"osd":7,"last update":"Fri Jul 14 11:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.80900000000000005,"15min":0.81999999999999995},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":0.91300000000000003,"5min":1.149,"15min":1.149},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.57599999999999996,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.94899999999999995,"5min":1.081,"15min":1.081},"last":0.70399999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27540,"kb_used_data":588,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":602112,"data_stored":256808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.44600000000000001,"15min":0.45300000000000001},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.58199999999999996,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.442,"15min":0.44600000000000001},"min":{"1min":0.33000000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.66300000000000003,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.5}]},{"osd":1,"last update":"Fri Jul 14 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.48399999999999999,"15min":0.48799999999999999},"min":{"1min":0.371,"5min":0.31,"15min":0.31},"max":{"1min":0.63500000000000001,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48999999999999999,"15min":0.49099999999999999},"min":{"1min":0.36199999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.60099999999999998,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.46300000000000002}]},{"osd":3,"last update":"Fri Jul 14 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.49299999999999999,"15min":0.495},"min":{"1min":0.34200000000000003,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.63200000000000001,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.58099999999999996,"15min":0.58799999999999997},"min":{"1min":0.44900000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.67300000000000004,"5min":1.034,"15min":1.034},"last":0.44}]},{"osd":4,"last update":"Fri Jul 14 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.76400000000000001,"15min":0.77300000000000002},"min":{"1min":0.55300000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.93300000000000005,"5min":1.212,"15min":1.212},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.78200000000000003,"15min":0.79000000000000004},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.96799999999999997,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.70399999999999996}]},{"osd":5,"last update":"Fri Jul 14 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.78700000000000003,"15min":0.79600000000000004},"min":{"1min":0.57399999999999995,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.117,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.751,"5min":0.81899999999999995,"15min":0.82999999999999996},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0229999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.84899999999999998}]},{"osd":6,"last update":"Fri Jul 14 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.78600000000000003,"15min":0.79200000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.077,"5min":1.103,"15min":1.103},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.746,"5min":0.81799999999999995,"15min":0.82999999999999996},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.006,"5min":1.258,"15min":1.258},"last":0.76700000000000002}]},{"osd":7,"last update":"Fri Jul 14 11:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.79900000000000004,"15min":0.80600000000000005},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1339999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.79800000000000004,"15min":0.81100000000000005},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":0.98899999999999999,"5min":1.202,"15min":1.202},"last":0.79500000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27544,"kb_used_data":592,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344296,"statfs":{"total":96636764160,"available":96608559104,"internally_reserved":0,"allocated":606208,"data_stored":256830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.441,"15min":0.45200000000000001},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.63900000000000001,"5min":0.754,"15min":0.754},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.441,"15min":0.44700000000000001},"min":{"1min":0.33600000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.59699999999999998,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.372}]},{"osd":1,"last update":"Fri Jul 14 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.44900000000000001,"15min":0.45200000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.58299999999999996,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.437,"5min":0.48799999999999999,"15min":0.496},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.54700000000000004,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.57099999999999995}]},{"osd":2,"last update":"Fri Jul 14 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.53400000000000003,"15min":0.54000000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.63900000000000001,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.58699999999999997,"15min":0.59799999999999998},"min":{"1min":0.44400000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.71599999999999997,"5min":1.585,"15min":1.585},"last":0.502}]},{"osd":4,"last update":"Fri Jul 14 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.755,"15min":0.76100000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.93000000000000005,"5min":1.216,"15min":1.216},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.754,"5min":0.752,"15min":0.752},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.64500000000000002}]},{"osd":5,"last update":"Fri Jul 14 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.753,"15min":0.75900000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.90700000000000003,"5min":1.413,"15min":1.413},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.753,"5min":0.84499999999999997,"15min":0.86099999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1619999999999999,"5min":1.657,"15min":1.657},"last":0.72399999999999998}]},{"osd":6,"last update":"Fri Jul 14 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.77200000000000002,"15min":0.78100000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.999,"5min":1.726,"15min":1.726},"last":0.628},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.79300000000000004,"15min":0.80200000000000005},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.88800000000000001,"5min":1.333,"15min":1.333},"last":0.66800000000000004}]},{"osd":7,"last update":"Fri Jul 14 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.82799999999999996,"15min":0.84099999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.135,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.83499999999999996,"15min":0.84299999999999997},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.232,"5min":1.268,"15min":1.268},"last":0.75}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27532,"kb_used_data":580,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":593920,"data_stored":255826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.627,"15min":0.628},"min":{"1min":0.44,"5min":0.433,"15min":0.433},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69799999999999995,"15min":0.69899999999999995},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.38400000000000001}]},{"osd":1,"last update":"Fri Jul 14 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.66800000000000004,"15min":0.67200000000000004},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.92000000000000004,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.71099999999999997,"15min":0.71299999999999997},"min":{"1min":0.51400000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.99299999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.64300000000000002}]},{"osd":2,"last update":"Fri Jul 14 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.48499999999999999,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0209999999999999,"5min":1.48,"15min":1.48},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.747,"15min":0.745},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.1080000000000001,"5min":1.23,"15min":1.23},"last":0.57899999999999996}]},{"osd":3,"last update":"Fri Jul 14 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.71699999999999997,"15min":0.72099999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.746,"15min":0.74099999999999999},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.1259999999999999,"5min":1.145,"15min":1.145},"last":0.72599999999999998}]},{"osd":5,"last update":"Fri Jul 14 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.76000000000000001,"15min":0.77400000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.88900000000000001,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.77200000000000002,"15min":0.78300000000000003},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.96999999999999997,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.61599999999999999}]},{"osd":6,"last update":"Fri Jul 14 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.1659999999999999,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.77800000000000002,"15min":0.78000000000000003},"min":{"1min":0.52300000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.1479999999999999,"5min":1.3,"15min":1.3},"last":0.70499999999999996}]},{"osd":7,"last update":"Fri Jul 14 11:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.77400000000000002,"15min":0.77800000000000002},"min":{"1min":0.54500000000000004,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.028,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.84699999999999998,"15min":0.85699999999999998},"min":{"1min":0.53700000000000003,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.21,"5min":1.379,"15min":1.379},"last":0.75800000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574879,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27528,"kb_used_data":576,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":589824,"data_stored":255244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.63700000000000001,"15min":0.64200000000000002},"min":{"1min":0.41299999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.996,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.627,"5min":0.63300000000000001,"15min":0.63400000000000001},"min":{"1min":0.47199999999999998,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.873,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.73199999999999998}]},{"osd":1,"last update":"Fri Jul 14 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.67700000000000005,"15min":0.68200000000000005},"min":{"1min":0.47699999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.88800000000000001,"5min":1.343,"15min":1.343},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.46300000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.69099999999999995}]},{"osd":2,"last update":"Fri Jul 14 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.73599999999999999,"15min":0.74099999999999999},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.012,"5min":1.034,"15min":1.034},"last":0.625},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.76300000000000001,"15min":0.77300000000000002},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.88200000000000001,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.78600000000000003}]},{"osd":3,"last update":"Fri Jul 14 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.76300000000000001,"15min":0.77300000000000002},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.95499999999999996,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.76700000000000002,"15min":0.78700000000000003},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.89000000000000001,"5min":1.806,"15min":1.806},"last":0.64700000000000002}]},{"osd":4,"last update":"Fri Jul 14 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.65600000000000003,"15min":0.65900000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.0229999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.753,"15min":0.76600000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.89900000000000002}]},{"osd":6,"last update":"Fri Jul 14 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.747,"15min":0.75700000000000001},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.93600000000000005,"5min":1.03,"15min":1.03},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.745,"5min":0.80300000000000005,"15min":0.81299999999999994},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.048,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.82899999999999996}]},{"osd":7,"last update":"Fri Jul 14 11:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.83899999999999997,"15min":0.86099999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.95299999999999996,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.86599999999999999,"15min":0.88200000000000001},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":0.96699999999999997,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.88200000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T11:15:20.691 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-14T11:15:20.692 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-14T11:15:20.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.924+0000 7f0933dff700 1 Processor -- start 2023-07-14T11:15:20.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.924+0000 7f0933dff700 1 -- start start 2023-07-14T11:15:20.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.925+0000 7f0933dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f092c0b8a60 0x7f092c0b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:20.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.925+0000 7f0933dff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f092c0b8e30 con 0x7f092c0b4530 2023-07-14T11:15:20.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.925+0000 7f0933dff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f092c0afaa0 con 0x7f092c0d1220 2023-07-14T11:15:20.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.925+0000 7f0933dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f092c0afd80 con 0x7f092c0b8a60 2023-07-14T11:15:20.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.925+0000 7f093139a700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f092c0b4530 0x7f092c0d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:33534/0 (socket says 172.21.15.84:33534) 2023-07-14T11:15:20.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.925+0000 7f093139a700 1 -- 172.21.15.84:0/2919057685 learned_addr learned my addr 172.21.15.84:0/2919057685 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:15:20.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.926+0000 7f0931b9b700 1 --2- 172.21.15.84:0/2919057685 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f092c0b8a60 0x7f092c0b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:20.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.926+0000 7f0930b99700 1 -- 172.21.15.84:0/2919057685 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1930278231 0 0) 0x7f092c0b8e30 con 0x7f092c0b4530 2023-07-14T11:15:20.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.926+0000 7f0930b99700 1 -- 172.21.15.84:0/2919057685 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09180035b0 con 0x7f092c0b4530 2023-07-14T11:15:20.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.926+0000 7f0930b99700 1 -- 172.21.15.84:0/2919057685 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1384059010 0 0) 0x7f09180035b0 con 0x7f092c0b4530 2023-07-14T11:15:20.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.926+0000 7f0930b99700 1 -- 172.21.15.84:0/2919057685 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f092c0b8a60 msgr2=0x7f092c0b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:20.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.926+0000 7f0930b99700 1 --2- 172.21.15.84:0/2919057685 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f092c0b8a60 0x7f092c0b3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:20.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.926+0000 7f0930b99700 1 -- 172.21.15.84:0/2919057685 >> v1:172.21.15.179:6789/0 conn(0x7f092c0d1220 legacy=0x7f092c0b0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:20.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.926+0000 7f0930b99700 1 -- 172.21.15.84:0/2919057685 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f092c0b0060 con 0x7f092c0b4530 2023-07-14T11:15:20.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.926+0000 7f0930b99700 1 -- 172.21.15.84:0/2919057685 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7f091c001670 con 0x7f092c0b4530 2023-07-14T11:15:20.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.926+0000 7f0930b99700 1 -- 172.21.15.84:0/2919057685 >> v1:172.21.15.84:6789/0 conn(0x7f092c0b4530 legacy=0x7f092c0d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:20.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.926+0000 7f0930b99700 1 --2- 172.21.15.84:0/2919057685 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0918003a30 0x7f0918003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:20.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.926+0000 7f0930b99700 1 --2- 172.21.15.84:0/2919057685 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f092c0b8a60 0x7f0918004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:20.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.926+0000 7f0930b99700 1 --2- 172.21.15.84:0/2919057685 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0918004d90 0x7f0918005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:20.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.926+0000 7f0930b99700 1 -- 172.21.15.84:0/2919057685 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f092c0afd80 con 0x7f0918004d90 2023-07-14T11:15:20.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.926+0000 7f0930b99700 1 -- 172.21.15.84:0/2919057685 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f091800ba10 con 0x7f0918003a30 2023-07-14T11:15:20.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.926+0000 7f0930b99700 1 -- 172.21.15.84:0/2919057685 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f091800bba0 con 0x7f092c0b8a60 2023-07-14T11:15:20.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.926+0000 7f0931b9b700 1 --2- 172.21.15.84:0/2919057685 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0918003a30 0x7f0918003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:20.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.927+0000 7f093139a700 1 --2- 172.21.15.84:0/2919057685 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f092c0b8a60 0x7f0918004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:20.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.927+0000 7f093239c700 1 --2- 172.21.15.84:0/2919057685 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0918004d90 0x7f0918005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:20.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.927+0000 7f0931b9b700 1 -- 172.21.15.84:0/2919057685 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f092c0b8a60 msgr2=0x7f0918004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:20.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.927+0000 7f0931b9b700 1 --2- 172.21.15.84:0/2919057685 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f092c0b8a60 0x7f0918004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:20.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.927+0000 7f0931b9b700 1 -- 172.21.15.84:0/2919057685 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0918004d90 msgr2=0x7f0918005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:20.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.927+0000 7f0931b9b700 1 --2- 172.21.15.84:0/2919057685 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0918004d90 0x7f0918005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:20.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.927+0000 7f0931b9b700 1 -- 172.21.15.84:0/2919057685 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09180035b0 con 0x7f0918003a30 2023-07-14T11:15:20.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.927+0000 7f093239c700 1 --2- 172.21.15.84:0/2919057685 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0918004d90 0x7f0918005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:15:20.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.927+0000 7f0931b9b700 1 --2- 172.21.15.84:0/2919057685 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0918003a30 0x7f0918003e00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0928009b60 tx=0x7f0918005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bab32851256e28c2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:20.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.928+0000 7f0930b99700 1 -- 172.21.15.84:0/2919057685 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f092800e6c0 con 0x7f0918003a30 2023-07-14T11:15:20.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.928+0000 7f0930b99700 1 -- 172.21.15.84:0/2919057685 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f092800e820 con 0x7f0918003a30 2023-07-14T11:15:20.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.928+0000 7f0930b99700 1 -- 172.21.15.84:0/2919057685 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f092800eb90 con 0x7f0918003a30 2023-07-14T11:15:20.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.928+0000 7f0933dff700 1 -- 172.21.15.84:0/2919057685 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0918003a30 msgr2=0x7f0918003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:20.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.928+0000 7f0933dff700 1 --2- 172.21.15.84:0/2919057685 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0918003a30 0x7f0918003e00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0928009b60 tx=0x7f0918005880 comp rx=0 tx=0).stop 2023-07-14T11:15:20.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.928+0000 7f093239c700 1 -- 172.21.15.84:0/2919057685 reap_dead start 2023-07-14T11:15:20.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.928+0000 7f0933dff700 1 -- 172.21.15.84:0/2919057685 shutdown_connections 2023-07-14T11:15:20.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.928+0000 7f0933dff700 1 -- 172.21.15.84:0/2919057685 >> 172.21.15.84:0/2919057685 conn(0x7f092c09c1b0 msgr2=0x7f092c0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:20.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.928+0000 7f0933dff700 1 -- 172.21.15.84:0/2919057685 shutdown_connections 2023-07-14T11:15:20.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.928+0000 7f0933dff700 1 -- 172.21.15.84:0/2919057685 wait complete. 2023-07-14T11:15:20.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.930+0000 7f0933dff700 1 Processor -- start 2023-07-14T11:15:20.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.930+0000 7f0933dff700 1 -- start start 2023-07-14T11:15:20.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.931+0000 7f0933dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0918003a30 0x7f092c15d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:20.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.931+0000 7f0933dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f092c14d840 0x7f092c15db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:20.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.931+0000 7f0933dff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f092c15e050 0x7f092c0cc680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:20.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.931+0000 7f0933dff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f092c0cd3b0 con 0x7f092c15e050 2023-07-14T11:15:20.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.931+0000 7f0933dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f092c15e4c0 con 0x7f092c14d840 2023-07-14T11:15:20.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.931+0000 7f0933dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f092c15cdc0 con 0x7f0918003a30 2023-07-14T11:15:20.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.931+0000 7f093239c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f092c15e050 0x7f092c0cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:20.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.931+0000 7f093239c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f092c15e050 0x7f092c0cc680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43468/0 (socket says 172.21.15.84:43468) 2023-07-14T11:15:20.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.931+0000 7f093239c700 1 -- 172.21.15.84:0/576930653 learned_addr learned my addr 172.21.15.84:0/576930653 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:20.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.932+0000 7f093139a700 1 --2- 172.21.15.84:0/576930653 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f092c14d840 0x7f092c15db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:20.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.932+0000 7f0931b9b700 1 --2- 172.21.15.84:0/576930653 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0918003a30 0x7f092c15d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:20.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.932+0000 7f093239c700 1 -- 172.21.15.84:0/576930653 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0918003a30 msgr2=0x7f092c15d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:20.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.932+0000 7f093239c700 1 --2- 172.21.15.84:0/576930653 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0918003a30 0x7f092c15d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:20.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.932+0000 7f093239c700 1 -- 172.21.15.84:0/576930653 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f092c14d840 msgr2=0x7f092c15db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:20.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.932+0000 7f093239c700 1 --2- 172.21.15.84:0/576930653 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f092c14d840 0x7f092c15db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:20.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.932+0000 7f093239c700 1 -- 172.21.15.84:0/576930653 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f092c15c490 con 0x7f092c15e050 2023-07-14T11:15:20.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.932+0000 7f093139a700 1 --2- 172.21.15.84:0/576930653 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f092c14d840 0x7f092c15db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:15:20.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.932+0000 7f093239c700 1 --2- 172.21.15.84:0/576930653 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f092c15e050 0x7f092c0cc680 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f092c08d270 tx=0x7f092400d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:20.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.932+0000 7f09227fc700 1 -- 172.21.15.84:0/576930653 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f092400fed0 con 0x7f092c15e050 2023-07-14T11:15:20.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.932+0000 7f09227fc700 1 -- 172.21.15.84:0/576930653 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f092400deb0 con 0x7f092c15e050 2023-07-14T11:15:20.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.932+0000 7f0933dff700 1 -- 172.21.15.84:0/576930653 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f092c15c770 con 0x7f092c15e050 2023-07-14T11:15:20.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.932+0000 7f09227fc700 1 -- 172.21.15.84:0/576930653 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0924003c20 con 0x7f092c15e050 2023-07-14T11:15:20.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.932+0000 7f0933dff700 1 -- 172.21.15.84:0/576930653 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f092c15d790 con 0x7f092c15e050 2023-07-14T11:15:20.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.933+0000 7f0933dff700 1 -- 172.21.15.84:0/576930653 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f092c074350 con 0x7f092c15e050 2023-07-14T11:15:20.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.934+0000 7f09227fc700 1 -- 172.21.15.84:0/576930653 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 7) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f09240050d0 con 0x7f092c15e050 2023-07-14T11:15:20.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.936+0000 7f09227fc700 1 --2- 172.21.15.84:0/576930653 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f091006ae90 0x7f091006d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:20.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.936+0000 7f09227fc700 1 -- 172.21.15.84:0/576930653 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0924089c10 con 0x7f092c15e050 2023-07-14T11:15:20.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.936+0000 7f0931b9b700 1 --2- 172.21.15.84:0/576930653 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f091006ae90 0x7f091006d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:20.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.937+0000 7f0931b9b700 1 --2- 172.21.15.84:0/576930653 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f091006ae90 0x7f091006d340 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f09280090b0 tx=0x7f0928008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:20.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:20.940+0000 7f09227fc700 1 -- 172.21.15.84:0/576930653 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f09240549a0 con 0x7f092c15e050 2023-07-14T11:15:21.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.217+0000 7f0933dff700 1 -- 172.21.15.84:0/576930653 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f092c0b2260 con 0x7f092c15e050 2023-07-14T11:15:21.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.221+0000 7f09227fc700 1 -- 172.21.15.84:0/576930653 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) v1 ==== 190+0+147 (secure 0 0 0) 0x7f0924057fc0 con 0x7f092c15e050 2023-07-14T11:15:21.224 INFO:teuthology.orchestra.run.smithi084.stdout:[client.0] 2023-07-14T11:15:21.225 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCKLbFkKSl5GBAAwPK4Zs6+gv/6YKHh4JI3WA== 2023-07-14T11:15:21.225 INFO:teuthology.orchestra.run.smithi084.stdout: caps mds = "allow" 2023-07-14T11:15:21.225 INFO:teuthology.orchestra.run.smithi084.stdout: caps mon = "allow r" 2023-07-14T11:15:21.225 INFO:teuthology.orchestra.run.smithi084.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-14T11:15:21.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.223+0000 7f0933dff700 1 -- 172.21.15.84:0/576930653 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f091006ae90 msgr2=0x7f091006d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:21.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.223+0000 7f0933dff700 1 --2- 172.21.15.84:0/576930653 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f091006ae90 0x7f091006d340 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f09280090b0 tx=0x7f0928008030 comp rx=0 tx=0).stop 2023-07-14T11:15:21.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.223+0000 7f0933dff700 1 -- 172.21.15.84:0/576930653 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f092c15e050 msgr2=0x7f092c0cc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:21.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.223+0000 7f0933dff700 1 --2- 172.21.15.84:0/576930653 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f092c15e050 0x7f092c0cc680 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f092c08d270 tx=0x7f092400d710 comp rx=0 tx=0).stop 2023-07-14T11:15:21.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.224+0000 7f0933dff700 1 -- 172.21.15.84:0/576930653 shutdown_connections 2023-07-14T11:15:21.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.224+0000 7f0933dff700 1 --2- 172.21.15.84:0/576930653 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f091006ae90 0x7f091006d340 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:21.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.224+0000 7f0933dff700 1 --2- 172.21.15.84:0/576930653 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0918003a30 0x7f092c15d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:21.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.224+0000 7f0933dff700 1 --2- 172.21.15.84:0/576930653 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f092c15e050 0x7f092c0cc680 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:21.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.224+0000 7f0933dff700 1 --2- 172.21.15.84:0/576930653 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f092c14d840 0x7f092c15db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:21.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.224+0000 7f0933dff700 1 -- 172.21.15.84:0/576930653 >> 172.21.15.84:0/576930653 conn(0x7f092c09c1b0 msgr2=0x7f092c06ad60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:21.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.224+0000 7f0933dff700 1 -- 172.21.15.84:0/576930653 shutdown_connections 2023-07-14T11:15:21.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.224+0000 7f0933dff700 1 -- 172.21.15.84:0/576930653 wait complete. 2023-07-14T11:15:21.229 INFO:teuthology.orchestra.run.smithi084.stderr:updated caps for client.0 2023-07-14T11:15:21.245 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T11:15:21.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.436+0000 7f93487ff700 1 Processor -- start 2023-07-14T11:15:21.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.436+0000 7f93487ff700 1 -- start start 2023-07-14T11:15:21.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.438+0000 7f93487ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9340158fd0 0x7f9340070710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:21.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.438+0000 7f93487ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f934006c110 con 0x7f9340141ff0 2023-07-14T11:15:21.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.438+0000 7f93487ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9340159410 con 0x7f93400b2180 2023-07-14T11:15:21.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.438+0000 7f93487ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9340071140 con 0x7f9340158fd0 2023-07-14T11:15:21.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.438+0000 7f934659b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f9340141ff0 0x7f93400b1a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:33546/0 (socket says 172.21.15.84:33546) 2023-07-14T11:15:21.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.438+0000 7f934659b700 1 -- 172.21.15.84:0/2703087937 learned_addr learned my addr 172.21.15.84:0/2703087937 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:15:21.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.438+0000 7f9345599700 1 -- 172.21.15.84:0/2703087937 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 765261004 0 0) 0x7f934006c110 con 0x7f9340141ff0 2023-07-14T11:15:21.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.438+0000 7f9346d9c700 1 --2- 172.21.15.84:0/2703087937 >> v2:172.21.15.179:3300/0 conn(0x7f9340158fd0 0x7f9340070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:21.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.438+0000 7f9345599700 1 -- 172.21.15.84:0/2703087937 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f932c0035b0 con 0x7f9340141ff0 2023-07-14T11:15:21.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.439+0000 7f9345599700 1 -- 172.21.15.84:0/2703087937 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1739019357 0 0) 0x7f932c0035b0 con 0x7f9340141ff0 2023-07-14T11:15:21.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.439+0000 7f9345599700 1 -- 172.21.15.84:0/2703087937 >> v2:172.21.15.179:3300/0 conn(0x7f9340158fd0 msgr2=0x7f9340070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:21.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.439+0000 7f9345599700 1 --2- 172.21.15.84:0/2703087937 >> v2:172.21.15.179:3300/0 conn(0x7f9340158fd0 0x7f9340070710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:21.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.439+0000 7f9345599700 1 -- 172.21.15.84:0/2703087937 >> v1:172.21.15.179:6789/0 conn(0x7f93400b2180 legacy=0x7f934006c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:21.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.439+0000 7f9345599700 1 -- 172.21.15.84:0/2703087937 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9340070e60 con 0x7f9340141ff0 2023-07-14T11:15:21.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.439+0000 7f9345599700 1 -- 172.21.15.84:0/2703087937 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7f933c001670 con 0x7f9340141ff0 2023-07-14T11:15:21.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.439+0000 7f9345599700 1 -- 172.21.15.84:0/2703087937 >> v1:172.21.15.84:6789/0 conn(0x7f9340141ff0 legacy=0x7f93400b1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:21.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.439+0000 7f9345599700 1 --2- 172.21.15.84:0/2703087937 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f932c003bd0 0x7f932c003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:21.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.439+0000 7f9345599700 1 --2- 172.21.15.84:0/2703087937 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f932c008870 0x7f932c00acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:21.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.439+0000 7f9345599700 1 --2- 172.21.15.84:0/2703087937 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f932c00b4f0 0x7f932c00d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:21.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.439+0000 7f9345599700 1 -- 172.21.15.84:0/2703087937 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9340071140 con 0x7f932c008870 2023-07-14T11:15:21.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.439+0000 7f9345599700 1 -- 172.21.15.84:0/2703087937 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f932c00e280 con 0x7f932c00b4f0 2023-07-14T11:15:21.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.439+0000 7f9345599700 1 -- 172.21.15.84:0/2703087937 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f932c00e440 con 0x7f932c003bd0 2023-07-14T11:15:21.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.439+0000 7f9345d9a700 1 --2- 172.21.15.84:0/2703087937 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f932c008870 0x7f932c00acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:21.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.439+0000 7f934659b700 1 --2- 172.21.15.84:0/2703087937 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f932c003bd0 0x7f932c003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:21.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.439+0000 7f9346d9c700 1 --2- 172.21.15.84:0/2703087937 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f932c00b4f0 0x7f932c00d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:21.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.439+0000 7f9345d9a700 1 -- 172.21.15.84:0/2703087937 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f932c003bd0 msgr2=0x7f932c003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:21.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.439+0000 7f9345d9a700 1 --2- 172.21.15.84:0/2703087937 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f932c003bd0 0x7f932c003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:21.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.439+0000 7f9345d9a700 1 -- 172.21.15.84:0/2703087937 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f932c00b4f0 msgr2=0x7f932c00d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:21.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.439+0000 7f9345d9a700 1 --2- 172.21.15.84:0/2703087937 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f932c00b4f0 0x7f932c00d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:21.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.439+0000 7f9345d9a700 1 -- 172.21.15.84:0/2703087937 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f932c0035b0 con 0x7f932c008870 2023-07-14T11:15:21.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.439+0000 7f9346d9c700 1 --2- 172.21.15.84:0/2703087937 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f932c00b4f0 0x7f932c00d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:15:21.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.440+0000 7f9346d9c700 1 -- 172.21.15.84:0/2703087937 reap_dead start 2023-07-14T11:15:21.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.440+0000 7f9345d9a700 1 --2- 172.21.15.84:0/2703087937 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f932c008870 0x7f932c00acf0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f93400b2570 tx=0x7f932c003860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e04c51a1e3de99b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:21.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.440+0000 7f9345599700 1 -- 172.21.15.84:0/2703087937 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93300052d0 con 0x7f932c008870 2023-07-14T11:15:21.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.440+0000 7f9345599700 1 -- 172.21.15.84:0/2703087937 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9330005430 con 0x7f932c008870 2023-07-14T11:15:21.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.440+0000 7f9345599700 1 -- 172.21.15.84:0/2703087937 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93300038c0 con 0x7f932c008870 2023-07-14T11:15:21.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.440+0000 7f93487ff700 1 -- 172.21.15.84:0/2703087937 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f932c008870 msgr2=0x7f932c00acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:21.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.440+0000 7f93487ff700 1 --2- 172.21.15.84:0/2703087937 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f932c008870 0x7f932c00acf0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f93400b2570 tx=0x7f932c003860 comp rx=0 tx=0).stop 2023-07-14T11:15:21.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.441+0000 7f93487ff700 1 -- 172.21.15.84:0/2703087937 shutdown_connections 2023-07-14T11:15:21.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.441+0000 7f93487ff700 1 --2- 172.21.15.84:0/2703087937 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f932c008870 0x7f932c00acf0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:21.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.441+0000 7f93487ff700 1 -- 172.21.15.84:0/2703087937 >> 172.21.15.84:0/2703087937 conn(0x7f9340069f30 msgr2=0x7f934006a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:21.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.441+0000 7f93487ff700 1 -- 172.21.15.84:0/2703087937 shutdown_connections 2023-07-14T11:15:21.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.441+0000 7f93487ff700 1 -- 172.21.15.84:0/2703087937 wait complete. 2023-07-14T11:15:21.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.443+0000 7f93487ff700 1 Processor -- start 2023-07-14T11:15:21.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.443+0000 7f93487ff700 1 -- start start 2023-07-14T11:15:21.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.444+0000 7f93487ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f932c008870 0x7f93400adde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:21.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.444+0000 7f93487ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9340158210 0x7f93400ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:21.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.444+0000 7f93487ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9340158680 0x7f93401f5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:21.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.444+0000 7f93487ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93400ac420 con 0x7f9340158210 2023-07-14T11:15:21.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.444+0000 7f93487ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93400ae320 con 0x7f9340158680 2023-07-14T11:15:21.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.445+0000 7f93487ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93400ab810 con 0x7f932c008870 2023-07-14T11:15:21.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.445+0000 7f9345d9a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9340158210 0x7f93400ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:21.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.445+0000 7f9345d9a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9340158210 0x7f93400ac8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43494/0 (socket says 172.21.15.84:43494) 2023-07-14T11:15:21.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.445+0000 7f9345d9a700 1 -- 172.21.15.84:0/481708171 learned_addr learned my addr 172.21.15.84:0/481708171 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:21.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.445+0000 7f934659b700 1 --2- 172.21.15.84:0/481708171 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f932c008870 0x7f93400adde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:21.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.445+0000 7f9346d9c700 1 --2- 172.21.15.84:0/481708171 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9340158680 0x7f93401f5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:21.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.445+0000 7f9345d9a700 1 -- 172.21.15.84:0/481708171 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f932c008870 msgr2=0x7f93400adde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:21.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.445+0000 7f9345d9a700 1 --2- 172.21.15.84:0/481708171 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f932c008870 0x7f93400adde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:21.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.445+0000 7f9345d9a700 1 -- 172.21.15.84:0/481708171 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9340158680 msgr2=0x7f93401f5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:21.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.445+0000 7f9345d9a700 1 --2- 172.21.15.84:0/481708171 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9340158680 0x7f93401f5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:21.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.445+0000 7f9345d9a700 1 -- 172.21.15.84:0/481708171 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93400abaf0 con 0x7f9340158210 2023-07-14T11:15:21.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.445+0000 7f9346d9c700 1 --2- 172.21.15.84:0/481708171 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9340158680 0x7f93401f5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:15:21.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.445+0000 7f9345d9a700 1 --2- 172.21.15.84:0/481708171 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9340158210 0x7f93400ac8b0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f9330005040 tx=0x7f9330001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:21.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.446+0000 7f9336ffd700 1 -- 172.21.15.84:0/481708171 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9330003e40 con 0x7f9340158210 2023-07-14T11:15:21.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.446+0000 7f9336ffd700 1 -- 172.21.15.84:0/481708171 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9330001290 con 0x7f9340158210 2023-07-14T11:15:21.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.446+0000 7f9336ffd700 1 -- 172.21.15.84:0/481708171 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f933001d6c0 con 0x7f9340158210 2023-07-14T11:15:21.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.446+0000 7f93487ff700 1 -- 172.21.15.84:0/481708171 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93400abdd0 con 0x7f9340158210 2023-07-14T11:15:21.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.446+0000 7f93487ff700 1 -- 172.21.15.84:0/481708171 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f934013ae70 con 0x7f9340158210 2023-07-14T11:15:21.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.447+0000 7f93487ff700 1 -- 172.21.15.84:0/481708171 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f934004e280 con 0x7f9340158210 2023-07-14T11:15:21.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.448+0000 7f9336ffd700 1 -- 172.21.15.84:0/481708171 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 7) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f9330019040 con 0x7f9340158210 2023-07-14T11:15:21.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.449+0000 7f9336ffd700 1 --2- 172.21.15.84:0/481708171 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f932406ae90 0x7f932406d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:21.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.449+0000 7f9336ffd700 1 -- 172.21.15.84:0/481708171 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f933008a310 con 0x7f9340158210 2023-07-14T11:15:21.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.449+0000 7f934659b700 1 --2- 172.21.15.84:0/481708171 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f932406ae90 0x7f932406d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:21.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.450+0000 7f934659b700 1 --2- 172.21.15.84:0/481708171 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f932406ae90 0x7f932406d340 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f933c000c00 tx=0x7f933c007040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:21.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.453+0000 7f9336ffd700 1 -- 172.21.15.84:0/481708171 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f9330055130 con 0x7f9340158210 2023-07-14T11:15:21.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.691+0000 7f93487ff700 1 -- 172.21.15.84:0/481708171 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f934006bac0 con 0x7f9340158210 2023-07-14T11:15:21.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.692+0000 7f9336ffd700 1 -- 172.21.15.84:0/481708171 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4712 (secure 0 0 0) 0x7f9330017090 con 0x7f9340158210 2023-07-14T11:15:21.695 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:15:21.695 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5030,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3551222138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3551222138},{"type":"v1","addr":"172.21.15.179:6834","nonce":3551222138}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5036,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/1316665435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1316665435},{"type":"v1","addr":"172.21.15.84:6836","nonce":1316665435}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5416,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/611235750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":611235750},{"type":"v1","addr":"172.21.15.179:6835","nonce":611235750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T11:15:10.408480+0000","modified":"2023-07-14T11:15:13.936541+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5625},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5625":{"gid":5625,"name":"c","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/2672133286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":2672133286},{"type":"v1","addr":"172.21.15.84:6837","nonce":2672133286}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-14T11:15:21.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.694+0000 7f93487ff700 1 -- 172.21.15.84:0/481708171 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f932406ae90 msgr2=0x7f932406d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:21.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.694+0000 7f93487ff700 1 --2- 172.21.15.84:0/481708171 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f932406ae90 0x7f932406d340 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f933c000c00 tx=0x7f933c007040 comp rx=0 tx=0).stop 2023-07-14T11:15:21.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.694+0000 7f93487ff700 1 -- 172.21.15.84:0/481708171 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9340158210 msgr2=0x7f93400ac8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:21.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.694+0000 7f93487ff700 1 --2- 172.21.15.84:0/481708171 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9340158210 0x7f93400ac8b0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f9330005040 tx=0x7f9330001120 comp rx=0 tx=0).stop 2023-07-14T11:15:21.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.694+0000 7f93487ff700 1 -- 172.21.15.84:0/481708171 shutdown_connections 2023-07-14T11:15:21.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.694+0000 7f93487ff700 1 --2- 172.21.15.84:0/481708171 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f932406ae90 0x7f932406d340 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:21.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.694+0000 7f93487ff700 1 --2- 172.21.15.84:0/481708171 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f932c008870 0x7f93400adde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:21.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.694+0000 7f93487ff700 1 --2- 172.21.15.84:0/481708171 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9340158680 0x7f93401f5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:21.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.694+0000 7f93487ff700 1 --2- 172.21.15.84:0/481708171 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9340158210 0x7f93400ac8b0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:21.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.694+0000 7f93487ff700 1 -- 172.21.15.84:0/481708171 >> 172.21.15.84:0/481708171 conn(0x7f9340069f30 msgr2=0x7f934015b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:21.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.694+0000 7f93487ff700 1 -- 172.21.15.84:0/481708171 shutdown_connections 2023-07-14T11:15:21.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:21.694+0000 7f93487ff700 1 -- 172.21.15.84:0/481708171 wait complete. 2023-07-14T11:15:21.699 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 27 2023-07-14T11:15:22.118 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-14T11:15:10.408480+0000', 'modified': '2023-07-14T11:15:13.936541+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5625}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5625': {'gid': 5625, 'name': 'c', 'rank': 0, 'incarnation': 24, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.84:6837/2672133286', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6835', 'nonce': 2672133286}, {'type': 'v1', 'addr': '172.21.15.84:6837', 'nonce': 2672133286}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-14T11:15:22.118 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-14T11:15:22.119 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-07-14T11:15:22.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.315+0000 7f50c07ff700 1 Processor -- start 2023-07-14T11:15:22.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.315+0000 7f50c07ff700 1 -- start start 2023-07-14T11:15:22.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.316+0000 7f50c07ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50b80d0b10 0x7f50b80d0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:22.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.316+0000 7f50c07ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f50b80b0e20 0x7f50b80b12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:22.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.316+0000 7f50c07ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50b80d14a0 con 0x7f50b80b8a60 2023-07-14T11:15:22.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.316+0000 7f50c07ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50b80b8e30 con 0x7f50b80b0e20 2023-07-14T11:15:22.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.316+0000 7f50c07ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50b80afaa0 con 0x7f50b80d0b10 2023-07-14T11:15:22.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.317+0000 7f50bdd9a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50b80d0b10 0x7f50b80d0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:22.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.317+0000 7f50bed9c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f50b80b0e20 0x7f50b80b12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:22.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.317+0000 7f50be59b700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f50b80b8a60 0x7f50b80b3ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.84:60856/0 (socket says 172.21.15.84:60856) 2023-07-14T11:15:22.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.317+0000 7f50be59b700 1 -- 172.21.15.84:0/25138708 learned_addr learned my addr 172.21.15.84:0/25138708 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:15:22.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.318+0000 7f50bed9c700 1 -- 172.21.15.84:0/25138708 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50b80d0b10 msgr2=0x7f50b80d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:22.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.318+0000 7f50bed9c700 1 --2- 172.21.15.84:0/25138708 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50b80d0b10 0x7f50b80d0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:22.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.318+0000 7f50bed9c700 1 -- 172.21.15.84:0/25138708 >> v1:172.21.15.179:6789/0 conn(0x7f50b80b8a60 legacy=0x7f50b80b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:22.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.318+0000 7f50bed9c700 1 -- 172.21.15.84:0/25138708 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b80afd80 con 0x7f50b80b0e20 2023-07-14T11:15:22.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.318+0000 7f50bed9c700 1 --2- 172.21.15.84:0/25138708 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50b80b0e20 0x7f50b80b12a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f50b0009d90 tx=0x7f50b000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7ab061d1b946b90 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:22.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.318+0000 7f50bd599700 1 -- 172.21.15.84:0/25138708 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b000e070 con 0x7f50b80b0e20 2023-07-14T11:15:22.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.318+0000 7f50bd599700 1 -- 172.21.15.84:0/25138708 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50b000bb20 con 0x7f50b80b0e20 2023-07-14T11:15:22.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.318+0000 7f50bd599700 1 -- 172.21.15.84:0/25138708 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b0012430 con 0x7f50b80b0e20 2023-07-14T11:15:22.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.319+0000 7f50c07ff700 1 -- 172.21.15.84:0/25138708 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50b80b0e20 msgr2=0x7f50b80b12a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:22.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.319+0000 7f50c07ff700 1 --2- 172.21.15.84:0/25138708 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50b80b0e20 0x7f50b80b12a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f50b0009d90 tx=0x7f50b000b330 comp rx=0 tx=0).stop 2023-07-14T11:15:22.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.319+0000 7f50c07ff700 1 -- 172.21.15.84:0/25138708 shutdown_connections 2023-07-14T11:15:22.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.319+0000 7f50c07ff700 1 --2- 172.21.15.84:0/25138708 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50b80b0e20 0x7f50b80b12a0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:22.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.319+0000 7f50c07ff700 1 --2- 172.21.15.84:0/25138708 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50b80d0b10 0x7f50b80d0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:22.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.319+0000 7f50c07ff700 1 -- 172.21.15.84:0/25138708 >> 172.21.15.84:0/25138708 conn(0x7f50b809c1b0 msgr2=0x7f50b80d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:22.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.319+0000 7f50c07ff700 1 -- 172.21.15.84:0/25138708 shutdown_connections 2023-07-14T11:15:22.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.319+0000 7f50c07ff700 1 -- 172.21.15.84:0/25138708 wait complete. 2023-07-14T11:15:22.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.320+0000 7f50c07ff700 1 Processor -- start 2023-07-14T11:15:22.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.321+0000 7f50c07ff700 1 -- start start 2023-07-14T11:15:22.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.321+0000 7f50c07ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50b80b0e20 0x7f50b80b6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:22.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.321+0000 7f50c07ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50b80b8a60 0x7f50b80ca3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:22.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.322+0000 7f50c07ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50b80d0b10 0x7f50b80cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:22.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.322+0000 7f50c07ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50b80b7720 con 0x7f50b80b0e20 2023-07-14T11:15:22.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.322+0000 7f50c07ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50b80d0400 con 0x7f50b80d0b10 2023-07-14T11:15:22.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.322+0000 7f50c07ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50b80ca910 con 0x7f50b80b8a60 2023-07-14T11:15:22.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.322+0000 7f50be59b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50b80b0e20 0x7f50b80b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:22.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.322+0000 7f50be59b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50b80b0e20 0x7f50b80b6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43508/0 (socket says 172.21.15.84:43508) 2023-07-14T11:15:22.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.322+0000 7f50be59b700 1 -- 172.21.15.84:0/1753780695 learned_addr learned my addr 172.21.15.84:0/1753780695 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:22.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.322+0000 7f50bdd9a700 1 --2- 172.21.15.84:0/1753780695 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50b80b8a60 0x7f50b80ca3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:22.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.322+0000 7f50bed9c700 1 --2- 172.21.15.84:0/1753780695 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50b80d0b10 0x7f50b80cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:22.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.322+0000 7f50be59b700 1 -- 172.21.15.84:0/1753780695 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50b80b8a60 msgr2=0x7f50b80ca3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:22.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.322+0000 7f50be59b700 1 --2- 172.21.15.84:0/1753780695 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50b80b8a60 0x7f50b80ca3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:22.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.322+0000 7f50be59b700 1 -- 172.21.15.84:0/1753780695 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50b80d0b10 msgr2=0x7f50b80cbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:22.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.322+0000 7f50be59b700 1 --2- 172.21.15.84:0/1753780695 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50b80d0b10 0x7f50b80cbe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:22.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.322+0000 7f50be59b700 1 -- 172.21.15.84:0/1753780695 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b0009a70 con 0x7f50b80b0e20 2023-07-14T11:15:22.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.322+0000 7f50bed9c700 1 --2- 172.21.15.84:0/1753780695 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50b80d0b10 0x7f50b80cbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:15:22.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.322+0000 7f50be59b700 1 --2- 172.21.15.84:0/1753780695 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50b80b0e20 0x7f50b80b6780 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f50b400c520 tx=0x7f50b400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:22.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.323+0000 7f50aeffd700 1 -- 172.21.15.84:0/1753780695 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b4005d70 con 0x7f50b80b0e20 2023-07-14T11:15:22.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.323+0000 7f50aeffd700 1 -- 172.21.15.84:0/1753780695 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50b40070d0 con 0x7f50b80b0e20 2023-07-14T11:15:22.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.323+0000 7f50c07ff700 1 -- 172.21.15.84:0/1753780695 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50b80b6e80 con 0x7f50b80b0e20 2023-07-14T11:15:22.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.323+0000 7f50aeffd700 1 -- 172.21.15.84:0/1753780695 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b4007440 con 0x7f50b80b0e20 2023-07-14T11:15:22.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.323+0000 7f50c07ff700 1 -- 172.21.15.84:0/1753780695 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50b80b7440 con 0x7f50b80b0e20 2023-07-14T11:15:22.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.325+0000 7f50aeffd700 1 -- 172.21.15.84:0/1753780695 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 7) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f50b40075a0 con 0x7f50b80b0e20 2023-07-14T11:15:22.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.326+0000 7f50aeffd700 1 --2- 172.21.15.84:0/1753780695 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f509c06ae90 0x7f509c06d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:22.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.326+0000 7f50aeffd700 1 -- 172.21.15.84:0/1753780695 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f50b4088a70 con 0x7f50b80b0e20 2023-07-14T11:15:22.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.326+0000 7f50bdd9a700 1 --2- 172.21.15.84:0/1753780695 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f509c06ae90 0x7f509c06d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:22.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.327+0000 7f50bdd9a700 1 --2- 172.21.15.84:0/1753780695 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f509c06ae90 0x7f509c06d340 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f50b815f270 tx=0x7f50a8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:22.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.328+0000 7f50d4095b80 1 Processor -- start 2023-07-14T11:15:22.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.328+0000 7f50d4095b80 1 -- start start 2023-07-14T11:15:22.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.329+0000 7f50d4095b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5606c5477880 0x5606c54a75e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:22.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.329+0000 7f50d4095b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606c5479dc0 0x5606c54a7b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:22.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.329+0000 7f50d4095b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5606c5477c50 0x5606c5492120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:22.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.329+0000 7f50d4095b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606c53f1ea0 con 0x5606c5479dc0 2023-07-14T11:15:22.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.329+0000 7f50d4095b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606c5365600 con 0x5606c5477880 2023-07-14T11:15:22.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.329+0000 7f50d4095b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x5606c53d4910 con 0x5606c5477c50 2023-07-14T11:15:22.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.329+0000 7f50bdd9a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606c5479dc0 0x5606c54a7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:22.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.329+0000 7f50bdd9a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606c5479dc0 0x5606c54a7b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43522/0 (socket says 172.21.15.84:43522) 2023-07-14T11:15:22.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.329+0000 7f50bdd9a700 1 -- 172.21.15.84:0/1664143746 learned_addr learned my addr 172.21.15.84:0/1664143746 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:22.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.329+0000 7f50bed9c700 1 --2- 172.21.15.84:0/1664143746 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5606c5477c50 0x5606c5492120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:22.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.329+0000 7f50be59b700 1 --2- 172.21.15.84:0/1664143746 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5606c5477880 0x5606c54a75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:22.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.330+0000 7f50bdd9a700 1 -- 172.21.15.84:0/1664143746 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5606c5477c50 msgr2=0x5606c5492120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:22.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.330+0000 7f50bdd9a700 1 --2- 172.21.15.84:0/1664143746 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5606c5477c50 0x5606c5492120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:22.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.330+0000 7f50bdd9a700 1 -- 172.21.15.84:0/1664143746 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5606c5477880 msgr2=0x5606c54a75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:22.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.330+0000 7f50bdd9a700 1 --2- 172.21.15.84:0/1664143746 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5606c5477880 0x5606c54a75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:22.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.330+0000 7f50bdd9a700 1 -- 172.21.15.84:0/1664143746 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5606c51c1790 con 0x5606c5479dc0 2023-07-14T11:15:22.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.330+0000 7f50bed9c700 1 --2- 172.21.15.84:0/1664143746 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5606c5477c50 0x5606c5492120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:15:22.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.330+0000 7f50bdd9a700 1 --2- 172.21.15.84:0/1664143746 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606c5479dc0 0x5606c54a7b20 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f50a8009fd0 tx=0x7f50a8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=260599cfdb58279 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:22.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.330+0000 7f509bfff700 1 -- 172.21.15.84:0/1664143746 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a80158d0 con 0x5606c5479dc0 2023-07-14T11:15:22.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.330+0000 7f509bfff700 1 -- 172.21.15.84:0/1664143746 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50a8015a30 con 0x5606c5479dc0 2023-07-14T11:15:22.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.330+0000 7f509bfff700 1 -- 172.21.15.84:0/1664143746 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a8015da0 con 0x5606c5479dc0 2023-07-14T11:15:22.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.331+0000 7f50d4095b80 1 -- 172.21.15.84:0/1664143746 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606c5479dc0 msgr2=0x5606c54a7b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:22.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.331+0000 7f50d4095b80 1 --2- 172.21.15.84:0/1664143746 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606c5479dc0 0x5606c54a7b20 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f50a8009fd0 tx=0x7f50a8014000 comp rx=0 tx=0).stop 2023-07-14T11:15:22.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.331+0000 7f50d4095b80 1 -- 172.21.15.84:0/1664143746 shutdown_connections 2023-07-14T11:15:22.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.331+0000 7f50d4095b80 1 --2- 172.21.15.84:0/1664143746 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5606c5477c50 0x5606c5492120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:22.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.331+0000 7f50d4095b80 1 --2- 172.21.15.84:0/1664143746 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5606c5477880 0x5606c54a75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:22.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.331+0000 7f50d4095b80 1 --2- 172.21.15.84:0/1664143746 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606c5479dc0 0x5606c54a7b20 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:22.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.331+0000 7f50d4095b80 1 -- 172.21.15.84:0/1664143746 >> 172.21.15.84:0/1664143746 conn(0x5606c54723b0 msgr2=0x5606c547d550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:22.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.331+0000 7f50d4095b80 1 -- 172.21.15.84:0/1664143746 shutdown_connections 2023-07-14T11:15:22.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.331+0000 7f50d4095b80 1 -- 172.21.15.84:0/1664143746 wait complete. 2023-07-14T11:15:22.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.332+0000 7f50d4095b80 1 -- start start 2023-07-14T11:15:22.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.332+0000 7f50d4095b80 1 Processor -- start 2023-07-14T11:15:22.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.333+0000 7f50d4095b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5606c5477880 0x5606c547f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:22.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.333+0000 7f50d4095b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5606c5477c50 0x5606c547f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:22.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.333+0000 7f50d4095b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606c5479dc0 0x5606c54d54d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:22.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.333+0000 7f50d4095b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606c53cdbe0 con 0x5606c5479dc0 2023-07-14T11:15:22.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.333+0000 7f50d4095b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606c538b5b0 con 0x5606c5477880 2023-07-14T11:15:22.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.333+0000 7f50d4095b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x5606c5371910 con 0x5606c5477c50 2023-07-14T11:15:22.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.333+0000 7f50d4095b80 10 client.0 _ll_register_callbacks cb 0x5606c5389b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T11:15:22.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.333+0000 7f50bed9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606c5479dc0 0x5606c54d54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:22.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.333+0000 7f50bed9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606c5479dc0 0x5606c54d54d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43526/0 (socket says 172.21.15.84:43526) 2023-07-14T11:15:22.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.333+0000 7f50bed9c700 1 -- 172.21.15.84:0/616724119 learned_addr learned my addr 172.21.15.84:0/616724119 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:22.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.333+0000 7f50bdd9a700 1 --2- 172.21.15.84:0/616724119 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5606c5477c50 0x5606c547f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:22.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.333+0000 7f50be59b700 1 --2- 172.21.15.84:0/616724119 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5606c5477880 0x5606c547f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:22.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.333+0000 7f50bed9c700 1 -- 172.21.15.84:0/616724119 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5606c5477c50 msgr2=0x5606c547f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:22.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.333+0000 7f50bed9c700 1 --2- 172.21.15.84:0/616724119 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5606c5477c50 0x5606c547f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:22.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.333+0000 7f50bed9c700 1 -- 172.21.15.84:0/616724119 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5606c5477880 msgr2=0x5606c547f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:22.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.333+0000 7f50bed9c700 1 --2- 172.21.15.84:0/616724119 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5606c5477880 0x5606c547f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:22.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.333+0000 7f50bed9c700 1 -- 172.21.15.84:0/616724119 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50a80118a0 con 0x5606c5479dc0 2023-07-14T11:15:22.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.333+0000 7f50be59b700 1 --2- 172.21.15.84:0/616724119 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5606c5477880 0x5606c547f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:15:22.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.334+0000 7f50bed9c700 1 --2- 172.21.15.84:0/616724119 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606c5479dc0 0x5606c54d54d0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f50b80681d0 tx=0x7f50b0004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81dfd89e168fc86f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:22.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.334+0000 7f50997fa700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-07-14T11:15:22.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.334+0000 7f50997fa700 1 -- 172.21.15.84:0/616724119 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b00098f0 con 0x5606c5479dc0 2023-07-14T11:15:22.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.334+0000 7f50997fa700 1 -- 172.21.15.84:0/616724119 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f50b0023070 con 0x5606c5479dc0 2023-07-14T11:15:22.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.334+0000 7f50d4095b80 1 -- 172.21.15.84:0/616724119 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5606c546f9c0 con 0x5606c5479dc0 2023-07-14T11:15:22.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.334+0000 7f50997fa700 1 -- 172.21.15.84:0/616724119 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f50b0004040 con 0x5606c5479dc0 2023-07-14T11:15:22.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.334+0000 7f50d4095b80 10 client.5778 fetch_fsmap learned FSMap version 27 2023-07-14T11:15:22.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.334+0000 7f50d4095b80 1 -- 172.21.15.84:0/616724119 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) v3 -- 0x5606c52ae0a0 con 0x5606c5479dc0 2023-07-14T11:15:22.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.334+0000 7f50997fa700 1 -- 172.21.15.84:0/616724119 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5606c546f9c0 con 0x5606c5479dc0 2023-07-14T11:15:22.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.334+0000 7f50997fa700 1 -- 172.21.15.84:0/616724119 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 27) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f50b00041a0 con 0x5606c5479dc0 2023-07-14T11:15:22.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.334+0000 7f50d4095b80 10 client.5778 fetch_fsmap finished waiting for FSMap version 27 2023-07-14T11:15:22.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.335+0000 7f50d4095b80 10 client.5778 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-14T11:15:22.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.335+0000 7f50d4095b80 20 client.5778 populate_metadata read hostname 'smithi084' 2023-07-14T11:15:22.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.335+0000 7f50d4095b80 1 --2- 172.21.15.84:0/616724119 >> [v2:172.21.15.84:6835/2672133286,v1:172.21.15.84:6837/2672133286] conn(0x5606c54ab130 0x5606c54ab500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:22.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.335+0000 7f50d4095b80 4 client.5778 mds_command: new command op to 5625 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T11:15:22.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.335+0000 7f50d4095b80 1 -- 172.21.15.84:0/616724119 --> [v2:172.21.15.84:6835/2672133286,v1:172.21.15.84:6837/2672133286] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5606c544c170 con 0x5606c54ab130 2023-07-14T11:15:22.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.335+0000 7f50be59b700 1 --2- 172.21.15.84:0/616724119 >> [v2:172.21.15.84:6835/2672133286,v1:172.21.15.84:6837/2672133286] conn(0x5606c54ab130 0x5606c54ab500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:22.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.335+0000 7f50997fa700 10 client.5778 ms_handle_connect on v2:172.21.15.84:6835/2672133286 2023-07-14T11:15:22.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.335+0000 7f50be59b700 1 --2- 172.21.15.84:0/616724119 >> [v2:172.21.15.84:6835/2672133286,v1:172.21.15.84:6837/2672133286] conn(0x5606c54ab130 0x5606c54ab500 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b78b98ecfd9e44f8 server_cookie=9c5c40b0e7c7b218 in_seq=0 out_seq=0 2023-07-14T11:15:22.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.336+0000 7f50997fa700 1 -- 172.21.15.84:0/616724119 <== mds.0 v2:172.21.15.84:6835/2672133286 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5606c544c170 con 0x5606c54ab130 2023-07-14T11:15:22.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.336+0000 7f50997fa700 10 client.5778 handle_command_reply: tid=0 2023-07-14T11:15:22.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.336+0000 7f50d4095b80 1 client.5778 shutdown 2023-07-14T11:15:22.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.336+0000 7f50d4095b80 1 -- 172.21.15.84:0/616724119 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606c5479dc0 msgr2=0x5606c54d54d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:22.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.336+0000 7f50d4095b80 1 --2- 172.21.15.84:0/616724119 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606c5479dc0 0x5606c54d54d0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f50b80681d0 tx=0x7f50b0004b40 comp rx=0 tx=0).stop 2023-07-14T11:15:22.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.336+0000 7f50d4095b80 1 -- 172.21.15.84:0/616724119 shutdown_connections 2023-07-14T11:15:22.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.336+0000 7f50d4095b80 1 --2- 172.21.15.84:0/616724119 >> [v2:172.21.15.84:6835/2672133286,v1:172.21.15.84:6837/2672133286] conn(0x5606c54ab130 0x5606c54ab500 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:22.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.336+0000 7f50d4095b80 1 --2- 172.21.15.84:0/616724119 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606c5479dc0 0x5606c54d54d0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:22.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.336+0000 7f50d4095b80 1 --2- 172.21.15.84:0/616724119 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5606c5477880 0x5606c547f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:22.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.336+0000 7f50d4095b80 1 --2- 172.21.15.84:0/616724119 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5606c5477c50 0x5606c547f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:22.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.336+0000 7f50997fa700 0 client.5778 ms_handle_reset on v2:172.21.15.84:6835/2672133286 2023-07-14T11:15:22.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.336+0000 7f50d4095b80 1 -- 172.21.15.84:0/616724119 >> 172.21.15.84:0/616724119 conn(0x5606c54723b0 msgr2=0x5606c547cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:22.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.336+0000 7f50d4095b80 1 -- 172.21.15.84:0/616724119 shutdown_connections 2023-07-14T11:15:22.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.337+0000 7f50d4095b80 1 -- 172.21.15.84:0/616724119 wait complete. 2023-07-14T11:15:22.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.337+0000 7f50d4095b80 20 client.5778 trim_cache size 0 max 16384 2023-07-14T11:15:22.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.354+0000 7f50d4095b80 1 Processor -- start 2023-07-14T11:15:22.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.354+0000 7f50d4095b80 1 -- start start 2023-07-14T11:15:22.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.355+0000 7f50d4095b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606c5477880 0x5606c54bd110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:22.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.355+0000 7f50d4095b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5606c5477c50 0x5606c54bd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:22.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.355+0000 7f50d4095b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5606c5479dc0 0x5606c54b8f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:22.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.355+0000 7f50d4095b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606c51c2390 con 0x5606c5477880 2023-07-14T11:15:22.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.355+0000 7f50d4095b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606c54d56a0 con 0x5606c5477c50 2023-07-14T11:15:22.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.355+0000 7f50d4095b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x5606c5492d90 con 0x5606c5479dc0 2023-07-14T11:15:22.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.356+0000 7f50be59b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606c5477880 0x5606c54bd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:22.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.356+0000 7f50be59b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606c5477880 0x5606c54bd110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43532/0 (socket says 172.21.15.84:43532) 2023-07-14T11:15:22.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.356+0000 7f50be59b700 1 -- 172.21.15.84:0/281819380 learned_addr learned my addr 172.21.15.84:0/281819380 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:22.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.356+0000 7f50bdd9a700 1 --2- 172.21.15.84:0/281819380 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5606c5477c50 0x5606c54bd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:22.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.356+0000 7f50be59b700 1 -- 172.21.15.84:0/281819380 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5606c5479dc0 msgr2=0x5606c54b8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:22.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.356+0000 7f50bed9c700 1 --2- 172.21.15.84:0/281819380 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5606c5479dc0 0x5606c54b8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:22.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.356+0000 7f50be59b700 1 --2- 172.21.15.84:0/281819380 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5606c5479dc0 0x5606c54b8f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:22.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.356+0000 7f50be59b700 1 -- 172.21.15.84:0/281819380 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5606c5477c50 msgr2=0x5606c54bd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:22.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.356+0000 7f50be59b700 1 --2- 172.21.15.84:0/281819380 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5606c5477c50 0x5606c54bd9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:22.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.356+0000 7f50be59b700 1 -- 172.21.15.84:0/281819380 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5606c5393b10 con 0x5606c5477880 2023-07-14T11:15:22.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.356+0000 7f50bdd9a700 1 --2- 172.21.15.84:0/281819380 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5606c5477c50 0x5606c54bd9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:15:22.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.356+0000 7f50be59b700 1 --2- 172.21.15.84:0/281819380 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606c5477880 0x5606c54bd110 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f50b4000f60 tx=0x7f50b405b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df2313f9f36029a3 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:22.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.356+0000 7f50acff9700 1 -- 172.21.15.84:0/281819380 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b4084070 con 0x5606c5477880 2023-07-14T11:15:22.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.356+0000 7f50acff9700 1 -- 172.21.15.84:0/281819380 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50b406ee90 con 0x5606c5477880 2023-07-14T11:15:22.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.356+0000 7f50acff9700 1 -- 172.21.15.84:0/281819380 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b406d040 con 0x5606c5477880 2023-07-14T11:15:22.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.357+0000 7f50d4095b80 1 -- 172.21.15.84:0/281819380 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606c5477880 msgr2=0x5606c54bd110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:22.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.357+0000 7f50d4095b80 1 --2- 172.21.15.84:0/281819380 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606c5477880 0x5606c54bd110 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f50b4000f60 tx=0x7f50b405b040 comp rx=0 tx=0).stop 2023-07-14T11:15:22.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.357+0000 7f50d4095b80 1 -- 172.21.15.84:0/281819380 shutdown_connections 2023-07-14T11:15:22.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.357+0000 7f50d4095b80 1 --2- 172.21.15.84:0/281819380 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5606c5479dc0 0x5606c54b8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:22.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.357+0000 7f50d4095b80 1 --2- 172.21.15.84:0/281819380 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606c5477880 0x5606c54bd110 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:22.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.357+0000 7f50d4095b80 1 --2- 172.21.15.84:0/281819380 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5606c5477c50 0x5606c54bd9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:22.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.357+0000 7f50d4095b80 1 -- 172.21.15.84:0/281819380 >> 172.21.15.84:0/281819380 conn(0x5606c54723b0 msgr2=0x5606c5473920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:22.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.357+0000 7f50d4095b80 1 -- 172.21.15.84:0/281819380 shutdown_connections 2023-07-14T11:15:22.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.357+0000 7f50d4095b80 1 -- 172.21.15.84:0/281819380 wait complete. 2023-07-14T11:15:22.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.358+0000 7f50d4095b80 1 -- start start 2023-07-14T11:15:22.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.358+0000 7f50d4095b80 1 Processor -- start 2023-07-14T11:15:22.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.359+0000 7f50d4095b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5606c5477880 0x5606c5529b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:22.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.359+0000 7f50d4095b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5606c5477c50 0x5606c54b8210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:22.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.359+0000 7f50d4095b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606c5479dc0 0x5606c5522ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:22.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.359+0000 7f50d4095b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606c54c4ac0 con 0x5606c5479dc0 2023-07-14T11:15:22.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.359+0000 7f50d4095b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606c54c5270 con 0x5606c5477c50 2023-07-14T11:15:22.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.359+0000 7f50d4095b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x5606c552a070 con 0x5606c5477880 2023-07-14T11:15:22.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.359+0000 7f50d4095b80 10 client.0 _ll_register_callbacks cb 0x7f50b0003de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T11:15:22.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.359+0000 7f50bed9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606c5479dc0 0x5606c5522ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:22.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.359+0000 7f50bed9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606c5479dc0 0x5606c5522ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43534/0 (socket says 172.21.15.84:43534) 2023-07-14T11:15:22.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.359+0000 7f50bed9c700 1 -- 172.21.15.84:0/2304398162 learned_addr learned my addr 172.21.15.84:0/2304398162 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:22.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.359+0000 7f50be59b700 1 --2- 172.21.15.84:0/2304398162 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5606c5477880 0x5606c5529b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:22.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.359+0000 7f50bdd9a700 1 --2- 172.21.15.84:0/2304398162 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5606c5477c50 0x5606c54b8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:22.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.360+0000 7f50bed9c700 1 -- 172.21.15.84:0/2304398162 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5606c5477880 msgr2=0x5606c5529b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:22.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.360+0000 7f50bed9c700 1 --2- 172.21.15.84:0/2304398162 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5606c5477880 0x5606c5529b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:22.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.360+0000 7f50bed9c700 1 -- 172.21.15.84:0/2304398162 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5606c5477c50 msgr2=0x5606c54b8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:22.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.360+0000 7f50bed9c700 1 --2- 172.21.15.84:0/2304398162 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5606c5477c50 0x5606c54b8210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:22.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.360+0000 7f50bed9c700 1 -- 172.21.15.84:0/2304398162 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50b80b7440 con 0x5606c5479dc0 2023-07-14T11:15:22.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.360+0000 7f50bed9c700 1 --2- 172.21.15.84:0/2304398162 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606c5479dc0 0x5606c5522ce0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f50b0004320 tx=0x7f50b0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c58e7e6305e5adc server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:22.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.360+0000 7f50997fa700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-07-14T11:15:22.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.360+0000 7f50997fa700 1 -- 172.21.15.84:0/2304398162 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b0028890 con 0x5606c5479dc0 2023-07-14T11:15:22.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.360+0000 7f50997fa700 1 -- 172.21.15.84:0/2304398162 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f50b0023070 con 0x5606c5479dc0 2023-07-14T11:15:22.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.360+0000 7f50d4095b80 1 -- 172.21.15.84:0/2304398162 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f50a8015a30 con 0x5606c5479dc0 2023-07-14T11:15:22.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.360+0000 7f50997fa700 1 -- 172.21.15.84:0/2304398162 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f50b0012970 con 0x5606c5479dc0 2023-07-14T11:15:22.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.360+0000 7f50d4095b80 10 client.5784 fetch_fsmap learned FSMap version 27 2023-07-14T11:15:22.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.360+0000 7f50d4095b80 1 -- 172.21.15.84:0/2304398162 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) v3 -- 0x5606c52221d0 con 0x5606c5479dc0 2023-07-14T11:15:22.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.360+0000 7f50997fa700 1 -- 172.21.15.84:0/2304398162 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50a8015a30 con 0x5606c5479dc0 2023-07-14T11:15:22.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.361+0000 7f50997fa700 1 -- 172.21.15.84:0/2304398162 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 27) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f50b00289f0 con 0x5606c5479dc0 2023-07-14T11:15:22.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.361+0000 7f50d4095b80 10 client.5784 fetch_fsmap finished waiting for FSMap version 27 2023-07-14T11:15:22.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.361+0000 7f50d4095b80 10 client.5784 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-14T11:15:22.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.361+0000 7f50d4095b80 20 client.5784 populate_metadata read hostname 'smithi084' 2023-07-14T11:15:22.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.361+0000 7f50d4095b80 1 --2- 172.21.15.84:0/2304398162 >> [v2:172.21.15.84:6835/2672133286,v1:172.21.15.84:6837/2672133286] conn(0x5606c54a4340 0x5606c54a4710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:22.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.361+0000 7f50d4095b80 4 client.5784 mds_command: new command op to 5625 tid=0[{"prefix": "status"}] 2023-07-14T11:15:22.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.361+0000 7f50d4095b80 1 -- 172.21.15.84:0/2304398162 --> [v2:172.21.15.84:6835/2672133286,v1:172.21.15.84:6837/2672133286] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5606c53c6d20 con 0x5606c54a4340 2023-07-14T11:15:22.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.361+0000 7f50be59b700 1 --2- 172.21.15.84:0/2304398162 >> [v2:172.21.15.84:6835/2672133286,v1:172.21.15.84:6837/2672133286] conn(0x5606c54a4340 0x5606c54a4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:22.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.361+0000 7f50be59b700 1 --2- 172.21.15.84:0/2304398162 >> [v2:172.21.15.84:6835/2672133286,v1:172.21.15.84:6837/2672133286] conn(0x5606c54a4340 0x5606c54a4710 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff446499c943ba7e server_cookie=6cd92e8f199c5a3b in_seq=0 out_seq=0 2023-07-14T11:15:22.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.361+0000 7f50997fa700 10 client.5784 ms_handle_connect on v2:172.21.15.84:6835/2672133286 2023-07-14T11:15:22.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.362+0000 7f50997fa700 1 -- 172.21.15.84:0/2304398162 <== mds.0 v2:172.21.15.84:6835/2672133286 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+319 (crc 0 0 0) 0x5606c53c6d20 con 0x5606c54a4340 2023-07-14T11:15:22.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.362+0000 7f50997fa700 10 client.5784 handle_command_reply: tid=0 2023-07-14T11:15:22.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.362+0000 7f50d4095b80 1 client.5784 shutdown 2023-07-14T11:15:22.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.362+0000 7f50d4095b80 1 -- 172.21.15.84:0/2304398162 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606c5479dc0 msgr2=0x5606c5522ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:22.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.362+0000 7f50d4095b80 1 --2- 172.21.15.84:0/2304398162 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606c5479dc0 0x5606c5522ce0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f50b0004320 tx=0x7f50b0009750 comp rx=0 tx=0).stop 2023-07-14T11:15:22.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.362+0000 7f50d4095b80 1 -- 172.21.15.84:0/2304398162 shutdown_connections 2023-07-14T11:15:22.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.362+0000 7f50d4095b80 1 --2- 172.21.15.84:0/2304398162 >> [v2:172.21.15.84:6835/2672133286,v1:172.21.15.84:6837/2672133286] conn(0x5606c54a4340 0x5606c54a4710 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:22.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.362+0000 7f50d4095b80 1 --2- 172.21.15.84:0/2304398162 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5606c5477880 0x5606c5529b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:22.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.362+0000 7f50d4095b80 1 --2- 172.21.15.84:0/2304398162 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606c5479dc0 0x5606c5522ce0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:22.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.362+0000 7f50997fa700 0 client.5784 ms_handle_reset on v2:172.21.15.84:6835/2672133286 2023-07-14T11:15:22.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.362+0000 7f50d4095b80 1 --2- 172.21.15.84:0/2304398162 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5606c5477c50 0x5606c54b8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:22.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.362+0000 7f50d4095b80 1 -- 172.21.15.84:0/2304398162 >> 172.21.15.84:0/2304398162 conn(0x5606c54723b0 msgr2=0x5606c54a8750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:22.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.362+0000 7f50d4095b80 1 -- 172.21.15.84:0/2304398162 shutdown_connections 2023-07-14T11:15:22.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.362+0000 7f50d4095b80 1 -- 172.21.15.84:0/2304398162 wait complete. 2023-07-14T11:15:22.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.362+0000 7f50d4095b80 20 client.5784 trim_cache size 0 max 16384 2023-07-14T11:15:22.374 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-07-14T11:15:22.374 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f", 2023-07-14T11:15:22.374 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 0, 2023-07-14T11:15:22.374 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 5625, 2023-07-14T11:15:22.374 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2023-07-14T11:15:22.374 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2023-07-14T11:15:22.374 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2023-07-14T11:15:22.375 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 11.440542782, 2023-07-14T11:15:22.375 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 27, 2023-07-14T11:15:22.375 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 50, 2023-07-14T11:15:22.375 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 50, 2023-07-14T11:15:22.375 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 16.947370571 2023-07-14T11:15:22.375 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-07-14T11:15:22.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.363+0000 7f50c07ff700 1 -- 172.21.15.84:0/1753780695 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f509c06ae90 msgr2=0x7f509c06d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:22.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.363+0000 7f50c07ff700 1 --2- 172.21.15.84:0/1753780695 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f509c06ae90 0x7f509c06d340 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f50b815f270 tx=0x7f50a8008040 comp rx=0 tx=0).stop 2023-07-14T11:15:22.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.363+0000 7f50c07ff700 1 -- 172.21.15.84:0/1753780695 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50b80b0e20 msgr2=0x7f50b80b6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:22.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.363+0000 7f50c07ff700 1 --2- 172.21.15.84:0/1753780695 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50b80b0e20 0x7f50b80b6780 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f50b400c520 tx=0x7f50b400c8e0 comp rx=0 tx=0).stop 2023-07-14T11:15:22.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.363+0000 7f50c07ff700 1 -- 172.21.15.84:0/1753780695 shutdown_connections 2023-07-14T11:15:22.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.363+0000 7f50c07ff700 1 --2- 172.21.15.84:0/1753780695 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50b80d0b10 0x7f50b80cbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:22.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.363+0000 7f50c07ff700 1 --2- 172.21.15.84:0/1753780695 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50b80b0e20 0x7f50b80b6780 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:22.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.363+0000 7f50c07ff700 1 --2- 172.21.15.84:0/1753780695 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f509c06ae90 0x7f509c06d340 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:22.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.363+0000 7f50c07ff700 1 --2- 172.21.15.84:0/1753780695 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50b80b8a60 0x7f50b80ca3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:22.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.363+0000 7f50c07ff700 1 -- 172.21.15.84:0/1753780695 >> 172.21.15.84:0/1753780695 conn(0x7f50b809c1b0 msgr2=0x7f50b80c9800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:22.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.363+0000 7f50c07ff700 1 -- 172.21.15.84:0/1753780695 shutdown_connections 2023-07-14T11:15:22.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.363+0000 7f50c07ff700 1 -- 172.21.15.84:0/1753780695 wait complete. 2023-07-14T11:15:22.383 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-14T11:15:22.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.576+0000 7f05a87ff700 1 Processor -- start 2023-07-14T11:15:22.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.576+0000 7f05a87ff700 1 -- start start 2023-07-14T11:15:22.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.577+0000 7f05a87ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f05a00b5d90 0x7f05a00b6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:22.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.577+0000 7f05a87ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f05a00d0b10 0x7f05a00d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:22.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.577+0000 7f05a87ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05a00b7f50 con 0x7f05a00b4510 2023-07-14T11:15:22.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.578+0000 7f05a87ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05a00b48e0 con 0x7f05a00d0b10 2023-07-14T11:15:22.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.578+0000 7f05a87ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05a00d14d0 con 0x7f05a00b5d90 2023-07-14T11:15:22.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.578+0000 7f05a659b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f05a00b4510 0x7f05a00cd590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:33556/0 (socket says 172.21.15.84:33556) 2023-07-14T11:15:22.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.578+0000 7f05a659b700 1 -- 172.21.15.84:0/2290100282 learned_addr learned my addr 172.21.15.84:0/2290100282 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:15:22.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.578+0000 7f05a6d9c700 1 --2- 172.21.15.84:0/2290100282 >> v2:172.21.15.84:3300/0 conn(0x7f05a00d0b10 0x7f05a00d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:22.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.578+0000 7f05a5d9a700 1 --2- 172.21.15.84:0/2290100282 >> v2:172.21.15.179:3300/0 conn(0x7f05a00b5d90 0x7f05a00b6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:22.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.578+0000 7f05a5599700 1 -- 172.21.15.84:0/2290100282 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1058201624 0 0) 0x7f05a00b7f50 con 0x7f05a00b4510 2023-07-14T11:15:22.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.578+0000 7f05a5599700 1 -- 172.21.15.84:0/2290100282 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f058c0035b0 con 0x7f05a00b4510 2023-07-14T11:15:22.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.578+0000 7f05a6d9c700 1 -- 172.21.15.84:0/2290100282 >> v2:172.21.15.179:3300/0 conn(0x7f05a00b5d90 msgr2=0x7f05a00b6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:22.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.578+0000 7f05a6d9c700 1 --2- 172.21.15.84:0/2290100282 >> v2:172.21.15.179:3300/0 conn(0x7f05a00b5d90 0x7f05a00b6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:22.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.578+0000 7f05a6d9c700 1 -- 172.21.15.84:0/2290100282 >> v1:172.21.15.84:6789/0 conn(0x7f05a00b4510 legacy=0x7f05a00cd590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:22.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.578+0000 7f05a6d9c700 1 -- 172.21.15.84:0/2290100282 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05a00cdca0 con 0x7f05a00d0b10 2023-07-14T11:15:22.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.579+0000 7f05a6d9c700 1 --2- 172.21.15.84:0/2290100282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05a00d0b10 0x7f05a00d0f90 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f05a00b5b30 tx=0x7f059800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=840699fc8ab70b75 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:22.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.579+0000 7f05a5599700 1 -- 172.21.15.84:0/2290100282 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059800e070 con 0x7f05a00d0b10 2023-07-14T11:15:22.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.579+0000 7f05a5599700 1 -- 172.21.15.84:0/2290100282 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f059800bb20 con 0x7f05a00d0b10 2023-07-14T11:15:22.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.579+0000 7f05a5599700 1 -- 172.21.15.84:0/2290100282 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0598012430 con 0x7f05a00d0b10 2023-07-14T11:15:22.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.579+0000 7f05a87ff700 1 -- 172.21.15.84:0/2290100282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05a00d0b10 msgr2=0x7f05a00d0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:22.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.579+0000 7f05a87ff700 1 --2- 172.21.15.84:0/2290100282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05a00d0b10 0x7f05a00d0f90 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f05a00b5b30 tx=0x7f059800b330 comp rx=0 tx=0).stop 2023-07-14T11:15:22.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.579+0000 7f05a87ff700 1 -- 172.21.15.84:0/2290100282 shutdown_connections 2023-07-14T11:15:22.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.579+0000 7f05a87ff700 1 --2- 172.21.15.84:0/2290100282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05a00d0b10 0x7f05a00d0f90 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:22.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.579+0000 7f05a87ff700 1 --2- 172.21.15.84:0/2290100282 >> v2:172.21.15.179:3300/0 conn(0x7f05a00b5d90 0x7f05a00b6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:22.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.579+0000 7f05a87ff700 1 -- 172.21.15.84:0/2290100282 >> 172.21.15.84:0/2290100282 conn(0x7f05a009c1d0 msgr2=0x7f05a00d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:22.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.580+0000 7f05a87ff700 1 -- 172.21.15.84:0/2290100282 shutdown_connections 2023-07-14T11:15:22.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.580+0000 7f05a87ff700 1 -- 172.21.15.84:0/2290100282 wait complete. 2023-07-14T11:15:22.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.581+0000 7f05a87ff700 1 Processor -- start 2023-07-14T11:15:22.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.581+0000 7f05a87ff700 1 -- start start 2023-07-14T11:15:22.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.582+0000 7f05a87ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05a00b4510 0x7f05a01514c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:22.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.582+0000 7f05a87ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05a00b5d90 0x7f05a00cba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:22.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.582+0000 7f05a87ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05a00d0b10 0x7f05a015f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:22.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.582+0000 7f05a87ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05a015cdb0 con 0x7f05a00b4510 2023-07-14T11:15:22.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.582+0000 7f05a87ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05a015d050 con 0x7f05a00d0b10 2023-07-14T11:15:22.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.582+0000 7f05a87ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05a00cbf60 con 0x7f05a00b5d90 2023-07-14T11:15:22.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.583+0000 7f05a659b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05a00b4510 0x7f05a01514c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:22.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.583+0000 7f05a659b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05a00b4510 0x7f05a01514c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43544/0 (socket says 172.21.15.84:43544) 2023-07-14T11:15:22.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.583+0000 7f05a659b700 1 -- 172.21.15.84:0/3996621569 learned_addr learned my addr 172.21.15.84:0/3996621569 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:22.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.583+0000 7f05a5d9a700 1 --2- 172.21.15.84:0/3996621569 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05a00b5d90 0x7f05a00cba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:22.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.583+0000 7f05a6d9c700 1 --2- 172.21.15.84:0/3996621569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05a00d0b10 0x7f05a015f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:22.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.583+0000 7f05a659b700 1 -- 172.21.15.84:0/3996621569 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05a00b5d90 msgr2=0x7f05a00cba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:22.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.583+0000 7f05a659b700 1 --2- 172.21.15.84:0/3996621569 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05a00b5d90 0x7f05a00cba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:22.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.583+0000 7f05a659b700 1 -- 172.21.15.84:0/3996621569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05a00d0b10 msgr2=0x7f05a015f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:22.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.583+0000 7f05a659b700 1 --2- 172.21.15.84:0/3996621569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05a00d0b10 0x7f05a015f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:22.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.583+0000 7f05a659b700 1 -- 172.21.15.84:0/3996621569 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0598009a70 con 0x7f05a00b4510 2023-07-14T11:15:22.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.583+0000 7f05a6d9c700 1 --2- 172.21.15.84:0/3996621569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05a00d0b10 0x7f05a015f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:15:22.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.583+0000 7f05a659b700 1 --2- 172.21.15.84:0/3996621569 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05a00b4510 0x7f05a01514c0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f059c001260 tx=0x7f059c00c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:22.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.584+0000 7f0596ffd700 1 -- 172.21.15.84:0/3996621569 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059c0074e0 con 0x7f05a00b4510 2023-07-14T11:15:22.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.584+0000 7f0596ffd700 1 -- 172.21.15.84:0/3996621569 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f059c007640 con 0x7f05a00b4510 2023-07-14T11:15:22.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.584+0000 7f0596ffd700 1 -- 172.21.15.84:0/3996621569 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059c005a50 con 0x7f05a00b4510 2023-07-14T11:15:22.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.584+0000 7f05a87ff700 1 -- 172.21.15.84:0/3996621569 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05a00cc230 con 0x7f05a00b4510 2023-07-14T11:15:22.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.584+0000 7f05a87ff700 1 -- 172.21.15.84:0/3996621569 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05a00cc7f0 con 0x7f05a00b4510 2023-07-14T11:15:22.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.585+0000 7f05a87ff700 1 -- 172.21.15.84:0/3996621569 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05a00cca10 con 0x7f05a00b4510 2023-07-14T11:15:22.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.586+0000 7f0596ffd700 1 -- 172.21.15.84:0/3996621569 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 7) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f059c005bb0 con 0x7f05a00b4510 2023-07-14T11:15:22.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.587+0000 7f0596ffd700 1 --2- 172.21.15.84:0/3996621569 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f058406ae90 0x7f058406d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:22.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.587+0000 7f0596ffd700 1 -- 172.21.15.84:0/3996621569 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f059c088b90 con 0x7f05a00b4510 2023-07-14T11:15:22.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.587+0000 7f05a5d9a700 1 --2- 172.21.15.84:0/3996621569 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f058406ae90 0x7f058406d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:22.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.588+0000 7f05a5d9a700 1 --2- 172.21.15.84:0/3996621569 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f058406ae90 0x7f058406d340 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f05a015b180 tx=0x7f0590008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:22.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.592+0000 7f0596ffd700 1 -- 172.21.15.84:0/3996621569 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f059c053a50 con 0x7f05a00b4510 2023-07-14T11:15:22.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.830+0000 7f05a87ff700 1 -- 172.21.15.84:0/3996621569 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f05a00723e0 con 0x7f05a00b4510 2023-07-14T11:15:22.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.830+0000 7f0596ffd700 1 -- 172.21.15.84:0/3996621569 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) v1 ==== 53+0+73 (secure 0 0 0) 0x7f059c017070 con 0x7f05a00b4510 2023-07-14T11:15:22.834 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-14T11:15:22.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.833+0000 7f05a87ff700 1 -- 172.21.15.84:0/3996621569 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f058406ae90 msgr2=0x7f058406d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:22.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.833+0000 7f05a87ff700 1 --2- 172.21.15.84:0/3996621569 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f058406ae90 0x7f058406d340 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f05a015b180 tx=0x7f0590008040 comp rx=0 tx=0).stop 2023-07-14T11:15:22.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.833+0000 7f05a87ff700 1 -- 172.21.15.84:0/3996621569 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05a00b4510 msgr2=0x7f05a01514c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:22.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.833+0000 7f05a87ff700 1 --2- 172.21.15.84:0/3996621569 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05a00b4510 0x7f05a01514c0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f059c001260 tx=0x7f059c00c7b0 comp rx=0 tx=0).stop 2023-07-14T11:15:22.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.833+0000 7f05a87ff700 1 -- 172.21.15.84:0/3996621569 shutdown_connections 2023-07-14T11:15:22.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.833+0000 7f05a87ff700 1 --2- 172.21.15.84:0/3996621569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05a00d0b10 0x7f05a015f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:22.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.833+0000 7f05a87ff700 1 --2- 172.21.15.84:0/3996621569 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05a00b4510 0x7f05a01514c0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:22.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.833+0000 7f05a87ff700 1 --2- 172.21.15.84:0/3996621569 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f058406ae90 0x7f058406d340 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:22.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.833+0000 7f05a87ff700 1 --2- 172.21.15.84:0/3996621569 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05a00b5d90 0x7f05a00cba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:22.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.833+0000 7f05a87ff700 1 -- 172.21.15.84:0/3996621569 >> 172.21.15.84:0/3996621569 conn(0x7f05a009c1d0 msgr2=0x7f05a00ce130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:22.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.833+0000 7f05a87ff700 1 -- 172.21.15.84:0/3996621569 shutdown_connections 2023-07-14T11:15:22.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:22.833+0000 7f05a87ff700 1 -- 172.21.15.84:0/3996621569 wait complete. 2023-07-14T11:15:22.854 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-14T11:15:22.854 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-14T11:15:22.854 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi084.front.sepia.ceph.com 2023-07-14T11:15:22.855 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-14T11:15:22.855 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-14T11:15:22.855 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-14T11:15:22.855 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-14T11:15:22.856 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-14T11:15:22.856 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-14T11:15:22.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:15:22.857 DEBUG:teuthology.orchestra.run.smithi084:> ip addr 2023-07-14T11:15:22.903 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-14T11:15:22.903 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-14T11:15:22.903 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2023-07-14T11:15:22.903 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:15:22.904 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2023-07-14T11:15:22.904 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:15:22.904 INFO:teuthology.orchestra.run.smithi084.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T11:15:22.904 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:68 brd ff:ff:ff:ff:ff:ff 2023-07-14T11:15:22.904 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f0 2023-07-14T11:15:22.904 INFO:teuthology.orchestra.run.smithi084.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T11:15:22.904 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:69 brd ff:ff:ff:ff:ff:ff 2023-07-14T11:15:22.905 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f1 2023-07-14T11:15:22.905 INFO:teuthology.orchestra.run.smithi084.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T11:15:22.905 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:50 brd ff:ff:ff:ff:ff:ff 2023-07-14T11:15:22.905 INFO:teuthology.orchestra.run.smithi084.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-14T11:15:22.905 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:51 brd ff:ff:ff:ff:ff:ff 2023-07-14T11:15:22.905 INFO:teuthology.orchestra.run.smithi084.stdout: inet 172.21.15.84/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-14T11:15:22.905 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft 41845sec preferred_lft 41845sec 2023-07-14T11:15:22.905 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::ec4:7aff:fe8f:d751/64 scope link 2023-07-14T11:15:22.906 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:15:22.906 INFO:teuthology.orchestra.run.smithi084.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-14T11:15:22.906 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 2e:15:90:61:8f:22 brd ff:ff:ff:ff:ff:ff 2023-07-14T11:15:22.906 INFO:teuthology.orchestra.run.smithi084.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-14T11:15:22.906 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:15:22.906 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::dc90:1eff:feca:b2b4/64 scope link 2023-07-14T11:15:22.906 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:15:22.907 INFO:teuthology.orchestra.run.smithi084.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-14T11:15:22.907 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 2e:15:90:61:8f:22 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-14T11:15:22.907 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::2c15:90ff:fe61:8f22/64 scope link 2023-07-14T11:15:22.907 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:15:22.907 INFO:teuthology.orchestra.run.smithi084.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-14T11:15:22.907 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 5e:77:8b:e6:63:60 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-14T11:15:22.907 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::5c77:8bff:fee6:6360/64 scope link 2023-07-14T11:15:22.907 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:15:22.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:15:22.909 DEBUG:teuthology.orchestra.run.smithi084:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-14T11:15:22.976 INFO:teuthology.orchestra.run.smithi084.stdout:1 2023-07-14T11:15:22.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:15:22.980 DEBUG:teuthology.orchestra.run.smithi084:> route 2023-07-14T11:15:23.029 INFO:teuthology.orchestra.run.smithi084.stdout:Kernel IP routing table 2023-07-14T11:15:23.029 INFO:teuthology.orchestra.run.smithi084.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-14T11:15:23.029 INFO:teuthology.orchestra.run.smithi084.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-14T11:15:23.030 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-14T11:15:23.030 INFO:teuthology.orchestra.run.smithi084.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-14T11:15:23.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:15:23.031 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-07-14T11:15:23.031 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-07-14T11:15:23.032 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-14T11:15:23.032 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-14T11:15:23.032 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-14T11:15:23.033 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-07-14T11:15:23.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:15:23.202 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2023-07-14T11:15:23.248 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-14T11:15:23.249 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-14T11:15:23.249 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-14T11:15:23.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:15:23.250 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set brx.0 up 2023-07-14T11:15:23.358 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T11:15:23.359 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-14T11:15:23.404 INFO:teuthology.orchestra.run.smithi084.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-14T11:15:23.405 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T11:15:23.405 DEBUG:teuthology.orchestra.run.smithi084:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-14T11:15:23.450 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-07-14T11:15:23.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:15:23.451 DEBUG:teuthology.orchestra.run.smithi084:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-14T11:15:23.593 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-14T11:15:23.593 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-14T11:15:23.620 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-14T11:15:23.620 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-14T11:15:23.620 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-07-14T11:15:23.620 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: trying mount with new device syntax: 0@3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f.cephfs=/ 2023-07-14T11:15:23.620 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.84:3300/172.21.15.179:3300/172.21.15.179:3301" will pass to kernel 2023-07-14T11:15:23.626 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-14T11:15:23.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:15:23.627 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-14T11:15:23.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:15:23.697 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-14T11:15:23.799 INFO:teuthology.orchestra.run.smithi084.stdout:client5796 2023-07-14T11:15:23.799 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-14T11:15:23.800 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:15:23.845 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-14T11:15:24.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.079+0000 7f5077bff700 1 Processor -- start 2023-07-14T11:15:24.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.079+0000 7f5077bff700 1 -- start start 2023-07-14T11:15:24.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.080+0000 7f5077bff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f50700d1220 0x7f50700b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:24.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.080+0000 7f5077bff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50700d2ce0 con 0x7f507015c950 2023-07-14T11:15:24.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.080+0000 7f5077bff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50700b3350 con 0x7f50700b1e00 2023-07-14T11:15:24.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.080+0000 7f5077bff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50700b3630 con 0x7f50700d1220 2023-07-14T11:15:24.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.080+0000 7f507599b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f507015c950 0x7f50700d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:33558/0 (socket says 172.21.15.84:33558) 2023-07-14T11:15:24.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.080+0000 7f507599b700 1 -- 172.21.15.84:0/1579196448 learned_addr learned my addr 172.21.15.84:0/1579196448 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:15:24.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.081+0000 7f507519a700 1 --2- 172.21.15.84:0/1579196448 >> v2:172.21.15.179:3300/0 conn(0x7f50700d1220 0x7f50700b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:24.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.081+0000 7f5074999700 1 -- 172.21.15.84:0/1579196448 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1396348658 0 0) 0x7f50700d2ce0 con 0x7f507015c950 2023-07-14T11:15:24.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.081+0000 7f5074999700 1 -- 172.21.15.84:0/1579196448 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f505c0035b0 con 0x7f507015c950 2023-07-14T11:15:24.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.081+0000 7f5074999700 1 -- 172.21.15.84:0/1579196448 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1287419338 0 0) 0x7f505c0035b0 con 0x7f507015c950 2023-07-14T11:15:24.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.081+0000 7f5074999700 1 -- 172.21.15.84:0/1579196448 >> v2:172.21.15.179:3300/0 conn(0x7f50700d1220 msgr2=0x7f50700b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:24.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.081+0000 7f5074999700 1 --2- 172.21.15.84:0/1579196448 >> v2:172.21.15.179:3300/0 conn(0x7f50700d1220 0x7f50700b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:24.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.081+0000 7f5074999700 1 -- 172.21.15.84:0/1579196448 >> v1:172.21.15.179:6789/0 conn(0x7f50700b1e00 legacy=0x7f50700afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:24.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.081+0000 7f5074999700 1 -- 172.21.15.84:0/1579196448 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50700b3910 con 0x7f507015c950 2023-07-14T11:15:24.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.081+0000 7f5074999700 1 -- 172.21.15.84:0/1579196448 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7f506c0017f0 con 0x7f507015c950 2023-07-14T11:15:24.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.081+0000 7f5074999700 1 -- 172.21.15.84:0/1579196448 >> v1:172.21.15.84:6789/0 conn(0x7f507015c950 legacy=0x7f50700d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:24.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.081+0000 7f5074999700 1 --2- 172.21.15.84:0/1579196448 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f505c003a00 0x7f505c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:24.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.081+0000 7f5074999700 1 --2- 172.21.15.84:0/1579196448 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f505c0043f0 0x7f505c0048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:24.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.081+0000 7f5074999700 1 --2- 172.21.15.84:0/1579196448 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f505c005150 0x7f505c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:24.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.081+0000 7f5074999700 1 -- 172.21.15.84:0/1579196448 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50700b3630 con 0x7f505c003a00 2023-07-14T11:15:24.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.081+0000 7f5074999700 1 -- 172.21.15.84:0/1579196448 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f505c00c080 con 0x7f505c0043f0 2023-07-14T11:15:24.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.081+0000 7f5074999700 1 -- 172.21.15.84:0/1579196448 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f505c00c240 con 0x7f505c005150 2023-07-14T11:15:24.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.082+0000 7f507599b700 1 --2- 172.21.15.84:0/1579196448 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f505c003a00 0x7f505c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:24.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.082+0000 7f507519a700 1 --2- 172.21.15.84:0/1579196448 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f505c0043f0 0x7f505c0048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:24.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.082+0000 7f507619c700 1 --2- 172.21.15.84:0/1579196448 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f505c005150 0x7f505c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:24.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.082+0000 7f507599b700 1 -- 172.21.15.84:0/1579196448 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f505c005150 msgr2=0x7f505c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:24.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.082+0000 7f507599b700 1 --2- 172.21.15.84:0/1579196448 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f505c005150 0x7f505c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:24.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.082+0000 7f507599b700 1 -- 172.21.15.84:0/1579196448 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f505c0043f0 msgr2=0x7f505c0048b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:24.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.082+0000 7f507599b700 1 --2- 172.21.15.84:0/1579196448 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f505c0043f0 0x7f505c0048b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:24.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.082+0000 7f507599b700 1 -- 172.21.15.84:0/1579196448 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f505c0035b0 con 0x7f505c003a00 2023-07-14T11:15:24.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.082+0000 7f507619c700 1 -- 172.21.15.84:0/1579196448 reap_dead start 2023-07-14T11:15:24.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.082+0000 7f507599b700 1 --2- 172.21.15.84:0/1579196448 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f505c003a00 0x7f505c003dd0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f506c00c240 tx=0x7f505c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=132576bf3498a726 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:24.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.082+0000 7f5074999700 1 -- 172.21.15.84:0/1579196448 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506c00cde0 con 0x7f505c003a00 2023-07-14T11:15:24.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.082+0000 7f5074999700 1 -- 172.21.15.84:0/1579196448 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f506c007ba0 con 0x7f505c003a00 2023-07-14T11:15:24.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.082+0000 7f5074999700 1 -- 172.21.15.84:0/1579196448 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506c007310 con 0x7f505c003a00 2023-07-14T11:15:24.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.083+0000 7f5077bff700 1 -- 172.21.15.84:0/1579196448 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f505c003a00 msgr2=0x7f505c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:24.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.083+0000 7f5077bff700 1 --2- 172.21.15.84:0/1579196448 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f505c003a00 0x7f505c003dd0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f506c00c240 tx=0x7f505c005880 comp rx=0 tx=0).stop 2023-07-14T11:15:24.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.083+0000 7f5077bff700 1 -- 172.21.15.84:0/1579196448 shutdown_connections 2023-07-14T11:15:24.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.083+0000 7f5077bff700 1 --2- 172.21.15.84:0/1579196448 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f505c003a00 0x7f505c003dd0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:24.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.083+0000 7f5077bff700 1 -- 172.21.15.84:0/1579196448 >> 172.21.15.84:0/1579196448 conn(0x7f507009c1d0 msgr2=0x7f50700d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:24.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.083+0000 7f5077bff700 1 -- 172.21.15.84:0/1579196448 shutdown_connections 2023-07-14T11:15:24.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.083+0000 7f5077bff700 1 -- 172.21.15.84:0/1579196448 wait complete. 2023-07-14T11:15:24.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.085+0000 7f5077bff700 1 Processor -- start 2023-07-14T11:15:24.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.085+0000 7f5077bff700 1 -- start start 2023-07-14T11:15:24.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.086+0000 7f5077bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f505c003a00 0x7f5070146c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:24.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.086+0000 7f5077bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50700b62c0 0x7f50700c8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:24.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.086+0000 7f5077bff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f507014c1d0 0x7f507014c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:24.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.086+0000 7f5077bff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50700b6730 con 0x7f507014c1d0 2023-07-14T11:15:24.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.086+0000 7f5077bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f507014cb80 con 0x7f505c003a00 2023-07-14T11:15:24.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.086+0000 7f5077bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50701474e0 con 0x7f50700b62c0 2023-07-14T11:15:24.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.086+0000 7f507619c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f507014c1d0 0x7f507014c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:24.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.086+0000 7f507619c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f507014c1d0 0x7f507014c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43560/0 (socket says 172.21.15.84:43560) 2023-07-14T11:15:24.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.086+0000 7f507619c700 1 -- 172.21.15.84:0/3163949984 learned_addr learned my addr 172.21.15.84:0/3163949984 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:24.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.086+0000 7f507519a700 1 --2- 172.21.15.84:0/3163949984 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50700b62c0 0x7f50700c8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:24.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.086+0000 7f507599b700 1 --2- 172.21.15.84:0/3163949984 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f505c003a00 0x7f5070146c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:24.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.086+0000 7f507619c700 1 -- 172.21.15.84:0/3163949984 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50700b62c0 msgr2=0x7f50700c8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:24.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.086+0000 7f507619c700 1 --2- 172.21.15.84:0/3163949984 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50700b62c0 0x7f50700c8650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:24.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.086+0000 7f507619c700 1 -- 172.21.15.84:0/3163949984 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f505c003a00 msgr2=0x7f5070146c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:24.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.086+0000 7f507619c700 1 --2- 172.21.15.84:0/3163949984 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f505c003a00 0x7f5070146c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:24.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.087+0000 7f507619c700 1 -- 172.21.15.84:0/3163949984 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50700c8b90 con 0x7f507014c1d0 2023-07-14T11:15:24.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.087+0000 7f507519a700 1 --2- 172.21.15.84:0/3163949984 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50700b62c0 0x7f50700c8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:15:24.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.087+0000 7f507619c700 1 --2- 172.21.15.84:0/3163949984 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f507014c1d0 0x7f507014c640 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f507008d390 tx=0x7f506800d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:24.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.087+0000 7f50667fc700 1 -- 172.21.15.84:0/3163949984 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5068003c10 con 0x7f507014c1d0 2023-07-14T11:15:24.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.087+0000 7f50667fc700 1 -- 172.21.15.84:0/3163949984 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5068003d70 con 0x7f507014c1d0 2023-07-14T11:15:24.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.087+0000 7f5077bff700 1 -- 172.21.15.84:0/3163949984 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50701494d0 con 0x7f507014c1d0 2023-07-14T11:15:24.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.087+0000 7f50667fc700 1 -- 172.21.15.84:0/3163949984 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506800dbd0 con 0x7f507014c1d0 2023-07-14T11:15:24.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.087+0000 7f5077bff700 1 -- 172.21.15.84:0/3163949984 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5070149a90 con 0x7f507014c1d0 2023-07-14T11:15:24.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.088+0000 7f5077bff700 1 -- 172.21.15.84:0/3163949984 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f507004e280 con 0x7f507014c1d0 2023-07-14T11:15:24.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.089+0000 7f50667fc700 1 -- 172.21.15.84:0/3163949984 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 7) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f506800dd30 con 0x7f507014c1d0 2023-07-14T11:15:24.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.090+0000 7f50667fc700 1 --2- 172.21.15.84:0/3163949984 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f505406ae90 0x7f505406d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:24.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.090+0000 7f50667fc700 1 -- 172.21.15.84:0/3163949984 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5068089b10 con 0x7f507014c1d0 2023-07-14T11:15:24.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.090+0000 7f507599b700 1 --2- 172.21.15.84:0/3163949984 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f505406ae90 0x7f505406d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:24.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.091+0000 7f507599b700 1 --2- 172.21.15.84:0/3163949984 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f505406ae90 0x7f505406d340 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f506c000c00 tx=0x7f506c007000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:24.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.094+0000 7f50667fc700 1 -- 172.21.15.84:0/3163949984 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f50680548a0 con 0x7f507014c1d0 2023-07-14T11:15:24.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.331+0000 7f5077bff700 1 -- 172.21.15.84:0/3163949984 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5070160020 con 0x7f507014c1d0 2023-07-14T11:15:24.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.332+0000 7f50667fc700 1 -- 172.21.15.84:0/3163949984 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5068057ec0 con 0x7f507014c1d0 2023-07-14T11:15:24.334 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-14T11:15:24.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.334+0000 7f5077bff700 1 -- 172.21.15.84:0/3163949984 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f505406ae90 msgr2=0x7f505406d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:24.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.334+0000 7f5077bff700 1 --2- 172.21.15.84:0/3163949984 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f505406ae90 0x7f505406d340 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f506c000c00 tx=0x7f506c007000 comp rx=0 tx=0).stop 2023-07-14T11:15:24.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.334+0000 7f5077bff700 1 -- 172.21.15.84:0/3163949984 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f507014c1d0 msgr2=0x7f507014c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:24.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.334+0000 7f5077bff700 1 --2- 172.21.15.84:0/3163949984 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f507014c1d0 0x7f507014c640 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f507008d390 tx=0x7f506800d430 comp rx=0 tx=0).stop 2023-07-14T11:15:24.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.334+0000 7f5077bff700 1 -- 172.21.15.84:0/3163949984 shutdown_connections 2023-07-14T11:15:24.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.334+0000 7f5077bff700 1 --2- 172.21.15.84:0/3163949984 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f507014c1d0 0x7f507014c640 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:24.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.334+0000 7f5077bff700 1 --2- 172.21.15.84:0/3163949984 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f505c003a00 0x7f5070146c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:24.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.334+0000 7f5077bff700 1 --2- 172.21.15.84:0/3163949984 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f505406ae90 0x7f505406d340 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:24.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.334+0000 7f5077bff700 1 --2- 172.21.15.84:0/3163949984 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50700b62c0 0x7f50700c8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:24.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.334+0000 7f5077bff700 1 -- 172.21.15.84:0/3163949984 >> 172.21.15.84:0/3163949984 conn(0x7f507009c1d0 msgr2=0x7f507006c030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:24.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.335+0000 7f5077bff700 1 -- 172.21.15.84:0/3163949984 shutdown_connections 2023-07-14T11:15:24.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:24.335+0000 7f5077bff700 1 -- 172.21.15.84:0/3163949984 wait complete. 2023-07-14T11:15:24.354 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-14T11:15:24.355 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-14T11:15:24.355 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi179.front.sepia.ceph.com 2023-07-14T11:15:24.355 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-07-14T11:15:24.356 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-14T11:15:24.356 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-14T11:15:24.356 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-14T11:15:24.356 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-14T11:15:24.357 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-14T11:15:24.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:15:24.357 DEBUG:teuthology.orchestra.run.smithi179:> ip addr 2023-07-14T11:15:24.409 INFO:teuthology.orchestra.run.smithi179.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-14T11:15:24.409 INFO:teuthology.orchestra.run.smithi179.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-14T11:15:24.409 INFO:teuthology.orchestra.run.smithi179.stdout: inet 127.0.0.1/8 scope host lo 2023-07-14T11:15:24.410 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:15:24.410 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 ::1/128 scope host 2023-07-14T11:15:24.410 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:15:24.410 INFO:teuthology.orchestra.run.smithi179.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T11:15:24.410 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:34 brd ff:ff:ff:ff:ff:ff 2023-07-14T11:15:24.410 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f0 2023-07-14T11:15:24.410 INFO:teuthology.orchestra.run.smithi179.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T11:15:24.411 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:35 brd ff:ff:ff:ff:ff:ff 2023-07-14T11:15:24.411 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f1 2023-07-14T11:15:24.411 INFO:teuthology.orchestra.run.smithi179.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T11:15:24.411 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5a brd ff:ff:ff:ff:ff:ff 2023-07-14T11:15:24.411 INFO:teuthology.orchestra.run.smithi179.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-14T11:15:24.411 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5b brd ff:ff:ff:ff:ff:ff 2023-07-14T11:15:24.411 INFO:teuthology.orchestra.run.smithi179.stdout: inet 172.21.15.179/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-14T11:15:24.412 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft 41731sec preferred_lft 41731sec 2023-07-14T11:15:24.412 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::ec4:7aff:fe88:725b/64 scope link 2023-07-14T11:15:24.412 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:15:24.412 INFO:teuthology.orchestra.run.smithi179.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-14T11:15:24.412 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 46:75:18:db:4e:84 brd ff:ff:ff:ff:ff:ff 2023-07-14T11:15:24.412 INFO:teuthology.orchestra.run.smithi179.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-14T11:15:24.412 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:15:24.412 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::fc06:a1ff:feba:ddf1/64 scope link 2023-07-14T11:15:24.413 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:15:24.413 INFO:teuthology.orchestra.run.smithi179.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-14T11:15:24.413 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 92:db:40:bf:aa:be brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-14T11:15:24.413 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::90db:40ff:febf:aabe/64 scope link 2023-07-14T11:15:24.413 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:15:24.413 INFO:teuthology.orchestra.run.smithi179.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-14T11:15:24.413 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 46:75:18:db:4e:84 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-07-14T11:15:24.413 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::4475:18ff:fedb:4e84/64 scope link 2023-07-14T11:15:24.414 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:15:24.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:15:24.415 DEBUG:teuthology.orchestra.run.smithi179:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-14T11:15:24.485 INFO:teuthology.orchestra.run.smithi179.stdout:1 2023-07-14T11:15:24.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:15:24.488 DEBUG:teuthology.orchestra.run.smithi179:> route 2023-07-14T11:15:24.536 INFO:teuthology.orchestra.run.smithi179.stdout:Kernel IP routing table 2023-07-14T11:15:24.537 INFO:teuthology.orchestra.run.smithi179.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-14T11:15:24.537 INFO:teuthology.orchestra.run.smithi179.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-14T11:15:24.537 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-14T11:15:24.537 INFO:teuthology.orchestra.run.smithi179.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-14T11:15:24.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:15:24.538 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2023-07-14T11:15:24.539 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2023-07-14T11:15:24.539 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-14T11:15:24.539 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-14T11:15:24.540 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-14T11:15:24.540 DEBUG:teuthology.orchestra.run.smithi179:> ') 2023-07-14T11:15:24.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:15:24.708 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2023-07-14T11:15:24.754 INFO:teuthology.orchestra.run.smithi179.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-07-14T11:15:24.754 INFO:teuthology.orchestra.run.smithi179.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-14T11:15:24.755 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-14T11:15:24.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:15:24.756 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link set brx.0 up 2023-07-14T11:15:24.826 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T11:15:24.826 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-07-14T11:15:24.871 INFO:teuthology.orchestra.run.smithi179.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-07-14T11:15:24.872 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T11:15:24.872 DEBUG:teuthology.orchestra.run.smithi179:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-07-14T11:15:24.956 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-07-14T11:15:24.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:15:24.957 DEBUG:teuthology.orchestra.run.smithi179:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-14T11:15:25.101 INFO:teuthology.orchestra.run.smithi179.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-14T11:15:25.101 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-14T11:15:25.129 INFO:teuthology.orchestra.run.smithi179.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-14T11:15:25.129 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-14T11:15:25.129 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-07-14T11:15:25.129 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: trying mount with new device syntax: 1@3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f.cephfs=/ 2023-07-14T11:15:25.130 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.84:3300/172.21.15.179:3300/172.21.15.179:3301" will pass to kernel 2023-07-14T11:15:25.134 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-14T11:15:25.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:15:25.135 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-07-14T11:15:25.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:15:25.205 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-14T11:15:25.292 INFO:teuthology.orchestra.run.smithi179.stdout:client5581 2023-07-14T11:15:25.293 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-07-14T11:15:25.293 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:15:25.338 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-07-14T11:15:25.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:25.545+0000 7f5b6bfff700 1 Processor -- start 2023-07-14T11:15:25.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:25.546+0000 7f5b6bfff700 1 -- start start 2023-07-14T11:15:25.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:25.547+0000 7f5b6bfff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5b6415c890 0x7f5b640d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:25.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:25.547+0000 7f5b6bfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5b6406c240 0x7f5b640d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:25.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:25.547+0000 7f5b6bfff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b6415cc60 con 0x7f5b640b2440 2023-07-14T11:15:25.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:25.547+0000 7f5b6bfff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b6406a7f0 con 0x7f5b6406c240 2023-07-14T11:15:25.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:25.547+0000 7f5b6bfff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b6406b760 con 0x7f5b6415c890 2023-07-14T11:15:25.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:25.547+0000 7f5b6a59c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5b6406c240 0x7f5b640d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:25.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:25.547+0000 7f5b6a59c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5b6406c240 0x7f5b640d0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43570/0 (socket says 172.21.15.84:43570) 2023-07-14T11:15:25.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:25.547+0000 7f5b6a59c700 1 -- 172.21.15.84:0/3793266267 learned_addr learned my addr 172.21.15.84:0/3793266267 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:25.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:25.547+0000 7f5b69d9b700 1 --2- 172.21.15.84:0/3793266267 >> v2:172.21.15.179:3300/0 conn(0x7f5b6415c890 0x7f5b640d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:25.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:25.547+0000 7f5b6a59c700 1 -- 172.21.15.84:0/3793266267 >> v2:172.21.15.179:3300/0 conn(0x7f5b6415c890 msgr2=0x7f5b640d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:25.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:25.548+0000 7f5b6a59c700 1 --2- 172.21.15.84:0/3793266267 >> v2:172.21.15.179:3300/0 conn(0x7f5b6415c890 0x7f5b640d0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:25.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:25.548+0000 7f5b6a59c700 1 -- 172.21.15.84:0/3793266267 >> v1:172.21.15.179:6789/0 conn(0x7f5b640b2440 legacy=0x7f5b640cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:25.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:25.548+0000 7f5b6a59c700 1 -- 172.21.15.84:0/3793266267 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b6406ba40 con 0x7f5b6406c240 2023-07-14T11:15:25.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:25.548+0000 7f5b6a59c700 1 --2- 172.21.15.84:0/3793266267 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b6406c240 0x7f5b640d0f90 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c009e50 tx=0x7f5b5c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe8fdcc7b3940111 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:25.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:25.548+0000 7f5b68d99700 1 -- 172.21.15.84:0/3793266267 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5c00e070 con 0x7f5b6406c240 2023-07-14T11:15:25.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:25.548+0000 7f5b68d99700 1 -- 172.21.15.84:0/3793266267 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b5c00b8d0 con 0x7f5b6406c240 2023-07-14T11:15:25.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:25.548+0000 7f5b68d99700 1 -- 172.21.15.84:0/3793266267 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5c00bc80 con 0x7f5b6406c240 2023-07-14T11:15:25.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:25.548+0000 7f5b6bfff700 1 -- 172.21.15.84:0/3793266267 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b6406c240 msgr2=0x7f5b640d0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:25.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:25.548+0000 7f5b6bfff700 1 --2- 172.21.15.84:0/3793266267 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b6406c240 0x7f5b640d0f90 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c009e50 tx=0x7f5b5c00b330 comp rx=0 tx=0).stop 2023-07-14T11:15:25.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:25.549+0000 7f5b6bfff700 1 -- 172.21.15.84:0/3793266267 shutdown_connections 2023-07-14T11:15:25.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:25.549+0000 7f5b6bfff700 1 --2- 172.21.15.84:0/3793266267 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b6406c240 0x7f5b640d0f90 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:25.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:25.549+0000 7f5b6bfff700 1 --2- 172.21.15.84:0/3793266267 >> v2:172.21.15.179:3300/0 conn(0x7f5b6415c890 0x7f5b640d0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:25.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:25.549+0000 7f5b6bfff700 1 -- 172.21.15.84:0/3793266267 >> 172.21.15.84:0/3793266267 conn(0x7f5b6409c170 msgr2=0x7f5b640d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:25.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:25.549+0000 7f5b6bfff700 1 -- 172.21.15.84:0/3793266267 shutdown_connections 2023-07-14T11:15:25.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:25.549+0000 7f5b6bfff700 1 -- 172.21.15.84:0/3793266267 wait complete. 2023-07-14T11:15:25.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:25.550+0000 7f5b6bfff700 1 Processor -- start 2023-07-14T11:15:25.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:25.551+0000 7f5b6bfff700 1 -- start start 2023-07-14T11:15:25.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:25.551+0000 7f5b6bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b6406c240 0x7f5b64156f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:25.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:25.551+0000 7f5b6bfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b640b2440 0x7f5b6415a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:25.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:25.551+0000 7f5b6bfff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b6415c890 0x7f5b6415add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:25.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:25.552+0000 7f5b6bfff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b64157660 con 0x7f5b6406c240 2023-07-14T11:15:25.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:25.552+0000 7f5b6bfff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b64157940 con 0x7f5b6415c890 2023-07-14T11:15:25.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:25.552+0000 7f5b6bfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b64157c20 con 0x7f5b640b2440 2023-07-14T11:15:25.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:25.552+0000 7f5b69d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b6406c240 0x7f5b64156f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:25.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:25.552+0000 7f5b69d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b6406c240 0x7f5b64156f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43576/0 (socket says 172.21.15.84:43576) 2023-07-14T11:15:25.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:25.552+0000 7f5b69d9b700 1 -- 172.21.15.84:0/2774619132 learned_addr learned my addr 172.21.15.84:0/2774619132 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:25.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:25.552+0000 7f5b6a59c700 1 --2- 172.21.15.84:0/2774619132 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b6415c890 0x7f5b6415add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:25.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:25.552+0000 7f5b6959a700 1 --2- 172.21.15.84:0/2774619132 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b640b2440 0x7f5b6415a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:25.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:25.552+0000 7f5b69d9b700 1 -- 172.21.15.84:0/2774619132 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b640b2440 msgr2=0x7f5b6415a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:25.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:25.552+0000 7f5b69d9b700 1 --2- 172.21.15.84:0/2774619132 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b640b2440 0x7f5b6415a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:25.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:25.552+0000 7f5b69d9b700 1 -- 172.21.15.84:0/2774619132 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b6415c890 msgr2=0x7f5b6415add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:25.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:25.552+0000 7f5b69d9b700 1 --2- 172.21.15.84:0/2774619132 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b6415c890 0x7f5b6415add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:25.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:25.552+0000 7f5b69d9b700 1 -- 172.21.15.84:0/2774619132 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b5c009b30 con 0x7f5b6406c240 2023-07-14T11:15:25.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:25.552+0000 7f5b6959a700 1 --2- 172.21.15.84:0/2774619132 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b640b2440 0x7f5b6415a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:15:25.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:25.552+0000 7f5b69d9b700 1 --2- 172.21.15.84:0/2774619132 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b6406c240 0x7f5b64156f60 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f5b6000e9b0 tx=0x7f5b6000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:25.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:25.553+0000 7f5b5a7fc700 1 -- 172.21.15.84:0/2774619132 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b60009710 con 0x7f5b6406c240 2023-07-14T11:15:25.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:25.553+0000 7f5b5a7fc700 1 -- 172.21.15.84:0/2774619132 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b6000c850 con 0x7f5b6406c240 2023-07-14T11:15:25.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:25.553+0000 7f5b5a7fc700 1 -- 172.21.15.84:0/2774619132 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6000cbc0 con 0x7f5b6406c240 2023-07-14T11:15:25.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:25.553+0000 7f5b6bfff700 1 -- 172.21.15.84:0/2774619132 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b64157f00 con 0x7f5b6406c240 2023-07-14T11:15:25.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:25.553+0000 7f5b6bfff700 1 -- 172.21.15.84:0/2774619132 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b64158700 con 0x7f5b6406c240 2023-07-14T11:15:25.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:25.554+0000 7f5b6bfff700 1 -- 172.21.15.84:0/2774619132 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b64074350 con 0x7f5b6406c240 2023-07-14T11:15:25.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:25.555+0000 7f5b5a7fc700 1 -- 172.21.15.84:0/2774619132 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 7) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f5b6000cd20 con 0x7f5b6406c240 2023-07-14T11:15:25.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:25.555+0000 7f5b5a7fc700 1 --2- 172.21.15.84:0/2774619132 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f5b4806ae90 0x7f5b4806d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:25.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:25.556+0000 7f5b5a7fc700 1 -- 172.21.15.84:0/2774619132 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5b600897f0 con 0x7f5b6406c240 2023-07-14T11:15:25.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:25.556+0000 7f5b6959a700 1 --2- 172.21.15.84:0/2774619132 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f5b4806ae90 0x7f5b4806d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:25.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:25.556+0000 7f5b6959a700 1 --2- 172.21.15.84:0/2774619132 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f5b4806ae90 0x7f5b4806d340 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f5b641f4ed0 tx=0x7f5b54009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:25.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:25.560+0000 7f5b5a7fc700 1 -- 172.21.15.84:0/2774619132 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f5b600546b0 con 0x7f5b6406c240 2023-07-14T11:15:25.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:25.797+0000 7f5b6bfff700 1 -- 172.21.15.84:0/2774619132 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f5b6414f8e0 con 0x7f5b6406c240 2023-07-14T11:15:25.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:25.988+0000 7f5b5a7fc700 1 -- 172.21.15.84:0/2774619132 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v28) v1 ==== 136+0+0 (secure 0 0 0) 0x7f5b60057cd0 con 0x7f5b6406c240 2023-07-14T11:15:25.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:25.991+0000 7f5b6bfff700 1 -- 172.21.15.84:0/2774619132 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f5b4806ae90 msgr2=0x7f5b4806d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:25.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:25.991+0000 7f5b6bfff700 1 --2- 172.21.15.84:0/2774619132 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f5b4806ae90 0x7f5b4806d340 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f5b641f4ed0 tx=0x7f5b54009040 comp rx=0 tx=0).stop 2023-07-14T11:15:25.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:25.991+0000 7f5b6bfff700 1 -- 172.21.15.84:0/2774619132 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b6406c240 msgr2=0x7f5b64156f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:25.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:25.991+0000 7f5b6bfff700 1 --2- 172.21.15.84:0/2774619132 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b6406c240 0x7f5b64156f60 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f5b6000e9b0 tx=0x7f5b6000ecc0 comp rx=0 tx=0).stop 2023-07-14T11:15:25.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:25.991+0000 7f5b6bfff700 1 -- 172.21.15.84:0/2774619132 shutdown_connections 2023-07-14T11:15:25.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:25.991+0000 7f5b6bfff700 1 --2- 172.21.15.84:0/2774619132 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b6415c890 0x7f5b6415add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:25.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:25.991+0000 7f5b6bfff700 1 --2- 172.21.15.84:0/2774619132 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b6406c240 0x7f5b64156f60 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:25.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:25.991+0000 7f5b6bfff700 1 --2- 172.21.15.84:0/2774619132 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f5b4806ae90 0x7f5b4806d340 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:25.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:25.991+0000 7f5b6bfff700 1 --2- 172.21.15.84:0/2774619132 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b640b2440 0x7f5b6415a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:25.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:25.991+0000 7f5b6bfff700 1 -- 172.21.15.84:0/2774619132 >> 172.21.15.84:0/2774619132 conn(0x7f5b6409c170 msgr2=0x7f5b6415b670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:25.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:25.991+0000 7f5b6bfff700 1 -- 172.21.15.84:0/2774619132 shutdown_connections 2023-07-14T11:15:25.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:25.991+0000 7f5b6bfff700 1 -- 172.21.15.84:0/2774619132 wait complete. 2023-07-14T11:15:26.011 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-07-14T11:15:26.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.206+0000 7f68621ff700 1 Processor -- start 2023-07-14T11:15:26.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.207+0000 7f68621ff700 1 -- start start 2023-07-14T11:15:26.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.208+0000 7f68621ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f685c0b8660 0x7f685c0cd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:26.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.208+0000 7f68621ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f685c0cd970 0x7f685c0b4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:26.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.208+0000 7f68621ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f685c0d02a0 con 0x7f685c0b4da0 2023-07-14T11:15:26.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.208+0000 7f68621ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f685c0b51c0 con 0x7f685c0cd970 2023-07-14T11:15:26.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.208+0000 7f68621ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f685c0cfce0 con 0x7f685c0b8660 2023-07-14T11:15:26.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.208+0000 7f685b7fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f685c0b8660 0x7f685c0cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:26.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.208+0000 7f685affd700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f685c0cd970 0x7f685c0b4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:26.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.208+0000 7f685bfff700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f685c0b4da0 0x7f685c1601f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.84:60894/0 (socket says 172.21.15.84:60894) 2023-07-14T11:15:26.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.208+0000 7f685bfff700 1 -- 172.21.15.84:0/2201335016 learned_addr learned my addr 172.21.15.84:0/2201335016 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:15:26.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.209+0000 7f685a7fc700 1 -- 172.21.15.84:0/2201335016 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 414943410 0 0) 0x7f685c0d02a0 con 0x7f685c0b4da0 2023-07-14T11:15:26.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.209+0000 7f685a7fc700 1 -- 172.21.15.84:0/2201335016 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68440035b0 con 0x7f685c0b4da0 2023-07-14T11:15:26.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.209+0000 7f685b7fe700 1 -- 172.21.15.84:0/2201335016 >> v2:172.21.15.179:3300/0 conn(0x7f685c0cd970 msgr2=0x7f685c0b4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:26.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.209+0000 7f685b7fe700 1 --2- 172.21.15.84:0/2201335016 >> v2:172.21.15.179:3300/0 conn(0x7f685c0cd970 0x7f685c0b4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:26.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.209+0000 7f685b7fe700 1 -- 172.21.15.84:0/2201335016 >> v1:172.21.15.179:6789/0 conn(0x7f685c0b4da0 legacy=0x7f685c1601f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:26.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.209+0000 7f685b7fe700 1 -- 172.21.15.84:0/2201335016 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f685c0cffc0 con 0x7f685c0b8660 2023-07-14T11:15:26.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.209+0000 7f685affd700 1 --2- 172.21.15.84:0/2201335016 >> v2:172.21.15.179:3300/0 conn(0x7f685c0cd970 0x7f685c0b4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:15:26.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.209+0000 7f685b7fe700 1 --2- 172.21.15.84:0/2201335016 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f685c0b8660 0x7f685c0cd430 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f684c009840 tx=0x7f684c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6fdbace3bf37aae server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:26.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.209+0000 7f685a7fc700 1 -- 172.21.15.84:0/2201335016 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f684c011830 con 0x7f685c0b8660 2023-07-14T11:15:26.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.209+0000 7f685a7fc700 1 -- 172.21.15.84:0/2201335016 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f684c011990 con 0x7f685c0b8660 2023-07-14T11:15:26.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.209+0000 7f685a7fc700 1 -- 172.21.15.84:0/2201335016 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f684c011d20 con 0x7f685c0b8660 2023-07-14T11:15:26.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.210+0000 7f68621ff700 1 -- 172.21.15.84:0/2201335016 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f685c0b8660 msgr2=0x7f685c0cd430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:26.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.210+0000 7f68621ff700 1 --2- 172.21.15.84:0/2201335016 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f685c0b8660 0x7f685c0cd430 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f684c009840 tx=0x7f684c009b50 comp rx=0 tx=0).stop 2023-07-14T11:15:26.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.210+0000 7f68621ff700 1 -- 172.21.15.84:0/2201335016 shutdown_connections 2023-07-14T11:15:26.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.210+0000 7f68621ff700 1 --2- 172.21.15.84:0/2201335016 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f685c0b8660 0x7f685c0cd430 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:26.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.210+0000 7f68621ff700 1 --2- 172.21.15.84:0/2201335016 >> v2:172.21.15.179:3300/0 conn(0x7f685c0cd970 0x7f685c0b4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:26.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.210+0000 7f68621ff700 1 -- 172.21.15.84:0/2201335016 >> 172.21.15.84:0/2201335016 conn(0x7f685c066860 msgr2=0x7f685c06a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:26.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.210+0000 7f68621ff700 1 -- 172.21.15.84:0/2201335016 shutdown_connections 2023-07-14T11:15:26.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.210+0000 7f68621ff700 1 -- 172.21.15.84:0/2201335016 wait complete. 2023-07-14T11:15:26.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.212+0000 7f68621ff700 1 Processor -- start 2023-07-14T11:15:26.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.212+0000 7f68621ff700 1 -- start start 2023-07-14T11:15:26.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.213+0000 7f68621ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f685c0b4da0 0x7f685c151bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:26.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.213+0000 7f68621ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f685c0b8660 0x7f685c156d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:26.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.213+0000 7f68621ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f685c0cd970 0x7f685c15f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:26.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.213+0000 7f68621ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f685c157670 con 0x7f685c0b8660 2023-07-14T11:15:26.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.213+0000 7f68621ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f685c158d70 con 0x7f685c0cd970 2023-07-14T11:15:26.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.213+0000 7f68621ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f685c159050 con 0x7f685c0b4da0 2023-07-14T11:15:26.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.213+0000 7f685affd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f685c0b8660 0x7f685c156d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:26.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.213+0000 7f685affd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f685c0b8660 0x7f685c156d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43592/0 (socket says 172.21.15.84:43592) 2023-07-14T11:15:26.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.213+0000 7f685affd700 1 -- 172.21.15.84:0/1100967583 learned_addr learned my addr 172.21.15.84:0/1100967583 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:26.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.213+0000 7f685b7fe700 1 --2- 172.21.15.84:0/1100967583 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f685c0b4da0 0x7f685c151bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:26.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.213+0000 7f685bfff700 1 --2- 172.21.15.84:0/1100967583 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f685c0cd970 0x7f685c15f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:26.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.213+0000 7f685affd700 1 -- 172.21.15.84:0/1100967583 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f685c0b4da0 msgr2=0x7f685c151bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:26.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.213+0000 7f685affd700 1 --2- 172.21.15.84:0/1100967583 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f685c0b4da0 0x7f685c151bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:26.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.213+0000 7f685affd700 1 -- 172.21.15.84:0/1100967583 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f685c0cd970 msgr2=0x7f685c15f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:26.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.213+0000 7f685affd700 1 --2- 172.21.15.84:0/1100967583 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f685c0cd970 0x7f685c15f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:26.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.213+0000 7f685affd700 1 -- 172.21.15.84:0/1100967583 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68500094a0 con 0x7f685c0b8660 2023-07-14T11:15:26.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.213+0000 7f685bfff700 1 --2- 172.21.15.84:0/1100967583 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f685c0cd970 0x7f685c15f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:15:26.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.214+0000 7f685affd700 1 --2- 172.21.15.84:0/1100967583 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f685c0b8660 0x7f685c156d70 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f685000ebe0 tx=0x7f6850009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:26.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.214+0000 7f6843fff700 1 -- 172.21.15.84:0/1100967583 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685000c890 con 0x7f685c0b8660 2023-07-14T11:15:26.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.214+0000 7f6843fff700 1 -- 172.21.15.84:0/1100967583 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f685000c9f0 con 0x7f685c0b8660 2023-07-14T11:15:26.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.214+0000 7f6843fff700 1 -- 172.21.15.84:0/1100967583 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685000cda0 con 0x7f685c0b8660 2023-07-14T11:15:26.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.214+0000 7f68621ff700 1 -- 172.21.15.84:0/1100967583 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f684c0094a0 con 0x7f685c0b8660 2023-07-14T11:15:26.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.214+0000 7f68621ff700 1 -- 172.21.15.84:0/1100967583 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f685c159610 con 0x7f685c0b8660 2023-07-14T11:15:26.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.215+0000 7f68621ff700 1 -- 172.21.15.84:0/1100967583 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f685c156310 con 0x7f685c0b8660 2023-07-14T11:15:26.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.216+0000 7f6843fff700 1 -- 172.21.15.84:0/1100967583 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 7) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f6850013470 con 0x7f685c0b8660 2023-07-14T11:15:26.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.217+0000 7f6843fff700 1 --2- 172.21.15.84:0/1100967583 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f684806ae90 0x7f684806d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:26.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.217+0000 7f6843fff700 1 -- 172.21.15.84:0/1100967583 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6850089680 con 0x7f685c0b8660 2023-07-14T11:15:26.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.217+0000 7f685b7fe700 1 --2- 172.21.15.84:0/1100967583 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f684806ae90 0x7f684806d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:26.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.217+0000 7f685b7fe700 1 --2- 172.21.15.84:0/1100967583 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f684806ae90 0x7f684806d340 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f684c000c00 tx=0x7f684c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:26.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.221+0000 7f6843fff700 1 -- 172.21.15.84:0/1100967583 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f6850054410 con 0x7f685c0b8660 2023-07-14T11:15:26.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.443+0000 7f68621ff700 1 -- 172.21.15.84:0/1100967583 --> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f685c158ee0 con 0x7f684806ae90 2023-07-14T11:15:26.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.444+0000 7f6843fff700 1 -- 172.21.15.84:0/1100967583 <== mgr.4104 v2:172.21.15.84:6832/379617029 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f685c158ee0 con 0x7f684806ae90 2023-07-14T11:15:26.446 INFO:teuthology.orchestra.run.smithi084.stdout:[ 2023-07-14T11:15:26.446 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:15:26.447 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "cephfs" 2023-07-14T11:15:26.447 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:15:26.447 INFO:teuthology.orchestra.run.smithi084.stdout:] 2023-07-14T11:15:26.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.446+0000 7f68621ff700 1 -- 172.21.15.84:0/1100967583 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f684806ae90 msgr2=0x7f684806d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:26.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.446+0000 7f68621ff700 1 --2- 172.21.15.84:0/1100967583 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f684806ae90 0x7f684806d340 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f684c000c00 tx=0x7f684c008030 comp rx=0 tx=0).stop 2023-07-14T11:15:26.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.446+0000 7f68621ff700 1 -- 172.21.15.84:0/1100967583 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f685c0b8660 msgr2=0x7f685c156d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:26.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.446+0000 7f68621ff700 1 --2- 172.21.15.84:0/1100967583 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f685c0b8660 0x7f685c156d70 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f685000ebe0 tx=0x7f6850009e60 comp rx=0 tx=0).stop 2023-07-14T11:15:26.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.446+0000 7f68621ff700 1 -- 172.21.15.84:0/1100967583 shutdown_connections 2023-07-14T11:15:26.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.447+0000 7f68621ff700 1 --2- 172.21.15.84:0/1100967583 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f684806ae90 0x7f684806d340 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:26.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.447+0000 7f68621ff700 1 --2- 172.21.15.84:0/1100967583 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f685c0b4da0 0x7f685c151bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:26.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.447+0000 7f68621ff700 1 --2- 172.21.15.84:0/1100967583 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f685c0cd970 0x7f685c15f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:26.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.447+0000 7f68621ff700 1 --2- 172.21.15.84:0/1100967583 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f685c0b8660 0x7f685c156d70 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:26.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.447+0000 7f68621ff700 1 -- 172.21.15.84:0/1100967583 >> 172.21.15.84:0/1100967583 conn(0x7f685c066860 msgr2=0x7f685c0b2580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:26.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.447+0000 7f68621ff700 1 -- 172.21.15.84:0/1100967583 shutdown_connections 2023-07-14T11:15:26.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.447+0000 7f68621ff700 1 -- 172.21.15.84:0/1100967583 wait complete. 2023-07-14T11:15:26.467 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-14T11:15:26.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.663+0000 7f496b7ff700 1 Processor -- start 2023-07-14T11:15:26.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.663+0000 7f496b7ff700 1 -- start start 2023-07-14T11:15:26.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.664+0000 7f496b7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49640c92d0 0x7f49640ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:26.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.664+0000 7f496b7ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f49640b12f0 0x7f49640c96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:26.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.664+0000 7f496b7ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f49640adea0 0x7f496406c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:26.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.664+0000 7f496b7ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f496415da60 con 0x7f49640adea0 2023-07-14T11:15:26.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.664+0000 7f496b7ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f496415ce70 con 0x7f49640b12f0 2023-07-14T11:15:26.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.664+0000 7f496b7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49640c9be0 con 0x7f49640c92d0 2023-07-14T11:15:26.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.665+0000 7f4969d9c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f49640adea0 0x7f496406c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:26.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.665+0000 7f4969d9c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f49640adea0 0x7f496406c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43594/0 (socket says 172.21.15.84:43594) 2023-07-14T11:15:26.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.665+0000 7f4969d9c700 1 -- 172.21.15.84:0/2086373422 learned_addr learned my addr 172.21.15.84:0/2086373422 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:26.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.665+0000 7f4968d9a700 1 --2- 172.21.15.84:0/2086373422 >> v2:172.21.15.179:3300/0 conn(0x7f49640b12f0 0x7f49640c96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:26.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.665+0000 7f496959b700 1 --2- 172.21.15.84:0/2086373422 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49640c92d0 0x7f49640ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:26.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.665+0000 7f4969d9c700 1 -- 172.21.15.84:0/2086373422 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49640c92d0 msgr2=0x7f49640ad8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:26.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.665+0000 7f4969d9c700 1 --2- 172.21.15.84:0/2086373422 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49640c92d0 0x7f49640ad8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:26.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.665+0000 7f4969d9c700 1 -- 172.21.15.84:0/2086373422 >> v2:172.21.15.179:3300/0 conn(0x7f49640b12f0 msgr2=0x7f49640c96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:26.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.665+0000 7f4969d9c700 1 --2- 172.21.15.84:0/2086373422 >> v2:172.21.15.179:3300/0 conn(0x7f49640b12f0 0x7f49640c96a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:26.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.665+0000 7f4969d9c700 1 -- 172.21.15.84:0/2086373422 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f496415d0c0 con 0x7f49640adea0 2023-07-14T11:15:26.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.665+0000 7f4969d9c700 1 --2- 172.21.15.84:0/2086373422 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49640adea0 0x7f496406c6c0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f496406d700 tx=0x7f495c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b06e7849879c1e3 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:26.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.666+0000 7f495bfff700 1 -- 172.21.15.84:0/2086373422 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495c00e070 con 0x7f49640adea0 2023-07-14T11:15:26.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.666+0000 7f495bfff700 1 -- 172.21.15.84:0/2086373422 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f495c00b910 con 0x7f49640adea0 2023-07-14T11:15:26.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.666+0000 7f495bfff700 1 -- 172.21.15.84:0/2086373422 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495c00bcc0 con 0x7f49640adea0 2023-07-14T11:15:26.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.666+0000 7f496b7ff700 1 -- 172.21.15.84:0/2086373422 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49640adea0 msgr2=0x7f496406c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:26.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.666+0000 7f496b7ff700 1 --2- 172.21.15.84:0/2086373422 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49640adea0 0x7f496406c6c0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f496406d700 tx=0x7f495c00b330 comp rx=0 tx=0).stop 2023-07-14T11:15:26.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.666+0000 7f496b7ff700 1 -- 172.21.15.84:0/2086373422 shutdown_connections 2023-07-14T11:15:26.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.666+0000 7f496b7ff700 1 --2- 172.21.15.84:0/2086373422 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49640c92d0 0x7f49640ad8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:26.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.666+0000 7f496b7ff700 1 --2- 172.21.15.84:0/2086373422 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49640adea0 0x7f496406c6c0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:26.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.666+0000 7f496b7ff700 1 --2- 172.21.15.84:0/2086373422 >> v2:172.21.15.179:3300/0 conn(0x7f49640b12f0 0x7f49640c96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:26.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.666+0000 7f496b7ff700 1 -- 172.21.15.84:0/2086373422 >> 172.21.15.84:0/2086373422 conn(0x7f49640b05d0 msgr2=0x7f49640b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:26.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.666+0000 7f496b7ff700 1 -- 172.21.15.84:0/2086373422 shutdown_connections 2023-07-14T11:15:26.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.666+0000 7f496b7ff700 1 -- 172.21.15.84:0/2086373422 wait complete. 2023-07-14T11:15:26.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.668+0000 7f496b7ff700 1 Processor -- start 2023-07-14T11:15:26.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.668+0000 7f496b7ff700 1 -- start start 2023-07-14T11:15:26.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.669+0000 7f496b7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49640adea0 0x7f496415abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:26.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.669+0000 7f496b7ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49640b12f0 0x7f49641508c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:26.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.669+0000 7f496b7ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49640c92d0 0x7f496415bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:26.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.669+0000 7f496b7ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4964154ef0 con 0x7f49640b12f0 2023-07-14T11:15:26.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.669+0000 7f496b7ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49640b2d20 con 0x7f49640c92d0 2023-07-14T11:15:26.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.669+0000 7f496b7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49640b3000 con 0x7f49640adea0 2023-07-14T11:15:26.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.669+0000 7f4968d9a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49640b12f0 0x7f49641508c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:26.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.669+0000 7f4968d9a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49640b12f0 0x7f49641508c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43596/0 (socket says 172.21.15.84:43596) 2023-07-14T11:15:26.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.669+0000 7f4968d9a700 1 -- 172.21.15.84:0/3135813117 learned_addr learned my addr 172.21.15.84:0/3135813117 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:26.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.670+0000 7f496959b700 1 --2- 172.21.15.84:0/3135813117 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49640adea0 0x7f496415abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:26.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.670+0000 7f4969d9c700 1 --2- 172.21.15.84:0/3135813117 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49640c92d0 0x7f496415bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:26.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.670+0000 7f4968d9a700 1 -- 172.21.15.84:0/3135813117 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49640adea0 msgr2=0x7f496415abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:26.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.670+0000 7f4968d9a700 1 --2- 172.21.15.84:0/3135813117 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49640adea0 0x7f496415abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:26.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.670+0000 7f4968d9a700 1 -- 172.21.15.84:0/3135813117 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49640c92d0 msgr2=0x7f496415bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:26.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.670+0000 7f4968d9a700 1 --2- 172.21.15.84:0/3135813117 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49640c92d0 0x7f496415bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:26.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.670+0000 7f4968d9a700 1 -- 172.21.15.84:0/3135813117 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f495c009b30 con 0x7f49640b12f0 2023-07-14T11:15:26.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.670+0000 7f4968d9a700 1 --2- 172.21.15.84:0/3135813117 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49640b12f0 0x7f49641508c0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f495400e870 tx=0x7f495400eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:26.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.670+0000 7f4959ffb700 1 -- 172.21.15.84:0/3135813117 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4954013680 con 0x7f49640b12f0 2023-07-14T11:15:26.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.670+0000 7f4959ffb700 1 -- 172.21.15.84:0/3135813117 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49540137e0 con 0x7f49640b12f0 2023-07-14T11:15:26.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.670+0000 7f4959ffb700 1 -- 172.21.15.84:0/3135813117 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4954013b90 con 0x7f49640b12f0 2023-07-14T11:15:26.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.671+0000 7f496b7ff700 1 -- 172.21.15.84:0/3135813117 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49640b32e0 con 0x7f49640b12f0 2023-07-14T11:15:26.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.671+0000 7f496b7ff700 1 -- 172.21.15.84:0/3135813117 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f496415b100 con 0x7f49640b12f0 2023-07-14T11:15:26.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.672+0000 7f496b7ff700 1 -- 172.21.15.84:0/3135813117 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49640b3800 con 0x7f49640b12f0 2023-07-14T11:15:26.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.673+0000 7f4959ffb700 1 -- 172.21.15.84:0/3135813117 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 7) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f4954013cf0 con 0x7f49640b12f0 2023-07-14T11:15:26.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.673+0000 7f4959ffb700 1 --2- 172.21.15.84:0/3135813117 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f494806ae90 0x7f494806d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:26.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.674+0000 7f4959ffb700 1 -- 172.21.15.84:0/3135813117 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4954089570 con 0x7f49640b12f0 2023-07-14T11:15:26.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.674+0000 7f496959b700 1 --2- 172.21.15.84:0/3135813117 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f494806ae90 0x7f494806d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:26.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.674+0000 7f496959b700 1 --2- 172.21.15.84:0/3135813117 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f494806ae90 0x7f494806d340 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f4960009be0 tx=0x7f4960009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:26.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.678+0000 7f4959ffb700 1 -- 172.21.15.84:0/3135813117 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f49640b3800 con 0x7f49640b12f0 2023-07-14T11:15:26.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.874+0000 7f496b7ff700 1 -- 172.21.15.84:0/3135813117 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f49640b3800 con 0x7f49640b12f0 2023-07-14T11:15:26.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.874+0000 7f4959ffb700 1 -- 172.21.15.84:0/3135813117 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f49640b3800 con 0x7f49640b12f0 2023-07-14T11:15:26.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.876+0000 7f496b7ff700 1 -- 172.21.15.84:0/3135813117 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f494806ae90 msgr2=0x7f494806d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:26.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.876+0000 7f496b7ff700 1 --2- 172.21.15.84:0/3135813117 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f494806ae90 0x7f494806d340 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f4960009be0 tx=0x7f4960009210 comp rx=0 tx=0).stop 2023-07-14T11:15:26.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.876+0000 7f496b7ff700 1 -- 172.21.15.84:0/3135813117 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49640b12f0 msgr2=0x7f49641508c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:26.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.876+0000 7f496b7ff700 1 --2- 172.21.15.84:0/3135813117 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49640b12f0 0x7f49641508c0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f495400e870 tx=0x7f495400eb80 comp rx=0 tx=0).stop 2023-07-14T11:15:26.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.876+0000 7f496b7ff700 1 -- 172.21.15.84:0/3135813117 shutdown_connections 2023-07-14T11:15:26.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.876+0000 7f496b7ff700 1 --2- 172.21.15.84:0/3135813117 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f494806ae90 0x7f494806d340 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:26.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.876+0000 7f496b7ff700 1 --2- 172.21.15.84:0/3135813117 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49640adea0 0x7f496415abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:26.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.876+0000 7f496b7ff700 1 --2- 172.21.15.84:0/3135813117 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49640c92d0 0x7f496415bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:26.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.876+0000 7f496b7ff700 1 --2- 172.21.15.84:0/3135813117 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49640b12f0 0x7f49641508c0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:26.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.876+0000 7f496b7ff700 1 -- 172.21.15.84:0/3135813117 >> 172.21.15.84:0/3135813117 conn(0x7f49640b05d0 msgr2=0x7f49640cd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:26.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.877+0000 7f496b7ff700 1 -- 172.21.15.84:0/3135813117 shutdown_connections 2023-07-14T11:15:26.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:26.877+0000 7f496b7ff700 1 -- 172.21.15.84:0/3135813117 wait complete. 2023-07-14T11:15:26.897 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-14T11:15:26.897 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:15:26.944 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-14T11:15:26.945 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:15:27.032 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:15:27.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.265+0000 7f1ee13ff700 1 Processor -- start 2023-07-14T11:15:27.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.265+0000 7f1ee13ff700 1 -- start start 2023-07-14T11:15:27.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.266+0000 7f1ee13ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1edc15c950 0x7f1edc0b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:27.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.266+0000 7f1ee13ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1edc0d1220 0x7f1edc0afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:27.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.266+0000 7f1ee13ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1edc0d2ce0 con 0x7f1edc0b1e00 2023-07-14T11:15:27.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.266+0000 7f1ee13ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1edc0b3350 con 0x7f1edc15c950 2023-07-14T11:15:27.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.266+0000 7f1ee13ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1edc0b3630 con 0x7f1edc0d1220 2023-07-14T11:15:27.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.267+0000 7f1edaffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1edc15c950 0x7f1edc0b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:27.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.267+0000 7f1edaffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1edc15c950 0x7f1edc0b43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43606/0 (socket says 172.21.15.84:43606) 2023-07-14T11:15:27.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.267+0000 7f1eda7fc700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f1edc0b1e00 0x7f1edc0d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:33560/0 (socket says 172.21.15.84:33560) 2023-07-14T11:15:27.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.267+0000 7f1edaffd700 1 -- 172.21.15.84:0/1950916358 learned_addr learned my addr 172.21.15.84:0/1950916358 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:27.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.267+0000 7f1edb7fe700 1 --2- 172.21.15.84:0/1950916358 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1edc0d1220 0x7f1edc0afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:27.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.267+0000 7f1edaffd700 1 -- 172.21.15.84:0/1950916358 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1edc0d1220 msgr2=0x7f1edc0afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:27.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.267+0000 7f1edaffd700 1 --2- 172.21.15.84:0/1950916358 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1edc0d1220 0x7f1edc0afac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:27.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.267+0000 7f1edaffd700 1 -- 172.21.15.84:0/1950916358 >> v1:172.21.15.84:6789/0 conn(0x7f1edc0b1e00 legacy=0x7f1edc0d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:27.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.267+0000 7f1edaffd700 1 -- 172.21.15.84:0/1950916358 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1edc0b3910 con 0x7f1edc15c950 2023-07-14T11:15:27.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.267+0000 7f1ed9ffb700 1 -- 172.21.15.84:0/1950916358 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4123825682 0 0) 0x7f1edc0d2ce0 con 0x7f1edc0b1e00 2023-07-14T11:15:27.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.267+0000 7f1edaffd700 1 --2- 172.21.15.84:0/1950916358 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1edc15c950 0x7f1edc0b43f0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc006fd0 tx=0x7f1ecc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8f8d70f0dfe4662 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:27.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.268+0000 7f1ed9ffb700 1 -- 172.21.15.84:0/1950916358 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc005e30 con 0x7f1edc15c950 2023-07-14T11:15:27.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.268+0000 7f1ed9ffb700 1 -- 172.21.15.84:0/1950916358 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ecc004030 con 0x7f1edc15c950 2023-07-14T11:15:27.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.268+0000 7f1ed9ffb700 1 -- 172.21.15.84:0/1950916358 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc0043e0 con 0x7f1edc15c950 2023-07-14T11:15:27.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.268+0000 7f1ee13ff700 1 -- 172.21.15.84:0/1950916358 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1edc15c950 msgr2=0x7f1edc0b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:27.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.268+0000 7f1ee13ff700 1 --2- 172.21.15.84:0/1950916358 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1edc15c950 0x7f1edc0b43f0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc006fd0 tx=0x7f1ecc009bd0 comp rx=0 tx=0).stop 2023-07-14T11:15:27.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.268+0000 7f1ee13ff700 1 -- 172.21.15.84:0/1950916358 shutdown_connections 2023-07-14T11:15:27.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.268+0000 7f1ee13ff700 1 --2- 172.21.15.84:0/1950916358 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1edc0d1220 0x7f1edc0afac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:27.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.268+0000 7f1ee13ff700 1 --2- 172.21.15.84:0/1950916358 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1edc15c950 0x7f1edc0b43f0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:27.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.268+0000 7f1ee13ff700 1 -- 172.21.15.84:0/1950916358 >> 172.21.15.84:0/1950916358 conn(0x7f1edc09c1d0 msgr2=0x7f1edc0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:27.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.268+0000 7f1ee13ff700 1 -- 172.21.15.84:0/1950916358 shutdown_connections 2023-07-14T11:15:27.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.268+0000 7f1ee13ff700 1 -- 172.21.15.84:0/1950916358 wait complete. 2023-07-14T11:15:27.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.270+0000 7f1ee13ff700 1 Processor -- start 2023-07-14T11:15:27.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.270+0000 7f1ee13ff700 1 -- start start 2023-07-14T11:15:27.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.271+0000 7f1ee13ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1edc0b1e00 0x7f1edc0cb410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:27.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.271+0000 7f1ee13ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1edc0d1220 0x7f1edc1f1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:27.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.271+0000 7f1ee13ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1edc15c950 0x7f1edc156730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:27.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.271+0000 7f1ee13ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1edc1f21e0 con 0x7f1edc15c950 2023-07-14T11:15:27.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.271+0000 7f1ee13ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1edc0c89d0 con 0x7f1edc0d1220 2023-07-14T11:15:27.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.271+0000 7f1ee13ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1edc0cd350 con 0x7f1edc0b1e00 2023-07-14T11:15:27.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.271+0000 7f1edb7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1edc15c950 0x7f1edc156730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:27.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.271+0000 7f1edb7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1edc15c950 0x7f1edc156730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43618/0 (socket says 172.21.15.84:43618) 2023-07-14T11:15:27.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.271+0000 7f1edb7fe700 1 -- 172.21.15.84:0/1564482333 learned_addr learned my addr 172.21.15.84:0/1564482333 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:27.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.272+0000 7f1eda7fc700 1 --2- 172.21.15.84:0/1564482333 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1edc0d1220 0x7f1edc1f1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:27.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.272+0000 7f1edb7fe700 1 -- 172.21.15.84:0/1564482333 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1edc0b1e00 msgr2=0x7f1edc0cb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:27.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.272+0000 7f1edb7fe700 1 --2- 172.21.15.84:0/1564482333 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1edc0b1e00 0x7f1edc0cb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:27.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.272+0000 7f1edb7fe700 1 -- 172.21.15.84:0/1564482333 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1edc0d1220 msgr2=0x7f1edc1f1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:27.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.272+0000 7f1edb7fe700 1 --2- 172.21.15.84:0/1564482333 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1edc0d1220 0x7f1edc1f1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:27.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.272+0000 7f1edb7fe700 1 -- 172.21.15.84:0/1564482333 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ecc009500 con 0x7f1edc15c950 2023-07-14T11:15:27.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.272+0000 7f1eda7fc700 1 --2- 172.21.15.84:0/1564482333 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1edc0d1220 0x7f1edc1f1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:15:27.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.272+0000 7f1edb7fe700 1 --2- 172.21.15.84:0/1564482333 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1edc15c950 0x7f1edc156730 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f1ed4007e70 tx=0x7f1ed400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:27.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.272+0000 7f1ec37fe700 1 -- 172.21.15.84:0/1564482333 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed400ee50 con 0x7f1edc15c950 2023-07-14T11:15:27.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.272+0000 7f1ec37fe700 1 -- 172.21.15.84:0/1564482333 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ed4014420 con 0x7f1edc15c950 2023-07-14T11:15:27.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.272+0000 7f1ee13ff700 1 -- 172.21.15.84:0/1564482333 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1edc156c70 con 0x7f1edc15c950 2023-07-14T11:15:27.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.272+0000 7f1ec37fe700 1 -- 172.21.15.84:0/1564482333 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed40147d0 con 0x7f1edc15c950 2023-07-14T11:15:27.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.272+0000 7f1ee13ff700 1 -- 172.21.15.84:0/1564482333 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1edc0c8380 con 0x7f1edc15c950 2023-07-14T11:15:27.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.273+0000 7f1ee13ff700 1 -- 172.21.15.84:0/1564482333 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1edc04e280 con 0x7f1edc15c950 2023-07-14T11:15:27.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.274+0000 7f1ec37fe700 1 -- 172.21.15.84:0/1564482333 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 7) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f1ed4014930 con 0x7f1edc15c950 2023-07-14T11:15:27.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.275+0000 7f1ec37fe700 1 --2- 172.21.15.84:0/1564482333 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1ec806ae90 0x7f1ec806d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:27.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.275+0000 7f1ec37fe700 1 -- 172.21.15.84:0/1564482333 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1ed4089ff0 con 0x7f1edc15c950 2023-07-14T11:15:27.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.275+0000 7f1edaffd700 1 --2- 172.21.15.84:0/1564482333 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1ec806ae90 0x7f1ec806d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:27.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.276+0000 7f1edaffd700 1 --2- 172.21.15.84:0/1564482333 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1ec806ae90 0x7f1ec806d340 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1edc0b5510 tx=0x7f1ecc010000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:27.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.280+0000 7f1ec37fe700 1 -- 172.21.15.84:0/1564482333 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f1ed4054de0 con 0x7f1edc15c950 2023-07-14T11:15:27.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.475+0000 7f1ee13ff700 1 -- 172.21.15.84:0/1564482333 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1edc15c0b0 con 0x7f1edc15c950 2023-07-14T11:15:27.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.476+0000 7f1ec37fe700 1 -- 172.21.15.84:0/1564482333 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+18327 (secure 0 0 0) 0x7f1ed4058400 con 0x7f1edc15c950 2023-07-14T11:15:27.479 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:15:27.479 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":50,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:15:11.922007+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-07-14T11:15:08.611029+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-07-14T11:15:09.373415+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:15:27.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.479+0000 7f1ee13ff700 1 -- 172.21.15.84:0/1564482333 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1ec806ae90 msgr2=0x7f1ec806d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:27.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.479+0000 7f1ee13ff700 1 --2- 172.21.15.84:0/1564482333 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1ec806ae90 0x7f1ec806d340 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1edc0b5510 tx=0x7f1ecc010000 comp rx=0 tx=0).stop 2023-07-14T11:15:27.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.479+0000 7f1ee13ff700 1 -- 172.21.15.84:0/1564482333 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1edc15c950 msgr2=0x7f1edc156730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:27.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.479+0000 7f1ee13ff700 1 --2- 172.21.15.84:0/1564482333 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1edc15c950 0x7f1edc156730 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f1ed4007e70 tx=0x7f1ed400e3c0 comp rx=0 tx=0).stop 2023-07-14T11:15:27.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.479+0000 7f1ee13ff700 1 -- 172.21.15.84:0/1564482333 shutdown_connections 2023-07-14T11:15:27.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.479+0000 7f1ee13ff700 1 --2- 172.21.15.84:0/1564482333 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1ec806ae90 0x7f1ec806d340 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:27.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.479+0000 7f1ee13ff700 1 --2- 172.21.15.84:0/1564482333 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1edc0b1e00 0x7f1edc0cb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:27.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.479+0000 7f1ee13ff700 1 --2- 172.21.15.84:0/1564482333 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1edc15c950 0x7f1edc156730 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:27.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.479+0000 7f1ee13ff700 1 --2- 172.21.15.84:0/1564482333 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1edc0d1220 0x7f1edc1f1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:27.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.479+0000 7f1ee13ff700 1 -- 172.21.15.84:0/1564482333 >> 172.21.15.84:0/1564482333 conn(0x7f1edc09c1d0 msgr2=0x7f1edc0d3640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:27.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.479+0000 7f1ee13ff700 1 -- 172.21.15.84:0/1564482333 shutdown_connections 2023-07-14T11:15:27.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.479+0000 7f1ee13ff700 1 -- 172.21.15.84:0/1564482333 wait complete. 2023-07-14T11:15:27.499 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T11:13:00.125395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T11:13:06.803994+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T11:15:08.611029+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T11:15:09.373415+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T11:15:27.500 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T11:15:27.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.696+0000 7f11dcdff700 1 Processor -- start 2023-07-14T11:15:27.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.696+0000 7f11dcdff700 1 -- start start 2023-07-14T11:15:27.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.697+0000 7f11dcdff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f11d815c6c0 0x7f11d80b2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:27.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.697+0000 7f11dcdff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f11d806b8a0 0x7f11d806bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:27.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.697+0000 7f11dcdff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11d815ca90 con 0x7f11d80afc40 2023-07-14T11:15:27.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.697+0000 7f11dcdff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11d806b0e0 con 0x7f11d815c6c0 2023-07-14T11:15:27.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.697+0000 7f11dcdff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11d80d0370 con 0x7f11d806b8a0 2023-07-14T11:15:27.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.697+0000 7f11d659c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f11d815c6c0 0x7f11d80b2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:27.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.698+0000 7f11d659c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f11d815c6c0 0x7f11d80b2630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43620/0 (socket says 172.21.15.84:43620) 2023-07-14T11:15:27.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.698+0000 7f11d659c700 1 -- 172.21.15.84:0/1594251894 learned_addr learned my addr 172.21.15.84:0/1594251894 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:27.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.698+0000 7f11d6d9d700 1 --2- 172.21.15.84:0/1594251894 >> v2:172.21.15.179:3300/0 conn(0x7f11d806b8a0 0x7f11d806bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:27.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.698+0000 7f11d659c700 1 -- 172.21.15.84:0/1594251894 >> v2:172.21.15.179:3300/0 conn(0x7f11d806b8a0 msgr2=0x7f11d806bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:27.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.698+0000 7f11d659c700 1 --2- 172.21.15.84:0/1594251894 >> v2:172.21.15.179:3300/0 conn(0x7f11d806b8a0 0x7f11d806bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:27.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.698+0000 7f11d659c700 1 -- 172.21.15.84:0/1594251894 >> v1:172.21.15.179:6789/0 conn(0x7f11d80afc40 legacy=0x7f11d80b2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:27.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.698+0000 7f11d659c700 1 -- 172.21.15.84:0/1594251894 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11d80d0650 con 0x7f11d815c6c0 2023-07-14T11:15:27.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.698+0000 7f11d659c700 1 --2- 172.21.15.84:0/1594251894 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11d815c6c0 0x7f11d80b2630 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f11c80098f0 tx=0x7f11c8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=362e436955e2061 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:27.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.698+0000 7f11d559a700 1 -- 172.21.15.84:0/1594251894 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c8011830 con 0x7f11d815c6c0 2023-07-14T11:15:27.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.699+0000 7f11d559a700 1 -- 172.21.15.84:0/1594251894 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11c8011990 con 0x7f11d815c6c0 2023-07-14T11:15:27.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.699+0000 7f11d559a700 1 -- 172.21.15.84:0/1594251894 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c8011d20 con 0x7f11d815c6c0 2023-07-14T11:15:27.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.699+0000 7f11dcdff700 1 -- 172.21.15.84:0/1594251894 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11d815c6c0 msgr2=0x7f11d80b2630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:27.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.699+0000 7f11dcdff700 1 --2- 172.21.15.84:0/1594251894 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11d815c6c0 0x7f11d80b2630 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f11c80098f0 tx=0x7f11c8009c00 comp rx=0 tx=0).stop 2023-07-14T11:15:27.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.699+0000 7f11dcdff700 1 -- 172.21.15.84:0/1594251894 shutdown_connections 2023-07-14T11:15:27.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.699+0000 7f11dcdff700 1 --2- 172.21.15.84:0/1594251894 >> v2:172.21.15.179:3300/0 conn(0x7f11d806b8a0 0x7f11d806bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:27.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.699+0000 7f11dcdff700 1 --2- 172.21.15.84:0/1594251894 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11d815c6c0 0x7f11d80b2630 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:27.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.699+0000 7f11dcdff700 1 -- 172.21.15.84:0/1594251894 >> 172.21.15.84:0/1594251894 conn(0x7f11d806d980 msgr2=0x7f11d806dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:27.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.699+0000 7f11dcdff700 1 -- 172.21.15.84:0/1594251894 shutdown_connections 2023-07-14T11:15:27.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.699+0000 7f11dcdff700 1 -- 172.21.15.84:0/1594251894 wait complete. 2023-07-14T11:15:27.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.701+0000 7f11dcdff700 1 Processor -- start 2023-07-14T11:15:27.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.701+0000 7f11dcdff700 1 -- start start 2023-07-14T11:15:27.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.702+0000 7f11dcdff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11d806b8a0 0x7f11d8154560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:27.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.702+0000 7f11dcdff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11d80afc40 0x7f11d815a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:27.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.702+0000 7f11dcdff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11d815c6c0 0x7f11d80c7c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:27.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.702+0000 7f11dcdff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d815a160 con 0x7f11d815c6c0 2023-07-14T11:15:27.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.702+0000 7f11dcdff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d8154aa0 con 0x7f11d80afc40 2023-07-14T11:15:27.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.702+0000 7f11dcdff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11d815aac0 con 0x7f11d806b8a0 2023-07-14T11:15:27.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.702+0000 7f11d6d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11d815c6c0 0x7f11d80c7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:27.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.702+0000 7f11d6d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11d815c6c0 0x7f11d80c7c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43630/0 (socket says 172.21.15.84:43630) 2023-07-14T11:15:27.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.702+0000 7f11d6d9d700 1 -- 172.21.15.84:0/1105312668 learned_addr learned my addr 172.21.15.84:0/1105312668 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:27.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.703+0000 7f11d5d9b700 1 --2- 172.21.15.84:0/1105312668 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11d80afc40 0x7f11d815a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:27.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.703+0000 7f11d659c700 1 --2- 172.21.15.84:0/1105312668 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11d806b8a0 0x7f11d8154560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:27.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.703+0000 7f11d6d9d700 1 -- 172.21.15.84:0/1105312668 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11d806b8a0 msgr2=0x7f11d8154560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:27.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.703+0000 7f11d6d9d700 1 --2- 172.21.15.84:0/1105312668 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11d806b8a0 0x7f11d8154560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:27.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.703+0000 7f11d6d9d700 1 -- 172.21.15.84:0/1105312668 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11d80afc40 msgr2=0x7f11d815a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:27.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.703+0000 7f11d6d9d700 1 --2- 172.21.15.84:0/1105312668 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11d80afc40 0x7f11d815a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:27.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.703+0000 7f11d6d9d700 1 -- 172.21.15.84:0/1105312668 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c8009550 con 0x7f11d815c6c0 2023-07-14T11:15:27.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.703+0000 7f11d6d9d700 1 --2- 172.21.15.84:0/1105312668 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11d815c6c0 0x7f11d80c7c80 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f11d000efc0 tx=0x7f11d000c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:27.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.703+0000 7f11c6ffd700 1 -- 172.21.15.84:0/1105312668 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d000cad0 con 0x7f11d815c6c0 2023-07-14T11:15:27.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.703+0000 7f11c6ffd700 1 -- 172.21.15.84:0/1105312668 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11d000f040 con 0x7f11d815c6c0 2023-07-14T11:15:27.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.703+0000 7f11dcdff700 1 -- 172.21.15.84:0/1105312668 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11d815bd40 con 0x7f11d815c6c0 2023-07-14T11:15:27.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.703+0000 7f11c6ffd700 1 -- 172.21.15.84:0/1105312668 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d000ce70 con 0x7f11d815c6c0 2023-07-14T11:15:27.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.704+0000 7f11dcdff700 1 -- 172.21.15.84:0/1105312668 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11d815ba60 con 0x7f11d815c6c0 2023-07-14T11:15:27.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.705+0000 7f11dcdff700 1 -- 172.21.15.84:0/1105312668 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11d815a2a0 con 0x7f11d815c6c0 2023-07-14T11:15:27.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.705+0000 7f11c6ffd700 1 -- 172.21.15.84:0/1105312668 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 7) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f11d0014480 con 0x7f11d815c6c0 2023-07-14T11:15:27.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.707+0000 7f11c6ffd700 1 --2- 172.21.15.84:0/1105312668 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f11b806ae90 0x7f11b806d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:27.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.707+0000 7f11c6ffd700 1 -- 172.21.15.84:0/1105312668 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f11d008a350 con 0x7f11d815c6c0 2023-07-14T11:15:27.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.707+0000 7f11d659c700 1 --2- 172.21.15.84:0/1105312668 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f11b806ae90 0x7f11b806d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:27.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.708+0000 7f11d659c700 1 --2- 172.21.15.84:0/1105312668 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f11b806ae90 0x7f11b806d340 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f11c8009c40 tx=0x7f11c8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:27.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.711+0000 7f11c6ffd700 1 -- 172.21.15.84:0/1105312668 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f11d815a2a0 con 0x7f11d815c6c0 2023-07-14T11:15:27.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.903+0000 7f11dcdff700 1 -- 172.21.15.84:0/1105312668 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f11d815a2a0 con 0x7f11d815c6c0 2023-07-14T11:15:27.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.904+0000 7f11c6ffd700 1 -- 172.21.15.84:0/1105312668 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v50) v1 ==== 93+0+10 (secure 0 0 0) 0x7f11d815a2a0 con 0x7f11d815c6c0 2023-07-14T11:15:27.906 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-07-14T11:15:27.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.906+0000 7f11dcdff700 1 -- 172.21.15.84:0/1105312668 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f11b806ae90 msgr2=0x7f11b806d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:27.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.906+0000 7f11dcdff700 1 --2- 172.21.15.84:0/1105312668 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f11b806ae90 0x7f11b806d340 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f11c8009c40 tx=0x7f11c8008030 comp rx=0 tx=0).stop 2023-07-14T11:15:27.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.906+0000 7f11dcdff700 1 -- 172.21.15.84:0/1105312668 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11d815c6c0 msgr2=0x7f11d80c7c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:27.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.906+0000 7f11dcdff700 1 --2- 172.21.15.84:0/1105312668 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11d815c6c0 0x7f11d80c7c80 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f11d000efc0 tx=0x7f11d000c0c0 comp rx=0 tx=0).stop 2023-07-14T11:15:27.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.906+0000 7f11dcdff700 1 -- 172.21.15.84:0/1105312668 shutdown_connections 2023-07-14T11:15:27.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.906+0000 7f11dcdff700 1 --2- 172.21.15.84:0/1105312668 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f11b806ae90 0x7f11b806d340 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:27.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.906+0000 7f11dcdff700 1 --2- 172.21.15.84:0/1105312668 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11d806b8a0 0x7f11d8154560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:27.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.906+0000 7f11dcdff700 1 --2- 172.21.15.84:0/1105312668 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11d815c6c0 0x7f11d80c7c80 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:27.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.906+0000 7f11dcdff700 1 --2- 172.21.15.84:0/1105312668 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11d80afc40 0x7f11d815a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:27.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.906+0000 7f11dcdff700 1 -- 172.21.15.84:0/1105312668 >> 172.21.15.84:0/1105312668 conn(0x7f11d806d980 msgr2=0x7f11d80d0ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:27.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.906+0000 7f11dcdff700 1 -- 172.21.15.84:0/1105312668 shutdown_connections 2023-07-14T11:15:27.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:27.906+0000 7f11dcdff700 1 -- 172.21.15.84:0/1105312668 wait complete. 2023-07-14T11:15:27.926 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T11:15:28.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.125+0000 7f8ffe9ff700 1 Processor -- start 2023-07-14T11:15:28.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.125+0000 7f8ffe9ff700 1 -- start start 2023-07-14T11:15:28.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.127+0000 7f8ffe9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ff80d0f90 0x7f8ff80b1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:28.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.127+0000 7f8ffe9ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ff80b8e30 con 0x7f8ff80b8a60 2023-07-14T11:15:28.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.127+0000 7f8ffe9ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ff80d1410 con 0x7f8ff80d0b10 2023-07-14T11:15:28.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.127+0000 7f8ffe9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff80afaa0 con 0x7f8ff80d0f90 2023-07-14T11:15:28.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.127+0000 7f8ff7fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f8ff80b8a60 0x7f8ff80b3ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:33564/0 (socket says 172.21.15.84:33564) 2023-07-14T11:15:28.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.127+0000 7f8ff7fff700 1 -- 172.21.15.84:0/301631560 learned_addr learned my addr 172.21.15.84:0/301631560 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:15:28.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.127+0000 7f8ffcf9c700 1 --2- 172.21.15.84:0/301631560 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ff80d0f90 0x7f8ff80b1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:28.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.127+0000 7f8ff6ffd700 1 -- 172.21.15.84:0/301631560 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2414426393 0 0) 0x7f8ff80b8e30 con 0x7f8ff80b8a60 2023-07-14T11:15:28.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.127+0000 7f8ff6ffd700 1 -- 172.21.15.84:0/301631560 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fe00035b0 con 0x7f8ff80b8a60 2023-07-14T11:15:28.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.127+0000 7f8ff6ffd700 1 -- 172.21.15.84:0/301631560 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2989449906 0 0) 0x7f8ff80d1410 con 0x7f8ff80d0b10 2023-07-14T11:15:28.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.127+0000 7f8ff6ffd700 1 -- 172.21.15.84:0/301631560 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ff80b8e30 con 0x7f8ff80d0b10 2023-07-14T11:15:28.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.127+0000 7f8ff6ffd700 1 -- 172.21.15.84:0/301631560 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2941003044 0 0) 0x7f8fe00035b0 con 0x7f8ff80b8a60 2023-07-14T11:15:28.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.127+0000 7f8ff6ffd700 1 -- 172.21.15.84:0/301631560 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ff80d0f90 msgr2=0x7f8ff80b1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:28.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.127+0000 7f8ff6ffd700 1 --2- 172.21.15.84:0/301631560 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ff80d0f90 0x7f8ff80b1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:28.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.127+0000 7f8ff6ffd700 1 -- 172.21.15.84:0/301631560 >> v1:172.21.15.179:6789/0 conn(0x7f8ff80d0b10 legacy=0x7f8ff80b0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:28.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.128+0000 7f8ff6ffd700 1 -- 172.21.15.84:0/301631560 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ff80afd80 con 0x7f8ff80b8a60 2023-07-14T11:15:28.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.128+0000 7f8ff6ffd700 1 -- 172.21.15.84:0/301631560 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7f8fe8001670 con 0x7f8ff80b8a60 2023-07-14T11:15:28.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.128+0000 7f8ff6ffd700 1 -- 172.21.15.84:0/301631560 >> v1:172.21.15.84:6789/0 conn(0x7f8ff80b8a60 legacy=0x7f8ff80b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:28.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.128+0000 7f8ff6ffd700 1 --2- 172.21.15.84:0/301631560 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ff80d0f90 0x7f8fe0003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:28.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.128+0000 7f8ff6ffd700 1 --2- 172.21.15.84:0/301631560 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8fe0004120 0x7f8fe0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:28.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.128+0000 7f8ff6ffd700 1 --2- 172.21.15.84:0/301631560 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fe0004d90 0x7f8fe0005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:28.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.128+0000 7f8ff6ffd700 1 -- 172.21.15.84:0/301631560 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff80afaa0 con 0x7f8fe0004d90 2023-07-14T11:15:28.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.128+0000 7f8ff6ffd700 1 -- 172.21.15.84:0/301631560 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe000bac0 con 0x7f8fe0004120 2023-07-14T11:15:28.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.128+0000 7f8ff6ffd700 1 -- 172.21.15.84:0/301631560 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe000bc80 con 0x7f8ff80d0f90 2023-07-14T11:15:28.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.128+0000 7f8ffcf9c700 1 --2- 172.21.15.84:0/301631560 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fe0004d90 0x7f8fe0005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:28.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.128+0000 7f8ff7fff700 1 --2- 172.21.15.84:0/301631560 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ff80d0f90 0x7f8fe0003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:28.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.128+0000 7f8ff77fe700 1 --2- 172.21.15.84:0/301631560 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8fe0004120 0x7f8fe0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:28.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.128+0000 7f8ffcf9c700 1 -- 172.21.15.84:0/301631560 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ff80d0f90 msgr2=0x7f8fe0003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:28.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.128+0000 7f8ffcf9c700 1 --2- 172.21.15.84:0/301631560 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ff80d0f90 0x7f8fe0003bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:28.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.128+0000 7f8ffcf9c700 1 -- 172.21.15.84:0/301631560 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8fe0004120 msgr2=0x7f8fe0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:28.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.128+0000 7f8ffcf9c700 1 --2- 172.21.15.84:0/301631560 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8fe0004120 0x7f8fe0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:28.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.128+0000 7f8ffcf9c700 1 -- 172.21.15.84:0/301631560 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fe00035b0 con 0x7f8fe0004d90 2023-07-14T11:15:28.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.129+0000 7f8ffcf9c700 1 --2- 172.21.15.84:0/301631560 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fe0004d90 0x7f8fe0005200 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0009f90 tx=0x7f8fe0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bcb4967cf5430b2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:28.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.129+0000 7f8ff6ffd700 1 -- 172.21.15.84:0/301631560 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff000ec30 con 0x7f8fe0004d90 2023-07-14T11:15:28.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.129+0000 7f8ff6ffd700 1 -- 172.21.15.84:0/301631560 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ff000f040 con 0x7f8fe0004d90 2023-07-14T11:15:28.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.129+0000 7f8ff6ffd700 1 -- 172.21.15.84:0/301631560 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff0014480 con 0x7f8fe0004d90 2023-07-14T11:15:28.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.129+0000 7f8ffe9ff700 1 -- 172.21.15.84:0/301631560 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fe0004d90 msgr2=0x7f8fe0005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:28.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.129+0000 7f8ffe9ff700 1 --2- 172.21.15.84:0/301631560 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fe0004d90 0x7f8fe0005200 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0009f90 tx=0x7f8fe0005880 comp rx=0 tx=0).stop 2023-07-14T11:15:28.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.129+0000 7f8ffcf9c700 1 -- 172.21.15.84:0/301631560 reap_dead start 2023-07-14T11:15:28.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.129+0000 7f8ffe9ff700 1 -- 172.21.15.84:0/301631560 shutdown_connections 2023-07-14T11:15:28.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.129+0000 7f8ffe9ff700 1 -- 172.21.15.84:0/301631560 >> 172.21.15.84:0/301631560 conn(0x7f8ff809c1b0 msgr2=0x7f8ff80d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:28.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.129+0000 7f8ffe9ff700 1 -- 172.21.15.84:0/301631560 shutdown_connections 2023-07-14T11:15:28.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.130+0000 7f8ffe9ff700 1 -- 172.21.15.84:0/301631560 wait complete. 2023-07-14T11:15:28.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.131+0000 7f8ffe9ff700 1 Processor -- start 2023-07-14T11:15:28.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.131+0000 7f8ffe9ff700 1 -- start start 2023-07-14T11:15:28.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.132+0000 7f8ffe9ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fe0004d90 0x7f8ff81f38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:28.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.132+0000 7f8ffe9ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ff80b78c0 0x7f8ff8151aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:28.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.132+0000 7f8ffe9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ff80cc530 0x7f8ff815a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:28.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.132+0000 7f8ffe9ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff81f3450 con 0x7f8fe0004d90 2023-07-14T11:15:28.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.132+0000 7f8ffe9ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff80b7e30 con 0x7f8ff80b78c0 2023-07-14T11:15:28.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.132+0000 7f8ffe9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff81f2e00 con 0x7f8ff80cc530 2023-07-14T11:15:28.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.133+0000 7f8ff7fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fe0004d90 0x7f8ff81f38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:28.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.133+0000 7f8ff7fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fe0004d90 0x7f8ff81f38e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43636/0 (socket says 172.21.15.84:43636) 2023-07-14T11:15:28.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.133+0000 7f8ff7fff700 1 -- 172.21.15.84:0/2743501837 learned_addr learned my addr 172.21.15.84:0/2743501837 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:28.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.133+0000 7f8ff77fe700 1 --2- 172.21.15.84:0/2743501837 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ff80b78c0 0x7f8ff8151aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:28.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.133+0000 7f8ffcf9c700 1 --2- 172.21.15.84:0/2743501837 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ff80cc530 0x7f8ff815a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:28.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.133+0000 7f8ff7fff700 1 -- 172.21.15.84:0/2743501837 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ff80cc530 msgr2=0x7f8ff815a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:28.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.133+0000 7f8ff7fff700 1 --2- 172.21.15.84:0/2743501837 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ff80cc530 0x7f8ff815a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:28.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.133+0000 7f8ff7fff700 1 -- 172.21.15.84:0/2743501837 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ff80b78c0 msgr2=0x7f8ff8151aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:28.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.133+0000 7f8ff7fff700 1 --2- 172.21.15.84:0/2743501837 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ff80b78c0 0x7f8ff8151aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:28.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.133+0000 7f8ff7fff700 1 -- 172.21.15.84:0/2743501837 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ff81f30e0 con 0x7f8fe0004d90 2023-07-14T11:15:28.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.133+0000 7f8ff7fff700 1 --2- 172.21.15.84:0/2743501837 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fe0004d90 0x7f8ff81f38e0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f8fe8007310 tx=0x7f8fe8007620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:28.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.134+0000 7f8ff4ff9700 1 -- 172.21.15.84:0/2743501837 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe8011580 con 0x7f8fe0004d90 2023-07-14T11:15:28.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.134+0000 7f8ff4ff9700 1 -- 172.21.15.84:0/2743501837 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fe8011720 con 0x7f8fe0004d90 2023-07-14T11:15:28.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.134+0000 7f8ff4ff9700 1 -- 172.21.15.84:0/2743501837 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe8011ad0 con 0x7f8fe0004d90 2023-07-14T11:15:28.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.134+0000 7f8ffe9ff700 1 -- 172.21.15.84:0/2743501837 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ff81f2a80 con 0x7f8fe0004d90 2023-07-14T11:15:28.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.134+0000 7f8ffe9ff700 1 -- 172.21.15.84:0/2743501837 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ff80ccb80 con 0x7f8fe0004d90 2023-07-14T11:15:28.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.135+0000 7f8ffe9ff700 1 -- 172.21.15.84:0/2743501837 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ff80d0960 con 0x7f8fe0004d90 2023-07-14T11:15:28.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.136+0000 7f8ff4ff9700 1 -- 172.21.15.84:0/2743501837 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 7) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f8fe8011c30 con 0x7f8fe0004d90 2023-07-14T11:15:28.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.136+0000 7f8ff4ff9700 1 --2- 172.21.15.84:0/2743501837 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f8fe406ae90 0x7f8fe406d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:28.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.137+0000 7f8ff4ff9700 1 -- 172.21.15.84:0/2743501837 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8fe8089770 con 0x7f8fe0004d90 2023-07-14T11:15:28.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.137+0000 7f8ff77fe700 1 --2- 172.21.15.84:0/2743501837 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f8fe406ae90 0x7f8fe406d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:28.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.137+0000 7f8ff77fe700 1 --2- 172.21.15.84:0/2743501837 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f8fe406ae90 0x7f8fe406d340 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8ff80b8110 tx=0x7f8fec009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:28.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.141+0000 7f8ff4ff9700 1 -- 172.21.15.84:0/2743501837 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f8fe8054500 con 0x7f8fe0004d90 2023-07-14T11:15:28.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.335+0000 7f8ffe9ff700 1 -- 172.21.15.84:0/2743501837 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8ff81f3730 con 0x7f8fe0004d90 2023-07-14T11:15:28.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.335+0000 7f8ff4ff9700 1 -- 172.21.15.84:0/2743501837 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v50) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8fe8057b20 con 0x7f8fe0004d90 2023-07-14T11:15:28.337 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-07-14T11:15:28.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.337+0000 7f8ffe9ff700 1 -- 172.21.15.84:0/2743501837 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f8fe406ae90 msgr2=0x7f8fe406d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:28.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.337+0000 7f8ffe9ff700 1 --2- 172.21.15.84:0/2743501837 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f8fe406ae90 0x7f8fe406d340 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8ff80b8110 tx=0x7f8fec009040 comp rx=0 tx=0).stop 2023-07-14T11:15:28.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.337+0000 7f8ffe9ff700 1 -- 172.21.15.84:0/2743501837 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fe0004d90 msgr2=0x7f8ff81f38e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:28.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.337+0000 7f8ffe9ff700 1 --2- 172.21.15.84:0/2743501837 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fe0004d90 0x7f8ff81f38e0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f8fe8007310 tx=0x7f8fe8007620 comp rx=0 tx=0).stop 2023-07-14T11:15:28.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.337+0000 7f8ffe9ff700 1 -- 172.21.15.84:0/2743501837 shutdown_connections 2023-07-14T11:15:28.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.337+0000 7f8ffe9ff700 1 --2- 172.21.15.84:0/2743501837 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f8fe406ae90 0x7f8fe406d340 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:28.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.337+0000 7f8ffe9ff700 1 --2- 172.21.15.84:0/2743501837 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ff80cc530 0x7f8ff815a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:28.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.337+0000 7f8ffe9ff700 1 --2- 172.21.15.84:0/2743501837 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fe0004d90 0x7f8ff81f38e0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:28.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.337+0000 7f8ffe9ff700 1 --2- 172.21.15.84:0/2743501837 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ff80b78c0 0x7f8ff8151aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:28.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.337+0000 7f8ffe9ff700 1 -- 172.21.15.84:0/2743501837 >> 172.21.15.84:0/2743501837 conn(0x7f8ff809c1b0 msgr2=0x7f8ff815c200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:28.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.337+0000 7f8ffe9ff700 1 -- 172.21.15.84:0/2743501837 shutdown_connections 2023-07-14T11:15:28.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.337+0000 7f8ffe9ff700 1 -- 172.21.15.84:0/2743501837 wait complete. 2023-07-14T11:15:28.357 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T11:15:28.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.554+0000 7f6c215ff700 1 Processor -- start 2023-07-14T11:15:28.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.554+0000 7f6c215ff700 1 -- start start 2023-07-14T11:15:28.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.556+0000 7f6c215ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6c1c15fd30 0x7f6c1c0ae1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:28.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.556+0000 7f6c215ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c1c0ae730 0x7f6c1c0cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:28.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.556+0000 7f6c215ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6c1c0cd6f0 0x7f6c1c1603d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:28.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.556+0000 7f6c215ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c1c06b930 con 0x7f6c1c0cd6f0 2023-07-14T11:15:28.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.556+0000 7f6c215ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c1c0cdb70 con 0x7f6c1c15fd30 2023-07-14T11:15:28.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.556+0000 7f6c215ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1c0b21b0 con 0x7f6c1c0ae730 2023-07-14T11:15:28.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.556+0000 7f6c1b7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6c1c0cd6f0 0x7f6c1c1603d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:28.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.556+0000 7f6c1b7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6c1c0cd6f0 0x7f6c1c1603d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43642/0 (socket says 172.21.15.84:43642) 2023-07-14T11:15:28.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.556+0000 7f6c1b7fe700 1 -- 172.21.15.84:0/3043154483 learned_addr learned my addr 172.21.15.84:0/3043154483 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:28.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.557+0000 7f6c1affd700 1 --2- 172.21.15.84:0/3043154483 >> v2:172.21.15.179:3300/0 conn(0x7f6c1c15fd30 0x7f6c1c0ae1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:28.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.557+0000 7f6c13fff700 1 --2- 172.21.15.84:0/3043154483 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c1c0ae730 0x7f6c1c0cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:28.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.557+0000 7f6c1b7fe700 1 -- 172.21.15.84:0/3043154483 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c1c0ae730 msgr2=0x7f6c1c0cd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:28.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.557+0000 7f6c1b7fe700 1 --2- 172.21.15.84:0/3043154483 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c1c0ae730 0x7f6c1c0cd1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:28.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.557+0000 7f6c1b7fe700 1 -- 172.21.15.84:0/3043154483 >> v2:172.21.15.179:3300/0 conn(0x7f6c1c15fd30 msgr2=0x7f6c1c0ae1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:28.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.557+0000 7f6c1b7fe700 1 --2- 172.21.15.84:0/3043154483 >> v2:172.21.15.179:3300/0 conn(0x7f6c1c15fd30 0x7f6c1c0ae1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:28.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.557+0000 7f6c1b7fe700 1 -- 172.21.15.84:0/3043154483 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c1c06ad20 con 0x7f6c1c0cd6f0 2023-07-14T11:15:28.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.557+0000 7f6c1affd700 1 --2- 172.21.15.84:0/3043154483 >> v2:172.21.15.179:3300/0 conn(0x7f6c1c15fd30 0x7f6c1c0ae1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:15:28.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.557+0000 7f6c1b7fe700 1 --2- 172.21.15.84:0/3043154483 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c1c0cd6f0 0x7f6c1c1603d0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c06bda0 tx=0x7f6c1400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=903ea45ec03a7ff7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:28.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.557+0000 7f6c1a7fc700 1 -- 172.21.15.84:0/3043154483 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c1400e070 con 0x7f6c1c0cd6f0 2023-07-14T11:15:28.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.558+0000 7f6c1a7fc700 1 -- 172.21.15.84:0/3043154483 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c1400b910 con 0x7f6c1c0cd6f0 2023-07-14T11:15:28.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.558+0000 7f6c1a7fc700 1 -- 172.21.15.84:0/3043154483 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c1400bcc0 con 0x7f6c1c0cd6f0 2023-07-14T11:15:28.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.558+0000 7f6c215ff700 1 -- 172.21.15.84:0/3043154483 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c1c0cd6f0 msgr2=0x7f6c1c1603d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:28.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.558+0000 7f6c215ff700 1 --2- 172.21.15.84:0/3043154483 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c1c0cd6f0 0x7f6c1c1603d0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c06bda0 tx=0x7f6c1400b330 comp rx=0 tx=0).stop 2023-07-14T11:15:28.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.558+0000 7f6c215ff700 1 -- 172.21.15.84:0/3043154483 shutdown_connections 2023-07-14T11:15:28.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.558+0000 7f6c215ff700 1 --2- 172.21.15.84:0/3043154483 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c1c0cd6f0 0x7f6c1c1603d0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:28.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.558+0000 7f6c215ff700 1 --2- 172.21.15.84:0/3043154483 >> v2:172.21.15.179:3300/0 conn(0x7f6c1c15fd30 0x7f6c1c0ae1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:28.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.558+0000 7f6c215ff700 1 --2- 172.21.15.84:0/3043154483 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c1c0ae730 0x7f6c1c0cd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:28.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.558+0000 7f6c215ff700 1 -- 172.21.15.84:0/3043154483 >> 172.21.15.84:0/3043154483 conn(0x7f6c1c0cc990 msgr2=0x7f6c1c0cf2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:28.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.558+0000 7f6c215ff700 1 -- 172.21.15.84:0/3043154483 shutdown_connections 2023-07-14T11:15:28.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.558+0000 7f6c215ff700 1 -- 172.21.15.84:0/3043154483 wait complete. 2023-07-14T11:15:28.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.560+0000 7f6c215ff700 1 Processor -- start 2023-07-14T11:15:28.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.560+0000 7f6c215ff700 1 -- start start 2023-07-14T11:15:28.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.561+0000 7f6c215ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c1c0ae730 0x7f6c1c1507d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:28.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.561+0000 7f6c215ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c1c0cd6f0 0x7f6c1c071460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:28.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.561+0000 7f6c215ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c1c15fd30 0x7f6c1c0b1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:28.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.561+0000 7f6c215ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1c15c540 con 0x7f6c1c15fd30 2023-07-14T11:15:28.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.561+0000 7f6c215ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1c15c820 con 0x7f6c1c0ae730 2023-07-14T11:15:28.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.561+0000 7f6c215ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1c15cb00 con 0x7f6c1c0cd6f0 2023-07-14T11:15:28.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.561+0000 7f6c1b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c1c15fd30 0x7f6c1c0b1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:28.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.561+0000 7f6c1b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c1c15fd30 0x7f6c1c0b1080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43650/0 (socket says 172.21.15.84:43650) 2023-07-14T11:15:28.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.561+0000 7f6c1b7fe700 1 -- 172.21.15.84:0/2277237930 learned_addr learned my addr 172.21.15.84:0/2277237930 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:28.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.561+0000 7f6c1affd700 1 --2- 172.21.15.84:0/2277237930 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c1c0ae730 0x7f6c1c1507d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:28.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.561+0000 7f6c13fff700 1 --2- 172.21.15.84:0/2277237930 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c1c0cd6f0 0x7f6c1c071460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:28.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.562+0000 7f6c1b7fe700 1 -- 172.21.15.84:0/2277237930 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c1c0cd6f0 msgr2=0x7f6c1c071460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:28.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.562+0000 7f6c1b7fe700 1 --2- 172.21.15.84:0/2277237930 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c1c0cd6f0 0x7f6c1c071460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:28.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.562+0000 7f6c1b7fe700 1 -- 172.21.15.84:0/2277237930 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c1c0ae730 msgr2=0x7f6c1c1507d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:28.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.562+0000 7f6c1b7fe700 1 --2- 172.21.15.84:0/2277237930 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c1c0ae730 0x7f6c1c1507d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:28.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.562+0000 7f6c1b7fe700 1 -- 172.21.15.84:0/2277237930 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c0c0094a0 con 0x7f6c1c15fd30 2023-07-14T11:15:28.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.562+0000 7f6c13fff700 1 --2- 172.21.15.84:0/2277237930 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c1c0cd6f0 0x7f6c1c071460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:15:28.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.562+0000 7f6c1b7fe700 1 --2- 172.21.15.84:0/2277237930 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c1c15fd30 0x7f6c1c0b1080 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c0b1ea0 tx=0x7f6c14004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:28.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.562+0000 7f6c137fe700 1 -- 172.21.15.84:0/2277237930 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c140099b0 con 0x7f6c1c15fd30 2023-07-14T11:15:28.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.562+0000 7f6c137fe700 1 -- 172.21.15.84:0/2277237930 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c1400ce80 con 0x7f6c1c15fd30 2023-07-14T11:15:28.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.562+0000 7f6c137fe700 1 -- 172.21.15.84:0/2277237930 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c14004490 con 0x7f6c1c15fd30 2023-07-14T11:15:28.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.562+0000 7f6c215ff700 1 -- 172.21.15.84:0/2277237930 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c14009b30 con 0x7f6c1c15fd30 2023-07-14T11:15:28.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.562+0000 7f6c215ff700 1 -- 172.21.15.84:0/2277237930 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c1c15d0c0 con 0x7f6c1c15fd30 2023-07-14T11:15:28.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.563+0000 7f6c215ff700 1 -- 172.21.15.84:0/2277237930 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c1c074350 con 0x7f6c1c15fd30 2023-07-14T11:15:28.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.564+0000 7f6c137fe700 1 -- 172.21.15.84:0/2277237930 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 7) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f6c140045f0 con 0x7f6c1c15fd30 2023-07-14T11:15:28.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.565+0000 7f6c137fe700 1 --2- 172.21.15.84:0/2277237930 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6bfc06ae90 0x7f6bfc06d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:28.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.565+0000 7f6c137fe700 1 -- 172.21.15.84:0/2277237930 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6c1408a880 con 0x7f6c1c15fd30 2023-07-14T11:15:28.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.565+0000 7f6c1affd700 1 --2- 172.21.15.84:0/2277237930 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6bfc06ae90 0x7f6bfc06d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:28.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.566+0000 7f6c1affd700 1 --2- 172.21.15.84:0/2277237930 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6bfc06ae90 0x7f6bfc06d340 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c009cf0 tx=0x7f6c0c009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:28.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.569+0000 7f6c137fe700 1 -- 172.21.15.84:0/2277237930 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f6c14055590 con 0x7f6c1c15fd30 2023-07-14T11:15:28.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.763+0000 7f6c215ff700 1 -- 172.21.15.84:0/2277237930 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6c1c0b50e0 con 0x7f6c1c15fd30 2023-07-14T11:15:28.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.764+0000 7f6c137fe700 1 -- 172.21.15.84:0/2277237930 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v50) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6c14058bb0 con 0x7f6c1c15fd30 2023-07-14T11:15:28.766 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-07-14T11:15:28.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.766+0000 7f6c215ff700 1 -- 172.21.15.84:0/2277237930 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6bfc06ae90 msgr2=0x7f6bfc06d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:28.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.766+0000 7f6c215ff700 1 --2- 172.21.15.84:0/2277237930 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6bfc06ae90 0x7f6bfc06d340 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c009cf0 tx=0x7f6c0c009210 comp rx=0 tx=0).stop 2023-07-14T11:15:28.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.766+0000 7f6c215ff700 1 -- 172.21.15.84:0/2277237930 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c1c15fd30 msgr2=0x7f6c1c0b1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:28.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.766+0000 7f6c215ff700 1 --2- 172.21.15.84:0/2277237930 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c1c15fd30 0x7f6c1c0b1080 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c0b1ea0 tx=0x7f6c14004ad0 comp rx=0 tx=0).stop 2023-07-14T11:15:28.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.766+0000 7f6c215ff700 1 -- 172.21.15.84:0/2277237930 shutdown_connections 2023-07-14T11:15:28.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.766+0000 7f6c215ff700 1 --2- 172.21.15.84:0/2277237930 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c1c15fd30 0x7f6c1c0b1080 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:28.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.766+0000 7f6c215ff700 1 --2- 172.21.15.84:0/2277237930 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c1c0ae730 0x7f6c1c1507d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:28.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.766+0000 7f6c215ff700 1 --2- 172.21.15.84:0/2277237930 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6bfc06ae90 0x7f6bfc06d340 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:28.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.766+0000 7f6c215ff700 1 --2- 172.21.15.84:0/2277237930 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c1c0cd6f0 0x7f6c1c071460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:28.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.766+0000 7f6c215ff700 1 -- 172.21.15.84:0/2277237930 >> 172.21.15.84:0/2277237930 conn(0x7f6c1c0cc990 msgr2=0x7f6c1c0ad270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:28.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.766+0000 7f6c215ff700 1 -- 172.21.15.84:0/2277237930 shutdown_connections 2023-07-14T11:15:28.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.766+0000 7f6c215ff700 1 -- 172.21.15.84:0/2277237930 wait complete. 2023-07-14T11:15:28.786 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T11:15:28.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.983+0000 7f7a361ff700 1 Processor -- start 2023-07-14T11:15:28.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.983+0000 7f7a361ff700 1 -- start start 2023-07-14T11:15:28.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.984+0000 7f7a361ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7a300b8a60 0x7f7a300b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:28.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.984+0000 7f7a361ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7a300b4530 0x7f7a300d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:28.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.984+0000 7f7a361ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a300d1490 con 0x7f7a300d1050 2023-07-14T11:15:28.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.985+0000 7f7a361ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a300b8e30 con 0x7f7a300b8a60 2023-07-14T11:15:28.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.985+0000 7f7a361ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a300b1e30 con 0x7f7a300b4530 2023-07-14T11:15:28.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.985+0000 7f7a2f7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7a300b8a60 0x7f7a300b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:28.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.985+0000 7f7a2ffff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f7a300d1050 0x7f7a300b25d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:58134/0 (socket says 172.21.15.84:58134) 2023-07-14T11:15:28.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.985+0000 7f7a2ffff700 1 -- 172.21.15.84:0/4167307183 learned_addr learned my addr 172.21.15.84:0/4167307183 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:15:28.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.985+0000 7f7a27fff700 1 --2- 172.21.15.84:0/4167307183 >> v2:172.21.15.179:3300/0 conn(0x7f7a300b4530 0x7f7a300d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:28.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.985+0000 7f7a2f7fe700 1 -- 172.21.15.84:0/4167307183 >> v2:172.21.15.179:3300/0 conn(0x7f7a300b4530 msgr2=0x7f7a300d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:28.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.985+0000 7f7a2f7fe700 1 --2- 172.21.15.84:0/4167307183 >> v2:172.21.15.179:3300/0 conn(0x7f7a300b4530 0x7f7a300d0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:28.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.985+0000 7f7a2f7fe700 1 -- 172.21.15.84:0/4167307183 >> v1:172.21.15.84:6789/0 conn(0x7f7a300d1050 legacy=0x7f7a300b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:28.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.985+0000 7f7a2f7fe700 1 -- 172.21.15.84:0/4167307183 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a300afaa0 con 0x7f7a300b8a60 2023-07-14T11:15:28.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.985+0000 7f7a2f7fe700 1 --2- 172.21.15.84:0/4167307183 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a300b8a60 0x7f7a300b3ff0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f7a3009c8e0 tx=0x7f7a20009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e21edf5d293ce1f6 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:28.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.986+0000 7f7a2effd700 1 -- 172.21.15.84:0/4167307183 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a20011830 con 0x7f7a300b8a60 2023-07-14T11:15:28.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.986+0000 7f7a2effd700 1 -- 172.21.15.84:0/4167307183 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a20011990 con 0x7f7a300b8a60 2023-07-14T11:15:28.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.986+0000 7f7a2effd700 1 -- 172.21.15.84:0/4167307183 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a20011d20 con 0x7f7a300b8a60 2023-07-14T11:15:28.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.986+0000 7f7a361ff700 1 -- 172.21.15.84:0/4167307183 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a300b8a60 msgr2=0x7f7a300b3ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:28.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.986+0000 7f7a361ff700 1 --2- 172.21.15.84:0/4167307183 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a300b8a60 0x7f7a300b3ff0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f7a3009c8e0 tx=0x7f7a20009b20 comp rx=0 tx=0).stop 2023-07-14T11:15:28.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.986+0000 7f7a361ff700 1 -- 172.21.15.84:0/4167307183 shutdown_connections 2023-07-14T11:15:28.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.986+0000 7f7a361ff700 1 --2- 172.21.15.84:0/4167307183 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a300b8a60 0x7f7a300b3ff0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:28.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.986+0000 7f7a361ff700 1 --2- 172.21.15.84:0/4167307183 >> v2:172.21.15.179:3300/0 conn(0x7f7a300b4530 0x7f7a300d0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:28.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.986+0000 7f7a361ff700 1 -- 172.21.15.84:0/4167307183 >> 172.21.15.84:0/4167307183 conn(0x7f7a3009c1b0 msgr2=0x7f7a300d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:28.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.986+0000 7f7a361ff700 1 -- 172.21.15.84:0/4167307183 shutdown_connections 2023-07-14T11:15:28.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.986+0000 7f7a361ff700 1 -- 172.21.15.84:0/4167307183 wait complete. 2023-07-14T11:15:28.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.988+0000 7f7a361ff700 1 Processor -- start 2023-07-14T11:15:28.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.988+0000 7f7a361ff700 1 -- start start 2023-07-14T11:15:28.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.989+0000 7f7a361ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a300b4530 0x7f7a3015d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:28.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.989+0000 7f7a361ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a300b8a60 0x7f7a30152340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:28.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.989+0000 7f7a361ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a300d1050 0x7f7a300cf360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:28.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.989+0000 7f7a361ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a3015ea70 con 0x7f7a300b4530 2023-07-14T11:15:28.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.989+0000 7f7a361ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a3015dd00 con 0x7f7a300d1050 2023-07-14T11:15:28.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.989+0000 7f7a361ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a300cafb0 con 0x7f7a300b8a60 2023-07-14T11:15:28.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.989+0000 7f7a2f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a300b4530 0x7f7a3015d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:28.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.989+0000 7f7a2f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a300b4530 0x7f7a3015d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37382/0 (socket says 172.21.15.84:37382) 2023-07-14T11:15:28.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.989+0000 7f7a2f7fe700 1 -- 172.21.15.84:0/3498524522 learned_addr learned my addr 172.21.15.84:0/3498524522 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:28.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.989+0000 7f7a2ffff700 1 --2- 172.21.15.84:0/3498524522 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a300d1050 0x7f7a300cf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:28.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.989+0000 7f7a27fff700 1 --2- 172.21.15.84:0/3498524522 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a300b8a60 0x7f7a30152340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:28.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.990+0000 7f7a2f7fe700 1 -- 172.21.15.84:0/3498524522 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a300b8a60 msgr2=0x7f7a30152340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:28.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.990+0000 7f7a2f7fe700 1 --2- 172.21.15.84:0/3498524522 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a300b8a60 0x7f7a30152340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:28.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.990+0000 7f7a2f7fe700 1 -- 172.21.15.84:0/3498524522 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a300d1050 msgr2=0x7f7a300cf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:28.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.990+0000 7f7a2f7fe700 1 --2- 172.21.15.84:0/3498524522 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a300d1050 0x7f7a300cf360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:28.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.990+0000 7f7a2f7fe700 1 -- 172.21.15.84:0/3498524522 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a200094a0 con 0x7f7a300b4530 2023-07-14T11:15:28.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.990+0000 7f7a2f7fe700 1 --2- 172.21.15.84:0/3498524522 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a300b4530 0x7f7a3015d7c0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f7a20009b60 tx=0x7f7a20004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:28.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.990+0000 7f7a2cff9700 1 -- 172.21.15.84:0/3498524522 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a200036a0 con 0x7f7a300b4530 2023-07-14T11:15:28.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.990+0000 7f7a2cff9700 1 -- 172.21.15.84:0/3498524522 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a2001f070 con 0x7f7a300b4530 2023-07-14T11:15:28.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.990+0000 7f7a361ff700 1 -- 172.21.15.84:0/3498524522 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a300d0190 con 0x7f7a300b4530 2023-07-14T11:15:28.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.990+0000 7f7a2cff9700 1 -- 172.21.15.84:0/3498524522 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a20003a60 con 0x7f7a300b4530 2023-07-14T11:15:28.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.991+0000 7f7a361ff700 1 -- 172.21.15.84:0/3498524522 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a3015dfa0 con 0x7f7a300b4530 2023-07-14T11:15:28.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.992+0000 7f7a361ff700 1 -- 172.21.15.84:0/3498524522 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a300cb1b0 con 0x7f7a300b4530 2023-07-14T11:15:28.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.992+0000 7f7a2cff9700 1 -- 172.21.15.84:0/3498524522 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 7) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f7a20003bc0 con 0x7f7a300b4530 2023-07-14T11:15:28.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.993+0000 7f7a2cff9700 1 --2- 172.21.15.84:0/3498524522 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f7a1006ae90 0x7f7a1006d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:28.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.993+0000 7f7a2cff9700 1 -- 172.21.15.84:0/3498524522 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7a20021070 con 0x7f7a300b4530 2023-07-14T11:15:28.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.994+0000 7f7a27fff700 1 --2- 172.21.15.84:0/3498524522 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f7a1006ae90 0x7f7a1006d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:28.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.994+0000 7f7a27fff700 1 --2- 172.21.15.84:0/3498524522 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f7a1006ae90 0x7f7a1006d340 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7a30073750 tx=0x7f7a18009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:28.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:28.998+0000 7f7a2cff9700 1 -- 172.21.15.84:0/3498524522 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7a300cb1b0 con 0x7f7a300b4530 2023-07-14T11:15:29.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.194+0000 7f7a361ff700 1 -- 172.21.15.84:0/3498524522 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7a300cb1b0 con 0x7f7a300b4530 2023-07-14T11:15:29.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.194+0000 7f7a2cff9700 1 -- 172.21.15.84:0/3498524522 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v50) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7a20055e50 con 0x7f7a300b4530 2023-07-14T11:15:29.197 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-07-14T11:15:29.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.197+0000 7f7a361ff700 1 -- 172.21.15.84:0/3498524522 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f7a1006ae90 msgr2=0x7f7a1006d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:29.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.197+0000 7f7a361ff700 1 --2- 172.21.15.84:0/3498524522 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f7a1006ae90 0x7f7a1006d340 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7a30073750 tx=0x7f7a18009210 comp rx=0 tx=0).stop 2023-07-14T11:15:29.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.197+0000 7f7a361ff700 1 -- 172.21.15.84:0/3498524522 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a300b4530 msgr2=0x7f7a3015d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:29.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.197+0000 7f7a361ff700 1 --2- 172.21.15.84:0/3498524522 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a300b4530 0x7f7a3015d7c0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f7a20009b60 tx=0x7f7a20004750 comp rx=0 tx=0).stop 2023-07-14T11:15:29.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.197+0000 7f7a361ff700 1 -- 172.21.15.84:0/3498524522 shutdown_connections 2023-07-14T11:15:29.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.197+0000 7f7a361ff700 1 --2- 172.21.15.84:0/3498524522 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a300d1050 0x7f7a300cf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:29.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.197+0000 7f7a361ff700 1 --2- 172.21.15.84:0/3498524522 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a300b4530 0x7f7a3015d7c0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:29.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.197+0000 7f7a361ff700 1 --2- 172.21.15.84:0/3498524522 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f7a1006ae90 0x7f7a1006d340 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:29.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.197+0000 7f7a361ff700 1 --2- 172.21.15.84:0/3498524522 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a300b8a60 0x7f7a30152340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:29.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.197+0000 7f7a361ff700 1 -- 172.21.15.84:0/3498524522 >> 172.21.15.84:0/3498524522 conn(0x7f7a3009c1b0 msgr2=0x7f7a300b39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:29.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.197+0000 7f7a361ff700 1 -- 172.21.15.84:0/3498524522 shutdown_connections 2023-07-14T11:15:29.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.197+0000 7f7a361ff700 1 -- 172.21.15.84:0/3498524522 wait complete. 2023-07-14T11:15:29.217 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-14T11:15:29.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.410+0000 7f15095ff700 1 Processor -- start 2023-07-14T11:15:29.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.411+0000 7f15095ff700 1 -- start start 2023-07-14T11:15:29.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.412+0000 7f15095ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15040c92d0 0x7f15040ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:29.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.412+0000 7f15095ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f15040b12f0 0x7f15040c96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:29.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.412+0000 7f15095ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f150415ce70 con 0x7f15040adea0 2023-07-14T11:15:29.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.412+0000 7f15095ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f150415da60 con 0x7f15040b12f0 2023-07-14T11:15:29.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.412+0000 7f15095ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15040c9be0 con 0x7f15040c92d0 2023-07-14T11:15:29.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.412+0000 7f15037fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f15040adea0 0x7f150406c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:58150/0 (socket says 172.21.15.84:58150) 2023-07-14T11:15:29.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.412+0000 7f15037fe700 1 -- 172.21.15.84:0/1203344325 learned_addr learned my addr 172.21.15.84:0/1203344325 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:15:29.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.412+0000 7f15027fc700 1 --2- 172.21.15.84:0/1203344325 >> v2:172.21.15.179:3300/0 conn(0x7f15040b12f0 0x7f15040c96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:29.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.412+0000 7f1502ffd700 1 --2- 172.21.15.84:0/1203344325 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15040c92d0 0x7f15040ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:29.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.412+0000 7f1501ffb700 1 -- 172.21.15.84:0/1203344325 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3259800662 0 0) 0x7f150415ce70 con 0x7f15040adea0 2023-07-14T11:15:29.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.413+0000 7f1501ffb700 1 -- 172.21.15.84:0/1203344325 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14ec0057c0 con 0x7f15040adea0 2023-07-14T11:15:29.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.413+0000 7f1501ffb700 1 -- 172.21.15.84:0/1203344325 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2465429794 0 0) 0x7f14ec0057c0 con 0x7f15040adea0 2023-07-14T11:15:29.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.413+0000 7f1501ffb700 1 -- 172.21.15.84:0/1203344325 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15040c92d0 msgr2=0x7f15040ad8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:29.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.413+0000 7f1501ffb700 1 --2- 172.21.15.84:0/1203344325 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15040c92d0 0x7f15040ad8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:29.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.413+0000 7f1501ffb700 1 -- 172.21.15.84:0/1203344325 >> v2:172.21.15.179:3300/0 conn(0x7f15040b12f0 msgr2=0x7f15040c96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:29.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.413+0000 7f1501ffb700 1 --2- 172.21.15.84:0/1203344325 >> v2:172.21.15.179:3300/0 conn(0x7f15040b12f0 0x7f15040c96a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:29.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.413+0000 7f1501ffb700 1 -- 172.21.15.84:0/1203344325 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f150415d0c0 con 0x7f15040adea0 2023-07-14T11:15:29.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.413+0000 7f1501ffb700 1 -- 172.21.15.84:0/1203344325 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7f14fc0019f0 con 0x7f15040adea0 2023-07-14T11:15:29.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.413+0000 7f15027fc700 1 --2- 172.21.15.84:0/1203344325 >> v2:172.21.15.179:3300/0 conn(0x7f15040b12f0 0x7f15040c96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:15:29.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.413+0000 7f1501ffb700 1 -- 172.21.15.84:0/1203344325 >> v1:172.21.15.84:6789/0 conn(0x7f15040adea0 legacy=0x7f150406c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:29.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.413+0000 7f1501ffb700 1 --2- 172.21.15.84:0/1203344325 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14ec005c10 0x7f14ec006020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:29.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.413+0000 7f1501ffb700 1 --2- 172.21.15.84:0/1203344325 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14ec006a60 0x7f14ec006ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:29.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.413+0000 7f1501ffb700 1 --2- 172.21.15.84:0/1203344325 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15040c92d0 0x7f14ec007410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:29.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.413+0000 7f1501ffb700 1 -- 172.21.15.84:0/1203344325 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f150415da60 con 0x7f14ec006a60 2023-07-14T11:15:29.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.413+0000 7f1501ffb700 1 -- 172.21.15.84:0/1203344325 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15040c9be0 con 0x7f14ec005c10 2023-07-14T11:15:29.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.413+0000 7f1501ffb700 1 -- 172.21.15.84:0/1203344325 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14ec00dc50 con 0x7f15040c92d0 2023-07-14T11:15:29.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.413+0000 7f15027fc700 1 --2- 172.21.15.84:0/1203344325 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14ec006a60 0x7f14ec006ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:29.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.413+0000 7f15037fe700 1 --2- 172.21.15.84:0/1203344325 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15040c92d0 0x7f14ec007410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:29.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.413+0000 7f1502ffd700 1 --2- 172.21.15.84:0/1203344325 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14ec005c10 0x7f14ec006020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:29.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.414+0000 7f15027fc700 1 -- 172.21.15.84:0/1203344325 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15040c92d0 msgr2=0x7f14ec007410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:29.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.414+0000 7f15027fc700 1 --2- 172.21.15.84:0/1203344325 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15040c92d0 0x7f14ec007410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:29.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.414+0000 7f15027fc700 1 -- 172.21.15.84:0/1203344325 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14ec005c10 msgr2=0x7f14ec006020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:29.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.414+0000 7f15027fc700 1 --2- 172.21.15.84:0/1203344325 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14ec005c10 0x7f14ec006020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:29.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.414+0000 7f15027fc700 1 -- 172.21.15.84:0/1203344325 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14ec0057c0 con 0x7f14ec006a60 2023-07-14T11:15:29.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.414+0000 7f15027fc700 1 --2- 172.21.15.84:0/1203344325 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14ec006a60 0x7f14ec006ed0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f14f8009d30 tx=0x7f14ec007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=775425af8d9d75e0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:29.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.414+0000 7f1501ffb700 1 -- 172.21.15.84:0/1203344325 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f8009e80 con 0x7f14ec006a60 2023-07-14T11:15:29.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.414+0000 7f1501ffb700 1 -- 172.21.15.84:0/1203344325 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14f800e9a0 con 0x7f14ec006a60 2023-07-14T11:15:29.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.414+0000 7f1501ffb700 1 -- 172.21.15.84:0/1203344325 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f800ed30 con 0x7f14ec006a60 2023-07-14T11:15:29.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.414+0000 7f15095ff700 1 -- 172.21.15.84:0/1203344325 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14ec006a60 msgr2=0x7f14ec006ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:29.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.414+0000 7f15095ff700 1 --2- 172.21.15.84:0/1203344325 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14ec006a60 0x7f14ec006ed0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f14f8009d30 tx=0x7f14ec007a90 comp rx=0 tx=0).stop 2023-07-14T11:15:29.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.415+0000 7f15037fe700 1 -- 172.21.15.84:0/1203344325 reap_dead start 2023-07-14T11:15:29.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.415+0000 7f15095ff700 1 -- 172.21.15.84:0/1203344325 shutdown_connections 2023-07-14T11:15:29.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.415+0000 7f15095ff700 1 -- 172.21.15.84:0/1203344325 >> 172.21.15.84:0/1203344325 conn(0x7f15040b05d0 msgr2=0x7f15040b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:29.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.415+0000 7f15095ff700 1 -- 172.21.15.84:0/1203344325 shutdown_connections 2023-07-14T11:15:29.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.415+0000 7f15095ff700 1 -- 172.21.15.84:0/1203344325 wait complete. 2023-07-14T11:15:29.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.416+0000 7f15095ff700 1 Processor -- start 2023-07-14T11:15:29.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.417+0000 7f15095ff700 1 -- start start 2023-07-14T11:15:29.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.417+0000 7f15095ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14ec006a60 0x7f1504141e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:29.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.418+0000 7f15095ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15040c60f0 0x7f15040b18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:29.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.418+0000 7f15095ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15040b1e30 0x7f1504070590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:29.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.418+0000 7f15095ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15040b22a0 con 0x7f14ec006a60 2023-07-14T11:15:29.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.418+0000 7f15095ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1504070100 con 0x7f15040c60f0 2023-07-14T11:15:29.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.418+0000 7f15095ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f150406f7d0 con 0x7f15040b1e30 2023-07-14T11:15:29.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.418+0000 7f1502ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14ec006a60 0x7f1504141e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:29.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.418+0000 7f1502ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14ec006a60 0x7f1504141e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37408/0 (socket says 172.21.15.84:37408) 2023-07-14T11:15:29.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.418+0000 7f1502ffd700 1 -- 172.21.15.84:0/1771062557 learned_addr learned my addr 172.21.15.84:0/1771062557 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:29.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.418+0000 7f15027fc700 1 --2- 172.21.15.84:0/1771062557 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15040c60f0 0x7f15040b18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:29.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.418+0000 7f15037fe700 1 --2- 172.21.15.84:0/1771062557 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15040b1e30 0x7f1504070590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:29.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.418+0000 7f1502ffd700 1 -- 172.21.15.84:0/1771062557 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15040b1e30 msgr2=0x7f1504070590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:29.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.418+0000 7f1502ffd700 1 --2- 172.21.15.84:0/1771062557 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15040b1e30 0x7f1504070590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:29.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.418+0000 7f1502ffd700 1 -- 172.21.15.84:0/1771062557 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15040c60f0 msgr2=0x7f15040b18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:29.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.418+0000 7f1502ffd700 1 --2- 172.21.15.84:0/1771062557 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15040c60f0 0x7f15040b18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:29.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.418+0000 7f1502ffd700 1 -- 172.21.15.84:0/1771062557 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f150406fab0 con 0x7f14ec006a60 2023-07-14T11:15:29.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.418+0000 7f1502ffd700 1 --2- 172.21.15.84:0/1771062557 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14ec006a60 0x7f1504141e20 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f14f4011690 tx=0x7f14f40119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:29.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.419+0000 7f14eb7fe700 1 -- 172.21.15.84:0/1771062557 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f4015870 con 0x7f14ec006a60 2023-07-14T11:15:29.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.419+0000 7f14eb7fe700 1 -- 172.21.15.84:0/1771062557 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14f40159d0 con 0x7f14ec006a60 2023-07-14T11:15:29.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.419+0000 7f15095ff700 1 -- 172.21.15.84:0/1771062557 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f150406fd90 con 0x7f14ec006a60 2023-07-14T11:15:29.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.419+0000 7f14eb7fe700 1 -- 172.21.15.84:0/1771062557 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f4015d40 con 0x7f14ec006a60 2023-07-14T11:15:29.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.419+0000 7f15095ff700 1 -- 172.21.15.84:0/1771062557 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1504142360 con 0x7f14ec006a60 2023-07-14T11:15:29.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.420+0000 7f15095ff700 1 -- 172.21.15.84:0/1771062557 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1504074350 con 0x7f14ec006a60 2023-07-14T11:15:29.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.421+0000 7f14eb7fe700 1 -- 172.21.15.84:0/1771062557 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 7) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f14f4013400 con 0x7f14ec006a60 2023-07-14T11:15:29.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.422+0000 7f14eb7fe700 1 --2- 172.21.15.84:0/1771062557 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f14f006ae90 0x7f14f006d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:29.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.422+0000 7f14eb7fe700 1 -- 172.21.15.84:0/1771062557 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f14f4089a30 con 0x7f14ec006a60 2023-07-14T11:15:29.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.422+0000 7f15027fc700 1 --2- 172.21.15.84:0/1771062557 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f14f006ae90 0x7f14f006d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:29.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.422+0000 7f15027fc700 1 --2- 172.21.15.84:0/1771062557 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f14f006ae90 0x7f14f006d340 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f14f80090b0 tx=0x7f14f801f040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:29.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.426+0000 7f14eb7fe700 1 -- 172.21.15.84:0/1771062557 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f14f4054850 con 0x7f14ec006a60 2023-07-14T11:15:29.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.636+0000 7f15095ff700 1 -- 172.21.15.84:0/1771062557 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f15041561d0 con 0x7f14ec006a60 2023-07-14T11:15:29.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.636+0000 7f14eb7fe700 1 -- 172.21.15.84:0/1771062557 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v50) v1 ==== 80+0+0 (secure 0 0 0) 0x7f14f4057e70 con 0x7f14ec006a60 2023-07-14T11:15:29.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.639+0000 7f15095ff700 1 -- 172.21.15.84:0/1771062557 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f14f006ae90 msgr2=0x7f14f006d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:29.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.639+0000 7f15095ff700 1 --2- 172.21.15.84:0/1771062557 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f14f006ae90 0x7f14f006d340 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f14f80090b0 tx=0x7f14f801f040 comp rx=0 tx=0).stop 2023-07-14T11:15:29.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.639+0000 7f15095ff700 1 -- 172.21.15.84:0/1771062557 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14ec006a60 msgr2=0x7f1504141e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:29.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.639+0000 7f15095ff700 1 --2- 172.21.15.84:0/1771062557 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14ec006a60 0x7f1504141e20 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f14f4011690 tx=0x7f14f40119a0 comp rx=0 tx=0).stop 2023-07-14T11:15:29.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.639+0000 7f15095ff700 1 -- 172.21.15.84:0/1771062557 shutdown_connections 2023-07-14T11:15:29.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.639+0000 7f15095ff700 1 --2- 172.21.15.84:0/1771062557 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f14f006ae90 0x7f14f006d340 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:29.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.639+0000 7f15095ff700 1 --2- 172.21.15.84:0/1771062557 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15040b1e30 0x7f1504070590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:29.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.639+0000 7f15095ff700 1 --2- 172.21.15.84:0/1771062557 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14ec006a60 0x7f1504141e20 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:29.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.639+0000 7f15095ff700 1 --2- 172.21.15.84:0/1771062557 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15040c60f0 0x7f15040b18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:29.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.639+0000 7f15095ff700 1 -- 172.21.15.84:0/1771062557 >> 172.21.15.84:0/1771062557 conn(0x7f15040b05d0 msgr2=0x7f15040cea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:29.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.639+0000 7f15095ff700 1 -- 172.21.15.84:0/1771062557 shutdown_connections 2023-07-14T11:15:29.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:29.639+0000 7f15095ff700 1 -- 172.21.15.84:0/1771062557 wait complete. 2023-07-14T11:15:29.643 INFO:teuthology.orchestra.run.smithi084.stderr:listed 0 entries 2023-07-14T11:15:29.659 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-14T11:15:29.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:15:29.660 DEBUG:teuthology.orchestra.run.smithi084:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-14T11:15:29.747 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi084.front.sepia.ceph.com 2023-07-14T11:15:29.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:15:29.747 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-14T11:15:29.793 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-07-14T11:15:29.794 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:15:29.845 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-07-14T11:15:29.846 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:15:29.893 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:15:30.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.088+0000 7f36be1ff700 1 Processor -- start 2023-07-14T11:15:30.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.088+0000 7f36be1ff700 1 -- start start 2023-07-14T11:15:30.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.089+0000 7f36be1ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f36b80ce840 0x7f36b80cec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:30.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.090+0000 7f36be1ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36b80cf1d0 con 0x7f36b815ca30 2023-07-14T11:15:30.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.090+0000 7f36be1ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36b806c360 con 0x7f36b80d0830 2023-07-14T11:15:30.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.090+0000 7f36be1ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36b806cf00 con 0x7f36b80ce840 2023-07-14T11:15:30.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.090+0000 7f36affff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f36b80ce840 0x7f36b80cec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:30.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.090+0000 7f36b77fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f36b815ca30 0x7f36b806c7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:58154/0 (socket says 172.21.15.84:58154) 2023-07-14T11:15:30.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.090+0000 7f36b77fe700 1 -- 172.21.15.84:0/3954172226 learned_addr learned my addr 172.21.15.84:0/3954172226 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:15:30.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.090+0000 7f36affff700 1 --2- 172.21.15.84:0/3954172226 >> v2:172.21.15.84:3300/0 conn(0x7f36b80ce840 0x7f36b80cec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37414/0 (socket says 172.21.15.84:37414) 2023-07-14T11:15:30.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.090+0000 7f36affff700 1 -- 172.21.15.84:0/3954172226 >> v1:172.21.15.179:6789/0 conn(0x7f36b80d0830 legacy=0x7f36b80d0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:30.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.090+0000 7f36affff700 1 -- 172.21.15.84:0/3954172226 >> v1:172.21.15.84:6789/0 conn(0x7f36b815ca30 legacy=0x7f36b806c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:30.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.090+0000 7f36b6ffd700 1 -- 172.21.15.84:0/3954172226 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1810495502 0 0) 0x7f36a8001110 con 0x7f36b815ca30 2023-07-14T11:15:30.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.090+0000 7f36affff700 1 -- 172.21.15.84:0/3954172226 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36b806ba50 con 0x7f36b80ce840 2023-07-14T11:15:30.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.090+0000 7f36affff700 1 --2- 172.21.15.84:0/3954172226 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36b80ce840 0x7f36b80cec90 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f36a0009840 tx=0x7f36a0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a041d4260299768f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:30.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.091+0000 7f36b6ffd700 1 -- 172.21.15.84:0/3954172226 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a0004230 con 0x7f36b80ce840 2023-07-14T11:15:30.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.091+0000 7f36b6ffd700 1 -- 172.21.15.84:0/3954172226 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36a0004390 con 0x7f36b80ce840 2023-07-14T11:15:30.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.091+0000 7f36b6ffd700 1 -- 172.21.15.84:0/3954172226 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a00036a0 con 0x7f36b80ce840 2023-07-14T11:15:30.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.091+0000 7f36be1ff700 1 -- 172.21.15.84:0/3954172226 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36b80ce840 msgr2=0x7f36b80cec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:30.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.091+0000 7f36be1ff700 1 --2- 172.21.15.84:0/3954172226 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36b80ce840 0x7f36b80cec90 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f36a0009840 tx=0x7f36a0009b50 comp rx=0 tx=0).stop 2023-07-14T11:15:30.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.091+0000 7f36be1ff700 1 -- 172.21.15.84:0/3954172226 shutdown_connections 2023-07-14T11:15:30.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.091+0000 7f36be1ff700 1 --2- 172.21.15.84:0/3954172226 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36b80ce840 0x7f36b80cec90 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:30.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.091+0000 7f36be1ff700 1 -- 172.21.15.84:0/3954172226 >> 172.21.15.84:0/3954172226 conn(0x7f36b80664f0 msgr2=0x7f36b8099fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:30.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.091+0000 7f36be1ff700 1 -- 172.21.15.84:0/3954172226 shutdown_connections 2023-07-14T11:15:30.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.091+0000 7f36be1ff700 1 -- 172.21.15.84:0/3954172226 wait complete. 2023-07-14T11:15:30.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.093+0000 7f36be1ff700 1 Processor -- start 2023-07-14T11:15:30.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.093+0000 7f36be1ff700 1 -- start start 2023-07-14T11:15:30.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.094+0000 7f36be1ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36b80ce840 0x7f36b8156eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:30.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.094+0000 7f36be1ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36b80d0830 0x7f36b80c46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:30.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.094+0000 7f36be1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36b815ca30 0x7f36b80b4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:30.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.094+0000 7f36be1ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b81573f0 con 0x7f36b80ce840 2023-07-14T11:15:30.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.094+0000 7f36be1ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b80c4c10 con 0x7f36b80d0830 2023-07-14T11:15:30.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.094+0000 7f36be1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36b80c8bc0 con 0x7f36b815ca30 2023-07-14T11:15:30.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.094+0000 7f36b77fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36b80ce840 0x7f36b8156eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:30.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.094+0000 7f36b77fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36b80ce840 0x7f36b8156eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37422/0 (socket says 172.21.15.84:37422) 2023-07-14T11:15:30.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.094+0000 7f36b77fe700 1 -- 172.21.15.84:0/564588995 learned_addr learned my addr 172.21.15.84:0/564588995 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:30.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.095+0000 7f36affff700 1 --2- 172.21.15.84:0/564588995 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36b80d0830 0x7f36b80c46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:30.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.095+0000 7f36b7fff700 1 --2- 172.21.15.84:0/564588995 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36b815ca30 0x7f36b80b4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:30.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.095+0000 7f36b77fe700 1 -- 172.21.15.84:0/564588995 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36b815ca30 msgr2=0x7f36b80b4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:30.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.095+0000 7f36b77fe700 1 --2- 172.21.15.84:0/564588995 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36b815ca30 0x7f36b80b4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:30.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.095+0000 7f36b77fe700 1 -- 172.21.15.84:0/564588995 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36b80d0830 msgr2=0x7f36b80c46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:30.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.095+0000 7f36b77fe700 1 --2- 172.21.15.84:0/564588995 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36b80d0830 0x7f36b80c46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:30.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.095+0000 7f36b77fe700 1 -- 172.21.15.84:0/564588995 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a00094a0 con 0x7f36b80ce840 2023-07-14T11:15:30.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.095+0000 7f36affff700 1 --2- 172.21.15.84:0/564588995 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36b80d0830 0x7f36b80c46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:15:30.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.095+0000 7f36b77fe700 1 --2- 172.21.15.84:0/564588995 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36b80ce840 0x7f36b8156eb0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f36a800c730 tx=0x7f36a800caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:30.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.095+0000 7f36b4ff9700 1 -- 172.21.15.84:0/564588995 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a8004c80 con 0x7f36b80ce840 2023-07-14T11:15:30.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.095+0000 7f36b4ff9700 1 -- 172.21.15.84:0/564588995 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36a8004e00 con 0x7f36b80ce840 2023-07-14T11:15:30.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.095+0000 7f36be1ff700 1 -- 172.21.15.84:0/564588995 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36b80b5340 con 0x7f36b80ce840 2023-07-14T11:15:30.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.095+0000 7f36b4ff9700 1 -- 172.21.15.84:0/564588995 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a8007310 con 0x7f36b80ce840 2023-07-14T11:15:30.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.095+0000 7f36be1ff700 1 -- 172.21.15.84:0/564588995 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36b80b5900 con 0x7f36b80ce840 2023-07-14T11:15:30.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.096+0000 7f36be1ff700 1 -- 172.21.15.84:0/564588995 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36b80cfc20 con 0x7f36b80ce840 2023-07-14T11:15:30.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.097+0000 7f36b4ff9700 1 -- 172.21.15.84:0/564588995 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 7) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f36a8007470 con 0x7f36b80ce840 2023-07-14T11:15:30.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.098+0000 7f36b4ff9700 1 --2- 172.21.15.84:0/564588995 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f369806ae90 0x7f369806d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:30.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.098+0000 7f36b4ff9700 1 -- 172.21.15.84:0/564588995 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f36a8089390 con 0x7f36b80ce840 2023-07-14T11:15:30.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.098+0000 7f36affff700 1 --2- 172.21.15.84:0/564588995 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f369806ae90 0x7f369806d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:30.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.099+0000 7f36affff700 1 --2- 172.21.15.84:0/564588995 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f369806ae90 0x7f369806d340 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f36a00090b0 tx=0x7f36a0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:30.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.103+0000 7f36b4ff9700 1 -- 172.21.15.84:0/564588995 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f36a8054250 con 0x7f36b80ce840 2023-07-14T11:15:30.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.303+0000 7f36be1ff700 1 -- 172.21.15.84:0/564588995 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f36b80cf1d0 con 0x7f36b80ce840 2023-07-14T11:15:30.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.304+0000 7f36b4ff9700 1 -- 172.21.15.84:0/564588995 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+18327 (secure 0 0 0) 0x7f36b80cf1d0 con 0x7f36b80ce840 2023-07-14T11:15:30.307 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:15:30.307 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":50,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:15:11.922007+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-07-14T11:15:08.611029+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-07-14T11:15:09.373415+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:15:30.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.306+0000 7f36be1ff700 1 -- 172.21.15.84:0/564588995 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f369806ae90 msgr2=0x7f369806d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:30.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.306+0000 7f36be1ff700 1 --2- 172.21.15.84:0/564588995 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f369806ae90 0x7f369806d340 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f36a00090b0 tx=0x7f36a0008030 comp rx=0 tx=0).stop 2023-07-14T11:15:30.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.306+0000 7f36be1ff700 1 -- 172.21.15.84:0/564588995 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36b80ce840 msgr2=0x7f36b8156eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:30.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.306+0000 7f36be1ff700 1 --2- 172.21.15.84:0/564588995 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36b80ce840 0x7f36b8156eb0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f36a800c730 tx=0x7f36a800caf0 comp rx=0 tx=0).stop 2023-07-14T11:15:30.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.306+0000 7f36be1ff700 1 -- 172.21.15.84:0/564588995 shutdown_connections 2023-07-14T11:15:30.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.306+0000 7f36be1ff700 1 --2- 172.21.15.84:0/564588995 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f369806ae90 0x7f369806d340 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:30.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.306+0000 7f36be1ff700 1 --2- 172.21.15.84:0/564588995 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36b815ca30 0x7f36b80b4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:30.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.306+0000 7f36be1ff700 1 --2- 172.21.15.84:0/564588995 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36b80ce840 0x7f36b8156eb0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:30.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.306+0000 7f36be1ff700 1 --2- 172.21.15.84:0/564588995 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36b80d0830 0x7f36b80c46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:30.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.306+0000 7f36be1ff700 1 -- 172.21.15.84:0/564588995 >> 172.21.15.84:0/564588995 conn(0x7f36b80664f0 msgr2=0x7f36b80adc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:30.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.307+0000 7f36be1ff700 1 -- 172.21.15.84:0/564588995 shutdown_connections 2023-07-14T11:15:30.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.307+0000 7f36be1ff700 1 -- 172.21.15.84:0/564588995 wait complete. 2023-07-14T11:15:30.326 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T11:13:00.125395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T11:13:06.803994+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T11:15:08.611029+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T11:15:09.373415+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T11:15:30.327 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T11:15:30.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.523+0000 7f70881ff700 1 Processor -- start 2023-07-14T11:15:30.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.523+0000 7f70881ff700 1 -- start start 2023-07-14T11:15:30.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.524+0000 7f70881ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f70800b4860 0x7f70800b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:30.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.524+0000 7f70881ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f70800d12c0 0x7f70800d16e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:30.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.525+0000 7f70881ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70800d02a0 con 0x7f70800b8660 2023-07-14T11:15:30.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.525+0000 7f70881ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70800b5240 con 0x7f70800b4860 2023-07-14T11:15:30.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.525+0000 7f70881ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70800cfce0 con 0x7f70800d12c0 2023-07-14T11:15:30.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.525+0000 7f708579a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f70800b4860 0x7f70800b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:30.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.525+0000 7f7085f9b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f70800b8660 0x7f70800cd430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:58160/0 (socket says 172.21.15.84:58160) 2023-07-14T11:15:30.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.525+0000 7f7085f9b700 1 -- 172.21.15.84:0/2300757329 learned_addr learned my addr 172.21.15.84:0/2300757329 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:15:30.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.525+0000 7f708679c700 1 --2- 172.21.15.84:0/2300757329 >> v2:172.21.15.179:3300/0 conn(0x7f70800d12c0 0x7f70800d16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:30.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.525+0000 7f708579a700 1 -- 172.21.15.84:0/2300757329 >> v2:172.21.15.179:3300/0 conn(0x7f70800d12c0 msgr2=0x7f70800d16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:30.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.525+0000 7f708579a700 1 --2- 172.21.15.84:0/2300757329 >> v2:172.21.15.179:3300/0 conn(0x7f70800d12c0 0x7f70800d16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:30.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.525+0000 7f708579a700 1 -- 172.21.15.84:0/2300757329 >> v1:172.21.15.84:6789/0 conn(0x7f70800b8660 legacy=0x7f70800cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:30.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.525+0000 7f708579a700 1 -- 172.21.15.84:0/2300757329 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70800cffc0 con 0x7f70800b4860 2023-07-14T11:15:30.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.525+0000 7f708579a700 1 --2- 172.21.15.84:0/2300757329 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70800b4860 0x7f70800b4d00 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f70800d0630 tx=0x7f7070009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10ad549c04669bda server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:30.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.526+0000 7f7084f99700 1 -- 172.21.15.84:0/2300757329 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7070004230 con 0x7f70800b4860 2023-07-14T11:15:30.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.526+0000 7f7084f99700 1 -- 172.21.15.84:0/2300757329 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7070004390 con 0x7f70800b4860 2023-07-14T11:15:30.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.526+0000 7f7084f99700 1 -- 172.21.15.84:0/2300757329 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70700036a0 con 0x7f70800b4860 2023-07-14T11:15:30.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.526+0000 7f70881ff700 1 -- 172.21.15.84:0/2300757329 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70800b4860 msgr2=0x7f70800b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:30.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.526+0000 7f70881ff700 1 --2- 172.21.15.84:0/2300757329 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70800b4860 0x7f70800b4d00 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f70800d0630 tx=0x7f7070009b20 comp rx=0 tx=0).stop 2023-07-14T11:15:30.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.526+0000 7f70881ff700 1 -- 172.21.15.84:0/2300757329 shutdown_connections 2023-07-14T11:15:30.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.526+0000 7f70881ff700 1 --2- 172.21.15.84:0/2300757329 >> v2:172.21.15.179:3300/0 conn(0x7f70800d12c0 0x7f70800d16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:30.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.526+0000 7f70881ff700 1 --2- 172.21.15.84:0/2300757329 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70800b4860 0x7f70800b4d00 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:30.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.526+0000 7f70881ff700 1 -- 172.21.15.84:0/2300757329 >> 172.21.15.84:0/2300757329 conn(0x7f7080066860 msgr2=0x7f708006a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:30.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.526+0000 7f70881ff700 1 -- 172.21.15.84:0/2300757329 shutdown_connections 2023-07-14T11:15:30.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.526+0000 7f70881ff700 1 -- 172.21.15.84:0/2300757329 wait complete. 2023-07-14T11:15:30.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.528+0000 7f70881ff700 1 Processor -- start 2023-07-14T11:15:30.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.528+0000 7f70881ff700 1 -- start start 2023-07-14T11:15:30.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.529+0000 7f70881ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70800b4860 0x7f7080144040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:30.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.529+0000 7f70881ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f70800b8660 0x7f7080146b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:30.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.529+0000 7f70881ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f70800d12c0 0x7f7080156ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:30.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.529+0000 7f70881ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70801470c0 con 0x7f70800b4860 2023-07-14T11:15:30.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.529+0000 7f70881ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7080145360 con 0x7f70800b8660 2023-07-14T11:15:30.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.529+0000 7f70881ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7080144750 con 0x7f70800d12c0 2023-07-14T11:15:30.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.529+0000 7f7085f9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70800b4860 0x7f7080144040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:30.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.529+0000 7f7085f9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70800b4860 0x7f7080144040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37448/0 (socket says 172.21.15.84:37448) 2023-07-14T11:15:30.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.530+0000 7f7085f9b700 1 -- 172.21.15.84:0/773992675 learned_addr learned my addr 172.21.15.84:0/773992675 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:30.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.530+0000 7f708679c700 1 --2- 172.21.15.84:0/773992675 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f70800d12c0 0x7f7080156ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:30.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.530+0000 7f708579a700 1 --2- 172.21.15.84:0/773992675 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f70800b8660 0x7f7080146b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:30.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.530+0000 7f7085f9b700 1 -- 172.21.15.84:0/773992675 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f70800d12c0 msgr2=0x7f7080156ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:30.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.530+0000 7f7085f9b700 1 --2- 172.21.15.84:0/773992675 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f70800d12c0 0x7f7080156ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:30.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.530+0000 7f7085f9b700 1 -- 172.21.15.84:0/773992675 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f70800b8660 msgr2=0x7f7080146b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:30.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.530+0000 7f7085f9b700 1 --2- 172.21.15.84:0/773992675 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f70800b8660 0x7f7080146b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:30.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.530+0000 7f7085f9b700 1 -- 172.21.15.84:0/773992675 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70700094a0 con 0x7f70800b4860 2023-07-14T11:15:30.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.530+0000 7f7085f9b700 1 --2- 172.21.15.84:0/773992675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70800b4860 0x7f7080144040 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f707c00c7b0 tx=0x7f707c00cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:30.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.530+0000 7f70767fc700 1 -- 172.21.15.84:0/773992675 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707c004c80 con 0x7f70800b4860 2023-07-14T11:15:30.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.530+0000 7f70767fc700 1 -- 172.21.15.84:0/773992675 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f707c004de0 con 0x7f70800b4860 2023-07-14T11:15:30.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.530+0000 7f70881ff700 1 -- 172.21.15.84:0/773992675 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7080144a30 con 0x7f70800b4860 2023-07-14T11:15:30.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.530+0000 7f70767fc700 1 -- 172.21.15.84:0/773992675 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707c007310 con 0x7f70800b4860 2023-07-14T11:15:30.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.531+0000 7f70881ff700 1 -- 172.21.15.84:0/773992675 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7080144ff0 con 0x7f70800b4860 2023-07-14T11:15:30.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.532+0000 7f70881ff700 1 -- 172.21.15.84:0/773992675 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7080074350 con 0x7f70800b4860 2023-07-14T11:15:30.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.532+0000 7f70767fc700 1 -- 172.21.15.84:0/773992675 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 7) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f707c007470 con 0x7f70800b4860 2023-07-14T11:15:30.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.534+0000 7f70767fc700 1 --2- 172.21.15.84:0/773992675 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f706406aee0 0x7f706406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:30.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.534+0000 7f70767fc700 1 -- 172.21.15.84:0/773992675 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f707c088ed0 con 0x7f70800b4860 2023-07-14T11:15:30.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.534+0000 7f708579a700 1 --2- 172.21.15.84:0/773992675 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f706406aee0 0x7f706406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:30.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.535+0000 7f708579a700 1 --2- 172.21.15.84:0/773992675 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f706406aee0 0x7f706406d390 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f70800d0630 tx=0x7f7070008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:30.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.538+0000 7f70767fc700 1 -- 172.21.15.84:0/773992675 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f707c053ce0 con 0x7f70800b4860 2023-07-14T11:15:30.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.730+0000 7f70881ff700 1 -- 172.21.15.84:0/773992675 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f70800b2150 con 0x7f70800b4860 2023-07-14T11:15:30.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.731+0000 7f70767fc700 1 -- 172.21.15.84:0/773992675 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v50) v1 ==== 93+0+10 (secure 0 0 0) 0x7f707c018020 con 0x7f70800b4860 2023-07-14T11:15:30.733 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-07-14T11:15:30.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.733+0000 7f70881ff700 1 -- 172.21.15.84:0/773992675 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f706406aee0 msgr2=0x7f706406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:30.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.733+0000 7f70881ff700 1 --2- 172.21.15.84:0/773992675 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f706406aee0 0x7f706406d390 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f70800d0630 tx=0x7f7070008030 comp rx=0 tx=0).stop 2023-07-14T11:15:30.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.733+0000 7f70881ff700 1 -- 172.21.15.84:0/773992675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70800b4860 msgr2=0x7f7080144040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:30.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.733+0000 7f70881ff700 1 --2- 172.21.15.84:0/773992675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70800b4860 0x7f7080144040 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f707c00c7b0 tx=0x7f707c00cb70 comp rx=0 tx=0).stop 2023-07-14T11:15:30.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.733+0000 7f70881ff700 1 -- 172.21.15.84:0/773992675 shutdown_connections 2023-07-14T11:15:30.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.733+0000 7f70881ff700 1 --2- 172.21.15.84:0/773992675 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f706406aee0 0x7f706406d390 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:30.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.733+0000 7f70881ff700 1 --2- 172.21.15.84:0/773992675 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f70800d12c0 0x7f7080156ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:30.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.733+0000 7f70881ff700 1 --2- 172.21.15.84:0/773992675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70800b4860 0x7f7080144040 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:30.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.733+0000 7f70881ff700 1 --2- 172.21.15.84:0/773992675 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f70800b8660 0x7f7080146b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:30.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.733+0000 7f70881ff700 1 -- 172.21.15.84:0/773992675 >> 172.21.15.84:0/773992675 conn(0x7f7080066860 msgr2=0x7f70800d1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:30.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.733+0000 7f70881ff700 1 -- 172.21.15.84:0/773992675 shutdown_connections 2023-07-14T11:15:30.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.733+0000 7f70881ff700 1 -- 172.21.15.84:0/773992675 wait complete. 2023-07-14T11:15:30.753 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T11:15:30.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.949+0000 7f5bfdbff700 1 Processor -- start 2023-07-14T11:15:30.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.950+0000 7f5bfdbff700 1 -- start start 2023-07-14T11:15:30.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.951+0000 7f5bfdbff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5bf80b8a60 0x7f5bf80b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:30.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.951+0000 7f5bfdbff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bf80d1220 0x7f5bf80b0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:30.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.951+0000 7f5bfdbff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bf80b8e30 con 0x7f5bf80b4530 2023-07-14T11:15:30.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.951+0000 7f5bfdbff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bf80afaa0 con 0x7f5bf80b8a60 2023-07-14T11:15:30.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.951+0000 7f5bfdbff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf80afd80 con 0x7f5bf80d1220 2023-07-14T11:15:30.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.951+0000 7f5bf77fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5bf80b8a60 0x7f5bf80b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:30.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.951+0000 7f5bf77fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5bf80b8a60 0x7f5bf80b3ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37458/0 (socket says 172.21.15.84:37458) 2023-07-14T11:15:30.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.951+0000 7f5bf77fe700 1 -- 172.21.15.84:0/1592877403 learned_addr learned my addr 172.21.15.84:0/1592877403 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:30.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.952+0000 7f5bf77fe700 1 -- 172.21.15.84:0/1592877403 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bf80d1220 msgr2=0x7f5bf80b0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:30.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.952+0000 7f5bf77fe700 1 --2- 172.21.15.84:0/1592877403 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bf80d1220 0x7f5bf80b0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:30.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.952+0000 7f5bf77fe700 1 -- 172.21.15.84:0/1592877403 >> v1:172.21.15.179:6789/0 conn(0x7f5bf80b4530 legacy=0x7f5bf80d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:30.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.952+0000 7f5bf77fe700 1 -- 172.21.15.84:0/1592877403 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf80b0060 con 0x7f5bf80b8a60 2023-07-14T11:15:30.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.952+0000 7f5bf77fe700 1 --2- 172.21.15.84:0/1592877403 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bf80b8a60 0x7f5bf80b3ff0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f5be80098f0 tx=0x7f5be8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6ad4aff5b7ae2de server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:30.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.952+0000 7f5bf67fc700 1 -- 172.21.15.84:0/1592877403 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be8004230 con 0x7f5bf80b8a60 2023-07-14T11:15:30.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.952+0000 7f5bf67fc700 1 -- 172.21.15.84:0/1592877403 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5be8004390 con 0x7f5bf80b8a60 2023-07-14T11:15:30.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.952+0000 7f5bf67fc700 1 -- 172.21.15.84:0/1592877403 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be80036a0 con 0x7f5bf80b8a60 2023-07-14T11:15:30.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.953+0000 7f5bfdbff700 1 -- 172.21.15.84:0/1592877403 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bf80b8a60 msgr2=0x7f5bf80b3ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:30.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.953+0000 7f5bfdbff700 1 --2- 172.21.15.84:0/1592877403 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bf80b8a60 0x7f5bf80b3ff0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f5be80098f0 tx=0x7f5be8009c00 comp rx=0 tx=0).stop 2023-07-14T11:15:30.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.953+0000 7f5bfdbff700 1 -- 172.21.15.84:0/1592877403 shutdown_connections 2023-07-14T11:15:30.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.953+0000 7f5bfdbff700 1 --2- 172.21.15.84:0/1592877403 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bf80d1220 0x7f5bf80b0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:30.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.953+0000 7f5bfdbff700 1 --2- 172.21.15.84:0/1592877403 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bf80b8a60 0x7f5bf80b3ff0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:30.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.953+0000 7f5bfdbff700 1 -- 172.21.15.84:0/1592877403 >> 172.21.15.84:0/1592877403 conn(0x7f5bf809c1b0 msgr2=0x7f5bf80d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:30.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.953+0000 7f5bfdbff700 1 -- 172.21.15.84:0/1592877403 shutdown_connections 2023-07-14T11:15:30.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.953+0000 7f5bfdbff700 1 -- 172.21.15.84:0/1592877403 wait complete. 2023-07-14T11:15:30.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.955+0000 7f5bfdbff700 1 Processor -- start 2023-07-14T11:15:30.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.955+0000 7f5bfdbff700 1 -- start start 2023-07-14T11:15:30.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.956+0000 7f5bfdbff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bf80b4530 0x7f5bf815f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:30.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.956+0000 7f5bfdbff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bf80b8a60 0x7f5bf8152560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:30.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.956+0000 7f5bfdbff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5bf80d1220 0x7f5bf8153b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:30.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.956+0000 7f5bfdbff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf815f980 con 0x7f5bf80b8a60 2023-07-14T11:15:30.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.956+0000 7f5bfdbff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf8152aa0 con 0x7f5bf80d1220 2023-07-14T11:15:30.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.956+0000 7f5bfdbff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf8154040 con 0x7f5bf80b4530 2023-07-14T11:15:30.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.956+0000 7f5bf6ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bf80b8a60 0x7f5bf8152560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:30.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.956+0000 7f5bf6ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bf80b8a60 0x7f5bf8152560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37460/0 (socket says 172.21.15.84:37460) 2023-07-14T11:15:30.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.956+0000 7f5bf6ffd700 1 -- 172.21.15.84:0/94890486 learned_addr learned my addr 172.21.15.84:0/94890486 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:30.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.956+0000 7f5bf77fe700 1 --2- 172.21.15.84:0/94890486 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bf80b4530 0x7f5bf815f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:30.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.956+0000 7f5bf7fff700 1 --2- 172.21.15.84:0/94890486 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5bf80d1220 0x7f5bf8153b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:30.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.956+0000 7f5bf6ffd700 1 -- 172.21.15.84:0/94890486 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bf80b4530 msgr2=0x7f5bf815f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:30.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.956+0000 7f5bf6ffd700 1 --2- 172.21.15.84:0/94890486 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bf80b4530 0x7f5bf815f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:30.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.956+0000 7f5bf6ffd700 1 -- 172.21.15.84:0/94890486 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5bf80d1220 msgr2=0x7f5bf8153b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:30.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.956+0000 7f5bf6ffd700 1 --2- 172.21.15.84:0/94890486 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5bf80d1220 0x7f5bf8153b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:30.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.956+0000 7f5bf6ffd700 1 -- 172.21.15.84:0/94890486 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5be8009550 con 0x7f5bf80b8a60 2023-07-14T11:15:30.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.956+0000 7f5bf7fff700 1 --2- 172.21.15.84:0/94890486 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5bf80d1220 0x7f5bf8153b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:15:30.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.957+0000 7f5bf6ffd700 1 --2- 172.21.15.84:0/94890486 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bf80b8a60 0x7f5bf8152560 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f5bec00c4a0 tx=0x7f5bec00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:30.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.957+0000 7f5bdffff700 1 -- 172.21.15.84:0/94890486 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bec0054e0 con 0x7f5bf80b8a60 2023-07-14T11:15:30.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.957+0000 7f5bdffff700 1 -- 172.21.15.84:0/94890486 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bec003680 con 0x7f5bf80b8a60 2023-07-14T11:15:30.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.957+0000 7f5bdffff700 1 -- 172.21.15.84:0/94890486 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bec003a30 con 0x7f5bf80b8a60 2023-07-14T11:15:30.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.957+0000 7f5bfdbff700 1 -- 172.21.15.84:0/94890486 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bf8154300 con 0x7f5bf80b8a60 2023-07-14T11:15:30.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.957+0000 7f5bfdbff700 1 -- 172.21.15.84:0/94890486 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bf81548c0 con 0x7f5bf80b8a60 2023-07-14T11:15:30.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.958+0000 7f5bfdbff700 1 -- 172.21.15.84:0/94890486 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bf8074350 con 0x7f5bf80b8a60 2023-07-14T11:15:30.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.959+0000 7f5bdffff700 1 -- 172.21.15.84:0/94890486 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 7) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f5bec003b90 con 0x7f5bf80b8a60 2023-07-14T11:15:30.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.960+0000 7f5bdffff700 1 --2- 172.21.15.84:0/94890486 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f5be406ae90 0x7f5be406d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:30.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.960+0000 7f5bdffff700 1 -- 172.21.15.84:0/94890486 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5bec0888c0 con 0x7f5bf80b8a60 2023-07-14T11:15:30.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.960+0000 7f5bf77fe700 1 --2- 172.21.15.84:0/94890486 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f5be406ae90 0x7f5be406d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:30.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.961+0000 7f5bf77fe700 1 --2- 172.21.15.84:0/94890486 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f5be406ae90 0x7f5be406d340 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5be8000c00 tx=0x7f5be8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:30.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:30.964+0000 7f5bdffff700 1 -- 172.21.15.84:0/94890486 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f5bec0536e0 con 0x7f5bf80b8a60 2023-07-14T11:15:31.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.161+0000 7f5bfdbff700 1 -- 172.21.15.84:0/94890486 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5bf80d23e0 con 0x7f5bf80b8a60 2023-07-14T11:15:31.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.161+0000 7f5bdffff700 1 -- 172.21.15.84:0/94890486 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v50) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5bec056d00 con 0x7f5bf80b8a60 2023-07-14T11:15:31.164 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-07-14T11:15:31.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.164+0000 7f5bfdbff700 1 -- 172.21.15.84:0/94890486 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f5be406ae90 msgr2=0x7f5be406d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:31.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.164+0000 7f5bfdbff700 1 --2- 172.21.15.84:0/94890486 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f5be406ae90 0x7f5be406d340 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5be8000c00 tx=0x7f5be8008030 comp rx=0 tx=0).stop 2023-07-14T11:15:31.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.164+0000 7f5bfdbff700 1 -- 172.21.15.84:0/94890486 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bf80b8a60 msgr2=0x7f5bf8152560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:31.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.164+0000 7f5bfdbff700 1 --2- 172.21.15.84:0/94890486 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bf80b8a60 0x7f5bf8152560 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f5bec00c4a0 tx=0x7f5bec00c860 comp rx=0 tx=0).stop 2023-07-14T11:15:31.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.164+0000 7f5bfdbff700 1 -- 172.21.15.84:0/94890486 shutdown_connections 2023-07-14T11:15:31.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.164+0000 7f5bfdbff700 1 --2- 172.21.15.84:0/94890486 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f5be406ae90 0x7f5be406d340 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:31.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.164+0000 7f5bfdbff700 1 --2- 172.21.15.84:0/94890486 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bf80b4530 0x7f5bf815f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:31.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.164+0000 7f5bfdbff700 1 --2- 172.21.15.84:0/94890486 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5bf80d1220 0x7f5bf8153b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:31.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.164+0000 7f5bfdbff700 1 --2- 172.21.15.84:0/94890486 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bf80b8a60 0x7f5bf8152560 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:31.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.164+0000 7f5bfdbff700 1 -- 172.21.15.84:0/94890486 >> 172.21.15.84:0/94890486 conn(0x7f5bf809c1b0 msgr2=0x7f5bf806b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:31.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.164+0000 7f5bfdbff700 1 -- 172.21.15.84:0/94890486 shutdown_connections 2023-07-14T11:15:31.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.164+0000 7f5bfdbff700 1 -- 172.21.15.84:0/94890486 wait complete. 2023-07-14T11:15:31.184 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T11:15:31.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.379+0000 7f8be27ff700 1 Processor -- start 2023-07-14T11:15:31.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.379+0000 7f8be27ff700 1 -- start start 2023-07-14T11:15:31.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.380+0000 7f8be27ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8bdc0b8660 0x7f8bdc0cd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:31.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.380+0000 7f8be27ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8bdc0b4f70 0x7f8bdc0d12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:31.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.380+0000 7f8be27ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bdc0d02a0 con 0x7f8bdc0cd970 2023-07-14T11:15:31.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.380+0000 7f8be27ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bdc0cfce0 con 0x7f8bdc0b8660 2023-07-14T11:15:31.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.380+0000 7f8be27ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bdc0cffc0 con 0x7f8bdc0b4f70 2023-07-14T11:15:31.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.380+0000 7f8bdbfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8bdc0b8660 0x7f8bdc0cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:31.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.380+0000 7f8bdb7fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f8bdc0cd970 0x7f8bdc0b4860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:58170/0 (socket says 172.21.15.84:58170) 2023-07-14T11:15:31.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.380+0000 7f8bdb7fe700 1 -- 172.21.15.84:0/3002287383 learned_addr learned my addr 172.21.15.84:0/3002287383 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:15:31.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.381+0000 7f8be0d9c700 1 --2- 172.21.15.84:0/3002287383 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8bdc0b4f70 0x7f8bdc0d12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:31.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.381+0000 7f8bdbfff700 1 -- 172.21.15.84:0/3002287383 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8bdc0b4f70 msgr2=0x7f8bdc0d12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:31.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.381+0000 7f8bdbfff700 1 --2- 172.21.15.84:0/3002287383 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8bdc0b4f70 0x7f8bdc0d12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:31.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.381+0000 7f8bdbfff700 1 -- 172.21.15.84:0/3002287383 >> v1:172.21.15.84:6789/0 conn(0x7f8bdc0cd970 legacy=0x7f8bdc0b4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:31.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.381+0000 7f8bdbfff700 1 -- 172.21.15.84:0/3002287383 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bdc0d0ac0 con 0x7f8bdc0b8660 2023-07-14T11:15:31.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.381+0000 7f8bdbfff700 1 --2- 172.21.15.84:0/3002287383 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8bdc0b8660 0x7f8bdc0cd430 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc009840 tx=0x7f8bcc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fccb0abe79346c01 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:31.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.381+0000 7f8bdaffd700 1 -- 172.21.15.84:0/3002287383 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bcc011830 con 0x7f8bdc0b8660 2023-07-14T11:15:31.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.381+0000 7f8bdaffd700 1 -- 172.21.15.84:0/3002287383 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bcc011990 con 0x7f8bdc0b8660 2023-07-14T11:15:31.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.381+0000 7f8bdaffd700 1 -- 172.21.15.84:0/3002287383 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bcc011d20 con 0x7f8bdc0b8660 2023-07-14T11:15:31.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.382+0000 7f8be27ff700 1 -- 172.21.15.84:0/3002287383 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8bdc0b8660 msgr2=0x7f8bdc0cd430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:31.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.382+0000 7f8be27ff700 1 --2- 172.21.15.84:0/3002287383 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8bdc0b8660 0x7f8bdc0cd430 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc009840 tx=0x7f8bcc009b50 comp rx=0 tx=0).stop 2023-07-14T11:15:31.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.382+0000 7f8be27ff700 1 -- 172.21.15.84:0/3002287383 shutdown_connections 2023-07-14T11:15:31.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.382+0000 7f8be27ff700 1 --2- 172.21.15.84:0/3002287383 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8bdc0b4f70 0x7f8bdc0d12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:31.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.382+0000 7f8be27ff700 1 --2- 172.21.15.84:0/3002287383 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8bdc0b8660 0x7f8bdc0cd430 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:31.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.382+0000 7f8be27ff700 1 -- 172.21.15.84:0/3002287383 >> 172.21.15.84:0/3002287383 conn(0x7f8bdc066860 msgr2=0x7f8bdc06a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:31.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.382+0000 7f8be27ff700 1 -- 172.21.15.84:0/3002287383 shutdown_connections 2023-07-14T11:15:31.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.382+0000 7f8be27ff700 1 -- 172.21.15.84:0/3002287383 wait complete. 2023-07-14T11:15:31.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.384+0000 7f8be27ff700 1 Processor -- start 2023-07-14T11:15:31.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.385+0000 7f8be27ff700 1 -- start start 2023-07-14T11:15:31.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.386+0000 7f8be27ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8bdc0b4f70 0x7f8bdc158530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:31.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.386+0000 7f8be27ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8bdc0b8660 0x7f8bdc0cc000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:31.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.386+0000 7f8be27ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8bdc0cd970 0x7f8bdc1563f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:31.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.386+0000 7f8be27ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bdc151dd0 con 0x7f8bdc0cd970 2023-07-14T11:15:31.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.386+0000 7f8be27ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bdc0cc540 con 0x7f8bdc0b4f70 2023-07-14T11:15:31.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.386+0000 7f8be27ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bdc1593d0 con 0x7f8bdc0b8660 2023-07-14T11:15:31.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.386+0000 7f8be0d9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8bdc0cd970 0x7f8bdc1563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:31.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.386+0000 7f8be0d9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8bdc0cd970 0x7f8bdc1563f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37468/0 (socket says 172.21.15.84:37468) 2023-07-14T11:15:31.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.386+0000 7f8be0d9c700 1 -- 172.21.15.84:0/2357682811 learned_addr learned my addr 172.21.15.84:0/2357682811 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:31.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.386+0000 7f8bdb7fe700 1 --2- 172.21.15.84:0/2357682811 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8bdc0b8660 0x7f8bdc0cc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:31.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.386+0000 7f8bdbfff700 1 --2- 172.21.15.84:0/2357682811 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8bdc0b4f70 0x7f8bdc158530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:31.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.387+0000 7f8be0d9c700 1 -- 172.21.15.84:0/2357682811 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8bdc0b8660 msgr2=0x7f8bdc0cc000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:31.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.387+0000 7f8be0d9c700 1 --2- 172.21.15.84:0/2357682811 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8bdc0b8660 0x7f8bdc0cc000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:31.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.387+0000 7f8be0d9c700 1 -- 172.21.15.84:0/2357682811 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8bdc0b4f70 msgr2=0x7f8bdc158530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:31.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.387+0000 7f8be0d9c700 1 --2- 172.21.15.84:0/2357682811 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8bdc0b4f70 0x7f8bdc158530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:31.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.387+0000 7f8be0d9c700 1 -- 172.21.15.84:0/2357682811 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bcc0094a0 con 0x7f8bdc0cd970 2023-07-14T11:15:31.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.387+0000 7f8be0d9c700 1 --2- 172.21.15.84:0/2357682811 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8bdc0cd970 0x7f8bdc1563f0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f8bd4007e60 tx=0x7f8bd400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:31.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.387+0000 7f8bd8ff9700 1 -- 172.21.15.84:0/2357682811 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd400ed30 con 0x7f8bdc0cd970 2023-07-14T11:15:31.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.387+0000 7f8bd8ff9700 1 -- 172.21.15.84:0/2357682811 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bd400ee90 con 0x7f8bdc0cd970 2023-07-14T11:15:31.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.387+0000 7f8bd8ff9700 1 -- 172.21.15.84:0/2357682811 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd4014660 con 0x7f8bdc0cd970 2023-07-14T11:15:31.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.387+0000 7f8be27ff700 1 -- 172.21.15.84:0/2357682811 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bdc158b30 con 0x7f8bdc0cd970 2023-07-14T11:15:31.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.387+0000 7f8be27ff700 1 -- 172.21.15.84:0/2357682811 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bdc1590f0 con 0x7f8bdc0cd970 2023-07-14T11:15:31.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.388+0000 7f8be27ff700 1 -- 172.21.15.84:0/2357682811 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bdc074350 con 0x7f8bdc0cd970 2023-07-14T11:15:31.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.389+0000 7f8bd8ff9700 1 -- 172.21.15.84:0/2357682811 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 7) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f8bd40147c0 con 0x7f8bdc0cd970 2023-07-14T11:15:31.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.390+0000 7f8bd8ff9700 1 --2- 172.21.15.84:0/2357682811 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f8bc806ae90 0x7f8bc806d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:31.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.390+0000 7f8bd8ff9700 1 -- 172.21.15.84:0/2357682811 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8bd4089e00 con 0x7f8bdc0cd970 2023-07-14T11:15:31.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.390+0000 7f8bdbfff700 1 --2- 172.21.15.84:0/2357682811 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f8bc806ae90 0x7f8bc806d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:31.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.391+0000 7f8bdbfff700 1 --2- 172.21.15.84:0/2357682811 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f8bc806ae90 0x7f8bc806d340 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc0090b0 tx=0x7f8bcc008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:31.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.395+0000 7f8bd8ff9700 1 -- 172.21.15.84:0/2357682811 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f8bd4054cc0 con 0x7f8bdc0cd970 2023-07-14T11:15:31.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.591+0000 7f8be27ff700 1 -- 172.21.15.84:0/2357682811 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8bdc0b2150 con 0x7f8bdc0cd970 2023-07-14T11:15:31.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.592+0000 7f8bd8ff9700 1 -- 172.21.15.84:0/2357682811 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v50) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8bd40582e0 con 0x7f8bdc0cd970 2023-07-14T11:15:31.594 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-07-14T11:15:31.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.594+0000 7f8be27ff700 1 -- 172.21.15.84:0/2357682811 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f8bc806ae90 msgr2=0x7f8bc806d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:31.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.594+0000 7f8be27ff700 1 --2- 172.21.15.84:0/2357682811 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f8bc806ae90 0x7f8bc806d340 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc0090b0 tx=0x7f8bcc008030 comp rx=0 tx=0).stop 2023-07-14T11:15:31.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.594+0000 7f8be27ff700 1 -- 172.21.15.84:0/2357682811 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8bdc0cd970 msgr2=0x7f8bdc1563f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:31.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.594+0000 7f8be27ff700 1 --2- 172.21.15.84:0/2357682811 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8bdc0cd970 0x7f8bdc1563f0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f8bd4007e60 tx=0x7f8bd400e3c0 comp rx=0 tx=0).stop 2023-07-14T11:15:31.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.594+0000 7f8be27ff700 1 -- 172.21.15.84:0/2357682811 shutdown_connections 2023-07-14T11:15:31.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.594+0000 7f8be27ff700 1 --2- 172.21.15.84:0/2357682811 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8bdc0cd970 0x7f8bdc1563f0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:31.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.594+0000 7f8be27ff700 1 --2- 172.21.15.84:0/2357682811 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8bdc0b4f70 0x7f8bdc158530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:31.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.594+0000 7f8be27ff700 1 --2- 172.21.15.84:0/2357682811 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f8bc806ae90 0x7f8bc806d340 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:31.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.594+0000 7f8be27ff700 1 --2- 172.21.15.84:0/2357682811 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8bdc0b8660 0x7f8bdc0cc000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:31.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.594+0000 7f8be27ff700 1 -- 172.21.15.84:0/2357682811 >> 172.21.15.84:0/2357682811 conn(0x7f8bdc066860 msgr2=0x7f8bdc0d11c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:31.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.594+0000 7f8be27ff700 1 -- 172.21.15.84:0/2357682811 shutdown_connections 2023-07-14T11:15:31.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.595+0000 7f8be27ff700 1 -- 172.21.15.84:0/2357682811 wait complete. 2023-07-14T11:15:31.614 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T11:15:31.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.811+0000 7f50283ff700 1 Processor -- start 2023-07-14T11:15:31.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.811+0000 7f50283ff700 1 -- start start 2023-07-14T11:15:31.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.812+0000 7f50283ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50200b8a60 0x7f50200b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:31.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.812+0000 7f50283ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f50200b4530 0x7f50200d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:31.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.812+0000 7f50283ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f50200d1050 0x7f50200b25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:31.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.812+0000 7f50283ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50200d14d0 con 0x7f50200d1050 2023-07-14T11:15:31.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.812+0000 7f50283ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50200b8e30 con 0x7f50200b4530 2023-07-14T11:15:31.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.812+0000 7f50283ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50200afaa0 con 0x7f50200b8a60 2023-07-14T11:15:31.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.812+0000 7f502699c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f50200d1050 0x7f50200b25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:31.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.813+0000 7f502699c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f50200d1050 0x7f50200b25d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37470/0 (socket says 172.21.15.84:37470) 2023-07-14T11:15:31.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.813+0000 7f502699c700 1 -- 172.21.15.84:0/3233449012 learned_addr learned my addr 172.21.15.84:0/3233449012 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:31.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.813+0000 7f502619b700 1 --2- 172.21.15.84:0/3233449012 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50200b8a60 0x7f50200b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:31.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.813+0000 7f502599a700 1 --2- 172.21.15.84:0/3233449012 >> v2:172.21.15.179:3300/0 conn(0x7f50200b4530 0x7f50200d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:31.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.813+0000 7f502699c700 1 -- 172.21.15.84:0/3233449012 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50200b8a60 msgr2=0x7f50200b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:31.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.813+0000 7f502699c700 1 --2- 172.21.15.84:0/3233449012 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50200b8a60 0x7f50200b3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:31.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.813+0000 7f502699c700 1 -- 172.21.15.84:0/3233449012 >> v2:172.21.15.179:3300/0 conn(0x7f50200b4530 msgr2=0x7f50200d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:31.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.813+0000 7f502699c700 1 --2- 172.21.15.84:0/3233449012 >> v2:172.21.15.179:3300/0 conn(0x7f50200b4530 0x7f50200d0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:31.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.813+0000 7f502699c700 1 -- 172.21.15.84:0/3233449012 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50200afd80 con 0x7f50200d1050 2023-07-14T11:15:31.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.813+0000 7f502699c700 1 --2- 172.21.15.84:0/3233449012 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50200d1050 0x7f50200b25d0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f50200b5b30 tx=0x7f501800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f9cb392133334f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:31.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.813+0000 7f5025199700 1 -- 172.21.15.84:0/3233449012 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501800e070 con 0x7f50200d1050 2023-07-14T11:15:31.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.813+0000 7f5025199700 1 -- 172.21.15.84:0/3233449012 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f501800b910 con 0x7f50200d1050 2023-07-14T11:15:31.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.813+0000 7f5025199700 1 -- 172.21.15.84:0/3233449012 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501800bcc0 con 0x7f50200d1050 2023-07-14T11:15:31.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.814+0000 7f50283ff700 1 -- 172.21.15.84:0/3233449012 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50200d1050 msgr2=0x7f50200b25d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:31.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.814+0000 7f50283ff700 1 --2- 172.21.15.84:0/3233449012 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50200d1050 0x7f50200b25d0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f50200b5b30 tx=0x7f501800b330 comp rx=0 tx=0).stop 2023-07-14T11:15:31.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.814+0000 7f50283ff700 1 -- 172.21.15.84:0/3233449012 shutdown_connections 2023-07-14T11:15:31.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.814+0000 7f50283ff700 1 --2- 172.21.15.84:0/3233449012 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50200b8a60 0x7f50200b3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:31.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.814+0000 7f50283ff700 1 --2- 172.21.15.84:0/3233449012 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50200d1050 0x7f50200b25d0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:31.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.814+0000 7f50283ff700 1 --2- 172.21.15.84:0/3233449012 >> v2:172.21.15.179:3300/0 conn(0x7f50200b4530 0x7f50200d0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:31.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.814+0000 7f50283ff700 1 -- 172.21.15.84:0/3233449012 >> 172.21.15.84:0/3233449012 conn(0x7f502009c1b0 msgr2=0x7f50200d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:31.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.814+0000 7f50283ff700 1 -- 172.21.15.84:0/3233449012 shutdown_connections 2023-07-14T11:15:31.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.814+0000 7f50283ff700 1 -- 172.21.15.84:0/3233449012 wait complete. 2023-07-14T11:15:31.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.816+0000 7f50283ff700 1 Processor -- start 2023-07-14T11:15:31.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.816+0000 7f50283ff700 1 -- start start 2023-07-14T11:15:31.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.817+0000 7f50283ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50200b4530 0x7f50200cc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:31.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.817+0000 7f50283ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50200b8a60 0x7f5020149f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:31.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.817+0000 7f50283ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50200d1050 0x7f502014cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:31.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.817+0000 7f50283ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50201504c0 con 0x7f50200b8a60 2023-07-14T11:15:31.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.817+0000 7f50283ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50200cc110 con 0x7f50200b4530 2023-07-14T11:15:31.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.817+0000 7f50283ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50200cb500 con 0x7f50200d1050 2023-07-14T11:15:31.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.817+0000 7f502599a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50200b8a60 0x7f5020149f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:31.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.817+0000 7f502599a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50200b8a60 0x7f5020149f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37484/0 (socket says 172.21.15.84:37484) 2023-07-14T11:15:31.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.817+0000 7f502599a700 1 -- 172.21.15.84:0/4203524530 learned_addr learned my addr 172.21.15.84:0/4203524530 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:31.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.817+0000 7f502619b700 1 --2- 172.21.15.84:0/4203524530 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50200b4530 0x7f50200cc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:31.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.818+0000 7f502699c700 1 --2- 172.21.15.84:0/4203524530 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50200d1050 0x7f502014cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:31.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.818+0000 7f502599a700 1 -- 172.21.15.84:0/4203524530 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50200d1050 msgr2=0x7f502014cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:31.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.818+0000 7f502599a700 1 --2- 172.21.15.84:0/4203524530 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50200d1050 0x7f502014cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:31.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.818+0000 7f502599a700 1 -- 172.21.15.84:0/4203524530 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50200b4530 msgr2=0x7f50200cc5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:31.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.818+0000 7f502599a700 1 --2- 172.21.15.84:0/4203524530 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50200b4530 0x7f50200cc5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:31.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.818+0000 7f502599a700 1 -- 172.21.15.84:0/4203524530 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5018009b30 con 0x7f50200b8a60 2023-07-14T11:15:31.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.818+0000 7f502599a700 1 --2- 172.21.15.84:0/4203524530 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50200b8a60 0x7f5020149f00 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f501000e9b0 tx=0x7f501000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:31.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.818+0000 7f5016ffd700 1 -- 172.21.15.84:0/4203524530 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5010009710 con 0x7f50200b8a60 2023-07-14T11:15:31.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.818+0000 7f5016ffd700 1 -- 172.21.15.84:0/4203524530 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f501000ee50 con 0x7f50200b8a60 2023-07-14T11:15:31.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.818+0000 7f50283ff700 1 -- 172.21.15.84:0/4203524530 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50200cb7e0 con 0x7f50200b8a60 2023-07-14T11:15:31.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.818+0000 7f5016ffd700 1 -- 172.21.15.84:0/4203524530 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501000ca50 con 0x7f50200b8a60 2023-07-14T11:15:31.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.818+0000 7f50283ff700 1 -- 172.21.15.84:0/4203524530 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50200cbda0 con 0x7f50200b8a60 2023-07-14T11:15:31.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.819+0000 7f50283ff700 1 -- 172.21.15.84:0/4203524530 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50200d0960 con 0x7f50200b8a60 2023-07-14T11:15:31.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.820+0000 7f5016ffd700 1 -- 172.21.15.84:0/4203524530 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 7) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f501000cbb0 con 0x7f50200b8a60 2023-07-14T11:15:31.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.821+0000 7f5016ffd700 1 --2- 172.21.15.84:0/4203524530 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f500406ae90 0x7f500406d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:31.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.821+0000 7f5016ffd700 1 -- 172.21.15.84:0/4203524530 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5010089b20 con 0x7f50200b8a60 2023-07-14T11:15:31.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.821+0000 7f502619b700 1 --2- 172.21.15.84:0/4203524530 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f500406ae90 0x7f500406d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:31.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.822+0000 7f502619b700 1 --2- 172.21.15.84:0/4203524530 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f500406ae90 0x7f500406d340 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f501c009b60 tx=0x7f501c009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:31.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:31.826+0000 7f5016ffd700 1 -- 172.21.15.84:0/4203524530 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f5010054940 con 0x7f50200b8a60 2023-07-14T11:15:32.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.022+0000 7f50283ff700 1 -- 172.21.15.84:0/4203524530 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f50200cc280 con 0x7f50200b8a60 2023-07-14T11:15:32.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.027+0000 7f5016ffd700 1 -- 172.21.15.84:0/4203524530 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v50) v1 ==== 100+0+11 (secure 0 0 0) 0x7f501000ce60 con 0x7f50200b8a60 2023-07-14T11:15:32.030 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-07-14T11:15:32.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.030+0000 7f50283ff700 1 -- 172.21.15.84:0/4203524530 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f500406ae90 msgr2=0x7f500406d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:32.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.030+0000 7f50283ff700 1 --2- 172.21.15.84:0/4203524530 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f500406ae90 0x7f500406d340 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f501c009b60 tx=0x7f501c009210 comp rx=0 tx=0).stop 2023-07-14T11:15:32.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.030+0000 7f50283ff700 1 -- 172.21.15.84:0/4203524530 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50200b8a60 msgr2=0x7f5020149f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:32.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.030+0000 7f50283ff700 1 --2- 172.21.15.84:0/4203524530 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50200b8a60 0x7f5020149f00 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f501000e9b0 tx=0x7f501000ecc0 comp rx=0 tx=0).stop 2023-07-14T11:15:32.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.030+0000 7f50283ff700 1 -- 172.21.15.84:0/4203524530 shutdown_connections 2023-07-14T11:15:32.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.030+0000 7f50283ff700 1 --2- 172.21.15.84:0/4203524530 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f500406ae90 0x7f500406d340 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:32.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.030+0000 7f50283ff700 1 --2- 172.21.15.84:0/4203524530 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50200d1050 0x7f502014cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:32.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.030+0000 7f50283ff700 1 --2- 172.21.15.84:0/4203524530 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50200b4530 0x7f50200cc5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:32.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.030+0000 7f50283ff700 1 --2- 172.21.15.84:0/4203524530 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50200b8a60 0x7f5020149f00 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:32.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.030+0000 7f50283ff700 1 -- 172.21.15.84:0/4203524530 >> 172.21.15.84:0/4203524530 conn(0x7f502009c1b0 msgr2=0x7f50200b1c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:32.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.030+0000 7f50283ff700 1 -- 172.21.15.84:0/4203524530 shutdown_connections 2023-07-14T11:15:32.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.030+0000 7f50283ff700 1 -- 172.21.15.84:0/4203524530 wait complete. 2023-07-14T11:15:32.050 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-14T11:15:32.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.245+0000 7f6a31bff700 1 Processor -- start 2023-07-14T11:15:32.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.245+0000 7f6a31bff700 1 -- start start 2023-07-14T11:15:32.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.246+0000 7f6a31bff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6a2c0c92d0 0x7f6a2c0ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:32.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.246+0000 7f6a31bff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6a2c0adea0 0x7f6a2c0cc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:32.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.246+0000 7f6a31bff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a2c15ce70 con 0x7f6a2c0b12f0 2023-07-14T11:15:32.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.246+0000 7f6a31bff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a2c15da60 con 0x7f6a2c0c92d0 2023-07-14T11:15:32.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.246+0000 7f6a31bff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a2c15d0c0 con 0x7f6a2c0adea0 2023-07-14T11:15:32.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.247+0000 7f6a2b7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6a2c0c92d0 0x7f6a2c0ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:32.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.247+0000 7f6a2affd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f6a2c0b12f0 0x7f6a2c0c96a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:58178/0 (socket says 172.21.15.84:58178) 2023-07-14T11:15:32.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.247+0000 7f6a2affd700 1 -- 172.21.15.84:0/2633828561 learned_addr learned my addr 172.21.15.84:0/2633828561 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:15:32.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.247+0000 7f6a2b7fe700 1 -- 172.21.15.84:0/2633828561 >> v2:172.21.15.179:3300/0 conn(0x7f6a2c0adea0 msgr2=0x7f6a2c0cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:32.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.247+0000 7f6a2bfff700 1 --2- 172.21.15.84:0/2633828561 >> v2:172.21.15.179:3300/0 conn(0x7f6a2c0adea0 0x7f6a2c0cc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:32.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.247+0000 7f6a2a7fc700 1 -- 172.21.15.84:0/2633828561 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2008416597 0 0) 0x7f6a2c15ce70 con 0x7f6a2c0b12f0 2023-07-14T11:15:32.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.247+0000 7f6a2b7fe700 1 --2- 172.21.15.84:0/2633828561 >> v2:172.21.15.179:3300/0 conn(0x7f6a2c0adea0 0x7f6a2c0cc690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:32.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.247+0000 7f6a2b7fe700 1 -- 172.21.15.84:0/2633828561 >> v1:172.21.15.84:6789/0 conn(0x7f6a2c0b12f0 legacy=0x7f6a2c0c96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:32.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.247+0000 7f6a2b7fe700 1 -- 172.21.15.84:0/2633828561 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a2c15d3a0 con 0x7f6a2c0c92d0 2023-07-14T11:15:32.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.247+0000 7f6a2bfff700 1 --2- 172.21.15.84:0/2633828561 >> v2:172.21.15.179:3300/0 conn(0x7f6a2c0adea0 0x7f6a2c0cc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:15:32.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.247+0000 7f6a2b7fe700 1 --2- 172.21.15.84:0/2633828561 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a2c0c92d0 0x7f6a2c0ad8f0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c0c9250 tx=0x7f6a1c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a06d612c5875fe8 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:32.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.248+0000 7f6a2a7fc700 1 -- 172.21.15.84:0/2633828561 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1c011830 con 0x7f6a2c0c92d0 2023-07-14T11:15:32.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.248+0000 7f6a2a7fc700 1 -- 172.21.15.84:0/2633828561 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a1c011990 con 0x7f6a2c0c92d0 2023-07-14T11:15:32.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.248+0000 7f6a2a7fc700 1 -- 172.21.15.84:0/2633828561 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1c011d20 con 0x7f6a2c0c92d0 2023-07-14T11:15:32.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.248+0000 7f6a31bff700 1 -- 172.21.15.84:0/2633828561 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a2c0c92d0 msgr2=0x7f6a2c0ad8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:32.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.248+0000 7f6a31bff700 1 --2- 172.21.15.84:0/2633828561 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a2c0c92d0 0x7f6a2c0ad8f0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c0c9250 tx=0x7f6a1c009b20 comp rx=0 tx=0).stop 2023-07-14T11:15:32.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.248+0000 7f6a31bff700 1 -- 172.21.15.84:0/2633828561 shutdown_connections 2023-07-14T11:15:32.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.248+0000 7f6a31bff700 1 --2- 172.21.15.84:0/2633828561 >> v2:172.21.15.179:3300/0 conn(0x7f6a2c0adea0 0x7f6a2c0cc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:32.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.248+0000 7f6a31bff700 1 --2- 172.21.15.84:0/2633828561 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a2c0c92d0 0x7f6a2c0ad8f0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:32.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.248+0000 7f6a31bff700 1 -- 172.21.15.84:0/2633828561 >> 172.21.15.84:0/2633828561 conn(0x7f6a2c0b05d0 msgr2=0x7f6a2c0b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:32.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.248+0000 7f6a31bff700 1 -- 172.21.15.84:0/2633828561 shutdown_connections 2023-07-14T11:15:32.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.248+0000 7f6a31bff700 1 -- 172.21.15.84:0/2633828561 wait complete. 2023-07-14T11:15:32.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.250+0000 7f6a31bff700 1 Processor -- start 2023-07-14T11:15:32.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.250+0000 7f6a31bff700 1 -- start start 2023-07-14T11:15:32.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.251+0000 7f6a31bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a2c0adea0 0x7f6a2c0b18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:32.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.251+0000 7f6a31bff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a2c0b12f0 0x7f6a2c0b35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:32.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.251+0000 7f6a31bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a2c0c92d0 0x7f6a2c152f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:32.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.251+0000 7f6a31bff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2c15c7b0 con 0x7f6a2c0b12f0 2023-07-14T11:15:32.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.251+0000 7f6a31bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2c15c280 con 0x7f6a2c0adea0 2023-07-14T11:15:32.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.251+0000 7f6a31bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2c15c4d0 con 0x7f6a2c0c92d0 2023-07-14T11:15:32.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.251+0000 7f6a2affd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a2c0b12f0 0x7f6a2c0b35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:32.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.251+0000 7f6a2affd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a2c0b12f0 0x7f6a2c0b35a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37498/0 (socket says 172.21.15.84:37498) 2023-07-14T11:15:32.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.251+0000 7f6a2affd700 1 -- 172.21.15.84:0/325662613 learned_addr learned my addr 172.21.15.84:0/325662613 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:32.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.252+0000 7f6a2bfff700 1 --2- 172.21.15.84:0/325662613 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a2c0c92d0 0x7f6a2c152f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:32.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.252+0000 7f6a2b7fe700 1 --2- 172.21.15.84:0/325662613 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a2c0adea0 0x7f6a2c0b18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:32.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.252+0000 7f6a2affd700 1 -- 172.21.15.84:0/325662613 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a2c0c92d0 msgr2=0x7f6a2c152f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:32.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.252+0000 7f6a2affd700 1 --2- 172.21.15.84:0/325662613 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a2c0c92d0 0x7f6a2c152f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:32.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.252+0000 7f6a2affd700 1 -- 172.21.15.84:0/325662613 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a2c0adea0 msgr2=0x7f6a2c0b18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:32.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.252+0000 7f6a2affd700 1 --2- 172.21.15.84:0/325662613 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a2c0adea0 0x7f6a2c0b18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:32.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.252+0000 7f6a2affd700 1 -- 172.21.15.84:0/325662613 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a1c0094a0 con 0x7f6a2c0b12f0 2023-07-14T11:15:32.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.252+0000 7f6a2bfff700 1 --2- 172.21.15.84:0/325662613 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a2c0c92d0 0x7f6a2c152f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:15:32.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.252+0000 7f6a2b7fe700 1 --2- 172.21.15.84:0/325662613 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a2c0adea0 0x7f6a2c0b18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:15:32.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.252+0000 7f6a2affd700 1 --2- 172.21.15.84:0/325662613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a2c0b12f0 0x7f6a2c0b35a0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f6a200011e0 tx=0x7f6a2000cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:32.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.252+0000 7f6a13fff700 1 -- 172.21.15.84:0/325662613 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a20004c80 con 0x7f6a2c0b12f0 2023-07-14T11:15:32.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.252+0000 7f6a13fff700 1 -- 172.21.15.84:0/325662613 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a20004e00 con 0x7f6a2c0b12f0 2023-07-14T11:15:32.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.252+0000 7f6a13fff700 1 -- 172.21.15.84:0/325662613 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a20007310 con 0x7f6a2c0b12f0 2023-07-14T11:15:32.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.252+0000 7f6a31bff700 1 -- 172.21.15.84:0/325662613 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a2c15aac0 con 0x7f6a2c0b12f0 2023-07-14T11:15:32.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.252+0000 7f6a31bff700 1 -- 172.21.15.84:0/325662613 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a2c0b3ae0 con 0x7f6a2c0b12f0 2023-07-14T11:15:32.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.253+0000 7f6a31bff700 1 -- 172.21.15.84:0/325662613 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a2c15b2c0 con 0x7f6a2c0b12f0 2023-07-14T11:15:32.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.254+0000 7f6a13fff700 1 -- 172.21.15.84:0/325662613 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 7) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f6a20007470 con 0x7f6a2c0b12f0 2023-07-14T11:15:32.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.255+0000 7f6a13fff700 1 --2- 172.21.15.84:0/325662613 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6a1806ae90 0x7f6a1806d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:32.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.255+0000 7f6a13fff700 1 -- 172.21.15.84:0/325662613 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6a20089580 con 0x7f6a2c0b12f0 2023-07-14T11:15:32.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.255+0000 7f6a2b7fe700 1 --2- 172.21.15.84:0/325662613 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6a1806ae90 0x7f6a1806d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:32.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.256+0000 7f6a2b7fe700 1 --2- 172.21.15.84:0/325662613 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6a1806ae90 0x7f6a1806d340 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c0090b0 tx=0x7f6a1c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:32.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.259+0000 7f6a13fff700 1 -- 172.21.15.84:0/325662613 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f6a2c15b2c0 con 0x7f6a2c0b12f0 2023-07-14T11:15:32.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.468+0000 7f6a31bff700 1 -- 172.21.15.84:0/325662613 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6a2c15b2c0 con 0x7f6a2c0b12f0 2023-07-14T11:15:32.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.468+0000 7f6a13fff700 1 -- 172.21.15.84:0/325662613 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v50) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6a2c15b2c0 con 0x7f6a2c0b12f0 2023-07-14T11:15:32.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.470+0000 7f6a31bff700 1 -- 172.21.15.84:0/325662613 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6a1806ae90 msgr2=0x7f6a1806d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:32.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.470+0000 7f6a31bff700 1 --2- 172.21.15.84:0/325662613 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6a1806ae90 0x7f6a1806d340 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c0090b0 tx=0x7f6a1c008030 comp rx=0 tx=0).stop 2023-07-14T11:15:32.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.470+0000 7f6a31bff700 1 -- 172.21.15.84:0/325662613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a2c0b12f0 msgr2=0x7f6a2c0b35a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:32.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.470+0000 7f6a31bff700 1 --2- 172.21.15.84:0/325662613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a2c0b12f0 0x7f6a2c0b35a0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f6a200011e0 tx=0x7f6a2000cae0 comp rx=0 tx=0).stop 2023-07-14T11:15:32.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.471+0000 7f6a31bff700 1 -- 172.21.15.84:0/325662613 shutdown_connections 2023-07-14T11:15:32.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.471+0000 7f6a31bff700 1 --2- 172.21.15.84:0/325662613 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6a1806ae90 0x7f6a1806d340 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:32.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.471+0000 7f6a31bff700 1 --2- 172.21.15.84:0/325662613 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a2c0c92d0 0x7f6a2c152f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:32.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.471+0000 7f6a31bff700 1 --2- 172.21.15.84:0/325662613 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a2c0adea0 0x7f6a2c0b18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:32.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.471+0000 7f6a31bff700 1 --2- 172.21.15.84:0/325662613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a2c0b12f0 0x7f6a2c0b35a0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:32.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.471+0000 7f6a31bff700 1 -- 172.21.15.84:0/325662613 >> 172.21.15.84:0/325662613 conn(0x7f6a2c0b05d0 msgr2=0x7f6a2c0cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:32.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.471+0000 7f6a31bff700 1 -- 172.21.15.84:0/325662613 shutdown_connections 2023-07-14T11:15:32.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.471+0000 7f6a31bff700 1 -- 172.21.15.84:0/325662613 wait complete. 2023-07-14T11:15:32.475 INFO:teuthology.orchestra.run.smithi084.stderr:listed 0 entries 2023-07-14T11:15:32.491 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-07-14T11:15:32.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:15:32.491 DEBUG:teuthology.orchestra.run.smithi179:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-07-14T11:15:32.590 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi179.front.sepia.ceph.com 2023-07-14T11:15:32.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:15:32.591 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-14T11:15:32.638 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T11:15:32.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.831+0000 7f1579bff700 1 Processor -- start 2023-07-14T11:15:32.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.831+0000 7f1579bff700 1 -- start start 2023-07-14T11:15:32.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.832+0000 7f1579bff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f15741597c0 0x7f1574159c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:32.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.832+0000 7f1579bff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15740cdf90 con 0x7f15740cea50 2023-07-14T11:15:32.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.832+0000 7f1579bff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f157415a2f0 con 0x7f15741500d0 2023-07-14T11:15:32.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.832+0000 7f1579bff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f157415a5d0 con 0x7f15741597c0 2023-07-14T11:15:32.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.833+0000 7f1573fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f15740cea50 0x7f15740b2690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:58194/0 (socket says 172.21.15.84:58194) 2023-07-14T11:15:32.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.833+0000 7f1573fff700 1 -- 172.21.15.84:0/3779155432 learned_addr learned my addr 172.21.15.84:0/3779155432 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:15:32.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.833+0000 7f1572ffd700 1 --2- 172.21.15.84:0/3779155432 >> v2:172.21.15.179:3300/0 conn(0x7f15741597c0 0x7f1574159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:32.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.833+0000 7f15727fc700 1 -- 172.21.15.84:0/3779155432 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1908671367 0 0) 0x7f15740cdf90 con 0x7f15740cea50 2023-07-14T11:15:32.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.833+0000 7f15727fc700 1 -- 172.21.15.84:0/3779155432 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f155c0035b0 con 0x7f15740cea50 2023-07-14T11:15:32.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.833+0000 7f15727fc700 1 -- 172.21.15.84:0/3779155432 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3713282665 0 0) 0x7f157415a2f0 con 0x7f15741500d0 2023-07-14T11:15:32.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.833+0000 7f15727fc700 1 -- 172.21.15.84:0/3779155432 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15740cdf90 con 0x7f15741500d0 2023-07-14T11:15:32.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.833+0000 7f1572ffd700 1 -- 172.21.15.84:0/3779155432 >> v1:172.21.15.179:6789/0 conn(0x7f15741500d0 legacy=0x7f1574070350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:32.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.833+0000 7f1572ffd700 1 -- 172.21.15.84:0/3779155432 >> v1:172.21.15.84:6789/0 conn(0x7f15740cea50 legacy=0x7f15740b2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:32.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.833+0000 7f1572ffd700 1 -- 172.21.15.84:0/3779155432 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15740ce250 con 0x7f15741597c0 2023-07-14T11:15:32.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.834+0000 7f1572ffd700 1 --2- 172.21.15.84:0/3779155432 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15741597c0 0x7f1574159c60 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f1568009840 tx=0x7f1568009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=218d88b31fddc275 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:32.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.834+0000 7f15727fc700 1 -- 172.21.15.84:0/3779155432 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1568011830 con 0x7f15741597c0 2023-07-14T11:15:32.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.834+0000 7f15727fc700 1 -- 172.21.15.84:0/3779155432 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1568011990 con 0x7f15741597c0 2023-07-14T11:15:32.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.834+0000 7f15727fc700 1 -- 172.21.15.84:0/3779155432 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1568011d20 con 0x7f15741597c0 2023-07-14T11:15:32.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.834+0000 7f1579bff700 1 -- 172.21.15.84:0/3779155432 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15741597c0 msgr2=0x7f1574159c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:32.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.834+0000 7f1579bff700 1 --2- 172.21.15.84:0/3779155432 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15741597c0 0x7f1574159c60 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f1568009840 tx=0x7f1568009b50 comp rx=0 tx=0).stop 2023-07-14T11:15:32.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.834+0000 7f1579bff700 1 -- 172.21.15.84:0/3779155432 shutdown_connections 2023-07-14T11:15:32.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.834+0000 7f1579bff700 1 --2- 172.21.15.84:0/3779155432 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15741597c0 0x7f1574159c60 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:32.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.834+0000 7f1579bff700 1 -- 172.21.15.84:0/3779155432 >> 172.21.15.84:0/3779155432 conn(0x7f1574069f30 msgr2=0x7f157406a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:32.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.835+0000 7f1579bff700 1 -- 172.21.15.84:0/3779155432 shutdown_connections 2023-07-14T11:15:32.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.835+0000 7f1579bff700 1 -- 172.21.15.84:0/3779155432 wait complete. 2023-07-14T11:15:32.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.836+0000 7f1579bff700 1 Processor -- start 2023-07-14T11:15:32.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.836+0000 7f1579bff700 1 -- start start 2023-07-14T11:15:32.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.837+0000 7f1579bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15740cea50 0x7f1574158470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:32.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.837+0000 7f1579bff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15741500d0 0x7f15740cbc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:32.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.837+0000 7f1579bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15741597c0 0x7f15741489a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:32.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.837+0000 7f1579bff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15740cc6c0 con 0x7f15741500d0 2023-07-14T11:15:32.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.837+0000 7f1579bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15740cc9a0 con 0x7f15740cea50 2023-07-14T11:15:32.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.837+0000 7f1579bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15740ccc80 con 0x7f15741597c0 2023-07-14T11:15:32.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.838+0000 7f1572ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15741500d0 0x7f15740cbc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:32.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.838+0000 7f1572ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15741500d0 0x7f15740cbc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37506/0 (socket says 172.21.15.84:37506) 2023-07-14T11:15:32.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.838+0000 7f1572ffd700 1 -- 172.21.15.84:0/3815278318 learned_addr learned my addr 172.21.15.84:0/3815278318 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:32.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.838+0000 7f15737fe700 1 --2- 172.21.15.84:0/3815278318 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15740cea50 0x7f1574158470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:32.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.838+0000 7f1573fff700 1 --2- 172.21.15.84:0/3815278318 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15741597c0 0x7f15741489a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:32.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.838+0000 7f1572ffd700 1 -- 172.21.15.84:0/3815278318 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15741597c0 msgr2=0x7f15741489a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:32.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.838+0000 7f1572ffd700 1 --2- 172.21.15.84:0/3815278318 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15741597c0 0x7f15741489a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:32.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.838+0000 7f1572ffd700 1 -- 172.21.15.84:0/3815278318 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15740cea50 msgr2=0x7f1574158470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:32.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.838+0000 7f1572ffd700 1 --2- 172.21.15.84:0/3815278318 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15740cea50 0x7f1574158470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:32.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.838+0000 7f1572ffd700 1 -- 172.21.15.84:0/3815278318 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15680094a0 con 0x7f15741500d0 2023-07-14T11:15:32.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.839+0000 7f1572ffd700 1 --2- 172.21.15.84:0/3815278318 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15741500d0 0x7f15740cbc90 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f1568014040 tx=0x7f1568004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:32.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.839+0000 7f155bfff700 1 -- 172.21.15.84:0/3815278318 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f156801a6e0 con 0x7f15741500d0 2023-07-14T11:15:32.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.839+0000 7f155bfff700 1 -- 172.21.15.84:0/3815278318 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f156801a840 con 0x7f15741500d0 2023-07-14T11:15:32.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.839+0000 7f1579bff700 1 -- 172.21.15.84:0/3815278318 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15740ccf60 con 0x7f15741500d0 2023-07-14T11:15:32.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.839+0000 7f155bfff700 1 -- 172.21.15.84:0/3815278318 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f156801abb0 con 0x7f15741500d0 2023-07-14T11:15:32.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.839+0000 7f1579bff700 1 -- 172.21.15.84:0/3815278318 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15740cb6c0 con 0x7f15741500d0 2023-07-14T11:15:32.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.840+0000 7f1579bff700 1 -- 172.21.15.84:0/3815278318 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15740cd480 con 0x7f15741500d0 2023-07-14T11:15:32.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.841+0000 7f155bfff700 1 -- 172.21.15.84:0/3815278318 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 7) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f1568022070 con 0x7f15741500d0 2023-07-14T11:15:32.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.842+0000 7f155bfff700 1 --2- 172.21.15.84:0/3815278318 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f156006ae90 0x7f156006d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:32.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.842+0000 7f155bfff700 1 -- 172.21.15.84:0/3815278318 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f156808a720 con 0x7f15741500d0 2023-07-14T11:15:32.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.843+0000 7f15737fe700 1 --2- 172.21.15.84:0/3815278318 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f156006ae90 0x7f156006d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:32.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.843+0000 7f15737fe700 1 --2- 172.21.15.84:0/3815278318 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f156006ae90 0x7f156006d340 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f15640011e0 tx=0x7f1564009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:32.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:32.847+0000 7f155bfff700 1 -- 172.21.15.84:0/3815278318 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f15740cd480 con 0x7f15741500d0 2023-07-14T11:15:33.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.085+0000 7f1579bff700 1 -- 172.21.15.84:0/3815278318 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f15740cd480 con 0x7f15741500d0 2023-07-14T11:15:33.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.086+0000 7f155bfff700 1 -- 172.21.15.84:0/3815278318 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+4712 (secure 0 0 0) 0x7f15740cd480 con 0x7f15741500d0 2023-07-14T11:15:33.088 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:15:33.088 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5030,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3551222138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3551222138},{"type":"v1","addr":"172.21.15.179:6834","nonce":3551222138}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5036,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/1316665435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1316665435},{"type":"v1","addr":"172.21.15.84:6836","nonce":1316665435}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5416,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/611235750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":611235750},{"type":"v1","addr":"172.21.15.179:6835","nonce":611235750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T11:15:10.408480+0000","modified":"2023-07-14T11:15:13.936541+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5625},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5625":{"gid":5625,"name":"c","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/2672133286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":2672133286},{"type":"v1","addr":"172.21.15.84:6837","nonce":2672133286}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-14T11:15:33.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.088+0000 7f1579bff700 1 -- 172.21.15.84:0/3815278318 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f156006ae90 msgr2=0x7f156006d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:33.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.088+0000 7f1579bff700 1 --2- 172.21.15.84:0/3815278318 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f156006ae90 0x7f156006d340 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f15640011e0 tx=0x7f1564009040 comp rx=0 tx=0).stop 2023-07-14T11:15:33.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.088+0000 7f1579bff700 1 -- 172.21.15.84:0/3815278318 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15741500d0 msgr2=0x7f15740cbc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:33.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.088+0000 7f1579bff700 1 --2- 172.21.15.84:0/3815278318 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15741500d0 0x7f15740cbc90 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f1568014040 tx=0x7f1568004750 comp rx=0 tx=0).stop 2023-07-14T11:15:33.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.088+0000 7f1579bff700 1 -- 172.21.15.84:0/3815278318 shutdown_connections 2023-07-14T11:15:33.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.088+0000 7f1579bff700 1 --2- 172.21.15.84:0/3815278318 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f156006ae90 0x7f156006d340 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:33.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.088+0000 7f1579bff700 1 --2- 172.21.15.84:0/3815278318 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15741597c0 0x7f15741489a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:33.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.088+0000 7f1579bff700 1 --2- 172.21.15.84:0/3815278318 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15740cea50 0x7f1574158470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:33.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.088+0000 7f1579bff700 1 --2- 172.21.15.84:0/3815278318 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15741500d0 0x7f15740cbc90 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:33.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.088+0000 7f1579bff700 1 -- 172.21.15.84:0/3815278318 >> 172.21.15.84:0/3815278318 conn(0x7f1574069f30 msgr2=0x7f1574151640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:33.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.088+0000 7f1579bff700 1 -- 172.21.15.84:0/3815278318 shutdown_connections 2023-07-14T11:15:33.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.088+0000 7f1579bff700 1 -- 172.21.15.84:0/3815278318 wait complete. 2023-07-14T11:15:33.092 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 28 2023-07-14T11:15:33.108 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2023-07-14T11:15:33.327 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2023-07-14T11:15:33.327 DEBUG:tasks.cephfs.filesystem:_json_asok output [] 2023-07-14T11:15:33.328 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvolume_0000000000378201 2023-07-14T11:15:33.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.525+0000 7fdcd6fff700 1 Processor -- start 2023-07-14T11:15:33.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.525+0000 7fdcd6fff700 1 -- start start 2023-07-14T11:15:33.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.526+0000 7fdcd6fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdcd015c860 0x7fdcd00d1e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:33.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.526+0000 7fdcd6fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fdcd00cf2a0 0x7fdcd00c6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:33.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.526+0000 7fdcd6fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdcd00c6fe0 0x7fdcd00c7460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:33.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.526+0000 7fdcd6fff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcd0146740 con 0x7fdcd00c6fe0 2023-07-14T11:15:33.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.526+0000 7fdcd6fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcd00cf710 con 0x7fdcd00cf2a0 2023-07-14T11:15:33.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.526+0000 7fdcd6fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd00cd5a0 con 0x7fdcd015c860 2023-07-14T11:15:33.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.527+0000 7fdcd559c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdcd00c6fe0 0x7fdcd00c7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:33.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.527+0000 7fdcd559c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdcd00c6fe0 0x7fdcd00c7460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37516/0 (socket says 172.21.15.84:37516) 2023-07-14T11:15:33.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.527+0000 7fdcd559c700 1 -- 172.21.15.84:0/4248241984 learned_addr learned my addr 172.21.15.84:0/4248241984 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:33.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.527+0000 7fdccffff700 1 --2- 172.21.15.84:0/4248241984 >> v2:172.21.15.179:3300/0 conn(0x7fdcd00cf2a0 0x7fdcd00c6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:33.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.527+0000 7fdcd4d9b700 1 --2- 172.21.15.84:0/4248241984 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdcd015c860 0x7fdcd00d1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:33.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.527+0000 7fdcd559c700 1 -- 172.21.15.84:0/4248241984 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdcd015c860 msgr2=0x7fdcd00d1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:33.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.527+0000 7fdcd559c700 1 --2- 172.21.15.84:0/4248241984 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdcd015c860 0x7fdcd00d1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:33.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.527+0000 7fdcd559c700 1 -- 172.21.15.84:0/4248241984 >> v2:172.21.15.179:3300/0 conn(0x7fdcd00cf2a0 msgr2=0x7fdcd00c6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:33.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.527+0000 7fdcd559c700 1 --2- 172.21.15.84:0/4248241984 >> v2:172.21.15.179:3300/0 conn(0x7fdcd00cf2a0 0x7fdcd00c6aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:33.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.527+0000 7fdcd559c700 1 -- 172.21.15.84:0/4248241984 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd00cd7f0 con 0x7fdcd00c6fe0 2023-07-14T11:15:33.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.528+0000 7fdcd559c700 1 --2- 172.21.15.84:0/4248241984 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdcd00c6fe0 0x7fdcd00c7460 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fdcd006bc50 tx=0x7fdcc800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=157da1257fc823b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:33.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.528+0000 7fdccf7fe700 1 -- 172.21.15.84:0/4248241984 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc800e070 con 0x7fdcd00c6fe0 2023-07-14T11:15:33.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.528+0000 7fdccf7fe700 1 -- 172.21.15.84:0/4248241984 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcc800b910 con 0x7fdcd00c6fe0 2023-07-14T11:15:33.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.528+0000 7fdccf7fe700 1 -- 172.21.15.84:0/4248241984 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc800bcc0 con 0x7fdcd00c6fe0 2023-07-14T11:15:33.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.528+0000 7fdcd6fff700 1 -- 172.21.15.84:0/4248241984 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdcd00c6fe0 msgr2=0x7fdcd00c7460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:33.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.528+0000 7fdcd6fff700 1 --2- 172.21.15.84:0/4248241984 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdcd00c6fe0 0x7fdcd00c7460 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fdcd006bc50 tx=0x7fdcc800b330 comp rx=0 tx=0).stop 2023-07-14T11:15:33.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.528+0000 7fdcd6fff700 1 -- 172.21.15.84:0/4248241984 shutdown_connections 2023-07-14T11:15:33.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.528+0000 7fdcd6fff700 1 --2- 172.21.15.84:0/4248241984 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdcd015c860 0x7fdcd00d1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:33.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.528+0000 7fdcd6fff700 1 --2- 172.21.15.84:0/4248241984 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdcd00c6fe0 0x7fdcd00c7460 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:33.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.528+0000 7fdcd6fff700 1 --2- 172.21.15.84:0/4248241984 >> v2:172.21.15.179:3300/0 conn(0x7fdcd00cf2a0 0x7fdcd00c6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:33.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.528+0000 7fdcd6fff700 1 -- 172.21.15.84:0/4248241984 >> 172.21.15.84:0/4248241984 conn(0x7fdcd0065bd0 msgr2=0x7fdcd0065fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:33.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.528+0000 7fdcd6fff700 1 -- 172.21.15.84:0/4248241984 shutdown_connections 2023-07-14T11:15:33.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.529+0000 7fdcd6fff700 1 -- 172.21.15.84:0/4248241984 wait complete. 2023-07-14T11:15:33.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.531+0000 7fdcd6fff700 1 Processor -- start 2023-07-14T11:15:33.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.531+0000 7fdcd6fff700 1 -- start start 2023-07-14T11:15:33.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.532+0000 7fdcd6fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdcd00c6fe0 0x7fdcd015cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:33.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.532+0000 7fdcd6fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdcd00cf2a0 0x7fdcd00b7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:33.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.532+0000 7fdcd6fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdcd015c860 0x7fdcd01f16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:33.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.532+0000 7fdcd6fff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd00ca020 con 0x7fdcd00cf2a0 2023-07-14T11:15:33.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.532+0000 7fdcd6fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd00b8c10 con 0x7fdcd015c860 2023-07-14T11:15:33.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.532+0000 7fdcd6fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd00b7fe0 con 0x7fdcd00c6fe0 2023-07-14T11:15:33.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.532+0000 7fdccffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdcd00cf2a0 0x7fdcd00b7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:33.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.533+0000 7fdccffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdcd00cf2a0 0x7fdcd00b7aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37522/0 (socket says 172.21.15.84:37522) 2023-07-14T11:15:33.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.533+0000 7fdccffff700 1 -- 172.21.15.84:0/2228969093 learned_addr learned my addr 172.21.15.84:0/2228969093 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:33.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.533+0000 7fdcd4d9b700 1 --2- 172.21.15.84:0/2228969093 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdcd00c6fe0 0x7fdcd015cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:33.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.533+0000 7fdccffff700 1 -- 172.21.15.84:0/2228969093 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdcd00c6fe0 msgr2=0x7fdcd015cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:33.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.533+0000 7fdcd559c700 1 --2- 172.21.15.84:0/2228969093 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdcd015c860 0x7fdcd01f16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:33.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.533+0000 7fdccffff700 1 --2- 172.21.15.84:0/2228969093 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdcd00c6fe0 0x7fdcd015cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:33.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.533+0000 7fdccffff700 1 -- 172.21.15.84:0/2228969093 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdcd015c860 msgr2=0x7fdcd01f16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:33.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.533+0000 7fdccffff700 1 --2- 172.21.15.84:0/2228969093 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdcd015c860 0x7fdcd01f16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:33.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.533+0000 7fdccffff700 1 -- 172.21.15.84:0/2228969093 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc8009b30 con 0x7fdcd00cf2a0 2023-07-14T11:15:33.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.533+0000 7fdcd4d9b700 1 --2- 172.21.15.84:0/2228969093 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdcd00c6fe0 0x7fdcd015cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:15:33.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.533+0000 7fdcd559c700 1 --2- 172.21.15.84:0/2228969093 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdcd015c860 0x7fdcd01f16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:15:33.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.533+0000 7fdccffff700 1 --2- 172.21.15.84:0/2228969093 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdcd00cf2a0 0x7fdcd00b7aa0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc00e930 tx=0x7fdcbc00ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:33.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.533+0000 7fdccd7fa700 1 -- 172.21.15.84:0/2228969093 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc009690 con 0x7fdcd00cf2a0 2023-07-14T11:15:33.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.533+0000 7fdccd7fa700 1 -- 172.21.15.84:0/2228969093 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcbc00c850 con 0x7fdcd00cf2a0 2023-07-14T11:15:33.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.533+0000 7fdccd7fa700 1 -- 172.21.15.84:0/2228969093 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc00cbe0 con 0x7fdcd00cf2a0 2023-07-14T11:15:33.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.533+0000 7fdcd6fff700 1 -- 172.21.15.84:0/2228969093 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcd00cab30 con 0x7fdcd00cf2a0 2023-07-14T11:15:33.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.534+0000 7fdcd6fff700 1 -- 172.21.15.84:0/2228969093 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcd00ca4e0 con 0x7fdcd00cf2a0 2023-07-14T11:15:33.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.534+0000 7fdcd6fff700 1 -- 172.21.15.84:0/2228969093 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcd00cacc0 con 0x7fdcd00cf2a0 2023-07-14T11:15:33.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.535+0000 7fdccd7fa700 1 -- 172.21.15.84:0/2228969093 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 7) v1 ==== 89190+0+0 (secure 0 0 0) 0x7fdcbc00cd40 con 0x7fdcd00cf2a0 2023-07-14T11:15:33.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.537+0000 7fdccd7fa700 1 --2- 172.21.15.84:0/2228969093 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fdcb406ae90 0x7fdcb406d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:33.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.537+0000 7fdccd7fa700 1 -- 172.21.15.84:0/2228969093 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdcbc089890 con 0x7fdcd00cf2a0 2023-07-14T11:15:33.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.537+0000 7fdcd4d9b700 1 --2- 172.21.15.84:0/2228969093 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fdcb406ae90 0x7fdcb406d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:33.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.537+0000 7fdcd4d9b700 1 --2- 172.21.15.84:0/2228969093 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fdcb406ae90 0x7fdcb406d340 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fdcc4009ac0 tx=0x7fdcc4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:33.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.541+0000 7fdccd7fa700 1 -- 172.21.15.84:0/2228969093 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fdcbc0546c0 con 0x7fdcd00cf2a0 2023-07-14T11:15:33.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.766+0000 7fdcd6fff700 1 -- 172.21.15.84:0/2228969093 --> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_0000000000378201", "target": ["mon-mgr", ""]}) v1 -- 0x7fdcd00d1640 con 0x7fdcb406ae90 2023-07-14T11:15:33.775 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:15:33.773+0000 7fed0d3be700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T11:15:33.775 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:15:33.773+0000 7fed0d3be700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T11:15:33.775 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:15:33.773+0000 7fed0d3be700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T11:15:33.775 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:15:33.773+0000 7fed0d3be700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T11:15:33.775 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:15:33.773+0000 7fed0d3be700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T11:15:33.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.810+0000 7fdccd7fa700 1 -- 172.21.15.84:0/2228969093 <== mgr.4104 v2:172.21.15.84:6832/379617029 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fdcc4004020 con 0x7fdcb406ae90 2023-07-14T11:15:33.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.812+0000 7fdcd6fff700 1 -- 172.21.15.84:0/2228969093 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fdcb406ae90 msgr2=0x7fdcb406d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:33.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.812+0000 7fdcd6fff700 1 --2- 172.21.15.84:0/2228969093 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fdcb406ae90 0x7fdcb406d340 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fdcc4009ac0 tx=0x7fdcc4008040 comp rx=0 tx=0).stop 2023-07-14T11:15:33.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.812+0000 7fdcd6fff700 1 -- 172.21.15.84:0/2228969093 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdcd00cf2a0 msgr2=0x7fdcd00b7aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:33.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.812+0000 7fdcd6fff700 1 --2- 172.21.15.84:0/2228969093 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdcd00cf2a0 0x7fdcd00b7aa0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc00e930 tx=0x7fdcbc00ecf0 comp rx=0 tx=0).stop 2023-07-14T11:15:33.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.812+0000 7fdcd6fff700 1 -- 172.21.15.84:0/2228969093 shutdown_connections 2023-07-14T11:15:33.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.812+0000 7fdcd6fff700 1 --2- 172.21.15.84:0/2228969093 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fdcb406ae90 0x7fdcb406d340 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:33.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.812+0000 7fdcd6fff700 1 --2- 172.21.15.84:0/2228969093 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdcd00c6fe0 0x7fdcd015cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:33.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.812+0000 7fdcd6fff700 1 --2- 172.21.15.84:0/2228969093 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdcd015c860 0x7fdcd01f16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:33.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.812+0000 7fdcd6fff700 1 --2- 172.21.15.84:0/2228969093 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdcd00cf2a0 0x7fdcd00b7aa0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:33.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.812+0000 7fdcd6fff700 1 -- 172.21.15.84:0/2228969093 >> 172.21.15.84:0/2228969093 conn(0x7fdcd0065bd0 msgr2=0x7fdcd00d3880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:33.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.813+0000 7fdcd6fff700 1 -- 172.21.15.84:0/2228969093 shutdown_connections 2023-07-14T11:15:33.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:33.813+0000 7fdcd6fff700 1 -- 172.21.15.84:0/2228969093 wait complete. 2023-07-14T11:15:33.832 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T11:15:34.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.027+0000 7fa44f5ff700 1 Processor -- start 2023-07-14T11:15:34.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.028+0000 7fa44f5ff700 1 -- start start 2023-07-14T11:15:34.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.029+0000 7fa44f5ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa4480d1220 0x7fa4480b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:34.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.029+0000 7fa44f5ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa4480b1e00 0x7fa4480afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:34.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.029+0000 7fa44f5ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4480d2ce0 con 0x7fa44815c950 2023-07-14T11:15:34.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.029+0000 7fa44f5ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4480b3350 con 0x7fa4480d1220 2023-07-14T11:15:34.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.029+0000 7fa44f5ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4480b3630 con 0x7fa4480b1e00 2023-07-14T11:15:34.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.029+0000 7fa44cb9a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa4480d1220 0x7fa4480b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:34.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.029+0000 7fa44d39b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fa44815c950 0x7fa4480d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:58198/0 (socket says 172.21.15.84:58198) 2023-07-14T11:15:34.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.029+0000 7fa44d39b700 1 -- 172.21.15.84:0/2759397696 learned_addr learned my addr 172.21.15.84:0/2759397696 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:15:34.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.029+0000 7fa44db9c700 1 --2- 172.21.15.84:0/2759397696 >> v2:172.21.15.179:3300/0 conn(0x7fa4480b1e00 0x7fa4480afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:34.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.029+0000 7fa43ffff700 1 -- 172.21.15.84:0/2759397696 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 122879333 0 0) 0x7fa4480d2ce0 con 0x7fa44815c950 2023-07-14T11:15:34.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.029+0000 7fa43ffff700 1 -- 172.21.15.84:0/2759397696 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4340035b0 con 0x7fa44815c950 2023-07-14T11:15:34.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.029+0000 7fa44cb9a700 1 -- 172.21.15.84:0/2759397696 >> v2:172.21.15.179:3300/0 conn(0x7fa4480b1e00 msgr2=0x7fa4480afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:34.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.029+0000 7fa44cb9a700 1 --2- 172.21.15.84:0/2759397696 >> v2:172.21.15.179:3300/0 conn(0x7fa4480b1e00 0x7fa4480afac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:34.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.030+0000 7fa44cb9a700 1 -- 172.21.15.84:0/2759397696 >> v1:172.21.15.84:6789/0 conn(0x7fa44815c950 legacy=0x7fa4480d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:34.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.030+0000 7fa44cb9a700 1 -- 172.21.15.84:0/2759397696 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4480b3910 con 0x7fa4480d1220 2023-07-14T11:15:34.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.030+0000 7fa44cb9a700 1 --2- 172.21.15.84:0/2759397696 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4480d1220 0x7fa4480b43f0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fa44808c300 tx=0x7fa438009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=925400bac8aa48b2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:34.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.030+0000 7fa43ffff700 1 -- 172.21.15.84:0/2759397696 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa438011830 con 0x7fa4480d1220 2023-07-14T11:15:34.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.030+0000 7fa43ffff700 1 -- 172.21.15.84:0/2759397696 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa438011990 con 0x7fa4480d1220 2023-07-14T11:15:34.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.030+0000 7fa43ffff700 1 -- 172.21.15.84:0/2759397696 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa438011d20 con 0x7fa4480d1220 2023-07-14T11:15:34.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.030+0000 7fa44f5ff700 1 -- 172.21.15.84:0/2759397696 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4480d1220 msgr2=0x7fa4480b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:34.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.030+0000 7fa44f5ff700 1 --2- 172.21.15.84:0/2759397696 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4480d1220 0x7fa4480b43f0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fa44808c300 tx=0x7fa438009b20 comp rx=0 tx=0).stop 2023-07-14T11:15:34.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.031+0000 7fa44f5ff700 1 -- 172.21.15.84:0/2759397696 shutdown_connections 2023-07-14T11:15:34.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.031+0000 7fa44f5ff700 1 --2- 172.21.15.84:0/2759397696 >> v2:172.21.15.179:3300/0 conn(0x7fa4480b1e00 0x7fa4480afac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:34.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.031+0000 7fa44f5ff700 1 --2- 172.21.15.84:0/2759397696 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4480d1220 0x7fa4480b43f0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:34.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.031+0000 7fa44f5ff700 1 -- 172.21.15.84:0/2759397696 >> 172.21.15.84:0/2759397696 conn(0x7fa44809c1d0 msgr2=0x7fa4480d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:34.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.031+0000 7fa44f5ff700 1 -- 172.21.15.84:0/2759397696 shutdown_connections 2023-07-14T11:15:34.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.031+0000 7fa44f5ff700 1 -- 172.21.15.84:0/2759397696 wait complete. 2023-07-14T11:15:34.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.032+0000 7fa44f5ff700 1 Processor -- start 2023-07-14T11:15:34.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.033+0000 7fa44f5ff700 1 -- start start 2023-07-14T11:15:34.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.034+0000 7fa44f5ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4480b1e00 0x7fa4480cba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:34.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.034+0000 7fa44f5ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4480d1220 0x7fa44815a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:34.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.034+0000 7fa44f5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa44815c950 0x7fa4480ce1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:34.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.034+0000 7fa44f5ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4480cbfb0 con 0x7fa4480b1e00 2023-07-14T11:15:34.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.034+0000 7fa44f5ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa44815b700 con 0x7fa4480d1220 2023-07-14T11:15:34.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.034+0000 7fa44f5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4480ccd60 con 0x7fa44815c950 2023-07-14T11:15:34.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.034+0000 7fa44d39b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4480b1e00 0x7fa4480cba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:34.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.034+0000 7fa44d39b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4480b1e00 0x7fa4480cba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37554/0 (socket says 172.21.15.84:37554) 2023-07-14T11:15:34.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.034+0000 7fa44d39b700 1 -- 172.21.15.84:0/3375496071 learned_addr learned my addr 172.21.15.84:0/3375496071 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:34.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.034+0000 7fa44cb9a700 1 --2- 172.21.15.84:0/3375496071 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4480d1220 0x7fa44815a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:34.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.034+0000 7fa44db9c700 1 --2- 172.21.15.84:0/3375496071 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa44815c950 0x7fa4480ce1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:34.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.034+0000 7fa44d39b700 1 -- 172.21.15.84:0/3375496071 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa44815c950 msgr2=0x7fa4480ce1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:34.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.034+0000 7fa44d39b700 1 --2- 172.21.15.84:0/3375496071 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa44815c950 0x7fa4480ce1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:34.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.034+0000 7fa44d39b700 1 -- 172.21.15.84:0/3375496071 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4480d1220 msgr2=0x7fa44815a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:34.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.034+0000 7fa44d39b700 1 --2- 172.21.15.84:0/3375496071 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4480d1220 0x7fa44815a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:34.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.034+0000 7fa44d39b700 1 -- 172.21.15.84:0/3375496071 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4380094a0 con 0x7fa4480b1e00 2023-07-14T11:15:34.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.035+0000 7fa44d39b700 1 --2- 172.21.15.84:0/3375496071 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4480b1e00 0x7fa4480cba70 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fa444001260 tx=0x7fa44400c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:34.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.035+0000 7fa43dffb700 1 -- 172.21.15.84:0/3375496071 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4440074e0 con 0x7fa4480b1e00 2023-07-14T11:15:34.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.035+0000 7fa43dffb700 1 -- 172.21.15.84:0/3375496071 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa444007640 con 0x7fa4480b1e00 2023-07-14T11:15:34.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.035+0000 7fa43dffb700 1 -- 172.21.15.84:0/3375496071 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa444005a50 con 0x7fa4480b1e00 2023-07-14T11:15:34.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.035+0000 7fa44f5ff700 1 -- 172.21.15.84:0/3375496071 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4480cd6f0 con 0x7fa4480b1e00 2023-07-14T11:15:34.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.035+0000 7fa44f5ff700 1 -- 172.21.15.84:0/3375496071 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4480cdcb0 con 0x7fa4480b1e00 2023-07-14T11:15:34.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.036+0000 7fa44f5ff700 1 -- 172.21.15.84:0/3375496071 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4480cd550 con 0x7fa4480b1e00 2023-07-14T11:15:34.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.037+0000 7fa43dffb700 1 -- 172.21.15.84:0/3375496071 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 7) v1 ==== 89190+0+0 (secure 0 0 0) 0x7fa444005bb0 con 0x7fa4480b1e00 2023-07-14T11:15:34.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.038+0000 7fa43dffb700 1 --2- 172.21.15.84:0/3375496071 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa42c06ae90 0x7fa42c06d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:34.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.038+0000 7fa43dffb700 1 -- 172.21.15.84:0/3375496071 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa444088c50 con 0x7fa4480b1e00 2023-07-14T11:15:34.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.038+0000 7fa44cb9a700 1 --2- 172.21.15.84:0/3375496071 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa42c06ae90 0x7fa42c06d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:34.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.039+0000 7fa44cb9a700 1 --2- 172.21.15.84:0/3375496071 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa42c06ae90 0x7fa42c06d340 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa4480d1610 tx=0x7fa438008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:34.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.042+0000 7fa43dffb700 1 -- 172.21.15.84:0/3375496071 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fa4480cd550 con 0x7fa4480b1e00 2023-07-14T11:15:34.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.280+0000 7fa44f5ff700 1 -- 172.21.15.84:0/3375496071 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa4480cd520 con 0x7fa4480b1e00 2023-07-14T11:15:34.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.280+0000 7fa43dffb700 1 -- 172.21.15.84:0/3375496071 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+4712 (secure 0 0 0) 0x7fa444017090 con 0x7fa4480b1e00 2023-07-14T11:15:34.283 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:15:34.283 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5030,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3551222138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3551222138},{"type":"v1","addr":"172.21.15.179:6834","nonce":3551222138}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5036,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/1316665435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1316665435},{"type":"v1","addr":"172.21.15.84:6836","nonce":1316665435}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5416,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/611235750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":611235750},{"type":"v1","addr":"172.21.15.179:6835","nonce":611235750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T11:15:10.408480+0000","modified":"2023-07-14T11:15:13.936541+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5625},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5625":{"gid":5625,"name":"c","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/2672133286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":2672133286},{"type":"v1","addr":"172.21.15.84:6837","nonce":2672133286}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-14T11:15:34.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.282+0000 7fa44f5ff700 1 -- 172.21.15.84:0/3375496071 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa42c06ae90 msgr2=0x7fa42c06d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:34.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.282+0000 7fa44f5ff700 1 --2- 172.21.15.84:0/3375496071 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa42c06ae90 0x7fa42c06d340 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa4480d1610 tx=0x7fa438008030 comp rx=0 tx=0).stop 2023-07-14T11:15:34.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.283+0000 7fa44f5ff700 1 -- 172.21.15.84:0/3375496071 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4480b1e00 msgr2=0x7fa4480cba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:34.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.283+0000 7fa44f5ff700 1 --2- 172.21.15.84:0/3375496071 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4480b1e00 0x7fa4480cba70 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fa444001260 tx=0x7fa44400c7b0 comp rx=0 tx=0).stop 2023-07-14T11:15:34.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.283+0000 7fa44f5ff700 1 -- 172.21.15.84:0/3375496071 shutdown_connections 2023-07-14T11:15:34.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.283+0000 7fa44f5ff700 1 --2- 172.21.15.84:0/3375496071 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa42c06ae90 0x7fa42c06d340 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:34.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.283+0000 7fa44f5ff700 1 --2- 172.21.15.84:0/3375496071 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa44815c950 0x7fa4480ce1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:34.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.283+0000 7fa44f5ff700 1 --2- 172.21.15.84:0/3375496071 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4480b1e00 0x7fa4480cba70 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:34.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.283+0000 7fa44f5ff700 1 --2- 172.21.15.84:0/3375496071 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4480d1220 0x7fa44815a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:34.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.283+0000 7fa44f5ff700 1 -- 172.21.15.84:0/3375496071 >> 172.21.15.84:0/3375496071 conn(0x7fa44809c1d0 msgr2=0x7fa44806bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:34.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.283+0000 7fa44f5ff700 1 -- 172.21.15.84:0/3375496071 shutdown_connections 2023-07-14T11:15:34.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.283+0000 7fa44f5ff700 1 -- 172.21.15.84:0/3375496071 wait complete. 2023-07-14T11:15:34.287 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 28 2023-07-14T11:15:34.303 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2023-07-14T11:15:34.520 INFO:teuthology.orchestra.run.smithi084.stdout:[{"id":5925,"entity":{"name":{"type":"client","num":5925},"addr":{"type":"any","addr":"172.21.15.84:0","nonce":3353249595}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":14,"uptime":0.72898640199999998,"requests_in_flight":2,"num_completed_requests":0,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":21.963626695961878,"halflife":300},"cap_acquisition":{"value":0,"halflife":10},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5925 172.21.15.84:0/3353249595","completed_requests":[],"prealloc_inos":[{"start":"0x10000000005","length":996}],"client_metadata":{"client_features":{"feature_bits":"0x00000000000fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"3fc0089cc1082313a98853d48b892acdc1385b8b","ceph_version":"ceph version 18.0.0-4757-g3fc0089c (3fc0089cc1082313a98853d48b892acdc1385b8b) reef (dev)","entity_id":"y","hostname":"smithi084","pid":"140843","root":"/"}}] 2023-07-14T11:15:34.521 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 10, "value": 0 }, "client_metadata": { "ceph_sha1": "3fc0089cc1082313a98853d48b892acdc1385b8b", "ceph_version": "ceph version 18.0.0-4757-g3fc0089c (3fc0089cc1082313a98853d48b892acdc1385b8b) reef (dev)", "client_features": { "feature_bits": "0x00000000000fffff" }, "entity_id": "y", "hostname": "smithi084", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "140843", "root": "/" }, "completed_requests": [], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.84:0", "nonce": 3353249595, "type": "any" }, "name": { "num": 5925, "type": "client" } }, "id": 5925, "inst": "client.5925 172.21.15.84:0/3353249595", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 0, "num_leases": 1, "prealloc_inos": [ { "length": 996, "start": "0x10000000005" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 14, "requests_in_flight": 2, "session_cache_liveness": { "halflife": 300, "value": 21.963626695961878 }, "state": "open", "uptime": 0.728986402 } ] 2023-07-14T11:15:34.521 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T11:15:34.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.714+0000 7f6a519ff700 1 Processor -- start 2023-07-14T11:15:34.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.714+0000 7f6a519ff700 1 -- start start 2023-07-14T11:15:34.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.715+0000 7f6a519ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a4c0ce840 0x7f6a4c0cec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:34.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.715+0000 7f6a519ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6a4c0d0830 0x7f6a4c0d0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:34.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.716+0000 7f6a519ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a4c0cf1d0 con 0x7f6a4c15ca30 2023-07-14T11:15:34.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.716+0000 7f6a519ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a4c06cf00 con 0x7f6a4c0d0830 2023-07-14T11:15:34.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.716+0000 7f6a519ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4c06c360 con 0x7f6a4c0ce840 2023-07-14T11:15:34.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.716+0000 7f6a4b7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6a4c0d0830 0x7f6a4c0d0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:34.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.716+0000 7f6a4b7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6a4c0d0830 0x7f6a4c0d0cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37560/0 (socket says 172.21.15.84:37560) 2023-07-14T11:15:34.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.716+0000 7f6a4b7fe700 1 -- 172.21.15.84:0/3051570580 learned_addr learned my addr 172.21.15.84:0/3051570580 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:34.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.716+0000 7f6a43fff700 1 --2- 172.21.15.84:0/3051570580 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a4c0ce840 0x7f6a4c0cec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:34.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.716+0000 7f6a4b7fe700 1 -- 172.21.15.84:0/3051570580 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a4c0ce840 msgr2=0x7f6a4c0cec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:34.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.716+0000 7f6a4b7fe700 1 --2- 172.21.15.84:0/3051570580 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a4c0ce840 0x7f6a4c0cec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:34.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.716+0000 7f6a4b7fe700 1 -- 172.21.15.84:0/3051570580 >> v1:172.21.15.179:6789/0 conn(0x7f6a4c15ca30 legacy=0x7f6a4c06c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:34.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.716+0000 7f6a4b7fe700 1 -- 172.21.15.84:0/3051570580 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a4c0d11f0 con 0x7f6a4c0d0830 2023-07-14T11:15:34.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.717+0000 7f6a4b7fe700 1 --2- 172.21.15.84:0/3051570580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a4c0d0830 0x7f6a4c0d0cb0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f6a44009e50 tx=0x7f6a4400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ad655a10fc7d95f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:34.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.717+0000 7f6a4a7fc700 1 -- 172.21.15.84:0/3051570580 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4400e070 con 0x7f6a4c0d0830 2023-07-14T11:15:34.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.717+0000 7f6a4a7fc700 1 -- 172.21.15.84:0/3051570580 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a4400b9c0 con 0x7f6a4c0d0830 2023-07-14T11:15:34.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.717+0000 7f6a4a7fc700 1 -- 172.21.15.84:0/3051570580 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4400bd70 con 0x7f6a4c0d0830 2023-07-14T11:15:34.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.717+0000 7f6a519ff700 1 -- 172.21.15.84:0/3051570580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a4c0d0830 msgr2=0x7f6a4c0d0cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:34.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.717+0000 7f6a519ff700 1 --2- 172.21.15.84:0/3051570580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a4c0d0830 0x7f6a4c0d0cb0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f6a44009e50 tx=0x7f6a4400b330 comp rx=0 tx=0).stop 2023-07-14T11:15:34.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.717+0000 7f6a519ff700 1 -- 172.21.15.84:0/3051570580 shutdown_connections 2023-07-14T11:15:34.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.717+0000 7f6a519ff700 1 --2- 172.21.15.84:0/3051570580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a4c0d0830 0x7f6a4c0d0cb0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:34.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.717+0000 7f6a519ff700 1 --2- 172.21.15.84:0/3051570580 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a4c0ce840 0x7f6a4c0cec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:34.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.717+0000 7f6a519ff700 1 -- 172.21.15.84:0/3051570580 >> 172.21.15.84:0/3051570580 conn(0x7f6a4c0664f0 msgr2=0x7f6a4c099fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:34.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.717+0000 7f6a519ff700 1 -- 172.21.15.84:0/3051570580 shutdown_connections 2023-07-14T11:15:34.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.718+0000 7f6a519ff700 1 -- 172.21.15.84:0/3051570580 wait complete. 2023-07-14T11:15:34.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.719+0000 7f6a519ff700 1 Processor -- start 2023-07-14T11:15:34.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.719+0000 7f6a519ff700 1 -- start start 2023-07-14T11:15:34.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.720+0000 7f6a519ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a4c0ce840 0x7f6a4c0c9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:34.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.720+0000 7f6a519ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a4c0d0830 0x7f6a4c0c7d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:34.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.720+0000 7f6a519ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a4c15ca30 0x7f6a4c147100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:34.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.720+0000 7f6a519ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4c0c8570 con 0x7f6a4c15ca30 2023-07-14T11:15:34.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.720+0000 7f6a519ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4c0c8850 con 0x7f6a4c0d0830 2023-07-14T11:15:34.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.720+0000 7f6a519ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4c0c8b30 con 0x7f6a4c0ce840 2023-07-14T11:15:34.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.721+0000 7f6a4b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a4c15ca30 0x7f6a4c147100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:34.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.721+0000 7f6a4b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a4c15ca30 0x7f6a4c147100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37564/0 (socket says 172.21.15.84:37564) 2023-07-14T11:15:34.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.721+0000 7f6a4b7fe700 1 -- 172.21.15.84:0/599927762 learned_addr learned my addr 172.21.15.84:0/599927762 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:34.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.721+0000 7f6a43fff700 1 --2- 172.21.15.84:0/599927762 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a4c0d0830 0x7f6a4c0c7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:34.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.721+0000 7f6a4affd700 1 --2- 172.21.15.84:0/599927762 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a4c0ce840 0x7f6a4c0c9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:34.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.721+0000 7f6a4b7fe700 1 -- 172.21.15.84:0/599927762 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a4c0ce840 msgr2=0x7f6a4c0c9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:34.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.721+0000 7f6a4b7fe700 1 --2- 172.21.15.84:0/599927762 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a4c0ce840 0x7f6a4c0c9610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:34.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.721+0000 7f6a4b7fe700 1 -- 172.21.15.84:0/599927762 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a4c0d0830 msgr2=0x7f6a4c0c7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:34.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.721+0000 7f6a4b7fe700 1 --2- 172.21.15.84:0/599927762 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a4c0d0830 0x7f6a4c0c7d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:34.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.721+0000 7f6a4b7fe700 1 -- 172.21.15.84:0/599927762 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a44009b30 con 0x7f6a4c15ca30 2023-07-14T11:15:34.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.721+0000 7f6a4affd700 1 --2- 172.21.15.84:0/599927762 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a4c0ce840 0x7f6a4c0c9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:15:34.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.721+0000 7f6a4b7fe700 1 --2- 172.21.15.84:0/599927762 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a4c15ca30 0x7f6a4c147100 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c0ce7f0 tx=0x7f6a44004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:34.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.721+0000 7f6a48ff9700 1 -- 172.21.15.84:0/599927762 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a440048b0 con 0x7f6a4c15ca30 2023-07-14T11:15:34.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.722+0000 7f6a48ff9700 1 -- 172.21.15.84:0/599927762 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a440099b0 con 0x7f6a4c15ca30 2023-07-14T11:15:34.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.722+0000 7f6a48ff9700 1 -- 172.21.15.84:0/599927762 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4401b670 con 0x7f6a4c15ca30 2023-07-14T11:15:34.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.722+0000 7f6a519ff700 1 -- 172.21.15.84:0/599927762 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a4c0c8e10 con 0x7f6a4c15ca30 2023-07-14T11:15:34.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.722+0000 7f6a519ff700 1 -- 172.21.15.84:0/599927762 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a4c0c8280 con 0x7f6a4c15ca30 2023-07-14T11:15:34.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.723+0000 7f6a519ff700 1 -- 172.21.15.84:0/599927762 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a4c0cfc20 con 0x7f6a4c15ca30 2023-07-14T11:15:34.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.724+0000 7f6a48ff9700 1 -- 172.21.15.84:0/599927762 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 7) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f6a4401b7d0 con 0x7f6a4c15ca30 2023-07-14T11:15:34.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.725+0000 7f6a48ff9700 1 --2- 172.21.15.84:0/599927762 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6a2c06ae90 0x7f6a2c06d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:34.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.725+0000 7f6a48ff9700 1 -- 172.21.15.84:0/599927762 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6a4408b170 con 0x7f6a4c15ca30 2023-07-14T11:15:34.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.725+0000 7f6a4affd700 1 --2- 172.21.15.84:0/599927762 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6a2c06ae90 0x7f6a2c06d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:34.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.726+0000 7f6a4affd700 1 --2- 172.21.15.84:0/599927762 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6a2c06ae90 0x7f6a2c06d340 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c000f60 tx=0x7f6a3c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:34.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.730+0000 7f6a48ff9700 1 -- 172.21.15.84:0/599927762 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f6a44055f20 con 0x7f6a4c15ca30 2023-07-14T11:15:34.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.970+0000 7f6a519ff700 1 -- 172.21.15.84:0/599927762 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6a4c0c9330 con 0x7f6a4c15ca30 2023-07-14T11:15:34.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.970+0000 7f6a48ff9700 1 -- 172.21.15.84:0/599927762 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+4712 (secure 0 0 0) 0x7f6a4c0c9330 con 0x7f6a4c15ca30 2023-07-14T11:15:34.973 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:15:34.973 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5030,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3551222138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3551222138},{"type":"v1","addr":"172.21.15.179:6834","nonce":3551222138}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5036,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/1316665435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1316665435},{"type":"v1","addr":"172.21.15.84:6836","nonce":1316665435}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5416,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/611235750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":611235750},{"type":"v1","addr":"172.21.15.179:6835","nonce":611235750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T11:15:10.408480+0000","modified":"2023-07-14T11:15:13.936541+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5625},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5625":{"gid":5625,"name":"c","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/2672133286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":2672133286},{"type":"v1","addr":"172.21.15.84:6837","nonce":2672133286}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-14T11:15:34.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.973+0000 7f6a519ff700 1 -- 172.21.15.84:0/599927762 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6a2c06ae90 msgr2=0x7f6a2c06d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:34.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.973+0000 7f6a519ff700 1 --2- 172.21.15.84:0/599927762 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6a2c06ae90 0x7f6a2c06d340 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c000f60 tx=0x7f6a3c009040 comp rx=0 tx=0).stop 2023-07-14T11:15:34.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.973+0000 7f6a519ff700 1 -- 172.21.15.84:0/599927762 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a4c15ca30 msgr2=0x7f6a4c147100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:34.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.973+0000 7f6a519ff700 1 --2- 172.21.15.84:0/599927762 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a4c15ca30 0x7f6a4c147100 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c0ce7f0 tx=0x7f6a44004ad0 comp rx=0 tx=0).stop 2023-07-14T11:15:34.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.973+0000 7f6a519ff700 1 -- 172.21.15.84:0/599927762 shutdown_connections 2023-07-14T11:15:34.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.973+0000 7f6a519ff700 1 --2- 172.21.15.84:0/599927762 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6a2c06ae90 0x7f6a2c06d340 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:34.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.973+0000 7f6a519ff700 1 --2- 172.21.15.84:0/599927762 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a4c0ce840 0x7f6a4c0c9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:34.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.973+0000 7f6a519ff700 1 --2- 172.21.15.84:0/599927762 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a4c15ca30 0x7f6a4c147100 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:34.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.973+0000 7f6a519ff700 1 --2- 172.21.15.84:0/599927762 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a4c0d0830 0x7f6a4c0c7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:34.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.973+0000 7f6a519ff700 1 -- 172.21.15.84:0/599927762 >> 172.21.15.84:0/599927762 conn(0x7f6a4c0664f0 msgr2=0x7f6a4c06b040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:34.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.973+0000 7f6a519ff700 1 -- 172.21.15.84:0/599927762 shutdown_connections 2023-07-14T11:15:34.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:34.973+0000 7f6a519ff700 1 -- 172.21.15.84:0/599927762 wait complete. 2023-07-14T11:15:34.977 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 28 2023-07-14T11:15:34.993 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2023-07-14T11:15:35.218 INFO:teuthology.orchestra.run.smithi084.stdout:[{"id":5925,"entity":{"name":{"type":"client","num":5925},"addr":{"type":"any","addr":"172.21.15.84:0","nonce":3353249595}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":14,"uptime":1.425973401,"requests_in_flight":2,"num_completed_requests":0,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":21.928285333018302,"halflife":300},"cap_acquisition":{"value":0,"halflife":10},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5925 172.21.15.84:0/3353249595","completed_requests":[],"prealloc_inos":[{"start":"0x10000000005","length":996}],"client_metadata":{"client_features":{"feature_bits":"0x00000000000fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"3fc0089cc1082313a98853d48b892acdc1385b8b","ceph_version":"ceph version 18.0.0-4757-g3fc0089c (3fc0089cc1082313a98853d48b892acdc1385b8b) reef (dev)","entity_id":"y","hostname":"smithi084","pid":"140843","root":"/"}}] 2023-07-14T11:15:35.218 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 10, "value": 0 }, "client_metadata": { "ceph_sha1": "3fc0089cc1082313a98853d48b892acdc1385b8b", "ceph_version": "ceph version 18.0.0-4757-g3fc0089c (3fc0089cc1082313a98853d48b892acdc1385b8b) reef (dev)", "client_features": { "feature_bits": "0x00000000000fffff" }, "entity_id": "y", "hostname": "smithi084", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "140843", "root": "/" }, "completed_requests": [], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.84:0", "nonce": 3353249595, "type": "any" }, "name": { "num": 5925, "type": "client" } }, "id": 5925, "inst": "client.5925 172.21.15.84:0/3353249595", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 0, "num_leases": 1, "prealloc_inos": [ { "length": 996, "start": "0x10000000005" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 14, "requests_in_flight": 2, "session_cache_liveness": { "halflife": 300, "value": 21.9282853330183 }, "state": "open", "uptime": 1.425973401 } ] 2023-07-14T11:15:35.219 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2023-07-14T11:15:36.887 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T11:15:36.893 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T11:15:40.220 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T11:15:40.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.426+0000 7fb561fff700 1 Processor -- start 2023-07-14T11:15:40.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.426+0000 7fb561fff700 1 -- start start 2023-07-14T11:15:40.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.428+0000 7fb561fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb55c0d1160 0x7fb55c06c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:40.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.428+0000 7fb561fff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb55c0d2cc0 con 0x7fb55c160030 2023-07-14T11:15:40.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.428+0000 7fb561fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb55c0afbb0 con 0x7fb55c0b5cd0 2023-07-14T11:15:40.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.428+0000 7fb561fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb55c0afe90 con 0x7fb55c0d1160 2023-07-14T11:15:40.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.428+0000 7fb55b7fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fb55c160030 0x7fb55c0d0a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:34602/0 (socket says 172.21.15.84:34602) 2023-07-14T11:15:40.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.428+0000 7fb55b7fe700 1 -- 172.21.15.84:0/1030239269 learned_addr learned my addr 172.21.15.84:0/1030239269 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:15:40.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.428+0000 7fb55affd700 1 --2- 172.21.15.84:0/1030239269 >> v2:172.21.15.179:3300/0 conn(0x7fb55c0d1160 0x7fb55c06c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:40.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.428+0000 7fb55a7fc700 1 -- 172.21.15.84:0/1030239269 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3673059429 0 0) 0x7fb55c0d2cc0 con 0x7fb55c160030 2023-07-14T11:15:40.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.428+0000 7fb55a7fc700 1 -- 172.21.15.84:0/1030239269 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5440035b0 con 0x7fb55c160030 2023-07-14T11:15:40.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.429+0000 7fb55a7fc700 1 -- 172.21.15.84:0/1030239269 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 10220103 0 0) 0x7fb5440035b0 con 0x7fb55c160030 2023-07-14T11:15:40.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.429+0000 7fb55a7fc700 1 -- 172.21.15.84:0/1030239269 >> v2:172.21.15.179:3300/0 conn(0x7fb55c0d1160 msgr2=0x7fb55c06c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:40.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.429+0000 7fb55a7fc700 1 --2- 172.21.15.84:0/1030239269 >> v2:172.21.15.179:3300/0 conn(0x7fb55c0d1160 0x7fb55c06c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:40.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.429+0000 7fb55a7fc700 1 -- 172.21.15.84:0/1030239269 >> v1:172.21.15.179:6789/0 conn(0x7fb55c0b5cd0 legacy=0x7fb55c0b0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:40.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.429+0000 7fb55a7fc700 1 -- 172.21.15.84:0/1030239269 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb55c0b0170 con 0x7fb55c160030 2023-07-14T11:15:40.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.429+0000 7fb55a7fc700 1 -- 172.21.15.84:0/1030239269 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7fb54c001670 con 0x7fb55c160030 2023-07-14T11:15:40.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.429+0000 7fb55a7fc700 1 -- 172.21.15.84:0/1030239269 >> v1:172.21.15.84:6789/0 conn(0x7fb55c160030 legacy=0x7fb55c0d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:40.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.429+0000 7fb55a7fc700 1 --2- 172.21.15.84:0/1030239269 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb544003a50 0x7fb544003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:40.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.429+0000 7fb55a7fc700 1 --2- 172.21.15.84:0/1030239269 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb544004850 0x7fb544004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:40.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.429+0000 7fb55a7fc700 1 --2- 172.21.15.84:0/1030239269 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5440052d0 0x7fb54400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:40.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.429+0000 7fb55a7fc700 1 -- 172.21.15.84:0/1030239269 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c0afe90 con 0x7fb544004850 2023-07-14T11:15:40.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.429+0000 7fb55a7fc700 1 -- 172.21.15.84:0/1030239269 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54400c200 con 0x7fb544003a50 2023-07-14T11:15:40.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.429+0000 7fb55a7fc700 1 -- 172.21.15.84:0/1030239269 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb54400c3c0 con 0x7fb5440052d0 2023-07-14T11:15:40.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.429+0000 7fb55affd700 1 --2- 172.21.15.84:0/1030239269 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb544004850 0x7fb544004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:40.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.429+0000 7fb55b7fe700 1 --2- 172.21.15.84:0/1030239269 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb544003a50 0x7fb544003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:40.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.429+0000 7fb55bfff700 1 --2- 172.21.15.84:0/1030239269 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5440052d0 0x7fb54400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:40.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.429+0000 7fb55affd700 1 -- 172.21.15.84:0/1030239269 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5440052d0 msgr2=0x7fb54400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:40.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.429+0000 7fb55affd700 1 --2- 172.21.15.84:0/1030239269 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5440052d0 0x7fb54400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:40.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.430+0000 7fb55affd700 1 -- 172.21.15.84:0/1030239269 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb544003a50 msgr2=0x7fb544003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:40.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.430+0000 7fb55affd700 1 --2- 172.21.15.84:0/1030239269 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb544003a50 0x7fb544003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:40.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.430+0000 7fb55affd700 1 -- 172.21.15.84:0/1030239269 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5440035b0 con 0x7fb544004850 2023-07-14T11:15:40.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.430+0000 7fb55b7fe700 1 --2- 172.21.15.84:0/1030239269 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb544003a50 0x7fb544003e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:15:40.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.430+0000 7fb55bfff700 1 -- 172.21.15.84:0/1030239269 reap_dead start 2023-07-14T11:15:40.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.430+0000 7fb55affd700 1 --2- 172.21.15.84:0/1030239269 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb544004850 0x7fb544004cc0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fb550009b30 tx=0x7fb544005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecaa0e4c6e7d0c82 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:40.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.430+0000 7fb55a7fc700 1 -- 172.21.15.84:0/1030239269 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb55000e6c0 con 0x7fb544004850 2023-07-14T11:15:40.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.430+0000 7fb55a7fc700 1 -- 172.21.15.84:0/1030239269 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb55000e820 con 0x7fb544004850 2023-07-14T11:15:40.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.430+0000 7fb55a7fc700 1 -- 172.21.15.84:0/1030239269 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb55000eb90 con 0x7fb544004850 2023-07-14T11:15:40.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.431+0000 7fb561fff700 1 -- 172.21.15.84:0/1030239269 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb544004850 msgr2=0x7fb544004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:40.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.431+0000 7fb561fff700 1 --2- 172.21.15.84:0/1030239269 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb544004850 0x7fb544004cc0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fb550009b30 tx=0x7fb544005880 comp rx=0 tx=0).stop 2023-07-14T11:15:40.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.431+0000 7fb561fff700 1 -- 172.21.15.84:0/1030239269 shutdown_connections 2023-07-14T11:15:40.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.431+0000 7fb561fff700 1 --2- 172.21.15.84:0/1030239269 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb544004850 0x7fb544004cc0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:40.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.431+0000 7fb561fff700 1 -- 172.21.15.84:0/1030239269 >> 172.21.15.84:0/1030239269 conn(0x7fb55c09c190 msgr2=0x7fb55c0d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:40.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.431+0000 7fb561fff700 1 -- 172.21.15.84:0/1030239269 shutdown_connections 2023-07-14T11:15:40.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.431+0000 7fb561fff700 1 -- 172.21.15.84:0/1030239269 wait complete. 2023-07-14T11:15:40.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.433+0000 7fb561fff700 1 Processor -- start 2023-07-14T11:15:40.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.433+0000 7fb561fff700 1 -- start start 2023-07-14T11:15:40.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.434+0000 7fb561fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb544004850 0x7fb55c156830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:40.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.434+0000 7fb561fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb55c0b4da0 0x7fb55c159f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:40.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.434+0000 7fb561fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb55c1553b0 0x7fb55c157d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:40.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.434+0000 7fb561fff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c0b2b60 con 0x7fb544004850 2023-07-14T11:15:40.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.434+0000 7fb561fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c1571a0 con 0x7fb55c1553b0 2023-07-14T11:15:40.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.434+0000 7fb561fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c157ae0 con 0x7fb55c0b4da0 2023-07-14T11:15:40.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.434+0000 7fb55b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb544004850 0x7fb55c156830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:40.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.434+0000 7fb55b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb544004850 0x7fb55c156830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60102/0 (socket says 172.21.15.84:60102) 2023-07-14T11:15:40.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.434+0000 7fb55b7fe700 1 -- 172.21.15.84:0/2126594234 learned_addr learned my addr 172.21.15.84:0/2126594234 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:40.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.434+0000 7fb55affd700 1 --2- 172.21.15.84:0/2126594234 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb55c0b4da0 0x7fb55c159f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:40.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.434+0000 7fb55bfff700 1 --2- 172.21.15.84:0/2126594234 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb55c1553b0 0x7fb55c157d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:40.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.434+0000 7fb55b7fe700 1 -- 172.21.15.84:0/2126594234 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb55c0b4da0 msgr2=0x7fb55c159f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:40.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.434+0000 7fb55b7fe700 1 --2- 172.21.15.84:0/2126594234 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb55c0b4da0 0x7fb55c159f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:40.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.434+0000 7fb55b7fe700 1 -- 172.21.15.84:0/2126594234 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb55c1553b0 msgr2=0x7fb55c157d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:40.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.434+0000 7fb55b7fe700 1 --2- 172.21.15.84:0/2126594234 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb55c1553b0 0x7fb55c157d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:40.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.434+0000 7fb55b7fe700 1 -- 172.21.15.84:0/2126594234 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb55c15a4a0 con 0x7fb544004850 2023-07-14T11:15:40.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.434+0000 7fb55bfff700 1 --2- 172.21.15.84:0/2126594234 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb55c1553b0 0x7fb55c157d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:15:40.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.435+0000 7fb55b7fe700 1 --2- 172.21.15.84:0/2126594234 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb544004850 0x7fb55c156830 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fb54c00eaf0 tx=0x7fb54c00ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:40.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.435+0000 7fb543fff700 1 -- 172.21.15.84:0/2126594234 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54c005e00 con 0x7fb544004850 2023-07-14T11:15:40.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.435+0000 7fb543fff700 1 -- 172.21.15.84:0/2126594234 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb54c00c780 con 0x7fb544004850 2023-07-14T11:15:40.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.435+0000 7fb561fff700 1 -- 172.21.15.84:0/2126594234 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb55c156ec0 con 0x7fb544004850 2023-07-14T11:15:40.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.435+0000 7fb543fff700 1 -- 172.21.15.84:0/2126594234 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54c00caf0 con 0x7fb544004850 2023-07-14T11:15:40.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.435+0000 7fb561fff700 1 -- 172.21.15.84:0/2126594234 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb55c0b2780 con 0x7fb544004850 2023-07-14T11:15:40.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.436+0000 7fb561fff700 1 -- 172.21.15.84:0/2126594234 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb55c0b2300 con 0x7fb544004850 2023-07-14T11:15:40.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.437+0000 7fb543fff700 1 -- 172.21.15.84:0/2126594234 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 8) v1 ==== 89241+0+0 (secure 0 0 0) 0x7fb54c00cc50 con 0x7fb544004850 2023-07-14T11:15:40.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.438+0000 7fb543fff700 1 --2- 172.21.15.84:0/2126594234 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fb54806af20 0x7fb54806d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:40.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.438+0000 7fb543fff700 1 -- 172.21.15.84:0/2126594234 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb54c089430 con 0x7fb544004850 2023-07-14T11:15:40.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.438+0000 7fb55affd700 1 --2- 172.21.15.84:0/2126594234 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fb54806af20 0x7fb54806d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:40.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.439+0000 7fb55affd700 1 --2- 172.21.15.84:0/2126594234 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fb54806af20 0x7fb54806d3d0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb5500090b0 tx=0x7fb55001e040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:40.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.443+0000 7fb543fff700 1 -- 172.21.15.84:0/2126594234 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fb55c0b2300 con 0x7fb544004850 2023-07-14T11:15:40.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.676+0000 7fb561fff700 1 -- 172.21.15.84:0/2126594234 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb55c0b2ca0 con 0x7fb544004850 2023-07-14T11:15:40.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.677+0000 7fb543fff700 1 -- 172.21.15.84:0/2126594234 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+4712 (secure 0 0 0) 0x7fb55c0b2ca0 con 0x7fb544004850 2023-07-14T11:15:40.680 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:15:40.680 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5030,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3551222138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3551222138},{"type":"v1","addr":"172.21.15.179:6834","nonce":3551222138}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5036,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/1316665435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1316665435},{"type":"v1","addr":"172.21.15.84:6836","nonce":1316665435}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5416,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/611235750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":611235750},{"type":"v1","addr":"172.21.15.179:6835","nonce":611235750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T11:15:10.408480+0000","modified":"2023-07-14T11:15:13.936541+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5625},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5625":{"gid":5625,"name":"c","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/2672133286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":2672133286},{"type":"v1","addr":"172.21.15.84:6837","nonce":2672133286}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-14T11:15:40.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.680+0000 7fb561fff700 1 -- 172.21.15.84:0/2126594234 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fb54806af20 msgr2=0x7fb54806d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:40.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.680+0000 7fb561fff700 1 --2- 172.21.15.84:0/2126594234 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fb54806af20 0x7fb54806d3d0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb5500090b0 tx=0x7fb55001e040 comp rx=0 tx=0).stop 2023-07-14T11:15:40.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.680+0000 7fb561fff700 1 -- 172.21.15.84:0/2126594234 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb544004850 msgr2=0x7fb55c156830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:40.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.680+0000 7fb561fff700 1 --2- 172.21.15.84:0/2126594234 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb544004850 0x7fb55c156830 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fb54c00eaf0 tx=0x7fb54c00ee00 comp rx=0 tx=0).stop 2023-07-14T11:15:40.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.680+0000 7fb561fff700 1 -- 172.21.15.84:0/2126594234 shutdown_connections 2023-07-14T11:15:40.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.680+0000 7fb561fff700 1 --2- 172.21.15.84:0/2126594234 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb55c1553b0 0x7fb55c157d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:40.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.680+0000 7fb561fff700 1 --2- 172.21.15.84:0/2126594234 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb544004850 0x7fb55c156830 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:40.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.680+0000 7fb561fff700 1 --2- 172.21.15.84:0/2126594234 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fb54806af20 0x7fb54806d3d0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:40.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.680+0000 7fb561fff700 1 --2- 172.21.15.84:0/2126594234 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb55c0b4da0 0x7fb55c159f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:40.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.680+0000 7fb561fff700 1 -- 172.21.15.84:0/2126594234 >> 172.21.15.84:0/2126594234 conn(0x7fb55c09c190 msgr2=0x7fb55c06a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:40.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.680+0000 7fb561fff700 1 -- 172.21.15.84:0/2126594234 shutdown_connections 2023-07-14T11:15:40.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:40.680+0000 7fb561fff700 1 -- 172.21.15.84:0/2126594234 wait complete. 2023-07-14T11:15:40.684 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 28 2023-07-14T11:15:40.700 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2023-07-14T11:15:40.920 INFO:teuthology.orchestra.run.smithi084.stdout:[{"id":5925,"entity":{"name":{"type":"client","num":5925},"addr":{"type":"any","addr":"172.21.15.84:0","nonce":3353249595}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":13,"uptime":7.1278670389999998,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":21.641292932159729,"halflife":300},"cap_acquisition":{"value":0,"halflife":10},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5925 172.21.15.84:0/3353249595","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000000fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"3fc0089cc1082313a98853d48b892acdc1385b8b","ceph_version":"ceph version 18.0.0-4757-g3fc0089c (3fc0089cc1082313a98853d48b892acdc1385b8b) reef (dev)","entity_id":"y","hostname":"smithi084","pid":"140843","root":"/"}}] 2023-07-14T11:15:40.921 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 10, "value": 0 }, "client_metadata": { "ceph_sha1": "3fc0089cc1082313a98853d48b892acdc1385b8b", "ceph_version": "ceph version 18.0.0-4757-g3fc0089c (3fc0089cc1082313a98853d48b892acdc1385b8b) reef (dev)", "client_features": { "feature_bits": "0x00000000000fffff" }, "entity_id": "y", "hostname": "smithi084", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "140843", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.84:0", "nonce": 3353249595, "type": "any" }, "name": { "num": 5925, "type": "client" } }, "id": 5925, "inst": "client.5925 172.21.15.84:0/3353249595", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 13, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 21.64129293215973 }, "state": "open", "uptime": 7.127867039 } ] 2023-07-14T11:15:40.921 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2023-07-14T11:15:45.922 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T11:15:46.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:46.126+0000 7f01485ff700 1 Processor -- start 2023-07-14T11:15:46.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:46.126+0000 7f01485ff700 1 -- start start 2023-07-14T11:15:46.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:46.127+0000 7f01485ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f01400b4510 0x7f01400b6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:46.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:46.127+0000 7f01485ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01400b7f50 con 0x7f01400d0b10 2023-07-14T11:15:46.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:46.127+0000 7f01485ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01400cdca0 con 0x7f01400b5d90 2023-07-14T11:15:46.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:46.127+0000 7f01485ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01400b48e0 con 0x7f01400b4510 2023-07-14T11:15:46.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:46.127+0000 7f014639b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f01400b4510 0x7f01400b6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:46.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:46.127+0000 7f0146b9c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f01400d0b10 0x7f01400b83e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:34612/0 (socket says 172.21.15.84:34612) 2023-07-14T11:15:46.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:46.127+0000 7f0146b9c700 1 -- 172.21.15.84:0/643942229 learned_addr learned my addr 172.21.15.84:0/643942229 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:15:46.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:46.128+0000 7f0145399700 1 -- 172.21.15.84:0/643942229 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2048252749 0 0) 0x7f01400b7f50 con 0x7f01400d0b10 2023-07-14T11:15:46.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:46.128+0000 7f0145399700 1 -- 172.21.15.84:0/643942229 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f012c0035b0 con 0x7f01400d0b10 2023-07-14T11:15:46.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:46.128+0000 7f014639b700 1 -- 172.21.15.84:0/643942229 >> v1:172.21.15.179:6789/0 conn(0x7f01400b5d90 legacy=0x7f01400cd590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:46.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:46.128+0000 7f014639b700 1 -- 172.21.15.84:0/643942229 >> v1:172.21.15.84:6789/0 conn(0x7f01400d0b10 legacy=0x7f01400b83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:46.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:46.128+0000 7f014639b700 1 -- 172.21.15.84:0/643942229 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01400b7340 con 0x7f01400b4510 2023-07-14T11:15:46.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:46.128+0000 7f014639b700 1 --2- 172.21.15.84:0/643942229 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01400b4510 0x7f01400b6c80 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f013c009830 tx=0x7f013c009b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d0f838256ca37df server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:46.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:46.128+0000 7f0145399700 1 -- 172.21.15.84:0/643942229 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013c011830 con 0x7f01400b4510 2023-07-14T11:15:46.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:46.128+0000 7f0145399700 1 -- 172.21.15.84:0/643942229 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f013c011990 con 0x7f01400b4510 2023-07-14T11:15:46.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:46.128+0000 7f0145399700 1 -- 172.21.15.84:0/643942229 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013c011d40 con 0x7f01400b4510 2023-07-14T11:15:46.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:46.129+0000 7f01485ff700 1 -- 172.21.15.84:0/643942229 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01400b4510 msgr2=0x7f01400b6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:46.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:46.129+0000 7f01485ff700 1 --2- 172.21.15.84:0/643942229 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01400b4510 0x7f01400b6c80 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f013c009830 tx=0x7f013c009b40 comp rx=0 tx=0).stop 2023-07-14T11:15:46.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:46.129+0000 7f01485ff700 1 -- 172.21.15.84:0/643942229 shutdown_connections 2023-07-14T11:15:46.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:46.129+0000 7f01485ff700 1 --2- 172.21.15.84:0/643942229 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01400b4510 0x7f01400b6c80 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:46.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:46.129+0000 7f01485ff700 1 -- 172.21.15.84:0/643942229 >> 172.21.15.84:0/643942229 conn(0x7f014009c1d0 msgr2=0x7f01400d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:46.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:46.129+0000 7f01485ff700 1 -- 172.21.15.84:0/643942229 shutdown_connections 2023-07-14T11:15:46.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:46.129+0000 7f01485ff700 1 -- 172.21.15.84:0/643942229 wait complete. 2023-07-14T11:15:46.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:46.131+0000 7f01485ff700 1 Processor -- start 2023-07-14T11:15:46.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:46.131+0000 7f01485ff700 1 -- start start 2023-07-14T11:15:46.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:46.132+0000 7f01485ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01400b4510 0x7f01400ca080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:46.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:46.132+0000 7f01485ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01400b5d90 0x7f01400cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:46.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:46.132+0000 7f01485ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01400d0b10 0x7f014006b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:46.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:46.132+0000 7f01485ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01400caa80 con 0x7f01400d0b10 2023-07-14T11:15:46.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:46.132+0000 7f01485ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0140154540 con 0x7f01400b5d90 2023-07-14T11:15:46.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:46.132+0000 7f01485ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0140154820 con 0x7f01400b4510 2023-07-14T11:15:46.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:46.132+0000 7f0146b9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01400d0b10 0x7f014006b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:46.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:46.132+0000 7f0146b9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01400d0b10 0x7f014006b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60116/0 (socket says 172.21.15.84:60116) 2023-07-14T11:15:46.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:46.132+0000 7f0146b9c700 1 -- 172.21.15.84:0/2578614650 learned_addr learned my addr 172.21.15.84:0/2578614650 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:46.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:46.132+0000 7f0146b9c700 1 -- 172.21.15.84:0/2578614650 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01400b4510 msgr2=0x7f01400ca080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:46.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:46.132+0000 7f0146b9c700 1 --2- 172.21.15.84:0/2578614650 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01400b4510 0x7f01400ca080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:46.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:46.132+0000 7f0146b9c700 1 -- 172.21.15.84:0/2578614650 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01400b5d90 msgr2=0x7f01400cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:46.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:46.132+0000 7f0145b9a700 1 --2- 172.21.15.84:0/2578614650 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01400b5d90 0x7f01400cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:46.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:46.132+0000 7f0146b9c700 1 --2- 172.21.15.84:0/2578614650 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01400b5d90 0x7f01400cc9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:46.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:46.132+0000 7f0146b9c700 1 -- 172.21.15.84:0/2578614650 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f013c009440 con 0x7f01400d0b10 2023-07-14T11:15:46.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:46.132+0000 7f0145b9a700 1 --2- 172.21.15.84:0/2578614650 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01400b5d90 0x7f01400cc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:15:46.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:46.133+0000 7f0146b9c700 1 --2- 172.21.15.84:0/2578614650 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01400d0b10 0x7f014006b880 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f013800cb40 tx=0x7f013800cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:46.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:46.133+0000 7f0136ffd700 1 -- 172.21.15.84:0/2578614650 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013800ab50 con 0x7f01400d0b10 2023-07-14T11:15:46.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:46.133+0000 7f0136ffd700 1 -- 172.21.15.84:0/2578614650 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f013800acb0 con 0x7f01400d0b10 2023-07-14T11:15:46.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:46.133+0000 7f01485ff700 1 -- 172.21.15.84:0/2578614650 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0140154b00 con 0x7f01400d0b10 2023-07-14T11:15:46.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:46.133+0000 7f0136ffd700 1 -- 172.21.15.84:0/2578614650 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0138012620 con 0x7f01400d0b10 2023-07-14T11:15:46.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:46.133+0000 7f01485ff700 1 -- 172.21.15.84:0/2578614650 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01400ca5c0 con 0x7f01400d0b10 2023-07-14T11:15:46.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:46.134+0000 7f01485ff700 1 -- 172.21.15.84:0/2578614650 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0140155020 con 0x7f01400d0b10 2023-07-14T11:15:46.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:46.135+0000 7f0136ffd700 1 -- 172.21.15.84:0/2578614650 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 8) v1 ==== 89241+0+0 (secure 0 0 0) 0x7f013801b3b0 con 0x7f01400d0b10 2023-07-14T11:15:46.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:46.136+0000 7f0136ffd700 1 --2- 172.21.15.84:0/2578614650 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f012406af50 0x7f012406d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:46.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:46.136+0000 7f0136ffd700 1 -- 172.21.15.84:0/2578614650 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f01380895d0 con 0x7f01400d0b10 2023-07-14T11:15:46.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:46.136+0000 7f014639b700 1 --2- 172.21.15.84:0/2578614650 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f012406af50 0x7f012406d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:46.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:46.137+0000 7f014639b700 1 --2- 172.21.15.84:0/2578614650 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f012406af50 0x7f012406d400 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f013c009b80 tx=0x7f013c010000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:46.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:46.140+0000 7f0136ffd700 1 -- 172.21.15.84:0/2578614650 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f01380543b0 con 0x7f01400d0b10 2023-07-14T11:15:46.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:46.381+0000 7f01485ff700 1 -- 172.21.15.84:0/2578614650 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f014004e280 con 0x7f01400d0b10 2023-07-14T11:15:46.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:46.382+0000 7f0136ffd700 1 -- 172.21.15.84:0/2578614650 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+4712 (secure 0 0 0) 0x7f01380579d0 con 0x7f01400d0b10 2023-07-14T11:15:46.384 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:15:46.384 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5030,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3551222138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3551222138},{"type":"v1","addr":"172.21.15.179:6834","nonce":3551222138}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5036,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/1316665435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1316665435},{"type":"v1","addr":"172.21.15.84:6836","nonce":1316665435}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5416,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/611235750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":611235750},{"type":"v1","addr":"172.21.15.179:6835","nonce":611235750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T11:15:10.408480+0000","modified":"2023-07-14T11:15:13.936541+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5625},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5625":{"gid":5625,"name":"c","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/2672133286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":2672133286},{"type":"v1","addr":"172.21.15.84:6837","nonce":2672133286}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-14T11:15:46.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:46.384+0000 7f01485ff700 1 -- 172.21.15.84:0/2578614650 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f012406af50 msgr2=0x7f012406d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:46.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:46.384+0000 7f01485ff700 1 --2- 172.21.15.84:0/2578614650 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f012406af50 0x7f012406d400 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f013c009b80 tx=0x7f013c010000 comp rx=0 tx=0).stop 2023-07-14T11:15:46.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:46.384+0000 7f01485ff700 1 -- 172.21.15.84:0/2578614650 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01400d0b10 msgr2=0x7f014006b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:46.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:46.384+0000 7f01485ff700 1 --2- 172.21.15.84:0/2578614650 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01400d0b10 0x7f014006b880 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f013800cb40 tx=0x7f013800cf00 comp rx=0 tx=0).stop 2023-07-14T11:15:46.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:46.384+0000 7f01485ff700 1 -- 172.21.15.84:0/2578614650 shutdown_connections 2023-07-14T11:15:46.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:46.384+0000 7f01485ff700 1 --2- 172.21.15.84:0/2578614650 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f012406af50 0x7f012406d400 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:46.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:46.384+0000 7f01485ff700 1 --2- 172.21.15.84:0/2578614650 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01400b4510 0x7f01400ca080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:46.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:46.384+0000 7f01485ff700 1 --2- 172.21.15.84:0/2578614650 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01400d0b10 0x7f014006b880 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:46.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:46.384+0000 7f01485ff700 1 --2- 172.21.15.84:0/2578614650 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01400b5d90 0x7f01400cc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:46.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:46.384+0000 7f01485ff700 1 -- 172.21.15.84:0/2578614650 >> 172.21.15.84:0/2578614650 conn(0x7f014009c1d0 msgr2=0x7f01400d32e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:46.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:46.384+0000 7f01485ff700 1 -- 172.21.15.84:0/2578614650 shutdown_connections 2023-07-14T11:15:46.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:46.384+0000 7f01485ff700 1 -- 172.21.15.84:0/2578614650 wait complete. 2023-07-14T11:15:46.388 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 28 2023-07-14T11:15:46.404 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2023-07-14T11:15:46.624 INFO:teuthology.orchestra.run.smithi084.stdout:[{"id":5925,"entity":{"name":{"type":"client","num":5925},"addr":{"type":"any","addr":"172.21.15.84:0","nonce":3353249595}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":12,"uptime":12.831761545999999,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":21.357957884603383,"halflife":300},"cap_acquisition":{"value":0,"halflife":10},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5925 172.21.15.84:0/3353249595","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000000fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"3fc0089cc1082313a98853d48b892acdc1385b8b","ceph_version":"ceph version 18.0.0-4757-g3fc0089c (3fc0089cc1082313a98853d48b892acdc1385b8b) reef (dev)","entity_id":"y","hostname":"smithi084","pid":"140843","root":"/"}}] 2023-07-14T11:15:46.625 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 10, "value": 0 }, "client_metadata": { "ceph_sha1": "3fc0089cc1082313a98853d48b892acdc1385b8b", "ceph_version": "ceph version 18.0.0-4757-g3fc0089c (3fc0089cc1082313a98853d48b892acdc1385b8b) reef (dev)", "client_features": { "feature_bits": "0x00000000000fffff" }, "entity_id": "y", "hostname": "smithi084", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "140843", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.84:0", "nonce": 3353249595, "type": "any" }, "name": { "num": 5925, "type": "client" } }, "id": 5925, "inst": "client.5925 172.21.15.84:0/3353249595", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 12, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 21.357957884603383 }, "state": "open", "uptime": 12.831761546 } ] 2023-07-14T11:15:46.625 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2023-07-14T11:15:51.627 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T11:15:51.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.832+0000 7f010c5ff700 1 Processor -- start 2023-07-14T11:15:51.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.832+0000 7f010c5ff700 1 -- start start 2023-07-14T11:15:51.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.834+0000 7f010c5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01040d1160 0x7f010406c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:51.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.834+0000 7f010c5ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f01040b5cd0 0x7f01040b0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:51.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.834+0000 7f010c5ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01040d2cc0 con 0x7f0104160030 2023-07-14T11:15:51.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.834+0000 7f010c5ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01040afbb0 con 0x7f01040b5cd0 2023-07-14T11:15:51.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.834+0000 7f010c5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01040afe90 con 0x7f01040d1160 2023-07-14T11:15:51.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.834+0000 7f010a39b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f0104160030 0x7f01040d0a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51366/0 (socket says 172.21.15.84:51366) 2023-07-14T11:15:51.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.834+0000 7f010a39b700 1 -- 172.21.15.84:0/3846402678 learned_addr learned my addr 172.21.15.84:0/3846402678 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:15:51.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.834+0000 7f0109399700 1 -- 172.21.15.84:0/3846402678 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 911598105 0 0) 0x7f01040d2cc0 con 0x7f0104160030 2023-07-14T11:15:51.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.834+0000 7f0109399700 1 -- 172.21.15.84:0/3846402678 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00f00035b0 con 0x7f0104160030 2023-07-14T11:15:51.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.834+0000 7f0109b9a700 1 --2- 172.21.15.84:0/3846402678 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01040d1160 0x7f010406c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:51.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.834+0000 7f010ab9c700 1 --2- 172.21.15.84:0/3846402678 >> v2:172.21.15.179:3300/0 conn(0x7f01040b5cd0 0x7f01040b0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:51.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.835+0000 7f0109399700 1 -- 172.21.15.84:0/3846402678 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2049246261 0 0) 0x7f00f00035b0 con 0x7f0104160030 2023-07-14T11:15:51.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.835+0000 7f0109399700 1 -- 172.21.15.84:0/3846402678 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01040d1160 msgr2=0x7f010406c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:51.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.835+0000 7f0109399700 1 --2- 172.21.15.84:0/3846402678 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01040d1160 0x7f010406c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:51.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.835+0000 7f0109399700 1 -- 172.21.15.84:0/3846402678 >> v2:172.21.15.179:3300/0 conn(0x7f01040b5cd0 msgr2=0x7f01040b0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:51.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.835+0000 7f0109399700 1 --2- 172.21.15.84:0/3846402678 >> v2:172.21.15.179:3300/0 conn(0x7f01040b5cd0 0x7f01040b0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:51.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.835+0000 7f0109399700 1 -- 172.21.15.84:0/3846402678 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01040b0170 con 0x7f0104160030 2023-07-14T11:15:51.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.835+0000 7f0109399700 1 -- 172.21.15.84:0/3846402678 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7f0100001670 con 0x7f0104160030 2023-07-14T11:15:51.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.835+0000 7f0109399700 1 -- 172.21.15.84:0/3846402678 >> v1:172.21.15.84:6789/0 conn(0x7f0104160030 legacy=0x7f01040d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:51.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.835+0000 7f0109399700 1 --2- 172.21.15.84:0/3846402678 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01040d1160 0x7f00f0003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:51.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.835+0000 7f0109399700 1 --2- 172.21.15.84:0/3846402678 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00f0003fd0 0x7f00f0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:51.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.835+0000 7f0109399700 1 --2- 172.21.15.84:0/3846402678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00f0004d90 0x7f00f0005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:51.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.835+0000 7f0109399700 1 -- 172.21.15.84:0/3846402678 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01040afbb0 con 0x7f00f0004d90 2023-07-14T11:15:51.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.835+0000 7f0109399700 1 -- 172.21.15.84:0/3846402678 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01040afe90 con 0x7f00f0003fd0 2023-07-14T11:15:51.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.835+0000 7f0109399700 1 -- 172.21.15.84:0/3846402678 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00f000bb40 con 0x7f01040d1160 2023-07-14T11:15:51.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.835+0000 7f010ab9c700 1 --2- 172.21.15.84:0/3846402678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00f0004d90 0x7f00f0005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:51.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.835+0000 7f010a39b700 1 --2- 172.21.15.84:0/3846402678 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01040d1160 0x7f00f0003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:51.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.835+0000 7f0109b9a700 1 --2- 172.21.15.84:0/3846402678 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00f0003fd0 0x7f00f0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:51.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.835+0000 7f010ab9c700 1 -- 172.21.15.84:0/3846402678 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01040d1160 msgr2=0x7f00f0003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:51.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.835+0000 7f010ab9c700 1 --2- 172.21.15.84:0/3846402678 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01040d1160 0x7f00f0003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:51.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.836+0000 7f010ab9c700 1 -- 172.21.15.84:0/3846402678 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00f0003fd0 msgr2=0x7f00f0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:51.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.836+0000 7f010ab9c700 1 --2- 172.21.15.84:0/3846402678 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00f0003fd0 0x7f00f0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:51.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.836+0000 7f010ab9c700 1 -- 172.21.15.84:0/3846402678 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f00035b0 con 0x7f00f0004d90 2023-07-14T11:15:51.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.836+0000 7f010ab9c700 1 --2- 172.21.15.84:0/3846402678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00f0004d90 0x7f00f0005200 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f0104067500 tx=0x7f00f0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d02b0c17b3a4eb4f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:51.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.836+0000 7f0109399700 1 -- 172.21.15.84:0/3846402678 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00fc00eba0 con 0x7f00f0004d90 2023-07-14T11:15:51.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.836+0000 7f0109399700 1 -- 172.21.15.84:0/3846402678 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00fc00f040 con 0x7f00f0004d90 2023-07-14T11:15:51.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.836+0000 7f0109399700 1 -- 172.21.15.84:0/3846402678 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00fc014480 con 0x7f00f0004d90 2023-07-14T11:15:51.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.836+0000 7f010c5ff700 1 -- 172.21.15.84:0/3846402678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00f0004d90 msgr2=0x7f00f0005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:51.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.836+0000 7f010c5ff700 1 --2- 172.21.15.84:0/3846402678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00f0004d90 0x7f00f0005200 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f0104067500 tx=0x7f00f0005880 comp rx=0 tx=0).stop 2023-07-14T11:15:51.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.836+0000 7f010ab9c700 1 -- 172.21.15.84:0/3846402678 reap_dead start 2023-07-14T11:15:51.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.837+0000 7f010c5ff700 1 -- 172.21.15.84:0/3846402678 shutdown_connections 2023-07-14T11:15:51.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.837+0000 7f010c5ff700 1 -- 172.21.15.84:0/3846402678 >> 172.21.15.84:0/3846402678 conn(0x7f010409c190 msgr2=0x7f01040d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:51.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.837+0000 7f010c5ff700 1 -- 172.21.15.84:0/3846402678 shutdown_connections 2023-07-14T11:15:51.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.837+0000 7f010c5ff700 1 -- 172.21.15.84:0/3846402678 wait complete. 2023-07-14T11:15:51.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.838+0000 7f010c5ff700 1 Processor -- start 2023-07-14T11:15:51.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.838+0000 7f010c5ff700 1 -- start start 2023-07-14T11:15:51.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.839+0000 7f010c5ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00f0004d90 0x7f010415b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:51.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.839+0000 7f010c5ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0104159270 0x7f01041588e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:51.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.839+0000 7f010c5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0104158e20 0x7f01041f5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:51.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.839+0000 7f010c5ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01040b3350 con 0x7f00f0004d90 2023-07-14T11:15:51.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.839+0000 7f010c5ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01040b3630 con 0x7f0104159270 2023-07-14T11:15:51.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.839+0000 7f010c5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f010415be00 con 0x7f0104158e20 2023-07-14T11:15:51.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.840+0000 7f010a39b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00f0004d90 0x7f010415b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:51.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.840+0000 7f010a39b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00f0004d90 0x7f010415b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55108/0 (socket says 172.21.15.84:55108) 2023-07-14T11:15:51.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.840+0000 7f010a39b700 1 -- 172.21.15.84:0/3248694774 learned_addr learned my addr 172.21.15.84:0/3248694774 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:51.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.840+0000 7f010ab9c700 1 --2- 172.21.15.84:0/3248694774 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0104158e20 0x7f01041f5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:51.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.840+0000 7f0109b9a700 1 --2- 172.21.15.84:0/3248694774 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0104159270 0x7f01041588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:51.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.840+0000 7f010a39b700 1 -- 172.21.15.84:0/3248694774 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0104158e20 msgr2=0x7f01041f5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:51.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.840+0000 7f010a39b700 1 --2- 172.21.15.84:0/3248694774 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0104158e20 0x7f01041f5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:51.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.840+0000 7f010a39b700 1 -- 172.21.15.84:0/3248694774 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0104159270 msgr2=0x7f01041588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:51.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.840+0000 7f010a39b700 1 --2- 172.21.15.84:0/3248694774 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0104159270 0x7f01041588e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:51.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.840+0000 7f010a39b700 1 -- 172.21.15.84:0/3248694774 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f010415c0e0 con 0x7f00f0004d90 2023-07-14T11:15:51.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.840+0000 7f0109b9a700 1 --2- 172.21.15.84:0/3248694774 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0104159270 0x7f01041588e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:15:51.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.840+0000 7f010ab9c700 1 --2- 172.21.15.84:0/3248694774 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0104158e20 0x7f01041f5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:15:51.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.840+0000 7f010a39b700 1 --2- 172.21.15.84:0/3248694774 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00f0004d90 0x7f010415b790 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f0100000c00 tx=0x7f01000076a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:51.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.840+0000 7f00faffd700 1 -- 172.21.15.84:0/3248694774 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01000077c0 con 0x7f00f0004d90 2023-07-14T11:15:51.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.840+0000 7f00faffd700 1 -- 172.21.15.84:0/3248694774 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f010000f8a0 con 0x7f00f0004d90 2023-07-14T11:15:51.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.840+0000 7f00faffd700 1 -- 172.21.15.84:0/3248694774 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f010000fc50 con 0x7f00f0004d90 2023-07-14T11:15:51.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.840+0000 7f010c5ff700 1 -- 172.21.15.84:0/3248694774 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f010415c3c0 con 0x7f00f0004d90 2023-07-14T11:15:51.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.841+0000 7f010c5ff700 1 -- 172.21.15.84:0/3248694774 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01041f6260 con 0x7f00f0004d90 2023-07-14T11:15:51.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.842+0000 7f010c5ff700 1 -- 172.21.15.84:0/3248694774 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01040b7130 con 0x7f00f0004d90 2023-07-14T11:15:51.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.842+0000 7f00faffd700 1 -- 172.21.15.84:0/3248694774 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 8) v1 ==== 89241+0+0 (secure 0 0 0) 0x7f010001d460 con 0x7f00f0004d90 2023-07-14T11:15:51.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.844+0000 7f00faffd700 1 --2- 172.21.15.84:0/3248694774 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f00e806af20 0x7f00e806d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:51.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.844+0000 7f00faffd700 1 -- 172.21.15.84:0/3248694774 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0100089920 con 0x7f00f0004d90 2023-07-14T11:15:51.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.844+0000 7f0109b9a700 1 --2- 172.21.15.84:0/3248694774 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f00e806af20 0x7f00e806d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:51.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.845+0000 7f0109b9a700 1 --2- 172.21.15.84:0/3248694774 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f00e806af20 0x7f00e806d3d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f01040d1550 tx=0x7f00f4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:51.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:51.848+0000 7f00faffd700 1 -- 172.21.15.84:0/3248694774 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f0100058190 con 0x7f00f0004d90 2023-07-14T11:15:52.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:52.084+0000 7f010c5ff700 1 -- 172.21.15.84:0/3248694774 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f010415c5b0 con 0x7f00f0004d90 2023-07-14T11:15:52.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:52.085+0000 7f00faffd700 1 -- 172.21.15.84:0/3248694774 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+4712 (secure 0 0 0) 0x7f0100057d20 con 0x7f00f0004d90 2023-07-14T11:15:52.087 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:15:52.087 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5030,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3551222138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3551222138},{"type":"v1","addr":"172.21.15.179:6834","nonce":3551222138}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5036,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/1316665435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1316665435},{"type":"v1","addr":"172.21.15.84:6836","nonce":1316665435}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5416,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/611235750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":611235750},{"type":"v1","addr":"172.21.15.179:6835","nonce":611235750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T11:15:10.408480+0000","modified":"2023-07-14T11:15:13.936541+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5625},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5625":{"gid":5625,"name":"c","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/2672133286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":2672133286},{"type":"v1","addr":"172.21.15.84:6837","nonce":2672133286}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-14T11:15:52.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:52.087+0000 7f010c5ff700 1 -- 172.21.15.84:0/3248694774 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f00e806af20 msgr2=0x7f00e806d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:52.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:52.087+0000 7f010c5ff700 1 --2- 172.21.15.84:0/3248694774 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f00e806af20 0x7f00e806d3d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f01040d1550 tx=0x7f00f4008040 comp rx=0 tx=0).stop 2023-07-14T11:15:52.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:52.087+0000 7f010c5ff700 1 -- 172.21.15.84:0/3248694774 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00f0004d90 msgr2=0x7f010415b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:52.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:52.087+0000 7f010c5ff700 1 --2- 172.21.15.84:0/3248694774 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00f0004d90 0x7f010415b790 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f0100000c00 tx=0x7f01000076a0 comp rx=0 tx=0).stop 2023-07-14T11:15:52.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:52.087+0000 7f010c5ff700 1 -- 172.21.15.84:0/3248694774 shutdown_connections 2023-07-14T11:15:52.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:52.087+0000 7f010c5ff700 1 --2- 172.21.15.84:0/3248694774 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f00e806af20 0x7f00e806d3d0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:52.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:52.087+0000 7f010c5ff700 1 --2- 172.21.15.84:0/3248694774 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0104158e20 0x7f01041f5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:52.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:52.087+0000 7f010c5ff700 1 --2- 172.21.15.84:0/3248694774 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00f0004d90 0x7f010415b790 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:52.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:52.087+0000 7f010c5ff700 1 --2- 172.21.15.84:0/3248694774 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0104159270 0x7f01041588e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:52.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:52.087+0000 7f010c5ff700 1 -- 172.21.15.84:0/3248694774 >> 172.21.15.84:0/3248694774 conn(0x7f010409c190 msgr2=0x7f01040b7560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:52.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:52.087+0000 7f010c5ff700 1 -- 172.21.15.84:0/3248694774 shutdown_connections 2023-07-14T11:15:52.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:52.087+0000 7f010c5ff700 1 -- 172.21.15.84:0/3248694774 wait complete. 2023-07-14T11:15:52.091 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 28 2023-07-14T11:15:52.107 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2023-07-14T11:15:52.325 INFO:teuthology.orchestra.run.smithi084.stdout:[{"id":5925,"entity":{"name":{"type":"client","num":5925},"addr":{"type":"any","addr":"172.21.15.84:0","nonce":3353249595}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":12,"uptime":18.532656608,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":21.078478431627925,"halflife":300},"cap_acquisition":{"value":0,"halflife":10},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5925 172.21.15.84:0/3353249595","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000000fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"3fc0089cc1082313a98853d48b892acdc1385b8b","ceph_version":"ceph version 18.0.0-4757-g3fc0089c (3fc0089cc1082313a98853d48b892acdc1385b8b) reef (dev)","entity_id":"y","hostname":"smithi084","pid":"140843","root":"/"}}] 2023-07-14T11:15:52.326 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 10, "value": 0 }, "client_metadata": { "ceph_sha1": "3fc0089cc1082313a98853d48b892acdc1385b8b", "ceph_version": "ceph version 18.0.0-4757-g3fc0089c (3fc0089cc1082313a98853d48b892acdc1385b8b) reef (dev)", "client_features": { "feature_bits": "0x00000000000fffff" }, "entity_id": "y", "hostname": "smithi084", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "140843", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.84:0", "nonce": 3353249595, "type": "any" }, "name": { "num": 5925, "type": "client" } }, "id": 5925, "inst": "client.5925 172.21.15.84:0/3353249595", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 12, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 21.078478431627925 }, "state": "open", "uptime": 18.532656608 } ] 2023-07-14T11:15:52.326 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2023-07-14T11:15:57.327 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T11:15:57.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:57.529+0000 7fe9615ff700 1 Processor -- start 2023-07-14T11:15:57.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:57.530+0000 7fe9615ff700 1 -- start start 2023-07-14T11:15:57.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:57.531+0000 7fe9615ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe95c0b4570 0x7fe95c0b4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:57.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:57.531+0000 7fe9615ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe95c0cd380 0x7fe95c160be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:57.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:57.531+0000 7fe9615ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe95c072080 con 0x7fe95c0ccf10 2023-07-14T11:15:57.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:57.531+0000 7fe9615ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe95c06d7a0 con 0x7fe95c0cd380 2023-07-14T11:15:57.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:57.531+0000 7fe9615ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe95c06a2b0 con 0x7fe95c0b4570 2023-07-14T11:15:57.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:57.531+0000 7fe95b7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe95c0cd380 0x7fe95c160be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:57.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:57.531+0000 7fe95b7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe95c0cd380 0x7fe95c160be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55120/0 (socket says 172.21.15.84:55120) 2023-07-14T11:15:57.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:57.531+0000 7fe95b7fe700 1 -- 172.21.15.84:0/543635579 learned_addr learned my addr 172.21.15.84:0/543635579 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:57.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:57.531+0000 7fe95affd700 1 --2- 172.21.15.84:0/543635579 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe95c0b4570 0x7fe95c0b4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:57.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:57.531+0000 7fe95b7fe700 1 -- 172.21.15.84:0/543635579 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe95c0b4570 msgr2=0x7fe95c0b4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:57.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:57.531+0000 7fe95b7fe700 1 --2- 172.21.15.84:0/543635579 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe95c0b4570 0x7fe95c0b4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:57.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:57.531+0000 7fe95b7fe700 1 -- 172.21.15.84:0/543635579 >> v1:172.21.15.179:6789/0 conn(0x7fe95c0ccf10 legacy=0x7fe95c06cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:15:57.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:57.531+0000 7fe95b7fe700 1 -- 172.21.15.84:0/543635579 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe95c06d9b0 con 0x7fe95c0cd380 2023-07-14T11:15:57.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:57.531+0000 7fe95affd700 1 --2- 172.21.15.84:0/543635579 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe95c0b4570 0x7fe95c0b4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:15:57.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:57.532+0000 7fe95b7fe700 1 --2- 172.21.15.84:0/543635579 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe95c0cd380 0x7fe95c160be0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fe954009e50 tx=0x7fe95400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=591b834a56247509 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:57.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:57.532+0000 7fe95a7fc700 1 -- 172.21.15.84:0/543635579 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95400e070 con 0x7fe95c0cd380 2023-07-14T11:15:57.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:57.532+0000 7fe95a7fc700 1 -- 172.21.15.84:0/543635579 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe954003a20 con 0x7fe95c0cd380 2023-07-14T11:15:57.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:57.532+0000 7fe95a7fc700 1 -- 172.21.15.84:0/543635579 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe954003dd0 con 0x7fe95c0cd380 2023-07-14T11:15:57.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:57.532+0000 7fe9615ff700 1 -- 172.21.15.84:0/543635579 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe95c0cd380 msgr2=0x7fe95c160be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:57.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:57.532+0000 7fe9615ff700 1 --2- 172.21.15.84:0/543635579 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe95c0cd380 0x7fe95c160be0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fe954009e50 tx=0x7fe95400b330 comp rx=0 tx=0).stop 2023-07-14T11:15:57.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:57.532+0000 7fe9615ff700 1 -- 172.21.15.84:0/543635579 shutdown_connections 2023-07-14T11:15:57.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:57.532+0000 7fe9615ff700 1 --2- 172.21.15.84:0/543635579 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe95c0cd380 0x7fe95c160be0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:57.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:57.532+0000 7fe9615ff700 1 --2- 172.21.15.84:0/543635579 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe95c0b4570 0x7fe95c0b4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:57.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:57.532+0000 7fe9615ff700 1 -- 172.21.15.84:0/543635579 >> 172.21.15.84:0/543635579 conn(0x7fe95c0b2ef0 msgr2=0x7fe95c071530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:57.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:57.532+0000 7fe9615ff700 1 -- 172.21.15.84:0/543635579 shutdown_connections 2023-07-14T11:15:57.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:57.533+0000 7fe9615ff700 1 -- 172.21.15.84:0/543635579 wait complete. 2023-07-14T11:15:57.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:57.534+0000 7fe9615ff700 1 Processor -- start 2023-07-14T11:15:57.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:57.534+0000 7fe9615ff700 1 -- start start 2023-07-14T11:15:57.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:57.535+0000 7fe9615ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe95c0b4570 0x7fe95c1594c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:57.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:57.535+0000 7fe9615ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe95c0ccf10 0x7fe95c15ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:57.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:57.535+0000 7fe9615ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe95c0cd380 0x7fe95c1578c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:57.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:57.535+0000 7fe9615ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe95c15e960 con 0x7fe95c0ccf10 2023-07-14T11:15:57.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:57.535+0000 7fe9615ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe95c157e00 con 0x7fe95c0b4570 2023-07-14T11:15:57.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:57.535+0000 7fe9615ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe95c15d8c0 con 0x7fe95c0cd380 2023-07-14T11:15:57.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:57.535+0000 7fe953fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe95c0ccf10 0x7fe95c15ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:57.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:57.536+0000 7fe953fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe95c0ccf10 0x7fe95c15ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55130/0 (socket says 172.21.15.84:55130) 2023-07-14T11:15:57.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:57.536+0000 7fe953fff700 1 -- 172.21.15.84:0/56973902 learned_addr learned my addr 172.21.15.84:0/56973902 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:15:57.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:57.536+0000 7fe95affd700 1 --2- 172.21.15.84:0/56973902 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe95c0b4570 0x7fe95c1594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:57.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:57.536+0000 7fe95b7fe700 1 --2- 172.21.15.84:0/56973902 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe95c0cd380 0x7fe95c1578c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:57.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:57.536+0000 7fe953fff700 1 -- 172.21.15.84:0/56973902 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe95c0cd380 msgr2=0x7fe95c1578c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:57.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:57.536+0000 7fe953fff700 1 --2- 172.21.15.84:0/56973902 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe95c0cd380 0x7fe95c1578c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:57.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:57.536+0000 7fe953fff700 1 -- 172.21.15.84:0/56973902 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe95c0b4570 msgr2=0x7fe95c1594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:57.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:57.536+0000 7fe953fff700 1 --2- 172.21.15.84:0/56973902 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe95c0b4570 0x7fe95c1594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:57.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:57.536+0000 7fe953fff700 1 -- 172.21.15.84:0/56973902 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe954009b30 con 0x7fe95c0ccf10 2023-07-14T11:15:57.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:57.536+0000 7fe95affd700 1 --2- 172.21.15.84:0/56973902 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe95c0b4570 0x7fe95c1594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:15:57.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:57.536+0000 7fe95b7fe700 1 --2- 172.21.15.84:0/56973902 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe95c0cd380 0x7fe95c1578c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:15:57.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:57.536+0000 7fe953fff700 1 --2- 172.21.15.84:0/56973902 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe95c0ccf10 0x7fe95c15ad80 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fe94400b4a0 tx=0x7fe94400b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:57.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:57.536+0000 7fe9537fe700 1 -- 172.21.15.84:0/56973902 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe944011830 con 0x7fe95c0ccf10 2023-07-14T11:15:57.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:57.536+0000 7fe9537fe700 1 -- 172.21.15.84:0/56973902 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe944011990 con 0x7fe95c0ccf10 2023-07-14T11:15:57.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:57.536+0000 7fe9537fe700 1 -- 172.21.15.84:0/56973902 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe944011d40 con 0x7fe95c0ccf10 2023-07-14T11:15:57.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:57.536+0000 7fe9615ff700 1 -- 172.21.15.84:0/56973902 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe95c15dba0 con 0x7fe95c0ccf10 2023-07-14T11:15:57.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:57.537+0000 7fe9615ff700 1 -- 172.21.15.84:0/56973902 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe95c15e160 con 0x7fe95c0ccf10 2023-07-14T11:15:57.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:57.538+0000 7fe9615ff700 1 -- 172.21.15.84:0/56973902 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe95c06e240 con 0x7fe95c0ccf10 2023-07-14T11:15:57.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:57.538+0000 7fe9537fe700 1 -- 172.21.15.84:0/56973902 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 8) v1 ==== 89241+0+0 (secure 0 0 0) 0x7fe94401a400 con 0x7fe95c0ccf10 2023-07-14T11:15:57.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:57.539+0000 7fe9537fe700 1 --2- 172.21.15.84:0/56973902 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe93c06af20 0x7fe93c06d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:15:57.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:57.539+0000 7fe9537fe700 1 -- 172.21.15.84:0/56973902 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fe9440896b0 con 0x7fe95c0ccf10 2023-07-14T11:15:57.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:57.540+0000 7fe95affd700 1 --2- 172.21.15.84:0/56973902 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe93c06af20 0x7fe93c06d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:15:57.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:57.540+0000 7fe95affd700 1 --2- 172.21.15.84:0/56973902 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe93c06af20 0x7fe93c06d3d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe94c00aa20 tx=0x7fe94c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:15:57.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:57.544+0000 7fe9537fe700 1 -- 172.21.15.84:0/56973902 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe944054320 con 0x7fe95c0ccf10 2023-07-14T11:15:57.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:57.781+0000 7fe9615ff700 1 -- 172.21.15.84:0/56973902 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe95c04e260 con 0x7fe95c0ccf10 2023-07-14T11:15:57.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:57.782+0000 7fe9537fe700 1 -- 172.21.15.84:0/56973902 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+4712 (secure 0 0 0) 0x7fe944057940 con 0x7fe95c0ccf10 2023-07-14T11:15:57.784 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:15:57.784 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5030,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3551222138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3551222138},{"type":"v1","addr":"172.21.15.179:6834","nonce":3551222138}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5036,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/1316665435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1316665435},{"type":"v1","addr":"172.21.15.84:6836","nonce":1316665435}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5416,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/611235750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":611235750},{"type":"v1","addr":"172.21.15.179:6835","nonce":611235750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T11:15:10.408480+0000","modified":"2023-07-14T11:15:13.936541+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5625},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5625":{"gid":5625,"name":"c","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/2672133286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":2672133286},{"type":"v1","addr":"172.21.15.84:6837","nonce":2672133286}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-14T11:15:57.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:57.784+0000 7fe9615ff700 1 -- 172.21.15.84:0/56973902 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe93c06af20 msgr2=0x7fe93c06d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:57.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:57.784+0000 7fe9615ff700 1 --2- 172.21.15.84:0/56973902 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe93c06af20 0x7fe93c06d3d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe94c00aa20 tx=0x7fe94c008040 comp rx=0 tx=0).stop 2023-07-14T11:15:57.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:57.784+0000 7fe9615ff700 1 -- 172.21.15.84:0/56973902 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe95c0ccf10 msgr2=0x7fe95c15ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:15:57.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:57.784+0000 7fe9615ff700 1 --2- 172.21.15.84:0/56973902 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe95c0ccf10 0x7fe95c15ad80 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fe94400b4a0 tx=0x7fe94400b860 comp rx=0 tx=0).stop 2023-07-14T11:15:57.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:57.784+0000 7fe9615ff700 1 -- 172.21.15.84:0/56973902 shutdown_connections 2023-07-14T11:15:57.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:57.784+0000 7fe9615ff700 1 --2- 172.21.15.84:0/56973902 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe93c06af20 0x7fe93c06d3d0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:57.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:57.784+0000 7fe9615ff700 1 --2- 172.21.15.84:0/56973902 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe95c0cd380 0x7fe95c1578c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:57.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:57.784+0000 7fe9615ff700 1 --2- 172.21.15.84:0/56973902 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe95c0b4570 0x7fe95c1594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:57.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:57.784+0000 7fe9615ff700 1 --2- 172.21.15.84:0/56973902 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe95c0ccf10 0x7fe95c15ad80 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:15:57.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:57.784+0000 7fe9615ff700 1 -- 172.21.15.84:0/56973902 >> 172.21.15.84:0/56973902 conn(0x7fe95c0b2ef0 msgr2=0x7fe95c0c6740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:15:57.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:57.784+0000 7fe9615ff700 1 -- 172.21.15.84:0/56973902 shutdown_connections 2023-07-14T11:15:57.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:15:57.784+0000 7fe9615ff700 1 -- 172.21.15.84:0/56973902 wait complete. 2023-07-14T11:15:57.788 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 28 2023-07-14T11:15:57.804 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2023-07-14T11:15:58.026 INFO:teuthology.orchestra.run.smithi084.stdout:[{"id":5925,"entity":{"name":{"type":"client","num":5925},"addr":{"type":"any","addr":"172.21.15.84:0","nonce":3353249595}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":11,"uptime":24.233551666,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":20.802656105853657,"halflife":300},"cap_acquisition":{"value":0,"halflife":10},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5925 172.21.15.84:0/3353249595","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000000fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"3fc0089cc1082313a98853d48b892acdc1385b8b","ceph_version":"ceph version 18.0.0-4757-g3fc0089c (3fc0089cc1082313a98853d48b892acdc1385b8b) reef (dev)","entity_id":"y","hostname":"smithi084","pid":"140843","root":"/"}}] 2023-07-14T11:15:58.026 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 10, "value": 0 }, "client_metadata": { "ceph_sha1": "3fc0089cc1082313a98853d48b892acdc1385b8b", "ceph_version": "ceph version 18.0.0-4757-g3fc0089c (3fc0089cc1082313a98853d48b892acdc1385b8b) reef (dev)", "client_features": { "feature_bits": "0x00000000000fffff" }, "entity_id": "y", "hostname": "smithi084", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "140843", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.84:0", "nonce": 3353249595, "type": "any" }, "name": { "num": 5925, "type": "client" } }, "id": 5925, "inst": "client.5925 172.21.15.84:0/3353249595", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 11, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 20.802656105853657 }, "state": "open", "uptime": 24.233551666 } ] 2023-07-14T11:15:58.027 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2023-07-14T11:16:03.028 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T11:16:03.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:03.232+0000 7fe994bff700 1 Processor -- start 2023-07-14T11:16:03.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:03.232+0000 7fe994bff700 1 -- start start 2023-07-14T11:16:03.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:03.233+0000 7fe994bff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe9901500d0 0x7fe990070350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:03.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:03.233+0000 7fe994bff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe990070890 0x7fe9901597c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:03.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:03.233+0000 7fe994bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe990159d00 0x7fe9900cea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:03.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:03.233+0000 7fe994bff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9900cdf90 con 0x7fe990070890 2023-07-14T11:16:03.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:03.233+0000 7fe994bff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe99015a2f0 con 0x7fe9901500d0 2023-07-14T11:16:03.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:03.233+0000 7fe994bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe99015a5d0 con 0x7fe990159d00 2023-07-14T11:16:03.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:03.233+0000 7fe98dd9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe990070890 0x7fe9901597c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:03.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:03.233+0000 7fe98dd9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe990070890 0x7fe9901597c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36268/0 (socket says 172.21.15.84:36268) 2023-07-14T11:16:03.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:03.233+0000 7fe98dd9b700 1 -- 172.21.15.84:0/3872549120 learned_addr learned my addr 172.21.15.84:0/3872549120 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:16:03.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:03.234+0000 7fe98e59c700 1 --2- 172.21.15.84:0/3872549120 >> v2:172.21.15.179:3300/0 conn(0x7fe9901500d0 0x7fe990070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:03.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:03.234+0000 7fe98ed9d700 1 --2- 172.21.15.84:0/3872549120 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe990159d00 0x7fe9900cea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:03.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:03.234+0000 7fe98dd9b700 1 -- 172.21.15.84:0/3872549120 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe990159d00 msgr2=0x7fe9900cea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:16:03.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:03.234+0000 7fe98dd9b700 1 --2- 172.21.15.84:0/3872549120 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe990159d00 0x7fe9900cea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:03.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:03.234+0000 7fe98dd9b700 1 -- 172.21.15.84:0/3872549120 >> v2:172.21.15.179:3300/0 conn(0x7fe9901500d0 msgr2=0x7fe990070350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:16:03.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:03.234+0000 7fe98dd9b700 1 --2- 172.21.15.84:0/3872549120 >> v2:172.21.15.179:3300/0 conn(0x7fe9901500d0 0x7fe990070350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:03.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:03.234+0000 7fe98dd9b700 1 -- 172.21.15.84:0/3872549120 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9900ce250 con 0x7fe990070890 2023-07-14T11:16:03.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:03.234+0000 7fe98ed9d700 1 --2- 172.21.15.84:0/3872549120 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe990159d00 0x7fe9900cea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:16:03.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:03.234+0000 7fe98dd9b700 1 --2- 172.21.15.84:0/3872549120 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe990070890 0x7fe9901597c0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fe99006fa00 tx=0x7fe984009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8caf661bebf633f2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:16:03.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:03.234+0000 7fe98d59a700 1 -- 172.21.15.84:0/3872549120 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe98400b870 con 0x7fe990070890 2023-07-14T11:16:03.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:03.234+0000 7fe98d59a700 1 -- 172.21.15.84:0/3872549120 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe98400b9d0 con 0x7fe990070890 2023-07-14T11:16:03.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:03.234+0000 7fe98d59a700 1 -- 172.21.15.84:0/3872549120 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe98400bd60 con 0x7fe990070890 2023-07-14T11:16:03.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:03.235+0000 7fe994bff700 1 -- 172.21.15.84:0/3872549120 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe990070890 msgr2=0x7fe9901597c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:03.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:03.235+0000 7fe994bff700 1 --2- 172.21.15.84:0/3872549120 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe990070890 0x7fe9901597c0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fe99006fa00 tx=0x7fe984009bd0 comp rx=0 tx=0).stop 2023-07-14T11:16:03.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:03.235+0000 7fe994bff700 1 -- 172.21.15.84:0/3872549120 shutdown_connections 2023-07-14T11:16:03.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:03.235+0000 7fe994bff700 1 --2- 172.21.15.84:0/3872549120 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe990159d00 0x7fe9900cea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:03.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:03.235+0000 7fe994bff700 1 --2- 172.21.15.84:0/3872549120 >> v2:172.21.15.179:3300/0 conn(0x7fe9901500d0 0x7fe990070350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:03.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:03.235+0000 7fe994bff700 1 --2- 172.21.15.84:0/3872549120 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe990070890 0x7fe9901597c0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:03.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:03.235+0000 7fe994bff700 1 -- 172.21.15.84:0/3872549120 >> 172.21.15.84:0/3872549120 conn(0x7fe990069f30 msgr2=0x7fe99006a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:16:03.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:03.235+0000 7fe994bff700 1 -- 172.21.15.84:0/3872549120 shutdown_connections 2023-07-14T11:16:03.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:03.235+0000 7fe994bff700 1 -- 172.21.15.84:0/3872549120 wait complete. 2023-07-14T11:16:03.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:03.237+0000 7fe994bff700 1 Processor -- start 2023-07-14T11:16:03.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:03.237+0000 7fe994bff700 1 -- start start 2023-07-14T11:16:03.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:03.238+0000 7fe994bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe990070890 0x7fe990142db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:03.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:03.238+0000 7fe994bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9901500d0 0x7fe99014bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:03.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:03.238+0000 7fe994bff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe990159d00 0x7fe99014e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:03.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:03.238+0000 7fe994bff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9901432f0 con 0x7fe990159d00 2023-07-14T11:16:03.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:03.238+0000 7fe994bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe99014d4a0 con 0x7fe990070890 2023-07-14T11:16:03.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:03.238+0000 7fe994bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe99014c890 con 0x7fe9901500d0 2023-07-14T11:16:03.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:03.238+0000 7fe98ed9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe990159d00 0x7fe99014e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:03.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:03.238+0000 7fe98ed9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe990159d00 0x7fe99014e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36270/0 (socket says 172.21.15.84:36270) 2023-07-14T11:16:03.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:03.238+0000 7fe98ed9d700 1 -- 172.21.15.84:0/4180260902 learned_addr learned my addr 172.21.15.84:0/4180260902 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:16:03.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:03.238+0000 7fe98ed9d700 1 -- 172.21.15.84:0/4180260902 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9901500d0 msgr2=0x7fe99014bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:03.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:03.238+0000 7fe98ed9d700 1 --2- 172.21.15.84:0/4180260902 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9901500d0 0x7fe99014bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:03.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:03.238+0000 7fe98ed9d700 1 -- 172.21.15.84:0/4180260902 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe990070890 msgr2=0x7fe990142db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:03.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:03.238+0000 7fe98ed9d700 1 --2- 172.21.15.84:0/4180260902 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe990070890 0x7fe990142db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:03.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:03.238+0000 7fe98ed9d700 1 -- 172.21.15.84:0/4180260902 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe984009550 con 0x7fe990159d00 2023-07-14T11:16:03.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:03.239+0000 7fe98ed9d700 1 --2- 172.21.15.84:0/4180260902 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe990159d00 0x7fe99014e460 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fe98800cd50 tx=0x7fe98800a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:16:03.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:03.239+0000 7fe97effd700 1 -- 172.21.15.84:0/4180260902 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe98800f480 con 0x7fe990159d00 2023-07-14T11:16:03.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:03.239+0000 7fe97effd700 1 -- 172.21.15.84:0/4180260902 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe98800f600 con 0x7fe990159d00 2023-07-14T11:16:03.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:03.239+0000 7fe994bff700 1 -- 172.21.15.84:0/4180260902 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe99014cb70 con 0x7fe990159d00 2023-07-14T11:16:03.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:03.239+0000 7fe97effd700 1 -- 172.21.15.84:0/4180260902 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe98800f9b0 con 0x7fe990159d00 2023-07-14T11:16:03.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:03.239+0000 7fe994bff700 1 -- 172.21.15.84:0/4180260902 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe99014d130 con 0x7fe990159d00 2023-07-14T11:16:03.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:03.240+0000 7fe994bff700 1 -- 172.21.15.84:0/4180260902 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe99004e280 con 0x7fe990159d00 2023-07-14T11:16:03.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:03.241+0000 7fe97effd700 1 -- 172.21.15.84:0/4180260902 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 8) v1 ==== 89241+0+0 (secure 0 0 0) 0x7fe98800b040 con 0x7fe990159d00 2023-07-14T11:16:03.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:03.242+0000 7fe97effd700 1 --2- 172.21.15.84:0/4180260902 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe97006af20 0x7fe97006d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:03.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:03.242+0000 7fe97effd700 1 -- 172.21.15.84:0/4180260902 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fe98808a300 con 0x7fe990159d00 2023-07-14T11:16:03.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:03.242+0000 7fe98e59c700 1 --2- 172.21.15.84:0/4180260902 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe97006af20 0x7fe97006d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:03.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:03.243+0000 7fe98e59c700 1 --2- 172.21.15.84:0/4180260902 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe97006af20 0x7fe97006d3d0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe9800097f0 tx=0x7fe980008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:16:03.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:03.247+0000 7fe97effd700 1 -- 172.21.15.84:0/4180260902 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe988054dd0 con 0x7fe990159d00 2023-07-14T11:16:03.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:03.484+0000 7fe994bff700 1 -- 172.21.15.84:0/4180260902 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe99014d5e0 con 0x7fe990159d00 2023-07-14T11:16:03.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:03.484+0000 7fe97effd700 1 -- 172.21.15.84:0/4180260902 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+4712 (secure 0 0 0) 0x7fe99014d5e0 con 0x7fe990159d00 2023-07-14T11:16:03.487 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:16:03.487 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5030,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3551222138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3551222138},{"type":"v1","addr":"172.21.15.179:6834","nonce":3551222138}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5036,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/1316665435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1316665435},{"type":"v1","addr":"172.21.15.84:6836","nonce":1316665435}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5416,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/611235750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":611235750},{"type":"v1","addr":"172.21.15.179:6835","nonce":611235750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T11:15:10.408480+0000","modified":"2023-07-14T11:15:13.936541+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5625},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5625":{"gid":5625,"name":"c","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/2672133286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":2672133286},{"type":"v1","addr":"172.21.15.84:6837","nonce":2672133286}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-14T11:16:03.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:03.487+0000 7fe994bff700 1 -- 172.21.15.84:0/4180260902 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe97006af20 msgr2=0x7fe97006d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:03.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:03.487+0000 7fe994bff700 1 --2- 172.21.15.84:0/4180260902 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe97006af20 0x7fe97006d3d0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe9800097f0 tx=0x7fe980008040 comp rx=0 tx=0).stop 2023-07-14T11:16:03.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:03.487+0000 7fe994bff700 1 -- 172.21.15.84:0/4180260902 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe990159d00 msgr2=0x7fe99014e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:03.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:03.487+0000 7fe994bff700 1 --2- 172.21.15.84:0/4180260902 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe990159d00 0x7fe99014e460 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fe98800cd50 tx=0x7fe98800a560 comp rx=0 tx=0).stop 2023-07-14T11:16:03.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:03.487+0000 7fe994bff700 1 -- 172.21.15.84:0/4180260902 shutdown_connections 2023-07-14T11:16:03.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:03.487+0000 7fe994bff700 1 --2- 172.21.15.84:0/4180260902 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe990159d00 0x7fe99014e460 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:03.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:03.487+0000 7fe994bff700 1 --2- 172.21.15.84:0/4180260902 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe990070890 0x7fe990142db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:03.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:03.487+0000 7fe994bff700 1 --2- 172.21.15.84:0/4180260902 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe97006af20 0x7fe97006d3d0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:03.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:03.487+0000 7fe994bff700 1 --2- 172.21.15.84:0/4180260902 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9901500d0 0x7fe99014bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:03.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:03.487+0000 7fe994bff700 1 -- 172.21.15.84:0/4180260902 >> 172.21.15.84:0/4180260902 conn(0x7fe990069f30 msgr2=0x7fe9901476b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:16:03.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:03.487+0000 7fe994bff700 1 -- 172.21.15.84:0/4180260902 shutdown_connections 2023-07-14T11:16:03.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:03.487+0000 7fe994bff700 1 -- 172.21.15.84:0/4180260902 wait complete. 2023-07-14T11:16:03.491 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 28 2023-07-14T11:16:03.507 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2023-07-14T11:16:03.725 INFO:teuthology.orchestra.run.smithi084.stdout:[{"id":5925,"entity":{"name":{"type":"client","num":5925},"addr":{"type":"any","addr":"172.21.15.84:0","nonce":3353249595}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":10,"uptime":29.932446763000002,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":20.530537920926438,"halflife":300},"cap_acquisition":{"value":0,"halflife":10},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5925 172.21.15.84:0/3353249595","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000000fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"3fc0089cc1082313a98853d48b892acdc1385b8b","ceph_version":"ceph version 18.0.0-4757-g3fc0089c (3fc0089cc1082313a98853d48b892acdc1385b8b) reef (dev)","entity_id":"y","hostname":"smithi084","pid":"140843","root":"/"}}] 2023-07-14T11:16:03.726 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 10, "value": 0 }, "client_metadata": { "ceph_sha1": "3fc0089cc1082313a98853d48b892acdc1385b8b", "ceph_version": "ceph version 18.0.0-4757-g3fc0089c (3fc0089cc1082313a98853d48b892acdc1385b8b) reef (dev)", "client_features": { "feature_bits": "0x00000000000fffff" }, "entity_id": "y", "hostname": "smithi084", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "140843", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.84:0", "nonce": 3353249595, "type": "any" }, "name": { "num": 5925, "type": "client" } }, "id": 5925, "inst": "client.5925 172.21.15.84:0/3353249595", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 10, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 20.530537920926438 }, "state": "open", "uptime": 29.932446763 } ] 2023-07-14T11:16:03.726 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2023-07-14T11:16:07.023 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T11:16:07.028 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T11:16:08.728 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T11:16:08.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:08.931+0000 7f804f5ff700 1 Processor -- start 2023-07-14T11:16:08.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:08.931+0000 7f804f5ff700 1 -- start start 2023-07-14T11:16:08.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:08.932+0000 7f804f5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80480b4510 0x7f80480b6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:08.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:08.932+0000 7f804f5ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f80480b5d90 0x7f80480cd590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:08.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:08.933+0000 7f804f5ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80480b7f50 con 0x7f80480d0b10 2023-07-14T11:16:08.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:08.933+0000 7f804f5ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80480b48e0 con 0x7f80480b5d90 2023-07-14T11:16:08.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:08.933+0000 7f804f5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80480b7340 con 0x7f80480b4510 2023-07-14T11:16:08.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:08.933+0000 7f804cb9a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f80480b5d90 0x7f80480cd590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:08.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:08.933+0000 7f804cb9a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f80480b5d90 0x7f80480cd590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36524/0 (socket says 172.21.15.84:36524) 2023-07-14T11:16:08.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:08.933+0000 7f804cb9a700 1 -- 172.21.15.84:0/1934530676 learned_addr learned my addr 172.21.15.84:0/1934530676 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:16:08.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:08.933+0000 7f804d39b700 1 --2- 172.21.15.84:0/1934530676 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80480b4510 0x7f80480b6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:08.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:08.933+0000 7f804cb9a700 1 -- 172.21.15.84:0/1934530676 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80480b4510 msgr2=0x7f80480b6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:16:08.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:08.933+0000 7f804cb9a700 1 --2- 172.21.15.84:0/1934530676 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80480b4510 0x7f80480b6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:08.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:08.933+0000 7f804cb9a700 1 -- 172.21.15.84:0/1934530676 >> v1:172.21.15.179:6789/0 conn(0x7f80480d0b10 legacy=0x7f80480b83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:08.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:08.933+0000 7f804cb9a700 1 -- 172.21.15.84:0/1934530676 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80480b7620 con 0x7f80480b5d90 2023-07-14T11:16:08.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:08.934+0000 7f804cb9a700 1 --2- 172.21.15.84:0/1934530676 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80480b5d90 0x7f80480cd590 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f80380098f0 tx=0x7f8038009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb66cd1346ab0f8e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:16:08.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:08.934+0000 7f803ffff700 1 -- 172.21.15.84:0/1934530676 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f803800b8a0 con 0x7f80480b5d90 2023-07-14T11:16:08.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:08.934+0000 7f803ffff700 1 -- 172.21.15.84:0/1934530676 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f803800ba00 con 0x7f80480b5d90 2023-07-14T11:16:08.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:08.934+0000 7f803ffff700 1 -- 172.21.15.84:0/1934530676 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f803800bd90 con 0x7f80480b5d90 2023-07-14T11:16:08.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:08.934+0000 7f804f5ff700 1 -- 172.21.15.84:0/1934530676 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80480b5d90 msgr2=0x7f80480cd590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:08.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:08.934+0000 7f804f5ff700 1 --2- 172.21.15.84:0/1934530676 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80480b5d90 0x7f80480cd590 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f80380098f0 tx=0x7f8038009c00 comp rx=0 tx=0).stop 2023-07-14T11:16:08.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:08.934+0000 7f804f5ff700 1 -- 172.21.15.84:0/1934530676 shutdown_connections 2023-07-14T11:16:08.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:08.934+0000 7f804f5ff700 1 --2- 172.21.15.84:0/1934530676 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80480b4510 0x7f80480b6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:08.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:08.934+0000 7f804f5ff700 1 --2- 172.21.15.84:0/1934530676 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80480b5d90 0x7f80480cd590 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:08.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:08.934+0000 7f804f5ff700 1 -- 172.21.15.84:0/1934530676 >> 172.21.15.84:0/1934530676 conn(0x7f804809c1d0 msgr2=0x7f80480d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:16:08.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:08.934+0000 7f804f5ff700 1 -- 172.21.15.84:0/1934530676 shutdown_connections 2023-07-14T11:16:08.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:08.935+0000 7f804f5ff700 1 -- 172.21.15.84:0/1934530676 wait complete. 2023-07-14T11:16:08.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:08.936+0000 7f804f5ff700 1 Processor -- start 2023-07-14T11:16:08.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:08.936+0000 7f804f5ff700 1 -- start start 2023-07-14T11:16:08.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:08.937+0000 7f804f5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80480b4510 0x7f80481f54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:08.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:08.937+0000 7f804f5ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80480b5d90 0x7f804813f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:08.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:08.937+0000 7f804f5ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80480d0b10 0x7f8048156530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:08.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:08.937+0000 7f804f5ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80480c8340 con 0x7f80480b5d90 2023-07-14T11:16:08.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:08.937+0000 7f804f5ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8048159940 con 0x7f80480d0b10 2023-07-14T11:16:08.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:08.937+0000 7f804f5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8048156a70 con 0x7f80480b4510 2023-07-14T11:16:08.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:08.938+0000 7f804cb9a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80480b5d90 0x7f804813f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:08.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:08.938+0000 7f804cb9a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80480b5d90 0x7f804813f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36528/0 (socket says 172.21.15.84:36528) 2023-07-14T11:16:08.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:08.938+0000 7f804cb9a700 1 -- 172.21.15.84:0/2532102720 learned_addr learned my addr 172.21.15.84:0/2532102720 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:16:08.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:08.938+0000 7f804d39b700 1 --2- 172.21.15.84:0/2532102720 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80480b4510 0x7f80481f54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:08.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:08.938+0000 7f804db9c700 1 --2- 172.21.15.84:0/2532102720 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80480d0b10 0x7f8048156530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:08.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:08.938+0000 7f804cb9a700 1 -- 172.21.15.84:0/2532102720 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80480b4510 msgr2=0x7f80481f54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:08.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:08.938+0000 7f804cb9a700 1 --2- 172.21.15.84:0/2532102720 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80480b4510 0x7f80481f54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:08.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:08.938+0000 7f804cb9a700 1 -- 172.21.15.84:0/2532102720 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80480d0b10 msgr2=0x7f8048156530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:08.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:08.938+0000 7f804cb9a700 1 --2- 172.21.15.84:0/2532102720 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80480d0b10 0x7f8048156530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:08.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:08.938+0000 7f804cb9a700 1 -- 172.21.15.84:0/2532102720 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8038009550 con 0x7f80480b5d90 2023-07-14T11:16:08.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:08.938+0000 7f804db9c700 1 --2- 172.21.15.84:0/2532102720 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80480d0b10 0x7f8048156530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:16:08.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:08.938+0000 7f804cb9a700 1 --2- 172.21.15.84:0/2532102720 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80480b5d90 0x7f804813f020 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f8038000c00 tx=0x7f8038004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:16:08.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:08.938+0000 7f803dffb700 1 -- 172.21.15.84:0/2532102720 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8038004590 con 0x7f80480b5d90 2023-07-14T11:16:08.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:08.938+0000 7f803dffb700 1 -- 172.21.15.84:0/2532102720 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f803801e070 con 0x7f80480b5d90 2023-07-14T11:16:08.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:08.938+0000 7f803dffb700 1 -- 172.21.15.84:0/2532102720 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80380038e0 con 0x7f80480b5d90 2023-07-14T11:16:08.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:08.939+0000 7f804f5ff700 1 -- 172.21.15.84:0/2532102720 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8048156110 con 0x7f80480b5d90 2023-07-14T11:16:08.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:08.939+0000 7f804f5ff700 1 -- 172.21.15.84:0/2532102720 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80480c7f60 con 0x7f80480b5d90 2023-07-14T11:16:08.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:08.940+0000 7f804f5ff700 1 -- 172.21.15.84:0/2532102720 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80480c7ac0 con 0x7f80480b5d90 2023-07-14T11:16:08.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:08.941+0000 7f803dffb700 1 -- 172.21.15.84:0/2532102720 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 8) v1 ==== 89241+0+0 (secure 0 0 0) 0x7f8038003a40 con 0x7f80480b5d90 2023-07-14T11:16:08.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:08.941+0000 7f803dffb700 1 --2- 172.21.15.84:0/2532102720 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f802c06af20 0x7f802c06d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:08.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:08.941+0000 7f803dffb700 1 -- 172.21.15.84:0/2532102720 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f8038020070 con 0x7f80480b5d90 2023-07-14T11:16:08.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:08.942+0000 7f804d39b700 1 --2- 172.21.15.84:0/2532102720 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f802c06af20 0x7f802c06d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:08.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:08.942+0000 7f804d39b700 1 --2- 172.21.15.84:0/2532102720 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f802c06af20 0x7f802c06d3d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f8044006fd0 tx=0x7f8044008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:16:08.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:08.946+0000 7f803dffb700 1 -- 172.21.15.84:0/2532102720 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f8038055980 con 0x7f80480b5d90 2023-07-14T11:16:09.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:09.184+0000 7f804f5ff700 1 -- 172.21.15.84:0/2532102720 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f80480c80f0 con 0x7f80480b5d90 2023-07-14T11:16:09.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:09.185+0000 7f803dffb700 1 -- 172.21.15.84:0/2532102720 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+4712 (secure 0 0 0) 0x7f8038058fa0 con 0x7f80480b5d90 2023-07-14T11:16:09.189 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:16:09.189 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5030,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3551222138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3551222138},{"type":"v1","addr":"172.21.15.179:6834","nonce":3551222138}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5036,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/1316665435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1316665435},{"type":"v1","addr":"172.21.15.84:6836","nonce":1316665435}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5416,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/611235750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":611235750},{"type":"v1","addr":"172.21.15.179:6835","nonce":611235750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T11:15:10.408480+0000","modified":"2023-07-14T11:15:13.936541+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5625},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5625":{"gid":5625,"name":"c","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/2672133286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":2672133286},{"type":"v1","addr":"172.21.15.84:6837","nonce":2672133286}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-14T11:16:09.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:09.187+0000 7f804f5ff700 1 -- 172.21.15.84:0/2532102720 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f802c06af20 msgr2=0x7f802c06d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:09.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:09.187+0000 7f804f5ff700 1 --2- 172.21.15.84:0/2532102720 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f802c06af20 0x7f802c06d3d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f8044006fd0 tx=0x7f8044008040 comp rx=0 tx=0).stop 2023-07-14T11:16:09.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:09.187+0000 7f804f5ff700 1 -- 172.21.15.84:0/2532102720 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80480b5d90 msgr2=0x7f804813f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:09.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:09.187+0000 7f804f5ff700 1 --2- 172.21.15.84:0/2532102720 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80480b5d90 0x7f804813f020 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f8038000c00 tx=0x7f8038004750 comp rx=0 tx=0).stop 2023-07-14T11:16:09.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:09.188+0000 7f804f5ff700 1 -- 172.21.15.84:0/2532102720 shutdown_connections 2023-07-14T11:16:09.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:09.188+0000 7f804f5ff700 1 --2- 172.21.15.84:0/2532102720 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f802c06af20 0x7f802c06d3d0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:09.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:09.188+0000 7f804f5ff700 1 --2- 172.21.15.84:0/2532102720 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80480b4510 0x7f80481f54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:09.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:09.188+0000 7f804f5ff700 1 --2- 172.21.15.84:0/2532102720 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80480d0b10 0x7f8048156530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:09.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:09.188+0000 7f804f5ff700 1 --2- 172.21.15.84:0/2532102720 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80480b5d90 0x7f804813f020 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:09.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:09.188+0000 7f804f5ff700 1 -- 172.21.15.84:0/2532102720 >> 172.21.15.84:0/2532102720 conn(0x7f804809c1d0 msgr2=0x7f804815fa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:16:09.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:09.188+0000 7f804f5ff700 1 -- 172.21.15.84:0/2532102720 shutdown_connections 2023-07-14T11:16:09.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:09.188+0000 7f804f5ff700 1 -- 172.21.15.84:0/2532102720 wait complete. 2023-07-14T11:16:09.193 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 28 2023-07-14T11:16:09.209 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2023-07-14T11:16:09.427 INFO:teuthology.orchestra.run.smithi084.stdout:[{"id":5925,"entity":{"name":{"type":"client","num":5925},"addr":{"type":"any","addr":"172.21.15.84:0","nonce":3353249595}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":9,"uptime":35.634341802999998,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":20.261838854008467,"halflife":300},"cap_acquisition":{"value":0,"halflife":10},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5925 172.21.15.84:0/3353249595","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000000fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"3fc0089cc1082313a98853d48b892acdc1385b8b","ceph_version":"ceph version 18.0.0-4757-g3fc0089c (3fc0089cc1082313a98853d48b892acdc1385b8b) reef (dev)","entity_id":"y","hostname":"smithi084","pid":"140843","root":"/"}}] 2023-07-14T11:16:09.428 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 10, "value": 0 }, "client_metadata": { "ceph_sha1": "3fc0089cc1082313a98853d48b892acdc1385b8b", "ceph_version": "ceph version 18.0.0-4757-g3fc0089c (3fc0089cc1082313a98853d48b892acdc1385b8b) reef (dev)", "client_features": { "feature_bits": "0x00000000000fffff" }, "entity_id": "y", "hostname": "smithi084", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "140843", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.84:0", "nonce": 3353249595, "type": "any" }, "name": { "num": 5925, "type": "client" } }, "id": 5925, "inst": "client.5925 172.21.15.84:0/3353249595", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 9, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 20.261838854008467 }, "state": "open", "uptime": 35.634341803 } ] 2023-07-14T11:16:09.428 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2023-07-14T11:16:14.429 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T11:16:14.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.631+0000 7fe0b51ff700 1 Processor -- start 2023-07-14T11:16:14.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.632+0000 7fe0b51ff700 1 -- start start 2023-07-14T11:16:14.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.633+0000 7fe0b51ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe0b0160030 0x7fe0b006c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:14.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.633+0000 7fe0b51ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0b00b5cd0 0x7fe0b00d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:14.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.633+0000 7fe0b51ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe0b00b1f70 0x7fe0b00d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:14.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.633+0000 7fe0b51ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0b00d2cc0 con 0x7fe0b0160030 2023-07-14T11:16:14.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.633+0000 7fe0b51ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0b00afbb0 con 0x7fe0b00b1f70 2023-07-14T11:16:14.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.633+0000 7fe0b51ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b00afe90 con 0x7fe0b00b5cd0 2023-07-14T11:16:14.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.633+0000 7fe0aed9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe0b0160030 0x7fe0b006c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:14.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.633+0000 7fe0aed9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe0b0160030 0x7fe0b006c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36536/0 (socket says 172.21.15.84:36536) 2023-07-14T11:16:14.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.633+0000 7fe0aed9d700 1 -- 172.21.15.84:0/1928048959 learned_addr learned my addr 172.21.15.84:0/1928048959 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:16:14.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.633+0000 7fe0ae59c700 1 --2- 172.21.15.84:0/1928048959 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0b00b5cd0 0x7fe0b00d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:14.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.633+0000 7fe0af59e700 1 --2- 172.21.15.84:0/1928048959 >> v2:172.21.15.179:3300/0 conn(0x7fe0b00b1f70 0x7fe0b00d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:14.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.633+0000 7fe0aed9d700 1 -- 172.21.15.84:0/1928048959 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0b00b5cd0 msgr2=0x7fe0b00d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:16:14.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.633+0000 7fe0aed9d700 1 --2- 172.21.15.84:0/1928048959 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0b00b5cd0 0x7fe0b00d0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:14.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.633+0000 7fe0aed9d700 1 -- 172.21.15.84:0/1928048959 >> v2:172.21.15.179:3300/0 conn(0x7fe0b00b1f70 msgr2=0x7fe0b00d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:16:14.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.633+0000 7fe0aed9d700 1 --2- 172.21.15.84:0/1928048959 >> v2:172.21.15.179:3300/0 conn(0x7fe0b00b1f70 0x7fe0b00d0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:14.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.633+0000 7fe0aed9d700 1 -- 172.21.15.84:0/1928048959 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b00b0170 con 0x7fe0b0160030 2023-07-14T11:16:14.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.633+0000 7fe0af59e700 1 --2- 172.21.15.84:0/1928048959 >> v2:172.21.15.179:3300/0 conn(0x7fe0b00b1f70 0x7fe0b00d0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:16:14.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.634+0000 7fe0aed9d700 1 --2- 172.21.15.84:0/1928048959 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0b0160030 0x7fe0b006c0f0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fe0b008c2c0 tx=0x7fe0a0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6fecf2f29afa912 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:16:14.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.634+0000 7fe0add9b700 1 -- 172.21.15.84:0/1928048959 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a000b870 con 0x7fe0b0160030 2023-07-14T11:16:14.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.634+0000 7fe0add9b700 1 -- 172.21.15.84:0/1928048959 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0a000b9d0 con 0x7fe0b0160030 2023-07-14T11:16:14.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.634+0000 7fe0add9b700 1 -- 172.21.15.84:0/1928048959 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a000bd60 con 0x7fe0b0160030 2023-07-14T11:16:14.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.634+0000 7fe0b51ff700 1 -- 172.21.15.84:0/1928048959 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0b0160030 msgr2=0x7fe0b006c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:14.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.634+0000 7fe0b51ff700 1 --2- 172.21.15.84:0/1928048959 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0b0160030 0x7fe0b006c0f0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fe0b008c2c0 tx=0x7fe0a0009bd0 comp rx=0 tx=0).stop 2023-07-14T11:16:14.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.635+0000 7fe0b51ff700 1 -- 172.21.15.84:0/1928048959 shutdown_connections 2023-07-14T11:16:14.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.635+0000 7fe0b51ff700 1 --2- 172.21.15.84:0/1928048959 >> v2:172.21.15.179:3300/0 conn(0x7fe0b00b1f70 0x7fe0b00d0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:14.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.635+0000 7fe0b51ff700 1 --2- 172.21.15.84:0/1928048959 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0b0160030 0x7fe0b006c0f0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:14.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.635+0000 7fe0b51ff700 1 --2- 172.21.15.84:0/1928048959 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0b00b5cd0 0x7fe0b00d0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:14.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.635+0000 7fe0b51ff700 1 -- 172.21.15.84:0/1928048959 >> 172.21.15.84:0/1928048959 conn(0x7fe0b009c190 msgr2=0x7fe0b00d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:16:14.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.635+0000 7fe0b51ff700 1 -- 172.21.15.84:0/1928048959 shutdown_connections 2023-07-14T11:16:14.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.635+0000 7fe0b51ff700 1 -- 172.21.15.84:0/1928048959 wait complete. 2023-07-14T11:16:14.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.636+0000 7fe0b51ff700 1 Processor -- start 2023-07-14T11:16:14.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.636+0000 7fe0b51ff700 1 -- start start 2023-07-14T11:16:14.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.637+0000 7fe0b51ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0b00b1f70 0x7fe0b00c9f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:14.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.637+0000 7fe0b51ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0b00b5cd0 0x7fe0b0154190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:14.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.637+0000 7fe0b51ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0b0160030 0x7fe0b009d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:14.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.637+0000 7fe0b51ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b01546d0 con 0x7fe0b00b1f70 2023-07-14T11:16:14.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.637+0000 7fe0b51ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b00ca530 con 0x7fe0b0160030 2023-07-14T11:16:14.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.637+0000 7fe0b51ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b009dff0 con 0x7fe0b00b5cd0 2023-07-14T11:16:14.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.637+0000 7fe0aed9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0b00b1f70 0x7fe0b00c9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:14.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.638+0000 7fe0aed9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0b00b1f70 0x7fe0b00c9f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36550/0 (socket says 172.21.15.84:36550) 2023-07-14T11:16:14.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.638+0000 7fe0aed9d700 1 -- 172.21.15.84:0/680623882 learned_addr learned my addr 172.21.15.84:0/680623882 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:16:14.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.638+0000 7fe0ae59c700 1 --2- 172.21.15.84:0/680623882 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0b00b5cd0 0x7fe0b0154190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:14.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.638+0000 7fe0af59e700 1 --2- 172.21.15.84:0/680623882 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0b0160030 0x7fe0b009d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:14.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.638+0000 7fe0aed9d700 1 -- 172.21.15.84:0/680623882 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0b00b5cd0 msgr2=0x7fe0b0154190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:14.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.638+0000 7fe0aed9d700 1 --2- 172.21.15.84:0/680623882 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0b00b5cd0 0x7fe0b0154190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:14.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.638+0000 7fe0aed9d700 1 -- 172.21.15.84:0/680623882 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0b0160030 msgr2=0x7fe0b009d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:14.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.638+0000 7fe0aed9d700 1 --2- 172.21.15.84:0/680623882 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0b0160030 0x7fe0b009d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:14.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.638+0000 7fe0aed9d700 1 -- 172.21.15.84:0/680623882 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a0009550 con 0x7fe0b00b1f70 2023-07-14T11:16:14.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.638+0000 7fe0aed9d700 1 --2- 172.21.15.84:0/680623882 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0b00b1f70 0x7fe0b00c9f50 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fe0a0000c00 tx=0x7fe0a0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:16:14.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.638+0000 7fe0977fe700 1 -- 172.21.15.84:0/680623882 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a0004520 con 0x7fe0b00b1f70 2023-07-14T11:16:14.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.638+0000 7fe0977fe700 1 -- 172.21.15.84:0/680623882 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0a001e070 con 0x7fe0b00b1f70 2023-07-14T11:16:14.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.638+0000 7fe0b51ff700 1 -- 172.21.15.84:0/680623882 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0b009e2d0 con 0x7fe0b00b1f70 2023-07-14T11:16:14.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.638+0000 7fe0977fe700 1 -- 172.21.15.84:0/680623882 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a00038c0 con 0x7fe0b00b1f70 2023-07-14T11:16:14.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.638+0000 7fe0b51ff700 1 -- 172.21.15.84:0/680623882 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0b009e890 con 0x7fe0b00b1f70 2023-07-14T11:16:14.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.639+0000 7fe0b51ff700 1 -- 172.21.15.84:0/680623882 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0b004e280 con 0x7fe0b00b1f70 2023-07-14T11:16:14.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.640+0000 7fe0977fe700 1 -- 172.21.15.84:0/680623882 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 8) v1 ==== 89241+0+0 (secure 0 0 0) 0x7fe0a0003a20 con 0x7fe0b00b1f70 2023-07-14T11:16:14.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.641+0000 7fe0977fe700 1 --2- 172.21.15.84:0/680623882 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe09c06af20 0x7fe09c06d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:14.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.641+0000 7fe0977fe700 1 -- 172.21.15.84:0/680623882 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fe0a0020070 con 0x7fe0b00b1f70 2023-07-14T11:16:14.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.641+0000 7fe0ae59c700 1 --2- 172.21.15.84:0/680623882 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe09c06af20 0x7fe09c06d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:14.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.642+0000 7fe0ae59c700 1 --2- 172.21.15.84:0/680623882 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe09c06af20 0x7fe09c06d3d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe0b01f5190 tx=0x7fe0a4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:16:14.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.646+0000 7fe0977fe700 1 -- 172.21.15.84:0/680623882 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe0a0055af0 con 0x7fe0b00b1f70 2023-07-14T11:16:14.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.882+0000 7fe0b51ff700 1 -- 172.21.15.84:0/680623882 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe0b00d38c0 con 0x7fe0b00b1f70 2023-07-14T11:16:14.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.882+0000 7fe0977fe700 1 -- 172.21.15.84:0/680623882 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+4712 (secure 0 0 0) 0x7fe0a0015090 con 0x7fe0b00b1f70 2023-07-14T11:16:14.887 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:16:14.887 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5030,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3551222138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3551222138},{"type":"v1","addr":"172.21.15.179:6834","nonce":3551222138}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5036,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/1316665435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1316665435},{"type":"v1","addr":"172.21.15.84:6836","nonce":1316665435}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5416,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/611235750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":611235750},{"type":"v1","addr":"172.21.15.179:6835","nonce":611235750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T11:15:10.408480+0000","modified":"2023-07-14T11:15:13.936541+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5625},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5625":{"gid":5625,"name":"c","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/2672133286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":2672133286},{"type":"v1","addr":"172.21.15.84:6837","nonce":2672133286}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-14T11:16:14.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.885+0000 7fe0b51ff700 1 -- 172.21.15.84:0/680623882 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe09c06af20 msgr2=0x7fe09c06d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:14.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.885+0000 7fe0b51ff700 1 --2- 172.21.15.84:0/680623882 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe09c06af20 0x7fe09c06d3d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe0b01f5190 tx=0x7fe0a4008040 comp rx=0 tx=0).stop 2023-07-14T11:16:14.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.885+0000 7fe0b51ff700 1 -- 172.21.15.84:0/680623882 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0b00b1f70 msgr2=0x7fe0b00c9f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:14.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.885+0000 7fe0b51ff700 1 --2- 172.21.15.84:0/680623882 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0b00b1f70 0x7fe0b00c9f50 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fe0a0000c00 tx=0x7fe0a0004750 comp rx=0 tx=0).stop 2023-07-14T11:16:14.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.885+0000 7fe0b51ff700 1 -- 172.21.15.84:0/680623882 shutdown_connections 2023-07-14T11:16:14.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.885+0000 7fe0b51ff700 1 --2- 172.21.15.84:0/680623882 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0b0160030 0x7fe0b009d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:14.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.885+0000 7fe0b51ff700 1 --2- 172.21.15.84:0/680623882 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0b00b1f70 0x7fe0b00c9f50 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:14.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.885+0000 7fe0b51ff700 1 --2- 172.21.15.84:0/680623882 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe09c06af20 0x7fe09c06d3d0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:14.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.885+0000 7fe0b51ff700 1 --2- 172.21.15.84:0/680623882 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0b00b5cd0 0x7fe0b0154190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:14.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.885+0000 7fe0b51ff700 1 -- 172.21.15.84:0/680623882 >> 172.21.15.84:0/680623882 conn(0x7fe0b009c190 msgr2=0x7fe0b006ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:16:14.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.885+0000 7fe0b51ff700 1 -- 172.21.15.84:0/680623882 shutdown_connections 2023-07-14T11:16:14.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:14.885+0000 7fe0b51ff700 1 -- 172.21.15.84:0/680623882 wait complete. 2023-07-14T11:16:14.892 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 28 2023-07-14T11:16:14.906 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2023-07-14T11:16:15.127 INFO:teuthology.orchestra.run.smithi084.stdout:[{"id":5925,"entity":{"name":{"type":"client","num":5925},"addr":{"type":"any","addr":"172.21.15.84:0","nonce":3353249595}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":9,"uptime":41.334236879000002,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":19.996748862823154,"halflife":300},"cap_acquisition":{"value":0,"halflife":10},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5925 172.21.15.84:0/3353249595","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000000fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"3fc0089cc1082313a98853d48b892acdc1385b8b","ceph_version":"ceph version 18.0.0-4757-g3fc0089c (3fc0089cc1082313a98853d48b892acdc1385b8b) reef (dev)","entity_id":"y","hostname":"smithi084","pid":"140843","root":"/"}}] 2023-07-14T11:16:15.127 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 10, "value": 0 }, "client_metadata": { "ceph_sha1": "3fc0089cc1082313a98853d48b892acdc1385b8b", "ceph_version": "ceph version 18.0.0-4757-g3fc0089c (3fc0089cc1082313a98853d48b892acdc1385b8b) reef (dev)", "client_features": { "feature_bits": "0x00000000000fffff" }, "entity_id": "y", "hostname": "smithi084", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "140843", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.84:0", "nonce": 3353249595, "type": "any" }, "name": { "num": 5925, "type": "client" } }, "id": 5925, "inst": "client.5925 172.21.15.84:0/3353249595", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 9, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 19.996748862823154 }, "state": "open", "uptime": 41.334236879 } ] 2023-07-14T11:16:15.128 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2023-07-14T11:16:20.129 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T11:16:20.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:20.334+0000 7f3a1adff700 1 Processor -- start 2023-07-14T11:16:20.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:20.334+0000 7f3a1adff700 1 -- start start 2023-07-14T11:16:20.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:20.335+0000 7f3a1adff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3a140b4510 0x7f3a140b6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:20.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:20.336+0000 7f3a1adff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3a140d0b10 0x7f3a140d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:20.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:20.336+0000 7f3a1adff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a140b7f50 con 0x7f3a140b5d90 2023-07-14T11:16:20.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:20.336+0000 7f3a1adff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a140b48e0 con 0x7f3a140d0b10 2023-07-14T11:16:20.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:20.336+0000 7f3a1adff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a140d14d0 con 0x7f3a140b4510 2023-07-14T11:16:20.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:20.336+0000 7f3a1939c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3a140d0b10 0x7f3a140d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:20.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:20.336+0000 7f3a1939c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3a140d0b10 0x7f3a140d0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60066/0 (socket says 172.21.15.84:60066) 2023-07-14T11:16:20.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:20.336+0000 7f3a1939c700 1 -- 172.21.15.84:0/166151437 learned_addr learned my addr 172.21.15.84:0/166151437 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:16:20.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:20.336+0000 7f3a18b9b700 1 --2- 172.21.15.84:0/166151437 >> v2:172.21.15.179:3300/0 conn(0x7f3a140b4510 0x7f3a140b6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:20.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:20.336+0000 7f3a1939c700 1 -- 172.21.15.84:0/166151437 >> v2:172.21.15.179:3300/0 conn(0x7f3a140b4510 msgr2=0x7f3a140b6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:16:20.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:20.336+0000 7f3a1939c700 1 --2- 172.21.15.84:0/166151437 >> v2:172.21.15.179:3300/0 conn(0x7f3a140b4510 0x7f3a140b6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:20.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:20.336+0000 7f3a1939c700 1 -- 172.21.15.84:0/166151437 >> v1:172.21.15.179:6789/0 conn(0x7f3a140b5d90 legacy=0x7f3a140cd590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:20.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:20.336+0000 7f3a1939c700 1 -- 172.21.15.84:0/166151437 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a140cdca0 con 0x7f3a140d0b10 2023-07-14T11:16:20.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:20.337+0000 7f3a1939c700 1 --2- 172.21.15.84:0/166151437 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a140d0b10 0x7f3a140d0f90 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f3a1408bd80 tx=0x7f3a0c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38e39377e63fc657 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:16:20.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:20.337+0000 7f3a137fe700 1 -- 172.21.15.84:0/166151437 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c00e070 con 0x7f3a140d0b10 2023-07-14T11:16:20.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:20.337+0000 7f3a137fe700 1 -- 172.21.15.84:0/166151437 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a0c00b9c0 con 0x7f3a140d0b10 2023-07-14T11:16:20.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:20.337+0000 7f3a137fe700 1 -- 172.21.15.84:0/166151437 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c00bd70 con 0x7f3a140d0b10 2023-07-14T11:16:20.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:20.337+0000 7f3a1adff700 1 -- 172.21.15.84:0/166151437 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a140d0b10 msgr2=0x7f3a140d0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:20.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:20.337+0000 7f3a1adff700 1 --2- 172.21.15.84:0/166151437 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a140d0b10 0x7f3a140d0f90 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f3a1408bd80 tx=0x7f3a0c00b330 comp rx=0 tx=0).stop 2023-07-14T11:16:20.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:20.337+0000 7f3a1adff700 1 -- 172.21.15.84:0/166151437 shutdown_connections 2023-07-14T11:16:20.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:20.337+0000 7f3a1adff700 1 --2- 172.21.15.84:0/166151437 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a140d0b10 0x7f3a140d0f90 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:20.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:20.337+0000 7f3a1adff700 1 --2- 172.21.15.84:0/166151437 >> v2:172.21.15.179:3300/0 conn(0x7f3a140b4510 0x7f3a140b6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:20.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:20.337+0000 7f3a1adff700 1 -- 172.21.15.84:0/166151437 >> 172.21.15.84:0/166151437 conn(0x7f3a1409c1d0 msgr2=0x7f3a140d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:16:20.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:20.338+0000 7f3a1adff700 1 -- 172.21.15.84:0/166151437 shutdown_connections 2023-07-14T11:16:20.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:20.338+0000 7f3a1adff700 1 -- 172.21.15.84:0/166151437 wait complete. 2023-07-14T11:16:20.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:20.339+0000 7f3a1adff700 1 Processor -- start 2023-07-14T11:16:20.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:20.339+0000 7f3a1adff700 1 -- start start 2023-07-14T11:16:20.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:20.340+0000 7f3a1adff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a140b4510 0x7f3a14150f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:20.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:20.340+0000 7f3a1adff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a140b5d90 0x7f3a141575d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:20.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:20.340+0000 7f3a1adff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a140d0b10 0x7f3a14157b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:20.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:20.340+0000 7f3a1adff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a14156a70 con 0x7f3a140b5d90 2023-07-14T11:16:20.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:20.340+0000 7f3a1adff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a14158420 con 0x7f3a140b4510 2023-07-14T11:16:20.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:20.340+0000 7f3a1adff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a14156490 con 0x7f3a140d0b10 2023-07-14T11:16:20.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:20.341+0000 7f3a13fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a140b5d90 0x7f3a141575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:20.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:20.341+0000 7f3a13fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a140b5d90 0x7f3a141575d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60070/0 (socket says 172.21.15.84:60070) 2023-07-14T11:16:20.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:20.341+0000 7f3a13fff700 1 -- 172.21.15.84:0/1141386579 learned_addr learned my addr 172.21.15.84:0/1141386579 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:16:20.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:20.341+0000 7f3a18b9b700 1 --2- 172.21.15.84:0/1141386579 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a140b4510 0x7f3a14150f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:20.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:20.341+0000 7f3a1939c700 1 --2- 172.21.15.84:0/1141386579 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a140d0b10 0x7f3a14157b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:20.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:20.341+0000 7f3a13fff700 1 -- 172.21.15.84:0/1141386579 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a140d0b10 msgr2=0x7f3a14157b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:20.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:20.341+0000 7f3a13fff700 1 --2- 172.21.15.84:0/1141386579 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a140d0b10 0x7f3a14157b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:20.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:20.341+0000 7f3a13fff700 1 -- 172.21.15.84:0/1141386579 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a140b4510 msgr2=0x7f3a14150f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:20.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:20.341+0000 7f3a13fff700 1 --2- 172.21.15.84:0/1141386579 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a140b4510 0x7f3a14150f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:20.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:20.341+0000 7f3a13fff700 1 -- 172.21.15.84:0/1141386579 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a0c009b30 con 0x7f3a140b5d90 2023-07-14T11:16:20.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:20.341+0000 7f3a13fff700 1 --2- 172.21.15.84:0/1141386579 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a140b5d90 0x7f3a141575d0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f3a0000c480 tx=0x7f3a0000c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:16:20.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:20.342+0000 7f3a117fa700 1 -- 172.21.15.84:0/1141386579 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a000052d0 con 0x7f3a140b5d90 2023-07-14T11:16:20.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:20.342+0000 7f3a117fa700 1 -- 172.21.15.84:0/1141386579 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a00005430 con 0x7f3a140b5d90 2023-07-14T11:16:20.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:20.342+0000 7f3a117fa700 1 -- 172.21.15.84:0/1141386579 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a000038c0 con 0x7f3a140b5d90 2023-07-14T11:16:20.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:20.342+0000 7f3a1adff700 1 -- 172.21.15.84:0/1141386579 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a140c6dc0 con 0x7f3a140b5d90 2023-07-14T11:16:20.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:20.342+0000 7f3a1adff700 1 -- 172.21.15.84:0/1141386579 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a140c6a70 con 0x7f3a140b5d90 2023-07-14T11:16:20.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:20.343+0000 7f3a1adff700 1 -- 172.21.15.84:0/1141386579 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a14156c20 con 0x7f3a140b5d90 2023-07-14T11:16:20.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:20.344+0000 7f3a117fa700 1 -- 172.21.15.84:0/1141386579 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 8) v1 ==== 89241+0+0 (secure 0 0 0) 0x7f3a00003a20 con 0x7f3a140b5d90 2023-07-14T11:16:20.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:20.345+0000 7f3a117fa700 1 --2- 172.21.15.84:0/1141386579 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f39f806af20 0x7f39f806d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:20.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:20.345+0000 7f3a117fa700 1 -- 172.21.15.84:0/1141386579 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f3a00088b60 con 0x7f3a140b5d90 2023-07-14T11:16:20.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:20.345+0000 7f3a18b9b700 1 --2- 172.21.15.84:0/1141386579 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f39f806af20 0x7f39f806d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:20.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:20.346+0000 7f3a18b9b700 1 --2- 172.21.15.84:0/1141386579 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f39f806af20 0x7f39f806d3d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3a08006fd0 tx=0x7f3a08008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:16:20.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:20.349+0000 7f3a117fa700 1 -- 172.21.15.84:0/1141386579 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3a14156c20 con 0x7f3a140b5d90 2023-07-14T11:16:20.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:20.585+0000 7f3a1adff700 1 -- 172.21.15.84:0/1141386579 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3a14156c20 con 0x7f3a140b5d90 2023-07-14T11:16:20.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:20.586+0000 7f3a117fa700 1 -- 172.21.15.84:0/1141386579 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+4712 (secure 0 0 0) 0x7f3a14156c20 con 0x7f3a140b5d90 2023-07-14T11:16:20.588 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:16:20.589 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5030,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3551222138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3551222138},{"type":"v1","addr":"172.21.15.179:6834","nonce":3551222138}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5036,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/1316665435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1316665435},{"type":"v1","addr":"172.21.15.84:6836","nonce":1316665435}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5416,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/611235750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":611235750},{"type":"v1","addr":"172.21.15.179:6835","nonce":611235750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T11:15:10.408480+0000","modified":"2023-07-14T11:15:13.936541+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5625},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5625":{"gid":5625,"name":"c","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/2672133286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":2672133286},{"type":"v1","addr":"172.21.15.84:6837","nonce":2672133286}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-14T11:16:20.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:20.588+0000 7f3a1adff700 1 -- 172.21.15.84:0/1141386579 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f39f806af20 msgr2=0x7f39f806d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:20.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:20.588+0000 7f3a1adff700 1 --2- 172.21.15.84:0/1141386579 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f39f806af20 0x7f39f806d3d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3a08006fd0 tx=0x7f3a08008040 comp rx=0 tx=0).stop 2023-07-14T11:16:20.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:20.588+0000 7f3a1adff700 1 -- 172.21.15.84:0/1141386579 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a140b5d90 msgr2=0x7f3a141575d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:20.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:20.588+0000 7f3a1adff700 1 --2- 172.21.15.84:0/1141386579 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a140b5d90 0x7f3a141575d0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f3a0000c480 tx=0x7f3a0000c790 comp rx=0 tx=0).stop 2023-07-14T11:16:20.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:20.588+0000 7f3a1adff700 1 -- 172.21.15.84:0/1141386579 shutdown_connections 2023-07-14T11:16:20.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:20.588+0000 7f3a1adff700 1 --2- 172.21.15.84:0/1141386579 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f39f806af20 0x7f39f806d3d0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:20.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:20.588+0000 7f3a1adff700 1 --2- 172.21.15.84:0/1141386579 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a140d0b10 0x7f3a14157b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:20.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:20.588+0000 7f3a1adff700 1 --2- 172.21.15.84:0/1141386579 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a140b4510 0x7f3a14150f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:20.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:20.588+0000 7f3a1adff700 1 --2- 172.21.15.84:0/1141386579 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a140b5d90 0x7f3a141575d0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:20.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:20.588+0000 7f3a1adff700 1 -- 172.21.15.84:0/1141386579 >> 172.21.15.84:0/1141386579 conn(0x7f3a1409c1d0 msgr2=0x7f3a140cf180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:16:20.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:20.588+0000 7f3a1adff700 1 -- 172.21.15.84:0/1141386579 shutdown_connections 2023-07-14T11:16:20.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:20.588+0000 7f3a1adff700 1 -- 172.21.15.84:0/1141386579 wait complete. 2023-07-14T11:16:20.592 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 28 2023-07-14T11:16:20.608 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2023-07-14T11:16:20.828 INFO:teuthology.orchestra.run.smithi084.stdout:[{"id":5925,"entity":{"name":{"type":"client","num":5925},"addr":{"type":"any","addr":"172.21.15.84:0","nonce":3353249595}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":8,"uptime":47.036131920999999,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":19.735035907059384,"halflife":300},"cap_acquisition":{"value":0,"halflife":10},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5925 172.21.15.84:0/3353249595","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000000fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"3fc0089cc1082313a98853d48b892acdc1385b8b","ceph_version":"ceph version 18.0.0-4757-g3fc0089c (3fc0089cc1082313a98853d48b892acdc1385b8b) reef (dev)","entity_id":"y","hostname":"smithi084","pid":"140843","root":"/"}}] 2023-07-14T11:16:20.828 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 10, "value": 0 }, "client_metadata": { "ceph_sha1": "3fc0089cc1082313a98853d48b892acdc1385b8b", "ceph_version": "ceph version 18.0.0-4757-g3fc0089c (3fc0089cc1082313a98853d48b892acdc1385b8b) reef (dev)", "client_features": { "feature_bits": "0x00000000000fffff" }, "entity_id": "y", "hostname": "smithi084", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "140843", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.84:0", "nonce": 3353249595, "type": "any" }, "name": { "num": 5925, "type": "client" } }, "id": 5925, "inst": "client.5925 172.21.15.84:0/3353249595", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 8, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 19.735035907059384 }, "state": "open", "uptime": 47.036131921 } ] 2023-07-14T11:16:20.829 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2023-07-14T11:16:25.829 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T11:16:26.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:26.033+0000 7f57a0bff700 1 Processor -- start 2023-07-14T11:16:26.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:26.033+0000 7f57a0bff700 1 -- start start 2023-07-14T11:16:26.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:26.034+0000 7f57a0bff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f579c15e890 0x7f579c0cee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:26.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:26.034+0000 7f57a0bff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f579c15afd0 0x7f579c0b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:26.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:26.034+0000 7f57a0bff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f579c15b430 con 0x7f579c0b3780 2023-07-14T11:16:26.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:26.034+0000 7f57a0bff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f579c0cf380 con 0x7f579c15e890 2023-07-14T11:16:26.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:26.034+0000 7f57a0bff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f579c0b4130 con 0x7f579c15afd0 2023-07-14T11:16:26.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:26.034+0000 7f579a59c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f579c15e890 0x7f579c0cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:26.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:26.034+0000 7f579a59c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f579c15e890 0x7f579c0cee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60084/0 (socket says 172.21.15.84:60084) 2023-07-14T11:16:26.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:26.034+0000 7f579a59c700 1 -- 172.21.15.84:0/2164572971 learned_addr learned my addr 172.21.15.84:0/2164572971 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:16:26.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:26.035+0000 7f579ad9d700 1 --2- 172.21.15.84:0/2164572971 >> v2:172.21.15.179:3300/0 conn(0x7f579c15afd0 0x7f579c0b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:26.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:26.035+0000 7f579a59c700 1 -- 172.21.15.84:0/2164572971 >> v2:172.21.15.179:3300/0 conn(0x7f579c15afd0 msgr2=0x7f579c0b3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:16:26.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:26.035+0000 7f579a59c700 1 --2- 172.21.15.84:0/2164572971 >> v2:172.21.15.179:3300/0 conn(0x7f579c15afd0 0x7f579c0b3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:26.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:26.035+0000 7f579a59c700 1 -- 172.21.15.84:0/2164572971 >> v1:172.21.15.179:6789/0 conn(0x7f579c0b3780 legacy=0x7f579c15a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:16:26.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:26.035+0000 7f579a59c700 1 -- 172.21.15.84:0/2164572971 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f579c0ce110 con 0x7f579c15e890 2023-07-14T11:16:26.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:26.035+0000 7f579a59c700 1 --2- 172.21.15.84:0/2164572971 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f579c15e890 0x7f579c0cee40 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f579c071ce0 tx=0x7f578c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8e7c3752c06bd63 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:16:26.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:26.035+0000 7f579959a700 1 -- 172.21.15.84:0/2164572971 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f578c00b860 con 0x7f579c15e890 2023-07-14T11:16:26.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:26.036+0000 7f579959a700 1 -- 172.21.15.84:0/2164572971 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f578c00b9c0 con 0x7f579c15e890 2023-07-14T11:16:26.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:26.036+0000 7f579959a700 1 -- 172.21.15.84:0/2164572971 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f578c00bd50 con 0x7f579c15e890 2023-07-14T11:16:26.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:26.036+0000 7f57a0bff700 1 -- 172.21.15.84:0/2164572971 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f579c15e890 msgr2=0x7f579c0cee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:26.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:26.036+0000 7f57a0bff700 1 --2- 172.21.15.84:0/2164572971 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f579c15e890 0x7f579c0cee40 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f579c071ce0 tx=0x7f578c009c00 comp rx=0 tx=0).stop 2023-07-14T11:16:26.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:26.036+0000 7f57a0bff700 1 -- 172.21.15.84:0/2164572971 shutdown_connections 2023-07-14T11:16:26.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:26.036+0000 7f57a0bff700 1 --2- 172.21.15.84:0/2164572971 >> v2:172.21.15.179:3300/0 conn(0x7f579c15afd0 0x7f579c0b3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:26.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:26.036+0000 7f57a0bff700 1 --2- 172.21.15.84:0/2164572971 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f579c15e890 0x7f579c0cee40 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:26.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:26.036+0000 7f57a0bff700 1 -- 172.21.15.84:0/2164572971 >> 172.21.15.84:0/2164572971 conn(0x7f579c069f30 msgr2=0x7f579c06a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:16:26.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:26.036+0000 7f57a0bff700 1 -- 172.21.15.84:0/2164572971 shutdown_connections 2023-07-14T11:16:26.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:26.036+0000 7f57a0bff700 1 -- 172.21.15.84:0/2164572971 wait complete. 2023-07-14T11:16:26.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:26.038+0000 7f57a0bff700 1 Processor -- start 2023-07-14T11:16:26.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:26.038+0000 7f57a0bff700 1 -- start start 2023-07-14T11:16:26.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:26.039+0000 7f57a0bff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f579c0b3780 0x7f579c070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:26.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:26.039+0000 7f57a0bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f579c15afd0 0x7f579c150320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:26.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:26.039+0000 7f57a0bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f579c15e890 0x7f579c150860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:26.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:26.039+0000 7f57a0bff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f579c1531e0 con 0x7f579c0b3780 2023-07-14T11:16:26.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:26.039+0000 7f57a0bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f579c150da0 con 0x7f579c15e890 2023-07-14T11:16:26.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:26.039+0000 7f57a0bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f579c1e6cb0 con 0x7f579c15afd0 2023-07-14T11:16:26.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:26.039+0000 7f579a59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f579c0b3780 0x7f579c070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:26.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:26.039+0000 7f579a59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f579c0b3780 0x7f579c070b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60094/0 (socket says 172.21.15.84:60094) 2023-07-14T11:16:26.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:26.039+0000 7f579a59c700 1 -- 172.21.15.84:0/1360395212 learned_addr learned my addr 172.21.15.84:0/1360395212 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:16:26.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:26.039+0000 7f579ad9d700 1 --2- 172.21.15.84:0/1360395212 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f579c15e890 0x7f579c150860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:26.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:26.039+0000 7f5799d9b700 1 --2- 172.21.15.84:0/1360395212 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f579c15afd0 0x7f579c150320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:26.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:26.040+0000 7f579a59c700 1 -- 172.21.15.84:0/1360395212 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f579c15afd0 msgr2=0x7f579c150320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:26.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:26.040+0000 7f579a59c700 1 --2- 172.21.15.84:0/1360395212 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f579c15afd0 0x7f579c150320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:26.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:26.040+0000 7f579a59c700 1 -- 172.21.15.84:0/1360395212 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f579c15e890 msgr2=0x7f579c150860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:26.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:26.040+0000 7f579a59c700 1 --2- 172.21.15.84:0/1360395212 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f579c15e890 0x7f579c150860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:26.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:26.040+0000 7f579a59c700 1 -- 172.21.15.84:0/1360395212 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f578c009550 con 0x7f579c0b3780 2023-07-14T11:16:26.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:26.040+0000 7f5799d9b700 1 --2- 172.21.15.84:0/1360395212 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f579c15afd0 0x7f579c150320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:16:26.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:26.040+0000 7f579a59c700 1 --2- 172.21.15.84:0/1360395212 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f579c0b3780 0x7f579c070b30 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f578c014040 tx=0x7f578c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:16:26.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:26.040+0000 7f578affd700 1 -- 172.21.15.84:0/1360395212 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f578c0045d0 con 0x7f579c0b3780 2023-07-14T11:16:26.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:26.040+0000 7f578affd700 1 -- 172.21.15.84:0/1360395212 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f578c01e070 con 0x7f579c0b3780 2023-07-14T11:16:26.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:26.040+0000 7f578affd700 1 -- 172.21.15.84:0/1360395212 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f578c0038a0 con 0x7f579c0b3780 2023-07-14T11:16:26.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:26.040+0000 7f57a0bff700 1 -- 172.21.15.84:0/1360395212 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f579c1e6f90 con 0x7f579c0b3780 2023-07-14T11:16:26.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:26.040+0000 7f57a0bff700 1 -- 172.21.15.84:0/1360395212 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f579c1e7550 con 0x7f579c0b3780 2023-07-14T11:16:26.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:26.041+0000 7f57a0bff700 1 -- 172.21.15.84:0/1360395212 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f579c04e280 con 0x7f579c0b3780 2023-07-14T11:16:26.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:26.042+0000 7f578affd700 1 -- 172.21.15.84:0/1360395212 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 8) v1 ==== 89241+0+0 (secure 0 0 0) 0x7f578c003a00 con 0x7f579c0b3780 2023-07-14T11:16:26.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:26.043+0000 7f578affd700 1 --2- 172.21.15.84:0/1360395212 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f577c06af20 0x7f577c06d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:26.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:26.043+0000 7f578affd700 1 -- 172.21.15.84:0/1360395212 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f578c020070 con 0x7f579c0b3780 2023-07-14T11:16:26.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:26.043+0000 7f5799d9b700 1 --2- 172.21.15.84:0/1360395212 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f577c06af20 0x7f577c06d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:26.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:26.044+0000 7f5799d9b700 1 --2- 172.21.15.84:0/1360395212 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f577c06af20 0x7f577c06d3d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f579c0cb6e0 tx=0x7f5790009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:16:26.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:26.047+0000 7f578affd700 1 -- 172.21.15.84:0/1360395212 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f578c055b40 con 0x7f579c0b3780 2023-07-14T11:16:26.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:26.286+0000 7f57a0bff700 1 -- 172.21.15.84:0/1360395212 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f579c06d240 con 0x7f579c0b3780 2023-07-14T11:16:26.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:26.287+0000 7f578affd700 1 -- 172.21.15.84:0/1360395212 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+4712 (secure 0 0 0) 0x7f578c02a090 con 0x7f579c0b3780 2023-07-14T11:16:26.294 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:16:26.294 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5030,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3551222138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3551222138},{"type":"v1","addr":"172.21.15.179:6834","nonce":3551222138}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5036,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/1316665435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1316665435},{"type":"v1","addr":"172.21.15.84:6836","nonce":1316665435}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5416,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/611235750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":611235750},{"type":"v1","addr":"172.21.15.179:6835","nonce":611235750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T11:15:10.408480+0000","modified":"2023-07-14T11:15:13.936541+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5625},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5625":{"gid":5625,"name":"c","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/2672133286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":2672133286},{"type":"v1","addr":"172.21.15.84:6837","nonce":2672133286}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-14T11:16:26.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:26.289+0000 7f57a0bff700 1 -- 172.21.15.84:0/1360395212 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f577c06af20 msgr2=0x7f577c06d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:26.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:26.289+0000 7f57a0bff700 1 --2- 172.21.15.84:0/1360395212 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f577c06af20 0x7f577c06d3d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f579c0cb6e0 tx=0x7f5790009040 comp rx=0 tx=0).stop 2023-07-14T11:16:26.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:26.290+0000 7f57a0bff700 1 -- 172.21.15.84:0/1360395212 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f579c0b3780 msgr2=0x7f579c070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:26.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:26.290+0000 7f57a0bff700 1 --2- 172.21.15.84:0/1360395212 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f579c0b3780 0x7f579c070b30 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f578c014040 tx=0x7f578c004750 comp rx=0 tx=0).stop 2023-07-14T11:16:26.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:26.290+0000 7f57a0bff700 1 -- 172.21.15.84:0/1360395212 shutdown_connections 2023-07-14T11:16:26.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:26.290+0000 7f57a0bff700 1 --2- 172.21.15.84:0/1360395212 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f579c15e890 0x7f579c150860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:26.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:26.290+0000 7f57a0bff700 1 --2- 172.21.15.84:0/1360395212 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f579c0b3780 0x7f579c070b30 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:26.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:26.290+0000 7f57a0bff700 1 --2- 172.21.15.84:0/1360395212 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f577c06af20 0x7f577c06d3d0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:26.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:26.290+0000 7f57a0bff700 1 --2- 172.21.15.84:0/1360395212 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f579c15afd0 0x7f579c150320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:26.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:26.290+0000 7f57a0bff700 1 -- 172.21.15.84:0/1360395212 >> 172.21.15.84:0/1360395212 conn(0x7f579c069f30 msgr2=0x7f579c159300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:16:26.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:26.290+0000 7f57a0bff700 1 -- 172.21.15.84:0/1360395212 shutdown_connections 2023-07-14T11:16:26.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:26.290+0000 7f57a0bff700 1 -- 172.21.15.84:0/1360395212 wait complete. 2023-07-14T11:16:26.296 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 28 2023-07-14T11:16:26.310 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2023-07-14T11:16:26.526 INFO:teuthology.orchestra.run.smithi084.stdout:[{"id":5925,"entity":{"name":{"type":"client","num":5925},"addr":{"type":"any","addr":"172.21.15.84:0","nonce":3353249595}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":8,"uptime":52.735027017999997,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":19.476883192176437,"halflife":300},"cap_acquisition":{"value":0,"halflife":10},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5925 172.21.15.84:0/3353249595","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000000fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"3fc0089cc1082313a98853d48b892acdc1385b8b","ceph_version":"ceph version 18.0.0-4757-g3fc0089c (3fc0089cc1082313a98853d48b892acdc1385b8b) reef (dev)","entity_id":"y","hostname":"smithi084","pid":"140843","root":"/"}}] 2023-07-14T11:16:26.527 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 10, "value": 0 }, "client_metadata": { "ceph_sha1": "3fc0089cc1082313a98853d48b892acdc1385b8b", "ceph_version": "ceph version 18.0.0-4757-g3fc0089c (3fc0089cc1082313a98853d48b892acdc1385b8b) reef (dev)", "client_features": { "feature_bits": "0x00000000000fffff" }, "entity_id": "y", "hostname": "smithi084", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "140843", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.84:0", "nonce": 3353249595, "type": "any" }, "name": { "num": 5925, "type": "client" } }, "id": 5925, "inst": "client.5925 172.21.15.84:0/3353249595", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 8, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 19.476883192176437 }, "state": "open", "uptime": 52.735027018 } ] 2023-07-14T11:16:26.527 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2023-07-14T11:16:31.528 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T11:16:31.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:31.731+0000 7fe7051ff700 1 Processor -- start 2023-07-14T11:16:31.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:31.731+0000 7fe7051ff700 1 -- start start 2023-07-14T11:16:31.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:31.733+0000 7fe7051ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe7001500d0 0x7fe700070350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:31.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:31.733+0000 7fe7051ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe700070890 0x7fe7001597c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:31.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:31.733+0000 7fe7051ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7000cdf90 con 0x7fe700159d00 2023-07-14T11:16:31.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:31.733+0000 7fe7051ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe70015a2f0 con 0x7fe700070890 2023-07-14T11:16:31.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:31.733+0000 7fe7051ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe70015a5d0 con 0x7fe7001500d0 2023-07-14T11:16:31.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:31.733+0000 7fe6fe59c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe700070890 0x7fe7001597c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:31.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:31.733+0000 7fe6fe59c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe700070890 0x7fe7001597c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40802/0 (socket says 172.21.15.84:40802) 2023-07-14T11:16:31.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:31.733+0000 7fe6fe59c700 1 -- 172.21.15.84:0/3455201656 learned_addr learned my addr 172.21.15.84:0/3455201656 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:16:31.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:31.733+0000 7fe6fed9d700 1 --2- 172.21.15.84:0/3455201656 >> v2:172.21.15.179:3300/0 conn(0x7fe7001500d0 0x7fe700070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:31.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:31.734+0000 7fe6fe59c700 1 -- 172.21.15.84:0/3455201656 >> v2:172.21.15.179:3300/0 conn(0x7fe7001500d0 msgr2=0x7fe700070350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:16:31.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:31.734+0000 7fe6fe59c700 1 --2- 172.21.15.84:0/3455201656 >> v2:172.21.15.179:3300/0 conn(0x7fe7001500d0 0x7fe700070350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:31.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:31.734+0000 7fe6fe59c700 1 -- 172.21.15.84:0/3455201656 >> v1:172.21.15.179:6789/0 conn(0x7fe700159d00 legacy=0x7fe7000cea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:31.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:31.734+0000 7fe6fe59c700 1 -- 172.21.15.84:0/3455201656 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7000ce250 con 0x7fe700070890 2023-07-14T11:16:31.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:31.734+0000 7fe6fe59c700 1 --2- 172.21.15.84:0/3455201656 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe700070890 0x7fe7001597c0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fe70006fa00 tx=0x7fe6f4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49b92bb890e75f0d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:16:31.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:31.734+0000 7fe6fdd9b700 1 -- 172.21.15.84:0/3455201656 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f400f8a0 con 0x7fe700070890 2023-07-14T11:16:31.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:31.734+0000 7fe6fdd9b700 1 -- 172.21.15.84:0/3455201656 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6f400fa00 con 0x7fe700070890 2023-07-14T11:16:31.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:31.734+0000 7fe6fdd9b700 1 -- 172.21.15.84:0/3455201656 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f400fd90 con 0x7fe700070890 2023-07-14T11:16:31.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:31.735+0000 7fe7051ff700 1 -- 172.21.15.84:0/3455201656 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe700070890 msgr2=0x7fe7001597c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:31.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:31.735+0000 7fe7051ff700 1 --2- 172.21.15.84:0/3455201656 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe700070890 0x7fe7001597c0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fe70006fa00 tx=0x7fe6f4009bd0 comp rx=0 tx=0).stop 2023-07-14T11:16:31.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:31.735+0000 7fe7051ff700 1 -- 172.21.15.84:0/3455201656 shutdown_connections 2023-07-14T11:16:31.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:31.735+0000 7fe7051ff700 1 --2- 172.21.15.84:0/3455201656 >> v2:172.21.15.179:3300/0 conn(0x7fe7001500d0 0x7fe700070350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:31.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:31.735+0000 7fe7051ff700 1 --2- 172.21.15.84:0/3455201656 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe700070890 0x7fe7001597c0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:31.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:31.735+0000 7fe7051ff700 1 -- 172.21.15.84:0/3455201656 >> 172.21.15.84:0/3455201656 conn(0x7fe700069f30 msgr2=0x7fe70006a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:16:31.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:31.735+0000 7fe7051ff700 1 -- 172.21.15.84:0/3455201656 shutdown_connections 2023-07-14T11:16:31.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:31.735+0000 7fe7051ff700 1 -- 172.21.15.84:0/3455201656 wait complete. 2023-07-14T11:16:31.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:31.737+0000 7fe7051ff700 1 Processor -- start 2023-07-14T11:16:31.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:31.737+0000 7fe7051ff700 1 -- start start 2023-07-14T11:16:31.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:31.739+0000 7fe7051ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe700070890 0x7fe70013e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:31.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:31.739+0000 7fe7051ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7001500d0 0x7fe70014b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:31.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:31.739+0000 7fe7051ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe700159d00 0x7fe70014c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:31.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:31.739+0000 7fe7051ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe700148890 con 0x7fe700159d00 2023-07-14T11:16:31.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:31.739+0000 7fe7051ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe70013ee00 con 0x7fe7001500d0 2023-07-14T11:16:31.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:31.739+0000 7fe7051ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe70014c120 con 0x7fe700070890 2023-07-14T11:16:31.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:31.739+0000 7fe6ff59e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe700159d00 0x7fe70014c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:31.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:31.739+0000 7fe6ff59e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe700159d00 0x7fe70014c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40810/0 (socket says 172.21.15.84:40810) 2023-07-14T11:16:31.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:31.739+0000 7fe6ff59e700 1 -- 172.21.15.84:0/470371555 learned_addr learned my addr 172.21.15.84:0/470371555 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:16:31.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:31.739+0000 7fe6fe59c700 1 --2- 172.21.15.84:0/470371555 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7001500d0 0x7fe70014b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:31.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:31.739+0000 7fe6fed9d700 1 --2- 172.21.15.84:0/470371555 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe700070890 0x7fe70013e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:31.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:31.739+0000 7fe6ff59e700 1 -- 172.21.15.84:0/470371555 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe700070890 msgr2=0x7fe70013e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:31.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:31.739+0000 7fe6ff59e700 1 --2- 172.21.15.84:0/470371555 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe700070890 0x7fe70013e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:31.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:31.739+0000 7fe6ff59e700 1 -- 172.21.15.84:0/470371555 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7001500d0 msgr2=0x7fe70014b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:31.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:31.739+0000 7fe6ff59e700 1 --2- 172.21.15.84:0/470371555 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7001500d0 0x7fe70014b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:31.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:31.739+0000 7fe6ff59e700 1 -- 172.21.15.84:0/470371555 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f4009550 con 0x7fe700159d00 2023-07-14T11:16:31.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:31.740+0000 7fe6ff59e700 1 --2- 172.21.15.84:0/470371555 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe700159d00 0x7fe70014c900 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fe6f800cb50 tx=0x7fe6f800ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:16:31.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:31.740+0000 7fe6e77fe700 1 -- 172.21.15.84:0/470371555 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f8003c00 con 0x7fe700159d00 2023-07-14T11:16:31.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:31.740+0000 7fe6e77fe700 1 -- 172.21.15.84:0/470371555 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6f8003d60 con 0x7fe700159d00 2023-07-14T11:16:31.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:31.740+0000 7fe7051ff700 1 -- 172.21.15.84:0/470371555 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe70014c400 con 0x7fe700159d00 2023-07-14T11:16:31.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:31.740+0000 7fe6e77fe700 1 -- 172.21.15.84:0/470371555 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f800aac0 con 0x7fe700159d00 2023-07-14T11:16:31.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:31.740+0000 7fe7051ff700 1 -- 172.21.15.84:0/470371555 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe700148d80 con 0x7fe700159d00 2023-07-14T11:16:31.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:31.741+0000 7fe7051ff700 1 -- 172.21.15.84:0/470371555 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe70014c5f0 con 0x7fe700159d00 2023-07-14T11:16:31.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:31.742+0000 7fe6e77fe700 1 -- 172.21.15.84:0/470371555 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 8) v1 ==== 89241+0+0 (secure 0 0 0) 0x7fe6f800ac20 con 0x7fe700159d00 2023-07-14T11:16:31.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:31.743+0000 7fe6e77fe700 1 --2- 172.21.15.84:0/470371555 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe6ec06af20 0x7fe6ec06d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:31.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:31.743+0000 7fe6e77fe700 1 -- 172.21.15.84:0/470371555 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fe6f80898e0 con 0x7fe700159d00 2023-07-14T11:16:31.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:31.743+0000 7fe6fed9d700 1 --2- 172.21.15.84:0/470371555 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe6ec06af20 0x7fe6ec06d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:31.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:31.744+0000 7fe6fed9d700 1 --2- 172.21.15.84:0/470371555 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe6ec06af20 0x7fe6ec06d3d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe70006b8d0 tx=0x7fe6f0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:16:31.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:31.748+0000 7fe6e77fe700 1 -- 172.21.15.84:0/470371555 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe70014c5f0 con 0x7fe700159d00 2023-07-14T11:16:31.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:31.988+0000 7fe7051ff700 1 -- 172.21.15.84:0/470371555 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe70014c5f0 con 0x7fe700159d00 2023-07-14T11:16:31.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:31.989+0000 7fe6e77fe700 1 -- 172.21.15.84:0/470371555 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+4712 (secure 0 0 0) 0x7fe70014c5f0 con 0x7fe700159d00 2023-07-14T11:16:31.991 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:16:31.992 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5030,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3551222138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3551222138},{"type":"v1","addr":"172.21.15.179:6834","nonce":3551222138}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5036,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/1316665435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1316665435},{"type":"v1","addr":"172.21.15.84:6836","nonce":1316665435}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5416,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/611235750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":611235750},{"type":"v1","addr":"172.21.15.179:6835","nonce":611235750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T11:15:10.408480+0000","modified":"2023-07-14T11:15:13.936541+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5625},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5625":{"gid":5625,"name":"c","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/2672133286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":2672133286},{"type":"v1","addr":"172.21.15.84:6837","nonce":2672133286}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-14T11:16:31.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:31.991+0000 7fe7051ff700 1 -- 172.21.15.84:0/470371555 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe6ec06af20 msgr2=0x7fe6ec06d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:31.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:31.991+0000 7fe7051ff700 1 --2- 172.21.15.84:0/470371555 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe6ec06af20 0x7fe6ec06d3d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe70006b8d0 tx=0x7fe6f0008040 comp rx=0 tx=0).stop 2023-07-14T11:16:31.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:31.991+0000 7fe7051ff700 1 -- 172.21.15.84:0/470371555 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe700159d00 msgr2=0x7fe70014c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:31.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:31.991+0000 7fe7051ff700 1 --2- 172.21.15.84:0/470371555 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe700159d00 0x7fe70014c900 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fe6f800cb50 tx=0x7fe6f800ce60 comp rx=0 tx=0).stop 2023-07-14T11:16:31.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:31.991+0000 7fe7051ff700 1 -- 172.21.15.84:0/470371555 shutdown_connections 2023-07-14T11:16:31.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:31.991+0000 7fe7051ff700 1 --2- 172.21.15.84:0/470371555 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe6ec06af20 0x7fe6ec06d3d0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:31.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:31.991+0000 7fe7051ff700 1 --2- 172.21.15.84:0/470371555 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe700070890 0x7fe70013e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:31.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:31.991+0000 7fe7051ff700 1 --2- 172.21.15.84:0/470371555 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe700159d00 0x7fe70014c900 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:31.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:31.991+0000 7fe7051ff700 1 --2- 172.21.15.84:0/470371555 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7001500d0 0x7fe70014b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:31.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:31.991+0000 7fe7051ff700 1 -- 172.21.15.84:0/470371555 >> 172.21.15.84:0/470371555 conn(0x7fe700069f30 msgr2=0x7fe70006b920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:16:31.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:31.991+0000 7fe7051ff700 1 -- 172.21.15.84:0/470371555 shutdown_connections 2023-07-14T11:16:31.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:31.991+0000 7fe7051ff700 1 -- 172.21.15.84:0/470371555 wait complete. 2023-07-14T11:16:31.995 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 28 2023-07-14T11:16:32.011 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2023-07-14T11:16:32.230 INFO:teuthology.orchestra.run.smithi084.stdout:[{"id":5925,"entity":{"name":{"type":"client","num":5925},"addr":{"type":"any","addr":"172.21.15.84:0","nonce":3353249595}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":7,"uptime":58.438922024999997,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":19.221885298872639,"halflife":300},"cap_acquisition":{"value":0,"halflife":10},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5925 172.21.15.84:0/3353249595","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000000fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"3fc0089cc1082313a98853d48b892acdc1385b8b","ceph_version":"ceph version 18.0.0-4757-g3fc0089c (3fc0089cc1082313a98853d48b892acdc1385b8b) reef (dev)","entity_id":"y","hostname":"smithi084","pid":"140843","root":"/"}}] 2023-07-14T11:16:32.231 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 10, "value": 0 }, "client_metadata": { "ceph_sha1": "3fc0089cc1082313a98853d48b892acdc1385b8b", "ceph_version": "ceph version 18.0.0-4757-g3fc0089c (3fc0089cc1082313a98853d48b892acdc1385b8b) reef (dev)", "client_features": { "feature_bits": "0x00000000000fffff" }, "entity_id": "y", "hostname": "smithi084", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "140843", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.84:0", "nonce": 3353249595, "type": "any" }, "name": { "num": 5925, "type": "client" } }, "id": 5925, "inst": "client.5925 172.21.15.84:0/3353249595", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 7, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 19.22188529887264 }, "state": "open", "uptime": 58.438922025 } ] 2023-07-14T11:16:32.231 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2023-07-14T11:16:37.133 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T11:16:37.138 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T11:16:37.233 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T11:16:37.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:37.427+0000 7f38949ff700 1 Processor -- start 2023-07-14T11:16:37.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:37.428+0000 7f38949ff700 1 -- start start 2023-07-14T11:16:37.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:37.429+0000 7f38949ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f389015c950 0x7f38900b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:37.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:37.429+0000 7f38949ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38900b1e00 0x7f38900d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:37.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:37.429+0000 7f38949ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38900d2ce0 con 0x7f38900b2350 2023-07-14T11:16:37.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:37.429+0000 7f38949ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38900b3350 con 0x7f389015c950 2023-07-14T11:16:37.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:37.429+0000 7f38949ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38900b3630 con 0x7f38900b1e00 2023-07-14T11:16:37.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:37.429+0000 7f388ed9d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f38900b2350 0x7f38900afac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:37780/0 (socket says 172.21.15.84:37780) 2023-07-14T11:16:37.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:37.429+0000 7f388ed9d700 1 -- 172.21.15.84:0/2591540488 learned_addr learned my addr 172.21.15.84:0/2591540488 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:16:37.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:37.429+0000 7f388dd9b700 1 --2- 172.21.15.84:0/2591540488 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38900b1e00 0x7f38900d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:37.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:37.429+0000 7f388e59c700 1 --2- 172.21.15.84:0/2591540488 >> v2:172.21.15.179:3300/0 conn(0x7f389015c950 0x7f38900b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:37.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:37.430+0000 7f388d59a700 1 -- 172.21.15.84:0/2591540488 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1885349025 0 0) 0x7f38900d2ce0 con 0x7f38900b2350 2023-07-14T11:16:37.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:37.430+0000 7f388d59a700 1 -- 172.21.15.84:0/2591540488 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38780035b0 con 0x7f38900b2350 2023-07-14T11:16:37.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:37.430+0000 7f388e59c700 1 -- 172.21.15.84:0/2591540488 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38900b1e00 msgr2=0x7f38900d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:16:37.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:37.430+0000 7f388e59c700 1 --2- 172.21.15.84:0/2591540488 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38900b1e00 0x7f38900d0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:37.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:37.430+0000 7f388e59c700 1 -- 172.21.15.84:0/2591540488 >> v1:172.21.15.84:6789/0 conn(0x7f38900b2350 legacy=0x7f38900afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:37.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:37.430+0000 7f388e59c700 1 -- 172.21.15.84:0/2591540488 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38900b3910 con 0x7f389015c950 2023-07-14T11:16:37.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:37.430+0000 7f388e59c700 1 --2- 172.21.15.84:0/2591540488 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f389015c950 0x7f38900b43f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f3880009820 tx=0x7f3880009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f6e670914a61454 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:16:37.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:37.430+0000 7f388d59a700 1 -- 172.21.15.84:0/2591540488 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3880005e30 con 0x7f389015c950 2023-07-14T11:16:37.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:37.431+0000 7f388d59a700 1 -- 172.21.15.84:0/2591540488 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3880006030 con 0x7f389015c950 2023-07-14T11:16:37.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:37.431+0000 7f388d59a700 1 -- 172.21.15.84:0/2591540488 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38800063c0 con 0x7f389015c950 2023-07-14T11:16:37.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:37.431+0000 7f38949ff700 1 -- 172.21.15.84:0/2591540488 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f389015c950 msgr2=0x7f38900b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:37.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:37.431+0000 7f38949ff700 1 --2- 172.21.15.84:0/2591540488 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f389015c950 0x7f38900b43f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f3880009820 tx=0x7f3880009b30 comp rx=0 tx=0).stop 2023-07-14T11:16:37.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:37.431+0000 7f38949ff700 1 -- 172.21.15.84:0/2591540488 shutdown_connections 2023-07-14T11:16:37.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:37.431+0000 7f38949ff700 1 --2- 172.21.15.84:0/2591540488 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f389015c950 0x7f38900b43f0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:37.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:37.431+0000 7f38949ff700 1 --2- 172.21.15.84:0/2591540488 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38900b1e00 0x7f38900d0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:37.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:37.431+0000 7f38949ff700 1 -- 172.21.15.84:0/2591540488 >> 172.21.15.84:0/2591540488 conn(0x7f389009c1d0 msgr2=0x7f38900d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:16:37.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:37.431+0000 7f38949ff700 1 -- 172.21.15.84:0/2591540488 shutdown_connections 2023-07-14T11:16:37.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:37.431+0000 7f38949ff700 1 -- 172.21.15.84:0/2591540488 wait complete. 2023-07-14T11:16:37.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:37.433+0000 7f38949ff700 1 Processor -- start 2023-07-14T11:16:37.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:37.433+0000 7f38949ff700 1 -- start start 2023-07-14T11:16:37.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:37.434+0000 7f38949ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38900b1e00 0x7f38900b88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:37.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:37.434+0000 7f38949ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38900b2350 0x7f38901518a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:37.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:37.434+0000 7f38949ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f389015c950 0x7f38900b6e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:37.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:37.434+0000 7f38949ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38900b82b0 con 0x7f38900b1e00 2023-07-14T11:16:37.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:37.434+0000 7f38949ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3890151de0 con 0x7f389015c950 2023-07-14T11:16:37.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:37.434+0000 7f38949ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38900ccce0 con 0x7f38900b2350 2023-07-14T11:16:37.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:37.434+0000 7f388e59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38900b1e00 0x7f38900b88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:37.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:37.434+0000 7f388e59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38900b1e00 0x7f38900b88e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40812/0 (socket says 172.21.15.84:40812) 2023-07-14T11:16:37.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:37.434+0000 7f388e59c700 1 -- 172.21.15.84:0/1793671052 learned_addr learned my addr 172.21.15.84:0/1793671052 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:16:37.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:37.435+0000 7f388ed9d700 1 --2- 172.21.15.84:0/1793671052 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f389015c950 0x7f38900b6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:37.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:37.435+0000 7f388dd9b700 1 --2- 172.21.15.84:0/1793671052 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38900b2350 0x7f38901518a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:37.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:37.435+0000 7f388e59c700 1 -- 172.21.15.84:0/1793671052 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38900b2350 msgr2=0x7f38901518a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:37.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:37.435+0000 7f388e59c700 1 --2- 172.21.15.84:0/1793671052 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38900b2350 0x7f38901518a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:37.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:37.435+0000 7f388e59c700 1 -- 172.21.15.84:0/1793671052 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f389015c950 msgr2=0x7f38900b6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:37.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:37.435+0000 7f388e59c700 1 --2- 172.21.15.84:0/1793671052 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f389015c950 0x7f38900b6e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:37.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:37.435+0000 7f388e59c700 1 -- 172.21.15.84:0/1793671052 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3880009430 con 0x7f38900b1e00 2023-07-14T11:16:37.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:37.435+0000 7f388ed9d700 1 --2- 172.21.15.84:0/1793671052 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f389015c950 0x7f38900b6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:16:37.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:37.435+0000 7f388e59c700 1 --2- 172.21.15.84:0/1793671052 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38900b1e00 0x7f38900b88e0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f3880000c00 tx=0x7f3880004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:16:37.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:37.435+0000 7f387effd700 1 -- 172.21.15.84:0/1793671052 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38800065b0 con 0x7f38900b1e00 2023-07-14T11:16:37.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:37.435+0000 7f387effd700 1 -- 172.21.15.84:0/1793671052 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3880006710 con 0x7f38900b1e00 2023-07-14T11:16:37.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:37.435+0000 7f38949ff700 1 -- 172.21.15.84:0/1793671052 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38900b7cf0 con 0x7f38900b1e00 2023-07-14T11:16:37.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:37.435+0000 7f387effd700 1 -- 172.21.15.84:0/1793671052 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38800036a0 con 0x7f38900b1e00 2023-07-14T11:16:37.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:37.435+0000 7f38949ff700 1 -- 172.21.15.84:0/1793671052 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3890152730 con 0x7f38900b1e00 2023-07-14T11:16:37.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:37.436+0000 7f38949ff700 1 -- 172.21.15.84:0/1793671052 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f389004e280 con 0x7f38900b1e00 2023-07-14T11:16:37.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:37.437+0000 7f387effd700 1 -- 172.21.15.84:0/1793671052 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 8) v1 ==== 89241+0+0 (secure 0 0 0) 0x7f3880022070 con 0x7f38900b1e00 2023-07-14T11:16:37.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:37.438+0000 7f387effd700 1 --2- 172.21.15.84:0/1793671052 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f387006af20 0x7f387006d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:37.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:37.438+0000 7f387effd700 1 -- 172.21.15.84:0/1793671052 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f388008b080 con 0x7f38900b1e00 2023-07-14T11:16:37.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:37.438+0000 7f388dd9b700 1 --2- 172.21.15.84:0/1793671052 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f387006af20 0x7f387006d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:37.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:37.439+0000 7f388dd9b700 1 --2- 172.21.15.84:0/1793671052 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f387006af20 0x7f387006d3d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f38900cbe30 tx=0x7f3884008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:16:37.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:37.443+0000 7f387effd700 1 -- 172.21.15.84:0/1793671052 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f38800bd330 con 0x7f38900b1e00 2023-07-14T11:16:37.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:37.679+0000 7f38949ff700 1 -- 172.21.15.84:0/1793671052 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f38900cd270 con 0x7f38900b1e00 2023-07-14T11:16:37.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:37.679+0000 7f387effd700 1 -- 172.21.15.84:0/1793671052 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+4712 (secure 0 0 0) 0x7f3880055d80 con 0x7f38900b1e00 2023-07-14T11:16:37.682 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:16:37.682 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5030,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3551222138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3551222138},{"type":"v1","addr":"172.21.15.179:6834","nonce":3551222138}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5036,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/1316665435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1316665435},{"type":"v1","addr":"172.21.15.84:6836","nonce":1316665435}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5416,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/611235750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":611235750},{"type":"v1","addr":"172.21.15.179:6835","nonce":611235750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T11:15:10.408480+0000","modified":"2023-07-14T11:15:13.936541+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5625},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5625":{"gid":5625,"name":"c","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/2672133286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":2672133286},{"type":"v1","addr":"172.21.15.84:6837","nonce":2672133286}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-14T11:16:37.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:37.682+0000 7f38949ff700 1 -- 172.21.15.84:0/1793671052 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f387006af20 msgr2=0x7f387006d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:37.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:37.682+0000 7f38949ff700 1 --2- 172.21.15.84:0/1793671052 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f387006af20 0x7f387006d3d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f38900cbe30 tx=0x7f3884008040 comp rx=0 tx=0).stop 2023-07-14T11:16:37.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:37.682+0000 7f38949ff700 1 -- 172.21.15.84:0/1793671052 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38900b1e00 msgr2=0x7f38900b88e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:37.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:37.682+0000 7f38949ff700 1 --2- 172.21.15.84:0/1793671052 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38900b1e00 0x7f38900b88e0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f3880000c00 tx=0x7f3880004750 comp rx=0 tx=0).stop 2023-07-14T11:16:37.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:37.682+0000 7f38949ff700 1 -- 172.21.15.84:0/1793671052 shutdown_connections 2023-07-14T11:16:37.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:37.682+0000 7f38949ff700 1 --2- 172.21.15.84:0/1793671052 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f389015c950 0x7f38900b6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:37.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:37.682+0000 7f38949ff700 1 --2- 172.21.15.84:0/1793671052 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38900b1e00 0x7f38900b88e0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:37.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:37.682+0000 7f38949ff700 1 --2- 172.21.15.84:0/1793671052 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f387006af20 0x7f387006d3d0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:37.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:37.682+0000 7f38949ff700 1 --2- 172.21.15.84:0/1793671052 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38900b2350 0x7f38901518a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:37.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:37.682+0000 7f38949ff700 1 -- 172.21.15.84:0/1793671052 >> 172.21.15.84:0/1793671052 conn(0x7f389009c1d0 msgr2=0x7f38900b1580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:16:37.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:37.682+0000 7f38949ff700 1 -- 172.21.15.84:0/1793671052 shutdown_connections 2023-07-14T11:16:37.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:37.682+0000 7f38949ff700 1 -- 172.21.15.84:0/1793671052 wait complete. 2023-07-14T11:16:37.686 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 28 2023-07-14T11:16:37.702 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2023-07-14T11:16:37.920 INFO:teuthology.orchestra.run.smithi084.stdout:[{"id":5925,"entity":{"name":{"type":"client","num":5925},"addr":{"type":"any","addr":"172.21.15.84:0","nonce":3353249595}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":7,"uptime":64.127817304000004,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":18.970883380994263,"halflife":300},"cap_acquisition":{"value":0,"halflife":10},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5925 172.21.15.84:0/3353249595","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000000fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"3fc0089cc1082313a98853d48b892acdc1385b8b","ceph_version":"ceph version 18.0.0-4757-g3fc0089c (3fc0089cc1082313a98853d48b892acdc1385b8b) reef (dev)","entity_id":"y","hostname":"smithi084","pid":"140843","root":"/"}}] 2023-07-14T11:16:37.920 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 10, "value": 0 }, "client_metadata": { "ceph_sha1": "3fc0089cc1082313a98853d48b892acdc1385b8b", "ceph_version": "ceph version 18.0.0-4757-g3fc0089c (3fc0089cc1082313a98853d48b892acdc1385b8b) reef (dev)", "client_features": { "feature_bits": "0x00000000000fffff" }, "entity_id": "y", "hostname": "smithi084", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "140843", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.84:0", "nonce": 3353249595, "type": "any" }, "name": { "num": 5925, "type": "client" } }, "id": 5925, "inst": "client.5925 172.21.15.84:0/3353249595", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 7, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 18.970883380994263 }, "state": "open", "uptime": 64.127817304 } ] 2023-07-14T11:16:37.921 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2023-07-14T11:16:42.922 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T11:16:43.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:43.126+0000 7fdfb6fff700 1 Processor -- start 2023-07-14T11:16:43.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:43.126+0000 7fdfb6fff700 1 -- start start 2023-07-14T11:16:43.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:43.127+0000 7fdfb6fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fdfb01597c0 0x7fdfb0159c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:43.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:43.127+0000 7fdfb6fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdfb00cea50 0x7fdfb00cee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:43.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:43.127+0000 7fdfb6fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfb00cdf90 con 0x7fdfb01500d0 2023-07-14T11:16:43.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:43.127+0000 7fdfb6fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfb00cf3c0 con 0x7fdfb01597c0 2023-07-14T11:16:43.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:43.127+0000 7fdfb6fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb015a2f0 con 0x7fdfb00cea50 2023-07-14T11:16:43.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:43.128+0000 7fdfb559c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdfb00cea50 0x7fdfb00cee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:43.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:43.128+0000 7fdfb4d9b700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fdfb01500d0 0x7fdfb0070350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.84:57856/0 (socket says 172.21.15.84:57856) 2023-07-14T11:16:43.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:43.128+0000 7fdfb4d9b700 1 -- 172.21.15.84:0/3168475078 learned_addr learned my addr 172.21.15.84:0/3168475078 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:16:43.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:43.128+0000 7fdfaffff700 1 --2- 172.21.15.84:0/3168475078 >> v2:172.21.15.179:3300/0 conn(0x7fdfb01597c0 0x7fdfb0159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:43.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:43.128+0000 7fdfaf7fe700 1 -- 172.21.15.84:0/3168475078 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2127374574 0 0) 0x7fdfb00cdf90 con 0x7fdfb01500d0 2023-07-14T11:16:43.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:43.128+0000 7fdfaf7fe700 1 -- 172.21.15.84:0/3168475078 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfa00035b0 con 0x7fdfb01500d0 2023-07-14T11:16:43.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:43.128+0000 7fdfb559c700 1 -- 172.21.15.84:0/3168475078 >> v2:172.21.15.179:3300/0 conn(0x7fdfb01597c0 msgr2=0x7fdfb0159c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:16:43.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:43.128+0000 7fdfb559c700 1 --2- 172.21.15.84:0/3168475078 >> v2:172.21.15.179:3300/0 conn(0x7fdfb01597c0 0x7fdfb0159c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:43.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:43.128+0000 7fdfb559c700 1 -- 172.21.15.84:0/3168475078 >> v1:172.21.15.179:6789/0 conn(0x7fdfb01500d0 legacy=0x7fdfb0070350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:43.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:43.128+0000 7fdfb559c700 1 -- 172.21.15.84:0/3168475078 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb015a5d0 con 0x7fdfb00cea50 2023-07-14T11:16:43.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:43.128+0000 7fdfaffff700 1 --2- 172.21.15.84:0/3168475078 >> v2:172.21.15.179:3300/0 conn(0x7fdfb01597c0 0x7fdfb0159c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:16:43.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:43.129+0000 7fdfb559c700 1 --2- 172.21.15.84:0/3168475078 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdfb00cea50 0x7fdfb00cee80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdfa8009d90 tx=0x7fdfa800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3baefe63ccc4ff6 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:16:43.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:43.129+0000 7fdfaf7fe700 1 -- 172.21.15.84:0/3168475078 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa800e070 con 0x7fdfb00cea50 2023-07-14T11:16:43.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:43.129+0000 7fdfaf7fe700 1 -- 172.21.15.84:0/3168475078 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfa800bb20 con 0x7fdfb00cea50 2023-07-14T11:16:43.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:43.129+0000 7fdfaf7fe700 1 -- 172.21.15.84:0/3168475078 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa8012430 con 0x7fdfb00cea50 2023-07-14T11:16:43.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:43.129+0000 7fdfb6fff700 1 -- 172.21.15.84:0/3168475078 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdfb00cea50 msgr2=0x7fdfb00cee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:43.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:43.129+0000 7fdfb6fff700 1 --2- 172.21.15.84:0/3168475078 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdfb00cea50 0x7fdfb00cee80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdfa8009d90 tx=0x7fdfa800b330 comp rx=0 tx=0).stop 2023-07-14T11:16:43.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:43.129+0000 7fdfb6fff700 1 -- 172.21.15.84:0/3168475078 shutdown_connections 2023-07-14T11:16:43.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:43.129+0000 7fdfb6fff700 1 --2- 172.21.15.84:0/3168475078 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdfb00cea50 0x7fdfb00cee80 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:43.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:43.129+0000 7fdfb6fff700 1 --2- 172.21.15.84:0/3168475078 >> v2:172.21.15.179:3300/0 conn(0x7fdfb01597c0 0x7fdfb0159c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:43.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:43.129+0000 7fdfb6fff700 1 -- 172.21.15.84:0/3168475078 >> 172.21.15.84:0/3168475078 conn(0x7fdfb0069f30 msgr2=0x7fdfb006a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:16:43.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:43.130+0000 7fdfb6fff700 1 -- 172.21.15.84:0/3168475078 shutdown_connections 2023-07-14T11:16:43.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:43.130+0000 7fdfb6fff700 1 -- 172.21.15.84:0/3168475078 wait complete. 2023-07-14T11:16:43.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:43.131+0000 7fdfb6fff700 1 Processor -- start 2023-07-14T11:16:43.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:43.131+0000 7fdfb6fff700 1 -- start start 2023-07-14T11:16:43.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:43.132+0000 7fdfb6fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdfb00cea50 0x7fdfb01f5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:43.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:43.132+0000 7fdfb6fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdfb01500d0 0x7fdfb0152030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:43.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:43.132+0000 7fdfb6fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdfb01597c0 0x7fdfb006c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:43.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:43.132+0000 7fdfb6fff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb0153b40 con 0x7fdfb00cea50 2023-07-14T11:16:43.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:43.132+0000 7fdfb6fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb00c3df0 con 0x7fdfb01500d0 2023-07-14T11:16:43.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:43.132+0000 7fdfb6fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb0152570 con 0x7fdfb01597c0 2023-07-14T11:16:43.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:43.133+0000 7fdfb4d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdfb00cea50 0x7fdfb01f5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:43.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:43.133+0000 7fdfb4d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdfb00cea50 0x7fdfb01f5120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38470/0 (socket says 172.21.15.84:38470) 2023-07-14T11:16:43.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:43.133+0000 7fdfb4d9b700 1 -- 172.21.15.84:0/1289882898 learned_addr learned my addr 172.21.15.84:0/1289882898 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:16:43.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:43.133+0000 7fdfaffff700 1 --2- 172.21.15.84:0/1289882898 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdfb01500d0 0x7fdfb0152030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:43.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:43.133+0000 7fdfb559c700 1 --2- 172.21.15.84:0/1289882898 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdfb01597c0 0x7fdfb006c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:43.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:43.133+0000 7fdfb4d9b700 1 -- 172.21.15.84:0/1289882898 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdfb01597c0 msgr2=0x7fdfb006c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:43.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:43.133+0000 7fdfb4d9b700 1 --2- 172.21.15.84:0/1289882898 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdfb01597c0 0x7fdfb006c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:43.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:43.133+0000 7fdfb4d9b700 1 -- 172.21.15.84:0/1289882898 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdfb01500d0 msgr2=0x7fdfb0152030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:43.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:43.133+0000 7fdfb4d9b700 1 --2- 172.21.15.84:0/1289882898 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdfb01500d0 0x7fdfb0152030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:43.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:43.133+0000 7fdfb4d9b700 1 -- 172.21.15.84:0/1289882898 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf9c0094a0 con 0x7fdfb00cea50 2023-07-14T11:16:43.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:43.133+0000 7fdfb4d9b700 1 --2- 172.21.15.84:0/1289882898 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdfb00cea50 0x7fdfb01f5120 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fdfa400c730 tx=0x7fdfa400caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:16:43.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:43.133+0000 7fdfad7fa700 1 -- 172.21.15.84:0/1289882898 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa4005d70 con 0x7fdfb00cea50 2023-07-14T11:16:43.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:43.134+0000 7fdfad7fa700 1 -- 172.21.15.84:0/1289882898 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfa40070d0 con 0x7fdfb00cea50 2023-07-14T11:16:43.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:43.134+0000 7fdfb6fff700 1 -- 172.21.15.84:0/1289882898 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfa8009a70 con 0x7fdfb00cea50 2023-07-14T11:16:43.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:43.134+0000 7fdfad7fa700 1 -- 172.21.15.84:0/1289882898 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa4007440 con 0x7fdfb00cea50 2023-07-14T11:16:43.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:43.134+0000 7fdfb6fff700 1 -- 172.21.15.84:0/1289882898 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfb00c5d00 con 0x7fdfb00cea50 2023-07-14T11:16:43.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:43.135+0000 7fdfb6fff700 1 -- 172.21.15.84:0/1289882898 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfb004e280 con 0x7fdfb00cea50 2023-07-14T11:16:43.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:43.136+0000 7fdfad7fa700 1 -- 172.21.15.84:0/1289882898 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 8) v1 ==== 89241+0+0 (secure 0 0 0) 0x7fdfa40075a0 con 0x7fdfb00cea50 2023-07-14T11:16:43.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:43.137+0000 7fdfad7fa700 1 --2- 172.21.15.84:0/1289882898 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fdf9406af20 0x7fdf9406d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:43.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:43.137+0000 7fdfad7fa700 1 -- 172.21.15.84:0/1289882898 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fdfa4088e00 con 0x7fdfb00cea50 2023-07-14T11:16:43.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:43.137+0000 7fdfaffff700 1 --2- 172.21.15.84:0/1289882898 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fdf9406af20 0x7fdf9406d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:43.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:43.138+0000 7fdfaffff700 1 --2- 172.21.15.84:0/1289882898 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fdf9406af20 0x7fdf9406d3d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fdfb00cad00 tx=0x7fdf9c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:16:43.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:43.142+0000 7fdfad7fa700 1 -- 172.21.15.84:0/1289882898 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fdfa4053b20 con 0x7fdfb00cea50 2023-07-14T11:16:43.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:43.378+0000 7fdfb6fff700 1 -- 172.21.15.84:0/1289882898 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdfb00cb2a0 con 0x7fdfb00cea50 2023-07-14T11:16:43.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:43.379+0000 7fdfad7fa700 1 -- 172.21.15.84:0/1289882898 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+4712 (secure 0 0 0) 0x7fdfa4057140 con 0x7fdfb00cea50 2023-07-14T11:16:43.381 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:16:43.381 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5030,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3551222138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3551222138},{"type":"v1","addr":"172.21.15.179:6834","nonce":3551222138}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5036,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/1316665435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1316665435},{"type":"v1","addr":"172.21.15.84:6836","nonce":1316665435}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5416,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/611235750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":611235750},{"type":"v1","addr":"172.21.15.179:6835","nonce":611235750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T11:15:10.408480+0000","modified":"2023-07-14T11:15:13.936541+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5625},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5625":{"gid":5625,"name":"c","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/2672133286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":2672133286},{"type":"v1","addr":"172.21.15.84:6837","nonce":2672133286}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-14T11:16:43.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:43.381+0000 7fdfb6fff700 1 -- 172.21.15.84:0/1289882898 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fdf9406af20 msgr2=0x7fdf9406d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:43.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:43.381+0000 7fdfb6fff700 1 --2- 172.21.15.84:0/1289882898 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fdf9406af20 0x7fdf9406d3d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fdfb00cad00 tx=0x7fdf9c008040 comp rx=0 tx=0).stop 2023-07-14T11:16:43.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:43.381+0000 7fdfb6fff700 1 -- 172.21.15.84:0/1289882898 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdfb00cea50 msgr2=0x7fdfb01f5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:43.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:43.381+0000 7fdfb6fff700 1 --2- 172.21.15.84:0/1289882898 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdfb00cea50 0x7fdfb01f5120 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fdfa400c730 tx=0x7fdfa400caf0 comp rx=0 tx=0).stop 2023-07-14T11:16:43.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:43.381+0000 7fdfb6fff700 1 -- 172.21.15.84:0/1289882898 shutdown_connections 2023-07-14T11:16:43.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:43.381+0000 7fdfb6fff700 1 --2- 172.21.15.84:0/1289882898 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fdf9406af20 0x7fdf9406d3d0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:43.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:43.381+0000 7fdfb6fff700 1 --2- 172.21.15.84:0/1289882898 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdfb01597c0 0x7fdfb006c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:43.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:43.381+0000 7fdfb6fff700 1 --2- 172.21.15.84:0/1289882898 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdfb00cea50 0x7fdfb01f5120 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:43.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:43.381+0000 7fdfb6fff700 1 --2- 172.21.15.84:0/1289882898 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdfb01500d0 0x7fdfb0152030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:43.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:43.381+0000 7fdfb6fff700 1 -- 172.21.15.84:0/1289882898 >> 172.21.15.84:0/1289882898 conn(0x7fdfb0069f30 msgr2=0x7fdfb014d940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:16:43.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:43.381+0000 7fdfb6fff700 1 -- 172.21.15.84:0/1289882898 shutdown_connections 2023-07-14T11:16:43.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:43.381+0000 7fdfb6fff700 1 -- 172.21.15.84:0/1289882898 wait complete. 2023-07-14T11:16:43.385 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 28 2023-07-14T11:16:43.401 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2023-07-14T11:16:43.619 INFO:teuthology.orchestra.run.smithi084.stdout:[{"id":5925,"entity":{"name":{"type":"client","num":5925},"addr":{"type":"any","addr":"172.21.15.84:0","nonce":3353249595}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":6,"uptime":69.826712396999994,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":18.722726495535298,"halflife":300},"cap_acquisition":{"value":0,"halflife":10},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5925 172.21.15.84:0/3353249595","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000000fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"3fc0089cc1082313a98853d48b892acdc1385b8b","ceph_version":"ceph version 18.0.0-4757-g3fc0089c (3fc0089cc1082313a98853d48b892acdc1385b8b) reef (dev)","entity_id":"y","hostname":"smithi084","pid":"140843","root":"/"}}] 2023-07-14T11:16:43.619 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 10, "value": 0 }, "client_metadata": { "ceph_sha1": "3fc0089cc1082313a98853d48b892acdc1385b8b", "ceph_version": "ceph version 18.0.0-4757-g3fc0089c (3fc0089cc1082313a98853d48b892acdc1385b8b) reef (dev)", "client_features": { "feature_bits": "0x00000000000fffff" }, "entity_id": "y", "hostname": "smithi084", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "140843", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.84:0", "nonce": 3353249595, "type": "any" }, "name": { "num": 5925, "type": "client" } }, "id": 5925, "inst": "client.5925 172.21.15.84:0/3353249595", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 6, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 18.722726495535298 }, "state": "open", "uptime": 69.826712397 } ] 2023-07-14T11:16:43.620 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2023-07-14T11:16:48.621 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T11:16:48.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.824+0000 7fdcaf9ff700 1 Processor -- start 2023-07-14T11:16:48.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.824+0000 7fdcaf9ff700 1 -- start start 2023-07-14T11:16:48.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.825+0000 7fdcaf9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdca81597c0 0x7fdca8159c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:48.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.825+0000 7fdcaf9ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdca80cdf90 con 0x7fdca80cea50 2023-07-14T11:16:48.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.825+0000 7fdcaf9ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdca815a2f0 con 0x7fdca81500d0 2023-07-14T11:16:48.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.825+0000 7fdcaf9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdca815a5d0 con 0x7fdca81597c0 2023-07-14T11:16:48.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.826+0000 7fdcadf9c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fdca80cea50 0x7fdca80b2690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:33916/0 (socket says 172.21.15.84:33916) 2023-07-14T11:16:48.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.826+0000 7fdcadf9c700 1 -- 172.21.15.84:0/2168780058 learned_addr learned my addr 172.21.15.84:0/2168780058 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:16:48.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.826+0000 7fdcacf9a700 1 --2- 172.21.15.84:0/2168780058 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdca81597c0 0x7fdca8159c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:48.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.826+0000 7fdc9ffff700 1 -- 172.21.15.84:0/2168780058 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2753800410 0 0) 0x7fdca80cdf90 con 0x7fdca80cea50 2023-07-14T11:16:48.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.826+0000 7fdc9ffff700 1 -- 172.21.15.84:0/2168780058 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc940057c0 con 0x7fdca80cea50 2023-07-14T11:16:48.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.826+0000 7fdc9ffff700 1 -- 172.21.15.84:0/2168780058 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 980509043 0 0) 0x7fdca815a2f0 con 0x7fdca81500d0 2023-07-14T11:16:48.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.826+0000 7fdc9ffff700 1 -- 172.21.15.84:0/2168780058 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdca80cdf90 con 0x7fdca81500d0 2023-07-14T11:16:48.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.826+0000 7fdc9ffff700 1 -- 172.21.15.84:0/2168780058 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2183691513 0 0) 0x7fdc940057c0 con 0x7fdca80cea50 2023-07-14T11:16:48.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.826+0000 7fdc9ffff700 1 -- 172.21.15.84:0/2168780058 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdca81597c0 msgr2=0x7fdca8159c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:16:48.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.826+0000 7fdc9ffff700 1 --2- 172.21.15.84:0/2168780058 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdca81597c0 0x7fdca8159c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:48.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.826+0000 7fdc9ffff700 1 -- 172.21.15.84:0/2168780058 >> v1:172.21.15.179:6789/0 conn(0x7fdca81500d0 legacy=0x7fdca8070350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:48.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.826+0000 7fdc9ffff700 1 -- 172.21.15.84:0/2168780058 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca80ce250 con 0x7fdca80cea50 2023-07-14T11:16:48.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.826+0000 7fdc9ffff700 1 -- 172.21.15.84:0/2168780058 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7fdca00019f0 con 0x7fdca80cea50 2023-07-14T11:16:48.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.826+0000 7fdcacf9a700 1 --2- 172.21.15.84:0/2168780058 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdca81597c0 0x7fdca8159c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:16:48.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.827+0000 7fdc9ffff700 1 -- 172.21.15.84:0/2168780058 >> v1:172.21.15.84:6789/0 conn(0x7fdca80cea50 legacy=0x7fdca80b2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:48.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.827+0000 7fdc9ffff700 1 --2- 172.21.15.84:0/2168780058 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc94005dd0 0x7fdc940061c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:48.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.827+0000 7fdc9ffff700 1 --2- 172.21.15.84:0/2168780058 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc94006a60 0x7fdc94006ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:48.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.827+0000 7fdc9ffff700 1 --2- 172.21.15.84:0/2168780058 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdca81597c0 0x7fdc94007410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:48.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.827+0000 7fdc9ffff700 1 -- 172.21.15.84:0/2168780058 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca815a5d0 con 0x7fdc94006a60 2023-07-14T11:16:48.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.827+0000 7fdc9ffff700 1 -- 172.21.15.84:0/2168780058 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc9400dcd0 con 0x7fdc94005dd0 2023-07-14T11:16:48.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.827+0000 7fdc9ffff700 1 -- 172.21.15.84:0/2168780058 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc9400de60 con 0x7fdca81597c0 2023-07-14T11:16:48.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.827+0000 7fdcacf9a700 1 --2- 172.21.15.84:0/2168780058 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc94006a60 0x7fdc94006ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:48.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.827+0000 7fdcad79b700 1 --2- 172.21.15.84:0/2168780058 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc94005dd0 0x7fdc940061c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:48.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.827+0000 7fdcadf9c700 1 --2- 172.21.15.84:0/2168780058 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdca81597c0 0x7fdc94007410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:48.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.827+0000 7fdcacf9a700 1 -- 172.21.15.84:0/2168780058 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdca81597c0 msgr2=0x7fdc94007410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:16:48.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.827+0000 7fdcacf9a700 1 --2- 172.21.15.84:0/2168780058 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdca81597c0 0x7fdc94007410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:48.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.827+0000 7fdcacf9a700 1 -- 172.21.15.84:0/2168780058 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc94005dd0 msgr2=0x7fdc940061c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:16:48.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.827+0000 7fdcacf9a700 1 --2- 172.21.15.84:0/2168780058 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc94005dd0 0x7fdc940061c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:48.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.827+0000 7fdcacf9a700 1 -- 172.21.15.84:0/2168780058 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc980094a0 con 0x7fdc94006a60 2023-07-14T11:16:48.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.828+0000 7fdcacf9a700 1 --2- 172.21.15.84:0/2168780058 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc94006a60 0x7fdc94006ed0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fdc98009d30 tx=0x7fdc94007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c54e56001ecc93d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:16:48.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.828+0000 7fdc9ffff700 1 -- 172.21.15.84:0/2168780058 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc98009e80 con 0x7fdc94006a60 2023-07-14T11:16:48.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.828+0000 7fdc9ffff700 1 -- 172.21.15.84:0/2168780058 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc9800e9a0 con 0x7fdc94006a60 2023-07-14T11:16:48.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.828+0000 7fdc9ffff700 1 -- 172.21.15.84:0/2168780058 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9800ed10 con 0x7fdc94006a60 2023-07-14T11:16:48.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.828+0000 7fdcaf9ff700 1 -- 172.21.15.84:0/2168780058 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc94006a60 msgr2=0x7fdc94006ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:48.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.828+0000 7fdcaf9ff700 1 --2- 172.21.15.84:0/2168780058 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc94006a60 0x7fdc94006ed0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fdc98009d30 tx=0x7fdc94007a90 comp rx=0 tx=0).stop 2023-07-14T11:16:48.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.828+0000 7fdcadf9c700 1 -- 172.21.15.84:0/2168780058 reap_dead start 2023-07-14T11:16:48.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.828+0000 7fdcaf9ff700 1 -- 172.21.15.84:0/2168780058 shutdown_connections 2023-07-14T11:16:48.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.828+0000 7fdcaf9ff700 1 -- 172.21.15.84:0/2168780058 >> 172.21.15.84:0/2168780058 conn(0x7fdca8069f30 msgr2=0x7fdca806a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:16:48.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.829+0000 7fdcaf9ff700 1 -- 172.21.15.84:0/2168780058 shutdown_connections 2023-07-14T11:16:48.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.829+0000 7fdcaf9ff700 1 -- 172.21.15.84:0/2168780058 wait complete. 2023-07-14T11:16:48.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.831+0000 7fdcaf9ff700 1 Processor -- start 2023-07-14T11:16:48.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.831+0000 7fdcaf9ff700 1 -- start start 2023-07-14T11:16:48.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.832+0000 7fdcaf9ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc94006a60 0x7fdca81427b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:48.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.832+0000 7fdcaf9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdca8149370 0x7fdca81f5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:48.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.832+0000 7fdcaf9ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdca806cc20 0x7fdca806d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:48.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.832+0000 7fdcaf9ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca806d5e0 con 0x7fdca806cc20 2023-07-14T11:16:48.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.832+0000 7fdcaf9ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca81f6590 con 0x7fdc94006a60 2023-07-14T11:16:48.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.832+0000 7fdcaf9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdca81f5fd0 con 0x7fdca8149370 2023-07-14T11:16:48.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.833+0000 7fdcadf9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdca806cc20 0x7fdca806d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:48.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.833+0000 7fdcadf9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdca806cc20 0x7fdca806d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38484/0 (socket says 172.21.15.84:38484) 2023-07-14T11:16:48.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.833+0000 7fdcadf9c700 1 -- 172.21.15.84:0/4116250153 learned_addr learned my addr 172.21.15.84:0/4116250153 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:16:48.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.833+0000 7fdcacf9a700 1 --2- 172.21.15.84:0/4116250153 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdca8149370 0x7fdca81f5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:48.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.833+0000 7fdcad79b700 1 --2- 172.21.15.84:0/4116250153 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc94006a60 0x7fdca81427b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:48.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.833+0000 7fdcadf9c700 1 -- 172.21.15.84:0/4116250153 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdca8149370 msgr2=0x7fdca81f5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:48.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.833+0000 7fdcadf9c700 1 --2- 172.21.15.84:0/4116250153 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdca8149370 0x7fdca81f5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:48.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.833+0000 7fdcadf9c700 1 -- 172.21.15.84:0/4116250153 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc94006a60 msgr2=0x7fdca81427b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:48.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.833+0000 7fdcadf9c700 1 --2- 172.21.15.84:0/4116250153 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc94006a60 0x7fdca81427b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:48.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.833+0000 7fdcadf9c700 1 -- 172.21.15.84:0/4116250153 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca81f62b0 con 0x7fdca806cc20 2023-07-14T11:16:48.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.833+0000 7fdcadf9c700 1 --2- 172.21.15.84:0/4116250153 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdca806cc20 0x7fdca806d0a0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fdca8071b10 tx=0x7fdca000a5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:16:48.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.834+0000 7fdc9dffb700 1 -- 172.21.15.84:0/4116250153 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca000acc0 con 0x7fdca806cc20 2023-07-14T11:16:48.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.834+0000 7fdc9dffb700 1 -- 172.21.15.84:0/4116250153 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdca000ae40 con 0x7fdca806cc20 2023-07-14T11:16:48.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.834+0000 7fdcaf9ff700 1 -- 172.21.15.84:0/4116250153 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdca81505d0 con 0x7fdca806cc20 2023-07-14T11:16:48.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.834+0000 7fdc9dffb700 1 -- 172.21.15.84:0/4116250153 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca0013630 con 0x7fdca806cc20 2023-07-14T11:16:48.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.834+0000 7fdcaf9ff700 1 -- 172.21.15.84:0/4116250153 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdca81f5ba0 con 0x7fdca806cc20 2023-07-14T11:16:48.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.835+0000 7fdcaf9ff700 1 -- 172.21.15.84:0/4116250153 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdca81f5d30 con 0x7fdca806cc20 2023-07-14T11:16:48.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.836+0000 7fdc9dffb700 1 -- 172.21.15.84:0/4116250153 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 8) v1 ==== 89241+0+0 (secure 0 0 0) 0x7fdca0013790 con 0x7fdca806cc20 2023-07-14T11:16:48.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.836+0000 7fdc9dffb700 1 --2- 172.21.15.84:0/4116250153 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fdc8c06af20 0x7fdc8c06d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:48.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.837+0000 7fdc9dffb700 1 -- 172.21.15.84:0/4116250153 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fdca008a420 con 0x7fdca806cc20 2023-07-14T11:16:48.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.837+0000 7fdcad79b700 1 --2- 172.21.15.84:0/4116250153 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fdc8c06af20 0x7fdc8c06d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:48.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.837+0000 7fdcad79b700 1 --2- 172.21.15.84:0/4116250153 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fdc8c06af20 0x7fdc8c06d3d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fdca806b8f0 tx=0x7fdca4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:16:48.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:48.841+0000 7fdc9dffb700 1 -- 172.21.15.84:0/4116250153 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fdca0055120 con 0x7fdca806cc20 2023-07-14T11:16:49.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:49.080+0000 7fdcaf9ff700 1 -- 172.21.15.84:0/4116250153 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdca804e280 con 0x7fdca806cc20 2023-07-14T11:16:49.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:49.081+0000 7fdc9dffb700 1 -- 172.21.15.84:0/4116250153 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+4712 (secure 0 0 0) 0x7fdca0058740 con 0x7fdca806cc20 2023-07-14T11:16:49.083 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:16:49.084 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5030,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3551222138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3551222138},{"type":"v1","addr":"172.21.15.179:6834","nonce":3551222138}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5036,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/1316665435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1316665435},{"type":"v1","addr":"172.21.15.84:6836","nonce":1316665435}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5416,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/611235750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":611235750},{"type":"v1","addr":"172.21.15.179:6835","nonce":611235750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T11:15:10.408480+0000","modified":"2023-07-14T11:15:13.936541+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5625},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5625":{"gid":5625,"name":"c","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/2672133286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":2672133286},{"type":"v1","addr":"172.21.15.84:6837","nonce":2672133286}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-14T11:16:49.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:49.083+0000 7fdcaf9ff700 1 -- 172.21.15.84:0/4116250153 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fdc8c06af20 msgr2=0x7fdc8c06d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:49.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:49.083+0000 7fdcaf9ff700 1 --2- 172.21.15.84:0/4116250153 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fdc8c06af20 0x7fdc8c06d3d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fdca806b8f0 tx=0x7fdca4009040 comp rx=0 tx=0).stop 2023-07-14T11:16:49.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:49.083+0000 7fdcaf9ff700 1 -- 172.21.15.84:0/4116250153 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdca806cc20 msgr2=0x7fdca806d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:49.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:49.083+0000 7fdcaf9ff700 1 --2- 172.21.15.84:0/4116250153 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdca806cc20 0x7fdca806d0a0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fdca8071b10 tx=0x7fdca000a5b0 comp rx=0 tx=0).stop 2023-07-14T11:16:49.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:49.083+0000 7fdcaf9ff700 1 -- 172.21.15.84:0/4116250153 shutdown_connections 2023-07-14T11:16:49.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:49.083+0000 7fdcaf9ff700 1 --2- 172.21.15.84:0/4116250153 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdca806cc20 0x7fdca806d0a0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:49.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:49.083+0000 7fdcaf9ff700 1 --2- 172.21.15.84:0/4116250153 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc94006a60 0x7fdca81427b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:49.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:49.083+0000 7fdcaf9ff700 1 --2- 172.21.15.84:0/4116250153 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fdc8c06af20 0x7fdc8c06d3d0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:49.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:49.083+0000 7fdcaf9ff700 1 --2- 172.21.15.84:0/4116250153 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdca8149370 0x7fdca81f5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:49.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:49.083+0000 7fdcaf9ff700 1 -- 172.21.15.84:0/4116250153 >> 172.21.15.84:0/4116250153 conn(0x7fdca8069f30 msgr2=0x7fdca806b920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:16:49.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:49.084+0000 7fdcaf9ff700 1 -- 172.21.15.84:0/4116250153 shutdown_connections 2023-07-14T11:16:49.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:49.084+0000 7fdcaf9ff700 1 -- 172.21.15.84:0/4116250153 wait complete. 2023-07-14T11:16:49.088 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 28 2023-07-14T11:16:49.103 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2023-07-14T11:16:49.321 INFO:teuthology.orchestra.run.smithi084.stdout:[{"id":5925,"entity":{"name":{"type":"client","num":5925},"addr":{"type":"any","addr":"172.21.15.84:0","nonce":3353249595}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":6,"uptime":75.529607568000003,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":18.477644960254775,"halflife":300},"cap_acquisition":{"value":0,"halflife":10},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5925 172.21.15.84:0/3353249595","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000000fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"3fc0089cc1082313a98853d48b892acdc1385b8b","ceph_version":"ceph version 18.0.0-4757-g3fc0089c (3fc0089cc1082313a98853d48b892acdc1385b8b) reef (dev)","entity_id":"y","hostname":"smithi084","pid":"140843","root":"/"}}] 2023-07-14T11:16:49.322 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 10, "value": 0 }, "client_metadata": { "ceph_sha1": "3fc0089cc1082313a98853d48b892acdc1385b8b", "ceph_version": "ceph version 18.0.0-4757-g3fc0089c (3fc0089cc1082313a98853d48b892acdc1385b8b) reef (dev)", "client_features": { "feature_bits": "0x00000000000fffff" }, "entity_id": "y", "hostname": "smithi084", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "140843", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.84:0", "nonce": 3353249595, "type": "any" }, "name": { "num": 5925, "type": "client" } }, "id": 5925, "inst": "client.5925 172.21.15.84:0/3353249595", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 6, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 18.477644960254775 }, "state": "open", "uptime": 75.529607568 } ] 2023-07-14T11:16:49.323 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2023-07-14T11:16:54.324 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T11:16:54.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:54.520+0000 7f93c8bff700 1 Processor -- start 2023-07-14T11:16:54.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:54.521+0000 7f93c8bff700 1 -- start start 2023-07-14T11:16:54.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:54.522+0000 7f93c8bff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f93c40d1220 0x7f93c40b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:54.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:54.522+0000 7f93c8bff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f93c40b1e00 0x7f93c40afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:54.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:54.522+0000 7f93c8bff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93c40d2ce0 con 0x7f93c415c950 2023-07-14T11:16:54.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:54.522+0000 7f93c8bff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93c40b3350 con 0x7f93c40b1e00 2023-07-14T11:16:54.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:54.522+0000 7f93c8bff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93c40b3630 con 0x7f93c40d1220 2023-07-14T11:16:54.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:54.522+0000 7f93c2d9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f93c40b1e00 0x7f93c40afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:54.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:54.522+0000 7f93c2d9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f93c40b1e00 0x7f93c40afac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50456/0 (socket says 172.21.15.84:50456) 2023-07-14T11:16:54.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:54.522+0000 7f93c2d9d700 1 -- 172.21.15.84:0/1318681159 learned_addr learned my addr 172.21.15.84:0/1318681159 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:16:54.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:54.522+0000 7f93c1d9b700 1 --2- 172.21.15.84:0/1318681159 >> v2:172.21.15.179:3300/0 conn(0x7f93c40d1220 0x7f93c40b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:54.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:54.523+0000 7f93c2d9d700 1 -- 172.21.15.84:0/1318681159 >> v2:172.21.15.179:3300/0 conn(0x7f93c40d1220 msgr2=0x7f93c40b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:16:54.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:54.523+0000 7f93c2d9d700 1 --2- 172.21.15.84:0/1318681159 >> v2:172.21.15.179:3300/0 conn(0x7f93c40d1220 0x7f93c40b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:54.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:54.523+0000 7f93c2d9d700 1 -- 172.21.15.84:0/1318681159 >> v1:172.21.15.179:6789/0 conn(0x7f93c415c950 legacy=0x7f93c40d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:54.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:54.523+0000 7f93c2d9d700 1 -- 172.21.15.84:0/1318681159 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93c40b3910 con 0x7f93c40b1e00 2023-07-14T11:16:54.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:54.523+0000 7f93c2d9d700 1 --2- 172.21.15.84:0/1318681159 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93c40b1e00 0x7f93c40afac0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f93c4072140 tx=0x7f93bc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afd66277085e1cf4 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:16:54.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:54.523+0000 7f93c159a700 1 -- 172.21.15.84:0/1318681159 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93bc00e070 con 0x7f93c40b1e00 2023-07-14T11:16:54.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:54.523+0000 7f93c159a700 1 -- 172.21.15.84:0/1318681159 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93bc00b9c0 con 0x7f93c40b1e00 2023-07-14T11:16:54.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:54.523+0000 7f93c159a700 1 -- 172.21.15.84:0/1318681159 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93bc00bd70 con 0x7f93c40b1e00 2023-07-14T11:16:54.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:54.524+0000 7f93c8bff700 1 -- 172.21.15.84:0/1318681159 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93c40b1e00 msgr2=0x7f93c40afac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:54.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:54.524+0000 7f93c8bff700 1 --2- 172.21.15.84:0/1318681159 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93c40b1e00 0x7f93c40afac0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f93c4072140 tx=0x7f93bc00b330 comp rx=0 tx=0).stop 2023-07-14T11:16:54.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:54.524+0000 7f93c8bff700 1 -- 172.21.15.84:0/1318681159 shutdown_connections 2023-07-14T11:16:54.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:54.524+0000 7f93c8bff700 1 --2- 172.21.15.84:0/1318681159 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93c40b1e00 0x7f93c40afac0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:54.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:54.524+0000 7f93c8bff700 1 --2- 172.21.15.84:0/1318681159 >> v2:172.21.15.179:3300/0 conn(0x7f93c40d1220 0x7f93c40b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:54.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:54.524+0000 7f93c8bff700 1 -- 172.21.15.84:0/1318681159 >> 172.21.15.84:0/1318681159 conn(0x7f93c409c1d0 msgr2=0x7f93c40d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:16:54.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:54.524+0000 7f93c8bff700 1 -- 172.21.15.84:0/1318681159 shutdown_connections 2023-07-14T11:16:54.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:54.524+0000 7f93c8bff700 1 -- 172.21.15.84:0/1318681159 wait complete. 2023-07-14T11:16:54.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:54.526+0000 7f93c8bff700 1 Processor -- start 2023-07-14T11:16:54.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:54.526+0000 7f93c8bff700 1 -- start start 2023-07-14T11:16:54.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:54.527+0000 7f93c8bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93c40b1e00 0x7f93c40cd550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:54.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:54.527+0000 7f93c8bff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93c40d1220 0x7f93c40c8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:54.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:54.527+0000 7f93c8bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93c415c950 0x7f93c4157d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:54.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:54.527+0000 7f93c8bff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93c41e6910 con 0x7f93c40d1220 2023-07-14T11:16:54.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:54.527+0000 7f93c8bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93c40cdda0 con 0x7f93c40b1e00 2023-07-14T11:16:54.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:54.527+0000 7f93c8bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93c40ce080 con 0x7f93c415c950 2023-07-14T11:16:54.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:54.527+0000 7f93c1d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93c40d1220 0x7f93c40c8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:54.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:54.527+0000 7f93c1d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93c40d1220 0x7f93c40c8ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50468/0 (socket says 172.21.15.84:50468) 2023-07-14T11:16:54.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:54.527+0000 7f93c1d9b700 1 -- 172.21.15.84:0/3141041920 learned_addr learned my addr 172.21.15.84:0/3141041920 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:16:54.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:54.527+0000 7f93c2d9d700 1 --2- 172.21.15.84:0/3141041920 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93c415c950 0x7f93c4157d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:54.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:54.527+0000 7f93c259c700 1 --2- 172.21.15.84:0/3141041920 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93c40b1e00 0x7f93c40cd550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:54.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:54.527+0000 7f93c1d9b700 1 -- 172.21.15.84:0/3141041920 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93c415c950 msgr2=0x7f93c4157d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:54.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:54.527+0000 7f93c1d9b700 1 --2- 172.21.15.84:0/3141041920 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93c415c950 0x7f93c4157d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:54.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:54.527+0000 7f93c1d9b700 1 -- 172.21.15.84:0/3141041920 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93c40b1e00 msgr2=0x7f93c40cd550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:54.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:54.527+0000 7f93c1d9b700 1 --2- 172.21.15.84:0/3141041920 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93c40b1e00 0x7f93c40cd550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:54.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:54.527+0000 7f93c1d9b700 1 -- 172.21.15.84:0/3141041920 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93bc009b30 con 0x7f93c40d1220 2023-07-14T11:16:54.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:54.527+0000 7f93c259c700 1 --2- 172.21.15.84:0/3141041920 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93c40b1e00 0x7f93c40cd550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:16:54.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:54.527+0000 7f93c2d9d700 1 --2- 172.21.15.84:0/3141041920 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93c415c950 0x7f93c4157d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:16:54.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:54.528+0000 7f93c1d9b700 1 --2- 172.21.15.84:0/3141041920 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93c40d1220 0x7f93c40c8ec0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f93b800e7e0 tx=0x7f93b800eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:16:54.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:54.528+0000 7f93b2ffd700 1 -- 172.21.15.84:0/3141041920 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b8013610 con 0x7f93c40d1220 2023-07-14T11:16:54.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:54.528+0000 7f93b2ffd700 1 -- 172.21.15.84:0/3141041920 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93b80137b0 con 0x7f93c40d1220 2023-07-14T11:16:54.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:54.528+0000 7f93c8bff700 1 -- 172.21.15.84:0/3141041920 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93c40ce360 con 0x7f93c40d1220 2023-07-14T11:16:54.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:54.528+0000 7f93b2ffd700 1 -- 172.21.15.84:0/3141041920 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b8013b60 con 0x7f93c40d1220 2023-07-14T11:16:54.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:54.528+0000 7f93c8bff700 1 -- 172.21.15.84:0/3141041920 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93c40cda90 con 0x7f93c40d1220 2023-07-14T11:16:54.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:54.529+0000 7f93c8bff700 1 -- 172.21.15.84:0/3141041920 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93c41e6ac0 con 0x7f93c40d1220 2023-07-14T11:16:54.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:54.530+0000 7f93b2ffd700 1 -- 172.21.15.84:0/3141041920 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 8) v1 ==== 89241+0+0 (secure 0 0 0) 0x7f93b8013cc0 con 0x7f93c40d1220 2023-07-14T11:16:54.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:54.531+0000 7f93b2ffd700 1 --2- 172.21.15.84:0/3141041920 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f93a406af20 0x7f93a406d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:54.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:54.531+0000 7f93b2ffd700 1 -- 172.21.15.84:0/3141041920 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f93b8089730 con 0x7f93c40d1220 2023-07-14T11:16:54.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:54.531+0000 7f93c259c700 1 --2- 172.21.15.84:0/3141041920 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f93a406af20 0x7f93a406d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:54.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:54.531+0000 7f93c259c700 1 --2- 172.21.15.84:0/3141041920 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f93a406af20 0x7f93a406d3d0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f93b4000fb0 tx=0x7f93b4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:16:54.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:54.535+0000 7f93b2ffd700 1 -- 172.21.15.84:0/3141041920 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f93c41e6ac0 con 0x7f93c40d1220 2023-07-14T11:16:54.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:54.772+0000 7f93c8bff700 1 -- 172.21.15.84:0/3141041920 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f93c404e280 con 0x7f93c40d1220 2023-07-14T11:16:54.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:54.772+0000 7f93b2ffd700 1 -- 172.21.15.84:0/3141041920 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+4712 (secure 0 0 0) 0x7f93b8057db0 con 0x7f93c40d1220 2023-07-14T11:16:54.775 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:16:54.775 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5030,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3551222138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3551222138},{"type":"v1","addr":"172.21.15.179:6834","nonce":3551222138}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5036,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/1316665435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1316665435},{"type":"v1","addr":"172.21.15.84:6836","nonce":1316665435}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5416,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/611235750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":611235750},{"type":"v1","addr":"172.21.15.179:6835","nonce":611235750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T11:15:10.408480+0000","modified":"2023-07-14T11:15:13.936541+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5625},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5625":{"gid":5625,"name":"c","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/2672133286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":2672133286},{"type":"v1","addr":"172.21.15.84:6837","nonce":2672133286}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-14T11:16:54.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:54.774+0000 7f93c8bff700 1 -- 172.21.15.84:0/3141041920 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f93a406af20 msgr2=0x7f93a406d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:54.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:54.775+0000 7f93c8bff700 1 --2- 172.21.15.84:0/3141041920 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f93a406af20 0x7f93a406d3d0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f93b4000fb0 tx=0x7f93b4009040 comp rx=0 tx=0).stop 2023-07-14T11:16:54.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:54.775+0000 7f93c8bff700 1 -- 172.21.15.84:0/3141041920 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93c40d1220 msgr2=0x7f93c40c8ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:54.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:54.775+0000 7f93c8bff700 1 --2- 172.21.15.84:0/3141041920 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93c40d1220 0x7f93c40c8ec0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f93b800e7e0 tx=0x7f93b800eba0 comp rx=0 tx=0).stop 2023-07-14T11:16:54.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:54.775+0000 7f93c8bff700 1 -- 172.21.15.84:0/3141041920 shutdown_connections 2023-07-14T11:16:54.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:54.775+0000 7f93c8bff700 1 --2- 172.21.15.84:0/3141041920 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f93a406af20 0x7f93a406d3d0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:54.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:54.775+0000 7f93c8bff700 1 --2- 172.21.15.84:0/3141041920 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93c415c950 0x7f93c4157d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:54.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:54.775+0000 7f93c8bff700 1 --2- 172.21.15.84:0/3141041920 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93c40b1e00 0x7f93c40cd550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:54.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:54.775+0000 7f93c8bff700 1 --2- 172.21.15.84:0/3141041920 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93c40d1220 0x7f93c40c8ec0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:54.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:54.775+0000 7f93c8bff700 1 -- 172.21.15.84:0/3141041920 >> 172.21.15.84:0/3141041920 conn(0x7f93c409c1d0 msgr2=0x7f93c40b0570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:16:54.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:54.775+0000 7f93c8bff700 1 -- 172.21.15.84:0/3141041920 shutdown_connections 2023-07-14T11:16:54.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:54.775+0000 7f93c8bff700 1 -- 172.21.15.84:0/3141041920 wait complete. 2023-07-14T11:16:54.779 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 28 2023-07-14T11:16:54.795 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2023-07-14T11:16:55.019 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2023-07-14T11:16:55.020 DEBUG:tasks.cephfs.filesystem:_json_asok output [] 2023-07-14T11:16:55.021 DEBUG:tasks.ceph_test_case:wait_until_true: success in 70s and 0 retries 2023-07-14T11:16:55.021 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-14T11:16:55.022 DEBUG:teuthology.orchestra.run.smithi084:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-14T11:16:55.117 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-14T11:16:55.218 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-14T11:16:55.219 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-14T11:16:55.219 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:16:55.265 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345568k,nr_inodes=4086392,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=35,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275008k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-07-14T11:16:55.266 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-07-14T11:16:55.266 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:16:55.313 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345528k,nr_inodes=4086382,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=40,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275000k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-07-14T11:16:55.314 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-14T11:16:55.314 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:16:55.361 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345568k,nr_inodes=4086392,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=35,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275008k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-07-14T11:16:55.362 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-07-14T11:16:55.363 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:16:55.409 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345528k,nr_inodes=4086382,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=40,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275000k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-07-14T11:16:55.409 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T11:16:55.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:55.601+0000 7f8cf39ff700 1 Processor -- start 2023-07-14T11:16:55.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:55.602+0000 7f8cf39ff700 1 -- start start 2023-07-14T11:16:55.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:55.603+0000 7f8cf39ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8cec15ca30 0x7f8cec06c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:55.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:55.603+0000 7f8cf39ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cec06c360 con 0x7f8cec0d0f40 2023-07-14T11:16:55.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:55.603+0000 7f8cf39ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cec06ba50 con 0x7f8cec0ce840 2023-07-14T11:16:55.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:55.603+0000 7f8cf39ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cec0d1b70 con 0x7f8cec15ca30 2023-07-14T11:16:55.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:55.603+0000 7f8cf1f9c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f8cec0d0f40 0x7f8cec0ad8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:33778/0 (socket says 172.21.15.84:33778) 2023-07-14T11:16:55.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:55.603+0000 7f8cf1f9c700 1 -- 172.21.15.84:0/800947862 learned_addr learned my addr 172.21.15.84:0/800947862 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:16:55.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:55.603+0000 7f8cf179b700 1 --2- 172.21.15.84:0/800947862 >> v2:172.21.15.179:3300/0 conn(0x7f8cec15ca30 0x7f8cec06c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:55.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:55.603+0000 7f8ce3fff700 1 -- 172.21.15.84:0/800947862 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 281791139 0 0) 0x7f8cec06c360 con 0x7f8cec0d0f40 2023-07-14T11:16:55.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:55.604+0000 7f8ce3fff700 1 -- 172.21.15.84:0/800947862 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8cd80035b0 con 0x7f8cec0d0f40 2023-07-14T11:16:55.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:55.604+0000 7f8ce3fff700 1 -- 172.21.15.84:0/800947862 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 649349386 0 0) 0x7f8cec06ba50 con 0x7f8cec0ce840 2023-07-14T11:16:55.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:55.604+0000 7f8ce3fff700 1 -- 172.21.15.84:0/800947862 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8cec06c360 con 0x7f8cec0ce840 2023-07-14T11:16:55.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:55.604+0000 7f8cf179b700 1 -- 172.21.15.84:0/800947862 >> v1:172.21.15.179:6789/0 conn(0x7f8cec0ce840 legacy=0x7f8cec0d0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:55.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:55.604+0000 7f8cf179b700 1 -- 172.21.15.84:0/800947862 >> v1:172.21.15.84:6789/0 conn(0x7f8cec0d0f40 legacy=0x7f8cec0ad8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:55.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:55.604+0000 7f8cf179b700 1 -- 172.21.15.84:0/800947862 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cec0d14a0 con 0x7f8cec15ca30 2023-07-14T11:16:55.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:55.604+0000 7f8cf179b700 1 --2- 172.21.15.84:0/800947862 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8cec15ca30 0x7f8cec06c7f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8ce8009840 tx=0x7f8ce8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b967d0aab7cc9dcd server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:16:55.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:55.604+0000 7f8ce3fff700 1 -- 172.21.15.84:0/800947862 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce8011830 con 0x7f8cec15ca30 2023-07-14T11:16:55.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:55.604+0000 7f8ce3fff700 1 -- 172.21.15.84:0/800947862 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ce8011990 con 0x7f8cec15ca30 2023-07-14T11:16:55.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:55.604+0000 7f8ce3fff700 1 -- 172.21.15.84:0/800947862 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce8011d00 con 0x7f8cec15ca30 2023-07-14T11:16:55.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:55.605+0000 7f8cf39ff700 1 -- 172.21.15.84:0/800947862 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8cec15ca30 msgr2=0x7f8cec06c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:55.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:55.605+0000 7f8cf39ff700 1 --2- 172.21.15.84:0/800947862 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8cec15ca30 0x7f8cec06c7f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8ce8009840 tx=0x7f8ce8009b50 comp rx=0 tx=0).stop 2023-07-14T11:16:55.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:55.605+0000 7f8cf39ff700 1 -- 172.21.15.84:0/800947862 shutdown_connections 2023-07-14T11:16:55.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:55.605+0000 7f8cf39ff700 1 --2- 172.21.15.84:0/800947862 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8cec15ca30 0x7f8cec06c7f0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:55.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:55.605+0000 7f8cf39ff700 1 -- 172.21.15.84:0/800947862 >> 172.21.15.84:0/800947862 conn(0x7f8cec0664f0 msgr2=0x7f8cec099fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:16:55.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:55.605+0000 7f8cf39ff700 1 -- 172.21.15.84:0/800947862 shutdown_connections 2023-07-14T11:16:55.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:55.605+0000 7f8cf39ff700 1 -- 172.21.15.84:0/800947862 wait complete. 2023-07-14T11:16:55.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:55.607+0000 7f8cf39ff700 1 Processor -- start 2023-07-14T11:16:55.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:55.607+0000 7f8cf39ff700 1 -- start start 2023-07-14T11:16:55.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:55.609+0000 7f8cf39ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8cec0ce840 0x7f8cec0ca550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:55.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:55.609+0000 7f8cf39ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8cec0d0f40 0x7f8cec1f1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:55.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:55.609+0000 7f8cf39ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8cec15ca30 0x7f8cec0c8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:55.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:55.609+0000 7f8cf39ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cec1f1e80 con 0x7f8cec0ce840 2023-07-14T11:16:55.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:55.609+0000 7f8cf39ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cec0c8c90 con 0x7f8cec15ca30 2023-07-14T11:16:55.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:55.609+0000 7f8cf39ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cec0c8f30 con 0x7f8cec0d0f40 2023-07-14T11:16:55.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:55.609+0000 7f8cf179b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8cec0ce840 0x7f8cec0ca550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:55.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:55.609+0000 7f8cf179b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8cec0ce840 0x7f8cec0ca550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50484/0 (socket says 172.21.15.84:50484) 2023-07-14T11:16:55.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:55.609+0000 7f8cf179b700 1 -- 172.21.15.84:0/2278731510 learned_addr learned my addr 172.21.15.84:0/2278731510 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:16:55.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:55.609+0000 7f8cf0f9a700 1 --2- 172.21.15.84:0/2278731510 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8cec0d0f40 0x7f8cec1f1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:55.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:55.609+0000 7f8cf1f9c700 1 --2- 172.21.15.84:0/2278731510 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8cec15ca30 0x7f8cec0c8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:55.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:55.609+0000 7f8cf179b700 1 -- 172.21.15.84:0/2278731510 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8cec0d0f40 msgr2=0x7f8cec1f1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:55.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:55.609+0000 7f8cf179b700 1 --2- 172.21.15.84:0/2278731510 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8cec0d0f40 0x7f8cec1f1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:55.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:55.609+0000 7f8cf179b700 1 -- 172.21.15.84:0/2278731510 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8cec15ca30 msgr2=0x7f8cec0c8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:55.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:55.609+0000 7f8cf179b700 1 --2- 172.21.15.84:0/2278731510 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8cec15ca30 0x7f8cec0c8750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:55.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:55.609+0000 7f8cf179b700 1 -- 172.21.15.84:0/2278731510 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce80094a0 con 0x7f8cec0ce840 2023-07-14T11:16:55.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:55.610+0000 7f8cf179b700 1 --2- 172.21.15.84:0/2278731510 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8cec0ce840 0x7f8cec0ca550 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f8ce8009fd0 tx=0x7f8ce8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:16:55.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:55.610+0000 7f8ce1ffb700 1 -- 172.21.15.84:0/2278731510 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce80044d0 con 0x7f8cec0ce840 2023-07-14T11:16:55.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:55.610+0000 7f8ce1ffb700 1 -- 172.21.15.84:0/2278731510 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ce801f070 con 0x7f8cec0ce840 2023-07-14T11:16:55.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:55.610+0000 7f8ce1ffb700 1 -- 172.21.15.84:0/2278731510 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce80038e0 con 0x7f8cec0ce840 2023-07-14T11:16:55.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:55.610+0000 7f8cf39ff700 1 -- 172.21.15.84:0/2278731510 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cec0c9210 con 0x7f8cec0ce840 2023-07-14T11:16:55.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:55.610+0000 7f8cf39ff700 1 -- 172.21.15.84:0/2278731510 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cec0c97d0 con 0x7f8cec0ce840 2023-07-14T11:16:55.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:55.611+0000 7f8cf39ff700 1 -- 172.21.15.84:0/2278731510 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cec0cfc20 con 0x7f8cec0ce840 2023-07-14T11:16:55.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:55.612+0000 7f8ce1ffb700 1 -- 172.21.15.84:0/2278731510 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 8) v1 ==== 89241+0+0 (secure 0 0 0) 0x7f8ce8003a40 con 0x7f8cec0ce840 2023-07-14T11:16:55.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:55.613+0000 7f8ce1ffb700 1 --2- 172.21.15.84:0/2278731510 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f8cd006af20 0x7f8cd006d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:55.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:55.614+0000 7f8ce1ffb700 1 -- 172.21.15.84:0/2278731510 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f8ce8021070 con 0x7f8cec0ce840 2023-07-14T11:16:55.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:55.614+0000 7f8cf0f9a700 1 --2- 172.21.15.84:0/2278731510 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f8cd006af20 0x7f8cd006d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:55.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:55.614+0000 7f8cf0f9a700 1 --2- 172.21.15.84:0/2278731510 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f8cd006af20 0x7f8cd006d3d0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f8cec0b6bc0 tx=0x7f8cdc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:16:55.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:55.618+0000 7f8ce1ffb700 1 -- 172.21.15.84:0/2278731510 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f8ce8055e70 con 0x7f8cec0ce840 2023-07-14T11:16:55.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:55.851+0000 7f8cf39ff700 1 -- 172.21.15.84:0/2278731510 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8cec04e280 con 0x7f8cec0ce840 2023-07-14T11:16:55.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:55.851+0000 7f8ce1ffb700 1 -- 172.21.15.84:0/2278731510 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+4712 (secure 0 0 0) 0x7f8ce8059490 con 0x7f8cec0ce840 2023-07-14T11:16:55.854 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:16:55.854 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5030,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3551222138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3551222138},{"type":"v1","addr":"172.21.15.179:6834","nonce":3551222138}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5036,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/1316665435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1316665435},{"type":"v1","addr":"172.21.15.84:6836","nonce":1316665435}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5416,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/611235750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":611235750},{"type":"v1","addr":"172.21.15.179:6835","nonce":611235750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T11:15:10.408480+0000","modified":"2023-07-14T11:15:13.936541+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5625},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5625":{"gid":5625,"name":"c","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/2672133286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":2672133286},{"type":"v1","addr":"172.21.15.84:6837","nonce":2672133286}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-14T11:16:55.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:55.853+0000 7f8cf39ff700 1 -- 172.21.15.84:0/2278731510 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f8cd006af20 msgr2=0x7f8cd006d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:55.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:55.853+0000 7f8cf39ff700 1 --2- 172.21.15.84:0/2278731510 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f8cd006af20 0x7f8cd006d3d0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f8cec0b6bc0 tx=0x7f8cdc009040 comp rx=0 tx=0).stop 2023-07-14T11:16:55.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:55.853+0000 7f8cf39ff700 1 -- 172.21.15.84:0/2278731510 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8cec0ce840 msgr2=0x7f8cec0ca550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:55.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:55.853+0000 7f8cf39ff700 1 --2- 172.21.15.84:0/2278731510 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8cec0ce840 0x7f8cec0ca550 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f8ce8009fd0 tx=0x7f8ce8004750 comp rx=0 tx=0).stop 2023-07-14T11:16:55.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:55.854+0000 7f8cf39ff700 1 -- 172.21.15.84:0/2278731510 shutdown_connections 2023-07-14T11:16:55.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:55.854+0000 7f8cf39ff700 1 --2- 172.21.15.84:0/2278731510 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8cec15ca30 0x7f8cec0c8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:55.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:55.854+0000 7f8cf39ff700 1 --2- 172.21.15.84:0/2278731510 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8cec0ce840 0x7f8cec0ca550 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:55.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:55.854+0000 7f8cf39ff700 1 --2- 172.21.15.84:0/2278731510 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f8cd006af20 0x7f8cd006d3d0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:55.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:55.854+0000 7f8cf39ff700 1 --2- 172.21.15.84:0/2278731510 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8cec0d0f40 0x7f8cec1f1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:55.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:55.854+0000 7f8cf39ff700 1 -- 172.21.15.84:0/2278731510 >> 172.21.15.84:0/2278731510 conn(0x7f8cec0664f0 msgr2=0x7f8cec0ae460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:16:55.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:55.854+0000 7f8cf39ff700 1 -- 172.21.15.84:0/2278731510 shutdown_connections 2023-07-14T11:16:55.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:55.854+0000 7f8cf39ff700 1 -- 172.21.15.84:0/2278731510 wait complete. 2023-07-14T11:16:55.858 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 28 2023-07-14T11:16:55.874 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:16:56.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.067+0000 7ff994dff700 1 Processor -- start 2023-07-14T11:16:56.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.067+0000 7ff994dff700 1 -- start start 2023-07-14T11:16:56.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.069+0000 7ff994dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff99015afd0 0x7ff9900cee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:56.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.069+0000 7ff994dff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9900ce110 con 0x7ff9900b3e90 2023-07-14T11:16:56.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.069+0000 7ff994dff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff99015b660 con 0x7ff99015e890 2023-07-14T11:16:56.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.069+0000 7ff994dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff99015b470 con 0x7ff99015afd0 2023-07-14T11:16:56.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.069+0000 7ff987fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7ff9900b3e90 0x7ff99015a8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:33782/0 (socket says 172.21.15.84:33782) 2023-07-14T11:16:56.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.069+0000 7ff987fff700 1 -- 172.21.15.84:0/4012131275 learned_addr learned my addr 172.21.15.84:0/4012131275 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:16:56.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.069+0000 7ff98ed9d700 1 --2- 172.21.15.84:0/4012131275 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff99015afd0 0x7ff9900cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:56.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.069+0000 7ff98dd9b700 1 -- 172.21.15.84:0/4012131275 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3350367659 0 0) 0x7ff9900ce110 con 0x7ff9900b3e90 2023-07-14T11:16:56.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.069+0000 7ff98dd9b700 1 -- 172.21.15.84:0/4012131275 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff97c0035b0 con 0x7ff9900b3e90 2023-07-14T11:16:56.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.070+0000 7ff98dd9b700 1 -- 172.21.15.84:0/4012131275 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 765524764 0 0) 0x7ff99015b660 con 0x7ff99015e890 2023-07-14T11:16:56.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.070+0000 7ff98dd9b700 1 -- 172.21.15.84:0/4012131275 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9900ce110 con 0x7ff99015e890 2023-07-14T11:16:56.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.070+0000 7ff98ed9d700 1 -- 172.21.15.84:0/4012131275 >> v1:172.21.15.179:6789/0 conn(0x7ff99015e890 legacy=0x7ff9900b3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:56.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.070+0000 7ff98dd9b700 1 -- 172.21.15.84:0/4012131275 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3797531904 0 0) 0x7ff97c0035b0 con 0x7ff9900b3e90 2023-07-14T11:16:56.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.070+0000 7ff98ed9d700 1 -- 172.21.15.84:0/4012131275 >> v1:172.21.15.84:6789/0 conn(0x7ff9900b3e90 legacy=0x7ff99015a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:56.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.070+0000 7ff98ed9d700 1 -- 172.21.15.84:0/4012131275 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9900ce360 con 0x7ff99015afd0 2023-07-14T11:16:56.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.070+0000 7ff98ed9d700 1 --2- 172.21.15.84:0/4012131275 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff99015afd0 0x7ff9900cee40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff988009dc0 tx=0x7ff98800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66d4b366914b00da server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:16:56.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.070+0000 7ff98dd9b700 1 -- 172.21.15.84:0/4012131275 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98800e070 con 0x7ff99015afd0 2023-07-14T11:16:56.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.070+0000 7ff98dd9b700 1 -- 172.21.15.84:0/4012131275 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff988003a20 con 0x7ff99015afd0 2023-07-14T11:16:56.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.070+0000 7ff98dd9b700 1 -- 172.21.15.84:0/4012131275 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff978001670 con 0x7ff99015afd0 2023-07-14T11:16:56.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.071+0000 7ff994dff700 1 -- 172.21.15.84:0/4012131275 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff99015afd0 msgr2=0x7ff9900cee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:56.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.071+0000 7ff994dff700 1 --2- 172.21.15.84:0/4012131275 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff99015afd0 0x7ff9900cee40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff988009dc0 tx=0x7ff98800b330 comp rx=0 tx=0).stop 2023-07-14T11:16:56.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.071+0000 7ff994dff700 1 -- 172.21.15.84:0/4012131275 shutdown_connections 2023-07-14T11:16:56.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.071+0000 7ff994dff700 1 --2- 172.21.15.84:0/4012131275 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff99015afd0 0x7ff9900cee40 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:56.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.071+0000 7ff994dff700 1 -- 172.21.15.84:0/4012131275 >> 172.21.15.84:0/4012131275 conn(0x7ff990069f30 msgr2=0x7ff99006a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:16:56.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.071+0000 7ff994dff700 1 -- 172.21.15.84:0/4012131275 shutdown_connections 2023-07-14T11:16:56.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.071+0000 7ff994dff700 1 -- 172.21.15.84:0/4012131275 wait complete. 2023-07-14T11:16:56.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.073+0000 7ff994dff700 1 Processor -- start 2023-07-14T11:16:56.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.073+0000 7ff994dff700 1 -- start start 2023-07-14T11:16:56.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.075+0000 7ff994dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9900b3e90 0x7ff99013e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:56.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.075+0000 7ff994dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff99015afd0 0x7ff9900b0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:56.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.075+0000 7ff994dff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff99015e890 0x7ff99014f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:56.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.075+0000 7ff994dff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff99013e9d0 con 0x7ff99015e890 2023-07-14T11:16:56.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.075+0000 7ff994dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9900b0970 con 0x7ff99015afd0 2023-07-14T11:16:56.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.075+0000 7ff994dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9900b0c50 con 0x7ff9900b3e90 2023-07-14T11:16:56.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.075+0000 7ff98ed9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff99015e890 0x7ff99014f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:56.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.075+0000 7ff98ed9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff99015e890 0x7ff99014f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50500/0 (socket says 172.21.15.84:50500) 2023-07-14T11:16:56.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.075+0000 7ff98ed9d700 1 -- 172.21.15.84:0/3533596957 learned_addr learned my addr 172.21.15.84:0/3533596957 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:16:56.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.075+0000 7ff98e59c700 1 --2- 172.21.15.84:0/3533596957 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9900b3e90 0x7ff99013e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:56.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.075+0000 7ff987fff700 1 --2- 172.21.15.84:0/3533596957 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff99015afd0 0x7ff9900b0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:56.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.075+0000 7ff98ed9d700 1 -- 172.21.15.84:0/3533596957 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9900b3e90 msgr2=0x7ff99013e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:56.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.075+0000 7ff98ed9d700 1 --2- 172.21.15.84:0/3533596957 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9900b3e90 0x7ff99013e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:56.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.075+0000 7ff98ed9d700 1 -- 172.21.15.84:0/3533596957 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff99015afd0 msgr2=0x7ff9900b0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:56.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.075+0000 7ff98ed9d700 1 --2- 172.21.15.84:0/3533596957 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff99015afd0 0x7ff9900b0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:56.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.075+0000 7ff98ed9d700 1 -- 172.21.15.84:0/3533596957 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff988009a70 con 0x7ff99015e890 2023-07-14T11:16:56.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.075+0000 7ff987fff700 1 --2- 172.21.15.84:0/3533596957 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff99015afd0 0x7ff9900b0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:16:56.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.076+0000 7ff98ed9d700 1 --2- 172.21.15.84:0/3533596957 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff99015e890 0x7ff99014f8e0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7ff988009d90 tx=0x7ff988004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:16:56.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.076+0000 7ff986ffd700 1 -- 172.21.15.84:0/3533596957 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff988004540 con 0x7ff99015e890 2023-07-14T11:16:56.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.076+0000 7ff986ffd700 1 -- 172.21.15.84:0/3533596957 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9880046a0 con 0x7ff99015e890 2023-07-14T11:16:56.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.076+0000 7ff994dff700 1 -- 172.21.15.84:0/3533596957 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9900b0f30 con 0x7ff99015e890 2023-07-14T11:16:56.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.076+0000 7ff986ffd700 1 -- 172.21.15.84:0/3533596957 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98801d470 con 0x7ff99015e890 2023-07-14T11:16:56.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.076+0000 7ff994dff700 1 -- 172.21.15.84:0/3533596957 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9900b0680 con 0x7ff99015e890 2023-07-14T11:16:56.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.077+0000 7ff994dff700 1 -- 172.21.15.84:0/3533596957 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9901e4af0 con 0x7ff99015e890 2023-07-14T11:16:56.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.078+0000 7ff986ffd700 1 -- 172.21.15.84:0/3533596957 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 8) v1 ==== 89241+0+0 (secure 0 0 0) 0x7ff98801d5d0 con 0x7ff99015e890 2023-07-14T11:16:56.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.079+0000 7ff986ffd700 1 --2- 172.21.15.84:0/3533596957 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff97006af20 0x7ff97006d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:56.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.079+0000 7ff986ffd700 1 -- 172.21.15.84:0/3533596957 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6120+0+0 (secure 0 0 0) 0x7ff98808b830 con 0x7ff99015e890 2023-07-14T11:16:56.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.079+0000 7ff98e59c700 1 --2- 172.21.15.84:0/3533596957 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff97006af20 0x7ff97006d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:56.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.080+0000 7ff98e59c700 1 --2- 172.21.15.84:0/3533596957 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff97006af20 0x7ff97006d3d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff980001220 tx=0x7ff980009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:16:56.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.083+0000 7ff986ffd700 1 -- 172.21.15.84:0/3533596957 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ff9901e4af0 con 0x7ff99015e890 2023-07-14T11:16:56.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.281+0000 7ff994dff700 1 -- 172.21.15.84:0/3533596957 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff9901e4af0 con 0x7ff99015e890 2023-07-14T11:16:56.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.282+0000 7ff986ffd700 1 -- 172.21.15.84:0/3533596957 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+18422 (secure 0 0 0) 0x7ff9901e4af0 con 0x7ff99015e890 2023-07-14T11:16:56.285 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:16:56.286 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":52,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:15:57.830481+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-07-14T11:15:08.611029+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-07-14T11:15:09.373415+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.c","mappings":[{"from":0,"to":6}]},{"pgid":"8.28","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:16:56.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.285+0000 7ff994dff700 1 -- 172.21.15.84:0/3533596957 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff97006af20 msgr2=0x7ff97006d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:56.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.285+0000 7ff994dff700 1 --2- 172.21.15.84:0/3533596957 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff97006af20 0x7ff97006d3d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff980001220 tx=0x7ff980009040 comp rx=0 tx=0).stop 2023-07-14T11:16:56.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.285+0000 7ff994dff700 1 -- 172.21.15.84:0/3533596957 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff99015e890 msgr2=0x7ff99014f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:56.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.285+0000 7ff994dff700 1 --2- 172.21.15.84:0/3533596957 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff99015e890 0x7ff99014f8e0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7ff988009d90 tx=0x7ff988004ad0 comp rx=0 tx=0).stop 2023-07-14T11:16:56.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.285+0000 7ff994dff700 1 -- 172.21.15.84:0/3533596957 shutdown_connections 2023-07-14T11:16:56.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.285+0000 7ff994dff700 1 --2- 172.21.15.84:0/3533596957 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff97006af20 0x7ff97006d3d0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:56.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.285+0000 7ff994dff700 1 --2- 172.21.15.84:0/3533596957 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9900b3e90 0x7ff99013e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:56.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.285+0000 7ff994dff700 1 --2- 172.21.15.84:0/3533596957 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff99015e890 0x7ff99014f8e0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:56.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.285+0000 7ff994dff700 1 --2- 172.21.15.84:0/3533596957 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff99015afd0 0x7ff9900b0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:56.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.285+0000 7ff994dff700 1 -- 172.21.15.84:0/3533596957 >> 172.21.15.84:0/3533596957 conn(0x7ff990069f30 msgr2=0x7ff99015a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:16:56.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.285+0000 7ff994dff700 1 -- 172.21.15.84:0/3533596957 shutdown_connections 2023-07-14T11:16:56.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.285+0000 7ff994dff700 1 -- 172.21.15.84:0/3533596957 wait complete. 2023-07-14T11:16:56.306 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T11:13:00.125395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T11:13:06.803994+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T11:15:08.611029+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T11:15:09.373415+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T11:16:56.307 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T11:16:56.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.502+0000 7f61b0dff700 1 Processor -- start 2023-07-14T11:16:56.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.502+0000 7f61b0dff700 1 -- start start 2023-07-14T11:16:56.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.503+0000 7f61b0dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f61ac156cf0 0x7f61ac0d0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:56.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.503+0000 7f61b0dff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f61ac0b50c0 0x7f61ac0cfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:56.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.503+0000 7f61b0dff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61ac0cd4e0 con 0x7f61ac15d5c0 2023-07-14T11:16:56.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.503+0000 7f61b0dff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61ac0d0280 con 0x7f61ac0b50c0 2023-07-14T11:16:56.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.503+0000 7f61b0dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61ac0d0fa0 con 0x7f61ac156cf0 2023-07-14T11:16:56.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.503+0000 7f61aad9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f61ac0b50c0 0x7f61ac0cfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:56.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.504+0000 7f61aad9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f61ac0b50c0 0x7f61ac0cfd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50516/0 (socket says 172.21.15.84:50516) 2023-07-14T11:16:56.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.504+0000 7f61aad9d700 1 -- 172.21.15.84:0/4083497558 learned_addr learned my addr 172.21.15.84:0/4083497558 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:16:56.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.504+0000 7f61aa59c700 1 --2- 172.21.15.84:0/4083497558 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f61ac156cf0 0x7f61ac0d0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:56.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.504+0000 7f61aad9d700 1 -- 172.21.15.84:0/4083497558 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f61ac156cf0 msgr2=0x7f61ac0d0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:16:56.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.504+0000 7f61aad9d700 1 --2- 172.21.15.84:0/4083497558 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f61ac156cf0 0x7f61ac0d0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:56.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.504+0000 7f61aad9d700 1 -- 172.21.15.84:0/4083497558 >> v1:172.21.15.179:6789/0 conn(0x7f61ac15d5c0 legacy=0x7f61ac0cf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:16:56.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.504+0000 7f61aad9d700 1 -- 172.21.15.84:0/4083497558 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61ac15da60 con 0x7f61ac0b50c0 2023-07-14T11:16:56.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.504+0000 7f61aa59c700 1 --2- 172.21.15.84:0/4083497558 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f61ac156cf0 0x7f61ac0d0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:16:56.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.504+0000 7f61aad9d700 1 --2- 172.21.15.84:0/4083497558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61ac0b50c0 0x7f61ac0cfd40 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f61a4009e50 tx=0x7f61a400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed9a050c7f1ea0f8 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:16:56.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.504+0000 7f61a959a700 1 -- 172.21.15.84:0/4083497558 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a400e070 con 0x7f61ac0b50c0 2023-07-14T11:16:56.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.504+0000 7f61a959a700 1 -- 172.21.15.84:0/4083497558 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61a4003a20 con 0x7f61ac0b50c0 2023-07-14T11:16:56.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.504+0000 7f61a959a700 1 -- 172.21.15.84:0/4083497558 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a4003dd0 con 0x7f61ac0b50c0 2023-07-14T11:16:56.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.505+0000 7f61b0dff700 1 -- 172.21.15.84:0/4083497558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61ac0b50c0 msgr2=0x7f61ac0cfd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:56.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.505+0000 7f61b0dff700 1 --2- 172.21.15.84:0/4083497558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61ac0b50c0 0x7f61ac0cfd40 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f61a4009e50 tx=0x7f61a400b330 comp rx=0 tx=0).stop 2023-07-14T11:16:56.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.505+0000 7f61b0dff700 1 -- 172.21.15.84:0/4083497558 shutdown_connections 2023-07-14T11:16:56.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.505+0000 7f61b0dff700 1 --2- 172.21.15.84:0/4083497558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61ac0b50c0 0x7f61ac0cfd40 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:56.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.505+0000 7f61b0dff700 1 --2- 172.21.15.84:0/4083497558 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f61ac156cf0 0x7f61ac0d0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:56.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.505+0000 7f61b0dff700 1 -- 172.21.15.84:0/4083497558 >> 172.21.15.84:0/4083497558 conn(0x7f61ac06a6c0 msgr2=0x7f61ac06aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:16:56.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.505+0000 7f61b0dff700 1 -- 172.21.15.84:0/4083497558 shutdown_connections 2023-07-14T11:16:56.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.505+0000 7f61b0dff700 1 -- 172.21.15.84:0/4083497558 wait complete. 2023-07-14T11:16:56.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.507+0000 7f61b0dff700 1 Processor -- start 2023-07-14T11:16:56.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.508+0000 7f61b0dff700 1 -- start start 2023-07-14T11:16:56.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.509+0000 7f61b0dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61ac0b50c0 0x7f61ac159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:56.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.509+0000 7f61b0dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f61ac156cf0 0x7f61ac0ccb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:56.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.509+0000 7f61b0dff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61ac15d5c0 0x7f61ac154cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:56.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.509+0000 7f61b0dff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61ac0cba60 con 0x7f61ac15d5c0 2023-07-14T11:16:56.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.509+0000 7f61b0dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61ac155210 con 0x7f61ac0b50c0 2023-07-14T11:16:56.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.509+0000 7f61b0dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61ac1570c0 con 0x7f61ac156cf0 2023-07-14T11:16:56.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.509+0000 7f61aad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61ac15d5c0 0x7f61ac154cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:56.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.509+0000 7f61aad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61ac15d5c0 0x7f61ac154cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50526/0 (socket says 172.21.15.84:50526) 2023-07-14T11:16:56.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.509+0000 7f61aad9d700 1 -- 172.21.15.84:0/3663573020 learned_addr learned my addr 172.21.15.84:0/3663573020 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:16:56.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.509+0000 7f61a9d9b700 1 --2- 172.21.15.84:0/3663573020 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f61ac156cf0 0x7f61ac0ccb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:56.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.509+0000 7f61aa59c700 1 --2- 172.21.15.84:0/3663573020 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61ac0b50c0 0x7f61ac159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:56.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.509+0000 7f61aad9d700 1 -- 172.21.15.84:0/3663573020 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f61ac156cf0 msgr2=0x7f61ac0ccb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:56.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.509+0000 7f61aad9d700 1 --2- 172.21.15.84:0/3663573020 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f61ac156cf0 0x7f61ac0ccb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:56.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.509+0000 7f61aad9d700 1 -- 172.21.15.84:0/3663573020 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61ac0b50c0 msgr2=0x7f61ac159ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:56.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.509+0000 7f61aad9d700 1 --2- 172.21.15.84:0/3663573020 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61ac0b50c0 0x7f61ac159ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:56.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.509+0000 7f61aad9d700 1 -- 172.21.15.84:0/3663573020 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a4009b30 con 0x7f61ac15d5c0 2023-07-14T11:16:56.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.510+0000 7f61aad9d700 1 --2- 172.21.15.84:0/3663573020 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61ac15d5c0 0x7f61ac154cd0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f61a400b730 tx=0x7f61a4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:16:56.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.510+0000 7f619affd700 1 -- 172.21.15.84:0/3663573020 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a4004440 con 0x7f61ac15d5c0 2023-07-14T11:16:56.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.510+0000 7f619affd700 1 -- 172.21.15.84:0/3663573020 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61a40045c0 con 0x7f61ac15d5c0 2023-07-14T11:16:56.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.510+0000 7f61b0dff700 1 -- 172.21.15.84:0/3663573020 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61ac157310 con 0x7f61ac15d5c0 2023-07-14T11:16:56.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.510+0000 7f619affd700 1 -- 172.21.15.84:0/3663573020 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a4004970 con 0x7f61ac15d5c0 2023-07-14T11:16:56.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.510+0000 7f61b0dff700 1 -- 172.21.15.84:0/3663573020 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61ac1578d0 con 0x7f61ac15d5c0 2023-07-14T11:16:56.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.511+0000 7f61b0dff700 1 -- 172.21.15.84:0/3663573020 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61ac04e210 con 0x7f61ac15d5c0 2023-07-14T11:16:56.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.512+0000 7f619affd700 1 -- 172.21.15.84:0/3663573020 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 8) v1 ==== 89241+0+0 (secure 0 0 0) 0x7f61a401c440 con 0x7f61ac15d5c0 2023-07-14T11:16:56.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.513+0000 7f619affd700 1 --2- 172.21.15.84:0/3663573020 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f618c06af20 0x7f618c06d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:56.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.513+0000 7f619affd700 1 -- 172.21.15.84:0/3663573020 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f61a408ad10 con 0x7f61ac15d5c0 2023-07-14T11:16:56.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.513+0000 7f61aa59c700 1 --2- 172.21.15.84:0/3663573020 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f618c06af20 0x7f618c06d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:56.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.514+0000 7f61aa59c700 1 --2- 172.21.15.84:0/3663573020 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f618c06af20 0x7f618c06d3d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f619c006fd0 tx=0x7f619c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:16:56.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.517+0000 7f619affd700 1 -- 172.21.15.84:0/3663573020 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f61a4090020 con 0x7f61ac15d5c0 2023-07-14T11:16:56.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.712+0000 7f61b0dff700 1 -- 172.21.15.84:0/3663573020 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f61ac0b3000 con 0x7f61ac15d5c0 2023-07-14T11:16:56.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.712+0000 7f619affd700 1 -- 172.21.15.84:0/3663573020 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v52) v1 ==== 93+0+10 (secure 0 0 0) 0x7f61a4059390 con 0x7f61ac15d5c0 2023-07-14T11:16:56.715 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-07-14T11:16:56.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.715+0000 7f61b0dff700 1 -- 172.21.15.84:0/3663573020 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f618c06af20 msgr2=0x7f618c06d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:56.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.715+0000 7f61b0dff700 1 --2- 172.21.15.84:0/3663573020 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f618c06af20 0x7f618c06d3d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f619c006fd0 tx=0x7f619c008040 comp rx=0 tx=0).stop 2023-07-14T11:16:56.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.715+0000 7f61b0dff700 1 -- 172.21.15.84:0/3663573020 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61ac15d5c0 msgr2=0x7f61ac154cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:56.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.715+0000 7f61b0dff700 1 --2- 172.21.15.84:0/3663573020 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61ac15d5c0 0x7f61ac154cd0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f61a400b730 tx=0x7f61a4004ad0 comp rx=0 tx=0).stop 2023-07-14T11:16:56.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.715+0000 7f61b0dff700 1 -- 172.21.15.84:0/3663573020 shutdown_connections 2023-07-14T11:16:56.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.715+0000 7f61b0dff700 1 --2- 172.21.15.84:0/3663573020 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61ac15d5c0 0x7f61ac154cd0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:56.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.715+0000 7f61b0dff700 1 --2- 172.21.15.84:0/3663573020 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61ac0b50c0 0x7f61ac159ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:56.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.715+0000 7f61b0dff700 1 --2- 172.21.15.84:0/3663573020 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f618c06af20 0x7f618c06d3d0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:56.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.715+0000 7f61b0dff700 1 --2- 172.21.15.84:0/3663573020 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f61ac156cf0 0x7f61ac0ccb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:56.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.715+0000 7f61b0dff700 1 -- 172.21.15.84:0/3663573020 >> 172.21.15.84:0/3663573020 conn(0x7f61ac06a6c0 msgr2=0x7f61ac0cf630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:16:56.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.715+0000 7f61b0dff700 1 -- 172.21.15.84:0/3663573020 shutdown_connections 2023-07-14T11:16:56.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.715+0000 7f61b0dff700 1 -- 172.21.15.84:0/3663573020 wait complete. 2023-07-14T11:16:56.735 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T11:16:56.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.931+0000 7f730efff700 1 Processor -- start 2023-07-14T11:16:56.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.931+0000 7f730efff700 1 -- start start 2023-07-14T11:16:56.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.933+0000 7f730efff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f730815d9d0 0x7f730806b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:56.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.933+0000 7f730efff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f730806c9f0 0x7f73080b1910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:56.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.933+0000 7f730efff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f730806c4e0 con 0x7f73080b1e50 2023-07-14T11:16:56.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.933+0000 7f730efff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f730815dda0 con 0x7f730815d9d0 2023-07-14T11:16:56.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.933+0000 7f730efff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f730806bf20 con 0x7f730806c9f0 2023-07-14T11:16:56.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.933+0000 7f730cd9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f730815d9d0 0x7f730806b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:56.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.933+0000 7f730cd9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f730815d9d0 0x7f730806b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50528/0 (socket says 172.21.15.84:50528) 2023-07-14T11:16:56.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.933+0000 7f730cd9b700 1 -- 172.21.15.84:0/2711751347 learned_addr learned my addr 172.21.15.84:0/2711751347 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:16:56.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.933+0000 7f730d59c700 1 --1- 172.21.15.84:0/2711751347 >> v1:172.21.15.84:6789/0 conn(0x7f73080b1e50 0x7f7308071170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:33798/0 (socket says 172.21.15.84:33798) 2023-07-14T11:16:56.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.933+0000 7f7307fff700 1 --2- 172.21.15.84:0/2711751347 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f730806c9f0 0x7f73080b1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:56.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.933+0000 7f730cd9b700 1 -- 172.21.15.84:0/2711751347 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f730806c9f0 msgr2=0x7f73080b1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:16:56.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.933+0000 7f730cd9b700 1 --2- 172.21.15.84:0/2711751347 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f730806c9f0 0x7f73080b1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:56.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.933+0000 7f730cd9b700 1 -- 172.21.15.84:0/2711751347 >> v1:172.21.15.84:6789/0 conn(0x7f73080b1e50 legacy=0x7f7308071170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:56.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.933+0000 7f730cd9b700 1 -- 172.21.15.84:0/2711751347 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f730806c200 con 0x7f730815d9d0 2023-07-14T11:16:56.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.933+0000 7f7307fff700 1 --2- 172.21.15.84:0/2711751347 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f730806c9f0 0x7f73080b1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:16:56.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.933+0000 7f73077fe700 1 -- 172.21.15.84:0/2711751347 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2157084692 0 0) 0x7f730806c4e0 con 0x7f73080b1e50 2023-07-14T11:16:56.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.934+0000 7f730cd9b700 1 --2- 172.21.15.84:0/2711751347 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f730815d9d0 0x7f730806b5b0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f72fc0098f0 tx=0x7f72fc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3baacfbfa7b00e01 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:16:56.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.934+0000 7f73077fe700 1 -- 172.21.15.84:0/2711751347 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72fc00b8a0 con 0x7f730815d9d0 2023-07-14T11:16:56.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.934+0000 7f73077fe700 1 -- 172.21.15.84:0/2711751347 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72fc00ba00 con 0x7f730815d9d0 2023-07-14T11:16:56.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.934+0000 7f73077fe700 1 -- 172.21.15.84:0/2711751347 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72fc00bd90 con 0x7f730815d9d0 2023-07-14T11:16:56.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.934+0000 7f730efff700 1 -- 172.21.15.84:0/2711751347 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f730815d9d0 msgr2=0x7f730806b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:56.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.934+0000 7f730efff700 1 --2- 172.21.15.84:0/2711751347 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f730815d9d0 0x7f730806b5b0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f72fc0098f0 tx=0x7f72fc009c00 comp rx=0 tx=0).stop 2023-07-14T11:16:56.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.935+0000 7f730efff700 1 -- 172.21.15.84:0/2711751347 shutdown_connections 2023-07-14T11:16:56.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.935+0000 7f730efff700 1 --2- 172.21.15.84:0/2711751347 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f730815d9d0 0x7f730806b5b0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:56.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.935+0000 7f730efff700 1 --2- 172.21.15.84:0/2711751347 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f730806c9f0 0x7f73080b1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:56.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.935+0000 7f730efff700 1 -- 172.21.15.84:0/2711751347 >> 172.21.15.84:0/2711751347 conn(0x7f73080b05d0 msgr2=0x7f73080b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:16:56.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.935+0000 7f730efff700 1 -- 172.21.15.84:0/2711751347 shutdown_connections 2023-07-14T11:16:56.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.935+0000 7f730efff700 1 -- 172.21.15.84:0/2711751347 wait complete. 2023-07-14T11:16:56.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.937+0000 7f730efff700 1 Processor -- start 2023-07-14T11:16:56.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.937+0000 7f730efff700 1 -- start start 2023-07-14T11:16:56.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.938+0000 7f730efff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f730806c9f0 0x7f73080c4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:56.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.938+0000 7f730efff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73080b1e50 0x7f73080c25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:56.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.938+0000 7f730efff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f730815d9d0 0x7f73080aeae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:56.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.938+0000 7f730efff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73080c3090 con 0x7f730806c9f0 2023-07-14T11:16:56.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.938+0000 7f730efff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73080c3370 con 0x7f730815d9d0 2023-07-14T11:16:56.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.938+0000 7f730efff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73080c3650 con 0x7f73080b1e50 2023-07-14T11:16:56.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.939+0000 7f730cd9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f730806c9f0 0x7f73080c4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:56.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.939+0000 7f730cd9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f730806c9f0 0x7f73080c4d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50542/0 (socket says 172.21.15.84:50542) 2023-07-14T11:16:56.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.939+0000 7f730cd9b700 1 -- 172.21.15.84:0/1565769893 learned_addr learned my addr 172.21.15.84:0/1565769893 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:16:56.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.939+0000 7f7307fff700 1 --2- 172.21.15.84:0/1565769893 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73080b1e50 0x7f73080c25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:56.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.939+0000 7f730d59c700 1 --2- 172.21.15.84:0/1565769893 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f730815d9d0 0x7f73080aeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:56.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.939+0000 7f730cd9b700 1 -- 172.21.15.84:0/1565769893 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73080b1e50 msgr2=0x7f73080c25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:56.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.939+0000 7f730cd9b700 1 --2- 172.21.15.84:0/1565769893 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73080b1e50 0x7f73080c25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:56.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.939+0000 7f730cd9b700 1 -- 172.21.15.84:0/1565769893 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f730815d9d0 msgr2=0x7f73080aeae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:56.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.939+0000 7f730cd9b700 1 --2- 172.21.15.84:0/1565769893 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f730815d9d0 0x7f73080aeae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:56.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.939+0000 7f730cd9b700 1 -- 172.21.15.84:0/1565769893 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72fc009550 con 0x7f730806c9f0 2023-07-14T11:16:56.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.939+0000 7f730cd9b700 1 --2- 172.21.15.84:0/1565769893 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f730806c9f0 0x7f73080c4d80 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f72fc014040 tx=0x7f72fc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:16:56.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.939+0000 7f73057fa700 1 -- 172.21.15.84:0/1565769893 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72fc0036a0 con 0x7f730806c9f0 2023-07-14T11:16:56.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.939+0000 7f73057fa700 1 -- 172.21.15.84:0/1565769893 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72fc01e070 con 0x7f730806c9f0 2023-07-14T11:16:56.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.939+0000 7f730efff700 1 -- 172.21.15.84:0/1565769893 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73080c3930 con 0x7f730806c9f0 2023-07-14T11:16:56.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.939+0000 7f73057fa700 1 -- 172.21.15.84:0/1565769893 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72fc003a60 con 0x7f730806c9f0 2023-07-14T11:16:56.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.940+0000 7f730efff700 1 -- 172.21.15.84:0/1565769893 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73080c52c0 con 0x7f730806c9f0 2023-07-14T11:16:56.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.941+0000 7f730efff700 1 -- 172.21.15.84:0/1565769893 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73080c54b0 con 0x7f730806c9f0 2023-07-14T11:16:56.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.941+0000 7f73057fa700 1 -- 172.21.15.84:0/1565769893 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 8) v1 ==== 89241+0+0 (secure 0 0 0) 0x7f72fc003bc0 con 0x7f730806c9f0 2023-07-14T11:16:56.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.942+0000 7f73057fa700 1 --2- 172.21.15.84:0/1565769893 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f72ec06af20 0x7f72ec06d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:56.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.943+0000 7f73057fa700 1 -- 172.21.15.84:0/1565769893 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f72fc020070 con 0x7f730806c9f0 2023-07-14T11:16:56.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.943+0000 7f7307fff700 1 --2- 172.21.15.84:0/1565769893 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f72ec06af20 0x7f72ec06d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:56.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.943+0000 7f7307fff700 1 --2- 172.21.15.84:0/1565769893 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f72ec06af20 0x7f72ec06d3d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f73080ca700 tx=0x7f72f4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:16:56.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.947+0000 7f73057fa700 1 -- 172.21.15.84:0/1565769893 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f72fc055c60 con 0x7f730806c9f0 2023-07-14T11:16:56.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:56.979+0000 7f73057fa700 1 -- 172.21.15.84:0/1565769893 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mgrmap(e 9) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f72fc056030 con 0x7f730806c9f0 2023-07-14T11:16:57.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.143+0000 7f730efff700 1 -- 172.21.15.84:0/1565769893 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f73080c3ca0 con 0x7f730806c9f0 2023-07-14T11:16:57.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.143+0000 7f73057fa700 1 -- 172.21.15.84:0/1565769893 <== mon.0 v2:172.21.15.84:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v52) v1 ==== 92+0+10 (secure 0 0 0) 0x7f72fc070210 con 0x7f730806c9f0 2023-07-14T11:16:57.146 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-07-14T11:16:57.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.146+0000 7f730efff700 1 -- 172.21.15.84:0/1565769893 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f72ec06af20 msgr2=0x7f72ec06d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:57.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.146+0000 7f730efff700 1 --2- 172.21.15.84:0/1565769893 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f72ec06af20 0x7f72ec06d3d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f73080ca700 tx=0x7f72f4008040 comp rx=0 tx=0).stop 2023-07-14T11:16:57.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.146+0000 7f730efff700 1 -- 172.21.15.84:0/1565769893 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f730806c9f0 msgr2=0x7f73080c4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:57.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.146+0000 7f730efff700 1 --2- 172.21.15.84:0/1565769893 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f730806c9f0 0x7f73080c4d80 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f72fc014040 tx=0x7f72fc004750 comp rx=0 tx=0).stop 2023-07-14T11:16:57.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.146+0000 7f730efff700 1 -- 172.21.15.84:0/1565769893 shutdown_connections 2023-07-14T11:16:57.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.146+0000 7f730efff700 1 --2- 172.21.15.84:0/1565769893 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f730815d9d0 0x7f73080aeae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:57.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.146+0000 7f730efff700 1 --2- 172.21.15.84:0/1565769893 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f730806c9f0 0x7f73080c4d80 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:57.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.146+0000 7f730efff700 1 --2- 172.21.15.84:0/1565769893 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f72ec06af20 0x7f72ec06d3d0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:57.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.146+0000 7f730efff700 1 --2- 172.21.15.84:0/1565769893 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73080b1e50 0x7f73080c25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:57.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.146+0000 7f730efff700 1 -- 172.21.15.84:0/1565769893 >> 172.21.15.84:0/1565769893 conn(0x7f73080b05d0 msgr2=0x7f73080cb800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:16:57.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.146+0000 7f730efff700 1 -- 172.21.15.84:0/1565769893 shutdown_connections 2023-07-14T11:16:57.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.146+0000 7f730efff700 1 -- 172.21.15.84:0/1565769893 wait complete. 2023-07-14T11:16:57.166 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T11:16:57.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.361+0000 7f35613ff700 1 Processor -- start 2023-07-14T11:16:57.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.361+0000 7f35613ff700 1 -- start start 2023-07-14T11:16:57.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.363+0000 7f35613ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f355c158bb0 0x7f355c0cd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:57.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.363+0000 7f35613ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f355c0ce150 0x7f355c06ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:57.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.363+0000 7f35613ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f355c0ce8c0 con 0x7f355c0cbe40 2023-07-14T11:16:57.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.363+0000 7f35613ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f355c06b5b0 con 0x7f355c0ce150 2023-07-14T11:16:57.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.363+0000 7f35613ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f355c071500 con 0x7f355c158bb0 2023-07-14T11:16:57.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.363+0000 7f355affd700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f355c158bb0 0x7f355c0cd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:57.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.363+0000 7f355b7fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f355c0ce150 0x7f355c06ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:57.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.364+0000 7f355affd700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f355c158bb0 0x7f355c0cd0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.84:50224/0 (socket says 172.21.15.84:50224) 2023-07-14T11:16:57.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.364+0000 7f3553fff700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f355c0cbe40 0x7f355c0cda40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.84:32992/0 (socket says 172.21.15.84:32992) 2023-07-14T11:16:57.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.364+0000 7f355affd700 1 -- 172.21.15.84:0/2264717819 learned_addr learned my addr 172.21.15.84:0/2264717819 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:16:57.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.364+0000 7f355affd700 1 -- 172.21.15.84:0/2264717819 >> v2:172.21.15.179:3300/0 conn(0x7f355c0ce150 msgr2=0x7f355c06ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:16:57.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.364+0000 7f355affd700 1 --2- 172.21.15.84:0/2264717819 >> v2:172.21.15.179:3300/0 conn(0x7f355c0ce150 0x7f355c06ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:57.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.364+0000 7f355affd700 1 -- 172.21.15.84:0/2264717819 >> v1:172.21.15.179:6789/0 conn(0x7f355c0cbe40 legacy=0x7f355c0cda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:57.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.364+0000 7f355a7fc700 1 -- 172.21.15.84:0/2264717819 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2960380350 0 0) 0x7f355c0ce8c0 con 0x7f355c0cbe40 2023-07-14T11:16:57.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.364+0000 7f355affd700 1 -- 172.21.15.84:0/2264717819 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f355c0cc2b0 con 0x7f355c158bb0 2023-07-14T11:16:57.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.364+0000 7f355b7fe700 1 --2- 172.21.15.84:0/2264717819 >> v2:172.21.15.179:3300/0 conn(0x7f355c0ce150 0x7f355c06ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:16:57.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.364+0000 7f355affd700 1 --2- 172.21.15.84:0/2264717819 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f355c158bb0 0x7f355c0cd0a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f354c0098f0 tx=0x7f354c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69a8fac0032d425 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:16:57.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.365+0000 7f355a7fc700 1 -- 172.21.15.84:0/2264717819 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354c011830 con 0x7f355c158bb0 2023-07-14T11:16:57.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.365+0000 7f355a7fc700 1 -- 172.21.15.84:0/2264717819 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f354c011990 con 0x7f355c158bb0 2023-07-14T11:16:57.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.365+0000 7f355a7fc700 1 -- 172.21.15.84:0/2264717819 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354c011d20 con 0x7f355c158bb0 2023-07-14T11:16:57.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.365+0000 7f35613ff700 1 -- 172.21.15.84:0/2264717819 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f355c158bb0 msgr2=0x7f355c0cd0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:57.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.365+0000 7f35613ff700 1 --2- 172.21.15.84:0/2264717819 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f355c158bb0 0x7f355c0cd0a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f354c0098f0 tx=0x7f354c009c00 comp rx=0 tx=0).stop 2023-07-14T11:16:57.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.365+0000 7f35613ff700 1 -- 172.21.15.84:0/2264717819 shutdown_connections 2023-07-14T11:16:57.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.365+0000 7f35613ff700 1 --2- 172.21.15.84:0/2264717819 >> v2:172.21.15.179:3300/0 conn(0x7f355c0ce150 0x7f355c06ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:57.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.365+0000 7f35613ff700 1 --2- 172.21.15.84:0/2264717819 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f355c158bb0 0x7f355c0cd0a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:57.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.365+0000 7f35613ff700 1 -- 172.21.15.84:0/2264717819 >> 172.21.15.84:0/2264717819 conn(0x7f355c0b05d0 msgr2=0x7f355c0b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:16:57.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.365+0000 7f35613ff700 1 -- 172.21.15.84:0/2264717819 shutdown_connections 2023-07-14T11:16:57.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.365+0000 7f35613ff700 1 -- 172.21.15.84:0/2264717819 wait complete. 2023-07-14T11:16:57.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.368+0000 7f35613ff700 1 Processor -- start 2023-07-14T11:16:57.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.368+0000 7f35613ff700 1 -- start start 2023-07-14T11:16:57.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.369+0000 7f35613ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f355c0cbe40 0x7f355c151e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:57.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.369+0000 7f35613ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f355c0ce150 0x7f355c0b18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:57.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.369+0000 7f35613ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f355c158bb0 0x7f355c159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:57.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.369+0000 7f35613ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f355c159100 con 0x7f355c0ce150 2023-07-14T11:16:57.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.369+0000 7f35613ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f355c1593e0 con 0x7f355c0cbe40 2023-07-14T11:16:57.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.369+0000 7f35613ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f355c1596c0 con 0x7f355c158bb0 2023-07-14T11:16:57.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.369+0000 7f3553fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f355c0ce150 0x7f355c0b18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:57.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.369+0000 7f3553fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f355c0ce150 0x7f355c0b18f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50546/0 (socket says 172.21.15.84:50546) 2023-07-14T11:16:57.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.369+0000 7f3553fff700 1 -- 172.21.15.84:0/2136036282 learned_addr learned my addr 172.21.15.84:0/2136036282 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:16:57.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.370+0000 7f355affd700 1 --2- 172.21.15.84:0/2136036282 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f355c0cbe40 0x7f355c151e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:57.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.370+0000 7f355b7fe700 1 --2- 172.21.15.84:0/2136036282 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f355c158bb0 0x7f355c159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:57.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.370+0000 7f3553fff700 1 -- 172.21.15.84:0/2136036282 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f355c158bb0 msgr2=0x7f355c159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:57.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.370+0000 7f3553fff700 1 --2- 172.21.15.84:0/2136036282 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f355c158bb0 0x7f355c159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:57.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.370+0000 7f3553fff700 1 -- 172.21.15.84:0/2136036282 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f355c0cbe40 msgr2=0x7f355c151e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:57.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.370+0000 7f3553fff700 1 --2- 172.21.15.84:0/2136036282 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f355c0cbe40 0x7f355c151e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:57.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.370+0000 7f3553fff700 1 -- 172.21.15.84:0/2136036282 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3554009a70 con 0x7f355c0ce150 2023-07-14T11:16:57.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.370+0000 7f355affd700 1 --2- 172.21.15.84:0/2136036282 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f355c0cbe40 0x7f355c151e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:16:57.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.370+0000 7f3553fff700 1 --2- 172.21.15.84:0/2136036282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f355c0ce150 0x7f355c0b18f0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f354400c540 tx=0x7f354400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:16:57.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.370+0000 7f35537fe700 1 -- 172.21.15.84:0/2136036282 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3544004c80 con 0x7f355c0ce150 2023-07-14T11:16:57.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.370+0000 7f35537fe700 1 -- 172.21.15.84:0/2136036282 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3544004de0 con 0x7f355c0ce150 2023-07-14T11:16:57.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.370+0000 7f35537fe700 1 -- 172.21.15.84:0/2136036282 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3544007310 con 0x7f355c0ce150 2023-07-14T11:16:57.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.370+0000 7f35613ff700 1 -- 172.21.15.84:0/2136036282 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f354c009550 con 0x7f355c0ce150 2023-07-14T11:16:57.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.371+0000 7f35613ff700 1 -- 172.21.15.84:0/2136036282 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f355c152bd0 con 0x7f355c0ce150 2023-07-14T11:16:57.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.372+0000 7f35613ff700 1 -- 172.21.15.84:0/2136036282 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f355c159be0 con 0x7f355c0ce150 2023-07-14T11:16:57.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.373+0000 7f35537fe700 1 -- 172.21.15.84:0/2136036282 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 9) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f3544007470 con 0x7f355c0ce150 2023-07-14T11:16:57.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.373+0000 7f35537fe700 1 --2- 172.21.15.84:0/2136036282 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f353c06ae90 0x7f353c06d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:57.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.374+0000 7f35537fe700 1 -- 172.21.15.84:0/2136036282 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f3544089410 con 0x7f355c0ce150 2023-07-14T11:16:57.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.374+0000 7f355affd700 1 --2- 172.21.15.84:0/2136036282 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f353c06ae90 0x7f353c06d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:57.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.374+0000 7f355affd700 1 --2- 172.21.15.84:0/2136036282 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f353c06ae90 0x7f353c06d340 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f354c014040 tx=0x7f354c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:16:57.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.378+0000 7f35537fe700 1 -- 172.21.15.84:0/2136036282 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f355c159be0 con 0x7f355c0ce150 2023-07-14T11:16:57.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.573+0000 7f35613ff700 1 -- 172.21.15.84:0/2136036282 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f355c159be0 con 0x7f355c0ce150 2023-07-14T11:16:57.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.574+0000 7f35537fe700 1 -- 172.21.15.84:0/2136036282 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v52) v1 ==== 104+0+11 (secure 0 0 0) 0x7f355c159be0 con 0x7f355c0ce150 2023-07-14T11:16:57.576 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-07-14T11:16:57.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.576+0000 7f35613ff700 1 -- 172.21.15.84:0/2136036282 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f353c06ae90 msgr2=0x7f353c06d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:57.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.576+0000 7f35613ff700 1 --2- 172.21.15.84:0/2136036282 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f353c06ae90 0x7f353c06d340 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f354c014040 tx=0x7f354c008030 comp rx=0 tx=0).stop 2023-07-14T11:16:57.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.576+0000 7f35613ff700 1 -- 172.21.15.84:0/2136036282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f355c0ce150 msgr2=0x7f355c0b18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:57.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.576+0000 7f35613ff700 1 --2- 172.21.15.84:0/2136036282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f355c0ce150 0x7f355c0b18f0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f354400c540 tx=0x7f354400c850 comp rx=0 tx=0).stop 2023-07-14T11:16:57.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.576+0000 7f35613ff700 1 -- 172.21.15.84:0/2136036282 shutdown_connections 2023-07-14T11:16:57.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.576+0000 7f35613ff700 1 --2- 172.21.15.84:0/2136036282 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f353c06ae90 0x7f353c06d340 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:57.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.576+0000 7f35613ff700 1 --2- 172.21.15.84:0/2136036282 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f355c158bb0 0x7f355c159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:57.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.576+0000 7f35613ff700 1 --2- 172.21.15.84:0/2136036282 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f355c0cbe40 0x7f355c151e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:57.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.576+0000 7f35613ff700 1 --2- 172.21.15.84:0/2136036282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f355c0ce150 0x7f355c0b18f0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:57.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.576+0000 7f35613ff700 1 -- 172.21.15.84:0/2136036282 >> 172.21.15.84:0/2136036282 conn(0x7f355c0b05d0 msgr2=0x7f355c0b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:16:57.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.576+0000 7f35613ff700 1 -- 172.21.15.84:0/2136036282 shutdown_connections 2023-07-14T11:16:57.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.576+0000 7f35613ff700 1 -- 172.21.15.84:0/2136036282 wait complete. 2023-07-14T11:16:57.596 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T11:16:57.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.793+0000 7f90415ff700 1 Processor -- start 2023-07-14T11:16:57.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.793+0000 7f90415ff700 1 -- start start 2023-07-14T11:16:57.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.795+0000 7f90415ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f903c0b12f0 0x7f903c0ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:57.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.795+0000 7f90415ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f903c15ce70 con 0x7f903c0adea0 2023-07-14T11:16:57.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.795+0000 7f90415ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f903c15d0c0 con 0x7f903c0c92d0 2023-07-14T11:16:57.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.795+0000 7f90415ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f903c15da60 con 0x7f903c0b12f0 2023-07-14T11:16:57.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.795+0000 7f903b7fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f903c0adea0 0x7f903c0cc690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:33800/0 (socket says 172.21.15.84:33800) 2023-07-14T11:16:57.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.795+0000 7f903b7fe700 1 -- 172.21.15.84:0/1450961787 learned_addr learned my addr 172.21.15.84:0/1450961787 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:16:57.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.795+0000 7f9033fff700 1 --2- 172.21.15.84:0/1450961787 >> v2:172.21.15.179:3300/0 conn(0x7f903c0b12f0 0x7f903c0ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:57.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.795+0000 7f903a7fc700 1 -- 172.21.15.84:0/1450961787 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4084446244 0 0) 0x7f903c15ce70 con 0x7f903c0adea0 2023-07-14T11:16:57.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.795+0000 7f903a7fc700 1 -- 172.21.15.84:0/1450961787 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90280035b0 con 0x7f903c0adea0 2023-07-14T11:16:57.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.796+0000 7f903a7fc700 1 -- 172.21.15.84:0/1450961787 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1693187849 0 0) 0x7f903c15d0c0 con 0x7f903c0c92d0 2023-07-14T11:16:57.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.796+0000 7f903a7fc700 1 -- 172.21.15.84:0/1450961787 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f903c15ce70 con 0x7f903c0c92d0 2023-07-14T11:16:57.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.796+0000 7f9033fff700 1 -- 172.21.15.84:0/1450961787 >> v1:172.21.15.179:6789/0 conn(0x7f903c0c92d0 legacy=0x7f903c0c96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:57.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.796+0000 7f9033fff700 1 -- 172.21.15.84:0/1450961787 >> v1:172.21.15.84:6789/0 conn(0x7f903c0adea0 legacy=0x7f903c0cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:57.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.796+0000 7f9033fff700 1 -- 172.21.15.84:0/1450961787 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f903c15d3a0 con 0x7f903c0b12f0 2023-07-14T11:16:57.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.796+0000 7f9033fff700 1 --2- 172.21.15.84:0/1450961787 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f903c0b12f0 0x7f903c0ad8f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f9024009840 tx=0x7f9024009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15ca78d0e85a376b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:16:57.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.796+0000 7f903a7fc700 1 -- 172.21.15.84:0/1450961787 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9024011830 con 0x7f903c0b12f0 2023-07-14T11:16:57.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.796+0000 7f903a7fc700 1 -- 172.21.15.84:0/1450961787 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9024011990 con 0x7f903c0b12f0 2023-07-14T11:16:57.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.796+0000 7f903a7fc700 1 -- 172.21.15.84:0/1450961787 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9024011d20 con 0x7f903c0b12f0 2023-07-14T11:16:57.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.797+0000 7f90415ff700 1 -- 172.21.15.84:0/1450961787 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f903c0b12f0 msgr2=0x7f903c0ad8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:57.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.797+0000 7f90415ff700 1 --2- 172.21.15.84:0/1450961787 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f903c0b12f0 0x7f903c0ad8f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f9024009840 tx=0x7f9024009b50 comp rx=0 tx=0).stop 2023-07-14T11:16:57.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.797+0000 7f90415ff700 1 -- 172.21.15.84:0/1450961787 shutdown_connections 2023-07-14T11:16:57.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.797+0000 7f90415ff700 1 --2- 172.21.15.84:0/1450961787 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f903c0b12f0 0x7f903c0ad8f0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:57.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.797+0000 7f90415ff700 1 -- 172.21.15.84:0/1450961787 >> 172.21.15.84:0/1450961787 conn(0x7f903c0b05d0 msgr2=0x7f903c0b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:16:57.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.797+0000 7f90415ff700 1 -- 172.21.15.84:0/1450961787 shutdown_connections 2023-07-14T11:16:57.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.797+0000 7f90415ff700 1 -- 172.21.15.84:0/1450961787 wait complete. 2023-07-14T11:16:57.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.799+0000 7f90415ff700 1 Processor -- start 2023-07-14T11:16:57.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.799+0000 7f90415ff700 1 -- start start 2023-07-14T11:16:57.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.800+0000 7f90415ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f903c0adea0 0x7f903c0c8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:57.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.800+0000 7f90415ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f903c0b12f0 0x7f903c13de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:57.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.800+0000 7f90415ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f903c0c92d0 0x7f903c152fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:57.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.800+0000 7f90415ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f903c0b3a30 con 0x7f903c0adea0 2023-07-14T11:16:57.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.800+0000 7f90415ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f903c0b3140 con 0x7f903c0c92d0 2023-07-14T11:16:57.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.800+0000 7f90415ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f903c153cc0 con 0x7f903c0b12f0 2023-07-14T11:16:57.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.800+0000 7f903affd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f903c0adea0 0x7f903c0c8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:57.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.800+0000 7f903affd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f903c0adea0 0x7f903c0c8300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50550/0 (socket says 172.21.15.84:50550) 2023-07-14T11:16:57.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.800+0000 7f903affd700 1 -- 172.21.15.84:0/3776067124 learned_addr learned my addr 172.21.15.84:0/3776067124 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:16:57.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.800+0000 7f903b7fe700 1 --2- 172.21.15.84:0/3776067124 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f903c0c92d0 0x7f903c152fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:57.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.800+0000 7f9033fff700 1 --2- 172.21.15.84:0/3776067124 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f903c0b12f0 0x7f903c13de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:57.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.800+0000 7f903affd700 1 -- 172.21.15.84:0/3776067124 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f903c0b12f0 msgr2=0x7f903c13de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:57.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.800+0000 7f903affd700 1 --2- 172.21.15.84:0/3776067124 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f903c0b12f0 0x7f903c13de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:57.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.800+0000 7f903affd700 1 -- 172.21.15.84:0/3776067124 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f903c0c92d0 msgr2=0x7f903c152fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:57.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.800+0000 7f903affd700 1 --2- 172.21.15.84:0/3776067124 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f903c0c92d0 0x7f903c152fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:57.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.800+0000 7f903affd700 1 -- 172.21.15.84:0/3776067124 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90240094a0 con 0x7f903c0adea0 2023-07-14T11:16:57.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.801+0000 7f903affd700 1 --2- 172.21.15.84:0/3776067124 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f903c0adea0 0x7f903c0c8300 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f902c00c520 tx=0x7f902c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:16:57.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.801+0000 7f90337fe700 1 -- 172.21.15.84:0/3776067124 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f902c0052d0 con 0x7f903c0adea0 2023-07-14T11:16:57.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.801+0000 7f90337fe700 1 -- 172.21.15.84:0/3776067124 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f902c005430 con 0x7f903c0adea0 2023-07-14T11:16:57.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.801+0000 7f90415ff700 1 -- 172.21.15.84:0/3776067124 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f903c0b1c30 con 0x7f903c0adea0 2023-07-14T11:16:57.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.801+0000 7f90337fe700 1 -- 172.21.15.84:0/3776067124 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f902c0038c0 con 0x7f903c0adea0 2023-07-14T11:16:57.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.801+0000 7f90415ff700 1 -- 172.21.15.84:0/3776067124 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f903c0b3370 con 0x7f903c0adea0 2023-07-14T11:16:57.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.802+0000 7f90415ff700 1 -- 172.21.15.84:0/3776067124 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f903c0b3b70 con 0x7f903c0adea0 2023-07-14T11:16:57.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.803+0000 7f90337fe700 1 -- 172.21.15.84:0/3776067124 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 9) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f902c003a20 con 0x7f903c0adea0 2023-07-14T11:16:57.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.804+0000 7f90337fe700 1 --2- 172.21.15.84:0/3776067124 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f901c06ae90 0x7f901c06d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:57.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.804+0000 7f90337fe700 1 -- 172.21.15.84:0/3776067124 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f902c088d60 con 0x7f903c0adea0 2023-07-14T11:16:57.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.804+0000 7f9033fff700 1 --2- 172.21.15.84:0/3776067124 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f901c06ae90 0x7f901c06d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:57.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.805+0000 7f9033fff700 1 --2- 172.21.15.84:0/3776067124 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f901c06ae90 0x7f901c06d340 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f9024009fd0 tx=0x7f902401c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:16:57.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:57.808+0000 7f90337fe700 1 -- 172.21.15.84:0/3776067124 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f903c0b3b70 con 0x7f903c0adea0 2023-07-14T11:16:58.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.003+0000 7f90415ff700 1 -- 172.21.15.84:0/3776067124 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f903c074350 con 0x7f903c0adea0 2023-07-14T11:16:58.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.004+0000 7f90337fe700 1 -- 172.21.15.84:0/3776067124 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v52) v1 ==== 100+0+11 (secure 0 0 0) 0x7f902c017020 con 0x7f903c0adea0 2023-07-14T11:16:58.006 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-07-14T11:16:58.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.006+0000 7f90415ff700 1 -- 172.21.15.84:0/3776067124 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f901c06ae90 msgr2=0x7f901c06d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:58.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.006+0000 7f90415ff700 1 --2- 172.21.15.84:0/3776067124 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f901c06ae90 0x7f901c06d340 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f9024009fd0 tx=0x7f902401c040 comp rx=0 tx=0).stop 2023-07-14T11:16:58.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.006+0000 7f90415ff700 1 -- 172.21.15.84:0/3776067124 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f903c0adea0 msgr2=0x7f903c0c8300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:58.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.006+0000 7f90415ff700 1 --2- 172.21.15.84:0/3776067124 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f903c0adea0 0x7f903c0c8300 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f902c00c520 tx=0x7f902c00c8e0 comp rx=0 tx=0).stop 2023-07-14T11:16:58.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.006+0000 7f90415ff700 1 -- 172.21.15.84:0/3776067124 shutdown_connections 2023-07-14T11:16:58.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.006+0000 7f90415ff700 1 --2- 172.21.15.84:0/3776067124 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f903c0c92d0 0x7f903c152fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:58.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.006+0000 7f90415ff700 1 --2- 172.21.15.84:0/3776067124 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f903c0adea0 0x7f903c0c8300 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:58.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.006+0000 7f90415ff700 1 --2- 172.21.15.84:0/3776067124 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f901c06ae90 0x7f901c06d340 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:58.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.006+0000 7f90415ff700 1 --2- 172.21.15.84:0/3776067124 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f903c0b12f0 0x7f903c13de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:58.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.006+0000 7f90415ff700 1 -- 172.21.15.84:0/3776067124 >> 172.21.15.84:0/3776067124 conn(0x7f903c0b05d0 msgr2=0x7f903c0cc830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:16:58.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.006+0000 7f90415ff700 1 -- 172.21.15.84:0/3776067124 shutdown_connections 2023-07-14T11:16:58.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.006+0000 7f90415ff700 1 -- 172.21.15.84:0/3776067124 wait complete. 2023-07-14T11:16:58.026 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T11:16:58.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.219+0000 7fae3c3ff700 1 Processor -- start 2023-07-14T11:16:58.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.220+0000 7fae3c3ff700 1 -- start start 2023-07-14T11:16:58.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.221+0000 7fae3c3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae34160030 0x7fae3406c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:58.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.221+0000 7fae3c3ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fae340d1160 0x7fae340b0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:58.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.221+0000 7fae3c3ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae340d2cc0 con 0x7fae340b5cd0 2023-07-14T11:16:58.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.221+0000 7fae3c3ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae340afbb0 con 0x7fae340d1160 2023-07-14T11:16:58.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.221+0000 7fae3c3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae340afe90 con 0x7fae34160030 2023-07-14T11:16:58.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.221+0000 7fae3999a700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fae340b5cd0 0x7fae340d0a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:33812/0 (socket says 172.21.15.84:33812) 2023-07-14T11:16:58.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.221+0000 7fae3999a700 1 -- 172.21.15.84:0/2307173171 learned_addr learned my addr 172.21.15.84:0/2307173171 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:16:58.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.221+0000 7fae3a99c700 1 --2- 172.21.15.84:0/2307173171 >> v2:172.21.15.179:3300/0 conn(0x7fae340d1160 0x7fae340b0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:58.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.221+0000 7fae3a19b700 1 --2- 172.21.15.84:0/2307173171 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae34160030 0x7fae3406c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:58.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.221+0000 7fae39199700 1 -- 172.21.15.84:0/2307173171 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2434398184 0 0) 0x7fae340d2cc0 con 0x7fae340b5cd0 2023-07-14T11:16:58.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.222+0000 7fae39199700 1 -- 172.21.15.84:0/2307173171 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae200035b0 con 0x7fae340b5cd0 2023-07-14T11:16:58.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.222+0000 7fae3a99c700 1 -- 172.21.15.84:0/2307173171 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae34160030 msgr2=0x7fae3406c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:16:58.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.222+0000 7fae3a99c700 1 --2- 172.21.15.84:0/2307173171 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae34160030 0x7fae3406c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:58.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.222+0000 7fae3a99c700 1 -- 172.21.15.84:0/2307173171 >> v1:172.21.15.84:6789/0 conn(0x7fae340b5cd0 legacy=0x7fae340d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:58.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.222+0000 7fae3a99c700 1 -- 172.21.15.84:0/2307173171 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae340b0170 con 0x7fae340d1160 2023-07-14T11:16:58.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.222+0000 7fae3a99c700 1 --2- 172.21.15.84:0/2307173171 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae340d1160 0x7fae340b0c50 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fae2c009d90 tx=0x7fae2c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a260a863e61e4b02 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:16:58.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.222+0000 7fae39199700 1 -- 172.21.15.84:0/2307173171 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2c00e070 con 0x7fae340d1160 2023-07-14T11:16:58.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.222+0000 7fae39199700 1 -- 172.21.15.84:0/2307173171 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae2c00bb20 con 0x7fae340d1160 2023-07-14T11:16:58.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.222+0000 7fae39199700 1 -- 172.21.15.84:0/2307173171 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2c012430 con 0x7fae340d1160 2023-07-14T11:16:58.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.223+0000 7fae3c3ff700 1 -- 172.21.15.84:0/2307173171 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae340d1160 msgr2=0x7fae340b0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:58.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.223+0000 7fae3c3ff700 1 --2- 172.21.15.84:0/2307173171 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae340d1160 0x7fae340b0c50 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fae2c009d90 tx=0x7fae2c00b330 comp rx=0 tx=0).stop 2023-07-14T11:16:58.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.223+0000 7fae3c3ff700 1 -- 172.21.15.84:0/2307173171 shutdown_connections 2023-07-14T11:16:58.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.223+0000 7fae3c3ff700 1 --2- 172.21.15.84:0/2307173171 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae340d1160 0x7fae340b0c50 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:58.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.223+0000 7fae3c3ff700 1 --2- 172.21.15.84:0/2307173171 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae34160030 0x7fae3406c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:58.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.223+0000 7fae3c3ff700 1 -- 172.21.15.84:0/2307173171 >> 172.21.15.84:0/2307173171 conn(0x7fae3409c190 msgr2=0x7fae340d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:16:58.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.223+0000 7fae3c3ff700 1 -- 172.21.15.84:0/2307173171 shutdown_connections 2023-07-14T11:16:58.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.223+0000 7fae3c3ff700 1 -- 172.21.15.84:0/2307173171 wait complete. 2023-07-14T11:16:58.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.225+0000 7fae3c3ff700 1 Processor -- start 2023-07-14T11:16:58.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.225+0000 7fae3c3ff700 1 -- start start 2023-07-14T11:16:58.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.226+0000 7fae3c3ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae340b5cd0 0x7fae341f4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:58.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.226+0000 7fae3c3ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae340d1160 0x7fae340c8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:58.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.226+0000 7fae3c3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae34160030 0x7fae3414ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:58.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.226+0000 7fae3c3ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae3414cf20 con 0x7fae340b5cd0 2023-07-14T11:16:58.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.226+0000 7fae3c3ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae340c8d40 con 0x7fae340d1160 2023-07-14T11:16:58.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.226+0000 7fae3c3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae340c9020 con 0x7fae34160030 2023-07-14T11:16:58.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.226+0000 7fae3a19b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae340b5cd0 0x7fae341f4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:58.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.226+0000 7fae3a19b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae340b5cd0 0x7fae341f4da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50562/0 (socket says 172.21.15.84:50562) 2023-07-14T11:16:58.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.226+0000 7fae3a19b700 1 -- 172.21.15.84:0/3473211449 learned_addr learned my addr 172.21.15.84:0/3473211449 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:16:58.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.226+0000 7fae3a19b700 1 -- 172.21.15.84:0/3473211449 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae34160030 msgr2=0x7fae3414ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:58.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.226+0000 7fae3a19b700 1 --2- 172.21.15.84:0/3473211449 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae34160030 0x7fae3414ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:58.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.226+0000 7fae3a19b700 1 -- 172.21.15.84:0/3473211449 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae340d1160 msgr2=0x7fae340c8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:58.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.226+0000 7fae3a19b700 1 --2- 172.21.15.84:0/3473211449 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae340d1160 0x7fae340c8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:58.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.226+0000 7fae3a19b700 1 -- 172.21.15.84:0/3473211449 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae2c009a70 con 0x7fae340b5cd0 2023-07-14T11:16:58.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.227+0000 7fae3a19b700 1 --2- 172.21.15.84:0/3473211449 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae340b5cd0 0x7fae341f4da0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fae3000e870 tx=0x7fae3000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:16:58.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.227+0000 7fae2affd700 1 -- 172.21.15.84:0/3473211449 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae30009590 con 0x7fae340b5cd0 2023-07-14T11:16:58.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.227+0000 7fae2affd700 1 -- 172.21.15.84:0/3473211449 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae3000ee70 con 0x7fae340b5cd0 2023-07-14T11:16:58.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.227+0000 7fae2affd700 1 -- 172.21.15.84:0/3473211449 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae3000ca50 con 0x7fae340b5cd0 2023-07-14T11:16:58.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.227+0000 7fae3c3ff700 1 -- 172.21.15.84:0/3473211449 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae340c9300 con 0x7fae340b5cd0 2023-07-14T11:16:58.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.227+0000 7fae3c3ff700 1 -- 172.21.15.84:0/3473211449 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae3414fcc0 con 0x7fae340b5cd0 2023-07-14T11:16:58.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.228+0000 7fae3c3ff700 1 -- 172.21.15.84:0/3473211449 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae3414d420 con 0x7fae340b5cd0 2023-07-14T11:16:58.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.229+0000 7fae2affd700 1 -- 172.21.15.84:0/3473211449 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 9) v1 ==== 89190+0+0 (secure 0 0 0) 0x7fae3000cbb0 con 0x7fae340b5cd0 2023-07-14T11:16:58.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.230+0000 7fae2affd700 1 --2- 172.21.15.84:0/3473211449 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fae1806ae90 0x7fae1806d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:58.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.230+0000 7fae2affd700 1 -- 172.21.15.84:0/3473211449 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fae30089850 con 0x7fae340b5cd0 2023-07-14T11:16:58.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.230+0000 7fae3999a700 1 --2- 172.21.15.84:0/3473211449 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fae1806ae90 0x7fae1806d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:58.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.230+0000 7fae3999a700 1 --2- 172.21.15.84:0/3473211449 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fae1806ae90 0x7fae1806d340 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fae340c9800 tx=0x7fae240079c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:16:58.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.234+0000 7fae2affd700 1 -- 172.21.15.84:0/3473211449 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fae3414d420 con 0x7fae340b5cd0 2023-07-14T11:16:58.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.470+0000 7fae3c3ff700 1 -- 172.21.15.84:0/3473211449 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fae3414d420 con 0x7fae340b5cd0 2023-07-14T11:16:58.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.471+0000 7fae2affd700 1 -- 172.21.15.84:0/3473211449 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+4712 (secure 0 0 0) 0x7fae3414d420 con 0x7fae340b5cd0 2023-07-14T11:16:58.473 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:16:58.474 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5030,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3551222138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3551222138},{"type":"v1","addr":"172.21.15.179:6834","nonce":3551222138}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5036,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/1316665435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1316665435},{"type":"v1","addr":"172.21.15.84:6836","nonce":1316665435}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5416,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/611235750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":611235750},{"type":"v1","addr":"172.21.15.179:6835","nonce":611235750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T11:15:10.408480+0000","modified":"2023-07-14T11:15:13.936541+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5625},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5625":{"gid":5625,"name":"c","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/2672133286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":2672133286},{"type":"v1","addr":"172.21.15.84:6837","nonce":2672133286}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-14T11:16:58.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.473+0000 7fae3c3ff700 1 -- 172.21.15.84:0/3473211449 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fae1806ae90 msgr2=0x7fae1806d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:58.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.473+0000 7fae3c3ff700 1 --2- 172.21.15.84:0/3473211449 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fae1806ae90 0x7fae1806d340 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fae340c9800 tx=0x7fae240079c0 comp rx=0 tx=0).stop 2023-07-14T11:16:58.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.473+0000 7fae3c3ff700 1 -- 172.21.15.84:0/3473211449 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae340b5cd0 msgr2=0x7fae341f4da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:58.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.473+0000 7fae3c3ff700 1 --2- 172.21.15.84:0/3473211449 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae340b5cd0 0x7fae341f4da0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fae3000e870 tx=0x7fae3000ec30 comp rx=0 tx=0).stop 2023-07-14T11:16:58.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.473+0000 7fae3c3ff700 1 -- 172.21.15.84:0/3473211449 shutdown_connections 2023-07-14T11:16:58.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.473+0000 7fae3c3ff700 1 --2- 172.21.15.84:0/3473211449 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fae1806ae90 0x7fae1806d340 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:58.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.473+0000 7fae3c3ff700 1 --2- 172.21.15.84:0/3473211449 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae34160030 0x7fae3414ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:58.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.474+0000 7fae3c3ff700 1 --2- 172.21.15.84:0/3473211449 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae340b5cd0 0x7fae341f4da0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:58.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.474+0000 7fae3c3ff700 1 --2- 172.21.15.84:0/3473211449 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae340d1160 0x7fae340c8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:58.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.474+0000 7fae3c3ff700 1 -- 172.21.15.84:0/3473211449 >> 172.21.15.84:0/3473211449 conn(0x7fae3409c190 msgr2=0x7fae3415f420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:16:58.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.474+0000 7fae3c3ff700 1 -- 172.21.15.84:0/3473211449 shutdown_connections 2023-07-14T11:16:58.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.474+0000 7fae3c3ff700 1 -- 172.21.15.84:0/3473211449 wait complete. 2023-07-14T11:16:58.478 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 28 2023-07-14T11:16:58.493 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:16:58.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.686+0000 7f7bcabff700 1 Processor -- start 2023-07-14T11:16:58.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.686+0000 7f7bcabff700 1 -- start start 2023-07-14T11:16:58.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.687+0000 7f7bcabff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7bc40d1220 0x7f7bc40b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:58.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.687+0000 7f7bcabff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bc40d2ce0 con 0x7f7bc40b1e00 2023-07-14T11:16:58.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.687+0000 7f7bcabff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bc40b3350 con 0x7f7bc415c950 2023-07-14T11:16:58.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.687+0000 7f7bcabff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bc40b3630 con 0x7f7bc40d1220 2023-07-14T11:16:58.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.688+0000 7f7bc919c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f7bc40b1e00 0x7f7bc40afac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:33828/0 (socket says 172.21.15.84:33828) 2023-07-14T11:16:58.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.688+0000 7f7bc919c700 1 -- 172.21.15.84:0/1492402019 learned_addr learned my addr 172.21.15.84:0/1492402019 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:16:58.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.688+0000 7f7bc3fff700 1 --2- 172.21.15.84:0/1492402019 >> v2:172.21.15.179:3300/0 conn(0x7f7bc40d1220 0x7f7bc40b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:58.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.688+0000 7f7bc37fe700 1 -- 172.21.15.84:0/1492402019 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1585972083 0 0) 0x7f7bc40d2ce0 con 0x7f7bc40b1e00 2023-07-14T11:16:58.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.688+0000 7f7bc37fe700 1 -- 172.21.15.84:0/1492402019 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bb40035b0 con 0x7f7bc40b1e00 2023-07-14T11:16:58.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.688+0000 7f7bc37fe700 1 -- 172.21.15.84:0/1492402019 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1848265685 0 0) 0x7f7bc40b3350 con 0x7f7bc415c950 2023-07-14T11:16:58.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.688+0000 7f7bc37fe700 1 -- 172.21.15.84:0/1492402019 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bc40d2ce0 con 0x7f7bc415c950 2023-07-14T11:16:58.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.688+0000 7f7bc3fff700 1 -- 172.21.15.84:0/1492402019 >> v1:172.21.15.179:6789/0 conn(0x7f7bc415c950 legacy=0x7f7bc40d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:58.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.688+0000 7f7bc3fff700 1 -- 172.21.15.84:0/1492402019 >> v1:172.21.15.84:6789/0 conn(0x7f7bc40b1e00 legacy=0x7f7bc40afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:58.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.688+0000 7f7bc3fff700 1 -- 172.21.15.84:0/1492402019 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc40b3910 con 0x7f7bc40d1220 2023-07-14T11:16:58.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.689+0000 7f7bc3fff700 1 --2- 172.21.15.84:0/1492402019 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7bc40d1220 0x7f7bc40b43f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7bb0009840 tx=0x7f7bb0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=62eab372b1aeae4 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:16:58.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.689+0000 7f7bc37fe700 1 -- 172.21.15.84:0/1492402019 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb0011830 con 0x7f7bc40d1220 2023-07-14T11:16:58.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.689+0000 7f7bc37fe700 1 -- 172.21.15.84:0/1492402019 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bb0011990 con 0x7f7bc40d1220 2023-07-14T11:16:58.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.689+0000 7f7bc37fe700 1 -- 172.21.15.84:0/1492402019 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb0011d20 con 0x7f7bc40d1220 2023-07-14T11:16:58.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.689+0000 7f7bcabff700 1 -- 172.21.15.84:0/1492402019 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7bc40d1220 msgr2=0x7f7bc40b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:58.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.689+0000 7f7bcabff700 1 --2- 172.21.15.84:0/1492402019 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7bc40d1220 0x7f7bc40b43f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7bb0009840 tx=0x7f7bb0009b50 comp rx=0 tx=0).stop 2023-07-14T11:16:58.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.690+0000 7f7bcabff700 1 -- 172.21.15.84:0/1492402019 shutdown_connections 2023-07-14T11:16:58.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.690+0000 7f7bcabff700 1 --2- 172.21.15.84:0/1492402019 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7bc40d1220 0x7f7bc40b43f0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:58.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.690+0000 7f7bcabff700 1 -- 172.21.15.84:0/1492402019 >> 172.21.15.84:0/1492402019 conn(0x7f7bc409c1d0 msgr2=0x7f7bc40d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:16:58.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.690+0000 7f7bcabff700 1 -- 172.21.15.84:0/1492402019 shutdown_connections 2023-07-14T11:16:58.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.690+0000 7f7bcabff700 1 -- 172.21.15.84:0/1492402019 wait complete. 2023-07-14T11:16:58.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.691+0000 7f7bcabff700 1 Processor -- start 2023-07-14T11:16:58.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.691+0000 7f7bcabff700 1 -- start start 2023-07-14T11:16:58.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.692+0000 7f7bcabff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7bc40b1e00 0x7f7bc40cb060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:58.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.692+0000 7f7bcabff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7bc40d1220 0x7f7bc40cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:58.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.692+0000 7f7bcabff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7bc415c950 0x7f7bc40cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:58.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.692+0000 7f7bcabff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc40cc020 con 0x7f7bc40d1220 2023-07-14T11:16:58.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.692+0000 7f7bcabff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc40ce000 con 0x7f7bc40b1e00 2023-07-14T11:16:58.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.692+0000 7f7bcabff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc41579f0 con 0x7f7bc415c950 2023-07-14T11:16:58.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.693+0000 7f7bc3fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7bc40d1220 0x7f7bc40cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:58.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.693+0000 7f7bc3fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7bc40d1220 0x7f7bc40cb5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50578/0 (socket says 172.21.15.84:50578) 2023-07-14T11:16:58.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.693+0000 7f7bc3fff700 1 -- 172.21.15.84:0/2312696591 learned_addr learned my addr 172.21.15.84:0/2312696591 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:16:58.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.693+0000 7f7bc919c700 1 --2- 172.21.15.84:0/2312696591 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7bc415c950 0x7f7bc40cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:58.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.693+0000 7f7bc899b700 1 --2- 172.21.15.84:0/2312696591 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7bc40b1e00 0x7f7bc40cb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:58.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.693+0000 7f7bc3fff700 1 -- 172.21.15.84:0/2312696591 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7bc415c950 msgr2=0x7f7bc40cbae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:58.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.693+0000 7f7bc3fff700 1 --2- 172.21.15.84:0/2312696591 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7bc415c950 0x7f7bc40cbae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:58.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.693+0000 7f7bc3fff700 1 -- 172.21.15.84:0/2312696591 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7bc40b1e00 msgr2=0x7f7bc40cb060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:58.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.693+0000 7f7bc3fff700 1 --2- 172.21.15.84:0/2312696591 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7bc40b1e00 0x7f7bc40cb060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:58.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.693+0000 7f7bc3fff700 1 -- 172.21.15.84:0/2312696591 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb00094a0 con 0x7f7bc40d1220 2023-07-14T11:16:58.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.693+0000 7f7bc919c700 1 --2- 172.21.15.84:0/2312696591 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7bc415c950 0x7f7bc40cbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:16:58.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.693+0000 7f7bc3fff700 1 --2- 172.21.15.84:0/2312696591 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7bc40d1220 0x7f7bc40cb5a0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f7bb0009b90 tx=0x7f7bb0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:16:58.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.694+0000 7f7bc17fa700 1 -- 172.21.15.84:0/2312696591 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb001a860 con 0x7f7bc40d1220 2023-07-14T11:16:58.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.694+0000 7f7bcabff700 1 -- 172.21.15.84:0/2312696591 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bc40cc210 con 0x7f7bc40d1220 2023-07-14T11:16:58.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.694+0000 7f7bc17fa700 1 -- 172.21.15.84:0/2312696591 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bb001a9c0 con 0x7f7bc40d1220 2023-07-14T11:16:58.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.694+0000 7f7bc17fa700 1 -- 172.21.15.84:0/2312696591 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb001ad30 con 0x7f7bc40d1220 2023-07-14T11:16:58.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.694+0000 7f7bcabff700 1 -- 172.21.15.84:0/2312696591 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bc40cc7d0 con 0x7f7bc40d1220 2023-07-14T11:16:58.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.695+0000 7f7bcabff700 1 -- 172.21.15.84:0/2312696591 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bc40cc9c0 con 0x7f7bc40d1220 2023-07-14T11:16:58.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.696+0000 7f7bc17fa700 1 -- 172.21.15.84:0/2312696591 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 9) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f7bb0022070 con 0x7f7bc40d1220 2023-07-14T11:16:58.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.697+0000 7f7bc17fa700 1 --2- 172.21.15.84:0/2312696591 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f7ba806ae90 0x7f7ba806d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:58.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.697+0000 7f7bc17fa700 1 -- 172.21.15.84:0/2312696591 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f7bb008a920 con 0x7f7bc40d1220 2023-07-14T11:16:58.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.697+0000 7f7bc899b700 1 --2- 172.21.15.84:0/2312696591 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f7ba806ae90 0x7f7ba806d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:58.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.697+0000 7f7bc899b700 1 --2- 172.21.15.84:0/2312696591 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f7ba806ae90 0x7f7ba806d340 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f7bb8001230 tx=0x7f7bb8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:16:58.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.700+0000 7f7bc17fa700 1 -- 172.21.15.84:0/2312696591 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7bb00557a0 con 0x7f7bc40d1220 2023-07-14T11:16:58.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.895+0000 7f7bcabff700 1 -- 172.21.15.84:0/2312696591 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7bc40d35c0 con 0x7f7bc40d1220 2023-07-14T11:16:58.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.896+0000 7f7bc17fa700 1 -- 172.21.15.84:0/2312696591 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+18422 (secure 0 0 0) 0x7f7bb0029090 con 0x7f7bc40d1220 2023-07-14T11:16:58.899 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:16:58.899 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":52,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:15:57.830481+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-07-14T11:15:08.611029+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-07-14T11:15:09.373415+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.c","mappings":[{"from":0,"to":6}]},{"pgid":"8.28","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:16:58.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.899+0000 7f7bcabff700 1 -- 172.21.15.84:0/2312696591 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f7ba806ae90 msgr2=0x7f7ba806d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:58.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.899+0000 7f7bcabff700 1 --2- 172.21.15.84:0/2312696591 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f7ba806ae90 0x7f7ba806d340 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f7bb8001230 tx=0x7f7bb8009040 comp rx=0 tx=0).stop 2023-07-14T11:16:58.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.899+0000 7f7bcabff700 1 -- 172.21.15.84:0/2312696591 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7bc40d1220 msgr2=0x7f7bc40cb5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:58.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.899+0000 7f7bcabff700 1 --2- 172.21.15.84:0/2312696591 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7bc40d1220 0x7f7bc40cb5a0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f7bb0009b90 tx=0x7f7bb0004750 comp rx=0 tx=0).stop 2023-07-14T11:16:58.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.899+0000 7f7bcabff700 1 -- 172.21.15.84:0/2312696591 shutdown_connections 2023-07-14T11:16:58.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.899+0000 7f7bcabff700 1 --2- 172.21.15.84:0/2312696591 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f7ba806ae90 0x7f7ba806d340 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:58.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.899+0000 7f7bcabff700 1 --2- 172.21.15.84:0/2312696591 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7bc415c950 0x7f7bc40cbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:58.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.899+0000 7f7bcabff700 1 --2- 172.21.15.84:0/2312696591 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7bc40b1e00 0x7f7bc40cb060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:58.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.899+0000 7f7bcabff700 1 --2- 172.21.15.84:0/2312696591 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7bc40d1220 0x7f7bc40cb5a0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:58.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.899+0000 7f7bcabff700 1 -- 172.21.15.84:0/2312696591 >> 172.21.15.84:0/2312696591 conn(0x7f7bc409c1d0 msgr2=0x7f7bc40b5280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:16:58.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.899+0000 7f7bcabff700 1 -- 172.21.15.84:0/2312696591 shutdown_connections 2023-07-14T11:16:58.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:58.899+0000 7f7bcabff700 1 -- 172.21.15.84:0/2312696591 wait complete. 2023-07-14T11:16:58.919 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-14T11:16:58.919 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T11:16:59.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.114+0000 7f1c90bff700 1 Processor -- start 2023-07-14T11:16:59.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.115+0000 7f1c90bff700 1 -- start start 2023-07-14T11:16:59.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.116+0000 7f1c90bff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1c8c15c950 0x7f1c8c0b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:59.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.116+0000 7f1c90bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c8c0b1e00 0x7f1c8c0d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:59.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.116+0000 7f1c90bff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c8c0d2ce0 con 0x7f1c8c0b2350 2023-07-14T11:16:59.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.116+0000 7f1c90bff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c8c0b3350 con 0x7f1c8c15c950 2023-07-14T11:16:59.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.116+0000 7f1c90bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8c0b3630 con 0x7f1c8c0b1e00 2023-07-14T11:16:59.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.116+0000 7f1c8a59c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1c8c15c950 0x7f1c8c0b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:59.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.116+0000 7f1c8a59c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1c8c15c950 0x7f1c8c0b43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45950/0 (socket says 172.21.15.84:45950) 2023-07-14T11:16:59.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.116+0000 7f1c8a59c700 1 -- 172.21.15.84:0/1959542277 learned_addr learned my addr 172.21.15.84:0/1959542277 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:16:59.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.116+0000 7f1c83fff700 1 --2- 172.21.15.84:0/1959542277 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c8c0b1e00 0x7f1c8c0d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:59.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.116+0000 7f1c8a59c700 1 -- 172.21.15.84:0/1959542277 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c8c0b1e00 msgr2=0x7f1c8c0d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:16:59.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.116+0000 7f1c8a59c700 1 --2- 172.21.15.84:0/1959542277 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c8c0b1e00 0x7f1c8c0d0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:59.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.116+0000 7f1c8a59c700 1 -- 172.21.15.84:0/1959542277 >> v1:172.21.15.179:6789/0 conn(0x7f1c8c0b2350 legacy=0x7f1c8c0afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:16:59.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.116+0000 7f1c8a59c700 1 -- 172.21.15.84:0/1959542277 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c8c0b3910 con 0x7f1c8c15c950 2023-07-14T11:16:59.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.117+0000 7f1c8a59c700 1 --2- 172.21.15.84:0/1959542277 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c8c15c950 0x7f1c8c0b43f0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c006fd0 tx=0x7f1c7c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bae68beb8040c17a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:16:59.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.117+0000 7f1c89d9b700 1 -- 172.21.15.84:0/1959542277 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c7c005e30 con 0x7f1c8c15c950 2023-07-14T11:16:59.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.117+0000 7f1c89d9b700 1 -- 172.21.15.84:0/1959542277 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c7c006030 con 0x7f1c8c15c950 2023-07-14T11:16:59.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.117+0000 7f1c89d9b700 1 -- 172.21.15.84:0/1959542277 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c7c0063c0 con 0x7f1c8c15c950 2023-07-14T11:16:59.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.117+0000 7f1c90bff700 1 -- 172.21.15.84:0/1959542277 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c8c15c950 msgr2=0x7f1c8c0b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:59.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.117+0000 7f1c90bff700 1 --2- 172.21.15.84:0/1959542277 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c8c15c950 0x7f1c8c0b43f0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c006fd0 tx=0x7f1c7c009bd0 comp rx=0 tx=0).stop 2023-07-14T11:16:59.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.118+0000 7f1c90bff700 1 -- 172.21.15.84:0/1959542277 shutdown_connections 2023-07-14T11:16:59.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.118+0000 7f1c90bff700 1 --2- 172.21.15.84:0/1959542277 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c8c15c950 0x7f1c8c0b43f0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:59.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.118+0000 7f1c90bff700 1 --2- 172.21.15.84:0/1959542277 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c8c0b1e00 0x7f1c8c0d0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:59.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.118+0000 7f1c90bff700 1 -- 172.21.15.84:0/1959542277 >> 172.21.15.84:0/1959542277 conn(0x7f1c8c09c1d0 msgr2=0x7f1c8c0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:16:59.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.118+0000 7f1c90bff700 1 -- 172.21.15.84:0/1959542277 shutdown_connections 2023-07-14T11:16:59.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.118+0000 7f1c90bff700 1 -- 172.21.15.84:0/1959542277 wait complete. 2023-07-14T11:16:59.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.119+0000 7f1c90bff700 1 Processor -- start 2023-07-14T11:16:59.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.119+0000 7f1c90bff700 1 -- start start 2023-07-14T11:16:59.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.120+0000 7f1c90bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c8c0b1e00 0x7f1c8c157140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:59.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.120+0000 7f1c90bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c8c0b2350 0x7f1c8c0c6a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:59.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.120+0000 7f1c90bff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c8c15c950 0x7f1c8c0cee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:59.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.120+0000 7f1c90bff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8c0c7f60 con 0x7f1c8c15c950 2023-07-14T11:16:59.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.120+0000 7f1c90bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8c0c7350 con 0x7f1c8c0b1e00 2023-07-14T11:16:59.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.120+0000 7f1c90bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8c0c7630 con 0x7f1c8c0b2350 2023-07-14T11:16:59.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.121+0000 7f1c8ad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c8c15c950 0x7f1c8c0cee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:59.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.121+0000 7f1c8a59c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c8c0b1e00 0x7f1c8c157140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:59.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.121+0000 7f1c8ad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c8c15c950 0x7f1c8c0cee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45964/0 (socket says 172.21.15.84:45964) 2023-07-14T11:16:59.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.121+0000 7f1c8ad9d700 1 -- 172.21.15.84:0/120610005 learned_addr learned my addr 172.21.15.84:0/120610005 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:16:59.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.121+0000 7f1c83fff700 1 --2- 172.21.15.84:0/120610005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c8c0b2350 0x7f1c8c0c6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:59.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.121+0000 7f1c8ad9d700 1 -- 172.21.15.84:0/120610005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c8c0b2350 msgr2=0x7f1c8c0c6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:59.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.121+0000 7f1c8ad9d700 1 --2- 172.21.15.84:0/120610005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c8c0b2350 0x7f1c8c0c6a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:59.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.121+0000 7f1c8ad9d700 1 -- 172.21.15.84:0/120610005 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c8c0b1e00 msgr2=0x7f1c8c157140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:59.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.121+0000 7f1c8ad9d700 1 --2- 172.21.15.84:0/120610005 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c8c0b1e00 0x7f1c8c157140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:59.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.121+0000 7f1c8ad9d700 1 -- 172.21.15.84:0/120610005 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c7c009500 con 0x7f1c8c15c950 2023-07-14T11:16:59.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.121+0000 7f1c8ad9d700 1 --2- 172.21.15.84:0/120610005 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c8c15c950 0x7f1c8c0cee60 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f1c8400cc10 tx=0x7f1c8400cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:16:59.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.122+0000 7f1c82ffd700 1 -- 172.21.15.84:0/120610005 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c8400aa60 con 0x7f1c8c15c950 2023-07-14T11:16:59.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.122+0000 7f1c82ffd700 1 -- 172.21.15.84:0/120610005 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c8400abc0 con 0x7f1c8c15c950 2023-07-14T11:16:59.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.122+0000 7f1c90bff700 1 -- 172.21.15.84:0/120610005 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c8c0c7910 con 0x7f1c8c15c950 2023-07-14T11:16:59.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.122+0000 7f1c82ffd700 1 -- 172.21.15.84:0/120610005 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c84012420 con 0x7f1c8c15c950 2023-07-14T11:16:59.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.122+0000 7f1c90bff700 1 -- 172.21.15.84:0/120610005 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c8c0c6fb0 con 0x7f1c8c15c950 2023-07-14T11:16:59.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.123+0000 7f1c90bff700 1 -- 172.21.15.84:0/120610005 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c8c08b5b0 con 0x7f1c8c15c950 2023-07-14T11:16:59.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.124+0000 7f1c82ffd700 1 -- 172.21.15.84:0/120610005 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 9) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f1c84012580 con 0x7f1c8c15c950 2023-07-14T11:16:59.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.125+0000 7f1c82ffd700 1 --2- 172.21.15.84:0/120610005 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1c6c06ae90 0x7f1c6c06d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:59.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.125+0000 7f1c82ffd700 1 -- 172.21.15.84:0/120610005 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f1c84089b30 con 0x7f1c8c15c950 2023-07-14T11:16:59.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.125+0000 7f1c8a59c700 1 --2- 172.21.15.84:0/120610005 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1c6c06ae90 0x7f1c6c06d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:59.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.126+0000 7f1c8a59c700 1 --2- 172.21.15.84:0/120610005 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1c6c06ae90 0x7f1c6c06d340 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c013040 tx=0x7f1c7c008070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:16:59.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.129+0000 7f1c82ffd700 1 -- 172.21.15.84:0/120610005 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f1c84054880 con 0x7f1c8c15c950 2023-07-14T11:16:59.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.366+0000 7f1c90bff700 1 -- 172.21.15.84:0/120610005 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1c8c04e280 con 0x7f1c8c15c950 2023-07-14T11:16:59.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.366+0000 7f1c82ffd700 1 -- 172.21.15.84:0/120610005 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+4712 (secure 0 0 0) 0x7f1c84057ea0 con 0x7f1c8c15c950 2023-07-14T11:16:59.369 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:16:59.369 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5030,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3551222138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3551222138},{"type":"v1","addr":"172.21.15.179:6834","nonce":3551222138}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5036,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/1316665435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1316665435},{"type":"v1","addr":"172.21.15.84:6836","nonce":1316665435}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5416,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/611235750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":611235750},{"type":"v1","addr":"172.21.15.179:6835","nonce":611235750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T11:15:10.408480+0000","modified":"2023-07-14T11:15:13.936541+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5625},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5625":{"gid":5625,"name":"c","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/2672133286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":2672133286},{"type":"v1","addr":"172.21.15.84:6837","nonce":2672133286}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-14T11:16:59.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.368+0000 7f1c90bff700 1 -- 172.21.15.84:0/120610005 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1c6c06ae90 msgr2=0x7f1c6c06d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:59.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.368+0000 7f1c90bff700 1 --2- 172.21.15.84:0/120610005 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1c6c06ae90 0x7f1c6c06d340 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c013040 tx=0x7f1c7c008070 comp rx=0 tx=0).stop 2023-07-14T11:16:59.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.369+0000 7f1c90bff700 1 -- 172.21.15.84:0/120610005 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c8c15c950 msgr2=0x7f1c8c0cee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:59.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.369+0000 7f1c90bff700 1 --2- 172.21.15.84:0/120610005 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c8c15c950 0x7f1c8c0cee60 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f1c8400cc10 tx=0x7f1c8400cf20 comp rx=0 tx=0).stop 2023-07-14T11:16:59.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.369+0000 7f1c90bff700 1 -- 172.21.15.84:0/120610005 shutdown_connections 2023-07-14T11:16:59.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.369+0000 7f1c90bff700 1 --2- 172.21.15.84:0/120610005 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c8c15c950 0x7f1c8c0cee60 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:59.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.369+0000 7f1c90bff700 1 --2- 172.21.15.84:0/120610005 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c8c0b1e00 0x7f1c8c157140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:59.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.369+0000 7f1c90bff700 1 --2- 172.21.15.84:0/120610005 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1c6c06ae90 0x7f1c6c06d340 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:59.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.369+0000 7f1c90bff700 1 --2- 172.21.15.84:0/120610005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c8c0b2350 0x7f1c8c0c6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:59.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.369+0000 7f1c90bff700 1 -- 172.21.15.84:0/120610005 >> 172.21.15.84:0/120610005 conn(0x7f1c8c09c1d0 msgr2=0x7f1c8c0d1410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:16:59.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.369+0000 7f1c90bff700 1 -- 172.21.15.84:0/120610005 shutdown_connections 2023-07-14T11:16:59.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.369+0000 7f1c90bff700 1 -- 172.21.15.84:0/120610005 wait complete. 2023-07-14T11:16:59.373 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 28 2023-07-14T11:16:59.389 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T11:16:59.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.581+0000 7fc482fff700 1 Processor -- start 2023-07-14T11:16:59.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.581+0000 7fc482fff700 1 -- start start 2023-07-14T11:16:59.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.583+0000 7fc482fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc47c0d1220 0x7fc47c0b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:59.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.583+0000 7fc482fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc47c0b1e00 0x7fc47c0afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:59.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.583+0000 7fc482fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc47c0d2ce0 con 0x7fc47c15c950 2023-07-14T11:16:59.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.583+0000 7fc482fff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc47c0b3350 con 0x7fc47c0d1220 2023-07-14T11:16:59.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.583+0000 7fc482fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc47c0b3630 con 0x7fc47c0b1e00 2023-07-14T11:16:59.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.583+0000 7fc47bfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc47c0d1220 0x7fc47c0b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:59.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.583+0000 7fc47bfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc47c0d1220 0x7fc47c0b43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45968/0 (socket says 172.21.15.84:45968) 2023-07-14T11:16:59.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.583+0000 7fc47bfff700 1 -- 172.21.15.84:0/4120897474 learned_addr learned my addr 172.21.15.84:0/4120897474 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:16:59.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.583+0000 7fc48159c700 1 --2- 172.21.15.84:0/4120897474 >> v2:172.21.15.179:3300/0 conn(0x7fc47c0b1e00 0x7fc47c0afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:59.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.583+0000 7fc47bfff700 1 -- 172.21.15.84:0/4120897474 >> v2:172.21.15.179:3300/0 conn(0x7fc47c0b1e00 msgr2=0x7fc47c0afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:16:59.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.583+0000 7fc47bfff700 1 --2- 172.21.15.84:0/4120897474 >> v2:172.21.15.179:3300/0 conn(0x7fc47c0b1e00 0x7fc47c0afac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:59.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.583+0000 7fc47bfff700 1 -- 172.21.15.84:0/4120897474 >> v1:172.21.15.179:6789/0 conn(0x7fc47c15c950 legacy=0x7fc47c0d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:59.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.583+0000 7fc47bfff700 1 -- 172.21.15.84:0/4120897474 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc47c0b3910 con 0x7fc47c0d1220 2023-07-14T11:16:59.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.584+0000 7fc47bfff700 1 --2- 172.21.15.84:0/4120897474 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc47c0d1220 0x7fc47c0b43f0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fc47c08c300 tx=0x7fc468009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5be092aef9fb586d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:16:59.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.584+0000 7fc47b7fe700 1 -- 172.21.15.84:0/4120897474 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc468011830 con 0x7fc47c0d1220 2023-07-14T11:16:59.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.584+0000 7fc47b7fe700 1 -- 172.21.15.84:0/4120897474 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc468011990 con 0x7fc47c0d1220 2023-07-14T11:16:59.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.584+0000 7fc47b7fe700 1 -- 172.21.15.84:0/4120897474 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc468011d20 con 0x7fc47c0d1220 2023-07-14T11:16:59.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.584+0000 7fc482fff700 1 -- 172.21.15.84:0/4120897474 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc47c0d1220 msgr2=0x7fc47c0b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:59.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.584+0000 7fc482fff700 1 --2- 172.21.15.84:0/4120897474 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc47c0d1220 0x7fc47c0b43f0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fc47c08c300 tx=0x7fc468009bd0 comp rx=0 tx=0).stop 2023-07-14T11:16:59.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.584+0000 7fc482fff700 1 -- 172.21.15.84:0/4120897474 shutdown_connections 2023-07-14T11:16:59.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.584+0000 7fc482fff700 1 --2- 172.21.15.84:0/4120897474 >> v2:172.21.15.179:3300/0 conn(0x7fc47c0b1e00 0x7fc47c0afac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:59.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.584+0000 7fc482fff700 1 --2- 172.21.15.84:0/4120897474 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc47c0d1220 0x7fc47c0b43f0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:59.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.584+0000 7fc482fff700 1 -- 172.21.15.84:0/4120897474 >> 172.21.15.84:0/4120897474 conn(0x7fc47c09c1d0 msgr2=0x7fc47c0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:16:59.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.585+0000 7fc482fff700 1 -- 172.21.15.84:0/4120897474 shutdown_connections 2023-07-14T11:16:59.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.585+0000 7fc482fff700 1 -- 172.21.15.84:0/4120897474 wait complete. 2023-07-14T11:16:59.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.586+0000 7fc482fff700 1 Processor -- start 2023-07-14T11:16:59.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.586+0000 7fc482fff700 1 -- start start 2023-07-14T11:16:59.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.587+0000 7fc482fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc47c0b1e00 0x7fc47c0b8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:59.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.587+0000 7fc482fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc47c0d1220 0x7fc47c0ceb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:59.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.587+0000 7fc482fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc47c15c950 0x7fc47c0cf700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:59.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.587+0000 7fc482fff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc47c0b7660 con 0x7fc47c0d1220 2023-07-14T11:16:59.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.587+0000 7fc482fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc47c0b7940 con 0x7fc47c15c950 2023-07-14T11:16:59.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.587+0000 7fc482fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc47c0b7c20 con 0x7fc47c0b1e00 2023-07-14T11:16:59.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.587+0000 7fc47bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc47c0d1220 0x7fc47c0ceb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:59.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.588+0000 7fc47bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc47c0d1220 0x7fc47c0ceb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45970/0 (socket says 172.21.15.84:45970) 2023-07-14T11:16:59.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.588+0000 7fc47bfff700 1 -- 172.21.15.84:0/2711863876 learned_addr learned my addr 172.21.15.84:0/2711863876 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:16:59.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.588+0000 7fc48159c700 1 --2- 172.21.15.84:0/2711863876 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc47c15c950 0x7fc47c0cf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:59.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.588+0000 7fc480d9b700 1 --2- 172.21.15.84:0/2711863876 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc47c0b1e00 0x7fc47c0b8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:59.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.588+0000 7fc47bfff700 1 -- 172.21.15.84:0/2711863876 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc47c0b1e00 msgr2=0x7fc47c0b8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:59.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.588+0000 7fc47bfff700 1 --2- 172.21.15.84:0/2711863876 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc47c0b1e00 0x7fc47c0b8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:59.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.588+0000 7fc47bfff700 1 -- 172.21.15.84:0/2711863876 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc47c15c950 msgr2=0x7fc47c0cf700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:59.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.588+0000 7fc47bfff700 1 --2- 172.21.15.84:0/2711863876 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc47c15c950 0x7fc47c0cf700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:59.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.588+0000 7fc47bfff700 1 -- 172.21.15.84:0/2711863876 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc468009550 con 0x7fc47c0d1220 2023-07-14T11:16:59.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.588+0000 7fc480d9b700 1 --2- 172.21.15.84:0/2711863876 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc47c0b1e00 0x7fc47c0b8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:16:59.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.588+0000 7fc47bfff700 1 --2- 172.21.15.84:0/2711863876 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc47c0d1220 0x7fc47c0ceb50 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fc468000c00 tx=0x7fc468004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:16:59.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.588+0000 7fc4797fa700 1 -- 172.21.15.84:0/2711863876 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc468004480 con 0x7fc47c0d1220 2023-07-14T11:16:59.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.588+0000 7fc4797fa700 1 -- 172.21.15.84:0/2711863876 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc46801f070 con 0x7fc47c0d1220 2023-07-14T11:16:59.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.588+0000 7fc4797fa700 1 -- 172.21.15.84:0/2711863876 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4680038c0 con 0x7fc47c0d1220 2023-07-14T11:16:59.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.588+0000 7fc482fff700 1 -- 172.21.15.84:0/2711863876 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc47c0b7f00 con 0x7fc47c0d1220 2023-07-14T11:16:59.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.589+0000 7fc482fff700 1 -- 172.21.15.84:0/2711863876 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc47c0b8c40 con 0x7fc47c0d1220 2023-07-14T11:16:59.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.590+0000 7fc482fff700 1 -- 172.21.15.84:0/2711863876 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc47c0b83c0 con 0x7fc47c0d1220 2023-07-14T11:16:59.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.590+0000 7fc4797fa700 1 -- 172.21.15.84:0/2711863876 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 9) v1 ==== 89190+0+0 (secure 0 0 0) 0x7fc468021030 con 0x7fc47c0d1220 2023-07-14T11:16:59.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.592+0000 7fc4797fa700 1 --2- 172.21.15.84:0/2711863876 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc46006ae90 0x7fc46006d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:16:59.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.592+0000 7fc4797fa700 1 -- 172.21.15.84:0/2711863876 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fc46808ad90 con 0x7fc47c0d1220 2023-07-14T11:16:59.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.592+0000 7fc480d9b700 1 --2- 172.21.15.84:0/2711863876 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc46006ae90 0x7fc46006d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:16:59.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.592+0000 7fc480d9b700 1 --2- 172.21.15.84:0/2711863876 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc46006ae90 0x7fc46006d340 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fc470000fb0 tx=0x7fc470009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:16:59.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.595+0000 7fc4797fa700 1 -- 172.21.15.84:0/2711863876 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fc468055b70 con 0x7fc47c0d1220 2023-07-14T11:16:59.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.833+0000 7fc482fff700 1 -- 172.21.15.84:0/2711863876 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc47c04e280 con 0x7fc47c0d1220 2023-07-14T11:16:59.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.833+0000 7fc4797fa700 1 -- 172.21.15.84:0/2711863876 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+4712 (secure 0 0 0) 0x7fc468059190 con 0x7fc47c0d1220 2023-07-14T11:16:59.837 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:16:59.837 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5030,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3551222138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3551222138},{"type":"v1","addr":"172.21.15.179:6834","nonce":3551222138}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5036,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/1316665435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1316665435},{"type":"v1","addr":"172.21.15.84:6836","nonce":1316665435}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5416,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/611235750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":611235750},{"type":"v1","addr":"172.21.15.179:6835","nonce":611235750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T11:15:10.408480+0000","modified":"2023-07-14T11:15:13.936541+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5625},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5625":{"gid":5625,"name":"c","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/2672133286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":2672133286},{"type":"v1","addr":"172.21.15.84:6837","nonce":2672133286}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-14T11:16:59.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.836+0000 7fc482fff700 1 -- 172.21.15.84:0/2711863876 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc46006ae90 msgr2=0x7fc46006d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:59.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.836+0000 7fc482fff700 1 --2- 172.21.15.84:0/2711863876 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc46006ae90 0x7fc46006d340 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fc470000fb0 tx=0x7fc470009040 comp rx=0 tx=0).stop 2023-07-14T11:16:59.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.836+0000 7fc482fff700 1 -- 172.21.15.84:0/2711863876 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc47c0d1220 msgr2=0x7fc47c0ceb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:16:59.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.836+0000 7fc482fff700 1 --2- 172.21.15.84:0/2711863876 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc47c0d1220 0x7fc47c0ceb50 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fc468000c00 tx=0x7fc468004750 comp rx=0 tx=0).stop 2023-07-14T11:16:59.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.836+0000 7fc482fff700 1 -- 172.21.15.84:0/2711863876 shutdown_connections 2023-07-14T11:16:59.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.836+0000 7fc482fff700 1 --2- 172.21.15.84:0/2711863876 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc46006ae90 0x7fc46006d340 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:59.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.836+0000 7fc482fff700 1 --2- 172.21.15.84:0/2711863876 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc47c0b1e00 0x7fc47c0b8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:59.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.836+0000 7fc482fff700 1 --2- 172.21.15.84:0/2711863876 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc47c15c950 0x7fc47c0cf700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:59.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.836+0000 7fc482fff700 1 --2- 172.21.15.84:0/2711863876 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc47c0d1220 0x7fc47c0ceb50 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:16:59.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.836+0000 7fc482fff700 1 -- 172.21.15.84:0/2711863876 >> 172.21.15.84:0/2711863876 conn(0x7fc47c09c1d0 msgr2=0x7fc47c0d0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:16:59.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.836+0000 7fc482fff700 1 -- 172.21.15.84:0/2711863876 shutdown_connections 2023-07-14T11:16:59.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:16:59.836+0000 7fc482fff700 1 -- 172.21.15.84:0/2711863876 wait complete. 2023-07-14T11:16:59.841 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 28 2023-07-14T11:16:59.857 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:17:00.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.052+0000 7f2a093ff700 1 Processor -- start 2023-07-14T11:17:00.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.052+0000 7f2a093ff700 1 -- start start 2023-07-14T11:17:00.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.053+0000 7f2a093ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2a040b5d90 0x7f2a040b6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:00.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.053+0000 7f2a093ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a040d0b10 0x7f2a040d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:00.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.053+0000 7f2a093ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a040b7f50 con 0x7f2a040b4510 2023-07-14T11:17:00.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.053+0000 7f2a093ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a040b48e0 con 0x7f2a040b5d90 2023-07-14T11:17:00.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.053+0000 7f2a093ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a040d14d0 con 0x7f2a040d0b10 2023-07-14T11:17:00.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.054+0000 7f2a037fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a040d0b10 0x7f2a040d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:00.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.054+0000 7f2a037fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a040d0b10 0x7f2a040d0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.84:51264/0 (socket says 172.21.15.84:51264) 2023-07-14T11:17:00.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.054+0000 7f2a037fe700 1 -- 172.21.15.84:0/1924630796 learned_addr learned my addr 172.21.15.84:0/1924630796 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:00.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.054+0000 7f2a02ffd700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f2a040b4510 0x7f2a040cd590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.84:56066/0 (socket says 172.21.15.84:56066) 2023-07-14T11:17:00.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.054+0000 7f2a027fc700 1 --2- 172.21.15.84:0/1924630796 >> v2:172.21.15.179:3300/0 conn(0x7f2a040b5d90 0x7f2a040b6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:00.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.054+0000 7f2a037fe700 1 -- 172.21.15.84:0/1924630796 >> v2:172.21.15.179:3300/0 conn(0x7f2a040b5d90 msgr2=0x7f2a040b6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:00.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.054+0000 7f2a037fe700 1 --2- 172.21.15.84:0/1924630796 >> v2:172.21.15.179:3300/0 conn(0x7f2a040b5d90 0x7f2a040b6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:00.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.054+0000 7f2a037fe700 1 -- 172.21.15.84:0/1924630796 >> v1:172.21.15.179:6789/0 conn(0x7f2a040b4510 legacy=0x7f2a040cd590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:00.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.054+0000 7f2a01ffb700 1 -- 172.21.15.84:0/1924630796 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4003878309 0 0) 0x7f2a040b7f50 con 0x7f2a040b4510 2023-07-14T11:17:00.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.054+0000 7f2a037fe700 1 -- 172.21.15.84:0/1924630796 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a040cdca0 con 0x7f2a040d0b10 2023-07-14T11:17:00.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.054+0000 7f2a037fe700 1 --2- 172.21.15.84:0/1924630796 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a040d0b10 0x7f2a040d0f90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f29fc009e50 tx=0x7f29fc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f88a9f4d479a85fb server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:00.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.055+0000 7f2a01ffb700 1 -- 172.21.15.84:0/1924630796 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29fc00e070 con 0x7f2a040d0b10 2023-07-14T11:17:00.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.055+0000 7f2a01ffb700 1 -- 172.21.15.84:0/1924630796 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29fc00b910 con 0x7f2a040d0b10 2023-07-14T11:17:00.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.055+0000 7f2a01ffb700 1 -- 172.21.15.84:0/1924630796 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29fc00bcc0 con 0x7f2a040d0b10 2023-07-14T11:17:00.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.055+0000 7f2a093ff700 1 -- 172.21.15.84:0/1924630796 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a040d0b10 msgr2=0x7f2a040d0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:00.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.055+0000 7f2a093ff700 1 --2- 172.21.15.84:0/1924630796 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a040d0b10 0x7f2a040d0f90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f29fc009e50 tx=0x7f29fc00b330 comp rx=0 tx=0).stop 2023-07-14T11:17:00.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.055+0000 7f2a093ff700 1 -- 172.21.15.84:0/1924630796 shutdown_connections 2023-07-14T11:17:00.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.055+0000 7f2a093ff700 1 --2- 172.21.15.84:0/1924630796 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a040d0b10 0x7f2a040d0f90 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:00.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.055+0000 7f2a093ff700 1 --2- 172.21.15.84:0/1924630796 >> v2:172.21.15.179:3300/0 conn(0x7f2a040b5d90 0x7f2a040b6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:00.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.055+0000 7f2a093ff700 1 -- 172.21.15.84:0/1924630796 >> 172.21.15.84:0/1924630796 conn(0x7f2a0409c1d0 msgr2=0x7f2a040d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:00.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.055+0000 7f2a093ff700 1 -- 172.21.15.84:0/1924630796 shutdown_connections 2023-07-14T11:17:00.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.055+0000 7f2a093ff700 1 -- 172.21.15.84:0/1924630796 wait complete. 2023-07-14T11:17:00.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.057+0000 7f2a093ff700 1 Processor -- start 2023-07-14T11:17:00.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.057+0000 7f2a093ff700 1 -- start start 2023-07-14T11:17:00.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.058+0000 7f2a093ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a040b4510 0x7f2a04154b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:00.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.058+0000 7f2a093ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a040b5d90 0x7f2a041f5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:00.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.058+0000 7f2a093ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a040d0b10 0x7f2a041533b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:00.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.058+0000 7f2a093ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a04156860 con 0x7f2a040d0b10 2023-07-14T11:17:00.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.058+0000 7f2a093ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a04156550 con 0x7f2a040b4510 2023-07-14T11:17:00.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.058+0000 7f2a093ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a041f5d40 con 0x7f2a040b5d90 2023-07-14T11:17:00.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.058+0000 7f2a037fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a040d0b10 0x7f2a041533b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:00.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.059+0000 7f2a037fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a040d0b10 0x7f2a041533b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45980/0 (socket says 172.21.15.84:45980) 2023-07-14T11:17:00.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.059+0000 7f2a037fe700 1 -- 172.21.15.84:0/920896850 learned_addr learned my addr 172.21.15.84:0/920896850 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:00.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.059+0000 7f2a027fc700 1 --2- 172.21.15.84:0/920896850 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a040b5d90 0x7f2a041f5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:00.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.059+0000 7f2a02ffd700 1 --2- 172.21.15.84:0/920896850 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a040b4510 0x7f2a04154b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:00.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.059+0000 7f2a037fe700 1 -- 172.21.15.84:0/920896850 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a040b5d90 msgr2=0x7f2a041f5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:00.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.059+0000 7f2a037fe700 1 --2- 172.21.15.84:0/920896850 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a040b5d90 0x7f2a041f5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:00.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.059+0000 7f2a037fe700 1 -- 172.21.15.84:0/920896850 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a040b4510 msgr2=0x7f2a04154b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:00.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.059+0000 7f2a037fe700 1 --2- 172.21.15.84:0/920896850 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a040b4510 0x7f2a04154b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:00.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.059+0000 7f2a037fe700 1 -- 172.21.15.84:0/920896850 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29fc009b30 con 0x7f2a040d0b10 2023-07-14T11:17:00.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.059+0000 7f2a037fe700 1 --2- 172.21.15.84:0/920896850 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a040d0b10 0x7f2a041533b0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f29fc00b680 tx=0x7f29fc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:00.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.059+0000 7f29eb7fe700 1 -- 172.21.15.84:0/920896850 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29fc003ea0 con 0x7f2a040d0b10 2023-07-14T11:17:00.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.059+0000 7f29eb7fe700 1 -- 172.21.15.84:0/920896850 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29fc0048d0 con 0x7f2a040d0b10 2023-07-14T11:17:00.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.059+0000 7f29eb7fe700 1 -- 172.21.15.84:0/920896850 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29fc01c650 con 0x7f2a040d0b10 2023-07-14T11:17:00.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.059+0000 7f2a093ff700 1 -- 172.21.15.84:0/920896850 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a041f6020 con 0x7f2a040d0b10 2023-07-14T11:17:00.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.060+0000 7f2a093ff700 1 -- 172.21.15.84:0/920896850 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a041538f0 con 0x7f2a040d0b10 2023-07-14T11:17:00.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.061+0000 7f2a093ff700 1 -- 172.21.15.84:0/920896850 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a041f6540 con 0x7f2a040d0b10 2023-07-14T11:17:00.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.061+0000 7f29eb7fe700 1 -- 172.21.15.84:0/920896850 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 9) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f29fc01c7b0 con 0x7f2a040d0b10 2023-07-14T11:17:00.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.063+0000 7f29eb7fe700 1 --2- 172.21.15.84:0/920896850 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f29f006ae90 0x7f29f006d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:00.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.063+0000 7f29eb7fe700 1 -- 172.21.15.84:0/920896850 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f29fc08afd0 con 0x7f2a040d0b10 2023-07-14T11:17:00.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.063+0000 7f2a02ffd700 1 --2- 172.21.15.84:0/920896850 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f29f006ae90 0x7f29f006d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:00.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.064+0000 7f2a02ffd700 1 --2- 172.21.15.84:0/920896850 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f29f006ae90 0x7f29f006d340 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f29f4000fb0 tx=0x7f29f4000ed0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:00.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.067+0000 7f29eb7fe700 1 -- 172.21.15.84:0/920896850 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f2a041f6540 con 0x7f2a040d0b10 2023-07-14T11:17:00.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.267+0000 7f2a093ff700 1 -- 172.21.15.84:0/920896850 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2a041f6540 con 0x7f2a040d0b10 2023-07-14T11:17:00.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.269+0000 7f29eb7fe700 1 -- 172.21.15.84:0/920896850 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+18422 (secure 0 0 0) 0x7f2a041f6540 con 0x7f2a040d0b10 2023-07-14T11:17:00.272 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:17:00.272 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":52,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:15:57.830481+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-07-14T11:15:08.611029+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-07-14T11:15:09.373415+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.c","mappings":[{"from":0,"to":6}]},{"pgid":"8.28","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:17:00.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.271+0000 7f2a093ff700 1 -- 172.21.15.84:0/920896850 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f29f006ae90 msgr2=0x7f29f006d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:00.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.271+0000 7f2a093ff700 1 --2- 172.21.15.84:0/920896850 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f29f006ae90 0x7f29f006d340 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f29f4000fb0 tx=0x7f29f4000ed0 comp rx=0 tx=0).stop 2023-07-14T11:17:00.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.271+0000 7f2a093ff700 1 -- 172.21.15.84:0/920896850 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a040d0b10 msgr2=0x7f2a041533b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:00.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.271+0000 7f2a093ff700 1 --2- 172.21.15.84:0/920896850 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a040d0b10 0x7f2a041533b0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f29fc00b680 tx=0x7f29fc004ad0 comp rx=0 tx=0).stop 2023-07-14T11:17:00.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.271+0000 7f2a093ff700 1 -- 172.21.15.84:0/920896850 shutdown_connections 2023-07-14T11:17:00.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.271+0000 7f2a093ff700 1 --2- 172.21.15.84:0/920896850 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a040d0b10 0x7f2a041533b0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:00.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.271+0000 7f2a093ff700 1 --2- 172.21.15.84:0/920896850 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a040b4510 0x7f2a04154b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:00.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.271+0000 7f2a093ff700 1 --2- 172.21.15.84:0/920896850 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f29f006ae90 0x7f29f006d340 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:00.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.271+0000 7f2a093ff700 1 --2- 172.21.15.84:0/920896850 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a040b5d90 0x7f2a041f5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:00.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.271+0000 7f2a093ff700 1 -- 172.21.15.84:0/920896850 >> 172.21.15.84:0/920896850 conn(0x7f2a0409c1d0 msgr2=0x7f2a040ce430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:00.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.271+0000 7f2a093ff700 1 -- 172.21.15.84:0/920896850 shutdown_connections 2023-07-14T11:17:00.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.271+0000 7f2a093ff700 1 -- 172.21.15.84:0/920896850 wait complete. 2023-07-14T11:17:00.292 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-14T11:17:00.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.486+0000 7f0d315ff700 1 Processor -- start 2023-07-14T11:17:00.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.486+0000 7f0d315ff700 1 -- start start 2023-07-14T11:17:00.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.487+0000 7f0d315ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0d2c0b4860 0x7f0d2c0b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:00.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.487+0000 7f0d315ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d2c0d12c0 0x7f0d2c0d16e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:00.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.487+0000 7f0d315ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d2c0d02a0 con 0x7f0d2c0b8660 2023-07-14T11:17:00.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.487+0000 7f0d315ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d2c0b5240 con 0x7f0d2c0b4860 2023-07-14T11:17:00.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.487+0000 7f0d315ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2c0cfce0 con 0x7f0d2c0d12c0 2023-07-14T11:17:00.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.488+0000 7f0d2affd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f0d2c0b8660 0x7f0d2c0cd430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:39194/0 (socket says 172.21.15.84:39194) 2023-07-14T11:17:00.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.488+0000 7f0d2affd700 1 -- 172.21.15.84:0/3929043572 learned_addr learned my addr 172.21.15.84:0/3929043572 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:17:00.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.488+0000 7f0d2b7fe700 1 --2- 172.21.15.84:0/3929043572 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d2c0d12c0 0x7f0d2c0d16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:00.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.488+0000 7f0d23fff700 1 --2- 172.21.15.84:0/3929043572 >> v2:172.21.15.179:3300/0 conn(0x7f0d2c0b4860 0x7f0d2c0b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:00.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.488+0000 7f0d2a7fc700 1 -- 172.21.15.84:0/3929043572 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2029959605 0 0) 0x7f0d2c0d02a0 con 0x7f0d2c0b8660 2023-07-14T11:17:00.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.488+0000 7f0d2a7fc700 1 -- 172.21.15.84:0/3929043572 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d180035b0 con 0x7f0d2c0b8660 2023-07-14T11:17:00.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.488+0000 7f0d2b7fe700 1 -- 172.21.15.84:0/3929043572 >> v2:172.21.15.179:3300/0 conn(0x7f0d2c0b4860 msgr2=0x7f0d2c0b4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:00.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.488+0000 7f0d2b7fe700 1 --2- 172.21.15.84:0/3929043572 >> v2:172.21.15.179:3300/0 conn(0x7f0d2c0b4860 0x7f0d2c0b4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:00.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.488+0000 7f0d2b7fe700 1 -- 172.21.15.84:0/3929043572 >> v1:172.21.15.84:6789/0 conn(0x7f0d2c0b8660 legacy=0x7f0d2c0cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:00.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.488+0000 7f0d2b7fe700 1 -- 172.21.15.84:0/3929043572 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d2c0cffc0 con 0x7f0d2c0d12c0 2023-07-14T11:17:00.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.489+0000 7f0d2b7fe700 1 --2- 172.21.15.84:0/3929043572 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d2c0d12c0 0x7f0d2c0d16e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0d24009d90 tx=0x7f0d2400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a971f405cad21516 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:00.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.489+0000 7f0d2a7fc700 1 -- 172.21.15.84:0/3929043572 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d2400e070 con 0x7f0d2c0d12c0 2023-07-14T11:17:00.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.489+0000 7f0d2a7fc700 1 -- 172.21.15.84:0/3929043572 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d2400bb20 con 0x7f0d2c0d12c0 2023-07-14T11:17:00.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.489+0000 7f0d2a7fc700 1 -- 172.21.15.84:0/3929043572 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d24012430 con 0x7f0d2c0d12c0 2023-07-14T11:17:00.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.489+0000 7f0d315ff700 1 -- 172.21.15.84:0/3929043572 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d2c0d12c0 msgr2=0x7f0d2c0d16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:00.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.489+0000 7f0d315ff700 1 --2- 172.21.15.84:0/3929043572 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d2c0d12c0 0x7f0d2c0d16e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0d24009d90 tx=0x7f0d2400b330 comp rx=0 tx=0).stop 2023-07-14T11:17:00.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.490+0000 7f0d315ff700 1 -- 172.21.15.84:0/3929043572 shutdown_connections 2023-07-14T11:17:00.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.490+0000 7f0d315ff700 1 --2- 172.21.15.84:0/3929043572 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d2c0d12c0 0x7f0d2c0d16e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:00.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.490+0000 7f0d315ff700 1 --2- 172.21.15.84:0/3929043572 >> v2:172.21.15.179:3300/0 conn(0x7f0d2c0b4860 0x7f0d2c0b4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:00.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.490+0000 7f0d315ff700 1 -- 172.21.15.84:0/3929043572 >> 172.21.15.84:0/3929043572 conn(0x7f0d2c066860 msgr2=0x7f0d2c06a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:00.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.490+0000 7f0d315ff700 1 -- 172.21.15.84:0/3929043572 shutdown_connections 2023-07-14T11:17:00.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.490+0000 7f0d315ff700 1 -- 172.21.15.84:0/3929043572 wait complete. 2023-07-14T11:17:00.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.491+0000 7f0d315ff700 1 Processor -- start 2023-07-14T11:17:00.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.492+0000 7f0d315ff700 1 -- start start 2023-07-14T11:17:00.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.492+0000 7f0d315ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d2c0b4860 0x7f0d2c0c6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:00.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.493+0000 7f0d315ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d2c0b8660 0x7f0d2c0c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:00.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.493+0000 7f0d315ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d2c0d12c0 0x7f0d2c155980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:00.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.493+0000 7f0d315ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2c0c7bb0 con 0x7f0d2c0d12c0 2023-07-14T11:17:00.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.493+0000 7f0d315ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2c155ec0 con 0x7f0d2c0b8660 2023-07-14T11:17:00.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.493+0000 7f0d315ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2c0c6fa0 con 0x7f0d2c0b4860 2023-07-14T11:17:00.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.493+0000 7f0d2b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d2c0d12c0 0x7f0d2c155980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:00.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.493+0000 7f0d2b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d2c0d12c0 0x7f0d2c155980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45992/0 (socket says 172.21.15.84:45992) 2023-07-14T11:17:00.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.493+0000 7f0d2b7fe700 1 -- 172.21.15.84:0/3876861689 learned_addr learned my addr 172.21.15.84:0/3876861689 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:00.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.493+0000 7f0d23fff700 1 --2- 172.21.15.84:0/3876861689 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d2c0b8660 0x7f0d2c0c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:00.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.493+0000 7f0d2affd700 1 --2- 172.21.15.84:0/3876861689 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d2c0b4860 0x7f0d2c0c6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:00.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.493+0000 7f0d2b7fe700 1 -- 172.21.15.84:0/3876861689 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d2c0b4860 msgr2=0x7f0d2c0c6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:00.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.493+0000 7f0d2b7fe700 1 --2- 172.21.15.84:0/3876861689 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d2c0b4860 0x7f0d2c0c6910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:00.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.493+0000 7f0d2b7fe700 1 -- 172.21.15.84:0/3876861689 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d2c0b8660 msgr2=0x7f0d2c0c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:00.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.493+0000 7f0d2b7fe700 1 --2- 172.21.15.84:0/3876861689 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d2c0b8660 0x7f0d2c0c8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:00.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.493+0000 7f0d2b7fe700 1 -- 172.21.15.84:0/3876861689 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d24009a70 con 0x7f0d2c0d12c0 2023-07-14T11:17:00.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.493+0000 7f0d2affd700 1 --2- 172.21.15.84:0/3876861689 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d2c0b4860 0x7f0d2c0c6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:17:00.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.494+0000 7f0d2b7fe700 1 --2- 172.21.15.84:0/3876861689 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d2c0d12c0 0x7f0d2c155980 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f0d24014040 tx=0x7f0d24004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:00.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.494+0000 7f0d237fe700 1 -- 172.21.15.84:0/3876861689 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d24012430 con 0x7f0d2c0d12c0 2023-07-14T11:17:00.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.494+0000 7f0d237fe700 1 -- 172.21.15.84:0/3876861689 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d24020070 con 0x7f0d2c0d12c0 2023-07-14T11:17:00.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.494+0000 7f0d237fe700 1 -- 172.21.15.84:0/3876861689 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d24004280 con 0x7f0d2c0d12c0 2023-07-14T11:17:00.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.494+0000 7f0d315ff700 1 -- 172.21.15.84:0/3876861689 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d2c0c7280 con 0x7f0d2c0d12c0 2023-07-14T11:17:00.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.494+0000 7f0d315ff700 1 -- 172.21.15.84:0/3876861689 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d2c0c7840 con 0x7f0d2c0d12c0 2023-07-14T11:17:00.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.495+0000 7f0d315ff700 1 -- 172.21.15.84:0/3876861689 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d2c0c7d20 con 0x7f0d2c0d12c0 2023-07-14T11:17:00.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.496+0000 7f0d237fe700 1 -- 172.21.15.84:0/3876861689 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 9) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f0d240043e0 con 0x7f0d2c0d12c0 2023-07-14T11:17:00.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.497+0000 7f0d237fe700 1 --2- 172.21.15.84:0/3876861689 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f0d0c06ae90 0x7f0d0c06d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:00.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.497+0000 7f0d237fe700 1 -- 172.21.15.84:0/3876861689 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f0d24022070 con 0x7f0d2c0d12c0 2023-07-14T11:17:00.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.497+0000 7f0d2affd700 1 --2- 172.21.15.84:0/3876861689 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f0d0c06ae90 0x7f0d0c06d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:00.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.498+0000 7f0d2affd700 1 --2- 172.21.15.84:0/3876861689 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f0d0c06ae90 0x7f0d0c06d340 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c005910 tx=0x7f0d1c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:00.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.502+0000 7f0d237fe700 1 -- 172.21.15.84:0/3876861689 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f0d24056340 con 0x7f0d2c0d12c0 2023-07-14T11:17:00.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.739+0000 7f0d315ff700 1 -- 172.21.15.84:0/3876861689 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f0d2c074350 con 0x7f0d2c0d12c0 2023-07-14T11:17:00.743 INFO:tasks.ceph.mon.a.smithi084.stderr:2023-07-14T11:17:00.740+0000 7f5e043f4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-14T11:17:00.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.745+0000 7f0d237fe700 1 -- 172.21.15.84:0/3876861689 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v29) v1 ==== 161+0+0 (secure 0 0 0) 0x7f0d24059960 con 0x7f0d2c0d12c0 2023-07-14T11:17:00.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.749+0000 7f0d315ff700 1 -- 172.21.15.84:0/3876861689 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f0d0c06ae90 msgr2=0x7f0d0c06d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:00.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.749+0000 7f0d315ff700 1 --2- 172.21.15.84:0/3876861689 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f0d0c06ae90 0x7f0d0c06d340 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c005910 tx=0x7f0d1c009040 comp rx=0 tx=0).stop 2023-07-14T11:17:00.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.749+0000 7f0d315ff700 1 -- 172.21.15.84:0/3876861689 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d2c0d12c0 msgr2=0x7f0d2c155980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:00.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.749+0000 7f0d315ff700 1 --2- 172.21.15.84:0/3876861689 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d2c0d12c0 0x7f0d2c155980 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f0d24014040 tx=0x7f0d24004ad0 comp rx=0 tx=0).stop 2023-07-14T11:17:00.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.749+0000 7f0d315ff700 1 -- 172.21.15.84:0/3876861689 shutdown_connections 2023-07-14T11:17:00.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.749+0000 7f0d315ff700 1 --2- 172.21.15.84:0/3876861689 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f0d0c06ae90 0x7f0d0c06d340 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:00.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.749+0000 7f0d315ff700 1 --2- 172.21.15.84:0/3876861689 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d2c0b4860 0x7f0d2c0c6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:00.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.749+0000 7f0d315ff700 1 --2- 172.21.15.84:0/3876861689 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d2c0d12c0 0x7f0d2c155980 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:00.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.749+0000 7f0d315ff700 1 --2- 172.21.15.84:0/3876861689 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d2c0b8660 0x7f0d2c0c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:00.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.749+0000 7f0d315ff700 1 -- 172.21.15.84:0/3876861689 >> 172.21.15.84:0/3876861689 conn(0x7f0d2c066860 msgr2=0x7f0d2c0d3780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:00.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.749+0000 7f0d315ff700 1 -- 172.21.15.84:0/3876861689 shutdown_connections 2023-07-14T11:17:00.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.749+0000 7f0d315ff700 1 -- 172.21.15.84:0/3876861689 wait complete. 2023-07-14T11:17:00.754 INFO:teuthology.orchestra.run.smithi084.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-14T11:17:00.779 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-14T11:17:00.829 INFO:tasks.ceph.mds.c.smithi084.stdout:starting mds.c at 2023-07-14T11:17:00.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.975+0000 7f86ecfff700 1 Processor -- start 2023-07-14T11:17:00.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.975+0000 7f86ecfff700 1 -- start start 2023-07-14T11:17:00.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.976+0000 7f86ecfff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f86e80b8a60 0x7f86e80b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:00.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.976+0000 7f86ecfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86e80d1220 0x7f86e80b0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:00.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.976+0000 7f86ecfff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86e80b8e30 con 0x7f86e80b4530 2023-07-14T11:17:00.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.976+0000 7f86ecfff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86e80afaa0 con 0x7f86e80b8a60 2023-07-14T11:17:00.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.976+0000 7f86ecfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86e80afd80 con 0x7f86e80d1220 2023-07-14T11:17:00.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.976+0000 7f86dffff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f86e80b4530 0x7f86e80d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:39222/0 (socket says 172.21.15.84:39222) 2023-07-14T11:17:00.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.976+0000 7f86dffff700 1 -- 172.21.15.84:0/4201409899 learned_addr learned my addr 172.21.15.84:0/4201409899 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:17:00.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.977+0000 7f86e659c700 1 --2- 172.21.15.84:0/4201409899 >> v2:172.21.15.179:3300/0 conn(0x7f86e80b8a60 0x7f86e80b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:00.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.977+0000 7f86e6d9d700 1 --2- 172.21.15.84:0/4201409899 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86e80d1220 0x7f86e80b0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:00.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.977+0000 7f86e5d9b700 1 -- 172.21.15.84:0/4201409899 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2168055306 0 0) 0x7f86e80b8e30 con 0x7f86e80b4530 2023-07-14T11:17:00.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.977+0000 7f86e5d9b700 1 -- 172.21.15.84:0/4201409899 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86d40035b0 con 0x7f86e80b4530 2023-07-14T11:17:00.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.977+0000 7f86e5d9b700 1 -- 172.21.15.84:0/4201409899 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2098683862 0 0) 0x7f86d40035b0 con 0x7f86e80b4530 2023-07-14T11:17:00.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.977+0000 7f86e5d9b700 1 -- 172.21.15.84:0/4201409899 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86e80d1220 msgr2=0x7f86e80b0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:00.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.977+0000 7f86e5d9b700 1 --2- 172.21.15.84:0/4201409899 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86e80d1220 0x7f86e80b0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:00.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.977+0000 7f86e5d9b700 1 -- 172.21.15.84:0/4201409899 >> v2:172.21.15.179:3300/0 conn(0x7f86e80b8a60 msgr2=0x7f86e80b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:00.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.977+0000 7f86e5d9b700 1 --2- 172.21.15.84:0/4201409899 >> v2:172.21.15.179:3300/0 conn(0x7f86e80b8a60 0x7f86e80b3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:00.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.977+0000 7f86e5d9b700 1 -- 172.21.15.84:0/4201409899 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e80b0060 con 0x7f86e80b4530 2023-07-14T11:17:00.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.977+0000 7f86e5d9b700 1 -- 172.21.15.84:0/4201409899 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7f86d0001670 con 0x7f86e80b4530 2023-07-14T11:17:00.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.977+0000 7f86e659c700 1 --2- 172.21.15.84:0/4201409899 >> v2:172.21.15.179:3300/0 conn(0x7f86e80b8a60 0x7f86e80b3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:17:00.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.977+0000 7f86e5d9b700 1 -- 172.21.15.84:0/4201409899 >> v1:172.21.15.84:6789/0 conn(0x7f86e80b4530 legacy=0x7f86e80d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:00.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.977+0000 7f86e5d9b700 1 --2- 172.21.15.84:0/4201409899 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86e80d1220 0x7f86d4003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:00.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.977+0000 7f86e5d9b700 1 --2- 172.21.15.84:0/4201409899 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86d4003fd0 0x7f86d4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:00.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.977+0000 7f86e5d9b700 1 --2- 172.21.15.84:0/4201409899 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86d4004d90 0x7f86d4005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:00.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.977+0000 7f86e5d9b700 1 -- 172.21.15.84:0/4201409899 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e80afaa0 con 0x7f86d4004d90 2023-07-14T11:17:00.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.977+0000 7f86e5d9b700 1 -- 172.21.15.84:0/4201409899 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e80afd80 con 0x7f86d4003fd0 2023-07-14T11:17:00.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.977+0000 7f86e5d9b700 1 -- 172.21.15.84:0/4201409899 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86d400ba90 con 0x7f86e80d1220 2023-07-14T11:17:00.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.977+0000 7f86e6d9d700 1 --2- 172.21.15.84:0/4201409899 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86d4004d90 0x7f86d4005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:00.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.978+0000 7f86e659c700 1 --2- 172.21.15.84:0/4201409899 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86e80d1220 0x7f86d4003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:00.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.978+0000 7f86dffff700 1 --2- 172.21.15.84:0/4201409899 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86d4003fd0 0x7f86d4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:00.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.978+0000 7f86e6d9d700 1 -- 172.21.15.84:0/4201409899 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86e80d1220 msgr2=0x7f86d4003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:00.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.978+0000 7f86e6d9d700 1 --2- 172.21.15.84:0/4201409899 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86e80d1220 0x7f86d4003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:00.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.978+0000 7f86e6d9d700 1 -- 172.21.15.84:0/4201409899 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86d4003fd0 msgr2=0x7f86d4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:00.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.978+0000 7f86e6d9d700 1 --2- 172.21.15.84:0/4201409899 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86d4003fd0 0x7f86d4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:00.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.978+0000 7f86e6d9d700 1 -- 172.21.15.84:0/4201409899 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86d40035b0 con 0x7f86d4004d90 2023-07-14T11:17:00.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.978+0000 7f86e6d9d700 1 --2- 172.21.15.84:0/4201409899 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86d4004d90 0x7f86d4005200 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f86e808d270 tx=0x7f86d4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2a5f881f226cdf5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:00.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.978+0000 7f86e5d9b700 1 -- 172.21.15.84:0/4201409899 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e000ebd0 con 0x7f86d4004d90 2023-07-14T11:17:00.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.978+0000 7f86e5d9b700 1 -- 172.21.15.84:0/4201409899 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86e000f040 con 0x7f86d4004d90 2023-07-14T11:17:00.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.978+0000 7f86e5d9b700 1 -- 172.21.15.84:0/4201409899 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e0014480 con 0x7f86d4004d90 2023-07-14T11:17:00.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.979+0000 7f86ecfff700 1 -- 172.21.15.84:0/4201409899 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86d4004d90 msgr2=0x7f86d4005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:00.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.979+0000 7f86ecfff700 1 --2- 172.21.15.84:0/4201409899 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86d4004d90 0x7f86d4005200 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f86e808d270 tx=0x7f86d4005880 comp rx=0 tx=0).stop 2023-07-14T11:17:00.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.979+0000 7f86e6d9d700 1 -- 172.21.15.84:0/4201409899 reap_dead start 2023-07-14T11:17:00.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.979+0000 7f86ecfff700 1 -- 172.21.15.84:0/4201409899 shutdown_connections 2023-07-14T11:17:00.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.979+0000 7f86ecfff700 1 -- 172.21.15.84:0/4201409899 >> 172.21.15.84:0/4201409899 conn(0x7f86e809c1b0 msgr2=0x7f86e80d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:00.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.979+0000 7f86ecfff700 1 -- 172.21.15.84:0/4201409899 shutdown_connections 2023-07-14T11:17:00.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.979+0000 7f86ecfff700 1 -- 172.21.15.84:0/4201409899 wait complete. 2023-07-14T11:17:00.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.981+0000 7f86ecfff700 1 Processor -- start 2023-07-14T11:17:00.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.981+0000 7f86ecfff700 1 -- start start 2023-07-14T11:17:00.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.982+0000 7f86ecfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86d4004d90 0x7f86e81f2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:00.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.982+0000 7f86ecfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86e81f18c0 0x7f86e80cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:00.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.982+0000 7f86ecfff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86e815d280 0x7f86e815d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:00.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.982+0000 7f86ecfff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e815dc60 con 0x7f86e81f18c0 2023-07-14T11:17:00.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.982+0000 7f86ecfff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e815ead0 con 0x7f86e815d280 2023-07-14T11:17:00.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.982+0000 7f86ecfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86e815edb0 con 0x7f86d4004d90 2023-07-14T11:17:00.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.982+0000 7f86dffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86e81f18c0 0x7f86e80cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:00.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.982+0000 7f86dffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86e81f18c0 0x7f86e80cfec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46044/0 (socket says 172.21.15.84:46044) 2023-07-14T11:17:00.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.982+0000 7f86dffff700 1 -- 172.21.15.84:0/730215616 learned_addr learned my addr 172.21.15.84:0/730215616 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:00.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.982+0000 7f86e6d9d700 1 --2- 172.21.15.84:0/730215616 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86e815d280 0x7f86e815d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:00.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.982+0000 7f86e659c700 1 --2- 172.21.15.84:0/730215616 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86d4004d90 0x7f86e81f2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:00.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.982+0000 7f86dffff700 1 -- 172.21.15.84:0/730215616 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86d4004d90 msgr2=0x7f86e81f2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:00.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.982+0000 7f86dffff700 1 --2- 172.21.15.84:0/730215616 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86d4004d90 0x7f86e81f2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:00.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.982+0000 7f86dffff700 1 -- 172.21.15.84:0/730215616 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86e815d280 msgr2=0x7f86e815d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:00.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.982+0000 7f86dffff700 1 --2- 172.21.15.84:0/730215616 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86e815d280 0x7f86e815d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:00.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.983+0000 7f86dffff700 1 -- 172.21.15.84:0/730215616 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e815f090 con 0x7f86e81f18c0 2023-07-14T11:17:00.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.983+0000 7f86e659c700 1 --2- 172.21.15.84:0/730215616 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86d4004d90 0x7f86e81f2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:17:00.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.983+0000 7f86e6d9d700 1 --2- 172.21.15.84:0/730215616 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86e815d280 0x7f86e815d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:17:00.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.983+0000 7f86dffff700 1 --2- 172.21.15.84:0/730215616 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86e81f18c0 0x7f86e80cfec0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f86d0007fd0 tx=0x7f86d00075f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:00.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.983+0000 7f86deffd700 1 -- 172.21.15.84:0/730215616 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d00077d0 con 0x7f86e81f18c0 2023-07-14T11:17:00.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.983+0000 7f86deffd700 1 -- 172.21.15.84:0/730215616 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86d000f8d0 con 0x7f86e81f18c0 2023-07-14T11:17:00.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.983+0000 7f86ecfff700 1 -- 172.21.15.84:0/730215616 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86e815f370 con 0x7f86e81f18c0 2023-07-14T11:17:00.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.983+0000 7f86deffd700 1 -- 172.21.15.84:0/730215616 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d000fc80 con 0x7f86e81f18c0 2023-07-14T11:17:00.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.983+0000 7f86ecfff700 1 -- 172.21.15.84:0/730215616 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86e80d0400 con 0x7f86e81f18c0 2023-07-14T11:17:00.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.984+0000 7f86ecfff700 1 -- 172.21.15.84:0/730215616 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86e815f890 con 0x7f86e81f18c0 2023-07-14T11:17:00.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.985+0000 7f86deffd700 1 -- 172.21.15.84:0/730215616 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 9) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f86d001d460 con 0x7f86e81f18c0 2023-07-14T11:17:00.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.986+0000 7f86deffd700 1 --2- 172.21.15.84:0/730215616 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f86c806ae90 0x7f86c806d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:00.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.987+0000 7f86deffd700 1 -- 172.21.15.84:0/730215616 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6206+0+0 (secure 0 0 0) 0x7f86d0089910 con 0x7f86e81f18c0 2023-07-14T11:17:00.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.987+0000 7f86e659c700 1 --2- 172.21.15.84:0/730215616 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f86c806ae90 0x7f86c806d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:00.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.987+0000 7f86e659c700 1 --2- 172.21.15.84:0/730215616 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f86c806ae90 0x7f86c806d340 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f86e815e7f0 tx=0x7f86d8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:00.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:00.991+0000 7f86deffd700 1 -- 172.21.15.84:0/730215616 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f86e815f890 con 0x7f86e81f18c0 2023-07-14T11:17:01.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.234+0000 7f86ecfff700 1 -- 172.21.15.84:0/730215616 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f86e815f890 con 0x7f86e81f18c0 2023-07-14T11:17:01.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.746+0000 7f86deffd700 1 -- 172.21.15.84:0/730215616 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v30) v1 ==== 104+0+0 (secure 0 0 0) 0x7f86e815f890 con 0x7f86e81f18c0 2023-07-14T11:17:01.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.748+0000 7f86ecfff700 1 -- 172.21.15.84:0/730215616 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f86c806ae90 msgr2=0x7f86c806d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:01.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.748+0000 7f86ecfff700 1 --2- 172.21.15.84:0/730215616 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f86c806ae90 0x7f86c806d340 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f86e815e7f0 tx=0x7f86d8008040 comp rx=0 tx=0).stop 2023-07-14T11:17:01.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.748+0000 7f86ecfff700 1 -- 172.21.15.84:0/730215616 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86e81f18c0 msgr2=0x7f86e80cfec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:01.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.748+0000 7f86ecfff700 1 --2- 172.21.15.84:0/730215616 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86e81f18c0 0x7f86e80cfec0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f86d0007fd0 tx=0x7f86d00075f0 comp rx=0 tx=0).stop 2023-07-14T11:17:01.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.748+0000 7f86ecfff700 1 -- 172.21.15.84:0/730215616 shutdown_connections 2023-07-14T11:17:01.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.748+0000 7f86ecfff700 1 --2- 172.21.15.84:0/730215616 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f86c806ae90 0x7f86c806d340 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:01.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.748+0000 7f86ecfff700 1 --2- 172.21.15.84:0/730215616 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86d4004d90 0x7f86e81f2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:01.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.748+0000 7f86ecfff700 1 --2- 172.21.15.84:0/730215616 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86e815d280 0x7f86e815d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:01.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.748+0000 7f86ecfff700 1 --2- 172.21.15.84:0/730215616 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86e81f18c0 0x7f86e80cfec0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:01.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.748+0000 7f86ecfff700 1 -- 172.21.15.84:0/730215616 >> 172.21.15.84:0/730215616 conn(0x7f86e809c1b0 msgr2=0x7f86e806b7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:01.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.749+0000 7f86ecfff700 1 -- 172.21.15.84:0/730215616 shutdown_connections 2023-07-14T11:17:01.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.749+0000 7f86ecfff700 1 -- 172.21.15.84:0/730215616 wait complete. 2023-07-14T11:17:01.770 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-14T11:17:01.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.970+0000 7f71943ff700 1 Processor -- start 2023-07-14T11:17:01.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.970+0000 7f71943ff700 1 -- start start 2023-07-14T11:17:01.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.971+0000 7f71943ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f718c156e40 0x7f718c1596a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:01.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.972+0000 7f71943ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f718c06fde0 0x7f718c070260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:01.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.972+0000 7f71943ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f718c159fb0 con 0x7f718c15d810 2023-07-14T11:17:01.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.972+0000 7f71943ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f718c0707a0 con 0x7f718c06fde0 2023-07-14T11:17:01.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.972+0000 7f71943ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f718c15a290 con 0x7f718c156e40 2023-07-14T11:17:01.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.972+0000 7f719199a700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f718c15d810 0x7f718c0b2230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:39234/0 (socket says 172.21.15.84:39234) 2023-07-14T11:17:01.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.972+0000 7f719199a700 1 -- 172.21.15.84:0/4034791513 learned_addr learned my addr 172.21.15.84:0/4034791513 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:17:01.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.972+0000 7f719219b700 1 --2- 172.21.15.84:0/4034791513 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f718c156e40 0x7f718c1596a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:01.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.972+0000 7f719299c700 1 --2- 172.21.15.84:0/4034791513 >> v2:172.21.15.179:3300/0 conn(0x7f718c06fde0 0x7f718c070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:01.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.972+0000 7f7191199700 1 -- 172.21.15.84:0/4034791513 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1523037594 0 0) 0x7f718c159fb0 con 0x7f718c15d810 2023-07-14T11:17:01.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.972+0000 7f7191199700 1 -- 172.21.15.84:0/4034791513 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71780035b0 con 0x7f718c15d810 2023-07-14T11:17:01.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.973+0000 7f719219b700 1 -- 172.21.15.84:0/4034791513 >> v2:172.21.15.179:3300/0 conn(0x7f718c06fde0 msgr2=0x7f718c070260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:01.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.973+0000 7f719219b700 1 --2- 172.21.15.84:0/4034791513 >> v2:172.21.15.179:3300/0 conn(0x7f718c06fde0 0x7f718c070260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:01.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.973+0000 7f719219b700 1 -- 172.21.15.84:0/4034791513 >> v1:172.21.15.84:6789/0 conn(0x7f718c15d810 legacy=0x7f718c0b2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:01.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.973+0000 7f7191199700 1 -- 172.21.15.84:0/4034791513 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1537520969 0 0) 0x7f71780035b0 con 0x7f718c15d810 2023-07-14T11:17:01.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.973+0000 7f719219b700 1 -- 172.21.15.84:0/4034791513 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f718c15a570 con 0x7f718c156e40 2023-07-14T11:17:01.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.973+0000 7f719299c700 1 --2- 172.21.15.84:0/4034791513 >> v2:172.21.15.179:3300/0 conn(0x7f718c06fde0 0x7f718c070260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:17:01.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.973+0000 7f719219b700 1 --2- 172.21.15.84:0/4034791513 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f718c156e40 0x7f718c1596a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7188009840 tx=0x7f7188009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19866c422a41ae8f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:01.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.973+0000 7f7191199700 1 -- 172.21.15.84:0/4034791513 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717c001670 con 0x7f718c156e40 2023-07-14T11:17:01.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.973+0000 7f7191199700 1 -- 172.21.15.84:0/4034791513 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7188004030 con 0x7f718c156e40 2023-07-14T11:17:01.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.973+0000 7f7191199700 1 -- 172.21.15.84:0/4034791513 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71880043c0 con 0x7f718c156e40 2023-07-14T11:17:01.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.974+0000 7f71943ff700 1 -- 172.21.15.84:0/4034791513 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f718c156e40 msgr2=0x7f718c1596a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:01.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.974+0000 7f71943ff700 1 --2- 172.21.15.84:0/4034791513 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f718c156e40 0x7f718c1596a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7188009840 tx=0x7f7188009b50 comp rx=0 tx=0).stop 2023-07-14T11:17:01.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.974+0000 7f71943ff700 1 -- 172.21.15.84:0/4034791513 shutdown_connections 2023-07-14T11:17:01.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.974+0000 7f71943ff700 1 --2- 172.21.15.84:0/4034791513 >> v2:172.21.15.179:3300/0 conn(0x7f718c06fde0 0x7f718c070260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:01.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.974+0000 7f71943ff700 1 --2- 172.21.15.84:0/4034791513 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f718c156e40 0x7f718c1596a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:01.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.974+0000 7f71943ff700 1 -- 172.21.15.84:0/4034791513 >> 172.21.15.84:0/4034791513 conn(0x7f718c065bd0 msgr2=0x7f718c065fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:01.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.974+0000 7f71943ff700 1 -- 172.21.15.84:0/4034791513 shutdown_connections 2023-07-14T11:17:01.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.974+0000 7f71943ff700 1 -- 172.21.15.84:0/4034791513 wait complete. 2023-07-14T11:17:01.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.976+0000 7f71943ff700 1 Processor -- start 2023-07-14T11:17:01.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.976+0000 7f71943ff700 1 -- start start 2023-07-14T11:17:01.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.978+0000 7f71943ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f718c06fde0 0x7f718c0af650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:01.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.978+0000 7f71943ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f718c156e40 0x7f718c143410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:01.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.978+0000 7f71943ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f718c15d810 0x7f718c0ada70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:01.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.978+0000 7f71943ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f718c143950 con 0x7f718c06fde0 2023-07-14T11:17:01.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.978+0000 7f71943ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f718c0ac9d0 con 0x7f718c156e40 2023-07-14T11:17:01.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.978+0000 7f71943ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f718c0accb0 con 0x7f718c15d810 2023-07-14T11:17:01.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.978+0000 7f719219b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f718c06fde0 0x7f718c0af650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:01.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.978+0000 7f719219b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f718c06fde0 0x7f718c0af650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46048/0 (socket says 172.21.15.84:46048) 2023-07-14T11:17:01.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.978+0000 7f719219b700 1 -- 172.21.15.84:0/2368431227 learned_addr learned my addr 172.21.15.84:0/2368431227 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:01.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.978+0000 7f719199a700 1 --2- 172.21.15.84:0/2368431227 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f718c156e40 0x7f718c143410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:01.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.978+0000 7f719299c700 1 --2- 172.21.15.84:0/2368431227 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f718c15d810 0x7f718c0ada70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:01.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.978+0000 7f719219b700 1 -- 172.21.15.84:0/2368431227 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f718c15d810 msgr2=0x7f718c0ada70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:01.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.978+0000 7f719219b700 1 --2- 172.21.15.84:0/2368431227 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f718c15d810 0x7f718c0ada70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:01.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.978+0000 7f719219b700 1 -- 172.21.15.84:0/2368431227 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f718c156e40 msgr2=0x7f718c143410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:01.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.978+0000 7f719219b700 1 --2- 172.21.15.84:0/2368431227 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f718c156e40 0x7f718c143410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:01.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.978+0000 7f719219b700 1 -- 172.21.15.84:0/2368431227 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7184009a70 con 0x7f718c06fde0 2023-07-14T11:17:01.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.979+0000 7f719219b700 1 --2- 172.21.15.84:0/2368431227 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f718c06fde0 0x7f718c0af650 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f718800a010 tx=0x7f7188004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:01.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.979+0000 7f7182ffd700 1 -- 172.21.15.84:0/2368431227 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7188003e10 con 0x7f718c06fde0 2023-07-14T11:17:01.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.979+0000 7f7182ffd700 1 -- 172.21.15.84:0/2368431227 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f718801f070 con 0x7f718c06fde0 2023-07-14T11:17:01.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.979+0000 7f7182ffd700 1 -- 172.21.15.84:0/2368431227 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7188011870 con 0x7f718c06fde0 2023-07-14T11:17:01.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.979+0000 7f71943ff700 1 -- 172.21.15.84:0/2368431227 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71880094a0 con 0x7f718c06fde0 2023-07-14T11:17:01.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.979+0000 7f71943ff700 1 -- 172.21.15.84:0/2368431227 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f718c0ad270 con 0x7f718c06fde0 2023-07-14T11:17:01.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.980+0000 7f71943ff700 1 -- 172.21.15.84:0/2368431227 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f718c0ad8c0 con 0x7f718c06fde0 2023-07-14T11:17:01.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.981+0000 7f7182ffd700 1 -- 172.21.15.84:0/2368431227 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 9) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f71880119d0 con 0x7f718c06fde0 2023-07-14T11:17:01.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.982+0000 7f7182ffd700 1 --2- 172.21.15.84:0/2368431227 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f717006ae90 0x7f717006d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:01.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.982+0000 7f7182ffd700 1 -- 172.21.15.84:0/2368431227 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6206+0+0 (secure 0 0 0) 0x7f7188021070 con 0x7f718c06fde0 2023-07-14T11:17:01.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.982+0000 7f719199a700 1 --2- 172.21.15.84:0/2368431227 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f717006ae90 0x7f717006d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:01.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.983+0000 7f719199a700 1 --2- 172.21.15.84:0/2368431227 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f717006ae90 0x7f717006d340 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f718c1f5420 tx=0x7f717c007a40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:01.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:01.987+0000 7f7182ffd700 1 -- 172.21.15.84:0/2368431227 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7188055f30 con 0x7f718c06fde0 2023-07-14T11:17:02.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:02.184+0000 7f71943ff700 1 -- 172.21.15.84:0/2368431227 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f718c074350 con 0x7f718c06fde0 2023-07-14T11:17:03.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.005+0000 7f7182ffd700 1 -- 172.21.15.84:0/2368431227 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v54) v1 ==== 181+0+0 (secure 0 0 0) 0x7f7188059550 con 0x7f718c06fde0 2023-07-14T11:17:03.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.010+0000 7f71943ff700 1 -- 172.21.15.84:0/2368431227 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f717006ae90 msgr2=0x7f717006d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:03.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.010+0000 7f71943ff700 1 --2- 172.21.15.84:0/2368431227 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f717006ae90 0x7f717006d340 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f718c1f5420 tx=0x7f717c007a40 comp rx=0 tx=0).stop 2023-07-14T11:17:03.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.010+0000 7f71943ff700 1 -- 172.21.15.84:0/2368431227 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f718c06fde0 msgr2=0x7f718c0af650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:03.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.010+0000 7f71943ff700 1 --2- 172.21.15.84:0/2368431227 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f718c06fde0 0x7f718c0af650 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f718800a010 tx=0x7f7188004750 comp rx=0 tx=0).stop 2023-07-14T11:17:03.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.010+0000 7f71943ff700 1 -- 172.21.15.84:0/2368431227 shutdown_connections 2023-07-14T11:17:03.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.010+0000 7f71943ff700 1 --2- 172.21.15.84:0/2368431227 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f717006ae90 0x7f717006d340 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:03.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.010+0000 7f71943ff700 1 --2- 172.21.15.84:0/2368431227 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f718c15d810 0x7f718c0ada70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:03.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.010+0000 7f71943ff700 1 --2- 172.21.15.84:0/2368431227 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f718c06fde0 0x7f718c0af650 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:03.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.010+0000 7f71943ff700 1 --2- 172.21.15.84:0/2368431227 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f718c156e40 0x7f718c143410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:03.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.010+0000 7f71943ff700 1 -- 172.21.15.84:0/2368431227 >> 172.21.15.84:0/2368431227 conn(0x7f718c065bd0 msgr2=0x7f718c15c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:03.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.011+0000 7f71943ff700 1 -- 172.21.15.84:0/2368431227 shutdown_connections 2023-07-14T11:17:03.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.011+0000 7f71943ff700 1 -- 172.21.15.84:0/2368431227 wait complete. 2023-07-14T11:17:03.016 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_metadata' removed 2023-07-14T11:17:03.035 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-14T11:17:03.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.232+0000 7f9fc8dff700 1 Processor -- start 2023-07-14T11:17:03.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.232+0000 7f9fc8dff700 1 -- start start 2023-07-14T11:17:03.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.233+0000 7f9fc8dff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9fc40d1160 0x7f9fc40cd4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:03.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.233+0000 7f9fc8dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fc40b2440 0x7f9fc40cda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:03.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.233+0000 7f9fc8dff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fc415cc60 con 0x7f9fc415c890 2023-07-14T11:17:03.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.233+0000 7f9fc8dff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fc406a7f0 con 0x7f9fc40d1160 2023-07-14T11:17:03.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.233+0000 7f9fc8dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc406b760 con 0x7f9fc40b2440 2023-07-14T11:17:03.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.234+0000 7f9fc259c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f9fc415c890 0x7f9fc40d0a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:39238/0 (socket says 172.21.15.84:39238) 2023-07-14T11:17:03.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.234+0000 7f9fc259c700 1 -- 172.21.15.84:0/2938333610 learned_addr learned my addr 172.21.15.84:0/2938333610 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:17:03.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.234+0000 7f9fc2d9d700 1 --2- 172.21.15.84:0/2938333610 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fc40b2440 0x7f9fc40cda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:03.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.234+0000 7f9fc1d9b700 1 --2- 172.21.15.84:0/2938333610 >> v2:172.21.15.179:3300/0 conn(0x7f9fc40d1160 0x7f9fc40cd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:03.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.234+0000 7f9fc159a700 1 -- 172.21.15.84:0/2938333610 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2482759221 0 0) 0x7f9fc415cc60 con 0x7f9fc415c890 2023-07-14T11:17:03.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.234+0000 7f9fc159a700 1 -- 172.21.15.84:0/2938333610 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fac0035b0 con 0x7f9fc415c890 2023-07-14T11:17:03.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.234+0000 7f9fc159a700 1 -- 172.21.15.84:0/2938333610 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1041948152 0 0) 0x7f9fac0035b0 con 0x7f9fc415c890 2023-07-14T11:17:03.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.234+0000 7f9fc2d9d700 1 -- 172.21.15.84:0/2938333610 >> v2:172.21.15.179:3300/0 conn(0x7f9fc40d1160 msgr2=0x7f9fc40cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:03.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.234+0000 7f9fc2d9d700 1 --2- 172.21.15.84:0/2938333610 >> v2:172.21.15.179:3300/0 conn(0x7f9fc40d1160 0x7f9fc40cd4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:03.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.234+0000 7f9fc2d9d700 1 -- 172.21.15.84:0/2938333610 >> v1:172.21.15.84:6789/0 conn(0x7f9fc415c890 legacy=0x7f9fc40d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:03.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.234+0000 7f9fc2d9d700 1 -- 172.21.15.84:0/2938333610 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fc406ba40 con 0x7f9fc40b2440 2023-07-14T11:17:03.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.234+0000 7f9fc1d9b700 1 --2- 172.21.15.84:0/2938333610 >> v2:172.21.15.179:3300/0 conn(0x7f9fc40d1160 0x7f9fc40cd4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:17:03.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.235+0000 7f9fc2d9d700 1 --2- 172.21.15.84:0/2938333610 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fc40b2440 0x7f9fc40cda10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc009d90 tx=0x7f9fbc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c111b483de90f6f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:03.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.235+0000 7f9fc159a700 1 -- 172.21.15.84:0/2938333610 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fbc00e070 con 0x7f9fc40b2440 2023-07-14T11:17:03.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.235+0000 7f9fc159a700 1 -- 172.21.15.84:0/2938333610 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fbc003a20 con 0x7f9fc40b2440 2023-07-14T11:17:03.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.235+0000 7f9fc159a700 1 -- 172.21.15.84:0/2938333610 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb4001670 con 0x7f9fc40b2440 2023-07-14T11:17:03.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.235+0000 7f9fc8dff700 1 -- 172.21.15.84:0/2938333610 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fc40b2440 msgr2=0x7f9fc40cda10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:03.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.235+0000 7f9fc8dff700 1 --2- 172.21.15.84:0/2938333610 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fc40b2440 0x7f9fc40cda10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc009d90 tx=0x7f9fbc00b330 comp rx=0 tx=0).stop 2023-07-14T11:17:03.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.236+0000 7f9fc8dff700 1 -- 172.21.15.84:0/2938333610 shutdown_connections 2023-07-14T11:17:03.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.236+0000 7f9fc8dff700 1 --2- 172.21.15.84:0/2938333610 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fc40b2440 0x7f9fc40cda10 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:03.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.236+0000 7f9fc8dff700 1 --2- 172.21.15.84:0/2938333610 >> v2:172.21.15.179:3300/0 conn(0x7f9fc40d1160 0x7f9fc40cd4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:03.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.236+0000 7f9fc8dff700 1 -- 172.21.15.84:0/2938333610 >> 172.21.15.84:0/2938333610 conn(0x7f9fc409c170 msgr2=0x7f9fc40d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:03.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.236+0000 7f9fc8dff700 1 -- 172.21.15.84:0/2938333610 shutdown_connections 2023-07-14T11:17:03.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.236+0000 7f9fc8dff700 1 -- 172.21.15.84:0/2938333610 wait complete. 2023-07-14T11:17:03.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.237+0000 7f9fc8dff700 1 Processor -- start 2023-07-14T11:17:03.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.238+0000 7f9fc8dff700 1 -- start start 2023-07-14T11:17:03.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.238+0000 7f9fc8dff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9fc40b2440 0x7f9fc40c8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:03.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.238+0000 7f9fc8dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fc40d1160 0x7f9fc4156550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:03.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.239+0000 7f9fc8dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fc415c890 0x7f9fc40b13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:03.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.239+0000 7f9fc8dff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc4156a90 con 0x7f9fc40b2440 2023-07-14T11:17:03.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.239+0000 7f9fc8dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc40c9320 con 0x7f9fc415c890 2023-07-14T11:17:03.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.239+0000 7f9fc8dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc40c9600 con 0x7f9fc40d1160 2023-07-14T11:17:03.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.239+0000 7f9fc259c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9fc40b2440 0x7f9fc40c8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:03.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.239+0000 7f9fc259c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9fc40b2440 0x7f9fc40c8c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46054/0 (socket says 172.21.15.84:46054) 2023-07-14T11:17:03.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.239+0000 7f9fc259c700 1 -- 172.21.15.84:0/3889753998 learned_addr learned my addr 172.21.15.84:0/3889753998 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:03.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.239+0000 7f9fc2d9d700 1 --2- 172.21.15.84:0/3889753998 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fc415c890 0x7f9fc40b13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:03.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.239+0000 7f9fc1d9b700 1 --2- 172.21.15.84:0/3889753998 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fc40d1160 0x7f9fc4156550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:03.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.239+0000 7f9fc259c700 1 -- 172.21.15.84:0/3889753998 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fc40d1160 msgr2=0x7f9fc4156550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:03.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.239+0000 7f9fc259c700 1 --2- 172.21.15.84:0/3889753998 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fc40d1160 0x7f9fc4156550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:03.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.239+0000 7f9fc259c700 1 -- 172.21.15.84:0/3889753998 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fc415c890 msgr2=0x7f9fc40b13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:03.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.239+0000 7f9fc259c700 1 --2- 172.21.15.84:0/3889753998 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fc415c890 0x7f9fc40b13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:03.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.239+0000 7f9fc259c700 1 -- 172.21.15.84:0/3889753998 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fb80094a0 con 0x7f9fc40b2440 2023-07-14T11:17:03.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.239+0000 7f9fc259c700 1 --2- 172.21.15.84:0/3889753998 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9fc40b2440 0x7f9fc40c8c20 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f9fb40011e0 tx=0x7f9fb400ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:03.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.240+0000 7f9fb2ffd700 1 -- 172.21.15.84:0/3889753998 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb4004c80 con 0x7f9fc40b2440 2023-07-14T11:17:03.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.240+0000 7f9fb2ffd700 1 -- 172.21.15.84:0/3889753998 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fb4004de0 con 0x7f9fc40b2440 2023-07-14T11:17:03.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.240+0000 7f9fc8dff700 1 -- 172.21.15.84:0/3889753998 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fbc009a70 con 0x7f9fc40b2440 2023-07-14T11:17:03.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.240+0000 7f9fb2ffd700 1 -- 172.21.15.84:0/3889753998 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb40072d0 con 0x7f9fc40b2440 2023-07-14T11:17:03.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.240+0000 7f9fc8dff700 1 -- 172.21.15.84:0/3889753998 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fc40b7a50 con 0x7f9fc40b2440 2023-07-14T11:17:03.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.241+0000 7f9fc8dff700 1 -- 172.21.15.84:0/3889753998 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fc40b7c10 con 0x7f9fc40b2440 2023-07-14T11:17:03.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.242+0000 7f9fb2ffd700 1 -- 172.21.15.84:0/3889753998 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 9) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f9fb4007430 con 0x7f9fc40b2440 2023-07-14T11:17:03.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.243+0000 7f9fb2ffd700 1 --2- 172.21.15.84:0/3889753998 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f9fa406ae90 0x7f9fa406d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:03.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.243+0000 7f9fb2ffd700 1 -- 172.21.15.84:0/3889753998 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5768+0+0 (secure 0 0 0) 0x7f9fb4089480 con 0x7f9fc40b2440 2023-07-14T11:17:03.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.243+0000 7f9fc1d9b700 1 --2- 172.21.15.84:0/3889753998 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f9fa406ae90 0x7f9fa406d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:03.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.244+0000 7f9fc1d9b700 1 --2- 172.21.15.84:0/3889753998 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f9fa406ae90 0x7f9fa406d340 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f9fc41f56c0 tx=0x7f9fb8009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:03.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.247+0000 7f9fb2ffd700 1 -- 172.21.15.84:0/3889753998 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f9fb40543c0 con 0x7f9fc40b2440 2023-07-14T11:17:03.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:03.440+0000 7f9fc8dff700 1 -- 172.21.15.84:0/3889753998 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9fc40c97c0 con 0x7f9fc40b2440 2023-07-14T11:17:04.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.008+0000 7f9fb2ffd700 1 -- 172.21.15.84:0/3889753998 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v55) v1 ==== 169+0+0 (secure 0 0 0) 0x7f9fb40579e0 con 0x7f9fc40b2440 2023-07-14T11:17:04.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.012+0000 7f9fc8dff700 1 -- 172.21.15.84:0/3889753998 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f9fa406ae90 msgr2=0x7f9fa406d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:04.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.012+0000 7f9fc8dff700 1 --2- 172.21.15.84:0/3889753998 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f9fa406ae90 0x7f9fa406d340 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f9fc41f56c0 tx=0x7f9fb8009210 comp rx=0 tx=0).stop 2023-07-14T11:17:04.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.012+0000 7f9fc8dff700 1 -- 172.21.15.84:0/3889753998 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9fc40b2440 msgr2=0x7f9fc40c8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:04.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.012+0000 7f9fc8dff700 1 --2- 172.21.15.84:0/3889753998 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9fc40b2440 0x7f9fc40c8c20 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f9fb40011e0 tx=0x7f9fb400ca50 comp rx=0 tx=0).stop 2023-07-14T11:17:04.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.012+0000 7f9fc8dff700 1 -- 172.21.15.84:0/3889753998 shutdown_connections 2023-07-14T11:17:04.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.012+0000 7f9fc8dff700 1 --2- 172.21.15.84:0/3889753998 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fc415c890 0x7f9fc40b13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:04.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.012+0000 7f9fc8dff700 1 --2- 172.21.15.84:0/3889753998 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9fc40b2440 0x7f9fc40c8c20 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:04.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.012+0000 7f9fc8dff700 1 --2- 172.21.15.84:0/3889753998 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f9fa406ae90 0x7f9fa406d340 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:04.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.012+0000 7f9fc8dff700 1 --2- 172.21.15.84:0/3889753998 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fc40d1160 0x7f9fc4156550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:04.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.012+0000 7f9fc8dff700 1 -- 172.21.15.84:0/3889753998 >> 172.21.15.84:0/3889753998 conn(0x7f9fc409c170 msgr2=0x7f9fc415ae90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:04.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.012+0000 7f9fc8dff700 1 -- 172.21.15.84:0/3889753998 shutdown_connections 2023-07-14T11:17:04.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.012+0000 7f9fc8dff700 1 -- 172.21.15.84:0/3889753998 wait complete. 2023-07-14T11:17:04.019 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data' removed 2023-07-14T11:17:04.035 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-14T11:17:04.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.229+0000 7fcc069ff700 1 Processor -- start 2023-07-14T11:17:04.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.229+0000 7fcc069ff700 1 -- start start 2023-07-14T11:17:04.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.230+0000 7fcc069ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fcc000d0b10 0x7fcc000d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:04.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.231+0000 7fcc069ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc000b8e30 con 0x7fcc000b8a60 2023-07-14T11:17:04.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.231+0000 7fcc069ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc000afaa0 con 0x7fcc000b0e20 2023-07-14T11:17:04.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.231+0000 7fcc069ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc000d14d0 con 0x7fcc000d0b10 2023-07-14T11:17:04.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.231+0000 7fcbfffff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fcc000b8a60 0x7fcc000b3ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:39246/0 (socket says 172.21.15.84:39246) 2023-07-14T11:17:04.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.231+0000 7fcbfffff700 1 -- 172.21.15.84:0/941036207 learned_addr learned my addr 172.21.15.84:0/941036207 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:17:04.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.231+0000 7fcbff7fe700 1 --2- 172.21.15.84:0/941036207 >> v2:172.21.15.179:3300/0 conn(0x7fcc000d0b10 0x7fcc000d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:04.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.231+0000 7fcbfeffd700 1 -- 172.21.15.84:0/941036207 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3756737874 0 0) 0x7fcc000b8e30 con 0x7fcc000b8a60 2023-07-14T11:17:04.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.231+0000 7fcbfeffd700 1 -- 172.21.15.84:0/941036207 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbe80035b0 con 0x7fcc000b8a60 2023-07-14T11:17:04.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.232+0000 7fcbfeffd700 1 -- 172.21.15.84:0/941036207 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1625736226 0 0) 0x7fcc000afaa0 con 0x7fcc000b0e20 2023-07-14T11:17:04.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.232+0000 7fcbfeffd700 1 -- 172.21.15.84:0/941036207 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc000b8e30 con 0x7fcc000b0e20 2023-07-14T11:17:04.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.232+0000 7fcbfeffd700 1 -- 172.21.15.84:0/941036207 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2868462179 0 0) 0x7fcbe80035b0 con 0x7fcc000b8a60 2023-07-14T11:17:04.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.232+0000 7fcbfeffd700 1 -- 172.21.15.84:0/941036207 >> v2:172.21.15.179:3300/0 conn(0x7fcc000d0b10 msgr2=0x7fcc000d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:04.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.232+0000 7fcbfeffd700 1 --2- 172.21.15.84:0/941036207 >> v2:172.21.15.179:3300/0 conn(0x7fcc000d0b10 0x7fcc000d0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:04.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.232+0000 7fcbfeffd700 1 -- 172.21.15.84:0/941036207 >> v1:172.21.15.179:6789/0 conn(0x7fcc000b0e20 legacy=0x7fcc000b1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:04.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.232+0000 7fcbfeffd700 1 -- 172.21.15.84:0/941036207 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc000afd80 con 0x7fcc000b8a60 2023-07-14T11:17:04.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.232+0000 7fcbfeffd700 1 -- 172.21.15.84:0/941036207 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7fcbf0001670 con 0x7fcc000b8a60 2023-07-14T11:17:04.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.232+0000 7fcbfeffd700 1 -- 172.21.15.84:0/941036207 >> v1:172.21.15.84:6789/0 conn(0x7fcc000b8a60 legacy=0x7fcc000b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:04.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.232+0000 7fcbfeffd700 1 --2- 172.21.15.84:0/941036207 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcbe8003b90 0x7fcbe8003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:04.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.232+0000 7fcbfeffd700 1 --2- 172.21.15.84:0/941036207 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcbe8004850 0x7fcbe8004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:04.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.232+0000 7fcbfeffd700 1 --2- 172.21.15.84:0/941036207 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcbe8005200 0x7fcbe800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:04.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.232+0000 7fcbfeffd700 1 -- 172.21.15.84:0/941036207 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc000d14d0 con 0x7fcbe8004850 2023-07-14T11:17:04.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.232+0000 7fcbfeffd700 1 -- 172.21.15.84:0/941036207 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe800c000 con 0x7fcbe8005200 2023-07-14T11:17:04.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.232+0000 7fcbfeffd700 1 -- 172.21.15.84:0/941036207 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe800c190 con 0x7fcbe8003b90 2023-07-14T11:17:04.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.232+0000 7fcbff7fe700 1 --2- 172.21.15.84:0/941036207 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcbe8004850 0x7fcbe8004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:04.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.232+0000 7fcbfffff700 1 --2- 172.21.15.84:0/941036207 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcbe8003b90 0x7fcbe8003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:04.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.232+0000 7fcc04f9c700 1 --2- 172.21.15.84:0/941036207 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcbe8005200 0x7fcbe800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:04.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.232+0000 7fcbff7fe700 1 -- 172.21.15.84:0/941036207 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcbe8003b90 msgr2=0x7fcbe8003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:04.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.232+0000 7fcbff7fe700 1 --2- 172.21.15.84:0/941036207 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcbe8003b90 0x7fcbe8003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:04.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.232+0000 7fcbff7fe700 1 -- 172.21.15.84:0/941036207 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcbe8005200 msgr2=0x7fcbe800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:04.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.232+0000 7fcbff7fe700 1 --2- 172.21.15.84:0/941036207 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcbe8005200 0x7fcbe800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:04.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.232+0000 7fcc04f9c700 1 -- 172.21.15.84:0/941036207 reap_dead start 2023-07-14T11:17:04.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.232+0000 7fcbff7fe700 1 -- 172.21.15.84:0/941036207 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbe80035b0 con 0x7fcbe8004850 2023-07-14T11:17:04.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.232+0000 7fcbfffff700 1 --2- 172.21.15.84:0/941036207 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcbe8003b90 0x7fcbe8003f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:17:04.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.233+0000 7fcbff7fe700 1 --2- 172.21.15.84:0/941036207 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcbe8004850 0x7fcbe8004cc0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fcbf4009b60 tx=0x7fcbe8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1341578f80b21362 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:04.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.233+0000 7fcbfeffd700 1 -- 172.21.15.84:0/941036207 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf400e6c0 con 0x7fcbe8004850 2023-07-14T11:17:04.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.233+0000 7fcbfeffd700 1 -- 172.21.15.84:0/941036207 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbf400e820 con 0x7fcbe8004850 2023-07-14T11:17:04.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.233+0000 7fcbfeffd700 1 -- 172.21.15.84:0/941036207 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf400eb90 con 0x7fcbe8004850 2023-07-14T11:17:04.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.233+0000 7fcc069ff700 1 -- 172.21.15.84:0/941036207 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcbe8004850 msgr2=0x7fcbe8004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:04.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.233+0000 7fcc069ff700 1 --2- 172.21.15.84:0/941036207 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcbe8004850 0x7fcbe8004cc0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fcbf4009b60 tx=0x7fcbe8005880 comp rx=0 tx=0).stop 2023-07-14T11:17:04.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.234+0000 7fcc069ff700 1 -- 172.21.15.84:0/941036207 shutdown_connections 2023-07-14T11:17:04.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.234+0000 7fcc069ff700 1 --2- 172.21.15.84:0/941036207 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcbe8004850 0x7fcbe8004cc0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:04.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.234+0000 7fcc069ff700 1 -- 172.21.15.84:0/941036207 >> 172.21.15.84:0/941036207 conn(0x7fcc0009c1b0 msgr2=0x7fcc000d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:04.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.234+0000 7fcc069ff700 1 -- 172.21.15.84:0/941036207 shutdown_connections 2023-07-14T11:17:04.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.234+0000 7fcc069ff700 1 -- 172.21.15.84:0/941036207 wait complete. 2023-07-14T11:17:04.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.235+0000 7fcc069ff700 1 Processor -- start 2023-07-14T11:17:04.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.235+0000 7fcc069ff700 1 -- start start 2023-07-14T11:17:04.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.236+0000 7fcc069ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcbe8004850 0x7fcc001f19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:04.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.236+0000 7fcc069ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc0015f8b0 0x7fcc000cd570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:04.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.236+0000 7fcc069ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc0015b070 0x7fcc0015b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:04.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.236+0000 7fcc069ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc000d0440 con 0x7fcc0015f8b0 2023-07-14T11:17:04.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.236+0000 7fcc069ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0015ba20 con 0x7fcc0015b070 2023-07-14T11:17:04.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.236+0000 7fcc069ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0015fe50 con 0x7fcbe8004850 2023-07-14T11:17:04.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.237+0000 7fcbff7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc0015f8b0 0x7fcc000cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:04.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.237+0000 7fcbff7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc0015f8b0 0x7fcc000cd570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46080/0 (socket says 172.21.15.84:46080) 2023-07-14T11:17:04.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.237+0000 7fcbff7fe700 1 -- 172.21.15.84:0/1356826690 learned_addr learned my addr 172.21.15.84:0/1356826690 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:04.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.237+0000 7fcbfffff700 1 --2- 172.21.15.84:0/1356826690 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcbe8004850 0x7fcc001f19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:04.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.237+0000 7fcc04f9c700 1 --2- 172.21.15.84:0/1356826690 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc0015b070 0x7fcc0015b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:04.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.237+0000 7fcbff7fe700 1 -- 172.21.15.84:0/1356826690 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcbe8004850 msgr2=0x7fcc001f19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:04.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.237+0000 7fcbff7fe700 1 --2- 172.21.15.84:0/1356826690 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcbe8004850 0x7fcc001f19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:04.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.237+0000 7fcbff7fe700 1 -- 172.21.15.84:0/1356826690 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc0015b070 msgr2=0x7fcc0015b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:04.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.237+0000 7fcbff7fe700 1 --2- 172.21.15.84:0/1356826690 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc0015b070 0x7fcc0015b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:04.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.237+0000 7fcbff7fe700 1 -- 172.21.15.84:0/1356826690 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc000cfaa0 con 0x7fcc0015f8b0 2023-07-14T11:17:04.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.237+0000 7fcbff7fe700 1 --2- 172.21.15.84:0/1356826690 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc0015f8b0 0x7fcc000cd570 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fcbe8005800 tx=0x7fcbf40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:04.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.237+0000 7fcbfcff9700 1 -- 172.21.15.84:0/1356826690 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf400e6c0 con 0x7fcc0015f8b0 2023-07-14T11:17:04.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.238+0000 7fcbfcff9700 1 -- 172.21.15.84:0/1356826690 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbf4003ad0 con 0x7fcc0015f8b0 2023-07-14T11:17:04.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.238+0000 7fcc069ff700 1 -- 172.21.15.84:0/1356826690 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc000cfd80 con 0x7fcc0015f8b0 2023-07-14T11:17:04.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.238+0000 7fcbfcff9700 1 -- 172.21.15.84:0/1356826690 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf4003e80 con 0x7fcc0015f8b0 2023-07-14T11:17:04.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.238+0000 7fcc069ff700 1 -- 172.21.15.84:0/1356826690 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc0015f600 con 0x7fcc0015f8b0 2023-07-14T11:17:04.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.239+0000 7fcc069ff700 1 -- 172.21.15.84:0/1356826690 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc00074350 con 0x7fcc0015f8b0 2023-07-14T11:17:04.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.239+0000 7fcbfcff9700 1 -- 172.21.15.84:0/1356826690 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 9) v1 ==== 89190+0+0 (secure 0 0 0) 0x7fcbf4013470 con 0x7fcc0015f8b0 2023-07-14T11:17:04.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.240+0000 7fcbfcff9700 1 --2- 172.21.15.84:0/1356826690 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fcbec06ae90 0x7fcbec06d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:04.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.240+0000 7fcbfcff9700 1 -- 172.21.15.84:0/1356826690 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fcbf408ab70 con 0x7fcc0015f8b0 2023-07-14T11:17:04.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.240+0000 7fcbfffff700 1 --2- 172.21.15.84:0/1356826690 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fcbec06ae90 0x7fcbec06d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:04.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.241+0000 7fcbfffff700 1 --2- 172.21.15.84:0/1356826690 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fcbec06ae90 0x7fcbec06d340 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fcbf00010e0 tx=0x7fcbf0007040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:04.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.244+0000 7fcbfcff9700 1 -- 172.21.15.84:0/1356826690 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fcbf4055dd0 con 0x7fcc0015f8b0 2023-07-14T11:17:04.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.438+0000 7fcc069ff700 1 -- 172.21.15.84:0/1356826690 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fcc0015c980 con 0x7fcc0015f8b0 2023-07-14T11:17:04.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.443+0000 7fcbfcff9700 1 -- 172.21.15.84:0/1356826690 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7fcbf40593f0 con 0x7fcc0015f8b0 2023-07-14T11:17:04.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.445+0000 7fcc069ff700 1 -- 172.21.15.84:0/1356826690 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fcbec06ae90 msgr2=0x7fcbec06d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:04.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.445+0000 7fcc069ff700 1 --2- 172.21.15.84:0/1356826690 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fcbec06ae90 0x7fcbec06d340 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fcbf00010e0 tx=0x7fcbf0007040 comp rx=0 tx=0).stop 2023-07-14T11:17:04.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.445+0000 7fcc069ff700 1 -- 172.21.15.84:0/1356826690 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc0015f8b0 msgr2=0x7fcc000cd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:04.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.445+0000 7fcc069ff700 1 --2- 172.21.15.84:0/1356826690 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc0015f8b0 0x7fcc000cd570 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fcbe8005800 tx=0x7fcbf40047c0 comp rx=0 tx=0).stop 2023-07-14T11:17:04.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.445+0000 7fcc069ff700 1 -- 172.21.15.84:0/1356826690 shutdown_connections 2023-07-14T11:17:04.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.445+0000 7fcc069ff700 1 --2- 172.21.15.84:0/1356826690 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fcbec06ae90 0x7fcbec06d340 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:04.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.445+0000 7fcc069ff700 1 --2- 172.21.15.84:0/1356826690 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcbe8004850 0x7fcc001f19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:04.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.445+0000 7fcc069ff700 1 --2- 172.21.15.84:0/1356826690 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc0015b070 0x7fcc0015b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:04.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.445+0000 7fcc069ff700 1 --2- 172.21.15.84:0/1356826690 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc0015f8b0 0x7fcc000cd570 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:04.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.445+0000 7fcc069ff700 1 -- 172.21.15.84:0/1356826690 >> 172.21.15.84:0/1356826690 conn(0x7fcc0009c1b0 msgr2=0x7fcc000b39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:04.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.445+0000 7fcc069ff700 1 -- 172.21.15.84:0/1356826690 shutdown_connections 2023-07-14T11:17:04.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.445+0000 7fcc069ff700 1 -- 172.21.15.84:0/1356826690 wait complete. 2023-07-14T11:17:04.466 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_connection_expiration' 2023-07-14T11:17:04.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.662+0000 7fbe329ff700 1 Processor -- start 2023-07-14T11:17:04.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.663+0000 7fbe329ff700 1 -- start start 2023-07-14T11:17:04.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.664+0000 7fbe329ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbe2c160030 0x7fbe2c06c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:04.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.664+0000 7fbe329ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbe2c0b5cd0 0x7fbe2c0d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:04.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.664+0000 7fbe329ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe2c0b1f70 0x7fbe2c0d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:04.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.664+0000 7fbe329ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe2c0d2cc0 con 0x7fbe2c160030 2023-07-14T11:17:04.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.664+0000 7fbe329ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe2c0afbb0 con 0x7fbe2c0b5cd0 2023-07-14T11:17:04.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.664+0000 7fbe329ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2c0afe90 con 0x7fbe2c0b1f70 2023-07-14T11:17:04.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.664+0000 7fbe2bfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbe2c160030 0x7fbe2c06c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:04.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.664+0000 7fbe2bfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbe2c160030 0x7fbe2c06c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46084/0 (socket says 172.21.15.84:46084) 2023-07-14T11:17:04.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.664+0000 7fbe2bfff700 1 -- 172.21.15.84:0/2885082895 learned_addr learned my addr 172.21.15.84:0/2885082895 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:04.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.664+0000 7fbe30f9c700 1 --2- 172.21.15.84:0/2885082895 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe2c0b1f70 0x7fbe2c0d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:04.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.664+0000 7fbe2b7fe700 1 --2- 172.21.15.84:0/2885082895 >> v2:172.21.15.179:3300/0 conn(0x7fbe2c0b5cd0 0x7fbe2c0d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:04.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.664+0000 7fbe2bfff700 1 -- 172.21.15.84:0/2885082895 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe2c0b1f70 msgr2=0x7fbe2c0d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:04.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.664+0000 7fbe2bfff700 1 --2- 172.21.15.84:0/2885082895 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe2c0b1f70 0x7fbe2c0d0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:04.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.664+0000 7fbe2bfff700 1 -- 172.21.15.84:0/2885082895 >> v2:172.21.15.179:3300/0 conn(0x7fbe2c0b5cd0 msgr2=0x7fbe2c0d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:04.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.664+0000 7fbe2bfff700 1 --2- 172.21.15.84:0/2885082895 >> v2:172.21.15.179:3300/0 conn(0x7fbe2c0b5cd0 0x7fbe2c0d0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:04.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.664+0000 7fbe2bfff700 1 -- 172.21.15.84:0/2885082895 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe2c0b0170 con 0x7fbe2c160030 2023-07-14T11:17:04.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.665+0000 7fbe2bfff700 1 --2- 172.21.15.84:0/2885082895 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe2c160030 0x7fbe2c06c0f0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c072140 tx=0x7fbe1c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2942205ec3dac1a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:04.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.665+0000 7fbe2affd700 1 -- 172.21.15.84:0/2885082895 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe1c00b870 con 0x7fbe2c160030 2023-07-14T11:17:04.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.665+0000 7fbe2affd700 1 -- 172.21.15.84:0/2885082895 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe1c00b9d0 con 0x7fbe2c160030 2023-07-14T11:17:04.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.665+0000 7fbe2affd700 1 -- 172.21.15.84:0/2885082895 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe1c00bd60 con 0x7fbe2c160030 2023-07-14T11:17:04.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.665+0000 7fbe329ff700 1 -- 172.21.15.84:0/2885082895 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe2c160030 msgr2=0x7fbe2c06c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:04.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.665+0000 7fbe329ff700 1 --2- 172.21.15.84:0/2885082895 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe2c160030 0x7fbe2c06c0f0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c072140 tx=0x7fbe1c009bd0 comp rx=0 tx=0).stop 2023-07-14T11:17:04.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.666+0000 7fbe329ff700 1 -- 172.21.15.84:0/2885082895 shutdown_connections 2023-07-14T11:17:04.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.666+0000 7fbe329ff700 1 --2- 172.21.15.84:0/2885082895 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe2c0b1f70 0x7fbe2c0d0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:04.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.666+0000 7fbe329ff700 1 --2- 172.21.15.84:0/2885082895 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe2c160030 0x7fbe2c06c0f0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:04.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.666+0000 7fbe329ff700 1 --2- 172.21.15.84:0/2885082895 >> v2:172.21.15.179:3300/0 conn(0x7fbe2c0b5cd0 0x7fbe2c0d0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:04.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.666+0000 7fbe329ff700 1 -- 172.21.15.84:0/2885082895 >> 172.21.15.84:0/2885082895 conn(0x7fbe2c09c190 msgr2=0x7fbe2c0d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:04.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.666+0000 7fbe329ff700 1 -- 172.21.15.84:0/2885082895 shutdown_connections 2023-07-14T11:17:04.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.666+0000 7fbe329ff700 1 -- 172.21.15.84:0/2885082895 wait complete. 2023-07-14T11:17:04.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.667+0000 7fbe329ff700 1 Processor -- start 2023-07-14T11:17:04.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.668+0000 7fbe329ff700 1 -- start start 2023-07-14T11:17:04.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.668+0000 7fbe329ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe2c0b1f70 0x7fbe2c1561a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:04.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.669+0000 7fbe329ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe2c0b5cd0 0x7fbe2c1585f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:04.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.669+0000 7fbe329ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe2c160030 0x7fbe2c149150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:04.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.669+0000 7fbe329ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2c157110 con 0x7fbe2c0b5cd0 2023-07-14T11:17:04.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.669+0000 7fbe329ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2c158b30 con 0x7fbe2c0b1f70 2023-07-14T11:17:04.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.669+0000 7fbe329ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2c158dd0 con 0x7fbe2c160030 2023-07-14T11:17:04.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.669+0000 7fbe2b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe2c0b5cd0 0x7fbe2c1585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:04.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.669+0000 7fbe2b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe2c0b5cd0 0x7fbe2c1585f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46094/0 (socket says 172.21.15.84:46094) 2023-07-14T11:17:04.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.669+0000 7fbe2b7fe700 1 -- 172.21.15.84:0/1937507616 learned_addr learned my addr 172.21.15.84:0/1937507616 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:04.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.669+0000 7fbe2bfff700 1 --2- 172.21.15.84:0/1937507616 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe2c0b1f70 0x7fbe2c1561a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:04.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.669+0000 7fbe30f9c700 1 --2- 172.21.15.84:0/1937507616 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe2c160030 0x7fbe2c149150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:04.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.669+0000 7fbe2b7fe700 1 -- 172.21.15.84:0/1937507616 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe2c160030 msgr2=0x7fbe2c149150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:04.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.669+0000 7fbe2b7fe700 1 --2- 172.21.15.84:0/1937507616 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe2c160030 0x7fbe2c149150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:04.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.669+0000 7fbe2b7fe700 1 -- 172.21.15.84:0/1937507616 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe2c0b1f70 msgr2=0x7fbe2c1561a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:04.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.669+0000 7fbe2b7fe700 1 --2- 172.21.15.84:0/1937507616 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe2c0b1f70 0x7fbe2c1561a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:04.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.669+0000 7fbe2b7fe700 1 -- 172.21.15.84:0/1937507616 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe1c009550 con 0x7fbe2c0b5cd0 2023-07-14T11:17:04.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.669+0000 7fbe2bfff700 1 --2- 172.21.15.84:0/1937507616 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe2c0b1f70 0x7fbe2c1561a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:17:04.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.669+0000 7fbe2b7fe700 1 --2- 172.21.15.84:0/1937507616 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe2c0b5cd0 0x7fbe2c1585f0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fbe2000e810 tx=0x7fbe2000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:04.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.670+0000 7fbe28ff9700 1 -- 172.21.15.84:0/1937507616 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe20013610 con 0x7fbe2c0b5cd0 2023-07-14T11:17:04.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.670+0000 7fbe28ff9700 1 -- 172.21.15.84:0/1937507616 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe20013770 con 0x7fbe2c0b5cd0 2023-07-14T11:17:04.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.670+0000 7fbe329ff700 1 -- 172.21.15.84:0/1937507616 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe2c1590b0 con 0x7fbe2c0b5cd0 2023-07-14T11:17:04.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.670+0000 7fbe28ff9700 1 -- 172.21.15.84:0/1937507616 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe20013b20 con 0x7fbe2c0b5cd0 2023-07-14T11:17:04.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.670+0000 7fbe329ff700 1 -- 172.21.15.84:0/1937507616 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe2c159670 con 0x7fbe2c0b5cd0 2023-07-14T11:17:04.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.671+0000 7fbe329ff700 1 -- 172.21.15.84:0/1937507616 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe2c159cc0 con 0x7fbe2c0b5cd0 2023-07-14T11:17:04.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.672+0000 7fbe28ff9700 1 -- 172.21.15.84:0/1937507616 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 9) v1 ==== 89190+0+0 (secure 0 0 0) 0x7fbe20013c80 con 0x7fbe2c0b5cd0 2023-07-14T11:17:04.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.673+0000 7fbe28ff9700 1 --2- 172.21.15.84:0/1937507616 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fbe1806ae90 0x7fbe1806d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:04.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.673+0000 7fbe28ff9700 1 -- 172.21.15.84:0/1937507616 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fbe20089360 con 0x7fbe2c0b5cd0 2023-07-14T11:17:04.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.673+0000 7fbe2bfff700 1 --2- 172.21.15.84:0/1937507616 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fbe1806ae90 0x7fbe1806d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:04.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.673+0000 7fbe2bfff700 1 --2- 172.21.15.84:0/1937507616 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fbe1806ae90 0x7fbe1806d340 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c014040 tx=0x7fbe1c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:04.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.677+0000 7fbe28ff9700 1 -- 172.21.15.84:0/1937507616 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fbe20054310 con 0x7fbe2c0b5cd0 2023-07-14T11:17:04.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:04.958+0000 7fbe329ff700 1 -- 172.21.15.84:0/1937507616 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_connection_expiration"]} v 0) v1 -- 0x7fbe2c04e280 con 0x7fbe2c0b5cd0 2023-07-14T11:17:05.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:05.018+0000 7fbe28ff9700 1 -- 172.21.15.84:0/1937507616 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_connection_expiration"]}]=0 v217) v1 ==== 140+0+0 (secure 0 0 0) 0x7fbe20057930 con 0x7fbe2c0b5cd0 2023-07-14T11:17:05.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:05.020+0000 7fbe329ff700 1 -- 172.21.15.84:0/1937507616 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fbe1806ae90 msgr2=0x7fbe1806d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:05.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:05.020+0000 7fbe329ff700 1 --2- 172.21.15.84:0/1937507616 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fbe1806ae90 0x7fbe1806d340 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c014040 tx=0x7fbe1c008030 comp rx=0 tx=0).stop 2023-07-14T11:17:05.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:05.020+0000 7fbe329ff700 1 -- 172.21.15.84:0/1937507616 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe2c0b5cd0 msgr2=0x7fbe2c1585f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:05.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:05.020+0000 7fbe329ff700 1 --2- 172.21.15.84:0/1937507616 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe2c0b5cd0 0x7fbe2c1585f0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fbe2000e810 tx=0x7fbe2000ebd0 comp rx=0 tx=0).stop 2023-07-14T11:17:05.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:05.020+0000 7fbe329ff700 1 -- 172.21.15.84:0/1937507616 shutdown_connections 2023-07-14T11:17:05.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:05.020+0000 7fbe329ff700 1 --2- 172.21.15.84:0/1937507616 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fbe1806ae90 0x7fbe1806d340 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:05.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:05.020+0000 7fbe329ff700 1 --2- 172.21.15.84:0/1937507616 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe2c160030 0x7fbe2c149150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:05.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:05.020+0000 7fbe329ff700 1 --2- 172.21.15.84:0/1937507616 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe2c0b1f70 0x7fbe2c1561a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:05.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:05.020+0000 7fbe329ff700 1 --2- 172.21.15.84:0/1937507616 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe2c0b5cd0 0x7fbe2c1585f0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:05.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:05.020+0000 7fbe329ff700 1 -- 172.21.15.84:0/1937507616 >> 172.21.15.84:0/1937507616 conn(0x7fbe2c09c190 msgr2=0x7fbe2c0d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:05.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:05.021+0000 7fbe329ff700 1 -- 172.21.15.84:0/1937507616 shutdown_connections 2023-07-14T11:17:05.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:05.021+0000 7fbe329ff700 1 -- 172.21.15.84:0/1937507616 wait complete. 2023-07-14T11:17:05.042 INFO:tasks.cephfs_test_runner:test_connection_expiration (tasks.cephfs.test_volumes.TestMisc) ... ok 2023-07-14T11:17:05.043 INFO:tasks.cephfs_test_runner:Starting test: test_malicious_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) 2023-07-14T11:17:05.043 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_malicious_metafile_on_legacy_to_v1_upgrade' 2023-07-14T11:17:05.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:05.237+0000 7febf5fff700 1 Processor -- start 2023-07-14T11:17:05.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:05.237+0000 7febf5fff700 1 -- start start 2023-07-14T11:17:05.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:05.238+0000 7febf5fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7febf00cd460 0x7febf00d1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:05.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:05.238+0000 7febf5fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7febf015cb40 0x7febf00b5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:05.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:05.238+0000 7febf5fff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febf00d0d10 con 0x7febf00b1b70 2023-07-14T11:17:05.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:05.238+0000 7febf5fff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febf00d0ff0 con 0x7febf00cd460 2023-07-14T11:17:05.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:05.238+0000 7febf5fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febf00d12d0 con 0x7febf015cb40 2023-07-14T11:17:05.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:05.239+0000 7febef7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7febf00cd460 0x7febf00d1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:05.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:05.239+0000 7febeeffd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7febf00b1b70 0x7febf00cd830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:39256/0 (socket says 172.21.15.84:39256) 2023-07-14T11:17:05.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:05.239+0000 7febeeffd700 1 -- 172.21.15.84:0/4158795628 learned_addr learned my addr 172.21.15.84:0/4158795628 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:17:05.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:05.239+0000 7febef7fe700 1 -- 172.21.15.84:0/4158795628 >> v2:172.21.15.179:3300/0 conn(0x7febf015cb40 msgr2=0x7febf00b5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:05.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:05.239+0000 7febeffff700 1 --2- 172.21.15.84:0/4158795628 >> v2:172.21.15.179:3300/0 conn(0x7febf015cb40 0x7febf00b5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:05.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:05.239+0000 7febee7fc700 1 -- 172.21.15.84:0/4158795628 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1855347838 0 0) 0x7febf00d0d10 con 0x7febf00b1b70 2023-07-14T11:17:05.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:05.239+0000 7febef7fe700 1 --2- 172.21.15.84:0/4158795628 >> v2:172.21.15.179:3300/0 conn(0x7febf015cb40 0x7febf00b5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:05.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:05.239+0000 7febef7fe700 1 -- 172.21.15.84:0/4158795628 >> v1:172.21.15.84:6789/0 conn(0x7febf00b1b70 legacy=0x7febf00cd830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:05.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:05.239+0000 7febef7fe700 1 -- 172.21.15.84:0/4158795628 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf00d15b0 con 0x7febf00cd460 2023-07-14T11:17:05.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:05.239+0000 7febeffff700 1 --2- 172.21.15.84:0/4158795628 >> v2:172.21.15.179:3300/0 conn(0x7febf015cb40 0x7febf00b5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:17:05.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:05.239+0000 7febef7fe700 1 --2- 172.21.15.84:0/4158795628 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febf00cd460 0x7febf00d1db0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7febf006c920 tx=0x7febe0009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a66a5bdc07c2d97c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:05.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:05.240+0000 7febee7fc700 1 -- 172.21.15.84:0/4158795628 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe0011830 con 0x7febf00cd460 2023-07-14T11:17:05.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:05.240+0000 7febee7fc700 1 -- 172.21.15.84:0/4158795628 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe0011990 con 0x7febf00cd460 2023-07-14T11:17:05.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:05.240+0000 7febee7fc700 1 -- 172.21.15.84:0/4158795628 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe0011d20 con 0x7febf00cd460 2023-07-14T11:17:05.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:05.240+0000 7febf5fff700 1 -- 172.21.15.84:0/4158795628 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febf00cd460 msgr2=0x7febf00d1db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:05.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:05.240+0000 7febf5fff700 1 --2- 172.21.15.84:0/4158795628 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febf00cd460 0x7febf00d1db0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7febf006c920 tx=0x7febe0009b20 comp rx=0 tx=0).stop 2023-07-14T11:17:05.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:05.240+0000 7febf5fff700 1 -- 172.21.15.84:0/4158795628 shutdown_connections 2023-07-14T11:17:05.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:05.240+0000 7febf5fff700 1 --2- 172.21.15.84:0/4158795628 >> v2:172.21.15.179:3300/0 conn(0x7febf015cb40 0x7febf00b5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:05.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:05.240+0000 7febf5fff700 1 --2- 172.21.15.84:0/4158795628 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febf00cd460 0x7febf00d1db0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:05.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:05.240+0000 7febf5fff700 1 -- 172.21.15.84:0/4158795628 >> 172.21.15.84:0/4158795628 conn(0x7febf006a680 msgr2=0x7febf006aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:05.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:05.240+0000 7febf5fff700 1 -- 172.21.15.84:0/4158795628 shutdown_connections 2023-07-14T11:17:05.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:05.240+0000 7febf5fff700 1 -- 172.21.15.84:0/4158795628 wait complete. 2023-07-14T11:17:05.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:05.242+0000 7febf5fff700 1 Processor -- start 2023-07-14T11:17:05.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:05.242+0000 7febf5fff700 1 -- start start 2023-07-14T11:17:05.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:05.243+0000 7febf5fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febf00b1b70 0x7febf00c6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:05.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:05.243+0000 7febf5fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7febf00cd460 0x7febf00ca190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:05.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:05.243+0000 7febf5fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febf015cb40 0x7febf00c8e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:05.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:05.243+0000 7febf5fff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf015d6a0 con 0x7febf00b1b70 2023-07-14T11:17:05.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:05.243+0000 7febf5fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf00c83c0 con 0x7febf00cd460 2023-07-14T11:17:05.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:05.243+0000 7febf5fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febf015d0e0 con 0x7febf015cb40 2023-07-14T11:17:05.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:05.243+0000 7febef7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febf00b1b70 0x7febf00c6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:05.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:05.243+0000 7febef7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febf00b1b70 0x7febf00c6940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46118/0 (socket says 172.21.15.84:46118) 2023-07-14T11:17:05.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:05.243+0000 7febef7fe700 1 -- 172.21.15.84:0/748506272 learned_addr learned my addr 172.21.15.84:0/748506272 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:05.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:05.244+0000 7febeeffd700 1 --2- 172.21.15.84:0/748506272 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7febf00cd460 0x7febf00ca190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:05.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:05.244+0000 7febeffff700 1 --2- 172.21.15.84:0/748506272 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febf015cb40 0x7febf00c8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:05.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:05.244+0000 7febef7fe700 1 -- 172.21.15.84:0/748506272 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febf015cb40 msgr2=0x7febf00c8e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:05.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:05.244+0000 7febef7fe700 1 --2- 172.21.15.84:0/748506272 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febf015cb40 0x7febf00c8e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:05.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:05.244+0000 7febef7fe700 1 -- 172.21.15.84:0/748506272 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7febf00cd460 msgr2=0x7febf00ca190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:05.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:05.244+0000 7febef7fe700 1 --2- 172.21.15.84:0/748506272 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7febf00cd460 0x7febf00ca190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:05.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:05.244+0000 7febef7fe700 1 -- 172.21.15.84:0/748506272 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe00094a0 con 0x7febf00b1b70 2023-07-14T11:17:05.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:05.244+0000 7febeffff700 1 --2- 172.21.15.84:0/748506272 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febf015cb40 0x7febf00c8e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:17:05.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:05.244+0000 7febef7fe700 1 --2- 172.21.15.84:0/748506272 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febf00b1b70 0x7febf00c6940 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7febe0000c00 tx=0x7febe0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:05.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:05.244+0000 7febd7fff700 1 -- 172.21.15.84:0/748506272 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe00038a0 con 0x7febf00b1b70 2023-07-14T11:17:05.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:05.244+0000 7febd7fff700 1 -- 172.21.15.84:0/748506272 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe001f070 con 0x7febf00b1b70 2023-07-14T11:17:05.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:05.244+0000 7febf5fff700 1 -- 172.21.15.84:0/748506272 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febf015d3c0 con 0x7febf00b1b70 2023-07-14T11:17:05.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:05.244+0000 7febd7fff700 1 -- 172.21.15.84:0/748506272 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe0003c40 con 0x7febf00b1b70 2023-07-14T11:17:05.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:05.244+0000 7febf5fff700 1 -- 172.21.15.84:0/748506272 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febf00c8940 con 0x7febf00b1b70 2023-07-14T11:17:05.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:05.245+0000 7febf5fff700 1 -- 172.21.15.84:0/748506272 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febf00c8ad0 con 0x7febf00b1b70 2023-07-14T11:17:05.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:05.246+0000 7febd7fff700 1 -- 172.21.15.84:0/748506272 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 9) v1 ==== 89190+0+0 (secure 0 0 0) 0x7febe0026480 con 0x7febf00b1b70 2023-07-14T11:17:05.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:05.247+0000 7febd7fff700 1 --2- 172.21.15.84:0/748506272 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7febdc06ae90 0x7febdc06d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:05.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:05.247+0000 7febd7fff700 1 -- 172.21.15.84:0/748506272 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5296+0+0 (secure 0 0 0) 0x7febe0021070 con 0x7febf00b1b70 2023-07-14T11:17:05.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:05.247+0000 7febeeffd700 1 --2- 172.21.15.84:0/748506272 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7febdc06ae90 0x7febdc06d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:05.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:05.248+0000 7febeeffd700 1 --2- 172.21.15.84:0/748506272 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7febdc06ae90 0x7febdc06d340 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7febf015f9a0 tx=0x7febe4007be0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:05.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:05.251+0000 7febd7fff700 1 -- 172.21.15.84:0/748506272 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7febe0056130 con 0x7febf00b1b70 2023-07-14T11:17:05.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:05.525+0000 7febf5fff700 1 -- 172.21.15.84:0/748506272 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_malicious_metafile_on_legacy_to_v1_upgrade"]} v 0) v1 -- 0x7febf0074350 con 0x7febf00b1b70 2023-07-14T11:17:06.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.022+0000 7febd7fff700 1 -- 172.21.15.84:0/748506272 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_malicious_metafile_on_legacy_to_v1_upgrade"]}]=0 v218) v1 ==== 164+0+0 (secure 0 0 0) 0x7febe002b0e0 con 0x7febf00b1b70 2023-07-14T11:17:06.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.025+0000 7febf5fff700 1 -- 172.21.15.84:0/748506272 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7febdc06ae90 msgr2=0x7febdc06d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:06.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.025+0000 7febf5fff700 1 --2- 172.21.15.84:0/748506272 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7febdc06ae90 0x7febdc06d340 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7febf015f9a0 tx=0x7febe4007be0 comp rx=0 tx=0).stop 2023-07-14T11:17:06.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.025+0000 7febf5fff700 1 -- 172.21.15.84:0/748506272 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febf00b1b70 msgr2=0x7febf00c6940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:06.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.025+0000 7febf5fff700 1 --2- 172.21.15.84:0/748506272 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febf00b1b70 0x7febf00c6940 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7febe0000c00 tx=0x7febe0004750 comp rx=0 tx=0).stop 2023-07-14T11:17:06.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.025+0000 7febf5fff700 1 -- 172.21.15.84:0/748506272 shutdown_connections 2023-07-14T11:17:06.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.025+0000 7febf5fff700 1 --2- 172.21.15.84:0/748506272 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7febdc06ae90 0x7febdc06d340 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:06.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.025+0000 7febf5fff700 1 --2- 172.21.15.84:0/748506272 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febf015cb40 0x7febf00c8e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:06.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.025+0000 7febf5fff700 1 --2- 172.21.15.84:0/748506272 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febf00b1b70 0x7febf00c6940 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:06.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.025+0000 7febf5fff700 1 --2- 172.21.15.84:0/748506272 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7febf00cd460 0x7febf00ca190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:06.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.025+0000 7febf5fff700 1 -- 172.21.15.84:0/748506272 >> 172.21.15.84:0/748506272 conn(0x7febf006a680 msgr2=0x7febf00b66e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:06.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.025+0000 7febf5fff700 1 -- 172.21.15.84:0/748506272 shutdown_connections 2023-07-14T11:17:06.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.025+0000 7febf5fff700 1 -- 172.21.15.84:0/748506272 wait complete. 2023-07-14T11:17:06.047 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-14T11:17:06.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.243+0000 7f29a65ff700 1 Processor -- start 2023-07-14T11:17:06.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.243+0000 7f29a65ff700 1 -- start start 2023-07-14T11:17:06.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.244+0000 7f29a65ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29a00d0b10 0x7f29a00d0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:06.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.244+0000 7f29a65ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f29a00b0e20 0x7f29a00b12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:06.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.244+0000 7f29a65ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29a00d14a0 con 0x7f29a00b8a60 2023-07-14T11:17:06.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.244+0000 7f29a65ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29a00b8e30 con 0x7f29a00b0e20 2023-07-14T11:17:06.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.244+0000 7f29a65ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29a00afaa0 con 0x7f29a00d0b10 2023-07-14T11:17:06.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.245+0000 7f29a4b9c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f29a00b0e20 0x7f29a00b12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:06.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.245+0000 7f299ffff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f29a00b8a60 0x7f29a00b3ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:39260/0 (socket says 172.21.15.84:39260) 2023-07-14T11:17:06.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.245+0000 7f299ffff700 1 -- 172.21.15.84:0/3566595261 learned_addr learned my addr 172.21.15.84:0/3566595261 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:17:06.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.245+0000 7f29a4b9c700 1 --2- 172.21.15.84:0/3566595261 >> v2:172.21.15.84:3300/0 conn(0x7f29a00b0e20 0x7f29a00b12a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46130/0 (socket says 172.21.15.84:46130) 2023-07-14T11:17:06.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.245+0000 7f299f7fe700 1 --2- 172.21.15.84:0/3566595261 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29a00d0b10 0x7f29a00d0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:06.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.245+0000 7f29a4b9c700 1 -- 172.21.15.84:0/3566595261 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29a00d0b10 msgr2=0x7f29a00d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:06.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.245+0000 7f29a4b9c700 1 --2- 172.21.15.84:0/3566595261 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29a00d0b10 0x7f29a00d0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:06.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.245+0000 7f29a4b9c700 1 -- 172.21.15.84:0/3566595261 >> v1:172.21.15.84:6789/0 conn(0x7f29a00b8a60 legacy=0x7f29a00b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:06.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.245+0000 7f29a4b9c700 1 -- 172.21.15.84:0/3566595261 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29a00afd80 con 0x7f29a00b0e20 2023-07-14T11:17:06.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.245+0000 7f29a4b9c700 1 --2- 172.21.15.84:0/3566595261 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29a00b0e20 0x7f29a00b12a0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f2998009d90 tx=0x7f299800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fcdd9c027eee5d5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:06.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.246+0000 7f299effd700 1 -- 172.21.15.84:0/3566595261 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f299800e070 con 0x7f29a00b0e20 2023-07-14T11:17:06.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.246+0000 7f299effd700 1 -- 172.21.15.84:0/3566595261 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f299800bbd0 con 0x7f29a00b0e20 2023-07-14T11:17:06.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.246+0000 7f299effd700 1 -- 172.21.15.84:0/3566595261 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2998012430 con 0x7f29a00b0e20 2023-07-14T11:17:06.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.246+0000 7f29a65ff700 1 -- 172.21.15.84:0/3566595261 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29a00b0e20 msgr2=0x7f29a00b12a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:06.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.246+0000 7f29a65ff700 1 --2- 172.21.15.84:0/3566595261 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29a00b0e20 0x7f29a00b12a0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f2998009d90 tx=0x7f299800b330 comp rx=0 tx=0).stop 2023-07-14T11:17:06.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.246+0000 7f29a65ff700 1 -- 172.21.15.84:0/3566595261 shutdown_connections 2023-07-14T11:17:06.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.246+0000 7f29a65ff700 1 --2- 172.21.15.84:0/3566595261 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29a00b0e20 0x7f29a00b12a0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:06.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.246+0000 7f29a65ff700 1 --2- 172.21.15.84:0/3566595261 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29a00d0b10 0x7f29a00d0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:06.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.246+0000 7f29a65ff700 1 -- 172.21.15.84:0/3566595261 >> 172.21.15.84:0/3566595261 conn(0x7f29a009c1b0 msgr2=0x7f29a00d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:06.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.246+0000 7f29a65ff700 1 -- 172.21.15.84:0/3566595261 shutdown_connections 2023-07-14T11:17:06.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.246+0000 7f29a65ff700 1 -- 172.21.15.84:0/3566595261 wait complete. 2023-07-14T11:17:06.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.248+0000 7f29a65ff700 1 Processor -- start 2023-07-14T11:17:06.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.248+0000 7f29a65ff700 1 -- start start 2023-07-14T11:17:06.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.249+0000 7f29a65ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f29a00b0e20 0x7f29a00b6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:06.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.249+0000 7f29a65ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29a00b8a60 0x7f29a00ca3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:06.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.249+0000 7f29a65ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29a00d0b10 0x7f29a00cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:06.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.249+0000 7f29a65ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29a00b7720 con 0x7f29a00d0b10 2023-07-14T11:17:06.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.249+0000 7f29a65ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29a00d0400 con 0x7f29a00b0e20 2023-07-14T11:17:06.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.249+0000 7f29a65ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29a00ca910 con 0x7f29a00b8a60 2023-07-14T11:17:06.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.249+0000 7f29a4b9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29a00d0b10 0x7f29a00cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:06.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.249+0000 7f29a4b9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29a00d0b10 0x7f29a00cbe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46134/0 (socket says 172.21.15.84:46134) 2023-07-14T11:17:06.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.249+0000 7f29a4b9c700 1 -- 172.21.15.84:0/1387336391 learned_addr learned my addr 172.21.15.84:0/1387336391 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:06.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.250+0000 7f29a4b9c700 1 -- 172.21.15.84:0/1387336391 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29a00b8a60 msgr2=0x7f29a00ca3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:06.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.250+0000 7f29a4b9c700 1 --2- 172.21.15.84:0/1387336391 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29a00b8a60 0x7f29a00ca3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:06.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.250+0000 7f29a4b9c700 1 -- 172.21.15.84:0/1387336391 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f29a00b0e20 msgr2=0x7f29a00b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:06.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.250+0000 7f29a4b9c700 1 --2- 172.21.15.84:0/1387336391 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f29a00b0e20 0x7f29a00b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:06.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.250+0000 7f29a4b9c700 1 -- 172.21.15.84:0/1387336391 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2998009a70 con 0x7f29a00d0b10 2023-07-14T11:17:06.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.250+0000 7f29a4b9c700 1 --2- 172.21.15.84:0/1387336391 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29a00d0b10 0x7f29a00cbe80 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f2998014040 tx=0x7f2998004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:06.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.250+0000 7f299cff9700 1 -- 172.21.15.84:0/1387336391 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2998003ea0 con 0x7f29a00d0b10 2023-07-14T11:17:06.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.250+0000 7f299cff9700 1 -- 172.21.15.84:0/1387336391 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2998020070 con 0x7f29a00d0b10 2023-07-14T11:17:06.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.250+0000 7f299cff9700 1 -- 172.21.15.84:0/1387336391 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2998004280 con 0x7f29a00d0b10 2023-07-14T11:17:06.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.250+0000 7f29a65ff700 1 -- 172.21.15.84:0/1387336391 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29a00b6e80 con 0x7f29a00d0b10 2023-07-14T11:17:06.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.250+0000 7f29a65ff700 1 -- 172.21.15.84:0/1387336391 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29a00b7440 con 0x7f29a00d0b10 2023-07-14T11:17:06.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.252+0000 7f29a65ff700 1 -- 172.21.15.84:0/1387336391 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29a0074350 con 0x7f29a00d0b10 2023-07-14T11:17:06.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.252+0000 7f299cff9700 1 -- 172.21.15.84:0/1387336391 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 9) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f29980043e0 con 0x7f29a00d0b10 2023-07-14T11:17:06.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.254+0000 7f299cff9700 1 --2- 172.21.15.84:0/1387336391 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f298c06ae90 0x7f298c06d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:06.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.254+0000 7f299cff9700 1 -- 172.21.15.84:0/1387336391 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f2998022070 con 0x7f29a00d0b10 2023-07-14T11:17:06.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.254+0000 7f299ffff700 1 --2- 172.21.15.84:0/1387336391 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f298c06ae90 0x7f298c06d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:06.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.255+0000 7f299ffff700 1 --2- 172.21.15.84:0/1387336391 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f298c06ae90 0x7f298c06d340 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f2990001670 tx=0x7f2990007ad0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:06.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.259+0000 7f299cff9700 1 -- 172.21.15.84:0/1387336391 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f29980564f0 con 0x7f29a00d0b10 2023-07-14T11:17:06.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.454+0000 7f29a65ff700 1 -- 172.21.15.84:0/1387336391 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f29a006c1e0 con 0x7f29a00d0b10 2023-07-14T11:17:06.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.460+0000 7f299cff9700 1 -- 172.21.15.84:0/1387336391 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2998059b10 con 0x7f29a00d0b10 2023-07-14T11:17:06.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.462+0000 7f29a65ff700 1 -- 172.21.15.84:0/1387336391 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f298c06ae90 msgr2=0x7f298c06d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:06.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.462+0000 7f29a65ff700 1 --2- 172.21.15.84:0/1387336391 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f298c06ae90 0x7f298c06d340 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f2990001670 tx=0x7f2990007ad0 comp rx=0 tx=0).stop 2023-07-14T11:17:06.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.462+0000 7f29a65ff700 1 -- 172.21.15.84:0/1387336391 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29a00d0b10 msgr2=0x7f29a00cbe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:06.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.462+0000 7f29a65ff700 1 --2- 172.21.15.84:0/1387336391 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29a00d0b10 0x7f29a00cbe80 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f2998014040 tx=0x7f2998004ad0 comp rx=0 tx=0).stop 2023-07-14T11:17:06.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.463+0000 7f29a65ff700 1 -- 172.21.15.84:0/1387336391 shutdown_connections 2023-07-14T11:17:06.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.463+0000 7f29a65ff700 1 --2- 172.21.15.84:0/1387336391 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29a00d0b10 0x7f29a00cbe80 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:06.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.463+0000 7f29a65ff700 1 --2- 172.21.15.84:0/1387336391 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f29a00b0e20 0x7f29a00b6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:06.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.463+0000 7f29a65ff700 1 --2- 172.21.15.84:0/1387336391 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f298c06ae90 0x7f298c06d340 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:06.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.463+0000 7f29a65ff700 1 --2- 172.21.15.84:0/1387336391 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29a00b8a60 0x7f29a00ca3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:06.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.463+0000 7f29a65ff700 1 -- 172.21.15.84:0/1387336391 >> 172.21.15.84:0/1387336391 conn(0x7f29a009c1b0 msgr2=0x7f29a00c9800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:06.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.463+0000 7f29a65ff700 1 -- 172.21.15.84:0/1387336391 shutdown_connections 2023-07-14T11:17:06.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:06.463+0000 7f29a65ff700 1 -- 172.21.15.84:0/1387336391 wait complete. 2023-07-14T11:17:06.484 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-14T11:17:06.484 DEBUG:teuthology.orchestra.run.smithi084:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-14T11:17:06.576 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-14T11:17:06.679 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-14T11:17:06.679 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-14T11:17:06.680 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:17:06.725 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345568k,nr_inodes=4086392,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=35,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275008k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-07-14T11:17:06.726 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-07-14T11:17:06.726 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:17:06.772 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345528k,nr_inodes=4086382,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=40,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275000k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-07-14T11:17:06.772 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-14T11:17:06.772 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:17:06.818 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345568k,nr_inodes=4086392,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=35,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275008k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-07-14T11:17:06.819 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-07-14T11:17:06.819 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:17:06.865 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345528k,nr_inodes=4086382,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=40,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275000k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-07-14T11:17:06.865 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-14T11:17:06.866 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T11:17:07.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.058+0000 7f56f0bff700 1 Processor -- start 2023-07-14T11:17:07.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.058+0000 7f56f0bff700 1 -- start start 2023-07-14T11:17:07.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.059+0000 7f56f0bff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f56ec0b4510 0x7f56ec0b6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:07.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.059+0000 7f56f0bff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56ec0b7f50 con 0x7f56ec0b5d90 2023-07-14T11:17:07.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.059+0000 7f56f0bff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56ec0cdca0 con 0x7f56ec0d0b10 2023-07-14T11:17:07.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.059+0000 7f56f0bff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56ec0b48e0 con 0x7f56ec0b4510 2023-07-14T11:17:07.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.060+0000 7f56ea59c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f56ec0b4510 0x7f56ec0b6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:07.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.060+0000 7f56e3fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f56ec0b5d90 0x7f56ec0cd590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:39274/0 (socket says 172.21.15.84:39274) 2023-07-14T11:17:07.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.060+0000 7f56ea59c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f56ec0b4510 0x7f56ec0b6c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46144/0 (socket says 172.21.15.84:46144) 2023-07-14T11:17:07.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.060+0000 7f56e3fff700 1 -- 172.21.15.84:0/4257880403 learned_addr learned my addr 172.21.15.84:0/4257880403 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:17:07.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.060+0000 7f56ea59c700 1 -- 172.21.15.84:0/4257880403 >> v1:172.21.15.179:6789/0 conn(0x7f56ec0d0b10 legacy=0x7f56ec0b83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:07.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.060+0000 7f56ea59c700 1 -- 172.21.15.84:0/4257880403 >> v1:172.21.15.84:6789/0 conn(0x7f56ec0b5d90 legacy=0x7f56ec0cd590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:07.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.060+0000 7f56ea59c700 1 -- 172.21.15.84:0/4257880403 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56ec0b7340 con 0x7f56ec0b4510 2023-07-14T11:17:07.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.060+0000 7f56e9d9b700 1 -- 172.21.15.84:0/4257880403 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3397760918 0 0) 0x7f56ec0b7f50 con 0x7f56ec0b5d90 2023-07-14T11:17:07.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.060+0000 7f56ea59c700 1 --2- 172.21.15.84:0/4257880403 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56ec0b4510 0x7f56ec0b6c80 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f56dc009820 tx=0x7f56dc009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf8087842082cb6d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:07.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.061+0000 7f56e9d9b700 1 -- 172.21.15.84:0/4257880403 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56dc005e30 con 0x7f56ec0b4510 2023-07-14T11:17:07.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.061+0000 7f56e9d9b700 1 -- 172.21.15.84:0/4257880403 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56dc004030 con 0x7f56ec0b4510 2023-07-14T11:17:07.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.061+0000 7f56e9d9b700 1 -- 172.21.15.84:0/4257880403 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56dc0043c0 con 0x7f56ec0b4510 2023-07-14T11:17:07.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.061+0000 7f56f0bff700 1 -- 172.21.15.84:0/4257880403 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56ec0b4510 msgr2=0x7f56ec0b6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:07.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.061+0000 7f56f0bff700 1 --2- 172.21.15.84:0/4257880403 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56ec0b4510 0x7f56ec0b6c80 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f56dc009820 tx=0x7f56dc009b30 comp rx=0 tx=0).stop 2023-07-14T11:17:07.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.061+0000 7f56f0bff700 1 -- 172.21.15.84:0/4257880403 shutdown_connections 2023-07-14T11:17:07.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.061+0000 7f56f0bff700 1 --2- 172.21.15.84:0/4257880403 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56ec0b4510 0x7f56ec0b6c80 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:07.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.061+0000 7f56f0bff700 1 -- 172.21.15.84:0/4257880403 >> 172.21.15.84:0/4257880403 conn(0x7f56ec09c1d0 msgr2=0x7f56ec0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:07.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.061+0000 7f56f0bff700 1 -- 172.21.15.84:0/4257880403 shutdown_connections 2023-07-14T11:17:07.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.061+0000 7f56f0bff700 1 -- 172.21.15.84:0/4257880403 wait complete. 2023-07-14T11:17:07.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.063+0000 7f56f0bff700 1 Processor -- start 2023-07-14T11:17:07.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.063+0000 7f56f0bff700 1 -- start start 2023-07-14T11:17:07.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.064+0000 7f56f0bff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56ec0b4510 0x7f56ec159970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:07.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.064+0000 7f56f0bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56ec0b5d90 0x7f56ec0c8df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:07.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.064+0000 7f56f0bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56ec0d0b10 0x7f56ec0afac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:07.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.064+0000 7f56f0bff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56ec0b39a0 con 0x7f56ec0b4510 2023-07-14T11:17:07.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.064+0000 7f56f0bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56ec159eb0 con 0x7f56ec0b5d90 2023-07-14T11:17:07.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.064+0000 7f56f0bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56ec0b2e20 con 0x7f56ec0d0b10 2023-07-14T11:17:07.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.064+0000 7f56ea59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56ec0b4510 0x7f56ec159970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:07.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.064+0000 7f56ea59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56ec0b4510 0x7f56ec159970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46160/0 (socket says 172.21.15.84:46160) 2023-07-14T11:17:07.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.064+0000 7f56ea59c700 1 -- 172.21.15.84:0/1523573198 learned_addr learned my addr 172.21.15.84:0/1523573198 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:07.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.065+0000 7f56e3fff700 1 --2- 172.21.15.84:0/1523573198 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56ec0b5d90 0x7f56ec0c8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:07.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.065+0000 7f56ead9d700 1 --2- 172.21.15.84:0/1523573198 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56ec0d0b10 0x7f56ec0afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:07.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.065+0000 7f56ea59c700 1 -- 172.21.15.84:0/1523573198 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56ec0d0b10 msgr2=0x7f56ec0afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:07.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.065+0000 7f56ea59c700 1 --2- 172.21.15.84:0/1523573198 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56ec0d0b10 0x7f56ec0afac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:07.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.065+0000 7f56ea59c700 1 -- 172.21.15.84:0/1523573198 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56ec0b5d90 msgr2=0x7f56ec0c8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:07.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.065+0000 7f56ea59c700 1 --2- 172.21.15.84:0/1523573198 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56ec0b5d90 0x7f56ec0c8df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:07.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.065+0000 7f56ea59c700 1 -- 172.21.15.84:0/1523573198 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56dc009430 con 0x7f56ec0b4510 2023-07-14T11:17:07.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.065+0000 7f56e3fff700 1 --2- 172.21.15.84:0/1523573198 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56ec0b5d90 0x7f56ec0c8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:17:07.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.065+0000 7f56ead9d700 1 --2- 172.21.15.84:0/1523573198 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56ec0d0b10 0x7f56ec0afac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:17:07.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.065+0000 7f56ea59c700 1 --2- 172.21.15.84:0/1523573198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56ec0b4510 0x7f56ec159970 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f56dc000c00 tx=0x7f56dc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:07.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.065+0000 7f56e2ffd700 1 -- 172.21.15.84:0/1523573198 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56dc01d630 con 0x7f56ec0b4510 2023-07-14T11:17:07.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.065+0000 7f56e2ffd700 1 -- 172.21.15.84:0/1523573198 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56dc01d790 con 0x7f56ec0b4510 2023-07-14T11:17:07.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.065+0000 7f56f0bff700 1 -- 172.21.15.84:0/1523573198 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56ec0b3100 con 0x7f56ec0b4510 2023-07-14T11:17:07.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.065+0000 7f56e2ffd700 1 -- 172.21.15.84:0/1523573198 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56dc01db40 con 0x7f56ec0b4510 2023-07-14T11:17:07.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.065+0000 7f56f0bff700 1 -- 172.21.15.84:0/1523573198 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56ec0b36c0 con 0x7f56ec0b4510 2023-07-14T11:17:07.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.066+0000 7f56f0bff700 1 -- 172.21.15.84:0/1523573198 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56ec04e280 con 0x7f56ec0b4510 2023-07-14T11:17:07.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.067+0000 7f56e2ffd700 1 -- 172.21.15.84:0/1523573198 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 9) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f56dc01dca0 con 0x7f56ec0b4510 2023-07-14T11:17:07.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.068+0000 7f56e2ffd700 1 --2- 172.21.15.84:0/1523573198 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f56cc06ae90 0x7f56cc06d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:07.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.068+0000 7f56e2ffd700 1 -- 172.21.15.84:0/1523573198 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f56dc08abf0 con 0x7f56ec0b4510 2023-07-14T11:17:07.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.068+0000 7f56e3fff700 1 --2- 172.21.15.84:0/1523573198 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f56cc06ae90 0x7f56cc06d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:07.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.069+0000 7f56e3fff700 1 --2- 172.21.15.84:0/1523573198 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f56cc06ae90 0x7f56cc06d340 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f56ec0c9b70 tx=0x7f56d4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:07.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.072+0000 7f56e2ffd700 1 -- 172.21.15.84:0/1523573198 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f56dc055d30 con 0x7f56ec0b4510 2023-07-14T11:17:07.246 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T11:17:07.251 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T11:17:07.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.326+0000 7f56f0bff700 1 -- 172.21.15.84:0/1523573198 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f56ec15ba40 con 0x7f56ec0b4510 2023-07-14T11:17:07.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.327+0000 7f56e2ffd700 1 -- 172.21.15.84:0/1523573198 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f56dc016de0 con 0x7f56ec0b4510 2023-07-14T11:17:07.331 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:17:07.331 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":30,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5030,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3551222138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3551222138},{"type":"v1","addr":"172.21.15.179:6834","nonce":3551222138}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5036,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/1316665435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1316665435},{"type":"v1","addr":"172.21.15.84:6836","nonce":1316665435}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5416,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/611235750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":611235750},{"type":"v1","addr":"172.21.15.179:6835","nonce":611235750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":6102,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/1177944134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":1177944134},{"type":"v1","addr":"172.21.15.84:6837","nonce":1177944134}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30}],"filesystems":[]} 2023-07-14T11:17:07.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.329+0000 7f56f0bff700 1 -- 172.21.15.84:0/1523573198 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f56cc06ae90 msgr2=0x7f56cc06d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:07.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.329+0000 7f56f0bff700 1 --2- 172.21.15.84:0/1523573198 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f56cc06ae90 0x7f56cc06d340 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f56ec0c9b70 tx=0x7f56d4009040 comp rx=0 tx=0).stop 2023-07-14T11:17:07.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.329+0000 7f56f0bff700 1 -- 172.21.15.84:0/1523573198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56ec0b4510 msgr2=0x7f56ec159970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:07.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.329+0000 7f56f0bff700 1 --2- 172.21.15.84:0/1523573198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56ec0b4510 0x7f56ec159970 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f56dc000c00 tx=0x7f56dc004750 comp rx=0 tx=0).stop 2023-07-14T11:17:07.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.329+0000 7f56f0bff700 1 -- 172.21.15.84:0/1523573198 shutdown_connections 2023-07-14T11:17:07.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.329+0000 7f56f0bff700 1 --2- 172.21.15.84:0/1523573198 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f56cc06ae90 0x7f56cc06d340 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:07.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.329+0000 7f56f0bff700 1 --2- 172.21.15.84:0/1523573198 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56ec0d0b10 0x7f56ec0afac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:07.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.329+0000 7f56f0bff700 1 --2- 172.21.15.84:0/1523573198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56ec0b4510 0x7f56ec159970 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:07.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.329+0000 7f56f0bff700 1 --2- 172.21.15.84:0/1523573198 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56ec0b5d90 0x7f56ec0c8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:07.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.329+0000 7f56f0bff700 1 -- 172.21.15.84:0/1523573198 >> 172.21.15.84:0/1523573198 conn(0x7f56ec09c1d0 msgr2=0x7f56ec15aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:07.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.330+0000 7f56f0bff700 1 -- 172.21.15.84:0/1523573198 shutdown_connections 2023-07-14T11:17:07.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.330+0000 7f56f0bff700 1 -- 172.21.15.84:0/1523573198 wait complete. 2023-07-14T11:17:07.336 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 30 2023-07-14T11:17:07.351 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-14T11:17:07.351 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-14T11:17:07.351 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-14T11:17:07.351 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T11:17:07.352 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-14T11:17:07.352 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-14T11:17:07.353 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-14T11:17:07.353 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T11:17:07.353 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-14T11:17:07.354 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-14T11:17:07.354 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-14T11:17:07.354 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T11:17:07.355 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-14T11:17:07.355 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-14T11:17:07.355 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-14T11:17:07.355 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T11:17:07.369 INFO:tasks.ceph.mds.b:Stopped 2023-07-14T11:17:07.369 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-14T11:17:07.370 INFO:tasks.ceph.mds.d:Stopped 2023-07-14T11:17:07.370 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-14T11:17:07.406 INFO:tasks.ceph.mds.a:Stopped 2023-07-14T11:17:07.406 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-14T11:17:07.407 INFO:tasks.ceph.mds.c:Stopped 2023-07-14T11:17:07.407 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-14T11:17:07.413 INFO:tasks.ceph.mds.b:Started 2023-07-14T11:17:07.413 DEBUG:teuthology.parallel:result is None 2023-07-14T11:17:07.415 INFO:tasks.ceph.mds.d:Started 2023-07-14T11:17:07.416 DEBUG:teuthology.parallel:result is None 2023-07-14T11:17:07.450 INFO:tasks.ceph.mds.a:Started 2023-07-14T11:17:07.450 DEBUG:teuthology.parallel:result is None 2023-07-14T11:17:07.453 INFO:tasks.ceph.mds.c:Started 2023-07-14T11:17:07.453 DEBUG:teuthology.parallel:result is None 2023-07-14T11:17:07.454 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-14T11:17:07.557 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2023-07-14T11:17:07.558 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2023-07-14T11:17:07.600 INFO:tasks.ceph.mds.c.smithi084.stdout:starting mds.c at 2023-07-14T11:17:07.601 INFO:tasks.ceph.mds.a.smithi084.stdout:starting mds.a at 2023-07-14T11:17:07.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.660+0000 7fd5245ff700 1 Processor -- start 2023-07-14T11:17:07.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.660+0000 7fd5245ff700 1 -- start start 2023-07-14T11:17:07.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.661+0000 7fd5245ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd51c0c92d0 0x7fd51c0ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:07.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.661+0000 7fd5245ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd51c0b12f0 0x7fd51c0c96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:07.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.661+0000 7fd5245ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd51c15ce70 con 0x7fd51c0adea0 2023-07-14T11:17:07.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.661+0000 7fd5245ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd51c15da60 con 0x7fd51c0c92d0 2023-07-14T11:17:07.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.661+0000 7fd5245ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd51c0c9be0 con 0x7fd51c0b12f0 2023-07-14T11:17:07.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.662+0000 7fd52239b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd51c0c92d0 0x7fd51c0ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:07.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.662+0000 7fd521b9a700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd51c0b12f0 0x7fd51c0c96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:07.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.662+0000 7fd52239b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd51c0c92d0 0x7fd51c0ad8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46190/0 (socket says 172.21.15.84:46190) 2023-07-14T11:17:07.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.662+0000 7fd52239b700 1 -- 172.21.15.84:0/4213009545 learned_addr learned my addr 172.21.15.84:0/4213009545 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:07.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.662+0000 7fd521399700 1 -- 172.21.15.84:0/4213009545 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 299408263 0 0) 0x7fd51c15ce70 con 0x7fd51c0adea0 2023-07-14T11:17:07.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.662+0000 7fd52239b700 1 -- 172.21.15.84:0/4213009545 >> v2:172.21.15.179:3300/0 conn(0x7fd51c0b12f0 msgr2=0x7fd51c0c96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:07.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.662+0000 7fd52239b700 1 --2- 172.21.15.84:0/4213009545 >> v2:172.21.15.179:3300/0 conn(0x7fd51c0b12f0 0x7fd51c0c96a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:07.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.662+0000 7fd52239b700 1 -- 172.21.15.84:0/4213009545 >> v1:172.21.15.179:6789/0 conn(0x7fd51c0adea0 legacy=0x7fd51c06c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:07.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.662+0000 7fd52239b700 1 -- 172.21.15.84:0/4213009545 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd51c15d0c0 con 0x7fd51c0c92d0 2023-07-14T11:17:07.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.662+0000 7fd521b9a700 1 --2- 172.21.15.84:0/4213009545 >> v2:172.21.15.179:3300/0 conn(0x7fd51c0b12f0 0x7fd51c0c96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:17:07.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.662+0000 7fd52239b700 1 --2- 172.21.15.84:0/4213009545 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd51c0c92d0 0x7fd51c0ad8f0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fd51c06d890 tx=0x7fd51800be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a9a9d116f131127 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:07.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.663+0000 7fd521399700 1 -- 172.21.15.84:0/4213009545 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51800dc70 con 0x7fd51c0c92d0 2023-07-14T11:17:07.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.663+0000 7fd521399700 1 -- 172.21.15.84:0/4213009545 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd51800ddd0 con 0x7fd51c0c92d0 2023-07-14T11:17:07.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.663+0000 7fd521399700 1 -- 172.21.15.84:0/4213009545 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd518010690 con 0x7fd51c0c92d0 2023-07-14T11:17:07.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.663+0000 7fd5245ff700 1 -- 172.21.15.84:0/4213009545 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd51c0c92d0 msgr2=0x7fd51c0ad8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:07.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.663+0000 7fd5245ff700 1 --2- 172.21.15.84:0/4213009545 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd51c0c92d0 0x7fd51c0ad8f0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fd51c06d890 tx=0x7fd51800be70 comp rx=0 tx=0).stop 2023-07-14T11:17:07.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.663+0000 7fd5245ff700 1 -- 172.21.15.84:0/4213009545 shutdown_connections 2023-07-14T11:17:07.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.663+0000 7fd5245ff700 1 --2- 172.21.15.84:0/4213009545 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd51c0c92d0 0x7fd51c0ad8f0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:07.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.663+0000 7fd5245ff700 1 --2- 172.21.15.84:0/4213009545 >> v2:172.21.15.179:3300/0 conn(0x7fd51c0b12f0 0x7fd51c0c96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:07.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.663+0000 7fd5245ff700 1 -- 172.21.15.84:0/4213009545 >> 172.21.15.84:0/4213009545 conn(0x7fd51c0b05d0 msgr2=0x7fd51c0b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:07.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.663+0000 7fd5245ff700 1 -- 172.21.15.84:0/4213009545 shutdown_connections 2023-07-14T11:17:07.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.663+0000 7fd5245ff700 1 -- 172.21.15.84:0/4213009545 wait complete. 2023-07-14T11:17:07.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.665+0000 7fd5245ff700 1 Processor -- start 2023-07-14T11:17:07.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.665+0000 7fd5245ff700 1 -- start start 2023-07-14T11:17:07.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.666+0000 7fd5245ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd51c0adea0 0x7fd51c154dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:07.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.666+0000 7fd5245ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd51c0b12f0 0x7fd51c0c8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:07.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.666+0000 7fd5245ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd51c0c92d0 0x7fd51c141c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:07.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.666+0000 7fd5245ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd51c0c8a70 con 0x7fd51c0c92d0 2023-07-14T11:17:07.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.666+0000 7fd5245ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd51c0b1990 con 0x7fd51c0b12f0 2023-07-14T11:17:07.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.666+0000 7fd5245ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd51c0b1c70 con 0x7fd51c0adea0 2023-07-14T11:17:07.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.666+0000 7fd522b9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd51c0c92d0 0x7fd51c141c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:07.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.666+0000 7fd522b9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd51c0c92d0 0x7fd51c141c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46206/0 (socket says 172.21.15.84:46206) 2023-07-14T11:17:07.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.666+0000 7fd522b9c700 1 -- 172.21.15.84:0/2896562013 learned_addr learned my addr 172.21.15.84:0/2896562013 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:07.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.667+0000 7fd52239b700 1 --2- 172.21.15.84:0/2896562013 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd51c0adea0 0x7fd51c154dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:07.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.667+0000 7fd521b9a700 1 --2- 172.21.15.84:0/2896562013 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd51c0b12f0 0x7fd51c0c8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:07.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.667+0000 7fd522b9c700 1 -- 172.21.15.84:0/2896562013 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd51c0adea0 msgr2=0x7fd51c154dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:07.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.667+0000 7fd522b9c700 1 --2- 172.21.15.84:0/2896562013 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd51c0adea0 0x7fd51c154dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:07.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.667+0000 7fd522b9c700 1 -- 172.21.15.84:0/2896562013 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd51c0b12f0 msgr2=0x7fd51c0c8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:07.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.667+0000 7fd522b9c700 1 --2- 172.21.15.84:0/2896562013 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd51c0b12f0 0x7fd51c0c8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:07.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.667+0000 7fd522b9c700 1 -- 172.21.15.84:0/2896562013 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd50c0094a0 con 0x7fd51c0c92d0 2023-07-14T11:17:07.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.667+0000 7fd522b9c700 1 --2- 172.21.15.84:0/2896562013 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd51c0c92d0 0x7fd51c141c80 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fd514001560 tx=0x7fd51400cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:07.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.667+0000 7fd512ffd700 1 -- 172.21.15.84:0/2896562013 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd514003e30 con 0x7fd51c0c92d0 2023-07-14T11:17:07.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.667+0000 7fd512ffd700 1 -- 172.21.15.84:0/2896562013 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd514005070 con 0x7fd51c0c92d0 2023-07-14T11:17:07.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.667+0000 7fd512ffd700 1 -- 172.21.15.84:0/2896562013 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd514005420 con 0x7fd51c0c92d0 2023-07-14T11:17:07.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.667+0000 7fd5245ff700 1 -- 172.21.15.84:0/2896562013 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd51800b7f0 con 0x7fd51c0c92d0 2023-07-14T11:17:07.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.668+0000 7fd5245ff700 1 -- 172.21.15.84:0/2896562013 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd51c1548b0 con 0x7fd51c0c92d0 2023-07-14T11:17:07.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.669+0000 7fd5245ff700 1 -- 172.21.15.84:0/2896562013 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd51c074350 con 0x7fd51c0c92d0 2023-07-14T11:17:07.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.670+0000 7fd512ffd700 1 -- 172.21.15.84:0/2896562013 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 9) v1 ==== 89190+0+0 (secure 0 0 0) 0x7fd514005580 con 0x7fd51c0c92d0 2023-07-14T11:17:07.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.670+0000 7fd512ffd700 1 --2- 172.21.15.84:0/2896562013 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fd50006ae90 0x7fd50006d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:07.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.671+0000 7fd512ffd700 1 -- 172.21.15.84:0/2896562013 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fd514088c90 con 0x7fd51c0c92d0 2023-07-14T11:17:07.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.671+0000 7fd52239b700 1 --2- 172.21.15.84:0/2896562013 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fd50006ae90 0x7fd50006d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:07.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.671+0000 7fd52239b700 1 --2- 172.21.15.84:0/2896562013 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fd50006ae90 0x7fd50006d340 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd518000c00 tx=0x7fd518013000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:07.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.675+0000 7fd512ffd700 1 -- 172.21.15.84:0/2896562013 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fd514053dd0 con 0x7fd51c0c92d0 2023-07-14T11:17:07.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:07.881+0000 7fd5245ff700 1 -- 172.21.15.84:0/2896562013 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fd51c154aa0 con 0x7fd51c0c92d0 2023-07-14T11:17:08.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.045+0000 7fd512ffd700 1 -- 172.21.15.84:0/2896562013 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v57) v1 ==== 97+0+0 (secure 0 0 0) 0x7fd514017080 con 0x7fd51c0c92d0 2023-07-14T11:17:08.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.048+0000 7fd5245ff700 1 -- 172.21.15.84:0/2896562013 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fd50006ae90 msgr2=0x7fd50006d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:08.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.048+0000 7fd5245ff700 1 --2- 172.21.15.84:0/2896562013 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fd50006ae90 0x7fd50006d340 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd518000c00 tx=0x7fd518013000 comp rx=0 tx=0).stop 2023-07-14T11:17:08.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.048+0000 7fd5245ff700 1 -- 172.21.15.84:0/2896562013 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd51c0c92d0 msgr2=0x7fd51c141c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:08.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.048+0000 7fd5245ff700 1 --2- 172.21.15.84:0/2896562013 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd51c0c92d0 0x7fd51c141c80 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fd514001560 tx=0x7fd51400cc00 comp rx=0 tx=0).stop 2023-07-14T11:17:08.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.048+0000 7fd5245ff700 1 -- 172.21.15.84:0/2896562013 shutdown_connections 2023-07-14T11:17:08.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.048+0000 7fd5245ff700 1 --2- 172.21.15.84:0/2896562013 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fd50006ae90 0x7fd50006d340 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:08.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.048+0000 7fd5245ff700 1 --2- 172.21.15.84:0/2896562013 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd51c0adea0 0x7fd51c154dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:08.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.048+0000 7fd5245ff700 1 --2- 172.21.15.84:0/2896562013 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd51c0c92d0 0x7fd51c141c80 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:08.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.048+0000 7fd5245ff700 1 --2- 172.21.15.84:0/2896562013 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd51c0b12f0 0x7fd51c0c8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:08.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.048+0000 7fd5245ff700 1 -- 172.21.15.84:0/2896562013 >> 172.21.15.84:0/2896562013 conn(0x7fd51c0b05d0 msgr2=0x7fd51c155d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:08.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.048+0000 7fd5245ff700 1 -- 172.21.15.84:0/2896562013 shutdown_connections 2023-07-14T11:17:08.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.048+0000 7fd5245ff700 1 -- 172.21.15.84:0/2896562013 wait complete. 2023-07-14T11:17:08.053 INFO:teuthology.orchestra.run.smithi084.stderr: removed all blocklist entries 2023-07-14T11:17:08.072 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-14T11:17:08.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.263+0000 7f6e5bbff700 1 Processor -- start 2023-07-14T11:17:08.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.263+0000 7f6e5bbff700 1 -- start start 2023-07-14T11:17:08.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.264+0000 7f6e5bbff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6e5415e890 0x7f6e540cee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:08.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.264+0000 7f6e5bbff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e5415afd0 0x7f6e540b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:08.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.265+0000 7f6e5bbff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e540ce110 con 0x7f6e540b3780 2023-07-14T11:17:08.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.265+0000 7f6e5bbff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e5415b450 con 0x7f6e5415e890 2023-07-14T11:17:08.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.265+0000 7f6e5bbff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e540cf380 con 0x7f6e5415afd0 2023-07-14T11:17:08.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.265+0000 7f6e5999b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6e5415e890 0x7f6e540cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:08.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.265+0000 7f6e5919a700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f6e540b3780 0x7f6e5415a8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:39278/0 (socket says 172.21.15.84:39278) 2023-07-14T11:17:08.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.265+0000 7f6e5999b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6e5415e890 0x7f6e540cee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46212/0 (socket says 172.21.15.84:46212) 2023-07-14T11:17:08.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.265+0000 7f6e5919a700 1 -- 172.21.15.84:0/2642410879 learned_addr learned my addr 172.21.15.84:0/2642410879 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:17:08.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.265+0000 7f6e5999b700 1 -- 172.21.15.84:0/2642410879 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e5415afd0 msgr2=0x7f6e540b3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:08.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.265+0000 7f6e5999b700 1 --2- 172.21.15.84:0/2642410879 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e5415afd0 0x7f6e540b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:08.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.265+0000 7f6e5999b700 1 -- 172.21.15.84:0/2642410879 >> v1:172.21.15.84:6789/0 conn(0x7f6e540b3780 legacy=0x7f6e5415a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:08.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.265+0000 7f6e5999b700 1 -- 172.21.15.84:0/2642410879 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e5415b660 con 0x7f6e5415e890 2023-07-14T11:17:08.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.265+0000 7f6e58999700 1 -- 172.21.15.84:0/2642410879 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2491580021 0 0) 0x7f6e540ce110 con 0x7f6e540b3780 2023-07-14T11:17:08.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.265+0000 7f6e5999b700 1 --2- 172.21.15.84:0/2642410879 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e5415e890 0x7f6e540cee40 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f6e50009840 tx=0x7f6e50009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=591bfe54953e23ed server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:08.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.266+0000 7f6e58999700 1 -- 172.21.15.84:0/2642410879 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e50011830 con 0x7f6e5415e890 2023-07-14T11:17:08.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.266+0000 7f6e58999700 1 -- 172.21.15.84:0/2642410879 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e50011990 con 0x7f6e5415e890 2023-07-14T11:17:08.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.266+0000 7f6e58999700 1 -- 172.21.15.84:0/2642410879 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e50011d20 con 0x7f6e5415e890 2023-07-14T11:17:08.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.266+0000 7f6e5bbff700 1 -- 172.21.15.84:0/2642410879 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e5415e890 msgr2=0x7f6e540cee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:08.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.266+0000 7f6e5bbff700 1 --2- 172.21.15.84:0/2642410879 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e5415e890 0x7f6e540cee40 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f6e50009840 tx=0x7f6e50009b50 comp rx=0 tx=0).stop 2023-07-14T11:17:08.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.266+0000 7f6e5bbff700 1 -- 172.21.15.84:0/2642410879 shutdown_connections 2023-07-14T11:17:08.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.266+0000 7f6e5bbff700 1 --2- 172.21.15.84:0/2642410879 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e5415afd0 0x7f6e540b3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:08.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.266+0000 7f6e5bbff700 1 --2- 172.21.15.84:0/2642410879 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e5415e890 0x7f6e540cee40 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:08.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.266+0000 7f6e5bbff700 1 -- 172.21.15.84:0/2642410879 >> 172.21.15.84:0/2642410879 conn(0x7f6e54069f30 msgr2=0x7f6e5406a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:08.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.266+0000 7f6e5bbff700 1 -- 172.21.15.84:0/2642410879 shutdown_connections 2023-07-14T11:17:08.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.266+0000 7f6e5bbff700 1 -- 172.21.15.84:0/2642410879 wait complete. 2023-07-14T11:17:08.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.268+0000 7f6e5bbff700 1 Processor -- start 2023-07-14T11:17:08.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.268+0000 7f6e5bbff700 1 -- start start 2023-07-14T11:17:08.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.269+0000 7f6e5bbff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e540b3780 0x7f6e541e61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:08.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.269+0000 7f6e5bbff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e5415afd0 0x7f6e5414c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:08.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.269+0000 7f6e5bbff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e5415e890 0x7f6e541f2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:08.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.269+0000 7f6e5bbff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e541e66f0 con 0x7f6e5415e890 2023-07-14T11:17:08.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.269+0000 7f6e5bbff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5414fb40 con 0x7f6e5415afd0 2023-07-14T11:17:08.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.269+0000 7f6e5bbff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5414ce20 con 0x7f6e540b3780 2023-07-14T11:17:08.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.269+0000 7f6e5a19c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e5415e890 0x7f6e541f2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:08.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.269+0000 7f6e5a19c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e5415e890 0x7f6e541f2fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46218/0 (socket says 172.21.15.84:46218) 2023-07-14T11:17:08.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.269+0000 7f6e5a19c700 1 -- 172.21.15.84:0/1104644207 learned_addr learned my addr 172.21.15.84:0/1104644207 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:08.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.270+0000 7f6e5999b700 1 --2- 172.21.15.84:0/1104644207 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e540b3780 0x7f6e541e61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:08.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.270+0000 7f6e5919a700 1 --2- 172.21.15.84:0/1104644207 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e5415afd0 0x7f6e5414c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:08.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.270+0000 7f6e5a19c700 1 -- 172.21.15.84:0/1104644207 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e540b3780 msgr2=0x7f6e541e61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:08.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.270+0000 7f6e5a19c700 1 --2- 172.21.15.84:0/1104644207 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e540b3780 0x7f6e541e61b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:08.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.270+0000 7f6e5a19c700 1 -- 172.21.15.84:0/1104644207 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e5415afd0 msgr2=0x7f6e5414c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:08.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.270+0000 7f6e5a19c700 1 --2- 172.21.15.84:0/1104644207 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e5415afd0 0x7f6e5414c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:08.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.270+0000 7f6e5a19c700 1 -- 172.21.15.84:0/1104644207 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e500094a0 con 0x7f6e5415e890 2023-07-14T11:17:08.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.270+0000 7f6e5a19c700 1 --2- 172.21.15.84:0/1104644207 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e5415e890 0x7f6e541f2fa0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c00b970 tx=0x7f6e4c00bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:08.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.270+0000 7f6e4a7fc700 1 -- 172.21.15.84:0/1104644207 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e4c00d8e0 con 0x7f6e5415e890 2023-07-14T11:17:08.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.270+0000 7f6e4a7fc700 1 -- 172.21.15.84:0/1104644207 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e4c00da60 con 0x7f6e5415e890 2023-07-14T11:17:08.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.270+0000 7f6e5bbff700 1 -- 172.21.15.84:0/1104644207 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e5414d6a0 con 0x7f6e5415e890 2023-07-14T11:17:08.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.270+0000 7f6e4a7fc700 1 -- 172.21.15.84:0/1104644207 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e4c00de10 con 0x7f6e5415e890 2023-07-14T11:17:08.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.270+0000 7f6e5bbff700 1 -- 172.21.15.84:0/1104644207 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e5414fd50 con 0x7f6e5415e890 2023-07-14T11:17:08.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.271+0000 7f6e5bbff700 1 -- 172.21.15.84:0/1104644207 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e54066f00 con 0x7f6e5415e890 2023-07-14T11:17:08.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.272+0000 7f6e4a7fc700 1 -- 172.21.15.84:0/1104644207 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 9) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f6e4c015420 con 0x7f6e5415e890 2023-07-14T11:17:08.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.273+0000 7f6e4a7fc700 1 --2- 172.21.15.84:0/1104644207 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6e3806ae90 0x7f6e3806d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:08.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.273+0000 7f6e4a7fc700 1 -- 172.21.15.84:0/1104644207 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6e4c011070 con 0x7f6e5415e890 2023-07-14T11:17:08.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.273+0000 7f6e5999b700 1 --2- 172.21.15.84:0/1104644207 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6e3806ae90 0x7f6e3806d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:08.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.274+0000 7f6e5999b700 1 --2- 172.21.15.84:0/1104644207 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6e3806ae90 0x7f6e3806d340 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6e500090b0 tx=0x7f6e5001c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:08.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.277+0000 7f6e4a7fc700 1 -- 172.21.15.84:0/1104644207 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f6e4c04e330 con 0x7f6e5415e890 2023-07-14T11:17:08.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.550+0000 7f6e5bbff700 1 -- 172.21.15.84:0/1104644207 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f6e5404e280 con 0x7f6e5415e890 2023-07-14T11:17:08.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.550+0000 7f6e4a7fc700 1 -- 172.21.15.84:0/1104644207 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f6e4c0544f0 con 0x7f6e5415e890 2023-07-14T11:17:08.554 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:17:08.555 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-07-14T11:17:08.555 INFO:teuthology.orchestra.run.smithi084.stdout: "auth_dump": [ 2023-07-14T11:17:08.555 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:17:08.555 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.a", 2023-07-14T11:17:08.555 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCJLbFkprwsJhAAIZa03ewirqLtc0mn7ki6Vw==", 2023-07-14T11:17:08.555 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:17:08.555 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-07-14T11:17:08.555 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-07-14T11:17:08.556 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-07-14T11:17:08.556 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:17:08.556 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:17:08.556 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:17:08.556 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:17:08.556 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.b", 2023-07-14T11:17:08.556 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCKLbFkfYOoAhAAQcpDkBRXNSDyfnZp1A/BJw==", 2023-07-14T11:17:08.557 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:17:08.557 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-07-14T11:17:08.557 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-07-14T11:17:08.557 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-07-14T11:17:08.557 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:17:08.557 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:17:08.557 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:17:08.557 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:17:08.558 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.c", 2023-07-14T11:17:08.558 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCJLbFk9MZ4MhAAY2CpAoK7Bx7NyoccpK7MLA==", 2023-07-14T11:17:08.558 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:17:08.558 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-07-14T11:17:08.558 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-07-14T11:17:08.558 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-07-14T11:17:08.558 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:17:08.558 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:17:08.559 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:17:08.559 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:17:08.559 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.d", 2023-07-14T11:17:08.559 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCKLbFkfxxFDhAAFPvGUrg0RW1nYTAdACvEAA==", 2023-07-14T11:17:08.559 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:17:08.559 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-07-14T11:17:08.559 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-07-14T11:17:08.560 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-07-14T11:17:08.560 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:17:08.560 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:17:08.560 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:17:08.560 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:17:08.560 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.0", 2023-07-14T11:17:08.560 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCOLbFkd18mDBAA2tneRYzoJkGwIZNDW6+Z7w==", 2023-07-14T11:17:08.560 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:17:08.561 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-07-14T11:17:08.561 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-07-14T11:17:08.561 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:17:08.561 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:17:08.561 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:17:08.561 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:17:08.561 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.1", 2023-07-14T11:17:08.561 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCRLbFkwBlAEBAAoEG62Dam3KHra4oNXBGyfw==", 2023-07-14T11:17:08.562 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:17:08.562 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-07-14T11:17:08.562 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-07-14T11:17:08.562 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:17:08.562 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:17:08.562 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:17:08.562 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:17:08.563 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.2", 2023-07-14T11:17:08.563 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCULbFkCln2ExAAKM+sAwMtcH6yEbNUqHbN4Q==", 2023-07-14T11:17:08.563 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:17:08.563 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-07-14T11:17:08.563 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-07-14T11:17:08.563 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:17:08.563 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:17:08.564 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:17:08.564 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:17:08.564 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.3", 2023-07-14T11:17:08.564 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCXLbFk0ZGgFxAAgOEUoX5jqzic6bOxtG7qSw==", 2023-07-14T11:17:08.564 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:17:08.564 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-07-14T11:17:08.565 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-07-14T11:17:08.565 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:17:08.565 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:17:08.565 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:17:08.565 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:17:08.565 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.4", 2023-07-14T11:17:08.565 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCdLbFknOESLBAA9usIfRfkbbLiMOCvUR+pXQ==", 2023-07-14T11:17:08.565 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:17:08.566 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-07-14T11:17:08.566 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-07-14T11:17:08.566 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:17:08.566 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:17:08.566 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:17:08.566 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:17:08.566 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.5", 2023-07-14T11:17:08.566 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCgLbFk+Rk/LxAAGqk3ueTaGaSINPuxoW53Gw==", 2023-07-14T11:17:08.567 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:17:08.567 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-07-14T11:17:08.567 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-07-14T11:17:08.567 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:17:08.567 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:17:08.567 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:17:08.567 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:17:08.568 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.6", 2023-07-14T11:17:08.568 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCjLbFk1/QfMxAABnWxus7LXfn7R0iwMVTWiA==", 2023-07-14T11:17:08.568 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:17:08.568 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-07-14T11:17:08.568 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-07-14T11:17:08.568 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:17:08.568 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:17:08.568 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:17:08.569 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:17:08.569 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.7", 2023-07-14T11:17:08.569 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCmLbFkNnhmNhAAz85GY1Sb1NuKINJCyWpPGQ==", 2023-07-14T11:17:08.569 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:17:08.569 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-07-14T11:17:08.569 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-07-14T11:17:08.569 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:17:08.569 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:17:08.570 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:17:08.570 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:17:08.570 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.0", 2023-07-14T11:17:08.570 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCKLbFkKSl5GBAAwPK4Zs6+gv/6YKHh4JI3WA==", 2023-07-14T11:17:08.570 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:17:08.570 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-07-14T11:17:08.570 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow r", 2023-07-14T11:17:08.570 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-14T11:17:08.571 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:17:08.571 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:17:08.571 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:17:08.571 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.1", 2023-07-14T11:17:08.571 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCKLbFkieNzJxAARri6UfCWdcXA3NpeFfvILw==", 2023-07-14T11:17:08.571 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:17:08.571 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-07-14T11:17:08.572 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-07-14T11:17:08.572 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-07-14T11:17:08.572 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-07-14T11:17:08.572 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:17:08.572 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:17:08.572 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:17:08.572 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.2", 2023-07-14T11:17:08.573 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCKLbFkLhv6HxAACUfTJK618qRsXETPJagZXQ==", 2023-07-14T11:17:08.573 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:17:08.573 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-07-14T11:17:08.573 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-07-14T11:17:08.573 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-07-14T11:17:08.573 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-07-14T11:17:08.573 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:17:08.574 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:17:08.574 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:17:08.574 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.3", 2023-07-14T11:17:08.574 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCKLbFka9HxLhAA4OsQY/t7A2FIYLEyYgJ19Q==", 2023-07-14T11:17:08.574 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:17:08.574 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-07-14T11:17:08.574 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-07-14T11:17:08.574 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-07-14T11:17:08.575 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-07-14T11:17:08.575 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:17:08.575 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:17:08.575 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:17:08.575 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.admin", 2023-07-14T11:17:08.575 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCILbFkmVPbKRAAffsYBVR51b7R8sXpbdF0MQ==", 2023-07-14T11:17:08.575 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:17:08.575 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow *", 2023-07-14T11:17:08.576 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-07-14T11:17:08.576 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-07-14T11:17:08.576 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:17:08.576 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:17:08.576 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:17:08.576 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:17:08.576 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mgr.x", 2023-07-14T11:17:08.576 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCJLbFk28xTHhAAAlmm5bW9VTtgE+OujO+G2w==", 2023-07-14T11:17:08.577 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:17:08.577 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow *", 2023-07-14T11:17:08.577 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile mgr", 2023-07-14T11:17:08.577 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:17:08.577 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:17:08.577 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:17:08.577 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:17:08.578 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mgr.y", 2023-07-14T11:17:08.578 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCJLbFk5dM1FhAAJWbB+GogsfcSkaBdHrFg4A==", 2023-07-14T11:17:08.578 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:17:08.578 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow *", 2023-07-14T11:17:08.578 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile mgr", 2023-07-14T11:17:08.578 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:17:08.578 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:17:08.578 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:17:08.579 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2023-07-14T11:17:08.579 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-07-14T11:17:08.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.552+0000 7f6e5bbff700 1 -- 172.21.15.84:0/1104644207 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6e3806ae90 msgr2=0x7f6e3806d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:08.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.552+0000 7f6e5bbff700 1 --2- 172.21.15.84:0/1104644207 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6e3806ae90 0x7f6e3806d340 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6e500090b0 tx=0x7f6e5001c040 comp rx=0 tx=0).stop 2023-07-14T11:17:08.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.553+0000 7f6e5bbff700 1 -- 172.21.15.84:0/1104644207 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e5415e890 msgr2=0x7f6e541f2fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:08.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.553+0000 7f6e5bbff700 1 --2- 172.21.15.84:0/1104644207 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e5415e890 0x7f6e541f2fa0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c00b970 tx=0x7f6e4c00bc80 comp rx=0 tx=0).stop 2023-07-14T11:17:08.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.553+0000 7f6e5bbff700 1 -- 172.21.15.84:0/1104644207 shutdown_connections 2023-07-14T11:17:08.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.553+0000 7f6e5bbff700 1 --2- 172.21.15.84:0/1104644207 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6e3806ae90 0x7f6e3806d340 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:08.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.553+0000 7f6e5bbff700 1 --2- 172.21.15.84:0/1104644207 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e540b3780 0x7f6e541e61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:08.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.553+0000 7f6e5bbff700 1 --2- 172.21.15.84:0/1104644207 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e5415e890 0x7f6e541f2fa0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:08.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.553+0000 7f6e5bbff700 1 --2- 172.21.15.84:0/1104644207 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e5415afd0 0x7f6e5414c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:08.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.553+0000 7f6e5bbff700 1 -- 172.21.15.84:0/1104644207 >> 172.21.15.84:0/1104644207 conn(0x7f6e54069f30 msgr2=0x7f6e540cd5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:08.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.553+0000 7f6e5bbff700 1 -- 172.21.15.84:0/1104644207 shutdown_connections 2023-07-14T11:17:08.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.553+0000 7f6e5bbff700 1 -- 172.21.15.84:0/1104644207 wait complete. 2023-07-14T11:17:08.582 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:17:08.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.774+0000 7f5d795ff700 1 Processor -- start 2023-07-14T11:17:08.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.774+0000 7f5d795ff700 1 -- start start 2023-07-14T11:17:08.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.775+0000 7f5d795ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5d74160030 0x7f5d7406c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:08.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.775+0000 7f5d795ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5d740d1160 0x7f5d740b0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:08.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.775+0000 7f5d795ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d740d2cc0 con 0x7f5d740b5cd0 2023-07-14T11:17:08.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.775+0000 7f5d795ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d740afbb0 con 0x7f5d74160030 2023-07-14T11:17:08.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.775+0000 7f5d795ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d740afe90 con 0x7f5d740d1160 2023-07-14T11:17:08.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.775+0000 7f5d72ffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5d74160030 0x7f5d7406c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:08.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.775+0000 7f5d727fc700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f5d740b5cd0 0x7f5d740d0a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:39286/0 (socket says 172.21.15.84:39286) 2023-07-14T11:17:08.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.775+0000 7f5d727fc700 1 -- 172.21.15.84:0/1775763950 learned_addr learned my addr 172.21.15.84:0/1775763950 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:17:08.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.775+0000 7f5d737fe700 1 --2- 172.21.15.84:0/1775763950 >> v2:172.21.15.179:3300/0 conn(0x7f5d740d1160 0x7f5d740b0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:08.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.775+0000 7f5d72ffd700 1 -- 172.21.15.84:0/1775763950 >> v2:172.21.15.179:3300/0 conn(0x7f5d740d1160 msgr2=0x7f5d740b0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:08.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.775+0000 7f5d72ffd700 1 --2- 172.21.15.84:0/1775763950 >> v2:172.21.15.179:3300/0 conn(0x7f5d740d1160 0x7f5d740b0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:08.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.775+0000 7f5d72ffd700 1 -- 172.21.15.84:0/1775763950 >> v1:172.21.15.84:6789/0 conn(0x7f5d740b5cd0 legacy=0x7f5d740d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:08.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.776+0000 7f5d71ffb700 1 -- 172.21.15.84:0/1775763950 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 901642398 0 0) 0x7f5d740d2cc0 con 0x7f5d740b5cd0 2023-07-14T11:17:08.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.776+0000 7f5d72ffd700 1 -- 172.21.15.84:0/1775763950 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d740b0170 con 0x7f5d74160030 2023-07-14T11:17:08.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.776+0000 7f5d72ffd700 1 --2- 172.21.15.84:0/1775763950 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d74160030 0x7f5d7406c0f0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f5d7406a5f0 tx=0x7f5d64009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1444d0e692caac92 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:08.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.776+0000 7f5d71ffb700 1 -- 172.21.15.84:0/1775763950 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d64011830 con 0x7f5d74160030 2023-07-14T11:17:08.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.776+0000 7f5d71ffb700 1 -- 172.21.15.84:0/1775763950 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d64011990 con 0x7f5d74160030 2023-07-14T11:17:08.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.776+0000 7f5d71ffb700 1 -- 172.21.15.84:0/1775763950 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d64011d20 con 0x7f5d74160030 2023-07-14T11:17:08.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.776+0000 7f5d795ff700 1 -- 172.21.15.84:0/1775763950 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d74160030 msgr2=0x7f5d7406c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:08.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.777+0000 7f5d795ff700 1 --2- 172.21.15.84:0/1775763950 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d74160030 0x7f5d7406c0f0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f5d7406a5f0 tx=0x7f5d64009b20 comp rx=0 tx=0).stop 2023-07-14T11:17:08.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.777+0000 7f5d795ff700 1 -- 172.21.15.84:0/1775763950 shutdown_connections 2023-07-14T11:17:08.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.777+0000 7f5d795ff700 1 --2- 172.21.15.84:0/1775763950 >> v2:172.21.15.179:3300/0 conn(0x7f5d740d1160 0x7f5d740b0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:08.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.777+0000 7f5d795ff700 1 --2- 172.21.15.84:0/1775763950 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d74160030 0x7f5d7406c0f0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:08.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.777+0000 7f5d795ff700 1 -- 172.21.15.84:0/1775763950 >> 172.21.15.84:0/1775763950 conn(0x7f5d7409c190 msgr2=0x7f5d740d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:08.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.777+0000 7f5d795ff700 1 -- 172.21.15.84:0/1775763950 shutdown_connections 2023-07-14T11:17:08.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.777+0000 7f5d795ff700 1 -- 172.21.15.84:0/1775763950 wait complete. 2023-07-14T11:17:08.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.778+0000 7f5d795ff700 1 Processor -- start 2023-07-14T11:17:08.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.779+0000 7f5d795ff700 1 -- start start 2023-07-14T11:17:08.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.780+0000 7f5d795ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d740b5cd0 0x7f5d74158990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:08.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.780+0000 7f5d795ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d740d1160 0x7f5d741544c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:08.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.780+0000 7f5d795ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d74160030 0x7f5d740b8070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:08.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.780+0000 7f5d795ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d741578f0 con 0x7f5d74160030 2023-07-14T11:17:08.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.780+0000 7f5d795ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d74157bd0 con 0x7f5d740d1160 2023-07-14T11:17:08.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.780+0000 7f5d795ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d74157eb0 con 0x7f5d740b5cd0 2023-07-14T11:17:08.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.780+0000 7f5d737fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d74160030 0x7f5d740b8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:08.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.780+0000 7f5d737fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d74160030 0x7f5d740b8070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46234/0 (socket says 172.21.15.84:46234) 2023-07-14T11:17:08.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.780+0000 7f5d737fe700 1 -- 172.21.15.84:0/3777865457 learned_addr learned my addr 172.21.15.84:0/3777865457 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:08.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.780+0000 7f5d72ffd700 1 --2- 172.21.15.84:0/3777865457 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d740b5cd0 0x7f5d74158990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:08.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.780+0000 7f5d727fc700 1 --2- 172.21.15.84:0/3777865457 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d740d1160 0x7f5d741544c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:08.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.780+0000 7f5d737fe700 1 -- 172.21.15.84:0/3777865457 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d740b5cd0 msgr2=0x7f5d74158990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:08.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.780+0000 7f5d737fe700 1 --2- 172.21.15.84:0/3777865457 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d740b5cd0 0x7f5d74158990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:08.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.780+0000 7f5d737fe700 1 -- 172.21.15.84:0/3777865457 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d740d1160 msgr2=0x7f5d741544c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:08.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.780+0000 7f5d737fe700 1 --2- 172.21.15.84:0/3777865457 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d740d1160 0x7f5d741544c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:08.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.780+0000 7f5d737fe700 1 -- 172.21.15.84:0/3777865457 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d640094a0 con 0x7f5d74160030 2023-07-14T11:17:08.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.780+0000 7f5d72ffd700 1 --2- 172.21.15.84:0/3777865457 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d740b5cd0 0x7f5d74158990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:17:08.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.780+0000 7f5d727fc700 1 --2- 172.21.15.84:0/3777865457 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d740d1160 0x7f5d741544c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:17:08.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.781+0000 7f5d737fe700 1 --2- 172.21.15.84:0/3777865457 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d74160030 0x7f5d740b8070 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c007e30 tx=0x7f5d6c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:08.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.781+0000 7f5d5b7fe700 1 -- 172.21.15.84:0/3777865457 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6c00eea0 con 0x7f5d74160030 2023-07-14T11:17:08.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.781+0000 7f5d5b7fe700 1 -- 172.21.15.84:0/3777865457 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d6c014420 con 0x7f5d74160030 2023-07-14T11:17:08.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.781+0000 7f5d5b7fe700 1 -- 172.21.15.84:0/3777865457 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6c0147d0 con 0x7f5d74160030 2023-07-14T11:17:08.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.781+0000 7f5d795ff700 1 -- 172.21.15.84:0/3777865457 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d74158190 con 0x7f5d74160030 2023-07-14T11:17:08.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.781+0000 7f5d795ff700 1 -- 172.21.15.84:0/3777865457 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d74154a00 con 0x7f5d74160030 2023-07-14T11:17:08.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.782+0000 7f5d795ff700 1 -- 172.21.15.84:0/3777865457 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d741586b0 con 0x7f5d74160030 2023-07-14T11:17:08.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.783+0000 7f5d5b7fe700 1 -- 172.21.15.84:0/3777865457 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 9) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f5d6c014930 con 0x7f5d74160030 2023-07-14T11:17:08.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.784+0000 7f5d5b7fe700 1 --2- 172.21.15.84:0/3777865457 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f5d6006ae90 0x7f5d6006d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:08.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.784+0000 7f5d5b7fe700 1 -- 172.21.15.84:0/3777865457 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f5d6c089cf0 con 0x7f5d74160030 2023-07-14T11:17:08.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.784+0000 7f5d72ffd700 1 --2- 172.21.15.84:0/3777865457 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f5d6006ae90 0x7f5d6006d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:08.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.785+0000 7f5d72ffd700 1 --2- 172.21.15.84:0/3777865457 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f5d6006ae90 0x7f5d6006d340 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f5d640090b0 tx=0x7f5d64008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:08.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.788+0000 7f5d5b7fe700 1 -- 172.21.15.84:0/3777865457 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f5d741586b0 con 0x7f5d74160030 2023-07-14T11:17:08.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.987+0000 7f5d795ff700 1 -- 172.21.15.84:0/3777865457 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5d74072420 con 0x7f5d74160030 2023-07-14T11:17:08.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.988+0000 7f5d5b7fe700 1 -- 172.21.15.84:0/3777865457 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+14615 (secure 0 0 0) 0x7f5d6c054dd0 con 0x7f5d74160030 2023-07-14T11:17:08.992 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:17:08.992 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":59,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:17:08.054915+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:17:08.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.991+0000 7f5d795ff700 1 -- 172.21.15.84:0/3777865457 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f5d6006ae90 msgr2=0x7f5d6006d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:08.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.991+0000 7f5d795ff700 1 --2- 172.21.15.84:0/3777865457 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f5d6006ae90 0x7f5d6006d340 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f5d640090b0 tx=0x7f5d64008030 comp rx=0 tx=0).stop 2023-07-14T11:17:08.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.991+0000 7f5d795ff700 1 -- 172.21.15.84:0/3777865457 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d74160030 msgr2=0x7f5d740b8070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:08.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.991+0000 7f5d795ff700 1 --2- 172.21.15.84:0/3777865457 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d74160030 0x7f5d740b8070 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c007e30 tx=0x7f5d6c00e3c0 comp rx=0 tx=0).stop 2023-07-14T11:17:08.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.991+0000 7f5d795ff700 1 -- 172.21.15.84:0/3777865457 shutdown_connections 2023-07-14T11:17:08.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.991+0000 7f5d795ff700 1 --2- 172.21.15.84:0/3777865457 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f5d6006ae90 0x7f5d6006d340 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:08.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.991+0000 7f5d795ff700 1 --2- 172.21.15.84:0/3777865457 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d740b5cd0 0x7f5d74158990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:08.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.991+0000 7f5d795ff700 1 --2- 172.21.15.84:0/3777865457 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d74160030 0x7f5d740b8070 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:08.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.991+0000 7f5d795ff700 1 --2- 172.21.15.84:0/3777865457 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d740d1160 0x7f5d741544c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:08.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.991+0000 7f5d795ff700 1 -- 172.21.15.84:0/3777865457 >> 172.21.15.84:0/3777865457 conn(0x7f5d7409c190 msgr2=0x7f5d7406a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:08.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.991+0000 7f5d795ff700 1 -- 172.21.15.84:0/3777865457 shutdown_connections 2023-07-14T11:17:08.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:08.991+0000 7f5d795ff700 1 -- 172.21.15.84:0/3777865457 wait complete. 2023-07-14T11:17:09.012 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T11:13:00.125395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T11:13:06.803994+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T11:17:09.013 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T11:17:09.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.209+0000 7fbcc0dff700 1 Processor -- start 2023-07-14T11:17:09.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.209+0000 7fbcc0dff700 1 -- start start 2023-07-14T11:17:09.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.211+0000 7fbcc0dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcbc06c8b0 0x7fbcbc1674e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:09.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.211+0000 7fbcc0dff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcbc15ca90 con 0x7fbcbc0afc40 2023-07-14T11:17:09.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.211+0000 7fbcc0dff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcbc0b3450 con 0x7fbcbc15c6c0 2023-07-14T11:17:09.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.211+0000 7fbcc0dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcbc06b0e0 con 0x7fbcbc06c8b0 2023-07-14T11:17:09.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.211+0000 7fbcb9d9b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fbcbc0afc40 0x7fbcbc0b2d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:43122/0 (socket says 172.21.15.84:43122) 2023-07-14T11:17:09.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.211+0000 7fbcb9d9b700 1 -- 172.21.15.84:0/196096318 learned_addr learned my addr 172.21.15.84:0/196096318 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:17:09.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.211+0000 7fbcbad9d700 1 --2- 172.21.15.84:0/196096318 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcbc06c8b0 0x7fbcbc1674e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:09.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.211+0000 7fbcb959a700 1 -- 172.21.15.84:0/196096318 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2172701428 0 0) 0x7fbcb0001110 con 0x7fbcbc0afc40 2023-07-14T11:17:09.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.211+0000 7fbcb959a700 1 -- 172.21.15.84:0/196096318 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbca40035b0 con 0x7fbcbc0afc40 2023-07-14T11:17:09.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.212+0000 7fbcb959a700 1 -- 172.21.15.84:0/196096318 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 77029084 0 0) 0x7fbcbc0b3450 con 0x7fbcbc15c6c0 2023-07-14T11:17:09.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.212+0000 7fbcb959a700 1 -- 172.21.15.84:0/196096318 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbcb0001110 con 0x7fbcbc15c6c0 2023-07-14T11:17:09.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.212+0000 7fbcbad9d700 1 -- 172.21.15.84:0/196096318 >> v1:172.21.15.179:6789/0 conn(0x7fbcbc15c6c0 legacy=0x7fbcbc0b2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:09.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.212+0000 7fbcbad9d700 1 -- 172.21.15.84:0/196096318 >> v1:172.21.15.84:6789/0 conn(0x7fbcbc0afc40 legacy=0x7fbcbc0b2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:09.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.212+0000 7fbcbad9d700 1 -- 172.21.15.84:0/196096318 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcbc0d0370 con 0x7fbcbc06c8b0 2023-07-14T11:17:09.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.212+0000 7fbcbad9d700 1 --2- 172.21.15.84:0/196096318 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcbc06c8b0 0x7fbcbc1674e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbcb4009df0 tx=0x7fbcb400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f942e47d488a4e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:09.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.212+0000 7fbcb959a700 1 -- 172.21.15.84:0/196096318 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb400e070 con 0x7fbcbc06c8b0 2023-07-14T11:17:09.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.212+0000 7fbcb959a700 1 -- 172.21.15.84:0/196096318 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcb400bae0 con 0x7fbcbc06c8b0 2023-07-14T11:17:09.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.212+0000 7fbcb959a700 1 -- 172.21.15.84:0/196096318 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb400be90 con 0x7fbcbc06c8b0 2023-07-14T11:17:09.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.213+0000 7fbcc0dff700 1 -- 172.21.15.84:0/196096318 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcbc06c8b0 msgr2=0x7fbcbc1674e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:09.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.213+0000 7fbcc0dff700 1 --2- 172.21.15.84:0/196096318 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcbc06c8b0 0x7fbcbc1674e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbcb4009df0 tx=0x7fbcb400b330 comp rx=0 tx=0).stop 2023-07-14T11:17:09.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.213+0000 7fbcc0dff700 1 -- 172.21.15.84:0/196096318 shutdown_connections 2023-07-14T11:17:09.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.213+0000 7fbcc0dff700 1 --2- 172.21.15.84:0/196096318 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcbc06c8b0 0x7fbcbc1674e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:09.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.213+0000 7fbcc0dff700 1 -- 172.21.15.84:0/196096318 >> 172.21.15.84:0/196096318 conn(0x7fbcbc06d980 msgr2=0x7fbcbc06dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:09.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.213+0000 7fbcc0dff700 1 -- 172.21.15.84:0/196096318 shutdown_connections 2023-07-14T11:17:09.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.213+0000 7fbcc0dff700 1 -- 172.21.15.84:0/196096318 wait complete. 2023-07-14T11:17:09.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.215+0000 7fbcc0dff700 1 Processor -- start 2023-07-14T11:17:09.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.215+0000 7fbcc0dff700 1 -- start start 2023-07-14T11:17:09.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.216+0000 7fbcc0dff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbcbc06c8b0 0x7fbcbc155c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:09.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.216+0000 7fbcc0dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcbc0afc40 0x7fbcbc1555e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:09.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.216+0000 7fbcc0dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbcbc15c6c0 0x7fbcbc0b5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:09.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.216+0000 7fbcc0dff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcbc0ad600 con 0x7fbcbc06c8b0 2023-07-14T11:17:09.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.216+0000 7fbcc0dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcbc0cca60 con 0x7fbcbc15c6c0 2023-07-14T11:17:09.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.216+0000 7fbcc0dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcbc0acd60 con 0x7fbcbc0afc40 2023-07-14T11:17:09.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.216+0000 7fbcba59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbcbc06c8b0 0x7fbcbc155c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:09.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.216+0000 7fbcba59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbcbc06c8b0 0x7fbcbc155c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35076/0 (socket says 172.21.15.84:35076) 2023-07-14T11:17:09.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.216+0000 7fbcba59c700 1 -- 172.21.15.84:0/4220181577 learned_addr learned my addr 172.21.15.84:0/4220181577 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:09.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.216+0000 7fbcb9d9b700 1 --2- 172.21.15.84:0/4220181577 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcbc0afc40 0x7fbcbc1555e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:09.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.216+0000 7fbcbad9d700 1 --2- 172.21.15.84:0/4220181577 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbcbc15c6c0 0x7fbcbc0b5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:09.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.216+0000 7fbcba59c700 1 -- 172.21.15.84:0/4220181577 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcbc0afc40 msgr2=0x7fbcbc1555e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:09.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.216+0000 7fbcba59c700 1 --2- 172.21.15.84:0/4220181577 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcbc0afc40 0x7fbcbc1555e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:09.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.216+0000 7fbcba59c700 1 -- 172.21.15.84:0/4220181577 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbcbc15c6c0 msgr2=0x7fbcbc0b5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:09.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.216+0000 7fbcba59c700 1 --2- 172.21.15.84:0/4220181577 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbcbc15c6c0 0x7fbcbc0b5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:09.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.216+0000 7fbcba59c700 1 -- 172.21.15.84:0/4220181577 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcb4009a70 con 0x7fbcbc06c8b0 2023-07-14T11:17:09.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.217+0000 7fbcba59c700 1 --2- 172.21.15.84:0/4220181577 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbcbc06c8b0 0x7fbcbc155c70 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fbcac00c520 tx=0x7fbcac00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:09.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.217+0000 7fbcaaffd700 1 -- 172.21.15.84:0/4220181577 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcac0052d0 con 0x7fbcbc06c8b0 2023-07-14T11:17:09.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.217+0000 7fbcaaffd700 1 -- 172.21.15.84:0/4220181577 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcac005430 con 0x7fbcbc06c8b0 2023-07-14T11:17:09.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.217+0000 7fbcc0dff700 1 -- 172.21.15.84:0/4220181577 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcbc0ad040 con 0x7fbcbc06c8b0 2023-07-14T11:17:09.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.217+0000 7fbcaaffd700 1 -- 172.21.15.84:0/4220181577 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcac0038c0 con 0x7fbcbc06c8b0 2023-07-14T11:17:09.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.217+0000 7fbcc0dff700 1 -- 172.21.15.84:0/4220181577 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcbc156380 con 0x7fbcbc06c8b0 2023-07-14T11:17:09.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.218+0000 7fbcc0dff700 1 -- 172.21.15.84:0/4220181577 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcbc156540 con 0x7fbcbc06c8b0 2023-07-14T11:17:09.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.219+0000 7fbcaaffd700 1 -- 172.21.15.84:0/4220181577 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 9) v1 ==== 89190+0+0 (secure 0 0 0) 0x7fbcac003a20 con 0x7fbcbc06c8b0 2023-07-14T11:17:09.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.220+0000 7fbcaaffd700 1 --2- 172.21.15.84:0/4220181577 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fbc9c06ae90 0x7fbc9c06d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:09.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.220+0000 7fbcaaffd700 1 -- 172.21.15.84:0/4220181577 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fbcac088900 con 0x7fbcbc06c8b0 2023-07-14T11:17:09.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.220+0000 7fbcb9d9b700 1 --2- 172.21.15.84:0/4220181577 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fbc9c06ae90 0x7fbc9c06d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:09.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.221+0000 7fbcb9d9b700 1 --2- 172.21.15.84:0/4220181577 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fbc9c06ae90 0x7fbc9c06d340 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc1f5660 tx=0x7fbcb0007dc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:09.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.225+0000 7fbcaaffd700 1 -- 172.21.15.84:0/4220181577 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fbcac0539e0 con 0x7fbcbc06c8b0 2023-07-14T11:17:09.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.422+0000 7fbcc0dff700 1 -- 172.21.15.84:0/4220181577 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbcbc0cc7c0 con 0x7fbcbc06c8b0 2023-07-14T11:17:09.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.423+0000 7fbcaaffd700 1 -- 172.21.15.84:0/4220181577 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v59) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbcac017020 con 0x7fbcbc06c8b0 2023-07-14T11:17:09.426 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-07-14T11:17:09.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.425+0000 7fbcc0dff700 1 -- 172.21.15.84:0/4220181577 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fbc9c06ae90 msgr2=0x7fbc9c06d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:09.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.425+0000 7fbcc0dff700 1 --2- 172.21.15.84:0/4220181577 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fbc9c06ae90 0x7fbc9c06d340 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc1f5660 tx=0x7fbcb0007dc0 comp rx=0 tx=0).stop 2023-07-14T11:17:09.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.425+0000 7fbcc0dff700 1 -- 172.21.15.84:0/4220181577 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbcbc06c8b0 msgr2=0x7fbcbc155c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:09.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.425+0000 7fbcc0dff700 1 --2- 172.21.15.84:0/4220181577 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbcbc06c8b0 0x7fbcbc155c70 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fbcac00c520 tx=0x7fbcac00c830 comp rx=0 tx=0).stop 2023-07-14T11:17:09.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.425+0000 7fbcc0dff700 1 -- 172.21.15.84:0/4220181577 shutdown_connections 2023-07-14T11:17:09.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.425+0000 7fbcc0dff700 1 --2- 172.21.15.84:0/4220181577 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbcbc15c6c0 0x7fbcbc0b5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:09.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.425+0000 7fbcc0dff700 1 --2- 172.21.15.84:0/4220181577 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbcbc06c8b0 0x7fbcbc155c70 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:09.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.425+0000 7fbcc0dff700 1 --2- 172.21.15.84:0/4220181577 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fbc9c06ae90 0x7fbc9c06d340 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:09.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.425+0000 7fbcc0dff700 1 --2- 172.21.15.84:0/4220181577 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcbc0afc40 0x7fbcbc1555e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:09.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.425+0000 7fbcc0dff700 1 -- 172.21.15.84:0/4220181577 >> 172.21.15.84:0/4220181577 conn(0x7fbcbc06d980 msgr2=0x7fbcbc0b02e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:09.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.425+0000 7fbcc0dff700 1 -- 172.21.15.84:0/4220181577 shutdown_connections 2023-07-14T11:17:09.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.425+0000 7fbcc0dff700 1 -- 172.21.15.84:0/4220181577 wait complete. 2023-07-14T11:17:09.446 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T11:17:09.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.641+0000 7ff0751ff700 1 Processor -- start 2023-07-14T11:17:09.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.641+0000 7ff0751ff700 1 -- start start 2023-07-14T11:17:09.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.642+0000 7ff0751ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff0700b8660 0x7ff0700cd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:09.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.642+0000 7ff0751ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0700cd970 0x7ff0700b4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:09.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.642+0000 7ff0751ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0700d02a0 con 0x7ff0700b4da0 2023-07-14T11:17:09.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.642+0000 7ff0751ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0700b51c0 con 0x7ff0700b8660 2023-07-14T11:17:09.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.642+0000 7ff0751ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0700cfce0 con 0x7ff0700cd970 2023-07-14T11:17:09.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.643+0000 7ff06ed9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff0700b8660 0x7ff0700cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:09.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.643+0000 7ff06ed9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff0700b8660 0x7ff0700cd430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35078/0 (socket says 172.21.15.84:35078) 2023-07-14T11:17:09.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.643+0000 7ff06ed9d700 1 -- 172.21.15.84:0/988528588 learned_addr learned my addr 172.21.15.84:0/988528588 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:09.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.643+0000 7ff067fff700 1 --2- 172.21.15.84:0/988528588 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0700cd970 0x7ff0700b4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:09.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.643+0000 7ff06ed9d700 1 -- 172.21.15.84:0/988528588 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0700cd970 msgr2=0x7ff0700b4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:09.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.643+0000 7ff06ed9d700 1 --2- 172.21.15.84:0/988528588 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0700cd970 0x7ff0700b4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:09.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.643+0000 7ff06ed9d700 1 -- 172.21.15.84:0/988528588 >> v1:172.21.15.179:6789/0 conn(0x7ff0700b4da0 legacy=0x7ff0701601f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:09.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.643+0000 7ff06ed9d700 1 -- 172.21.15.84:0/988528588 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0700cffc0 con 0x7ff0700b8660 2023-07-14T11:17:09.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.643+0000 7ff067fff700 1 --2- 172.21.15.84:0/988528588 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0700cd970 0x7ff0700b4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:17:09.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.643+0000 7ff06ed9d700 1 --2- 172.21.15.84:0/988528588 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0700b8660 0x7ff0700cd430 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7ff0600098f0 tx=0x7ff060009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=197775b1fdc2773a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:09.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.644+0000 7ff06e59c700 1 -- 172.21.15.84:0/988528588 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff060004230 con 0x7ff0700b8660 2023-07-14T11:17:09.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.644+0000 7ff06e59c700 1 -- 172.21.15.84:0/988528588 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff060004390 con 0x7ff0700b8660 2023-07-14T11:17:09.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.644+0000 7ff06e59c700 1 -- 172.21.15.84:0/988528588 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0600036a0 con 0x7ff0700b8660 2023-07-14T11:17:09.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.644+0000 7ff0751ff700 1 -- 172.21.15.84:0/988528588 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0700b8660 msgr2=0x7ff0700cd430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:09.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.644+0000 7ff0751ff700 1 --2- 172.21.15.84:0/988528588 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0700b8660 0x7ff0700cd430 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7ff0600098f0 tx=0x7ff060009c00 comp rx=0 tx=0).stop 2023-07-14T11:17:09.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.644+0000 7ff0751ff700 1 -- 172.21.15.84:0/988528588 shutdown_connections 2023-07-14T11:17:09.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.644+0000 7ff0751ff700 1 --2- 172.21.15.84:0/988528588 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0700b8660 0x7ff0700cd430 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:09.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.644+0000 7ff0751ff700 1 --2- 172.21.15.84:0/988528588 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0700cd970 0x7ff0700b4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:09.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.644+0000 7ff0751ff700 1 -- 172.21.15.84:0/988528588 >> 172.21.15.84:0/988528588 conn(0x7ff070066860 msgr2=0x7ff07006a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:09.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.644+0000 7ff0751ff700 1 -- 172.21.15.84:0/988528588 shutdown_connections 2023-07-14T11:17:09.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.644+0000 7ff0751ff700 1 -- 172.21.15.84:0/988528588 wait complete. 2023-07-14T11:17:09.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.646+0000 7ff0751ff700 1 Processor -- start 2023-07-14T11:17:09.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.646+0000 7ff0751ff700 1 -- start start 2023-07-14T11:17:09.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.647+0000 7ff0751ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff0700b4da0 0x7ff0701f67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:09.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.647+0000 7ff0751ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0700b8660 0x7ff070151eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:09.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.647+0000 7ff0751ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0700cd970 0x7ff0700c8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:09.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.647+0000 7ff0751ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0701f6d10 con 0x7ff0700cd970 2023-07-14T11:17:09.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.647+0000 7ff0751ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff070156cd0 con 0x7ff0700b4da0 2023-07-14T11:17:09.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.647+0000 7ff0751ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff070156fb0 con 0x7ff0700b8660 2023-07-14T11:17:09.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.647+0000 7ff06f59e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0700cd970 0x7ff0700c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:09.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.647+0000 7ff06f59e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0700cd970 0x7ff0700c8290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35086/0 (socket says 172.21.15.84:35086) 2023-07-14T11:17:09.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.648+0000 7ff06f59e700 1 -- 172.21.15.84:0/1553770171 learned_addr learned my addr 172.21.15.84:0/1553770171 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:09.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.648+0000 7ff067fff700 1 --2- 172.21.15.84:0/1553770171 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0700b8660 0x7ff070151eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:09.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.648+0000 7ff06ed9d700 1 --2- 172.21.15.84:0/1553770171 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff0700b4da0 0x7ff0701f67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:09.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.648+0000 7ff06f59e700 1 -- 172.21.15.84:0/1553770171 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0700b8660 msgr2=0x7ff070151eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:09.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.648+0000 7ff06f59e700 1 --2- 172.21.15.84:0/1553770171 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0700b8660 0x7ff070151eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:09.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.648+0000 7ff06f59e700 1 -- 172.21.15.84:0/1553770171 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff0700b4da0 msgr2=0x7ff0701f67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:09.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.648+0000 7ff06f59e700 1 --2- 172.21.15.84:0/1553770171 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff0700b4da0 0x7ff0701f67d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:09.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.648+0000 7ff06f59e700 1 -- 172.21.15.84:0/1553770171 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff060009550 con 0x7ff0700cd970 2023-07-14T11:17:09.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.648+0000 7ff06ed9d700 1 --2- 172.21.15.84:0/1553770171 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff0700b4da0 0x7ff0701f67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:17:09.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.648+0000 7ff06f59e700 1 --2- 172.21.15.84:0/1553770171 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0700cd970 0x7ff0700c8290 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7ff06800b970 tx=0x7ff06800bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:09.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.648+0000 7ff0677fe700 1 -- 172.21.15.84:0/1553770171 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06800c930 con 0x7ff0700cd970 2023-07-14T11:17:09.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.648+0000 7ff0677fe700 1 -- 172.21.15.84:0/1553770171 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff06800cad0 con 0x7ff0700cd970 2023-07-14T11:17:09.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.648+0000 7ff0751ff700 1 -- 172.21.15.84:0/1553770171 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff070157290 con 0x7ff0700cd970 2023-07-14T11:17:09.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.648+0000 7ff0677fe700 1 -- 172.21.15.84:0/1553770171 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06800ce80 con 0x7ff0700cd970 2023-07-14T11:17:09.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.649+0000 7ff0751ff700 1 -- 172.21.15.84:0/1553770171 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff070157850 con 0x7ff0700cd970 2023-07-14T11:17:09.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.650+0000 7ff0751ff700 1 -- 172.21.15.84:0/1553770171 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff070157a40 con 0x7ff0700cd970 2023-07-14T11:17:09.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.650+0000 7ff0677fe700 1 -- 172.21.15.84:0/1553770171 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 9) v1 ==== 89190+0+0 (secure 0 0 0) 0x7ff068014440 con 0x7ff0700cd970 2023-07-14T11:17:09.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.651+0000 7ff0677fe700 1 --2- 172.21.15.84:0/1553770171 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff05006ae90 0x7ff05006d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:09.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.651+0000 7ff0677fe700 1 -- 172.21.15.84:0/1553770171 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ff068088fe0 con 0x7ff0700cd970 2023-07-14T11:17:09.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.652+0000 7ff06ed9d700 1 --2- 172.21.15.84:0/1553770171 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff05006ae90 0x7ff05006d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:09.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.652+0000 7ff06ed9d700 1 --2- 172.21.15.84:0/1553770171 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff05006ae90 0x7ff05006d340 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ff060009130 tx=0x7ff060008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:09.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.656+0000 7ff0677fe700 1 -- 172.21.15.84:0/1553770171 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ff0680542a0 con 0x7ff0700cd970 2023-07-14T11:17:09.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.845+0000 7ff0751ff700 1 -- 172.21.15.84:0/1553770171 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff070074350 con 0x7ff0700cd970 2023-07-14T11:17:09.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.845+0000 7ff0677fe700 1 -- 172.21.15.84:0/1553770171 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v59) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff0680578c0 con 0x7ff0700cd970 2023-07-14T11:17:09.849 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-07-14T11:17:09.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.847+0000 7ff0751ff700 1 -- 172.21.15.84:0/1553770171 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff05006ae90 msgr2=0x7ff05006d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:09.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.847+0000 7ff0751ff700 1 --2- 172.21.15.84:0/1553770171 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff05006ae90 0x7ff05006d340 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ff060009130 tx=0x7ff060008030 comp rx=0 tx=0).stop 2023-07-14T11:17:09.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.847+0000 7ff0751ff700 1 -- 172.21.15.84:0/1553770171 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0700cd970 msgr2=0x7ff0700c8290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:09.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.847+0000 7ff0751ff700 1 --2- 172.21.15.84:0/1553770171 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0700cd970 0x7ff0700c8290 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7ff06800b970 tx=0x7ff06800bc80 comp rx=0 tx=0).stop 2023-07-14T11:17:09.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.848+0000 7ff0751ff700 1 -- 172.21.15.84:0/1553770171 shutdown_connections 2023-07-14T11:17:09.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.848+0000 7ff0751ff700 1 --2- 172.21.15.84:0/1553770171 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0700cd970 0x7ff0700c8290 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:09.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.848+0000 7ff0751ff700 1 --2- 172.21.15.84:0/1553770171 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff0700b4da0 0x7ff0701f67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:09.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.848+0000 7ff0751ff700 1 --2- 172.21.15.84:0/1553770171 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff05006ae90 0x7ff05006d340 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:09.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.848+0000 7ff0751ff700 1 --2- 172.21.15.84:0/1553770171 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0700b8660 0x7ff070151eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:09.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.848+0000 7ff0751ff700 1 -- 172.21.15.84:0/1553770171 >> 172.21.15.84:0/1553770171 conn(0x7ff070066860 msgr2=0x7ff0700b4590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:09.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.848+0000 7ff0751ff700 1 -- 172.21.15.84:0/1553770171 shutdown_connections 2023-07-14T11:17:09.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:09.848+0000 7ff0751ff700 1 -- 172.21.15.84:0/1553770171 wait complete. 2023-07-14T11:17:09.869 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-14T11:17:10.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.064+0000 7facb19ff700 1 Processor -- start 2023-07-14T11:17:10.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.064+0000 7facb19ff700 1 -- start start 2023-07-14T11:17:10.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.065+0000 7facb19ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7facac0d1220 0x7facac0b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:10.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.065+0000 7facb19ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7facac0b1e00 0x7facac0afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:10.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.065+0000 7facb19ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facac0d2ce0 con 0x7facac15c950 2023-07-14T11:17:10.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.065+0000 7facb19ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facac0b3350 con 0x7facac0d1220 2023-07-14T11:17:10.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.065+0000 7facb19ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facac0b3630 con 0x7facac0b1e00 2023-07-14T11:17:10.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.065+0000 7facaa7fc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7facac0d1220 0x7facac0b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:10.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.065+0000 7facaaffd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7facac15c950 0x7facac0d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:43138/0 (socket says 172.21.15.84:43138) 2023-07-14T11:17:10.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.065+0000 7facaaffd700 1 -- 172.21.15.84:0/1244676321 learned_addr learned my addr 172.21.15.84:0/1244676321 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:17:10.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.066+0000 7facab7fe700 1 --2- 172.21.15.84:0/1244676321 >> v2:172.21.15.179:3300/0 conn(0x7facac0b1e00 0x7facac0afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:10.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.066+0000 7facaa7fc700 1 -- 172.21.15.84:0/1244676321 >> v2:172.21.15.179:3300/0 conn(0x7facac0b1e00 msgr2=0x7facac0afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:10.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.066+0000 7facaa7fc700 1 --2- 172.21.15.84:0/1244676321 >> v2:172.21.15.179:3300/0 conn(0x7facac0b1e00 0x7facac0afac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:10.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.066+0000 7facaa7fc700 1 -- 172.21.15.84:0/1244676321 >> v1:172.21.15.84:6789/0 conn(0x7facac15c950 legacy=0x7facac0d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:10.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.066+0000 7facaa7fc700 1 -- 172.21.15.84:0/1244676321 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facac0b3910 con 0x7facac0d1220 2023-07-14T11:17:10.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.066+0000 7faca9ffb700 1 -- 172.21.15.84:0/1244676321 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1781659523 0 0) 0x7facac0d2ce0 con 0x7facac15c950 2023-07-14T11:17:10.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.066+0000 7facaa7fc700 1 --2- 172.21.15.84:0/1244676321 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facac0d1220 0x7facac0b43f0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7facac08c300 tx=0x7faca0009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ee67222bb05fd00 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:10.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.066+0000 7faca9ffb700 1 -- 172.21.15.84:0/1244676321 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca0011830 con 0x7facac0d1220 2023-07-14T11:17:10.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.066+0000 7faca9ffb700 1 -- 172.21.15.84:0/1244676321 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faca0011990 con 0x7facac0d1220 2023-07-14T11:17:10.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.066+0000 7faca9ffb700 1 -- 172.21.15.84:0/1244676321 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca0011d20 con 0x7facac0d1220 2023-07-14T11:17:10.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.067+0000 7facb19ff700 1 -- 172.21.15.84:0/1244676321 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facac0d1220 msgr2=0x7facac0b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:10.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.067+0000 7facb19ff700 1 --2- 172.21.15.84:0/1244676321 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facac0d1220 0x7facac0b43f0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7facac08c300 tx=0x7faca0009b20 comp rx=0 tx=0).stop 2023-07-14T11:17:10.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.067+0000 7facb19ff700 1 -- 172.21.15.84:0/1244676321 shutdown_connections 2023-07-14T11:17:10.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.067+0000 7facb19ff700 1 --2- 172.21.15.84:0/1244676321 >> v2:172.21.15.179:3300/0 conn(0x7facac0b1e00 0x7facac0afac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:10.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.067+0000 7facb19ff700 1 --2- 172.21.15.84:0/1244676321 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facac0d1220 0x7facac0b43f0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:10.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.067+0000 7facb19ff700 1 -- 172.21.15.84:0/1244676321 >> 172.21.15.84:0/1244676321 conn(0x7facac09c1d0 msgr2=0x7facac0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:10.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.067+0000 7facb19ff700 1 -- 172.21.15.84:0/1244676321 shutdown_connections 2023-07-14T11:17:10.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.067+0000 7facb19ff700 1 -- 172.21.15.84:0/1244676321 wait complete. 2023-07-14T11:17:10.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.069+0000 7facb19ff700 1 Processor -- start 2023-07-14T11:17:10.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.069+0000 7facb19ff700 1 -- start start 2023-07-14T11:17:10.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.070+0000 7facb19ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7facac0b1e00 0x7facac0b8620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:10.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.070+0000 7facb19ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7facac0d1220 0x7facac0b1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:10.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.070+0000 7facb19ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facac15c950 0x7facac0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:10.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.070+0000 7facb19ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facac0c6b00 con 0x7facac15c950 2023-07-14T11:17:10.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.070+0000 7facb19ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facac0b1bd0 con 0x7facac0b1e00 2023-07-14T11:17:10.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.070+0000 7facb19ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facac0b8c70 con 0x7facac0d1220 2023-07-14T11:17:10.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.070+0000 7facab7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facac15c950 0x7facac0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:10.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.070+0000 7facab7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facac15c950 0x7facac0b71b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35100/0 (socket says 172.21.15.84:35100) 2023-07-14T11:17:10.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.070+0000 7facab7fe700 1 -- 172.21.15.84:0/4250426534 learned_addr learned my addr 172.21.15.84:0/4250426534 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:10.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.070+0000 7facaaffd700 1 --2- 172.21.15.84:0/4250426534 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7facac0b1e00 0x7facac0b8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:10.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.070+0000 7facaa7fc700 1 --2- 172.21.15.84:0/4250426534 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7facac0d1220 0x7facac0b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:10.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.071+0000 7facab7fe700 1 -- 172.21.15.84:0/4250426534 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7facac0d1220 msgr2=0x7facac0b1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:10.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.071+0000 7facab7fe700 1 --2- 172.21.15.84:0/4250426534 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7facac0d1220 0x7facac0b1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:10.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.071+0000 7facab7fe700 1 -- 172.21.15.84:0/4250426534 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7facac0b1e00 msgr2=0x7facac0b8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:10.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.071+0000 7facab7fe700 1 --2- 172.21.15.84:0/4250426534 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7facac0b1e00 0x7facac0b8620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:10.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.071+0000 7facab7fe700 1 -- 172.21.15.84:0/4250426534 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faca00094a0 con 0x7facac15c950 2023-07-14T11:17:10.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.071+0000 7facab7fe700 1 --2- 172.21.15.84:0/4250426534 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facac15c950 0x7facac0b71b0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7faca4007e40 tx=0x7faca400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:10.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.071+0000 7fac93fff700 1 -- 172.21.15.84:0/4250426534 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca400ed30 con 0x7facac15c950 2023-07-14T11:17:10.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.071+0000 7fac93fff700 1 -- 172.21.15.84:0/4250426534 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faca4014420 con 0x7facac15c950 2023-07-14T11:17:10.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.071+0000 7facb19ff700 1 -- 172.21.15.84:0/4250426534 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facac0b7b10 con 0x7facac15c950 2023-07-14T11:17:10.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.071+0000 7fac93fff700 1 -- 172.21.15.84:0/4250426534 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca40147d0 con 0x7facac15c950 2023-07-14T11:17:10.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.071+0000 7facb19ff700 1 -- 172.21.15.84:0/4250426534 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facac0b80d0 con 0x7facac15c950 2023-07-14T11:17:10.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.072+0000 7facb19ff700 1 -- 172.21.15.84:0/4250426534 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facac06a3e0 con 0x7facac15c950 2023-07-14T11:17:10.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.073+0000 7fac93fff700 1 -- 172.21.15.84:0/4250426534 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 9) v1 ==== 89190+0+0 (secure 0 0 0) 0x7faca4014930 con 0x7facac15c950 2023-07-14T11:17:10.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.075+0000 7fac93fff700 1 --2- 172.21.15.84:0/4250426534 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fac9806ae90 0x7fac9806d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:10.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.075+0000 7fac93fff700 1 -- 172.21.15.84:0/4250426534 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5210+0+0 (secure 0 0 0) 0x7faca4089b40 con 0x7facac15c950 2023-07-14T11:17:10.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.075+0000 7facaaffd700 1 --2- 172.21.15.84:0/4250426534 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fac9806ae90 0x7fac9806d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:10.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.075+0000 7facaaffd700 1 --2- 172.21.15.84:0/4250426534 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fac9806ae90 0x7fac9806d340 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fac9c007fd0 tx=0x7fac9c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:10.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.079+0000 7fac93fff700 1 -- 172.21.15.84:0/4250426534 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7faca4054d70 con 0x7facac15c950 2023-07-14T11:17:10.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.280+0000 7facb19ff700 1 -- 172.21.15.84:0/4250426534 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7facac04e280 con 0x7facac15c950 2023-07-14T11:17:10.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.281+0000 7fac93fff700 1 -- 172.21.15.84:0/4250426534 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v59) v1 ==== 84+0+126 (secure 0 0 0) 0x7faca4058390 con 0x7facac15c950 2023-07-14T11:17:10.284 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:17:10.284 INFO:teuthology.orchestra.run.smithi084.stdout:[ 2023-07-14T11:17:10.285 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:17:10.285 INFO:teuthology.orchestra.run.smithi084.stdout: "poolnum": 1, 2023-07-14T11:17:10.285 INFO:teuthology.orchestra.run.smithi084.stdout: "poolname": ".mgr" 2023-07-14T11:17:10.285 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:17:10.285 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:17:10.285 INFO:teuthology.orchestra.run.smithi084.stdout: "poolnum": 2, 2023-07-14T11:17:10.286 INFO:teuthology.orchestra.run.smithi084.stdout: "poolname": "rbd" 2023-07-14T11:17:10.286 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:17:10.286 INFO:teuthology.orchestra.run.smithi084.stdout:] 2023-07-14T11:17:10.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.283+0000 7facb19ff700 1 -- 172.21.15.84:0/4250426534 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fac9806ae90 msgr2=0x7fac9806d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:10.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.283+0000 7facb19ff700 1 --2- 172.21.15.84:0/4250426534 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fac9806ae90 0x7fac9806d340 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fac9c007fd0 tx=0x7fac9c009040 comp rx=0 tx=0).stop 2023-07-14T11:17:10.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.283+0000 7facb19ff700 1 -- 172.21.15.84:0/4250426534 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facac15c950 msgr2=0x7facac0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:10.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.283+0000 7facb19ff700 1 --2- 172.21.15.84:0/4250426534 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facac15c950 0x7facac0b71b0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7faca4007e40 tx=0x7faca400e3c0 comp rx=0 tx=0).stop 2023-07-14T11:17:10.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.283+0000 7facb19ff700 1 -- 172.21.15.84:0/4250426534 shutdown_connections 2023-07-14T11:17:10.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.283+0000 7facb19ff700 1 --2- 172.21.15.84:0/4250426534 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facac15c950 0x7facac0b71b0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:10.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.283+0000 7facb19ff700 1 --2- 172.21.15.84:0/4250426534 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7facac0b1e00 0x7facac0b8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:10.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.283+0000 7facb19ff700 1 --2- 172.21.15.84:0/4250426534 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fac9806ae90 0x7fac9806d340 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:10.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.283+0000 7facb19ff700 1 --2- 172.21.15.84:0/4250426534 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7facac0d1220 0x7facac0b1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:10.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.283+0000 7facb19ff700 1 -- 172.21.15.84:0/4250426534 >> 172.21.15.84:0/4250426534 conn(0x7facac09c1d0 msgr2=0x7facac0b5000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:10.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.283+0000 7facb19ff700 1 -- 172.21.15.84:0/4250426534 shutdown_connections 2023-07-14T11:17:10.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.283+0000 7facb19ff700 1 -- 172.21.15.84:0/4250426534 wait complete. 2023-07-14T11:17:10.304 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-14T11:17:10.305 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-14T11:17:10.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.500+0000 7f671f1ff700 1 Processor -- start 2023-07-14T11:17:10.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.500+0000 7f671f1ff700 1 -- start start 2023-07-14T11:17:10.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.501+0000 7f671f1ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6718156e40 0x7f67181596a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:10.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.501+0000 7f671f1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f671815d810 0x7f67180b2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:10.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.501+0000 7f671f1ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f67180b2770 0x7f671806fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:10.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.501+0000 7f671f1ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6718159fb0 con 0x7f6718156e40 2023-07-14T11:17:10.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.501+0000 7f671f1ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f671815a290 con 0x7f67180b2770 2023-07-14T11:17:10.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.501+0000 7f671f1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f671815a570 con 0x7f671815d810 2023-07-14T11:17:10.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.502+0000 7f671cf9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6718156e40 0x7f67181596a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:10.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.502+0000 7f671cf9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6718156e40 0x7f67181596a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35110/0 (socket says 172.21.15.84:35110) 2023-07-14T11:17:10.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.502+0000 7f671cf9b700 1 -- 172.21.15.84:0/2776684762 learned_addr learned my addr 172.21.15.84:0/2776684762 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:10.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.502+0000 7f671cf9b700 1 -- 172.21.15.84:0/2776684762 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f671815d810 msgr2=0x7f67180b2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:10.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.502+0000 7f6717fff700 1 --2- 172.21.15.84:0/2776684762 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f671815d810 0x7f67180b2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:10.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.502+0000 7f671d79c700 1 --2- 172.21.15.84:0/2776684762 >> v2:172.21.15.179:3300/0 conn(0x7f67180b2770 0x7f671806fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:10.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.502+0000 7f671cf9b700 1 --2- 172.21.15.84:0/2776684762 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f671815d810 0x7f67180b2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:10.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.502+0000 7f671cf9b700 1 -- 172.21.15.84:0/2776684762 >> v2:172.21.15.179:3300/0 conn(0x7f67180b2770 msgr2=0x7f671806fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:10.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.502+0000 7f671cf9b700 1 --2- 172.21.15.84:0/2776684762 >> v2:172.21.15.179:3300/0 conn(0x7f67180b2770 0x7f671806fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:10.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.502+0000 7f671cf9b700 1 -- 172.21.15.84:0/2776684762 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67180b1a30 con 0x7f6718156e40 2023-07-14T11:17:10.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.502+0000 7f6717fff700 1 --2- 172.21.15.84:0/2776684762 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f671815d810 0x7f67180b2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:17:10.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.502+0000 7f671d79c700 1 --2- 172.21.15.84:0/2776684762 >> v2:172.21.15.179:3300/0 conn(0x7f67180b2770 0x7f671806fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:17:10.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.502+0000 7f671cf9b700 1 --2- 172.21.15.84:0/2776684762 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6718156e40 0x7f67181596a0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f671806d7b0 tx=0x7f670c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fba8550de23c115 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:10.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.503+0000 7f67177fe700 1 -- 172.21.15.84:0/2776684762 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670c00b870 con 0x7f6718156e40 2023-07-14T11:17:10.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.503+0000 7f67177fe700 1 -- 172.21.15.84:0/2776684762 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f670c00b9d0 con 0x7f6718156e40 2023-07-14T11:17:10.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.503+0000 7f67177fe700 1 -- 172.21.15.84:0/2776684762 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670c00bd60 con 0x7f6718156e40 2023-07-14T11:17:10.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.503+0000 7f671f1ff700 1 -- 172.21.15.84:0/2776684762 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6718156e40 msgr2=0x7f67181596a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:10.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.503+0000 7f671f1ff700 1 --2- 172.21.15.84:0/2776684762 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6718156e40 0x7f67181596a0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f671806d7b0 tx=0x7f670c009bd0 comp rx=0 tx=0).stop 2023-07-14T11:17:10.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.503+0000 7f671f1ff700 1 -- 172.21.15.84:0/2776684762 shutdown_connections 2023-07-14T11:17:10.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.503+0000 7f671f1ff700 1 --2- 172.21.15.84:0/2776684762 >> v2:172.21.15.179:3300/0 conn(0x7f67180b2770 0x7f671806fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:10.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.503+0000 7f671f1ff700 1 --2- 172.21.15.84:0/2776684762 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6718156e40 0x7f67181596a0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:10.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.503+0000 7f671f1ff700 1 --2- 172.21.15.84:0/2776684762 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f671815d810 0x7f67180b2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:10.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.503+0000 7f671f1ff700 1 -- 172.21.15.84:0/2776684762 >> 172.21.15.84:0/2776684762 conn(0x7f6718065bd0 msgr2=0x7f6718065fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:10.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.503+0000 7f671f1ff700 1 -- 172.21.15.84:0/2776684762 shutdown_connections 2023-07-14T11:17:10.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.503+0000 7f671f1ff700 1 -- 172.21.15.84:0/2776684762 wait complete. 2023-07-14T11:17:10.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.505+0000 7f671f1ff700 1 Processor -- start 2023-07-14T11:17:10.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.505+0000 7f671f1ff700 1 -- start start 2023-07-14T11:17:10.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.506+0000 7f671f1ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67180b2770 0x7f6718155bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:10.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.506+0000 7f671f1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6718156e40 0x7f671812de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:10.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.506+0000 7f671f1ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f671815d810 0x7f67180cda40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:10.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.506+0000 7f671f1ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67180ccbd0 con 0x7f67180b2770 2023-07-14T11:17:10.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.506+0000 7f671f1ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f671812e6c0 con 0x7f671815d810 2023-07-14T11:17:10.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.506+0000 7f671f1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f671812e9a0 con 0x7f6718156e40 2023-07-14T11:17:10.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.506+0000 7f671cf9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67180b2770 0x7f6718155bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:10.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.506+0000 7f671cf9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67180b2770 0x7f6718155bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35124/0 (socket says 172.21.15.84:35124) 2023-07-14T11:17:10.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.506+0000 7f671cf9b700 1 -- 172.21.15.84:0/1484807185 learned_addr learned my addr 172.21.15.84:0/1484807185 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:10.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.507+0000 7f6717fff700 1 --2- 172.21.15.84:0/1484807185 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6718156e40 0x7f671812de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:10.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.507+0000 7f671d79c700 1 --2- 172.21.15.84:0/1484807185 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f671815d810 0x7f67180cda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:10.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.507+0000 7f671cf9b700 1 -- 172.21.15.84:0/1484807185 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6718156e40 msgr2=0x7f671812de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:10.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.507+0000 7f671cf9b700 1 --2- 172.21.15.84:0/1484807185 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6718156e40 0x7f671812de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:10.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.507+0000 7f671cf9b700 1 -- 172.21.15.84:0/1484807185 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f671815d810 msgr2=0x7f67180cda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:10.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.507+0000 7f671cf9b700 1 --2- 172.21.15.84:0/1484807185 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f671815d810 0x7f67180cda40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:10.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.507+0000 7f671cf9b700 1 -- 172.21.15.84:0/1484807185 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f670c009550 con 0x7f67180b2770 2023-07-14T11:17:10.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.507+0000 7f671cf9b700 1 --2- 172.21.15.84:0/1484807185 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67180b2770 0x7f6718155bb0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f671806cbd0 tx=0x7f670c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:10.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.507+0000 7f67157fa700 1 -- 172.21.15.84:0/1484807185 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670c004310 con 0x7f67180b2770 2023-07-14T11:17:10.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.507+0000 7f67157fa700 1 -- 172.21.15.84:0/1484807185 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f670c01f070 con 0x7f67180b2770 2023-07-14T11:17:10.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.507+0000 7f67157fa700 1 -- 172.21.15.84:0/1484807185 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670c0036a0 con 0x7f67180b2770 2023-07-14T11:17:10.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.507+0000 7f671f1ff700 1 -- 172.21.15.84:0/1484807185 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f671812ec80 con 0x7f67180b2770 2023-07-14T11:17:10.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.508+0000 7f671f1ff700 1 -- 172.21.15.84:0/1484807185 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f671812e3d0 con 0x7f67180b2770 2023-07-14T11:17:10.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.509+0000 7f671f1ff700 1 -- 172.21.15.84:0/1484807185 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67180cd890 con 0x7f67180b2770 2023-07-14T11:17:10.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.509+0000 7f67157fa700 1 -- 172.21.15.84:0/1484807185 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 9) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f670c021030 con 0x7f67180b2770 2023-07-14T11:17:10.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.511+0000 7f67157fa700 1 --2- 172.21.15.84:0/1484807185 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f66fc06ae90 0x7f66fc06d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:10.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.511+0000 7f67157fa700 1 -- 172.21.15.84:0/1484807185 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f670c08a8c0 con 0x7f67180b2770 2023-07-14T11:17:10.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.511+0000 7f6717fff700 1 --2- 172.21.15.84:0/1484807185 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f66fc06ae90 0x7f66fc06d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:10.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.511+0000 7f6717fff700 1 --2- 172.21.15.84:0/1484807185 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f66fc06ae90 0x7f66fc06d340 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f67181e5f20 tx=0x7f6704008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:10.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.514+0000 7f67157fa700 1 -- 172.21.15.84:0/1484807185 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f670c055a30 con 0x7f67180b2770 2023-07-14T11:17:10.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:10.710+0000 7f671f1ff700 1 -- 172.21.15.84:0/1484807185 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f67180b1590 con 0x7f67180b2770 2023-07-14T11:17:11.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:11.055+0000 7f67157fa700 1 -- 172.21.15.84:0/1484807185 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v60) v1 ==== 138+0+0 (secure 0 0 0) 0x7f670c059050 con 0x7f67180b2770 2023-07-14T11:17:11.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:11.057+0000 7f671f1ff700 1 -- 172.21.15.84:0/1484807185 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f66fc06ae90 msgr2=0x7f66fc06d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:11.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:11.057+0000 7f671f1ff700 1 --2- 172.21.15.84:0/1484807185 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f66fc06ae90 0x7f66fc06d340 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f67181e5f20 tx=0x7f6704008040 comp rx=0 tx=0).stop 2023-07-14T11:17:11.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:11.057+0000 7f671f1ff700 1 -- 172.21.15.84:0/1484807185 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67180b2770 msgr2=0x7f6718155bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:11.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:11.057+0000 7f671f1ff700 1 --2- 172.21.15.84:0/1484807185 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67180b2770 0x7f6718155bb0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f671806cbd0 tx=0x7f670c004750 comp rx=0 tx=0).stop 2023-07-14T11:17:11.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:11.057+0000 7f671f1ff700 1 -- 172.21.15.84:0/1484807185 shutdown_connections 2023-07-14T11:17:11.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:11.057+0000 7f671f1ff700 1 --2- 172.21.15.84:0/1484807185 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f671815d810 0x7f67180cda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:11.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:11.057+0000 7f671f1ff700 1 --2- 172.21.15.84:0/1484807185 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67180b2770 0x7f6718155bb0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:11.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:11.057+0000 7f671f1ff700 1 --2- 172.21.15.84:0/1484807185 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f66fc06ae90 0x7f66fc06d340 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:11.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:11.057+0000 7f671f1ff700 1 --2- 172.21.15.84:0/1484807185 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6718156e40 0x7f671812de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:11.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:11.057+0000 7f671f1ff700 1 -- 172.21.15.84:0/1484807185 >> 172.21.15.84:0/1484807185 conn(0x7f6718065bd0 msgr2=0x7f67181576c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:11.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:11.058+0000 7f671f1ff700 1 -- 172.21.15.84:0/1484807185 shutdown_connections 2023-07-14T11:17:11.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:11.058+0000 7f671f1ff700 1 -- 172.21.15.84:0/1484807185 wait complete. 2023-07-14T11:17:11.063 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_metadata' created 2023-07-14T11:17:11.082 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-14T11:17:11.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:11.280+0000 7f2bbd7ff700 1 Processor -- start 2023-07-14T11:17:11.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:11.280+0000 7f2bbd7ff700 1 -- start start 2023-07-14T11:17:11.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:11.281+0000 7f2bbd7ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2bb8158bb0 0x7f2bb80cd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:11.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:11.281+0000 7f2bbd7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2bb80ce150 0x7f2bb806ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:11.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:11.282+0000 7f2bbd7ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bb80ce8c0 con 0x7f2bb80cbe40 2023-07-14T11:17:11.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:11.282+0000 7f2bbd7ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bb806b5b0 con 0x7f2bb8158bb0 2023-07-14T11:17:11.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:11.282+0000 7f2bbd7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb8071500 con 0x7f2bb80ce150 2023-07-14T11:17:11.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:11.282+0000 7f2bb6ffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2bb8158bb0 0x7f2bb80cd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:11.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:11.282+0000 7f2bb6ffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2bb8158bb0 0x7f2bb80cd0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35136/0 (socket says 172.21.15.84:35136) 2023-07-14T11:17:11.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:11.282+0000 7f2baffff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f2bb80cbe40 0x7f2bb80cda40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:43146/0 (socket says 172.21.15.84:43146) 2023-07-14T11:17:11.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:11.282+0000 7f2bb6ffd700 1 -- 172.21.15.84:0/3779307200 learned_addr learned my addr 172.21.15.84:0/3779307200 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:11.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:11.282+0000 7f2bb77fe700 1 --2- 172.21.15.84:0/3779307200 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2bb80ce150 0x7f2bb806ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:11.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:11.282+0000 7f2bb6ffd700 1 -- 172.21.15.84:0/3779307200 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2bb80ce150 msgr2=0x7f2bb806ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:11.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:11.282+0000 7f2bb6ffd700 1 --2- 172.21.15.84:0/3779307200 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2bb80ce150 0x7f2bb806ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:11.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:11.282+0000 7f2bb6ffd700 1 -- 172.21.15.84:0/3779307200 >> v1:172.21.15.84:6789/0 conn(0x7f2bb80cbe40 legacy=0x7f2bb80cda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:11.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:11.282+0000 7f2bb6ffd700 1 -- 172.21.15.84:0/3779307200 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bb80cc2b0 con 0x7f2bb8158bb0 2023-07-14T11:17:11.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:11.283+0000 7f2bb6ffd700 1 --2- 172.21.15.84:0/3779307200 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bb8158bb0 0x7f2bb80cd0a0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f2ba800bb90 tx=0x7f2ba800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd1bdaea0b166885 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:11.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:11.283+0000 7f2bb67fc700 1 -- 172.21.15.84:0/3779307200 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba800dd50 con 0x7f2bb8158bb0 2023-07-14T11:17:11.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:11.283+0000 7f2bb67fc700 1 -- 172.21.15.84:0/3779307200 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ba8010470 con 0x7f2bb8158bb0 2023-07-14T11:17:11.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:11.283+0000 7f2bb67fc700 1 -- 172.21.15.84:0/3779307200 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba8010800 con 0x7f2bb8158bb0 2023-07-14T11:17:11.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:11.283+0000 7f2bbd7ff700 1 -- 172.21.15.84:0/3779307200 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bb8158bb0 msgr2=0x7f2bb80cd0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:11.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:11.283+0000 7f2bbd7ff700 1 --2- 172.21.15.84:0/3779307200 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bb8158bb0 0x7f2bb80cd0a0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f2ba800bb90 tx=0x7f2ba800bea0 comp rx=0 tx=0).stop 2023-07-14T11:17:11.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:11.284+0000 7f2bbd7ff700 1 -- 172.21.15.84:0/3779307200 shutdown_connections 2023-07-14T11:17:11.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:11.284+0000 7f2bbd7ff700 1 --2- 172.21.15.84:0/3779307200 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2bb80ce150 0x7f2bb806ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:11.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:11.284+0000 7f2bbd7ff700 1 --2- 172.21.15.84:0/3779307200 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bb8158bb0 0x7f2bb80cd0a0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:11.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:11.284+0000 7f2bbd7ff700 1 -- 172.21.15.84:0/3779307200 >> 172.21.15.84:0/3779307200 conn(0x7f2bb80b05d0 msgr2=0x7f2bb80b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:11.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:11.284+0000 7f2bbd7ff700 1 -- 172.21.15.84:0/3779307200 shutdown_connections 2023-07-14T11:17:11.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:11.284+0000 7f2bbd7ff700 1 -- 172.21.15.84:0/3779307200 wait complete. 2023-07-14T11:17:11.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:11.285+0000 7f2bbd7ff700 1 Processor -- start 2023-07-14T11:17:11.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:11.286+0000 7f2bbd7ff700 1 -- start start 2023-07-14T11:17:11.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:11.286+0000 7f2bbd7ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bb80cbe40 0x7f2bb80c1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:11.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:11.286+0000 7f2bbd7ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2bb80ce150 0x7f2bb8158f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:11.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:11.286+0000 7f2bbd7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2bb8158bb0 0x7f2bb81594c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:11.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:11.286+0000 7f2bbd7ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb814d7e0 con 0x7f2bb80cbe40 2023-07-14T11:17:11.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:11.286+0000 7f2bbd7ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb80b3030 con 0x7f2bb80ce150 2023-07-14T11:17:11.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:11.286+0000 7f2bbd7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb815bbe0 con 0x7f2bb8158bb0 2023-07-14T11:17:11.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:11.287+0000 7f2bb6ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bb80cbe40 0x7f2bb80c1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:11.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:11.287+0000 7f2bb6ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bb80cbe40 0x7f2bb80c1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35144/0 (socket says 172.21.15.84:35144) 2023-07-14T11:17:11.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:11.287+0000 7f2bb6ffd700 1 -- 172.21.15.84:0/2568238085 learned_addr learned my addr 172.21.15.84:0/2568238085 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:11.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:11.287+0000 7f2bb77fe700 1 --2- 172.21.15.84:0/2568238085 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2bb8158bb0 0x7f2bb81594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:11.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:11.287+0000 7f2bb6ffd700 1 -- 172.21.15.84:0/2568238085 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2bb8158bb0 msgr2=0x7f2bb81594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:11.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:11.287+0000 7f2bb6ffd700 1 --2- 172.21.15.84:0/2568238085 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2bb8158bb0 0x7f2bb81594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:11.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:11.287+0000 7f2bb6ffd700 1 -- 172.21.15.84:0/2568238085 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2bb80ce150 msgr2=0x7f2bb8158f80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-14T11:17:11.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:11.287+0000 7f2bb6ffd700 1 --2- 172.21.15.84:0/2568238085 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2bb80ce150 0x7f2bb8158f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:11.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:11.287+0000 7f2bb6ffd700 1 -- 172.21.15.84:0/2568238085 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba800b7f0 con 0x7f2bb80cbe40 2023-07-14T11:17:11.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:11.287+0000 7f2bb77fe700 1 --2- 172.21.15.84:0/2568238085 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2bb8158bb0 0x7f2bb81594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:17:11.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:11.287+0000 7f2bb6ffd700 1 --2- 172.21.15.84:0/2568238085 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bb80cbe40 0x7f2bb80c1890 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f2ba800bee0 tx=0x7f2ba8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:11.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:11.288+0000 7f2baf7fe700 1 -- 172.21.15.84:0/2568238085 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba8003b30 con 0x7f2bb80cbe40 2023-07-14T11:17:11.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:11.288+0000 7f2baf7fe700 1 -- 172.21.15.84:0/2568238085 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ba8003c90 con 0x7f2bb80cbe40 2023-07-14T11:17:11.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:11.288+0000 7f2bbd7ff700 1 -- 172.21.15.84:0/2568238085 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bb815bec0 con 0x7f2bb80cbe40 2023-07-14T11:17:11.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:11.288+0000 7f2baf7fe700 1 -- 172.21.15.84:0/2568238085 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba80105e0 con 0x7f2bb80cbe40 2023-07-14T11:17:11.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:11.288+0000 7f2bbd7ff700 1 -- 172.21.15.84:0/2568238085 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bb80b2cc0 con 0x7f2bb80cbe40 2023-07-14T11:17:11.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:11.289+0000 7f2bbd7ff700 1 -- 172.21.15.84:0/2568238085 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bb8074350 con 0x7f2bb80cbe40 2023-07-14T11:17:11.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:11.290+0000 7f2baf7fe700 1 -- 172.21.15.84:0/2568238085 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 9) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f2ba8019400 con 0x7f2bb80cbe40 2023-07-14T11:17:11.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:11.291+0000 7f2baf7fe700 1 --2- 172.21.15.84:0/2568238085 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f2b9806ae90 0x7f2b9806d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:11.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:11.291+0000 7f2baf7fe700 1 -- 172.21.15.84:0/2568238085 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f2ba808ab00 con 0x7f2bb80cbe40 2023-07-14T11:17:11.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:11.291+0000 7f2baffff700 1 --2- 172.21.15.84:0/2568238085 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f2b9806ae90 0x7f2b9806d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:11.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:11.291+0000 7f2baffff700 1 --2- 172.21.15.84:0/2568238085 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f2b9806ae90 0x7f2b9806d340 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2bb806fb90 tx=0x7f2ba0007a50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:11.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:11.297+0000 7f2baf7fe700 1 -- 172.21.15.84:0/2568238085 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f2ba808ce60 con 0x7f2bb80cbe40 2023-07-14T11:17:11.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:11.488+0000 7f2bbd7ff700 1 -- 172.21.15.84:0/2568238085 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f2bb80b2e50 con 0x7f2bb80cbe40 2023-07-14T11:17:12.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:12.057+0000 7f2baf7fe700 1 -- 172.21.15.84:0/2568238085 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v61) v1 ==== 170+0+0 (secure 0 0 0) 0x7f2ba80559f0 con 0x7f2bb80cbe40 2023-07-14T11:17:12.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:12.065+0000 7f2bbd7ff700 1 -- 172.21.15.84:0/2568238085 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f2b9806ae90 msgr2=0x7f2b9806d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:12.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:12.065+0000 7f2bbd7ff700 1 --2- 172.21.15.84:0/2568238085 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f2b9806ae90 0x7f2b9806d340 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2bb806fb90 tx=0x7f2ba0007a50 comp rx=0 tx=0).stop 2023-07-14T11:17:12.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:12.065+0000 7f2bbd7ff700 1 -- 172.21.15.84:0/2568238085 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bb80cbe40 msgr2=0x7f2bb80c1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:12.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:12.065+0000 7f2bbd7ff700 1 --2- 172.21.15.84:0/2568238085 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bb80cbe40 0x7f2bb80c1890 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f2ba800bee0 tx=0x7f2ba8004750 comp rx=0 tx=0).stop 2023-07-14T11:17:12.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:12.067+0000 7f2bbd7ff700 1 -- 172.21.15.84:0/2568238085 shutdown_connections 2023-07-14T11:17:12.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:12.067+0000 7f2bbd7ff700 1 --2- 172.21.15.84:0/2568238085 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f2b9806ae90 0x7f2b9806d340 secure :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2bb806fb90 tx=0x7f2ba0007a50 comp rx=0 tx=0).stop 2023-07-14T11:17:12.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:12.067+0000 7f2bbd7ff700 1 --2- 172.21.15.84:0/2568238085 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2bb8158bb0 0x7f2bb81594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:12.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:12.067+0000 7f2bbd7ff700 1 --2- 172.21.15.84:0/2568238085 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bb80cbe40 0x7f2bb80c1890 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:12.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:12.067+0000 7f2bbd7ff700 1 --2- 172.21.15.84:0/2568238085 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2bb80ce150 0x7f2bb8158f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:12.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:12.067+0000 7f2bbd7ff700 1 -- 172.21.15.84:0/2568238085 >> 172.21.15.84:0/2568238085 conn(0x7f2bb80b05d0 msgr2=0x7f2bb80cd810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:12.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:12.068+0000 7f2bbd7ff700 1 -- 172.21.15.84:0/2568238085 shutdown_connections 2023-07-14T11:17:12.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:12.068+0000 7f2bbd7ff700 1 -- 172.21.15.84:0/2568238085 wait complete. 2023-07-14T11:17:12.074 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data' created 2023-07-14T11:17:12.098 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-14T11:17:12.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:12.295+0000 7f99e9dff700 1 Processor -- start 2023-07-14T11:17:12.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:12.295+0000 7f99e9dff700 1 -- start start 2023-07-14T11:17:12.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:12.297+0000 7f99e9dff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f99e40b8a60 0x7f99e40b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:12.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:12.297+0000 7f99e9dff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99e40b8e30 con 0x7f99e40b4530 2023-07-14T11:17:12.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:12.297+0000 7f99e9dff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99e40afaa0 con 0x7f99e40d1220 2023-07-14T11:17:12.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:12.297+0000 7f99e9dff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99e40afd80 con 0x7f99e40b8a60 2023-07-14T11:17:12.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:12.297+0000 7f99e37fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f99e40b8a60 0x7f99e40b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:12.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:12.297+0000 7f99dbfff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f99e40b4530 0x7f99e40d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:43150/0 (socket says 172.21.15.84:43150) 2023-07-14T11:17:12.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:12.297+0000 7f99dbfff700 1 -- 172.21.15.84:0/3667746319 learned_addr learned my addr 172.21.15.84:0/3667746319 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:17:12.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:12.298+0000 7f99e37fe700 1 -- 172.21.15.84:0/3667746319 >> v1:172.21.15.179:6789/0 conn(0x7f99e40d1220 legacy=0x7f99e40b0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:12.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:12.298+0000 7f99e37fe700 1 -- 172.21.15.84:0/3667746319 >> v1:172.21.15.84:6789/0 conn(0x7f99e40b4530 legacy=0x7f99e40d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:12.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:12.298+0000 7f99e37fe700 1 -- 172.21.15.84:0/3667746319 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e40b0060 con 0x7f99e40b8a60 2023-07-14T11:17:12.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:12.298+0000 7f99e2ffd700 1 -- 172.21.15.84:0/3667746319 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 668140256 0 0) 0x7f99e40b8e30 con 0x7f99e40b4530 2023-07-14T11:17:12.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:12.298+0000 7f99e37fe700 1 --2- 172.21.15.84:0/3667746319 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99e40b8a60 0x7f99e40b3ff0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f99d4009840 tx=0x7f99d4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c43b0c06f055071 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:12.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:12.298+0000 7f99e2ffd700 1 -- 172.21.15.84:0/3667746319 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d4011830 con 0x7f99e40b8a60 2023-07-14T11:17:12.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:12.298+0000 7f99e2ffd700 1 -- 172.21.15.84:0/3667746319 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99d4011990 con 0x7f99e40b8a60 2023-07-14T11:17:12.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:12.298+0000 7f99e2ffd700 1 -- 172.21.15.84:0/3667746319 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d4011d20 con 0x7f99e40b8a60 2023-07-14T11:17:12.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:12.299+0000 7f99e9dff700 1 -- 172.21.15.84:0/3667746319 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99e40b8a60 msgr2=0x7f99e40b3ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:12.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:12.299+0000 7f99e9dff700 1 --2- 172.21.15.84:0/3667746319 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99e40b8a60 0x7f99e40b3ff0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f99d4009840 tx=0x7f99d4009b50 comp rx=0 tx=0).stop 2023-07-14T11:17:12.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:12.299+0000 7f99e9dff700 1 -- 172.21.15.84:0/3667746319 shutdown_connections 2023-07-14T11:17:12.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:12.299+0000 7f99e9dff700 1 --2- 172.21.15.84:0/3667746319 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99e40b8a60 0x7f99e40b3ff0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:12.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:12.299+0000 7f99e9dff700 1 -- 172.21.15.84:0/3667746319 >> 172.21.15.84:0/3667746319 conn(0x7f99e409c1b0 msgr2=0x7f99e40d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:12.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:12.299+0000 7f99e9dff700 1 -- 172.21.15.84:0/3667746319 shutdown_connections 2023-07-14T11:17:12.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:12.299+0000 7f99e9dff700 1 -- 172.21.15.84:0/3667746319 wait complete. 2023-07-14T11:17:12.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:12.301+0000 7f99e9dff700 1 Processor -- start 2023-07-14T11:17:12.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:12.301+0000 7f99e9dff700 1 -- start start 2023-07-14T11:17:12.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:12.302+0000 7f99e9dff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99e40b4530 0x7f99e4149320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:12.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:12.302+0000 7f99e9dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99e40b8a60 0x7f99e415f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:12.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:12.302+0000 7f99e9dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99e40d1220 0x7f99e415fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:12.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:12.302+0000 7f99e9dff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e40c9610 con 0x7f99e40b4530 2023-07-14T11:17:12.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:12.302+0000 7f99e9dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e40ca130 con 0x7f99e40b8a60 2023-07-14T11:17:12.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:12.302+0000 7f99e9dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99e40ca410 con 0x7f99e40d1220 2023-07-14T11:17:12.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:12.302+0000 7f99e37fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99e40b4530 0x7f99e4149320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:12.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:12.302+0000 7f99e37fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99e40b4530 0x7f99e4149320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35174/0 (socket says 172.21.15.84:35174) 2023-07-14T11:17:12.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:12.302+0000 7f99e37fe700 1 -- 172.21.15.84:0/1163053303 learned_addr learned my addr 172.21.15.84:0/1163053303 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:12.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:12.302+0000 7f99e37fe700 1 -- 172.21.15.84:0/1163053303 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99e40d1220 msgr2=0x7f99e415fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:12.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:12.302+0000 7f99e37fe700 1 --2- 172.21.15.84:0/1163053303 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99e40d1220 0x7f99e415fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:12.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:12.302+0000 7f99e37fe700 1 -- 172.21.15.84:0/1163053303 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99e40b8a60 msgr2=0x7f99e415f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:12.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:12.302+0000 7f99e37fe700 1 --2- 172.21.15.84:0/1163053303 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99e40b8a60 0x7f99e415f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:12.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:12.302+0000 7f99e37fe700 1 -- 172.21.15.84:0/1163053303 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99d40094a0 con 0x7f99e40b4530 2023-07-14T11:17:12.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:12.303+0000 7f99e37fe700 1 --2- 172.21.15.84:0/1163053303 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99e40b4530 0x7f99e4149320 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f99d40090b0 tx=0x7f99d4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:12.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:12.303+0000 7f99e0ff9700 1 -- 172.21.15.84:0/1163053303 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d401a900 con 0x7f99e40b4530 2023-07-14T11:17:12.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:12.303+0000 7f99e0ff9700 1 -- 172.21.15.84:0/1163053303 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99d401aa60 con 0x7f99e40b4530 2023-07-14T11:17:12.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:12.303+0000 7f99e9dff700 1 -- 172.21.15.84:0/1163053303 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99e40ca6f0 con 0x7f99e40b4530 2023-07-14T11:17:12.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:12.303+0000 7f99e0ff9700 1 -- 172.21.15.84:0/1163053303 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d401add0 con 0x7f99e40b4530 2023-07-14T11:17:12.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:12.303+0000 7f99e9dff700 1 -- 172.21.15.84:0/1163053303 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99e40cacb0 con 0x7f99e40b4530 2023-07-14T11:17:12.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:12.304+0000 7f99e9dff700 1 -- 172.21.15.84:0/1163053303 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99e4074350 con 0x7f99e40b4530 2023-07-14T11:17:12.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:12.305+0000 7f99e0ff9700 1 -- 172.21.15.84:0/1163053303 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 9) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f99d4022070 con 0x7f99e40b4530 2023-07-14T11:17:12.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:12.306+0000 7f99e0ff9700 1 --2- 172.21.15.84:0/1163053303 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f99c406ae90 0x7f99c406d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:12.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:12.306+0000 7f99e0ff9700 1 -- 172.21.15.84:0/1163053303 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f99d408aa40 con 0x7f99e40b4530 2023-07-14T11:17:12.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:12.306+0000 7f99dbfff700 1 --2- 172.21.15.84:0/1163053303 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f99c406ae90 0x7f99c406d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:12.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:12.307+0000 7f99dbfff700 1 --2- 172.21.15.84:0/1163053303 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f99c406ae90 0x7f99c406d340 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f99cc000c00 tx=0x7f99cc007990 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:12.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:12.311+0000 7f99e0ff9700 1 -- 172.21.15.84:0/1163053303 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f99d4055a00 con 0x7f99e40b4530 2023-07-14T11:17:12.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:12.546+0000 7f99e9dff700 1 -- 172.21.15.84:0/1163053303 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f99e40d1000 con 0x7f99e40b4530 2023-07-14T11:17:13.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.079+0000 7f99e0ff9700 1 -- 172.21.15.84:0/1163053303 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 9 and data pool 10 v33) v1 ==== 173+0+0 (secure 0 0 0) 0x7f99d40150c0 con 0x7f99e40b4530 2023-07-14T11:17:13.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.087+0000 7f99e9dff700 1 -- 172.21.15.84:0/1163053303 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f99c406ae90 msgr2=0x7f99c406d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:13.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.087+0000 7f99e9dff700 1 --2- 172.21.15.84:0/1163053303 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f99c406ae90 0x7f99c406d340 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f99cc000c00 tx=0x7f99cc007990 comp rx=0 tx=0).stop 2023-07-14T11:17:13.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.087+0000 7f99e9dff700 1 -- 172.21.15.84:0/1163053303 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99e40b4530 msgr2=0x7f99e4149320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:13.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.087+0000 7f99e9dff700 1 --2- 172.21.15.84:0/1163053303 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99e40b4530 0x7f99e4149320 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f99d40090b0 tx=0x7f99d4004750 comp rx=0 tx=0).stop 2023-07-14T11:17:13.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.088+0000 7f99e9dff700 1 -- 172.21.15.84:0/1163053303 shutdown_connections 2023-07-14T11:17:13.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.088+0000 7f99e9dff700 1 --2- 172.21.15.84:0/1163053303 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f99c406ae90 0x7f99c406d340 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:13.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.088+0000 7f99e9dff700 1 --2- 172.21.15.84:0/1163053303 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99e40d1220 0x7f99e415fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:13.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.088+0000 7f99e9dff700 1 --2- 172.21.15.84:0/1163053303 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99e40b4530 0x7f99e4149320 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:13.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.088+0000 7f99e9dff700 1 --2- 172.21.15.84:0/1163053303 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99e40b8a60 0x7f99e415f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:13.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.088+0000 7f99e9dff700 1 -- 172.21.15.84:0/1163053303 >> 172.21.15.84:0/1163053303 conn(0x7f99e409c1b0 msgr2=0x7f99e40b25b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:13.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.088+0000 7f99e9dff700 1 -- 172.21.15.84:0/1163053303 shutdown_connections 2023-07-14T11:17:13.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.088+0000 7f99e9dff700 1 -- 172.21.15.84:0/1163053303 wait complete. 2023-07-14T11:17:13.094 INFO:teuthology.orchestra.run.smithi084.stderr:new fs with metadata pool 9 and data pool 10 2023-07-14T11:17:13.117 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:17:13.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.310+0000 7f551cfff700 1 Processor -- start 2023-07-14T11:17:13.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.310+0000 7f551cfff700 1 -- start start 2023-07-14T11:17:13.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.311+0000 7f551cfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f551815c950 0x7f55180b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:13.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.311+0000 7f551cfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55180b1e00 0x7f55180d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:13.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.311+0000 7f551cfff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f55180b2350 0x7f55180d1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:13.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.311+0000 7f551cfff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55180d2ce0 con 0x7f551815c950 2023-07-14T11:17:13.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.311+0000 7f551cfff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55180b3350 con 0x7f55180b2350 2023-07-14T11:17:13.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.311+0000 7f551cfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55180b3630 con 0x7f55180b1e00 2023-07-14T11:17:13.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.312+0000 7f551659c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f551815c950 0x7f55180b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:13.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.312+0000 7f551659c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f551815c950 0x7f55180b43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35178/0 (socket says 172.21.15.84:35178) 2023-07-14T11:17:13.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.312+0000 7f551659c700 1 -- 172.21.15.84:0/4127143365 learned_addr learned my addr 172.21.15.84:0/4127143365 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:13.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.312+0000 7f5516d9d700 1 --2- 172.21.15.84:0/4127143365 >> v2:172.21.15.179:3300/0 conn(0x7f55180b2350 0x7f55180d1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:13.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.312+0000 7f550ffff700 1 --2- 172.21.15.84:0/4127143365 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55180b1e00 0x7f55180d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:13.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.312+0000 7f551659c700 1 -- 172.21.15.84:0/4127143365 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55180b1e00 msgr2=0x7f55180d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:13.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.312+0000 7f551659c700 1 --2- 172.21.15.84:0/4127143365 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55180b1e00 0x7f55180d0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:13.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.312+0000 7f551659c700 1 -- 172.21.15.84:0/4127143365 >> v2:172.21.15.179:3300/0 conn(0x7f55180b2350 msgr2=0x7f55180d1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:13.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.312+0000 7f551659c700 1 --2- 172.21.15.84:0/4127143365 >> v2:172.21.15.179:3300/0 conn(0x7f55180b2350 0x7f55180d1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:13.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.312+0000 7f551659c700 1 -- 172.21.15.84:0/4127143365 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55180b3910 con 0x7f551815c950 2023-07-14T11:17:13.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.312+0000 7f551659c700 1 --2- 172.21.15.84:0/4127143365 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f551815c950 0x7f55180b43f0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f55180b3280 tx=0x7f5508009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b6822283594f6f9 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:13.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.313+0000 7f5515d9b700 1 -- 172.21.15.84:0/4127143365 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5508005e30 con 0x7f551815c950 2023-07-14T11:17:13.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.313+0000 7f5515d9b700 1 -- 172.21.15.84:0/4127143365 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5508004030 con 0x7f551815c950 2023-07-14T11:17:13.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.313+0000 7f5515d9b700 1 -- 172.21.15.84:0/4127143365 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55080043e0 con 0x7f551815c950 2023-07-14T11:17:13.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.313+0000 7f551cfff700 1 -- 172.21.15.84:0/4127143365 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f551815c950 msgr2=0x7f55180b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:13.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.313+0000 7f551cfff700 1 --2- 172.21.15.84:0/4127143365 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f551815c950 0x7f55180b43f0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f55180b3280 tx=0x7f5508009bd0 comp rx=0 tx=0).stop 2023-07-14T11:17:13.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.313+0000 7f551cfff700 1 -- 172.21.15.84:0/4127143365 shutdown_connections 2023-07-14T11:17:13.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.313+0000 7f551cfff700 1 --2- 172.21.15.84:0/4127143365 >> v2:172.21.15.179:3300/0 conn(0x7f55180b2350 0x7f55180d1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:13.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.313+0000 7f551cfff700 1 --2- 172.21.15.84:0/4127143365 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f551815c950 0x7f55180b43f0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:13.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.313+0000 7f551cfff700 1 --2- 172.21.15.84:0/4127143365 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55180b1e00 0x7f55180d0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:13.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.313+0000 7f551cfff700 1 -- 172.21.15.84:0/4127143365 >> 172.21.15.84:0/4127143365 conn(0x7f551809c1d0 msgr2=0x7f55180d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:13.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.313+0000 7f551cfff700 1 -- 172.21.15.84:0/4127143365 shutdown_connections 2023-07-14T11:17:13.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.313+0000 7f551cfff700 1 -- 172.21.15.84:0/4127143365 wait complete. 2023-07-14T11:17:13.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.315+0000 7f551cfff700 1 Processor -- start 2023-07-14T11:17:13.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.315+0000 7f551cfff700 1 -- start start 2023-07-14T11:17:13.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.316+0000 7f551cfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55180b1e00 0x7f55180cc930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:13.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.316+0000 7f551cfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55180b2350 0x7f5518152760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:13.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.316+0000 7f551cfff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f551815c950 0x7f55180ca010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:13.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.316+0000 7f551cfff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55180b83e0 con 0x7f55180b1e00 2023-07-14T11:17:13.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.316+0000 7f551cfff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55180cd710 con 0x7f551815c950 2023-07-14T11:17:13.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.316+0000 7f551cfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55180cd9f0 con 0x7f55180b2350 2023-07-14T11:17:13.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.316+0000 7f551659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55180b1e00 0x7f55180cc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:13.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.317+0000 7f551659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55180b1e00 0x7f55180cc930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35180/0 (socket says 172.21.15.84:35180) 2023-07-14T11:17:13.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.317+0000 7f551659c700 1 -- 172.21.15.84:0/4270603569 learned_addr learned my addr 172.21.15.84:0/4270603569 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:13.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.317+0000 7f550ffff700 1 --2- 172.21.15.84:0/4270603569 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55180b2350 0x7f5518152760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:13.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.317+0000 7f5516d9d700 1 --2- 172.21.15.84:0/4270603569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f551815c950 0x7f55180ca010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:13.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.317+0000 7f551659c700 1 -- 172.21.15.84:0/4270603569 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55180b2350 msgr2=0x7f5518152760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:13.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.317+0000 7f551659c700 1 --2- 172.21.15.84:0/4270603569 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55180b2350 0x7f5518152760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:13.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.317+0000 7f551659c700 1 -- 172.21.15.84:0/4270603569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f551815c950 msgr2=0x7f55180ca010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:13.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.317+0000 7f551659c700 1 --2- 172.21.15.84:0/4270603569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f551815c950 0x7f55180ca010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:13.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.317+0000 7f551659c700 1 -- 172.21.15.84:0/4270603569 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5508009500 con 0x7f55180b1e00 2023-07-14T11:17:13.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.317+0000 7f551659c700 1 --2- 172.21.15.84:0/4270603569 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55180b1e00 0x7f55180cc930 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f5508000c00 tx=0x7f5508004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:13.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.317+0000 7f550effd700 1 -- 172.21.15.84:0/4270603569 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5508003d90 con 0x7f55180b1e00 2023-07-14T11:17:13.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.317+0000 7f550effd700 1 -- 172.21.15.84:0/4270603569 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5508011420 con 0x7f55180b1e00 2023-07-14T11:17:13.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.317+0000 7f550effd700 1 -- 172.21.15.84:0/4270603569 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55080117b0 con 0x7f55180b1e00 2023-07-14T11:17:13.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.317+0000 7f551cfff700 1 -- 172.21.15.84:0/4270603569 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55180cdcd0 con 0x7f55180b1e00 2023-07-14T11:17:13.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.318+0000 7f551cfff700 1 -- 172.21.15.84:0/4270603569 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5518152ca0 con 0x7f55180b1e00 2023-07-14T11:17:13.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.318+0000 7f551cfff700 1 -- 172.21.15.84:0/4270603569 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55180ce1f0 con 0x7f55180b1e00 2023-07-14T11:17:13.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.319+0000 7f550effd700 1 -- 172.21.15.84:0/4270603569 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 9) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f5508011910 con 0x7f55180b1e00 2023-07-14T11:17:13.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.320+0000 7f550effd700 1 --2- 172.21.15.84:0/4270603569 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f54f806ae90 0x7f54f806d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:13.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.320+0000 7f550effd700 1 -- 172.21.15.84:0/4270603569 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f550808a9c0 con 0x7f55180b1e00 2023-07-14T11:17:13.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.321+0000 7f550ffff700 1 --2- 172.21.15.84:0/4270603569 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f54f806ae90 0x7f54f806d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:13.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.321+0000 7f550ffff700 1 --2- 172.21.15.84:0/4270603569 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f54f806ae90 0x7f54f806d340 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f55180cce70 tx=0x7f5500008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:13.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.325+0000 7f550effd700 1 -- 172.21.15.84:0/4270603569 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f55080557e0 con 0x7f55180b1e00 2023-07-14T11:17:13.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.519+0000 7f551cfff700 1 -- 172.21.15.84:0/4270603569 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f551804e280 con 0x7f55180b1e00 2023-07-14T11:17:13.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.520+0000 7f550effd700 1 -- 172.21.15.84:0/4270603569 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) v1 ==== 74+0+18282 (secure 0 0 0) 0x7f5508058e00 con 0x7f55180b1e00 2023-07-14T11:17:13.523 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:17:13.523 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":62,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:17:12.547457+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-07-14T11:17:10.750697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-07-14T11:17:11.528893+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:17:13.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.522+0000 7f551cfff700 1 -- 172.21.15.84:0/4270603569 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f54f806ae90 msgr2=0x7f54f806d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:13.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.522+0000 7f551cfff700 1 --2- 172.21.15.84:0/4270603569 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f54f806ae90 0x7f54f806d340 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f55180cce70 tx=0x7f5500008040 comp rx=0 tx=0).stop 2023-07-14T11:17:13.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.522+0000 7f551cfff700 1 -- 172.21.15.84:0/4270603569 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55180b1e00 msgr2=0x7f55180cc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:13.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.522+0000 7f551cfff700 1 --2- 172.21.15.84:0/4270603569 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55180b1e00 0x7f55180cc930 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f5508000c00 tx=0x7f5508004750 comp rx=0 tx=0).stop 2023-07-14T11:17:13.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.522+0000 7f551cfff700 1 -- 172.21.15.84:0/4270603569 shutdown_connections 2023-07-14T11:17:13.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.522+0000 7f551cfff700 1 --2- 172.21.15.84:0/4270603569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f551815c950 0x7f55180ca010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:13.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.522+0000 7f551cfff700 1 --2- 172.21.15.84:0/4270603569 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55180b1e00 0x7f55180cc930 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:13.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.522+0000 7f551cfff700 1 --2- 172.21.15.84:0/4270603569 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f54f806ae90 0x7f54f806d340 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:13.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.522+0000 7f551cfff700 1 --2- 172.21.15.84:0/4270603569 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55180b2350 0x7f5518152760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:13.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.522+0000 7f551cfff700 1 -- 172.21.15.84:0/4270603569 >> 172.21.15.84:0/4270603569 conn(0x7f551809c1d0 msgr2=0x7f55180b5340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:13.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.523+0000 7f551cfff700 1 -- 172.21.15.84:0/4270603569 shutdown_connections 2023-07-14T11:17:13.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.523+0000 7f551cfff700 1 -- 172.21.15.84:0/4270603569 wait complete. 2023-07-14T11:17:13.543 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:17:13.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.736+0000 7f4b621ff700 1 Processor -- start 2023-07-14T11:17:13.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.736+0000 7f4b621ff700 1 -- start start 2023-07-14T11:17:13.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.737+0000 7f4b621ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4b5c06cdb0 0x7f4b5c15cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:13.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.737+0000 7f4b621ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b5c06c820 0x7f4b5c161080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:13.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.737+0000 7f4b621ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b5c0cd120 con 0x7f4b5c15c840 2023-07-14T11:17:13.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.737+0000 7f4b621ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b5c0cdff0 con 0x7f4b5c06cdb0 2023-07-14T11:17:13.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.737+0000 7f4b621ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c1615c0 con 0x7f4b5c06c820 2023-07-14T11:17:13.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.738+0000 7f4b5affd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4b5c06cdb0 0x7f4b5c15cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:13.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.738+0000 7f4b5affd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4b5c06cdb0 0x7f4b5c15cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35186/0 (socket says 172.21.15.84:35186) 2023-07-14T11:17:13.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.738+0000 7f4b5affd700 1 -- 172.21.15.84:0/4224835220 learned_addr learned my addr 172.21.15.84:0/4224835220 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:13.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.738+0000 7f4b5bfff700 1 --2- 172.21.15.84:0/4224835220 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b5c06c820 0x7f4b5c161080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:13.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.738+0000 7f4b5affd700 1 -- 172.21.15.84:0/4224835220 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b5c06c820 msgr2=0x7f4b5c161080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:13.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.738+0000 7f4b5affd700 1 --2- 172.21.15.84:0/4224835220 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b5c06c820 0x7f4b5c161080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:13.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.738+0000 7f4b5affd700 1 -- 172.21.15.84:0/4224835220 >> v1:172.21.15.179:6789/0 conn(0x7f4b5c15c840 legacy=0x7f4b5c06c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:13.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.738+0000 7f4b5affd700 1 -- 172.21.15.84:0/4224835220 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b5c0cd370 con 0x7f4b5c06cdb0 2023-07-14T11:17:13.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.738+0000 7f4b5affd700 1 --2- 172.21.15.84:0/4224835220 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b5c06cdb0 0x7f4b5c15cc10 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f4b500098f0 tx=0x7f4b50009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3a713dfed7b2ad0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:13.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.739+0000 7f4b5a7fc700 1 -- 172.21.15.84:0/4224835220 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b50011830 con 0x7f4b5c06cdb0 2023-07-14T11:17:13.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.739+0000 7f4b5a7fc700 1 -- 172.21.15.84:0/4224835220 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b50011990 con 0x7f4b5c06cdb0 2023-07-14T11:17:13.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.739+0000 7f4b5a7fc700 1 -- 172.21.15.84:0/4224835220 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b50011d20 con 0x7f4b5c06cdb0 2023-07-14T11:17:13.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.739+0000 7f4b621ff700 1 -- 172.21.15.84:0/4224835220 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b5c06cdb0 msgr2=0x7f4b5c15cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:13.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.739+0000 7f4b621ff700 1 --2- 172.21.15.84:0/4224835220 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b5c06cdb0 0x7f4b5c15cc10 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f4b500098f0 tx=0x7f4b50009c00 comp rx=0 tx=0).stop 2023-07-14T11:17:13.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.739+0000 7f4b621ff700 1 -- 172.21.15.84:0/4224835220 shutdown_connections 2023-07-14T11:17:13.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.739+0000 7f4b621ff700 1 --2- 172.21.15.84:0/4224835220 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b5c06c820 0x7f4b5c161080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:13.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.739+0000 7f4b621ff700 1 --2- 172.21.15.84:0/4224835220 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b5c06cdb0 0x7f4b5c15cc10 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:13.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.739+0000 7f4b621ff700 1 -- 172.21.15.84:0/4224835220 >> 172.21.15.84:0/4224835220 conn(0x7f4b5c06d8e0 msgr2=0x7f4b5c06dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:13.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.739+0000 7f4b621ff700 1 -- 172.21.15.84:0/4224835220 shutdown_connections 2023-07-14T11:17:13.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.739+0000 7f4b621ff700 1 -- 172.21.15.84:0/4224835220 wait complete. 2023-07-14T11:17:13.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.741+0000 7f4b621ff700 1 Processor -- start 2023-07-14T11:17:13.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.741+0000 7f4b621ff700 1 -- start start 2023-07-14T11:17:13.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.742+0000 7f4b621ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b5c06c820 0x7f4b5c151a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:13.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.742+0000 7f4b621ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b5c06cdb0 0x7f4b5c15f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:13.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.742+0000 7f4b621ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b5c15c840 0x7f4b5c0cb780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:13.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.742+0000 7f4b621ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c151f40 con 0x7f4b5c06cdb0 2023-07-14T11:17:13.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.742+0000 7f4b621ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c0ca9e0 con 0x7f4b5c15c840 2023-07-14T11:17:13.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.742+0000 7f4b621ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c0c7ca0 con 0x7f4b5c06c820 2023-07-14T11:17:13.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.742+0000 7f4b5affd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b5c06cdb0 0x7f4b5c15f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:13.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.743+0000 7f4b5affd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b5c06cdb0 0x7f4b5c15f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35196/0 (socket says 172.21.15.84:35196) 2023-07-14T11:17:13.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.743+0000 7f4b5affd700 1 -- 172.21.15.84:0/2829020977 learned_addr learned my addr 172.21.15.84:0/2829020977 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:13.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.743+0000 7f4b5bfff700 1 --2- 172.21.15.84:0/2829020977 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b5c15c840 0x7f4b5c0cb780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:13.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.743+0000 7f4b5b7fe700 1 --2- 172.21.15.84:0/2829020977 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b5c06c820 0x7f4b5c151a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:13.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.743+0000 7f4b5affd700 1 -- 172.21.15.84:0/2829020977 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b5c06c820 msgr2=0x7f4b5c151a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:13.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.743+0000 7f4b5affd700 1 --2- 172.21.15.84:0/2829020977 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b5c06c820 0x7f4b5c151a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:13.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.743+0000 7f4b5affd700 1 -- 172.21.15.84:0/2829020977 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b5c15c840 msgr2=0x7f4b5c0cb780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:13.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.743+0000 7f4b5affd700 1 --2- 172.21.15.84:0/2829020977 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b5c15c840 0x7f4b5c0cb780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:13.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.743+0000 7f4b5affd700 1 -- 172.21.15.84:0/2829020977 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b50009550 con 0x7f4b5c06cdb0 2023-07-14T11:17:13.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.743+0000 7f4b5b7fe700 1 --2- 172.21.15.84:0/2829020977 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b5c06c820 0x7f4b5c151a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:17:13.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.743+0000 7f4b5affd700 1 --2- 172.21.15.84:0/2829020977 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b5c06cdb0 0x7f4b5c15f3d0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f4b50009c40 tx=0x7f4b50004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:13.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.743+0000 7f4b43fff700 1 -- 172.21.15.84:0/2829020977 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b500036a0 con 0x7f4b5c06cdb0 2023-07-14T11:17:13.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.743+0000 7f4b43fff700 1 -- 172.21.15.84:0/2829020977 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b5001e070 con 0x7f4b5c06cdb0 2023-07-14T11:17:13.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.743+0000 7f4b621ff700 1 -- 172.21.15.84:0/2829020977 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b5c0b5ad0 con 0x7f4b5c06cdb0 2023-07-14T11:17:13.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.743+0000 7f4b43fff700 1 -- 172.21.15.84:0/2829020977 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b50003a60 con 0x7f4b5c06cdb0 2023-07-14T11:17:13.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.744+0000 7f4b621ff700 1 -- 172.21.15.84:0/2829020977 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b5c0c7eb0 con 0x7f4b5c06cdb0 2023-07-14T11:17:13.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.745+0000 7f4b621ff700 1 -- 172.21.15.84:0/2829020977 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b5c06bcf0 con 0x7f4b5c06cdb0 2023-07-14T11:17:13.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.746+0000 7f4b43fff700 1 -- 172.21.15.84:0/2829020977 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 9) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f4b50003bc0 con 0x7f4b5c06cdb0 2023-07-14T11:17:13.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.746+0000 7f4b43fff700 1 --2- 172.21.15.84:0/2829020977 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f4b4806ae90 0x7f4b4806d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:13.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.747+0000 7f4b43fff700 1 -- 172.21.15.84:0/2829020977 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4b5008a6c0 con 0x7f4b5c06cdb0 2023-07-14T11:17:13.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.747+0000 7f4b5b7fe700 1 --2- 172.21.15.84:0/2829020977 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f4b4806ae90 0x7f4b4806d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:13.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.747+0000 7f4b5b7fe700 1 --2- 172.21.15.84:0/2829020977 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f4b4806ae90 0x7f4b4806d340 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c000f60 tx=0x7f4b4c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:13.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.751+0000 7f4b43fff700 1 -- 172.21.15.84:0/2829020977 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f4b50055580 con 0x7f4b5c06cdb0 2023-07-14T11:17:13.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.947+0000 7f4b621ff700 1 -- 172.21.15.84:0/2829020977 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4b5c06b4b0 con 0x7f4b5c06cdb0 2023-07-14T11:17:13.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.948+0000 7f4b43fff700 1 -- 172.21.15.84:0/2829020977 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) v1 ==== 74+0+18282 (secure 0 0 0) 0x7f4b50058ba0 con 0x7f4b5c06cdb0 2023-07-14T11:17:13.951 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:17:13.952 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":62,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:17:12.547457+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-07-14T11:17:10.750697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-07-14T11:17:11.528893+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:17:13.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.951+0000 7f4b621ff700 1 -- 172.21.15.84:0/2829020977 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f4b4806ae90 msgr2=0x7f4b4806d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:13.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.951+0000 7f4b621ff700 1 --2- 172.21.15.84:0/2829020977 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f4b4806ae90 0x7f4b4806d340 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c000f60 tx=0x7f4b4c009040 comp rx=0 tx=0).stop 2023-07-14T11:17:13.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.951+0000 7f4b621ff700 1 -- 172.21.15.84:0/2829020977 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b5c06cdb0 msgr2=0x7f4b5c15f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:13.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.951+0000 7f4b621ff700 1 --2- 172.21.15.84:0/2829020977 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b5c06cdb0 0x7f4b5c15f3d0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f4b50009c40 tx=0x7f4b50004750 comp rx=0 tx=0).stop 2023-07-14T11:17:13.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.951+0000 7f4b621ff700 1 -- 172.21.15.84:0/2829020977 shutdown_connections 2023-07-14T11:17:13.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.951+0000 7f4b621ff700 1 --2- 172.21.15.84:0/2829020977 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f4b4806ae90 0x7f4b4806d340 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:13.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.951+0000 7f4b621ff700 1 --2- 172.21.15.84:0/2829020977 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b5c06c820 0x7f4b5c151a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:13.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.951+0000 7f4b621ff700 1 --2- 172.21.15.84:0/2829020977 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b5c15c840 0x7f4b5c0cb780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:13.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.951+0000 7f4b621ff700 1 --2- 172.21.15.84:0/2829020977 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b5c06cdb0 0x7f4b5c15f3d0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:13.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.951+0000 7f4b621ff700 1 -- 172.21.15.84:0/2829020977 >> 172.21.15.84:0/2829020977 conn(0x7f4b5c06d8e0 msgr2=0x7f4b5c15c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:13.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.951+0000 7f4b621ff700 1 -- 172.21.15.84:0/2829020977 shutdown_connections 2023-07-14T11:17:13.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:13.951+0000 7f4b621ff700 1 -- 172.21.15.84:0/2829020977 wait complete. 2023-07-14T11:17:13.971 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-14T11:17:14.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.174+0000 7f0108bff700 1 Processor -- start 2023-07-14T11:17:14.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.175+0000 7f0108bff700 1 -- start start 2023-07-14T11:17:14.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.176+0000 7f0108bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01040b8660 0x7f01040cd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:14.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.176+0000 7f0108bff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01040d02a0 con 0x7f01040cd970 2023-07-14T11:17:14.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.176+0000 7f0108bff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01040cfce0 con 0x7f01040b4f70 2023-07-14T11:17:14.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.176+0000 7f0108bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01040cffc0 con 0x7f01040b8660 2023-07-14T11:17:14.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.176+0000 7f00fbfff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f01040cd970 0x7f01040b4860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:43158/0 (socket says 172.21.15.84:43158) 2023-07-14T11:17:14.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.176+0000 7f00fbfff700 1 -- 172.21.15.84:0/2870404634 learned_addr learned my addr 172.21.15.84:0/2870404634 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:17:14.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.176+0000 7f010259c700 1 --2- 172.21.15.84:0/2870404634 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01040b8660 0x7f01040cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:14.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.176+0000 7f0101d9b700 1 -- 172.21.15.84:0/2870404634 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2529522035 0 0) 0x7f01040d02a0 con 0x7f01040cd970 2023-07-14T11:17:14.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.176+0000 7f0101d9b700 1 -- 172.21.15.84:0/2870404634 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00f00035b0 con 0x7f01040cd970 2023-07-14T11:17:14.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.177+0000 7f0101d9b700 1 -- 172.21.15.84:0/2870404634 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1939348220 0 0) 0x7f01040cfce0 con 0x7f01040b4f70 2023-07-14T11:17:14.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.177+0000 7f0101d9b700 1 -- 172.21.15.84:0/2870404634 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01040d02a0 con 0x7f01040b4f70 2023-07-14T11:17:14.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.177+0000 7f0101d9b700 1 -- 172.21.15.84:0/2870404634 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 908233755 0 0) 0x7f00f00035b0 con 0x7f01040cd970 2023-07-14T11:17:14.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.177+0000 7f0101d9b700 1 -- 172.21.15.84:0/2870404634 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01040b8660 msgr2=0x7f01040cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:14.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.177+0000 7f0101d9b700 1 --2- 172.21.15.84:0/2870404634 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01040b8660 0x7f01040cd430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:14.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.177+0000 7f0101d9b700 1 -- 172.21.15.84:0/2870404634 >> v1:172.21.15.179:6789/0 conn(0x7f01040b4f70 legacy=0x7f01040d12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:14.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.177+0000 7f0101d9b700 1 -- 172.21.15.84:0/2870404634 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01040d0ac0 con 0x7f01040cd970 2023-07-14T11:17:14.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.177+0000 7f0101d9b700 1 -- 172.21.15.84:0/2870404634 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7f00ec001670 con 0x7f01040cd970 2023-07-14T11:17:14.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.177+0000 7f0101d9b700 1 -- 172.21.15.84:0/2870404634 >> v1:172.21.15.84:6789/0 conn(0x7f01040cd970 legacy=0x7f01040b4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:14.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.177+0000 7f0101d9b700 1 --2- 172.21.15.84:0/2870404634 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00f0003bc0 0x7f00f0003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:14.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.177+0000 7f0101d9b700 1 --2- 172.21.15.84:0/2870404634 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01040b8660 0x7f00f0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:14.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.177+0000 7f0101d9b700 1 --2- 172.21.15.84:0/2870404634 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00f0004d90 0x7f00f0005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:14.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.177+0000 7f0101d9b700 1 -- 172.21.15.84:0/2870404634 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01040cffc0 con 0x7f00f0004d90 2023-07-14T11:17:14.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.177+0000 7f0101d9b700 1 -- 172.21.15.84:0/2870404634 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f000bac0 con 0x7f00f0003bc0 2023-07-14T11:17:14.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.177+0000 7f0101d9b700 1 -- 172.21.15.84:0/2870404634 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00f000bc80 con 0x7f01040b8660 2023-07-14T11:17:14.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.177+0000 7f0102d9d700 1 --2- 172.21.15.84:0/2870404634 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00f0004d90 0x7f00f0005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:14.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.177+0000 7f00fbfff700 1 --2- 172.21.15.84:0/2870404634 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01040b8660 0x7f00f0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:14.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.177+0000 7f010259c700 1 --2- 172.21.15.84:0/2870404634 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00f0003bc0 0x7f00f0003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:14.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.178+0000 7f0102d9d700 1 -- 172.21.15.84:0/2870404634 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01040b8660 msgr2=0x7f00f0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:14.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.178+0000 7f0102d9d700 1 --2- 172.21.15.84:0/2870404634 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01040b8660 0x7f00f0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:14.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.178+0000 7f0102d9d700 1 -- 172.21.15.84:0/2870404634 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00f0003bc0 msgr2=0x7f00f0003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:14.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.178+0000 7f0102d9d700 1 --2- 172.21.15.84:0/2870404634 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00f0003bc0 0x7f00f0003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:14.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.178+0000 7f0102d9d700 1 -- 172.21.15.84:0/2870404634 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f00035b0 con 0x7f00f0004d90 2023-07-14T11:17:14.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.178+0000 7f0102d9d700 1 --2- 172.21.15.84:0/2870404634 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00f0004d90 0x7f00f0005200 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f00fc002230 tx=0x7f00f0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cdf33262fb2f2e7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:14.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.178+0000 7f0101d9b700 1 -- 172.21.15.84:0/2870404634 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00fc001f30 con 0x7f00f0004d90 2023-07-14T11:17:14.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.178+0000 7f0101d9b700 1 -- 172.21.15.84:0/2870404634 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00fc00ce80 con 0x7f00f0004d90 2023-07-14T11:17:14.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.178+0000 7f0101d9b700 1 -- 172.21.15.84:0/2870404634 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00fc003c40 con 0x7f00f0004d90 2023-07-14T11:17:14.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.178+0000 7f0108bff700 1 -- 172.21.15.84:0/2870404634 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00f0004d90 msgr2=0x7f00f0005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:14.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.178+0000 7f0108bff700 1 --2- 172.21.15.84:0/2870404634 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00f0004d90 0x7f00f0005200 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f00fc002230 tx=0x7f00f0005880 comp rx=0 tx=0).stop 2023-07-14T11:17:14.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.178+0000 7f0102d9d700 1 -- 172.21.15.84:0/2870404634 reap_dead start 2023-07-14T11:17:14.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.179+0000 7f0108bff700 1 -- 172.21.15.84:0/2870404634 shutdown_connections 2023-07-14T11:17:14.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.179+0000 7f0108bff700 1 -- 172.21.15.84:0/2870404634 >> 172.21.15.84:0/2870404634 conn(0x7f0104066860 msgr2=0x7f010406a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:14.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.179+0000 7f0108bff700 1 -- 172.21.15.84:0/2870404634 shutdown_connections 2023-07-14T11:17:14.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.179+0000 7f0108bff700 1 -- 172.21.15.84:0/2870404634 wait complete. 2023-07-14T11:17:14.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.180+0000 7f0108bff700 1 Processor -- start 2023-07-14T11:17:14.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.181+0000 7f0108bff700 1 -- start start 2023-07-14T11:17:14.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.181+0000 7f0108bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00f0004d90 0x7f0104154160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:14.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.181+0000 7f0108bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01040c8d80 0x7f01040c91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:14.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.181+0000 7f0108bff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01040c6b20 0x7f01040c6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:14.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.181+0000 7f0108bff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01040c9730 con 0x7f01040c6b20 2023-07-14T11:17:14.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.181+0000 7f0108bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01040c74d0 con 0x7f01040c8d80 2023-07-14T11:17:14.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.181+0000 7f0108bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01040c77a0 con 0x7f00f0004d90 2023-07-14T11:17:14.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.182+0000 7f0102d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01040c6b20 0x7f01040c6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:14.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.182+0000 7f0102d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01040c6b20 0x7f01040c6f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35214/0 (socket says 172.21.15.84:35214) 2023-07-14T11:17:14.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.182+0000 7f0102d9d700 1 -- 172.21.15.84:0/3830243956 learned_addr learned my addr 172.21.15.84:0/3830243956 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:14.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.182+0000 7f010259c700 1 --2- 172.21.15.84:0/3830243956 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00f0004d90 0x7f0104154160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:14.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.182+0000 7f00fbfff700 1 --2- 172.21.15.84:0/3830243956 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01040c8d80 0x7f01040c91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:14.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.182+0000 7f0102d9d700 1 -- 172.21.15.84:0/3830243956 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00f0004d90 msgr2=0x7f0104154160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:14.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.182+0000 7f0102d9d700 1 --2- 172.21.15.84:0/3830243956 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00f0004d90 0x7f0104154160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:14.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.182+0000 7f0102d9d700 1 -- 172.21.15.84:0/3830243956 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01040c8d80 msgr2=0x7f01040c91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:14.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.182+0000 7f0102d9d700 1 --2- 172.21.15.84:0/3830243956 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01040c8d80 0x7f01040c91f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:14.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.182+0000 7f0102d9d700 1 -- 172.21.15.84:0/3830243956 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01040c7a80 con 0x7f01040c6b20 2023-07-14T11:17:14.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.182+0000 7f0102d9d700 1 --2- 172.21.15.84:0/3830243956 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01040c6b20 0x7f01040c6f90 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f00f00047d0 tx=0x7f00fc001650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:14.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.183+0000 7f00faffd700 1 -- 172.21.15.84:0/3830243956 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00fc003c10 con 0x7f01040c6b20 2023-07-14T11:17:14.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.183+0000 7f00faffd700 1 -- 172.21.15.84:0/3830243956 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00fc003d70 con 0x7f01040c6b20 2023-07-14T11:17:14.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.183+0000 7f0108bff700 1 -- 172.21.15.84:0/3830243956 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01040c7d60 con 0x7f01040c6b20 2023-07-14T11:17:14.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.183+0000 7f00faffd700 1 -- 172.21.15.84:0/3830243956 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00fc005310 con 0x7f01040c6b20 2023-07-14T11:17:14.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.183+0000 7f0108bff700 1 -- 172.21.15.84:0/3830243956 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01040c8320 con 0x7f01040c6b20 2023-07-14T11:17:14.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.184+0000 7f0108bff700 1 -- 172.21.15.84:0/3830243956 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0104157b00 con 0x7f01040c6b20 2023-07-14T11:17:14.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.185+0000 7f00faffd700 1 -- 172.21.15.84:0/3830243956 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 9) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f00fc019070 con 0x7f01040c6b20 2023-07-14T11:17:14.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.186+0000 7f00faffd700 1 --2- 172.21.15.84:0/3830243956 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f00e406aec0 0x7f00e406d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:14.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.186+0000 7f00faffd700 1 -- 172.21.15.84:0/3830243956 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f00fc08a320 con 0x7f01040c6b20 2023-07-14T11:17:14.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.186+0000 7f010259c700 1 --2- 172.21.15.84:0/3830243956 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f00e406aec0 0x7f00e406d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:14.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.187+0000 7f010259c700 1 --2- 172.21.15.84:0/3830243956 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f00e406aec0 0x7f00e406d370 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f00f4009c60 tx=0x7f00f4009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:14.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.190+0000 7f00faffd700 1 -- 172.21.15.84:0/3830243956 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f00fc055140 con 0x7f01040c6b20 2023-07-14T11:17:14.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:14.427+0000 7f0108bff700 1 -- 172.21.15.84:0/3830243956 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f01040723c0 con 0x7f01040c6b20 2023-07-14T11:17:15.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.095+0000 7f00faffd700 1 -- 172.21.15.84:0/3830243956 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v36) v1 ==== 118+0+0 (secure 0 0 0) 0x7f00fc002090 con 0x7f01040c6b20 2023-07-14T11:17:15.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.098+0000 7f0108bff700 1 -- 172.21.15.84:0/3830243956 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f00e406aec0 msgr2=0x7f00e406d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:15.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.098+0000 7f0108bff700 1 --2- 172.21.15.84:0/3830243956 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f00e406aec0 0x7f00e406d370 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f00f4009c60 tx=0x7f00f4009210 comp rx=0 tx=0).stop 2023-07-14T11:17:15.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.098+0000 7f0108bff700 1 -- 172.21.15.84:0/3830243956 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01040c6b20 msgr2=0x7f01040c6f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:15.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.098+0000 7f0108bff700 1 --2- 172.21.15.84:0/3830243956 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01040c6b20 0x7f01040c6f90 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f00f00047d0 tx=0x7f00fc001650 comp rx=0 tx=0).stop 2023-07-14T11:17:15.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.098+0000 7f0108bff700 1 -- 172.21.15.84:0/3830243956 shutdown_connections 2023-07-14T11:17:15.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.098+0000 7f0108bff700 1 --2- 172.21.15.84:0/3830243956 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f00e406aec0 0x7f00e406d370 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:15.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.098+0000 7f0108bff700 1 --2- 172.21.15.84:0/3830243956 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00f0004d90 0x7f0104154160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:15.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.098+0000 7f0108bff700 1 --2- 172.21.15.84:0/3830243956 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01040c6b20 0x7f01040c6f90 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:15.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.098+0000 7f0108bff700 1 --2- 172.21.15.84:0/3830243956 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01040c8d80 0x7f01040c91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:15.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.098+0000 7f0108bff700 1 -- 172.21.15.84:0/3830243956 >> 172.21.15.84:0/3830243956 conn(0x7f0104066860 msgr2=0x7f01040d1620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:15.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.098+0000 7f0108bff700 1 -- 172.21.15.84:0/3830243956 shutdown_connections 2023-07-14T11:17:15.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.098+0000 7f0108bff700 1 -- 172.21.15.84:0/3830243956 wait complete. 2023-07-14T11:17:15.120 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-14T11:17:15.121 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-14T11:17:15.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.321+0000 7f1d431ff700 1 Processor -- start 2023-07-14T11:17:15.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.321+0000 7f1d431ff700 1 -- start start 2023-07-14T11:17:15.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.322+0000 7f1d431ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1d3c0b12f0 0x7f1d3c0ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:15.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.322+0000 7f1d431ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d3c15ce70 con 0x7f1d3c0c92d0 2023-07-14T11:17:15.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.322+0000 7f1d431ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d3c15d0c0 con 0x7f1d3c0adea0 2023-07-14T11:17:15.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.322+0000 7f1d431ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d3c15da60 con 0x7f1d3c0b12f0 2023-07-14T11:17:15.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.322+0000 7f1d40f9b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f1d3c0c92d0 0x7f1d3c0c96a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:43170/0 (socket says 172.21.15.84:43170) 2023-07-14T11:17:15.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.323+0000 7f1d40f9b700 1 -- 172.21.15.84:0/1435367124 learned_addr learned my addr 172.21.15.84:0/1435367124 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:17:15.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.323+0000 7f1d3bfff700 1 --2- 172.21.15.84:0/1435367124 >> v2:172.21.15.179:3300/0 conn(0x7f1d3c0b12f0 0x7f1d3c0ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:15.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.323+0000 7f1d3b7fe700 1 -- 172.21.15.84:0/1435367124 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 521487167 0 0) 0x7f1d3c15ce70 con 0x7f1d3c0c92d0 2023-07-14T11:17:15.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.323+0000 7f1d3b7fe700 1 -- 172.21.15.84:0/1435367124 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d2c0057c0 con 0x7f1d3c0c92d0 2023-07-14T11:17:15.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.323+0000 7f1d3b7fe700 1 -- 172.21.15.84:0/1435367124 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 64712477 0 0) 0x7f1d3c15d0c0 con 0x7f1d3c0adea0 2023-07-14T11:17:15.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.323+0000 7f1d3b7fe700 1 -- 172.21.15.84:0/1435367124 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d3c15ce70 con 0x7f1d3c0adea0 2023-07-14T11:17:15.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.323+0000 7f1d3b7fe700 1 -- 172.21.15.84:0/1435367124 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 246012500 0 0) 0x7f1d2c0057c0 con 0x7f1d3c0c92d0 2023-07-14T11:17:15.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.323+0000 7f1d3b7fe700 1 -- 172.21.15.84:0/1435367124 >> v2:172.21.15.179:3300/0 conn(0x7f1d3c0b12f0 msgr2=0x7f1d3c0ad8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:15.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.323+0000 7f1d3b7fe700 1 --2- 172.21.15.84:0/1435367124 >> v2:172.21.15.179:3300/0 conn(0x7f1d3c0b12f0 0x7f1d3c0ad8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:15.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.323+0000 7f1d3b7fe700 1 -- 172.21.15.84:0/1435367124 >> v1:172.21.15.179:6789/0 conn(0x7f1d3c0adea0 legacy=0x7f1d3c0cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:15.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.323+0000 7f1d3b7fe700 1 -- 172.21.15.84:0/1435367124 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d3c15d3a0 con 0x7f1d3c0c92d0 2023-07-14T11:17:15.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.323+0000 7f1d3b7fe700 1 -- 172.21.15.84:0/1435367124 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7f1d30001670 con 0x7f1d3c0c92d0 2023-07-14T11:17:15.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.323+0000 7f1d3b7fe700 1 -- 172.21.15.84:0/1435367124 >> v1:172.21.15.84:6789/0 conn(0x7f1d3c0c92d0 legacy=0x7f1d3c0c96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:15.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.323+0000 7f1d3b7fe700 1 --2- 172.21.15.84:0/1435367124 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d2c005da0 0x7f1d2c006190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:15.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.323+0000 7f1d3b7fe700 1 --2- 172.21.15.84:0/1435367124 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d2c006a60 0x7f1d2c006ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:15.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.323+0000 7f1d3b7fe700 1 --2- 172.21.15.84:0/1435367124 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d2c007410 0x7f1d2c00dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:15.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.323+0000 7f1d3b7fe700 1 -- 172.21.15.84:0/1435367124 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3c15da60 con 0x7f1d2c005da0 2023-07-14T11:17:15.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.323+0000 7f1d3b7fe700 1 -- 172.21.15.84:0/1435367124 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2c00e320 con 0x7f1d2c006a60 2023-07-14T11:17:15.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.324+0000 7f1d3b7fe700 1 -- 172.21.15.84:0/1435367124 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2c00e4e0 con 0x7f1d2c007410 2023-07-14T11:17:15.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.324+0000 7f1d3bfff700 1 --2- 172.21.15.84:0/1435367124 >> v2:172.21.15.179:3300/0 conn(0x7f1d3c0b12f0 0x7f1d3c0ad8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:17:15.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.324+0000 7f1d40f9b700 1 --2- 172.21.15.84:0/1435367124 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d2c005da0 0x7f1d2c006190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:15.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.324+0000 7f1d4179c700 1 --2- 172.21.15.84:0/1435367124 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d2c007410 0x7f1d2c00dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:15.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.324+0000 7f1d3bfff700 1 --2- 172.21.15.84:0/1435367124 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d2c006a60 0x7f1d2c006ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:15.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.324+0000 7f1d40f9b700 1 -- 172.21.15.84:0/1435367124 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d2c007410 msgr2=0x7f1d2c00dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:15.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.324+0000 7f1d40f9b700 1 --2- 172.21.15.84:0/1435367124 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d2c007410 0x7f1d2c00dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:15.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.324+0000 7f1d40f9b700 1 -- 172.21.15.84:0/1435367124 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d2c006a60 msgr2=0x7f1d2c006ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:15.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.324+0000 7f1d40f9b700 1 --2- 172.21.15.84:0/1435367124 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d2c006a60 0x7f1d2c006ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:15.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.324+0000 7f1d40f9b700 1 -- 172.21.15.84:0/1435367124 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d2c0057c0 con 0x7f1d2c005da0 2023-07-14T11:17:15.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.324+0000 7f1d4179c700 1 --2- 172.21.15.84:0/1435367124 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d2c007410 0x7f1d2c00dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:17:15.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.324+0000 7f1d4179c700 1 -- 172.21.15.84:0/1435367124 reap_dead start 2023-07-14T11:17:15.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.324+0000 7f1d40f9b700 1 --2- 172.21.15.84:0/1435367124 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d2c005da0 0x7f1d2c006190 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f1d30001eb0 tx=0x7f1d2c007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da115961e9c46c80 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:15.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.325+0000 7f1d3b7fe700 1 -- 172.21.15.84:0/1435367124 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3000cd80 con 0x7f1d2c005da0 2023-07-14T11:17:15.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.325+0000 7f1d3b7fe700 1 -- 172.21.15.84:0/1435367124 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d30001af0 con 0x7f1d2c005da0 2023-07-14T11:17:15.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.325+0000 7f1d3b7fe700 1 -- 172.21.15.84:0/1435367124 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d30005ba0 con 0x7f1d2c005da0 2023-07-14T11:17:15.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.325+0000 7f1d431ff700 1 -- 172.21.15.84:0/1435367124 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d2c005da0 msgr2=0x7f1d2c006190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:15.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.325+0000 7f1d431ff700 1 --2- 172.21.15.84:0/1435367124 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d2c005da0 0x7f1d2c006190 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f1d30001eb0 tx=0x7f1d2c007a90 comp rx=0 tx=0).stop 2023-07-14T11:17:15.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.325+0000 7f1d431ff700 1 -- 172.21.15.84:0/1435367124 shutdown_connections 2023-07-14T11:17:15.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.325+0000 7f1d431ff700 1 --2- 172.21.15.84:0/1435367124 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d2c005da0 0x7f1d2c006190 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:15.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.325+0000 7f1d431ff700 1 -- 172.21.15.84:0/1435367124 >> 172.21.15.84:0/1435367124 conn(0x7f1d3c0b05d0 msgr2=0x7f1d3c0b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:15.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.325+0000 7f1d431ff700 1 -- 172.21.15.84:0/1435367124 shutdown_connections 2023-07-14T11:17:15.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.325+0000 7f1d431ff700 1 -- 172.21.15.84:0/1435367124 wait complete. 2023-07-14T11:17:15.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.327+0000 7f1d431ff700 1 Processor -- start 2023-07-14T11:17:15.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.327+0000 7f1d431ff700 1 -- start start 2023-07-14T11:17:15.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.328+0000 7f1d431ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d2c005da0 0x7f1d3c0c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:15.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.328+0000 7f1d431ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d3c06c330 0x7f1d3c1526b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:15.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.328+0000 7f1d431ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d3c0b2a10 0x7f1d3c0b2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:15.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.328+0000 7f1d431ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3c0c6b80 con 0x7f1d3c0b2a10 2023-07-14T11:17:15.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.328+0000 7f1d431ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3c0c6e60 con 0x7f1d3c06c330 2023-07-14T11:17:15.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.328+0000 7f1d431ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3c0c7350 con 0x7f1d2c005da0 2023-07-14T11:17:15.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.328+0000 7f1d4179c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d3c0b2a10 0x7f1d3c0b2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:15.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.328+0000 7f1d4179c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d3c0b2a10 0x7f1d3c0b2e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35234/0 (socket says 172.21.15.84:35234) 2023-07-14T11:17:15.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.328+0000 7f1d4179c700 1 -- 172.21.15.84:0/2865466617 learned_addr learned my addr 172.21.15.84:0/2865466617 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:15.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.328+0000 7f1d40f9b700 1 --2- 172.21.15.84:0/2865466617 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d2c005da0 0x7f1d3c0c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:15.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.328+0000 7f1d3bfff700 1 --2- 172.21.15.84:0/2865466617 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d3c06c330 0x7f1d3c1526b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:15.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.329+0000 7f1d4179c700 1 -- 172.21.15.84:0/2865466617 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d2c005da0 msgr2=0x7f1d3c0c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:15.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.329+0000 7f1d4179c700 1 --2- 172.21.15.84:0/2865466617 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d2c005da0 0x7f1d3c0c65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:15.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.329+0000 7f1d4179c700 1 -- 172.21.15.84:0/2865466617 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d3c06c330 msgr2=0x7f1d3c1526b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:15.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.329+0000 7f1d4179c700 1 --2- 172.21.15.84:0/2865466617 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d3c06c330 0x7f1d3c1526b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:15.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.329+0000 7f1d4179c700 1 -- 172.21.15.84:0/2865466617 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d3c0c7630 con 0x7f1d3c0b2a10 2023-07-14T11:17:15.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.329+0000 7f1d4179c700 1 --2- 172.21.15.84:0/2865466617 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d3c0b2a10 0x7f1d3c0b2e80 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f1d34001a50 tx=0x7f1d340021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:15.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.329+0000 7f1d397fa700 1 -- 172.21.15.84:0/2865466617 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d34003c10 con 0x7f1d3c0b2a10 2023-07-14T11:17:15.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.329+0000 7f1d397fa700 1 -- 172.21.15.84:0/2865466617 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d34003d70 con 0x7f1d3c0b2a10 2023-07-14T11:17:15.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.329+0000 7f1d397fa700 1 -- 172.21.15.84:0/2865466617 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d340052d0 con 0x7f1d3c0b2a10 2023-07-14T11:17:15.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.329+0000 7f1d431ff700 1 -- 172.21.15.84:0/2865466617 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d3c0c7910 con 0x7f1d3c0b2a10 2023-07-14T11:17:15.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.329+0000 7f1d431ff700 1 -- 172.21.15.84:0/2865466617 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d3c06c7a0 con 0x7f1d3c0b2a10 2023-07-14T11:17:15.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.330+0000 7f1d431ff700 1 -- 172.21.15.84:0/2865466617 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d3c0c7b00 con 0x7f1d3c0b2a10 2023-07-14T11:17:15.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.331+0000 7f1d397fa700 1 -- 172.21.15.84:0/2865466617 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 9) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f1d34005430 con 0x7f1d3c0b2a10 2023-07-14T11:17:15.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.332+0000 7f1d397fa700 1 --2- 172.21.15.84:0/2865466617 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1d2006ae90 0x7f1d2006d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:15.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.332+0000 7f1d397fa700 1 -- 172.21.15.84:0/2865466617 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1d340898d0 con 0x7f1d3c0b2a10 2023-07-14T11:17:15.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.333+0000 7f1d40f9b700 1 --2- 172.21.15.84:0/2865466617 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1d2006ae90 0x7f1d2006d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:15.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.333+0000 7f1d40f9b700 1 --2- 172.21.15.84:0/2865466617 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1d2006ae90 0x7f1d2006d340 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f1d30015040 tx=0x7f1d30006040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:15.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.336+0000 7f1d397fa700 1 -- 172.21.15.84:0/2865466617 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f1d34054660 con 0x7f1d3c0b2a10 2023-07-14T11:17:15.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:15.573+0000 7f1d431ff700 1 -- 172.21.15.84:0/2865466617 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f1d3c074350 con 0x7f1d3c0b2a10 2023-07-14T11:17:16.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.104+0000 7f1d397fa700 1 -- 172.21.15.84:0/2865466617 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v37) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1d34057c80 con 0x7f1d3c0b2a10 2023-07-14T11:17:16.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.106+0000 7f1d431ff700 1 -- 172.21.15.84:0/2865466617 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1d2006ae90 msgr2=0x7f1d2006d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:16.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.106+0000 7f1d431ff700 1 --2- 172.21.15.84:0/2865466617 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1d2006ae90 0x7f1d2006d340 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f1d30015040 tx=0x7f1d30006040 comp rx=0 tx=0).stop 2023-07-14T11:17:16.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.106+0000 7f1d431ff700 1 -- 172.21.15.84:0/2865466617 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d3c0b2a10 msgr2=0x7f1d3c0b2e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:16.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.106+0000 7f1d431ff700 1 --2- 172.21.15.84:0/2865466617 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d3c0b2a10 0x7f1d3c0b2e80 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f1d34001a50 tx=0x7f1d340021d0 comp rx=0 tx=0).stop 2023-07-14T11:17:16.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.107+0000 7f1d431ff700 1 -- 172.21.15.84:0/2865466617 shutdown_connections 2023-07-14T11:17:16.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.107+0000 7f1d431ff700 1 --2- 172.21.15.84:0/2865466617 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1d2006ae90 0x7f1d2006d340 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:16.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.107+0000 7f1d431ff700 1 --2- 172.21.15.84:0/2865466617 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d2c005da0 0x7f1d3c0c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:16.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.107+0000 7f1d431ff700 1 --2- 172.21.15.84:0/2865466617 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d3c0b2a10 0x7f1d3c0b2e80 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:16.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.107+0000 7f1d431ff700 1 --2- 172.21.15.84:0/2865466617 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d3c06c330 0x7f1d3c1526b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:16.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.107+0000 7f1d431ff700 1 -- 172.21.15.84:0/2865466617 >> 172.21.15.84:0/2865466617 conn(0x7f1d3c0b05d0 msgr2=0x7f1d3c1583a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:16.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.107+0000 7f1d431ff700 1 -- 172.21.15.84:0/2865466617 shutdown_connections 2023-07-14T11:17:16.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.107+0000 7f1d431ff700 1 -- 172.21.15.84:0/2865466617 wait complete. 2023-07-14T11:17:16.127 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-14T11:17:16.128 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T11:17:16.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.321+0000 7f8f9f7ff700 1 Processor -- start 2023-07-14T11:17:16.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.321+0000 7f8f9f7ff700 1 -- start start 2023-07-14T11:17:16.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.322+0000 7f8f9f7ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8f980b4510 0x7f8f980b6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:16.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.322+0000 7f8f9f7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f980d0b10 0x7f8f980d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:16.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.322+0000 7f8f9f7ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f980b7f50 con 0x7f8f980b5d90 2023-07-14T11:17:16.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.322+0000 7f8f9f7ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f980b48e0 con 0x7f8f980b4510 2023-07-14T11:17:16.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.322+0000 7f8f9f7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f980d14d0 con 0x7f8f980d0b10 2023-07-14T11:17:16.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.322+0000 7f8f9cd9a700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f8f980b5d90 0x7f8f980cd590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:43172/0 (socket says 172.21.15.84:43172) 2023-07-14T11:17:16.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.322+0000 7f8f9cd9a700 1 -- 172.21.15.84:0/3132933873 learned_addr learned my addr 172.21.15.84:0/3132933873 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:17:16.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.323+0000 7f8f8ffff700 1 -- 172.21.15.84:0/3132933873 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1786257540 0 0) 0x7f8f980b7f50 con 0x7f8f980b5d90 2023-07-14T11:17:16.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.323+0000 7f8f8ffff700 1 -- 172.21.15.84:0/3132933873 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f840035b0 con 0x7f8f980b5d90 2023-07-14T11:17:16.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.323+0000 7f8f9dd9c700 1 --2- 172.21.15.84:0/3132933873 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f980d0b10 0x7f8f980d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:16.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.323+0000 7f8f9d59b700 1 --2- 172.21.15.84:0/3132933873 >> v2:172.21.15.179:3300/0 conn(0x7f8f980b4510 0x7f8f980b6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:16.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.323+0000 7f8f8ffff700 1 -- 172.21.15.84:0/3132933873 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2078468373 0 0) 0x7f8f840035b0 con 0x7f8f980b5d90 2023-07-14T11:17:16.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.323+0000 7f8f8ffff700 1 -- 172.21.15.84:0/3132933873 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f980d0b10 msgr2=0x7f8f980d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:16.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.323+0000 7f8f8ffff700 1 --2- 172.21.15.84:0/3132933873 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f980d0b10 0x7f8f980d0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:16.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.323+0000 7f8f8ffff700 1 -- 172.21.15.84:0/3132933873 >> v2:172.21.15.179:3300/0 conn(0x7f8f980b4510 msgr2=0x7f8f980b6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:16.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.323+0000 7f8f8ffff700 1 --2- 172.21.15.84:0/3132933873 >> v2:172.21.15.179:3300/0 conn(0x7f8f980b4510 0x7f8f980b6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:16.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.323+0000 7f8f8ffff700 1 -- 172.21.15.84:0/3132933873 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f980cdca0 con 0x7f8f980b5d90 2023-07-14T11:17:16.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.323+0000 7f8f8ffff700 1 -- 172.21.15.84:0/3132933873 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7f8f88001670 con 0x7f8f980b5d90 2023-07-14T11:17:16.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.323+0000 7f8f8ffff700 1 -- 172.21.15.84:0/3132933873 >> v1:172.21.15.84:6789/0 conn(0x7f8f980b5d90 legacy=0x7f8f980cd590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:16.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.323+0000 7f8f8ffff700 1 --2- 172.21.15.84:0/3132933873 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f84003a00 0x7f8f84003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:16.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.323+0000 7f8f8ffff700 1 --2- 172.21.15.84:0/3132933873 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f980d0b10 0x7f8f84004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:16.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.323+0000 7f8f8ffff700 1 --2- 172.21.15.84:0/3132933873 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f84004d90 0x7f8f84005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:16.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.323+0000 7f8f8ffff700 1 -- 172.21.15.84:0/3132933873 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f980d14d0 con 0x7f8f84003a00 2023-07-14T11:17:16.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.323+0000 7f8f8ffff700 1 -- 172.21.15.84:0/3132933873 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8400bba0 con 0x7f8f84004d90 2023-07-14T11:17:16.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.323+0000 7f8f8ffff700 1 -- 172.21.15.84:0/3132933873 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8400bd60 con 0x7f8f980d0b10 2023-07-14T11:17:16.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.323+0000 7f8f9d59b700 1 --2- 172.21.15.84:0/3132933873 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f84003a00 0x7f8f84003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:16.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.324+0000 7f8f9cd9a700 1 --2- 172.21.15.84:0/3132933873 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f980d0b10 0x7f8f84004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:16.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.324+0000 7f8f9dd9c700 1 --2- 172.21.15.84:0/3132933873 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f84004d90 0x7f8f84005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:16.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.324+0000 7f8f9d59b700 1 -- 172.21.15.84:0/3132933873 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f980d0b10 msgr2=0x7f8f84004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:16.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.324+0000 7f8f9d59b700 1 --2- 172.21.15.84:0/3132933873 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f980d0b10 0x7f8f84004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:16.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.324+0000 7f8f9d59b700 1 -- 172.21.15.84:0/3132933873 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f84004d90 msgr2=0x7f8f84005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:16.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.324+0000 7f8f9d59b700 1 --2- 172.21.15.84:0/3132933873 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f84004d90 0x7f8f84005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:16.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.324+0000 7f8f9d59b700 1 -- 172.21.15.84:0/3132933873 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f840035b0 con 0x7f8f84003a00 2023-07-14T11:17:16.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.324+0000 7f8f9d59b700 1 --2- 172.21.15.84:0/3132933873 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f84003a00 0x7f8f84003e10 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f8f94009880 tx=0x7f8f84005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c84dcaa43531dd5b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:16.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.324+0000 7f8f8ffff700 1 -- 172.21.15.84:0/3132933873 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f9400c070 con 0x7f8f84003a00 2023-07-14T11:17:16.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.324+0000 7f8f8ffff700 1 -- 172.21.15.84:0/3132933873 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f94005c20 con 0x7f8f84003a00 2023-07-14T11:17:16.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.324+0000 7f8f8ffff700 1 -- 172.21.15.84:0/3132933873 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f94006050 con 0x7f8f84003a00 2023-07-14T11:17:16.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.325+0000 7f8f9f7ff700 1 -- 172.21.15.84:0/3132933873 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f84003a00 msgr2=0x7f8f84003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:16.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.325+0000 7f8f9f7ff700 1 --2- 172.21.15.84:0/3132933873 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f84003a00 0x7f8f84003e10 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f8f94009880 tx=0x7f8f84005880 comp rx=0 tx=0).stop 2023-07-14T11:17:16.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.325+0000 7f8f9dd9c700 1 -- 172.21.15.84:0/3132933873 reap_dead start 2023-07-14T11:17:16.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.325+0000 7f8f9f7ff700 1 -- 172.21.15.84:0/3132933873 shutdown_connections 2023-07-14T11:17:16.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.325+0000 7f8f9f7ff700 1 -- 172.21.15.84:0/3132933873 >> 172.21.15.84:0/3132933873 conn(0x7f8f9809c1d0 msgr2=0x7f8f980d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:16.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.325+0000 7f8f9f7ff700 1 -- 172.21.15.84:0/3132933873 shutdown_connections 2023-07-14T11:17:16.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.325+0000 7f8f9f7ff700 1 -- 172.21.15.84:0/3132933873 wait complete. 2023-07-14T11:17:16.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.327+0000 7f8f9f7ff700 1 Processor -- start 2023-07-14T11:17:16.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.327+0000 7f8f9f7ff700 1 -- start start 2023-07-14T11:17:16.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.328+0000 7f8f9f7ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f84003a00 0x7f8f98151d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:16.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.328+0000 7f8f9f7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f98158c40 0x7f8f98156200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:16.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.328+0000 7f8f9f7ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f981f68b0 0x7f8f980c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:16.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.328+0000 7f8f9f7ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f98157870 con 0x7f8f84003a00 2023-07-14T11:17:16.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.328+0000 7f8f9f7ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f981594b0 con 0x7f8f981f68b0 2023-07-14T11:17:16.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.328+0000 7f8f9f7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f981591d0 con 0x7f8f98158c40 2023-07-14T11:17:16.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.328+0000 7f8f9d59b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f84003a00 0x7f8f98151d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:16.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.328+0000 7f8f9d59b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f84003a00 0x7f8f98151d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35244/0 (socket says 172.21.15.84:35244) 2023-07-14T11:17:16.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.328+0000 7f8f9d59b700 1 -- 172.21.15.84:0/4274064508 learned_addr learned my addr 172.21.15.84:0/4274064508 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:16.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.328+0000 7f8f9dd9c700 1 --2- 172.21.15.84:0/4274064508 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f981f68b0 0x7f8f980c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:16.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.328+0000 7f8f9cd9a700 1 --2- 172.21.15.84:0/4274064508 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f98158c40 0x7f8f98156200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:16.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.328+0000 7f8f9d59b700 1 -- 172.21.15.84:0/4274064508 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f98158c40 msgr2=0x7f8f98156200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:16.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.328+0000 7f8f9d59b700 1 --2- 172.21.15.84:0/4274064508 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f98158c40 0x7f8f98156200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:16.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.328+0000 7f8f9d59b700 1 -- 172.21.15.84:0/4274064508 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f981f68b0 msgr2=0x7f8f980c8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:16.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.328+0000 7f8f9d59b700 1 --2- 172.21.15.84:0/4274064508 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f981f68b0 0x7f8f980c8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:16.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.328+0000 7f8f9d59b700 1 -- 172.21.15.84:0/4274064508 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f981f5dd0 con 0x7f8f84003a00 2023-07-14T11:17:16.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.328+0000 7f8f9cd9a700 1 --2- 172.21.15.84:0/4274064508 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f98158c40 0x7f8f98156200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:17:16.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.329+0000 7f8f9d59b700 1 --2- 172.21.15.84:0/4274064508 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f84003a00 0x7f8f98151d50 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f8f84005810 tx=0x7f8f940047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:16.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.329+0000 7f8f8dffb700 1 -- 172.21.15.84:0/4274064508 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f940063a0 con 0x7f8f84003a00 2023-07-14T11:17:16.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.329+0000 7f8f8dffb700 1 -- 172.21.15.84:0/4274064508 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f94006500 con 0x7f8f84003a00 2023-07-14T11:17:16.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.329+0000 7f8f8dffb700 1 -- 172.21.15.84:0/4274064508 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f940068b0 con 0x7f8f84003a00 2023-07-14T11:17:16.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.329+0000 7f8f9f7ff700 1 -- 172.21.15.84:0/4274064508 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f981f60b0 con 0x7f8f84003a00 2023-07-14T11:17:16.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.329+0000 7f8f9f7ff700 1 -- 172.21.15.84:0/4274064508 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f98152290 con 0x7f8f84003a00 2023-07-14T11:17:16.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.330+0000 7f8f9f7ff700 1 -- 172.21.15.84:0/4274064508 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f9804e280 con 0x7f8f84003a00 2023-07-14T11:17:16.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.331+0000 7f8f8dffb700 1 -- 172.21.15.84:0/4274064508 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 9) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f8f94013430 con 0x7f8f84003a00 2023-07-14T11:17:16.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.332+0000 7f8f8dffb700 1 --2- 172.21.15.84:0/4274064508 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f8f7c06ae90 0x7f8f7c06d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:16.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.332+0000 7f8f8dffb700 1 -- 172.21.15.84:0/4274064508 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8f94089fe0 con 0x7f8f84003a00 2023-07-14T11:17:16.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.332+0000 7f8f9cd9a700 1 --2- 172.21.15.84:0/4274064508 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f8f7c06ae90 0x7f8f7c06d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:16.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.332+0000 7f8f9cd9a700 1 --2- 172.21.15.84:0/4274064508 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f8f7c06ae90 0x7f8f7c06d340 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8f88001eb0 tx=0x7f8f88009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:16.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.336+0000 7f8f8dffb700 1 -- 172.21.15.84:0/4274064508 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f8f94054cf0 con 0x7f8f84003a00 2023-07-14T11:17:16.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.571+0000 7f8f9f7ff700 1 -- 172.21.15.84:0/4274064508 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8f980d12b0 con 0x7f8f84003a00 2023-07-14T11:17:16.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.571+0000 7f8f8dffb700 1 -- 172.21.15.84:0/4274064508 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+4716 (secure 0 0 0) 0x7f8f9402a090 con 0x7f8f84003a00 2023-07-14T11:17:16.574 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:17:16.574 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":37,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5342,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/2977703024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2977703024},{"type":"v1","addr":"172.21.15.179:6834","nonce":2977703024}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31},{"gid":5351,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/2068020315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":2068020315},{"type":"v1","addr":"172.21.15.84:6837","nonce":2068020315}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32},{"gid":5914,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/2441649918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2441649918},{"type":"v1","addr":"172.21.15.84:6836","nonce":2441649918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T11:17:12.547835+0000","modified":"2023-07-14T11:17:16.095092+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6174},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6174":{"gid":6174,"name":"d","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/3902238230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":3902238230},{"type":"v1","addr":"172.21.15.179:6835","nonce":3902238230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-07-14T11:17:16.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.574+0000 7f8f9f7ff700 1 -- 172.21.15.84:0/4274064508 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f8f7c06ae90 msgr2=0x7f8f7c06d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:16.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.574+0000 7f8f9f7ff700 1 --2- 172.21.15.84:0/4274064508 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f8f7c06ae90 0x7f8f7c06d340 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8f88001eb0 tx=0x7f8f88009040 comp rx=0 tx=0).stop 2023-07-14T11:17:16.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.574+0000 7f8f9f7ff700 1 -- 172.21.15.84:0/4274064508 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f84003a00 msgr2=0x7f8f98151d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:16.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.574+0000 7f8f9f7ff700 1 --2- 172.21.15.84:0/4274064508 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f84003a00 0x7f8f98151d50 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f8f84005810 tx=0x7f8f940047c0 comp rx=0 tx=0).stop 2023-07-14T11:17:16.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.574+0000 7f8f9f7ff700 1 -- 172.21.15.84:0/4274064508 shutdown_connections 2023-07-14T11:17:16.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.574+0000 7f8f9f7ff700 1 --2- 172.21.15.84:0/4274064508 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f981f68b0 0x7f8f980c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:16.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.574+0000 7f8f9f7ff700 1 --2- 172.21.15.84:0/4274064508 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f84003a00 0x7f8f98151d50 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:16.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.574+0000 7f8f9f7ff700 1 --2- 172.21.15.84:0/4274064508 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f8f7c06ae90 0x7f8f7c06d340 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:16.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.574+0000 7f8f9f7ff700 1 --2- 172.21.15.84:0/4274064508 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f98158c40 0x7f8f98156200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:16.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.574+0000 7f8f9f7ff700 1 -- 172.21.15.84:0/4274064508 >> 172.21.15.84:0/4274064508 conn(0x7f8f9809c1d0 msgr2=0x7f8f980ce1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:16.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.574+0000 7f8f9f7ff700 1 -- 172.21.15.84:0/4274064508 shutdown_connections 2023-07-14T11:17:16.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.574+0000 7f8f9f7ff700 1 -- 172.21.15.84:0/4274064508 wait complete. 2023-07-14T11:17:16.578 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 37 2023-07-14T11:17:16.594 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:17:16.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.786+0000 7fc501bff700 1 Processor -- start 2023-07-14T11:17:16.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.787+0000 7fc501bff700 1 -- start start 2023-07-14T11:17:16.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.788+0000 7fc501bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc4fc15c950 0x7fc4fc0b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:16.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.788+0000 7fc501bff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc4fc0b1e00 0x7fc4fc0d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:16.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.788+0000 7fc501bff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4fc0d2ce0 con 0x7fc4fc0b2350 2023-07-14T11:17:16.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.788+0000 7fc501bff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4fc0b3350 con 0x7fc4fc0b1e00 2023-07-14T11:17:16.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.788+0000 7fc501bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4fc0b3630 con 0x7fc4fc15c950 2023-07-14T11:17:16.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.788+0000 7fc4f3fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc4fc0b1e00 0x7fc4fc0d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:16.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.788+0000 7fc4f3fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc4fc0b1e00 0x7fc4fc0d0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35256/0 (socket says 172.21.15.84:35256) 2023-07-14T11:17:16.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.788+0000 7fc4f3fff700 1 -- 172.21.15.84:0/169558981 learned_addr learned my addr 172.21.15.84:0/169558981 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:16.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.788+0000 7fc4fb7fe700 1 --2- 172.21.15.84:0/169558981 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc4fc15c950 0x7fc4fc0b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:16.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.789+0000 7fc4f3fff700 1 -- 172.21.15.84:0/169558981 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc4fc15c950 msgr2=0x7fc4fc0b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:16.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.789+0000 7fc4f3fff700 1 --2- 172.21.15.84:0/169558981 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc4fc15c950 0x7fc4fc0b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:16.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.789+0000 7fc4f3fff700 1 -- 172.21.15.84:0/169558981 >> v1:172.21.15.179:6789/0 conn(0x7fc4fc0b2350 legacy=0x7fc4fc0afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:16.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.789+0000 7fc4f3fff700 1 -- 172.21.15.84:0/169558981 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4fc0b3910 con 0x7fc4fc0b1e00 2023-07-14T11:17:16.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.789+0000 7fc4f3fff700 1 --2- 172.21.15.84:0/169558981 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4fc0b1e00 0x7fc4fc0d0b10 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fc4e40098f0 tx=0x7fc4e4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7efaada8fb8a0a5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:16.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.789+0000 7fc4faffd700 1 -- 172.21.15.84:0/169558981 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e400b8a0 con 0x7fc4fc0b1e00 2023-07-14T11:17:16.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.789+0000 7fc4faffd700 1 -- 172.21.15.84:0/169558981 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4e400ba00 con 0x7fc4fc0b1e00 2023-07-14T11:17:16.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.789+0000 7fc4faffd700 1 -- 172.21.15.84:0/169558981 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e400bd90 con 0x7fc4fc0b1e00 2023-07-14T11:17:16.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.790+0000 7fc501bff700 1 -- 172.21.15.84:0/169558981 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4fc0b1e00 msgr2=0x7fc4fc0d0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:16.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.790+0000 7fc501bff700 1 --2- 172.21.15.84:0/169558981 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4fc0b1e00 0x7fc4fc0d0b10 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fc4e40098f0 tx=0x7fc4e4009c00 comp rx=0 tx=0).stop 2023-07-14T11:17:16.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.790+0000 7fc501bff700 1 -- 172.21.15.84:0/169558981 shutdown_connections 2023-07-14T11:17:16.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.790+0000 7fc501bff700 1 --2- 172.21.15.84:0/169558981 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc4fc15c950 0x7fc4fc0b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:16.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.790+0000 7fc501bff700 1 --2- 172.21.15.84:0/169558981 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4fc0b1e00 0x7fc4fc0d0b10 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:16.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.790+0000 7fc501bff700 1 -- 172.21.15.84:0/169558981 >> 172.21.15.84:0/169558981 conn(0x7fc4fc09c1d0 msgr2=0x7fc4fc0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:16.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.790+0000 7fc501bff700 1 -- 172.21.15.84:0/169558981 shutdown_connections 2023-07-14T11:17:16.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.790+0000 7fc501bff700 1 -- 172.21.15.84:0/169558981 wait complete. 2023-07-14T11:17:16.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.792+0000 7fc501bff700 1 Processor -- start 2023-07-14T11:17:16.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.792+0000 7fc501bff700 1 -- start start 2023-07-14T11:17:16.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.794+0000 7fc501bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc4fc0b1e00 0x7fc4fc0cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:16.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.794+0000 7fc501bff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4fc0b2350 0x7fc4fc0b8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:16.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.794+0000 7fc501bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc4fc15c950 0x7fc4fc0c8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:16.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.794+0000 7fc501bff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4fc0b83f0 con 0x7fc4fc0b2350 2023-07-14T11:17:16.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.794+0000 7fc501bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4fc0b79c0 con 0x7fc4fc15c950 2023-07-14T11:17:16.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.794+0000 7fc501bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4fc0b76e0 con 0x7fc4fc0b1e00 2023-07-14T11:17:16.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.794+0000 7fc4f3fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4fc0b2350 0x7fc4fc0b8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:16.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.794+0000 7fc4f3fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4fc0b2350 0x7fc4fc0b8880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35268/0 (socket says 172.21.15.84:35268) 2023-07-14T11:17:16.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.794+0000 7fc4f3fff700 1 -- 172.21.15.84:0/3680703641 learned_addr learned my addr 172.21.15.84:0/3680703641 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:16.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.794+0000 7fc4fb7fe700 1 --2- 172.21.15.84:0/3680703641 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc4fc0b1e00 0x7fc4fc0cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:16.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.794+0000 7fc4fbfff700 1 --2- 172.21.15.84:0/3680703641 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc4fc15c950 0x7fc4fc0c8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:16.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.794+0000 7fc4f3fff700 1 -- 172.21.15.84:0/3680703641 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc4fc0b1e00 msgr2=0x7fc4fc0cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:16.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.794+0000 7fc4f3fff700 1 --2- 172.21.15.84:0/3680703641 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc4fc0b1e00 0x7fc4fc0cceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:16.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.794+0000 7fc4f3fff700 1 -- 172.21.15.84:0/3680703641 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc4fc15c950 msgr2=0x7fc4fc0c8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:16.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.794+0000 7fc4f3fff700 1 --2- 172.21.15.84:0/3680703641 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc4fc15c950 0x7fc4fc0c8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:16.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.794+0000 7fc4f3fff700 1 -- 172.21.15.84:0/3680703641 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4e4009550 con 0x7fc4fc0b2350 2023-07-14T11:17:16.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.794+0000 7fc4fbfff700 1 --2- 172.21.15.84:0/3680703641 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc4fc15c950 0x7fc4fc0c8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:17:16.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.795+0000 7fc4f3fff700 1 --2- 172.21.15.84:0/3680703641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4fc0b2350 0x7fc4fc0b8880 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fc4e4009c40 tx=0x7fc4e4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:16.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.795+0000 7fc4f8ff9700 1 -- 172.21.15.84:0/3680703641 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e4004380 con 0x7fc4fc0b2350 2023-07-14T11:17:16.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.795+0000 7fc4f8ff9700 1 -- 172.21.15.84:0/3680703641 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4e401f070 con 0x7fc4fc0b2350 2023-07-14T11:17:16.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.795+0000 7fc501bff700 1 -- 172.21.15.84:0/3680703641 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4fc0b7da0 con 0x7fc4fc0b2350 2023-07-14T11:17:16.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.795+0000 7fc4f8ff9700 1 -- 172.21.15.84:0/3680703641 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e40036a0 con 0x7fc4fc0b2350 2023-07-14T11:17:16.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.795+0000 7fc501bff700 1 -- 172.21.15.84:0/3680703641 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4fc0b7370 con 0x7fc4fc0b2350 2023-07-14T11:17:16.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.796+0000 7fc501bff700 1 -- 172.21.15.84:0/3680703641 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4fc0d1410 con 0x7fc4fc0b2350 2023-07-14T11:17:16.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.797+0000 7fc4f8ff9700 1 -- 172.21.15.84:0/3680703641 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 9) v1 ==== 89190+0+0 (secure 0 0 0) 0x7fc4e4021030 con 0x7fc4fc0b2350 2023-07-14T11:17:16.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.798+0000 7fc4f8ff9700 1 --2- 172.21.15.84:0/3680703641 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc4dc06ae90 0x7fc4dc06d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:16.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.798+0000 7fc4f8ff9700 1 -- 172.21.15.84:0/3680703641 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc4e408ac20 con 0x7fc4fc0b2350 2023-07-14T11:17:16.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.799+0000 7fc4fb7fe700 1 --2- 172.21.15.84:0/3680703641 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc4dc06ae90 0x7fc4dc06d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:16.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.799+0000 7fc4fb7fe700 1 --2- 172.21.15.84:0/3680703641 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc4dc06ae90 0x7fc4dc06d340 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc0c9190 tx=0x7fc4ec008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:16.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.803+0000 7fc4f8ff9700 1 -- 172.21.15.84:0/3680703641 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fc4e4055a40 con 0x7fc4fc0b2350 2023-07-14T11:17:17.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:16.999+0000 7fc501bff700 1 -- 172.21.15.84:0/3680703641 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc4fc04e280 con 0x7fc4fc0b2350 2023-07-14T11:17:17.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.000+0000 7fc4f8ff9700 1 -- 172.21.15.84:0/3680703641 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+18269 (secure 0 0 0) 0x7fc4e4059060 con 0x7fc4fc0b2350 2023-07-14T11:17:17.003 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:17:17.003 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":63,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:17:14.075543+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-07-14T11:17:10.750697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-07-14T11:17:11.528893+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:17:17.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.002+0000 7fc501bff700 1 -- 172.21.15.84:0/3680703641 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc4dc06ae90 msgr2=0x7fc4dc06d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:17.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.002+0000 7fc501bff700 1 --2- 172.21.15.84:0/3680703641 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc4dc06ae90 0x7fc4dc06d340 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc0c9190 tx=0x7fc4ec008040 comp rx=0 tx=0).stop 2023-07-14T11:17:17.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.002+0000 7fc501bff700 1 -- 172.21.15.84:0/3680703641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4fc0b2350 msgr2=0x7fc4fc0b8880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:17.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.002+0000 7fc501bff700 1 --2- 172.21.15.84:0/3680703641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4fc0b2350 0x7fc4fc0b8880 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fc4e4009c40 tx=0x7fc4e4004750 comp rx=0 tx=0).stop 2023-07-14T11:17:17.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.002+0000 7fc501bff700 1 -- 172.21.15.84:0/3680703641 shutdown_connections 2023-07-14T11:17:17.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.002+0000 7fc501bff700 1 --2- 172.21.15.84:0/3680703641 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc4dc06ae90 0x7fc4dc06d340 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:17.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.002+0000 7fc501bff700 1 --2- 172.21.15.84:0/3680703641 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc4fc0b1e00 0x7fc4fc0cceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:17.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.002+0000 7fc501bff700 1 --2- 172.21.15.84:0/3680703641 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc4fc15c950 0x7fc4fc0c8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:17.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.002+0000 7fc501bff700 1 --2- 172.21.15.84:0/3680703641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4fc0b2350 0x7fc4fc0b8880 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:17.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.002+0000 7fc501bff700 1 -- 172.21.15.84:0/3680703641 >> 172.21.15.84:0/3680703641 conn(0x7fc4fc09c1d0 msgr2=0x7fc4fc0b42f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:17.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.003+0000 7fc501bff700 1 -- 172.21.15.84:0/3680703641 shutdown_connections 2023-07-14T11:17:17.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.003+0000 7fc501bff700 1 -- 172.21.15.84:0/3680703641 wait complete. 2023-07-14T11:17:17.023 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-14T11:17:17.023 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T11:17:17.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.218+0000 7f3dd69ff700 1 Processor -- start 2023-07-14T11:17:17.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.218+0000 7f3dd69ff700 1 -- start start 2023-07-14T11:17:17.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.219+0000 7f3dd69ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3dd00d1220 0x7f3dd00b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:17.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.219+0000 7f3dd69ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3dd00b1e00 0x7f3dd00afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:17.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.219+0000 7f3dd69ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dd00d2ce0 con 0x7f3dd015c950 2023-07-14T11:17:17.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.219+0000 7f3dd69ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dd00b3350 con 0x7f3dd00b1e00 2023-07-14T11:17:17.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.219+0000 7f3dd69ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dd00b3630 con 0x7f3dd00d1220 2023-07-14T11:17:17.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.219+0000 7f3dd4f9c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3dd00b1e00 0x7f3dd00afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:17.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.219+0000 7f3dcffff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f3dd015c950 0x7f3dd00d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:43186/0 (socket says 172.21.15.84:43186) 2023-07-14T11:17:17.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.219+0000 7f3dcffff700 1 -- 172.21.15.84:0/1752818719 learned_addr learned my addr 172.21.15.84:0/1752818719 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:17:17.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.219+0000 7f3dd4f9c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3dd00b1e00 0x7f3dd00afac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35272/0 (socket says 172.21.15.84:35272) 2023-07-14T11:17:17.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.220+0000 7f3dd4f9c700 1 -- 172.21.15.84:0/1752818719 >> v2:172.21.15.179:3300/0 conn(0x7f3dd00d1220 msgr2=0x7f3dd00b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:17.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.220+0000 7f3dcf7fe700 1 --2- 172.21.15.84:0/1752818719 >> v2:172.21.15.179:3300/0 conn(0x7f3dd00d1220 0x7f3dd00b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:17.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.220+0000 7f3dd4f9c700 1 --2- 172.21.15.84:0/1752818719 >> v2:172.21.15.179:3300/0 conn(0x7f3dd00d1220 0x7f3dd00b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:17.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.220+0000 7f3dd4f9c700 1 -- 172.21.15.84:0/1752818719 >> v1:172.21.15.84:6789/0 conn(0x7f3dd015c950 legacy=0x7f3dd00d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:17.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.220+0000 7f3dd4f9c700 1 -- 172.21.15.84:0/1752818719 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dd00b3910 con 0x7f3dd00b1e00 2023-07-14T11:17:17.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.220+0000 7f3dcf7fe700 1 --2- 172.21.15.84:0/1752818719 >> v2:172.21.15.179:3300/0 conn(0x7f3dd00d1220 0x7f3dd00b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:17:17.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.220+0000 7f3dceffd700 1 -- 172.21.15.84:0/1752818719 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3282973833 0 0) 0x7f3dd00d2ce0 con 0x7f3dd015c950 2023-07-14T11:17:17.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.220+0000 7f3dd4f9c700 1 --2- 172.21.15.84:0/1752818719 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3dd00b1e00 0x7f3dd00afac0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f3dd0072140 tx=0x7f3dc800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75e9c3d6b4cb6258 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:17.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.220+0000 7f3dceffd700 1 -- 172.21.15.84:0/1752818719 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc800e070 con 0x7f3dd00b1e00 2023-07-14T11:17:17.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.220+0000 7f3dceffd700 1 -- 172.21.15.84:0/1752818719 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dc800bbd0 con 0x7f3dd00b1e00 2023-07-14T11:17:17.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.220+0000 7f3dceffd700 1 -- 172.21.15.84:0/1752818719 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc8012430 con 0x7f3dd00b1e00 2023-07-14T11:17:17.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.221+0000 7f3dd69ff700 1 -- 172.21.15.84:0/1752818719 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3dd00b1e00 msgr2=0x7f3dd00afac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:17.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.221+0000 7f3dd69ff700 1 --2- 172.21.15.84:0/1752818719 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3dd00b1e00 0x7f3dd00afac0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f3dd0072140 tx=0x7f3dc800b330 comp rx=0 tx=0).stop 2023-07-14T11:17:17.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.221+0000 7f3dd69ff700 1 -- 172.21.15.84:0/1752818719 shutdown_connections 2023-07-14T11:17:17.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.221+0000 7f3dd69ff700 1 --2- 172.21.15.84:0/1752818719 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3dd00b1e00 0x7f3dd00afac0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:17.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.221+0000 7f3dd69ff700 1 --2- 172.21.15.84:0/1752818719 >> v2:172.21.15.179:3300/0 conn(0x7f3dd00d1220 0x7f3dd00b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:17.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.221+0000 7f3dd69ff700 1 -- 172.21.15.84:0/1752818719 >> 172.21.15.84:0/1752818719 conn(0x7f3dd009c1d0 msgr2=0x7f3dd00d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:17.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.221+0000 7f3dd69ff700 1 -- 172.21.15.84:0/1752818719 shutdown_connections 2023-07-14T11:17:17.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.221+0000 7f3dd69ff700 1 -- 172.21.15.84:0/1752818719 wait complete. 2023-07-14T11:17:17.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.223+0000 7f3dd69ff700 1 Processor -- start 2023-07-14T11:17:17.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.223+0000 7f3dd69ff700 1 -- start start 2023-07-14T11:17:17.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.224+0000 7f3dd69ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3dd00b1e00 0x7f3dd01e82b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:17.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.224+0000 7f3dd69ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3dd00d1220 0x7f3dd00cf500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:17.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.224+0000 7f3dd69ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3dd015c950 0x7f3dd00cd550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:17.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.224+0000 7f3dd69ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd00c78f0 con 0x7f3dd015c950 2023-07-14T11:17:17.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.224+0000 7f3dd69ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd00c72c0 con 0x7f3dd00b1e00 2023-07-14T11:17:17.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.224+0000 7f3dd69ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd01e87f0 con 0x7f3dd00d1220 2023-07-14T11:17:17.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.224+0000 7f3dd4f9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3dd015c950 0x7f3dd00cd550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:17.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.224+0000 7f3dd4f9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3dd015c950 0x7f3dd00cd550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35286/0 (socket says 172.21.15.84:35286) 2023-07-14T11:17:17.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.224+0000 7f3dd4f9c700 1 -- 172.21.15.84:0/2927937599 learned_addr learned my addr 172.21.15.84:0/2927937599 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:17.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.224+0000 7f3dcffff700 1 --2- 172.21.15.84:0/2927937599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3dd00b1e00 0x7f3dd01e82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:17.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.224+0000 7f3dcf7fe700 1 --2- 172.21.15.84:0/2927937599 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3dd00d1220 0x7f3dd00cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:17.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.224+0000 7f3dd4f9c700 1 -- 172.21.15.84:0/2927937599 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3dd00d1220 msgr2=0x7f3dd00cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:17.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.224+0000 7f3dd4f9c700 1 --2- 172.21.15.84:0/2927937599 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3dd00d1220 0x7f3dd00cf500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:17.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.224+0000 7f3dd4f9c700 1 -- 172.21.15.84:0/2927937599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3dd00b1e00 msgr2=0x7f3dd01e82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:17.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.224+0000 7f3dd4f9c700 1 --2- 172.21.15.84:0/2927937599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3dd00b1e00 0x7f3dd01e82b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:17.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.224+0000 7f3dd4f9c700 1 -- 172.21.15.84:0/2927937599 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dc8009a70 con 0x7f3dd015c950 2023-07-14T11:17:17.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.225+0000 7f3dd4f9c700 1 --2- 172.21.15.84:0/2927937599 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3dd015c950 0x7f3dd00cd550 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f3dd00673b0 tx=0x7f3dc8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:17.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.225+0000 7f3dccff9700 1 -- 172.21.15.84:0/2927937599 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc8012430 con 0x7f3dd015c950 2023-07-14T11:17:17.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.225+0000 7f3dccff9700 1 -- 172.21.15.84:0/2927937599 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dc8020070 con 0x7f3dd015c950 2023-07-14T11:17:17.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.225+0000 7f3dd69ff700 1 -- 172.21.15.84:0/2927937599 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dd00cff70 con 0x7f3dd015c950 2023-07-14T11:17:17.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.225+0000 7f3dccff9700 1 -- 172.21.15.84:0/2927937599 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc8004280 con 0x7f3dd015c950 2023-07-14T11:17:17.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.225+0000 7f3dd69ff700 1 -- 172.21.15.84:0/2927937599 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dd00c7510 con 0x7f3dd015c950 2023-07-14T11:17:17.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.226+0000 7f3dd69ff700 1 -- 172.21.15.84:0/2927937599 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dd00c7a30 con 0x7f3dd015c950 2023-07-14T11:17:17.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.227+0000 7f3dccff9700 1 -- 172.21.15.84:0/2927937599 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 9) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f3dc80043e0 con 0x7f3dd015c950 2023-07-14T11:17:17.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.228+0000 7f3dccff9700 1 --2- 172.21.15.84:0/2927937599 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f3dbc06ae90 0x7f3dbc06d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:17.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.228+0000 7f3dccff9700 1 -- 172.21.15.84:0/2927937599 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3dc8022070 con 0x7f3dd015c950 2023-07-14T11:17:17.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.228+0000 7f3dcffff700 1 --2- 172.21.15.84:0/2927937599 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f3dbc06ae90 0x7f3dbc06d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:17.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.229+0000 7f3dcffff700 1 --2- 172.21.15.84:0/2927937599 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f3dbc06ae90 0x7f3dbc06d340 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f3dc0001750 tx=0x7f3dc0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:17.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.232+0000 7f3dccff9700 1 -- 172.21.15.84:0/2927937599 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3dd00c7a30 con 0x7f3dd015c950 2023-07-14T11:17:17.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.419+0000 7f3dd69ff700 1 -- 172.21.15.84:0/2927937599 --> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3dd00b3ed0 con 0x7f3dbc06ae90 2023-07-14T11:17:17.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.429+0000 7f3dccff9700 1 -- 172.21.15.84:0/2927937599 <== mgr.4104 v2:172.21.15.84:6832/379617029 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311068 (secure 0 0 0) 0x7f3dc00070d0 con 0x7f3dbc06ae90 2023-07-14T11:17:17.435 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:17:17.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.433+0000 7f3dd69ff700 1 -- 172.21.15.84:0/2927937599 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f3dbc06ae90 msgr2=0x7f3dbc06d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:17.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.433+0000 7f3dd69ff700 1 --2- 172.21.15.84:0/2927937599 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f3dbc06ae90 0x7f3dbc06d340 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f3dc0001750 tx=0x7f3dc0009040 comp rx=0 tx=0).stop 2023-07-14T11:17:17.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.433+0000 7f3dd69ff700 1 -- 172.21.15.84:0/2927937599 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3dd015c950 msgr2=0x7f3dd00cd550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:17.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.433+0000 7f3dd69ff700 1 --2- 172.21.15.84:0/2927937599 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3dd015c950 0x7f3dd00cd550 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f3dd00673b0 tx=0x7f3dc8004ad0 comp rx=0 tx=0).stop 2023-07-14T11:17:17.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.433+0000 7f3dd69ff700 1 -- 172.21.15.84:0/2927937599 shutdown_connections 2023-07-14T11:17:17.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.433+0000 7f3dd69ff700 1 --2- 172.21.15.84:0/2927937599 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3dd015c950 0x7f3dd00cd550 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:17.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.433+0000 7f3dd69ff700 1 --2- 172.21.15.84:0/2927937599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3dd00b1e00 0x7f3dd01e82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:17.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.433+0000 7f3dd69ff700 1 --2- 172.21.15.84:0/2927937599 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f3dbc06ae90 0x7f3dbc06d340 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:17.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.433+0000 7f3dd69ff700 1 --2- 172.21.15.84:0/2927937599 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3dd00d1220 0x7f3dd00cf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:17.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.433+0000 7f3dd69ff700 1 -- 172.21.15.84:0/2927937599 >> 172.21.15.84:0/2927937599 conn(0x7f3dd009c1d0 msgr2=0x7f3dd00d0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:17.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.433+0000 7f3dd69ff700 1 -- 172.21.15.84:0/2927937599 shutdown_connections 2023-07-14T11:17:17.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.433+0000 7f3dd69ff700 1 -- 172.21.15.84:0/2927937599 wait complete. 2023-07-14T11:17:17.439 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-07-14T11:17:17.453 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":184,"stamp":"2023-07-14T11:17:16.124465+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":135,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222760,"kb_used_data":7144,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754751960,"statfs":{"total":773094113280,"available":772866007040,"internally_reserved":0,"allocated":7315456,"data_stored":3868252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.070354"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.080336+0000","last_change":"2023-07-14T11:17:13.075796+0000","last_active":"2023-07-14T11:17:14.080336+0000","last_peered":"2023-07-14T11:17:14.080336+0000","last_clean":"2023-07-14T11:17:14.080336+0000","last_became_active":"2023-07-14T11:17:13.075489+0000","last_became_peered":"2023-07-14T11:17:13.075489+0000","last_unstale":"2023-07-14T11:17:14.080336+0000","last_undegraded":"2023-07-14T11:17:14.080336+0000","last_fullsized":"2023-07-14T11:17:14.080336+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:11:52.455103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.080393+0000","last_change":"2023-07-14T11:17:13.088331+0000","last_active":"2023-07-14T11:17:14.080393+0000","last_peered":"2023-07-14T11:17:14.080393+0000","last_clean":"2023-07-14T11:17:14.080393+0000","last_became_active":"2023-07-14T11:17:13.088011+0000","last_became_peered":"2023-07-14T11:17:13.088011+0000","last_unstale":"2023-07-14T11:17:14.080393+0000","last_undegraded":"2023-07-14T11:17:14.080393+0000","last_fullsized":"2023-07-14T11:17:14.080393+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:02:26.797841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.087257+0000","last_change":"2023-07-14T11:17:13.088879+0000","last_active":"2023-07-14T11:17:14.087257+0000","last_peered":"2023-07-14T11:17:14.087257+0000","last_clean":"2023-07-14T11:17:14.087257+0000","last_became_active":"2023-07-14T11:17:13.088622+0000","last_became_peered":"2023-07-14T11:17:13.088622+0000","last_unstale":"2023-07-14T11:17:14.087257+0000","last_undegraded":"2023-07-14T11:17:14.087257+0000","last_fullsized":"2023-07-14T11:17:14.087257+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:29:09.874246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.089564+0000","last_change":"2023-07-14T11:17:13.100412+0000","last_active":"2023-07-14T11:17:14.089564+0000","last_peered":"2023-07-14T11:17:14.089564+0000","last_clean":"2023-07-14T11:17:14.089564+0000","last_became_active":"2023-07-14T11:17:13.100102+0000","last_became_peered":"2023-07-14T11:17:13.100102+0000","last_unstale":"2023-07-14T11:17:14.089564+0000","last_undegraded":"2023-07-14T11:17:14.089564+0000","last_fullsized":"2023-07-14T11:17:14.089564+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:23:49.127396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.081549+0000","last_change":"2023-07-14T11:17:13.100421+0000","last_active":"2023-07-14T11:17:14.081549+0000","last_peered":"2023-07-14T11:17:14.081549+0000","last_clean":"2023-07-14T11:17:14.081549+0000","last_became_active":"2023-07-14T11:17:13.100096+0000","last_became_peered":"2023-07-14T11:17:13.100096+0000","last_unstale":"2023-07-14T11:17:14.081549+0000","last_undegraded":"2023-07-14T11:17:14.081549+0000","last_fullsized":"2023-07-14T11:17:14.081549+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:25:01.766469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.087064+0000","last_change":"2023-07-14T11:17:13.090762+0000","last_active":"2023-07-14T11:17:14.087064+0000","last_peered":"2023-07-14T11:17:14.087064+0000","last_clean":"2023-07-14T11:17:14.087064+0000","last_became_active":"2023-07-14T11:17:13.090481+0000","last_became_peered":"2023-07-14T11:17:13.090481+0000","last_unstale":"2023-07-14T11:17:14.087064+0000","last_undegraded":"2023-07-14T11:17:14.087064+0000","last_fullsized":"2023-07-14T11:17:14.087064+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:39:37.631814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.080390+0000","last_change":"2023-07-14T11:17:13.091627+0000","last_active":"2023-07-14T11:17:14.080390+0000","last_peered":"2023-07-14T11:17:14.080390+0000","last_clean":"2023-07-14T11:17:14.080390+0000","last_became_active":"2023-07-14T11:17:13.091372+0000","last_became_peered":"2023-07-14T11:17:13.091372+0000","last_unstale":"2023-07-14T11:17:14.080390+0000","last_undegraded":"2023-07-14T11:17:14.080390+0000","last_fullsized":"2023-07-14T11:17:14.080390+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:40:54.518530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.087130+0000","last_change":"2023-07-14T11:17:13.097003+0000","last_active":"2023-07-14T11:17:14.087130+0000","last_peered":"2023-07-14T11:17:14.087130+0000","last_clean":"2023-07-14T11:17:14.087130+0000","last_became_active":"2023-07-14T11:17:13.096738+0000","last_became_peered":"2023-07-14T11:17:13.096738+0000","last_unstale":"2023-07-14T11:17:14.087130+0000","last_undegraded":"2023-07-14T11:17:14.087130+0000","last_fullsized":"2023-07-14T11:17:14.087130+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:31:43.397294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.088184+0000","last_change":"2023-07-14T11:17:13.097955+0000","last_active":"2023-07-14T11:17:14.088184+0000","last_peered":"2023-07-14T11:17:14.088184+0000","last_clean":"2023-07-14T11:17:14.088184+0000","last_became_active":"2023-07-14T11:17:13.097645+0000","last_became_peered":"2023-07-14T11:17:13.097645+0000","last_unstale":"2023-07-14T11:17:14.088184+0000","last_undegraded":"2023-07-14T11:17:14.088184+0000","last_fullsized":"2023-07-14T11:17:14.088184+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:27:25.806664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.087350+0000","last_change":"2023-07-14T11:17:13.091004+0000","last_active":"2023-07-14T11:17:14.087350+0000","last_peered":"2023-07-14T11:17:14.087350+0000","last_clean":"2023-07-14T11:17:14.087350+0000","last_became_active":"2023-07-14T11:17:13.090701+0000","last_became_peered":"2023-07-14T11:17:13.090701+0000","last_unstale":"2023-07-14T11:17:14.087350+0000","last_undegraded":"2023-07-14T11:17:14.087350+0000","last_fullsized":"2023-07-14T11:17:14.087350+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:10:54.258407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.089501+0000","last_change":"2023-07-14T11:17:13.093268+0000","last_active":"2023-07-14T11:17:14.089501+0000","last_peered":"2023-07-14T11:17:14.089501+0000","last_clean":"2023-07-14T11:17:14.089501+0000","last_became_active":"2023-07-14T11:17:13.092704+0000","last_became_peered":"2023-07-14T11:17:13.092704+0000","last_unstale":"2023-07-14T11:17:14.089501+0000","last_undegraded":"2023-07-14T11:17:14.089501+0000","last_fullsized":"2023-07-14T11:17:14.089501+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:50:20.405701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.087990+0000","last_change":"2023-07-14T11:17:13.091726+0000","last_active":"2023-07-14T11:17:14.087990+0000","last_peered":"2023-07-14T11:17:14.087990+0000","last_clean":"2023-07-14T11:17:14.087990+0000","last_became_active":"2023-07-14T11:17:13.091416+0000","last_became_peered":"2023-07-14T11:17:13.091416+0000","last_unstale":"2023-07-14T11:17:14.087990+0000","last_undegraded":"2023-07-14T11:17:14.087990+0000","last_fullsized":"2023-07-14T11:17:14.087990+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:33:41.404929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.087720+0000","last_change":"2023-07-14T11:17:13.096417+0000","last_active":"2023-07-14T11:17:14.087720+0000","last_peered":"2023-07-14T11:17:14.087720+0000","last_clean":"2023-07-14T11:17:14.087720+0000","last_became_active":"2023-07-14T11:17:13.096147+0000","last_became_peered":"2023-07-14T11:17:13.096147+0000","last_unstale":"2023-07-14T11:17:14.087720+0000","last_undegraded":"2023-07-14T11:17:14.087720+0000","last_fullsized":"2023-07-14T11:17:14.087720+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:11:52.455103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.088062+0000","last_change":"2023-07-14T11:17:13.089419+0000","last_active":"2023-07-14T11:17:14.088062+0000","last_peered":"2023-07-14T11:17:14.088062+0000","last_clean":"2023-07-14T11:17:14.088062+0000","last_became_active":"2023-07-14T11:17:13.089096+0000","last_became_peered":"2023-07-14T11:17:13.089096+0000","last_unstale":"2023-07-14T11:17:14.088062+0000","last_undegraded":"2023-07-14T11:17:14.088062+0000","last_fullsized":"2023-07-14T11:17:14.088062+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:56:03.158035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.087969+0000","last_change":"2023-07-14T11:17:13.089765+0000","last_active":"2023-07-14T11:17:14.087969+0000","last_peered":"2023-07-14T11:17:14.087969+0000","last_clean":"2023-07-14T11:17:14.087969+0000","last_became_active":"2023-07-14T11:17:13.089351+0000","last_became_peered":"2023-07-14T11:17:13.089351+0000","last_unstale":"2023-07-14T11:17:14.087969+0000","last_undegraded":"2023-07-14T11:17:14.087969+0000","last_fullsized":"2023-07-14T11:17:14.087969+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:47:45.082462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.080286+0000","last_change":"2023-07-14T11:17:13.088749+0000","last_active":"2023-07-14T11:17:14.080286+0000","last_peered":"2023-07-14T11:17:14.080286+0000","last_clean":"2023-07-14T11:17:14.080286+0000","last_became_active":"2023-07-14T11:17:13.088488+0000","last_became_peered":"2023-07-14T11:17:13.088488+0000","last_unstale":"2023-07-14T11:17:14.080286+0000","last_undegraded":"2023-07-14T11:17:14.080286+0000","last_fullsized":"2023-07-14T11:17:14.080286+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:49:18.671194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.080619+0000","last_change":"2023-07-14T11:17:13.099252+0000","last_active":"2023-07-14T11:17:14.080619+0000","last_peered":"2023-07-14T11:17:14.080619+0000","last_clean":"2023-07-14T11:17:14.080619+0000","last_became_active":"2023-07-14T11:17:13.098985+0000","last_became_peered":"2023-07-14T11:17:13.098985+0000","last_unstale":"2023-07-14T11:17:14.080619+0000","last_undegraded":"2023-07-14T11:17:14.080619+0000","last_fullsized":"2023-07-14T11:17:14.080619+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:36:36.276917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.089672+0000","last_change":"2023-07-14T11:17:13.101001+0000","last_active":"2023-07-14T11:17:14.089672+0000","last_peered":"2023-07-14T11:17:14.089672+0000","last_clean":"2023-07-14T11:17:14.089672+0000","last_became_active":"2023-07-14T11:17:13.100493+0000","last_became_peered":"2023-07-14T11:17:13.100493+0000","last_unstale":"2023-07-14T11:17:14.089672+0000","last_undegraded":"2023-07-14T11:17:14.089672+0000","last_fullsized":"2023-07-14T11:17:14.089672+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:54:08.391634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.082015+0000","last_change":"2023-07-14T11:17:13.093907+0000","last_active":"2023-07-14T11:17:14.082015+0000","last_peered":"2023-07-14T11:17:14.082015+0000","last_clean":"2023-07-14T11:17:14.082015+0000","last_became_active":"2023-07-14T11:17:13.093563+0000","last_became_peered":"2023-07-14T11:17:13.093563+0000","last_unstale":"2023-07-14T11:17:14.082015+0000","last_undegraded":"2023-07-14T11:17:14.082015+0000","last_fullsized":"2023-07-14T11:17:14.082015+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:54:08.391634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.086445+0000","last_change":"2023-07-14T11:17:13.092967+0000","last_active":"2023-07-14T11:17:14.086445+0000","last_peered":"2023-07-14T11:17:14.086445+0000","last_clean":"2023-07-14T11:17:14.086445+0000","last_became_active":"2023-07-14T11:17:13.092602+0000","last_became_peered":"2023-07-14T11:17:13.092602+0000","last_unstale":"2023-07-14T11:17:14.086445+0000","last_undegraded":"2023-07-14T11:17:14.086445+0000","last_fullsized":"2023-07-14T11:17:14.086445+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:49:28.461054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.087572+0000","last_change":"2023-07-14T11:17:13.081348+0000","last_active":"2023-07-14T11:17:14.087572+0000","last_peered":"2023-07-14T11:17:14.087572+0000","last_clean":"2023-07-14T11:17:14.087572+0000","last_became_active":"2023-07-14T11:17:13.081090+0000","last_became_peered":"2023-07-14T11:17:13.081090+0000","last_unstale":"2023-07-14T11:17:14.087572+0000","last_undegraded":"2023-07-14T11:17:14.087572+0000","last_fullsized":"2023-07-14T11:17:14.087572+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:59:43.358928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.086184+0000","last_change":"2023-07-14T11:17:13.091755+0000","last_active":"2023-07-14T11:17:14.086184+0000","last_peered":"2023-07-14T11:17:14.086184+0000","last_clean":"2023-07-14T11:17:14.086184+0000","last_became_active":"2023-07-14T11:17:13.091467+0000","last_became_peered":"2023-07-14T11:17:13.091467+0000","last_unstale":"2023-07-14T11:17:14.086184+0000","last_undegraded":"2023-07-14T11:17:14.086184+0000","last_fullsized":"2023-07-14T11:17:14.086184+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:46:53.476421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.086022+0000","last_change":"2023-07-14T11:17:13.091811+0000","last_active":"2023-07-14T11:17:14.086022+0000","last_peered":"2023-07-14T11:17:14.086022+0000","last_clean":"2023-07-14T11:17:14.086022+0000","last_became_active":"2023-07-14T11:17:13.091526+0000","last_became_peered":"2023-07-14T11:17:13.091526+0000","last_unstale":"2023-07-14T11:17:14.086022+0000","last_undegraded":"2023-07-14T11:17:14.086022+0000","last_fullsized":"2023-07-14T11:17:14.086022+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:03:05.693970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.088024+0000","last_change":"2023-07-14T11:17:13.090063+0000","last_active":"2023-07-14T11:17:14.088024+0000","last_peered":"2023-07-14T11:17:14.088024+0000","last_clean":"2023-07-14T11:17:14.088024+0000","last_became_active":"2023-07-14T11:17:13.089654+0000","last_became_peered":"2023-07-14T11:17:13.089654+0000","last_unstale":"2023-07-14T11:17:14.088024+0000","last_undegraded":"2023-07-14T11:17:14.088024+0000","last_fullsized":"2023-07-14T11:17:14.088024+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:04:01.641095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.088349+0000","last_change":"2023-07-14T11:17:13.085044+0000","last_active":"2023-07-14T11:17:14.088349+0000","last_peered":"2023-07-14T11:17:14.088349+0000","last_clean":"2023-07-14T11:17:14.088349+0000","last_became_active":"2023-07-14T11:17:13.084737+0000","last_became_peered":"2023-07-14T11:17:13.084737+0000","last_unstale":"2023-07-14T11:17:14.088349+0000","last_undegraded":"2023-07-14T11:17:14.088349+0000","last_fullsized":"2023-07-14T11:17:14.088349+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:40:12.342267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.088940+0000","last_change":"2023-07-14T11:17:13.084489+0000","last_active":"2023-07-14T11:17:14.088940+0000","last_peered":"2023-07-14T11:17:14.088940+0000","last_clean":"2023-07-14T11:17:14.088940+0000","last_became_active":"2023-07-14T11:17:13.084190+0000","last_became_peered":"2023-07-14T11:17:13.084190+0000","last_unstale":"2023-07-14T11:17:14.088940+0000","last_undegraded":"2023-07-14T11:17:14.088940+0000","last_fullsized":"2023-07-14T11:17:14.088940+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:12:45.484169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.089769+0000","last_change":"2023-07-14T11:17:13.093063+0000","last_active":"2023-07-14T11:17:14.089769+0000","last_peered":"2023-07-14T11:17:14.089769+0000","last_clean":"2023-07-14T11:17:14.089769+0000","last_became_active":"2023-07-14T11:17:13.092376+0000","last_became_peered":"2023-07-14T11:17:13.092376+0000","last_unstale":"2023-07-14T11:17:14.089769+0000","last_undegraded":"2023-07-14T11:17:14.089769+0000","last_fullsized":"2023-07-14T11:17:14.089769+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:37:02.423402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.080391+0000","last_change":"2023-07-14T11:17:13.094033+0000","last_active":"2023-07-14T11:17:14.080391+0000","last_peered":"2023-07-14T11:17:14.080391+0000","last_clean":"2023-07-14T11:17:14.080391+0000","last_became_active":"2023-07-14T11:17:13.093719+0000","last_became_peered":"2023-07-14T11:17:13.093719+0000","last_unstale":"2023-07-14T11:17:14.080391+0000","last_undegraded":"2023-07-14T11:17:14.080391+0000","last_fullsized":"2023-07-14T11:17:14.080391+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:33:41.404929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.088001+0000","last_change":"2023-07-14T11:17:13.096973+0000","last_active":"2023-07-14T11:17:14.088001+0000","last_peered":"2023-07-14T11:17:14.088001+0000","last_clean":"2023-07-14T11:17:14.088001+0000","last_became_active":"2023-07-14T11:17:13.096676+0000","last_became_peered":"2023-07-14T11:17:13.096676+0000","last_unstale":"2023-07-14T11:17:14.088001+0000","last_undegraded":"2023-07-14T11:17:14.088001+0000","last_fullsized":"2023-07-14T11:17:14.088001+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:08:44.120399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.088420+0000","last_change":"2023-07-14T11:17:13.091877+0000","last_active":"2023-07-14T11:17:14.088420+0000","last_peered":"2023-07-14T11:17:14.088420+0000","last_clean":"2023-07-14T11:17:14.088420+0000","last_became_active":"2023-07-14T11:17:13.091498+0000","last_became_peered":"2023-07-14T11:17:13.091498+0000","last_unstale":"2023-07-14T11:17:14.088420+0000","last_undegraded":"2023-07-14T11:17:14.088420+0000","last_fullsized":"2023-07-14T11:17:14.088420+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:54:43.413011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.089394+0000","last_change":"2023-07-14T11:17:13.092554+0000","last_active":"2023-07-14T11:17:14.089394+0000","last_peered":"2023-07-14T11:17:14.089394+0000","last_clean":"2023-07-14T11:17:14.089394+0000","last_became_active":"2023-07-14T11:17:13.092118+0000","last_became_peered":"2023-07-14T11:17:13.092118+0000","last_unstale":"2023-07-14T11:17:14.089394+0000","last_undegraded":"2023-07-14T11:17:14.089394+0000","last_fullsized":"2023-07-14T11:17:14.089394+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:19:56.532964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.086470+0000","last_change":"2023-07-14T11:17:13.085049+0000","last_active":"2023-07-14T11:17:14.086470+0000","last_peered":"2023-07-14T11:17:14.086470+0000","last_clean":"2023-07-14T11:17:14.086470+0000","last_became_active":"2023-07-14T11:17:13.084590+0000","last_became_peered":"2023-07-14T11:17:13.084590+0000","last_unstale":"2023-07-14T11:17:14.086470+0000","last_undegraded":"2023-07-14T11:17:14.086470+0000","last_fullsized":"2023-07-14T11:17:14.086470+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:26:13.238741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.081910+0000","last_change":"2023-07-14T11:17:13.092064+0000","last_active":"2023-07-14T11:17:14.081910+0000","last_peered":"2023-07-14T11:17:14.081910+0000","last_clean":"2023-07-14T11:17:14.081910+0000","last_became_active":"2023-07-14T11:17:13.091596+0000","last_became_peered":"2023-07-14T11:17:13.091596+0000","last_unstale":"2023-07-14T11:17:14.081910+0000","last_undegraded":"2023-07-14T11:17:14.081910+0000","last_fullsized":"2023-07-14T11:17:14.081910+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:50:20.405701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"62'4","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.080471+0000","last_change":"2023-07-14T11:17:12.082698+0000","last_active":"2023-07-14T11:17:14.080471+0000","last_peered":"2023-07-14T11:17:14.080471+0000","last_clean":"2023-07-14T11:17:14.080471+0000","last_became_active":"2023-07-14T11:17:12.082271+0000","last_became_peered":"2023-07-14T11:17:12.082271+0000","last_unstale":"2023-07-14T11:17:14.080471+0000","last_undegraded":"2023-07-14T11:17:14.080471+0000","last_fullsized":"2023-07-14T11:17:14.080471+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_clean_scrub_stamp":"2023-07-14T11:17:11.047915+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:40:11.336915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.089824+0000","last_change":"2023-07-14T11:17:13.101769+0000","last_active":"2023-07-14T11:17:14.089824+0000","last_peered":"2023-07-14T11:17:14.089824+0000","last_clean":"2023-07-14T11:17:14.089824+0000","last_became_active":"2023-07-14T11:17:13.101177+0000","last_became_peered":"2023-07-14T11:17:13.101177+0000","last_unstale":"2023-07-14T11:17:14.089824+0000","last_undegraded":"2023-07-14T11:17:14.089824+0000","last_fullsized":"2023-07-14T11:17:14.089824+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:51:49.502930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"62'1","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.087159+0000","last_change":"2023-07-14T11:17:12.082944+0000","last_active":"2023-07-14T11:17:14.087159+0000","last_peered":"2023-07-14T11:17:14.087159+0000","last_clean":"2023-07-14T11:17:14.087159+0000","last_became_active":"2023-07-14T11:17:12.082661+0000","last_became_peered":"2023-07-14T11:17:12.082661+0000","last_unstale":"2023-07-14T11:17:14.087159+0000","last_undegraded":"2023-07-14T11:17:14.087159+0000","last_fullsized":"2023-07-14T11:17:14.087159+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_clean_scrub_stamp":"2023-07-14T11:17:11.047915+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:53:46.354390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.087121+0000","last_change":"2023-07-14T11:17:13.084887+0000","last_active":"2023-07-14T11:17:14.087121+0000","last_peered":"2023-07-14T11:17:14.087121+0000","last_clean":"2023-07-14T11:17:14.087121+0000","last_became_active":"2023-07-14T11:17:13.084516+0000","last_became_peered":"2023-07-14T11:17:13.084516+0000","last_unstale":"2023-07-14T11:17:14.087121+0000","last_undegraded":"2023-07-14T11:17:14.087121+0000","last_fullsized":"2023-07-14T11:17:14.087121+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:40:24.384130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"62'2","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.086914+0000","last_change":"2023-07-14T11:17:12.078449+0000","last_active":"2023-07-14T11:17:14.086914+0000","last_peered":"2023-07-14T11:17:14.086914+0000","last_clean":"2023-07-14T11:17:14.086914+0000","last_became_active":"2023-07-14T11:17:12.078128+0000","last_became_peered":"2023-07-14T11:17:12.078128+0000","last_unstale":"2023-07-14T11:17:14.086914+0000","last_undegraded":"2023-07-14T11:17:14.086914+0000","last_fullsized":"2023-07-14T11:17:14.086914+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_clean_scrub_stamp":"2023-07-14T11:17:11.047915+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:04:54.809817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.087673+0000","last_change":"2023-07-14T11:17:13.088894+0000","last_active":"2023-07-14T11:17:14.087673+0000","last_peered":"2023-07-14T11:17:14.087673+0000","last_clean":"2023-07-14T11:17:14.087673+0000","last_became_active":"2023-07-14T11:17:13.088553+0000","last_became_peered":"2023-07-14T11:17:13.088553+0000","last_unstale":"2023-07-14T11:17:14.087673+0000","last_undegraded":"2023-07-14T11:17:14.087673+0000","last_fullsized":"2023-07-14T11:17:14.087673+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:52:19.076130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"62'2","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.086832+0000","last_change":"2023-07-14T11:17:12.078146+0000","last_active":"2023-07-14T11:17:14.086832+0000","last_peered":"2023-07-14T11:17:14.086832+0000","last_clean":"2023-07-14T11:17:14.086832+0000","last_became_active":"2023-07-14T11:17:12.077838+0000","last_became_peered":"2023-07-14T11:17:12.077838+0000","last_unstale":"2023-07-14T11:17:14.086832+0000","last_undegraded":"2023-07-14T11:17:14.086832+0000","last_fullsized":"2023-07-14T11:17:14.086832+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_clean_scrub_stamp":"2023-07-14T11:17:11.047915+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:49:27.455702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.080739+0000","last_change":"2023-07-14T11:17:13.087253+0000","last_active":"2023-07-14T11:17:14.080739+0000","last_peered":"2023-07-14T11:17:14.080739+0000","last_clean":"2023-07-14T11:17:14.080739+0000","last_became_active":"2023-07-14T11:17:13.086980+0000","last_became_peered":"2023-07-14T11:17:13.086980+0000","last_unstale":"2023-07-14T11:17:14.080739+0000","last_undegraded":"2023-07-14T11:17:14.080739+0000","last_fullsized":"2023-07-14T11:17:14.080739+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:43:37.984778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"62'1","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.086402+0000","last_change":"2023-07-14T11:17:12.075185+0000","last_active":"2023-07-14T11:17:14.086402+0000","last_peered":"2023-07-14T11:17:14.086402+0000","last_clean":"2023-07-14T11:17:14.086402+0000","last_became_active":"2023-07-14T11:17:12.074908+0000","last_became_peered":"2023-07-14T11:17:12.074908+0000","last_unstale":"2023-07-14T11:17:14.086402+0000","last_undegraded":"2023-07-14T11:17:14.086402+0000","last_fullsized":"2023-07-14T11:17:14.086402+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_clean_scrub_stamp":"2023-07-14T11:17:11.047915+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:56:50.536324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.079777+0000","last_change":"2023-07-14T11:17:13.094679+0000","last_active":"2023-07-14T11:17:14.079777+0000","last_peered":"2023-07-14T11:17:14.079777+0000","last_clean":"2023-07-14T11:17:14.079777+0000","last_became_active":"2023-07-14T11:17:13.094347+0000","last_became_peered":"2023-07-14T11:17:13.094347+0000","last_unstale":"2023-07-14T11:17:14.079777+0000","last_undegraded":"2023-07-14T11:17:14.079777+0000","last_fullsized":"2023-07-14T11:17:14.079777+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:18:04.169046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"62'1","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.086382+0000","last_change":"2023-07-14T11:17:12.074984+0000","last_active":"2023-07-14T11:17:14.086382+0000","last_peered":"2023-07-14T11:17:14.086382+0000","last_clean":"2023-07-14T11:17:14.086382+0000","last_became_active":"2023-07-14T11:17:12.074698+0000","last_became_peered":"2023-07-14T11:17:12.074698+0000","last_unstale":"2023-07-14T11:17:14.086382+0000","last_undegraded":"2023-07-14T11:17:14.086382+0000","last_fullsized":"2023-07-14T11:17:14.086382+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_clean_scrub_stamp":"2023-07-14T11:17:11.047915+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:05:55.359051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.081392+0000","last_change":"2023-07-14T11:17:13.091647+0000","last_active":"2023-07-14T11:17:14.081392+0000","last_peered":"2023-07-14T11:17:14.081392+0000","last_clean":"2023-07-14T11:17:14.081392+0000","last_became_active":"2023-07-14T11:17:13.091348+0000","last_became_peered":"2023-07-14T11:17:13.091348+0000","last_unstale":"2023-07-14T11:17:14.081392+0000","last_undegraded":"2023-07-14T11:17:14.081392+0000","last_fullsized":"2023-07-14T11:17:14.081392+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:29:51.723855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.086140+0000","last_change":"2023-07-14T11:17:12.076643+0000","last_active":"2023-07-14T11:17:14.086140+0000","last_peered":"2023-07-14T11:17:14.086140+0000","last_clean":"2023-07-14T11:17:14.086140+0000","last_became_active":"2023-07-14T11:17:12.076298+0000","last_became_peered":"2023-07-14T11:17:12.076298+0000","last_unstale":"2023-07-14T11:17:14.086140+0000","last_undegraded":"2023-07-14T11:17:14.086140+0000","last_fullsized":"2023-07-14T11:17:14.086140+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_clean_scrub_stamp":"2023-07-14T11:17:11.047915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:46:49.241362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.086280+0000","last_change":"2023-07-14T11:17:13.094429+0000","last_active":"2023-07-14T11:17:14.086280+0000","last_peered":"2023-07-14T11:17:14.086280+0000","last_clean":"2023-07-14T11:17:14.086280+0000","last_became_active":"2023-07-14T11:17:13.094139+0000","last_became_peered":"2023-07-14T11:17:13.094139+0000","last_unstale":"2023-07-14T11:17:14.086280+0000","last_undegraded":"2023-07-14T11:17:14.086280+0000","last_fullsized":"2023-07-14T11:17:14.086280+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:26:13.238741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.081300+0000","last_change":"2023-07-14T11:17:12.084042+0000","last_active":"2023-07-14T11:17:14.081300+0000","last_peered":"2023-07-14T11:17:14.081300+0000","last_clean":"2023-07-14T11:17:14.081300+0000","last_became_active":"2023-07-14T11:17:12.083756+0000","last_became_peered":"2023-07-14T11:17:12.083756+0000","last_unstale":"2023-07-14T11:17:14.081300+0000","last_undegraded":"2023-07-14T11:17:14.081300+0000","last_fullsized":"2023-07-14T11:17:14.081300+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_clean_scrub_stamp":"2023-07-14T11:17:11.047915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:21:04.501017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.080092+0000","last_change":"2023-07-14T11:17:13.084302+0000","last_active":"2023-07-14T11:17:14.080092+0000","last_peered":"2023-07-14T11:17:14.080092+0000","last_clean":"2023-07-14T11:17:14.080092+0000","last_became_active":"2023-07-14T11:17:13.083955+0000","last_became_peered":"2023-07-14T11:17:13.083955+0000","last_unstale":"2023-07-14T11:17:14.080092+0000","last_undegraded":"2023-07-14T11:17:14.080092+0000","last_fullsized":"2023-07-14T11:17:14.080092+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:52:12.133537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.088017+0000","last_change":"2023-07-14T11:17:12.083993+0000","last_active":"2023-07-14T11:17:14.088017+0000","last_peered":"2023-07-14T11:17:14.088017+0000","last_clean":"2023-07-14T11:17:14.088017+0000","last_became_active":"2023-07-14T11:17:12.082748+0000","last_became_peered":"2023-07-14T11:17:12.082748+0000","last_unstale":"2023-07-14T11:17:14.088017+0000","last_undegraded":"2023-07-14T11:17:14.088017+0000","last_fullsized":"2023-07-14T11:17:14.088017+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_clean_scrub_stamp":"2023-07-14T11:17:11.047915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:49:44.094764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.086424+0000","last_change":"2023-07-14T11:17:13.075907+0000","last_active":"2023-07-14T11:17:14.086424+0000","last_peered":"2023-07-14T11:17:14.086424+0000","last_clean":"2023-07-14T11:17:14.086424+0000","last_became_active":"2023-07-14T11:17:13.075592+0000","last_became_peered":"2023-07-14T11:17:13.075592+0000","last_unstale":"2023-07-14T11:17:14.086424+0000","last_undegraded":"2023-07-14T11:17:14.086424+0000","last_fullsized":"2023-07-14T11:17:14.086424+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:35:54.640751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.090014+0000","last_change":"2023-07-14T11:17:12.073864+0000","last_active":"2023-07-14T11:17:14.090014+0000","last_peered":"2023-07-14T11:17:14.090014+0000","last_clean":"2023-07-14T11:17:14.090014+0000","last_became_active":"2023-07-14T11:17:12.073535+0000","last_became_peered":"2023-07-14T11:17:12.073535+0000","last_unstale":"2023-07-14T11:17:14.090014+0000","last_undegraded":"2023-07-14T11:17:14.090014+0000","last_fullsized":"2023-07-14T11:17:14.090014+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_clean_scrub_stamp":"2023-07-14T11:17:11.047915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:52:36.312706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.081932+0000","last_change":"2023-07-14T11:17:13.095873+0000","last_active":"2023-07-14T11:17:14.081932+0000","last_peered":"2023-07-14T11:17:14.081932+0000","last_clean":"2023-07-14T11:17:14.081932+0000","last_became_active":"2023-07-14T11:17:13.095460+0000","last_became_peered":"2023-07-14T11:17:13.095460+0000","last_unstale":"2023-07-14T11:17:14.081932+0000","last_undegraded":"2023-07-14T11:17:14.081932+0000","last_fullsized":"2023-07-14T11:17:14.081932+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:23:49.127396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"62'3","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.087534+0000","last_change":"2023-07-14T11:17:12.084564+0000","last_active":"2023-07-14T11:17:14.087534+0000","last_peered":"2023-07-14T11:17:14.087534+0000","last_clean":"2023-07-14T11:17:14.087534+0000","last_became_active":"2023-07-14T11:17:12.084288+0000","last_became_peered":"2023-07-14T11:17:12.084288+0000","last_unstale":"2023-07-14T11:17:14.087534+0000","last_undegraded":"2023-07-14T11:17:14.087534+0000","last_fullsized":"2023-07-14T11:17:14.087534+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_clean_scrub_stamp":"2023-07-14T11:17:11.047915+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:25:28.964162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.090006+0000","last_change":"2023-07-14T11:17:13.095112+0000","last_active":"2023-07-14T11:17:14.090006+0000","last_peered":"2023-07-14T11:17:14.090006+0000","last_clean":"2023-07-14T11:17:14.090006+0000","last_became_active":"2023-07-14T11:17:13.094773+0000","last_became_peered":"2023-07-14T11:17:13.094773+0000","last_unstale":"2023-07-14T11:17:14.090006+0000","last_undegraded":"2023-07-14T11:17:14.090006+0000","last_fullsized":"2023-07-14T11:17:14.090006+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:32:41.713202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"62'6","reported_seq":19,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.080233+0000","last_change":"2023-07-14T11:17:12.076649+0000","last_active":"2023-07-14T11:17:14.080233+0000","last_peered":"2023-07-14T11:17:14.080233+0000","last_clean":"2023-07-14T11:17:14.080233+0000","last_became_active":"2023-07-14T11:17:12.076274+0000","last_became_peered":"2023-07-14T11:17:12.076274+0000","last_unstale":"2023-07-14T11:17:14.080233+0000","last_undegraded":"2023-07-14T11:17:14.080233+0000","last_fullsized":"2023-07-14T11:17:14.080233+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_clean_scrub_stamp":"2023-07-14T11:17:11.047915+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:59:42.353576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.089274+0000","last_change":"2023-07-14T11:17:13.096135+0000","last_active":"2023-07-14T11:17:14.089274+0000","last_peered":"2023-07-14T11:17:14.089274+0000","last_clean":"2023-07-14T11:17:14.089274+0000","last_became_active":"2023-07-14T11:17:13.095870+0000","last_became_peered":"2023-07-14T11:17:13.095870+0000","last_unstale":"2023-07-14T11:17:14.089274+0000","last_undegraded":"2023-07-14T11:17:14.089274+0000","last_fullsized":"2023-07-14T11:17:14.089274+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:55:23.958080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"62'2","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.087985+0000","last_change":"2023-07-14T11:17:12.084200+0000","last_active":"2023-07-14T11:17:14.087985+0000","last_peered":"2023-07-14T11:17:14.087985+0000","last_clean":"2023-07-14T11:17:14.087985+0000","last_became_active":"2023-07-14T11:17:12.083901+0000","last_became_peered":"2023-07-14T11:17:12.083901+0000","last_unstale":"2023-07-14T11:17:14.087985+0000","last_undegraded":"2023-07-14T11:17:14.087985+0000","last_fullsized":"2023-07-14T11:17:14.087985+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_clean_scrub_stamp":"2023-07-14T11:17:11.047915+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:55:07.814201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.088564+0000","last_change":"2023-07-14T11:17:13.091544+0000","last_active":"2023-07-14T11:17:14.088564+0000","last_peered":"2023-07-14T11:17:14.088564+0000","last_clean":"2023-07-14T11:17:14.088564+0000","last_became_active":"2023-07-14T11:17:13.091251+0000","last_became_peered":"2023-07-14T11:17:13.091251+0000","last_unstale":"2023-07-14T11:17:14.088564+0000","last_undegraded":"2023-07-14T11:17:14.088564+0000","last_fullsized":"2023-07-14T11:17:14.088564+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:32:50.226354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.088570+0000","last_change":"2023-07-14T11:17:12.072876+0000","last_active":"2023-07-14T11:17:14.088570+0000","last_peered":"2023-07-14T11:17:14.088570+0000","last_clean":"2023-07-14T11:17:14.088570+0000","last_became_active":"2023-07-14T11:17:12.072420+0000","last_became_peered":"2023-07-14T11:17:12.072420+0000","last_unstale":"2023-07-14T11:17:14.088570+0000","last_undegraded":"2023-07-14T11:17:14.088570+0000","last_fullsized":"2023-07-14T11:17:14.088570+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_clean_scrub_stamp":"2023-07-14T11:17:11.047915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:40:36.048341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.081501+0000","last_change":"2023-07-14T11:17:13.089494+0000","last_active":"2023-07-14T11:17:14.081501+0000","last_peered":"2023-07-14T11:17:14.081501+0000","last_clean":"2023-07-14T11:17:14.081501+0000","last_became_active":"2023-07-14T11:17:13.089209+0000","last_became_peered":"2023-07-14T11:17:13.089209+0000","last_unstale":"2023-07-14T11:17:14.081501+0000","last_undegraded":"2023-07-14T11:17:14.081501+0000","last_fullsized":"2023-07-14T11:17:14.081501+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:33:16.856527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.087446+0000","last_change":"2023-07-14T11:17:12.085713+0000","last_active":"2023-07-14T11:17:14.087446+0000","last_peered":"2023-07-14T11:17:14.087446+0000","last_clean":"2023-07-14T11:17:14.087446+0000","last_became_active":"2023-07-14T11:17:12.085189+0000","last_became_peered":"2023-07-14T11:17:12.085189+0000","last_unstale":"2023-07-14T11:17:14.087446+0000","last_undegraded":"2023-07-14T11:17:14.087446+0000","last_fullsized":"2023-07-14T11:17:14.087446+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_clean_scrub_stamp":"2023-07-14T11:17:11.047915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:38:24.908532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.080189+0000","last_change":"2023-07-14T11:17:13.085582+0000","last_active":"2023-07-14T11:17:14.080189+0000","last_peered":"2023-07-14T11:17:14.080189+0000","last_clean":"2023-07-14T11:17:14.080189+0000","last_became_active":"2023-07-14T11:17:13.085304+0000","last_became_peered":"2023-07-14T11:17:13.085304+0000","last_unstale":"2023-07-14T11:17:14.080189+0000","last_undegraded":"2023-07-14T11:17:14.080189+0000","last_fullsized":"2023-07-14T11:17:14.080189+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:31:43.397294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"62'8","reported_seq":21,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.089212+0000","last_change":"2023-07-14T11:17:12.083653+0000","last_active":"2023-07-14T11:17:14.089212+0000","last_peered":"2023-07-14T11:17:14.089212+0000","last_clean":"2023-07-14T11:17:14.089212+0000","last_became_active":"2023-07-14T11:17:12.083370+0000","last_became_peered":"2023-07-14T11:17:12.083370+0000","last_unstale":"2023-07-14T11:17:14.089212+0000","last_undegraded":"2023-07-14T11:17:14.089212+0000","last_fullsized":"2023-07-14T11:17:14.089212+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_clean_scrub_stamp":"2023-07-14T11:17:11.047915+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:08:26.358802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.086658+0000","last_change":"2023-07-14T11:17:13.100389+0000","last_active":"2023-07-14T11:17:14.086658+0000","last_peered":"2023-07-14T11:17:14.086658+0000","last_clean":"2023-07-14T11:17:14.086658+0000","last_became_active":"2023-07-14T11:17:13.100152+0000","last_became_peered":"2023-07-14T11:17:13.100152+0000","last_unstale":"2023-07-14T11:17:14.086658+0000","last_undegraded":"2023-07-14T11:17:14.086658+0000","last_fullsized":"2023-07-14T11:17:14.086658+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:05:56.364403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"62'2","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.088700+0000","last_change":"2023-07-14T11:17:12.083031+0000","last_active":"2023-07-14T11:17:14.088700+0000","last_peered":"2023-07-14T11:17:14.088700+0000","last_clean":"2023-07-14T11:17:14.088700+0000","last_became_active":"2023-07-14T11:17:12.082659+0000","last_became_peered":"2023-07-14T11:17:12.082659+0000","last_unstale":"2023-07-14T11:17:14.088700+0000","last_undegraded":"2023-07-14T11:17:14.088700+0000","last_fullsized":"2023-07-14T11:17:14.088700+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_clean_scrub_stamp":"2023-07-14T11:17:11.047915+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:02:30.644175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.080944+0000","last_change":"2023-07-14T11:17:13.087229+0000","last_active":"2023-07-14T11:17:14.080944+0000","last_peered":"2023-07-14T11:17:14.080944+0000","last_clean":"2023-07-14T11:17:14.080944+0000","last_became_active":"2023-07-14T11:17:13.086965+0000","last_became_peered":"2023-07-14T11:17:13.086965+0000","last_unstale":"2023-07-14T11:17:14.080944+0000","last_undegraded":"2023-07-14T11:17:14.080944+0000","last_fullsized":"2023-07-14T11:17:14.080944+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:50:01.051200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.089045+0000","last_change":"2023-07-14T11:17:12.076105+0000","last_active":"2023-07-14T11:17:14.089045+0000","last_peered":"2023-07-14T11:17:14.089045+0000","last_clean":"2023-07-14T11:17:14.089045+0000","last_became_active":"2023-07-14T11:17:12.075727+0000","last_became_peered":"2023-07-14T11:17:12.075727+0000","last_unstale":"2023-07-14T11:17:14.089045+0000","last_undegraded":"2023-07-14T11:17:14.089045+0000","last_fullsized":"2023-07-14T11:17:14.089045+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_clean_scrub_stamp":"2023-07-14T11:17:11.047915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:54:54.138894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.088937+0000","last_change":"2023-07-14T11:17:13.092122+0000","last_active":"2023-07-14T11:17:14.088937+0000","last_peered":"2023-07-14T11:17:14.088937+0000","last_clean":"2023-07-14T11:17:14.088937+0000","last_became_active":"2023-07-14T11:17:13.091855+0000","last_became_peered":"2023-07-14T11:17:13.091855+0000","last_unstale":"2023-07-14T11:17:14.088937+0000","last_undegraded":"2023-07-14T11:17:14.088937+0000","last_fullsized":"2023-07-14T11:17:14.088937+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:25:21.414988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.086909+0000","last_change":"2023-07-14T11:17:12.078379+0000","last_active":"2023-07-14T11:17:14.086909+0000","last_peered":"2023-07-14T11:17:14.086909+0000","last_clean":"2023-07-14T11:17:14.086909+0000","last_became_active":"2023-07-14T11:17:12.077692+0000","last_became_peered":"2023-07-14T11:17:12.077692+0000","last_unstale":"2023-07-14T11:17:14.086909+0000","last_undegraded":"2023-07-14T11:17:14.086909+0000","last_fullsized":"2023-07-14T11:17:14.086909+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_clean_scrub_stamp":"2023-07-14T11:17:11.047915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:30:08.788357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.081877+0000","last_change":"2023-07-14T11:17:13.093260+0000","last_active":"2023-07-14T11:17:14.081877+0000","last_peered":"2023-07-14T11:17:14.081877+0000","last_clean":"2023-07-14T11:17:14.081877+0000","last_became_active":"2023-07-14T11:17:13.092810+0000","last_became_peered":"2023-07-14T11:17:13.092810+0000","last_unstale":"2023-07-14T11:17:14.081877+0000","last_undegraded":"2023-07-14T11:17:14.081877+0000","last_fullsized":"2023-07-14T11:17:14.081877+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:19:52.002386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.080743+0000","last_change":"2023-07-14T11:17:12.076515+0000","last_active":"2023-07-14T11:17:14.080743+0000","last_peered":"2023-07-14T11:17:14.080743+0000","last_clean":"2023-07-14T11:17:14.080743+0000","last_became_active":"2023-07-14T11:17:12.076021+0000","last_became_peered":"2023-07-14T11:17:12.076021+0000","last_unstale":"2023-07-14T11:17:14.080743+0000","last_undegraded":"2023-07-14T11:17:14.080743+0000","last_fullsized":"2023-07-14T11:17:14.080743+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_clean_scrub_stamp":"2023-07-14T11:17:11.047915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:32:49.221001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.081097+0000","last_change":"2023-07-14T11:17:13.085932+0000","last_active":"2023-07-14T11:17:14.081097+0000","last_peered":"2023-07-14T11:17:14.081097+0000","last_clean":"2023-07-14T11:17:14.081097+0000","last_became_active":"2023-07-14T11:17:13.085654+0000","last_became_peered":"2023-07-14T11:17:13.085654+0000","last_unstale":"2023-07-14T11:17:14.081097+0000","last_undegraded":"2023-07-14T11:17:14.081097+0000","last_fullsized":"2023-07-14T11:17:14.081097+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:29:57.595392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.088132+0000","last_change":"2023-07-14T11:17:12.085454+0000","last_active":"2023-07-14T11:17:14.088132+0000","last_peered":"2023-07-14T11:17:14.088132+0000","last_clean":"2023-07-14T11:17:14.088132+0000","last_became_active":"2023-07-14T11:17:12.084739+0000","last_became_peered":"2023-07-14T11:17:12.084739+0000","last_unstale":"2023-07-14T11:17:14.088132+0000","last_undegraded":"2023-07-14T11:17:14.088132+0000","last_fullsized":"2023-07-14T11:17:14.088132+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_clean_scrub_stamp":"2023-07-14T11:17:11.047915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:49:46.528855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.089474+0000","last_change":"2023-07-14T11:17:13.094108+0000","last_active":"2023-07-14T11:17:14.089474+0000","last_peered":"2023-07-14T11:17:14.089474+0000","last_clean":"2023-07-14T11:17:14.089474+0000","last_became_active":"2023-07-14T11:17:13.093719+0000","last_became_peered":"2023-07-14T11:17:13.093719+0000","last_unstale":"2023-07-14T11:17:14.089474+0000","last_undegraded":"2023-07-14T11:17:14.089474+0000","last_fullsized":"2023-07-14T11:17:14.089474+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:19:52.002386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.086303+0000","last_change":"2023-07-14T11:17:12.075233+0000","last_active":"2023-07-14T11:17:14.086303+0000","last_peered":"2023-07-14T11:17:14.086303+0000","last_clean":"2023-07-14T11:17:14.086303+0000","last_became_active":"2023-07-14T11:17:12.074964+0000","last_became_peered":"2023-07-14T11:17:12.074964+0000","last_unstale":"2023-07-14T11:17:14.086303+0000","last_undegraded":"2023-07-14T11:17:14.086303+0000","last_fullsized":"2023-07-14T11:17:14.086303+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_clean_scrub_stamp":"2023-07-14T11:17:11.047915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:40:00.813395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.079902+0000","last_change":"2023-07-14T11:17:13.095120+0000","last_active":"2023-07-14T11:17:14.079902+0000","last_peered":"2023-07-14T11:17:14.079902+0000","last_clean":"2023-07-14T11:17:14.079902+0000","last_became_active":"2023-07-14T11:17:13.094831+0000","last_became_peered":"2023-07-14T11:17:13.094831+0000","last_unstale":"2023-07-14T11:17:14.079902+0000","last_undegraded":"2023-07-14T11:17:14.079902+0000","last_fullsized":"2023-07-14T11:17:14.079902+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:23:15.131386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.086247+0000","last_change":"2023-07-14T11:17:12.077850+0000","last_active":"2023-07-14T11:17:14.086247+0000","last_peered":"2023-07-14T11:17:14.086247+0000","last_clean":"2023-07-14T11:17:14.086247+0000","last_became_active":"2023-07-14T11:17:12.075856+0000","last_became_peered":"2023-07-14T11:17:12.075856+0000","last_unstale":"2023-07-14T11:17:14.086247+0000","last_undegraded":"2023-07-14T11:17:14.086247+0000","last_fullsized":"2023-07-14T11:17:14.086247+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_clean_scrub_stamp":"2023-07-14T11:17:11.047915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:00:35.167233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.080559+0000","last_change":"2023-07-14T11:17:13.088630+0000","last_active":"2023-07-14T11:17:14.080559+0000","last_peered":"2023-07-14T11:17:14.080559+0000","last_clean":"2023-07-14T11:17:14.080559+0000","last_became_active":"2023-07-14T11:17:13.088368+0000","last_became_peered":"2023-07-14T11:17:13.088368+0000","last_unstale":"2023-07-14T11:17:14.080559+0000","last_undegraded":"2023-07-14T11:17:14.080559+0000","last_fullsized":"2023-07-14T11:17:14.080559+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:23:24.203581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.079780+0000","last_change":"2023-07-14T11:17:12.075405+0000","last_active":"2023-07-14T11:17:14.079780+0000","last_peered":"2023-07-14T11:17:14.079780+0000","last_clean":"2023-07-14T11:17:14.079780+0000","last_became_active":"2023-07-14T11:17:12.075145+0000","last_became_peered":"2023-07-14T11:17:12.075145+0000","last_unstale":"2023-07-14T11:17:14.079780+0000","last_undegraded":"2023-07-14T11:17:14.079780+0000","last_fullsized":"2023-07-14T11:17:14.079780+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_clean_scrub_stamp":"2023-07-14T11:17:11.047915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:04:45.785551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.087801+0000","last_change":"2023-07-14T11:17:13.096178+0000","last_active":"2023-07-14T11:17:14.087801+0000","last_peered":"2023-07-14T11:17:14.087801+0000","last_clean":"2023-07-14T11:17:14.087801+0000","last_became_active":"2023-07-14T11:17:13.095900+0000","last_became_peered":"2023-07-14T11:17:13.095900+0000","last_unstale":"2023-07-14T11:17:14.087801+0000","last_undegraded":"2023-07-14T11:17:14.087801+0000","last_fullsized":"2023-07-14T11:17:14.087801+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:24:42.746315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"62'1","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.088507+0000","last_change":"2023-07-14T11:17:12.076344+0000","last_active":"2023-07-14T11:17:14.088507+0000","last_peered":"2023-07-14T11:17:14.088507+0000","last_clean":"2023-07-14T11:17:14.088507+0000","last_became_active":"2023-07-14T11:17:12.076010+0000","last_became_peered":"2023-07-14T11:17:12.076010+0000","last_unstale":"2023-07-14T11:17:14.088507+0000","last_undegraded":"2023-07-14T11:17:14.088507+0000","last_fullsized":"2023-07-14T11:17:14.088507+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_clean_scrub_stamp":"2023-07-14T11:17:11.047915+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:36:35.271564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":100,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.079875+0000","last_change":"2023-07-14T11:13:08.923786+0000","last_active":"2023-07-14T11:17:14.079875+0000","last_peered":"2023-07-14T11:17:14.079875+0000","last_clean":"2023-07-14T11:17:14.079875+0000","last_became_active":"2023-07-14T11:13:08.923384+0000","last_became_peered":"2023-07-14T11:13:08.923384+0000","last_unstale":"2023-07-14T11:17:14.079875+0000","last_undegraded":"2023-07-14T11:17:14.079875+0000","last_fullsized":"2023-07-14T11:17:14.079875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:08:23.647023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.081765+0000","last_change":"2023-07-14T11:17:13.092241+0000","last_active":"2023-07-14T11:17:14.081765+0000","last_peered":"2023-07-14T11:17:14.081765+0000","last_clean":"2023-07-14T11:17:14.081765+0000","last_became_active":"2023-07-14T11:17:13.091899+0000","last_became_peered":"2023-07-14T11:17:13.091899+0000","last_unstale":"2023-07-14T11:17:14.081765+0000","last_undegraded":"2023-07-14T11:17:14.081765+0000","last_fullsized":"2023-07-14T11:17:14.081765+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:19:56.532964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.086680+0000","last_change":"2023-07-14T11:17:12.082886+0000","last_active":"2023-07-14T11:17:14.086680+0000","last_peered":"2023-07-14T11:17:14.086680+0000","last_clean":"2023-07-14T11:17:14.086680+0000","last_became_active":"2023-07-14T11:17:12.082591+0000","last_became_peered":"2023-07-14T11:17:12.082591+0000","last_unstale":"2023-07-14T11:17:14.086680+0000","last_undegraded":"2023-07-14T11:17:14.086680+0000","last_fullsized":"2023-07-14T11:17:14.086680+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_clean_scrub_stamp":"2023-07-14T11:17:11.047915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:35:53.635399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":92,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.088683+0000","last_change":"2023-07-14T11:13:08.758749+0000","last_active":"2023-07-14T11:17:14.088683+0000","last_peered":"2023-07-14T11:17:14.088683+0000","last_clean":"2023-07-14T11:17:14.088683+0000","last_became_active":"2023-07-14T11:13:08.757956+0000","last_became_peered":"2023-07-14T11:13:08.757956+0000","last_unstale":"2023-07-14T11:17:14.088683+0000","last_undegraded":"2023-07-14T11:17:14.088683+0000","last_fullsized":"2023-07-14T11:17:14.088683+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:19:56.862493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.088810+0000","last_change":"2023-07-14T11:17:13.085144+0000","last_active":"2023-07-14T11:17:14.088810+0000","last_peered":"2023-07-14T11:17:14.088810+0000","last_clean":"2023-07-14T11:17:14.088810+0000","last_became_active":"2023-07-14T11:17:13.084719+0000","last_became_peered":"2023-07-14T11:17:13.084719+0000","last_unstale":"2023-07-14T11:17:14.088810+0000","last_undegraded":"2023-07-14T11:17:14.088810+0000","last_fullsized":"2023-07-14T11:17:14.088810+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:15:15.655818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.088642+0000","last_change":"2023-07-14T11:17:12.072930+0000","last_active":"2023-07-14T11:17:14.088642+0000","last_peered":"2023-07-14T11:17:14.088642+0000","last_clean":"2023-07-14T11:17:14.088642+0000","last_became_active":"2023-07-14T11:17:12.072569+0000","last_became_peered":"2023-07-14T11:17:12.072569+0000","last_unstale":"2023-07-14T11:17:14.088642+0000","last_undegraded":"2023-07-14T11:17:14.088642+0000","last_fullsized":"2023-07-14T11:17:14.088642+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_clean_scrub_stamp":"2023-07-14T11:17:11.047915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:06:13.465011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":98,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.080555+0000","last_change":"2023-07-14T11:13:08.862331+0000","last_active":"2023-07-14T11:17:14.080555+0000","last_peered":"2023-07-14T11:17:14.080555+0000","last_clean":"2023-07-14T11:17:14.080555+0000","last_became_active":"2023-07-14T11:13:08.861817+0000","last_became_peered":"2023-07-14T11:13:08.861817+0000","last_unstale":"2023-07-14T11:17:14.080555+0000","last_undegraded":"2023-07-14T11:17:14.080555+0000","last_fullsized":"2023-07-14T11:17:14.080555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:56:28.158090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.081595+0000","last_change":"2023-07-14T11:17:13.085759+0000","last_active":"2023-07-14T11:17:14.081595+0000","last_peered":"2023-07-14T11:17:14.081595+0000","last_clean":"2023-07-14T11:17:14.081595+0000","last_became_active":"2023-07-14T11:17:13.085470+0000","last_became_peered":"2023-07-14T11:17:13.085470+0000","last_unstale":"2023-07-14T11:17:14.081595+0000","last_undegraded":"2023-07-14T11:17:14.081595+0000","last_fullsized":"2023-07-14T11:17:14.081595+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:08:27.364154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.086277+0000","last_change":"2023-07-14T11:17:12.073149+0000","last_active":"2023-07-14T11:17:14.086277+0000","last_peered":"2023-07-14T11:17:14.086277+0000","last_clean":"2023-07-14T11:17:14.086277+0000","last_became_active":"2023-07-14T11:17:12.072826+0000","last_became_peered":"2023-07-14T11:17:12.072826+0000","last_unstale":"2023-07-14T11:17:14.086277+0000","last_undegraded":"2023-07-14T11:17:14.086277+0000","last_fullsized":"2023-07-14T11:17:14.086277+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_clean_scrub_stamp":"2023-07-14T11:17:11.047915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:09:48.932021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":92,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.087805+0000","last_change":"2023-07-14T11:13:08.757882+0000","last_active":"2023-07-14T11:17:14.087805+0000","last_peered":"2023-07-14T11:17:14.087805+0000","last_clean":"2023-07-14T11:17:14.087805+0000","last_became_active":"2023-07-14T11:13:08.757541+0000","last_became_peered":"2023-07-14T11:13:08.757541+0000","last_unstale":"2023-07-14T11:17:14.087805+0000","last_undegraded":"2023-07-14T11:17:14.087805+0000","last_fullsized":"2023-07-14T11:17:14.087805+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:58:22.487301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":245,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.087191+0000","last_change":"2023-07-14T11:13:01.370649+0000","last_active":"2023-07-14T11:17:14.087191+0000","last_peered":"2023-07-14T11:17:14.087191+0000","last_clean":"2023-07-14T11:17:14.087191+0000","last_became_active":"2023-07-14T11:13:01.369478+0000","last_became_peered":"2023-07-14T11:13:01.369478+0000","last_unstale":"2023-07-14T11:17:14.087191+0000","last_undegraded":"2023-07-14T11:17:14.087191+0000","last_fullsized":"2023-07-14T11:17:14.087191+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:00.254800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:00.254800+0000","last_clean_scrub_stamp":"2023-07-14T11:13:00.254800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:39:50.510755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.086592+0000","last_change":"2023-07-14T11:17:13.084871+0000","last_active":"2023-07-14T11:17:14.086592+0000","last_peered":"2023-07-14T11:17:14.086592+0000","last_clean":"2023-07-14T11:17:14.086592+0000","last_became_active":"2023-07-14T11:17:13.084293+0000","last_became_peered":"2023-07-14T11:17:13.084293+0000","last_unstale":"2023-07-14T11:17:14.086592+0000","last_undegraded":"2023-07-14T11:17:14.086592+0000","last_fullsized":"2023-07-14T11:17:14.086592+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:40:01.818748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"62'2","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.086670+0000","last_change":"2023-07-14T11:17:12.077219+0000","last_active":"2023-07-14T11:17:14.086670+0000","last_peered":"2023-07-14T11:17:14.086670+0000","last_clean":"2023-07-14T11:17:14.086670+0000","last_became_active":"2023-07-14T11:17:12.076158+0000","last_became_peered":"2023-07-14T11:17:12.076158+0000","last_unstale":"2023-07-14T11:17:14.086670+0000","last_undegraded":"2023-07-14T11:17:14.086670+0000","last_fullsized":"2023-07-14T11:17:14.086670+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_clean_scrub_stamp":"2023-07-14T11:17:11.047915+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:56:50.536324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":89,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.087001+0000","last_change":"2023-07-14T11:13:08.760609+0000","last_active":"2023-07-14T11:17:14.087001+0000","last_peered":"2023-07-14T11:17:14.087001+0000","last_clean":"2023-07-14T11:17:14.087001+0000","last_became_active":"2023-07-14T11:13:08.760285+0000","last_became_peered":"2023-07-14T11:13:08.760285+0000","last_unstale":"2023-07-14T11:17:14.087001+0000","last_undegraded":"2023-07-14T11:17:14.087001+0000","last_fullsized":"2023-07-14T11:17:14.087001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:05:57.680963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.082092+0000","last_change":"2023-07-14T11:17:13.101446+0000","last_active":"2023-07-14T11:17:14.082092+0000","last_peered":"2023-07-14T11:17:14.082092+0000","last_clean":"2023-07-14T11:17:14.082092+0000","last_became_active":"2023-07-14T11:17:13.101176+0000","last_became_peered":"2023-07-14T11:17:13.101176+0000","last_unstale":"2023-07-14T11:17:14.082092+0000","last_undegraded":"2023-07-14T11:17:14.082092+0000","last_fullsized":"2023-07-14T11:17:14.082092+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:51:49.502930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"62'2","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.087585+0000","last_change":"2023-07-14T11:17:12.083507+0000","last_active":"2023-07-14T11:17:14.087585+0000","last_peered":"2023-07-14T11:17:14.087585+0000","last_clean":"2023-07-14T11:17:14.087585+0000","last_became_active":"2023-07-14T11:17:12.083028+0000","last_became_peered":"2023-07-14T11:17:12.083028+0000","last_unstale":"2023-07-14T11:17:14.087585+0000","last_undegraded":"2023-07-14T11:17:14.087585+0000","last_fullsized":"2023-07-14T11:17:14.087585+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_clean_scrub_stamp":"2023-07-14T11:17:11.047915+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:47:14.124778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":88,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.087615+0000","last_change":"2023-07-14T11:13:08.923899+0000","last_active":"2023-07-14T11:17:14.087615+0000","last_peered":"2023-07-14T11:17:14.087615+0000","last_clean":"2023-07-14T11:17:14.087615+0000","last_became_active":"2023-07-14T11:13:08.923513+0000","last_became_peered":"2023-07-14T11:13:08.923513+0000","last_unstale":"2023-07-14T11:17:14.087615+0000","last_undegraded":"2023-07-14T11:17:14.087615+0000","last_fullsized":"2023-07-14T11:17:14.087615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:12:36.676518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.090051+0000","last_change":"2023-07-14T11:17:13.100810+0000","last_active":"2023-07-14T11:17:14.090051+0000","last_peered":"2023-07-14T11:17:14.090051+0000","last_clean":"2023-07-14T11:17:14.090051+0000","last_became_active":"2023-07-14T11:17:13.100196+0000","last_became_peered":"2023-07-14T11:17:13.100196+0000","last_unstale":"2023-07-14T11:17:14.090051+0000","last_undegraded":"2023-07-14T11:17:14.090051+0000","last_fullsized":"2023-07-14T11:17:14.090051+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:52:47.971492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"62'1","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.087392+0000","last_change":"2023-07-14T11:17:12.082774+0000","last_active":"2023-07-14T11:17:14.087392+0000","last_peered":"2023-07-14T11:17:14.087392+0000","last_clean":"2023-07-14T11:17:14.087392+0000","last_became_active":"2023-07-14T11:17:12.082322+0000","last_became_peered":"2023-07-14T11:17:12.082322+0000","last_unstale":"2023-07-14T11:17:14.087392+0000","last_undegraded":"2023-07-14T11:17:14.087392+0000","last_fullsized":"2023-07-14T11:17:14.087392+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_clean_scrub_stamp":"2023-07-14T11:17:11.047915+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:56:58.707583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":100,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.080557+0000","last_change":"2023-07-14T11:13:08.761726+0000","last_active":"2023-07-14T11:17:14.080557+0000","last_peered":"2023-07-14T11:17:14.080557+0000","last_clean":"2023-07-14T11:17:14.080557+0000","last_became_active":"2023-07-14T11:13:08.761365+0000","last_became_peered":"2023-07-14T11:13:08.761365+0000","last_unstale":"2023-07-14T11:17:14.080557+0000","last_undegraded":"2023-07-14T11:17:14.080557+0000","last_fullsized":"2023-07-14T11:17:14.080557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:50:39.102471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.081874+0000","last_change":"2023-07-14T11:17:13.093089+0000","last_active":"2023-07-14T11:17:14.081874+0000","last_peered":"2023-07-14T11:17:14.081874+0000","last_clean":"2023-07-14T11:17:14.081874+0000","last_became_active":"2023-07-14T11:17:13.092516+0000","last_became_peered":"2023-07-14T11:17:13.092516+0000","last_unstale":"2023-07-14T11:17:14.081874+0000","last_undegraded":"2023-07-14T11:17:14.081874+0000","last_fullsized":"2023-07-14T11:17:14.081874+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:55:23.958080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.086543+0000","last_change":"2023-07-14T11:17:12.076603+0000","last_active":"2023-07-14T11:17:14.086543+0000","last_peered":"2023-07-14T11:17:14.086543+0000","last_clean":"2023-07-14T11:17:14.086543+0000","last_became_active":"2023-07-14T11:17:12.076316+0000","last_became_peered":"2023-07-14T11:17:12.076316+0000","last_unstale":"2023-07-14T11:17:14.086543+0000","last_undegraded":"2023-07-14T11:17:14.086543+0000","last_fullsized":"2023-07-14T11:17:14.086543+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_clean_scrub_stamp":"2023-07-14T11:17:11.047915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:30:08.788357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":92,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.082018+0000","last_change":"2023-07-14T11:13:08.762084+0000","last_active":"2023-07-14T11:17:14.082018+0000","last_peered":"2023-07-14T11:17:14.082018+0000","last_clean":"2023-07-14T11:17:14.082018+0000","last_became_active":"2023-07-14T11:13:08.761763+0000","last_became_peered":"2023-07-14T11:13:08.761763+0000","last_unstale":"2023-07-14T11:17:14.082018+0000","last_undegraded":"2023-07-14T11:17:14.082018+0000","last_fullsized":"2023-07-14T11:17:14.082018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:32:58.112862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574903,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28288,"kb_used_data":1336,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343552,"statfs":{"total":96636764160,"available":96607797248,"internally_reserved":0,"allocated":1368064,"data_stored":926493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.80400000000000005,"15min":0.94199999999999995},"min":{"1min":0.441,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.93300000000000005,"5min":8.4339999999999993,"15min":8.4339999999999993},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.84599999999999997,"15min":0.97999999999999998},"min":{"1min":0.55100000000000005,"5min":0.377,"15min":0.377},"max":{"1min":0.88800000000000001,"5min":8.4559999999999995,"15min":8.4559999999999995},"last":0.63900000000000001}]},{"osd":1,"last update":"Fri Jul 14 11:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.79700000000000004,"15min":0.91300000000000003},"min":{"1min":0.54000000000000004,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.86699999999999999,"5min":6.3520000000000003,"15min":6.3520000000000003},"last":0.505},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.88100000000000001,"15min":1.083},"min":{"1min":0.49299999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.877,"5min":6.8550000000000004,"15min":6.8550000000000004},"last":0.47899999999999998}]},{"osd":2,"last update":"Fri Jul 14 11:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.91200000000000003,"15min":1.137},"min":{"1min":0.51000000000000001,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.91400000000000003,"5min":7.0289999999999999,"15min":7.0289999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.70599999999999996,"15min":0.69399999999999995},"min":{"1min":0.48599999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.94499999999999995,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.59799999999999998}]},{"osd":3,"last update":"Fri Jul 14 11:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.95699999999999996,"15min":1.198},"min":{"1min":0.51800000000000002,"5min":0.505,"15min":0.505},"max":{"1min":0.95699999999999996,"5min":10.337,"15min":10.337},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.753,"15min":0.76700000000000002},"min":{"1min":0.60799999999999998,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.97899999999999998,"5min":1.921,"15min":1.921},"last":0.55600000000000005}]},{"osd":4,"last update":"Fri Jul 14 11:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.62,"15min":0.58999999999999997},"min":{"1min":0.44500000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.89900000000000002,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.72499999999999998,"15min":0.70199999999999996},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.88200000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.72399999999999998}]},{"osd":5,"last update":"Fri Jul 14 11:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.68899999999999995,"15min":0.67500000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.89400000000000002,"5min":1.04,"15min":1.04},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.746,"5min":0.754,"15min":0.73699999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.92100000000000004,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.69899999999999995}]},{"osd":6,"last update":"Fri Jul 14 11:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.70899999999999996,"15min":0.67700000000000005},"min":{"1min":0.499,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.94199999999999995,"5min":1.002,"15min":1.002},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.71699999999999997,"15min":0.68899999999999995},"min":{"1min":0.50900000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.90200000000000002,"5min":1.018,"15min":1.018},"last":0.53500000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574904,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27696,"kb_used_data":744,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":761856,"data_stored":335383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.71499999999999997,"15min":0.70799999999999996},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.93799999999999994,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.73499999999999999,"15min":0.72099999999999997},"min":{"1min":0.45300000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.93100000000000005,"5min":1.167,"15min":1.167},"last":0.99299999999999999}]},{"osd":1,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.71099999999999997,"15min":0.68899999999999995},"min":{"1min":0.53100000000000003,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.97699999999999998,"5min":1.006,"15min":1.006},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.73599999999999999,"15min":0.71599999999999997},"min":{"1min":0.50900000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.0109999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.75900000000000001}]},{"osd":2,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.69399999999999995,"15min":0.67700000000000005},"min":{"1min":0.51300000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.95199999999999996,"5min":1.45,"15min":1.45},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76900000000000002,"15min":0.78100000000000003},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.94799999999999995,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.496}]},{"osd":3,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.752,"15min":0.75},"min":{"1min":0.56499999999999995,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.002,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.747,"15min":0.74299999999999999},"min":{"1min":0.60099999999999998,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.91600000000000004,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.52400000000000002}]},{"osd":4,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.68799999999999994,"15min":0.70599999999999996},"min":{"1min":0.44400000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.94699999999999995,"5min":1.712,"15min":1.712},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.71399999999999997,"15min":0.72399999999999998},"min":{"1min":0.47299999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.871,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.0680000000000001}]},{"osd":5,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.71299999999999997,"15min":0.71799999999999997},"min":{"1min":0.51500000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.89800000000000002,"5min":2.8820000000000001,"15min":2.8820000000000001},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76900000000000002,"15min":0.78700000000000003},"min":{"1min":0.496,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.98399999999999999,"5min":1.129,"15min":1.129},"last":1.022}]},{"osd":7,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.78000000000000003,"15min":0.80100000000000005},"min":{"1min":0.47399999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0569999999999999,"5min":1.333,"15min":1.333},"last":1.1220000000000001},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.76800000000000002,"15min":0.79000000000000004},"min":{"1min":0.54100000000000004,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.92700000000000005,"5min":1.55,"15min":1.55},"last":0.95199999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574903,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27720,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":786432,"data_stored":337677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:17:04 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.42299999999999999,"15min":0.438},"min":{"1min":0.28899999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.54300000000000004,"5min":0.996,"15min":0.996},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.47699999999999998,"15min":0.48299999999999998},"min":{"1min":0.34499999999999997,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.63100000000000001,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.34799999999999998}]},{"osd":2,"last update":"Fri Jul 14 11:17:04 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.52800000000000002,"15min":0.56499999999999995},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.70799999999999996,"5min":2.476,"15min":2.476},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.55800000000000005,"15min":0.61799999999999999},"min":{"1min":0.39800000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.68300000000000005,"5min":2.6299999999999999,"15min":2.6299999999999999},"last":0.42099999999999999}]},{"osd":3,"last update":"Fri Jul 14 11:17:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.53200000000000003,"15min":0.52300000000000002},"min":{"1min":0.40200000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.66300000000000003,"5min":0.748,"15min":0.748},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48199999999999998,"15min":0.49399999999999999},"min":{"1min":0.41699999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.60299999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.38300000000000001}]},{"osd":4,"last update":"Fri Jul 14 11:17:04 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.75,"15min":0.753},"min":{"1min":0.61199999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0309999999999999,"5min":1.363,"15min":1.363},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.76800000000000002,"15min":0.77400000000000002},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.1160000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.71699999999999997}]},{"osd":5,"last update":"Fri Jul 14 11:17:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.76700000000000002,"15min":0.77100000000000002},"min":{"1min":0.60199999999999998,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.2250000000000001,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.79300000000000004,"15min":0.81799999999999995},"min":{"1min":0.58199999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":0.98299999999999998,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.75700000000000001}]},{"osd":6,"last update":"Fri Jul 14 11:17:04 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.76800000000000002,"15min":0.79600000000000004},"min":{"1min":0.56200000000000006,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.97599999999999998,"5min":1.298,"15min":1.298},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77700000000000002,"15min":0.78700000000000003},"min":{"1min":0.54800000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1899999999999999,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.749}]},{"osd":7,"last update":"Fri Jul 14 11:17:04 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.78600000000000003,"15min":0.81599999999999995},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.097,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.77400000000000002,"15min":0.78700000000000003},"min":{"1min":0.624,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.0800000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.70599999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574901,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28272,"kb_used_data":1320,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343568,"statfs":{"total":96636764160,"available":96607813632,"internally_reserved":0,"allocated":1351680,"data_stored":925717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.44,"15min":0.435},"min":{"1min":0.33900000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.59999999999999998,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.44400000000000001,"15min":0.441},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.64100000000000001,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.36899999999999999}]},{"osd":2,"last update":"Fri Jul 14 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.375,"5min":0.307,"15min":0.307},"max":{"1min":0.58599999999999997,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.497,"15min":0.502},"min":{"1min":0.36299999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.66600000000000004,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.53100000000000003}]},{"osd":3,"last update":"Fri Jul 14 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.44900000000000001,"15min":0.42699999999999999},"min":{"1min":0.36099999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.64300000000000002,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.52700000000000002,"15min":0.52500000000000002},"min":{"1min":0.42299999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.64400000000000002,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.51600000000000001}]},{"osd":4,"last update":"Fri Jul 14 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.76300000000000001,"15min":0.76600000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.044,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.72999999999999998,"15min":0.70699999999999996},"min":{"1min":0.53200000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.86599999999999999}]},{"osd":5,"last update":"Fri Jul 14 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.74399999999999999,"15min":0.72899999999999998},"min":{"1min":0.57799999999999996,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77400000000000002,"15min":0.77900000000000003},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.94599999999999995}]},{"osd":6,"last update":"Fri Jul 14 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.73499999999999999,"15min":0.72499999999999998},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.01,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":1.01},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.77600000000000002,"15min":0.78000000000000003},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.022,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.81200000000000006}]},{"osd":7,"last update":"Fri Jul 14 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.80800000000000005,"15min":0.81999999999999995},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.0900000000000001,"5min":1.149,"15min":1.149},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.80300000000000005,"15min":0.78300000000000003},"min":{"1min":0.58999999999999997,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.0600000000000001,"5min":1.081,"15min":1.081},"last":0.96299999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574901,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":740,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":757760,"data_stored":335349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.42799999999999999,"15min":0.44700000000000001},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.63900000000000001,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.436,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.30399999999999999}]},{"osd":1,"last update":"Fri Jul 14 11:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.47999999999999998,"15min":0.48599999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.68400000000000005,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.499,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.39500000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.61399999999999999,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.42299999999999999}]},{"osd":3,"last update":"Fri Jul 14 11:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.501,"15min":0.497},"min":{"1min":0.35699999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57799999999999996,"15min":0.58699999999999997},"min":{"1min":0.42099999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.72599999999999998,"5min":1.034,"15min":1.034},"last":0.50900000000000001}]},{"osd":4,"last update":"Fri Jul 14 11:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.76200000000000001,"15min":0.77200000000000002},"min":{"1min":0.55800000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.92700000000000005,"5min":1.212,"15min":1.212},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.77700000000000002,"15min":0.78800000000000003},"min":{"1min":0.64100000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.1000000000000001,"5min":1.198,"15min":1.198},"last":0.65200000000000002}]},{"osd":5,"last update":"Fri Jul 14 11:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.76900000000000002,"15min":0.79000000000000004},"min":{"1min":0.59499999999999997,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.98899999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.754},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.80000000000000004,"15min":0.82399999999999995},"min":{"1min":0.55000000000000004,"5min":0.495,"15min":0.495},"max":{"1min":1.0609999999999999,"5min":1.351,"15min":1.351},"last":0.624}]},{"osd":6,"last update":"Fri Jul 14 11:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.78100000000000003,"15min":0.79000000000000004},"min":{"1min":0.60899999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.1180000000000001,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.79900000000000004,"15min":0.82299999999999995},"min":{"1min":0.59499999999999997,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0129999999999999,"5min":1.282,"15min":1.282},"last":0.63600000000000001}]},{"osd":7,"last update":"Fri Jul 14 11:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.79300000000000004,"15min":0.80400000000000005},"min":{"1min":0.628,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.0389999999999999,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.78600000000000003,"15min":0.80700000000000005},"min":{"1min":0.63,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.95299999999999996,"5min":1.244,"15min":1.244},"last":0.67600000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574901,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":740,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":757760,"data_stored":335349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.42899999999999999,"15min":0.44800000000000001},"min":{"1min":0.34399999999999997,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.67800000000000005,"5min":0.754,"15min":0.754},"last":0.38},{"interface":"front","average":{"1min":0.502,"5min":0.45500000000000002,"15min":0.45100000000000001},"min":{"1min":0.317,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.47199999999999998}]},{"osd":1,"last update":"Fri Jul 14 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.45100000000000001,"15min":0.45300000000000001},"min":{"1min":0.34000000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.49299999999999999,"15min":0.498},"min":{"1min":0.44500000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.72699999999999998,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.42599999999999999}]},{"osd":2,"last update":"Fri Jul 14 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.55200000000000005,"15min":0.54600000000000004},"min":{"1min":0.42899999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.627,"5min":0.58799999999999997,"15min":0.59799999999999998},"min":{"1min":0.46500000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.79600000000000004,"5min":1.585,"15min":1.585},"last":0.49399999999999999}]},{"osd":4,"last update":"Fri Jul 14 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.75900000000000001,"15min":0.76300000000000001},"min":{"1min":0.53200000000000003,"5min":0.372,"15min":0.372},"max":{"1min":1.0029999999999999,"5min":1.216,"15min":1.216},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.77700000000000002,"15min":0.76000000000000001},"min":{"1min":0.61899999999999999,"5min":0.504,"15min":0.504},"max":{"1min":1.0609999999999999,"5min":1.147,"15min":1.147},"last":0.84999999999999998}]},{"osd":5,"last update":"Fri Jul 14 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.76700000000000002,"15min":0.76400000000000001},"min":{"1min":0.65400000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.024,"5min":1.413,"15min":1.413},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.81799999999999995,"15min":0.85199999999999998},"min":{"1min":0.621,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.097,"5min":1.657,"15min":1.657},"last":0.86299999999999999}]},{"osd":6,"last update":"Fri Jul 14 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.66300000000000003,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.133,"5min":1.726,"15min":1.726},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.78900000000000003,"15min":0.80100000000000005},"min":{"1min":0.61099999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.085,"5min":1.333,"15min":1.333},"last":0.75600000000000001}]},{"osd":7,"last update":"Fri Jul 14 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.81899999999999995,"15min":0.83799999999999997},"min":{"1min":0.623,"5min":0.437,"15min":0.437},"max":{"1min":1.1459999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.83299999999999996,"15min":0.84199999999999997},"min":{"1min":0.59599999999999997,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1579999999999999,"5min":1.268,"15min":1.268},"last":0.82299999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574901,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27704,"kb_used_data":752,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344136,"statfs":{"total":96636764160,"available":96608395264,"internally_reserved":0,"allocated":770048,"data_stored":336913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.64400000000000002,"15min":0.63400000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.85199999999999998,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.67500000000000004,"15min":0.69099999999999995},"min":{"1min":0.42699999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.83199999999999996,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.63600000000000001}]},{"osd":1,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.66100000000000003,"15min":0.66900000000000004},"min":{"1min":0.46100000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.82899999999999996,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.71599999999999997,"15min":0.71399999999999997},"min":{"1min":0.49299999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.93700000000000006,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.66000000000000003}]},{"osd":2,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.71799999999999997,"15min":0.71299999999999997},"min":{"1min":0.51000000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.85299999999999998,"5min":1.48,"15min":1.48},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.73899999999999999,"15min":0.74199999999999999},"min":{"1min":0.57499999999999996,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.84499999999999997,"5min":1.23,"15min":1.23},"last":0.57599999999999996}]},{"osd":3,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.69899999999999995,"15min":0.71499999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.81299999999999994,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.748,"15min":0.74199999999999999},"min":{"1min":0.55200000000000005,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.88100000000000001,"5min":1.145,"15min":1.145},"last":0.52800000000000002}]},{"osd":5,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.71799999999999997,"15min":0.76000000000000001},"min":{"1min":0.45300000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.90000000000000002,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.71699999999999997,"15min":0.76500000000000001},"min":{"1min":0.48999999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.81499999999999995,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.70299999999999996}]},{"osd":6,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71499999999999997,"15min":0.72299999999999998},"min":{"1min":0.45600000000000002,"5min":0.436,"15min":0.436},"max":{"1min":0.86399999999999999,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76600000000000001,"15min":0.77600000000000002},"min":{"1min":0.56999999999999995,"5min":0.442,"15min":0.442},"max":{"1min":0.96099999999999997,"5min":1.3,"15min":1.3},"last":0.49099999999999999}]},{"osd":7,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.746,"15min":0.76900000000000002},"min":{"1min":0.53500000000000003,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.86499999999999999,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.81000000000000005,"15min":0.84399999999999997},"min":{"1min":0.50900000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.92200000000000004,"5min":1.379,"15min":1.379},"last":0.73599999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574903,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27696,"kb_used_data":744,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":761856,"data_stored":335371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.63700000000000001,"15min":0.64200000000000002},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.97299999999999998,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.65000000000000002,"15min":0.64000000000000001},"min":{"1min":0.47599999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.88,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.69099999999999995}]},{"osd":1,"last update":"Fri Jul 14 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.66200000000000003,"15min":0.67700000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.78700000000000003,"5min":1.343,"15min":1.343},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.66100000000000003,"15min":0.65100000000000002},"min":{"1min":0.51300000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.81200000000000006}]},{"osd":2,"last update":"Fri Jul 14 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.72799999999999998,"15min":0.73799999999999999},"min":{"1min":0.59399999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.93500000000000005,"5min":1.034,"15min":1.034},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.73999999999999999,"15min":0.76600000000000001},"min":{"1min":0.51000000000000001,"5min":0.496,"15min":0.496},"max":{"1min":0.83199999999999996,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.83599999999999997}]},{"osd":3,"last update":"Fri Jul 14 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.73699999999999999,"15min":0.76500000000000001},"min":{"1min":0.53500000000000003,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.92800000000000005,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.73799999999999999,"15min":0.77800000000000002},"min":{"1min":0.63500000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.90900000000000003,"5min":1.806,"15min":1.806},"last":0.77900000000000003}]},{"osd":4,"last update":"Fri Jul 14 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.63700000000000001,"15min":0.65300000000000002},"min":{"1min":0.42599999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.88800000000000001,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.627},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.70499999999999996,"15min":0.75},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.996,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.79500000000000004}]},{"osd":6,"last update":"Fri Jul 14 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.71899999999999997,"15min":0.747},"min":{"1min":0.52200000000000002,"5min":0.435,"15min":0.435},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.76200000000000001,"15min":0.79900000000000004},"min":{"1min":0.432,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0629999999999999,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.86399999999999999}]},{"osd":7,"last update":"Fri Jul 14 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.78400000000000003,"15min":0.84199999999999997},"min":{"1min":0.45700000000000002,"5min":0.435,"15min":0.435},"max":{"1min":1.081,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.82599999999999996,"15min":0.86799999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.95899999999999996,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.89600000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T11:17:17.461 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T11:17:17.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.686+0000 7f7415fff700 1 Processor -- start 2023-07-14T11:17:17.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.686+0000 7f7415fff700 1 -- start start 2023-07-14T11:17:17.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.687+0000 7f7415fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f741015c710 0x7f74100cf510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:17.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.687+0000 7f7415fff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74100cd320 con 0x7f741006db30 2023-07-14T11:17:17.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.688+0000 7f7415fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74100ce750 con 0x7f7410069f30 2023-07-14T11:17:17.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.688+0000 7f7415fff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74100cea30 con 0x7f741015c710 2023-07-14T11:17:17.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.688+0000 7f740f7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f741015c710 0x7f74100cf510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:17.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.688+0000 7f740ffff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f741006db30 0x7f7410070950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:43202/0 (socket says 172.21.15.84:43202) 2023-07-14T11:17:17.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.688+0000 7f740ffff700 1 -- 172.21.15.84:0/2372091754 learned_addr learned my addr 172.21.15.84:0/2372091754 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:17:17.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.688+0000 7f740f7fe700 1 -- 172.21.15.84:0/2372091754 >> v1:172.21.15.179:6789/0 conn(0x7f7410069f30 legacy=0x7f741006d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:17.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.688+0000 7f740f7fe700 1 -- 172.21.15.84:0/2372091754 >> v1:172.21.15.84:6789/0 conn(0x7f741006db30 legacy=0x7f7410070950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:17.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.688+0000 7f740f7fe700 1 -- 172.21.15.84:0/2372091754 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74100ced10 con 0x7f741015c710 2023-07-14T11:17:17.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.688+0000 7f740f7fe700 1 --2- 172.21.15.84:0/2372091754 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f741015c710 0x7f74100cf510 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f7400009840 tx=0x7f7400009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eca188b50fa9e82e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:17.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.689+0000 7f740e7fc700 1 -- 172.21.15.84:0/2372091754 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7400011830 con 0x7f741015c710 2023-07-14T11:17:17.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.689+0000 7f740e7fc700 1 -- 172.21.15.84:0/2372091754 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7400011990 con 0x7f741015c710 2023-07-14T11:17:17.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.689+0000 7f740e7fc700 1 -- 172.21.15.84:0/2372091754 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7400011d20 con 0x7f741015c710 2023-07-14T11:17:17.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.689+0000 7f7415fff700 1 -- 172.21.15.84:0/2372091754 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f741015c710 msgr2=0x7f74100cf510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:17.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.689+0000 7f7415fff700 1 --2- 172.21.15.84:0/2372091754 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f741015c710 0x7f74100cf510 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f7400009840 tx=0x7f7400009b50 comp rx=0 tx=0).stop 2023-07-14T11:17:17.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.689+0000 7f7415fff700 1 -- 172.21.15.84:0/2372091754 shutdown_connections 2023-07-14T11:17:17.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.689+0000 7f7415fff700 1 --2- 172.21.15.84:0/2372091754 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f741015c710 0x7f74100cf510 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:17.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.689+0000 7f7415fff700 1 -- 172.21.15.84:0/2372091754 >> 172.21.15.84:0/2372091754 conn(0x7f74100b16c0 msgr2=0x7f74100b1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:17.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.689+0000 7f7415fff700 1 -- 172.21.15.84:0/2372091754 shutdown_connections 2023-07-14T11:17:17.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.689+0000 7f7415fff700 1 -- 172.21.15.84:0/2372091754 wait complete. 2023-07-14T11:17:17.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.691+0000 7f7415fff700 1 Processor -- start 2023-07-14T11:17:17.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.691+0000 7f7415fff700 1 -- start start 2023-07-14T11:17:17.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.692+0000 7f7415fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7410069f30 0x7f741015f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:17.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.692+0000 7f7415fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f741006db30 0x7f741014acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:17.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.692+0000 7f7415fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74100ada30 0x7f74100aded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:17.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.692+0000 7f7415fff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74100ae410 con 0x7f7410069f30 2023-07-14T11:17:17.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.692+0000 7f7415fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741015e670 con 0x7f74100ada30 2023-07-14T11:17:17.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.692+0000 7f7415fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f741015e950 con 0x7f741006db30 2023-07-14T11:17:17.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.692+0000 7f740f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7410069f30 0x7f741015f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:17.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.692+0000 7f740f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7410069f30 0x7f741015f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35312/0 (socket says 172.21.15.84:35312) 2023-07-14T11:17:17.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.692+0000 7f740f7fe700 1 -- 172.21.15.84:0/2013043119 learned_addr learned my addr 172.21.15.84:0/2013043119 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:17.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.693+0000 7f740effd700 1 --2- 172.21.15.84:0/2013043119 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f741006db30 0x7f741014acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:17.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.693+0000 7f740ffff700 1 --2- 172.21.15.84:0/2013043119 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74100ada30 0x7f74100aded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:17.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.693+0000 7f740f7fe700 1 -- 172.21.15.84:0/2013043119 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f741006db30 msgr2=0x7f741014acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:17.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.693+0000 7f740f7fe700 1 --2- 172.21.15.84:0/2013043119 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f741006db30 0x7f741014acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:17.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.693+0000 7f740f7fe700 1 -- 172.21.15.84:0/2013043119 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74100ada30 msgr2=0x7f74100aded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:17.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.693+0000 7f740f7fe700 1 --2- 172.21.15.84:0/2013043119 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74100ada30 0x7f74100aded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:17.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.693+0000 7f740f7fe700 1 -- 172.21.15.84:0/2013043119 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74000094a0 con 0x7f7410069f30 2023-07-14T11:17:17.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.693+0000 7f740ffff700 1 --2- 172.21.15.84:0/2013043119 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74100ada30 0x7f74100aded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:17:17.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.693+0000 7f740f7fe700 1 --2- 172.21.15.84:0/2013043119 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7410069f30 0x7f741015f710 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f7400000c00 tx=0x7f7400004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:17.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.693+0000 7f73f7fff700 1 -- 172.21.15.84:0/2013043119 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74000038a0 con 0x7f7410069f30 2023-07-14T11:17:17.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.693+0000 7f73f7fff700 1 -- 172.21.15.84:0/2013043119 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f740001e070 con 0x7f7410069f30 2023-07-14T11:17:17.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.693+0000 7f73f7fff700 1 -- 172.21.15.84:0/2013043119 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7400003c60 con 0x7f7410069f30 2023-07-14T11:17:17.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.693+0000 7f7415fff700 1 -- 172.21.15.84:0/2013043119 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f741006ac20 con 0x7f7410069f30 2023-07-14T11:17:17.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.694+0000 7f7415fff700 1 -- 172.21.15.84:0/2013043119 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f741015ef10 con 0x7f7410069f30 2023-07-14T11:17:17.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.694+0000 7f7415fff700 1 -- 172.21.15.84:0/2013043119 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74100b2240 con 0x7f7410069f30 2023-07-14T11:17:17.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.696+0000 7f73f7fff700 1 -- 172.21.15.84:0/2013043119 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 9) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f740002d450 con 0x7f7410069f30 2023-07-14T11:17:17.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.696+0000 7f73f7fff700 1 --2- 172.21.15.84:0/2013043119 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f73fc06ae90 0x7f73fc06d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:17.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.697+0000 7f73f7fff700 1 -- 172.21.15.84:0/2013043119 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f740008a810 con 0x7f7410069f30 2023-07-14T11:17:17.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.697+0000 7f740effd700 1 --2- 172.21.15.84:0/2013043119 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f73fc06ae90 0x7f73fc06d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:17.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.697+0000 7f740effd700 1 --2- 172.21.15.84:0/2013043119 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f73fc06ae90 0x7f73fc06d340 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f7404007fd0 tx=0x7f7404009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:17.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.701+0000 7f73f7fff700 1 -- 172.21.15.84:0/2013043119 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f74000556d0 con 0x7f7410069f30 2023-07-14T11:17:17.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.889+0000 7f7415fff700 1 -- 172.21.15.84:0/2013043119 --> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f741006aaa0 con 0x7f73fc06ae90 2023-07-14T11:17:17.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.898+0000 7f73f7fff700 1 -- 172.21.15.84:0/2013043119 <== mgr.4104 v2:172.21.15.84:6832/379617029 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311068 (secure 0 0 0) 0x7f7404001560 con 0x7f73fc06ae90 2023-07-14T11:17:17.903 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:17:17.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.902+0000 7f7415fff700 1 -- 172.21.15.84:0/2013043119 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f73fc06ae90 msgr2=0x7f73fc06d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:17.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.902+0000 7f7415fff700 1 --2- 172.21.15.84:0/2013043119 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f73fc06ae90 0x7f73fc06d340 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f7404007fd0 tx=0x7f7404009040 comp rx=0 tx=0).stop 2023-07-14T11:17:17.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.902+0000 7f7415fff700 1 -- 172.21.15.84:0/2013043119 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7410069f30 msgr2=0x7f741015f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:17.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.902+0000 7f7415fff700 1 --2- 172.21.15.84:0/2013043119 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7410069f30 0x7f741015f710 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f7400000c00 tx=0x7f7400004750 comp rx=0 tx=0).stop 2023-07-14T11:17:17.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.902+0000 7f7415fff700 1 -- 172.21.15.84:0/2013043119 shutdown_connections 2023-07-14T11:17:17.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.902+0000 7f7415fff700 1 --2- 172.21.15.84:0/2013043119 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74100ada30 0x7f74100aded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:17.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.902+0000 7f7415fff700 1 --2- 172.21.15.84:0/2013043119 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7410069f30 0x7f741015f710 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:17.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.902+0000 7f7415fff700 1 --2- 172.21.15.84:0/2013043119 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f73fc06ae90 0x7f73fc06d340 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:17.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.902+0000 7f7415fff700 1 --2- 172.21.15.84:0/2013043119 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f741006db30 0x7f741014acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:17.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.902+0000 7f7415fff700 1 -- 172.21.15.84:0/2013043119 >> 172.21.15.84:0/2013043119 conn(0x7f74100b16c0 msgr2=0x7f74100b08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:17.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.902+0000 7f7415fff700 1 -- 172.21.15.84:0/2013043119 shutdown_connections 2023-07-14T11:17:17.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:17.902+0000 7f7415fff700 1 -- 172.21.15.84:0/2013043119 wait complete. 2023-07-14T11:17:17.907 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-07-14T11:17:17.923 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":184,"stamp":"2023-07-14T11:17:16.124465+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":135,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222760,"kb_used_data":7144,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754751960,"statfs":{"total":773094113280,"available":772866007040,"internally_reserved":0,"allocated":7315456,"data_stored":3868252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.070354"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.080336+0000","last_change":"2023-07-14T11:17:13.075796+0000","last_active":"2023-07-14T11:17:14.080336+0000","last_peered":"2023-07-14T11:17:14.080336+0000","last_clean":"2023-07-14T11:17:14.080336+0000","last_became_active":"2023-07-14T11:17:13.075489+0000","last_became_peered":"2023-07-14T11:17:13.075489+0000","last_unstale":"2023-07-14T11:17:14.080336+0000","last_undegraded":"2023-07-14T11:17:14.080336+0000","last_fullsized":"2023-07-14T11:17:14.080336+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:11:52.455103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.080393+0000","last_change":"2023-07-14T11:17:13.088331+0000","last_active":"2023-07-14T11:17:14.080393+0000","last_peered":"2023-07-14T11:17:14.080393+0000","last_clean":"2023-07-14T11:17:14.080393+0000","last_became_active":"2023-07-14T11:17:13.088011+0000","last_became_peered":"2023-07-14T11:17:13.088011+0000","last_unstale":"2023-07-14T11:17:14.080393+0000","last_undegraded":"2023-07-14T11:17:14.080393+0000","last_fullsized":"2023-07-14T11:17:14.080393+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:02:26.797841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.087257+0000","last_change":"2023-07-14T11:17:13.088879+0000","last_active":"2023-07-14T11:17:14.087257+0000","last_peered":"2023-07-14T11:17:14.087257+0000","last_clean":"2023-07-14T11:17:14.087257+0000","last_became_active":"2023-07-14T11:17:13.088622+0000","last_became_peered":"2023-07-14T11:17:13.088622+0000","last_unstale":"2023-07-14T11:17:14.087257+0000","last_undegraded":"2023-07-14T11:17:14.087257+0000","last_fullsized":"2023-07-14T11:17:14.087257+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:29:09.874246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.089564+0000","last_change":"2023-07-14T11:17:13.100412+0000","last_active":"2023-07-14T11:17:14.089564+0000","last_peered":"2023-07-14T11:17:14.089564+0000","last_clean":"2023-07-14T11:17:14.089564+0000","last_became_active":"2023-07-14T11:17:13.100102+0000","last_became_peered":"2023-07-14T11:17:13.100102+0000","last_unstale":"2023-07-14T11:17:14.089564+0000","last_undegraded":"2023-07-14T11:17:14.089564+0000","last_fullsized":"2023-07-14T11:17:14.089564+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:23:49.127396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.081549+0000","last_change":"2023-07-14T11:17:13.100421+0000","last_active":"2023-07-14T11:17:14.081549+0000","last_peered":"2023-07-14T11:17:14.081549+0000","last_clean":"2023-07-14T11:17:14.081549+0000","last_became_active":"2023-07-14T11:17:13.100096+0000","last_became_peered":"2023-07-14T11:17:13.100096+0000","last_unstale":"2023-07-14T11:17:14.081549+0000","last_undegraded":"2023-07-14T11:17:14.081549+0000","last_fullsized":"2023-07-14T11:17:14.081549+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:25:01.766469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.087064+0000","last_change":"2023-07-14T11:17:13.090762+0000","last_active":"2023-07-14T11:17:14.087064+0000","last_peered":"2023-07-14T11:17:14.087064+0000","last_clean":"2023-07-14T11:17:14.087064+0000","last_became_active":"2023-07-14T11:17:13.090481+0000","last_became_peered":"2023-07-14T11:17:13.090481+0000","last_unstale":"2023-07-14T11:17:14.087064+0000","last_undegraded":"2023-07-14T11:17:14.087064+0000","last_fullsized":"2023-07-14T11:17:14.087064+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:39:37.631814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.080390+0000","last_change":"2023-07-14T11:17:13.091627+0000","last_active":"2023-07-14T11:17:14.080390+0000","last_peered":"2023-07-14T11:17:14.080390+0000","last_clean":"2023-07-14T11:17:14.080390+0000","last_became_active":"2023-07-14T11:17:13.091372+0000","last_became_peered":"2023-07-14T11:17:13.091372+0000","last_unstale":"2023-07-14T11:17:14.080390+0000","last_undegraded":"2023-07-14T11:17:14.080390+0000","last_fullsized":"2023-07-14T11:17:14.080390+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:40:54.518530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.087130+0000","last_change":"2023-07-14T11:17:13.097003+0000","last_active":"2023-07-14T11:17:14.087130+0000","last_peered":"2023-07-14T11:17:14.087130+0000","last_clean":"2023-07-14T11:17:14.087130+0000","last_became_active":"2023-07-14T11:17:13.096738+0000","last_became_peered":"2023-07-14T11:17:13.096738+0000","last_unstale":"2023-07-14T11:17:14.087130+0000","last_undegraded":"2023-07-14T11:17:14.087130+0000","last_fullsized":"2023-07-14T11:17:14.087130+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:31:43.397294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.088184+0000","last_change":"2023-07-14T11:17:13.097955+0000","last_active":"2023-07-14T11:17:14.088184+0000","last_peered":"2023-07-14T11:17:14.088184+0000","last_clean":"2023-07-14T11:17:14.088184+0000","last_became_active":"2023-07-14T11:17:13.097645+0000","last_became_peered":"2023-07-14T11:17:13.097645+0000","last_unstale":"2023-07-14T11:17:14.088184+0000","last_undegraded":"2023-07-14T11:17:14.088184+0000","last_fullsized":"2023-07-14T11:17:14.088184+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:27:25.806664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.087350+0000","last_change":"2023-07-14T11:17:13.091004+0000","last_active":"2023-07-14T11:17:14.087350+0000","last_peered":"2023-07-14T11:17:14.087350+0000","last_clean":"2023-07-14T11:17:14.087350+0000","last_became_active":"2023-07-14T11:17:13.090701+0000","last_became_peered":"2023-07-14T11:17:13.090701+0000","last_unstale":"2023-07-14T11:17:14.087350+0000","last_undegraded":"2023-07-14T11:17:14.087350+0000","last_fullsized":"2023-07-14T11:17:14.087350+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:10:54.258407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.089501+0000","last_change":"2023-07-14T11:17:13.093268+0000","last_active":"2023-07-14T11:17:14.089501+0000","last_peered":"2023-07-14T11:17:14.089501+0000","last_clean":"2023-07-14T11:17:14.089501+0000","last_became_active":"2023-07-14T11:17:13.092704+0000","last_became_peered":"2023-07-14T11:17:13.092704+0000","last_unstale":"2023-07-14T11:17:14.089501+0000","last_undegraded":"2023-07-14T11:17:14.089501+0000","last_fullsized":"2023-07-14T11:17:14.089501+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:50:20.405701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.087990+0000","last_change":"2023-07-14T11:17:13.091726+0000","last_active":"2023-07-14T11:17:14.087990+0000","last_peered":"2023-07-14T11:17:14.087990+0000","last_clean":"2023-07-14T11:17:14.087990+0000","last_became_active":"2023-07-14T11:17:13.091416+0000","last_became_peered":"2023-07-14T11:17:13.091416+0000","last_unstale":"2023-07-14T11:17:14.087990+0000","last_undegraded":"2023-07-14T11:17:14.087990+0000","last_fullsized":"2023-07-14T11:17:14.087990+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:33:41.404929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.087720+0000","last_change":"2023-07-14T11:17:13.096417+0000","last_active":"2023-07-14T11:17:14.087720+0000","last_peered":"2023-07-14T11:17:14.087720+0000","last_clean":"2023-07-14T11:17:14.087720+0000","last_became_active":"2023-07-14T11:17:13.096147+0000","last_became_peered":"2023-07-14T11:17:13.096147+0000","last_unstale":"2023-07-14T11:17:14.087720+0000","last_undegraded":"2023-07-14T11:17:14.087720+0000","last_fullsized":"2023-07-14T11:17:14.087720+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:11:52.455103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.088062+0000","last_change":"2023-07-14T11:17:13.089419+0000","last_active":"2023-07-14T11:17:14.088062+0000","last_peered":"2023-07-14T11:17:14.088062+0000","last_clean":"2023-07-14T11:17:14.088062+0000","last_became_active":"2023-07-14T11:17:13.089096+0000","last_became_peered":"2023-07-14T11:17:13.089096+0000","last_unstale":"2023-07-14T11:17:14.088062+0000","last_undegraded":"2023-07-14T11:17:14.088062+0000","last_fullsized":"2023-07-14T11:17:14.088062+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:56:03.158035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.087969+0000","last_change":"2023-07-14T11:17:13.089765+0000","last_active":"2023-07-14T11:17:14.087969+0000","last_peered":"2023-07-14T11:17:14.087969+0000","last_clean":"2023-07-14T11:17:14.087969+0000","last_became_active":"2023-07-14T11:17:13.089351+0000","last_became_peered":"2023-07-14T11:17:13.089351+0000","last_unstale":"2023-07-14T11:17:14.087969+0000","last_undegraded":"2023-07-14T11:17:14.087969+0000","last_fullsized":"2023-07-14T11:17:14.087969+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:47:45.082462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.080286+0000","last_change":"2023-07-14T11:17:13.088749+0000","last_active":"2023-07-14T11:17:14.080286+0000","last_peered":"2023-07-14T11:17:14.080286+0000","last_clean":"2023-07-14T11:17:14.080286+0000","last_became_active":"2023-07-14T11:17:13.088488+0000","last_became_peered":"2023-07-14T11:17:13.088488+0000","last_unstale":"2023-07-14T11:17:14.080286+0000","last_undegraded":"2023-07-14T11:17:14.080286+0000","last_fullsized":"2023-07-14T11:17:14.080286+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:49:18.671194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.080619+0000","last_change":"2023-07-14T11:17:13.099252+0000","last_active":"2023-07-14T11:17:14.080619+0000","last_peered":"2023-07-14T11:17:14.080619+0000","last_clean":"2023-07-14T11:17:14.080619+0000","last_became_active":"2023-07-14T11:17:13.098985+0000","last_became_peered":"2023-07-14T11:17:13.098985+0000","last_unstale":"2023-07-14T11:17:14.080619+0000","last_undegraded":"2023-07-14T11:17:14.080619+0000","last_fullsized":"2023-07-14T11:17:14.080619+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:36:36.276917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.089672+0000","last_change":"2023-07-14T11:17:13.101001+0000","last_active":"2023-07-14T11:17:14.089672+0000","last_peered":"2023-07-14T11:17:14.089672+0000","last_clean":"2023-07-14T11:17:14.089672+0000","last_became_active":"2023-07-14T11:17:13.100493+0000","last_became_peered":"2023-07-14T11:17:13.100493+0000","last_unstale":"2023-07-14T11:17:14.089672+0000","last_undegraded":"2023-07-14T11:17:14.089672+0000","last_fullsized":"2023-07-14T11:17:14.089672+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:54:08.391634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.082015+0000","last_change":"2023-07-14T11:17:13.093907+0000","last_active":"2023-07-14T11:17:14.082015+0000","last_peered":"2023-07-14T11:17:14.082015+0000","last_clean":"2023-07-14T11:17:14.082015+0000","last_became_active":"2023-07-14T11:17:13.093563+0000","last_became_peered":"2023-07-14T11:17:13.093563+0000","last_unstale":"2023-07-14T11:17:14.082015+0000","last_undegraded":"2023-07-14T11:17:14.082015+0000","last_fullsized":"2023-07-14T11:17:14.082015+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:54:08.391634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.086445+0000","last_change":"2023-07-14T11:17:13.092967+0000","last_active":"2023-07-14T11:17:14.086445+0000","last_peered":"2023-07-14T11:17:14.086445+0000","last_clean":"2023-07-14T11:17:14.086445+0000","last_became_active":"2023-07-14T11:17:13.092602+0000","last_became_peered":"2023-07-14T11:17:13.092602+0000","last_unstale":"2023-07-14T11:17:14.086445+0000","last_undegraded":"2023-07-14T11:17:14.086445+0000","last_fullsized":"2023-07-14T11:17:14.086445+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:49:28.461054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.087572+0000","last_change":"2023-07-14T11:17:13.081348+0000","last_active":"2023-07-14T11:17:14.087572+0000","last_peered":"2023-07-14T11:17:14.087572+0000","last_clean":"2023-07-14T11:17:14.087572+0000","last_became_active":"2023-07-14T11:17:13.081090+0000","last_became_peered":"2023-07-14T11:17:13.081090+0000","last_unstale":"2023-07-14T11:17:14.087572+0000","last_undegraded":"2023-07-14T11:17:14.087572+0000","last_fullsized":"2023-07-14T11:17:14.087572+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:59:43.358928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.086184+0000","last_change":"2023-07-14T11:17:13.091755+0000","last_active":"2023-07-14T11:17:14.086184+0000","last_peered":"2023-07-14T11:17:14.086184+0000","last_clean":"2023-07-14T11:17:14.086184+0000","last_became_active":"2023-07-14T11:17:13.091467+0000","last_became_peered":"2023-07-14T11:17:13.091467+0000","last_unstale":"2023-07-14T11:17:14.086184+0000","last_undegraded":"2023-07-14T11:17:14.086184+0000","last_fullsized":"2023-07-14T11:17:14.086184+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:46:53.476421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.086022+0000","last_change":"2023-07-14T11:17:13.091811+0000","last_active":"2023-07-14T11:17:14.086022+0000","last_peered":"2023-07-14T11:17:14.086022+0000","last_clean":"2023-07-14T11:17:14.086022+0000","last_became_active":"2023-07-14T11:17:13.091526+0000","last_became_peered":"2023-07-14T11:17:13.091526+0000","last_unstale":"2023-07-14T11:17:14.086022+0000","last_undegraded":"2023-07-14T11:17:14.086022+0000","last_fullsized":"2023-07-14T11:17:14.086022+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:03:05.693970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.088024+0000","last_change":"2023-07-14T11:17:13.090063+0000","last_active":"2023-07-14T11:17:14.088024+0000","last_peered":"2023-07-14T11:17:14.088024+0000","last_clean":"2023-07-14T11:17:14.088024+0000","last_became_active":"2023-07-14T11:17:13.089654+0000","last_became_peered":"2023-07-14T11:17:13.089654+0000","last_unstale":"2023-07-14T11:17:14.088024+0000","last_undegraded":"2023-07-14T11:17:14.088024+0000","last_fullsized":"2023-07-14T11:17:14.088024+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:04:01.641095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.088349+0000","last_change":"2023-07-14T11:17:13.085044+0000","last_active":"2023-07-14T11:17:14.088349+0000","last_peered":"2023-07-14T11:17:14.088349+0000","last_clean":"2023-07-14T11:17:14.088349+0000","last_became_active":"2023-07-14T11:17:13.084737+0000","last_became_peered":"2023-07-14T11:17:13.084737+0000","last_unstale":"2023-07-14T11:17:14.088349+0000","last_undegraded":"2023-07-14T11:17:14.088349+0000","last_fullsized":"2023-07-14T11:17:14.088349+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:40:12.342267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.088940+0000","last_change":"2023-07-14T11:17:13.084489+0000","last_active":"2023-07-14T11:17:14.088940+0000","last_peered":"2023-07-14T11:17:14.088940+0000","last_clean":"2023-07-14T11:17:14.088940+0000","last_became_active":"2023-07-14T11:17:13.084190+0000","last_became_peered":"2023-07-14T11:17:13.084190+0000","last_unstale":"2023-07-14T11:17:14.088940+0000","last_undegraded":"2023-07-14T11:17:14.088940+0000","last_fullsized":"2023-07-14T11:17:14.088940+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:12:45.484169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.089769+0000","last_change":"2023-07-14T11:17:13.093063+0000","last_active":"2023-07-14T11:17:14.089769+0000","last_peered":"2023-07-14T11:17:14.089769+0000","last_clean":"2023-07-14T11:17:14.089769+0000","last_became_active":"2023-07-14T11:17:13.092376+0000","last_became_peered":"2023-07-14T11:17:13.092376+0000","last_unstale":"2023-07-14T11:17:14.089769+0000","last_undegraded":"2023-07-14T11:17:14.089769+0000","last_fullsized":"2023-07-14T11:17:14.089769+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:37:02.423402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.080391+0000","last_change":"2023-07-14T11:17:13.094033+0000","last_active":"2023-07-14T11:17:14.080391+0000","last_peered":"2023-07-14T11:17:14.080391+0000","last_clean":"2023-07-14T11:17:14.080391+0000","last_became_active":"2023-07-14T11:17:13.093719+0000","last_became_peered":"2023-07-14T11:17:13.093719+0000","last_unstale":"2023-07-14T11:17:14.080391+0000","last_undegraded":"2023-07-14T11:17:14.080391+0000","last_fullsized":"2023-07-14T11:17:14.080391+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:33:41.404929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.088001+0000","last_change":"2023-07-14T11:17:13.096973+0000","last_active":"2023-07-14T11:17:14.088001+0000","last_peered":"2023-07-14T11:17:14.088001+0000","last_clean":"2023-07-14T11:17:14.088001+0000","last_became_active":"2023-07-14T11:17:13.096676+0000","last_became_peered":"2023-07-14T11:17:13.096676+0000","last_unstale":"2023-07-14T11:17:14.088001+0000","last_undegraded":"2023-07-14T11:17:14.088001+0000","last_fullsized":"2023-07-14T11:17:14.088001+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:08:44.120399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.088420+0000","last_change":"2023-07-14T11:17:13.091877+0000","last_active":"2023-07-14T11:17:14.088420+0000","last_peered":"2023-07-14T11:17:14.088420+0000","last_clean":"2023-07-14T11:17:14.088420+0000","last_became_active":"2023-07-14T11:17:13.091498+0000","last_became_peered":"2023-07-14T11:17:13.091498+0000","last_unstale":"2023-07-14T11:17:14.088420+0000","last_undegraded":"2023-07-14T11:17:14.088420+0000","last_fullsized":"2023-07-14T11:17:14.088420+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:54:43.413011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.089394+0000","last_change":"2023-07-14T11:17:13.092554+0000","last_active":"2023-07-14T11:17:14.089394+0000","last_peered":"2023-07-14T11:17:14.089394+0000","last_clean":"2023-07-14T11:17:14.089394+0000","last_became_active":"2023-07-14T11:17:13.092118+0000","last_became_peered":"2023-07-14T11:17:13.092118+0000","last_unstale":"2023-07-14T11:17:14.089394+0000","last_undegraded":"2023-07-14T11:17:14.089394+0000","last_fullsized":"2023-07-14T11:17:14.089394+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:19:56.532964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.086470+0000","last_change":"2023-07-14T11:17:13.085049+0000","last_active":"2023-07-14T11:17:14.086470+0000","last_peered":"2023-07-14T11:17:14.086470+0000","last_clean":"2023-07-14T11:17:14.086470+0000","last_became_active":"2023-07-14T11:17:13.084590+0000","last_became_peered":"2023-07-14T11:17:13.084590+0000","last_unstale":"2023-07-14T11:17:14.086470+0000","last_undegraded":"2023-07-14T11:17:14.086470+0000","last_fullsized":"2023-07-14T11:17:14.086470+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:26:13.238741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.081910+0000","last_change":"2023-07-14T11:17:13.092064+0000","last_active":"2023-07-14T11:17:14.081910+0000","last_peered":"2023-07-14T11:17:14.081910+0000","last_clean":"2023-07-14T11:17:14.081910+0000","last_became_active":"2023-07-14T11:17:13.091596+0000","last_became_peered":"2023-07-14T11:17:13.091596+0000","last_unstale":"2023-07-14T11:17:14.081910+0000","last_undegraded":"2023-07-14T11:17:14.081910+0000","last_fullsized":"2023-07-14T11:17:14.081910+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:50:20.405701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"62'4","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.080471+0000","last_change":"2023-07-14T11:17:12.082698+0000","last_active":"2023-07-14T11:17:14.080471+0000","last_peered":"2023-07-14T11:17:14.080471+0000","last_clean":"2023-07-14T11:17:14.080471+0000","last_became_active":"2023-07-14T11:17:12.082271+0000","last_became_peered":"2023-07-14T11:17:12.082271+0000","last_unstale":"2023-07-14T11:17:14.080471+0000","last_undegraded":"2023-07-14T11:17:14.080471+0000","last_fullsized":"2023-07-14T11:17:14.080471+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_clean_scrub_stamp":"2023-07-14T11:17:11.047915+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:40:11.336915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.089824+0000","last_change":"2023-07-14T11:17:13.101769+0000","last_active":"2023-07-14T11:17:14.089824+0000","last_peered":"2023-07-14T11:17:14.089824+0000","last_clean":"2023-07-14T11:17:14.089824+0000","last_became_active":"2023-07-14T11:17:13.101177+0000","last_became_peered":"2023-07-14T11:17:13.101177+0000","last_unstale":"2023-07-14T11:17:14.089824+0000","last_undegraded":"2023-07-14T11:17:14.089824+0000","last_fullsized":"2023-07-14T11:17:14.089824+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:51:49.502930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"62'1","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.087159+0000","last_change":"2023-07-14T11:17:12.082944+0000","last_active":"2023-07-14T11:17:14.087159+0000","last_peered":"2023-07-14T11:17:14.087159+0000","last_clean":"2023-07-14T11:17:14.087159+0000","last_became_active":"2023-07-14T11:17:12.082661+0000","last_became_peered":"2023-07-14T11:17:12.082661+0000","last_unstale":"2023-07-14T11:17:14.087159+0000","last_undegraded":"2023-07-14T11:17:14.087159+0000","last_fullsized":"2023-07-14T11:17:14.087159+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_clean_scrub_stamp":"2023-07-14T11:17:11.047915+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:53:46.354390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.087121+0000","last_change":"2023-07-14T11:17:13.084887+0000","last_active":"2023-07-14T11:17:14.087121+0000","last_peered":"2023-07-14T11:17:14.087121+0000","last_clean":"2023-07-14T11:17:14.087121+0000","last_became_active":"2023-07-14T11:17:13.084516+0000","last_became_peered":"2023-07-14T11:17:13.084516+0000","last_unstale":"2023-07-14T11:17:14.087121+0000","last_undegraded":"2023-07-14T11:17:14.087121+0000","last_fullsized":"2023-07-14T11:17:14.087121+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:40:24.384130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"62'2","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.086914+0000","last_change":"2023-07-14T11:17:12.078449+0000","last_active":"2023-07-14T11:17:14.086914+0000","last_peered":"2023-07-14T11:17:14.086914+0000","last_clean":"2023-07-14T11:17:14.086914+0000","last_became_active":"2023-07-14T11:17:12.078128+0000","last_became_peered":"2023-07-14T11:17:12.078128+0000","last_unstale":"2023-07-14T11:17:14.086914+0000","last_undegraded":"2023-07-14T11:17:14.086914+0000","last_fullsized":"2023-07-14T11:17:14.086914+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_clean_scrub_stamp":"2023-07-14T11:17:11.047915+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:04:54.809817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.087673+0000","last_change":"2023-07-14T11:17:13.088894+0000","last_active":"2023-07-14T11:17:14.087673+0000","last_peered":"2023-07-14T11:17:14.087673+0000","last_clean":"2023-07-14T11:17:14.087673+0000","last_became_active":"2023-07-14T11:17:13.088553+0000","last_became_peered":"2023-07-14T11:17:13.088553+0000","last_unstale":"2023-07-14T11:17:14.087673+0000","last_undegraded":"2023-07-14T11:17:14.087673+0000","last_fullsized":"2023-07-14T11:17:14.087673+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:52:19.076130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"62'2","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.086832+0000","last_change":"2023-07-14T11:17:12.078146+0000","last_active":"2023-07-14T11:17:14.086832+0000","last_peered":"2023-07-14T11:17:14.086832+0000","last_clean":"2023-07-14T11:17:14.086832+0000","last_became_active":"2023-07-14T11:17:12.077838+0000","last_became_peered":"2023-07-14T11:17:12.077838+0000","last_unstale":"2023-07-14T11:17:14.086832+0000","last_undegraded":"2023-07-14T11:17:14.086832+0000","last_fullsized":"2023-07-14T11:17:14.086832+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_clean_scrub_stamp":"2023-07-14T11:17:11.047915+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:49:27.455702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.080739+0000","last_change":"2023-07-14T11:17:13.087253+0000","last_active":"2023-07-14T11:17:14.080739+0000","last_peered":"2023-07-14T11:17:14.080739+0000","last_clean":"2023-07-14T11:17:14.080739+0000","last_became_active":"2023-07-14T11:17:13.086980+0000","last_became_peered":"2023-07-14T11:17:13.086980+0000","last_unstale":"2023-07-14T11:17:14.080739+0000","last_undegraded":"2023-07-14T11:17:14.080739+0000","last_fullsized":"2023-07-14T11:17:14.080739+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:43:37.984778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"62'1","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.086402+0000","last_change":"2023-07-14T11:17:12.075185+0000","last_active":"2023-07-14T11:17:14.086402+0000","last_peered":"2023-07-14T11:17:14.086402+0000","last_clean":"2023-07-14T11:17:14.086402+0000","last_became_active":"2023-07-14T11:17:12.074908+0000","last_became_peered":"2023-07-14T11:17:12.074908+0000","last_unstale":"2023-07-14T11:17:14.086402+0000","last_undegraded":"2023-07-14T11:17:14.086402+0000","last_fullsized":"2023-07-14T11:17:14.086402+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_clean_scrub_stamp":"2023-07-14T11:17:11.047915+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:56:50.536324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.079777+0000","last_change":"2023-07-14T11:17:13.094679+0000","last_active":"2023-07-14T11:17:14.079777+0000","last_peered":"2023-07-14T11:17:14.079777+0000","last_clean":"2023-07-14T11:17:14.079777+0000","last_became_active":"2023-07-14T11:17:13.094347+0000","last_became_peered":"2023-07-14T11:17:13.094347+0000","last_unstale":"2023-07-14T11:17:14.079777+0000","last_undegraded":"2023-07-14T11:17:14.079777+0000","last_fullsized":"2023-07-14T11:17:14.079777+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:18:04.169046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"62'1","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.086382+0000","last_change":"2023-07-14T11:17:12.074984+0000","last_active":"2023-07-14T11:17:14.086382+0000","last_peered":"2023-07-14T11:17:14.086382+0000","last_clean":"2023-07-14T11:17:14.086382+0000","last_became_active":"2023-07-14T11:17:12.074698+0000","last_became_peered":"2023-07-14T11:17:12.074698+0000","last_unstale":"2023-07-14T11:17:14.086382+0000","last_undegraded":"2023-07-14T11:17:14.086382+0000","last_fullsized":"2023-07-14T11:17:14.086382+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_clean_scrub_stamp":"2023-07-14T11:17:11.047915+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:05:55.359051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.081392+0000","last_change":"2023-07-14T11:17:13.091647+0000","last_active":"2023-07-14T11:17:14.081392+0000","last_peered":"2023-07-14T11:17:14.081392+0000","last_clean":"2023-07-14T11:17:14.081392+0000","last_became_active":"2023-07-14T11:17:13.091348+0000","last_became_peered":"2023-07-14T11:17:13.091348+0000","last_unstale":"2023-07-14T11:17:14.081392+0000","last_undegraded":"2023-07-14T11:17:14.081392+0000","last_fullsized":"2023-07-14T11:17:14.081392+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:29:51.723855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.086140+0000","last_change":"2023-07-14T11:17:12.076643+0000","last_active":"2023-07-14T11:17:14.086140+0000","last_peered":"2023-07-14T11:17:14.086140+0000","last_clean":"2023-07-14T11:17:14.086140+0000","last_became_active":"2023-07-14T11:17:12.076298+0000","last_became_peered":"2023-07-14T11:17:12.076298+0000","last_unstale":"2023-07-14T11:17:14.086140+0000","last_undegraded":"2023-07-14T11:17:14.086140+0000","last_fullsized":"2023-07-14T11:17:14.086140+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_clean_scrub_stamp":"2023-07-14T11:17:11.047915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:46:49.241362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.086280+0000","last_change":"2023-07-14T11:17:13.094429+0000","last_active":"2023-07-14T11:17:14.086280+0000","last_peered":"2023-07-14T11:17:14.086280+0000","last_clean":"2023-07-14T11:17:14.086280+0000","last_became_active":"2023-07-14T11:17:13.094139+0000","last_became_peered":"2023-07-14T11:17:13.094139+0000","last_unstale":"2023-07-14T11:17:14.086280+0000","last_undegraded":"2023-07-14T11:17:14.086280+0000","last_fullsized":"2023-07-14T11:17:14.086280+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:26:13.238741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.081300+0000","last_change":"2023-07-14T11:17:12.084042+0000","last_active":"2023-07-14T11:17:14.081300+0000","last_peered":"2023-07-14T11:17:14.081300+0000","last_clean":"2023-07-14T11:17:14.081300+0000","last_became_active":"2023-07-14T11:17:12.083756+0000","last_became_peered":"2023-07-14T11:17:12.083756+0000","last_unstale":"2023-07-14T11:17:14.081300+0000","last_undegraded":"2023-07-14T11:17:14.081300+0000","last_fullsized":"2023-07-14T11:17:14.081300+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_clean_scrub_stamp":"2023-07-14T11:17:11.047915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:21:04.501017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.080092+0000","last_change":"2023-07-14T11:17:13.084302+0000","last_active":"2023-07-14T11:17:14.080092+0000","last_peered":"2023-07-14T11:17:14.080092+0000","last_clean":"2023-07-14T11:17:14.080092+0000","last_became_active":"2023-07-14T11:17:13.083955+0000","last_became_peered":"2023-07-14T11:17:13.083955+0000","last_unstale":"2023-07-14T11:17:14.080092+0000","last_undegraded":"2023-07-14T11:17:14.080092+0000","last_fullsized":"2023-07-14T11:17:14.080092+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:52:12.133537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.088017+0000","last_change":"2023-07-14T11:17:12.083993+0000","last_active":"2023-07-14T11:17:14.088017+0000","last_peered":"2023-07-14T11:17:14.088017+0000","last_clean":"2023-07-14T11:17:14.088017+0000","last_became_active":"2023-07-14T11:17:12.082748+0000","last_became_peered":"2023-07-14T11:17:12.082748+0000","last_unstale":"2023-07-14T11:17:14.088017+0000","last_undegraded":"2023-07-14T11:17:14.088017+0000","last_fullsized":"2023-07-14T11:17:14.088017+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_clean_scrub_stamp":"2023-07-14T11:17:11.047915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:49:44.094764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.086424+0000","last_change":"2023-07-14T11:17:13.075907+0000","last_active":"2023-07-14T11:17:14.086424+0000","last_peered":"2023-07-14T11:17:14.086424+0000","last_clean":"2023-07-14T11:17:14.086424+0000","last_became_active":"2023-07-14T11:17:13.075592+0000","last_became_peered":"2023-07-14T11:17:13.075592+0000","last_unstale":"2023-07-14T11:17:14.086424+0000","last_undegraded":"2023-07-14T11:17:14.086424+0000","last_fullsized":"2023-07-14T11:17:14.086424+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:35:54.640751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.090014+0000","last_change":"2023-07-14T11:17:12.073864+0000","last_active":"2023-07-14T11:17:14.090014+0000","last_peered":"2023-07-14T11:17:14.090014+0000","last_clean":"2023-07-14T11:17:14.090014+0000","last_became_active":"2023-07-14T11:17:12.073535+0000","last_became_peered":"2023-07-14T11:17:12.073535+0000","last_unstale":"2023-07-14T11:17:14.090014+0000","last_undegraded":"2023-07-14T11:17:14.090014+0000","last_fullsized":"2023-07-14T11:17:14.090014+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_clean_scrub_stamp":"2023-07-14T11:17:11.047915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:52:36.312706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.081932+0000","last_change":"2023-07-14T11:17:13.095873+0000","last_active":"2023-07-14T11:17:14.081932+0000","last_peered":"2023-07-14T11:17:14.081932+0000","last_clean":"2023-07-14T11:17:14.081932+0000","last_became_active":"2023-07-14T11:17:13.095460+0000","last_became_peered":"2023-07-14T11:17:13.095460+0000","last_unstale":"2023-07-14T11:17:14.081932+0000","last_undegraded":"2023-07-14T11:17:14.081932+0000","last_fullsized":"2023-07-14T11:17:14.081932+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:23:49.127396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"62'3","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.087534+0000","last_change":"2023-07-14T11:17:12.084564+0000","last_active":"2023-07-14T11:17:14.087534+0000","last_peered":"2023-07-14T11:17:14.087534+0000","last_clean":"2023-07-14T11:17:14.087534+0000","last_became_active":"2023-07-14T11:17:12.084288+0000","last_became_peered":"2023-07-14T11:17:12.084288+0000","last_unstale":"2023-07-14T11:17:14.087534+0000","last_undegraded":"2023-07-14T11:17:14.087534+0000","last_fullsized":"2023-07-14T11:17:14.087534+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_clean_scrub_stamp":"2023-07-14T11:17:11.047915+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:25:28.964162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.090006+0000","last_change":"2023-07-14T11:17:13.095112+0000","last_active":"2023-07-14T11:17:14.090006+0000","last_peered":"2023-07-14T11:17:14.090006+0000","last_clean":"2023-07-14T11:17:14.090006+0000","last_became_active":"2023-07-14T11:17:13.094773+0000","last_became_peered":"2023-07-14T11:17:13.094773+0000","last_unstale":"2023-07-14T11:17:14.090006+0000","last_undegraded":"2023-07-14T11:17:14.090006+0000","last_fullsized":"2023-07-14T11:17:14.090006+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:32:41.713202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"62'6","reported_seq":19,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.080233+0000","last_change":"2023-07-14T11:17:12.076649+0000","last_active":"2023-07-14T11:17:14.080233+0000","last_peered":"2023-07-14T11:17:14.080233+0000","last_clean":"2023-07-14T11:17:14.080233+0000","last_became_active":"2023-07-14T11:17:12.076274+0000","last_became_peered":"2023-07-14T11:17:12.076274+0000","last_unstale":"2023-07-14T11:17:14.080233+0000","last_undegraded":"2023-07-14T11:17:14.080233+0000","last_fullsized":"2023-07-14T11:17:14.080233+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_clean_scrub_stamp":"2023-07-14T11:17:11.047915+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:59:42.353576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.089274+0000","last_change":"2023-07-14T11:17:13.096135+0000","last_active":"2023-07-14T11:17:14.089274+0000","last_peered":"2023-07-14T11:17:14.089274+0000","last_clean":"2023-07-14T11:17:14.089274+0000","last_became_active":"2023-07-14T11:17:13.095870+0000","last_became_peered":"2023-07-14T11:17:13.095870+0000","last_unstale":"2023-07-14T11:17:14.089274+0000","last_undegraded":"2023-07-14T11:17:14.089274+0000","last_fullsized":"2023-07-14T11:17:14.089274+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:55:23.958080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"62'2","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.087985+0000","last_change":"2023-07-14T11:17:12.084200+0000","last_active":"2023-07-14T11:17:14.087985+0000","last_peered":"2023-07-14T11:17:14.087985+0000","last_clean":"2023-07-14T11:17:14.087985+0000","last_became_active":"2023-07-14T11:17:12.083901+0000","last_became_peered":"2023-07-14T11:17:12.083901+0000","last_unstale":"2023-07-14T11:17:14.087985+0000","last_undegraded":"2023-07-14T11:17:14.087985+0000","last_fullsized":"2023-07-14T11:17:14.087985+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_clean_scrub_stamp":"2023-07-14T11:17:11.047915+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:55:07.814201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.088564+0000","last_change":"2023-07-14T11:17:13.091544+0000","last_active":"2023-07-14T11:17:14.088564+0000","last_peered":"2023-07-14T11:17:14.088564+0000","last_clean":"2023-07-14T11:17:14.088564+0000","last_became_active":"2023-07-14T11:17:13.091251+0000","last_became_peered":"2023-07-14T11:17:13.091251+0000","last_unstale":"2023-07-14T11:17:14.088564+0000","last_undegraded":"2023-07-14T11:17:14.088564+0000","last_fullsized":"2023-07-14T11:17:14.088564+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:32:50.226354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.088570+0000","last_change":"2023-07-14T11:17:12.072876+0000","last_active":"2023-07-14T11:17:14.088570+0000","last_peered":"2023-07-14T11:17:14.088570+0000","last_clean":"2023-07-14T11:17:14.088570+0000","last_became_active":"2023-07-14T11:17:12.072420+0000","last_became_peered":"2023-07-14T11:17:12.072420+0000","last_unstale":"2023-07-14T11:17:14.088570+0000","last_undegraded":"2023-07-14T11:17:14.088570+0000","last_fullsized":"2023-07-14T11:17:14.088570+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_clean_scrub_stamp":"2023-07-14T11:17:11.047915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:40:36.048341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.081501+0000","last_change":"2023-07-14T11:17:13.089494+0000","last_active":"2023-07-14T11:17:14.081501+0000","last_peered":"2023-07-14T11:17:14.081501+0000","last_clean":"2023-07-14T11:17:14.081501+0000","last_became_active":"2023-07-14T11:17:13.089209+0000","last_became_peered":"2023-07-14T11:17:13.089209+0000","last_unstale":"2023-07-14T11:17:14.081501+0000","last_undegraded":"2023-07-14T11:17:14.081501+0000","last_fullsized":"2023-07-14T11:17:14.081501+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:33:16.856527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.087446+0000","last_change":"2023-07-14T11:17:12.085713+0000","last_active":"2023-07-14T11:17:14.087446+0000","last_peered":"2023-07-14T11:17:14.087446+0000","last_clean":"2023-07-14T11:17:14.087446+0000","last_became_active":"2023-07-14T11:17:12.085189+0000","last_became_peered":"2023-07-14T11:17:12.085189+0000","last_unstale":"2023-07-14T11:17:14.087446+0000","last_undegraded":"2023-07-14T11:17:14.087446+0000","last_fullsized":"2023-07-14T11:17:14.087446+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_clean_scrub_stamp":"2023-07-14T11:17:11.047915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:38:24.908532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.080189+0000","last_change":"2023-07-14T11:17:13.085582+0000","last_active":"2023-07-14T11:17:14.080189+0000","last_peered":"2023-07-14T11:17:14.080189+0000","last_clean":"2023-07-14T11:17:14.080189+0000","last_became_active":"2023-07-14T11:17:13.085304+0000","last_became_peered":"2023-07-14T11:17:13.085304+0000","last_unstale":"2023-07-14T11:17:14.080189+0000","last_undegraded":"2023-07-14T11:17:14.080189+0000","last_fullsized":"2023-07-14T11:17:14.080189+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:31:43.397294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"62'8","reported_seq":21,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.089212+0000","last_change":"2023-07-14T11:17:12.083653+0000","last_active":"2023-07-14T11:17:14.089212+0000","last_peered":"2023-07-14T11:17:14.089212+0000","last_clean":"2023-07-14T11:17:14.089212+0000","last_became_active":"2023-07-14T11:17:12.083370+0000","last_became_peered":"2023-07-14T11:17:12.083370+0000","last_unstale":"2023-07-14T11:17:14.089212+0000","last_undegraded":"2023-07-14T11:17:14.089212+0000","last_fullsized":"2023-07-14T11:17:14.089212+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_clean_scrub_stamp":"2023-07-14T11:17:11.047915+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:08:26.358802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.086658+0000","last_change":"2023-07-14T11:17:13.100389+0000","last_active":"2023-07-14T11:17:14.086658+0000","last_peered":"2023-07-14T11:17:14.086658+0000","last_clean":"2023-07-14T11:17:14.086658+0000","last_became_active":"2023-07-14T11:17:13.100152+0000","last_became_peered":"2023-07-14T11:17:13.100152+0000","last_unstale":"2023-07-14T11:17:14.086658+0000","last_undegraded":"2023-07-14T11:17:14.086658+0000","last_fullsized":"2023-07-14T11:17:14.086658+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:05:56.364403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"62'2","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.088700+0000","last_change":"2023-07-14T11:17:12.083031+0000","last_active":"2023-07-14T11:17:14.088700+0000","last_peered":"2023-07-14T11:17:14.088700+0000","last_clean":"2023-07-14T11:17:14.088700+0000","last_became_active":"2023-07-14T11:17:12.082659+0000","last_became_peered":"2023-07-14T11:17:12.082659+0000","last_unstale":"2023-07-14T11:17:14.088700+0000","last_undegraded":"2023-07-14T11:17:14.088700+0000","last_fullsized":"2023-07-14T11:17:14.088700+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_clean_scrub_stamp":"2023-07-14T11:17:11.047915+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:02:30.644175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.080944+0000","last_change":"2023-07-14T11:17:13.087229+0000","last_active":"2023-07-14T11:17:14.080944+0000","last_peered":"2023-07-14T11:17:14.080944+0000","last_clean":"2023-07-14T11:17:14.080944+0000","last_became_active":"2023-07-14T11:17:13.086965+0000","last_became_peered":"2023-07-14T11:17:13.086965+0000","last_unstale":"2023-07-14T11:17:14.080944+0000","last_undegraded":"2023-07-14T11:17:14.080944+0000","last_fullsized":"2023-07-14T11:17:14.080944+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:50:01.051200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.089045+0000","last_change":"2023-07-14T11:17:12.076105+0000","last_active":"2023-07-14T11:17:14.089045+0000","last_peered":"2023-07-14T11:17:14.089045+0000","last_clean":"2023-07-14T11:17:14.089045+0000","last_became_active":"2023-07-14T11:17:12.075727+0000","last_became_peered":"2023-07-14T11:17:12.075727+0000","last_unstale":"2023-07-14T11:17:14.089045+0000","last_undegraded":"2023-07-14T11:17:14.089045+0000","last_fullsized":"2023-07-14T11:17:14.089045+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_clean_scrub_stamp":"2023-07-14T11:17:11.047915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:54:54.138894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.088937+0000","last_change":"2023-07-14T11:17:13.092122+0000","last_active":"2023-07-14T11:17:14.088937+0000","last_peered":"2023-07-14T11:17:14.088937+0000","last_clean":"2023-07-14T11:17:14.088937+0000","last_became_active":"2023-07-14T11:17:13.091855+0000","last_became_peered":"2023-07-14T11:17:13.091855+0000","last_unstale":"2023-07-14T11:17:14.088937+0000","last_undegraded":"2023-07-14T11:17:14.088937+0000","last_fullsized":"2023-07-14T11:17:14.088937+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:25:21.414988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.086909+0000","last_change":"2023-07-14T11:17:12.078379+0000","last_active":"2023-07-14T11:17:14.086909+0000","last_peered":"2023-07-14T11:17:14.086909+0000","last_clean":"2023-07-14T11:17:14.086909+0000","last_became_active":"2023-07-14T11:17:12.077692+0000","last_became_peered":"2023-07-14T11:17:12.077692+0000","last_unstale":"2023-07-14T11:17:14.086909+0000","last_undegraded":"2023-07-14T11:17:14.086909+0000","last_fullsized":"2023-07-14T11:17:14.086909+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_clean_scrub_stamp":"2023-07-14T11:17:11.047915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:30:08.788357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.081877+0000","last_change":"2023-07-14T11:17:13.093260+0000","last_active":"2023-07-14T11:17:14.081877+0000","last_peered":"2023-07-14T11:17:14.081877+0000","last_clean":"2023-07-14T11:17:14.081877+0000","last_became_active":"2023-07-14T11:17:13.092810+0000","last_became_peered":"2023-07-14T11:17:13.092810+0000","last_unstale":"2023-07-14T11:17:14.081877+0000","last_undegraded":"2023-07-14T11:17:14.081877+0000","last_fullsized":"2023-07-14T11:17:14.081877+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:19:52.002386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.080743+0000","last_change":"2023-07-14T11:17:12.076515+0000","last_active":"2023-07-14T11:17:14.080743+0000","last_peered":"2023-07-14T11:17:14.080743+0000","last_clean":"2023-07-14T11:17:14.080743+0000","last_became_active":"2023-07-14T11:17:12.076021+0000","last_became_peered":"2023-07-14T11:17:12.076021+0000","last_unstale":"2023-07-14T11:17:14.080743+0000","last_undegraded":"2023-07-14T11:17:14.080743+0000","last_fullsized":"2023-07-14T11:17:14.080743+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_clean_scrub_stamp":"2023-07-14T11:17:11.047915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:32:49.221001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.081097+0000","last_change":"2023-07-14T11:17:13.085932+0000","last_active":"2023-07-14T11:17:14.081097+0000","last_peered":"2023-07-14T11:17:14.081097+0000","last_clean":"2023-07-14T11:17:14.081097+0000","last_became_active":"2023-07-14T11:17:13.085654+0000","last_became_peered":"2023-07-14T11:17:13.085654+0000","last_unstale":"2023-07-14T11:17:14.081097+0000","last_undegraded":"2023-07-14T11:17:14.081097+0000","last_fullsized":"2023-07-14T11:17:14.081097+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:29:57.595392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.088132+0000","last_change":"2023-07-14T11:17:12.085454+0000","last_active":"2023-07-14T11:17:14.088132+0000","last_peered":"2023-07-14T11:17:14.088132+0000","last_clean":"2023-07-14T11:17:14.088132+0000","last_became_active":"2023-07-14T11:17:12.084739+0000","last_became_peered":"2023-07-14T11:17:12.084739+0000","last_unstale":"2023-07-14T11:17:14.088132+0000","last_undegraded":"2023-07-14T11:17:14.088132+0000","last_fullsized":"2023-07-14T11:17:14.088132+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_clean_scrub_stamp":"2023-07-14T11:17:11.047915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:49:46.528855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.089474+0000","last_change":"2023-07-14T11:17:13.094108+0000","last_active":"2023-07-14T11:17:14.089474+0000","last_peered":"2023-07-14T11:17:14.089474+0000","last_clean":"2023-07-14T11:17:14.089474+0000","last_became_active":"2023-07-14T11:17:13.093719+0000","last_became_peered":"2023-07-14T11:17:13.093719+0000","last_unstale":"2023-07-14T11:17:14.089474+0000","last_undegraded":"2023-07-14T11:17:14.089474+0000","last_fullsized":"2023-07-14T11:17:14.089474+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:19:52.002386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.086303+0000","last_change":"2023-07-14T11:17:12.075233+0000","last_active":"2023-07-14T11:17:14.086303+0000","last_peered":"2023-07-14T11:17:14.086303+0000","last_clean":"2023-07-14T11:17:14.086303+0000","last_became_active":"2023-07-14T11:17:12.074964+0000","last_became_peered":"2023-07-14T11:17:12.074964+0000","last_unstale":"2023-07-14T11:17:14.086303+0000","last_undegraded":"2023-07-14T11:17:14.086303+0000","last_fullsized":"2023-07-14T11:17:14.086303+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_clean_scrub_stamp":"2023-07-14T11:17:11.047915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:40:00.813395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.079902+0000","last_change":"2023-07-14T11:17:13.095120+0000","last_active":"2023-07-14T11:17:14.079902+0000","last_peered":"2023-07-14T11:17:14.079902+0000","last_clean":"2023-07-14T11:17:14.079902+0000","last_became_active":"2023-07-14T11:17:13.094831+0000","last_became_peered":"2023-07-14T11:17:13.094831+0000","last_unstale":"2023-07-14T11:17:14.079902+0000","last_undegraded":"2023-07-14T11:17:14.079902+0000","last_fullsized":"2023-07-14T11:17:14.079902+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:23:15.131386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.086247+0000","last_change":"2023-07-14T11:17:12.077850+0000","last_active":"2023-07-14T11:17:14.086247+0000","last_peered":"2023-07-14T11:17:14.086247+0000","last_clean":"2023-07-14T11:17:14.086247+0000","last_became_active":"2023-07-14T11:17:12.075856+0000","last_became_peered":"2023-07-14T11:17:12.075856+0000","last_unstale":"2023-07-14T11:17:14.086247+0000","last_undegraded":"2023-07-14T11:17:14.086247+0000","last_fullsized":"2023-07-14T11:17:14.086247+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_clean_scrub_stamp":"2023-07-14T11:17:11.047915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:00:35.167233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.080559+0000","last_change":"2023-07-14T11:17:13.088630+0000","last_active":"2023-07-14T11:17:14.080559+0000","last_peered":"2023-07-14T11:17:14.080559+0000","last_clean":"2023-07-14T11:17:14.080559+0000","last_became_active":"2023-07-14T11:17:13.088368+0000","last_became_peered":"2023-07-14T11:17:13.088368+0000","last_unstale":"2023-07-14T11:17:14.080559+0000","last_undegraded":"2023-07-14T11:17:14.080559+0000","last_fullsized":"2023-07-14T11:17:14.080559+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:23:24.203581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.079780+0000","last_change":"2023-07-14T11:17:12.075405+0000","last_active":"2023-07-14T11:17:14.079780+0000","last_peered":"2023-07-14T11:17:14.079780+0000","last_clean":"2023-07-14T11:17:14.079780+0000","last_became_active":"2023-07-14T11:17:12.075145+0000","last_became_peered":"2023-07-14T11:17:12.075145+0000","last_unstale":"2023-07-14T11:17:14.079780+0000","last_undegraded":"2023-07-14T11:17:14.079780+0000","last_fullsized":"2023-07-14T11:17:14.079780+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_clean_scrub_stamp":"2023-07-14T11:17:11.047915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:04:45.785551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.087801+0000","last_change":"2023-07-14T11:17:13.096178+0000","last_active":"2023-07-14T11:17:14.087801+0000","last_peered":"2023-07-14T11:17:14.087801+0000","last_clean":"2023-07-14T11:17:14.087801+0000","last_became_active":"2023-07-14T11:17:13.095900+0000","last_became_peered":"2023-07-14T11:17:13.095900+0000","last_unstale":"2023-07-14T11:17:14.087801+0000","last_undegraded":"2023-07-14T11:17:14.087801+0000","last_fullsized":"2023-07-14T11:17:14.087801+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:24:42.746315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"62'1","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.088507+0000","last_change":"2023-07-14T11:17:12.076344+0000","last_active":"2023-07-14T11:17:14.088507+0000","last_peered":"2023-07-14T11:17:14.088507+0000","last_clean":"2023-07-14T11:17:14.088507+0000","last_became_active":"2023-07-14T11:17:12.076010+0000","last_became_peered":"2023-07-14T11:17:12.076010+0000","last_unstale":"2023-07-14T11:17:14.088507+0000","last_undegraded":"2023-07-14T11:17:14.088507+0000","last_fullsized":"2023-07-14T11:17:14.088507+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_clean_scrub_stamp":"2023-07-14T11:17:11.047915+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:36:35.271564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":100,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.079875+0000","last_change":"2023-07-14T11:13:08.923786+0000","last_active":"2023-07-14T11:17:14.079875+0000","last_peered":"2023-07-14T11:17:14.079875+0000","last_clean":"2023-07-14T11:17:14.079875+0000","last_became_active":"2023-07-14T11:13:08.923384+0000","last_became_peered":"2023-07-14T11:13:08.923384+0000","last_unstale":"2023-07-14T11:17:14.079875+0000","last_undegraded":"2023-07-14T11:17:14.079875+0000","last_fullsized":"2023-07-14T11:17:14.079875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:08:23.647023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.081765+0000","last_change":"2023-07-14T11:17:13.092241+0000","last_active":"2023-07-14T11:17:14.081765+0000","last_peered":"2023-07-14T11:17:14.081765+0000","last_clean":"2023-07-14T11:17:14.081765+0000","last_became_active":"2023-07-14T11:17:13.091899+0000","last_became_peered":"2023-07-14T11:17:13.091899+0000","last_unstale":"2023-07-14T11:17:14.081765+0000","last_undegraded":"2023-07-14T11:17:14.081765+0000","last_fullsized":"2023-07-14T11:17:14.081765+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:19:56.532964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.086680+0000","last_change":"2023-07-14T11:17:12.082886+0000","last_active":"2023-07-14T11:17:14.086680+0000","last_peered":"2023-07-14T11:17:14.086680+0000","last_clean":"2023-07-14T11:17:14.086680+0000","last_became_active":"2023-07-14T11:17:12.082591+0000","last_became_peered":"2023-07-14T11:17:12.082591+0000","last_unstale":"2023-07-14T11:17:14.086680+0000","last_undegraded":"2023-07-14T11:17:14.086680+0000","last_fullsized":"2023-07-14T11:17:14.086680+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_clean_scrub_stamp":"2023-07-14T11:17:11.047915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:35:53.635399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":92,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.088683+0000","last_change":"2023-07-14T11:13:08.758749+0000","last_active":"2023-07-14T11:17:14.088683+0000","last_peered":"2023-07-14T11:17:14.088683+0000","last_clean":"2023-07-14T11:17:14.088683+0000","last_became_active":"2023-07-14T11:13:08.757956+0000","last_became_peered":"2023-07-14T11:13:08.757956+0000","last_unstale":"2023-07-14T11:17:14.088683+0000","last_undegraded":"2023-07-14T11:17:14.088683+0000","last_fullsized":"2023-07-14T11:17:14.088683+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:19:56.862493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.088810+0000","last_change":"2023-07-14T11:17:13.085144+0000","last_active":"2023-07-14T11:17:14.088810+0000","last_peered":"2023-07-14T11:17:14.088810+0000","last_clean":"2023-07-14T11:17:14.088810+0000","last_became_active":"2023-07-14T11:17:13.084719+0000","last_became_peered":"2023-07-14T11:17:13.084719+0000","last_unstale":"2023-07-14T11:17:14.088810+0000","last_undegraded":"2023-07-14T11:17:14.088810+0000","last_fullsized":"2023-07-14T11:17:14.088810+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:15:15.655818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.088642+0000","last_change":"2023-07-14T11:17:12.072930+0000","last_active":"2023-07-14T11:17:14.088642+0000","last_peered":"2023-07-14T11:17:14.088642+0000","last_clean":"2023-07-14T11:17:14.088642+0000","last_became_active":"2023-07-14T11:17:12.072569+0000","last_became_peered":"2023-07-14T11:17:12.072569+0000","last_unstale":"2023-07-14T11:17:14.088642+0000","last_undegraded":"2023-07-14T11:17:14.088642+0000","last_fullsized":"2023-07-14T11:17:14.088642+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_clean_scrub_stamp":"2023-07-14T11:17:11.047915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:06:13.465011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":98,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.080555+0000","last_change":"2023-07-14T11:13:08.862331+0000","last_active":"2023-07-14T11:17:14.080555+0000","last_peered":"2023-07-14T11:17:14.080555+0000","last_clean":"2023-07-14T11:17:14.080555+0000","last_became_active":"2023-07-14T11:13:08.861817+0000","last_became_peered":"2023-07-14T11:13:08.861817+0000","last_unstale":"2023-07-14T11:17:14.080555+0000","last_undegraded":"2023-07-14T11:17:14.080555+0000","last_fullsized":"2023-07-14T11:17:14.080555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:56:28.158090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.081595+0000","last_change":"2023-07-14T11:17:13.085759+0000","last_active":"2023-07-14T11:17:14.081595+0000","last_peered":"2023-07-14T11:17:14.081595+0000","last_clean":"2023-07-14T11:17:14.081595+0000","last_became_active":"2023-07-14T11:17:13.085470+0000","last_became_peered":"2023-07-14T11:17:13.085470+0000","last_unstale":"2023-07-14T11:17:14.081595+0000","last_undegraded":"2023-07-14T11:17:14.081595+0000","last_fullsized":"2023-07-14T11:17:14.081595+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:08:27.364154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.086277+0000","last_change":"2023-07-14T11:17:12.073149+0000","last_active":"2023-07-14T11:17:14.086277+0000","last_peered":"2023-07-14T11:17:14.086277+0000","last_clean":"2023-07-14T11:17:14.086277+0000","last_became_active":"2023-07-14T11:17:12.072826+0000","last_became_peered":"2023-07-14T11:17:12.072826+0000","last_unstale":"2023-07-14T11:17:14.086277+0000","last_undegraded":"2023-07-14T11:17:14.086277+0000","last_fullsized":"2023-07-14T11:17:14.086277+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_clean_scrub_stamp":"2023-07-14T11:17:11.047915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:09:48.932021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":92,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.087805+0000","last_change":"2023-07-14T11:13:08.757882+0000","last_active":"2023-07-14T11:17:14.087805+0000","last_peered":"2023-07-14T11:17:14.087805+0000","last_clean":"2023-07-14T11:17:14.087805+0000","last_became_active":"2023-07-14T11:13:08.757541+0000","last_became_peered":"2023-07-14T11:13:08.757541+0000","last_unstale":"2023-07-14T11:17:14.087805+0000","last_undegraded":"2023-07-14T11:17:14.087805+0000","last_fullsized":"2023-07-14T11:17:14.087805+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:58:22.487301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":245,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.087191+0000","last_change":"2023-07-14T11:13:01.370649+0000","last_active":"2023-07-14T11:17:14.087191+0000","last_peered":"2023-07-14T11:17:14.087191+0000","last_clean":"2023-07-14T11:17:14.087191+0000","last_became_active":"2023-07-14T11:13:01.369478+0000","last_became_peered":"2023-07-14T11:13:01.369478+0000","last_unstale":"2023-07-14T11:17:14.087191+0000","last_undegraded":"2023-07-14T11:17:14.087191+0000","last_fullsized":"2023-07-14T11:17:14.087191+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:00.254800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:00.254800+0000","last_clean_scrub_stamp":"2023-07-14T11:13:00.254800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:39:50.510755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.086592+0000","last_change":"2023-07-14T11:17:13.084871+0000","last_active":"2023-07-14T11:17:14.086592+0000","last_peered":"2023-07-14T11:17:14.086592+0000","last_clean":"2023-07-14T11:17:14.086592+0000","last_became_active":"2023-07-14T11:17:13.084293+0000","last_became_peered":"2023-07-14T11:17:13.084293+0000","last_unstale":"2023-07-14T11:17:14.086592+0000","last_undegraded":"2023-07-14T11:17:14.086592+0000","last_fullsized":"2023-07-14T11:17:14.086592+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:40:01.818748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"62'2","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.086670+0000","last_change":"2023-07-14T11:17:12.077219+0000","last_active":"2023-07-14T11:17:14.086670+0000","last_peered":"2023-07-14T11:17:14.086670+0000","last_clean":"2023-07-14T11:17:14.086670+0000","last_became_active":"2023-07-14T11:17:12.076158+0000","last_became_peered":"2023-07-14T11:17:12.076158+0000","last_unstale":"2023-07-14T11:17:14.086670+0000","last_undegraded":"2023-07-14T11:17:14.086670+0000","last_fullsized":"2023-07-14T11:17:14.086670+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_clean_scrub_stamp":"2023-07-14T11:17:11.047915+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:56:50.536324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":89,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.087001+0000","last_change":"2023-07-14T11:13:08.760609+0000","last_active":"2023-07-14T11:17:14.087001+0000","last_peered":"2023-07-14T11:17:14.087001+0000","last_clean":"2023-07-14T11:17:14.087001+0000","last_became_active":"2023-07-14T11:13:08.760285+0000","last_became_peered":"2023-07-14T11:13:08.760285+0000","last_unstale":"2023-07-14T11:17:14.087001+0000","last_undegraded":"2023-07-14T11:17:14.087001+0000","last_fullsized":"2023-07-14T11:17:14.087001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:05:57.680963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.082092+0000","last_change":"2023-07-14T11:17:13.101446+0000","last_active":"2023-07-14T11:17:14.082092+0000","last_peered":"2023-07-14T11:17:14.082092+0000","last_clean":"2023-07-14T11:17:14.082092+0000","last_became_active":"2023-07-14T11:17:13.101176+0000","last_became_peered":"2023-07-14T11:17:13.101176+0000","last_unstale":"2023-07-14T11:17:14.082092+0000","last_undegraded":"2023-07-14T11:17:14.082092+0000","last_fullsized":"2023-07-14T11:17:14.082092+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:51:49.502930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"62'2","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.087585+0000","last_change":"2023-07-14T11:17:12.083507+0000","last_active":"2023-07-14T11:17:14.087585+0000","last_peered":"2023-07-14T11:17:14.087585+0000","last_clean":"2023-07-14T11:17:14.087585+0000","last_became_active":"2023-07-14T11:17:12.083028+0000","last_became_peered":"2023-07-14T11:17:12.083028+0000","last_unstale":"2023-07-14T11:17:14.087585+0000","last_undegraded":"2023-07-14T11:17:14.087585+0000","last_fullsized":"2023-07-14T11:17:14.087585+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_clean_scrub_stamp":"2023-07-14T11:17:11.047915+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:47:14.124778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":88,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.087615+0000","last_change":"2023-07-14T11:13:08.923899+0000","last_active":"2023-07-14T11:17:14.087615+0000","last_peered":"2023-07-14T11:17:14.087615+0000","last_clean":"2023-07-14T11:17:14.087615+0000","last_became_active":"2023-07-14T11:13:08.923513+0000","last_became_peered":"2023-07-14T11:13:08.923513+0000","last_unstale":"2023-07-14T11:17:14.087615+0000","last_undegraded":"2023-07-14T11:17:14.087615+0000","last_fullsized":"2023-07-14T11:17:14.087615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:12:36.676518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.090051+0000","last_change":"2023-07-14T11:17:13.100810+0000","last_active":"2023-07-14T11:17:14.090051+0000","last_peered":"2023-07-14T11:17:14.090051+0000","last_clean":"2023-07-14T11:17:14.090051+0000","last_became_active":"2023-07-14T11:17:13.100196+0000","last_became_peered":"2023-07-14T11:17:13.100196+0000","last_unstale":"2023-07-14T11:17:14.090051+0000","last_undegraded":"2023-07-14T11:17:14.090051+0000","last_fullsized":"2023-07-14T11:17:14.090051+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:52:47.971492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"62'1","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.087392+0000","last_change":"2023-07-14T11:17:12.082774+0000","last_active":"2023-07-14T11:17:14.087392+0000","last_peered":"2023-07-14T11:17:14.087392+0000","last_clean":"2023-07-14T11:17:14.087392+0000","last_became_active":"2023-07-14T11:17:12.082322+0000","last_became_peered":"2023-07-14T11:17:12.082322+0000","last_unstale":"2023-07-14T11:17:14.087392+0000","last_undegraded":"2023-07-14T11:17:14.087392+0000","last_fullsized":"2023-07-14T11:17:14.087392+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_clean_scrub_stamp":"2023-07-14T11:17:11.047915+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:56:58.707583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":100,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.080557+0000","last_change":"2023-07-14T11:13:08.761726+0000","last_active":"2023-07-14T11:17:14.080557+0000","last_peered":"2023-07-14T11:17:14.080557+0000","last_clean":"2023-07-14T11:17:14.080557+0000","last_became_active":"2023-07-14T11:13:08.761365+0000","last_became_peered":"2023-07-14T11:13:08.761365+0000","last_unstale":"2023-07-14T11:17:14.080557+0000","last_undegraded":"2023-07-14T11:17:14.080557+0000","last_fullsized":"2023-07-14T11:17:14.080557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:50:39.102471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.081874+0000","last_change":"2023-07-14T11:17:13.093089+0000","last_active":"2023-07-14T11:17:14.081874+0000","last_peered":"2023-07-14T11:17:14.081874+0000","last_clean":"2023-07-14T11:17:14.081874+0000","last_became_active":"2023-07-14T11:17:13.092516+0000","last_became_peered":"2023-07-14T11:17:13.092516+0000","last_unstale":"2023-07-14T11:17:14.081874+0000","last_undegraded":"2023-07-14T11:17:14.081874+0000","last_fullsized":"2023-07-14T11:17:14.081874+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:12.053267+0000","last_clean_scrub_stamp":"2023-07-14T11:17:12.053267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:55:23.958080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.086543+0000","last_change":"2023-07-14T11:17:12.076603+0000","last_active":"2023-07-14T11:17:14.086543+0000","last_peered":"2023-07-14T11:17:14.086543+0000","last_clean":"2023-07-14T11:17:14.086543+0000","last_became_active":"2023-07-14T11:17:12.076316+0000","last_became_peered":"2023-07-14T11:17:12.076316+0000","last_unstale":"2023-07-14T11:17:14.086543+0000","last_undegraded":"2023-07-14T11:17:14.086543+0000","last_fullsized":"2023-07-14T11:17:14.086543+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:11.047915+0000","last_clean_scrub_stamp":"2023-07-14T11:17:11.047915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:30:08.788357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":92,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T11:17:14.082018+0000","last_change":"2023-07-14T11:13:08.762084+0000","last_active":"2023-07-14T11:17:14.082018+0000","last_peered":"2023-07-14T11:17:14.082018+0000","last_clean":"2023-07-14T11:17:14.082018+0000","last_became_active":"2023-07-14T11:13:08.761763+0000","last_became_peered":"2023-07-14T11:13:08.761763+0000","last_unstale":"2023-07-14T11:17:14.082018+0000","last_undegraded":"2023-07-14T11:17:14.082018+0000","last_fullsized":"2023-07-14T11:17:14.082018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:32:58.112862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574903,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28288,"kb_used_data":1336,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343552,"statfs":{"total":96636764160,"available":96607797248,"internally_reserved":0,"allocated":1368064,"data_stored":926493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.80400000000000005,"15min":0.94199999999999995},"min":{"1min":0.441,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.93300000000000005,"5min":8.4339999999999993,"15min":8.4339999999999993},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.84599999999999997,"15min":0.97999999999999998},"min":{"1min":0.55100000000000005,"5min":0.377,"15min":0.377},"max":{"1min":0.88800000000000001,"5min":8.4559999999999995,"15min":8.4559999999999995},"last":0.63900000000000001}]},{"osd":1,"last update":"Fri Jul 14 11:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.79700000000000004,"15min":0.91300000000000003},"min":{"1min":0.54000000000000004,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.86699999999999999,"5min":6.3520000000000003,"15min":6.3520000000000003},"last":0.505},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.88100000000000001,"15min":1.083},"min":{"1min":0.49299999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.877,"5min":6.8550000000000004,"15min":6.8550000000000004},"last":0.47899999999999998}]},{"osd":2,"last update":"Fri Jul 14 11:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.91200000000000003,"15min":1.137},"min":{"1min":0.51000000000000001,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.91400000000000003,"5min":7.0289999999999999,"15min":7.0289999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.70599999999999996,"15min":0.69399999999999995},"min":{"1min":0.48599999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.94499999999999995,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.59799999999999998}]},{"osd":3,"last update":"Fri Jul 14 11:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.95699999999999996,"15min":1.198},"min":{"1min":0.51800000000000002,"5min":0.505,"15min":0.505},"max":{"1min":0.95699999999999996,"5min":10.337,"15min":10.337},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.753,"15min":0.76700000000000002},"min":{"1min":0.60799999999999998,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.97899999999999998,"5min":1.921,"15min":1.921},"last":0.55600000000000005}]},{"osd":4,"last update":"Fri Jul 14 11:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.62,"15min":0.58999999999999997},"min":{"1min":0.44500000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.89900000000000002,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.72499999999999998,"15min":0.70199999999999996},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.88200000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.72399999999999998}]},{"osd":5,"last update":"Fri Jul 14 11:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.68899999999999995,"15min":0.67500000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.89400000000000002,"5min":1.04,"15min":1.04},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.746,"5min":0.754,"15min":0.73699999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.92100000000000004,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.69899999999999995}]},{"osd":6,"last update":"Fri Jul 14 11:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.70899999999999996,"15min":0.67700000000000005},"min":{"1min":0.499,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.94199999999999995,"5min":1.002,"15min":1.002},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.71699999999999997,"15min":0.68899999999999995},"min":{"1min":0.50900000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.90200000000000002,"5min":1.018,"15min":1.018},"last":0.53500000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574904,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27696,"kb_used_data":744,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":761856,"data_stored":335383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.71499999999999997,"15min":0.70799999999999996},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.93799999999999994,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.73499999999999999,"15min":0.72099999999999997},"min":{"1min":0.45300000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.93100000000000005,"5min":1.167,"15min":1.167},"last":0.99299999999999999}]},{"osd":1,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.71099999999999997,"15min":0.68899999999999995},"min":{"1min":0.53100000000000003,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.97699999999999998,"5min":1.006,"15min":1.006},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.73599999999999999,"15min":0.71599999999999997},"min":{"1min":0.50900000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.0109999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.75900000000000001}]},{"osd":2,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.69399999999999995,"15min":0.67700000000000005},"min":{"1min":0.51300000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.95199999999999996,"5min":1.45,"15min":1.45},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76900000000000002,"15min":0.78100000000000003},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.94799999999999995,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.496}]},{"osd":3,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.752,"15min":0.75},"min":{"1min":0.56499999999999995,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.002,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.747,"15min":0.74299999999999999},"min":{"1min":0.60099999999999998,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.91600000000000004,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.52400000000000002}]},{"osd":4,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.68799999999999994,"15min":0.70599999999999996},"min":{"1min":0.44400000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.94699999999999995,"5min":1.712,"15min":1.712},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.71399999999999997,"15min":0.72399999999999998},"min":{"1min":0.47299999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.871,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.0680000000000001}]},{"osd":5,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.71299999999999997,"15min":0.71799999999999997},"min":{"1min":0.51500000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.89800000000000002,"5min":2.8820000000000001,"15min":2.8820000000000001},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76900000000000002,"15min":0.78700000000000003},"min":{"1min":0.496,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.98399999999999999,"5min":1.129,"15min":1.129},"last":1.022}]},{"osd":7,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.78000000000000003,"15min":0.80100000000000005},"min":{"1min":0.47399999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0569999999999999,"5min":1.333,"15min":1.333},"last":1.1220000000000001},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.76800000000000002,"15min":0.79000000000000004},"min":{"1min":0.54100000000000004,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.92700000000000005,"5min":1.55,"15min":1.55},"last":0.95199999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574903,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27720,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":786432,"data_stored":337677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:17:04 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.42299999999999999,"15min":0.438},"min":{"1min":0.28899999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.54300000000000004,"5min":0.996,"15min":0.996},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.47699999999999998,"15min":0.48299999999999998},"min":{"1min":0.34499999999999997,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.63100000000000001,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.34799999999999998}]},{"osd":2,"last update":"Fri Jul 14 11:17:04 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.52800000000000002,"15min":0.56499999999999995},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.70799999999999996,"5min":2.476,"15min":2.476},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.55800000000000005,"15min":0.61799999999999999},"min":{"1min":0.39800000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.68300000000000005,"5min":2.6299999999999999,"15min":2.6299999999999999},"last":0.42099999999999999}]},{"osd":3,"last update":"Fri Jul 14 11:17:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.53200000000000003,"15min":0.52300000000000002},"min":{"1min":0.40200000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.66300000000000003,"5min":0.748,"15min":0.748},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48199999999999998,"15min":0.49399999999999999},"min":{"1min":0.41699999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.60299999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.38300000000000001}]},{"osd":4,"last update":"Fri Jul 14 11:17:04 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.75,"15min":0.753},"min":{"1min":0.61199999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0309999999999999,"5min":1.363,"15min":1.363},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.76800000000000002,"15min":0.77400000000000002},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.1160000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.71699999999999997}]},{"osd":5,"last update":"Fri Jul 14 11:17:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.76700000000000002,"15min":0.77100000000000002},"min":{"1min":0.60199999999999998,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.2250000000000001,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.79300000000000004,"15min":0.81799999999999995},"min":{"1min":0.58199999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":0.98299999999999998,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.75700000000000001}]},{"osd":6,"last update":"Fri Jul 14 11:17:04 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.76800000000000002,"15min":0.79600000000000004},"min":{"1min":0.56200000000000006,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.97599999999999998,"5min":1.298,"15min":1.298},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77700000000000002,"15min":0.78700000000000003},"min":{"1min":0.54800000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1899999999999999,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.749}]},{"osd":7,"last update":"Fri Jul 14 11:17:04 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.78600000000000003,"15min":0.81599999999999995},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.097,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.77400000000000002,"15min":0.78700000000000003},"min":{"1min":0.624,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.0800000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.70599999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574901,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28272,"kb_used_data":1320,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343568,"statfs":{"total":96636764160,"available":96607813632,"internally_reserved":0,"allocated":1351680,"data_stored":925717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.44,"15min":0.435},"min":{"1min":0.33900000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.59999999999999998,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.44400000000000001,"15min":0.441},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.64100000000000001,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.36899999999999999}]},{"osd":2,"last update":"Fri Jul 14 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.375,"5min":0.307,"15min":0.307},"max":{"1min":0.58599999999999997,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.497,"15min":0.502},"min":{"1min":0.36299999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.66600000000000004,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.53100000000000003}]},{"osd":3,"last update":"Fri Jul 14 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.44900000000000001,"15min":0.42699999999999999},"min":{"1min":0.36099999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.64300000000000002,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.52700000000000002,"15min":0.52500000000000002},"min":{"1min":0.42299999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.64400000000000002,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.51600000000000001}]},{"osd":4,"last update":"Fri Jul 14 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.76300000000000001,"15min":0.76600000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.044,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.72999999999999998,"15min":0.70699999999999996},"min":{"1min":0.53200000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.86599999999999999}]},{"osd":5,"last update":"Fri Jul 14 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.74399999999999999,"15min":0.72899999999999998},"min":{"1min":0.57799999999999996,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77400000000000002,"15min":0.77900000000000003},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.94599999999999995}]},{"osd":6,"last update":"Fri Jul 14 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.73499999999999999,"15min":0.72499999999999998},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.01,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":1.01},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.77600000000000002,"15min":0.78000000000000003},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.022,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.81200000000000006}]},{"osd":7,"last update":"Fri Jul 14 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.80800000000000005,"15min":0.81999999999999995},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.0900000000000001,"5min":1.149,"15min":1.149},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.80300000000000005,"15min":0.78300000000000003},"min":{"1min":0.58999999999999997,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.0600000000000001,"5min":1.081,"15min":1.081},"last":0.96299999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574901,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":740,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":757760,"data_stored":335349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.42799999999999999,"15min":0.44700000000000001},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.63900000000000001,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.436,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.30399999999999999}]},{"osd":1,"last update":"Fri Jul 14 11:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.47999999999999998,"15min":0.48599999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.68400000000000005,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.499,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.39500000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.61399999999999999,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.42299999999999999}]},{"osd":3,"last update":"Fri Jul 14 11:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.501,"15min":0.497},"min":{"1min":0.35699999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57799999999999996,"15min":0.58699999999999997},"min":{"1min":0.42099999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.72599999999999998,"5min":1.034,"15min":1.034},"last":0.50900000000000001}]},{"osd":4,"last update":"Fri Jul 14 11:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.76200000000000001,"15min":0.77200000000000002},"min":{"1min":0.55800000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.92700000000000005,"5min":1.212,"15min":1.212},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.77700000000000002,"15min":0.78800000000000003},"min":{"1min":0.64100000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.1000000000000001,"5min":1.198,"15min":1.198},"last":0.65200000000000002}]},{"osd":5,"last update":"Fri Jul 14 11:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.76900000000000002,"15min":0.79000000000000004},"min":{"1min":0.59499999999999997,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.98899999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.754},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.80000000000000004,"15min":0.82399999999999995},"min":{"1min":0.55000000000000004,"5min":0.495,"15min":0.495},"max":{"1min":1.0609999999999999,"5min":1.351,"15min":1.351},"last":0.624}]},{"osd":6,"last update":"Fri Jul 14 11:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.78100000000000003,"15min":0.79000000000000004},"min":{"1min":0.60899999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.1180000000000001,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.79900000000000004,"15min":0.82299999999999995},"min":{"1min":0.59499999999999997,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0129999999999999,"5min":1.282,"15min":1.282},"last":0.63600000000000001}]},{"osd":7,"last update":"Fri Jul 14 11:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.79300000000000004,"15min":0.80400000000000005},"min":{"1min":0.628,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.0389999999999999,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.78600000000000003,"15min":0.80700000000000005},"min":{"1min":0.63,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.95299999999999996,"5min":1.244,"15min":1.244},"last":0.67600000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574901,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":740,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":757760,"data_stored":335349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.42899999999999999,"15min":0.44800000000000001},"min":{"1min":0.34399999999999997,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.67800000000000005,"5min":0.754,"15min":0.754},"last":0.38},{"interface":"front","average":{"1min":0.502,"5min":0.45500000000000002,"15min":0.45100000000000001},"min":{"1min":0.317,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.47199999999999998}]},{"osd":1,"last update":"Fri Jul 14 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.45100000000000001,"15min":0.45300000000000001},"min":{"1min":0.34000000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.49299999999999999,"15min":0.498},"min":{"1min":0.44500000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.72699999999999998,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.42599999999999999}]},{"osd":2,"last update":"Fri Jul 14 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.55200000000000005,"15min":0.54600000000000004},"min":{"1min":0.42899999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.627,"5min":0.58799999999999997,"15min":0.59799999999999998},"min":{"1min":0.46500000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.79600000000000004,"5min":1.585,"15min":1.585},"last":0.49399999999999999}]},{"osd":4,"last update":"Fri Jul 14 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.75900000000000001,"15min":0.76300000000000001},"min":{"1min":0.53200000000000003,"5min":0.372,"15min":0.372},"max":{"1min":1.0029999999999999,"5min":1.216,"15min":1.216},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.77700000000000002,"15min":0.76000000000000001},"min":{"1min":0.61899999999999999,"5min":0.504,"15min":0.504},"max":{"1min":1.0609999999999999,"5min":1.147,"15min":1.147},"last":0.84999999999999998}]},{"osd":5,"last update":"Fri Jul 14 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.76700000000000002,"15min":0.76400000000000001},"min":{"1min":0.65400000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.024,"5min":1.413,"15min":1.413},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.81799999999999995,"15min":0.85199999999999998},"min":{"1min":0.621,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.097,"5min":1.657,"15min":1.657},"last":0.86299999999999999}]},{"osd":6,"last update":"Fri Jul 14 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.66300000000000003,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.133,"5min":1.726,"15min":1.726},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.78900000000000003,"15min":0.80100000000000005},"min":{"1min":0.61099999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.085,"5min":1.333,"15min":1.333},"last":0.75600000000000001}]},{"osd":7,"last update":"Fri Jul 14 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.81899999999999995,"15min":0.83799999999999997},"min":{"1min":0.623,"5min":0.437,"15min":0.437},"max":{"1min":1.1459999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.83299999999999996,"15min":0.84199999999999997},"min":{"1min":0.59599999999999997,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1579999999999999,"5min":1.268,"15min":1.268},"last":0.82299999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574901,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27704,"kb_used_data":752,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344136,"statfs":{"total":96636764160,"available":96608395264,"internally_reserved":0,"allocated":770048,"data_stored":336913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.64400000000000002,"15min":0.63400000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.85199999999999998,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.67500000000000004,"15min":0.69099999999999995},"min":{"1min":0.42699999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.83199999999999996,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.63600000000000001}]},{"osd":1,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.66100000000000003,"15min":0.66900000000000004},"min":{"1min":0.46100000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.82899999999999996,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.71599999999999997,"15min":0.71399999999999997},"min":{"1min":0.49299999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.93700000000000006,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.66000000000000003}]},{"osd":2,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.71799999999999997,"15min":0.71299999999999997},"min":{"1min":0.51000000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.85299999999999998,"5min":1.48,"15min":1.48},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.73899999999999999,"15min":0.74199999999999999},"min":{"1min":0.57499999999999996,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.84499999999999997,"5min":1.23,"15min":1.23},"last":0.57599999999999996}]},{"osd":3,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.69899999999999995,"15min":0.71499999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.81299999999999994,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.748,"15min":0.74199999999999999},"min":{"1min":0.55200000000000005,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.88100000000000001,"5min":1.145,"15min":1.145},"last":0.52800000000000002}]},{"osd":5,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.71799999999999997,"15min":0.76000000000000001},"min":{"1min":0.45300000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.90000000000000002,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.71699999999999997,"15min":0.76500000000000001},"min":{"1min":0.48999999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.81499999999999995,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.70299999999999996}]},{"osd":6,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71499999999999997,"15min":0.72299999999999998},"min":{"1min":0.45600000000000002,"5min":0.436,"15min":0.436},"max":{"1min":0.86399999999999999,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76600000000000001,"15min":0.77600000000000002},"min":{"1min":0.56999999999999995,"5min":0.442,"15min":0.442},"max":{"1min":0.96099999999999997,"5min":1.3,"15min":1.3},"last":0.49099999999999999}]},{"osd":7,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.746,"15min":0.76900000000000002},"min":{"1min":0.53500000000000003,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.86499999999999999,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.81000000000000005,"15min":0.84399999999999997},"min":{"1min":0.50900000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.92200000000000004,"5min":1.379,"15min":1.379},"last":0.73599999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574903,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27696,"kb_used_data":744,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":761856,"data_stored":335371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.63700000000000001,"15min":0.64200000000000002},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.97299999999999998,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.65000000000000002,"15min":0.64000000000000001},"min":{"1min":0.47599999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.88,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.69099999999999995}]},{"osd":1,"last update":"Fri Jul 14 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.66200000000000003,"15min":0.67700000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.78700000000000003,"5min":1.343,"15min":1.343},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.66100000000000003,"15min":0.65100000000000002},"min":{"1min":0.51300000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.81200000000000006}]},{"osd":2,"last update":"Fri Jul 14 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.72799999999999998,"15min":0.73799999999999999},"min":{"1min":0.59399999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.93500000000000005,"5min":1.034,"15min":1.034},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.73999999999999999,"15min":0.76600000000000001},"min":{"1min":0.51000000000000001,"5min":0.496,"15min":0.496},"max":{"1min":0.83199999999999996,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.83599999999999997}]},{"osd":3,"last update":"Fri Jul 14 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.73699999999999999,"15min":0.76500000000000001},"min":{"1min":0.53500000000000003,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.92800000000000005,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.73799999999999999,"15min":0.77800000000000002},"min":{"1min":0.63500000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.90900000000000003,"5min":1.806,"15min":1.806},"last":0.77900000000000003}]},{"osd":4,"last update":"Fri Jul 14 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.63700000000000001,"15min":0.65300000000000002},"min":{"1min":0.42599999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.88800000000000001,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.627},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.70499999999999996,"15min":0.75},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.996,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.79500000000000004}]},{"osd":6,"last update":"Fri Jul 14 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.71899999999999997,"15min":0.747},"min":{"1min":0.52200000000000002,"5min":0.435,"15min":0.435},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.76200000000000001,"15min":0.79900000000000004},"min":{"1min":0.432,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0629999999999999,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.86399999999999999}]},{"osd":7,"last update":"Fri Jul 14 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.78400000000000003,"15min":0.84199999999999997},"min":{"1min":0.45700000000000002,"5min":0.435,"15min":0.435},"max":{"1min":1.081,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.82599999999999996,"15min":0.86799999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.95899999999999996,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.89600000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T11:17:17.930 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-14T11:17:17.931 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-14T11:17:18.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.166+0000 7fdb01fff700 1 Processor -- start 2023-07-14T11:17:18.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.166+0000 7fdb01fff700 1 -- start start 2023-07-14T11:17:18.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.167+0000 7fdb01fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fdafc0b12f0 0x7fdafc0ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:18.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.167+0000 7fdb01fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdafc0adea0 0x7fdafc0cc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:18.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.167+0000 7fdb01fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdafc15ce70 con 0x7fdafc0c92d0 2023-07-14T11:17:18.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.167+0000 7fdb01fff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdafc15da60 con 0x7fdafc0adea0 2023-07-14T11:17:18.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.167+0000 7fdb01fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdafc15d0c0 con 0x7fdafc0b12f0 2023-07-14T11:17:18.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.167+0000 7fdafbfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdafc0adea0 0x7fdafc0cc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:18.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.167+0000 7fdafbfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdafc0adea0 0x7fdafc0cc690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35328/0 (socket says 172.21.15.84:35328) 2023-07-14T11:17:18.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.167+0000 7fdafbfff700 1 -- 172.21.15.84:0/2177220315 learned_addr learned my addr 172.21.15.84:0/2177220315 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:18.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.168+0000 7fdaf3fff700 1 --2- 172.21.15.84:0/2177220315 >> v2:172.21.15.179:3300/0 conn(0x7fdafc0b12f0 0x7fdafc0ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:18.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.168+0000 7fdafbfff700 1 -- 172.21.15.84:0/2177220315 >> v2:172.21.15.179:3300/0 conn(0x7fdafc0b12f0 msgr2=0x7fdafc0ad8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:18.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.168+0000 7fdafbfff700 1 --2- 172.21.15.84:0/2177220315 >> v2:172.21.15.179:3300/0 conn(0x7fdafc0b12f0 0x7fdafc0ad8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:18.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.168+0000 7fdafbfff700 1 -- 172.21.15.84:0/2177220315 >> v1:172.21.15.179:6789/0 conn(0x7fdafc0c92d0 legacy=0x7fdafc0c96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:18.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.168+0000 7fdafbfff700 1 -- 172.21.15.84:0/2177220315 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdafc15d3a0 con 0x7fdafc0adea0 2023-07-14T11:17:18.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.168+0000 7fdafbfff700 1 --2- 172.21.15.84:0/2177220315 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdafc0adea0 0x7fdafc0cc690 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fdafc06d890 tx=0x7fdaf400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eee5fea2bfe83bb server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:18.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.168+0000 7fdafaffd700 1 -- 172.21.15.84:0/2177220315 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf400e070 con 0x7fdafc0adea0 2023-07-14T11:17:18.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.168+0000 7fdafaffd700 1 -- 172.21.15.84:0/2177220315 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaf4003a20 con 0x7fdafc0adea0 2023-07-14T11:17:18.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.168+0000 7fdafaffd700 1 -- 172.21.15.84:0/2177220315 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf4003dd0 con 0x7fdafc0adea0 2023-07-14T11:17:18.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.169+0000 7fdb01fff700 1 -- 172.21.15.84:0/2177220315 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdafc0adea0 msgr2=0x7fdafc0cc690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:18.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.169+0000 7fdb01fff700 1 --2- 172.21.15.84:0/2177220315 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdafc0adea0 0x7fdafc0cc690 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fdafc06d890 tx=0x7fdaf400b330 comp rx=0 tx=0).stop 2023-07-14T11:17:18.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.169+0000 7fdb01fff700 1 -- 172.21.15.84:0/2177220315 shutdown_connections 2023-07-14T11:17:18.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.169+0000 7fdb01fff700 1 --2- 172.21.15.84:0/2177220315 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdafc0adea0 0x7fdafc0cc690 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:18.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.169+0000 7fdb01fff700 1 --2- 172.21.15.84:0/2177220315 >> v2:172.21.15.179:3300/0 conn(0x7fdafc0b12f0 0x7fdafc0ad8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:18.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.169+0000 7fdb01fff700 1 -- 172.21.15.84:0/2177220315 >> 172.21.15.84:0/2177220315 conn(0x7fdafc0b05d0 msgr2=0x7fdafc0b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:18.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.169+0000 7fdb01fff700 1 -- 172.21.15.84:0/2177220315 shutdown_connections 2023-07-14T11:17:18.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.169+0000 7fdb01fff700 1 -- 172.21.15.84:0/2177220315 wait complete. 2023-07-14T11:17:18.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.171+0000 7fdb01fff700 1 Processor -- start 2023-07-14T11:17:18.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.171+0000 7fdb01fff700 1 -- start start 2023-07-14T11:17:18.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.172+0000 7fdb01fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdafc0adea0 0x7fdafc0b42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:18.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.172+0000 7fdb01fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdafc0b12f0 0x7fdafc0ac860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:18.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.172+0000 7fdb01fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdafc0c92d0 0x7fdafc0acda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:18.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.172+0000 7fdb01fff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdafc0c8050 con 0x7fdafc0b12f0 2023-07-14T11:17:18.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.172+0000 7fdb01fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdafc0b4820 con 0x7fdafc0adea0 2023-07-14T11:17:18.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.172+0000 7fdb01fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdafc0c73d0 con 0x7fdafc0c92d0 2023-07-14T11:17:18.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.172+0000 7fdaf3fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdafc0b12f0 0x7fdafc0ac860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:18.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.172+0000 7fdaf3fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdafc0b12f0 0x7fdafc0ac860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35334/0 (socket says 172.21.15.84:35334) 2023-07-14T11:17:18.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.172+0000 7fdaf3fff700 1 -- 172.21.15.84:0/918883243 learned_addr learned my addr 172.21.15.84:0/918883243 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:18.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.172+0000 7fdaf3fff700 1 -- 172.21.15.84:0/918883243 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdafc0c92d0 msgr2=0x7fdafc0acda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:18.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.172+0000 7fdaf3fff700 1 --2- 172.21.15.84:0/918883243 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdafc0c92d0 0x7fdafc0acda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:18.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.172+0000 7fdaf3fff700 1 -- 172.21.15.84:0/918883243 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdafc0adea0 msgr2=0x7fdafc0b42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:18.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.172+0000 7fdaf3fff700 1 --2- 172.21.15.84:0/918883243 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdafc0adea0 0x7fdafc0b42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:18.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.172+0000 7fdaf3fff700 1 -- 172.21.15.84:0/918883243 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaf4009b30 con 0x7fdafc0b12f0 2023-07-14T11:17:18.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.173+0000 7fdaf3fff700 1 --2- 172.21.15.84:0/918883243 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdafc0b12f0 0x7fdafc0ac860 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fdae400e810 tx=0x7fdae400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:18.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.173+0000 7fdaf8ff9700 1 -- 172.21.15.84:0/918883243 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae4013610 con 0x7fdafc0b12f0 2023-07-14T11:17:18.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.173+0000 7fdaf8ff9700 1 -- 172.21.15.84:0/918883243 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdae4013770 con 0x7fdafc0b12f0 2023-07-14T11:17:18.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.173+0000 7fdaf8ff9700 1 -- 172.21.15.84:0/918883243 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae4013b20 con 0x7fdafc0b12f0 2023-07-14T11:17:18.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.173+0000 7fdb01fff700 1 -- 172.21.15.84:0/918883243 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdafc0c76b0 con 0x7fdafc0b12f0 2023-07-14T11:17:18.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.173+0000 7fdb01fff700 1 -- 172.21.15.84:0/918883243 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdafc0c7c70 con 0x7fdafc0b12f0 2023-07-14T11:17:18.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.174+0000 7fdb01fff700 1 -- 172.21.15.84:0/918883243 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdafc0c7e30 con 0x7fdafc0b12f0 2023-07-14T11:17:18.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.175+0000 7fdaf8ff9700 1 -- 172.21.15.84:0/918883243 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 9) v1 ==== 89190+0+0 (secure 0 0 0) 0x7fdae4013c80 con 0x7fdafc0b12f0 2023-07-14T11:17:18.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.176+0000 7fdaf8ff9700 1 --2- 172.21.15.84:0/918883243 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fdadc06ae90 0x7fdadc06d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:18.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.176+0000 7fdaf8ff9700 1 -- 172.21.15.84:0/918883243 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdae40895d0 con 0x7fdafc0b12f0 2023-07-14T11:17:18.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.176+0000 7fdafb7fe700 1 --2- 172.21.15.84:0/918883243 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fdadc06ae90 0x7fdadc06d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:18.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.177+0000 7fdafb7fe700 1 --2- 172.21.15.84:0/918883243 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fdadc06ae90 0x7fdadc06d340 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fdafc0ad7c0 tx=0x7fdaec006c50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:18.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.180+0000 7fdaf8ff9700 1 -- 172.21.15.84:0/918883243 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fdae4054260 con 0x7fdafc0b12f0 2023-07-14T11:17:18.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.450+0000 7fdb01fff700 1 -- 172.21.15.84:0/918883243 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fdafc074350 con 0x7fdafc0b12f0 2023-07-14T11:17:18.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.456+0000 7fdaf8ff9700 1 -- 172.21.15.84:0/918883243 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 190+0+147 (secure 0 0 0) 0x7fdae4057880 con 0x7fdafc0b12f0 2023-07-14T11:17:18.459 INFO:teuthology.orchestra.run.smithi084.stdout:[client.0] 2023-07-14T11:17:18.459 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCKLbFkKSl5GBAAwPK4Zs6+gv/6YKHh4JI3WA== 2023-07-14T11:17:18.459 INFO:teuthology.orchestra.run.smithi084.stdout: caps mds = "allow" 2023-07-14T11:17:18.459 INFO:teuthology.orchestra.run.smithi084.stdout: caps mon = "allow r" 2023-07-14T11:17:18.459 INFO:teuthology.orchestra.run.smithi084.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-14T11:17:18.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.459+0000 7fdb01fff700 1 -- 172.21.15.84:0/918883243 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fdadc06ae90 msgr2=0x7fdadc06d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:18.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.459+0000 7fdb01fff700 1 --2- 172.21.15.84:0/918883243 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fdadc06ae90 0x7fdadc06d340 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fdafc0ad7c0 tx=0x7fdaec006c50 comp rx=0 tx=0).stop 2023-07-14T11:17:18.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.459+0000 7fdb01fff700 1 -- 172.21.15.84:0/918883243 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdafc0b12f0 msgr2=0x7fdafc0ac860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:18.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.459+0000 7fdb01fff700 1 --2- 172.21.15.84:0/918883243 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdafc0b12f0 0x7fdafc0ac860 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fdae400e810 tx=0x7fdae400ebd0 comp rx=0 tx=0).stop 2023-07-14T11:17:18.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.459+0000 7fdb01fff700 1 -- 172.21.15.84:0/918883243 shutdown_connections 2023-07-14T11:17:18.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.459+0000 7fdb01fff700 1 --2- 172.21.15.84:0/918883243 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fdadc06ae90 0x7fdadc06d340 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:18.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.459+0000 7fdb01fff700 1 --2- 172.21.15.84:0/918883243 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdafc0c92d0 0x7fdafc0acda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:18.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.459+0000 7fdb01fff700 1 --2- 172.21.15.84:0/918883243 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdafc0adea0 0x7fdafc0b42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:18.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.459+0000 7fdb01fff700 1 --2- 172.21.15.84:0/918883243 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdafc0b12f0 0x7fdafc0ac860 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:18.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.459+0000 7fdb01fff700 1 -- 172.21.15.84:0/918883243 >> 172.21.15.84:0/918883243 conn(0x7fdafc0b05d0 msgr2=0x7fdafc0cc960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:18.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.459+0000 7fdb01fff700 1 -- 172.21.15.84:0/918883243 shutdown_connections 2023-07-14T11:17:18.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.459+0000 7fdb01fff700 1 -- 172.21.15.84:0/918883243 wait complete. 2023-07-14T11:17:18.463 INFO:teuthology.orchestra.run.smithi084.stderr:updated caps for client.0 2023-07-14T11:17:18.479 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T11:17:18.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.670+0000 7fdf0ebff700 1 Processor -- start 2023-07-14T11:17:18.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.671+0000 7fdf0ebff700 1 -- start start 2023-07-14T11:17:18.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.672+0000 7fdf0ebff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fdf080b5d90 0x7fdf080b6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:18.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.672+0000 7fdf0ebff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf080b7f50 con 0x7fdf080d0b10 2023-07-14T11:17:18.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.672+0000 7fdf0ebff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf080cdca0 con 0x7fdf080b4510 2023-07-14T11:17:18.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.672+0000 7fdf0ebff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf080b48e0 con 0x7fdf080b5d90 2023-07-14T11:17:18.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.672+0000 7fdf0d19c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fdf080d0b10 0x7fdf080b83e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:43216/0 (socket says 172.21.15.84:43216) 2023-07-14T11:17:18.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.672+0000 7fdf0d19c700 1 -- 172.21.15.84:0/2690603452 learned_addr learned my addr 172.21.15.84:0/2690603452 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:17:18.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.672+0000 7fdf07fff700 1 --2- 172.21.15.84:0/2690603452 >> v2:172.21.15.179:3300/0 conn(0x7fdf080b5d90 0x7fdf080b6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:18.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.672+0000 7fdf077fe700 1 -- 172.21.15.84:0/2690603452 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1326595063 0 0) 0x7fdf080b7f50 con 0x7fdf080d0b10 2023-07-14T11:17:18.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.673+0000 7fdf077fe700 1 -- 172.21.15.84:0/2690603452 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdef80035b0 con 0x7fdf080d0b10 2023-07-14T11:17:18.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.673+0000 7fdf077fe700 1 -- 172.21.15.84:0/2690603452 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2785525876 0 0) 0x7fdef80035b0 con 0x7fdf080d0b10 2023-07-14T11:17:18.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.673+0000 7fdf077fe700 1 -- 172.21.15.84:0/2690603452 >> v2:172.21.15.179:3300/0 conn(0x7fdf080b5d90 msgr2=0x7fdf080b6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:18.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.673+0000 7fdf077fe700 1 --2- 172.21.15.84:0/2690603452 >> v2:172.21.15.179:3300/0 conn(0x7fdf080b5d90 0x7fdf080b6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:18.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.673+0000 7fdf077fe700 1 -- 172.21.15.84:0/2690603452 >> v1:172.21.15.179:6789/0 conn(0x7fdf080b4510 legacy=0x7fdf080cd590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:18.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.673+0000 7fdf077fe700 1 -- 172.21.15.84:0/2690603452 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf080b7340 con 0x7fdf080d0b10 2023-07-14T11:17:18.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.673+0000 7fdf077fe700 1 -- 172.21.15.84:0/2690603452 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7fdf000019f0 con 0x7fdf080d0b10 2023-07-14T11:17:18.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.673+0000 7fdf077fe700 1 -- 172.21.15.84:0/2690603452 >> v1:172.21.15.84:6789/0 conn(0x7fdf080d0b10 legacy=0x7fdf080b83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:18.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.673+0000 7fdf077fe700 1 --2- 172.21.15.84:0/2690603452 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdef8003a50 0x7fdef8003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:18.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.673+0000 7fdf077fe700 1 --2- 172.21.15.84:0/2690603452 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdef8004850 0x7fdef8004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:18.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.673+0000 7fdf077fe700 1 --2- 172.21.15.84:0/2690603452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdef80052d0 0x7fdef800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:18.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.673+0000 7fdf077fe700 1 -- 172.21.15.84:0/2690603452 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef800c1d0 con 0x7fdef8004850 2023-07-14T11:17:18.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.673+0000 7fdf077fe700 1 -- 172.21.15.84:0/2690603452 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef800c340 con 0x7fdef80052d0 2023-07-14T11:17:18.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.673+0000 7fdf077fe700 1 -- 172.21.15.84:0/2690603452 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdef800c500 con 0x7fdef8003a50 2023-07-14T11:17:18.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.673+0000 7fdf07fff700 1 --2- 172.21.15.84:0/2690603452 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdef8004850 0x7fdef8004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:18.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.673+0000 7fdf0d19c700 1 --2- 172.21.15.84:0/2690603452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdef80052d0 0x7fdef800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:18.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.673+0000 7fdf0c99b700 1 --2- 172.21.15.84:0/2690603452 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdef8003a50 0x7fdef8003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:18.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.674+0000 7fdf07fff700 1 -- 172.21.15.84:0/2690603452 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdef8003a50 msgr2=0x7fdef8003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:18.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.674+0000 7fdf07fff700 1 --2- 172.21.15.84:0/2690603452 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdef8003a50 0x7fdef8003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:18.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.674+0000 7fdf07fff700 1 -- 172.21.15.84:0/2690603452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdef80052d0 msgr2=0x7fdef800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:18.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.674+0000 7fdf07fff700 1 --2- 172.21.15.84:0/2690603452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdef80052d0 0x7fdef800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:18.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.674+0000 7fdf07fff700 1 -- 172.21.15.84:0/2690603452 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdef80035b0 con 0x7fdef8004850 2023-07-14T11:17:18.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.674+0000 7fdf0d19c700 1 -- 172.21.15.84:0/2690603452 reap_dead start 2023-07-14T11:17:18.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.674+0000 7fdf07fff700 1 --2- 172.21.15.84:0/2690603452 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdef8004850 0x7fdef8004cc0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fdef4009b60 tx=0x7fdef8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2be0c3c4b34f177 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:18.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.674+0000 7fdf077fe700 1 -- 172.21.15.84:0/2690603452 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef400e6c0 con 0x7fdef8004850 2023-07-14T11:17:18.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.674+0000 7fdf077fe700 1 -- 172.21.15.84:0/2690603452 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdef400e820 con 0x7fdef8004850 2023-07-14T11:17:18.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.674+0000 7fdf077fe700 1 -- 172.21.15.84:0/2690603452 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef400eb90 con 0x7fdef8004850 2023-07-14T11:17:18.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.675+0000 7fdf0ebff700 1 -- 172.21.15.84:0/2690603452 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdef8004850 msgr2=0x7fdef8004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:18.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.675+0000 7fdf0ebff700 1 --2- 172.21.15.84:0/2690603452 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdef8004850 0x7fdef8004cc0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fdef4009b60 tx=0x7fdef8005880 comp rx=0 tx=0).stop 2023-07-14T11:17:18.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.675+0000 7fdf0ebff700 1 -- 172.21.15.84:0/2690603452 shutdown_connections 2023-07-14T11:17:18.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.675+0000 7fdf0ebff700 1 --2- 172.21.15.84:0/2690603452 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdef8004850 0x7fdef8004cc0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:18.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.675+0000 7fdf0ebff700 1 -- 172.21.15.84:0/2690603452 >> 172.21.15.84:0/2690603452 conn(0x7fdf0809c1d0 msgr2=0x7fdf080d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:18.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.675+0000 7fdf0ebff700 1 -- 172.21.15.84:0/2690603452 shutdown_connections 2023-07-14T11:17:18.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.675+0000 7fdf0ebff700 1 -- 172.21.15.84:0/2690603452 wait complete. 2023-07-14T11:17:18.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.677+0000 7fdf0ebff700 1 Processor -- start 2023-07-14T11:17:18.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.677+0000 7fdf0ebff700 1 -- start start 2023-07-14T11:17:18.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.679+0000 7fdf0ebff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdef8004850 0x7fdf0815f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:18.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.679+0000 7fdf0ebff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf081f1af0 0x7fdf080ca010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:18.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.679+0000 7fdf0ebff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf080ceee0 0x7fdf080cf350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:18.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.679+0000 7fdf0ebff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf08150e90 con 0x7fdef8004850 2023-07-14T11:17:18.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.679+0000 7fdf0ebff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf080cf890 con 0x7fdf081f1af0 2023-07-14T11:17:18.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.679+0000 7fdf0ebff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf080ca550 con 0x7fdf080ceee0 2023-07-14T11:17:18.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.679+0000 7fdf0c99b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdef8004850 0x7fdf0815f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:18.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.679+0000 7fdf0c99b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdef8004850 0x7fdf0815f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35342/0 (socket says 172.21.15.84:35342) 2023-07-14T11:17:18.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.679+0000 7fdf0c99b700 1 -- 172.21.15.84:0/2057915032 learned_addr learned my addr 172.21.15.84:0/2057915032 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:18.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.679+0000 7fdf0c99b700 1 -- 172.21.15.84:0/2057915032 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf080ceee0 msgr2=0x7fdf080cf350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:18.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.679+0000 7fdf0c99b700 1 --2- 172.21.15.84:0/2057915032 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf080ceee0 0x7fdf080cf350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:18.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.679+0000 7fdf0c99b700 1 -- 172.21.15.84:0/2057915032 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf081f1af0 msgr2=0x7fdf080ca010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:18.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.679+0000 7fdf0c99b700 1 --2- 172.21.15.84:0/2057915032 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf081f1af0 0x7fdf080ca010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:18.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.679+0000 7fdf0c99b700 1 -- 172.21.15.84:0/2057915032 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf080ca820 con 0x7fdef8004850 2023-07-14T11:17:18.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.679+0000 7fdf0c99b700 1 --2- 172.21.15.84:0/2057915032 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdef8004850 0x7fdf0815f5c0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fdefc00e490 tx=0x7fdefc00e850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:18.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.680+0000 7fdf057fa700 1 -- 172.21.15.84:0/2057915032 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdefc0052e0 con 0x7fdef8004850 2023-07-14T11:17:18.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.680+0000 7fdf057fa700 1 -- 172.21.15.84:0/2057915032 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdefc005440 con 0x7fdef8004850 2023-07-14T11:17:18.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.680+0000 7fdf0ebff700 1 -- 172.21.15.84:0/2057915032 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf080cab00 con 0x7fdef8004850 2023-07-14T11:17:18.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.680+0000 7fdf057fa700 1 -- 172.21.15.84:0/2057915032 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdefc0038d0 con 0x7fdef8004850 2023-07-14T11:17:18.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.680+0000 7fdf0ebff700 1 -- 172.21.15.84:0/2057915032 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf080cb0c0 con 0x7fdef8004850 2023-07-14T11:17:18.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.681+0000 7fdf0ebff700 1 -- 172.21.15.84:0/2057915032 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf0804e280 con 0x7fdef8004850 2023-07-14T11:17:18.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.682+0000 7fdf057fa700 1 -- 172.21.15.84:0/2057915032 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 9) v1 ==== 89190+0+0 (secure 0 0 0) 0x7fdefc003a30 con 0x7fdef8004850 2023-07-14T11:17:18.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.683+0000 7fdf057fa700 1 --2- 172.21.15.84:0/2057915032 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fdeec06aec0 0x7fdeec06d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:18.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.683+0000 7fdf057fa700 1 -- 172.21.15.84:0/2057915032 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdefc088dc0 con 0x7fdef8004850 2023-07-14T11:17:18.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.683+0000 7fdf07fff700 1 --2- 172.21.15.84:0/2057915032 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fdeec06aec0 0x7fdeec06d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:18.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.684+0000 7fdf07fff700 1 --2- 172.21.15.84:0/2057915032 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fdeec06aec0 0x7fdeec06d370 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fdf0806b990 tx=0x7fdef4013000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:18.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.687+0000 7fdf057fa700 1 -- 172.21.15.84:0/2057915032 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fdefc053c90 con 0x7fdef8004850 2023-07-14T11:17:18.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.924+0000 7fdf0ebff700 1 -- 172.21.15.84:0/2057915032 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdf080c6810 con 0x7fdef8004850 2023-07-14T11:17:18.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.924+0000 7fdf057fa700 1 -- 172.21.15.84:0/2057915032 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+4716 (secure 0 0 0) 0x7fdefc019090 con 0x7fdef8004850 2023-07-14T11:17:18.927 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:17:18.927 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":37,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5342,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/2977703024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2977703024},{"type":"v1","addr":"172.21.15.179:6834","nonce":2977703024}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31},{"gid":5351,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/2068020315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":2068020315},{"type":"v1","addr":"172.21.15.84:6837","nonce":2068020315}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32},{"gid":5914,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/2441649918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2441649918},{"type":"v1","addr":"172.21.15.84:6836","nonce":2441649918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T11:17:12.547835+0000","modified":"2023-07-14T11:17:16.095092+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6174},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6174":{"gid":6174,"name":"d","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/3902238230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":3902238230},{"type":"v1","addr":"172.21.15.179:6835","nonce":3902238230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-07-14T11:17:18.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.927+0000 7fdf0ebff700 1 -- 172.21.15.84:0/2057915032 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fdeec06aec0 msgr2=0x7fdeec06d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:18.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.927+0000 7fdf0ebff700 1 --2- 172.21.15.84:0/2057915032 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fdeec06aec0 0x7fdeec06d370 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fdf0806b990 tx=0x7fdef4013000 comp rx=0 tx=0).stop 2023-07-14T11:17:18.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.927+0000 7fdf0ebff700 1 -- 172.21.15.84:0/2057915032 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdef8004850 msgr2=0x7fdf0815f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:18.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.927+0000 7fdf0ebff700 1 --2- 172.21.15.84:0/2057915032 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdef8004850 0x7fdf0815f5c0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fdefc00e490 tx=0x7fdefc00e850 comp rx=0 tx=0).stop 2023-07-14T11:17:18.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.927+0000 7fdf0ebff700 1 -- 172.21.15.84:0/2057915032 shutdown_connections 2023-07-14T11:17:18.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.927+0000 7fdf0ebff700 1 --2- 172.21.15.84:0/2057915032 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fdeec06aec0 0x7fdeec06d370 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:18.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.927+0000 7fdf0ebff700 1 --2- 172.21.15.84:0/2057915032 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf080ceee0 0x7fdf080cf350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:18.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.927+0000 7fdf0ebff700 1 --2- 172.21.15.84:0/2057915032 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdef8004850 0x7fdf0815f5c0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:18.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.927+0000 7fdf0ebff700 1 --2- 172.21.15.84:0/2057915032 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf081f1af0 0x7fdf080ca010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:18.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.927+0000 7fdf0ebff700 1 -- 172.21.15.84:0/2057915032 >> 172.21.15.84:0/2057915032 conn(0x7fdf0809c1d0 msgr2=0x7fdf080d2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:18.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.927+0000 7fdf0ebff700 1 -- 172.21.15.84:0/2057915032 shutdown_connections 2023-07-14T11:17:18.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:18.927+0000 7fdf0ebff700 1 -- 172.21.15.84:0/2057915032 wait complete. 2023-07-14T11:17:18.931 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 37 2023-07-14T11:17:19.054 INFO:tasks.ceph.mds.d.smithi179.stderr:2023-07-14T11:17:19.052+0000 7fee341f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-14T11:17:19.349 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 37, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-14T11:17:12.547835+0000', 'modified': '2023-07-14T11:17:16.095092+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6174}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6174': {'gid': 6174, 'name': 'd', 'rank': 0, 'incarnation': 33, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.179:6835/3902238230', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6833', 'nonce': 3902238230}, {'type': 'v1', 'addr': '172.21.15.179:6835', 'nonce': 3902238230}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-14T11:17:19.349 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-14T11:17:19.349 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-07-14T11:17:19.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.545+0000 7fe8dedff700 1 Processor -- start 2023-07-14T11:17:19.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.545+0000 7fe8dedff700 1 -- start start 2023-07-14T11:17:19.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.546+0000 7fe8dedff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe8d815c6c0 0x7fe8d80b2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:19.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.546+0000 7fe8dedff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8d80afc40 0x7fe8d80b2b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:19.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.546+0000 7fe8dedff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8d815ca90 con 0x7fe8d80b30b0 2023-07-14T11:17:19.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.546+0000 7fe8dedff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8d806b0e0 con 0x7fe8d815c6c0 2023-07-14T11:17:19.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.546+0000 7fe8dedff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d80d0370 con 0x7fe8d80afc40 2023-07-14T11:17:19.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.547+0000 7fe8dcb9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe8d815c6c0 0x7fe8d80b2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:19.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.547+0000 7fe8dd39c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fe8d80b30b0 0x7fe8d8160150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:35796/0 (socket says 172.21.15.84:35796) 2023-07-14T11:17:19.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.547+0000 7fe8dd39c700 1 -- 172.21.15.84:0/2381847860 learned_addr learned my addr 172.21.15.84:0/2381847860 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:17:19.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.547+0000 7fe8d7fff700 1 --2- 172.21.15.84:0/2381847860 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8d80afc40 0x7fe8d80b2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:19.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.547+0000 7fe8dcb9b700 1 -- 172.21.15.84:0/2381847860 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8d80afc40 msgr2=0x7fe8d80b2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:19.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.547+0000 7fe8dcb9b700 1 --2- 172.21.15.84:0/2381847860 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8d80afc40 0x7fe8d80b2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:19.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.547+0000 7fe8dcb9b700 1 -- 172.21.15.84:0/2381847860 >> v1:172.21.15.84:6789/0 conn(0x7fe8d80b30b0 legacy=0x7fe8d8160150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:19.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.547+0000 7fe8dcb9b700 1 -- 172.21.15.84:0/2381847860 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d80d0650 con 0x7fe8d815c6c0 2023-07-14T11:17:19.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.547+0000 7fe8d7fff700 1 --2- 172.21.15.84:0/2381847860 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8d80afc40 0x7fe8d80b2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:17:19.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.547+0000 7fe8dcb9b700 1 --2- 172.21.15.84:0/2381847860 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8d815c6c0 0x7fe8d80b2630 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc009840 tx=0x7fe8cc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a42c70da32bcbc4 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:19.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.547+0000 7fe8d77fe700 1 -- 172.21.15.84:0/2381847860 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8cc011830 con 0x7fe8d815c6c0 2023-07-14T11:17:19.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.548+0000 7fe8d77fe700 1 -- 172.21.15.84:0/2381847860 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8cc011990 con 0x7fe8d815c6c0 2023-07-14T11:17:19.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.548+0000 7fe8d77fe700 1 -- 172.21.15.84:0/2381847860 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8cc011d20 con 0x7fe8d815c6c0 2023-07-14T11:17:19.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.548+0000 7fe8dedff700 1 -- 172.21.15.84:0/2381847860 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8d815c6c0 msgr2=0x7fe8d80b2630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:19.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.548+0000 7fe8dedff700 1 --2- 172.21.15.84:0/2381847860 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8d815c6c0 0x7fe8d80b2630 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc009840 tx=0x7fe8cc009b50 comp rx=0 tx=0).stop 2023-07-14T11:17:19.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.548+0000 7fe8dedff700 1 -- 172.21.15.84:0/2381847860 shutdown_connections 2023-07-14T11:17:19.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.548+0000 7fe8dedff700 1 --2- 172.21.15.84:0/2381847860 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8d815c6c0 0x7fe8d80b2630 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:19.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.548+0000 7fe8dedff700 1 --2- 172.21.15.84:0/2381847860 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8d80afc40 0x7fe8d80b2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:19.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.548+0000 7fe8dedff700 1 -- 172.21.15.84:0/2381847860 >> 172.21.15.84:0/2381847860 conn(0x7fe8d806d980 msgr2=0x7fe8d806dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:19.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.548+0000 7fe8dedff700 1 -- 172.21.15.84:0/2381847860 shutdown_connections 2023-07-14T11:17:19.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.548+0000 7fe8dedff700 1 -- 172.21.15.84:0/2381847860 wait complete. 2023-07-14T11:17:19.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.550+0000 7fe8dedff700 1 Processor -- start 2023-07-14T11:17:19.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.550+0000 7fe8dedff700 1 -- start start 2023-07-14T11:17:19.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.551+0000 7fe8dedff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8d80afc40 0x7fe8d8159b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:19.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.551+0000 7fe8dedff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8d80b30b0 0x7fe8d81f63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:19.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.551+0000 7fe8dedff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8d815c6c0 0x7fe8d80ca610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:19.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.551+0000 7fe8dedff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d81f6930 con 0x7fe8d80afc40 2023-07-14T11:17:19.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.551+0000 7fe8dedff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d80cab50 con 0x7fe8d80b30b0 2023-07-14T11:17:19.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.551+0000 7fe8dedff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d815a1c0 con 0x7fe8d815c6c0 2023-07-14T11:17:19.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.551+0000 7fe8dcb9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8d80afc40 0x7fe8d8159b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:19.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.551+0000 7fe8dcb9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8d80afc40 0x7fe8d8159b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58926/0 (socket says 172.21.15.84:58926) 2023-07-14T11:17:19.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.551+0000 7fe8dcb9b700 1 -- 172.21.15.84:0/779948561 learned_addr learned my addr 172.21.15.84:0/779948561 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:19.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.552+0000 7fe8dcb9b700 1 -- 172.21.15.84:0/779948561 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8d815c6c0 msgr2=0x7fe8d80ca610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:19.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.552+0000 7fe8dcb9b700 1 --2- 172.21.15.84:0/779948561 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8d815c6c0 0x7fe8d80ca610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:19.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.552+0000 7fe8dcb9b700 1 -- 172.21.15.84:0/779948561 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8d80b30b0 msgr2=0x7fe8d81f63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:19.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.552+0000 7fe8dcb9b700 1 --2- 172.21.15.84:0/779948561 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8d80b30b0 0x7fe8d81f63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:19.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.552+0000 7fe8dcb9b700 1 -- 172.21.15.84:0/779948561 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8cc0094a0 con 0x7fe8d80afc40 2023-07-14T11:17:19.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.552+0000 7fe8dcb9b700 1 --2- 172.21.15.84:0/779948561 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8d80afc40 0x7fe8d8159b30 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc009b90 tx=0x7fe8cc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:19.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.552+0000 7fe8d57fa700 1 -- 172.21.15.84:0/779948561 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8cc0036a0 con 0x7fe8d80afc40 2023-07-14T11:17:19.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.552+0000 7fe8d57fa700 1 -- 172.21.15.84:0/779948561 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8cc01f070 con 0x7fe8d80afc40 2023-07-14T11:17:19.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.552+0000 7fe8dedff700 1 -- 172.21.15.84:0/779948561 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8d815a4a0 con 0x7fe8d80afc40 2023-07-14T11:17:19.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.552+0000 7fe8d57fa700 1 -- 172.21.15.84:0/779948561 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8cc003a40 con 0x7fe8d80afc40 2023-07-14T11:17:19.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.552+0000 7fe8dedff700 1 -- 172.21.15.84:0/779948561 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8d815aa60 con 0x7fe8d80afc40 2023-07-14T11:17:19.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.555+0000 7fe8d57fa700 1 -- 172.21.15.84:0/779948561 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 9) v1 ==== 89190+0+0 (secure 0 0 0) 0x7fe8cc003ba0 con 0x7fe8d80afc40 2023-07-14T11:17:19.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.556+0000 7fe8d57fa700 1 --2- 172.21.15.84:0/779948561 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe8bc06ae90 0x7fe8bc06d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:19.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.556+0000 7fe8d57fa700 1 -- 172.21.15.84:0/779948561 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe8cc021070 con 0x7fe8d80afc40 2023-07-14T11:17:19.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.556+0000 7fe8d7fff700 1 --2- 172.21.15.84:0/779948561 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe8bc06ae90 0x7fe8bc06d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:19.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.557+0000 7fe8d7fff700 1 --2- 172.21.15.84:0/779948561 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe8bc06ae90 0x7fe8bc06d340 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fe8c4006fd0 tx=0x7fe8c4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:19.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.558+0000 7fe8f2740b80 1 Processor -- start 2023-07-14T11:17:19.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.558+0000 7fe8f2740b80 1 -- start start 2023-07-14T11:17:19.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.559+0000 7fe8f2740b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f47f0d9880 0x55f47f1095e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:19.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.559+0000 7fe8f2740b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f47f0dbdc0 0x55f47f109b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:19.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.559+0000 7fe8f2740b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f47f0d9c50 0x55f47f0f4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:19.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.559+0000 7fe8f2740b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f47f053ea0 con 0x55f47f0d9c50 2023-07-14T11:17:19.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.559+0000 7fe8f2740b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f47efc7600 con 0x55f47f0d9880 2023-07-14T11:17:19.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.559+0000 7fe8f2740b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f47f036910 con 0x55f47f0dbdc0 2023-07-14T11:17:19.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.559+0000 7fe8dd39c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f47f0d9c50 0x55f47f0f4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:19.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.559+0000 7fe8dd39c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f47f0d9c50 0x55f47f0f4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58928/0 (socket says 172.21.15.84:58928) 2023-07-14T11:17:19.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.559+0000 7fe8dd39c700 1 -- 172.21.15.84:0/1691817450 learned_addr learned my addr 172.21.15.84:0/1691817450 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:19.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.559+0000 7fe8dcb9b700 1 --2- 172.21.15.84:0/1691817450 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f47f0d9880 0x55f47f1095e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:19.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.559+0000 7fe8d7fff700 1 --2- 172.21.15.84:0/1691817450 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f47f0dbdc0 0x55f47f109b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:19.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.560+0000 7fe8dd39c700 1 -- 172.21.15.84:0/1691817450 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f47f0dbdc0 msgr2=0x55f47f109b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:19.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.560+0000 7fe8dd39c700 1 --2- 172.21.15.84:0/1691817450 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f47f0dbdc0 0x55f47f109b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:19.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.560+0000 7fe8dd39c700 1 -- 172.21.15.84:0/1691817450 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f47f0d9880 msgr2=0x55f47f1095e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:19.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.560+0000 7fe8dd39c700 1 --2- 172.21.15.84:0/1691817450 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f47f0d9880 0x55f47f1095e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:19.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.560+0000 7fe8dd39c700 1 -- 172.21.15.84:0/1691817450 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f47ee23790 con 0x55f47f0d9c50 2023-07-14T11:17:19.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.560+0000 7fe8dd39c700 1 --2- 172.21.15.84:0/1691817450 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f47f0d9c50 0x55f47f0f4120 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fe8d0002150 tx=0x7fe8d000c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15d087ce03c60393 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:19.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.560+0000 7fe8c27fc700 1 -- 172.21.15.84:0/1691817450 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d000cea0 con 0x55f47f0d9c50 2023-07-14T11:17:19.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.560+0000 7fe8c27fc700 1 -- 172.21.15.84:0/1691817450 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d0012400 con 0x55f47f0d9c50 2023-07-14T11:17:19.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.560+0000 7fe8c27fc700 1 -- 172.21.15.84:0/1691817450 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d0012770 con 0x55f47f0d9c50 2023-07-14T11:17:19.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.561+0000 7fe8f2740b80 1 -- 172.21.15.84:0/1691817450 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f47f0d9c50 msgr2=0x55f47f0f4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:19.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.561+0000 7fe8f2740b80 1 --2- 172.21.15.84:0/1691817450 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f47f0d9c50 0x55f47f0f4120 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fe8d0002150 tx=0x7fe8d000c3c0 comp rx=0 tx=0).stop 2023-07-14T11:17:19.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.561+0000 7fe8f2740b80 1 -- 172.21.15.84:0/1691817450 shutdown_connections 2023-07-14T11:17:19.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.561+0000 7fe8f2740b80 1 --2- 172.21.15.84:0/1691817450 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f47f0d9c50 0x55f47f0f4120 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:19.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.561+0000 7fe8f2740b80 1 --2- 172.21.15.84:0/1691817450 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f47f0d9880 0x55f47f1095e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:19.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.561+0000 7fe8f2740b80 1 --2- 172.21.15.84:0/1691817450 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f47f0dbdc0 0x55f47f109b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:19.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.561+0000 7fe8f2740b80 1 -- 172.21.15.84:0/1691817450 >> 172.21.15.84:0/1691817450 conn(0x55f47f0d43b0 msgr2=0x55f47f0df550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:19.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.561+0000 7fe8f2740b80 1 -- 172.21.15.84:0/1691817450 shutdown_connections 2023-07-14T11:17:19.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.561+0000 7fe8f2740b80 1 -- 172.21.15.84:0/1691817450 wait complete. 2023-07-14T11:17:19.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.562+0000 7fe8f2740b80 1 -- start start 2023-07-14T11:17:19.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.562+0000 7fe8f2740b80 1 Processor -- start 2023-07-14T11:17:19.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.563+0000 7fe8f2740b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f47f0d9880 0x55f47f10ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:19.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.563+0000 7fe8f2740b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f47f0d9c50 0x55f47f0f0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:19.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.563+0000 7fe8f2740b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f47f0dbdc0 0x55f47f127530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:19.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.563+0000 7fe8f2740b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f47f02fbe0 con 0x55f47f0d9880 2023-07-14T11:17:19.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.563+0000 7fe8f2740b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f47efed5b0 con 0x55f47f0d9c50 2023-07-14T11:17:19.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.563+0000 7fe8f2740b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f47efd3910 con 0x55f47f0dbdc0 2023-07-14T11:17:19.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.563+0000 7fe8f2740b80 10 client.0 _ll_register_callbacks cb 0x55f47efebb70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T11:17:19.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.563+0000 7fe8dcb9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f47f0d9880 0x55f47f10ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:19.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.563+0000 7fe8dcb9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f47f0d9880 0x55f47f10ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58938/0 (socket says 172.21.15.84:58938) 2023-07-14T11:17:19.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.563+0000 7fe8dcb9b700 1 -- 172.21.15.84:0/3400453195 learned_addr learned my addr 172.21.15.84:0/3400453195 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:19.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.563+0000 7fe8d7fff700 1 --2- 172.21.15.84:0/3400453195 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f47f0d9c50 0x55f47f0f0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:19.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.563+0000 7fe8dd39c700 1 --2- 172.21.15.84:0/3400453195 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f47f0dbdc0 0x55f47f127530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:19.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.563+0000 7fe8dcb9b700 1 -- 172.21.15.84:0/3400453195 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f47f0dbdc0 msgr2=0x55f47f127530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:19.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.563+0000 7fe8dcb9b700 1 --2- 172.21.15.84:0/3400453195 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f47f0dbdc0 0x55f47f127530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:19.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.563+0000 7fe8dcb9b700 1 -- 172.21.15.84:0/3400453195 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f47f0d9c50 msgr2=0x55f47f0f0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:19.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.563+0000 7fe8dcb9b700 1 --2- 172.21.15.84:0/3400453195 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f47f0d9c50 0x55f47f0f0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:19.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.563+0000 7fe8dcb9b700 1 -- 172.21.15.84:0/3400453195 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8d0001d70 con 0x55f47f0d9880 2023-07-14T11:17:19.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.563+0000 7fe8dd39c700 1 --2- 172.21.15.84:0/3400453195 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f47f0dbdc0 0x55f47f127530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:17:19.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.564+0000 7fe8dcb9b700 1 --2- 172.21.15.84:0/3400453195 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f47f0d9880 0x55f47f10ce60 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc009390 tx=0x7fe8cc062050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb14c3fe344fb6c0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:19.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.564+0000 7fe8b77fe700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-07-14T11:17:19.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.564+0000 7fe8b77fe700 1 -- 172.21.15.84:0/3400453195 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8cc089630 con 0x55f47f0d9880 2023-07-14T11:17:19.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.564+0000 7fe8b77fe700 1 -- 172.21.15.84:0/3400453195 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(63..63 src has 1..63) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe8cc05d030 con 0x55f47f0d9880 2023-07-14T11:17:19.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.564+0000 7fe8f2740b80 1 -- 172.21.15.84:0/3400453195 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f47f0d19c0 con 0x55f47f0d9880 2023-07-14T11:17:19.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.564+0000 7fe8b77fe700 1 -- 172.21.15.84:0/3400453195 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe8cc071170 con 0x55f47f0d9880 2023-07-14T11:17:19.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.564+0000 7fe8f2740b80 10 client.6336 fetch_fsmap learned FSMap version 37 2023-07-14T11:17:19.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.564+0000 7fe8f2740b80 1 -- 172.21.15.84:0/3400453195 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) v3 -- 0x55f47ef100a0 con 0x55f47f0d9880 2023-07-14T11:17:19.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.564+0000 7fe8b77fe700 1 -- 172.21.15.84:0/3400453195 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f47f0d19c0 con 0x55f47f0d9880 2023-07-14T11:17:19.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.564+0000 7fe8b77fe700 1 -- 172.21.15.84:0/3400453195 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 37) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fe8cc0712d0 con 0x55f47f0d9880 2023-07-14T11:17:19.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.564+0000 7fe8f2740b80 10 client.6336 fetch_fsmap finished waiting for FSMap version 37 2023-07-14T11:17:19.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.564+0000 7fe8f2740b80 10 client.6336 resolve_mds: resolved name 'd' to daemon mds.d 2023-07-14T11:17:19.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.564+0000 7fe8f2740b80 20 client.6336 populate_metadata read hostname 'smithi084' 2023-07-14T11:17:19.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.564+0000 7fe8f2740b80 1 --2- 172.21.15.84:0/3400453195 >> [v2:172.21.15.179:6833/3902238230,v1:172.21.15.179:6835/3902238230] conn(0x55f47f10ad50 0x55f47f10b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:19.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.564+0000 7fe8f2740b80 4 client.6336 mds_command: new command op to 6174 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T11:17:19.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.564+0000 7fe8f2740b80 1 -- 172.21.15.84:0/3400453195 --> [v2:172.21.15.179:6833/3902238230,v1:172.21.15.179:6835/3902238230] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f47f0ae170 con 0x55f47f10ad50 2023-07-14T11:17:19.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.565+0000 7fe8d7fff700 1 --2- 172.21.15.84:0/3400453195 >> [v2:172.21.15.179:6833/3902238230,v1:172.21.15.179:6835/3902238230] conn(0x55f47f10ad50 0x55f47f10b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:19.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.565+0000 7fe8b77fe700 10 client.6336 ms_handle_connect on v2:172.21.15.179:6833/3902238230 2023-07-14T11:17:19.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.565+0000 7fe8d7fff700 1 --2- 172.21.15.84:0/3400453195 >> [v2:172.21.15.179:6833/3902238230,v1:172.21.15.179:6835/3902238230] conn(0x55f47f10ad50 0x55f47f10b120 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2b103e11c2afcb4 server_cookie=97bc61754255b3a7 in_seq=0 out_seq=0 2023-07-14T11:17:19.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.566+0000 7fe8b77fe700 1 -- 172.21.15.84:0/3400453195 <== mds.0 v2:172.21.15.179:6833/3902238230 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55f47f0ae170 con 0x55f47f10ad50 2023-07-14T11:17:19.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.567+0000 7fe8b77fe700 10 client.6336 handle_command_reply: tid=0 2023-07-14T11:17:19.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.567+0000 7fe8f2740b80 1 client.6336 shutdown 2023-07-14T11:17:19.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.567+0000 7fe8f2740b80 1 -- 172.21.15.84:0/3400453195 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f47f0d9880 msgr2=0x55f47f10ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:19.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.567+0000 7fe8f2740b80 1 --2- 172.21.15.84:0/3400453195 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f47f0d9880 0x55f47f10ce60 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc009390 tx=0x7fe8cc062050 comp rx=0 tx=0).stop 2023-07-14T11:17:19.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.567+0000 7fe8f2740b80 1 -- 172.21.15.84:0/3400453195 shutdown_connections 2023-07-14T11:17:19.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.567+0000 7fe8f2740b80 1 --2- 172.21.15.84:0/3400453195 >> [v2:172.21.15.179:6833/3902238230,v1:172.21.15.179:6835/3902238230] conn(0x55f47f10ad50 0x55f47f10b120 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:19.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.567+0000 7fe8f2740b80 1 --2- 172.21.15.84:0/3400453195 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f47f0dbdc0 0x55f47f127530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:19.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.567+0000 7fe8f2740b80 1 --2- 172.21.15.84:0/3400453195 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f47f0d9880 0x55f47f10ce60 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:19.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.567+0000 7fe8f2740b80 1 --2- 172.21.15.84:0/3400453195 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f47f0d9c50 0x55f47f0f0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:19.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.567+0000 7fe8b77fe700 0 client.6336 ms_handle_reset on v2:172.21.15.179:6833/3902238230 2023-07-14T11:17:19.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.567+0000 7fe8f2740b80 1 -- 172.21.15.84:0/3400453195 >> 172.21.15.84:0/3400453195 conn(0x55f47f0d43b0 msgr2=0x55f47f0ded50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:19.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.567+0000 7fe8f2740b80 1 -- 172.21.15.84:0/3400453195 shutdown_connections 2023-07-14T11:17:19.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.567+0000 7fe8f2740b80 1 -- 172.21.15.84:0/3400453195 wait complete. 2023-07-14T11:17:19.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.567+0000 7fe8f2740b80 20 client.6336 trim_cache size 0 max 16384 2023-07-14T11:17:19.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.585+0000 7fe8f2740b80 1 Processor -- start 2023-07-14T11:17:19.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.585+0000 7fe8f2740b80 1 -- start start 2023-07-14T11:17:19.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.586+0000 7fe8f2740b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f47f0d9880 0x55f47f0daae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:19.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.586+0000 7fe8f2740b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f47f0d9c50 0x55f47f0f50a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:19.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.586+0000 7fe8f2740b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f47f0dbdc0 0x55f47f11cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:19.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.586+0000 7fe8f2740b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f47ee24390 con 0x55f47f0d9880 2023-07-14T11:17:19.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.586+0000 7fe8f2740b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f47f0db1a0 con 0x55f47f0d9c50 2023-07-14T11:17:19.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.586+0000 7fe8f2740b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f47f0e0e10 con 0x55f47f0dbdc0 2023-07-14T11:17:19.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.586+0000 7fe8dcb9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f47f0d9880 0x55f47f0daae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:19.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.586+0000 7fe8dcb9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f47f0d9880 0x55f47f0daae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58942/0 (socket says 172.21.15.84:58942) 2023-07-14T11:17:19.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.586+0000 7fe8dcb9b700 1 -- 172.21.15.84:0/3560583288 learned_addr learned my addr 172.21.15.84:0/3560583288 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:19.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.587+0000 7fe8dcb9b700 1 -- 172.21.15.84:0/3560583288 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f47f0dbdc0 msgr2=0x55f47f11cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:19.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.587+0000 7fe8dcb9b700 1 --2- 172.21.15.84:0/3560583288 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f47f0dbdc0 0x55f47f11cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:19.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.587+0000 7fe8dcb9b700 1 -- 172.21.15.84:0/3560583288 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f47f0d9c50 msgr2=0x55f47f0f50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:19.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.587+0000 7fe8dcb9b700 1 --2- 172.21.15.84:0/3560583288 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f47f0d9c50 0x55f47f0f50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:19.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.587+0000 7fe8dcb9b700 1 -- 172.21.15.84:0/3560583288 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f47eff5b10 con 0x55f47f0d9880 2023-07-14T11:17:19.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.587+0000 7fe8dcb9b700 1 --2- 172.21.15.84:0/3560583288 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f47f0d9880 0x55f47f0daae0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc059a00 tx=0x7fe8cc06f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d636881b536cd6ab server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:19.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.587+0000 7fe8c2ffd700 1 -- 172.21.15.84:0/3560583288 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8cc071370 con 0x55f47f0d9880 2023-07-14T11:17:19.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.587+0000 7fe8c2ffd700 1 -- 172.21.15.84:0/3560583288 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8cc0892e0 con 0x55f47f0d9880 2023-07-14T11:17:19.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.587+0000 7fe8c2ffd700 1 -- 172.21.15.84:0/3560583288 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8cc089650 con 0x55f47f0d9880 2023-07-14T11:17:19.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.588+0000 7fe8f2740b80 1 -- 172.21.15.84:0/3560583288 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f47f0d9880 msgr2=0x55f47f0daae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:19.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.588+0000 7fe8f2740b80 1 --2- 172.21.15.84:0/3560583288 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f47f0d9880 0x55f47f0daae0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc059a00 tx=0x7fe8cc06f000 comp rx=0 tx=0).stop 2023-07-14T11:17:19.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.588+0000 7fe8f2740b80 1 -- 172.21.15.84:0/3560583288 shutdown_connections 2023-07-14T11:17:19.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.588+0000 7fe8f2740b80 1 --2- 172.21.15.84:0/3560583288 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f47f0dbdc0 0x55f47f11cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:19.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.588+0000 7fe8f2740b80 1 --2- 172.21.15.84:0/3560583288 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f47f0d9880 0x55f47f0daae0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:19.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.588+0000 7fe8f2740b80 1 --2- 172.21.15.84:0/3560583288 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f47f0d9c50 0x55f47f0f50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:19.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.588+0000 7fe8f2740b80 1 -- 172.21.15.84:0/3560583288 >> 172.21.15.84:0/3560583288 conn(0x55f47f0d43b0 msgr2=0x55f47f0df520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:19.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.588+0000 7fe8f2740b80 1 -- 172.21.15.84:0/3560583288 shutdown_connections 2023-07-14T11:17:19.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.588+0000 7fe8f2740b80 1 -- 172.21.15.84:0/3560583288 wait complete. 2023-07-14T11:17:19.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.588+0000 7fe8f2740b80 1 -- start start 2023-07-14T11:17:19.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.589+0000 7fe8f2740b80 1 Processor -- start 2023-07-14T11:17:19.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.589+0000 7fe8f2740b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f47f0d9880 0x55f47f0f3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:19.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.589+0000 7fe8f2740b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f47f0d9c50 0x55f47f1059a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:19.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.590+0000 7fe8f2740b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f47f0dbdc0 0x55f47f1363d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:19.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.590+0000 7fe8f2740b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f47f0f57c0 con 0x55f47f0dbdc0 2023-07-14T11:17:19.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.590+0000 7fe8f2740b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f47f105ee0 con 0x55f47f0d9c50 2023-07-14T11:17:19.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.590+0000 7fe8f2740b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f47f0f5290 con 0x55f47f0d9880 2023-07-14T11:17:19.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.590+0000 7fe8f2740b80 10 client.0 _ll_register_callbacks cb 0x7fe8cc059750 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T11:17:19.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.590+0000 7fe8dd39c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f47f0dbdc0 0x55f47f1363d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:19.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.590+0000 7fe8dd39c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f47f0dbdc0 0x55f47f1363d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58956/0 (socket says 172.21.15.84:58956) 2023-07-14T11:17:19.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.590+0000 7fe8dd39c700 1 -- 172.21.15.84:0/2715868499 learned_addr learned my addr 172.21.15.84:0/2715868499 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:19.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.590+0000 7fe8dcb9b700 1 --2- 172.21.15.84:0/2715868499 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f47f0d9880 0x55f47f0f3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:19.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.590+0000 7fe8d7fff700 1 --2- 172.21.15.84:0/2715868499 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f47f0d9c50 0x55f47f1059a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:19.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.590+0000 7fe8dd39c700 1 -- 172.21.15.84:0/2715868499 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f47f0d9880 msgr2=0x55f47f0f3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:19.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.590+0000 7fe8dd39c700 1 --2- 172.21.15.84:0/2715868499 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f47f0d9880 0x55f47f0f3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:19.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.590+0000 7fe8dd39c700 1 -- 172.21.15.84:0/2715868499 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f47f0d9c50 msgr2=0x55f47f1059a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:19.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.590+0000 7fe8dd39c700 1 --2- 172.21.15.84:0/2715868499 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f47f0d9c50 0x55f47f1059a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:19.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.590+0000 7fe8dd39c700 1 -- 172.21.15.84:0/2715868499 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f47ef100a0 con 0x55f47f0dbdc0 2023-07-14T11:17:19.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.591+0000 7fe8dd39c700 1 --2- 172.21.15.84:0/2715868499 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f47f0dbdc0 0x55f47f1363d0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fe8d000c0b0 tx=0x7fe8d00014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6334a5659ddc6dd8 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:19.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.591+0000 7fe8b77fe700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-07-14T11:17:19.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.591+0000 7fe8b77fe700 1 -- 172.21.15.84:0/2715868499 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d0012980 con 0x55f47f0dbdc0 2023-07-14T11:17:19.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.591+0000 7fe8f2740b80 1 -- 172.21.15.84:0/2715868499 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe8d0012400 con 0x55f47f0dbdc0 2023-07-14T11:17:19.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.591+0000 7fe8b77fe700 1 -- 172.21.15.84:0/2715868499 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(63..63 src has 1..63) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe8d0012ae0 con 0x55f47f0dbdc0 2023-07-14T11:17:19.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.591+0000 7fe8b77fe700 1 -- 172.21.15.84:0/2715868499 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe8d0012ca0 con 0x55f47f0dbdc0 2023-07-14T11:17:19.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.591+0000 7fe8f2740b80 10 client.6342 fetch_fsmap learned FSMap version 37 2023-07-14T11:17:19.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.591+0000 7fe8f2740b80 1 -- 172.21.15.84:0/2715868499 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) v3 -- 0x55f47ee841d0 con 0x55f47f0dbdc0 2023-07-14T11:17:19.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.591+0000 7fe8b77fe700 1 -- 172.21.15.84:0/2715868499 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d0012400 con 0x55f47f0dbdc0 2023-07-14T11:17:19.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.591+0000 7fe8b77fe700 1 -- 172.21.15.84:0/2715868499 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 37) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fe8d001d3f0 con 0x55f47f0dbdc0 2023-07-14T11:17:19.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.591+0000 7fe8f2740b80 10 client.6342 fetch_fsmap finished waiting for FSMap version 37 2023-07-14T11:17:19.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.591+0000 7fe8f2740b80 10 client.6342 resolve_mds: resolved name 'd' to daemon mds.d 2023-07-14T11:17:19.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.591+0000 7fe8f2740b80 20 client.6342 populate_metadata read hostname 'smithi084' 2023-07-14T11:17:19.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.591+0000 7fe8f2740b80 1 --2- 172.21.15.84:0/2715868499 >> [v2:172.21.15.179:6833/3902238230,v1:172.21.15.179:6835/3902238230] conn(0x55f47f18b4d0 0x55f47f18b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:19.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.591+0000 7fe8f2740b80 4 client.6342 mds_command: new command op to 6174 tid=0[{"prefix": "status"}] 2023-07-14T11:17:19.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.591+0000 7fe8f2740b80 1 -- 172.21.15.84:0/2715868499 --> [v2:172.21.15.179:6833/3902238230,v1:172.21.15.179:6835/3902238230] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f47f028d20 con 0x55f47f18b4d0 2023-07-14T11:17:19.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.592+0000 7fe8dcb9b700 1 --2- 172.21.15.84:0/2715868499 >> [v2:172.21.15.179:6833/3902238230,v1:172.21.15.179:6835/3902238230] conn(0x55f47f18b4d0 0x55f47f18b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:19.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.592+0000 7fe8dcb9b700 1 --2- 172.21.15.84:0/2715868499 >> [v2:172.21.15.179:6833/3902238230,v1:172.21.15.179:6835/3902238230] conn(0x55f47f18b4d0 0x55f47f18b8a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2112a366190112b5 server_cookie=b051f0e0e5f58617 in_seq=0 out_seq=0 2023-07-14T11:17:19.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.592+0000 7fe8b77fe700 10 client.6342 ms_handle_connect on v2:172.21.15.179:6833/3902238230 2023-07-14T11:17:19.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.592+0000 7fe8b77fe700 1 -- 172.21.15.84:0/2715868499 <== mds.0 v2:172.21.15.179:6833/3902238230 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55f47f028d20 con 0x55f47f18b4d0 2023-07-14T11:17:19.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.592+0000 7fe8b77fe700 10 client.6342 handle_command_reply: tid=0 2023-07-14T11:17:19.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.593+0000 7fe8f2740b80 1 client.6342 shutdown 2023-07-14T11:17:19.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.593+0000 7fe8f2740b80 1 -- 172.21.15.84:0/2715868499 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f47f0dbdc0 msgr2=0x55f47f1363d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:19.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.593+0000 7fe8f2740b80 1 --2- 172.21.15.84:0/2715868499 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f47f0dbdc0 0x55f47f1363d0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fe8d000c0b0 tx=0x7fe8d00014a0 comp rx=0 tx=0).stop 2023-07-14T11:17:19.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.593+0000 7fe8f2740b80 1 -- 172.21.15.84:0/2715868499 shutdown_connections 2023-07-14T11:17:19.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.593+0000 7fe8f2740b80 1 --2- 172.21.15.84:0/2715868499 >> [v2:172.21.15.179:6833/3902238230,v1:172.21.15.179:6835/3902238230] conn(0x55f47f18b4d0 0x55f47f18b8a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:19.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.593+0000 7fe8f2740b80 1 --2- 172.21.15.84:0/2715868499 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f47f0d9880 0x55f47f0f3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:19.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.593+0000 7fe8f2740b80 1 --2- 172.21.15.84:0/2715868499 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f47f0dbdc0 0x55f47f1363d0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:19.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.593+0000 7fe8b77fe700 0 client.6342 ms_handle_reset on v2:172.21.15.179:6833/3902238230 2023-07-14T11:17:19.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.593+0000 7fe8f2740b80 1 --2- 172.21.15.84:0/2715868499 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f47f0d9c50 0x55f47f1059a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:19.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.593+0000 7fe8f2740b80 1 -- 172.21.15.84:0/2715868499 >> 172.21.15.84:0/2715868499 conn(0x55f47f0d43b0 msgr2=0x55f47f0d5920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:19.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.593+0000 7fe8f2740b80 1 -- 172.21.15.84:0/2715868499 shutdown_connections 2023-07-14T11:17:19.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.593+0000 7fe8f2740b80 1 -- 172.21.15.84:0/2715868499 wait complete. 2023-07-14T11:17:19.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.593+0000 7fe8f2740b80 20 client.6342 trim_cache size 0 max 16384 2023-07-14T11:17:19.603 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-07-14T11:17:19.604 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f", 2023-07-14T11:17:19.604 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 0, 2023-07-14T11:17:19.604 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 6174, 2023-07-14T11:17:19.604 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2023-07-14T11:17:19.604 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2023-07-14T11:17:19.604 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2023-07-14T11:17:19.604 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 6.5136104819999998, 2023-07-14T11:17:19.605 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 37, 2023-07-14T11:17:19.605 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 63, 2023-07-14T11:17:19.605 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 63, 2023-07-14T11:17:19.605 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 12.033761542000001 2023-07-14T11:17:19.605 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-07-14T11:17:19.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.594+0000 7fe8dedff700 1 -- 172.21.15.84:0/779948561 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe8bc06ae90 msgr2=0x7fe8bc06d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:19.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.594+0000 7fe8dedff700 1 --2- 172.21.15.84:0/779948561 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe8bc06ae90 0x7fe8bc06d340 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fe8c4006fd0 tx=0x7fe8c4008040 comp rx=0 tx=0).stop 2023-07-14T11:17:19.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.594+0000 7fe8dedff700 1 -- 172.21.15.84:0/779948561 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8d80afc40 msgr2=0x7fe8d8159b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:19.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.594+0000 7fe8dedff700 1 --2- 172.21.15.84:0/779948561 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8d80afc40 0x7fe8d8159b30 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc009b90 tx=0x7fe8cc004750 comp rx=0 tx=0).stop 2023-07-14T11:17:19.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.594+0000 7fe8dedff700 1 -- 172.21.15.84:0/779948561 shutdown_connections 2023-07-14T11:17:19.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.594+0000 7fe8dedff700 1 --2- 172.21.15.84:0/779948561 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe8bc06ae90 0x7fe8bc06d340 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:19.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.594+0000 7fe8dedff700 1 --2- 172.21.15.84:0/779948561 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8d815c6c0 0x7fe8d80ca610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:19.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.594+0000 7fe8dedff700 1 --2- 172.21.15.84:0/779948561 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8d80afc40 0x7fe8d8159b30 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:19.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.594+0000 7fe8dedff700 1 --2- 172.21.15.84:0/779948561 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8d80b30b0 0x7fe8d81f63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:19.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.594+0000 7fe8dedff700 1 -- 172.21.15.84:0/779948561 >> 172.21.15.84:0/779948561 conn(0x7fe8d806d980 msgr2=0x7fe8d806b780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:19.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.594+0000 7fe8dedff700 1 -- 172.21.15.84:0/779948561 shutdown_connections 2023-07-14T11:17:19.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.594+0000 7fe8dedff700 1 -- 172.21.15.84:0/779948561 wait complete. 2023-07-14T11:17:19.613 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-14T11:17:19.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.805+0000 7f011cdff700 1 Processor -- start 2023-07-14T11:17:19.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.806+0000 7f011cdff700 1 -- start start 2023-07-14T11:17:19.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.807+0000 7f011cdff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f011815c950 0x7f01180b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:19.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.807+0000 7f011cdff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01180d2ce0 con 0x7f01180b1e00 2023-07-14T11:17:19.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.807+0000 7f011cdff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01180b3350 con 0x7f01180d1220 2023-07-14T11:17:19.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.807+0000 7f011cdff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01180b3630 con 0x7f011815c950 2023-07-14T11:17:19.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.807+0000 7f010ffff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f01180b1e00 0x7f01180d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:35802/0 (socket says 172.21.15.84:35802) 2023-07-14T11:17:19.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.807+0000 7f010ffff700 1 -- 172.21.15.84:0/2348306175 learned_addr learned my addr 172.21.15.84:0/2348306175 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:17:19.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.807+0000 7f011659c700 1 --2- 172.21.15.84:0/2348306175 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f011815c950 0x7f01180b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:19.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.807+0000 7f0115d9b700 1 -- 172.21.15.84:0/2348306175 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2440786392 0 0) 0x7f01180d2ce0 con 0x7f01180b1e00 2023-07-14T11:17:19.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.807+0000 7f0115d9b700 1 -- 172.21.15.84:0/2348306175 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01040035b0 con 0x7f01180b1e00 2023-07-14T11:17:19.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.808+0000 7f0115d9b700 1 -- 172.21.15.84:0/2348306175 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2069374209 0 0) 0x7f01040035b0 con 0x7f01180b1e00 2023-07-14T11:17:19.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.808+0000 7f0115d9b700 1 -- 172.21.15.84:0/2348306175 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f011815c950 msgr2=0x7f01180b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:19.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.808+0000 7f0115d9b700 1 --2- 172.21.15.84:0/2348306175 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f011815c950 0x7f01180b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:19.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.808+0000 7f0115d9b700 1 -- 172.21.15.84:0/2348306175 >> v1:172.21.15.179:6789/0 conn(0x7f01180d1220 legacy=0x7f01180afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:19.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.808+0000 7f0115d9b700 1 -- 172.21.15.84:0/2348306175 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01180b3910 con 0x7f01180b1e00 2023-07-14T11:17:19.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.808+0000 7f0115d9b700 1 -- 172.21.15.84:0/2348306175 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7f0100001670 con 0x7f01180b1e00 2023-07-14T11:17:19.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.808+0000 7f0115d9b700 1 -- 172.21.15.84:0/2348306175 >> v1:172.21.15.84:6789/0 conn(0x7f01180b1e00 legacy=0x7f01180d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:19.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.808+0000 7f0115d9b700 1 --2- 172.21.15.84:0/2348306175 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0104003a30 0x7f0104003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:19.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.808+0000 7f0115d9b700 1 --2- 172.21.15.84:0/2348306175 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f011815c950 0x7f0104004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:19.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.808+0000 7f0115d9b700 1 --2- 172.21.15.84:0/2348306175 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0104004d90 0x7f0104005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:19.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.808+0000 7f0115d9b700 1 -- 172.21.15.84:0/2348306175 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01180b3630 con 0x7f0104004d90 2023-07-14T11:17:19.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.808+0000 7f0115d9b700 1 -- 172.21.15.84:0/2348306175 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f010400bb10 con 0x7f0104003a30 2023-07-14T11:17:19.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.808+0000 7f0115d9b700 1 -- 172.21.15.84:0/2348306175 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f010400bcd0 con 0x7f011815c950 2023-07-14T11:17:19.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.808+0000 7f0116d9d700 1 --2- 172.21.15.84:0/2348306175 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0104004d90 0x7f0104005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:19.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.808+0000 7f011659c700 1 --2- 172.21.15.84:0/2348306175 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0104003a30 0x7f0104003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:19.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.808+0000 7f010ffff700 1 --2- 172.21.15.84:0/2348306175 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f011815c950 0x7f0104004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:19.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.809+0000 7f0116d9d700 1 -- 172.21.15.84:0/2348306175 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f011815c950 msgr2=0x7f0104004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:19.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.809+0000 7f0116d9d700 1 --2- 172.21.15.84:0/2348306175 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f011815c950 0x7f0104004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:19.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.809+0000 7f0116d9d700 1 -- 172.21.15.84:0/2348306175 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0104003a30 msgr2=0x7f0104003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:19.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.809+0000 7f0116d9d700 1 --2- 172.21.15.84:0/2348306175 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0104003a30 0x7f0104003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:19.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.809+0000 7f0116d9d700 1 -- 172.21.15.84:0/2348306175 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01040035b0 con 0x7f0104004d90 2023-07-14T11:17:19.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.809+0000 7f0116d9d700 1 --2- 172.21.15.84:0/2348306175 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0104004d90 0x7f0104005200 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f0110001dd0 tx=0x7f0104005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64eebfebd93aac59 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:19.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.809+0000 7f0115d9b700 1 -- 172.21.15.84:0/2348306175 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0110001870 con 0x7f0104004d90 2023-07-14T11:17:19.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.809+0000 7f0115d9b700 1 -- 172.21.15.84:0/2348306175 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0110003c20 con 0x7f0104004d90 2023-07-14T11:17:19.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.809+0000 7f0115d9b700 1 -- 172.21.15.84:0/2348306175 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01100050d0 con 0x7f0104004d90 2023-07-14T11:17:19.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.810+0000 7f011cdff700 1 -- 172.21.15.84:0/2348306175 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0104004d90 msgr2=0x7f0104005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:19.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.810+0000 7f011cdff700 1 --2- 172.21.15.84:0/2348306175 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0104004d90 0x7f0104005200 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f0110001dd0 tx=0x7f0104005880 comp rx=0 tx=0).stop 2023-07-14T11:17:19.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.810+0000 7f0116d9d700 1 -- 172.21.15.84:0/2348306175 reap_dead start 2023-07-14T11:17:19.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.810+0000 7f011cdff700 1 -- 172.21.15.84:0/2348306175 shutdown_connections 2023-07-14T11:17:19.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.810+0000 7f011cdff700 1 -- 172.21.15.84:0/2348306175 >> 172.21.15.84:0/2348306175 conn(0x7f011809c1d0 msgr2=0x7f01180d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:19.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.810+0000 7f011cdff700 1 -- 172.21.15.84:0/2348306175 shutdown_connections 2023-07-14T11:17:19.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.810+0000 7f011cdff700 1 -- 172.21.15.84:0/2348306175 wait complete. 2023-07-14T11:17:19.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.811+0000 7f011cdff700 1 Processor -- start 2023-07-14T11:17:19.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.812+0000 7f011cdff700 1 -- start start 2023-07-14T11:17:19.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.812+0000 7f011cdff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0104004d90 0x7f01181f1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:19.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.813+0000 7f011cdff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f011809f590 0x7f011809fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:19.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.813+0000 7f011cdff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f011809d650 0x7f011809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:19.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.813+0000 7f011cdff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01180a0c80 con 0x7f0104004d90 2023-07-14T11:17:19.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.813+0000 7f011cdff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f011814a830 con 0x7f011809f590 2023-07-14T11:17:19.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.813+0000 7f011cdff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f011809e000 con 0x7f011809d650 2023-07-14T11:17:19.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.813+0000 7f011659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0104004d90 0x7f01181f1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:19.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.813+0000 7f011659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0104004d90 0x7f01181f1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58970/0 (socket says 172.21.15.84:58970) 2023-07-14T11:17:19.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.813+0000 7f011659c700 1 -- 172.21.15.84:0/3520544438 learned_addr learned my addr 172.21.15.84:0/3520544438 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:19.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.813+0000 7f010ffff700 1 --2- 172.21.15.84:0/3520544438 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f011809f590 0x7f011809fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:19.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.813+0000 7f0116d9d700 1 --2- 172.21.15.84:0/3520544438 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f011809d650 0x7f011809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:19.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.813+0000 7f011659c700 1 -- 172.21.15.84:0/3520544438 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f011809d650 msgr2=0x7f011809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:19.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.813+0000 7f011659c700 1 --2- 172.21.15.84:0/3520544438 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f011809d650 0x7f011809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:19.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.813+0000 7f011659c700 1 -- 172.21.15.84:0/3520544438 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f011809f590 msgr2=0x7f011809fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:19.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.813+0000 7f011659c700 1 --2- 172.21.15.84:0/3520544438 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f011809f590 0x7f011809fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:19.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.813+0000 7f011659c700 1 -- 172.21.15.84:0/3520544438 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01180a0070 con 0x7f0104004d90 2023-07-14T11:17:19.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.813+0000 7f010ffff700 1 --2- 172.21.15.84:0/3520544438 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f011809f590 0x7f011809fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:17:19.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.813+0000 7f011659c700 1 --2- 172.21.15.84:0/3520544438 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0104004d90 0x7f01181f1da0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f01080119f0 tx=0x7f0108011db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:19.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.814+0000 7f010effd700 1 -- 172.21.15.84:0/3520544438 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0108005c30 con 0x7f0104004d90 2023-07-14T11:17:19.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.814+0000 7f010effd700 1 -- 172.21.15.84:0/3520544438 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0108005d90 con 0x7f0104004d90 2023-07-14T11:17:19.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.814+0000 7f010effd700 1 -- 172.21.15.84:0/3520544438 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f010800f950 con 0x7f0104004d90 2023-07-14T11:17:19.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.814+0000 7f011cdff700 1 -- 172.21.15.84:0/3520544438 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01180a0350 con 0x7f0104004d90 2023-07-14T11:17:19.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.814+0000 7f011cdff700 1 -- 172.21.15.84:0/3520544438 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01180a0910 con 0x7f0104004d90 2023-07-14T11:17:19.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.815+0000 7f011cdff700 1 -- 172.21.15.84:0/3520544438 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f011804e280 con 0x7f0104004d90 2023-07-14T11:17:19.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.816+0000 7f010effd700 1 -- 172.21.15.84:0/3520544438 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 9) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f010800fab0 con 0x7f0104004d90 2023-07-14T11:17:19.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.817+0000 7f010effd700 1 --2- 172.21.15.84:0/3520544438 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f00f806ae90 0x7f00f806d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:19.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.817+0000 7f010effd700 1 -- 172.21.15.84:0/3520544438 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0108089fc0 con 0x7f0104004d90 2023-07-14T11:17:19.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.817+0000 7f010ffff700 1 --2- 172.21.15.84:0/3520544438 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f00f806ae90 0x7f00f806d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:19.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.818+0000 7f010ffff700 1 --2- 172.21.15.84:0/3520544438 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f00f806ae90 0x7f00f806d340 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f01180b3050 tx=0x7f0100009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:19.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:19.821+0000 7f010effd700 1 -- 172.21.15.84:0/3520544438 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f0108054de0 con 0x7f0104004d90 2023-07-14T11:17:20.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:20.059+0000 7f011cdff700 1 -- 172.21.15.84:0/3520544438 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f011808c5a0 con 0x7f0104004d90 2023-07-14T11:17:20.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:20.059+0000 7f010effd700 1 -- 172.21.15.84:0/3520544438 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v37) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0108021070 con 0x7f0104004d90 2023-07-14T11:17:20.062 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-14T11:17:20.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:20.061+0000 7f011cdff700 1 -- 172.21.15.84:0/3520544438 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f00f806ae90 msgr2=0x7f00f806d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:20.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:20.061+0000 7f011cdff700 1 --2- 172.21.15.84:0/3520544438 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f00f806ae90 0x7f00f806d340 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f01180b3050 tx=0x7f0100009040 comp rx=0 tx=0).stop 2023-07-14T11:17:20.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:20.061+0000 7f011cdff700 1 -- 172.21.15.84:0/3520544438 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0104004d90 msgr2=0x7f01181f1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:20.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:20.061+0000 7f011cdff700 1 --2- 172.21.15.84:0/3520544438 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0104004d90 0x7f01181f1da0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f01080119f0 tx=0x7f0108011db0 comp rx=0 tx=0).stop 2023-07-14T11:17:20.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:20.062+0000 7f011cdff700 1 -- 172.21.15.84:0/3520544438 shutdown_connections 2023-07-14T11:17:20.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:20.062+0000 7f011cdff700 1 --2- 172.21.15.84:0/3520544438 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f00f806ae90 0x7f00f806d340 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:20.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:20.062+0000 7f011cdff700 1 --2- 172.21.15.84:0/3520544438 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f011809d650 0x7f011809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:20.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:20.062+0000 7f011cdff700 1 --2- 172.21.15.84:0/3520544438 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0104004d90 0x7f01181f1da0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:20.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:20.062+0000 7f011cdff700 1 --2- 172.21.15.84:0/3520544438 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f011809f590 0x7f011809fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:20.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:20.062+0000 7f011cdff700 1 -- 172.21.15.84:0/3520544438 >> 172.21.15.84:0/3520544438 conn(0x7f011809c1d0 msgr2=0x7f01180d2a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:20.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:20.062+0000 7f011cdff700 1 -- 172.21.15.84:0/3520544438 shutdown_connections 2023-07-14T11:17:20.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:20.062+0000 7f011cdff700 1 -- 172.21.15.84:0/3520544438 wait complete. 2023-07-14T11:17:20.082 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-14T11:17:20.083 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-14T11:17:20.083 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi084.front.sepia.ceph.com 2023-07-14T11:17:20.083 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-14T11:17:20.084 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-14T11:17:20.084 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-14T11:17:20.084 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-14T11:17:20.085 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-14T11:17:20.085 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-14T11:17:20.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:17:20.086 DEBUG:teuthology.orchestra.run.smithi084:> ip addr 2023-07-14T11:17:20.132 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-14T11:17:20.132 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-14T11:17:20.132 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2023-07-14T11:17:20.133 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:17:20.133 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2023-07-14T11:17:20.133 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:17:20.133 INFO:teuthology.orchestra.run.smithi084.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T11:17:20.133 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:68 brd ff:ff:ff:ff:ff:ff 2023-07-14T11:17:20.133 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f0 2023-07-14T11:17:20.134 INFO:teuthology.orchestra.run.smithi084.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T11:17:20.134 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:69 brd ff:ff:ff:ff:ff:ff 2023-07-14T11:17:20.134 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f1 2023-07-14T11:17:20.134 INFO:teuthology.orchestra.run.smithi084.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T11:17:20.134 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:50 brd ff:ff:ff:ff:ff:ff 2023-07-14T11:17:20.134 INFO:teuthology.orchestra.run.smithi084.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-14T11:17:20.134 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:51 brd ff:ff:ff:ff:ff:ff 2023-07-14T11:17:20.135 INFO:teuthology.orchestra.run.smithi084.stdout: inet 172.21.15.84/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-14T11:17:20.135 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft 41728sec preferred_lft 41728sec 2023-07-14T11:17:20.135 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::ec4:7aff:fe8f:d751/64 scope link 2023-07-14T11:17:20.135 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:17:20.135 INFO:teuthology.orchestra.run.smithi084.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-14T11:17:20.135 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 2e:15:90:61:8f:22 brd ff:ff:ff:ff:ff:ff 2023-07-14T11:17:20.135 INFO:teuthology.orchestra.run.smithi084.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-14T11:17:20.136 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:17:20.136 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::dc90:1eff:feca:b2b4/64 scope link 2023-07-14T11:17:20.136 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:17:20.136 INFO:teuthology.orchestra.run.smithi084.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-14T11:17:20.136 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 2e:15:90:61:8f:22 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-14T11:17:20.136 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::2c15:90ff:fe61:8f22/64 scope link 2023-07-14T11:17:20.136 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:17:20.137 INFO:teuthology.orchestra.run.smithi084.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-14T11:17:20.137 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 5e:77:8b:e6:63:60 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-14T11:17:20.137 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::5c77:8bff:fee6:6360/64 scope link 2023-07-14T11:17:20.137 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:17:20.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:17:20.138 DEBUG:teuthology.orchestra.run.smithi084:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-14T11:17:20.206 INFO:teuthology.orchestra.run.smithi084.stdout:1 2023-07-14T11:17:20.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:17:20.209 DEBUG:teuthology.orchestra.run.smithi084:> route 2023-07-14T11:17:20.258 INFO:teuthology.orchestra.run.smithi084.stdout:Kernel IP routing table 2023-07-14T11:17:20.258 INFO:teuthology.orchestra.run.smithi084.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-14T11:17:20.258 INFO:teuthology.orchestra.run.smithi084.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-14T11:17:20.258 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-14T11:17:20.258 INFO:teuthology.orchestra.run.smithi084.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-14T11:17:20.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:17:20.260 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-07-14T11:17:20.260 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-07-14T11:17:20.260 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-14T11:17:20.261 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-14T11:17:20.261 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-14T11:17:20.261 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-07-14T11:17:20.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:17:20.430 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2023-07-14T11:17:20.475 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-14T11:17:20.475 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-14T11:17:20.476 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-14T11:17:20.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:17:20.477 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set brx.0 up 2023-07-14T11:17:20.546 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T11:17:20.547 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-14T11:17:20.593 INFO:teuthology.orchestra.run.smithi084.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-14T11:17:20.593 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T11:17:20.593 DEBUG:teuthology.orchestra.run.smithi084:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-14T11:17:20.678 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-07-14T11:17:20.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:17:20.678 DEBUG:teuthology.orchestra.run.smithi084:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-14T11:17:20.822 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-14T11:17:20.823 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-14T11:17:20.852 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-14T11:17:20.852 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-14T11:17:20.852 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-07-14T11:17:20.852 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: trying mount with new device syntax: 0@3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f.cephfs=/ 2023-07-14T11:17:20.852 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.84:3300/172.21.15.179:3300/172.21.15.179:3301" will pass to kernel 2023-07-14T11:17:20.858 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-14T11:17:20.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:17:20.859 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-14T11:17:20.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:17:20.930 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-14T11:17:21.041 INFO:teuthology.orchestra.run.smithi084.stdout:client6022 2023-07-14T11:17:21.041 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-14T11:17:21.042 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:17:21.088 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-14T11:17:21.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:21.321+0000 7f3f65bff700 1 Processor -- start 2023-07-14T11:17:21.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:21.321+0000 7f3f65bff700 1 -- start start 2023-07-14T11:17:21.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:21.323+0000 7f3f65bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f60141ff0 0x7f3f60158fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:21.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:21.323+0000 7f3f65bff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3f600b2180 0x7f3f600b4000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:21.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:21.323+0000 7f3f65bff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f600b4540 con 0x7f3f60070710 2023-07-14T11:17:21.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:21.323+0000 7f3f65bff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f60071140 con 0x7f3f600b2180 2023-07-14T11:17:21.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:21.323+0000 7f3f65bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6006c110 con 0x7f3f60141ff0 2023-07-14T11:17:21.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:21.323+0000 7f3f5f7fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f60141ff0 0x7f3f60158fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:21.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:21.323+0000 7f3f5f7fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f60141ff0 0x7f3f60158fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.84:44290/0 (socket says 172.21.15.84:44290) 2023-07-14T11:17:21.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:21.323+0000 7f3f5f7fe700 1 -- 172.21.15.84:0/3220111989 learned_addr learned my addr 172.21.15.84:0/3220111989 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:21.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:21.323+0000 7f3f5ffff700 1 --2- 172.21.15.84:0/3220111989 >> v2:172.21.15.179:3300/0 conn(0x7f3f600b2180 0x7f3f600b4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:21.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:21.324+0000 7f3f5f7fe700 1 -- 172.21.15.84:0/3220111989 >> v2:172.21.15.179:3300/0 conn(0x7f3f600b2180 msgr2=0x7f3f600b4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:21.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:21.324+0000 7f3f5f7fe700 1 --2- 172.21.15.84:0/3220111989 >> v2:172.21.15.179:3300/0 conn(0x7f3f600b2180 0x7f3f600b4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:21.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:21.324+0000 7f3f5f7fe700 1 -- 172.21.15.84:0/3220111989 >> v1:172.21.15.179:6789/0 conn(0x7f3f60070710 legacy=0x7f3f600b1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:21.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:21.324+0000 7f3f5f7fe700 1 -- 172.21.15.84:0/3220111989 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f60070e60 con 0x7f3f60141ff0 2023-07-14T11:17:21.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:21.324+0000 7f3f5f7fe700 1 --2- 172.21.15.84:0/3220111989 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f60141ff0 0x7f3f60158fd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3f500098f0 tx=0x7f3f50009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce37018241af5997 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:21.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:21.324+0000 7f3f5effd700 1 -- 172.21.15.84:0/3220111989 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5000f8a0 con 0x7f3f60141ff0 2023-07-14T11:17:21.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:21.324+0000 7f3f5effd700 1 -- 172.21.15.84:0/3220111989 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f5000fa00 con 0x7f3f60141ff0 2023-07-14T11:17:21.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:21.324+0000 7f3f5effd700 1 -- 172.21.15.84:0/3220111989 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5000fd90 con 0x7f3f60141ff0 2023-07-14T11:17:21.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:21.325+0000 7f3f65bff700 1 -- 172.21.15.84:0/3220111989 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f60141ff0 msgr2=0x7f3f60158fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:21.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:21.325+0000 7f3f65bff700 1 --2- 172.21.15.84:0/3220111989 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f60141ff0 0x7f3f60158fd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3f500098f0 tx=0x7f3f50009c00 comp rx=0 tx=0).stop 2023-07-14T11:17:21.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:21.325+0000 7f3f65bff700 1 -- 172.21.15.84:0/3220111989 shutdown_connections 2023-07-14T11:17:21.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:21.325+0000 7f3f65bff700 1 --2- 172.21.15.84:0/3220111989 >> v2:172.21.15.179:3300/0 conn(0x7f3f600b2180 0x7f3f600b4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:21.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:21.325+0000 7f3f65bff700 1 --2- 172.21.15.84:0/3220111989 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f60141ff0 0x7f3f60158fd0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:21.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:21.325+0000 7f3f65bff700 1 -- 172.21.15.84:0/3220111989 >> 172.21.15.84:0/3220111989 conn(0x7f3f60069f30 msgr2=0x7f3f6006a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:21.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:21.325+0000 7f3f65bff700 1 -- 172.21.15.84:0/3220111989 shutdown_connections 2023-07-14T11:17:21.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:21.325+0000 7f3f65bff700 1 -- 172.21.15.84:0/3220111989 wait complete. 2023-07-14T11:17:21.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:21.327+0000 7f3f65bff700 1 Processor -- start 2023-07-14T11:17:21.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:21.327+0000 7f3f65bff700 1 -- start start 2023-07-14T11:17:21.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:21.328+0000 7f3f65bff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f60070710 0x7f3f601583d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:21.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:21.328+0000 7f3f65bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f600b2180 0x7f3f600a95c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:21.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:21.328+0000 7f3f65bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f60141ff0 0x7f3f60140600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:21.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:21.328+0000 7f3f65bff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f600ab800 con 0x7f3f60070710 2023-07-14T11:17:21.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:21.328+0000 7f3f65bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f600aa4f0 con 0x7f3f600b2180 2023-07-14T11:17:21.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:21.328+0000 7f3f65bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f600a9f30 con 0x7f3f60141ff0 2023-07-14T11:17:21.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:21.328+0000 7f3f5f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f60070710 0x7f3f601583d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:21.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:21.328+0000 7f3f5f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f60070710 0x7f3f601583d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58984/0 (socket says 172.21.15.84:58984) 2023-07-14T11:17:21.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:21.328+0000 7f3f5f7fe700 1 -- 172.21.15.84:0/4000223324 learned_addr learned my addr 172.21.15.84:0/4000223324 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:21.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:21.328+0000 7f3f5ffff700 1 --2- 172.21.15.84:0/4000223324 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f60141ff0 0x7f3f60140600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:21.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:21.328+0000 7f3f5f7fe700 1 -- 172.21.15.84:0/4000223324 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f60141ff0 msgr2=0x7f3f60140600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:21.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:21.328+0000 7f3f57fff700 1 --2- 172.21.15.84:0/4000223324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f600b2180 0x7f3f600a95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:21.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:21.328+0000 7f3f5f7fe700 1 --2- 172.21.15.84:0/4000223324 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f60141ff0 0x7f3f60140600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:21.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:21.328+0000 7f3f5f7fe700 1 -- 172.21.15.84:0/4000223324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f600b2180 msgr2=0x7f3f600a95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:21.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:21.328+0000 7f3f5f7fe700 1 --2- 172.21.15.84:0/4000223324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f600b2180 0x7f3f600a95c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:21.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:21.329+0000 7f3f5f7fe700 1 -- 172.21.15.84:0/4000223324 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f50009550 con 0x7f3f60070710 2023-07-14T11:17:21.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:21.329+0000 7f3f5ffff700 1 --2- 172.21.15.84:0/4000223324 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f60141ff0 0x7f3f60140600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:17:21.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:21.329+0000 7f3f57fff700 1 --2- 172.21.15.84:0/4000223324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f600b2180 0x7f3f600a95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:17:21.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:21.329+0000 7f3f5f7fe700 1 --2- 172.21.15.84:0/4000223324 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f60070710 0x7f3f601583d0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f3f50000c00 tx=0x7f3f50004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:21.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:21.329+0000 7f3f5cff9700 1 -- 172.21.15.84:0/4000223324 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5001e070 con 0x7f3f60070710 2023-07-14T11:17:21.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:21.329+0000 7f3f5cff9700 1 -- 172.21.15.84:0/4000223324 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f50004590 con 0x7f3f60070710 2023-07-14T11:17:21.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:21.329+0000 7f3f5cff9700 1 -- 172.21.15.84:0/4000223324 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f50003ad0 con 0x7f3f60070710 2023-07-14T11:17:21.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:21.329+0000 7f3f65bff700 1 -- 172.21.15.84:0/4000223324 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f600aa210 con 0x7f3f60070710 2023-07-14T11:17:21.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:21.329+0000 7f3f65bff700 1 -- 172.21.15.84:0/4000223324 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f60158910 con 0x7f3f60070710 2023-07-14T11:17:21.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:21.330+0000 7f3f65bff700 1 -- 172.21.15.84:0/4000223324 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f6004e280 con 0x7f3f60070710 2023-07-14T11:17:21.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:21.331+0000 7f3f5cff9700 1 -- 172.21.15.84:0/4000223324 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 9) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f3f50003c30 con 0x7f3f60070710 2023-07-14T11:17:21.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:21.332+0000 7f3f5cff9700 1 --2- 172.21.15.84:0/4000223324 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f3f4006ae90 0x7f3f4006d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:21.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:21.332+0000 7f3f5cff9700 1 -- 172.21.15.84:0/4000223324 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3f5008c820 con 0x7f3f60070710 2023-07-14T11:17:21.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:21.332+0000 7f3f57fff700 1 --2- 172.21.15.84:0/4000223324 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f3f4006ae90 0x7f3f4006d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:21.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:21.333+0000 7f3f57fff700 1 --2- 172.21.15.84:0/4000223324 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f3f4006ae90 0x7f3f4006d340 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f3f600b12c0 tx=0x7f3f48009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:21.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:21.336+0000 7f3f5cff9700 1 -- 172.21.15.84:0/4000223324 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3f50057760 con 0x7f3f60070710 2023-07-14T11:17:21.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:21.577+0000 7f3f65bff700 1 -- 172.21.15.84:0/4000223324 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3f6006f900 con 0x7f3f60070710 2023-07-14T11:17:21.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:21.577+0000 7f3f5cff9700 1 -- 172.21.15.84:0/4000223324 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v37) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3f5005ad80 con 0x7f3f60070710 2023-07-14T11:17:21.580 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-14T11:17:21.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:21.580+0000 7f3f65bff700 1 -- 172.21.15.84:0/4000223324 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f3f4006ae90 msgr2=0x7f3f4006d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:21.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:21.580+0000 7f3f65bff700 1 --2- 172.21.15.84:0/4000223324 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f3f4006ae90 0x7f3f4006d340 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f3f600b12c0 tx=0x7f3f48009040 comp rx=0 tx=0).stop 2023-07-14T11:17:21.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:21.580+0000 7f3f65bff700 1 -- 172.21.15.84:0/4000223324 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f60070710 msgr2=0x7f3f601583d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:21.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:21.580+0000 7f3f65bff700 1 --2- 172.21.15.84:0/4000223324 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f60070710 0x7f3f601583d0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f3f50000c00 tx=0x7f3f50004750 comp rx=0 tx=0).stop 2023-07-14T11:17:21.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:21.580+0000 7f3f65bff700 1 -- 172.21.15.84:0/4000223324 shutdown_connections 2023-07-14T11:17:21.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:21.580+0000 7f3f65bff700 1 --2- 172.21.15.84:0/4000223324 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f3f4006ae90 0x7f3f4006d340 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:21.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:21.580+0000 7f3f65bff700 1 --2- 172.21.15.84:0/4000223324 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f60141ff0 0x7f3f60140600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:21.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:21.580+0000 7f3f65bff700 1 --2- 172.21.15.84:0/4000223324 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f60070710 0x7f3f601583d0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:21.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:21.580+0000 7f3f65bff700 1 --2- 172.21.15.84:0/4000223324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f600b2180 0x7f3f600a95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:21.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:21.580+0000 7f3f65bff700 1 -- 172.21.15.84:0/4000223324 >> 172.21.15.84:0/4000223324 conn(0x7f3f60069f30 msgr2=0x7f3f600ce9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:21.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:21.580+0000 7f3f65bff700 1 -- 172.21.15.84:0/4000223324 shutdown_connections 2023-07-14T11:17:21.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:21.580+0000 7f3f65bff700 1 -- 172.21.15.84:0/4000223324 wait complete. 2023-07-14T11:17:21.600 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-14T11:17:21.601 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-14T11:17:21.601 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi179.front.sepia.ceph.com 2023-07-14T11:17:21.601 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-07-14T11:17:21.601 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-14T11:17:21.602 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-14T11:17:21.602 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-14T11:17:21.602 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-14T11:17:21.602 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-14T11:17:21.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:17:21.603 DEBUG:teuthology.orchestra.run.smithi179:> ip addr 2023-07-14T11:17:21.655 INFO:teuthology.orchestra.run.smithi179.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-14T11:17:21.655 INFO:teuthology.orchestra.run.smithi179.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-14T11:17:21.656 INFO:teuthology.orchestra.run.smithi179.stdout: inet 127.0.0.1/8 scope host lo 2023-07-14T11:17:21.656 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:17:21.656 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 ::1/128 scope host 2023-07-14T11:17:21.656 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:17:21.656 INFO:teuthology.orchestra.run.smithi179.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T11:17:21.656 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:34 brd ff:ff:ff:ff:ff:ff 2023-07-14T11:17:21.656 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f0 2023-07-14T11:17:21.656 INFO:teuthology.orchestra.run.smithi179.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T11:17:21.657 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:35 brd ff:ff:ff:ff:ff:ff 2023-07-14T11:17:21.657 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f1 2023-07-14T11:17:21.657 INFO:teuthology.orchestra.run.smithi179.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T11:17:21.657 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5a brd ff:ff:ff:ff:ff:ff 2023-07-14T11:17:21.657 INFO:teuthology.orchestra.run.smithi179.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-14T11:17:21.657 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5b brd ff:ff:ff:ff:ff:ff 2023-07-14T11:17:21.657 INFO:teuthology.orchestra.run.smithi179.stdout: inet 172.21.15.179/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-14T11:17:21.658 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft 41614sec preferred_lft 41614sec 2023-07-14T11:17:21.658 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::ec4:7aff:fe88:725b/64 scope link 2023-07-14T11:17:21.658 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:17:21.658 INFO:teuthology.orchestra.run.smithi179.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-14T11:17:21.658 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 46:75:18:db:4e:84 brd ff:ff:ff:ff:ff:ff 2023-07-14T11:17:21.658 INFO:teuthology.orchestra.run.smithi179.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-14T11:17:21.658 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:17:21.658 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::fc06:a1ff:feba:ddf1/64 scope link 2023-07-14T11:17:21.659 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:17:21.659 INFO:teuthology.orchestra.run.smithi179.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-14T11:17:21.659 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 92:db:40:bf:aa:be brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-14T11:17:21.659 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::90db:40ff:febf:aabe/64 scope link 2023-07-14T11:17:21.659 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:17:21.659 INFO:teuthology.orchestra.run.smithi179.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-14T11:17:21.659 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 46:75:18:db:4e:84 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-07-14T11:17:21.660 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::4475:18ff:fedb:4e84/64 scope link 2023-07-14T11:17:21.660 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:17:21.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:17:21.661 DEBUG:teuthology.orchestra.run.smithi179:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-14T11:17:21.731 INFO:teuthology.orchestra.run.smithi179.stdout:1 2023-07-14T11:17:21.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:17:21.734 DEBUG:teuthology.orchestra.run.smithi179:> route 2023-07-14T11:17:21.783 INFO:teuthology.orchestra.run.smithi179.stdout:Kernel IP routing table 2023-07-14T11:17:21.784 INFO:teuthology.orchestra.run.smithi179.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-14T11:17:21.784 INFO:teuthology.orchestra.run.smithi179.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-14T11:17:21.784 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-14T11:17:21.784 INFO:teuthology.orchestra.run.smithi179.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-14T11:17:21.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:17:21.785 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2023-07-14T11:17:21.786 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2023-07-14T11:17:21.786 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-14T11:17:21.786 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-14T11:17:21.786 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-14T11:17:21.787 DEBUG:teuthology.orchestra.run.smithi179:> ') 2023-07-14T11:17:21.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:17:21.955 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2023-07-14T11:17:22.000 INFO:teuthology.orchestra.run.smithi179.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-07-14T11:17:22.000 INFO:teuthology.orchestra.run.smithi179.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-14T11:17:22.001 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-14T11:17:22.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:17:22.002 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link set brx.0 up 2023-07-14T11:17:22.072 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T11:17:22.073 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-07-14T11:17:22.118 INFO:teuthology.orchestra.run.smithi179.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-07-14T11:17:22.119 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T11:17:22.119 DEBUG:teuthology.orchestra.run.smithi179:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-07-14T11:17:22.204 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-07-14T11:17:22.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:17:22.205 DEBUG:teuthology.orchestra.run.smithi179:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-14T11:17:22.308 INFO:teuthology.orchestra.run.smithi179.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-14T11:17:22.308 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-14T11:17:22.336 INFO:teuthology.orchestra.run.smithi179.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-14T11:17:22.336 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-14T11:17:22.336 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-07-14T11:17:22.337 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: trying mount with new device syntax: 1@3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f.cephfs=/ 2023-07-14T11:17:22.337 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.84:3300/172.21.15.179:3300/172.21.15.179:3301" will pass to kernel 2023-07-14T11:17:22.340 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-14T11:17:22.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:17:22.341 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-07-14T11:17:22.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:17:22.410 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-14T11:17:22.498 INFO:teuthology.orchestra.run.smithi179.stdout:client6031 2023-07-14T11:17:22.499 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-07-14T11:17:22.500 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:17:22.545 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-07-14T11:17:22.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:22.752+0000 7f14b29ff700 1 Processor -- start 2023-07-14T11:17:22.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:22.752+0000 7f14b29ff700 1 -- start start 2023-07-14T11:17:22.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:22.753+0000 7f14b29ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14ac15cc70 0x7f14ac0cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:22.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:22.753+0000 7f14b29ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f14ac071590 0x7f14ac1610d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:22.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:22.753+0000 7f14b29ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14ac161610 con 0x7f14ac069f30 2023-07-14T11:17:22.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:22.753+0000 7f14b29ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14ac0ca4d0 con 0x7f14ac071590 2023-07-14T11:17:22.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:22.753+0000 7f14b29ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14ac15d040 con 0x7f14ac15cc70 2023-07-14T11:17:22.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:22.753+0000 7f14b0f9c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f14ac069f30 0x7f14ac0cd690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:35816/0 (socket says 172.21.15.84:35816) 2023-07-14T11:17:22.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:22.753+0000 7f14b0f9c700 1 -- 172.21.15.84:0/2345494906 learned_addr learned my addr 172.21.15.84:0/2345494906 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:17:22.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:22.754+0000 7f14abfff700 1 --2- 172.21.15.84:0/2345494906 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14ac15cc70 0x7f14ac0cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:22.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:22.754+0000 7f14ab7fe700 1 --2- 172.21.15.84:0/2345494906 >> v2:172.21.15.179:3300/0 conn(0x7f14ac071590 0x7f14ac1610d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:22.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:22.754+0000 7f14aaffd700 1 -- 172.21.15.84:0/2345494906 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2149196238 0 0) 0x7f14a4001490 con 0x7f14ac069f30 2023-07-14T11:17:22.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:22.754+0000 7f14aaffd700 1 -- 172.21.15.84:0/2345494906 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14940035b0 con 0x7f14ac069f30 2023-07-14T11:17:22.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:22.754+0000 7f14abfff700 1 -- 172.21.15.84:0/2345494906 >> v2:172.21.15.179:3300/0 conn(0x7f14ac071590 msgr2=0x7f14ac1610d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:22.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:22.754+0000 7f14abfff700 1 --2- 172.21.15.84:0/2345494906 >> v2:172.21.15.179:3300/0 conn(0x7f14ac071590 0x7f14ac1610d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:22.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:22.754+0000 7f14abfff700 1 -- 172.21.15.84:0/2345494906 >> v1:172.21.15.84:6789/0 conn(0x7f14ac069f30 legacy=0x7f14ac0cd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:22.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:22.754+0000 7f14abfff700 1 -- 172.21.15.84:0/2345494906 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14ac070860 con 0x7f14ac15cc70 2023-07-14T11:17:22.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:22.754+0000 7f14ab7fe700 1 --2- 172.21.15.84:0/2345494906 >> v2:172.21.15.179:3300/0 conn(0x7f14ac071590 0x7f14ac1610d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:17:22.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:22.754+0000 7f14abfff700 1 --2- 172.21.15.84:0/2345494906 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14ac15cc70 0x7f14ac0cbae0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f149c009840 tx=0x7f149c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc8d3ed547fe38d0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:22.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:22.755+0000 7f14aaffd700 1 -- 172.21.15.84:0/2345494906 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149c011830 con 0x7f14ac15cc70 2023-07-14T11:17:22.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:22.755+0000 7f14aaffd700 1 -- 172.21.15.84:0/2345494906 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f149c011990 con 0x7f14ac15cc70 2023-07-14T11:17:22.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:22.755+0000 7f14aaffd700 1 -- 172.21.15.84:0/2345494906 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149c011d20 con 0x7f14ac15cc70 2023-07-14T11:17:22.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:22.755+0000 7f14b29ff700 1 -- 172.21.15.84:0/2345494906 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14ac15cc70 msgr2=0x7f14ac0cbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:22.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:22.755+0000 7f14b29ff700 1 --2- 172.21.15.84:0/2345494906 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14ac15cc70 0x7f14ac0cbae0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f149c009840 tx=0x7f149c009b50 comp rx=0 tx=0).stop 2023-07-14T11:17:22.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:22.755+0000 7f14b29ff700 1 -- 172.21.15.84:0/2345494906 shutdown_connections 2023-07-14T11:17:22.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:22.755+0000 7f14b29ff700 1 --2- 172.21.15.84:0/2345494906 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14ac15cc70 0x7f14ac0cbae0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:22.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:22.755+0000 7f14b29ff700 1 --2- 172.21.15.84:0/2345494906 >> v2:172.21.15.179:3300/0 conn(0x7f14ac071590 0x7f14ac1610d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:22.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:22.755+0000 7f14b29ff700 1 -- 172.21.15.84:0/2345494906 >> 172.21.15.84:0/2345494906 conn(0x7f14ac0cd180 msgr2=0x7f14ac0cfac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:22.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:22.755+0000 7f14b29ff700 1 -- 172.21.15.84:0/2345494906 shutdown_connections 2023-07-14T11:17:22.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:22.755+0000 7f14b29ff700 1 -- 172.21.15.84:0/2345494906 wait complete. 2023-07-14T11:17:22.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:22.757+0000 7f14b29ff700 1 Processor -- start 2023-07-14T11:17:22.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:22.757+0000 7f14b29ff700 1 -- start start 2023-07-14T11:17:22.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:22.758+0000 7f14b29ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14ac069f30 0x7f14ac1583e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:22.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:22.758+0000 7f14b29ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14ac071590 0x7f14ac0b39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:22.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:22.758+0000 7f14b29ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14ac15cc70 0x7f14ac15dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:22.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:22.758+0000 7f14b29ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14ac158920 con 0x7f14ac069f30 2023-07-14T11:17:22.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:22.758+0000 7f14b29ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14ac0c6b90 con 0x7f14ac15cc70 2023-07-14T11:17:22.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:22.758+0000 7f14b29ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14ac0c6de0 con 0x7f14ac071590 2023-07-14T11:17:22.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:22.758+0000 7f14abfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14ac069f30 0x7f14ac1583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:22.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:22.758+0000 7f14abfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14ac069f30 0x7f14ac1583e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58990/0 (socket says 172.21.15.84:58990) 2023-07-14T11:17:22.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:22.758+0000 7f14abfff700 1 -- 172.21.15.84:0/3481730787 learned_addr learned my addr 172.21.15.84:0/3481730787 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:22.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:22.759+0000 7f14ab7fe700 1 --2- 172.21.15.84:0/3481730787 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14ac071590 0x7f14ac0b39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:22.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:22.759+0000 7f14b0f9c700 1 --2- 172.21.15.84:0/3481730787 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14ac15cc70 0x7f14ac15dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:22.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:22.759+0000 7f14abfff700 1 -- 172.21.15.84:0/3481730787 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14ac071590 msgr2=0x7f14ac0b39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:22.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:22.759+0000 7f14abfff700 1 --2- 172.21.15.84:0/3481730787 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14ac071590 0x7f14ac0b39a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:22.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:22.759+0000 7f14abfff700 1 -- 172.21.15.84:0/3481730787 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14ac15cc70 msgr2=0x7f14ac15dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:22.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:22.759+0000 7f14abfff700 1 --2- 172.21.15.84:0/3481730787 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14ac15cc70 0x7f14ac15dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:22.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:22.759+0000 7f14abfff700 1 -- 172.21.15.84:0/3481730787 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a00094a0 con 0x7f14ac069f30 2023-07-14T11:17:22.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:22.759+0000 7f14b0f9c700 1 --2- 172.21.15.84:0/3481730787 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14ac15cc70 0x7f14ac15dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:17:22.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:22.759+0000 7f14abfff700 1 --2- 172.21.15.84:0/3481730787 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14ac069f30 0x7f14ac1583e0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f149c009fd0 tx=0x7f149c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:22.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:22.759+0000 7f14a8ff9700 1 -- 172.21.15.84:0/3481730787 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149c0036a0 con 0x7f14ac069f30 2023-07-14T11:17:22.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:22.759+0000 7f14a8ff9700 1 -- 172.21.15.84:0/3481730787 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f149c01f070 con 0x7f14ac069f30 2023-07-14T11:17:22.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:22.759+0000 7f14b29ff700 1 -- 172.21.15.84:0/3481730787 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f149c0094a0 con 0x7f14ac069f30 2023-07-14T11:17:22.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:22.759+0000 7f14a8ff9700 1 -- 172.21.15.84:0/3481730787 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149c003a20 con 0x7f14ac069f30 2023-07-14T11:17:22.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:22.759+0000 7f14b29ff700 1 -- 172.21.15.84:0/3481730787 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14ac0c73a0 con 0x7f14ac069f30 2023-07-14T11:17:22.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:22.760+0000 7f14b29ff700 1 -- 172.21.15.84:0/3481730787 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14ac074350 con 0x7f14ac069f30 2023-07-14T11:17:22.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:22.761+0000 7f14a8ff9700 1 -- 172.21.15.84:0/3481730787 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 9) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f149c003b80 con 0x7f14ac069f30 2023-07-14T11:17:22.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:22.762+0000 7f14a8ff9700 1 --2- 172.21.15.84:0/3481730787 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f149806ae90 0x7f149806d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:22.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:22.762+0000 7f14a8ff9700 1 -- 172.21.15.84:0/3481730787 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f149c021070 con 0x7f14ac069f30 2023-07-14T11:17:22.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:22.762+0000 7f14ab7fe700 1 --2- 172.21.15.84:0/3481730787 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f149806ae90 0x7f149806d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:22.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:22.763+0000 7f14ab7fe700 1 --2- 172.21.15.84:0/3481730787 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f149806ae90 0x7f149806d340 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f14a0009d70 tx=0x7f14a0009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:22.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:22.767+0000 7f14a8ff9700 1 -- 172.21.15.84:0/3481730787 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f149c055e00 con 0x7f14ac069f30 2023-07-14T11:17:23.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:23.005+0000 7f14b29ff700 1 -- 172.21.15.84:0/3481730787 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f14ac0b5a40 con 0x7f14ac069f30 2023-07-14T11:17:23.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:23.811+0000 7f14a8ff9700 1 -- 172.21.15.84:0/3481730787 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v38) v1 ==== 136+0+0 (secure 0 0 0) 0x7f149c059420 con 0x7f14ac069f30 2023-07-14T11:17:23.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:23.814+0000 7f14b29ff700 1 -- 172.21.15.84:0/3481730787 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f149806ae90 msgr2=0x7f149806d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:23.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:23.814+0000 7f14b29ff700 1 --2- 172.21.15.84:0/3481730787 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f149806ae90 0x7f149806d340 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f14a0009d70 tx=0x7f14a0009210 comp rx=0 tx=0).stop 2023-07-14T11:17:23.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:23.814+0000 7f14b29ff700 1 -- 172.21.15.84:0/3481730787 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14ac069f30 msgr2=0x7f14ac1583e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:23.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:23.814+0000 7f14b29ff700 1 --2- 172.21.15.84:0/3481730787 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14ac069f30 0x7f14ac1583e0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f149c009fd0 tx=0x7f149c004750 comp rx=0 tx=0).stop 2023-07-14T11:17:23.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:23.814+0000 7f14b29ff700 1 -- 172.21.15.84:0/3481730787 shutdown_connections 2023-07-14T11:17:23.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:23.814+0000 7f14b29ff700 1 --2- 172.21.15.84:0/3481730787 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14ac15cc70 0x7f14ac15dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:23.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:23.814+0000 7f14b29ff700 1 --2- 172.21.15.84:0/3481730787 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14ac069f30 0x7f14ac1583e0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:23.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:23.814+0000 7f14b29ff700 1 --2- 172.21.15.84:0/3481730787 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f149806ae90 0x7f149806d340 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:23.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:23.814+0000 7f14b29ff700 1 --2- 172.21.15.84:0/3481730787 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14ac071590 0x7f14ac0b39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:23.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:23.814+0000 7f14b29ff700 1 -- 172.21.15.84:0/3481730787 >> 172.21.15.84:0/3481730787 conn(0x7f14ac0cd180 msgr2=0x7f14ac06c860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:23.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:23.814+0000 7f14b29ff700 1 -- 172.21.15.84:0/3481730787 shutdown_connections 2023-07-14T11:17:23.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:23.814+0000 7f14b29ff700 1 -- 172.21.15.84:0/3481730787 wait complete. 2023-07-14T11:17:23.837 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-07-14T11:17:24.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.035+0000 7fe90c1ff700 1 Processor -- start 2023-07-14T11:17:24.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.036+0000 7fe90c1ff700 1 -- start start 2023-07-14T11:17:24.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.037+0000 7fe90c1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9040d12c0 0x7fe9040cc220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:24.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.037+0000 7fe90c1ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9040b0560 con 0x7fe9040cb330 2023-07-14T11:17:24.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.037+0000 7fe90c1ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9040cc760 con 0x7fe90406b750 2023-07-14T11:17:24.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.037+0000 7fe90c1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9040d1690 con 0x7fe9040d12c0 2023-07-14T11:17:24.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.037+0000 7fe90979a700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fe9040cb330 0x7fe90406b040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:35830/0 (socket says 172.21.15.84:35830) 2023-07-14T11:17:24.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.037+0000 7fe90979a700 1 -- 172.21.15.84:0/1692124336 learned_addr learned my addr 172.21.15.84:0/1692124336 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:17:24.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.037+0000 7fe909f9b700 1 --2- 172.21.15.84:0/1692124336 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9040d12c0 0x7fe9040cc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:24.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.037+0000 7fe908f99700 1 -- 172.21.15.84:0/1692124336 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1669268407 0 0) 0x7fe9040b0560 con 0x7fe9040cb330 2023-07-14T11:17:24.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.038+0000 7fe908f99700 1 -- 172.21.15.84:0/1692124336 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8f00035b0 con 0x7fe9040cb330 2023-07-14T11:17:24.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.038+0000 7fe908f99700 1 -- 172.21.15.84:0/1692124336 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4265706467 0 0) 0x7fe9040cc760 con 0x7fe90406b750 2023-07-14T11:17:24.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.038+0000 7fe908f99700 1 -- 172.21.15.84:0/1692124336 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9040b0560 con 0x7fe90406b750 2023-07-14T11:17:24.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.038+0000 7fe908f99700 1 -- 172.21.15.84:0/1692124336 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 620090615 0 0) 0x7fe8f00035b0 con 0x7fe9040cb330 2023-07-14T11:17:24.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.038+0000 7fe908f99700 1 -- 172.21.15.84:0/1692124336 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9040d12c0 msgr2=0x7fe9040cc220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:24.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.038+0000 7fe908f99700 1 --2- 172.21.15.84:0/1692124336 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9040d12c0 0x7fe9040cc220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:24.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.038+0000 7fe908f99700 1 -- 172.21.15.84:0/1692124336 >> v1:172.21.15.179:6789/0 conn(0x7fe90406b750 legacy=0x7fe9040b0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:24.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.038+0000 7fe908f99700 1 -- 172.21.15.84:0/1692124336 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe90415ced0 con 0x7fe9040cb330 2023-07-14T11:17:24.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.038+0000 7fe908f99700 1 -- 172.21.15.84:0/1692124336 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7fe8f4001670 con 0x7fe9040cb330 2023-07-14T11:17:24.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.038+0000 7fe908f99700 1 -- 172.21.15.84:0/1692124336 >> v1:172.21.15.84:6789/0 conn(0x7fe9040cb330 legacy=0x7fe90406b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:24.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.038+0000 7fe908f99700 1 --2- 172.21.15.84:0/1692124336 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8f0003bc0 0x7fe8f0003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:24.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.038+0000 7fe908f99700 1 --2- 172.21.15.84:0/1692124336 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9040d12c0 0x7fe8f0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:24.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.038+0000 7fe908f99700 1 --2- 172.21.15.84:0/1692124336 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8f0004d90 0x7fe8f0005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:24.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.038+0000 7fe908f99700 1 -- 172.21.15.84:0/1692124336 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9040d1690 con 0x7fe8f0004d90 2023-07-14T11:17:24.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.038+0000 7fe908f99700 1 -- 172.21.15.84:0/1692124336 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f000bac0 con 0x7fe8f0003bc0 2023-07-14T11:17:24.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.038+0000 7fe908f99700 1 -- 172.21.15.84:0/1692124336 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f000bc30 con 0x7fe9040d12c0 2023-07-14T11:17:24.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.038+0000 7fe90a79c700 1 --2- 172.21.15.84:0/1692124336 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8f0004d90 0x7fe8f0005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:24.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.038+0000 7fe90979a700 1 --2- 172.21.15.84:0/1692124336 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9040d12c0 0x7fe8f0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:24.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.038+0000 7fe909f9b700 1 --2- 172.21.15.84:0/1692124336 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8f0003bc0 0x7fe8f0003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:24.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.039+0000 7fe90a79c700 1 -- 172.21.15.84:0/1692124336 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9040d12c0 msgr2=0x7fe8f0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:24.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.039+0000 7fe90a79c700 1 --2- 172.21.15.84:0/1692124336 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9040d12c0 0x7fe8f0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:24.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.039+0000 7fe90a79c700 1 -- 172.21.15.84:0/1692124336 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8f0003bc0 msgr2=0x7fe8f0003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:24.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.039+0000 7fe90a79c700 1 --2- 172.21.15.84:0/1692124336 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8f0003bc0 0x7fe8f0003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:24.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.039+0000 7fe90a79c700 1 -- 172.21.15.84:0/1692124336 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8f00035b0 con 0x7fe8f0004d90 2023-07-14T11:17:24.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.039+0000 7fe90a79c700 1 --2- 172.21.15.84:0/1692124336 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8f0004d90 0x7fe8f0005200 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc00c4c0 tx=0x7fe8f0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8e3beb1dc6db4d4 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:24.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.039+0000 7fe908f99700 1 -- 172.21.15.84:0/1692124336 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8fc003a00 con 0x7fe8f0004d90 2023-07-14T11:17:24.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.039+0000 7fe908f99700 1 -- 172.21.15.84:0/1692124336 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8fc003b60 con 0x7fe8f0004d90 2023-07-14T11:17:24.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.039+0000 7fe908f99700 1 -- 172.21.15.84:0/1692124336 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8fc0050d0 con 0x7fe8f0004d90 2023-07-14T11:17:24.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.040+0000 7fe90c1ff700 1 -- 172.21.15.84:0/1692124336 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8f0004d90 msgr2=0x7fe8f0005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:24.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.040+0000 7fe90c1ff700 1 --2- 172.21.15.84:0/1692124336 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8f0004d90 0x7fe8f0005200 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc00c4c0 tx=0x7fe8f0005880 comp rx=0 tx=0).stop 2023-07-14T11:17:24.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.040+0000 7fe90a79c700 1 -- 172.21.15.84:0/1692124336 reap_dead start 2023-07-14T11:17:24.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.040+0000 7fe90c1ff700 1 -- 172.21.15.84:0/1692124336 shutdown_connections 2023-07-14T11:17:24.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.040+0000 7fe90c1ff700 1 -- 172.21.15.84:0/1692124336 >> 172.21.15.84:0/1692124336 conn(0x7fe9040999e0 msgr2=0x7fe904099de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:24.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.040+0000 7fe90c1ff700 1 -- 172.21.15.84:0/1692124336 shutdown_connections 2023-07-14T11:17:24.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.040+0000 7fe90c1ff700 1 -- 172.21.15.84:0/1692124336 wait complete. 2023-07-14T11:17:24.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.041+0000 7fe90c1ff700 1 Processor -- start 2023-07-14T11:17:24.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.042+0000 7fe90c1ff700 1 -- start start 2023-07-14T11:17:24.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.043+0000 7fe90c1ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8f0004d90 0x7fe9041460d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:24.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.043+0000 7fe90c1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9040b4e00 0x7fe9040b5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:24.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.043+0000 7fe90c1ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9040c9e70 0x7fe9040ca2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:24.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.043+0000 7fe90c1ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9040ca800 con 0x7fe9040c9e70 2023-07-14T11:17:24.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.043+0000 7fe90c1ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9040b3b10 con 0x7fe8f0004d90 2023-07-14T11:17:24.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.043+0000 7fe90c1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9040b3d60 con 0x7fe9040b4e00 2023-07-14T11:17:24.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.043+0000 7fe90a79c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9040c9e70 0x7fe9040ca2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:24.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.043+0000 7fe90a79c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9040c9e70 0x7fe9040ca2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58998/0 (socket says 172.21.15.84:58998) 2023-07-14T11:17:24.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.043+0000 7fe90a79c700 1 -- 172.21.15.84:0/1687230912 learned_addr learned my addr 172.21.15.84:0/1687230912 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:24.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.043+0000 7fe909f9b700 1 --2- 172.21.15.84:0/1687230912 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8f0004d90 0x7fe9041460d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:24.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.043+0000 7fe90979a700 1 --2- 172.21.15.84:0/1687230912 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9040b4e00 0x7fe9040b5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:24.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.043+0000 7fe90a79c700 1 -- 172.21.15.84:0/1687230912 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9040b4e00 msgr2=0x7fe9040b5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:24.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.043+0000 7fe90a79c700 1 --2- 172.21.15.84:0/1687230912 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9040b4e00 0x7fe9040b5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:24.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.043+0000 7fe90a79c700 1 -- 172.21.15.84:0/1687230912 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8f0004d90 msgr2=0x7fe9041460d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:24.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.043+0000 7fe90a79c700 1 --2- 172.21.15.84:0/1687230912 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8f0004d90 0x7fe9041460d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:24.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.043+0000 7fe90a79c700 1 -- 172.21.15.84:0/1687230912 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9040b4040 con 0x7fe9040c9e70 2023-07-14T11:17:24.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.043+0000 7fe90979a700 1 --2- 172.21.15.84:0/1687230912 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9040b4e00 0x7fe9040b5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:17:24.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.044+0000 7fe90a79c700 1 --2- 172.21.15.84:0/1687230912 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9040c9e70 0x7fe9040ca2c0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc005040 tx=0x7fe8fc001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:24.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.044+0000 7fe8fa7fc700 1 -- 172.21.15.84:0/1687230912 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8fc003a00 con 0x7fe9040c9e70 2023-07-14T11:17:24.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.044+0000 7fe8fa7fc700 1 -- 172.21.15.84:0/1687230912 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8fc0052e0 con 0x7fe9040c9e70 2023-07-14T11:17:24.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.044+0000 7fe90c1ff700 1 -- 172.21.15.84:0/1687230912 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9040b4320 con 0x7fe9040c9e70 2023-07-14T11:17:24.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.044+0000 7fe8fa7fc700 1 -- 172.21.15.84:0/1687230912 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8fc005670 con 0x7fe9040c9e70 2023-07-14T11:17:24.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.044+0000 7fe90c1ff700 1 -- 172.21.15.84:0/1687230912 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9040b48e0 con 0x7fe9040c9e70 2023-07-14T11:17:24.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.045+0000 7fe90c1ff700 1 -- 172.21.15.84:0/1687230912 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe904074350 con 0x7fe9040c9e70 2023-07-14T11:17:24.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.046+0000 7fe8fa7fc700 1 -- 172.21.15.84:0/1687230912 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 9) v1 ==== 89190+0+0 (secure 0 0 0) 0x7fe8fc019070 con 0x7fe9040c9e70 2023-07-14T11:17:24.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.047+0000 7fe8fa7fc700 1 --2- 172.21.15.84:0/1687230912 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe8e806ae90 0x7fe8e806d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:24.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.047+0000 7fe8fa7fc700 1 -- 172.21.15.84:0/1687230912 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe8fc08ab40 con 0x7fe9040c9e70 2023-07-14T11:17:24.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.047+0000 7fe909f9b700 1 --2- 172.21.15.84:0/1687230912 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe8e806ae90 0x7fe8e806d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:24.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.048+0000 7fe909f9b700 1 --2- 172.21.15.84:0/1687230912 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe8e806ae90 0x7fe8e806d340 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fe900009c60 tx=0x7fe900009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:24.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.051+0000 7fe8fa7fc700 1 -- 172.21.15.84:0/1687230912 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe8fc055a80 con 0x7fe9040c9e70 2023-07-14T11:17:24.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.276+0000 7fe90c1ff700 1 -- 172.21.15.84:0/1687230912 --> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fe9040ccca0 con 0x7fe8e806ae90 2023-07-14T11:17:24.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.277+0000 7fe8fa7fc700 1 -- 172.21.15.84:0/1687230912 <== mgr.4104 v2:172.21.15.84:6832/379617029 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fe900019070 con 0x7fe8e806ae90 2023-07-14T11:17:24.280 INFO:teuthology.orchestra.run.smithi084.stdout:[ 2023-07-14T11:17:24.280 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:17:24.280 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "cephfs" 2023-07-14T11:17:24.280 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:17:24.280 INFO:teuthology.orchestra.run.smithi084.stdout:] 2023-07-14T11:17:24.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.280+0000 7fe90c1ff700 1 -- 172.21.15.84:0/1687230912 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe8e806ae90 msgr2=0x7fe8e806d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:24.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.280+0000 7fe90c1ff700 1 --2- 172.21.15.84:0/1687230912 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe8e806ae90 0x7fe8e806d340 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fe900009c60 tx=0x7fe900009210 comp rx=0 tx=0).stop 2023-07-14T11:17:24.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.280+0000 7fe90c1ff700 1 -- 172.21.15.84:0/1687230912 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9040c9e70 msgr2=0x7fe9040ca2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:24.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.280+0000 7fe90c1ff700 1 --2- 172.21.15.84:0/1687230912 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9040c9e70 0x7fe9040ca2c0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc005040 tx=0x7fe8fc001690 comp rx=0 tx=0).stop 2023-07-14T11:17:24.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.280+0000 7fe90c1ff700 1 -- 172.21.15.84:0/1687230912 shutdown_connections 2023-07-14T11:17:24.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.280+0000 7fe90c1ff700 1 --2- 172.21.15.84:0/1687230912 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9040c9e70 0x7fe9040ca2c0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:24.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.280+0000 7fe90c1ff700 1 --2- 172.21.15.84:0/1687230912 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8f0004d90 0x7fe9041460d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:24.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.280+0000 7fe90c1ff700 1 --2- 172.21.15.84:0/1687230912 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe8e806ae90 0x7fe8e806d340 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:24.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.280+0000 7fe90c1ff700 1 --2- 172.21.15.84:0/1687230912 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9040b4e00 0x7fe9040b5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:24.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.280+0000 7fe90c1ff700 1 -- 172.21.15.84:0/1687230912 >> 172.21.15.84:0/1687230912 conn(0x7fe9040999e0 msgr2=0x7fe9040cd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:24.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.280+0000 7fe90c1ff700 1 -- 172.21.15.84:0/1687230912 shutdown_connections 2023-07-14T11:17:24.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.280+0000 7fe90c1ff700 1 -- 172.21.15.84:0/1687230912 wait complete. 2023-07-14T11:17:24.300 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-14T11:17:24.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.497+0000 7f49eb1ff700 1 Processor -- start 2023-07-14T11:17:24.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.497+0000 7f49eb1ff700 1 -- start start 2023-07-14T11:17:24.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.498+0000 7f49eb1ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f49e40b8a60 0x7f49e40b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:24.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.498+0000 7f49eb1ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49e40b8e30 con 0x7f49e40b4530 2023-07-14T11:17:24.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.498+0000 7f49eb1ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49e40afaa0 con 0x7f49e40d1220 2023-07-14T11:17:24.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.498+0000 7f49eb1ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49e40afd80 con 0x7f49e40b8a60 2023-07-14T11:17:24.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.498+0000 7f49e8f9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f49e40b8a60 0x7f49e40b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:24.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.498+0000 7f49e3fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f49e40b4530 0x7f49e40d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:35838/0 (socket says 172.21.15.84:35838) 2023-07-14T11:17:24.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.498+0000 7f49e3fff700 1 -- 172.21.15.84:0/688236655 learned_addr learned my addr 172.21.15.84:0/688236655 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:17:24.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.499+0000 7f49e37fe700 1 -- 172.21.15.84:0/688236655 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1691439538 0 0) 0x7f49e40b8e30 con 0x7f49e40b4530 2023-07-14T11:17:24.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.499+0000 7f49e37fe700 1 -- 172.21.15.84:0/688236655 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49d40035b0 con 0x7f49e40b4530 2023-07-14T11:17:24.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.499+0000 7f49e8f9b700 1 -- 172.21.15.84:0/688236655 >> v1:172.21.15.179:6789/0 conn(0x7f49e40d1220 legacy=0x7f49e40b0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:24.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.499+0000 7f49e8f9b700 1 -- 172.21.15.84:0/688236655 >> v1:172.21.15.84:6789/0 conn(0x7f49e40b4530 legacy=0x7f49e40d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:24.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.499+0000 7f49e8f9b700 1 -- 172.21.15.84:0/688236655 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e40b0060 con 0x7f49e40b8a60 2023-07-14T11:17:24.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.499+0000 7f49e8f9b700 1 --2- 172.21.15.84:0/688236655 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49e40b8a60 0x7f49e40b3ff0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f49d8009840 tx=0x7f49d8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e5fc97d0bcd40a7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:24.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.499+0000 7f49e37fe700 1 -- 172.21.15.84:0/688236655 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d8004230 con 0x7f49e40b8a60 2023-07-14T11:17:24.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.499+0000 7f49e37fe700 1 -- 172.21.15.84:0/688236655 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49d8004390 con 0x7f49e40b8a60 2023-07-14T11:17:24.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.499+0000 7f49e37fe700 1 -- 172.21.15.84:0/688236655 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d80036c0 con 0x7f49e40b8a60 2023-07-14T11:17:24.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.500+0000 7f49eb1ff700 1 -- 172.21.15.84:0/688236655 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49e40b8a60 msgr2=0x7f49e40b3ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:24.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.500+0000 7f49eb1ff700 1 --2- 172.21.15.84:0/688236655 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49e40b8a60 0x7f49e40b3ff0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f49d8009840 tx=0x7f49d8009b50 comp rx=0 tx=0).stop 2023-07-14T11:17:24.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.500+0000 7f49eb1ff700 1 -- 172.21.15.84:0/688236655 shutdown_connections 2023-07-14T11:17:24.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.500+0000 7f49eb1ff700 1 --2- 172.21.15.84:0/688236655 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49e40b8a60 0x7f49e40b3ff0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:24.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.500+0000 7f49eb1ff700 1 -- 172.21.15.84:0/688236655 >> 172.21.15.84:0/688236655 conn(0x7f49e409c1b0 msgr2=0x7f49e40d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:24.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.500+0000 7f49eb1ff700 1 -- 172.21.15.84:0/688236655 shutdown_connections 2023-07-14T11:17:24.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.500+0000 7f49eb1ff700 1 -- 172.21.15.84:0/688236655 wait complete. 2023-07-14T11:17:24.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.502+0000 7f49eb1ff700 1 Processor -- start 2023-07-14T11:17:24.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.502+0000 7f49eb1ff700 1 -- start start 2023-07-14T11:17:24.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.503+0000 7f49eb1ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49e40b4530 0x7f49e40cc970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:24.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.504+0000 7f49eb1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49e40b8a60 0x7f49e40ca010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:24.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.504+0000 7f49eb1ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49e40d1220 0x7f49e4151950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:24.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.504+0000 7f49eb1ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e40cb6e0 con 0x7f49e40b4530 2023-07-14T11:17:24.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.504+0000 7f49eb1ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e40cbb70 con 0x7f49e40d1220 2023-07-14T11:17:24.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.504+0000 7f49eb1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49e40caad0 con 0x7f49e40b8a60 2023-07-14T11:17:24.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.504+0000 7f49e8f9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49e40b4530 0x7f49e40cc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:24.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.504+0000 7f49e8f9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49e40b4530 0x7f49e40cc970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59012/0 (socket says 172.21.15.84:59012) 2023-07-14T11:17:24.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.504+0000 7f49e8f9b700 1 -- 172.21.15.84:0/1962961102 learned_addr learned my addr 172.21.15.84:0/1962961102 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:24.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.504+0000 7f49e979c700 1 --2- 172.21.15.84:0/1962961102 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49e40d1220 0x7f49e4151950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:24.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.504+0000 7f49e3fff700 1 --2- 172.21.15.84:0/1962961102 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49e40b8a60 0x7f49e40ca010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:24.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.504+0000 7f49e8f9b700 1 -- 172.21.15.84:0/1962961102 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49e40b8a60 msgr2=0x7f49e40ca010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:24.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.504+0000 7f49e8f9b700 1 --2- 172.21.15.84:0/1962961102 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49e40b8a60 0x7f49e40ca010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:24.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.504+0000 7f49e8f9b700 1 -- 172.21.15.84:0/1962961102 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49e40d1220 msgr2=0x7f49e4151950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:24.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.504+0000 7f49e8f9b700 1 --2- 172.21.15.84:0/1962961102 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49e40d1220 0x7f49e4151950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:24.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.504+0000 7f49e8f9b700 1 -- 172.21.15.84:0/1962961102 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d80094a0 con 0x7f49e40b4530 2023-07-14T11:17:24.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.504+0000 7f49e979c700 1 --2- 172.21.15.84:0/1962961102 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49e40d1220 0x7f49e4151950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:17:24.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.504+0000 7f49e3fff700 1 --2- 172.21.15.84:0/1962961102 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49e40b8a60 0x7f49e40ca010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:17:24.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.504+0000 7f49e8f9b700 1 --2- 172.21.15.84:0/1962961102 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49e40b4530 0x7f49e40cc970 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f49d80090b0 tx=0x7f49d8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:24.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.505+0000 7f49e17fa700 1 -- 172.21.15.84:0/1962961102 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d8011630 con 0x7f49e40b4530 2023-07-14T11:17:24.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.505+0000 7f49e17fa700 1 -- 172.21.15.84:0/1962961102 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49d8011790 con 0x7f49e40b4530 2023-07-14T11:17:24.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.505+0000 7f49eb1ff700 1 -- 172.21.15.84:0/1962961102 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49e40cadb0 con 0x7f49e40b4530 2023-07-14T11:17:24.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.505+0000 7f49e17fa700 1 -- 172.21.15.84:0/1962961102 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d8011b00 con 0x7f49e40b4530 2023-07-14T11:17:24.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.505+0000 7f49eb1ff700 1 -- 172.21.15.84:0/1962961102 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49e40cb370 con 0x7f49e40b4530 2023-07-14T11:17:24.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.506+0000 7f49eb1ff700 1 -- 172.21.15.84:0/1962961102 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49e4074350 con 0x7f49e40b4530 2023-07-14T11:17:24.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.507+0000 7f49e17fa700 1 -- 172.21.15.84:0/1962961102 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 9) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f49d8018040 con 0x7f49e40b4530 2023-07-14T11:17:24.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.508+0000 7f49e17fa700 1 --2- 172.21.15.84:0/1962961102 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f49c806aec0 0x7f49c806d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:24.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.508+0000 7f49e17fa700 1 -- 172.21.15.84:0/1962961102 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f49d808a1c0 con 0x7f49e40b4530 2023-07-14T11:17:24.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.508+0000 7f49e3fff700 1 --2- 172.21.15.84:0/1962961102 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f49c806aec0 0x7f49c806d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:24.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.509+0000 7f49e3fff700 1 --2- 172.21.15.84:0/1962961102 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f49c806aec0 0x7f49c806d370 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f49e40cea60 tx=0x7f49d0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:24.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.513+0000 7f49e17fa700 1 -- 172.21.15.84:0/1962961102 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f49d8054ec0 con 0x7f49e40b4530 2023-07-14T11:17:24.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.709+0000 7f49eb1ff700 1 -- 172.21.15.84:0/1962961102 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f49e40b2260 con 0x7f49e40b4530 2023-07-14T11:17:24.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.710+0000 7f49e17fa700 1 -- 172.21.15.84:0/1962961102 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f49d80160c0 con 0x7f49e40b4530 2023-07-14T11:17:24.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.712+0000 7f49eb1ff700 1 -- 172.21.15.84:0/1962961102 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f49c806aec0 msgr2=0x7f49c806d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:24.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.712+0000 7f49eb1ff700 1 --2- 172.21.15.84:0/1962961102 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f49c806aec0 0x7f49c806d370 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f49e40cea60 tx=0x7f49d0009040 comp rx=0 tx=0).stop 2023-07-14T11:17:24.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.712+0000 7f49eb1ff700 1 -- 172.21.15.84:0/1962961102 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49e40b4530 msgr2=0x7f49e40cc970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:24.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.712+0000 7f49eb1ff700 1 --2- 172.21.15.84:0/1962961102 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49e40b4530 0x7f49e40cc970 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f49d80090b0 tx=0x7f49d8004750 comp rx=0 tx=0).stop 2023-07-14T11:17:24.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.712+0000 7f49eb1ff700 1 -- 172.21.15.84:0/1962961102 shutdown_connections 2023-07-14T11:17:24.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.712+0000 7f49eb1ff700 1 --2- 172.21.15.84:0/1962961102 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49e40d1220 0x7f49e4151950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:24.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.712+0000 7f49eb1ff700 1 --2- 172.21.15.84:0/1962961102 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49e40b4530 0x7f49e40cc970 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:24.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.712+0000 7f49eb1ff700 1 --2- 172.21.15.84:0/1962961102 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f49c806aec0 0x7f49c806d370 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:24.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.712+0000 7f49eb1ff700 1 --2- 172.21.15.84:0/1962961102 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49e40b8a60 0x7f49e40ca010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:24.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.712+0000 7f49eb1ff700 1 -- 172.21.15.84:0/1962961102 >> 172.21.15.84:0/1962961102 conn(0x7f49e409c1b0 msgr2=0x7f49e415c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:24.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.712+0000 7f49eb1ff700 1 -- 172.21.15.84:0/1962961102 shutdown_connections 2023-07-14T11:17:24.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:24.712+0000 7f49eb1ff700 1 -- 172.21.15.84:0/1962961102 wait complete. 2023-07-14T11:17:24.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:17:24.733 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p ./volumes/_nogroup/subvolume_0000000000851779) 2023-07-14T11:17:24.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:17:24.813 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool .) 2023-07-14T11:17:24.861 INFO:teuthology.orchestra.run.smithi084.stdout:cephfs_data 2023-07-14T11:17:24.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:17:24.862 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo setfattr -n ceph.dir.layout.pool -v cephfs_data ./volumes/_nogroup/subvolume_0000000000851779) 2023-07-14T11:17:24.937 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvolume_0000000000851780 2023-07-14T11:17:25.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.134+0000 7fd955fff700 1 Processor -- start 2023-07-14T11:17:25.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.134+0000 7fd955fff700 1 -- start start 2023-07-14T11:17:25.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.135+0000 7fd955fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd9500b4d00 0x7fd9500d19d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:25.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.135+0000 7fd955fff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9500d02a0 con 0x7fd9500b8660 2023-07-14T11:17:25.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.135+0000 7fd955fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9500cfce0 con 0x7fd9500b4860 2023-07-14T11:17:25.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.135+0000 7fd955fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9500cffc0 con 0x7fd9500b4d00 2023-07-14T11:17:25.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.135+0000 7fd94f7fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fd9500b8660 0x7fd9500cd430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:35852/0 (socket says 172.21.15.84:35852) 2023-07-14T11:17:25.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.135+0000 7fd94f7fe700 1 -- 172.21.15.84:0/2467007926 learned_addr learned my addr 172.21.15.84:0/2467007926 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:17:25.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.136+0000 7fd94ffff700 1 --2- 172.21.15.84:0/2467007926 >> v2:172.21.15.179:3300/0 conn(0x7fd9500b4d00 0x7fd9500d19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:25.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.136+0000 7fd94e7fc700 1 -- 172.21.15.84:0/2467007926 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1330586847 0 0) 0x7fd9500d02a0 con 0x7fd9500b8660 2023-07-14T11:17:25.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.136+0000 7fd94e7fc700 1 -- 172.21.15.84:0/2467007926 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9380035b0 con 0x7fd9500b8660 2023-07-14T11:17:25.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.136+0000 7fd94e7fc700 1 -- 172.21.15.84:0/2467007926 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1065154590 0 0) 0x7fd9380035b0 con 0x7fd9500b8660 2023-07-14T11:17:25.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.136+0000 7fd94e7fc700 1 -- 172.21.15.84:0/2467007926 >> v2:172.21.15.179:3300/0 conn(0x7fd9500b4d00 msgr2=0x7fd9500d19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:25.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.136+0000 7fd94e7fc700 1 --2- 172.21.15.84:0/2467007926 >> v2:172.21.15.179:3300/0 conn(0x7fd9500b4d00 0x7fd9500d19d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:25.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.136+0000 7fd94e7fc700 1 -- 172.21.15.84:0/2467007926 >> v1:172.21.15.179:6789/0 conn(0x7fd9500b4860 legacy=0x7fd9500d12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:25.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.136+0000 7fd94e7fc700 1 -- 172.21.15.84:0/2467007926 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9500d0ac0 con 0x7fd9500b8660 2023-07-14T11:17:25.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.136+0000 7fd94e7fc700 1 -- 172.21.15.84:0/2467007926 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7fd940001670 con 0x7fd9500b8660 2023-07-14T11:17:25.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.136+0000 7fd94e7fc700 1 -- 172.21.15.84:0/2467007926 >> v1:172.21.15.84:6789/0 conn(0x7fd9500b8660 legacy=0x7fd9500cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:25.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.136+0000 7fd94e7fc700 1 --2- 172.21.15.84:0/2467007926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd938003a00 0x7fd938003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:25.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.136+0000 7fd94e7fc700 1 --2- 172.21.15.84:0/2467007926 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9380043f0 0x7fd9380048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:25.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.136+0000 7fd94e7fc700 1 --2- 172.21.15.84:0/2467007926 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9380050b0 0x7fd93800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:25.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.136+0000 7fd94e7fc700 1 -- 172.21.15.84:0/2467007926 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9500cffc0 con 0x7fd938003a00 2023-07-14T11:17:25.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.136+0000 7fd94e7fc700 1 -- 172.21.15.84:0/2467007926 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd93800c000 con 0x7fd9380050b0 2023-07-14T11:17:25.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.136+0000 7fd94e7fc700 1 -- 172.21.15.84:0/2467007926 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd93800c1c0 con 0x7fd9380043f0 2023-07-14T11:17:25.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.137+0000 7fd94f7fe700 1 --2- 172.21.15.84:0/2467007926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd938003a00 0x7fd938003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:25.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.137+0000 7fd94ffff700 1 --2- 172.21.15.84:0/2467007926 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9380050b0 0x7fd93800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:25.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.137+0000 7fd94effd700 1 --2- 172.21.15.84:0/2467007926 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9380043f0 0x7fd9380048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:25.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.137+0000 7fd94f7fe700 1 -- 172.21.15.84:0/2467007926 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9380043f0 msgr2=0x7fd9380048b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:25.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.137+0000 7fd94f7fe700 1 --2- 172.21.15.84:0/2467007926 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9380043f0 0x7fd9380048b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:25.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.137+0000 7fd94f7fe700 1 -- 172.21.15.84:0/2467007926 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9380050b0 msgr2=0x7fd93800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:25.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.137+0000 7fd94f7fe700 1 --2- 172.21.15.84:0/2467007926 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9380050b0 0x7fd93800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:25.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.137+0000 7fd94f7fe700 1 -- 172.21.15.84:0/2467007926 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9380035b0 con 0x7fd938003a00 2023-07-14T11:17:25.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.137+0000 7fd94ffff700 1 --2- 172.21.15.84:0/2467007926 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9380050b0 0x7fd93800ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:17:25.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.137+0000 7fd94ffff700 1 -- 172.21.15.84:0/2467007926 reap_dead start 2023-07-14T11:17:25.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.137+0000 7fd94f7fe700 1 --2- 172.21.15.84:0/2467007926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd938003a00 0x7fd938003dd0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fd94000c240 tx=0x7fd938005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7146ca73f849c70 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:25.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.137+0000 7fd94e7fc700 1 -- 172.21.15.84:0/2467007926 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94000cde0 con 0x7fd938003a00 2023-07-14T11:17:25.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.137+0000 7fd94e7fc700 1 -- 172.21.15.84:0/2467007926 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd940007ba0 con 0x7fd938003a00 2023-07-14T11:17:25.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.137+0000 7fd94e7fc700 1 -- 172.21.15.84:0/2467007926 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd940005ba0 con 0x7fd938003a00 2023-07-14T11:17:25.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.138+0000 7fd955fff700 1 -- 172.21.15.84:0/2467007926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd938003a00 msgr2=0x7fd938003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:25.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.138+0000 7fd955fff700 1 --2- 172.21.15.84:0/2467007926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd938003a00 0x7fd938003dd0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fd94000c240 tx=0x7fd938005880 comp rx=0 tx=0).stop 2023-07-14T11:17:25.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.138+0000 7fd955fff700 1 -- 172.21.15.84:0/2467007926 shutdown_connections 2023-07-14T11:17:25.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.138+0000 7fd955fff700 1 --2- 172.21.15.84:0/2467007926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd938003a00 0x7fd938003dd0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:25.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.138+0000 7fd955fff700 1 -- 172.21.15.84:0/2467007926 >> 172.21.15.84:0/2467007926 conn(0x7fd950066860 msgr2=0x7fd95006a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:25.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.138+0000 7fd955fff700 1 -- 172.21.15.84:0/2467007926 shutdown_connections 2023-07-14T11:17:25.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.138+0000 7fd955fff700 1 -- 172.21.15.84:0/2467007926 wait complete. 2023-07-14T11:17:25.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.140+0000 7fd955fff700 1 Processor -- start 2023-07-14T11:17:25.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.140+0000 7fd955fff700 1 -- start start 2023-07-14T11:17:25.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.141+0000 7fd955fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd938003a00 0x7fd9500cb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:25.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.141+0000 7fd955fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd95014e100 0x7fd9500c9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:25.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.141+0000 7fd955fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9500ca3f0 0x7fd9500cc670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:25.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.141+0000 7fd955fff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9500cbee0 con 0x7fd9500ca3f0 2023-07-14T11:17:25.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.141+0000 7fd955fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9500cb510 con 0x7fd938003a00 2023-07-14T11:17:25.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.141+0000 7fd955fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9500ca900 con 0x7fd95014e100 2023-07-14T11:17:25.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.141+0000 7fd94ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9500ca3f0 0x7fd9500cc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:25.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.141+0000 7fd94ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9500ca3f0 0x7fd9500cc670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59018/0 (socket says 172.21.15.84:59018) 2023-07-14T11:17:25.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.141+0000 7fd94ffff700 1 -- 172.21.15.84:0/1108347932 learned_addr learned my addr 172.21.15.84:0/1108347932 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:25.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.142+0000 7fd94ffff700 1 -- 172.21.15.84:0/1108347932 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd95014e100 msgr2=0x7fd9500c9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:25.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.142+0000 7fd94ffff700 1 --2- 172.21.15.84:0/1108347932 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd95014e100 0x7fd9500c9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:25.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.142+0000 7fd94ffff700 1 -- 172.21.15.84:0/1108347932 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd938003a00 msgr2=0x7fd9500cb9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:25.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.142+0000 7fd94ffff700 1 --2- 172.21.15.84:0/1108347932 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd938003a00 0x7fd9500cb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:25.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.142+0000 7fd94ffff700 1 -- 172.21.15.84:0/1108347932 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9500cabe0 con 0x7fd9500ca3f0 2023-07-14T11:17:25.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.142+0000 7fd94ffff700 1 --2- 172.21.15.84:0/1108347932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9500ca3f0 0x7fd9500cc670 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fd9500c68e0 tx=0x7fd9480104a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:25.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.142+0000 7fd937fff700 1 -- 172.21.15.84:0/1108347932 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94801b070 con 0x7fd9500ca3f0 2023-07-14T11:17:25.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.142+0000 7fd937fff700 1 -- 172.21.15.84:0/1108347932 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd94800f040 con 0x7fd9500ca3f0 2023-07-14T11:17:25.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.142+0000 7fd955fff700 1 -- 172.21.15.84:0/1108347932 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9500caec0 con 0x7fd9500ca3f0 2023-07-14T11:17:25.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.142+0000 7fd937fff700 1 -- 172.21.15.84:0/1108347932 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94800e050 con 0x7fd9500ca3f0 2023-07-14T11:17:25.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.142+0000 7fd955fff700 1 -- 172.21.15.84:0/1108347932 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd95014e570 con 0x7fd9500ca3f0 2023-07-14T11:17:25.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.143+0000 7fd955fff700 1 -- 172.21.15.84:0/1108347932 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9500b5120 con 0x7fd9500ca3f0 2023-07-14T11:17:25.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.144+0000 7fd937fff700 1 -- 172.21.15.84:0/1108347932 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 9) v1 ==== 89190+0+0 (secure 0 0 0) 0x7fd948015440 con 0x7fd9500ca3f0 2023-07-14T11:17:25.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.146+0000 7fd937fff700 1 --2- 172.21.15.84:0/1108347932 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fd93c06ae90 0x7fd93c06d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:25.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.146+0000 7fd937fff700 1 -- 172.21.15.84:0/1108347932 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd9480898f0 con 0x7fd9500ca3f0 2023-07-14T11:17:25.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.146+0000 7fd94f7fe700 1 --2- 172.21.15.84:0/1108347932 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fd93c06ae90 0x7fd93c06d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:25.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.146+0000 7fd94f7fe700 1 --2- 172.21.15.84:0/1108347932 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fd93c06ae90 0x7fd93c06d340 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fd940007d50 tx=0x7fd94000a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:25.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.150+0000 7fd937fff700 1 -- 172.21.15.84:0/1108347932 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fd948054570 con 0x7fd9500ca3f0 2023-07-14T11:17:25.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.375+0000 7fd955fff700 1 -- 172.21.15.84:0/1108347932 --> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_0000000000851780", "target": ["mon-mgr", ""]}) v1 -- 0x7fd9500d0da0 con 0x7fd93c06ae90 2023-07-14T11:17:25.382 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:17:25.380+0000 7fed0d3be700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T11:17:25.383 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:17:25.380+0000 7fed0d3be700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T11:17:25.383 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:17:25.380+0000 7fed0d3be700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T11:17:25.383 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:17:25.380+0000 7fed0d3be700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T11:17:25.383 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:17:25.380+0000 7fed0d3be700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T11:17:25.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.423+0000 7fd937fff700 1 -- 172.21.15.84:0/1108347932 <== mgr.4104 v2:172.21.15.84:6832/379617029 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fd94000cd60 con 0x7fd93c06ae90 2023-07-14T11:17:25.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.425+0000 7fd955fff700 1 -- 172.21.15.84:0/1108347932 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fd93c06ae90 msgr2=0x7fd93c06d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:25.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.425+0000 7fd955fff700 1 --2- 172.21.15.84:0/1108347932 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fd93c06ae90 0x7fd93c06d340 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fd940007d50 tx=0x7fd94000a000 comp rx=0 tx=0).stop 2023-07-14T11:17:25.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.425+0000 7fd955fff700 1 -- 172.21.15.84:0/1108347932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9500ca3f0 msgr2=0x7fd9500cc670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:25.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.425+0000 7fd955fff700 1 --2- 172.21.15.84:0/1108347932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9500ca3f0 0x7fd9500cc670 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fd9500c68e0 tx=0x7fd9480104a0 comp rx=0 tx=0).stop 2023-07-14T11:17:25.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.425+0000 7fd955fff700 1 -- 172.21.15.84:0/1108347932 shutdown_connections 2023-07-14T11:17:25.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.425+0000 7fd955fff700 1 --2- 172.21.15.84:0/1108347932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9500ca3f0 0x7fd9500cc670 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:25.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.425+0000 7fd955fff700 1 --2- 172.21.15.84:0/1108347932 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd938003a00 0x7fd9500cb9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:25.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.425+0000 7fd955fff700 1 --2- 172.21.15.84:0/1108347932 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fd93c06ae90 0x7fd93c06d340 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:25.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.425+0000 7fd955fff700 1 --2- 172.21.15.84:0/1108347932 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd95014e100 0x7fd9500c9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:25.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.425+0000 7fd955fff700 1 -- 172.21.15.84:0/1108347932 >> 172.21.15.84:0/1108347932 conn(0x7fd950066860 msgr2=0x7fd9500b6aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:25.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.425+0000 7fd955fff700 1 -- 172.21.15.84:0/1108347932 shutdown_connections 2023-07-14T11:17:25.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:25.425+0000 7fd955fff700 1 -- 172.21.15.84:0/1108347932 wait complete. 2023-07-14T11:17:25.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:17:25.446 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cp ./volumes/_nogroup/subvolume_0000000000851780/.meta ./volumes/_nogroup/subvolume_0000000000851779) 2023-07-14T11:17:27.579 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvolume_0000000000851779 2023-07-14T11:17:27.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.783+0000 7ffb635ff700 1 Processor -- start 2023-07-14T11:17:27.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.783+0000 7ffb635ff700 1 -- start start 2023-07-14T11:17:27.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.784+0000 7ffb635ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ffb5c158bb0 0x7ffb5c0cd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:27.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.784+0000 7ffb635ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb5c0ce8c0 con 0x7ffb5c0ce150 2023-07-14T11:17:27.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.784+0000 7ffb635ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb5c0cc2b0 con 0x7ffb5c0cbe40 2023-07-14T11:17:27.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.784+0000 7ffb635ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb5c06b5b0 con 0x7ffb5c158bb0 2023-07-14T11:17:27.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.784+0000 7ffb61b9c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7ffb5c0ce150 0x7ffb5c06ba00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:35864/0 (socket says 172.21.15.84:35864) 2023-07-14T11:17:27.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.784+0000 7ffb61b9c700 1 -- 172.21.15.84:0/3091215232 learned_addr learned my addr 172.21.15.84:0/3091215232 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:17:27.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.785+0000 7ffb6139b700 1 --2- 172.21.15.84:0/3091215232 >> v2:172.21.15.179:3300/0 conn(0x7ffb5c158bb0 0x7ffb5c0cd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:27.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.785+0000 7ffb53fff700 1 -- 172.21.15.84:0/3091215232 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1078651280 0 0) 0x7ffb5c0ce8c0 con 0x7ffb5c0ce150 2023-07-14T11:17:27.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.785+0000 7ffb53fff700 1 -- 172.21.15.84:0/3091215232 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb480035b0 con 0x7ffb5c0ce150 2023-07-14T11:17:27.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.785+0000 7ffb53fff700 1 -- 172.21.15.84:0/3091215232 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 170449654 0 0) 0x7ffb5c0cc2b0 con 0x7ffb5c0cbe40 2023-07-14T11:17:27.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.785+0000 7ffb53fff700 1 -- 172.21.15.84:0/3091215232 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb5c0ce8c0 con 0x7ffb5c0cbe40 2023-07-14T11:17:27.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.785+0000 7ffb53fff700 1 -- 172.21.15.84:0/3091215232 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1353391769 0 0) 0x7ffb480035b0 con 0x7ffb5c0ce150 2023-07-14T11:17:27.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.785+0000 7ffb53fff700 1 -- 172.21.15.84:0/3091215232 >> v2:172.21.15.179:3300/0 conn(0x7ffb5c158bb0 msgr2=0x7ffb5c0cd0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:27.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.785+0000 7ffb53fff700 1 --2- 172.21.15.84:0/3091215232 >> v2:172.21.15.179:3300/0 conn(0x7ffb5c158bb0 0x7ffb5c0cd0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:27.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.785+0000 7ffb53fff700 1 -- 172.21.15.84:0/3091215232 >> v1:172.21.15.179:6789/0 conn(0x7ffb5c0cbe40 legacy=0x7ffb5c0cda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:27.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.785+0000 7ffb53fff700 1 -- 172.21.15.84:0/3091215232 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb5c0cae30 con 0x7ffb5c0ce150 2023-07-14T11:17:27.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.785+0000 7ffb53fff700 1 -- 172.21.15.84:0/3091215232 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7ffb540019f0 con 0x7ffb5c0ce150 2023-07-14T11:17:27.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.785+0000 7ffb53fff700 1 -- 172.21.15.84:0/3091215232 >> v1:172.21.15.84:6789/0 conn(0x7ffb5c0ce150 legacy=0x7ffb5c06ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:27.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.785+0000 7ffb53fff700 1 --2- 172.21.15.84:0/3091215232 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb48003be0 0x7ffb48003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:27.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.785+0000 7ffb53fff700 1 --2- 172.21.15.84:0/3091215232 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb48004850 0x7ffb48004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:27.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.785+0000 7ffb53fff700 1 --2- 172.21.15.84:0/3091215232 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb48005200 0x7ffb4800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:27.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.785+0000 7ffb53fff700 1 -- 172.21.15.84:0/3091215232 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb5c06b5b0 con 0x7ffb48003be0 2023-07-14T11:17:27.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.785+0000 7ffb53fff700 1 -- 172.21.15.84:0/3091215232 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4800e2f0 con 0x7ffb48004850 2023-07-14T11:17:27.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.785+0000 7ffb53fff700 1 -- 172.21.15.84:0/3091215232 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4800e480 con 0x7ffb48005200 2023-07-14T11:17:27.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.786+0000 7ffb6139b700 1 --2- 172.21.15.84:0/3091215232 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb48003be0 0x7ffb48003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:27.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.786+0000 7ffb60b9a700 1 --2- 172.21.15.84:0/3091215232 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb48004850 0x7ffb48004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:27.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.786+0000 7ffb61b9c700 1 --2- 172.21.15.84:0/3091215232 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb48005200 0x7ffb4800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:27.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.786+0000 7ffb6139b700 1 -- 172.21.15.84:0/3091215232 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb48005200 msgr2=0x7ffb4800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:27.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.786+0000 7ffb6139b700 1 --2- 172.21.15.84:0/3091215232 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb48005200 0x7ffb4800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:27.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.786+0000 7ffb6139b700 1 -- 172.21.15.84:0/3091215232 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb48004850 msgr2=0x7ffb48004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:27.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.786+0000 7ffb6139b700 1 --2- 172.21.15.84:0/3091215232 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb48004850 0x7ffb48004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:27.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.786+0000 7ffb6139b700 1 -- 172.21.15.84:0/3091215232 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb480035b0 con 0x7ffb48003be0 2023-07-14T11:17:27.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.786+0000 7ffb61b9c700 1 --2- 172.21.15.84:0/3091215232 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb48005200 0x7ffb4800ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:17:27.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.786+0000 7ffb61b9c700 1 -- 172.21.15.84:0/3091215232 reap_dead start 2023-07-14T11:17:27.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.786+0000 7ffb6139b700 1 --2- 172.21.15.84:0/3091215232 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb48003be0 0x7ffb48003fd0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7ffb5800aab0 tx=0x7ffb48005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=237336c23453c1bd server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:27.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.786+0000 7ffb53fff700 1 -- 172.21.15.84:0/3091215232 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb5800e960 con 0x7ffb48003be0 2023-07-14T11:17:27.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.786+0000 7ffb53fff700 1 -- 172.21.15.84:0/3091215232 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb5800eac0 con 0x7ffb48003be0 2023-07-14T11:17:27.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.786+0000 7ffb53fff700 1 -- 172.21.15.84:0/3091215232 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb5800ee50 con 0x7ffb48003be0 2023-07-14T11:17:27.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.787+0000 7ffb635ff700 1 -- 172.21.15.84:0/3091215232 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb48003be0 msgr2=0x7ffb48003fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:27.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.787+0000 7ffb635ff700 1 --2- 172.21.15.84:0/3091215232 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb48003be0 0x7ffb48003fd0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7ffb5800aab0 tx=0x7ffb48005880 comp rx=0 tx=0).stop 2023-07-14T11:17:27.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.787+0000 7ffb635ff700 1 -- 172.21.15.84:0/3091215232 shutdown_connections 2023-07-14T11:17:27.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.787+0000 7ffb635ff700 1 --2- 172.21.15.84:0/3091215232 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb48003be0 0x7ffb48003fd0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:27.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.787+0000 7ffb635ff700 1 -- 172.21.15.84:0/3091215232 >> 172.21.15.84:0/3091215232 conn(0x7ffb5c0b05d0 msgr2=0x7ffb5c0b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:27.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.787+0000 7ffb635ff700 1 -- 172.21.15.84:0/3091215232 shutdown_connections 2023-07-14T11:17:27.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.787+0000 7ffb635ff700 1 -- 172.21.15.84:0/3091215232 wait complete. 2023-07-14T11:17:27.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.789+0000 7ffb635ff700 1 Processor -- start 2023-07-14T11:17:27.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.789+0000 7ffb635ff700 1 -- start start 2023-07-14T11:17:27.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.790+0000 7ffb635ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb48003be0 0x7ffb5c14fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:27.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.790+0000 7ffb635ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb5c0b2a70 0x7ffb5c06fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:27.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.790+0000 7ffb635ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb5c070250 0x7ffb5c0c29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:27.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.790+0000 7ffb635ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb5c0706c0 con 0x7ffb5c070250 2023-07-14T11:17:27.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.790+0000 7ffb635ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb5c0c4bd0 con 0x7ffb48003be0 2023-07-14T11:17:27.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.790+0000 7ffb635ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb5c0c4eb0 con 0x7ffb5c0b2a70 2023-07-14T11:17:27.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.790+0000 7ffb61b9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb5c070250 0x7ffb5c0c29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:27.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.790+0000 7ffb61b9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb5c070250 0x7ffb5c0c29b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59050/0 (socket says 172.21.15.84:59050) 2023-07-14T11:17:27.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.790+0000 7ffb61b9c700 1 -- 172.21.15.84:0/12564731 learned_addr learned my addr 172.21.15.84:0/12564731 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:27.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.790+0000 7ffb61b9c700 1 -- 172.21.15.84:0/12564731 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb5c0b2a70 msgr2=0x7ffb5c06fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:27.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.790+0000 7ffb60b9a700 1 --2- 172.21.15.84:0/12564731 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb5c0b2a70 0x7ffb5c06fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:27.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.790+0000 7ffb6139b700 1 --2- 172.21.15.84:0/12564731 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb48003be0 0x7ffb5c14fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:27.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.790+0000 7ffb61b9c700 1 --2- 172.21.15.84:0/12564731 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb5c0b2a70 0x7ffb5c06fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:27.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.790+0000 7ffb61b9c700 1 -- 172.21.15.84:0/12564731 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb48003be0 msgr2=0x7ffb5c14fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:27.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.790+0000 7ffb61b9c700 1 --2- 172.21.15.84:0/12564731 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb48003be0 0x7ffb5c14fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:27.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.790+0000 7ffb61b9c700 1 -- 172.21.15.84:0/12564731 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb5c0c5190 con 0x7ffb5c070250 2023-07-14T11:17:27.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.790+0000 7ffb60b9a700 1 --2- 172.21.15.84:0/12564731 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb5c0b2a70 0x7ffb5c06fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:17:27.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.790+0000 7ffb6139b700 1 --2- 172.21.15.84:0/12564731 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb48003be0 0x7ffb5c14fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:17:27.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.791+0000 7ffb61b9c700 1 --2- 172.21.15.84:0/12564731 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb5c070250 0x7ffb5c0c29b0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c0c25c0 tx=0x7ffb5400e4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:27.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.791+0000 7ffb51ffb700 1 -- 172.21.15.84:0/12564731 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb5400ed80 con 0x7ffb5c070250 2023-07-14T11:17:27.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.791+0000 7ffb51ffb700 1 -- 172.21.15.84:0/12564731 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb54013420 con 0x7ffb5c070250 2023-07-14T11:17:27.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.791+0000 7ffb51ffb700 1 -- 172.21.15.84:0/12564731 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb5400eee0 con 0x7ffb5c070250 2023-07-14T11:17:27.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.791+0000 7ffb635ff700 1 -- 172.21.15.84:0/12564731 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb5c0c5470 con 0x7ffb5c070250 2023-07-14T11:17:27.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.791+0000 7ffb635ff700 1 -- 172.21.15.84:0/12564731 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb5c150370 con 0x7ffb5c070250 2023-07-14T11:17:27.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.792+0000 7ffb635ff700 1 -- 172.21.15.84:0/12564731 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb5c0c5660 con 0x7ffb5c070250 2023-07-14T11:17:27.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.793+0000 7ffb51ffb700 1 -- 172.21.15.84:0/12564731 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 10) v1 ==== 89241+0+0 (secure 0 0 0) 0x7ffb540137d0 con 0x7ffb5c070250 2023-07-14T11:17:27.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.794+0000 7ffb51ffb700 1 --2- 172.21.15.84:0/12564731 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ffb4006af20 0x7ffb4006d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:27.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.795+0000 7ffb51ffb700 1 -- 172.21.15.84:0/12564731 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ffb54089f70 con 0x7ffb5c070250 2023-07-14T11:17:27.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.795+0000 7ffb6139b700 1 --2- 172.21.15.84:0/12564731 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ffb4006af20 0x7ffb4006d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:27.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.795+0000 7ffb6139b700 1 --2- 172.21.15.84:0/12564731 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ffb4006af20 0x7ffb4006d3d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ffb5800aab0 tx=0x7ffb58008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:27.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:27.799+0000 7ffb51ffb700 1 -- 172.21.15.84:0/12564731 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ffb54054cf0 con 0x7ffb5c070250 2023-07-14T11:17:28.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.026+0000 7ffb635ff700 1 -- 172.21.15.84:0/12564731 --> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_0000000000851779", "target": ["mon-mgr", ""]}) v1 -- 0x7ffb5c0cb110 con 0x7ffb4006af20 2023-07-14T11:17:28.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.066+0000 7ffb51ffb700 1 -- 172.21.15.84:0/12564731 <== mgr.4104 v2:172.21.15.84:6832/379617029 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+45 (secure 0 0 0) 0x7ffb5800e8c0 con 0x7ffb4006af20 2023-07-14T11:17:28.069 INFO:teuthology.orchestra.run.smithi084.stdout:/volumes/_nogroup/subvolume_0000000000851779 2023-07-14T11:17:28.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.068+0000 7ffb635ff700 1 -- 172.21.15.84:0/12564731 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ffb4006af20 msgr2=0x7ffb4006d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:28.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.068+0000 7ffb635ff700 1 --2- 172.21.15.84:0/12564731 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ffb4006af20 0x7ffb4006d3d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ffb5800aab0 tx=0x7ffb58008030 comp rx=0 tx=0).stop 2023-07-14T11:17:28.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.068+0000 7ffb635ff700 1 -- 172.21.15.84:0/12564731 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb5c070250 msgr2=0x7ffb5c0c29b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:28.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.068+0000 7ffb635ff700 1 --2- 172.21.15.84:0/12564731 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb5c070250 0x7ffb5c0c29b0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c0c25c0 tx=0x7ffb5400e4f0 comp rx=0 tx=0).stop 2023-07-14T11:17:28.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.068+0000 7ffb635ff700 1 -- 172.21.15.84:0/12564731 shutdown_connections 2023-07-14T11:17:28.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.068+0000 7ffb635ff700 1 --2- 172.21.15.84:0/12564731 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb5c070250 0x7ffb5c0c29b0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:28.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.068+0000 7ffb635ff700 1 --2- 172.21.15.84:0/12564731 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb48003be0 0x7ffb5c14fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:28.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.068+0000 7ffb635ff700 1 --2- 172.21.15.84:0/12564731 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ffb4006af20 0x7ffb4006d3d0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:28.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.068+0000 7ffb635ff700 1 --2- 172.21.15.84:0/12564731 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb5c0b2a70 0x7ffb5c06fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:28.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.068+0000 7ffb635ff700 1 -- 172.21.15.84:0/12564731 >> 172.21.15.84:0/12564731 conn(0x7ffb5c0b05d0 msgr2=0x7ffb5c0b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:28.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.068+0000 7ffb635ff700 1 -- 172.21.15.84:0/12564731 shutdown_connections 2023-07-14T11:17:28.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.068+0000 7ffb635ff700 1 -- 172.21.15.84:0/12564731 wait complete. 2023-07-14T11:17:28.090 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvolume_0000000000851779 2023-07-14T11:17:28.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.287+0000 7fd060fff700 1 Processor -- start 2023-07-14T11:17:28.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.287+0000 7fd060fff700 1 -- start start 2023-07-14T11:17:28.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.288+0000 7fd060fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd05c0c92d0 0x7fd05c0ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:28.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.288+0000 7fd060fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd05c0b12f0 0x7fd05c0c96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:28.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.288+0000 7fd060fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd05c0adea0 0x7fd05c06c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:28.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.288+0000 7fd060fff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd05c15da60 con 0x7fd05c0b12f0 2023-07-14T11:17:28.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.288+0000 7fd060fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd05c15ce70 con 0x7fd05c0c92d0 2023-07-14T11:17:28.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.288+0000 7fd060fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd05c0c9be0 con 0x7fd05c0adea0 2023-07-14T11:17:28.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.289+0000 7fd059d9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd05c0b12f0 0x7fd05c0c96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:28.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.289+0000 7fd059d9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd05c0b12f0 0x7fd05c0c96a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59062/0 (socket says 172.21.15.84:59062) 2023-07-14T11:17:28.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.289+0000 7fd059d9b700 1 -- 172.21.15.84:0/1598073228 learned_addr learned my addr 172.21.15.84:0/1598073228 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:28.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.289+0000 7fd05a59c700 1 --2- 172.21.15.84:0/1598073228 >> v2:172.21.15.179:3300/0 conn(0x7fd05c0c92d0 0x7fd05c0ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:28.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.289+0000 7fd05ad9d700 1 --2- 172.21.15.84:0/1598073228 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd05c0adea0 0x7fd05c06c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:28.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.289+0000 7fd059d9b700 1 -- 172.21.15.84:0/1598073228 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd05c0adea0 msgr2=0x7fd05c06c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:28.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.289+0000 7fd059d9b700 1 --2- 172.21.15.84:0/1598073228 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd05c0adea0 0x7fd05c06c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:28.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.289+0000 7fd059d9b700 1 -- 172.21.15.84:0/1598073228 >> v2:172.21.15.179:3300/0 conn(0x7fd05c0c92d0 msgr2=0x7fd05c0ad8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:28.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.289+0000 7fd059d9b700 1 --2- 172.21.15.84:0/1598073228 >> v2:172.21.15.179:3300/0 conn(0x7fd05c0c92d0 0x7fd05c0ad8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:28.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.289+0000 7fd059d9b700 1 -- 172.21.15.84:0/1598073228 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd05c15d0c0 con 0x7fd05c0b12f0 2023-07-14T11:17:28.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.289+0000 7fd059d9b700 1 --2- 172.21.15.84:0/1598073228 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd05c0b12f0 0x7fd05c0c96a0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fd05c06f630 tx=0x7fd05000be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6ab706f881a574b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:28.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.290+0000 7fd05959a700 1 -- 172.21.15.84:0/1598073228 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05000dc70 con 0x7fd05c0b12f0 2023-07-14T11:17:28.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.290+0000 7fd05959a700 1 -- 172.21.15.84:0/1598073228 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd05000ddd0 con 0x7fd05c0b12f0 2023-07-14T11:17:28.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.290+0000 7fd05959a700 1 -- 172.21.15.84:0/1598073228 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd050010690 con 0x7fd05c0b12f0 2023-07-14T11:17:28.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.290+0000 7fd060fff700 1 -- 172.21.15.84:0/1598073228 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd05c0b12f0 msgr2=0x7fd05c0c96a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:28.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.290+0000 7fd060fff700 1 --2- 172.21.15.84:0/1598073228 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd05c0b12f0 0x7fd05c0c96a0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fd05c06f630 tx=0x7fd05000be70 comp rx=0 tx=0).stop 2023-07-14T11:17:28.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.290+0000 7fd060fff700 1 -- 172.21.15.84:0/1598073228 shutdown_connections 2023-07-14T11:17:28.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.290+0000 7fd060fff700 1 --2- 172.21.15.84:0/1598073228 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd05c0adea0 0x7fd05c06c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:28.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.290+0000 7fd060fff700 1 --2- 172.21.15.84:0/1598073228 >> v2:172.21.15.179:3300/0 conn(0x7fd05c0c92d0 0x7fd05c0ad8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:28.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.290+0000 7fd060fff700 1 --2- 172.21.15.84:0/1598073228 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd05c0b12f0 0x7fd05c0c96a0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:28.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.290+0000 7fd060fff700 1 -- 172.21.15.84:0/1598073228 >> 172.21.15.84:0/1598073228 conn(0x7fd05c0b05d0 msgr2=0x7fd05c0b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:28.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.291+0000 7fd060fff700 1 -- 172.21.15.84:0/1598073228 shutdown_connections 2023-07-14T11:17:28.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.291+0000 7fd060fff700 1 -- 172.21.15.84:0/1598073228 wait complete. 2023-07-14T11:17:28.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.293+0000 7fd060fff700 1 Processor -- start 2023-07-14T11:17:28.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.293+0000 7fd060fff700 1 -- start start 2023-07-14T11:17:28.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.294+0000 7fd060fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd05c0adea0 0x7fd05c14ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:28.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.294+0000 7fd060fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd05c0b12f0 0x7fd05c0afd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:28.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.294+0000 7fd060fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd05c0c92d0 0x7fd05c0b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:28.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.294+0000 7fd060fff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd05c0c6cf0 con 0x7fd05c0c92d0 2023-07-14T11:17:28.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.294+0000 7fd060fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd05c0c6070 con 0x7fd05c0adea0 2023-07-14T11:17:28.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.294+0000 7fd060fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd05c0c6350 con 0x7fd05c0b12f0 2023-07-14T11:17:28.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.295+0000 7fd05ad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd05c0c92d0 0x7fd05c0b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:28.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.295+0000 7fd05ad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd05c0c92d0 0x7fd05c0b1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59068/0 (socket says 172.21.15.84:59068) 2023-07-14T11:17:28.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.295+0000 7fd05ad9d700 1 -- 172.21.15.84:0/2147734832 learned_addr learned my addr 172.21.15.84:0/2147734832 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:28.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.295+0000 7fd05a59c700 1 --2- 172.21.15.84:0/2147734832 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd05c0adea0 0x7fd05c14ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:28.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.295+0000 7fd059d9b700 1 --2- 172.21.15.84:0/2147734832 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd05c0b12f0 0x7fd05c0afd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:28.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.295+0000 7fd05ad9d700 1 -- 172.21.15.84:0/2147734832 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd05c0b12f0 msgr2=0x7fd05c0afd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:28.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.295+0000 7fd05ad9d700 1 --2- 172.21.15.84:0/2147734832 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd05c0b12f0 0x7fd05c0afd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:28.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.295+0000 7fd05ad9d700 1 -- 172.21.15.84:0/2147734832 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd05c0adea0 msgr2=0x7fd05c14ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:28.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.295+0000 7fd05ad9d700 1 --2- 172.21.15.84:0/2147734832 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd05c0adea0 0x7fd05c14ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:28.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.295+0000 7fd05ad9d700 1 -- 172.21.15.84:0/2147734832 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd05000b7f0 con 0x7fd05c0c92d0 2023-07-14T11:17:28.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.295+0000 7fd05a59c700 1 --2- 172.21.15.84:0/2147734832 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd05c0adea0 0x7fd05c14ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:17:28.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.295+0000 7fd05ad9d700 1 --2- 172.21.15.84:0/2147734832 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd05c0c92d0 0x7fd05c0b1cf0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fd05400eed0 tx=0x7fd05400b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:28.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.295+0000 7fd04affd700 1 -- 172.21.15.84:0/2147734832 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd054010040 con 0x7fd05c0c92d0 2023-07-14T11:17:28.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.295+0000 7fd04affd700 1 -- 172.21.15.84:0/2147734832 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd05400bd30 con 0x7fd05c0c92d0 2023-07-14T11:17:28.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.295+0000 7fd060fff700 1 -- 172.21.15.84:0/2147734832 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd05c0c6630 con 0x7fd05c0c92d0 2023-07-14T11:17:28.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.296+0000 7fd04affd700 1 -- 172.21.15.84:0/2147734832 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd054009ea0 con 0x7fd05c0c92d0 2023-07-14T11:17:28.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.296+0000 7fd060fff700 1 -- 172.21.15.84:0/2147734832 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd05c14cf80 con 0x7fd05c0c92d0 2023-07-14T11:17:28.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.297+0000 7fd060fff700 1 -- 172.21.15.84:0/2147734832 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd05c0c6e30 con 0x7fd05c0c92d0 2023-07-14T11:17:28.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.298+0000 7fd04affd700 1 -- 172.21.15.84:0/2147734832 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 10) v1 ==== 89241+0+0 (secure 0 0 0) 0x7fd054014640 con 0x7fd05c0c92d0 2023-07-14T11:17:28.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.299+0000 7fd04affd700 1 --2- 172.21.15.84:0/2147734832 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fd03c06af20 0x7fd03c06d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:28.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.299+0000 7fd04affd700 1 -- 172.21.15.84:0/2147734832 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd054089f30 con 0x7fd05c0c92d0 2023-07-14T11:17:28.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.299+0000 7fd05a59c700 1 --2- 172.21.15.84:0/2147734832 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fd03c06af20 0x7fd03c06d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:28.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.299+0000 7fd05a59c700 1 --2- 172.21.15.84:0/2147734832 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fd03c06af20 0x7fd03c06d3d0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fd05c15cd20 tx=0x7fd04c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:28.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.303+0000 7fd04affd700 1 -- 172.21.15.84:0/2147734832 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fd05c0c6e30 con 0x7fd05c0c92d0 2023-07-14T11:17:28.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.528+0000 7fd060fff700 1 -- 172.21.15.84:0/2147734832 --> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_0000000000851779", "target": ["mon-mgr", ""]}) v1 -- 0x7fd05c15d680 con 0x7fd03c06af20 2023-07-14T11:17:28.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.533+0000 7fd04affd700 1 -- 172.21.15.84:0/2147734832 <== mgr.4104 v2:172.21.15.84:6832/379617029 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+45 (secure 0 0 0) 0x7fd04c004040 con 0x7fd03c06af20 2023-07-14T11:17:28.535 INFO:teuthology.orchestra.run.smithi084.stdout:/volumes/_nogroup/subvolume_0000000000851779 2023-07-14T11:17:28.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.535+0000 7fd060fff700 1 -- 172.21.15.84:0/2147734832 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fd03c06af20 msgr2=0x7fd03c06d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:28.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.535+0000 7fd060fff700 1 --2- 172.21.15.84:0/2147734832 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fd03c06af20 0x7fd03c06d3d0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fd05c15cd20 tx=0x7fd04c008040 comp rx=0 tx=0).stop 2023-07-14T11:17:28.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.535+0000 7fd060fff700 1 -- 172.21.15.84:0/2147734832 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd05c0c92d0 msgr2=0x7fd05c0b1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:28.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.535+0000 7fd060fff700 1 --2- 172.21.15.84:0/2147734832 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd05c0c92d0 0x7fd05c0b1cf0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fd05400eed0 tx=0x7fd05400b390 comp rx=0 tx=0).stop 2023-07-14T11:17:28.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.535+0000 7fd060fff700 1 -- 172.21.15.84:0/2147734832 shutdown_connections 2023-07-14T11:17:28.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.535+0000 7fd060fff700 1 --2- 172.21.15.84:0/2147734832 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd05c0c92d0 0x7fd05c0b1cf0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:28.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.535+0000 7fd060fff700 1 --2- 172.21.15.84:0/2147734832 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd05c0adea0 0x7fd05c14ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:28.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.535+0000 7fd060fff700 1 --2- 172.21.15.84:0/2147734832 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fd03c06af20 0x7fd03c06d3d0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:28.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.535+0000 7fd060fff700 1 --2- 172.21.15.84:0/2147734832 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd05c0b12f0 0x7fd05c0afd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:28.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.535+0000 7fd060fff700 1 -- 172.21.15.84:0/2147734832 >> 172.21.15.84:0/2147734832 conn(0x7fd05c0b05d0 msgr2=0x7fd05c070d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:28.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.536+0000 7fd060fff700 1 -- 172.21.15.84:0/2147734832 shutdown_connections 2023-07-14T11:17:28.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.536+0000 7fd060fff700 1 -- 172.21.15.84:0/2147734832 wait complete. 2023-07-14T11:17:28.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:17:28.556 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/_legacy/4321aeaf20e30b47ac58dd77ffd6c75d.meta) 2023-07-14T11:17:28.631 INFO:teuthology.orchestra.run.smithi084.stdout:[GLOBAL] 2023-07-14T11:17:28.632 INFO:teuthology.orchestra.run.smithi084.stdout:version = 1 2023-07-14T11:17:28.632 INFO:teuthology.orchestra.run.smithi084.stdout:type = subvolume 2023-07-14T11:17:28.632 INFO:teuthology.orchestra.run.smithi084.stdout:path = /volumes/_nogroup/subvolume_0000000000851779 2023-07-14T11:17:28.632 INFO:teuthology.orchestra.run.smithi084.stdout:state = complete 2023-07-14T11:17:28.632 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:17:28.634 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume authorize cephfs subvolume_0000000000851779 alice 2023-07-14T11:17:28.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.831+0000 7fe8ed9ff700 1 Processor -- start 2023-07-14T11:17:28.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.831+0000 7fe8ed9ff700 1 -- start start 2023-07-14T11:17:28.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.832+0000 7fe8ed9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8e806a640 0x7fe8e80cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:28.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.832+0000 7fe8ed9ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8e8070860 con 0x7fe8e815cc70 2023-07-14T11:17:28.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.832+0000 7fe8ed9ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8e8071100 con 0x7fe8e8071590 2023-07-14T11:17:28.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.832+0000 7fe8ed9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e80ca4d0 con 0x7fe8e806a640 2023-07-14T11:17:28.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.832+0000 7fe8e6ffd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fe8e815cc70 0x7fe8e8069f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:35870/0 (socket says 172.21.15.84:35870) 2023-07-14T11:17:28.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.832+0000 7fe8e6ffd700 1 -- 172.21.15.84:0/4037384032 learned_addr learned my addr 172.21.15.84:0/4037384032 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:17:28.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.833+0000 7fe8e67fc700 1 --2- 172.21.15.84:0/4037384032 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8e806a640 0x7fe8e80cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:28.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.833+0000 7fe8e5ffb700 1 -- 172.21.15.84:0/4037384032 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 758829802 0 0) 0x7fe8e8070860 con 0x7fe8e815cc70 2023-07-14T11:17:28.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.833+0000 7fe8e5ffb700 1 -- 172.21.15.84:0/4037384032 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8d00035b0 con 0x7fe8e815cc70 2023-07-14T11:17:28.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.833+0000 7fe8e67fc700 1 -- 172.21.15.84:0/4037384032 >> v1:172.21.15.179:6789/0 conn(0x7fe8e8071590 legacy=0x7fe8e80ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:28.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.833+0000 7fe8e67fc700 1 -- 172.21.15.84:0/4037384032 >> v1:172.21.15.84:6789/0 conn(0x7fe8e815cc70 legacy=0x7fe8e8069f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:28.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.833+0000 7fe8e67fc700 1 -- 172.21.15.84:0/4037384032 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e80cc180 con 0x7fe8e806a640 2023-07-14T11:17:28.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.833+0000 7fe8e67fc700 1 --2- 172.21.15.84:0/4037384032 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8e806a640 0x7fe8e80cbae0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc009870 tx=0x7fe8dc009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67076970131a7c4d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:28.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.834+0000 7fe8e5ffb700 1 -- 172.21.15.84:0/4037384032 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8dc011830 con 0x7fe8e806a640 2023-07-14T11:17:28.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.834+0000 7fe8e5ffb700 1 -- 172.21.15.84:0/4037384032 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8dc011990 con 0x7fe8e806a640 2023-07-14T11:17:28.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.834+0000 7fe8e5ffb700 1 -- 172.21.15.84:0/4037384032 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8dc011d20 con 0x7fe8e806a640 2023-07-14T11:17:28.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.834+0000 7fe8ed9ff700 1 -- 172.21.15.84:0/4037384032 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8e806a640 msgr2=0x7fe8e80cbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:28.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.834+0000 7fe8ed9ff700 1 --2- 172.21.15.84:0/4037384032 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8e806a640 0x7fe8e80cbae0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc009870 tx=0x7fe8dc009b80 comp rx=0 tx=0).stop 2023-07-14T11:17:28.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.834+0000 7fe8ed9ff700 1 -- 172.21.15.84:0/4037384032 shutdown_connections 2023-07-14T11:17:28.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.834+0000 7fe8ed9ff700 1 --2- 172.21.15.84:0/4037384032 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8e806a640 0x7fe8e80cbae0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:28.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.834+0000 7fe8ed9ff700 1 -- 172.21.15.84:0/4037384032 >> 172.21.15.84:0/4037384032 conn(0x7fe8e80cd180 msgr2=0x7fe8e80cfac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:28.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.834+0000 7fe8ed9ff700 1 -- 172.21.15.84:0/4037384032 shutdown_connections 2023-07-14T11:17:28.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.835+0000 7fe8ed9ff700 1 -- 172.21.15.84:0/4037384032 wait complete. 2023-07-14T11:17:28.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.836+0000 7fe8ed9ff700 1 Processor -- start 2023-07-14T11:17:28.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.836+0000 7fe8ed9ff700 1 -- start start 2023-07-14T11:17:28.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.837+0000 7fe8ed9ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8e806a640 0x7fe8e80c93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:28.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.837+0000 7fe8ed9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8e8071590 0x7fe8e815fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:28.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.837+0000 7fe8ed9ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8e815cc70 0x7fe8e80ad8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:28.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.837+0000 7fe8ed9ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e80c7cc0 con 0x7fe8e806a640 2023-07-14T11:17:28.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.837+0000 7fe8ed9ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e80c8f50 con 0x7fe8e815cc70 2023-07-14T11:17:28.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.837+0000 7fe8ed9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e80c8940 con 0x7fe8e8071590 2023-07-14T11:17:28.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.837+0000 7fe8e6ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8e806a640 0x7fe8e80c93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:28.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.837+0000 7fe8e6ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8e806a640 0x7fe8e80c93e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59078/0 (socket says 172.21.15.84:59078) 2023-07-14T11:17:28.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.838+0000 7fe8e6ffd700 1 -- 172.21.15.84:0/2174936653 learned_addr learned my addr 172.21.15.84:0/2174936653 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:28.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.838+0000 7fe8e67fc700 1 --2- 172.21.15.84:0/2174936653 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8e8071590 0x7fe8e815fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:28.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.838+0000 7fe8e77fe700 1 --2- 172.21.15.84:0/2174936653 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8e815cc70 0x7fe8e80ad8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:28.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.838+0000 7fe8e6ffd700 1 -- 172.21.15.84:0/2174936653 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8e8071590 msgr2=0x7fe8e815fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:28.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.838+0000 7fe8e6ffd700 1 --2- 172.21.15.84:0/2174936653 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8e8071590 0x7fe8e815fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:28.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.838+0000 7fe8e6ffd700 1 -- 172.21.15.84:0/2174936653 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8e815cc70 msgr2=0x7fe8e80ad8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:28.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.838+0000 7fe8e6ffd700 1 --2- 172.21.15.84:0/2174936653 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8e815cc70 0x7fe8e80ad8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:28.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.838+0000 7fe8e6ffd700 1 -- 172.21.15.84:0/2174936653 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8dc0094a0 con 0x7fe8e806a640 2023-07-14T11:17:28.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.838+0000 7fe8e67fc700 1 --2- 172.21.15.84:0/2174936653 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8e8071590 0x7fe8e815fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:17:28.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.838+0000 7fe8e77fe700 1 --2- 172.21.15.84:0/2174936653 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8e815cc70 0x7fe8e80ad8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:17:28.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.838+0000 7fe8e6ffd700 1 --2- 172.21.15.84:0/2174936653 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8e806a640 0x7fe8e80c93e0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8001eb0 tx=0x7fe8d800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:28.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.838+0000 7fe8cffff700 1 -- 172.21.15.84:0/2174936653 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d8005d70 con 0x7fe8e806a640 2023-07-14T11:17:28.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.838+0000 7fe8cffff700 1 -- 172.21.15.84:0/2174936653 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d80070d0 con 0x7fe8e806a640 2023-07-14T11:17:28.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.838+0000 7fe8ed9ff700 1 -- 172.21.15.84:0/2174936653 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8e80c79e0 con 0x7fe8e806a640 2023-07-14T11:17:28.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.838+0000 7fe8cffff700 1 -- 172.21.15.84:0/2174936653 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d8007460 con 0x7fe8e806a640 2023-07-14T11:17:28.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.839+0000 7fe8ed9ff700 1 -- 172.21.15.84:0/2174936653 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8e80c9920 con 0x7fe8e806a640 2023-07-14T11:17:28.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.840+0000 7fe8ed9ff700 1 -- 172.21.15.84:0/2174936653 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8e80c9230 con 0x7fe8e806a640 2023-07-14T11:17:28.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.840+0000 7fe8cffff700 1 -- 172.21.15.84:0/2174936653 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 10) v1 ==== 89241+0+0 (secure 0 0 0) 0x7fe8d80075c0 con 0x7fe8e806a640 2023-07-14T11:17:28.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.841+0000 7fe8cffff700 1 --2- 172.21.15.84:0/2174936653 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe8d406af20 0x7fe8d406d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:28.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.841+0000 7fe8cffff700 1 -- 172.21.15.84:0/2174936653 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe8d8088e20 con 0x7fe8e806a640 2023-07-14T11:17:28.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.842+0000 7fe8e67fc700 1 --2- 172.21.15.84:0/2174936653 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe8d406af20 0x7fe8d406d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:28.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.842+0000 7fe8e67fc700 1 --2- 172.21.15.84:0/2174936653 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe8d406af20 0x7fe8d406d3d0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fe8e806aa30 tx=0x7fe8dc008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:28.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:28.846+0000 7fe8cffff700 1 -- 172.21.15.84:0/2174936653 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe8d8053b70 con 0x7fe8e806a640 2023-07-14T11:17:29.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.074+0000 7fe8ed9ff700 1 -- 172.21.15.84:0/2174936653 --> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] -- mgr_command(tid 0: {"prefix": "fs subvolume authorize", "vol_name": "cephfs", "sub_name": "subvolume_0000000000851779", "auth_id": "alice", "target": ["mon-mgr", ""]}) v1 -- 0x7fe8e8070ab0 con 0x7fe8d406af20 2023-07-14T11:17:29.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.117+0000 7fe8cffff700 1 -- 172.21.15.84:0/2174936653 <== mgr.4104 v2:172.21.15.84:6832/379617029 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fe8dc011b80 con 0x7fe8d406af20 2023-07-14T11:17:29.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.119+0000 7fe8ed9ff700 1 -- 172.21.15.84:0/2174936653 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe8d406af20 msgr2=0x7fe8d406d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:29.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.119+0000 7fe8ed9ff700 1 --2- 172.21.15.84:0/2174936653 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe8d406af20 0x7fe8d406d3d0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fe8e806aa30 tx=0x7fe8dc008030 comp rx=0 tx=0).stop 2023-07-14T11:17:29.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.119+0000 7fe8ed9ff700 1 -- 172.21.15.84:0/2174936653 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8e806a640 msgr2=0x7fe8e80c93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:29.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.119+0000 7fe8ed9ff700 1 --2- 172.21.15.84:0/2174936653 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8e806a640 0x7fe8e80c93e0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8001eb0 tx=0x7fe8d800c860 comp rx=0 tx=0).stop 2023-07-14T11:17:29.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.120+0000 7fe8ed9ff700 1 -- 172.21.15.84:0/2174936653 shutdown_connections 2023-07-14T11:17:29.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.120+0000 7fe8ed9ff700 1 --2- 172.21.15.84:0/2174936653 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8e815cc70 0x7fe8e80ad8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:29.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.120+0000 7fe8ed9ff700 1 --2- 172.21.15.84:0/2174936653 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8e806a640 0x7fe8e80c93e0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:29.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.120+0000 7fe8ed9ff700 1 --2- 172.21.15.84:0/2174936653 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe8d406af20 0x7fe8d406d3d0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:29.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.120+0000 7fe8ed9ff700 1 --2- 172.21.15.84:0/2174936653 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8e8071590 0x7fe8e815fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:29.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.120+0000 7fe8ed9ff700 1 -- 172.21.15.84:0/2174936653 >> 172.21.15.84:0/2174936653 conn(0x7fe8e80cd180 msgr2=0x7fe8e8069f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:29.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.120+0000 7fe8ed9ff700 1 -- 172.21.15.84:0/2174936653 shutdown_connections 2023-07-14T11:17:29.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.120+0000 7fe8ed9ff700 1 -- 172.21.15.84:0/2174936653 wait complete. 2023-07-14T11:17:29.140 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.alice --format=json-pretty 2023-07-14T11:17:29.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.334+0000 7fc41e9ff700 1 Processor -- start 2023-07-14T11:17:29.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.335+0000 7fc41e9ff700 1 -- start start 2023-07-14T11:17:29.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.336+0000 7fc41e9ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc4180b8660 0x7fc4180cd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:29.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.336+0000 7fc41e9ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc4180b4f70 0x7fc4180d12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:29.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.336+0000 7fc41e9ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4180d02a0 con 0x7fc4180cd970 2023-07-14T11:17:29.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.336+0000 7fc41e9ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4180cfce0 con 0x7fc4180b4f70 2023-07-14T11:17:29.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.336+0000 7fc41e9ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4180cffc0 con 0x7fc4180b8660 2023-07-14T11:17:29.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.337+0000 7fc4177fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fc4180cd970 0x7fc4180b4860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52764/0 (socket says 172.21.15.84:52764) 2023-07-14T11:17:29.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.337+0000 7fc4177fe700 1 -- 172.21.15.84:0/344513603 learned_addr learned my addr 172.21.15.84:0/344513603 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:17:29.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.337+0000 7fc41cf9c700 1 --2- 172.21.15.84:0/344513603 >> v2:172.21.15.84:3300/0 conn(0x7fc4180b4f70 0x7fc4180d12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:29.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.337+0000 7fc417fff700 1 --2- 172.21.15.84:0/344513603 >> v2:172.21.15.179:3300/0 conn(0x7fc4180b8660 0x7fc4180cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:29.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.337+0000 7fc41cf9c700 1 -- 172.21.15.84:0/344513603 >> v2:172.21.15.179:3300/0 conn(0x7fc4180b8660 msgr2=0x7fc4180cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:29.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.337+0000 7fc41cf9c700 1 --2- 172.21.15.84:0/344513603 >> v2:172.21.15.179:3300/0 conn(0x7fc4180b8660 0x7fc4180cd430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:29.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.337+0000 7fc41cf9c700 1 -- 172.21.15.84:0/344513603 >> v1:172.21.15.84:6789/0 conn(0x7fc4180cd970 legacy=0x7fc4180b4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:29.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.337+0000 7fc41cf9c700 1 -- 172.21.15.84:0/344513603 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4180d0ac0 con 0x7fc4180b4f70 2023-07-14T11:17:29.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.337+0000 7fc41cf9c700 1 --2- 172.21.15.84:0/344513603 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4180b4f70 0x7fc4180d12c0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fc4180c9e60 tx=0x7fc41000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90e48b8bd57b5aa3 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:29.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.338+0000 7fc416ffd700 1 -- 172.21.15.84:0/344513603 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc41000e070 con 0x7fc4180b4f70 2023-07-14T11:17:29.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.338+0000 7fc416ffd700 1 -- 172.21.15.84:0/344513603 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc41000bbd0 con 0x7fc4180b4f70 2023-07-14T11:17:29.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.338+0000 7fc416ffd700 1 -- 172.21.15.84:0/344513603 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc410012430 con 0x7fc4180b4f70 2023-07-14T11:17:29.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.338+0000 7fc41e9ff700 1 -- 172.21.15.84:0/344513603 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4180b4f70 msgr2=0x7fc4180d12c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:29.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.338+0000 7fc41e9ff700 1 --2- 172.21.15.84:0/344513603 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4180b4f70 0x7fc4180d12c0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fc4180c9e60 tx=0x7fc41000b330 comp rx=0 tx=0).stop 2023-07-14T11:17:29.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.338+0000 7fc41e9ff700 1 -- 172.21.15.84:0/344513603 shutdown_connections 2023-07-14T11:17:29.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.338+0000 7fc41e9ff700 1 --2- 172.21.15.84:0/344513603 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4180b4f70 0x7fc4180d12c0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:29.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.338+0000 7fc41e9ff700 1 --2- 172.21.15.84:0/344513603 >> v2:172.21.15.179:3300/0 conn(0x7fc4180b8660 0x7fc4180cd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:29.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.338+0000 7fc41e9ff700 1 -- 172.21.15.84:0/344513603 >> 172.21.15.84:0/344513603 conn(0x7fc418066860 msgr2=0x7fc41806a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:29.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.338+0000 7fc41e9ff700 1 -- 172.21.15.84:0/344513603 shutdown_connections 2023-07-14T11:17:29.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.338+0000 7fc41e9ff700 1 -- 172.21.15.84:0/344513603 wait complete. 2023-07-14T11:17:29.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.340+0000 7fc41e9ff700 1 Processor -- start 2023-07-14T11:17:29.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.340+0000 7fc41e9ff700 1 -- start start 2023-07-14T11:17:29.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.341+0000 7fc41e9ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4180b4f70 0x7fc4181f66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:29.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.341+0000 7fc41e9ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc4180b8660 0x7fc4181585f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:29.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.341+0000 7fc41e9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc4180cd970 0x7fc4180cac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:29.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.341+0000 7fc41e9ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc418157550 con 0x7fc4180b4f70 2023-07-14T11:17:29.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.341+0000 7fc41e9ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc418157830 con 0x7fc4180b8660 2023-07-14T11:17:29.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.341+0000 7fc41e9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc418157b10 con 0x7fc4180cd970 2023-07-14T11:17:29.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.341+0000 7fc417fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4180b4f70 0x7fc4181f66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:29.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.341+0000 7fc417fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4180b4f70 0x7fc4181f66c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39474/0 (socket says 172.21.15.84:39474) 2023-07-14T11:17:29.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.341+0000 7fc417fff700 1 -- 172.21.15.84:0/895312265 learned_addr learned my addr 172.21.15.84:0/895312265 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:29.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.342+0000 7fc41cf9c700 1 --2- 172.21.15.84:0/895312265 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc4180cd970 0x7fc4180cac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:29.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.342+0000 7fc4177fe700 1 --2- 172.21.15.84:0/895312265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc4180b8660 0x7fc4181585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:29.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.342+0000 7fc417fff700 1 -- 172.21.15.84:0/895312265 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc4180cd970 msgr2=0x7fc4180cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:29.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.342+0000 7fc417fff700 1 --2- 172.21.15.84:0/895312265 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc4180cd970 0x7fc4180cac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:29.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.342+0000 7fc417fff700 1 -- 172.21.15.84:0/895312265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc4180b8660 msgr2=0x7fc4181585f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:29.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.342+0000 7fc417fff700 1 --2- 172.21.15.84:0/895312265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc4180b8660 0x7fc4181585f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:29.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.342+0000 7fc417fff700 1 -- 172.21.15.84:0/895312265 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc410009a70 con 0x7fc4180b4f70 2023-07-14T11:17:29.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.342+0000 7fc417fff700 1 --2- 172.21.15.84:0/895312265 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4180b4f70 0x7fc4181f66c0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fc40800e810 tx=0x7fc40800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:29.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.342+0000 7fc414ff9700 1 -- 172.21.15.84:0/895312265 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc408013610 con 0x7fc4180b4f70 2023-07-14T11:17:29.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.342+0000 7fc414ff9700 1 -- 172.21.15.84:0/895312265 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc408013770 con 0x7fc4180b4f70 2023-07-14T11:17:29.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.342+0000 7fc41e9ff700 1 -- 172.21.15.84:0/895312265 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc418157df0 con 0x7fc4180b4f70 2023-07-14T11:17:29.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.342+0000 7fc414ff9700 1 -- 172.21.15.84:0/895312265 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc408013b20 con 0x7fc4180b4f70 2023-07-14T11:17:29.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.342+0000 7fc41e9ff700 1 -- 172.21.15.84:0/895312265 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4181f6c00 con 0x7fc4180b4f70 2023-07-14T11:17:29.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.343+0000 7fc41e9ff700 1 -- 172.21.15.84:0/895312265 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc418074350 con 0x7fc4180b4f70 2023-07-14T11:17:29.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.344+0000 7fc414ff9700 1 -- 172.21.15.84:0/895312265 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 10) v1 ==== 89241+0+0 (secure 0 0 0) 0x7fc408013c80 con 0x7fc4180b4f70 2023-07-14T11:17:29.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.345+0000 7fc414ff9700 1 --2- 172.21.15.84:0/895312265 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc40406af20 0x7fc40406d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:29.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.345+0000 7fc414ff9700 1 -- 172.21.15.84:0/895312265 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc408089790 con 0x7fc4180b4f70 2023-07-14T11:17:29.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.345+0000 7fc4177fe700 1 --2- 172.21.15.84:0/895312265 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc40406af20 0x7fc40406d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:29.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.346+0000 7fc4177fe700 1 --2- 172.21.15.84:0/895312265 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc40406af20 0x7fc40406d3d0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fc4180cd4c0 tx=0x7fc40c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:29.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.349+0000 7fc414ff9700 1 -- 172.21.15.84:0/895312265 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fc408054340 con 0x7fc4180b4f70 2023-07-14T11:17:29.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.618+0000 7fc41e9ff700 1 -- 172.21.15.84:0/895312265 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.alice", "format": "json-pretty"} v 0) v1 -- 0x7fc4180b2150 con 0x7fc4180b4f70 2023-07-14T11:17:29.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.618+0000 7fc414ff9700 1 -- 172.21.15.84:0/895312265 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.alice", "format": "json-pretty"}]=0 v18) v1 ==== 107+0+295 (secure 0 0 0) 0x7fc408057960 con 0x7fc4180b4f70 2023-07-14T11:17:29.621 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:17:29.621 INFO:teuthology.orchestra.run.smithi084.stdout:[ 2023-07-14T11:17:29.621 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:17:29.621 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.alice", 2023-07-14T11:17:29.621 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDJLrFkk6jmBRAA2udJ1hTXApUjWlDupnErDw==", 2023-07-14T11:17:29.622 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:17:29.622 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow rw path=/volumes/_nogroup/subvolume_0000000000851779", 2023-07-14T11:17:29.622 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow r", 2023-07-14T11:17:29.622 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rw pool=cephfs_data" 2023-07-14T11:17:29.622 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:17:29.622 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:17:29.623 INFO:teuthology.orchestra.run.smithi084.stdout:] 2023-07-14T11:17:29.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.620+0000 7fc41e9ff700 1 -- 172.21.15.84:0/895312265 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc40406af20 msgr2=0x7fc40406d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:29.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.620+0000 7fc41e9ff700 1 --2- 172.21.15.84:0/895312265 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc40406af20 0x7fc40406d3d0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fc4180cd4c0 tx=0x7fc40c009040 comp rx=0 tx=0).stop 2023-07-14T11:17:29.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.620+0000 7fc41e9ff700 1 -- 172.21.15.84:0/895312265 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4180b4f70 msgr2=0x7fc4181f66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:29.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.620+0000 7fc41e9ff700 1 --2- 172.21.15.84:0/895312265 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4180b4f70 0x7fc4181f66c0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fc40800e810 tx=0x7fc40800ebd0 comp rx=0 tx=0).stop 2023-07-14T11:17:29.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.621+0000 7fc41e9ff700 1 -- 172.21.15.84:0/895312265 shutdown_connections 2023-07-14T11:17:29.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.621+0000 7fc41e9ff700 1 --2- 172.21.15.84:0/895312265 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc40406af20 0x7fc40406d3d0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:29.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.621+0000 7fc41e9ff700 1 --2- 172.21.15.84:0/895312265 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc4180cd970 0x7fc4180cac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:29.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.621+0000 7fc41e9ff700 1 --2- 172.21.15.84:0/895312265 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4180b4f70 0x7fc4181f66c0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:29.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.621+0000 7fc41e9ff700 1 --2- 172.21.15.84:0/895312265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc4180b8660 0x7fc4181585f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:29.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.621+0000 7fc41e9ff700 1 -- 172.21.15.84:0/895312265 >> 172.21.15.84:0/895312265 conn(0x7fc418066860 msgr2=0x7fc4180b4590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:29.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.621+0000 7fc41e9ff700 1 -- 172.21.15.84:0/895312265 shutdown_connections 2023-07-14T11:17:29.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.621+0000 7fc41e9ff700 1 -- 172.21.15.84:0/895312265 wait complete. 2023-07-14T11:17:29.641 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvolume_0000000000851779 2023-07-14T11:17:29.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.837+0000 7f58821ff700 1 Processor -- start 2023-07-14T11:17:29.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.837+0000 7f58821ff700 1 -- start start 2023-07-14T11:17:29.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.838+0000 7f58821ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f587c0b21f0 0x7f587c0cfc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:29.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.838+0000 7f58821ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f587c0d29c0 0x7f587c0d2e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:29.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.838+0000 7f58821ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f587c0cd8e0 con 0x7f587c0cf890 2023-07-14T11:17:29.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.838+0000 7f58821ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f587c0d2760 con 0x7f587c0d29c0 2023-07-14T11:17:29.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.838+0000 7f58821ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f587c0d01a0 con 0x7f587c0b21f0 2023-07-14T11:17:29.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.838+0000 7f587bfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f587c0d29c0 0x7f587c0d2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:29.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.838+0000 7f587bfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f587c0d29c0 0x7f587c0d2e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39486/0 (socket says 172.21.15.84:39486) 2023-07-14T11:17:29.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.838+0000 7f587bfff700 1 -- 172.21.15.84:0/1226209652 learned_addr learned my addr 172.21.15.84:0/1226209652 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:29.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.839+0000 7f587affd700 1 --2- 172.21.15.84:0/1226209652 >> v2:172.21.15.179:3300/0 conn(0x7f587c0b21f0 0x7f587c0cfc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:29.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.839+0000 7f587bfff700 1 -- 172.21.15.84:0/1226209652 >> v2:172.21.15.179:3300/0 conn(0x7f587c0b21f0 msgr2=0x7f587c0cfc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:29.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.839+0000 7f587bfff700 1 --2- 172.21.15.84:0/1226209652 >> v2:172.21.15.179:3300/0 conn(0x7f587c0b21f0 0x7f587c0cfc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:29.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.839+0000 7f587bfff700 1 -- 172.21.15.84:0/1226209652 >> v1:172.21.15.84:6789/0 conn(0x7f587c0cf890 legacy=0x7f587c0cf030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:29.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.839+0000 7f587bfff700 1 -- 172.21.15.84:0/1226209652 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f587c0d1740 con 0x7f587c0d29c0 2023-07-14T11:17:29.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.839+0000 7f587affd700 1 --2- 172.21.15.84:0/1226209652 >> v2:172.21.15.179:3300/0 conn(0x7f587c0b21f0 0x7f587c0cfc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:17:29.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.839+0000 7f587bfff700 1 --2- 172.21.15.84:0/1226209652 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f587c0d29c0 0x7f587c0d2e20 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f587c160110 tx=0x7f587400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92e14263ba1900d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:29.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.839+0000 7f587a7fc700 1 -- 172.21.15.84:0/1226209652 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587400e070 con 0x7f587c0d29c0 2023-07-14T11:17:29.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.839+0000 7f587a7fc700 1 -- 172.21.15.84:0/1226209652 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f587400b9c0 con 0x7f587c0d29c0 2023-07-14T11:17:29.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.839+0000 7f587a7fc700 1 -- 172.21.15.84:0/1226209652 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587400bd70 con 0x7f587c0d29c0 2023-07-14T11:17:29.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.840+0000 7f58821ff700 1 -- 172.21.15.84:0/1226209652 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f587c0d29c0 msgr2=0x7f587c0d2e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:29.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.840+0000 7f58821ff700 1 --2- 172.21.15.84:0/1226209652 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f587c0d29c0 0x7f587c0d2e20 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f587c160110 tx=0x7f587400b330 comp rx=0 tx=0).stop 2023-07-14T11:17:29.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.840+0000 7f58821ff700 1 -- 172.21.15.84:0/1226209652 shutdown_connections 2023-07-14T11:17:29.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.840+0000 7f58821ff700 1 --2- 172.21.15.84:0/1226209652 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f587c0d29c0 0x7f587c0d2e20 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:29.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.840+0000 7f58821ff700 1 --2- 172.21.15.84:0/1226209652 >> v2:172.21.15.179:3300/0 conn(0x7f587c0b21f0 0x7f587c0cfc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:29.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.840+0000 7f58821ff700 1 -- 172.21.15.84:0/1226209652 >> 172.21.15.84:0/1226209652 conn(0x7f587c06c170 msgr2=0x7f587c06c540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:29.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.840+0000 7f58821ff700 1 -- 172.21.15.84:0/1226209652 shutdown_connections 2023-07-14T11:17:29.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.840+0000 7f58821ff700 1 -- 172.21.15.84:0/1226209652 wait complete. 2023-07-14T11:17:29.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.842+0000 7f58821ff700 1 Processor -- start 2023-07-14T11:17:29.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.842+0000 7f58821ff700 1 -- start start 2023-07-14T11:17:29.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.843+0000 7f58821ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f587c0b21f0 0x7f587c14f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:29.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.843+0000 7f58821ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f587c0cf890 0x7f587c0cc220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:29.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.843+0000 7f58821ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f587c0d29c0 0x7f587c0a9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:29.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.843+0000 7f58821ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f587c0aa050 con 0x7f587c0cf890 2023-07-14T11:17:29.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.843+0000 7f58821ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f587c0cb210 con 0x7f587c0d29c0 2023-07-14T11:17:29.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.843+0000 7f58821ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f587c0cbd90 con 0x7f587c0b21f0 2023-07-14T11:17:29.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.843+0000 7f587affd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f587c0cf890 0x7f587c0cc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:29.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.843+0000 7f587affd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f587c0cf890 0x7f587c0cc220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39498/0 (socket says 172.21.15.84:39498) 2023-07-14T11:17:29.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.843+0000 7f587affd700 1 -- 172.21.15.84:0/3579659668 learned_addr learned my addr 172.21.15.84:0/3579659668 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:29.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.843+0000 7f587b7fe700 1 --2- 172.21.15.84:0/3579659668 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f587c0b21f0 0x7f587c14f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:29.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.843+0000 7f587bfff700 1 --2- 172.21.15.84:0/3579659668 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f587c0d29c0 0x7f587c0a9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:29.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.843+0000 7f587affd700 1 -- 172.21.15.84:0/3579659668 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f587c0b21f0 msgr2=0x7f587c14f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:29.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.843+0000 7f587affd700 1 --2- 172.21.15.84:0/3579659668 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f587c0b21f0 0x7f587c14f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:29.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.843+0000 7f587affd700 1 -- 172.21.15.84:0/3579659668 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f587c0d29c0 msgr2=0x7f587c0a9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:29.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.843+0000 7f587affd700 1 --2- 172.21.15.84:0/3579659668 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f587c0d29c0 0x7f587c0a9800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:29.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.844+0000 7f587affd700 1 -- 172.21.15.84:0/3579659668 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5874009b30 con 0x7f587c0cf890 2023-07-14T11:17:29.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.844+0000 7f587b7fe700 1 --2- 172.21.15.84:0/3579659668 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f587c0b21f0 0x7f587c14f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:17:29.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.844+0000 7f587bfff700 1 --2- 172.21.15.84:0/3579659668 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f587c0d29c0 0x7f587c0a9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:17:29.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.844+0000 7f587affd700 1 --2- 172.21.15.84:0/3579659668 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f587c0cf890 0x7f587c0cc220 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f587000e840 tx=0x7f587000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:29.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.844+0000 7f5863fff700 1 -- 172.21.15.84:0/3579659668 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587000c020 con 0x7f587c0cf890 2023-07-14T11:17:29.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.844+0000 7f5863fff700 1 -- 172.21.15.84:0/3579659668 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5870004250 con 0x7f587c0cf890 2023-07-14T11:17:29.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.844+0000 7f5863fff700 1 -- 172.21.15.84:0/3579659668 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58700036a0 con 0x7f587c0cf890 2023-07-14T11:17:29.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.844+0000 7f58821ff700 1 -- 172.21.15.84:0/3579659668 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f587c0cb460 con 0x7f587c0cf890 2023-07-14T11:17:29.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.844+0000 7f58821ff700 1 -- 172.21.15.84:0/3579659668 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f587c0cba20 con 0x7f587c0cf890 2023-07-14T11:17:29.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.845+0000 7f58821ff700 1 -- 172.21.15.84:0/3579659668 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f587c0cc760 con 0x7f587c0cf890 2023-07-14T11:17:29.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.846+0000 7f5863fff700 1 -- 172.21.15.84:0/3579659668 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 10) v1 ==== 89241+0+0 (secure 0 0 0) 0x7f5870003800 con 0x7f587c0cf890 2023-07-14T11:17:29.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.847+0000 7f5863fff700 1 --2- 172.21.15.84:0/3579659668 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f586806af20 0x7f586806d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:29.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.847+0000 7f5863fff700 1 -- 172.21.15.84:0/3579659668 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5870089470 con 0x7f587c0cf890 2023-07-14T11:17:29.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.847+0000 7f587b7fe700 1 --2- 172.21.15.84:0/3579659668 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f586806af20 0x7f586806d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:29.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.848+0000 7f587b7fe700 1 --2- 172.21.15.84:0/3579659668 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f586806af20 0x7f586806d3d0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f587c0b21c0 tx=0x7f586c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:29.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:29.851+0000 7f5863fff700 1 -- 172.21.15.84:0/3579659668 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f5870054140 con 0x7f587c0cf890 2023-07-14T11:17:30.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.075+0000 7f58821ff700 1 -- 172.21.15.84:0/3579659668 --> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvolume_0000000000851779", "target": ["mon-mgr", ""]}) v1 -- 0x7f587c0d1a20 con 0x7f586806af20 2023-07-14T11:17:30.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.091+0000 7f5863fff700 1 -- 172.21.15.84:0/3579659668 <== mgr.4104 v2:172.21.15.84:6832/379617029 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f586c0050d0 con 0x7f586806af20 2023-07-14T11:17:30.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.094+0000 7f58821ff700 1 -- 172.21.15.84:0/3579659668 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f586806af20 msgr2=0x7f586806d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:30.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.094+0000 7f58821ff700 1 --2- 172.21.15.84:0/3579659668 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f586806af20 0x7f586806d3d0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f587c0b21c0 tx=0x7f586c009040 comp rx=0 tx=0).stop 2023-07-14T11:17:30.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.094+0000 7f58821ff700 1 -- 172.21.15.84:0/3579659668 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f587c0cf890 msgr2=0x7f587c0cc220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:30.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.094+0000 7f58821ff700 1 --2- 172.21.15.84:0/3579659668 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f587c0cf890 0x7f587c0cc220 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f587000e840 tx=0x7f587000ec00 comp rx=0 tx=0).stop 2023-07-14T11:17:30.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.094+0000 7f58821ff700 1 -- 172.21.15.84:0/3579659668 shutdown_connections 2023-07-14T11:17:30.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.094+0000 7f58821ff700 1 --2- 172.21.15.84:0/3579659668 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f586806af20 0x7f586806d3d0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:30.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.094+0000 7f58821ff700 1 --2- 172.21.15.84:0/3579659668 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f587c0b21f0 0x7f587c14f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:30.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.094+0000 7f58821ff700 1 --2- 172.21.15.84:0/3579659668 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f587c0d29c0 0x7f587c0a9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:30.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.094+0000 7f58821ff700 1 --2- 172.21.15.84:0/3579659668 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f587c0cf890 0x7f587c0cc220 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:30.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.094+0000 7f58821ff700 1 -- 172.21.15.84:0/3579659668 >> 172.21.15.84:0/3579659668 conn(0x7f587c06c170 msgr2=0x7f587c0b42f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:30.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.094+0000 7f58821ff700 1 -- 172.21.15.84:0/3579659668 shutdown_connections 2023-07-14T11:17:30.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.094+0000 7f58821ff700 1 -- 172.21.15.84:0/3579659668 wait complete. 2023-07-14T11:17:30.099 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:17:30.096+0000 7fed0ebc1700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T11:17:30.099 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:17:30.096+0000 7fed0ebc1700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T11:17:30.099 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:17:30.096+0000 7fed0ebc1700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T11:17:30.100 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:17:30.096+0000 7fed0ebc1700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T11:17:30.100 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:17:30.096+0000 7fed0ebc1700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T11:17:30.116 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvolume_0000000000851780 2023-07-14T11:17:30.117 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:17:30.114+0000 7fed0fbc3700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T11:17:30.117 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:17:30.114+0000 7fed0fbc3700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T11:17:30.118 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:17:30.114+0000 7fed0fbc3700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T11:17:30.118 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:17:30.114+0000 7fed0fbc3700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T11:17:30.118 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:17:30.114+0000 7fed0fbc3700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T11:17:30.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.315+0000 7ff795fff700 1 Processor -- start 2023-07-14T11:17:30.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.315+0000 7ff795fff700 1 -- start start 2023-07-14T11:17:30.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.316+0000 7ff795fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff7900b8a60 0x7ff7900b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:30.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.316+0000 7ff795fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7900b4530 0x7ff7900d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:30.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.316+0000 7ff795fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff7900d1050 0x7ff7900b25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:30.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.316+0000 7ff795fff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7900d14d0 con 0x7ff7900b8a60 2023-07-14T11:17:30.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.316+0000 7ff795fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7900b8e30 con 0x7ff7900d1050 2023-07-14T11:17:30.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.316+0000 7ff795fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7900afaa0 con 0x7ff7900b4530 2023-07-14T11:17:30.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.317+0000 7ff78f7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff7900b8a60 0x7ff7900b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:30.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.317+0000 7ff78f7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff7900b8a60 0x7ff7900b3ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39570/0 (socket says 172.21.15.84:39570) 2023-07-14T11:17:30.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.317+0000 7ff78f7fe700 1 -- 172.21.15.84:0/1545572169 learned_addr learned my addr 172.21.15.84:0/1545572169 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:30.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.317+0000 7ff78effd700 1 --2- 172.21.15.84:0/1545572169 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7900b4530 0x7ff7900d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:30.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.317+0000 7ff78ffff700 1 --2- 172.21.15.84:0/1545572169 >> v2:172.21.15.179:3300/0 conn(0x7ff7900d1050 0x7ff7900b25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:30.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.317+0000 7ff78f7fe700 1 -- 172.21.15.84:0/1545572169 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7900b4530 msgr2=0x7ff7900d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:30.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.317+0000 7ff78f7fe700 1 --2- 172.21.15.84:0/1545572169 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7900b4530 0x7ff7900d0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:30.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.317+0000 7ff78f7fe700 1 -- 172.21.15.84:0/1545572169 >> v2:172.21.15.179:3300/0 conn(0x7ff7900d1050 msgr2=0x7ff7900b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:30.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.317+0000 7ff78f7fe700 1 --2- 172.21.15.84:0/1545572169 >> v2:172.21.15.179:3300/0 conn(0x7ff7900d1050 0x7ff7900b25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:30.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.317+0000 7ff78f7fe700 1 -- 172.21.15.84:0/1545572169 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7900afd80 con 0x7ff7900b8a60 2023-07-14T11:17:30.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.317+0000 7ff78f7fe700 1 --2- 172.21.15.84:0/1545572169 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7900b8a60 0x7ff7900b3ff0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7ff79008c2e0 tx=0x7ff780009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64591c699b4de22c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:30.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.318+0000 7ff78e7fc700 1 -- 172.21.15.84:0/1545572169 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff78000b870 con 0x7ff7900b8a60 2023-07-14T11:17:30.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.318+0000 7ff78e7fc700 1 -- 172.21.15.84:0/1545572169 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff78000b9d0 con 0x7ff7900b8a60 2023-07-14T11:17:30.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.318+0000 7ff78e7fc700 1 -- 172.21.15.84:0/1545572169 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff78000bd60 con 0x7ff7900b8a60 2023-07-14T11:17:30.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.318+0000 7ff795fff700 1 -- 172.21.15.84:0/1545572169 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7900b8a60 msgr2=0x7ff7900b3ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:30.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.318+0000 7ff795fff700 1 --2- 172.21.15.84:0/1545572169 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7900b8a60 0x7ff7900b3ff0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7ff79008c2e0 tx=0x7ff780009bd0 comp rx=0 tx=0).stop 2023-07-14T11:17:30.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.318+0000 7ff795fff700 1 -- 172.21.15.84:0/1545572169 shutdown_connections 2023-07-14T11:17:30.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.318+0000 7ff795fff700 1 --2- 172.21.15.84:0/1545572169 >> v2:172.21.15.179:3300/0 conn(0x7ff7900d1050 0x7ff7900b25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:30.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.318+0000 7ff795fff700 1 --2- 172.21.15.84:0/1545572169 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7900b8a60 0x7ff7900b3ff0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:30.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.318+0000 7ff795fff700 1 --2- 172.21.15.84:0/1545572169 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7900b4530 0x7ff7900d0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:30.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.318+0000 7ff795fff700 1 -- 172.21.15.84:0/1545572169 >> 172.21.15.84:0/1545572169 conn(0x7ff79009c1b0 msgr2=0x7ff7900d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:30.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.318+0000 7ff795fff700 1 -- 172.21.15.84:0/1545572169 shutdown_connections 2023-07-14T11:17:30.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.318+0000 7ff795fff700 1 -- 172.21.15.84:0/1545572169 wait complete. 2023-07-14T11:17:30.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.321+0000 7ff795fff700 1 Processor -- start 2023-07-14T11:17:30.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.321+0000 7ff795fff700 1 -- start start 2023-07-14T11:17:30.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.322+0000 7ff795fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7900b4530 0x7ff7901f76d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:30.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.322+0000 7ff795fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7900b8a60 0x7ff7900cb500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:30.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.322+0000 7ff795fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7900d1050 0x7ff7901fa150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:30.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.322+0000 7ff795fff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7900caab0 con 0x7ff7900b8a60 2023-07-14T11:17:30.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.322+0000 7ff795fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7900c8f30 con 0x7ff7900d1050 2023-07-14T11:17:30.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.322+0000 7ff795fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7900c9210 con 0x7ff7900b4530 2023-07-14T11:17:30.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.322+0000 7ff78effd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7900b8a60 0x7ff7900cb500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:30.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.322+0000 7ff78effd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7900b8a60 0x7ff7900cb500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39576/0 (socket says 172.21.15.84:39576) 2023-07-14T11:17:30.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.322+0000 7ff78effd700 1 -- 172.21.15.84:0/3003989285 learned_addr learned my addr 172.21.15.84:0/3003989285 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:30.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.323+0000 7ff78f7fe700 1 --2- 172.21.15.84:0/3003989285 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7900b4530 0x7ff7901f76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:30.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.323+0000 7ff78ffff700 1 --2- 172.21.15.84:0/3003989285 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7900d1050 0x7ff7901fa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:30.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.323+0000 7ff78effd700 1 -- 172.21.15.84:0/3003989285 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7900b4530 msgr2=0x7ff7901f76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:30.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.323+0000 7ff78effd700 1 --2- 172.21.15.84:0/3003989285 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7900b4530 0x7ff7901f76d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:30.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.323+0000 7ff78effd700 1 -- 172.21.15.84:0/3003989285 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7900d1050 msgr2=0x7ff7901fa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:30.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.323+0000 7ff78effd700 1 --2- 172.21.15.84:0/3003989285 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7900d1050 0x7ff7901fa150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:30.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.323+0000 7ff78effd700 1 -- 172.21.15.84:0/3003989285 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff780009550 con 0x7ff7900b8a60 2023-07-14T11:17:30.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.323+0000 7ff78effd700 1 --2- 172.21.15.84:0/3003989285 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7900b8a60 0x7ff7900cb500 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7ff78400e810 tx=0x7ff78400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:30.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.323+0000 7ff777fff700 1 -- 172.21.15.84:0/3003989285 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff78400c070 con 0x7ff7900b8a60 2023-07-14T11:17:30.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.323+0000 7ff777fff700 1 -- 172.21.15.84:0/3003989285 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff784013610 con 0x7ff7900b8a60 2023-07-14T11:17:30.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.323+0000 7ff777fff700 1 -- 172.21.15.84:0/3003989285 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7840139c0 con 0x7ff7900b8a60 2023-07-14T11:17:30.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.323+0000 7ff795fff700 1 -- 172.21.15.84:0/3003989285 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7900c94f0 con 0x7ff7900b8a60 2023-07-14T11:17:30.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.324+0000 7ff795fff700 1 -- 172.21.15.84:0/3003989285 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7900cafe0 con 0x7ff7900b8a60 2023-07-14T11:17:30.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.324+0000 7ff795fff700 1 -- 172.21.15.84:0/3003989285 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7900cb350 con 0x7ff7900b8a60 2023-07-14T11:17:30.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.325+0000 7ff777fff700 1 -- 172.21.15.84:0/3003989285 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 10) v1 ==== 89241+0+0 (secure 0 0 0) 0x7ff784013b20 con 0x7ff7900b8a60 2023-07-14T11:17:30.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.326+0000 7ff777fff700 1 --2- 172.21.15.84:0/3003989285 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff77c06af20 0x7ff77c06d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:30.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.326+0000 7ff777fff700 1 -- 172.21.15.84:0/3003989285 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff784089800 con 0x7ff7900b8a60 2023-07-14T11:17:30.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.327+0000 7ff78f7fe700 1 --2- 172.21.15.84:0/3003989285 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff77c06af20 0x7ff77c06d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:30.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.327+0000 7ff78f7fe700 1 --2- 172.21.15.84:0/3003989285 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff77c06af20 0x7ff77c06d3d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff780000c00 tx=0x7ff780008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:30.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.330+0000 7ff777fff700 1 -- 172.21.15.84:0/3003989285 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ff7840543b0 con 0x7ff7900b8a60 2023-07-14T11:17:30.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.555+0000 7ff795fff700 1 -- 172.21.15.84:0/3003989285 --> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvolume_0000000000851780", "target": ["mon-mgr", ""]}) v1 -- 0x7ff7900c9730 con 0x7ff77c06af20 2023-07-14T11:17:30.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.576+0000 7ff777fff700 1 -- 172.21.15.84:0/3003989285 <== mgr.4104 v2:172.21.15.84:6832/379617029 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7ff78000bb40 con 0x7ff77c06af20 2023-07-14T11:17:30.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.579+0000 7ff795fff700 1 -- 172.21.15.84:0/3003989285 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff77c06af20 msgr2=0x7ff77c06d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:30.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.579+0000 7ff795fff700 1 --2- 172.21.15.84:0/3003989285 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff77c06af20 0x7ff77c06d3d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff780000c00 tx=0x7ff780008030 comp rx=0 tx=0).stop 2023-07-14T11:17:30.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.579+0000 7ff795fff700 1 -- 172.21.15.84:0/3003989285 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7900b8a60 msgr2=0x7ff7900cb500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:30.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.579+0000 7ff795fff700 1 --2- 172.21.15.84:0/3003989285 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7900b8a60 0x7ff7900cb500 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7ff78400e810 tx=0x7ff78400eb20 comp rx=0 tx=0).stop 2023-07-14T11:17:30.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.579+0000 7ff795fff700 1 -- 172.21.15.84:0/3003989285 shutdown_connections 2023-07-14T11:17:30.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.579+0000 7ff795fff700 1 --2- 172.21.15.84:0/3003989285 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff77c06af20 0x7ff77c06d3d0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:30.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.579+0000 7ff795fff700 1 --2- 172.21.15.84:0/3003989285 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7900b4530 0x7ff7901f76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:30.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.579+0000 7ff795fff700 1 --2- 172.21.15.84:0/3003989285 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7900d1050 0x7ff7901fa150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:30.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.579+0000 7ff795fff700 1 --2- 172.21.15.84:0/3003989285 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7900b8a60 0x7ff7900cb500 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:30.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.579+0000 7ff795fff700 1 -- 172.21.15.84:0/3003989285 >> 172.21.15.84:0/3003989285 conn(0x7ff79009c1b0 msgr2=0x7ff79006a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:30.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.579+0000 7ff795fff700 1 -- 172.21.15.84:0/3003989285 shutdown_connections 2023-07-14T11:17:30.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:30.579+0000 7ff795fff700 1 -- 172.21.15.84:0/3003989285 wait complete. 2023-07-14T11:17:30.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:17:30.601 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2023-07-14T11:17:30.691 INFO:teuthology.orchestra.run.smithi084.stdout:2 2023-07-14T11:17:30.692 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-14T11:17:30.693 DEBUG:teuthology.orchestra.run.smithi084:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-14T11:17:30.789 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-14T11:17:30.905 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-14T11:17:30.906 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-14T11:17:30.906 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:17:30.953 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-14T11:17:30.953 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:17:31.039 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:17:31.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.271+0000 7f9033fff700 1 Processor -- start 2023-07-14T11:17:31.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.272+0000 7f9033fff700 1 -- start start 2023-07-14T11:17:31.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.273+0000 7f9033fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f902c15e890 0x7f902c0cee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:31.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.273+0000 7f9033fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f902c0b3780 0x7f902c0b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:31.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.273+0000 7f9033fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f902c15a8c0 0x7f902c15ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:31.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.273+0000 7f9033fff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f902c0cf380 con 0x7f902c15a8c0 2023-07-14T11:17:31.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.273+0000 7f9033fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f902c0b4130 con 0x7f902c0b3780 2023-07-14T11:17:31.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.273+0000 7f9033fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f902c0ce110 con 0x7f902c15e890 2023-07-14T11:17:31.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.273+0000 7f903259c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f902c15a8c0 0x7f902c15ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:31.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.273+0000 7f903259c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f902c15a8c0 0x7f902c15ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39586/0 (socket says 172.21.15.84:39586) 2023-07-14T11:17:31.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.273+0000 7f903259c700 1 -- 172.21.15.84:0/2585247358 learned_addr learned my addr 172.21.15.84:0/2585247358 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:31.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.273+0000 7f903159a700 1 --2- 172.21.15.84:0/2585247358 >> v2:172.21.15.179:3300/0 conn(0x7f902c0b3780 0x7f902c0b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:31.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.273+0000 7f9031d9b700 1 --2- 172.21.15.84:0/2585247358 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f902c15e890 0x7f902c0cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:31.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.273+0000 7f903259c700 1 -- 172.21.15.84:0/2585247358 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f902c15e890 msgr2=0x7f902c0cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:31.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.273+0000 7f903259c700 1 --2- 172.21.15.84:0/2585247358 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f902c15e890 0x7f902c0cee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:31.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.274+0000 7f903259c700 1 -- 172.21.15.84:0/2585247358 >> v2:172.21.15.179:3300/0 conn(0x7f902c0b3780 msgr2=0x7f902c0b3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:31.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.274+0000 7f903259c700 1 --2- 172.21.15.84:0/2585247358 >> v2:172.21.15.179:3300/0 conn(0x7f902c0b3780 0x7f902c0b3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:31.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.274+0000 7f903259c700 1 -- 172.21.15.84:0/2585247358 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f902c15b660 con 0x7f902c15a8c0 2023-07-14T11:17:31.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.274+0000 7f903159a700 1 --2- 172.21.15.84:0/2585247358 >> v2:172.21.15.179:3300/0 conn(0x7f902c0b3780 0x7f902c0b3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:17:31.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.274+0000 7f903259c700 1 --2- 172.21.15.84:0/2585247358 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f902c15a8c0 0x7f902c15ad40 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f902c071cb0 tx=0x7f902400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d4c38ff9934f0b6 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:31.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.274+0000 7f9030d99700 1 -- 172.21.15.84:0/2585247358 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f902400e070 con 0x7f902c15a8c0 2023-07-14T11:17:31.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.274+0000 7f9030d99700 1 -- 172.21.15.84:0/2585247358 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f902400b8d0 con 0x7f902c15a8c0 2023-07-14T11:17:31.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.274+0000 7f9030d99700 1 -- 172.21.15.84:0/2585247358 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f902400bc80 con 0x7f902c15a8c0 2023-07-14T11:17:31.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.274+0000 7f9033fff700 1 -- 172.21.15.84:0/2585247358 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f902c15a8c0 msgr2=0x7f902c15ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:31.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.274+0000 7f9033fff700 1 --2- 172.21.15.84:0/2585247358 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f902c15a8c0 0x7f902c15ad40 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f902c071cb0 tx=0x7f902400b330 comp rx=0 tx=0).stop 2023-07-14T11:17:31.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.275+0000 7f9033fff700 1 -- 172.21.15.84:0/2585247358 shutdown_connections 2023-07-14T11:17:31.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.275+0000 7f9033fff700 1 --2- 172.21.15.84:0/2585247358 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f902c15e890 0x7f902c0cee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:31.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.275+0000 7f9033fff700 1 --2- 172.21.15.84:0/2585247358 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f902c15a8c0 0x7f902c15ad40 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:31.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.275+0000 7f9033fff700 1 --2- 172.21.15.84:0/2585247358 >> v2:172.21.15.179:3300/0 conn(0x7f902c0b3780 0x7f902c0b3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:31.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.275+0000 7f9033fff700 1 -- 172.21.15.84:0/2585247358 >> 172.21.15.84:0/2585247358 conn(0x7f902c069f30 msgr2=0x7f902c06a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:31.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.275+0000 7f9033fff700 1 -- 172.21.15.84:0/2585247358 shutdown_connections 2023-07-14T11:17:31.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.275+0000 7f9033fff700 1 -- 172.21.15.84:0/2585247358 wait complete. 2023-07-14T11:17:31.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.276+0000 7f9033fff700 1 Processor -- start 2023-07-14T11:17:31.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.277+0000 7f9033fff700 1 -- start start 2023-07-14T11:17:31.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.277+0000 7f9033fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f902c0b3780 0x7f902c0c53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:31.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.277+0000 7f9033fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f902c15a8c0 0x7f902c147210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:31.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.277+0000 7f9033fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f902c15e890 0x7f902c147750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:31.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.277+0000 7f9033fff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f902c1454d0 con 0x7f902c15a8c0 2023-07-14T11:17:31.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.277+0000 7f9033fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f902c145180 con 0x7f902c0b3780 2023-07-14T11:17:31.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.277+0000 7f9033fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f902c0c5d40 con 0x7f902c15e890 2023-07-14T11:17:31.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.278+0000 7f903159a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f902c15a8c0 0x7f902c147210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:31.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.278+0000 7f903159a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f902c15a8c0 0x7f902c147210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39602/0 (socket says 172.21.15.84:39602) 2023-07-14T11:17:31.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.278+0000 7f903159a700 1 -- 172.21.15.84:0/3401162847 learned_addr learned my addr 172.21.15.84:0/3401162847 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:31.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.278+0000 7f903259c700 1 --2- 172.21.15.84:0/3401162847 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f902c15e890 0x7f902c147750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:31.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.278+0000 7f9031d9b700 1 --2- 172.21.15.84:0/3401162847 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f902c0b3780 0x7f902c0c53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:31.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.278+0000 7f903159a700 1 -- 172.21.15.84:0/3401162847 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f902c15e890 msgr2=0x7f902c147750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:31.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.278+0000 7f903159a700 1 --2- 172.21.15.84:0/3401162847 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f902c15e890 0x7f902c147750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:31.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.278+0000 7f903159a700 1 -- 172.21.15.84:0/3401162847 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f902c0b3780 msgr2=0x7f902c0c53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:31.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.278+0000 7f903159a700 1 --2- 172.21.15.84:0/3401162847 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f902c0b3780 0x7f902c0c53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:31.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.278+0000 7f903159a700 1 -- 172.21.15.84:0/3401162847 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9024009b30 con 0x7f902c15a8c0 2023-07-14T11:17:31.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.278+0000 7f903159a700 1 --2- 172.21.15.84:0/3401162847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f902c15a8c0 0x7f902c147210 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f901c00e810 tx=0x7f901c00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:31.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.279+0000 7f90227fc700 1 -- 172.21.15.84:0/3401162847 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f901c00c020 con 0x7f902c15a8c0 2023-07-14T11:17:31.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.279+0000 7f90227fc700 1 -- 172.21.15.84:0/3401162847 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f901c004250 con 0x7f902c15a8c0 2023-07-14T11:17:31.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.279+0000 7f9033fff700 1 -- 172.21.15.84:0/3401162847 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f902c0c6020 con 0x7f902c15a8c0 2023-07-14T11:17:31.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.279+0000 7f90227fc700 1 -- 172.21.15.84:0/3401162847 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f901c0036a0 con 0x7f902c15a8c0 2023-07-14T11:17:31.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.279+0000 7f9033fff700 1 -- 172.21.15.84:0/3401162847 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f902c0c5900 con 0x7f902c15a8c0 2023-07-14T11:17:31.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.280+0000 7f9033fff700 1 -- 172.21.15.84:0/3401162847 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f902c04e280 con 0x7f902c15a8c0 2023-07-14T11:17:31.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.281+0000 7f90227fc700 1 -- 172.21.15.84:0/3401162847 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7f901c003800 con 0x7f902c15a8c0 2023-07-14T11:17:31.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.281+0000 7f90227fc700 1 --2- 172.21.15.84:0/3401162847 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f901006b040 0x7f901006d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:31.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.282+0000 7f90227fc700 1 -- 172.21.15.84:0/3401162847 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f901c089410 con 0x7f902c15a8c0 2023-07-14T11:17:31.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.282+0000 7f9031d9b700 1 --2- 172.21.15.84:0/3401162847 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f901006b040 0x7f901006d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:31.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.282+0000 7f9031d9b700 1 --2- 172.21.15.84:0/3401162847 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f901006b040 0x7f901006d4f0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f9028009b60 tx=0x7f9028009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:31.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.286+0000 7f90227fc700 1 -- 172.21.15.84:0/3401162847 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f901c053ff0 con 0x7f902c15a8c0 2023-07-14T11:17:31.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.480+0000 7f9033fff700 1 -- 172.21.15.84:0/3401162847 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f902c0cac80 con 0x7f902c15a8c0 2023-07-14T11:17:31.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.481+0000 7f90227fc700 1 -- 172.21.15.84:0/3401162847 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+18269 (secure 0 0 0) 0x7f901c057610 con 0x7f902c15a8c0 2023-07-14T11:17:31.484 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:17:31.484 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":63,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:17:14.075543+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-07-14T11:17:10.750697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-07-14T11:17:11.528893+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:17:31.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.484+0000 7f9033fff700 1 -- 172.21.15.84:0/3401162847 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f901006b040 msgr2=0x7f901006d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:31.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.484+0000 7f9033fff700 1 --2- 172.21.15.84:0/3401162847 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f901006b040 0x7f901006d4f0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f9028009b60 tx=0x7f9028009210 comp rx=0 tx=0).stop 2023-07-14T11:17:31.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.484+0000 7f9033fff700 1 -- 172.21.15.84:0/3401162847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f902c15a8c0 msgr2=0x7f902c147210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:31.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.484+0000 7f9033fff700 1 --2- 172.21.15.84:0/3401162847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f902c15a8c0 0x7f902c147210 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f901c00e810 tx=0x7f901c00eb20 comp rx=0 tx=0).stop 2023-07-14T11:17:31.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.484+0000 7f9033fff700 1 -- 172.21.15.84:0/3401162847 shutdown_connections 2023-07-14T11:17:31.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.484+0000 7f9033fff700 1 --2- 172.21.15.84:0/3401162847 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f901006b040 0x7f901006d4f0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:31.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.484+0000 7f9033fff700 1 --2- 172.21.15.84:0/3401162847 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f902c15e890 0x7f902c147750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:31.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.484+0000 7f9033fff700 1 --2- 172.21.15.84:0/3401162847 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f902c0b3780 0x7f902c0c53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:31.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.484+0000 7f9033fff700 1 --2- 172.21.15.84:0/3401162847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f902c15a8c0 0x7f902c147210 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:31.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.484+0000 7f9033fff700 1 -- 172.21.15.84:0/3401162847 >> 172.21.15.84:0/3401162847 conn(0x7f902c069f30 msgr2=0x7f902c15b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:31.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.484+0000 7f9033fff700 1 -- 172.21.15.84:0/3401162847 shutdown_connections 2023-07-14T11:17:31.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.484+0000 7f9033fff700 1 -- 172.21.15.84:0/3401162847 wait complete. 2023-07-14T11:17:31.505 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T11:13:00.125395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T11:13:06.803994+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T11:17:10.750697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T11:17:11.528893+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '63', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T11:17:31.505 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T11:17:31.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.701+0000 7fe193dff700 1 Processor -- start 2023-07-14T11:17:31.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.702+0000 7fe193dff700 1 -- start start 2023-07-14T11:17:31.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.703+0000 7fe193dff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe18c0adea0 0x7fe18c0ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:31.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.703+0000 7fe193dff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe18c15ce70 con 0x7fe18c0b12f0 2023-07-14T11:17:31.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.703+0000 7fe193dff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe18c15d0c0 con 0x7fe18c0c92d0 2023-07-14T11:17:31.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.703+0000 7fe193dff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe18c15da60 con 0x7fe18c0adea0 2023-07-14T11:17:31.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.703+0000 7fe19139a700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fe18c0b12f0 0x7fe18c0cc690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52772/0 (socket says 172.21.15.84:52772) 2023-07-14T11:17:31.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.703+0000 7fe19139a700 1 -- 172.21.15.84:0/3724232856 learned_addr learned my addr 172.21.15.84:0/3724232856 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:17:31.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.703+0000 7fe19239c700 1 --2- 172.21.15.84:0/3724232856 >> v2:172.21.15.179:3300/0 conn(0x7fe18c0adea0 0x7fe18c0ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:31.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.703+0000 7fe190b99700 1 -- 172.21.15.84:0/3724232856 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 794713142 0 0) 0x7fe18c15ce70 con 0x7fe18c0b12f0 2023-07-14T11:17:31.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.704+0000 7fe190b99700 1 -- 172.21.15.84:0/3724232856 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1780035b0 con 0x7fe18c0b12f0 2023-07-14T11:17:31.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.704+0000 7fe19239c700 1 -- 172.21.15.84:0/3724232856 >> v1:172.21.15.179:6789/0 conn(0x7fe18c0c92d0 legacy=0x7fe18c0c96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:31.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.704+0000 7fe19239c700 1 -- 172.21.15.84:0/3724232856 >> v1:172.21.15.84:6789/0 conn(0x7fe18c0b12f0 legacy=0x7fe18c0cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:31.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.704+0000 7fe19239c700 1 -- 172.21.15.84:0/3724232856 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe18c15d3a0 con 0x7fe18c0adea0 2023-07-14T11:17:31.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.704+0000 7fe19239c700 1 --2- 172.21.15.84:0/3724232856 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe18c0adea0 0x7fe18c0ad8f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe184009d90 tx=0x7fe18400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48f7a4d750f0fc97 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:31.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.704+0000 7fe190b99700 1 -- 172.21.15.84:0/3724232856 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe18400e070 con 0x7fe18c0adea0 2023-07-14T11:17:31.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.704+0000 7fe190b99700 1 -- 172.21.15.84:0/3724232856 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe18400bb20 con 0x7fe18c0adea0 2023-07-14T11:17:31.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.704+0000 7fe190b99700 1 -- 172.21.15.84:0/3724232856 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe184012430 con 0x7fe18c0adea0 2023-07-14T11:17:31.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.705+0000 7fe193dff700 1 -- 172.21.15.84:0/3724232856 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe18c0adea0 msgr2=0x7fe18c0ad8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:31.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.705+0000 7fe193dff700 1 --2- 172.21.15.84:0/3724232856 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe18c0adea0 0x7fe18c0ad8f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe184009d90 tx=0x7fe18400b330 comp rx=0 tx=0).stop 2023-07-14T11:17:31.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.705+0000 7fe193dff700 1 -- 172.21.15.84:0/3724232856 shutdown_connections 2023-07-14T11:17:31.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.705+0000 7fe193dff700 1 --2- 172.21.15.84:0/3724232856 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe18c0adea0 0x7fe18c0ad8f0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:31.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.705+0000 7fe193dff700 1 -- 172.21.15.84:0/3724232856 >> 172.21.15.84:0/3724232856 conn(0x7fe18c0b05d0 msgr2=0x7fe18c0b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:31.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.705+0000 7fe193dff700 1 -- 172.21.15.84:0/3724232856 shutdown_connections 2023-07-14T11:17:31.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.705+0000 7fe193dff700 1 -- 172.21.15.84:0/3724232856 wait complete. 2023-07-14T11:17:31.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.707+0000 7fe193dff700 1 Processor -- start 2023-07-14T11:17:31.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.707+0000 7fe193dff700 1 -- start start 2023-07-14T11:17:31.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.708+0000 7fe193dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe18c0adea0 0x7fe18c0c7490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:31.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.708+0000 7fe193dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe18c0b12f0 0x7fe18c157180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:31.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.708+0000 7fe193dff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe18c0c92d0 0x7fe18c1576c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:31.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.708+0000 7fe193dff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe18c0aef20 con 0x7fe18c0c92d0 2023-07-14T11:17:31.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.708+0000 7fe193dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe18c0ae330 con 0x7fe18c0b12f0 2023-07-14T11:17:31.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.708+0000 7fe193dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe18c0ae5f0 con 0x7fe18c0adea0 2023-07-14T11:17:31.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.708+0000 7fe19239c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe18c0c92d0 0x7fe18c1576c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:31.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.708+0000 7fe19239c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe18c0c92d0 0x7fe18c1576c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39610/0 (socket says 172.21.15.84:39610) 2023-07-14T11:17:31.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.708+0000 7fe19239c700 1 -- 172.21.15.84:0/2238464390 learned_addr learned my addr 172.21.15.84:0/2238464390 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:31.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.708+0000 7fe191b9b700 1 --2- 172.21.15.84:0/2238464390 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe18c0adea0 0x7fe18c0c7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:31.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.708+0000 7fe19139a700 1 --2- 172.21.15.84:0/2238464390 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe18c0b12f0 0x7fe18c157180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:31.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.708+0000 7fe19239c700 1 -- 172.21.15.84:0/2238464390 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe18c0adea0 msgr2=0x7fe18c0c7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:31.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.708+0000 7fe19239c700 1 --2- 172.21.15.84:0/2238464390 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe18c0adea0 0x7fe18c0c7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:31.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.708+0000 7fe19239c700 1 -- 172.21.15.84:0/2238464390 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe18c0b12f0 msgr2=0x7fe18c157180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:31.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.708+0000 7fe19239c700 1 --2- 172.21.15.84:0/2238464390 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe18c0b12f0 0x7fe18c157180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:31.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.708+0000 7fe19239c700 1 -- 172.21.15.84:0/2238464390 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe184009a70 con 0x7fe18c0c92d0 2023-07-14T11:17:31.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.709+0000 7fe19239c700 1 --2- 172.21.15.84:0/2238464390 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe18c0c92d0 0x7fe18c1576c0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fe184014040 tx=0x7fe184004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:31.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.709+0000 7fe1827fc700 1 -- 172.21.15.84:0/2238464390 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe184012430 con 0x7fe18c0c92d0 2023-07-14T11:17:31.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.709+0000 7fe1827fc700 1 -- 172.21.15.84:0/2238464390 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe184020070 con 0x7fe18c0c92d0 2023-07-14T11:17:31.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.709+0000 7fe1827fc700 1 -- 172.21.15.84:0/2238464390 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe184004280 con 0x7fe18c0c92d0 2023-07-14T11:17:31.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.709+0000 7fe193dff700 1 -- 172.21.15.84:0/2238464390 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe18c0ae8d0 con 0x7fe18c0c92d0 2023-07-14T11:17:31.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.709+0000 7fe193dff700 1 -- 172.21.15.84:0/2238464390 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe18c0c57c0 con 0x7fe18c0c92d0 2023-07-14T11:17:31.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.710+0000 7fe193dff700 1 -- 172.21.15.84:0/2238464390 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe18c0af0d0 con 0x7fe18c0c92d0 2023-07-14T11:17:31.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.711+0000 7fe1827fc700 1 -- 172.21.15.84:0/2238464390 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7fe1840043e0 con 0x7fe18c0c92d0 2023-07-14T11:17:31.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.712+0000 7fe1827fc700 1 --2- 172.21.15.84:0/2238464390 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe17006b040 0x7fe17006d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:31.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.712+0000 7fe1827fc700 1 -- 172.21.15.84:0/2238464390 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe184022070 con 0x7fe18c0c92d0 2023-07-14T11:17:31.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.712+0000 7fe191b9b700 1 --2- 172.21.15.84:0/2238464390 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe17006b040 0x7fe17006d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:31.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.713+0000 7fe191b9b700 1 --2- 172.21.15.84:0/2238464390 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe17006b040 0x7fe17006d4f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fe188000f60 tx=0x7fe188009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:31.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.716+0000 7fe1827fc700 1 -- 172.21.15.84:0/2238464390 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe18c0af0d0 con 0x7fe18c0c92d0 2023-07-14T11:17:31.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.912+0000 7fe193dff700 1 -- 172.21.15.84:0/2238464390 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe18c074350 con 0x7fe18c0c92d0 2023-07-14T11:17:31.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.912+0000 7fe1827fc700 1 -- 172.21.15.84:0/2238464390 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v63) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe184056450 con 0x7fe18c0c92d0 2023-07-14T11:17:31.915 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-07-14T11:17:31.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.914+0000 7fe193dff700 1 -- 172.21.15.84:0/2238464390 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe17006b040 msgr2=0x7fe17006d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:31.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.914+0000 7fe193dff700 1 --2- 172.21.15.84:0/2238464390 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe17006b040 0x7fe17006d4f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fe188000f60 tx=0x7fe188009040 comp rx=0 tx=0).stop 2023-07-14T11:17:31.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.914+0000 7fe193dff700 1 -- 172.21.15.84:0/2238464390 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe18c0c92d0 msgr2=0x7fe18c1576c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:31.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.914+0000 7fe193dff700 1 --2- 172.21.15.84:0/2238464390 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe18c0c92d0 0x7fe18c1576c0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fe184014040 tx=0x7fe184004ad0 comp rx=0 tx=0).stop 2023-07-14T11:17:31.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.915+0000 7fe193dff700 1 -- 172.21.15.84:0/2238464390 shutdown_connections 2023-07-14T11:17:31.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.915+0000 7fe193dff700 1 --2- 172.21.15.84:0/2238464390 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe17006b040 0x7fe17006d4f0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:31.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.915+0000 7fe193dff700 1 --2- 172.21.15.84:0/2238464390 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe18c0adea0 0x7fe18c0c7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:31.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.915+0000 7fe193dff700 1 --2- 172.21.15.84:0/2238464390 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe18c0c92d0 0x7fe18c1576c0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:31.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.915+0000 7fe193dff700 1 --2- 172.21.15.84:0/2238464390 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe18c0b12f0 0x7fe18c157180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:31.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.915+0000 7fe193dff700 1 -- 172.21.15.84:0/2238464390 >> 172.21.15.84:0/2238464390 conn(0x7fe18c0b05d0 msgr2=0x7fe18c0c9e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:31.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.915+0000 7fe193dff700 1 -- 172.21.15.84:0/2238464390 shutdown_connections 2023-07-14T11:17:31.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:31.915+0000 7fe193dff700 1 -- 172.21.15.84:0/2238464390 wait complete. 2023-07-14T11:17:31.935 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T11:17:32.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.133+0000 7f6f997ff700 1 Processor -- start 2023-07-14T11:17:32.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.133+0000 7f6f997ff700 1 -- start start 2023-07-14T11:17:32.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.134+0000 7f6f997ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6f9406f010 0x7f6f94071650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:32.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.134+0000 7f6f997ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f940cdba0 con 0x7f6f940ce030 2023-07-14T11:17:32.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.134+0000 7f6f997ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f940cf370 con 0x7f6f9406a640 2023-07-14T11:17:32.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.134+0000 7f6f997ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f9406f3e0 con 0x7f6f9406f010 2023-07-14T11:17:32.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.134+0000 7f6f927fc700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f6f940ce030 0x7f6f94069f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52786/0 (socket says 172.21.15.84:52786) 2023-07-14T11:17:32.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.135+0000 7f6f927fc700 1 -- 172.21.15.84:0/1670617932 learned_addr learned my addr 172.21.15.84:0/1670617932 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:17:32.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.135+0000 7f6f92ffd700 1 --2- 172.21.15.84:0/1670617932 >> v2:172.21.15.179:3300/0 conn(0x7f6f9406f010 0x7f6f94071650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:32.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.135+0000 7f6f91ffb700 1 -- 172.21.15.84:0/1670617932 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3765019163 0 0) 0x7f6f940cdba0 con 0x7f6f940ce030 2023-07-14T11:17:32.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.135+0000 7f6f91ffb700 1 -- 172.21.15.84:0/1670617932 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f7c0035b0 con 0x7f6f940ce030 2023-07-14T11:17:32.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.135+0000 7f6f91ffb700 1 -- 172.21.15.84:0/1670617932 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2329248036 0 0) 0x7f6f940cf370 con 0x7f6f9406a640 2023-07-14T11:17:32.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.135+0000 7f6f91ffb700 1 -- 172.21.15.84:0/1670617932 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f940cdba0 con 0x7f6f9406a640 2023-07-14T11:17:32.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.135+0000 7f6f91ffb700 1 -- 172.21.15.84:0/1670617932 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2944018032 0 0) 0x7f6f7c0035b0 con 0x7f6f940ce030 2023-07-14T11:17:32.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.135+0000 7f6f91ffb700 1 -- 172.21.15.84:0/1670617932 >> v2:172.21.15.179:3300/0 conn(0x7f6f9406f010 msgr2=0x7f6f94071650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:32.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.135+0000 7f6f91ffb700 1 --2- 172.21.15.84:0/1670617932 >> v2:172.21.15.179:3300/0 conn(0x7f6f9406f010 0x7f6f94071650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:32.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.135+0000 7f6f91ffb700 1 -- 172.21.15.84:0/1670617932 >> v1:172.21.15.179:6789/0 conn(0x7f6f9406a640 legacy=0x7f6f941601d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:32.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.135+0000 7f6f91ffb700 1 -- 172.21.15.84:0/1670617932 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f940cf650 con 0x7f6f940ce030 2023-07-14T11:17:32.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.135+0000 7f6f91ffb700 1 -- 172.21.15.84:0/1670617932 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7f6f88001670 con 0x7f6f940ce030 2023-07-14T11:17:32.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.135+0000 7f6f91ffb700 1 -- 172.21.15.84:0/1670617932 >> v1:172.21.15.84:6789/0 conn(0x7f6f940ce030 legacy=0x7f6f94069f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:32.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.135+0000 7f6f91ffb700 1 --2- 172.21.15.84:0/1670617932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f7c003b90 0x7f6f7c003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:32.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.135+0000 7f6f91ffb700 1 --2- 172.21.15.84:0/1670617932 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f7c004850 0x7f6f7c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:32.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.135+0000 7f6f91ffb700 1 --2- 172.21.15.84:0/1670617932 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f7c005200 0x7f6f7c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:32.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.135+0000 7f6f91ffb700 1 -- 172.21.15.84:0/1670617932 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9406f3e0 con 0x7f6f7c003b90 2023-07-14T11:17:32.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.135+0000 7f6f91ffb700 1 -- 172.21.15.84:0/1670617932 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7c00c060 con 0x7f6f7c005200 2023-07-14T11:17:32.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.135+0000 7f6f91ffb700 1 -- 172.21.15.84:0/1670617932 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7c00c220 con 0x7f6f7c004850 2023-07-14T11:17:32.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.136+0000 7f6f92ffd700 1 --2- 172.21.15.84:0/1670617932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f7c003b90 0x7f6f7c003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:32.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.136+0000 7f6f927fc700 1 --2- 172.21.15.84:0/1670617932 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f7c004850 0x7f6f7c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:32.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.136+0000 7f6f937fe700 1 --2- 172.21.15.84:0/1670617932 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f7c005200 0x7f6f7c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:32.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.136+0000 7f6f92ffd700 1 -- 172.21.15.84:0/1670617932 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f7c004850 msgr2=0x7f6f7c004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:32.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.136+0000 7f6f92ffd700 1 --2- 172.21.15.84:0/1670617932 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f7c004850 0x7f6f7c004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:32.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.136+0000 7f6f92ffd700 1 -- 172.21.15.84:0/1670617932 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f7c005200 msgr2=0x7f6f7c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:32.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.136+0000 7f6f92ffd700 1 --2- 172.21.15.84:0/1670617932 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f7c005200 0x7f6f7c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:32.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.136+0000 7f6f92ffd700 1 -- 172.21.15.84:0/1670617932 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f7c0035b0 con 0x7f6f7c003b90 2023-07-14T11:17:32.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.136+0000 7f6f937fe700 1 --2- 172.21.15.84:0/1670617932 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f7c005200 0x7f6f7c00ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:17:32.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.136+0000 7f6f937fe700 1 -- 172.21.15.84:0/1670617932 reap_dead start 2023-07-14T11:17:32.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.136+0000 7f6f92ffd700 1 --2- 172.21.15.84:0/1670617932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f7c003b90 0x7f6f7c003f80 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f6f84009b60 tx=0x7f6f7c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14148bbd5172b387 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:32.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.136+0000 7f6f91ffb700 1 -- 172.21.15.84:0/1670617932 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8400e6c0 con 0x7f6f7c003b90 2023-07-14T11:17:32.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.136+0000 7f6f91ffb700 1 -- 172.21.15.84:0/1670617932 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f8400e820 con 0x7f6f7c003b90 2023-07-14T11:17:32.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.136+0000 7f6f91ffb700 1 -- 172.21.15.84:0/1670617932 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8400eb90 con 0x7f6f7c003b90 2023-07-14T11:17:32.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.137+0000 7f6f997ff700 1 -- 172.21.15.84:0/1670617932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f7c003b90 msgr2=0x7f6f7c003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:32.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.137+0000 7f6f997ff700 1 --2- 172.21.15.84:0/1670617932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f7c003b90 0x7f6f7c003f80 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f6f84009b60 tx=0x7f6f7c005880 comp rx=0 tx=0).stop 2023-07-14T11:17:32.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.137+0000 7f6f997ff700 1 -- 172.21.15.84:0/1670617932 shutdown_connections 2023-07-14T11:17:32.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.137+0000 7f6f997ff700 1 --2- 172.21.15.84:0/1670617932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f7c003b90 0x7f6f7c003f80 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:32.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.137+0000 7f6f997ff700 1 -- 172.21.15.84:0/1670617932 >> 172.21.15.84:0/1670617932 conn(0x7f6f940cc640 msgr2=0x7f6f940cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:32.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.137+0000 7f6f997ff700 1 -- 172.21.15.84:0/1670617932 shutdown_connections 2023-07-14T11:17:32.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.137+0000 7f6f997ff700 1 -- 172.21.15.84:0/1670617932 wait complete. 2023-07-14T11:17:32.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.139+0000 7f6f997ff700 1 Processor -- start 2023-07-14T11:17:32.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.139+0000 7f6f997ff700 1 -- start start 2023-07-14T11:17:32.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.140+0000 7f6f997ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f7c003b90 0x7f6f940b14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:32.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.140+0000 7f6f997ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f9415b380 0x7f6f9415ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:32.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.140+0000 7f6f997ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f9415ef50 0x7f6f940c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:32.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.140+0000 7f6f997ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9415f4b0 con 0x7f6f9415ef50 2023-07-14T11:17:32.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.140+0000 7f6f997ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f940b0a10 con 0x7f6f9415b380 2023-07-14T11:17:32.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.140+0000 7f6f997ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f940b0cf0 con 0x7f6f7c003b90 2023-07-14T11:17:32.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.140+0000 7f6f937fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f9415ef50 0x7f6f940c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:32.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.140+0000 7f6f937fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f9415ef50 0x7f6f940c8dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39642/0 (socket says 172.21.15.84:39642) 2023-07-14T11:17:32.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.140+0000 7f6f937fe700 1 -- 172.21.15.84:0/3187773809 learned_addr learned my addr 172.21.15.84:0/3187773809 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:32.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.140+0000 7f6f937fe700 1 -- 172.21.15.84:0/3187773809 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f7c003b90 msgr2=0x7f6f940b14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:32.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.140+0000 7f6f937fe700 1 --2- 172.21.15.84:0/3187773809 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f7c003b90 0x7f6f940b14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:32.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.140+0000 7f6f937fe700 1 -- 172.21.15.84:0/3187773809 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f9415b380 msgr2=0x7f6f9415ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:32.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.140+0000 7f6f927fc700 1 --2- 172.21.15.84:0/3187773809 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f9415b380 0x7f6f9415ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:32.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.141+0000 7f6f937fe700 1 --2- 172.21.15.84:0/3187773809 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f9415b380 0x7f6f9415ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:32.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.141+0000 7f6f937fe700 1 -- 172.21.15.84:0/3187773809 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f940b0fd0 con 0x7f6f9415ef50 2023-07-14T11:17:32.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.141+0000 7f6f927fc700 1 --2- 172.21.15.84:0/3187773809 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f9415b380 0x7f6f9415ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:17:32.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.141+0000 7f6f937fe700 1 --2- 172.21.15.84:0/3187773809 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f9415ef50 0x7f6f940c8dd0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f6f9406aa10 tx=0x7f6f8c00df40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:32.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.141+0000 7f6f7b7fe700 1 -- 172.21.15.84:0/3187773809 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8c003e10 con 0x7f6f9415ef50 2023-07-14T11:17:32.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.141+0000 7f6f7b7fe700 1 -- 172.21.15.84:0/3187773809 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f8c00b760 con 0x7f6f9415ef50 2023-07-14T11:17:32.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.141+0000 7f6f997ff700 1 -- 172.21.15.84:0/3187773809 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f9415bd80 con 0x7f6f9415ef50 2023-07-14T11:17:32.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.141+0000 7f6f7b7fe700 1 -- 172.21.15.84:0/3187773809 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8c00bb10 con 0x7f6f9415ef50 2023-07-14T11:17:32.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.141+0000 7f6f997ff700 1 -- 172.21.15.84:0/3187773809 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f9415b7f0 con 0x7f6f9415ef50 2023-07-14T11:17:32.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.142+0000 7f6f997ff700 1 -- 172.21.15.84:0/3187773809 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f94074350 con 0x7f6f9415ef50 2023-07-14T11:17:32.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.143+0000 7f6f7b7fe700 1 -- 172.21.15.84:0/3187773809 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7f6f8c00bc70 con 0x7f6f9415ef50 2023-07-14T11:17:32.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.144+0000 7f6f7b7fe700 1 --2- 172.21.15.84:0/3187773809 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6f8006b040 0x7f6f8006d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:32.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.144+0000 7f6f7b7fe700 1 -- 172.21.15.84:0/3187773809 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6f8c0897e0 con 0x7f6f9415ef50 2023-07-14T11:17:32.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.144+0000 7f6f92ffd700 1 --2- 172.21.15.84:0/3187773809 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6f8006b040 0x7f6f8006d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:32.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.145+0000 7f6f92ffd700 1 --2- 172.21.15.84:0/3187773809 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6f8006b040 0x7f6f8006d4f0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f6f840090b0 tx=0x7f6f84013000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:32.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.149+0000 7f6f7b7fe700 1 -- 172.21.15.84:0/3187773809 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f6f8c0543c0 con 0x7f6f9415ef50 2023-07-14T11:17:32.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.341+0000 7f6f997ff700 1 -- 172.21.15.84:0/3187773809 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6f940cf900 con 0x7f6f9415ef50 2023-07-14T11:17:32.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.341+0000 7f6f7b7fe700 1 -- 172.21.15.84:0/3187773809 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v63) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6f8c018020 con 0x7f6f9415ef50 2023-07-14T11:17:32.344 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-07-14T11:17:32.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.343+0000 7f6f997ff700 1 -- 172.21.15.84:0/3187773809 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6f8006b040 msgr2=0x7f6f8006d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:32.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.343+0000 7f6f997ff700 1 --2- 172.21.15.84:0/3187773809 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6f8006b040 0x7f6f8006d4f0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f6f840090b0 tx=0x7f6f84013000 comp rx=0 tx=0).stop 2023-07-14T11:17:32.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.343+0000 7f6f997ff700 1 -- 172.21.15.84:0/3187773809 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f9415ef50 msgr2=0x7f6f940c8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:32.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.343+0000 7f6f997ff700 1 --2- 172.21.15.84:0/3187773809 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f9415ef50 0x7f6f940c8dd0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f6f9406aa10 tx=0x7f6f8c00df40 comp rx=0 tx=0).stop 2023-07-14T11:17:32.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.343+0000 7f6f997ff700 1 -- 172.21.15.84:0/3187773809 shutdown_connections 2023-07-14T11:17:32.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.343+0000 7f6f997ff700 1 --2- 172.21.15.84:0/3187773809 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6f8006b040 0x7f6f8006d4f0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:32.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.343+0000 7f6f997ff700 1 --2- 172.21.15.84:0/3187773809 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f7c003b90 0x7f6f940b14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:32.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.343+0000 7f6f997ff700 1 --2- 172.21.15.84:0/3187773809 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f9415ef50 0x7f6f940c8dd0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:32.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.343+0000 7f6f997ff700 1 --2- 172.21.15.84:0/3187773809 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f9415b380 0x7f6f9415ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:32.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.343+0000 7f6f997ff700 1 -- 172.21.15.84:0/3187773809 >> 172.21.15.84:0/3187773809 conn(0x7f6f940cc640 msgr2=0x7f6f940ac860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:32.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.343+0000 7f6f997ff700 1 -- 172.21.15.84:0/3187773809 shutdown_connections 2023-07-14T11:17:32.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.344+0000 7f6f997ff700 1 -- 172.21.15.84:0/3187773809 wait complete. 2023-07-14T11:17:32.364 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T11:17:32.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.560+0000 7f3a5f7ff700 1 Processor -- start 2023-07-14T11:17:32.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.560+0000 7f3a5f7ff700 1 -- start start 2023-07-14T11:17:32.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.561+0000 7f3a5f7ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3a580b4600 0x7f3a580cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:32.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.561+0000 7f3a5f7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a580b6f00 0x7f3a580d02b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:32.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.561+0000 7f3a5f7ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a5815cd60 con 0x7f3a580cfe40 2023-07-14T11:17:32.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.561+0000 7f3a5f7ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a580d1550 con 0x7f3a580b4600 2023-07-14T11:17:32.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.561+0000 7f3a5f7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a580d2d90 con 0x7f3a580b6f00 2023-07-14T11:17:32.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.562+0000 7f3a5dd9c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a580b6f00 0x7f3a580d02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:32.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.562+0000 7f3a5cd9a700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f3a580cfe40 0x7f3a580cd540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.84:57182/0 (socket says 172.21.15.84:57182) 2023-07-14T11:17:32.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.562+0000 7f3a5dd9c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a580b6f00 0x7f3a580d02b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.84:59518/0 (socket says 172.21.15.84:59518) 2023-07-14T11:17:32.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.562+0000 7f3a5cd9a700 1 -- 172.21.15.84:0/2523153344 learned_addr learned my addr 172.21.15.84:0/2523153344 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:17:32.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.562+0000 7f3a5d59b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3a580b4600 0x7f3a580cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:32.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.562+0000 7f3a4ffff700 1 -- 172.21.15.84:0/2523153344 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2285442658 0 0) 0x7f3a5815cd60 con 0x7f3a580cfe40 2023-07-14T11:17:32.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.562+0000 7f3a5dd9c700 1 -- 172.21.15.84:0/2523153344 >> v2:172.21.15.179:3300/0 conn(0x7f3a580b4600 msgr2=0x7f3a580cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:32.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.562+0000 7f3a5dd9c700 1 --2- 172.21.15.84:0/2523153344 >> v2:172.21.15.179:3300/0 conn(0x7f3a580b4600 0x7f3a580cf900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:32.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.562+0000 7f3a5dd9c700 1 -- 172.21.15.84:0/2523153344 >> v1:172.21.15.179:6789/0 conn(0x7f3a580cfe40 legacy=0x7f3a580cd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:32.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.562+0000 7f3a5dd9c700 1 -- 172.21.15.84:0/2523153344 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a580cf340 con 0x7f3a580b6f00 2023-07-14T11:17:32.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.562+0000 7f3a5d59b700 1 --2- 172.21.15.84:0/2523153344 >> v2:172.21.15.179:3300/0 conn(0x7f3a580b4600 0x7f3a580cf900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:17:32.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.562+0000 7f3a5dd9c700 1 --2- 172.21.15.84:0/2523153344 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a580b6f00 0x7f3a580d02b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3a50009d90 tx=0x7f3a5000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92c4f01fb3cfe9b2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:32.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.563+0000 7f3a4ffff700 1 -- 172.21.15.84:0/2523153344 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5000e070 con 0x7f3a580b6f00 2023-07-14T11:17:32.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.563+0000 7f3a4ffff700 1 -- 172.21.15.84:0/2523153344 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a5000bb20 con 0x7f3a580b6f00 2023-07-14T11:17:32.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.563+0000 7f3a4ffff700 1 -- 172.21.15.84:0/2523153344 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a50012430 con 0x7f3a580b6f00 2023-07-14T11:17:32.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.563+0000 7f3a5f7ff700 1 -- 172.21.15.84:0/2523153344 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a580b6f00 msgr2=0x7f3a580d02b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:32.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.563+0000 7f3a5f7ff700 1 --2- 172.21.15.84:0/2523153344 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a580b6f00 0x7f3a580d02b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3a50009d90 tx=0x7f3a5000b330 comp rx=0 tx=0).stop 2023-07-14T11:17:32.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.563+0000 7f3a5f7ff700 1 -- 172.21.15.84:0/2523153344 shutdown_connections 2023-07-14T11:17:32.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.563+0000 7f3a5f7ff700 1 --2- 172.21.15.84:0/2523153344 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a580b6f00 0x7f3a580d02b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:32.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.563+0000 7f3a5f7ff700 1 --2- 172.21.15.84:0/2523153344 >> v2:172.21.15.179:3300/0 conn(0x7f3a580b4600 0x7f3a580cf900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:32.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.563+0000 7f3a5f7ff700 1 -- 172.21.15.84:0/2523153344 >> 172.21.15.84:0/2523153344 conn(0x7f3a5809c200 msgr2=0x7f3a580d2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:32.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.564+0000 7f3a5f7ff700 1 -- 172.21.15.84:0/2523153344 shutdown_connections 2023-07-14T11:17:32.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.564+0000 7f3a5f7ff700 1 -- 172.21.15.84:0/2523153344 wait complete. 2023-07-14T11:17:32.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.566+0000 7f3a5f7ff700 1 Processor -- start 2023-07-14T11:17:32.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.566+0000 7f3a5f7ff700 1 -- start start 2023-07-14T11:17:32.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.567+0000 7f3a5f7ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a580b6f00 0x7f3a581e58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:32.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.567+0000 7f3a5f7ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a580cfe40 0x7f3a580c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:32.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.567+0000 7f3a5f7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a5809cc70 0x7f3a5809f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:32.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.567+0000 7f3a5f7ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5809d1f0 con 0x7f3a580b6f00 2023-07-14T11:17:32.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.567+0000 7f3a5f7ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5809ebc0 con 0x7f3a580cfe40 2023-07-14T11:17:32.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.567+0000 7f3a5f7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5809eea0 con 0x7f3a5809cc70 2023-07-14T11:17:32.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.567+0000 7f3a5d59b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a580b6f00 0x7f3a581e58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:32.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.567+0000 7f3a5d59b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a580b6f00 0x7f3a581e58b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39646/0 (socket says 172.21.15.84:39646) 2023-07-14T11:17:32.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.567+0000 7f3a5d59b700 1 -- 172.21.15.84:0/325039384 learned_addr learned my addr 172.21.15.84:0/325039384 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:32.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.567+0000 7f3a5cd9a700 1 --2- 172.21.15.84:0/325039384 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a580cfe40 0x7f3a580c81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:32.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.567+0000 7f3a5dd9c700 1 --2- 172.21.15.84:0/325039384 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a5809cc70 0x7f3a5809f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:32.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.568+0000 7f3a5d59b700 1 -- 172.21.15.84:0/325039384 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a5809cc70 msgr2=0x7f3a5809f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:32.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.568+0000 7f3a5d59b700 1 --2- 172.21.15.84:0/325039384 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a5809cc70 0x7f3a5809f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:32.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.568+0000 7f3a5d59b700 1 -- 172.21.15.84:0/325039384 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a580cfe40 msgr2=0x7f3a580c81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:32.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.568+0000 7f3a5d59b700 1 --2- 172.21.15.84:0/325039384 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a580cfe40 0x7f3a580c81a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:32.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.568+0000 7f3a5d59b700 1 -- 172.21.15.84:0/325039384 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a540094a0 con 0x7f3a580b6f00 2023-07-14T11:17:32.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.568+0000 7f3a5d59b700 1 --2- 172.21.15.84:0/325039384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a580b6f00 0x7f3a581e58b0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f3a5400ebe0 tx=0x7f3a5400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:32.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.568+0000 7f3a4dffb700 1 -- 172.21.15.84:0/325039384 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a54009760 con 0x7f3a580b6f00 2023-07-14T11:17:32.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.568+0000 7f3a4dffb700 1 -- 172.21.15.84:0/325039384 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a5400c850 con 0x7f3a580b6f00 2023-07-14T11:17:32.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.568+0000 7f3a5f7ff700 1 -- 172.21.15.84:0/325039384 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a50009a70 con 0x7f3a580b6f00 2023-07-14T11:17:32.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.568+0000 7f3a4dffb700 1 -- 172.21.15.84:0/325039384 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5400cbe0 con 0x7f3a580b6f00 2023-07-14T11:17:32.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.568+0000 7f3a5f7ff700 1 -- 172.21.15.84:0/325039384 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a581e5df0 con 0x7f3a580b6f00 2023-07-14T11:17:32.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.570+0000 7f3a5f7ff700 1 -- 172.21.15.84:0/325039384 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a58074350 con 0x7f3a580b6f00 2023-07-14T11:17:32.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.571+0000 7f3a4dffb700 1 -- 172.21.15.84:0/325039384 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7f3a5400cd40 con 0x7f3a580b6f00 2023-07-14T11:17:32.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.571+0000 7f3a4dffb700 1 --2- 172.21.15.84:0/325039384 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f3a3c06b040 0x7f3a3c06d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:32.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.572+0000 7f3a4dffb700 1 -- 172.21.15.84:0/325039384 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3a54089a00 con 0x7f3a580b6f00 2023-07-14T11:17:32.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.572+0000 7f3a5cd9a700 1 --2- 172.21.15.84:0/325039384 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f3a3c06b040 0x7f3a3c06d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:32.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.572+0000 7f3a5cd9a700 1 --2- 172.21.15.84:0/325039384 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f3a3c06b040 0x7f3a3c06d4f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f3a580b3ce0 tx=0x7f3a48007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:32.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.576+0000 7f3a4dffb700 1 -- 172.21.15.84:0/325039384 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3a540546a0 con 0x7f3a580b6f00 2023-07-14T11:17:32.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.769+0000 7f3a5f7ff700 1 -- 172.21.15.84:0/325039384 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3a580d1830 con 0x7f3a580b6f00 2023-07-14T11:17:32.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.769+0000 7f3a4dffb700 1 -- 172.21.15.84:0/325039384 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v63) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3a54057cc0 con 0x7f3a580b6f00 2023-07-14T11:17:32.772 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-07-14T11:17:32.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.772+0000 7f3a5f7ff700 1 -- 172.21.15.84:0/325039384 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f3a3c06b040 msgr2=0x7f3a3c06d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:32.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.772+0000 7f3a5f7ff700 1 --2- 172.21.15.84:0/325039384 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f3a3c06b040 0x7f3a3c06d4f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f3a580b3ce0 tx=0x7f3a48007de0 comp rx=0 tx=0).stop 2023-07-14T11:17:32.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.772+0000 7f3a5f7ff700 1 -- 172.21.15.84:0/325039384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a580b6f00 msgr2=0x7f3a581e58b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:32.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.772+0000 7f3a5f7ff700 1 --2- 172.21.15.84:0/325039384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a580b6f00 0x7f3a581e58b0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f3a5400ebe0 tx=0x7f3a5400eef0 comp rx=0 tx=0).stop 2023-07-14T11:17:32.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.772+0000 7f3a5f7ff700 1 -- 172.21.15.84:0/325039384 shutdown_connections 2023-07-14T11:17:32.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.772+0000 7f3a5f7ff700 1 --2- 172.21.15.84:0/325039384 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f3a3c06b040 0x7f3a3c06d4f0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:32.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.772+0000 7f3a5f7ff700 1 --2- 172.21.15.84:0/325039384 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a5809cc70 0x7f3a5809f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:32.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.772+0000 7f3a5f7ff700 1 --2- 172.21.15.84:0/325039384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a580b6f00 0x7f3a581e58b0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:32.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.772+0000 7f3a5f7ff700 1 --2- 172.21.15.84:0/325039384 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a580cfe40 0x7f3a580c81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:32.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.772+0000 7f3a5f7ff700 1 -- 172.21.15.84:0/325039384 >> 172.21.15.84:0/325039384 conn(0x7f3a5809c200 msgr2=0x7f3a580b7ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:32.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.772+0000 7f3a5f7ff700 1 -- 172.21.15.84:0/325039384 shutdown_connections 2023-07-14T11:17:32.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.772+0000 7f3a5f7ff700 1 -- 172.21.15.84:0/325039384 wait complete. 2023-07-14T11:17:32.791 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T11:17:32.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.988+0000 7fdf03fff700 1 Processor -- start 2023-07-14T11:17:32.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.988+0000 7fdf03fff700 1 -- start start 2023-07-14T11:17:32.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.989+0000 7fdf03fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdefc0d1e40 0x7fdefc0cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:32.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.989+0000 7fdf03fff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdefc0cd5a0 con 0x7fdefc0c71b0 2023-07-14T11:17:32.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.989+0000 7fdf03fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdefc0cd7f0 con 0x7fdefc15c860 2023-07-14T11:17:32.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.989+0000 7fdf03fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdefc0d22b0 con 0x7fdefc0d1e40 2023-07-14T11:17:32.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.990+0000 7fdf0259c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fdefc0c71b0 0x7fdefc0b49d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52792/0 (socket says 172.21.15.84:52792) 2023-07-14T11:17:32.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.990+0000 7fdf0259c700 1 -- 172.21.15.84:0/4267785552 learned_addr learned my addr 172.21.15.84:0/4267785552 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:17:32.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.990+0000 7fdf0159a700 1 --2- 172.21.15.84:0/4267785552 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdefc0d1e40 0x7fdefc0cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:32.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.990+0000 7fdf00d99700 1 -- 172.21.15.84:0/4267785552 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3964030595 0 0) 0x7fdefc0cd5a0 con 0x7fdefc0c71b0 2023-07-14T11:17:32.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.990+0000 7fdf00d99700 1 -- 172.21.15.84:0/4267785552 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdee80035b0 con 0x7fdefc0c71b0 2023-07-14T11:17:32.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.990+0000 7fdf00d99700 1 -- 172.21.15.84:0/4267785552 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3479203066 0 0) 0x7fdefc0cd7f0 con 0x7fdefc15c860 2023-07-14T11:17:32.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.990+0000 7fdf00d99700 1 -- 172.21.15.84:0/4267785552 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdefc0cd5a0 con 0x7fdefc15c860 2023-07-14T11:17:32.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.990+0000 7fdf0159a700 1 -- 172.21.15.84:0/4267785552 >> v1:172.21.15.179:6789/0 conn(0x7fdefc15c860 legacy=0x7fdefc0c6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:32.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.990+0000 7fdf0159a700 1 -- 172.21.15.84:0/4267785552 >> v1:172.21.15.84:6789/0 conn(0x7fdefc0c71b0 legacy=0x7fdefc0b49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:32.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.990+0000 7fdf0159a700 1 -- 172.21.15.84:0/4267785552 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdefc0cdad0 con 0x7fdefc0d1e40 2023-07-14T11:17:32.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.991+0000 7fdf0159a700 1 --2- 172.21.15.84:0/4267785552 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdefc0d1e40 0x7fdefc0cf2a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdeec009870 tx=0x7fdeec009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d111bf8b842927c4 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:32.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.991+0000 7fdf00d99700 1 -- 172.21.15.84:0/4267785552 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeec011830 con 0x7fdefc0d1e40 2023-07-14T11:17:32.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.991+0000 7fdf00d99700 1 -- 172.21.15.84:0/4267785552 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeec011990 con 0x7fdefc0d1e40 2023-07-14T11:17:32.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.991+0000 7fdf00d99700 1 -- 172.21.15.84:0/4267785552 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeec011d20 con 0x7fdefc0d1e40 2023-07-14T11:17:32.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.991+0000 7fdf03fff700 1 -- 172.21.15.84:0/4267785552 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdefc0d1e40 msgr2=0x7fdefc0cf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:32.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.991+0000 7fdf03fff700 1 --2- 172.21.15.84:0/4267785552 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdefc0d1e40 0x7fdefc0cf2a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdeec009870 tx=0x7fdeec009b80 comp rx=0 tx=0).stop 2023-07-14T11:17:32.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.991+0000 7fdf03fff700 1 -- 172.21.15.84:0/4267785552 shutdown_connections 2023-07-14T11:17:32.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.991+0000 7fdf03fff700 1 --2- 172.21.15.84:0/4267785552 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdefc0d1e40 0x7fdefc0cf2a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:32.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.991+0000 7fdf03fff700 1 -- 172.21.15.84:0/4267785552 >> 172.21.15.84:0/4267785552 conn(0x7fdefc065bd0 msgr2=0x7fdefc065fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:32.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.992+0000 7fdf03fff700 1 -- 172.21.15.84:0/4267785552 shutdown_connections 2023-07-14T11:17:32.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.992+0000 7fdf03fff700 1 -- 172.21.15.84:0/4267785552 wait complete. 2023-07-14T11:17:32.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.993+0000 7fdf03fff700 1 Processor -- start 2023-07-14T11:17:32.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.993+0000 7fdf03fff700 1 -- start start 2023-07-14T11:17:32.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.994+0000 7fdf03fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdefc0c71b0 0x7fdefc0cf260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:32.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.994+0000 7fdf03fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdefc0d1e40 0x7fdefc1f53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:32.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.994+0000 7fdf03fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdefc15c860 0x7fdefc155b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:32.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.994+0000 7fdf03fff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdefc1f5900 con 0x7fdefc0d1e40 2023-07-14T11:17:32.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.994+0000 7fdf03fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdefc0ccc00 con 0x7fdefc15c860 2023-07-14T11:17:32.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.994+0000 7fdf03fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdefc15d000 con 0x7fdefc0c71b0 2023-07-14T11:17:32.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.995+0000 7fdf0159a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdefc0d1e40 0x7fdefc1f53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:32.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.995+0000 7fdf0159a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdefc0d1e40 0x7fdefc1f53c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39654/0 (socket says 172.21.15.84:39654) 2023-07-14T11:17:32.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.995+0000 7fdf0159a700 1 -- 172.21.15.84:0/3320374929 learned_addr learned my addr 172.21.15.84:0/3320374929 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:32.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.995+0000 7fdf0259c700 1 --2- 172.21.15.84:0/3320374929 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdefc15c860 0x7fdefc155b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:33.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.995+0000 7fdf01d9b700 1 --2- 172.21.15.84:0/3320374929 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdefc0c71b0 0x7fdefc0cf260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:33.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.995+0000 7fdf0159a700 1 -- 172.21.15.84:0/3320374929 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdefc0c71b0 msgr2=0x7fdefc0cf260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:33.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.995+0000 7fdf0159a700 1 --2- 172.21.15.84:0/3320374929 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdefc0c71b0 0x7fdefc0cf260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:33.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.995+0000 7fdf0159a700 1 -- 172.21.15.84:0/3320374929 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdefc15c860 msgr2=0x7fdefc155b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:33.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.995+0000 7fdf0159a700 1 --2- 172.21.15.84:0/3320374929 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdefc15c860 0x7fdefc155b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:33.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.995+0000 7fdf0159a700 1 -- 172.21.15.84:0/3320374929 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeec0094a0 con 0x7fdefc0d1e40 2023-07-14T11:17:33.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.995+0000 7fdf0159a700 1 --2- 172.21.15.84:0/3320374929 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdefc0d1e40 0x7fdefc1f53c0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fdeec009bc0 tx=0x7fdeec004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:33.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.995+0000 7fdef27fc700 1 -- 172.21.15.84:0/3320374929 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeec01a860 con 0x7fdefc0d1e40 2023-07-14T11:17:33.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.996+0000 7fdef27fc700 1 -- 172.21.15.84:0/3320374929 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeec01a9c0 con 0x7fdefc0d1e40 2023-07-14T11:17:33.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.996+0000 7fdef27fc700 1 -- 172.21.15.84:0/3320374929 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeec01ad50 con 0x7fdefc0d1e40 2023-07-14T11:17:33.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.996+0000 7fdf03fff700 1 -- 172.21.15.84:0/3320374929 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdefc15d2e0 con 0x7fdefc0d1e40 2023-07-14T11:17:33.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.996+0000 7fdf03fff700 1 -- 172.21.15.84:0/3320374929 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdefc1566f0 con 0x7fdefc0d1e40 2023-07-14T11:17:33.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.997+0000 7fdf03fff700 1 -- 172.21.15.84:0/3320374929 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdefc15ce60 con 0x7fdefc0d1e40 2023-07-14T11:17:33.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.998+0000 7fdef27fc700 1 -- 172.21.15.84:0/3320374929 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7fdeec022070 con 0x7fdefc0d1e40 2023-07-14T11:17:33.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.998+0000 7fdef27fc700 1 --2- 172.21.15.84:0/3320374929 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fdee006b040 0x7fdee006d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:33.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.998+0000 7fdef27fc700 1 -- 172.21.15.84:0/3320374929 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdeec08a7c0 con 0x7fdefc0d1e40 2023-07-14T11:17:33.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.999+0000 7fdf01d9b700 1 --2- 172.21.15.84:0/3320374929 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fdee006b040 0x7fdee006d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:33.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:32.999+0000 7fdf01d9b700 1 --2- 172.21.15.84:0/3320374929 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fdee006b040 0x7fdee006d4f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fdef8007fd0 tx=0x7fdef8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:33.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.003+0000 7fdef27fc700 1 -- 172.21.15.84:0/3320374929 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fdefc15ce60 con 0x7fdefc0d1e40 2023-07-14T11:17:33.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.197+0000 7fdf03fff700 1 -- 172.21.15.84:0/3320374929 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdefc15ce60 con 0x7fdefc0d1e40 2023-07-14T11:17:33.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.198+0000 7fdef27fc700 1 -- 172.21.15.84:0/3320374929 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v63) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdefc15ce60 con 0x7fdefc0d1e40 2023-07-14T11:17:33.200 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-07-14T11:17:33.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.200+0000 7fdf03fff700 1 -- 172.21.15.84:0/3320374929 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fdee006b040 msgr2=0x7fdee006d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:33.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.200+0000 7fdf03fff700 1 --2- 172.21.15.84:0/3320374929 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fdee006b040 0x7fdee006d4f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fdef8007fd0 tx=0x7fdef8009040 comp rx=0 tx=0).stop 2023-07-14T11:17:33.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.200+0000 7fdf03fff700 1 -- 172.21.15.84:0/3320374929 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdefc0d1e40 msgr2=0x7fdefc1f53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:33.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.200+0000 7fdf03fff700 1 --2- 172.21.15.84:0/3320374929 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdefc0d1e40 0x7fdefc1f53c0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fdeec009bc0 tx=0x7fdeec004750 comp rx=0 tx=0).stop 2023-07-14T11:17:33.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.200+0000 7fdf03fff700 1 -- 172.21.15.84:0/3320374929 shutdown_connections 2023-07-14T11:17:33.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.200+0000 7fdf03fff700 1 --2- 172.21.15.84:0/3320374929 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fdee006b040 0x7fdee006d4f0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:33.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.200+0000 7fdf03fff700 1 --2- 172.21.15.84:0/3320374929 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdefc0c71b0 0x7fdefc0cf260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:33.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.200+0000 7fdf03fff700 1 --2- 172.21.15.84:0/3320374929 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdefc15c860 0x7fdefc155b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:33.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.200+0000 7fdf03fff700 1 --2- 172.21.15.84:0/3320374929 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdefc0d1e40 0x7fdefc1f53c0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:33.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.200+0000 7fdf03fff700 1 -- 172.21.15.84:0/3320374929 >> 172.21.15.84:0/3320374929 conn(0x7fdefc065bd0 msgr2=0x7fdefc0cf960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:33.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.200+0000 7fdf03fff700 1 -- 172.21.15.84:0/3320374929 shutdown_connections 2023-07-14T11:17:33.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.200+0000 7fdf03fff700 1 -- 172.21.15.84:0/3320374929 wait complete. 2023-07-14T11:17:33.220 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-14T11:17:33.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.416+0000 7fc1f3bff700 1 Processor -- start 2023-07-14T11:17:33.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.416+0000 7fc1f3bff700 1 -- start start 2023-07-14T11:17:33.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.417+0000 7fc1f3bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1ec15c6c0 0x7fc1ec0b2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:33.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.417+0000 7fc1f3bff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc1ec0afc40 0x7fc1ec0b2b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:33.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.417+0000 7fc1f3bff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1ec15ca90 con 0x7fc1ec0b30b0 2023-07-14T11:17:33.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.417+0000 7fc1f3bff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1ec06b0e0 con 0x7fc1ec0afc40 2023-07-14T11:17:33.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.417+0000 7fc1f3bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ec0d0370 con 0x7fc1ec15c6c0 2023-07-14T11:17:33.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.417+0000 7fc1f219c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fc1ec0b30b0 0x7fc1ec160150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52796/0 (socket says 172.21.15.84:52796) 2023-07-14T11:17:33.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.418+0000 7fc1f219c700 1 -- 172.21.15.84:0/2339548557 learned_addr learned my addr 172.21.15.84:0/2339548557 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:17:33.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.418+0000 7fc1f119a700 1 --2- 172.21.15.84:0/2339548557 >> v2:172.21.15.179:3300/0 conn(0x7fc1ec0afc40 0x7fc1ec0b2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:33.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.418+0000 7fc1f199b700 1 --2- 172.21.15.84:0/2339548557 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1ec15c6c0 0x7fc1ec0b2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:33.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.418+0000 7fc1f0999700 1 -- 172.21.15.84:0/2339548557 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3999400948 0 0) 0x7fc1e4001490 con 0x7fc1ec0b30b0 2023-07-14T11:17:33.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.418+0000 7fc1f0999700 1 -- 172.21.15.84:0/2339548557 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1d80035b0 con 0x7fc1ec0b30b0 2023-07-14T11:17:33.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.418+0000 7fc1f119a700 1 -- 172.21.15.84:0/2339548557 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1ec15c6c0 msgr2=0x7fc1ec0b2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:33.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.418+0000 7fc1f119a700 1 --2- 172.21.15.84:0/2339548557 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1ec15c6c0 0x7fc1ec0b2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:33.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.418+0000 7fc1f119a700 1 -- 172.21.15.84:0/2339548557 >> v1:172.21.15.84:6789/0 conn(0x7fc1ec0b30b0 legacy=0x7fc1ec160150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:33.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.418+0000 7fc1f119a700 1 -- 172.21.15.84:0/2339548557 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1ec0d0650 con 0x7fc1ec0afc40 2023-07-14T11:17:33.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.418+0000 7fc1f199b700 1 --2- 172.21.15.84:0/2339548557 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1ec15c6c0 0x7fc1ec0b2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:17:33.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.418+0000 7fc1f119a700 1 --2- 172.21.15.84:0/2339548557 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1ec0afc40 0x7fc1ec0b2b70 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc009840 tx=0x7fc1dc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38918912d33715d1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:33.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.419+0000 7fc1f0999700 1 -- 172.21.15.84:0/2339548557 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc011830 con 0x7fc1ec0afc40 2023-07-14T11:17:33.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.419+0000 7fc1f0999700 1 -- 172.21.15.84:0/2339548557 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1dc011990 con 0x7fc1ec0afc40 2023-07-14T11:17:33.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.419+0000 7fc1f0999700 1 -- 172.21.15.84:0/2339548557 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc011d20 con 0x7fc1ec0afc40 2023-07-14T11:17:33.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.419+0000 7fc1f3bff700 1 -- 172.21.15.84:0/2339548557 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1ec0afc40 msgr2=0x7fc1ec0b2b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:33.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.419+0000 7fc1f3bff700 1 --2- 172.21.15.84:0/2339548557 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1ec0afc40 0x7fc1ec0b2b70 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc009840 tx=0x7fc1dc009b50 comp rx=0 tx=0).stop 2023-07-14T11:17:33.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.419+0000 7fc1f3bff700 1 -- 172.21.15.84:0/2339548557 shutdown_connections 2023-07-14T11:17:33.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.419+0000 7fc1f3bff700 1 --2- 172.21.15.84:0/2339548557 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1ec15c6c0 0x7fc1ec0b2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:33.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.419+0000 7fc1f3bff700 1 --2- 172.21.15.84:0/2339548557 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1ec0afc40 0x7fc1ec0b2b70 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:33.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.419+0000 7fc1f3bff700 1 -- 172.21.15.84:0/2339548557 >> 172.21.15.84:0/2339548557 conn(0x7fc1ec06d980 msgr2=0x7fc1ec06dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:33.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.419+0000 7fc1f3bff700 1 -- 172.21.15.84:0/2339548557 shutdown_connections 2023-07-14T11:17:33.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.419+0000 7fc1f3bff700 1 -- 172.21.15.84:0/2339548557 wait complete. 2023-07-14T11:17:33.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.421+0000 7fc1f3bff700 1 Processor -- start 2023-07-14T11:17:33.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.421+0000 7fc1f3bff700 1 -- start start 2023-07-14T11:17:33.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.422+0000 7fc1f3bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1ec0afc40 0x7fc1ec0b4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:33.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.422+0000 7fc1f3bff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1ec0b30b0 0x7fc1ec0b53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:33.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.422+0000 7fc1f3bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1ec15c6c0 0x7fc1ec15a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:33.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.422+0000 7fc1f3bff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ec0b4ac0 con 0x7fc1ec0b30b0 2023-07-14T11:17:33.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.422+0000 7fc1f3bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ec0b5c10 con 0x7fc1ec0afc40 2023-07-14T11:17:33.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.422+0000 7fc1f3bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ec0b5ef0 con 0x7fc1ec15c6c0 2023-07-14T11:17:33.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.423+0000 7fc1f119a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1ec0b30b0 0x7fc1ec0b53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:33.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.423+0000 7fc1f119a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1ec0b30b0 0x7fc1ec0b53a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39666/0 (socket says 172.21.15.84:39666) 2023-07-14T11:17:33.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.423+0000 7fc1f119a700 1 -- 172.21.15.84:0/2390632284 learned_addr learned my addr 172.21.15.84:0/2390632284 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:33.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.423+0000 7fc1f199b700 1 --2- 172.21.15.84:0/2390632284 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1ec0afc40 0x7fc1ec0b4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:33.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.423+0000 7fc1f219c700 1 --2- 172.21.15.84:0/2390632284 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1ec15c6c0 0x7fc1ec15a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:33.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.423+0000 7fc1f119a700 1 -- 172.21.15.84:0/2390632284 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1ec15c6c0 msgr2=0x7fc1ec15a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:33.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.423+0000 7fc1f119a700 1 --2- 172.21.15.84:0/2390632284 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1ec15c6c0 0x7fc1ec15a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:33.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.423+0000 7fc1f119a700 1 -- 172.21.15.84:0/2390632284 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1ec0afc40 msgr2=0x7fc1ec0b4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:33.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.423+0000 7fc1f119a700 1 --2- 172.21.15.84:0/2390632284 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1ec0afc40 0x7fc1ec0b4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:33.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.423+0000 7fc1f119a700 1 -- 172.21.15.84:0/2390632284 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1e80094a0 con 0x7fc1ec0b30b0 2023-07-14T11:17:33.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.423+0000 7fc1f119a700 1 --2- 172.21.15.84:0/2390632284 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1ec0b30b0 0x7fc1ec0b53a0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc009fd0 tx=0x7fc1dc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:33.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.424+0000 7fc1e27fc700 1 -- 172.21.15.84:0/2390632284 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc004590 con 0x7fc1ec0b30b0 2023-07-14T11:17:33.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.424+0000 7fc1e27fc700 1 -- 172.21.15.84:0/2390632284 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1dc01e070 con 0x7fc1ec0b30b0 2023-07-14T11:17:33.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.424+0000 7fc1e27fc700 1 -- 172.21.15.84:0/2390632284 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc0038e0 con 0x7fc1ec0b30b0 2023-07-14T11:17:33.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.424+0000 7fc1f3bff700 1 -- 172.21.15.84:0/2390632284 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1dc0094a0 con 0x7fc1ec0b30b0 2023-07-14T11:17:33.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.424+0000 7fc1f3bff700 1 -- 172.21.15.84:0/2390632284 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1ec0b64b0 con 0x7fc1ec0b30b0 2023-07-14T11:17:33.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.425+0000 7fc1f3bff700 1 -- 172.21.15.84:0/2390632284 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1ec074350 con 0x7fc1ec0b30b0 2023-07-14T11:17:33.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.426+0000 7fc1e27fc700 1 -- 172.21.15.84:0/2390632284 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7fc1dc003a40 con 0x7fc1ec0b30b0 2023-07-14T11:17:33.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.426+0000 7fc1e27fc700 1 --2- 172.21.15.84:0/2390632284 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc1d006b040 0x7fc1d006d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:33.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.427+0000 7fc1e27fc700 1 -- 172.21.15.84:0/2390632284 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc1dc08a820 con 0x7fc1ec0b30b0 2023-07-14T11:17:33.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.427+0000 7fc1f199b700 1 --2- 172.21.15.84:0/2390632284 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc1d006b040 0x7fc1d006d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:33.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.427+0000 7fc1f199b700 1 --2- 172.21.15.84:0/2390632284 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc1d006b040 0x7fc1d006d4f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc1e8009d70 tx=0x7fc1e8009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:33.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.431+0000 7fc1e27fc700 1 -- 172.21.15.84:0/2390632284 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fc1dc0554b0 con 0x7fc1ec0b30b0 2023-07-14T11:17:33.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.640+0000 7fc1f3bff700 1 -- 172.21.15.84:0/2390632284 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc1ec0ce310 con 0x7fc1ec0b30b0 2023-07-14T11:17:33.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.641+0000 7fc1e27fc700 1 -- 172.21.15.84:0/2390632284 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v63) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc1dc020080 con 0x7fc1ec0b30b0 2023-07-14T11:17:33.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.643+0000 7fc1f3bff700 1 -- 172.21.15.84:0/2390632284 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc1d006b040 msgr2=0x7fc1d006d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:33.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.643+0000 7fc1f3bff700 1 --2- 172.21.15.84:0/2390632284 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc1d006b040 0x7fc1d006d4f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc1e8009d70 tx=0x7fc1e8009210 comp rx=0 tx=0).stop 2023-07-14T11:17:33.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.643+0000 7fc1f3bff700 1 -- 172.21.15.84:0/2390632284 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1ec0b30b0 msgr2=0x7fc1ec0b53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:33.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.643+0000 7fc1f3bff700 1 --2- 172.21.15.84:0/2390632284 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1ec0b30b0 0x7fc1ec0b53a0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc009fd0 tx=0x7fc1dc004750 comp rx=0 tx=0).stop 2023-07-14T11:17:33.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.643+0000 7fc1f3bff700 1 -- 172.21.15.84:0/2390632284 shutdown_connections 2023-07-14T11:17:33.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.643+0000 7fc1f3bff700 1 --2- 172.21.15.84:0/2390632284 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc1d006b040 0x7fc1d006d4f0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:33.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.643+0000 7fc1f3bff700 1 --2- 172.21.15.84:0/2390632284 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1ec15c6c0 0x7fc1ec15a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:33.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.643+0000 7fc1f3bff700 1 --2- 172.21.15.84:0/2390632284 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1ec0afc40 0x7fc1ec0b4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:33.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.643+0000 7fc1f3bff700 1 --2- 172.21.15.84:0/2390632284 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1ec0b30b0 0x7fc1ec0b53a0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:33.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.643+0000 7fc1f3bff700 1 -- 172.21.15.84:0/2390632284 >> 172.21.15.84:0/2390632284 conn(0x7fc1ec06d980 msgr2=0x7fc1ec073050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:33.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.643+0000 7fc1f3bff700 1 -- 172.21.15.84:0/2390632284 shutdown_connections 2023-07-14T11:17:33.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:33.643+0000 7fc1f3bff700 1 -- 172.21.15.84:0/2390632284 wait complete. 2023-07-14T11:17:33.647 INFO:teuthology.orchestra.run.smithi084.stderr:listed 0 entries 2023-07-14T11:17:33.663 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-14T11:17:33.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:17:33.664 DEBUG:teuthology.orchestra.run.smithi084:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-14T11:17:33.770 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi084.front.sepia.ceph.com 2023-07-14T11:17:33.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:17:33.771 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-14T11:17:33.822 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-07-14T11:17:33.823 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:17:33.871 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-07-14T11:17:33.871 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:17:33.958 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:17:34.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.152+0000 7ff6009ff700 1 Processor -- start 2023-07-14T11:17:34.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.152+0000 7ff6009ff700 1 -- start start 2023-07-14T11:17:34.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.154+0000 7ff6009ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff5fc158fd0 0x7ff5fc070710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:34.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.154+0000 7ff6009ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5fc06c110 con 0x7ff5fc141ff0 2023-07-14T11:17:34.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.154+0000 7ff6009ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5fc159410 con 0x7ff5fc0b2180 2023-07-14T11:17:34.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.154+0000 7ff6009ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5fc071140 con 0x7ff5fc158fd0 2023-07-14T11:17:34.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.154+0000 7ff5fa59c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7ff5fc141ff0 0x7ff5fc0b1a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52798/0 (socket says 172.21.15.84:52798) 2023-07-14T11:17:34.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.154+0000 7ff5fa59c700 1 -- 172.21.15.84:0/1230796274 learned_addr learned my addr 172.21.15.84:0/1230796274 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:17:34.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.154+0000 7ff5fad9d700 1 --2- 172.21.15.84:0/1230796274 >> v2:172.21.15.179:3300/0 conn(0x7ff5fc158fd0 0x7ff5fc070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:34.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.154+0000 7ff5f9d9b700 1 -- 172.21.15.84:0/1230796274 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3997196800 0 0) 0x7ff5fc06c110 con 0x7ff5fc141ff0 2023-07-14T11:17:34.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.154+0000 7ff5f9d9b700 1 -- 172.21.15.84:0/1230796274 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5e80035b0 con 0x7ff5fc141ff0 2023-07-14T11:17:34.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.155+0000 7ff5f9d9b700 1 -- 172.21.15.84:0/1230796274 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 155703543 0 0) 0x7ff5e80035b0 con 0x7ff5fc141ff0 2023-07-14T11:17:34.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.155+0000 7ff5f9d9b700 1 -- 172.21.15.84:0/1230796274 >> v2:172.21.15.179:3300/0 conn(0x7ff5fc158fd0 msgr2=0x7ff5fc070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:34.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.155+0000 7ff5f9d9b700 1 --2- 172.21.15.84:0/1230796274 >> v2:172.21.15.179:3300/0 conn(0x7ff5fc158fd0 0x7ff5fc070710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:34.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.155+0000 7ff5f9d9b700 1 -- 172.21.15.84:0/1230796274 >> v1:172.21.15.179:6789/0 conn(0x7ff5fc0b2180 legacy=0x7ff5fc06c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:34.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.155+0000 7ff5f9d9b700 1 -- 172.21.15.84:0/1230796274 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5fc070e60 con 0x7ff5fc141ff0 2023-07-14T11:17:34.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.155+0000 7ff5f9d9b700 1 -- 172.21.15.84:0/1230796274 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7ff5ec001670 con 0x7ff5fc141ff0 2023-07-14T11:17:34.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.155+0000 7ff5f9d9b700 1 -- 172.21.15.84:0/1230796274 >> v1:172.21.15.84:6789/0 conn(0x7ff5fc141ff0 legacy=0x7ff5fc0b1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:34.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.155+0000 7ff5f9d9b700 1 --2- 172.21.15.84:0/1230796274 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5e8003a00 0x7ff5e8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:34.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.155+0000 7ff5f9d9b700 1 --2- 172.21.15.84:0/1230796274 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5e8004850 0x7ff5e8004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:34.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.155+0000 7ff5f9d9b700 1 --2- 172.21.15.84:0/1230796274 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5e8005200 0x7ff5e800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:34.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.155+0000 7ff5f9d9b700 1 -- 172.21.15.84:0/1230796274 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5fc071140 con 0x7ff5e8004850 2023-07-14T11:17:34.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.155+0000 7ff5f9d9b700 1 -- 172.21.15.84:0/1230796274 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e800e290 con 0x7ff5e8003a00 2023-07-14T11:17:34.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.155+0000 7ff5f9d9b700 1 -- 172.21.15.84:0/1230796274 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e800e450 con 0x7ff5e8005200 2023-07-14T11:17:34.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.155+0000 7ff5f3fff700 1 --2- 172.21.15.84:0/1230796274 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5e8004850 0x7ff5e8004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:34.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.155+0000 7ff5fa59c700 1 --2- 172.21.15.84:0/1230796274 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5e8003a00 0x7ff5e8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:34.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.155+0000 7ff5fad9d700 1 --2- 172.21.15.84:0/1230796274 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5e8005200 0x7ff5e800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:34.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.155+0000 7ff5f3fff700 1 -- 172.21.15.84:0/1230796274 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5e8005200 msgr2=0x7ff5e800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:34.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.155+0000 7ff5f3fff700 1 --2- 172.21.15.84:0/1230796274 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5e8005200 0x7ff5e800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:34.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.155+0000 7ff5f3fff700 1 -- 172.21.15.84:0/1230796274 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5e8003a00 msgr2=0x7ff5e8003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:34.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.155+0000 7ff5f3fff700 1 --2- 172.21.15.84:0/1230796274 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5e8003a00 0x7ff5e8003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:34.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.155+0000 7ff5f3fff700 1 -- 172.21.15.84:0/1230796274 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e80035b0 con 0x7ff5e8004850 2023-07-14T11:17:34.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.155+0000 7ff5fad9d700 1 -- 172.21.15.84:0/1230796274 reap_dead start 2023-07-14T11:17:34.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.156+0000 7ff5f3fff700 1 --2- 172.21.15.84:0/1230796274 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5e8004850 0x7ff5e8004cc0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc0b2570 tx=0x7ff5e8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b22a5a692c84a14b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:34.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.156+0000 7ff5f9d9b700 1 -- 172.21.15.84:0/1230796274 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e40052d0 con 0x7ff5e8004850 2023-07-14T11:17:34.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.156+0000 7ff5f9d9b700 1 -- 172.21.15.84:0/1230796274 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5e4005450 con 0x7ff5e8004850 2023-07-14T11:17:34.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.156+0000 7ff5f9d9b700 1 -- 172.21.15.84:0/1230796274 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e40038c0 con 0x7ff5e8004850 2023-07-14T11:17:34.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.156+0000 7ff6009ff700 1 -- 172.21.15.84:0/1230796274 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5e8004850 msgr2=0x7ff5e8004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:34.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.156+0000 7ff6009ff700 1 --2- 172.21.15.84:0/1230796274 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5e8004850 0x7ff5e8004cc0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc0b2570 tx=0x7ff5e8005880 comp rx=0 tx=0).stop 2023-07-14T11:17:34.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.156+0000 7ff6009ff700 1 -- 172.21.15.84:0/1230796274 shutdown_connections 2023-07-14T11:17:34.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.156+0000 7ff6009ff700 1 --2- 172.21.15.84:0/1230796274 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5e8004850 0x7ff5e8004cc0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:34.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.156+0000 7ff6009ff700 1 -- 172.21.15.84:0/1230796274 >> 172.21.15.84:0/1230796274 conn(0x7ff5fc069f30 msgr2=0x7ff5fc06a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:34.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.157+0000 7ff6009ff700 1 -- 172.21.15.84:0/1230796274 shutdown_connections 2023-07-14T11:17:34.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.157+0000 7ff6009ff700 1 -- 172.21.15.84:0/1230796274 wait complete. 2023-07-14T11:17:34.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.158+0000 7ff6009ff700 1 Processor -- start 2023-07-14T11:17:34.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.158+0000 7ff6009ff700 1 -- start start 2023-07-14T11:17:34.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.159+0000 7ff6009ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5e8004850 0x7ff5fc0c57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:34.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.159+0000 7ff6009ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5fc158380 0x7ff5fc0ad3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:34.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.159+0000 7ff6009ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5fc0ad910 0x7ff5fc0c39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:34.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.159+0000 7ff6009ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5fc0add80 con 0x7ff5fc158380 2023-07-14T11:17:34.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.159+0000 7ff6009ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5fc0c4710 con 0x7ff5e8004850 2023-07-14T11:17:34.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.159+0000 7ff6009ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5fc0c49f0 con 0x7ff5fc0ad910 2023-07-14T11:17:34.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.160+0000 7ff5f3fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5fc158380 0x7ff5fc0ad3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:34.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.160+0000 7ff5f3fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5fc158380 0x7ff5fc0ad3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39682/0 (socket says 172.21.15.84:39682) 2023-07-14T11:17:34.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.160+0000 7ff5f3fff700 1 -- 172.21.15.84:0/1419499059 learned_addr learned my addr 172.21.15.84:0/1419499059 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:34.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.160+0000 7ff5fa59c700 1 --2- 172.21.15.84:0/1419499059 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5e8004850 0x7ff5fc0c57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:34.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.160+0000 7ff5fad9d700 1 --2- 172.21.15.84:0/1419499059 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5fc0ad910 0x7ff5fc0c39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:34.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.160+0000 7ff5f3fff700 1 -- 172.21.15.84:0/1419499059 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5fc0ad910 msgr2=0x7ff5fc0c39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:34.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.160+0000 7ff5f3fff700 1 --2- 172.21.15.84:0/1419499059 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5fc0ad910 0x7ff5fc0c39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:34.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.160+0000 7ff5f3fff700 1 -- 172.21.15.84:0/1419499059 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5e8004850 msgr2=0x7ff5fc0c57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:34.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.160+0000 7ff5f3fff700 1 --2- 172.21.15.84:0/1419499059 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5e8004850 0x7ff5fc0c57b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:34.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.160+0000 7ff5f3fff700 1 -- 172.21.15.84:0/1419499059 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5fc0c4cd0 con 0x7ff5fc158380 2023-07-14T11:17:34.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.160+0000 7ff5f3fff700 1 --2- 172.21.15.84:0/1419499059 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5fc158380 0x7ff5fc0ad3d0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7ff5e4005040 tx=0x7ff5e4001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:34.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.160+0000 7ff5f2ffd700 1 -- 172.21.15.84:0/1419499059 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e4001290 con 0x7ff5fc158380 2023-07-14T11:17:34.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.160+0000 7ff5f2ffd700 1 -- 172.21.15.84:0/1419499059 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5e4007040 con 0x7ff5fc158380 2023-07-14T11:17:34.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.160+0000 7ff5f2ffd700 1 -- 172.21.15.84:0/1419499059 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e40073f0 con 0x7ff5fc158380 2023-07-14T11:17:34.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.160+0000 7ff6009ff700 1 -- 172.21.15.84:0/1419499059 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5fc0c4fb0 con 0x7ff5fc158380 2023-07-14T11:17:34.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.161+0000 7ff6009ff700 1 -- 172.21.15.84:0/1419499059 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5fc1587f0 con 0x7ff5fc158380 2023-07-14T11:17:34.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.162+0000 7ff6009ff700 1 -- 172.21.15.84:0/1419499059 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5fc0c54d0 con 0x7ff5fc158380 2023-07-14T11:17:34.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.162+0000 7ff5f2ffd700 1 -- 172.21.15.84:0/1419499059 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7ff5e4007550 con 0x7ff5fc158380 2023-07-14T11:17:34.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.164+0000 7ff5f2ffd700 1 --2- 172.21.15.84:0/1419499059 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff5dc06b070 0x7ff5dc06d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:34.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.164+0000 7ff5f2ffd700 1 -- 172.21.15.84:0/1419499059 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff5e408a130 con 0x7ff5fc158380 2023-07-14T11:17:34.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.164+0000 7ff5fa59c700 1 --2- 172.21.15.84:0/1419499059 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff5dc06b070 0x7ff5dc06d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:34.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.164+0000 7ff5fa59c700 1 --2- 172.21.15.84:0/1419499059 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff5dc06b070 0x7ff5dc06d520 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc068e20 tx=0x7ff5ec001bd0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:34.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.168+0000 7ff5f2ffd700 1 -- 172.21.15.84:0/1419499059 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ff5fc0c54d0 con 0x7ff5fc158380 2023-07-14T11:17:34.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.366+0000 7ff6009ff700 1 -- 172.21.15.84:0/1419499059 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff5fc0c54d0 con 0x7ff5fc158380 2023-07-14T11:17:34.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.367+0000 7ff5f2ffd700 1 -- 172.21.15.84:0/1419499059 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+18269 (secure 0 0 0) 0x7ff5fc0c54d0 con 0x7ff5fc158380 2023-07-14T11:17:34.370 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:17:34.370 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":63,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:17:14.075543+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-07-14T11:17:10.750697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-07-14T11:17:11.528893+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:17:34.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.370+0000 7ff6009ff700 1 -- 172.21.15.84:0/1419499059 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff5dc06b070 msgr2=0x7ff5dc06d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:34.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.370+0000 7ff6009ff700 1 --2- 172.21.15.84:0/1419499059 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff5dc06b070 0x7ff5dc06d520 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc068e20 tx=0x7ff5ec001bd0 comp rx=0 tx=0).stop 2023-07-14T11:17:34.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.370+0000 7ff6009ff700 1 -- 172.21.15.84:0/1419499059 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5fc158380 msgr2=0x7ff5fc0ad3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:34.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.370+0000 7ff6009ff700 1 --2- 172.21.15.84:0/1419499059 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5fc158380 0x7ff5fc0ad3d0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7ff5e4005040 tx=0x7ff5e4001120 comp rx=0 tx=0).stop 2023-07-14T11:17:34.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.370+0000 7ff6009ff700 1 -- 172.21.15.84:0/1419499059 shutdown_connections 2023-07-14T11:17:34.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.370+0000 7ff6009ff700 1 --2- 172.21.15.84:0/1419499059 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff5dc06b070 0x7ff5dc06d520 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:34.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.370+0000 7ff6009ff700 1 --2- 172.21.15.84:0/1419499059 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5fc0ad910 0x7ff5fc0c39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:34.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.370+0000 7ff6009ff700 1 --2- 172.21.15.84:0/1419499059 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5e8004850 0x7ff5fc0c57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:34.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.370+0000 7ff6009ff700 1 --2- 172.21.15.84:0/1419499059 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5fc158380 0x7ff5fc0ad3d0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:34.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.370+0000 7ff6009ff700 1 -- 172.21.15.84:0/1419499059 >> 172.21.15.84:0/1419499059 conn(0x7ff5fc069f30 msgr2=0x7ff5fc15b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:34.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.370+0000 7ff6009ff700 1 -- 172.21.15.84:0/1419499059 shutdown_connections 2023-07-14T11:17:34.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.370+0000 7ff6009ff700 1 -- 172.21.15.84:0/1419499059 wait complete. 2023-07-14T11:17:34.391 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T11:13:00.125395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T11:13:06.803994+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T11:17:10.750697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T11:17:11.528893+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '63', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T11:17:34.391 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T11:17:34.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.587+0000 7f96837ff700 1 Processor -- start 2023-07-14T11:17:34.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.587+0000 7f96837ff700 1 -- start start 2023-07-14T11:17:34.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.589+0000 7f96837ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f967c158bb0 0x7f967c0cd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:34.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.589+0000 7f96837ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f967c0cbe40 0x7f967c0cda40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:34.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.589+0000 7f96837ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f967c0ce3a0 con 0x7f967c0cdf80 2023-07-14T11:17:34.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.589+0000 7f96837ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f967c06b5b0 con 0x7f967c158bb0 2023-07-14T11:17:34.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.589+0000 7f96837ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f967c071500 con 0x7f967c0cbe40 2023-07-14T11:17:34.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.589+0000 7f968159b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f967c158bb0 0x7f967c0cd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:34.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.589+0000 7f9681d9c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f967c0cdf80 0x7f967c15c790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52806/0 (socket says 172.21.15.84:52806) 2023-07-14T11:17:34.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.589+0000 7f9681d9c700 1 -- 172.21.15.84:0/3312095075 learned_addr learned my addr 172.21.15.84:0/3312095075 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:17:34.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.589+0000 7f9680d9a700 1 --2- 172.21.15.84:0/3312095075 >> v2:172.21.15.179:3300/0 conn(0x7f967c0cbe40 0x7f967c0cda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:34.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.589+0000 7f968159b700 1 -- 172.21.15.84:0/3312095075 >> v2:172.21.15.179:3300/0 conn(0x7f967c0cbe40 msgr2=0x7f967c0cda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:34.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.589+0000 7f9673fff700 1 -- 172.21.15.84:0/3312095075 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4294549989 0 0) 0x7f967c0ce3a0 con 0x7f967c0cdf80 2023-07-14T11:17:34.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.589+0000 7f968159b700 1 --2- 172.21.15.84:0/3312095075 >> v2:172.21.15.179:3300/0 conn(0x7f967c0cbe40 0x7f967c0cda40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:34.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.589+0000 7f968159b700 1 -- 172.21.15.84:0/3312095075 >> v1:172.21.15.84:6789/0 conn(0x7f967c0cdf80 legacy=0x7f967c15c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:34.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.589+0000 7f968159b700 1 -- 172.21.15.84:0/3312095075 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f967c0ce8c0 con 0x7f967c158bb0 2023-07-14T11:17:34.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.589+0000 7f9680d9a700 1 --2- 172.21.15.84:0/3312095075 >> v2:172.21.15.179:3300/0 conn(0x7f967c0cbe40 0x7f967c0cda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:17:34.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.590+0000 7f968159b700 1 --2- 172.21.15.84:0/3312095075 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f967c158bb0 0x7f967c0cd0a0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f967c072040 tx=0x7f9678009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad3f9e31a259cdb5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:34.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.590+0000 7f9673fff700 1 -- 172.21.15.84:0/3312095075 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9678011830 con 0x7f967c158bb0 2023-07-14T11:17:34.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.590+0000 7f9673fff700 1 -- 172.21.15.84:0/3312095075 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9678011990 con 0x7f967c158bb0 2023-07-14T11:17:34.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.590+0000 7f9673fff700 1 -- 172.21.15.84:0/3312095075 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9678011d20 con 0x7f967c158bb0 2023-07-14T11:17:34.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.590+0000 7f96837ff700 1 -- 172.21.15.84:0/3312095075 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f967c158bb0 msgr2=0x7f967c0cd0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:34.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.590+0000 7f96837ff700 1 --2- 172.21.15.84:0/3312095075 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f967c158bb0 0x7f967c0cd0a0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f967c072040 tx=0x7f9678009b20 comp rx=0 tx=0).stop 2023-07-14T11:17:34.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.591+0000 7f96837ff700 1 -- 172.21.15.84:0/3312095075 shutdown_connections 2023-07-14T11:17:34.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.591+0000 7f96837ff700 1 --2- 172.21.15.84:0/3312095075 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f967c158bb0 0x7f967c0cd0a0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:34.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.591+0000 7f96837ff700 1 --2- 172.21.15.84:0/3312095075 >> v2:172.21.15.179:3300/0 conn(0x7f967c0cbe40 0x7f967c0cda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:34.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.591+0000 7f96837ff700 1 -- 172.21.15.84:0/3312095075 >> 172.21.15.84:0/3312095075 conn(0x7f967c0b05d0 msgr2=0x7f967c0b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:34.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.591+0000 7f96837ff700 1 -- 172.21.15.84:0/3312095075 shutdown_connections 2023-07-14T11:17:34.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.591+0000 7f96837ff700 1 -- 172.21.15.84:0/3312095075 wait complete. 2023-07-14T11:17:34.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.592+0000 7f96837ff700 1 Processor -- start 2023-07-14T11:17:34.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.592+0000 7f96837ff700 1 -- start start 2023-07-14T11:17:34.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.593+0000 7f96837ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f967c0cbe40 0x7f967c0b2c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:34.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.593+0000 7f96837ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f967c0cdf80 0x7f967c145b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:34.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.593+0000 7f96837ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f967c158bb0 0x7f967c06bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:34.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.593+0000 7f96837ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f967c0b18f0 con 0x7f967c0cdf80 2023-07-14T11:17:34.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.593+0000 7f96837ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f967c0b3180 con 0x7f967c158bb0 2023-07-14T11:17:34.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.593+0000 7f96837ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f967c0b1b40 con 0x7f967c0cbe40 2023-07-14T11:17:34.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.593+0000 7f9680d9a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f967c0cdf80 0x7f967c145b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:34.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.594+0000 7f9680d9a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f967c0cdf80 0x7f967c145b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39692/0 (socket says 172.21.15.84:39692) 2023-07-14T11:17:34.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.594+0000 7f9680d9a700 1 -- 172.21.15.84:0/469641533 learned_addr learned my addr 172.21.15.84:0/469641533 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:34.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.594+0000 7f9680d9a700 1 -- 172.21.15.84:0/469641533 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f967c0cbe40 msgr2=0x7f967c0b2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:34.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.594+0000 7f968159b700 1 --2- 172.21.15.84:0/469641533 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f967c0cbe40 0x7f967c0b2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:34.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.594+0000 7f9681d9c700 1 --2- 172.21.15.84:0/469641533 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f967c158bb0 0x7f967c06bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:34.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.594+0000 7f9680d9a700 1 --2- 172.21.15.84:0/469641533 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f967c0cbe40 0x7f967c0b2c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:34.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.594+0000 7f9680d9a700 1 -- 172.21.15.84:0/469641533 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f967c158bb0 msgr2=0x7f967c06bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:34.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.594+0000 7f9680d9a700 1 --2- 172.21.15.84:0/469641533 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f967c158bb0 0x7f967c06bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:34.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.594+0000 7f9680d9a700 1 -- 172.21.15.84:0/469641533 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96780094a0 con 0x7f967c0cdf80 2023-07-14T11:17:34.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.594+0000 7f968159b700 1 --2- 172.21.15.84:0/469641533 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f967c0cbe40 0x7f967c0b2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:17:34.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.594+0000 7f9681d9c700 1 --2- 172.21.15.84:0/469641533 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f967c158bb0 0x7f967c06bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:17:34.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.594+0000 7f9680d9a700 1 --2- 172.21.15.84:0/469641533 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f967c0cdf80 0x7f967c145b10 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f966c00c7f0 tx=0x7f966c00cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:34.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.594+0000 7f9671ffb700 1 -- 172.21.15.84:0/469641533 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966c011800 con 0x7f967c0cdf80 2023-07-14T11:17:34.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.594+0000 7f9671ffb700 1 -- 172.21.15.84:0/469641533 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f966c011960 con 0x7f967c0cdf80 2023-07-14T11:17:34.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.594+0000 7f9671ffb700 1 -- 172.21.15.84:0/469641533 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966c011cf0 con 0x7f967c0cdf80 2023-07-14T11:17:34.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.595+0000 7f96837ff700 1 -- 172.21.15.84:0/469641533 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f967c0b1e20 con 0x7f967c0cdf80 2023-07-14T11:17:34.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.595+0000 7f96837ff700 1 -- 172.21.15.84:0/469641533 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f967c0b23e0 con 0x7f967c0cdf80 2023-07-14T11:17:34.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.596+0000 7f96837ff700 1 -- 172.21.15.84:0/469641533 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f967c074350 con 0x7f967c0cdf80 2023-07-14T11:17:34.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.597+0000 7f9671ffb700 1 -- 172.21.15.84:0/469641533 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7f966c018360 con 0x7f967c0cdf80 2023-07-14T11:17:34.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.597+0000 7f9671ffb700 1 --2- 172.21.15.84:0/469641533 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f966006b040 0x7f966006d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:34.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.598+0000 7f9671ffb700 1 -- 172.21.15.84:0/469641533 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f966c089b60 con 0x7f967c0cdf80 2023-07-14T11:17:34.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.598+0000 7f968159b700 1 --2- 172.21.15.84:0/469641533 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f966006b040 0x7f966006d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:34.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.598+0000 7f968159b700 1 --2- 172.21.15.84:0/469641533 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f966006b040 0x7f966006d4f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f967c1509e0 tx=0x7f9678008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:34.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.602+0000 7f9671ffb700 1 -- 172.21.15.84:0/469641533 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f966c0546b0 con 0x7f967c0cdf80 2023-07-14T11:17:34.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.793+0000 7f96837ff700 1 -- 172.21.15.84:0/469641533 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f967c0b4a40 con 0x7f967c0cdf80 2023-07-14T11:17:34.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.793+0000 7f9671ffb700 1 -- 172.21.15.84:0/469641533 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v63) v1 ==== 93+0+10 (secure 0 0 0) 0x7f966c057cd0 con 0x7f967c0cdf80 2023-07-14T11:17:34.796 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-07-14T11:17:34.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.795+0000 7f96837ff700 1 -- 172.21.15.84:0/469641533 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f966006b040 msgr2=0x7f966006d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:34.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.795+0000 7f96837ff700 1 --2- 172.21.15.84:0/469641533 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f966006b040 0x7f966006d4f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f967c1509e0 tx=0x7f9678008030 comp rx=0 tx=0).stop 2023-07-14T11:17:34.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.795+0000 7f96837ff700 1 -- 172.21.15.84:0/469641533 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f967c0cdf80 msgr2=0x7f967c145b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:34.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.795+0000 7f96837ff700 1 --2- 172.21.15.84:0/469641533 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f967c0cdf80 0x7f967c145b10 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f966c00c7f0 tx=0x7f966c00cbb0 comp rx=0 tx=0).stop 2023-07-14T11:17:34.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.795+0000 7f96837ff700 1 -- 172.21.15.84:0/469641533 shutdown_connections 2023-07-14T11:17:34.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.795+0000 7f96837ff700 1 --2- 172.21.15.84:0/469641533 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f966006b040 0x7f966006d4f0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:34.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.795+0000 7f96837ff700 1 --2- 172.21.15.84:0/469641533 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f967c0cbe40 0x7f967c0b2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:34.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.795+0000 7f96837ff700 1 --2- 172.21.15.84:0/469641533 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f967c158bb0 0x7f967c06bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:34.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.795+0000 7f96837ff700 1 --2- 172.21.15.84:0/469641533 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f967c0cdf80 0x7f967c145b10 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:34.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.795+0000 7f96837ff700 1 -- 172.21.15.84:0/469641533 >> 172.21.15.84:0/469641533 conn(0x7f967c0b05d0 msgr2=0x7f967c14fe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:34.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.796+0000 7f96837ff700 1 -- 172.21.15.84:0/469641533 shutdown_connections 2023-07-14T11:17:34.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:34.796+0000 7f96837ff700 1 -- 172.21.15.84:0/469641533 wait complete. 2023-07-14T11:17:34.815 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T11:17:35.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.012+0000 7fbfd7fff700 1 Processor -- start 2023-07-14T11:17:35.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.012+0000 7fbfd7fff700 1 -- start start 2023-07-14T11:17:35.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.013+0000 7fbfd7fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbfd0158bb0 0x7fbfd00cd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:35.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.013+0000 7fbfd7fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbfd00cbe40 0x7fbfd00cda40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:35.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.013+0000 7fbfd7fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfd00ce8c0 con 0x7fbfd00cdf80 2023-07-14T11:17:35.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.013+0000 7fbfd7fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfd006b5b0 con 0x7fbfd0158bb0 2023-07-14T11:17:35.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.013+0000 7fbfd7fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd00ce400 con 0x7fbfd00cbe40 2023-07-14T11:17:35.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.014+0000 7fbfd559a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbfd00cbe40 0x7fbfd00cda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:35.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.014+0000 7fbfd5d9b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbfd0158bb0 0x7fbfd00cd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:35.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.014+0000 7fbfd559a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbfd00cbe40 0x7fbfd00cda40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.84:59612/0 (socket says 172.21.15.84:59612) 2023-07-14T11:17:35.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.014+0000 7fbfd559a700 1 -- 172.21.15.84:0/1355986361 learned_addr learned my addr 172.21.15.84:0/1355986361 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:35.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.014+0000 7fbfd559a700 1 -- 172.21.15.84:0/1355986361 >> v2:172.21.15.179:3300/0 conn(0x7fbfd0158bb0 msgr2=0x7fbfd00cd0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:35.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.014+0000 7fbfd559a700 1 --2- 172.21.15.84:0/1355986361 >> v2:172.21.15.179:3300/0 conn(0x7fbfd0158bb0 0x7fbfd00cd0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:35.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.014+0000 7fbfd559a700 1 -- 172.21.15.84:0/1355986361 >> v1:172.21.15.179:6789/0 conn(0x7fbfd00cdf80 legacy=0x7fbfd015c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:35.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.014+0000 7fbfd559a700 1 -- 172.21.15.84:0/1355986361 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd00cc2b0 con 0x7fbfd00cbe40 2023-07-14T11:17:35.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.015+0000 7fbfd559a700 1 --2- 172.21.15.84:0/1355986361 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbfd00cbe40 0x7fbfd00cda40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbfc000aa90 tx=0x7fbfc000ada0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2361f9655cf16dc9 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:35.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.015+0000 7fbfd4d99700 1 -- 172.21.15.84:0/1355986361 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc000cb70 con 0x7fbfd00cbe40 2023-07-14T11:17:35.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.015+0000 7fbfd4d99700 1 -- 172.21.15.84:0/1355986361 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfc000ccd0 con 0x7fbfd00cbe40 2023-07-14T11:17:35.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.015+0000 7fbfd4d99700 1 -- 172.21.15.84:0/1355986361 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc0018620 con 0x7fbfd00cbe40 2023-07-14T11:17:35.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.015+0000 7fbfd7fff700 1 -- 172.21.15.84:0/1355986361 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbfd00cbe40 msgr2=0x7fbfd00cda40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:35.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.015+0000 7fbfd7fff700 1 --2- 172.21.15.84:0/1355986361 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbfd00cbe40 0x7fbfd00cda40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbfc000aa90 tx=0x7fbfc000ada0 comp rx=0 tx=0).stop 2023-07-14T11:17:35.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.016+0000 7fbfd7fff700 1 -- 172.21.15.84:0/1355986361 shutdown_connections 2023-07-14T11:17:35.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.016+0000 7fbfd7fff700 1 --2- 172.21.15.84:0/1355986361 >> v2:172.21.15.179:3300/0 conn(0x7fbfd0158bb0 0x7fbfd00cd0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:35.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.016+0000 7fbfd7fff700 1 --2- 172.21.15.84:0/1355986361 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbfd00cbe40 0x7fbfd00cda40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:35.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.016+0000 7fbfd7fff700 1 -- 172.21.15.84:0/1355986361 >> 172.21.15.84:0/1355986361 conn(0x7fbfd00b05d0 msgr2=0x7fbfd00b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:35.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.016+0000 7fbfd7fff700 1 -- 172.21.15.84:0/1355986361 shutdown_connections 2023-07-14T11:17:35.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.016+0000 7fbfd7fff700 1 -- 172.21.15.84:0/1355986361 wait complete. 2023-07-14T11:17:35.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.017+0000 7fbfd7fff700 1 Processor -- start 2023-07-14T11:17:35.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.018+0000 7fbfd7fff700 1 -- start start 2023-07-14T11:17:35.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.019+0000 7fbfd7fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbfd00cbe40 0x7fbfd0157480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:35.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.019+0000 7fbfd7fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbfd00cdf80 0x7fbfd01558c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:35.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.019+0000 7fbfd7fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbfd0158bb0 0x7fbfd0155e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:35.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.019+0000 7fbfd7fff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd00c4180 con 0x7fbfd0158bb0 2023-07-14T11:17:35.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.019+0000 7fbfd7fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd00b25a0 con 0x7fbfd00cdf80 2023-07-14T11:17:35.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.019+0000 7fbfd7fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd00b2860 con 0x7fbfd00cbe40 2023-07-14T11:17:35.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.019+0000 7fbfd659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbfd0158bb0 0x7fbfd0155e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:35.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.019+0000 7fbfd659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbfd0158bb0 0x7fbfd0155e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39704/0 (socket says 172.21.15.84:39704) 2023-07-14T11:17:35.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.019+0000 7fbfd659c700 1 -- 172.21.15.84:0/4141765116 learned_addr learned my addr 172.21.15.84:0/4141765116 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:35.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.019+0000 7fbfd559a700 1 --2- 172.21.15.84:0/4141765116 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbfd00cdf80 0x7fbfd01558c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:35.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.019+0000 7fbfd5d9b700 1 --2- 172.21.15.84:0/4141765116 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbfd00cbe40 0x7fbfd0157480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:35.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.019+0000 7fbfd659c700 1 -- 172.21.15.84:0/4141765116 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbfd00cbe40 msgr2=0x7fbfd0157480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:35.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.019+0000 7fbfd659c700 1 --2- 172.21.15.84:0/4141765116 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbfd00cbe40 0x7fbfd0157480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:35.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.019+0000 7fbfd659c700 1 -- 172.21.15.84:0/4141765116 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbfd00cdf80 msgr2=0x7fbfd01558c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:35.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.019+0000 7fbfd659c700 1 --2- 172.21.15.84:0/4141765116 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbfd00cdf80 0x7fbfd01558c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:35.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.019+0000 7fbfd659c700 1 -- 172.21.15.84:0/4141765116 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfc000a6f0 con 0x7fbfd0158bb0 2023-07-14T11:17:35.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.019+0000 7fbfd559a700 1 --2- 172.21.15.84:0/4141765116 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbfd00cdf80 0x7fbfd01558c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:17:35.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.020+0000 7fbfd659c700 1 --2- 172.21.15.84:0/4141765116 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbfd0158bb0 0x7fbfd0155e00 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fbfc800cc50 tx=0x7fbfc800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:35.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.020+0000 7fbfc67fc700 1 -- 172.21.15.84:0/4141765116 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc800ad80 con 0x7fbfd0158bb0 2023-07-14T11:17:35.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.020+0000 7fbfc67fc700 1 -- 172.21.15.84:0/4141765116 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfc800ce50 con 0x7fbfd0158bb0 2023-07-14T11:17:35.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.020+0000 7fbfc67fc700 1 -- 172.21.15.84:0/4141765116 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc8003c40 con 0x7fbfd0158bb0 2023-07-14T11:17:35.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.020+0000 7fbfd7fff700 1 -- 172.21.15.84:0/4141765116 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfd00b2b40 con 0x7fbfd0158bb0 2023-07-14T11:17:35.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.020+0000 7fbfd7fff700 1 -- 172.21.15.84:0/4141765116 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfd00b3100 con 0x7fbfd0158bb0 2023-07-14T11:17:35.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.021+0000 7fbfd7fff700 1 -- 172.21.15.84:0/4141765116 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfd00714e0 con 0x7fbfd0158bb0 2023-07-14T11:17:35.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.022+0000 7fbfc67fc700 1 -- 172.21.15.84:0/4141765116 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7fbfc80050d0 con 0x7fbfd0158bb0 2023-07-14T11:17:35.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.023+0000 7fbfc67fc700 1 --2- 172.21.15.84:0/4141765116 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fbfb406b010 0x7fbfb406d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:35.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.023+0000 7fbfc67fc700 1 -- 172.21.15.84:0/4141765116 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbfc8089b90 con 0x7fbfd0158bb0 2023-07-14T11:17:35.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.023+0000 7fbfd5d9b700 1 --2- 172.21.15.84:0/4141765116 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fbfb406b010 0x7fbfb406d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:35.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.024+0000 7fbfd5d9b700 1 --2- 172.21.15.84:0/4141765116 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fbfb406b010 0x7fbfb406d4c0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc009ad0 tx=0x7fbfcc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:35.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.027+0000 7fbfc67fc700 1 -- 172.21.15.84:0/4141765116 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fbfd00714e0 con 0x7fbfd0158bb0 2023-07-14T11:17:35.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.221+0000 7fbfd7fff700 1 -- 172.21.15.84:0/4141765116 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fbfd00714e0 con 0x7fbfd0158bb0 2023-07-14T11:17:35.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.221+0000 7fbfc67fc700 1 -- 172.21.15.84:0/4141765116 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v63) v1 ==== 92+0+10 (secure 0 0 0) 0x7fbfd00714e0 con 0x7fbfd0158bb0 2023-07-14T11:17:35.224 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-07-14T11:17:35.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.224+0000 7fbfd7fff700 1 -- 172.21.15.84:0/4141765116 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fbfb406b010 msgr2=0x7fbfb406d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:35.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.224+0000 7fbfd7fff700 1 --2- 172.21.15.84:0/4141765116 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fbfb406b010 0x7fbfb406d4c0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc009ad0 tx=0x7fbfcc008040 comp rx=0 tx=0).stop 2023-07-14T11:17:35.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.224+0000 7fbfd7fff700 1 -- 172.21.15.84:0/4141765116 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbfd0158bb0 msgr2=0x7fbfd0155e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:35.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.224+0000 7fbfd7fff700 1 --2- 172.21.15.84:0/4141765116 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbfd0158bb0 0x7fbfd0155e00 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fbfc800cc50 tx=0x7fbfc800a340 comp rx=0 tx=0).stop 2023-07-14T11:17:35.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.224+0000 7fbfd7fff700 1 -- 172.21.15.84:0/4141765116 shutdown_connections 2023-07-14T11:17:35.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.224+0000 7fbfd7fff700 1 --2- 172.21.15.84:0/4141765116 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fbfb406b010 0x7fbfb406d4c0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:35.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.224+0000 7fbfd7fff700 1 --2- 172.21.15.84:0/4141765116 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbfd00cbe40 0x7fbfd0157480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:35.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.224+0000 7fbfd7fff700 1 --2- 172.21.15.84:0/4141765116 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbfd0158bb0 0x7fbfd0155e00 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:35.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.224+0000 7fbfd7fff700 1 --2- 172.21.15.84:0/4141765116 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbfd00cdf80 0x7fbfd01558c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:35.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.224+0000 7fbfd7fff700 1 -- 172.21.15.84:0/4141765116 >> 172.21.15.84:0/4141765116 conn(0x7fbfd00b05d0 msgr2=0x7fbfd006bb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:35.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.224+0000 7fbfd7fff700 1 -- 172.21.15.84:0/4141765116 shutdown_connections 2023-07-14T11:17:35.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.224+0000 7fbfd7fff700 1 -- 172.21.15.84:0/4141765116 wait complete. 2023-07-14T11:17:35.244 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T11:17:35.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.440+0000 7efe8dfff700 1 Processor -- start 2023-07-14T11:17:35.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.440+0000 7efe8dfff700 1 -- start start 2023-07-14T11:17:35.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.441+0000 7efe8dfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7efe880b8a60 0x7efe880b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:35.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.441+0000 7efe8dfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efe880b4530 0x7efe880d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:35.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.441+0000 7efe8dfff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe880b8e30 con 0x7efe880d1050 2023-07-14T11:17:35.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.441+0000 7efe8dfff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe880d14d0 con 0x7efe880b8a60 2023-07-14T11:17:35.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.441+0000 7efe8dfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe880b1e30 con 0x7efe880b4530 2023-07-14T11:17:35.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.441+0000 7efe877fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7efe880b8a60 0x7efe880b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:35.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.441+0000 7efe877fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7efe880b8a60 0x7efe880b3ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39706/0 (socket says 172.21.15.84:39706) 2023-07-14T11:17:35.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.441+0000 7efe877fe700 1 -- 172.21.15.84:0/4084430024 learned_addr learned my addr 172.21.15.84:0/4084430024 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:35.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.441+0000 7efe7ffff700 1 --2- 172.21.15.84:0/4084430024 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efe880b4530 0x7efe880d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:35.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.442+0000 7efe877fe700 1 -- 172.21.15.84:0/4084430024 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efe880b4530 msgr2=0x7efe880d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:35.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.442+0000 7efe877fe700 1 --2- 172.21.15.84:0/4084430024 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efe880b4530 0x7efe880d0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:35.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.442+0000 7efe877fe700 1 -- 172.21.15.84:0/4084430024 >> v1:172.21.15.179:6789/0 conn(0x7efe880d1050 legacy=0x7efe880b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:35.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.442+0000 7efe877fe700 1 -- 172.21.15.84:0/4084430024 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe880afaa0 con 0x7efe880b8a60 2023-07-14T11:17:35.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.442+0000 7efe7ffff700 1 --2- 172.21.15.84:0/4084430024 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efe880b4530 0x7efe880d0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:17:35.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.442+0000 7efe877fe700 1 --2- 172.21.15.84:0/4084430024 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe880b8a60 0x7efe880b3ff0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7efe780098f0 tx=0x7efe78009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61fe125156d4ba1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:35.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.442+0000 7efe86ffd700 1 -- 172.21.15.84:0/4084430024 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7800b8a0 con 0x7efe880b8a60 2023-07-14T11:17:35.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.442+0000 7efe86ffd700 1 -- 172.21.15.84:0/4084430024 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe7800ba00 con 0x7efe880b8a60 2023-07-14T11:17:35.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.442+0000 7efe86ffd700 1 -- 172.21.15.84:0/4084430024 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7800bd90 con 0x7efe880b8a60 2023-07-14T11:17:35.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.443+0000 7efe8dfff700 1 -- 172.21.15.84:0/4084430024 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe880b8a60 msgr2=0x7efe880b3ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:35.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.443+0000 7efe8dfff700 1 --2- 172.21.15.84:0/4084430024 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe880b8a60 0x7efe880b3ff0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7efe780098f0 tx=0x7efe78009c00 comp rx=0 tx=0).stop 2023-07-14T11:17:35.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.443+0000 7efe8dfff700 1 -- 172.21.15.84:0/4084430024 shutdown_connections 2023-07-14T11:17:35.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.443+0000 7efe8dfff700 1 --2- 172.21.15.84:0/4084430024 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe880b8a60 0x7efe880b3ff0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:35.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.443+0000 7efe8dfff700 1 --2- 172.21.15.84:0/4084430024 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efe880b4530 0x7efe880d0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:35.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.443+0000 7efe8dfff700 1 -- 172.21.15.84:0/4084430024 >> 172.21.15.84:0/4084430024 conn(0x7efe8809c1b0 msgr2=0x7efe880d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:35.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.443+0000 7efe8dfff700 1 -- 172.21.15.84:0/4084430024 shutdown_connections 2023-07-14T11:17:35.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.443+0000 7efe8dfff700 1 -- 172.21.15.84:0/4084430024 wait complete. 2023-07-14T11:17:35.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.444+0000 7efe8dfff700 1 Processor -- start 2023-07-14T11:17:35.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.445+0000 7efe8dfff700 1 -- start start 2023-07-14T11:17:35.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.445+0000 7efe8dfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efe880b4530 0x7efe8815f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:35.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.445+0000 7efe8dfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe880b8a60 0x7efe8815d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:35.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.445+0000 7efe8dfff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efe880d1050 0x7efe8815d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:35.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.445+0000 7efe8dfff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe8815fe80 con 0x7efe880b8a60 2023-07-14T11:17:35.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.445+0000 7efe8dfff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe8815fba0 con 0x7efe880d1050 2023-07-14T11:17:35.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.445+0000 7efe8dfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe88156230 con 0x7efe880b4530 2023-07-14T11:17:35.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.446+0000 7efe7ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe880b8a60 0x7efe8815d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:35.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.446+0000 7efe7ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe880b8a60 0x7efe8815d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39722/0 (socket says 172.21.15.84:39722) 2023-07-14T11:17:35.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.446+0000 7efe7ffff700 1 -- 172.21.15.84:0/2673973651 learned_addr learned my addr 172.21.15.84:0/2673973651 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:35.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.446+0000 7efe877fe700 1 --2- 172.21.15.84:0/2673973651 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efe880b4530 0x7efe8815f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:35.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.446+0000 7efe87fff700 1 --2- 172.21.15.84:0/2673973651 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efe880d1050 0x7efe8815d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:35.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.446+0000 7efe7ffff700 1 -- 172.21.15.84:0/2673973651 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efe880b4530 msgr2=0x7efe8815f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:35.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.446+0000 7efe7ffff700 1 --2- 172.21.15.84:0/2673973651 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efe880b4530 0x7efe8815f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:35.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.446+0000 7efe7ffff700 1 -- 172.21.15.84:0/2673973651 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efe880d1050 msgr2=0x7efe8815d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:35.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.446+0000 7efe7ffff700 1 --2- 172.21.15.84:0/2673973651 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efe880d1050 0x7efe8815d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:35.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.446+0000 7efe7ffff700 1 -- 172.21.15.84:0/2673973651 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe78009550 con 0x7efe880b8a60 2023-07-14T11:17:35.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.446+0000 7efe7ffff700 1 --2- 172.21.15.84:0/2673973651 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe880b8a60 0x7efe8815d130 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7efe7000e810 tx=0x7efe7000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:35.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.447+0000 7efe84ff9700 1 -- 172.21.15.84:0/2673973651 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe70013610 con 0x7efe880b8a60 2023-07-14T11:17:35.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.447+0000 7efe84ff9700 1 -- 172.21.15.84:0/2673973651 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe70013770 con 0x7efe880b8a60 2023-07-14T11:17:35.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.447+0000 7efe8dfff700 1 -- 172.21.15.84:0/2673973651 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe88156510 con 0x7efe880b8a60 2023-07-14T11:17:35.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.447+0000 7efe84ff9700 1 -- 172.21.15.84:0/2673973651 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe70013b20 con 0x7efe880b8a60 2023-07-14T11:17:35.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.447+0000 7efe8dfff700 1 -- 172.21.15.84:0/2673973651 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe88152540 con 0x7efe880b8a60 2023-07-14T11:17:35.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.448+0000 7efe8dfff700 1 -- 172.21.15.84:0/2673973651 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe88156a30 con 0x7efe880b8a60 2023-07-14T11:17:35.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.449+0000 7efe84ff9700 1 -- 172.21.15.84:0/2673973651 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7efe70013c80 con 0x7efe880b8a60 2023-07-14T11:17:35.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.449+0000 7efe84ff9700 1 --2- 172.21.15.84:0/2673973651 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7efe6806b040 0x7efe6806d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:35.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.450+0000 7efe84ff9700 1 -- 172.21.15.84:0/2673973651 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efe70089610 con 0x7efe880b8a60 2023-07-14T11:17:35.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.450+0000 7efe877fe700 1 --2- 172.21.15.84:0/2673973651 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7efe6806b040 0x7efe6806d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:35.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.450+0000 7efe877fe700 1 --2- 172.21.15.84:0/2673973651 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7efe6806b040 0x7efe6806d4f0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7efe78009c40 tx=0x7efe78008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:35.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.454+0000 7efe84ff9700 1 -- 172.21.15.84:0/2673973651 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7efe88156a30 con 0x7efe880b8a60 2023-07-14T11:17:35.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.648+0000 7efe8dfff700 1 -- 172.21.15.84:0/2673973651 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7efe88156a30 con 0x7efe880b8a60 2023-07-14T11:17:35.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.649+0000 7efe84ff9700 1 -- 172.21.15.84:0/2673973651 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v63) v1 ==== 104+0+11 (secure 0 0 0) 0x7efe88156a30 con 0x7efe880b8a60 2023-07-14T11:17:35.651 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-07-14T11:17:35.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.651+0000 7efe8dfff700 1 -- 172.21.15.84:0/2673973651 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7efe6806b040 msgr2=0x7efe6806d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:35.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.651+0000 7efe8dfff700 1 --2- 172.21.15.84:0/2673973651 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7efe6806b040 0x7efe6806d4f0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7efe78009c40 tx=0x7efe78008030 comp rx=0 tx=0).stop 2023-07-14T11:17:35.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.651+0000 7efe8dfff700 1 -- 172.21.15.84:0/2673973651 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe880b8a60 msgr2=0x7efe8815d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:35.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.651+0000 7efe8dfff700 1 --2- 172.21.15.84:0/2673973651 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe880b8a60 0x7efe8815d130 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7efe7000e810 tx=0x7efe7000eb20 comp rx=0 tx=0).stop 2023-07-14T11:17:35.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.651+0000 7efe8dfff700 1 -- 172.21.15.84:0/2673973651 shutdown_connections 2023-07-14T11:17:35.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.651+0000 7efe8dfff700 1 --2- 172.21.15.84:0/2673973651 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7efe6806b040 0x7efe6806d4f0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:35.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.651+0000 7efe8dfff700 1 --2- 172.21.15.84:0/2673973651 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efe880b4530 0x7efe8815f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:35.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.651+0000 7efe8dfff700 1 --2- 172.21.15.84:0/2673973651 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efe880d1050 0x7efe8815d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:35.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.651+0000 7efe8dfff700 1 --2- 172.21.15.84:0/2673973651 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe880b8a60 0x7efe8815d130 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:35.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.651+0000 7efe8dfff700 1 -- 172.21.15.84:0/2673973651 >> 172.21.15.84:0/2673973651 conn(0x7efe8809c1b0 msgr2=0x7efe8806b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:35.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.651+0000 7efe8dfff700 1 -- 172.21.15.84:0/2673973651 shutdown_connections 2023-07-14T11:17:35.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.651+0000 7efe8dfff700 1 -- 172.21.15.84:0/2673973651 wait complete. 2023-07-14T11:17:35.671 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T11:17:35.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.869+0000 7f46ca9ff700 1 Processor -- start 2023-07-14T11:17:35.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.869+0000 7f46ca9ff700 1 -- start start 2023-07-14T11:17:35.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.870+0000 7f46ca9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46c40d1e40 0x7f46c40cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:35.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.870+0000 7f46ca9ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f46c40c71b0 0x7f46c40b49d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:35.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.870+0000 7f46ca9ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46c40cd5a0 con 0x7f46c415c860 2023-07-14T11:17:35.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.870+0000 7f46ca9ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46c40d22b0 con 0x7f46c40c71b0 2023-07-14T11:17:35.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.870+0000 7f46ca9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46c4146740 con 0x7f46c40d1e40 2023-07-14T11:17:35.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.870+0000 7f46c8f9c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f46c40c71b0 0x7f46c40b49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:35.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.870+0000 7f46c3fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f46c415c860 0x7f46c40c6aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52822/0 (socket says 172.21.15.84:52822) 2023-07-14T11:17:35.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.871+0000 7f46c3fff700 1 -- 172.21.15.84:0/741820614 learned_addr learned my addr 172.21.15.84:0/741820614 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:17:35.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.871+0000 7f46c37fe700 1 --2- 172.21.15.84:0/741820614 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46c40d1e40 0x7f46c40cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:35.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.871+0000 7f46c2ffd700 1 -- 172.21.15.84:0/741820614 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2722959390 0 0) 0x7f46c40cd5a0 con 0x7f46c415c860 2023-07-14T11:17:35.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.871+0000 7f46c2ffd700 1 -- 172.21.15.84:0/741820614 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46ac0035b0 con 0x7f46c415c860 2023-07-14T11:17:35.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.871+0000 7f46c8f9c700 1 -- 172.21.15.84:0/741820614 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46c40d1e40 msgr2=0x7f46c40cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:35.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.871+0000 7f46c8f9c700 1 --2- 172.21.15.84:0/741820614 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46c40d1e40 0x7f46c40cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:35.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.871+0000 7f46c8f9c700 1 -- 172.21.15.84:0/741820614 >> v1:172.21.15.84:6789/0 conn(0x7f46c415c860 legacy=0x7f46c40c6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:35.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.871+0000 7f46c8f9c700 1 -- 172.21.15.84:0/741820614 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c40cd7f0 con 0x7f46c40c71b0 2023-07-14T11:17:35.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.871+0000 7f46c37fe700 1 --2- 172.21.15.84:0/741820614 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46c40d1e40 0x7f46c40cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:17:35.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.871+0000 7f46c8f9c700 1 --2- 172.21.15.84:0/741820614 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46c40c71b0 0x7f46c40b49d0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f46bc009d90 tx=0x7f46bc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5061f5745cecea3a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:35.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.871+0000 7f46c2ffd700 1 -- 172.21.15.84:0/741820614 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46bc00e070 con 0x7f46c40c71b0 2023-07-14T11:17:35.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.872+0000 7f46c2ffd700 1 -- 172.21.15.84:0/741820614 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46bc00bb20 con 0x7f46c40c71b0 2023-07-14T11:17:35.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.872+0000 7f46c2ffd700 1 -- 172.21.15.84:0/741820614 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46bc012430 con 0x7f46c40c71b0 2023-07-14T11:17:35.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.872+0000 7f46ca9ff700 1 -- 172.21.15.84:0/741820614 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46c40c71b0 msgr2=0x7f46c40b49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:35.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.872+0000 7f46ca9ff700 1 --2- 172.21.15.84:0/741820614 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46c40c71b0 0x7f46c40b49d0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f46bc009d90 tx=0x7f46bc00b330 comp rx=0 tx=0).stop 2023-07-14T11:17:35.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.872+0000 7f46ca9ff700 1 -- 172.21.15.84:0/741820614 shutdown_connections 2023-07-14T11:17:35.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.872+0000 7f46ca9ff700 1 --2- 172.21.15.84:0/741820614 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46c40c71b0 0x7f46c40b49d0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:35.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.872+0000 7f46ca9ff700 1 --2- 172.21.15.84:0/741820614 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46c40d1e40 0x7f46c40cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:35.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.872+0000 7f46ca9ff700 1 -- 172.21.15.84:0/741820614 >> 172.21.15.84:0/741820614 conn(0x7f46c4065bd0 msgr2=0x7f46c4065fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:35.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.872+0000 7f46ca9ff700 1 -- 172.21.15.84:0/741820614 shutdown_connections 2023-07-14T11:17:35.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.872+0000 7f46ca9ff700 1 -- 172.21.15.84:0/741820614 wait complete. 2023-07-14T11:17:35.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.874+0000 7f46ca9ff700 1 Processor -- start 2023-07-14T11:17:35.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.874+0000 7f46ca9ff700 1 -- start start 2023-07-14T11:17:35.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.875+0000 7f46ca9ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46c40c71b0 0x7f46c4156590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:35.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.875+0000 7f46ca9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46c40d1e40 0x7f46c41572d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:35.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.875+0000 7f46ca9ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f46c415c860 0x7f46c4157810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:35.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.875+0000 7f46ca9ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c40cb010 con 0x7f46c40c71b0 2023-07-14T11:17:35.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.875+0000 7f46ca9ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c40ca400 con 0x7f46c415c860 2023-07-14T11:17:35.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.875+0000 7f46ca9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46c40ca6e0 con 0x7f46c40d1e40 2023-07-14T11:17:35.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.875+0000 7f46c3fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46c40c71b0 0x7f46c4156590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:35.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.875+0000 7f46c3fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46c40c71b0 0x7f46c4156590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39752/0 (socket says 172.21.15.84:39752) 2023-07-14T11:17:35.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.875+0000 7f46c3fff700 1 -- 172.21.15.84:0/3213353130 learned_addr learned my addr 172.21.15.84:0/3213353130 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:35.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.876+0000 7f46c3fff700 1 -- 172.21.15.84:0/3213353130 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46c40d1e40 msgr2=0x7f46c41572d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:35.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.876+0000 7f46c3fff700 1 --2- 172.21.15.84:0/3213353130 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46c40d1e40 0x7f46c41572d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:35.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.876+0000 7f46c3fff700 1 -- 172.21.15.84:0/3213353130 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f46c415c860 msgr2=0x7f46c4157810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:35.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.876+0000 7f46c3fff700 1 --2- 172.21.15.84:0/3213353130 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f46c415c860 0x7f46c4157810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:35.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.876+0000 7f46c3fff700 1 -- 172.21.15.84:0/3213353130 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46bc009a70 con 0x7f46c40c71b0 2023-07-14T11:17:35.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.876+0000 7f46c3fff700 1 --2- 172.21.15.84:0/3213353130 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46c40c71b0 0x7f46c4156590 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f46b4001eb0 tx=0x7f46b400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:35.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.876+0000 7f46c0ff9700 1 -- 172.21.15.84:0/3213353130 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b4005d70 con 0x7f46c40c71b0 2023-07-14T11:17:35.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.876+0000 7f46c0ff9700 1 -- 172.21.15.84:0/3213353130 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46b40070d0 con 0x7f46c40c71b0 2023-07-14T11:17:35.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.876+0000 7f46c0ff9700 1 -- 172.21.15.84:0/3213353130 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b4007440 con 0x7f46c40c71b0 2023-07-14T11:17:35.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.876+0000 7f46ca9ff700 1 -- 172.21.15.84:0/3213353130 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46c40ca9c0 con 0x7f46c40c71b0 2023-07-14T11:17:35.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.876+0000 7f46ca9ff700 1 -- 172.21.15.84:0/3213353130 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46c4156ad0 con 0x7f46c40c71b0 2023-07-14T11:17:35.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.877+0000 7f46ca9ff700 1 -- 172.21.15.84:0/3213353130 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46c4074350 con 0x7f46c40c71b0 2023-07-14T11:17:35.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.878+0000 7f46c0ff9700 1 -- 172.21.15.84:0/3213353130 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7f46b40075a0 con 0x7f46c40c71b0 2023-07-14T11:17:35.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.879+0000 7f46c0ff9700 1 --2- 172.21.15.84:0/3213353130 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f46b006b070 0x7f46b006d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:35.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.880+0000 7f46c0ff9700 1 -- 172.21.15.84:0/3213353130 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f46b4088ef0 con 0x7f46c40c71b0 2023-07-14T11:17:35.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.880+0000 7f46c37fe700 1 --2- 172.21.15.84:0/3213353130 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f46b006b070 0x7f46b006d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:35.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.880+0000 7f46c37fe700 1 --2- 172.21.15.84:0/3213353130 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f46b006b070 0x7f46b006d520 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f46b8006fd0 tx=0x7f46b8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:35.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:35.884+0000 7f46c0ff9700 1 -- 172.21.15.84:0/3213353130 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f46b4053ab0 con 0x7f46c40c71b0 2023-07-14T11:17:36.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.078+0000 7f46ca9ff700 1 -- 172.21.15.84:0/3213353130 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f46c40d1190 con 0x7f46c40c71b0 2023-07-14T11:17:36.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.079+0000 7f46c0ff9700 1 -- 172.21.15.84:0/3213353130 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v63) v1 ==== 100+0+11 (secure 0 0 0) 0x7f46b4017020 con 0x7f46c40c71b0 2023-07-14T11:17:36.081 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-07-14T11:17:36.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.081+0000 7f46ca9ff700 1 -- 172.21.15.84:0/3213353130 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f46b006b070 msgr2=0x7f46b006d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:36.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.081+0000 7f46ca9ff700 1 --2- 172.21.15.84:0/3213353130 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f46b006b070 0x7f46b006d520 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f46b8006fd0 tx=0x7f46b8008040 comp rx=0 tx=0).stop 2023-07-14T11:17:36.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.081+0000 7f46ca9ff700 1 -- 172.21.15.84:0/3213353130 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46c40c71b0 msgr2=0x7f46c4156590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:36.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.081+0000 7f46ca9ff700 1 --2- 172.21.15.84:0/3213353130 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46c40c71b0 0x7f46c4156590 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f46b4001eb0 tx=0x7f46b400c860 comp rx=0 tx=0).stop 2023-07-14T11:17:36.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.081+0000 7f46ca9ff700 1 -- 172.21.15.84:0/3213353130 shutdown_connections 2023-07-14T11:17:36.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.081+0000 7f46ca9ff700 1 --2- 172.21.15.84:0/3213353130 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f46c415c860 0x7f46c4157810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:36.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.081+0000 7f46ca9ff700 1 --2- 172.21.15.84:0/3213353130 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46c40c71b0 0x7f46c4156590 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:36.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.081+0000 7f46ca9ff700 1 --2- 172.21.15.84:0/3213353130 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f46b006b070 0x7f46b006d520 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:36.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.081+0000 7f46ca9ff700 1 --2- 172.21.15.84:0/3213353130 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46c40d1e40 0x7f46c41572d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:36.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.081+0000 7f46ca9ff700 1 -- 172.21.15.84:0/3213353130 >> 172.21.15.84:0/3213353130 conn(0x7f46c4065bd0 msgr2=0x7f46c40c7580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:36.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.081+0000 7f46ca9ff700 1 -- 172.21.15.84:0/3213353130 shutdown_connections 2023-07-14T11:17:36.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.081+0000 7f46ca9ff700 1 -- 172.21.15.84:0/3213353130 wait complete. 2023-07-14T11:17:36.102 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-14T11:17:36.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.295+0000 7f1cfa3ff700 1 Processor -- start 2023-07-14T11:17:36.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.296+0000 7f1cfa3ff700 1 -- start start 2023-07-14T11:17:36.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.297+0000 7f1cfa3ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1cf40d0b10 0x7f1cf40d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:36.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.297+0000 7f1cfa3ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1cf40b0e20 0x7f1cf40b1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:36.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.297+0000 7f1cfa3ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cf40b8e30 con 0x7f1cf40b8a60 2023-07-14T11:17:36.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.297+0000 7f1cfa3ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cf40d14d0 con 0x7f1cf40b0e20 2023-07-14T11:17:36.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.297+0000 7f1cfa3ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cf40afaa0 con 0x7f1cf40d0b10 2023-07-14T11:17:36.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.297+0000 7f1cf899c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1cf40b0e20 0x7f1cf40b1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:36.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.297+0000 7f1cf899c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1cf40b0e20 0x7f1cf40b1260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39762/0 (socket says 172.21.15.84:39762) 2023-07-14T11:17:36.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.297+0000 7f1cf37fe700 1 --2- 172.21.15.84:0/2842659491 >> v2:172.21.15.179:3300/0 conn(0x7f1cf40d0b10 0x7f1cf40d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:36.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.297+0000 7f1cf899c700 1 -- 172.21.15.84:0/2842659491 learned_addr learned my addr 172.21.15.84:0/2842659491 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:36.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.298+0000 7f1cf899c700 1 -- 172.21.15.84:0/2842659491 >> v2:172.21.15.179:3300/0 conn(0x7f1cf40d0b10 msgr2=0x7f1cf40d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:36.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.298+0000 7f1cf899c700 1 --2- 172.21.15.84:0/2842659491 >> v2:172.21.15.179:3300/0 conn(0x7f1cf40d0b10 0x7f1cf40d0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:36.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.298+0000 7f1cf899c700 1 -- 172.21.15.84:0/2842659491 >> v1:172.21.15.179:6789/0 conn(0x7f1cf40b8a60 legacy=0x7f1cf40b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:36.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.298+0000 7f1cf899c700 1 -- 172.21.15.84:0/2842659491 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf40afd80 con 0x7f1cf40b0e20 2023-07-14T11:17:36.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.298+0000 7f1cf899c700 1 --2- 172.21.15.84:0/2842659491 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1cf40b0e20 0x7f1cf40b1260 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f1cf409c8e0 tx=0x7f1cec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=901d4bec26541596 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:36.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.298+0000 7f1cf2ffd700 1 -- 172.21.15.84:0/2842659491 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cec00e070 con 0x7f1cf40b0e20 2023-07-14T11:17:36.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.298+0000 7f1cf2ffd700 1 -- 172.21.15.84:0/2842659491 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cec00b910 con 0x7f1cf40b0e20 2023-07-14T11:17:36.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.298+0000 7f1cf2ffd700 1 -- 172.21.15.84:0/2842659491 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cec00bcc0 con 0x7f1cf40b0e20 2023-07-14T11:17:36.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.299+0000 7f1cfa3ff700 1 -- 172.21.15.84:0/2842659491 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1cf40b0e20 msgr2=0x7f1cf40b1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:36.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.299+0000 7f1cfa3ff700 1 --2- 172.21.15.84:0/2842659491 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1cf40b0e20 0x7f1cf40b1260 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f1cf409c8e0 tx=0x7f1cec00b330 comp rx=0 tx=0).stop 2023-07-14T11:17:36.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.299+0000 7f1cfa3ff700 1 -- 172.21.15.84:0/2842659491 shutdown_connections 2023-07-14T11:17:36.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.299+0000 7f1cfa3ff700 1 --2- 172.21.15.84:0/2842659491 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1cf40b0e20 0x7f1cf40b1260 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:36.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.299+0000 7f1cfa3ff700 1 --2- 172.21.15.84:0/2842659491 >> v2:172.21.15.179:3300/0 conn(0x7f1cf40d0b10 0x7f1cf40d0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:36.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.299+0000 7f1cfa3ff700 1 -- 172.21.15.84:0/2842659491 >> 172.21.15.84:0/2842659491 conn(0x7f1cf409c1b0 msgr2=0x7f1cf40d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:36.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.299+0000 7f1cfa3ff700 1 -- 172.21.15.84:0/2842659491 shutdown_connections 2023-07-14T11:17:36.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.299+0000 7f1cfa3ff700 1 -- 172.21.15.84:0/2842659491 wait complete. 2023-07-14T11:17:36.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.300+0000 7f1cfa3ff700 1 Processor -- start 2023-07-14T11:17:36.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.301+0000 7f1cfa3ff700 1 -- start start 2023-07-14T11:17:36.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.302+0000 7f1cfa3ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1cf40b0e20 0x7f1cf414a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:36.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.302+0000 7f1cfa3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1cf40b8a60 0x7f1cf4149bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:36.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.302+0000 7f1cfa3ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1cf40d0b10 0x7f1cf40ca010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:36.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.302+0000 7f1cfa3ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf40cd340 con 0x7f1cf40b0e20 2023-07-14T11:17:36.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.302+0000 7f1cfa3ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf40cd060 con 0x7f1cf40d0b10 2023-07-14T11:17:36.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.302+0000 7f1cfa3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf40b6260 con 0x7f1cf40b8a60 2023-07-14T11:17:36.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.302+0000 7f1cf3fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1cf40b0e20 0x7f1cf414a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:36.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.302+0000 7f1cf3fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1cf40b0e20 0x7f1cf414a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39764/0 (socket says 172.21.15.84:39764) 2023-07-14T11:17:36.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.302+0000 7f1cf3fff700 1 -- 172.21.15.84:0/2312009915 learned_addr learned my addr 172.21.15.84:0/2312009915 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:36.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.302+0000 7f1cf899c700 1 --2- 172.21.15.84:0/2312009915 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1cf40d0b10 0x7f1cf40ca010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:36.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.302+0000 7f1cf37fe700 1 --2- 172.21.15.84:0/2312009915 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1cf40b8a60 0x7f1cf4149bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:36.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.302+0000 7f1cf3fff700 1 -- 172.21.15.84:0/2312009915 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1cf40b8a60 msgr2=0x7f1cf4149bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:36.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.302+0000 7f1cf3fff700 1 --2- 172.21.15.84:0/2312009915 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1cf40b8a60 0x7f1cf4149bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:36.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.302+0000 7f1cf3fff700 1 -- 172.21.15.84:0/2312009915 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1cf40d0b10 msgr2=0x7f1cf40ca010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:36.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.302+0000 7f1cf3fff700 1 --2- 172.21.15.84:0/2312009915 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1cf40d0b10 0x7f1cf40ca010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:36.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.302+0000 7f1cf3fff700 1 -- 172.21.15.84:0/2312009915 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cec009b30 con 0x7f1cf40b0e20 2023-07-14T11:17:36.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.302+0000 7f1cf899c700 1 --2- 172.21.15.84:0/2312009915 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1cf40d0b10 0x7f1cf40ca010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:17:36.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.302+0000 7f1cf37fe700 1 --2- 172.21.15.84:0/2312009915 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1cf40b8a60 0x7f1cf4149bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:17:36.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.303+0000 7f1cf3fff700 1 --2- 172.21.15.84:0/2312009915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1cf40b0e20 0x7f1cf414a300 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f1ce400c4e0 tx=0x7f1ce400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:36.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.303+0000 7f1cf0ff9700 1 -- 172.21.15.84:0/2312009915 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce40052d0 con 0x7f1cf40b0e20 2023-07-14T11:17:36.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.303+0000 7f1cf0ff9700 1 -- 172.21.15.84:0/2312009915 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ce4005430 con 0x7f1cf40b0e20 2023-07-14T11:17:36.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.303+0000 7f1cf0ff9700 1 -- 172.21.15.84:0/2312009915 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce40038c0 con 0x7f1cf40b0e20 2023-07-14T11:17:36.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.303+0000 7f1cfa3ff700 1 -- 172.21.15.84:0/2312009915 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cf40b6540 con 0x7f1cf40b0e20 2023-07-14T11:17:36.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.303+0000 7f1cfa3ff700 1 -- 172.21.15.84:0/2312009915 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cf40ca550 con 0x7f1cf40b0e20 2023-07-14T11:17:36.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.304+0000 7f1cfa3ff700 1 -- 172.21.15.84:0/2312009915 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cf40d0960 con 0x7f1cf40b0e20 2023-07-14T11:17:36.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.305+0000 7f1cf0ff9700 1 -- 172.21.15.84:0/2312009915 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7f1ce4003a20 con 0x7f1cf40b0e20 2023-07-14T11:17:36.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.306+0000 7f1cf0ff9700 1 --2- 172.21.15.84:0/2312009915 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1ce006b040 0x7f1ce006d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:36.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.306+0000 7f1cf0ff9700 1 -- 172.21.15.84:0/2312009915 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1ce4088e50 con 0x7f1cf40b0e20 2023-07-14T11:17:36.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.306+0000 7f1cf37fe700 1 --2- 172.21.15.84:0/2312009915 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1ce006b040 0x7f1ce006d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:36.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.307+0000 7f1cf37fe700 1 --2- 172.21.15.84:0/2312009915 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1ce006b040 0x7f1ce006d4f0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f1cf40b7c40 tx=0x7f1ce8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:36.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.311+0000 7f1cf0ff9700 1 -- 172.21.15.84:0/2312009915 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f1ce4053b40 con 0x7f1cf40b0e20 2023-07-14T11:17:36.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.520+0000 7f1cfa3ff700 1 -- 172.21.15.84:0/2312009915 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f1cf4074350 con 0x7f1cf40b0e20 2023-07-14T11:17:36.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.520+0000 7f1cf0ff9700 1 -- 172.21.15.84:0/2312009915 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v63) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1ce4057160 con 0x7f1cf40b0e20 2023-07-14T11:17:36.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.523+0000 7f1cfa3ff700 1 -- 172.21.15.84:0/2312009915 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1ce006b040 msgr2=0x7f1ce006d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:36.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.523+0000 7f1cfa3ff700 1 --2- 172.21.15.84:0/2312009915 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1ce006b040 0x7f1ce006d4f0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f1cf40b7c40 tx=0x7f1ce8008040 comp rx=0 tx=0).stop 2023-07-14T11:17:36.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.523+0000 7f1cfa3ff700 1 -- 172.21.15.84:0/2312009915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1cf40b0e20 msgr2=0x7f1cf414a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:36.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.523+0000 7f1cfa3ff700 1 --2- 172.21.15.84:0/2312009915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1cf40b0e20 0x7f1cf414a300 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f1ce400c4e0 tx=0x7f1ce400c8a0 comp rx=0 tx=0).stop 2023-07-14T11:17:36.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.523+0000 7f1cfa3ff700 1 -- 172.21.15.84:0/2312009915 shutdown_connections 2023-07-14T11:17:36.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.523+0000 7f1cfa3ff700 1 --2- 172.21.15.84:0/2312009915 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1cf40d0b10 0x7f1cf40ca010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:36.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.523+0000 7f1cfa3ff700 1 --2- 172.21.15.84:0/2312009915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1cf40b0e20 0x7f1cf414a300 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:36.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.523+0000 7f1cfa3ff700 1 --2- 172.21.15.84:0/2312009915 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1ce006b040 0x7f1ce006d4f0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:36.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.523+0000 7f1cfa3ff700 1 --2- 172.21.15.84:0/2312009915 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1cf40b8a60 0x7f1cf4149bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:36.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.523+0000 7f1cfa3ff700 1 -- 172.21.15.84:0/2312009915 >> 172.21.15.84:0/2312009915 conn(0x7f1cf409c1b0 msgr2=0x7f1cf415c2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:36.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.523+0000 7f1cfa3ff700 1 -- 172.21.15.84:0/2312009915 shutdown_connections 2023-07-14T11:17:36.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.523+0000 7f1cfa3ff700 1 -- 172.21.15.84:0/2312009915 wait complete. 2023-07-14T11:17:36.528 INFO:teuthology.orchestra.run.smithi084.stderr:listed 0 entries 2023-07-14T11:17:36.543 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-07-14T11:17:36.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:17:36.544 DEBUG:teuthology.orchestra.run.smithi179:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-07-14T11:17:36.641 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi179.front.sepia.ceph.com 2023-07-14T11:17:36.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:17:36.641 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-14T11:17:36.689 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-14T11:17:36.690 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:17:36.736 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345568k,nr_inodes=4086392,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=35,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275008k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-07-14T11:17:36.736 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-07-14T11:17:36.737 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:17:36.783 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345528k,nr_inodes=4086382,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=40,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275000k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-07-14T11:17:36.783 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T11:17:36.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.977+0000 7f0542dff700 1 Processor -- start 2023-07-14T11:17:36.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.977+0000 7f0542dff700 1 -- start start 2023-07-14T11:17:36.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.979+0000 7f0542dff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f053c0b3e90 0x7f053c0cee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:36.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.979+0000 7f0542dff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f053c15b430 con 0x7f053c15a8c0 2023-07-14T11:17:36.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.979+0000 7f0542dff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f053c0ce110 con 0x7f053c15e890 2023-07-14T11:17:36.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.979+0000 7f0542dff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f053c0cf380 con 0x7f053c0b3e90 2023-07-14T11:17:36.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.979+0000 7f053bfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f053c0b3e90 0x7f053c0cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:36.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.979+0000 7f054139c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f053c15a8c0 0x7f053c15ad20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52832/0 (socket says 172.21.15.84:52832) 2023-07-14T11:17:36.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.979+0000 7f054139c700 1 -- 172.21.15.84:0/4166857431 learned_addr learned my addr 172.21.15.84:0/4166857431 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:17:36.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.979+0000 7f053bfff700 1 -- 172.21.15.84:0/4166857431 >> v1:172.21.15.179:6789/0 conn(0x7f053c15e890 legacy=0x7f053c0b3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:36.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.979+0000 7f053bfff700 1 -- 172.21.15.84:0/4166857431 >> v1:172.21.15.84:6789/0 conn(0x7f053c15a8c0 legacy=0x7f053c15ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:36.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.979+0000 7f053bfff700 1 -- 172.21.15.84:0/4166857431 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f053c15b660 con 0x7f053c0b3e90 2023-07-14T11:17:36.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.979+0000 7f053b7fe700 1 -- 172.21.15.84:0/4166857431 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2993831472 0 0) 0x7f053c15b430 con 0x7f053c15a8c0 2023-07-14T11:17:36.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.980+0000 7f053bfff700 1 --2- 172.21.15.84:0/4166857431 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f053c0b3e90 0x7f053c0cee40 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f0528009840 tx=0x7f0528009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=369f72d361da26f7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:36.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.980+0000 7f053b7fe700 1 -- 172.21.15.84:0/4166857431 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0528004230 con 0x7f053c0b3e90 2023-07-14T11:17:36.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.980+0000 7f053b7fe700 1 -- 172.21.15.84:0/4166857431 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0528004390 con 0x7f053c0b3e90 2023-07-14T11:17:36.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.980+0000 7f053b7fe700 1 -- 172.21.15.84:0/4166857431 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05280036a0 con 0x7f053c0b3e90 2023-07-14T11:17:36.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.980+0000 7f0542dff700 1 -- 172.21.15.84:0/4166857431 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f053c0b3e90 msgr2=0x7f053c0cee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:36.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.980+0000 7f0542dff700 1 --2- 172.21.15.84:0/4166857431 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f053c0b3e90 0x7f053c0cee40 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f0528009840 tx=0x7f0528009b50 comp rx=0 tx=0).stop 2023-07-14T11:17:36.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.980+0000 7f0542dff700 1 -- 172.21.15.84:0/4166857431 shutdown_connections 2023-07-14T11:17:36.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.980+0000 7f0542dff700 1 --2- 172.21.15.84:0/4166857431 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f053c0b3e90 0x7f053c0cee40 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:36.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.980+0000 7f0542dff700 1 -- 172.21.15.84:0/4166857431 >> 172.21.15.84:0/4166857431 conn(0x7f053c069f30 msgr2=0x7f053c06a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:36.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.980+0000 7f0542dff700 1 -- 172.21.15.84:0/4166857431 shutdown_connections 2023-07-14T11:17:36.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.981+0000 7f0542dff700 1 -- 172.21.15.84:0/4166857431 wait complete. 2023-07-14T11:17:36.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.982+0000 7f0542dff700 1 Processor -- start 2023-07-14T11:17:36.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.982+0000 7f0542dff700 1 -- start start 2023-07-14T11:17:36.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.983+0000 7f0542dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f053c0b3e90 0x7f053c06c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:36.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.983+0000 7f0542dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f053c15a8c0 0x7f053c0b0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:36.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.983+0000 7f0542dff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f053c15e890 0x7f053c0b1290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:36.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.983+0000 7f0542dff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f053c14c460 con 0x7f053c15e890 2023-07-14T11:17:36.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.983+0000 7f0542dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f053c14c6b0 con 0x7f053c15a8c0 2023-07-14T11:17:36.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.983+0000 7f0542dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f053c14c990 con 0x7f053c0b3e90 2023-07-14T11:17:36.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.983+0000 7f054139c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f053c15e890 0x7f053c0b1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:36.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.983+0000 7f054139c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f053c15e890 0x7f053c0b1290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39786/0 (socket says 172.21.15.84:39786) 2023-07-14T11:17:36.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.983+0000 7f054139c700 1 -- 172.21.15.84:0/3584369566 learned_addr learned my addr 172.21.15.84:0/3584369566 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:36.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.984+0000 7f053bfff700 1 --2- 172.21.15.84:0/3584369566 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f053c15a8c0 0x7f053c0b0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:36.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.984+0000 7f0540b9b700 1 --2- 172.21.15.84:0/3584369566 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f053c0b3e90 0x7f053c06c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:36.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.984+0000 7f054139c700 1 -- 172.21.15.84:0/3584369566 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f053c0b3e90 msgr2=0x7f053c06c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:36.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.984+0000 7f054139c700 1 --2- 172.21.15.84:0/3584369566 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f053c0b3e90 0x7f053c06c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:36.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.984+0000 7f054139c700 1 -- 172.21.15.84:0/3584369566 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f053c15a8c0 msgr2=0x7f053c0b0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:36.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.984+0000 7f054139c700 1 --2- 172.21.15.84:0/3584369566 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f053c15a8c0 0x7f053c0b0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:36.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.984+0000 7f054139c700 1 -- 172.21.15.84:0/3584369566 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05280094a0 con 0x7f053c15e890 2023-07-14T11:17:36.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.984+0000 7f0540b9b700 1 --2- 172.21.15.84:0/3584369566 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f053c0b3e90 0x7f053c06c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:17:36.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.984+0000 7f053bfff700 1 --2- 172.21.15.84:0/3584369566 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f053c15a8c0 0x7f053c0b0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:17:36.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.984+0000 7f054139c700 1 --2- 172.21.15.84:0/3584369566 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f053c15e890 0x7f053c0b1290 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f053400cca0 tx=0x7f053400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:36.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.984+0000 7f05397fa700 1 -- 172.21.15.84:0/3584369566 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053400cea0 con 0x7f053c15e890 2023-07-14T11:17:36.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.984+0000 7f05397fa700 1 -- 172.21.15.84:0/3584369566 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f053400ade0 con 0x7f053c15e890 2023-07-14T11:17:36.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.984+0000 7f0542dff700 1 -- 172.21.15.84:0/3584369566 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f053c14cc70 con 0x7f053c15e890 2023-07-14T11:17:36.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.984+0000 7f05397fa700 1 -- 172.21.15.84:0/3584369566 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0534007310 con 0x7f053c15e890 2023-07-14T11:17:36.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.984+0000 7f0542dff700 1 -- 172.21.15.84:0/3584369566 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f053c14d230 con 0x7f053c15e890 2023-07-14T11:17:36.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.985+0000 7f0542dff700 1 -- 172.21.15.84:0/3584369566 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f053c04e280 con 0x7f053c15e890 2023-07-14T11:17:36.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.986+0000 7f05397fa700 1 -- 172.21.15.84:0/3584369566 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7f0534007470 con 0x7f053c15e890 2023-07-14T11:17:36.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.987+0000 7f05397fa700 1 --2- 172.21.15.84:0/3584369566 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f052006b040 0x7f052006d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:36.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.987+0000 7f05397fa700 1 -- 172.21.15.84:0/3584369566 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0534089660 con 0x7f053c15e890 2023-07-14T11:17:36.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.988+0000 7f0540b9b700 1 --2- 172.21.15.84:0/3584369566 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f052006b040 0x7f052006d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:36.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.988+0000 7f0540b9b700 1 --2- 172.21.15.84:0/3584369566 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f052006b040 0x7f052006d4f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f0530006fd0 tx=0x7f0530008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:36.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:36.992+0000 7f05397fa700 1 -- 172.21.15.84:0/3584369566 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f0534054350 con 0x7f053c15e890 2023-07-14T11:17:37.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.236+0000 7f0542dff700 1 -- 172.21.15.84:0/3584369566 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f053c0ae4a0 con 0x7f053c15e890 2023-07-14T11:17:37.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.236+0000 7f05397fa700 1 -- 172.21.15.84:0/3584369566 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4716 (secure 0 0 0) 0x7f0534057970 con 0x7f053c15e890 2023-07-14T11:17:37.239 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:17:37.239 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":38,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5342,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/2977703024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2977703024},{"type":"v1","addr":"172.21.15.179:6834","nonce":2977703024}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31},{"gid":5351,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/2068020315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":2068020315},{"type":"v1","addr":"172.21.15.84:6837","nonce":2068020315}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32},{"gid":5914,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/2441649918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2441649918},{"type":"v1","addr":"172.21.15.84:6836","nonce":2441649918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T11:17:12.547835+0000","modified":"2023-07-14T11:17:16.095092+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6174},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6174":{"gid":6174,"name":"d","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/3902238230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":3902238230},{"type":"v1","addr":"172.21.15.179:6835","nonce":3902238230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-07-14T11:17:37.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.238+0000 7f0542dff700 1 -- 172.21.15.84:0/3584369566 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f052006b040 msgr2=0x7f052006d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:37.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.238+0000 7f0542dff700 1 --2- 172.21.15.84:0/3584369566 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f052006b040 0x7f052006d4f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f0530006fd0 tx=0x7f0530008040 comp rx=0 tx=0).stop 2023-07-14T11:17:37.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.238+0000 7f0542dff700 1 -- 172.21.15.84:0/3584369566 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f053c15e890 msgr2=0x7f053c0b1290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:37.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.238+0000 7f0542dff700 1 --2- 172.21.15.84:0/3584369566 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f053c15e890 0x7f053c0b1290 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f053400cca0 tx=0x7f053400a340 comp rx=0 tx=0).stop 2023-07-14T11:17:37.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.239+0000 7f0542dff700 1 -- 172.21.15.84:0/3584369566 shutdown_connections 2023-07-14T11:17:37.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.239+0000 7f0542dff700 1 --2- 172.21.15.84:0/3584369566 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f052006b040 0x7f052006d4f0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:37.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.239+0000 7f0542dff700 1 --2- 172.21.15.84:0/3584369566 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f053c0b3e90 0x7f053c06c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:37.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.239+0000 7f0542dff700 1 --2- 172.21.15.84:0/3584369566 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f053c15e890 0x7f053c0b1290 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:37.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.239+0000 7f0542dff700 1 --2- 172.21.15.84:0/3584369566 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f053c15a8c0 0x7f053c0b0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:37.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.239+0000 7f0542dff700 1 -- 172.21.15.84:0/3584369566 >> 172.21.15.84:0/3584369566 conn(0x7f053c069f30 msgr2=0x7f053c073020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:37.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.239+0000 7f0542dff700 1 -- 172.21.15.84:0/3584369566 shutdown_connections 2023-07-14T11:17:37.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.239+0000 7f0542dff700 1 -- 172.21.15.84:0/3584369566 wait complete. 2023-07-14T11:17:37.243 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 38 2023-07-14T11:17:37.259 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:17:37.350 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T11:17:37.354 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T11:17:37.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.456+0000 7fd0975ff700 1 Processor -- start 2023-07-14T11:17:37.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.457+0000 7fd0975ff700 1 -- start start 2023-07-14T11:17:37.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.458+0000 7fd0975ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd09015c710 0x7fd0900cf510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:37.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.458+0000 7fd0975ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd09006db30 0x7fd09006a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:37.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.458+0000 7fd0975ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0900cd320 con 0x7fd090069f30 2023-07-14T11:17:37.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.458+0000 7fd0975ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0900ce750 con 0x7fd09006db30 2023-07-14T11:17:37.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.458+0000 7fd0975ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0900cea30 con 0x7fd09015c710 2023-07-14T11:17:37.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.458+0000 7fd095b9c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd09006db30 0x7fd09006a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:37.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.458+0000 7fd09539b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd09015c710 0x7fd0900cf510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:37.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.458+0000 7fd095b9c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd09006db30 0x7fd09006a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39798/0 (socket says 172.21.15.84:39798) 2023-07-14T11:17:37.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.458+0000 7fd095b9c700 1 -- 172.21.15.84:0/192602816 learned_addr learned my addr 172.21.15.84:0/192602816 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:37.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.459+0000 7fd095b9c700 1 -- 172.21.15.84:0/192602816 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd09015c710 msgr2=0x7fd0900cf510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:37.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.459+0000 7fd095b9c700 1 --2- 172.21.15.84:0/192602816 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd09015c710 0x7fd0900cf510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:37.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.459+0000 7fd095b9c700 1 -- 172.21.15.84:0/192602816 >> v1:172.21.15.179:6789/0 conn(0x7fd090069f30 legacy=0x7fd09006d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:37.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.459+0000 7fd095b9c700 1 -- 172.21.15.84:0/192602816 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0900ced10 con 0x7fd09006db30 2023-07-14T11:17:37.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.459+0000 7fd095b9c700 1 --2- 172.21.15.84:0/192602816 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd09006db30 0x7fd09006a3a0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fd088009e50 tx=0x7fd08800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2054f5ac5246ac2e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:37.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.459+0000 7fd087fff700 1 -- 172.21.15.84:0/192602816 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd08800e070 con 0x7fd09006db30 2023-07-14T11:17:37.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.459+0000 7fd087fff700 1 -- 172.21.15.84:0/192602816 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd08800b910 con 0x7fd09006db30 2023-07-14T11:17:37.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.459+0000 7fd087fff700 1 -- 172.21.15.84:0/192602816 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd08800bcc0 con 0x7fd09006db30 2023-07-14T11:17:37.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.460+0000 7fd0975ff700 1 -- 172.21.15.84:0/192602816 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd09006db30 msgr2=0x7fd09006a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:37.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.460+0000 7fd0975ff700 1 --2- 172.21.15.84:0/192602816 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd09006db30 0x7fd09006a3a0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fd088009e50 tx=0x7fd08800b330 comp rx=0 tx=0).stop 2023-07-14T11:17:37.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.460+0000 7fd0975ff700 1 -- 172.21.15.84:0/192602816 shutdown_connections 2023-07-14T11:17:37.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.460+0000 7fd0975ff700 1 --2- 172.21.15.84:0/192602816 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd09006db30 0x7fd09006a3a0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:37.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.460+0000 7fd0975ff700 1 --2- 172.21.15.84:0/192602816 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd09015c710 0x7fd0900cf510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:37.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.460+0000 7fd0975ff700 1 -- 172.21.15.84:0/192602816 >> 172.21.15.84:0/192602816 conn(0x7fd0900b16c0 msgr2=0x7fd0900b1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:37.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.460+0000 7fd0975ff700 1 -- 172.21.15.84:0/192602816 shutdown_connections 2023-07-14T11:17:37.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.460+0000 7fd0975ff700 1 -- 172.21.15.84:0/192602816 wait complete. 2023-07-14T11:17:37.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.462+0000 7fd0975ff700 1 Processor -- start 2023-07-14T11:17:37.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.462+0000 7fd0975ff700 1 -- start start 2023-07-14T11:17:37.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.463+0000 7fd0975ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd090069f30 0x7fd090150b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:37.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.463+0000 7fd0975ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd09006db30 0x7fd0901523b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:37.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.463+0000 7fd0975ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0901f23d0 0x7fd0900b3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:37.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.463+0000 7fd0975ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd09015e720 con 0x7fd0901f23d0 2023-07-14T11:17:37.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.463+0000 7fd0975ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0901e8b60 con 0x7fd09006db30 2023-07-14T11:17:37.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.463+0000 7fd0975ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0901528f0 con 0x7fd090069f30 2023-07-14T11:17:37.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.463+0000 7fd095b9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0901f23d0 0x7fd0900b3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:37.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.463+0000 7fd095b9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0901f23d0 0x7fd0900b3a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39812/0 (socket says 172.21.15.84:39812) 2023-07-14T11:17:37.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.463+0000 7fd095b9c700 1 -- 172.21.15.84:0/704675414 learned_addr learned my addr 172.21.15.84:0/704675414 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:37.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.463+0000 7fd09539b700 1 --2- 172.21.15.84:0/704675414 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd090069f30 0x7fd090150b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:37.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.463+0000 7fd094b9a700 1 --2- 172.21.15.84:0/704675414 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd09006db30 0x7fd0901523b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:37.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.464+0000 7fd095b9c700 1 -- 172.21.15.84:0/704675414 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd090069f30 msgr2=0x7fd090150b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:37.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.464+0000 7fd095b9c700 1 --2- 172.21.15.84:0/704675414 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd090069f30 0x7fd090150b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:37.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.464+0000 7fd095b9c700 1 -- 172.21.15.84:0/704675414 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd09006db30 msgr2=0x7fd0901523b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:37.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.464+0000 7fd095b9c700 1 --2- 172.21.15.84:0/704675414 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd09006db30 0x7fd0901523b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:37.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.464+0000 7fd095b9c700 1 -- 172.21.15.84:0/704675414 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd088009b30 con 0x7fd0901f23d0 2023-07-14T11:17:37.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.464+0000 7fd095b9c700 1 --2- 172.21.15.84:0/704675414 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0901f23d0 0x7fd0900b3a10 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fd088012000 tx=0x7fd088004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:37.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.464+0000 7fd085ffb700 1 -- 172.21.15.84:0/704675414 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd088004800 con 0x7fd0901f23d0 2023-07-14T11:17:37.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.464+0000 7fd085ffb700 1 -- 172.21.15.84:0/704675414 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd088004960 con 0x7fd0901f23d0 2023-07-14T11:17:37.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.464+0000 7fd0975ff700 1 -- 172.21.15.84:0/704675414 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd09006ac20 con 0x7fd0901f23d0 2023-07-14T11:17:37.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.464+0000 7fd085ffb700 1 -- 172.21.15.84:0/704675414 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd08801c680 con 0x7fd0901f23d0 2023-07-14T11:17:37.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.464+0000 7fd0975ff700 1 -- 172.21.15.84:0/704675414 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd09015dd80 con 0x7fd0901f23d0 2023-07-14T11:17:37.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.465+0000 7fd0975ff700 1 -- 172.21.15.84:0/704675414 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd09015e860 con 0x7fd0901f23d0 2023-07-14T11:17:37.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.466+0000 7fd085ffb700 1 -- 172.21.15.84:0/704675414 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7fd08801c7e0 con 0x7fd0901f23d0 2023-07-14T11:17:37.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.467+0000 7fd085ffb700 1 --2- 172.21.15.84:0/704675414 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fd07406b040 0x7fd07406d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:37.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.467+0000 7fd085ffb700 1 -- 172.21.15.84:0/704675414 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd08808b350 con 0x7fd0901f23d0 2023-07-14T11:17:37.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.467+0000 7fd09539b700 1 --2- 172.21.15.84:0/704675414 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fd07406b040 0x7fd07406d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:37.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.468+0000 7fd09539b700 1 --2- 172.21.15.84:0/704675414 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fd07406b040 0x7fd07406d4f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd08c009b40 tx=0x7fd08c009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:37.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.471+0000 7fd085ffb700 1 -- 172.21.15.84:0/704675414 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fd09015e860 con 0x7fd0901f23d0 2023-07-14T11:17:37.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.671+0000 7fd0975ff700 1 -- 172.21.15.84:0/704675414 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd09015e860 con 0x7fd0901f23d0 2023-07-14T11:17:37.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.673+0000 7fd085ffb700 1 -- 172.21.15.84:0/704675414 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+18269 (secure 0 0 0) 0x7fd09015e860 con 0x7fd0901f23d0 2023-07-14T11:17:37.675 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:17:37.676 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":63,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:17:14.075543+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-07-14T11:17:10.750697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-07-14T11:17:11.528893+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:17:37.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.675+0000 7fd0975ff700 1 -- 172.21.15.84:0/704675414 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fd07406b040 msgr2=0x7fd07406d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:37.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.675+0000 7fd0975ff700 1 --2- 172.21.15.84:0/704675414 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fd07406b040 0x7fd07406d4f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd08c009b40 tx=0x7fd08c009210 comp rx=0 tx=0).stop 2023-07-14T11:17:37.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.675+0000 7fd0975ff700 1 -- 172.21.15.84:0/704675414 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0901f23d0 msgr2=0x7fd0900b3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:37.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.675+0000 7fd0975ff700 1 --2- 172.21.15.84:0/704675414 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0901f23d0 0x7fd0900b3a10 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fd088012000 tx=0x7fd088004ad0 comp rx=0 tx=0).stop 2023-07-14T11:17:37.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.675+0000 7fd0975ff700 1 -- 172.21.15.84:0/704675414 shutdown_connections 2023-07-14T11:17:37.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.675+0000 7fd0975ff700 1 --2- 172.21.15.84:0/704675414 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fd07406b040 0x7fd07406d4f0 secure :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd08c009b40 tx=0x7fd08c009210 comp rx=0 tx=0).stop 2023-07-14T11:17:37.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.675+0000 7fd0975ff700 1 --2- 172.21.15.84:0/704675414 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd090069f30 0x7fd090150b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:37.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.675+0000 7fd0975ff700 1 --2- 172.21.15.84:0/704675414 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0901f23d0 0x7fd0900b3a10 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:37.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.675+0000 7fd0975ff700 1 --2- 172.21.15.84:0/704675414 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd09006db30 0x7fd0901523b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:37.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.675+0000 7fd0975ff700 1 -- 172.21.15.84:0/704675414 >> 172.21.15.84:0/704675414 conn(0x7fd0900b16c0 msgr2=0x7fd0900aeab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:37.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.675+0000 7fd0975ff700 1 -- 172.21.15.84:0/704675414 shutdown_connections 2023-07-14T11:17:37.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.675+0000 7fd0975ff700 1 -- 172.21.15.84:0/704675414 wait complete. 2023-07-14T11:17:37.696 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T11:13:00.125395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T11:13:06.803994+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T11:17:10.750697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T11:17:11.528893+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '63', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T11:17:37.697 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T11:17:37.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.933+0000 7f74825ff700 1 Processor -- start 2023-07-14T11:17:37.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.933+0000 7f74825ff700 1 -- start start 2023-07-14T11:17:37.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.934+0000 7f74825ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f747c0b4600 0x7f747c0cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:37.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.934+0000 7f74825ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f747c0cfe40 0x7f747c0d02b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:37.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.934+0000 7f74825ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f747c15cd60 con 0x7f747c0cd540 2023-07-14T11:17:37.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.934+0000 7f74825ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f747c0d1550 con 0x7f747c0cfe40 2023-07-14T11:17:37.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.934+0000 7f74825ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f747c0d2d90 con 0x7f747c0b4600 2023-07-14T11:17:37.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.935+0000 7f747b7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f747c0cfe40 0x7f747c0d02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:37.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.935+0000 7f7480b9c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f747c0cd540 0x7f747c0cd950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52836/0 (socket says 172.21.15.84:52836) 2023-07-14T11:17:37.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.935+0000 7f7480b9c700 1 -- 172.21.15.84:0/958296430 learned_addr learned my addr 172.21.15.84:0/958296430 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:17:37.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.935+0000 7f747b7fe700 1 -- 172.21.15.84:0/958296430 >> v2:172.21.15.179:3300/0 conn(0x7f747c0b4600 msgr2=0x7f747c0cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:37.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.935+0000 7f747bfff700 1 --2- 172.21.15.84:0/958296430 >> v2:172.21.15.179:3300/0 conn(0x7f747c0b4600 0x7f747c0cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:37.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.935+0000 7f747b7fe700 1 --2- 172.21.15.84:0/958296430 >> v2:172.21.15.179:3300/0 conn(0x7f747c0b4600 0x7f747c0cf900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:37.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.935+0000 7f747b7fe700 1 -- 172.21.15.84:0/958296430 >> v1:172.21.15.84:6789/0 conn(0x7f747c0cd540 legacy=0x7f747c0cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:37.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.935+0000 7f747b7fe700 1 -- 172.21.15.84:0/958296430 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f747c0cf340 con 0x7f747c0cfe40 2023-07-14T11:17:37.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.935+0000 7f747affd700 1 -- 172.21.15.84:0/958296430 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3087342391 0 0) 0x7f747c15cd60 con 0x7f747c0cd540 2023-07-14T11:17:37.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.935+0000 7f747bfff700 1 --2- 172.21.15.84:0/958296430 >> v2:172.21.15.179:3300/0 conn(0x7f747c0b4600 0x7f747c0cf900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:17:37.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.935+0000 7f747b7fe700 1 --2- 172.21.15.84:0/958296430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f747c0cfe40 0x7f747c0d02b0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f747c0673b0 tx=0x7f7470009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adce1f31b78e1847 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:37.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.936+0000 7f747affd700 1 -- 172.21.15.84:0/958296430 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7470011830 con 0x7f747c0cfe40 2023-07-14T11:17:37.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.936+0000 7f747affd700 1 -- 172.21.15.84:0/958296430 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7470011990 con 0x7f747c0cfe40 2023-07-14T11:17:37.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.936+0000 7f747affd700 1 -- 172.21.15.84:0/958296430 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7470011d20 con 0x7f747c0cfe40 2023-07-14T11:17:37.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.936+0000 7f74825ff700 1 -- 172.21.15.84:0/958296430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f747c0cfe40 msgr2=0x7f747c0d02b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:37.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.936+0000 7f74825ff700 1 --2- 172.21.15.84:0/958296430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f747c0cfe40 0x7f747c0d02b0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f747c0673b0 tx=0x7f7470009b50 comp rx=0 tx=0).stop 2023-07-14T11:17:37.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.936+0000 7f74825ff700 1 -- 172.21.15.84:0/958296430 shutdown_connections 2023-07-14T11:17:37.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.936+0000 7f74825ff700 1 --2- 172.21.15.84:0/958296430 >> v2:172.21.15.179:3300/0 conn(0x7f747c0b4600 0x7f747c0cf900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:37.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.936+0000 7f74825ff700 1 --2- 172.21.15.84:0/958296430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f747c0cfe40 0x7f747c0d02b0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:37.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.936+0000 7f74825ff700 1 -- 172.21.15.84:0/958296430 >> 172.21.15.84:0/958296430 conn(0x7f747c09c200 msgr2=0x7f747c0d2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:37.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.936+0000 7f74825ff700 1 -- 172.21.15.84:0/958296430 shutdown_connections 2023-07-14T11:17:37.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.936+0000 7f74825ff700 1 -- 172.21.15.84:0/958296430 wait complete. 2023-07-14T11:17:37.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.938+0000 7f74825ff700 1 Processor -- start 2023-07-14T11:17:37.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.938+0000 7f74825ff700 1 -- start start 2023-07-14T11:17:37.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.939+0000 7f74825ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f747c0cd540 0x7f747c15f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:37.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.939+0000 7f74825ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f747c0cfe40 0x7f747c0c78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:37.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.939+0000 7f74825ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f747c0c90d0 0x7f747c0ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:37.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.939+0000 7f74825ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f747c0c7e00 con 0x7f747c0cfe40 2023-07-14T11:17:37.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.939+0000 7f74825ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f747c0c8c40 con 0x7f747c0c90d0 2023-07-14T11:17:37.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.939+0000 7f74825ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f747c0c8030 con 0x7f747c0cd540 2023-07-14T11:17:37.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.939+0000 7f747b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f747c0cfe40 0x7f747c0c78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:37.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.939+0000 7f747b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f747c0cfe40 0x7f747c0c78c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39836/0 (socket says 172.21.15.84:39836) 2023-07-14T11:17:37.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.939+0000 7f747b7fe700 1 -- 172.21.15.84:0/509575239 learned_addr learned my addr 172.21.15.84:0/509575239 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:37.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.940+0000 7f747bfff700 1 --2- 172.21.15.84:0/509575239 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f747c0cd540 0x7f747c15f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:37.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.940+0000 7f7480b9c700 1 --2- 172.21.15.84:0/509575239 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f747c0c90d0 0x7f747c0ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:37.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.940+0000 7f747b7fe700 1 -- 172.21.15.84:0/509575239 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f747c0cd540 msgr2=0x7f747c15f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:37.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.940+0000 7f747b7fe700 1 --2- 172.21.15.84:0/509575239 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f747c0cd540 0x7f747c15f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:37.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.940+0000 7f747b7fe700 1 -- 172.21.15.84:0/509575239 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f747c0c90d0 msgr2=0x7f747c0ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:37.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.940+0000 7f747b7fe700 1 --2- 172.21.15.84:0/509575239 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f747c0c90d0 0x7f747c0ccab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:37.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.940+0000 7f747b7fe700 1 -- 172.21.15.84:0/509575239 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74700094a0 con 0x7f747c0cfe40 2023-07-14T11:17:37.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.940+0000 7f747b7fe700 1 --2- 172.21.15.84:0/509575239 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f747c0cfe40 0x7f747c0c78c0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f7470014040 tx=0x7f7470004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:37.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.940+0000 7f7478ff9700 1 -- 172.21.15.84:0/509575239 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747001abc0 con 0x7f747c0cfe40 2023-07-14T11:17:37.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.940+0000 7f7478ff9700 1 -- 172.21.15.84:0/509575239 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f747001ad20 con 0x7f747c0cfe40 2023-07-14T11:17:37.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.940+0000 7f7478ff9700 1 -- 172.21.15.84:0/509575239 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7470024610 con 0x7f747c0cfe40 2023-07-14T11:17:37.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.940+0000 7f74825ff700 1 -- 172.21.15.84:0/509575239 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f747c0c8310 con 0x7f747c0cfe40 2023-07-14T11:17:37.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.941+0000 7f74825ff700 1 -- 172.21.15.84:0/509575239 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f747c0c88d0 con 0x7f747c0cfe40 2023-07-14T11:17:37.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.941+0000 7f74825ff700 1 -- 172.21.15.84:0/509575239 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f747c06c200 con 0x7f747c0cfe40 2023-07-14T11:17:37.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.942+0000 7f7478ff9700 1 -- 172.21.15.84:0/509575239 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7f747002d450 con 0x7f747c0cfe40 2023-07-14T11:17:37.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.944+0000 7f7478ff9700 1 --2- 172.21.15.84:0/509575239 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f746806b040 0x7f746806d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:37.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.944+0000 7f7478ff9700 1 -- 172.21.15.84:0/509575239 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f747008afb0 con 0x7f747c0cfe40 2023-07-14T11:17:37.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.944+0000 7f747bfff700 1 --2- 172.21.15.84:0/509575239 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f746806b040 0x7f746806d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:37.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.945+0000 7f747bfff700 1 --2- 172.21.15.84:0/509575239 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f746806b040 0x7f746806d4f0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f746c006fd0 tx=0x7f746c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:37.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:37.948+0000 7f7478ff9700 1 -- 172.21.15.84:0/509575239 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7470055ce0 con 0x7f747c0cfe40 2023-07-14T11:17:38.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.148+0000 7f74825ff700 1 -- 172.21.15.84:0/509575239 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f747c0c8db0 con 0x7f747c0cfe40 2023-07-14T11:17:38.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.149+0000 7f7478ff9700 1 -- 172.21.15.84:0/509575239 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v63) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7470015020 con 0x7f747c0cfe40 2023-07-14T11:17:38.152 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-07-14T11:17:38.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.151+0000 7f74825ff700 1 -- 172.21.15.84:0/509575239 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f746806b040 msgr2=0x7f746806d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:38.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.151+0000 7f74825ff700 1 --2- 172.21.15.84:0/509575239 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f746806b040 0x7f746806d4f0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f746c006fd0 tx=0x7f746c008040 comp rx=0 tx=0).stop 2023-07-14T11:17:38.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.151+0000 7f74825ff700 1 -- 172.21.15.84:0/509575239 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f747c0cfe40 msgr2=0x7f747c0c78c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:38.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.151+0000 7f74825ff700 1 --2- 172.21.15.84:0/509575239 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f747c0cfe40 0x7f747c0c78c0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f7470014040 tx=0x7f7470004750 comp rx=0 tx=0).stop 2023-07-14T11:17:38.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.151+0000 7f74825ff700 1 -- 172.21.15.84:0/509575239 shutdown_connections 2023-07-14T11:17:38.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.151+0000 7f74825ff700 1 --2- 172.21.15.84:0/509575239 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f746806b040 0x7f746806d4f0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:38.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.151+0000 7f74825ff700 1 --2- 172.21.15.84:0/509575239 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f747c0cd540 0x7f747c15f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:38.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.151+0000 7f74825ff700 1 --2- 172.21.15.84:0/509575239 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f747c0c90d0 0x7f747c0ccab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:38.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.151+0000 7f74825ff700 1 --2- 172.21.15.84:0/509575239 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f747c0cfe40 0x7f747c0c78c0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:38.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.151+0000 7f74825ff700 1 -- 172.21.15.84:0/509575239 >> 172.21.15.84:0/509575239 conn(0x7f747c09c200 msgr2=0x7f747c0b74c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:38.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.151+0000 7f74825ff700 1 -- 172.21.15.84:0/509575239 shutdown_connections 2023-07-14T11:17:38.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.151+0000 7f74825ff700 1 -- 172.21.15.84:0/509575239 wait complete. 2023-07-14T11:17:38.171 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T11:17:38.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.367+0000 7ff69f3ff700 1 Processor -- start 2023-07-14T11:17:38.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.367+0000 7ff69f3ff700 1 -- start start 2023-07-14T11:17:38.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.368+0000 7ff69f3ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff6980d12c0 0x7ff6980cc220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:38.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.368+0000 7ff69f3ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff6980cb330 0x7ff69806b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:38.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.368+0000 7ff69f3ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6980b0560 con 0x7ff69806b580 2023-07-14T11:17:38.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.368+0000 7ff69f3ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff69806ba00 con 0x7ff6980d12c0 2023-07-14T11:17:38.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.368+0000 7ff69f3ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6980d1690 con 0x7ff6980cb330 2023-07-14T11:17:38.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.368+0000 7ff69d19b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff6980d12c0 0x7ff6980cc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:38.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.368+0000 7ff69d19b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff6980d12c0 0x7ff6980cc220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39840/0 (socket says 172.21.15.84:39840) 2023-07-14T11:17:38.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.368+0000 7ff69d19b700 1 -- 172.21.15.84:0/1530940050 learned_addr learned my addr 172.21.15.84:0/1530940050 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:38.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.369+0000 7ff69c99a700 1 --2- 172.21.15.84:0/1530940050 >> v2:172.21.15.179:3300/0 conn(0x7ff6980cb330 0x7ff69806b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:38.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.369+0000 7ff69d19b700 1 -- 172.21.15.84:0/1530940050 >> v2:172.21.15.179:3300/0 conn(0x7ff6980cb330 msgr2=0x7ff69806b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:38.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.369+0000 7ff69d19b700 1 --2- 172.21.15.84:0/1530940050 >> v2:172.21.15.179:3300/0 conn(0x7ff6980cb330 0x7ff69806b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:38.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.369+0000 7ff69d19b700 1 -- 172.21.15.84:0/1530940050 >> v1:172.21.15.84:6789/0 conn(0x7ff69806b580 legacy=0x7ff6980cd560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:38.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.369+0000 7ff69d19b700 1 -- 172.21.15.84:0/1530940050 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6980cc760 con 0x7ff6980d12c0 2023-07-14T11:17:38.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.369+0000 7ff69c99a700 1 --2- 172.21.15.84:0/1530940050 >> v2:172.21.15.179:3300/0 conn(0x7ff6980cb330 0x7ff69806b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:17:38.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.369+0000 7ff68ffff700 1 -- 172.21.15.84:0/1530940050 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2624889005 0 0) 0x7ff6980b0560 con 0x7ff69806b580 2023-07-14T11:17:38.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.369+0000 7ff69d19b700 1 --2- 172.21.15.84:0/1530940050 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff6980d12c0 0x7ff6980cc220 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7ff698068200 tx=0x7ff694009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68f3a6c184c4ec55 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:38.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.369+0000 7ff68ffff700 1 -- 172.21.15.84:0/1530940050 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69400b870 con 0x7ff6980d12c0 2023-07-14T11:17:38.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.369+0000 7ff68ffff700 1 -- 172.21.15.84:0/1530940050 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff69400b9d0 con 0x7ff6980d12c0 2023-07-14T11:17:38.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.369+0000 7ff68ffff700 1 -- 172.21.15.84:0/1530940050 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69400bd60 con 0x7ff6980d12c0 2023-07-14T11:17:38.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.370+0000 7ff69f3ff700 1 -- 172.21.15.84:0/1530940050 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff6980d12c0 msgr2=0x7ff6980cc220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:38.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.370+0000 7ff69f3ff700 1 --2- 172.21.15.84:0/1530940050 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff6980d12c0 0x7ff6980cc220 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7ff698068200 tx=0x7ff694009bd0 comp rx=0 tx=0).stop 2023-07-14T11:17:38.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.370+0000 7ff69f3ff700 1 -- 172.21.15.84:0/1530940050 shutdown_connections 2023-07-14T11:17:38.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.370+0000 7ff69f3ff700 1 --2- 172.21.15.84:0/1530940050 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff6980d12c0 0x7ff6980cc220 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:38.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.370+0000 7ff69f3ff700 1 --2- 172.21.15.84:0/1530940050 >> v2:172.21.15.179:3300/0 conn(0x7ff6980cb330 0x7ff69806b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:38.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.370+0000 7ff69f3ff700 1 -- 172.21.15.84:0/1530940050 >> 172.21.15.84:0/1530940050 conn(0x7ff6980999e0 msgr2=0x7ff698099de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:38.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.370+0000 7ff69f3ff700 1 -- 172.21.15.84:0/1530940050 shutdown_connections 2023-07-14T11:17:38.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.370+0000 7ff69f3ff700 1 -- 172.21.15.84:0/1530940050 wait complete. 2023-07-14T11:17:38.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.372+0000 7ff69f3ff700 1 Processor -- start 2023-07-14T11:17:38.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.372+0000 7ff69f3ff700 1 -- start start 2023-07-14T11:17:38.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.373+0000 7ff69f3ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff69806b580 0x7ff698159b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:38.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.373+0000 7ff69f3ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6980cb330 0x7ff6981e6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:38.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.373+0000 7ff69f3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6980d12c0 0x7ff6980b5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:38.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.373+0000 7ff69f3ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff698158d80 con 0x7ff69806b580 2023-07-14T11:17:38.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.373+0000 7ff69f3ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff69815aed0 con 0x7ff6980cb330 2023-07-14T11:17:38.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.373+0000 7ff69f3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff698159040 con 0x7ff6980d12c0 2023-07-14T11:17:38.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.373+0000 7ff69d19b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff69806b580 0x7ff698159b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:38.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.373+0000 7ff69d19b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff69806b580 0x7ff698159b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39854/0 (socket says 172.21.15.84:39854) 2023-07-14T11:17:38.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.373+0000 7ff69d19b700 1 -- 172.21.15.84:0/874993170 learned_addr learned my addr 172.21.15.84:0/874993170 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:38.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.373+0000 7ff69d19b700 1 -- 172.21.15.84:0/874993170 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6980d12c0 msgr2=0x7ff6980b5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:38.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.373+0000 7ff69d19b700 1 --2- 172.21.15.84:0/874993170 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6980d12c0 0x7ff6980b5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:38.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.373+0000 7ff69d19b700 1 -- 172.21.15.84:0/874993170 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6980cb330 msgr2=0x7ff6981e6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:38.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.373+0000 7ff69d19b700 1 --2- 172.21.15.84:0/874993170 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6980cb330 0x7ff6981e6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:38.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.373+0000 7ff69d19b700 1 -- 172.21.15.84:0/874993170 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff694009550 con 0x7ff69806b580 2023-07-14T11:17:38.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.374+0000 7ff69d19b700 1 --2- 172.21.15.84:0/874993170 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff69806b580 0x7ff698159b20 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7ff694000c00 tx=0x7ff694004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:38.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.374+0000 7ff68dffb700 1 -- 172.21.15.84:0/874993170 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff694004500 con 0x7ff69806b580 2023-07-14T11:17:38.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.374+0000 7ff68dffb700 1 -- 172.21.15.84:0/874993170 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6940036a0 con 0x7ff69806b580 2023-07-14T11:17:38.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.374+0000 7ff68dffb700 1 -- 172.21.15.84:0/874993170 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff694003a10 con 0x7ff69806b580 2023-07-14T11:17:38.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.374+0000 7ff69f3ff700 1 -- 172.21.15.84:0/874993170 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff698159320 con 0x7ff69806b580 2023-07-14T11:17:38.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.374+0000 7ff69f3ff700 1 -- 172.21.15.84:0/874993170 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff69815a060 con 0x7ff69806b580 2023-07-14T11:17:38.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.375+0000 7ff69f3ff700 1 -- 172.21.15.84:0/874993170 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff69806c370 con 0x7ff69806b580 2023-07-14T11:17:38.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.376+0000 7ff68dffb700 1 -- 172.21.15.84:0/874993170 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7ff694003b70 con 0x7ff69806b580 2023-07-14T11:17:38.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.377+0000 7ff68dffb700 1 --2- 172.21.15.84:0/874993170 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff67c06b040 0x7ff67c06d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:38.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.377+0000 7ff68dffb700 1 -- 172.21.15.84:0/874993170 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff69408afb0 con 0x7ff69806b580 2023-07-14T11:17:38.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.377+0000 7ff69c99a700 1 --2- 172.21.15.84:0/874993170 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff67c06b040 0x7ff67c06d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:38.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.377+0000 7ff69c99a700 1 --2- 172.21.15.84:0/874993170 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff67c06b040 0x7ff67c06d4f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff6981f55f0 tx=0x7ff688008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:38.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.381+0000 7ff68dffb700 1 -- 172.21.15.84:0/874993170 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ff694055ca0 con 0x7ff69806b580 2023-07-14T11:17:38.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.575+0000 7ff69f3ff700 1 -- 172.21.15.84:0/874993170 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff69815ceb0 con 0x7ff69806b580 2023-07-14T11:17:38.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.575+0000 7ff68dffb700 1 -- 172.21.15.84:0/874993170 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v63) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff69815ceb0 con 0x7ff69806b580 2023-07-14T11:17:38.578 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-07-14T11:17:38.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.577+0000 7ff69f3ff700 1 -- 172.21.15.84:0/874993170 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff67c06b040 msgr2=0x7ff67c06d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:38.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.577+0000 7ff69f3ff700 1 --2- 172.21.15.84:0/874993170 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff67c06b040 0x7ff67c06d4f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff6981f55f0 tx=0x7ff688008040 comp rx=0 tx=0).stop 2023-07-14T11:17:38.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.577+0000 7ff69f3ff700 1 -- 172.21.15.84:0/874993170 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff69806b580 msgr2=0x7ff698159b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:38.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.577+0000 7ff69f3ff700 1 --2- 172.21.15.84:0/874993170 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff69806b580 0x7ff698159b20 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7ff694000c00 tx=0x7ff694004750 comp rx=0 tx=0).stop 2023-07-14T11:17:38.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.577+0000 7ff69f3ff700 1 -- 172.21.15.84:0/874993170 shutdown_connections 2023-07-14T11:17:38.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.577+0000 7ff69f3ff700 1 --2- 172.21.15.84:0/874993170 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff67c06b040 0x7ff67c06d4f0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:38.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.577+0000 7ff69f3ff700 1 --2- 172.21.15.84:0/874993170 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6980d12c0 0x7ff6980b5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:38.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.577+0000 7ff69f3ff700 1 --2- 172.21.15.84:0/874993170 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff69806b580 0x7ff698159b20 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:38.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.577+0000 7ff69f3ff700 1 --2- 172.21.15.84:0/874993170 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6980cb330 0x7ff6981e6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:38.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.577+0000 7ff69f3ff700 1 -- 172.21.15.84:0/874993170 >> 172.21.15.84:0/874993170 conn(0x7ff6980999e0 msgr2=0x7ff6980d00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:38.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.577+0000 7ff69f3ff700 1 -- 172.21.15.84:0/874993170 shutdown_connections 2023-07-14T11:17:38.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.578+0000 7ff69f3ff700 1 -- 172.21.15.84:0/874993170 wait complete. 2023-07-14T11:17:38.597 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T11:17:38.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.793+0000 7f832b1ff700 1 Processor -- start 2023-07-14T11:17:38.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.793+0000 7f832b1ff700 1 -- start start 2023-07-14T11:17:38.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.794+0000 7f832b1ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f83240b12f0 0x7f83240ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:38.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.794+0000 7f832b1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83240adea0 0x7f83240cc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:38.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.794+0000 7f832b1ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f832415ce70 con 0x7f83240c92d0 2023-07-14T11:17:38.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.794+0000 7f832b1ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f832415da60 con 0x7f83240b12f0 2023-07-14T11:17:38.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.794+0000 7f832b1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f832415d0c0 con 0x7f83240adea0 2023-07-14T11:17:38.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.794+0000 7f8328f9b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f83240c92d0 0x7f83240c96a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52850/0 (socket says 172.21.15.84:52850) 2023-07-14T11:17:38.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.794+0000 7f8328f9b700 1 -- 172.21.15.84:0/834035798 learned_addr learned my addr 172.21.15.84:0/834035798 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:17:38.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.794+0000 7f8323fff700 1 --2- 172.21.15.84:0/834035798 >> v2:172.21.15.179:3300/0 conn(0x7f83240b12f0 0x7f83240ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:38.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.794+0000 7f832979c700 1 --2- 172.21.15.84:0/834035798 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83240adea0 0x7f83240cc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:38.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.795+0000 7f83237fe700 1 -- 172.21.15.84:0/834035798 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2151788841 0 0) 0x7f832415ce70 con 0x7f83240c92d0 2023-07-14T11:17:38.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.795+0000 7f83237fe700 1 -- 172.21.15.84:0/834035798 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83140035b0 con 0x7f83240c92d0 2023-07-14T11:17:38.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.795+0000 7f8323fff700 1 -- 172.21.15.84:0/834035798 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83240adea0 msgr2=0x7f83240cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:38.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.795+0000 7f8323fff700 1 --2- 172.21.15.84:0/834035798 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83240adea0 0x7f83240cc690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:38.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.795+0000 7f8323fff700 1 -- 172.21.15.84:0/834035798 >> v1:172.21.15.84:6789/0 conn(0x7f83240c92d0 legacy=0x7f83240c96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:38.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.795+0000 7f8323fff700 1 -- 172.21.15.84:0/834035798 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f832415d3a0 con 0x7f83240b12f0 2023-07-14T11:17:38.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.795+0000 7f8323fff700 1 --2- 172.21.15.84:0/834035798 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83240b12f0 0x7f83240ad8f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8310009840 tx=0x7f8310009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9395a1303ae5c8 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:38.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.795+0000 7f83237fe700 1 -- 172.21.15.84:0/834035798 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8310011830 con 0x7f83240b12f0 2023-07-14T11:17:38.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.796+0000 7f83237fe700 1 -- 172.21.15.84:0/834035798 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8310011990 con 0x7f83240b12f0 2023-07-14T11:17:38.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.796+0000 7f83237fe700 1 -- 172.21.15.84:0/834035798 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8310011d20 con 0x7f83240b12f0 2023-07-14T11:17:38.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.796+0000 7f832b1ff700 1 -- 172.21.15.84:0/834035798 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83240b12f0 msgr2=0x7f83240ad8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:38.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.796+0000 7f832b1ff700 1 --2- 172.21.15.84:0/834035798 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83240b12f0 0x7f83240ad8f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8310009840 tx=0x7f8310009b50 comp rx=0 tx=0).stop 2023-07-14T11:17:38.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.796+0000 7f832b1ff700 1 -- 172.21.15.84:0/834035798 shutdown_connections 2023-07-14T11:17:38.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.796+0000 7f832b1ff700 1 --2- 172.21.15.84:0/834035798 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83240adea0 0x7f83240cc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:38.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.796+0000 7f832b1ff700 1 --2- 172.21.15.84:0/834035798 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83240b12f0 0x7f83240ad8f0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:38.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.796+0000 7f832b1ff700 1 -- 172.21.15.84:0/834035798 >> 172.21.15.84:0/834035798 conn(0x7f83240b05d0 msgr2=0x7f83240b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:38.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.796+0000 7f832b1ff700 1 -- 172.21.15.84:0/834035798 shutdown_connections 2023-07-14T11:17:38.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.796+0000 7f832b1ff700 1 -- 172.21.15.84:0/834035798 wait complete. 2023-07-14T11:17:38.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.798+0000 7f832b1ff700 1 Processor -- start 2023-07-14T11:17:38.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.798+0000 7f832b1ff700 1 -- start start 2023-07-14T11:17:38.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.799+0000 7f832b1ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83240adea0 0x7f83240b18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:38.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.799+0000 7f832b1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83240b12f0 0x7f8324159910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:38.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.799+0000 7f832b1ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83240c92d0 0x7f83240cc270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:38.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.799+0000 7f832b1ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83240c6830 con 0x7f83240c92d0 2023-07-14T11:17:38.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.799+0000 7f832b1ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f832415a140 con 0x7f83240adea0 2023-07-14T11:17:38.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.799+0000 7f832b1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f832415a420 con 0x7f83240b12f0 2023-07-14T11:17:38.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.799+0000 7f832979c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83240c92d0 0x7f83240cc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:38.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.799+0000 7f832979c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83240c92d0 0x7f83240cc270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39868/0 (socket says 172.21.15.84:39868) 2023-07-14T11:17:38.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.799+0000 7f832979c700 1 -- 172.21.15.84:0/2821639818 learned_addr learned my addr 172.21.15.84:0/2821639818 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:38.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.799+0000 7f8328f9b700 1 --2- 172.21.15.84:0/2821639818 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83240adea0 0x7f83240b18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:38.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.799+0000 7f8323fff700 1 --2- 172.21.15.84:0/2821639818 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83240b12f0 0x7f8324159910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:38.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.800+0000 7f832979c700 1 -- 172.21.15.84:0/2821639818 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83240b12f0 msgr2=0x7f8324159910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:38.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.800+0000 7f832979c700 1 --2- 172.21.15.84:0/2821639818 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83240b12f0 0x7f8324159910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:38.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.800+0000 7f832979c700 1 -- 172.21.15.84:0/2821639818 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83240adea0 msgr2=0x7f83240b18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:38.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.800+0000 7f832979c700 1 --2- 172.21.15.84:0/2821639818 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83240adea0 0x7f83240b18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:38.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.800+0000 7f832979c700 1 -- 172.21.15.84:0/2821639818 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83100094a0 con 0x7f83240c92d0 2023-07-14T11:17:38.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.800+0000 7f832979c700 1 --2- 172.21.15.84:0/2821639818 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83240c92d0 0x7f83240cc270 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f831c00efc0 tx=0x7f831c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:38.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.800+0000 7f83217fa700 1 -- 172.21.15.84:0/2821639818 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831c00cd40 con 0x7f83240c92d0 2023-07-14T11:17:38.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.800+0000 7f83217fa700 1 -- 172.21.15.84:0/2821639818 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f831c00f040 con 0x7f83240c92d0 2023-07-14T11:17:38.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.800+0000 7f83217fa700 1 -- 172.21.15.84:0/2821639818 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831c0146c0 con 0x7f83240c92d0 2023-07-14T11:17:38.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.800+0000 7f832b1ff700 1 -- 172.21.15.84:0/2821639818 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83240c6ad0 con 0x7f83240c92d0 2023-07-14T11:17:38.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.800+0000 7f832b1ff700 1 -- 172.21.15.84:0/2821639818 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f832415a700 con 0x7f83240c92d0 2023-07-14T11:17:38.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.801+0000 7f832b1ff700 1 -- 172.21.15.84:0/2821639818 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83240c6cc0 con 0x7f83240c92d0 2023-07-14T11:17:38.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.802+0000 7f83217fa700 1 -- 172.21.15.84:0/2821639818 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7f831c014820 con 0x7f83240c92d0 2023-07-14T11:17:38.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.803+0000 7f83217fa700 1 --2- 172.21.15.84:0/2821639818 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f830806b040 0x7f830806d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:38.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.803+0000 7f83217fa700 1 -- 172.21.15.84:0/2821639818 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f831c08a470 con 0x7f83240c92d0 2023-07-14T11:17:38.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.804+0000 7f8328f9b700 1 --2- 172.21.15.84:0/2821639818 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f830806b040 0x7f830806d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:38.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.804+0000 7f8328f9b700 1 --2- 172.21.15.84:0/2821639818 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f830806b040 0x7f830806d4f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f83180011e0 tx=0x7f8318009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:38.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:38.807+0000 7f83217fa700 1 -- 172.21.15.84:0/2821639818 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f831c058a50 con 0x7f83240c92d0 2023-07-14T11:17:39.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.005+0000 7f832b1ff700 1 -- 172.21.15.84:0/2821639818 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8324074350 con 0x7f83240c92d0 2023-07-14T11:17:39.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.005+0000 7f83217fa700 1 -- 172.21.15.84:0/2821639818 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v63) v1 ==== 104+0+11 (secure 0 0 0) 0x7f831c00cea0 con 0x7f83240c92d0 2023-07-14T11:17:39.008 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-07-14T11:17:39.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.007+0000 7f832b1ff700 1 -- 172.21.15.84:0/2821639818 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f830806b040 msgr2=0x7f830806d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:39.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.007+0000 7f832b1ff700 1 --2- 172.21.15.84:0/2821639818 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f830806b040 0x7f830806d4f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f83180011e0 tx=0x7f8318009040 comp rx=0 tx=0).stop 2023-07-14T11:17:39.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.007+0000 7f832b1ff700 1 -- 172.21.15.84:0/2821639818 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83240c92d0 msgr2=0x7f83240cc270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:39.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.007+0000 7f832b1ff700 1 --2- 172.21.15.84:0/2821639818 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83240c92d0 0x7f83240cc270 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f831c00efc0 tx=0x7f831c00c3a0 comp rx=0 tx=0).stop 2023-07-14T11:17:39.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.007+0000 7f832b1ff700 1 -- 172.21.15.84:0/2821639818 shutdown_connections 2023-07-14T11:17:39.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.007+0000 7f832b1ff700 1 --2- 172.21.15.84:0/2821639818 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83240c92d0 0x7f83240cc270 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:39.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.007+0000 7f832b1ff700 1 --2- 172.21.15.84:0/2821639818 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83240adea0 0x7f83240b18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:39.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.007+0000 7f832b1ff700 1 --2- 172.21.15.84:0/2821639818 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f830806b040 0x7f830806d4f0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:39.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.007+0000 7f832b1ff700 1 --2- 172.21.15.84:0/2821639818 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83240b12f0 0x7f8324159910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:39.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.007+0000 7f832b1ff700 1 -- 172.21.15.84:0/2821639818 >> 172.21.15.84:0/2821639818 conn(0x7f83240b05d0 msgr2=0x7f83240c9e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:39.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.007+0000 7f832b1ff700 1 -- 172.21.15.84:0/2821639818 shutdown_connections 2023-07-14T11:17:39.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.008+0000 7f832b1ff700 1 -- 172.21.15.84:0/2821639818 wait complete. 2023-07-14T11:17:39.027 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T11:17:39.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.224+0000 7feac63ff700 1 Processor -- start 2023-07-14T11:17:39.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.224+0000 7feac63ff700 1 -- start start 2023-07-14T11:17:39.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.225+0000 7feac63ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7feac00d0b10 0x7feac00d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:39.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.225+0000 7feac63ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7feac00b0e20 0x7feac00b1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:39.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.225+0000 7feac63ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feac00b8e30 con 0x7feac00b8a60 2023-07-14T11:17:39.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.225+0000 7feac63ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feac00d14d0 con 0x7feac00b0e20 2023-07-14T11:17:39.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.225+0000 7feac63ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feac00afaa0 con 0x7feac00d0b10 2023-07-14T11:17:39.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.225+0000 7feabffff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7feac00b8a60 0x7feac00b3ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48910/0 (socket says 172.21.15.84:48910) 2023-07-14T11:17:39.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.225+0000 7feabffff700 1 -- 172.21.15.84:0/1064226989 learned_addr learned my addr 172.21.15.84:0/1064226989 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:17:39.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.225+0000 7feac499c700 1 --2- 172.21.15.84:0/1064226989 >> v2:172.21.15.84:3300/0 conn(0x7feac00b0e20 0x7feac00b1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:39.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.226+0000 7feabeffd700 1 -- 172.21.15.84:0/1064226989 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3296036608 0 0) 0x7feac00b8e30 con 0x7feac00b8a60 2023-07-14T11:17:39.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.226+0000 7feabf7fe700 1 --2- 172.21.15.84:0/1064226989 >> v2:172.21.15.179:3300/0 conn(0x7feac00d0b10 0x7feac00d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:39.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.226+0000 7feabeffd700 1 -- 172.21.15.84:0/1064226989 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feaa80035b0 con 0x7feac00b8a60 2023-07-14T11:17:39.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.226+0000 7feac499c700 1 -- 172.21.15.84:0/1064226989 >> v2:172.21.15.179:3300/0 conn(0x7feac00d0b10 msgr2=0x7feac00d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:39.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.226+0000 7feac499c700 1 --2- 172.21.15.84:0/1064226989 >> v2:172.21.15.179:3300/0 conn(0x7feac00d0b10 0x7feac00d0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:39.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.226+0000 7feac499c700 1 -- 172.21.15.84:0/1064226989 >> v1:172.21.15.84:6789/0 conn(0x7feac00b8a60 legacy=0x7feac00b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:39.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.226+0000 7feac499c700 1 -- 172.21.15.84:0/1064226989 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feac00afd80 con 0x7feac00b0e20 2023-07-14T11:17:39.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.226+0000 7feabf7fe700 1 --2- 172.21.15.84:0/1064226989 >> v2:172.21.15.179:3300/0 conn(0x7feac00d0b10 0x7feac00d0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:17:39.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.226+0000 7feac499c700 1 --2- 172.21.15.84:0/1064226989 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feac00b0e20 0x7feac00b1260 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7feac009c8e0 tx=0x7feab800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4605ea7144aee616 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:39.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.226+0000 7feabeffd700 1 -- 172.21.15.84:0/1064226989 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab800e070 con 0x7feac00b0e20 2023-07-14T11:17:39.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.226+0000 7feabeffd700 1 -- 172.21.15.84:0/1064226989 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feab800bb20 con 0x7feac00b0e20 2023-07-14T11:17:39.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.226+0000 7feabeffd700 1 -- 172.21.15.84:0/1064226989 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab8012430 con 0x7feac00b0e20 2023-07-14T11:17:39.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.227+0000 7feac63ff700 1 -- 172.21.15.84:0/1064226989 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feac00b0e20 msgr2=0x7feac00b1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:39.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.227+0000 7feac63ff700 1 --2- 172.21.15.84:0/1064226989 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feac00b0e20 0x7feac00b1260 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7feac009c8e0 tx=0x7feab800b330 comp rx=0 tx=0).stop 2023-07-14T11:17:39.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.227+0000 7feac63ff700 1 -- 172.21.15.84:0/1064226989 shutdown_connections 2023-07-14T11:17:39.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.227+0000 7feac63ff700 1 --2- 172.21.15.84:0/1064226989 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feac00b0e20 0x7feac00b1260 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:39.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.227+0000 7feac63ff700 1 --2- 172.21.15.84:0/1064226989 >> v2:172.21.15.179:3300/0 conn(0x7feac00d0b10 0x7feac00d0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:39.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.227+0000 7feac63ff700 1 -- 172.21.15.84:0/1064226989 >> 172.21.15.84:0/1064226989 conn(0x7feac009c1b0 msgr2=0x7feac00d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:39.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.227+0000 7feac63ff700 1 -- 172.21.15.84:0/1064226989 shutdown_connections 2023-07-14T11:17:39.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.227+0000 7feac63ff700 1 -- 172.21.15.84:0/1064226989 wait complete. 2023-07-14T11:17:39.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.229+0000 7feac63ff700 1 Processor -- start 2023-07-14T11:17:39.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.229+0000 7feac63ff700 1 -- start start 2023-07-14T11:17:39.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.230+0000 7feac63ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feac00b0e20 0x7feac015d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:39.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.230+0000 7feac63ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feac00b8a60 0x7feac00c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:39.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.230+0000 7feac63ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feac00d0b10 0x7feac0159710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:39.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.230+0000 7feac63ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feac00c6ba0 con 0x7feac00b0e20 2023-07-14T11:17:39.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.230+0000 7feac63ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feac00c89e0 con 0x7feac00b8a60 2023-07-14T11:17:39.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.230+0000 7feac63ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feac015d570 con 0x7feac00d0b10 2023-07-14T11:17:39.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.230+0000 7feabffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feac00b0e20 0x7feac015d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:39.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.230+0000 7feabffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feac00b0e20 0x7feac015d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44648/0 (socket says 172.21.15.84:44648) 2023-07-14T11:17:39.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.230+0000 7feabffff700 1 -- 172.21.15.84:0/860678027 learned_addr learned my addr 172.21.15.84:0/860678027 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:39.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.230+0000 7feabf7fe700 1 --2- 172.21.15.84:0/860678027 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feac00b8a60 0x7feac00c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:39.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.230+0000 7feac499c700 1 --2- 172.21.15.84:0/860678027 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feac00d0b10 0x7feac0159710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:39.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.231+0000 7feabffff700 1 -- 172.21.15.84:0/860678027 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feac00d0b10 msgr2=0x7feac0159710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:39.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.231+0000 7feabffff700 1 --2- 172.21.15.84:0/860678027 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feac00d0b10 0x7feac0159710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:39.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.231+0000 7feabffff700 1 -- 172.21.15.84:0/860678027 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feac00b8a60 msgr2=0x7feac00c8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:39.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.231+0000 7feabffff700 1 --2- 172.21.15.84:0/860678027 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feac00b8a60 0x7feac00c8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:39.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.231+0000 7feabffff700 1 -- 172.21.15.84:0/860678027 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab8009a70 con 0x7feac00b0e20 2023-07-14T11:17:39.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.231+0000 7feabf7fe700 1 --2- 172.21.15.84:0/860678027 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feac00b8a60 0x7feac00c8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:17:39.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.231+0000 7feabffff700 1 --2- 172.21.15.84:0/860678027 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feac00b0e20 0x7feac015d030 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7feab000c730 tx=0x7feab000caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:39.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.231+0000 7feabcff9700 1 -- 172.21.15.84:0/860678027 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab0005d70 con 0x7feac00b0e20 2023-07-14T11:17:39.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.231+0000 7feabcff9700 1 -- 172.21.15.84:0/860678027 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feab00070d0 con 0x7feac00b0e20 2023-07-14T11:17:39.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.231+0000 7feac63ff700 1 -- 172.21.15.84:0/860678027 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feac015fd60 con 0x7feac00b0e20 2023-07-14T11:17:39.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.231+0000 7feabcff9700 1 -- 172.21.15.84:0/860678027 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab0007440 con 0x7feac00b0e20 2023-07-14T11:17:39.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.231+0000 7feac63ff700 1 -- 172.21.15.84:0/860678027 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feac00c8670 con 0x7feac00b0e20 2023-07-14T11:17:39.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.232+0000 7feac63ff700 1 -- 172.21.15.84:0/860678027 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feac00d0960 con 0x7feac00b0e20 2023-07-14T11:17:39.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.233+0000 7feabcff9700 1 -- 172.21.15.84:0/860678027 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7feab00075a0 con 0x7feac00b0e20 2023-07-14T11:17:39.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.235+0000 7feabcff9700 1 --2- 172.21.15.84:0/860678027 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7feaac06b040 0x7feaac06d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:39.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.235+0000 7feabcff9700 1 -- 172.21.15.84:0/860678027 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6062+0+0 (secure 0 0 0) 0x7feab0088ec0 con 0x7feac00b0e20 2023-07-14T11:17:39.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.235+0000 7feabf7fe700 1 --2- 172.21.15.84:0/860678027 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7feaac06b040 0x7feaac06d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:39.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.235+0000 7feabf7fe700 1 --2- 172.21.15.84:0/860678027 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7feaac06b040 0x7feaac06d4f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7feab4006fd0 tx=0x7feab4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:39.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.239+0000 7feabcff9700 1 -- 172.21.15.84:0/860678027 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7feab0053b60 con 0x7feac00b0e20 2023-07-14T11:17:39.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.435+0000 7feac63ff700 1 -- 172.21.15.84:0/860678027 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7feac00c8cc0 con 0x7feac00b0e20 2023-07-14T11:17:39.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.436+0000 7feabcff9700 1 -- 172.21.15.84:0/860678027 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v63) v1 ==== 100+0+11 (secure 0 0 0) 0x7feab0057180 con 0x7feac00b0e20 2023-07-14T11:17:39.438 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-07-14T11:17:39.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.438+0000 7feac63ff700 1 -- 172.21.15.84:0/860678027 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7feaac06b040 msgr2=0x7feaac06d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:39.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.438+0000 7feac63ff700 1 --2- 172.21.15.84:0/860678027 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7feaac06b040 0x7feaac06d4f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7feab4006fd0 tx=0x7feab4008040 comp rx=0 tx=0).stop 2023-07-14T11:17:39.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.438+0000 7feac63ff700 1 -- 172.21.15.84:0/860678027 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feac00b0e20 msgr2=0x7feac015d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:39.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.438+0000 7feac63ff700 1 --2- 172.21.15.84:0/860678027 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feac00b0e20 0x7feac015d030 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7feab000c730 tx=0x7feab000caf0 comp rx=0 tx=0).stop 2023-07-14T11:17:39.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.438+0000 7feac63ff700 1 -- 172.21.15.84:0/860678027 shutdown_connections 2023-07-14T11:17:39.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.438+0000 7feac63ff700 1 --2- 172.21.15.84:0/860678027 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7feaac06b040 0x7feaac06d4f0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:39.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.438+0000 7feac63ff700 1 --2- 172.21.15.84:0/860678027 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feac00d0b10 0x7feac0159710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:39.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.438+0000 7feac63ff700 1 --2- 172.21.15.84:0/860678027 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feac00b0e20 0x7feac015d030 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:39.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.438+0000 7feac63ff700 1 --2- 172.21.15.84:0/860678027 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feac00b8a60 0x7feac00c8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:39.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.438+0000 7feac63ff700 1 -- 172.21.15.84:0/860678027 >> 172.21.15.84:0/860678027 conn(0x7feac009c1b0 msgr2=0x7feac00b5d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:39.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.438+0000 7feac63ff700 1 -- 172.21.15.84:0/860678027 shutdown_connections 2023-07-14T11:17:39.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.438+0000 7feac63ff700 1 -- 172.21.15.84:0/860678027 wait complete. 2023-07-14T11:17:39.458 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T11:17:39.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.652+0000 7f5831dff700 1 Processor -- start 2023-07-14T11:17:39.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.652+0000 7f5831dff700 1 -- start start 2023-07-14T11:17:39.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.653+0000 7f5831dff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f582c15c950 0x7f582c0b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:39.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.653+0000 7f5831dff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f582c0b1e00 0x7f582c0d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:39.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.653+0000 7f5831dff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f582c0d2ce0 con 0x7f582c0b2350 2023-07-14T11:17:39.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.653+0000 7f5831dff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f582c0b3350 con 0x7f582c0b1e00 2023-07-14T11:17:39.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.653+0000 7f5831dff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f582c0b3630 con 0x7f582c15c950 2023-07-14T11:17:39.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.654+0000 7f582affd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f582c0b1e00 0x7f582c0d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:39.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.654+0000 7f582affd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f582c0b1e00 0x7f582c0d0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44660/0 (socket says 172.21.15.84:44660) 2023-07-14T11:17:39.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.654+0000 7f582affd700 1 -- 172.21.15.84:0/4024878027 learned_addr learned my addr 172.21.15.84:0/4024878027 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:39.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.654+0000 7f582b7fe700 1 --2- 172.21.15.84:0/4024878027 >> v2:172.21.15.179:3300/0 conn(0x7f582c15c950 0x7f582c0b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:39.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.654+0000 7f582affd700 1 -- 172.21.15.84:0/4024878027 >> v2:172.21.15.179:3300/0 conn(0x7f582c15c950 msgr2=0x7f582c0b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:39.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.654+0000 7f582affd700 1 --2- 172.21.15.84:0/4024878027 >> v2:172.21.15.179:3300/0 conn(0x7f582c15c950 0x7f582c0b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:39.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.654+0000 7f582affd700 1 -- 172.21.15.84:0/4024878027 >> v1:172.21.15.179:6789/0 conn(0x7f582c0b2350 legacy=0x7f582c0afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:39.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.654+0000 7f582affd700 1 -- 172.21.15.84:0/4024878027 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f582c0b3910 con 0x7f582c0b1e00 2023-07-14T11:17:39.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.654+0000 7f582affd700 1 --2- 172.21.15.84:0/4024878027 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f582c0b1e00 0x7f582c0d0b10 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f582c08d170 tx=0x7f5820009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69aea6716ba9e5f5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:39.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.655+0000 7f582a7fc700 1 -- 172.21.15.84:0/4024878027 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5820011830 con 0x7f582c0b1e00 2023-07-14T11:17:39.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.655+0000 7f582a7fc700 1 -- 172.21.15.84:0/4024878027 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5820011990 con 0x7f582c0b1e00 2023-07-14T11:17:39.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.655+0000 7f582a7fc700 1 -- 172.21.15.84:0/4024878027 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5820011d20 con 0x7f582c0b1e00 2023-07-14T11:17:39.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.655+0000 7f5831dff700 1 -- 172.21.15.84:0/4024878027 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f582c0b1e00 msgr2=0x7f582c0d0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:39.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.655+0000 7f5831dff700 1 --2- 172.21.15.84:0/4024878027 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f582c0b1e00 0x7f582c0d0b10 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f582c08d170 tx=0x7f5820009bd0 comp rx=0 tx=0).stop 2023-07-14T11:17:39.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.655+0000 7f5831dff700 1 -- 172.21.15.84:0/4024878027 shutdown_connections 2023-07-14T11:17:39.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.655+0000 7f5831dff700 1 --2- 172.21.15.84:0/4024878027 >> v2:172.21.15.179:3300/0 conn(0x7f582c15c950 0x7f582c0b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:39.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.655+0000 7f5831dff700 1 --2- 172.21.15.84:0/4024878027 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f582c0b1e00 0x7f582c0d0b10 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:39.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.655+0000 7f5831dff700 1 -- 172.21.15.84:0/4024878027 >> 172.21.15.84:0/4024878027 conn(0x7f582c09c1d0 msgr2=0x7f582c0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:39.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.655+0000 7f5831dff700 1 -- 172.21.15.84:0/4024878027 shutdown_connections 2023-07-14T11:17:39.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.655+0000 7f5831dff700 1 -- 172.21.15.84:0/4024878027 wait complete. 2023-07-14T11:17:39.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.657+0000 7f5831dff700 1 Processor -- start 2023-07-14T11:17:39.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.657+0000 7f5831dff700 1 -- start start 2023-07-14T11:17:39.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.658+0000 7f5831dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f582c0b1e00 0x7f582c0b7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:39.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.658+0000 7f5831dff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f582c0b2350 0x7f582c14e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:39.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.658+0000 7f5831dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f582c15c950 0x7f582c14e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:39.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.658+0000 7f5831dff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f582c0c8dc0 con 0x7f582c0b2350 2023-07-14T11:17:39.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.658+0000 7f5831dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f582c0c6a70 con 0x7f582c0b1e00 2023-07-14T11:17:39.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.658+0000 7f5831dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f582c0c75f0 con 0x7f582c15c950 2023-07-14T11:17:39.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.658+0000 7f582affd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f582c0b2350 0x7f582c14e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:39.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.658+0000 7f582affd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f582c0b2350 0x7f582c14e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44674/0 (socket says 172.21.15.84:44674) 2023-07-14T11:17:39.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.658+0000 7f582affd700 1 -- 172.21.15.84:0/258189121 learned_addr learned my addr 172.21.15.84:0/258189121 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:39.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.659+0000 7f582b7fe700 1 --2- 172.21.15.84:0/258189121 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f582c0b1e00 0x7f582c0b7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:39.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.659+0000 7f582bfff700 1 --2- 172.21.15.84:0/258189121 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f582c15c950 0x7f582c14e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:39.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.659+0000 7f582affd700 1 -- 172.21.15.84:0/258189121 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f582c15c950 msgr2=0x7f582c14e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:39.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.659+0000 7f582affd700 1 --2- 172.21.15.84:0/258189121 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f582c15c950 0x7f582c14e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:39.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.659+0000 7f582affd700 1 -- 172.21.15.84:0/258189121 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f582c0b1e00 msgr2=0x7f582c0b7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:39.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.659+0000 7f582affd700 1 --2- 172.21.15.84:0/258189121 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f582c0b1e00 0x7f582c0b7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:39.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.659+0000 7f582affd700 1 -- 172.21.15.84:0/258189121 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5820009550 con 0x7f582c0b2350 2023-07-14T11:17:39.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.659+0000 7f582b7fe700 1 --2- 172.21.15.84:0/258189121 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f582c0b1e00 0x7f582c0b7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:17:39.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.659+0000 7f582affd700 1 --2- 172.21.15.84:0/258189121 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f582c0b2350 0x7f582c14e070 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f582c0673b0 tx=0x7f5820004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:39.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.659+0000 7f5813fff700 1 -- 172.21.15.84:0/258189121 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5820004480 con 0x7f582c0b2350 2023-07-14T11:17:39.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.659+0000 7f5813fff700 1 -- 172.21.15.84:0/258189121 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f582001f070 con 0x7f582c0b2350 2023-07-14T11:17:39.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.659+0000 7f5813fff700 1 -- 172.21.15.84:0/258189121 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58200038e0 con 0x7f582c0b2350 2023-07-14T11:17:39.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.659+0000 7f5831dff700 1 -- 172.21.15.84:0/258189121 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f582c0c6cc0 con 0x7f582c0b2350 2023-07-14T11:17:39.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.659+0000 7f5831dff700 1 -- 172.21.15.84:0/258189121 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f582c0c7280 con 0x7f582c0b2350 2023-07-14T11:17:39.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.660+0000 7f5831dff700 1 -- 172.21.15.84:0/258189121 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f582c04e280 con 0x7f582c0b2350 2023-07-14T11:17:39.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.661+0000 7f5813fff700 1 -- 172.21.15.84:0/258189121 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7f5820021030 con 0x7f582c0b2350 2023-07-14T11:17:39.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.662+0000 7f5813fff700 1 --2- 172.21.15.84:0/258189121 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f581806b040 0x7f581806d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:39.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.662+0000 7f5813fff700 1 -- 172.21.15.84:0/258189121 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f582008aeb0 con 0x7f582c0b2350 2023-07-14T11:17:39.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.662+0000 7f582b7fe700 1 --2- 172.21.15.84:0/258189121 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f581806b040 0x7f581806d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:39.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.663+0000 7f582b7fe700 1 --2- 172.21.15.84:0/258189121 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f581806b040 0x7f581806d4f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f582c0aff10 tx=0x7f581c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:39.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.666+0000 7f5813fff700 1 -- 172.21.15.84:0/258189121 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f5820055ba0 con 0x7f582c0b2350 2023-07-14T11:17:39.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.906+0000 7f5831dff700 1 -- 172.21.15.84:0/258189121 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f582c0c7730 con 0x7f582c0b2350 2023-07-14T11:17:39.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.907+0000 7f5813fff700 1 -- 172.21.15.84:0/258189121 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4716 (secure 0 0 0) 0x7f58200591c0 con 0x7f582c0b2350 2023-07-14T11:17:39.910 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:17:39.910 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":38,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5342,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/2977703024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2977703024},{"type":"v1","addr":"172.21.15.179:6834","nonce":2977703024}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31},{"gid":5351,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/2068020315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":2068020315},{"type":"v1","addr":"172.21.15.84:6837","nonce":2068020315}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32},{"gid":5914,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/2441649918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2441649918},{"type":"v1","addr":"172.21.15.84:6836","nonce":2441649918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T11:17:12.547835+0000","modified":"2023-07-14T11:17:16.095092+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6174},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6174":{"gid":6174,"name":"d","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/3902238230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":3902238230},{"type":"v1","addr":"172.21.15.179:6835","nonce":3902238230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-07-14T11:17:39.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.909+0000 7f5831dff700 1 -- 172.21.15.84:0/258189121 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f581806b040 msgr2=0x7f581806d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:39.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.909+0000 7f5831dff700 1 --2- 172.21.15.84:0/258189121 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f581806b040 0x7f581806d4f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f582c0aff10 tx=0x7f581c008040 comp rx=0 tx=0).stop 2023-07-14T11:17:39.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.909+0000 7f5831dff700 1 -- 172.21.15.84:0/258189121 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f582c0b2350 msgr2=0x7f582c14e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:39.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.909+0000 7f5831dff700 1 --2- 172.21.15.84:0/258189121 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f582c0b2350 0x7f582c14e070 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f582c0673b0 tx=0x7f5820004750 comp rx=0 tx=0).stop 2023-07-14T11:17:39.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.909+0000 7f5831dff700 1 -- 172.21.15.84:0/258189121 shutdown_connections 2023-07-14T11:17:39.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.909+0000 7f5831dff700 1 --2- 172.21.15.84:0/258189121 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f581806b040 0x7f581806d4f0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:39.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.909+0000 7f5831dff700 1 --2- 172.21.15.84:0/258189121 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f582c15c950 0x7f582c14e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:39.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.909+0000 7f5831dff700 1 --2- 172.21.15.84:0/258189121 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f582c0b1e00 0x7f582c0b7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:39.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.909+0000 7f5831dff700 1 --2- 172.21.15.84:0/258189121 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f582c0b2350 0x7f582c14e070 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:39.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.909+0000 7f5831dff700 1 -- 172.21.15.84:0/258189121 >> 172.21.15.84:0/258189121 conn(0x7f582c09c1d0 msgr2=0x7f582c0b5280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:39.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.909+0000 7f5831dff700 1 -- 172.21.15.84:0/258189121 shutdown_connections 2023-07-14T11:17:39.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:39.909+0000 7f5831dff700 1 -- 172.21.15.84:0/258189121 wait complete. 2023-07-14T11:17:39.914 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 38 2023-07-14T11:17:39.930 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:17:40.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.123+0000 7f58f37ff700 1 Processor -- start 2023-07-14T11:17:40.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.124+0000 7f58f37ff700 1 -- start start 2023-07-14T11:17:40.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.125+0000 7f58f37ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f58ec0d1220 0x7f58ec0b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:40.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.125+0000 7f58f37ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f58ec0b1e00 0x7f58ec0afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:40.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.125+0000 7f58f37ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58ec0d2ce0 con 0x7f58ec15c950 2023-07-14T11:17:40.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.125+0000 7f58f37ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58ec0b3350 con 0x7f58ec0d1220 2023-07-14T11:17:40.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.125+0000 7f58f37ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58ec0b3630 con 0x7f58ec0b1e00 2023-07-14T11:17:40.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.125+0000 7f58f0d9a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f58ec0d1220 0x7f58ec0b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:40.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.125+0000 7f58f0d9a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f58ec0d1220 0x7f58ec0b43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44690/0 (socket says 172.21.15.84:44690) 2023-07-14T11:17:40.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.125+0000 7f58f0d9a700 1 -- 172.21.15.84:0/3196431613 learned_addr learned my addr 172.21.15.84:0/3196431613 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:40.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.125+0000 7f58f1d9c700 1 --2- 172.21.15.84:0/3196431613 >> v2:172.21.15.179:3300/0 conn(0x7f58ec0b1e00 0x7f58ec0afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:40.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.125+0000 7f58f0d9a700 1 -- 172.21.15.84:0/3196431613 >> v2:172.21.15.179:3300/0 conn(0x7f58ec0b1e00 msgr2=0x7f58ec0afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:40.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.125+0000 7f58f0d9a700 1 --2- 172.21.15.84:0/3196431613 >> v2:172.21.15.179:3300/0 conn(0x7f58ec0b1e00 0x7f58ec0afac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:40.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.125+0000 7f58f0d9a700 1 -- 172.21.15.84:0/3196431613 >> v1:172.21.15.84:6789/0 conn(0x7f58ec15c950 legacy=0x7f58ec0d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:40.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.125+0000 7f58f0d9a700 1 -- 172.21.15.84:0/3196431613 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58ec0b3910 con 0x7f58ec0d1220 2023-07-14T11:17:40.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.125+0000 7f58e3fff700 1 -- 172.21.15.84:0/3196431613 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1967362432 0 0) 0x7f58ec0d2ce0 con 0x7f58ec15c950 2023-07-14T11:17:40.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.125+0000 7f58f1d9c700 1 --2- 172.21.15.84:0/3196431613 >> v2:172.21.15.179:3300/0 conn(0x7f58ec0b1e00 0x7f58ec0afac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:17:40.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.126+0000 7f58f0d9a700 1 --2- 172.21.15.84:0/3196431613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58ec0d1220 0x7f58ec0b43f0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f58ec08c300 tx=0x7f58dc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f21653b367527b2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:40.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.126+0000 7f58e3fff700 1 -- 172.21.15.84:0/3196431613 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58dc00b870 con 0x7f58ec0d1220 2023-07-14T11:17:40.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.126+0000 7f58e3fff700 1 -- 172.21.15.84:0/3196431613 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58dc00b9d0 con 0x7f58ec0d1220 2023-07-14T11:17:40.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.126+0000 7f58e3fff700 1 -- 172.21.15.84:0/3196431613 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58dc00bd60 con 0x7f58ec0d1220 2023-07-14T11:17:40.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.126+0000 7f58f37ff700 1 -- 172.21.15.84:0/3196431613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58ec0d1220 msgr2=0x7f58ec0b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:40.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.126+0000 7f58f37ff700 1 --2- 172.21.15.84:0/3196431613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58ec0d1220 0x7f58ec0b43f0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f58ec08c300 tx=0x7f58dc009bd0 comp rx=0 tx=0).stop 2023-07-14T11:17:40.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.127+0000 7f58f37ff700 1 -- 172.21.15.84:0/3196431613 shutdown_connections 2023-07-14T11:17:40.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.127+0000 7f58f37ff700 1 --2- 172.21.15.84:0/3196431613 >> v2:172.21.15.179:3300/0 conn(0x7f58ec0b1e00 0x7f58ec0afac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:40.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.127+0000 7f58f37ff700 1 --2- 172.21.15.84:0/3196431613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58ec0d1220 0x7f58ec0b43f0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:40.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.127+0000 7f58f37ff700 1 -- 172.21.15.84:0/3196431613 >> 172.21.15.84:0/3196431613 conn(0x7f58ec09c1d0 msgr2=0x7f58ec0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:40.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.127+0000 7f58f37ff700 1 -- 172.21.15.84:0/3196431613 shutdown_connections 2023-07-14T11:17:40.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.127+0000 7f58f37ff700 1 -- 172.21.15.84:0/3196431613 wait complete. 2023-07-14T11:17:40.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.128+0000 7f58f37ff700 1 Processor -- start 2023-07-14T11:17:40.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.128+0000 7f58f37ff700 1 -- start start 2023-07-14T11:17:40.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.129+0000 7f58f37ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58ec0b1e00 0x7f58ec0b6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:40.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.129+0000 7f58f37ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58ec0d1220 0x7f58ec0cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:40.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.129+0000 7f58f37ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58ec15c950 0x7f58ec1f5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:40.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.129+0000 7f58f37ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58ec0b6d80 con 0x7f58ec0d1220 2023-07-14T11:17:40.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.129+0000 7f58f37ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58ec0c8db0 con 0x7f58ec15c950 2023-07-14T11:17:40.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.129+0000 7f58f37ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58ec0c9090 con 0x7f58ec0b1e00 2023-07-14T11:17:40.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.130+0000 7f58f0d9a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58ec0d1220 0x7f58ec0cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:40.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.130+0000 7f58f0d9a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58ec0d1220 0x7f58ec0cfe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44704/0 (socket says 172.21.15.84:44704) 2023-07-14T11:17:40.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.130+0000 7f58f0d9a700 1 -- 172.21.15.84:0/2522207511 learned_addr learned my addr 172.21.15.84:0/2522207511 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:40.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.130+0000 7f58f1d9c700 1 --2- 172.21.15.84:0/2522207511 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58ec15c950 0x7f58ec1f5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:40.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.130+0000 7f58f159b700 1 --2- 172.21.15.84:0/2522207511 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58ec0b1e00 0x7f58ec0b6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:40.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.130+0000 7f58f0d9a700 1 -- 172.21.15.84:0/2522207511 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58ec0b1e00 msgr2=0x7f58ec0b6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:40.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.130+0000 7f58f0d9a700 1 --2- 172.21.15.84:0/2522207511 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58ec0b1e00 0x7f58ec0b6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:40.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.130+0000 7f58f0d9a700 1 -- 172.21.15.84:0/2522207511 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58ec15c950 msgr2=0x7f58ec1f5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:40.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.130+0000 7f58f0d9a700 1 --2- 172.21.15.84:0/2522207511 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58ec15c950 0x7f58ec1f5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:40.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.130+0000 7f58f0d9a700 1 -- 172.21.15.84:0/2522207511 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58dc009550 con 0x7f58ec0d1220 2023-07-14T11:17:40.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.130+0000 7f58f0d9a700 1 --2- 172.21.15.84:0/2522207511 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58ec0d1220 0x7f58ec0cfe00 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f58dc009c10 tx=0x7f58dc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:40.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.130+0000 7f58e1ffb700 1 -- 172.21.15.84:0/2522207511 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58dc004310 con 0x7f58ec0d1220 2023-07-14T11:17:40.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.130+0000 7f58e1ffb700 1 -- 172.21.15.84:0/2522207511 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58dc01f070 con 0x7f58ec0d1220 2023-07-14T11:17:40.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.130+0000 7f58f37ff700 1 -- 172.21.15.84:0/2522207511 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58ec0c9370 con 0x7f58ec0d1220 2023-07-14T11:17:40.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.131+0000 7f58e1ffb700 1 -- 172.21.15.84:0/2522207511 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58dc0036a0 con 0x7f58ec0d1220 2023-07-14T11:17:40.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.131+0000 7f58f37ff700 1 -- 172.21.15.84:0/2522207511 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58ec1f5bb0 con 0x7f58ec0d1220 2023-07-14T11:17:40.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.132+0000 7f58f37ff700 1 -- 172.21.15.84:0/2522207511 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58ec04e280 con 0x7f58ec0d1220 2023-07-14T11:17:40.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.132+0000 7f58e1ffb700 1 -- 172.21.15.84:0/2522207511 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7f58dc021030 con 0x7f58ec0d1220 2023-07-14T11:17:40.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.133+0000 7f58e1ffb700 1 --2- 172.21.15.84:0/2522207511 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f58d006b040 0x7f58d006d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:40.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.133+0000 7f58e1ffb700 1 -- 172.21.15.84:0/2522207511 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f58dc08aea0 con 0x7f58ec0d1220 2023-07-14T11:17:40.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.134+0000 7f58f159b700 1 --2- 172.21.15.84:0/2522207511 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f58d006b040 0x7f58d006d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:40.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.134+0000 7f58f159b700 1 --2- 172.21.15.84:0/2522207511 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f58d006b040 0x7f58d006d4f0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f58e80016e0 tx=0x7f58e8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:40.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.137+0000 7f58e1ffb700 1 -- 172.21.15.84:0/2522207511 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f58dc055b90 con 0x7f58ec0d1220 2023-07-14T11:17:40.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.337+0000 7f58f37ff700 1 -- 172.21.15.84:0/2522207511 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f58ec0b5890 con 0x7f58ec0d1220 2023-07-14T11:17:40.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.338+0000 7f58e1ffb700 1 -- 172.21.15.84:0/2522207511 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+18269 (secure 0 0 0) 0x7f58dc0591b0 con 0x7f58ec0d1220 2023-07-14T11:17:40.341 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:17:40.341 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":63,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:17:14.075543+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-07-14T11:17:10.750697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-07-14T11:17:11.528893+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:17:40.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.340+0000 7f58f37ff700 1 -- 172.21.15.84:0/2522207511 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f58d006b040 msgr2=0x7f58d006d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:40.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.340+0000 7f58f37ff700 1 --2- 172.21.15.84:0/2522207511 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f58d006b040 0x7f58d006d4f0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f58e80016e0 tx=0x7f58e8009040 comp rx=0 tx=0).stop 2023-07-14T11:17:40.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.340+0000 7f58f37ff700 1 -- 172.21.15.84:0/2522207511 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58ec0d1220 msgr2=0x7f58ec0cfe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:40.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.340+0000 7f58f37ff700 1 --2- 172.21.15.84:0/2522207511 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58ec0d1220 0x7f58ec0cfe00 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f58dc009c10 tx=0x7f58dc004750 comp rx=0 tx=0).stop 2023-07-14T11:17:40.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.340+0000 7f58f37ff700 1 -- 172.21.15.84:0/2522207511 shutdown_connections 2023-07-14T11:17:40.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.340+0000 7f58f37ff700 1 --2- 172.21.15.84:0/2522207511 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f58d006b040 0x7f58d006d4f0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:40.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.340+0000 7f58f37ff700 1 --2- 172.21.15.84:0/2522207511 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58ec0b1e00 0x7f58ec0b6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:40.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.340+0000 7f58f37ff700 1 --2- 172.21.15.84:0/2522207511 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58ec15c950 0x7f58ec1f5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:40.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.340+0000 7f58f37ff700 1 --2- 172.21.15.84:0/2522207511 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58ec0d1220 0x7f58ec0cfe00 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:40.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.340+0000 7f58f37ff700 1 -- 172.21.15.84:0/2522207511 >> 172.21.15.84:0/2522207511 conn(0x7f58ec09c1d0 msgr2=0x7f58ec1585e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:40.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.340+0000 7f58f37ff700 1 -- 172.21.15.84:0/2522207511 shutdown_connections 2023-07-14T11:17:40.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.340+0000 7f58f37ff700 1 -- 172.21.15.84:0/2522207511 wait complete. 2023-07-14T11:17:40.361 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-14T11:17:40.361 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T11:17:40.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.554+0000 7f7bfa5ff700 1 Processor -- start 2023-07-14T11:17:40.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.555+0000 7f7bfa5ff700 1 -- start start 2023-07-14T11:17:40.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.556+0000 7f7bfa5ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7bf41500d0 0x7f7bf4070350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:40.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.556+0000 7f7bfa5ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7bf40cea50 0x7f7bf40ceeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:40.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.556+0000 7f7bfa5ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bf40cdf90 con 0x7f7bf4070890 2023-07-14T11:17:40.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.556+0000 7f7bfa5ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bf415a2f0 con 0x7f7bf41500d0 2023-07-14T11:17:40.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.556+0000 7f7bfa5ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bf415a5d0 con 0x7f7bf40cea50 2023-07-14T11:17:40.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.556+0000 7f7bf3fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7bf41500d0 0x7f7bf4070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:40.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.556+0000 7f7bf3fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7bf41500d0 0x7f7bf4070350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44714/0 (socket says 172.21.15.84:44714) 2023-07-14T11:17:40.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.556+0000 7f7bf37fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f7bf4070890 0x7f7bf41597c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48940/0 (socket says 172.21.15.84:48940) 2023-07-14T11:17:40.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.556+0000 7f7bf3fff700 1 -- 172.21.15.84:0/3941057552 learned_addr learned my addr 172.21.15.84:0/3941057552 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:40.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.557+0000 7f7bf8b9c700 1 --2- 172.21.15.84:0/3941057552 >> v2:172.21.15.179:3300/0 conn(0x7f7bf40cea50 0x7f7bf40ceeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:40.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.557+0000 7f7bf3fff700 1 -- 172.21.15.84:0/3941057552 >> v2:172.21.15.179:3300/0 conn(0x7f7bf40cea50 msgr2=0x7f7bf40ceeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:40.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.557+0000 7f7bf3fff700 1 --2- 172.21.15.84:0/3941057552 >> v2:172.21.15.179:3300/0 conn(0x7f7bf40cea50 0x7f7bf40ceeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:40.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.557+0000 7f7bf3fff700 1 -- 172.21.15.84:0/3941057552 >> v1:172.21.15.84:6789/0 conn(0x7f7bf4070890 legacy=0x7f7bf41597c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:40.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.557+0000 7f7bf2ffd700 1 -- 172.21.15.84:0/3941057552 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3296876464 0 0) 0x7f7bf40cdf90 con 0x7f7bf4070890 2023-07-14T11:17:40.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.557+0000 7f7bf3fff700 1 -- 172.21.15.84:0/3941057552 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf40ce250 con 0x7f7bf41500d0 2023-07-14T11:17:40.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.557+0000 7f7bf3fff700 1 --2- 172.21.15.84:0/3941057552 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7bf41500d0 0x7f7bf4070350 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f7bf406f670 tx=0x7f7be400be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a5ef7c53840197b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:40.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.557+0000 7f7bf2ffd700 1 -- 172.21.15.84:0/3941057552 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be400dd30 con 0x7f7bf41500d0 2023-07-14T11:17:40.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.557+0000 7f7bf2ffd700 1 -- 172.21.15.84:0/3941057552 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be400de90 con 0x7f7bf41500d0 2023-07-14T11:17:40.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.557+0000 7f7bf2ffd700 1 -- 172.21.15.84:0/3941057552 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be4010690 con 0x7f7bf41500d0 2023-07-14T11:17:40.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.558+0000 7f7bfa5ff700 1 -- 172.21.15.84:0/3941057552 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7bf41500d0 msgr2=0x7f7bf4070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:40.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.558+0000 7f7bfa5ff700 1 --2- 172.21.15.84:0/3941057552 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7bf41500d0 0x7f7bf4070350 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f7bf406f670 tx=0x7f7be400be70 comp rx=0 tx=0).stop 2023-07-14T11:17:40.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.558+0000 7f7bfa5ff700 1 -- 172.21.15.84:0/3941057552 shutdown_connections 2023-07-14T11:17:40.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.558+0000 7f7bfa5ff700 1 --2- 172.21.15.84:0/3941057552 >> v2:172.21.15.179:3300/0 conn(0x7f7bf40cea50 0x7f7bf40ceeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:40.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.558+0000 7f7bfa5ff700 1 --2- 172.21.15.84:0/3941057552 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7bf41500d0 0x7f7bf4070350 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:40.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.558+0000 7f7bfa5ff700 1 -- 172.21.15.84:0/3941057552 >> 172.21.15.84:0/3941057552 conn(0x7f7bf4069f30 msgr2=0x7f7bf406a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:40.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.558+0000 7f7bfa5ff700 1 -- 172.21.15.84:0/3941057552 shutdown_connections 2023-07-14T11:17:40.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.558+0000 7f7bfa5ff700 1 -- 172.21.15.84:0/3941057552 wait complete. 2023-07-14T11:17:40.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.559+0000 7f7bfa5ff700 1 Processor -- start 2023-07-14T11:17:40.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.560+0000 7f7bfa5ff700 1 -- start start 2023-07-14T11:17:40.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.560+0000 7f7bfa5ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7bf4070890 0x7f7bf413bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:40.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.561+0000 7f7bfa5ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7bf40cea50 0x7f7bf41e4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:40.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.561+0000 7f7bfa5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7bf41500d0 0x7f7bf41514a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:40.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.561+0000 7f7bfa5ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf4152b70 con 0x7f7bf4070890 2023-07-14T11:17:40.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.561+0000 7f7bfa5ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf413c240 con 0x7f7bf40cea50 2023-07-14T11:17:40.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.561+0000 7f7bfa5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf41e54b0 con 0x7f7bf41500d0 2023-07-14T11:17:40.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.561+0000 7f7bf3fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7bf4070890 0x7f7bf413bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:40.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.561+0000 7f7bf3fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7bf4070890 0x7f7bf413bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44720/0 (socket says 172.21.15.84:44720) 2023-07-14T11:17:40.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.561+0000 7f7bf3fff700 1 -- 172.21.15.84:0/3156581668 learned_addr learned my addr 172.21.15.84:0/3156581668 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:40.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.561+0000 7f7bf8b9c700 1 --2- 172.21.15.84:0/3156581668 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7bf41500d0 0x7f7bf41514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:40.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.561+0000 7f7bf37fe700 1 --2- 172.21.15.84:0/3156581668 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7bf40cea50 0x7f7bf41e4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:40.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.561+0000 7f7bf3fff700 1 -- 172.21.15.84:0/3156581668 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7bf41500d0 msgr2=0x7f7bf41514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:40.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.561+0000 7f7bf3fff700 1 --2- 172.21.15.84:0/3156581668 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7bf41500d0 0x7f7bf41514a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:40.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.561+0000 7f7bf3fff700 1 -- 172.21.15.84:0/3156581668 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7bf40cea50 msgr2=0x7f7bf41e4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:40.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.561+0000 7f7bf3fff700 1 --2- 172.21.15.84:0/3156581668 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7bf40cea50 0x7f7bf41e4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:40.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.561+0000 7f7bf3fff700 1 -- 172.21.15.84:0/3156581668 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be400b7f0 con 0x7f7bf4070890 2023-07-14T11:17:40.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.561+0000 7f7bf3fff700 1 --2- 172.21.15.84:0/3156581668 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7bf4070890 0x7f7bf413bd00 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f7be4000c00 tx=0x7f7be4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:40.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.562+0000 7f7bf0ff9700 1 -- 172.21.15.84:0/3156581668 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be401d070 con 0x7f7bf4070890 2023-07-14T11:17:40.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.562+0000 7f7bf0ff9700 1 -- 172.21.15.84:0/3156581668 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be4010620 con 0x7f7bf4070890 2023-07-14T11:17:40.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.562+0000 7f7bf0ff9700 1 -- 172.21.15.84:0/3156581668 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be4010c90 con 0x7f7bf4070890 2023-07-14T11:17:40.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.562+0000 7f7bfa5ff700 1 -- 172.21.15.84:0/3156581668 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bf4151f60 con 0x7f7bf4070890 2023-07-14T11:17:40.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.562+0000 7f7bfa5ff700 1 -- 172.21.15.84:0/3156581668 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bf4152520 con 0x7f7bf4070890 2023-07-14T11:17:40.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.563+0000 7f7bfa5ff700 1 -- 172.21.15.84:0/3156581668 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bf404e280 con 0x7f7bf4070890 2023-07-14T11:17:40.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.564+0000 7f7bf0ff9700 1 -- 172.21.15.84:0/3156581668 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7f7be40036a0 con 0x7f7bf4070890 2023-07-14T11:17:40.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.565+0000 7f7bf0ff9700 1 --2- 172.21.15.84:0/3156581668 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f7be006b040 0x7f7be006d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:40.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.565+0000 7f7bf0ff9700 1 -- 172.21.15.84:0/3156581668 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7be408b160 con 0x7f7bf4070890 2023-07-14T11:17:40.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.565+0000 7f7bf37fe700 1 --2- 172.21.15.84:0/3156581668 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f7be006b040 0x7f7be006d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:40.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.566+0000 7f7bf37fe700 1 --2- 172.21.15.84:0/3156581668 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f7be006b040 0x7f7be006d4f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f7bf41f56e0 tx=0x7f7be8007be0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:40.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.569+0000 7f7bf0ff9700 1 -- 172.21.15.84:0/3156581668 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7be4055c40 con 0x7f7bf4070890 2023-07-14T11:17:40.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.810+0000 7f7bfa5ff700 1 -- 172.21.15.84:0/3156581668 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7bf415a030 con 0x7f7bf4070890 2023-07-14T11:17:40.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.811+0000 7f7bf0ff9700 1 -- 172.21.15.84:0/3156581668 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4716 (secure 0 0 0) 0x7f7be4059260 con 0x7f7bf4070890 2023-07-14T11:17:40.814 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:17:40.814 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":38,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5342,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/2977703024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2977703024},{"type":"v1","addr":"172.21.15.179:6834","nonce":2977703024}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31},{"gid":5351,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/2068020315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":2068020315},{"type":"v1","addr":"172.21.15.84:6837","nonce":2068020315}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32},{"gid":5914,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/2441649918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2441649918},{"type":"v1","addr":"172.21.15.84:6836","nonce":2441649918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T11:17:12.547835+0000","modified":"2023-07-14T11:17:16.095092+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6174},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6174":{"gid":6174,"name":"d","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/3902238230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":3902238230},{"type":"v1","addr":"172.21.15.179:6835","nonce":3902238230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-07-14T11:17:40.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.813+0000 7f7bfa5ff700 1 -- 172.21.15.84:0/3156581668 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f7be006b040 msgr2=0x7f7be006d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:40.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.813+0000 7f7bfa5ff700 1 --2- 172.21.15.84:0/3156581668 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f7be006b040 0x7f7be006d4f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f7bf41f56e0 tx=0x7f7be8007be0 comp rx=0 tx=0).stop 2023-07-14T11:17:40.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.813+0000 7f7bfa5ff700 1 -- 172.21.15.84:0/3156581668 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7bf4070890 msgr2=0x7f7bf413bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:40.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.813+0000 7f7bfa5ff700 1 --2- 172.21.15.84:0/3156581668 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7bf4070890 0x7f7bf413bd00 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f7be4000c00 tx=0x7f7be4004750 comp rx=0 tx=0).stop 2023-07-14T11:17:40.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.813+0000 7f7bfa5ff700 1 -- 172.21.15.84:0/3156581668 shutdown_connections 2023-07-14T11:17:40.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.813+0000 7f7bfa5ff700 1 --2- 172.21.15.84:0/3156581668 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f7be006b040 0x7f7be006d4f0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:40.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.813+0000 7f7bfa5ff700 1 --2- 172.21.15.84:0/3156581668 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7bf41500d0 0x7f7bf41514a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:40.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.813+0000 7f7bfa5ff700 1 --2- 172.21.15.84:0/3156581668 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7bf4070890 0x7f7bf413bd00 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:40.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.813+0000 7f7bfa5ff700 1 --2- 172.21.15.84:0/3156581668 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7bf40cea50 0x7f7bf41e4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:40.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.813+0000 7f7bfa5ff700 1 -- 172.21.15.84:0/3156581668 >> 172.21.15.84:0/3156581668 conn(0x7f7bf4069f30 msgr2=0x7f7bf41597c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:40.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.814+0000 7f7bfa5ff700 1 -- 172.21.15.84:0/3156581668 shutdown_connections 2023-07-14T11:17:40.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:40.814+0000 7f7bfa5ff700 1 -- 172.21.15.84:0/3156581668 wait complete. 2023-07-14T11:17:40.818 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 38 2023-07-14T11:17:40.834 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T11:17:41.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.028+0000 7f7c693ff700 1 Processor -- start 2023-07-14T11:17:41.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.029+0000 7f7c693ff700 1 -- start start 2023-07-14T11:17:41.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.030+0000 7f7c693ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7c64160030 0x7f7c6406c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:41.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.030+0000 7f7c693ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c640b5cd0 0x7f7c640d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:41.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.030+0000 7f7c693ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c640d2cc0 con 0x7f7c640b1f70 2023-07-14T11:17:41.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.030+0000 7f7c693ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c640afbb0 con 0x7f7c64160030 2023-07-14T11:17:41.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.030+0000 7f7c693ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c640afe90 con 0x7f7c640b5cd0 2023-07-14T11:17:41.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.030+0000 7f7c637fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f7c640b1f70 0x7f7c6406a700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48942/0 (socket says 172.21.15.84:48942) 2023-07-14T11:17:41.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.030+0000 7f7c62ffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7c64160030 0x7f7c6406c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:41.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.030+0000 7f7c637fe700 1 -- 172.21.15.84:0/2594887890 learned_addr learned my addr 172.21.15.84:0/2594887890 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:17:41.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.030+0000 7f7c5bfff700 1 --2- 172.21.15.84:0/2594887890 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c640b5cd0 0x7f7c640d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:41.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.030+0000 7f7c627fc700 1 -- 172.21.15.84:0/2594887890 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2071474114 0 0) 0x7f7c640d2cc0 con 0x7f7c640b1f70 2023-07-14T11:17:41.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.030+0000 7f7c62ffd700 1 -- 172.21.15.84:0/2594887890 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c640b5cd0 msgr2=0x7f7c640d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:41.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.030+0000 7f7c62ffd700 1 --2- 172.21.15.84:0/2594887890 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c640b5cd0 0x7f7c640d0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:41.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.030+0000 7f7c62ffd700 1 -- 172.21.15.84:0/2594887890 >> v1:172.21.15.84:6789/0 conn(0x7f7c640b1f70 legacy=0x7f7c6406a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:41.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.030+0000 7f7c62ffd700 1 -- 172.21.15.84:0/2594887890 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c640b0170 con 0x7f7c64160030 2023-07-14T11:17:41.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.031+0000 7f7c5bfff700 1 --2- 172.21.15.84:0/2594887890 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c640b5cd0 0x7f7c640d0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:17:41.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.031+0000 7f7c62ffd700 1 --2- 172.21.15.84:0/2594887890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c64160030 0x7f7c6406c0f0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f7c54009840 tx=0x7f7c54009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cc85101d35bcfc1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:41.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.031+0000 7f7c627fc700 1 -- 172.21.15.84:0/2594887890 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c54011830 con 0x7f7c64160030 2023-07-14T11:17:41.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.031+0000 7f7c627fc700 1 -- 172.21.15.84:0/2594887890 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c54011990 con 0x7f7c64160030 2023-07-14T11:17:41.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.031+0000 7f7c627fc700 1 -- 172.21.15.84:0/2594887890 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c54011d20 con 0x7f7c64160030 2023-07-14T11:17:41.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.031+0000 7f7c693ff700 1 -- 172.21.15.84:0/2594887890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c64160030 msgr2=0x7f7c6406c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:41.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.031+0000 7f7c693ff700 1 --2- 172.21.15.84:0/2594887890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c64160030 0x7f7c6406c0f0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f7c54009840 tx=0x7f7c54009b50 comp rx=0 tx=0).stop 2023-07-14T11:17:41.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.032+0000 7f7c693ff700 1 -- 172.21.15.84:0/2594887890 shutdown_connections 2023-07-14T11:17:41.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.032+0000 7f7c693ff700 1 --2- 172.21.15.84:0/2594887890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c64160030 0x7f7c6406c0f0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:41.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.032+0000 7f7c693ff700 1 --2- 172.21.15.84:0/2594887890 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c640b5cd0 0x7f7c640d0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:41.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.032+0000 7f7c693ff700 1 -- 172.21.15.84:0/2594887890 >> 172.21.15.84:0/2594887890 conn(0x7f7c6409c190 msgr2=0x7f7c640d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:41.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.032+0000 7f7c693ff700 1 -- 172.21.15.84:0/2594887890 shutdown_connections 2023-07-14T11:17:41.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.032+0000 7f7c693ff700 1 -- 172.21.15.84:0/2594887890 wait complete. 2023-07-14T11:17:41.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.033+0000 7f7c693ff700 1 Processor -- start 2023-07-14T11:17:41.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.033+0000 7f7c693ff700 1 -- start start 2023-07-14T11:17:41.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.034+0000 7f7c693ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c640b1f70 0x7f7c641589c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:41.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.034+0000 7f7c693ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c640b5cd0 0x7f7c64155af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:41.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.034+0000 7f7c693ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c64160030 0x7f7c6415efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:41.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.034+0000 7f7c693ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6415f4e0 con 0x7f7c640b1f70 2023-07-14T11:17:41.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.034+0000 7f7c693ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c641561f0 con 0x7f7c64160030 2023-07-14T11:17:41.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.034+0000 7f7c693ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c640c8420 con 0x7f7c640b5cd0 2023-07-14T11:17:41.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.035+0000 7f7c62ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c640b1f70 0x7f7c641589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:41.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.035+0000 7f7c62ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c640b1f70 0x7f7c641589c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44734/0 (socket says 172.21.15.84:44734) 2023-07-14T11:17:41.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.035+0000 7f7c62ffd700 1 -- 172.21.15.84:0/1968434994 learned_addr learned my addr 172.21.15.84:0/1968434994 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:41.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.035+0000 7f7c5bfff700 1 --2- 172.21.15.84:0/1968434994 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c640b5cd0 0x7f7c64155af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:41.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.035+0000 7f7c637fe700 1 --2- 172.21.15.84:0/1968434994 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c64160030 0x7f7c6415efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:41.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.035+0000 7f7c62ffd700 1 -- 172.21.15.84:0/1968434994 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c640b5cd0 msgr2=0x7f7c64155af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:41.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.035+0000 7f7c62ffd700 1 --2- 172.21.15.84:0/1968434994 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c640b5cd0 0x7f7c64155af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:41.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.035+0000 7f7c62ffd700 1 -- 172.21.15.84:0/1968434994 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c64160030 msgr2=0x7f7c6415efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:41.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.035+0000 7f7c62ffd700 1 --2- 172.21.15.84:0/1968434994 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c64160030 0x7f7c6415efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:41.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.035+0000 7f7c62ffd700 1 -- 172.21.15.84:0/1968434994 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c540094a0 con 0x7f7c640b1f70 2023-07-14T11:17:41.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.035+0000 7f7c637fe700 1 --2- 172.21.15.84:0/1968434994 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c64160030 0x7f7c6415efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:17:41.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.035+0000 7f7c62ffd700 1 --2- 172.21.15.84:0/1968434994 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c640b1f70 0x7f7c641589c0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f7c54009b90 tx=0x7f7c54004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:41.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.036+0000 7f7c5b7fe700 1 -- 172.21.15.84:0/1968434994 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c540036a0 con 0x7f7c640b1f70 2023-07-14T11:17:41.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.036+0000 7f7c5b7fe700 1 -- 172.21.15.84:0/1968434994 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c5401e070 con 0x7f7c640b1f70 2023-07-14T11:17:41.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.036+0000 7f7c693ff700 1 -- 172.21.15.84:0/1968434994 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c640c8700 con 0x7f7c640b1f70 2023-07-14T11:17:41.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.036+0000 7f7c5b7fe700 1 -- 172.21.15.84:0/1968434994 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c54003a40 con 0x7f7c640b1f70 2023-07-14T11:17:41.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.036+0000 7f7c693ff700 1 -- 172.21.15.84:0/1968434994 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c640c8cc0 con 0x7f7c640b1f70 2023-07-14T11:17:41.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.037+0000 7f7c693ff700 1 -- 172.21.15.84:0/1968434994 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c640c8eb0 con 0x7f7c640b1f70 2023-07-14T11:17:41.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.038+0000 7f7c5b7fe700 1 -- 172.21.15.84:0/1968434994 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7f7c54003ba0 con 0x7f7c640b1f70 2023-07-14T11:17:41.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.038+0000 7f7c5b7fe700 1 --2- 172.21.15.84:0/1968434994 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f7c4406b040 0x7f7c4406d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:41.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.039+0000 7f7c5b7fe700 1 -- 172.21.15.84:0/1968434994 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7c5408a970 con 0x7f7c640b1f70 2023-07-14T11:17:41.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.039+0000 7f7c5bfff700 1 --2- 172.21.15.84:0/1968434994 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f7c4406b040 0x7f7c4406d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:41.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.039+0000 7f7c5bfff700 1 --2- 172.21.15.84:0/1968434994 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f7c4406b040 0x7f7c4406d4f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f7c640c9a00 tx=0x7f7c4c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:41.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.043+0000 7f7c5b7fe700 1 -- 172.21.15.84:0/1968434994 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7c54055660 con 0x7f7c640b1f70 2023-07-14T11:17:41.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.283+0000 7f7c693ff700 1 -- 172.21.15.84:0/1968434994 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7c6404e280 con 0x7f7c640b1f70 2023-07-14T11:17:41.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.283+0000 7f7c5b7fe700 1 -- 172.21.15.84:0/1968434994 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4716 (secure 0 0 0) 0x7f7c54020090 con 0x7f7c640b1f70 2023-07-14T11:17:41.286 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:17:41.286 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":38,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5342,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/2977703024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2977703024},{"type":"v1","addr":"172.21.15.179:6834","nonce":2977703024}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31},{"gid":5351,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/2068020315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":2068020315},{"type":"v1","addr":"172.21.15.84:6837","nonce":2068020315}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32},{"gid":5914,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/2441649918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2441649918},{"type":"v1","addr":"172.21.15.84:6836","nonce":2441649918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T11:17:12.547835+0000","modified":"2023-07-14T11:17:16.095092+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6174},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6174":{"gid":6174,"name":"d","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/3902238230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":3902238230},{"type":"v1","addr":"172.21.15.179:6835","nonce":3902238230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-07-14T11:17:41.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.285+0000 7f7c693ff700 1 -- 172.21.15.84:0/1968434994 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f7c4406b040 msgr2=0x7f7c4406d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:41.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.285+0000 7f7c693ff700 1 --2- 172.21.15.84:0/1968434994 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f7c4406b040 0x7f7c4406d4f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f7c640c9a00 tx=0x7f7c4c008040 comp rx=0 tx=0).stop 2023-07-14T11:17:41.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.285+0000 7f7c693ff700 1 -- 172.21.15.84:0/1968434994 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c640b1f70 msgr2=0x7f7c641589c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:41.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.285+0000 7f7c693ff700 1 --2- 172.21.15.84:0/1968434994 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c640b1f70 0x7f7c641589c0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f7c54009b90 tx=0x7f7c54004750 comp rx=0 tx=0).stop 2023-07-14T11:17:41.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.286+0000 7f7c693ff700 1 -- 172.21.15.84:0/1968434994 shutdown_connections 2023-07-14T11:17:41.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.286+0000 7f7c693ff700 1 --2- 172.21.15.84:0/1968434994 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c64160030 0x7f7c6415efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:41.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.286+0000 7f7c693ff700 1 --2- 172.21.15.84:0/1968434994 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c640b1f70 0x7f7c641589c0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:41.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.286+0000 7f7c693ff700 1 --2- 172.21.15.84:0/1968434994 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f7c4406b040 0x7f7c4406d4f0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:41.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.286+0000 7f7c693ff700 1 --2- 172.21.15.84:0/1968434994 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c640b5cd0 0x7f7c64155af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:41.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.286+0000 7f7c693ff700 1 -- 172.21.15.84:0/1968434994 >> 172.21.15.84:0/1968434994 conn(0x7f7c6409c190 msgr2=0x7f7c640d2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:41.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.286+0000 7f7c693ff700 1 -- 172.21.15.84:0/1968434994 shutdown_connections 2023-07-14T11:17:41.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.286+0000 7f7c693ff700 1 -- 172.21.15.84:0/1968434994 wait complete. 2023-07-14T11:17:41.290 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 38 2023-07-14T11:17:41.306 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:17:41.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.498+0000 7fc206bff700 1 Processor -- start 2023-07-14T11:17:41.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.499+0000 7fc206bff700 1 -- start start 2023-07-14T11:17:41.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.500+0000 7fc206bff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc2000cf510 0x7fc20006d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:41.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.500+0000 7fc206bff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc20006dda0 con 0x7fc20015c710 2023-07-14T11:17:41.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.500+0000 7fc206bff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2000cd320 con 0x7fc20006d960 2023-07-14T11:17:41.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.500+0000 7fc206bff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2000cf980 con 0x7fc2000cf510 2023-07-14T11:17:41.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.500+0000 7fc1fffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc2000cf510 0x7fc20006d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:41.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.500+0000 7fc20499b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fc20015c710 0x7fc200069f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48956/0 (socket says 172.21.15.84:48956) 2023-07-14T11:17:41.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.500+0000 7fc20499b700 1 -- 172.21.15.84:0/270007438 learned_addr learned my addr 172.21.15.84:0/270007438 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:17:41.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.500+0000 7fc1fffff700 1 -- 172.21.15.84:0/270007438 >> v1:172.21.15.179:6789/0 conn(0x7fc20006d960 legacy=0x7fc200070950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:41.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.500+0000 7fc1fffff700 1 -- 172.21.15.84:0/270007438 >> v1:172.21.15.84:6789/0 conn(0x7fc20015c710 legacy=0x7fc200069f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:41.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.500+0000 7fc1fffff700 1 -- 172.21.15.84:0/270007438 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2000ce750 con 0x7fc2000cf510 2023-07-14T11:17:41.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.501+0000 7fc1fffff700 1 --2- 172.21.15.84:0/270007438 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2000cf510 0x7fc20006d420 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec009840 tx=0x7fc1ec009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60cc3b907d85d4ce server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:41.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.501+0000 7fc1ff7fe700 1 -- 172.21.15.84:0/270007438 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ec004230 con 0x7fc2000cf510 2023-07-14T11:17:41.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.501+0000 7fc1ff7fe700 1 -- 172.21.15.84:0/270007438 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1ec004390 con 0x7fc2000cf510 2023-07-14T11:17:41.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.501+0000 7fc1ff7fe700 1 -- 172.21.15.84:0/270007438 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ec0036a0 con 0x7fc2000cf510 2023-07-14T11:17:41.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.501+0000 7fc206bff700 1 -- 172.21.15.84:0/270007438 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2000cf510 msgr2=0x7fc20006d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:41.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.501+0000 7fc206bff700 1 --2- 172.21.15.84:0/270007438 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2000cf510 0x7fc20006d420 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec009840 tx=0x7fc1ec009b50 comp rx=0 tx=0).stop 2023-07-14T11:17:41.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.501+0000 7fc206bff700 1 -- 172.21.15.84:0/270007438 shutdown_connections 2023-07-14T11:17:41.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.501+0000 7fc206bff700 1 --2- 172.21.15.84:0/270007438 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2000cf510 0x7fc20006d420 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:41.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.502+0000 7fc206bff700 1 -- 172.21.15.84:0/270007438 >> 172.21.15.84:0/270007438 conn(0x7fc2000b16c0 msgr2=0x7fc2000b1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:41.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.502+0000 7fc206bff700 1 -- 172.21.15.84:0/270007438 shutdown_connections 2023-07-14T11:17:41.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.502+0000 7fc206bff700 1 -- 172.21.15.84:0/270007438 wait complete. 2023-07-14T11:17:41.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.503+0000 7fc206bff700 1 Processor -- start 2023-07-14T11:17:41.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.503+0000 7fc206bff700 1 -- start start 2023-07-14T11:17:41.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.504+0000 7fc206bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc20006d960 0x7fc200151f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:41.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.504+0000 7fc206bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2000cf510 0x7fc20015e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:41.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.504+0000 7fc206bff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc20015e690 0x7fc200159570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:41.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.504+0000 7fc206bff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2001430a0 con 0x7fc20015e690 2023-07-14T11:17:41.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.504+0000 7fc206bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc20015eb30 con 0x7fc2000cf510 2023-07-14T11:17:41.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.504+0000 7fc206bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc200142d50 con 0x7fc20006d960 2023-07-14T11:17:41.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.504+0000 7fc20519c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc20015e690 0x7fc200159570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:41.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.505+0000 7fc20519c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc20015e690 0x7fc200159570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44746/0 (socket says 172.21.15.84:44746) 2023-07-14T11:17:41.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.505+0000 7fc20519c700 1 -- 172.21.15.84:0/4023067769 learned_addr learned my addr 172.21.15.84:0/4023067769 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:41.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.505+0000 7fc1fffff700 1 --2- 172.21.15.84:0/4023067769 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2000cf510 0x7fc20015e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:41.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.505+0000 7fc20499b700 1 --2- 172.21.15.84:0/4023067769 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc20006d960 0x7fc200151f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:41.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.505+0000 7fc20519c700 1 -- 172.21.15.84:0/4023067769 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc20006d960 msgr2=0x7fc200151f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:41.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.505+0000 7fc20519c700 1 --2- 172.21.15.84:0/4023067769 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc20006d960 0x7fc200151f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:41.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.505+0000 7fc20519c700 1 -- 172.21.15.84:0/4023067769 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2000cf510 msgr2=0x7fc20015e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:41.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.505+0000 7fc20519c700 1 --2- 172.21.15.84:0/4023067769 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2000cf510 0x7fc20015e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:41.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.505+0000 7fc20519c700 1 -- 172.21.15.84:0/4023067769 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1ec0094a0 con 0x7fc20015e690 2023-07-14T11:17:41.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.505+0000 7fc20499b700 1 --2- 172.21.15.84:0/4023067769 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc20006d960 0x7fc200151f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:17:41.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.505+0000 7fc20519c700 1 --2- 172.21.15.84:0/4023067769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc20015e690 0x7fc200159570 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fc1f800cc40 tx=0x7fc1f800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:41.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.505+0000 7fc1fd7fa700 1 -- 172.21.15.84:0/4023067769 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f800aba0 con 0x7fc20015e690 2023-07-14T11:17:41.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.505+0000 7fc1fd7fa700 1 -- 172.21.15.84:0/4023067769 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1f800ad00 con 0x7fc20015e690 2023-07-14T11:17:41.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.505+0000 7fc206bff700 1 -- 172.21.15.84:0/4023067769 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc20015a2e0 con 0x7fc20015e690 2023-07-14T11:17:41.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.506+0000 7fc1fd7fa700 1 -- 172.21.15.84:0/4023067769 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f8012660 con 0x7fc20015e690 2023-07-14T11:17:41.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.506+0000 7fc206bff700 1 -- 172.21.15.84:0/4023067769 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc20015a8a0 con 0x7fc20015e690 2023-07-14T11:17:41.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.507+0000 7fc206bff700 1 -- 172.21.15.84:0/4023067769 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2001431e0 con 0x7fc20015e690 2023-07-14T11:17:41.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.508+0000 7fc1fd7fa700 1 -- 172.21.15.84:0/4023067769 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7fc1f80127c0 con 0x7fc20015e690 2023-07-14T11:17:41.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.509+0000 7fc1fd7fa700 1 --2- 172.21.15.84:0/4023067769 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc1e406b070 0x7fc1e406d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:41.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.509+0000 7fc1fd7fa700 1 -- 172.21.15.84:0/4023067769 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc1f808a160 con 0x7fc20015e690 2023-07-14T11:17:41.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.509+0000 7fc20499b700 1 --2- 172.21.15.84:0/4023067769 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc1e406b070 0x7fc1e406d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:41.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.510+0000 7fc20499b700 1 --2- 172.21.15.84:0/4023067769 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc1e406b070 0x7fc1e406d520 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fc1f4000f60 tx=0x7fc1f4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:41.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.513+0000 7fc1fd7fa700 1 -- 172.21.15.84:0/4023067769 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fc2001431e0 con 0x7fc20015e690 2023-07-14T11:17:41.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.708+0000 7fc206bff700 1 -- 172.21.15.84:0/4023067769 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc2001431e0 con 0x7fc20015e690 2023-07-14T11:17:41.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.709+0000 7fc1fd7fa700 1 -- 172.21.15.84:0/4023067769 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+18269 (secure 0 0 0) 0x7fc2001431e0 con 0x7fc20015e690 2023-07-14T11:17:41.712 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:17:41.712 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":63,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:17:14.075543+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-07-14T11:17:10.750697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-07-14T11:17:11.528893+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:17:41.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.711+0000 7fc206bff700 1 -- 172.21.15.84:0/4023067769 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc1e406b070 msgr2=0x7fc1e406d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:41.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.711+0000 7fc206bff700 1 --2- 172.21.15.84:0/4023067769 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc1e406b070 0x7fc1e406d520 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fc1f4000f60 tx=0x7fc1f4009040 comp rx=0 tx=0).stop 2023-07-14T11:17:41.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.711+0000 7fc206bff700 1 -- 172.21.15.84:0/4023067769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc20015e690 msgr2=0x7fc200159570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:41.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.711+0000 7fc206bff700 1 --2- 172.21.15.84:0/4023067769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc20015e690 0x7fc200159570 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fc1f800cc40 tx=0x7fc1f800a060 comp rx=0 tx=0).stop 2023-07-14T11:17:41.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.712+0000 7fc206bff700 1 -- 172.21.15.84:0/4023067769 shutdown_connections 2023-07-14T11:17:41.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.712+0000 7fc206bff700 1 --2- 172.21.15.84:0/4023067769 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc1e406b070 0x7fc1e406d520 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:41.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.712+0000 7fc206bff700 1 --2- 172.21.15.84:0/4023067769 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc20006d960 0x7fc200151f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:41.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.712+0000 7fc206bff700 1 --2- 172.21.15.84:0/4023067769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc20015e690 0x7fc200159570 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:41.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.712+0000 7fc206bff700 1 --2- 172.21.15.84:0/4023067769 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2000cf510 0x7fc20015e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:41.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.712+0000 7fc206bff700 1 -- 172.21.15.84:0/4023067769 >> 172.21.15.84:0/4023067769 conn(0x7fc2000b16c0 msgr2=0x7fc200070bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:41.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.712+0000 7fc206bff700 1 -- 172.21.15.84:0/4023067769 shutdown_connections 2023-07-14T11:17:41.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.712+0000 7fc206bff700 1 -- 172.21.15.84:0/4023067769 wait complete. 2023-07-14T11:17:41.732 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-14T11:17:41.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.927+0000 7f683b9ff700 1 Processor -- start 2023-07-14T11:17:41.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.927+0000 7f683b9ff700 1 -- start start 2023-07-14T11:17:41.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.928+0000 7f683b9ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f68340b8660 0x7f68340cd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:41.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.928+0000 7f683b9ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f68340cd970 0x7f68340b4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:41.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.928+0000 7f683b9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68340b4da0 0x7f68341601f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:41.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.928+0000 7f683b9ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68340d02a0 con 0x7f68340cd970 2023-07-14T11:17:41.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.928+0000 7f683b9ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68340b51b0 con 0x7f68340b8660 2023-07-14T11:17:41.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.928+0000 7f683b9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68340cfce0 con 0x7f68340b4da0 2023-07-14T11:17:41.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.929+0000 7f6838f9a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f68340cd970 0x7f68340b4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:41.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.929+0000 7f6838f9a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f68340cd970 0x7f68340b4860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44758/0 (socket says 172.21.15.84:44758) 2023-07-14T11:17:41.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.929+0000 7f6838f9a700 1 -- 172.21.15.84:0/1685752355 learned_addr learned my addr 172.21.15.84:0/1685752355 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:41.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.929+0000 7f683979b700 1 --2- 172.21.15.84:0/1685752355 >> v2:172.21.15.179:3300/0 conn(0x7f68340b8660 0x7f68340cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:41.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.929+0000 7f6839f9c700 1 --2- 172.21.15.84:0/1685752355 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68340b4da0 0x7f68341601f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:41.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.929+0000 7f6838f9a700 1 -- 172.21.15.84:0/1685752355 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68340b4da0 msgr2=0x7f68341601f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:41.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.929+0000 7f6838f9a700 1 --2- 172.21.15.84:0/1685752355 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68340b4da0 0x7f68341601f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:41.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.929+0000 7f6838f9a700 1 -- 172.21.15.84:0/1685752355 >> v2:172.21.15.179:3300/0 conn(0x7f68340b8660 msgr2=0x7f68340cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:41.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.929+0000 7f6838f9a700 1 --2- 172.21.15.84:0/1685752355 >> v2:172.21.15.179:3300/0 conn(0x7f68340b8660 0x7f68340cd430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:41.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.929+0000 7f6838f9a700 1 -- 172.21.15.84:0/1685752355 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68340cffc0 con 0x7f68340cd970 2023-07-14T11:17:41.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.930+0000 7f6838f9a700 1 --2- 172.21.15.84:0/1685752355 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68340cd970 0x7f68340b4860 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f68340c9e60 tx=0x7f6824009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49573a66561a654f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:41.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.930+0000 7f682bfff700 1 -- 172.21.15.84:0/1685752355 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6824011830 con 0x7f68340cd970 2023-07-14T11:17:41.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.930+0000 7f682bfff700 1 -- 172.21.15.84:0/1685752355 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6824011990 con 0x7f68340cd970 2023-07-14T11:17:41.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.930+0000 7f682bfff700 1 -- 172.21.15.84:0/1685752355 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6824011d20 con 0x7f68340cd970 2023-07-14T11:17:41.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.930+0000 7f683b9ff700 1 -- 172.21.15.84:0/1685752355 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68340cd970 msgr2=0x7f68340b4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:41.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.930+0000 7f683b9ff700 1 --2- 172.21.15.84:0/1685752355 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68340cd970 0x7f68340b4860 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f68340c9e60 tx=0x7f6824009bd0 comp rx=0 tx=0).stop 2023-07-14T11:17:41.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.930+0000 7f683b9ff700 1 -- 172.21.15.84:0/1685752355 shutdown_connections 2023-07-14T11:17:41.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.930+0000 7f683b9ff700 1 --2- 172.21.15.84:0/1685752355 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68340b4da0 0x7f68341601f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:41.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.930+0000 7f683b9ff700 1 --2- 172.21.15.84:0/1685752355 >> v2:172.21.15.179:3300/0 conn(0x7f68340b8660 0x7f68340cd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:41.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.930+0000 7f683b9ff700 1 --2- 172.21.15.84:0/1685752355 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68340cd970 0x7f68340b4860 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:41.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.930+0000 7f683b9ff700 1 -- 172.21.15.84:0/1685752355 >> 172.21.15.84:0/1685752355 conn(0x7f6834066860 msgr2=0x7f683406a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:41.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.931+0000 7f683b9ff700 1 -- 172.21.15.84:0/1685752355 shutdown_connections 2023-07-14T11:17:41.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.931+0000 7f683b9ff700 1 -- 172.21.15.84:0/1685752355 wait complete. 2023-07-14T11:17:41.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.933+0000 7f683b9ff700 1 Processor -- start 2023-07-14T11:17:41.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.933+0000 7f683b9ff700 1 -- start start 2023-07-14T11:17:41.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.934+0000 7f683b9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68340b4da0 0x7f68341f54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:41.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.934+0000 7f683b9ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68340b8660 0x7f68341f2540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:41.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.934+0000 7f683b9ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68340cd970 0x7f68340c8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:41.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.934+0000 7f683b9ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68340cb940 con 0x7f68340b8660 2023-07-14T11:17:41.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.934+0000 7f683b9ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68340c8d20 con 0x7f68340cd970 2023-07-14T11:17:41.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.934+0000 7f683b9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68340cafa0 con 0x7f68340b4da0 2023-07-14T11:17:41.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.935+0000 7f6838f9a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68340b8660 0x7f68341f2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:41.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.935+0000 7f6838f9a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68340b8660 0x7f68341f2540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44768/0 (socket says 172.21.15.84:44768) 2023-07-14T11:17:41.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.935+0000 7f6838f9a700 1 -- 172.21.15.84:0/3784588876 learned_addr learned my addr 172.21.15.84:0/3784588876 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:41.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.935+0000 7f683979b700 1 --2- 172.21.15.84:0/3784588876 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68340b4da0 0x7f68341f54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:41.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.935+0000 7f6839f9c700 1 --2- 172.21.15.84:0/3784588876 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68340cd970 0x7f68340c8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:41.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.935+0000 7f6838f9a700 1 -- 172.21.15.84:0/3784588876 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68340b4da0 msgr2=0x7f68341f54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:41.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.935+0000 7f6838f9a700 1 --2- 172.21.15.84:0/3784588876 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68340b4da0 0x7f68341f54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:41.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.935+0000 7f6838f9a700 1 -- 172.21.15.84:0/3784588876 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68340cd970 msgr2=0x7f68340c8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:41.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.935+0000 7f6838f9a700 1 --2- 172.21.15.84:0/3784588876 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68340cd970 0x7f68340c8280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:41.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.935+0000 7f6838f9a700 1 -- 172.21.15.84:0/3784588876 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6824009550 con 0x7f68340b8660 2023-07-14T11:17:41.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.935+0000 7f6838f9a700 1 --2- 172.21.15.84:0/3784588876 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68340b8660 0x7f68341f2540 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f6824009c10 tx=0x7f6824004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:41.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.936+0000 7f6829ffb700 1 -- 172.21.15.84:0/3784588876 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6824004450 con 0x7f68340b8660 2023-07-14T11:17:41.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.936+0000 7f6829ffb700 1 -- 172.21.15.84:0/3784588876 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f682401e070 con 0x7f68340b8660 2023-07-14T11:17:41.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.936+0000 7f683b9ff700 1 -- 172.21.15.84:0/3784588876 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68340cb280 con 0x7f68340b8660 2023-07-14T11:17:41.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.936+0000 7f6829ffb700 1 -- 172.21.15.84:0/3784588876 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68240038e0 con 0x7f68340b8660 2023-07-14T11:17:41.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.936+0000 7f683b9ff700 1 -- 172.21.15.84:0/3784588876 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68341f2a80 con 0x7f68340b8660 2023-07-14T11:17:41.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.937+0000 7f683b9ff700 1 -- 172.21.15.84:0/3784588876 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68340ce6b0 con 0x7f68340b8660 2023-07-14T11:17:41.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.938+0000 7f6829ffb700 1 -- 172.21.15.84:0/3784588876 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7f6824003a40 con 0x7f68340b8660 2023-07-14T11:17:41.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.939+0000 7f6829ffb700 1 --2- 172.21.15.84:0/3784588876 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f681806b040 0x7f681806d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:41.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.939+0000 7f6829ffb700 1 -- 172.21.15.84:0/3784588876 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f682408a720 con 0x7f68340b8660 2023-07-14T11:17:41.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.939+0000 7f683979b700 1 --2- 172.21.15.84:0/3784588876 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f681806b040 0x7f681806d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:41.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.940+0000 7f683979b700 1 --2- 172.21.15.84:0/3784588876 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f681806b040 0x7f681806d4f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f6830009be0 tx=0x7f6830009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:41.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:41.944+0000 7f6829ffb700 1 -- 172.21.15.84:0/3784588876 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f68240553c0 con 0x7f68340b8660 2023-07-14T11:17:42.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:42.182+0000 7f683b9ff700 1 -- 172.21.15.84:0/3784588876 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f68341f2c10 con 0x7f68340b8660 2023-07-14T11:17:42.185 INFO:tasks.ceph.mon.a.smithi084.stderr:2023-07-14T11:17:42.183+0000 7f5e043f4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-14T11:17:42.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:42.191+0000 7f6829ffb700 1 -- 172.21.15.84:0/3784588876 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v39) v1 ==== 161+0+0 (secure 0 0 0) 0x7f682402c3b0 con 0x7f68340b8660 2023-07-14T11:17:42.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:42.194+0000 7f683b9ff700 1 -- 172.21.15.84:0/3784588876 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f681806b040 msgr2=0x7f681806d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:42.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:42.194+0000 7f683b9ff700 1 --2- 172.21.15.84:0/3784588876 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f681806b040 0x7f681806d4f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f6830009be0 tx=0x7f6830009210 comp rx=0 tx=0).stop 2023-07-14T11:17:42.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:42.194+0000 7f683b9ff700 1 -- 172.21.15.84:0/3784588876 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68340b8660 msgr2=0x7f68341f2540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:42.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:42.194+0000 7f683b9ff700 1 --2- 172.21.15.84:0/3784588876 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68340b8660 0x7f68341f2540 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f6824009c10 tx=0x7f6824004750 comp rx=0 tx=0).stop 2023-07-14T11:17:42.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:42.194+0000 7f683b9ff700 1 -- 172.21.15.84:0/3784588876 shutdown_connections 2023-07-14T11:17:42.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:42.194+0000 7f683b9ff700 1 --2- 172.21.15.84:0/3784588876 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f681806b040 0x7f681806d4f0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:42.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:42.194+0000 7f683b9ff700 1 --2- 172.21.15.84:0/3784588876 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68340b4da0 0x7f68341f54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:42.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:42.194+0000 7f683b9ff700 1 --2- 172.21.15.84:0/3784588876 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68340cd970 0x7f68340c8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:42.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:42.194+0000 7f683b9ff700 1 --2- 172.21.15.84:0/3784588876 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68340b8660 0x7f68341f2540 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:42.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:42.194+0000 7f683b9ff700 1 -- 172.21.15.84:0/3784588876 >> 172.21.15.84:0/3784588876 conn(0x7f6834066860 msgr2=0x7f68340d1920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:42.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:42.194+0000 7f683b9ff700 1 -- 172.21.15.84:0/3784588876 shutdown_connections 2023-07-14T11:17:42.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:42.194+0000 7f683b9ff700 1 -- 172.21.15.84:0/3784588876 wait complete. 2023-07-14T11:17:42.198 INFO:teuthology.orchestra.run.smithi084.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-14T11:17:42.214 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-14T11:17:42.265 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2023-07-14T11:17:42.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:42.411+0000 7efc5f1ff700 1 Processor -- start 2023-07-14T11:17:42.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:42.411+0000 7efc5f1ff700 1 -- start start 2023-07-14T11:17:42.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:42.412+0000 7efc5f1ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7efc580c92d0 0x7efc580ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:42.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:42.412+0000 7efc5f1ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc5815ce70 con 0x7efc580adea0 2023-07-14T11:17:42.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:42.412+0000 7efc5f1ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc5815d0c0 con 0x7efc580b12f0 2023-07-14T11:17:42.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:42.412+0000 7efc5f1ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc5815da60 con 0x7efc580c92d0 2023-07-14T11:17:42.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:42.412+0000 7efc5cf9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7efc580c92d0 0x7efc580ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:42.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:42.413+0000 7efc5cf9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7efc580c92d0 0x7efc580ad8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44776/0 (socket says 172.21.15.84:44776) 2023-07-14T11:17:42.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:42.413+0000 7efc5cf9b700 1 -- 172.21.15.84:0/645939339 learned_addr learned my addr 172.21.15.84:0/645939339 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:42.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:42.413+0000 7efc5cf9b700 1 -- 172.21.15.84:0/645939339 >> v1:172.21.15.179:6789/0 conn(0x7efc580b12f0 legacy=0x7efc580c96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:42.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:42.413+0000 7efc5cf9b700 1 -- 172.21.15.84:0/645939339 >> v1:172.21.15.84:6789/0 conn(0x7efc580adea0 legacy=0x7efc580cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:42.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:42.413+0000 7efc5cf9b700 1 -- 172.21.15.84:0/645939339 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc5815d3a0 con 0x7efc580c92d0 2023-07-14T11:17:42.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:42.413+0000 7efc5cf9b700 1 --2- 172.21.15.84:0/645939339 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc580c92d0 0x7efc580ad8f0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7efc4c00bb90 tx=0x7efc4c00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0bb1b7855275cce server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:42.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:42.413+0000 7efc577fe700 1 -- 172.21.15.84:0/645939339 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4c00dd50 con 0x7efc580c92d0 2023-07-14T11:17:42.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:42.413+0000 7efc577fe700 1 -- 172.21.15.84:0/645939339 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc4c010470 con 0x7efc580c92d0 2023-07-14T11:17:42.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:42.413+0000 7efc577fe700 1 -- 172.21.15.84:0/645939339 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4c010800 con 0x7efc580c92d0 2023-07-14T11:17:42.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:42.414+0000 7efc5f1ff700 1 -- 172.21.15.84:0/645939339 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc580c92d0 msgr2=0x7efc580ad8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:42.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:42.414+0000 7efc5f1ff700 1 --2- 172.21.15.84:0/645939339 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc580c92d0 0x7efc580ad8f0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7efc4c00bb90 tx=0x7efc4c00bea0 comp rx=0 tx=0).stop 2023-07-14T11:17:42.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:42.414+0000 7efc5f1ff700 1 -- 172.21.15.84:0/645939339 shutdown_connections 2023-07-14T11:17:42.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:42.414+0000 7efc5f1ff700 1 --2- 172.21.15.84:0/645939339 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc580c92d0 0x7efc580ad8f0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:42.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:42.414+0000 7efc5f1ff700 1 -- 172.21.15.84:0/645939339 >> 172.21.15.84:0/645939339 conn(0x7efc580b05d0 msgr2=0x7efc580b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:42.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:42.414+0000 7efc5f1ff700 1 -- 172.21.15.84:0/645939339 shutdown_connections 2023-07-14T11:17:42.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:42.414+0000 7efc5f1ff700 1 -- 172.21.15.84:0/645939339 wait complete. 2023-07-14T11:17:42.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:42.416+0000 7efc5f1ff700 1 Processor -- start 2023-07-14T11:17:42.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:42.416+0000 7efc5f1ff700 1 -- start start 2023-07-14T11:17:42.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:42.417+0000 7efc5f1ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc580adea0 0x7efc580b4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:42.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:42.417+0000 7efc5f1ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efc580b12f0 0x7efc580b18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:42.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:42.417+0000 7efc5f1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efc580c92d0 0x7efc5814fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:42.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:42.417+0000 7efc5f1ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc580b2140 con 0x7efc580adea0 2023-07-14T11:17:42.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:42.417+0000 7efc5f1ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc581508c0 con 0x7efc580b12f0 2023-07-14T11:17:42.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:42.417+0000 7efc5f1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc58150ba0 con 0x7efc580c92d0 2023-07-14T11:17:42.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:42.417+0000 7efc5cf9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc580adea0 0x7efc580b4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:42.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:42.417+0000 7efc5cf9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc580adea0 0x7efc580b4490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44784/0 (socket says 172.21.15.84:44784) 2023-07-14T11:17:42.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:42.417+0000 7efc5cf9b700 1 -- 172.21.15.84:0/1537880342 learned_addr learned my addr 172.21.15.84:0/1537880342 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:42.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:42.417+0000 7efc57fff700 1 --2- 172.21.15.84:0/1537880342 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efc580b12f0 0x7efc580b18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:42.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:42.417+0000 7efc5d79c700 1 --2- 172.21.15.84:0/1537880342 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efc580c92d0 0x7efc5814fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:42.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:42.417+0000 7efc5cf9b700 1 -- 172.21.15.84:0/1537880342 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efc580c92d0 msgr2=0x7efc5814fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:42.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:42.417+0000 7efc5cf9b700 1 --2- 172.21.15.84:0/1537880342 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efc580c92d0 0x7efc5814fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:42.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:42.417+0000 7efc5cf9b700 1 -- 172.21.15.84:0/1537880342 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efc580b12f0 msgr2=0x7efc580b18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:42.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:42.417+0000 7efc5cf9b700 1 --2- 172.21.15.84:0/1537880342 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efc580b12f0 0x7efc580b18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:42.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:42.417+0000 7efc5cf9b700 1 -- 172.21.15.84:0/1537880342 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc4c00b7f0 con 0x7efc580adea0 2023-07-14T11:17:42.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:42.417+0000 7efc57fff700 1 --2- 172.21.15.84:0/1537880342 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efc580b12f0 0x7efc580b18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:17:42.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:42.418+0000 7efc5cf9b700 1 --2- 172.21.15.84:0/1537880342 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc580adea0 0x7efc580b4490 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7efc4c00bee0 tx=0x7efc4c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:42.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:42.418+0000 7efc557fa700 1 -- 172.21.15.84:0/1537880342 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4c01f070 con 0x7efc580adea0 2023-07-14T11:17:42.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:42.418+0000 7efc557fa700 1 -- 172.21.15.84:0/1537880342 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc4c0039b0 con 0x7efc580adea0 2023-07-14T11:17:42.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:42.418+0000 7efc557fa700 1 -- 172.21.15.84:0/1537880342 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4c003d60 con 0x7efc580adea0 2023-07-14T11:17:42.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:42.418+0000 7efc5f1ff700 1 -- 172.21.15.84:0/1537880342 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc58150e80 con 0x7efc580adea0 2023-07-14T11:17:42.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:42.418+0000 7efc5f1ff700 1 -- 172.21.15.84:0/1537880342 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc580b1e30 con 0x7efc580adea0 2023-07-14T11:17:42.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:42.419+0000 7efc5f1ff700 1 -- 172.21.15.84:0/1537880342 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc581513a0 con 0x7efc580adea0 2023-07-14T11:17:42.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:42.420+0000 7efc557fa700 1 -- 172.21.15.84:0/1537880342 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7efc4c019400 con 0x7efc580adea0 2023-07-14T11:17:42.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:42.422+0000 7efc557fa700 1 --2- 172.21.15.84:0/1537880342 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7efc3c06afb0 0x7efc3c06d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:42.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:42.422+0000 7efc557fa700 1 -- 172.21.15.84:0/1537880342 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6148+0+0 (secure 0 0 0) 0x7efc4c08d8a0 con 0x7efc580adea0 2023-07-14T11:17:42.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:42.422+0000 7efc57fff700 1 --2- 172.21.15.84:0/1537880342 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7efc3c06afb0 0x7efc3c06d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:42.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:42.423+0000 7efc57fff700 1 --2- 172.21.15.84:0/1537880342 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7efc3c06afb0 0x7efc3c06d460 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7efc58155eb0 tx=0x7efc44009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:42.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:42.426+0000 7efc557fa700 1 -- 172.21.15.84:0/1537880342 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7efc581513a0 con 0x7efc580adea0 2023-07-14T11:17:42.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:42.662+0000 7efc5f1ff700 1 -- 172.21.15.84:0/1537880342 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7efc581513a0 con 0x7efc580adea0 2023-07-14T11:17:43.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.191+0000 7efc557fa700 1 -- 172.21.15.84:0/1537880342 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v40) v1 ==== 104+0+0 (secure 0 0 0) 0x7efc581513a0 con 0x7efc580adea0 2023-07-14T11:17:43.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.194+0000 7efc5f1ff700 1 -- 172.21.15.84:0/1537880342 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7efc3c06afb0 msgr2=0x7efc3c06d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:43.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.194+0000 7efc5f1ff700 1 --2- 172.21.15.84:0/1537880342 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7efc3c06afb0 0x7efc3c06d460 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7efc58155eb0 tx=0x7efc44009040 comp rx=0 tx=0).stop 2023-07-14T11:17:43.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.194+0000 7efc5f1ff700 1 -- 172.21.15.84:0/1537880342 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc580adea0 msgr2=0x7efc580b4490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:43.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.194+0000 7efc5f1ff700 1 --2- 172.21.15.84:0/1537880342 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc580adea0 0x7efc580b4490 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7efc4c00bee0 tx=0x7efc4c004750 comp rx=0 tx=0).stop 2023-07-14T11:17:43.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.194+0000 7efc5f1ff700 1 -- 172.21.15.84:0/1537880342 shutdown_connections 2023-07-14T11:17:43.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.194+0000 7efc5f1ff700 1 --2- 172.21.15.84:0/1537880342 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7efc3c06afb0 0x7efc3c06d460 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:43.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.194+0000 7efc5f1ff700 1 --2- 172.21.15.84:0/1537880342 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efc580c92d0 0x7efc5814fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:43.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.194+0000 7efc5f1ff700 1 --2- 172.21.15.84:0/1537880342 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc580adea0 0x7efc580b4490 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:43.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.194+0000 7efc5f1ff700 1 --2- 172.21.15.84:0/1537880342 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efc580b12f0 0x7efc580b18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:43.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.194+0000 7efc5f1ff700 1 -- 172.21.15.84:0/1537880342 >> 172.21.15.84:0/1537880342 conn(0x7efc580b05d0 msgr2=0x7efc581560f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:43.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.194+0000 7efc5f1ff700 1 -- 172.21.15.84:0/1537880342 shutdown_connections 2023-07-14T11:17:43.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.194+0000 7efc5f1ff700 1 -- 172.21.15.84:0/1537880342 wait complete. 2023-07-14T11:17:43.216 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-14T11:17:43.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.414+0000 7f99403ff700 1 Processor -- start 2023-07-14T11:17:43.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.414+0000 7f99403ff700 1 -- start start 2023-07-14T11:17:43.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.415+0000 7f99403ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f993815cc70 0x7f99380cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:43.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.415+0000 7f99403ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9938071590 0x7f99381610d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:43.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.415+0000 7f99403ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9938161610 con 0x7f9938069f30 2023-07-14T11:17:43.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.416+0000 7f99403ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99380ca4d0 con 0x7f9938071590 2023-07-14T11:17:43.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.416+0000 7f99403ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f993815d040 con 0x7f993815cc70 2023-07-14T11:17:43.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.416+0000 7f993e99c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f9938069f30 0x7f99380cd690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48976/0 (socket says 172.21.15.84:48976) 2023-07-14T11:17:43.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.416+0000 7f993e99c700 1 -- 172.21.15.84:0/3748683766 learned_addr learned my addr 172.21.15.84:0/3748683766 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:17:43.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.416+0000 7f993d99a700 1 --2- 172.21.15.84:0/3748683766 >> v2:172.21.15.179:3300/0 conn(0x7f9938071590 0x7f99381610d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:43.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.416+0000 7f993e19b700 1 --2- 172.21.15.84:0/3748683766 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f993815cc70 0x7f99380cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:43.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.416+0000 7f993d199700 1 -- 172.21.15.84:0/3748683766 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3556107797 0 0) 0x7f9930001490 con 0x7f9938069f30 2023-07-14T11:17:43.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.416+0000 7f993d199700 1 -- 172.21.15.84:0/3748683766 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99240035b0 con 0x7f9938069f30 2023-07-14T11:17:43.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.417+0000 7f993e19b700 1 -- 172.21.15.84:0/3748683766 >> v2:172.21.15.179:3300/0 conn(0x7f9938071590 msgr2=0x7f99381610d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:43.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.417+0000 7f993e19b700 1 --2- 172.21.15.84:0/3748683766 >> v2:172.21.15.179:3300/0 conn(0x7f9938071590 0x7f99381610d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:43.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.417+0000 7f993e19b700 1 -- 172.21.15.84:0/3748683766 >> v1:172.21.15.84:6789/0 conn(0x7f9938069f30 legacy=0x7f99380cd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:43.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.417+0000 7f993e19b700 1 -- 172.21.15.84:0/3748683766 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9938070860 con 0x7f993815cc70 2023-07-14T11:17:43.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.417+0000 7f993d99a700 1 --2- 172.21.15.84:0/3748683766 >> v2:172.21.15.179:3300/0 conn(0x7f9938071590 0x7f99381610d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:17:43.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.417+0000 7f993e19b700 1 --2- 172.21.15.84:0/3748683766 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f993815cc70 0x7f99380cbae0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9934009840 tx=0x7f9934009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94e9a3669a29136b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:43.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.417+0000 7f993d199700 1 -- 172.21.15.84:0/3748683766 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9934011830 con 0x7f993815cc70 2023-07-14T11:17:43.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.417+0000 7f993d199700 1 -- 172.21.15.84:0/3748683766 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9934011990 con 0x7f993815cc70 2023-07-14T11:17:43.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.417+0000 7f993d199700 1 -- 172.21.15.84:0/3748683766 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9934011d20 con 0x7f993815cc70 2023-07-14T11:17:43.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.418+0000 7f99403ff700 1 -- 172.21.15.84:0/3748683766 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f993815cc70 msgr2=0x7f99380cbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:43.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.418+0000 7f99403ff700 1 --2- 172.21.15.84:0/3748683766 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f993815cc70 0x7f99380cbae0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9934009840 tx=0x7f9934009b50 comp rx=0 tx=0).stop 2023-07-14T11:17:43.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.418+0000 7f99403ff700 1 -- 172.21.15.84:0/3748683766 shutdown_connections 2023-07-14T11:17:43.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.418+0000 7f99403ff700 1 --2- 172.21.15.84:0/3748683766 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f993815cc70 0x7f99380cbae0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:43.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.418+0000 7f99403ff700 1 --2- 172.21.15.84:0/3748683766 >> v2:172.21.15.179:3300/0 conn(0x7f9938071590 0x7f99381610d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:43.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.418+0000 7f99403ff700 1 -- 172.21.15.84:0/3748683766 >> 172.21.15.84:0/3748683766 conn(0x7f99380cd180 msgr2=0x7f99380cfac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:43.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.418+0000 7f99403ff700 1 -- 172.21.15.84:0/3748683766 shutdown_connections 2023-07-14T11:17:43.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.418+0000 7f99403ff700 1 -- 172.21.15.84:0/3748683766 wait complete. 2023-07-14T11:17:43.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.420+0000 7f99403ff700 1 Processor -- start 2023-07-14T11:17:43.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.420+0000 7f99403ff700 1 -- start start 2023-07-14T11:17:43.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.421+0000 7f99403ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9938069f30 0x7f99380b1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:43.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.421+0000 7f99403ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9938071590 0x7f99380c5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:43.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.421+0000 7f99403ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f993815cc70 0x7f99380c35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:43.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.421+0000 7f99403ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99380c4b70 con 0x7f9938069f30 2023-07-14T11:17:43.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.421+0000 7f99403ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99380b2480 con 0x7f993815cc70 2023-07-14T11:17:43.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.421+0000 7f99403ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99380c3f60 con 0x7f9938071590 2023-07-14T11:17:43.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.421+0000 7f993e19b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9938069f30 0x7f99380b1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:43.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.421+0000 7f993e19b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9938069f30 0x7f99380b1f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44794/0 (socket says 172.21.15.84:44794) 2023-07-14T11:17:43.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.421+0000 7f993e19b700 1 -- 172.21.15.84:0/3754782140 learned_addr learned my addr 172.21.15.84:0/3754782140 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:43.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.421+0000 7f993d99a700 1 --2- 172.21.15.84:0/3754782140 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9938071590 0x7f99380c5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:43.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.421+0000 7f993e99c700 1 --2- 172.21.15.84:0/3754782140 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f993815cc70 0x7f99380c35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:43.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.421+0000 7f993e19b700 1 -- 172.21.15.84:0/3754782140 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9938071590 msgr2=0x7f99380c5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:43.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.421+0000 7f993e19b700 1 --2- 172.21.15.84:0/3754782140 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9938071590 0x7f99380c5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:43.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.421+0000 7f993e19b700 1 -- 172.21.15.84:0/3754782140 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f993815cc70 msgr2=0x7f99380c35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:43.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.421+0000 7f993e19b700 1 --2- 172.21.15.84:0/3754782140 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f993815cc70 0x7f99380c35f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:43.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.421+0000 7f993e19b700 1 -- 172.21.15.84:0/3754782140 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99280094a0 con 0x7f9938069f30 2023-07-14T11:17:43.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.421+0000 7f993e99c700 1 --2- 172.21.15.84:0/3754782140 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f993815cc70 0x7f99380c35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:17:43.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.422+0000 7f993e19b700 1 --2- 172.21.15.84:0/3754782140 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9938069f30 0x7f99380b1f40 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f99340090b0 tx=0x7f9934004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:43.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.422+0000 7f992effd700 1 -- 172.21.15.84:0/3754782140 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9934004590 con 0x7f9938069f30 2023-07-14T11:17:43.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.422+0000 7f992effd700 1 -- 172.21.15.84:0/3754782140 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99340036a0 con 0x7f9938069f30 2023-07-14T11:17:43.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.422+0000 7f99403ff700 1 -- 172.21.15.84:0/3754782140 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99340094a0 con 0x7f9938069f30 2023-07-14T11:17:43.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.422+0000 7f992effd700 1 -- 172.21.15.84:0/3754782140 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9934003a30 con 0x7f9938069f30 2023-07-14T11:17:43.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.422+0000 7f99403ff700 1 -- 172.21.15.84:0/3754782140 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99380c4520 con 0x7f9938069f30 2023-07-14T11:17:43.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.423+0000 7f99403ff700 1 -- 172.21.15.84:0/3754782140 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9938074350 con 0x7f9938069f30 2023-07-14T11:17:43.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.424+0000 7f992effd700 1 -- 172.21.15.84:0/3754782140 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7f9934003b90 con 0x7f9938069f30 2023-07-14T11:17:43.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.425+0000 7f992effd700 1 --2- 172.21.15.84:0/3754782140 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f991c06b040 0x7f991c06d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:43.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.425+0000 7f992effd700 1 -- 172.21.15.84:0/3754782140 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f993408ada0 con 0x7f9938069f30 2023-07-14T11:17:43.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.425+0000 7f993d99a700 1 --2- 172.21.15.84:0/3754782140 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f991c06b040 0x7f991c06d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:43.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.426+0000 7f993d99a700 1 --2- 172.21.15.84:0/3754782140 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f991c06b040 0x7f991c06d4f0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f993815c740 tx=0x7f9928008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:43.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.429+0000 7f992effd700 1 -- 172.21.15.84:0/3754782140 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f9934055a70 con 0x7f9938069f30 2023-07-14T11:17:43.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:43.626+0000 7f99403ff700 1 -- 172.21.15.84:0/3754782140 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f993806db00 con 0x7f9938069f30 2023-07-14T11:17:44.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.199+0000 7f992effd700 1 -- 172.21.15.84:0/3754782140 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v65) v1 ==== 181+0+0 (secure 0 0 0) 0x7f9934059090 con 0x7f9938069f30 2023-07-14T11:17:44.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.203+0000 7f99403ff700 1 -- 172.21.15.84:0/3754782140 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f991c06b040 msgr2=0x7f991c06d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:44.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.203+0000 7f99403ff700 1 --2- 172.21.15.84:0/3754782140 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f991c06b040 0x7f991c06d4f0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f993815c740 tx=0x7f9928008040 comp rx=0 tx=0).stop 2023-07-14T11:17:44.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.203+0000 7f99403ff700 1 -- 172.21.15.84:0/3754782140 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9938069f30 msgr2=0x7f99380b1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:44.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.203+0000 7f99403ff700 1 --2- 172.21.15.84:0/3754782140 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9938069f30 0x7f99380b1f40 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f99340090b0 tx=0x7f9934004750 comp rx=0 tx=0).stop 2023-07-14T11:17:44.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.203+0000 7f99403ff700 1 -- 172.21.15.84:0/3754782140 shutdown_connections 2023-07-14T11:17:44.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.203+0000 7f99403ff700 1 --2- 172.21.15.84:0/3754782140 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f993815cc70 0x7f99380c35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:44.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.203+0000 7f99403ff700 1 --2- 172.21.15.84:0/3754782140 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9938069f30 0x7f99380b1f40 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:44.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.203+0000 7f99403ff700 1 --2- 172.21.15.84:0/3754782140 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f991c06b040 0x7f991c06d4f0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:44.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.203+0000 7f99403ff700 1 --2- 172.21.15.84:0/3754782140 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9938071590 0x7f99380c5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:44.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.203+0000 7f99403ff700 1 -- 172.21.15.84:0/3754782140 >> 172.21.15.84:0/3754782140 conn(0x7f99380cd180 msgr2=0x7f993815bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:44.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.203+0000 7f99403ff700 1 -- 172.21.15.84:0/3754782140 shutdown_connections 2023-07-14T11:17:44.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.203+0000 7f99403ff700 1 -- 172.21.15.84:0/3754782140 wait complete. 2023-07-14T11:17:44.207 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_metadata' removed 2023-07-14T11:17:44.224 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-14T11:17:44.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.421+0000 7fcc5cbff700 1 Processor -- start 2023-07-14T11:17:44.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.422+0000 7fcc5cbff700 1 -- start start 2023-07-14T11:17:44.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.423+0000 7fcc5cbff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fcc5815c890 0x7fcc580d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:44.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.423+0000 7fcc5cbff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc5806c240 0x7fcc580d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:44.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.423+0000 7fcc5cbff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc5815cc60 con 0x7fcc580b2440 2023-07-14T11:17:44.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.423+0000 7fcc5cbff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc5806a7f0 con 0x7fcc5815c890 2023-07-14T11:17:44.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.423+0000 7fcc5cbff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5806b760 con 0x7fcc5806c240 2023-07-14T11:17:44.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.423+0000 7fcc4ffff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fcc580b2440 0x7fcc580cf840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48990/0 (socket says 172.21.15.84:48990) 2023-07-14T11:17:44.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.423+0000 7fcc4ffff700 1 -- 172.21.15.84:0/3240713917 learned_addr learned my addr 172.21.15.84:0/3240713917 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:17:44.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.423+0000 7fcc55d9b700 1 -- 172.21.15.84:0/3240713917 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2564191219 0 0) 0x7fcc5815cc60 con 0x7fcc580b2440 2023-07-14T11:17:44.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.423+0000 7fcc56d9d700 1 --2- 172.21.15.84:0/3240713917 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc5806c240 0x7fcc580d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:44.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.423+0000 7fcc5659c700 1 --2- 172.21.15.84:0/3240713917 >> v2:172.21.15.179:3300/0 conn(0x7fcc5815c890 0x7fcc580d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:44.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.423+0000 7fcc55d9b700 1 -- 172.21.15.84:0/3240713917 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc440035b0 con 0x7fcc580b2440 2023-07-14T11:17:44.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.424+0000 7fcc55d9b700 1 -- 172.21.15.84:0/3240713917 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3516054232 0 0) 0x7fcc440035b0 con 0x7fcc580b2440 2023-07-14T11:17:44.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.424+0000 7fcc55d9b700 1 -- 172.21.15.84:0/3240713917 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc5806c240 msgr2=0x7fcc580d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:44.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.424+0000 7fcc55d9b700 1 --2- 172.21.15.84:0/3240713917 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc5806c240 0x7fcc580d0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:44.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.424+0000 7fcc55d9b700 1 -- 172.21.15.84:0/3240713917 >> v2:172.21.15.179:3300/0 conn(0x7fcc5815c890 msgr2=0x7fcc580d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:44.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.424+0000 7fcc55d9b700 1 --2- 172.21.15.84:0/3240713917 >> v2:172.21.15.179:3300/0 conn(0x7fcc5815c890 0x7fcc580d0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:44.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.424+0000 7fcc55d9b700 1 -- 172.21.15.84:0/3240713917 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc5806ba40 con 0x7fcc580b2440 2023-07-14T11:17:44.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.424+0000 7fcc55d9b700 1 -- 172.21.15.84:0/3240713917 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7fcc40001670 con 0x7fcc580b2440 2023-07-14T11:17:44.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.424+0000 7fcc55d9b700 1 -- 172.21.15.84:0/3240713917 >> v1:172.21.15.84:6789/0 conn(0x7fcc580b2440 legacy=0x7fcc580cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:44.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.424+0000 7fcc55d9b700 1 --2- 172.21.15.84:0/3240713917 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc44003ac0 0x7fcc44003ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:44.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.424+0000 7fcc55d9b700 1 --2- 172.21.15.84:0/3240713917 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc44004850 0x7fcc44004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:44.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.424+0000 7fcc55d9b700 1 --2- 172.21.15.84:0/3240713917 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc5806c240 0x7fcc44005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:44.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.424+0000 7fcc55d9b700 1 -- 172.21.15.84:0/3240713917 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5806a7f0 con 0x7fcc44003ac0 2023-07-14T11:17:44.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.424+0000 7fcc55d9b700 1 -- 172.21.15.84:0/3240713917 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5806b760 con 0x7fcc44004850 2023-07-14T11:17:44.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.424+0000 7fcc55d9b700 1 -- 172.21.15.84:0/3240713917 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4400ba60 con 0x7fcc5806c240 2023-07-14T11:17:44.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.424+0000 7fcc5659c700 1 --2- 172.21.15.84:0/3240713917 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc44003ac0 0x7fcc44003ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:44.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.424+0000 7fcc4ffff700 1 --2- 172.21.15.84:0/3240713917 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc44004850 0x7fcc44004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:44.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.424+0000 7fcc56d9d700 1 --2- 172.21.15.84:0/3240713917 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc5806c240 0x7fcc44005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:44.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.424+0000 7fcc5659c700 1 -- 172.21.15.84:0/3240713917 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc5806c240 msgr2=0x7fcc44005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:44.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.424+0000 7fcc5659c700 1 --2- 172.21.15.84:0/3240713917 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc5806c240 0x7fcc44005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:44.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.424+0000 7fcc5659c700 1 -- 172.21.15.84:0/3240713917 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc44004850 msgr2=0x7fcc44004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:44.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.424+0000 7fcc5659c700 1 --2- 172.21.15.84:0/3240713917 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc44004850 0x7fcc44004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:44.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.424+0000 7fcc5659c700 1 -- 172.21.15.84:0/3240713917 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc440035b0 con 0x7fcc44003ac0 2023-07-14T11:17:44.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.424+0000 7fcc4ffff700 1 --2- 172.21.15.84:0/3240713917 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc44004850 0x7fcc44004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:17:44.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.425+0000 7fcc5659c700 1 --2- 172.21.15.84:0/3240713917 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc44003ac0 0x7fcc44003ed0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fcc48009b90 tx=0x7fcc44005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d754113ec323a693 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:44.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.425+0000 7fcc55d9b700 1 -- 172.21.15.84:0/3240713917 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc4800e6c0 con 0x7fcc44003ac0 2023-07-14T11:17:44.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.425+0000 7fcc55d9b700 1 -- 172.21.15.84:0/3240713917 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc4800e820 con 0x7fcc44003ac0 2023-07-14T11:17:44.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.425+0000 7fcc55d9b700 1 -- 172.21.15.84:0/3240713917 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc4800eb90 con 0x7fcc44003ac0 2023-07-14T11:17:44.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.425+0000 7fcc5cbff700 1 -- 172.21.15.84:0/3240713917 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc44003ac0 msgr2=0x7fcc44003ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:44.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.425+0000 7fcc5cbff700 1 --2- 172.21.15.84:0/3240713917 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc44003ac0 0x7fcc44003ed0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fcc48009b90 tx=0x7fcc44005880 comp rx=0 tx=0).stop 2023-07-14T11:17:44.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.425+0000 7fcc56d9d700 1 -- 172.21.15.84:0/3240713917 reap_dead start 2023-07-14T11:17:44.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.426+0000 7fcc5cbff700 1 -- 172.21.15.84:0/3240713917 shutdown_connections 2023-07-14T11:17:44.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.426+0000 7fcc5cbff700 1 -- 172.21.15.84:0/3240713917 >> 172.21.15.84:0/3240713917 conn(0x7fcc5809c170 msgr2=0x7fcc580d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:44.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.426+0000 7fcc5cbff700 1 -- 172.21.15.84:0/3240713917 shutdown_connections 2023-07-14T11:17:44.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.426+0000 7fcc5cbff700 1 -- 172.21.15.84:0/3240713917 wait complete. 2023-07-14T11:17:44.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.427+0000 7fcc5cbff700 1 Processor -- start 2023-07-14T11:17:44.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.427+0000 7fcc5cbff700 1 -- start start 2023-07-14T11:17:44.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.428+0000 7fcc5cbff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc44003ac0 0x7fcc5813f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:44.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.428+0000 7fcc5cbff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc580cfb40 0x7fcc580c6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:44.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.428+0000 7fcc5cbff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc580cffb0 0x7fcc580b4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:44.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.428+0000 7fcc5cbff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc580b2c00 con 0x7fcc580cffb0 2023-07-14T11:17:44.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.428+0000 7fcc5cbff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc58142cc0 con 0x7fcc44003ac0 2023-07-14T11:17:44.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.428+0000 7fcc5cbff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc58142780 con 0x7fcc580cfb40 2023-07-14T11:17:44.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.429+0000 7fcc56d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc580cffb0 0x7fcc580b4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:44.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.429+0000 7fcc56d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc580cffb0 0x7fcc580b4d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44816/0 (socket says 172.21.15.84:44816) 2023-07-14T11:17:44.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.429+0000 7fcc56d9d700 1 -- 172.21.15.84:0/2806821299 learned_addr learned my addr 172.21.15.84:0/2806821299 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:44.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.429+0000 7fcc5659c700 1 --2- 172.21.15.84:0/2806821299 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc44003ac0 0x7fcc5813f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:44.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.429+0000 7fcc4ffff700 1 --2- 172.21.15.84:0/2806821299 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc580cfb40 0x7fcc580c6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:44.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.429+0000 7fcc56d9d700 1 -- 172.21.15.84:0/2806821299 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc580cfb40 msgr2=0x7fcc580c6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:44.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.429+0000 7fcc56d9d700 1 --2- 172.21.15.84:0/2806821299 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc580cfb40 0x7fcc580c6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:44.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.429+0000 7fcc56d9d700 1 -- 172.21.15.84:0/2806821299 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc44003ac0 msgr2=0x7fcc5813f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:44.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.429+0000 7fcc56d9d700 1 --2- 172.21.15.84:0/2806821299 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc44003ac0 0x7fcc5813f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:44.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.429+0000 7fcc56d9d700 1 -- 172.21.15.84:0/2806821299 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc580b3fd0 con 0x7fcc580cffb0 2023-07-14T11:17:44.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.429+0000 7fcc56d9d700 1 --2- 172.21.15.84:0/2806821299 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc580cffb0 0x7fcc580b4d50 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fcc5808b590 tx=0x7fcc500111d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:44.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.430+0000 7fcc4effd700 1 -- 172.21.15.84:0/2806821299 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc5000e070 con 0x7fcc580cffb0 2023-07-14T11:17:44.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.430+0000 7fcc4effd700 1 -- 172.21.15.84:0/2806821299 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc50003cf0 con 0x7fcc580cffb0 2023-07-14T11:17:44.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.430+0000 7fcc4effd700 1 -- 172.21.15.84:0/2806821299 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc50003ea0 con 0x7fcc580cffb0 2023-07-14T11:17:44.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.430+0000 7fcc5cbff700 1 -- 172.21.15.84:0/2806821299 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc5813f860 con 0x7fcc580cffb0 2023-07-14T11:17:44.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.430+0000 7fcc5cbff700 1 -- 172.21.15.84:0/2806821299 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc580b4270 con 0x7fcc580cffb0 2023-07-14T11:17:44.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.431+0000 7fcc5cbff700 1 -- 172.21.15.84:0/2806821299 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc58074350 con 0x7fcc580cffb0 2023-07-14T11:17:44.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.432+0000 7fcc4effd700 1 -- 172.21.15.84:0/2806821299 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7fcc500117d0 con 0x7fcc580cffb0 2023-07-14T11:17:44.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.432+0000 7fcc4effd700 1 --2- 172.21.15.84:0/2806821299 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fcc3806b070 0x7fcc3806d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:44.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.433+0000 7fcc4effd700 1 -- 172.21.15.84:0/2806821299 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5710+0+0 (secure 0 0 0) 0x7fcc50089db0 con 0x7fcc580cffb0 2023-07-14T11:17:44.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.433+0000 7fcc5659c700 1 --2- 172.21.15.84:0/2806821299 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fcc3806b070 0x7fcc3806d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:44.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.433+0000 7fcc5659c700 1 --2- 172.21.15.84:0/2806821299 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fcc3806b070 0x7fcc3806d520 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fcc480090b0 tx=0x7fcc48008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:44.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.437+0000 7fcc4effd700 1 -- 172.21.15.84:0/2806821299 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fcc5008e070 con 0x7fcc580cffb0 2023-07-14T11:17:44.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:44.633+0000 7fcc5cbff700 1 -- 172.21.15.84:0/2806821299 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fcc580d2f30 con 0x7fcc580cffb0 2023-07-14T11:17:45.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.199+0000 7fcc4effd700 1 -- 172.21.15.84:0/2806821299 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v66) v1 ==== 169+0+0 (secure 0 0 0) 0x7fcc50054a60 con 0x7fcc580cffb0 2023-07-14T11:17:45.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.204+0000 7fcc5cbff700 1 -- 172.21.15.84:0/2806821299 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fcc3806b070 msgr2=0x7fcc3806d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:45.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.204+0000 7fcc5cbff700 1 --2- 172.21.15.84:0/2806821299 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fcc3806b070 0x7fcc3806d520 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fcc480090b0 tx=0x7fcc48008030 comp rx=0 tx=0).stop 2023-07-14T11:17:45.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.204+0000 7fcc5cbff700 1 -- 172.21.15.84:0/2806821299 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc580cffb0 msgr2=0x7fcc580b4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:45.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.204+0000 7fcc5cbff700 1 --2- 172.21.15.84:0/2806821299 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc580cffb0 0x7fcc580b4d50 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fcc5808b590 tx=0x7fcc500111d0 comp rx=0 tx=0).stop 2023-07-14T11:17:45.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.205+0000 7fcc5cbff700 1 -- 172.21.15.84:0/2806821299 shutdown_connections 2023-07-14T11:17:45.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.205+0000 7fcc5cbff700 1 --2- 172.21.15.84:0/2806821299 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc580cffb0 0x7fcc580b4d50 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:45.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.205+0000 7fcc5cbff700 1 --2- 172.21.15.84:0/2806821299 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc44003ac0 0x7fcc5813f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:45.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.205+0000 7fcc5cbff700 1 --2- 172.21.15.84:0/2806821299 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fcc3806b070 0x7fcc3806d520 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:45.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.205+0000 7fcc5cbff700 1 --2- 172.21.15.84:0/2806821299 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc580cfb40 0x7fcc580c6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:45.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.205+0000 7fcc5cbff700 1 -- 172.21.15.84:0/2806821299 >> 172.21.15.84:0/2806821299 conn(0x7fcc5809c170 msgr2=0x7fcc580afbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:45.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.206+0000 7fcc5cbff700 1 -- 172.21.15.84:0/2806821299 shutdown_connections 2023-07-14T11:17:45.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.206+0000 7fcc5cbff700 1 -- 172.21.15.84:0/2806821299 wait complete. 2023-07-14T11:17:45.211 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data' removed 2023-07-14T11:17:45.229 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-14T11:17:45.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.428+0000 7fa1b47ff700 1 Processor -- start 2023-07-14T11:17:45.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.428+0000 7fa1b47ff700 1 -- start start 2023-07-14T11:17:45.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.430+0000 7fa1b47ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1ac158bb0 0x7fa1ac0cd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:45.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.430+0000 7fa1b47ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa1ac0ce150 0x7fa1ac06ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:45.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.430+0000 7fa1b47ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1ac0ce8c0 con 0x7fa1ac0cbe40 2023-07-14T11:17:45.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.430+0000 7fa1b47ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1ac06b5b0 con 0x7fa1ac0ce150 2023-07-14T11:17:45.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.430+0000 7fa1b47ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1ac071500 con 0x7fa1ac158bb0 2023-07-14T11:17:45.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.430+0000 7fa1b1d9a700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fa1ac0cbe40 0x7fa1ac0cda40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49004/0 (socket says 172.21.15.84:49004) 2023-07-14T11:17:45.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.430+0000 7fa1b1d9a700 1 -- 172.21.15.84:0/350346978 learned_addr learned my addr 172.21.15.84:0/350346978 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:17:45.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.430+0000 7fa1b1599700 1 -- 172.21.15.84:0/350346978 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1666514284 0 0) 0x7fa1ac0ce8c0 con 0x7fa1ac0cbe40 2023-07-14T11:17:45.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.430+0000 7fa1b1599700 1 -- 172.21.15.84:0/350346978 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1980035b0 con 0x7fa1ac0cbe40 2023-07-14T11:17:45.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.430+0000 7fa1b259b700 1 --2- 172.21.15.84:0/350346978 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1ac158bb0 0x7fa1ac0cd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:45.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.430+0000 7fa1b2d9c700 1 --2- 172.21.15.84:0/350346978 >> v2:172.21.15.179:3300/0 conn(0x7fa1ac0ce150 0x7fa1ac06ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:45.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.431+0000 7fa1b1599700 1 -- 172.21.15.84:0/350346978 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 524987220 0 0) 0x7fa1980035b0 con 0x7fa1ac0cbe40 2023-07-14T11:17:45.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.431+0000 7fa1b1599700 1 -- 172.21.15.84:0/350346978 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1ac158bb0 msgr2=0x7fa1ac0cd0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:45.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.431+0000 7fa1b1599700 1 --2- 172.21.15.84:0/350346978 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1ac158bb0 0x7fa1ac0cd0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:45.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.431+0000 7fa1b1599700 1 -- 172.21.15.84:0/350346978 >> v2:172.21.15.179:3300/0 conn(0x7fa1ac0ce150 msgr2=0x7fa1ac06ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:45.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.431+0000 7fa1b1599700 1 --2- 172.21.15.84:0/350346978 >> v2:172.21.15.179:3300/0 conn(0x7fa1ac0ce150 0x7fa1ac06ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:45.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.431+0000 7fa1b1599700 1 -- 172.21.15.84:0/350346978 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1ac0cc2b0 con 0x7fa1ac0cbe40 2023-07-14T11:17:45.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.431+0000 7fa1b1599700 1 -- 172.21.15.84:0/350346978 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7fa19c001670 con 0x7fa1ac0cbe40 2023-07-14T11:17:45.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.431+0000 7fa1b1599700 1 -- 172.21.15.84:0/350346978 >> v1:172.21.15.84:6789/0 conn(0x7fa1ac0cbe40 legacy=0x7fa1ac0cda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:45.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.431+0000 7fa1b1599700 1 --2- 172.21.15.84:0/350346978 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1ac158bb0 0x7fa198003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:45.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.431+0000 7fa1b1599700 1 --2- 172.21.15.84:0/350346978 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa198003f80 0x7fa198004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:45.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.431+0000 7fa1b1599700 1 --2- 172.21.15.84:0/350346978 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa198004d90 0x7fa198005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:45.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.431+0000 7fa1b1599700 1 -- 172.21.15.84:0/350346978 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1ac06b5b0 con 0x7fa198004d90 2023-07-14T11:17:45.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.431+0000 7fa1b1599700 1 -- 172.21.15.84:0/350346978 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1ac071500 con 0x7fa198003f80 2023-07-14T11:17:45.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.431+0000 7fa1b1599700 1 -- 172.21.15.84:0/350346978 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa19800ba10 con 0x7fa1ac158bb0 2023-07-14T11:17:45.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.431+0000 7fa1b2d9c700 1 --2- 172.21.15.84:0/350346978 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa198004d90 0x7fa198005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:45.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.431+0000 7fa1b1d9a700 1 --2- 172.21.15.84:0/350346978 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa198003f80 0x7fa198004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:45.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.431+0000 7fa1b259b700 1 --2- 172.21.15.84:0/350346978 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1ac158bb0 0x7fa198003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:45.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.431+0000 7fa1b2d9c700 1 -- 172.21.15.84:0/350346978 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1ac158bb0 msgr2=0x7fa198003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:45.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.431+0000 7fa1b2d9c700 1 --2- 172.21.15.84:0/350346978 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1ac158bb0 0x7fa198003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:45.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.431+0000 7fa1b2d9c700 1 -- 172.21.15.84:0/350346978 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa198003f80 msgr2=0x7fa198004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:45.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.431+0000 7fa1b2d9c700 1 --2- 172.21.15.84:0/350346978 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa198003f80 0x7fa198004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:45.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.432+0000 7fa1b2d9c700 1 -- 172.21.15.84:0/350346978 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1980035b0 con 0x7fa198004d90 2023-07-14T11:17:45.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.432+0000 7fa1b259b700 1 --2- 172.21.15.84:0/350346978 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa1ac158bb0 0x7fa198003a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:17:45.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.432+0000 7fa1b2d9c700 1 --2- 172.21.15.84:0/350346978 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa198004d90 0x7fa198005200 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fa1a4009bd0 tx=0x7fa198005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ef50ebe3962d482 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:45.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.432+0000 7fa1b1599700 1 -- 172.21.15.84:0/350346978 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a400ebd0 con 0x7fa198004d90 2023-07-14T11:17:45.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.432+0000 7fa1b1599700 1 -- 172.21.15.84:0/350346978 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1a400f040 con 0x7fa198004d90 2023-07-14T11:17:45.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.432+0000 7fa1b1599700 1 -- 172.21.15.84:0/350346978 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a4012430 con 0x7fa198004d90 2023-07-14T11:17:45.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.432+0000 7fa1b47ff700 1 -- 172.21.15.84:0/350346978 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa198004d90 msgr2=0x7fa198005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:45.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.432+0000 7fa1b47ff700 1 --2- 172.21.15.84:0/350346978 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa198004d90 0x7fa198005200 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fa1a4009bd0 tx=0x7fa198005880 comp rx=0 tx=0).stop 2023-07-14T11:17:45.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.432+0000 7fa1b2d9c700 1 -- 172.21.15.84:0/350346978 reap_dead start 2023-07-14T11:17:45.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.433+0000 7fa1b47ff700 1 -- 172.21.15.84:0/350346978 shutdown_connections 2023-07-14T11:17:45.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.433+0000 7fa1b47ff700 1 -- 172.21.15.84:0/350346978 >> 172.21.15.84:0/350346978 conn(0x7fa1ac0b05d0 msgr2=0x7fa1ac0b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:45.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.433+0000 7fa1b47ff700 1 -- 172.21.15.84:0/350346978 shutdown_connections 2023-07-14T11:17:45.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.433+0000 7fa1b47ff700 1 -- 172.21.15.84:0/350346978 wait complete. 2023-07-14T11:17:45.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.435+0000 7fa1b47ff700 1 Processor -- start 2023-07-14T11:17:45.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.435+0000 7fa1b47ff700 1 -- start start 2023-07-14T11:17:45.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.436+0000 7fa1b47ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa198004d90 0x7fa1ac0c8670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:45.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.436+0000 7fa1b47ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa1ac0b2750 0x7fa1ac0b3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:45.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.436+0000 7fa1b47ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa1ac1ee520 0x7fa1ac0c6b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:45.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.437+0000 7fa1b47ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1ac0b4220 con 0x7fa1ac0b2750 2023-07-14T11:17:45.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.437+0000 7fa1b47ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1ac0b1990 con 0x7fa1ac1ee520 2023-07-14T11:17:45.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.437+0000 7fa1b47ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1ac0b1c70 con 0x7fa198004d90 2023-07-14T11:17:45.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.437+0000 7fa1b1d9a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa1ac0b2750 0x7fa1ac0b3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:45.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.437+0000 7fa1b1d9a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa1ac0b2750 0x7fa1ac0b3ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44844/0 (socket says 172.21.15.84:44844) 2023-07-14T11:17:45.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.437+0000 7fa1b1d9a700 1 -- 172.21.15.84:0/3084089091 learned_addr learned my addr 172.21.15.84:0/3084089091 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:45.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.437+0000 7fa1b259b700 1 --2- 172.21.15.84:0/3084089091 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa198004d90 0x7fa1ac0c8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:45.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.437+0000 7fa1b2d9c700 1 --2- 172.21.15.84:0/3084089091 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa1ac1ee520 0x7fa1ac0c6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:45.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.437+0000 7fa1b1d9a700 1 -- 172.21.15.84:0/3084089091 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa198004d90 msgr2=0x7fa1ac0c8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:45.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.437+0000 7fa1b1d9a700 1 --2- 172.21.15.84:0/3084089091 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa198004d90 0x7fa1ac0c8670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:45.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.437+0000 7fa1b1d9a700 1 -- 172.21.15.84:0/3084089091 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa1ac1ee520 msgr2=0x7fa1ac0c6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:45.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.437+0000 7fa1b1d9a700 1 --2- 172.21.15.84:0/3084089091 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa1ac1ee520 0x7fa1ac0c6b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:45.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.437+0000 7fa1b1d9a700 1 -- 172.21.15.84:0/3084089091 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1ac0b1f50 con 0x7fa1ac0b2750 2023-07-14T11:17:45.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.437+0000 7fa1b2d9c700 1 --2- 172.21.15.84:0/3084089091 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa1ac1ee520 0x7fa1ac0c6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:17:45.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.437+0000 7fa1b1d9a700 1 --2- 172.21.15.84:0/3084089091 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa1ac0b2750 0x7fa1ac0b3ce0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fa19c0017a0 tx=0x7fa19c0075f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:45.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.438+0000 7fa1a2ffd700 1 -- 172.21.15.84:0/3084089091 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa19c00f6c0 con 0x7fa1ac0b2750 2023-07-14T11:17:45.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.438+0000 7fa1a2ffd700 1 -- 172.21.15.84:0/3084089091 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa19c00f840 con 0x7fa1ac0b2750 2023-07-14T11:17:45.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.438+0000 7fa1b47ff700 1 -- 172.21.15.84:0/3084089091 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1ac0b2230 con 0x7fa1ac0b2750 2023-07-14T11:17:45.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.438+0000 7fa1a2ffd700 1 -- 172.21.15.84:0/3084089091 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa19c00fbf0 con 0x7fa1ac0b2750 2023-07-14T11:17:45.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.438+0000 7fa1b47ff700 1 -- 172.21.15.84:0/3084089091 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1ac0b44f0 con 0x7fa1ac0b2750 2023-07-14T11:17:45.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.439+0000 7fa1b47ff700 1 -- 172.21.15.84:0/3084089091 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1ac0b2470 con 0x7fa1ac0b2750 2023-07-14T11:17:45.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.440+0000 7fa1a2ffd700 1 -- 172.21.15.84:0/3084089091 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7fa19c00fd50 con 0x7fa1ac0b2750 2023-07-14T11:17:45.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.441+0000 7fa1a2ffd700 1 --2- 172.21.15.84:0/3084089091 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa19006b040 0x7fa19006d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:45.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.441+0000 7fa1a2ffd700 1 -- 172.21.15.84:0/3084089091 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fa19c0896e0 con 0x7fa1ac0b2750 2023-07-14T11:17:45.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.441+0000 7fa1b259b700 1 --2- 172.21.15.84:0/3084089091 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa19006b040 0x7fa19006d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:45.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.442+0000 7fa1b259b700 1 --2- 172.21.15.84:0/3084089091 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa19006b040 0x7fa19006d4f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac0b4a10 tx=0x7fa1a8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:45.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.445+0000 7fa1a2ffd700 1 -- 172.21.15.84:0/3084089091 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fa1ac0b2470 con 0x7fa1ac0b2750 2023-07-14T11:17:45.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.640+0000 7fa1b47ff700 1 -- 172.21.15.84:0/3084089091 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fa1ac074350 con 0x7fa1ac0b2750 2023-07-14T11:17:45.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.645+0000 7fa1a2ffd700 1 -- 172.21.15.84:0/3084089091 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa19c054680 con 0x7fa1ac0b2750 2023-07-14T11:17:45.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.647+0000 7fa1b47ff700 1 -- 172.21.15.84:0/3084089091 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa19006b040 msgr2=0x7fa19006d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:45.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.647+0000 7fa1b47ff700 1 --2- 172.21.15.84:0/3084089091 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa19006b040 0x7fa19006d4f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac0b4a10 tx=0x7fa1a8008040 comp rx=0 tx=0).stop 2023-07-14T11:17:45.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.647+0000 7fa1b47ff700 1 -- 172.21.15.84:0/3084089091 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa1ac0b2750 msgr2=0x7fa1ac0b3ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:45.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.647+0000 7fa1b47ff700 1 --2- 172.21.15.84:0/3084089091 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa1ac0b2750 0x7fa1ac0b3ce0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fa19c0017a0 tx=0x7fa19c0075f0 comp rx=0 tx=0).stop 2023-07-14T11:17:45.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.648+0000 7fa1b47ff700 1 -- 172.21.15.84:0/3084089091 shutdown_connections 2023-07-14T11:17:45.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.648+0000 7fa1b47ff700 1 --2- 172.21.15.84:0/3084089091 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa19006b040 0x7fa19006d4f0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:45.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.648+0000 7fa1b47ff700 1 --2- 172.21.15.84:0/3084089091 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa198004d90 0x7fa1ac0c8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:45.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.648+0000 7fa1b47ff700 1 --2- 172.21.15.84:0/3084089091 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa1ac1ee520 0x7fa1ac0c6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:45.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.648+0000 7fa1b47ff700 1 --2- 172.21.15.84:0/3084089091 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa1ac0b2750 0x7fa1ac0b3ce0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:45.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.648+0000 7fa1b47ff700 1 -- 172.21.15.84:0/3084089091 >> 172.21.15.84:0/3084089091 conn(0x7fa1ac0b05d0 msgr2=0x7fa1ac0cca60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:45.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.648+0000 7fa1b47ff700 1 -- 172.21.15.84:0/3084089091 shutdown_connections 2023-07-14T11:17:45.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.648+0000 7fa1b47ff700 1 -- 172.21.15.84:0/3084089091 wait complete. 2023-07-14T11:17:45.668 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_malicious_metafile_on_legacy_to_v1_upgrade' 2023-07-14T11:17:45.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.859+0000 7f81d03ff700 1 Processor -- start 2023-07-14T11:17:45.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.859+0000 7f81d03ff700 1 -- start start 2023-07-14T11:17:45.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.861+0000 7f81d03ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f81c80b26c0 0x7f81c815cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:45.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.861+0000 7f81d03ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81c8160750 con 0x7f81c80d0240 2023-07-14T11:17:45.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.861+0000 7f81d03ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81c8160980 con 0x7f81c815c8b0 2023-07-14T11:17:45.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.861+0000 7f81d03ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81c80b0530 con 0x7f81c80b26c0 2023-07-14T11:17:45.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.861+0000 7f81ce99c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f81c80d0240 0x7f81c80d0de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49010/0 (socket says 172.21.15.84:49010) 2023-07-14T11:17:45.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.861+0000 7f81ce99c700 1 -- 172.21.15.84:0/1587280802 learned_addr learned my addr 172.21.15.84:0/1587280802 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:17:45.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.862+0000 7f81cd99a700 1 --2- 172.21.15.84:0/1587280802 >> v2:172.21.15.179:3300/0 conn(0x7f81c80b26c0 0x7f81c815cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:45.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.862+0000 7f81cd199700 1 -- 172.21.15.84:0/1587280802 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1101625037 0 0) 0x7f81c8160750 con 0x7f81c80d0240 2023-07-14T11:17:45.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.862+0000 7f81cd199700 1 -- 172.21.15.84:0/1587280802 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81b40035b0 con 0x7f81c80d0240 2023-07-14T11:17:45.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.862+0000 7f81cd99a700 1 -- 172.21.15.84:0/1587280802 >> v1:172.21.15.179:6789/0 conn(0x7f81c815c8b0 legacy=0x7f81c80cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:45.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.862+0000 7f81cd99a700 1 -- 172.21.15.84:0/1587280802 >> v1:172.21.15.84:6789/0 conn(0x7f81c80d0240 legacy=0x7f81c80d0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:45.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.862+0000 7f81cd99a700 1 -- 172.21.15.84:0/1587280802 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c8160c60 con 0x7f81c80b26c0 2023-07-14T11:17:45.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.863+0000 7f81cd99a700 1 --2- 172.21.15.84:0/1587280802 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81c80b26c0 0x7f81c815cc80 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f81b8009840 tx=0x7f81b8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=375eef5c95ee4255 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:45.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.863+0000 7f81cd199700 1 -- 172.21.15.84:0/1587280802 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b8011830 con 0x7f81c80b26c0 2023-07-14T11:17:45.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.863+0000 7f81cd199700 1 -- 172.21.15.84:0/1587280802 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81b8011990 con 0x7f81c80b26c0 2023-07-14T11:17:45.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.863+0000 7f81cd199700 1 -- 172.21.15.84:0/1587280802 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b8011d20 con 0x7f81c80b26c0 2023-07-14T11:17:45.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.863+0000 7f81d03ff700 1 -- 172.21.15.84:0/1587280802 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81c80b26c0 msgr2=0x7f81c815cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:45.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.863+0000 7f81d03ff700 1 --2- 172.21.15.84:0/1587280802 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81c80b26c0 0x7f81c815cc80 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f81b8009840 tx=0x7f81b8009b50 comp rx=0 tx=0).stop 2023-07-14T11:17:45.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.863+0000 7f81d03ff700 1 -- 172.21.15.84:0/1587280802 shutdown_connections 2023-07-14T11:17:45.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.863+0000 7f81d03ff700 1 --2- 172.21.15.84:0/1587280802 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81c80b26c0 0x7f81c815cc80 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:45.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.863+0000 7f81d03ff700 1 -- 172.21.15.84:0/1587280802 >> 172.21.15.84:0/1587280802 conn(0x7f81c806d9f0 msgr2=0x7f81c806ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:45.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.863+0000 7f81d03ff700 1 -- 172.21.15.84:0/1587280802 shutdown_connections 2023-07-14T11:17:45.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.863+0000 7f81d03ff700 1 -- 172.21.15.84:0/1587280802 wait complete. 2023-07-14T11:17:45.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.865+0000 7f81d03ff700 1 Processor -- start 2023-07-14T11:17:45.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.865+0000 7f81d03ff700 1 -- start start 2023-07-14T11:17:45.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.866+0000 7f81d03ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f81c80b26c0 0x7f81c80c6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:45.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.866+0000 7f81d03ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81c80d0240 0x7f81c814a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:45.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.866+0000 7f81d03ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81c815c8b0 0x7f81c814d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:45.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.866+0000 7f81d03ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c814a960 con 0x7f81c80b26c0 2023-07-14T11:17:45.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.866+0000 7f81d03ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c8150a60 con 0x7f81c815c8b0 2023-07-14T11:17:45.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.866+0000 7f81d03ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81c814db70 con 0x7f81c80d0240 2023-07-14T11:17:45.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.866+0000 7f81ce19b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f81c80b26c0 0x7f81c80c6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:45.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.866+0000 7f81ce19b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f81c80b26c0 0x7f81c80c6d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44850/0 (socket says 172.21.15.84:44850) 2023-07-14T11:17:45.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.866+0000 7f81ce19b700 1 -- 172.21.15.84:0/543630163 learned_addr learned my addr 172.21.15.84:0/543630163 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:45.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.867+0000 7f81ce99c700 1 --2- 172.21.15.84:0/543630163 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81c815c8b0 0x7f81c814d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:45.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.867+0000 7f81ce19b700 1 -- 172.21.15.84:0/543630163 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81c80d0240 msgr2=0x7f81c814a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:45.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.867+0000 7f81ce19b700 1 --2- 172.21.15.84:0/543630163 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81c80d0240 0x7f81c814a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:45.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.867+0000 7f81ce19b700 1 -- 172.21.15.84:0/543630163 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81c815c8b0 msgr2=0x7f81c814d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:45.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.867+0000 7f81ce19b700 1 --2- 172.21.15.84:0/543630163 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81c815c8b0 0x7f81c814d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:45.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.867+0000 7f81ce19b700 1 -- 172.21.15.84:0/543630163 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81b80094a0 con 0x7f81c80b26c0 2023-07-14T11:17:45.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.867+0000 7f81ce99c700 1 --2- 172.21.15.84:0/543630163 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81c815c8b0 0x7f81c814d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:17:45.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.867+0000 7f81ce19b700 1 --2- 172.21.15.84:0/543630163 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f81c80b26c0 0x7f81c80c6d00 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f81c400c450 tx=0x7f81c400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:45.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.867+0000 7f81beffd700 1 -- 172.21.15.84:0/543630163 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c40052d0 con 0x7f81c80b26c0 2023-07-14T11:17:45.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.867+0000 7f81beffd700 1 -- 172.21.15.84:0/543630163 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c4005430 con 0x7f81c80b26c0 2023-07-14T11:17:45.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.867+0000 7f81beffd700 1 -- 172.21.15.84:0/543630163 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c40038c0 con 0x7f81c80b26c0 2023-07-14T11:17:45.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.867+0000 7f81d03ff700 1 -- 172.21.15.84:0/543630163 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81c80c5c60 con 0x7f81c80b26c0 2023-07-14T11:17:45.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.867+0000 7f81d03ff700 1 -- 172.21.15.84:0/543630163 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81c80c6220 con 0x7f81c80b26c0 2023-07-14T11:17:45.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.868+0000 7f81d03ff700 1 -- 172.21.15.84:0/543630163 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81c8074350 con 0x7f81c80b26c0 2023-07-14T11:17:45.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.869+0000 7f81beffd700 1 -- 172.21.15.84:0/543630163 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7f81c4003a20 con 0x7f81c80b26c0 2023-07-14T11:17:45.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.870+0000 7f81beffd700 1 --2- 172.21.15.84:0/543630163 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f81ac06b040 0x7f81ac06d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:45.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.870+0000 7f81beffd700 1 -- 172.21.15.84:0/543630163 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f81c4088ba0 con 0x7f81c80b26c0 2023-07-14T11:17:45.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.871+0000 7f81cd99a700 1 --2- 172.21.15.84:0/543630163 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f81ac06b040 0x7f81ac06d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:45.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.871+0000 7f81cd99a700 1 --2- 172.21.15.84:0/543630163 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f81ac06b040 0x7f81ac06d4f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f81b80090b0 tx=0x7f81b8010000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:45.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:45.875+0000 7f81beffd700 1 -- 172.21.15.84:0/543630163 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f81c4053a00 con 0x7f81c80b26c0 2023-07-14T11:17:46.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:46.147+0000 7f81d03ff700 1 -- 172.21.15.84:0/543630163 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_malicious_metafile_on_legacy_to_v1_upgrade"]} v 0) v1 -- 0x7f81c80b3550 con 0x7f81c80b26c0 2023-07-14T11:17:46.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:46.210+0000 7f81beffd700 1 -- 172.21.15.84:0/543630163 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_malicious_metafile_on_legacy_to_v1_upgrade"]}]=0 v257) v1 ==== 161+0+0 (secure 0 0 0) 0x7f81c4057020 con 0x7f81c80b26c0 2023-07-14T11:17:46.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:46.212+0000 7f81d03ff700 1 -- 172.21.15.84:0/543630163 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f81ac06b040 msgr2=0x7f81ac06d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:46.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:46.212+0000 7f81d03ff700 1 --2- 172.21.15.84:0/543630163 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f81ac06b040 0x7f81ac06d4f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f81b80090b0 tx=0x7f81b8010000 comp rx=0 tx=0).stop 2023-07-14T11:17:46.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:46.212+0000 7f81d03ff700 1 -- 172.21.15.84:0/543630163 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f81c80b26c0 msgr2=0x7f81c80c6d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:46.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:46.212+0000 7f81d03ff700 1 --2- 172.21.15.84:0/543630163 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f81c80b26c0 0x7f81c80c6d00 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f81c400c450 tx=0x7f81c400c810 comp rx=0 tx=0).stop 2023-07-14T11:17:46.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:46.213+0000 7f81d03ff700 1 -- 172.21.15.84:0/543630163 shutdown_connections 2023-07-14T11:17:46.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:46.213+0000 7f81d03ff700 1 --2- 172.21.15.84:0/543630163 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81c815c8b0 0x7f81c814d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:46.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:46.213+0000 7f81d03ff700 1 --2- 172.21.15.84:0/543630163 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f81c80b26c0 0x7f81c80c6d00 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:46.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:46.213+0000 7f81d03ff700 1 --2- 172.21.15.84:0/543630163 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f81ac06b040 0x7f81ac06d4f0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:46.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:46.213+0000 7f81d03ff700 1 --2- 172.21.15.84:0/543630163 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81c80d0240 0x7f81c814a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:46.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:46.213+0000 7f81d03ff700 1 -- 172.21.15.84:0/543630163 >> 172.21.15.84:0/543630163 conn(0x7f81c806d9f0 msgr2=0x7f81c806ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:46.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:46.213+0000 7f81d03ff700 1 -- 172.21.15.84:0/543630163 shutdown_connections 2023-07-14T11:17:46.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:46.213+0000 7f81d03ff700 1 -- 172.21.15.84:0/543630163 wait complete. 2023-07-14T11:17:46.235 INFO:tasks.cephfs_test_runner:test_malicious_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) ... ok 2023-07-14T11:17:46.236 INFO:tasks.cephfs_test_runner:Starting test: test_mgr_eviction (tasks.cephfs.test_volumes.TestMisc) 2023-07-14T11:17:46.236 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_mgr_eviction' 2023-07-14T11:17:46.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:46.429+0000 7f6311fff700 1 Processor -- start 2023-07-14T11:17:46.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:46.429+0000 7f6311fff700 1 -- start start 2023-07-14T11:17:46.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:46.430+0000 7f6311fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f630c160030 0x7f630c06c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:46.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:46.430+0000 7f6311fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f630c0b5cd0 0x7f630c0d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:46.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:46.430+0000 7f6311fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f630c0d2cc0 con 0x7f630c0b1f70 2023-07-14T11:17:46.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:46.430+0000 7f6311fff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f630c0afbb0 con 0x7f630c0b5cd0 2023-07-14T11:17:46.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:46.430+0000 7f6311fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f630c0afe90 con 0x7f630c160030 2023-07-14T11:17:46.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:46.430+0000 7f6303fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f630c0b5cd0 0x7f630c0d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:46.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:46.430+0000 7f6303fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f630c0b5cd0 0x7f630c0d0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44856/0 (socket says 172.21.15.84:44856) 2023-07-14T11:17:46.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:46.430+0000 7f6303fff700 1 -- 172.21.15.84:0/1028153289 learned_addr learned my addr 172.21.15.84:0/1028153289 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:46.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:46.430+0000 7f630b7fe700 1 --2- 172.21.15.84:0/1028153289 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f630c160030 0x7f630c06c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:46.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:46.431+0000 7f6303fff700 1 -- 172.21.15.84:0/1028153289 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f630c160030 msgr2=0x7f630c06c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:46.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:46.431+0000 7f6303fff700 1 --2- 172.21.15.84:0/1028153289 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f630c160030 0x7f630c06c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:46.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:46.431+0000 7f6303fff700 1 -- 172.21.15.84:0/1028153289 >> v1:172.21.15.179:6789/0 conn(0x7f630c0b1f70 legacy=0x7f630c06a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:46.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:46.431+0000 7f6303fff700 1 -- 172.21.15.84:0/1028153289 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f630c0b0170 con 0x7f630c0b5cd0 2023-07-14T11:17:46.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:46.431+0000 7f6303fff700 1 --2- 172.21.15.84:0/1028153289 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f630c0b5cd0 0x7f630c0d0a50 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f62f40098f0 tx=0x7f62f4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ade2212cfa82e3 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:46.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:46.431+0000 7f630affd700 1 -- 172.21.15.84:0/1028153289 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f4011830 con 0x7f630c0b5cd0 2023-07-14T11:17:46.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:46.431+0000 7f630affd700 1 -- 172.21.15.84:0/1028153289 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62f4011990 con 0x7f630c0b5cd0 2023-07-14T11:17:46.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:46.431+0000 7f630affd700 1 -- 172.21.15.84:0/1028153289 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f4011d20 con 0x7f630c0b5cd0 2023-07-14T11:17:46.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:46.432+0000 7f6311fff700 1 -- 172.21.15.84:0/1028153289 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f630c0b5cd0 msgr2=0x7f630c0d0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:46.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:46.432+0000 7f6311fff700 1 --2- 172.21.15.84:0/1028153289 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f630c0b5cd0 0x7f630c0d0a50 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f62f40098f0 tx=0x7f62f4009c00 comp rx=0 tx=0).stop 2023-07-14T11:17:46.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:46.432+0000 7f6311fff700 1 -- 172.21.15.84:0/1028153289 shutdown_connections 2023-07-14T11:17:46.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:46.432+0000 7f6311fff700 1 --2- 172.21.15.84:0/1028153289 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f630c160030 0x7f630c06c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:46.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:46.432+0000 7f6311fff700 1 --2- 172.21.15.84:0/1028153289 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f630c0b5cd0 0x7f630c0d0a50 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:46.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:46.432+0000 7f6311fff700 1 -- 172.21.15.84:0/1028153289 >> 172.21.15.84:0/1028153289 conn(0x7f630c09c190 msgr2=0x7f630c0d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:46.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:46.432+0000 7f6311fff700 1 -- 172.21.15.84:0/1028153289 shutdown_connections 2023-07-14T11:17:46.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:46.432+0000 7f6311fff700 1 -- 172.21.15.84:0/1028153289 wait complete. 2023-07-14T11:17:46.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:46.433+0000 7f6311fff700 1 Processor -- start 2023-07-14T11:17:46.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:46.434+0000 7f6311fff700 1 -- start start 2023-07-14T11:17:46.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:46.435+0000 7f6311fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f630c0b1f70 0x7f630c1f5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:46.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:46.435+0000 7f6311fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f630c0b5cd0 0x7f630c15b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:46.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:46.435+0000 7f6311fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f630c160030 0x7f630c15a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:46.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:46.435+0000 7f6311fff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f630c15a760 con 0x7f630c0b5cd0 2023-07-14T11:17:46.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:46.435+0000 7f6311fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f630c15b880 con 0x7f630c0b1f70 2023-07-14T11:17:46.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:46.435+0000 7f6311fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f630c15bb60 con 0x7f630c160030 2023-07-14T11:17:46.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:46.435+0000 7f6303fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f630c0b5cd0 0x7f630c15b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:46.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:46.435+0000 7f6303fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f630c0b5cd0 0x7f630c15b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44860/0 (socket says 172.21.15.84:44860) 2023-07-14T11:17:46.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:46.435+0000 7f6303fff700 1 -- 172.21.15.84:0/4008596666 learned_addr learned my addr 172.21.15.84:0/4008596666 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:46.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:46.435+0000 7f630b7fe700 1 --2- 172.21.15.84:0/4008596666 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f630c0b1f70 0x7f630c1f5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:46.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:46.435+0000 7f630bfff700 1 --2- 172.21.15.84:0/4008596666 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f630c160030 0x7f630c15a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:46.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:46.435+0000 7f6303fff700 1 -- 172.21.15.84:0/4008596666 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f630c160030 msgr2=0x7f630c15a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:46.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:46.435+0000 7f6303fff700 1 --2- 172.21.15.84:0/4008596666 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f630c160030 0x7f630c15a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:46.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:46.435+0000 7f6303fff700 1 -- 172.21.15.84:0/4008596666 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f630c0b1f70 msgr2=0x7f630c1f5680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:46.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:46.435+0000 7f6303fff700 1 --2- 172.21.15.84:0/4008596666 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f630c0b1f70 0x7f630c1f5680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:46.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:46.435+0000 7f6303fff700 1 -- 172.21.15.84:0/4008596666 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f4009550 con 0x7f630c0b5cd0 2023-07-14T11:17:46.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:46.435+0000 7f6303fff700 1 --2- 172.21.15.84:0/4008596666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f630c0b5cd0 0x7f630c15b1c0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f62f4009c40 tx=0x7f62f4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:46.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:46.436+0000 7f6308ff9700 1 -- 172.21.15.84:0/4008596666 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f4004480 con 0x7f630c0b5cd0 2023-07-14T11:17:46.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:46.436+0000 7f6308ff9700 1 -- 172.21.15.84:0/4008596666 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62f401f070 con 0x7f630c0b5cd0 2023-07-14T11:17:46.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:46.436+0000 7f6308ff9700 1 -- 172.21.15.84:0/4008596666 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f40038e0 con 0x7f630c0b5cd0 2023-07-14T11:17:46.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:46.436+0000 7f6311fff700 1 -- 172.21.15.84:0/4008596666 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f630c155db0 con 0x7f630c0b5cd0 2023-07-14T11:17:46.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:46.436+0000 7f6311fff700 1 -- 172.21.15.84:0/4008596666 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f630c156370 con 0x7f630c0b5cd0 2023-07-14T11:17:46.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:46.437+0000 7f6311fff700 1 -- 172.21.15.84:0/4008596666 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f630c04e280 con 0x7f630c0b5cd0 2023-07-14T11:17:46.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:46.438+0000 7f6308ff9700 1 -- 172.21.15.84:0/4008596666 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7f62f4021030 con 0x7f630c0b5cd0 2023-07-14T11:17:46.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:46.439+0000 7f6308ff9700 1 --2- 172.21.15.84:0/4008596666 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f62ec06b040 0x7f62ec06d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:46.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:46.439+0000 7f6308ff9700 1 -- 172.21.15.84:0/4008596666 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f62f408ab10 con 0x7f630c0b5cd0 2023-07-14T11:17:46.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:46.439+0000 7f630b7fe700 1 --2- 172.21.15.84:0/4008596666 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f62ec06b040 0x7f62ec06d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:46.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:46.439+0000 7f630b7fe700 1 --2- 172.21.15.84:0/4008596666 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f62ec06b040 0x7f62ec06d4f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f62fc009b40 tx=0x7f62fc009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:46.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:46.443+0000 7f6308ff9700 1 -- 172.21.15.84:0/4008596666 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f62f4055b40 con 0x7f630c0b5cd0 2023-07-14T11:17:46.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:46.715+0000 7f6311fff700 1 -- 172.21.15.84:0/4008596666 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_mgr_eviction"]} v 0) v1 -- 0x7f630c0d38c0 con 0x7f630c0b5cd0 2023-07-14T11:17:47.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.213+0000 7f6308ff9700 1 -- 172.21.15.84:0/4008596666 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_mgr_eviction"]}]=0 v258) v1 ==== 134+0+0 (secure 0 0 0) 0x7f62f4059160 con 0x7f630c0b5cd0 2023-07-14T11:17:47.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.215+0000 7f6311fff700 1 -- 172.21.15.84:0/4008596666 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f62ec06b040 msgr2=0x7f62ec06d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:47.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.215+0000 7f6311fff700 1 --2- 172.21.15.84:0/4008596666 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f62ec06b040 0x7f62ec06d4f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f62fc009b40 tx=0x7f62fc009210 comp rx=0 tx=0).stop 2023-07-14T11:17:47.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.215+0000 7f6311fff700 1 -- 172.21.15.84:0/4008596666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f630c0b5cd0 msgr2=0x7f630c15b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:47.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.215+0000 7f6311fff700 1 --2- 172.21.15.84:0/4008596666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f630c0b5cd0 0x7f630c15b1c0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f62f4009c40 tx=0x7f62f4004750 comp rx=0 tx=0).stop 2023-07-14T11:17:47.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.215+0000 7f6311fff700 1 -- 172.21.15.84:0/4008596666 shutdown_connections 2023-07-14T11:17:47.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.215+0000 7f6311fff700 1 --2- 172.21.15.84:0/4008596666 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f62ec06b040 0x7f62ec06d4f0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:47.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.215+0000 7f6311fff700 1 --2- 172.21.15.84:0/4008596666 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f630c160030 0x7f630c15a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:47.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.215+0000 7f6311fff700 1 --2- 172.21.15.84:0/4008596666 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f630c0b1f70 0x7f630c1f5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:47.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.215+0000 7f6311fff700 1 --2- 172.21.15.84:0/4008596666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f630c0b5cd0 0x7f630c15b1c0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:47.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.216+0000 7f6311fff700 1 -- 172.21.15.84:0/4008596666 >> 172.21.15.84:0/4008596666 conn(0x7f630c09c190 msgr2=0x7f630c0b70b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:47.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.216+0000 7f6311fff700 1 -- 172.21.15.84:0/4008596666 shutdown_connections 2023-07-14T11:17:47.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.216+0000 7f6311fff700 1 -- 172.21.15.84:0/4008596666 wait complete. 2023-07-14T11:17:47.237 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-14T11:17:47.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.435+0000 7f11ab7ff700 1 Processor -- start 2023-07-14T11:17:47.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.435+0000 7f11ab7ff700 1 -- start start 2023-07-14T11:17:47.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.436+0000 7f11ab7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11a40d0010 0x7f11a40b5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:47.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.436+0000 7f11ab7ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f11a40d0480 0x7f11a40b6430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:47.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.436+0000 7f11ab7ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11a415cd60 con 0x7f11a40b4600 2023-07-14T11:17:47.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.436+0000 7f11ab7ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11a40d1550 con 0x7f11a40d0480 2023-07-14T11:17:47.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.436+0000 7f11ab7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11a40d2d90 con 0x7f11a40d0010 2023-07-14T11:17:47.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.437+0000 7f11a9d9c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f11a40d0480 0x7f11a40b6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:47.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.437+0000 7f11a9d9c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f11a40d0480 0x7f11a40b6430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44874/0 (socket says 172.21.15.84:44874) 2023-07-14T11:17:47.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.437+0000 7f11a9d9c700 1 -- 172.21.15.84:0/818030945 learned_addr learned my addr 172.21.15.84:0/818030945 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:47.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.437+0000 7f11a8d9a700 1 --2- 172.21.15.84:0/818030945 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11a40d0010 0x7f11a40b5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:47.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.437+0000 7f11a9d9c700 1 -- 172.21.15.84:0/818030945 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11a40d0010 msgr2=0x7f11a40b5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:47.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.437+0000 7f11a9d9c700 1 --2- 172.21.15.84:0/818030945 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11a40d0010 0x7f11a40b5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:47.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.437+0000 7f11a9d9c700 1 -- 172.21.15.84:0/818030945 >> v1:172.21.15.179:6789/0 conn(0x7f11a40b4600 legacy=0x7f11a40cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:47.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.437+0000 7f11a9d9c700 1 -- 172.21.15.84:0/818030945 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11a40cf340 con 0x7f11a40d0480 2023-07-14T11:17:47.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.437+0000 7f11a9d9c700 1 --2- 172.21.15.84:0/818030945 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11a40d0480 0x7f11a40b6430 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f119c009e80 tx=0x7f119c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65c82c92daad8a7e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:47.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.438+0000 7f119bfff700 1 -- 172.21.15.84:0/818030945 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f119c00e070 con 0x7f11a40d0480 2023-07-14T11:17:47.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.438+0000 7f119bfff700 1 -- 172.21.15.84:0/818030945 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f119c003a20 con 0x7f11a40d0480 2023-07-14T11:17:47.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.438+0000 7f119bfff700 1 -- 172.21.15.84:0/818030945 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f119c003dd0 con 0x7f11a40d0480 2023-07-14T11:17:47.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.438+0000 7f11ab7ff700 1 -- 172.21.15.84:0/818030945 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11a40d0480 msgr2=0x7f11a40b6430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:47.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.438+0000 7f11ab7ff700 1 --2- 172.21.15.84:0/818030945 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11a40d0480 0x7f11a40b6430 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f119c009e80 tx=0x7f119c00b330 comp rx=0 tx=0).stop 2023-07-14T11:17:47.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.438+0000 7f11ab7ff700 1 -- 172.21.15.84:0/818030945 shutdown_connections 2023-07-14T11:17:47.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.438+0000 7f11ab7ff700 1 --2- 172.21.15.84:0/818030945 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11a40d0480 0x7f11a40b6430 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:47.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.438+0000 7f11ab7ff700 1 --2- 172.21.15.84:0/818030945 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11a40d0010 0x7f11a40b5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:47.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.438+0000 7f11ab7ff700 1 -- 172.21.15.84:0/818030945 >> 172.21.15.84:0/818030945 conn(0x7f11a409c200 msgr2=0x7f11a40d2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:47.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.438+0000 7f11ab7ff700 1 -- 172.21.15.84:0/818030945 shutdown_connections 2023-07-14T11:17:47.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.438+0000 7f11ab7ff700 1 -- 172.21.15.84:0/818030945 wait complete. 2023-07-14T11:17:47.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.440+0000 7f11ab7ff700 1 Processor -- start 2023-07-14T11:17:47.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.440+0000 7f11ab7ff700 1 -- start start 2023-07-14T11:17:47.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.441+0000 7f11ab7ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11a40d0010 0x7f11a4152630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:47.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.441+0000 7f11ab7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11a40d0480 0x7f11a40cd630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:47.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.441+0000 7f11ab7ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11a40cdb70 0x7f11a415ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:47.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.441+0000 7f11ab7ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11a40cb260 con 0x7f11a40cdb70 2023-07-14T11:17:47.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.441+0000 7f11ab7ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11a40ca6c0 con 0x7f11a40d0010 2023-07-14T11:17:47.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.441+0000 7f11ab7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11a40ca930 con 0x7f11a40d0480 2023-07-14T11:17:47.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.441+0000 7f11a9d9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11a40cdb70 0x7f11a415ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:47.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.441+0000 7f11a9d9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11a40cdb70 0x7f11a415ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44876/0 (socket says 172.21.15.84:44876) 2023-07-14T11:17:47.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.441+0000 7f11a9d9c700 1 -- 172.21.15.84:0/967600223 learned_addr learned my addr 172.21.15.84:0/967600223 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:47.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.442+0000 7f11a8d9a700 1 --2- 172.21.15.84:0/967600223 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11a40d0480 0x7f11a40cd630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:47.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.442+0000 7f11a959b700 1 --2- 172.21.15.84:0/967600223 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11a40d0010 0x7f11a4152630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:47.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.442+0000 7f11a9d9c700 1 -- 172.21.15.84:0/967600223 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11a40d0480 msgr2=0x7f11a40cd630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:47.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.442+0000 7f11a9d9c700 1 --2- 172.21.15.84:0/967600223 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11a40d0480 0x7f11a40cd630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:47.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.442+0000 7f11a9d9c700 1 -- 172.21.15.84:0/967600223 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11a40d0010 msgr2=0x7f11a4152630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:47.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.442+0000 7f11a9d9c700 1 --2- 172.21.15.84:0/967600223 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11a40d0010 0x7f11a4152630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:47.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.442+0000 7f11a9d9c700 1 -- 172.21.15.84:0/967600223 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f119c009b30 con 0x7f11a40cdb70 2023-07-14T11:17:47.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.442+0000 7f11a959b700 1 --2- 172.21.15.84:0/967600223 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11a40d0010 0x7f11a4152630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:17:47.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.442+0000 7f11a8d9a700 1 --2- 172.21.15.84:0/967600223 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11a40d0480 0x7f11a40cd630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:17:47.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.442+0000 7f11a9d9c700 1 --2- 172.21.15.84:0/967600223 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11a40cdb70 0x7f11a415ebe0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f11a40b5ae0 tx=0x7f119c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:47.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.442+0000 7f1199ffb700 1 -- 172.21.15.84:0/967600223 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f119c004440 con 0x7f11a40cdb70 2023-07-14T11:17:47.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.442+0000 7f1199ffb700 1 -- 172.21.15.84:0/967600223 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f119c0045c0 con 0x7f11a40cdb70 2023-07-14T11:17:47.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.442+0000 7f11ab7ff700 1 -- 172.21.15.84:0/967600223 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11a40cac10 con 0x7f11a40cdb70 2023-07-14T11:17:47.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.442+0000 7f1199ffb700 1 -- 172.21.15.84:0/967600223 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f119c004970 con 0x7f11a40cdb70 2023-07-14T11:17:47.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.443+0000 7f11ab7ff700 1 -- 172.21.15.84:0/967600223 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11a4152b70 con 0x7f11a40cdb70 2023-07-14T11:17:47.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.444+0000 7f11ab7ff700 1 -- 172.21.15.84:0/967600223 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11a4152d30 con 0x7f11a40cdb70 2023-07-14T11:17:47.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.445+0000 7f1199ffb700 1 -- 172.21.15.84:0/967600223 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7f119c012430 con 0x7f11a40cdb70 2023-07-14T11:17:47.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.445+0000 7f1199ffb700 1 --2- 172.21.15.84:0/967600223 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f118806b040 0x7f118806d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:47.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.446+0000 7f1199ffb700 1 -- 172.21.15.84:0/967600223 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f119c08ac50 con 0x7f11a40cdb70 2023-07-14T11:17:47.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.446+0000 7f11a959b700 1 --2- 172.21.15.84:0/967600223 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f118806b040 0x7f118806d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:47.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.446+0000 7f11a959b700 1 --2- 172.21.15.84:0/967600223 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f118806b040 0x7f118806d4f0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f11a0009930 tx=0x7f11a0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:47.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.450+0000 7f1199ffb700 1 -- 172.21.15.84:0/967600223 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f11a4152d30 con 0x7f11a40cdb70 2023-07-14T11:17:47.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.647+0000 7f11ab7ff700 1 -- 172.21.15.84:0/967600223 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f11a40cb410 con 0x7f11a40cdb70 2023-07-14T11:17:47.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.653+0000 7f1199ffb700 1 -- 172.21.15.84:0/967600223 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f11a40cb410 con 0x7f11a40cdb70 2023-07-14T11:17:47.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.655+0000 7f11ab7ff700 1 -- 172.21.15.84:0/967600223 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f118806b040 msgr2=0x7f118806d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:47.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.655+0000 7f11ab7ff700 1 --2- 172.21.15.84:0/967600223 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f118806b040 0x7f118806d4f0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f11a0009930 tx=0x7f11a0008040 comp rx=0 tx=0).stop 2023-07-14T11:17:47.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.655+0000 7f11ab7ff700 1 -- 172.21.15.84:0/967600223 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11a40cdb70 msgr2=0x7f11a415ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:47.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.655+0000 7f11ab7ff700 1 --2- 172.21.15.84:0/967600223 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11a40cdb70 0x7f11a415ebe0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f11a40b5ae0 tx=0x7f119c004ad0 comp rx=0 tx=0).stop 2023-07-14T11:17:47.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.655+0000 7f11ab7ff700 1 -- 172.21.15.84:0/967600223 shutdown_connections 2023-07-14T11:17:47.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.655+0000 7f11ab7ff700 1 --2- 172.21.15.84:0/967600223 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11a40cdb70 0x7f11a415ebe0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:47.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.655+0000 7f11ab7ff700 1 --2- 172.21.15.84:0/967600223 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11a40d0010 0x7f11a4152630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:47.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.655+0000 7f11ab7ff700 1 --2- 172.21.15.84:0/967600223 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f118806b040 0x7f118806d4f0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:47.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.655+0000 7f11ab7ff700 1 --2- 172.21.15.84:0/967600223 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11a40d0480 0x7f11a40cd630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:47.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.655+0000 7f11ab7ff700 1 -- 172.21.15.84:0/967600223 >> 172.21.15.84:0/967600223 conn(0x7f11a409c200 msgr2=0x7f11a40b6190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:47.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.656+0000 7f11ab7ff700 1 -- 172.21.15.84:0/967600223 shutdown_connections 2023-07-14T11:17:47.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:47.656+0000 7f11ab7ff700 1 -- 172.21.15.84:0/967600223 wait complete. 2023-07-14T11:17:47.676 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-14T11:17:47.677 DEBUG:teuthology.orchestra.run.smithi084:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-14T11:17:47.779 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-14T11:17:47.889 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-14T11:17:47.889 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-14T11:17:47.890 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:17:47.935 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345568k,nr_inodes=4086392,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=35,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275008k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-07-14T11:17:47.936 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-07-14T11:17:47.936 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:17:47.983 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345528k,nr_inodes=4086382,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=40,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275000k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-07-14T11:17:47.984 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-14T11:17:47.984 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:17:48.029 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345568k,nr_inodes=4086392,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=35,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275008k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-07-14T11:17:48.030 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-07-14T11:17:48.030 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:17:48.076 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345528k,nr_inodes=4086382,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=40,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275000k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-07-14T11:17:48.076 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-14T11:17:48.076 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T11:17:48.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.270+0000 7f1dc8bff700 1 Processor -- start 2023-07-14T11:17:48.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.270+0000 7f1dc8bff700 1 -- start start 2023-07-14T11:17:48.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.271+0000 7f1dc8bff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1dc40b4510 0x7f1dc40b6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:48.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.271+0000 7f1dc8bff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dc40b7f50 con 0x7f1dc40d0b10 2023-07-14T11:17:48.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.271+0000 7f1dc8bff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dc40cdca0 con 0x7f1dc40b5d90 2023-07-14T11:17:48.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.271+0000 7f1dc8bff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dc40b48e0 con 0x7f1dc40b4510 2023-07-14T11:17:48.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.271+0000 7f1dc259c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1dc40b4510 0x7f1dc40b6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:48.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.271+0000 7f1dc259c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1dc40b4510 0x7f1dc40b6c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44884/0 (socket says 172.21.15.84:44884) 2023-07-14T11:17:48.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.271+0000 7f1dc259c700 1 -- 172.21.15.84:0/1400538907 learned_addr learned my addr 172.21.15.84:0/1400538907 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:48.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.272+0000 7f1dc259c700 1 -- 172.21.15.84:0/1400538907 >> v1:172.21.15.179:6789/0 conn(0x7f1dc40b5d90 legacy=0x7f1dc40cd590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:48.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.272+0000 7f1dc259c700 1 -- 172.21.15.84:0/1400538907 >> v1:172.21.15.84:6789/0 conn(0x7f1dc40d0b10 legacy=0x7f1dc40b83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:48.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.272+0000 7f1dc259c700 1 -- 172.21.15.84:0/1400538907 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dc40b7340 con 0x7f1dc40b4510 2023-07-14T11:17:48.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.272+0000 7f1dc259c700 1 --2- 172.21.15.84:0/1400538907 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1dc40b4510 0x7f1dc40b6c80 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f1db40098e0 tx=0x7f1db4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de6def620d4a0e9f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:48.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.272+0000 7f1dc159a700 1 -- 172.21.15.84:0/1400538907 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db400b8a0 con 0x7f1dc40b4510 2023-07-14T11:17:48.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.272+0000 7f1dc159a700 1 -- 172.21.15.84:0/1400538907 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1db400ba00 con 0x7f1dc40b4510 2023-07-14T11:17:48.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.272+0000 7f1dc159a700 1 -- 172.21.15.84:0/1400538907 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db400bdb0 con 0x7f1dc40b4510 2023-07-14T11:17:48.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.273+0000 7f1dc8bff700 1 -- 172.21.15.84:0/1400538907 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1dc40b4510 msgr2=0x7f1dc40b6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:48.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.273+0000 7f1dc8bff700 1 --2- 172.21.15.84:0/1400538907 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1dc40b4510 0x7f1dc40b6c80 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f1db40098e0 tx=0x7f1db4009bf0 comp rx=0 tx=0).stop 2023-07-14T11:17:48.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.273+0000 7f1dc8bff700 1 -- 172.21.15.84:0/1400538907 shutdown_connections 2023-07-14T11:17:48.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.273+0000 7f1dc8bff700 1 --2- 172.21.15.84:0/1400538907 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1dc40b4510 0x7f1dc40b6c80 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:48.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.273+0000 7f1dc8bff700 1 -- 172.21.15.84:0/1400538907 >> 172.21.15.84:0/1400538907 conn(0x7f1dc409c1d0 msgr2=0x7f1dc40d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:48.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.273+0000 7f1dc8bff700 1 -- 172.21.15.84:0/1400538907 shutdown_connections 2023-07-14T11:17:48.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.273+0000 7f1dc8bff700 1 -- 172.21.15.84:0/1400538907 wait complete. 2023-07-14T11:17:48.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.275+0000 7f1dc8bff700 1 Processor -- start 2023-07-14T11:17:48.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.275+0000 7f1dc8bff700 1 -- start start 2023-07-14T11:17:48.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.276+0000 7f1dc8bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1dc40b4510 0x7f1dc4159300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:48.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.276+0000 7f1dc8bff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1dc40b5d90 0x7f1dc40c86a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:48.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.276+0000 7f1dc8bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1dc40d0b10 0x7f1dc40c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:48.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.276+0000 7f1dc8bff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc40c6b10 con 0x7f1dc40b5d90 2023-07-14T11:17:48.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.276+0000 7f1dc8bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc40c6db0 con 0x7f1dc40d0b10 2023-07-14T11:17:48.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.276+0000 7f1dc8bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc40c7090 con 0x7f1dc40b4510 2023-07-14T11:17:48.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.276+0000 7f1dc1d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1dc40b5d90 0x7f1dc40c86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:48.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.276+0000 7f1dc1d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1dc40b5d90 0x7f1dc40c86a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44888/0 (socket says 172.21.15.84:44888) 2023-07-14T11:17:48.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.276+0000 7f1dc1d9b700 1 -- 172.21.15.84:0/3825049401 learned_addr learned my addr 172.21.15.84:0/3825049401 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:48.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.276+0000 7f1dc1d9b700 1 -- 172.21.15.84:0/3825049401 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1dc40b4510 msgr2=0x7f1dc4159300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:48.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.276+0000 7f1dc259c700 1 --2- 172.21.15.84:0/3825049401 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1dc40b4510 0x7f1dc4159300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:48.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.276+0000 7f1dc2d9d700 1 --2- 172.21.15.84:0/3825049401 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1dc40d0b10 0x7f1dc40c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:48.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.276+0000 7f1dc1d9b700 1 --2- 172.21.15.84:0/3825049401 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1dc40b4510 0x7f1dc4159300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:48.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.277+0000 7f1dc1d9b700 1 -- 172.21.15.84:0/3825049401 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1dc40d0b10 msgr2=0x7f1dc40c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:48.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.277+0000 7f1dc1d9b700 1 --2- 172.21.15.84:0/3825049401 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1dc40d0b10 0x7f1dc40c8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:48.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.277+0000 7f1dc1d9b700 1 -- 172.21.15.84:0/3825049401 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1db40094f0 con 0x7f1dc40b5d90 2023-07-14T11:17:48.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.277+0000 7f1dc259c700 1 --2- 172.21.15.84:0/3825049401 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1dc40b4510 0x7f1dc4159300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:17:48.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.277+0000 7f1dc2d9d700 1 --2- 172.21.15.84:0/3825049401 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1dc40d0b10 0x7f1dc40c8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:17:48.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.277+0000 7f1dc1d9b700 1 --2- 172.21.15.84:0/3825049401 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1dc40b5d90 0x7f1dc40c86a0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f1db800c450 tx=0x7f1db800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:48.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.277+0000 7f1db2ffd700 1 -- 172.21.15.84:0/3825049401 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db80052d0 con 0x7f1dc40b5d90 2023-07-14T11:17:48.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.277+0000 7f1db2ffd700 1 -- 172.21.15.84:0/3825049401 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1db8005430 con 0x7f1dc40b5d90 2023-07-14T11:17:48.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.277+0000 7f1dc8bff700 1 -- 172.21.15.84:0/3825049401 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dc40c95b0 con 0x7f1dc40b5d90 2023-07-14T11:17:48.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.277+0000 7f1db2ffd700 1 -- 172.21.15.84:0/3825049401 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db80038c0 con 0x7f1dc40b5d90 2023-07-14T11:17:48.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.277+0000 7f1dc8bff700 1 -- 172.21.15.84:0/3825049401 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dc41508e0 con 0x7f1dc40b5d90 2023-07-14T11:17:48.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.278+0000 7f1dc8bff700 1 -- 172.21.15.84:0/3825049401 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dc404e280 con 0x7f1dc40b5d90 2023-07-14T11:17:48.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.279+0000 7f1db2ffd700 1 -- 172.21.15.84:0/3825049401 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7f1db8003a20 con 0x7f1dc40b5d90 2023-07-14T11:17:48.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.280+0000 7f1db2ffd700 1 --2- 172.21.15.84:0/3825049401 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1da406b040 0x7f1da406d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:48.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.280+0000 7f1db2ffd700 1 -- 172.21.15.84:0/3825049401 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f1db8088ba0 con 0x7f1dc40b5d90 2023-07-14T11:17:48.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.280+0000 7f1dc259c700 1 --2- 172.21.15.84:0/3825049401 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1da406b040 0x7f1da406d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:48.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.281+0000 7f1dc259c700 1 --2- 172.21.15.84:0/3825049401 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1da406b040 0x7f1da406d4f0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f1db4009130 tx=0x7f1db4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:48.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.284+0000 7f1db2ffd700 1 -- 172.21.15.84:0/3825049401 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f1db8053a00 con 0x7f1dc40b5d90 2023-07-14T11:17:48.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.521+0000 7f1dc8bff700 1 -- 172.21.15.84:0/3825049401 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1dc408b890 con 0x7f1dc40b5d90 2023-07-14T11:17:48.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.522+0000 7f1db2ffd700 1 -- 172.21.15.84:0/3825049401 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f1db8017de0 con 0x7f1dc40b5d90 2023-07-14T11:17:48.527 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:17:48.527 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":40,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5342,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/2977703024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2977703024},{"type":"v1","addr":"172.21.15.179:6834","nonce":2977703024}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31},{"gid":5351,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/2068020315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":2068020315},{"type":"v1","addr":"172.21.15.84:6837","nonce":2068020315}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32},{"gid":5573,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3343535588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":3343535588},{"type":"v1","addr":"172.21.15.179:6835","nonce":3343535588}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":40},{"gid":5914,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/2441649918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2441649918},{"type":"v1","addr":"172.21.15.84:6836","nonce":2441649918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32}],"filesystems":[]} 2023-07-14T11:17:48.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.524+0000 7f1dc8bff700 1 -- 172.21.15.84:0/3825049401 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1da406b040 msgr2=0x7f1da406d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:48.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.524+0000 7f1dc8bff700 1 --2- 172.21.15.84:0/3825049401 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1da406b040 0x7f1da406d4f0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f1db4009130 tx=0x7f1db4008030 comp rx=0 tx=0).stop 2023-07-14T11:17:48.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.524+0000 7f1dc8bff700 1 -- 172.21.15.84:0/3825049401 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1dc40b5d90 msgr2=0x7f1dc40c86a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:48.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.524+0000 7f1dc8bff700 1 --2- 172.21.15.84:0/3825049401 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1dc40b5d90 0x7f1dc40c86a0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f1db800c450 tx=0x7f1db800c810 comp rx=0 tx=0).stop 2023-07-14T11:17:48.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.524+0000 7f1dc8bff700 1 -- 172.21.15.84:0/3825049401 shutdown_connections 2023-07-14T11:17:48.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.524+0000 7f1dc8bff700 1 --2- 172.21.15.84:0/3825049401 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f1da406b040 0x7f1da406d4f0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:48.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.524+0000 7f1dc8bff700 1 --2- 172.21.15.84:0/3825049401 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1dc40b4510 0x7f1dc4159300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:48.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.524+0000 7f1dc8bff700 1 --2- 172.21.15.84:0/3825049401 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1dc40d0b10 0x7f1dc40c8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:48.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.524+0000 7f1dc8bff700 1 --2- 172.21.15.84:0/3825049401 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1dc40b5d90 0x7f1dc40c86a0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:48.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.524+0000 7f1dc8bff700 1 -- 172.21.15.84:0/3825049401 >> 172.21.15.84:0/3825049401 conn(0x7f1dc409c1d0 msgr2=0x7f1dc406acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:48.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.525+0000 7f1dc8bff700 1 -- 172.21.15.84:0/3825049401 shutdown_connections 2023-07-14T11:17:48.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.525+0000 7f1dc8bff700 1 -- 172.21.15.84:0/3825049401 wait complete. 2023-07-14T11:17:48.531 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 40 2023-07-14T11:17:48.545 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-14T11:17:48.545 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-14T11:17:48.545 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-14T11:17:48.546 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T11:17:48.546 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-14T11:17:48.546 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-14T11:17:48.546 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-14T11:17:48.547 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T11:17:48.547 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-14T11:17:48.547 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-14T11:17:48.547 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-14T11:17:48.548 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T11:17:48.548 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-14T11:17:48.548 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-14T11:17:48.548 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-14T11:17:48.549 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T11:17:48.560 INFO:tasks.ceph.mds.a:Stopped 2023-07-14T11:17:48.560 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-14T11:17:48.561 INFO:tasks.ceph.mds.c:Stopped 2023-07-14T11:17:48.561 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-14T11:17:48.563 INFO:tasks.ceph.mds.b:Stopped 2023-07-14T11:17:48.563 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-14T11:17:48.564 INFO:tasks.ceph.mds.d:Stopped 2023-07-14T11:17:48.564 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-14T11:17:48.604 INFO:tasks.ceph.mds.a:Started 2023-07-14T11:17:48.605 DEBUG:teuthology.parallel:result is None 2023-07-14T11:17:48.607 INFO:tasks.ceph.mds.c:Started 2023-07-14T11:17:48.607 DEBUG:teuthology.parallel:result is None 2023-07-14T11:17:48.608 INFO:tasks.ceph.mds.b:Started 2023-07-14T11:17:48.608 DEBUG:teuthology.parallel:result is None 2023-07-14T11:17:48.610 INFO:tasks.ceph.mds.d:Started 2023-07-14T11:17:48.610 DEBUG:teuthology.parallel:result is None 2023-07-14T11:17:48.611 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-14T11:17:48.752 INFO:tasks.ceph.mds.a.smithi084.stdout:starting mds.a at 2023-07-14T11:17:48.753 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2023-07-14T11:17:48.753 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2023-07-14T11:17:48.754 INFO:tasks.ceph.mds.c.smithi084.stdout:starting mds.c at 2023-07-14T11:17:48.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.817+0000 7f17701ff700 1 Processor -- start 2023-07-14T11:17:48.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.817+0000 7f17701ff700 1 -- start start 2023-07-14T11:17:48.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.818+0000 7f17701ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f17680c92d0 0x7f17680ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:48.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.818+0000 7f17701ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f17680b12f0 0x7f17680c96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:48.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.818+0000 7f17701ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f176815ce70 con 0x7f17680adea0 2023-07-14T11:17:48.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.818+0000 7f17701ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f176815da60 con 0x7f17680b12f0 2023-07-14T11:17:48.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.818+0000 7f17701ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17680c9be0 con 0x7f17680c92d0 2023-07-14T11:17:48.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.819+0000 7f176d79a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f17680b12f0 0x7f17680c96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:48.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.819+0000 7f176e79c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f17680adea0 0x7f176806c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49044/0 (socket says 172.21.15.84:49044) 2023-07-14T11:17:48.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.819+0000 7f176e79c700 1 -- 172.21.15.84:0/2092570212 learned_addr learned my addr 172.21.15.84:0/2092570212 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:17:48.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.819+0000 7f176df9b700 1 --2- 172.21.15.84:0/2092570212 >> v2:172.21.15.179:3300/0 conn(0x7f17680c92d0 0x7f17680ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:48.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.819+0000 7f176d79a700 1 -- 172.21.15.84:0/2092570212 >> v2:172.21.15.179:3300/0 conn(0x7f17680c92d0 msgr2=0x7f17680ad8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:48.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.819+0000 7f176d79a700 1 --2- 172.21.15.84:0/2092570212 >> v2:172.21.15.179:3300/0 conn(0x7f17680c92d0 0x7f17680ad8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:48.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.819+0000 7f176d79a700 1 -- 172.21.15.84:0/2092570212 >> v1:172.21.15.84:6789/0 conn(0x7f17680adea0 legacy=0x7f176806c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:48.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.819+0000 7f176d79a700 1 -- 172.21.15.84:0/2092570212 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f176815d0c0 con 0x7f17680b12f0 2023-07-14T11:17:48.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.819+0000 7f176df9b700 1 --2- 172.21.15.84:0/2092570212 >> v2:172.21.15.179:3300/0 conn(0x7f17680c92d0 0x7f17680ad8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:17:48.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.819+0000 7f176d79a700 1 --2- 172.21.15.84:0/2092570212 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17680b12f0 0x7f17680c96a0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f176806f630 tx=0x7f1758009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f71db9d624b44b1f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:48.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.820+0000 7f176cf99700 1 -- 172.21.15.84:0/2092570212 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1758011830 con 0x7f17680b12f0 2023-07-14T11:17:48.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.820+0000 7f176cf99700 1 -- 172.21.15.84:0/2092570212 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1758011990 con 0x7f17680b12f0 2023-07-14T11:17:48.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.820+0000 7f176cf99700 1 -- 172.21.15.84:0/2092570212 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1758011d20 con 0x7f17680b12f0 2023-07-14T11:17:48.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.820+0000 7f17701ff700 1 -- 172.21.15.84:0/2092570212 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17680b12f0 msgr2=0x7f17680c96a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:48.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.820+0000 7f17701ff700 1 --2- 172.21.15.84:0/2092570212 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17680b12f0 0x7f17680c96a0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f176806f630 tx=0x7f1758009b20 comp rx=0 tx=0).stop 2023-07-14T11:17:48.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.820+0000 7f17701ff700 1 -- 172.21.15.84:0/2092570212 shutdown_connections 2023-07-14T11:17:48.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.820+0000 7f17701ff700 1 --2- 172.21.15.84:0/2092570212 >> v2:172.21.15.179:3300/0 conn(0x7f17680c92d0 0x7f17680ad8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:48.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.820+0000 7f17701ff700 1 --2- 172.21.15.84:0/2092570212 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17680b12f0 0x7f17680c96a0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:48.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.820+0000 7f17701ff700 1 -- 172.21.15.84:0/2092570212 >> 172.21.15.84:0/2092570212 conn(0x7f17680b05d0 msgr2=0x7f17680b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:48.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.820+0000 7f17701ff700 1 -- 172.21.15.84:0/2092570212 shutdown_connections 2023-07-14T11:17:48.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.820+0000 7f17701ff700 1 -- 172.21.15.84:0/2092570212 wait complete. 2023-07-14T11:17:48.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.822+0000 7f17701ff700 1 Processor -- start 2023-07-14T11:17:48.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.822+0000 7f17701ff700 1 -- start start 2023-07-14T11:17:48.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.823+0000 7f17701ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17680adea0 0x7f17680c81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:48.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.823+0000 7f17701ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f17680b12f0 0x7f1768151b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:48.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.823+0000 7f17701ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f17680c92d0 0x7f17680b3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:48.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.823+0000 7f17701ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17680b39b0 con 0x7f17680adea0 2023-07-14T11:17:48.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.823+0000 7f17701ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17680b2da0 con 0x7f17680b12f0 2023-07-14T11:17:48.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.823+0000 7f17701ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17680b3080 con 0x7f17680c92d0 2023-07-14T11:17:48.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.823+0000 7f176df9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17680adea0 0x7f17680c81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:48.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.823+0000 7f176df9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17680adea0 0x7f17680c81d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44948/0 (socket says 172.21.15.84:44948) 2023-07-14T11:17:48.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.823+0000 7f176df9b700 1 -- 172.21.15.84:0/3646289294 learned_addr learned my addr 172.21.15.84:0/3646289294 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:48.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.824+0000 7f176d79a700 1 --2- 172.21.15.84:0/3646289294 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f17680b12f0 0x7f1768151b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:48.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.824+0000 7f176df9b700 1 -- 172.21.15.84:0/3646289294 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f17680c92d0 msgr2=0x7f17680b3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:48.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.824+0000 7f176e79c700 1 --2- 172.21.15.84:0/3646289294 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f17680c92d0 0x7f17680b3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:48.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.824+0000 7f176df9b700 1 --2- 172.21.15.84:0/3646289294 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f17680c92d0 0x7f17680b3e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:48.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.824+0000 7f176df9b700 1 -- 172.21.15.84:0/3646289294 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f17680b12f0 msgr2=0x7f1768151b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:48.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.824+0000 7f176df9b700 1 --2- 172.21.15.84:0/3646289294 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f17680b12f0 0x7f1768151b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:48.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.824+0000 7f176df9b700 1 -- 172.21.15.84:0/3646289294 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17640094a0 con 0x7f17680adea0 2023-07-14T11:17:48.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.824+0000 7f176d79a700 1 --2- 172.21.15.84:0/3646289294 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f17680b12f0 0x7f1768151b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:17:48.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.824+0000 7f176e79c700 1 --2- 172.21.15.84:0/3646289294 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f17680c92d0 0x7f17680b3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:17:48.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.824+0000 7f176df9b700 1 --2- 172.21.15.84:0/3646289294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17680adea0 0x7f17680c81d0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f176400ebe0 tx=0x7f1764009e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:48.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.824+0000 7f175e7fc700 1 -- 172.21.15.84:0/3646289294 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f176400c8b0 con 0x7f17680adea0 2023-07-14T11:17:48.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.824+0000 7f175e7fc700 1 -- 172.21.15.84:0/3646289294 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f176400ca10 con 0x7f17680adea0 2023-07-14T11:17:48.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.824+0000 7f175e7fc700 1 -- 172.21.15.84:0/3646289294 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f176400cda0 con 0x7f17680adea0 2023-07-14T11:17:48.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.824+0000 7f17701ff700 1 -- 172.21.15.84:0/3646289294 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17580094a0 con 0x7f17680adea0 2023-07-14T11:17:48.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.824+0000 7f17701ff700 1 -- 172.21.15.84:0/3646289294 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17680b3640 con 0x7f17680adea0 2023-07-14T11:17:48.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.825+0000 7f17701ff700 1 -- 172.21.15.84:0/3646289294 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17680cd680 con 0x7f17680adea0 2023-07-14T11:17:48.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.826+0000 7f175e7fc700 1 -- 172.21.15.84:0/3646289294 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7f1764013470 con 0x7f17680adea0 2023-07-14T11:17:48.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.827+0000 7f175e7fc700 1 --2- 172.21.15.84:0/3646289294 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f174c06b040 0x7f174c06d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:48.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.827+0000 7f175e7fc700 1 -- 172.21.15.84:0/3646289294 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f1764089780 con 0x7f17680adea0 2023-07-14T11:17:48.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.828+0000 7f176d79a700 1 --2- 172.21.15.84:0/3646289294 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f174c06b040 0x7f174c06d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:48.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.828+0000 7f176d79a700 1 --2- 172.21.15.84:0/3646289294 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f174c06b040 0x7f174c06d4f0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f17680b24a0 tx=0x7f1758008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:48.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:48.832+0000 7f175e7fc700 1 -- 172.21.15.84:0/3646289294 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f17680cd680 con 0x7f17680adea0 2023-07-14T11:17:49.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:49.041+0000 7f17701ff700 1 -- 172.21.15.84:0/3646289294 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f17680b3c90 con 0x7f17680adea0 2023-07-14T11:17:50.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.236+0000 7f175e7fc700 1 -- 172.21.15.84:0/3646289294 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v71) v1 ==== 97+0+0 (secure 0 0 0) 0x7f17640547b0 con 0x7f17680adea0 2023-07-14T11:17:50.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.239+0000 7f17701ff700 1 -- 172.21.15.84:0/3646289294 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f174c06b040 msgr2=0x7f174c06d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:50.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.239+0000 7f17701ff700 1 --2- 172.21.15.84:0/3646289294 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f174c06b040 0x7f174c06d4f0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f17680b24a0 tx=0x7f1758008030 comp rx=0 tx=0).stop 2023-07-14T11:17:50.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.239+0000 7f17701ff700 1 -- 172.21.15.84:0/3646289294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17680adea0 msgr2=0x7f17680c81d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:50.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.239+0000 7f17701ff700 1 --2- 172.21.15.84:0/3646289294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17680adea0 0x7f17680c81d0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f176400ebe0 tx=0x7f1764009e20 comp rx=0 tx=0).stop 2023-07-14T11:17:50.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.239+0000 7f17701ff700 1 -- 172.21.15.84:0/3646289294 shutdown_connections 2023-07-14T11:17:50.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.239+0000 7f17701ff700 1 --2- 172.21.15.84:0/3646289294 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f174c06b040 0x7f174c06d4f0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:50.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.239+0000 7f17701ff700 1 --2- 172.21.15.84:0/3646289294 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f17680c92d0 0x7f17680b3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:50.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.239+0000 7f17701ff700 1 --2- 172.21.15.84:0/3646289294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17680adea0 0x7f17680c81d0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:50.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.239+0000 7f17701ff700 1 --2- 172.21.15.84:0/3646289294 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f17680b12f0 0x7f1768151b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:50.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.239+0000 7f17701ff700 1 -- 172.21.15.84:0/3646289294 >> 172.21.15.84:0/3646289294 conn(0x7f17680b05d0 msgr2=0x7f17680ac860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:50.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.239+0000 7f17701ff700 1 -- 172.21.15.84:0/3646289294 shutdown_connections 2023-07-14T11:17:50.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.239+0000 7f17701ff700 1 -- 172.21.15.84:0/3646289294 wait complete. 2023-07-14T11:17:50.244 INFO:teuthology.orchestra.run.smithi084.stderr: removed all blocklist entries 2023-07-14T11:17:50.262 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-14T11:17:50.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.460+0000 7f6ce07ff700 1 Processor -- start 2023-07-14T11:17:50.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.460+0000 7f6ce07ff700 1 -- start start 2023-07-14T11:17:50.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.461+0000 7f6ce07ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6cd8141ff0 0x7f6cd8158fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:50.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.461+0000 7f6ce07ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6cd8070710 0x7f6cd80b4000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:50.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.461+0000 7f6ce07ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cd80b4540 con 0x7f6cd80b1a70 2023-07-14T11:17:50.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.461+0000 7f6ce07ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cd8071140 con 0x7f6cd8070710 2023-07-14T11:17:50.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.461+0000 7f6ce07ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd806c110 con 0x7f6cd8141ff0 2023-07-14T11:17:50.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.462+0000 7f6cddd9a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6cd8070710 0x7f6cd80b4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:50.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.462+0000 7f6cded9c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f6cd80b1a70 0x7f6cd806c5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:37004/0 (socket says 172.21.15.84:37004) 2023-07-14T11:17:50.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.462+0000 7f6cded9c700 1 -- 172.21.15.84:0/4235820435 learned_addr learned my addr 172.21.15.84:0/4235820435 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:17:50.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.462+0000 7f6cde59b700 1 --2- 172.21.15.84:0/4235820435 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6cd8141ff0 0x7f6cd8158fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:50.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.462+0000 7f6cdd599700 1 -- 172.21.15.84:0/4235820435 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2649765587 0 0) 0x7f6cd0001490 con 0x7f6cd80b1a70 2023-07-14T11:17:50.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.462+0000 7f6cdd599700 1 -- 172.21.15.84:0/4235820435 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6cc40034d0 con 0x7f6cd80b1a70 2023-07-14T11:17:50.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.462+0000 7f6cddd9a700 1 -- 172.21.15.84:0/4235820435 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6cd8141ff0 msgr2=0x7f6cd8158fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:50.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.462+0000 7f6cddd9a700 1 --2- 172.21.15.84:0/4235820435 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6cd8141ff0 0x7f6cd8158fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:50.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.462+0000 7f6cddd9a700 1 -- 172.21.15.84:0/4235820435 >> v1:172.21.15.84:6789/0 conn(0x7f6cd80b1a70 legacy=0x7f6cd806c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:50.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.462+0000 7f6cddd9a700 1 -- 172.21.15.84:0/4235820435 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd8070e60 con 0x7f6cd8070710 2023-07-14T11:17:50.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.462+0000 7f6cddd9a700 1 --2- 172.21.15.84:0/4235820435 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cd8070710 0x7f6cd80b4000 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f6cc8009840 tx=0x7f6cc8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=486f2550503a0a05 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:50.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.463+0000 7f6cdd599700 1 -- 172.21.15.84:0/4235820435 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc8011830 con 0x7f6cd8070710 2023-07-14T11:17:50.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.463+0000 7f6cdd599700 1 -- 172.21.15.84:0/4235820435 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cc8011990 con 0x7f6cd8070710 2023-07-14T11:17:50.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.463+0000 7f6cdd599700 1 -- 172.21.15.84:0/4235820435 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc8011d20 con 0x7f6cd8070710 2023-07-14T11:17:50.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.463+0000 7f6ce07ff700 1 -- 172.21.15.84:0/4235820435 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cd8070710 msgr2=0x7f6cd80b4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:50.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.463+0000 7f6ce07ff700 1 --2- 172.21.15.84:0/4235820435 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cd8070710 0x7f6cd80b4000 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f6cc8009840 tx=0x7f6cc8009b50 comp rx=0 tx=0).stop 2023-07-14T11:17:50.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.463+0000 7f6ce07ff700 1 -- 172.21.15.84:0/4235820435 shutdown_connections 2023-07-14T11:17:50.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.463+0000 7f6ce07ff700 1 --2- 172.21.15.84:0/4235820435 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6cd8141ff0 0x7f6cd8158fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:50.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.463+0000 7f6ce07ff700 1 --2- 172.21.15.84:0/4235820435 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cd8070710 0x7f6cd80b4000 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:50.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.463+0000 7f6ce07ff700 1 -- 172.21.15.84:0/4235820435 >> 172.21.15.84:0/4235820435 conn(0x7f6cd8069f30 msgr2=0x7f6cd806a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:50.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.463+0000 7f6ce07ff700 1 -- 172.21.15.84:0/4235820435 shutdown_connections 2023-07-14T11:17:50.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.463+0000 7f6ce07ff700 1 -- 172.21.15.84:0/4235820435 wait complete. 2023-07-14T11:17:50.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.466+0000 7f6ce07ff700 1 Processor -- start 2023-07-14T11:17:50.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.466+0000 7f6ce07ff700 1 -- start start 2023-07-14T11:17:50.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.467+0000 7f6ce07ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cd8070710 0x7f6cd81e3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:50.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.467+0000 7f6ce07ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6cd80b1a70 0x7f6cd815aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:50.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.467+0000 7f6ce07ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6cd8141ff0 0x7f6cd81335f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:50.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.467+0000 7f6ce07ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd81310c0 con 0x7f6cd8070710 2023-07-14T11:17:50.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.467+0000 7f6ce07ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd80c3d90 con 0x7f6cd8141ff0 2023-07-14T11:17:50.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.467+0000 7f6ce07ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd81e4d10 con 0x7f6cd80b1a70 2023-07-14T11:17:50.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.467+0000 7f6cde59b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cd8070710 0x7f6cd81e3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:50.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.467+0000 7f6cde59b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cd8070710 0x7f6cd81e3e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44832/0 (socket says 172.21.15.84:44832) 2023-07-14T11:17:50.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.467+0000 7f6cde59b700 1 -- 172.21.15.84:0/508571923 learned_addr learned my addr 172.21.15.84:0/508571923 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:50.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.468+0000 7f6cddd9a700 1 --2- 172.21.15.84:0/508571923 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6cd80b1a70 0x7f6cd815aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:50.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.468+0000 7f6cded9c700 1 --2- 172.21.15.84:0/508571923 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6cd8141ff0 0x7f6cd81335f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:50.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.468+0000 7f6cde59b700 1 -- 172.21.15.84:0/508571923 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6cd80b1a70 msgr2=0x7f6cd815aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:50.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.468+0000 7f6cde59b700 1 --2- 172.21.15.84:0/508571923 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6cd80b1a70 0x7f6cd815aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:50.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.468+0000 7f6cde59b700 1 -- 172.21.15.84:0/508571923 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6cd8141ff0 msgr2=0x7f6cd81335f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:50.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.468+0000 7f6cde59b700 1 --2- 172.21.15.84:0/508571923 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6cd8141ff0 0x7f6cd81335f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:50.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.468+0000 7f6cde59b700 1 -- 172.21.15.84:0/508571923 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cc80094a0 con 0x7f6cd8070710 2023-07-14T11:17:50.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.468+0000 7f6cde59b700 1 --2- 172.21.15.84:0/508571923 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cd8070710 0x7f6cd81e3e60 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f6cd400e9e0 tx=0x7f6cd400ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:50.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.468+0000 7f6cceffd700 1 -- 172.21.15.84:0/508571923 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd4009710 con 0x7f6cd8070710 2023-07-14T11:17:50.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.468+0000 7f6cceffd700 1 -- 172.21.15.84:0/508571923 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cd400c850 con 0x7f6cd8070710 2023-07-14T11:17:50.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.468+0000 7f6cceffd700 1 -- 172.21.15.84:0/508571923 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd400cbc0 con 0x7f6cd8070710 2023-07-14T11:17:50.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.468+0000 7f6ce07ff700 1 -- 172.21.15.84:0/508571923 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cd81e4ff0 con 0x7f6cd8070710 2023-07-14T11:17:50.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.468+0000 7f6ce07ff700 1 -- 172.21.15.84:0/508571923 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cd81e55b0 con 0x7f6cd8070710 2023-07-14T11:17:50.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.469+0000 7f6ce07ff700 1 -- 172.21.15.84:0/508571923 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cd804e280 con 0x7f6cd8070710 2023-07-14T11:17:50.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.470+0000 7f6cceffd700 1 -- 172.21.15.84:0/508571923 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7f6cd400cd20 con 0x7f6cd8070710 2023-07-14T11:17:50.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.471+0000 7f6cceffd700 1 --2- 172.21.15.84:0/508571923 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6cbc06b040 0x7f6cbc06d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:50.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.471+0000 7f6cceffd700 1 -- 172.21.15.84:0/508571923 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6cd4089740 con 0x7f6cd8070710 2023-07-14T11:17:50.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.472+0000 7f6cddd9a700 1 --2- 172.21.15.84:0/508571923 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6cbc06b040 0x7f6cbc06d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:50.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.472+0000 7f6cddd9a700 1 --2- 172.21.15.84:0/508571923 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6cbc06b040 0x7f6cbc06d4f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f6cc8000c00 tx=0x7f6cc801c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:50.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.475+0000 7f6cceffd700 1 -- 172.21.15.84:0/508571923 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f6cd40546f0 con 0x7f6cd8070710 2023-07-14T11:17:50.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.745+0000 7f6ce07ff700 1 -- 172.21.15.84:0/508571923 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f6cd806f900 con 0x7f6cd8070710 2023-07-14T11:17:50.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.746+0000 7f6cceffd700 1 -- 172.21.15.84:0/508571923 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v18) v1 ==== 80+0+5632 (secure 0 0 0) 0x7f6cd4057d10 con 0x7f6cd8070710 2023-07-14T11:17:50.748 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:17:50.748 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-07-14T11:17:50.749 INFO:teuthology.orchestra.run.smithi084.stdout: "auth_dump": [ 2023-07-14T11:17:50.749 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:17:50.749 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.a", 2023-07-14T11:17:50.749 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCJLbFkprwsJhAAIZa03ewirqLtc0mn7ki6Vw==", 2023-07-14T11:17:50.749 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:17:50.749 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-07-14T11:17:50.750 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-07-14T11:17:50.750 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-07-14T11:17:50.750 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:17:50.750 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:17:50.750 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:17:50.750 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:17:50.750 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.b", 2023-07-14T11:17:50.750 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCKLbFkfYOoAhAAQcpDkBRXNSDyfnZp1A/BJw==", 2023-07-14T11:17:50.751 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:17:50.751 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-07-14T11:17:50.751 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-07-14T11:17:50.751 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-07-14T11:17:50.751 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:17:50.751 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:17:50.751 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:17:50.752 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:17:50.752 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.c", 2023-07-14T11:17:50.752 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCJLbFk9MZ4MhAAY2CpAoK7Bx7NyoccpK7MLA==", 2023-07-14T11:17:50.752 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:17:50.752 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-07-14T11:17:50.752 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-07-14T11:17:50.753 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-07-14T11:17:50.753 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:17:50.753 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:17:50.753 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:17:50.753 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:17:50.753 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.d", 2023-07-14T11:17:50.753 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCKLbFkfxxFDhAAFPvGUrg0RW1nYTAdACvEAA==", 2023-07-14T11:17:50.753 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:17:50.754 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-07-14T11:17:50.754 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-07-14T11:17:50.754 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-07-14T11:17:50.754 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:17:50.754 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:17:50.754 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:17:50.754 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:17:50.755 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.0", 2023-07-14T11:17:50.755 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCOLbFkd18mDBAA2tneRYzoJkGwIZNDW6+Z7w==", 2023-07-14T11:17:50.755 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:17:50.755 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-07-14T11:17:50.755 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-07-14T11:17:50.755 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:17:50.755 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:17:50.756 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:17:50.756 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:17:50.756 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.1", 2023-07-14T11:17:50.756 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCRLbFkwBlAEBAAoEG62Dam3KHra4oNXBGyfw==", 2023-07-14T11:17:50.756 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:17:50.756 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-07-14T11:17:50.756 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-07-14T11:17:50.757 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:17:50.757 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:17:50.757 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:17:50.757 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:17:50.757 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.2", 2023-07-14T11:17:50.757 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCULbFkCln2ExAAKM+sAwMtcH6yEbNUqHbN4Q==", 2023-07-14T11:17:50.757 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:17:50.758 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-07-14T11:17:50.758 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-07-14T11:17:50.758 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:17:50.758 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:17:50.758 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:17:50.758 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:17:50.758 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.3", 2023-07-14T11:17:50.759 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCXLbFk0ZGgFxAAgOEUoX5jqzic6bOxtG7qSw==", 2023-07-14T11:17:50.759 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:17:50.759 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-07-14T11:17:50.759 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-07-14T11:17:50.759 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:17:50.759 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:17:50.759 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:17:50.760 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:17:50.760 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.4", 2023-07-14T11:17:50.760 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCdLbFknOESLBAA9usIfRfkbbLiMOCvUR+pXQ==", 2023-07-14T11:17:50.760 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:17:50.760 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-07-14T11:17:50.760 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-07-14T11:17:50.760 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:17:50.761 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:17:50.761 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:17:50.761 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:17:50.761 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.5", 2023-07-14T11:17:50.761 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCgLbFk+Rk/LxAAGqk3ueTaGaSINPuxoW53Gw==", 2023-07-14T11:17:50.761 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:17:50.761 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-07-14T11:17:50.762 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-07-14T11:17:50.762 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:17:50.762 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:17:50.762 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:17:50.762 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:17:50.762 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.6", 2023-07-14T11:17:50.762 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCjLbFk1/QfMxAABnWxus7LXfn7R0iwMVTWiA==", 2023-07-14T11:17:50.762 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:17:50.763 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-07-14T11:17:50.763 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-07-14T11:17:50.763 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:17:50.763 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:17:50.763 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:17:50.763 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:17:50.763 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.7", 2023-07-14T11:17:50.764 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCmLbFkNnhmNhAAz85GY1Sb1NuKINJCyWpPGQ==", 2023-07-14T11:17:50.764 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:17:50.764 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-07-14T11:17:50.764 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-07-14T11:17:50.764 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:17:50.764 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:17:50.764 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:17:50.765 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:17:50.765 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.0", 2023-07-14T11:17:50.765 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCKLbFkKSl5GBAAwPK4Zs6+gv/6YKHh4JI3WA==", 2023-07-14T11:17:50.765 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:17:50.765 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-07-14T11:17:50.765 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow r", 2023-07-14T11:17:50.765 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-14T11:17:50.766 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:17:50.766 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:17:50.766 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:17:50.766 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.1", 2023-07-14T11:17:50.766 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCKLbFkieNzJxAARri6UfCWdcXA3NpeFfvILw==", 2023-07-14T11:17:50.766 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:17:50.766 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-07-14T11:17:50.767 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-07-14T11:17:50.767 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-07-14T11:17:50.767 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-07-14T11:17:50.767 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:17:50.767 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:17:50.767 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:17:50.767 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.2", 2023-07-14T11:17:50.768 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCKLbFkLhv6HxAACUfTJK618qRsXETPJagZXQ==", 2023-07-14T11:17:50.768 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:17:50.768 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-07-14T11:17:50.768 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-07-14T11:17:50.768 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-07-14T11:17:50.768 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-07-14T11:17:50.768 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:17:50.769 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:17:50.769 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:17:50.769 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.3", 2023-07-14T11:17:50.769 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCKLbFka9HxLhAA4OsQY/t7A2FIYLEyYgJ19Q==", 2023-07-14T11:17:50.769 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:17:50.769 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-07-14T11:17:50.769 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-07-14T11:17:50.770 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-07-14T11:17:50.770 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-07-14T11:17:50.770 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:17:50.770 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:17:50.770 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:17:50.770 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.admin", 2023-07-14T11:17:50.770 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCILbFkmVPbKRAAffsYBVR51b7R8sXpbdF0MQ==", 2023-07-14T11:17:50.771 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:17:50.771 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow *", 2023-07-14T11:17:50.771 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-07-14T11:17:50.771 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-07-14T11:17:50.771 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:17:50.771 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:17:50.771 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:17:50.772 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:17:50.772 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.alice", 2023-07-14T11:17:50.772 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDJLrFkk6jmBRAA2udJ1hTXApUjWlDupnErDw==", 2023-07-14T11:17:50.772 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:17:50.772 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow rw path=/volumes/_nogroup/subvolume_0000000000851779", 2023-07-14T11:17:50.772 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow r", 2023-07-14T11:17:50.772 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rw pool=cephfs_data" 2023-07-14T11:17:50.773 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:17:50.773 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:17:50.773 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:17:50.773 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mgr.x", 2023-07-14T11:17:50.773 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCJLbFk28xTHhAAAlmm5bW9VTtgE+OujO+G2w==", 2023-07-14T11:17:50.773 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:17:50.773 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow *", 2023-07-14T11:17:50.774 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile mgr", 2023-07-14T11:17:50.774 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:17:50.774 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:17:50.774 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:17:50.774 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:17:50.774 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mgr.y", 2023-07-14T11:17:50.774 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCJLbFk5dM1FhAAJWbB+GogsfcSkaBdHrFg4A==", 2023-07-14T11:17:50.774 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:17:50.775 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow *", 2023-07-14T11:17:50.775 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile mgr", 2023-07-14T11:17:50.775 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:17:50.775 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:17:50.775 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:17:50.775 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2023-07-14T11:17:50.775 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-07-14T11:17:50.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.748+0000 7f6ce07ff700 1 -- 172.21.15.84:0/508571923 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6cbc06b040 msgr2=0x7f6cbc06d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:50.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.748+0000 7f6ce07ff700 1 --2- 172.21.15.84:0/508571923 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6cbc06b040 0x7f6cbc06d4f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f6cc8000c00 tx=0x7f6cc801c040 comp rx=0 tx=0).stop 2023-07-14T11:17:50.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.748+0000 7f6ce07ff700 1 -- 172.21.15.84:0/508571923 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cd8070710 msgr2=0x7f6cd81e3e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:50.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.748+0000 7f6ce07ff700 1 --2- 172.21.15.84:0/508571923 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cd8070710 0x7f6cd81e3e60 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f6cd400e9e0 tx=0x7f6cd400ecf0 comp rx=0 tx=0).stop 2023-07-14T11:17:50.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.748+0000 7f6ce07ff700 1 -- 172.21.15.84:0/508571923 shutdown_connections 2023-07-14T11:17:50.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.748+0000 7f6ce07ff700 1 --2- 172.21.15.84:0/508571923 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6cd8141ff0 0x7f6cd81335f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:50.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.748+0000 7f6ce07ff700 1 --2- 172.21.15.84:0/508571923 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cd8070710 0x7f6cd81e3e60 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:50.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.748+0000 7f6ce07ff700 1 --2- 172.21.15.84:0/508571923 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6cbc06b040 0x7f6cbc06d4f0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:50.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.748+0000 7f6ce07ff700 1 --2- 172.21.15.84:0/508571923 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6cd80b1a70 0x7f6cd815aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:50.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.748+0000 7f6ce07ff700 1 -- 172.21.15.84:0/508571923 >> 172.21.15.84:0/508571923 conn(0x7f6cd8069f30 msgr2=0x7f6cd80b0740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:50.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.748+0000 7f6ce07ff700 1 -- 172.21.15.84:0/508571923 shutdown_connections 2023-07-14T11:17:50.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.748+0000 7f6ce07ff700 1 -- 172.21.15.84:0/508571923 wait complete. 2023-07-14T11:17:50.779 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.alice 2023-07-14T11:17:50.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.973+0000 7f9a8a3ff700 1 Processor -- start 2023-07-14T11:17:50.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.973+0000 7f9a8a3ff700 1 -- start start 2023-07-14T11:17:50.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.974+0000 7f9a8a3ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9a8415c860 0x7f9a840d1e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:50.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.974+0000 7f9a8a3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9a840cf2a0 0x7f9a840c6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:50.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.974+0000 7f9a8a3ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a840cf710 con 0x7f9a840c6fe0 2023-07-14T11:17:50.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.975+0000 7f9a8a3ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a84146740 con 0x7f9a8415c860 2023-07-14T11:17:50.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.975+0000 7f9a8a3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a840cd5a0 con 0x7f9a840cf2a0 2023-07-14T11:17:50.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.975+0000 7f9a83fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9a8415c860 0x7f9a840d1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:50.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.975+0000 7f9a8899c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f9a840c6fe0 0x7f9a840cf960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:37016/0 (socket says 172.21.15.84:37016) 2023-07-14T11:17:50.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.975+0000 7f9a8899c700 1 -- 172.21.15.84:0/1207588558 learned_addr learned my addr 172.21.15.84:0/1207588558 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:17:50.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.975+0000 7f9a837fe700 1 --2- 172.21.15.84:0/1207588558 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9a840cf2a0 0x7f9a840c6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:50.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.975+0000 7f9a83fff700 1 -- 172.21.15.84:0/1207588558 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9a840cf2a0 msgr2=0x7f9a840c6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:50.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.975+0000 7f9a83fff700 1 --2- 172.21.15.84:0/1207588558 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9a840cf2a0 0x7f9a840c6aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:50.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.975+0000 7f9a83fff700 1 -- 172.21.15.84:0/1207588558 >> v1:172.21.15.84:6789/0 conn(0x7f9a840c6fe0 legacy=0x7f9a840cf960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:50.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.975+0000 7f9a82ffd700 1 -- 172.21.15.84:0/1207588558 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2378724740 0 0) 0x7f9a7c001490 con 0x7f9a840c6fe0 2023-07-14T11:17:50.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.975+0000 7f9a83fff700 1 -- 172.21.15.84:0/1207588558 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a840cd7f0 con 0x7f9a8415c860 2023-07-14T11:17:50.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.976+0000 7f9a83fff700 1 --2- 172.21.15.84:0/1207588558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a8415c860 0x7f9a840d1e40 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f9a74009840 tx=0x7f9a74009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37d89d05fcf83251 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:50.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.976+0000 7f9a82ffd700 1 -- 172.21.15.84:0/1207588558 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a74011830 con 0x7f9a8415c860 2023-07-14T11:17:50.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.976+0000 7f9a82ffd700 1 -- 172.21.15.84:0/1207588558 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a74011990 con 0x7f9a8415c860 2023-07-14T11:17:50.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.976+0000 7f9a82ffd700 1 -- 172.21.15.84:0/1207588558 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a74011d20 con 0x7f9a8415c860 2023-07-14T11:17:50.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.976+0000 7f9a8a3ff700 1 -- 172.21.15.84:0/1207588558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a8415c860 msgr2=0x7f9a840d1e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:50.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.976+0000 7f9a8a3ff700 1 --2- 172.21.15.84:0/1207588558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a8415c860 0x7f9a840d1e40 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f9a74009840 tx=0x7f9a74009b50 comp rx=0 tx=0).stop 2023-07-14T11:17:50.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.976+0000 7f9a8a3ff700 1 -- 172.21.15.84:0/1207588558 shutdown_connections 2023-07-14T11:17:50.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.976+0000 7f9a8a3ff700 1 --2- 172.21.15.84:0/1207588558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a8415c860 0x7f9a840d1e40 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:50.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.976+0000 7f9a8a3ff700 1 --2- 172.21.15.84:0/1207588558 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9a840cf2a0 0x7f9a840c6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:50.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.976+0000 7f9a8a3ff700 1 -- 172.21.15.84:0/1207588558 >> 172.21.15.84:0/1207588558 conn(0x7f9a84065bd0 msgr2=0x7f9a84065fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:50.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.976+0000 7f9a8a3ff700 1 -- 172.21.15.84:0/1207588558 shutdown_connections 2023-07-14T11:17:50.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.977+0000 7f9a8a3ff700 1 -- 172.21.15.84:0/1207588558 wait complete. 2023-07-14T11:17:50.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.979+0000 7f9a8a3ff700 1 Processor -- start 2023-07-14T11:17:50.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.979+0000 7f9a8a3ff700 1 -- start start 2023-07-14T11:17:50.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.980+0000 7f9a8a3ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9a840c6fe0 0x7f9a841f1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:50.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.980+0000 7f9a8a3ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a840cf2a0 0x7f9a840b5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:50.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.980+0000 7f9a8a3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9a8415c860 0x7f9a840b62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:50.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.980+0000 7f9a8a3ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a840b8fa0 con 0x7f9a840cf2a0 2023-07-14T11:17:50.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.980+0000 7f9a8a3ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a84157ca0 con 0x7f9a840c6fe0 2023-07-14T11:17:50.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.980+0000 7f9a8a3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a840b8cc0 con 0x7f9a8415c860 2023-07-14T11:17:50.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.980+0000 7f9a837fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a840cf2a0 0x7f9a840b5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:50.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.980+0000 7f9a837fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a840cf2a0 0x7f9a840b5d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44852/0 (socket says 172.21.15.84:44852) 2023-07-14T11:17:50.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.980+0000 7f9a837fe700 1 -- 172.21.15.84:0/1339506642 learned_addr learned my addr 172.21.15.84:0/1339506642 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:50.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.981+0000 7f9a8899c700 1 --2- 172.21.15.84:0/1339506642 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9a8415c860 0x7f9a840b62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:50.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.981+0000 7f9a837fe700 1 -- 172.21.15.84:0/1339506642 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9a8415c860 msgr2=0x7f9a840b62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:50.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.981+0000 7f9a83fff700 1 --2- 172.21.15.84:0/1339506642 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9a840c6fe0 0x7f9a841f1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:50.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.981+0000 7f9a837fe700 1 --2- 172.21.15.84:0/1339506642 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9a8415c860 0x7f9a840b62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:50.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.981+0000 7f9a837fe700 1 -- 172.21.15.84:0/1339506642 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9a840c6fe0 msgr2=0x7f9a841f1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:50.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.981+0000 7f9a837fe700 1 --2- 172.21.15.84:0/1339506642 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9a840c6fe0 0x7f9a841f1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:50.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.981+0000 7f9a837fe700 1 -- 172.21.15.84:0/1339506642 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a740094a0 con 0x7f9a840cf2a0 2023-07-14T11:17:50.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.981+0000 7f9a8899c700 1 --2- 172.21.15.84:0/1339506642 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9a8415c860 0x7f9a840b62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:17:50.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.981+0000 7f9a83fff700 1 --2- 172.21.15.84:0/1339506642 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9a840c6fe0 0x7f9a841f1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:17:50.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.981+0000 7f9a837fe700 1 --2- 172.21.15.84:0/1339506642 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a840cf2a0 0x7f9a840b5d80 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f9a7800e810 tx=0x7f9a7800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:50.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.981+0000 7f9a80ff9700 1 -- 172.21.15.84:0/1339506642 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a78013610 con 0x7f9a840cf2a0 2023-07-14T11:17:50.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.981+0000 7f9a80ff9700 1 -- 172.21.15.84:0/1339506642 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a78013770 con 0x7f9a840cf2a0 2023-07-14T11:17:50.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.981+0000 7f9a8a3ff700 1 -- 172.21.15.84:0/1339506642 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a84157f60 con 0x7f9a840cf2a0 2023-07-14T11:17:50.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.981+0000 7f9a80ff9700 1 -- 172.21.15.84:0/1339506642 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a78013b20 con 0x7f9a840cf2a0 2023-07-14T11:17:50.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.982+0000 7f9a8a3ff700 1 -- 172.21.15.84:0/1339506642 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a841460f0 con 0x7f9a840cf2a0 2023-07-14T11:17:50.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.983+0000 7f9a8a3ff700 1 -- 172.21.15.84:0/1339506642 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a84074350 con 0x7f9a840cf2a0 2023-07-14T11:17:50.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.984+0000 7f9a80ff9700 1 -- 172.21.15.84:0/1339506642 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7f9a78013c80 con 0x7f9a840cf2a0 2023-07-14T11:17:50.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.985+0000 7f9a80ff9700 1 --2- 172.21.15.84:0/1339506642 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f9a7006b040 0x7f9a7006d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:50.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.985+0000 7f9a80ff9700 1 -- 172.21.15.84:0/1339506642 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f9a78089440 con 0x7f9a840cf2a0 2023-07-14T11:17:50.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.985+0000 7f9a83fff700 1 --2- 172.21.15.84:0/1339506642 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f9a7006b040 0x7f9a7006d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:50.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.985+0000 7f9a83fff700 1 --2- 172.21.15.84:0/1339506642 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f9a7006b040 0x7f9a7006d4f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f9a74009b90 tx=0x7f9a74008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:50.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:50.989+0000 7f9a80ff9700 1 -- 172.21.15.84:0/1339506642 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f9a78057d80 con 0x7f9a840cf2a0 2023-07-14T11:17:51.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.262+0000 7f9a8a3ff700 1 -- 172.21.15.84:0/1339506642 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.alice"} v 0) v1 -- 0x7f9a8415baf0 con 0x7f9a840cf2a0 2023-07-14T11:17:51.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.266+0000 7f9a80ff9700 1 -- 172.21.15.84:0/1339506642 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.alice"}]=0 v19) v1 ==== 82+0+0 (secure 0 0 0) 0x7f9a78057910 con 0x7f9a840cf2a0 2023-07-14T11:17:51.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.268+0000 7f9a8a3ff700 1 -- 172.21.15.84:0/1339506642 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f9a7006b040 msgr2=0x7f9a7006d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:51.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.268+0000 7f9a8a3ff700 1 --2- 172.21.15.84:0/1339506642 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f9a7006b040 0x7f9a7006d4f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f9a74009b90 tx=0x7f9a74008030 comp rx=0 tx=0).stop 2023-07-14T11:17:51.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.268+0000 7f9a8a3ff700 1 -- 172.21.15.84:0/1339506642 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a840cf2a0 msgr2=0x7f9a840b5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:51.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.268+0000 7f9a8a3ff700 1 --2- 172.21.15.84:0/1339506642 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a840cf2a0 0x7f9a840b5d80 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f9a7800e810 tx=0x7f9a7800ebd0 comp rx=0 tx=0).stop 2023-07-14T11:17:51.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.268+0000 7f9a8a3ff700 1 -- 172.21.15.84:0/1339506642 shutdown_connections 2023-07-14T11:17:51.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.268+0000 7f9a8a3ff700 1 --2- 172.21.15.84:0/1339506642 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f9a7006b040 0x7f9a7006d4f0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:51.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.268+0000 7f9a8a3ff700 1 --2- 172.21.15.84:0/1339506642 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9a8415c860 0x7f9a840b62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:51.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.268+0000 7f9a8a3ff700 1 --2- 172.21.15.84:0/1339506642 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9a840c6fe0 0x7f9a841f1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:51.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.268+0000 7f9a8a3ff700 1 --2- 172.21.15.84:0/1339506642 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a840cf2a0 0x7f9a840b5d80 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:51.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.268+0000 7f9a8a3ff700 1 -- 172.21.15.84:0/1339506642 >> 172.21.15.84:0/1339506642 conn(0x7f9a84065bd0 msgr2=0x7f9a840c8680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:51.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.268+0000 7f9a8a3ff700 1 -- 172.21.15.84:0/1339506642 shutdown_connections 2023-07-14T11:17:51.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.268+0000 7f9a8a3ff700 1 -- 172.21.15.84:0/1339506642 wait complete. 2023-07-14T11:17:51.288 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:17:51.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.481+0000 7f443e7ff700 1 Processor -- start 2023-07-14T11:17:51.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.482+0000 7f443e7ff700 1 -- start start 2023-07-14T11:17:51.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.483+0000 7f443e7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f443815c710 0x7f44380cf510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:51.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.483+0000 7f443e7ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4438069f30 0x7f443806a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:51.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.483+0000 7f443e7ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f443806d420 0x7f443806d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:51.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.483+0000 7f443e7ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f443806dde0 con 0x7f4438069f30 2023-07-14T11:17:51.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.483+0000 7f443e7ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44380cd320 con 0x7f443806d420 2023-07-14T11:17:51.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.483+0000 7f443e7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44380ce750 con 0x7f443815c710 2023-07-14T11:17:51.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.483+0000 7f442ffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4438069f30 0x7f443806a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:51.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.483+0000 7f442ffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4438069f30 0x7f443806a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44854/0 (socket says 172.21.15.84:44854) 2023-07-14T11:17:51.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.483+0000 7f442ffff700 1 -- 172.21.15.84:0/3184868464 learned_addr learned my addr 172.21.15.84:0/3184868464 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:51.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.483+0000 7f4437fff700 1 --2- 172.21.15.84:0/3184868464 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f443815c710 0x7f44380cf510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:51.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.483+0000 7f443cd9c700 1 --2- 172.21.15.84:0/3184868464 >> v2:172.21.15.179:3300/0 conn(0x7f443806d420 0x7f443806d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:51.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.483+0000 7f442ffff700 1 -- 172.21.15.84:0/3184868464 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f443815c710 msgr2=0x7f44380cf510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:51.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.483+0000 7f442ffff700 1 --2- 172.21.15.84:0/3184868464 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f443815c710 0x7f44380cf510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:51.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.483+0000 7f442ffff700 1 -- 172.21.15.84:0/3184868464 >> v2:172.21.15.179:3300/0 conn(0x7f443806d420 msgr2=0x7f443806d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:51.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.483+0000 7f442ffff700 1 --2- 172.21.15.84:0/3184868464 >> v2:172.21.15.179:3300/0 conn(0x7f443806d420 0x7f443806d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:51.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.483+0000 7f442ffff700 1 -- 172.21.15.84:0/3184868464 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44380cea30 con 0x7f4438069f30 2023-07-14T11:17:51.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.483+0000 7f4437fff700 1 --2- 172.21.15.84:0/3184868464 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f443815c710 0x7f44380cf510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:17:51.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.483+0000 7f443cd9c700 1 --2- 172.21.15.84:0/3184868464 >> v2:172.21.15.179:3300/0 conn(0x7f443806d420 0x7f443806d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:17:51.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.484+0000 7f442ffff700 1 --2- 172.21.15.84:0/3184868464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4438069f30 0x7f443806a3a0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f4438067f70 tx=0x7f4420009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c86b33c7ca7f6c3c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:51.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.484+0000 7f44377fe700 1 -- 172.21.15.84:0/3184868464 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f442000b870 con 0x7f4438069f30 2023-07-14T11:17:51.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.484+0000 7f44377fe700 1 -- 172.21.15.84:0/3184868464 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f442000b9d0 con 0x7f4438069f30 2023-07-14T11:17:51.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.484+0000 7f44377fe700 1 -- 172.21.15.84:0/3184868464 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f442000bd60 con 0x7f4438069f30 2023-07-14T11:17:51.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.484+0000 7f443e7ff700 1 -- 172.21.15.84:0/3184868464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4438069f30 msgr2=0x7f443806a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:51.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.484+0000 7f443e7ff700 1 --2- 172.21.15.84:0/3184868464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4438069f30 0x7f443806a3a0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f4438067f70 tx=0x7f4420009bd0 comp rx=0 tx=0).stop 2023-07-14T11:17:51.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.485+0000 7f443e7ff700 1 -- 172.21.15.84:0/3184868464 shutdown_connections 2023-07-14T11:17:51.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.485+0000 7f443e7ff700 1 --2- 172.21.15.84:0/3184868464 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f443815c710 0x7f44380cf510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:51.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.485+0000 7f443e7ff700 1 --2- 172.21.15.84:0/3184868464 >> v2:172.21.15.179:3300/0 conn(0x7f443806d420 0x7f443806d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:51.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.485+0000 7f443e7ff700 1 --2- 172.21.15.84:0/3184868464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4438069f30 0x7f443806a3a0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:51.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.485+0000 7f443e7ff700 1 -- 172.21.15.84:0/3184868464 >> 172.21.15.84:0/3184868464 conn(0x7f44380b16c0 msgr2=0x7f44380b1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:51.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.485+0000 7f443e7ff700 1 -- 172.21.15.84:0/3184868464 shutdown_connections 2023-07-14T11:17:51.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.485+0000 7f443e7ff700 1 -- 172.21.15.84:0/3184868464 wait complete. 2023-07-14T11:17:51.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.486+0000 7f443e7ff700 1 Processor -- start 2023-07-14T11:17:51.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.486+0000 7f443e7ff700 1 -- start start 2023-07-14T11:17:51.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.487+0000 7f443e7ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4438069f30 0x7f443815cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:51.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.487+0000 7f443e7ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f443806d420 0x7f44380b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:51.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.487+0000 7f443e7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f443815e1e0 0x7f44381532c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:51.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.487+0000 7f443e7ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f443815e680 con 0x7f443806d420 2023-07-14T11:17:51.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.487+0000 7f443e7ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f443815d140 con 0x7f4438069f30 2023-07-14T11:17:51.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.487+0000 7f443e7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f443815d420 con 0x7f443815e1e0 2023-07-14T11:17:51.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.488+0000 7f442ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f443806d420 0x7f44380b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:51.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.488+0000 7f442ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f443806d420 0x7f44380b4f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44864/0 (socket says 172.21.15.84:44864) 2023-07-14T11:17:51.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.488+0000 7f442ffff700 1 -- 172.21.15.84:0/1289098636 learned_addr learned my addr 172.21.15.84:0/1289098636 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:51.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.488+0000 7f4437fff700 1 --2- 172.21.15.84:0/1289098636 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4438069f30 0x7f443815cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:51.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.488+0000 7f443cd9c700 1 --2- 172.21.15.84:0/1289098636 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f443815e1e0 0x7f44381532c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:51.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.488+0000 7f442ffff700 1 -- 172.21.15.84:0/1289098636 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f443815e1e0 msgr2=0x7f44381532c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:51.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.488+0000 7f442ffff700 1 --2- 172.21.15.84:0/1289098636 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f443815e1e0 0x7f44381532c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:51.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.488+0000 7f442ffff700 1 -- 172.21.15.84:0/1289098636 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4438069f30 msgr2=0x7f443815cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:51.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.488+0000 7f442ffff700 1 --2- 172.21.15.84:0/1289098636 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4438069f30 0x7f443815cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:51.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.488+0000 7f442ffff700 1 -- 172.21.15.84:0/1289098636 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4420009550 con 0x7f443806d420 2023-07-14T11:17:51.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.488+0000 7f442ffff700 1 --2- 172.21.15.84:0/1289098636 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f443806d420 0x7f44380b4f00 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f4438068040 tx=0x7f4420004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:51.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.488+0000 7f44357fa700 1 -- 172.21.15.84:0/1289098636 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4420004310 con 0x7f443806d420 2023-07-14T11:17:51.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.488+0000 7f44357fa700 1 -- 172.21.15.84:0/1289098636 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f442001f070 con 0x7f443806d420 2023-07-14T11:17:51.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.488+0000 7f443e7ff700 1 -- 172.21.15.84:0/1289098636 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f443815d700 con 0x7f443806d420 2023-07-14T11:17:51.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.489+0000 7f44357fa700 1 -- 172.21.15.84:0/1289098636 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44200036a0 con 0x7f443806d420 2023-07-14T11:17:51.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.489+0000 7f443e7ff700 1 -- 172.21.15.84:0/1289098636 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f443815dcc0 con 0x7f443806d420 2023-07-14T11:17:51.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.490+0000 7f443e7ff700 1 -- 172.21.15.84:0/1289098636 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f443804e280 con 0x7f443806d420 2023-07-14T11:17:51.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.491+0000 7f44357fa700 1 -- 172.21.15.84:0/1289098636 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7f4420021030 con 0x7f443806d420 2023-07-14T11:17:51.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.491+0000 7f44357fa700 1 --2- 172.21.15.84:0/1289098636 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f441806b040 0x7f441806d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:51.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.491+0000 7f44357fa700 1 -- 172.21.15.84:0/1289098636 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f442008ab30 con 0x7f443806d420 2023-07-14T11:17:51.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.492+0000 7f4437fff700 1 --2- 172.21.15.84:0/1289098636 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f441806b040 0x7f441806d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:51.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.492+0000 7f4437fff700 1 --2- 172.21.15.84:0/1289098636 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f441806b040 0x7f441806d4f0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f4428006fd0 tx=0x7f4428008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:51.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.496+0000 7f44357fa700 1 -- 172.21.15.84:0/1289098636 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f4420055b70 con 0x7f443806d420 2023-07-14T11:17:51.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.690+0000 7f443e7ff700 1 -- 172.21.15.84:0/1289098636 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f443815fb90 con 0x7f443806d420 2023-07-14T11:17:51.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.691+0000 7f44357fa700 1 -- 172.21.15.84:0/1289098636 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+14616 (secure 0 0 0) 0x7f4420059190 con 0x7f443806d420 2023-07-14T11:17:51.694 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:17:51.694 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":71,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:17:50.232575+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:17:51.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.694+0000 7f443e7ff700 1 -- 172.21.15.84:0/1289098636 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f441806b040 msgr2=0x7f441806d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:51.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.694+0000 7f443e7ff700 1 --2- 172.21.15.84:0/1289098636 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f441806b040 0x7f441806d4f0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f4428006fd0 tx=0x7f4428008040 comp rx=0 tx=0).stop 2023-07-14T11:17:51.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.694+0000 7f443e7ff700 1 -- 172.21.15.84:0/1289098636 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f443806d420 msgr2=0x7f44380b4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:51.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.694+0000 7f443e7ff700 1 --2- 172.21.15.84:0/1289098636 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f443806d420 0x7f44380b4f00 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f4438068040 tx=0x7f4420004750 comp rx=0 tx=0).stop 2023-07-14T11:17:51.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.694+0000 7f443e7ff700 1 -- 172.21.15.84:0/1289098636 shutdown_connections 2023-07-14T11:17:51.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.694+0000 7f443e7ff700 1 --2- 172.21.15.84:0/1289098636 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f441806b040 0x7f441806d4f0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:51.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.694+0000 7f443e7ff700 1 --2- 172.21.15.84:0/1289098636 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f443815e1e0 0x7f44381532c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:51.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.694+0000 7f443e7ff700 1 --2- 172.21.15.84:0/1289098636 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4438069f30 0x7f443815cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:51.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.694+0000 7f443e7ff700 1 --2- 172.21.15.84:0/1289098636 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f443806d420 0x7f44380b4f00 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:51.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.694+0000 7f443e7ff700 1 -- 172.21.15.84:0/1289098636 >> 172.21.15.84:0/1289098636 conn(0x7f44380b16c0 msgr2=0x7f44380cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:51.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.694+0000 7f443e7ff700 1 -- 172.21.15.84:0/1289098636 shutdown_connections 2023-07-14T11:17:51.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.694+0000 7f443e7ff700 1 -- 172.21.15.84:0/1289098636 wait complete. 2023-07-14T11:17:51.714 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T11:13:00.125395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T11:13:06.803994+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T11:17:51.715 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T11:17:51.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.911+0000 7f3600fff700 1 Processor -- start 2023-07-14T11:17:51.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.911+0000 7f3600fff700 1 -- start start 2023-07-14T11:17:51.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.912+0000 7f3600fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f35fc06f010 0x7f35fc071650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:51.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.912+0000 7f3600fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f35fc06a640 0x7f35fc1601d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:51.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.912+0000 7f3600fff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35fc0cdba0 con 0x7f35fc0ce030 2023-07-14T11:17:51.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.912+0000 7f3600fff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35fc06f3e0 con 0x7f35fc06a640 2023-07-14T11:17:51.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.912+0000 7f3600fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35fc0cf370 con 0x7f35fc06f010 2023-07-14T11:17:51.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.913+0000 7f35f9d9b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f35fc0ce030 0x7f35fc069f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:37026/0 (socket says 172.21.15.84:37026) 2023-07-14T11:17:51.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.913+0000 7f35fad9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f35fc06a640 0x7f35fc1601d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:51.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.913+0000 7f35f9d9b700 1 -- 172.21.15.84:0/2999143335 learned_addr learned my addr 172.21.15.84:0/2999143335 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:17:51.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.913+0000 7f35fa59c700 1 --2- 172.21.15.84:0/2999143335 >> v2:172.21.15.179:3300/0 conn(0x7f35fc06f010 0x7f35fc071650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:51.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.913+0000 7f35f959a700 1 -- 172.21.15.84:0/2999143335 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1385861659 0 0) 0x7f35fc0cdba0 con 0x7f35fc0ce030 2023-07-14T11:17:51.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.913+0000 7f35f959a700 1 -- 172.21.15.84:0/2999143335 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35e40035b0 con 0x7f35fc0ce030 2023-07-14T11:17:51.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.913+0000 7f35fad9d700 1 -- 172.21.15.84:0/2999143335 >> v2:172.21.15.179:3300/0 conn(0x7f35fc06f010 msgr2=0x7f35fc071650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:51.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.913+0000 7f35fad9d700 1 --2- 172.21.15.84:0/2999143335 >> v2:172.21.15.179:3300/0 conn(0x7f35fc06f010 0x7f35fc071650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:51.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.913+0000 7f35fad9d700 1 -- 172.21.15.84:0/2999143335 >> v1:172.21.15.84:6789/0 conn(0x7f35fc0ce030 legacy=0x7f35fc069f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:51.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.913+0000 7f35fad9d700 1 -- 172.21.15.84:0/2999143335 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35fc0cf650 con 0x7f35fc06a640 2023-07-14T11:17:51.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.913+0000 7f35fad9d700 1 --2- 172.21.15.84:0/2999143335 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35fc06a640 0x7f35fc1601d0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f35fc0cd6c0 tx=0x7f35f400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44c9dcfb2e6f9eb6 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:51.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.914+0000 7f35f959a700 1 -- 172.21.15.84:0/2999143335 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f400e070 con 0x7f35fc06a640 2023-07-14T11:17:51.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.914+0000 7f35f959a700 1 -- 172.21.15.84:0/2999143335 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35f400bb20 con 0x7f35fc06a640 2023-07-14T11:17:51.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.914+0000 7f35f959a700 1 -- 172.21.15.84:0/2999143335 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f4012430 con 0x7f35fc06a640 2023-07-14T11:17:51.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.914+0000 7f3600fff700 1 -- 172.21.15.84:0/2999143335 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35fc06a640 msgr2=0x7f35fc1601d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:51.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.914+0000 7f3600fff700 1 --2- 172.21.15.84:0/2999143335 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35fc06a640 0x7f35fc1601d0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f35fc0cd6c0 tx=0x7f35f400b330 comp rx=0 tx=0).stop 2023-07-14T11:17:51.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.914+0000 7f3600fff700 1 -- 172.21.15.84:0/2999143335 shutdown_connections 2023-07-14T11:17:51.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.914+0000 7f3600fff700 1 --2- 172.21.15.84:0/2999143335 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35fc06a640 0x7f35fc1601d0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:51.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.914+0000 7f3600fff700 1 --2- 172.21.15.84:0/2999143335 >> v2:172.21.15.179:3300/0 conn(0x7f35fc06f010 0x7f35fc071650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:51.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.914+0000 7f3600fff700 1 -- 172.21.15.84:0/2999143335 >> 172.21.15.84:0/2999143335 conn(0x7f35fc0cc640 msgr2=0x7f35fc0cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:51.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.914+0000 7f3600fff700 1 -- 172.21.15.84:0/2999143335 shutdown_connections 2023-07-14T11:17:51.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.914+0000 7f3600fff700 1 -- 172.21.15.84:0/2999143335 wait complete. 2023-07-14T11:17:51.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.917+0000 7f3600fff700 1 Processor -- start 2023-07-14T11:17:51.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.917+0000 7f3600fff700 1 -- start start 2023-07-14T11:17:51.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.918+0000 7f3600fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35fc06a640 0x7f35fc0c83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:51.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.918+0000 7f3600fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35fc06f010 0x7f35fc14b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:51.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.918+0000 7f3600fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35fc0ce030 0x7f35fc148300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:51.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.918+0000 7f3600fff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35fc0c8aa0 con 0x7f35fc0ce030 2023-07-14T11:17:51.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.918+0000 7f3600fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35fc0c8d80 con 0x7f35fc06f010 2023-07-14T11:17:51.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.918+0000 7f3600fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35fc0c9060 con 0x7f35fc06a640 2023-07-14T11:17:51.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.918+0000 7f35fad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35fc0ce030 0x7f35fc148300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:51.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.918+0000 7f35fad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35fc0ce030 0x7f35fc148300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44872/0 (socket says 172.21.15.84:44872) 2023-07-14T11:17:51.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.919+0000 7f35fad9d700 1 -- 172.21.15.84:0/3473944876 learned_addr learned my addr 172.21.15.84:0/3473944876 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:51.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.919+0000 7f35f9d9b700 1 --2- 172.21.15.84:0/3473944876 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35fc06f010 0x7f35fc14b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:51.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.919+0000 7f35fa59c700 1 --2- 172.21.15.84:0/3473944876 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35fc06a640 0x7f35fc0c83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:51.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.919+0000 7f35fad9d700 1 -- 172.21.15.84:0/3473944876 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35fc06a640 msgr2=0x7f35fc0c83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:51.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.919+0000 7f35fad9d700 1 --2- 172.21.15.84:0/3473944876 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35fc06a640 0x7f35fc0c83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:51.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.919+0000 7f35fad9d700 1 -- 172.21.15.84:0/3473944876 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35fc06f010 msgr2=0x7f35fc14b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:51.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.919+0000 7f35fad9d700 1 --2- 172.21.15.84:0/3473944876 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35fc06f010 0x7f35fc14b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:51.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.919+0000 7f35fad9d700 1 -- 172.21.15.84:0/3473944876 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35f4009a70 con 0x7f35fc0ce030 2023-07-14T11:17:51.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.919+0000 7f35fad9d700 1 --2- 172.21.15.84:0/3473944876 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35fc0ce030 0x7f35fc148300 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f35f4014040 tx=0x7f35f4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:51.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.919+0000 7f35eaffd700 1 -- 172.21.15.84:0/3473944876 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f4012430 con 0x7f35fc0ce030 2023-07-14T11:17:51.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.919+0000 7f35eaffd700 1 -- 172.21.15.84:0/3473944876 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35f4020070 con 0x7f35fc0ce030 2023-07-14T11:17:51.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.919+0000 7f3600fff700 1 -- 172.21.15.84:0/3473944876 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35fc0c9340 con 0x7f35fc0ce030 2023-07-14T11:17:51.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.919+0000 7f35eaffd700 1 -- 172.21.15.84:0/3473944876 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f4004280 con 0x7f35fc0ce030 2023-07-14T11:17:51.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.920+0000 7f3600fff700 1 -- 172.21.15.84:0/3473944876 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35fc14bb60 con 0x7f35fc0ce030 2023-07-14T11:17:51.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.920+0000 7f3600fff700 1 -- 172.21.15.84:0/3473944876 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35fc0c9860 con 0x7f35fc0ce030 2023-07-14T11:17:51.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.922+0000 7f35eaffd700 1 -- 172.21.15.84:0/3473944876 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7f35f40043e0 con 0x7f35fc0ce030 2023-07-14T11:17:51.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.922+0000 7f35eaffd700 1 --2- 172.21.15.84:0/3473944876 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f35dc06b040 0x7f35dc06d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:51.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.923+0000 7f35eaffd700 1 -- 172.21.15.84:0/3473944876 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f35f4022070 con 0x7f35fc0ce030 2023-07-14T11:17:51.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.923+0000 7f35fa59c700 1 --2- 172.21.15.84:0/3473944876 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f35dc06b040 0x7f35dc06d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:51.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.923+0000 7f35fa59c700 1 --2- 172.21.15.84:0/3473944876 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f35dc06b040 0x7f35dc06d4f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f35ec009b70 tx=0x7f35ec008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:51.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:51.927+0000 7f35eaffd700 1 -- 172.21.15.84:0/3473944876 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f35fc0c9860 con 0x7f35fc0ce030 2023-07-14T11:17:52.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.122+0000 7f3600fff700 1 -- 172.21.15.84:0/3473944876 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f35fc0c9860 con 0x7f35fc0ce030 2023-07-14T11:17:52.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.123+0000 7f35eaffd700 1 -- 172.21.15.84:0/3473944876 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v71) v1 ==== 93+0+10 (secure 0 0 0) 0x7f35fc0c9860 con 0x7f35fc0ce030 2023-07-14T11:17:52.125 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-07-14T11:17:52.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.125+0000 7f3600fff700 1 -- 172.21.15.84:0/3473944876 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f35dc06b040 msgr2=0x7f35dc06d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:52.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.125+0000 7f3600fff700 1 --2- 172.21.15.84:0/3473944876 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f35dc06b040 0x7f35dc06d4f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f35ec009b70 tx=0x7f35ec008040 comp rx=0 tx=0).stop 2023-07-14T11:17:52.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.125+0000 7f3600fff700 1 -- 172.21.15.84:0/3473944876 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35fc0ce030 msgr2=0x7f35fc148300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:52.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.125+0000 7f3600fff700 1 --2- 172.21.15.84:0/3473944876 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35fc0ce030 0x7f35fc148300 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f35f4014040 tx=0x7f35f4004ad0 comp rx=0 tx=0).stop 2023-07-14T11:17:52.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.125+0000 7f3600fff700 1 -- 172.21.15.84:0/3473944876 shutdown_connections 2023-07-14T11:17:52.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.125+0000 7f3600fff700 1 --2- 172.21.15.84:0/3473944876 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f35dc06b040 0x7f35dc06d4f0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:52.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.125+0000 7f3600fff700 1 --2- 172.21.15.84:0/3473944876 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35fc06a640 0x7f35fc0c83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:52.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.125+0000 7f3600fff700 1 --2- 172.21.15.84:0/3473944876 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35fc0ce030 0x7f35fc148300 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:52.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.125+0000 7f3600fff700 1 --2- 172.21.15.84:0/3473944876 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35fc06f010 0x7f35fc14b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:52.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.125+0000 7f3600fff700 1 -- 172.21.15.84:0/3473944876 >> 172.21.15.84:0/3473944876 conn(0x7f35fc0cc640 msgr2=0x7f35fc06c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:52.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.125+0000 7f3600fff700 1 -- 172.21.15.84:0/3473944876 shutdown_connections 2023-07-14T11:17:52.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.125+0000 7f3600fff700 1 -- 172.21.15.84:0/3473944876 wait complete. 2023-07-14T11:17:52.146 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T11:17:52.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.345+0000 7fdff85ff700 1 Processor -- start 2023-07-14T11:17:52.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.345+0000 7fdff85ff700 1 -- start start 2023-07-14T11:17:52.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.346+0000 7fdff85ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdff00c92d0 0x7fdff00ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:52.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.346+0000 7fdff85ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fdff00adea0 0x7fdff00cc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:52.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.346+0000 7fdff85ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdff015ce70 con 0x7fdff00b12f0 2023-07-14T11:17:52.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.346+0000 7fdff85ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdff015da60 con 0x7fdff00adea0 2023-07-14T11:17:52.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.347+0000 7fdff85ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdff015d0c0 con 0x7fdff00c92d0 2023-07-14T11:17:52.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.347+0000 7fdff639b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdff00c92d0 0x7fdff00ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:52.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.347+0000 7fdff639b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdff00c92d0 0x7fdff00ad8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.84:45860/0 (socket says 172.21.15.84:45860) 2023-07-14T11:17:52.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.347+0000 7fdff639b700 1 -- 172.21.15.84:0/1600710195 learned_addr learned my addr 172.21.15.84:0/1600710195 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:52.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.347+0000 7fdff6b9c700 1 --2- 172.21.15.84:0/1600710195 >> v2:172.21.15.179:3300/0 conn(0x7fdff00adea0 0x7fdff00cc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:52.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.347+0000 7fdff639b700 1 -- 172.21.15.84:0/1600710195 >> v2:172.21.15.179:3300/0 conn(0x7fdff00adea0 msgr2=0x7fdff00cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:52.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.347+0000 7fdff639b700 1 --2- 172.21.15.84:0/1600710195 >> v2:172.21.15.179:3300/0 conn(0x7fdff00adea0 0x7fdff00cc690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:52.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.347+0000 7fdff639b700 1 -- 172.21.15.84:0/1600710195 >> v1:172.21.15.179:6789/0 conn(0x7fdff00b12f0 legacy=0x7fdff00c96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:52.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.348+0000 7fdff639b700 1 -- 172.21.15.84:0/1600710195 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff015d3a0 con 0x7fdff00c92d0 2023-07-14T11:17:52.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.348+0000 7fdff5399700 1 -- 172.21.15.84:0/1600710195 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2928597001 0 0) 0x7fdff015ce70 con 0x7fdff00b12f0 2023-07-14T11:17:52.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.348+0000 7fdff639b700 1 --2- 172.21.15.84:0/1600710195 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdff00c92d0 0x7fdff00ad8f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdfec0098f0 tx=0x7fdfec009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f201b9e256a26d59 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:52.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.348+0000 7fdff5399700 1 -- 172.21.15.84:0/1600710195 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfec011830 con 0x7fdff00c92d0 2023-07-14T11:17:52.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.348+0000 7fdff5399700 1 -- 172.21.15.84:0/1600710195 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfec011990 con 0x7fdff00c92d0 2023-07-14T11:17:52.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.348+0000 7fdff5399700 1 -- 172.21.15.84:0/1600710195 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfec011d20 con 0x7fdff00c92d0 2023-07-14T11:17:52.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.349+0000 7fdff85ff700 1 -- 172.21.15.84:0/1600710195 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdff00c92d0 msgr2=0x7fdff00ad8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:52.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.349+0000 7fdff85ff700 1 --2- 172.21.15.84:0/1600710195 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdff00c92d0 0x7fdff00ad8f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdfec0098f0 tx=0x7fdfec009c00 comp rx=0 tx=0).stop 2023-07-14T11:17:52.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.349+0000 7fdff85ff700 1 -- 172.21.15.84:0/1600710195 shutdown_connections 2023-07-14T11:17:52.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.349+0000 7fdff85ff700 1 --2- 172.21.15.84:0/1600710195 >> v2:172.21.15.179:3300/0 conn(0x7fdff00adea0 0x7fdff00cc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:52.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.349+0000 7fdff85ff700 1 --2- 172.21.15.84:0/1600710195 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdff00c92d0 0x7fdff00ad8f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:52.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.349+0000 7fdff85ff700 1 -- 172.21.15.84:0/1600710195 >> 172.21.15.84:0/1600710195 conn(0x7fdff00b05d0 msgr2=0x7fdff00b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:52.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.349+0000 7fdff85ff700 1 -- 172.21.15.84:0/1600710195 shutdown_connections 2023-07-14T11:17:52.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.349+0000 7fdff85ff700 1 -- 172.21.15.84:0/1600710195 wait complete. 2023-07-14T11:17:52.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.351+0000 7fdff85ff700 1 Processor -- start 2023-07-14T11:17:52.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.351+0000 7fdff85ff700 1 -- start start 2023-07-14T11:17:52.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.352+0000 7fdff85ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdff00adea0 0x7fdff01ef380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:52.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.352+0000 7fdff85ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdff00b12f0 0x7fdff01f0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:52.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.352+0000 7fdff85ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdff00c92d0 0x7fdff01f03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:52.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.352+0000 7fdff85ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff01f1010 con 0x7fdff00c92d0 2023-07-14T11:17:52.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.352+0000 7fdff85ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff01f0910 con 0x7fdff00b12f0 2023-07-14T11:17:52.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.352+0000 7fdff85ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdff00b1d10 con 0x7fdff00adea0 2023-07-14T11:17:52.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.352+0000 7fdff6b9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdff00c92d0 0x7fdff01f03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:52.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.352+0000 7fdff639b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdff00adea0 0x7fdff01ef380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:52.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.352+0000 7fdff6b9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdff00c92d0 0x7fdff01f03d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44878/0 (socket says 172.21.15.84:44878) 2023-07-14T11:17:52.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.352+0000 7fdff639b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdff00adea0 0x7fdff01ef380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.84:45872/0 (socket says 172.21.15.84:45872) 2023-07-14T11:17:52.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.352+0000 7fdff6b9c700 1 -- 172.21.15.84:0/2839383388 learned_addr learned my addr 172.21.15.84:0/2839383388 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:52.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.352+0000 7fdff5b9a700 1 --2- 172.21.15.84:0/2839383388 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdff00b12f0 0x7fdff01f0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:52.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.352+0000 7fdff639b700 1 -- 172.21.15.84:0/2839383388 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdff00b12f0 msgr2=0x7fdff01f0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:52.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.352+0000 7fdff639b700 1 --2- 172.21.15.84:0/2839383388 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdff00b12f0 0x7fdff01f0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:52.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.352+0000 7fdff639b700 1 -- 172.21.15.84:0/2839383388 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdff00c92d0 msgr2=0x7fdff01f03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:52.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.352+0000 7fdff639b700 1 --2- 172.21.15.84:0/2839383388 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdff00c92d0 0x7fdff01f03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:52.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.352+0000 7fdff639b700 1 -- 172.21.15.84:0/2839383388 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfec009550 con 0x7fdff00adea0 2023-07-14T11:17:52.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.352+0000 7fdff6b9c700 1 --2- 172.21.15.84:0/2839383388 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdff00c92d0 0x7fdff01f03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:17:52.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.353+0000 7fdff639b700 1 --2- 172.21.15.84:0/2839383388 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdff00adea0 0x7fdff01ef380 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fdfec016000 tx=0x7fdfec004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:52.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.353+0000 7fdfe6ffd700 1 -- 172.21.15.84:0/2839383388 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfec004590 con 0x7fdff00adea0 2023-07-14T11:17:52.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.353+0000 7fdfe6ffd700 1 -- 172.21.15.84:0/2839383388 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfec0036a0 con 0x7fdff00adea0 2023-07-14T11:17:52.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.353+0000 7fdfe6ffd700 1 -- 172.21.15.84:0/2839383388 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfec003a30 con 0x7fdff00adea0 2023-07-14T11:17:52.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.353+0000 7fdff85ff700 1 -- 172.21.15.84:0/2839383388 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdff00b1ff0 con 0x7fdff00adea0 2023-07-14T11:17:52.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.353+0000 7fdff85ff700 1 -- 172.21.15.84:0/2839383388 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdff00b25b0 con 0x7fdff00adea0 2023-07-14T11:17:52.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.354+0000 7fdff85ff700 1 -- 172.21.15.84:0/2839383388 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdff0074350 con 0x7fdff00adea0 2023-07-14T11:17:52.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.355+0000 7fdfe6ffd700 1 -- 172.21.15.84:0/2839383388 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7fdfec003b90 con 0x7fdff00adea0 2023-07-14T11:17:52.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.356+0000 7fdfe6ffd700 1 --2- 172.21.15.84:0/2839383388 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fdfd406b040 0x7fdfd406d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:52.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.356+0000 7fdfe6ffd700 1 -- 172.21.15.84:0/2839383388 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fdfec021030 con 0x7fdff00adea0 2023-07-14T11:17:52.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.356+0000 7fdff5b9a700 1 --2- 172.21.15.84:0/2839383388 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fdfd406b040 0x7fdfd406d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:52.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.357+0000 7fdff5b9a700 1 --2- 172.21.15.84:0/2839383388 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fdfd406b040 0x7fdfd406d4f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fdff01f2e60 tx=0x7fdfe0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:52.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.361+0000 7fdfe6ffd700 1 -- 172.21.15.84:0/2839383388 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fdfec055c20 con 0x7fdff00adea0 2023-07-14T11:17:52.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.556+0000 7fdff85ff700 1 -- 172.21.15.84:0/2839383388 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fdff00b4a40 con 0x7fdff00adea0 2023-07-14T11:17:52.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.557+0000 7fdfe6ffd700 1 -- 172.21.15.84:0/2839383388 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v71) v1 ==== 92+0+10 (secure 0 0 0) 0x7fdfec0150a0 con 0x7fdff00adea0 2023-07-14T11:17:52.559 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-07-14T11:17:52.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.559+0000 7fdff85ff700 1 -- 172.21.15.84:0/2839383388 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fdfd406b040 msgr2=0x7fdfd406d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:52.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.559+0000 7fdff85ff700 1 --2- 172.21.15.84:0/2839383388 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fdfd406b040 0x7fdfd406d4f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fdff01f2e60 tx=0x7fdfe0009040 comp rx=0 tx=0).stop 2023-07-14T11:17:52.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.559+0000 7fdff85ff700 1 -- 172.21.15.84:0/2839383388 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdff00adea0 msgr2=0x7fdff01ef380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:52.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.559+0000 7fdff85ff700 1 --2- 172.21.15.84:0/2839383388 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdff00adea0 0x7fdff01ef380 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fdfec016000 tx=0x7fdfec004750 comp rx=0 tx=0).stop 2023-07-14T11:17:52.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.559+0000 7fdff85ff700 1 -- 172.21.15.84:0/2839383388 shutdown_connections 2023-07-14T11:17:52.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.559+0000 7fdff85ff700 1 --2- 172.21.15.84:0/2839383388 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fdfd406b040 0x7fdfd406d4f0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:52.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.559+0000 7fdff85ff700 1 --2- 172.21.15.84:0/2839383388 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdff00adea0 0x7fdff01ef380 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:52.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.559+0000 7fdff85ff700 1 --2- 172.21.15.84:0/2839383388 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdff00c92d0 0x7fdff01f03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:52.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.559+0000 7fdff85ff700 1 --2- 172.21.15.84:0/2839383388 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdff00b12f0 0x7fdff01f0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:52.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.559+0000 7fdff85ff700 1 -- 172.21.15.84:0/2839383388 >> 172.21.15.84:0/2839383388 conn(0x7fdff00b05d0 msgr2=0x7fdff00ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:52.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.559+0000 7fdff85ff700 1 -- 172.21.15.84:0/2839383388 shutdown_connections 2023-07-14T11:17:52.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.559+0000 7fdff85ff700 1 -- 172.21.15.84:0/2839383388 wait complete. 2023-07-14T11:17:52.579 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-14T11:17:52.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.771+0000 7f5dd5bff700 1 Processor -- start 2023-07-14T11:17:52.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.772+0000 7f5dd5bff700 1 -- start start 2023-07-14T11:17:52.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.773+0000 7f5dd5bff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5dd00d1220 0x7f5dd00b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:52.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.773+0000 7f5dd5bff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dd00d2ce0 con 0x7f5dd015c950 2023-07-14T11:17:52.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.773+0000 7f5dd5bff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dd00b3350 con 0x7f5dd00b1e00 2023-07-14T11:17:52.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.773+0000 7f5dd5bff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dd00b3630 con 0x7f5dd00d1220 2023-07-14T11:17:52.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.773+0000 7f5dcf7fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f5dd015c950 0x7f5dd00d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:37030/0 (socket says 172.21.15.84:37030) 2023-07-14T11:17:52.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.773+0000 7f5dcf7fe700 1 -- 172.21.15.84:0/3300316896 learned_addr learned my addr 172.21.15.84:0/3300316896 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:17:52.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.773+0000 7f5dceffd700 1 --2- 172.21.15.84:0/3300316896 >> v2:172.21.15.179:3300/0 conn(0x7f5dd00d1220 0x7f5dd00b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:52.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.773+0000 7f5dce7fc700 1 -- 172.21.15.84:0/3300316896 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 720211266 0 0) 0x7f5dd00d2ce0 con 0x7f5dd015c950 2023-07-14T11:17:52.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.774+0000 7f5dce7fc700 1 -- 172.21.15.84:0/3300316896 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5db80035b0 con 0x7f5dd015c950 2023-07-14T11:17:52.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.774+0000 7f5dceffd700 1 -- 172.21.15.84:0/3300316896 >> v1:172.21.15.179:6789/0 conn(0x7f5dd00b1e00 legacy=0x7f5dd00afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:52.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.774+0000 7f5dceffd700 1 -- 172.21.15.84:0/3300316896 >> v1:172.21.15.84:6789/0 conn(0x7f5dd015c950 legacy=0x7f5dd00d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:52.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.774+0000 7f5dceffd700 1 -- 172.21.15.84:0/3300316896 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dd00b3910 con 0x7f5dd00d1220 2023-07-14T11:17:52.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.774+0000 7f5dceffd700 1 --2- 172.21.15.84:0/3300316896 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5dd00d1220 0x7f5dd00b43f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f5dc4009840 tx=0x7f5dc4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=301242353d28f6ed server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:52.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.774+0000 7f5dce7fc700 1 -- 172.21.15.84:0/3300316896 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc4011830 con 0x7f5dd00d1220 2023-07-14T11:17:52.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.774+0000 7f5dce7fc700 1 -- 172.21.15.84:0/3300316896 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dc4011990 con 0x7f5dd00d1220 2023-07-14T11:17:52.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.774+0000 7f5dce7fc700 1 -- 172.21.15.84:0/3300316896 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc4011d20 con 0x7f5dd00d1220 2023-07-14T11:17:52.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.775+0000 7f5dd5bff700 1 -- 172.21.15.84:0/3300316896 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5dd00d1220 msgr2=0x7f5dd00b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:52.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.775+0000 7f5dd5bff700 1 --2- 172.21.15.84:0/3300316896 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5dd00d1220 0x7f5dd00b43f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f5dc4009840 tx=0x7f5dc4009b50 comp rx=0 tx=0).stop 2023-07-14T11:17:52.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.775+0000 7f5dd5bff700 1 -- 172.21.15.84:0/3300316896 shutdown_connections 2023-07-14T11:17:52.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.775+0000 7f5dd5bff700 1 --2- 172.21.15.84:0/3300316896 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5dd00d1220 0x7f5dd00b43f0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:52.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.775+0000 7f5dd5bff700 1 -- 172.21.15.84:0/3300316896 >> 172.21.15.84:0/3300316896 conn(0x7f5dd009c1d0 msgr2=0x7f5dd00d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:52.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.775+0000 7f5dd5bff700 1 -- 172.21.15.84:0/3300316896 shutdown_connections 2023-07-14T11:17:52.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.775+0000 7f5dd5bff700 1 -- 172.21.15.84:0/3300316896 wait complete. 2023-07-14T11:17:52.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.777+0000 7f5dd5bff700 1 Processor -- start 2023-07-14T11:17:52.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.777+0000 7f5dd5bff700 1 -- start start 2023-07-14T11:17:52.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.778+0000 7f5dd5bff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5dd00b1e00 0x7f5dd00c9240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:52.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.778+0000 7f5dd5bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5dd00d1220 0x7f5dd00cfe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:52.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.778+0000 7f5dd5bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5dd015c950 0x7f5dd006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:52.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.778+0000 7f5dd5bff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd014fce0 con 0x7f5dd00b1e00 2023-07-14T11:17:52.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.778+0000 7f5dd5bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd00c9780 con 0x7f5dd015c950 2023-07-14T11:17:52.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.778+0000 7f5dd5bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd00d0360 con 0x7f5dd00d1220 2023-07-14T11:17:52.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.778+0000 7f5dcf7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5dd00b1e00 0x7f5dd00c9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:52.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.778+0000 7f5dcf7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5dd00b1e00 0x7f5dd00c9240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44882/0 (socket says 172.21.15.84:44882) 2023-07-14T11:17:52.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.778+0000 7f5dcf7fe700 1 -- 172.21.15.84:0/555242016 learned_addr learned my addr 172.21.15.84:0/555242016 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:52.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.778+0000 7f5dcf7fe700 1 -- 172.21.15.84:0/555242016 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5dd00d1220 msgr2=0x7f5dd00cfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:52.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.778+0000 7f5dcf7fe700 1 --2- 172.21.15.84:0/555242016 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5dd00d1220 0x7f5dd00cfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:52.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.778+0000 7f5dcf7fe700 1 -- 172.21.15.84:0/555242016 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5dd015c950 msgr2=0x7f5dd006b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:52.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.778+0000 7f5dcf7fe700 1 --2- 172.21.15.84:0/555242016 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5dd015c950 0x7f5dd006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:52.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.778+0000 7f5dcf7fe700 1 -- 172.21.15.84:0/555242016 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dc40094a0 con 0x7f5dd00b1e00 2023-07-14T11:17:52.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.779+0000 7f5dcf7fe700 1 --2- 172.21.15.84:0/555242016 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5dd00b1e00 0x7f5dd00c9240 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f5dc0001260 tx=0x7f5dc000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:52.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.779+0000 7f5db7fff700 1 -- 172.21.15.84:0/555242016 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc00074e0 con 0x7f5dd00b1e00 2023-07-14T11:17:52.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.779+0000 7f5db7fff700 1 -- 172.21.15.84:0/555242016 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dc0007640 con 0x7f5dd00b1e00 2023-07-14T11:17:52.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.779+0000 7f5dd5bff700 1 -- 172.21.15.84:0/555242016 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dd00c6c10 con 0x7f5dd00b1e00 2023-07-14T11:17:52.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.779+0000 7f5db7fff700 1 -- 172.21.15.84:0/555242016 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc0005a50 con 0x7f5dd00b1e00 2023-07-14T11:17:52.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.779+0000 7f5dd5bff700 1 -- 172.21.15.84:0/555242016 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dd00b5e10 con 0x7f5dd00b1e00 2023-07-14T11:17:52.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.780+0000 7f5dd5bff700 1 -- 172.21.15.84:0/555242016 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dd006a3e0 con 0x7f5dd00b1e00 2023-07-14T11:17:52.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.781+0000 7f5db7fff700 1 -- 172.21.15.84:0/555242016 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7f5dc0005bb0 con 0x7f5dd00b1e00 2023-07-14T11:17:52.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.782+0000 7f5db7fff700 1 --2- 172.21.15.84:0/555242016 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f5dbc06b040 0x7f5dbc06d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:52.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.782+0000 7f5db7fff700 1 -- 172.21.15.84:0/555242016 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f5dc0088be0 con 0x7f5dd00b1e00 2023-07-14T11:17:52.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.782+0000 7f5dceffd700 1 --2- 172.21.15.84:0/555242016 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f5dbc06b040 0x7f5dbc06d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:52.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.783+0000 7f5dceffd700 1 --2- 172.21.15.84:0/555242016 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f5dbc06b040 0x7f5dbc06d4f0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f5dd00d1610 tx=0x7f5dc4010000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:52.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.786+0000 7f5db7fff700 1 -- 172.21.15.84:0/555242016 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f5dc0053bd0 con 0x7f5dd00b1e00 2023-07-14T11:17:52.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.986+0000 7f5dd5bff700 1 -- 172.21.15.84:0/555242016 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f5dd004e280 con 0x7f5dd00b1e00 2023-07-14T11:17:52.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.987+0000 7f5db7fff700 1 -- 172.21.15.84:0/555242016 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v71) v1 ==== 84+0+126 (secure 0 0 0) 0x7f5dc0017090 con 0x7f5dd00b1e00 2023-07-14T11:17:52.990 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:17:52.990 INFO:teuthology.orchestra.run.smithi084.stdout:[ 2023-07-14T11:17:52.990 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:17:52.990 INFO:teuthology.orchestra.run.smithi084.stdout: "poolnum": 1, 2023-07-14T11:17:52.990 INFO:teuthology.orchestra.run.smithi084.stdout: "poolname": ".mgr" 2023-07-14T11:17:52.990 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:17:52.991 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:17:52.991 INFO:teuthology.orchestra.run.smithi084.stdout: "poolnum": 2, 2023-07-14T11:17:52.991 INFO:teuthology.orchestra.run.smithi084.stdout: "poolname": "rbd" 2023-07-14T11:17:52.991 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:17:52.991 INFO:teuthology.orchestra.run.smithi084.stdout:] 2023-07-14T11:17:52.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.989+0000 7f5dd5bff700 1 -- 172.21.15.84:0/555242016 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f5dbc06b040 msgr2=0x7f5dbc06d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:52.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.989+0000 7f5dd5bff700 1 --2- 172.21.15.84:0/555242016 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f5dbc06b040 0x7f5dbc06d4f0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f5dd00d1610 tx=0x7f5dc4010000 comp rx=0 tx=0).stop 2023-07-14T11:17:52.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.989+0000 7f5dd5bff700 1 -- 172.21.15.84:0/555242016 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5dd00b1e00 msgr2=0x7f5dd00c9240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:52.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.989+0000 7f5dd5bff700 1 --2- 172.21.15.84:0/555242016 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5dd00b1e00 0x7f5dd00c9240 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f5dc0001260 tx=0x7f5dc000c860 comp rx=0 tx=0).stop 2023-07-14T11:17:52.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.989+0000 7f5dd5bff700 1 -- 172.21.15.84:0/555242016 shutdown_connections 2023-07-14T11:17:52.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.989+0000 7f5dd5bff700 1 --2- 172.21.15.84:0/555242016 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5dd015c950 0x7f5dd006b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:52.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.989+0000 7f5dd5bff700 1 --2- 172.21.15.84:0/555242016 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5dd00b1e00 0x7f5dd00c9240 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:52.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.989+0000 7f5dd5bff700 1 --2- 172.21.15.84:0/555242016 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f5dbc06b040 0x7f5dbc06d4f0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:52.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.989+0000 7f5dd5bff700 1 --2- 172.21.15.84:0/555242016 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5dd00d1220 0x7f5dd00cfe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:52.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.989+0000 7f5dd5bff700 1 -- 172.21.15.84:0/555242016 >> 172.21.15.84:0/555242016 conn(0x7f5dd009c1d0 msgr2=0x7f5dd00b5280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:52.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.989+0000 7f5dd5bff700 1 -- 172.21.15.84:0/555242016 shutdown_connections 2023-07-14T11:17:52.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:52.989+0000 7f5dd5bff700 1 -- 172.21.15.84:0/555242016 wait complete. 2023-07-14T11:17:53.009 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-14T11:17:53.010 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-14T11:17:53.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:53.207+0000 7ff5837ff700 1 Processor -- start 2023-07-14T11:17:53.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:53.207+0000 7ff5837ff700 1 -- start start 2023-07-14T11:17:53.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:53.208+0000 7ff5837ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff57c0cf6b0 0x7ff57c0b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:53.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:53.208+0000 7ff5837ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff57c0b2cb0 0x7ff57c0b3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:53.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:53.208+0000 7ff5837ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff57c151830 con 0x7ff57c151460 2023-07-14T11:17:53.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:53.208+0000 7ff5837ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff57c0ce420 con 0x7ff57c0cf6b0 2023-07-14T11:17:53.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:53.208+0000 7ff5837ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff57c0b3650 con 0x7ff57c0b2cb0 2023-07-14T11:17:53.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:53.209+0000 7ff580d9a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff57c0cf6b0 0x7ff57c0b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:53.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:53.209+0000 7ff580d9a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff57c0cf6b0 0x7ff57c0b2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44892/0 (socket says 172.21.15.84:44892) 2023-07-14T11:17:53.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:53.209+0000 7ff580d9a700 1 -- 172.21.15.84:0/3086242304 learned_addr learned my addr 172.21.15.84:0/3086242304 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:53.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:53.209+0000 7ff581d9c700 1 --2- 172.21.15.84:0/3086242304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff57c0b2cb0 0x7ff57c0b3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:53.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:53.209+0000 7ff580d9a700 1 -- 172.21.15.84:0/3086242304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff57c0b2cb0 msgr2=0x7ff57c0b3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:53.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:53.209+0000 7ff580d9a700 1 --2- 172.21.15.84:0/3086242304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff57c0b2cb0 0x7ff57c0b3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:53.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:53.209+0000 7ff580d9a700 1 -- 172.21.15.84:0/3086242304 >> v1:172.21.15.179:6789/0 conn(0x7ff57c151460 legacy=0x7ff57c0cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:53.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:53.209+0000 7ff580d9a700 1 -- 172.21.15.84:0/3086242304 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff57c0b20d0 con 0x7ff57c0cf6b0 2023-07-14T11:17:53.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:53.209+0000 7ff580d9a700 1 --2- 172.21.15.84:0/3086242304 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff57c0cf6b0 0x7ff57c0b2560 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7ff56c0098f0 tx=0x7ff56c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a43cb43b89c9415b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:53.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:53.210+0000 7ff573fff700 1 -- 172.21.15.84:0/3086242304 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56c00b8a0 con 0x7ff57c0cf6b0 2023-07-14T11:17:53.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:53.210+0000 7ff573fff700 1 -- 172.21.15.84:0/3086242304 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff56c00ba00 con 0x7ff57c0cf6b0 2023-07-14T11:17:53.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:53.210+0000 7ff573fff700 1 -- 172.21.15.84:0/3086242304 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56c00bd90 con 0x7ff57c0cf6b0 2023-07-14T11:17:53.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:53.210+0000 7ff5837ff700 1 -- 172.21.15.84:0/3086242304 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff57c0cf6b0 msgr2=0x7ff57c0b2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:53.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:53.210+0000 7ff5837ff700 1 --2- 172.21.15.84:0/3086242304 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff57c0cf6b0 0x7ff57c0b2560 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7ff56c0098f0 tx=0x7ff56c009c00 comp rx=0 tx=0).stop 2023-07-14T11:17:53.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:53.210+0000 7ff5837ff700 1 -- 172.21.15.84:0/3086242304 shutdown_connections 2023-07-14T11:17:53.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:53.210+0000 7ff5837ff700 1 --2- 172.21.15.84:0/3086242304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff57c0b2cb0 0x7ff57c0b3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:53.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:53.210+0000 7ff5837ff700 1 --2- 172.21.15.84:0/3086242304 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff57c0cf6b0 0x7ff57c0b2560 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:53.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:53.210+0000 7ff5837ff700 1 -- 172.21.15.84:0/3086242304 >> 172.21.15.84:0/3086242304 conn(0x7ff57c065bd0 msgr2=0x7ff57c065fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:53.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:53.210+0000 7ff5837ff700 1 -- 172.21.15.84:0/3086242304 shutdown_connections 2023-07-14T11:17:53.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:53.210+0000 7ff5837ff700 1 -- 172.21.15.84:0/3086242304 wait complete. 2023-07-14T11:17:53.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:53.212+0000 7ff5837ff700 1 Processor -- start 2023-07-14T11:17:53.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:53.212+0000 7ff5837ff700 1 -- start start 2023-07-14T11:17:53.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:53.213+0000 7ff5837ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff57c0b2cb0 0x7ff57c14ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:53.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:53.213+0000 7ff5837ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff57c0cf6b0 0x7ff57c15cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:53.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:53.213+0000 7ff5837ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff57c151460 0x7ff57c13e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:53.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:53.213+0000 7ff5837ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff57c15d110 con 0x7ff57c151460 2023-07-14T11:17:53.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:53.213+0000 7ff5837ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff57c15d3f0 con 0x7ff57c0b2cb0 2023-07-14T11:17:53.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:53.213+0000 7ff5837ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff57c15d6d0 con 0x7ff57c0cf6b0 2023-07-14T11:17:53.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:53.213+0000 7ff581d9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff57c151460 0x7ff57c13e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:53.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:53.213+0000 7ff581d9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff57c151460 0x7ff57c13e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44904/0 (socket says 172.21.15.84:44904) 2023-07-14T11:17:53.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:53.213+0000 7ff581d9c700 1 -- 172.21.15.84:0/2781291062 learned_addr learned my addr 172.21.15.84:0/2781291062 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:53.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:53.214+0000 7ff58159b700 1 --2- 172.21.15.84:0/2781291062 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff57c0b2cb0 0x7ff57c14ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:53.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:53.214+0000 7ff580d9a700 1 --2- 172.21.15.84:0/2781291062 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff57c0cf6b0 0x7ff57c15cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:53.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:53.214+0000 7ff581d9c700 1 -- 172.21.15.84:0/2781291062 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff57c0cf6b0 msgr2=0x7ff57c15cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:53.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:53.214+0000 7ff581d9c700 1 --2- 172.21.15.84:0/2781291062 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff57c0cf6b0 0x7ff57c15cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:53.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:53.214+0000 7ff581d9c700 1 -- 172.21.15.84:0/2781291062 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff57c0b2cb0 msgr2=0x7ff57c14ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:53.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:53.214+0000 7ff581d9c700 1 --2- 172.21.15.84:0/2781291062 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff57c0b2cb0 0x7ff57c14ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:53.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:53.214+0000 7ff581d9c700 1 -- 172.21.15.84:0/2781291062 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff56c009550 con 0x7ff57c151460 2023-07-14T11:17:53.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:53.214+0000 7ff58159b700 1 --2- 172.21.15.84:0/2781291062 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff57c0b2cb0 0x7ff57c14ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:17:53.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:53.214+0000 7ff581d9c700 1 --2- 172.21.15.84:0/2781291062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff57c151460 0x7ff57c13e300 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7ff574007e60 tx=0x7ff57400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:53.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:53.214+0000 7ff571ffb700 1 -- 172.21.15.84:0/2781291062 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff57400ede0 con 0x7ff57c151460 2023-07-14T11:17:53.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:53.214+0000 7ff571ffb700 1 -- 172.21.15.84:0/2781291062 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff574014420 con 0x7ff57c151460 2023-07-14T11:17:53.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:53.214+0000 7ff571ffb700 1 -- 172.21.15.84:0/2781291062 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5740147d0 con 0x7ff57c151460 2023-07-14T11:17:53.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:53.214+0000 7ff5837ff700 1 -- 172.21.15.84:0/2781291062 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff57c13dde0 con 0x7ff57c151460 2023-07-14T11:17:53.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:53.214+0000 7ff5837ff700 1 -- 172.21.15.84:0/2781291062 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff57c14f500 con 0x7ff57c151460 2023-07-14T11:17:53.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:53.215+0000 7ff5837ff700 1 -- 172.21.15.84:0/2781291062 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff57c13dc10 con 0x7ff57c151460 2023-07-14T11:17:53.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:53.216+0000 7ff571ffb700 1 -- 172.21.15.84:0/2781291062 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7ff574014930 con 0x7ff57c151460 2023-07-14T11:17:53.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:53.217+0000 7ff571ffb700 1 --2- 172.21.15.84:0/2781291062 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff56006b040 0x7ff56006d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:53.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:53.217+0000 7ff571ffb700 1 -- 172.21.15.84:0/2781291062 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ff574089e50 con 0x7ff57c151460 2023-07-14T11:17:53.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:53.218+0000 7ff58159b700 1 --2- 172.21.15.84:0/2781291062 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff56006b040 0x7ff56006d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:53.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:53.218+0000 7ff58159b700 1 --2- 172.21.15.84:0/2781291062 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff56006b040 0x7ff56006d4f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7ff57c1f5350 tx=0x7ff578009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:53.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:53.221+0000 7ff571ffb700 1 -- 172.21.15.84:0/2781291062 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ff574054ef0 con 0x7ff57c151460 2023-07-14T11:17:53.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:53.416+0000 7ff5837ff700 1 -- 172.21.15.84:0/2781291062 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ff57c15d890 con 0x7ff57c151460 2023-07-14T11:17:54.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.247+0000 7ff571ffb700 1 -- 172.21.15.84:0/2781291062 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v72) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff57408b0b0 con 0x7ff57c151460 2023-07-14T11:17:54.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.251+0000 7ff5837ff700 1 -- 172.21.15.84:0/2781291062 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff56006b040 msgr2=0x7ff56006d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:54.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.251+0000 7ff5837ff700 1 --2- 172.21.15.84:0/2781291062 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff56006b040 0x7ff56006d4f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7ff57c1f5350 tx=0x7ff578009040 comp rx=0 tx=0).stop 2023-07-14T11:17:54.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.251+0000 7ff5837ff700 1 -- 172.21.15.84:0/2781291062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff57c151460 msgr2=0x7ff57c13e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:54.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.251+0000 7ff5837ff700 1 --2- 172.21.15.84:0/2781291062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff57c151460 0x7ff57c13e300 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7ff574007e60 tx=0x7ff57400e3c0 comp rx=0 tx=0).stop 2023-07-14T11:17:54.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.251+0000 7ff5837ff700 1 -- 172.21.15.84:0/2781291062 shutdown_connections 2023-07-14T11:17:54.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.251+0000 7ff5837ff700 1 --2- 172.21.15.84:0/2781291062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff57c151460 0x7ff57c13e300 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:54.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.251+0000 7ff5837ff700 1 --2- 172.21.15.84:0/2781291062 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff57c0b2cb0 0x7ff57c14ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:54.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.251+0000 7ff5837ff700 1 --2- 172.21.15.84:0/2781291062 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff56006b040 0x7ff56006d4f0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:54.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.251+0000 7ff5837ff700 1 --2- 172.21.15.84:0/2781291062 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff57c0cf6b0 0x7ff57c15cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:54.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.251+0000 7ff5837ff700 1 -- 172.21.15.84:0/2781291062 >> 172.21.15.84:0/2781291062 conn(0x7ff57c065bd0 msgr2=0x7ff57c0cef70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:54.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.252+0000 7ff5837ff700 1 -- 172.21.15.84:0/2781291062 shutdown_connections 2023-07-14T11:17:54.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.252+0000 7ff5837ff700 1 -- 172.21.15.84:0/2781291062 wait complete. 2023-07-14T11:17:54.257 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_metadata' created 2023-07-14T11:17:54.275 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-14T11:17:54.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.474+0000 7f6a585ff700 1 Processor -- start 2023-07-14T11:17:54.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.474+0000 7f6a585ff700 1 -- start start 2023-07-14T11:17:54.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.475+0000 7f6a585ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a500d0b10 0x7f6a500d0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:54.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.475+0000 7f6a585ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a500d14a0 con 0x7f6a500b8a60 2023-07-14T11:17:54.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.475+0000 7f6a585ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a500b8e30 con 0x7f6a500b0e20 2023-07-14T11:17:54.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.475+0000 7f6a585ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a500afaa0 con 0x7f6a500d0b10 2023-07-14T11:17:54.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.475+0000 7f6a5639b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f6a500b8a60 0x7f6a500b3ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:37042/0 (socket says 172.21.15.84:37042) 2023-07-14T11:17:54.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.475+0000 7f6a5639b700 1 -- 172.21.15.84:0/2205803101 learned_addr learned my addr 172.21.15.84:0/2205803101 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:17:54.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.476+0000 7f6a55b9a700 1 --2- 172.21.15.84:0/2205803101 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a500d0b10 0x7f6a500d0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:54.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.476+0000 7f6a55399700 1 -- 172.21.15.84:0/2205803101 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2425834773 0 0) 0x7f6a4c001110 con 0x7f6a500b8a60 2023-07-14T11:17:54.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.476+0000 7f6a55399700 1 -- 172.21.15.84:0/2205803101 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a3c0035b0 con 0x7f6a500b8a60 2023-07-14T11:17:54.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.476+0000 7f6a55399700 1 -- 172.21.15.84:0/2205803101 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2625134602 0 0) 0x7f6a500b8e30 con 0x7f6a500b0e20 2023-07-14T11:17:54.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.476+0000 7f6a55399700 1 -- 172.21.15.84:0/2205803101 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a4c001110 con 0x7f6a500b0e20 2023-07-14T11:17:54.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.476+0000 7f6a55399700 1 -- 172.21.15.84:0/2205803101 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1145846903 0 0) 0x7f6a3c0035b0 con 0x7f6a500b8a60 2023-07-14T11:17:54.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.476+0000 7f6a55399700 1 -- 172.21.15.84:0/2205803101 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a500d0b10 msgr2=0x7f6a500d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:54.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.476+0000 7f6a55399700 1 --2- 172.21.15.84:0/2205803101 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a500d0b10 0x7f6a500d0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:54.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.476+0000 7f6a55399700 1 -- 172.21.15.84:0/2205803101 >> v1:172.21.15.179:6789/0 conn(0x7f6a500b0e20 legacy=0x7f6a500b12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:54.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.476+0000 7f6a55399700 1 -- 172.21.15.84:0/2205803101 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a500afd80 con 0x7f6a500b8a60 2023-07-14T11:17:54.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.476+0000 7f6a55399700 1 -- 172.21.15.84:0/2205803101 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7f6a4c001800 con 0x7f6a500b8a60 2023-07-14T11:17:54.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.476+0000 7f6a55399700 1 -- 172.21.15.84:0/2205803101 >> v1:172.21.15.84:6789/0 conn(0x7f6a500b8a60 legacy=0x7f6a500b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:54.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.476+0000 7f6a55399700 1 --2- 172.21.15.84:0/2205803101 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a3c003bc0 0x7f6a3c003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:54.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.476+0000 7f6a55399700 1 --2- 172.21.15.84:0/2205803101 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a3c004850 0x7f6a3c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:54.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.476+0000 7f6a55399700 1 --2- 172.21.15.84:0/2205803101 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a500d0b10 0x7f6a3c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:54.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.476+0000 7f6a55399700 1 -- 172.21.15.84:0/2205803101 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a500afaa0 con 0x7f6a3c003bc0 2023-07-14T11:17:54.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.476+0000 7f6a55399700 1 -- 172.21.15.84:0/2205803101 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3c00bac0 con 0x7f6a3c004850 2023-07-14T11:17:54.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.476+0000 7f6a55399700 1 -- 172.21.15.84:0/2205803101 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3c00bc30 con 0x7f6a500d0b10 2023-07-14T11:17:54.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.477+0000 7f6a5639b700 1 --2- 172.21.15.84:0/2205803101 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a3c003bc0 0x7f6a3c003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:54.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.477+0000 7f6a55b9a700 1 --2- 172.21.15.84:0/2205803101 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a3c004850 0x7f6a3c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:54.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.477+0000 7f6a56b9c700 1 --2- 172.21.15.84:0/2205803101 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a500d0b10 0x7f6a3c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:54.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.477+0000 7f6a5639b700 1 -- 172.21.15.84:0/2205803101 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a500d0b10 msgr2=0x7f6a3c005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:54.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.477+0000 7f6a5639b700 1 --2- 172.21.15.84:0/2205803101 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a500d0b10 0x7f6a3c005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:54.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.477+0000 7f6a5639b700 1 -- 172.21.15.84:0/2205803101 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a3c004850 msgr2=0x7f6a3c004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:54.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.477+0000 7f6a5639b700 1 --2- 172.21.15.84:0/2205803101 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a3c004850 0x7f6a3c004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:54.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.477+0000 7f6a5639b700 1 -- 172.21.15.84:0/2205803101 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a3c0035b0 con 0x7f6a3c003bc0 2023-07-14T11:17:54.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.477+0000 7f6a55b9a700 1 --2- 172.21.15.84:0/2205803101 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a3c004850 0x7f6a3c004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:17:54.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.477+0000 7f6a5639b700 1 --2- 172.21.15.84:0/2205803101 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a3c003bc0 0x7f6a3c003fb0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c00c210 tx=0x7f6a3c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=415670ed9ec776c5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:54.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.477+0000 7f6a55399700 1 -- 172.21.15.84:0/2205803101 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4c00cd50 con 0x7f6a3c003bc0 2023-07-14T11:17:54.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.477+0000 7f6a55399700 1 -- 172.21.15.84:0/2205803101 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a4c001c80 con 0x7f6a3c003bc0 2023-07-14T11:17:54.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.477+0000 7f6a55399700 1 -- 172.21.15.84:0/2205803101 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4c005ba0 con 0x7f6a3c003bc0 2023-07-14T11:17:54.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.478+0000 7f6a585ff700 1 -- 172.21.15.84:0/2205803101 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a3c003bc0 msgr2=0x7f6a3c003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:54.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.478+0000 7f6a585ff700 1 --2- 172.21.15.84:0/2205803101 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a3c003bc0 0x7f6a3c003fb0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c00c210 tx=0x7f6a3c005880 comp rx=0 tx=0).stop 2023-07-14T11:17:54.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.478+0000 7f6a56b9c700 1 -- 172.21.15.84:0/2205803101 reap_dead start 2023-07-14T11:17:54.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.478+0000 7f6a585ff700 1 -- 172.21.15.84:0/2205803101 shutdown_connections 2023-07-14T11:17:54.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.478+0000 7f6a585ff700 1 -- 172.21.15.84:0/2205803101 >> 172.21.15.84:0/2205803101 conn(0x7f6a5009c1b0 msgr2=0x7f6a500d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:54.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.478+0000 7f6a585ff700 1 -- 172.21.15.84:0/2205803101 shutdown_connections 2023-07-14T11:17:54.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.478+0000 7f6a585ff700 1 -- 172.21.15.84:0/2205803101 wait complete. 2023-07-14T11:17:54.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.480+0000 7f6a585ff700 1 Processor -- start 2023-07-14T11:17:54.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.480+0000 7f6a585ff700 1 -- start start 2023-07-14T11:17:54.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.481+0000 7f6a585ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a3c003bc0 0x7f6a500ca010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:54.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.481+0000 7f6a585ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a50151f80 0x7f6a500cc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:54.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.481+0000 7f6a585ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a501523f0 0x7f6a500ccce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:54.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.481+0000 7f6a585ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a500cb690 con 0x7f6a3c003bc0 2023-07-14T11:17:54.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.481+0000 7f6a585ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a500ca5f0 con 0x7f6a50151f80 2023-07-14T11:17:54.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.481+0000 7f6a585ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a500ca8d0 con 0x7f6a501523f0 2023-07-14T11:17:54.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.481+0000 7f6a5639b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a3c003bc0 0x7f6a500ca010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:54.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.481+0000 7f6a5639b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a3c003bc0 0x7f6a500ca010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44928/0 (socket says 172.21.15.84:44928) 2023-07-14T11:17:54.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.481+0000 7f6a5639b700 1 -- 172.21.15.84:0/539950216 learned_addr learned my addr 172.21.15.84:0/539950216 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:54.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.481+0000 7f6a55b9a700 1 --2- 172.21.15.84:0/539950216 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a50151f80 0x7f6a500cc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:54.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.481+0000 7f6a56b9c700 1 --2- 172.21.15.84:0/539950216 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a501523f0 0x7f6a500ccce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:54.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.482+0000 7f6a5639b700 1 -- 172.21.15.84:0/539950216 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a501523f0 msgr2=0x7f6a500ccce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:54.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.482+0000 7f6a5639b700 1 --2- 172.21.15.84:0/539950216 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a501523f0 0x7f6a500ccce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:54.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.482+0000 7f6a5639b700 1 -- 172.21.15.84:0/539950216 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a50151f80 msgr2=0x7f6a500cc7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:54.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.482+0000 7f6a5639b700 1 --2- 172.21.15.84:0/539950216 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a50151f80 0x7f6a500cc7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:54.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.482+0000 7f6a5639b700 1 -- 172.21.15.84:0/539950216 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a500cabb0 con 0x7f6a3c003bc0 2023-07-14T11:17:54.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.482+0000 7f6a5639b700 1 --2- 172.21.15.84:0/539950216 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a3c003bc0 0x7f6a500ca010 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c004780 tx=0x7f6a4c001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:54.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.482+0000 7f6a46ffd700 1 -- 172.21.15.84:0/539950216 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4c0072d0 con 0x7f6a3c003bc0 2023-07-14T11:17:54.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.482+0000 7f6a46ffd700 1 -- 172.21.15.84:0/539950216 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a4c007430 con 0x7f6a3c003bc0 2023-07-14T11:17:54.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.482+0000 7f6a46ffd700 1 -- 172.21.15.84:0/539950216 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4c0077e0 con 0x7f6a3c003bc0 2023-07-14T11:17:54.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.482+0000 7f6a585ff700 1 -- 172.21.15.84:0/539950216 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a500cae90 con 0x7f6a3c003bc0 2023-07-14T11:17:54.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.482+0000 7f6a585ff700 1 -- 172.21.15.84:0/539950216 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a500d07a0 con 0x7f6a3c003bc0 2023-07-14T11:17:54.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.483+0000 7f6a585ff700 1 -- 172.21.15.84:0/539950216 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a50074350 con 0x7f6a3c003bc0 2023-07-14T11:17:54.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.484+0000 7f6a46ffd700 1 -- 172.21.15.84:0/539950216 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7f6a4c019030 con 0x7f6a3c003bc0 2023-07-14T11:17:54.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.486+0000 7f6a46ffd700 1 --2- 172.21.15.84:0/539950216 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6a3406b040 0x7f6a3406d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:54.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.486+0000 7f6a46ffd700 1 -- 172.21.15.84:0/539950216 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f6a4c08ad40 con 0x7f6a3c003bc0 2023-07-14T11:17:54.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.486+0000 7f6a55b9a700 1 --2- 172.21.15.84:0/539950216 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6a3406b040 0x7f6a3406d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:54.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.487+0000 7f6a55b9a700 1 --2- 172.21.15.84:0/539950216 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6a3406b040 0x7f6a3406d4f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f6a500a0d30 tx=0x7f6a40008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:54.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.490+0000 7f6a46ffd700 1 -- 172.21.15.84:0/539950216 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f6a4c055cb0 con 0x7f6a3c003bc0 2023-07-14T11:17:54.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:54.684+0000 7f6a585ff700 1 -- 172.21.15.84:0/539950216 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f6a500d14a0 con 0x7f6a3c003bc0 2023-07-14T11:17:55.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:55.254+0000 7f6a46ffd700 1 -- 172.21.15.84:0/539950216 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v73) v1 ==== 170+0+0 (secure 0 0 0) 0x7f6a500d14a0 con 0x7f6a3c003bc0 2023-07-14T11:17:55.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:55.259+0000 7f6a585ff700 1 -- 172.21.15.84:0/539950216 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6a3406b040 msgr2=0x7f6a3406d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:55.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:55.259+0000 7f6a585ff700 1 --2- 172.21.15.84:0/539950216 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6a3406b040 0x7f6a3406d4f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f6a500a0d30 tx=0x7f6a40008040 comp rx=0 tx=0).stop 2023-07-14T11:17:55.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:55.259+0000 7f6a585ff700 1 -- 172.21.15.84:0/539950216 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a3c003bc0 msgr2=0x7f6a500ca010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:55.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:55.259+0000 7f6a585ff700 1 --2- 172.21.15.84:0/539950216 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a3c003bc0 0x7f6a500ca010 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c004780 tx=0x7f6a4c001b10 comp rx=0 tx=0).stop 2023-07-14T11:17:55.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:55.261+0000 7f6a585ff700 1 -- 172.21.15.84:0/539950216 shutdown_connections 2023-07-14T11:17:55.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:55.261+0000 7f6a585ff700 1 --2- 172.21.15.84:0/539950216 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f6a3406b040 0x7f6a3406d4f0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:55.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:55.261+0000 7f6a585ff700 1 --2- 172.21.15.84:0/539950216 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a501523f0 0x7f6a500ccce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:55.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:55.261+0000 7f6a585ff700 1 --2- 172.21.15.84:0/539950216 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a3c003bc0 0x7f6a500ca010 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:55.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:55.261+0000 7f6a585ff700 1 --2- 172.21.15.84:0/539950216 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a50151f80 0x7f6a500cc7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:55.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:55.261+0000 7f6a585ff700 1 -- 172.21.15.84:0/539950216 >> 172.21.15.84:0/539950216 conn(0x7f6a5009c1b0 msgr2=0x7f6a500b4150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:55.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:55.263+0000 7f6a585ff700 1 -- 172.21.15.84:0/539950216 shutdown_connections 2023-07-14T11:17:55.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:55.263+0000 7f6a585ff700 1 -- 172.21.15.84:0/539950216 wait complete. 2023-07-14T11:17:55.275 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data' created 2023-07-14T11:17:55.292 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-14T11:17:55.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:55.488+0000 7f839bdff700 1 Processor -- start 2023-07-14T11:17:55.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:55.488+0000 7f839bdff700 1 -- start start 2023-07-14T11:17:55.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:55.489+0000 7f839bdff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f83940b8a60 0x7f83940b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:55.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:55.489+0000 7f839bdff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83940d1220 0x7f83940b0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:55.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:55.489+0000 7f839bdff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83940b8e30 con 0x7f83940b4530 2023-07-14T11:17:55.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:55.489+0000 7f839bdff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83940afaa0 con 0x7f83940b8a60 2023-07-14T11:17:55.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:55.489+0000 7f839bdff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83940afd80 con 0x7f83940d1220 2023-07-14T11:17:55.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:55.489+0000 7f8399b9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f83940b8a60 0x7f83940b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:55.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:55.489+0000 7f8399b9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f83940b8a60 0x7f83940b3ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44942/0 (socket says 172.21.15.84:44942) 2023-07-14T11:17:55.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:55.489+0000 7f8399b9b700 1 -- 172.21.15.84:0/2473411025 learned_addr learned my addr 172.21.15.84:0/2473411025 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:55.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:55.490+0000 7f839a39c700 1 --2- 172.21.15.84:0/2473411025 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83940d1220 0x7f83940b0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:55.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:55.490+0000 7f8399b9b700 1 -- 172.21.15.84:0/2473411025 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83940d1220 msgr2=0x7f83940b0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:55.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:55.490+0000 7f8399b9b700 1 --2- 172.21.15.84:0/2473411025 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83940d1220 0x7f83940b0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:55.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:55.490+0000 7f8399b9b700 1 -- 172.21.15.84:0/2473411025 >> v1:172.21.15.179:6789/0 conn(0x7f83940b4530 legacy=0x7f83940d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:55.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:55.490+0000 7f8399b9b700 1 -- 172.21.15.84:0/2473411025 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83940b0060 con 0x7f83940b8a60 2023-07-14T11:17:55.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:55.490+0000 7f8399b9b700 1 --2- 172.21.15.84:0/2473411025 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83940b8a60 0x7f83940b3ff0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f83900098f0 tx=0x7f8390009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c37be9f36a8c523f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:55.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:55.490+0000 7f8398b99700 1 -- 172.21.15.84:0/2473411025 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839000b8a0 con 0x7f83940b8a60 2023-07-14T11:17:55.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:55.490+0000 7f8398b99700 1 -- 172.21.15.84:0/2473411025 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f839000ba00 con 0x7f83940b8a60 2023-07-14T11:17:55.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:55.490+0000 7f8398b99700 1 -- 172.21.15.84:0/2473411025 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839000bd90 con 0x7f83940b8a60 2023-07-14T11:17:55.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:55.491+0000 7f839bdff700 1 -- 172.21.15.84:0/2473411025 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83940b8a60 msgr2=0x7f83940b3ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:55.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:55.491+0000 7f839bdff700 1 --2- 172.21.15.84:0/2473411025 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83940b8a60 0x7f83940b3ff0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f83900098f0 tx=0x7f8390009c00 comp rx=0 tx=0).stop 2023-07-14T11:17:55.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:55.491+0000 7f839bdff700 1 -- 172.21.15.84:0/2473411025 shutdown_connections 2023-07-14T11:17:55.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:55.491+0000 7f839bdff700 1 --2- 172.21.15.84:0/2473411025 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83940d1220 0x7f83940b0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:55.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:55.491+0000 7f839bdff700 1 --2- 172.21.15.84:0/2473411025 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83940b8a60 0x7f83940b3ff0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:55.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:55.491+0000 7f839bdff700 1 -- 172.21.15.84:0/2473411025 >> 172.21.15.84:0/2473411025 conn(0x7f839409c1b0 msgr2=0x7f83940d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:55.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:55.491+0000 7f839bdff700 1 -- 172.21.15.84:0/2473411025 shutdown_connections 2023-07-14T11:17:55.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:55.491+0000 7f839bdff700 1 -- 172.21.15.84:0/2473411025 wait complete. 2023-07-14T11:17:55.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:55.493+0000 7f839bdff700 1 Processor -- start 2023-07-14T11:17:55.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:55.493+0000 7f839bdff700 1 -- start start 2023-07-14T11:17:55.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:55.494+0000 7f839bdff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83940b4530 0x7f839415f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:55.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:55.494+0000 7f839bdff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83940b8a60 0x7f839415e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:55.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:55.494+0000 7f839bdff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83940d1220 0x7f83940cb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:55.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:55.494+0000 7f839bdff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83941529d0 con 0x7f83940d1220 2023-07-14T11:17:55.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:55.494+0000 7f839bdff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f839415da40 con 0x7f83940b4530 2023-07-14T11:17:55.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:55.494+0000 7f839bdff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f839415fd00 con 0x7f83940b8a60 2023-07-14T11:17:55.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:55.494+0000 7f839a39c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83940d1220 0x7f83940cb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:55.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:55.494+0000 7f839a39c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83940d1220 0x7f83940cb9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44946/0 (socket says 172.21.15.84:44946) 2023-07-14T11:17:55.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:55.494+0000 7f839a39c700 1 -- 172.21.15.84:0/2574954059 learned_addr learned my addr 172.21.15.84:0/2574954059 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:55.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:55.494+0000 7f839a39c700 1 -- 172.21.15.84:0/2574954059 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83940b8a60 msgr2=0x7f839415e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:55.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:55.494+0000 7f839a39c700 1 --2- 172.21.15.84:0/2574954059 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83940b8a60 0x7f839415e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:55.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:55.494+0000 7f839a39c700 1 -- 172.21.15.84:0/2574954059 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83940b4530 msgr2=0x7f839415f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:55.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:55.494+0000 7f839a39c700 1 --2- 172.21.15.84:0/2574954059 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83940b4530 0x7f839415f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:55.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:55.494+0000 7f839a39c700 1 -- 172.21.15.84:0/2574954059 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8390009550 con 0x7f83940d1220 2023-07-14T11:17:55.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:55.495+0000 7f839a39c700 1 --2- 172.21.15.84:0/2574954059 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83940d1220 0x7f83940cb9f0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f838c007d40 tx=0x7f838c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:55.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:55.495+0000 7f838a7fc700 1 -- 172.21.15.84:0/2574954059 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838c00ede0 con 0x7f83940d1220 2023-07-14T11:17:55.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:55.495+0000 7f838a7fc700 1 -- 172.21.15.84:0/2574954059 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f838c014420 con 0x7f83940d1220 2023-07-14T11:17:55.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:55.495+0000 7f838a7fc700 1 -- 172.21.15.84:0/2574954059 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838c0147d0 con 0x7f83940d1220 2023-07-14T11:17:55.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:55.495+0000 7f839bdff700 1 -- 172.21.15.84:0/2574954059 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f839415dc90 con 0x7f83940d1220 2023-07-14T11:17:55.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:55.495+0000 7f839bdff700 1 -- 172.21.15.84:0/2574954059 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f839415e250 con 0x7f83940d1220 2023-07-14T11:17:55.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:55.496+0000 7f839bdff700 1 -- 172.21.15.84:0/2574954059 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f839415e5c0 con 0x7f83940d1220 2023-07-14T11:17:55.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:55.497+0000 7f838a7fc700 1 -- 172.21.15.84:0/2574954059 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7f838c014930 con 0x7f83940d1220 2023-07-14T11:17:55.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:55.498+0000 7f838a7fc700 1 --2- 172.21.15.84:0/2574954059 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f837806b040 0x7f837806d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:55.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:55.498+0000 7f838a7fc700 1 -- 172.21.15.84:0/2574954059 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f838c08af10 con 0x7f83940d1220 2023-07-14T11:17:55.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:55.499+0000 7f8399b9b700 1 --2- 172.21.15.84:0/2574954059 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f837806b040 0x7f837806d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:55.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:55.499+0000 7f8399b9b700 1 --2- 172.21.15.84:0/2574954059 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f837806b040 0x7f837806d4f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f8390000c00 tx=0x7f8390010000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:55.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:55.502+0000 7f838a7fc700 1 -- 172.21.15.84:0/2574954059 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f838c055c50 con 0x7f83940d1220 2023-07-14T11:17:55.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:55.739+0000 7f839bdff700 1 -- 172.21.15.84:0/2574954059 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f8394074350 con 0x7f83940d1220 2023-07-14T11:17:56.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.275+0000 7f838a7fc700 1 -- 172.21.15.84:0/2574954059 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 11 and data pool 12 v42) v1 ==== 174+0+0 (secure 0 0 0) 0x7f838c059270 con 0x7f83940d1220 2023-07-14T11:17:56.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.279+0000 7f839bdff700 1 -- 172.21.15.84:0/2574954059 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f837806b040 msgr2=0x7f837806d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:56.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.279+0000 7f839bdff700 1 --2- 172.21.15.84:0/2574954059 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f837806b040 0x7f837806d4f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f8390000c00 tx=0x7f8390010000 comp rx=0 tx=0).stop 2023-07-14T11:17:56.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.279+0000 7f839bdff700 1 -- 172.21.15.84:0/2574954059 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83940d1220 msgr2=0x7f83940cb9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:56.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.279+0000 7f839bdff700 1 --2- 172.21.15.84:0/2574954059 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83940d1220 0x7f83940cb9f0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f838c007d40 tx=0x7f838c00e3c0 comp rx=0 tx=0).stop 2023-07-14T11:17:56.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.282+0000 7f839bdff700 1 -- 172.21.15.84:0/2574954059 shutdown_connections 2023-07-14T11:17:56.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.282+0000 7f839bdff700 1 --2- 172.21.15.84:0/2574954059 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83940d1220 0x7f83940cb9f0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:56.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.282+0000 7f839bdff700 1 --2- 172.21.15.84:0/2574954059 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83940b4530 0x7f839415f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:56.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.282+0000 7f839bdff700 1 --2- 172.21.15.84:0/2574954059 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f837806b040 0x7f837806d4f0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:56.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.282+0000 7f839bdff700 1 --2- 172.21.15.84:0/2574954059 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83940b8a60 0x7f839415e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:56.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.282+0000 7f839bdff700 1 -- 172.21.15.84:0/2574954059 >> 172.21.15.84:0/2574954059 conn(0x7f839409c1b0 msgr2=0x7f83940b8070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:56.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.283+0000 7f839bdff700 1 -- 172.21.15.84:0/2574954059 shutdown_connections 2023-07-14T11:17:56.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.284+0000 7f839bdff700 1 -- 172.21.15.84:0/2574954059 wait complete. 2023-07-14T11:17:56.294 INFO:teuthology.orchestra.run.smithi084.stderr:new fs with metadata pool 11 and data pool 12 2023-07-14T11:17:56.314 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:17:56.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.507+0000 7fe2eedff700 1 Processor -- start 2023-07-14T11:17:56.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.507+0000 7fe2eedff700 1 -- start start 2023-07-14T11:17:56.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.508+0000 7fe2eedff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2e80b5d90 0x7fe2e80b6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:56.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.509+0000 7fe2eedff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2e80b7f50 con 0x7fe2e80b4510 2023-07-14T11:17:56.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.509+0000 7fe2eedff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2e80cdca0 con 0x7fe2e80d0b10 2023-07-14T11:17:56.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.509+0000 7fe2eedff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e80b48e0 con 0x7fe2e80b5d90 2023-07-14T11:17:56.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.509+0000 7fe2ecb9b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fe2e80b4510 0x7fe2e80cd590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:37052/0 (socket says 172.21.15.84:37052) 2023-07-14T11:17:56.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.509+0000 7fe2ecb9b700 1 -- 172.21.15.84:0/4139489682 learned_addr learned my addr 172.21.15.84:0/4139489682 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:17:56.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.509+0000 7fe2e7fff700 1 --2- 172.21.15.84:0/4139489682 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2e80b5d90 0x7fe2e80b6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:56.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.509+0000 7fe2e77fe700 1 -- 172.21.15.84:0/4139489682 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3531837743 0 0) 0x7fe2e80b7f50 con 0x7fe2e80b4510 2023-07-14T11:17:56.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.509+0000 7fe2e77fe700 1 -- 172.21.15.84:0/4139489682 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2d80035b0 con 0x7fe2e80b4510 2023-07-14T11:17:56.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.510+0000 7fe2e77fe700 1 -- 172.21.15.84:0/4139489682 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4156214999 0 0) 0x7fe2e80cdca0 con 0x7fe2e80d0b10 2023-07-14T11:17:56.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.510+0000 7fe2e77fe700 1 -- 172.21.15.84:0/4139489682 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2e80b7f50 con 0x7fe2e80d0b10 2023-07-14T11:17:56.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.510+0000 7fe2e77fe700 1 -- 172.21.15.84:0/4139489682 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3864369553 0 0) 0x7fe2d80035b0 con 0x7fe2e80b4510 2023-07-14T11:17:56.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.510+0000 7fe2e7fff700 1 -- 172.21.15.84:0/4139489682 >> v1:172.21.15.179:6789/0 conn(0x7fe2e80d0b10 legacy=0x7fe2e80b83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:56.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.510+0000 7fe2e7fff700 1 -- 172.21.15.84:0/4139489682 >> v1:172.21.15.84:6789/0 conn(0x7fe2e80b4510 legacy=0x7fe2e80cd590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:56.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.510+0000 7fe2e7fff700 1 -- 172.21.15.84:0/4139489682 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2e80b7340 con 0x7fe2e80b5d90 2023-07-14T11:17:56.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.510+0000 7fe2e7fff700 1 --2- 172.21.15.84:0/4139489682 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2e80b5d90 0x7fe2e80b6c80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe2d4009870 tx=0x7fe2d4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6959e0bb71fc9d02 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:56.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.510+0000 7fe2e77fe700 1 -- 172.21.15.84:0/4139489682 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2dc0017f0 con 0x7fe2e80b5d90 2023-07-14T11:17:56.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.510+0000 7fe2e77fe700 1 -- 172.21.15.84:0/4139489682 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2d4004030 con 0x7fe2e80b5d90 2023-07-14T11:17:56.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.510+0000 7fe2e77fe700 1 -- 172.21.15.84:0/4139489682 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d40043c0 con 0x7fe2e80b5d90 2023-07-14T11:17:56.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.511+0000 7fe2eedff700 1 -- 172.21.15.84:0/4139489682 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2e80b5d90 msgr2=0x7fe2e80b6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:56.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.511+0000 7fe2eedff700 1 --2- 172.21.15.84:0/4139489682 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2e80b5d90 0x7fe2e80b6c80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe2d4009870 tx=0x7fe2d4009b80 comp rx=0 tx=0).stop 2023-07-14T11:17:56.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.511+0000 7fe2eedff700 1 -- 172.21.15.84:0/4139489682 shutdown_connections 2023-07-14T11:17:56.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.511+0000 7fe2eedff700 1 --2- 172.21.15.84:0/4139489682 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2e80b5d90 0x7fe2e80b6c80 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:56.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.511+0000 7fe2eedff700 1 -- 172.21.15.84:0/4139489682 >> 172.21.15.84:0/4139489682 conn(0x7fe2e809c1d0 msgr2=0x7fe2e80d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:56.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.511+0000 7fe2eedff700 1 -- 172.21.15.84:0/4139489682 shutdown_connections 2023-07-14T11:17:56.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.511+0000 7fe2eedff700 1 -- 172.21.15.84:0/4139489682 wait complete. 2023-07-14T11:17:56.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.513+0000 7fe2eedff700 1 Processor -- start 2023-07-14T11:17:56.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.513+0000 7fe2eedff700 1 -- start start 2023-07-14T11:17:56.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.514+0000 7fe2eedff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe2e80b4510 0x7fe2e80caf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:56.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.514+0000 7fe2eedff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2e80b5d90 0x7fe2e815a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:56.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.514+0000 7fe2eedff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2e80d0b10 0x7fe2e81f2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:56.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.514+0000 7fe2eedff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e81f5ed0 con 0x7fe2e80b4510 2023-07-14T11:17:56.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.514+0000 7fe2eedff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e81f3340 con 0x7fe2e80b5d90 2023-07-14T11:17:56.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.514+0000 7fe2eedff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e80cbb30 con 0x7fe2e80d0b10 2023-07-14T11:17:56.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.514+0000 7fe2ecb9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe2e80b4510 0x7fe2e80caf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:56.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.514+0000 7fe2ecb9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe2e80b4510 0x7fe2e80caf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44950/0 (socket says 172.21.15.84:44950) 2023-07-14T11:17:56.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.514+0000 7fe2ecb9b700 1 -- 172.21.15.84:0/1339621073 learned_addr learned my addr 172.21.15.84:0/1339621073 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:56.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.514+0000 7fe2ecb9b700 1 -- 172.21.15.84:0/1339621073 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2e80d0b10 msgr2=0x7fe2e81f2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:56.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.514+0000 7fe2ecb9b700 1 --2- 172.21.15.84:0/1339621073 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2e80d0b10 0x7fe2e81f2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:56.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.514+0000 7fe2ecb9b700 1 -- 172.21.15.84:0/1339621073 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2e80b5d90 msgr2=0x7fe2e815a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:56.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.514+0000 7fe2ecb9b700 1 --2- 172.21.15.84:0/1339621073 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2e80b5d90 0x7fe2e815a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:56.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.514+0000 7fe2ecb9b700 1 -- 172.21.15.84:0/1339621073 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d40094a0 con 0x7fe2e80b4510 2023-07-14T11:17:56.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.514+0000 7fe2ecb9b700 1 --2- 172.21.15.84:0/1339621073 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe2e80b4510 0x7fe2e80caf20 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc00c550 tx=0x7fe2dc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:56.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.515+0000 7fe2e57fa700 1 -- 172.21.15.84:0/1339621073 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2dc0074e0 con 0x7fe2e80b4510 2023-07-14T11:17:56.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.515+0000 7fe2e57fa700 1 -- 172.21.15.84:0/1339621073 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2dc007660 con 0x7fe2e80b4510 2023-07-14T11:17:56.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.515+0000 7fe2e57fa700 1 -- 172.21.15.84:0/1339621073 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2dc005a70 con 0x7fe2e80b4510 2023-07-14T11:17:56.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.515+0000 7fe2eedff700 1 -- 172.21.15.84:0/1339621073 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2e80cb570 con 0x7fe2e80b4510 2023-07-14T11:17:56.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.515+0000 7fe2eedff700 1 -- 172.21.15.84:0/1339621073 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2e81f5af0 con 0x7fe2e80b4510 2023-07-14T11:17:56.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.516+0000 7fe2eedff700 1 -- 172.21.15.84:0/1339621073 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2e81f5950 con 0x7fe2e80b4510 2023-07-14T11:17:56.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.517+0000 7fe2e57fa700 1 -- 172.21.15.84:0/1339621073 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7fe2dc005bd0 con 0x7fe2e80b4510 2023-07-14T11:17:56.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.518+0000 7fe2e57fa700 1 --2- 172.21.15.84:0/1339621073 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe2cc06b040 0x7fe2cc06d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:56.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.518+0000 7fe2e57fa700 1 -- 172.21.15.84:0/1339621073 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe2dc088fb0 con 0x7fe2e80b4510 2023-07-14T11:17:56.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.518+0000 7fe2e7fff700 1 --2- 172.21.15.84:0/1339621073 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe2cc06b040 0x7fe2cc06d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:56.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.519+0000 7fe2e7fff700 1 --2- 172.21.15.84:0/1339621073 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe2cc06b040 0x7fe2cc06d4f0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fe2e80ca330 tx=0x7fe2d4010000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:56.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.522+0000 7fe2e57fa700 1 -- 172.21.15.84:0/1339621073 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe2e81f5950 con 0x7fe2e80b4510 2023-07-14T11:17:56.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.714+0000 7fe2eedff700 1 -- 172.21.15.84:0/1339621073 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe2e81f5950 con 0x7fe2e80b4510 2023-07-14T11:17:56.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.716+0000 7fe2e57fa700 1 -- 172.21.15.84:0/1339621073 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) v1 ==== 74+0+18343 (secure 0 0 0) 0x7fe2e81f5950 con 0x7fe2e80b4510 2023-07-14T11:17:56.720 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:17:56.720 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":74,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:17:55.741564+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-07-14T11:17:53.456029+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-07-14T11:17:54.724710+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:17:56.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.718+0000 7fe2eedff700 1 -- 172.21.15.84:0/1339621073 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe2cc06b040 msgr2=0x7fe2cc06d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:56.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.718+0000 7fe2eedff700 1 --2- 172.21.15.84:0/1339621073 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe2cc06b040 0x7fe2cc06d4f0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fe2e80ca330 tx=0x7fe2d4010000 comp rx=0 tx=0).stop 2023-07-14T11:17:56.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.718+0000 7fe2eedff700 1 -- 172.21.15.84:0/1339621073 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe2e80b4510 msgr2=0x7fe2e80caf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:56.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.718+0000 7fe2eedff700 1 --2- 172.21.15.84:0/1339621073 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe2e80b4510 0x7fe2e80caf20 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc00c550 tx=0x7fe2dc00c910 comp rx=0 tx=0).stop 2023-07-14T11:17:56.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.718+0000 7fe2eedff700 1 -- 172.21.15.84:0/1339621073 shutdown_connections 2023-07-14T11:17:56.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.718+0000 7fe2eedff700 1 --2- 172.21.15.84:0/1339621073 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe2cc06b040 0x7fe2cc06d4f0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:56.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.718+0000 7fe2eedff700 1 --2- 172.21.15.84:0/1339621073 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2e80d0b10 0x7fe2e81f2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:56.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.718+0000 7fe2eedff700 1 --2- 172.21.15.84:0/1339621073 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe2e80b4510 0x7fe2e80caf20 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:56.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.718+0000 7fe2eedff700 1 --2- 172.21.15.84:0/1339621073 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2e80b5d90 0x7fe2e815a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:56.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.718+0000 7fe2eedff700 1 -- 172.21.15.84:0/1339621073 >> 172.21.15.84:0/1339621073 conn(0x7fe2e809c1d0 msgr2=0x7fe2e8160270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:56.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.718+0000 7fe2eedff700 1 -- 172.21.15.84:0/1339621073 shutdown_connections 2023-07-14T11:17:56.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.718+0000 7fe2eedff700 1 -- 172.21.15.84:0/1339621073 wait complete. 2023-07-14T11:17:56.740 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:17:56.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.933+0000 7f2f84dff700 1 Processor -- start 2023-07-14T11:17:56.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.933+0000 7f2f84dff700 1 -- start start 2023-07-14T11:17:56.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.935+0000 7f2f84dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f800b1e00 0x7f2f800b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:56.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.935+0000 7f2f84dff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f800d2ce0 con 0x7f2f8015c950 2023-07-14T11:17:56.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.935+0000 7f2f84dff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f800b3350 con 0x7f2f800d1220 2023-07-14T11:17:56.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.935+0000 7f2f84dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f800b3630 con 0x7f2f800b1e00 2023-07-14T11:17:56.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.935+0000 7f2f7e59c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f2f8015c950 0x7f2f800d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:37060/0 (socket says 172.21.15.84:37060) 2023-07-14T11:17:56.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.935+0000 7f2f7e59c700 1 -- 172.21.15.84:0/54427736 learned_addr learned my addr 172.21.15.84:0/54427736 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:17:56.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.935+0000 7f2f7ed9d700 1 --2- 172.21.15.84:0/54427736 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f800b1e00 0x7f2f800b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:56.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.935+0000 7f2f7dd9b700 1 -- 172.21.15.84:0/54427736 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1070153304 0 0) 0x7f2f800d2ce0 con 0x7f2f8015c950 2023-07-14T11:17:56.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.935+0000 7f2f7dd9b700 1 -- 172.21.15.84:0/54427736 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f6c0035b0 con 0x7f2f8015c950 2023-07-14T11:17:56.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.936+0000 7f2f7dd9b700 1 -- 172.21.15.84:0/54427736 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1319898627 0 0) 0x7f2f800b3350 con 0x7f2f800d1220 2023-07-14T11:17:56.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.936+0000 7f2f7dd9b700 1 -- 172.21.15.84:0/54427736 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f800d2ce0 con 0x7f2f800d1220 2023-07-14T11:17:56.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.936+0000 7f2f7dd9b700 1 -- 172.21.15.84:0/54427736 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2706097930 0 0) 0x7f2f6c0035b0 con 0x7f2f8015c950 2023-07-14T11:17:56.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.936+0000 7f2f7dd9b700 1 -- 172.21.15.84:0/54427736 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f800b1e00 msgr2=0x7f2f800b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:56.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.936+0000 7f2f7dd9b700 1 --2- 172.21.15.84:0/54427736 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f800b1e00 0x7f2f800b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:56.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.936+0000 7f2f7dd9b700 1 -- 172.21.15.84:0/54427736 >> v1:172.21.15.179:6789/0 conn(0x7f2f800d1220 legacy=0x7f2f800afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:56.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.936+0000 7f2f7dd9b700 1 -- 172.21.15.84:0/54427736 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f800b3910 con 0x7f2f8015c950 2023-07-14T11:17:56.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.936+0000 7f2f7dd9b700 1 -- 172.21.15.84:0/54427736 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7f2f70001b70 con 0x7f2f8015c950 2023-07-14T11:17:56.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.936+0000 7f2f7dd9b700 1 -- 172.21.15.84:0/54427736 >> v1:172.21.15.84:6789/0 conn(0x7f2f8015c950 legacy=0x7f2f800d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:56.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.936+0000 7f2f7dd9b700 1 --2- 172.21.15.84:0/54427736 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f6c003bc0 0x7f2f6c003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:56.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.936+0000 7f2f7dd9b700 1 --2- 172.21.15.84:0/54427736 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f800b1e00 0x7f2f6c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:56.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.936+0000 7f2f7dd9b700 1 --2- 172.21.15.84:0/54427736 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f6c004d90 0x7f2f6c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:56.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.936+0000 7f2f7dd9b700 1 -- 172.21.15.84:0/54427736 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f800b3630 con 0x7f2f6c003bc0 2023-07-14T11:17:56.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.936+0000 7f2f7dd9b700 1 -- 172.21.15.84:0/54427736 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6c00bba0 con 0x7f2f6c004d90 2023-07-14T11:17:56.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.936+0000 7f2f7dd9b700 1 -- 172.21.15.84:0/54427736 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6c00bd60 con 0x7f2f800b1e00 2023-07-14T11:17:56.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.936+0000 7f2f7e59c700 1 --2- 172.21.15.84:0/54427736 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f6c003bc0 0x7f2f6c003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:56.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.936+0000 7f2f75d9b700 1 --2- 172.21.15.84:0/54427736 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f800b1e00 0x7f2f6c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:56.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.936+0000 7f2f7ed9d700 1 --2- 172.21.15.84:0/54427736 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f6c004d90 0x7f2f6c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:56.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.937+0000 7f2f7e59c700 1 -- 172.21.15.84:0/54427736 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f800b1e00 msgr2=0x7f2f6c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:56.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.937+0000 7f2f7e59c700 1 --2- 172.21.15.84:0/54427736 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f800b1e00 0x7f2f6c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:56.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.937+0000 7f2f7e59c700 1 -- 172.21.15.84:0/54427736 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f6c004d90 msgr2=0x7f2f6c005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:56.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.937+0000 7f2f7e59c700 1 --2- 172.21.15.84:0/54427736 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f6c004d90 0x7f2f6c005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:56.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.937+0000 7f2f7e59c700 1 -- 172.21.15.84:0/54427736 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f6c0035b0 con 0x7f2f6c003bc0 2023-07-14T11:17:56.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.937+0000 7f2f7e59c700 1 --2- 172.21.15.84:0/54427736 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f6c003bc0 0x7f2f6c003fb0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f2f7000c490 tx=0x7f2f6c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b79f8415b4ba545 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:56.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.937+0000 7f2f7dd9b700 1 -- 172.21.15.84:0/54427736 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f70007dd0 con 0x7f2f6c003bc0 2023-07-14T11:17:56.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.937+0000 7f2f7dd9b700 1 -- 172.21.15.84:0/54427736 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f70005bb0 con 0x7f2f6c003bc0 2023-07-14T11:17:56.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.937+0000 7f2f7dd9b700 1 -- 172.21.15.84:0/54427736 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f700070d0 con 0x7f2f6c003bc0 2023-07-14T11:17:56.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.937+0000 7f2f84dff700 1 -- 172.21.15.84:0/54427736 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f6c003bc0 msgr2=0x7f2f6c003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:56.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.937+0000 7f2f84dff700 1 --2- 172.21.15.84:0/54427736 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f6c003bc0 0x7f2f6c003fb0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f2f7000c490 tx=0x7f2f6c005880 comp rx=0 tx=0).stop 2023-07-14T11:17:56.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.938+0000 7f2f7ed9d700 1 -- 172.21.15.84:0/54427736 reap_dead start 2023-07-14T11:17:56.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.938+0000 7f2f84dff700 1 -- 172.21.15.84:0/54427736 shutdown_connections 2023-07-14T11:17:56.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.938+0000 7f2f84dff700 1 -- 172.21.15.84:0/54427736 >> 172.21.15.84:0/54427736 conn(0x7f2f8009c1d0 msgr2=0x7f2f800d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:56.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.938+0000 7f2f84dff700 1 -- 172.21.15.84:0/54427736 shutdown_connections 2023-07-14T11:17:56.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.938+0000 7f2f84dff700 1 -- 172.21.15.84:0/54427736 wait complete. 2023-07-14T11:17:56.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.940+0000 7f2f84dff700 1 Processor -- start 2023-07-14T11:17:56.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.940+0000 7f2f84dff700 1 -- start start 2023-07-14T11:17:56.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.941+0000 7f2f84dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f6c003bc0 0x7f2f8014e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:56.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.941+0000 7f2f84dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f800c91d0 0x7f2f800cb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:56.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.941+0000 7f2f84dff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f800c9640 0x7f2f800cb620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:56.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.941+0000 7f2f84dff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f800cbe90 con 0x7f2f800c9640 2023-07-14T11:17:56.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.941+0000 7f2f84dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f800cc170 con 0x7f2f800c91d0 2023-07-14T11:17:56.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.941+0000 7f2f84dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f800cc450 con 0x7f2f6c003bc0 2023-07-14T11:17:56.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.942+0000 7f2f7e59c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f6c003bc0 0x7f2f8014e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:56.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.942+0000 7f2f75d9b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f800c91d0 0x7f2f800cb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:56.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.942+0000 7f2f7e59c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f6c003bc0 0x7f2f8014e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.84:45976/0 (socket says 172.21.15.84:45976) 2023-07-14T11:17:56.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.942+0000 7f2f7e59c700 1 -- 172.21.15.84:0/373140370 learned_addr learned my addr 172.21.15.84:0/373140370 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:56.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.942+0000 7f2f7ed9d700 1 --2- 172.21.15.84:0/373140370 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f800c9640 0x7f2f800cb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:56.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.942+0000 7f2f7ed9d700 1 -- 172.21.15.84:0/373140370 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f6c003bc0 msgr2=0x7f2f8014e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:56.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.942+0000 7f2f7ed9d700 1 --2- 172.21.15.84:0/373140370 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f6c003bc0 0x7f2f8014e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:56.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.942+0000 7f2f7ed9d700 1 -- 172.21.15.84:0/373140370 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f800c91d0 msgr2=0x7f2f800cb0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:56.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.942+0000 7f2f7ed9d700 1 --2- 172.21.15.84:0/373140370 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f800c91d0 0x7f2f800cb0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:56.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.942+0000 7f2f7ed9d700 1 -- 172.21.15.84:0/373140370 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f800cc730 con 0x7f2f800c9640 2023-07-14T11:17:56.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.942+0000 7f2f7e59c700 1 --2- 172.21.15.84:0/373140370 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f6c003bc0 0x7f2f8014e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:17:56.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.942+0000 7f2f7ed9d700 1 --2- 172.21.15.84:0/373140370 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f800c9640 0x7f2f800cb620 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f2f8008be20 tx=0x7f2f78011b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:56.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.943+0000 7f2f777fe700 1 -- 172.21.15.84:0/373140370 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f78004300 con 0x7f2f800c9640 2023-07-14T11:17:56.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.943+0000 7f2f777fe700 1 -- 172.21.15.84:0/373140370 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f78004460 con 0x7f2f800c9640 2023-07-14T11:17:56.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.943+0000 7f2f84dff700 1 -- 172.21.15.84:0/373140370 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f800cca10 con 0x7f2f800c9640 2023-07-14T11:17:56.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.943+0000 7f2f777fe700 1 -- 172.21.15.84:0/373140370 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f780038e0 con 0x7f2f800c9640 2023-07-14T11:17:56.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.943+0000 7f2f84dff700 1 -- 172.21.15.84:0/373140370 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f800cd260 con 0x7f2f800c9640 2023-07-14T11:17:56.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.944+0000 7f2f84dff700 1 -- 172.21.15.84:0/373140370 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f8004e280 con 0x7f2f800c9640 2023-07-14T11:17:56.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.945+0000 7f2f777fe700 1 -- 172.21.15.84:0/373140370 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7f2f78003a40 con 0x7f2f800c9640 2023-07-14T11:17:56.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.946+0000 7f2f777fe700 1 --2- 172.21.15.84:0/373140370 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f2f6006b040 0x7f2f6006d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:56.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.946+0000 7f2f777fe700 1 -- 172.21.15.84:0/373140370 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2f78089870 con 0x7f2f800c9640 2023-07-14T11:17:56.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.946+0000 7f2f7e59c700 1 --2- 172.21.15.84:0/373140370 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f2f6006b040 0x7f2f6006d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:56.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.947+0000 7f2f7e59c700 1 --2- 172.21.15.84:0/373140370 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f2f6006b040 0x7f2f6006d4f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f2f70015040 tx=0x7f2f70007000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:56.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:56.950+0000 7f2f777fe700 1 -- 172.21.15.84:0/373140370 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f2f780545e0 con 0x7f2f800c9640 2023-07-14T11:17:57.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:57.148+0000 7f2f84dff700 1 -- 172.21.15.84:0/373140370 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2f8008c5a0 con 0x7f2f800c9640 2023-07-14T11:17:57.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:57.149+0000 7f2f777fe700 1 -- 172.21.15.84:0/373140370 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) v1 ==== 74+0+18343 (secure 0 0 0) 0x7f2f78019020 con 0x7f2f800c9640 2023-07-14T11:17:57.153 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:17:57.153 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":74,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:17:55.741564+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-07-14T11:17:53.456029+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-07-14T11:17:54.724710+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:17:57.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:57.151+0000 7f2f84dff700 1 -- 172.21.15.84:0/373140370 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f2f6006b040 msgr2=0x7f2f6006d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:57.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:57.151+0000 7f2f84dff700 1 --2- 172.21.15.84:0/373140370 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f2f6006b040 0x7f2f6006d4f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f2f70015040 tx=0x7f2f70007000 comp rx=0 tx=0).stop 2023-07-14T11:17:57.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:57.151+0000 7f2f84dff700 1 -- 172.21.15.84:0/373140370 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f800c9640 msgr2=0x7f2f800cb620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:57.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:57.151+0000 7f2f84dff700 1 --2- 172.21.15.84:0/373140370 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f800c9640 0x7f2f800cb620 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f2f8008be20 tx=0x7f2f78011b40 comp rx=0 tx=0).stop 2023-07-14T11:17:57.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:57.151+0000 7f2f84dff700 1 -- 172.21.15.84:0/373140370 shutdown_connections 2023-07-14T11:17:57.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:57.151+0000 7f2f84dff700 1 --2- 172.21.15.84:0/373140370 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f2f6006b040 0x7f2f6006d4f0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:57.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:57.151+0000 7f2f84dff700 1 --2- 172.21.15.84:0/373140370 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f6c003bc0 0x7f2f8014e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:57.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:57.151+0000 7f2f84dff700 1 --2- 172.21.15.84:0/373140370 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f800c9640 0x7f2f800cb620 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:57.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:57.151+0000 7f2f84dff700 1 --2- 172.21.15.84:0/373140370 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f800c91d0 0x7f2f800cb0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:57.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:57.151+0000 7f2f84dff700 1 -- 172.21.15.84:0/373140370 >> 172.21.15.84:0/373140370 conn(0x7f2f8009c1d0 msgr2=0x7f2f8006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:57.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:57.151+0000 7f2f84dff700 1 -- 172.21.15.84:0/373140370 shutdown_connections 2023-07-14T11:17:57.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:57.151+0000 7f2f84dff700 1 -- 172.21.15.84:0/373140370 wait complete. 2023-07-14T11:17:57.173 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-14T11:17:57.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:57.371+0000 7f5a8bfff700 1 Processor -- start 2023-07-14T11:17:57.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:57.371+0000 7f5a8bfff700 1 -- start start 2023-07-14T11:17:57.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:57.372+0000 7f5a8bfff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5a840b8a60 0x7f5a840b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:57.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:57.372+0000 7f5a8bfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5a840b4530 0x7f5a840d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:57.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:57.372+0000 7f5a8bfff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a840d1490 con 0x7f5a840d1050 2023-07-14T11:17:57.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:57.372+0000 7f5a8bfff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a840b8e30 con 0x7f5a840b4530 2023-07-14T11:17:57.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:57.372+0000 7f5a8bfff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a840b1e30 con 0x7f5a840b8a60 2023-07-14T11:17:57.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:57.372+0000 7f5a8959a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5a840b4530 0x7f5a840d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:57.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:57.372+0000 7f5a8959a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5a840b4530 0x7f5a840d0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44984/0 (socket says 172.21.15.84:44984) 2023-07-14T11:17:57.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:57.372+0000 7f5a8959a700 1 -- 172.21.15.84:0/3444967747 learned_addr learned my addr 172.21.15.84:0/3444967747 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:57.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:57.373+0000 7f5a89d9b700 1 --2- 172.21.15.84:0/3444967747 >> v2:172.21.15.179:3300/0 conn(0x7f5a840b8a60 0x7f5a840b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:57.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:57.373+0000 7f5a8959a700 1 -- 172.21.15.84:0/3444967747 >> v2:172.21.15.179:3300/0 conn(0x7f5a840b8a60 msgr2=0x7f5a840b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:57.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:57.373+0000 7f5a8959a700 1 --2- 172.21.15.84:0/3444967747 >> v2:172.21.15.179:3300/0 conn(0x7f5a840b8a60 0x7f5a840b3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:57.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:57.373+0000 7f5a8959a700 1 -- 172.21.15.84:0/3444967747 >> v1:172.21.15.179:6789/0 conn(0x7f5a840d1050 legacy=0x7f5a840b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:57.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:57.373+0000 7f5a8959a700 1 -- 172.21.15.84:0/3444967747 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a840afaa0 con 0x7f5a840b4530 2023-07-14T11:17:57.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:57.373+0000 7f5a8959a700 1 --2- 172.21.15.84:0/3444967747 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a840b4530 0x7f5a840d0b10 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f5a840b5b00 tx=0x7f5a74009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c260beaf318e0375 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:57.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:57.373+0000 7f5a88d99700 1 -- 172.21.15.84:0/3444967747 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a7400b870 con 0x7f5a840b4530 2023-07-14T11:17:57.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:57.373+0000 7f5a88d99700 1 -- 172.21.15.84:0/3444967747 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a7400b9d0 con 0x7f5a840b4530 2023-07-14T11:17:57.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:57.373+0000 7f5a88d99700 1 -- 172.21.15.84:0/3444967747 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a7400bd60 con 0x7f5a840b4530 2023-07-14T11:17:57.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:57.374+0000 7f5a8bfff700 1 -- 172.21.15.84:0/3444967747 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a840b4530 msgr2=0x7f5a840d0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:57.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:57.374+0000 7f5a8bfff700 1 --2- 172.21.15.84:0/3444967747 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a840b4530 0x7f5a840d0b10 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f5a840b5b00 tx=0x7f5a74009bd0 comp rx=0 tx=0).stop 2023-07-14T11:17:57.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:57.374+0000 7f5a8bfff700 1 -- 172.21.15.84:0/3444967747 shutdown_connections 2023-07-14T11:17:57.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:57.374+0000 7f5a8bfff700 1 --2- 172.21.15.84:0/3444967747 >> v2:172.21.15.179:3300/0 conn(0x7f5a840b8a60 0x7f5a840b3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:57.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:57.374+0000 7f5a8bfff700 1 --2- 172.21.15.84:0/3444967747 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a840b4530 0x7f5a840d0b10 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:57.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:57.374+0000 7f5a8bfff700 1 -- 172.21.15.84:0/3444967747 >> 172.21.15.84:0/3444967747 conn(0x7f5a8409c1b0 msgr2=0x7f5a840d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:57.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:57.374+0000 7f5a8bfff700 1 -- 172.21.15.84:0/3444967747 shutdown_connections 2023-07-14T11:17:57.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:57.374+0000 7f5a8bfff700 1 -- 172.21.15.84:0/3444967747 wait complete. 2023-07-14T11:17:57.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:57.376+0000 7f5a8bfff700 1 Processor -- start 2023-07-14T11:17:57.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:57.376+0000 7f5a8bfff700 1 -- start start 2023-07-14T11:17:57.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:57.377+0000 7f5a8bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a840b4530 0x7f5a84156580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:57.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:57.377+0000 7f5a8bfff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a840b8a60 0x7f5a8415f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:57.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:57.377+0000 7f5a8bfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a840d1050 0x7f5a8406b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:57.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:57.377+0000 7f5a8bfff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a840cb840 con 0x7f5a840b4530 2023-07-14T11:17:57.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:57.377+0000 7f5a8bfff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a84156ac0 con 0x7f5a840b8a60 2023-07-14T11:17:57.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:57.377+0000 7f5a8bfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8415dba0 con 0x7f5a840d1050 2023-07-14T11:17:57.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:57.377+0000 7f5a89d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a840b4530 0x7f5a84156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:57.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:57.377+0000 7f5a89d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a840b4530 0x7f5a84156580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44992/0 (socket says 172.21.15.84:44992) 2023-07-14T11:17:57.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:57.377+0000 7f5a89d9b700 1 -- 172.21.15.84:0/3008649127 learned_addr learned my addr 172.21.15.84:0/3008649127 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:57.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:57.377+0000 7f5a89d9b700 1 -- 172.21.15.84:0/3008649127 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a840d1050 msgr2=0x7f5a8406b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:57.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:57.377+0000 7f5a8959a700 1 --2- 172.21.15.84:0/3008649127 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a840b8a60 0x7f5a8415f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:57.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:57.377+0000 7f5a8a59c700 1 --2- 172.21.15.84:0/3008649127 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a840d1050 0x7f5a8406b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:57.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:57.377+0000 7f5a89d9b700 1 --2- 172.21.15.84:0/3008649127 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a840d1050 0x7f5a8406b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:57.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:57.378+0000 7f5a89d9b700 1 -- 172.21.15.84:0/3008649127 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a840b8a60 msgr2=0x7f5a8415f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:57.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:57.378+0000 7f5a89d9b700 1 --2- 172.21.15.84:0/3008649127 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a840b8a60 0x7f5a8415f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:57.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:57.378+0000 7f5a89d9b700 1 -- 172.21.15.84:0/3008649127 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a74009550 con 0x7f5a840b4530 2023-07-14T11:17:57.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:57.378+0000 7f5a8959a700 1 --2- 172.21.15.84:0/3008649127 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a840b8a60 0x7f5a8415f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:17:57.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:57.378+0000 7f5a8a59c700 1 --2- 172.21.15.84:0/3008649127 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a840d1050 0x7f5a8406b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:17:57.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:57.378+0000 7f5a89d9b700 1 --2- 172.21.15.84:0/3008649127 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a840b4530 0x7f5a84156580 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f5a8000e810 tx=0x7f5a8000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:57.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:57.378+0000 7f5a7a7fc700 1 -- 172.21.15.84:0/3008649127 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a80013610 con 0x7f5a840b4530 2023-07-14T11:17:57.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:57.378+0000 7f5a7a7fc700 1 -- 172.21.15.84:0/3008649127 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a80013770 con 0x7f5a840b4530 2023-07-14T11:17:57.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:57.378+0000 7f5a7a7fc700 1 -- 172.21.15.84:0/3008649127 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a80013b20 con 0x7f5a840b4530 2023-07-14T11:17:57.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:57.378+0000 7f5a8bfff700 1 -- 172.21.15.84:0/3008649127 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a8415de80 con 0x7f5a840b4530 2023-07-14T11:17:57.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:57.378+0000 7f5a8bfff700 1 -- 172.21.15.84:0/3008649127 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a8415e440 con 0x7f5a840b4530 2023-07-14T11:17:57.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:57.379+0000 7f5a8bfff700 1 -- 172.21.15.84:0/3008649127 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a840cb980 con 0x7f5a840b4530 2023-07-14T11:17:57.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:57.380+0000 7f5a7a7fc700 1 -- 172.21.15.84:0/3008649127 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7f5a80013c80 con 0x7f5a840b4530 2023-07-14T11:17:57.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:57.381+0000 7f5a7a7fc700 1 --2- 172.21.15.84:0/3008649127 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f5a6806b070 0x7f5a6806d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:57.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:57.381+0000 7f5a7a7fc700 1 -- 172.21.15.84:0/3008649127 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5a80089800 con 0x7f5a840b4530 2023-07-14T11:17:57.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:57.381+0000 7f5a8959a700 1 --2- 172.21.15.84:0/3008649127 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f5a6806b070 0x7f5a6806d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:57.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:57.382+0000 7f5a8959a700 1 --2- 172.21.15.84:0/3008649127 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f5a6806b070 0x7f5a6806d520 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f5a840b7be0 tx=0x7f5a74008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:57.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:57.385+0000 7f5a7a7fc700 1 -- 172.21.15.84:0/3008649127 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f5a840cb980 con 0x7f5a840b4530 2023-07-14T11:17:57.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:57.629+0000 7f5a8bfff700 1 -- 172.21.15.84:0/3008649127 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f5a840cb980 con 0x7f5a840b4530 2023-07-14T11:17:58.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:58.277+0000 7f5a7a7fc700 1 -- 172.21.15.84:0/3008649127 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v44) v1 ==== 118+0+0 (secure 0 0 0) 0x7f5a840cb980 con 0x7f5a840b4530 2023-07-14T11:17:58.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:58.279+0000 7f5a8bfff700 1 -- 172.21.15.84:0/3008649127 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f5a6806b070 msgr2=0x7f5a6806d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:58.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:58.279+0000 7f5a8bfff700 1 --2- 172.21.15.84:0/3008649127 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f5a6806b070 0x7f5a6806d520 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f5a840b7be0 tx=0x7f5a74008030 comp rx=0 tx=0).stop 2023-07-14T11:17:58.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:58.279+0000 7f5a8bfff700 1 -- 172.21.15.84:0/3008649127 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a840b4530 msgr2=0x7f5a84156580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:58.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:58.279+0000 7f5a8bfff700 1 --2- 172.21.15.84:0/3008649127 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a840b4530 0x7f5a84156580 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f5a8000e810 tx=0x7f5a8000ebd0 comp rx=0 tx=0).stop 2023-07-14T11:17:58.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:58.279+0000 7f5a8bfff700 1 -- 172.21.15.84:0/3008649127 shutdown_connections 2023-07-14T11:17:58.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:58.279+0000 7f5a8bfff700 1 --2- 172.21.15.84:0/3008649127 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f5a6806b070 0x7f5a6806d520 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:58.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:58.279+0000 7f5a8bfff700 1 --2- 172.21.15.84:0/3008649127 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a840d1050 0x7f5a8406b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:58.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:58.279+0000 7f5a8bfff700 1 --2- 172.21.15.84:0/3008649127 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a840b4530 0x7f5a84156580 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:58.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:58.279+0000 7f5a8bfff700 1 --2- 172.21.15.84:0/3008649127 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a840b8a60 0x7f5a8415f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:58.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:58.279+0000 7f5a8bfff700 1 -- 172.21.15.84:0/3008649127 >> 172.21.15.84:0/3008649127 conn(0x7f5a8409c1b0 msgr2=0x7f5a8415c360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:58.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:58.280+0000 7f5a8bfff700 1 -- 172.21.15.84:0/3008649127 shutdown_connections 2023-07-14T11:17:58.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:58.280+0000 7f5a8bfff700 1 -- 172.21.15.84:0/3008649127 wait complete. 2023-07-14T11:17:58.301 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-14T11:17:58.302 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-14T11:17:58.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:58.498+0000 7f8caf7ff700 1 Processor -- start 2023-07-14T11:17:58.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:58.498+0000 7f8caf7ff700 1 -- start start 2023-07-14T11:17:58.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:58.499+0000 7f8caf7ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8ca80b8a60 0x7f8ca80b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:58.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:58.499+0000 7f8caf7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ca80b4530 0x7f8ca80d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:58.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:58.499+0000 7f8caf7ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ca80b8e30 con 0x7f8ca80d1050 2023-07-14T11:17:58.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:58.499+0000 7f8caf7ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ca80d14d0 con 0x7f8ca80b8a60 2023-07-14T11:17:58.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:58.499+0000 7f8caf7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca80b1e30 con 0x7f8ca80b4530 2023-07-14T11:17:58.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:58.499+0000 7f8cad59b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8ca80b8a60 0x7f8ca80b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:58.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:58.499+0000 7f8cadd9c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f8ca80d1050 0x7f8ca80b25d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:37066/0 (socket says 172.21.15.84:37066) 2023-07-14T11:17:58.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:58.499+0000 7f8cadd9c700 1 -- 172.21.15.84:0/2519242588 learned_addr learned my addr 172.21.15.84:0/2519242588 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:17:58.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:58.500+0000 7f8cacd9a700 1 --2- 172.21.15.84:0/2519242588 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ca80b4530 0x7f8ca80d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:58.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:58.500+0000 7f8cad59b700 1 -- 172.21.15.84:0/2519242588 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ca80b4530 msgr2=0x7f8ca80d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:58.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:58.500+0000 7f8cad59b700 1 --2- 172.21.15.84:0/2519242588 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ca80b4530 0x7f8ca80d0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:58.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:58.500+0000 7f8cad59b700 1 -- 172.21.15.84:0/2519242588 >> v1:172.21.15.84:6789/0 conn(0x7f8ca80d1050 legacy=0x7f8ca80b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:58.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:58.500+0000 7f8cad59b700 1 -- 172.21.15.84:0/2519242588 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ca80afaa0 con 0x7f8ca80b8a60 2023-07-14T11:17:58.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:58.500+0000 7f8cacd9a700 1 --2- 172.21.15.84:0/2519242588 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ca80b4530 0x7f8ca80d0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:17:58.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:58.500+0000 7f8cad59b700 1 --2- 172.21.15.84:0/2519242588 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ca80b8a60 0x7f8ca80b3ff0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4009840 tx=0x7f8ca4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=365a89f08ac2ac12 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:58.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:58.500+0000 7f8c9ffff700 1 -- 172.21.15.84:0/2519242588 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca4011830 con 0x7f8ca80b8a60 2023-07-14T11:17:58.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:58.500+0000 7f8c9ffff700 1 -- 172.21.15.84:0/2519242588 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ca4011990 con 0x7f8ca80b8a60 2023-07-14T11:17:58.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:58.500+0000 7f8c9ffff700 1 -- 172.21.15.84:0/2519242588 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca4011d20 con 0x7f8ca80b8a60 2023-07-14T11:17:58.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:58.501+0000 7f8caf7ff700 1 -- 172.21.15.84:0/2519242588 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ca80b8a60 msgr2=0x7f8ca80b3ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:58.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:58.501+0000 7f8caf7ff700 1 --2- 172.21.15.84:0/2519242588 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ca80b8a60 0x7f8ca80b3ff0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4009840 tx=0x7f8ca4009b50 comp rx=0 tx=0).stop 2023-07-14T11:17:58.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:58.501+0000 7f8caf7ff700 1 -- 172.21.15.84:0/2519242588 shutdown_connections 2023-07-14T11:17:58.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:58.501+0000 7f8caf7ff700 1 --2- 172.21.15.84:0/2519242588 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ca80b8a60 0x7f8ca80b3ff0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:58.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:58.501+0000 7f8caf7ff700 1 --2- 172.21.15.84:0/2519242588 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ca80b4530 0x7f8ca80d0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:58.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:58.501+0000 7f8caf7ff700 1 -- 172.21.15.84:0/2519242588 >> 172.21.15.84:0/2519242588 conn(0x7f8ca809c1b0 msgr2=0x7f8ca80d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:58.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:58.501+0000 7f8caf7ff700 1 -- 172.21.15.84:0/2519242588 shutdown_connections 2023-07-14T11:17:58.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:58.501+0000 7f8caf7ff700 1 -- 172.21.15.84:0/2519242588 wait complete. 2023-07-14T11:17:58.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:58.502+0000 7f8caf7ff700 1 Processor -- start 2023-07-14T11:17:58.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:58.503+0000 7f8caf7ff700 1 -- start start 2023-07-14T11:17:58.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:58.503+0000 7f8caf7ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ca80b4530 0x7f8ca80b7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:58.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:58.504+0000 7f8caf7ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ca80b8a60 0x7f8ca80cc880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:58.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:58.504+0000 7f8caf7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ca80d1050 0x7f8ca81f5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:58.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:58.504+0000 7f8caf7ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca80cc3f0 con 0x7f8ca80b4530 2023-07-14T11:17:58.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:58.504+0000 7f8caf7ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca81f5ef0 con 0x7f8ca80b8a60 2023-07-14T11:17:58.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:58.504+0000 7f8caf7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca81f61d0 con 0x7f8ca80d1050 2023-07-14T11:17:58.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:58.504+0000 7f8cad59b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ca80b4530 0x7f8ca80b7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:58.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:58.504+0000 7f8cad59b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ca80b4530 0x7f8ca80b7030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45018/0 (socket says 172.21.15.84:45018) 2023-07-14T11:17:58.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:58.504+0000 7f8cad59b700 1 -- 172.21.15.84:0/1749586793 learned_addr learned my addr 172.21.15.84:0/1749586793 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:58.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:58.504+0000 7f8cadd9c700 1 --2- 172.21.15.84:0/1749586793 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ca80d1050 0x7f8ca81f5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:58.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:58.504+0000 7f8cacd9a700 1 --2- 172.21.15.84:0/1749586793 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ca80b8a60 0x7f8ca80cc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:58.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:58.504+0000 7f8cad59b700 1 -- 172.21.15.84:0/1749586793 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ca80d1050 msgr2=0x7f8ca81f5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:58.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:58.504+0000 7f8cad59b700 1 --2- 172.21.15.84:0/1749586793 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ca80d1050 0x7f8ca81f5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:58.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:58.504+0000 7f8cad59b700 1 -- 172.21.15.84:0/1749586793 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ca80b8a60 msgr2=0x7f8ca80cc880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:58.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:58.504+0000 7f8cad59b700 1 --2- 172.21.15.84:0/1749586793 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ca80b8a60 0x7f8ca80cc880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:58.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:58.504+0000 7f8cad59b700 1 -- 172.21.15.84:0/1749586793 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ca40094a0 con 0x7f8ca80b4530 2023-07-14T11:17:58.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:58.504+0000 7f8cadd9c700 1 --2- 172.21.15.84:0/1749586793 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ca80d1050 0x7f8ca81f5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:17:58.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:58.505+0000 7f8cad59b700 1 --2- 172.21.15.84:0/1749586793 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ca80b4530 0x7f8ca80b7030 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f8ca40090b0 tx=0x7f8ca4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:58.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:58.505+0000 7f8c9dffb700 1 -- 172.21.15.84:0/1749586793 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca40038a0 con 0x7f8ca80b4530 2023-07-14T11:17:58.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:58.505+0000 7f8c9dffb700 1 -- 172.21.15.84:0/1749586793 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ca401f070 con 0x7f8ca80b4530 2023-07-14T11:17:58.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:58.505+0000 7f8c9dffb700 1 -- 172.21.15.84:0/1749586793 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca4003c40 con 0x7f8ca80b4530 2023-07-14T11:17:58.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:58.505+0000 7f8caf7ff700 1 -- 172.21.15.84:0/1749586793 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ca80cc080 con 0x7f8ca80b4530 2023-07-14T11:17:58.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:58.505+0000 7f8caf7ff700 1 -- 172.21.15.84:0/1749586793 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ca80b7750 con 0x7f8ca80b4530 2023-07-14T11:17:58.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:58.506+0000 7f8caf7ff700 1 -- 172.21.15.84:0/1749586793 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ca80cbee0 con 0x7f8ca80b4530 2023-07-14T11:17:58.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:58.507+0000 7f8c9dffb700 1 -- 172.21.15.84:0/1749586793 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7f8ca4026480 con 0x7f8ca80b4530 2023-07-14T11:17:58.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:58.508+0000 7f8c9dffb700 1 --2- 172.21.15.84:0/1749586793 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f8c8c06b040 0x7f8c8c06d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:58.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:58.508+0000 7f8c9dffb700 1 -- 172.21.15.84:0/1749586793 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8ca4021070 con 0x7f8ca80b4530 2023-07-14T11:17:58.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:58.508+0000 7f8cacd9a700 1 --2- 172.21.15.84:0/1749586793 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f8c8c06b040 0x7f8c8c06d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:58.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:58.509+0000 7f8cacd9a700 1 --2- 172.21.15.84:0/1749586793 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f8c8c06b040 0x7f8c8c06d4f0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f8c98006fd0 tx=0x7f8c98008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:58.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:58.512+0000 7f8c9dffb700 1 -- 172.21.15.84:0/1749586793 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f8ca80cbee0 con 0x7f8ca80b4530 2023-07-14T11:17:58.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:58.748+0000 7f8caf7ff700 1 -- 172.21.15.84:0/1749586793 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f8ca80cbee0 con 0x7f8ca80b4530 2023-07-14T11:17:59.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.282+0000 7f8c9dffb700 1 -- 172.21.15.84:0/1749586793 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v45) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8ca80cbee0 con 0x7f8ca80b4530 2023-07-14T11:17:59.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.284+0000 7f8caf7ff700 1 -- 172.21.15.84:0/1749586793 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f8c8c06b040 msgr2=0x7f8c8c06d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:59.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.284+0000 7f8caf7ff700 1 --2- 172.21.15.84:0/1749586793 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f8c8c06b040 0x7f8c8c06d4f0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f8c98006fd0 tx=0x7f8c98008040 comp rx=0 tx=0).stop 2023-07-14T11:17:59.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.284+0000 7f8caf7ff700 1 -- 172.21.15.84:0/1749586793 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ca80b4530 msgr2=0x7f8ca80b7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:59.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.284+0000 7f8caf7ff700 1 --2- 172.21.15.84:0/1749586793 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ca80b4530 0x7f8ca80b7030 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f8ca40090b0 tx=0x7f8ca4004750 comp rx=0 tx=0).stop 2023-07-14T11:17:59.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.284+0000 7f8caf7ff700 1 -- 172.21.15.84:0/1749586793 shutdown_connections 2023-07-14T11:17:59.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.284+0000 7f8caf7ff700 1 --2- 172.21.15.84:0/1749586793 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f8c8c06b040 0x7f8c8c06d4f0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:59.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.284+0000 7f8caf7ff700 1 --2- 172.21.15.84:0/1749586793 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ca80d1050 0x7f8ca81f5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:59.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.284+0000 7f8caf7ff700 1 --2- 172.21.15.84:0/1749586793 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ca80b4530 0x7f8ca80b7030 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:59.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.284+0000 7f8caf7ff700 1 --2- 172.21.15.84:0/1749586793 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ca80b8a60 0x7f8ca80cc880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:59.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.284+0000 7f8caf7ff700 1 -- 172.21.15.84:0/1749586793 >> 172.21.15.84:0/1749586793 conn(0x7f8ca809c1b0 msgr2=0x7f8ca80b2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:59.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.285+0000 7f8caf7ff700 1 -- 172.21.15.84:0/1749586793 shutdown_connections 2023-07-14T11:17:59.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.285+0000 7f8caf7ff700 1 -- 172.21.15.84:0/1749586793 wait complete. 2023-07-14T11:17:59.306 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-14T11:17:59.306 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T11:17:59.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.499+0000 7efc4b1ff700 1 Processor -- start 2023-07-14T11:17:59.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.499+0000 7efc4b1ff700 1 -- start start 2023-07-14T11:17:59.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.500+0000 7efc4b1ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7efc440b5d90 0x7efc440b6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:59.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.500+0000 7efc4b1ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7efc440d0b10 0x7efc440d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:59.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.500+0000 7efc4b1ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc440b7f50 con 0x7efc440b4510 2023-07-14T11:17:59.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.500+0000 7efc4b1ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc440b48e0 con 0x7efc440d0b10 2023-07-14T11:17:59.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.500+0000 7efc4b1ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc440d14d0 con 0x7efc440b5d90 2023-07-14T11:17:59.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.500+0000 7efc4979c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7efc440d0b10 0x7efc440d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:59.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.500+0000 7efc4979c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7efc440d0b10 0x7efc440d0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36466/0 (socket says 172.21.15.84:36466) 2023-07-14T11:17:59.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.500+0000 7efc4979c700 1 -- 172.21.15.84:0/1661295181 learned_addr learned my addr 172.21.15.84:0/1661295181 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:59.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.501+0000 7efc43fff700 1 --2- 172.21.15.84:0/1661295181 >> v2:172.21.15.179:3300/0 conn(0x7efc440b5d90 0x7efc440b6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:59.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.501+0000 7efc4979c700 1 -- 172.21.15.84:0/1661295181 >> v2:172.21.15.179:3300/0 conn(0x7efc440b5d90 msgr2=0x7efc440b6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:17:59.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.501+0000 7efc4979c700 1 --2- 172.21.15.84:0/1661295181 >> v2:172.21.15.179:3300/0 conn(0x7efc440b5d90 0x7efc440b6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:59.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.501+0000 7efc4979c700 1 -- 172.21.15.84:0/1661295181 >> v1:172.21.15.179:6789/0 conn(0x7efc440b4510 legacy=0x7efc440cd590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:59.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.501+0000 7efc4979c700 1 -- 172.21.15.84:0/1661295181 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc440cdca0 con 0x7efc440d0b10 2023-07-14T11:17:59.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.501+0000 7efc4979c700 1 --2- 172.21.15.84:0/1661295181 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc440d0b10 0x7efc440d0f90 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7efc440b5b30 tx=0x7efc3c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b15e30d6785e49d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:59.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.501+0000 7efc437fe700 1 -- 172.21.15.84:0/1661295181 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3c00e070 con 0x7efc440d0b10 2023-07-14T11:17:59.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.501+0000 7efc437fe700 1 -- 172.21.15.84:0/1661295181 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc3c00b910 con 0x7efc440d0b10 2023-07-14T11:17:59.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.501+0000 7efc437fe700 1 -- 172.21.15.84:0/1661295181 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3c00bcc0 con 0x7efc440d0b10 2023-07-14T11:17:59.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.502+0000 7efc4b1ff700 1 -- 172.21.15.84:0/1661295181 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc440d0b10 msgr2=0x7efc440d0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:59.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.502+0000 7efc4b1ff700 1 --2- 172.21.15.84:0/1661295181 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc440d0b10 0x7efc440d0f90 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7efc440b5b30 tx=0x7efc3c00b330 comp rx=0 tx=0).stop 2023-07-14T11:17:59.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.502+0000 7efc4b1ff700 1 -- 172.21.15.84:0/1661295181 shutdown_connections 2023-07-14T11:17:59.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.502+0000 7efc4b1ff700 1 --2- 172.21.15.84:0/1661295181 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc440d0b10 0x7efc440d0f90 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:59.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.502+0000 7efc4b1ff700 1 --2- 172.21.15.84:0/1661295181 >> v2:172.21.15.179:3300/0 conn(0x7efc440b5d90 0x7efc440b6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:59.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.502+0000 7efc4b1ff700 1 -- 172.21.15.84:0/1661295181 >> 172.21.15.84:0/1661295181 conn(0x7efc4409c1d0 msgr2=0x7efc440d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:59.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.502+0000 7efc4b1ff700 1 -- 172.21.15.84:0/1661295181 shutdown_connections 2023-07-14T11:17:59.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.502+0000 7efc4b1ff700 1 -- 172.21.15.84:0/1661295181 wait complete. 2023-07-14T11:17:59.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.504+0000 7efc4b1ff700 1 Processor -- start 2023-07-14T11:17:59.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.504+0000 7efc4b1ff700 1 -- start start 2023-07-14T11:17:59.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.505+0000 7efc4b1ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc440b4510 0x7efc44151c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:59.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.505+0000 7efc4b1ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efc440b5d90 0x7efc44153b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:59.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.505+0000 7efc4b1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efc440d0b10 0x7efc44154060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:59.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.505+0000 7efc4b1ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc440c71a0 con 0x7efc440b4510 2023-07-14T11:17:59.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.505+0000 7efc4b1ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc44154680 con 0x7efc440b5d90 2023-07-14T11:17:59.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.505+0000 7efc4b1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc44154960 con 0x7efc440d0b10 2023-07-14T11:17:59.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.505+0000 7efc48f9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc440b4510 0x7efc44151c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:59.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.505+0000 7efc48f9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc440b4510 0x7efc44151c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36468/0 (socket says 172.21.15.84:36468) 2023-07-14T11:17:59.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.505+0000 7efc48f9b700 1 -- 172.21.15.84:0/405665035 learned_addr learned my addr 172.21.15.84:0/405665035 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:59.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.505+0000 7efc4979c700 1 --2- 172.21.15.84:0/405665035 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efc440d0b10 0x7efc44154060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:59.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.505+0000 7efc43fff700 1 --2- 172.21.15.84:0/405665035 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efc440b5d90 0x7efc44153b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:59.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.505+0000 7efc48f9b700 1 -- 172.21.15.84:0/405665035 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efc440d0b10 msgr2=0x7efc44154060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:59.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.505+0000 7efc48f9b700 1 --2- 172.21.15.84:0/405665035 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efc440d0b10 0x7efc44154060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:59.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.505+0000 7efc48f9b700 1 -- 172.21.15.84:0/405665035 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efc440b5d90 msgr2=0x7efc44153b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:59.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.505+0000 7efc48f9b700 1 --2- 172.21.15.84:0/405665035 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efc440b5d90 0x7efc44153b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:59.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.505+0000 7efc48f9b700 1 -- 172.21.15.84:0/405665035 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc3c009b30 con 0x7efc440b4510 2023-07-14T11:17:59.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.506+0000 7efc48f9b700 1 --2- 172.21.15.84:0/405665035 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc440b4510 0x7efc44151c70 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7efc3800c4d0 tx=0x7efc3800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:59.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.506+0000 7efc417fa700 1 -- 172.21.15.84:0/405665035 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc380052d0 con 0x7efc440b4510 2023-07-14T11:17:59.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.506+0000 7efc417fa700 1 -- 172.21.15.84:0/405665035 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc38005430 con 0x7efc440b4510 2023-07-14T11:17:59.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.506+0000 7efc4b1ff700 1 -- 172.21.15.84:0/405665035 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc44154c40 con 0x7efc440b4510 2023-07-14T11:17:59.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.506+0000 7efc417fa700 1 -- 172.21.15.84:0/405665035 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc380038f0 con 0x7efc440b4510 2023-07-14T11:17:59.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.506+0000 7efc4b1ff700 1 -- 172.21.15.84:0/405665035 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc44154f20 con 0x7efc440b4510 2023-07-14T11:17:59.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.507+0000 7efc4b1ff700 1 -- 172.21.15.84:0/405665035 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc4404e280 con 0x7efc440b4510 2023-07-14T11:17:59.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.508+0000 7efc417fa700 1 -- 172.21.15.84:0/405665035 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7efc38003a50 con 0x7efc440b4510 2023-07-14T11:17:59.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.509+0000 7efc417fa700 1 --2- 172.21.15.84:0/405665035 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7efc2806b040 0x7efc2806d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:59.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.509+0000 7efc417fa700 1 -- 172.21.15.84:0/405665035 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efc38088e70 con 0x7efc440b4510 2023-07-14T11:17:59.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.510+0000 7efc43fff700 1 --2- 172.21.15.84:0/405665035 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7efc2806b040 0x7efc2806d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:59.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.510+0000 7efc43fff700 1 --2- 172.21.15.84:0/405665035 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7efc2806b040 0x7efc2806d4f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7efc440a0e10 tx=0x7efc30008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:59.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.513+0000 7efc417fa700 1 -- 172.21.15.84:0/405665035 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7efc38053b10 con 0x7efc440b4510 2023-07-14T11:17:59.666 INFO:tasks.ceph.mds.c.smithi084.stderr:2023-07-14T11:17:59.663+0000 7f5fa49f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-14T11:17:59.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.748+0000 7efc4b1ff700 1 -- 172.21.15.84:0/405665035 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efc440b4080 con 0x7efc440b4510 2023-07-14T11:17:59.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.749+0000 7efc417fa700 1 -- 172.21.15.84:0/405665035 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+4717 (secure 0 0 0) 0x7efc38057130 con 0x7efc440b4510 2023-07-14T11:17:59.752 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:17:59.753 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":45,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5615,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3014145470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3014145470},{"type":"v1","addr":"172.21.15.179:6834","nonce":3014145470}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":5621,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3377004712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":3377004712},{"type":"v1","addr":"172.21.15.179:6835","nonce":3377004712}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":6681,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1864489758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1864489758},{"type":"v1","addr":"172.21.15.84:6835","nonce":1864489758}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T11:17:55.741927+0000","modified":"2023-07-14T11:17:59.277009+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6690},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6690":{"gid":6690,"name":"c","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/2405785300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":2405785300},{"type":"v1","addr":"172.21.15.84:6837","nonce":2405785300}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-07-14T11:17:59.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.751+0000 7efc4b1ff700 1 -- 172.21.15.84:0/405665035 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7efc2806b040 msgr2=0x7efc2806d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:59.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.751+0000 7efc4b1ff700 1 --2- 172.21.15.84:0/405665035 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7efc2806b040 0x7efc2806d4f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7efc440a0e10 tx=0x7efc30008040 comp rx=0 tx=0).stop 2023-07-14T11:17:59.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.751+0000 7efc4b1ff700 1 -- 172.21.15.84:0/405665035 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc440b4510 msgr2=0x7efc44151c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:59.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.751+0000 7efc4b1ff700 1 --2- 172.21.15.84:0/405665035 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc440b4510 0x7efc44151c70 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7efc3800c4d0 tx=0x7efc3800c890 comp rx=0 tx=0).stop 2023-07-14T11:17:59.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.751+0000 7efc4b1ff700 1 -- 172.21.15.84:0/405665035 shutdown_connections 2023-07-14T11:17:59.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.751+0000 7efc4b1ff700 1 --2- 172.21.15.84:0/405665035 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7efc2806b040 0x7efc2806d4f0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:59.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.751+0000 7efc4b1ff700 1 --2- 172.21.15.84:0/405665035 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efc440d0b10 0x7efc44154060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:59.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.751+0000 7efc4b1ff700 1 --2- 172.21.15.84:0/405665035 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc440b4510 0x7efc44151c70 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:59.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.751+0000 7efc4b1ff700 1 --2- 172.21.15.84:0/405665035 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efc440b5d90 0x7efc44153b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:59.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.751+0000 7efc4b1ff700 1 -- 172.21.15.84:0/405665035 >> 172.21.15.84:0/405665035 conn(0x7efc4409c1d0 msgr2=0x7efc4415b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:59.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.751+0000 7efc4b1ff700 1 -- 172.21.15.84:0/405665035 shutdown_connections 2023-07-14T11:17:59.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.751+0000 7efc4b1ff700 1 -- 172.21.15.84:0/405665035 wait complete. 2023-07-14T11:17:59.756 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 45 2023-07-14T11:17:59.772 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:17:59.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.967+0000 7ff2b11ff700 1 Processor -- start 2023-07-14T11:17:59.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.967+0000 7ff2b11ff700 1 -- start start 2023-07-14T11:17:59.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.968+0000 7ff2b11ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2ac0b5d90 0x7ff2ac0b6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:59.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.969+0000 7ff2b11ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2ac0b7f50 con 0x7ff2ac0d0b10 2023-07-14T11:17:59.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.969+0000 7ff2b11ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2ac0cdca0 con 0x7ff2ac0b4510 2023-07-14T11:17:59.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.969+0000 7ff2b11ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ac0b48e0 con 0x7ff2ac0b5d90 2023-07-14T11:17:59.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.969+0000 7ff2ab59e700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7ff2ac0d0b10 0x7ff2ac0b83e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:59486/0 (socket says 172.21.15.84:59486) 2023-07-14T11:17:59.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.969+0000 7ff2ab59e700 1 -- 172.21.15.84:0/2944612544 learned_addr learned my addr 172.21.15.84:0/2944612544 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:17:59.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.969+0000 7ff2a3fff700 1 --2- 172.21.15.84:0/2944612544 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2ac0b5d90 0x7ff2ac0b6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:59.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.969+0000 7ff2aa59c700 1 -- 172.21.15.84:0/2944612544 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1893717573 0 0) 0x7ff2ac0b7f50 con 0x7ff2ac0d0b10 2023-07-14T11:17:59.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.969+0000 7ff2aa59c700 1 -- 172.21.15.84:0/2944612544 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2980035b0 con 0x7ff2ac0d0b10 2023-07-14T11:17:59.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.969+0000 7ff2aa59c700 1 -- 172.21.15.84:0/2944612544 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 770289377 0 0) 0x7ff2ac0cdca0 con 0x7ff2ac0b4510 2023-07-14T11:17:59.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.969+0000 7ff2aa59c700 1 -- 172.21.15.84:0/2944612544 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2ac0b7f50 con 0x7ff2ac0b4510 2023-07-14T11:17:59.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.969+0000 7ff2a3fff700 1 -- 172.21.15.84:0/2944612544 >> v1:172.21.15.179:6789/0 conn(0x7ff2ac0b4510 legacy=0x7ff2ac0cd590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:59.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.969+0000 7ff2a3fff700 1 -- 172.21.15.84:0/2944612544 >> v1:172.21.15.84:6789/0 conn(0x7ff2ac0d0b10 legacy=0x7ff2ac0b83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:59.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.969+0000 7ff2a3fff700 1 -- 172.21.15.84:0/2944612544 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2ac0b7340 con 0x7ff2ac0b5d90 2023-07-14T11:17:59.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.970+0000 7ff2a3fff700 1 --2- 172.21.15.84:0/2944612544 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2ac0b5d90 0x7ff2ac0b6c80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff294009870 tx=0x7ff294009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a996cd4cb0a838c2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:59.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.970+0000 7ff2aa59c700 1 -- 172.21.15.84:0/2944612544 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff294011830 con 0x7ff2ac0b5d90 2023-07-14T11:17:59.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.970+0000 7ff2aa59c700 1 -- 172.21.15.84:0/2944612544 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff294011990 con 0x7ff2ac0b5d90 2023-07-14T11:17:59.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.970+0000 7ff2aa59c700 1 -- 172.21.15.84:0/2944612544 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff294011d00 con 0x7ff2ac0b5d90 2023-07-14T11:17:59.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.971+0000 7ff2b11ff700 1 -- 172.21.15.84:0/2944612544 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2ac0b5d90 msgr2=0x7ff2ac0b6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:59.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.971+0000 7ff2b11ff700 1 --2- 172.21.15.84:0/2944612544 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2ac0b5d90 0x7ff2ac0b6c80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff294009870 tx=0x7ff294009b80 comp rx=0 tx=0).stop 2023-07-14T11:17:59.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.971+0000 7ff2b11ff700 1 -- 172.21.15.84:0/2944612544 shutdown_connections 2023-07-14T11:17:59.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.971+0000 7ff2b11ff700 1 --2- 172.21.15.84:0/2944612544 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2ac0b5d90 0x7ff2ac0b6c80 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:59.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.971+0000 7ff2b11ff700 1 -- 172.21.15.84:0/2944612544 >> 172.21.15.84:0/2944612544 conn(0x7ff2ac09c1d0 msgr2=0x7ff2ac0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:17:59.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.971+0000 7ff2b11ff700 1 -- 172.21.15.84:0/2944612544 shutdown_connections 2023-07-14T11:17:59.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.971+0000 7ff2b11ff700 1 -- 172.21.15.84:0/2944612544 wait complete. 2023-07-14T11:17:59.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.972+0000 7ff2b11ff700 1 Processor -- start 2023-07-14T11:17:59.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.973+0000 7ff2b11ff700 1 -- start start 2023-07-14T11:17:59.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.973+0000 7ff2b11ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2ac0b4510 0x7ff2ac1f1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:59.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.973+0000 7ff2b11ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2ac0b5d90 0x7ff2ac153f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:59.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.974+0000 7ff2b11ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2ac0d0b10 0x7ff2ac1e5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:59.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.974+0000 7ff2b11ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ac1549d0 con 0x7ff2ac0d0b10 2023-07-14T11:17:59.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.974+0000 7ff2b11ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ac154cb0 con 0x7ff2ac0b4510 2023-07-14T11:17:59.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.974+0000 7ff2b11ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ac154f90 con 0x7ff2ac0b5d90 2023-07-14T11:17:59.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.974+0000 7ff2ab59e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2ac0d0b10 0x7ff2ac1e5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:59.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.974+0000 7ff2ab59e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2ac0d0b10 0x7ff2ac1e5fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36484/0 (socket says 172.21.15.84:36484) 2023-07-14T11:17:59.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.974+0000 7ff2ab59e700 1 -- 172.21.15.84:0/1106006748 learned_addr learned my addr 172.21.15.84:0/1106006748 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:17:59.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.974+0000 7ff2a3fff700 1 --2- 172.21.15.84:0/1106006748 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2ac0b5d90 0x7ff2ac153f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:59.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.974+0000 7ff2aad9d700 1 --2- 172.21.15.84:0/1106006748 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2ac0b4510 0x7ff2ac1f1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:59.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.974+0000 7ff2ab59e700 1 -- 172.21.15.84:0/1106006748 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2ac0b5d90 msgr2=0x7ff2ac153f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:59.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.974+0000 7ff2ab59e700 1 --2- 172.21.15.84:0/1106006748 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2ac0b5d90 0x7ff2ac153f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:59.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.974+0000 7ff2ab59e700 1 -- 172.21.15.84:0/1106006748 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2ac0b4510 msgr2=0x7ff2ac1f1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:17:59.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.974+0000 7ff2ab59e700 1 --2- 172.21.15.84:0/1106006748 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2ac0b4510 0x7ff2ac1f1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:17:59.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.974+0000 7ff2ab59e700 1 -- 172.21.15.84:0/1106006748 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2940094a0 con 0x7ff2ac0d0b10 2023-07-14T11:17:59.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.974+0000 7ff2aad9d700 1 --2- 172.21.15.84:0/1106006748 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2ac0b4510 0x7ff2ac1f1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:17:59.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.974+0000 7ff2ab59e700 1 --2- 172.21.15.84:0/1106006748 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2ac0d0b10 0x7ff2ac1e5fa0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7ff2a400cbc0 tx=0x7ff2a400cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:59.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.975+0000 7ff2a37fe700 1 -- 172.21.15.84:0/1106006748 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a400ab50 con 0x7ff2ac0d0b10 2023-07-14T11:17:59.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.975+0000 7ff2a37fe700 1 -- 172.21.15.84:0/1106006748 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2a400acb0 con 0x7ff2ac0d0b10 2023-07-14T11:17:59.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.975+0000 7ff2b11ff700 1 -- 172.21.15.84:0/1106006748 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2ac155270 con 0x7ff2ac0d0b10 2023-07-14T11:17:59.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.975+0000 7ff2a37fe700 1 -- 172.21.15.84:0/1106006748 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a4012600 con 0x7ff2ac0d0b10 2023-07-14T11:17:59.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.975+0000 7ff2b11ff700 1 -- 172.21.15.84:0/1106006748 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2ac1f1e50 con 0x7ff2ac0d0b10 2023-07-14T11:17:59.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.976+0000 7ff2b11ff700 1 -- 172.21.15.84:0/1106006748 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2ac1f2070 con 0x7ff2ac0d0b10 2023-07-14T11:17:59.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.977+0000 7ff2a37fe700 1 -- 172.21.15.84:0/1106006748 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7ff2a401b3b0 con 0x7ff2ac0d0b10 2023-07-14T11:17:59.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.978+0000 7ff2a37fe700 1 --2- 172.21.15.84:0/1106006748 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff28c06b040 0x7ff28c06d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:17:59.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.978+0000 7ff2a37fe700 1 -- 172.21.15.84:0/1106006748 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff2a40897d0 con 0x7ff2ac0d0b10 2023-07-14T11:17:59.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.978+0000 7ff2aad9d700 1 --2- 172.21.15.84:0/1106006748 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff28c06b040 0x7ff28c06d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:17:59.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.978+0000 7ff2aad9d700 1 --2- 172.21.15.84:0/1106006748 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff28c06b040 0x7ff28c06d4f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7ff29c001270 tx=0x7ff29c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:17:59.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:17:59.982+0000 7ff2a37fe700 1 -- 172.21.15.84:0/1106006748 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ff2a40543e0 con 0x7ff2ac0d0b10 2023-07-14T11:18:00.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.180+0000 7ff2b11ff700 1 -- 172.21.15.84:0/1106006748 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff2ac04e280 con 0x7ff2ac0d0b10 2023-07-14T11:18:00.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.182+0000 7ff2a37fe700 1 -- 172.21.15.84:0/1106006748 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+18330 (secure 0 0 0) 0x7ff2a4057a00 con 0x7ff2ac0d0b10 2023-07-14T11:18:00.186 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:18:00.186 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":75,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:17:57.264291+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-07-14T11:17:53.456029+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-07-14T11:17:54.724710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:18:00.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.184+0000 7ff2b11ff700 1 -- 172.21.15.84:0/1106006748 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff28c06b040 msgr2=0x7ff28c06d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:00.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.184+0000 7ff2b11ff700 1 --2- 172.21.15.84:0/1106006748 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff28c06b040 0x7ff28c06d4f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7ff29c001270 tx=0x7ff29c009040 comp rx=0 tx=0).stop 2023-07-14T11:18:00.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.184+0000 7ff2b11ff700 1 -- 172.21.15.84:0/1106006748 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2ac0d0b10 msgr2=0x7ff2ac1e5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:00.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.184+0000 7ff2b11ff700 1 --2- 172.21.15.84:0/1106006748 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2ac0d0b10 0x7ff2ac1e5fa0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7ff2a400cbc0 tx=0x7ff2a400cf80 comp rx=0 tx=0).stop 2023-07-14T11:18:00.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.184+0000 7ff2b11ff700 1 -- 172.21.15.84:0/1106006748 shutdown_connections 2023-07-14T11:18:00.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.184+0000 7ff2b11ff700 1 --2- 172.21.15.84:0/1106006748 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2ac0d0b10 0x7ff2ac1e5fa0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:00.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.184+0000 7ff2b11ff700 1 --2- 172.21.15.84:0/1106006748 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2ac0b4510 0x7ff2ac1f1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:00.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.184+0000 7ff2b11ff700 1 --2- 172.21.15.84:0/1106006748 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff28c06b040 0x7ff28c06d4f0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:00.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.184+0000 7ff2b11ff700 1 --2- 172.21.15.84:0/1106006748 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2ac0b5d90 0x7ff2ac153f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:00.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.184+0000 7ff2b11ff700 1 -- 172.21.15.84:0/1106006748 >> 172.21.15.84:0/1106006748 conn(0x7ff2ac09c1d0 msgr2=0x7ff2ac0cf2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:00.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.184+0000 7ff2b11ff700 1 -- 172.21.15.84:0/1106006748 shutdown_connections 2023-07-14T11:18:00.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.184+0000 7ff2b11ff700 1 -- 172.21.15.84:0/1106006748 wait complete. 2023-07-14T11:18:00.206 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-14T11:18:00.206 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T11:18:00.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.399+0000 7f99a17ff700 1 Processor -- start 2023-07-14T11:18:00.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.399+0000 7f99a17ff700 1 -- start start 2023-07-14T11:18:00.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.400+0000 7f99a17ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f999c15e890 0x7f999c0cee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:00.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.400+0000 7f99a17ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f999c0b3780 0x7f999c0b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:00.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.400+0000 7f99a17ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f999c15a8c0 0x7f999c15ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:00.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.400+0000 7f99a17ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f999c0cf380 con 0x7f999c15a8c0 2023-07-14T11:18:00.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.400+0000 7f99a17ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f999c0b4130 con 0x7f999c0b3780 2023-07-14T11:18:00.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.400+0000 7f99a17ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f999c0ce110 con 0x7f999c15e890 2023-07-14T11:18:00.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.400+0000 7f999b7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f999c15a8c0 0x7f999c15ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:00.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.400+0000 7f999b7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f999c15a8c0 0x7f999c15ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36496/0 (socket says 172.21.15.84:36496) 2023-07-14T11:18:00.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.400+0000 7f999b7fe700 1 -- 172.21.15.84:0/2229081515 learned_addr learned my addr 172.21.15.84:0/2229081515 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:00.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.401+0000 7f9993fff700 1 --2- 172.21.15.84:0/2229081515 >> v2:172.21.15.179:3300/0 conn(0x7f999c0b3780 0x7f999c0b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:00.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.401+0000 7f999affd700 1 --2- 172.21.15.84:0/2229081515 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f999c15e890 0x7f999c0cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:00.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.401+0000 7f999b7fe700 1 -- 172.21.15.84:0/2229081515 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f999c15e890 msgr2=0x7f999c0cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:00.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.401+0000 7f999b7fe700 1 --2- 172.21.15.84:0/2229081515 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f999c15e890 0x7f999c0cee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:00.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.401+0000 7f999b7fe700 1 -- 172.21.15.84:0/2229081515 >> v2:172.21.15.179:3300/0 conn(0x7f999c0b3780 msgr2=0x7f999c0b3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:00.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.401+0000 7f999b7fe700 1 --2- 172.21.15.84:0/2229081515 >> v2:172.21.15.179:3300/0 conn(0x7f999c0b3780 0x7f999c0b3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:00.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.401+0000 7f999b7fe700 1 -- 172.21.15.84:0/2229081515 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f999c15b660 con 0x7f999c15a8c0 2023-07-14T11:18:00.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.401+0000 7f999b7fe700 1 --2- 172.21.15.84:0/2229081515 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f999c15a8c0 0x7f999c15ad40 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f999c071cb0 tx=0x7f999400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dade08dd62bb5985 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:00.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.401+0000 7f999a7fc700 1 -- 172.21.15.84:0/2229081515 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f999400e070 con 0x7f999c15a8c0 2023-07-14T11:18:00.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.401+0000 7f999a7fc700 1 -- 172.21.15.84:0/2229081515 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f999400b980 con 0x7f999c15a8c0 2023-07-14T11:18:00.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.401+0000 7f999a7fc700 1 -- 172.21.15.84:0/2229081515 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f999400bd30 con 0x7f999c15a8c0 2023-07-14T11:18:00.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.402+0000 7f99a17ff700 1 -- 172.21.15.84:0/2229081515 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f999c15a8c0 msgr2=0x7f999c15ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:00.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.402+0000 7f99a17ff700 1 --2- 172.21.15.84:0/2229081515 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f999c15a8c0 0x7f999c15ad40 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f999c071cb0 tx=0x7f999400b330 comp rx=0 tx=0).stop 2023-07-14T11:18:00.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.402+0000 7f99a17ff700 1 -- 172.21.15.84:0/2229081515 shutdown_connections 2023-07-14T11:18:00.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.402+0000 7f99a17ff700 1 --2- 172.21.15.84:0/2229081515 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f999c15e890 0x7f999c0cee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:00.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.402+0000 7f99a17ff700 1 --2- 172.21.15.84:0/2229081515 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f999c15a8c0 0x7f999c15ad40 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:00.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.402+0000 7f99a17ff700 1 --2- 172.21.15.84:0/2229081515 >> v2:172.21.15.179:3300/0 conn(0x7f999c0b3780 0x7f999c0b3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:00.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.402+0000 7f99a17ff700 1 -- 172.21.15.84:0/2229081515 >> 172.21.15.84:0/2229081515 conn(0x7f999c069f30 msgr2=0x7f999c06a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:00.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.402+0000 7f99a17ff700 1 -- 172.21.15.84:0/2229081515 shutdown_connections 2023-07-14T11:18:00.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.402+0000 7f99a17ff700 1 -- 172.21.15.84:0/2229081515 wait complete. 2023-07-14T11:18:00.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.404+0000 7f99a17ff700 1 Processor -- start 2023-07-14T11:18:00.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.404+0000 7f99a17ff700 1 -- start start 2023-07-14T11:18:00.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.406+0000 7f99a17ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f999c0b3780 0x7f999c0c8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:00.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.406+0000 7f99a17ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f999c15a8c0 0x7f999c14dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:00.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.406+0000 7f99a17ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f999c15e890 0x7f999c14e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:00.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.406+0000 7f99a17ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f999c070b40 con 0x7f999c15a8c0 2023-07-14T11:18:00.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.406+0000 7f99a17ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f999c070de0 con 0x7f999c0b3780 2023-07-14T11:18:00.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.406+0000 7f99a17ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f999c0710c0 con 0x7f999c15e890 2023-07-14T11:18:00.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.406+0000 7f9993fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f999c15a8c0 0x7f999c14dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:00.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.406+0000 7f9993fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f999c15a8c0 0x7f999c14dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36512/0 (socket says 172.21.15.84:36512) 2023-07-14T11:18:00.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.406+0000 7f9993fff700 1 -- 172.21.15.84:0/1636582868 learned_addr learned my addr 172.21.15.84:0/1636582868 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:00.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.406+0000 7f999affd700 1 --2- 172.21.15.84:0/1636582868 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f999c0b3780 0x7f999c0c8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:00.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.406+0000 7f999b7fe700 1 --2- 172.21.15.84:0/1636582868 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f999c15e890 0x7f999c14e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:00.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.406+0000 7f9993fff700 1 -- 172.21.15.84:0/1636582868 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f999c15e890 msgr2=0x7f999c14e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:00.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.406+0000 7f9993fff700 1 --2- 172.21.15.84:0/1636582868 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f999c15e890 0x7f999c14e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:00.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.406+0000 7f9993fff700 1 -- 172.21.15.84:0/1636582868 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f999c0b3780 msgr2=0x7f999c0c8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:00.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.406+0000 7f9993fff700 1 --2- 172.21.15.84:0/1636582868 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f999c0b3780 0x7f999c0c8850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:00.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.406+0000 7f9993fff700 1 -- 172.21.15.84:0/1636582868 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9994009b30 con 0x7f999c15a8c0 2023-07-14T11:18:00.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.407+0000 7f9993fff700 1 --2- 172.21.15.84:0/1636582868 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f999c15a8c0 0x7f999c14dee0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f998400d800 tx=0x7f998400db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:00.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.407+0000 7f99937fe700 1 -- 172.21.15.84:0/1636582868 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99840125f0 con 0x7f999c15a8c0 2023-07-14T11:18:00.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.407+0000 7f99937fe700 1 -- 172.21.15.84:0/1636582868 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9984012750 con 0x7f999c15a8c0 2023-07-14T11:18:00.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.407+0000 7f99a17ff700 1 -- 172.21.15.84:0/1636582868 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f999c0713a0 con 0x7f999c15a8c0 2023-07-14T11:18:00.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.407+0000 7f99937fe700 1 -- 172.21.15.84:0/1636582868 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9984012b00 con 0x7f999c15a8c0 2023-07-14T11:18:00.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.407+0000 7f99a17ff700 1 -- 172.21.15.84:0/1636582868 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f999c0c8d90 con 0x7f999c15a8c0 2023-07-14T11:18:00.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.408+0000 7f99a17ff700 1 -- 172.21.15.84:0/1636582868 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f999c04e280 con 0x7f999c15a8c0 2023-07-14T11:18:00.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.409+0000 7f99937fe700 1 -- 172.21.15.84:0/1636582868 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7f9984012c60 con 0x7f999c15a8c0 2023-07-14T11:18:00.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.410+0000 7f99937fe700 1 --2- 172.21.15.84:0/1636582868 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f997c06b040 0x7f997c06d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:00.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.410+0000 7f99937fe700 1 -- 172.21.15.84:0/1636582868 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f99840899d0 con 0x7f999c15a8c0 2023-07-14T11:18:00.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.410+0000 7f999affd700 1 --2- 172.21.15.84:0/1636582868 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f997c06b040 0x7f997c06d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:00.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.411+0000 7f999affd700 1 --2- 172.21.15.84:0/1636582868 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f997c06b040 0x7f997c06d4f0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f999c15d800 tx=0x7f998c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:00.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.414+0000 7f99937fe700 1 -- 172.21.15.84:0/1636582868 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f9984054720 con 0x7f999c15a8c0 2023-07-14T11:18:00.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.601+0000 7f99a17ff700 1 -- 172.21.15.84:0/1636582868 --> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f999c0ce640 con 0x7f997c06b040 2023-07-14T11:18:00.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.610+0000 7f99937fe700 1 -- 172.21.15.84:0/1636582868 <== mgr.4104 v2:172.21.15.84:6832/379617029 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299215 (secure 0 0 0) 0x7f998c009dc0 con 0x7f997c06b040 2023-07-14T11:18:00.617 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:18:00.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.615+0000 7f99a17ff700 1 -- 172.21.15.84:0/1636582868 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f997c06b040 msgr2=0x7f997c06d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:00.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.615+0000 7f99a17ff700 1 --2- 172.21.15.84:0/1636582868 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f997c06b040 0x7f997c06d4f0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f999c15d800 tx=0x7f998c008040 comp rx=0 tx=0).stop 2023-07-14T11:18:00.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.615+0000 7f99a17ff700 1 -- 172.21.15.84:0/1636582868 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f999c15a8c0 msgr2=0x7f999c14dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:00.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.615+0000 7f99a17ff700 1 --2- 172.21.15.84:0/1636582868 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f999c15a8c0 0x7f999c14dee0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f998400d800 tx=0x7f998400db10 comp rx=0 tx=0).stop 2023-07-14T11:18:00.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.615+0000 7f99a17ff700 1 -- 172.21.15.84:0/1636582868 shutdown_connections 2023-07-14T11:18:00.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.615+0000 7f99a17ff700 1 --2- 172.21.15.84:0/1636582868 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f997c06b040 0x7f997c06d4f0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:00.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.615+0000 7f99a17ff700 1 --2- 172.21.15.84:0/1636582868 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f999c15e890 0x7f999c14e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:00.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.615+0000 7f99a17ff700 1 --2- 172.21.15.84:0/1636582868 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f999c0b3780 0x7f999c0c8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:00.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.615+0000 7f99a17ff700 1 --2- 172.21.15.84:0/1636582868 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f999c15a8c0 0x7f999c14dee0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:00.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.615+0000 7f99a17ff700 1 -- 172.21.15.84:0/1636582868 >> 172.21.15.84:0/1636582868 conn(0x7f999c069f30 msgr2=0x7f999c15ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:00.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.615+0000 7f99a17ff700 1 -- 172.21.15.84:0/1636582868 shutdown_connections 2023-07-14T11:18:00.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.615+0000 7f99a17ff700 1 -- 172.21.15.84:0/1636582868 wait complete. 2023-07-14T11:18:00.621 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-07-14T11:18:00.636 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":218,"stamp":"2023-07-14T11:18:00.133284+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":22,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223612,"kb_used_data":7996,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754751108,"statfs":{"total":773094113280,"available":772865134592,"internally_reserved":0,"allocated":8187904,"data_stored":4276094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.886330"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.250154+0000","last_change":"2023-07-14T11:17:54.250154+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.250154+0000","last_undegraded":"2023-07-14T11:17:54.250154+0000","last_fullsized":"2023-07-14T11:17:54.250154+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.252866+0000","last_change":"2023-07-14T11:17:54.252866+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.252866+0000","last_undegraded":"2023-07-14T11:17:54.252866+0000","last_fullsized":"2023-07-14T11:17:54.252866+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.253607+0000","last_change":"2023-07-14T11:17:54.253607+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.253607+0000","last_undegraded":"2023-07-14T11:17:54.253607+0000","last_fullsized":"2023-07-14T11:17:54.253607+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.256459+0000","last_change":"2023-07-14T11:17:54.256459+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.256459+0000","last_undegraded":"2023-07-14T11:17:54.256459+0000","last_fullsized":"2023-07-14T11:17:54.256459+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.252207+0000","last_change":"2023-07-14T11:17:54.252207+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.252207+0000","last_undegraded":"2023-07-14T11:17:54.252207+0000","last_fullsized":"2023-07-14T11:17:54.252207+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.250078+0000","last_change":"2023-07-14T11:17:54.250078+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.250078+0000","last_undegraded":"2023-07-14T11:17:54.250078+0000","last_fullsized":"2023-07-14T11:17:54.250078+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.264598+0000","last_change":"2023-07-14T11:17:54.264598+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.264598+0000","last_undegraded":"2023-07-14T11:17:54.264598+0000","last_fullsized":"2023-07-14T11:17:54.264598+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.249433+0000","last_change":"2023-07-14T11:17:54.249433+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.249433+0000","last_undegraded":"2023-07-14T11:17:54.249433+0000","last_fullsized":"2023-07-14T11:17:54.249433+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.253430+0000","last_change":"2023-07-14T11:17:54.253430+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.253430+0000","last_undegraded":"2023-07-14T11:17:54.253430+0000","last_fullsized":"2023-07-14T11:17:54.253430+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.250081+0000","last_change":"2023-07-14T11:17:54.250081+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.250081+0000","last_undegraded":"2023-07-14T11:17:54.250081+0000","last_fullsized":"2023-07-14T11:17:54.250081+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.250054+0000","last_change":"2023-07-14T11:17:54.250054+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.250054+0000","last_undegraded":"2023-07-14T11:17:54.250054+0000","last_fullsized":"2023-07-14T11:17:54.250054+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.255976+0000","last_change":"2023-07-14T11:17:54.255976+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.255976+0000","last_undegraded":"2023-07-14T11:17:54.255976+0000","last_fullsized":"2023-07-14T11:17:54.255976+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.250228+0000","last_change":"2023-07-14T11:17:54.250228+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.250228+0000","last_undegraded":"2023-07-14T11:17:54.250228+0000","last_fullsized":"2023-07-14T11:17:54.250228+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.252759+0000","last_change":"2023-07-14T11:17:54.252759+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.252759+0000","last_undegraded":"2023-07-14T11:17:54.252759+0000","last_fullsized":"2023-07-14T11:17:54.252759+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.249801+0000","last_change":"2023-07-14T11:17:54.249801+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.249801+0000","last_undegraded":"2023-07-14T11:17:54.249801+0000","last_fullsized":"2023-07-14T11:17:54.249801+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.264525+0000","last_change":"2023-07-14T11:17:54.264525+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.264525+0000","last_undegraded":"2023-07-14T11:17:54.264525+0000","last_fullsized":"2023-07-14T11:17:54.264525+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.250078+0000","last_change":"2023-07-14T11:17:54.250078+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.250078+0000","last_undegraded":"2023-07-14T11:17:54.250078+0000","last_fullsized":"2023-07-14T11:17:54.250078+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.264599+0000","last_change":"2023-07-14T11:17:54.264599+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.264599+0000","last_undegraded":"2023-07-14T11:17:54.264599+0000","last_fullsized":"2023-07-14T11:17:54.264599+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.252804+0000","last_change":"2023-07-14T11:17:54.252804+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.252804+0000","last_undegraded":"2023-07-14T11:17:54.252804+0000","last_fullsized":"2023-07-14T11:17:54.252804+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.253203+0000","last_change":"2023-07-14T11:17:54.253203+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.253203+0000","last_undegraded":"2023-07-14T11:17:54.253203+0000","last_fullsized":"2023-07-14T11:17:54.253203+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.255870+0000","last_change":"2023-07-14T11:17:54.255870+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.255870+0000","last_undegraded":"2023-07-14T11:17:54.255870+0000","last_fullsized":"2023-07-14T11:17:54.255870+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.249476+0000","last_change":"2023-07-14T11:17:54.249476+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.249476+0000","last_undegraded":"2023-07-14T11:17:54.249476+0000","last_fullsized":"2023-07-14T11:17:54.249476+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.255894+0000","last_change":"2023-07-14T11:17:54.255894+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.255894+0000","last_undegraded":"2023-07-14T11:17:54.255894+0000","last_fullsized":"2023-07-14T11:17:54.255894+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.249601+0000","last_change":"2023-07-14T11:17:54.249601+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.249601+0000","last_undegraded":"2023-07-14T11:17:54.249601+0000","last_fullsized":"2023-07-14T11:17:54.249601+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.249509+0000","last_change":"2023-07-14T11:17:54.249509+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.249509+0000","last_undegraded":"2023-07-14T11:17:54.249509+0000","last_fullsized":"2023-07-14T11:17:54.249509+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":119,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-07-14T11:17:54.249115+0000","last_change":"2023-07-14T11:13:08.923786+0000","last_active":"2023-07-14T11:17:54.249115+0000","last_peered":"2023-07-14T11:17:54.249115+0000","last_clean":"2023-07-14T11:17:54.249115+0000","last_became_active":"2023-07-14T11:13:08.923384+0000","last_became_peered":"2023-07-14T11:13:08.923384+0000","last_unstale":"2023-07-14T11:17:54.249115+0000","last_undegraded":"2023-07-14T11:17:54.249115+0000","last_fullsized":"2023-07-14T11:17:54.249115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:27:18.695333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.252585+0000","last_change":"2023-07-14T11:17:54.252585+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.252585+0000","last_undegraded":"2023-07-14T11:17:54.252585+0000","last_fullsized":"2023-07-14T11:17:54.252585+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":109,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-07-14T11:17:54.250790+0000","last_change":"2023-07-14T11:13:08.758749+0000","last_active":"2023-07-14T11:17:54.250790+0000","last_peered":"2023-07-14T11:17:54.250790+0000","last_clean":"2023-07-14T11:17:54.250790+0000","last_became_active":"2023-07-14T11:13:08.757956+0000","last_became_peered":"2023-07-14T11:13:08.757956+0000","last_unstale":"2023-07-14T11:17:54.250790+0000","last_undegraded":"2023-07-14T11:17:54.250790+0000","last_fullsized":"2023-07-14T11:17:54.250790+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:55:59.907702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.252247+0000","last_change":"2023-07-14T11:17:54.252247+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.252247+0000","last_undegraded":"2023-07-14T11:17:54.252247+0000","last_fullsized":"2023-07-14T11:17:54.252247+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":115,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-07-14T11:17:54.250025+0000","last_change":"2023-07-14T11:13:08.862331+0000","last_active":"2023-07-14T11:17:54.250025+0000","last_peered":"2023-07-14T11:17:54.250025+0000","last_clean":"2023-07-14T11:17:54.250025+0000","last_became_active":"2023-07-14T11:13:08.861817+0000","last_became_peered":"2023-07-14T11:13:08.861817+0000","last_unstale":"2023-07-14T11:17:54.250025+0000","last_undegraded":"2023-07-14T11:17:54.250025+0000","last_fullsized":"2023-07-14T11:17:54.250025+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:43:14.721900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.252294+0000","last_change":"2023-07-14T11:17:54.252294+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.252294+0000","last_undegraded":"2023-07-14T11:17:54.252294+0000","last_fullsized":"2023-07-14T11:17:54.252294+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":109,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-07-14T11:17:54.250781+0000","last_change":"2023-07-14T11:13:08.757882+0000","last_active":"2023-07-14T11:17:54.250781+0000","last_peered":"2023-07-14T11:17:54.250781+0000","last_clean":"2023-07-14T11:17:54.250781+0000","last_became_active":"2023-07-14T11:13:08.757541+0000","last_became_peered":"2023-07-14T11:13:08.757541+0000","last_unstale":"2023-07-14T11:17:54.250781+0000","last_undegraded":"2023-07-14T11:17:54.250781+0000","last_fullsized":"2023-07-14T11:17:54.250781+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:56:08.609824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":257,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-07-14T11:17:54.254685+0000","last_change":"2023-07-14T11:13:01.370649+0000","last_active":"2023-07-14T11:17:54.254685+0000","last_peered":"2023-07-14T11:17:54.254685+0000","last_clean":"2023-07-14T11:17:54.254685+0000","last_became_active":"2023-07-14T11:13:01.369478+0000","last_became_peered":"2023-07-14T11:13:01.369478+0000","last_unstale":"2023-07-14T11:17:54.254685+0000","last_undegraded":"2023-07-14T11:17:54.254685+0000","last_fullsized":"2023-07-14T11:17:54.254685+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:00.254800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:00.254800+0000","last_clean_scrub_stamp":"2023-07-14T11:13:00.254800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:45:28.466990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.252300+0000","last_change":"2023-07-14T11:17:54.252300+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.252300+0000","last_undegraded":"2023-07-14T11:17:54.252300+0000","last_fullsized":"2023-07-14T11:17:54.252300+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":101,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-07-14T11:17:54.254522+0000","last_change":"2023-07-14T11:13:08.760609+0000","last_active":"2023-07-14T11:17:54.254522+0000","last_peered":"2023-07-14T11:17:54.254522+0000","last_clean":"2023-07-14T11:17:54.254522+0000","last_became_active":"2023-07-14T11:13:08.760285+0000","last_became_peered":"2023-07-14T11:13:08.760285+0000","last_unstale":"2023-07-14T11:17:54.254522+0000","last_undegraded":"2023-07-14T11:17:54.254522+0000","last_fullsized":"2023-07-14T11:17:54.254522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:02:04.589208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.249980+0000","last_change":"2023-07-14T11:17:54.249980+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.249980+0000","last_undegraded":"2023-07-14T11:17:54.249980+0000","last_fullsized":"2023-07-14T11:17:54.249980+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":101,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-07-14T11:17:54.255064+0000","last_change":"2023-07-14T11:13:08.923899+0000","last_active":"2023-07-14T11:17:54.255064+0000","last_peered":"2023-07-14T11:17:54.255064+0000","last_clean":"2023-07-14T11:17:54.255064+0000","last_became_active":"2023-07-14T11:13:08.923513+0000","last_became_peered":"2023-07-14T11:13:08.923513+0000","last_unstale":"2023-07-14T11:17:54.255064+0000","last_undegraded":"2023-07-14T11:17:54.255064+0000","last_fullsized":"2023-07-14T11:17:54.255064+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:54:10.440722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.253922+0000","last_change":"2023-07-14T11:17:54.253922+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.253922+0000","last_undegraded":"2023-07-14T11:17:54.253922+0000","last_fullsized":"2023-07-14T11:17:54.253922+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":119,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-07-14T11:17:54.249255+0000","last_change":"2023-07-14T11:13:08.761726+0000","last_active":"2023-07-14T11:17:54.249255+0000","last_peered":"2023-07-14T11:17:54.249255+0000","last_clean":"2023-07-14T11:17:54.249255+0000","last_became_active":"2023-07-14T11:13:08.761365+0000","last_became_peered":"2023-07-14T11:13:08.761365+0000","last_unstale":"2023-07-14T11:17:54.249255+0000","last_undegraded":"2023-07-14T11:17:54.249255+0000","last_fullsized":"2023-07-14T11:17:54.249255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:53:21.512364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.252236+0000","last_change":"2023-07-14T11:17:54.252236+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.252236+0000","last_undegraded":"2023-07-14T11:17:54.252236+0000","last_fullsized":"2023-07-14T11:17:54.252236+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":107,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-07-14T11:17:54.256951+0000","last_change":"2023-07-14T11:13:08.762084+0000","last_active":"2023-07-14T11:17:54.256951+0000","last_peered":"2023-07-14T11:17:54.256951+0000","last_clean":"2023-07-14T11:17:54.256951+0000","last_became_active":"2023-07-14T11:13:08.761763+0000","last_became_peered":"2023-07-14T11:13:08.761763+0000","last_unstale":"2023-07-14T11:17:54.256951+0000","last_undegraded":"2023-07-14T11:17:54.256951+0000","last_fullsized":"2023-07-14T11:17:54.256951+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:50:50.833707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574911,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28388,"kb_used_data":1436,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343452,"statfs":{"total":96636764160,"available":96607694848,"internally_reserved":0,"allocated":1470464,"data_stored":978059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.80400000000000005,"15min":0.94199999999999995},"min":{"1min":0.441,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.93300000000000005,"5min":8.4339999999999993,"15min":8.4339999999999993},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.84599999999999997,"15min":0.97999999999999998},"min":{"1min":0.55100000000000005,"5min":0.377,"15min":0.377},"max":{"1min":0.88800000000000001,"5min":8.4559999999999995,"15min":8.4559999999999995},"last":0.59899999999999998}]},{"osd":1,"last update":"Fri Jul 14 11:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.79700000000000004,"15min":0.91300000000000003},"min":{"1min":0.54000000000000004,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.86699999999999999,"5min":6.3520000000000003,"15min":6.3520000000000003},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.88100000000000001,"15min":1.083},"min":{"1min":0.49299999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.877,"5min":6.8550000000000004,"15min":6.8550000000000004},"last":0.53700000000000003}]},{"osd":2,"last update":"Fri Jul 14 11:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.91200000000000003,"15min":1.137},"min":{"1min":0.51000000000000001,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.91400000000000003,"5min":7.0289999999999999,"15min":7.0289999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.70599999999999996,"15min":0.69399999999999995},"min":{"1min":0.48599999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.94499999999999995,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.76900000000000002}]},{"osd":3,"last update":"Fri Jul 14 11:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.95699999999999996,"15min":1.198},"min":{"1min":0.51800000000000002,"5min":0.505,"15min":0.505},"max":{"1min":0.95699999999999996,"5min":10.337,"15min":10.337},"last":0.627},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.753,"15min":0.76700000000000002},"min":{"1min":0.60799999999999998,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.97899999999999998,"5min":1.921,"15min":1.921},"last":0.82199999999999995}]},{"osd":4,"last update":"Fri Jul 14 11:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.62,"15min":0.58999999999999997},"min":{"1min":0.44500000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.89900000000000002,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.72499999999999998,"15min":0.70199999999999996},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.88200000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.67000000000000004}]},{"osd":5,"last update":"Fri Jul 14 11:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.68899999999999995,"15min":0.67500000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.89400000000000002,"5min":1.04,"15min":1.04},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.746,"5min":0.754,"15min":0.73699999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.92100000000000004,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.79500000000000004}]},{"osd":6,"last update":"Fri Jul 14 11:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.70899999999999996,"15min":0.67700000000000005},"min":{"1min":0.499,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.94199999999999995,"5min":1.002,"15min":1.002},"last":0.753},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.71699999999999997,"15min":0.68899999999999995},"min":{"1min":0.50900000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.90200000000000002,"5min":1.018,"15min":1.018},"last":0.72699999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574912,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":876544,"data_stored":387691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.71499999999999997,"15min":0.70799999999999996},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.93799999999999994,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.73499999999999999,"15min":0.72099999999999997},"min":{"1min":0.45300000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.93100000000000005,"5min":1.167,"15min":1.167},"last":0.86699999999999999}]},{"osd":1,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.71099999999999997,"15min":0.68899999999999995},"min":{"1min":0.53100000000000003,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.97699999999999998,"5min":1.006,"15min":1.006},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.73599999999999999,"15min":0.71599999999999997},"min":{"1min":0.50900000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.0109999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.91500000000000004}]},{"osd":2,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.69399999999999995,"15min":0.67700000000000005},"min":{"1min":0.51300000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.95199999999999996,"5min":1.45,"15min":1.45},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76900000000000002,"15min":0.78100000000000003},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.94799999999999995,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.93600000000000005}]},{"osd":3,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.752,"15min":0.75},"min":{"1min":0.56499999999999995,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.002,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.747,"15min":0.74299999999999999},"min":{"1min":0.60099999999999998,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.91600000000000004,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.81599999999999995}]},{"osd":4,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.68799999999999994,"15min":0.70599999999999996},"min":{"1min":0.44400000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.94699999999999995,"5min":1.712,"15min":1.712},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.71399999999999997,"15min":0.72399999999999998},"min":{"1min":0.47299999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.871,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.58699999999999997}]},{"osd":5,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.71299999999999997,"15min":0.71799999999999997},"min":{"1min":0.51500000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.89800000000000002,"5min":2.8820000000000001,"15min":2.8820000000000001},"last":0.627},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76900000000000002,"15min":0.78700000000000003},"min":{"1min":0.496,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.98399999999999999,"5min":1.129,"15min":1.129},"last":0.72399999999999998}]},{"osd":7,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.78000000000000003,"15min":0.80100000000000005},"min":{"1min":0.47399999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0569999999999999,"5min":1.333,"15min":1.333},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.76800000000000002,"15min":0.79000000000000004},"min":{"1min":0.54100000000000004,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.92700000000000005,"5min":1.55,"15min":1.55},"last":0.88300000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574911,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":876544,"data_stored":387691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:17:04 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.42299999999999999,"15min":0.438},"min":{"1min":0.28899999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.54300000000000004,"5min":0.996,"15min":0.996},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.47699999999999998,"15min":0.48299999999999998},"min":{"1min":0.34499999999999997,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.63100000000000001,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.38300000000000001}]},{"osd":2,"last update":"Fri Jul 14 11:17:04 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.52800000000000002,"15min":0.56499999999999995},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.70799999999999996,"5min":2.476,"15min":2.476},"last":0.442},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.55800000000000005,"15min":0.61799999999999999},"min":{"1min":0.39800000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.68300000000000005,"5min":2.6299999999999999,"15min":2.6299999999999999},"last":0.53400000000000003}]},{"osd":3,"last update":"Fri Jul 14 11:17:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.53200000000000003,"15min":0.52300000000000002},"min":{"1min":0.40200000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.66300000000000003,"5min":0.748,"15min":0.748},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48199999999999998,"15min":0.49399999999999999},"min":{"1min":0.41699999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.60299999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.40300000000000002}]},{"osd":4,"last update":"Fri Jul 14 11:17:04 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.75,"15min":0.753},"min":{"1min":0.61199999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0309999999999999,"5min":1.363,"15min":1.363},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.76800000000000002,"15min":0.77400000000000002},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.1160000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.55400000000000005}]},{"osd":5,"last update":"Fri Jul 14 11:17:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.76700000000000002,"15min":0.77100000000000002},"min":{"1min":0.60199999999999998,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.2250000000000001,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.499},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.79300000000000004,"15min":0.81799999999999995},"min":{"1min":0.58199999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":0.98299999999999998,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.63100000000000001}]},{"osd":6,"last update":"Fri Jul 14 11:17:04 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.76800000000000002,"15min":0.79600000000000004},"min":{"1min":0.56200000000000006,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.97599999999999998,"5min":1.298,"15min":1.298},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77700000000000002,"15min":0.78700000000000003},"min":{"1min":0.54800000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1899999999999999,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.65000000000000002}]},{"osd":7,"last update":"Fri Jul 14 11:17:04 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.78600000000000003,"15min":0.81599999999999995},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.097,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.77400000000000002,"15min":0.78700000000000003},"min":{"1min":0.624,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.0800000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.57099999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574909,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28388,"kb_used_data":1436,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343452,"statfs":{"total":96636764160,"available":96607694848,"internally_reserved":0,"allocated":1470464,"data_stored":978059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.44,"15min":0.435},"min":{"1min":0.33900000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.59999999999999998,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.44400000000000001,"15min":0.441},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.64100000000000001,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.34999999999999998}]},{"osd":2,"last update":"Fri Jul 14 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.375,"5min":0.307,"15min":0.307},"max":{"1min":0.58599999999999997,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.497,"15min":0.502},"min":{"1min":0.36299999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.66600000000000004,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.51300000000000001}]},{"osd":3,"last update":"Fri Jul 14 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.44900000000000001,"15min":0.42699999999999999},"min":{"1min":0.36099999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.64300000000000002,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.52700000000000002,"15min":0.52500000000000002},"min":{"1min":0.42299999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.64400000000000002,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.53100000000000003}]},{"osd":4,"last update":"Fri Jul 14 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.76300000000000001,"15min":0.76600000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.044,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":1.0289999999999999},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.72999999999999998,"15min":0.70699999999999996},"min":{"1min":0.53200000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.92600000000000005}]},{"osd":5,"last update":"Fri Jul 14 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.74399999999999999,"15min":0.72899999999999998},"min":{"1min":0.57799999999999996,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77400000000000002,"15min":0.77900000000000003},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.99299999999999999}]},{"osd":6,"last update":"Fri Jul 14 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.73499999999999999,"15min":0.72499999999999998},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.01,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.77600000000000002,"15min":0.78000000000000003},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.022,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.85999999999999999}]},{"osd":7,"last update":"Fri Jul 14 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.80800000000000005,"15min":0.81999999999999995},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.0900000000000001,"5min":1.149,"15min":1.149},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.80300000000000005,"15min":0.78300000000000003},"min":{"1min":0.58999999999999997,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.0600000000000001,"5min":1.081,"15min":1.081},"last":1.014}]}]},{"osd":2,"up_from":13,"seq":55834574909,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":876544,"data_stored":387691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.42799999999999999,"15min":0.44700000000000001},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.63900000000000001,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.436,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.52500000000000002}]},{"osd":1,"last update":"Fri Jul 14 11:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.47999999999999998,"15min":0.48599999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.68400000000000005,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.499,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.39500000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.61399999999999999,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.40400000000000003}]},{"osd":3,"last update":"Fri Jul 14 11:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.501,"15min":0.497},"min":{"1min":0.35699999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.376},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57799999999999996,"15min":0.58699999999999997},"min":{"1min":0.42099999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.72599999999999998,"5min":1.034,"15min":1.034},"last":0.45800000000000002}]},{"osd":4,"last update":"Fri Jul 14 11:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.76200000000000001,"15min":0.77200000000000002},"min":{"1min":0.55800000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.92700000000000005,"5min":1.212,"15min":1.212},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.77700000000000002,"15min":0.78800000000000003},"min":{"1min":0.64100000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.1000000000000001,"5min":1.198,"15min":1.198},"last":0.82199999999999995}]},{"osd":5,"last update":"Fri Jul 14 11:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.76900000000000002,"15min":0.79000000000000004},"min":{"1min":0.59499999999999997,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.98899999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.80000000000000004,"15min":0.82399999999999995},"min":{"1min":0.55000000000000004,"5min":0.495,"15min":0.495},"max":{"1min":1.0609999999999999,"5min":1.351,"15min":1.351},"last":0.89200000000000002}]},{"osd":6,"last update":"Fri Jul 14 11:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.78100000000000003,"15min":0.79000000000000004},"min":{"1min":0.60899999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.1180000000000001,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.79900000000000004,"15min":0.82299999999999995},"min":{"1min":0.59499999999999997,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0129999999999999,"5min":1.282,"15min":1.282},"last":0.79500000000000004}]},{"osd":7,"last update":"Fri Jul 14 11:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.79300000000000004,"15min":0.80400000000000005},"min":{"1min":0.628,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.0389999999999999,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.78600000000000003,"15min":0.80700000000000005},"min":{"1min":0.63,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.95299999999999996,"5min":1.244,"15min":1.244},"last":0.84099999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574909,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":864256,"data_stored":381521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.42899999999999999,"15min":0.44800000000000001},"min":{"1min":0.34399999999999997,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.67800000000000005,"5min":0.754,"15min":0.754},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.502,"5min":0.45500000000000002,"15min":0.45100000000000001},"min":{"1min":0.317,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.57499999999999996}]},{"osd":1,"last update":"Fri Jul 14 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.45100000000000001,"15min":0.45300000000000001},"min":{"1min":0.34000000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.49299999999999999,"15min":0.498},"min":{"1min":0.44500000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.72699999999999998,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.41299999999999998}]},{"osd":2,"last update":"Fri Jul 14 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.55200000000000005,"15min":0.54600000000000004},"min":{"1min":0.42899999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.438},{"interface":"front","average":{"1min":0.627,"5min":0.58799999999999997,"15min":0.59799999999999998},"min":{"1min":0.46500000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.79600000000000004,"5min":1.585,"15min":1.585},"last":0.52800000000000002}]},{"osd":4,"last update":"Fri Jul 14 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.75900000000000001,"15min":0.76300000000000001},"min":{"1min":0.53200000000000003,"5min":0.372,"15min":0.372},"max":{"1min":1.0029999999999999,"5min":1.216,"15min":1.216},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.77700000000000002,"15min":0.76000000000000001},"min":{"1min":0.61899999999999999,"5min":0.504,"15min":0.504},"max":{"1min":1.0609999999999999,"5min":1.147,"15min":1.147},"last":0.67500000000000004}]},{"osd":5,"last update":"Fri Jul 14 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.76700000000000002,"15min":0.76400000000000001},"min":{"1min":0.65400000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.024,"5min":1.413,"15min":1.413},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.81799999999999995,"15min":0.85199999999999998},"min":{"1min":0.621,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.097,"5min":1.657,"15min":1.657},"last":0.65600000000000003}]},{"osd":6,"last update":"Fri Jul 14 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.66300000000000003,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.133,"5min":1.726,"15min":1.726},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.78900000000000003,"15min":0.80100000000000005},"min":{"1min":0.61099999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.085,"5min":1.333,"15min":1.333},"last":0.83799999999999997}]},{"osd":7,"last update":"Fri Jul 14 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.81899999999999995,"15min":0.83799999999999997},"min":{"1min":0.623,"5min":0.437,"15min":0.437},"max":{"1min":1.1459999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.83299999999999996,"15min":0.84199999999999997},"min":{"1min":0.59599999999999997,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1579999999999999,"5min":1.268,"15min":1.268},"last":0.80000000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574909,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":876544,"data_stored":387691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.64400000000000002,"15min":0.63400000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.85199999999999998,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.67500000000000004,"15min":0.69099999999999995},"min":{"1min":0.42699999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.83199999999999996,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.64600000000000002}]},{"osd":1,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.66100000000000003,"15min":0.66900000000000004},"min":{"1min":0.46100000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.82899999999999996,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.71599999999999997,"15min":0.71399999999999997},"min":{"1min":0.49299999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.93700000000000006,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.61399999999999999}]},{"osd":2,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.71799999999999997,"15min":0.71299999999999997},"min":{"1min":0.51000000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.85299999999999998,"5min":1.48,"15min":1.48},"last":0.5},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.73899999999999999,"15min":0.74199999999999999},"min":{"1min":0.57499999999999996,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.84499999999999997,"5min":1.23,"15min":1.23},"last":0.83099999999999996}]},{"osd":3,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.69899999999999995,"15min":0.71499999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.81299999999999994,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.748,"15min":0.74199999999999999},"min":{"1min":0.55200000000000005,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.88100000000000001,"5min":1.145,"15min":1.145},"last":0.55200000000000005}]},{"osd":5,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.71799999999999997,"15min":0.76000000000000001},"min":{"1min":0.45300000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.90000000000000002,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.71699999999999997,"15min":0.76500000000000001},"min":{"1min":0.48999999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.81499999999999995,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.81899999999999995}]},{"osd":6,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71499999999999997,"15min":0.72299999999999998},"min":{"1min":0.45600000000000002,"5min":0.436,"15min":0.436},"max":{"1min":0.86399999999999999,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76600000000000001,"15min":0.77600000000000002},"min":{"1min":0.56999999999999995,"5min":0.442,"15min":0.442},"max":{"1min":0.96099999999999997,"5min":1.3,"15min":1.3},"last":0.88900000000000001}]},{"osd":7,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.746,"15min":0.76900000000000002},"min":{"1min":0.53500000000000003,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.86499999999999999,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.81000000000000005,"15min":0.84399999999999997},"min":{"1min":0.50900000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.92200000000000004,"5min":1.379,"15min":1.379},"last":0.80300000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574911,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":876544,"data_stored":387691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.63700000000000001,"15min":0.64200000000000002},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.97299999999999998,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.65000000000000002,"15min":0.64000000000000001},"min":{"1min":0.47599999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.88,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.71899999999999997}]},{"osd":1,"last update":"Fri Jul 14 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.66200000000000003,"15min":0.67700000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.78700000000000003,"5min":1.343,"15min":1.343},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.66100000000000003,"15min":0.65100000000000002},"min":{"1min":0.51300000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.69099999999999995}]},{"osd":2,"last update":"Fri Jul 14 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.72799999999999998,"15min":0.73799999999999999},"min":{"1min":0.59399999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.93500000000000005,"5min":1.034,"15min":1.034},"last":0.748},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.73999999999999999,"15min":0.76600000000000001},"min":{"1min":0.51000000000000001,"5min":0.496,"15min":0.496},"max":{"1min":0.83199999999999996,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.80200000000000005}]},{"osd":3,"last update":"Fri Jul 14 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.73699999999999999,"15min":0.76500000000000001},"min":{"1min":0.53500000000000003,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.92800000000000005,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.73799999999999999,"15min":0.77800000000000002},"min":{"1min":0.63500000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.90900000000000003,"5min":1.806,"15min":1.806},"last":0.67100000000000004}]},{"osd":4,"last update":"Fri Jul 14 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.63700000000000001,"15min":0.65300000000000002},"min":{"1min":0.42599999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.88800000000000001,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.70499999999999996,"15min":0.75},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.996,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.64800000000000002}]},{"osd":6,"last update":"Fri Jul 14 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.71899999999999997,"15min":0.747},"min":{"1min":0.52200000000000002,"5min":0.435,"15min":0.435},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.76200000000000001,"15min":0.79900000000000004},"min":{"1min":0.432,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0629999999999999,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.82399999999999995}]},{"osd":7,"last update":"Fri Jul 14 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.78400000000000003,"15min":0.84199999999999997},"min":{"1min":0.45700000000000002,"5min":0.435,"15min":0.435},"max":{"1min":1.081,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.82599999999999996,"15min":0.86799999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.95899999999999996,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.879}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T11:18:00.643 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T11:18:00.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.869+0000 7fc068bff700 1 Processor -- start 2023-07-14T11:18:00.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.869+0000 7fc068bff700 1 -- start start 2023-07-14T11:18:00.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.870+0000 7fc068bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0640b4510 0x7fc0640b6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:00.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.871+0000 7fc068bff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc0640d0b10 0x7fc0640d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:00.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.871+0000 7fc068bff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0640b7f50 con 0x7fc0640b5d90 2023-07-14T11:18:00.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.871+0000 7fc068bff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0640b48e0 con 0x7fc0640d0b10 2023-07-14T11:18:00.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.871+0000 7fc068bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0640d14d0 con 0x7fc0640b4510 2023-07-14T11:18:00.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.871+0000 7fc062d9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc0640d0b10 0x7fc0640d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:00.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.871+0000 7fc061d9b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fc0640b5d90 0x7fc0640cd590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:59494/0 (socket says 172.21.15.84:59494) 2023-07-14T11:18:00.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.871+0000 7fc061d9b700 1 -- 172.21.15.84:0/3821168709 learned_addr learned my addr 172.21.15.84:0/3821168709 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:18:00.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.871+0000 7fc06259c700 1 --2- 172.21.15.84:0/3821168709 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0640b4510 0x7fc0640b6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:00.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.871+0000 7fc06159a700 1 -- 172.21.15.84:0/3821168709 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3228671230 0 0) 0x7fc0640b7f50 con 0x7fc0640b5d90 2023-07-14T11:18:00.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.871+0000 7fc062d9d700 1 -- 172.21.15.84:0/3821168709 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0640b4510 msgr2=0x7fc0640b6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:00.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.871+0000 7fc062d9d700 1 --2- 172.21.15.84:0/3821168709 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0640b4510 0x7fc0640b6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:00.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.871+0000 7fc062d9d700 1 -- 172.21.15.84:0/3821168709 >> v1:172.21.15.84:6789/0 conn(0x7fc0640b5d90 legacy=0x7fc0640cd590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:00.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.871+0000 7fc062d9d700 1 -- 172.21.15.84:0/3821168709 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0640cdca0 con 0x7fc0640d0b10 2023-07-14T11:18:00.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.872+0000 7fc062d9d700 1 --2- 172.21.15.84:0/3821168709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0640d0b10 0x7fc0640d0f90 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fc05c009d90 tx=0x7fc05c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbbf6810b7989c48 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:00.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.872+0000 7fc06159a700 1 -- 172.21.15.84:0/3821168709 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05c00e070 con 0x7fc0640d0b10 2023-07-14T11:18:00.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.872+0000 7fc06159a700 1 -- 172.21.15.84:0/3821168709 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc05c00bb20 con 0x7fc0640d0b10 2023-07-14T11:18:00.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.872+0000 7fc06159a700 1 -- 172.21.15.84:0/3821168709 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05c012430 con 0x7fc0640d0b10 2023-07-14T11:18:00.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.872+0000 7fc068bff700 1 -- 172.21.15.84:0/3821168709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0640d0b10 msgr2=0x7fc0640d0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:00.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.872+0000 7fc068bff700 1 --2- 172.21.15.84:0/3821168709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0640d0b10 0x7fc0640d0f90 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fc05c009d90 tx=0x7fc05c00b330 comp rx=0 tx=0).stop 2023-07-14T11:18:00.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.872+0000 7fc068bff700 1 -- 172.21.15.84:0/3821168709 shutdown_connections 2023-07-14T11:18:00.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.872+0000 7fc068bff700 1 --2- 172.21.15.84:0/3821168709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0640d0b10 0x7fc0640d0f90 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:00.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.872+0000 7fc068bff700 1 --2- 172.21.15.84:0/3821168709 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0640b4510 0x7fc0640b6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:00.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.872+0000 7fc068bff700 1 -- 172.21.15.84:0/3821168709 >> 172.21.15.84:0/3821168709 conn(0x7fc06409c1d0 msgr2=0x7fc0640d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:00.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.873+0000 7fc068bff700 1 -- 172.21.15.84:0/3821168709 shutdown_connections 2023-07-14T11:18:00.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.873+0000 7fc068bff700 1 -- 172.21.15.84:0/3821168709 wait complete. 2023-07-14T11:18:00.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.875+0000 7fc068bff700 1 Processor -- start 2023-07-14T11:18:00.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.875+0000 7fc068bff700 1 -- start start 2023-07-14T11:18:00.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.876+0000 7fc068bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0640b4510 0x7fc06415a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:00.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.876+0000 7fc068bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0640b5d90 0x7fc0640ca010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:00.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.876+0000 7fc068bff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0640d0b10 0x7fc064159a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:00.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.876+0000 7fc068bff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc06415aad0 con 0x7fc0640d0b10 2023-07-14T11:18:00.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.876+0000 7fc068bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0640ccfd0 con 0x7fc0640b4510 2023-07-14T11:18:00.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.876+0000 7fc068bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0640ca550 con 0x7fc0640b5d90 2023-07-14T11:18:00.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.877+0000 7fc062d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0640d0b10 0x7fc064159a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:00.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.877+0000 7fc062d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0640d0b10 0x7fc064159a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36522/0 (socket says 172.21.15.84:36522) 2023-07-14T11:18:00.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.877+0000 7fc062d9d700 1 -- 172.21.15.84:0/1393043043 learned_addr learned my addr 172.21.15.84:0/1393043043 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:00.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.877+0000 7fc06259c700 1 --2- 172.21.15.84:0/1393043043 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0640b4510 0x7fc06415a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:00.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.877+0000 7fc061d9b700 1 --2- 172.21.15.84:0/1393043043 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0640b5d90 0x7fc0640ca010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:00.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.877+0000 7fc062d9d700 1 -- 172.21.15.84:0/1393043043 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0640b5d90 msgr2=0x7fc0640ca010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:00.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.877+0000 7fc062d9d700 1 --2- 172.21.15.84:0/1393043043 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0640b5d90 0x7fc0640ca010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:00.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.877+0000 7fc062d9d700 1 -- 172.21.15.84:0/1393043043 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0640b4510 msgr2=0x7fc06415a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:00.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.877+0000 7fc062d9d700 1 --2- 172.21.15.84:0/1393043043 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0640b4510 0x7fc06415a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:00.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.877+0000 7fc062d9d700 1 -- 172.21.15.84:0/1393043043 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc05c009a70 con 0x7fc0640d0b10 2023-07-14T11:18:00.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.877+0000 7fc061d9b700 1 --2- 172.21.15.84:0/1393043043 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0640b5d90 0x7fc0640ca010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:18:00.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.877+0000 7fc06259c700 1 --2- 172.21.15.84:0/1393043043 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0640b4510 0x7fc06415a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:18:00.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.877+0000 7fc062d9d700 1 --2- 172.21.15.84:0/1393043043 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0640d0b10 0x7fc064159a20 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fc05c00b680 tx=0x7fc05c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:00.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.877+0000 7fc052ffd700 1 -- 172.21.15.84:0/1393043043 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05c012430 con 0x7fc0640d0b10 2023-07-14T11:18:00.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.877+0000 7fc052ffd700 1 -- 172.21.15.84:0/1393043043 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc05c020070 con 0x7fc0640d0b10 2023-07-14T11:18:00.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.877+0000 7fc068bff700 1 -- 172.21.15.84:0/1393043043 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0640ccb40 con 0x7fc0640d0b10 2023-07-14T11:18:00.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.878+0000 7fc052ffd700 1 -- 172.21.15.84:0/1393043043 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05c004040 con 0x7fc0640d0b10 2023-07-14T11:18:00.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.878+0000 7fc068bff700 1 -- 172.21.15.84:0/1393043043 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc06415fab0 con 0x7fc0640d0b10 2023-07-14T11:18:00.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.879+0000 7fc068bff700 1 -- 172.21.15.84:0/1393043043 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0640cccd0 con 0x7fc0640d0b10 2023-07-14T11:18:00.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.880+0000 7fc052ffd700 1 -- 172.21.15.84:0/1393043043 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7fc05c0041a0 con 0x7fc0640d0b10 2023-07-14T11:18:00.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.880+0000 7fc052ffd700 1 --2- 172.21.15.84:0/1393043043 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc04406b040 0x7fc04406d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:00.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.881+0000 7fc052ffd700 1 -- 172.21.15.84:0/1393043043 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc05c022070 con 0x7fc0640d0b10 2023-07-14T11:18:00.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.881+0000 7fc06259c700 1 --2- 172.21.15.84:0/1393043043 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc04406b040 0x7fc04406d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:00.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.881+0000 7fc06259c700 1 --2- 172.21.15.84:0/1393043043 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc04406b040 0x7fc04406d4f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fc0640b4270 tx=0x7fc054008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:00.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:00.885+0000 7fc052ffd700 1 -- 172.21.15.84:0/1393043043 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fc05c056870 con 0x7fc0640d0b10 2023-07-14T11:18:01.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.076+0000 7fc068bff700 1 -- 172.21.15.84:0/1393043043 --> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc0640b7620 con 0x7fc04406b040 2023-07-14T11:18:01.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.084+0000 7fc052ffd700 1 -- 172.21.15.84:0/1393043043 <== mgr.4104 v2:172.21.15.84:6832/379617029 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299215 (secure 0 0 0) 0x7fc0540117b0 con 0x7fc04406b040 2023-07-14T11:18:01.091 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:18:01.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.088+0000 7fc068bff700 1 -- 172.21.15.84:0/1393043043 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc04406b040 msgr2=0x7fc04406d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:01.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.088+0000 7fc068bff700 1 --2- 172.21.15.84:0/1393043043 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc04406b040 0x7fc04406d4f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fc0640b4270 tx=0x7fc054008040 comp rx=0 tx=0).stop 2023-07-14T11:18:01.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.088+0000 7fc068bff700 1 -- 172.21.15.84:0/1393043043 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0640d0b10 msgr2=0x7fc064159a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:01.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.088+0000 7fc068bff700 1 --2- 172.21.15.84:0/1393043043 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0640d0b10 0x7fc064159a20 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fc05c00b680 tx=0x7fc05c004ad0 comp rx=0 tx=0).stop 2023-07-14T11:18:01.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.088+0000 7fc068bff700 1 -- 172.21.15.84:0/1393043043 shutdown_connections 2023-07-14T11:18:01.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.088+0000 7fc068bff700 1 --2- 172.21.15.84:0/1393043043 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0640d0b10 0x7fc064159a20 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:01.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.088+0000 7fc068bff700 1 --2- 172.21.15.84:0/1393043043 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0640b4510 0x7fc06415a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:01.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.088+0000 7fc068bff700 1 --2- 172.21.15.84:0/1393043043 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc04406b040 0x7fc04406d4f0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:01.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.088+0000 7fc068bff700 1 --2- 172.21.15.84:0/1393043043 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0640b5d90 0x7fc0640ca010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:01.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.088+0000 7fc068bff700 1 -- 172.21.15.84:0/1393043043 >> 172.21.15.84:0/1393043043 conn(0x7fc06409c1d0 msgr2=0x7fc06406a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:01.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.089+0000 7fc068bff700 1 -- 172.21.15.84:0/1393043043 shutdown_connections 2023-07-14T11:18:01.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.089+0000 7fc068bff700 1 -- 172.21.15.84:0/1393043043 wait complete. 2023-07-14T11:18:01.094 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-07-14T11:18:01.110 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":218,"stamp":"2023-07-14T11:18:00.133284+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":22,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223612,"kb_used_data":7996,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754751108,"statfs":{"total":773094113280,"available":772865134592,"internally_reserved":0,"allocated":8187904,"data_stored":4276094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.886330"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.250154+0000","last_change":"2023-07-14T11:17:54.250154+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.250154+0000","last_undegraded":"2023-07-14T11:17:54.250154+0000","last_fullsized":"2023-07-14T11:17:54.250154+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.252866+0000","last_change":"2023-07-14T11:17:54.252866+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.252866+0000","last_undegraded":"2023-07-14T11:17:54.252866+0000","last_fullsized":"2023-07-14T11:17:54.252866+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.253607+0000","last_change":"2023-07-14T11:17:54.253607+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.253607+0000","last_undegraded":"2023-07-14T11:17:54.253607+0000","last_fullsized":"2023-07-14T11:17:54.253607+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.256459+0000","last_change":"2023-07-14T11:17:54.256459+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.256459+0000","last_undegraded":"2023-07-14T11:17:54.256459+0000","last_fullsized":"2023-07-14T11:17:54.256459+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.252207+0000","last_change":"2023-07-14T11:17:54.252207+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.252207+0000","last_undegraded":"2023-07-14T11:17:54.252207+0000","last_fullsized":"2023-07-14T11:17:54.252207+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.250078+0000","last_change":"2023-07-14T11:17:54.250078+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.250078+0000","last_undegraded":"2023-07-14T11:17:54.250078+0000","last_fullsized":"2023-07-14T11:17:54.250078+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.264598+0000","last_change":"2023-07-14T11:17:54.264598+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.264598+0000","last_undegraded":"2023-07-14T11:17:54.264598+0000","last_fullsized":"2023-07-14T11:17:54.264598+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.249433+0000","last_change":"2023-07-14T11:17:54.249433+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.249433+0000","last_undegraded":"2023-07-14T11:17:54.249433+0000","last_fullsized":"2023-07-14T11:17:54.249433+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.253430+0000","last_change":"2023-07-14T11:17:54.253430+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.253430+0000","last_undegraded":"2023-07-14T11:17:54.253430+0000","last_fullsized":"2023-07-14T11:17:54.253430+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.250081+0000","last_change":"2023-07-14T11:17:54.250081+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.250081+0000","last_undegraded":"2023-07-14T11:17:54.250081+0000","last_fullsized":"2023-07-14T11:17:54.250081+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.250054+0000","last_change":"2023-07-14T11:17:54.250054+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.250054+0000","last_undegraded":"2023-07-14T11:17:54.250054+0000","last_fullsized":"2023-07-14T11:17:54.250054+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.255976+0000","last_change":"2023-07-14T11:17:54.255976+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.255976+0000","last_undegraded":"2023-07-14T11:17:54.255976+0000","last_fullsized":"2023-07-14T11:17:54.255976+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.250228+0000","last_change":"2023-07-14T11:17:54.250228+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.250228+0000","last_undegraded":"2023-07-14T11:17:54.250228+0000","last_fullsized":"2023-07-14T11:17:54.250228+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.252759+0000","last_change":"2023-07-14T11:17:54.252759+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.252759+0000","last_undegraded":"2023-07-14T11:17:54.252759+0000","last_fullsized":"2023-07-14T11:17:54.252759+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.249801+0000","last_change":"2023-07-14T11:17:54.249801+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.249801+0000","last_undegraded":"2023-07-14T11:17:54.249801+0000","last_fullsized":"2023-07-14T11:17:54.249801+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.264525+0000","last_change":"2023-07-14T11:17:54.264525+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.264525+0000","last_undegraded":"2023-07-14T11:17:54.264525+0000","last_fullsized":"2023-07-14T11:17:54.264525+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.250078+0000","last_change":"2023-07-14T11:17:54.250078+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.250078+0000","last_undegraded":"2023-07-14T11:17:54.250078+0000","last_fullsized":"2023-07-14T11:17:54.250078+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.264599+0000","last_change":"2023-07-14T11:17:54.264599+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.264599+0000","last_undegraded":"2023-07-14T11:17:54.264599+0000","last_fullsized":"2023-07-14T11:17:54.264599+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.252804+0000","last_change":"2023-07-14T11:17:54.252804+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.252804+0000","last_undegraded":"2023-07-14T11:17:54.252804+0000","last_fullsized":"2023-07-14T11:17:54.252804+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.253203+0000","last_change":"2023-07-14T11:17:54.253203+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.253203+0000","last_undegraded":"2023-07-14T11:17:54.253203+0000","last_fullsized":"2023-07-14T11:17:54.253203+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.255870+0000","last_change":"2023-07-14T11:17:54.255870+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.255870+0000","last_undegraded":"2023-07-14T11:17:54.255870+0000","last_fullsized":"2023-07-14T11:17:54.255870+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.249476+0000","last_change":"2023-07-14T11:17:54.249476+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.249476+0000","last_undegraded":"2023-07-14T11:17:54.249476+0000","last_fullsized":"2023-07-14T11:17:54.249476+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.255894+0000","last_change":"2023-07-14T11:17:54.255894+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.255894+0000","last_undegraded":"2023-07-14T11:17:54.255894+0000","last_fullsized":"2023-07-14T11:17:54.255894+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.249601+0000","last_change":"2023-07-14T11:17:54.249601+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.249601+0000","last_undegraded":"2023-07-14T11:17:54.249601+0000","last_fullsized":"2023-07-14T11:17:54.249601+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.249509+0000","last_change":"2023-07-14T11:17:54.249509+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.249509+0000","last_undegraded":"2023-07-14T11:17:54.249509+0000","last_fullsized":"2023-07-14T11:17:54.249509+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":119,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-07-14T11:17:54.249115+0000","last_change":"2023-07-14T11:13:08.923786+0000","last_active":"2023-07-14T11:17:54.249115+0000","last_peered":"2023-07-14T11:17:54.249115+0000","last_clean":"2023-07-14T11:17:54.249115+0000","last_became_active":"2023-07-14T11:13:08.923384+0000","last_became_peered":"2023-07-14T11:13:08.923384+0000","last_unstale":"2023-07-14T11:17:54.249115+0000","last_undegraded":"2023-07-14T11:17:54.249115+0000","last_fullsized":"2023-07-14T11:17:54.249115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:27:18.695333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.252585+0000","last_change":"2023-07-14T11:17:54.252585+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.252585+0000","last_undegraded":"2023-07-14T11:17:54.252585+0000","last_fullsized":"2023-07-14T11:17:54.252585+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":109,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-07-14T11:17:54.250790+0000","last_change":"2023-07-14T11:13:08.758749+0000","last_active":"2023-07-14T11:17:54.250790+0000","last_peered":"2023-07-14T11:17:54.250790+0000","last_clean":"2023-07-14T11:17:54.250790+0000","last_became_active":"2023-07-14T11:13:08.757956+0000","last_became_peered":"2023-07-14T11:13:08.757956+0000","last_unstale":"2023-07-14T11:17:54.250790+0000","last_undegraded":"2023-07-14T11:17:54.250790+0000","last_fullsized":"2023-07-14T11:17:54.250790+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:55:59.907702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.252247+0000","last_change":"2023-07-14T11:17:54.252247+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.252247+0000","last_undegraded":"2023-07-14T11:17:54.252247+0000","last_fullsized":"2023-07-14T11:17:54.252247+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":115,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-07-14T11:17:54.250025+0000","last_change":"2023-07-14T11:13:08.862331+0000","last_active":"2023-07-14T11:17:54.250025+0000","last_peered":"2023-07-14T11:17:54.250025+0000","last_clean":"2023-07-14T11:17:54.250025+0000","last_became_active":"2023-07-14T11:13:08.861817+0000","last_became_peered":"2023-07-14T11:13:08.861817+0000","last_unstale":"2023-07-14T11:17:54.250025+0000","last_undegraded":"2023-07-14T11:17:54.250025+0000","last_fullsized":"2023-07-14T11:17:54.250025+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:43:14.721900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.252294+0000","last_change":"2023-07-14T11:17:54.252294+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.252294+0000","last_undegraded":"2023-07-14T11:17:54.252294+0000","last_fullsized":"2023-07-14T11:17:54.252294+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":109,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-07-14T11:17:54.250781+0000","last_change":"2023-07-14T11:13:08.757882+0000","last_active":"2023-07-14T11:17:54.250781+0000","last_peered":"2023-07-14T11:17:54.250781+0000","last_clean":"2023-07-14T11:17:54.250781+0000","last_became_active":"2023-07-14T11:13:08.757541+0000","last_became_peered":"2023-07-14T11:13:08.757541+0000","last_unstale":"2023-07-14T11:17:54.250781+0000","last_undegraded":"2023-07-14T11:17:54.250781+0000","last_fullsized":"2023-07-14T11:17:54.250781+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:56:08.609824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":257,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-07-14T11:17:54.254685+0000","last_change":"2023-07-14T11:13:01.370649+0000","last_active":"2023-07-14T11:17:54.254685+0000","last_peered":"2023-07-14T11:17:54.254685+0000","last_clean":"2023-07-14T11:17:54.254685+0000","last_became_active":"2023-07-14T11:13:01.369478+0000","last_became_peered":"2023-07-14T11:13:01.369478+0000","last_unstale":"2023-07-14T11:17:54.254685+0000","last_undegraded":"2023-07-14T11:17:54.254685+0000","last_fullsized":"2023-07-14T11:17:54.254685+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:00.254800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:00.254800+0000","last_clean_scrub_stamp":"2023-07-14T11:13:00.254800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:45:28.466990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.252300+0000","last_change":"2023-07-14T11:17:54.252300+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.252300+0000","last_undegraded":"2023-07-14T11:17:54.252300+0000","last_fullsized":"2023-07-14T11:17:54.252300+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":101,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-07-14T11:17:54.254522+0000","last_change":"2023-07-14T11:13:08.760609+0000","last_active":"2023-07-14T11:17:54.254522+0000","last_peered":"2023-07-14T11:17:54.254522+0000","last_clean":"2023-07-14T11:17:54.254522+0000","last_became_active":"2023-07-14T11:13:08.760285+0000","last_became_peered":"2023-07-14T11:13:08.760285+0000","last_unstale":"2023-07-14T11:17:54.254522+0000","last_undegraded":"2023-07-14T11:17:54.254522+0000","last_fullsized":"2023-07-14T11:17:54.254522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:02:04.589208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.249980+0000","last_change":"2023-07-14T11:17:54.249980+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.249980+0000","last_undegraded":"2023-07-14T11:17:54.249980+0000","last_fullsized":"2023-07-14T11:17:54.249980+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":101,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-07-14T11:17:54.255064+0000","last_change":"2023-07-14T11:13:08.923899+0000","last_active":"2023-07-14T11:17:54.255064+0000","last_peered":"2023-07-14T11:17:54.255064+0000","last_clean":"2023-07-14T11:17:54.255064+0000","last_became_active":"2023-07-14T11:13:08.923513+0000","last_became_peered":"2023-07-14T11:13:08.923513+0000","last_unstale":"2023-07-14T11:17:54.255064+0000","last_undegraded":"2023-07-14T11:17:54.255064+0000","last_fullsized":"2023-07-14T11:17:54.255064+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:54:10.440722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.253922+0000","last_change":"2023-07-14T11:17:54.253922+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.253922+0000","last_undegraded":"2023-07-14T11:17:54.253922+0000","last_fullsized":"2023-07-14T11:17:54.253922+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":119,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-07-14T11:17:54.249255+0000","last_change":"2023-07-14T11:13:08.761726+0000","last_active":"2023-07-14T11:17:54.249255+0000","last_peered":"2023-07-14T11:17:54.249255+0000","last_clean":"2023-07-14T11:17:54.249255+0000","last_became_active":"2023-07-14T11:13:08.761365+0000","last_became_peered":"2023-07-14T11:13:08.761365+0000","last_unstale":"2023-07-14T11:17:54.249255+0000","last_undegraded":"2023-07-14T11:17:54.249255+0000","last_fullsized":"2023-07-14T11:17:54.249255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:53:21.512364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.252236+0000","last_change":"2023-07-14T11:17:54.252236+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.252236+0000","last_undegraded":"2023-07-14T11:17:54.252236+0000","last_fullsized":"2023-07-14T11:17:54.252236+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":107,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-07-14T11:17:54.256951+0000","last_change":"2023-07-14T11:13:08.762084+0000","last_active":"2023-07-14T11:17:54.256951+0000","last_peered":"2023-07-14T11:17:54.256951+0000","last_clean":"2023-07-14T11:17:54.256951+0000","last_became_active":"2023-07-14T11:13:08.761763+0000","last_became_peered":"2023-07-14T11:13:08.761763+0000","last_unstale":"2023-07-14T11:17:54.256951+0000","last_undegraded":"2023-07-14T11:17:54.256951+0000","last_fullsized":"2023-07-14T11:17:54.256951+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:50:50.833707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574911,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28388,"kb_used_data":1436,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343452,"statfs":{"total":96636764160,"available":96607694848,"internally_reserved":0,"allocated":1470464,"data_stored":978059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.80400000000000005,"15min":0.94199999999999995},"min":{"1min":0.441,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.93300000000000005,"5min":8.4339999999999993,"15min":8.4339999999999993},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.84599999999999997,"15min":0.97999999999999998},"min":{"1min":0.55100000000000005,"5min":0.377,"15min":0.377},"max":{"1min":0.88800000000000001,"5min":8.4559999999999995,"15min":8.4559999999999995},"last":0.59899999999999998}]},{"osd":1,"last update":"Fri Jul 14 11:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.79700000000000004,"15min":0.91300000000000003},"min":{"1min":0.54000000000000004,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.86699999999999999,"5min":6.3520000000000003,"15min":6.3520000000000003},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.88100000000000001,"15min":1.083},"min":{"1min":0.49299999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.877,"5min":6.8550000000000004,"15min":6.8550000000000004},"last":0.53700000000000003}]},{"osd":2,"last update":"Fri Jul 14 11:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.91200000000000003,"15min":1.137},"min":{"1min":0.51000000000000001,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.91400000000000003,"5min":7.0289999999999999,"15min":7.0289999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.70599999999999996,"15min":0.69399999999999995},"min":{"1min":0.48599999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.94499999999999995,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.76900000000000002}]},{"osd":3,"last update":"Fri Jul 14 11:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.95699999999999996,"15min":1.198},"min":{"1min":0.51800000000000002,"5min":0.505,"15min":0.505},"max":{"1min":0.95699999999999996,"5min":10.337,"15min":10.337},"last":0.627},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.753,"15min":0.76700000000000002},"min":{"1min":0.60799999999999998,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.97899999999999998,"5min":1.921,"15min":1.921},"last":0.82199999999999995}]},{"osd":4,"last update":"Fri Jul 14 11:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.62,"15min":0.58999999999999997},"min":{"1min":0.44500000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.89900000000000002,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.72499999999999998,"15min":0.70199999999999996},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.88200000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.67000000000000004}]},{"osd":5,"last update":"Fri Jul 14 11:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.68899999999999995,"15min":0.67500000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.89400000000000002,"5min":1.04,"15min":1.04},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.746,"5min":0.754,"15min":0.73699999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.92100000000000004,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.79500000000000004}]},{"osd":6,"last update":"Fri Jul 14 11:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.70899999999999996,"15min":0.67700000000000005},"min":{"1min":0.499,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.94199999999999995,"5min":1.002,"15min":1.002},"last":0.753},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.71699999999999997,"15min":0.68899999999999995},"min":{"1min":0.50900000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.90200000000000002,"5min":1.018,"15min":1.018},"last":0.72699999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574912,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":876544,"data_stored":387691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.71499999999999997,"15min":0.70799999999999996},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.93799999999999994,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.73499999999999999,"15min":0.72099999999999997},"min":{"1min":0.45300000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.93100000000000005,"5min":1.167,"15min":1.167},"last":0.86699999999999999}]},{"osd":1,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.71099999999999997,"15min":0.68899999999999995},"min":{"1min":0.53100000000000003,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.97699999999999998,"5min":1.006,"15min":1.006},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.73599999999999999,"15min":0.71599999999999997},"min":{"1min":0.50900000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.0109999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.91500000000000004}]},{"osd":2,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.69399999999999995,"15min":0.67700000000000005},"min":{"1min":0.51300000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.95199999999999996,"5min":1.45,"15min":1.45},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76900000000000002,"15min":0.78100000000000003},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.94799999999999995,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.93600000000000005}]},{"osd":3,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.752,"15min":0.75},"min":{"1min":0.56499999999999995,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.002,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.747,"15min":0.74299999999999999},"min":{"1min":0.60099999999999998,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.91600000000000004,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.81599999999999995}]},{"osd":4,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.68799999999999994,"15min":0.70599999999999996},"min":{"1min":0.44400000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.94699999999999995,"5min":1.712,"15min":1.712},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.71399999999999997,"15min":0.72399999999999998},"min":{"1min":0.47299999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.871,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.58699999999999997}]},{"osd":5,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.71299999999999997,"15min":0.71799999999999997},"min":{"1min":0.51500000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.89800000000000002,"5min":2.8820000000000001,"15min":2.8820000000000001},"last":0.627},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76900000000000002,"15min":0.78700000000000003},"min":{"1min":0.496,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.98399999999999999,"5min":1.129,"15min":1.129},"last":0.72399999999999998}]},{"osd":7,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.78000000000000003,"15min":0.80100000000000005},"min":{"1min":0.47399999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0569999999999999,"5min":1.333,"15min":1.333},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.76800000000000002,"15min":0.79000000000000004},"min":{"1min":0.54100000000000004,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.92700000000000005,"5min":1.55,"15min":1.55},"last":0.88300000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574911,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":876544,"data_stored":387691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:17:04 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.42299999999999999,"15min":0.438},"min":{"1min":0.28899999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.54300000000000004,"5min":0.996,"15min":0.996},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.47699999999999998,"15min":0.48299999999999998},"min":{"1min":0.34499999999999997,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.63100000000000001,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.38300000000000001}]},{"osd":2,"last update":"Fri Jul 14 11:17:04 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.52800000000000002,"15min":0.56499999999999995},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.70799999999999996,"5min":2.476,"15min":2.476},"last":0.442},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.55800000000000005,"15min":0.61799999999999999},"min":{"1min":0.39800000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.68300000000000005,"5min":2.6299999999999999,"15min":2.6299999999999999},"last":0.53400000000000003}]},{"osd":3,"last update":"Fri Jul 14 11:17:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.53200000000000003,"15min":0.52300000000000002},"min":{"1min":0.40200000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.66300000000000003,"5min":0.748,"15min":0.748},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48199999999999998,"15min":0.49399999999999999},"min":{"1min":0.41699999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.60299999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.40300000000000002}]},{"osd":4,"last update":"Fri Jul 14 11:17:04 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.75,"15min":0.753},"min":{"1min":0.61199999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0309999999999999,"5min":1.363,"15min":1.363},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.76800000000000002,"15min":0.77400000000000002},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.1160000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.55400000000000005}]},{"osd":5,"last update":"Fri Jul 14 11:17:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.76700000000000002,"15min":0.77100000000000002},"min":{"1min":0.60199999999999998,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.2250000000000001,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.499},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.79300000000000004,"15min":0.81799999999999995},"min":{"1min":0.58199999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":0.98299999999999998,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.63100000000000001}]},{"osd":6,"last update":"Fri Jul 14 11:17:04 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.76800000000000002,"15min":0.79600000000000004},"min":{"1min":0.56200000000000006,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.97599999999999998,"5min":1.298,"15min":1.298},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77700000000000002,"15min":0.78700000000000003},"min":{"1min":0.54800000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1899999999999999,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.65000000000000002}]},{"osd":7,"last update":"Fri Jul 14 11:17:04 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.78600000000000003,"15min":0.81599999999999995},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.097,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.77400000000000002,"15min":0.78700000000000003},"min":{"1min":0.624,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.0800000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.57099999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574909,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28388,"kb_used_data":1436,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343452,"statfs":{"total":96636764160,"available":96607694848,"internally_reserved":0,"allocated":1470464,"data_stored":978059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.44,"15min":0.435},"min":{"1min":0.33900000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.59999999999999998,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.44400000000000001,"15min":0.441},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.64100000000000001,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.34999999999999998}]},{"osd":2,"last update":"Fri Jul 14 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.375,"5min":0.307,"15min":0.307},"max":{"1min":0.58599999999999997,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.497,"15min":0.502},"min":{"1min":0.36299999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.66600000000000004,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.51300000000000001}]},{"osd":3,"last update":"Fri Jul 14 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.44900000000000001,"15min":0.42699999999999999},"min":{"1min":0.36099999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.64300000000000002,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.52700000000000002,"15min":0.52500000000000002},"min":{"1min":0.42299999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.64400000000000002,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.53100000000000003}]},{"osd":4,"last update":"Fri Jul 14 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.76300000000000001,"15min":0.76600000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.044,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":1.0289999999999999},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.72999999999999998,"15min":0.70699999999999996},"min":{"1min":0.53200000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.92600000000000005}]},{"osd":5,"last update":"Fri Jul 14 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.74399999999999999,"15min":0.72899999999999998},"min":{"1min":0.57799999999999996,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77400000000000002,"15min":0.77900000000000003},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.99299999999999999}]},{"osd":6,"last update":"Fri Jul 14 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.73499999999999999,"15min":0.72499999999999998},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.01,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.77600000000000002,"15min":0.78000000000000003},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.022,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.85999999999999999}]},{"osd":7,"last update":"Fri Jul 14 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.80800000000000005,"15min":0.81999999999999995},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.0900000000000001,"5min":1.149,"15min":1.149},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.80300000000000005,"15min":0.78300000000000003},"min":{"1min":0.58999999999999997,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.0600000000000001,"5min":1.081,"15min":1.081},"last":1.014}]}]},{"osd":2,"up_from":13,"seq":55834574909,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":876544,"data_stored":387691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.42799999999999999,"15min":0.44700000000000001},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.63900000000000001,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.436,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.52500000000000002}]},{"osd":1,"last update":"Fri Jul 14 11:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.47999999999999998,"15min":0.48599999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.68400000000000005,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.499,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.39500000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.61399999999999999,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.40400000000000003}]},{"osd":3,"last update":"Fri Jul 14 11:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.501,"15min":0.497},"min":{"1min":0.35699999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.376},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57799999999999996,"15min":0.58699999999999997},"min":{"1min":0.42099999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.72599999999999998,"5min":1.034,"15min":1.034},"last":0.45800000000000002}]},{"osd":4,"last update":"Fri Jul 14 11:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.76200000000000001,"15min":0.77200000000000002},"min":{"1min":0.55800000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.92700000000000005,"5min":1.212,"15min":1.212},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.77700000000000002,"15min":0.78800000000000003},"min":{"1min":0.64100000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.1000000000000001,"5min":1.198,"15min":1.198},"last":0.82199999999999995}]},{"osd":5,"last update":"Fri Jul 14 11:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.76900000000000002,"15min":0.79000000000000004},"min":{"1min":0.59499999999999997,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.98899999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.80000000000000004,"15min":0.82399999999999995},"min":{"1min":0.55000000000000004,"5min":0.495,"15min":0.495},"max":{"1min":1.0609999999999999,"5min":1.351,"15min":1.351},"last":0.89200000000000002}]},{"osd":6,"last update":"Fri Jul 14 11:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.78100000000000003,"15min":0.79000000000000004},"min":{"1min":0.60899999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.1180000000000001,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.79900000000000004,"15min":0.82299999999999995},"min":{"1min":0.59499999999999997,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0129999999999999,"5min":1.282,"15min":1.282},"last":0.79500000000000004}]},{"osd":7,"last update":"Fri Jul 14 11:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.79300000000000004,"15min":0.80400000000000005},"min":{"1min":0.628,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.0389999999999999,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.78600000000000003,"15min":0.80700000000000005},"min":{"1min":0.63,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.95299999999999996,"5min":1.244,"15min":1.244},"last":0.84099999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574909,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":864256,"data_stored":381521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.42899999999999999,"15min":0.44800000000000001},"min":{"1min":0.34399999999999997,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.67800000000000005,"5min":0.754,"15min":0.754},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.502,"5min":0.45500000000000002,"15min":0.45100000000000001},"min":{"1min":0.317,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.57499999999999996}]},{"osd":1,"last update":"Fri Jul 14 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.45100000000000001,"15min":0.45300000000000001},"min":{"1min":0.34000000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.49299999999999999,"15min":0.498},"min":{"1min":0.44500000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.72699999999999998,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.41299999999999998}]},{"osd":2,"last update":"Fri Jul 14 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.55200000000000005,"15min":0.54600000000000004},"min":{"1min":0.42899999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.438},{"interface":"front","average":{"1min":0.627,"5min":0.58799999999999997,"15min":0.59799999999999998},"min":{"1min":0.46500000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.79600000000000004,"5min":1.585,"15min":1.585},"last":0.52800000000000002}]},{"osd":4,"last update":"Fri Jul 14 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.75900000000000001,"15min":0.76300000000000001},"min":{"1min":0.53200000000000003,"5min":0.372,"15min":0.372},"max":{"1min":1.0029999999999999,"5min":1.216,"15min":1.216},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.77700000000000002,"15min":0.76000000000000001},"min":{"1min":0.61899999999999999,"5min":0.504,"15min":0.504},"max":{"1min":1.0609999999999999,"5min":1.147,"15min":1.147},"last":0.67500000000000004}]},{"osd":5,"last update":"Fri Jul 14 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.76700000000000002,"15min":0.76400000000000001},"min":{"1min":0.65400000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.024,"5min":1.413,"15min":1.413},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.81799999999999995,"15min":0.85199999999999998},"min":{"1min":0.621,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.097,"5min":1.657,"15min":1.657},"last":0.65600000000000003}]},{"osd":6,"last update":"Fri Jul 14 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.66300000000000003,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.133,"5min":1.726,"15min":1.726},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.78900000000000003,"15min":0.80100000000000005},"min":{"1min":0.61099999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.085,"5min":1.333,"15min":1.333},"last":0.83799999999999997}]},{"osd":7,"last update":"Fri Jul 14 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.81899999999999995,"15min":0.83799999999999997},"min":{"1min":0.623,"5min":0.437,"15min":0.437},"max":{"1min":1.1459999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.83299999999999996,"15min":0.84199999999999997},"min":{"1min":0.59599999999999997,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1579999999999999,"5min":1.268,"15min":1.268},"last":0.80000000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574909,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":876544,"data_stored":387691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.64400000000000002,"15min":0.63400000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.85199999999999998,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.67500000000000004,"15min":0.69099999999999995},"min":{"1min":0.42699999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.83199999999999996,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.64600000000000002}]},{"osd":1,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.66100000000000003,"15min":0.66900000000000004},"min":{"1min":0.46100000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.82899999999999996,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.71599999999999997,"15min":0.71399999999999997},"min":{"1min":0.49299999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.93700000000000006,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.61399999999999999}]},{"osd":2,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.71799999999999997,"15min":0.71299999999999997},"min":{"1min":0.51000000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.85299999999999998,"5min":1.48,"15min":1.48},"last":0.5},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.73899999999999999,"15min":0.74199999999999999},"min":{"1min":0.57499999999999996,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.84499999999999997,"5min":1.23,"15min":1.23},"last":0.83099999999999996}]},{"osd":3,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.69899999999999995,"15min":0.71499999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.81299999999999994,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.748,"15min":0.74199999999999999},"min":{"1min":0.55200000000000005,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.88100000000000001,"5min":1.145,"15min":1.145},"last":0.55200000000000005}]},{"osd":5,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.71799999999999997,"15min":0.76000000000000001},"min":{"1min":0.45300000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.90000000000000002,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.71699999999999997,"15min":0.76500000000000001},"min":{"1min":0.48999999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.81499999999999995,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.81899999999999995}]},{"osd":6,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71499999999999997,"15min":0.72299999999999998},"min":{"1min":0.45600000000000002,"5min":0.436,"15min":0.436},"max":{"1min":0.86399999999999999,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76600000000000001,"15min":0.77600000000000002},"min":{"1min":0.56999999999999995,"5min":0.442,"15min":0.442},"max":{"1min":0.96099999999999997,"5min":1.3,"15min":1.3},"last":0.88900000000000001}]},{"osd":7,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.746,"15min":0.76900000000000002},"min":{"1min":0.53500000000000003,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.86499999999999999,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.81000000000000005,"15min":0.84399999999999997},"min":{"1min":0.50900000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.92200000000000004,"5min":1.379,"15min":1.379},"last":0.80300000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574911,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":876544,"data_stored":387691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.63700000000000001,"15min":0.64200000000000002},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.97299999999999998,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.65000000000000002,"15min":0.64000000000000001},"min":{"1min":0.47599999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.88,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.71899999999999997}]},{"osd":1,"last update":"Fri Jul 14 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.66200000000000003,"15min":0.67700000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.78700000000000003,"5min":1.343,"15min":1.343},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.66100000000000003,"15min":0.65100000000000002},"min":{"1min":0.51300000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.69099999999999995}]},{"osd":2,"last update":"Fri Jul 14 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.72799999999999998,"15min":0.73799999999999999},"min":{"1min":0.59399999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.93500000000000005,"5min":1.034,"15min":1.034},"last":0.748},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.73999999999999999,"15min":0.76600000000000001},"min":{"1min":0.51000000000000001,"5min":0.496,"15min":0.496},"max":{"1min":0.83199999999999996,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.80200000000000005}]},{"osd":3,"last update":"Fri Jul 14 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.73699999999999999,"15min":0.76500000000000001},"min":{"1min":0.53500000000000003,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.92800000000000005,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.73799999999999999,"15min":0.77800000000000002},"min":{"1min":0.63500000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.90900000000000003,"5min":1.806,"15min":1.806},"last":0.67100000000000004}]},{"osd":4,"last update":"Fri Jul 14 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.63700000000000001,"15min":0.65300000000000002},"min":{"1min":0.42599999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.88800000000000001,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.70499999999999996,"15min":0.75},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.996,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.64800000000000002}]},{"osd":6,"last update":"Fri Jul 14 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.71899999999999997,"15min":0.747},"min":{"1min":0.52200000000000002,"5min":0.435,"15min":0.435},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.76200000000000001,"15min":0.79900000000000004},"min":{"1min":0.432,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0629999999999999,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.82399999999999995}]},{"osd":7,"last update":"Fri Jul 14 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.78400000000000003,"15min":0.84199999999999997},"min":{"1min":0.45700000000000002,"5min":0.435,"15min":0.435},"max":{"1min":1.081,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.82599999999999996,"15min":0.86799999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.95899999999999996,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.879}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T11:18:01.116 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T11:18:01.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.342+0000 7f7e0c3ff700 1 Processor -- start 2023-07-14T11:18:01.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.342+0000 7f7e0c3ff700 1 -- start start 2023-07-14T11:18:01.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.343+0000 7f7e0c3ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7e04160030 0x7f7e0406c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:01.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.343+0000 7f7e0c3ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7e040b5cd0 0x7f7e040d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:01.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.343+0000 7f7e0c3ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e040d2cc0 con 0x7f7e040b1f70 2023-07-14T11:18:01.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.343+0000 7f7e0c3ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e040afbb0 con 0x7f7e040b5cd0 2023-07-14T11:18:01.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.343+0000 7f7e0c3ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e040afe90 con 0x7f7e04160030 2023-07-14T11:18:01.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.344+0000 7f7e0999a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7e040b5cd0 0x7f7e040d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:01.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.344+0000 7f7e0999a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7e040b5cd0 0x7f7e040d0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36526/0 (socket says 172.21.15.84:36526) 2023-07-14T11:18:01.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.344+0000 7f7e0999a700 1 -- 172.21.15.84:0/2132893840 learned_addr learned my addr 172.21.15.84:0/2132893840 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:01.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.344+0000 7f7e0a19b700 1 --2- 172.21.15.84:0/2132893840 >> v2:172.21.15.179:3300/0 conn(0x7f7e04160030 0x7f7e0406c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:01.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.344+0000 7f7e0999a700 1 -- 172.21.15.84:0/2132893840 >> v2:172.21.15.179:3300/0 conn(0x7f7e04160030 msgr2=0x7f7e0406c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:01.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.344+0000 7f7e0999a700 1 --2- 172.21.15.84:0/2132893840 >> v2:172.21.15.179:3300/0 conn(0x7f7e04160030 0x7f7e0406c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:01.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.344+0000 7f7e0999a700 1 -- 172.21.15.84:0/2132893840 >> v1:172.21.15.179:6789/0 conn(0x7f7e040b1f70 legacy=0x7f7e0406a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:01.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.344+0000 7f7e0999a700 1 -- 172.21.15.84:0/2132893840 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e040b0170 con 0x7f7e040b5cd0 2023-07-14T11:18:01.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.344+0000 7f7e0999a700 1 --2- 172.21.15.84:0/2132893840 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e040b5cd0 0x7f7e040d0a50 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f7e0406d1a0 tx=0x7f7df4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=863d8011c6524ecc server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:01.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.344+0000 7f7e09199700 1 -- 172.21.15.84:0/2132893840 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df400b870 con 0x7f7e040b5cd0 2023-07-14T11:18:01.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.345+0000 7f7e09199700 1 -- 172.21.15.84:0/2132893840 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7df400b9d0 con 0x7f7e040b5cd0 2023-07-14T11:18:01.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.345+0000 7f7e09199700 1 -- 172.21.15.84:0/2132893840 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df400bd60 con 0x7f7e040b5cd0 2023-07-14T11:18:01.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.345+0000 7f7e0c3ff700 1 -- 172.21.15.84:0/2132893840 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e040b5cd0 msgr2=0x7f7e040d0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:01.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.345+0000 7f7e0c3ff700 1 --2- 172.21.15.84:0/2132893840 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e040b5cd0 0x7f7e040d0a50 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f7e0406d1a0 tx=0x7f7df4009bd0 comp rx=0 tx=0).stop 2023-07-14T11:18:01.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.345+0000 7f7e0c3ff700 1 -- 172.21.15.84:0/2132893840 shutdown_connections 2023-07-14T11:18:01.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.345+0000 7f7e0c3ff700 1 --2- 172.21.15.84:0/2132893840 >> v2:172.21.15.179:3300/0 conn(0x7f7e04160030 0x7f7e0406c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:01.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.345+0000 7f7e0c3ff700 1 --2- 172.21.15.84:0/2132893840 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e040b5cd0 0x7f7e040d0a50 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:01.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.345+0000 7f7e0c3ff700 1 -- 172.21.15.84:0/2132893840 >> 172.21.15.84:0/2132893840 conn(0x7f7e0409c190 msgr2=0x7f7e040d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:01.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.345+0000 7f7e0c3ff700 1 -- 172.21.15.84:0/2132893840 shutdown_connections 2023-07-14T11:18:01.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.345+0000 7f7e0c3ff700 1 -- 172.21.15.84:0/2132893840 wait complete. 2023-07-14T11:18:01.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.347+0000 7f7e0c3ff700 1 Processor -- start 2023-07-14T11:18:01.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.347+0000 7f7e0c3ff700 1 -- start start 2023-07-14T11:18:01.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.348+0000 7f7e0c3ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e040b1f70 0x7f7e040c8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:01.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.348+0000 7f7e0c3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e040b5cd0 0x7f7e0414a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:01.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.348+0000 7f7e0c3ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e04160030 0x7f7e0414a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:01.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.348+0000 7f7e0c3ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e041f5d60 con 0x7f7e040b1f70 2023-07-14T11:18:01.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.348+0000 7f7e0c3ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e041f68a0 con 0x7f7e04160030 2023-07-14T11:18:01.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.348+0000 7f7e0c3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0414ad70 con 0x7f7e040b5cd0 2023-07-14T11:18:01.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.348+0000 7f7e0a19b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e040b1f70 0x7f7e040c8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:01.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.348+0000 7f7e0a19b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e040b1f70 0x7f7e040c8c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36530/0 (socket says 172.21.15.84:36530) 2023-07-14T11:18:01.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.348+0000 7f7e0a19b700 1 -- 172.21.15.84:0/3537699535 learned_addr learned my addr 172.21.15.84:0/3537699535 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:01.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.349+0000 7f7e0a19b700 1 -- 172.21.15.84:0/3537699535 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e040b5cd0 msgr2=0x7f7e0414a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:01.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.349+0000 7f7e0a19b700 1 --2- 172.21.15.84:0/3537699535 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e040b5cd0 0x7f7e0414a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:01.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.349+0000 7f7e0a19b700 1 -- 172.21.15.84:0/3537699535 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e04160030 msgr2=0x7f7e0414a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:01.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.349+0000 7f7e0a19b700 1 --2- 172.21.15.84:0/3537699535 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e04160030 0x7f7e0414a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:01.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.349+0000 7f7e0a19b700 1 -- 172.21.15.84:0/3537699535 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7df4009550 con 0x7f7e040b1f70 2023-07-14T11:18:01.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.349+0000 7f7e0a19b700 1 --2- 172.21.15.84:0/3537699535 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e040b1f70 0x7f7e040c8c30 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f7e0000d800 tx=0x7f7e0000dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:01.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.349+0000 7f7dfaffd700 1 -- 172.21.15.84:0/3537699535 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e000125f0 con 0x7f7e040b1f70 2023-07-14T11:18:01.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.349+0000 7f7dfaffd700 1 -- 172.21.15.84:0/3537699535 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e00012750 con 0x7f7e040b1f70 2023-07-14T11:18:01.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.349+0000 7f7e0c3ff700 1 -- 172.21.15.84:0/3537699535 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e041f5f70 con 0x7f7e040b1f70 2023-07-14T11:18:01.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.349+0000 7f7dfaffd700 1 -- 172.21.15.84:0/3537699535 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e00012b00 con 0x7f7e040b1f70 2023-07-14T11:18:01.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.349+0000 7f7e0c3ff700 1 -- 172.21.15.84:0/3537699535 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e041f6530 con 0x7f7e040b1f70 2023-07-14T11:18:01.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.350+0000 7f7e0c3ff700 1 -- 172.21.15.84:0/3537699535 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e0404e280 con 0x7f7e040b1f70 2023-07-14T11:18:01.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.351+0000 7f7dfaffd700 1 -- 172.21.15.84:0/3537699535 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7f7e00012c60 con 0x7f7e040b1f70 2023-07-14T11:18:01.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.352+0000 7f7dfaffd700 1 --2- 172.21.15.84:0/3537699535 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f7de806b040 0x7f7de806d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:01.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.352+0000 7f7dfaffd700 1 -- 172.21.15.84:0/3537699535 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7e00089e50 con 0x7f7e040b1f70 2023-07-14T11:18:01.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.352+0000 7f7e0999a700 1 --2- 172.21.15.84:0/3537699535 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f7de806b040 0x7f7de806d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:01.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.353+0000 7f7e0999a700 1 --2- 172.21.15.84:0/3537699535 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f7de806b040 0x7f7de806d4f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f7e0409e1c0 tx=0x7f7df4010000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:01.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.356+0000 7f7dfaffd700 1 -- 172.21.15.84:0/3537699535 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7e00054ab0 con 0x7f7e040b1f70 2023-07-14T11:18:01.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.547+0000 7f7e0c3ff700 1 -- 172.21.15.84:0/3537699535 --> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7e040b0730 con 0x7f7de806b040 2023-07-14T11:18:01.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.555+0000 7f7dfaffd700 1 -- 172.21.15.84:0/3537699535 <== mgr.4104 v2:172.21.15.84:6832/379617029 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299215 (secure 0 0 0) 0x7f7df401f070 con 0x7f7de806b040 2023-07-14T11:18:01.562 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:18:01.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.560+0000 7f7e0c3ff700 1 -- 172.21.15.84:0/3537699535 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f7de806b040 msgr2=0x7f7de806d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:01.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.560+0000 7f7e0c3ff700 1 --2- 172.21.15.84:0/3537699535 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f7de806b040 0x7f7de806d4f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f7e0409e1c0 tx=0x7f7df4010000 comp rx=0 tx=0).stop 2023-07-14T11:18:01.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.560+0000 7f7e0c3ff700 1 -- 172.21.15.84:0/3537699535 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e040b1f70 msgr2=0x7f7e040c8c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:01.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.560+0000 7f7e0c3ff700 1 --2- 172.21.15.84:0/3537699535 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e040b1f70 0x7f7e040c8c30 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f7e0000d800 tx=0x7f7e0000dbc0 comp rx=0 tx=0).stop 2023-07-14T11:18:01.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.560+0000 7f7e0c3ff700 1 -- 172.21.15.84:0/3537699535 shutdown_connections 2023-07-14T11:18:01.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.560+0000 7f7e0c3ff700 1 --2- 172.21.15.84:0/3537699535 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e04160030 0x7f7e0414a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:01.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.560+0000 7f7e0c3ff700 1 --2- 172.21.15.84:0/3537699535 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e040b1f70 0x7f7e040c8c30 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:01.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.560+0000 7f7e0c3ff700 1 --2- 172.21.15.84:0/3537699535 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f7de806b040 0x7f7de806d4f0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:01.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.560+0000 7f7e0c3ff700 1 --2- 172.21.15.84:0/3537699535 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e040b5cd0 0x7f7e0414a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:01.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.560+0000 7f7e0c3ff700 1 -- 172.21.15.84:0/3537699535 >> 172.21.15.84:0/3537699535 conn(0x7f7e0409c190 msgr2=0x7f7e040b7610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:01.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.560+0000 7f7e0c3ff700 1 -- 172.21.15.84:0/3537699535 shutdown_connections 2023-07-14T11:18:01.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.560+0000 7f7e0c3ff700 1 -- 172.21.15.84:0/3537699535 wait complete. 2023-07-14T11:18:01.565 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-07-14T11:18:01.581 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":218,"stamp":"2023-07-14T11:18:00.133284+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":22,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223612,"kb_used_data":7996,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754751108,"statfs":{"total":773094113280,"available":772865134592,"internally_reserved":0,"allocated":8187904,"data_stored":4276094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.886330"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.250154+0000","last_change":"2023-07-14T11:17:54.250154+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.250154+0000","last_undegraded":"2023-07-14T11:17:54.250154+0000","last_fullsized":"2023-07-14T11:17:54.250154+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.252866+0000","last_change":"2023-07-14T11:17:54.252866+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.252866+0000","last_undegraded":"2023-07-14T11:17:54.252866+0000","last_fullsized":"2023-07-14T11:17:54.252866+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.253607+0000","last_change":"2023-07-14T11:17:54.253607+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.253607+0000","last_undegraded":"2023-07-14T11:17:54.253607+0000","last_fullsized":"2023-07-14T11:17:54.253607+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.256459+0000","last_change":"2023-07-14T11:17:54.256459+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.256459+0000","last_undegraded":"2023-07-14T11:17:54.256459+0000","last_fullsized":"2023-07-14T11:17:54.256459+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.252207+0000","last_change":"2023-07-14T11:17:54.252207+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.252207+0000","last_undegraded":"2023-07-14T11:17:54.252207+0000","last_fullsized":"2023-07-14T11:17:54.252207+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.250078+0000","last_change":"2023-07-14T11:17:54.250078+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.250078+0000","last_undegraded":"2023-07-14T11:17:54.250078+0000","last_fullsized":"2023-07-14T11:17:54.250078+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.264598+0000","last_change":"2023-07-14T11:17:54.264598+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.264598+0000","last_undegraded":"2023-07-14T11:17:54.264598+0000","last_fullsized":"2023-07-14T11:17:54.264598+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.249433+0000","last_change":"2023-07-14T11:17:54.249433+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.249433+0000","last_undegraded":"2023-07-14T11:17:54.249433+0000","last_fullsized":"2023-07-14T11:17:54.249433+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.253430+0000","last_change":"2023-07-14T11:17:54.253430+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.253430+0000","last_undegraded":"2023-07-14T11:17:54.253430+0000","last_fullsized":"2023-07-14T11:17:54.253430+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.250081+0000","last_change":"2023-07-14T11:17:54.250081+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.250081+0000","last_undegraded":"2023-07-14T11:17:54.250081+0000","last_fullsized":"2023-07-14T11:17:54.250081+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.250054+0000","last_change":"2023-07-14T11:17:54.250054+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.250054+0000","last_undegraded":"2023-07-14T11:17:54.250054+0000","last_fullsized":"2023-07-14T11:17:54.250054+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.255976+0000","last_change":"2023-07-14T11:17:54.255976+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.255976+0000","last_undegraded":"2023-07-14T11:17:54.255976+0000","last_fullsized":"2023-07-14T11:17:54.255976+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.250228+0000","last_change":"2023-07-14T11:17:54.250228+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.250228+0000","last_undegraded":"2023-07-14T11:17:54.250228+0000","last_fullsized":"2023-07-14T11:17:54.250228+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.252759+0000","last_change":"2023-07-14T11:17:54.252759+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.252759+0000","last_undegraded":"2023-07-14T11:17:54.252759+0000","last_fullsized":"2023-07-14T11:17:54.252759+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.249801+0000","last_change":"2023-07-14T11:17:54.249801+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.249801+0000","last_undegraded":"2023-07-14T11:17:54.249801+0000","last_fullsized":"2023-07-14T11:17:54.249801+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.264525+0000","last_change":"2023-07-14T11:17:54.264525+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.264525+0000","last_undegraded":"2023-07-14T11:17:54.264525+0000","last_fullsized":"2023-07-14T11:17:54.264525+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.250078+0000","last_change":"2023-07-14T11:17:54.250078+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.250078+0000","last_undegraded":"2023-07-14T11:17:54.250078+0000","last_fullsized":"2023-07-14T11:17:54.250078+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.264599+0000","last_change":"2023-07-14T11:17:54.264599+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.264599+0000","last_undegraded":"2023-07-14T11:17:54.264599+0000","last_fullsized":"2023-07-14T11:17:54.264599+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.252804+0000","last_change":"2023-07-14T11:17:54.252804+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.252804+0000","last_undegraded":"2023-07-14T11:17:54.252804+0000","last_fullsized":"2023-07-14T11:17:54.252804+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.253203+0000","last_change":"2023-07-14T11:17:54.253203+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.253203+0000","last_undegraded":"2023-07-14T11:17:54.253203+0000","last_fullsized":"2023-07-14T11:17:54.253203+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.255870+0000","last_change":"2023-07-14T11:17:54.255870+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.255870+0000","last_undegraded":"2023-07-14T11:17:54.255870+0000","last_fullsized":"2023-07-14T11:17:54.255870+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.249476+0000","last_change":"2023-07-14T11:17:54.249476+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.249476+0000","last_undegraded":"2023-07-14T11:17:54.249476+0000","last_fullsized":"2023-07-14T11:17:54.249476+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.255894+0000","last_change":"2023-07-14T11:17:54.255894+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.255894+0000","last_undegraded":"2023-07-14T11:17:54.255894+0000","last_fullsized":"2023-07-14T11:17:54.255894+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.249601+0000","last_change":"2023-07-14T11:17:54.249601+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.249601+0000","last_undegraded":"2023-07-14T11:17:54.249601+0000","last_fullsized":"2023-07-14T11:17:54.249601+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.249509+0000","last_change":"2023-07-14T11:17:54.249509+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.249509+0000","last_undegraded":"2023-07-14T11:17:54.249509+0000","last_fullsized":"2023-07-14T11:17:54.249509+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":119,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-07-14T11:17:54.249115+0000","last_change":"2023-07-14T11:13:08.923786+0000","last_active":"2023-07-14T11:17:54.249115+0000","last_peered":"2023-07-14T11:17:54.249115+0000","last_clean":"2023-07-14T11:17:54.249115+0000","last_became_active":"2023-07-14T11:13:08.923384+0000","last_became_peered":"2023-07-14T11:13:08.923384+0000","last_unstale":"2023-07-14T11:17:54.249115+0000","last_undegraded":"2023-07-14T11:17:54.249115+0000","last_fullsized":"2023-07-14T11:17:54.249115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:27:18.695333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.252585+0000","last_change":"2023-07-14T11:17:54.252585+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.252585+0000","last_undegraded":"2023-07-14T11:17:54.252585+0000","last_fullsized":"2023-07-14T11:17:54.252585+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":109,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-07-14T11:17:54.250790+0000","last_change":"2023-07-14T11:13:08.758749+0000","last_active":"2023-07-14T11:17:54.250790+0000","last_peered":"2023-07-14T11:17:54.250790+0000","last_clean":"2023-07-14T11:17:54.250790+0000","last_became_active":"2023-07-14T11:13:08.757956+0000","last_became_peered":"2023-07-14T11:13:08.757956+0000","last_unstale":"2023-07-14T11:17:54.250790+0000","last_undegraded":"2023-07-14T11:17:54.250790+0000","last_fullsized":"2023-07-14T11:17:54.250790+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:55:59.907702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.252247+0000","last_change":"2023-07-14T11:17:54.252247+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.252247+0000","last_undegraded":"2023-07-14T11:17:54.252247+0000","last_fullsized":"2023-07-14T11:17:54.252247+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":115,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-07-14T11:17:54.250025+0000","last_change":"2023-07-14T11:13:08.862331+0000","last_active":"2023-07-14T11:17:54.250025+0000","last_peered":"2023-07-14T11:17:54.250025+0000","last_clean":"2023-07-14T11:17:54.250025+0000","last_became_active":"2023-07-14T11:13:08.861817+0000","last_became_peered":"2023-07-14T11:13:08.861817+0000","last_unstale":"2023-07-14T11:17:54.250025+0000","last_undegraded":"2023-07-14T11:17:54.250025+0000","last_fullsized":"2023-07-14T11:17:54.250025+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:43:14.721900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.252294+0000","last_change":"2023-07-14T11:17:54.252294+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.252294+0000","last_undegraded":"2023-07-14T11:17:54.252294+0000","last_fullsized":"2023-07-14T11:17:54.252294+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":109,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-07-14T11:17:54.250781+0000","last_change":"2023-07-14T11:13:08.757882+0000","last_active":"2023-07-14T11:17:54.250781+0000","last_peered":"2023-07-14T11:17:54.250781+0000","last_clean":"2023-07-14T11:17:54.250781+0000","last_became_active":"2023-07-14T11:13:08.757541+0000","last_became_peered":"2023-07-14T11:13:08.757541+0000","last_unstale":"2023-07-14T11:17:54.250781+0000","last_undegraded":"2023-07-14T11:17:54.250781+0000","last_fullsized":"2023-07-14T11:17:54.250781+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:56:08.609824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":257,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-07-14T11:17:54.254685+0000","last_change":"2023-07-14T11:13:01.370649+0000","last_active":"2023-07-14T11:17:54.254685+0000","last_peered":"2023-07-14T11:17:54.254685+0000","last_clean":"2023-07-14T11:17:54.254685+0000","last_became_active":"2023-07-14T11:13:01.369478+0000","last_became_peered":"2023-07-14T11:13:01.369478+0000","last_unstale":"2023-07-14T11:17:54.254685+0000","last_undegraded":"2023-07-14T11:17:54.254685+0000","last_fullsized":"2023-07-14T11:17:54.254685+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:00.254800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:00.254800+0000","last_clean_scrub_stamp":"2023-07-14T11:13:00.254800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:45:28.466990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.252300+0000","last_change":"2023-07-14T11:17:54.252300+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.252300+0000","last_undegraded":"2023-07-14T11:17:54.252300+0000","last_fullsized":"2023-07-14T11:17:54.252300+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":101,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-07-14T11:17:54.254522+0000","last_change":"2023-07-14T11:13:08.760609+0000","last_active":"2023-07-14T11:17:54.254522+0000","last_peered":"2023-07-14T11:17:54.254522+0000","last_clean":"2023-07-14T11:17:54.254522+0000","last_became_active":"2023-07-14T11:13:08.760285+0000","last_became_peered":"2023-07-14T11:13:08.760285+0000","last_unstale":"2023-07-14T11:17:54.254522+0000","last_undegraded":"2023-07-14T11:17:54.254522+0000","last_fullsized":"2023-07-14T11:17:54.254522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:02:04.589208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.249980+0000","last_change":"2023-07-14T11:17:54.249980+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.249980+0000","last_undegraded":"2023-07-14T11:17:54.249980+0000","last_fullsized":"2023-07-14T11:17:54.249980+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":101,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-07-14T11:17:54.255064+0000","last_change":"2023-07-14T11:13:08.923899+0000","last_active":"2023-07-14T11:17:54.255064+0000","last_peered":"2023-07-14T11:17:54.255064+0000","last_clean":"2023-07-14T11:17:54.255064+0000","last_became_active":"2023-07-14T11:13:08.923513+0000","last_became_peered":"2023-07-14T11:13:08.923513+0000","last_unstale":"2023-07-14T11:17:54.255064+0000","last_undegraded":"2023-07-14T11:17:54.255064+0000","last_fullsized":"2023-07-14T11:17:54.255064+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:54:10.440722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.253922+0000","last_change":"2023-07-14T11:17:54.253922+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.253922+0000","last_undegraded":"2023-07-14T11:17:54.253922+0000","last_fullsized":"2023-07-14T11:17:54.253922+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":119,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-07-14T11:17:54.249255+0000","last_change":"2023-07-14T11:13:08.761726+0000","last_active":"2023-07-14T11:17:54.249255+0000","last_peered":"2023-07-14T11:17:54.249255+0000","last_clean":"2023-07-14T11:17:54.249255+0000","last_became_active":"2023-07-14T11:13:08.761365+0000","last_became_peered":"2023-07-14T11:13:08.761365+0000","last_unstale":"2023-07-14T11:17:54.249255+0000","last_undegraded":"2023-07-14T11:17:54.249255+0000","last_fullsized":"2023-07-14T11:17:54.249255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:53:21.512364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:17:55.247056+0000","last_change":"2023-07-14T11:17:55.247056+0000","last_active":"2023-07-14T11:17:55.247056+0000","last_peered":"2023-07-14T11:17:55.247056+0000","last_clean":"2023-07-14T11:17:55.247056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:55.247056+0000","last_undegraded":"2023-07-14T11:17:55.247056+0000","last_fullsized":"2023-07-14T11:17:55.247056+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2023-07-14T11:17:54.252236+0000","last_change":"2023-07-14T11:17:54.252236+0000","last_active":"2023-07-14T11:17:54.239645+0000","last_peered":"2023-07-14T11:17:54.239645+0000","last_clean":"2023-07-14T11:17:54.239645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:17:54.252236+0000","last_undegraded":"2023-07-14T11:17:54.252236+0000","last_fullsized":"2023-07-14T11:17:54.252236+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":107,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-07-14T11:17:54.256951+0000","last_change":"2023-07-14T11:13:08.762084+0000","last_active":"2023-07-14T11:17:54.256951+0000","last_peered":"2023-07-14T11:17:54.256951+0000","last_clean":"2023-07-14T11:17:54.256951+0000","last_became_active":"2023-07-14T11:13:08.761763+0000","last_became_peered":"2023-07-14T11:13:08.761763+0000","last_unstale":"2023-07-14T11:17:54.256951+0000","last_undegraded":"2023-07-14T11:17:54.256951+0000","last_fullsized":"2023-07-14T11:17:54.256951+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:50:50.833707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574911,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28388,"kb_used_data":1436,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343452,"statfs":{"total":96636764160,"available":96607694848,"internally_reserved":0,"allocated":1470464,"data_stored":978059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.80400000000000005,"15min":0.94199999999999995},"min":{"1min":0.441,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.93300000000000005,"5min":8.4339999999999993,"15min":8.4339999999999993},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.84599999999999997,"15min":0.97999999999999998},"min":{"1min":0.55100000000000005,"5min":0.377,"15min":0.377},"max":{"1min":0.88800000000000001,"5min":8.4559999999999995,"15min":8.4559999999999995},"last":0.59899999999999998}]},{"osd":1,"last update":"Fri Jul 14 11:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.79700000000000004,"15min":0.91300000000000003},"min":{"1min":0.54000000000000004,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.86699999999999999,"5min":6.3520000000000003,"15min":6.3520000000000003},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.88100000000000001,"15min":1.083},"min":{"1min":0.49299999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.877,"5min":6.8550000000000004,"15min":6.8550000000000004},"last":0.53700000000000003}]},{"osd":2,"last update":"Fri Jul 14 11:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.91200000000000003,"15min":1.137},"min":{"1min":0.51000000000000001,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.91400000000000003,"5min":7.0289999999999999,"15min":7.0289999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.70599999999999996,"15min":0.69399999999999995},"min":{"1min":0.48599999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.94499999999999995,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.76900000000000002}]},{"osd":3,"last update":"Fri Jul 14 11:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.95699999999999996,"15min":1.198},"min":{"1min":0.51800000000000002,"5min":0.505,"15min":0.505},"max":{"1min":0.95699999999999996,"5min":10.337,"15min":10.337},"last":0.627},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.753,"15min":0.76700000000000002},"min":{"1min":0.60799999999999998,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.97899999999999998,"5min":1.921,"15min":1.921},"last":0.82199999999999995}]},{"osd":4,"last update":"Fri Jul 14 11:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.62,"15min":0.58999999999999997},"min":{"1min":0.44500000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.89900000000000002,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.72499999999999998,"15min":0.70199999999999996},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.88200000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.67000000000000004}]},{"osd":5,"last update":"Fri Jul 14 11:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.68899999999999995,"15min":0.67500000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.89400000000000002,"5min":1.04,"15min":1.04},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.746,"5min":0.754,"15min":0.73699999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.92100000000000004,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.79500000000000004}]},{"osd":6,"last update":"Fri Jul 14 11:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.70899999999999996,"15min":0.67700000000000005},"min":{"1min":0.499,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.94199999999999995,"5min":1.002,"15min":1.002},"last":0.753},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.71699999999999997,"15min":0.68899999999999995},"min":{"1min":0.50900000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.90200000000000002,"5min":1.018,"15min":1.018},"last":0.72699999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574912,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":876544,"data_stored":387691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.71499999999999997,"15min":0.70799999999999996},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.93799999999999994,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.73499999999999999,"15min":0.72099999999999997},"min":{"1min":0.45300000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.93100000000000005,"5min":1.167,"15min":1.167},"last":0.86699999999999999}]},{"osd":1,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.71099999999999997,"15min":0.68899999999999995},"min":{"1min":0.53100000000000003,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.97699999999999998,"5min":1.006,"15min":1.006},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.73599999999999999,"15min":0.71599999999999997},"min":{"1min":0.50900000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.0109999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.91500000000000004}]},{"osd":2,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.69399999999999995,"15min":0.67700000000000005},"min":{"1min":0.51300000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.95199999999999996,"5min":1.45,"15min":1.45},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76900000000000002,"15min":0.78100000000000003},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.94799999999999995,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.93600000000000005}]},{"osd":3,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.752,"15min":0.75},"min":{"1min":0.56499999999999995,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.002,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.747,"15min":0.74299999999999999},"min":{"1min":0.60099999999999998,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.91600000000000004,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.81599999999999995}]},{"osd":4,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.68799999999999994,"15min":0.70599999999999996},"min":{"1min":0.44400000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.94699999999999995,"5min":1.712,"15min":1.712},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.71399999999999997,"15min":0.72399999999999998},"min":{"1min":0.47299999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.871,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.58699999999999997}]},{"osd":5,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.71299999999999997,"15min":0.71799999999999997},"min":{"1min":0.51500000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.89800000000000002,"5min":2.8820000000000001,"15min":2.8820000000000001},"last":0.627},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76900000000000002,"15min":0.78700000000000003},"min":{"1min":0.496,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.98399999999999999,"5min":1.129,"15min":1.129},"last":0.72399999999999998}]},{"osd":7,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.78000000000000003,"15min":0.80100000000000005},"min":{"1min":0.47399999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0569999999999999,"5min":1.333,"15min":1.333},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.76800000000000002,"15min":0.79000000000000004},"min":{"1min":0.54100000000000004,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.92700000000000005,"5min":1.55,"15min":1.55},"last":0.88300000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574911,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":876544,"data_stored":387691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:17:04 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.42299999999999999,"15min":0.438},"min":{"1min":0.28899999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.54300000000000004,"5min":0.996,"15min":0.996},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.47699999999999998,"15min":0.48299999999999998},"min":{"1min":0.34499999999999997,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.63100000000000001,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.38300000000000001}]},{"osd":2,"last update":"Fri Jul 14 11:17:04 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.52800000000000002,"15min":0.56499999999999995},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.70799999999999996,"5min":2.476,"15min":2.476},"last":0.442},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.55800000000000005,"15min":0.61799999999999999},"min":{"1min":0.39800000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.68300000000000005,"5min":2.6299999999999999,"15min":2.6299999999999999},"last":0.53400000000000003}]},{"osd":3,"last update":"Fri Jul 14 11:17:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.53200000000000003,"15min":0.52300000000000002},"min":{"1min":0.40200000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.66300000000000003,"5min":0.748,"15min":0.748},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48199999999999998,"15min":0.49399999999999999},"min":{"1min":0.41699999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.60299999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.40300000000000002}]},{"osd":4,"last update":"Fri Jul 14 11:17:04 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.75,"15min":0.753},"min":{"1min":0.61199999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0309999999999999,"5min":1.363,"15min":1.363},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.76800000000000002,"15min":0.77400000000000002},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.1160000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.55400000000000005}]},{"osd":5,"last update":"Fri Jul 14 11:17:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.76700000000000002,"15min":0.77100000000000002},"min":{"1min":0.60199999999999998,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.2250000000000001,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.499},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.79300000000000004,"15min":0.81799999999999995},"min":{"1min":0.58199999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":0.98299999999999998,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.63100000000000001}]},{"osd":6,"last update":"Fri Jul 14 11:17:04 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.76800000000000002,"15min":0.79600000000000004},"min":{"1min":0.56200000000000006,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.97599999999999998,"5min":1.298,"15min":1.298},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77700000000000002,"15min":0.78700000000000003},"min":{"1min":0.54800000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1899999999999999,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.65000000000000002}]},{"osd":7,"last update":"Fri Jul 14 11:17:04 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.78600000000000003,"15min":0.81599999999999995},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.097,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.77400000000000002,"15min":0.78700000000000003},"min":{"1min":0.624,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.0800000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.57099999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574909,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28388,"kb_used_data":1436,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343452,"statfs":{"total":96636764160,"available":96607694848,"internally_reserved":0,"allocated":1470464,"data_stored":978059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.44,"15min":0.435},"min":{"1min":0.33900000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.59999999999999998,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.44400000000000001,"15min":0.441},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.64100000000000001,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.34999999999999998}]},{"osd":2,"last update":"Fri Jul 14 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.375,"5min":0.307,"15min":0.307},"max":{"1min":0.58599999999999997,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.497,"15min":0.502},"min":{"1min":0.36299999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.66600000000000004,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.51300000000000001}]},{"osd":3,"last update":"Fri Jul 14 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.44900000000000001,"15min":0.42699999999999999},"min":{"1min":0.36099999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.64300000000000002,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.52700000000000002,"15min":0.52500000000000002},"min":{"1min":0.42299999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.64400000000000002,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.53100000000000003}]},{"osd":4,"last update":"Fri Jul 14 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.76300000000000001,"15min":0.76600000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.044,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":1.0289999999999999},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.72999999999999998,"15min":0.70699999999999996},"min":{"1min":0.53200000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.92600000000000005}]},{"osd":5,"last update":"Fri Jul 14 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.74399999999999999,"15min":0.72899999999999998},"min":{"1min":0.57799999999999996,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77400000000000002,"15min":0.77900000000000003},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.99299999999999999}]},{"osd":6,"last update":"Fri Jul 14 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.73499999999999999,"15min":0.72499999999999998},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.01,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.77600000000000002,"15min":0.78000000000000003},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.022,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.85999999999999999}]},{"osd":7,"last update":"Fri Jul 14 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.80800000000000005,"15min":0.81999999999999995},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.0900000000000001,"5min":1.149,"15min":1.149},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.80300000000000005,"15min":0.78300000000000003},"min":{"1min":0.58999999999999997,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.0600000000000001,"5min":1.081,"15min":1.081},"last":1.014}]}]},{"osd":2,"up_from":13,"seq":55834574909,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":876544,"data_stored":387691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.42799999999999999,"15min":0.44700000000000001},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.63900000000000001,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.436,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.52500000000000002}]},{"osd":1,"last update":"Fri Jul 14 11:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.47999999999999998,"15min":0.48599999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.68400000000000005,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.499,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.39500000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.61399999999999999,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.40400000000000003}]},{"osd":3,"last update":"Fri Jul 14 11:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.501,"15min":0.497},"min":{"1min":0.35699999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.376},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57799999999999996,"15min":0.58699999999999997},"min":{"1min":0.42099999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.72599999999999998,"5min":1.034,"15min":1.034},"last":0.45800000000000002}]},{"osd":4,"last update":"Fri Jul 14 11:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.76200000000000001,"15min":0.77200000000000002},"min":{"1min":0.55800000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.92700000000000005,"5min":1.212,"15min":1.212},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.77700000000000002,"15min":0.78800000000000003},"min":{"1min":0.64100000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.1000000000000001,"5min":1.198,"15min":1.198},"last":0.82199999999999995}]},{"osd":5,"last update":"Fri Jul 14 11:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.76900000000000002,"15min":0.79000000000000004},"min":{"1min":0.59499999999999997,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.98899999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.80000000000000004,"15min":0.82399999999999995},"min":{"1min":0.55000000000000004,"5min":0.495,"15min":0.495},"max":{"1min":1.0609999999999999,"5min":1.351,"15min":1.351},"last":0.89200000000000002}]},{"osd":6,"last update":"Fri Jul 14 11:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.78100000000000003,"15min":0.79000000000000004},"min":{"1min":0.60899999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.1180000000000001,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.79900000000000004,"15min":0.82299999999999995},"min":{"1min":0.59499999999999997,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0129999999999999,"5min":1.282,"15min":1.282},"last":0.79500000000000004}]},{"osd":7,"last update":"Fri Jul 14 11:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.79300000000000004,"15min":0.80400000000000005},"min":{"1min":0.628,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.0389999999999999,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.78600000000000003,"15min":0.80700000000000005},"min":{"1min":0.63,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.95299999999999996,"5min":1.244,"15min":1.244},"last":0.84099999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574909,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":864256,"data_stored":381521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.42899999999999999,"15min":0.44800000000000001},"min":{"1min":0.34399999999999997,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.67800000000000005,"5min":0.754,"15min":0.754},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.502,"5min":0.45500000000000002,"15min":0.45100000000000001},"min":{"1min":0.317,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.57499999999999996}]},{"osd":1,"last update":"Fri Jul 14 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.45100000000000001,"15min":0.45300000000000001},"min":{"1min":0.34000000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.49299999999999999,"15min":0.498},"min":{"1min":0.44500000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.72699999999999998,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.41299999999999998}]},{"osd":2,"last update":"Fri Jul 14 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.55200000000000005,"15min":0.54600000000000004},"min":{"1min":0.42899999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.438},{"interface":"front","average":{"1min":0.627,"5min":0.58799999999999997,"15min":0.59799999999999998},"min":{"1min":0.46500000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.79600000000000004,"5min":1.585,"15min":1.585},"last":0.52800000000000002}]},{"osd":4,"last update":"Fri Jul 14 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.75900000000000001,"15min":0.76300000000000001},"min":{"1min":0.53200000000000003,"5min":0.372,"15min":0.372},"max":{"1min":1.0029999999999999,"5min":1.216,"15min":1.216},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.77700000000000002,"15min":0.76000000000000001},"min":{"1min":0.61899999999999999,"5min":0.504,"15min":0.504},"max":{"1min":1.0609999999999999,"5min":1.147,"15min":1.147},"last":0.67500000000000004}]},{"osd":5,"last update":"Fri Jul 14 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.76700000000000002,"15min":0.76400000000000001},"min":{"1min":0.65400000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.024,"5min":1.413,"15min":1.413},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.81799999999999995,"15min":0.85199999999999998},"min":{"1min":0.621,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.097,"5min":1.657,"15min":1.657},"last":0.65600000000000003}]},{"osd":6,"last update":"Fri Jul 14 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.66300000000000003,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.133,"5min":1.726,"15min":1.726},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.78900000000000003,"15min":0.80100000000000005},"min":{"1min":0.61099999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.085,"5min":1.333,"15min":1.333},"last":0.83799999999999997}]},{"osd":7,"last update":"Fri Jul 14 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.81899999999999995,"15min":0.83799999999999997},"min":{"1min":0.623,"5min":0.437,"15min":0.437},"max":{"1min":1.1459999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.83299999999999996,"15min":0.84199999999999997},"min":{"1min":0.59599999999999997,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1579999999999999,"5min":1.268,"15min":1.268},"last":0.80000000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574909,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":876544,"data_stored":387691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.64400000000000002,"15min":0.63400000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.85199999999999998,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.67500000000000004,"15min":0.69099999999999995},"min":{"1min":0.42699999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.83199999999999996,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.64600000000000002}]},{"osd":1,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.66100000000000003,"15min":0.66900000000000004},"min":{"1min":0.46100000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.82899999999999996,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.71599999999999997,"15min":0.71399999999999997},"min":{"1min":0.49299999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.93700000000000006,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.61399999999999999}]},{"osd":2,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.71799999999999997,"15min":0.71299999999999997},"min":{"1min":0.51000000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.85299999999999998,"5min":1.48,"15min":1.48},"last":0.5},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.73899999999999999,"15min":0.74199999999999999},"min":{"1min":0.57499999999999996,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.84499999999999997,"5min":1.23,"15min":1.23},"last":0.83099999999999996}]},{"osd":3,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.69899999999999995,"15min":0.71499999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.81299999999999994,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.748,"15min":0.74199999999999999},"min":{"1min":0.55200000000000005,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.88100000000000001,"5min":1.145,"15min":1.145},"last":0.55200000000000005}]},{"osd":5,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.71799999999999997,"15min":0.76000000000000001},"min":{"1min":0.45300000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.90000000000000002,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.71699999999999997,"15min":0.76500000000000001},"min":{"1min":0.48999999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.81499999999999995,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.81899999999999995}]},{"osd":6,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71499999999999997,"15min":0.72299999999999998},"min":{"1min":0.45600000000000002,"5min":0.436,"15min":0.436},"max":{"1min":0.86399999999999999,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76600000000000001,"15min":0.77600000000000002},"min":{"1min":0.56999999999999995,"5min":0.442,"15min":0.442},"max":{"1min":0.96099999999999997,"5min":1.3,"15min":1.3},"last":0.88900000000000001}]},{"osd":7,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.746,"15min":0.76900000000000002},"min":{"1min":0.53500000000000003,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.86499999999999999,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.81000000000000005,"15min":0.84399999999999997},"min":{"1min":0.50900000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.92200000000000004,"5min":1.379,"15min":1.379},"last":0.80300000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574911,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":876544,"data_stored":387691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.63700000000000001,"15min":0.64200000000000002},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.97299999999999998,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.65000000000000002,"15min":0.64000000000000001},"min":{"1min":0.47599999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.88,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.71899999999999997}]},{"osd":1,"last update":"Fri Jul 14 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.66200000000000003,"15min":0.67700000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.78700000000000003,"5min":1.343,"15min":1.343},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.66100000000000003,"15min":0.65100000000000002},"min":{"1min":0.51300000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.69099999999999995}]},{"osd":2,"last update":"Fri Jul 14 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.72799999999999998,"15min":0.73799999999999999},"min":{"1min":0.59399999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.93500000000000005,"5min":1.034,"15min":1.034},"last":0.748},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.73999999999999999,"15min":0.76600000000000001},"min":{"1min":0.51000000000000001,"5min":0.496,"15min":0.496},"max":{"1min":0.83199999999999996,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.80200000000000005}]},{"osd":3,"last update":"Fri Jul 14 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.73699999999999999,"15min":0.76500000000000001},"min":{"1min":0.53500000000000003,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.92800000000000005,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.73799999999999999,"15min":0.77800000000000002},"min":{"1min":0.63500000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.90900000000000003,"5min":1.806,"15min":1.806},"last":0.67100000000000004}]},{"osd":4,"last update":"Fri Jul 14 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.63700000000000001,"15min":0.65300000000000002},"min":{"1min":0.42599999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.88800000000000001,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.70499999999999996,"15min":0.75},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.996,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.64800000000000002}]},{"osd":6,"last update":"Fri Jul 14 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.71899999999999997,"15min":0.747},"min":{"1min":0.52200000000000002,"5min":0.435,"15min":0.435},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.76200000000000001,"15min":0.79900000000000004},"min":{"1min":0.432,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0629999999999999,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.82399999999999995}]},{"osd":7,"last update":"Fri Jul 14 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.78400000000000003,"15min":0.84199999999999997},"min":{"1min":0.45700000000000002,"5min":0.435,"15min":0.435},"max":{"1min":1.081,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.82599999999999996,"15min":0.86799999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.95899999999999996,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.879}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T11:18:01.588 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3f is not active+clean 2023-07-14T11:18:01.588 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:17:55.247056+0000', 'last_change': '2023-07-14T11:17:55.247056+0000', 'last_active': '2023-07-14T11:17:55.247056+0000', 'last_peered': '2023-07-14T11:17:55.247056+0000', 'last_clean': '2023-07-14T11:17:55.247056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:55.247056+0000', 'last_undegraded': '2023-07-14T11:17:55.247056+0000', 'last_fullsized': '2023-07-14T11:17:55.247056+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:18:01.589 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3e is not active+clean 2023-07-14T11:18:01.589 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:17:55.247056+0000', 'last_change': '2023-07-14T11:17:55.247056+0000', 'last_active': '2023-07-14T11:17:55.247056+0000', 'last_peered': '2023-07-14T11:17:55.247056+0000', 'last_clean': '2023-07-14T11:17:55.247056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:55.247056+0000', 'last_undegraded': '2023-07-14T11:17:55.247056+0000', 'last_fullsized': '2023-07-14T11:17:55.247056+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:18:01.589 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3d is not active+clean 2023-07-14T11:18:01.589 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:17:55.247056+0000', 'last_change': '2023-07-14T11:17:55.247056+0000', 'last_active': '2023-07-14T11:17:55.247056+0000', 'last_peered': '2023-07-14T11:17:55.247056+0000', 'last_clean': '2023-07-14T11:17:55.247056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:55.247056+0000', 'last_undegraded': '2023-07-14T11:17:55.247056+0000', 'last_fullsized': '2023-07-14T11:17:55.247056+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:18:01.590 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3c is not active+clean 2023-07-14T11:18:01.590 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:17:55.247056+0000', 'last_change': '2023-07-14T11:17:55.247056+0000', 'last_active': '2023-07-14T11:17:55.247056+0000', 'last_peered': '2023-07-14T11:17:55.247056+0000', 'last_clean': '2023-07-14T11:17:55.247056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:55.247056+0000', 'last_undegraded': '2023-07-14T11:17:55.247056+0000', 'last_fullsized': '2023-07-14T11:17:55.247056+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:18:01.590 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3b is not active+clean 2023-07-14T11:18:01.591 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:17:55.247056+0000', 'last_change': '2023-07-14T11:17:55.247056+0000', 'last_active': '2023-07-14T11:17:55.247056+0000', 'last_peered': '2023-07-14T11:17:55.247056+0000', 'last_clean': '2023-07-14T11:17:55.247056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:55.247056+0000', 'last_undegraded': '2023-07-14T11:17:55.247056+0000', 'last_fullsized': '2023-07-14T11:17:55.247056+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:18:01.591 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3a is not active+clean 2023-07-14T11:18:01.591 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:17:55.247056+0000', 'last_change': '2023-07-14T11:17:55.247056+0000', 'last_active': '2023-07-14T11:17:55.247056+0000', 'last_peered': '2023-07-14T11:17:55.247056+0000', 'last_clean': '2023-07-14T11:17:55.247056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:55.247056+0000', 'last_undegraded': '2023-07-14T11:17:55.247056+0000', 'last_fullsized': '2023-07-14T11:17:55.247056+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:18:01.592 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.39 is not active+clean 2023-07-14T11:18:01.592 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:17:55.247056+0000', 'last_change': '2023-07-14T11:17:55.247056+0000', 'last_active': '2023-07-14T11:17:55.247056+0000', 'last_peered': '2023-07-14T11:17:55.247056+0000', 'last_clean': '2023-07-14T11:17:55.247056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:55.247056+0000', 'last_undegraded': '2023-07-14T11:17:55.247056+0000', 'last_fullsized': '2023-07-14T11:17:55.247056+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:18:01.592 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.38 is not active+clean 2023-07-14T11:18:01.593 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:17:55.247056+0000', 'last_change': '2023-07-14T11:17:55.247056+0000', 'last_active': '2023-07-14T11:17:55.247056+0000', 'last_peered': '2023-07-14T11:17:55.247056+0000', 'last_clean': '2023-07-14T11:17:55.247056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:55.247056+0000', 'last_undegraded': '2023-07-14T11:17:55.247056+0000', 'last_fullsized': '2023-07-14T11:17:55.247056+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:18:01.593 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.37 is not active+clean 2023-07-14T11:18:01.593 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:17:55.247056+0000', 'last_change': '2023-07-14T11:17:55.247056+0000', 'last_active': '2023-07-14T11:17:55.247056+0000', 'last_peered': '2023-07-14T11:17:55.247056+0000', 'last_clean': '2023-07-14T11:17:55.247056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:55.247056+0000', 'last_undegraded': '2023-07-14T11:17:55.247056+0000', 'last_fullsized': '2023-07-14T11:17:55.247056+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:18:01.594 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.36 is not active+clean 2023-07-14T11:18:01.594 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:17:55.247056+0000', 'last_change': '2023-07-14T11:17:55.247056+0000', 'last_active': '2023-07-14T11:17:55.247056+0000', 'last_peered': '2023-07-14T11:17:55.247056+0000', 'last_clean': '2023-07-14T11:17:55.247056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:55.247056+0000', 'last_undegraded': '2023-07-14T11:17:55.247056+0000', 'last_fullsized': '2023-07-14T11:17:55.247056+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:18:01.594 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.35 is not active+clean 2023-07-14T11:18:01.594 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:17:55.247056+0000', 'last_change': '2023-07-14T11:17:55.247056+0000', 'last_active': '2023-07-14T11:17:55.247056+0000', 'last_peered': '2023-07-14T11:17:55.247056+0000', 'last_clean': '2023-07-14T11:17:55.247056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:55.247056+0000', 'last_undegraded': '2023-07-14T11:17:55.247056+0000', 'last_fullsized': '2023-07-14T11:17:55.247056+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:18:01.595 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.34 is not active+clean 2023-07-14T11:18:01.595 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:17:55.247056+0000', 'last_change': '2023-07-14T11:17:55.247056+0000', 'last_active': '2023-07-14T11:17:55.247056+0000', 'last_peered': '2023-07-14T11:17:55.247056+0000', 'last_clean': '2023-07-14T11:17:55.247056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:55.247056+0000', 'last_undegraded': '2023-07-14T11:17:55.247056+0000', 'last_fullsized': '2023-07-14T11:17:55.247056+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:18:01.595 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.33 is not active+clean 2023-07-14T11:18:01.596 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:17:55.247056+0000', 'last_change': '2023-07-14T11:17:55.247056+0000', 'last_active': '2023-07-14T11:17:55.247056+0000', 'last_peered': '2023-07-14T11:17:55.247056+0000', 'last_clean': '2023-07-14T11:17:55.247056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:55.247056+0000', 'last_undegraded': '2023-07-14T11:17:55.247056+0000', 'last_fullsized': '2023-07-14T11:17:55.247056+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:18:01.596 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.32 is not active+clean 2023-07-14T11:18:01.596 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:17:55.247056+0000', 'last_change': '2023-07-14T11:17:55.247056+0000', 'last_active': '2023-07-14T11:17:55.247056+0000', 'last_peered': '2023-07-14T11:17:55.247056+0000', 'last_clean': '2023-07-14T11:17:55.247056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:55.247056+0000', 'last_undegraded': '2023-07-14T11:17:55.247056+0000', 'last_fullsized': '2023-07-14T11:17:55.247056+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:18:01.597 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.31 is not active+clean 2023-07-14T11:18:01.597 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:17:55.247056+0000', 'last_change': '2023-07-14T11:17:55.247056+0000', 'last_active': '2023-07-14T11:17:55.247056+0000', 'last_peered': '2023-07-14T11:17:55.247056+0000', 'last_clean': '2023-07-14T11:17:55.247056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:55.247056+0000', 'last_undegraded': '2023-07-14T11:17:55.247056+0000', 'last_fullsized': '2023-07-14T11:17:55.247056+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:18:01.597 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.30 is not active+clean 2023-07-14T11:18:01.598 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:17:55.247056+0000', 'last_change': '2023-07-14T11:17:55.247056+0000', 'last_active': '2023-07-14T11:17:55.247056+0000', 'last_peered': '2023-07-14T11:17:55.247056+0000', 'last_clean': '2023-07-14T11:17:55.247056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:55.247056+0000', 'last_undegraded': '2023-07-14T11:17:55.247056+0000', 'last_fullsized': '2023-07-14T11:17:55.247056+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:18:01.598 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2f is not active+clean 2023-07-14T11:18:01.598 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:17:55.247056+0000', 'last_change': '2023-07-14T11:17:55.247056+0000', 'last_active': '2023-07-14T11:17:55.247056+0000', 'last_peered': '2023-07-14T11:17:55.247056+0000', 'last_clean': '2023-07-14T11:17:55.247056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:55.247056+0000', 'last_undegraded': '2023-07-14T11:17:55.247056+0000', 'last_fullsized': '2023-07-14T11:17:55.247056+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:18:01.599 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2e is not active+clean 2023-07-14T11:18:01.599 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:17:55.247056+0000', 'last_change': '2023-07-14T11:17:55.247056+0000', 'last_active': '2023-07-14T11:17:55.247056+0000', 'last_peered': '2023-07-14T11:17:55.247056+0000', 'last_clean': '2023-07-14T11:17:55.247056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:55.247056+0000', 'last_undegraded': '2023-07-14T11:17:55.247056+0000', 'last_fullsized': '2023-07-14T11:17:55.247056+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:18:01.599 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2d is not active+clean 2023-07-14T11:18:01.599 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:17:55.247056+0000', 'last_change': '2023-07-14T11:17:55.247056+0000', 'last_active': '2023-07-14T11:17:55.247056+0000', 'last_peered': '2023-07-14T11:17:55.247056+0000', 'last_clean': '2023-07-14T11:17:55.247056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:55.247056+0000', 'last_undegraded': '2023-07-14T11:17:55.247056+0000', 'last_fullsized': '2023-07-14T11:17:55.247056+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:18:01.600 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2c is not active+clean 2023-07-14T11:18:01.600 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:17:55.247056+0000', 'last_change': '2023-07-14T11:17:55.247056+0000', 'last_active': '2023-07-14T11:17:55.247056+0000', 'last_peered': '2023-07-14T11:17:55.247056+0000', 'last_clean': '2023-07-14T11:17:55.247056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:55.247056+0000', 'last_undegraded': '2023-07-14T11:17:55.247056+0000', 'last_fullsized': '2023-07-14T11:17:55.247056+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:18:01.600 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2b is not active+clean 2023-07-14T11:18:01.601 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:17:55.247056+0000', 'last_change': '2023-07-14T11:17:55.247056+0000', 'last_active': '2023-07-14T11:17:55.247056+0000', 'last_peered': '2023-07-14T11:17:55.247056+0000', 'last_clean': '2023-07-14T11:17:55.247056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:55.247056+0000', 'last_undegraded': '2023-07-14T11:17:55.247056+0000', 'last_fullsized': '2023-07-14T11:17:55.247056+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:18:01.601 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2a is not active+clean 2023-07-14T11:18:01.601 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:17:55.247056+0000', 'last_change': '2023-07-14T11:17:55.247056+0000', 'last_active': '2023-07-14T11:17:55.247056+0000', 'last_peered': '2023-07-14T11:17:55.247056+0000', 'last_clean': '2023-07-14T11:17:55.247056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:55.247056+0000', 'last_undegraded': '2023-07-14T11:17:55.247056+0000', 'last_fullsized': '2023-07-14T11:17:55.247056+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:18:01.602 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.29 is not active+clean 2023-07-14T11:18:01.602 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:17:55.247056+0000', 'last_change': '2023-07-14T11:17:55.247056+0000', 'last_active': '2023-07-14T11:17:55.247056+0000', 'last_peered': '2023-07-14T11:17:55.247056+0000', 'last_clean': '2023-07-14T11:17:55.247056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:55.247056+0000', 'last_undegraded': '2023-07-14T11:17:55.247056+0000', 'last_fullsized': '2023-07-14T11:17:55.247056+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:18:01.602 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.28 is not active+clean 2023-07-14T11:18:01.603 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:17:55.247056+0000', 'last_change': '2023-07-14T11:17:55.247056+0000', 'last_active': '2023-07-14T11:17:55.247056+0000', 'last_peered': '2023-07-14T11:17:55.247056+0000', 'last_clean': '2023-07-14T11:17:55.247056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:55.247056+0000', 'last_undegraded': '2023-07-14T11:17:55.247056+0000', 'last_fullsized': '2023-07-14T11:17:55.247056+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:18:01.603 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.27 is not active+clean 2023-07-14T11:18:01.603 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:17:55.247056+0000', 'last_change': '2023-07-14T11:17:55.247056+0000', 'last_active': '2023-07-14T11:17:55.247056+0000', 'last_peered': '2023-07-14T11:17:55.247056+0000', 'last_clean': '2023-07-14T11:17:55.247056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:55.247056+0000', 'last_undegraded': '2023-07-14T11:17:55.247056+0000', 'last_fullsized': '2023-07-14T11:17:55.247056+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:18:01.604 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.26 is not active+clean 2023-07-14T11:18:01.604 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:17:55.247056+0000', 'last_change': '2023-07-14T11:17:55.247056+0000', 'last_active': '2023-07-14T11:17:55.247056+0000', 'last_peered': '2023-07-14T11:17:55.247056+0000', 'last_clean': '2023-07-14T11:17:55.247056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:55.247056+0000', 'last_undegraded': '2023-07-14T11:17:55.247056+0000', 'last_fullsized': '2023-07-14T11:17:55.247056+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:18:01.604 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.25 is not active+clean 2023-07-14T11:18:01.604 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:17:55.247056+0000', 'last_change': '2023-07-14T11:17:55.247056+0000', 'last_active': '2023-07-14T11:17:55.247056+0000', 'last_peered': '2023-07-14T11:17:55.247056+0000', 'last_clean': '2023-07-14T11:17:55.247056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:55.247056+0000', 'last_undegraded': '2023-07-14T11:17:55.247056+0000', 'last_fullsized': '2023-07-14T11:17:55.247056+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:18:01.605 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.24 is not active+clean 2023-07-14T11:18:01.605 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:17:55.247056+0000', 'last_change': '2023-07-14T11:17:55.247056+0000', 'last_active': '2023-07-14T11:17:55.247056+0000', 'last_peered': '2023-07-14T11:17:55.247056+0000', 'last_clean': '2023-07-14T11:17:55.247056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:55.247056+0000', 'last_undegraded': '2023-07-14T11:17:55.247056+0000', 'last_fullsized': '2023-07-14T11:17:55.247056+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:18:01.605 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.23 is not active+clean 2023-07-14T11:18:01.606 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:17:55.247056+0000', 'last_change': '2023-07-14T11:17:55.247056+0000', 'last_active': '2023-07-14T11:17:55.247056+0000', 'last_peered': '2023-07-14T11:17:55.247056+0000', 'last_clean': '2023-07-14T11:17:55.247056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:55.247056+0000', 'last_undegraded': '2023-07-14T11:17:55.247056+0000', 'last_fullsized': '2023-07-14T11:17:55.247056+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:18:01.606 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.22 is not active+clean 2023-07-14T11:18:01.606 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:17:55.247056+0000', 'last_change': '2023-07-14T11:17:55.247056+0000', 'last_active': '2023-07-14T11:17:55.247056+0000', 'last_peered': '2023-07-14T11:17:55.247056+0000', 'last_clean': '2023-07-14T11:17:55.247056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:55.247056+0000', 'last_undegraded': '2023-07-14T11:17:55.247056+0000', 'last_fullsized': '2023-07-14T11:17:55.247056+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:18:01.607 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.21 is not active+clean 2023-07-14T11:18:01.607 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:17:55.247056+0000', 'last_change': '2023-07-14T11:17:55.247056+0000', 'last_active': '2023-07-14T11:17:55.247056+0000', 'last_peered': '2023-07-14T11:17:55.247056+0000', 'last_clean': '2023-07-14T11:17:55.247056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:55.247056+0000', 'last_undegraded': '2023-07-14T11:17:55.247056+0000', 'last_fullsized': '2023-07-14T11:17:55.247056+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:18:01.607 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.20 is not active+clean 2023-07-14T11:18:01.607 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:17:55.247056+0000', 'last_change': '2023-07-14T11:17:55.247056+0000', 'last_active': '2023-07-14T11:17:55.247056+0000', 'last_peered': '2023-07-14T11:17:55.247056+0000', 'last_clean': '2023-07-14T11:17:55.247056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:55.247056+0000', 'last_undegraded': '2023-07-14T11:17:55.247056+0000', 'last_fullsized': '2023-07-14T11:17:55.247056+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:18:01.608 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.18 is not active+clean 2023-07-14T11:18:01.608 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:17:55.247056+0000', 'last_change': '2023-07-14T11:17:55.247056+0000', 'last_active': '2023-07-14T11:17:55.247056+0000', 'last_peered': '2023-07-14T11:17:55.247056+0000', 'last_clean': '2023-07-14T11:17:55.247056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:55.247056+0000', 'last_undegraded': '2023-07-14T11:17:55.247056+0000', 'last_fullsized': '2023-07-14T11:17:55.247056+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:18:01.608 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1f is not active+clean 2023-07-14T11:18:01.609 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 72, 'state': 'creating+peering', 'last_fresh': '2023-07-14T11:17:54.250154+0000', 'last_change': '2023-07-14T11:17:54.250154+0000', 'last_active': '2023-07-14T11:17:54.239645+0000', 'last_peered': '2023-07-14T11:17:54.239645+0000', 'last_clean': '2023-07-14T11:17:54.239645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:54.250154+0000', 'last_undegraded': '2023-07-14T11:17:54.250154+0000', 'last_fullsized': '2023-07-14T11:17:54.250154+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-14T11:18:01.609 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.19 is not active+clean 2023-07-14T11:18:01.609 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:17:55.247056+0000', 'last_change': '2023-07-14T11:17:55.247056+0000', 'last_active': '2023-07-14T11:17:55.247056+0000', 'last_peered': '2023-07-14T11:17:55.247056+0000', 'last_clean': '2023-07-14T11:17:55.247056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:55.247056+0000', 'last_undegraded': '2023-07-14T11:17:55.247056+0000', 'last_fullsized': '2023-07-14T11:17:55.247056+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:18:01.610 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1e is not active+clean 2023-07-14T11:18:01.610 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 72, 'state': 'creating+peering', 'last_fresh': '2023-07-14T11:17:54.252866+0000', 'last_change': '2023-07-14T11:17:54.252866+0000', 'last_active': '2023-07-14T11:17:54.239645+0000', 'last_peered': '2023-07-14T11:17:54.239645+0000', 'last_clean': '2023-07-14T11:17:54.239645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:54.252866+0000', 'last_undegraded': '2023-07-14T11:17:54.252866+0000', 'last_fullsized': '2023-07-14T11:17:54.252866+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T11:18:01.610 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1a is not active+clean 2023-07-14T11:18:01.611 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:17:55.247056+0000', 'last_change': '2023-07-14T11:17:55.247056+0000', 'last_active': '2023-07-14T11:17:55.247056+0000', 'last_peered': '2023-07-14T11:17:55.247056+0000', 'last_clean': '2023-07-14T11:17:55.247056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:55.247056+0000', 'last_undegraded': '2023-07-14T11:17:55.247056+0000', 'last_fullsized': '2023-07-14T11:17:55.247056+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:18:01.611 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1d is not active+clean 2023-07-14T11:18:01.611 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 72, 'state': 'creating+peering', 'last_fresh': '2023-07-14T11:17:54.253607+0000', 'last_change': '2023-07-14T11:17:54.253607+0000', 'last_active': '2023-07-14T11:17:54.239645+0000', 'last_peered': '2023-07-14T11:17:54.239645+0000', 'last_clean': '2023-07-14T11:17:54.239645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:54.253607+0000', 'last_undegraded': '2023-07-14T11:17:54.253607+0000', 'last_fullsized': '2023-07-14T11:17:54.253607+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T11:18:01.612 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1b is not active+clean 2023-07-14T11:18:01.612 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:17:55.247056+0000', 'last_change': '2023-07-14T11:17:55.247056+0000', 'last_active': '2023-07-14T11:17:55.247056+0000', 'last_peered': '2023-07-14T11:17:55.247056+0000', 'last_clean': '2023-07-14T11:17:55.247056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:55.247056+0000', 'last_undegraded': '2023-07-14T11:17:55.247056+0000', 'last_fullsized': '2023-07-14T11:17:55.247056+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:18:01.612 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1c is not active+clean 2023-07-14T11:18:01.612 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 72, 'state': 'creating+peering', 'last_fresh': '2023-07-14T11:17:54.256459+0000', 'last_change': '2023-07-14T11:17:54.256459+0000', 'last_active': '2023-07-14T11:17:54.239645+0000', 'last_peered': '2023-07-14T11:17:54.239645+0000', 'last_clean': '2023-07-14T11:17:54.239645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:54.256459+0000', 'last_undegraded': '2023-07-14T11:17:54.256459+0000', 'last_fullsized': '2023-07-14T11:17:54.256459+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-14T11:18:01.613 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1c is not active+clean 2023-07-14T11:18:01.613 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:17:55.247056+0000', 'last_change': '2023-07-14T11:17:55.247056+0000', 'last_active': '2023-07-14T11:17:55.247056+0000', 'last_peered': '2023-07-14T11:17:55.247056+0000', 'last_clean': '2023-07-14T11:17:55.247056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:55.247056+0000', 'last_undegraded': '2023-07-14T11:17:55.247056+0000', 'last_fullsized': '2023-07-14T11:17:55.247056+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:18:01.613 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1b is not active+clean 2023-07-14T11:18:01.614 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 72, 'state': 'creating+peering', 'last_fresh': '2023-07-14T11:17:54.252207+0000', 'last_change': '2023-07-14T11:17:54.252207+0000', 'last_active': '2023-07-14T11:17:54.239645+0000', 'last_peered': '2023-07-14T11:17:54.239645+0000', 'last_clean': '2023-07-14T11:17:54.239645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:54.252207+0000', 'last_undegraded': '2023-07-14T11:17:54.252207+0000', 'last_fullsized': '2023-07-14T11:17:54.252207+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-14T11:18:01.614 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1d is not active+clean 2023-07-14T11:18:01.614 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:17:55.247056+0000', 'last_change': '2023-07-14T11:17:55.247056+0000', 'last_active': '2023-07-14T11:17:55.247056+0000', 'last_peered': '2023-07-14T11:17:55.247056+0000', 'last_clean': '2023-07-14T11:17:55.247056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:55.247056+0000', 'last_undegraded': '2023-07-14T11:17:55.247056+0000', 'last_fullsized': '2023-07-14T11:17:55.247056+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:18:01.615 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1a is not active+clean 2023-07-14T11:18:01.615 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 72, 'state': 'creating+peering', 'last_fresh': '2023-07-14T11:17:54.250078+0000', 'last_change': '2023-07-14T11:17:54.250078+0000', 'last_active': '2023-07-14T11:17:54.239645+0000', 'last_peered': '2023-07-14T11:17:54.239645+0000', 'last_clean': '2023-07-14T11:17:54.239645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:54.250078+0000', 'last_undegraded': '2023-07-14T11:17:54.250078+0000', 'last_fullsized': '2023-07-14T11:17:54.250078+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T11:18:01.615 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1e is not active+clean 2023-07-14T11:18:01.616 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:17:55.247056+0000', 'last_change': '2023-07-14T11:17:55.247056+0000', 'last_active': '2023-07-14T11:17:55.247056+0000', 'last_peered': '2023-07-14T11:17:55.247056+0000', 'last_clean': '2023-07-14T11:17:55.247056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:55.247056+0000', 'last_undegraded': '2023-07-14T11:17:55.247056+0000', 'last_fullsized': '2023-07-14T11:17:55.247056+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:18:01.616 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.19 is not active+clean 2023-07-14T11:18:01.616 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 72, 'state': 'creating+peering', 'last_fresh': '2023-07-14T11:17:54.264598+0000', 'last_change': '2023-07-14T11:17:54.264598+0000', 'last_active': '2023-07-14T11:17:54.239645+0000', 'last_peered': '2023-07-14T11:17:54.239645+0000', 'last_clean': '2023-07-14T11:17:54.239645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:54.264598+0000', 'last_undegraded': '2023-07-14T11:17:54.264598+0000', 'last_fullsized': '2023-07-14T11:17:54.264598+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-14T11:18:01.617 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1f is not active+clean 2023-07-14T11:18:01.617 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:17:55.247056+0000', 'last_change': '2023-07-14T11:17:55.247056+0000', 'last_active': '2023-07-14T11:17:55.247056+0000', 'last_peered': '2023-07-14T11:17:55.247056+0000', 'last_clean': '2023-07-14T11:17:55.247056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:55.247056+0000', 'last_undegraded': '2023-07-14T11:17:55.247056+0000', 'last_fullsized': '2023-07-14T11:17:55.247056+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:18:01.617 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.18 is not active+clean 2023-07-14T11:18:01.617 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 72, 'state': 'creating+peering', 'last_fresh': '2023-07-14T11:17:54.249433+0000', 'last_change': '2023-07-14T11:17:54.249433+0000', 'last_active': '2023-07-14T11:17:54.239645+0000', 'last_peered': '2023-07-14T11:17:54.239645+0000', 'last_clean': '2023-07-14T11:17:54.239645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:54.249433+0000', 'last_undegraded': '2023-07-14T11:17:54.249433+0000', 'last_fullsized': '2023-07-14T11:17:54.249433+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-14T11:18:01.618 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.10 is not active+clean 2023-07-14T11:18:01.618 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:17:55.247056+0000', 'last_change': '2023-07-14T11:17:55.247056+0000', 'last_active': '2023-07-14T11:17:55.247056+0000', 'last_peered': '2023-07-14T11:17:55.247056+0000', 'last_clean': '2023-07-14T11:17:55.247056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:55.247056+0000', 'last_undegraded': '2023-07-14T11:17:55.247056+0000', 'last_fullsized': '2023-07-14T11:17:55.247056+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:18:01.618 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.17 is not active+clean 2023-07-14T11:18:01.619 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 72, 'state': 'creating+peering', 'last_fresh': '2023-07-14T11:17:54.253430+0000', 'last_change': '2023-07-14T11:17:54.253430+0000', 'last_active': '2023-07-14T11:17:54.239645+0000', 'last_peered': '2023-07-14T11:17:54.239645+0000', 'last_clean': '2023-07-14T11:17:54.239645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:54.253430+0000', 'last_undegraded': '2023-07-14T11:17:54.253430+0000', 'last_fullsized': '2023-07-14T11:17:54.253430+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T11:18:01.619 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.11 is not active+clean 2023-07-14T11:18:01.619 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:17:55.247056+0000', 'last_change': '2023-07-14T11:17:55.247056+0000', 'last_active': '2023-07-14T11:17:55.247056+0000', 'last_peered': '2023-07-14T11:17:55.247056+0000', 'last_clean': '2023-07-14T11:17:55.247056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:55.247056+0000', 'last_undegraded': '2023-07-14T11:17:55.247056+0000', 'last_fullsized': '2023-07-14T11:17:55.247056+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:18:01.620 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.16 is not active+clean 2023-07-14T11:18:01.620 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 72, 'state': 'creating+peering', 'last_fresh': '2023-07-14T11:17:54.250081+0000', 'last_change': '2023-07-14T11:17:54.250081+0000', 'last_active': '2023-07-14T11:17:54.239645+0000', 'last_peered': '2023-07-14T11:17:54.239645+0000', 'last_clean': '2023-07-14T11:17:54.239645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:54.250081+0000', 'last_undegraded': '2023-07-14T11:17:54.250081+0000', 'last_fullsized': '2023-07-14T11:17:54.250081+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T11:18:01.620 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.12 is not active+clean 2023-07-14T11:18:01.621 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:17:55.247056+0000', 'last_change': '2023-07-14T11:17:55.247056+0000', 'last_active': '2023-07-14T11:17:55.247056+0000', 'last_peered': '2023-07-14T11:17:55.247056+0000', 'last_clean': '2023-07-14T11:17:55.247056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:55.247056+0000', 'last_undegraded': '2023-07-14T11:17:55.247056+0000', 'last_fullsized': '2023-07-14T11:17:55.247056+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:18:01.621 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.15 is not active+clean 2023-07-14T11:18:01.621 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 72, 'state': 'creating+peering', 'last_fresh': '2023-07-14T11:17:54.250054+0000', 'last_change': '2023-07-14T11:17:54.250054+0000', 'last_active': '2023-07-14T11:17:54.239645+0000', 'last_peered': '2023-07-14T11:17:54.239645+0000', 'last_clean': '2023-07-14T11:17:54.239645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:54.250054+0000', 'last_undegraded': '2023-07-14T11:17:54.250054+0000', 'last_fullsized': '2023-07-14T11:17:54.250054+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-14T11:18:01.622 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.13 is not active+clean 2023-07-14T11:18:01.622 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:17:55.247056+0000', 'last_change': '2023-07-14T11:17:55.247056+0000', 'last_active': '2023-07-14T11:17:55.247056+0000', 'last_peered': '2023-07-14T11:17:55.247056+0000', 'last_clean': '2023-07-14T11:17:55.247056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:55.247056+0000', 'last_undegraded': '2023-07-14T11:17:55.247056+0000', 'last_fullsized': '2023-07-14T11:17:55.247056+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:18:01.622 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.14 is not active+clean 2023-07-14T11:18:01.622 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 72, 'state': 'creating+peering', 'last_fresh': '2023-07-14T11:17:54.255976+0000', 'last_change': '2023-07-14T11:17:54.255976+0000', 'last_active': '2023-07-14T11:17:54.239645+0000', 'last_peered': '2023-07-14T11:17:54.239645+0000', 'last_clean': '2023-07-14T11:17:54.239645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:54.255976+0000', 'last_undegraded': '2023-07-14T11:17:54.255976+0000', 'last_fullsized': '2023-07-14T11:17:54.255976+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-14T11:18:01.623 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.14 is not active+clean 2023-07-14T11:18:01.623 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:17:55.247056+0000', 'last_change': '2023-07-14T11:17:55.247056+0000', 'last_active': '2023-07-14T11:17:55.247056+0000', 'last_peered': '2023-07-14T11:17:55.247056+0000', 'last_clean': '2023-07-14T11:17:55.247056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:55.247056+0000', 'last_undegraded': '2023-07-14T11:17:55.247056+0000', 'last_fullsized': '2023-07-14T11:17:55.247056+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:18:01.623 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.13 is not active+clean 2023-07-14T11:18:01.624 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 72, 'state': 'creating+peering', 'last_fresh': '2023-07-14T11:17:54.250228+0000', 'last_change': '2023-07-14T11:17:54.250228+0000', 'last_active': '2023-07-14T11:17:54.239645+0000', 'last_peered': '2023-07-14T11:17:54.239645+0000', 'last_clean': '2023-07-14T11:17:54.239645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:54.250228+0000', 'last_undegraded': '2023-07-14T11:17:54.250228+0000', 'last_fullsized': '2023-07-14T11:17:54.250228+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T11:18:01.624 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.15 is not active+clean 2023-07-14T11:18:01.624 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:17:55.247056+0000', 'last_change': '2023-07-14T11:17:55.247056+0000', 'last_active': '2023-07-14T11:17:55.247056+0000', 'last_peered': '2023-07-14T11:17:55.247056+0000', 'last_clean': '2023-07-14T11:17:55.247056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:55.247056+0000', 'last_undegraded': '2023-07-14T11:17:55.247056+0000', 'last_fullsized': '2023-07-14T11:17:55.247056+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:18:01.625 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.12 is not active+clean 2023-07-14T11:18:01.625 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 72, 'state': 'creating+peering', 'last_fresh': '2023-07-14T11:17:54.252759+0000', 'last_change': '2023-07-14T11:17:54.252759+0000', 'last_active': '2023-07-14T11:17:54.239645+0000', 'last_peered': '2023-07-14T11:17:54.239645+0000', 'last_clean': '2023-07-14T11:17:54.239645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:54.252759+0000', 'last_undegraded': '2023-07-14T11:17:54.252759+0000', 'last_fullsized': '2023-07-14T11:17:54.252759+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T11:18:01.625 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.16 is not active+clean 2023-07-14T11:18:01.626 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:17:55.247056+0000', 'last_change': '2023-07-14T11:17:55.247056+0000', 'last_active': '2023-07-14T11:17:55.247056+0000', 'last_peered': '2023-07-14T11:17:55.247056+0000', 'last_clean': '2023-07-14T11:17:55.247056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:55.247056+0000', 'last_undegraded': '2023-07-14T11:17:55.247056+0000', 'last_fullsized': '2023-07-14T11:17:55.247056+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:18:01.626 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.11 is not active+clean 2023-07-14T11:18:01.626 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 72, 'state': 'creating+peering', 'last_fresh': '2023-07-14T11:17:54.249801+0000', 'last_change': '2023-07-14T11:17:54.249801+0000', 'last_active': '2023-07-14T11:17:54.239645+0000', 'last_peered': '2023-07-14T11:17:54.239645+0000', 'last_clean': '2023-07-14T11:17:54.239645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:54.249801+0000', 'last_undegraded': '2023-07-14T11:17:54.249801+0000', 'last_fullsized': '2023-07-14T11:17:54.249801+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-14T11:18:01.627 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.17 is not active+clean 2023-07-14T11:18:01.627 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:17:55.247056+0000', 'last_change': '2023-07-14T11:17:55.247056+0000', 'last_active': '2023-07-14T11:17:55.247056+0000', 'last_peered': '2023-07-14T11:17:55.247056+0000', 'last_clean': '2023-07-14T11:17:55.247056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:55.247056+0000', 'last_undegraded': '2023-07-14T11:17:55.247056+0000', 'last_fullsized': '2023-07-14T11:17:55.247056+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:18:01.627 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.10 is not active+clean 2023-07-14T11:18:01.627 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 72, 'state': 'creating+peering', 'last_fresh': '2023-07-14T11:17:54.264525+0000', 'last_change': '2023-07-14T11:17:54.264525+0000', 'last_active': '2023-07-14T11:17:54.239645+0000', 'last_peered': '2023-07-14T11:17:54.239645+0000', 'last_clean': '2023-07-14T11:17:54.239645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:54.264525+0000', 'last_undegraded': '2023-07-14T11:17:54.264525+0000', 'last_fullsized': '2023-07-14T11:17:54.264525+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-14T11:18:01.628 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.0 is not active+clean 2023-07-14T11:18:01.628 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:17:55.247056+0000', 'last_change': '2023-07-14T11:17:55.247056+0000', 'last_active': '2023-07-14T11:17:55.247056+0000', 'last_peered': '2023-07-14T11:17:55.247056+0000', 'last_clean': '2023-07-14T11:17:55.247056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:55.247056+0000', 'last_undegraded': '2023-07-14T11:17:55.247056+0000', 'last_fullsized': '2023-07-14T11:17:55.247056+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:18:01.628 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.7 is not active+clean 2023-07-14T11:18:01.629 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 72, 'state': 'creating+peering', 'last_fresh': '2023-07-14T11:17:54.250078+0000', 'last_change': '2023-07-14T11:17:54.250078+0000', 'last_active': '2023-07-14T11:17:54.239645+0000', 'last_peered': '2023-07-14T11:17:54.239645+0000', 'last_clean': '2023-07-14T11:17:54.239645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:54.250078+0000', 'last_undegraded': '2023-07-14T11:17:54.250078+0000', 'last_fullsized': '2023-07-14T11:17:54.250078+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T11:18:01.629 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1 is not active+clean 2023-07-14T11:18:01.629 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:17:55.247056+0000', 'last_change': '2023-07-14T11:17:55.247056+0000', 'last_active': '2023-07-14T11:17:55.247056+0000', 'last_peered': '2023-07-14T11:17:55.247056+0000', 'last_clean': '2023-07-14T11:17:55.247056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:55.247056+0000', 'last_undegraded': '2023-07-14T11:17:55.247056+0000', 'last_fullsized': '2023-07-14T11:17:55.247056+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:18:01.630 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.6 is not active+clean 2023-07-14T11:18:01.630 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 72, 'state': 'creating+peering', 'last_fresh': '2023-07-14T11:17:54.264599+0000', 'last_change': '2023-07-14T11:17:54.264599+0000', 'last_active': '2023-07-14T11:17:54.239645+0000', 'last_peered': '2023-07-14T11:17:54.239645+0000', 'last_clean': '2023-07-14T11:17:54.239645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:54.264599+0000', 'last_undegraded': '2023-07-14T11:17:54.264599+0000', 'last_fullsized': '2023-07-14T11:17:54.264599+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-14T11:18:01.630 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2 is not active+clean 2023-07-14T11:18:01.631 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:17:55.247056+0000', 'last_change': '2023-07-14T11:17:55.247056+0000', 'last_active': '2023-07-14T11:17:55.247056+0000', 'last_peered': '2023-07-14T11:17:55.247056+0000', 'last_clean': '2023-07-14T11:17:55.247056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:55.247056+0000', 'last_undegraded': '2023-07-14T11:17:55.247056+0000', 'last_fullsized': '2023-07-14T11:17:55.247056+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:18:01.631 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.5 is not active+clean 2023-07-14T11:18:01.631 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 72, 'state': 'creating+peering', 'last_fresh': '2023-07-14T11:17:54.252804+0000', 'last_change': '2023-07-14T11:17:54.252804+0000', 'last_active': '2023-07-14T11:17:54.239645+0000', 'last_peered': '2023-07-14T11:17:54.239645+0000', 'last_clean': '2023-07-14T11:17:54.239645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:54.252804+0000', 'last_undegraded': '2023-07-14T11:17:54.252804+0000', 'last_fullsized': '2023-07-14T11:17:54.252804+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T11:18:01.632 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3 is not active+clean 2023-07-14T11:18:01.632 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:17:55.247056+0000', 'last_change': '2023-07-14T11:17:55.247056+0000', 'last_active': '2023-07-14T11:17:55.247056+0000', 'last_peered': '2023-07-14T11:17:55.247056+0000', 'last_clean': '2023-07-14T11:17:55.247056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:55.247056+0000', 'last_undegraded': '2023-07-14T11:17:55.247056+0000', 'last_fullsized': '2023-07-14T11:17:55.247056+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:18:01.632 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.4 is not active+clean 2023-07-14T11:18:01.632 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 72, 'state': 'creating+peering', 'last_fresh': '2023-07-14T11:17:54.253203+0000', 'last_change': '2023-07-14T11:17:54.253203+0000', 'last_active': '2023-07-14T11:17:54.239645+0000', 'last_peered': '2023-07-14T11:17:54.239645+0000', 'last_clean': '2023-07-14T11:17:54.239645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:54.253203+0000', 'last_undegraded': '2023-07-14T11:17:54.253203+0000', 'last_fullsized': '2023-07-14T11:17:54.253203+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T11:18:01.633 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.4 is not active+clean 2023-07-14T11:18:01.633 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:17:55.247056+0000', 'last_change': '2023-07-14T11:17:55.247056+0000', 'last_active': '2023-07-14T11:17:55.247056+0000', 'last_peered': '2023-07-14T11:17:55.247056+0000', 'last_clean': '2023-07-14T11:17:55.247056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:55.247056+0000', 'last_undegraded': '2023-07-14T11:17:55.247056+0000', 'last_fullsized': '2023-07-14T11:17:55.247056+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:18:01.633 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3 is not active+clean 2023-07-14T11:18:01.634 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 72, 'state': 'creating+peering', 'last_fresh': '2023-07-14T11:17:54.255870+0000', 'last_change': '2023-07-14T11:17:54.255870+0000', 'last_active': '2023-07-14T11:17:54.239645+0000', 'last_peered': '2023-07-14T11:17:54.239645+0000', 'last_clean': '2023-07-14T11:17:54.239645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:54.255870+0000', 'last_undegraded': '2023-07-14T11:17:54.255870+0000', 'last_fullsized': '2023-07-14T11:17:54.255870+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-14T11:18:01.634 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.5 is not active+clean 2023-07-14T11:18:01.634 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:17:55.247056+0000', 'last_change': '2023-07-14T11:17:55.247056+0000', 'last_active': '2023-07-14T11:17:55.247056+0000', 'last_peered': '2023-07-14T11:17:55.247056+0000', 'last_clean': '2023-07-14T11:17:55.247056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:55.247056+0000', 'last_undegraded': '2023-07-14T11:17:55.247056+0000', 'last_fullsized': '2023-07-14T11:17:55.247056+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:18:01.635 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2 is not active+clean 2023-07-14T11:18:01.635 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 72, 'state': 'creating+peering', 'last_fresh': '2023-07-14T11:17:54.249476+0000', 'last_change': '2023-07-14T11:17:54.249476+0000', 'last_active': '2023-07-14T11:17:54.239645+0000', 'last_peered': '2023-07-14T11:17:54.239645+0000', 'last_clean': '2023-07-14T11:17:54.239645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:54.249476+0000', 'last_undegraded': '2023-07-14T11:17:54.249476+0000', 'last_fullsized': '2023-07-14T11:17:54.249476+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-14T11:18:01.635 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.6 is not active+clean 2023-07-14T11:18:01.636 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:17:55.247056+0000', 'last_change': '2023-07-14T11:17:55.247056+0000', 'last_active': '2023-07-14T11:17:55.247056+0000', 'last_peered': '2023-07-14T11:17:55.247056+0000', 'last_clean': '2023-07-14T11:17:55.247056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:55.247056+0000', 'last_undegraded': '2023-07-14T11:17:55.247056+0000', 'last_fullsized': '2023-07-14T11:17:55.247056+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:18:01.636 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1 is not active+clean 2023-07-14T11:18:01.636 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 72, 'state': 'creating+peering', 'last_fresh': '2023-07-14T11:17:54.255894+0000', 'last_change': '2023-07-14T11:17:54.255894+0000', 'last_active': '2023-07-14T11:17:54.239645+0000', 'last_peered': '2023-07-14T11:17:54.239645+0000', 'last_clean': '2023-07-14T11:17:54.239645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:54.255894+0000', 'last_undegraded': '2023-07-14T11:17:54.255894+0000', 'last_fullsized': '2023-07-14T11:17:54.255894+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-14T11:18:01.636 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.7 is not active+clean 2023-07-14T11:18:01.637 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:17:55.247056+0000', 'last_change': '2023-07-14T11:17:55.247056+0000', 'last_active': '2023-07-14T11:17:55.247056+0000', 'last_peered': '2023-07-14T11:17:55.247056+0000', 'last_clean': '2023-07-14T11:17:55.247056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:55.247056+0000', 'last_undegraded': '2023-07-14T11:17:55.247056+0000', 'last_fullsized': '2023-07-14T11:17:55.247056+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:18:01.637 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.0 is not active+clean 2023-07-14T11:18:01.637 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 72, 'state': 'creating+peering', 'last_fresh': '2023-07-14T11:17:54.249601+0000', 'last_change': '2023-07-14T11:17:54.249601+0000', 'last_active': '2023-07-14T11:17:54.239645+0000', 'last_peered': '2023-07-14T11:17:54.239645+0000', 'last_clean': '2023-07-14T11:17:54.239645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:54.249601+0000', 'last_undegraded': '2023-07-14T11:17:54.249601+0000', 'last_fullsized': '2023-07-14T11:17:54.249601+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-14T11:18:01.638 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.a is not active+clean 2023-07-14T11:18:01.638 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:17:55.247056+0000', 'last_change': '2023-07-14T11:17:55.247056+0000', 'last_active': '2023-07-14T11:17:55.247056+0000', 'last_peered': '2023-07-14T11:17:55.247056+0000', 'last_clean': '2023-07-14T11:17:55.247056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:55.247056+0000', 'last_undegraded': '2023-07-14T11:17:55.247056+0000', 'last_fullsized': '2023-07-14T11:17:55.247056+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:18:01.638 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.d is not active+clean 2023-07-14T11:18:01.639 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 72, 'state': 'creating+peering', 'last_fresh': '2023-07-14T11:17:54.249509+0000', 'last_change': '2023-07-14T11:17:54.249509+0000', 'last_active': '2023-07-14T11:17:54.239645+0000', 'last_peered': '2023-07-14T11:17:54.239645+0000', 'last_clean': '2023-07-14T11:17:54.239645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:54.249509+0000', 'last_undegraded': '2023-07-14T11:17:54.249509+0000', 'last_fullsized': '2023-07-14T11:17:54.249509+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-14T11:18:01.639 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.c is not active+clean 2023-07-14T11:18:01.639 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:17:55.247056+0000', 'last_change': '2023-07-14T11:17:55.247056+0000', 'last_active': '2023-07-14T11:17:55.247056+0000', 'last_peered': '2023-07-14T11:17:55.247056+0000', 'last_clean': '2023-07-14T11:17:55.247056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:55.247056+0000', 'last_undegraded': '2023-07-14T11:17:55.247056+0000', 'last_fullsized': '2023-07-14T11:17:55.247056+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:18:01.640 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.b is not active+clean 2023-07-14T11:18:01.640 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 72, 'state': 'creating+peering', 'last_fresh': '2023-07-14T11:17:54.252585+0000', 'last_change': '2023-07-14T11:17:54.252585+0000', 'last_active': '2023-07-14T11:17:54.239645+0000', 'last_peered': '2023-07-14T11:17:54.239645+0000', 'last_clean': '2023-07-14T11:17:54.239645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:54.252585+0000', 'last_undegraded': '2023-07-14T11:17:54.252585+0000', 'last_fullsized': '2023-07-14T11:17:54.252585+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T11:18:01.640 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.f is not active+clean 2023-07-14T11:18:01.640 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:17:55.247056+0000', 'last_change': '2023-07-14T11:17:55.247056+0000', 'last_active': '2023-07-14T11:17:55.247056+0000', 'last_peered': '2023-07-14T11:17:55.247056+0000', 'last_clean': '2023-07-14T11:17:55.247056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:55.247056+0000', 'last_undegraded': '2023-07-14T11:17:55.247056+0000', 'last_fullsized': '2023-07-14T11:17:55.247056+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:18:01.641 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.8 is not active+clean 2023-07-14T11:18:01.641 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 72, 'state': 'creating+peering', 'last_fresh': '2023-07-14T11:17:54.252247+0000', 'last_change': '2023-07-14T11:17:54.252247+0000', 'last_active': '2023-07-14T11:17:54.239645+0000', 'last_peered': '2023-07-14T11:17:54.239645+0000', 'last_clean': '2023-07-14T11:17:54.239645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:54.252247+0000', 'last_undegraded': '2023-07-14T11:17:54.252247+0000', 'last_fullsized': '2023-07-14T11:17:54.252247+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T11:18:01.641 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.d is not active+clean 2023-07-14T11:18:01.642 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:17:55.247056+0000', 'last_change': '2023-07-14T11:17:55.247056+0000', 'last_active': '2023-07-14T11:17:55.247056+0000', 'last_peered': '2023-07-14T11:17:55.247056+0000', 'last_clean': '2023-07-14T11:17:55.247056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:55.247056+0000', 'last_undegraded': '2023-07-14T11:17:55.247056+0000', 'last_fullsized': '2023-07-14T11:17:55.247056+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:18:01.642 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.a is not active+clean 2023-07-14T11:18:01.642 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 72, 'state': 'creating+peering', 'last_fresh': '2023-07-14T11:17:54.252294+0000', 'last_change': '2023-07-14T11:17:54.252294+0000', 'last_active': '2023-07-14T11:17:54.239645+0000', 'last_peered': '2023-07-14T11:17:54.239645+0000', 'last_clean': '2023-07-14T11:17:54.239645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:54.252294+0000', 'last_undegraded': '2023-07-14T11:17:54.252294+0000', 'last_fullsized': '2023-07-14T11:17:54.252294+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T11:18:01.643 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.e is not active+clean 2023-07-14T11:18:01.643 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:17:55.247056+0000', 'last_change': '2023-07-14T11:17:55.247056+0000', 'last_active': '2023-07-14T11:17:55.247056+0000', 'last_peered': '2023-07-14T11:17:55.247056+0000', 'last_clean': '2023-07-14T11:17:55.247056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:55.247056+0000', 'last_undegraded': '2023-07-14T11:17:55.247056+0000', 'last_fullsized': '2023-07-14T11:17:55.247056+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:18:01.643 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.9 is not active+clean 2023-07-14T11:18:01.644 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 72, 'state': 'creating+peering', 'last_fresh': '2023-07-14T11:17:54.252300+0000', 'last_change': '2023-07-14T11:17:54.252300+0000', 'last_active': '2023-07-14T11:17:54.239645+0000', 'last_peered': '2023-07-14T11:17:54.239645+0000', 'last_clean': '2023-07-14T11:17:54.239645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:54.252300+0000', 'last_undegraded': '2023-07-14T11:17:54.252300+0000', 'last_fullsized': '2023-07-14T11:17:54.252300+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T11:18:01.644 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.b is not active+clean 2023-07-14T11:18:01.644 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:17:55.247056+0000', 'last_change': '2023-07-14T11:17:55.247056+0000', 'last_active': '2023-07-14T11:17:55.247056+0000', 'last_peered': '2023-07-14T11:17:55.247056+0000', 'last_clean': '2023-07-14T11:17:55.247056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:55.247056+0000', 'last_undegraded': '2023-07-14T11:17:55.247056+0000', 'last_fullsized': '2023-07-14T11:17:55.247056+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:18:01.645 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.c is not active+clean 2023-07-14T11:18:01.645 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 72, 'state': 'creating+peering', 'last_fresh': '2023-07-14T11:17:54.249980+0000', 'last_change': '2023-07-14T11:17:54.249980+0000', 'last_active': '2023-07-14T11:17:54.239645+0000', 'last_peered': '2023-07-14T11:17:54.239645+0000', 'last_clean': '2023-07-14T11:17:54.239645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:54.249980+0000', 'last_undegraded': '2023-07-14T11:17:54.249980+0000', 'last_fullsized': '2023-07-14T11:17:54.249980+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-14T11:18:01.645 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.8 is not active+clean 2023-07-14T11:18:01.645 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:17:55.247056+0000', 'last_change': '2023-07-14T11:17:55.247056+0000', 'last_active': '2023-07-14T11:17:55.247056+0000', 'last_peered': '2023-07-14T11:17:55.247056+0000', 'last_clean': '2023-07-14T11:17:55.247056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:55.247056+0000', 'last_undegraded': '2023-07-14T11:17:55.247056+0000', 'last_fullsized': '2023-07-14T11:17:55.247056+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:18:01.646 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.f is not active+clean 2023-07-14T11:18:01.646 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 72, 'state': 'creating+peering', 'last_fresh': '2023-07-14T11:17:54.253922+0000', 'last_change': '2023-07-14T11:17:54.253922+0000', 'last_active': '2023-07-14T11:17:54.239645+0000', 'last_peered': '2023-07-14T11:17:54.239645+0000', 'last_clean': '2023-07-14T11:17:54.239645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:54.253922+0000', 'last_undegraded': '2023-07-14T11:17:54.253922+0000', 'last_fullsized': '2023-07-14T11:17:54.253922+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T11:18:01.646 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.9 is not active+clean 2023-07-14T11:18:01.647 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:17:55.247056+0000', 'last_change': '2023-07-14T11:17:55.247056+0000', 'last_active': '2023-07-14T11:17:55.247056+0000', 'last_peered': '2023-07-14T11:17:55.247056+0000', 'last_clean': '2023-07-14T11:17:55.247056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:55.247056+0000', 'last_undegraded': '2023-07-14T11:17:55.247056+0000', 'last_fullsized': '2023-07-14T11:17:55.247056+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:55.247056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:18:01.647 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.e is not active+clean 2023-07-14T11:18:01.647 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 72, 'state': 'creating+peering', 'last_fresh': '2023-07-14T11:17:54.252236+0000', 'last_change': '2023-07-14T11:17:54.252236+0000', 'last_active': '2023-07-14T11:17:54.239645+0000', 'last_peered': '2023-07-14T11:17:54.239645+0000', 'last_clean': '2023-07-14T11:17:54.239645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:17:54.252236+0000', 'last_undegraded': '2023-07-14T11:17:54.252236+0000', 'last_fullsized': '2023-07-14T11:17:54.252236+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'last_clean_scrub_stamp': '2023-07-14T11:17:54.239645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-14T11:18:01.648 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-07-14T11:18:01.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.842+0000 7fdd373ff700 1 Processor -- start 2023-07-14T11:18:01.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.842+0000 7fdd373ff700 1 -- start start 2023-07-14T11:18:01.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.843+0000 7fdd373ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdd301500d0 0x7fdd30070350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:01.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.843+0000 7fdd373ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fdd30070890 0x7fdd301597c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:01.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.843+0000 7fdd373ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd300cdf90 con 0x7fdd30159d00 2023-07-14T11:18:01.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.843+0000 7fdd373ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd3015a2f0 con 0x7fdd301500d0 2023-07-14T11:18:01.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.843+0000 7fdd373ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd3015a5d0 con 0x7fdd30070890 2023-07-14T11:18:01.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.844+0000 7fdd3519b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdd301500d0 0x7fdd30070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:01.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.844+0000 7fdd3599c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fdd30159d00 0x7fdd300cea50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:59510/0 (socket says 172.21.15.84:59510) 2023-07-14T11:18:01.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.844+0000 7fdd3599c700 1 -- 172.21.15.84:0/2899506822 learned_addr learned my addr 172.21.15.84:0/2899506822 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:18:01.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.844+0000 7fdd3499a700 1 --2- 172.21.15.84:0/2899506822 >> v2:172.21.15.179:3300/0 conn(0x7fdd30070890 0x7fdd301597c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:01.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.844+0000 7fdd3519b700 1 -- 172.21.15.84:0/2899506822 >> v2:172.21.15.179:3300/0 conn(0x7fdd30070890 msgr2=0x7fdd301597c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:01.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.844+0000 7fdd3519b700 1 --2- 172.21.15.84:0/2899506822 >> v2:172.21.15.179:3300/0 conn(0x7fdd30070890 0x7fdd301597c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:01.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.844+0000 7fdd3519b700 1 -- 172.21.15.84:0/2899506822 >> v1:172.21.15.84:6789/0 conn(0x7fdd30159d00 legacy=0x7fdd300cea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:01.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.844+0000 7fdd3519b700 1 -- 172.21.15.84:0/2899506822 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd300ce250 con 0x7fdd301500d0 2023-07-14T11:18:01.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.844+0000 7fdd27fff700 1 -- 172.21.15.84:0/2899506822 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2243482061 0 0) 0x7fdd300cdf90 con 0x7fdd30159d00 2023-07-14T11:18:01.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.844+0000 7fdd3519b700 1 --2- 172.21.15.84:0/2899506822 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd301500d0 0x7fdd30070350 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fdd3006f970 tx=0x7fdd2c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b53fd82a1021106 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:01.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.845+0000 7fdd27fff700 1 -- 172.21.15.84:0/2899506822 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd2c011830 con 0x7fdd301500d0 2023-07-14T11:18:01.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.845+0000 7fdd27fff700 1 -- 172.21.15.84:0/2899506822 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd2c011990 con 0x7fdd301500d0 2023-07-14T11:18:01.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.845+0000 7fdd27fff700 1 -- 172.21.15.84:0/2899506822 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd2c011d20 con 0x7fdd301500d0 2023-07-14T11:18:01.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.845+0000 7fdd373ff700 1 -- 172.21.15.84:0/2899506822 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd301500d0 msgr2=0x7fdd30070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:01.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.845+0000 7fdd373ff700 1 --2- 172.21.15.84:0/2899506822 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd301500d0 0x7fdd30070350 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fdd3006f970 tx=0x7fdd2c009b20 comp rx=0 tx=0).stop 2023-07-14T11:18:01.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.845+0000 7fdd373ff700 1 -- 172.21.15.84:0/2899506822 shutdown_connections 2023-07-14T11:18:01.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.845+0000 7fdd373ff700 1 --2- 172.21.15.84:0/2899506822 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd301500d0 0x7fdd30070350 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:01.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.845+0000 7fdd373ff700 1 --2- 172.21.15.84:0/2899506822 >> v2:172.21.15.179:3300/0 conn(0x7fdd30070890 0x7fdd301597c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:01.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.845+0000 7fdd373ff700 1 -- 172.21.15.84:0/2899506822 >> 172.21.15.84:0/2899506822 conn(0x7fdd30069f30 msgr2=0x7fdd3006a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:01.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.845+0000 7fdd373ff700 1 -- 172.21.15.84:0/2899506822 shutdown_connections 2023-07-14T11:18:01.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.845+0000 7fdd373ff700 1 -- 172.21.15.84:0/2899506822 wait complete. 2023-07-14T11:18:01.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.847+0000 7fdd373ff700 1 Processor -- start 2023-07-14T11:18:01.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.847+0000 7fdd373ff700 1 -- start start 2023-07-14T11:18:01.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.848+0000 7fdd373ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd30070890 0x7fdd3006d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:01.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.848+0000 7fdd373ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd301500d0 0x7fdd300ccd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:01.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.848+0000 7fdd373ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd30159d00 0x7fdd3013c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:01.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.848+0000 7fdd373ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd3014a2e0 con 0x7fdd30070890 2023-07-14T11:18:01.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.848+0000 7fdd373ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd3014a5c0 con 0x7fdd301500d0 2023-07-14T11:18:01.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.848+0000 7fdd373ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd3014a8a0 con 0x7fdd30159d00 2023-07-14T11:18:01.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.848+0000 7fdd3519b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd30070890 0x7fdd3006d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:01.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.848+0000 7fdd3519b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd30070890 0x7fdd3006d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36552/0 (socket says 172.21.15.84:36552) 2023-07-14T11:18:01.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.848+0000 7fdd3519b700 1 -- 172.21.15.84:0/3004682412 learned_addr learned my addr 172.21.15.84:0/3004682412 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:01.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.848+0000 7fdd3499a700 1 --2- 172.21.15.84:0/3004682412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd301500d0 0x7fdd300ccd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:01.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.848+0000 7fdd3599c700 1 --2- 172.21.15.84:0/3004682412 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd30159d00 0x7fdd3013c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:01.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.849+0000 7fdd3519b700 1 -- 172.21.15.84:0/3004682412 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd30159d00 msgr2=0x7fdd3013c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:01.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.849+0000 7fdd3519b700 1 --2- 172.21.15.84:0/3004682412 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd30159d00 0x7fdd3013c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:01.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.849+0000 7fdd3519b700 1 -- 172.21.15.84:0/3004682412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd301500d0 msgr2=0x7fdd300ccd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:01.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.849+0000 7fdd3519b700 1 --2- 172.21.15.84:0/3004682412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd301500d0 0x7fdd300ccd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:01.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.849+0000 7fdd3519b700 1 -- 172.21.15.84:0/3004682412 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd2c0094a0 con 0x7fdd30070890 2023-07-14T11:18:01.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.849+0000 7fdd3599c700 1 --2- 172.21.15.84:0/3004682412 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd30159d00 0x7fdd3013c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:18:01.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.849+0000 7fdd3519b700 1 --2- 172.21.15.84:0/3004682412 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd30070890 0x7fdd3006d070 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c000c00 tx=0x7fdd2c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:01.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.849+0000 7fdd25ffb700 1 -- 172.21.15.84:0/3004682412 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd2c0036a0 con 0x7fdd30070890 2023-07-14T11:18:01.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.849+0000 7fdd25ffb700 1 -- 172.21.15.84:0/3004682412 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd2c01f070 con 0x7fdd30070890 2023-07-14T11:18:01.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.849+0000 7fdd25ffb700 1 -- 172.21.15.84:0/3004682412 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd2c003a60 con 0x7fdd30070890 2023-07-14T11:18:01.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.849+0000 7fdd373ff700 1 -- 172.21.15.84:0/3004682412 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd3014ab80 con 0x7fdd30070890 2023-07-14T11:18:01.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.849+0000 7fdd373ff700 1 -- 172.21.15.84:0/3004682412 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd3006d5b0 con 0x7fdd30070890 2023-07-14T11:18:01.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.850+0000 7fdd373ff700 1 -- 172.21.15.84:0/3004682412 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd3014a420 con 0x7fdd30070890 2023-07-14T11:18:01.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.851+0000 7fdd25ffb700 1 -- 172.21.15.84:0/3004682412 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7fdd2c003bc0 con 0x7fdd30070890 2023-07-14T11:18:01.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.852+0000 7fdd25ffb700 1 --2- 172.21.15.84:0/3004682412 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fdd1406b040 0x7fdd1406d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:01.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.852+0000 7fdd25ffb700 1 -- 172.21.15.84:0/3004682412 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdd2c021070 con 0x7fdd30070890 2023-07-14T11:18:01.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.852+0000 7fdd3499a700 1 --2- 172.21.15.84:0/3004682412 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fdd1406b040 0x7fdd1406d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:01.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.853+0000 7fdd3499a700 1 --2- 172.21.15.84:0/3004682412 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fdd1406b040 0x7fdd1406d4f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fdd30158360 tx=0x7fdd20008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:01.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:01.857+0000 7fdd25ffb700 1 -- 172.21.15.84:0/3004682412 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fdd3014a420 con 0x7fdd30070890 2023-07-14T11:18:02.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.126+0000 7fdd373ff700 1 -- 172.21.15.84:0/3004682412 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fdd3014a420 con 0x7fdd30070890 2023-07-14T11:18:02.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.127+0000 7fdd25ffb700 1 -- 172.21.15.84:0/3004682412 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1109 (secure 0 0 0) 0x7fdd3014a420 con 0x7fdd30070890 2023-07-14T11:18:02.131 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:18:02.131 INFO:teuthology.orchestra.run.smithi084.stdout:{"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":315,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":75,"num_osds":8,"num_up_osds":8,"osd_up_since":1689333179,"num_in_osds":8,"osd_in_since":1689333170,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":9}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":228978688,"bytes_avail":772865134592,"bytes_total":773094113280,"unknown_pgs_ratio":0.60952383279800415,"inactive_pgs_ratio":0.30476191639900208},"fsmap":{"epoch":45,"id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"c","status":"up:active","gid":6690}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":8,"modified":"2023-07-14T11:16:18.110532+0000","services":{}},"progress_events":{}} 2023-07-14T11:18:02.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.129+0000 7fdd373ff700 1 -- 172.21.15.84:0/3004682412 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fdd1406b040 msgr2=0x7fdd1406d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:02.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.129+0000 7fdd373ff700 1 --2- 172.21.15.84:0/3004682412 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fdd1406b040 0x7fdd1406d4f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fdd30158360 tx=0x7fdd20008040 comp rx=0 tx=0).stop 2023-07-14T11:18:02.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.129+0000 7fdd373ff700 1 -- 172.21.15.84:0/3004682412 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd30070890 msgr2=0x7fdd3006d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:02.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.129+0000 7fdd373ff700 1 --2- 172.21.15.84:0/3004682412 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd30070890 0x7fdd3006d070 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c000c00 tx=0x7fdd2c004750 comp rx=0 tx=0).stop 2023-07-14T11:18:02.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.129+0000 7fdd373ff700 1 -- 172.21.15.84:0/3004682412 shutdown_connections 2023-07-14T11:18:02.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.129+0000 7fdd373ff700 1 --2- 172.21.15.84:0/3004682412 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fdd1406b040 0x7fdd1406d4f0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:02.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.129+0000 7fdd373ff700 1 --2- 172.21.15.84:0/3004682412 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd30159d00 0x7fdd3013c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:02.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.129+0000 7fdd373ff700 1 --2- 172.21.15.84:0/3004682412 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd30070890 0x7fdd3006d070 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:02.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.129+0000 7fdd373ff700 1 --2- 172.21.15.84:0/3004682412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd301500d0 0x7fdd300ccd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:02.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.129+0000 7fdd373ff700 1 -- 172.21.15.84:0/3004682412 >> 172.21.15.84:0/3004682412 conn(0x7fdd30069f30 msgr2=0x7fdd301504a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:02.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.129+0000 7fdd373ff700 1 -- 172.21.15.84:0/3004682412 shutdown_connections 2023-07-14T11:18:02.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.129+0000 7fdd373ff700 1 -- 172.21.15.84:0/3004682412 wait complete. 2023-07-14T11:18:02.151 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-07-14T11:18:02.151 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T11:18:02.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.343+0000 7ff2f61ff700 1 Processor -- start 2023-07-14T11:18:02.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.343+0000 7ff2f61ff700 1 -- start start 2023-07-14T11:18:02.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.344+0000 7ff2f61ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff2f006a640 0x7ff2f0071580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:02.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.344+0000 7ff2f61ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2f00ae890 con 0x7ff2f0070d10 2023-07-14T11:18:02.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.344+0000 7ff2f61ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2f00ce9f0 con 0x7ff2f00ae4c0 2023-07-14T11:18:02.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.344+0000 7ff2f61ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2f0071130 con 0x7ff2f006a640 2023-07-14T11:18:02.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.344+0000 7ff2effff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7ff2f0070d10 0x7ff2f00ac860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:59526/0 (socket says 172.21.15.84:59526) 2023-07-14T11:18:02.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.344+0000 7ff2effff700 1 -- 172.21.15.84:0/1162271381 learned_addr learned my addr 172.21.15.84:0/1162271381 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:18:02.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.345+0000 7ff2e7fff700 1 --2- 172.21.15.84:0/1162271381 >> v2:172.21.15.179:3300/0 conn(0x7ff2f006a640 0x7ff2f0071580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:02.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.345+0000 7ff2eeffd700 1 -- 172.21.15.84:0/1162271381 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 463798282 0 0) 0x7ff2f00ae890 con 0x7ff2f0070d10 2023-07-14T11:18:02.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.345+0000 7ff2eeffd700 1 -- 172.21.15.84:0/1162271381 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2dc0035b0 con 0x7ff2f0070d10 2023-07-14T11:18:02.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.345+0000 7ff2eeffd700 1 -- 172.21.15.84:0/1162271381 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2354246265 0 0) 0x7ff2dc0035b0 con 0x7ff2f0070d10 2023-07-14T11:18:02.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.345+0000 7ff2eeffd700 1 -- 172.21.15.84:0/1162271381 >> v2:172.21.15.179:3300/0 conn(0x7ff2f006a640 msgr2=0x7ff2f0071580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:02.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.345+0000 7ff2eeffd700 1 --2- 172.21.15.84:0/1162271381 >> v2:172.21.15.179:3300/0 conn(0x7ff2f006a640 0x7ff2f0071580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:02.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.345+0000 7ff2eeffd700 1 -- 172.21.15.84:0/1162271381 >> v1:172.21.15.179:6789/0 conn(0x7ff2f00ae4c0 legacy=0x7ff2f0069f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:02.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.345+0000 7ff2eeffd700 1 -- 172.21.15.84:0/1162271381 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2f00cecd0 con 0x7ff2f0070d10 2023-07-14T11:18:02.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.345+0000 7ff2eeffd700 1 -- 172.21.15.84:0/1162271381 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7ff2e80019f0 con 0x7ff2f0070d10 2023-07-14T11:18:02.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.345+0000 7ff2eeffd700 1 -- 172.21.15.84:0/1162271381 >> v1:172.21.15.84:6789/0 conn(0x7ff2f0070d10 legacy=0x7ff2f00ac860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:02.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.345+0000 7ff2eeffd700 1 --2- 172.21.15.84:0/1162271381 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2dc003a00 0x7ff2dc003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:02.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.345+0000 7ff2eeffd700 1 --2- 172.21.15.84:0/1162271381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2dc004850 0x7ff2dc004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:02.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.345+0000 7ff2eeffd700 1 --2- 172.21.15.84:0/1162271381 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2dc005200 0x7ff2dc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:02.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.345+0000 7ff2eeffd700 1 -- 172.21.15.84:0/1162271381 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f0071130 con 0x7ff2dc004850 2023-07-14T11:18:02.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.345+0000 7ff2eeffd700 1 -- 172.21.15.84:0/1162271381 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2dc00c080 con 0x7ff2dc003a00 2023-07-14T11:18:02.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.345+0000 7ff2eeffd700 1 -- 172.21.15.84:0/1162271381 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2dc00c240 con 0x7ff2dc005200 2023-07-14T11:18:02.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.345+0000 7ff2e7fff700 1 --2- 172.21.15.84:0/1162271381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2dc004850 0x7ff2dc004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:02.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.346+0000 7ff2ef7fe700 1 --2- 172.21.15.84:0/1162271381 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2dc003a00 0x7ff2dc003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:02.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.346+0000 7ff2effff700 1 --2- 172.21.15.84:0/1162271381 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2dc005200 0x7ff2dc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:02.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.346+0000 7ff2e7fff700 1 -- 172.21.15.84:0/1162271381 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2dc005200 msgr2=0x7ff2dc00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:02.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.346+0000 7ff2e7fff700 1 --2- 172.21.15.84:0/1162271381 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2dc005200 0x7ff2dc00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:02.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.346+0000 7ff2e7fff700 1 -- 172.21.15.84:0/1162271381 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2dc003a00 msgr2=0x7ff2dc003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:02.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.346+0000 7ff2e7fff700 1 --2- 172.21.15.84:0/1162271381 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2dc003a00 0x7ff2dc003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:02.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.346+0000 7ff2e7fff700 1 -- 172.21.15.84:0/1162271381 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2dc0035b0 con 0x7ff2dc004850 2023-07-14T11:18:02.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.346+0000 7ff2ef7fe700 1 --2- 172.21.15.84:0/1162271381 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2dc003a00 0x7ff2dc003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:18:02.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.346+0000 7ff2effff700 1 -- 172.21.15.84:0/1162271381 reap_dead start 2023-07-14T11:18:02.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.346+0000 7ff2e7fff700 1 --2- 172.21.15.84:0/1162271381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2dc004850 0x7ff2dc004cc0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7ff2d8009b30 tx=0x7ff2dc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c06c0c48e98a4b3 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:02.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.346+0000 7ff2eeffd700 1 -- 172.21.15.84:0/1162271381 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d800e6c0 con 0x7ff2dc004850 2023-07-14T11:18:02.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.346+0000 7ff2eeffd700 1 -- 172.21.15.84:0/1162271381 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2d800e820 con 0x7ff2dc004850 2023-07-14T11:18:02.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.346+0000 7ff2eeffd700 1 -- 172.21.15.84:0/1162271381 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d800eb90 con 0x7ff2dc004850 2023-07-14T11:18:02.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.347+0000 7ff2f61ff700 1 -- 172.21.15.84:0/1162271381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2dc004850 msgr2=0x7ff2dc004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:02.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.347+0000 7ff2f61ff700 1 --2- 172.21.15.84:0/1162271381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2dc004850 0x7ff2dc004cc0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7ff2d8009b30 tx=0x7ff2dc005880 comp rx=0 tx=0).stop 2023-07-14T11:18:02.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.347+0000 7ff2f61ff700 1 -- 172.21.15.84:0/1162271381 shutdown_connections 2023-07-14T11:18:02.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.347+0000 7ff2f61ff700 1 --2- 172.21.15.84:0/1162271381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2dc004850 0x7ff2dc004cc0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:02.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.347+0000 7ff2f61ff700 1 -- 172.21.15.84:0/1162271381 >> 172.21.15.84:0/1162271381 conn(0x7ff2f00b16c0 msgr2=0x7ff2f00b1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:02.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.347+0000 7ff2f61ff700 1 -- 172.21.15.84:0/1162271381 shutdown_connections 2023-07-14T11:18:02.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.347+0000 7ff2f61ff700 1 -- 172.21.15.84:0/1162271381 wait complete. 2023-07-14T11:18:02.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.349+0000 7ff2f61ff700 1 Processor -- start 2023-07-14T11:18:02.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.349+0000 7ff2f61ff700 1 -- start start 2023-07-14T11:18:02.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.350+0000 7ff2f61ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2dc004850 0x7ff2f015e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:02.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.350+0000 7ff2f61ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2f00b56a0 0x7ff2f01e5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:02.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.350+0000 7ff2f61ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2f0151000 0x7ff2f01e5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:02.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.350+0000 7ff2f61ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f01e63e0 con 0x7ff2dc004850 2023-07-14T11:18:02.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.350+0000 7ff2f61ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f015f560 con 0x7ff2f0151000 2023-07-14T11:18:02.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.350+0000 7ff2f61ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f015efa0 con 0x7ff2f00b56a0 2023-07-14T11:18:02.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.350+0000 7ff2ef7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2dc004850 0x7ff2f015e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:02.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.350+0000 7ff2ef7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2dc004850 0x7ff2f015e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36562/0 (socket says 172.21.15.84:36562) 2023-07-14T11:18:02.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.350+0000 7ff2ef7fe700 1 -- 172.21.15.84:0/3356443718 learned_addr learned my addr 172.21.15.84:0/3356443718 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:02.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.350+0000 7ff2effff700 1 --2- 172.21.15.84:0/3356443718 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2f0151000 0x7ff2f01e5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:02.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.350+0000 7ff2e7fff700 1 --2- 172.21.15.84:0/3356443718 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2f00b56a0 0x7ff2f01e5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:02.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.350+0000 7ff2ef7fe700 1 -- 172.21.15.84:0/3356443718 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2f00b56a0 msgr2=0x7ff2f01e5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:02.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.350+0000 7ff2ef7fe700 1 --2- 172.21.15.84:0/3356443718 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2f00b56a0 0x7ff2f01e5960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:02.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.350+0000 7ff2ef7fe700 1 -- 172.21.15.84:0/3356443718 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2f0151000 msgr2=0x7ff2f01e5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:02.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.350+0000 7ff2ef7fe700 1 --2- 172.21.15.84:0/3356443718 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2f0151000 0x7ff2f01e5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:02.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.350+0000 7ff2ef7fe700 1 -- 172.21.15.84:0/3356443718 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2f015f280 con 0x7ff2dc004850 2023-07-14T11:18:02.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.350+0000 7ff2e7fff700 1 --2- 172.21.15.84:0/3356443718 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2f00b56a0 0x7ff2f01e5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:18:02.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.351+0000 7ff2ef7fe700 1 --2- 172.21.15.84:0/3356443718 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2dc004850 0x7ff2f015e650 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7ff2e000e550 tx=0x7ff2e000e910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:02.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.351+0000 7ff2ecff9700 1 -- 172.21.15.84:0/3356443718 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e00052e0 con 0x7ff2dc004850 2023-07-14T11:18:02.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.351+0000 7ff2ecff9700 1 -- 172.21.15.84:0/3356443718 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e0005440 con 0x7ff2dc004850 2023-07-14T11:18:02.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.351+0000 7ff2ecff9700 1 -- 172.21.15.84:0/3356443718 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e00038c0 con 0x7ff2dc004850 2023-07-14T11:18:02.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.351+0000 7ff2f61ff700 1 -- 172.21.15.84:0/3356443718 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2f00b3050 con 0x7ff2dc004850 2023-07-14T11:18:02.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.351+0000 7ff2f61ff700 1 -- 172.21.15.84:0/3356443718 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2f015eb90 con 0x7ff2dc004850 2023-07-14T11:18:02.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.352+0000 7ff2f61ff700 1 -- 172.21.15.84:0/3356443718 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2f00b36a0 con 0x7ff2dc004850 2023-07-14T11:18:02.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.353+0000 7ff2ecff9700 1 -- 172.21.15.84:0/3356443718 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7ff2e0003a20 con 0x7ff2dc004850 2023-07-14T11:18:02.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.354+0000 7ff2ecff9700 1 --2- 172.21.15.84:0/3356443718 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff2d006b040 0x7ff2d006d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:02.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.354+0000 7ff2ecff9700 1 -- 172.21.15.84:0/3356443718 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff2e00890f0 con 0x7ff2dc004850 2023-07-14T11:18:02.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.354+0000 7ff2e7fff700 1 --2- 172.21.15.84:0/3356443718 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff2d006b040 0x7ff2d006d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:02.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.355+0000 7ff2e7fff700 1 --2- 172.21.15.84:0/3356443718 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff2d006b040 0x7ff2d006d4f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ff2f01f5790 tx=0x7ff2d8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:02.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.358+0000 7ff2ecff9700 1 -- 172.21.15.84:0/3356443718 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ff2e0053e00 con 0x7ff2dc004850 2023-07-14T11:18:02.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.548+0000 7ff2f61ff700 1 -- 172.21.15.84:0/3356443718 --> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff2f00cefb0 con 0x7ff2d006b040 2023-07-14T11:18:02.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.556+0000 7ff2ecff9700 1 -- 172.21.15.84:0/3356443718 <== mgr.4104 v2:172.21.15.84:6832/379617029 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311106 (secure 0 0 0) 0x7ff2d800ea10 con 0x7ff2d006b040 2023-07-14T11:18:02.563 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:18:02.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.561+0000 7ff2f61ff700 1 -- 172.21.15.84:0/3356443718 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff2d006b040 msgr2=0x7ff2d006d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:02.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.561+0000 7ff2f61ff700 1 --2- 172.21.15.84:0/3356443718 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff2d006b040 0x7ff2d006d4f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ff2f01f5790 tx=0x7ff2d8008030 comp rx=0 tx=0).stop 2023-07-14T11:18:02.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.561+0000 7ff2f61ff700 1 -- 172.21.15.84:0/3356443718 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2dc004850 msgr2=0x7ff2f015e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:02.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.561+0000 7ff2f61ff700 1 --2- 172.21.15.84:0/3356443718 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2dc004850 0x7ff2f015e650 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7ff2e000e550 tx=0x7ff2e000e910 comp rx=0 tx=0).stop 2023-07-14T11:18:02.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.561+0000 7ff2f61ff700 1 -- 172.21.15.84:0/3356443718 shutdown_connections 2023-07-14T11:18:02.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.561+0000 7ff2f61ff700 1 --2- 172.21.15.84:0/3356443718 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2f0151000 0x7ff2f01e5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:02.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.561+0000 7ff2f61ff700 1 --2- 172.21.15.84:0/3356443718 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2dc004850 0x7ff2f015e650 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:02.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.561+0000 7ff2f61ff700 1 --2- 172.21.15.84:0/3356443718 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff2d006b040 0x7ff2d006d4f0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:02.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.561+0000 7ff2f61ff700 1 --2- 172.21.15.84:0/3356443718 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2f00b56a0 0x7ff2f01e5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:02.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.561+0000 7ff2f61ff700 1 -- 172.21.15.84:0/3356443718 >> 172.21.15.84:0/3356443718 conn(0x7ff2f00b16c0 msgr2=0x7ff2f00b0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:02.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.561+0000 7ff2f61ff700 1 -- 172.21.15.84:0/3356443718 shutdown_connections 2023-07-14T11:18:02.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:02.561+0000 7ff2f61ff700 1 -- 172.21.15.84:0/3356443718 wait complete. 2023-07-14T11:18:02.567 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-07-14T11:18:02.582 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":219,"stamp":"2023-07-14T11:18:02.133565+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":197,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223976,"kb_used_data":8360,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754750744,"statfs":{"total":773094113280,"available":772864761856,"internally_reserved":0,"allocated":8560640,"data_stored":4450260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.879443"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.270851+0000","last_change":"2023-07-14T11:17:56.278047+0000","last_active":"2023-07-14T11:17:57.270851+0000","last_peered":"2023-07-14T11:17:57.270851+0000","last_clean":"2023-07-14T11:17:57.270851+0000","last_became_active":"2023-07-14T11:17:56.277754+0000","last_became_peered":"2023-07-14T11:17:56.277754+0000","last_unstale":"2023-07-14T11:17:57.270851+0000","last_undegraded":"2023-07-14T11:17:57.270851+0000","last_fullsized":"2023-07-14T11:17:57.270851+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:05:06.697870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.432586+0000","last_change":"2023-07-14T11:17:56.295058+0000","last_active":"2023-07-14T11:17:57.432586+0000","last_peered":"2023-07-14T11:17:57.432586+0000","last_clean":"2023-07-14T11:17:57.432586+0000","last_became_active":"2023-07-14T11:17:56.294812+0000","last_became_peered":"2023-07-14T11:17:56.294812+0000","last_unstale":"2023-07-14T11:17:57.432586+0000","last_undegraded":"2023-07-14T11:17:57.432586+0000","last_fullsized":"2023-07-14T11:17:57.432586+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:18:17.091451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.269094+0000","last_change":"2023-07-14T11:17:56.296902+0000","last_active":"2023-07-14T11:17:57.269094+0000","last_peered":"2023-07-14T11:17:57.269094+0000","last_clean":"2023-07-14T11:17:57.269094+0000","last_became_active":"2023-07-14T11:17:56.296632+0000","last_became_peered":"2023-07-14T11:17:56.296632+0000","last_unstale":"2023-07-14T11:17:57.269094+0000","last_undegraded":"2023-07-14T11:17:57.269094+0000","last_fullsized":"2023-07-14T11:17:57.269094+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:28:02.434633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.433450+0000","last_change":"2023-07-14T11:17:56.265557+0000","last_active":"2023-07-14T11:17:57.433450+0000","last_peered":"2023-07-14T11:17:57.433450+0000","last_clean":"2023-07-14T11:17:57.433450+0000","last_became_active":"2023-07-14T11:17:56.265276+0000","last_became_peered":"2023-07-14T11:17:56.265276+0000","last_unstale":"2023-07-14T11:17:57.433450+0000","last_undegraded":"2023-07-14T11:17:57.433450+0000","last_fullsized":"2023-07-14T11:17:57.433450+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:52:32.334837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.270039+0000","last_change":"2023-07-14T11:17:56.278573+0000","last_active":"2023-07-14T11:17:57.270039+0000","last_peered":"2023-07-14T11:17:57.270039+0000","last_clean":"2023-07-14T11:17:57.270039+0000","last_became_active":"2023-07-14T11:17:56.278319+0000","last_became_peered":"2023-07-14T11:17:56.278319+0000","last_unstale":"2023-07-14T11:17:57.270039+0000","last_undegraded":"2023-07-14T11:17:57.270039+0000","last_fullsized":"2023-07-14T11:17:57.270039+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:18:17.785724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.433562+0000","last_change":"2023-07-14T11:17:56.279620+0000","last_active":"2023-07-14T11:17:57.433562+0000","last_peered":"2023-07-14T11:17:57.433562+0000","last_clean":"2023-07-14T11:17:57.433562+0000","last_became_active":"2023-07-14T11:17:56.279106+0000","last_became_peered":"2023-07-14T11:17:56.279106+0000","last_unstale":"2023-07-14T11:17:57.433562+0000","last_undegraded":"2023-07-14T11:17:57.433562+0000","last_fullsized":"2023-07-14T11:17:57.433562+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:50:50.138300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.434318+0000","last_change":"2023-07-14T11:17:56.281103+0000","last_active":"2023-07-14T11:17:57.434318+0000","last_peered":"2023-07-14T11:17:57.434318+0000","last_clean":"2023-07-14T11:17:57.434318+0000","last_became_active":"2023-07-14T11:17:56.280804+0000","last_became_peered":"2023-07-14T11:17:56.280804+0000","last_unstale":"2023-07-14T11:17:57.434318+0000","last_undegraded":"2023-07-14T11:17:57.434318+0000","last_fullsized":"2023-07-14T11:17:57.434318+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:47:58.323919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.269928+0000","last_change":"2023-07-14T11:17:56.276231+0000","last_active":"2023-07-14T11:17:57.269928+0000","last_peered":"2023-07-14T11:17:57.269928+0000","last_clean":"2023-07-14T11:17:57.269928+0000","last_became_active":"2023-07-14T11:17:56.275958+0000","last_became_peered":"2023-07-14T11:17:56.275958+0000","last_unstale":"2023-07-14T11:17:57.269928+0000","last_undegraded":"2023-07-14T11:17:57.269928+0000","last_fullsized":"2023-07-14T11:17:57.269928+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:43:39.497391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.433872+0000","last_change":"2023-07-14T11:17:56.280772+0000","last_active":"2023-07-14T11:17:57.433872+0000","last_peered":"2023-07-14T11:17:57.433872+0000","last_clean":"2023-07-14T11:17:57.433872+0000","last_became_active":"2023-07-14T11:17:56.280480+0000","last_became_peered":"2023-07-14T11:17:56.280480+0000","last_unstale":"2023-07-14T11:17:57.433872+0000","last_undegraded":"2023-07-14T11:17:57.433872+0000","last_fullsized":"2023-07-14T11:17:57.433872+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:41:19.412625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.433399+0000","last_change":"2023-07-14T11:17:56.274001+0000","last_active":"2023-07-14T11:17:57.433399+0000","last_peered":"2023-07-14T11:17:57.433399+0000","last_clean":"2023-07-14T11:17:57.433399+0000","last_became_active":"2023-07-14T11:17:56.273729+0000","last_became_peered":"2023-07-14T11:17:56.273729+0000","last_unstale":"2023-07-14T11:17:57.433399+0000","last_undegraded":"2023-07-14T11:17:57.433399+0000","last_fullsized":"2023-07-14T11:17:57.433399+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:20:41.534310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.432813+0000","last_change":"2023-07-14T11:17:56.295489+0000","last_active":"2023-07-14T11:17:57.432813+0000","last_peered":"2023-07-14T11:17:57.432813+0000","last_clean":"2023-07-14T11:17:57.432813+0000","last_became_active":"2023-07-14T11:17:56.295231+0000","last_became_peered":"2023-07-14T11:17:56.295231+0000","last_unstale":"2023-07-14T11:17:57.432813+0000","last_undegraded":"2023-07-14T11:17:57.432813+0000","last_fullsized":"2023-07-14T11:17:57.432813+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:50:50.138300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.433722+0000","last_change":"2023-07-14T11:17:56.295578+0000","last_active":"2023-07-14T11:17:57.433722+0000","last_peered":"2023-07-14T11:17:57.433722+0000","last_clean":"2023-07-14T11:17:57.433722+0000","last_became_active":"2023-07-14T11:17:56.295317+0000","last_became_peered":"2023-07-14T11:17:56.295317+0000","last_unstale":"2023-07-14T11:17:57.433722+0000","last_undegraded":"2023-07-14T11:17:57.433722+0000","last_fullsized":"2023-07-14T11:17:57.433722+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:26:51.493769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.270218+0000","last_change":"2023-07-14T11:17:56.283557+0000","last_active":"2023-07-14T11:17:57.270218+0000","last_peered":"2023-07-14T11:17:57.270218+0000","last_clean":"2023-07-14T11:17:57.270218+0000","last_became_active":"2023-07-14T11:17:56.283279+0000","last_became_peered":"2023-07-14T11:17:56.283279+0000","last_unstale":"2023-07-14T11:17:57.270218+0000","last_undegraded":"2023-07-14T11:17:57.270218+0000","last_fullsized":"2023-07-14T11:17:57.270218+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:26:23.512984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.433444+0000","last_change":"2023-07-14T11:17:56.279163+0000","last_active":"2023-07-14T11:17:57.433444+0000","last_peered":"2023-07-14T11:17:57.433444+0000","last_clean":"2023-07-14T11:17:57.433444+0000","last_became_active":"2023-07-14T11:17:56.278874+0000","last_became_peered":"2023-07-14T11:17:56.278874+0000","last_unstale":"2023-07-14T11:17:57.433444+0000","last_undegraded":"2023-07-14T11:17:57.433444+0000","last_fullsized":"2023-07-14T11:17:57.433444+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:14:50.259303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.432446+0000","last_change":"2023-07-14T11:17:56.288910+0000","last_active":"2023-07-14T11:17:57.432446+0000","last_peered":"2023-07-14T11:17:57.432446+0000","last_clean":"2023-07-14T11:17:57.432446+0000","last_became_active":"2023-07-14T11:17:56.288445+0000","last_became_peered":"2023-07-14T11:17:56.288445+0000","last_unstale":"2023-07-14T11:17:57.432446+0000","last_undegraded":"2023-07-14T11:17:57.432446+0000","last_fullsized":"2023-07-14T11:17:57.432446+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:10:46.398403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.270453+0000","last_change":"2023-07-14T11:17:56.275889+0000","last_active":"2023-07-14T11:17:57.270453+0000","last_peered":"2023-07-14T11:17:57.270453+0000","last_clean":"2023-07-14T11:17:57.270453+0000","last_became_active":"2023-07-14T11:17:56.274913+0000","last_became_peered":"2023-07-14T11:17:56.274913+0000","last_unstale":"2023-07-14T11:17:57.270453+0000","last_undegraded":"2023-07-14T11:17:57.270453+0000","last_fullsized":"2023-07-14T11:17:57.270453+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:54:44.987237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.270509+0000","last_change":"2023-07-14T11:17:56.277708+0000","last_active":"2023-07-14T11:17:57.270509+0000","last_peered":"2023-07-14T11:17:57.270509+0000","last_clean":"2023-07-14T11:17:57.270509+0000","last_became_active":"2023-07-14T11:17:56.277445+0000","last_became_peered":"2023-07-14T11:17:56.277445+0000","last_unstale":"2023-07-14T11:17:57.270509+0000","last_undegraded":"2023-07-14T11:17:57.270509+0000","last_fullsized":"2023-07-14T11:17:57.270509+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:46:15.134220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.268864+0000","last_change":"2023-07-14T11:17:56.265293+0000","last_active":"2023-07-14T11:17:57.268864+0000","last_peered":"2023-07-14T11:17:57.268864+0000","last_clean":"2023-07-14T11:17:57.268864+0000","last_became_active":"2023-07-14T11:17:56.265018+0000","last_became_peered":"2023-07-14T11:17:56.265018+0000","last_unstale":"2023-07-14T11:17:57.268864+0000","last_undegraded":"2023-07-14T11:17:57.268864+0000","last_fullsized":"2023-07-14T11:17:57.268864+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:16:39.822307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.433594+0000","last_change":"2023-07-14T11:17:56.283283+0000","last_active":"2023-07-14T11:17:57.433594+0000","last_peered":"2023-07-14T11:17:57.433594+0000","last_clean":"2023-07-14T11:17:57.433594+0000","last_became_active":"2023-07-14T11:17:56.282958+0000","last_became_peered":"2023-07-14T11:17:56.282958+0000","last_unstale":"2023-07-14T11:17:57.433594+0000","last_undegraded":"2023-07-14T11:17:57.433594+0000","last_fullsized":"2023-07-14T11:17:57.433594+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:57:56.849299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.270549+0000","last_change":"2023-07-14T11:17:56.281316+0000","last_active":"2023-07-14T11:17:57.270549+0000","last_peered":"2023-07-14T11:17:57.270549+0000","last_clean":"2023-07-14T11:17:57.270549+0000","last_became_active":"2023-07-14T11:17:56.281070+0000","last_became_peered":"2023-07-14T11:17:56.281070+0000","last_unstale":"2023-07-14T11:17:57.270549+0000","last_undegraded":"2023-07-14T11:17:57.270549+0000","last_fullsized":"2023-07-14T11:17:57.270549+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:10:11.862226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.434241+0000","last_change":"2023-07-14T11:17:56.274395+0000","last_active":"2023-07-14T11:17:57.434241+0000","last_peered":"2023-07-14T11:17:57.434241+0000","last_clean":"2023-07-14T11:17:57.434241+0000","last_became_active":"2023-07-14T11:17:56.274092+0000","last_became_peered":"2023-07-14T11:17:56.274092+0000","last_unstale":"2023-07-14T11:17:57.434241+0000","last_undegraded":"2023-07-14T11:17:57.434241+0000","last_fullsized":"2023-07-14T11:17:57.434241+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:26:34.157198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.270131+0000","last_change":"2023-07-14T11:17:56.284501+0000","last_active":"2023-07-14T11:17:57.270131+0000","last_peered":"2023-07-14T11:17:57.270131+0000","last_clean":"2023-07-14T11:17:57.270131+0000","last_became_active":"2023-07-14T11:17:56.284260+0000","last_became_peered":"2023-07-14T11:17:56.284260+0000","last_unstale":"2023-07-14T11:17:57.270131+0000","last_undegraded":"2023-07-14T11:17:57.270131+0000","last_fullsized":"2023-07-14T11:17:57.270131+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:12:19.035572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.433586+0000","last_change":"2023-07-14T11:17:56.269186+0000","last_active":"2023-07-14T11:17:57.433586+0000","last_peered":"2023-07-14T11:17:57.433586+0000","last_clean":"2023-07-14T11:17:57.433586+0000","last_became_active":"2023-07-14T11:17:56.268903+0000","last_became_peered":"2023-07-14T11:17:56.268903+0000","last_unstale":"2023-07-14T11:17:57.433586+0000","last_undegraded":"2023-07-14T11:17:57.433586+0000","last_fullsized":"2023-07-14T11:17:57.433586+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:17:57.681147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.433177+0000","last_change":"2023-07-14T11:17:56.298701+0000","last_active":"2023-07-14T11:17:57.433177+0000","last_peered":"2023-07-14T11:17:57.433177+0000","last_clean":"2023-07-14T11:17:57.433177+0000","last_became_active":"2023-07-14T11:17:56.298131+0000","last_became_peered":"2023-07-14T11:17:56.298131+0000","last_unstale":"2023-07-14T11:17:57.433177+0000","last_undegraded":"2023-07-14T11:17:57.433177+0000","last_fullsized":"2023-07-14T11:17:57.433177+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:57:23.955100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.433089+0000","last_change":"2023-07-14T11:17:56.289501+0000","last_active":"2023-07-14T11:17:57.433089+0000","last_peered":"2023-07-14T11:17:57.433089+0000","last_clean":"2023-07-14T11:17:57.433089+0000","last_became_active":"2023-07-14T11:17:56.289251+0000","last_became_peered":"2023-07-14T11:17:56.289251+0000","last_unstale":"2023-07-14T11:17:57.433089+0000","last_undegraded":"2023-07-14T11:17:57.433089+0000","last_fullsized":"2023-07-14T11:17:57.433089+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:50:43.936067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.433540+0000","last_change":"2023-07-14T11:17:56.295572+0000","last_active":"2023-07-14T11:17:57.433540+0000","last_peered":"2023-07-14T11:17:57.433540+0000","last_clean":"2023-07-14T11:17:57.433540+0000","last_became_active":"2023-07-14T11:17:56.295306+0000","last_became_peered":"2023-07-14T11:17:56.295306+0000","last_unstale":"2023-07-14T11:17:57.433540+0000","last_undegraded":"2023-07-14T11:17:57.433540+0000","last_fullsized":"2023-07-14T11:17:57.433540+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:54:40.603146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.270668+0000","last_change":"2023-07-14T11:17:56.278727+0000","last_active":"2023-07-14T11:17:57.270668+0000","last_peered":"2023-07-14T11:17:57.270668+0000","last_clean":"2023-07-14T11:17:57.270668+0000","last_became_active":"2023-07-14T11:17:56.278391+0000","last_became_peered":"2023-07-14T11:17:56.278391+0000","last_unstale":"2023-07-14T11:17:57.270668+0000","last_undegraded":"2023-07-14T11:17:57.270668+0000","last_fullsized":"2023-07-14T11:17:57.270668+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:58:28.533567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.270630+0000","last_change":"2023-07-14T11:17:56.277037+0000","last_active":"2023-07-14T11:17:57.270630+0000","last_peered":"2023-07-14T11:17:57.270630+0000","last_clean":"2023-07-14T11:17:57.270630+0000","last_became_active":"2023-07-14T11:17:56.276730+0000","last_became_peered":"2023-07-14T11:17:56.276730+0000","last_unstale":"2023-07-14T11:17:57.270630+0000","last_undegraded":"2023-07-14T11:17:57.270630+0000","last_fullsized":"2023-07-14T11:17:57.270630+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:20:50.119024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.432918+0000","last_change":"2023-07-14T11:17:56.287932+0000","last_active":"2023-07-14T11:17:57.432918+0000","last_peered":"2023-07-14T11:17:57.432918+0000","last_clean":"2023-07-14T11:17:57.432918+0000","last_became_active":"2023-07-14T11:17:56.287475+0000","last_became_peered":"2023-07-14T11:17:56.287475+0000","last_unstale":"2023-07-14T11:17:57.432918+0000","last_undegraded":"2023-07-14T11:17:57.432918+0000","last_fullsized":"2023-07-14T11:17:57.432918+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:53:41.364051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.270563+0000","last_change":"2023-07-14T11:17:56.296708+0000","last_active":"2023-07-14T11:17:57.270563+0000","last_peered":"2023-07-14T11:17:57.270563+0000","last_clean":"2023-07-14T11:17:57.270563+0000","last_became_active":"2023-07-14T11:17:56.296422+0000","last_became_peered":"2023-07-14T11:17:56.296422+0000","last_unstale":"2023-07-14T11:17:57.270563+0000","last_undegraded":"2023-07-14T11:17:57.270563+0000","last_fullsized":"2023-07-14T11:17:57.270563+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:54:09.095859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.268748+0000","last_change":"2023-07-14T11:17:56.278072+0000","last_active":"2023-07-14T11:17:57.268748+0000","last_peered":"2023-07-14T11:17:57.268748+0000","last_clean":"2023-07-14T11:17:57.268748+0000","last_became_active":"2023-07-14T11:17:56.277800+0000","last_became_peered":"2023-07-14T11:17:56.277800+0000","last_unstale":"2023-07-14T11:17:57.268748+0000","last_undegraded":"2023-07-14T11:17:57.268748+0000","last_fullsized":"2023-07-14T11:17:57.268748+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:29:33.204246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.270864+0000","last_change":"2023-07-14T11:17:56.278173+0000","last_active":"2023-07-14T11:17:57.270864+0000","last_peered":"2023-07-14T11:17:57.270864+0000","last_clean":"2023-07-14T11:17:57.270864+0000","last_became_active":"2023-07-14T11:17:56.277705+0000","last_became_peered":"2023-07-14T11:17:56.277705+0000","last_unstale":"2023-07-14T11:17:57.270864+0000","last_undegraded":"2023-07-14T11:17:57.270864+0000","last_fullsized":"2023-07-14T11:17:57.270864+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:52:21.989412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.268642+0000","last_change":"2023-07-14T11:17:56.265268+0000","last_active":"2023-07-14T11:17:57.268642+0000","last_peered":"2023-07-14T11:17:57.268642+0000","last_clean":"2023-07-14T11:17:57.268642+0000","last_became_active":"2023-07-14T11:17:56.264971+0000","last_became_peered":"2023-07-14T11:17:56.264971+0000","last_unstale":"2023-07-14T11:17:57.268642+0000","last_undegraded":"2023-07-14T11:17:57.268642+0000","last_fullsized":"2023-07-14T11:17:57.268642+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:49:43.373479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"74'4","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.270333+0000","last_change":"2023-07-14T11:17:55.275342+0000","last_active":"2023-07-14T11:17:57.270333+0000","last_peered":"2023-07-14T11:17:57.270333+0000","last_clean":"2023-07-14T11:17:57.270333+0000","last_became_active":"2023-07-14T11:17:55.275030+0000","last_became_peered":"2023-07-14T11:17:55.275030+0000","last_unstale":"2023-07-14T11:17:57.270333+0000","last_undegraded":"2023-07-14T11:17:57.270333+0000","last_fullsized":"2023-07-14T11:17:57.270333+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:51:52.285666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.432625+0000","last_change":"2023-07-14T11:17:56.288704+0000","last_active":"2023-07-14T11:17:57.432625+0000","last_peered":"2023-07-14T11:17:57.432625+0000","last_clean":"2023-07-14T11:17:57.432625+0000","last_became_active":"2023-07-14T11:17:56.288138+0000","last_became_peered":"2023-07-14T11:17:56.288138+0000","last_unstale":"2023-07-14T11:17:57.432625+0000","last_undegraded":"2023-07-14T11:17:57.432625+0000","last_fullsized":"2023-07-14T11:17:57.432625+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:11:07.261491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"74'1","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.270936+0000","last_change":"2023-07-14T11:17:55.276014+0000","last_active":"2023-07-14T11:17:57.270936+0000","last_peered":"2023-07-14T11:17:57.270936+0000","last_clean":"2023-07-14T11:17:57.270936+0000","last_became_active":"2023-07-14T11:17:55.275761+0000","last_became_peered":"2023-07-14T11:17:55.275761+0000","last_unstale":"2023-07-14T11:17:57.270936+0000","last_undegraded":"2023-07-14T11:17:57.270936+0000","last_fullsized":"2023-07-14T11:17:57.270936+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:40:59.216505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.433954+0000","last_change":"2023-07-14T11:17:56.283330+0000","last_active":"2023-07-14T11:17:57.433954+0000","last_peered":"2023-07-14T11:17:57.433954+0000","last_clean":"2023-07-14T11:17:57.433954+0000","last_became_active":"2023-07-14T11:17:56.282812+0000","last_became_peered":"2023-07-14T11:17:56.282812+0000","last_unstale":"2023-07-14T11:17:57.433954+0000","last_undegraded":"2023-07-14T11:17:57.433954+0000","last_fullsized":"2023-07-14T11:17:57.433954+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:47:45.590333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"74'2","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.271157+0000","last_change":"2023-07-14T11:17:55.277374+0000","last_active":"2023-07-14T11:17:57.271157+0000","last_peered":"2023-07-14T11:17:57.271157+0000","last_clean":"2023-07-14T11:17:57.271157+0000","last_became_active":"2023-07-14T11:17:55.277071+0000","last_became_peered":"2023-07-14T11:17:55.277071+0000","last_unstale":"2023-07-14T11:17:57.271157+0000","last_undegraded":"2023-07-14T11:17:57.271157+0000","last_fullsized":"2023-07-14T11:17:57.271157+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:12:19.266848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.434545+0000","last_change":"2023-07-14T11:17:56.274564+0000","last_active":"2023-07-14T11:17:57.434545+0000","last_peered":"2023-07-14T11:17:57.434545+0000","last_clean":"2023-07-14T11:17:57.434545+0000","last_became_active":"2023-07-14T11:17:56.274246+0000","last_became_peered":"2023-07-14T11:17:56.274246+0000","last_unstale":"2023-07-14T11:17:57.434545+0000","last_undegraded":"2023-07-14T11:17:57.434545+0000","last_fullsized":"2023-07-14T11:17:57.434545+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:04:05.516942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"74'2","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.433576+0000","last_change":"2023-07-14T11:17:55.275292+0000","last_active":"2023-07-14T11:17:57.433576+0000","last_peered":"2023-07-14T11:17:57.433576+0000","last_clean":"2023-07-14T11:17:57.433576+0000","last_became_active":"2023-07-14T11:17:55.274845+0000","last_became_peered":"2023-07-14T11:17:55.274845+0000","last_unstale":"2023-07-14T11:17:57.433576+0000","last_undegraded":"2023-07-14T11:17:57.433576+0000","last_fullsized":"2023-07-14T11:17:57.433576+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:36:35.133900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.432538+0000","last_change":"2023-07-14T11:17:56.295069+0000","last_active":"2023-07-14T11:17:57.432538+0000","last_peered":"2023-07-14T11:17:57.432538+0000","last_clean":"2023-07-14T11:17:57.432538+0000","last_became_active":"2023-07-14T11:17:56.294651+0000","last_became_peered":"2023-07-14T11:17:56.294651+0000","last_unstale":"2023-07-14T11:17:57.432538+0000","last_undegraded":"2023-07-14T11:17:57.432538+0000","last_fullsized":"2023-07-14T11:17:57.432538+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:33:10.495205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"74'1","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.434531+0000","last_change":"2023-07-14T11:17:55.274123+0000","last_active":"2023-07-14T11:17:57.434531+0000","last_peered":"2023-07-14T11:17:57.434531+0000","last_clean":"2023-07-14T11:17:57.434531+0000","last_became_active":"2023-07-14T11:17:55.273853+0000","last_became_peered":"2023-07-14T11:17:55.273853+0000","last_unstale":"2023-07-14T11:17:57.434531+0000","last_undegraded":"2023-07-14T11:17:57.434531+0000","last_fullsized":"2023-07-14T11:17:57.434531+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:23:38.158254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.432581+0000","last_change":"2023-07-14T11:17:56.295889+0000","last_active":"2023-07-14T11:17:57.432581+0000","last_peered":"2023-07-14T11:17:57.432581+0000","last_clean":"2023-07-14T11:17:57.432581+0000","last_became_active":"2023-07-14T11:17:56.295623+0000","last_became_peered":"2023-07-14T11:17:56.295623+0000","last_unstale":"2023-07-14T11:17:57.432581+0000","last_undegraded":"2023-07-14T11:17:57.432581+0000","last_fullsized":"2023-07-14T11:17:57.432581+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:23:18.192191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"74'1","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.433114+0000","last_change":"2023-07-14T11:17:55.275771+0000","last_active":"2023-07-14T11:17:57.433114+0000","last_peered":"2023-07-14T11:17:57.433114+0000","last_clean":"2023-07-14T11:17:57.433114+0000","last_became_active":"2023-07-14T11:17:55.275490+0000","last_became_peered":"2023-07-14T11:17:55.275490+0000","last_unstale":"2023-07-14T11:17:57.433114+0000","last_undegraded":"2023-07-14T11:17:57.433114+0000","last_fullsized":"2023-07-14T11:17:57.433114+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:56:34.024532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.434254+0000","last_change":"2023-07-14T11:17:56.280041+0000","last_active":"2023-07-14T11:17:57.434254+0000","last_peered":"2023-07-14T11:17:57.434254+0000","last_clean":"2023-07-14T11:17:57.434254+0000","last_became_active":"2023-07-14T11:17:56.279755+0000","last_became_peered":"2023-07-14T11:17:56.279755+0000","last_unstale":"2023-07-14T11:17:57.434254+0000","last_undegraded":"2023-07-14T11:17:57.434254+0000","last_fullsized":"2023-07-14T11:17:57.434254+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:04:14.942015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.432715+0000","last_change":"2023-07-14T11:17:55.271818+0000","last_active":"2023-07-14T11:17:57.432715+0000","last_peered":"2023-07-14T11:17:57.432715+0000","last_clean":"2023-07-14T11:17:57.432715+0000","last_became_active":"2023-07-14T11:17:55.271488+0000","last_became_peered":"2023-07-14T11:17:55.271488+0000","last_unstale":"2023-07-14T11:17:57.432715+0000","last_undegraded":"2023-07-14T11:17:57.432715+0000","last_fullsized":"2023-07-14T11:17:57.432715+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:08:09.595286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.434301+0000","last_change":"2023-07-14T11:17:56.281601+0000","last_active":"2023-07-14T11:17:57.434301+0000","last_peered":"2023-07-14T11:17:57.434301+0000","last_clean":"2023-07-14T11:17:57.434301+0000","last_became_active":"2023-07-14T11:17:56.280781+0000","last_became_peered":"2023-07-14T11:17:56.280781+0000","last_unstale":"2023-07-14T11:17:57.434301+0000","last_undegraded":"2023-07-14T11:17:57.434301+0000","last_fullsized":"2023-07-14T11:17:57.434301+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:26:13.163304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.270244+0000","last_change":"2023-07-14T11:17:55.273443+0000","last_active":"2023-07-14T11:17:57.270244+0000","last_peered":"2023-07-14T11:17:57.270244+0000","last_clean":"2023-07-14T11:17:57.270244+0000","last_became_active":"2023-07-14T11:17:55.273159+0000","last_became_peered":"2023-07-14T11:17:55.273159+0000","last_unstale":"2023-07-14T11:17:57.270244+0000","last_undegraded":"2023-07-14T11:17:57.270244+0000","last_fullsized":"2023-07-14T11:17:57.270244+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:37:34.561211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.432379+0000","last_change":"2023-07-14T11:17:56.298901+0000","last_active":"2023-07-14T11:17:57.432379+0000","last_peered":"2023-07-14T11:17:57.432379+0000","last_clean":"2023-07-14T11:17:57.432379+0000","last_became_active":"2023-07-14T11:17:56.298457+0000","last_became_peered":"2023-07-14T11:17:56.298457+0000","last_unstale":"2023-07-14T11:17:57.432379+0000","last_undegraded":"2023-07-14T11:17:57.432379+0000","last_fullsized":"2023-07-14T11:17:57.432379+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:23:49.258381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.271035+0000","last_change":"2023-07-14T11:17:55.276895+0000","last_active":"2023-07-14T11:17:57.271035+0000","last_peered":"2023-07-14T11:17:57.271035+0000","last_clean":"2023-07-14T11:17:57.271035+0000","last_became_active":"2023-07-14T11:17:55.275745+0000","last_became_peered":"2023-07-14T11:17:55.275745+0000","last_unstale":"2023-07-14T11:17:57.271035+0000","last_undegraded":"2023-07-14T11:17:57.271035+0000","last_fullsized":"2023-07-14T11:17:57.271035+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:04:14.538789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.433237+0000","last_change":"2023-07-14T11:17:56.265329+0000","last_active":"2023-07-14T11:17:57.433237+0000","last_peered":"2023-07-14T11:17:57.433237+0000","last_clean":"2023-07-14T11:17:57.433237+0000","last_became_active":"2023-07-14T11:17:56.265042+0000","last_became_peered":"2023-07-14T11:17:56.265042+0000","last_unstale":"2023-07-14T11:17:57.433237+0000","last_undegraded":"2023-07-14T11:17:57.433237+0000","last_fullsized":"2023-07-14T11:17:57.433237+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:11:48.438192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.433554+0000","last_change":"2023-07-14T11:17:55.271797+0000","last_active":"2023-07-14T11:17:57.433554+0000","last_peered":"2023-07-14T11:17:57.433554+0000","last_clean":"2023-07-14T11:17:57.433554+0000","last_became_active":"2023-07-14T11:17:55.271504+0000","last_became_peered":"2023-07-14T11:17:55.271504+0000","last_unstale":"2023-07-14T11:17:57.433554+0000","last_undegraded":"2023-07-14T11:17:57.433554+0000","last_fullsized":"2023-07-14T11:17:57.433554+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:03:41.393976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.433429+0000","last_change":"2023-07-14T11:17:56.286261+0000","last_active":"2023-07-14T11:17:57.433429+0000","last_peered":"2023-07-14T11:17:57.433429+0000","last_clean":"2023-07-14T11:17:57.433429+0000","last_became_active":"2023-07-14T11:17:56.285211+0000","last_became_peered":"2023-07-14T11:17:56.285211+0000","last_unstale":"2023-07-14T11:17:57.433429+0000","last_undegraded":"2023-07-14T11:17:57.433429+0000","last_fullsized":"2023-07-14T11:17:57.433429+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:11:07.261491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"74'3","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.270604+0000","last_change":"2023-07-14T11:17:55.266331+0000","last_active":"2023-07-14T11:17:57.270604+0000","last_peered":"2023-07-14T11:17:57.270604+0000","last_clean":"2023-07-14T11:17:57.270604+0000","last_became_active":"2023-07-14T11:17:55.266061+0000","last_became_peered":"2023-07-14T11:17:55.266061+0000","last_unstale":"2023-07-14T11:17:57.270604+0000","last_undegraded":"2023-07-14T11:17:57.270604+0000","last_fullsized":"2023-07-14T11:17:57.270604+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:10:32.123752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.268988+0000","last_change":"2023-07-14T11:17:56.295375+0000","last_active":"2023-07-14T11:17:57.268988+0000","last_peered":"2023-07-14T11:17:57.268988+0000","last_clean":"2023-07-14T11:17:57.268988+0000","last_became_active":"2023-07-14T11:17:56.295099+0000","last_became_peered":"2023-07-14T11:17:56.295099+0000","last_unstale":"2023-07-14T11:17:57.268988+0000","last_undegraded":"2023-07-14T11:17:57.268988+0000","last_fullsized":"2023-07-14T11:17:57.268988+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:55:13.745622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"74'6","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.433746+0000","last_change":"2023-07-14T11:17:55.276939+0000","last_active":"2023-07-14T11:17:57.433746+0000","last_peered":"2023-07-14T11:17:57.433746+0000","last_clean":"2023-07-14T11:17:57.433746+0000","last_became_active":"2023-07-14T11:17:55.276617+0000","last_became_peered":"2023-07-14T11:17:55.276617+0000","last_unstale":"2023-07-14T11:17:57.433746+0000","last_undegraded":"2023-07-14T11:17:57.433746+0000","last_fullsized":"2023-07-14T11:17:57.433746+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:34:18.629743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.433871+0000","last_change":"2023-07-14T11:17:56.280583+0000","last_active":"2023-07-14T11:17:57.433871+0000","last_peered":"2023-07-14T11:17:57.433871+0000","last_clean":"2023-07-14T11:17:57.433871+0000","last_became_active":"2023-07-14T11:17:56.280314+0000","last_became_peered":"2023-07-14T11:17:56.280314+0000","last_unstale":"2023-07-14T11:17:57.433871+0000","last_undegraded":"2023-07-14T11:17:57.433871+0000","last_fullsized":"2023-07-14T11:17:57.433871+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:58:52.233368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"74'2","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.433391+0000","last_change":"2023-07-14T11:17:55.272772+0000","last_active":"2023-07-14T11:17:57.433391+0000","last_peered":"2023-07-14T11:17:57.433391+0000","last_clean":"2023-07-14T11:17:57.433391+0000","last_became_active":"2023-07-14T11:17:55.272348+0000","last_became_peered":"2023-07-14T11:17:55.272348+0000","last_unstale":"2023-07-14T11:17:57.433391+0000","last_undegraded":"2023-07-14T11:17:57.433391+0000","last_fullsized":"2023-07-14T11:17:57.433391+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:00:19.835173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.434122+0000","last_change":"2023-07-14T11:17:56.278648+0000","last_active":"2023-07-14T11:17:57.434122+0000","last_peered":"2023-07-14T11:17:57.434122+0000","last_clean":"2023-07-14T11:17:57.434122+0000","last_became_active":"2023-07-14T11:17:56.278367+0000","last_became_peered":"2023-07-14T11:17:56.278367+0000","last_unstale":"2023-07-14T11:17:57.434122+0000","last_undegraded":"2023-07-14T11:17:57.434122+0000","last_fullsized":"2023-07-14T11:17:57.434122+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:11:37.452196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.270606+0000","last_change":"2023-07-14T11:17:55.273580+0000","last_active":"2023-07-14T11:17:57.270606+0000","last_peered":"2023-07-14T11:17:57.270606+0000","last_clean":"2023-07-14T11:17:57.270606+0000","last_became_active":"2023-07-14T11:17:55.273264+0000","last_became_peered":"2023-07-14T11:17:55.273264+0000","last_unstale":"2023-07-14T11:17:57.270606+0000","last_undegraded":"2023-07-14T11:17:57.270606+0000","last_fullsized":"2023-07-14T11:17:57.270606+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:21:09.440808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.433841+0000","last_change":"2023-07-14T11:17:56.276880+0000","last_active":"2023-07-14T11:17:57.433841+0000","last_peered":"2023-07-14T11:17:57.433841+0000","last_clean":"2023-07-14T11:17:57.433841+0000","last_became_active":"2023-07-14T11:17:56.276265+0000","last_became_peered":"2023-07-14T11:17:56.276265+0000","last_unstale":"2023-07-14T11:17:57.433841+0000","last_undegraded":"2023-07-14T11:17:57.433841+0000","last_fullsized":"2023-07-14T11:17:57.433841+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:44:45.503011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.269998+0000","last_change":"2023-07-14T11:17:55.274451+0000","last_active":"2023-07-14T11:17:57.269998+0000","last_peered":"2023-07-14T11:17:57.269998+0000","last_clean":"2023-07-14T11:17:57.269998+0000","last_became_active":"2023-07-14T11:17:55.274122+0000","last_became_peered":"2023-07-14T11:17:55.274122+0000","last_unstale":"2023-07-14T11:17:57.269998+0000","last_undegraded":"2023-07-14T11:17:57.269998+0000","last_fullsized":"2023-07-14T11:17:57.269998+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:35:00.736586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.433810+0000","last_change":"2023-07-14T11:17:56.281897+0000","last_active":"2023-07-14T11:17:57.433810+0000","last_peered":"2023-07-14T11:17:57.433810+0000","last_clean":"2023-07-14T11:17:57.433810+0000","last_became_active":"2023-07-14T11:17:56.281312+0000","last_became_peered":"2023-07-14T11:17:56.281312+0000","last_unstale":"2023-07-14T11:17:57.433810+0000","last_undegraded":"2023-07-14T11:17:57.433810+0000","last_fullsized":"2023-07-14T11:17:57.433810+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:10:45.185292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"74'8","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.433126+0000","last_change":"2023-07-14T11:17:55.277603+0000","last_active":"2023-07-14T11:17:57.433126+0000","last_peered":"2023-07-14T11:17:57.433126+0000","last_clean":"2023-07-14T11:17:57.433126+0000","last_became_active":"2023-07-14T11:17:55.277297+0000","last_became_peered":"2023-07-14T11:17:55.277297+0000","last_unstale":"2023-07-14T11:17:57.433126+0000","last_undegraded":"2023-07-14T11:17:57.433126+0000","last_fullsized":"2023-07-14T11:17:57.433126+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:27:02.258845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.433411+0000","last_change":"2023-07-14T11:17:56.274029+0000","last_active":"2023-07-14T11:17:57.433411+0000","last_peered":"2023-07-14T11:17:57.433411+0000","last_clean":"2023-07-14T11:17:57.433411+0000","last_became_active":"2023-07-14T11:17:56.273680+0000","last_became_peered":"2023-07-14T11:17:56.273680+0000","last_unstale":"2023-07-14T11:17:57.433411+0000","last_undegraded":"2023-07-14T11:17:57.433411+0000","last_fullsized":"2023-07-14T11:17:57.433411+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:05:14.284692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"74'2","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.433572+0000","last_change":"2023-07-14T11:17:55.269223+0000","last_active":"2023-07-14T11:17:57.433572+0000","last_peered":"2023-07-14T11:17:57.433572+0000","last_clean":"2023-07-14T11:17:57.433572+0000","last_became_active":"2023-07-14T11:17:55.268917+0000","last_became_peered":"2023-07-14T11:17:55.268917+0000","last_unstale":"2023-07-14T11:17:57.433572+0000","last_undegraded":"2023-07-14T11:17:57.433572+0000","last_fullsized":"2023-07-14T11:17:57.433572+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:07:17.816976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.434141+0000","last_change":"2023-07-14T11:17:56.282012+0000","last_active":"2023-07-14T11:17:57.434141+0000","last_peered":"2023-07-14T11:17:57.434141+0000","last_clean":"2023-07-14T11:17:57.434141+0000","last_became_active":"2023-07-14T11:17:56.280463+0000","last_became_peered":"2023-07-14T11:17:56.280463+0000","last_unstale":"2023-07-14T11:17:57.434141+0000","last_undegraded":"2023-07-14T11:17:57.434141+0000","last_fullsized":"2023-07-14T11:17:57.434141+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:57:42.906724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"75'1","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.433023+0000","last_change":"2023-07-14T11:17:55.271803+0000","last_active":"2023-07-14T11:17:57.433023+0000","last_peered":"2023-07-14T11:17:57.433023+0000","last_clean":"2023-07-14T11:17:57.433023+0000","last_became_active":"2023-07-14T11:17:55.271427+0000","last_became_peered":"2023-07-14T11:17:55.271427+0000","last_unstale":"2023-07-14T11:17:57.433023+0000","last_undegraded":"2023-07-14T11:17:57.433023+0000","last_fullsized":"2023-07-14T11:17:57.433023+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:02:21.804706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.434053+0000","last_change":"2023-07-14T11:17:56.283149+0000","last_active":"2023-07-14T11:17:57.434053+0000","last_peered":"2023-07-14T11:17:57.434053+0000","last_clean":"2023-07-14T11:17:57.434053+0000","last_became_active":"2023-07-14T11:17:56.282393+0000","last_became_peered":"2023-07-14T11:17:56.282393+0000","last_unstale":"2023-07-14T11:17:57.434053+0000","last_undegraded":"2023-07-14T11:17:57.434053+0000","last_fullsized":"2023-07-14T11:17:57.434053+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:12:38.082963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.270973+0000","last_change":"2023-07-14T11:17:55.271560+0000","last_active":"2023-07-14T11:17:57.270973+0000","last_peered":"2023-07-14T11:17:57.270973+0000","last_clean":"2023-07-14T11:17:57.270973+0000","last_became_active":"2023-07-14T11:17:55.271242+0000","last_became_peered":"2023-07-14T11:17:55.271242+0000","last_unstale":"2023-07-14T11:17:57.270973+0000","last_undegraded":"2023-07-14T11:17:57.270973+0000","last_fullsized":"2023-07-14T11:17:57.270973+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:38:27.876073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.432952+0000","last_change":"2023-07-14T11:17:56.287715+0000","last_active":"2023-07-14T11:17:57.432952+0000","last_peered":"2023-07-14T11:17:57.432952+0000","last_clean":"2023-07-14T11:17:57.432952+0000","last_became_active":"2023-07-14T11:17:56.287188+0000","last_became_peered":"2023-07-14T11:17:56.287188+0000","last_unstale":"2023-07-14T11:17:57.432952+0000","last_undegraded":"2023-07-14T11:17:57.432952+0000","last_fullsized":"2023-07-14T11:17:57.432952+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:23:25.619220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.270672+0000","last_change":"2023-07-14T11:17:55.277955+0000","last_active":"2023-07-14T11:17:57.270672+0000","last_peered":"2023-07-14T11:17:57.270672+0000","last_clean":"2023-07-14T11:17:57.270672+0000","last_became_active":"2023-07-14T11:17:55.277668+0000","last_became_peered":"2023-07-14T11:17:55.277668+0000","last_unstale":"2023-07-14T11:17:57.270672+0000","last_undegraded":"2023-07-14T11:17:57.270672+0000","last_fullsized":"2023-07-14T11:17:57.270672+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:02:13.891074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.434047+0000","last_change":"2023-07-14T11:17:56.281745+0000","last_active":"2023-07-14T11:17:57.434047+0000","last_peered":"2023-07-14T11:17:57.434047+0000","last_clean":"2023-07-14T11:17:57.434047+0000","last_became_active":"2023-07-14T11:17:56.281408+0000","last_became_peered":"2023-07-14T11:17:56.281408+0000","last_unstale":"2023-07-14T11:17:57.434047+0000","last_undegraded":"2023-07-14T11:17:57.434047+0000","last_fullsized":"2023-07-14T11:17:57.434047+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:48:28.276251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.433450+0000","last_change":"2023-07-14T11:17:55.275172+0000","last_active":"2023-07-14T11:17:57.433450+0000","last_peered":"2023-07-14T11:17:57.433450+0000","last_clean":"2023-07-14T11:17:57.433450+0000","last_became_active":"2023-07-14T11:17:55.274349+0000","last_became_peered":"2023-07-14T11:17:55.274349+0000","last_unstale":"2023-07-14T11:17:57.433450+0000","last_undegraded":"2023-07-14T11:17:57.433450+0000","last_fullsized":"2023-07-14T11:17:57.433450+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:12:40.575330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.434261+0000","last_change":"2023-07-14T11:17:56.281195+0000","last_active":"2023-07-14T11:17:57.434261+0000","last_peered":"2023-07-14T11:17:57.434261+0000","last_clean":"2023-07-14T11:17:57.434261+0000","last_became_active":"2023-07-14T11:17:56.280741+0000","last_became_peered":"2023-07-14T11:17:56.280741+0000","last_unstale":"2023-07-14T11:17:57.434261+0000","last_undegraded":"2023-07-14T11:17:57.434261+0000","last_fullsized":"2023-07-14T11:17:57.434261+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:39:09.107674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.270217+0000","last_change":"2023-07-14T11:17:55.274435+0000","last_active":"2023-07-14T11:17:57.270217+0000","last_peered":"2023-07-14T11:17:57.270217+0000","last_clean":"2023-07-14T11:17:57.270217+0000","last_became_active":"2023-07-14T11:17:55.274142+0000","last_became_peered":"2023-07-14T11:17:55.274142+0000","last_unstale":"2023-07-14T11:17:57.270217+0000","last_undegraded":"2023-07-14T11:17:57.270217+0000","last_fullsized":"2023-07-14T11:17:57.270217+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:05:09.641011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.269064+0000","last_change":"2023-07-14T11:17:56.296645+0000","last_active":"2023-07-14T11:17:57.269064+0000","last_peered":"2023-07-14T11:17:57.269064+0000","last_clean":"2023-07-14T11:17:57.269064+0000","last_became_active":"2023-07-14T11:17:56.296331+0000","last_became_peered":"2023-07-14T11:17:56.296331+0000","last_unstale":"2023-07-14T11:17:57.269064+0000","last_undegraded":"2023-07-14T11:17:57.269064+0000","last_fullsized":"2023-07-14T11:17:57.269064+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:01:07.387368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.434300+0000","last_change":"2023-07-14T11:17:55.276180+0000","last_active":"2023-07-14T11:17:57.434300+0000","last_peered":"2023-07-14T11:17:57.434300+0000","last_clean":"2023-07-14T11:17:57.434300+0000","last_became_active":"2023-07-14T11:17:55.275919+0000","last_became_peered":"2023-07-14T11:17:55.275919+0000","last_unstale":"2023-07-14T11:17:57.434300+0000","last_undegraded":"2023-07-14T11:17:57.434300+0000","last_fullsized":"2023-07-14T11:17:57.434300+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:53:01.262508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.269371+0000","last_change":"2023-07-14T11:17:56.275875+0000","last_active":"2023-07-14T11:17:57.269371+0000","last_peered":"2023-07-14T11:17:57.269371+0000","last_clean":"2023-07-14T11:17:57.269371+0000","last_became_active":"2023-07-14T11:17:56.275588+0000","last_became_peered":"2023-07-14T11:17:56.275588+0000","last_unstale":"2023-07-14T11:17:57.269371+0000","last_undegraded":"2023-07-14T11:17:57.269371+0000","last_fullsized":"2023-07-14T11:17:57.269371+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:45:52.565378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.268583+0000","last_change":"2023-07-14T11:17:55.272497+0000","last_active":"2023-07-14T11:17:57.268583+0000","last_peered":"2023-07-14T11:17:57.268583+0000","last_clean":"2023-07-14T11:17:57.268583+0000","last_became_active":"2023-07-14T11:17:55.272194+0000","last_became_peered":"2023-07-14T11:17:55.272194+0000","last_unstale":"2023-07-14T11:17:57.268583+0000","last_undegraded":"2023-07-14T11:17:57.268583+0000","last_fullsized":"2023-07-14T11:17:57.268583+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:40:52.697902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.270357+0000","last_change":"2023-07-14T11:17:56.297655+0000","last_active":"2023-07-14T11:17:57.270357+0000","last_peered":"2023-07-14T11:17:57.270357+0000","last_clean":"2023-07-14T11:17:57.270357+0000","last_became_active":"2023-07-14T11:17:56.297399+0000","last_became_peered":"2023-07-14T11:17:56.297399+0000","last_unstale":"2023-07-14T11:17:57.270357+0000","last_undegraded":"2023-07-14T11:17:57.270357+0000","last_fullsized":"2023-07-14T11:17:57.270357+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:48:38.647623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"74'1","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.270635+0000","last_change":"2023-07-14T11:17:55.273602+0000","last_active":"2023-07-14T11:17:57.270635+0000","last_peered":"2023-07-14T11:17:57.270635+0000","last_clean":"2023-07-14T11:17:57.270635+0000","last_became_active":"2023-07-14T11:17:55.273211+0000","last_became_peered":"2023-07-14T11:17:55.273211+0000","last_unstale":"2023-07-14T11:17:57.270635+0000","last_undegraded":"2023-07-14T11:17:57.270635+0000","last_fullsized":"2023-07-14T11:17:57.270635+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:03:47.880348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":125,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.269103+0000","last_change":"2023-07-14T11:13:08.923786+0000","last_active":"2023-07-14T11:17:57.269103+0000","last_peered":"2023-07-14T11:17:57.269103+0000","last_clean":"2023-07-14T11:17:57.269103+0000","last_became_active":"2023-07-14T11:13:08.923384+0000","last_became_peered":"2023-07-14T11:13:08.923384+0000","last_unstale":"2023-07-14T11:17:57.269103+0000","last_undegraded":"2023-07-14T11:17:57.269103+0000","last_fullsized":"2023-07-14T11:17:57.269103+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:24:09.074757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.432776+0000","last_change":"2023-07-14T11:17:56.290086+0000","last_active":"2023-07-14T11:17:57.432776+0000","last_peered":"2023-07-14T11:17:57.432776+0000","last_clean":"2023-07-14T11:17:57.432776+0000","last_became_active":"2023-07-14T11:17:56.289734+0000","last_became_peered":"2023-07-14T11:17:56.289734+0000","last_unstale":"2023-07-14T11:17:57.432776+0000","last_undegraded":"2023-07-14T11:17:57.432776+0000","last_fullsized":"2023-07-14T11:17:57.432776+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:14:50.259303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"74'2","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.433293+0000","last_change":"2023-07-14T11:17:55.273188+0000","last_active":"2023-07-14T11:17:57.433293+0000","last_peered":"2023-07-14T11:17:57.433293+0000","last_clean":"2023-07-14T11:17:57.433293+0000","last_became_active":"2023-07-14T11:17:55.272925+0000","last_became_peered":"2023-07-14T11:17:55.272925+0000","last_unstale":"2023-07-14T11:17:57.433293+0000","last_undegraded":"2023-07-14T11:17:57.433293+0000","last_fullsized":"2023-07-14T11:17:57.433293+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:18:16.084040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":115,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.433176+0000","last_change":"2023-07-14T11:13:08.758749+0000","last_active":"2023-07-14T11:17:57.433176+0000","last_peered":"2023-07-14T11:17:57.433176+0000","last_clean":"2023-07-14T11:17:57.433176+0000","last_became_active":"2023-07-14T11:13:08.757956+0000","last_became_peered":"2023-07-14T11:13:08.757956+0000","last_unstale":"2023-07-14T11:17:57.433176+0000","last_undegraded":"2023-07-14T11:17:57.433176+0000","last_fullsized":"2023-07-14T11:17:57.433176+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:30:34.436057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.433977+0000","last_change":"2023-07-14T11:17:56.277376+0000","last_active":"2023-07-14T11:17:57.433977+0000","last_peered":"2023-07-14T11:17:57.433977+0000","last_clean":"2023-07-14T11:17:57.433977+0000","last_became_active":"2023-07-14T11:17:56.277036+0000","last_became_peered":"2023-07-14T11:17:56.277036+0000","last_unstale":"2023-07-14T11:17:57.433977+0000","last_undegraded":"2023-07-14T11:17:57.433977+0000","last_fullsized":"2023-07-14T11:17:57.433977+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:29:53.068035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.433123+0000","last_change":"2023-07-14T11:17:55.276195+0000","last_active":"2023-07-14T11:17:57.433123+0000","last_peered":"2023-07-14T11:17:57.433123+0000","last_clean":"2023-07-14T11:17:57.433123+0000","last_became_active":"2023-07-14T11:17:55.275914+0000","last_became_peered":"2023-07-14T11:17:55.275914+0000","last_unstale":"2023-07-14T11:17:57.433123+0000","last_undegraded":"2023-07-14T11:17:57.433123+0000","last_fullsized":"2023-07-14T11:17:57.433123+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:10:45.390992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":121,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.270108+0000","last_change":"2023-07-14T11:13:08.862331+0000","last_active":"2023-07-14T11:17:57.270108+0000","last_peered":"2023-07-14T11:17:57.270108+0000","last_clean":"2023-07-14T11:17:57.270108+0000","last_became_active":"2023-07-14T11:13:08.861817+0000","last_became_peered":"2023-07-14T11:13:08.861817+0000","last_unstale":"2023-07-14T11:17:57.270108+0000","last_undegraded":"2023-07-14T11:17:57.270108+0000","last_fullsized":"2023-07-14T11:17:57.270108+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:00:33.085381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.270888+0000","last_change":"2023-07-14T11:17:56.283212+0000","last_active":"2023-07-14T11:17:57.270888+0000","last_peered":"2023-07-14T11:17:57.270888+0000","last_clean":"2023-07-14T11:17:57.270888+0000","last_became_active":"2023-07-14T11:17:56.282927+0000","last_became_peered":"2023-07-14T11:17:56.282927+0000","last_unstale":"2023-07-14T11:17:57.270888+0000","last_undegraded":"2023-07-14T11:17:57.270888+0000","last_fullsized":"2023-07-14T11:17:57.270888+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:04:58.168257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.433271+0000","last_change":"2023-07-14T11:17:55.277231+0000","last_active":"2023-07-14T11:17:57.433271+0000","last_peered":"2023-07-14T11:17:57.433271+0000","last_clean":"2023-07-14T11:17:57.433271+0000","last_became_active":"2023-07-14T11:17:55.276954+0000","last_became_peered":"2023-07-14T11:17:55.276954+0000","last_unstale":"2023-07-14T11:17:57.433271+0000","last_undegraded":"2023-07-14T11:17:57.433271+0000","last_fullsized":"2023-07-14T11:17:57.433271+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:23:17.184781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":115,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.433752+0000","last_change":"2023-07-14T11:13:08.757882+0000","last_active":"2023-07-14T11:17:57.433752+0000","last_peered":"2023-07-14T11:17:57.433752+0000","last_clean":"2023-07-14T11:17:57.433752+0000","last_became_active":"2023-07-14T11:13:08.757541+0000","last_became_peered":"2023-07-14T11:13:08.757541+0000","last_unstale":"2023-07-14T11:17:57.433752+0000","last_undegraded":"2023-07-14T11:17:57.433752+0000","last_fullsized":"2023-07-14T11:17:57.433752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:23:11.820932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":263,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.270922+0000","last_change":"2023-07-14T11:13:01.370649+0000","last_active":"2023-07-14T11:17:57.270922+0000","last_peered":"2023-07-14T11:17:57.270922+0000","last_clean":"2023-07-14T11:17:57.270922+0000","last_became_active":"2023-07-14T11:13:01.369478+0000","last_became_peered":"2023-07-14T11:13:01.369478+0000","last_unstale":"2023-07-14T11:17:57.270922+0000","last_undegraded":"2023-07-14T11:17:57.270922+0000","last_fullsized":"2023-07-14T11:17:57.270922+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:00.254800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:00.254800+0000","last_clean_scrub_stamp":"2023-07-14T11:13:00.254800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:45:29.654803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.432900+0000","last_change":"2023-07-14T11:17:56.294975+0000","last_active":"2023-07-14T11:17:57.432900+0000","last_peered":"2023-07-14T11:17:57.432900+0000","last_clean":"2023-07-14T11:17:57.432900+0000","last_became_active":"2023-07-14T11:17:56.294682+0000","last_became_peered":"2023-07-14T11:17:56.294682+0000","last_unstale":"2023-07-14T11:17:57.432900+0000","last_undegraded":"2023-07-14T11:17:57.432900+0000","last_fullsized":"2023-07-14T11:17:57.432900+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:57:56.849299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.432764+0000","last_change":"2023-07-14T11:17:55.276250+0000","last_active":"2023-07-14T11:17:57.432764+0000","last_peered":"2023-07-14T11:17:57.432764+0000","last_clean":"2023-07-14T11:17:57.432764+0000","last_became_active":"2023-07-14T11:17:55.275893+0000","last_became_peered":"2023-07-14T11:17:55.275893+0000","last_unstale":"2023-07-14T11:17:57.432764+0000","last_undegraded":"2023-07-14T11:17:57.432764+0000","last_fullsized":"2023-07-14T11:17:57.432764+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:58:02.464932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":107,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.270581+0000","last_change":"2023-07-14T11:13:08.760609+0000","last_active":"2023-07-14T11:17:57.270581+0000","last_peered":"2023-07-14T11:17:57.270581+0000","last_clean":"2023-07-14T11:17:57.270581+0000","last_became_active":"2023-07-14T11:13:08.760285+0000","last_became_peered":"2023-07-14T11:13:08.760285+0000","last_unstale":"2023-07-14T11:17:57.270581+0000","last_undegraded":"2023-07-14T11:17:57.270581+0000","last_fullsized":"2023-07-14T11:17:57.270581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:48:45.565321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.433318+0000","last_change":"2023-07-14T11:17:56.283668+0000","last_active":"2023-07-14T11:17:57.433318+0000","last_peered":"2023-07-14T11:17:57.433318+0000","last_clean":"2023-07-14T11:17:57.433318+0000","last_became_active":"2023-07-14T11:17:56.283349+0000","last_became_peered":"2023-07-14T11:17:56.283349+0000","last_unstale":"2023-07-14T11:17:57.433318+0000","last_undegraded":"2023-07-14T11:17:57.433318+0000","last_fullsized":"2023-07-14T11:17:57.433318+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:33:10.495205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.268954+0000","last_change":"2023-07-14T11:17:55.262746+0000","last_active":"2023-07-14T11:17:57.268954+0000","last_peered":"2023-07-14T11:17:57.268954+0000","last_clean":"2023-07-14T11:17:57.268954+0000","last_became_active":"2023-07-14T11:17:55.262453+0000","last_became_peered":"2023-07-14T11:17:55.262453+0000","last_unstale":"2023-07-14T11:17:57.268954+0000","last_undegraded":"2023-07-14T11:17:57.268954+0000","last_fullsized":"2023-07-14T11:17:57.268954+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:19:47.552496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":107,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.271079+0000","last_change":"2023-07-14T11:13:08.923899+0000","last_active":"2023-07-14T11:17:57.271079+0000","last_peered":"2023-07-14T11:17:57.271079+0000","last_clean":"2023-07-14T11:17:57.271079+0000","last_became_active":"2023-07-14T11:13:08.923513+0000","last_became_peered":"2023-07-14T11:13:08.923513+0000","last_unstale":"2023-07-14T11:17:57.271079+0000","last_undegraded":"2023-07-14T11:17:57.271079+0000","last_fullsized":"2023-07-14T11:17:57.271079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:30:08.941878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.432991+0000","last_change":"2023-07-14T11:17:56.283076+0000","last_active":"2023-07-14T11:17:57.432991+0000","last_peered":"2023-07-14T11:17:57.432991+0000","last_clean":"2023-07-14T11:17:57.432991+0000","last_became_active":"2023-07-14T11:17:56.282813+0000","last_became_peered":"2023-07-14T11:17:56.282813+0000","last_unstale":"2023-07-14T11:17:57.432991+0000","last_undegraded":"2023-07-14T11:17:57.432991+0000","last_fullsized":"2023-07-14T11:17:57.432991+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:23:49.258381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"74'1","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.270949+0000","last_change":"2023-07-14T11:17:55.271607+0000","last_active":"2023-07-14T11:17:57.270949+0000","last_peered":"2023-07-14T11:17:57.270949+0000","last_clean":"2023-07-14T11:17:57.270949+0000","last_became_active":"2023-07-14T11:17:55.271309+0000","last_became_peered":"2023-07-14T11:17:55.271309+0000","last_unstale":"2023-07-14T11:17:57.270949+0000","last_undegraded":"2023-07-14T11:17:57.270949+0000","last_fullsized":"2023-07-14T11:17:57.270949+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:01:33.621776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":125,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.269249+0000","last_change":"2023-07-14T11:13:08.761726+0000","last_active":"2023-07-14T11:17:57.269249+0000","last_peered":"2023-07-14T11:17:57.269249+0000","last_clean":"2023-07-14T11:17:57.269249+0000","last_became_active":"2023-07-14T11:13:08.761365+0000","last_became_peered":"2023-07-14T11:13:08.761365+0000","last_unstale":"2023-07-14T11:17:57.269249+0000","last_undegraded":"2023-07-14T11:17:57.269249+0000","last_fullsized":"2023-07-14T11:17:57.269249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:35:48.591063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.270026+0000","last_change":"2023-07-14T11:17:56.273725+0000","last_active":"2023-07-14T11:17:57.270026+0000","last_peered":"2023-07-14T11:17:57.270026+0000","last_clean":"2023-07-14T11:17:57.270026+0000","last_became_active":"2023-07-14T11:17:56.273460+0000","last_became_peered":"2023-07-14T11:17:56.273460+0000","last_unstale":"2023-07-14T11:17:57.270026+0000","last_undegraded":"2023-07-14T11:17:57.270026+0000","last_fullsized":"2023-07-14T11:17:57.270026+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:42:12.056380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"74'2","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.434386+0000","last_change":"2023-07-14T11:17:55.273234+0000","last_active":"2023-07-14T11:17:57.434386+0000","last_peered":"2023-07-14T11:17:57.434386+0000","last_clean":"2023-07-14T11:17:57.434386+0000","last_became_active":"2023-07-14T11:17:55.272953+0000","last_became_peered":"2023-07-14T11:17:55.272953+0000","last_unstale":"2023-07-14T11:17:57.434386+0000","last_undegraded":"2023-07-14T11:17:57.434386+0000","last_fullsized":"2023-07-14T11:17:57.434386+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:35:37.364572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":113,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.434388+0000","last_change":"2023-07-14T11:13:08.762084+0000","last_active":"2023-07-14T11:17:57.434388+0000","last_peered":"2023-07-14T11:17:57.434388+0000","last_clean":"2023-07-14T11:17:57.434388+0000","last_became_active":"2023-07-14T11:13:08.761763+0000","last_became_peered":"2023-07-14T11:13:08.761763+0000","last_unstale":"2023-07-14T11:17:57.434388+0000","last_undegraded":"2023-07-14T11:17:57.434388+0000","last_fullsized":"2023-07-14T11:17:57.434388+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:12:36.676518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574912,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28428,"kb_used_data":1476,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343412,"statfs":{"total":96636764160,"available":96607653888,"internally_reserved":0,"allocated":1511424,"data_stored":998490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.80400000000000005,"15min":0.94199999999999995},"min":{"1min":0.441,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.93300000000000005,"5min":8.4339999999999993,"15min":8.4339999999999993},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.84599999999999997,"15min":0.97999999999999998},"min":{"1min":0.55100000000000005,"5min":0.377,"15min":0.377},"max":{"1min":0.88800000000000001,"5min":8.4559999999999995,"15min":8.4559999999999995},"last":0.55400000000000005}]},{"osd":1,"last update":"Fri Jul 14 11:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.79700000000000004,"15min":0.91300000000000003},"min":{"1min":0.54000000000000004,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.86699999999999999,"5min":6.3520000000000003,"15min":6.3520000000000003},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.88100000000000001,"15min":1.083},"min":{"1min":0.49299999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.877,"5min":6.8550000000000004,"15min":6.8550000000000004},"last":0.47799999999999998}]},{"osd":2,"last update":"Fri Jul 14 11:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.91200000000000003,"15min":1.137},"min":{"1min":0.51000000000000001,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.91400000000000003,"5min":7.0289999999999999,"15min":7.0289999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.70599999999999996,"15min":0.69399999999999995},"min":{"1min":0.48599999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.94499999999999995,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.746}]},{"osd":3,"last update":"Fri Jul 14 11:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.95699999999999996,"15min":1.198},"min":{"1min":0.51800000000000002,"5min":0.505,"15min":0.505},"max":{"1min":0.95699999999999996,"5min":10.337,"15min":10.337},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.753,"15min":0.76700000000000002},"min":{"1min":0.60799999999999998,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.97899999999999998,"5min":1.921,"15min":1.921},"last":0.57999999999999996}]},{"osd":4,"last update":"Fri Jul 14 11:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.62,"15min":0.58999999999999997},"min":{"1min":0.44500000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.89900000000000002,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.72499999999999998,"15min":0.70199999999999996},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.88200000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.76300000000000001}]},{"osd":5,"last update":"Fri Jul 14 11:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.68899999999999995,"15min":0.67500000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.89400000000000002,"5min":1.04,"15min":1.04},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.746,"5min":0.754,"15min":0.73699999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.92100000000000004,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.72499999999999998}]},{"osd":6,"last update":"Fri Jul 14 11:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.70899999999999996,"15min":0.67700000000000005},"min":{"1min":0.499,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.94199999999999995,"5min":1.002,"15min":1.002},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.71699999999999997,"15min":0.68899999999999995},"min":{"1min":0.50900000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.90200000000000002,"5min":1.018,"15min":1.018},"last":0.80300000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574913,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":904,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":925696,"data_stored":409664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.71499999999999997,"15min":0.70799999999999996},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.93799999999999994,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.73499999999999999,"15min":0.72099999999999997},"min":{"1min":0.45300000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.93100000000000005,"5min":1.167,"15min":1.167},"last":0.89000000000000001}]},{"osd":1,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.71099999999999997,"15min":0.68899999999999995},"min":{"1min":0.53100000000000003,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.97699999999999998,"5min":1.006,"15min":1.006},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.73599999999999999,"15min":0.71599999999999997},"min":{"1min":0.50900000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.0109999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.94299999999999995}]},{"osd":2,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.69399999999999995,"15min":0.67700000000000005},"min":{"1min":0.51300000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.95199999999999996,"5min":1.45,"15min":1.45},"last":0.87},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76900000000000002,"15min":0.78100000000000003},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.94799999999999995,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.97099999999999997}]},{"osd":3,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.752,"15min":0.75},"min":{"1min":0.56499999999999995,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.002,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.747,"15min":0.74299999999999999},"min":{"1min":0.60099999999999998,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.91600000000000004,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.89800000000000002}]},{"osd":4,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.68799999999999994,"15min":0.70599999999999996},"min":{"1min":0.44400000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.94699999999999995,"5min":1.712,"15min":1.712},"last":0.627},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.71399999999999997,"15min":0.72399999999999998},"min":{"1min":0.47299999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.871,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.66200000000000003}]},{"osd":5,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.71299999999999997,"15min":0.71799999999999997},"min":{"1min":0.51500000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.89800000000000002,"5min":2.8820000000000001,"15min":2.8820000000000001},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76900000000000002,"15min":0.78700000000000003},"min":{"1min":0.496,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.98399999999999999,"5min":1.129,"15min":1.129},"last":0.68200000000000005}]},{"osd":7,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.78000000000000003,"15min":0.80100000000000005},"min":{"1min":0.47399999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0569999999999999,"5min":1.333,"15min":1.333},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.76800000000000002,"15min":0.79000000000000004},"min":{"1min":0.54100000000000004,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.92700000000000005,"5min":1.55,"15min":1.55},"last":0.70499999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574912,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":900,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":921600,"data_stored":408212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:17:04 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.42299999999999999,"15min":0.438},"min":{"1min":0.28899999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.54300000000000004,"5min":0.996,"15min":0.996},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.47699999999999998,"15min":0.48299999999999998},"min":{"1min":0.34499999999999997,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.63100000000000001,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.30199999999999999}]},{"osd":2,"last update":"Fri Jul 14 11:17:04 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.52800000000000002,"15min":0.56499999999999995},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.70799999999999996,"5min":2.476,"15min":2.476},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.55800000000000005,"15min":0.61799999999999999},"min":{"1min":0.39800000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.68300000000000005,"5min":2.6299999999999999,"15min":2.6299999999999999},"last":0.39100000000000001}]},{"osd":3,"last update":"Fri Jul 14 11:17:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.53200000000000003,"15min":0.52300000000000002},"min":{"1min":0.40200000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.66300000000000003,"5min":0.748,"15min":0.748},"last":0.435},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48199999999999998,"15min":0.49399999999999999},"min":{"1min":0.41699999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.60299999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.47899999999999998}]},{"osd":4,"last update":"Fri Jul 14 11:17:04 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.75,"15min":0.753},"min":{"1min":0.61199999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0309999999999999,"5min":1.363,"15min":1.363},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.76800000000000002,"15min":0.77400000000000002},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.1160000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.61299999999999999}]},{"osd":5,"last update":"Fri Jul 14 11:17:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.76700000000000002,"15min":0.77100000000000002},"min":{"1min":0.60199999999999998,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.2250000000000001,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.79300000000000004,"15min":0.81799999999999995},"min":{"1min":0.58199999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":0.98299999999999998,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.60199999999999998}]},{"osd":6,"last update":"Fri Jul 14 11:17:04 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.76800000000000002,"15min":0.79600000000000004},"min":{"1min":0.56200000000000006,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.97599999999999998,"5min":1.298,"15min":1.298},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77700000000000002,"15min":0.78700000000000003},"min":{"1min":0.54800000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1899999999999999,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.58999999999999997}]},{"osd":7,"last update":"Fri Jul 14 11:17:04 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.78600000000000003,"15min":0.81599999999999995},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.097,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.63},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.77400000000000002,"15min":0.78700000000000003},"min":{"1min":0.624,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.0800000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.73299999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574910,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28424,"kb_used_data":1472,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343416,"statfs":{"total":96636764160,"available":96607657984,"internally_reserved":0,"allocated":1507328,"data_stored":998468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.44,"15min":0.435},"min":{"1min":0.33900000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.59999999999999998,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.44400000000000001,"15min":0.441},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.64100000000000001,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.38100000000000001}]},{"osd":2,"last update":"Fri Jul 14 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.375,"5min":0.307,"15min":0.307},"max":{"1min":0.58599999999999997,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.501},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.497,"15min":0.502},"min":{"1min":0.36299999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.66600000000000004,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.53300000000000003}]},{"osd":3,"last update":"Fri Jul 14 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.44900000000000001,"15min":0.42699999999999999},"min":{"1min":0.36099999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.64300000000000002,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.52700000000000002,"15min":0.52500000000000002},"min":{"1min":0.42299999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.64400000000000002,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.54900000000000004}]},{"osd":4,"last update":"Fri Jul 14 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.76300000000000001,"15min":0.76600000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.044,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.72999999999999998,"15min":0.70699999999999996},"min":{"1min":0.53200000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.83199999999999996}]},{"osd":5,"last update":"Fri Jul 14 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.74399999999999999,"15min":0.72899999999999998},"min":{"1min":0.57799999999999996,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77400000000000002,"15min":0.77900000000000003},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.90900000000000003}]},{"osd":6,"last update":"Fri Jul 14 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.73499999999999999,"15min":0.72499999999999998},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.01,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.77600000000000002,"15min":0.78000000000000003},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.022,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.89900000000000002}]},{"osd":7,"last update":"Fri Jul 14 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.80800000000000005,"15min":0.81999999999999995},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.0900000000000001,"5min":1.149,"15min":1.149},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.80300000000000005,"15min":0.78300000000000003},"min":{"1min":0.58999999999999997,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.0600000000000001,"5min":1.081,"15min":1.081},"last":0.85499999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574910,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":904,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":925696,"data_stored":408842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.42799999999999999,"15min":0.44700000000000001},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.63900000000000001,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.436,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.33100000000000002}]},{"osd":1,"last update":"Fri Jul 14 11:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.47999999999999998,"15min":0.48599999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.68400000000000005,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.499,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.39500000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.61399999999999999,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.55700000000000005}]},{"osd":3,"last update":"Fri Jul 14 11:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.501,"15min":0.497},"min":{"1min":0.35699999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57799999999999996,"15min":0.58699999999999997},"min":{"1min":0.42099999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.72599999999999998,"5min":1.034,"15min":1.034},"last":0.49299999999999999}]},{"osd":4,"last update":"Fri Jul 14 11:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.76200000000000001,"15min":0.77200000000000002},"min":{"1min":0.55800000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.92700000000000005,"5min":1.212,"15min":1.212},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.77700000000000002,"15min":0.78800000000000003},"min":{"1min":0.64100000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.1000000000000001,"5min":1.198,"15min":1.198},"last":0.66400000000000003}]},{"osd":5,"last update":"Fri Jul 14 11:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.76900000000000002,"15min":0.79000000000000004},"min":{"1min":0.59499999999999997,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.98899999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.80000000000000004,"15min":0.82399999999999995},"min":{"1min":0.55000000000000004,"5min":0.495,"15min":0.495},"max":{"1min":1.0609999999999999,"5min":1.351,"15min":1.351},"last":0.74199999999999999}]},{"osd":6,"last update":"Fri Jul 14 11:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.78100000000000003,"15min":0.79000000000000004},"min":{"1min":0.60899999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.1180000000000001,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.79900000000000004,"15min":0.82299999999999995},"min":{"1min":0.59499999999999997,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0129999999999999,"5min":1.282,"15min":1.282},"last":0.623}]},{"osd":7,"last update":"Fri Jul 14 11:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.79300000000000004,"15min":0.80400000000000005},"min":{"1min":0.628,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.0389999999999999,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.78600000000000003,"15min":0.80700000000000005},"min":{"1min":0.63,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.95299999999999996,"5min":1.244,"15min":1.244},"last":0.83099999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574910,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":917504,"data_stored":408682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.42899999999999999,"15min":0.44800000000000001},"min":{"1min":0.34399999999999997,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.67800000000000005,"5min":0.754,"15min":0.754},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.502,"5min":0.45500000000000002,"15min":0.45100000000000001},"min":{"1min":0.317,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.53200000000000003}]},{"osd":1,"last update":"Fri Jul 14 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.45100000000000001,"15min":0.45300000000000001},"min":{"1min":0.34000000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.49299999999999999,"15min":0.498},"min":{"1min":0.44500000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.72699999999999998,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.438}]},{"osd":2,"last update":"Fri Jul 14 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.55200000000000005,"15min":0.54600000000000004},"min":{"1min":0.42899999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.627,"5min":0.58799999999999997,"15min":0.59799999999999998},"min":{"1min":0.46500000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.79600000000000004,"5min":1.585,"15min":1.585},"last":0.46300000000000002}]},{"osd":4,"last update":"Fri Jul 14 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.75900000000000001,"15min":0.76300000000000001},"min":{"1min":0.53200000000000003,"5min":0.372,"15min":0.372},"max":{"1min":1.0029999999999999,"5min":1.216,"15min":1.216},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.77700000000000002,"15min":0.76000000000000001},"min":{"1min":0.61899999999999999,"5min":0.504,"15min":0.504},"max":{"1min":1.0609999999999999,"5min":1.147,"15min":1.147},"last":0.86199999999999999}]},{"osd":5,"last update":"Fri Jul 14 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.76700000000000002,"15min":0.76400000000000001},"min":{"1min":0.65400000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.024,"5min":1.413,"15min":1.413},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.81799999999999995,"15min":0.85199999999999998},"min":{"1min":0.621,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.097,"5min":1.657,"15min":1.657},"last":0.74299999999999999}]},{"osd":6,"last update":"Fri Jul 14 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.66300000000000003,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.133,"5min":1.726,"15min":1.726},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.78900000000000003,"15min":0.80100000000000005},"min":{"1min":0.61099999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.085,"5min":1.333,"15min":1.333},"last":0.84399999999999997}]},{"osd":7,"last update":"Fri Jul 14 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.81899999999999995,"15min":0.83799999999999997},"min":{"1min":0.623,"5min":0.437,"15min":0.437},"max":{"1min":1.1459999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.83299999999999996,"15min":0.84199999999999997},"min":{"1min":0.59599999999999997,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1579999999999999,"5min":1.268,"15min":1.268},"last":0.81699999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574910,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":912,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":933888,"data_stored":409768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.64400000000000002,"15min":0.63400000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.85199999999999998,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.67500000000000004,"15min":0.69099999999999995},"min":{"1min":0.42699999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.83199999999999996,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.751}]},{"osd":1,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.66100000000000003,"15min":0.66900000000000004},"min":{"1min":0.46100000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.82899999999999996,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.71599999999999997,"15min":0.71399999999999997},"min":{"1min":0.49299999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.93700000000000006,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.65100000000000002}]},{"osd":2,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.71799999999999997,"15min":0.71299999999999997},"min":{"1min":0.51000000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.85299999999999998,"5min":1.48,"15min":1.48},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.73899999999999999,"15min":0.74199999999999999},"min":{"1min":0.57499999999999996,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.84499999999999997,"5min":1.23,"15min":1.23},"last":0.78500000000000003}]},{"osd":3,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.69899999999999995,"15min":0.71499999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.81299999999999994,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.748,"15min":0.74199999999999999},"min":{"1min":0.55200000000000005,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.88100000000000001,"5min":1.145,"15min":1.145},"last":0.56599999999999995}]},{"osd":5,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.71799999999999997,"15min":0.76000000000000001},"min":{"1min":0.45300000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.90000000000000002,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.71699999999999997,"15min":0.76500000000000001},"min":{"1min":0.48999999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.81499999999999995,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.624}]},{"osd":6,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71499999999999997,"15min":0.72299999999999998},"min":{"1min":0.45600000000000002,"5min":0.436,"15min":0.436},"max":{"1min":0.86399999999999999,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76600000000000001,"15min":0.77600000000000002},"min":{"1min":0.56999999999999995,"5min":0.442,"15min":0.442},"max":{"1min":0.96099999999999997,"5min":1.3,"15min":1.3},"last":0.59899999999999998}]},{"osd":7,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.746,"15min":0.76900000000000002},"min":{"1min":0.53500000000000003,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.86499999999999999,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.81000000000000005,"15min":0.84399999999999997},"min":{"1min":0.50900000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.92200000000000004,"5min":1.379,"15min":1.379},"last":0.82499999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574912,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":917504,"data_stored":408134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.63700000000000001,"15min":0.64200000000000002},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.97299999999999998,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.65000000000000002,"15min":0.64000000000000001},"min":{"1min":0.47599999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.88,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.67000000000000004}]},{"osd":1,"last update":"Fri Jul 14 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.66200000000000003,"15min":0.67700000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.78700000000000003,"5min":1.343,"15min":1.343},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.66100000000000003,"15min":0.65100000000000002},"min":{"1min":0.51300000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.57899999999999996}]},{"osd":2,"last update":"Fri Jul 14 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.72799999999999998,"15min":0.73799999999999999},"min":{"1min":0.59399999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.93500000000000005,"5min":1.034,"15min":1.034},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.73999999999999999,"15min":0.76600000000000001},"min":{"1min":0.51000000000000001,"5min":0.496,"15min":0.496},"max":{"1min":0.83199999999999996,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.60499999999999998}]},{"osd":3,"last update":"Fri Jul 14 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.73699999999999999,"15min":0.76500000000000001},"min":{"1min":0.53500000000000003,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.92800000000000005,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.73799999999999999,"15min":0.77800000000000002},"min":{"1min":0.63500000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.90900000000000003,"5min":1.806,"15min":1.806},"last":0.55700000000000005}]},{"osd":4,"last update":"Fri Jul 14 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.63700000000000001,"15min":0.65300000000000002},"min":{"1min":0.42599999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.88800000000000001,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.70499999999999996,"15min":0.75},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.996,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.72099999999999997}]},{"osd":6,"last update":"Fri Jul 14 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.71899999999999997,"15min":0.747},"min":{"1min":0.52200000000000002,"5min":0.435,"15min":0.435},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.76200000000000001,"15min":0.79900000000000004},"min":{"1min":0.432,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0629999999999999,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.627}]},{"osd":7,"last update":"Fri Jul 14 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.78400000000000003,"15min":0.84199999999999997},"min":{"1min":0.45700000000000002,"5min":0.435,"15min":0.435},"max":{"1min":1.081,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.82599999999999996,"15min":0.86799999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.95899999999999996,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.73299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T11:18:05.590 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T11:18:05.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.794+0000 7fcb6e7ff700 1 Processor -- start 2023-07-14T11:18:05.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.794+0000 7fcb6e7ff700 1 -- start start 2023-07-14T11:18:05.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.795+0000 7fcb6e7ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fcb680b4510 0x7fcb680b6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:05.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.795+0000 7fcb6e7ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb680b7f50 con 0x7fcb680b5d90 2023-07-14T11:18:05.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.795+0000 7fcb6e7ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb680cdca0 con 0x7fcb680d0b10 2023-07-14T11:18:05.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.795+0000 7fcb6e7ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb680b48e0 con 0x7fcb680b4510 2023-07-14T11:18:05.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.795+0000 7fcb677fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fcb680b5d90 0x7fcb680cd590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:59542/0 (socket says 172.21.15.84:59542) 2023-07-14T11:18:05.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.795+0000 7fcb677fe700 1 -- 172.21.15.84:0/2143787855 learned_addr learned my addr 172.21.15.84:0/2143787855 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:18:05.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.795+0000 7fcb66ffd700 1 -- 172.21.15.84:0/2143787855 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 113908673 0 0) 0x7fcb680b7f50 con 0x7fcb680b5d90 2023-07-14T11:18:05.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.795+0000 7fcb66ffd700 1 -- 172.21.15.84:0/2143787855 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb500035b0 con 0x7fcb680b5d90 2023-07-14T11:18:05.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.796+0000 7fcb67fff700 1 --2- 172.21.15.84:0/2143787855 >> v2:172.21.15.179:3300/0 conn(0x7fcb680b4510 0x7fcb680b6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:05.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.796+0000 7fcb66ffd700 1 -- 172.21.15.84:0/2143787855 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3138119925 0 0) 0x7fcb500035b0 con 0x7fcb680b5d90 2023-07-14T11:18:05.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.796+0000 7fcb66ffd700 1 -- 172.21.15.84:0/2143787855 >> v2:172.21.15.179:3300/0 conn(0x7fcb680b4510 msgr2=0x7fcb680b6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:05.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.796+0000 7fcb66ffd700 1 --2- 172.21.15.84:0/2143787855 >> v2:172.21.15.179:3300/0 conn(0x7fcb680b4510 0x7fcb680b6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:05.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.796+0000 7fcb66ffd700 1 -- 172.21.15.84:0/2143787855 >> v1:172.21.15.179:6789/0 conn(0x7fcb680d0b10 legacy=0x7fcb680b83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:05.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.796+0000 7fcb66ffd700 1 -- 172.21.15.84:0/2143787855 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb680b7340 con 0x7fcb680b5d90 2023-07-14T11:18:05.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.796+0000 7fcb66ffd700 1 -- 172.21.15.84:0/2143787855 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7fcb5c001670 con 0x7fcb680b5d90 2023-07-14T11:18:05.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.796+0000 7fcb66ffd700 1 -- 172.21.15.84:0/2143787855 >> v1:172.21.15.84:6789/0 conn(0x7fcb680b5d90 legacy=0x7fcb680cd590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:05.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.796+0000 7fcb66ffd700 1 --2- 172.21.15.84:0/2143787855 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb50003a50 0x7fcb50003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:05.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.796+0000 7fcb66ffd700 1 --2- 172.21.15.84:0/2143787855 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb50004850 0x7fcb50004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:05.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.796+0000 7fcb66ffd700 1 --2- 172.21.15.84:0/2143787855 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb50005400 0x7fcb5000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:05.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.796+0000 7fcb66ffd700 1 -- 172.21.15.84:0/2143787855 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5000c280 con 0x7fcb50004850 2023-07-14T11:18:05.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.796+0000 7fcb66ffd700 1 -- 172.21.15.84:0/2143787855 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5000c3f0 con 0x7fcb50003a50 2023-07-14T11:18:05.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.796+0000 7fcb66ffd700 1 -- 172.21.15.84:0/2143787855 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5000c5b0 con 0x7fcb50005400 2023-07-14T11:18:05.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.796+0000 7fcb677fe700 1 --2- 172.21.15.84:0/2143787855 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb50004850 0x7fcb50004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:05.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.796+0000 7fcb67fff700 1 --2- 172.21.15.84:0/2143787855 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb50003a50 0x7fcb50003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:05.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.797+0000 7fcb6cd9c700 1 --2- 172.21.15.84:0/2143787855 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb50005400 0x7fcb5000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:05.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.797+0000 7fcb677fe700 1 -- 172.21.15.84:0/2143787855 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb50005400 msgr2=0x7fcb5000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:05.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.797+0000 7fcb677fe700 1 --2- 172.21.15.84:0/2143787855 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb50005400 0x7fcb5000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:05.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.797+0000 7fcb677fe700 1 -- 172.21.15.84:0/2143787855 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb50003a50 msgr2=0x7fcb50003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:05.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.797+0000 7fcb677fe700 1 --2- 172.21.15.84:0/2143787855 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb50003a50 0x7fcb50003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:05.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.797+0000 7fcb677fe700 1 -- 172.21.15.84:0/2143787855 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb500035b0 con 0x7fcb50004850 2023-07-14T11:18:05.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.797+0000 7fcb67fff700 1 --2- 172.21.15.84:0/2143787855 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb50003a50 0x7fcb50003e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:18:05.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.797+0000 7fcb6cd9c700 1 -- 172.21.15.84:0/2143787855 reap_dead start 2023-07-14T11:18:05.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.797+0000 7fcb677fe700 1 --2- 172.21.15.84:0/2143787855 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb50004850 0x7fcb50004cc0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c00c160 tx=0x7fcb50005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b019fd81b43f4dc2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:05.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.797+0000 7fcb66ffd700 1 -- 172.21.15.84:0/2143787855 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c007b70 con 0x7fcb50004850 2023-07-14T11:18:05.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.797+0000 7fcb66ffd700 1 -- 172.21.15.84:0/2143787855 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb5c00cd00 con 0x7fcb50004850 2023-07-14T11:18:05.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.797+0000 7fcb66ffd700 1 -- 172.21.15.84:0/2143787855 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c005ba0 con 0x7fcb50004850 2023-07-14T11:18:05.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.798+0000 7fcb6e7ff700 1 -- 172.21.15.84:0/2143787855 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb50004850 msgr2=0x7fcb50004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:05.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.798+0000 7fcb6e7ff700 1 --2- 172.21.15.84:0/2143787855 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb50004850 0x7fcb50004cc0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c00c160 tx=0x7fcb50005880 comp rx=0 tx=0).stop 2023-07-14T11:18:05.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.798+0000 7fcb6e7ff700 1 -- 172.21.15.84:0/2143787855 shutdown_connections 2023-07-14T11:18:05.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.798+0000 7fcb6e7ff700 1 --2- 172.21.15.84:0/2143787855 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb50004850 0x7fcb50004cc0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:05.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.798+0000 7fcb6e7ff700 1 -- 172.21.15.84:0/2143787855 >> 172.21.15.84:0/2143787855 conn(0x7fcb6809c1d0 msgr2=0x7fcb680d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:05.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.798+0000 7fcb6e7ff700 1 -- 172.21.15.84:0/2143787855 shutdown_connections 2023-07-14T11:18:05.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.798+0000 7fcb6e7ff700 1 -- 172.21.15.84:0/2143787855 wait complete. 2023-07-14T11:18:05.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.800+0000 7fcb6e7ff700 1 Processor -- start 2023-07-14T11:18:05.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.800+0000 7fcb6e7ff700 1 -- start start 2023-07-14T11:18:05.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.801+0000 7fcb6e7ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb50004850 0x7fcb680ce600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:05.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.801+0000 7fcb6e7ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb681524e0 0x7fcb680ceb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:05.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.801+0000 7fcb6e7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb68152f00 0x7fcb68153370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:05.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.801+0000 7fcb6e7ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb681538b0 con 0x7fcb681524e0 2023-07-14T11:18:05.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.801+0000 7fcb6e7ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb68151780 con 0x7fcb50004850 2023-07-14T11:18:05.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.801+0000 7fcb6e7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb680cf170 con 0x7fcb68152f00 2023-07-14T11:18:05.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.801+0000 7fcb677fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb681524e0 0x7fcb680ceb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:05.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.801+0000 7fcb677fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb681524e0 0x7fcb680ceb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36588/0 (socket says 172.21.15.84:36588) 2023-07-14T11:18:05.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.801+0000 7fcb677fe700 1 -- 172.21.15.84:0/1301024881 learned_addr learned my addr 172.21.15.84:0/1301024881 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:05.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.801+0000 7fcb67fff700 1 --2- 172.21.15.84:0/1301024881 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb50004850 0x7fcb680ce600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:05.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.801+0000 7fcb6cd9c700 1 --2- 172.21.15.84:0/1301024881 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb68152f00 0x7fcb68153370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:05.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.802+0000 7fcb677fe700 1 -- 172.21.15.84:0/1301024881 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb68152f00 msgr2=0x7fcb68153370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:05.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.802+0000 7fcb677fe700 1 --2- 172.21.15.84:0/1301024881 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb68152f00 0x7fcb68153370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:05.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.802+0000 7fcb677fe700 1 -- 172.21.15.84:0/1301024881 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb50004850 msgr2=0x7fcb680ce600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:05.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.802+0000 7fcb677fe700 1 --2- 172.21.15.84:0/1301024881 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb50004850 0x7fcb680ce600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:05.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.802+0000 7fcb677fe700 1 -- 172.21.15.84:0/1301024881 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb680cf450 con 0x7fcb681524e0 2023-07-14T11:18:05.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.802+0000 7fcb677fe700 1 --2- 172.21.15.84:0/1301024881 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb681524e0 0x7fcb680ceb40 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fcb5000c3c0 tx=0x7fcb5c001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:05.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.802+0000 7fcb64ff9700 1 -- 172.21.15.84:0/1301024881 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c00ce70 con 0x7fcb681524e0 2023-07-14T11:18:05.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.802+0000 7fcb64ff9700 1 -- 172.21.15.84:0/1301024881 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb5c0070d0 con 0x7fcb681524e0 2023-07-14T11:18:05.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.802+0000 7fcb6e7ff700 1 -- 172.21.15.84:0/1301024881 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb680cf730 con 0x7fcb681524e0 2023-07-14T11:18:05.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.802+0000 7fcb64ff9700 1 -- 172.21.15.84:0/1301024881 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c007480 con 0x7fcb681524e0 2023-07-14T11:18:05.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.802+0000 7fcb6e7ff700 1 -- 172.21.15.84:0/1301024881 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb680c7580 con 0x7fcb681524e0 2023-07-14T11:18:05.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.803+0000 7fcb6e7ff700 1 -- 172.21.15.84:0/1301024881 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb6804e280 con 0x7fcb681524e0 2023-07-14T11:18:05.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.804+0000 7fcb64ff9700 1 -- 172.21.15.84:0/1301024881 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7fcb5c0075e0 con 0x7fcb681524e0 2023-07-14T11:18:05.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.805+0000 7fcb64ff9700 1 --2- 172.21.15.84:0/1301024881 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fcb5406b040 0x7fcb5406d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:05.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.805+0000 7fcb64ff9700 1 -- 172.21.15.84:0/1301024881 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcb5c08a810 con 0x7fcb681524e0 2023-07-14T11:18:05.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.805+0000 7fcb67fff700 1 --2- 172.21.15.84:0/1301024881 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fcb5406b040 0x7fcb5406d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:05.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.806+0000 7fcb67fff700 1 --2- 172.21.15.84:0/1301024881 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fcb5406b040 0x7fcb5406d4f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fcb6815a3f0 tx=0x7fcb58008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:05.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:05.811+0000 7fcb64ff9700 1 -- 172.21.15.84:0/1301024881 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fcb5c0555e0 con 0x7fcb681524e0 2023-07-14T11:18:06.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.001+0000 7fcb6e7ff700 1 -- 172.21.15.84:0/1301024881 --> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcb681538b0 con 0x7fcb5406b040 2023-07-14T11:18:06.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.010+0000 7fcb64ff9700 1 -- 172.21.15.84:0/1301024881 <== mgr.4104 v2:172.21.15.84:6832/379617029 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311106 (secure 0 0 0) 0x7fcb681538b0 con 0x7fcb5406b040 2023-07-14T11:18:06.017 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:18:06.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.015+0000 7fcb6e7ff700 1 -- 172.21.15.84:0/1301024881 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fcb5406b040 msgr2=0x7fcb5406d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:06.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.015+0000 7fcb6e7ff700 1 --2- 172.21.15.84:0/1301024881 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fcb5406b040 0x7fcb5406d4f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fcb6815a3f0 tx=0x7fcb58008040 comp rx=0 tx=0).stop 2023-07-14T11:18:06.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.015+0000 7fcb6e7ff700 1 -- 172.21.15.84:0/1301024881 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb681524e0 msgr2=0x7fcb680ceb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:06.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.015+0000 7fcb6e7ff700 1 --2- 172.21.15.84:0/1301024881 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb681524e0 0x7fcb680ceb40 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fcb5000c3c0 tx=0x7fcb5c001930 comp rx=0 tx=0).stop 2023-07-14T11:18:06.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.015+0000 7fcb6e7ff700 1 -- 172.21.15.84:0/1301024881 shutdown_connections 2023-07-14T11:18:06.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.015+0000 7fcb6e7ff700 1 --2- 172.21.15.84:0/1301024881 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fcb5406b040 0x7fcb5406d4f0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:06.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.015+0000 7fcb6e7ff700 1 --2- 172.21.15.84:0/1301024881 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb68152f00 0x7fcb68153370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:06.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.015+0000 7fcb6e7ff700 1 --2- 172.21.15.84:0/1301024881 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb50004850 0x7fcb680ce600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:06.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.015+0000 7fcb6e7ff700 1 --2- 172.21.15.84:0/1301024881 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb681524e0 0x7fcb680ceb40 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:06.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.015+0000 7fcb6e7ff700 1 -- 172.21.15.84:0/1301024881 >> 172.21.15.84:0/1301024881 conn(0x7fcb6809c1d0 msgr2=0x7fcb680b82e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:06.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.015+0000 7fcb6e7ff700 1 -- 172.21.15.84:0/1301024881 shutdown_connections 2023-07-14T11:18:06.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.015+0000 7fcb6e7ff700 1 -- 172.21.15.84:0/1301024881 wait complete. 2023-07-14T11:18:06.021 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-07-14T11:18:06.036 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":220,"stamp":"2023-07-14T11:18:04.134145+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":197,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223976,"kb_used_data":8360,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754750744,"statfs":{"total":773094113280,"available":772864761856,"internally_reserved":0,"allocated":8560640,"data_stored":4450260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001496"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.270851+0000","last_change":"2023-07-14T11:17:56.278047+0000","last_active":"2023-07-14T11:17:57.270851+0000","last_peered":"2023-07-14T11:17:57.270851+0000","last_clean":"2023-07-14T11:17:57.270851+0000","last_became_active":"2023-07-14T11:17:56.277754+0000","last_became_peered":"2023-07-14T11:17:56.277754+0000","last_unstale":"2023-07-14T11:17:57.270851+0000","last_undegraded":"2023-07-14T11:17:57.270851+0000","last_fullsized":"2023-07-14T11:17:57.270851+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:05:06.697870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.432586+0000","last_change":"2023-07-14T11:17:56.295058+0000","last_active":"2023-07-14T11:17:57.432586+0000","last_peered":"2023-07-14T11:17:57.432586+0000","last_clean":"2023-07-14T11:17:57.432586+0000","last_became_active":"2023-07-14T11:17:56.294812+0000","last_became_peered":"2023-07-14T11:17:56.294812+0000","last_unstale":"2023-07-14T11:17:57.432586+0000","last_undegraded":"2023-07-14T11:17:57.432586+0000","last_fullsized":"2023-07-14T11:17:57.432586+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:18:17.091451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.269094+0000","last_change":"2023-07-14T11:17:56.296902+0000","last_active":"2023-07-14T11:17:57.269094+0000","last_peered":"2023-07-14T11:17:57.269094+0000","last_clean":"2023-07-14T11:17:57.269094+0000","last_became_active":"2023-07-14T11:17:56.296632+0000","last_became_peered":"2023-07-14T11:17:56.296632+0000","last_unstale":"2023-07-14T11:17:57.269094+0000","last_undegraded":"2023-07-14T11:17:57.269094+0000","last_fullsized":"2023-07-14T11:17:57.269094+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:28:02.434633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.433450+0000","last_change":"2023-07-14T11:17:56.265557+0000","last_active":"2023-07-14T11:17:57.433450+0000","last_peered":"2023-07-14T11:17:57.433450+0000","last_clean":"2023-07-14T11:17:57.433450+0000","last_became_active":"2023-07-14T11:17:56.265276+0000","last_became_peered":"2023-07-14T11:17:56.265276+0000","last_unstale":"2023-07-14T11:17:57.433450+0000","last_undegraded":"2023-07-14T11:17:57.433450+0000","last_fullsized":"2023-07-14T11:17:57.433450+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:52:32.334837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.270039+0000","last_change":"2023-07-14T11:17:56.278573+0000","last_active":"2023-07-14T11:17:57.270039+0000","last_peered":"2023-07-14T11:17:57.270039+0000","last_clean":"2023-07-14T11:17:57.270039+0000","last_became_active":"2023-07-14T11:17:56.278319+0000","last_became_peered":"2023-07-14T11:17:56.278319+0000","last_unstale":"2023-07-14T11:17:57.270039+0000","last_undegraded":"2023-07-14T11:17:57.270039+0000","last_fullsized":"2023-07-14T11:17:57.270039+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:18:17.785724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.433562+0000","last_change":"2023-07-14T11:17:56.279620+0000","last_active":"2023-07-14T11:17:57.433562+0000","last_peered":"2023-07-14T11:17:57.433562+0000","last_clean":"2023-07-14T11:17:57.433562+0000","last_became_active":"2023-07-14T11:17:56.279106+0000","last_became_peered":"2023-07-14T11:17:56.279106+0000","last_unstale":"2023-07-14T11:17:57.433562+0000","last_undegraded":"2023-07-14T11:17:57.433562+0000","last_fullsized":"2023-07-14T11:17:57.433562+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:50:50.138300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.434318+0000","last_change":"2023-07-14T11:17:56.281103+0000","last_active":"2023-07-14T11:17:57.434318+0000","last_peered":"2023-07-14T11:17:57.434318+0000","last_clean":"2023-07-14T11:17:57.434318+0000","last_became_active":"2023-07-14T11:17:56.280804+0000","last_became_peered":"2023-07-14T11:17:56.280804+0000","last_unstale":"2023-07-14T11:17:57.434318+0000","last_undegraded":"2023-07-14T11:17:57.434318+0000","last_fullsized":"2023-07-14T11:17:57.434318+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:47:58.323919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.269928+0000","last_change":"2023-07-14T11:17:56.276231+0000","last_active":"2023-07-14T11:17:57.269928+0000","last_peered":"2023-07-14T11:17:57.269928+0000","last_clean":"2023-07-14T11:17:57.269928+0000","last_became_active":"2023-07-14T11:17:56.275958+0000","last_became_peered":"2023-07-14T11:17:56.275958+0000","last_unstale":"2023-07-14T11:17:57.269928+0000","last_undegraded":"2023-07-14T11:17:57.269928+0000","last_fullsized":"2023-07-14T11:17:57.269928+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:43:39.497391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.433872+0000","last_change":"2023-07-14T11:17:56.280772+0000","last_active":"2023-07-14T11:17:57.433872+0000","last_peered":"2023-07-14T11:17:57.433872+0000","last_clean":"2023-07-14T11:17:57.433872+0000","last_became_active":"2023-07-14T11:17:56.280480+0000","last_became_peered":"2023-07-14T11:17:56.280480+0000","last_unstale":"2023-07-14T11:17:57.433872+0000","last_undegraded":"2023-07-14T11:17:57.433872+0000","last_fullsized":"2023-07-14T11:17:57.433872+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:41:19.412625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.433399+0000","last_change":"2023-07-14T11:17:56.274001+0000","last_active":"2023-07-14T11:17:57.433399+0000","last_peered":"2023-07-14T11:17:57.433399+0000","last_clean":"2023-07-14T11:17:57.433399+0000","last_became_active":"2023-07-14T11:17:56.273729+0000","last_became_peered":"2023-07-14T11:17:56.273729+0000","last_unstale":"2023-07-14T11:17:57.433399+0000","last_undegraded":"2023-07-14T11:17:57.433399+0000","last_fullsized":"2023-07-14T11:17:57.433399+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:20:41.534310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.432813+0000","last_change":"2023-07-14T11:17:56.295489+0000","last_active":"2023-07-14T11:17:57.432813+0000","last_peered":"2023-07-14T11:17:57.432813+0000","last_clean":"2023-07-14T11:17:57.432813+0000","last_became_active":"2023-07-14T11:17:56.295231+0000","last_became_peered":"2023-07-14T11:17:56.295231+0000","last_unstale":"2023-07-14T11:17:57.432813+0000","last_undegraded":"2023-07-14T11:17:57.432813+0000","last_fullsized":"2023-07-14T11:17:57.432813+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:50:50.138300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.433722+0000","last_change":"2023-07-14T11:17:56.295578+0000","last_active":"2023-07-14T11:17:57.433722+0000","last_peered":"2023-07-14T11:17:57.433722+0000","last_clean":"2023-07-14T11:17:57.433722+0000","last_became_active":"2023-07-14T11:17:56.295317+0000","last_became_peered":"2023-07-14T11:17:56.295317+0000","last_unstale":"2023-07-14T11:17:57.433722+0000","last_undegraded":"2023-07-14T11:17:57.433722+0000","last_fullsized":"2023-07-14T11:17:57.433722+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:26:51.493769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.270218+0000","last_change":"2023-07-14T11:17:56.283557+0000","last_active":"2023-07-14T11:17:57.270218+0000","last_peered":"2023-07-14T11:17:57.270218+0000","last_clean":"2023-07-14T11:17:57.270218+0000","last_became_active":"2023-07-14T11:17:56.283279+0000","last_became_peered":"2023-07-14T11:17:56.283279+0000","last_unstale":"2023-07-14T11:17:57.270218+0000","last_undegraded":"2023-07-14T11:17:57.270218+0000","last_fullsized":"2023-07-14T11:17:57.270218+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:26:23.512984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.433444+0000","last_change":"2023-07-14T11:17:56.279163+0000","last_active":"2023-07-14T11:17:57.433444+0000","last_peered":"2023-07-14T11:17:57.433444+0000","last_clean":"2023-07-14T11:17:57.433444+0000","last_became_active":"2023-07-14T11:17:56.278874+0000","last_became_peered":"2023-07-14T11:17:56.278874+0000","last_unstale":"2023-07-14T11:17:57.433444+0000","last_undegraded":"2023-07-14T11:17:57.433444+0000","last_fullsized":"2023-07-14T11:17:57.433444+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:14:50.259303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.432446+0000","last_change":"2023-07-14T11:17:56.288910+0000","last_active":"2023-07-14T11:17:57.432446+0000","last_peered":"2023-07-14T11:17:57.432446+0000","last_clean":"2023-07-14T11:17:57.432446+0000","last_became_active":"2023-07-14T11:17:56.288445+0000","last_became_peered":"2023-07-14T11:17:56.288445+0000","last_unstale":"2023-07-14T11:17:57.432446+0000","last_undegraded":"2023-07-14T11:17:57.432446+0000","last_fullsized":"2023-07-14T11:17:57.432446+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:10:46.398403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.270453+0000","last_change":"2023-07-14T11:17:56.275889+0000","last_active":"2023-07-14T11:17:57.270453+0000","last_peered":"2023-07-14T11:17:57.270453+0000","last_clean":"2023-07-14T11:17:57.270453+0000","last_became_active":"2023-07-14T11:17:56.274913+0000","last_became_peered":"2023-07-14T11:17:56.274913+0000","last_unstale":"2023-07-14T11:17:57.270453+0000","last_undegraded":"2023-07-14T11:17:57.270453+0000","last_fullsized":"2023-07-14T11:17:57.270453+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:54:44.987237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.270509+0000","last_change":"2023-07-14T11:17:56.277708+0000","last_active":"2023-07-14T11:17:57.270509+0000","last_peered":"2023-07-14T11:17:57.270509+0000","last_clean":"2023-07-14T11:17:57.270509+0000","last_became_active":"2023-07-14T11:17:56.277445+0000","last_became_peered":"2023-07-14T11:17:56.277445+0000","last_unstale":"2023-07-14T11:17:57.270509+0000","last_undegraded":"2023-07-14T11:17:57.270509+0000","last_fullsized":"2023-07-14T11:17:57.270509+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:46:15.134220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.268864+0000","last_change":"2023-07-14T11:17:56.265293+0000","last_active":"2023-07-14T11:17:57.268864+0000","last_peered":"2023-07-14T11:17:57.268864+0000","last_clean":"2023-07-14T11:17:57.268864+0000","last_became_active":"2023-07-14T11:17:56.265018+0000","last_became_peered":"2023-07-14T11:17:56.265018+0000","last_unstale":"2023-07-14T11:17:57.268864+0000","last_undegraded":"2023-07-14T11:17:57.268864+0000","last_fullsized":"2023-07-14T11:17:57.268864+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:16:39.822307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.433594+0000","last_change":"2023-07-14T11:17:56.283283+0000","last_active":"2023-07-14T11:17:57.433594+0000","last_peered":"2023-07-14T11:17:57.433594+0000","last_clean":"2023-07-14T11:17:57.433594+0000","last_became_active":"2023-07-14T11:17:56.282958+0000","last_became_peered":"2023-07-14T11:17:56.282958+0000","last_unstale":"2023-07-14T11:17:57.433594+0000","last_undegraded":"2023-07-14T11:17:57.433594+0000","last_fullsized":"2023-07-14T11:17:57.433594+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:57:56.849299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.270549+0000","last_change":"2023-07-14T11:17:56.281316+0000","last_active":"2023-07-14T11:17:57.270549+0000","last_peered":"2023-07-14T11:17:57.270549+0000","last_clean":"2023-07-14T11:17:57.270549+0000","last_became_active":"2023-07-14T11:17:56.281070+0000","last_became_peered":"2023-07-14T11:17:56.281070+0000","last_unstale":"2023-07-14T11:17:57.270549+0000","last_undegraded":"2023-07-14T11:17:57.270549+0000","last_fullsized":"2023-07-14T11:17:57.270549+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:10:11.862226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.434241+0000","last_change":"2023-07-14T11:17:56.274395+0000","last_active":"2023-07-14T11:17:57.434241+0000","last_peered":"2023-07-14T11:17:57.434241+0000","last_clean":"2023-07-14T11:17:57.434241+0000","last_became_active":"2023-07-14T11:17:56.274092+0000","last_became_peered":"2023-07-14T11:17:56.274092+0000","last_unstale":"2023-07-14T11:17:57.434241+0000","last_undegraded":"2023-07-14T11:17:57.434241+0000","last_fullsized":"2023-07-14T11:17:57.434241+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:26:34.157198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.270131+0000","last_change":"2023-07-14T11:17:56.284501+0000","last_active":"2023-07-14T11:17:57.270131+0000","last_peered":"2023-07-14T11:17:57.270131+0000","last_clean":"2023-07-14T11:17:57.270131+0000","last_became_active":"2023-07-14T11:17:56.284260+0000","last_became_peered":"2023-07-14T11:17:56.284260+0000","last_unstale":"2023-07-14T11:17:57.270131+0000","last_undegraded":"2023-07-14T11:17:57.270131+0000","last_fullsized":"2023-07-14T11:17:57.270131+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:12:19.035572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.433586+0000","last_change":"2023-07-14T11:17:56.269186+0000","last_active":"2023-07-14T11:17:57.433586+0000","last_peered":"2023-07-14T11:17:57.433586+0000","last_clean":"2023-07-14T11:17:57.433586+0000","last_became_active":"2023-07-14T11:17:56.268903+0000","last_became_peered":"2023-07-14T11:17:56.268903+0000","last_unstale":"2023-07-14T11:17:57.433586+0000","last_undegraded":"2023-07-14T11:17:57.433586+0000","last_fullsized":"2023-07-14T11:17:57.433586+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:17:57.681147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.433177+0000","last_change":"2023-07-14T11:17:56.298701+0000","last_active":"2023-07-14T11:17:57.433177+0000","last_peered":"2023-07-14T11:17:57.433177+0000","last_clean":"2023-07-14T11:17:57.433177+0000","last_became_active":"2023-07-14T11:17:56.298131+0000","last_became_peered":"2023-07-14T11:17:56.298131+0000","last_unstale":"2023-07-14T11:17:57.433177+0000","last_undegraded":"2023-07-14T11:17:57.433177+0000","last_fullsized":"2023-07-14T11:17:57.433177+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:57:23.955100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.433089+0000","last_change":"2023-07-14T11:17:56.289501+0000","last_active":"2023-07-14T11:17:57.433089+0000","last_peered":"2023-07-14T11:17:57.433089+0000","last_clean":"2023-07-14T11:17:57.433089+0000","last_became_active":"2023-07-14T11:17:56.289251+0000","last_became_peered":"2023-07-14T11:17:56.289251+0000","last_unstale":"2023-07-14T11:17:57.433089+0000","last_undegraded":"2023-07-14T11:17:57.433089+0000","last_fullsized":"2023-07-14T11:17:57.433089+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:50:43.936067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.433540+0000","last_change":"2023-07-14T11:17:56.295572+0000","last_active":"2023-07-14T11:17:57.433540+0000","last_peered":"2023-07-14T11:17:57.433540+0000","last_clean":"2023-07-14T11:17:57.433540+0000","last_became_active":"2023-07-14T11:17:56.295306+0000","last_became_peered":"2023-07-14T11:17:56.295306+0000","last_unstale":"2023-07-14T11:17:57.433540+0000","last_undegraded":"2023-07-14T11:17:57.433540+0000","last_fullsized":"2023-07-14T11:17:57.433540+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:54:40.603146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.270668+0000","last_change":"2023-07-14T11:17:56.278727+0000","last_active":"2023-07-14T11:17:57.270668+0000","last_peered":"2023-07-14T11:17:57.270668+0000","last_clean":"2023-07-14T11:17:57.270668+0000","last_became_active":"2023-07-14T11:17:56.278391+0000","last_became_peered":"2023-07-14T11:17:56.278391+0000","last_unstale":"2023-07-14T11:17:57.270668+0000","last_undegraded":"2023-07-14T11:17:57.270668+0000","last_fullsized":"2023-07-14T11:17:57.270668+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:58:28.533567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.270630+0000","last_change":"2023-07-14T11:17:56.277037+0000","last_active":"2023-07-14T11:17:57.270630+0000","last_peered":"2023-07-14T11:17:57.270630+0000","last_clean":"2023-07-14T11:17:57.270630+0000","last_became_active":"2023-07-14T11:17:56.276730+0000","last_became_peered":"2023-07-14T11:17:56.276730+0000","last_unstale":"2023-07-14T11:17:57.270630+0000","last_undegraded":"2023-07-14T11:17:57.270630+0000","last_fullsized":"2023-07-14T11:17:57.270630+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:20:50.119024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.432918+0000","last_change":"2023-07-14T11:17:56.287932+0000","last_active":"2023-07-14T11:17:57.432918+0000","last_peered":"2023-07-14T11:17:57.432918+0000","last_clean":"2023-07-14T11:17:57.432918+0000","last_became_active":"2023-07-14T11:17:56.287475+0000","last_became_peered":"2023-07-14T11:17:56.287475+0000","last_unstale":"2023-07-14T11:17:57.432918+0000","last_undegraded":"2023-07-14T11:17:57.432918+0000","last_fullsized":"2023-07-14T11:17:57.432918+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:53:41.364051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.270563+0000","last_change":"2023-07-14T11:17:56.296708+0000","last_active":"2023-07-14T11:17:57.270563+0000","last_peered":"2023-07-14T11:17:57.270563+0000","last_clean":"2023-07-14T11:17:57.270563+0000","last_became_active":"2023-07-14T11:17:56.296422+0000","last_became_peered":"2023-07-14T11:17:56.296422+0000","last_unstale":"2023-07-14T11:17:57.270563+0000","last_undegraded":"2023-07-14T11:17:57.270563+0000","last_fullsized":"2023-07-14T11:17:57.270563+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:54:09.095859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.268748+0000","last_change":"2023-07-14T11:17:56.278072+0000","last_active":"2023-07-14T11:17:57.268748+0000","last_peered":"2023-07-14T11:17:57.268748+0000","last_clean":"2023-07-14T11:17:57.268748+0000","last_became_active":"2023-07-14T11:17:56.277800+0000","last_became_peered":"2023-07-14T11:17:56.277800+0000","last_unstale":"2023-07-14T11:17:57.268748+0000","last_undegraded":"2023-07-14T11:17:57.268748+0000","last_fullsized":"2023-07-14T11:17:57.268748+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:29:33.204246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.270864+0000","last_change":"2023-07-14T11:17:56.278173+0000","last_active":"2023-07-14T11:17:57.270864+0000","last_peered":"2023-07-14T11:17:57.270864+0000","last_clean":"2023-07-14T11:17:57.270864+0000","last_became_active":"2023-07-14T11:17:56.277705+0000","last_became_peered":"2023-07-14T11:17:56.277705+0000","last_unstale":"2023-07-14T11:17:57.270864+0000","last_undegraded":"2023-07-14T11:17:57.270864+0000","last_fullsized":"2023-07-14T11:17:57.270864+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:52:21.989412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.268642+0000","last_change":"2023-07-14T11:17:56.265268+0000","last_active":"2023-07-14T11:17:57.268642+0000","last_peered":"2023-07-14T11:17:57.268642+0000","last_clean":"2023-07-14T11:17:57.268642+0000","last_became_active":"2023-07-14T11:17:56.264971+0000","last_became_peered":"2023-07-14T11:17:56.264971+0000","last_unstale":"2023-07-14T11:17:57.268642+0000","last_undegraded":"2023-07-14T11:17:57.268642+0000","last_fullsized":"2023-07-14T11:17:57.268642+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:49:43.373479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"74'4","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.270333+0000","last_change":"2023-07-14T11:17:55.275342+0000","last_active":"2023-07-14T11:17:57.270333+0000","last_peered":"2023-07-14T11:17:57.270333+0000","last_clean":"2023-07-14T11:17:57.270333+0000","last_became_active":"2023-07-14T11:17:55.275030+0000","last_became_peered":"2023-07-14T11:17:55.275030+0000","last_unstale":"2023-07-14T11:17:57.270333+0000","last_undegraded":"2023-07-14T11:17:57.270333+0000","last_fullsized":"2023-07-14T11:17:57.270333+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:51:52.285666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.432625+0000","last_change":"2023-07-14T11:17:56.288704+0000","last_active":"2023-07-14T11:17:57.432625+0000","last_peered":"2023-07-14T11:17:57.432625+0000","last_clean":"2023-07-14T11:17:57.432625+0000","last_became_active":"2023-07-14T11:17:56.288138+0000","last_became_peered":"2023-07-14T11:17:56.288138+0000","last_unstale":"2023-07-14T11:17:57.432625+0000","last_undegraded":"2023-07-14T11:17:57.432625+0000","last_fullsized":"2023-07-14T11:17:57.432625+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:11:07.261491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"74'1","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.270936+0000","last_change":"2023-07-14T11:17:55.276014+0000","last_active":"2023-07-14T11:17:57.270936+0000","last_peered":"2023-07-14T11:17:57.270936+0000","last_clean":"2023-07-14T11:17:57.270936+0000","last_became_active":"2023-07-14T11:17:55.275761+0000","last_became_peered":"2023-07-14T11:17:55.275761+0000","last_unstale":"2023-07-14T11:17:57.270936+0000","last_undegraded":"2023-07-14T11:17:57.270936+0000","last_fullsized":"2023-07-14T11:17:57.270936+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:40:59.216505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.433954+0000","last_change":"2023-07-14T11:17:56.283330+0000","last_active":"2023-07-14T11:17:57.433954+0000","last_peered":"2023-07-14T11:17:57.433954+0000","last_clean":"2023-07-14T11:17:57.433954+0000","last_became_active":"2023-07-14T11:17:56.282812+0000","last_became_peered":"2023-07-14T11:17:56.282812+0000","last_unstale":"2023-07-14T11:17:57.433954+0000","last_undegraded":"2023-07-14T11:17:57.433954+0000","last_fullsized":"2023-07-14T11:17:57.433954+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:47:45.590333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"74'2","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.271157+0000","last_change":"2023-07-14T11:17:55.277374+0000","last_active":"2023-07-14T11:17:57.271157+0000","last_peered":"2023-07-14T11:17:57.271157+0000","last_clean":"2023-07-14T11:17:57.271157+0000","last_became_active":"2023-07-14T11:17:55.277071+0000","last_became_peered":"2023-07-14T11:17:55.277071+0000","last_unstale":"2023-07-14T11:17:57.271157+0000","last_undegraded":"2023-07-14T11:17:57.271157+0000","last_fullsized":"2023-07-14T11:17:57.271157+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:12:19.266848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.434545+0000","last_change":"2023-07-14T11:17:56.274564+0000","last_active":"2023-07-14T11:17:57.434545+0000","last_peered":"2023-07-14T11:17:57.434545+0000","last_clean":"2023-07-14T11:17:57.434545+0000","last_became_active":"2023-07-14T11:17:56.274246+0000","last_became_peered":"2023-07-14T11:17:56.274246+0000","last_unstale":"2023-07-14T11:17:57.434545+0000","last_undegraded":"2023-07-14T11:17:57.434545+0000","last_fullsized":"2023-07-14T11:17:57.434545+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:04:05.516942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"74'2","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.433576+0000","last_change":"2023-07-14T11:17:55.275292+0000","last_active":"2023-07-14T11:17:57.433576+0000","last_peered":"2023-07-14T11:17:57.433576+0000","last_clean":"2023-07-14T11:17:57.433576+0000","last_became_active":"2023-07-14T11:17:55.274845+0000","last_became_peered":"2023-07-14T11:17:55.274845+0000","last_unstale":"2023-07-14T11:17:57.433576+0000","last_undegraded":"2023-07-14T11:17:57.433576+0000","last_fullsized":"2023-07-14T11:17:57.433576+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:36:35.133900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.432538+0000","last_change":"2023-07-14T11:17:56.295069+0000","last_active":"2023-07-14T11:17:57.432538+0000","last_peered":"2023-07-14T11:17:57.432538+0000","last_clean":"2023-07-14T11:17:57.432538+0000","last_became_active":"2023-07-14T11:17:56.294651+0000","last_became_peered":"2023-07-14T11:17:56.294651+0000","last_unstale":"2023-07-14T11:17:57.432538+0000","last_undegraded":"2023-07-14T11:17:57.432538+0000","last_fullsized":"2023-07-14T11:17:57.432538+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:33:10.495205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"74'1","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.434531+0000","last_change":"2023-07-14T11:17:55.274123+0000","last_active":"2023-07-14T11:17:57.434531+0000","last_peered":"2023-07-14T11:17:57.434531+0000","last_clean":"2023-07-14T11:17:57.434531+0000","last_became_active":"2023-07-14T11:17:55.273853+0000","last_became_peered":"2023-07-14T11:17:55.273853+0000","last_unstale":"2023-07-14T11:17:57.434531+0000","last_undegraded":"2023-07-14T11:17:57.434531+0000","last_fullsized":"2023-07-14T11:17:57.434531+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:23:38.158254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.432581+0000","last_change":"2023-07-14T11:17:56.295889+0000","last_active":"2023-07-14T11:17:57.432581+0000","last_peered":"2023-07-14T11:17:57.432581+0000","last_clean":"2023-07-14T11:17:57.432581+0000","last_became_active":"2023-07-14T11:17:56.295623+0000","last_became_peered":"2023-07-14T11:17:56.295623+0000","last_unstale":"2023-07-14T11:17:57.432581+0000","last_undegraded":"2023-07-14T11:17:57.432581+0000","last_fullsized":"2023-07-14T11:17:57.432581+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:23:18.192191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"74'1","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.433114+0000","last_change":"2023-07-14T11:17:55.275771+0000","last_active":"2023-07-14T11:17:57.433114+0000","last_peered":"2023-07-14T11:17:57.433114+0000","last_clean":"2023-07-14T11:17:57.433114+0000","last_became_active":"2023-07-14T11:17:55.275490+0000","last_became_peered":"2023-07-14T11:17:55.275490+0000","last_unstale":"2023-07-14T11:17:57.433114+0000","last_undegraded":"2023-07-14T11:17:57.433114+0000","last_fullsized":"2023-07-14T11:17:57.433114+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:56:34.024532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.434254+0000","last_change":"2023-07-14T11:17:56.280041+0000","last_active":"2023-07-14T11:17:57.434254+0000","last_peered":"2023-07-14T11:17:57.434254+0000","last_clean":"2023-07-14T11:17:57.434254+0000","last_became_active":"2023-07-14T11:17:56.279755+0000","last_became_peered":"2023-07-14T11:17:56.279755+0000","last_unstale":"2023-07-14T11:17:57.434254+0000","last_undegraded":"2023-07-14T11:17:57.434254+0000","last_fullsized":"2023-07-14T11:17:57.434254+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:04:14.942015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.432715+0000","last_change":"2023-07-14T11:17:55.271818+0000","last_active":"2023-07-14T11:17:57.432715+0000","last_peered":"2023-07-14T11:17:57.432715+0000","last_clean":"2023-07-14T11:17:57.432715+0000","last_became_active":"2023-07-14T11:17:55.271488+0000","last_became_peered":"2023-07-14T11:17:55.271488+0000","last_unstale":"2023-07-14T11:17:57.432715+0000","last_undegraded":"2023-07-14T11:17:57.432715+0000","last_fullsized":"2023-07-14T11:17:57.432715+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:08:09.595286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.434301+0000","last_change":"2023-07-14T11:17:56.281601+0000","last_active":"2023-07-14T11:17:57.434301+0000","last_peered":"2023-07-14T11:17:57.434301+0000","last_clean":"2023-07-14T11:17:57.434301+0000","last_became_active":"2023-07-14T11:17:56.280781+0000","last_became_peered":"2023-07-14T11:17:56.280781+0000","last_unstale":"2023-07-14T11:17:57.434301+0000","last_undegraded":"2023-07-14T11:17:57.434301+0000","last_fullsized":"2023-07-14T11:17:57.434301+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:26:13.163304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.270244+0000","last_change":"2023-07-14T11:17:55.273443+0000","last_active":"2023-07-14T11:17:57.270244+0000","last_peered":"2023-07-14T11:17:57.270244+0000","last_clean":"2023-07-14T11:17:57.270244+0000","last_became_active":"2023-07-14T11:17:55.273159+0000","last_became_peered":"2023-07-14T11:17:55.273159+0000","last_unstale":"2023-07-14T11:17:57.270244+0000","last_undegraded":"2023-07-14T11:17:57.270244+0000","last_fullsized":"2023-07-14T11:17:57.270244+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:37:34.561211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.432379+0000","last_change":"2023-07-14T11:17:56.298901+0000","last_active":"2023-07-14T11:17:57.432379+0000","last_peered":"2023-07-14T11:17:57.432379+0000","last_clean":"2023-07-14T11:17:57.432379+0000","last_became_active":"2023-07-14T11:17:56.298457+0000","last_became_peered":"2023-07-14T11:17:56.298457+0000","last_unstale":"2023-07-14T11:17:57.432379+0000","last_undegraded":"2023-07-14T11:17:57.432379+0000","last_fullsized":"2023-07-14T11:17:57.432379+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:23:49.258381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.271035+0000","last_change":"2023-07-14T11:17:55.276895+0000","last_active":"2023-07-14T11:17:57.271035+0000","last_peered":"2023-07-14T11:17:57.271035+0000","last_clean":"2023-07-14T11:17:57.271035+0000","last_became_active":"2023-07-14T11:17:55.275745+0000","last_became_peered":"2023-07-14T11:17:55.275745+0000","last_unstale":"2023-07-14T11:17:57.271035+0000","last_undegraded":"2023-07-14T11:17:57.271035+0000","last_fullsized":"2023-07-14T11:17:57.271035+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:04:14.538789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.433237+0000","last_change":"2023-07-14T11:17:56.265329+0000","last_active":"2023-07-14T11:17:57.433237+0000","last_peered":"2023-07-14T11:17:57.433237+0000","last_clean":"2023-07-14T11:17:57.433237+0000","last_became_active":"2023-07-14T11:17:56.265042+0000","last_became_peered":"2023-07-14T11:17:56.265042+0000","last_unstale":"2023-07-14T11:17:57.433237+0000","last_undegraded":"2023-07-14T11:17:57.433237+0000","last_fullsized":"2023-07-14T11:17:57.433237+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:11:48.438192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.433554+0000","last_change":"2023-07-14T11:17:55.271797+0000","last_active":"2023-07-14T11:17:57.433554+0000","last_peered":"2023-07-14T11:17:57.433554+0000","last_clean":"2023-07-14T11:17:57.433554+0000","last_became_active":"2023-07-14T11:17:55.271504+0000","last_became_peered":"2023-07-14T11:17:55.271504+0000","last_unstale":"2023-07-14T11:17:57.433554+0000","last_undegraded":"2023-07-14T11:17:57.433554+0000","last_fullsized":"2023-07-14T11:17:57.433554+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:03:41.393976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.433429+0000","last_change":"2023-07-14T11:17:56.286261+0000","last_active":"2023-07-14T11:17:57.433429+0000","last_peered":"2023-07-14T11:17:57.433429+0000","last_clean":"2023-07-14T11:17:57.433429+0000","last_became_active":"2023-07-14T11:17:56.285211+0000","last_became_peered":"2023-07-14T11:17:56.285211+0000","last_unstale":"2023-07-14T11:17:57.433429+0000","last_undegraded":"2023-07-14T11:17:57.433429+0000","last_fullsized":"2023-07-14T11:17:57.433429+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:11:07.261491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"74'3","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.270604+0000","last_change":"2023-07-14T11:17:55.266331+0000","last_active":"2023-07-14T11:17:57.270604+0000","last_peered":"2023-07-14T11:17:57.270604+0000","last_clean":"2023-07-14T11:17:57.270604+0000","last_became_active":"2023-07-14T11:17:55.266061+0000","last_became_peered":"2023-07-14T11:17:55.266061+0000","last_unstale":"2023-07-14T11:17:57.270604+0000","last_undegraded":"2023-07-14T11:17:57.270604+0000","last_fullsized":"2023-07-14T11:17:57.270604+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:10:32.123752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.268988+0000","last_change":"2023-07-14T11:17:56.295375+0000","last_active":"2023-07-14T11:17:57.268988+0000","last_peered":"2023-07-14T11:17:57.268988+0000","last_clean":"2023-07-14T11:17:57.268988+0000","last_became_active":"2023-07-14T11:17:56.295099+0000","last_became_peered":"2023-07-14T11:17:56.295099+0000","last_unstale":"2023-07-14T11:17:57.268988+0000","last_undegraded":"2023-07-14T11:17:57.268988+0000","last_fullsized":"2023-07-14T11:17:57.268988+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:55:13.745622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"74'6","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.433746+0000","last_change":"2023-07-14T11:17:55.276939+0000","last_active":"2023-07-14T11:17:57.433746+0000","last_peered":"2023-07-14T11:17:57.433746+0000","last_clean":"2023-07-14T11:17:57.433746+0000","last_became_active":"2023-07-14T11:17:55.276617+0000","last_became_peered":"2023-07-14T11:17:55.276617+0000","last_unstale":"2023-07-14T11:17:57.433746+0000","last_undegraded":"2023-07-14T11:17:57.433746+0000","last_fullsized":"2023-07-14T11:17:57.433746+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:34:18.629743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.433871+0000","last_change":"2023-07-14T11:17:56.280583+0000","last_active":"2023-07-14T11:17:57.433871+0000","last_peered":"2023-07-14T11:17:57.433871+0000","last_clean":"2023-07-14T11:17:57.433871+0000","last_became_active":"2023-07-14T11:17:56.280314+0000","last_became_peered":"2023-07-14T11:17:56.280314+0000","last_unstale":"2023-07-14T11:17:57.433871+0000","last_undegraded":"2023-07-14T11:17:57.433871+0000","last_fullsized":"2023-07-14T11:17:57.433871+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:58:52.233368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"74'2","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.433391+0000","last_change":"2023-07-14T11:17:55.272772+0000","last_active":"2023-07-14T11:17:57.433391+0000","last_peered":"2023-07-14T11:17:57.433391+0000","last_clean":"2023-07-14T11:17:57.433391+0000","last_became_active":"2023-07-14T11:17:55.272348+0000","last_became_peered":"2023-07-14T11:17:55.272348+0000","last_unstale":"2023-07-14T11:17:57.433391+0000","last_undegraded":"2023-07-14T11:17:57.433391+0000","last_fullsized":"2023-07-14T11:17:57.433391+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:00:19.835173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.434122+0000","last_change":"2023-07-14T11:17:56.278648+0000","last_active":"2023-07-14T11:17:57.434122+0000","last_peered":"2023-07-14T11:17:57.434122+0000","last_clean":"2023-07-14T11:17:57.434122+0000","last_became_active":"2023-07-14T11:17:56.278367+0000","last_became_peered":"2023-07-14T11:17:56.278367+0000","last_unstale":"2023-07-14T11:17:57.434122+0000","last_undegraded":"2023-07-14T11:17:57.434122+0000","last_fullsized":"2023-07-14T11:17:57.434122+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:11:37.452196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.270606+0000","last_change":"2023-07-14T11:17:55.273580+0000","last_active":"2023-07-14T11:17:57.270606+0000","last_peered":"2023-07-14T11:17:57.270606+0000","last_clean":"2023-07-14T11:17:57.270606+0000","last_became_active":"2023-07-14T11:17:55.273264+0000","last_became_peered":"2023-07-14T11:17:55.273264+0000","last_unstale":"2023-07-14T11:17:57.270606+0000","last_undegraded":"2023-07-14T11:17:57.270606+0000","last_fullsized":"2023-07-14T11:17:57.270606+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:21:09.440808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.433841+0000","last_change":"2023-07-14T11:17:56.276880+0000","last_active":"2023-07-14T11:17:57.433841+0000","last_peered":"2023-07-14T11:17:57.433841+0000","last_clean":"2023-07-14T11:17:57.433841+0000","last_became_active":"2023-07-14T11:17:56.276265+0000","last_became_peered":"2023-07-14T11:17:56.276265+0000","last_unstale":"2023-07-14T11:17:57.433841+0000","last_undegraded":"2023-07-14T11:17:57.433841+0000","last_fullsized":"2023-07-14T11:17:57.433841+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:44:45.503011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.269998+0000","last_change":"2023-07-14T11:17:55.274451+0000","last_active":"2023-07-14T11:17:57.269998+0000","last_peered":"2023-07-14T11:17:57.269998+0000","last_clean":"2023-07-14T11:17:57.269998+0000","last_became_active":"2023-07-14T11:17:55.274122+0000","last_became_peered":"2023-07-14T11:17:55.274122+0000","last_unstale":"2023-07-14T11:17:57.269998+0000","last_undegraded":"2023-07-14T11:17:57.269998+0000","last_fullsized":"2023-07-14T11:17:57.269998+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:35:00.736586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.433810+0000","last_change":"2023-07-14T11:17:56.281897+0000","last_active":"2023-07-14T11:17:57.433810+0000","last_peered":"2023-07-14T11:17:57.433810+0000","last_clean":"2023-07-14T11:17:57.433810+0000","last_became_active":"2023-07-14T11:17:56.281312+0000","last_became_peered":"2023-07-14T11:17:56.281312+0000","last_unstale":"2023-07-14T11:17:57.433810+0000","last_undegraded":"2023-07-14T11:17:57.433810+0000","last_fullsized":"2023-07-14T11:17:57.433810+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:10:45.185292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"74'8","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.433126+0000","last_change":"2023-07-14T11:17:55.277603+0000","last_active":"2023-07-14T11:17:57.433126+0000","last_peered":"2023-07-14T11:17:57.433126+0000","last_clean":"2023-07-14T11:17:57.433126+0000","last_became_active":"2023-07-14T11:17:55.277297+0000","last_became_peered":"2023-07-14T11:17:55.277297+0000","last_unstale":"2023-07-14T11:17:57.433126+0000","last_undegraded":"2023-07-14T11:17:57.433126+0000","last_fullsized":"2023-07-14T11:17:57.433126+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:27:02.258845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.433411+0000","last_change":"2023-07-14T11:17:56.274029+0000","last_active":"2023-07-14T11:17:57.433411+0000","last_peered":"2023-07-14T11:17:57.433411+0000","last_clean":"2023-07-14T11:17:57.433411+0000","last_became_active":"2023-07-14T11:17:56.273680+0000","last_became_peered":"2023-07-14T11:17:56.273680+0000","last_unstale":"2023-07-14T11:17:57.433411+0000","last_undegraded":"2023-07-14T11:17:57.433411+0000","last_fullsized":"2023-07-14T11:17:57.433411+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:05:14.284692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"74'2","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.433572+0000","last_change":"2023-07-14T11:17:55.269223+0000","last_active":"2023-07-14T11:17:57.433572+0000","last_peered":"2023-07-14T11:17:57.433572+0000","last_clean":"2023-07-14T11:17:57.433572+0000","last_became_active":"2023-07-14T11:17:55.268917+0000","last_became_peered":"2023-07-14T11:17:55.268917+0000","last_unstale":"2023-07-14T11:17:57.433572+0000","last_undegraded":"2023-07-14T11:17:57.433572+0000","last_fullsized":"2023-07-14T11:17:57.433572+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:07:17.816976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.434141+0000","last_change":"2023-07-14T11:17:56.282012+0000","last_active":"2023-07-14T11:17:57.434141+0000","last_peered":"2023-07-14T11:17:57.434141+0000","last_clean":"2023-07-14T11:17:57.434141+0000","last_became_active":"2023-07-14T11:17:56.280463+0000","last_became_peered":"2023-07-14T11:17:56.280463+0000","last_unstale":"2023-07-14T11:17:57.434141+0000","last_undegraded":"2023-07-14T11:17:57.434141+0000","last_fullsized":"2023-07-14T11:17:57.434141+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:57:42.906724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"75'1","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.433023+0000","last_change":"2023-07-14T11:17:55.271803+0000","last_active":"2023-07-14T11:17:57.433023+0000","last_peered":"2023-07-14T11:17:57.433023+0000","last_clean":"2023-07-14T11:17:57.433023+0000","last_became_active":"2023-07-14T11:17:55.271427+0000","last_became_peered":"2023-07-14T11:17:55.271427+0000","last_unstale":"2023-07-14T11:17:57.433023+0000","last_undegraded":"2023-07-14T11:17:57.433023+0000","last_fullsized":"2023-07-14T11:17:57.433023+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:02:21.804706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.434053+0000","last_change":"2023-07-14T11:17:56.283149+0000","last_active":"2023-07-14T11:17:57.434053+0000","last_peered":"2023-07-14T11:17:57.434053+0000","last_clean":"2023-07-14T11:17:57.434053+0000","last_became_active":"2023-07-14T11:17:56.282393+0000","last_became_peered":"2023-07-14T11:17:56.282393+0000","last_unstale":"2023-07-14T11:17:57.434053+0000","last_undegraded":"2023-07-14T11:17:57.434053+0000","last_fullsized":"2023-07-14T11:17:57.434053+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:12:38.082963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.270973+0000","last_change":"2023-07-14T11:17:55.271560+0000","last_active":"2023-07-14T11:17:57.270973+0000","last_peered":"2023-07-14T11:17:57.270973+0000","last_clean":"2023-07-14T11:17:57.270973+0000","last_became_active":"2023-07-14T11:17:55.271242+0000","last_became_peered":"2023-07-14T11:17:55.271242+0000","last_unstale":"2023-07-14T11:17:57.270973+0000","last_undegraded":"2023-07-14T11:17:57.270973+0000","last_fullsized":"2023-07-14T11:17:57.270973+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:38:27.876073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.432952+0000","last_change":"2023-07-14T11:17:56.287715+0000","last_active":"2023-07-14T11:17:57.432952+0000","last_peered":"2023-07-14T11:17:57.432952+0000","last_clean":"2023-07-14T11:17:57.432952+0000","last_became_active":"2023-07-14T11:17:56.287188+0000","last_became_peered":"2023-07-14T11:17:56.287188+0000","last_unstale":"2023-07-14T11:17:57.432952+0000","last_undegraded":"2023-07-14T11:17:57.432952+0000","last_fullsized":"2023-07-14T11:17:57.432952+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:23:25.619220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.270672+0000","last_change":"2023-07-14T11:17:55.277955+0000","last_active":"2023-07-14T11:17:57.270672+0000","last_peered":"2023-07-14T11:17:57.270672+0000","last_clean":"2023-07-14T11:17:57.270672+0000","last_became_active":"2023-07-14T11:17:55.277668+0000","last_became_peered":"2023-07-14T11:17:55.277668+0000","last_unstale":"2023-07-14T11:17:57.270672+0000","last_undegraded":"2023-07-14T11:17:57.270672+0000","last_fullsized":"2023-07-14T11:17:57.270672+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:02:13.891074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.434047+0000","last_change":"2023-07-14T11:17:56.281745+0000","last_active":"2023-07-14T11:17:57.434047+0000","last_peered":"2023-07-14T11:17:57.434047+0000","last_clean":"2023-07-14T11:17:57.434047+0000","last_became_active":"2023-07-14T11:17:56.281408+0000","last_became_peered":"2023-07-14T11:17:56.281408+0000","last_unstale":"2023-07-14T11:17:57.434047+0000","last_undegraded":"2023-07-14T11:17:57.434047+0000","last_fullsized":"2023-07-14T11:17:57.434047+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:48:28.276251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.433450+0000","last_change":"2023-07-14T11:17:55.275172+0000","last_active":"2023-07-14T11:17:57.433450+0000","last_peered":"2023-07-14T11:17:57.433450+0000","last_clean":"2023-07-14T11:17:57.433450+0000","last_became_active":"2023-07-14T11:17:55.274349+0000","last_became_peered":"2023-07-14T11:17:55.274349+0000","last_unstale":"2023-07-14T11:17:57.433450+0000","last_undegraded":"2023-07-14T11:17:57.433450+0000","last_fullsized":"2023-07-14T11:17:57.433450+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:12:40.575330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.434261+0000","last_change":"2023-07-14T11:17:56.281195+0000","last_active":"2023-07-14T11:17:57.434261+0000","last_peered":"2023-07-14T11:17:57.434261+0000","last_clean":"2023-07-14T11:17:57.434261+0000","last_became_active":"2023-07-14T11:17:56.280741+0000","last_became_peered":"2023-07-14T11:17:56.280741+0000","last_unstale":"2023-07-14T11:17:57.434261+0000","last_undegraded":"2023-07-14T11:17:57.434261+0000","last_fullsized":"2023-07-14T11:17:57.434261+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:39:09.107674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.270217+0000","last_change":"2023-07-14T11:17:55.274435+0000","last_active":"2023-07-14T11:17:57.270217+0000","last_peered":"2023-07-14T11:17:57.270217+0000","last_clean":"2023-07-14T11:17:57.270217+0000","last_became_active":"2023-07-14T11:17:55.274142+0000","last_became_peered":"2023-07-14T11:17:55.274142+0000","last_unstale":"2023-07-14T11:17:57.270217+0000","last_undegraded":"2023-07-14T11:17:57.270217+0000","last_fullsized":"2023-07-14T11:17:57.270217+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:05:09.641011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.269064+0000","last_change":"2023-07-14T11:17:56.296645+0000","last_active":"2023-07-14T11:17:57.269064+0000","last_peered":"2023-07-14T11:17:57.269064+0000","last_clean":"2023-07-14T11:17:57.269064+0000","last_became_active":"2023-07-14T11:17:56.296331+0000","last_became_peered":"2023-07-14T11:17:56.296331+0000","last_unstale":"2023-07-14T11:17:57.269064+0000","last_undegraded":"2023-07-14T11:17:57.269064+0000","last_fullsized":"2023-07-14T11:17:57.269064+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:01:07.387368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.434300+0000","last_change":"2023-07-14T11:17:55.276180+0000","last_active":"2023-07-14T11:17:57.434300+0000","last_peered":"2023-07-14T11:17:57.434300+0000","last_clean":"2023-07-14T11:17:57.434300+0000","last_became_active":"2023-07-14T11:17:55.275919+0000","last_became_peered":"2023-07-14T11:17:55.275919+0000","last_unstale":"2023-07-14T11:17:57.434300+0000","last_undegraded":"2023-07-14T11:17:57.434300+0000","last_fullsized":"2023-07-14T11:17:57.434300+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:53:01.262508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.269371+0000","last_change":"2023-07-14T11:17:56.275875+0000","last_active":"2023-07-14T11:17:57.269371+0000","last_peered":"2023-07-14T11:17:57.269371+0000","last_clean":"2023-07-14T11:17:57.269371+0000","last_became_active":"2023-07-14T11:17:56.275588+0000","last_became_peered":"2023-07-14T11:17:56.275588+0000","last_unstale":"2023-07-14T11:17:57.269371+0000","last_undegraded":"2023-07-14T11:17:57.269371+0000","last_fullsized":"2023-07-14T11:17:57.269371+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:45:52.565378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.268583+0000","last_change":"2023-07-14T11:17:55.272497+0000","last_active":"2023-07-14T11:17:57.268583+0000","last_peered":"2023-07-14T11:17:57.268583+0000","last_clean":"2023-07-14T11:17:57.268583+0000","last_became_active":"2023-07-14T11:17:55.272194+0000","last_became_peered":"2023-07-14T11:17:55.272194+0000","last_unstale":"2023-07-14T11:17:57.268583+0000","last_undegraded":"2023-07-14T11:17:57.268583+0000","last_fullsized":"2023-07-14T11:17:57.268583+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:40:52.697902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.270357+0000","last_change":"2023-07-14T11:17:56.297655+0000","last_active":"2023-07-14T11:17:57.270357+0000","last_peered":"2023-07-14T11:17:57.270357+0000","last_clean":"2023-07-14T11:17:57.270357+0000","last_became_active":"2023-07-14T11:17:56.297399+0000","last_became_peered":"2023-07-14T11:17:56.297399+0000","last_unstale":"2023-07-14T11:17:57.270357+0000","last_undegraded":"2023-07-14T11:17:57.270357+0000","last_fullsized":"2023-07-14T11:17:57.270357+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:48:38.647623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"74'1","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.270635+0000","last_change":"2023-07-14T11:17:55.273602+0000","last_active":"2023-07-14T11:17:57.270635+0000","last_peered":"2023-07-14T11:17:57.270635+0000","last_clean":"2023-07-14T11:17:57.270635+0000","last_became_active":"2023-07-14T11:17:55.273211+0000","last_became_peered":"2023-07-14T11:17:55.273211+0000","last_unstale":"2023-07-14T11:17:57.270635+0000","last_undegraded":"2023-07-14T11:17:57.270635+0000","last_fullsized":"2023-07-14T11:17:57.270635+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:03:47.880348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":125,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.269103+0000","last_change":"2023-07-14T11:13:08.923786+0000","last_active":"2023-07-14T11:17:57.269103+0000","last_peered":"2023-07-14T11:17:57.269103+0000","last_clean":"2023-07-14T11:17:57.269103+0000","last_became_active":"2023-07-14T11:13:08.923384+0000","last_became_peered":"2023-07-14T11:13:08.923384+0000","last_unstale":"2023-07-14T11:17:57.269103+0000","last_undegraded":"2023-07-14T11:17:57.269103+0000","last_fullsized":"2023-07-14T11:17:57.269103+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:24:09.074757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.432776+0000","last_change":"2023-07-14T11:17:56.290086+0000","last_active":"2023-07-14T11:17:57.432776+0000","last_peered":"2023-07-14T11:17:57.432776+0000","last_clean":"2023-07-14T11:17:57.432776+0000","last_became_active":"2023-07-14T11:17:56.289734+0000","last_became_peered":"2023-07-14T11:17:56.289734+0000","last_unstale":"2023-07-14T11:17:57.432776+0000","last_undegraded":"2023-07-14T11:17:57.432776+0000","last_fullsized":"2023-07-14T11:17:57.432776+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:14:50.259303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"74'2","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.433293+0000","last_change":"2023-07-14T11:17:55.273188+0000","last_active":"2023-07-14T11:17:57.433293+0000","last_peered":"2023-07-14T11:17:57.433293+0000","last_clean":"2023-07-14T11:17:57.433293+0000","last_became_active":"2023-07-14T11:17:55.272925+0000","last_became_peered":"2023-07-14T11:17:55.272925+0000","last_unstale":"2023-07-14T11:17:57.433293+0000","last_undegraded":"2023-07-14T11:17:57.433293+0000","last_fullsized":"2023-07-14T11:17:57.433293+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:18:16.084040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":115,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.433176+0000","last_change":"2023-07-14T11:13:08.758749+0000","last_active":"2023-07-14T11:17:57.433176+0000","last_peered":"2023-07-14T11:17:57.433176+0000","last_clean":"2023-07-14T11:17:57.433176+0000","last_became_active":"2023-07-14T11:13:08.757956+0000","last_became_peered":"2023-07-14T11:13:08.757956+0000","last_unstale":"2023-07-14T11:17:57.433176+0000","last_undegraded":"2023-07-14T11:17:57.433176+0000","last_fullsized":"2023-07-14T11:17:57.433176+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:30:34.436057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.433977+0000","last_change":"2023-07-14T11:17:56.277376+0000","last_active":"2023-07-14T11:17:57.433977+0000","last_peered":"2023-07-14T11:17:57.433977+0000","last_clean":"2023-07-14T11:17:57.433977+0000","last_became_active":"2023-07-14T11:17:56.277036+0000","last_became_peered":"2023-07-14T11:17:56.277036+0000","last_unstale":"2023-07-14T11:17:57.433977+0000","last_undegraded":"2023-07-14T11:17:57.433977+0000","last_fullsized":"2023-07-14T11:17:57.433977+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:29:53.068035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.433123+0000","last_change":"2023-07-14T11:17:55.276195+0000","last_active":"2023-07-14T11:17:57.433123+0000","last_peered":"2023-07-14T11:17:57.433123+0000","last_clean":"2023-07-14T11:17:57.433123+0000","last_became_active":"2023-07-14T11:17:55.275914+0000","last_became_peered":"2023-07-14T11:17:55.275914+0000","last_unstale":"2023-07-14T11:17:57.433123+0000","last_undegraded":"2023-07-14T11:17:57.433123+0000","last_fullsized":"2023-07-14T11:17:57.433123+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:10:45.390992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":121,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.270108+0000","last_change":"2023-07-14T11:13:08.862331+0000","last_active":"2023-07-14T11:17:57.270108+0000","last_peered":"2023-07-14T11:17:57.270108+0000","last_clean":"2023-07-14T11:17:57.270108+0000","last_became_active":"2023-07-14T11:13:08.861817+0000","last_became_peered":"2023-07-14T11:13:08.861817+0000","last_unstale":"2023-07-14T11:17:57.270108+0000","last_undegraded":"2023-07-14T11:17:57.270108+0000","last_fullsized":"2023-07-14T11:17:57.270108+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:00:33.085381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.270888+0000","last_change":"2023-07-14T11:17:56.283212+0000","last_active":"2023-07-14T11:17:57.270888+0000","last_peered":"2023-07-14T11:17:57.270888+0000","last_clean":"2023-07-14T11:17:57.270888+0000","last_became_active":"2023-07-14T11:17:56.282927+0000","last_became_peered":"2023-07-14T11:17:56.282927+0000","last_unstale":"2023-07-14T11:17:57.270888+0000","last_undegraded":"2023-07-14T11:17:57.270888+0000","last_fullsized":"2023-07-14T11:17:57.270888+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:04:58.168257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.433271+0000","last_change":"2023-07-14T11:17:55.277231+0000","last_active":"2023-07-14T11:17:57.433271+0000","last_peered":"2023-07-14T11:17:57.433271+0000","last_clean":"2023-07-14T11:17:57.433271+0000","last_became_active":"2023-07-14T11:17:55.276954+0000","last_became_peered":"2023-07-14T11:17:55.276954+0000","last_unstale":"2023-07-14T11:17:57.433271+0000","last_undegraded":"2023-07-14T11:17:57.433271+0000","last_fullsized":"2023-07-14T11:17:57.433271+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:23:17.184781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":115,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.433752+0000","last_change":"2023-07-14T11:13:08.757882+0000","last_active":"2023-07-14T11:17:57.433752+0000","last_peered":"2023-07-14T11:17:57.433752+0000","last_clean":"2023-07-14T11:17:57.433752+0000","last_became_active":"2023-07-14T11:13:08.757541+0000","last_became_peered":"2023-07-14T11:13:08.757541+0000","last_unstale":"2023-07-14T11:17:57.433752+0000","last_undegraded":"2023-07-14T11:17:57.433752+0000","last_fullsized":"2023-07-14T11:17:57.433752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:23:11.820932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":263,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.270922+0000","last_change":"2023-07-14T11:13:01.370649+0000","last_active":"2023-07-14T11:17:57.270922+0000","last_peered":"2023-07-14T11:17:57.270922+0000","last_clean":"2023-07-14T11:17:57.270922+0000","last_became_active":"2023-07-14T11:13:01.369478+0000","last_became_peered":"2023-07-14T11:13:01.369478+0000","last_unstale":"2023-07-14T11:17:57.270922+0000","last_undegraded":"2023-07-14T11:17:57.270922+0000","last_fullsized":"2023-07-14T11:17:57.270922+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:00.254800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:00.254800+0000","last_clean_scrub_stamp":"2023-07-14T11:13:00.254800+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:45:29.654803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.432900+0000","last_change":"2023-07-14T11:17:56.294975+0000","last_active":"2023-07-14T11:17:57.432900+0000","last_peered":"2023-07-14T11:17:57.432900+0000","last_clean":"2023-07-14T11:17:57.432900+0000","last_became_active":"2023-07-14T11:17:56.294682+0000","last_became_peered":"2023-07-14T11:17:56.294682+0000","last_unstale":"2023-07-14T11:17:57.432900+0000","last_undegraded":"2023-07-14T11:17:57.432900+0000","last_fullsized":"2023-07-14T11:17:57.432900+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:57:56.849299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.432764+0000","last_change":"2023-07-14T11:17:55.276250+0000","last_active":"2023-07-14T11:17:57.432764+0000","last_peered":"2023-07-14T11:17:57.432764+0000","last_clean":"2023-07-14T11:17:57.432764+0000","last_became_active":"2023-07-14T11:17:55.275893+0000","last_became_peered":"2023-07-14T11:17:55.275893+0000","last_unstale":"2023-07-14T11:17:57.432764+0000","last_undegraded":"2023-07-14T11:17:57.432764+0000","last_fullsized":"2023-07-14T11:17:57.432764+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:58:02.464932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":107,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.270581+0000","last_change":"2023-07-14T11:13:08.760609+0000","last_active":"2023-07-14T11:17:57.270581+0000","last_peered":"2023-07-14T11:17:57.270581+0000","last_clean":"2023-07-14T11:17:57.270581+0000","last_became_active":"2023-07-14T11:13:08.760285+0000","last_became_peered":"2023-07-14T11:13:08.760285+0000","last_unstale":"2023-07-14T11:17:57.270581+0000","last_undegraded":"2023-07-14T11:17:57.270581+0000","last_fullsized":"2023-07-14T11:17:57.270581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:48:45.565321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.433318+0000","last_change":"2023-07-14T11:17:56.283668+0000","last_active":"2023-07-14T11:17:57.433318+0000","last_peered":"2023-07-14T11:17:57.433318+0000","last_clean":"2023-07-14T11:17:57.433318+0000","last_became_active":"2023-07-14T11:17:56.283349+0000","last_became_peered":"2023-07-14T11:17:56.283349+0000","last_unstale":"2023-07-14T11:17:57.433318+0000","last_undegraded":"2023-07-14T11:17:57.433318+0000","last_fullsized":"2023-07-14T11:17:57.433318+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:33:10.495205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.268954+0000","last_change":"2023-07-14T11:17:55.262746+0000","last_active":"2023-07-14T11:17:57.268954+0000","last_peered":"2023-07-14T11:17:57.268954+0000","last_clean":"2023-07-14T11:17:57.268954+0000","last_became_active":"2023-07-14T11:17:55.262453+0000","last_became_peered":"2023-07-14T11:17:55.262453+0000","last_unstale":"2023-07-14T11:17:57.268954+0000","last_undegraded":"2023-07-14T11:17:57.268954+0000","last_fullsized":"2023-07-14T11:17:57.268954+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:19:47.552496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":107,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.271079+0000","last_change":"2023-07-14T11:13:08.923899+0000","last_active":"2023-07-14T11:17:57.271079+0000","last_peered":"2023-07-14T11:17:57.271079+0000","last_clean":"2023-07-14T11:17:57.271079+0000","last_became_active":"2023-07-14T11:13:08.923513+0000","last_became_peered":"2023-07-14T11:13:08.923513+0000","last_unstale":"2023-07-14T11:17:57.271079+0000","last_undegraded":"2023-07-14T11:17:57.271079+0000","last_fullsized":"2023-07-14T11:17:57.271079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:30:08.941878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.432991+0000","last_change":"2023-07-14T11:17:56.283076+0000","last_active":"2023-07-14T11:17:57.432991+0000","last_peered":"2023-07-14T11:17:57.432991+0000","last_clean":"2023-07-14T11:17:57.432991+0000","last_became_active":"2023-07-14T11:17:56.282813+0000","last_became_peered":"2023-07-14T11:17:56.282813+0000","last_unstale":"2023-07-14T11:17:57.432991+0000","last_undegraded":"2023-07-14T11:17:57.432991+0000","last_fullsized":"2023-07-14T11:17:57.432991+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:23:49.258381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"74'1","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.270949+0000","last_change":"2023-07-14T11:17:55.271607+0000","last_active":"2023-07-14T11:17:57.270949+0000","last_peered":"2023-07-14T11:17:57.270949+0000","last_clean":"2023-07-14T11:17:57.270949+0000","last_became_active":"2023-07-14T11:17:55.271309+0000","last_became_peered":"2023-07-14T11:17:55.271309+0000","last_unstale":"2023-07-14T11:17:57.270949+0000","last_undegraded":"2023-07-14T11:17:57.270949+0000","last_fullsized":"2023-07-14T11:17:57.270949+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:01:33.621776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":125,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.269249+0000","last_change":"2023-07-14T11:13:08.761726+0000","last_active":"2023-07-14T11:17:57.269249+0000","last_peered":"2023-07-14T11:17:57.269249+0000","last_clean":"2023-07-14T11:17:57.269249+0000","last_became_active":"2023-07-14T11:13:08.761365+0000","last_became_peered":"2023-07-14T11:13:08.761365+0000","last_unstale":"2023-07-14T11:17:57.269249+0000","last_undegraded":"2023-07-14T11:17:57.269249+0000","last_fullsized":"2023-07-14T11:17:57.269249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:35:48.591063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.270026+0000","last_change":"2023-07-14T11:17:56.273725+0000","last_active":"2023-07-14T11:17:57.270026+0000","last_peered":"2023-07-14T11:17:57.270026+0000","last_clean":"2023-07-14T11:17:57.270026+0000","last_became_active":"2023-07-14T11:17:56.273460+0000","last_became_peered":"2023-07-14T11:17:56.273460+0000","last_unstale":"2023-07-14T11:17:57.270026+0000","last_undegraded":"2023-07-14T11:17:57.270026+0000","last_fullsized":"2023-07-14T11:17:57.270026+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:55.247056+0000","last_clean_scrub_stamp":"2023-07-14T11:17:55.247056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:42:12.056380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"74'2","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.434386+0000","last_change":"2023-07-14T11:17:55.273234+0000","last_active":"2023-07-14T11:17:57.434386+0000","last_peered":"2023-07-14T11:17:57.434386+0000","last_clean":"2023-07-14T11:17:57.434386+0000","last_became_active":"2023-07-14T11:17:55.272953+0000","last_became_peered":"2023-07-14T11:17:55.272953+0000","last_unstale":"2023-07-14T11:17:57.434386+0000","last_undegraded":"2023-07-14T11:17:57.434386+0000","last_fullsized":"2023-07-14T11:17:57.434386+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:17:54.239645+0000","last_clean_scrub_stamp":"2023-07-14T11:17:54.239645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:35:37.364572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":113,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-07-14T11:17:57.434388+0000","last_change":"2023-07-14T11:13:08.762084+0000","last_active":"2023-07-14T11:17:57.434388+0000","last_peered":"2023-07-14T11:17:57.434388+0000","last_clean":"2023-07-14T11:17:57.434388+0000","last_became_active":"2023-07-14T11:13:08.761763+0000","last_became_peered":"2023-07-14T11:13:08.761763+0000","last_unstale":"2023-07-14T11:17:57.434388+0000","last_undegraded":"2023-07-14T11:17:57.434388+0000","last_fullsized":"2023-07-14T11:17:57.434388+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:12:36.676518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574912,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28428,"kb_used_data":1476,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343412,"statfs":{"total":96636764160,"available":96607653888,"internally_reserved":0,"allocated":1511424,"data_stored":998490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.80400000000000005,"15min":0.94199999999999995},"min":{"1min":0.441,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.93300000000000005,"5min":8.4339999999999993,"15min":8.4339999999999993},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.84599999999999997,"15min":0.97999999999999998},"min":{"1min":0.55100000000000005,"5min":0.377,"15min":0.377},"max":{"1min":0.88800000000000001,"5min":8.4559999999999995,"15min":8.4559999999999995},"last":0.55400000000000005}]},{"osd":1,"last update":"Fri Jul 14 11:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.79700000000000004,"15min":0.91300000000000003},"min":{"1min":0.54000000000000004,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.86699999999999999,"5min":6.3520000000000003,"15min":6.3520000000000003},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.88100000000000001,"15min":1.083},"min":{"1min":0.49299999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.877,"5min":6.8550000000000004,"15min":6.8550000000000004},"last":0.47799999999999998}]},{"osd":2,"last update":"Fri Jul 14 11:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.91200000000000003,"15min":1.137},"min":{"1min":0.51000000000000001,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.91400000000000003,"5min":7.0289999999999999,"15min":7.0289999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.70599999999999996,"15min":0.69399999999999995},"min":{"1min":0.48599999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.94499999999999995,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.746}]},{"osd":3,"last update":"Fri Jul 14 11:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.95699999999999996,"15min":1.198},"min":{"1min":0.51800000000000002,"5min":0.505,"15min":0.505},"max":{"1min":0.95699999999999996,"5min":10.337,"15min":10.337},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.753,"15min":0.76700000000000002},"min":{"1min":0.60799999999999998,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.97899999999999998,"5min":1.921,"15min":1.921},"last":0.57999999999999996}]},{"osd":4,"last update":"Fri Jul 14 11:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.62,"15min":0.58999999999999997},"min":{"1min":0.44500000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.89900000000000002,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.72499999999999998,"15min":0.70199999999999996},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.88200000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.76300000000000001}]},{"osd":5,"last update":"Fri Jul 14 11:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.68899999999999995,"15min":0.67500000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.89400000000000002,"5min":1.04,"15min":1.04},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.746,"5min":0.754,"15min":0.73699999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.92100000000000004,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.72499999999999998}]},{"osd":6,"last update":"Fri Jul 14 11:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.70899999999999996,"15min":0.67700000000000005},"min":{"1min":0.499,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.94199999999999995,"5min":1.002,"15min":1.002},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.71699999999999997,"15min":0.68899999999999995},"min":{"1min":0.50900000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.90200000000000002,"5min":1.018,"15min":1.018},"last":0.80300000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574913,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":904,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":925696,"data_stored":409664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.71499999999999997,"15min":0.70799999999999996},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.93799999999999994,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.73499999999999999,"15min":0.72099999999999997},"min":{"1min":0.45300000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.93100000000000005,"5min":1.167,"15min":1.167},"last":0.89000000000000001}]},{"osd":1,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.71099999999999997,"15min":0.68899999999999995},"min":{"1min":0.53100000000000003,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.97699999999999998,"5min":1.006,"15min":1.006},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.73599999999999999,"15min":0.71599999999999997},"min":{"1min":0.50900000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.0109999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.94299999999999995}]},{"osd":2,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.69399999999999995,"15min":0.67700000000000005},"min":{"1min":0.51300000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.95199999999999996,"5min":1.45,"15min":1.45},"last":0.87},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76900000000000002,"15min":0.78100000000000003},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.94799999999999995,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.97099999999999997}]},{"osd":3,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.752,"15min":0.75},"min":{"1min":0.56499999999999995,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.002,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.747,"15min":0.74299999999999999},"min":{"1min":0.60099999999999998,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.91600000000000004,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.89800000000000002}]},{"osd":4,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.68799999999999994,"15min":0.70599999999999996},"min":{"1min":0.44400000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.94699999999999995,"5min":1.712,"15min":1.712},"last":0.627},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.71399999999999997,"15min":0.72399999999999998},"min":{"1min":0.47299999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.871,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.66200000000000003}]},{"osd":5,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.71299999999999997,"15min":0.71799999999999997},"min":{"1min":0.51500000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.89800000000000002,"5min":2.8820000000000001,"15min":2.8820000000000001},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76900000000000002,"15min":0.78700000000000003},"min":{"1min":0.496,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.98399999999999999,"5min":1.129,"15min":1.129},"last":0.68200000000000005}]},{"osd":7,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.78000000000000003,"15min":0.80100000000000005},"min":{"1min":0.47399999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0569999999999999,"5min":1.333,"15min":1.333},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.76800000000000002,"15min":0.79000000000000004},"min":{"1min":0.54100000000000004,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.92700000000000005,"5min":1.55,"15min":1.55},"last":0.70499999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574912,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":900,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":921600,"data_stored":408212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:17:04 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.42299999999999999,"15min":0.438},"min":{"1min":0.28899999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.54300000000000004,"5min":0.996,"15min":0.996},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.47699999999999998,"15min":0.48299999999999998},"min":{"1min":0.34499999999999997,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.63100000000000001,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.30199999999999999}]},{"osd":2,"last update":"Fri Jul 14 11:17:04 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.52800000000000002,"15min":0.56499999999999995},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.70799999999999996,"5min":2.476,"15min":2.476},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.55800000000000005,"15min":0.61799999999999999},"min":{"1min":0.39800000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.68300000000000005,"5min":2.6299999999999999,"15min":2.6299999999999999},"last":0.39100000000000001}]},{"osd":3,"last update":"Fri Jul 14 11:17:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.53200000000000003,"15min":0.52300000000000002},"min":{"1min":0.40200000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.66300000000000003,"5min":0.748,"15min":0.748},"last":0.435},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48199999999999998,"15min":0.49399999999999999},"min":{"1min":0.41699999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.60299999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.47899999999999998}]},{"osd":4,"last update":"Fri Jul 14 11:17:04 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.75,"15min":0.753},"min":{"1min":0.61199999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0309999999999999,"5min":1.363,"15min":1.363},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.76800000000000002,"15min":0.77400000000000002},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.1160000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.61299999999999999}]},{"osd":5,"last update":"Fri Jul 14 11:17:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.76700000000000002,"15min":0.77100000000000002},"min":{"1min":0.60199999999999998,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.2250000000000001,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.79300000000000004,"15min":0.81799999999999995},"min":{"1min":0.58199999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":0.98299999999999998,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.60199999999999998}]},{"osd":6,"last update":"Fri Jul 14 11:17:04 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.76800000000000002,"15min":0.79600000000000004},"min":{"1min":0.56200000000000006,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.97599999999999998,"5min":1.298,"15min":1.298},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77700000000000002,"15min":0.78700000000000003},"min":{"1min":0.54800000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1899999999999999,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.58999999999999997}]},{"osd":7,"last update":"Fri Jul 14 11:17:04 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.78600000000000003,"15min":0.81599999999999995},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.097,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.63},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.77400000000000002,"15min":0.78700000000000003},"min":{"1min":0.624,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.0800000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.73299999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574910,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28424,"kb_used_data":1472,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343416,"statfs":{"total":96636764160,"available":96607657984,"internally_reserved":0,"allocated":1507328,"data_stored":998468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.44,"15min":0.435},"min":{"1min":0.33900000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.59999999999999998,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.44400000000000001,"15min":0.441},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.64100000000000001,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.38100000000000001}]},{"osd":2,"last update":"Fri Jul 14 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.375,"5min":0.307,"15min":0.307},"max":{"1min":0.58599999999999997,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.501},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.497,"15min":0.502},"min":{"1min":0.36299999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.66600000000000004,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.53300000000000003}]},{"osd":3,"last update":"Fri Jul 14 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.44900000000000001,"15min":0.42699999999999999},"min":{"1min":0.36099999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.64300000000000002,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.52700000000000002,"15min":0.52500000000000002},"min":{"1min":0.42299999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.64400000000000002,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.54900000000000004}]},{"osd":4,"last update":"Fri Jul 14 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.76300000000000001,"15min":0.76600000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.044,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.72999999999999998,"15min":0.70699999999999996},"min":{"1min":0.53200000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.83199999999999996}]},{"osd":5,"last update":"Fri Jul 14 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.74399999999999999,"15min":0.72899999999999998},"min":{"1min":0.57799999999999996,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77400000000000002,"15min":0.77900000000000003},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.90900000000000003}]},{"osd":6,"last update":"Fri Jul 14 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.73499999999999999,"15min":0.72499999999999998},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.01,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.77600000000000002,"15min":0.78000000000000003},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.022,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.89900000000000002}]},{"osd":7,"last update":"Fri Jul 14 11:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.80800000000000005,"15min":0.81999999999999995},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.0900000000000001,"5min":1.149,"15min":1.149},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.80300000000000005,"15min":0.78300000000000003},"min":{"1min":0.58999999999999997,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.0600000000000001,"5min":1.081,"15min":1.081},"last":0.85499999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574910,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":904,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":925696,"data_stored":408842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.42799999999999999,"15min":0.44700000000000001},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.63900000000000001,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.436,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.33100000000000002}]},{"osd":1,"last update":"Fri Jul 14 11:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.47999999999999998,"15min":0.48599999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.68400000000000005,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.499,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.39500000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.61399999999999999,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.55700000000000005}]},{"osd":3,"last update":"Fri Jul 14 11:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.501,"15min":0.497},"min":{"1min":0.35699999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57799999999999996,"15min":0.58699999999999997},"min":{"1min":0.42099999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.72599999999999998,"5min":1.034,"15min":1.034},"last":0.49299999999999999}]},{"osd":4,"last update":"Fri Jul 14 11:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.76200000000000001,"15min":0.77200000000000002},"min":{"1min":0.55800000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.92700000000000005,"5min":1.212,"15min":1.212},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.77700000000000002,"15min":0.78800000000000003},"min":{"1min":0.64100000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.1000000000000001,"5min":1.198,"15min":1.198},"last":0.66400000000000003}]},{"osd":5,"last update":"Fri Jul 14 11:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.76900000000000002,"15min":0.79000000000000004},"min":{"1min":0.59499999999999997,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.98899999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.80000000000000004,"15min":0.82399999999999995},"min":{"1min":0.55000000000000004,"5min":0.495,"15min":0.495},"max":{"1min":1.0609999999999999,"5min":1.351,"15min":1.351},"last":0.74199999999999999}]},{"osd":6,"last update":"Fri Jul 14 11:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.78100000000000003,"15min":0.79000000000000004},"min":{"1min":0.60899999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.1180000000000001,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.79900000000000004,"15min":0.82299999999999995},"min":{"1min":0.59499999999999997,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0129999999999999,"5min":1.282,"15min":1.282},"last":0.623}]},{"osd":7,"last update":"Fri Jul 14 11:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.79300000000000004,"15min":0.80400000000000005},"min":{"1min":0.628,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.0389999999999999,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.78600000000000003,"15min":0.80700000000000005},"min":{"1min":0.63,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.95299999999999996,"5min":1.244,"15min":1.244},"last":0.83099999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574910,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":917504,"data_stored":408682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.42899999999999999,"15min":0.44800000000000001},"min":{"1min":0.34399999999999997,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.67800000000000005,"5min":0.754,"15min":0.754},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.502,"5min":0.45500000000000002,"15min":0.45100000000000001},"min":{"1min":0.317,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.53200000000000003}]},{"osd":1,"last update":"Fri Jul 14 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.45100000000000001,"15min":0.45300000000000001},"min":{"1min":0.34000000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.49299999999999999,"15min":0.498},"min":{"1min":0.44500000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.72699999999999998,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.438}]},{"osd":2,"last update":"Fri Jul 14 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.55200000000000005,"15min":0.54600000000000004},"min":{"1min":0.42899999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.627,"5min":0.58799999999999997,"15min":0.59799999999999998},"min":{"1min":0.46500000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.79600000000000004,"5min":1.585,"15min":1.585},"last":0.46300000000000002}]},{"osd":4,"last update":"Fri Jul 14 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.75900000000000001,"15min":0.76300000000000001},"min":{"1min":0.53200000000000003,"5min":0.372,"15min":0.372},"max":{"1min":1.0029999999999999,"5min":1.216,"15min":1.216},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.77700000000000002,"15min":0.76000000000000001},"min":{"1min":0.61899999999999999,"5min":0.504,"15min":0.504},"max":{"1min":1.0609999999999999,"5min":1.147,"15min":1.147},"last":0.86199999999999999}]},{"osd":5,"last update":"Fri Jul 14 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.76700000000000002,"15min":0.76400000000000001},"min":{"1min":0.65400000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.024,"5min":1.413,"15min":1.413},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.81799999999999995,"15min":0.85199999999999998},"min":{"1min":0.621,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.097,"5min":1.657,"15min":1.657},"last":0.74299999999999999}]},{"osd":6,"last update":"Fri Jul 14 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.66300000000000003,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.133,"5min":1.726,"15min":1.726},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.78900000000000003,"15min":0.80100000000000005},"min":{"1min":0.61099999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.085,"5min":1.333,"15min":1.333},"last":0.84399999999999997}]},{"osd":7,"last update":"Fri Jul 14 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.81899999999999995,"15min":0.83799999999999997},"min":{"1min":0.623,"5min":0.437,"15min":0.437},"max":{"1min":1.1459999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.83299999999999996,"15min":0.84199999999999997},"min":{"1min":0.59599999999999997,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1579999999999999,"5min":1.268,"15min":1.268},"last":0.81699999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574910,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":912,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":933888,"data_stored":409768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.64400000000000002,"15min":0.63400000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.85199999999999998,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.67500000000000004,"15min":0.69099999999999995},"min":{"1min":0.42699999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.83199999999999996,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.751}]},{"osd":1,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.66100000000000003,"15min":0.66900000000000004},"min":{"1min":0.46100000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.82899999999999996,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.71599999999999997,"15min":0.71399999999999997},"min":{"1min":0.49299999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.93700000000000006,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.65100000000000002}]},{"osd":2,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.71799999999999997,"15min":0.71299999999999997},"min":{"1min":0.51000000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.85299999999999998,"5min":1.48,"15min":1.48},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.73899999999999999,"15min":0.74199999999999999},"min":{"1min":0.57499999999999996,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.84499999999999997,"5min":1.23,"15min":1.23},"last":0.78500000000000003}]},{"osd":3,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.69899999999999995,"15min":0.71499999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.81299999999999994,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.748,"15min":0.74199999999999999},"min":{"1min":0.55200000000000005,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.88100000000000001,"5min":1.145,"15min":1.145},"last":0.56599999999999995}]},{"osd":5,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.71799999999999997,"15min":0.76000000000000001},"min":{"1min":0.45300000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.90000000000000002,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.71699999999999997,"15min":0.76500000000000001},"min":{"1min":0.48999999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.81499999999999995,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.624}]},{"osd":6,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71499999999999997,"15min":0.72299999999999998},"min":{"1min":0.45600000000000002,"5min":0.436,"15min":0.436},"max":{"1min":0.86399999999999999,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76600000000000001,"15min":0.77600000000000002},"min":{"1min":0.56999999999999995,"5min":0.442,"15min":0.442},"max":{"1min":0.96099999999999997,"5min":1.3,"15min":1.3},"last":0.59899999999999998}]},{"osd":7,"last update":"Fri Jul 14 11:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.746,"15min":0.76900000000000002},"min":{"1min":0.53500000000000003,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.86499999999999999,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.81000000000000005,"15min":0.84399999999999997},"min":{"1min":0.50900000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.92200000000000004,"5min":1.379,"15min":1.379},"last":0.82499999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574912,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":917504,"data_stored":408134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.63700000000000001,"15min":0.64200000000000002},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.97299999999999998,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.65000000000000002,"15min":0.64000000000000001},"min":{"1min":0.47599999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.88,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.67000000000000004}]},{"osd":1,"last update":"Fri Jul 14 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.66200000000000003,"15min":0.67700000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.78700000000000003,"5min":1.343,"15min":1.343},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.66100000000000003,"15min":0.65100000000000002},"min":{"1min":0.51300000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.57899999999999996}]},{"osd":2,"last update":"Fri Jul 14 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.72799999999999998,"15min":0.73799999999999999},"min":{"1min":0.59399999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.93500000000000005,"5min":1.034,"15min":1.034},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.73999999999999999,"15min":0.76600000000000001},"min":{"1min":0.51000000000000001,"5min":0.496,"15min":0.496},"max":{"1min":0.83199999999999996,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.60499999999999998}]},{"osd":3,"last update":"Fri Jul 14 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.73699999999999999,"15min":0.76500000000000001},"min":{"1min":0.53500000000000003,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.92800000000000005,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.73799999999999999,"15min":0.77800000000000002},"min":{"1min":0.63500000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.90900000000000003,"5min":1.806,"15min":1.806},"last":0.55700000000000005}]},{"osd":4,"last update":"Fri Jul 14 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.63700000000000001,"15min":0.65300000000000002},"min":{"1min":0.42599999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.88800000000000001,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.70499999999999996,"15min":0.75},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.996,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.72099999999999997}]},{"osd":6,"last update":"Fri Jul 14 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.71899999999999997,"15min":0.747},"min":{"1min":0.52200000000000002,"5min":0.435,"15min":0.435},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.76200000000000001,"15min":0.79900000000000004},"min":{"1min":0.432,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0629999999999999,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.627}]},{"osd":7,"last update":"Fri Jul 14 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.78400000000000003,"15min":0.84199999999999997},"min":{"1min":0.45700000000000002,"5min":0.435,"15min":0.435},"max":{"1min":1.081,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.82599999999999996,"15min":0.86799999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.95899999999999996,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.73299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T11:18:06.043 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-14T11:18:06.043 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-14T11:18:06.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.277+0000 7f0cae3ff700 1 Processor -- start 2023-07-14T11:18:06.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.277+0000 7f0cae3ff700 1 -- start start 2023-07-14T11:18:06.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.278+0000 7f0cae3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ca80c92d0 0x7f0ca80ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:06.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.278+0000 7f0cae3ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0ca80adea0 0x7f0ca80cc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:06.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.278+0000 7f0cae3ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ca815ce70 con 0x7f0ca80b12f0 2023-07-14T11:18:06.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.278+0000 7f0cae3ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ca815da60 con 0x7f0ca80adea0 2023-07-14T11:18:06.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.278+0000 7f0cae3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca815d0c0 con 0x7f0ca80c92d0 2023-07-14T11:18:06.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.278+0000 7f0ca77fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f0ca80b12f0 0x7f0ca80c96a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:59546/0 (socket says 172.21.15.84:59546) 2023-07-14T11:18:06.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.278+0000 7f0ca77fe700 1 -- 172.21.15.84:0/4061043928 learned_addr learned my addr 172.21.15.84:0/4061043928 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:18:06.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.278+0000 7f0cac99c700 1 --2- 172.21.15.84:0/4061043928 >> v2:172.21.15.179:3300/0 conn(0x7f0ca80adea0 0x7f0ca80cc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:06.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.279+0000 7f0ca7fff700 1 --2- 172.21.15.84:0/4061043928 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ca80c92d0 0x7f0ca80ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:06.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.279+0000 7f0ca6ffd700 1 -- 172.21.15.84:0/4061043928 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1986613834 0 0) 0x7f0ca815ce70 con 0x7f0ca80b12f0 2023-07-14T11:18:06.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.279+0000 7f0ca6ffd700 1 -- 172.21.15.84:0/4061043928 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c900035b0 con 0x7f0ca80b12f0 2023-07-14T11:18:06.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.279+0000 7f0ca6ffd700 1 -- 172.21.15.84:0/4061043928 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 620234022 0 0) 0x7f0c900035b0 con 0x7f0ca80b12f0 2023-07-14T11:18:06.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.279+0000 7f0ca6ffd700 1 -- 172.21.15.84:0/4061043928 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ca80c92d0 msgr2=0x7f0ca80ad8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:06.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.279+0000 7f0ca6ffd700 1 --2- 172.21.15.84:0/4061043928 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ca80c92d0 0x7f0ca80ad8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:06.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.279+0000 7f0ca6ffd700 1 -- 172.21.15.84:0/4061043928 >> v2:172.21.15.179:3300/0 conn(0x7f0ca80adea0 msgr2=0x7f0ca80cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:06.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.279+0000 7f0ca6ffd700 1 --2- 172.21.15.84:0/4061043928 >> v2:172.21.15.179:3300/0 conn(0x7f0ca80adea0 0x7f0ca80cc690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:06.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.279+0000 7f0ca6ffd700 1 -- 172.21.15.84:0/4061043928 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca815d3a0 con 0x7f0ca80b12f0 2023-07-14T11:18:06.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.279+0000 7f0ca6ffd700 1 -- 172.21.15.84:0/4061043928 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7f0c9c001670 con 0x7f0ca80b12f0 2023-07-14T11:18:06.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.279+0000 7f0cac99c700 1 --2- 172.21.15.84:0/4061043928 >> v2:172.21.15.179:3300/0 conn(0x7f0ca80adea0 0x7f0ca80cc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:18:06.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.279+0000 7f0ca6ffd700 1 -- 172.21.15.84:0/4061043928 >> v1:172.21.15.84:6789/0 conn(0x7f0ca80b12f0 legacy=0x7f0ca80c96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:06.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.279+0000 7f0ca6ffd700 1 --2- 172.21.15.84:0/4061043928 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c90003a00 0x7f0c90003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:06.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.279+0000 7f0ca6ffd700 1 --2- 172.21.15.84:0/4061043928 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c90004430 0x7f0c900048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:06.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.279+0000 7f0ca6ffd700 1 --2- 172.21.15.84:0/4061043928 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c90005000 0x7f0c9000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:06.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.279+0000 7f0ca6ffd700 1 -- 172.21.15.84:0/4061043928 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca815da60 con 0x7f0c90004430 2023-07-14T11:18:06.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.279+0000 7f0ca6ffd700 1 -- 172.21.15.84:0/4061043928 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca815d0c0 con 0x7f0c90003a00 2023-07-14T11:18:06.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.279+0000 7f0ca6ffd700 1 -- 172.21.15.84:0/4061043928 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9000bf50 con 0x7f0c90005000 2023-07-14T11:18:06.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.279+0000 7f0ca7fff700 1 --2- 172.21.15.84:0/4061043928 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0ca80c92d0 0x7f0ca80ad8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:18:06.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.280+0000 7f0ca77fe700 1 --2- 172.21.15.84:0/4061043928 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c90004430 0x7f0c900048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:06.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.280+0000 7f0cac99c700 1 --2- 172.21.15.84:0/4061043928 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c90005000 0x7f0c9000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:06.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.280+0000 7f0ca7fff700 1 --2- 172.21.15.84:0/4061043928 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c90003a00 0x7f0c90003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:06.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.280+0000 7f0ca77fe700 1 -- 172.21.15.84:0/4061043928 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c90005000 msgr2=0x7f0c9000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:06.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.280+0000 7f0ca77fe700 1 --2- 172.21.15.84:0/4061043928 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c90005000 0x7f0c9000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:06.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.280+0000 7f0ca77fe700 1 -- 172.21.15.84:0/4061043928 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c90003a00 msgr2=0x7f0c90003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:06.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.280+0000 7f0ca77fe700 1 --2- 172.21.15.84:0/4061043928 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c90003a00 0x7f0c90003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:06.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.280+0000 7f0ca77fe700 1 -- 172.21.15.84:0/4061043928 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c900035b0 con 0x7f0c90004430 2023-07-14T11:18:06.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.280+0000 7f0ca77fe700 1 --2- 172.21.15.84:0/4061043928 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c90004430 0x7f0c900048f0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c00c320 tx=0x7f0c90005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=391eb2e5386be4bb server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:06.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.280+0000 7f0ca6ffd700 1 -- 172.21.15.84:0/4061043928 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9c00ce60 con 0x7f0c90004430 2023-07-14T11:18:06.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.280+0000 7f0ca6ffd700 1 -- 172.21.15.84:0/4061043928 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c9c005960 con 0x7f0c90004430 2023-07-14T11:18:06.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.280+0000 7f0ca6ffd700 1 -- 172.21.15.84:0/4061043928 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9c005cf0 con 0x7f0c90004430 2023-07-14T11:18:06.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.281+0000 7f0cae3ff700 1 -- 172.21.15.84:0/4061043928 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c90004430 msgr2=0x7f0c900048f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:06.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.281+0000 7f0cae3ff700 1 --2- 172.21.15.84:0/4061043928 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c90004430 0x7f0c900048f0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c00c320 tx=0x7f0c90005880 comp rx=0 tx=0).stop 2023-07-14T11:18:06.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.281+0000 7f0cac99c700 1 -- 172.21.15.84:0/4061043928 reap_dead start 2023-07-14T11:18:06.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.281+0000 7f0cae3ff700 1 -- 172.21.15.84:0/4061043928 shutdown_connections 2023-07-14T11:18:06.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.281+0000 7f0cae3ff700 1 -- 172.21.15.84:0/4061043928 >> 172.21.15.84:0/4061043928 conn(0x7f0ca80b05d0 msgr2=0x7f0ca80b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:06.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.281+0000 7f0cae3ff700 1 -- 172.21.15.84:0/4061043928 shutdown_connections 2023-07-14T11:18:06.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.281+0000 7f0cae3ff700 1 -- 172.21.15.84:0/4061043928 wait complete. 2023-07-14T11:18:06.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.283+0000 7f0cae3ff700 1 Processor -- start 2023-07-14T11:18:06.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.283+0000 7f0cae3ff700 1 -- start start 2023-07-14T11:18:06.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.284+0000 7f0cae3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c90004430 0x7f0ca815c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:06.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.284+0000 7f0cae3ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ca81e6bc0 0x7f0ca81e4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:06.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.284+0000 7f0cae3ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ca8070250 0x7f0ca80706c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:06.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.284+0000 7f0cae3ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca80b30e0 con 0x7f0ca81e6bc0 2023-07-14T11:18:06.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.284+0000 7f0cae3ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca8070c00 con 0x7f0ca8070250 2023-07-14T11:18:06.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.284+0000 7f0cae3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca8159910 con 0x7f0c90004430 2023-07-14T11:18:06.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.284+0000 7f0ca77fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ca81e6bc0 0x7f0ca81e4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:06.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.284+0000 7f0ca77fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ca81e6bc0 0x7f0ca81e4600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36598/0 (socket says 172.21.15.84:36598) 2023-07-14T11:18:06.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.284+0000 7f0ca77fe700 1 -- 172.21.15.84:0/856749986 learned_addr learned my addr 172.21.15.84:0/856749986 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:06.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.285+0000 7f0cac99c700 1 --2- 172.21.15.84:0/856749986 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ca8070250 0x7f0ca80706c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:06.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.285+0000 7f0ca77fe700 1 -- 172.21.15.84:0/856749986 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c90004430 msgr2=0x7f0ca815c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:06.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.285+0000 7f0ca77fe700 1 --2- 172.21.15.84:0/856749986 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c90004430 0x7f0ca815c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:06.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.285+0000 7f0ca77fe700 1 -- 172.21.15.84:0/856749986 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ca8070250 msgr2=0x7f0ca80706c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:06.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.285+0000 7f0ca77fe700 1 --2- 172.21.15.84:0/856749986 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ca8070250 0x7f0ca80706c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:06.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.285+0000 7f0ca77fe700 1 -- 172.21.15.84:0/856749986 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca81e5110 con 0x7f0ca81e6bc0 2023-07-14T11:18:06.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.285+0000 7f0cac99c700 1 --2- 172.21.15.84:0/856749986 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ca8070250 0x7f0ca80706c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:18:06.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.285+0000 7f0ca77fe700 1 --2- 172.21.15.84:0/856749986 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ca81e6bc0 0x7f0ca81e4600 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c00c910 tx=0x7f0c9c001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:06.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.285+0000 7f0ca4ff9700 1 -- 172.21.15.84:0/856749986 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9c004870 con 0x7f0ca81e6bc0 2023-07-14T11:18:06.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.285+0000 7f0ca4ff9700 1 -- 172.21.15.84:0/856749986 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c9c0049f0 con 0x7f0ca81e6bc0 2023-07-14T11:18:06.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.285+0000 7f0cae3ff700 1 -- 172.21.15.84:0/856749986 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ca81e4e30 con 0x7f0ca81e6bc0 2023-07-14T11:18:06.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.285+0000 7f0ca4ff9700 1 -- 172.21.15.84:0/856749986 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9c004da0 con 0x7f0ca81e6bc0 2023-07-14T11:18:06.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.285+0000 7f0cae3ff700 1 -- 172.21.15.84:0/856749986 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ca80b2d00 con 0x7f0ca81e6bc0 2023-07-14T11:18:06.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.286+0000 7f0cae3ff700 1 -- 172.21.15.84:0/856749986 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ca80b2880 con 0x7f0ca81e6bc0 2023-07-14T11:18:06.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.287+0000 7f0ca4ff9700 1 -- 172.21.15.84:0/856749986 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7f0c9c0070d0 con 0x7f0ca81e6bc0 2023-07-14T11:18:06.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.288+0000 7f0ca4ff9700 1 --2- 172.21.15.84:0/856749986 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f0c9406b040 0x7f0c9406d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:06.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.288+0000 7f0ca4ff9700 1 -- 172.21.15.84:0/856749986 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0c9c08ada0 con 0x7f0ca81e6bc0 2023-07-14T11:18:06.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.288+0000 7f0ca7fff700 1 --2- 172.21.15.84:0/856749986 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f0c9406b040 0x7f0c9406d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:06.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.289+0000 7f0ca7fff700 1 --2- 172.21.15.84:0/856749986 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f0c9406b040 0x7f0c9406d4f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f0ca806f630 tx=0x7f0c98008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:06.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.292+0000 7f0ca4ff9700 1 -- 172.21.15.84:0/856749986 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f0ca80b2880 con 0x7f0ca81e6bc0 2023-07-14T11:18:06.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.565+0000 7f0cae3ff700 1 -- 172.21.15.84:0/856749986 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f0ca80b2880 con 0x7f0ca81e6bc0 2023-07-14T11:18:06.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.569+0000 7f0ca4ff9700 1 -- 172.21.15.84:0/856749986 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v20) v1 ==== 190+0+147 (secure 0 0 0) 0x7f0ca80b2880 con 0x7f0ca81e6bc0 2023-07-14T11:18:06.573 INFO:teuthology.orchestra.run.smithi084.stdout:[client.0] 2023-07-14T11:18:06.573 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCKLbFkKSl5GBAAwPK4Zs6+gv/6YKHh4JI3WA== 2023-07-14T11:18:06.573 INFO:teuthology.orchestra.run.smithi084.stdout: caps mds = "allow" 2023-07-14T11:18:06.573 INFO:teuthology.orchestra.run.smithi084.stdout: caps mon = "allow r" 2023-07-14T11:18:06.573 INFO:teuthology.orchestra.run.smithi084.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-14T11:18:06.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.572+0000 7f0cae3ff700 1 -- 172.21.15.84:0/856749986 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f0c9406b040 msgr2=0x7f0c9406d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:06.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.572+0000 7f0cae3ff700 1 --2- 172.21.15.84:0/856749986 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f0c9406b040 0x7f0c9406d4f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f0ca806f630 tx=0x7f0c98008040 comp rx=0 tx=0).stop 2023-07-14T11:18:06.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.572+0000 7f0cae3ff700 1 -- 172.21.15.84:0/856749986 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ca81e6bc0 msgr2=0x7f0ca81e4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:06.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.572+0000 7f0cae3ff700 1 --2- 172.21.15.84:0/856749986 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ca81e6bc0 0x7f0ca81e4600 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c00c910 tx=0x7f0c9c001a00 comp rx=0 tx=0).stop 2023-07-14T11:18:06.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.572+0000 7f0cae3ff700 1 -- 172.21.15.84:0/856749986 shutdown_connections 2023-07-14T11:18:06.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.572+0000 7f0cae3ff700 1 --2- 172.21.15.84:0/856749986 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f0c9406b040 0x7f0c9406d4f0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:06.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.572+0000 7f0cae3ff700 1 --2- 172.21.15.84:0/856749986 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c90004430 0x7f0ca815c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:06.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.572+0000 7f0cae3ff700 1 --2- 172.21.15.84:0/856749986 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ca8070250 0x7f0ca80706c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:06.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.572+0000 7f0cae3ff700 1 --2- 172.21.15.84:0/856749986 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ca81e6bc0 0x7f0ca81e4600 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:06.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.572+0000 7f0cae3ff700 1 -- 172.21.15.84:0/856749986 >> 172.21.15.84:0/856749986 conn(0x7f0ca80b05d0 msgr2=0x7f0ca806b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:06.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.572+0000 7f0cae3ff700 1 -- 172.21.15.84:0/856749986 shutdown_connections 2023-07-14T11:18:06.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.572+0000 7f0cae3ff700 1 -- 172.21.15.84:0/856749986 wait complete. 2023-07-14T11:18:06.577 INFO:teuthology.orchestra.run.smithi084.stderr:updated caps for client.0 2023-07-14T11:18:06.594 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T11:18:06.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.787+0000 7f0ec07ff700 1 Processor -- start 2023-07-14T11:18:06.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.787+0000 7f0ec07ff700 1 -- start start 2023-07-14T11:18:06.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.788+0000 7f0ec07ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0eb8160030 0x7f0eb806c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:06.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.788+0000 7f0ec07ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0eb80b5cd0 0x7f0eb80d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:06.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.788+0000 7f0ec07ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0eb80b1f70 0x7f0eb80d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:06.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.788+0000 7f0ec07ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0eb80d2cc0 con 0x7f0eb80b1f70 2023-07-14T11:18:06.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.788+0000 7f0ec07ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0eb80afbb0 con 0x7f0eb8160030 2023-07-14T11:18:06.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.788+0000 7f0ec07ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb80afe90 con 0x7f0eb80b5cd0 2023-07-14T11:18:06.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.788+0000 7f0ebed9c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0eb80b1f70 0x7f0eb80d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:06.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.788+0000 7f0ebed9c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0eb80b1f70 0x7f0eb80d0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36608/0 (socket says 172.21.15.84:36608) 2023-07-14T11:18:06.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.788+0000 7f0ebed9c700 1 -- 172.21.15.84:0/3418975442 learned_addr learned my addr 172.21.15.84:0/3418975442 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:06.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.788+0000 7f0ebdd9a700 1 --2- 172.21.15.84:0/3418975442 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0eb80b5cd0 0x7f0eb80d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:06.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.788+0000 7f0ebe59b700 1 --2- 172.21.15.84:0/3418975442 >> v2:172.21.15.179:3300/0 conn(0x7f0eb8160030 0x7f0eb806c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:06.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.788+0000 7f0ebed9c700 1 -- 172.21.15.84:0/3418975442 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0eb80b5cd0 msgr2=0x7f0eb80d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:06.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.788+0000 7f0ebed9c700 1 --2- 172.21.15.84:0/3418975442 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0eb80b5cd0 0x7f0eb80d0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:06.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.788+0000 7f0ebed9c700 1 -- 172.21.15.84:0/3418975442 >> v2:172.21.15.179:3300/0 conn(0x7f0eb8160030 msgr2=0x7f0eb806c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:06.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.788+0000 7f0ebed9c700 1 --2- 172.21.15.84:0/3418975442 >> v2:172.21.15.179:3300/0 conn(0x7f0eb8160030 0x7f0eb806c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:06.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.788+0000 7f0ebed9c700 1 -- 172.21.15.84:0/3418975442 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb80b0170 con 0x7f0eb80b1f70 2023-07-14T11:18:06.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.788+0000 7f0ebed9c700 1 --2- 172.21.15.84:0/3418975442 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0eb80b1f70 0x7f0eb80d0f90 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f0eb806d1a0 tx=0x7f0eb000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bc9e98c9ae270fb server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:06.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.788+0000 7f0ebd599700 1 -- 172.21.15.84:0/3418975442 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb000e070 con 0x7f0eb80b1f70 2023-07-14T11:18:06.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.788+0000 7f0ebd599700 1 -- 172.21.15.84:0/3418975442 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eb000b9c0 con 0x7f0eb80b1f70 2023-07-14T11:18:06.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.788+0000 7f0ebd599700 1 -- 172.21.15.84:0/3418975442 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb000bd70 con 0x7f0eb80b1f70 2023-07-14T11:18:06.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.790+0000 7f0ec07ff700 1 -- 172.21.15.84:0/3418975442 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0eb80b1f70 msgr2=0x7f0eb80d0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:06.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.790+0000 7f0ec07ff700 1 --2- 172.21.15.84:0/3418975442 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0eb80b1f70 0x7f0eb80d0f90 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f0eb806d1a0 tx=0x7f0eb000b330 comp rx=0 tx=0).stop 2023-07-14T11:18:06.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.790+0000 7f0ec07ff700 1 -- 172.21.15.84:0/3418975442 shutdown_connections 2023-07-14T11:18:06.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.790+0000 7f0ec07ff700 1 --2- 172.21.15.84:0/3418975442 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0eb80b1f70 0x7f0eb80d0f90 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:06.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.790+0000 7f0ec07ff700 1 --2- 172.21.15.84:0/3418975442 >> v2:172.21.15.179:3300/0 conn(0x7f0eb8160030 0x7f0eb806c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:06.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.790+0000 7f0ec07ff700 1 --2- 172.21.15.84:0/3418975442 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0eb80b5cd0 0x7f0eb80d0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:06.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.790+0000 7f0ec07ff700 1 -- 172.21.15.84:0/3418975442 >> 172.21.15.84:0/3418975442 conn(0x7f0eb809c190 msgr2=0x7f0eb80d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:06.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.790+0000 7f0ec07ff700 1 -- 172.21.15.84:0/3418975442 shutdown_connections 2023-07-14T11:18:06.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.790+0000 7f0ec07ff700 1 -- 172.21.15.84:0/3418975442 wait complete. 2023-07-14T11:18:06.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.792+0000 7f0ec07ff700 1 Processor -- start 2023-07-14T11:18:06.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.792+0000 7f0ec07ff700 1 -- start start 2023-07-14T11:18:06.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.793+0000 7f0ec07ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0eb80b1f70 0x7f0eb80b1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:06.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.793+0000 7f0ec07ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0eb80b5cd0 0x7f0eb80b6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:06.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.793+0000 7f0ec07ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0eb8160030 0x7f0eb815c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:06.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.793+0000 7f0ec07ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb815aa40 con 0x7f0eb80b5cd0 2023-07-14T11:18:06.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.793+0000 7f0ec07ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb80b15c0 con 0x7f0eb8160030 2023-07-14T11:18:06.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.793+0000 7f0ec07ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb80b6a00 con 0x7f0eb80b1f70 2023-07-14T11:18:06.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.793+0000 7f0ebdd9a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0eb80b5cd0 0x7f0eb80b6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:06.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.793+0000 7f0ebdd9a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0eb80b5cd0 0x7f0eb80b6100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36620/0 (socket says 172.21.15.84:36620) 2023-07-14T11:18:06.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.793+0000 7f0ebdd9a700 1 -- 172.21.15.84:0/204518423 learned_addr learned my addr 172.21.15.84:0/204518423 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:06.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.794+0000 7f0ebe59b700 1 --2- 172.21.15.84:0/204518423 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0eb80b1f70 0x7f0eb80b1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:06.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.794+0000 7f0ebed9c700 1 --2- 172.21.15.84:0/204518423 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0eb8160030 0x7f0eb815c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:06.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.794+0000 7f0ebdd9a700 1 -- 172.21.15.84:0/204518423 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0eb80b1f70 msgr2=0x7f0eb80b1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:06.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.794+0000 7f0ebdd9a700 1 --2- 172.21.15.84:0/204518423 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0eb80b1f70 0x7f0eb80b1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:06.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.794+0000 7f0ebdd9a700 1 -- 172.21.15.84:0/204518423 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0eb8160030 msgr2=0x7f0eb815c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:06.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.794+0000 7f0ebdd9a700 1 --2- 172.21.15.84:0/204518423 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0eb8160030 0x7f0eb815c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:06.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.794+0000 7f0ebdd9a700 1 -- 172.21.15.84:0/204518423 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb0009b30 con 0x7f0eb80b5cd0 2023-07-14T11:18:06.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.794+0000 7f0ebed9c700 1 --2- 172.21.15.84:0/204518423 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0eb8160030 0x7f0eb815c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:18:06.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.794+0000 7f0ebdd9a700 1 --2- 172.21.15.84:0/204518423 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0eb80b5cd0 0x7f0eb80b6100 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f0ea800e810 tx=0x7f0ea800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:06.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.794+0000 7f0eaeffd700 1 -- 172.21.15.84:0/204518423 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea8013610 con 0x7f0eb80b5cd0 2023-07-14T11:18:06.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.794+0000 7f0eaeffd700 1 -- 172.21.15.84:0/204518423 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ea8013770 con 0x7f0eb80b5cd0 2023-07-14T11:18:06.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.794+0000 7f0ec07ff700 1 -- 172.21.15.84:0/204518423 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eb80b6ce0 con 0x7f0eb80b5cd0 2023-07-14T11:18:06.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.794+0000 7f0eaeffd700 1 -- 172.21.15.84:0/204518423 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea8013b00 con 0x7f0eb80b5cd0 2023-07-14T11:18:06.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.794+0000 7f0ec07ff700 1 -- 172.21.15.84:0/204518423 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eb815a660 con 0x7f0eb80b5cd0 2023-07-14T11:18:06.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.795+0000 7f0ec07ff700 1 -- 172.21.15.84:0/204518423 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0eb815ab80 con 0x7f0eb80b5cd0 2023-07-14T11:18:06.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.796+0000 7f0eaeffd700 1 -- 172.21.15.84:0/204518423 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7f0ea8013c60 con 0x7f0eb80b5cd0 2023-07-14T11:18:06.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.797+0000 7f0eaeffd700 1 --2- 172.21.15.84:0/204518423 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f0e9c06b040 0x7f0e9c06d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:06.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.797+0000 7f0eaeffd700 1 -- 172.21.15.84:0/204518423 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0ea80897c0 con 0x7f0eb80b5cd0 2023-07-14T11:18:06.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.797+0000 7f0ebe59b700 1 --2- 172.21.15.84:0/204518423 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f0e9c06b040 0x7f0e9c06d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:06.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.798+0000 7f0ebe59b700 1 --2- 172.21.15.84:0/204518423 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f0e9c06b040 0x7f0e9c06d4f0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f0eb400b9b0 tx=0x7f0eb4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:06.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:06.801+0000 7f0eaeffd700 1 -- 172.21.15.84:0/204518423 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f0ea8054310 con 0x7f0eb80b5cd0 2023-07-14T11:18:07.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.044+0000 7f0ec07ff700 1 -- 172.21.15.84:0/204518423 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0eb804e280 con 0x7f0eb80b5cd0 2023-07-14T11:18:07.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.045+0000 7f0eaeffd700 1 -- 172.21.15.84:0/204518423 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+4717 (secure 0 0 0) 0x7f0ea8057930 con 0x7f0eb80b5cd0 2023-07-14T11:18:07.047 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:18:07.048 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":45,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5615,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3014145470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3014145470},{"type":"v1","addr":"172.21.15.179:6834","nonce":3014145470}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":5621,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3377004712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":3377004712},{"type":"v1","addr":"172.21.15.179:6835","nonce":3377004712}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":6681,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1864489758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1864489758},{"type":"v1","addr":"172.21.15.84:6835","nonce":1864489758}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T11:17:55.741927+0000","modified":"2023-07-14T11:17:59.277009+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6690},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6690":{"gid":6690,"name":"c","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/2405785300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":2405785300},{"type":"v1","addr":"172.21.15.84:6837","nonce":2405785300}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-07-14T11:18:07.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.047+0000 7f0ec07ff700 1 -- 172.21.15.84:0/204518423 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f0e9c06b040 msgr2=0x7f0e9c06d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:07.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.047+0000 7f0ec07ff700 1 --2- 172.21.15.84:0/204518423 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f0e9c06b040 0x7f0e9c06d4f0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f0eb400b9b0 tx=0x7f0eb4008040 comp rx=0 tx=0).stop 2023-07-14T11:18:07.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.047+0000 7f0ec07ff700 1 -- 172.21.15.84:0/204518423 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0eb80b5cd0 msgr2=0x7f0eb80b6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:07.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.047+0000 7f0ec07ff700 1 --2- 172.21.15.84:0/204518423 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0eb80b5cd0 0x7f0eb80b6100 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f0ea800e810 tx=0x7f0ea800ebd0 comp rx=0 tx=0).stop 2023-07-14T11:18:07.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.047+0000 7f0ec07ff700 1 -- 172.21.15.84:0/204518423 shutdown_connections 2023-07-14T11:18:07.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.047+0000 7f0ec07ff700 1 --2- 172.21.15.84:0/204518423 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f0e9c06b040 0x7f0e9c06d4f0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:07.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.047+0000 7f0ec07ff700 1 --2- 172.21.15.84:0/204518423 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0eb80b1f70 0x7f0eb80b1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:07.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.047+0000 7f0ec07ff700 1 --2- 172.21.15.84:0/204518423 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0eb8160030 0x7f0eb815c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:07.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.047+0000 7f0ec07ff700 1 --2- 172.21.15.84:0/204518423 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0eb80b5cd0 0x7f0eb80b6100 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:07.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.047+0000 7f0ec07ff700 1 -- 172.21.15.84:0/204518423 >> 172.21.15.84:0/204518423 conn(0x7f0eb809c190 msgr2=0x7f0eb806c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:07.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.047+0000 7f0ec07ff700 1 -- 172.21.15.84:0/204518423 shutdown_connections 2023-07-14T11:18:07.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.047+0000 7f0ec07ff700 1 -- 172.21.15.84:0/204518423 wait complete. 2023-07-14T11:18:07.051 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 45 2023-07-14T11:18:07.465 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T11:18:07.469 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 45, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-14T11:17:55.741927+0000', 'modified': '2023-07-14T11:17:59.277009+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6690}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6690': {'gid': 6690, 'name': 'c', 'rank': 0, 'incarnation': 42, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.84:6837/2405785300', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6836', 'nonce': 2405785300}, {'type': 'v1', 'addr': '172.21.15.84:6837', 'nonce': 2405785300}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-14T11:18:07.470 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-14T11:18:07.470 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-07-14T11:18:07.471 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T11:18:07.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.706+0000 7f19befff700 1 Processor -- start 2023-07-14T11:18:07.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.706+0000 7f19befff700 1 -- start start 2023-07-14T11:18:07.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.707+0000 7f19befff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19b80b8a60 0x7f19b80b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:07.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.708+0000 7f19befff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f19b80d1220 0x7f19b80b0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:07.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.708+0000 7f19befff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19b80b8e30 con 0x7f19b80b4530 2023-07-14T11:18:07.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.708+0000 7f19befff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19b80afaa0 con 0x7f19b80d1220 2023-07-14T11:18:07.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.708+0000 7f19befff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19b80afd80 con 0x7f19b80b8a60 2023-07-14T11:18:07.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.708+0000 7f19bd59c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f19b80d1220 0x7f19b80b0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:07.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.708+0000 7f19bd59c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f19b80d1220 0x7f19b80b0e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36636/0 (socket says 172.21.15.84:36636) 2023-07-14T11:18:07.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.708+0000 7f19bd59c700 1 -- 172.21.15.84:0/1353781376 learned_addr learned my addr 172.21.15.84:0/1353781376 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:07.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.708+0000 7f19bcd9b700 1 --2- 172.21.15.84:0/1353781376 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19b80b8a60 0x7f19b80b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:07.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.708+0000 7f19bd59c700 1 -- 172.21.15.84:0/1353781376 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19b80b8a60 msgr2=0x7f19b80b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:07.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.708+0000 7f19bd59c700 1 --2- 172.21.15.84:0/1353781376 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19b80b8a60 0x7f19b80b3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:07.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.708+0000 7f19bd59c700 1 -- 172.21.15.84:0/1353781376 >> v1:172.21.15.179:6789/0 conn(0x7f19b80b4530 legacy=0x7f19b80d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:07.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.708+0000 7f19bd59c700 1 -- 172.21.15.84:0/1353781376 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b80b0060 con 0x7f19b80d1220 2023-07-14T11:18:07.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.709+0000 7f19bd59c700 1 --2- 172.21.15.84:0/1353781376 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19b80d1220 0x7f19b80b0e20 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f19b0009e50 tx=0x7f19b000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57bc20e42137d025 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:07.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.709+0000 7f19b77fe700 1 -- 172.21.15.84:0/1353781376 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b000e070 con 0x7f19b80d1220 2023-07-14T11:18:07.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.709+0000 7f19b77fe700 1 -- 172.21.15.84:0/1353781376 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19b000b9c0 con 0x7f19b80d1220 2023-07-14T11:18:07.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.709+0000 7f19b77fe700 1 -- 172.21.15.84:0/1353781376 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b000bd70 con 0x7f19b80d1220 2023-07-14T11:18:07.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.709+0000 7f19befff700 1 -- 172.21.15.84:0/1353781376 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19b80d1220 msgr2=0x7f19b80b0e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:07.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.709+0000 7f19befff700 1 --2- 172.21.15.84:0/1353781376 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19b80d1220 0x7f19b80b0e20 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f19b0009e50 tx=0x7f19b000b330 comp rx=0 tx=0).stop 2023-07-14T11:18:07.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.709+0000 7f19befff700 1 -- 172.21.15.84:0/1353781376 shutdown_connections 2023-07-14T11:18:07.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.709+0000 7f19befff700 1 --2- 172.21.15.84:0/1353781376 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19b80d1220 0x7f19b80b0e20 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:07.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.709+0000 7f19befff700 1 --2- 172.21.15.84:0/1353781376 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19b80b8a60 0x7f19b80b3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:07.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.710+0000 7f19befff700 1 -- 172.21.15.84:0/1353781376 >> 172.21.15.84:0/1353781376 conn(0x7f19b809c1b0 msgr2=0x7f19b80d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:07.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.710+0000 7f19befff700 1 -- 172.21.15.84:0/1353781376 shutdown_connections 2023-07-14T11:18:07.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.710+0000 7f19befff700 1 -- 172.21.15.84:0/1353781376 wait complete. 2023-07-14T11:18:07.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.712+0000 7f19befff700 1 Processor -- start 2023-07-14T11:18:07.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.712+0000 7f19befff700 1 -- start start 2023-07-14T11:18:07.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.713+0000 7f19befff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19b80b4530 0x7f19b80cbda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:07.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.713+0000 7f19befff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19b80b8a60 0x7f19b81f5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:07.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.713+0000 7f19befff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19b80d1220 0x7f19b80ca010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:07.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.713+0000 7f19befff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b80b7f10 con 0x7f19b80d1220 2023-07-14T11:18:07.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.713+0000 7f19befff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b80cad00 con 0x7f19b80b8a60 2023-07-14T11:18:07.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.713+0000 7f19befff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19b80cafe0 con 0x7f19b80b4530 2023-07-14T11:18:07.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.714+0000 7f19bd59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19b80d1220 0x7f19b80ca010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:07.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.714+0000 7f19bcd9b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19b80b4530 0x7f19b80cbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:07.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.714+0000 7f19bcd9b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19b80b4530 0x7f19b80cbda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.84:60984/0 (socket says 172.21.15.84:60984) 2023-07-14T11:18:07.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.714+0000 7f19b7fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19b80b8a60 0x7f19b81f5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:07.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.714+0000 7f19bcd9b700 1 -- 172.21.15.84:0/3135402563 learned_addr learned my addr 172.21.15.84:0/3135402563 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:07.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.714+0000 7f19bd59c700 1 -- 172.21.15.84:0/3135402563 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19b80b4530 msgr2=0x7f19b80cbda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:07.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.714+0000 7f19bd59c700 1 --2- 172.21.15.84:0/3135402563 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19b80b4530 0x7f19b80cbda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:07.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.714+0000 7f19bd59c700 1 -- 172.21.15.84:0/3135402563 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19b80b8a60 msgr2=0x7f19b81f5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:07.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.714+0000 7f19bd59c700 1 --2- 172.21.15.84:0/3135402563 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19b80b8a60 0x7f19b81f5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:07.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.714+0000 7f19bd59c700 1 -- 172.21.15.84:0/3135402563 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b0009b30 con 0x7f19b80d1220 2023-07-14T11:18:07.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.714+0000 7f19bd59c700 1 --2- 172.21.15.84:0/3135402563 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19b80d1220 0x7f19b80ca010 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f19b0015000 tx=0x7f19b0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:07.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.715+0000 7f19b57fa700 1 -- 172.21.15.84:0/3135402563 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b00047c0 con 0x7f19b80d1220 2023-07-14T11:18:07.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.715+0000 7f19b57fa700 1 -- 172.21.15.84:0/3135402563 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19b00092e0 con 0x7f19b80d1220 2023-07-14T11:18:07.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.715+0000 7f19befff700 1 -- 172.21.15.84:0/3135402563 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19b80cb2c0 con 0x7f19b80d1220 2023-07-14T11:18:07.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.715+0000 7f19b57fa700 1 -- 172.21.15.84:0/3135402563 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b001c680 con 0x7f19b80d1220 2023-07-14T11:18:07.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.715+0000 7f19befff700 1 -- 172.21.15.84:0/3135402563 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19b80cb880 con 0x7f19b80d1220 2023-07-14T11:18:07.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.717+0000 7f19b57fa700 1 -- 172.21.15.84:0/3135402563 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7f19b001c7e0 con 0x7f19b80d1220 2023-07-14T11:18:07.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.718+0000 7f19b57fa700 1 --2- 172.21.15.84:0/3135402563 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f199c06b040 0x7f199c06d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:07.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.718+0000 7f19b57fa700 1 -- 172.21.15.84:0/3135402563 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f19b008af80 con 0x7f19b80d1220 2023-07-14T11:18:07.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.718+0000 7f19bcd9b700 1 --2- 172.21.15.84:0/3135402563 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f199c06b040 0x7f199c06d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:07.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.719+0000 7f19bcd9b700 1 --2- 172.21.15.84:0/3135402563 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f199c06b040 0x7f199c06d4f0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f19b81531a0 tx=0x7f19ac008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:07.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.720+0000 7f19d28b0b80 1 Processor -- start 2023-07-14T11:18:07.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.720+0000 7f19d28b0b80 1 -- start start 2023-07-14T11:18:07.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.721+0000 7f19d28b0b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e4b2907880 0x55e4b29375e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:07.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.721+0000 7f19d28b0b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e4b2909dc0 0x55e4b2937b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:07.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.721+0000 7f19d28b0b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e4b2907c50 0x55e4b2922120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:07.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.721+0000 7f19d28b0b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4b2881ea0 con 0x55e4b2909dc0 2023-07-14T11:18:07.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.721+0000 7f19d28b0b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4b27f5600 con 0x55e4b2907880 2023-07-14T11:18:07.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.721+0000 7f19d28b0b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e4b2864910 con 0x55e4b2907c50 2023-07-14T11:18:07.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.721+0000 7f19b7fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e4b2909dc0 0x55e4b2937b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:07.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.721+0000 7f19b7fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e4b2909dc0 0x55e4b2937b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36650/0 (socket says 172.21.15.84:36650) 2023-07-14T11:18:07.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.721+0000 7f19b7fff700 1 -- 172.21.15.84:0/1064029077 learned_addr learned my addr 172.21.15.84:0/1064029077 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:07.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.721+0000 7f19bd59c700 1 --2- 172.21.15.84:0/1064029077 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e4b2907c50 0x55e4b2922120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:07.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.721+0000 7f19bcd9b700 1 --2- 172.21.15.84:0/1064029077 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e4b2907880 0x55e4b29375e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:07.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.721+0000 7f19b7fff700 1 -- 172.21.15.84:0/1064029077 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e4b2907c50 msgr2=0x55e4b2922120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:07.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.721+0000 7f19b7fff700 1 --2- 172.21.15.84:0/1064029077 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e4b2907c50 0x55e4b2922120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:07.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.722+0000 7f19b7fff700 1 -- 172.21.15.84:0/1064029077 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e4b2907880 msgr2=0x55e4b29375e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:07.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.722+0000 7f19b7fff700 1 --2- 172.21.15.84:0/1064029077 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e4b2907880 0x55e4b29375e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:07.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.722+0000 7f19b7fff700 1 -- 172.21.15.84:0/1064029077 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e4b2651790 con 0x55e4b2909dc0 2023-07-14T11:18:07.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.722+0000 7f19bcd9b700 1 --2- 172.21.15.84:0/1064029077 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e4b2907880 0x55e4b29375e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:18:07.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.722+0000 7f19b7fff700 1 --2- 172.21.15.84:0/1064029077 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e4b2909dc0 0x55e4b2937b20 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f19a4001740 tx=0x7f19a4007ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e818e9f9d7395a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:07.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.722+0000 7f19a27fc700 1 -- 172.21.15.84:0/1064029077 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a40052e0 con 0x55e4b2909dc0 2023-07-14T11:18:07.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.722+0000 7f19a27fc700 1 -- 172.21.15.84:0/1064029077 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19a4005440 con 0x55e4b2909dc0 2023-07-14T11:18:07.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.722+0000 7f19a27fc700 1 -- 172.21.15.84:0/1064029077 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a40038a0 con 0x55e4b2909dc0 2023-07-14T11:18:07.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.723+0000 7f19d28b0b80 1 -- 172.21.15.84:0/1064029077 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e4b2909dc0 msgr2=0x55e4b2937b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:07.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.723+0000 7f19d28b0b80 1 --2- 172.21.15.84:0/1064029077 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e4b2909dc0 0x55e4b2937b20 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f19a4001740 tx=0x7f19a4007ec0 comp rx=0 tx=0).stop 2023-07-14T11:18:07.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.723+0000 7f19d28b0b80 1 -- 172.21.15.84:0/1064029077 shutdown_connections 2023-07-14T11:18:07.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.723+0000 7f19d28b0b80 1 --2- 172.21.15.84:0/1064029077 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e4b2907c50 0x55e4b2922120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:07.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.723+0000 7f19d28b0b80 1 --2- 172.21.15.84:0/1064029077 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e4b2907880 0x55e4b29375e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:07.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.723+0000 7f19d28b0b80 1 --2- 172.21.15.84:0/1064029077 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e4b2909dc0 0x55e4b2937b20 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:07.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.723+0000 7f19d28b0b80 1 -- 172.21.15.84:0/1064029077 >> 172.21.15.84:0/1064029077 conn(0x55e4b29023b0 msgr2=0x55e4b290d550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:07.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.723+0000 7f19d28b0b80 1 -- 172.21.15.84:0/1064029077 shutdown_connections 2023-07-14T11:18:07.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.723+0000 7f19d28b0b80 1 -- 172.21.15.84:0/1064029077 wait complete. 2023-07-14T11:18:07.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.724+0000 7f19d28b0b80 1 -- start start 2023-07-14T11:18:07.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.724+0000 7f19d28b0b80 1 Processor -- start 2023-07-14T11:18:07.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.726+0000 7f19d28b0b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e4b2907880 0x55e4b293a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:07.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.726+0000 7f19d28b0b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e4b2907c50 0x55e4b2922f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:07.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.726+0000 7f19d28b0b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e4b2909dc0 0x55e4b29081b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:07.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.726+0000 7f19d28b0b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4b285dbe0 con 0x55e4b2907880 2023-07-14T11:18:07.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.726+0000 7f19d28b0b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4b281b5b0 con 0x55e4b2909dc0 2023-07-14T11:18:07.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.726+0000 7f19d28b0b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e4b2801910 con 0x55e4b2907c50 2023-07-14T11:18:07.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.726+0000 7f19d28b0b80 10 client.0 _ll_register_callbacks cb 0x55e4b2819b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T11:18:07.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.726+0000 7f19bcd9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e4b2907880 0x55e4b293a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:07.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.726+0000 7f19bcd9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e4b2907880 0x55e4b293a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36662/0 (socket says 172.21.15.84:36662) 2023-07-14T11:18:07.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.726+0000 7f19bcd9b700 1 -- 172.21.15.84:0/2137638726 learned_addr learned my addr 172.21.15.84:0/2137638726 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:07.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.726+0000 7f19bcd9b700 1 -- 172.21.15.84:0/2137638726 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e4b2907c50 msgr2=0x55e4b2922f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:07.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.726+0000 7f19b7fff700 1 --2- 172.21.15.84:0/2137638726 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e4b2907c50 0x55e4b2922f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:07.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.726+0000 7f19bd59c700 1 --2- 172.21.15.84:0/2137638726 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e4b2909dc0 0x55e4b29081b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:07.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.726+0000 7f19bcd9b700 1 --2- 172.21.15.84:0/2137638726 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e4b2907c50 0x55e4b2922f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:07.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.726+0000 7f19bcd9b700 1 -- 172.21.15.84:0/2137638726 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e4b2909dc0 msgr2=0x55e4b29081b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:07.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.726+0000 7f19bcd9b700 1 --2- 172.21.15.84:0/2137638726 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e4b2909dc0 0x55e4b29081b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:07.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.726+0000 7f19bcd9b700 1 -- 172.21.15.84:0/2137638726 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19b80b8e30 con 0x55e4b2907880 2023-07-14T11:18:07.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.726+0000 7f19b7fff700 1 --2- 172.21.15.84:0/2137638726 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e4b2907c50 0x55e4b2922f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:18:07.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.726+0000 7f19bd59c700 1 --2- 172.21.15.84:0/2137638726 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e4b2909dc0 0x55e4b29081b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:18:07.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.727+0000 7f19bcd9b700 1 --2- 172.21.15.84:0/2137638726 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e4b2907880 0x55e4b293a850 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f19ac0154c0 tx=0x7f19ac004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ca5b68d5452f581 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:07.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.727+0000 7f19977fe700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-07-14T11:18:07.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.727+0000 7f19977fe700 1 -- 172.21.15.84:0/2137638726 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19ac022830 con 0x55e4b2907880 2023-07-14T11:18:07.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.727+0000 7f19977fe700 1 -- 172.21.15.84:0/2137638726 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(75..75 src has 1..75) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f19ac022990 con 0x55e4b2907880 2023-07-14T11:18:07.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.727+0000 7f19d28b0b80 1 -- 172.21.15.84:0/2137638726 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e4b28ff9c0 con 0x55e4b2907880 2023-07-14T11:18:07.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.727+0000 7f19977fe700 1 -- 172.21.15.84:0/2137638726 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f19ac015e80 con 0x55e4b2907880 2023-07-14T11:18:07.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.727+0000 7f19d28b0b80 10 client.6864 fetch_fsmap learned FSMap version 45 2023-07-14T11:18:07.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.727+0000 7f19d28b0b80 1 -- 172.21.15.84:0/2137638726 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=2+}) v3 -- 0x55e4b273e0a0 con 0x55e4b2907880 2023-07-14T11:18:07.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.727+0000 7f19977fe700 1 -- 172.21.15.84:0/2137638726 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e4b28ff9c0 con 0x55e4b2907880 2023-07-14T11:18:07.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.727+0000 7f19977fe700 1 -- 172.21.15.84:0/2137638726 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 45) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f19ac022b50 con 0x55e4b2907880 2023-07-14T11:18:07.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.727+0000 7f19d28b0b80 10 client.6864 fetch_fsmap finished waiting for FSMap version 45 2023-07-14T11:18:07.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.727+0000 7f19d28b0b80 10 client.6864 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-14T11:18:07.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.728+0000 7f19d28b0b80 20 client.6864 populate_metadata read hostname 'smithi084' 2023-07-14T11:18:07.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.728+0000 7f19d28b0b80 1 --2- 172.21.15.84:0/2137638726 >> [v2:172.21.15.84:6836/2405785300,v1:172.21.15.84:6837/2405785300] conn(0x55e4b294bd30 0x55e4b294c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:07.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.728+0000 7f19d28b0b80 4 client.6864 mds_command: new command op to 6690 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T11:18:07.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.728+0000 7f19d28b0b80 1 -- 172.21.15.84:0/2137638726 --> [v2:172.21.15.84:6836/2405785300,v1:172.21.15.84:6837/2405785300] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e4b28dc170 con 0x55e4b294bd30 2023-07-14T11:18:07.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.728+0000 7f19b7fff700 1 --2- 172.21.15.84:0/2137638726 >> [v2:172.21.15.84:6836/2405785300,v1:172.21.15.84:6837/2405785300] conn(0x55e4b294bd30 0x55e4b294c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:07.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.728+0000 7f19b7fff700 1 --2- 172.21.15.84:0/2137638726 >> [v2:172.21.15.84:6836/2405785300,v1:172.21.15.84:6837/2405785300] conn(0x55e4b294bd30 0x55e4b294c100 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b692b93e5b375008 server_cookie=e438e23e143adc28 in_seq=0 out_seq=0 2023-07-14T11:18:07.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.728+0000 7f19977fe700 10 client.6864 ms_handle_connect on v2:172.21.15.84:6836/2405785300 2023-07-14T11:18:07.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.729+0000 7f19977fe700 1 -- 172.21.15.84:0/2137638726 <== mds.0 v2:172.21.15.84:6836/2405785300 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55e4b28dc170 con 0x55e4b294bd30 2023-07-14T11:18:07.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.729+0000 7f19977fe700 10 client.6864 handle_command_reply: tid=0 2023-07-14T11:18:07.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.729+0000 7f19d28b0b80 1 client.6864 shutdown 2023-07-14T11:18:07.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.729+0000 7f19d28b0b80 1 -- 172.21.15.84:0/2137638726 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e4b2907880 msgr2=0x55e4b293a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:07.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.729+0000 7f19d28b0b80 1 --2- 172.21.15.84:0/2137638726 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e4b2907880 0x55e4b293a850 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f19ac0154c0 tx=0x7f19ac004750 comp rx=0 tx=0).stop 2023-07-14T11:18:07.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.729+0000 7f19d28b0b80 1 -- 172.21.15.84:0/2137638726 shutdown_connections 2023-07-14T11:18:07.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.729+0000 7f19d28b0b80 1 --2- 172.21.15.84:0/2137638726 >> [v2:172.21.15.84:6836/2405785300,v1:172.21.15.84:6837/2405785300] conn(0x55e4b294bd30 0x55e4b294c100 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:07.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.729+0000 7f19d28b0b80 1 --2- 172.21.15.84:0/2137638726 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e4b2909dc0 0x55e4b29081b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:07.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.729+0000 7f19977fe700 0 client.6864 ms_handle_reset on v2:172.21.15.84:6836/2405785300 2023-07-14T11:18:07.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.729+0000 7f19d28b0b80 1 --2- 172.21.15.84:0/2137638726 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e4b2907880 0x55e4b293a850 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:07.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.729+0000 7f19d28b0b80 1 --2- 172.21.15.84:0/2137638726 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e4b2907c50 0x55e4b2922f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:07.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.729+0000 7f19d28b0b80 1 -- 172.21.15.84:0/2137638726 >> 172.21.15.84:0/2137638726 conn(0x55e4b29023b0 msgr2=0x55e4b2952f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:07.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.730+0000 7f19d28b0b80 1 -- 172.21.15.84:0/2137638726 shutdown_connections 2023-07-14T11:18:07.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.730+0000 7f19d28b0b80 1 -- 172.21.15.84:0/2137638726 wait complete. 2023-07-14T11:18:07.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.730+0000 7f19d28b0b80 20 client.6864 trim_cache size 0 max 16384 2023-07-14T11:18:07.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.748+0000 7f19d28b0b80 1 Processor -- start 2023-07-14T11:18:07.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.748+0000 7f19d28b0b80 1 -- start start 2023-07-14T11:18:07.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.749+0000 7f19d28b0b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e4b29023b0 0x55e4b29339a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:07.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.749+0000 7f19d28b0b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e4b2907880 0x55e4b2933ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:07.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.749+0000 7f19d28b0b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e4b2907c50 0x55e4b2934420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:07.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.749+0000 7f19d28b0b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4b2652390 con 0x55e4b2907880 2023-07-14T11:18:07.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.749+0000 7f19d28b0b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4b2903de0 con 0x55e4b2907c50 2023-07-14T11:18:07.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.749+0000 7f19d28b0b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e4b29492d0 con 0x55e4b29023b0 2023-07-14T11:18:07.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.749+0000 7f19b7fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e4b2907880 0x55e4b2933ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:07.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.749+0000 7f19b7fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e4b2907880 0x55e4b2933ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36676/0 (socket says 172.21.15.84:36676) 2023-07-14T11:18:07.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.749+0000 7f19b7fff700 1 -- 172.21.15.84:0/3736099996 learned_addr learned my addr 172.21.15.84:0/3736099996 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:07.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.749+0000 7f19b7fff700 1 -- 172.21.15.84:0/3736099996 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e4b29023b0 msgr2=0x55e4b29339a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:07.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.749+0000 7f19b7fff700 1 --2- 172.21.15.84:0/3736099996 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e4b29023b0 0x55e4b29339a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:07.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.749+0000 7f19b7fff700 1 -- 172.21.15.84:0/3736099996 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e4b2907c50 msgr2=0x55e4b2934420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:07.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.749+0000 7f19b7fff700 1 --2- 172.21.15.84:0/3736099996 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e4b2907c50 0x55e4b2934420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:07.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.749+0000 7f19b7fff700 1 -- 172.21.15.84:0/3736099996 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e4b2823b10 con 0x55e4b2907880 2023-07-14T11:18:07.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.750+0000 7f19b7fff700 1 --2- 172.21.15.84:0/3736099996 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e4b2907880 0x55e4b2933ee0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f19a4015040 tx=0x7f19a4005000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7c71d5803954d23 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:07.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.750+0000 7f19a2ffd700 1 -- 172.21.15.84:0/3736099996 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a4023040 con 0x55e4b2907880 2023-07-14T11:18:07.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.750+0000 7f19a2ffd700 1 -- 172.21.15.84:0/3736099996 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19a40254c0 con 0x55e4b2907880 2023-07-14T11:18:07.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.750+0000 7f19a2ffd700 1 -- 172.21.15.84:0/3736099996 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a4025a10 con 0x55e4b2907880 2023-07-14T11:18:07.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.750+0000 7f19d28b0b80 1 -- 172.21.15.84:0/3736099996 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e4b2907880 msgr2=0x55e4b2933ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:07.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.750+0000 7f19d28b0b80 1 --2- 172.21.15.84:0/3736099996 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e4b2907880 0x55e4b2933ee0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f19a4015040 tx=0x7f19a4005000 comp rx=0 tx=0).stop 2023-07-14T11:18:07.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.750+0000 7f19d28b0b80 1 -- 172.21.15.84:0/3736099996 shutdown_connections 2023-07-14T11:18:07.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.750+0000 7f19d28b0b80 1 --2- 172.21.15.84:0/3736099996 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e4b29023b0 0x55e4b29339a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:07.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.750+0000 7f19d28b0b80 1 --2- 172.21.15.84:0/3736099996 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e4b2907c50 0x55e4b2934420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:07.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.750+0000 7f19d28b0b80 1 --2- 172.21.15.84:0/3736099996 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e4b2907880 0x55e4b2933ee0 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:07.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.750+0000 7f19d28b0b80 1 -- 172.21.15.84:0/3736099996 >> 172.21.15.84:0/3736099996 conn(0x55e4b293b830 msgr2=0x55e4b2952330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:07.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.750+0000 7f19d28b0b80 1 -- 172.21.15.84:0/3736099996 shutdown_connections 2023-07-14T11:18:07.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.750+0000 7f19d28b0b80 1 -- 172.21.15.84:0/3736099996 wait complete. 2023-07-14T11:18:07.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.751+0000 7f19d28b0b80 1 -- start start 2023-07-14T11:18:07.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.751+0000 7f19d28b0b80 1 Processor -- start 2023-07-14T11:18:07.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.753+0000 7f19d28b0b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e4b29023b0 0x55e4b2934190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:07.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.753+0000 7f19d28b0b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e4b2907880 0x55e4b2970860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:07.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.753+0000 7f19d28b0b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e4b2907c50 0x55e4b2906640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:07.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.753+0000 7f19d28b0b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4b2972860 con 0x55e4b2907c50 2023-07-14T11:18:07.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.753+0000 7f19d28b0b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4b2971140 con 0x55e4b29023b0 2023-07-14T11:18:07.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.753+0000 7f19d28b0b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e4b294a9b0 con 0x55e4b2907880 2023-07-14T11:18:07.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.753+0000 7f19d28b0b80 10 client.0 _ll_register_callbacks cb 0x7f19ac011cd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T11:18:07.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.753+0000 7f19bd59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e4b2907c50 0x55e4b2906640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:07.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.753+0000 7f19bd59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e4b2907c50 0x55e4b2906640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36682/0 (socket says 172.21.15.84:36682) 2023-07-14T11:18:07.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.753+0000 7f19bd59c700 1 -- 172.21.15.84:0/4120556864 learned_addr learned my addr 172.21.15.84:0/4120556864 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:07.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.753+0000 7f19bcd9b700 1 --2- 172.21.15.84:0/4120556864 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e4b29023b0 0x55e4b2934190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:07.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.754+0000 7f19b7fff700 1 --2- 172.21.15.84:0/4120556864 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e4b2907880 0x55e4b2970860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:07.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.754+0000 7f19bd59c700 1 -- 172.21.15.84:0/4120556864 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e4b2907880 msgr2=0x55e4b2970860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:07.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.754+0000 7f19bd59c700 1 --2- 172.21.15.84:0/4120556864 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e4b2907880 0x55e4b2970860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:07.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.754+0000 7f19bd59c700 1 -- 172.21.15.84:0/4120556864 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e4b29023b0 msgr2=0x55e4b2934190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:07.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.754+0000 7f19bd59c700 1 --2- 172.21.15.84:0/4120556864 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e4b29023b0 0x55e4b2934190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:07.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.754+0000 7f19bd59c700 1 -- 172.21.15.84:0/4120556864 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e4b2651790 con 0x55e4b2907c50 2023-07-14T11:18:07.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.754+0000 7f19bd59c700 1 --2- 172.21.15.84:0/4120556864 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e4b2907c50 0x55e4b2906640 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f19b000b730 tx=0x7f19b0009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a280b971d81d632f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:07.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.754+0000 7f19977fe700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-07-14T11:18:07.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.754+0000 7f19977fe700 1 -- 172.21.15.84:0/4120556864 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b005ab80 con 0x55e4b2907c50 2023-07-14T11:18:07.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.754+0000 7f19977fe700 1 -- 172.21.15.84:0/4120556864 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(75..75 src has 1..75) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f19b005ace0 con 0x55e4b2907c50 2023-07-14T11:18:07.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.754+0000 7f19d28b0b80 1 -- 172.21.15.84:0/4120556864 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f19a4005440 con 0x55e4b2907c50 2023-07-14T11:18:07.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.754+0000 7f19977fe700 1 -- 172.21.15.84:0/4120556864 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f19b005aea0 con 0x55e4b2907c50 2023-07-14T11:18:07.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.754+0000 7f19d28b0b80 10 client.6870 fetch_fsmap learned FSMap version 45 2023-07-14T11:18:07.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.754+0000 7f19d28b0b80 1 -- 172.21.15.84:0/4120556864 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=2+}) v3 -- 0x55e4b26b21d0 con 0x55e4b2907c50 2023-07-14T11:18:07.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.755+0000 7f19977fe700 1 -- 172.21.15.84:0/4120556864 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19a4005440 con 0x55e4b2907c50 2023-07-14T11:18:07.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.755+0000 7f19977fe700 1 -- 172.21.15.84:0/4120556864 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 45) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f19b0055580 con 0x55e4b2907c50 2023-07-14T11:18:07.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.755+0000 7f19d28b0b80 10 client.6870 fetch_fsmap finished waiting for FSMap version 45 2023-07-14T11:18:07.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.755+0000 7f19d28b0b80 10 client.6870 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-14T11:18:07.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.755+0000 7f19d28b0b80 20 client.6870 populate_metadata read hostname 'smithi084' 2023-07-14T11:18:07.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.755+0000 7f19d28b0b80 1 --2- 172.21.15.84:0/4120556864 >> [v2:172.21.15.84:6836/2405785300,v1:172.21.15.84:6837/2405785300] conn(0x55e4b2909dc0 0x55e4b2906b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:07.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.755+0000 7f19d28b0b80 4 client.6870 mds_command: new command op to 6690 tid=0[{"prefix": "status"}] 2023-07-14T11:18:07.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.755+0000 7f19d28b0b80 1 -- 172.21.15.84:0/4120556864 --> [v2:172.21.15.84:6836/2405785300,v1:172.21.15.84:6837/2405785300] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e4b2856d20 con 0x55e4b2909dc0 2023-07-14T11:18:07.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.755+0000 7f19bcd9b700 1 --2- 172.21.15.84:0/4120556864 >> [v2:172.21.15.84:6836/2405785300,v1:172.21.15.84:6837/2405785300] conn(0x55e4b2909dc0 0x55e4b2906b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:07.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.755+0000 7f19977fe700 10 client.6870 ms_handle_connect on v2:172.21.15.84:6836/2405785300 2023-07-14T11:18:07.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.755+0000 7f19bcd9b700 1 --2- 172.21.15.84:0/4120556864 >> [v2:172.21.15.84:6836/2405785300,v1:172.21.15.84:6837/2405785300] conn(0x55e4b2909dc0 0x55e4b2906b80 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=434493ba896c6f02 server_cookie=52383f328c9c42a in_seq=0 out_seq=0 2023-07-14T11:18:07.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.756+0000 7f19977fe700 1 -- 172.21.15.84:0/4120556864 <== mds.0 v2:172.21.15.84:6836/2405785300 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55e4b2856d20 con 0x55e4b2909dc0 2023-07-14T11:18:07.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.756+0000 7f19977fe700 10 client.6870 handle_command_reply: tid=0 2023-07-14T11:18:07.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.756+0000 7f19d28b0b80 1 client.6870 shutdown 2023-07-14T11:18:07.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.756+0000 7f19d28b0b80 1 -- 172.21.15.84:0/4120556864 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e4b2907c50 msgr2=0x55e4b2906640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:07.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.756+0000 7f19d28b0b80 1 --2- 172.21.15.84:0/4120556864 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e4b2907c50 0x55e4b2906640 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f19b000b730 tx=0x7f19b0009880 comp rx=0 tx=0).stop 2023-07-14T11:18:07.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.756+0000 7f19d28b0b80 1 -- 172.21.15.84:0/4120556864 shutdown_connections 2023-07-14T11:18:07.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.756+0000 7f19d28b0b80 1 --2- 172.21.15.84:0/4120556864 >> [v2:172.21.15.84:6836/2405785300,v1:172.21.15.84:6837/2405785300] conn(0x55e4b2909dc0 0x55e4b2906b80 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:07.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.756+0000 7f19d28b0b80 1 --2- 172.21.15.84:0/4120556864 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e4b2907c50 0x55e4b2906640 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:07.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.756+0000 7f19d28b0b80 1 --2- 172.21.15.84:0/4120556864 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e4b29023b0 0x55e4b2934190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:07.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.756+0000 7f19d28b0b80 1 --2- 172.21.15.84:0/4120556864 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e4b2907880 0x55e4b2970860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:07.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.756+0000 7f19977fe700 0 client.6870 ms_handle_reset on v2:172.21.15.84:6836/2405785300 2023-07-14T11:18:07.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.756+0000 7f19d28b0b80 1 -- 172.21.15.84:0/4120556864 >> 172.21.15.84:0/4120556864 conn(0x55e4b293b830 msgr2=0x55e4b29339a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:07.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.756+0000 7f19d28b0b80 1 -- 172.21.15.84:0/4120556864 shutdown_connections 2023-07-14T11:18:07.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.756+0000 7f19d28b0b80 1 -- 172.21.15.84:0/4120556864 wait complete. 2023-07-14T11:18:07.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.756+0000 7f19d28b0b80 20 client.6870 trim_cache size 0 max 16384 2023-07-14T11:18:07.766 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-07-14T11:18:07.766 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f", 2023-07-14T11:18:07.766 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 0, 2023-07-14T11:18:07.766 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 6690, 2023-07-14T11:18:07.766 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2023-07-14T11:18:07.766 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2023-07-14T11:18:07.767 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2023-07-14T11:18:07.767 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 11.491598016999999, 2023-07-14T11:18:07.767 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 45, 2023-07-14T11:18:07.767 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 75, 2023-07-14T11:18:07.767 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 75, 2023-07-14T11:18:07.767 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 18.997821390999999 2023-07-14T11:18:07.767 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-07-14T11:18:07.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.757+0000 7f19befff700 1 -- 172.21.15.84:0/3135402563 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f199c06b040 msgr2=0x7f199c06d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:07.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.757+0000 7f19befff700 1 --2- 172.21.15.84:0/3135402563 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f199c06b040 0x7f199c06d4f0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f19b81531a0 tx=0x7f19ac008040 comp rx=0 tx=0).stop 2023-07-14T11:18:07.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.757+0000 7f19befff700 1 -- 172.21.15.84:0/3135402563 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19b80d1220 msgr2=0x7f19b80ca010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:07.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.757+0000 7f19befff700 1 --2- 172.21.15.84:0/3135402563 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19b80d1220 0x7f19b80ca010 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f19b0015000 tx=0x7f19b0004ad0 comp rx=0 tx=0).stop 2023-07-14T11:18:07.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.757+0000 7f19befff700 1 -- 172.21.15.84:0/3135402563 shutdown_connections 2023-07-14T11:18:07.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.757+0000 7f19befff700 1 --2- 172.21.15.84:0/3135402563 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f199c06b040 0x7f199c06d4f0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:07.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.757+0000 7f19befff700 1 --2- 172.21.15.84:0/3135402563 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19b80b4530 0x7f19b80cbda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:07.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.757+0000 7f19befff700 1 --2- 172.21.15.84:0/3135402563 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19b80d1220 0x7f19b80ca010 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:07.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.757+0000 7f19befff700 1 --2- 172.21.15.84:0/3135402563 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19b80b8a60 0x7f19b81f5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:07.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.757+0000 7f19befff700 1 -- 172.21.15.84:0/3135402563 >> 172.21.15.84:0/3135402563 conn(0x7f19b809c1b0 msgr2=0x7f19b806ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:07.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.757+0000 7f19befff700 1 -- 172.21.15.84:0/3135402563 shutdown_connections 2023-07-14T11:18:07.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.757+0000 7f19befff700 1 -- 172.21.15.84:0/3135402563 wait complete. 2023-07-14T11:18:07.776 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-14T11:18:07.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.969+0000 7fe8ef9ff700 1 Processor -- start 2023-07-14T11:18:07.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.969+0000 7fe8ef9ff700 1 -- start start 2023-07-14T11:18:07.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.970+0000 7fe8ef9ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe8e815e890 0x7fe8e80cee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:07.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.970+0000 7fe8ef9ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8e815b430 con 0x7fe8e80b3780 2023-07-14T11:18:07.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.970+0000 7fe8ef9ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8e80ce110 con 0x7fe8e815afd0 2023-07-14T11:18:07.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.970+0000 7fe8ef9ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8e80cf380 con 0x7fe8e815e890 2023-07-14T11:18:07.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.971+0000 7fe8ecf9a700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fe8e80b3780 0x7fe8e815a8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:59548/0 (socket says 172.21.15.84:59548) 2023-07-14T11:18:07.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.971+0000 7fe8ecf9a700 1 -- 172.21.15.84:0/3913556418 learned_addr learned my addr 172.21.15.84:0/3913556418 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:18:07.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.971+0000 7fe8ed79b700 1 --2- 172.21.15.84:0/3913556418 >> v2:172.21.15.84:3300/0 conn(0x7fe8e815e890 0x7fe8e80cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:07.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.971+0000 7fe8dffff700 1 -- 172.21.15.84:0/3913556418 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3269278346 0 0) 0x7fe8e815b430 con 0x7fe8e80b3780 2023-07-14T11:18:07.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.971+0000 7fe8dffff700 1 -- 172.21.15.84:0/3913556418 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8d40035b0 con 0x7fe8e80b3780 2023-07-14T11:18:07.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.971+0000 7fe8ed79b700 1 -- 172.21.15.84:0/3913556418 >> v1:172.21.15.179:6789/0 conn(0x7fe8e815afd0 legacy=0x7fe8e8150c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:07.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.971+0000 7fe8ed79b700 1 -- 172.21.15.84:0/3913556418 >> v1:172.21.15.84:6789/0 conn(0x7fe8e80b3780 legacy=0x7fe8e815a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:07.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.971+0000 7fe8ed79b700 1 -- 172.21.15.84:0/3913556418 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e815b660 con 0x7fe8e815e890 2023-07-14T11:18:07.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.972+0000 7fe8ed79b700 1 --2- 172.21.15.84:0/3913556418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8e815e890 0x7fe8e80cee40 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fe8e4009840 tx=0x7fe8e4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ff52f40940f02c2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:07.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.972+0000 7fe8dffff700 1 -- 172.21.15.84:0/3913556418 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e4011830 con 0x7fe8e815e890 2023-07-14T11:18:07.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.972+0000 7fe8dffff700 1 -- 172.21.15.84:0/3913556418 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8e4011990 con 0x7fe8e815e890 2023-07-14T11:18:07.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.972+0000 7fe8dffff700 1 -- 172.21.15.84:0/3913556418 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e4011d20 con 0x7fe8e815e890 2023-07-14T11:18:07.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.972+0000 7fe8ef9ff700 1 -- 172.21.15.84:0/3913556418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8e815e890 msgr2=0x7fe8e80cee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:07.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.972+0000 7fe8ef9ff700 1 --2- 172.21.15.84:0/3913556418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8e815e890 0x7fe8e80cee40 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fe8e4009840 tx=0x7fe8e4009b50 comp rx=0 tx=0).stop 2023-07-14T11:18:07.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.972+0000 7fe8ef9ff700 1 -- 172.21.15.84:0/3913556418 shutdown_connections 2023-07-14T11:18:07.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.972+0000 7fe8ef9ff700 1 --2- 172.21.15.84:0/3913556418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8e815e890 0x7fe8e80cee40 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:07.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.972+0000 7fe8ef9ff700 1 -- 172.21.15.84:0/3913556418 >> 172.21.15.84:0/3913556418 conn(0x7fe8e8069f30 msgr2=0x7fe8e806a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:07.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.972+0000 7fe8ef9ff700 1 -- 172.21.15.84:0/3913556418 shutdown_connections 2023-07-14T11:18:07.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.973+0000 7fe8ef9ff700 1 -- 172.21.15.84:0/3913556418 wait complete. 2023-07-14T11:18:07.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.974+0000 7fe8ef9ff700 1 Processor -- start 2023-07-14T11:18:07.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.974+0000 7fe8ef9ff700 1 -- start start 2023-07-14T11:18:07.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.975+0000 7fe8ef9ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8e80b3780 0x7fe8e8145290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:07.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.975+0000 7fe8ef9ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8e815afd0 0x7fe8e80c5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:07.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.975+0000 7fe8ef9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8e815e890 0x7fe8e81f4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:07.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.975+0000 7fe8ef9ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e81f4460 con 0x7fe8e80b3780 2023-07-14T11:18:07.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.975+0000 7fe8ef9ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e81f37e0 con 0x7fe8e815afd0 2023-07-14T11:18:07.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.975+0000 7fe8ef9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e81f3ac0 con 0x7fe8e815e890 2023-07-14T11:18:07.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.975+0000 7fe8ed79b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8e80b3780 0x7fe8e8145290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:07.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.975+0000 7fe8ed79b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8e80b3780 0x7fe8e8145290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36710/0 (socket says 172.21.15.84:36710) 2023-07-14T11:18:07.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.975+0000 7fe8ed79b700 1 -- 172.21.15.84:0/1755031659 learned_addr learned my addr 172.21.15.84:0/1755031659 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:07.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.976+0000 7fe8ecf9a700 1 --2- 172.21.15.84:0/1755031659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8e815afd0 0x7fe8e80c5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:07.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.976+0000 7fe8edf9c700 1 --2- 172.21.15.84:0/1755031659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8e815e890 0x7fe8e81f4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:07.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.976+0000 7fe8ed79b700 1 -- 172.21.15.84:0/1755031659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8e815e890 msgr2=0x7fe8e81f4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:07.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.976+0000 7fe8ed79b700 1 --2- 172.21.15.84:0/1755031659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8e815e890 0x7fe8e81f4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:07.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.976+0000 7fe8ed79b700 1 -- 172.21.15.84:0/1755031659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8e815afd0 msgr2=0x7fe8e80c5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:07.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.976+0000 7fe8ed79b700 1 --2- 172.21.15.84:0/1755031659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8e815afd0 0x7fe8e80c5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:07.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.976+0000 7fe8ed79b700 1 -- 172.21.15.84:0/1755031659 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e40094a0 con 0x7fe8e80b3780 2023-07-14T11:18:07.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.976+0000 7fe8ed79b700 1 --2- 172.21.15.84:0/1755031659 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8e80b3780 0x7fe8e8145290 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fe8e4009fd0 tx=0x7fe8e4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:07.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.976+0000 7fe8ddffb700 1 -- 172.21.15.84:0/1755031659 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e40038a0 con 0x7fe8e80b3780 2023-07-14T11:18:07.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.976+0000 7fe8ddffb700 1 -- 172.21.15.84:0/1755031659 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8e401f070 con 0x7fe8e80b3780 2023-07-14T11:18:07.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.976+0000 7fe8ddffb700 1 -- 172.21.15.84:0/1755031659 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e4003c40 con 0x7fe8e80b3780 2023-07-14T11:18:07.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.976+0000 7fe8ef9ff700 1 -- 172.21.15.84:0/1755031659 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8e81f3da0 con 0x7fe8e80b3780 2023-07-14T11:18:07.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.976+0000 7fe8ef9ff700 1 -- 172.21.15.84:0/1755031659 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8e81457d0 con 0x7fe8e80b3780 2023-07-14T11:18:07.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.977+0000 7fe8ef9ff700 1 -- 172.21.15.84:0/1755031659 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8e81f45a0 con 0x7fe8e80b3780 2023-07-14T11:18:07.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.978+0000 7fe8ddffb700 1 -- 172.21.15.84:0/1755031659 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7fe8e4026480 con 0x7fe8e80b3780 2023-07-14T11:18:07.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.979+0000 7fe8ddffb700 1 --2- 172.21.15.84:0/1755031659 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe8cc06b040 0x7fe8cc06d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:07.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.979+0000 7fe8ddffb700 1 -- 172.21.15.84:0/1755031659 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe8e4021070 con 0x7fe8e80b3780 2023-07-14T11:18:07.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.980+0000 7fe8ecf9a700 1 --2- 172.21.15.84:0/1755031659 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe8cc06b040 0x7fe8cc06d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:07.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.980+0000 7fe8ecf9a700 1 --2- 172.21.15.84:0/1755031659 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe8cc06b040 0x7fe8cc06d4f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fe8e81e5af0 tx=0x7fe8d8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:07.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:07.984+0000 7fe8ddffb700 1 -- 172.21.15.84:0/1755031659 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe8e81f45a0 con 0x7fe8e80b3780 2023-07-14T11:18:08.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:08.223+0000 7fe8ef9ff700 1 -- 172.21.15.84:0/1755031659 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe8e81f45a0 con 0x7fe8e80b3780 2023-07-14T11:18:08.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:08.224+0000 7fe8ddffb700 1 -- 172.21.15.84:0/1755031659 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v45) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe8e405de60 con 0x7fe8e80b3780 2023-07-14T11:18:08.226 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-14T11:18:08.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:08.226+0000 7fe8ef9ff700 1 -- 172.21.15.84:0/1755031659 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe8cc06b040 msgr2=0x7fe8cc06d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:08.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:08.226+0000 7fe8ef9ff700 1 --2- 172.21.15.84:0/1755031659 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe8cc06b040 0x7fe8cc06d4f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fe8e81e5af0 tx=0x7fe8d8009040 comp rx=0 tx=0).stop 2023-07-14T11:18:08.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:08.226+0000 7fe8ef9ff700 1 -- 172.21.15.84:0/1755031659 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8e80b3780 msgr2=0x7fe8e8145290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:08.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:08.226+0000 7fe8ef9ff700 1 --2- 172.21.15.84:0/1755031659 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8e80b3780 0x7fe8e8145290 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fe8e4009fd0 tx=0x7fe8e4004750 comp rx=0 tx=0).stop 2023-07-14T11:18:08.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:08.226+0000 7fe8ef9ff700 1 -- 172.21.15.84:0/1755031659 shutdown_connections 2023-07-14T11:18:08.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:08.226+0000 7fe8ef9ff700 1 --2- 172.21.15.84:0/1755031659 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fe8cc06b040 0x7fe8cc06d4f0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:08.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:08.226+0000 7fe8ef9ff700 1 --2- 172.21.15.84:0/1755031659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8e815e890 0x7fe8e81f4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:08.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:08.226+0000 7fe8ef9ff700 1 --2- 172.21.15.84:0/1755031659 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8e80b3780 0x7fe8e8145290 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:08.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:08.226+0000 7fe8ef9ff700 1 --2- 172.21.15.84:0/1755031659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8e815afd0 0x7fe8e80c5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:08.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:08.226+0000 7fe8ef9ff700 1 -- 172.21.15.84:0/1755031659 >> 172.21.15.84:0/1755031659 conn(0x7fe8e8069f30 msgr2=0x7fe8e806b920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:08.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:08.226+0000 7fe8ef9ff700 1 -- 172.21.15.84:0/1755031659 shutdown_connections 2023-07-14T11:18:08.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:08.226+0000 7fe8ef9ff700 1 -- 172.21.15.84:0/1755031659 wait complete. 2023-07-14T11:18:08.246 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-14T11:18:08.247 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-14T11:18:08.247 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi084.front.sepia.ceph.com 2023-07-14T11:18:08.247 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-14T11:18:08.247 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-14T11:18:08.248 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-14T11:18:08.248 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-14T11:18:08.248 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-14T11:18:08.248 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-14T11:18:08.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:18:08.249 DEBUG:teuthology.orchestra.run.smithi084:> ip addr 2023-07-14T11:18:08.295 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-14T11:18:08.296 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-14T11:18:08.296 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2023-07-14T11:18:08.296 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:18:08.296 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2023-07-14T11:18:08.296 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:18:08.296 INFO:teuthology.orchestra.run.smithi084.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T11:18:08.297 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:68 brd ff:ff:ff:ff:ff:ff 2023-07-14T11:18:08.297 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f0 2023-07-14T11:18:08.297 INFO:teuthology.orchestra.run.smithi084.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T11:18:08.297 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:69 brd ff:ff:ff:ff:ff:ff 2023-07-14T11:18:08.297 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f1 2023-07-14T11:18:08.297 INFO:teuthology.orchestra.run.smithi084.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T11:18:08.297 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:50 brd ff:ff:ff:ff:ff:ff 2023-07-14T11:18:08.298 INFO:teuthology.orchestra.run.smithi084.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-14T11:18:08.298 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:51 brd ff:ff:ff:ff:ff:ff 2023-07-14T11:18:08.298 INFO:teuthology.orchestra.run.smithi084.stdout: inet 172.21.15.84/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-14T11:18:08.298 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft 41679sec preferred_lft 41679sec 2023-07-14T11:18:08.298 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::ec4:7aff:fe8f:d751/64 scope link 2023-07-14T11:18:08.298 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:18:08.298 INFO:teuthology.orchestra.run.smithi084.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-14T11:18:08.298 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 2e:15:90:61:8f:22 brd ff:ff:ff:ff:ff:ff 2023-07-14T11:18:08.299 INFO:teuthology.orchestra.run.smithi084.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-14T11:18:08.299 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:18:08.299 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::dc90:1eff:feca:b2b4/64 scope link 2023-07-14T11:18:08.299 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:18:08.299 INFO:teuthology.orchestra.run.smithi084.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-14T11:18:08.299 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 2e:15:90:61:8f:22 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-14T11:18:08.299 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::2c15:90ff:fe61:8f22/64 scope link 2023-07-14T11:18:08.300 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:18:08.300 INFO:teuthology.orchestra.run.smithi084.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-14T11:18:08.300 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 5e:77:8b:e6:63:60 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-14T11:18:08.300 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::5c77:8bff:fee6:6360/64 scope link 2023-07-14T11:18:08.300 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:18:08.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:18:08.301 DEBUG:teuthology.orchestra.run.smithi084:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-14T11:18:08.407 INFO:teuthology.orchestra.run.smithi084.stdout:1 2023-07-14T11:18:08.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:18:08.411 DEBUG:teuthology.orchestra.run.smithi084:> route 2023-07-14T11:18:08.460 INFO:teuthology.orchestra.run.smithi084.stdout:Kernel IP routing table 2023-07-14T11:18:08.460 INFO:teuthology.orchestra.run.smithi084.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-14T11:18:08.460 INFO:teuthology.orchestra.run.smithi084.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-14T11:18:08.460 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-14T11:18:08.461 INFO:teuthology.orchestra.run.smithi084.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-14T11:18:08.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:18:08.462 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-07-14T11:18:08.462 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-07-14T11:18:08.462 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-14T11:18:08.463 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-14T11:18:08.463 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-14T11:18:08.463 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-07-14T11:18:08.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:18:08.632 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2023-07-14T11:18:08.678 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-14T11:18:08.678 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-14T11:18:08.679 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-14T11:18:08.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:18:08.680 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set brx.0 up 2023-07-14T11:18:08.750 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T11:18:08.751 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-14T11:18:08.796 INFO:teuthology.orchestra.run.smithi084.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-14T11:18:08.797 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T11:18:08.797 DEBUG:teuthology.orchestra.run.smithi084:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-14T11:18:08.842 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-07-14T11:18:08.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:18:08.843 DEBUG:teuthology.orchestra.run.smithi084:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-14T11:18:08.987 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-14T11:18:08.987 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-14T11:18:09.013 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-14T11:18:09.014 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-14T11:18:09.014 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-07-14T11:18:09.014 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: trying mount with new device syntax: 0@3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f.cephfs=/ 2023-07-14T11:18:09.014 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.84:3300/172.21.15.179:3300/172.21.15.179:3301" will pass to kernel 2023-07-14T11:18:09.019 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-14T11:18:09.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:18:09.020 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-14T11:18:09.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:18:09.090 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-14T11:18:09.193 INFO:teuthology.orchestra.run.smithi084.stdout:client6882 2023-07-14T11:18:09.193 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-14T11:18:09.193 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:18:09.239 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-14T11:18:09.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:09.473+0000 7fb4cfbff700 1 Processor -- start 2023-07-14T11:18:09.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:09.473+0000 7fb4cfbff700 1 -- start start 2023-07-14T11:18:09.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:09.474+0000 7fb4cfbff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb4c80b4510 0x7fb4c80b6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:09.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:09.474+0000 7fb4cfbff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4c80b5d90 0x7fb4c80cd590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:09.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:09.474+0000 7fb4cfbff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4c80b7f50 con 0x7fb4c80d0b10 2023-07-14T11:18:09.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:09.474+0000 7fb4cfbff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4c80b48e0 con 0x7fb4c80b4510 2023-07-14T11:18:09.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:09.474+0000 7fb4cfbff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c80b7340 con 0x7fb4c80b5d90 2023-07-14T11:18:09.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:09.474+0000 7fb4cd99b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb4c80b4510 0x7fb4c80b6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:09.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:09.475+0000 7fb4cd99b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb4c80b4510 0x7fb4c80b6c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37714/0 (socket says 172.21.15.84:37714) 2023-07-14T11:18:09.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:09.475+0000 7fb4cd99b700 1 -- 172.21.15.84:0/1292094782 learned_addr learned my addr 172.21.15.84:0/1292094782 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:09.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:09.475+0000 7fb4cd19a700 1 --2- 172.21.15.84:0/1292094782 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4c80b5d90 0x7fb4c80cd590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:09.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:09.475+0000 7fb4cd99b700 1 -- 172.21.15.84:0/1292094782 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4c80b5d90 msgr2=0x7fb4c80cd590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:09.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:09.475+0000 7fb4cd99b700 1 --2- 172.21.15.84:0/1292094782 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4c80b5d90 0x7fb4c80cd590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:09.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:09.475+0000 7fb4cd99b700 1 -- 172.21.15.84:0/1292094782 >> v1:172.21.15.84:6789/0 conn(0x7fb4c80d0b10 legacy=0x7fb4c80b83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:09.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:09.475+0000 7fb4cd99b700 1 -- 172.21.15.84:0/1292094782 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4c80b7620 con 0x7fb4c80b4510 2023-07-14T11:18:09.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:09.475+0000 7fb4cd19a700 1 --2- 172.21.15.84:0/1292094782 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4c80b5d90 0x7fb4c80cd590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:18:09.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:09.475+0000 7fb4cd99b700 1 --2- 172.21.15.84:0/1292094782 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4c80b4510 0x7fb4c80b6c80 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fb4c4006fd0 tx=0x7fb4c4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=826792ddb21a1dd5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:09.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:09.475+0000 7fb4cc999700 1 -- 172.21.15.84:0/1292094782 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c4005e30 con 0x7fb4c80b4510 2023-07-14T11:18:09.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:09.475+0000 7fb4cc999700 1 -- 172.21.15.84:0/1292094782 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4c4004030 con 0x7fb4c80b4510 2023-07-14T11:18:09.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:09.475+0000 7fb4cc999700 1 -- 172.21.15.84:0/1292094782 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c40043e0 con 0x7fb4c80b4510 2023-07-14T11:18:09.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:09.476+0000 7fb4cfbff700 1 -- 172.21.15.84:0/1292094782 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4c80b4510 msgr2=0x7fb4c80b6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:09.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:09.476+0000 7fb4cfbff700 1 --2- 172.21.15.84:0/1292094782 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4c80b4510 0x7fb4c80b6c80 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fb4c4006fd0 tx=0x7fb4c4009bd0 comp rx=0 tx=0).stop 2023-07-14T11:18:09.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:09.476+0000 7fb4cfbff700 1 -- 172.21.15.84:0/1292094782 shutdown_connections 2023-07-14T11:18:09.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:09.476+0000 7fb4cfbff700 1 --2- 172.21.15.84:0/1292094782 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4c80b4510 0x7fb4c80b6c80 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:09.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:09.476+0000 7fb4cfbff700 1 --2- 172.21.15.84:0/1292094782 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4c80b5d90 0x7fb4c80cd590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:09.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:09.476+0000 7fb4cfbff700 1 -- 172.21.15.84:0/1292094782 >> 172.21.15.84:0/1292094782 conn(0x7fb4c809c1d0 msgr2=0x7fb4c80d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:09.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:09.476+0000 7fb4cfbff700 1 -- 172.21.15.84:0/1292094782 shutdown_connections 2023-07-14T11:18:09.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:09.476+0000 7fb4cfbff700 1 -- 172.21.15.84:0/1292094782 wait complete. 2023-07-14T11:18:09.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:09.478+0000 7fb4cfbff700 1 Processor -- start 2023-07-14T11:18:09.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:09.478+0000 7fb4cfbff700 1 -- start start 2023-07-14T11:18:09.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:09.479+0000 7fb4cfbff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4c80b4510 0x7fb4c81587b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:09.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:09.479+0000 7fb4cfbff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb4c80b5d90 0x7fb4c81547a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:09.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:09.479+0000 7fb4cfbff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4c80d0b10 0x7fb4c809fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:09.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:09.479+0000 7fb4cfbff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c8158cf0 con 0x7fb4c80d0b10 2023-07-14T11:18:09.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:09.479+0000 7fb4cfbff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c8154ce0 con 0x7fb4c80b5d90 2023-07-14T11:18:09.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:09.479+0000 7fb4cfbff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c8157d60 con 0x7fb4c80b4510 2023-07-14T11:18:09.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:09.479+0000 7fb4ce19c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4c80d0b10 0x7fb4c809fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:09.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:09.479+0000 7fb4ce19c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4c80d0b10 0x7fb4c809fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37726/0 (socket says 172.21.15.84:37726) 2023-07-14T11:18:09.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:09.479+0000 7fb4ce19c700 1 -- 172.21.15.84:0/652890647 learned_addr learned my addr 172.21.15.84:0/652890647 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:09.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:09.479+0000 7fb4cd99b700 1 --2- 172.21.15.84:0/652890647 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4c80b4510 0x7fb4c81587b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:09.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:09.479+0000 7fb4cd19a700 1 --2- 172.21.15.84:0/652890647 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb4c80b5d90 0x7fb4c81547a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:09.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:09.479+0000 7fb4ce19c700 1 -- 172.21.15.84:0/652890647 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4c80b4510 msgr2=0x7fb4c81587b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:09.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:09.479+0000 7fb4ce19c700 1 --2- 172.21.15.84:0/652890647 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4c80b4510 0x7fb4c81587b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:09.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:09.479+0000 7fb4ce19c700 1 -- 172.21.15.84:0/652890647 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb4c80b5d90 msgr2=0x7fb4c81547a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:09.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:09.479+0000 7fb4ce19c700 1 --2- 172.21.15.84:0/652890647 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb4c80b5d90 0x7fb4c81547a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:09.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:09.479+0000 7fb4ce19c700 1 -- 172.21.15.84:0/652890647 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4c4009500 con 0x7fb4c80d0b10 2023-07-14T11:18:09.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:09.480+0000 7fb4ce19c700 1 --2- 172.21.15.84:0/652890647 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4c80d0b10 0x7fb4c809fb60 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fb4c000cc50 tx=0x7fb4c000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:09.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:09.480+0000 7fb4be7fc700 1 -- 172.21.15.84:0/652890647 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c0003c00 con 0x7fb4c80d0b10 2023-07-14T11:18:09.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:09.480+0000 7fb4be7fc700 1 -- 172.21.15.84:0/652890647 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4c0003d60 con 0x7fb4c80d0b10 2023-07-14T11:18:09.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:09.480+0000 7fb4be7fc700 1 -- 172.21.15.84:0/652890647 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c000abb0 con 0x7fb4c80d0b10 2023-07-14T11:18:09.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:09.480+0000 7fb4cfbff700 1 -- 172.21.15.84:0/652890647 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4c8158320 con 0x7fb4c80d0b10 2023-07-14T11:18:09.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:09.480+0000 7fb4cfbff700 1 -- 172.21.15.84:0/652890647 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4c809ee00 con 0x7fb4c80d0b10 2023-07-14T11:18:09.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:09.481+0000 7fb4cfbff700 1 -- 172.21.15.84:0/652890647 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4c81584b0 con 0x7fb4c80d0b10 2023-07-14T11:18:09.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:09.482+0000 7fb4be7fc700 1 -- 172.21.15.84:0/652890647 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7fb4c000ad10 con 0x7fb4c80d0b10 2023-07-14T11:18:09.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:09.483+0000 7fb4be7fc700 1 --2- 172.21.15.84:0/652890647 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fb4ac06b040 0x7fb4ac06d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:09.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:09.483+0000 7fb4be7fc700 1 -- 172.21.15.84:0/652890647 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb4c0089c20 con 0x7fb4c80d0b10 2023-07-14T11:18:09.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:09.484+0000 7fb4cd99b700 1 --2- 172.21.15.84:0/652890647 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fb4ac06b040 0x7fb4ac06d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:09.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:09.484+0000 7fb4cd99b700 1 --2- 172.21.15.84:0/652890647 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fb4ac06b040 0x7fb4ac06d4f0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fb4c4000c00 tx=0x7fb4c4008070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:09.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:09.488+0000 7fb4be7fc700 1 -- 172.21.15.84:0/652890647 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fb4c0054780 con 0x7fb4c80d0b10 2023-07-14T11:18:09.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:09.723+0000 7fb4cfbff700 1 -- 172.21.15.84:0/652890647 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb4c804e280 con 0x7fb4c80d0b10 2023-07-14T11:18:09.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:09.723+0000 7fb4be7fc700 1 -- 172.21.15.84:0/652890647 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v45) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb4c0057da0 con 0x7fb4c80d0b10 2023-07-14T11:18:09.726 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-14T11:18:09.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:09.726+0000 7fb4cfbff700 1 -- 172.21.15.84:0/652890647 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fb4ac06b040 msgr2=0x7fb4ac06d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:09.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:09.726+0000 7fb4cfbff700 1 --2- 172.21.15.84:0/652890647 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fb4ac06b040 0x7fb4ac06d4f0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fb4c4000c00 tx=0x7fb4c4008070 comp rx=0 tx=0).stop 2023-07-14T11:18:09.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:09.726+0000 7fb4cfbff700 1 -- 172.21.15.84:0/652890647 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4c80d0b10 msgr2=0x7fb4c809fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:09.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:09.726+0000 7fb4cfbff700 1 --2- 172.21.15.84:0/652890647 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4c80d0b10 0x7fb4c809fb60 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fb4c000cc50 tx=0x7fb4c000a340 comp rx=0 tx=0).stop 2023-07-14T11:18:09.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:09.726+0000 7fb4cfbff700 1 -- 172.21.15.84:0/652890647 shutdown_connections 2023-07-14T11:18:09.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:09.726+0000 7fb4cfbff700 1 --2- 172.21.15.84:0/652890647 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fb4ac06b040 0x7fb4ac06d4f0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:09.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:09.726+0000 7fb4cfbff700 1 --2- 172.21.15.84:0/652890647 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4c80b4510 0x7fb4c81587b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:09.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:09.726+0000 7fb4cfbff700 1 --2- 172.21.15.84:0/652890647 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4c80d0b10 0x7fb4c809fb60 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:09.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:09.726+0000 7fb4cfbff700 1 --2- 172.21.15.84:0/652890647 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb4c80b5d90 0x7fb4c81547a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:09.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:09.726+0000 7fb4cfbff700 1 -- 172.21.15.84:0/652890647 >> 172.21.15.84:0/652890647 conn(0x7fb4c809c1d0 msgr2=0x7fb4c80b6270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:09.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:09.726+0000 7fb4cfbff700 1 -- 172.21.15.84:0/652890647 shutdown_connections 2023-07-14T11:18:09.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:09.726+0000 7fb4cfbff700 1 -- 172.21.15.84:0/652890647 wait complete. 2023-07-14T11:18:09.746 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-14T11:18:09.746 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-14T11:18:09.747 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi179.front.sepia.ceph.com 2023-07-14T11:18:09.747 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-07-14T11:18:09.747 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-14T11:18:09.747 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-14T11:18:09.748 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-14T11:18:09.748 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-14T11:18:09.748 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-14T11:18:09.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:18:09.749 DEBUG:teuthology.orchestra.run.smithi179:> ip addr 2023-07-14T11:18:09.800 INFO:teuthology.orchestra.run.smithi179.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-14T11:18:09.801 INFO:teuthology.orchestra.run.smithi179.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-14T11:18:09.801 INFO:teuthology.orchestra.run.smithi179.stdout: inet 127.0.0.1/8 scope host lo 2023-07-14T11:18:09.801 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:18:09.801 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 ::1/128 scope host 2023-07-14T11:18:09.801 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:18:09.801 INFO:teuthology.orchestra.run.smithi179.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T11:18:09.801 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:34 brd ff:ff:ff:ff:ff:ff 2023-07-14T11:18:09.802 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f0 2023-07-14T11:18:09.802 INFO:teuthology.orchestra.run.smithi179.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T11:18:09.802 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:35 brd ff:ff:ff:ff:ff:ff 2023-07-14T11:18:09.802 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f1 2023-07-14T11:18:09.802 INFO:teuthology.orchestra.run.smithi179.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T11:18:09.802 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5a brd ff:ff:ff:ff:ff:ff 2023-07-14T11:18:09.802 INFO:teuthology.orchestra.run.smithi179.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-14T11:18:09.803 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5b brd ff:ff:ff:ff:ff:ff 2023-07-14T11:18:09.803 INFO:teuthology.orchestra.run.smithi179.stdout: inet 172.21.15.179/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-14T11:18:09.803 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft 41566sec preferred_lft 41566sec 2023-07-14T11:18:09.803 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::ec4:7aff:fe88:725b/64 scope link 2023-07-14T11:18:09.803 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:18:09.803 INFO:teuthology.orchestra.run.smithi179.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-14T11:18:09.803 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 46:75:18:db:4e:84 brd ff:ff:ff:ff:ff:ff 2023-07-14T11:18:09.803 INFO:teuthology.orchestra.run.smithi179.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-14T11:18:09.804 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:18:09.804 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::fc06:a1ff:feba:ddf1/64 scope link 2023-07-14T11:18:09.804 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:18:09.804 INFO:teuthology.orchestra.run.smithi179.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-14T11:18:09.804 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 92:db:40:bf:aa:be brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-14T11:18:09.804 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::90db:40ff:febf:aabe/64 scope link 2023-07-14T11:18:09.804 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:18:09.805 INFO:teuthology.orchestra.run.smithi179.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-14T11:18:09.805 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 46:75:18:db:4e:84 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-07-14T11:18:09.805 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::4475:18ff:fedb:4e84/64 scope link 2023-07-14T11:18:09.805 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:18:09.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:18:09.806 DEBUG:teuthology.orchestra.run.smithi179:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-14T11:18:09.879 INFO:teuthology.orchestra.run.smithi179.stdout:1 2023-07-14T11:18:09.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:18:09.882 DEBUG:teuthology.orchestra.run.smithi179:> route 2023-07-14T11:18:09.932 INFO:teuthology.orchestra.run.smithi179.stdout:Kernel IP routing table 2023-07-14T11:18:09.932 INFO:teuthology.orchestra.run.smithi179.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-14T11:18:09.933 INFO:teuthology.orchestra.run.smithi179.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-14T11:18:09.933 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-14T11:18:09.933 INFO:teuthology.orchestra.run.smithi179.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-14T11:18:09.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:18:09.934 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2023-07-14T11:18:09.935 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2023-07-14T11:18:09.935 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-14T11:18:09.935 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-14T11:18:09.936 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-14T11:18:09.936 DEBUG:teuthology.orchestra.run.smithi179:> ') 2023-07-14T11:18:10.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:18:10.105 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2023-07-14T11:18:10.150 INFO:teuthology.orchestra.run.smithi179.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-07-14T11:18:10.151 INFO:teuthology.orchestra.run.smithi179.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-14T11:18:10.151 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-14T11:18:10.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:18:10.152 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link set brx.0 up 2023-07-14T11:18:10.262 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T11:18:10.262 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-07-14T11:18:10.308 INFO:teuthology.orchestra.run.smithi179.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-07-14T11:18:10.309 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T11:18:10.309 DEBUG:teuthology.orchestra.run.smithi179:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-07-14T11:18:10.393 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-07-14T11:18:10.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:18:10.395 DEBUG:teuthology.orchestra.run.smithi179:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-14T11:18:10.537 INFO:teuthology.orchestra.run.smithi179.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-14T11:18:10.537 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-14T11:18:10.564 INFO:teuthology.orchestra.run.smithi179.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-14T11:18:10.565 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-14T11:18:10.565 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-07-14T11:18:10.565 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: trying mount with new device syntax: 1@3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f.cephfs=/ 2023-07-14T11:18:10.565 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.84:3300/172.21.15.179:3300/172.21.15.179:3301" will pass to kernel 2023-07-14T11:18:10.570 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-14T11:18:10.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:18:10.571 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-07-14T11:18:10.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:18:10.640 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-14T11:18:10.728 INFO:teuthology.orchestra.run.smithi179.stdout:client5723 2023-07-14T11:18:10.728 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-07-14T11:18:10.728 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:18:10.774 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-07-14T11:18:10.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:10.982+0000 7f06f8bff700 1 Processor -- start 2023-07-14T11:18:10.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:10.982+0000 7f06f8bff700 1 -- start start 2023-07-14T11:18:10.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:10.983+0000 7f06f8bff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f06f415c890 0x7f06f40d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:10.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:10.983+0000 7f06f8bff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f06f406c240 0x7f06f40d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:10.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:10.983+0000 7f06f8bff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06f415cc60 con 0x7f06f40b2440 2023-07-14T11:18:10.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:10.983+0000 7f06f8bff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06f406a7f0 con 0x7f06f406c240 2023-07-14T11:18:10.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:10.983+0000 7f06f8bff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06f406b760 con 0x7f06f415c890 2023-07-14T11:18:10.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:10.983+0000 7f06f2d9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f06f406c240 0x7f06f40d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:10.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:10.983+0000 7f06f2d9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f06f406c240 0x7f06f40d0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37734/0 (socket says 172.21.15.84:37734) 2023-07-14T11:18:10.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:10.983+0000 7f06f2d9d700 1 -- 172.21.15.84:0/40711580 learned_addr learned my addr 172.21.15.84:0/40711580 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:10.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:10.984+0000 7f06f259c700 1 --2- 172.21.15.84:0/40711580 >> v2:172.21.15.179:3300/0 conn(0x7f06f415c890 0x7f06f40d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:10.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:10.984+0000 7f06f2d9d700 1 -- 172.21.15.84:0/40711580 >> v2:172.21.15.179:3300/0 conn(0x7f06f415c890 msgr2=0x7f06f40d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:10.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:10.984+0000 7f06f2d9d700 1 --2- 172.21.15.84:0/40711580 >> v2:172.21.15.179:3300/0 conn(0x7f06f415c890 0x7f06f40d0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:10.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:10.984+0000 7f06f2d9d700 1 -- 172.21.15.84:0/40711580 >> v1:172.21.15.179:6789/0 conn(0x7f06f40b2440 legacy=0x7f06f40cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:10.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:10.984+0000 7f06f2d9d700 1 -- 172.21.15.84:0/40711580 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06f406ba40 con 0x7f06f406c240 2023-07-14T11:18:10.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:10.984+0000 7f06f259c700 1 --2- 172.21.15.84:0/40711580 >> v2:172.21.15.179:3300/0 conn(0x7f06f415c890 0x7f06f40d0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:18:10.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:10.984+0000 7f06f2d9d700 1 --2- 172.21.15.84:0/40711580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06f406c240 0x7f06f40d0f90 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f06ec009e50 tx=0x7f06ec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4a8f88a300a84a2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:10.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:10.984+0000 7f06f1d9b700 1 -- 172.21.15.84:0/40711580 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ec00e070 con 0x7f06f406c240 2023-07-14T11:18:10.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:10.984+0000 7f06f1d9b700 1 -- 172.21.15.84:0/40711580 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06ec003a20 con 0x7f06f406c240 2023-07-14T11:18:10.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:10.984+0000 7f06f1d9b700 1 -- 172.21.15.84:0/40711580 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ec003dd0 con 0x7f06f406c240 2023-07-14T11:18:10.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:10.985+0000 7f06f8bff700 1 -- 172.21.15.84:0/40711580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06f406c240 msgr2=0x7f06f40d0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:10.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:10.985+0000 7f06f8bff700 1 --2- 172.21.15.84:0/40711580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06f406c240 0x7f06f40d0f90 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f06ec009e50 tx=0x7f06ec00b330 comp rx=0 tx=0).stop 2023-07-14T11:18:10.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:10.985+0000 7f06f8bff700 1 -- 172.21.15.84:0/40711580 shutdown_connections 2023-07-14T11:18:10.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:10.985+0000 7f06f8bff700 1 --2- 172.21.15.84:0/40711580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06f406c240 0x7f06f40d0f90 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:10.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:10.985+0000 7f06f8bff700 1 --2- 172.21.15.84:0/40711580 >> v2:172.21.15.179:3300/0 conn(0x7f06f415c890 0x7f06f40d0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:10.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:10.985+0000 7f06f8bff700 1 -- 172.21.15.84:0/40711580 >> 172.21.15.84:0/40711580 conn(0x7f06f409c170 msgr2=0x7f06f40d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:10.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:10.985+0000 7f06f8bff700 1 -- 172.21.15.84:0/40711580 shutdown_connections 2023-07-14T11:18:10.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:10.985+0000 7f06f8bff700 1 -- 172.21.15.84:0/40711580 wait complete. 2023-07-14T11:18:10.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:10.986+0000 7f06f8bff700 1 Processor -- start 2023-07-14T11:18:10.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:10.987+0000 7f06f8bff700 1 -- start start 2023-07-14T11:18:10.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:10.987+0000 7f06f8bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06f406c240 0x7f06f40c6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:10.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:10.987+0000 7f06f8bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06f40b2440 0x7f06f406aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:10.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:10.987+0000 7f06f8bff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06f415c890 0x7f06f40b5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:10.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:10.988+0000 7f06f8bff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06f4157740 con 0x7f06f415c890 2023-07-14T11:18:10.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:10.988+0000 7f06f8bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06f40c8e70 con 0x7f06f40b2440 2023-07-14T11:18:10.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:10.988+0000 7f06f8bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06f40b8c90 con 0x7f06f406c240 2023-07-14T11:18:10.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:10.988+0000 7f06f2d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06f415c890 0x7f06f40b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:10.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:10.988+0000 7f06f2d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06f415c890 0x7f06f40b5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37750/0 (socket says 172.21.15.84:37750) 2023-07-14T11:18:10.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:10.988+0000 7f06f2d9d700 1 -- 172.21.15.84:0/3650936273 learned_addr learned my addr 172.21.15.84:0/3650936273 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:10.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:10.988+0000 7f06ebfff700 1 --2- 172.21.15.84:0/3650936273 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06f40b2440 0x7f06f406aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:10.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:10.988+0000 7f06f259c700 1 --2- 172.21.15.84:0/3650936273 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06f406c240 0x7f06f40c6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:10.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:10.988+0000 7f06f2d9d700 1 -- 172.21.15.84:0/3650936273 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06f406c240 msgr2=0x7f06f40c6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:10.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:10.988+0000 7f06f2d9d700 1 --2- 172.21.15.84:0/3650936273 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06f406c240 0x7f06f40c6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:10.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:10.988+0000 7f06f2d9d700 1 -- 172.21.15.84:0/3650936273 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06f40b2440 msgr2=0x7f06f406aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:10.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:10.988+0000 7f06f2d9d700 1 --2- 172.21.15.84:0/3650936273 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06f40b2440 0x7f06f406aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:10.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:10.988+0000 7f06f2d9d700 1 -- 172.21.15.84:0/3650936273 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06ec009b30 con 0x7f06f415c890 2023-07-14T11:18:10.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:10.988+0000 7f06ebfff700 1 --2- 172.21.15.84:0/3650936273 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06f40b2440 0x7f06f406aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:18:10.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:10.988+0000 7f06f259c700 1 --2- 172.21.15.84:0/3650936273 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06f406c240 0x7f06f40c6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:18:10.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:10.988+0000 7f06f2d9d700 1 --2- 172.21.15.84:0/3650936273 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06f415c890 0x7f06f40b5cb0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f06ec015040 tx=0x7f06ec004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:10.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:10.989+0000 7f06eaffd700 1 -- 172.21.15.84:0/3650936273 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ec004240 con 0x7f06f415c890 2023-07-14T11:18:10.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:10.989+0000 7f06eaffd700 1 -- 172.21.15.84:0/3650936273 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06ec0043c0 con 0x7f06f415c890 2023-07-14T11:18:10.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:10.989+0000 7f06eaffd700 1 -- 172.21.15.84:0/3650936273 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ec004770 con 0x7f06f415c890 2023-07-14T11:18:10.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:10.989+0000 7f06f8bff700 1 -- 172.21.15.84:0/3650936273 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06f40c8540 con 0x7f06f415c890 2023-07-14T11:18:10.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:10.989+0000 7f06f8bff700 1 -- 172.21.15.84:0/3650936273 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06f40c8b00 con 0x7f06f415c890 2023-07-14T11:18:10.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:10.990+0000 7f06f8bff700 1 -- 172.21.15.84:0/3650936273 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06f4074350 con 0x7f06f415c890 2023-07-14T11:18:10.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:10.991+0000 7f06eaffd700 1 -- 172.21.15.84:0/3650936273 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7f06ec019070 con 0x7f06f415c890 2023-07-14T11:18:10.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:10.992+0000 7f06eaffd700 1 --2- 172.21.15.84:0/3650936273 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f06d406b040 0x7f06d406d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:10.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:10.992+0000 7f06eaffd700 1 -- 172.21.15.84:0/3650936273 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f06ec08ab40 con 0x7f06f415c890 2023-07-14T11:18:10.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:10.992+0000 7f06f259c700 1 --2- 172.21.15.84:0/3650936273 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f06d406b040 0x7f06d406d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:10.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:10.993+0000 7f06f259c700 1 --2- 172.21.15.84:0/3650936273 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f06d406b040 0x7f06d406d4f0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f06e4006fd0 tx=0x7f06e4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:10.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:10.996+0000 7f06eaffd700 1 -- 172.21.15.84:0/3650936273 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f06ec055720 con 0x7f06f415c890 2023-07-14T11:18:11.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:11.237+0000 7f06f8bff700 1 -- 172.21.15.84:0/3650936273 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f06f40d1840 con 0x7f06f415c890 2023-07-14T11:18:11.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:11.845+0000 7f06eaffd700 1 -- 172.21.15.84:0/3650936273 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v46) v1 ==== 136+0+0 (secure 0 0 0) 0x7f06ec007310 con 0x7f06f415c890 2023-07-14T11:18:11.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:11.848+0000 7f06f8bff700 1 -- 172.21.15.84:0/3650936273 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f06d406b040 msgr2=0x7f06d406d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:11.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:11.848+0000 7f06f8bff700 1 --2- 172.21.15.84:0/3650936273 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f06d406b040 0x7f06d406d4f0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f06e4006fd0 tx=0x7f06e4008040 comp rx=0 tx=0).stop 2023-07-14T11:18:11.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:11.848+0000 7f06f8bff700 1 -- 172.21.15.84:0/3650936273 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06f415c890 msgr2=0x7f06f40b5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:11.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:11.848+0000 7f06f8bff700 1 --2- 172.21.15.84:0/3650936273 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06f415c890 0x7f06f40b5cb0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f06ec015040 tx=0x7f06ec004ad0 comp rx=0 tx=0).stop 2023-07-14T11:18:11.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:11.848+0000 7f06f8bff700 1 -- 172.21.15.84:0/3650936273 shutdown_connections 2023-07-14T11:18:11.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:11.848+0000 7f06f8bff700 1 --2- 172.21.15.84:0/3650936273 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f06d406b040 0x7f06d406d4f0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:11.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:11.848+0000 7f06f8bff700 1 --2- 172.21.15.84:0/3650936273 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06f406c240 0x7f06f40c6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:11.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:11.848+0000 7f06f8bff700 1 --2- 172.21.15.84:0/3650936273 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06f415c890 0x7f06f40b5cb0 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:11.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:11.848+0000 7f06f8bff700 1 --2- 172.21.15.84:0/3650936273 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06f40b2440 0x7f06f406aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:11.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:11.848+0000 7f06f8bff700 1 -- 172.21.15.84:0/3650936273 >> 172.21.15.84:0/3650936273 conn(0x7f06f409c170 msgr2=0x7f06f40b5110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:11.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:11.848+0000 7f06f8bff700 1 -- 172.21.15.84:0/3650936273 shutdown_connections 2023-07-14T11:18:11.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:11.848+0000 7f06f8bff700 1 -- 172.21.15.84:0/3650936273 wait complete. 2023-07-14T11:18:11.870 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-07-14T11:18:12.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.066+0000 7ff974dff700 1 Processor -- start 2023-07-14T11:18:12.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.066+0000 7ff974dff700 1 -- start start 2023-07-14T11:18:12.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.068+0000 7ff974dff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff9700b8660 0x7ff9700cd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:12.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.068+0000 7ff974dff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff9700cd970 0x7ff9700b4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:12.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.068+0000 7ff974dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9700b4da0 0x7ff9701601f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:12.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.068+0000 7ff974dff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9700d02a0 con 0x7ff9700cd970 2023-07-14T11:18:12.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.068+0000 7ff974dff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9700b51b0 con 0x7ff9700b8660 2023-07-14T11:18:12.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.068+0000 7ff974dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9700cfce0 con 0x7ff9700b4da0 2023-07-14T11:18:12.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.068+0000 7ff96dd9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff9700cd970 0x7ff9700b4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:12.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.068+0000 7ff96dd9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff9700cd970 0x7ff9700b4860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37762/0 (socket says 172.21.15.84:37762) 2023-07-14T11:18:12.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.068+0000 7ff96dd9b700 1 -- 172.21.15.84:0/2035739599 learned_addr learned my addr 172.21.15.84:0/2035739599 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:12.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.068+0000 7ff96ed9d700 1 --2- 172.21.15.84:0/2035739599 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9700b4da0 0x7ff9701601f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:12.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.068+0000 7ff96e59c700 1 --2- 172.21.15.84:0/2035739599 >> v2:172.21.15.179:3300/0 conn(0x7ff9700b8660 0x7ff9700cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:12.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.069+0000 7ff96dd9b700 1 -- 172.21.15.84:0/2035739599 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9700b4da0 msgr2=0x7ff9701601f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:12.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.069+0000 7ff96dd9b700 1 --2- 172.21.15.84:0/2035739599 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9700b4da0 0x7ff9701601f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:12.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.069+0000 7ff96dd9b700 1 -- 172.21.15.84:0/2035739599 >> v2:172.21.15.179:3300/0 conn(0x7ff9700b8660 msgr2=0x7ff9700cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:12.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.069+0000 7ff96dd9b700 1 --2- 172.21.15.84:0/2035739599 >> v2:172.21.15.179:3300/0 conn(0x7ff9700b8660 0x7ff9700cd430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:12.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.069+0000 7ff96dd9b700 1 -- 172.21.15.84:0/2035739599 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9700cffc0 con 0x7ff9700cd970 2023-07-14T11:18:12.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.069+0000 7ff96e59c700 1 --2- 172.21.15.84:0/2035739599 >> v2:172.21.15.179:3300/0 conn(0x7ff9700b8660 0x7ff9700cd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:18:12.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.069+0000 7ff96dd9b700 1 --2- 172.21.15.84:0/2035739599 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9700cd970 0x7ff9700b4860 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7ff9700c9e60 tx=0x7ff964009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68651072e4a34d92 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:12.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.069+0000 7ff96d59a700 1 -- 172.21.15.84:0/2035739599 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff964011830 con 0x7ff9700cd970 2023-07-14T11:18:12.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.069+0000 7ff96d59a700 1 -- 172.21.15.84:0/2035739599 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff964011990 con 0x7ff9700cd970 2023-07-14T11:18:12.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.069+0000 7ff96d59a700 1 -- 172.21.15.84:0/2035739599 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff964011d20 con 0x7ff9700cd970 2023-07-14T11:18:12.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.070+0000 7ff974dff700 1 -- 172.21.15.84:0/2035739599 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9700cd970 msgr2=0x7ff9700b4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:12.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.070+0000 7ff974dff700 1 --2- 172.21.15.84:0/2035739599 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9700cd970 0x7ff9700b4860 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7ff9700c9e60 tx=0x7ff964009bd0 comp rx=0 tx=0).stop 2023-07-14T11:18:12.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.070+0000 7ff974dff700 1 -- 172.21.15.84:0/2035739599 shutdown_connections 2023-07-14T11:18:12.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.070+0000 7ff974dff700 1 --2- 172.21.15.84:0/2035739599 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9700b4da0 0x7ff9701601f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:12.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.070+0000 7ff974dff700 1 --2- 172.21.15.84:0/2035739599 >> v2:172.21.15.179:3300/0 conn(0x7ff9700b8660 0x7ff9700cd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:12.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.070+0000 7ff974dff700 1 --2- 172.21.15.84:0/2035739599 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9700cd970 0x7ff9700b4860 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:12.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.070+0000 7ff974dff700 1 -- 172.21.15.84:0/2035739599 >> 172.21.15.84:0/2035739599 conn(0x7ff970066860 msgr2=0x7ff97006a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:12.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.070+0000 7ff974dff700 1 -- 172.21.15.84:0/2035739599 shutdown_connections 2023-07-14T11:18:12.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.070+0000 7ff974dff700 1 -- 172.21.15.84:0/2035739599 wait complete. 2023-07-14T11:18:12.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.072+0000 7ff974dff700 1 Processor -- start 2023-07-14T11:18:12.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.073+0000 7ff974dff700 1 -- start start 2023-07-14T11:18:12.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.074+0000 7ff974dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9700b4da0 0x7ff9700cb910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:12.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.074+0000 7ff974dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9700b8660 0x7ff97015a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:12.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.074+0000 7ff974dff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9700cd970 0x7ff9700c9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:12.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.074+0000 7ff974dff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9700c6a30 con 0x7ff9700cd970 2023-07-14T11:18:12.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.074+0000 7ff974dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff97015ac50 con 0x7ff9700b4da0 2023-07-14T11:18:12.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.074+0000 7ff974dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9700cbef0 con 0x7ff9700b8660 2023-07-14T11:18:12.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.074+0000 7ff96ed9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9700cd970 0x7ff9700c9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:12.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.074+0000 7ff96ed9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9700cd970 0x7ff9700c9290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37766/0 (socket says 172.21.15.84:37766) 2023-07-14T11:18:12.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.074+0000 7ff96ed9d700 1 -- 172.21.15.84:0/3846241662 learned_addr learned my addr 172.21.15.84:0/3846241662 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:12.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.074+0000 7ff96dd9b700 1 --2- 172.21.15.84:0/3846241662 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9700b8660 0x7ff97015a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:12.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.074+0000 7ff96e59c700 1 --2- 172.21.15.84:0/3846241662 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9700b4da0 0x7ff9700cb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:12.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.075+0000 7ff96dd9b700 1 -- 172.21.15.84:0/3846241662 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9700b4da0 msgr2=0x7ff9700cb910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:12.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.075+0000 7ff96dd9b700 1 --2- 172.21.15.84:0/3846241662 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9700b4da0 0x7ff9700cb910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:12.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.075+0000 7ff96dd9b700 1 -- 172.21.15.84:0/3846241662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9700cd970 msgr2=0x7ff9700c9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:12.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.075+0000 7ff96dd9b700 1 --2- 172.21.15.84:0/3846241662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9700cd970 0x7ff9700c9290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:12.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.075+0000 7ff96dd9b700 1 -- 172.21.15.84:0/3846241662 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff964009550 con 0x7ff9700b8660 2023-07-14T11:18:12.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.075+0000 7ff96ed9d700 1 --2- 172.21.15.84:0/3846241662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9700cd970 0x7ff9700c9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:18:12.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.075+0000 7ff96dd9b700 1 --2- 172.21.15.84:0/3846241662 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9700b8660 0x7ff97015a710 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff964016000 tx=0x7ff964004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:12.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.075+0000 7ff95effd700 1 -- 172.21.15.84:0/3846241662 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff964004510 con 0x7ff9700b8660 2023-07-14T11:18:12.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.075+0000 7ff974dff700 1 -- 172.21.15.84:0/3846241662 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9700cc1d0 con 0x7ff9700b8660 2023-07-14T11:18:12.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.076+0000 7ff974dff700 1 -- 172.21.15.84:0/3846241662 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9700cc790 con 0x7ff9700b8660 2023-07-14T11:18:12.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.076+0000 7ff95effd700 1 -- 172.21.15.84:0/3846241662 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff96401e070 con 0x7ff9700b8660 2023-07-14T11:18:12.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.076+0000 7ff95effd700 1 -- 172.21.15.84:0/3846241662 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9640038a0 con 0x7ff9700b8660 2023-07-14T11:18:12.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.077+0000 7ff974dff700 1 -- 172.21.15.84:0/3846241662 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9700c6b70 con 0x7ff9700b8660 2023-07-14T11:18:12.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.078+0000 7ff95effd700 1 -- 172.21.15.84:0/3846241662 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7ff964003a00 con 0x7ff9700b8660 2023-07-14T11:18:12.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.079+0000 7ff95effd700 1 --2- 172.21.15.84:0/3846241662 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff95006afb0 0x7ff95006d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:12.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.079+0000 7ff95effd700 1 -- 172.21.15.84:0/3846241662 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff96408a890 con 0x7ff9700b8660 2023-07-14T11:18:12.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.079+0000 7ff96e59c700 1 --2- 172.21.15.84:0/3846241662 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff95006afb0 0x7ff95006d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:12.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.079+0000 7ff96e59c700 1 --2- 172.21.15.84:0/3846241662 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff95006afb0 0x7ff95006d460 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7ff9700ccce0 tx=0x7ff960008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:12.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.084+0000 7ff95effd700 1 -- 172.21.15.84:0/3846241662 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ff9700c6b70 con 0x7ff9700b8660 2023-07-14T11:18:12.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.313+0000 7ff974dff700 1 -- 172.21.15.84:0/3846241662 --> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7ff9700d0da0 con 0x7ff95006afb0 2023-07-14T11:18:12.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.314+0000 7ff95effd700 1 -- 172.21.15.84:0/3846241662 <== mgr.4104 v2:172.21.15.84:6832/379617029 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7ff960009e10 con 0x7ff95006afb0 2023-07-14T11:18:12.317 INFO:teuthology.orchestra.run.smithi084.stdout:[ 2023-07-14T11:18:12.317 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:12.317 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "cephfs" 2023-07-14T11:18:12.317 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:12.317 INFO:teuthology.orchestra.run.smithi084.stdout:] 2023-07-14T11:18:12.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.317+0000 7ff974dff700 1 -- 172.21.15.84:0/3846241662 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff95006afb0 msgr2=0x7ff95006d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:12.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.317+0000 7ff974dff700 1 --2- 172.21.15.84:0/3846241662 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff95006afb0 0x7ff95006d460 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7ff9700ccce0 tx=0x7ff960008040 comp rx=0 tx=0).stop 2023-07-14T11:18:12.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.317+0000 7ff974dff700 1 -- 172.21.15.84:0/3846241662 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9700b8660 msgr2=0x7ff97015a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:12.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.317+0000 7ff974dff700 1 --2- 172.21.15.84:0/3846241662 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9700b8660 0x7ff97015a710 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff964016000 tx=0x7ff964004750 comp rx=0 tx=0).stop 2023-07-14T11:18:12.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.317+0000 7ff974dff700 1 -- 172.21.15.84:0/3846241662 shutdown_connections 2023-07-14T11:18:12.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.317+0000 7ff974dff700 1 --2- 172.21.15.84:0/3846241662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9700cd970 0x7ff9700c9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:12.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.317+0000 7ff974dff700 1 --2- 172.21.15.84:0/3846241662 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9700b4da0 0x7ff9700cb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:12.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.317+0000 7ff974dff700 1 --2- 172.21.15.84:0/3846241662 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ff95006afb0 0x7ff95006d460 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:12.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.317+0000 7ff974dff700 1 --2- 172.21.15.84:0/3846241662 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9700b8660 0x7ff97015a710 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:12.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.317+0000 7ff974dff700 1 -- 172.21.15.84:0/3846241662 >> 172.21.15.84:0/3846241662 conn(0x7ff970066860 msgr2=0x7ff9700d2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:12.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.317+0000 7ff974dff700 1 -- 172.21.15.84:0/3846241662 shutdown_connections 2023-07-14T11:18:12.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.317+0000 7ff974dff700 1 -- 172.21.15.84:0/3846241662 wait complete. 2023-07-14T11:18:12.337 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-14T11:18:12.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.534+0000 7f9fbc5ff700 1 Processor -- start 2023-07-14T11:18:12.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.534+0000 7f9fbc5ff700 1 -- start start 2023-07-14T11:18:12.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.536+0000 7f9fbc5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fb406f010 0x7f9fb4071650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:12.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.536+0000 7f9fbc5ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fb40cdba0 con 0x7f9fb40ce030 2023-07-14T11:18:12.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.536+0000 7f9fbc5ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fb40cf370 con 0x7f9fb406a640 2023-07-14T11:18:12.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.536+0000 7f9fbc5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb406f3e0 con 0x7f9fb406f010 2023-07-14T11:18:12.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.536+0000 7f9fb9b9a700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f9fb40ce030 0x7f9fb4069f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:59784/0 (socket says 172.21.15.84:59784) 2023-07-14T11:18:12.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.536+0000 7f9fb9b9a700 1 -- 172.21.15.84:0/1556985684 learned_addr learned my addr 172.21.15.84:0/1556985684 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:18:12.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.536+0000 7f9fba39b700 1 --2- 172.21.15.84:0/1556985684 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fb406f010 0x7f9fb4071650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:12.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.536+0000 7f9fb9399700 1 -- 172.21.15.84:0/1556985684 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 894496019 0 0) 0x7f9fb40cdba0 con 0x7f9fb40ce030 2023-07-14T11:18:12.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.536+0000 7f9fb9399700 1 -- 172.21.15.84:0/1556985684 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fa00035b0 con 0x7f9fb40ce030 2023-07-14T11:18:12.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.537+0000 7f9fb9399700 1 -- 172.21.15.84:0/1556985684 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3723917469 0 0) 0x7f9fb40cf370 con 0x7f9fb406a640 2023-07-14T11:18:12.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.537+0000 7f9fb9399700 1 -- 172.21.15.84:0/1556985684 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fb40cdba0 con 0x7f9fb406a640 2023-07-14T11:18:12.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.537+0000 7f9fb9399700 1 -- 172.21.15.84:0/1556985684 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2345297174 0 0) 0x7f9fa00035b0 con 0x7f9fb40ce030 2023-07-14T11:18:12.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.537+0000 7f9fb9399700 1 -- 172.21.15.84:0/1556985684 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fb406f010 msgr2=0x7f9fb4071650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:12.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.537+0000 7f9fb9399700 1 --2- 172.21.15.84:0/1556985684 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fb406f010 0x7f9fb4071650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:12.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.537+0000 7f9fb9399700 1 -- 172.21.15.84:0/1556985684 >> v1:172.21.15.179:6789/0 conn(0x7f9fb406a640 legacy=0x7f9fb41601d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:12.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.537+0000 7f9fb9399700 1 -- 172.21.15.84:0/1556985684 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fb40cf650 con 0x7f9fb40ce030 2023-07-14T11:18:12.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.537+0000 7f9fb9399700 1 -- 172.21.15.84:0/1556985684 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7f9fa4001670 con 0x7f9fb40ce030 2023-07-14T11:18:12.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.537+0000 7f9fba39b700 1 --2- 172.21.15.84:0/1556985684 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fb406f010 0x7f9fb4071650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:18:12.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.537+0000 7f9fb9399700 1 -- 172.21.15.84:0/1556985684 >> v1:172.21.15.84:6789/0 conn(0x7f9fb40ce030 legacy=0x7f9fb4069f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:12.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.537+0000 7f9fb9399700 1 --2- 172.21.15.84:0/1556985684 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fb406f010 0x7f9fa0003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:12.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.537+0000 7f9fb9399700 1 --2- 172.21.15.84:0/1556985684 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9fa0004100 0x7f9fa0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:12.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.537+0000 7f9fb9399700 1 --2- 172.21.15.84:0/1556985684 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fa0004d90 0x7f9fa0005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:12.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.537+0000 7f9fb9399700 1 -- 172.21.15.84:0/1556985684 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb406f3e0 con 0x7f9fa0004100 2023-07-14T11:18:12.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.537+0000 7f9fb9399700 1 -- 172.21.15.84:0/1556985684 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa000bac0 con 0x7f9fa0004d90 2023-07-14T11:18:12.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.537+0000 7f9fb9399700 1 -- 172.21.15.84:0/1556985684 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa000bc80 con 0x7f9fb406f010 2023-07-14T11:18:12.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.537+0000 7f9fb9b9a700 1 --2- 172.21.15.84:0/1556985684 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9fa0004100 0x7f9fa0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:12.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.537+0000 7f9fba39b700 1 --2- 172.21.15.84:0/1556985684 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fb406f010 0x7f9fa0003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:12.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.537+0000 7f9fbab9c700 1 --2- 172.21.15.84:0/1556985684 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fa0004d90 0x7f9fa0005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:12.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.538+0000 7f9fb9b9a700 1 -- 172.21.15.84:0/1556985684 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fb406f010 msgr2=0x7f9fa0003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:12.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.538+0000 7f9fb9b9a700 1 --2- 172.21.15.84:0/1556985684 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fb406f010 0x7f9fa0003bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:12.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.538+0000 7f9fb9b9a700 1 -- 172.21.15.84:0/1556985684 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fa0004d90 msgr2=0x7f9fa0005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:12.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.538+0000 7f9fb9b9a700 1 --2- 172.21.15.84:0/1556985684 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fa0004d90 0x7f9fa0005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:12.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.538+0000 7f9fb9b9a700 1 -- 172.21.15.84:0/1556985684 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fb00094a0 con 0x7f9fa0004100 2023-07-14T11:18:12.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.538+0000 7f9fb9b9a700 1 --2- 172.21.15.84:0/1556985684 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9fa0004100 0x7f9fa0004850 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f9fa4001eb0 tx=0x7f9fa0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7294a442af07407f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:12.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.538+0000 7f9fb9399700 1 -- 172.21.15.84:0/1556985684 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa400cd80 con 0x7f9fa0004100 2023-07-14T11:18:12.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.538+0000 7f9fb9399700 1 -- 172.21.15.84:0/1556985684 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fa4001af0 con 0x7f9fa0004100 2023-07-14T11:18:12.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.538+0000 7f9fb9399700 1 -- 172.21.15.84:0/1556985684 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa4005ba0 con 0x7f9fa0004100 2023-07-14T11:18:12.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.539+0000 7f9fbc5ff700 1 -- 172.21.15.84:0/1556985684 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9fa0004100 msgr2=0x7f9fa0004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:12.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.539+0000 7f9fbc5ff700 1 --2- 172.21.15.84:0/1556985684 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9fa0004100 0x7f9fa0004850 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f9fa4001eb0 tx=0x7f9fa0005880 comp rx=0 tx=0).stop 2023-07-14T11:18:12.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.539+0000 7f9fbab9c700 1 -- 172.21.15.84:0/1556985684 reap_dead start 2023-07-14T11:18:12.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.539+0000 7f9fbc5ff700 1 -- 172.21.15.84:0/1556985684 shutdown_connections 2023-07-14T11:18:12.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.539+0000 7f9fbc5ff700 1 -- 172.21.15.84:0/1556985684 >> 172.21.15.84:0/1556985684 conn(0x7f9fb40cc640 msgr2=0x7f9fb40cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:12.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.539+0000 7f9fbc5ff700 1 -- 172.21.15.84:0/1556985684 shutdown_connections 2023-07-14T11:18:12.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.539+0000 7f9fbc5ff700 1 -- 172.21.15.84:0/1556985684 wait complete. 2023-07-14T11:18:12.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.540+0000 7f9fbc5ff700 1 Processor -- start 2023-07-14T11:18:12.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.541+0000 7f9fbc5ff700 1 -- start start 2023-07-14T11:18:12.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.541+0000 7f9fbc5ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9fa0004100 0x7f9fb415e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:12.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.541+0000 7f9fbc5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fb40c9560 0x7f9fb40c99d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:12.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.542+0000 7f9fbc5ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fb40c6c90 0x7f9fb40c7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:12.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.542+0000 7f9fbc5ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb40c9f10 con 0x7f9fa0004100 2023-07-14T11:18:12.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.542+0000 7f9fbc5ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb40c8640 con 0x7f9fb40c6c90 2023-07-14T11:18:12.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.542+0000 7f9fbc5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb415e920 con 0x7f9fb40c9560 2023-07-14T11:18:12.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.542+0000 7f9fba39b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9fa0004100 0x7f9fb415e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:12.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.542+0000 7f9fba39b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9fa0004100 0x7f9fb415e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37772/0 (socket says 172.21.15.84:37772) 2023-07-14T11:18:12.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.542+0000 7f9fba39b700 1 -- 172.21.15.84:0/4081643888 learned_addr learned my addr 172.21.15.84:0/4081643888 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:12.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.542+0000 7f9fba39b700 1 -- 172.21.15.84:0/4081643888 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fb40c9560 msgr2=0x7f9fb40c99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:12.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.542+0000 7f9fba39b700 1 --2- 172.21.15.84:0/4081643888 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fb40c9560 0x7f9fb40c99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:12.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.542+0000 7f9fba39b700 1 -- 172.21.15.84:0/4081643888 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fb40c6c90 msgr2=0x7f9fb40c7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:12.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.542+0000 7f9fba39b700 1 --2- 172.21.15.84:0/4081643888 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fb40c6c90 0x7f9fb40c7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:12.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.542+0000 7f9fba39b700 1 -- 172.21.15.84:0/4081643888 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fb40c79c0 con 0x7f9fa0004100 2023-07-14T11:18:12.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.542+0000 7f9fba39b700 1 --2- 172.21.15.84:0/4081643888 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9fa0004100 0x7f9fb415e3e0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f9fb0011d30 tx=0x7f9fb000f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:12.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.543+0000 7f9faaffd700 1 -- 172.21.15.84:0/4081643888 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb0011ed0 con 0x7f9fa0004100 2023-07-14T11:18:12.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.543+0000 7f9faaffd700 1 -- 172.21.15.84:0/4081643888 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fb000fc60 con 0x7f9fa0004100 2023-07-14T11:18:12.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.543+0000 7f9faaffd700 1 -- 172.21.15.84:0/4081643888 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb0014440 con 0x7f9fa0004100 2023-07-14T11:18:12.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.543+0000 7f9fbc5ff700 1 -- 172.21.15.84:0/4081643888 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fb40c7ca0 con 0x7f9fa0004100 2023-07-14T11:18:12.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.543+0000 7f9fbc5ff700 1 -- 172.21.15.84:0/4081643888 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fb40c8260 con 0x7f9fa0004100 2023-07-14T11:18:12.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.544+0000 7f9fbc5ff700 1 -- 172.21.15.84:0/4081643888 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fb41f26a0 con 0x7f9fa0004100 2023-07-14T11:18:12.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.545+0000 7f9faaffd700 1 -- 172.21.15.84:0/4081643888 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7f9fb00145a0 con 0x7f9fa0004100 2023-07-14T11:18:12.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.545+0000 7f9faaffd700 1 --2- 172.21.15.84:0/4081643888 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f9f9806b040 0x7f9f9806d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:12.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.546+0000 7f9faaffd700 1 -- 172.21.15.84:0/4081643888 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9fb008a170 con 0x7f9fa0004100 2023-07-14T11:18:12.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.546+0000 7f9fb9b9a700 1 --2- 172.21.15.84:0/4081643888 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f9f9806b040 0x7f9f9806d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:12.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.546+0000 7f9fb9b9a700 1 --2- 172.21.15.84:0/4081643888 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f9f9806b040 0x7f9f9806d4f0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f9fb415d970 tx=0x7f9fa400f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:12.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.550+0000 7f9faaffd700 1 -- 172.21.15.84:0/4081643888 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f9fb0054f50 con 0x7f9fa0004100 2023-07-14T11:18:12.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.746+0000 7f9fbc5ff700 1 -- 172.21.15.84:0/4081643888 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f9fb4074350 con 0x7f9fa0004100 2023-07-14T11:18:12.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.746+0000 7f9faaffd700 1 -- 172.21.15.84:0/4081643888 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f9fb0058570 con 0x7f9fa0004100 2023-07-14T11:18:12.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.748+0000 7f9fbc5ff700 1 -- 172.21.15.84:0/4081643888 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f9f9806b040 msgr2=0x7f9f9806d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:12.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.748+0000 7f9fbc5ff700 1 --2- 172.21.15.84:0/4081643888 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f9f9806b040 0x7f9f9806d4f0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f9fb415d970 tx=0x7f9fa400f000 comp rx=0 tx=0).stop 2023-07-14T11:18:12.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.748+0000 7f9fbc5ff700 1 -- 172.21.15.84:0/4081643888 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9fa0004100 msgr2=0x7f9fb415e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:12.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.748+0000 7f9fbc5ff700 1 --2- 172.21.15.84:0/4081643888 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9fa0004100 0x7f9fb415e3e0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f9fb0011d30 tx=0x7f9fb000f520 comp rx=0 tx=0).stop 2023-07-14T11:18:12.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.749+0000 7f9fbc5ff700 1 -- 172.21.15.84:0/4081643888 shutdown_connections 2023-07-14T11:18:12.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.749+0000 7f9fbc5ff700 1 --2- 172.21.15.84:0/4081643888 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fb40c6c90 0x7f9fb40c7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:12.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.749+0000 7f9fbc5ff700 1 --2- 172.21.15.84:0/4081643888 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9fa0004100 0x7f9fb415e3e0 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:12.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.749+0000 7f9fbc5ff700 1 --2- 172.21.15.84:0/4081643888 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f9f9806b040 0x7f9f9806d4f0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:12.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.749+0000 7f9fbc5ff700 1 --2- 172.21.15.84:0/4081643888 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fb40c9560 0x7f9fb40c99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:12.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.749+0000 7f9fbc5ff700 1 -- 172.21.15.84:0/4081643888 >> 172.21.15.84:0/4081643888 conn(0x7f9fb40cc640 msgr2=0x7f9fb40ce400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:12.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.749+0000 7f9fbc5ff700 1 -- 172.21.15.84:0/4081643888 shutdown_connections 2023-07-14T11:18:12.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:12.749+0000 7f9fbc5ff700 1 -- 172.21.15.84:0/4081643888 wait complete. 2023-07-14T11:18:12.769 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-14T11:18:12.770 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:18:12.815 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-14T11:18:12.815 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:18:12.902 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:18:13.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.135+0000 7f466b3ff700 1 Processor -- start 2023-07-14T11:18:13.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.136+0000 7f466b3ff700 1 -- start start 2023-07-14T11:18:13.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.137+0000 7f466b3ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f466415afd0 0x7f46640cee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:13.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.137+0000 7f466b3ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f466415b430 con 0x7f46640b3e90 2023-07-14T11:18:13.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.137+0000 7f466b3ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46640ce110 con 0x7f466415e890 2023-07-14T11:18:13.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.137+0000 7f466b3ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46640cf380 con 0x7f466415afd0 2023-07-14T11:18:13.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.137+0000 7f466899a700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f46640b3e90 0x7f466415a8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:59788/0 (socket says 172.21.15.84:59788) 2023-07-14T11:18:13.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.137+0000 7f466899a700 1 -- 172.21.15.84:0/197222632 learned_addr learned my addr 172.21.15.84:0/197222632 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:18:13.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.137+0000 7f466999c700 1 --2- 172.21.15.84:0/197222632 >> v2:172.21.15.179:3300/0 conn(0x7f466415afd0 0x7f46640cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:13.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.137+0000 7f465bfff700 1 -- 172.21.15.84:0/197222632 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 864765658 0 0) 0x7f466415b430 con 0x7f46640b3e90 2023-07-14T11:18:13.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.138+0000 7f465bfff700 1 -- 172.21.15.84:0/197222632 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46500035b0 con 0x7f46640b3e90 2023-07-14T11:18:13.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.138+0000 7f465bfff700 1 -- 172.21.15.84:0/197222632 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3011520473 0 0) 0x7f46640ce110 con 0x7f466415e890 2023-07-14T11:18:13.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.138+0000 7f465bfff700 1 -- 172.21.15.84:0/197222632 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f466415b430 con 0x7f466415e890 2023-07-14T11:18:13.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.138+0000 7f466999c700 1 -- 172.21.15.84:0/197222632 >> v1:172.21.15.179:6789/0 conn(0x7f466415e890 legacy=0x7f46640b3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:13.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.138+0000 7f465bfff700 1 -- 172.21.15.84:0/197222632 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 790394748 0 0) 0x7f46500035b0 con 0x7f46640b3e90 2023-07-14T11:18:13.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.138+0000 7f466999c700 1 -- 172.21.15.84:0/197222632 >> v1:172.21.15.84:6789/0 conn(0x7f46640b3e90 legacy=0x7f466415a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:13.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.138+0000 7f466999c700 1 -- 172.21.15.84:0/197222632 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f466415b660 con 0x7f466415afd0 2023-07-14T11:18:13.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.138+0000 7f466999c700 1 --2- 172.21.15.84:0/197222632 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f466415afd0 0x7f46640cee40 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f465c009d90 tx=0x7f465c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a7b9549a51fcb46 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:13.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.139+0000 7f465bfff700 1 -- 172.21.15.84:0/197222632 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465c00e070 con 0x7f466415afd0 2023-07-14T11:18:13.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.139+0000 7f465bfff700 1 -- 172.21.15.84:0/197222632 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f465c003a20 con 0x7f466415afd0 2023-07-14T11:18:13.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.139+0000 7f465bfff700 1 -- 172.21.15.84:0/197222632 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4654001670 con 0x7f466415afd0 2023-07-14T11:18:13.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.139+0000 7f466b3ff700 1 -- 172.21.15.84:0/197222632 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f466415afd0 msgr2=0x7f46640cee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:13.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.139+0000 7f466b3ff700 1 --2- 172.21.15.84:0/197222632 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f466415afd0 0x7f46640cee40 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f465c009d90 tx=0x7f465c00b330 comp rx=0 tx=0).stop 2023-07-14T11:18:13.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.139+0000 7f466b3ff700 1 -- 172.21.15.84:0/197222632 shutdown_connections 2023-07-14T11:18:13.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.139+0000 7f466b3ff700 1 --2- 172.21.15.84:0/197222632 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f466415afd0 0x7f46640cee40 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:13.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.139+0000 7f466b3ff700 1 -- 172.21.15.84:0/197222632 >> 172.21.15.84:0/197222632 conn(0x7f4664069f30 msgr2=0x7f466406a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:13.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.139+0000 7f466b3ff700 1 -- 172.21.15.84:0/197222632 shutdown_connections 2023-07-14T11:18:13.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.139+0000 7f466b3ff700 1 -- 172.21.15.84:0/197222632 wait complete. 2023-07-14T11:18:13.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.141+0000 7f466b3ff700 1 Processor -- start 2023-07-14T11:18:13.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.141+0000 7f466b3ff700 1 -- start start 2023-07-14T11:18:13.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.142+0000 7f466b3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46640b3e90 0x7f46640b0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:13.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.142+0000 7f466b3ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f466415afd0 0x7f466414d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:13.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.142+0000 7f466b3ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f466415e890 0x7f46640af730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:13.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.142+0000 7f466b3ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46640afc70 con 0x7f466415e890 2023-07-14T11:18:13.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.142+0000 7f466b3ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46640b0ab0 con 0x7f466415afd0 2023-07-14T11:18:13.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.142+0000 7f466b3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46640afea0 con 0x7f46640b3e90 2023-07-14T11:18:13.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.142+0000 7f466999c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f466415e890 0x7f46640af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:13.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.142+0000 7f466999c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f466415e890 0x7f46640af730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37782/0 (socket says 172.21.15.84:37782) 2023-07-14T11:18:13.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.142+0000 7f466999c700 1 -- 172.21.15.84:0/3427522579 learned_addr learned my addr 172.21.15.84:0/3427522579 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:13.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.142+0000 7f466919b700 1 --2- 172.21.15.84:0/3427522579 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46640b3e90 0x7f46640b0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:13.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.142+0000 7f466899a700 1 --2- 172.21.15.84:0/3427522579 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f466415afd0 0x7f466414d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:13.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.143+0000 7f466999c700 1 -- 172.21.15.84:0/3427522579 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46640b3e90 msgr2=0x7f46640b0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:13.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.143+0000 7f466999c700 1 --2- 172.21.15.84:0/3427522579 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46640b3e90 0x7f46640b0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:13.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.143+0000 7f466999c700 1 -- 172.21.15.84:0/3427522579 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f466415afd0 msgr2=0x7f466414d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:13.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.143+0000 7f466999c700 1 --2- 172.21.15.84:0/3427522579 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f466415afd0 0x7f466414d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:13.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.143+0000 7f466999c700 1 -- 172.21.15.84:0/3427522579 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f465c009a70 con 0x7f466415e890 2023-07-14T11:18:13.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.143+0000 7f466919b700 1 --2- 172.21.15.84:0/3427522579 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46640b3e90 0x7f46640b0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:18:13.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.143+0000 7f466999c700 1 --2- 172.21.15.84:0/3427522579 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f466415e890 0x7f46640af730 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f465c00b370 tx=0x7f465c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:13.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.143+0000 7f4659ffb700 1 -- 172.21.15.84:0/3427522579 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465c0045c0 con 0x7f466415e890 2023-07-14T11:18:13.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.143+0000 7f4659ffb700 1 -- 172.21.15.84:0/3427522579 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f465c004720 con 0x7f466415e890 2023-07-14T11:18:13.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.143+0000 7f466b3ff700 1 -- 172.21.15.84:0/3427522579 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46640b0180 con 0x7f466415e890 2023-07-14T11:18:13.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.143+0000 7f4659ffb700 1 -- 172.21.15.84:0/3427522579 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465c01d470 con 0x7f466415e890 2023-07-14T11:18:13.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.143+0000 7f466b3ff700 1 -- 172.21.15.84:0/3427522579 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46640b0740 con 0x7f466415e890 2023-07-14T11:18:13.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.144+0000 7f466b3ff700 1 -- 172.21.15.84:0/3427522579 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46640b0c40 con 0x7f466415e890 2023-07-14T11:18:13.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.145+0000 7f4659ffb700 1 -- 172.21.15.84:0/3427522579 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7f465c01d5d0 con 0x7f466415e890 2023-07-14T11:18:13.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.146+0000 7f4659ffb700 1 --2- 172.21.15.84:0/3427522579 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f464806b040 0x7f464806d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:13.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.146+0000 7f4659ffb700 1 -- 172.21.15.84:0/3427522579 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f465c08b7b0 con 0x7f466415e890 2023-07-14T11:18:13.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.146+0000 7f466919b700 1 --2- 172.21.15.84:0/3427522579 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f464806b040 0x7f464806d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:13.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.147+0000 7f466919b700 1 --2- 172.21.15.84:0/3427522579 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f464806b040 0x7f464806d4f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f46600011e0 tx=0x7f4660009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:13.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.150+0000 7f4659ffb700 1 -- 172.21.15.84:0/3427522579 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f465c056390 con 0x7f466415e890 2023-07-14T11:18:13.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.344+0000 7f466b3ff700 1 -- 172.21.15.84:0/3427522579 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f466404e280 con 0x7f466415e890 2023-07-14T11:18:13.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.346+0000 7f4659ffb700 1 -- 172.21.15.84:0/3427522579 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+18330 (secure 0 0 0) 0x7f465c0599b0 con 0x7f466415e890 2023-07-14T11:18:13.349 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:18:13.349 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":75,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:17:57.264291+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-07-14T11:17:53.456029+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-07-14T11:17:54.724710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:18:13.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.348+0000 7f466b3ff700 1 -- 172.21.15.84:0/3427522579 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f464806b040 msgr2=0x7f464806d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:13.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.348+0000 7f466b3ff700 1 --2- 172.21.15.84:0/3427522579 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f464806b040 0x7f464806d4f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f46600011e0 tx=0x7f4660009040 comp rx=0 tx=0).stop 2023-07-14T11:18:13.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.348+0000 7f466b3ff700 1 -- 172.21.15.84:0/3427522579 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f466415e890 msgr2=0x7f46640af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:13.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.348+0000 7f466b3ff700 1 --2- 172.21.15.84:0/3427522579 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f466415e890 0x7f46640af730 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f465c00b370 tx=0x7f465c004ad0 comp rx=0 tx=0).stop 2023-07-14T11:18:13.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.348+0000 7f466b3ff700 1 -- 172.21.15.84:0/3427522579 shutdown_connections 2023-07-14T11:18:13.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.348+0000 7f466b3ff700 1 --2- 172.21.15.84:0/3427522579 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f464806b040 0x7f464806d4f0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:13.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.348+0000 7f466b3ff700 1 --2- 172.21.15.84:0/3427522579 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46640b3e90 0x7f46640b0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:13.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.348+0000 7f466b3ff700 1 --2- 172.21.15.84:0/3427522579 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f466415e890 0x7f46640af730 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:13.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.348+0000 7f466b3ff700 1 --2- 172.21.15.84:0/3427522579 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f466415afd0 0x7f466414d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:13.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.348+0000 7f466b3ff700 1 -- 172.21.15.84:0/3427522579 >> 172.21.15.84:0/3427522579 conn(0x7f4664069f30 msgr2=0x7f466406b920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:13.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.348+0000 7f466b3ff700 1 -- 172.21.15.84:0/3427522579 shutdown_connections 2023-07-14T11:18:13.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.348+0000 7f466b3ff700 1 -- 172.21.15.84:0/3427522579 wait complete. 2023-07-14T11:18:13.368 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T11:13:00.125395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T11:13:06.803994+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T11:17:53.456029+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T11:17:54.724710+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T11:18:13.369 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T11:18:13.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.565+0000 7fc3215ff700 1 Processor -- start 2023-07-14T11:18:13.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.565+0000 7fc3215ff700 1 -- start start 2023-07-14T11:18:13.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.566+0000 7fc3215ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc31c15fd30 0x7fc31c0ae1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:13.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.566+0000 7fc3215ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc31c0ae730 0x7fc31c0cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:13.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.566+0000 7fc3215ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc31c0b21b0 con 0x7fc31c0cd6f0 2023-07-14T11:18:13.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.566+0000 7fc3215ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc31c06b930 con 0x7fc31c15fd30 2023-07-14T11:18:13.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.566+0000 7fc3215ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc31c0cdb70 con 0x7fc31c0ae730 2023-07-14T11:18:13.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.567+0000 7fc31affd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc31c15fd30 0x7fc31c0ae1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:13.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.567+0000 7fc31affd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc31c15fd30 0x7fc31c0ae1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37784/0 (socket says 172.21.15.84:37784) 2023-07-14T11:18:13.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.567+0000 7fc31affd700 1 -- 172.21.15.84:0/999359684 learned_addr learned my addr 172.21.15.84:0/999359684 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:13.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.567+0000 7fc31b7fe700 1 --1- 172.21.15.84:0/999359684 >> v1:172.21.15.84:6789/0 conn(0x7fc31c0cd6f0 0x7fc31c1603d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:59796/0 (socket says 172.21.15.84:59796) 2023-07-14T11:18:13.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.567+0000 7fc31a7fc700 1 --2- 172.21.15.84:0/999359684 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc31c0ae730 0x7fc31c0cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:13.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.567+0000 7fc31affd700 1 -- 172.21.15.84:0/999359684 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc31c0ae730 msgr2=0x7fc31c0cd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:13.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.567+0000 7fc31affd700 1 --2- 172.21.15.84:0/999359684 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc31c0ae730 0x7fc31c0cd1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:13.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.567+0000 7fc31affd700 1 -- 172.21.15.84:0/999359684 >> v1:172.21.15.84:6789/0 conn(0x7fc31c0cd6f0 legacy=0x7fc31c1603d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:13.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.567+0000 7fc31affd700 1 -- 172.21.15.84:0/999359684 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc31c06ad20 con 0x7fc31c15fd30 2023-07-14T11:18:13.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.567+0000 7fc319ffb700 1 -- 172.21.15.84:0/999359684 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2984550971 0 0) 0x7fc31c0b21b0 con 0x7fc31c0cd6f0 2023-07-14T11:18:13.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.567+0000 7fc31affd700 1 --2- 172.21.15.84:0/999359684 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc31c15fd30 0x7fc31c0ae1f0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fc30c0098f0 tx=0x7fc30c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53a6c2ec03f4789f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:13.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.568+0000 7fc319ffb700 1 -- 172.21.15.84:0/999359684 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30c00b8a0 con 0x7fc31c15fd30 2023-07-14T11:18:13.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.568+0000 7fc319ffb700 1 -- 172.21.15.84:0/999359684 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc30c00ba00 con 0x7fc31c15fd30 2023-07-14T11:18:13.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.568+0000 7fc319ffb700 1 -- 172.21.15.84:0/999359684 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30c00bd90 con 0x7fc31c15fd30 2023-07-14T11:18:13.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.568+0000 7fc3215ff700 1 -- 172.21.15.84:0/999359684 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc31c15fd30 msgr2=0x7fc31c0ae1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:13.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.568+0000 7fc3215ff700 1 --2- 172.21.15.84:0/999359684 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc31c15fd30 0x7fc31c0ae1f0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fc30c0098f0 tx=0x7fc30c009c00 comp rx=0 tx=0).stop 2023-07-14T11:18:13.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.568+0000 7fc3215ff700 1 -- 172.21.15.84:0/999359684 shutdown_connections 2023-07-14T11:18:13.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.568+0000 7fc3215ff700 1 --2- 172.21.15.84:0/999359684 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc31c15fd30 0x7fc31c0ae1f0 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:13.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.568+0000 7fc3215ff700 1 --2- 172.21.15.84:0/999359684 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc31c0ae730 0x7fc31c0cd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:13.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.568+0000 7fc3215ff700 1 -- 172.21.15.84:0/999359684 >> 172.21.15.84:0/999359684 conn(0x7fc31c0cc990 msgr2=0x7fc31c0cf2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:13.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.568+0000 7fc3215ff700 1 -- 172.21.15.84:0/999359684 shutdown_connections 2023-07-14T11:18:13.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.568+0000 7fc3215ff700 1 -- 172.21.15.84:0/999359684 wait complete. 2023-07-14T11:18:13.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.570+0000 7fc3215ff700 1 Processor -- start 2023-07-14T11:18:13.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.570+0000 7fc3215ff700 1 -- start start 2023-07-14T11:18:13.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.571+0000 7fc3215ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc31c0ae730 0x7fc31c1f1b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:13.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.571+0000 7fc3215ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc31c0cd6f0 0x7fc31c09a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:13.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.571+0000 7fc3215ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc31c15fd30 0x7fc31c071000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:13.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.571+0000 7fc3215ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc31c09ae10 con 0x7fc31c0ae730 2023-07-14T11:18:13.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.571+0000 7fc3215ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc31c1f2080 con 0x7fc31c15fd30 2023-07-14T11:18:13.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.571+0000 7fc3215ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc31c09a8b0 con 0x7fc31c0cd6f0 2023-07-14T11:18:13.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.571+0000 7fc31affd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc31c0ae730 0x7fc31c1f1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:13.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.571+0000 7fc31affd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc31c0ae730 0x7fc31c1f1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37796/0 (socket says 172.21.15.84:37796) 2023-07-14T11:18:13.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.571+0000 7fc31affd700 1 -- 172.21.15.84:0/3090383770 learned_addr learned my addr 172.21.15.84:0/3090383770 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:13.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.572+0000 7fc31a7fc700 1 --2- 172.21.15.84:0/3090383770 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc31c0cd6f0 0x7fc31c09a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:13.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.572+0000 7fc31b7fe700 1 --2- 172.21.15.84:0/3090383770 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc31c15fd30 0x7fc31c071000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:13.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.572+0000 7fc31affd700 1 -- 172.21.15.84:0/3090383770 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc31c0cd6f0 msgr2=0x7fc31c09a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:13.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.572+0000 7fc31affd700 1 --2- 172.21.15.84:0/3090383770 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc31c0cd6f0 0x7fc31c09a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:13.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.572+0000 7fc31affd700 1 -- 172.21.15.84:0/3090383770 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc31c15fd30 msgr2=0x7fc31c071000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:13.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.572+0000 7fc31affd700 1 --2- 172.21.15.84:0/3090383770 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc31c15fd30 0x7fc31c071000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:13.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.572+0000 7fc31affd700 1 -- 172.21.15.84:0/3090383770 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc30c009550 con 0x7fc31c0ae730 2023-07-14T11:18:13.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.572+0000 7fc31b7fe700 1 --2- 172.21.15.84:0/3090383770 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc31c15fd30 0x7fc31c071000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:18:13.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.572+0000 7fc31affd700 1 --2- 172.21.15.84:0/3090383770 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc31c0ae730 0x7fc31c1f1b40 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fc31c0b1ea0 tx=0x7fc30c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:13.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.572+0000 7fc3037fe700 1 -- 172.21.15.84:0/3090383770 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30c004380 con 0x7fc31c0ae730 2023-07-14T11:18:13.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.572+0000 7fc3037fe700 1 -- 172.21.15.84:0/3090383770 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc30c01f070 con 0x7fc31c0ae730 2023-07-14T11:18:13.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.572+0000 7fc3037fe700 1 -- 172.21.15.84:0/3090383770 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30c0036a0 con 0x7fc31c0ae730 2023-07-14T11:18:13.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.572+0000 7fc3215ff700 1 -- 172.21.15.84:0/3090383770 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc31c09ab30 con 0x7fc31c0ae730 2023-07-14T11:18:13.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.572+0000 7fc3215ff700 1 -- 172.21.15.84:0/3090383770 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc31c15bb10 con 0x7fc31c0ae730 2023-07-14T11:18:13.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.573+0000 7fc3215ff700 1 -- 172.21.15.84:0/3090383770 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc31c0cbb30 con 0x7fc31c0ae730 2023-07-14T11:18:13.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.574+0000 7fc3037fe700 1 -- 172.21.15.84:0/3090383770 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7fc30c021030 con 0x7fc31c0ae730 2023-07-14T11:18:13.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.575+0000 7fc3037fe700 1 --2- 172.21.15.84:0/3090383770 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc30806b040 0x7fc30806d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:13.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.575+0000 7fc3037fe700 1 -- 172.21.15.84:0/3090383770 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc30c08ad60 con 0x7fc31c0ae730 2023-07-14T11:18:13.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.575+0000 7fc31a7fc700 1 --2- 172.21.15.84:0/3090383770 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc30806b040 0x7fc30806d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:13.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.576+0000 7fc31a7fc700 1 --2- 172.21.15.84:0/3090383770 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc30806b040 0x7fc30806d4f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fc31c0b3a40 tx=0x7fc310008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:13.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.580+0000 7fc3037fe700 1 -- 172.21.15.84:0/3090383770 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fc30c055a50 con 0x7fc31c0ae730 2023-07-14T11:18:13.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.770+0000 7fc3215ff700 1 -- 172.21.15.84:0/3090383770 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc31c15b690 con 0x7fc31c0ae730 2023-07-14T11:18:13.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.770+0000 7fc3037fe700 1 -- 172.21.15.84:0/3090383770 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc31c15b690 con 0x7fc31c0ae730 2023-07-14T11:18:13.773 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-07-14T11:18:13.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.772+0000 7fc3215ff700 1 -- 172.21.15.84:0/3090383770 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc30806b040 msgr2=0x7fc30806d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:13.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.772+0000 7fc3215ff700 1 --2- 172.21.15.84:0/3090383770 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc30806b040 0x7fc30806d4f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fc31c0b3a40 tx=0x7fc310008040 comp rx=0 tx=0).stop 2023-07-14T11:18:13.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.772+0000 7fc3215ff700 1 -- 172.21.15.84:0/3090383770 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc31c0ae730 msgr2=0x7fc31c1f1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:13.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.772+0000 7fc3215ff700 1 --2- 172.21.15.84:0/3090383770 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc31c0ae730 0x7fc31c1f1b40 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fc31c0b1ea0 tx=0x7fc30c004750 comp rx=0 tx=0).stop 2023-07-14T11:18:13.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.773+0000 7fc3215ff700 1 -- 172.21.15.84:0/3090383770 shutdown_connections 2023-07-14T11:18:13.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.773+0000 7fc3215ff700 1 --2- 172.21.15.84:0/3090383770 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc31c15fd30 0x7fc31c071000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:13.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.773+0000 7fc3215ff700 1 --2- 172.21.15.84:0/3090383770 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc31c0ae730 0x7fc31c1f1b40 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:13.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.773+0000 7fc3215ff700 1 --2- 172.21.15.84:0/3090383770 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fc30806b040 0x7fc30806d4f0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:13.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.773+0000 7fc3215ff700 1 --2- 172.21.15.84:0/3090383770 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc31c0cd6f0 0x7fc31c09a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:13.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.773+0000 7fc3215ff700 1 -- 172.21.15.84:0/3090383770 >> 172.21.15.84:0/3090383770 conn(0x7fc31c0cc990 msgr2=0x7fc31c06c110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:13.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.773+0000 7fc3215ff700 1 -- 172.21.15.84:0/3090383770 shutdown_connections 2023-07-14T11:18:13.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.773+0000 7fc3215ff700 1 -- 172.21.15.84:0/3090383770 wait complete. 2023-07-14T11:18:13.793 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T11:18:13.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.991+0000 7ffb0bfff700 1 Processor -- start 2023-07-14T11:18:13.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.991+0000 7ffb0bfff700 1 -- start start 2023-07-14T11:18:13.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.992+0000 7ffb0bfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ffb040c92d0 0x7ffb040ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:13.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.992+0000 7ffb0bfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb040b12f0 0x7ffb040c96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:13.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.992+0000 7ffb0bfff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ffb040adea0 0x7ffb0406c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:13.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.992+0000 7ffb0bfff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb0415da60 con 0x7ffb040c92d0 2023-07-14T11:18:13.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.993+0000 7ffb0bfff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb0415ce70 con 0x7ffb040adea0 2023-07-14T11:18:13.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.993+0000 7ffb0bfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb040c9be0 con 0x7ffb040b12f0 2023-07-14T11:18:13.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.993+0000 7ffb09d9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ffb040c92d0 0x7ffb040ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:13.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.993+0000 7ffb09d9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ffb040c92d0 0x7ffb040ad8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37800/0 (socket says 172.21.15.84:37800) 2023-07-14T11:18:13.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.993+0000 7ffb09d9b700 1 -- 172.21.15.84:0/1589103799 learned_addr learned my addr 172.21.15.84:0/1589103799 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:13.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.993+0000 7ffb0959a700 1 --2- 172.21.15.84:0/1589103799 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb040b12f0 0x7ffb040c96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:13.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.993+0000 7ffb0a59c700 1 --2- 172.21.15.84:0/1589103799 >> v2:172.21.15.179:3300/0 conn(0x7ffb040adea0 0x7ffb0406c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:13.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.993+0000 7ffb09d9b700 1 -- 172.21.15.84:0/1589103799 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb040b12f0 msgr2=0x7ffb040c96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:13.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.993+0000 7ffb09d9b700 1 --2- 172.21.15.84:0/1589103799 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb040b12f0 0x7ffb040c96a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:13.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.993+0000 7ffb09d9b700 1 -- 172.21.15.84:0/1589103799 >> v2:172.21.15.179:3300/0 conn(0x7ffb040adea0 msgr2=0x7ffb0406c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:13.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.993+0000 7ffb09d9b700 1 --2- 172.21.15.84:0/1589103799 >> v2:172.21.15.179:3300/0 conn(0x7ffb040adea0 0x7ffb0406c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:13.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.993+0000 7ffb09d9b700 1 -- 172.21.15.84:0/1589103799 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb0415d0c0 con 0x7ffb040c92d0 2023-07-14T11:18:13.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.993+0000 7ffb0a59c700 1 --2- 172.21.15.84:0/1589103799 >> v2:172.21.15.179:3300/0 conn(0x7ffb040adea0 0x7ffb0406c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:18:13.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.993+0000 7ffb0959a700 1 --2- 172.21.15.84:0/1589103799 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb040b12f0 0x7ffb040c96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:18:13.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.994+0000 7ffb09d9b700 1 --2- 172.21.15.84:0/1589103799 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb040c92d0 0x7ffb040ad8f0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7ffb0406f5e0 tx=0x7ffb0000be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7e58b58feac92bb server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:13.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.994+0000 7ffb08d99700 1 -- 172.21.15.84:0/1589103799 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0000dd30 con 0x7ffb040c92d0 2023-07-14T11:18:13.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.994+0000 7ffb08d99700 1 -- 172.21.15.84:0/1589103799 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb0000de90 con 0x7ffb040c92d0 2023-07-14T11:18:13.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.994+0000 7ffb08d99700 1 -- 172.21.15.84:0/1589103799 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb00010690 con 0x7ffb040c92d0 2023-07-14T11:18:14.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.994+0000 7ffb0bfff700 1 -- 172.21.15.84:0/1589103799 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb040c92d0 msgr2=0x7ffb040ad8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:14.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.994+0000 7ffb0bfff700 1 --2- 172.21.15.84:0/1589103799 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb040c92d0 0x7ffb040ad8f0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7ffb0406f5e0 tx=0x7ffb0000be70 comp rx=0 tx=0).stop 2023-07-14T11:18:14.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.994+0000 7ffb0bfff700 1 -- 172.21.15.84:0/1589103799 shutdown_connections 2023-07-14T11:18:14.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.994+0000 7ffb0bfff700 1 --2- 172.21.15.84:0/1589103799 >> v2:172.21.15.179:3300/0 conn(0x7ffb040adea0 0x7ffb0406c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:14.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.994+0000 7ffb0bfff700 1 --2- 172.21.15.84:0/1589103799 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb040c92d0 0x7ffb040ad8f0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:14.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.994+0000 7ffb0bfff700 1 --2- 172.21.15.84:0/1589103799 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb040b12f0 0x7ffb040c96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:14.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.994+0000 7ffb0bfff700 1 -- 172.21.15.84:0/1589103799 >> 172.21.15.84:0/1589103799 conn(0x7ffb040b05d0 msgr2=0x7ffb040b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:14.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.995+0000 7ffb0bfff700 1 -- 172.21.15.84:0/1589103799 shutdown_connections 2023-07-14T11:18:14.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.995+0000 7ffb0bfff700 1 -- 172.21.15.84:0/1589103799 wait complete. 2023-07-14T11:18:14.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.997+0000 7ffb0bfff700 1 Processor -- start 2023-07-14T11:18:14.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.997+0000 7ffb0bfff700 1 -- start start 2023-07-14T11:18:14.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.998+0000 7ffb0bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb040adea0 0x7ffb040c4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:14.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.998+0000 7ffb0bfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb040b12f0 0x7ffb041448e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:14.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.998+0000 7ffb0bfff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb040c92d0 0x7ffb0406f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:14.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.998+0000 7ffb0bfff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb040c4e90 con 0x7ffb040adea0 2023-07-14T11:18:14.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.998+0000 7ffb0bfff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb041545b0 con 0x7ffb040c92d0 2023-07-14T11:18:14.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.998+0000 7ffb0bfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb04154850 con 0x7ffb040b12f0 2023-07-14T11:18:14.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.999+0000 7ffb09d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb040adea0 0x7ffb040c4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:14.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.999+0000 7ffb09d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb040adea0 0x7ffb040c4950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37802/0 (socket says 172.21.15.84:37802) 2023-07-14T11:18:14.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.999+0000 7ffb09d9b700 1 -- 172.21.15.84:0/1622443364 learned_addr learned my addr 172.21.15.84:0/1622443364 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:14.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.999+0000 7ffb0959a700 1 --2- 172.21.15.84:0/1622443364 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb040b12f0 0x7ffb041448e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:14.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.999+0000 7ffb09d9b700 1 -- 172.21.15.84:0/1622443364 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb040b12f0 msgr2=0x7ffb041448e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:14.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.999+0000 7ffb0a59c700 1 --2- 172.21.15.84:0/1622443364 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb040c92d0 0x7ffb0406f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:14.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.999+0000 7ffb09d9b700 1 --2- 172.21.15.84:0/1622443364 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb040b12f0 0x7ffb041448e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:14.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.999+0000 7ffb09d9b700 1 -- 172.21.15.84:0/1622443364 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb040c92d0 msgr2=0x7ffb0406f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:14.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.999+0000 7ffb09d9b700 1 --2- 172.21.15.84:0/1622443364 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb040c92d0 0x7ffb0406f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:14.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.999+0000 7ffb09d9b700 1 -- 172.21.15.84:0/1622443364 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb0000b7f0 con 0x7ffb040adea0 2023-07-14T11:18:14.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.999+0000 7ffb0959a700 1 --2- 172.21.15.84:0/1622443364 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb040b12f0 0x7ffb041448e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:18:14.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.999+0000 7ffb0a59c700 1 --2- 172.21.15.84:0/1622443364 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb040c92d0 0x7ffb0406f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:18:14.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.999+0000 7ffb09d9b700 1 --2- 172.21.15.84:0/1622443364 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb040adea0 0x7ffb040c4950 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7ffb0000beb0 tx=0x7ffb00004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:14.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.999+0000 7ffafa7fc700 1 -- 172.21.15.84:0/1622443364 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb00003da0 con 0x7ffb040adea0 2023-07-14T11:18:14.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.999+0000 7ffafa7fc700 1 -- 172.21.15.84:0/1622443364 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb00010470 con 0x7ffb040adea0 2023-07-14T11:18:14.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.999+0000 7ffafa7fc700 1 -- 172.21.15.84:0/1622443364 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb00010820 con 0x7ffb040adea0 2023-07-14T11:18:14.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:13.999+0000 7ffb0bfff700 1 -- 172.21.15.84:0/1622443364 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb04153110 con 0x7ffb040adea0 2023-07-14T11:18:14.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.000+0000 7ffb0bfff700 1 -- 172.21.15.84:0/1622443364 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb04152e30 con 0x7ffb040adea0 2023-07-14T11:18:14.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.001+0000 7ffb0bfff700 1 -- 172.21.15.84:0/1622443364 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb041571e0 con 0x7ffb040adea0 2023-07-14T11:18:14.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.002+0000 7ffafa7fc700 1 -- 172.21.15.84:0/1622443364 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7ffb00019400 con 0x7ffb040adea0 2023-07-14T11:18:14.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.003+0000 7ffafa7fc700 1 --2- 172.21.15.84:0/1622443364 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ffae806b040 0x7ffae806d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:14.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.003+0000 7ffafa7fc700 1 -- 172.21.15.84:0/1622443364 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ffb0008b680 con 0x7ffb040adea0 2023-07-14T11:18:14.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.003+0000 7ffb0959a700 1 --2- 172.21.15.84:0/1622443364 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ffae806b040 0x7ffae806d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:14.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.003+0000 7ffb0959a700 1 --2- 172.21.15.84:0/1622443364 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ffae806b040 0x7ffae806d4f0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7ffb0415cca0 tx=0x7ffaf4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:14.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.006+0000 7ffafa7fc700 1 -- 172.21.15.84:0/1622443364 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ffb000562e0 con 0x7ffb040adea0 2023-07-14T11:18:14.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.201+0000 7ffb0bfff700 1 -- 172.21.15.84:0/1622443364 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ffb0415d680 con 0x7ffb040adea0 2023-07-14T11:18:14.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.202+0000 7ffafa7fc700 1 -- 172.21.15.84:0/1622443364 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v75) v1 ==== 92+0+10 (secure 0 0 0) 0x7ffb00059900 con 0x7ffb040adea0 2023-07-14T11:18:14.205 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-07-14T11:18:14.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.204+0000 7ffb0bfff700 1 -- 172.21.15.84:0/1622443364 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ffae806b040 msgr2=0x7ffae806d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:14.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.204+0000 7ffb0bfff700 1 --2- 172.21.15.84:0/1622443364 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ffae806b040 0x7ffae806d4f0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7ffb0415cca0 tx=0x7ffaf4008040 comp rx=0 tx=0).stop 2023-07-14T11:18:14.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.204+0000 7ffb0bfff700 1 -- 172.21.15.84:0/1622443364 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb040adea0 msgr2=0x7ffb040c4950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:14.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.204+0000 7ffb0bfff700 1 --2- 172.21.15.84:0/1622443364 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb040adea0 0x7ffb040c4950 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7ffb0000beb0 tx=0x7ffb00004750 comp rx=0 tx=0).stop 2023-07-14T11:18:14.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.204+0000 7ffb0bfff700 1 -- 172.21.15.84:0/1622443364 shutdown_connections 2023-07-14T11:18:14.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.204+0000 7ffb0bfff700 1 --2- 172.21.15.84:0/1622443364 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb040c92d0 0x7ffb0406f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:14.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.204+0000 7ffb0bfff700 1 --2- 172.21.15.84:0/1622443364 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb040adea0 0x7ffb040c4950 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:14.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.204+0000 7ffb0bfff700 1 --2- 172.21.15.84:0/1622443364 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7ffae806b040 0x7ffae806d4f0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:14.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.204+0000 7ffb0bfff700 1 --2- 172.21.15.84:0/1622443364 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb040b12f0 0x7ffb041448e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:14.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.204+0000 7ffb0bfff700 1 -- 172.21.15.84:0/1622443364 >> 172.21.15.84:0/1622443364 conn(0x7ffb040b05d0 msgr2=0x7ffb040cb2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:14.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.204+0000 7ffb0bfff700 1 -- 172.21.15.84:0/1622443364 shutdown_connections 2023-07-14T11:18:14.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.204+0000 7ffb0bfff700 1 -- 172.21.15.84:0/1622443364 wait complete. 2023-07-14T11:18:14.225 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T11:18:14.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.421+0000 7f3409bff700 1 Processor -- start 2023-07-14T11:18:14.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.422+0000 7f3409bff700 1 -- start start 2023-07-14T11:18:14.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.423+0000 7f3409bff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f34040b8a60 0x7f34040b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:14.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.423+0000 7f3409bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34040b4530 0x7f34040d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:14.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.423+0000 7f3409bff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34040b8e30 con 0x7f34040d1050 2023-07-14T11:18:14.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.423+0000 7f3409bff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34040d14d0 con 0x7f34040b8a60 2023-07-14T11:18:14.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.423+0000 7f3409bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34040b1e30 con 0x7f34040b4530 2023-07-14T11:18:14.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.424+0000 7f33fbfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34040b4530 0x7f34040d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:14.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.424+0000 7f33fbfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34040b4530 0x7f34040d0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.84:45600/0 (socket says 172.21.15.84:45600) 2023-07-14T11:18:14.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.424+0000 7f33fbfff700 1 -- 172.21.15.84:0/7700056 learned_addr learned my addr 172.21.15.84:0/7700056 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:14.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.424+0000 7f34037fe700 1 --2- 172.21.15.84:0/7700056 >> v2:172.21.15.179:3300/0 conn(0x7f34040b8a60 0x7f34040b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:14.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.424+0000 7f33fbfff700 1 -- 172.21.15.84:0/7700056 >> v2:172.21.15.179:3300/0 conn(0x7f34040b8a60 msgr2=0x7f34040b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:14.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.424+0000 7f33fbfff700 1 --2- 172.21.15.84:0/7700056 >> v2:172.21.15.179:3300/0 conn(0x7f34040b8a60 0x7f34040b3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:14.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.424+0000 7f33fbfff700 1 -- 172.21.15.84:0/7700056 >> v1:172.21.15.179:6789/0 conn(0x7f34040d1050 legacy=0x7f34040b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:14.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.424+0000 7f33fbfff700 1 -- 172.21.15.84:0/7700056 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34040afaa0 con 0x7f34040b4530 2023-07-14T11:18:14.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.424+0000 7f3402ffd700 1 -- 172.21.15.84:0/7700056 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1000108779 0 0) 0x7f34040b8e30 con 0x7f34040d1050 2023-07-14T11:18:14.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.425+0000 7f33fbfff700 1 --2- 172.21.15.84:0/7700056 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34040b4530 0x7f34040d0b10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f33ec0098f0 tx=0x7f33ec009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f4190a635f975c1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:14.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.425+0000 7f3402ffd700 1 -- 172.21.15.84:0/7700056 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ec011830 con 0x7f34040b4530 2023-07-14T11:18:14.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.425+0000 7f3402ffd700 1 -- 172.21.15.84:0/7700056 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33ec011990 con 0x7f34040b4530 2023-07-14T11:18:14.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.425+0000 7f3402ffd700 1 -- 172.21.15.84:0/7700056 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ec011d20 con 0x7f34040b4530 2023-07-14T11:18:14.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.425+0000 7f3409bff700 1 -- 172.21.15.84:0/7700056 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34040b4530 msgr2=0x7f34040d0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:14.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.425+0000 7f3409bff700 1 --2- 172.21.15.84:0/7700056 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34040b4530 0x7f34040d0b10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f33ec0098f0 tx=0x7f33ec009c00 comp rx=0 tx=0).stop 2023-07-14T11:18:14.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.425+0000 7f3409bff700 1 -- 172.21.15.84:0/7700056 shutdown_connections 2023-07-14T11:18:14.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.425+0000 7f3409bff700 1 --2- 172.21.15.84:0/7700056 >> v2:172.21.15.179:3300/0 conn(0x7f34040b8a60 0x7f34040b3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:14.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.425+0000 7f3409bff700 1 --2- 172.21.15.84:0/7700056 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34040b4530 0x7f34040d0b10 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:14.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.425+0000 7f3409bff700 1 -- 172.21.15.84:0/7700056 >> 172.21.15.84:0/7700056 conn(0x7f340409c1b0 msgr2=0x7f34040d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:14.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.425+0000 7f3409bff700 1 -- 172.21.15.84:0/7700056 shutdown_connections 2023-07-14T11:18:14.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.425+0000 7f3409bff700 1 -- 172.21.15.84:0/7700056 wait complete. 2023-07-14T11:18:14.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.427+0000 7f3409bff700 1 Processor -- start 2023-07-14T11:18:14.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.427+0000 7f3409bff700 1 -- start start 2023-07-14T11:18:14.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.428+0000 7f3409bff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34040b4530 0x7f3404152190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:14.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.428+0000 7f3409bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34040b8a60 0x7f34040ce6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:14.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.428+0000 7f3409bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34040d1050 0x7f34040cebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:14.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.428+0000 7f3409bff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f340415cdb0 con 0x7f34040b4530 2023-07-14T11:18:14.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.428+0000 7f3409bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f340415d090 con 0x7f34040b8a60 2023-07-14T11:18:14.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.428+0000 7f3409bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f340415d370 con 0x7f34040d1050 2023-07-14T11:18:14.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.428+0000 7f34037fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34040b4530 0x7f3404152190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:14.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.428+0000 7f34037fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34040b4530 0x7f3404152190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37814/0 (socket says 172.21.15.84:37814) 2023-07-14T11:18:14.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.429+0000 7f34037fe700 1 -- 172.21.15.84:0/1649554912 learned_addr learned my addr 172.21.15.84:0/1649554912 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:14.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.429+0000 7f33fbfff700 1 --2- 172.21.15.84:0/1649554912 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34040b8a60 0x7f34040ce6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:14.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.429+0000 7f3403fff700 1 --2- 172.21.15.84:0/1649554912 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34040d1050 0x7f34040cebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:14.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.429+0000 7f34037fe700 1 -- 172.21.15.84:0/1649554912 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34040d1050 msgr2=0x7f34040cebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:14.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.429+0000 7f34037fe700 1 --2- 172.21.15.84:0/1649554912 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34040d1050 0x7f34040cebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:14.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.429+0000 7f34037fe700 1 -- 172.21.15.84:0/1649554912 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34040b8a60 msgr2=0x7f34040ce6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:14.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.429+0000 7f34037fe700 1 --2- 172.21.15.84:0/1649554912 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34040b8a60 0x7f34040ce6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:14.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.429+0000 7f34037fe700 1 -- 172.21.15.84:0/1649554912 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33ec009550 con 0x7f34040b4530 2023-07-14T11:18:14.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.429+0000 7f33fbfff700 1 --2- 172.21.15.84:0/1649554912 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34040b8a60 0x7f34040ce6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:18:14.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.429+0000 7f34037fe700 1 --2- 172.21.15.84:0/1649554912 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34040b4530 0x7f3404152190 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f33f400e9d0 tx=0x7f33f400ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:14.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.429+0000 7f3400ff9700 1 -- 172.21.15.84:0/1649554912 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f4009730 con 0x7f34040b4530 2023-07-14T11:18:14.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.430+0000 7f3400ff9700 1 -- 172.21.15.84:0/1649554912 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33f400c850 con 0x7f34040b4530 2023-07-14T11:18:14.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.430+0000 7f3400ff9700 1 -- 172.21.15.84:0/1649554912 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f400cbe0 con 0x7f34040b4530 2023-07-14T11:18:14.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.430+0000 7f3409bff700 1 -- 172.21.15.84:0/1649554912 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f340415d650 con 0x7f34040b4530 2023-07-14T11:18:14.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.430+0000 7f3409bff700 1 -- 172.21.15.84:0/1649554912 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f340415dc10 con 0x7f34040b4530 2023-07-14T11:18:14.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.431+0000 7f3409bff700 1 -- 172.21.15.84:0/1649554912 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3404074350 con 0x7f34040b4530 2023-07-14T11:18:14.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.432+0000 7f3400ff9700 1 -- 172.21.15.84:0/1649554912 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7f33f400cd40 con 0x7f34040b4530 2023-07-14T11:18:14.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.432+0000 7f3400ff9700 1 --2- 172.21.15.84:0/1649554912 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f33e406b040 0x7f33e406d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:14.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.433+0000 7f3400ff9700 1 -- 172.21.15.84:0/1649554912 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f33f4089b80 con 0x7f34040b4530 2023-07-14T11:18:14.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.433+0000 7f33fbfff700 1 --2- 172.21.15.84:0/1649554912 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f33e406b040 0x7f33e406d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:14.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.433+0000 7f33fbfff700 1 --2- 172.21.15.84:0/1649554912 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f33e406b040 0x7f33e406d4f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f33ec000c00 tx=0x7f33ec008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:14.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.437+0000 7f3400ff9700 1 -- 172.21.15.84:0/1649554912 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f33f4058270 con 0x7f34040b4530 2023-07-14T11:18:14.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.630+0000 7f3409bff700 1 -- 172.21.15.84:0/1649554912 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f34040d1ff0 con 0x7f34040b4530 2023-07-14T11:18:14.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.631+0000 7f3400ff9700 1 -- 172.21.15.84:0/1649554912 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v75) v1 ==== 104+0+11 (secure 0 0 0) 0x7f33f4057e00 con 0x7f34040b4530 2023-07-14T11:18:14.634 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-07-14T11:18:14.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.633+0000 7f3409bff700 1 -- 172.21.15.84:0/1649554912 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f33e406b040 msgr2=0x7f33e406d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:14.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.633+0000 7f3409bff700 1 --2- 172.21.15.84:0/1649554912 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f33e406b040 0x7f33e406d4f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f33ec000c00 tx=0x7f33ec008030 comp rx=0 tx=0).stop 2023-07-14T11:18:14.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.633+0000 7f3409bff700 1 -- 172.21.15.84:0/1649554912 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34040b4530 msgr2=0x7f3404152190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:14.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.633+0000 7f3409bff700 1 --2- 172.21.15.84:0/1649554912 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34040b4530 0x7f3404152190 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f33f400e9d0 tx=0x7f33f400ed90 comp rx=0 tx=0).stop 2023-07-14T11:18:14.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.633+0000 7f3409bff700 1 -- 172.21.15.84:0/1649554912 shutdown_connections 2023-07-14T11:18:14.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.633+0000 7f3409bff700 1 --2- 172.21.15.84:0/1649554912 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f33e406b040 0x7f33e406d4f0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:14.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.633+0000 7f3409bff700 1 --2- 172.21.15.84:0/1649554912 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34040d1050 0x7f34040cebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:14.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.633+0000 7f3409bff700 1 --2- 172.21.15.84:0/1649554912 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34040b4530 0x7f3404152190 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:14.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.633+0000 7f3409bff700 1 --2- 172.21.15.84:0/1649554912 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34040b8a60 0x7f34040ce6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:14.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.633+0000 7f3409bff700 1 -- 172.21.15.84:0/1649554912 >> 172.21.15.84:0/1649554912 conn(0x7f340409c1b0 msgr2=0x7f34040c96a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:14.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.633+0000 7f3409bff700 1 -- 172.21.15.84:0/1649554912 shutdown_connections 2023-07-14T11:18:14.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.633+0000 7f3409bff700 1 -- 172.21.15.84:0/1649554912 wait complete. 2023-07-14T11:18:14.654 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T11:18:14.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.849+0000 7f0021bff700 1 Processor -- start 2023-07-14T11:18:14.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.849+0000 7f0021bff700 1 -- start start 2023-07-14T11:18:14.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.850+0000 7f0021bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f001c0b8660 0x7f001c0cd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:14.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.850+0000 7f0021bff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f001c0cd970 0x7f001c0b4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:14.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.850+0000 7f0021bff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f001c0d02a0 con 0x7f001c0b4da0 2023-07-14T11:18:14.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.850+0000 7f0021bff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f001c0b51c0 con 0x7f001c0cd970 2023-07-14T11:18:14.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.850+0000 7f0021bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f001c0cfce0 con 0x7f001c0b8660 2023-07-14T11:18:14.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.851+0000 7f001bfff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f001c0b4da0 0x7f001c1601f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:59812/0 (socket says 172.21.15.84:59812) 2023-07-14T11:18:14.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.851+0000 7f001bfff700 1 -- 172.21.15.84:0/3873248576 learned_addr learned my addr 172.21.15.84:0/3873248576 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:18:14.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.851+0000 7f001b7fe700 1 --2- 172.21.15.84:0/3873248576 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f001c0b8660 0x7f001c0cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:14.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.851+0000 7f001affd700 1 --2- 172.21.15.84:0/3873248576 >> v2:172.21.15.179:3300/0 conn(0x7f001c0cd970 0x7f001c0b4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:14.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.851+0000 7f001a7fc700 1 -- 172.21.15.84:0/3873248576 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3540190351 0 0) 0x7f001c0d02a0 con 0x7f001c0b4da0 2023-07-14T11:18:14.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.851+0000 7f001a7fc700 1 -- 172.21.15.84:0/3873248576 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00040035b0 con 0x7f001c0b4da0 2023-07-14T11:18:14.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.851+0000 7f001b7fe700 1 -- 172.21.15.84:0/3873248576 >> v2:172.21.15.179:3300/0 conn(0x7f001c0cd970 msgr2=0x7f001c0b4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:14.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.851+0000 7f001b7fe700 1 --2- 172.21.15.84:0/3873248576 >> v2:172.21.15.179:3300/0 conn(0x7f001c0cd970 0x7f001c0b4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:14.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.851+0000 7f001b7fe700 1 -- 172.21.15.84:0/3873248576 >> v1:172.21.15.84:6789/0 conn(0x7f001c0b4da0 legacy=0x7f001c1601f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:14.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.851+0000 7f001b7fe700 1 -- 172.21.15.84:0/3873248576 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f001c0cffc0 con 0x7f001c0b8660 2023-07-14T11:18:14.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.851+0000 7f001b7fe700 1 --2- 172.21.15.84:0/3873248576 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f001c0b8660 0x7f001c0cd430 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f000c009840 tx=0x7f000c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e3e85c37c877ec0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:14.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.852+0000 7f001a7fc700 1 -- 172.21.15.84:0/3873248576 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f000c011830 con 0x7f001c0b8660 2023-07-14T11:18:14.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.852+0000 7f001a7fc700 1 -- 172.21.15.84:0/3873248576 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f000c011990 con 0x7f001c0b8660 2023-07-14T11:18:14.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.852+0000 7f001a7fc700 1 -- 172.21.15.84:0/3873248576 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f000c011d20 con 0x7f001c0b8660 2023-07-14T11:18:14.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.852+0000 7f0021bff700 1 -- 172.21.15.84:0/3873248576 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f001c0b8660 msgr2=0x7f001c0cd430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:14.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.852+0000 7f0021bff700 1 --2- 172.21.15.84:0/3873248576 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f001c0b8660 0x7f001c0cd430 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f000c009840 tx=0x7f000c009b50 comp rx=0 tx=0).stop 2023-07-14T11:18:14.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.852+0000 7f0021bff700 1 -- 172.21.15.84:0/3873248576 shutdown_connections 2023-07-14T11:18:14.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.852+0000 7f0021bff700 1 --2- 172.21.15.84:0/3873248576 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f001c0b8660 0x7f001c0cd430 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:14.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.852+0000 7f0021bff700 1 --2- 172.21.15.84:0/3873248576 >> v2:172.21.15.179:3300/0 conn(0x7f001c0cd970 0x7f001c0b4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:14.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.852+0000 7f0021bff700 1 -- 172.21.15.84:0/3873248576 >> 172.21.15.84:0/3873248576 conn(0x7f001c066860 msgr2=0x7f001c06a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:14.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.852+0000 7f0021bff700 1 -- 172.21.15.84:0/3873248576 shutdown_connections 2023-07-14T11:18:14.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.852+0000 7f0021bff700 1 -- 172.21.15.84:0/3873248576 wait complete. 2023-07-14T11:18:14.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.854+0000 7f0021bff700 1 Processor -- start 2023-07-14T11:18:14.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.854+0000 7f0021bff700 1 -- start start 2023-07-14T11:18:14.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.855+0000 7f0021bff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f001c0b4da0 0x7f001c156bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:14.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.855+0000 7f0021bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f001c0b8660 0x7f001c158c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:14.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.855+0000 7f0021bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f001c0cd970 0x7f001c1f19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:14.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.855+0000 7f0021bff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f001c154a70 con 0x7f001c0b4da0 2023-07-14T11:18:14.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.855+0000 7f0021bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f001c155ab0 con 0x7f001c0cd970 2023-07-14T11:18:14.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.855+0000 7f0021bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f001c154cf0 con 0x7f001c0b8660 2023-07-14T11:18:14.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.855+0000 7f001b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f001c0b4da0 0x7f001c156bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:14.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.855+0000 7f001b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f001c0b4da0 0x7f001c156bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37816/0 (socket says 172.21.15.84:37816) 2023-07-14T11:18:14.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.855+0000 7f001b7fe700 1 -- 172.21.15.84:0/306381020 learned_addr learned my addr 172.21.15.84:0/306381020 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:14.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.856+0000 7f001affd700 1 --2- 172.21.15.84:0/306381020 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f001c0b8660 0x7f001c158c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:14.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.856+0000 7f001bfff700 1 --2- 172.21.15.84:0/306381020 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f001c0cd970 0x7f001c1f19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:14.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.856+0000 7f001b7fe700 1 -- 172.21.15.84:0/306381020 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f001c0b8660 msgr2=0x7f001c158c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:14.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.856+0000 7f001b7fe700 1 --2- 172.21.15.84:0/306381020 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f001c0b8660 0x7f001c158c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:14.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.856+0000 7f001b7fe700 1 -- 172.21.15.84:0/306381020 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f001c0cd970 msgr2=0x7f001c1f19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:14.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.856+0000 7f001b7fe700 1 --2- 172.21.15.84:0/306381020 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f001c0cd970 0x7f001c1f19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:14.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.856+0000 7f001b7fe700 1 -- 172.21.15.84:0/306381020 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f000c0094a0 con 0x7f001c0b4da0 2023-07-14T11:18:14.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.856+0000 7f001affd700 1 --2- 172.21.15.84:0/306381020 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f001c0b8660 0x7f001c158c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:18:14.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.856+0000 7f001b7fe700 1 --2- 172.21.15.84:0/306381020 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f001c0b4da0 0x7f001c156bc0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f000c0090b0 tx=0x7f000c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:14.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.856+0000 7f0003fff700 1 -- 172.21.15.84:0/306381020 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f000c0036a0 con 0x7f001c0b4da0 2023-07-14T11:18:14.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.856+0000 7f0003fff700 1 -- 172.21.15.84:0/306381020 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f000c01f070 con 0x7f001c0b4da0 2023-07-14T11:18:14.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.856+0000 7f0003fff700 1 -- 172.21.15.84:0/306381020 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f000c003a40 con 0x7f001c0b4da0 2023-07-14T11:18:14.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.856+0000 7f0021bff700 1 -- 172.21.15.84:0/306381020 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f001c154fd0 con 0x7f001c0b4da0 2023-07-14T11:18:14.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.857+0000 7f0021bff700 1 -- 172.21.15.84:0/306381020 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f001c155590 con 0x7f001c0b4da0 2023-07-14T11:18:14.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.858+0000 7f0021bff700 1 -- 172.21.15.84:0/306381020 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f001c1557d0 con 0x7f001c0b4da0 2023-07-14T11:18:14.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.861+0000 7f0003fff700 1 -- 172.21.15.84:0/306381020 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7f000c003ba0 con 0x7f001c0b4da0 2023-07-14T11:18:14.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.862+0000 7f0003fff700 1 --2- 172.21.15.84:0/306381020 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f000806b040 0x7f000806d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:14.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.862+0000 7f0003fff700 1 -- 172.21.15.84:0/306381020 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f000c021070 con 0x7f001c0b4da0 2023-07-14T11:18:14.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.862+0000 7f001affd700 1 --2- 172.21.15.84:0/306381020 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f000806b040 0x7f000806d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:14.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.863+0000 7f001affd700 1 --2- 172.21.15.84:0/306381020 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f000806b040 0x7f000806d4f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f001c14fb70 tx=0x7f0010008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:14.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:14.865+0000 7f0003fff700 1 -- 172.21.15.84:0/306381020 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f000c0562e0 con 0x7f001c0b4da0 2023-07-14T11:18:15.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.060+0000 7f0021bff700 1 -- 172.21.15.84:0/306381020 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f001c074350 con 0x7f001c0b4da0 2023-07-14T11:18:15.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.061+0000 7f0003fff700 1 -- 172.21.15.84:0/306381020 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v75) v1 ==== 100+0+11 (secure 0 0 0) 0x7f000c059900 con 0x7f001c0b4da0 2023-07-14T11:18:15.064 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-07-14T11:18:15.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.063+0000 7f0021bff700 1 -- 172.21.15.84:0/306381020 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f000806b040 msgr2=0x7f000806d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:15.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.063+0000 7f0021bff700 1 --2- 172.21.15.84:0/306381020 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f000806b040 0x7f000806d4f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f001c14fb70 tx=0x7f0010008040 comp rx=0 tx=0).stop 2023-07-14T11:18:15.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.063+0000 7f0021bff700 1 -- 172.21.15.84:0/306381020 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f001c0b4da0 msgr2=0x7f001c156bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:15.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.063+0000 7f0021bff700 1 --2- 172.21.15.84:0/306381020 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f001c0b4da0 0x7f001c156bc0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f000c0090b0 tx=0x7f000c004750 comp rx=0 tx=0).stop 2023-07-14T11:18:15.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.063+0000 7f0021bff700 1 -- 172.21.15.84:0/306381020 shutdown_connections 2023-07-14T11:18:15.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.063+0000 7f0021bff700 1 --2- 172.21.15.84:0/306381020 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f001c0cd970 0x7f001c1f19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:15.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.063+0000 7f0021bff700 1 --2- 172.21.15.84:0/306381020 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f001c0b4da0 0x7f001c156bc0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:15.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.063+0000 7f0021bff700 1 --2- 172.21.15.84:0/306381020 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f000806b040 0x7f000806d4f0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:15.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.063+0000 7f0021bff700 1 --2- 172.21.15.84:0/306381020 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f001c0b8660 0x7f001c158c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:15.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.063+0000 7f0021bff700 1 -- 172.21.15.84:0/306381020 >> 172.21.15.84:0/306381020 conn(0x7f001c066860 msgr2=0x7f001c0b2580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:15.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.063+0000 7f0021bff700 1 -- 172.21.15.84:0/306381020 shutdown_connections 2023-07-14T11:18:15.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.063+0000 7f0021bff700 1 -- 172.21.15.84:0/306381020 wait complete. 2023-07-14T11:18:15.084 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-14T11:18:15.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.278+0000 7f0812dff700 1 Processor -- start 2023-07-14T11:18:15.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.278+0000 7f0812dff700 1 -- start start 2023-07-14T11:18:15.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.279+0000 7f0812dff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f080c15d9d0 0x7f080c06b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:15.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.279+0000 7f0812dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f080c06c9f0 0x7f080c0b1910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:15.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.279+0000 7f0812dff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f080c06c4e0 con 0x7f080c0b1e50 2023-07-14T11:18:15.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.279+0000 7f0812dff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f080c15dda0 con 0x7f080c15d9d0 2023-07-14T11:18:15.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.279+0000 7f0812dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f080c06bf20 con 0x7f080c06c9f0 2023-07-14T11:18:15.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.279+0000 7f0810b9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f080c15d9d0 0x7f080c06b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:15.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.280+0000 7f0810b9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f080c15d9d0 0x7f080c06b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37826/0 (socket says 172.21.15.84:37826) 2023-07-14T11:18:15.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.280+0000 7f0810b9b700 1 -- 172.21.15.84:0/3529980458 learned_addr learned my addr 172.21.15.84:0/3529980458 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:15.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.280+0000 7f080bfff700 1 --2- 172.21.15.84:0/3529980458 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f080c06c9f0 0x7f080c0b1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:15.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.280+0000 7f0810b9b700 1 -- 172.21.15.84:0/3529980458 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f080c06c9f0 msgr2=0x7f080c0b1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:15.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.280+0000 7f0810b9b700 1 --2- 172.21.15.84:0/3529980458 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f080c06c9f0 0x7f080c0b1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:15.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.280+0000 7f0810b9b700 1 -- 172.21.15.84:0/3529980458 >> v1:172.21.15.179:6789/0 conn(0x7f080c0b1e50 legacy=0x7f080c071170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:15.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.280+0000 7f0810b9b700 1 -- 172.21.15.84:0/3529980458 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f080c06c200 con 0x7f080c15d9d0 2023-07-14T11:18:15.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.280+0000 7f0810b9b700 1 --2- 172.21.15.84:0/3529980458 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f080c15d9d0 0x7f080c06b5b0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f08000098f0 tx=0x7f0800009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60588e3caa63be0f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:15.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.280+0000 7f080b7fe700 1 -- 172.21.15.84:0/3529980458 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0800004230 con 0x7f080c15d9d0 2023-07-14T11:18:15.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.280+0000 7f080b7fe700 1 -- 172.21.15.84:0/3529980458 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0800004390 con 0x7f080c15d9d0 2023-07-14T11:18:15.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.280+0000 7f080b7fe700 1 -- 172.21.15.84:0/3529980458 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08000036a0 con 0x7f080c15d9d0 2023-07-14T11:18:15.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.281+0000 7f0812dff700 1 -- 172.21.15.84:0/3529980458 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f080c15d9d0 msgr2=0x7f080c06b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:15.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.281+0000 7f0812dff700 1 --2- 172.21.15.84:0/3529980458 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f080c15d9d0 0x7f080c06b5b0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f08000098f0 tx=0x7f0800009c00 comp rx=0 tx=0).stop 2023-07-14T11:18:15.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.281+0000 7f0812dff700 1 -- 172.21.15.84:0/3529980458 shutdown_connections 2023-07-14T11:18:15.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.281+0000 7f0812dff700 1 --2- 172.21.15.84:0/3529980458 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f080c15d9d0 0x7f080c06b5b0 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:15.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.281+0000 7f0812dff700 1 --2- 172.21.15.84:0/3529980458 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f080c06c9f0 0x7f080c0b1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:15.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.281+0000 7f0812dff700 1 -- 172.21.15.84:0/3529980458 >> 172.21.15.84:0/3529980458 conn(0x7f080c0b05d0 msgr2=0x7f080c0b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:15.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.281+0000 7f0812dff700 1 -- 172.21.15.84:0/3529980458 shutdown_connections 2023-07-14T11:18:15.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.281+0000 7f0812dff700 1 -- 172.21.15.84:0/3529980458 wait complete. 2023-07-14T11:18:15.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.283+0000 7f0812dff700 1 Processor -- start 2023-07-14T11:18:15.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.284+0000 7f0812dff700 1 -- start start 2023-07-14T11:18:15.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.285+0000 7f0812dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f080c06c9f0 0x7f080c0c4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:15.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.285+0000 7f0812dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f080c0b1e50 0x7f080c156df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:15.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.285+0000 7f0812dff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f080c15d9d0 0x7f080c157330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:15.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.285+0000 7f0812dff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f080c153660 con 0x7f080c15d9d0 2023-07-14T11:18:15.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.285+0000 7f0812dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f080c0c5000 con 0x7f080c06c9f0 2023-07-14T11:18:15.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.285+0000 7f0812dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f080c0c3a20 con 0x7f080c0b1e50 2023-07-14T11:18:15.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.285+0000 7f081139c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f080c15d9d0 0x7f080c157330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:15.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.285+0000 7f081139c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f080c15d9d0 0x7f080c157330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37836/0 (socket says 172.21.15.84:37836) 2023-07-14T11:18:15.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.285+0000 7f081139c700 1 -- 172.21.15.84:0/2667168443 learned_addr learned my addr 172.21.15.84:0/2667168443 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:15.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.285+0000 7f080bfff700 1 --2- 172.21.15.84:0/2667168443 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f080c0b1e50 0x7f080c156df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:15.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.285+0000 7f0810b9b700 1 --2- 172.21.15.84:0/2667168443 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f080c06c9f0 0x7f080c0c4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:15.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.286+0000 7f081139c700 1 -- 172.21.15.84:0/2667168443 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f080c0b1e50 msgr2=0x7f080c156df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:15.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.286+0000 7f081139c700 1 --2- 172.21.15.84:0/2667168443 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f080c0b1e50 0x7f080c156df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:15.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.286+0000 7f081139c700 1 -- 172.21.15.84:0/2667168443 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f080c06c9f0 msgr2=0x7f080c0c4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:15.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.286+0000 7f081139c700 1 --2- 172.21.15.84:0/2667168443 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f080c06c9f0 0x7f080c0c4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:15.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.286+0000 7f081139c700 1 -- 172.21.15.84:0/2667168443 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0800009550 con 0x7f080c15d9d0 2023-07-14T11:18:15.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.286+0000 7f0810b9b700 1 --2- 172.21.15.84:0/2667168443 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f080c06c9f0 0x7f080c0c4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:18:15.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.286+0000 7f081139c700 1 --2- 172.21.15.84:0/2667168443 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f080c15d9d0 0x7f080c157330 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f080400cc10 tx=0x7f080400cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:15.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.286+0000 7f08097fa700 1 -- 172.21.15.84:0/2667168443 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0804004b90 con 0x7f080c15d9d0 2023-07-14T11:18:15.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.286+0000 7f08097fa700 1 -- 172.21.15.84:0/2667168443 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0804004cf0 con 0x7f080c15d9d0 2023-07-14T11:18:15.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.286+0000 7f08097fa700 1 -- 172.21.15.84:0/2667168443 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f080400ab90 con 0x7f080c15d9d0 2023-07-14T11:18:15.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.286+0000 7f0812dff700 1 -- 172.21.15.84:0/2667168443 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f080c0c3d00 con 0x7f080c15d9d0 2023-07-14T11:18:15.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.286+0000 7f0812dff700 1 -- 172.21.15.84:0/2667168443 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f080c0c42c0 con 0x7f080c15d9d0 2023-07-14T11:18:15.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.287+0000 7f0812dff700 1 -- 172.21.15.84:0/2667168443 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f080c074350 con 0x7f080c15d9d0 2023-07-14T11:18:15.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.289+0000 7f08097fa700 1 -- 172.21.15.84:0/2667168443 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7f080400acf0 con 0x7f080c15d9d0 2023-07-14T11:18:15.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.290+0000 7f08097fa700 1 --2- 172.21.15.84:0/2667168443 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f07f006b040 0x7f07f006d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:15.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.290+0000 7f08097fa700 1 -- 172.21.15.84:0/2667168443 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0804089430 con 0x7f080c15d9d0 2023-07-14T11:18:15.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.290+0000 7f0810b9b700 1 --2- 172.21.15.84:0/2667168443 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f07f006b040 0x7f07f006d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:15.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.291+0000 7f0810b9b700 1 --2- 172.21.15.84:0/2667168443 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f07f006b040 0x7f07f006d4f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f0800009130 tx=0x7f0800008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:15.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.294+0000 7f08097fa700 1 -- 172.21.15.84:0/2667168443 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f0804054090 con 0x7f080c15d9d0 2023-07-14T11:18:15.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.501+0000 7f0812dff700 1 -- 172.21.15.84:0/2667168443 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f080c0ca720 con 0x7f080c15d9d0 2023-07-14T11:18:15.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.501+0000 7f08097fa700 1 -- 172.21.15.84:0/2667168443 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v75) v1 ==== 80+0+0 (secure 0 0 0) 0x7f08040576b0 con 0x7f080c15d9d0 2023-07-14T11:18:15.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.503+0000 7f0812dff700 1 -- 172.21.15.84:0/2667168443 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f07f006b040 msgr2=0x7f07f006d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:15.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.503+0000 7f0812dff700 1 --2- 172.21.15.84:0/2667168443 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f07f006b040 0x7f07f006d4f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f0800009130 tx=0x7f0800008030 comp rx=0 tx=0).stop 2023-07-14T11:18:15.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.503+0000 7f0812dff700 1 -- 172.21.15.84:0/2667168443 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f080c15d9d0 msgr2=0x7f080c157330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:15.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.503+0000 7f0812dff700 1 --2- 172.21.15.84:0/2667168443 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f080c15d9d0 0x7f080c157330 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f080400cc10 tx=0x7f080400cf20 comp rx=0 tx=0).stop 2023-07-14T11:18:15.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.503+0000 7f0812dff700 1 -- 172.21.15.84:0/2667168443 shutdown_connections 2023-07-14T11:18:15.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.503+0000 7f0812dff700 1 --2- 172.21.15.84:0/2667168443 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f080c15d9d0 0x7f080c157330 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:15.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.503+0000 7f0812dff700 1 --2- 172.21.15.84:0/2667168443 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f080c06c9f0 0x7f080c0c4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:15.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.503+0000 7f0812dff700 1 --2- 172.21.15.84:0/2667168443 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f07f006b040 0x7f07f006d4f0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:15.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.503+0000 7f0812dff700 1 --2- 172.21.15.84:0/2667168443 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f080c0b1e50 0x7f080c156df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:15.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.503+0000 7f0812dff700 1 -- 172.21.15.84:0/2667168443 >> 172.21.15.84:0/2667168443 conn(0x7f080c0b05d0 msgr2=0x7f080c0b2240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:15.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.503+0000 7f0812dff700 1 -- 172.21.15.84:0/2667168443 shutdown_connections 2023-07-14T11:18:15.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.503+0000 7f0812dff700 1 -- 172.21.15.84:0/2667168443 wait complete. 2023-07-14T11:18:15.508 INFO:teuthology.orchestra.run.smithi084.stderr:listed 0 entries 2023-07-14T11:18:15.523 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-14T11:18:15.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:18:15.524 DEBUG:teuthology.orchestra.run.smithi084:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-14T11:18:15.612 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi084.front.sepia.ceph.com 2023-07-14T11:18:15.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:18:15.614 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-14T11:18:15.661 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-07-14T11:18:15.662 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:18:15.714 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-07-14T11:18:15.715 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:18:15.762 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:18:15.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.957+0000 7f08c77ff700 1 Processor -- start 2023-07-14T11:18:15.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.958+0000 7f08c77ff700 1 -- start start 2023-07-14T11:18:15.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.959+0000 7f08c77ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08c0160030 0x7f08c006c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:15.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.959+0000 7f08c77ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f08c00d1160 0x7f08c00b0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:15.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.959+0000 7f08c77ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08c00d2cc0 con 0x7f08c00b5cd0 2023-07-14T11:18:15.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.959+0000 7f08c77ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08c00afbb0 con 0x7f08c00d1160 2023-07-14T11:18:15.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.959+0000 7f08c77ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08c00afe90 con 0x7f08c0160030 2023-07-14T11:18:15.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.959+0000 7f08c5d9c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f08c00d1160 0x7f08c00b0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:15.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.959+0000 7f08c5d9c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f08c00d1160 0x7f08c00b0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37852/0 (socket says 172.21.15.84:37852) 2023-07-14T11:18:15.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.959+0000 7f08c5d9c700 1 -- 172.21.15.84:0/3482499949 learned_addr learned my addr 172.21.15.84:0/3482499949 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:15.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.959+0000 7f08c559b700 1 --2- 172.21.15.84:0/3482499949 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08c0160030 0x7f08c006c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:15.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.959+0000 7f08c5d9c700 1 -- 172.21.15.84:0/3482499949 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08c0160030 msgr2=0x7f08c006c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:15.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.959+0000 7f08c5d9c700 1 --2- 172.21.15.84:0/3482499949 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08c0160030 0x7f08c006c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:15.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.959+0000 7f08c5d9c700 1 -- 172.21.15.84:0/3482499949 >> v1:172.21.15.179:6789/0 conn(0x7f08c00b5cd0 legacy=0x7f08c00d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:15.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.960+0000 7f08c5d9c700 1 -- 172.21.15.84:0/3482499949 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08c00b0170 con 0x7f08c00d1160 2023-07-14T11:18:15.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.960+0000 7f08c559b700 1 --2- 172.21.15.84:0/3482499949 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08c0160030 0x7f08c006c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:18:15.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.960+0000 7f08c5d9c700 1 --2- 172.21.15.84:0/3482499949 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08c00d1160 0x7f08c00b0c50 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f08b8009e50 tx=0x7f08b800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6d0f041435ac6be server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:15.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.960+0000 7f08b7fff700 1 -- 172.21.15.84:0/3482499949 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b800e070 con 0x7f08c00d1160 2023-07-14T11:18:15.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.960+0000 7f08b7fff700 1 -- 172.21.15.84:0/3482499949 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08b800b9c0 con 0x7f08c00d1160 2023-07-14T11:18:15.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.960+0000 7f08b7fff700 1 -- 172.21.15.84:0/3482499949 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b800bd70 con 0x7f08c00d1160 2023-07-14T11:18:15.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.960+0000 7f08c77ff700 1 -- 172.21.15.84:0/3482499949 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08c00d1160 msgr2=0x7f08c00b0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:15.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.960+0000 7f08c77ff700 1 --2- 172.21.15.84:0/3482499949 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08c00d1160 0x7f08c00b0c50 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f08b8009e50 tx=0x7f08b800b330 comp rx=0 tx=0).stop 2023-07-14T11:18:15.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.961+0000 7f08c77ff700 1 -- 172.21.15.84:0/3482499949 shutdown_connections 2023-07-14T11:18:15.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.961+0000 7f08c77ff700 1 --2- 172.21.15.84:0/3482499949 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08c00d1160 0x7f08c00b0c50 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:15.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.961+0000 7f08c77ff700 1 --2- 172.21.15.84:0/3482499949 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08c0160030 0x7f08c006c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:15.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.961+0000 7f08c77ff700 1 -- 172.21.15.84:0/3482499949 >> 172.21.15.84:0/3482499949 conn(0x7f08c009c190 msgr2=0x7f08c00d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:15.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.961+0000 7f08c77ff700 1 -- 172.21.15.84:0/3482499949 shutdown_connections 2023-07-14T11:18:15.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.961+0000 7f08c77ff700 1 -- 172.21.15.84:0/3482499949 wait complete. 2023-07-14T11:18:15.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.962+0000 7f08c77ff700 1 Processor -- start 2023-07-14T11:18:15.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.963+0000 7f08c77ff700 1 -- start start 2023-07-14T11:18:15.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.963+0000 7f08c77ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08c00b5cd0 0x7f08c00c8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:15.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.963+0000 7f08c77ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08c00d1160 0x7f08c015cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:15.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.963+0000 7f08c77ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08c0160030 0x7f08c01f23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:15.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.963+0000 7f08c77ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08c015a2e0 con 0x7f08c0160030 2023-07-14T11:18:15.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.964+0000 7f08c77ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08c015d110 con 0x7f08c00d1160 2023-07-14T11:18:15.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.964+0000 7f08c77ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08c00c89d0 con 0x7f08c00b5cd0 2023-07-14T11:18:15.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.964+0000 7f08c5d9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08c0160030 0x7f08c01f23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:15.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.964+0000 7f08c5d9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08c0160030 0x7f08c01f23e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37866/0 (socket says 172.21.15.84:37866) 2023-07-14T11:18:15.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.964+0000 7f08c5d9c700 1 -- 172.21.15.84:0/3215043163 learned_addr learned my addr 172.21.15.84:0/3215043163 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:15.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.964+0000 7f08c559b700 1 --2- 172.21.15.84:0/3215043163 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08c00b5cd0 0x7f08c00c8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:15.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.964+0000 7f08c4d9a700 1 --2- 172.21.15.84:0/3215043163 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08c00d1160 0x7f08c015cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:15.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.964+0000 7f08c5d9c700 1 -- 172.21.15.84:0/3215043163 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08c00b5cd0 msgr2=0x7f08c00c8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:15.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.964+0000 7f08c5d9c700 1 --2- 172.21.15.84:0/3215043163 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08c00b5cd0 0x7f08c00c8380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:15.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.964+0000 7f08c5d9c700 1 -- 172.21.15.84:0/3215043163 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08c00d1160 msgr2=0x7f08c015cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:15.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.964+0000 7f08c5d9c700 1 --2- 172.21.15.84:0/3215043163 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08c00d1160 0x7f08c015cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:15.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.964+0000 7f08c5d9c700 1 -- 172.21.15.84:0/3215043163 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b8009b30 con 0x7f08c0160030 2023-07-14T11:18:15.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.964+0000 7f08c5d9c700 1 --2- 172.21.15.84:0/3215043163 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08c0160030 0x7f08c01f23e0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f08b8012000 tx=0x7f08b8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:15.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.965+0000 7f08b5ffb700 1 -- 172.21.15.84:0/3215043163 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b8004800 con 0x7f08c0160030 2023-07-14T11:18:15.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.965+0000 7f08b5ffb700 1 -- 172.21.15.84:0/3215043163 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08b8004960 con 0x7f08c0160030 2023-07-14T11:18:15.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.965+0000 7f08c77ff700 1 -- 172.21.15.84:0/3215043163 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08c00c8cb0 con 0x7f08c0160030 2023-07-14T11:18:15.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.965+0000 7f08b5ffb700 1 -- 172.21.15.84:0/3215043163 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b801c680 con 0x7f08c0160030 2023-07-14T11:18:15.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.965+0000 7f08c77ff700 1 -- 172.21.15.84:0/3215043163 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08c00c9270 con 0x7f08c0160030 2023-07-14T11:18:15.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.966+0000 7f08c77ff700 1 -- 172.21.15.84:0/3215043163 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08c004e280 con 0x7f08c0160030 2023-07-14T11:18:15.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.967+0000 7f08b5ffb700 1 -- 172.21.15.84:0/3215043163 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7f08b801c7e0 con 0x7f08c0160030 2023-07-14T11:18:15.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.968+0000 7f08b5ffb700 1 --2- 172.21.15.84:0/3215043163 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f08a406b040 0x7f08a406d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:15.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.968+0000 7f08b5ffb700 1 -- 172.21.15.84:0/3215043163 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f08b808b870 con 0x7f08c0160030 2023-07-14T11:18:15.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.968+0000 7f08c559b700 1 --2- 172.21.15.84:0/3215043163 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f08a406b040 0x7f08a406d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:15.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.969+0000 7f08c559b700 1 --2- 172.21.15.84:0/3215043163 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f08a406b040 0x7f08a406d4f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f08c00c9590 tx=0x7f08bc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:15.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:15.971+0000 7f08b5ffb700 1 -- 172.21.15.84:0/3215043163 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f08b8056610 con 0x7f08c0160030 2023-07-14T11:18:16.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.167+0000 7f08c77ff700 1 -- 172.21.15.84:0/3215043163 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f08c015a420 con 0x7f08c0160030 2023-07-14T11:18:16.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.168+0000 7f08b5ffb700 1 -- 172.21.15.84:0/3215043163 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+18330 (secure 0 0 0) 0x7f08b8059c30 con 0x7f08c0160030 2023-07-14T11:18:16.171 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:18:16.171 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":75,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:17:57.264291+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-07-14T11:17:53.456029+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-07-14T11:17:54.724710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:18:16.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.171+0000 7f08c77ff700 1 -- 172.21.15.84:0/3215043163 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f08a406b040 msgr2=0x7f08a406d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:16.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.171+0000 7f08c77ff700 1 --2- 172.21.15.84:0/3215043163 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f08a406b040 0x7f08a406d4f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f08c00c9590 tx=0x7f08bc008040 comp rx=0 tx=0).stop 2023-07-14T11:18:16.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.171+0000 7f08c77ff700 1 -- 172.21.15.84:0/3215043163 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08c0160030 msgr2=0x7f08c01f23e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:16.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.171+0000 7f08c77ff700 1 --2- 172.21.15.84:0/3215043163 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08c0160030 0x7f08c01f23e0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f08b8012000 tx=0x7f08b8004ad0 comp rx=0 tx=0).stop 2023-07-14T11:18:16.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.171+0000 7f08c77ff700 1 -- 172.21.15.84:0/3215043163 shutdown_connections 2023-07-14T11:18:16.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.171+0000 7f08c77ff700 1 --2- 172.21.15.84:0/3215043163 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f08a406b040 0x7f08a406d4f0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:16.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.171+0000 7f08c77ff700 1 --2- 172.21.15.84:0/3215043163 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08c00b5cd0 0x7f08c00c8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:16.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.171+0000 7f08c77ff700 1 --2- 172.21.15.84:0/3215043163 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08c0160030 0x7f08c01f23e0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:16.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.171+0000 7f08c77ff700 1 --2- 172.21.15.84:0/3215043163 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08c00d1160 0x7f08c015cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:16.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.171+0000 7f08c77ff700 1 -- 172.21.15.84:0/3215043163 >> 172.21.15.84:0/3215043163 conn(0x7f08c009c190 msgr2=0x7f08c00b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:16.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.171+0000 7f08c77ff700 1 -- 172.21.15.84:0/3215043163 shutdown_connections 2023-07-14T11:18:16.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.171+0000 7f08c77ff700 1 -- 172.21.15.84:0/3215043163 wait complete. 2023-07-14T11:18:16.191 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T11:13:00.125395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T11:13:06.803994+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T11:17:53.456029+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T11:17:54.724710+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T11:18:16.192 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T11:18:16.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.389+0000 7fb210fff700 1 Processor -- start 2023-07-14T11:18:16.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.389+0000 7fb210fff700 1 -- start start 2023-07-14T11:18:16.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.390+0000 7fb210fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb20c0b8a60 0x7fb20c0b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:16.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.390+0000 7fb210fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb20c0b4530 0x7fb20c0d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:16.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.390+0000 7fb210fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb20c0d1050 0x7fb20c0b25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:16.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.390+0000 7fb210fff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb20c0d14d0 con 0x7fb20c0b8a60 2023-07-14T11:18:16.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.390+0000 7fb210fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb20c0b8e30 con 0x7fb20c0d1050 2023-07-14T11:18:16.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.390+0000 7fb210fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb20c0afaa0 con 0x7fb20c0b4530 2023-07-14T11:18:16.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.390+0000 7fb20a59c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb20c0b8a60 0x7fb20c0b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:16.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.390+0000 7fb20a59c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb20c0b8a60 0x7fb20c0b3ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37868/0 (socket says 172.21.15.84:37868) 2023-07-14T11:18:16.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.391+0000 7fb20a59c700 1 -- 172.21.15.84:0/4275616478 learned_addr learned my addr 172.21.15.84:0/4275616478 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:16.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.391+0000 7fb209d9b700 1 --2- 172.21.15.84:0/4275616478 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb20c0b4530 0x7fb20c0d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:16.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.391+0000 7fb20ad9d700 1 --2- 172.21.15.84:0/4275616478 >> v2:172.21.15.179:3300/0 conn(0x7fb20c0d1050 0x7fb20c0b25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:16.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.391+0000 7fb20a59c700 1 -- 172.21.15.84:0/4275616478 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb20c0b4530 msgr2=0x7fb20c0d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:16.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.391+0000 7fb20a59c700 1 --2- 172.21.15.84:0/4275616478 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb20c0b4530 0x7fb20c0d0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:16.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.391+0000 7fb20a59c700 1 -- 172.21.15.84:0/4275616478 >> v2:172.21.15.179:3300/0 conn(0x7fb20c0d1050 msgr2=0x7fb20c0b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:16.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.391+0000 7fb20a59c700 1 --2- 172.21.15.84:0/4275616478 >> v2:172.21.15.179:3300/0 conn(0x7fb20c0d1050 0x7fb20c0b25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:16.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.391+0000 7fb20a59c700 1 -- 172.21.15.84:0/4275616478 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb20c0afd80 con 0x7fb20c0b8a60 2023-07-14T11:18:16.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.391+0000 7fb209d9b700 1 --2- 172.21.15.84:0/4275616478 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb20c0b4530 0x7fb20c0d0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:18:16.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.391+0000 7fb20a59c700 1 --2- 172.21.15.84:0/4275616478 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb20c0b8a60 0x7fb20c0b3ff0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fb20c08c2e0 tx=0x7fb1fc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a075d0bf2be2c5fe server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:16.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.391+0000 7fb20959a700 1 -- 172.21.15.84:0/4275616478 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1fc00b870 con 0x7fb20c0b8a60 2023-07-14T11:18:16.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.391+0000 7fb20959a700 1 -- 172.21.15.84:0/4275616478 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1fc00b9d0 con 0x7fb20c0b8a60 2023-07-14T11:18:16.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.391+0000 7fb20959a700 1 -- 172.21.15.84:0/4275616478 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1fc00bd60 con 0x7fb20c0b8a60 2023-07-14T11:18:16.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.392+0000 7fb210fff700 1 -- 172.21.15.84:0/4275616478 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb20c0b8a60 msgr2=0x7fb20c0b3ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:16.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.392+0000 7fb210fff700 1 --2- 172.21.15.84:0/4275616478 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb20c0b8a60 0x7fb20c0b3ff0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fb20c08c2e0 tx=0x7fb1fc009bd0 comp rx=0 tx=0).stop 2023-07-14T11:18:16.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.392+0000 7fb210fff700 1 -- 172.21.15.84:0/4275616478 shutdown_connections 2023-07-14T11:18:16.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.392+0000 7fb210fff700 1 --2- 172.21.15.84:0/4275616478 >> v2:172.21.15.179:3300/0 conn(0x7fb20c0d1050 0x7fb20c0b25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:16.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.392+0000 7fb210fff700 1 --2- 172.21.15.84:0/4275616478 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb20c0b8a60 0x7fb20c0b3ff0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:16.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.392+0000 7fb210fff700 1 --2- 172.21.15.84:0/4275616478 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb20c0b4530 0x7fb20c0d0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:16.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.392+0000 7fb210fff700 1 -- 172.21.15.84:0/4275616478 >> 172.21.15.84:0/4275616478 conn(0x7fb20c09c1b0 msgr2=0x7fb20c0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:16.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.392+0000 7fb210fff700 1 -- 172.21.15.84:0/4275616478 shutdown_connections 2023-07-14T11:18:16.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.392+0000 7fb210fff700 1 -- 172.21.15.84:0/4275616478 wait complete. 2023-07-14T11:18:16.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.394+0000 7fb210fff700 1 Processor -- start 2023-07-14T11:18:16.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.395+0000 7fb210fff700 1 -- start start 2023-07-14T11:18:16.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.396+0000 7fb210fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb20c0b4530 0x7fb20c151d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:16.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.396+0000 7fb210fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb20c0b8a60 0x7fb20c1f5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:16.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.396+0000 7fb210fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb20c0d1050 0x7fb20c1f62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:16.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.396+0000 7fb210fff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb20c15cdb0 con 0x7fb20c0d1050 2023-07-14T11:18:16.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.396+0000 7fb210fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb20c15d090 con 0x7fb20c0b8a60 2023-07-14T11:18:16.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.396+0000 7fb210fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb20c152290 con 0x7fb20c0b4530 2023-07-14T11:18:16.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.396+0000 7fb20ad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb20c0d1050 0x7fb20c1f62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:16.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.396+0000 7fb20ad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb20c0d1050 0x7fb20c1f62c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37876/0 (socket says 172.21.15.84:37876) 2023-07-14T11:18:16.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.396+0000 7fb20ad9d700 1 -- 172.21.15.84:0/3047626990 learned_addr learned my addr 172.21.15.84:0/3047626990 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:16.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.396+0000 7fb20a59c700 1 --2- 172.21.15.84:0/3047626990 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb20c0b4530 0x7fb20c151d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:16.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.396+0000 7fb209d9b700 1 --2- 172.21.15.84:0/3047626990 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb20c0b8a60 0x7fb20c1f5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:16.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.397+0000 7fb20ad9d700 1 -- 172.21.15.84:0/3047626990 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb20c0b4530 msgr2=0x7fb20c151d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:16.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.397+0000 7fb20ad9d700 1 --2- 172.21.15.84:0/3047626990 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb20c0b4530 0x7fb20c151d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:16.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.397+0000 7fb20ad9d700 1 -- 172.21.15.84:0/3047626990 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb20c0b8a60 msgr2=0x7fb20c1f5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:16.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.397+0000 7fb20ad9d700 1 --2- 172.21.15.84:0/3047626990 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb20c0b8a60 0x7fb20c1f5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:16.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.397+0000 7fb20ad9d700 1 -- 172.21.15.84:0/3047626990 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1fc009550 con 0x7fb20c0d1050 2023-07-14T11:18:16.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.397+0000 7fb20ad9d700 1 --2- 172.21.15.84:0/3047626990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb20c0d1050 0x7fb20c1f62c0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fb204007ec0 tx=0x7fb20400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:16.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.397+0000 7fb1faffd700 1 -- 172.21.15.84:0/3047626990 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb20400ed30 con 0x7fb20c0d1050 2023-07-14T11:18:16.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.397+0000 7fb1faffd700 1 -- 172.21.15.84:0/3047626990 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb20400eeb0 con 0x7fb20c0d1050 2023-07-14T11:18:16.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.397+0000 7fb1faffd700 1 -- 172.21.15.84:0/3047626990 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb204014640 con 0x7fb20c0d1050 2023-07-14T11:18:16.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.397+0000 7fb210fff700 1 -- 172.21.15.84:0/3047626990 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb20c15f6e0 con 0x7fb20c0d1050 2023-07-14T11:18:16.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.397+0000 7fb210fff700 1 -- 172.21.15.84:0/3047626990 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb20c15fca0 con 0x7fb20c0d1050 2023-07-14T11:18:16.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.398+0000 7fb210fff700 1 -- 172.21.15.84:0/3047626990 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb20c15d220 con 0x7fb20c0d1050 2023-07-14T11:18:16.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.399+0000 7fb1faffd700 1 -- 172.21.15.84:0/3047626990 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7fb2040147a0 con 0x7fb20c0d1050 2023-07-14T11:18:16.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.401+0000 7fb1faffd700 1 --2- 172.21.15.84:0/3047626990 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fb1ec06b040 0x7fb1ec06d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:16.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.401+0000 7fb1faffd700 1 -- 172.21.15.84:0/3047626990 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb204089e60 con 0x7fb20c0d1050 2023-07-14T11:18:16.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.401+0000 7fb20a59c700 1 --2- 172.21.15.84:0/3047626990 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fb1ec06b040 0x7fb1ec06d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:16.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.401+0000 7fb20a59c700 1 --2- 172.21.15.84:0/3047626990 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fb1ec06b040 0x7fb1ec06d4f0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc000c00 tx=0x7fb1fc008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:16.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.405+0000 7fb1faffd700 1 -- 172.21.15.84:0/3047626990 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fb204054b50 con 0x7fb20c0d1050 2023-07-14T11:18:16.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.597+0000 7fb210fff700 1 -- 172.21.15.84:0/3047626990 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb20c074350 con 0x7fb20c0d1050 2023-07-14T11:18:16.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.598+0000 7fb1faffd700 1 -- 172.21.15.84:0/3047626990 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb204058170 con 0x7fb20c0d1050 2023-07-14T11:18:16.600 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-07-14T11:18:16.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.600+0000 7fb210fff700 1 -- 172.21.15.84:0/3047626990 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fb1ec06b040 msgr2=0x7fb1ec06d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:16.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.600+0000 7fb210fff700 1 --2- 172.21.15.84:0/3047626990 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fb1ec06b040 0x7fb1ec06d4f0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc000c00 tx=0x7fb1fc008030 comp rx=0 tx=0).stop 2023-07-14T11:18:16.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.600+0000 7fb210fff700 1 -- 172.21.15.84:0/3047626990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb20c0d1050 msgr2=0x7fb20c1f62c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:16.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.600+0000 7fb210fff700 1 --2- 172.21.15.84:0/3047626990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb20c0d1050 0x7fb20c1f62c0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fb204007ec0 tx=0x7fb20400e3c0 comp rx=0 tx=0).stop 2023-07-14T11:18:16.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.600+0000 7fb210fff700 1 -- 172.21.15.84:0/3047626990 shutdown_connections 2023-07-14T11:18:16.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.600+0000 7fb210fff700 1 --2- 172.21.15.84:0/3047626990 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fb1ec06b040 0x7fb1ec06d4f0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:16.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.600+0000 7fb210fff700 1 --2- 172.21.15.84:0/3047626990 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb20c0b4530 0x7fb20c151d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:16.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.600+0000 7fb210fff700 1 --2- 172.21.15.84:0/3047626990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb20c0d1050 0x7fb20c1f62c0 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:16.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.600+0000 7fb210fff700 1 --2- 172.21.15.84:0/3047626990 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb20c0b8a60 0x7fb20c1f5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:16.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.600+0000 7fb210fff700 1 -- 172.21.15.84:0/3047626990 >> 172.21.15.84:0/3047626990 conn(0x7fb20c09c1b0 msgr2=0x7fb20c06a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:16.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.600+0000 7fb210fff700 1 -- 172.21.15.84:0/3047626990 shutdown_connections 2023-07-14T11:18:16.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.600+0000 7fb210fff700 1 -- 172.21.15.84:0/3047626990 wait complete. 2023-07-14T11:18:16.620 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T11:18:16.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.817+0000 7fa032bff700 1 Processor -- start 2023-07-14T11:18:16.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.817+0000 7fa032bff700 1 -- start start 2023-07-14T11:18:16.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.818+0000 7fa032bff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa02c0d0b10 0x7fa02c0d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:16.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.818+0000 7fa032bff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa02c0b0e20 0x7fa02c0b1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:16.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.818+0000 7fa032bff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa02c0b8e30 con 0x7fa02c0b8a60 2023-07-14T11:18:16.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.818+0000 7fa032bff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa02c0d14d0 con 0x7fa02c0b0e20 2023-07-14T11:18:16.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.818+0000 7fa032bff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa02c0afaa0 con 0x7fa02c0d0b10 2023-07-14T11:18:16.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.818+0000 7fa03119c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa02c0b0e20 0x7fa02c0b1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:16.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.818+0000 7fa03119c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa02c0b0e20 0x7fa02c0b1260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37880/0 (socket says 172.21.15.84:37880) 2023-07-14T11:18:16.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.818+0000 7fa03119c700 1 -- 172.21.15.84:0/3577476027 learned_addr learned my addr 172.21.15.84:0/3577476027 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:16.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.819+0000 7fa02bfff700 1 --2- 172.21.15.84:0/3577476027 >> v2:172.21.15.179:3300/0 conn(0x7fa02c0d0b10 0x7fa02c0d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:16.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.819+0000 7fa03119c700 1 -- 172.21.15.84:0/3577476027 >> v2:172.21.15.179:3300/0 conn(0x7fa02c0d0b10 msgr2=0x7fa02c0d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:16.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.819+0000 7fa03119c700 1 --2- 172.21.15.84:0/3577476027 >> v2:172.21.15.179:3300/0 conn(0x7fa02c0d0b10 0x7fa02c0d0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:16.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.819+0000 7fa03119c700 1 -- 172.21.15.84:0/3577476027 >> v1:172.21.15.179:6789/0 conn(0x7fa02c0b8a60 legacy=0x7fa02c0b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:16.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.819+0000 7fa03119c700 1 -- 172.21.15.84:0/3577476027 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa02c0afd80 con 0x7fa02c0b0e20 2023-07-14T11:18:16.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.819+0000 7fa03119c700 1 --2- 172.21.15.84:0/3577476027 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa02c0b0e20 0x7fa02c0b1260 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fa02c09c8e0 tx=0x7fa02400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65427124c51c1229 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:16.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.819+0000 7fa02b7fe700 1 -- 172.21.15.84:0/3577476027 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02400e070 con 0x7fa02c0b0e20 2023-07-14T11:18:16.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.819+0000 7fa02b7fe700 1 -- 172.21.15.84:0/3577476027 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa02400b9c0 con 0x7fa02c0b0e20 2023-07-14T11:18:16.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.819+0000 7fa02b7fe700 1 -- 172.21.15.84:0/3577476027 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02400bd70 con 0x7fa02c0b0e20 2023-07-14T11:18:16.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.820+0000 7fa032bff700 1 -- 172.21.15.84:0/3577476027 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa02c0b0e20 msgr2=0x7fa02c0b1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:16.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.820+0000 7fa032bff700 1 --2- 172.21.15.84:0/3577476027 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa02c0b0e20 0x7fa02c0b1260 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fa02c09c8e0 tx=0x7fa02400b330 comp rx=0 tx=0).stop 2023-07-14T11:18:16.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.820+0000 7fa032bff700 1 -- 172.21.15.84:0/3577476027 shutdown_connections 2023-07-14T11:18:16.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.820+0000 7fa032bff700 1 --2- 172.21.15.84:0/3577476027 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa02c0b0e20 0x7fa02c0b1260 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:16.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.820+0000 7fa032bff700 1 --2- 172.21.15.84:0/3577476027 >> v2:172.21.15.179:3300/0 conn(0x7fa02c0d0b10 0x7fa02c0d0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:16.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.820+0000 7fa032bff700 1 -- 172.21.15.84:0/3577476027 >> 172.21.15.84:0/3577476027 conn(0x7fa02c09c1b0 msgr2=0x7fa02c0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:16.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.820+0000 7fa032bff700 1 -- 172.21.15.84:0/3577476027 shutdown_connections 2023-07-14T11:18:16.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.820+0000 7fa032bff700 1 -- 172.21.15.84:0/3577476027 wait complete. 2023-07-14T11:18:16.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.822+0000 7fa032bff700 1 Processor -- start 2023-07-14T11:18:16.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.822+0000 7fa032bff700 1 -- start start 2023-07-14T11:18:16.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.823+0000 7fa032bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa02c0b0e20 0x7fa02c14a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:16.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.823+0000 7fa032bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa02c0b8a60 0x7fa02c149bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:16.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.823+0000 7fa032bff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa02c0d0b10 0x7fa02c0ca010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:16.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.823+0000 7fa032bff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa02c0cd340 con 0x7fa02c0d0b10 2023-07-14T11:18:16.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.823+0000 7fa032bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa02c0cd060 con 0x7fa02c0b0e20 2023-07-14T11:18:16.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.823+0000 7fa032bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa02c0b6260 con 0x7fa02c0b8a60 2023-07-14T11:18:16.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.823+0000 7fa03119c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa02c0d0b10 0x7fa02c0ca010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:16.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.823+0000 7fa03119c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa02c0d0b10 0x7fa02c0ca010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37888/0 (socket says 172.21.15.84:37888) 2023-07-14T11:18:16.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.823+0000 7fa03119c700 1 -- 172.21.15.84:0/1009938305 learned_addr learned my addr 172.21.15.84:0/1009938305 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:16.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.823+0000 7fa03119c700 1 -- 172.21.15.84:0/1009938305 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa02c0b8a60 msgr2=0x7fa02c149bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:16.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.823+0000 7fa02bfff700 1 --2- 172.21.15.84:0/1009938305 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa02c0b8a60 0x7fa02c149bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:16.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.823+0000 7fa03099b700 1 --2- 172.21.15.84:0/1009938305 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa02c0b0e20 0x7fa02c14a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:16.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.823+0000 7fa03119c700 1 --2- 172.21.15.84:0/1009938305 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa02c0b8a60 0x7fa02c149bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:16.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.823+0000 7fa03119c700 1 -- 172.21.15.84:0/1009938305 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa02c0b0e20 msgr2=0x7fa02c14a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:16.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.823+0000 7fa03119c700 1 --2- 172.21.15.84:0/1009938305 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa02c0b0e20 0x7fa02c14a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:16.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.823+0000 7fa03119c700 1 -- 172.21.15.84:0/1009938305 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa024009b30 con 0x7fa02c0d0b10 2023-07-14T11:18:16.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.823+0000 7fa03099b700 1 --2- 172.21.15.84:0/1009938305 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa02c0b0e20 0x7fa02c14a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:18:16.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.824+0000 7fa03119c700 1 --2- 172.21.15.84:0/1009938305 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa02c0d0b10 0x7fa02c0ca010 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7fa02c0681d0 tx=0x7fa024004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:16.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.824+0000 7fa0297fa700 1 -- 172.21.15.84:0/1009938305 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0240099b0 con 0x7fa02c0d0b10 2023-07-14T11:18:16.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.824+0000 7fa0297fa700 1 -- 172.21.15.84:0/1009938305 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0240092e0 con 0x7fa02c0d0b10 2023-07-14T11:18:16.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.824+0000 7fa0297fa700 1 -- 172.21.15.84:0/1009938305 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02401c640 con 0x7fa02c0d0b10 2023-07-14T11:18:16.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.824+0000 7fa032bff700 1 -- 172.21.15.84:0/1009938305 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa02c0b6540 con 0x7fa02c0d0b10 2023-07-14T11:18:16.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.824+0000 7fa032bff700 1 -- 172.21.15.84:0/1009938305 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa02c0ca550 con 0x7fa02c0d0b10 2023-07-14T11:18:16.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.825+0000 7fa032bff700 1 -- 172.21.15.84:0/1009938305 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa02c0d0960 con 0x7fa02c0d0b10 2023-07-14T11:18:16.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.826+0000 7fa0297fa700 1 -- 172.21.15.84:0/1009938305 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7fa02401c7a0 con 0x7fa02c0d0b10 2023-07-14T11:18:16.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.827+0000 7fa0297fa700 1 --2- 172.21.15.84:0/1009938305 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa01006b040 0x7fa01006d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:16.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.827+0000 7fa0297fa700 1 -- 172.21.15.84:0/1009938305 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa02408b7a0 con 0x7fa02c0d0b10 2023-07-14T11:18:16.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.827+0000 7fa03099b700 1 --2- 172.21.15.84:0/1009938305 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa01006b040 0x7fa01006d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:16.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.828+0000 7fa03099b700 1 --2- 172.21.15.84:0/1009938305 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa01006b040 0x7fa01006d4f0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fa020000f60 tx=0x7fa020009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:16.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:16.831+0000 7fa0297fa700 1 -- 172.21.15.84:0/1009938305 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fa0240563c0 con 0x7fa02c0d0b10 2023-07-14T11:18:17.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.028+0000 7fa032bff700 1 -- 172.21.15.84:0/1009938305 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa02c0b6a00 con 0x7fa02c0d0b10 2023-07-14T11:18:17.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.028+0000 7fa0297fa700 1 -- 172.21.15.84:0/1009938305 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v75) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa0240599e0 con 0x7fa02c0d0b10 2023-07-14T11:18:17.031 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-07-14T11:18:17.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.031+0000 7fa032bff700 1 -- 172.21.15.84:0/1009938305 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa01006b040 msgr2=0x7fa01006d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:17.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.031+0000 7fa032bff700 1 --2- 172.21.15.84:0/1009938305 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa01006b040 0x7fa01006d4f0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fa020000f60 tx=0x7fa020009040 comp rx=0 tx=0).stop 2023-07-14T11:18:17.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.031+0000 7fa032bff700 1 -- 172.21.15.84:0/1009938305 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa02c0d0b10 msgr2=0x7fa02c0ca010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:17.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.031+0000 7fa032bff700 1 --2- 172.21.15.84:0/1009938305 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa02c0d0b10 0x7fa02c0ca010 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7fa02c0681d0 tx=0x7fa024004ad0 comp rx=0 tx=0).stop 2023-07-14T11:18:17.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.031+0000 7fa032bff700 1 -- 172.21.15.84:0/1009938305 shutdown_connections 2023-07-14T11:18:17.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.031+0000 7fa032bff700 1 --2- 172.21.15.84:0/1009938305 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa02c0d0b10 0x7fa02c0ca010 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:17.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.031+0000 7fa032bff700 1 --2- 172.21.15.84:0/1009938305 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa02c0b0e20 0x7fa02c14a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:17.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.031+0000 7fa032bff700 1 --2- 172.21.15.84:0/1009938305 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fa01006b040 0x7fa01006d4f0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:17.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.031+0000 7fa032bff700 1 --2- 172.21.15.84:0/1009938305 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa02c0b8a60 0x7fa02c149bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:17.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.031+0000 7fa032bff700 1 -- 172.21.15.84:0/1009938305 >> 172.21.15.84:0/1009938305 conn(0x7fa02c09c1b0 msgr2=0x7fa02c15c2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:17.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.031+0000 7fa032bff700 1 -- 172.21.15.84:0/1009938305 shutdown_connections 2023-07-14T11:18:17.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.031+0000 7fa032bff700 1 -- 172.21.15.84:0/1009938305 wait complete. 2023-07-14T11:18:17.051 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T11:18:17.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.246+0000 7f6207bff700 1 Processor -- start 2023-07-14T11:18:17.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.247+0000 7f6207bff700 1 -- start start 2023-07-14T11:18:17.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.248+0000 7f6207bff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f62000b8660 0x7f62000cd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:17.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.248+0000 7f6207bff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f62000b4f70 0x7f62000d12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:17.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.248+0000 7f6207bff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62000d02a0 con 0x7f62000cd970 2023-07-14T11:18:17.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.248+0000 7f6207bff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62000cfce0 con 0x7f62000b4f70 2023-07-14T11:18:17.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.248+0000 7f6207bff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62000cffc0 con 0x7f62000b8660 2023-07-14T11:18:17.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.248+0000 7f620619c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f62000b4f70 0x7f62000d12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:17.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.248+0000 7f620519a700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f62000cd970 0x7f62000b4860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:59822/0 (socket says 172.21.15.84:59822) 2023-07-14T11:18:17.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.248+0000 7f620519a700 1 -- 172.21.15.84:0/2891613228 learned_addr learned my addr 172.21.15.84:0/2891613228 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:18:17.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.248+0000 7f620599b700 1 --2- 172.21.15.84:0/2891613228 >> v2:172.21.15.179:3300/0 conn(0x7f62000b8660 0x7f62000cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:17.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.249+0000 7f620619c700 1 -- 172.21.15.84:0/2891613228 >> v2:172.21.15.179:3300/0 conn(0x7f62000b8660 msgr2=0x7f62000cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:17.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.249+0000 7f620619c700 1 --2- 172.21.15.84:0/2891613228 >> v2:172.21.15.179:3300/0 conn(0x7f62000b8660 0x7f62000cd430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:17.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.249+0000 7f620619c700 1 -- 172.21.15.84:0/2891613228 >> v1:172.21.15.84:6789/0 conn(0x7f62000cd970 legacy=0x7f62000b4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:17.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.249+0000 7f620619c700 1 -- 172.21.15.84:0/2891613228 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62000d0ac0 con 0x7f62000b4f70 2023-07-14T11:18:17.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.249+0000 7f620619c700 1 --2- 172.21.15.84:0/2891613228 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62000b4f70 0x7f62000d12c0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f62000c9e60 tx=0x7f61f800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af7e9fb3065583f2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:17.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.249+0000 7f6204999700 1 -- 172.21.15.84:0/2891613228 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f800e070 con 0x7f62000b4f70 2023-07-14T11:18:17.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.249+0000 7f6204999700 1 -- 172.21.15.84:0/2891613228 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61f800bb20 con 0x7f62000b4f70 2023-07-14T11:18:17.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.249+0000 7f6204999700 1 -- 172.21.15.84:0/2891613228 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f8012430 con 0x7f62000b4f70 2023-07-14T11:18:17.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.250+0000 7f6207bff700 1 -- 172.21.15.84:0/2891613228 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62000b4f70 msgr2=0x7f62000d12c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:17.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.250+0000 7f6207bff700 1 --2- 172.21.15.84:0/2891613228 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62000b4f70 0x7f62000d12c0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f62000c9e60 tx=0x7f61f800b330 comp rx=0 tx=0).stop 2023-07-14T11:18:17.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.250+0000 7f6207bff700 1 -- 172.21.15.84:0/2891613228 shutdown_connections 2023-07-14T11:18:17.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.250+0000 7f6207bff700 1 --2- 172.21.15.84:0/2891613228 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62000b4f70 0x7f62000d12c0 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:17.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.250+0000 7f6207bff700 1 --2- 172.21.15.84:0/2891613228 >> v2:172.21.15.179:3300/0 conn(0x7f62000b8660 0x7f62000cd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:17.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.250+0000 7f6207bff700 1 -- 172.21.15.84:0/2891613228 >> 172.21.15.84:0/2891613228 conn(0x7f6200066860 msgr2=0x7f620006a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:17.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.250+0000 7f6207bff700 1 -- 172.21.15.84:0/2891613228 shutdown_connections 2023-07-14T11:18:17.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.250+0000 7f6207bff700 1 -- 172.21.15.84:0/2891613228 wait complete. 2023-07-14T11:18:17.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.252+0000 7f6207bff700 1 Processor -- start 2023-07-14T11:18:17.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.252+0000 7f6207bff700 1 -- start start 2023-07-14T11:18:17.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.253+0000 7f6207bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62000b4f70 0x7f62001f66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:17.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.253+0000 7f6207bff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62000b8660 0x7f62001585f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:17.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.253+0000 7f6207bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62000cd970 0x7f62000cac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:17.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.254+0000 7f6207bff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6200157550 con 0x7f62000b8660 2023-07-14T11:18:17.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.254+0000 7f6207bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6200157830 con 0x7f62000b4f70 2023-07-14T11:18:17.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.254+0000 7f6207bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6200157b10 con 0x7f62000cd970 2023-07-14T11:18:17.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.254+0000 7f620519a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62000b8660 0x7f62001585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:17.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.254+0000 7f620599b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62000b4f70 0x7f62001f66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:17.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.254+0000 7f620519a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62000b8660 0x7f62001585f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37908/0 (socket says 172.21.15.84:37908) 2023-07-14T11:18:17.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.254+0000 7f620519a700 1 -- 172.21.15.84:0/1110512805 learned_addr learned my addr 172.21.15.84:0/1110512805 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:17.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.254+0000 7f620619c700 1 --2- 172.21.15.84:0/1110512805 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62000cd970 0x7f62000cac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:17.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.254+0000 7f620519a700 1 -- 172.21.15.84:0/1110512805 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62000cd970 msgr2=0x7f62000cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:17.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.254+0000 7f620519a700 1 --2- 172.21.15.84:0/1110512805 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62000cd970 0x7f62000cac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:17.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.254+0000 7f620519a700 1 -- 172.21.15.84:0/1110512805 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62000b4f70 msgr2=0x7f62001f66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:17.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.254+0000 7f620519a700 1 --2- 172.21.15.84:0/1110512805 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62000b4f70 0x7f62001f66c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:17.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.254+0000 7f620519a700 1 -- 172.21.15.84:0/1110512805 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61f8009a70 con 0x7f62000b8660 2023-07-14T11:18:17.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.254+0000 7f620599b700 1 --2- 172.21.15.84:0/1110512805 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62000b4f70 0x7f62001f66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:18:17.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.255+0000 7f620519a700 1 --2- 172.21.15.84:0/1110512805 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62000b8660 0x7f62001585f0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f61f000c480 tx=0x7f61f000c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:17.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.255+0000 7f61f67fc700 1 -- 172.21.15.84:0/1110512805 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f0005d70 con 0x7f62000b8660 2023-07-14T11:18:17.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.255+0000 7f61f67fc700 1 -- 172.21.15.84:0/1110512805 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61f000ce90 con 0x7f62000b8660 2023-07-14T11:18:17.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.255+0000 7f6207bff700 1 -- 172.21.15.84:0/1110512805 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6200157df0 con 0x7f62000b8660 2023-07-14T11:18:17.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.255+0000 7f61f67fc700 1 -- 172.21.15.84:0/1110512805 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f00072d0 con 0x7f62000b8660 2023-07-14T11:18:17.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.255+0000 7f6207bff700 1 -- 172.21.15.84:0/1110512805 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62001f6c00 con 0x7f62000b8660 2023-07-14T11:18:17.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.256+0000 7f6207bff700 1 -- 172.21.15.84:0/1110512805 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6200158310 con 0x7f62000b8660 2023-07-14T11:18:17.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.257+0000 7f61f67fc700 1 -- 172.21.15.84:0/1110512805 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7f61f0007430 con 0x7f62000b8660 2023-07-14T11:18:17.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.258+0000 7f61f67fc700 1 --2- 172.21.15.84:0/1110512805 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f61e406b040 0x7f61e406d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:17.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.258+0000 7f61f67fc700 1 -- 172.21.15.84:0/1110512805 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f61f0088c80 con 0x7f62000b8660 2023-07-14T11:18:17.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.258+0000 7f620599b700 1 --2- 172.21.15.84:0/1110512805 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f61e406b040 0x7f61e406d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:17.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.258+0000 7f620599b700 1 --2- 172.21.15.84:0/1110512805 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f61e406b040 0x7f61e406d4f0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f61fc009fd0 tx=0x7f61fc009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:17.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.262+0000 7f61f67fc700 1 -- 172.21.15.84:0/1110512805 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f6200158310 con 0x7f62000b8660 2023-07-14T11:18:17.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.455+0000 7f6207bff700 1 -- 172.21.15.84:0/1110512805 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6200158310 con 0x7f62000b8660 2023-07-14T11:18:17.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.456+0000 7f61f67fc700 1 -- 172.21.15.84:0/1110512805 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v75) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6200158310 con 0x7f62000b8660 2023-07-14T11:18:17.459 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-07-14T11:18:17.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.458+0000 7f6207bff700 1 -- 172.21.15.84:0/1110512805 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f61e406b040 msgr2=0x7f61e406d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:17.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.458+0000 7f6207bff700 1 --2- 172.21.15.84:0/1110512805 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f61e406b040 0x7f61e406d4f0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f61fc009fd0 tx=0x7f61fc009210 comp rx=0 tx=0).stop 2023-07-14T11:18:17.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.458+0000 7f6207bff700 1 -- 172.21.15.84:0/1110512805 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62000b8660 msgr2=0x7f62001585f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:17.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.458+0000 7f6207bff700 1 --2- 172.21.15.84:0/1110512805 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62000b8660 0x7f62001585f0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f61f000c480 tx=0x7f61f000c790 comp rx=0 tx=0).stop 2023-07-14T11:18:17.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.458+0000 7f6207bff700 1 -- 172.21.15.84:0/1110512805 shutdown_connections 2023-07-14T11:18:17.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.458+0000 7f6207bff700 1 --2- 172.21.15.84:0/1110512805 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f61e406b040 0x7f61e406d4f0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:17.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.458+0000 7f6207bff700 1 --2- 172.21.15.84:0/1110512805 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62000cd970 0x7f62000cac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:17.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.458+0000 7f6207bff700 1 --2- 172.21.15.84:0/1110512805 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62000b4f70 0x7f62001f66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:17.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.458+0000 7f6207bff700 1 --2- 172.21.15.84:0/1110512805 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62000b8660 0x7f62001585f0 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:17.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.458+0000 7f6207bff700 1 -- 172.21.15.84:0/1110512805 >> 172.21.15.84:0/1110512805 conn(0x7f6200066860 msgr2=0x7f62000b4590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:17.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.458+0000 7f6207bff700 1 -- 172.21.15.84:0/1110512805 shutdown_connections 2023-07-14T11:18:17.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.458+0000 7f6207bff700 1 -- 172.21.15.84:0/1110512805 wait complete. 2023-07-14T11:18:17.479 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T11:18:17.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.674+0000 7f2bd75ff700 1 Processor -- start 2023-07-14T11:18:17.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.674+0000 7f2bd75ff700 1 -- start start 2023-07-14T11:18:17.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.675+0000 7f2bd75ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2bd015c860 0x7f2bd00d1e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:17.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.675+0000 7f2bd75ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2bd00c71b0 0x7f2bd00b49d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:17.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.675+0000 7f2bd75ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bd00cd5a0 con 0x7f2bd00cf2a0 2023-07-14T11:18:17.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.675+0000 7f2bd75ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bd0146740 con 0x7f2bd00c71b0 2023-07-14T11:18:17.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.675+0000 7f2bd75ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bd00cf740 con 0x7f2bd015c860 2023-07-14T11:18:17.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.675+0000 7f2bd5b9c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2bd00c71b0 0x7f2bd00b49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:17.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.675+0000 7f2bd5b9c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2bd00c71b0 0x7f2bd00b49d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37914/0 (socket says 172.21.15.84:37914) 2023-07-14T11:18:17.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.675+0000 7f2bd5b9c700 1 -- 172.21.15.84:0/1475481581 learned_addr learned my addr 172.21.15.84:0/1475481581 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:17.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.676+0000 7f2bd539b700 1 --2- 172.21.15.84:0/1475481581 >> v2:172.21.15.179:3300/0 conn(0x7f2bd015c860 0x7f2bd00d1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:17.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.676+0000 7f2bd5b9c700 1 -- 172.21.15.84:0/1475481581 >> v2:172.21.15.179:3300/0 conn(0x7f2bd015c860 msgr2=0x7f2bd00d1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:17.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.676+0000 7f2bd5b9c700 1 --2- 172.21.15.84:0/1475481581 >> v2:172.21.15.179:3300/0 conn(0x7f2bd015c860 0x7f2bd00d1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:17.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.676+0000 7f2bd5b9c700 1 -- 172.21.15.84:0/1475481581 >> v1:172.21.15.179:6789/0 conn(0x7f2bd00cf2a0 legacy=0x7f2bd00c6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:17.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.676+0000 7f2bd5b9c700 1 -- 172.21.15.84:0/1475481581 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bd00cd7f0 con 0x7f2bd00c71b0 2023-07-14T11:18:17.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.676+0000 7f2bd539b700 1 --2- 172.21.15.84:0/1475481581 >> v2:172.21.15.179:3300/0 conn(0x7f2bd015c860 0x7f2bd00d1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:18:17.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.676+0000 7f2bd5b9c700 1 --2- 172.21.15.84:0/1475481581 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bd00c71b0 0x7f2bd00b49d0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f2bd008c100 tx=0x7f2bc800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46d616240739285 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:17.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.676+0000 7f2bc7fff700 1 -- 172.21.15.84:0/1475481581 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc800e070 con 0x7f2bd00c71b0 2023-07-14T11:18:17.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.676+0000 7f2bc7fff700 1 -- 172.21.15.84:0/1475481581 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bc8003a20 con 0x7f2bd00c71b0 2023-07-14T11:18:17.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.676+0000 7f2bc7fff700 1 -- 172.21.15.84:0/1475481581 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc8003dd0 con 0x7f2bd00c71b0 2023-07-14T11:18:17.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.677+0000 7f2bd75ff700 1 -- 172.21.15.84:0/1475481581 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bd00c71b0 msgr2=0x7f2bd00b49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:17.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.677+0000 7f2bd75ff700 1 --2- 172.21.15.84:0/1475481581 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bd00c71b0 0x7f2bd00b49d0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f2bd008c100 tx=0x7f2bc800b330 comp rx=0 tx=0).stop 2023-07-14T11:18:17.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.677+0000 7f2bd75ff700 1 -- 172.21.15.84:0/1475481581 shutdown_connections 2023-07-14T11:18:17.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.677+0000 7f2bd75ff700 1 --2- 172.21.15.84:0/1475481581 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bd00c71b0 0x7f2bd00b49d0 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:17.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.677+0000 7f2bd75ff700 1 --2- 172.21.15.84:0/1475481581 >> v2:172.21.15.179:3300/0 conn(0x7f2bd015c860 0x7f2bd00d1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:17.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.677+0000 7f2bd75ff700 1 -- 172.21.15.84:0/1475481581 >> 172.21.15.84:0/1475481581 conn(0x7f2bd0065bd0 msgr2=0x7f2bd0065fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:17.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.677+0000 7f2bd75ff700 1 -- 172.21.15.84:0/1475481581 shutdown_connections 2023-07-14T11:18:17.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.677+0000 7f2bd75ff700 1 -- 172.21.15.84:0/1475481581 wait complete. 2023-07-14T11:18:17.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.678+0000 7f2bd75ff700 1 Processor -- start 2023-07-14T11:18:17.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.679+0000 7f2bd75ff700 1 -- start start 2023-07-14T11:18:17.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.679+0000 7f2bd75ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2bd00c71b0 0x7f2bd00b8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:17.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.680+0000 7f2bd75ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bd00cf2a0 0x7f2bd00b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:17.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.680+0000 7f2bd75ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2bd015c860 0x7f2bd0155760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:17.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.680+0000 7f2bd75ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd00cb3d0 con 0x7f2bd00cf2a0 2023-07-14T11:18:17.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.680+0000 7f2bd75ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd01561b0 con 0x7f2bd015c860 2023-07-14T11:18:17.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.680+0000 7f2bd75ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd0155ca0 con 0x7f2bd00c71b0 2023-07-14T11:18:17.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.680+0000 7f2bd4b9a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bd00cf2a0 0x7f2bd00b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:17.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.680+0000 7f2bd4b9a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bd00cf2a0 0x7f2bd00b7900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37926/0 (socket says 172.21.15.84:37926) 2023-07-14T11:18:17.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.680+0000 7f2bd4b9a700 1 -- 172.21.15.84:0/2394669253 learned_addr learned my addr 172.21.15.84:0/2394669253 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:17.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.680+0000 7f2bd539b700 1 --2- 172.21.15.84:0/2394669253 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2bd00c71b0 0x7f2bd00b8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:17.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.680+0000 7f2bd5b9c700 1 --2- 172.21.15.84:0/2394669253 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2bd015c860 0x7f2bd0155760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:17.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.680+0000 7f2bd4b9a700 1 -- 172.21.15.84:0/2394669253 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2bd00c71b0 msgr2=0x7f2bd00b8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:17.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.680+0000 7f2bd4b9a700 1 --2- 172.21.15.84:0/2394669253 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2bd00c71b0 0x7f2bd00b8ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:17.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.680+0000 7f2bd4b9a700 1 -- 172.21.15.84:0/2394669253 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2bd015c860 msgr2=0x7f2bd0155760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:17.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.680+0000 7f2bd4b9a700 1 --2- 172.21.15.84:0/2394669253 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2bd015c860 0x7f2bd0155760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:17.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.680+0000 7f2bd4b9a700 1 -- 172.21.15.84:0/2394669253 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bc8009b30 con 0x7f2bd00cf2a0 2023-07-14T11:18:17.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.681+0000 7f2bd4b9a700 1 --2- 172.21.15.84:0/2394669253 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bd00cf2a0 0x7f2bd00b7900 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f2bc000c4d0 tx=0x7f2bc000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:17.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.681+0000 7f2bc5ffb700 1 -- 172.21.15.84:0/2394669253 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc0011790 con 0x7f2bd00cf2a0 2023-07-14T11:18:17.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.681+0000 7f2bc5ffb700 1 -- 172.21.15.84:0/2394669253 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bc00118f0 con 0x7f2bd00cf2a0 2023-07-14T11:18:17.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.681+0000 7f2bc5ffb700 1 -- 172.21.15.84:0/2394669253 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc0011ca0 con 0x7f2bd00cf2a0 2023-07-14T11:18:17.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.681+0000 7f2bd75ff700 1 -- 172.21.15.84:0/2394669253 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bd00b7fc0 con 0x7f2bd00cf2a0 2023-07-14T11:18:17.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.681+0000 7f2bd75ff700 1 -- 172.21.15.84:0/2394669253 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bd00cad10 con 0x7f2bd00cf2a0 2023-07-14T11:18:17.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.682+0000 7f2bd75ff700 1 -- 172.21.15.84:0/2394669253 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bd00cb510 con 0x7f2bd00cf2a0 2023-07-14T11:18:17.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.683+0000 7f2bc5ffb700 1 -- 172.21.15.84:0/2394669253 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7f2bc001c460 con 0x7f2bd00cf2a0 2023-07-14T11:18:17.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.684+0000 7f2bc5ffb700 1 --2- 172.21.15.84:0/2394669253 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f2bb406b040 0x7f2bb406d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:17.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.684+0000 7f2bc5ffb700 1 -- 172.21.15.84:0/2394669253 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2bc0089680 con 0x7f2bd00cf2a0 2023-07-14T11:18:17.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.684+0000 7f2bd539b700 1 --2- 172.21.15.84:0/2394669253 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f2bb406b040 0x7f2bb406d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:17.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.684+0000 7f2bd539b700 1 --2- 172.21.15.84:0/2394669253 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f2bb406b040 0x7f2bb406d4f0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc006fd0 tx=0x7f2bcc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:17.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.688+0000 7f2bc5ffb700 1 -- 172.21.15.84:0/2394669253 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f2bd00cb510 con 0x7f2bd00cf2a0 2023-07-14T11:18:17.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.881+0000 7f2bd75ff700 1 -- 172.21.15.84:0/2394669253 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2bd00cb510 con 0x7f2bd00cf2a0 2023-07-14T11:18:17.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.881+0000 7f2bc5ffb700 1 -- 172.21.15.84:0/2394669253 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v75) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2bd00cb510 con 0x7f2bd00cf2a0 2023-07-14T11:18:17.884 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-07-14T11:18:17.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.884+0000 7f2bd75ff700 1 -- 172.21.15.84:0/2394669253 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f2bb406b040 msgr2=0x7f2bb406d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:17.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.884+0000 7f2bd75ff700 1 --2- 172.21.15.84:0/2394669253 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f2bb406b040 0x7f2bb406d4f0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc006fd0 tx=0x7f2bcc008040 comp rx=0 tx=0).stop 2023-07-14T11:18:17.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.884+0000 7f2bd75ff700 1 -- 172.21.15.84:0/2394669253 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bd00cf2a0 msgr2=0x7f2bd00b7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:17.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.884+0000 7f2bd75ff700 1 --2- 172.21.15.84:0/2394669253 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bd00cf2a0 0x7f2bd00b7900 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f2bc000c4d0 tx=0x7f2bc000c7e0 comp rx=0 tx=0).stop 2023-07-14T11:18:17.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.884+0000 7f2bd75ff700 1 -- 172.21.15.84:0/2394669253 shutdown_connections 2023-07-14T11:18:17.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.884+0000 7f2bd75ff700 1 --2- 172.21.15.84:0/2394669253 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f2bb406b040 0x7f2bb406d4f0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:17.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.884+0000 7f2bd75ff700 1 --2- 172.21.15.84:0/2394669253 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2bd00c71b0 0x7f2bd00b8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:17.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.884+0000 7f2bd75ff700 1 --2- 172.21.15.84:0/2394669253 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2bd015c860 0x7f2bd0155760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:17.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.884+0000 7f2bd75ff700 1 --2- 172.21.15.84:0/2394669253 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bd00cf2a0 0x7f2bd00b7900 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:17.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.884+0000 7f2bd75ff700 1 -- 172.21.15.84:0/2394669253 >> 172.21.15.84:0/2394669253 conn(0x7f2bd0065bd0 msgr2=0x7f2bd00c7580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:17.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.884+0000 7f2bd75ff700 1 -- 172.21.15.84:0/2394669253 shutdown_connections 2023-07-14T11:18:17.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:17.884+0000 7f2bd75ff700 1 -- 172.21.15.84:0/2394669253 wait complete. 2023-07-14T11:18:17.904 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-14T11:18:18.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.098+0000 7fad06bff700 1 Processor -- start 2023-07-14T11:18:18.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.099+0000 7fad06bff700 1 -- start start 2023-07-14T11:18:18.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.100+0000 7fad06bff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fad0015c860 0x7fad000d1e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:18.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.100+0000 7fad06bff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad000cd5a0 con 0x7fad000c71b0 2023-07-14T11:18:18.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.100+0000 7fad06bff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad000cd7f0 con 0x7fad000cf2a0 2023-07-14T11:18:18.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.100+0000 7fad06bff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad00146740 con 0x7fad0015c860 2023-07-14T11:18:18.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.100+0000 7fad0499b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fad0015c860 0x7fad000d1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:18.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.100+0000 7fad0519c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fad000c71b0 0x7fad000b49d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:59832/0 (socket says 172.21.15.84:59832) 2023-07-14T11:18:18.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.100+0000 7fad0519c700 1 -- 172.21.15.84:0/3503564089 learned_addr learned my addr 172.21.15.84:0/3503564089 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:18:18.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.100+0000 7fad0499b700 1 -- 172.21.15.84:0/3503564089 >> v1:172.21.15.179:6789/0 conn(0x7fad000cf2a0 legacy=0x7fad000c6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:18.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.101+0000 7fad0499b700 1 -- 172.21.15.84:0/3503564089 >> v1:172.21.15.84:6789/0 conn(0x7fad000c71b0 legacy=0x7fad000b49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:18.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.101+0000 7fad0499b700 1 -- 172.21.15.84:0/3503564089 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad000cdad0 con 0x7fad0015c860 2023-07-14T11:18:18.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.101+0000 7facff7fe700 1 -- 172.21.15.84:0/3503564089 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1120846548 0 0) 0x7fad000cd5a0 con 0x7fad000c71b0 2023-07-14T11:18:18.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.101+0000 7fad0499b700 1 --2- 172.21.15.84:0/3503564089 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad0015c860 0x7fad000d1e40 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7facf4009840 tx=0x7facf4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7696b1ade47d282f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:18.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.101+0000 7facff7fe700 1 -- 172.21.15.84:0/3503564089 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf4004230 con 0x7fad0015c860 2023-07-14T11:18:18.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.101+0000 7facff7fe700 1 -- 172.21.15.84:0/3503564089 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facf4004390 con 0x7fad0015c860 2023-07-14T11:18:18.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.101+0000 7facff7fe700 1 -- 172.21.15.84:0/3503564089 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf40036a0 con 0x7fad0015c860 2023-07-14T11:18:18.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.101+0000 7fad06bff700 1 -- 172.21.15.84:0/3503564089 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad0015c860 msgr2=0x7fad000d1e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:18.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.101+0000 7fad06bff700 1 --2- 172.21.15.84:0/3503564089 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad0015c860 0x7fad000d1e40 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7facf4009840 tx=0x7facf4009b50 comp rx=0 tx=0).stop 2023-07-14T11:18:18.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.102+0000 7fad06bff700 1 -- 172.21.15.84:0/3503564089 shutdown_connections 2023-07-14T11:18:18.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.102+0000 7fad06bff700 1 --2- 172.21.15.84:0/3503564089 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad0015c860 0x7fad000d1e40 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:18.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.102+0000 7fad06bff700 1 -- 172.21.15.84:0/3503564089 >> 172.21.15.84:0/3503564089 conn(0x7fad00065bd0 msgr2=0x7fad00065fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:18.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.102+0000 7fad06bff700 1 -- 172.21.15.84:0/3503564089 shutdown_connections 2023-07-14T11:18:18.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.102+0000 7fad06bff700 1 -- 172.21.15.84:0/3503564089 wait complete. 2023-07-14T11:18:18.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.103+0000 7fad06bff700 1 Processor -- start 2023-07-14T11:18:18.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.103+0000 7fad06bff700 1 -- start start 2023-07-14T11:18:18.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.104+0000 7fad06bff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad000c71b0 0x7fad0015d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:18.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.104+0000 7fad06bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fad000cf2a0 0x7fad000ca020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:18.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.104+0000 7fad06bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad0015c860 0x7fad001e6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:18.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.104+0000 7fad06bff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad000c61a0 con 0x7fad000c71b0 2023-07-14T11:18:18.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.104+0000 7fad06bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad0015d9f0 con 0x7fad0015c860 2023-07-14T11:18:18.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.104+0000 7fad06bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad0015dc90 con 0x7fad000cf2a0 2023-07-14T11:18:18.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.105+0000 7fad0499b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad000c71b0 0x7fad0015d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:18.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.105+0000 7fad0499b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad000c71b0 0x7fad0015d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37938/0 (socket says 172.21.15.84:37938) 2023-07-14T11:18:18.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.105+0000 7fad0499b700 1 -- 172.21.15.84:0/2694985665 learned_addr learned my addr 172.21.15.84:0/2694985665 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:18.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.105+0000 7fad0519c700 1 --2- 172.21.15.84:0/2694985665 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad0015c860 0x7fad001e6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:18.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.105+0000 7facfffff700 1 --2- 172.21.15.84:0/2694985665 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fad000cf2a0 0x7fad000ca020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:18.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.105+0000 7fad0499b700 1 -- 172.21.15.84:0/2694985665 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fad000cf2a0 msgr2=0x7fad000ca020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:18.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.105+0000 7fad0499b700 1 --2- 172.21.15.84:0/2694985665 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fad000cf2a0 0x7fad000ca020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:18.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.105+0000 7fad0499b700 1 -- 172.21.15.84:0/2694985665 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad0015c860 msgr2=0x7fad001e6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:18.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.105+0000 7fad0499b700 1 --2- 172.21.15.84:0/2694985665 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad0015c860 0x7fad001e6910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:18.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.105+0000 7fad0499b700 1 -- 172.21.15.84:0/2694985665 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facf40094a0 con 0x7fad000c71b0 2023-07-14T11:18:18.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.105+0000 7facfffff700 1 --2- 172.21.15.84:0/2694985665 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fad000cf2a0 0x7fad000ca020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:18:18.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.105+0000 7fad0499b700 1 --2- 172.21.15.84:0/2694985665 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad000c71b0 0x7fad0015d4b0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7facf40090b0 tx=0x7facf40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:18.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.106+0000 7facfd7fa700 1 -- 172.21.15.84:0/2694985665 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf4011630 con 0x7fad000c71b0 2023-07-14T11:18:18.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.106+0000 7facfd7fa700 1 -- 172.21.15.84:0/2694985665 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facf4011790 con 0x7fad000c71b0 2023-07-14T11:18:18.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.106+0000 7facfd7fa700 1 -- 172.21.15.84:0/2694985665 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf4011b40 con 0x7fad000c71b0 2023-07-14T11:18:18.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.106+0000 7fad06bff700 1 -- 172.21.15.84:0/2694985665 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad0015df70 con 0x7fad000c71b0 2023-07-14T11:18:18.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.106+0000 7fad06bff700 1 -- 172.21.15.84:0/2694985665 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad0015e530 con 0x7fad000c71b0 2023-07-14T11:18:18.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.107+0000 7fad06bff700 1 -- 172.21.15.84:0/2694985665 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad00074350 con 0x7fad000c71b0 2023-07-14T11:18:18.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.108+0000 7facfd7fa700 1 -- 172.21.15.84:0/2694985665 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7facf4011ca0 con 0x7fad000c71b0 2023-07-14T11:18:18.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.109+0000 7facfd7fa700 1 --2- 172.21.15.84:0/2694985665 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7face406b040 0x7face406d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:18.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.109+0000 7facfd7fa700 1 -- 172.21.15.84:0/2694985665 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6062+0+0 (secure 0 0 0) 0x7facf408b230 con 0x7fad000c71b0 2023-07-14T11:18:18.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.109+0000 7facfffff700 1 --2- 172.21.15.84:0/2694985665 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7face406b040 0x7face406d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:18.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.110+0000 7facfffff700 1 --2- 172.21.15.84:0/2694985665 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7face406b040 0x7face406d4f0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fad000d2e20 tx=0x7facec009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:18.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.113+0000 7facfd7fa700 1 -- 172.21.15.84:0/2694985665 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7facf4055f60 con 0x7fad000c71b0 2023-07-14T11:18:18.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.325+0000 7fad06bff700 1 -- 172.21.15.84:0/2694985665 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fad000ce5a0 con 0x7fad000c71b0 2023-07-14T11:18:18.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.325+0000 7facfd7fa700 1 -- 172.21.15.84:0/2694985665 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v75) v1 ==== 80+0+0 (secure 0 0 0) 0x7facf4059580 con 0x7fad000c71b0 2023-07-14T11:18:18.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.327+0000 7fad06bff700 1 -- 172.21.15.84:0/2694985665 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7face406b040 msgr2=0x7face406d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:18.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.327+0000 7fad06bff700 1 --2- 172.21.15.84:0/2694985665 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7face406b040 0x7face406d4f0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fad000d2e20 tx=0x7facec009040 comp rx=0 tx=0).stop 2023-07-14T11:18:18.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.327+0000 7fad06bff700 1 -- 172.21.15.84:0/2694985665 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad000c71b0 msgr2=0x7fad0015d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:18.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.327+0000 7fad06bff700 1 --2- 172.21.15.84:0/2694985665 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad000c71b0 0x7fad0015d4b0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7facf40090b0 tx=0x7facf40047c0 comp rx=0 tx=0).stop 2023-07-14T11:18:18.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.327+0000 7fad06bff700 1 -- 172.21.15.84:0/2694985665 shutdown_connections 2023-07-14T11:18:18.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.327+0000 7fad06bff700 1 --2- 172.21.15.84:0/2694985665 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad0015c860 0x7fad001e6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:18.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.327+0000 7fad06bff700 1 --2- 172.21.15.84:0/2694985665 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad000c71b0 0x7fad0015d4b0 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:18.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.327+0000 7fad06bff700 1 --2- 172.21.15.84:0/2694985665 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7face406b040 0x7face406d4f0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:18.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.327+0000 7fad06bff700 1 --2- 172.21.15.84:0/2694985665 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fad000cf2a0 0x7fad000ca020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:18.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.327+0000 7fad06bff700 1 -- 172.21.15.84:0/2694985665 >> 172.21.15.84:0/2694985665 conn(0x7fad00065bd0 msgr2=0x7fad0015a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:18.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.328+0000 7fad06bff700 1 -- 172.21.15.84:0/2694985665 shutdown_connections 2023-07-14T11:18:18.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.328+0000 7fad06bff700 1 -- 172.21.15.84:0/2694985665 wait complete. 2023-07-14T11:18:18.332 INFO:teuthology.orchestra.run.smithi084.stderr:listed 0 entries 2023-07-14T11:18:18.347 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-07-14T11:18:18.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:18:18.348 DEBUG:teuthology.orchestra.run.smithi179:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-07-14T11:18:18.440 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi179.front.sepia.ceph.com 2023-07-14T11:18:18.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:18:18.441 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-14T11:18:18.489 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T11:18:18.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.683+0000 7f69103ff700 1 Processor -- start 2023-07-14T11:18:18.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.683+0000 7f69103ff700 1 -- start start 2023-07-14T11:18:18.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.684+0000 7f69103ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f690806ae40 0x7f69081672b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:18.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.684+0000 7f69103ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69080cd4e0 con 0x7f69080cfc60 2023-07-14T11:18:18.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.684+0000 7f69103ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69080cdcf0 con 0x7f69080b87d0 2023-07-14T11:18:18.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.684+0000 7f69103ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6908160f70 con 0x7f690806ae40 2023-07-14T11:18:18.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.685+0000 7f690d99a700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f69080cfc60 0x7f6908160860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:59842/0 (socket says 172.21.15.84:59842) 2023-07-14T11:18:18.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.685+0000 7f690d99a700 1 -- 172.21.15.84:0/787624926 learned_addr learned my addr 172.21.15.84:0/787624926 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:18:18.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.685+0000 7f690e99c700 1 --2- 172.21.15.84:0/787624926 >> v2:172.21.15.84:3300/0 conn(0x7f690806ae40 0x7f69081672b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:18.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.685+0000 7f690d199700 1 -- 172.21.15.84:0/787624926 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1418898015 0 0) 0x7f69080cd4e0 con 0x7f69080cfc60 2023-07-14T11:18:18.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.685+0000 7f690d199700 1 -- 172.21.15.84:0/787624926 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68f40035b0 con 0x7f69080cfc60 2023-07-14T11:18:18.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.685+0000 7f690d199700 1 -- 172.21.15.84:0/787624926 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1154753383 0 0) 0x7f69080cdcf0 con 0x7f69080b87d0 2023-07-14T11:18:18.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.685+0000 7f690e99c700 1 -- 172.21.15.84:0/787624926 >> v1:172.21.15.179:6789/0 conn(0x7f69080b87d0 legacy=0x7f6908160150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:18.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.685+0000 7f690e99c700 1 -- 172.21.15.84:0/787624926 >> v1:172.21.15.84:6789/0 conn(0x7f69080cfc60 legacy=0x7f6908160860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:18.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.685+0000 7f690e99c700 1 -- 172.21.15.84:0/787624926 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69080d00d0 con 0x7f690806ae40 2023-07-14T11:18:18.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.685+0000 7f690e99c700 1 --2- 172.21.15.84:0/787624926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f690806ae40 0x7f69081672b0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f6900009d90 tx=0x7f690000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4ff68f4848c3b06 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:18.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.686+0000 7f690d199700 1 -- 172.21.15.84:0/787624926 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f690000e070 con 0x7f690806ae40 2023-07-14T11:18:18.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.686+0000 7f690d199700 1 -- 172.21.15.84:0/787624926 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f690000bb20 con 0x7f690806ae40 2023-07-14T11:18:18.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.686+0000 7f690d199700 1 -- 172.21.15.84:0/787624926 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f690000bed0 con 0x7f690806ae40 2023-07-14T11:18:18.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.686+0000 7f69103ff700 1 -- 172.21.15.84:0/787624926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f690806ae40 msgr2=0x7f69081672b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:18.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.686+0000 7f69103ff700 1 --2- 172.21.15.84:0/787624926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f690806ae40 0x7f69081672b0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f6900009d90 tx=0x7f690000b330 comp rx=0 tx=0).stop 2023-07-14T11:18:18.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.686+0000 7f69103ff700 1 -- 172.21.15.84:0/787624926 shutdown_connections 2023-07-14T11:18:18.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.686+0000 7f69103ff700 1 --2- 172.21.15.84:0/787624926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f690806ae40 0x7f69081672b0 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:18.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.686+0000 7f69103ff700 1 -- 172.21.15.84:0/787624926 >> 172.21.15.84:0/787624926 conn(0x7f690806c140 msgr2=0x7f690806c510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:18.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.686+0000 7f69103ff700 1 -- 172.21.15.84:0/787624926 shutdown_connections 2023-07-14T11:18:18.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.686+0000 7f69103ff700 1 -- 172.21.15.84:0/787624926 wait complete. 2023-07-14T11:18:18.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.688+0000 7f69103ff700 1 Processor -- start 2023-07-14T11:18:18.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.688+0000 7f69103ff700 1 -- start start 2023-07-14T11:18:18.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.689+0000 7f69103ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69080b87d0 0x7f690815f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:18.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.689+0000 7f69103ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69080cfc60 0x7f690815f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:18.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.689+0000 7f69103ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f690815b750 0x7f69081f2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:18.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.689+0000 7f69103ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f690815fe50 con 0x7f690815b750 2023-07-14T11:18:18.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.689+0000 7f69103ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6908160c40 con 0x7f69080cfc60 2023-07-14T11:18:18.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.689+0000 7f69103ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69081600c0 con 0x7f69080b87d0 2023-07-14T11:18:18.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.689+0000 7f690e99c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f690815b750 0x7f69081f2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:18.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.690+0000 7f690e99c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f690815b750 0x7f69081f2060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37962/0 (socket says 172.21.15.84:37962) 2023-07-14T11:18:18.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.690+0000 7f690e99c700 1 -- 172.21.15.84:0/2463333562 learned_addr learned my addr 172.21.15.84:0/2463333562 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:18.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.690+0000 7f690e19b700 1 --2- 172.21.15.84:0/2463333562 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69080b87d0 0x7f690815f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:18.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.690+0000 7f690d99a700 1 --2- 172.21.15.84:0/2463333562 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69080cfc60 0x7f690815f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:18.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.690+0000 7f690e99c700 1 -- 172.21.15.84:0/2463333562 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69080b87d0 msgr2=0x7f690815f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:18.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.690+0000 7f690e99c700 1 --2- 172.21.15.84:0/2463333562 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69080b87d0 0x7f690815f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:18.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.690+0000 7f690e99c700 1 -- 172.21.15.84:0/2463333562 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69080cfc60 msgr2=0x7f690815f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:18.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.690+0000 7f690e99c700 1 --2- 172.21.15.84:0/2463333562 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69080cfc60 0x7f690815f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:18.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.690+0000 7f690e99c700 1 -- 172.21.15.84:0/2463333562 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6900009a70 con 0x7f690815b750 2023-07-14T11:18:18.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.690+0000 7f690e99c700 1 --2- 172.21.15.84:0/2463333562 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f690815b750 0x7f69081f2060 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f6900014040 tx=0x7f6900004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:18.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.690+0000 7f68feffd700 1 -- 172.21.15.84:0/2463333562 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f690001b8d0 con 0x7f690815b750 2023-07-14T11:18:18.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.690+0000 7f68feffd700 1 -- 172.21.15.84:0/2463333562 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6900020070 con 0x7f690815b750 2023-07-14T11:18:18.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.691+0000 7f68feffd700 1 -- 172.21.15.84:0/2463333562 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f690001bc70 con 0x7f690815b750 2023-07-14T11:18:18.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.691+0000 7f69103ff700 1 -- 172.21.15.84:0/2463333562 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69081603a0 con 0x7f690815b750 2023-07-14T11:18:18.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.691+0000 7f69103ff700 1 -- 172.21.15.84:0/2463333562 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6908160960 con 0x7f690815b750 2023-07-14T11:18:18.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.692+0000 7f69103ff700 1 -- 172.21.15.84:0/2463333562 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69080cead0 con 0x7f690815b750 2023-07-14T11:18:18.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.693+0000 7f68feffd700 1 -- 172.21.15.84:0/2463333562 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7f690001c400 con 0x7f690815b750 2023-07-14T11:18:18.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.693+0000 7f68feffd700 1 --2- 172.21.15.84:0/2463333562 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f68ec06b040 0x7f68ec06d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:18.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.694+0000 7f68feffd700 1 -- 172.21.15.84:0/2463333562 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6900022070 con 0x7f690815b750 2023-07-14T11:18:18.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.694+0000 7f690e19b700 1 --2- 172.21.15.84:0/2463333562 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f68ec06b040 0x7f68ec06d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:18.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.694+0000 7f690e19b700 1 --2- 172.21.15.84:0/2463333562 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f68ec06b040 0x7f68ec06d4f0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f6904000f60 tx=0x7f6904009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:18.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.698+0000 7f68feffd700 1 -- 172.21.15.84:0/2463333562 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f690005a280 con 0x7f690815b750 2023-07-14T11:18:18.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.935+0000 7f69103ff700 1 -- 172.21.15.84:0/2463333562 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f690804e280 con 0x7f690815b750 2023-07-14T11:18:18.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.936+0000 7f68feffd700 1 -- 172.21.15.84:0/2463333562 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4717 (secure 0 0 0) 0x7f6900059e10 con 0x7f690815b750 2023-07-14T11:18:18.938 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:18:18.939 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":46,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5615,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3014145470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3014145470},{"type":"v1","addr":"172.21.15.179:6834","nonce":3014145470}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":5621,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3377004712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":3377004712},{"type":"v1","addr":"172.21.15.179:6835","nonce":3377004712}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":6681,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1864489758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1864489758},{"type":"v1","addr":"172.21.15.84:6835","nonce":1864489758}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T11:17:55.741927+0000","modified":"2023-07-14T11:17:59.277009+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6690},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6690":{"gid":6690,"name":"c","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/2405785300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":2405785300},{"type":"v1","addr":"172.21.15.84:6837","nonce":2405785300}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-07-14T11:18:18.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.938+0000 7f69103ff700 1 -- 172.21.15.84:0/2463333562 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f68ec06b040 msgr2=0x7f68ec06d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:18.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.938+0000 7f69103ff700 1 --2- 172.21.15.84:0/2463333562 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f68ec06b040 0x7f68ec06d4f0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f6904000f60 tx=0x7f6904009040 comp rx=0 tx=0).stop 2023-07-14T11:18:18.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.938+0000 7f69103ff700 1 -- 172.21.15.84:0/2463333562 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f690815b750 msgr2=0x7f69081f2060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:18.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.938+0000 7f69103ff700 1 --2- 172.21.15.84:0/2463333562 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f690815b750 0x7f69081f2060 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f6900014040 tx=0x7f6900004ad0 comp rx=0 tx=0).stop 2023-07-14T11:18:18.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.938+0000 7f69103ff700 1 -- 172.21.15.84:0/2463333562 shutdown_connections 2023-07-14T11:18:18.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.938+0000 7f69103ff700 1 --2- 172.21.15.84:0/2463333562 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f68ec06b040 0x7f68ec06d4f0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:18.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.938+0000 7f69103ff700 1 --2- 172.21.15.84:0/2463333562 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69080b87d0 0x7f690815f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:18.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.938+0000 7f69103ff700 1 --2- 172.21.15.84:0/2463333562 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f690815b750 0x7f69081f2060 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:18.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.938+0000 7f69103ff700 1 --2- 172.21.15.84:0/2463333562 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69080cfc60 0x7f690815f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:18.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.938+0000 7f69103ff700 1 -- 172.21.15.84:0/2463333562 >> 172.21.15.84:0/2463333562 conn(0x7f690806c140 msgr2=0x7f69080b27d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:18.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.938+0000 7f69103ff700 1 -- 172.21.15.84:0/2463333562 shutdown_connections 2023-07-14T11:18:18.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:18.938+0000 7f69103ff700 1 -- 172.21.15.84:0/2463333562 wait complete. 2023-07-14T11:18:18.943 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 46 2023-07-14T11:18:18.959 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2023-07-14T11:18:19.178 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2023-07-14T11:18:19.179 DEBUG:tasks.cephfs.filesystem:_json_asok output [] 2023-07-14T11:18:19.179 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvolume_0000000000993896 2023-07-14T11:18:19.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.376+0000 7f21dc7ff700 1 Processor -- start 2023-07-14T11:18:19.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.376+0000 7f21dc7ff700 1 -- start start 2023-07-14T11:18:19.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.378+0000 7f21dc7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21d413f650 0x7f21d40cb270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:19.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.378+0000 7f21dc7ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f21d4142430 0x7f21d40cb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:19.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.378+0000 7f21dc7ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21d415d320 con 0x7f21d415cd60 2023-07-14T11:18:19.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.378+0000 7f21dc7ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21d415d600 con 0x7f21d4142430 2023-07-14T11:18:19.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.378+0000 7f21dc7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21d415d8e0 con 0x7f21d413f650 2023-07-14T11:18:19.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.378+0000 7f21d9d9a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f21d4142430 0x7f21d40cb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:19.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.378+0000 7f21dad9c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f21d415cd60 0x7f21d40cd670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48944/0 (socket says 172.21.15.84:48944) 2023-07-14T11:18:19.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.378+0000 7f21dad9c700 1 -- 172.21.15.84:0/2126139575 learned_addr learned my addr 172.21.15.84:0/2126139575 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:18:19.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.378+0000 7f21da59b700 1 --2- 172.21.15.84:0/2126139575 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21d413f650 0x7f21d40cb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:19.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.378+0000 7f21d9d9a700 1 -- 172.21.15.84:0/2126139575 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21d413f650 msgr2=0x7f21d40cb270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:19.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.378+0000 7f21d9d9a700 1 --2- 172.21.15.84:0/2126139575 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21d413f650 0x7f21d40cb270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:19.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.378+0000 7f21d9d9a700 1 -- 172.21.15.84:0/2126139575 >> v1:172.21.15.84:6789/0 conn(0x7f21d415cd60 legacy=0x7f21d40cd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:19.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.378+0000 7f21d9d9a700 1 -- 172.21.15.84:0/2126139575 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21d415dbc0 con 0x7f21d4142430 2023-07-14T11:18:19.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.378+0000 7f21d9599700 1 -- 172.21.15.84:0/2126139575 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 653182523 0 0) 0x7f21d415d320 con 0x7f21d415cd60 2023-07-14T11:18:19.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.379+0000 7f21d9d9a700 1 --2- 172.21.15.84:0/2126139575 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21d4142430 0x7f21d40cb7b0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f21c4009840 tx=0x7f21c4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afccc419998c7d63 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:19.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.379+0000 7f21d9599700 1 -- 172.21.15.84:0/2126139575 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c4011830 con 0x7f21d4142430 2023-07-14T11:18:19.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.379+0000 7f21d9599700 1 -- 172.21.15.84:0/2126139575 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21c4011990 con 0x7f21d4142430 2023-07-14T11:18:19.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.379+0000 7f21d9599700 1 -- 172.21.15.84:0/2126139575 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c4011d20 con 0x7f21d4142430 2023-07-14T11:18:19.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.379+0000 7f21dc7ff700 1 -- 172.21.15.84:0/2126139575 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21d4142430 msgr2=0x7f21d40cb7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:19.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.379+0000 7f21dc7ff700 1 --2- 172.21.15.84:0/2126139575 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21d4142430 0x7f21d40cb7b0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f21c4009840 tx=0x7f21c4009b50 comp rx=0 tx=0).stop 2023-07-14T11:18:19.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.379+0000 7f21dc7ff700 1 -- 172.21.15.84:0/2126139575 shutdown_connections 2023-07-14T11:18:19.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.379+0000 7f21dc7ff700 1 --2- 172.21.15.84:0/2126139575 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21d413f650 0x7f21d40cb270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:19.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.379+0000 7f21dc7ff700 1 --2- 172.21.15.84:0/2126139575 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21d4142430 0x7f21d40cb7b0 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:19.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.379+0000 7f21dc7ff700 1 -- 172.21.15.84:0/2126139575 >> 172.21.15.84:0/2126139575 conn(0x7f21d40b0640 msgr2=0x7f21d40b0a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:19.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.380+0000 7f21dc7ff700 1 -- 172.21.15.84:0/2126139575 shutdown_connections 2023-07-14T11:18:19.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.380+0000 7f21dc7ff700 1 -- 172.21.15.84:0/2126139575 wait complete. 2023-07-14T11:18:19.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.381+0000 7f21dc7ff700 1 Processor -- start 2023-07-14T11:18:19.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.381+0000 7f21dc7ff700 1 -- start start 2023-07-14T11:18:19.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.382+0000 7f21dc7ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21d413f650 0x7f21d4140c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:19.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.382+0000 7f21dc7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21d4142430 0x7f21d40706d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:19.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.382+0000 7f21dc7ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21d415cd60 0x7f21d415b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:19.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.382+0000 7f21dc7ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d4140610 con 0x7f21d413f650 2023-07-14T11:18:19.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.382+0000 7f21dc7ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d4140a30 con 0x7f21d415cd60 2023-07-14T11:18:19.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.382+0000 7f21dc7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21d413fa20 con 0x7f21d4142430 2023-07-14T11:18:19.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.383+0000 7f21da59b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21d413f650 0x7f21d4140c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:19.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.383+0000 7f21da59b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21d413f650 0x7f21d4140c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58598/0 (socket says 172.21.15.84:58598) 2023-07-14T11:18:19.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.383+0000 7f21da59b700 1 -- 172.21.15.84:0/2765588435 learned_addr learned my addr 172.21.15.84:0/2765588435 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:19.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.383+0000 7f21d9d9a700 1 --2- 172.21.15.84:0/2765588435 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21d4142430 0x7f21d40706d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:19.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.383+0000 7f21dad9c700 1 --2- 172.21.15.84:0/2765588435 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21d415cd60 0x7f21d415b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:19.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.383+0000 7f21da59b700 1 -- 172.21.15.84:0/2765588435 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21d4142430 msgr2=0x7f21d40706d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:19.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.383+0000 7f21da59b700 1 --2- 172.21.15.84:0/2765588435 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21d4142430 0x7f21d40706d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:19.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.383+0000 7f21da59b700 1 -- 172.21.15.84:0/2765588435 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21d415cd60 msgr2=0x7f21d415b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:19.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.383+0000 7f21da59b700 1 --2- 172.21.15.84:0/2765588435 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21d415cd60 0x7f21d415b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:19.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.383+0000 7f21da59b700 1 -- 172.21.15.84:0/2765588435 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c40094a0 con 0x7f21d413f650 2023-07-14T11:18:19.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.383+0000 7f21da59b700 1 --2- 172.21.15.84:0/2765588435 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21d413f650 0x7f21d4140c00 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f21d000e840 tx=0x7f21d000eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:19.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.383+0000 7f21caffd700 1 -- 172.21.15.84:0/2765588435 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d0013610 con 0x7f21d413f650 2023-07-14T11:18:19.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.384+0000 7f21caffd700 1 -- 172.21.15.84:0/2765588435 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21d0013770 con 0x7f21d413f650 2023-07-14T11:18:19.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.384+0000 7f21dc7ff700 1 -- 172.21.15.84:0/2765588435 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21d413fc70 con 0x7f21d413f650 2023-07-14T11:18:19.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.384+0000 7f21caffd700 1 -- 172.21.15.84:0/2765588435 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d0013b20 con 0x7f21d413f650 2023-07-14T11:18:19.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.384+0000 7f21dc7ff700 1 -- 172.21.15.84:0/2765588435 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21d4140000 con 0x7f21d413f650 2023-07-14T11:18:19.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.385+0000 7f21dc7ff700 1 -- 172.21.15.84:0/2765588435 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21d404e210 con 0x7f21d413f650 2023-07-14T11:18:19.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.386+0000 7f21caffd700 1 -- 172.21.15.84:0/2765588435 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7f21d0013c80 con 0x7f21d413f650 2023-07-14T11:18:19.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.386+0000 7f21caffd700 1 --2- 172.21.15.84:0/2765588435 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f21b806b040 0x7f21b806d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:19.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.387+0000 7f21caffd700 1 -- 172.21.15.84:0/2765588435 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f21d00896a0 con 0x7f21d413f650 2023-07-14T11:18:19.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.387+0000 7f21d9d9a700 1 --2- 172.21.15.84:0/2765588435 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f21b806b040 0x7f21b806d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:19.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.387+0000 7f21d9d9a700 1 --2- 172.21.15.84:0/2765588435 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f21b806b040 0x7f21b806d4f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f21c40090b0 tx=0x7f21c4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:19.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.391+0000 7f21caffd700 1 -- 172.21.15.84:0/2765588435 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f21d0057c90 con 0x7f21d413f650 2023-07-14T11:18:19.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.615+0000 7f21dc7ff700 1 -- 172.21.15.84:0/2765588435 --> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_0000000000993896", "target": ["mon-mgr", ""]}) v1 -- 0x7f21d4142bb0 con 0x7f21b806b040 2023-07-14T11:18:19.623 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:18:19.621+0000 7fed0d3be700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T11:18:19.624 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:18:19.621+0000 7fed0d3be700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T11:18:19.624 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:18:19.621+0000 7fed0d3be700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T11:18:19.624 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:18:19.621+0000 7fed0d3be700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T11:18:19.624 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:18:19.621+0000 7fed0d3be700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T11:18:19.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.655+0000 7f21caffd700 1 -- 172.21.15.84:0/2765588435 <== mgr.4104 v2:172.21.15.84:6832/379617029 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f21c4011630 con 0x7f21b806b040 2023-07-14T11:18:19.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.658+0000 7f21dc7ff700 1 -- 172.21.15.84:0/2765588435 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f21b806b040 msgr2=0x7f21b806d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:19.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.658+0000 7f21dc7ff700 1 --2- 172.21.15.84:0/2765588435 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f21b806b040 0x7f21b806d4f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f21c40090b0 tx=0x7f21c4008030 comp rx=0 tx=0).stop 2023-07-14T11:18:19.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.658+0000 7f21dc7ff700 1 -- 172.21.15.84:0/2765588435 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21d413f650 msgr2=0x7f21d4140c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:19.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.658+0000 7f21dc7ff700 1 --2- 172.21.15.84:0/2765588435 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21d413f650 0x7f21d4140c00 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f21d000e840 tx=0x7f21d000eb50 comp rx=0 tx=0).stop 2023-07-14T11:18:19.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.658+0000 7f21dc7ff700 1 -- 172.21.15.84:0/2765588435 shutdown_connections 2023-07-14T11:18:19.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.658+0000 7f21dc7ff700 1 --2- 172.21.15.84:0/2765588435 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21d415cd60 0x7f21d415b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:19.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.658+0000 7f21dc7ff700 1 --2- 172.21.15.84:0/2765588435 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21d413f650 0x7f21d4140c00 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:19.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.658+0000 7f21dc7ff700 1 --2- 172.21.15.84:0/2765588435 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f21b806b040 0x7f21b806d4f0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:19.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.658+0000 7f21dc7ff700 1 --2- 172.21.15.84:0/2765588435 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21d4142430 0x7f21d40706d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:19.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.658+0000 7f21dc7ff700 1 -- 172.21.15.84:0/2765588435 >> 172.21.15.84:0/2765588435 conn(0x7f21d40b0640 msgr2=0x7f21d4073100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:19.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.658+0000 7f21dc7ff700 1 -- 172.21.15.84:0/2765588435 shutdown_connections 2023-07-14T11:18:19.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.658+0000 7f21dc7ff700 1 -- 172.21.15.84:0/2765588435 wait complete. 2023-07-14T11:18:19.678 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T11:18:19.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.870+0000 7feeff5ff700 1 Processor -- start 2023-07-14T11:18:19.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.871+0000 7feeff5ff700 1 -- start start 2023-07-14T11:18:19.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.872+0000 7feeff5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feef81597c0 0x7feef8159c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:19.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.872+0000 7feeff5ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7feef80cea50 0x7feef80ceeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:19.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.872+0000 7feeff5ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feef80cdf90 con 0x7feef81500d0 2023-07-14T11:18:19.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.872+0000 7feeff5ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feef815a2f0 con 0x7feef80cea50 2023-07-14T11:18:19.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.872+0000 7feeff5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feef815a5d0 con 0x7feef81597c0 2023-07-14T11:18:19.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.872+0000 7feefcb9a700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feef81597c0 0x7feef8159c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:19.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.872+0000 7feefdb9c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7feef80cea50 0x7feef80ceeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:19.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.872+0000 7feefd39b700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7feef81500d0 0x7feef8070350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.84:49764/0 (socket says 172.21.15.84:49764) 2023-07-14T11:18:19.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.872+0000 7feefd39b700 1 -- 172.21.15.84:0/1623149503 learned_addr learned my addr 172.21.15.84:0/1623149503 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:18:19.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.873+0000 7feeeffff700 1 -- 172.21.15.84:0/1623149503 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1345086684 0 0) 0x7feef80cdf90 con 0x7feef81500d0 2023-07-14T11:18:19.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.873+0000 7feeeffff700 1 -- 172.21.15.84:0/1623149503 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feee40035b0 con 0x7feef81500d0 2023-07-14T11:18:19.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.873+0000 7feefcb9a700 1 -- 172.21.15.84:0/1623149503 >> v2:172.21.15.179:3300/0 conn(0x7feef80cea50 msgr2=0x7feef80ceeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:19.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.873+0000 7feefcb9a700 1 --2- 172.21.15.84:0/1623149503 >> v2:172.21.15.179:3300/0 conn(0x7feef80cea50 0x7feef80ceeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:19.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.873+0000 7feefcb9a700 1 -- 172.21.15.84:0/1623149503 >> v1:172.21.15.179:6789/0 conn(0x7feef81500d0 legacy=0x7feef8070350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:19.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.873+0000 7feefcb9a700 1 -- 172.21.15.84:0/1623149503 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef80ce250 con 0x7feef81597c0 2023-07-14T11:18:19.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.873+0000 7feefdb9c700 1 --2- 172.21.15.84:0/1623149503 >> v2:172.21.15.179:3300/0 conn(0x7feef80cea50 0x7feef80ceeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:18:19.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.873+0000 7feefcb9a700 1 --2- 172.21.15.84:0/1623149503 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feef81597c0 0x7feef8159c30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7feee8009840 tx=0x7feee8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2f13aca4ad3b4d7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:19.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.873+0000 7feeeffff700 1 -- 172.21.15.84:0/1623149503 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee8011830 con 0x7feef81597c0 2023-07-14T11:18:19.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.873+0000 7feeeffff700 1 -- 172.21.15.84:0/1623149503 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feee8011990 con 0x7feef81597c0 2023-07-14T11:18:19.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.873+0000 7feeeffff700 1 -- 172.21.15.84:0/1623149503 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee8011d20 con 0x7feef81597c0 2023-07-14T11:18:19.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.874+0000 7feeff5ff700 1 -- 172.21.15.84:0/1623149503 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feef81597c0 msgr2=0x7feef8159c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:19.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.874+0000 7feeff5ff700 1 --2- 172.21.15.84:0/1623149503 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feef81597c0 0x7feef8159c30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7feee8009840 tx=0x7feee8009b50 comp rx=0 tx=0).stop 2023-07-14T11:18:19.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.874+0000 7feeff5ff700 1 -- 172.21.15.84:0/1623149503 shutdown_connections 2023-07-14T11:18:19.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.874+0000 7feeff5ff700 1 --2- 172.21.15.84:0/1623149503 >> v2:172.21.15.179:3300/0 conn(0x7feef80cea50 0x7feef80ceeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:19.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.874+0000 7feeff5ff700 1 --2- 172.21.15.84:0/1623149503 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feef81597c0 0x7feef8159c30 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:19.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.874+0000 7feeff5ff700 1 -- 172.21.15.84:0/1623149503 >> 172.21.15.84:0/1623149503 conn(0x7feef8069f30 msgr2=0x7feef806a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:19.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.874+0000 7feeff5ff700 1 -- 172.21.15.84:0/1623149503 shutdown_connections 2023-07-14T11:18:19.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.874+0000 7feeff5ff700 1 -- 172.21.15.84:0/1623149503 wait complete. 2023-07-14T11:18:19.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.876+0000 7feeff5ff700 1 Processor -- start 2023-07-14T11:18:19.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.876+0000 7feeff5ff700 1 -- start start 2023-07-14T11:18:19.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.877+0000 7feeff5ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feef80cea50 0x7feef813bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:19.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.877+0000 7feeff5ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feef81500d0 0x7feef8152c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:19.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.877+0000 7feeff5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feef81597c0 0x7feef8153140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:19.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.877+0000 7feeff5ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef8140ab0 con 0x7feef81500d0 2023-07-14T11:18:19.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.877+0000 7feeff5ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef813fa10 con 0x7feef80cea50 2023-07-14T11:18:19.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.877+0000 7feeff5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feef813fcf0 con 0x7feef81597c0 2023-07-14T11:18:19.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.877+0000 7feefcb9a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feef81500d0 0x7feef8152c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:19.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.877+0000 7feefcb9a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feef81500d0 0x7feef8152c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58634/0 (socket says 172.21.15.84:58634) 2023-07-14T11:18:19.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.877+0000 7feefcb9a700 1 -- 172.21.15.84:0/1923685364 learned_addr learned my addr 172.21.15.84:0/1923685364 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:19.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.877+0000 7feefd39b700 1 --2- 172.21.15.84:0/1923685364 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feef80cea50 0x7feef813bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:19.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.877+0000 7feefdb9c700 1 --2- 172.21.15.84:0/1923685364 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feef81597c0 0x7feef8153140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:19.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.878+0000 7feefcb9a700 1 -- 172.21.15.84:0/1923685364 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feef81597c0 msgr2=0x7feef8153140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:19.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.878+0000 7feefcb9a700 1 --2- 172.21.15.84:0/1923685364 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feef81597c0 0x7feef8153140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:19.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.878+0000 7feefcb9a700 1 -- 172.21.15.84:0/1923685364 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feef80cea50 msgr2=0x7feef813bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:19.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.878+0000 7feefcb9a700 1 --2- 172.21.15.84:0/1923685364 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feef80cea50 0x7feef813bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:19.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.878+0000 7feefcb9a700 1 -- 172.21.15.84:0/1923685364 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef0009a70 con 0x7feef81500d0 2023-07-14T11:18:19.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.878+0000 7feefd39b700 1 --2- 172.21.15.84:0/1923685364 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feef80cea50 0x7feef813bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:18:19.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.878+0000 7feefcb9a700 1 --2- 172.21.15.84:0/1923685364 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feef81500d0 0x7feef8152c00 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7feee8014040 tx=0x7feee8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:19.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.878+0000 7feeedffb700 1 -- 172.21.15.84:0/1923685364 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee80038a0 con 0x7feef81500d0 2023-07-14T11:18:19.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.878+0000 7feeff5ff700 1 -- 172.21.15.84:0/1923685364 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feee80094a0 con 0x7feef81500d0 2023-07-14T11:18:19.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.878+0000 7feeedffb700 1 -- 172.21.15.84:0/1923685364 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feee801f070 con 0x7feef81500d0 2023-07-14T11:18:19.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.878+0000 7feeedffb700 1 -- 172.21.15.84:0/1923685364 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee8003c00 con 0x7feef81500d0 2023-07-14T11:18:19.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.878+0000 7feeff5ff700 1 -- 172.21.15.84:0/1923685364 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feef81402b0 con 0x7feef81500d0 2023-07-14T11:18:19.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.879+0000 7feeff5ff700 1 -- 172.21.15.84:0/1923685364 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feef804e280 con 0x7feef81500d0 2023-07-14T11:18:19.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.880+0000 7feeedffb700 1 -- 172.21.15.84:0/1923685364 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7feee801a430 con 0x7feef81500d0 2023-07-14T11:18:19.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.881+0000 7feeedffb700 1 --2- 172.21.15.84:0/1923685364 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7feedc06b040 0x7feedc06d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:19.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.881+0000 7feeedffb700 1 -- 172.21.15.84:0/1923685364 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6062+0+0 (secure 0 0 0) 0x7feee8021070 con 0x7feef81500d0 2023-07-14T11:18:19.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.881+0000 7feefd39b700 1 --2- 172.21.15.84:0/1923685364 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7feedc06b040 0x7feedc06d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:19.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.882+0000 7feefd39b700 1 --2- 172.21.15.84:0/1923685364 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7feedc06b040 0x7feedc06d4f0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7feef40011e0 tx=0x7feef4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:19.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:19.886+0000 7feeedffb700 1 -- 172.21.15.84:0/1923685364 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7feee8055ef0 con 0x7feef81500d0 2023-07-14T11:18:20.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.126+0000 7feeff5ff700 1 -- 172.21.15.84:0/1923685364 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feef80b1560 con 0x7feef81500d0 2023-07-14T11:18:20.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.126+0000 7feeedffb700 1 -- 172.21.15.84:0/1923685364 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4717 (secure 0 0 0) 0x7feee8059510 con 0x7feef81500d0 2023-07-14T11:18:20.129 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:18:20.129 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":46,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5615,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3014145470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3014145470},{"type":"v1","addr":"172.21.15.179:6834","nonce":3014145470}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":5621,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3377004712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":3377004712},{"type":"v1","addr":"172.21.15.179:6835","nonce":3377004712}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":6681,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1864489758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1864489758},{"type":"v1","addr":"172.21.15.84:6835","nonce":1864489758}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T11:17:55.741927+0000","modified":"2023-07-14T11:17:59.277009+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6690},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6690":{"gid":6690,"name":"c","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/2405785300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":2405785300},{"type":"v1","addr":"172.21.15.84:6837","nonce":2405785300}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-07-14T11:18:20.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.129+0000 7feeff5ff700 1 -- 172.21.15.84:0/1923685364 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7feedc06b040 msgr2=0x7feedc06d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:20.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.129+0000 7feeff5ff700 1 --2- 172.21.15.84:0/1923685364 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7feedc06b040 0x7feedc06d4f0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7feef40011e0 tx=0x7feef4009040 comp rx=0 tx=0).stop 2023-07-14T11:18:20.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.129+0000 7feeff5ff700 1 -- 172.21.15.84:0/1923685364 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feef81500d0 msgr2=0x7feef8152c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:20.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.129+0000 7feeff5ff700 1 --2- 172.21.15.84:0/1923685364 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feef81500d0 0x7feef8152c00 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7feee8014040 tx=0x7feee8004750 comp rx=0 tx=0).stop 2023-07-14T11:18:20.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.129+0000 7feeff5ff700 1 -- 172.21.15.84:0/1923685364 shutdown_connections 2023-07-14T11:18:20.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.129+0000 7feeff5ff700 1 --2- 172.21.15.84:0/1923685364 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7feedc06b040 0x7feedc06d4f0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:20.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.129+0000 7feeff5ff700 1 --2- 172.21.15.84:0/1923685364 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feef81597c0 0x7feef8153140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:20.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.129+0000 7feeff5ff700 1 --2- 172.21.15.84:0/1923685364 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feef80cea50 0x7feef813bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:20.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.129+0000 7feeff5ff700 1 --2- 172.21.15.84:0/1923685364 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feef81500d0 0x7feef8152c00 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:20.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.129+0000 7feeff5ff700 1 -- 172.21.15.84:0/1923685364 >> 172.21.15.84:0/1923685364 conn(0x7feef8069f30 msgr2=0x7feef814b230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:20.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.129+0000 7feeff5ff700 1 -- 172.21.15.84:0/1923685364 shutdown_connections 2023-07-14T11:18:20.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.129+0000 7feeff5ff700 1 -- 172.21.15.84:0/1923685364 wait complete. 2023-07-14T11:18:20.133 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 46 2023-07-14T11:18:20.150 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2023-07-14T11:18:20.373 INFO:teuthology.orchestra.run.smithi084.stdout:[{"id":7011,"entity":{"name":{"type":"client","num":7011},"addr":{"type":"any","addr":"172.21.15.84:0","nonce":2317294276}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":14,"uptime":0.73298660800000004,"requests_in_flight":2,"num_completed_requests":0,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":21.963458297763779,"halflife":300},"cap_acquisition":{"value":0,"halflife":10},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.7011 172.21.15.84:0/2317294276","completed_requests":[],"prealloc_inos":[{"start":"0x10000000005","length":996}],"client_metadata":{"client_features":{"feature_bits":"0x00000000000fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"3fc0089cc1082313a98853d48b892acdc1385b8b","ceph_version":"ceph version 18.0.0-4757-g3fc0089c (3fc0089cc1082313a98853d48b892acdc1385b8b) reef (dev)","entity_id":"y","hostname":"smithi084","pid":"140843","root":"/"}}] 2023-07-14T11:18:20.373 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 10, "value": 0 }, "client_metadata": { "ceph_sha1": "3fc0089cc1082313a98853d48b892acdc1385b8b", "ceph_version": "ceph version 18.0.0-4757-g3fc0089c (3fc0089cc1082313a98853d48b892acdc1385b8b) reef (dev)", "client_features": { "feature_bits": "0x00000000000fffff" }, "entity_id": "y", "hostname": "smithi084", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "140843", "root": "/" }, "completed_requests": [], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.84:0", "nonce": 2317294276, "type": "any" }, "name": { "num": 7011, "type": "client" } }, "id": 7011, "inst": "client.7011 172.21.15.84:0/2317294276", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 0, "num_leases": 1, "prealloc_inos": [ { "length": 996, "start": "0x10000000005" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 14, "requests_in_flight": 2, "session_cache_liveness": { "halflife": 300, "value": 21.96345829776378 }, "state": "open", "uptime": 0.732986608 } ] 2023-07-14T11:18:20.374 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2023-07-14T11:18:20.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.567+0000 7f2b111ff700 1 Processor -- start 2023-07-14T11:18:20.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.568+0000 7f2b111ff700 1 -- start start 2023-07-14T11:18:20.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.569+0000 7f2b111ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2b0c15c950 0x7f2b0c0b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:20.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.569+0000 7f2b111ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b0c0b1e00 0x7f2b0c0d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:20.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.569+0000 7f2b111ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b0c0d2ce0 con 0x7f2b0c0b2350 2023-07-14T11:18:20.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.569+0000 7f2b111ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b0c0b3350 con 0x7f2b0c15c950 2023-07-14T11:18:20.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.569+0000 7f2b111ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0c0b3630 con 0x7f2b0c0b1e00 2023-07-14T11:18:20.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.569+0000 7f2b0b59e700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f2b0c0b2350 0x7f2b0c0afac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48946/0 (socket says 172.21.15.84:48946) 2023-07-14T11:18:20.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.569+0000 7f2b0b59e700 1 -- 172.21.15.84:0/3165288278 learned_addr learned my addr 172.21.15.84:0/3165288278 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:18:20.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.569+0000 7f2b03fff700 1 --2- 172.21.15.84:0/3165288278 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b0c0b1e00 0x7f2b0c0d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:20.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.569+0000 7f2b0ad9d700 1 --2- 172.21.15.84:0/3165288278 >> v2:172.21.15.179:3300/0 conn(0x7f2b0c15c950 0x7f2b0c0b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:20.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.569+0000 7f2b0a59c700 1 -- 172.21.15.84:0/3165288278 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3348895122 0 0) 0x7f2b0c0d2ce0 con 0x7f2b0c0b2350 2023-07-14T11:18:20.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.570+0000 7f2b0a59c700 1 -- 172.21.15.84:0/3165288278 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2af80035b0 con 0x7f2b0c0b2350 2023-07-14T11:18:20.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.570+0000 7f2b03fff700 1 -- 172.21.15.84:0/3165288278 >> v2:172.21.15.179:3300/0 conn(0x7f2b0c15c950 msgr2=0x7f2b0c0b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:20.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.570+0000 7f2b03fff700 1 --2- 172.21.15.84:0/3165288278 >> v2:172.21.15.179:3300/0 conn(0x7f2b0c15c950 0x7f2b0c0b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:20.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.570+0000 7f2b03fff700 1 -- 172.21.15.84:0/3165288278 >> v1:172.21.15.84:6789/0 conn(0x7f2b0c0b2350 legacy=0x7f2b0c0afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:20.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.570+0000 7f2b03fff700 1 -- 172.21.15.84:0/3165288278 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b0c0b3910 con 0x7f2b0c0b1e00 2023-07-14T11:18:20.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.570+0000 7f2b0ad9d700 1 --2- 172.21.15.84:0/3165288278 >> v2:172.21.15.179:3300/0 conn(0x7f2b0c15c950 0x7f2b0c0b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:18:20.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.570+0000 7f2b03fff700 1 --2- 172.21.15.84:0/3165288278 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b0c0b1e00 0x7f2b0c0d0b10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2af4009840 tx=0x7f2af4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10b4030cf198db8b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:20.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.570+0000 7f2b0a59c700 1 -- 172.21.15.84:0/3165288278 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af4011830 con 0x7f2b0c0b1e00 2023-07-14T11:18:20.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.570+0000 7f2b0a59c700 1 -- 172.21.15.84:0/3165288278 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af4011990 con 0x7f2b0c0b1e00 2023-07-14T11:18:20.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.570+0000 7f2b0a59c700 1 -- 172.21.15.84:0/3165288278 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af4011d20 con 0x7f2b0c0b1e00 2023-07-14T11:18:20.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.571+0000 7f2b111ff700 1 -- 172.21.15.84:0/3165288278 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b0c0b1e00 msgr2=0x7f2b0c0d0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:20.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.571+0000 7f2b111ff700 1 --2- 172.21.15.84:0/3165288278 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b0c0b1e00 0x7f2b0c0d0b10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2af4009840 tx=0x7f2af4009b50 comp rx=0 tx=0).stop 2023-07-14T11:18:20.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.571+0000 7f2b111ff700 1 -- 172.21.15.84:0/3165288278 shutdown_connections 2023-07-14T11:18:20.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.571+0000 7f2b111ff700 1 --2- 172.21.15.84:0/3165288278 >> v2:172.21.15.179:3300/0 conn(0x7f2b0c15c950 0x7f2b0c0b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:20.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.571+0000 7f2b111ff700 1 --2- 172.21.15.84:0/3165288278 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b0c0b1e00 0x7f2b0c0d0b10 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:20.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.571+0000 7f2b111ff700 1 -- 172.21.15.84:0/3165288278 >> 172.21.15.84:0/3165288278 conn(0x7f2b0c09c1d0 msgr2=0x7f2b0c0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:20.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.571+0000 7f2b111ff700 1 -- 172.21.15.84:0/3165288278 shutdown_connections 2023-07-14T11:18:20.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.571+0000 7f2b111ff700 1 -- 172.21.15.84:0/3165288278 wait complete. 2023-07-14T11:18:20.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.573+0000 7f2b111ff700 1 Processor -- start 2023-07-14T11:18:20.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.573+0000 7f2b111ff700 1 -- start start 2023-07-14T11:18:20.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.574+0000 7f2b111ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b0c0b1e00 0x7f2b0c0c91c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:20.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.574+0000 7f2b111ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b0c0b2350 0x7f2b0c0cd570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:20.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.574+0000 7f2b111ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b0c15c950 0x7f2b0c0cdab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:20.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.574+0000 7f2b111ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0c1508b0 con 0x7f2b0c0b1e00 2023-07-14T11:18:20.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.574+0000 7f2b111ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0c0d0030 con 0x7f2b0c15c950 2023-07-14T11:18:20.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.574+0000 7f2b111ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0c0b8170 con 0x7f2b0c0b2350 2023-07-14T11:18:20.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.574+0000 7f2b0ad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b0c0b1e00 0x7f2b0c0c91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:20.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.574+0000 7f2b0ad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b0c0b1e00 0x7f2b0c0c91c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58646/0 (socket says 172.21.15.84:58646) 2023-07-14T11:18:20.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.574+0000 7f2b0ad9d700 1 -- 172.21.15.84:0/104511049 learned_addr learned my addr 172.21.15.84:0/104511049 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:20.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.574+0000 7f2b0ad9d700 1 -- 172.21.15.84:0/104511049 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b0c0b2350 msgr2=0x7f2b0c0cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:20.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.574+0000 7f2b0ad9d700 1 --2- 172.21.15.84:0/104511049 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b0c0b2350 0x7f2b0c0cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:20.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.574+0000 7f2b0ad9d700 1 -- 172.21.15.84:0/104511049 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b0c15c950 msgr2=0x7f2b0c0cdab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:20.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.574+0000 7f2b0ad9d700 1 --2- 172.21.15.84:0/104511049 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b0c15c950 0x7f2b0c0cdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:20.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.574+0000 7f2b0ad9d700 1 -- 172.21.15.84:0/104511049 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2afc009430 con 0x7f2b0c0b1e00 2023-07-14T11:18:20.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.575+0000 7f2b0ad9d700 1 --2- 172.21.15.84:0/104511049 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b0c0b1e00 0x7f2b0c0c91c0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f2afc00ebe0 tx=0x7f2afc009e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:20.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.575+0000 7f2b037fe700 1 -- 172.21.15.84:0/104511049 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2afc005a20 con 0x7f2b0c0b1e00 2023-07-14T11:18:20.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.575+0000 7f2b037fe700 1 -- 172.21.15.84:0/104511049 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2afc005b80 con 0x7f2b0c0b1e00 2023-07-14T11:18:20.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.575+0000 7f2b111ff700 1 -- 172.21.15.84:0/104511049 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2af40094a0 con 0x7f2b0c0b1e00 2023-07-14T11:18:20.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.575+0000 7f2b037fe700 1 -- 172.21.15.84:0/104511049 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2afc00c8b0 con 0x7f2b0c0b1e00 2023-07-14T11:18:20.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.575+0000 7f2b111ff700 1 -- 172.21.15.84:0/104511049 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b0c150260 con 0x7f2b0c0b1e00 2023-07-14T11:18:20.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.576+0000 7f2b111ff700 1 -- 172.21.15.84:0/104511049 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b0c04e280 con 0x7f2b0c0b1e00 2023-07-14T11:18:20.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.577+0000 7f2b037fe700 1 -- 172.21.15.84:0/104511049 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 11) v1 ==== 89343+0+0 (secure 0 0 0) 0x7f2afc00ca10 con 0x7f2b0c0b1e00 2023-07-14T11:18:20.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.578+0000 7f2b037fe700 1 --2- 172.21.15.84:0/104511049 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f2aec06b040 0x7f2aec06d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:20.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.578+0000 7f2b037fe700 1 -- 172.21.15.84:0/104511049 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2afc089ca0 con 0x7f2b0c0b1e00 2023-07-14T11:18:20.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.578+0000 7f2b03fff700 1 --2- 172.21.15.84:0/104511049 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f2aec06b040 0x7f2aec06d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:20.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.578+0000 7f2b03fff700 1 --2- 172.21.15.84:0/104511049 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f2aec06b040 0x7f2aec06d4f0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c1524a0 tx=0x7f2af4010000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:20.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.582+0000 7f2b037fe700 1 -- 172.21.15.84:0/104511049 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f2afc054990 con 0x7f2b0c0b1e00 2023-07-14T11:18:20.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.829+0000 7f2b111ff700 1 -- 172.21.15.84:0/104511049 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) v1 -- 0x7f2b0c08c5a0 con 0x7f2b0c0b1e00 2023-07-14T11:18:20.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.836+0000 7f2b037fe700 1 -- 172.21.15.84:0/104511049 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v11) v1 ==== 81+0+467212 (secure 0 0 0) 0x7f2afc020090 con 0x7f2b0c0b1e00 2023-07-14T11:18:20.847 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:18:20.847 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-07-14T11:18:20.848 INFO:teuthology.orchestra.run.smithi084.stdout: "epoch": 11, 2023-07-14T11:18:20.848 INFO:teuthology.orchestra.run.smithi084.stdout: "active_gid": 4104, 2023-07-14T11:18:20.848 INFO:teuthology.orchestra.run.smithi084.stdout: "active_name": "y", 2023-07-14T11:18:20.848 INFO:teuthology.orchestra.run.smithi084.stdout: "active_addrs": { 2023-07-14T11:18:20.849 INFO:teuthology.orchestra.run.smithi084.stdout: "addrvec": [ 2023-07-14T11:18:20.849 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:20.849 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v2", 2023-07-14T11:18:20.850 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "172.21.15.84:6832", 2023-07-14T11:18:20.850 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 379617029 2023-07-14T11:18:20.850 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:20.850 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:20.851 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v1", 2023-07-14T11:18:20.851 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "172.21.15.84:6833", 2023-07-14T11:18:20.851 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 379617029 2023-07-14T11:18:20.851 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:20.852 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2023-07-14T11:18:20.852 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:20.852 INFO:teuthology.orchestra.run.smithi084.stdout: "active_addr": "172.21.15.84:6833/379617029", 2023-07-14T11:18:20.852 INFO:teuthology.orchestra.run.smithi084.stdout: "active_change": "2023-07-14T11:12:54.051634+0000", 2023-07-14T11:18:20.853 INFO:teuthology.orchestra.run.smithi084.stdout: "active_mgr_features": 4540138322906710015, 2023-07-14T11:18:20.853 INFO:teuthology.orchestra.run.smithi084.stdout: "available": true, 2023-07-14T11:18:20.853 INFO:teuthology.orchestra.run.smithi084.stdout: "standbys": [ 2023-07-14T11:18:20.853 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:20.854 INFO:teuthology.orchestra.run.smithi084.stdout: "gid": 4100, 2023-07-14T11:18:20.854 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "x", 2023-07-14T11:18:20.854 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr_features": 4540138322906710015, 2023-07-14T11:18:20.854 INFO:teuthology.orchestra.run.smithi084.stdout: "available_modules": [ 2023-07-14T11:18:20.855 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:20.855 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "alerts", 2023-07-14T11:18:20.855 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2023-07-14T11:18:20.855 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2023-07-14T11:18:20.856 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2023-07-14T11:18:20.856 INFO:teuthology.orchestra.run.smithi084.stdout: "interval": { 2023-07-14T11:18:20.856 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "interval", 2023-07-14T11:18:20.857 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2023-07-14T11:18:20.857 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:20.857 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:20.857 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "60", 2023-07-14T11:18:20.857 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:20.858 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:20.858 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:20.858 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "How frequently to reexamine health status", 2023-07-14T11:18:20.858 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:20.858 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:20.858 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:20.858 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:20.858 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2023-07-14T11:18:20.859 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2023-07-14T11:18:20.859 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:20.859 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:20.859 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:20.859 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:20.859 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:20.859 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:20.859 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:20.860 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:20.860 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:20.860 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:20.860 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:20.860 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:20.860 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:20.860 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:20.861 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:20.861 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:20.861 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:20.861 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:20.861 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:20.861 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2023-07-14T11:18:20.861 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2023-07-14T11:18:20.861 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:20.862 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:20.862 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:20.862 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:20.862 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:20.862 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:20.862 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:20.862 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:20.862 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:20.863 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:20.863 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:20.863 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:20.863 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2023-07-14T11:18:20.863 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2023-07-14T11:18:20.863 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:20.863 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:20.864 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:20.864 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2023-07-14T11:18:20.864 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:20.864 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:20.864 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:20.864 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:20.864 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:20.865 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:20.865 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:20.865 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:20.865 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:20.865 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:20.865 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:20.866 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:20.866 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:20.866 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:20.866 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:20.866 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2023-07-14T11:18:20.866 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2023-07-14T11:18:20.866 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:20.866 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:20.867 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:20.867 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:20.867 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:20.867 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:20.867 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:20.867 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:20.867 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:20.867 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:20.868 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:20.868 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:20.868 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_destination": { 2023-07-14T11:18:20.868 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_destination", 2023-07-14T11:18:20.868 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:20.868 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:20.868 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:20.869 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:20.869 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:20.869 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:20.869 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:20.869 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Email address to send alerts to", 2023-07-14T11:18:20.869 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:20.869 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:20.870 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:20.870 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:20.870 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_from_name": { 2023-07-14T11:18:20.870 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_from_name", 2023-07-14T11:18:20.870 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:20.870 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:20.870 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:20.870 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "Ceph", 2023-07-14T11:18:20.871 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:20.871 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:20.871 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:20.871 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Email From: name", 2023-07-14T11:18:20.871 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:20.871 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:20.871 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:20.871 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:20.872 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_host": { 2023-07-14T11:18:20.872 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_host", 2023-07-14T11:18:20.872 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:20.872 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:20.872 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:20.872 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:20.872 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:20.872 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:20.873 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:20.873 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "SMTP server", 2023-07-14T11:18:20.873 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:20.873 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:20.873 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:20.873 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:20.873 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_password": { 2023-07-14T11:18:20.874 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_password", 2023-07-14T11:18:20.874 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:20.874 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:20.874 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:20.874 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:20.874 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:20.874 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:20.874 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:20.875 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Password to authenticate with", 2023-07-14T11:18:20.875 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:20.875 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:20.875 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:20.875 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:20.875 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_port": { 2023-07-14T11:18:20.875 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_port", 2023-07-14T11:18:20.875 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2023-07-14T11:18:20.876 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:20.876 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:20.876 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "465", 2023-07-14T11:18:20.876 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:20.876 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:20.876 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:20.876 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "SMTP port", 2023-07-14T11:18:20.876 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:20.877 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:20.877 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:20.877 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:20.877 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_sender": { 2023-07-14T11:18:20.877 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_sender", 2023-07-14T11:18:20.877 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:20.877 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:20.878 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:20.878 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:20.878 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:20.878 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:20.878 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:20.878 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "SMTP envelope sender", 2023-07-14T11:18:20.878 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:20.879 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:20.879 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:20.879 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:20.879 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_ssl": { 2023-07-14T11:18:20.879 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_ssl", 2023-07-14T11:18:20.879 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:20.879 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:20.879 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:20.880 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:20.880 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:20.880 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:20.880 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:20.880 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Use SSL to connect to SMTP server", 2023-07-14T11:18:20.880 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:20.880 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:20.881 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:20.881 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:20.881 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_user": { 2023-07-14T11:18:20.881 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_user", 2023-07-14T11:18:20.881 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:20.881 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:20.881 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:20.882 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:20.882 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:20.882 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:20.882 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:20.882 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "User to authenticate as", 2023-07-14T11:18:20.882 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:20.882 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:20.882 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:20.883 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:20.883 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:20.883 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:20.883 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:20.883 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "balancer", 2023-07-14T11:18:20.883 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2023-07-14T11:18:20.883 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2023-07-14T11:18:20.883 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2023-07-14T11:18:20.884 INFO:teuthology.orchestra.run.smithi084.stdout: "active": { 2023-07-14T11:18:20.884 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "active", 2023-07-14T11:18:20.884 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:20.884 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:20.884 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:20.884 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:20.884 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:20.884 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:20.885 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:20.885 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "automatically balance PGs across cluster", 2023-07-14T11:18:20.885 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:20.885 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:20.885 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:20.885 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:20.885 INFO:teuthology.orchestra.run.smithi084.stdout: "begin_time": { 2023-07-14T11:18:20.886 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "begin_time", 2023-07-14T11:18:20.886 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:20.886 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:20.886 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:20.886 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0000", 2023-07-14T11:18:20.886 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:20.886 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:20.886 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:20.887 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "beginning time of day to automatically balance", 2023-07-14T11:18:20.887 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-07-14T11:18:20.887 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:20.887 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:20.887 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:20.887 INFO:teuthology.orchestra.run.smithi084.stdout: "begin_weekday": { 2023-07-14T11:18:20.887 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "begin_weekday", 2023-07-14T11:18:20.887 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "uint", 2023-07-14T11:18:20.888 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:20.888 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:20.888 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2023-07-14T11:18:20.888 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "0", 2023-07-14T11:18:20.888 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "6", 2023-07-14T11:18:20.888 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:20.888 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-07-14T11:18:20.889 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-07-14T11:18:20.889 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:20.889 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:20.889 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:20.889 INFO:teuthology.orchestra.run.smithi084.stdout: "crush_compat_max_iterations": { 2023-07-14T11:18:20.889 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "crush_compat_max_iterations", 2023-07-14T11:18:20.889 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "uint", 2023-07-14T11:18:20.889 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:20.890 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:20.890 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "25", 2023-07-14T11:18:20.890 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "1", 2023-07-14T11:18:20.890 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "250", 2023-07-14T11:18:20.890 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:20.890 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-07-14T11:18:20.890 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:20.890 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:20.891 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:20.891 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:20.891 INFO:teuthology.orchestra.run.smithi084.stdout: "crush_compat_metrics": { 2023-07-14T11:18:20.891 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "crush_compat_metrics", 2023-07-14T11:18:20.891 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:20.891 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:20.891 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:20.891 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "pgs,objects,bytes", 2023-07-14T11:18:20.892 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:20.892 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:20.892 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:20.892 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-07-14T11:18:20.892 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-07-14T11:18:20.892 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:20.892 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:20.893 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:20.893 INFO:teuthology.orchestra.run.smithi084.stdout: "crush_compat_step": { 2023-07-14T11:18:20.893 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "crush_compat_step", 2023-07-14T11:18:20.893 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2023-07-14T11:18:20.893 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:20.893 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:20.893 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0.5", 2023-07-14T11:18:20.893 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "0.001", 2023-07-14T11:18:20.894 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "0.999", 2023-07-14T11:18:20.894 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:20.894 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "aggressiveness of optimization", 2023-07-14T11:18:20.894 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-07-14T11:18:20.894 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:20.894 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:20.894 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:20.894 INFO:teuthology.orchestra.run.smithi084.stdout: "end_time": { 2023-07-14T11:18:20.895 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "end_time", 2023-07-14T11:18:20.895 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:20.895 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:20.895 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:20.895 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "2359", 2023-07-14T11:18:20.895 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:20.895 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:20.895 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:20.896 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "ending time of day to automatically balance", 2023-07-14T11:18:20.896 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-07-14T11:18:20.896 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:20.896 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:20.896 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:20.896 INFO:teuthology.orchestra.run.smithi084.stdout: "end_weekday": { 2023-07-14T11:18:20.897 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "end_weekday", 2023-07-14T11:18:20.897 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "uint", 2023-07-14T11:18:20.897 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:20.897 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:20.897 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2023-07-14T11:18:20.897 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "0", 2023-07-14T11:18:20.897 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "6", 2023-07-14T11:18:20.898 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:20.898 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-07-14T11:18:20.898 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-07-14T11:18:20.898 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:20.898 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:20.898 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:20.898 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2023-07-14T11:18:20.898 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2023-07-14T11:18:20.899 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:20.899 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:20.899 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:20.899 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:20.899 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:20.899 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:20.899 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:20.900 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:20.900 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:20.900 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:20.900 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:20.900 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:20.900 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:20.900 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:20.900 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:20.901 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:20.901 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:20.901 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:20.901 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:20.901 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2023-07-14T11:18:20.901 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2023-07-14T11:18:20.901 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:20.901 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:20.902 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:20.902 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:20.902 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:20.902 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:20.902 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:20.902 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:20.902 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:20.903 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:20.903 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:20.903 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:20.903 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2023-07-14T11:18:20.903 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2023-07-14T11:18:20.903 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:20.903 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:20.904 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:20.904 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2023-07-14T11:18:20.904 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:20.904 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:20.904 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:20.904 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:20.904 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:20.904 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:20.905 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:20.905 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:20.905 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:20.905 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:20.905 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:20.905 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:20.905 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:20.906 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:20.906 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:20.906 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2023-07-14T11:18:20.906 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2023-07-14T11:18:20.906 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:20.906 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:20.906 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:20.906 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:20.907 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:20.907 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:20.907 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:20.907 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:20.907 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:20.907 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:20.907 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:20.907 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:20.908 INFO:teuthology.orchestra.run.smithi084.stdout: "min_score": { 2023-07-14T11:18:20.908 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "min_score", 2023-07-14T11:18:20.908 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2023-07-14T11:18:20.908 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:20.908 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:20.908 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2023-07-14T11:18:20.908 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:20.908 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:20.909 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:20.909 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-07-14T11:18:20.909 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:20.909 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:20.909 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:20.909 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:20.909 INFO:teuthology.orchestra.run.smithi084.stdout: "mode": { 2023-07-14T11:18:20.909 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "mode", 2023-07-14T11:18:20.910 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:20.910 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:20.910 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:20.910 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "upmap", 2023-07-14T11:18:20.910 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:20.910 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:20.910 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:20.910 INFO:teuthology.orchestra.run.smithi084.stdout: "crush-compat", 2023-07-14T11:18:20.911 INFO:teuthology.orchestra.run.smithi084.stdout: "none", 2023-07-14T11:18:20.911 INFO:teuthology.orchestra.run.smithi084.stdout: "upmap" 2023-07-14T11:18:20.911 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:20.911 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Balancer mode", 2023-07-14T11:18:20.911 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:20.911 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:20.911 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:20.912 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:20.912 INFO:teuthology.orchestra.run.smithi084.stdout: "pool_ids": { 2023-07-14T11:18:20.912 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "pool_ids", 2023-07-14T11:18:20.912 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:20.912 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:20.912 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:20.912 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:20.912 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:20.913 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:20.913 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:20.913 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-07-14T11:18:20.913 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:20.913 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:20.913 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:20.913 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:20.913 INFO:teuthology.orchestra.run.smithi084.stdout: "sleep_interval": { 2023-07-14T11:18:20.914 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sleep_interval", 2023-07-14T11:18:20.914 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2023-07-14T11:18:20.914 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:20.914 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:20.914 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "60", 2023-07-14T11:18:20.914 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:20.914 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:20.914 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:20.915 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-07-14T11:18:20.915 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:20.915 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:20.915 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:20.915 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:20.915 INFO:teuthology.orchestra.run.smithi084.stdout: "upmap_max_deviation": { 2023-07-14T11:18:20.915 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "upmap_max_deviation", 2023-07-14T11:18:20.916 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2023-07-14T11:18:20.916 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:20.916 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:20.916 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "5", 2023-07-14T11:18:20.916 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "1", 2023-07-14T11:18:20.916 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:20.916 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:20.916 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "deviation below which no optimization is attempted", 2023-07-14T11:18:20.917 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-07-14T11:18:20.917 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:20.917 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:20.917 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:20.917 INFO:teuthology.orchestra.run.smithi084.stdout: "upmap_max_optimizations": { 2023-07-14T11:18:20.917 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "upmap_max_optimizations", 2023-07-14T11:18:20.917 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "uint", 2023-07-14T11:18:20.917 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:20.918 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:20.918 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2023-07-14T11:18:20.918 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:20.918 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:20.918 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:20.918 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-07-14T11:18:20.918 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:20.918 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:20.919 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:20.919 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:20.919 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:20.919 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:20.919 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:20.919 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "cephadm", 2023-07-14T11:18:20.919 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2023-07-14T11:18:20.919 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2023-07-14T11:18:20.920 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2023-07-14T11:18:20.920 INFO:teuthology.orchestra.run.smithi084.stdout: "agent_down_multiplier": { 2023-07-14T11:18:20.920 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "agent_down_multiplier", 2023-07-14T11:18:20.920 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2023-07-14T11:18:20.920 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:20.920 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:20.920 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "3.0", 2023-07-14T11:18:20.921 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:20.921 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:20.921 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:20.921 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-07-14T11:18:20.921 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:20.921 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:20.922 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:20.922 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:20.922 INFO:teuthology.orchestra.run.smithi084.stdout: "agent_refresh_rate": { 2023-07-14T11:18:20.922 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "agent_refresh_rate", 2023-07-14T11:18:20.922 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2023-07-14T11:18:20.922 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:20.922 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:20.922 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "20", 2023-07-14T11:18:20.923 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:20.923 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:20.923 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:20.923 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-07-14T11:18:20.923 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:20.923 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:20.923 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:20.923 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:20.924 INFO:teuthology.orchestra.run.smithi084.stdout: "agent_starting_port": { 2023-07-14T11:18:20.924 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "agent_starting_port", 2023-07-14T11:18:20.924 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2023-07-14T11:18:20.924 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:20.924 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:20.924 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "4721", 2023-07-14T11:18:20.924 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:20.925 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:20.925 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:20.925 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-07-14T11:18:20.925 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:20.925 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:20.925 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:20.925 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:20.925 INFO:teuthology.orchestra.run.smithi084.stdout: "alertmanager_web_password": { 2023-07-14T11:18:20.926 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "alertmanager_web_password", 2023-07-14T11:18:20.926 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:20.926 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:20.926 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:20.926 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "admin", 2023-07-14T11:18:20.926 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:20.926 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:20.927 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:20.927 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Alertmanager web password", 2023-07-14T11:18:20.927 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:20.927 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:20.927 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:20.927 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:20.927 INFO:teuthology.orchestra.run.smithi084.stdout: "alertmanager_web_user": { 2023-07-14T11:18:20.927 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "alertmanager_web_user", 2023-07-14T11:18:20.928 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:20.928 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:20.928 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:20.928 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "admin", 2023-07-14T11:18:20.928 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:20.928 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:20.928 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:20.929 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Alertmanager web user", 2023-07-14T11:18:20.929 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:20.929 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:20.929 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:20.929 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:20.929 INFO:teuthology.orchestra.run.smithi084.stdout: "allow_ptrace": { 2023-07-14T11:18:20.929 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "allow_ptrace", 2023-07-14T11:18:20.929 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:20.930 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:20.930 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:20.930 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:20.930 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:20.930 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:20.930 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:20.930 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-07-14T11:18:20.930 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-07-14T11:18:20.931 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:20.931 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:20.931 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:20.931 INFO:teuthology.orchestra.run.smithi084.stdout: "autotune_interval": { 2023-07-14T11:18:20.931 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "autotune_interval", 2023-07-14T11:18:20.931 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2023-07-14T11:18:20.931 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:20.931 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:20.932 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "600", 2023-07-14T11:18:20.932 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:20.932 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:20.932 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:20.932 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how frequently to autotune daemon memory", 2023-07-14T11:18:20.932 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:20.932 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:20.932 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:20.933 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:20.933 INFO:teuthology.orchestra.run.smithi084.stdout: "autotune_memory_target_ratio": { 2023-07-14T11:18:20.933 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "autotune_memory_target_ratio", 2023-07-14T11:18:20.933 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2023-07-14T11:18:20.933 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:20.933 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:20.933 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0.7", 2023-07-14T11:18:20.933 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:20.934 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:20.934 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:20.934 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-07-14T11:18:20.934 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:20.934 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:20.934 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:20.934 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:20.934 INFO:teuthology.orchestra.run.smithi084.stdout: "cgroups_split": { 2023-07-14T11:18:20.935 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "cgroups_split", 2023-07-14T11:18:20.935 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:20.935 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:20.935 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:20.935 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:20.935 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:20.935 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:20.936 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:20.936 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-07-14T11:18:20.936 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:20.936 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:20.936 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:20.936 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:20.936 INFO:teuthology.orchestra.run.smithi084.stdout: "config_checks_enabled": { 2023-07-14T11:18:20.937 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "config_checks_enabled", 2023-07-14T11:18:20.937 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:20.937 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:20.937 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:20.937 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:20.937 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:20.937 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:20.937 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:20.938 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-07-14T11:18:20.938 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:20.938 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:20.938 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:20.938 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:20.938 INFO:teuthology.orchestra.run.smithi084.stdout: "config_dashboard": { 2023-07-14T11:18:20.938 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "config_dashboard", 2023-07-14T11:18:20.939 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:20.939 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:20.939 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:20.939 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:20.939 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:20.939 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:20.939 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:20.939 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-07-14T11:18:20.940 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:20.940 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:20.940 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:20.940 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:20.940 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_alertmanager": { 2023-07-14T11:18:20.940 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_alertmanager", 2023-07-14T11:18:20.940 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:20.940 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:20.941 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:20.941 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-07-14T11:18:20.941 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:20.941 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:20.941 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:20.941 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Prometheus container image", 2023-07-14T11:18:20.941 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:20.941 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:20.942 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:20.942 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:20.942 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_base": { 2023-07-14T11:18:20.942 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_base", 2023-07-14T11:18:20.942 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:20.942 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:20.942 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:20.943 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/ceph/ceph", 2023-07-14T11:18:20.943 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:20.943 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:20.943 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:20.943 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Container image name, without the tag", 2023-07-14T11:18:20.943 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:20.943 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:20.943 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:20.944 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:20.944 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_elasticsearch": { 2023-07-14T11:18:20.944 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_elasticsearch", 2023-07-14T11:18:20.944 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:20.944 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:20.944 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:20.944 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-07-14T11:18:20.944 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:20.945 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:20.945 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:20.945 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "elasticsearch container image", 2023-07-14T11:18:20.945 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:20.945 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:20.945 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:20.945 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:20.945 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_grafana": { 2023-07-14T11:18:20.946 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_grafana", 2023-07-14T11:18:20.946 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:20.946 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:20.946 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:20.947 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-07-14T11:18:20.947 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:20.947 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:20.947 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:20.947 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Prometheus container image", 2023-07-14T11:18:20.948 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:20.948 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:20.948 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:20.948 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:20.949 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_haproxy": { 2023-07-14T11:18:20.949 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_haproxy", 2023-07-14T11:18:20.949 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:20.950 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:20.950 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:20.950 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-07-14T11:18:20.950 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:20.951 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:20.951 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:20.951 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "HAproxy container image", 2023-07-14T11:18:20.951 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:20.952 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:20.952 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:20.952 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:20.953 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_jaeger_agent": { 2023-07-14T11:18:20.953 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_jaeger_agent", 2023-07-14T11:18:20.953 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:20.954 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:20.954 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:20.954 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-07-14T11:18:20.955 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:20.955 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:20.955 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:20.955 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Jaeger agent container image", 2023-07-14T11:18:20.956 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:20.956 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:20.956 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:20.957 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:20.957 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_jaeger_collector": { 2023-07-14T11:18:20.957 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_jaeger_collector", 2023-07-14T11:18:20.957 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:20.958 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:20.958 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:20.958 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-07-14T11:18:20.958 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:20.959 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:20.959 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:20.959 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Jaeger collector container image", 2023-07-14T11:18:20.959 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:20.959 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:20.959 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:20.960 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:20.960 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_jaeger_query": { 2023-07-14T11:18:20.960 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_jaeger_query", 2023-07-14T11:18:20.960 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:20.960 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:20.960 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:20.960 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-07-14T11:18:20.961 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:20.961 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:20.961 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:20.961 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Jaeger query container image", 2023-07-14T11:18:20.961 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:20.961 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:20.961 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:20.961 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:20.962 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_keepalived": { 2023-07-14T11:18:20.962 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_keepalived", 2023-07-14T11:18:20.962 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:20.962 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:20.962 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:20.962 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-07-14T11:18:20.962 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:20.963 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:20.963 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:20.963 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Keepalived container image", 2023-07-14T11:18:20.963 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:20.963 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:20.963 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:20.963 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:20.963 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_loki": { 2023-07-14T11:18:20.964 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_loki", 2023-07-14T11:18:20.964 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:20.964 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:20.964 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:20.964 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-07-14T11:18:20.964 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:20.964 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:20.965 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:20.965 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Loki container image", 2023-07-14T11:18:20.965 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:20.965 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:20.965 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:20.965 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:20.966 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_node_exporter": { 2023-07-14T11:18:20.966 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_node_exporter", 2023-07-14T11:18:20.966 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:20.966 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:20.966 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:20.966 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-07-14T11:18:20.966 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:20.966 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:20.967 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:20.967 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Prometheus container image", 2023-07-14T11:18:20.967 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:20.967 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:20.967 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:20.967 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:20.967 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_prometheus": { 2023-07-14T11:18:20.967 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_prometheus", 2023-07-14T11:18:20.968 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:20.968 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:20.968 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:20.968 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-07-14T11:18:20.968 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:20.968 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:20.968 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:20.969 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Prometheus container image", 2023-07-14T11:18:20.969 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:20.969 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:20.969 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:20.969 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:20.970 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_promtail": { 2023-07-14T11:18:20.970 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_promtail", 2023-07-14T11:18:20.970 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:20.971 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:20.971 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:20.971 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-07-14T11:18:20.971 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:20.972 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:20.972 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:20.972 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Promtail container image", 2023-07-14T11:18:20.972 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:20.972 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:20.973 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:20.973 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:20.973 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_snmp_gateway": { 2023-07-14T11:18:20.973 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_snmp_gateway", 2023-07-14T11:18:20.973 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:20.973 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:20.974 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:20.974 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-07-14T11:18:20.974 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:20.974 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:20.974 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:20.975 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "SNMP Gateway container image", 2023-07-14T11:18:20.975 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:20.975 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:20.975 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:20.976 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:20.976 INFO:teuthology.orchestra.run.smithi084.stdout: "container_init": { 2023-07-14T11:18:20.976 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_init", 2023-07-14T11:18:20.976 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:20.977 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:20.977 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:20.977 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:20.977 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:20.978 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:20.978 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:20.978 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Run podman/docker with `--init`", 2023-07-14T11:18:20.978 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:20.978 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:20.979 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:20.979 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:20.979 INFO:teuthology.orchestra.run.smithi084.stdout: "daemon_cache_timeout": { 2023-07-14T11:18:20.979 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "daemon_cache_timeout", 2023-07-14T11:18:20.980 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2023-07-14T11:18:20.980 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:20.980 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:20.980 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "600", 2023-07-14T11:18:20.980 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:20.981 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:20.981 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:20.981 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-07-14T11:18:20.981 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:20.982 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:20.982 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:20.982 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:20.982 INFO:teuthology.orchestra.run.smithi084.stdout: "default_cephadm_command_timeout": { 2023-07-14T11:18:20.983 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "default_cephadm_command_timeout", 2023-07-14T11:18:20.983 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2023-07-14T11:18:20.983 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:20.983 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:20.984 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "900", 2023-07-14T11:18:20.984 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:20.984 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:20.984 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:20.984 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-07-14T11:18:20.985 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:20.985 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:20.985 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:20.985 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:20.986 INFO:teuthology.orchestra.run.smithi084.stdout: "default_registry": { 2023-07-14T11:18:20.986 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "default_registry", 2023-07-14T11:18:20.986 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:20.986 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:20.987 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:20.987 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "docker.io", 2023-07-14T11:18:20.987 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:20.987 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:20.988 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:20.988 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-07-14T11:18:20.988 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:20.988 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:20.989 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:20.989 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:20.989 INFO:teuthology.orchestra.run.smithi084.stdout: "device_cache_timeout": { 2023-07-14T11:18:20.989 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "device_cache_timeout", 2023-07-14T11:18:20.990 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2023-07-14T11:18:20.990 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:20.990 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:20.991 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "1800", 2023-07-14T11:18:20.991 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:20.991 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:20.991 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:20.992 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "seconds to cache device inventory", 2023-07-14T11:18:20.992 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:20.992 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:20.992 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:20.993 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:20.993 INFO:teuthology.orchestra.run.smithi084.stdout: "device_enhanced_scan": { 2023-07-14T11:18:20.993 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "device_enhanced_scan", 2023-07-14T11:18:20.993 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:20.994 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:20.994 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:20.994 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:20.994 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:20.995 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:20.995 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:20.995 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Use libstoragemgmt during device scans", 2023-07-14T11:18:20.995 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:20.996 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:20.996 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:20.996 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:20.997 INFO:teuthology.orchestra.run.smithi084.stdout: "facts_cache_timeout": { 2023-07-14T11:18:20.997 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "facts_cache_timeout", 2023-07-14T11:18:20.997 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2023-07-14T11:18:20.997 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:20.998 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:20.998 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "60", 2023-07-14T11:18:20.998 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:20.998 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:20.999 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:20.999 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "seconds to cache host facts data", 2023-07-14T11:18:20.999 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:20.999 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.000 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.000 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.000 INFO:teuthology.orchestra.run.smithi084.stdout: "host_check_interval": { 2023-07-14T11:18:21.001 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "host_check_interval", 2023-07-14T11:18:21.001 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2023-07-14T11:18:21.001 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.001 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.002 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "600", 2023-07-14T11:18:21.002 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.002 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.002 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.003 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how frequently to perform a host check", 2023-07-14T11:18:21.003 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.003 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.003 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.003 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.004 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2023-07-14T11:18:21.004 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2023-07-14T11:18:21.004 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.004 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.004 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.004 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.005 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.005 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.005 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.005 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.005 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.005 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.005 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.005 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.006 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.006 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.006 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.006 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.006 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.006 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.006 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.006 INFO:teuthology.orchestra.run.smithi084.stdout: "log_refresh_metadata": { 2023-07-14T11:18:21.007 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_refresh_metadata", 2023-07-14T11:18:21.007 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.007 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.007 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.007 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.007 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.007 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.007 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.008 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-07-14T11:18:21.008 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.008 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.008 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.008 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.008 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2023-07-14T11:18:21.008 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2023-07-14T11:18:21.009 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.009 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.009 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.009 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:21.009 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.009 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.009 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.009 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-07-14T11:18:21.010 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.010 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.010 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.010 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.010 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2023-07-14T11:18:21.010 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2023-07-14T11:18:21.010 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.010 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.011 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.011 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2023-07-14T11:18:21.011 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.011 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.011 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.011 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.011 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.011 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.012 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.012 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.012 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.012 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.012 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.012 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.012 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.013 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.013 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.013 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2023-07-14T11:18:21.013 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2023-07-14T11:18:21.013 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.013 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.013 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.013 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.014 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.014 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.014 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.014 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.014 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.014 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.014 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.014 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.015 INFO:teuthology.orchestra.run.smithi084.stdout: "manage_etc_ceph_ceph_conf": { 2023-07-14T11:18:21.015 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-07-14T11:18:21.015 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.015 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.015 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.015 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.015 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.015 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.016 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.016 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-07-14T11:18:21.016 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.016 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.016 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.016 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.016 INFO:teuthology.orchestra.run.smithi084.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-07-14T11:18:21.017 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-07-14T11:18:21.017 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.017 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.017 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.017 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "*", 2023-07-14T11:18:21.017 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.017 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.018 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.018 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-07-14T11:18:21.018 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.018 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.018 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.018 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.018 INFO:teuthology.orchestra.run.smithi084.stdout: "max_count_per_host": { 2023-07-14T11:18:21.018 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "max_count_per_host", 2023-07-14T11:18:21.019 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2023-07-14T11:18:21.019 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.019 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.019 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2023-07-14T11:18:21.019 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.019 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.019 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.019 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "max number of daemons per service per host", 2023-07-14T11:18:21.020 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.020 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.020 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.020 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.020 INFO:teuthology.orchestra.run.smithi084.stdout: "max_osd_draining_count": { 2023-07-14T11:18:21.020 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "max_osd_draining_count", 2023-07-14T11:18:21.020 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2023-07-14T11:18:21.021 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.021 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.021 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2023-07-14T11:18:21.021 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.021 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.021 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.021 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-07-14T11:18:21.021 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.022 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.022 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.022 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.022 INFO:teuthology.orchestra.run.smithi084.stdout: "migration_current": { 2023-07-14T11:18:21.022 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "migration_current", 2023-07-14T11:18:21.022 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2023-07-14T11:18:21.022 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.023 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.023 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.023 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.023 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.023 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.023 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "internal - do not modify", 2023-07-14T11:18:21.023 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.023 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.024 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.024 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.024 INFO:teuthology.orchestra.run.smithi084.stdout: "mode": { 2023-07-14T11:18:21.024 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "mode", 2023-07-14T11:18:21.024 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.024 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.024 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.024 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "root", 2023-07-14T11:18:21.025 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.025 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.025 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.025 INFO:teuthology.orchestra.run.smithi084.stdout: "cephadm-package", 2023-07-14T11:18:21.025 INFO:teuthology.orchestra.run.smithi084.stdout: "root" 2023-07-14T11:18:21.025 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.025 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "mode for remote execution of cephadm", 2023-07-14T11:18:21.025 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.026 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.026 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.026 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.026 INFO:teuthology.orchestra.run.smithi084.stdout: "prometheus_alerts_path": { 2023-07-14T11:18:21.026 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "prometheus_alerts_path", 2023-07-14T11:18:21.026 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.026 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.027 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.027 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-07-14T11:18:21.027 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.027 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.027 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.027 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-07-14T11:18:21.027 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.027 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.028 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.028 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.028 INFO:teuthology.orchestra.run.smithi084.stdout: "prometheus_web_password": { 2023-07-14T11:18:21.028 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "prometheus_web_password", 2023-07-14T11:18:21.028 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.028 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.028 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.028 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "admin", 2023-07-14T11:18:21.029 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.029 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.029 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.029 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Prometheus web password", 2023-07-14T11:18:21.029 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.029 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.029 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.029 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.030 INFO:teuthology.orchestra.run.smithi084.stdout: "prometheus_web_user": { 2023-07-14T11:18:21.030 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "prometheus_web_user", 2023-07-14T11:18:21.030 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.030 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.030 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.030 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "admin", 2023-07-14T11:18:21.030 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.030 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.031 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.031 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Prometheus web user", 2023-07-14T11:18:21.031 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.031 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.031 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.031 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.031 INFO:teuthology.orchestra.run.smithi084.stdout: "registry_insecure": { 2023-07-14T11:18:21.031 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "registry_insecure", 2023-07-14T11:18:21.032 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.032 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.032 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.032 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.032 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.032 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.032 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.033 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-07-14T11:18:21.033 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.033 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.033 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.033 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.033 INFO:teuthology.orchestra.run.smithi084.stdout: "registry_password": { 2023-07-14T11:18:21.033 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "registry_password", 2023-07-14T11:18:21.033 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.034 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.034 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.034 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.034 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.034 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.034 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.034 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-07-14T11:18:21.034 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.035 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.035 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.035 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.035 INFO:teuthology.orchestra.run.smithi084.stdout: "registry_url": { 2023-07-14T11:18:21.035 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "registry_url", 2023-07-14T11:18:21.035 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.035 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.035 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.036 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.036 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.036 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.036 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.036 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-07-14T11:18:21.036 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.036 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.036 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.037 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.037 INFO:teuthology.orchestra.run.smithi084.stdout: "registry_username": { 2023-07-14T11:18:21.037 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "registry_username", 2023-07-14T11:18:21.037 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.037 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.037 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.037 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.038 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.038 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.038 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.038 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-07-14T11:18:21.038 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.038 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.038 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.038 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.039 INFO:teuthology.orchestra.run.smithi084.stdout: "secure_monitoring_stack": { 2023-07-14T11:18:21.039 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "secure_monitoring_stack", 2023-07-14T11:18:21.039 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.039 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.039 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.039 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.039 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.040 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.040 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.040 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-07-14T11:18:21.040 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.040 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.040 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.040 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.040 INFO:teuthology.orchestra.run.smithi084.stdout: "service_discovery_port": { 2023-07-14T11:18:21.041 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "service_discovery_port", 2023-07-14T11:18:21.041 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2023-07-14T11:18:21.041 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.041 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.041 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "8765", 2023-07-14T11:18:21.041 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.041 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.041 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.042 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "cephadm service discovery port", 2023-07-14T11:18:21.042 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.042 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.042 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.042 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.042 INFO:teuthology.orchestra.run.smithi084.stdout: "ssh_config_file": { 2023-07-14T11:18:21.042 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ssh_config_file", 2023-07-14T11:18:21.042 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.043 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.043 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.043 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.043 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.043 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.043 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.043 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-07-14T11:18:21.043 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.044 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.044 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.044 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.044 INFO:teuthology.orchestra.run.smithi084.stdout: "use_agent": { 2023-07-14T11:18:21.044 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "use_agent", 2023-07-14T11:18:21.044 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.044 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.045 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.045 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.045 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.045 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.045 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.045 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-07-14T11:18:21.045 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.045 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.046 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.046 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.046 INFO:teuthology.orchestra.run.smithi084.stdout: "use_repo_digest": { 2023-07-14T11:18:21.046 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "use_repo_digest", 2023-07-14T11:18:21.046 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.046 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.046 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.046 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:21.047 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.047 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.047 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.047 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-07-14T11:18:21.047 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.047 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.047 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.047 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.048 INFO:teuthology.orchestra.run.smithi084.stdout: "warn_on_failed_host_check": { 2023-07-14T11:18:21.048 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "warn_on_failed_host_check", 2023-07-14T11:18:21.048 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.048 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.048 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.048 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:21.048 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.048 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.049 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.049 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "raise a health warning if the host check fails", 2023-07-14T11:18:21.049 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.049 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.049 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.049 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.049 INFO:teuthology.orchestra.run.smithi084.stdout: "warn_on_stray_daemons": { 2023-07-14T11:18:21.050 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "warn_on_stray_daemons", 2023-07-14T11:18:21.050 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.050 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.050 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.050 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:21.050 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.050 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.050 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.051 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-07-14T11:18:21.051 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.051 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.051 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.051 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.051 INFO:teuthology.orchestra.run.smithi084.stdout: "warn_on_stray_hosts": { 2023-07-14T11:18:21.051 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "warn_on_stray_hosts", 2023-07-14T11:18:21.051 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.052 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.052 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.052 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:21.052 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.052 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.052 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.052 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-07-14T11:18:21.052 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.053 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.053 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.053 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.053 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.053 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.053 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:21.053 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "crash", 2023-07-14T11:18:21.053 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2023-07-14T11:18:21.054 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2023-07-14T11:18:21.054 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2023-07-14T11:18:21.054 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2023-07-14T11:18:21.054 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2023-07-14T11:18:21.054 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.054 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.054 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.055 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.055 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.055 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.055 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.055 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.055 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.055 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.055 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.056 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.056 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.056 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.056 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.056 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.056 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.056 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.056 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.057 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2023-07-14T11:18:21.057 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2023-07-14T11:18:21.057 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.057 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.057 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.057 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.057 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.057 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.058 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.058 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.058 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.058 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.058 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.058 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.058 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2023-07-14T11:18:21.058 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2023-07-14T11:18:21.059 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.059 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.059 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.059 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2023-07-14T11:18:21.059 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.059 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.059 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.059 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.060 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.060 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.060 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.060 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.060 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.060 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.060 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.061 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.061 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.061 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.061 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.061 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2023-07-14T11:18:21.061 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2023-07-14T11:18:21.061 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.062 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.062 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.062 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.062 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.062 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.062 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.062 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.062 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.063 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.063 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.063 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.063 INFO:teuthology.orchestra.run.smithi084.stdout: "retain_interval": { 2023-07-14T11:18:21.063 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "retain_interval", 2023-07-14T11:18:21.063 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2023-07-14T11:18:21.063 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.063 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.064 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "31536000", 2023-07-14T11:18:21.064 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.064 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.064 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.064 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how long to retain crashes before pruning them", 2023-07-14T11:18:21.064 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.064 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.064 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.065 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.065 INFO:teuthology.orchestra.run.smithi084.stdout: "warn_recent_interval": { 2023-07-14T11:18:21.065 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "warn_recent_interval", 2023-07-14T11:18:21.065 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2023-07-14T11:18:21.065 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.065 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.065 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "1209600", 2023-07-14T11:18:21.066 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.066 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.066 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.066 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "time interval in which to warn about recent crashes", 2023-07-14T11:18:21.066 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.066 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.066 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.066 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.067 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.067 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.067 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:21.067 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "dashboard", 2023-07-14T11:18:21.067 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2023-07-14T11:18:21.067 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2023-07-14T11:18:21.067 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2023-07-14T11:18:21.067 INFO:teuthology.orchestra.run.smithi084.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-07-14T11:18:21.068 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-07-14T11:18:21.068 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2023-07-14T11:18:21.068 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.068 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.068 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2023-07-14T11:18:21.068 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.068 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.068 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.069 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.069 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.069 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.069 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.069 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.069 INFO:teuthology.orchestra.run.smithi084.stdout: "ALERTMANAGER_API_HOST": { 2023-07-14T11:18:21.069 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ALERTMANAGER_API_HOST", 2023-07-14T11:18:21.069 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.070 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.070 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.070 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.070 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.070 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.070 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.070 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.070 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.071 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.071 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.071 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.071 INFO:teuthology.orchestra.run.smithi084.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-07-14T11:18:21.071 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-07-14T11:18:21.071 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.071 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.071 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.072 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:21.072 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.072 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.072 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.072 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.072 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.072 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.073 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.073 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.073 INFO:teuthology.orchestra.run.smithi084.stdout: "AUDIT_API_ENABLED": { 2023-07-14T11:18:21.073 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "AUDIT_API_ENABLED", 2023-07-14T11:18:21.073 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.073 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.073 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.073 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.074 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.074 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.074 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.074 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.074 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.074 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.074 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.074 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.075 INFO:teuthology.orchestra.run.smithi084.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-07-14T11:18:21.075 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-07-14T11:18:21.075 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.075 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.075 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.075 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:21.075 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.075 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.076 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.076 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.076 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.076 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.076 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.076 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.076 INFO:teuthology.orchestra.run.smithi084.stdout: "ENABLE_BROWSABLE_API": { 2023-07-14T11:18:21.077 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ENABLE_BROWSABLE_API", 2023-07-14T11:18:21.077 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.077 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.077 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.077 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:21.077 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.077 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.077 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.078 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.078 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.078 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.078 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.078 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.078 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-07-14T11:18:21.078 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-07-14T11:18:21.078 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.079 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.079 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.079 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:21.079 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.079 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.079 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.079 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.079 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.080 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.080 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.080 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.080 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-07-14T11:18:21.080 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-07-14T11:18:21.080 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.080 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.080 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.081 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:21.081 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.081 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.081 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.081 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.081 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.081 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.081 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.082 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.082 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-07-14T11:18:21.082 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-07-14T11:18:21.082 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.082 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.082 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.082 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:21.082 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.083 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.083 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.083 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.083 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.083 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.083 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.083 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.083 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-07-14T11:18:21.084 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-07-14T11:18:21.084 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.084 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.084 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.084 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:21.084 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.084 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.085 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.085 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.085 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.085 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.085 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.085 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.085 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_NFS": { 2023-07-14T11:18:21.085 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-07-14T11:18:21.086 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.086 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.086 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.086 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:21.086 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.086 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.086 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.087 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.087 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.087 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.087 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.087 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.087 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_RBD": { 2023-07-14T11:18:21.087 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-07-14T11:18:21.087 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.088 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.088 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.088 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:21.088 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.088 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.088 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.088 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.088 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.089 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.089 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.089 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.089 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_RGW": { 2023-07-14T11:18:21.089 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-07-14T11:18:21.089 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.089 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.089 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.090 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:21.090 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.090 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.090 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.090 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.090 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.090 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.090 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.091 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.091 INFO:teuthology.orchestra.run.smithi084.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-07-14T11:18:21.091 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-07-14T11:18:21.091 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.091 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.091 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.091 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.092 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.092 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.092 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.092 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.092 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.092 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.092 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.092 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.093 INFO:teuthology.orchestra.run.smithi084.stdout: "GRAFANA_API_PASSWORD": { 2023-07-14T11:18:21.093 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GRAFANA_API_PASSWORD", 2023-07-14T11:18:21.093 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.093 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.093 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.093 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "admin", 2023-07-14T11:18:21.093 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.093 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.094 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.094 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.094 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.094 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.094 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.094 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.094 INFO:teuthology.orchestra.run.smithi084.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-07-14T11:18:21.094 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-07-14T11:18:21.095 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.095 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.095 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.095 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:21.095 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.095 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.095 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.095 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.096 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.096 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.096 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.096 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.096 INFO:teuthology.orchestra.run.smithi084.stdout: "GRAFANA_API_URL": { 2023-07-14T11:18:21.096 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GRAFANA_API_URL", 2023-07-14T11:18:21.096 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.097 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.097 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.097 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.097 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.097 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.097 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.097 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.097 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.098 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.098 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.098 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.098 INFO:teuthology.orchestra.run.smithi084.stdout: "GRAFANA_API_USERNAME": { 2023-07-14T11:18:21.098 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GRAFANA_API_USERNAME", 2023-07-14T11:18:21.098 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.098 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.098 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.099 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "admin", 2023-07-14T11:18:21.099 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.099 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.099 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.099 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.099 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.099 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.099 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.100 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.100 INFO:teuthology.orchestra.run.smithi084.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-07-14T11:18:21.100 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-07-14T11:18:21.100 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.100 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.100 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.100 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.101 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.101 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.101 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.101 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.101 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.101 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.101 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.101 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.102 INFO:teuthology.orchestra.run.smithi084.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-07-14T11:18:21.102 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-07-14T11:18:21.102 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.102 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.102 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.102 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.102 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.102 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.103 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.103 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.103 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.103 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.103 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.103 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.103 INFO:teuthology.orchestra.run.smithi084.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-07-14T11:18:21.103 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-07-14T11:18:21.104 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.104 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.104 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.104 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:21.104 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.104 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.104 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.104 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.105 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.105 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.105 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.105 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.105 INFO:teuthology.orchestra.run.smithi084.stdout: "ISSUE_TRACKER_API_KEY": { 2023-07-14T11:18:21.105 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-07-14T11:18:21.105 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.106 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.106 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.106 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.106 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.106 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.106 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.106 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.106 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.107 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.107 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.107 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.107 INFO:teuthology.orchestra.run.smithi084.stdout: "PROMETHEUS_API_HOST": { 2023-07-14T11:18:21.107 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PROMETHEUS_API_HOST", 2023-07-14T11:18:21.107 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.107 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.107 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.108 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.108 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.108 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.108 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.108 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.108 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.108 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.108 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.109 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.109 INFO:teuthology.orchestra.run.smithi084.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-07-14T11:18:21.109 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-07-14T11:18:21.109 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.109 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.109 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.109 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:21.110 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.110 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.110 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.110 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.110 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.110 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.110 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.110 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.111 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-07-14T11:18:21.111 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-07-14T11:18:21.111 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.111 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.111 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.111 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.111 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.111 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.112 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.112 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.112 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.112 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.112 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.112 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.112 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-07-14T11:18:21.112 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-07-14T11:18:21.113 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.113 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.113 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.113 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.113 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.113 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.113 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.113 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.114 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.114 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.114 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.114 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.114 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-07-14T11:18:21.114 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-07-14T11:18:21.114 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.114 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.115 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.115 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:21.115 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.115 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.115 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.115 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.115 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.116 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.116 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.116 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.116 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-07-14T11:18:21.116 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-07-14T11:18:21.116 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.116 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.116 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.117 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:21.117 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.117 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.117 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.117 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.117 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.117 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.117 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.118 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.118 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-07-14T11:18:21.118 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-07-14T11:18:21.118 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.118 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.118 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.118 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.118 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.119 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.119 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.119 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.119 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.119 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.119 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.119 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.119 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-07-14T11:18:21.120 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-07-14T11:18:21.120 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.120 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.120 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.120 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.120 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.120 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.121 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.121 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.121 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.121 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.121 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.121 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.121 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-07-14T11:18:21.121 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-07-14T11:18:21.122 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.122 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.122 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.122 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.122 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.122 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.122 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.122 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.123 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.123 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.123 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.123 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.123 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_ENABLED": { 2023-07-14T11:18:21.123 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_ENABLED", 2023-07-14T11:18:21.123 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.123 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.124 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.124 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:21.124 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.124 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.124 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.124 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.124 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.124 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.125 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.125 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.125 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-07-14T11:18:21.125 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-07-14T11:18:21.125 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.125 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.125 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.125 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-07-14T11:18:21.126 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.126 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.126 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.126 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.126 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.126 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.126 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.126 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.127 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-07-14T11:18:21.127 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-07-14T11:18:21.127 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2023-07-14T11:18:21.127 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.127 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.127 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2023-07-14T11:18:21.127 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.127 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.128 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.128 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.128 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.128 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.128 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.128 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.128 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-07-14T11:18:21.129 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-07-14T11:18:21.129 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2023-07-14T11:18:21.129 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.129 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.129 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "8", 2023-07-14T11:18:21.129 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.129 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.129 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.130 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.130 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.130 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.130 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.130 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.130 INFO:teuthology.orchestra.run.smithi084.stdout: "REST_REQUESTS_TIMEOUT": { 2023-07-14T11:18:21.130 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-07-14T11:18:21.130 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2023-07-14T11:18:21.131 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.131 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.131 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "45", 2023-07-14T11:18:21.131 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.131 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.131 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.131 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.131 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.132 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.132 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.132 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.132 INFO:teuthology.orchestra.run.smithi084.stdout: "RGW_API_ACCESS_KEY": { 2023-07-14T11:18:21.132 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RGW_API_ACCESS_KEY", 2023-07-14T11:18:21.132 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.132 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.133 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.133 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.133 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.133 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.133 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.133 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.133 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.133 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.134 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.134 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.134 INFO:teuthology.orchestra.run.smithi084.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-07-14T11:18:21.134 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-07-14T11:18:21.134 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.134 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.134 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.134 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "admin", 2023-07-14T11:18:21.135 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.135 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.135 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.135 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.135 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.135 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.135 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.135 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.136 INFO:teuthology.orchestra.run.smithi084.stdout: "RGW_API_SECRET_KEY": { 2023-07-14T11:18:21.136 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RGW_API_SECRET_KEY", 2023-07-14T11:18:21.136 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.136 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.136 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.136 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.136 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.136 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.137 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.137 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.137 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.137 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.137 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.137 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.137 INFO:teuthology.orchestra.run.smithi084.stdout: "RGW_API_SSL_VERIFY": { 2023-07-14T11:18:21.138 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RGW_API_SSL_VERIFY", 2023-07-14T11:18:21.138 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.138 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.138 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.138 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:21.138 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.138 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.138 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.139 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.139 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.139 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.139 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.139 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.139 INFO:teuthology.orchestra.run.smithi084.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-07-14T11:18:21.139 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-07-14T11:18:21.139 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2023-07-14T11:18:21.140 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.140 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.140 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2023-07-14T11:18:21.140 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.140 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.140 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.140 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.140 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.141 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.141 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.141 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.141 INFO:teuthology.orchestra.run.smithi084.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-07-14T11:18:21.141 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-07-14T11:18:21.141 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2023-07-14T11:18:21.141 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.141 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.142 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2023-07-14T11:18:21.142 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.142 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.142 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.142 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.142 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.142 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.142 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.143 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.143 INFO:teuthology.orchestra.run.smithi084.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-07-14T11:18:21.143 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-07-14T11:18:21.143 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2023-07-14T11:18:21.143 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.143 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.143 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "5", 2023-07-14T11:18:21.143 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.144 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.144 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.144 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.144 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.144 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.144 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.144 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.145 INFO:teuthology.orchestra.run.smithi084.stdout: "cross_origin_url": { 2023-07-14T11:18:21.145 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "cross_origin_url", 2023-07-14T11:18:21.145 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.145 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.145 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.145 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.145 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.145 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.146 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.146 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.146 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.146 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.146 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.146 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.146 INFO:teuthology.orchestra.run.smithi084.stdout: "crt_file": { 2023-07-14T11:18:21.146 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "crt_file", 2023-07-14T11:18:21.147 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.147 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.147 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.147 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.147 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.147 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.147 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.147 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.148 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.148 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.148 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.148 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.148 INFO:teuthology.orchestra.run.smithi084.stdout: "debug": { 2023-07-14T11:18:21.148 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "debug", 2023-07-14T11:18:21.148 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.149 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.149 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.149 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.149 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.149 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.149 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.149 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Enable/disable debug options", 2023-07-14T11:18:21.149 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.150 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.150 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.150 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.150 INFO:teuthology.orchestra.run.smithi084.stdout: "jwt_token_ttl": { 2023-07-14T11:18:21.150 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "jwt_token_ttl", 2023-07-14T11:18:21.150 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2023-07-14T11:18:21.150 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.150 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.151 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "28800", 2023-07-14T11:18:21.151 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.151 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.151 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.151 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.151 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.151 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.151 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.152 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.152 INFO:teuthology.orchestra.run.smithi084.stdout: "key_file": { 2023-07-14T11:18:21.152 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "key_file", 2023-07-14T11:18:21.152 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.152 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.152 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.152 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.152 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.153 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.153 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.153 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.153 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.153 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.153 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.153 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.153 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2023-07-14T11:18:21.154 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2023-07-14T11:18:21.154 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.154 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.154 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.154 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.154 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.154 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.154 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.155 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.155 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.155 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.155 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.155 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.155 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.155 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.155 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.156 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.156 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.156 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.156 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.156 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2023-07-14T11:18:21.156 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2023-07-14T11:18:21.156 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.157 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.157 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.157 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.157 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.157 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.157 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.157 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.157 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.158 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.158 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.158 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.158 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2023-07-14T11:18:21.158 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2023-07-14T11:18:21.158 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.158 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.158 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.159 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2023-07-14T11:18:21.159 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.159 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.159 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.159 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.159 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.159 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.159 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.160 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.160 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.160 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.160 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.160 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.160 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.160 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.161 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.161 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2023-07-14T11:18:21.161 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2023-07-14T11:18:21.161 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.161 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.161 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.161 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.161 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.162 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.162 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.162 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.162 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.162 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.162 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.162 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.162 INFO:teuthology.orchestra.run.smithi084.stdout: "motd": { 2023-07-14T11:18:21.163 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "motd", 2023-07-14T11:18:21.163 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.163 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.163 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.163 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.163 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.163 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.163 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.164 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "The message of the day", 2023-07-14T11:18:21.164 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.164 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.164 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.164 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.164 INFO:teuthology.orchestra.run.smithi084.stdout: "redirect_resolve_ip_addr": { 2023-07-14T11:18:21.164 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "redirect_resolve_ip_addr", 2023-07-14T11:18:21.164 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.165 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.165 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.165 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.165 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.165 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.165 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.165 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.165 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.166 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.166 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.166 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.166 INFO:teuthology.orchestra.run.smithi084.stdout: "server_addr": { 2023-07-14T11:18:21.166 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "server_addr", 2023-07-14T11:18:21.166 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.166 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.166 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.167 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "::", 2023-07-14T11:18:21.167 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.167 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.167 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.167 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.167 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.167 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.168 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.168 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.168 INFO:teuthology.orchestra.run.smithi084.stdout: "server_port": { 2023-07-14T11:18:21.168 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "server_port", 2023-07-14T11:18:21.168 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2023-07-14T11:18:21.168 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.168 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.168 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "8080", 2023-07-14T11:18:21.169 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.169 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.169 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.169 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.169 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.169 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.169 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.169 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.170 INFO:teuthology.orchestra.run.smithi084.stdout: "ssl": { 2023-07-14T11:18:21.170 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ssl", 2023-07-14T11:18:21.170 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.170 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.170 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.170 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:21.170 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.170 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.171 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.171 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.171 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.171 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.171 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.171 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.171 INFO:teuthology.orchestra.run.smithi084.stdout: "ssl_server_port": { 2023-07-14T11:18:21.171 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ssl_server_port", 2023-07-14T11:18:21.172 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2023-07-14T11:18:21.172 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.172 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.172 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "8443", 2023-07-14T11:18:21.172 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.172 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.172 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.172 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.173 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.173 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.173 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.173 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.173 INFO:teuthology.orchestra.run.smithi084.stdout: "standby_behaviour": { 2023-07-14T11:18:21.173 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "standby_behaviour", 2023-07-14T11:18:21.173 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.173 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.174 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.174 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "redirect", 2023-07-14T11:18:21.174 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.174 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.174 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.174 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.174 INFO:teuthology.orchestra.run.smithi084.stdout: "redirect" 2023-07-14T11:18:21.175 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.175 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.175 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.175 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.175 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.175 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.175 INFO:teuthology.orchestra.run.smithi084.stdout: "standby_error_status_code": { 2023-07-14T11:18:21.175 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "standby_error_status_code", 2023-07-14T11:18:21.176 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2023-07-14T11:18:21.176 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.176 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.176 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "500", 2023-07-14T11:18:21.176 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "400", 2023-07-14T11:18:21.176 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "599", 2023-07-14T11:18:21.176 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.176 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.177 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.177 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.177 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.177 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.177 INFO:teuthology.orchestra.run.smithi084.stdout: "url_prefix": { 2023-07-14T11:18:21.177 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "url_prefix", 2023-07-14T11:18:21.177 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.177 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.178 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.178 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.178 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.178 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.178 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.178 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.178 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.178 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.179 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.179 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.179 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.179 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.179 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:21.179 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "devicehealth", 2023-07-14T11:18:21.179 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2023-07-14T11:18:21.179 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2023-07-14T11:18:21.180 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2023-07-14T11:18:21.180 INFO:teuthology.orchestra.run.smithi084.stdout: "enable_monitoring": { 2023-07-14T11:18:21.180 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "enable_monitoring", 2023-07-14T11:18:21.180 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.180 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.180 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.180 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:21.181 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.181 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.181 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.181 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "monitor device health metrics", 2023-07-14T11:18:21.181 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.181 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.181 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.181 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.182 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2023-07-14T11:18:21.182 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2023-07-14T11:18:21.182 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.182 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.182 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.182 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.182 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.182 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.183 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.183 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.183 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.183 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.183 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.183 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.183 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.183 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.184 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.184 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.184 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.184 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.184 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.184 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2023-07-14T11:18:21.184 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2023-07-14T11:18:21.184 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.185 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.185 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.185 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.185 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.185 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.185 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.185 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.186 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.186 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.186 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.186 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.186 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2023-07-14T11:18:21.186 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2023-07-14T11:18:21.186 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.186 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.187 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.187 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2023-07-14T11:18:21.187 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.187 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.187 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.187 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.187 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.187 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.188 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.188 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.188 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.188 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.188 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.188 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.188 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.188 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.189 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.189 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2023-07-14T11:18:21.189 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2023-07-14T11:18:21.189 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.189 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.189 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.189 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.189 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.190 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.190 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.190 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.190 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.190 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.190 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.190 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.190 INFO:teuthology.orchestra.run.smithi084.stdout: "mark_out_threshold": { 2023-07-14T11:18:21.191 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "mark_out_threshold", 2023-07-14T11:18:21.191 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2023-07-14T11:18:21.191 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.191 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.191 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "2419200", 2023-07-14T11:18:21.191 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.191 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.191 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.192 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-07-14T11:18:21.192 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.192 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.192 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.192 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.192 INFO:teuthology.orchestra.run.smithi084.stdout: "pool_name": { 2023-07-14T11:18:21.192 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "pool_name", 2023-07-14T11:18:21.192 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.193 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.193 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.193 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "device_health_metrics", 2023-07-14T11:18:21.193 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.193 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.193 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.193 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "name of pool in which to store device health metrics", 2023-07-14T11:18:21.193 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.194 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.194 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.194 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.194 INFO:teuthology.orchestra.run.smithi084.stdout: "retention_period": { 2023-07-14T11:18:21.194 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "retention_period", 2023-07-14T11:18:21.194 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2023-07-14T11:18:21.194 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.194 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.195 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "15552000", 2023-07-14T11:18:21.195 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.195 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.195 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.195 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how long to retain device health metrics", 2023-07-14T11:18:21.195 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.195 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.195 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.196 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.196 INFO:teuthology.orchestra.run.smithi084.stdout: "scrape_frequency": { 2023-07-14T11:18:21.196 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "scrape_frequency", 2023-07-14T11:18:21.196 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2023-07-14T11:18:21.196 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.196 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.196 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "86400", 2023-07-14T11:18:21.197 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.197 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.197 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.197 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how frequently to scrape device health metrics", 2023-07-14T11:18:21.197 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.197 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.197 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.197 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.198 INFO:teuthology.orchestra.run.smithi084.stdout: "self_heal": { 2023-07-14T11:18:21.198 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "self_heal", 2023-07-14T11:18:21.198 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.198 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.198 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.198 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:21.198 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.198 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.199 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.199 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-07-14T11:18:21.199 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.199 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.199 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.199 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.199 INFO:teuthology.orchestra.run.smithi084.stdout: "sleep_interval": { 2023-07-14T11:18:21.199 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sleep_interval", 2023-07-14T11:18:21.200 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2023-07-14T11:18:21.200 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.200 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.200 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "600", 2023-07-14T11:18:21.200 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.200 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.200 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.200 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how frequently to wake up and check device health", 2023-07-14T11:18:21.201 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.201 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.201 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.201 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.201 INFO:teuthology.orchestra.run.smithi084.stdout: "warn_threshold": { 2023-07-14T11:18:21.201 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "warn_threshold", 2023-07-14T11:18:21.201 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2023-07-14T11:18:21.201 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.202 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.202 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "7257600", 2023-07-14T11:18:21.202 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.202 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.202 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.202 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-07-14T11:18:21.202 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.202 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.203 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.203 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.203 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.204 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.204 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:21.204 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "diskprediction_local", 2023-07-14T11:18:21.204 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2023-07-14T11:18:21.204 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2023-07-14T11:18:21.204 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2023-07-14T11:18:21.205 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2023-07-14T11:18:21.205 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2023-07-14T11:18:21.205 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.205 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.205 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.205 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.205 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.206 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.206 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.206 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.206 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.206 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.206 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.206 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.206 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.207 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.207 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.207 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.207 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.207 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.207 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.207 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2023-07-14T11:18:21.207 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2023-07-14T11:18:21.208 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.208 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.208 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.208 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.208 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.208 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.208 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.208 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.209 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.209 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.209 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.209 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.209 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2023-07-14T11:18:21.209 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2023-07-14T11:18:21.209 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.210 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.210 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.210 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2023-07-14T11:18:21.210 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.210 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.210 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.210 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.210 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.211 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.211 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.211 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.211 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.211 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.211 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.211 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.211 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.212 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.212 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.212 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2023-07-14T11:18:21.212 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2023-07-14T11:18:21.212 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.212 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.212 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.212 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.213 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.213 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.213 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.213 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.213 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.213 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.213 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.213 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.214 INFO:teuthology.orchestra.run.smithi084.stdout: "predict_interval": { 2023-07-14T11:18:21.214 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "predict_interval", 2023-07-14T11:18:21.214 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.214 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.214 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.214 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "86400", 2023-07-14T11:18:21.214 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.215 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.215 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.215 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.215 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.215 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.215 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.215 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.215 INFO:teuthology.orchestra.run.smithi084.stdout: "predictor_model": { 2023-07-14T11:18:21.216 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "predictor_model", 2023-07-14T11:18:21.216 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.216 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.216 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.216 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "prophetstor", 2023-07-14T11:18:21.216 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.216 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.216 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.217 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.217 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.217 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.217 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.217 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.217 INFO:teuthology.orchestra.run.smithi084.stdout: "sleep_interval": { 2023-07-14T11:18:21.217 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sleep_interval", 2023-07-14T11:18:21.217 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.218 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.218 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.218 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "600", 2023-07-14T11:18:21.218 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.218 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.218 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.218 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.219 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.219 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.219 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.219 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.219 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.219 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.219 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:21.219 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "influx", 2023-07-14T11:18:21.220 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": false, 2023-07-14T11:18:21.220 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "influxdb python module not found", 2023-07-14T11:18:21.220 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2023-07-14T11:18:21.220 INFO:teuthology.orchestra.run.smithi084.stdout: "batch_size": { 2023-07-14T11:18:21.220 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "batch_size", 2023-07-14T11:18:21.220 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2023-07-14T11:18:21.220 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.220 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.221 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "5000", 2023-07-14T11:18:21.221 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.221 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.221 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.221 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-07-14T11:18:21.221 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.221 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.221 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.222 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.222 INFO:teuthology.orchestra.run.smithi084.stdout: "database": { 2023-07-14T11:18:21.222 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "database", 2023-07-14T11:18:21.222 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.222 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.222 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.222 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "ceph", 2023-07-14T11:18:21.222 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.223 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.223 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.223 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-07-14T11:18:21.223 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.223 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.223 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.223 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.223 INFO:teuthology.orchestra.run.smithi084.stdout: "hostname": { 2023-07-14T11:18:21.224 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "hostname", 2023-07-14T11:18:21.224 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.224 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.224 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.224 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.224 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.224 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.225 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.225 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "InfluxDB server hostname", 2023-07-14T11:18:21.225 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.225 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.225 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.225 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.225 INFO:teuthology.orchestra.run.smithi084.stdout: "interval": { 2023-07-14T11:18:21.225 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "interval", 2023-07-14T11:18:21.226 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2023-07-14T11:18:21.226 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.226 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.226 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "30", 2023-07-14T11:18:21.226 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "5", 2023-07-14T11:18:21.226 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.226 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.226 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-07-14T11:18:21.227 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.227 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.227 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.227 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.227 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2023-07-14T11:18:21.227 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2023-07-14T11:18:21.227 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.227 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.228 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.228 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.228 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.228 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.228 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.228 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.228 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.229 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.229 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.229 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.229 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.229 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.229 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.229 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.229 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.230 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.230 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.230 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2023-07-14T11:18:21.230 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2023-07-14T11:18:21.230 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.230 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.230 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.230 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.231 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.231 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.231 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.231 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.231 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.231 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.231 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.231 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.232 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2023-07-14T11:18:21.232 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2023-07-14T11:18:21.232 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.232 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.232 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.232 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2023-07-14T11:18:21.232 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.233 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.233 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.233 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.233 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.233 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.233 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.233 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.233 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.234 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.234 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.234 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.234 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.234 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.234 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.234 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2023-07-14T11:18:21.234 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2023-07-14T11:18:21.235 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.235 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.235 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.235 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.235 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.235 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.235 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.235 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.236 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.236 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.236 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.236 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.236 INFO:teuthology.orchestra.run.smithi084.stdout: "password": { 2023-07-14T11:18:21.236 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "password", 2023-07-14T11:18:21.236 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.236 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.237 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.237 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.237 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.237 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.237 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.237 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "password of InfluxDB server user", 2023-07-14T11:18:21.237 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.237 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.238 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.238 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.238 INFO:teuthology.orchestra.run.smithi084.stdout: "port": { 2023-07-14T11:18:21.238 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "port", 2023-07-14T11:18:21.238 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2023-07-14T11:18:21.238 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.238 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.238 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "8086", 2023-07-14T11:18:21.239 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.239 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.239 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.239 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "InfluxDB server port", 2023-07-14T11:18:21.239 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.239 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.239 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.239 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.240 INFO:teuthology.orchestra.run.smithi084.stdout: "ssl": { 2023-07-14T11:18:21.240 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ssl", 2023-07-14T11:18:21.240 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.240 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.240 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.240 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "false", 2023-07-14T11:18:21.240 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.241 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.241 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.241 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-07-14T11:18:21.241 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.241 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.241 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.241 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.241 INFO:teuthology.orchestra.run.smithi084.stdout: "threads": { 2023-07-14T11:18:21.242 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "threads", 2023-07-14T11:18:21.242 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2023-07-14T11:18:21.242 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.242 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.242 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "5", 2023-07-14T11:18:21.242 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "1", 2023-07-14T11:18:21.242 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "32", 2023-07-14T11:18:21.242 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.243 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-07-14T11:18:21.243 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.243 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.243 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.243 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.243 INFO:teuthology.orchestra.run.smithi084.stdout: "username": { 2023-07-14T11:18:21.243 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "username", 2023-07-14T11:18:21.244 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.244 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.244 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.244 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.244 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.244 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.244 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.244 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "username of InfluxDB server user", 2023-07-14T11:18:21.245 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.245 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.245 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.245 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.245 INFO:teuthology.orchestra.run.smithi084.stdout: "verify_ssl": { 2023-07-14T11:18:21.245 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "verify_ssl", 2023-07-14T11:18:21.245 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.245 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.246 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.246 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "true", 2023-07-14T11:18:21.246 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.246 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.246 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.246 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-07-14T11:18:21.246 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.247 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.247 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.247 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.247 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.247 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.247 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:21.247 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "insights", 2023-07-14T11:18:21.247 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2023-07-14T11:18:21.248 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2023-07-14T11:18:21.248 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2023-07-14T11:18:21.248 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2023-07-14T11:18:21.248 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2023-07-14T11:18:21.248 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.248 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.248 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.248 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.249 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.249 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.249 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.249 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.249 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.249 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.249 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.249 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.250 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.250 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.250 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.250 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.250 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.250 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.250 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.250 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2023-07-14T11:18:21.251 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2023-07-14T11:18:21.251 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.251 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.251 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.251 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.251 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.251 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.251 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.252 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.252 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.252 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.252 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.252 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.252 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2023-07-14T11:18:21.252 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2023-07-14T11:18:21.252 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.253 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.253 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.253 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2023-07-14T11:18:21.253 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.253 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.253 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.253 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.254 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.254 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.254 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.254 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.254 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.254 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.254 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.254 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.255 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.255 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.255 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.255 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2023-07-14T11:18:21.255 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2023-07-14T11:18:21.255 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.255 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.255 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.256 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.256 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.256 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.256 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.256 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.256 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.256 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.257 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.257 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.257 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.257 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.257 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:21.257 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "iostat", 2023-07-14T11:18:21.257 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2023-07-14T11:18:21.257 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2023-07-14T11:18:21.258 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2023-07-14T11:18:21.258 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2023-07-14T11:18:21.258 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2023-07-14T11:18:21.258 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.258 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.258 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.258 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.258 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.259 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.259 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.259 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.259 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.259 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.259 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.259 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.259 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.260 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.260 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.260 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.260 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.260 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.260 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.260 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2023-07-14T11:18:21.261 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2023-07-14T11:18:21.261 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.261 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.261 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.261 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.261 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.261 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.261 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.262 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.262 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.262 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.262 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.262 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.262 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2023-07-14T11:18:21.262 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2023-07-14T11:18:21.262 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.263 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.263 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.263 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2023-07-14T11:18:21.263 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.263 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.263 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.263 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.263 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.264 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.264 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.264 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.264 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.264 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.264 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.264 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.264 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.265 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.265 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.265 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2023-07-14T11:18:21.265 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2023-07-14T11:18:21.265 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.265 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.265 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.265 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.266 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.266 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.266 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.266 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.266 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.266 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.266 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.266 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.267 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.267 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.267 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:21.267 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "localpool", 2023-07-14T11:18:21.267 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2023-07-14T11:18:21.267 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2023-07-14T11:18:21.267 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2023-07-14T11:18:21.267 INFO:teuthology.orchestra.run.smithi084.stdout: "failure_domain": { 2023-07-14T11:18:21.268 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "failure_domain", 2023-07-14T11:18:21.268 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.268 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.268 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.268 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "host", 2023-07-14T11:18:21.268 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.268 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.269 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.269 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "failure domain for any created local pool", 2023-07-14T11:18:21.269 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-07-14T11:18:21.269 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.269 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.269 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.269 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2023-07-14T11:18:21.269 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2023-07-14T11:18:21.270 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.270 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.270 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.270 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.270 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.270 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.270 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.270 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.271 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.271 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.271 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.271 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.271 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.271 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.271 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.271 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.272 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.272 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.272 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.272 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2023-07-14T11:18:21.272 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2023-07-14T11:18:21.272 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.272 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.272 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.273 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.273 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.273 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.273 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.273 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.273 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.273 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.273 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.274 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.274 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2023-07-14T11:18:21.274 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2023-07-14T11:18:21.274 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.274 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.274 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.274 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2023-07-14T11:18:21.274 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.275 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.275 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.275 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.275 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.275 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.275 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.275 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.275 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.276 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.276 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.276 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.276 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.276 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.276 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.276 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2023-07-14T11:18:21.277 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2023-07-14T11:18:21.277 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.277 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.277 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.277 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.277 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.277 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.277 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.278 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.278 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.278 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.278 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.278 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.278 INFO:teuthology.orchestra.run.smithi084.stdout: "min_size": { 2023-07-14T11:18:21.278 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "min_size", 2023-07-14T11:18:21.279 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2023-07-14T11:18:21.279 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.279 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.279 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.279 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.279 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.279 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.279 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "default min_size for any created local pool", 2023-07-14T11:18:21.280 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-07-14T11:18:21.280 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.280 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.280 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.280 INFO:teuthology.orchestra.run.smithi084.stdout: "num_rep": { 2023-07-14T11:18:21.280 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "num_rep", 2023-07-14T11:18:21.280 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2023-07-14T11:18:21.280 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.281 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.281 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "3", 2023-07-14T11:18:21.281 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.281 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.281 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.281 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "default replica count for any created local pool", 2023-07-14T11:18:21.281 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.281 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.282 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.282 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.282 INFO:teuthology.orchestra.run.smithi084.stdout: "pg_num": { 2023-07-14T11:18:21.282 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "pg_num", 2023-07-14T11:18:21.282 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2023-07-14T11:18:21.282 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.282 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.283 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "128", 2023-07-14T11:18:21.283 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.283 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.283 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.283 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "default pg_num for any created local pool", 2023-07-14T11:18:21.283 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.283 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.283 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.284 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.284 INFO:teuthology.orchestra.run.smithi084.stdout: "prefix": { 2023-07-14T11:18:21.284 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "prefix", 2023-07-14T11:18:21.284 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.284 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.284 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.284 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.284 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.285 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.285 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.285 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "name prefix for any created local pool", 2023-07-14T11:18:21.285 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.285 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.285 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.285 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.285 INFO:teuthology.orchestra.run.smithi084.stdout: "subtree": { 2023-07-14T11:18:21.286 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "subtree", 2023-07-14T11:18:21.286 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.286 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.286 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.286 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "rack", 2023-07-14T11:18:21.286 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.286 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.286 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.287 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "CRUSH level for which to create a local pool", 2023-07-14T11:18:21.287 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-07-14T11:18:21.287 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.287 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.287 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.287 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.287 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.288 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:21.288 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "mds_autoscaler", 2023-07-14T11:18:21.288 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2023-07-14T11:18:21.288 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2023-07-14T11:18:21.288 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2023-07-14T11:18:21.288 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2023-07-14T11:18:21.288 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2023-07-14T11:18:21.288 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.289 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.289 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.289 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.289 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.289 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.289 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.289 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.289 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.290 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.290 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.290 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.290 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.290 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.290 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.290 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.290 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.291 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.291 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.291 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2023-07-14T11:18:21.291 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2023-07-14T11:18:21.291 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.291 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.291 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.291 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.292 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.292 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.292 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.292 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.292 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.292 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.292 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.293 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.293 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2023-07-14T11:18:21.293 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2023-07-14T11:18:21.293 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.293 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.293 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.293 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2023-07-14T11:18:21.293 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.294 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.294 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.294 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.294 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.294 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.294 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.294 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.294 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.295 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.295 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.295 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.295 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.295 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.295 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.295 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2023-07-14T11:18:21.295 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2023-07-14T11:18:21.296 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.296 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.296 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.296 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.296 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.296 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.296 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.296 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.297 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.297 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.297 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.297 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.297 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.297 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.297 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:21.297 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "mirroring", 2023-07-14T11:18:21.298 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2023-07-14T11:18:21.298 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2023-07-14T11:18:21.298 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2023-07-14T11:18:21.298 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2023-07-14T11:18:21.298 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2023-07-14T11:18:21.298 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.298 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.298 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.299 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.299 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.299 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.299 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.299 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.299 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.299 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.299 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.300 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.300 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.300 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.300 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.300 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.300 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.300 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.301 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.301 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2023-07-14T11:18:21.301 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2023-07-14T11:18:21.301 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.301 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.301 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.301 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.301 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.302 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.302 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.302 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.302 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.302 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.302 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.302 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.302 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2023-07-14T11:18:21.303 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2023-07-14T11:18:21.303 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.303 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.303 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.303 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2023-07-14T11:18:21.303 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.303 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.303 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.304 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.304 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.304 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.304 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.304 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.304 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.304 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.305 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.305 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.305 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.305 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.305 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.305 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2023-07-14T11:18:21.305 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2023-07-14T11:18:21.305 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.306 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.306 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.306 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.306 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.306 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.306 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.306 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.306 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.307 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.307 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.307 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.307 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.307 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.307 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:21.307 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "nfs", 2023-07-14T11:18:21.307 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2023-07-14T11:18:21.308 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2023-07-14T11:18:21.308 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2023-07-14T11:18:21.308 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2023-07-14T11:18:21.308 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2023-07-14T11:18:21.308 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.308 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.308 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.308 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.309 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.309 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.309 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.309 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.309 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.309 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.309 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.310 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.310 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.310 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.310 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.310 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.310 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.310 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.310 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.311 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2023-07-14T11:18:21.311 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2023-07-14T11:18:21.311 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.311 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.311 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.311 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.311 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.311 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.312 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.312 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.312 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.312 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.312 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.312 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.312 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2023-07-14T11:18:21.312 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2023-07-14T11:18:21.313 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.313 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.313 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.313 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2023-07-14T11:18:21.313 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.313 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.313 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.313 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.314 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.314 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.314 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.314 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.314 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.314 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.314 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.314 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.315 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.315 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.315 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.315 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2023-07-14T11:18:21.315 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2023-07-14T11:18:21.315 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.315 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.315 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.316 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.316 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.316 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.316 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.316 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.316 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.316 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.317 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.317 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.317 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.317 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.317 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:21.317 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "orchestrator", 2023-07-14T11:18:21.317 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2023-07-14T11:18:21.317 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2023-07-14T11:18:21.318 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2023-07-14T11:18:21.318 INFO:teuthology.orchestra.run.smithi084.stdout: "fail_fs": { 2023-07-14T11:18:21.318 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "fail_fs", 2023-07-14T11:18:21.318 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.318 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.318 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.318 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.318 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.319 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.319 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.319 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-07-14T11:18:21.319 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.319 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.319 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.319 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.319 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2023-07-14T11:18:21.320 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2023-07-14T11:18:21.320 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.320 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.320 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.320 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.320 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.320 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.320 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.321 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.321 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.321 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.321 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.321 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.321 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.321 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.321 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.322 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.322 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.322 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.322 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.322 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2023-07-14T11:18:21.322 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2023-07-14T11:18:21.322 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.322 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.323 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.323 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.323 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.323 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.323 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.323 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.323 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.323 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.324 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.324 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.324 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2023-07-14T11:18:21.324 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2023-07-14T11:18:21.324 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.324 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.324 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.325 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2023-07-14T11:18:21.325 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.325 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.325 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.325 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.325 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.325 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.325 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.326 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.326 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.326 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.326 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.326 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.326 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.326 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.326 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.327 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2023-07-14T11:18:21.327 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2023-07-14T11:18:21.327 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.327 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.327 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.327 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.327 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.327 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.328 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.328 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.328 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.328 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.328 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.328 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.328 INFO:teuthology.orchestra.run.smithi084.stdout: "orchestrator": { 2023-07-14T11:18:21.329 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "orchestrator", 2023-07-14T11:18:21.329 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.329 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.329 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.329 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.329 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.329 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.329 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.330 INFO:teuthology.orchestra.run.smithi084.stdout: "cephadm", 2023-07-14T11:18:21.330 INFO:teuthology.orchestra.run.smithi084.stdout: "rook", 2023-07-14T11:18:21.330 INFO:teuthology.orchestra.run.smithi084.stdout: "test_orchestrator" 2023-07-14T11:18:21.330 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.330 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Orchestrator backend", 2023-07-14T11:18:21.330 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.330 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.330 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.331 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.331 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.331 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.331 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:21.331 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "osd_perf_query", 2023-07-14T11:18:21.331 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2023-07-14T11:18:21.331 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2023-07-14T11:18:21.331 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2023-07-14T11:18:21.332 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2023-07-14T11:18:21.332 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2023-07-14T11:18:21.332 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.332 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.332 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.332 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.332 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.333 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.333 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.333 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.333 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.333 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.333 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.333 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.333 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.334 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.334 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.334 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.334 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.334 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.334 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.334 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2023-07-14T11:18:21.334 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2023-07-14T11:18:21.335 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.335 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.335 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.335 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.335 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.335 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.335 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.335 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.336 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.336 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.336 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.336 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.336 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2023-07-14T11:18:21.336 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2023-07-14T11:18:21.336 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.337 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.337 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.337 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2023-07-14T11:18:21.337 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.337 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.337 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.337 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.337 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.338 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.338 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.338 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.338 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.338 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.338 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.338 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.338 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.339 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.339 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.339 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2023-07-14T11:18:21.339 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2023-07-14T11:18:21.339 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.339 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.339 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.339 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.340 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.340 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.340 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.340 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.340 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.340 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.340 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.341 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.341 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.341 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.341 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:21.341 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "osd_support", 2023-07-14T11:18:21.341 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2023-07-14T11:18:21.341 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2023-07-14T11:18:21.341 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2023-07-14T11:18:21.342 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2023-07-14T11:18:21.342 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2023-07-14T11:18:21.342 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.342 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.342 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.342 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.342 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.342 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.343 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.343 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.343 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.343 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.343 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.343 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.343 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.343 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.344 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.344 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.344 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.344 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.344 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.344 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2023-07-14T11:18:21.344 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2023-07-14T11:18:21.345 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.345 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.345 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.345 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.345 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.345 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.345 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.345 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.346 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.346 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.346 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.346 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.346 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2023-07-14T11:18:21.346 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2023-07-14T11:18:21.346 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.346 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.347 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.347 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2023-07-14T11:18:21.347 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.347 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.347 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.347 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.347 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.347 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.348 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.348 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.348 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.348 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.348 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.348 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.348 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.348 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.349 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.349 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2023-07-14T11:18:21.349 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2023-07-14T11:18:21.349 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.349 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.349 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.349 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.349 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.350 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.350 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.350 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.350 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.350 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.350 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.350 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.351 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.351 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.351 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:21.351 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "pg_autoscaler", 2023-07-14T11:18:21.351 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2023-07-14T11:18:21.351 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2023-07-14T11:18:21.351 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2023-07-14T11:18:21.351 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2023-07-14T11:18:21.352 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2023-07-14T11:18:21.352 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.352 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.352 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.352 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.352 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.352 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.352 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.353 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.353 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.353 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.353 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.353 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.353 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.353 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.354 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.354 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.354 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.354 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.354 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.354 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2023-07-14T11:18:21.354 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2023-07-14T11:18:21.354 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.355 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.355 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.355 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.355 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.355 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.355 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.355 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.355 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.356 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.356 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.356 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.356 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2023-07-14T11:18:21.356 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2023-07-14T11:18:21.356 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.356 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.357 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.357 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2023-07-14T11:18:21.357 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.357 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.357 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.357 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.357 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.357 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.358 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.358 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.358 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.358 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.358 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.358 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.358 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.358 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.359 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.359 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2023-07-14T11:18:21.359 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2023-07-14T11:18:21.359 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.359 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.359 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.359 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.359 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.360 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.360 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.360 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.360 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.360 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.360 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.360 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.361 INFO:teuthology.orchestra.run.smithi084.stdout: "noautoscale": { 2023-07-14T11:18:21.361 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "noautoscale", 2023-07-14T11:18:21.361 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.361 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.361 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.361 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.361 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.361 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.362 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.362 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "global autoscale flag", 2023-07-14T11:18:21.362 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "Option to turn on/off the autoscaler for all pools", 2023-07-14T11:18:21.362 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.362 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.362 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.362 INFO:teuthology.orchestra.run.smithi084.stdout: "sleep_interval": { 2023-07-14T11:18:21.362 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sleep_interval", 2023-07-14T11:18:21.363 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2023-07-14T11:18:21.363 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.363 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.363 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "60", 2023-07-14T11:18:21.363 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.363 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.363 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.363 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.364 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.364 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.364 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.364 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.364 INFO:teuthology.orchestra.run.smithi084.stdout: "threshold": { 2023-07-14T11:18:21.364 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "threshold", 2023-07-14T11:18:21.364 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2023-07-14T11:18:21.365 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.365 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.365 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "3.0", 2023-07-14T11:18:21.365 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "1.0", 2023-07-14T11:18:21.365 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.365 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.365 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "scaling threshold", 2023-07-14T11:18:21.365 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-07-14T11:18:21.366 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.366 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.366 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.366 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.366 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.366 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:21.366 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "progress", 2023-07-14T11:18:21.366 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2023-07-14T11:18:21.367 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2023-07-14T11:18:21.367 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2023-07-14T11:18:21.367 INFO:teuthology.orchestra.run.smithi084.stdout: "allow_pg_recovery_event": { 2023-07-14T11:18:21.367 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "allow_pg_recovery_event", 2023-07-14T11:18:21.367 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.367 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.367 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.367 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.368 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.368 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.368 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.368 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "allow the module to show pg recovery progress", 2023-07-14T11:18:21.368 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.368 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.368 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.369 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.369 INFO:teuthology.orchestra.run.smithi084.stdout: "enabled": { 2023-07-14T11:18:21.369 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "enabled", 2023-07-14T11:18:21.369 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.369 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.369 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.369 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:21.369 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.370 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.370 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.370 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.370 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.370 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.370 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.370 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.370 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2023-07-14T11:18:21.371 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2023-07-14T11:18:21.371 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.371 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.371 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.371 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.371 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.371 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.371 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.372 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.372 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.372 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.372 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.372 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.372 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.372 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.373 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.373 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.373 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.373 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.373 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.373 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2023-07-14T11:18:21.373 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2023-07-14T11:18:21.373 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.374 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.374 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.374 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.374 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.374 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.374 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.374 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.375 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.375 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.375 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.375 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.375 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2023-07-14T11:18:21.375 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2023-07-14T11:18:21.375 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.375 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.376 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.376 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2023-07-14T11:18:21.376 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.376 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.376 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.376 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.376 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.376 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.377 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.377 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.377 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.377 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.377 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.377 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.377 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.378 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.378 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.378 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2023-07-14T11:18:21.378 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2023-07-14T11:18:21.378 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.378 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.378 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.378 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.379 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.379 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.379 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.379 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.379 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.379 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.379 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.379 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.380 INFO:teuthology.orchestra.run.smithi084.stdout: "max_completed_events": { 2023-07-14T11:18:21.380 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "max_completed_events", 2023-07-14T11:18:21.380 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2023-07-14T11:18:21.380 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.380 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.380 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "50", 2023-07-14T11:18:21.380 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.381 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.381 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.381 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "number of past completed events to remember", 2023-07-14T11:18:21.381 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.381 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.381 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.381 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.381 INFO:teuthology.orchestra.run.smithi084.stdout: "sleep_interval": { 2023-07-14T11:18:21.382 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sleep_interval", 2023-07-14T11:18:21.382 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2023-07-14T11:18:21.382 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.382 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.382 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "5", 2023-07-14T11:18:21.382 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.382 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.382 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.383 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how long the module is going to sleep", 2023-07-14T11:18:21.383 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.383 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.383 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.383 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.383 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.383 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.383 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:21.384 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "prometheus", 2023-07-14T11:18:21.384 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2023-07-14T11:18:21.384 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2023-07-14T11:18:21.384 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2023-07-14T11:18:21.384 INFO:teuthology.orchestra.run.smithi084.stdout: "cache": { 2023-07-14T11:18:21.384 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "cache", 2023-07-14T11:18:21.384 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.384 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.385 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.385 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:21.385 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.385 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.385 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.385 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.385 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.385 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.386 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.386 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.386 INFO:teuthology.orchestra.run.smithi084.stdout: "exclude_perf_counters": { 2023-07-14T11:18:21.386 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "exclude_perf_counters", 2023-07-14T11:18:21.386 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.386 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.386 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.387 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:21.387 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.387 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.387 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.387 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-07-14T11:18:21.387 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-07-14T11:18:21.387 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.387 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.388 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.388 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2023-07-14T11:18:21.388 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2023-07-14T11:18:21.388 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.388 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.388 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.388 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.388 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.389 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.389 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.389 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.389 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.389 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.389 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.389 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.389 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.390 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.390 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.390 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.390 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.390 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.390 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.390 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2023-07-14T11:18:21.390 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2023-07-14T11:18:21.391 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.391 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.391 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.391 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.391 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.391 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.391 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.391 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.392 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.392 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.392 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.392 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.392 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2023-07-14T11:18:21.392 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2023-07-14T11:18:21.392 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.393 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.393 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.393 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2023-07-14T11:18:21.393 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.393 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.393 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.393 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.393 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.394 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.394 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.394 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.394 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.394 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.394 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.394 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.394 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.395 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.395 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.395 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2023-07-14T11:18:21.395 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2023-07-14T11:18:21.395 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.395 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.395 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.395 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.396 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.396 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.396 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.396 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.396 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.396 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.396 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.397 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.397 INFO:teuthology.orchestra.run.smithi084.stdout: "rbd_stats_pools": { 2023-07-14T11:18:21.397 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rbd_stats_pools", 2023-07-14T11:18:21.397 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.397 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.397 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.397 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.397 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.398 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.398 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.398 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.398 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.398 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.398 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.398 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.398 INFO:teuthology.orchestra.run.smithi084.stdout: "rbd_stats_pools_refresh_interval": { 2023-07-14T11:18:21.399 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-07-14T11:18:21.399 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2023-07-14T11:18:21.399 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.399 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.399 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "300", 2023-07-14T11:18:21.399 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.399 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.399 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.400 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.400 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.400 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.400 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.400 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.400 INFO:teuthology.orchestra.run.smithi084.stdout: "scrape_interval": { 2023-07-14T11:18:21.400 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "scrape_interval", 2023-07-14T11:18:21.400 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2023-07-14T11:18:21.401 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.401 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.401 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "15.0", 2023-07-14T11:18:21.401 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.401 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.401 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.401 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.402 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.402 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.402 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.402 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.402 INFO:teuthology.orchestra.run.smithi084.stdout: "server_addr": { 2023-07-14T11:18:21.402 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "server_addr", 2023-07-14T11:18:21.402 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.402 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.403 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.403 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "::", 2023-07-14T11:18:21.403 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.403 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.403 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.403 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-07-14T11:18:21.403 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.403 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.404 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.404 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.404 INFO:teuthology.orchestra.run.smithi084.stdout: "server_port": { 2023-07-14T11:18:21.404 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "server_port", 2023-07-14T11:18:21.404 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2023-07-14T11:18:21.404 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.404 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.405 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "9283", 2023-07-14T11:18:21.405 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.405 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.405 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.405 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-07-14T11:18:21.405 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.405 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.405 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.406 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.406 INFO:teuthology.orchestra.run.smithi084.stdout: "stale_cache_strategy": { 2023-07-14T11:18:21.406 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "stale_cache_strategy", 2023-07-14T11:18:21.406 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.406 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.406 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.406 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "log", 2023-07-14T11:18:21.406 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.407 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.407 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.407 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.407 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.407 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.407 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.407 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.407 INFO:teuthology.orchestra.run.smithi084.stdout: "standby_behaviour": { 2023-07-14T11:18:21.408 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "standby_behaviour", 2023-07-14T11:18:21.408 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.408 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.408 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.408 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "default", 2023-07-14T11:18:21.408 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.408 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.409 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.409 INFO:teuthology.orchestra.run.smithi084.stdout: "default", 2023-07-14T11:18:21.409 INFO:teuthology.orchestra.run.smithi084.stdout: "error" 2023-07-14T11:18:21.409 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.409 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.409 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.409 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.409 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.410 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.410 INFO:teuthology.orchestra.run.smithi084.stdout: "standby_error_status_code": { 2023-07-14T11:18:21.410 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "standby_error_status_code", 2023-07-14T11:18:21.410 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2023-07-14T11:18:21.410 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.410 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.410 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "500", 2023-07-14T11:18:21.410 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "400", 2023-07-14T11:18:21.411 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "599", 2023-07-14T11:18:21.411 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.411 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.411 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.411 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.411 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.411 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.411 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.412 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.412 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:21.412 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rbd_support", 2023-07-14T11:18:21.412 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2023-07-14T11:18:21.412 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2023-07-14T11:18:21.412 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2023-07-14T11:18:21.412 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2023-07-14T11:18:21.413 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2023-07-14T11:18:21.413 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.413 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.413 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.413 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.413 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.413 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.413 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.414 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.414 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.414 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.414 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.414 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.414 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.414 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.414 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.415 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.415 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.415 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.415 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.415 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2023-07-14T11:18:21.415 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2023-07-14T11:18:21.415 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.415 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.416 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.416 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.416 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.416 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.416 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.416 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.416 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.416 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.417 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.417 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.417 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2023-07-14T11:18:21.417 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2023-07-14T11:18:21.417 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.417 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.417 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.418 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2023-07-14T11:18:21.418 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.418 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.418 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.418 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.418 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.418 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.418 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.419 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.419 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.419 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.419 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.419 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.419 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.419 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.419 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.420 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2023-07-14T11:18:21.420 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2023-07-14T11:18:21.420 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.420 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.420 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.420 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.420 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.420 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.421 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.421 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.421 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.421 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.421 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.421 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.421 INFO:teuthology.orchestra.run.smithi084.stdout: "max_concurrent_snap_create": { 2023-07-14T11:18:21.421 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "max_concurrent_snap_create", 2023-07-14T11:18:21.422 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2023-07-14T11:18:21.422 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.422 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.422 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2023-07-14T11:18:21.422 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.422 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.422 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.422 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.423 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.423 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.423 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.423 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.423 INFO:teuthology.orchestra.run.smithi084.stdout: "mirror_snapshot_schedule": { 2023-07-14T11:18:21.423 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "mirror_snapshot_schedule", 2023-07-14T11:18:21.423 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.424 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.424 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.424 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.424 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.424 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.424 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.424 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.424 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.425 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.425 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.425 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.425 INFO:teuthology.orchestra.run.smithi084.stdout: "trash_purge_schedule": { 2023-07-14T11:18:21.425 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "trash_purge_schedule", 2023-07-14T11:18:21.425 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.425 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.425 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.426 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.426 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.426 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.426 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.426 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.426 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.426 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.426 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.427 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.427 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.427 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.427 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:21.427 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "restful", 2023-07-14T11:18:21.427 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2023-07-14T11:18:21.427 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2023-07-14T11:18:21.428 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2023-07-14T11:18:21.428 INFO:teuthology.orchestra.run.smithi084.stdout: "enable_auth": { 2023-07-14T11:18:21.428 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "enable_auth", 2023-07-14T11:18:21.428 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.428 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.428 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.428 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:21.428 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.429 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.429 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.429 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.429 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.429 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.429 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.429 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.429 INFO:teuthology.orchestra.run.smithi084.stdout: "key_file": { 2023-07-14T11:18:21.430 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "key_file", 2023-07-14T11:18:21.430 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.430 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.430 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.430 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.430 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.430 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.430 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.431 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.431 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.431 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.431 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.431 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.431 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2023-07-14T11:18:21.431 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2023-07-14T11:18:21.431 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.432 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.432 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.432 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.432 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.432 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.432 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.432 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.433 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.433 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.433 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.433 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.433 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.433 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.433 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.433 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.434 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.434 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.434 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.434 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2023-07-14T11:18:21.434 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2023-07-14T11:18:21.434 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.434 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.434 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.435 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.435 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.435 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.435 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.435 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.435 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.435 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.435 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.436 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.436 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2023-07-14T11:18:21.436 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2023-07-14T11:18:21.436 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.436 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.436 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.436 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2023-07-14T11:18:21.436 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.437 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.437 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.437 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.437 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.437 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.437 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.437 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.437 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.438 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.438 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.438 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.438 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.438 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.438 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.438 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2023-07-14T11:18:21.438 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2023-07-14T11:18:21.439 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.439 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.439 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.439 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.439 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.439 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.439 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.439 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.440 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.440 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.440 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.440 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.440 INFO:teuthology.orchestra.run.smithi084.stdout: "server_addr": { 2023-07-14T11:18:21.440 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "server_addr", 2023-07-14T11:18:21.440 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.441 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.441 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.441 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.441 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.441 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.441 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.441 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.441 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.442 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.442 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.442 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.442 INFO:teuthology.orchestra.run.smithi084.stdout: "server_port": { 2023-07-14T11:18:21.442 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "server_port", 2023-07-14T11:18:21.442 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.442 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.442 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.443 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.443 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.443 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.443 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.443 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.443 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.443 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.443 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.444 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.444 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.444 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.444 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:21.444 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rgw", 2023-07-14T11:18:21.444 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2023-07-14T11:18:21.444 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2023-07-14T11:18:21.444 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2023-07-14T11:18:21.445 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2023-07-14T11:18:21.445 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2023-07-14T11:18:21.445 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.445 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.445 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.445 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.445 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.445 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.446 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.446 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.446 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.446 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.446 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.446 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.446 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.446 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.447 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.447 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.447 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.447 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.447 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.447 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2023-07-14T11:18:21.447 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2023-07-14T11:18:21.447 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.448 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.448 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.448 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.448 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.448 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.448 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.448 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.449 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.449 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.449 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.449 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.449 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2023-07-14T11:18:21.449 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2023-07-14T11:18:21.449 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.449 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.450 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.450 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2023-07-14T11:18:21.450 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.450 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.450 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.450 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.451 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.451 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.451 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.451 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.451 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.451 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.451 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.452 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.452 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.452 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.452 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.452 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2023-07-14T11:18:21.452 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2023-07-14T11:18:21.452 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.452 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.453 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.453 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.453 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.453 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.453 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.453 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.453 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.453 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.454 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.454 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.454 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.454 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.454 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:21.454 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rook", 2023-07-14T11:18:21.454 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2023-07-14T11:18:21.455 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2023-07-14T11:18:21.455 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2023-07-14T11:18:21.455 INFO:teuthology.orchestra.run.smithi084.stdout: "drive_group_interval": { 2023-07-14T11:18:21.455 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "drive_group_interval", 2023-07-14T11:18:21.455 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2023-07-14T11:18:21.455 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.455 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.455 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "300.0", 2023-07-14T11:18:21.456 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.456 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.456 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.456 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-07-14T11:18:21.456 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.456 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.456 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.456 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.457 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2023-07-14T11:18:21.457 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2023-07-14T11:18:21.457 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.457 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.457 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.457 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.457 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.458 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.458 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.458 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.458 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.458 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.458 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.458 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.458 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.459 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.459 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.459 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.459 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.459 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.459 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.459 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2023-07-14T11:18:21.459 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2023-07-14T11:18:21.460 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.460 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.460 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.460 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.460 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.460 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.460 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.460 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.461 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.461 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.461 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.461 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.461 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2023-07-14T11:18:21.461 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2023-07-14T11:18:21.461 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.462 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.462 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.462 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2023-07-14T11:18:21.462 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.462 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.462 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.462 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.462 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.463 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.463 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.463 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.463 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.463 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.463 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.463 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.463 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.464 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.464 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.464 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2023-07-14T11:18:21.464 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2023-07-14T11:18:21.464 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.464 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.464 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.465 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.465 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.465 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.465 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.465 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.465 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.465 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.465 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.466 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.466 INFO:teuthology.orchestra.run.smithi084.stdout: "storage_class": { 2023-07-14T11:18:21.466 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "storage_class", 2023-07-14T11:18:21.466 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.466 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.466 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.466 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "local", 2023-07-14T11:18:21.466 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.467 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.467 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.467 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-07-14T11:18:21.467 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.467 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.467 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.467 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.467 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.468 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.468 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:21.468 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "selftest", 2023-07-14T11:18:21.468 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2023-07-14T11:18:21.468 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2023-07-14T11:18:21.468 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2023-07-14T11:18:21.468 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2023-07-14T11:18:21.469 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2023-07-14T11:18:21.469 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.469 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.469 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.469 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.469 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.469 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.469 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.470 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.470 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.470 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.470 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.470 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.470 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.470 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.470 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.471 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.471 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.471 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.471 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.471 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2023-07-14T11:18:21.471 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2023-07-14T11:18:21.471 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.471 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.472 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.472 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.472 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.472 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.472 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.472 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.472 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.473 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.473 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.473 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.473 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2023-07-14T11:18:21.473 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2023-07-14T11:18:21.473 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.473 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.473 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.474 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2023-07-14T11:18:21.474 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.474 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.474 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.474 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.474 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.474 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.474 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.475 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.475 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.475 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.475 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.475 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.475 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.475 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.476 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.476 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2023-07-14T11:18:21.476 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2023-07-14T11:18:21.476 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.476 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.476 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.476 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.476 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.477 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.477 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.477 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.477 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.477 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.477 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.477 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.478 INFO:teuthology.orchestra.run.smithi084.stdout: "roption1": { 2023-07-14T11:18:21.478 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "roption1", 2023-07-14T11:18:21.478 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.478 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.478 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.478 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.478 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.478 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.479 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.479 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.479 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.479 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.479 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.479 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.479 INFO:teuthology.orchestra.run.smithi084.stdout: "roption2": { 2023-07-14T11:18:21.479 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "roption2", 2023-07-14T11:18:21.480 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.480 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.480 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.480 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "xyz", 2023-07-14T11:18:21.480 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.480 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.480 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.480 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.481 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.481 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.481 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.481 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.481 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption1": { 2023-07-14T11:18:21.481 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption1", 2023-07-14T11:18:21.481 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.481 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.482 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.482 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.482 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.482 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.482 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.482 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.482 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.482 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.483 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.483 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.483 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption2": { 2023-07-14T11:18:21.483 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption2", 2023-07-14T11:18:21.483 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2023-07-14T11:18:21.483 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.483 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.484 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.484 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.484 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.484 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.484 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.484 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.484 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.484 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.485 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.485 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption3": { 2023-07-14T11:18:21.485 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption3", 2023-07-14T11:18:21.485 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2023-07-14T11:18:21.485 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.485 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.485 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.485 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.486 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.486 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.486 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.486 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.486 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.486 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.486 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.486 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption4": { 2023-07-14T11:18:21.487 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption4", 2023-07-14T11:18:21.487 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.487 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.487 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.487 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.487 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.487 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.487 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.488 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.488 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.488 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.488 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.488 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.488 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption5": { 2023-07-14T11:18:21.488 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption5", 2023-07-14T11:18:21.489 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.489 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.489 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.489 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.489 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.489 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.489 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.489 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.490 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.490 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.490 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.490 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.490 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption6": { 2023-07-14T11:18:21.490 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption6", 2023-07-14T11:18:21.490 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.490 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.491 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.491 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:21.491 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.491 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.491 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.491 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.491 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.491 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.492 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.492 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.492 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption7": { 2023-07-14T11:18:21.492 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption7", 2023-07-14T11:18:21.492 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2023-07-14T11:18:21.492 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.492 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.493 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.493 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "1", 2023-07-14T11:18:21.493 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "42", 2023-07-14T11:18:21.493 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.493 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.493 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.493 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.493 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.494 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.494 INFO:teuthology.orchestra.run.smithi084.stdout: "testkey": { 2023-07-14T11:18:21.494 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "testkey", 2023-07-14T11:18:21.494 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.494 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.494 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.494 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.494 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.495 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.495 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.495 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.495 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.495 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.495 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.495 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.495 INFO:teuthology.orchestra.run.smithi084.stdout: "testlkey": { 2023-07-14T11:18:21.496 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "testlkey", 2023-07-14T11:18:21.496 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.496 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.496 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.496 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.496 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.496 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.497 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.497 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.497 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.497 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.497 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.497 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.497 INFO:teuthology.orchestra.run.smithi084.stdout: "testnewline": { 2023-07-14T11:18:21.497 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "testnewline", 2023-07-14T11:18:21.498 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.498 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.498 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.498 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.498 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.498 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.498 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.498 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.499 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.499 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.499 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.499 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.499 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.499 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.499 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:21.499 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "snap_schedule", 2023-07-14T11:18:21.500 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2023-07-14T11:18:21.500 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2023-07-14T11:18:21.500 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2023-07-14T11:18:21.500 INFO:teuthology.orchestra.run.smithi084.stdout: "allow_m_granularity": { 2023-07-14T11:18:21.500 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "allow_m_granularity", 2023-07-14T11:18:21.500 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.500 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.500 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.501 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.501 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.501 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.501 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.501 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "allow minute scheduled snapshots", 2023-07-14T11:18:21.501 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.501 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.502 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.502 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.502 INFO:teuthology.orchestra.run.smithi084.stdout: "dump_on_update": { 2023-07-14T11:18:21.502 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "dump_on_update", 2023-07-14T11:18:21.502 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.502 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.502 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.502 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.503 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.503 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.503 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.503 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "dump database to debug log on update", 2023-07-14T11:18:21.503 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.503 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.503 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.503 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.504 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2023-07-14T11:18:21.504 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2023-07-14T11:18:21.504 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.504 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.504 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.504 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.504 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.504 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.505 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.505 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.505 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.505 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.505 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.505 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.505 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.506 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.506 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.506 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.506 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.506 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.506 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.506 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2023-07-14T11:18:21.506 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2023-07-14T11:18:21.507 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.507 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.507 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.507 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.507 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.507 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.507 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.507 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.508 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.508 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.508 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.508 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.508 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2023-07-14T11:18:21.508 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2023-07-14T11:18:21.508 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.508 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.509 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.509 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2023-07-14T11:18:21.509 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.509 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.509 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.509 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.509 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.510 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.510 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.510 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.510 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.510 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.510 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.510 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.510 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.511 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.511 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.511 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2023-07-14T11:18:21.511 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2023-07-14T11:18:21.511 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.511 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.511 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.511 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.512 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.512 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.512 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.512 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.512 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.512 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.512 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.512 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.513 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.513 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.513 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:21.513 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "stats", 2023-07-14T11:18:21.513 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2023-07-14T11:18:21.513 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2023-07-14T11:18:21.513 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2023-07-14T11:18:21.513 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2023-07-14T11:18:21.514 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2023-07-14T11:18:21.514 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.514 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.514 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.514 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.514 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.514 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.514 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.515 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.515 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.515 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.515 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.515 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.515 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.515 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.516 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.516 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.516 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.516 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.516 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.516 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2023-07-14T11:18:21.516 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2023-07-14T11:18:21.516 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.517 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.517 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.517 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.517 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.517 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.517 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.517 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.517 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.518 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.518 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.518 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.518 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2023-07-14T11:18:21.518 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2023-07-14T11:18:21.518 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.518 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.518 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.519 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2023-07-14T11:18:21.519 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.519 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.519 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.519 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.519 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.519 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.520 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.520 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.520 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.520 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.520 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.520 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.520 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.520 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.521 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.521 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2023-07-14T11:18:21.521 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2023-07-14T11:18:21.521 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.521 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.521 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.521 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.521 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.522 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.522 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.522 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.522 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.522 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.522 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.522 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.522 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.523 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.523 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:21.523 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "status", 2023-07-14T11:18:21.523 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2023-07-14T11:18:21.523 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2023-07-14T11:18:21.523 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2023-07-14T11:18:21.523 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2023-07-14T11:18:21.524 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2023-07-14T11:18:21.524 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.524 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.524 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.524 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.524 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.524 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.524 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.525 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.525 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.525 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.525 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.525 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.525 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.525 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.526 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.526 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.526 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.526 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.526 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.526 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2023-07-14T11:18:21.526 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2023-07-14T11:18:21.526 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.527 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.527 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.527 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.527 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.527 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.527 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.527 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.528 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.528 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.528 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.528 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.528 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2023-07-14T11:18:21.528 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2023-07-14T11:18:21.528 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.528 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.529 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.529 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2023-07-14T11:18:21.529 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.529 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.529 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.529 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.529 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.529 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.530 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.530 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.530 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.530 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.530 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.530 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.530 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.531 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.531 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.531 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2023-07-14T11:18:21.531 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2023-07-14T11:18:21.531 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.531 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.531 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.531 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.532 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.532 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.532 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.532 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.532 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.532 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.532 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.532 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.533 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.533 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.533 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:21.533 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "telegraf", 2023-07-14T11:18:21.533 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2023-07-14T11:18:21.533 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2023-07-14T11:18:21.533 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2023-07-14T11:18:21.534 INFO:teuthology.orchestra.run.smithi084.stdout: "address": { 2023-07-14T11:18:21.534 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "address", 2023-07-14T11:18:21.534 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.534 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.534 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.534 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-07-14T11:18:21.534 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.534 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.535 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.535 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.535 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.535 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.535 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.535 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.535 INFO:teuthology.orchestra.run.smithi084.stdout: "interval": { 2023-07-14T11:18:21.535 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "interval", 2023-07-14T11:18:21.536 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2023-07-14T11:18:21.536 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.536 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.536 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "15", 2023-07-14T11:18:21.536 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.536 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.536 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.537 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.537 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.537 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.537 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.537 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.537 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2023-07-14T11:18:21.537 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2023-07-14T11:18:21.537 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.538 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.538 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.538 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.538 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.538 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.538 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.538 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.538 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.539 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.539 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.539 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.539 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.539 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.539 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.539 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.539 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.540 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.540 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.540 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2023-07-14T11:18:21.540 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2023-07-14T11:18:21.540 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.540 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.540 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.541 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.541 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.541 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.541 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.541 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.541 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.541 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.541 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.542 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.542 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2023-07-14T11:18:21.542 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2023-07-14T11:18:21.542 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.542 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.542 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.542 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2023-07-14T11:18:21.542 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.543 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.543 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.543 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.543 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.543 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.543 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.543 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.543 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.544 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.544 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.544 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.544 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.544 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.544 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.544 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2023-07-14T11:18:21.545 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2023-07-14T11:18:21.545 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.545 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.545 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.545 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.545 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.545 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.545 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.546 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.546 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.546 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.546 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.546 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.546 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.546 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.546 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:21.547 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "telemetry", 2023-07-14T11:18:21.547 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2023-07-14T11:18:21.547 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2023-07-14T11:18:21.547 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2023-07-14T11:18:21.547 INFO:teuthology.orchestra.run.smithi084.stdout: "channel_basic": { 2023-07-14T11:18:21.547 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "channel_basic", 2023-07-14T11:18:21.547 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.547 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.548 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.548 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:21.548 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.548 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.548 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.548 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Share basic cluster information (size, version)", 2023-07-14T11:18:21.548 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.548 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.549 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.549 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.549 INFO:teuthology.orchestra.run.smithi084.stdout: "channel_crash": { 2023-07-14T11:18:21.549 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "channel_crash", 2023-07-14T11:18:21.549 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.549 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.549 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.550 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:21.550 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.550 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.550 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.550 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-07-14T11:18:21.550 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.550 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.550 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.551 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.551 INFO:teuthology.orchestra.run.smithi084.stdout: "channel_device": { 2023-07-14T11:18:21.551 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "channel_device", 2023-07-14T11:18:21.551 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.551 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.551 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.551 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:21.551 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.552 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.552 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.552 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-07-14T11:18:21.552 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.552 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.552 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.552 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.553 INFO:teuthology.orchestra.run.smithi084.stdout: "channel_ident": { 2023-07-14T11:18:21.553 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "channel_ident", 2023-07-14T11:18:21.553 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.553 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.553 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.553 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.553 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.553 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.554 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.554 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-07-14T11:18:21.554 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.554 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.554 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.554 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.554 INFO:teuthology.orchestra.run.smithi084.stdout: "channel_perf": { 2023-07-14T11:18:21.555 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "channel_perf", 2023-07-14T11:18:21.555 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.555 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.555 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.555 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.555 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.555 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.555 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.556 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Share various performance metrics of a cluster", 2023-07-14T11:18:21.556 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.556 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.556 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.556 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.556 INFO:teuthology.orchestra.run.smithi084.stdout: "contact": { 2023-07-14T11:18:21.556 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "contact", 2023-07-14T11:18:21.556 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.557 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.557 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.557 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.557 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.557 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.557 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.557 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.557 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.558 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.558 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.558 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.558 INFO:teuthology.orchestra.run.smithi084.stdout: "description": { 2023-07-14T11:18:21.558 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "description", 2023-07-14T11:18:21.558 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.558 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.558 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.559 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.559 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.559 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.559 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.559 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.559 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.559 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.559 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.560 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.560 INFO:teuthology.orchestra.run.smithi084.stdout: "device_url": { 2023-07-14T11:18:21.560 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "device_url", 2023-07-14T11:18:21.560 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.560 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.560 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.560 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-07-14T11:18:21.561 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.561 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.561 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.561 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.561 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.561 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.561 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.561 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.562 INFO:teuthology.orchestra.run.smithi084.stdout: "enabled": { 2023-07-14T11:18:21.562 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "enabled", 2023-07-14T11:18:21.562 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.562 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.562 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.562 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.562 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.562 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.563 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.563 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.563 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.563 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.563 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.563 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.563 INFO:teuthology.orchestra.run.smithi084.stdout: "interval": { 2023-07-14T11:18:21.563 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "interval", 2023-07-14T11:18:21.564 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2023-07-14T11:18:21.564 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.564 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.564 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "24", 2023-07-14T11:18:21.564 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "8", 2023-07-14T11:18:21.564 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.564 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.564 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.565 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.565 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.565 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.565 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.565 INFO:teuthology.orchestra.run.smithi084.stdout: "last_opt_revision": { 2023-07-14T11:18:21.565 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "last_opt_revision", 2023-07-14T11:18:21.565 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2023-07-14T11:18:21.565 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.566 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.566 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "1", 2023-07-14T11:18:21.566 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.566 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.566 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.566 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.566 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.567 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.567 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.567 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.567 INFO:teuthology.orchestra.run.smithi084.stdout: "leaderboard": { 2023-07-14T11:18:21.567 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "leaderboard", 2023-07-14T11:18:21.567 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.567 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.567 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.568 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.568 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.568 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.568 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.568 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.568 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.568 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.568 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.569 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.569 INFO:teuthology.orchestra.run.smithi084.stdout: "leaderboard_description": { 2023-07-14T11:18:21.569 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "leaderboard_description", 2023-07-14T11:18:21.569 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.569 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.569 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.569 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.569 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.570 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.570 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.570 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.570 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.570 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.570 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.570 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.570 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2023-07-14T11:18:21.571 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2023-07-14T11:18:21.571 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.571 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.571 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.571 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.571 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.571 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.571 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.572 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.572 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.572 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.572 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.572 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.572 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.572 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.573 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.573 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.573 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.573 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.573 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.573 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2023-07-14T11:18:21.573 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2023-07-14T11:18:21.573 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.574 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.574 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.574 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.574 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.574 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.574 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.574 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.574 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.575 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.575 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.575 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.575 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2023-07-14T11:18:21.575 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2023-07-14T11:18:21.575 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.575 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.575 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.576 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2023-07-14T11:18:21.576 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.576 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.576 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.576 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.576 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.576 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.577 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.577 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.577 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.577 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.577 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.577 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.577 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.577 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.578 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.578 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2023-07-14T11:18:21.578 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2023-07-14T11:18:21.578 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.578 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.578 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.578 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.578 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.579 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.579 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.579 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.579 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.579 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.579 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.579 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.579 INFO:teuthology.orchestra.run.smithi084.stdout: "organization": { 2023-07-14T11:18:21.580 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "organization", 2023-07-14T11:18:21.580 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.580 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.580 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.580 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.580 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.580 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.581 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.581 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.581 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.581 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.581 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.581 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.581 INFO:teuthology.orchestra.run.smithi084.stdout: "proxy": { 2023-07-14T11:18:21.581 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "proxy", 2023-07-14T11:18:21.582 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.582 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.582 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.582 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.582 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.582 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.582 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.582 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.583 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.583 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.583 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.583 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.583 INFO:teuthology.orchestra.run.smithi084.stdout: "url": { 2023-07-14T11:18:21.583 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "url", 2023-07-14T11:18:21.583 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.583 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.584 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.584 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-07-14T11:18:21.584 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.584 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.584 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.584 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.584 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.585 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.585 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.585 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.585 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.585 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.585 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:21.585 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "test_orchestrator", 2023-07-14T11:18:21.585 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2023-07-14T11:18:21.586 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2023-07-14T11:18:21.586 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2023-07-14T11:18:21.586 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2023-07-14T11:18:21.586 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2023-07-14T11:18:21.586 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.586 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.586 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.586 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.587 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.587 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.587 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.587 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.587 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.587 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.587 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.587 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.588 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.588 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.588 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.588 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.588 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.588 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.588 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.588 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2023-07-14T11:18:21.589 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2023-07-14T11:18:21.589 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.589 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.589 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.589 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.589 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.589 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.589 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.590 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.590 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.590 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.590 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.590 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.590 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2023-07-14T11:18:21.590 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2023-07-14T11:18:21.591 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.591 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.591 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.591 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2023-07-14T11:18:21.591 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.591 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.591 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.591 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.592 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.592 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.592 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.592 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.592 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.592 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.592 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.592 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.593 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.593 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.593 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.593 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2023-07-14T11:18:21.593 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2023-07-14T11:18:21.593 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.593 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.593 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.594 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.594 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.594 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.594 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.594 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.594 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.594 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.594 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.595 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.595 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.595 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.595 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:21.595 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "volumes", 2023-07-14T11:18:21.595 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2023-07-14T11:18:21.595 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2023-07-14T11:18:21.596 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2023-07-14T11:18:21.596 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2023-07-14T11:18:21.596 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2023-07-14T11:18:21.596 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.596 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.596 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.596 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.596 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.597 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.597 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.597 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.597 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.597 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.597 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.597 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.597 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.598 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.598 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.598 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.598 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.598 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.598 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.598 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2023-07-14T11:18:21.598 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2023-07-14T11:18:21.599 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.599 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.599 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.599 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.599 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.599 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.599 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.600 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.600 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.600 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.600 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.600 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.600 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2023-07-14T11:18:21.600 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2023-07-14T11:18:21.600 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.601 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.601 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.601 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2023-07-14T11:18:21.601 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.601 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.601 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.601 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.602 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.602 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.602 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.602 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.602 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.602 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.602 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.602 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.603 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.603 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.603 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.603 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2023-07-14T11:18:21.603 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2023-07-14T11:18:21.603 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.603 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.603 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.604 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.604 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.604 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.604 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.604 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.604 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.604 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.604 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.605 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.605 INFO:teuthology.orchestra.run.smithi084.stdout: "max_concurrent_clones": { 2023-07-14T11:18:21.605 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "max_concurrent_clones", 2023-07-14T11:18:21.605 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2023-07-14T11:18:21.605 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.605 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.605 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "4", 2023-07-14T11:18:21.605 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.606 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.606 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.606 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Number of asynchronous cloner threads", 2023-07-14T11:18:21.606 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.606 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.606 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.606 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.606 INFO:teuthology.orchestra.run.smithi084.stdout: "snapshot_clone_delay": { 2023-07-14T11:18:21.607 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "snapshot_clone_delay", 2023-07-14T11:18:21.607 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2023-07-14T11:18:21.607 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.607 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.607 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2023-07-14T11:18:21.607 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.607 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.608 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.608 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-07-14T11:18:21.608 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.608 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.608 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.608 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.608 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.608 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.609 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:21.609 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "zabbix", 2023-07-14T11:18:21.609 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2023-07-14T11:18:21.609 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2023-07-14T11:18:21.609 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2023-07-14T11:18:21.609 INFO:teuthology.orchestra.run.smithi084.stdout: "discovery_interval": { 2023-07-14T11:18:21.609 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "discovery_interval", 2023-07-14T11:18:21.609 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "uint", 2023-07-14T11:18:21.610 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.610 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.610 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "100", 2023-07-14T11:18:21.610 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.610 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.610 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.610 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.610 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.611 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.611 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.611 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.611 INFO:teuthology.orchestra.run.smithi084.stdout: "identifier": { 2023-07-14T11:18:21.611 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "identifier", 2023-07-14T11:18:21.611 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.611 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.611 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.612 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.612 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.612 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.612 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.612 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.612 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.612 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.613 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.613 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.613 INFO:teuthology.orchestra.run.smithi084.stdout: "interval": { 2023-07-14T11:18:21.613 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "interval", 2023-07-14T11:18:21.613 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2023-07-14T11:18:21.613 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.613 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.613 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "60", 2023-07-14T11:18:21.614 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.614 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.614 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.614 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.614 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.614 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.614 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.614 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.615 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2023-07-14T11:18:21.615 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2023-07-14T11:18:21.615 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.615 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.615 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.615 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.615 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.615 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.616 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.616 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.616 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.616 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.616 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.616 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.616 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.616 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.617 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.617 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.617 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.617 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.617 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.617 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2023-07-14T11:18:21.617 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2023-07-14T11:18:21.618 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.618 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.618 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.618 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.618 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.618 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.618 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.618 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.619 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.619 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.619 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.619 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.619 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2023-07-14T11:18:21.619 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2023-07-14T11:18:21.619 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.619 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.620 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.620 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2023-07-14T11:18:21.620 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.620 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.620 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.620 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.620 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.620 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.621 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.621 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.621 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.621 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.621 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.621 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.621 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.621 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.622 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.622 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2023-07-14T11:18:21.622 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2023-07-14T11:18:21.622 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.622 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.622 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.622 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.622 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.623 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.623 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.623 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.623 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.623 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.623 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.623 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.624 INFO:teuthology.orchestra.run.smithi084.stdout: "zabbix_host": { 2023-07-14T11:18:21.624 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "zabbix_host", 2023-07-14T11:18:21.624 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.624 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.624 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.624 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.624 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.624 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.625 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.625 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.625 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.625 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.625 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.625 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.625 INFO:teuthology.orchestra.run.smithi084.stdout: "zabbix_port": { 2023-07-14T11:18:21.625 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "zabbix_port", 2023-07-14T11:18:21.626 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2023-07-14T11:18:21.626 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.626 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.626 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10051", 2023-07-14T11:18:21.626 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.626 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.626 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.626 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.627 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.627 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.627 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.627 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.627 INFO:teuthology.orchestra.run.smithi084.stdout: "zabbix_sender": { 2023-07-14T11:18:21.627 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "zabbix_sender", 2023-07-14T11:18:21.627 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.628 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.628 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.628 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-07-14T11:18:21.628 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.628 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.628 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.628 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.628 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.629 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.629 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.629 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.629 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.629 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.629 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2023-07-14T11:18:21.629 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.629 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.630 INFO:teuthology.orchestra.run.smithi084.stdout: "modules": [ 2023-07-14T11:18:21.630 INFO:teuthology.orchestra.run.smithi084.stdout: "iostat", 2023-07-14T11:18:21.630 INFO:teuthology.orchestra.run.smithi084.stdout: "nfs", 2023-07-14T11:18:21.630 INFO:teuthology.orchestra.run.smithi084.stdout: "restful" 2023-07-14T11:18:21.630 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.630 INFO:teuthology.orchestra.run.smithi084.stdout: "available_modules": [ 2023-07-14T11:18:21.630 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:21.630 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "alerts", 2023-07-14T11:18:21.631 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2023-07-14T11:18:21.631 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2023-07-14T11:18:21.631 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2023-07-14T11:18:21.631 INFO:teuthology.orchestra.run.smithi084.stdout: "interval": { 2023-07-14T11:18:21.631 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "interval", 2023-07-14T11:18:21.631 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2023-07-14T11:18:21.631 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.631 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.632 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "60", 2023-07-14T11:18:21.632 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.632 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.632 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.632 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "How frequently to reexamine health status", 2023-07-14T11:18:21.632 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.632 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.633 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.633 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.633 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2023-07-14T11:18:21.633 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2023-07-14T11:18:21.633 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.633 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.633 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.633 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.634 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.634 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.634 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.634 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.634 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.634 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.634 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.634 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.635 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.635 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.635 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.635 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.635 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.635 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.635 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.635 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2023-07-14T11:18:21.636 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2023-07-14T11:18:21.636 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.636 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.636 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.636 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.636 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.636 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.636 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.637 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.637 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.637 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.637 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.637 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.637 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2023-07-14T11:18:21.637 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2023-07-14T11:18:21.637 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.638 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.638 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.638 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2023-07-14T11:18:21.638 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.638 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.638 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.638 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.639 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.639 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.639 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.639 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.639 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.639 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.639 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.639 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.640 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.640 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.640 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.640 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2023-07-14T11:18:21.640 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2023-07-14T11:18:21.640 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.640 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.640 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.641 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.641 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.641 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.641 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.641 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.641 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.641 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.642 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.642 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.642 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_destination": { 2023-07-14T11:18:21.642 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_destination", 2023-07-14T11:18:21.642 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.642 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.642 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.642 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.643 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.643 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.643 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.643 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Email address to send alerts to", 2023-07-14T11:18:21.643 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.643 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.643 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.643 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.644 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_from_name": { 2023-07-14T11:18:21.644 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_from_name", 2023-07-14T11:18:21.644 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.644 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.644 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.644 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "Ceph", 2023-07-14T11:18:21.644 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.644 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.645 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.645 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Email From: name", 2023-07-14T11:18:21.645 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.645 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.645 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.645 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.645 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_host": { 2023-07-14T11:18:21.646 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_host", 2023-07-14T11:18:21.646 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.646 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.646 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.646 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.646 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.646 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.646 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.647 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "SMTP server", 2023-07-14T11:18:21.647 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.647 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.647 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.647 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.647 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_password": { 2023-07-14T11:18:21.647 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_password", 2023-07-14T11:18:21.647 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.648 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.648 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.648 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.648 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.648 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.648 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.648 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Password to authenticate with", 2023-07-14T11:18:21.648 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.649 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.649 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.649 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.649 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_port": { 2023-07-14T11:18:21.649 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_port", 2023-07-14T11:18:21.649 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2023-07-14T11:18:21.649 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.649 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.650 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "465", 2023-07-14T11:18:21.650 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.650 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.650 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.650 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "SMTP port", 2023-07-14T11:18:21.650 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.650 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.651 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.651 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.651 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_sender": { 2023-07-14T11:18:21.651 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_sender", 2023-07-14T11:18:21.651 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.651 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.651 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.651 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.652 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.652 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.652 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.652 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "SMTP envelope sender", 2023-07-14T11:18:21.652 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.652 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.652 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.652 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.653 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_ssl": { 2023-07-14T11:18:21.653 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_ssl", 2023-07-14T11:18:21.653 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.653 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.653 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.653 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:21.653 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.653 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.654 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.654 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Use SSL to connect to SMTP server", 2023-07-14T11:18:21.654 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.654 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.654 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.654 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.654 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_user": { 2023-07-14T11:18:21.654 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_user", 2023-07-14T11:18:21.655 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.655 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.655 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.655 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.655 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.655 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.655 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.656 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "User to authenticate as", 2023-07-14T11:18:21.656 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.656 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.656 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.656 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.656 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.656 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.656 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:21.657 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "balancer", 2023-07-14T11:18:21.657 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2023-07-14T11:18:21.657 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2023-07-14T11:18:21.657 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2023-07-14T11:18:21.657 INFO:teuthology.orchestra.run.smithi084.stdout: "active": { 2023-07-14T11:18:21.657 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "active", 2023-07-14T11:18:21.657 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.657 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.658 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.658 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:21.658 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.658 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.658 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.658 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "automatically balance PGs across cluster", 2023-07-14T11:18:21.658 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.659 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.659 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.659 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.659 INFO:teuthology.orchestra.run.smithi084.stdout: "begin_time": { 2023-07-14T11:18:21.659 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "begin_time", 2023-07-14T11:18:21.659 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.659 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.659 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.660 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0000", 2023-07-14T11:18:21.660 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.660 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.660 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.660 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "beginning time of day to automatically balance", 2023-07-14T11:18:21.660 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-07-14T11:18:21.660 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.660 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.661 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.661 INFO:teuthology.orchestra.run.smithi084.stdout: "begin_weekday": { 2023-07-14T11:18:21.661 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "begin_weekday", 2023-07-14T11:18:21.661 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "uint", 2023-07-14T11:18:21.661 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.661 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.661 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2023-07-14T11:18:21.661 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "0", 2023-07-14T11:18:21.662 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "6", 2023-07-14T11:18:21.662 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.662 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-07-14T11:18:21.662 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-07-14T11:18:21.662 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.662 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.662 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.663 INFO:teuthology.orchestra.run.smithi084.stdout: "crush_compat_max_iterations": { 2023-07-14T11:18:21.663 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "crush_compat_max_iterations", 2023-07-14T11:18:21.663 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "uint", 2023-07-14T11:18:21.663 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.663 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.663 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "25", 2023-07-14T11:18:21.663 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "1", 2023-07-14T11:18:21.663 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "250", 2023-07-14T11:18:21.664 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.664 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-07-14T11:18:21.664 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.664 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.664 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.664 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.664 INFO:teuthology.orchestra.run.smithi084.stdout: "crush_compat_metrics": { 2023-07-14T11:18:21.664 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "crush_compat_metrics", 2023-07-14T11:18:21.665 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.665 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.665 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.665 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "pgs,objects,bytes", 2023-07-14T11:18:21.665 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.665 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.665 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.665 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-07-14T11:18:21.666 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-07-14T11:18:21.666 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.666 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.666 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.666 INFO:teuthology.orchestra.run.smithi084.stdout: "crush_compat_step": { 2023-07-14T11:18:21.666 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "crush_compat_step", 2023-07-14T11:18:21.666 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2023-07-14T11:18:21.666 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.667 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.667 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0.5", 2023-07-14T11:18:21.667 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "0.001", 2023-07-14T11:18:21.667 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "0.999", 2023-07-14T11:18:21.667 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.667 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "aggressiveness of optimization", 2023-07-14T11:18:21.667 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-07-14T11:18:21.667 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.668 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.668 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.668 INFO:teuthology.orchestra.run.smithi084.stdout: "end_time": { 2023-07-14T11:18:21.668 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "end_time", 2023-07-14T11:18:21.668 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.668 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.668 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.669 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "2359", 2023-07-14T11:18:21.669 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.669 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.669 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.669 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "ending time of day to automatically balance", 2023-07-14T11:18:21.669 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-07-14T11:18:21.669 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.669 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.670 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.670 INFO:teuthology.orchestra.run.smithi084.stdout: "end_weekday": { 2023-07-14T11:18:21.670 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "end_weekday", 2023-07-14T11:18:21.670 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "uint", 2023-07-14T11:18:21.670 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.670 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.670 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2023-07-14T11:18:21.670 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "0", 2023-07-14T11:18:21.671 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "6", 2023-07-14T11:18:21.671 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.671 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-07-14T11:18:21.671 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-07-14T11:18:21.671 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.671 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.671 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.671 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2023-07-14T11:18:21.672 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2023-07-14T11:18:21.672 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.672 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.672 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.672 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.672 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.672 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.673 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.673 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.673 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.673 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.673 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.673 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.673 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.673 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.674 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.674 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.674 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.674 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.674 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.674 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2023-07-14T11:18:21.674 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2023-07-14T11:18:21.674 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.675 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.675 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.675 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.675 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.675 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.675 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.675 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.675 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.676 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.676 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.676 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.676 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2023-07-14T11:18:21.676 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2023-07-14T11:18:21.676 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.676 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.676 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.677 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2023-07-14T11:18:21.677 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.677 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.677 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.677 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.677 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.677 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.677 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.678 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.678 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.678 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.678 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.678 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.678 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.678 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.678 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.679 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2023-07-14T11:18:21.679 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2023-07-14T11:18:21.679 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.679 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.679 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.679 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.679 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.680 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.680 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.680 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.680 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.680 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.680 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.680 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.680 INFO:teuthology.orchestra.run.smithi084.stdout: "min_score": { 2023-07-14T11:18:21.681 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "min_score", 2023-07-14T11:18:21.681 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2023-07-14T11:18:21.681 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.681 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.681 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2023-07-14T11:18:21.681 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.681 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.681 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.682 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-07-14T11:18:21.682 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.682 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.682 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.682 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.682 INFO:teuthology.orchestra.run.smithi084.stdout: "mode": { 2023-07-14T11:18:21.682 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "mode", 2023-07-14T11:18:21.682 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.683 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.683 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.683 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "upmap", 2023-07-14T11:18:21.683 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.683 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.683 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.683 INFO:teuthology.orchestra.run.smithi084.stdout: "crush-compat", 2023-07-14T11:18:21.683 INFO:teuthology.orchestra.run.smithi084.stdout: "none", 2023-07-14T11:18:21.684 INFO:teuthology.orchestra.run.smithi084.stdout: "upmap" 2023-07-14T11:18:21.684 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.684 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Balancer mode", 2023-07-14T11:18:21.684 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.684 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.684 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.684 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.685 INFO:teuthology.orchestra.run.smithi084.stdout: "pool_ids": { 2023-07-14T11:18:21.685 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "pool_ids", 2023-07-14T11:18:21.685 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.685 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.685 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.685 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.685 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.685 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.686 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.686 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-07-14T11:18:21.686 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.686 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.686 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.686 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.686 INFO:teuthology.orchestra.run.smithi084.stdout: "sleep_interval": { 2023-07-14T11:18:21.686 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sleep_interval", 2023-07-14T11:18:21.687 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2023-07-14T11:18:21.687 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.687 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.687 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "60", 2023-07-14T11:18:21.687 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.687 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.687 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.687 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-07-14T11:18:21.688 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.688 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.688 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.688 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.688 INFO:teuthology.orchestra.run.smithi084.stdout: "upmap_max_deviation": { 2023-07-14T11:18:21.688 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "upmap_max_deviation", 2023-07-14T11:18:21.688 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2023-07-14T11:18:21.688 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.689 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.689 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "5", 2023-07-14T11:18:21.689 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "1", 2023-07-14T11:18:21.689 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.689 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.689 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "deviation below which no optimization is attempted", 2023-07-14T11:18:21.689 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-07-14T11:18:21.689 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.690 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.690 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.690 INFO:teuthology.orchestra.run.smithi084.stdout: "upmap_max_optimizations": { 2023-07-14T11:18:21.690 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "upmap_max_optimizations", 2023-07-14T11:18:21.690 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "uint", 2023-07-14T11:18:21.690 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.690 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.691 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2023-07-14T11:18:21.691 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.691 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.691 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.691 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-07-14T11:18:21.691 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.691 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.691 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.692 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.692 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.692 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.692 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:21.692 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "cephadm", 2023-07-14T11:18:21.692 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2023-07-14T11:18:21.692 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2023-07-14T11:18:21.692 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2023-07-14T11:18:21.693 INFO:teuthology.orchestra.run.smithi084.stdout: "agent_down_multiplier": { 2023-07-14T11:18:21.693 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "agent_down_multiplier", 2023-07-14T11:18:21.693 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2023-07-14T11:18:21.693 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.693 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.693 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "3.0", 2023-07-14T11:18:21.693 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.693 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.694 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.694 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-07-14T11:18:21.694 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.694 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.694 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.694 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.694 INFO:teuthology.orchestra.run.smithi084.stdout: "agent_refresh_rate": { 2023-07-14T11:18:21.694 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "agent_refresh_rate", 2023-07-14T11:18:21.695 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2023-07-14T11:18:21.695 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.695 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.695 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "20", 2023-07-14T11:18:21.695 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.695 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.695 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.695 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-07-14T11:18:21.696 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.696 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.696 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.696 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.696 INFO:teuthology.orchestra.run.smithi084.stdout: "agent_starting_port": { 2023-07-14T11:18:21.696 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "agent_starting_port", 2023-07-14T11:18:21.696 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2023-07-14T11:18:21.697 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.697 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.697 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "4721", 2023-07-14T11:18:21.697 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.697 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.697 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.697 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-07-14T11:18:21.698 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.698 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.698 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.698 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.698 INFO:teuthology.orchestra.run.smithi084.stdout: "alertmanager_web_password": { 2023-07-14T11:18:21.698 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "alertmanager_web_password", 2023-07-14T11:18:21.699 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.699 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.699 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.699 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "admin", 2023-07-14T11:18:21.699 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.699 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.699 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.700 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Alertmanager web password", 2023-07-14T11:18:21.700 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.700 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.700 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.700 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.700 INFO:teuthology.orchestra.run.smithi084.stdout: "alertmanager_web_user": { 2023-07-14T11:18:21.701 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "alertmanager_web_user", 2023-07-14T11:18:21.701 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.701 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.701 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.701 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "admin", 2023-07-14T11:18:21.702 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.702 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.702 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.702 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Alertmanager web user", 2023-07-14T11:18:21.702 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.702 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.703 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.703 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.703 INFO:teuthology.orchestra.run.smithi084.stdout: "allow_ptrace": { 2023-07-14T11:18:21.703 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "allow_ptrace", 2023-07-14T11:18:21.703 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.703 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.704 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.704 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.704 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.704 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.704 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.704 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-07-14T11:18:21.704 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-07-14T11:18:21.705 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.705 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.705 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.705 INFO:teuthology.orchestra.run.smithi084.stdout: "autotune_interval": { 2023-07-14T11:18:21.705 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "autotune_interval", 2023-07-14T11:18:21.705 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2023-07-14T11:18:21.705 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.706 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.706 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "600", 2023-07-14T11:18:21.706 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.706 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.706 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.706 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how frequently to autotune daemon memory", 2023-07-14T11:18:21.706 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.706 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.707 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.707 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.707 INFO:teuthology.orchestra.run.smithi084.stdout: "autotune_memory_target_ratio": { 2023-07-14T11:18:21.707 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "autotune_memory_target_ratio", 2023-07-14T11:18:21.707 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2023-07-14T11:18:21.707 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.707 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.707 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0.7", 2023-07-14T11:18:21.708 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.708 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.708 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.708 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-07-14T11:18:21.708 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.708 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.708 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.708 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.709 INFO:teuthology.orchestra.run.smithi084.stdout: "cgroups_split": { 2023-07-14T11:18:21.709 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "cgroups_split", 2023-07-14T11:18:21.709 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.709 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.709 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.709 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:21.709 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.709 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.710 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.710 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-07-14T11:18:21.710 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.710 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.710 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.710 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.710 INFO:teuthology.orchestra.run.smithi084.stdout: "config_checks_enabled": { 2023-07-14T11:18:21.711 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "config_checks_enabled", 2023-07-14T11:18:21.711 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.711 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.711 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.711 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.711 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.711 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.711 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.712 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-07-14T11:18:21.712 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.712 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.712 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.712 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.712 INFO:teuthology.orchestra.run.smithi084.stdout: "config_dashboard": { 2023-07-14T11:18:21.712 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "config_dashboard", 2023-07-14T11:18:21.712 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.713 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.713 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.713 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:21.713 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.713 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.713 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.713 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-07-14T11:18:21.713 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.714 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.714 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.714 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.714 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_alertmanager": { 2023-07-14T11:18:21.714 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_alertmanager", 2023-07-14T11:18:21.714 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.714 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.715 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.715 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-07-14T11:18:21.715 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.715 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.715 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.715 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Prometheus container image", 2023-07-14T11:18:21.715 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.715 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.716 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.716 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.716 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_base": { 2023-07-14T11:18:21.716 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_base", 2023-07-14T11:18:21.716 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.716 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.716 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.716 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/ceph/ceph", 2023-07-14T11:18:21.717 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.717 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.717 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.717 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Container image name, without the tag", 2023-07-14T11:18:21.717 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.717 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.717 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.717 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.718 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_elasticsearch": { 2023-07-14T11:18:21.718 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_elasticsearch", 2023-07-14T11:18:21.718 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.718 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.718 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.718 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-07-14T11:18:21.718 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.718 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.719 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.719 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "elasticsearch container image", 2023-07-14T11:18:21.719 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.719 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.719 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.719 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.719 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_grafana": { 2023-07-14T11:18:21.719 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_grafana", 2023-07-14T11:18:21.720 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.720 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.720 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.720 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-07-14T11:18:21.720 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.720 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.720 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.721 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Prometheus container image", 2023-07-14T11:18:21.721 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.721 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.721 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.721 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.721 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_haproxy": { 2023-07-14T11:18:21.721 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_haproxy", 2023-07-14T11:18:21.721 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.722 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.722 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.722 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-07-14T11:18:21.722 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.722 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.722 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.722 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "HAproxy container image", 2023-07-14T11:18:21.722 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.723 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.723 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.723 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.723 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_jaeger_agent": { 2023-07-14T11:18:21.723 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_jaeger_agent", 2023-07-14T11:18:21.723 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.723 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.723 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.724 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-07-14T11:18:21.724 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.724 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.724 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.724 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Jaeger agent container image", 2023-07-14T11:18:21.724 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.724 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.725 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.725 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.725 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_jaeger_collector": { 2023-07-14T11:18:21.725 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_jaeger_collector", 2023-07-14T11:18:21.725 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.725 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.725 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.725 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-07-14T11:18:21.726 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.726 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.726 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.726 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Jaeger collector container image", 2023-07-14T11:18:21.726 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.726 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.726 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.726 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.727 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_jaeger_query": { 2023-07-14T11:18:21.727 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_jaeger_query", 2023-07-14T11:18:21.727 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.727 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.727 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.727 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-07-14T11:18:21.727 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.727 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.728 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.728 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Jaeger query container image", 2023-07-14T11:18:21.728 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.728 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.728 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.728 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.728 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_keepalived": { 2023-07-14T11:18:21.728 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_keepalived", 2023-07-14T11:18:21.729 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.729 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.729 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.729 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-07-14T11:18:21.729 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.729 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.729 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.730 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Keepalived container image", 2023-07-14T11:18:21.730 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.730 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.730 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.730 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.730 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_loki": { 2023-07-14T11:18:21.730 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_loki", 2023-07-14T11:18:21.730 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.731 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.731 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.731 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-07-14T11:18:21.731 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.731 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.731 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.731 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Loki container image", 2023-07-14T11:18:21.731 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.732 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.732 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.732 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.732 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_node_exporter": { 2023-07-14T11:18:21.732 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_node_exporter", 2023-07-14T11:18:21.732 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.732 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.732 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.733 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-07-14T11:18:21.733 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.733 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.733 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.733 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Prometheus container image", 2023-07-14T11:18:21.733 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.733 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.733 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.734 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.734 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_prometheus": { 2023-07-14T11:18:21.734 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_prometheus", 2023-07-14T11:18:21.734 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.734 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.734 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.734 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-07-14T11:18:21.734 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.735 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.735 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.735 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Prometheus container image", 2023-07-14T11:18:21.735 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.735 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.735 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.735 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.736 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_promtail": { 2023-07-14T11:18:21.736 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_promtail", 2023-07-14T11:18:21.736 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.736 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.736 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.736 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-07-14T11:18:21.736 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.736 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.737 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.737 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Promtail container image", 2023-07-14T11:18:21.737 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.737 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.737 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.737 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.737 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_snmp_gateway": { 2023-07-14T11:18:21.737 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_snmp_gateway", 2023-07-14T11:18:21.738 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.738 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.738 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.738 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-07-14T11:18:21.738 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.738 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.738 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.739 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "SNMP Gateway container image", 2023-07-14T11:18:21.739 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.739 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.739 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.739 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.739 INFO:teuthology.orchestra.run.smithi084.stdout: "container_init": { 2023-07-14T11:18:21.739 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_init", 2023-07-14T11:18:21.739 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.740 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.740 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.740 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:21.740 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.740 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.740 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.740 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Run podman/docker with `--init`", 2023-07-14T11:18:21.740 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.741 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.741 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.741 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.741 INFO:teuthology.orchestra.run.smithi084.stdout: "daemon_cache_timeout": { 2023-07-14T11:18:21.741 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "daemon_cache_timeout", 2023-07-14T11:18:21.741 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2023-07-14T11:18:21.741 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.741 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.742 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "600", 2023-07-14T11:18:21.742 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.742 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.742 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.742 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-07-14T11:18:21.742 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.742 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.742 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.743 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.743 INFO:teuthology.orchestra.run.smithi084.stdout: "default_cephadm_command_timeout": { 2023-07-14T11:18:21.743 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "default_cephadm_command_timeout", 2023-07-14T11:18:21.743 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2023-07-14T11:18:21.743 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.743 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.743 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "900", 2023-07-14T11:18:21.743 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.744 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.744 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.744 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-07-14T11:18:21.744 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.744 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.744 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.744 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.745 INFO:teuthology.orchestra.run.smithi084.stdout: "default_registry": { 2023-07-14T11:18:21.745 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "default_registry", 2023-07-14T11:18:21.745 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.745 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.745 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.745 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "docker.io", 2023-07-14T11:18:21.745 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.745 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.746 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.746 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-07-14T11:18:21.746 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.746 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.746 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.746 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.746 INFO:teuthology.orchestra.run.smithi084.stdout: "device_cache_timeout": { 2023-07-14T11:18:21.746 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "device_cache_timeout", 2023-07-14T11:18:21.747 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2023-07-14T11:18:21.747 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.747 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.747 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "1800", 2023-07-14T11:18:21.747 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.747 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.747 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.747 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "seconds to cache device inventory", 2023-07-14T11:18:21.748 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.748 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.748 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.748 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.748 INFO:teuthology.orchestra.run.smithi084.stdout: "device_enhanced_scan": { 2023-07-14T11:18:21.748 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "device_enhanced_scan", 2023-07-14T11:18:21.748 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.749 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.749 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.749 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.749 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.749 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.749 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.749 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Use libstoragemgmt during device scans", 2023-07-14T11:18:21.749 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.750 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.750 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.750 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.750 INFO:teuthology.orchestra.run.smithi084.stdout: "facts_cache_timeout": { 2023-07-14T11:18:21.750 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "facts_cache_timeout", 2023-07-14T11:18:21.750 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2023-07-14T11:18:21.750 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.750 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.751 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "60", 2023-07-14T11:18:21.751 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.751 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.751 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.751 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "seconds to cache host facts data", 2023-07-14T11:18:21.751 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.751 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.752 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.752 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.752 INFO:teuthology.orchestra.run.smithi084.stdout: "host_check_interval": { 2023-07-14T11:18:21.752 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "host_check_interval", 2023-07-14T11:18:21.752 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2023-07-14T11:18:21.752 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.752 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.752 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "600", 2023-07-14T11:18:21.753 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.753 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.753 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.753 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how frequently to perform a host check", 2023-07-14T11:18:21.753 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.753 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.753 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.753 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.754 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2023-07-14T11:18:21.754 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2023-07-14T11:18:21.754 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.754 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.754 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.754 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.754 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.754 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.755 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.755 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.755 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.755 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.755 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.755 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.755 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.756 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.756 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.756 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.756 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.756 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.756 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.756 INFO:teuthology.orchestra.run.smithi084.stdout: "log_refresh_metadata": { 2023-07-14T11:18:21.756 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_refresh_metadata", 2023-07-14T11:18:21.757 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.757 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.757 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.757 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.757 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.757 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.757 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.757 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-07-14T11:18:21.758 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.758 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.758 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.758 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.758 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2023-07-14T11:18:21.758 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2023-07-14T11:18:21.758 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.759 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.759 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.759 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:21.759 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.759 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.759 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.759 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-07-14T11:18:21.759 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.760 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.760 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.760 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.760 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2023-07-14T11:18:21.760 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2023-07-14T11:18:21.760 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.760 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.760 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.761 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2023-07-14T11:18:21.761 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.761 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.761 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.761 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.761 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.761 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.761 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.762 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.762 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.762 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.762 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.762 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.762 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.762 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.763 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.763 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2023-07-14T11:18:21.763 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2023-07-14T11:18:21.763 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.763 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.763 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.763 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.763 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.764 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.764 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.764 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.764 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.764 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.764 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.764 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.765 INFO:teuthology.orchestra.run.smithi084.stdout: "manage_etc_ceph_ceph_conf": { 2023-07-14T11:18:21.765 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-07-14T11:18:21.765 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.765 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.765 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.765 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.765 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.765 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.766 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.766 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-07-14T11:18:21.766 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.766 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.766 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.766 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.766 INFO:teuthology.orchestra.run.smithi084.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-07-14T11:18:21.766 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-07-14T11:18:21.767 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.767 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.767 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.767 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "*", 2023-07-14T11:18:21.767 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.767 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.767 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.767 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-07-14T11:18:21.768 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.768 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.768 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.768 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.768 INFO:teuthology.orchestra.run.smithi084.stdout: "max_count_per_host": { 2023-07-14T11:18:21.768 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "max_count_per_host", 2023-07-14T11:18:21.768 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2023-07-14T11:18:21.769 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.769 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.769 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2023-07-14T11:18:21.769 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.769 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.769 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.769 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "max number of daemons per service per host", 2023-07-14T11:18:21.769 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.770 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.770 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.770 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.770 INFO:teuthology.orchestra.run.smithi084.stdout: "max_osd_draining_count": { 2023-07-14T11:18:21.770 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "max_osd_draining_count", 2023-07-14T11:18:21.770 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2023-07-14T11:18:21.770 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.770 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.771 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2023-07-14T11:18:21.771 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.771 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.771 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.771 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-07-14T11:18:21.771 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.771 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.772 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.772 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.772 INFO:teuthology.orchestra.run.smithi084.stdout: "migration_current": { 2023-07-14T11:18:21.772 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "migration_current", 2023-07-14T11:18:21.772 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2023-07-14T11:18:21.772 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.772 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.772 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.773 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.773 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.773 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.773 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "internal - do not modify", 2023-07-14T11:18:21.773 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.773 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.773 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.773 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.774 INFO:teuthology.orchestra.run.smithi084.stdout: "mode": { 2023-07-14T11:18:21.774 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "mode", 2023-07-14T11:18:21.774 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.774 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.774 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.774 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "root", 2023-07-14T11:18:21.774 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.775 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.775 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.775 INFO:teuthology.orchestra.run.smithi084.stdout: "cephadm-package", 2023-07-14T11:18:21.775 INFO:teuthology.orchestra.run.smithi084.stdout: "root" 2023-07-14T11:18:21.775 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.775 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "mode for remote execution of cephadm", 2023-07-14T11:18:21.775 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.775 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.776 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.776 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.776 INFO:teuthology.orchestra.run.smithi084.stdout: "prometheus_alerts_path": { 2023-07-14T11:18:21.776 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "prometheus_alerts_path", 2023-07-14T11:18:21.776 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.776 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.776 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.776 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-07-14T11:18:21.777 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.777 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.777 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.777 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-07-14T11:18:21.777 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.777 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.777 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.778 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.778 INFO:teuthology.orchestra.run.smithi084.stdout: "prometheus_web_password": { 2023-07-14T11:18:21.778 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "prometheus_web_password", 2023-07-14T11:18:21.778 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.778 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.778 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.778 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "admin", 2023-07-14T11:18:21.778 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.779 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.779 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.779 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Prometheus web password", 2023-07-14T11:18:21.779 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.779 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.779 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.779 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.779 INFO:teuthology.orchestra.run.smithi084.stdout: "prometheus_web_user": { 2023-07-14T11:18:21.780 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "prometheus_web_user", 2023-07-14T11:18:21.780 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.780 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.780 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.780 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "admin", 2023-07-14T11:18:21.780 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.780 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.780 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.781 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Prometheus web user", 2023-07-14T11:18:21.781 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.781 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.781 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.781 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.781 INFO:teuthology.orchestra.run.smithi084.stdout: "registry_insecure": { 2023-07-14T11:18:21.781 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "registry_insecure", 2023-07-14T11:18:21.782 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.782 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.782 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.782 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.782 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.782 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.782 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.782 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-07-14T11:18:21.783 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.783 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.783 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.783 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.783 INFO:teuthology.orchestra.run.smithi084.stdout: "registry_password": { 2023-07-14T11:18:21.783 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "registry_password", 2023-07-14T11:18:21.783 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.783 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.784 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.784 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.784 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.784 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.784 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.784 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-07-14T11:18:21.784 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.784 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.785 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.785 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.785 INFO:teuthology.orchestra.run.smithi084.stdout: "registry_url": { 2023-07-14T11:18:21.785 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "registry_url", 2023-07-14T11:18:21.785 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.785 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.785 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.786 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.786 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.786 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.786 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.786 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-07-14T11:18:21.786 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.786 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.786 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.787 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.787 INFO:teuthology.orchestra.run.smithi084.stdout: "registry_username": { 2023-07-14T11:18:21.787 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "registry_username", 2023-07-14T11:18:21.787 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.787 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.787 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.787 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.787 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.788 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.788 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.788 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-07-14T11:18:21.788 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.788 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.788 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.788 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.789 INFO:teuthology.orchestra.run.smithi084.stdout: "secure_monitoring_stack": { 2023-07-14T11:18:21.789 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "secure_monitoring_stack", 2023-07-14T11:18:21.789 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.789 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.789 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.789 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.789 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.789 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.790 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.790 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-07-14T11:18:21.790 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.790 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.790 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.790 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.790 INFO:teuthology.orchestra.run.smithi084.stdout: "service_discovery_port": { 2023-07-14T11:18:21.790 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "service_discovery_port", 2023-07-14T11:18:21.791 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2023-07-14T11:18:21.791 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.791 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.791 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "8765", 2023-07-14T11:18:21.791 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.791 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.791 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.792 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "cephadm service discovery port", 2023-07-14T11:18:21.792 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.792 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.792 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.792 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.792 INFO:teuthology.orchestra.run.smithi084.stdout: "ssh_config_file": { 2023-07-14T11:18:21.792 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ssh_config_file", 2023-07-14T11:18:21.792 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.793 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.793 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.793 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.793 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.793 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.793 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.793 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-07-14T11:18:21.793 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.794 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.794 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.794 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.794 INFO:teuthology.orchestra.run.smithi084.stdout: "use_agent": { 2023-07-14T11:18:21.794 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "use_agent", 2023-07-14T11:18:21.794 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.794 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.794 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.795 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.795 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.795 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.795 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.795 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-07-14T11:18:21.795 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.795 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.796 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.796 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.796 INFO:teuthology.orchestra.run.smithi084.stdout: "use_repo_digest": { 2023-07-14T11:18:21.796 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "use_repo_digest", 2023-07-14T11:18:21.796 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.796 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.796 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.796 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:21.797 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.797 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.797 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.797 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-07-14T11:18:21.797 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.797 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.797 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.797 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.798 INFO:teuthology.orchestra.run.smithi084.stdout: "warn_on_failed_host_check": { 2023-07-14T11:18:21.798 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "warn_on_failed_host_check", 2023-07-14T11:18:21.798 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.798 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.798 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.798 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:21.798 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.798 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.799 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.799 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "raise a health warning if the host check fails", 2023-07-14T11:18:21.799 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.799 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.799 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.799 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.799 INFO:teuthology.orchestra.run.smithi084.stdout: "warn_on_stray_daemons": { 2023-07-14T11:18:21.799 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "warn_on_stray_daemons", 2023-07-14T11:18:21.800 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.800 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.800 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.800 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:21.800 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.800 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.800 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.801 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-07-14T11:18:21.801 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.801 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.801 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.801 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.801 INFO:teuthology.orchestra.run.smithi084.stdout: "warn_on_stray_hosts": { 2023-07-14T11:18:21.801 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "warn_on_stray_hosts", 2023-07-14T11:18:21.801 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.802 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.802 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.802 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:21.802 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.802 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.802 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.802 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-07-14T11:18:21.802 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.803 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.803 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.803 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.803 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.803 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.803 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:21.803 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "crash", 2023-07-14T11:18:21.803 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2023-07-14T11:18:21.804 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2023-07-14T11:18:21.804 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2023-07-14T11:18:21.804 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2023-07-14T11:18:21.804 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2023-07-14T11:18:21.804 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.804 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.804 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.805 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.805 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.805 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.805 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.805 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.805 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.805 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.805 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.806 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.806 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.806 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.806 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.806 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.806 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.806 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.806 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.807 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2023-07-14T11:18:21.807 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2023-07-14T11:18:21.807 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.807 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.807 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.807 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.807 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.807 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.808 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.808 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.808 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.808 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.808 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.808 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.808 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2023-07-14T11:18:21.809 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2023-07-14T11:18:21.809 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.809 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.809 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.809 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2023-07-14T11:18:21.809 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.809 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.809 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.810 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.810 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.810 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.810 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.810 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.810 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.810 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.810 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.811 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.811 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.811 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.811 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.811 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2023-07-14T11:18:21.811 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2023-07-14T11:18:21.811 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.812 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.812 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.812 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.812 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.812 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.812 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.812 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.812 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.813 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.813 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.813 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.813 INFO:teuthology.orchestra.run.smithi084.stdout: "retain_interval": { 2023-07-14T11:18:21.813 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "retain_interval", 2023-07-14T11:18:21.813 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2023-07-14T11:18:21.813 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.813 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.814 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "31536000", 2023-07-14T11:18:21.814 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.814 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.814 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.814 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how long to retain crashes before pruning them", 2023-07-14T11:18:21.814 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.814 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.814 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.815 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.815 INFO:teuthology.orchestra.run.smithi084.stdout: "warn_recent_interval": { 2023-07-14T11:18:21.815 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "warn_recent_interval", 2023-07-14T11:18:21.815 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2023-07-14T11:18:21.815 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.815 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.815 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "1209600", 2023-07-14T11:18:21.815 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.816 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.816 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.816 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "time interval in which to warn about recent crashes", 2023-07-14T11:18:21.816 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.816 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.816 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.816 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.817 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.817 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.817 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:21.817 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "dashboard", 2023-07-14T11:18:21.817 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2023-07-14T11:18:21.817 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2023-07-14T11:18:21.817 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2023-07-14T11:18:21.817 INFO:teuthology.orchestra.run.smithi084.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-07-14T11:18:21.818 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-07-14T11:18:21.818 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2023-07-14T11:18:21.818 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.818 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.818 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2023-07-14T11:18:21.818 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.818 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.818 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.819 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.819 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.819 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.819 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.819 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.819 INFO:teuthology.orchestra.run.smithi084.stdout: "ALERTMANAGER_API_HOST": { 2023-07-14T11:18:21.819 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ALERTMANAGER_API_HOST", 2023-07-14T11:18:21.820 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.820 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.820 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.820 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.820 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.820 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.820 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.820 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.821 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.821 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.821 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.821 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.821 INFO:teuthology.orchestra.run.smithi084.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-07-14T11:18:21.821 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-07-14T11:18:21.821 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.822 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.822 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.822 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:21.822 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.822 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.822 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.822 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.822 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.823 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.823 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.823 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.823 INFO:teuthology.orchestra.run.smithi084.stdout: "AUDIT_API_ENABLED": { 2023-07-14T11:18:21.823 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "AUDIT_API_ENABLED", 2023-07-14T11:18:21.823 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.823 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.823 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.824 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.824 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.824 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.824 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.824 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.824 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.824 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.824 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.825 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.825 INFO:teuthology.orchestra.run.smithi084.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-07-14T11:18:21.825 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-07-14T11:18:21.825 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.825 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.825 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.825 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:21.825 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.826 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.826 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.826 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.826 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.826 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.826 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.826 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.827 INFO:teuthology.orchestra.run.smithi084.stdout: "ENABLE_BROWSABLE_API": { 2023-07-14T11:18:21.827 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ENABLE_BROWSABLE_API", 2023-07-14T11:18:21.827 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.827 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.827 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.827 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:21.827 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.827 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.828 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.828 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.828 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.828 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.828 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.828 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.828 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-07-14T11:18:21.828 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-07-14T11:18:21.829 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.829 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.829 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.829 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:21.829 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.829 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.829 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.829 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.830 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.830 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.830 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.830 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.830 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-07-14T11:18:21.830 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-07-14T11:18:21.830 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.830 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.831 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.831 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:21.831 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.831 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.831 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.831 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.831 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.831 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.832 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.832 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.832 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-07-14T11:18:21.832 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-07-14T11:18:21.832 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.832 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.832 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.833 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:21.833 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.833 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.833 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.833 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.833 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.833 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.833 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.834 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.834 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-07-14T11:18:21.834 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-07-14T11:18:21.834 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.834 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.834 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.834 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:21.834 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.835 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.835 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.835 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.835 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.835 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.835 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.835 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.835 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_NFS": { 2023-07-14T11:18:21.836 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-07-14T11:18:21.836 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.836 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.836 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.836 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:21.836 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.836 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.837 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.837 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.837 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.837 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.837 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.837 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.837 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_RBD": { 2023-07-14T11:18:21.837 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-07-14T11:18:21.838 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.838 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.838 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.838 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:21.838 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.838 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.838 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.838 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.839 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.839 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.839 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.839 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.839 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_RGW": { 2023-07-14T11:18:21.839 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-07-14T11:18:21.839 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.840 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.840 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.840 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:21.840 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.840 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.840 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.840 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.840 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.841 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.841 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.841 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.841 INFO:teuthology.orchestra.run.smithi084.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-07-14T11:18:21.841 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-07-14T11:18:21.841 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.841 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.841 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.842 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.842 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.842 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.842 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.842 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.842 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.842 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.842 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.843 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.843 INFO:teuthology.orchestra.run.smithi084.stdout: "GRAFANA_API_PASSWORD": { 2023-07-14T11:18:21.843 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GRAFANA_API_PASSWORD", 2023-07-14T11:18:21.843 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.843 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.843 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.843 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "admin", 2023-07-14T11:18:21.843 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.844 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.844 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.844 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.844 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.844 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.844 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.844 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.845 INFO:teuthology.orchestra.run.smithi084.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-07-14T11:18:21.845 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-07-14T11:18:21.845 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.845 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.845 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.845 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:21.845 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.845 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.846 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.846 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.846 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.846 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.846 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.846 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.846 INFO:teuthology.orchestra.run.smithi084.stdout: "GRAFANA_API_URL": { 2023-07-14T11:18:21.846 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GRAFANA_API_URL", 2023-07-14T11:18:21.847 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.847 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.847 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.847 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.847 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.847 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.847 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.847 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.848 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.848 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.848 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.848 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.848 INFO:teuthology.orchestra.run.smithi084.stdout: "GRAFANA_API_USERNAME": { 2023-07-14T11:18:21.848 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GRAFANA_API_USERNAME", 2023-07-14T11:18:21.848 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.849 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.849 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.849 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "admin", 2023-07-14T11:18:21.849 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.849 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.849 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.849 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.849 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.850 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.850 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.850 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.850 INFO:teuthology.orchestra.run.smithi084.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-07-14T11:18:21.850 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-07-14T11:18:21.850 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.850 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.850 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.851 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.851 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.851 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.851 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.851 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.851 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.851 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.852 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.852 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.852 INFO:teuthology.orchestra.run.smithi084.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-07-14T11:18:21.852 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-07-14T11:18:21.852 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.852 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.852 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.852 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.853 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.853 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.853 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.853 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.853 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.853 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.853 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.853 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.854 INFO:teuthology.orchestra.run.smithi084.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-07-14T11:18:21.854 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-07-14T11:18:21.854 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.854 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.854 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.854 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:21.854 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.854 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.855 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.855 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.855 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.855 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.855 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.855 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.855 INFO:teuthology.orchestra.run.smithi084.stdout: "ISSUE_TRACKER_API_KEY": { 2023-07-14T11:18:21.855 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-07-14T11:18:21.856 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.856 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.856 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.856 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.856 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.856 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.856 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.857 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.857 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.857 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.857 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.857 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.857 INFO:teuthology.orchestra.run.smithi084.stdout: "PROMETHEUS_API_HOST": { 2023-07-14T11:18:21.857 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PROMETHEUS_API_HOST", 2023-07-14T11:18:21.857 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.858 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.858 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.858 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.858 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.858 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.858 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.858 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.858 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.859 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.859 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.859 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.859 INFO:teuthology.orchestra.run.smithi084.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-07-14T11:18:21.859 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-07-14T11:18:21.859 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.859 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.859 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.860 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:21.860 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.860 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.860 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.860 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.860 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.860 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.861 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.861 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.861 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-07-14T11:18:21.861 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-07-14T11:18:21.861 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.861 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.861 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.861 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.862 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.862 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.862 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.862 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.862 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.862 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.862 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.862 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.863 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-07-14T11:18:21.863 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-07-14T11:18:21.863 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.863 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.863 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.863 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.863 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.863 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.864 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.864 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.864 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.864 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.864 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.864 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.864 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-07-14T11:18:21.864 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-07-14T11:18:21.865 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.865 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.865 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.865 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:21.865 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.865 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.865 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.866 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.866 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.866 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.866 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.866 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.866 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-07-14T11:18:21.866 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-07-14T11:18:21.866 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.867 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.867 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.867 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:21.867 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.867 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.867 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.867 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.867 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.868 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.868 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.868 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.868 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-07-14T11:18:21.868 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-07-14T11:18:21.868 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.868 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.868 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.869 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.869 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.869 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.869 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.869 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.869 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.869 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.869 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.870 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.870 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-07-14T11:18:21.870 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-07-14T11:18:21.870 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.870 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.870 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.870 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.871 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.871 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.871 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.871 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.871 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.871 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.871 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.871 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.872 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-07-14T11:18:21.872 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-07-14T11:18:21.872 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.872 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.872 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.872 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.872 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.872 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.873 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.873 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.873 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.873 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.873 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.873 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.873 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_ENABLED": { 2023-07-14T11:18:21.873 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_ENABLED", 2023-07-14T11:18:21.874 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.874 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.874 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.874 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:21.874 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.874 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.874 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.874 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.875 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.875 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.875 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.875 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.875 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-07-14T11:18:21.875 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-07-14T11:18:21.875 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.876 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.876 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.876 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-07-14T11:18:21.876 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.876 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.876 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.876 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.876 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.877 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.877 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.877 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.877 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-07-14T11:18:21.877 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-07-14T11:18:21.877 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2023-07-14T11:18:21.877 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.878 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.878 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2023-07-14T11:18:21.878 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.878 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.878 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.878 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.878 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.878 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.879 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.879 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.879 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-07-14T11:18:21.879 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-07-14T11:18:21.879 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2023-07-14T11:18:21.879 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.879 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.879 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "8", 2023-07-14T11:18:21.880 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.880 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.880 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.880 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.880 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.880 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.880 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.880 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.881 INFO:teuthology.orchestra.run.smithi084.stdout: "REST_REQUESTS_TIMEOUT": { 2023-07-14T11:18:21.881 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-07-14T11:18:21.881 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2023-07-14T11:18:21.881 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.881 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.881 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "45", 2023-07-14T11:18:21.881 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.881 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.882 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.882 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.882 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.882 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.882 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.882 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.882 INFO:teuthology.orchestra.run.smithi084.stdout: "RGW_API_ACCESS_KEY": { 2023-07-14T11:18:21.883 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RGW_API_ACCESS_KEY", 2023-07-14T11:18:21.883 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.883 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.883 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.883 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.883 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.883 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.883 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.884 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.884 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.884 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.884 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.884 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.884 INFO:teuthology.orchestra.run.smithi084.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-07-14T11:18:21.884 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-07-14T11:18:21.884 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.885 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.885 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.885 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "admin", 2023-07-14T11:18:21.885 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.885 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.885 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.885 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.886 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.886 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.886 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.886 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.886 INFO:teuthology.orchestra.run.smithi084.stdout: "RGW_API_SECRET_KEY": { 2023-07-14T11:18:21.886 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RGW_API_SECRET_KEY", 2023-07-14T11:18:21.886 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.886 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.887 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.887 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.887 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.887 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.887 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.887 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.887 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.887 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.888 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.888 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.888 INFO:teuthology.orchestra.run.smithi084.stdout: "RGW_API_SSL_VERIFY": { 2023-07-14T11:18:21.888 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RGW_API_SSL_VERIFY", 2023-07-14T11:18:21.888 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.888 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.888 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.888 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:21.889 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.889 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.889 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.889 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.889 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.889 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.889 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.889 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.890 INFO:teuthology.orchestra.run.smithi084.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-07-14T11:18:21.890 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-07-14T11:18:21.890 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2023-07-14T11:18:21.890 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.890 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.890 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2023-07-14T11:18:21.890 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.890 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.891 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.891 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.891 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.891 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.891 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.891 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.891 INFO:teuthology.orchestra.run.smithi084.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-07-14T11:18:21.892 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-07-14T11:18:21.892 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2023-07-14T11:18:21.892 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.892 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.892 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2023-07-14T11:18:21.892 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.892 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.892 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.893 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.893 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.893 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.893 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.893 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.893 INFO:teuthology.orchestra.run.smithi084.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-07-14T11:18:21.893 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-07-14T11:18:21.893 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2023-07-14T11:18:21.894 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.894 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.894 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "5", 2023-07-14T11:18:21.894 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.894 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.894 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.894 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.894 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.895 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.895 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.895 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.895 INFO:teuthology.orchestra.run.smithi084.stdout: "cross_origin_url": { 2023-07-14T11:18:21.895 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "cross_origin_url", 2023-07-14T11:18:21.895 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.895 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.895 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.896 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.896 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.896 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.896 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.896 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.896 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.896 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.897 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.897 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.897 INFO:teuthology.orchestra.run.smithi084.stdout: "crt_file": { 2023-07-14T11:18:21.897 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "crt_file", 2023-07-14T11:18:21.897 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.897 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.897 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.897 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.898 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.898 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.898 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.898 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.898 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.898 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.898 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.899 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.899 INFO:teuthology.orchestra.run.smithi084.stdout: "debug": { 2023-07-14T11:18:21.899 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "debug", 2023-07-14T11:18:21.899 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.899 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.899 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.899 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.899 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.900 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.900 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.900 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Enable/disable debug options", 2023-07-14T11:18:21.900 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.900 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.900 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.900 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.901 INFO:teuthology.orchestra.run.smithi084.stdout: "jwt_token_ttl": { 2023-07-14T11:18:21.901 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "jwt_token_ttl", 2023-07-14T11:18:21.901 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2023-07-14T11:18:21.901 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.901 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.901 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "28800", 2023-07-14T11:18:21.901 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.901 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.902 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.902 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.902 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.902 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.902 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.902 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.902 INFO:teuthology.orchestra.run.smithi084.stdout: "key_file": { 2023-07-14T11:18:21.902 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "key_file", 2023-07-14T11:18:21.903 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.903 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.903 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.903 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.903 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.903 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.903 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.903 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.904 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.904 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.904 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.904 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.904 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2023-07-14T11:18:21.904 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2023-07-14T11:18:21.904 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.905 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.905 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.905 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.905 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.905 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.905 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.905 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.905 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.906 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.906 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.906 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.906 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.906 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.906 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.906 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.906 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.907 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.907 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.907 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2023-07-14T11:18:21.907 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2023-07-14T11:18:21.907 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.907 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.907 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.908 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.908 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.908 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.908 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.908 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.908 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.908 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.908 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.909 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.909 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2023-07-14T11:18:21.909 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2023-07-14T11:18:21.909 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.909 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.909 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.909 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2023-07-14T11:18:21.910 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.910 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.910 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.910 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.910 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.910 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.910 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.910 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.911 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.911 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.911 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.911 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.911 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.911 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.911 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.911 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2023-07-14T11:18:21.912 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2023-07-14T11:18:21.912 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.912 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.912 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.912 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.912 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.912 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.913 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.913 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.913 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.913 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.913 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.913 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.913 INFO:teuthology.orchestra.run.smithi084.stdout: "motd": { 2023-07-14T11:18:21.913 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "motd", 2023-07-14T11:18:21.914 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.914 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.914 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.914 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.914 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.914 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.914 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.914 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "The message of the day", 2023-07-14T11:18:21.915 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.915 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.915 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.915 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.915 INFO:teuthology.orchestra.run.smithi084.stdout: "redirect_resolve_ip_addr": { 2023-07-14T11:18:21.915 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "redirect_resolve_ip_addr", 2023-07-14T11:18:21.915 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.915 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.916 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.916 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.916 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.916 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.916 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.916 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.916 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.916 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.917 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.917 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.917 INFO:teuthology.orchestra.run.smithi084.stdout: "server_addr": { 2023-07-14T11:18:21.917 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "server_addr", 2023-07-14T11:18:21.917 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.917 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.917 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.918 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "::", 2023-07-14T11:18:21.918 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.918 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.918 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.918 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.918 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.918 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.918 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.919 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.919 INFO:teuthology.orchestra.run.smithi084.stdout: "server_port": { 2023-07-14T11:18:21.919 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "server_port", 2023-07-14T11:18:21.919 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2023-07-14T11:18:21.919 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.919 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.919 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "8080", 2023-07-14T11:18:21.919 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.920 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.920 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.920 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.920 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.920 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.920 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.920 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.920 INFO:teuthology.orchestra.run.smithi084.stdout: "ssl": { 2023-07-14T11:18:21.921 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ssl", 2023-07-14T11:18:21.921 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.921 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.921 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.921 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:21.921 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.921 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.922 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.922 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.922 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.922 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.922 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.922 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.922 INFO:teuthology.orchestra.run.smithi084.stdout: "ssl_server_port": { 2023-07-14T11:18:21.922 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ssl_server_port", 2023-07-14T11:18:21.923 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2023-07-14T11:18:21.923 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.923 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.923 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "8443", 2023-07-14T11:18:21.923 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.923 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.923 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.923 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.924 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.924 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.924 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.924 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.924 INFO:teuthology.orchestra.run.smithi084.stdout: "standby_behaviour": { 2023-07-14T11:18:21.924 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "standby_behaviour", 2023-07-14T11:18:21.924 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.924 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.925 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.925 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "redirect", 2023-07-14T11:18:21.925 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.925 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.925 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.925 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.925 INFO:teuthology.orchestra.run.smithi084.stdout: "redirect" 2023-07-14T11:18:21.925 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.926 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.926 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.926 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.926 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.926 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.926 INFO:teuthology.orchestra.run.smithi084.stdout: "standby_error_status_code": { 2023-07-14T11:18:21.926 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "standby_error_status_code", 2023-07-14T11:18:21.926 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2023-07-14T11:18:21.927 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.927 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.927 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "500", 2023-07-14T11:18:21.927 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "400", 2023-07-14T11:18:21.927 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "599", 2023-07-14T11:18:21.927 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.927 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.927 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.928 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.928 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.928 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.928 INFO:teuthology.orchestra.run.smithi084.stdout: "url_prefix": { 2023-07-14T11:18:21.928 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "url_prefix", 2023-07-14T11:18:21.928 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.928 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.929 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.929 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.929 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.929 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.929 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.929 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.929 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.929 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.930 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.930 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.930 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.930 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.930 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:21.930 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "devicehealth", 2023-07-14T11:18:21.930 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2023-07-14T11:18:21.930 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2023-07-14T11:18:21.931 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2023-07-14T11:18:21.931 INFO:teuthology.orchestra.run.smithi084.stdout: "enable_monitoring": { 2023-07-14T11:18:21.931 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "enable_monitoring", 2023-07-14T11:18:21.931 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.931 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.931 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.931 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:21.931 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.932 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.932 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.932 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "monitor device health metrics", 2023-07-14T11:18:21.932 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.932 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.932 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.932 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.933 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2023-07-14T11:18:21.933 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2023-07-14T11:18:21.933 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.933 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.933 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.933 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.933 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.933 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.934 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.934 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.934 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.934 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.934 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.934 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.934 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.934 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.935 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.935 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.935 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.935 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.935 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.935 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2023-07-14T11:18:21.935 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2023-07-14T11:18:21.935 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.936 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.936 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.936 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.936 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.936 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.936 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.936 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.937 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.937 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.937 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.937 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.937 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2023-07-14T11:18:21.937 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2023-07-14T11:18:21.937 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.937 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.938 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.938 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2023-07-14T11:18:21.938 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.938 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.938 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.938 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.938 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.938 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.939 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.939 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.939 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.939 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.939 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.939 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.939 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.939 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.940 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.940 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2023-07-14T11:18:21.940 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2023-07-14T11:18:21.940 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.940 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.940 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.940 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.941 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.941 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.941 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.941 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.941 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.941 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.941 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.941 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.942 INFO:teuthology.orchestra.run.smithi084.stdout: "mark_out_threshold": { 2023-07-14T11:18:21.942 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "mark_out_threshold", 2023-07-14T11:18:21.942 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2023-07-14T11:18:21.942 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.942 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.942 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "2419200", 2023-07-14T11:18:21.942 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.942 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.943 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.943 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-07-14T11:18:21.943 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.943 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.943 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.943 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.943 INFO:teuthology.orchestra.run.smithi084.stdout: "pool_name": { 2023-07-14T11:18:21.943 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "pool_name", 2023-07-14T11:18:21.944 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.944 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.944 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.944 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "device_health_metrics", 2023-07-14T11:18:21.944 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.944 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.944 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.944 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "name of pool in which to store device health metrics", 2023-07-14T11:18:21.945 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.945 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.945 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.945 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.945 INFO:teuthology.orchestra.run.smithi084.stdout: "retention_period": { 2023-07-14T11:18:21.945 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "retention_period", 2023-07-14T11:18:21.945 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2023-07-14T11:18:21.945 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.946 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.946 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "15552000", 2023-07-14T11:18:21.946 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.946 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.946 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.946 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how long to retain device health metrics", 2023-07-14T11:18:21.946 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.946 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.947 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.947 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.947 INFO:teuthology.orchestra.run.smithi084.stdout: "scrape_frequency": { 2023-07-14T11:18:21.947 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "scrape_frequency", 2023-07-14T11:18:21.947 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2023-07-14T11:18:21.947 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.947 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.947 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "86400", 2023-07-14T11:18:21.948 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.948 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.948 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.948 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how frequently to scrape device health metrics", 2023-07-14T11:18:21.948 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.948 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.948 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.949 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.949 INFO:teuthology.orchestra.run.smithi084.stdout: "self_heal": { 2023-07-14T11:18:21.949 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "self_heal", 2023-07-14T11:18:21.949 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.949 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.949 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.949 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:21.949 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.950 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.950 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.950 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-07-14T11:18:21.950 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.950 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.950 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.950 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.950 INFO:teuthology.orchestra.run.smithi084.stdout: "sleep_interval": { 2023-07-14T11:18:21.951 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sleep_interval", 2023-07-14T11:18:21.951 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2023-07-14T11:18:21.951 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.951 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.951 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "600", 2023-07-14T11:18:21.951 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.951 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.951 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.952 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how frequently to wake up and check device health", 2023-07-14T11:18:21.952 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.952 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.952 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.952 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.952 INFO:teuthology.orchestra.run.smithi084.stdout: "warn_threshold": { 2023-07-14T11:18:21.952 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "warn_threshold", 2023-07-14T11:18:21.953 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2023-07-14T11:18:21.953 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.953 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.953 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "7257600", 2023-07-14T11:18:21.953 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.953 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.953 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.953 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-07-14T11:18:21.954 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.954 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.954 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.954 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.954 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.954 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.954 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:21.954 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "diskprediction_local", 2023-07-14T11:18:21.955 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2023-07-14T11:18:21.955 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2023-07-14T11:18:21.955 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2023-07-14T11:18:21.955 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2023-07-14T11:18:21.955 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2023-07-14T11:18:21.955 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.955 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.955 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.956 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.956 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.956 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.956 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.956 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.956 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.956 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.957 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.957 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.957 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.957 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.957 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.957 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.957 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.957 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.958 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.958 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2023-07-14T11:18:21.958 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2023-07-14T11:18:21.958 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.958 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.958 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.958 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.958 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.959 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.959 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.959 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.959 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.959 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.959 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.959 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.959 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2023-07-14T11:18:21.960 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2023-07-14T11:18:21.960 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.960 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.960 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.960 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2023-07-14T11:18:21.960 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.960 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.960 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.961 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.961 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.961 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.961 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.961 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.961 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.961 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.962 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.962 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.962 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.962 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.962 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.962 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2023-07-14T11:18:21.962 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2023-07-14T11:18:21.962 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.963 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.963 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.963 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.963 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.963 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.963 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.963 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.963 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.964 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.964 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.964 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.964 INFO:teuthology.orchestra.run.smithi084.stdout: "predict_interval": { 2023-07-14T11:18:21.964 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "predict_interval", 2023-07-14T11:18:21.964 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.964 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.965 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.965 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "86400", 2023-07-14T11:18:21.965 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.965 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.965 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.965 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.965 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.965 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.966 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.966 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.966 INFO:teuthology.orchestra.run.smithi084.stdout: "predictor_model": { 2023-07-14T11:18:21.966 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "predictor_model", 2023-07-14T11:18:21.966 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.966 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.966 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.966 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "prophetstor", 2023-07-14T11:18:21.967 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.967 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.967 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.967 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.967 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.967 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.967 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.967 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.968 INFO:teuthology.orchestra.run.smithi084.stdout: "sleep_interval": { 2023-07-14T11:18:21.968 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sleep_interval", 2023-07-14T11:18:21.968 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.968 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.968 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.968 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "600", 2023-07-14T11:18:21.968 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.969 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.969 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.969 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.969 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.969 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.969 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.969 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.969 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.970 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.970 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:21.970 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "influx", 2023-07-14T11:18:21.970 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": false, 2023-07-14T11:18:21.970 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "influxdb python module not found", 2023-07-14T11:18:21.970 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2023-07-14T11:18:21.970 INFO:teuthology.orchestra.run.smithi084.stdout: "batch_size": { 2023-07-14T11:18:21.970 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "batch_size", 2023-07-14T11:18:21.971 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2023-07-14T11:18:21.971 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.971 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.971 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "5000", 2023-07-14T11:18:21.971 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.971 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.971 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.971 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-07-14T11:18:21.972 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.972 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.972 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.972 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.972 INFO:teuthology.orchestra.run.smithi084.stdout: "database": { 2023-07-14T11:18:21.972 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "database", 2023-07-14T11:18:21.972 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.973 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.973 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.973 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "ceph", 2023-07-14T11:18:21.973 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.973 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.973 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.973 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-07-14T11:18:21.973 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.974 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.974 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.974 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.974 INFO:teuthology.orchestra.run.smithi084.stdout: "hostname": { 2023-07-14T11:18:21.974 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "hostname", 2023-07-14T11:18:21.974 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.974 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.974 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.975 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.975 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.975 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.975 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.975 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "InfluxDB server hostname", 2023-07-14T11:18:21.975 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.975 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.975 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.976 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.976 INFO:teuthology.orchestra.run.smithi084.stdout: "interval": { 2023-07-14T11:18:21.976 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "interval", 2023-07-14T11:18:21.976 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2023-07-14T11:18:21.976 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.976 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.976 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "30", 2023-07-14T11:18:21.977 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "5", 2023-07-14T11:18:21.977 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.977 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.977 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-07-14T11:18:21.977 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.977 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.977 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.977 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.978 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2023-07-14T11:18:21.978 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2023-07-14T11:18:21.978 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.978 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.978 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.978 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.978 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.978 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.979 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.979 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.979 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.979 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.979 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.979 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.979 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.980 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.980 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.980 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.980 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.980 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.980 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.980 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2023-07-14T11:18:21.980 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2023-07-14T11:18:21.981 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.981 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.981 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.981 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.981 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.981 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.981 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.981 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.982 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.982 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.982 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.982 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.982 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2023-07-14T11:18:21.982 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2023-07-14T11:18:21.982 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.982 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.983 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.983 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2023-07-14T11:18:21.983 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.983 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.983 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.983 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:21.983 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:21.983 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:21.984 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:21.984 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:21.984 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:21.984 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:21.984 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.984 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.984 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.985 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.985 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.985 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2023-07-14T11:18:21.985 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2023-07-14T11:18:21.985 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:21.985 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.985 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.985 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:21.986 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.986 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.986 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.986 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:21.986 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.986 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.986 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.986 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.987 INFO:teuthology.orchestra.run.smithi084.stdout: "password": { 2023-07-14T11:18:21.987 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "password", 2023-07-14T11:18:21.987 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.987 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.987 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.987 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.987 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.987 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.988 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.988 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "password of InfluxDB server user", 2023-07-14T11:18:21.988 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.988 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.988 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.988 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.988 INFO:teuthology.orchestra.run.smithi084.stdout: "port": { 2023-07-14T11:18:21.989 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "port", 2023-07-14T11:18:21.989 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2023-07-14T11:18:21.989 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.989 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.989 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "8086", 2023-07-14T11:18:21.989 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.989 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.989 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.990 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "InfluxDB server port", 2023-07-14T11:18:21.990 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.990 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.990 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.990 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.990 INFO:teuthology.orchestra.run.smithi084.stdout: "ssl": { 2023-07-14T11:18:21.990 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ssl", 2023-07-14T11:18:21.990 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.991 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.991 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.991 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "false", 2023-07-14T11:18:21.991 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.991 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.991 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.991 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-07-14T11:18:21.991 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.992 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.992 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.992 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.992 INFO:teuthology.orchestra.run.smithi084.stdout: "threads": { 2023-07-14T11:18:21.992 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "threads", 2023-07-14T11:18:21.992 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2023-07-14T11:18:21.992 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.992 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.993 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "5", 2023-07-14T11:18:21.993 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "1", 2023-07-14T11:18:21.993 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "32", 2023-07-14T11:18:21.993 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.993 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-07-14T11:18:21.993 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.993 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.994 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.994 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.994 INFO:teuthology.orchestra.run.smithi084.stdout: "username": { 2023-07-14T11:18:21.994 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "username", 2023-07-14T11:18:21.994 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.994 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.994 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.994 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.995 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.995 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.995 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.995 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "username of InfluxDB server user", 2023-07-14T11:18:21.995 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.995 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.995 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.995 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.996 INFO:teuthology.orchestra.run.smithi084.stdout: "verify_ssl": { 2023-07-14T11:18:21.996 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "verify_ssl", 2023-07-14T11:18:21.996 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.996 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.996 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:21.996 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "true", 2023-07-14T11:18:21.996 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.997 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.997 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:21.997 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-07-14T11:18:21.997 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:21.997 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:21.997 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:21.997 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.997 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:21.998 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:21.998 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:21.998 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "insights", 2023-07-14T11:18:21.998 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2023-07-14T11:18:21.998 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2023-07-14T11:18:21.998 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2023-07-14T11:18:21.998 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2023-07-14T11:18:21.998 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2023-07-14T11:18:21.999 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:21.999 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:21.999 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:21.999 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:21.999 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:21.999 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:21.999 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:21.999 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:22.000 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:22.000 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:22.000 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:22.000 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:22.000 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:22.000 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:22.000 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.001 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.001 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.001 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.001 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.001 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2023-07-14T11:18:22.001 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2023-07-14T11:18:22.001 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:22.001 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.002 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.002 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:22.002 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.002 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.002 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.002 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.002 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.002 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.003 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.003 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.003 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2023-07-14T11:18:22.003 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2023-07-14T11:18:22.003 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.003 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.003 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.003 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2023-07-14T11:18:22.004 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.004 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.004 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:22.004 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:22.004 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:22.004 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:22.004 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:22.004 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:22.005 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:22.005 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:22.005 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.005 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.005 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.005 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.005 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.005 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2023-07-14T11:18:22.006 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2023-07-14T11:18:22.006 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:22.006 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.006 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.006 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:22.006 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.006 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.007 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.007 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.007 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.007 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.007 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.007 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:22.007 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:22.007 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.008 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:22.008 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "iostat", 2023-07-14T11:18:22.008 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2023-07-14T11:18:22.008 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2023-07-14T11:18:22.008 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2023-07-14T11:18:22.008 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2023-07-14T11:18:22.008 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2023-07-14T11:18:22.008 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.009 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.009 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.009 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:22.009 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.009 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.009 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:22.009 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:22.009 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:22.010 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:22.010 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:22.010 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:22.010 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:22.010 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:22.010 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.010 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.011 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.011 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.011 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.011 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2023-07-14T11:18:22.011 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2023-07-14T11:18:22.011 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:22.011 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.011 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.012 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:22.012 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.012 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.012 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.012 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.012 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.012 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.012 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.013 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.013 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2023-07-14T11:18:22.013 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2023-07-14T11:18:22.013 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.013 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.013 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.013 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2023-07-14T11:18:22.013 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.014 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.014 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:22.014 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:22.014 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:22.014 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:22.014 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:22.014 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:22.015 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:22.015 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:22.015 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.015 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.015 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.015 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.015 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.015 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2023-07-14T11:18:22.016 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2023-07-14T11:18:22.016 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:22.016 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.016 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.016 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:22.016 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.016 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.016 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.017 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.017 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.017 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.017 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.017 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:22.017 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:22.017 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.017 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:22.018 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "localpool", 2023-07-14T11:18:22.018 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2023-07-14T11:18:22.018 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2023-07-14T11:18:22.018 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2023-07-14T11:18:22.018 INFO:teuthology.orchestra.run.smithi084.stdout: "failure_domain": { 2023-07-14T11:18:22.018 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "failure_domain", 2023-07-14T11:18:22.018 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.019 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.019 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.019 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "host", 2023-07-14T11:18:22.019 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.019 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.019 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.019 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "failure domain for any created local pool", 2023-07-14T11:18:22.019 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-07-14T11:18:22.020 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.020 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.020 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.020 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2023-07-14T11:18:22.020 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2023-07-14T11:18:22.020 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.020 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.020 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.021 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:22.021 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.021 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.021 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:22.021 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:22.021 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:22.021 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:22.021 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:22.022 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:22.022 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:22.022 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:22.022 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.022 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.022 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.022 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.022 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.023 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2023-07-14T11:18:22.023 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2023-07-14T11:18:22.023 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:22.023 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.023 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.023 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:22.023 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.023 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.024 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.024 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.024 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.024 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.024 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.024 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.024 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2023-07-14T11:18:22.025 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2023-07-14T11:18:22.025 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.025 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.025 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.025 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2023-07-14T11:18:22.025 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.025 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.025 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:22.026 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:22.026 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:22.026 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:22.026 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:22.026 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:22.026 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:22.026 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:22.026 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.027 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.027 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.027 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.027 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.027 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2023-07-14T11:18:22.027 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2023-07-14T11:18:22.027 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:22.028 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.028 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.028 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:22.028 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.028 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.028 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.028 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.028 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.029 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.029 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.029 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.029 INFO:teuthology.orchestra.run.smithi084.stdout: "min_size": { 2023-07-14T11:18:22.029 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "min_size", 2023-07-14T11:18:22.029 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2023-07-14T11:18:22.029 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.029 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.030 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:22.030 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.030 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.030 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.030 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "default min_size for any created local pool", 2023-07-14T11:18:22.030 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-07-14T11:18:22.030 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.031 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.031 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.031 INFO:teuthology.orchestra.run.smithi084.stdout: "num_rep": { 2023-07-14T11:18:22.031 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "num_rep", 2023-07-14T11:18:22.031 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2023-07-14T11:18:22.031 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.031 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.031 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "3", 2023-07-14T11:18:22.032 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.032 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.032 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.032 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "default replica count for any created local pool", 2023-07-14T11:18:22.032 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.032 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.032 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.032 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.033 INFO:teuthology.orchestra.run.smithi084.stdout: "pg_num": { 2023-07-14T11:18:22.033 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "pg_num", 2023-07-14T11:18:22.033 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2023-07-14T11:18:22.033 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.033 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.033 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "128", 2023-07-14T11:18:22.033 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.033 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.034 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.034 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "default pg_num for any created local pool", 2023-07-14T11:18:22.034 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.034 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.034 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.034 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.034 INFO:teuthology.orchestra.run.smithi084.stdout: "prefix": { 2023-07-14T11:18:22.035 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "prefix", 2023-07-14T11:18:22.035 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.035 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.035 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.035 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:22.035 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.035 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.035 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.036 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "name prefix for any created local pool", 2023-07-14T11:18:22.036 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.036 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.036 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.036 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.036 INFO:teuthology.orchestra.run.smithi084.stdout: "subtree": { 2023-07-14T11:18:22.036 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "subtree", 2023-07-14T11:18:22.036 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.037 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.037 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.037 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "rack", 2023-07-14T11:18:22.037 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.037 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.037 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.037 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "CRUSH level for which to create a local pool", 2023-07-14T11:18:22.037 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-07-14T11:18:22.038 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.038 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.038 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:22.038 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:22.038 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.038 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:22.038 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "mds_autoscaler", 2023-07-14T11:18:22.039 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2023-07-14T11:18:22.039 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2023-07-14T11:18:22.039 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2023-07-14T11:18:22.039 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2023-07-14T11:18:22.039 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2023-07-14T11:18:22.039 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.039 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.039 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.040 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:22.040 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.040 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.040 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:22.040 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:22.040 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:22.040 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:22.040 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:22.041 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:22.041 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:22.041 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:22.041 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.041 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.041 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.041 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.042 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.042 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2023-07-14T11:18:22.042 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2023-07-14T11:18:22.042 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:22.042 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.042 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.042 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:22.042 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.043 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.043 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.043 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.043 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.043 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.043 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.043 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.043 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2023-07-14T11:18:22.044 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2023-07-14T11:18:22.044 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.044 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.044 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.044 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2023-07-14T11:18:22.044 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.044 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.045 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:22.045 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:22.045 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:22.045 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:22.045 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:22.045 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:22.045 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:22.045 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:22.046 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.046 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.046 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.046 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.046 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.046 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2023-07-14T11:18:22.046 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2023-07-14T11:18:22.046 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:22.047 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.047 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.047 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:22.047 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.047 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.047 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.047 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.047 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.048 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.048 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.048 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:22.048 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:22.048 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.048 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:22.048 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "mirroring", 2023-07-14T11:18:22.049 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2023-07-14T11:18:22.049 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2023-07-14T11:18:22.049 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2023-07-14T11:18:22.049 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2023-07-14T11:18:22.049 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2023-07-14T11:18:22.049 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.049 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.049 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.050 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:22.050 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.050 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.050 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:22.050 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:22.050 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:22.050 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:22.050 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:22.051 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:22.051 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:22.051 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:22.051 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.051 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.051 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.051 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.051 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.052 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2023-07-14T11:18:22.052 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2023-07-14T11:18:22.052 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:22.052 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.052 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.052 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:22.052 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.052 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.053 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.053 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.053 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.053 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.053 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.053 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.053 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2023-07-14T11:18:22.053 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2023-07-14T11:18:22.054 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.054 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.054 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.054 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2023-07-14T11:18:22.054 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.054 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.054 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:22.055 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:22.055 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:22.055 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:22.055 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:22.055 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:22.055 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:22.056 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:22.056 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.056 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.056 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.056 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.056 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.057 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2023-07-14T11:18:22.057 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2023-07-14T11:18:22.057 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:22.057 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.057 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.057 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:22.057 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.058 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.058 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.058 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.058 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.058 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.058 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.058 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:22.059 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:22.059 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.059 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:22.059 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "nfs", 2023-07-14T11:18:22.060 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2023-07-14T11:18:22.060 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2023-07-14T11:18:22.060 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2023-07-14T11:18:22.060 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2023-07-14T11:18:22.060 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2023-07-14T11:18:22.060 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.060 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.061 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.061 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:22.061 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.061 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.061 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:22.061 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:22.061 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:22.061 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:22.062 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:22.062 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:22.062 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:22.062 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:22.062 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.062 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.062 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.063 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.063 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.063 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2023-07-14T11:18:22.063 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2023-07-14T11:18:22.064 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:22.064 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.064 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.065 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:22.065 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.065 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.065 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.066 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.066 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.066 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.067 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.067 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.067 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2023-07-14T11:18:22.067 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2023-07-14T11:18:22.068 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.068 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.068 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.069 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2023-07-14T11:18:22.069 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.069 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.070 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:22.070 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:22.070 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:22.070 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:22.071 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:22.071 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:22.071 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:22.072 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:22.072 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.072 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.072 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.073 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.073 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.073 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2023-07-14T11:18:22.073 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2023-07-14T11:18:22.074 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:22.074 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.074 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.074 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:22.075 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.075 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.075 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.075 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.076 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.076 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.076 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.076 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:22.077 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:22.077 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.077 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:22.077 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "orchestrator", 2023-07-14T11:18:22.077 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2023-07-14T11:18:22.078 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2023-07-14T11:18:22.078 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2023-07-14T11:18:22.078 INFO:teuthology.orchestra.run.smithi084.stdout: "fail_fs": { 2023-07-14T11:18:22.078 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "fail_fs", 2023-07-14T11:18:22.078 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:22.079 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.079 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:22.079 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:22.079 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.079 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.079 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.079 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-07-14T11:18:22.080 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.080 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.080 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.080 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.080 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2023-07-14T11:18:22.080 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2023-07-14T11:18:22.080 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.080 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.081 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.081 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:22.081 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.081 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.081 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:22.081 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:22.081 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:22.082 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:22.082 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:22.082 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:22.082 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:22.082 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:22.082 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.082 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.082 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.083 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.083 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.083 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2023-07-14T11:18:22.083 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2023-07-14T11:18:22.083 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:22.083 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.083 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.083 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:22.084 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.084 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.084 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.084 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.084 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.084 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.084 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.084 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.085 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2023-07-14T11:18:22.085 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2023-07-14T11:18:22.085 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.085 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.085 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.085 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2023-07-14T11:18:22.085 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.086 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.086 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:22.086 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:22.086 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:22.086 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:22.086 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:22.086 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:22.086 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:22.087 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:22.087 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.087 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.087 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.087 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.087 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.087 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2023-07-14T11:18:22.087 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2023-07-14T11:18:22.088 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:22.088 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.088 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.088 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:22.088 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.088 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.088 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.088 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.089 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.089 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.089 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.089 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.089 INFO:teuthology.orchestra.run.smithi084.stdout: "orchestrator": { 2023-07-14T11:18:22.089 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "orchestrator", 2023-07-14T11:18:22.089 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.089 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.090 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.090 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:22.090 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.090 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.090 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:22.090 INFO:teuthology.orchestra.run.smithi084.stdout: "cephadm", 2023-07-14T11:18:22.090 INFO:teuthology.orchestra.run.smithi084.stdout: "rook", 2023-07-14T11:18:22.090 INFO:teuthology.orchestra.run.smithi084.stdout: "test_orchestrator" 2023-07-14T11:18:22.091 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:22.091 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Orchestrator backend", 2023-07-14T11:18:22.091 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.091 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.091 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.091 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:22.091 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:22.092 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.092 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:22.092 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "osd_perf_query", 2023-07-14T11:18:22.092 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2023-07-14T11:18:22.092 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2023-07-14T11:18:22.092 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2023-07-14T11:18:22.092 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2023-07-14T11:18:22.092 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2023-07-14T11:18:22.093 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.093 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.093 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.093 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:22.093 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.093 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.093 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:22.093 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:22.094 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:22.094 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:22.094 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:22.094 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:22.094 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:22.094 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:22.094 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.094 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.095 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.095 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.095 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.095 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2023-07-14T11:18:22.095 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2023-07-14T11:18:22.095 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:22.095 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.096 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.096 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:22.096 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.096 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.096 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.096 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.096 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.096 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.097 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.097 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.097 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2023-07-14T11:18:22.097 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2023-07-14T11:18:22.097 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.097 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.097 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.097 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2023-07-14T11:18:22.098 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.098 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.098 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:22.098 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:22.098 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:22.098 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:22.098 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:22.099 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:22.099 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:22.099 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:22.099 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.099 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.099 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.099 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.099 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.100 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2023-07-14T11:18:22.100 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2023-07-14T11:18:22.100 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:22.100 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.100 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.100 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:22.100 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.100 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.101 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.101 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.101 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.101 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.101 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.101 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:22.101 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:22.101 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.102 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:22.102 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "osd_support", 2023-07-14T11:18:22.102 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2023-07-14T11:18:22.102 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2023-07-14T11:18:22.102 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2023-07-14T11:18:22.102 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2023-07-14T11:18:22.102 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2023-07-14T11:18:22.102 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.103 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.103 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.103 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:22.103 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.103 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.103 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:22.103 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:22.104 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:22.104 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:22.104 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:22.104 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:22.104 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:22.104 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:22.104 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.104 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.105 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.105 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.105 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.105 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2023-07-14T11:18:22.105 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2023-07-14T11:18:22.105 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:22.105 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.105 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.106 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:22.106 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.106 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.106 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.106 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.106 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.106 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.106 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.107 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.107 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2023-07-14T11:18:22.107 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2023-07-14T11:18:22.107 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.107 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.107 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.107 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2023-07-14T11:18:22.107 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.108 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.108 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:22.108 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:22.108 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:22.108 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:22.108 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:22.108 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:22.109 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:22.109 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:22.109 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.109 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.109 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.109 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.109 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.109 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2023-07-14T11:18:22.110 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2023-07-14T11:18:22.110 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:22.110 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.110 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.110 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:22.110 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.110 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.110 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.111 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.111 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.111 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.111 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.111 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:22.111 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:22.111 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.111 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:22.112 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "pg_autoscaler", 2023-07-14T11:18:22.112 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2023-07-14T11:18:22.112 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2023-07-14T11:18:22.112 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2023-07-14T11:18:22.112 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2023-07-14T11:18:22.112 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2023-07-14T11:18:22.112 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.112 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.113 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.113 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:22.113 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.113 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.113 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:22.113 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:22.113 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:22.113 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:22.114 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:22.114 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:22.114 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:22.114 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:22.114 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.114 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.114 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.115 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.115 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.115 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2023-07-14T11:18:22.115 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2023-07-14T11:18:22.115 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:22.115 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.115 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.115 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:22.116 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.116 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.116 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.116 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.116 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.116 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.116 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.116 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.117 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2023-07-14T11:18:22.117 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2023-07-14T11:18:22.117 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.117 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.117 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.117 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2023-07-14T11:18:22.117 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.117 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.118 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:22.118 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:22.118 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:22.118 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:22.118 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:22.118 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:22.118 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:22.118 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:22.119 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.119 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.119 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.119 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.119 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.119 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2023-07-14T11:18:22.119 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2023-07-14T11:18:22.120 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:22.120 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.120 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.120 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:22.120 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.120 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.120 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.120 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.121 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.121 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.121 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.121 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.121 INFO:teuthology.orchestra.run.smithi084.stdout: "noautoscale": { 2023-07-14T11:18:22.121 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "noautoscale", 2023-07-14T11:18:22.121 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:22.121 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.122 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:22.122 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:22.122 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.122 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.122 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.122 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "global autoscale flag", 2023-07-14T11:18:22.122 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "Option to turn on/off the autoscaler for all pools", 2023-07-14T11:18:22.122 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.123 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.123 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.123 INFO:teuthology.orchestra.run.smithi084.stdout: "sleep_interval": { 2023-07-14T11:18:22.123 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sleep_interval", 2023-07-14T11:18:22.123 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2023-07-14T11:18:22.123 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.123 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:22.123 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "60", 2023-07-14T11:18:22.124 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.124 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.124 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.124 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.124 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.124 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.124 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.125 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.125 INFO:teuthology.orchestra.run.smithi084.stdout: "threshold": { 2023-07-14T11:18:22.125 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "threshold", 2023-07-14T11:18:22.125 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2023-07-14T11:18:22.125 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.125 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:22.125 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "3.0", 2023-07-14T11:18:22.125 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "1.0", 2023-07-14T11:18:22.126 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.126 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.126 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "scaling threshold", 2023-07-14T11:18:22.126 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-07-14T11:18:22.126 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.126 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.126 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:22.126 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:22.127 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.127 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:22.127 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "progress", 2023-07-14T11:18:22.127 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2023-07-14T11:18:22.127 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2023-07-14T11:18:22.127 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2023-07-14T11:18:22.127 INFO:teuthology.orchestra.run.smithi084.stdout: "allow_pg_recovery_event": { 2023-07-14T11:18:22.127 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "allow_pg_recovery_event", 2023-07-14T11:18:22.128 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:22.128 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.128 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.128 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:22.128 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.128 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.128 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.129 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "allow the module to show pg recovery progress", 2023-07-14T11:18:22.129 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.129 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.129 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.129 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.129 INFO:teuthology.orchestra.run.smithi084.stdout: "enabled": { 2023-07-14T11:18:22.129 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "enabled", 2023-07-14T11:18:22.129 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:22.130 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.130 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:22.130 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:22.130 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.130 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.130 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.130 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.130 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.131 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.131 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.131 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.131 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2023-07-14T11:18:22.131 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2023-07-14T11:18:22.131 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.131 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.131 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.132 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:22.132 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.132 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.132 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:22.132 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:22.132 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:22.132 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:22.133 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:22.133 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:22.133 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:22.133 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:22.133 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.133 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.133 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.133 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.134 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.134 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2023-07-14T11:18:22.134 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2023-07-14T11:18:22.134 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:22.134 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.134 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.134 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:22.134 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.135 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.135 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.135 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.135 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.135 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.135 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.135 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.135 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2023-07-14T11:18:22.136 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2023-07-14T11:18:22.136 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.136 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.136 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.136 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2023-07-14T11:18:22.136 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.136 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.137 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:22.137 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:22.137 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:22.137 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:22.137 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:22.137 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:22.137 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:22.137 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:22.138 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.138 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.138 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.138 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.138 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.138 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2023-07-14T11:18:22.138 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2023-07-14T11:18:22.138 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:22.139 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.139 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.139 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:22.139 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.139 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.139 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.139 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.139 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.140 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.140 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.140 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.140 INFO:teuthology.orchestra.run.smithi084.stdout: "max_completed_events": { 2023-07-14T11:18:22.140 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "max_completed_events", 2023-07-14T11:18:22.140 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2023-07-14T11:18:22.140 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.140 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.141 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "50", 2023-07-14T11:18:22.141 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.141 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.141 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.141 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "number of past completed events to remember", 2023-07-14T11:18:22.141 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.141 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.142 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.142 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.142 INFO:teuthology.orchestra.run.smithi084.stdout: "sleep_interval": { 2023-07-14T11:18:22.142 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sleep_interval", 2023-07-14T11:18:22.142 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2023-07-14T11:18:22.142 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.142 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.143 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "5", 2023-07-14T11:18:22.143 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.143 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.143 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.143 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how long the module is going to sleep", 2023-07-14T11:18:22.143 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.143 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.143 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.144 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:22.144 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:22.144 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.144 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:22.144 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "prometheus", 2023-07-14T11:18:22.144 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2023-07-14T11:18:22.144 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2023-07-14T11:18:22.144 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2023-07-14T11:18:22.145 INFO:teuthology.orchestra.run.smithi084.stdout: "cache": { 2023-07-14T11:18:22.145 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "cache", 2023-07-14T11:18:22.145 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:22.145 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.145 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:22.145 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:22.145 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.145 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.146 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.146 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.146 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.146 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.146 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.146 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.146 INFO:teuthology.orchestra.run.smithi084.stdout: "exclude_perf_counters": { 2023-07-14T11:18:22.147 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "exclude_perf_counters", 2023-07-14T11:18:22.147 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:22.147 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.147 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.147 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:22.147 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.147 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.147 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.148 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-07-14T11:18:22.148 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-07-14T11:18:22.148 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.148 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.148 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.148 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2023-07-14T11:18:22.148 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2023-07-14T11:18:22.148 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.149 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.149 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.149 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:22.149 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.149 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.149 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:22.149 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:22.150 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:22.150 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:22.150 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:22.150 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:22.150 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:22.150 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:22.150 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.150 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.151 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.151 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.151 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.151 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2023-07-14T11:18:22.151 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2023-07-14T11:18:22.151 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:22.151 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.151 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.152 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:22.152 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.152 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.152 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.152 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.152 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.152 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.152 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.153 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.153 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2023-07-14T11:18:22.153 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2023-07-14T11:18:22.153 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.153 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.153 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.153 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2023-07-14T11:18:22.153 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.154 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.154 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:22.154 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:22.154 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:22.154 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:22.154 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:22.154 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:22.154 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:22.155 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:22.155 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.155 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.155 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.155 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.155 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.155 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2023-07-14T11:18:22.155 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2023-07-14T11:18:22.156 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:22.156 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.156 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.156 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:22.156 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.156 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.156 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.157 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.157 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.157 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.157 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.157 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.157 INFO:teuthology.orchestra.run.smithi084.stdout: "rbd_stats_pools": { 2023-07-14T11:18:22.157 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rbd_stats_pools", 2023-07-14T11:18:22.157 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.158 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.158 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:22.158 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:22.158 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.158 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.158 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.158 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.158 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.159 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.159 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.159 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.159 INFO:teuthology.orchestra.run.smithi084.stdout: "rbd_stats_pools_refresh_interval": { 2023-07-14T11:18:22.159 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-07-14T11:18:22.159 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2023-07-14T11:18:22.159 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.159 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:22.160 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "300", 2023-07-14T11:18:22.160 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.160 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.160 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.160 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.160 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.160 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.161 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.161 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.161 INFO:teuthology.orchestra.run.smithi084.stdout: "scrape_interval": { 2023-07-14T11:18:22.161 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "scrape_interval", 2023-07-14T11:18:22.161 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2023-07-14T11:18:22.161 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.161 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:22.161 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "15.0", 2023-07-14T11:18:22.162 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.162 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.162 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.162 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.162 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.162 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.162 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.162 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.163 INFO:teuthology.orchestra.run.smithi084.stdout: "server_addr": { 2023-07-14T11:18:22.163 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "server_addr", 2023-07-14T11:18:22.163 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.163 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.163 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:22.163 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "::", 2023-07-14T11:18:22.163 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.163 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.164 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.164 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-07-14T11:18:22.164 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.164 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.164 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.164 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.164 INFO:teuthology.orchestra.run.smithi084.stdout: "server_port": { 2023-07-14T11:18:22.164 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "server_port", 2023-07-14T11:18:22.165 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2023-07-14T11:18:22.165 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.165 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.165 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "9283", 2023-07-14T11:18:22.165 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.165 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.165 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.166 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-07-14T11:18:22.166 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.166 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.166 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.166 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.166 INFO:teuthology.orchestra.run.smithi084.stdout: "stale_cache_strategy": { 2023-07-14T11:18:22.166 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "stale_cache_strategy", 2023-07-14T11:18:22.166 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.167 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.167 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:22.167 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "log", 2023-07-14T11:18:22.167 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.167 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.167 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.167 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.167 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.168 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.168 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.168 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.168 INFO:teuthology.orchestra.run.smithi084.stdout: "standby_behaviour": { 2023-07-14T11:18:22.168 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "standby_behaviour", 2023-07-14T11:18:22.168 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.168 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.168 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.169 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "default", 2023-07-14T11:18:22.169 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.169 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.169 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:22.169 INFO:teuthology.orchestra.run.smithi084.stdout: "default", 2023-07-14T11:18:22.169 INFO:teuthology.orchestra.run.smithi084.stdout: "error" 2023-07-14T11:18:22.169 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:22.169 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.170 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.170 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.170 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.170 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.170 INFO:teuthology.orchestra.run.smithi084.stdout: "standby_error_status_code": { 2023-07-14T11:18:22.170 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "standby_error_status_code", 2023-07-14T11:18:22.170 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2023-07-14T11:18:22.170 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.171 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.171 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "500", 2023-07-14T11:18:22.171 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "400", 2023-07-14T11:18:22.171 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "599", 2023-07-14T11:18:22.171 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.171 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.171 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.171 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.172 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.172 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:22.172 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:22.172 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.172 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:22.172 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rbd_support", 2023-07-14T11:18:22.172 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2023-07-14T11:18:22.172 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2023-07-14T11:18:22.173 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2023-07-14T11:18:22.173 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2023-07-14T11:18:22.173 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2023-07-14T11:18:22.173 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.173 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.173 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.173 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:22.174 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.174 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.174 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:22.174 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:22.174 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:22.174 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:22.174 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:22.174 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:22.175 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:22.175 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:22.175 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.175 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.175 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.175 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.175 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.175 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2023-07-14T11:18:22.176 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2023-07-14T11:18:22.176 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:22.176 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.176 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.176 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:22.176 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.176 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.176 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.177 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.177 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.177 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.177 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.177 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.177 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2023-07-14T11:18:22.177 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2023-07-14T11:18:22.177 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.178 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.178 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.178 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2023-07-14T11:18:22.178 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.178 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.178 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:22.178 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:22.179 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:22.179 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:22.179 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:22.179 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:22.179 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:22.179 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:22.179 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.179 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.180 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.180 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.180 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.180 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2023-07-14T11:18:22.180 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2023-07-14T11:18:22.180 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:22.180 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.180 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.181 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:22.181 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.181 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.181 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.181 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.181 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.181 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.181 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.182 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.182 INFO:teuthology.orchestra.run.smithi084.stdout: "max_concurrent_snap_create": { 2023-07-14T11:18:22.182 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "max_concurrent_snap_create", 2023-07-14T11:18:22.182 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2023-07-14T11:18:22.182 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.182 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:22.182 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2023-07-14T11:18:22.182 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.183 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.183 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.183 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.183 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.183 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.183 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.183 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.183 INFO:teuthology.orchestra.run.smithi084.stdout: "mirror_snapshot_schedule": { 2023-07-14T11:18:22.184 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "mirror_snapshot_schedule", 2023-07-14T11:18:22.184 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.184 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.184 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:22.184 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:22.184 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.184 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.185 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.185 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.185 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.185 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.185 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.185 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.185 INFO:teuthology.orchestra.run.smithi084.stdout: "trash_purge_schedule": { 2023-07-14T11:18:22.185 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "trash_purge_schedule", 2023-07-14T11:18:22.186 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.186 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.186 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:22.186 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:22.186 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.186 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.186 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.187 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.187 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.187 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.187 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.187 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:22.187 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:22.188 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.188 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:22.188 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "restful", 2023-07-14T11:18:22.188 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2023-07-14T11:18:22.188 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2023-07-14T11:18:22.188 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2023-07-14T11:18:22.188 INFO:teuthology.orchestra.run.smithi084.stdout: "enable_auth": { 2023-07-14T11:18:22.188 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "enable_auth", 2023-07-14T11:18:22.189 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:22.189 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.189 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:22.189 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:22.189 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.189 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.189 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.189 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.190 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.190 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.190 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.190 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.190 INFO:teuthology.orchestra.run.smithi084.stdout: "key_file": { 2023-07-14T11:18:22.190 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "key_file", 2023-07-14T11:18:22.190 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.191 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.191 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:22.191 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:22.191 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.191 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.191 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.191 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.191 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.192 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.192 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.192 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.192 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2023-07-14T11:18:22.192 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2023-07-14T11:18:22.192 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.192 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.192 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.193 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:22.193 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.193 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.193 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:22.193 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:22.193 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:22.193 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:22.194 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:22.194 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:22.194 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:22.194 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:22.194 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.194 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.194 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.194 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.195 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.195 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2023-07-14T11:18:22.195 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2023-07-14T11:18:22.195 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:22.195 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.195 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.195 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:22.195 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.196 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.196 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.196 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.196 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.196 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.196 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.196 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.196 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2023-07-14T11:18:22.197 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2023-07-14T11:18:22.197 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.197 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.197 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.197 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2023-07-14T11:18:22.197 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.197 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.197 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:22.198 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:22.198 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:22.198 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:22.198 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:22.198 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:22.198 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:22.198 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:22.198 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.199 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.199 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.199 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.199 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.199 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2023-07-14T11:18:22.199 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2023-07-14T11:18:22.199 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:22.200 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.200 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.200 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:22.200 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.200 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.200 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.200 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.200 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.201 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.201 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.201 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.201 INFO:teuthology.orchestra.run.smithi084.stdout: "server_addr": { 2023-07-14T11:18:22.201 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "server_addr", 2023-07-14T11:18:22.201 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.201 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.201 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:22.202 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:22.202 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.202 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.202 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.202 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.202 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.202 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.202 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.203 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.203 INFO:teuthology.orchestra.run.smithi084.stdout: "server_port": { 2023-07-14T11:18:22.203 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "server_port", 2023-07-14T11:18:22.203 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.203 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.203 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:22.203 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:22.203 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.204 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.204 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.204 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.204 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.204 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.204 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.204 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:22.205 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:22.205 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.205 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:22.205 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rgw", 2023-07-14T11:18:22.205 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2023-07-14T11:18:22.205 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2023-07-14T11:18:22.205 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2023-07-14T11:18:22.205 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2023-07-14T11:18:22.206 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2023-07-14T11:18:22.206 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.206 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.206 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.206 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:22.206 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.206 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.206 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:22.207 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:22.207 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:22.207 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:22.207 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:22.207 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:22.207 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:22.207 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:22.207 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.208 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.208 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.208 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.208 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.208 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2023-07-14T11:18:22.208 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2023-07-14T11:18:22.208 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:22.208 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.209 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.209 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:22.209 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.209 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.209 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.209 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.209 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.210 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.210 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.210 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.210 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2023-07-14T11:18:22.210 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2023-07-14T11:18:22.210 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.210 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.210 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.211 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2023-07-14T11:18:22.211 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.211 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.211 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:22.211 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:22.211 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:22.211 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:22.211 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:22.212 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:22.212 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:22.212 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:22.212 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.212 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.212 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.212 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.212 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.213 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2023-07-14T11:18:22.213 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2023-07-14T11:18:22.213 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:22.213 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.213 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.213 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:22.213 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.213 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.214 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.214 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.214 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.214 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.214 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.214 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:22.214 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:22.214 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.215 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:22.215 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rook", 2023-07-14T11:18:22.215 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2023-07-14T11:18:22.215 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2023-07-14T11:18:22.215 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2023-07-14T11:18:22.215 INFO:teuthology.orchestra.run.smithi084.stdout: "drive_group_interval": { 2023-07-14T11:18:22.215 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "drive_group_interval", 2023-07-14T11:18:22.215 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2023-07-14T11:18:22.216 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.216 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:22.216 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "300.0", 2023-07-14T11:18:22.216 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.216 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.216 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.216 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-07-14T11:18:22.217 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.217 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.217 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.217 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.217 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2023-07-14T11:18:22.217 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2023-07-14T11:18:22.217 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.217 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.218 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.218 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:22.218 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.218 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.218 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:22.218 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:22.218 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:22.218 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:22.219 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:22.219 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:22.219 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:22.219 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:22.219 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.219 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.219 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.220 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.220 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.220 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2023-07-14T11:18:22.220 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2023-07-14T11:18:22.220 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:22.220 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.220 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.220 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:22.221 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.221 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.221 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.221 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.221 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.221 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.221 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.221 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.222 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2023-07-14T11:18:22.222 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2023-07-14T11:18:22.222 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.222 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.222 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.222 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2023-07-14T11:18:22.222 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.222 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.223 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:22.223 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:22.223 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:22.223 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:22.223 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:22.223 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:22.223 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:22.223 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:22.224 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.224 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.224 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.224 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.224 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.224 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2023-07-14T11:18:22.224 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2023-07-14T11:18:22.224 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:22.225 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.225 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.225 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:22.225 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.225 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.225 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.225 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.226 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.226 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.226 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.226 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.226 INFO:teuthology.orchestra.run.smithi084.stdout: "storage_class": { 2023-07-14T11:18:22.226 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "storage_class", 2023-07-14T11:18:22.226 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.226 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.227 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:22.227 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "local", 2023-07-14T11:18:22.227 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.227 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.227 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.227 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-07-14T11:18:22.227 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.227 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.228 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.228 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:22.228 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:22.228 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.228 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:22.228 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "selftest", 2023-07-14T11:18:22.228 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2023-07-14T11:18:22.228 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2023-07-14T11:18:22.229 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2023-07-14T11:18:22.229 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2023-07-14T11:18:22.229 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2023-07-14T11:18:22.229 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.229 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.229 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.229 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:22.229 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.230 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.230 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:22.230 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:22.230 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:22.230 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:22.230 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:22.230 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:22.231 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:22.231 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:22.231 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.231 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.231 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.231 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.231 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.231 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2023-07-14T11:18:22.232 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2023-07-14T11:18:22.232 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:22.232 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.232 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.232 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:22.232 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.232 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.232 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.233 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.233 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.233 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.233 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.233 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.233 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2023-07-14T11:18:22.233 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2023-07-14T11:18:22.233 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.234 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.234 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.234 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2023-07-14T11:18:22.234 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.234 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.234 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:22.234 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:22.235 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:22.235 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:22.235 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:22.235 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:22.235 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:22.235 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:22.235 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.235 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.236 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.236 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.236 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.236 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2023-07-14T11:18:22.236 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2023-07-14T11:18:22.236 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:22.236 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.236 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.237 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:22.237 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.237 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.237 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.237 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.237 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.237 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.237 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.238 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.238 INFO:teuthology.orchestra.run.smithi084.stdout: "roption1": { 2023-07-14T11:18:22.238 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "roption1", 2023-07-14T11:18:22.238 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.238 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.238 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:22.238 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:22.239 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.239 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.239 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.239 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.239 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.239 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.239 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.239 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.240 INFO:teuthology.orchestra.run.smithi084.stdout: "roption2": { 2023-07-14T11:18:22.240 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "roption2", 2023-07-14T11:18:22.240 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.240 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.240 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:22.240 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "xyz", 2023-07-14T11:18:22.240 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.240 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.241 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.241 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.241 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.241 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.241 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.241 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.241 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption1": { 2023-07-14T11:18:22.241 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption1", 2023-07-14T11:18:22.242 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.242 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.242 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:22.242 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:22.242 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.242 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.242 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.242 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.243 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.243 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.243 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.243 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.243 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption2": { 2023-07-14T11:18:22.243 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption2", 2023-07-14T11:18:22.243 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2023-07-14T11:18:22.244 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.244 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:22.244 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:22.244 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.244 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.244 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.244 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.244 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.245 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.245 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.245 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.245 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption3": { 2023-07-14T11:18:22.245 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption3", 2023-07-14T11:18:22.245 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2023-07-14T11:18:22.245 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.245 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:22.246 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:22.246 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.246 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.246 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.246 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.246 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.246 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.247 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.247 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.247 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption4": { 2023-07-14T11:18:22.247 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption4", 2023-07-14T11:18:22.247 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.247 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.247 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:22.247 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:22.248 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.248 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.248 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.248 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.248 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.248 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.248 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.248 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.249 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption5": { 2023-07-14T11:18:22.249 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption5", 2023-07-14T11:18:22.249 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:22.249 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.249 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:22.249 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:22.249 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.249 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.250 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.250 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.250 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.250 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.250 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.250 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.250 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption6": { 2023-07-14T11:18:22.250 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption6", 2023-07-14T11:18:22.251 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:22.251 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.251 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:22.251 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:22.251 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.251 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.251 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.252 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.252 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.252 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.252 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.252 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.252 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption7": { 2023-07-14T11:18:22.252 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption7", 2023-07-14T11:18:22.252 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2023-07-14T11:18:22.253 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.253 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:22.253 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:22.253 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "1", 2023-07-14T11:18:22.253 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "42", 2023-07-14T11:18:22.253 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.253 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.253 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.254 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.254 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.254 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.254 INFO:teuthology.orchestra.run.smithi084.stdout: "testkey": { 2023-07-14T11:18:22.254 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "testkey", 2023-07-14T11:18:22.254 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.254 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.254 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:22.255 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:22.255 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.255 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.255 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.255 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.255 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.255 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.255 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.256 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.256 INFO:teuthology.orchestra.run.smithi084.stdout: "testlkey": { 2023-07-14T11:18:22.256 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "testlkey", 2023-07-14T11:18:22.256 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.256 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.256 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:22.256 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:22.257 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.257 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.257 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.257 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.257 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.257 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.257 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.257 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.258 INFO:teuthology.orchestra.run.smithi084.stdout: "testnewline": { 2023-07-14T11:18:22.258 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "testnewline", 2023-07-14T11:18:22.258 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.258 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.258 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:22.258 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:22.258 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.258 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.259 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.259 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.259 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.259 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.259 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.259 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:22.259 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:22.259 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.260 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:22.260 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "snap_schedule", 2023-07-14T11:18:22.260 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2023-07-14T11:18:22.260 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2023-07-14T11:18:22.260 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2023-07-14T11:18:22.260 INFO:teuthology.orchestra.run.smithi084.stdout: "allow_m_granularity": { 2023-07-14T11:18:22.260 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "allow_m_granularity", 2023-07-14T11:18:22.261 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:22.261 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.261 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.261 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:22.261 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.261 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.261 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.261 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "allow minute scheduled snapshots", 2023-07-14T11:18:22.262 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.262 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.262 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.262 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.262 INFO:teuthology.orchestra.run.smithi084.stdout: "dump_on_update": { 2023-07-14T11:18:22.262 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "dump_on_update", 2023-07-14T11:18:22.262 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:22.262 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.263 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.263 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:22.263 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.263 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.263 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.263 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "dump database to debug log on update", 2023-07-14T11:18:22.263 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.263 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.264 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.264 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.264 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2023-07-14T11:18:22.264 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2023-07-14T11:18:22.264 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.264 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.264 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.265 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:22.265 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.265 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.265 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:22.265 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:22.265 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:22.265 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:22.265 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:22.266 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:22.266 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:22.266 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:22.266 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.266 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.266 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.266 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.266 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.267 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2023-07-14T11:18:22.267 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2023-07-14T11:18:22.267 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:22.267 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.267 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.267 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:22.267 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.267 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.268 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.268 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.268 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.268 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.268 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.268 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.268 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2023-07-14T11:18:22.269 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2023-07-14T11:18:22.269 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.269 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.269 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.269 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2023-07-14T11:18:22.269 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.269 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.269 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:22.270 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:22.270 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:22.270 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:22.270 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:22.270 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:22.270 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:22.270 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:22.270 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.271 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.271 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.271 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.271 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.271 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2023-07-14T11:18:22.271 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2023-07-14T11:18:22.271 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:22.271 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.272 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.272 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:22.272 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.272 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.272 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.272 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.272 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.272 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.273 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.273 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:22.273 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:22.273 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.273 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:22.273 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "stats", 2023-07-14T11:18:22.273 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2023-07-14T11:18:22.274 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2023-07-14T11:18:22.274 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2023-07-14T11:18:22.274 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2023-07-14T11:18:22.274 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2023-07-14T11:18:22.274 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.274 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.274 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.274 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:22.275 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.275 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.275 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:22.275 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:22.275 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:22.275 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:22.275 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:22.275 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:22.276 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:22.276 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:22.276 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.276 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.276 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.276 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.276 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.276 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2023-07-14T11:18:22.277 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2023-07-14T11:18:22.277 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:22.277 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.277 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.277 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:22.277 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.277 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.277 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.278 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.278 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.278 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.278 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.278 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.278 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2023-07-14T11:18:22.278 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2023-07-14T11:18:22.278 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.279 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.279 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.279 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2023-07-14T11:18:22.279 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.279 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.279 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:22.279 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:22.279 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:22.280 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:22.280 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:22.280 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:22.280 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:22.280 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:22.280 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.280 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.281 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.281 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.281 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.281 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2023-07-14T11:18:22.281 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2023-07-14T11:18:22.281 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:22.281 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.281 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.282 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:22.282 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.282 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.282 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.282 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.282 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.282 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.282 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.283 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:22.283 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:22.283 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.283 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:22.283 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "status", 2023-07-14T11:18:22.283 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2023-07-14T11:18:22.283 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2023-07-14T11:18:22.283 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2023-07-14T11:18:22.284 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2023-07-14T11:18:22.284 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2023-07-14T11:18:22.284 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.284 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.284 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.284 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:22.284 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.285 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.285 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:22.285 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:22.285 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:22.285 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:22.285 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:22.285 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:22.285 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:22.286 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:22.286 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.286 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.286 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.286 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.286 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.286 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2023-07-14T11:18:22.286 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2023-07-14T11:18:22.287 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:22.287 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.287 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.287 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:22.287 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.287 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.287 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.287 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.288 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.288 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.288 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.288 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.288 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2023-07-14T11:18:22.288 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2023-07-14T11:18:22.288 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.288 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.289 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.289 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2023-07-14T11:18:22.289 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.289 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.289 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:22.289 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:22.289 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:22.289 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:22.290 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:22.290 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:22.290 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:22.290 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:22.290 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.290 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.290 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.291 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.291 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.291 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2023-07-14T11:18:22.291 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2023-07-14T11:18:22.291 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:22.291 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.291 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.291 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:22.292 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.292 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.292 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.292 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.292 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.292 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.292 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.292 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:22.293 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:22.293 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.293 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:22.293 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "telegraf", 2023-07-14T11:18:22.293 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2023-07-14T11:18:22.293 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2023-07-14T11:18:22.293 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2023-07-14T11:18:22.293 INFO:teuthology.orchestra.run.smithi084.stdout: "address": { 2023-07-14T11:18:22.294 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "address", 2023-07-14T11:18:22.294 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.294 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.294 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:22.294 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-07-14T11:18:22.294 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.294 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.294 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.295 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.295 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.295 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.295 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.295 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.295 INFO:teuthology.orchestra.run.smithi084.stdout: "interval": { 2023-07-14T11:18:22.295 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "interval", 2023-07-14T11:18:22.296 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2023-07-14T11:18:22.296 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.296 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:22.296 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "15", 2023-07-14T11:18:22.296 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.296 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.296 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.296 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.297 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.297 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.297 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.297 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.297 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2023-07-14T11:18:22.297 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2023-07-14T11:18:22.297 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.297 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.298 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.298 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:22.298 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.298 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.298 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:22.298 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:22.298 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:22.298 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:22.299 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:22.299 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:22.299 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:22.299 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:22.299 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.299 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.299 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.299 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.300 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.300 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2023-07-14T11:18:22.300 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2023-07-14T11:18:22.300 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:22.300 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.300 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.300 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:22.301 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.301 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.301 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.301 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.301 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.301 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.301 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.301 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.302 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2023-07-14T11:18:22.302 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2023-07-14T11:18:22.302 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.302 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.302 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.302 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2023-07-14T11:18:22.302 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.302 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.303 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:22.303 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:22.303 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:22.303 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:22.303 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:22.303 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:22.303 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:22.303 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:22.304 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.304 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.304 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.304 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.304 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.304 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2023-07-14T11:18:22.304 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2023-07-14T11:18:22.304 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:22.305 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.305 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.305 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:22.305 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.305 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.305 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.305 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.305 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.306 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.306 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.306 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:22.306 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:22.306 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.306 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:22.306 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "telemetry", 2023-07-14T11:18:22.306 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2023-07-14T11:18:22.307 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2023-07-14T11:18:22.307 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2023-07-14T11:18:22.307 INFO:teuthology.orchestra.run.smithi084.stdout: "channel_basic": { 2023-07-14T11:18:22.307 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "channel_basic", 2023-07-14T11:18:22.307 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:22.307 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.307 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:22.307 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:22.308 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.308 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.308 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.308 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Share basic cluster information (size, version)", 2023-07-14T11:18:22.308 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.308 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.308 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.309 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.309 INFO:teuthology.orchestra.run.smithi084.stdout: "channel_crash": { 2023-07-14T11:18:22.309 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "channel_crash", 2023-07-14T11:18:22.309 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:22.309 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.309 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:22.309 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:22.309 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.310 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.310 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.310 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-07-14T11:18:22.310 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.310 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.310 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.310 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.310 INFO:teuthology.orchestra.run.smithi084.stdout: "channel_device": { 2023-07-14T11:18:22.311 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "channel_device", 2023-07-14T11:18:22.311 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:22.311 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.311 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:22.311 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2023-07-14T11:18:22.311 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.311 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.311 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.312 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-07-14T11:18:22.312 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.312 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.312 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.312 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.312 INFO:teuthology.orchestra.run.smithi084.stdout: "channel_ident": { 2023-07-14T11:18:22.312 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "channel_ident", 2023-07-14T11:18:22.313 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:22.313 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.313 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:22.313 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:22.313 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.313 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.313 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.313 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-07-14T11:18:22.314 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.314 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.314 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.314 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.314 INFO:teuthology.orchestra.run.smithi084.stdout: "channel_perf": { 2023-07-14T11:18:22.314 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "channel_perf", 2023-07-14T11:18:22.314 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:22.314 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.315 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:22.315 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:22.315 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.315 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.315 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.315 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Share various performance metrics of a cluster", 2023-07-14T11:18:22.315 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.315 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.316 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.316 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.316 INFO:teuthology.orchestra.run.smithi084.stdout: "contact": { 2023-07-14T11:18:22.316 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "contact", 2023-07-14T11:18:22.316 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.316 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.316 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:22.316 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:22.317 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.317 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.317 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.317 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.317 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.317 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.317 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.317 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.318 INFO:teuthology.orchestra.run.smithi084.stdout: "description": { 2023-07-14T11:18:22.318 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "description", 2023-07-14T11:18:22.318 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.318 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.318 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:22.318 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:22.318 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.318 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.319 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.319 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.319 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.319 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.319 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.319 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.319 INFO:teuthology.orchestra.run.smithi084.stdout: "device_url": { 2023-07-14T11:18:22.320 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "device_url", 2023-07-14T11:18:22.320 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.320 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.320 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:22.320 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-07-14T11:18:22.320 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.320 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.320 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.321 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.321 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.321 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.321 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.321 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.321 INFO:teuthology.orchestra.run.smithi084.stdout: "enabled": { 2023-07-14T11:18:22.321 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "enabled", 2023-07-14T11:18:22.321 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:22.322 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.322 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:22.322 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:22.322 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.322 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.322 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.322 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.322 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.323 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.323 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.323 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.323 INFO:teuthology.orchestra.run.smithi084.stdout: "interval": { 2023-07-14T11:18:22.323 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "interval", 2023-07-14T11:18:22.323 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2023-07-14T11:18:22.323 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.323 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:22.324 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "24", 2023-07-14T11:18:22.324 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "8", 2023-07-14T11:18:22.324 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.324 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.324 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.324 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.324 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.325 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.325 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.325 INFO:teuthology.orchestra.run.smithi084.stdout: "last_opt_revision": { 2023-07-14T11:18:22.325 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "last_opt_revision", 2023-07-14T11:18:22.325 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2023-07-14T11:18:22.325 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.325 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:22.325 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "1", 2023-07-14T11:18:22.326 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.326 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.326 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.326 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.326 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.326 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.326 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.326 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.327 INFO:teuthology.orchestra.run.smithi084.stdout: "leaderboard": { 2023-07-14T11:18:22.327 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "leaderboard", 2023-07-14T11:18:22.327 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:22.327 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.327 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:22.327 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:22.327 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.327 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.328 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.328 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.328 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.328 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.328 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.328 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.328 INFO:teuthology.orchestra.run.smithi084.stdout: "leaderboard_description": { 2023-07-14T11:18:22.328 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "leaderboard_description", 2023-07-14T11:18:22.329 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.329 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.329 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:22.329 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:22.329 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.329 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.329 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.330 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.330 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.330 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.330 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.330 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.330 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2023-07-14T11:18:22.330 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2023-07-14T11:18:22.330 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.331 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.331 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.331 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:22.331 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.331 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.331 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:22.331 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:22.331 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:22.332 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:22.332 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:22.332 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:22.332 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:22.332 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:22.332 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.332 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.332 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.333 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.333 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.333 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2023-07-14T11:18:22.333 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2023-07-14T11:18:22.333 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:22.333 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.333 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.333 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:22.334 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.334 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.334 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.334 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.334 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.334 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.334 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.334 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.335 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2023-07-14T11:18:22.335 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2023-07-14T11:18:22.335 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.335 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.335 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.335 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2023-07-14T11:18:22.335 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.335 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.336 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:22.336 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:22.336 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:22.336 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:22.336 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:22.336 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:22.336 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:22.336 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:22.337 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.337 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.337 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.337 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.337 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.337 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2023-07-14T11:18:22.337 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2023-07-14T11:18:22.337 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:22.338 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.338 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.338 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:22.338 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.338 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.338 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.338 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.338 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.339 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.339 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.339 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.339 INFO:teuthology.orchestra.run.smithi084.stdout: "organization": { 2023-07-14T11:18:22.339 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "organization", 2023-07-14T11:18:22.339 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.339 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.339 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:22.340 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:22.340 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.340 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.340 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.340 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.340 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.340 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.341 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.341 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.341 INFO:teuthology.orchestra.run.smithi084.stdout: "proxy": { 2023-07-14T11:18:22.341 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "proxy", 2023-07-14T11:18:22.341 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.341 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.341 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:22.341 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:22.342 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.342 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.342 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.342 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.342 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.342 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.342 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.342 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.343 INFO:teuthology.orchestra.run.smithi084.stdout: "url": { 2023-07-14T11:18:22.343 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "url", 2023-07-14T11:18:22.343 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.343 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.343 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:22.343 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-07-14T11:18:22.343 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.343 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.344 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.344 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.344 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.344 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.344 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.344 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:22.344 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:22.345 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.345 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:22.345 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "test_orchestrator", 2023-07-14T11:18:22.345 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2023-07-14T11:18:22.345 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2023-07-14T11:18:22.345 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2023-07-14T11:18:22.345 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2023-07-14T11:18:22.345 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2023-07-14T11:18:22.346 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.346 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.346 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.346 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:22.346 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.346 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.346 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:22.346 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:22.347 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:22.347 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:22.347 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:22.347 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:22.347 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:22.347 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:22.347 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.347 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.348 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.348 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.348 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.348 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2023-07-14T11:18:22.348 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2023-07-14T11:18:22.348 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:22.348 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.348 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.349 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:22.349 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.349 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.349 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.349 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.349 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.349 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.350 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.350 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.350 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2023-07-14T11:18:22.350 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2023-07-14T11:18:22.350 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.350 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.350 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.350 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2023-07-14T11:18:22.351 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.351 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.351 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:22.351 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:22.351 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:22.351 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:22.351 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:22.351 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:22.352 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:22.352 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:22.352 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.352 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.352 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.352 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.352 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.352 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2023-07-14T11:18:22.353 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2023-07-14T11:18:22.353 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:22.353 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.353 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.353 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:22.353 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.353 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.353 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.354 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.354 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.354 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.354 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.354 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:22.354 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:22.354 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.354 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:22.355 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "volumes", 2023-07-14T11:18:22.355 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2023-07-14T11:18:22.355 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2023-07-14T11:18:22.355 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2023-07-14T11:18:22.355 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2023-07-14T11:18:22.355 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2023-07-14T11:18:22.355 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.355 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.356 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.356 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:22.356 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.356 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.356 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:22.356 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:22.356 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:22.357 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:22.357 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:22.357 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:22.357 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:22.357 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:22.357 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.357 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.357 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.358 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.358 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.358 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2023-07-14T11:18:22.358 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2023-07-14T11:18:22.358 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:22.358 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.358 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.358 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:22.359 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.359 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.359 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.359 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.359 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.359 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.359 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.359 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.360 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2023-07-14T11:18:22.360 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2023-07-14T11:18:22.360 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.360 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.360 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.360 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2023-07-14T11:18:22.360 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.361 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.361 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:22.361 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:22.361 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:22.361 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:22.361 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:22.361 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:22.361 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:22.362 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:22.362 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.362 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.362 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.362 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.362 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.362 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2023-07-14T11:18:22.362 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2023-07-14T11:18:22.363 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:22.363 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.363 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.363 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:22.363 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.363 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.363 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.363 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.364 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.364 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.364 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.364 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.364 INFO:teuthology.orchestra.run.smithi084.stdout: "max_concurrent_clones": { 2023-07-14T11:18:22.364 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "max_concurrent_clones", 2023-07-14T11:18:22.364 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2023-07-14T11:18:22.364 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.365 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:22.365 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "4", 2023-07-14T11:18:22.365 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.365 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.365 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.365 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Number of asynchronous cloner threads", 2023-07-14T11:18:22.365 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.365 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.366 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.366 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.366 INFO:teuthology.orchestra.run.smithi084.stdout: "snapshot_clone_delay": { 2023-07-14T11:18:22.366 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "snapshot_clone_delay", 2023-07-14T11:18:22.366 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2023-07-14T11:18:22.366 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.366 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:22.366 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2023-07-14T11:18:22.367 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.367 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.367 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.367 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-07-14T11:18:22.367 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.367 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.367 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.367 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:22.368 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:22.368 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.368 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:22.368 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "zabbix", 2023-07-14T11:18:22.368 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2023-07-14T11:18:22.368 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2023-07-14T11:18:22.368 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2023-07-14T11:18:22.369 INFO:teuthology.orchestra.run.smithi084.stdout: "discovery_interval": { 2023-07-14T11:18:22.369 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "discovery_interval", 2023-07-14T11:18:22.369 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "uint", 2023-07-14T11:18:22.369 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.369 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:22.369 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "100", 2023-07-14T11:18:22.369 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.369 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.370 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.370 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.370 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.370 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.370 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.370 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.370 INFO:teuthology.orchestra.run.smithi084.stdout: "identifier": { 2023-07-14T11:18:22.370 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "identifier", 2023-07-14T11:18:22.371 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.371 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.371 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:22.371 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:22.371 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.371 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.371 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.371 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.372 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.372 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.372 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.372 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.372 INFO:teuthology.orchestra.run.smithi084.stdout: "interval": { 2023-07-14T11:18:22.372 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "interval", 2023-07-14T11:18:22.372 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2023-07-14T11:18:22.373 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.373 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:22.373 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "60", 2023-07-14T11:18:22.373 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.373 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.373 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.373 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.373 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.374 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.374 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.374 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.374 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2023-07-14T11:18:22.374 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2023-07-14T11:18:22.374 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.374 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.374 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.375 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:22.375 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.375 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.375 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:22.375 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:22.375 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:22.375 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:22.375 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:22.376 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:22.376 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:22.376 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:22.376 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.376 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.376 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.376 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.377 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.377 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2023-07-14T11:18:22.377 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2023-07-14T11:18:22.377 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:22.377 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.377 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.377 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:22.378 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.378 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.378 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.378 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.378 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.378 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.378 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.378 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.379 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2023-07-14T11:18:22.379 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2023-07-14T11:18:22.379 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.379 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.379 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.379 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2023-07-14T11:18:22.379 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.379 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.380 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2023-07-14T11:18:22.380 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2023-07-14T11:18:22.380 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2023-07-14T11:18:22.380 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2023-07-14T11:18:22.380 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2023-07-14T11:18:22.380 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2023-07-14T11:18:22.380 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2023-07-14T11:18:22.380 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:22.381 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.381 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.381 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.381 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.381 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.381 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2023-07-14T11:18:22.381 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2023-07-14T11:18:22.381 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2023-07-14T11:18:22.382 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.382 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2023-07-14T11:18:22.382 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2023-07-14T11:18:22.382 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.382 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.382 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.382 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.382 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.383 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.383 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.383 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.383 INFO:teuthology.orchestra.run.smithi084.stdout: "zabbix_host": { 2023-07-14T11:18:22.383 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "zabbix_host", 2023-07-14T11:18:22.383 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.383 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.383 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:22.384 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2023-07-14T11:18:22.384 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.384 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.384 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.384 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.384 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.384 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.385 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.385 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.385 INFO:teuthology.orchestra.run.smithi084.stdout: "zabbix_port": { 2023-07-14T11:18:22.385 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "zabbix_port", 2023-07-14T11:18:22.385 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2023-07-14T11:18:22.385 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.385 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:22.385 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10051", 2023-07-14T11:18:22.386 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.386 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.386 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.386 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.386 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.386 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.386 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.386 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.387 INFO:teuthology.orchestra.run.smithi084.stdout: "zabbix_sender": { 2023-07-14T11:18:22.387 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "zabbix_sender", 2023-07-14T11:18:22.387 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2023-07-14T11:18:22.387 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2023-07-14T11:18:22.387 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2023-07-14T11:18:22.387 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-07-14T11:18:22.387 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2023-07-14T11:18:22.387 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2023-07-14T11:18:22.388 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2023-07-14T11:18:22.388 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2023-07-14T11:18:22.388 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2023-07-14T11:18:22.388 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2023-07-14T11:18:22.388 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2023-07-14T11:18:22.388 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:22.388 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:22.389 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:22.389 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:22.389 INFO:teuthology.orchestra.run.smithi084.stdout: "services": {}, 2023-07-14T11:18:22.389 INFO:teuthology.orchestra.run.smithi084.stdout: "always_on_modules": { 2023-07-14T11:18:22.389 INFO:teuthology.orchestra.run.smithi084.stdout: "octopus": [ 2023-07-14T11:18:22.389 INFO:teuthology.orchestra.run.smithi084.stdout: "balancer", 2023-07-14T11:18:22.389 INFO:teuthology.orchestra.run.smithi084.stdout: "crash", 2023-07-14T11:18:22.389 INFO:teuthology.orchestra.run.smithi084.stdout: "devicehealth", 2023-07-14T11:18:22.390 INFO:teuthology.orchestra.run.smithi084.stdout: "orchestrator", 2023-07-14T11:18:22.390 INFO:teuthology.orchestra.run.smithi084.stdout: "pg_autoscaler", 2023-07-14T11:18:22.390 INFO:teuthology.orchestra.run.smithi084.stdout: "progress", 2023-07-14T11:18:22.390 INFO:teuthology.orchestra.run.smithi084.stdout: "rbd_support", 2023-07-14T11:18:22.390 INFO:teuthology.orchestra.run.smithi084.stdout: "status", 2023-07-14T11:18:22.390 INFO:teuthology.orchestra.run.smithi084.stdout: "telemetry", 2023-07-14T11:18:22.390 INFO:teuthology.orchestra.run.smithi084.stdout: "volumes" 2023-07-14T11:18:22.390 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:22.391 INFO:teuthology.orchestra.run.smithi084.stdout: "pacific": [ 2023-07-14T11:18:22.391 INFO:teuthology.orchestra.run.smithi084.stdout: "balancer", 2023-07-14T11:18:22.391 INFO:teuthology.orchestra.run.smithi084.stdout: "crash", 2023-07-14T11:18:22.391 INFO:teuthology.orchestra.run.smithi084.stdout: "devicehealth", 2023-07-14T11:18:22.391 INFO:teuthology.orchestra.run.smithi084.stdout: "orchestrator", 2023-07-14T11:18:22.391 INFO:teuthology.orchestra.run.smithi084.stdout: "pg_autoscaler", 2023-07-14T11:18:22.391 INFO:teuthology.orchestra.run.smithi084.stdout: "progress", 2023-07-14T11:18:22.391 INFO:teuthology.orchestra.run.smithi084.stdout: "rbd_support", 2023-07-14T11:18:22.392 INFO:teuthology.orchestra.run.smithi084.stdout: "status", 2023-07-14T11:18:22.392 INFO:teuthology.orchestra.run.smithi084.stdout: "telemetry", 2023-07-14T11:18:22.392 INFO:teuthology.orchestra.run.smithi084.stdout: "volumes" 2023-07-14T11:18:22.392 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:22.392 INFO:teuthology.orchestra.run.smithi084.stdout: "quincy": [ 2023-07-14T11:18:22.392 INFO:teuthology.orchestra.run.smithi084.stdout: "balancer", 2023-07-14T11:18:22.392 INFO:teuthology.orchestra.run.smithi084.stdout: "crash", 2023-07-14T11:18:22.392 INFO:teuthology.orchestra.run.smithi084.stdout: "devicehealth", 2023-07-14T11:18:22.393 INFO:teuthology.orchestra.run.smithi084.stdout: "orchestrator", 2023-07-14T11:18:22.393 INFO:teuthology.orchestra.run.smithi084.stdout: "pg_autoscaler", 2023-07-14T11:18:22.393 INFO:teuthology.orchestra.run.smithi084.stdout: "progress", 2023-07-14T11:18:22.393 INFO:teuthology.orchestra.run.smithi084.stdout: "rbd_support", 2023-07-14T11:18:22.393 INFO:teuthology.orchestra.run.smithi084.stdout: "status", 2023-07-14T11:18:22.393 INFO:teuthology.orchestra.run.smithi084.stdout: "telemetry", 2023-07-14T11:18:22.393 INFO:teuthology.orchestra.run.smithi084.stdout: "volumes" 2023-07-14T11:18:22.393 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:18:22.394 INFO:teuthology.orchestra.run.smithi084.stdout: "reef": [ 2023-07-14T11:18:22.394 INFO:teuthology.orchestra.run.smithi084.stdout: "balancer", 2023-07-14T11:18:22.394 INFO:teuthology.orchestra.run.smithi084.stdout: "crash", 2023-07-14T11:18:22.394 INFO:teuthology.orchestra.run.smithi084.stdout: "devicehealth", 2023-07-14T11:18:22.394 INFO:teuthology.orchestra.run.smithi084.stdout: "orchestrator", 2023-07-14T11:18:22.394 INFO:teuthology.orchestra.run.smithi084.stdout: "pg_autoscaler", 2023-07-14T11:18:22.394 INFO:teuthology.orchestra.run.smithi084.stdout: "progress", 2023-07-14T11:18:22.395 INFO:teuthology.orchestra.run.smithi084.stdout: "rbd_support", 2023-07-14T11:18:22.395 INFO:teuthology.orchestra.run.smithi084.stdout: "status", 2023-07-14T11:18:22.395 INFO:teuthology.orchestra.run.smithi084.stdout: "telemetry", 2023-07-14T11:18:22.395 INFO:teuthology.orchestra.run.smithi084.stdout: "volumes" 2023-07-14T11:18:22.395 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2023-07-14T11:18:22.395 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.395 INFO:teuthology.orchestra.run.smithi084.stdout: "last_failure_osd_epoch": 0, 2023-07-14T11:18:22.395 INFO:teuthology.orchestra.run.smithi084.stdout: "active_clients": [ 2023-07-14T11:18:22.396 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:22.396 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "devicehealth", 2023-07-14T11:18:22.396 INFO:teuthology.orchestra.run.smithi084.stdout: "addrvec": [ 2023-07-14T11:18:22.396 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:22.396 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v2", 2023-07-14T11:18:22.396 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "172.21.15.84:0", 2023-07-14T11:18:22.396 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 1410429649 2023-07-14T11:18:22.396 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:22.397 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2023-07-14T11:18:22.397 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.397 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:22.397 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "libcephsqlite", 2023-07-14T11:18:22.397 INFO:teuthology.orchestra.run.smithi084.stdout: "addrvec": [ 2023-07-14T11:18:22.397 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:22.397 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v2", 2023-07-14T11:18:22.397 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "172.21.15.84:0", 2023-07-14T11:18:22.398 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 2017899455 2023-07-14T11:18:22.398 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:22.398 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2023-07-14T11:18:22.398 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.398 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:22.398 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rbd_support", 2023-07-14T11:18:22.398 INFO:teuthology.orchestra.run.smithi084.stdout: "addrvec": [ 2023-07-14T11:18:22.398 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:22.399 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v2", 2023-07-14T11:18:22.399 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "172.21.15.84:0", 2023-07-14T11:18:22.399 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 3082191159 2023-07-14T11:18:22.399 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:22.399 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2023-07-14T11:18:22.399 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.399 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:22.399 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "volumes", 2023-07-14T11:18:22.400 INFO:teuthology.orchestra.run.smithi084.stdout: "addrvec": [ 2023-07-14T11:18:22.400 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:22.400 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v2", 2023-07-14T11:18:22.400 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "172.21.15.84:0", 2023-07-14T11:18:22.400 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 1609666652 2023-07-14T11:18:22.400 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:22.400 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2023-07-14T11:18:22.401 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.401 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:22.401 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "volumes", 2023-07-14T11:18:22.401 INFO:teuthology.orchestra.run.smithi084.stdout: "addrvec": [ 2023-07-14T11:18:22.401 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:22.401 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v2", 2023-07-14T11:18:22.401 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "172.21.15.84:0", 2023-07-14T11:18:22.401 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 4142616364 2023-07-14T11:18:22.402 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:22.402 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2023-07-14T11:18:22.402 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.402 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:22.402 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "volumes", 2023-07-14T11:18:22.402 INFO:teuthology.orchestra.run.smithi084.stdout: "addrvec": [ 2023-07-14T11:18:22.402 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:22.402 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v2", 2023-07-14T11:18:22.403 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "172.21.15.84:0", 2023-07-14T11:18:22.403 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 1962247770 2023-07-14T11:18:22.403 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:22.403 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2023-07-14T11:18:22.403 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.403 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:22.403 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "volumes", 2023-07-14T11:18:22.403 INFO:teuthology.orchestra.run.smithi084.stdout: "addrvec": [ 2023-07-14T11:18:22.404 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:22.404 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v2", 2023-07-14T11:18:22.404 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "172.21.15.84:0", 2023-07-14T11:18:22.404 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 2313824978 2023-07-14T11:18:22.404 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:22.404 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2023-07-14T11:18:22.404 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.404 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:22.405 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "volumes", 2023-07-14T11:18:22.405 INFO:teuthology.orchestra.run.smithi084.stdout: "addrvec": [ 2023-07-14T11:18:22.405 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:22.405 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v2", 2023-07-14T11:18:22.405 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "172.21.15.84:0", 2023-07-14T11:18:22.405 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 3621960179 2023-07-14T11:18:22.405 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:22.405 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2023-07-14T11:18:22.406 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.406 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:22.406 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "volumes", 2023-07-14T11:18:22.406 INFO:teuthology.orchestra.run.smithi084.stdout: "addrvec": [ 2023-07-14T11:18:22.406 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:22.406 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v2", 2023-07-14T11:18:22.406 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "172.21.15.84:0", 2023-07-14T11:18:22.406 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 866699477 2023-07-14T11:18:22.407 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:22.407 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2023-07-14T11:18:22.407 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:22.407 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:22.407 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "volumes", 2023-07-14T11:18:22.407 INFO:teuthology.orchestra.run.smithi084.stdout: "addrvec": [ 2023-07-14T11:18:22.407 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:22.408 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v2", 2023-07-14T11:18:22.408 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "172.21.15.84:0", 2023-07-14T11:18:22.408 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 2585793132 2023-07-14T11:18:22.408 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:22.408 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2023-07-14T11:18:22.408 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:22.408 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2023-07-14T11:18:22.408 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-07-14T11:18:22.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.841+0000 7f2b111ff700 1 -- 172.21.15.84:0/104511049 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f2aec06b040 msgr2=0x7f2aec06d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:22.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.841+0000 7f2b111ff700 1 --2- 172.21.15.84:0/104511049 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f2aec06b040 0x7f2aec06d4f0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c1524a0 tx=0x7f2af4010000 comp rx=0 tx=0).stop 2023-07-14T11:18:22.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.841+0000 7f2b111ff700 1 -- 172.21.15.84:0/104511049 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b0c0b1e00 msgr2=0x7f2b0c0c91c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:22.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.842+0000 7f2b111ff700 1 --2- 172.21.15.84:0/104511049 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b0c0b1e00 0x7f2b0c0c91c0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f2afc00ebe0 tx=0x7f2afc009e00 comp rx=0 tx=0).stop 2023-07-14T11:18:22.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.842+0000 7f2b111ff700 1 -- 172.21.15.84:0/104511049 shutdown_connections 2023-07-14T11:18:22.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.842+0000 7f2b111ff700 1 --2- 172.21.15.84:0/104511049 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b0c15c950 0x7f2b0c0cdab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:22.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.842+0000 7f2b111ff700 1 --2- 172.21.15.84:0/104511049 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b0c0b1e00 0x7f2b0c0c91c0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:22.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.842+0000 7f2b111ff700 1 --2- 172.21.15.84:0/104511049 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7f2aec06b040 0x7f2aec06d4f0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:22.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.842+0000 7f2b111ff700 1 --2- 172.21.15.84:0/104511049 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b0c0b2350 0x7f2b0c0cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:22.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.842+0000 7f2b111ff700 1 -- 172.21.15.84:0/104511049 >> 172.21.15.84:0/104511049 conn(0x7f2b0c09c1d0 msgr2=0x7f2b0c06b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:22.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.842+0000 7f2b111ff700 1 -- 172.21.15.84:0/104511049 shutdown_connections 2023-07-14T11:18:22.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:20.842+0000 7f2b111ff700 1 -- 172.21.15.84:0/104511049 wait complete. 2023-07-14T11:18:22.415 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr fail y 2023-07-14T11:18:22.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.618+0000 7fb0879ff700 1 Processor -- start 2023-07-14T11:18:22.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.619+0000 7fb0879ff700 1 -- start start 2023-07-14T11:18:22.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.620+0000 7fb0879ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb0800cf2a0 0x7fb0801673d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:22.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.620+0000 7fb0879ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0800cf720 con 0x7fb0800d1e40 2023-07-14T11:18:22.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.620+0000 7fb0879ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0800cd5a0 con 0x7fb08015c860 2023-07-14T11:18:22.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.620+0000 7fb0879ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb080146740 con 0x7fb0800cf2a0 2023-07-14T11:18:22.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.620+0000 7fb084f9a700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fb0800d1e40 0x7fb0800c71b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48958/0 (socket says 172.21.15.84:48958) 2023-07-14T11:18:22.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.620+0000 7fb084f9a700 1 -- 172.21.15.84:0/3373646796 learned_addr learned my addr 172.21.15.84:0/3373646796 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:18:22.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.620+0000 7fb077fff700 1 -- 172.21.15.84:0/3373646796 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 210676004 0 0) 0x7fb0800cf720 con 0x7fb0800d1e40 2023-07-14T11:18:22.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.621+0000 7fb077fff700 1 -- 172.21.15.84:0/3373646796 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb06c0035b0 con 0x7fb0800d1e40 2023-07-14T11:18:22.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.621+0000 7fb085f9c700 1 --2- 172.21.15.84:0/3373646796 >> v2:172.21.15.179:3300/0 conn(0x7fb0800cf2a0 0x7fb0801673d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:22.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.621+0000 7fb077fff700 1 -- 172.21.15.84:0/3373646796 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 868848994 0 0) 0x7fb06c0035b0 con 0x7fb0800d1e40 2023-07-14T11:18:22.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.621+0000 7fb077fff700 1 -- 172.21.15.84:0/3373646796 >> v2:172.21.15.179:3300/0 conn(0x7fb0800cf2a0 msgr2=0x7fb0801673d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:22.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.621+0000 7fb077fff700 1 --2- 172.21.15.84:0/3373646796 >> v2:172.21.15.179:3300/0 conn(0x7fb0800cf2a0 0x7fb0801673d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:22.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.621+0000 7fb077fff700 1 -- 172.21.15.84:0/3373646796 >> v1:172.21.15.179:6789/0 conn(0x7fb08015c860 legacy=0x7fb0800c6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:22.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.621+0000 7fb077fff700 1 -- 172.21.15.84:0/3373646796 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0800cd7f0 con 0x7fb0800d1e40 2023-07-14T11:18:22.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.621+0000 7fb077fff700 1 -- 172.21.15.84:0/3373646796 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7fb070001670 con 0x7fb0800d1e40 2023-07-14T11:18:22.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.621+0000 7fb077fff700 1 -- 172.21.15.84:0/3373646796 >> v1:172.21.15.84:6789/0 conn(0x7fb0800d1e40 legacy=0x7fb0800c71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:22.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.621+0000 7fb077fff700 1 --2- 172.21.15.84:0/3373646796 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb06c003a00 0x7fb06c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:22.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.621+0000 7fb077fff700 1 --2- 172.21.15.84:0/3373646796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb06c004850 0x7fb06c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:22.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.621+0000 7fb077fff700 1 --2- 172.21.15.84:0/3373646796 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb06c005200 0x7fb06c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:22.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.621+0000 7fb077fff700 1 -- 172.21.15.84:0/3373646796 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb06c00c050 con 0x7fb06c003a00 2023-07-14T11:18:22.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.621+0000 7fb077fff700 1 -- 172.21.15.84:0/3373646796 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb06c00c1c0 con 0x7fb06c004850 2023-07-14T11:18:22.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.621+0000 7fb077fff700 1 -- 172.21.15.84:0/3373646796 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb06c00c380 con 0x7fb06c005200 2023-07-14T11:18:22.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.621+0000 7fb08579b700 1 --2- 172.21.15.84:0/3373646796 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb06c003a00 0x7fb06c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:22.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.621+0000 7fb084f9a700 1 --2- 172.21.15.84:0/3373646796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb06c004850 0x7fb06c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:22.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.622+0000 7fb085f9c700 1 --2- 172.21.15.84:0/3373646796 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb06c005200 0x7fb06c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:22.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.622+0000 7fb08579b700 1 -- 172.21.15.84:0/3373646796 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb06c005200 msgr2=0x7fb06c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:22.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.622+0000 7fb08579b700 1 --2- 172.21.15.84:0/3373646796 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb06c005200 0x7fb06c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:22.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.622+0000 7fb08579b700 1 -- 172.21.15.84:0/3373646796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb06c004850 msgr2=0x7fb06c004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:22.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.622+0000 7fb08579b700 1 --2- 172.21.15.84:0/3373646796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb06c004850 0x7fb06c004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:22.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.622+0000 7fb08579b700 1 -- 172.21.15.84:0/3373646796 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb06c0035b0 con 0x7fb06c003a00 2023-07-14T11:18:22.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.622+0000 7fb084f9a700 1 --2- 172.21.15.84:0/3373646796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb06c004850 0x7fb06c004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:18:22.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.622+0000 7fb085f9c700 1 --2- 172.21.15.84:0/3373646796 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb06c005200 0x7fb06c00ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:18:22.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.622+0000 7fb085f9c700 1 -- 172.21.15.84:0/3373646796 reap_dead start 2023-07-14T11:18:22.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.622+0000 7fb08579b700 1 --2- 172.21.15.84:0/3373646796 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb06c003a00 0x7fb06c003e10 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fb07c0017c0 tx=0x7fb06c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32a68dbfdeaef0c1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:22.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.622+0000 7fb077fff700 1 -- 172.21.15.84:0/3373646796 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07c0052d0 con 0x7fb06c003a00 2023-07-14T11:18:22.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.622+0000 7fb077fff700 1 -- 172.21.15.84:0/3373646796 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb07c005430 con 0x7fb06c003a00 2023-07-14T11:18:22.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.622+0000 7fb077fff700 1 -- 172.21.15.84:0/3373646796 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07c0038c0 con 0x7fb06c003a00 2023-07-14T11:18:22.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.623+0000 7fb0879ff700 1 -- 172.21.15.84:0/3373646796 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb06c003a00 msgr2=0x7fb06c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:22.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.623+0000 7fb0879ff700 1 --2- 172.21.15.84:0/3373646796 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb06c003a00 0x7fb06c003e10 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fb07c0017c0 tx=0x7fb06c005880 comp rx=0 tx=0).stop 2023-07-14T11:18:22.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.623+0000 7fb0879ff700 1 -- 172.21.15.84:0/3373646796 shutdown_connections 2023-07-14T11:18:22.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.623+0000 7fb0879ff700 1 --2- 172.21.15.84:0/3373646796 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb06c003a00 0x7fb06c003e10 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:22.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.623+0000 7fb0879ff700 1 -- 172.21.15.84:0/3373646796 >> 172.21.15.84:0/3373646796 conn(0x7fb080065bd0 msgr2=0x7fb080065fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:22.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.623+0000 7fb0879ff700 1 -- 172.21.15.84:0/3373646796 shutdown_connections 2023-07-14T11:18:22.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.623+0000 7fb0879ff700 1 -- 172.21.15.84:0/3373646796 wait complete. 2023-07-14T11:18:22.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.625+0000 7fb0879ff700 1 Processor -- start 2023-07-14T11:18:22.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.625+0000 7fb0879ff700 1 -- start start 2023-07-14T11:18:22.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.627+0000 7fb0879ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb06c003a00 0x7fb0800b5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:22.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.627+0000 7fb0879ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0801566e0 0x7fb0800b86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:22.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.627+0000 7fb0879ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0800b7400 0x7fb0800cb970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:22.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.627+0000 7fb0879ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0800b6360 con 0x7fb0800b7400 2023-07-14T11:18:22.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.627+0000 7fb0879ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0800b6640 con 0x7fb0801566e0 2023-07-14T11:18:22.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.627+0000 7fb0879ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0800b6920 con 0x7fb06c003a00 2023-07-14T11:18:22.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.627+0000 7fb085f9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0800b7400 0x7fb0800cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:22.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.627+0000 7fb085f9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0800b7400 0x7fb0800cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58662/0 (socket says 172.21.15.84:58662) 2023-07-14T11:18:22.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.627+0000 7fb085f9c700 1 -- 172.21.15.84:0/1674962871 learned_addr learned my addr 172.21.15.84:0/1674962871 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:22.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.627+0000 7fb08579b700 1 --2- 172.21.15.84:0/1674962871 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb06c003a00 0x7fb0800b5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:22.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.627+0000 7fb084f9a700 1 --2- 172.21.15.84:0/1674962871 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0801566e0 0x7fb0800b86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:22.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.627+0000 7fb085f9c700 1 -- 172.21.15.84:0/1674962871 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb06c003a00 msgr2=0x7fb0800b5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:22.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.627+0000 7fb085f9c700 1 --2- 172.21.15.84:0/1674962871 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb06c003a00 0x7fb0800b5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:22.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.627+0000 7fb085f9c700 1 -- 172.21.15.84:0/1674962871 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0801566e0 msgr2=0x7fb0800b86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:22.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.627+0000 7fb085f9c700 1 --2- 172.21.15.84:0/1674962871 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0801566e0 0x7fb0800b86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:22.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.627+0000 7fb085f9c700 1 -- 172.21.15.84:0/1674962871 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0800b6c00 con 0x7fb0800b7400 2023-07-14T11:18:22.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.628+0000 7fb085f9c700 1 --2- 172.21.15.84:0/1674962871 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0800b7400 0x7fb0800cb970 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fb0800720e0 tx=0x7fb0780104a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:22.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.628+0000 7fb075ffb700 1 -- 172.21.15.84:0/1674962871 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07801b070 con 0x7fb0800b7400 2023-07-14T11:18:22.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.628+0000 7fb075ffb700 1 -- 172.21.15.84:0/1674962871 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb07800f040 con 0x7fb0800b7400 2023-07-14T11:18:22.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.628+0000 7fb0879ff700 1 -- 172.21.15.84:0/1674962871 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0800b6ee0 con 0x7fb0800b7400 2023-07-14T11:18:22.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.628+0000 7fb075ffb700 1 -- 172.21.15.84:0/1674962871 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07800e050 con 0x7fb0800b7400 2023-07-14T11:18:22.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.628+0000 7fb0879ff700 1 -- 172.21.15.84:0/1674962871 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0800cbeb0 con 0x7fb0800b7400 2023-07-14T11:18:22.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.629+0000 7fb0879ff700 1 -- 172.21.15.84:0/1674962871 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb080156ab0 con 0x7fb0800b7400 2023-07-14T11:18:22.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.630+0000 7fb075ffb700 1 -- 172.21.15.84:0/1674962871 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 12) v1 ==== 89394+0+0 (secure 0 0 0) 0x7fb078003a20 con 0x7fb0800b7400 2023-07-14T11:18:22.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.631+0000 7fb075ffb700 1 --2- 172.21.15.84:0/1674962871 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fb06406b100 0x7fb06406d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:22.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.631+0000 7fb075ffb700 1 -- 172.21.15.84:0/1674962871 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb078089f50 con 0x7fb0800b7400 2023-07-14T11:18:22.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.631+0000 7fb08579b700 1 --2- 172.21.15.84:0/1674962871 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fb06406b100 0x7fb06406d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:22.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.631+0000 7fb08579b700 1 --2- 172.21.15.84:0/1674962871 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fb06406b100 0x7fb06406d5b0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fb07c000c00 tx=0x7fb07c009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:22.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.635+0000 7fb075ffb700 1 -- 172.21.15.84:0/1674962871 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fb080156ab0 con 0x7fb0800b7400 2023-07-14T11:18:22.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.883+0000 7fb0879ff700 1 -- 172.21.15.84:0/1674962871 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "mgr fail", "who": "y"} v 0) v1 -- 0x7fb080156ab0 con 0x7fb0800b7400 2023-07-14T11:18:22.891 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:18:22.889+0000 7fed85df5700 -1 mgr handle_mgr_map I was active but no longer am 2023-07-14T11:18:22.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.891+0000 7fb075ffb700 1 -- 172.21.15.84:0/1674962871 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mgrmap(e 13) v1 ==== 44470+0+0 (secure 0 0 0) 0x7fb078003cd0 con 0x7fb0800b7400 2023-07-14T11:18:22.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.891+0000 7fb075ffb700 1 -- 172.21.15.84:0/1674962871 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fb06406b100 msgr2=0x7fb06406d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:22.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.891+0000 7fb075ffb700 1 --2- 172.21.15.84:0/1674962871 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fb06406b100 0x7fb06406d5b0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fb07c000c00 tx=0x7fb07c009030 comp rx=0 tx=0).stop 2023-07-14T11:18:22.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.892+0000 7fb075ffb700 1 -- 172.21.15.84:0/1674962871 <== mon.0 v2:172.21.15.84:3300/0 8 ==== mon_command_ack([{"prefix": "mgr fail", "who": "y"}]=0 v13) v1 ==== 68+0+0 (secure 0 0 0) 0x7fb078010da0 con 0x7fb0800b7400 2023-07-14T11:18:22.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.896+0000 7fb0879ff700 1 -- 172.21.15.84:0/1674962871 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0800b7400 msgr2=0x7fb0800cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:22.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.896+0000 7fb0879ff700 1 --2- 172.21.15.84:0/1674962871 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0800b7400 0x7fb0800cb970 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fb0800720e0 tx=0x7fb0780104a0 comp rx=0 tx=0).stop 2023-07-14T11:18:22.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.896+0000 7fb0879ff700 1 -- 172.21.15.84:0/1674962871 shutdown_connections 2023-07-14T11:18:22.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.896+0000 7fb0879ff700 1 --2- 172.21.15.84:0/1674962871 >> [v2:172.21.15.84:6832/379617029,v1:172.21.15.84:6833/379617029] conn(0x7fb06406b100 0x7fb06406d5b0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:22.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.896+0000 7fb0879ff700 1 --2- 172.21.15.84:0/1674962871 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb06c003a00 0x7fb0800b5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:22.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.896+0000 7fb0879ff700 1 --2- 172.21.15.84:0/1674962871 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0800b7400 0x7fb0800cb970 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:22.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.896+0000 7fb0879ff700 1 --2- 172.21.15.84:0/1674962871 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0801566e0 0x7fb0800b86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:22.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.896+0000 7fb0879ff700 1 -- 172.21.15.84:0/1674962871 >> 172.21.15.84:0/1674962871 conn(0x7fb080065bd0 msgr2=0x7fb0800cf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:22.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.896+0000 7fb0879ff700 1 -- 172.21.15.84:0/1674962871 shutdown_connections 2023-07-14T11:18:22.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:22.896+0000 7fb0879ff700 1 -- 172.21.15.84:0/1674962871 wait complete. 2023-07-14T11:18:22.934 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T11:18:23.006 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-07-14T11:18:23.004+0000 7f8e2c0ca700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T11:18:23.007 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-07-14T11:18:23.004+0000 7f8e2c0ca700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T11:18:23.007 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-07-14T11:18:23.004+0000 7f8e2c0ca700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T11:18:23.007 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-07-14T11:18:23.004+0000 7f8e2c0ca700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T11:18:23.007 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-07-14T11:18:23.004+0000 7f8e2c0ca700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T11:18:23.007 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-07-14T11:18:23.005+0000 7f8e280c2700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T11:18:23.008 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-07-14T11:18:23.005+0000 7f8e280c2700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T11:18:23.008 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-07-14T11:18:23.005+0000 7f8e280c2700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T11:18:23.008 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-07-14T11:18:23.005+0000 7f8e280c2700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T11:18:23.008 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-07-14T11:18:23.005+0000 7f8e280c2700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T11:18:23.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:23.153+0000 7f499fbff700 1 Processor -- start 2023-07-14T11:18:23.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:23.153+0000 7f499fbff700 1 -- start start 2023-07-14T11:18:23.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:23.154+0000 7f499fbff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f49981597c0 0x7f4998159c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:23.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:23.155+0000 7f499fbff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f49980cea50 0x7f49980ceeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:23.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:23.155+0000 7f499fbff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49980cdf90 con 0x7f49981500d0 2023-07-14T11:18:23.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:23.155+0000 7f499fbff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f499815a2f0 con 0x7f49981597c0 2023-07-14T11:18:23.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:23.155+0000 7f499fbff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f499815a5d0 con 0x7f49980cea50 2023-07-14T11:18:23.158 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:18:23.155+0000 7fdddc059200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-14T11:18:23.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:23.155+0000 7f499d19a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f49981597c0 0x7f4998159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:23.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:23.155+0000 7f499d99b700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f49981500d0 0x7f4998070350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.84:49800/0 (socket says 172.21.15.84:49800) 2023-07-14T11:18:23.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:23.155+0000 7f499d99b700 1 -- 172.21.15.84:0/1559673935 learned_addr learned my addr 172.21.15.84:0/1559673935 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:18:23.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:23.155+0000 7f499e19c700 1 --2- 172.21.15.84:0/1559673935 >> v2:172.21.15.179:3300/0 conn(0x7f49980cea50 0x7f49980ceeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:23.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:23.155+0000 7f499d19a700 1 -- 172.21.15.84:0/1559673935 >> v2:172.21.15.179:3300/0 conn(0x7f49980cea50 msgr2=0x7f49980ceeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:23.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:23.155+0000 7f499d19a700 1 --2- 172.21.15.84:0/1559673935 >> v2:172.21.15.179:3300/0 conn(0x7f49980cea50 0x7f49980ceeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:23.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:23.155+0000 7f499d19a700 1 -- 172.21.15.84:0/1559673935 >> v1:172.21.15.179:6789/0 conn(0x7f49981500d0 legacy=0x7f4998070350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:23.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:23.155+0000 7f499d19a700 1 -- 172.21.15.84:0/1559673935 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49980ce250 con 0x7f49981597c0 2023-07-14T11:18:23.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:23.156+0000 7f499d19a700 1 --2- 172.21.15.84:0/1559673935 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49981597c0 0x7f4998159c60 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f49980b3c40 tx=0x7f498c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99cb32b56fb1f243 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:23.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:23.156+0000 7f499c999700 1 -- 172.21.15.84:0/1559673935 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498c011830 con 0x7f49981597c0 2023-07-14T11:18:23.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:23.156+0000 7f499c999700 1 -- 172.21.15.84:0/1559673935 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f498c011990 con 0x7f49981597c0 2023-07-14T11:18:23.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:23.156+0000 7f499c999700 1 -- 172.21.15.84:0/1559673935 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498c011d20 con 0x7f49981597c0 2023-07-14T11:18:23.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:23.156+0000 7f499fbff700 1 -- 172.21.15.84:0/1559673935 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49981597c0 msgr2=0x7f4998159c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:23.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:23.156+0000 7f499fbff700 1 --2- 172.21.15.84:0/1559673935 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49981597c0 0x7f4998159c60 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f49980b3c40 tx=0x7f498c009b20 comp rx=0 tx=0).stop 2023-07-14T11:18:23.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:23.157+0000 7f499fbff700 1 -- 172.21.15.84:0/1559673935 shutdown_connections 2023-07-14T11:18:23.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:23.157+0000 7f499fbff700 1 --2- 172.21.15.84:0/1559673935 >> v2:172.21.15.179:3300/0 conn(0x7f49980cea50 0x7f49980ceeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:23.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:23.157+0000 7f499fbff700 1 --2- 172.21.15.84:0/1559673935 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49981597c0 0x7f4998159c60 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:23.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:23.157+0000 7f499fbff700 1 -- 172.21.15.84:0/1559673935 >> 172.21.15.84:0/1559673935 conn(0x7f4998069f30 msgr2=0x7f499806a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:23.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:23.157+0000 7f499fbff700 1 -- 172.21.15.84:0/1559673935 shutdown_connections 2023-07-14T11:18:23.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:23.157+0000 7f499fbff700 1 -- 172.21.15.84:0/1559673935 wait complete. 2023-07-14T11:18:23.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:23.158+0000 7f499fbff700 1 Processor -- start 2023-07-14T11:18:23.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:23.159+0000 7f499fbff700 1 -- start start 2023-07-14T11:18:23.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:23.159+0000 7f499fbff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49980cea50 0x7f49981f2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:23.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:23.159+0000 7f499fbff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49981500d0 0x7f49981481e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:23.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:23.159+0000 7f499fbff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49981597c0 0x7f49981516a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:23.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:23.159+0000 7f499fbff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f499814ce50 con 0x7f49980cea50 2023-07-14T11:18:23.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:23.159+0000 7f499fbff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f499814d130 con 0x7f49981597c0 2023-07-14T11:18:23.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:23.159+0000 7f499fbff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49981f2160 con 0x7f49981500d0 2023-07-14T11:18:23.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:23.160+0000 7f499d99b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49980cea50 0x7f49981f2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:23.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:23.160+0000 7f499d99b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49980cea50 0x7f49981f2960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58686/0 (socket says 172.21.15.84:58686) 2023-07-14T11:18:23.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:23.160+0000 7f499d99b700 1 -- 172.21.15.84:0/33104481 learned_addr learned my addr 172.21.15.84:0/33104481 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:23.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:23.160+0000 7f499e19c700 1 --2- 172.21.15.84:0/33104481 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49981597c0 0x7f49981516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:23.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:23.160+0000 7f499d19a700 1 --2- 172.21.15.84:0/33104481 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49981500d0 0x7f49981481e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:23.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:23.160+0000 7f499d99b700 1 -- 172.21.15.84:0/33104481 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49981500d0 msgr2=0x7f49981481e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:23.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:23.160+0000 7f499d99b700 1 --2- 172.21.15.84:0/33104481 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49981500d0 0x7f49981481e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:23.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:23.160+0000 7f499d99b700 1 -- 172.21.15.84:0/33104481 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49981597c0 msgr2=0x7f49981516a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:23.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:23.160+0000 7f499d99b700 1 --2- 172.21.15.84:0/33104481 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49981597c0 0x7f49981516a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:23.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:23.160+0000 7f499d99b700 1 -- 172.21.15.84:0/33104481 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f498c0094a0 con 0x7f49980cea50 2023-07-14T11:18:23.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:23.160+0000 7f499d99b700 1 --2- 172.21.15.84:0/33104481 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49980cea50 0x7f49981f2960 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f498800cba0 tx=0x7f498800ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:23.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:23.161+0000 7f49967fc700 1 -- 172.21.15.84:0/33104481 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498800aaa0 con 0x7f49980cea50 2023-07-14T11:18:23.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:23.161+0000 7f49967fc700 1 -- 172.21.15.84:0/33104481 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f498800ac00 con 0x7f49980cea50 2023-07-14T11:18:23.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:23.161+0000 7f49967fc700 1 -- 172.21.15.84:0/33104481 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4988012400 con 0x7f49980cea50 2023-07-14T11:18:23.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:23.161+0000 7f499fbff700 1 -- 172.21.15.84:0/33104481 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49981f2440 con 0x7f49980cea50 2023-07-14T11:18:23.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:23.161+0000 7f499fbff700 1 -- 172.21.15.84:0/33104481 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49981f2ea0 con 0x7f49980cea50 2023-07-14T11:18:23.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:23.162+0000 7f49967fc700 1 -- 172.21.15.84:0/33104481 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 13) v1 ==== 44470+0+0 (secure 0 0 0) 0x7f498801b3b0 con 0x7f49980cea50 2023-07-14T11:18:23.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:23.162+0000 7f499fbff700 1 -- 172.21.15.84:0/33104481 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f499804e280 con 0x7f49980cea50 2023-07-14T11:18:23.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:23.163+0000 7f49967fc700 1 -- 172.21.15.84:0/33104481 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6621+0+0 (secure 0 0 0) 0x7f498804a490 con 0x7f49980cea50 2023-07-14T11:18:23.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:23.167+0000 7f49967fc700 1 -- 172.21.15.84:0/33104481 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f49880192c0 con 0x7f49980cea50 2023-07-14T11:18:23.360 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:18:23.357+0000 7fdddc059200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-14T11:18:23.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:23.450+0000 7f499fbff700 1 -- 172.21.15.84:0/33104481 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4998070130 con 0x7f49980cea50 2023-07-14T11:18:23.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:23.451+0000 7f49967fc700 1 -- 172.21.15.84:0/33104481 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4717 (secure 0 0 0) 0x7f4988017090 con 0x7f49980cea50 2023-07-14T11:18:23.453 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:18:23.453 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":46,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5615,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3014145470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3014145470},{"type":"v1","addr":"172.21.15.179:6834","nonce":3014145470}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":5621,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3377004712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":3377004712},{"type":"v1","addr":"172.21.15.179:6835","nonce":3377004712}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":6681,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1864489758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1864489758},{"type":"v1","addr":"172.21.15.84:6835","nonce":1864489758}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T11:17:55.741927+0000","modified":"2023-07-14T11:17:59.277009+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6690},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6690":{"gid":6690,"name":"c","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/2405785300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":2405785300},{"type":"v1","addr":"172.21.15.84:6837","nonce":2405785300}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-07-14T11:18:23.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:23.453+0000 7f499fbff700 1 -- 172.21.15.84:0/33104481 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49980cea50 msgr2=0x7f49981f2960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:23.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:23.453+0000 7f499fbff700 1 --2- 172.21.15.84:0/33104481 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49980cea50 0x7f49981f2960 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f498800cba0 tx=0x7f498800ceb0 comp rx=0 tx=0).stop 2023-07-14T11:18:23.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:23.453+0000 7f499fbff700 1 -- 172.21.15.84:0/33104481 shutdown_connections 2023-07-14T11:18:23.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:23.453+0000 7f499fbff700 1 --2- 172.21.15.84:0/33104481 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49981597c0 0x7f49981516a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:23.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:23.453+0000 7f499fbff700 1 --2- 172.21.15.84:0/33104481 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49980cea50 0x7f49981f2960 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:23.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:23.453+0000 7f499fbff700 1 --2- 172.21.15.84:0/33104481 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49981500d0 0x7f49981481e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:23.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:23.453+0000 7f499fbff700 1 -- 172.21.15.84:0/33104481 >> 172.21.15.84:0/33104481 conn(0x7f4998069f30 msgr2=0x7f499806cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:23.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:23.453+0000 7f499fbff700 1 -- 172.21.15.84:0/33104481 shutdown_connections 2023-07-14T11:18:23.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:23.453+0000 7f499fbff700 1 -- 172.21.15.84:0/33104481 wait complete. 2023-07-14T11:18:23.457 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 46 2023-07-14T11:18:23.474 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2023-07-14T11:18:23.699 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:18:23.697+0000 7fdddc059200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-14T11:18:23.705 INFO:teuthology.orchestra.run.smithi084.stdout:[{"id":5834,"entity":{"name":{"type":"client","num":5834},"addr":{"type":"any","addr":"172.21.15.179:0","nonce":134136373}},"state":"open","num_leases":0,"num_caps":2,"request_load_avg":2,"uptime":0.67698762999999995,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":1.9969040873602912,"halflife":300},"cap_acquisition":{"value":0,"halflife":10},"last_trim_completed_requests_tid":2,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5834 172.21.15.179:0/134136373","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x00000000000fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"3fc0089cc1082313a98853d48b892acdc1385b8b","ceph_version":"ceph version 18.0.0-4757-g3fc0089c (3fc0089cc1082313a98853d48b892acdc1385b8b) reef (dev)","entity_id":"x","hostname":"smithi179","pid":"111787","root":"/"}},{"id":6565,"entity":{"name":{"type":"client","num":6565},"addr":{"type":"any","addr":"172.21.15.179:0","nonce":1276915320}},"state":"open","num_leases":0,"num_caps":2,"request_load_avg":2,"uptime":0.67798761200000002,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":1.9969040873602912,"halflife":300},"cap_acquisition":{"value":0,"halflife":10},"last_trim_completed_requests_tid":2,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.6565 172.21.15.179:0/1276915320","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x00000000000fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"3fc0089cc1082313a98853d48b892acdc1385b8b","ceph_version":"ceph version 18.0.0-4757-g3fc0089c (3fc0089cc1082313a98853d48b892acdc1385b8b) reef (dev)","entity_id":"x","hostname":"smithi179","pid":"111787","root":"/"}}] 2023-07-14T11:18:23.705 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 10, "value": 0 }, "client_metadata": { "ceph_sha1": "3fc0089cc1082313a98853d48b892acdc1385b8b", "ceph_version": "ceph version 18.0.0-4757-g3fc0089c (3fc0089cc1082313a98853d48b892acdc1385b8b) reef (dev)", "client_features": { "feature_bits": "0x00000000000fffff" }, "entity_id": "x", "hostname": "smithi179", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "111787", "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "172.21.15.179:0", "nonce": 134136373, "type": "any" }, "name": { "num": 5834, "type": "client" } }, "id": 5834, "inst": "client.5834 172.21.15.179:0/134136373", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 2, "num_caps": 2, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 2, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 1.9969040873602912 }, "state": "open", "uptime": 0.67698763 }, { "cap_acquisition": { "halflife": 10, "value": 0 }, "client_metadata": { "ceph_sha1": "3fc0089cc1082313a98853d48b892acdc1385b8b", "ceph_version": "ceph version 18.0.0-4757-g3fc0089c (3fc0089cc1082313a98853d48b892acdc1385b8b) reef (dev)", "client_features": { "feature_bits": "0x00000000000fffff" }, "entity_id": "x", "hostname": "smithi179", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "111787", "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "172.21.15.179:0", "nonce": 1276915320, "type": "any" }, "name": { "num": 6565, "type": "client" } }, "id": 6565, "inst": "client.6565 172.21.15.179:0/1276915320", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 2, "num_caps": 2, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 2, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 1.9969040873602912 }, "state": "open", "uptime": 0.677987612 } ] 2023-07-14T11:18:23.706 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-07-14T11:18:23.706 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-14T11:18:23.706 DEBUG:teuthology.orchestra.run.smithi084:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-14T11:18:23.819 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-14T11:18:23.929 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-14T11:18:23.930 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-14T11:18:23.930 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:18:23.979 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345568k,nr_inodes=4086392,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=35,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275008k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-07-14T11:18:23.980 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-07-14T11:18:23.980 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:18:24.027 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345528k,nr_inodes=4086382,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=40,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275000k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-07-14T11:18:24.028 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-14T11:18:24.028 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:18:24.079 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345568k,nr_inodes=4086392,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=35,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275008k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-07-14T11:18:24.080 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-07-14T11:18:24.080 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:18:24.126 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345528k,nr_inodes=4086382,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=40,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275000k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-07-14T11:18:24.126 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T11:18:24.258 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:18:24.256+0000 7fdddc059200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-14T11:18:24.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.327+0000 7f2cc23ff700 1 Processor -- start 2023-07-14T11:18:24.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.328+0000 7f2cc23ff700 1 -- start start 2023-07-14T11:18:24.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.329+0000 7f2cc23ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2cbc0b3e90 0x7f2cbc0cee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:24.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.329+0000 7f2cc23ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2cbc15a8c0 0x7f2cbc15ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:24.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.329+0000 7f2cc23ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cbc0ce110 con 0x7f2cbc15e890 2023-07-14T11:18:24.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.329+0000 7f2cc23ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cbc0cf380 con 0x7f2cbc0b3e90 2023-07-14T11:18:24.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.329+0000 7f2cc23ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cbc15b660 con 0x7f2cbc15a8c0 2023-07-14T11:18:24.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.329+0000 7f2cbb7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2cbc0b3e90 0x7f2cbc0cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:24.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.329+0000 7f2cbb7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2cbc0b3e90 0x7f2cbc0cee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58688/0 (socket says 172.21.15.84:58688) 2023-07-14T11:18:24.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.329+0000 7f2cbbfff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f2cbc15e890 0x7f2cbc0b3780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48976/0 (socket says 172.21.15.84:48976) 2023-07-14T11:18:24.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.329+0000 7f2cbb7fe700 1 -- 172.21.15.84:0/15959730 learned_addr learned my addr 172.21.15.84:0/15959730 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:24.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.330+0000 7f2cc099c700 1 --2- 172.21.15.84:0/15959730 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2cbc15a8c0 0x7f2cbc15ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:24.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.330+0000 7f2cbb7fe700 1 -- 172.21.15.84:0/15959730 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2cbc15a8c0 msgr2=0x7f2cbc15ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:24.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.330+0000 7f2cbb7fe700 1 --2- 172.21.15.84:0/15959730 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2cbc15a8c0 0x7f2cbc15ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:24.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.330+0000 7f2cbb7fe700 1 -- 172.21.15.84:0/15959730 >> v1:172.21.15.84:6789/0 conn(0x7f2cbc15e890 legacy=0x7f2cbc0b3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:24.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.330+0000 7f2cbb7fe700 1 -- 172.21.15.84:0/15959730 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cbc0ce360 con 0x7f2cbc0b3e90 2023-07-14T11:18:24.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.330+0000 7f2cbaffd700 1 -- 172.21.15.84:0/15959730 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3532617747 0 0) 0x7f2cbc0ce110 con 0x7f2cbc15e890 2023-07-14T11:18:24.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.330+0000 7f2cbb7fe700 1 --2- 172.21.15.84:0/15959730 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cbc0b3e90 0x7f2cbc0cee40 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f2cb00098f0 tx=0x7f2cb0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=118cb98c95a0dbc4 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:24.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.330+0000 7f2cbaffd700 1 -- 172.21.15.84:0/15959730 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb000b8a0 con 0x7f2cbc0b3e90 2023-07-14T11:18:24.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.330+0000 7f2cbaffd700 1 -- 172.21.15.84:0/15959730 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cb000ba00 con 0x7f2cbc0b3e90 2023-07-14T11:18:24.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.330+0000 7f2cbaffd700 1 -- 172.21.15.84:0/15959730 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb000bd90 con 0x7f2cbc0b3e90 2023-07-14T11:18:24.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.331+0000 7f2cc23ff700 1 -- 172.21.15.84:0/15959730 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cbc0b3e90 msgr2=0x7f2cbc0cee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:24.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.331+0000 7f2cc23ff700 1 --2- 172.21.15.84:0/15959730 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cbc0b3e90 0x7f2cbc0cee40 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f2cb00098f0 tx=0x7f2cb0009c00 comp rx=0 tx=0).stop 2023-07-14T11:18:24.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.331+0000 7f2cc23ff700 1 -- 172.21.15.84:0/15959730 shutdown_connections 2023-07-14T11:18:24.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.331+0000 7f2cc23ff700 1 --2- 172.21.15.84:0/15959730 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2cbc15a8c0 0x7f2cbc15ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:24.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.331+0000 7f2cc23ff700 1 --2- 172.21.15.84:0/15959730 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cbc0b3e90 0x7f2cbc0cee40 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:24.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.331+0000 7f2cc23ff700 1 -- 172.21.15.84:0/15959730 >> 172.21.15.84:0/15959730 conn(0x7f2cbc069f30 msgr2=0x7f2cbc06a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:24.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.331+0000 7f2cc23ff700 1 -- 172.21.15.84:0/15959730 shutdown_connections 2023-07-14T11:18:24.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.331+0000 7f2cc23ff700 1 -- 172.21.15.84:0/15959730 wait complete. 2023-07-14T11:18:24.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.334+0000 7f2cc23ff700 1 Processor -- start 2023-07-14T11:18:24.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.334+0000 7f2cc23ff700 1 -- start start 2023-07-14T11:18:24.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.335+0000 7f2cc23ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cbc0b3e90 0x7f2cbc14c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:24.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.335+0000 7f2cc23ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2cbc15a8c0 0x7f2cbc14ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:24.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.335+0000 7f2cc23ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2cbc15e890 0x7f2cbc13f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:24.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.335+0000 7f2cc23ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cbc1504e0 con 0x7f2cbc0b3e90 2023-07-14T11:18:24.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.335+0000 7f2cc23ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cbc153370 con 0x7f2cbc15e890 2023-07-14T11:18:24.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.335+0000 7f2cc23ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cbc153650 con 0x7f2cbc15a8c0 2023-07-14T11:18:24.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.335+0000 7f2cbbfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cbc0b3e90 0x7f2cbc14c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:24.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.335+0000 7f2cbbfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cbc0b3e90 0x7f2cbc14c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58700/0 (socket says 172.21.15.84:58700) 2023-07-14T11:18:24.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.335+0000 7f2cbbfff700 1 -- 172.21.15.84:0/2519407243 learned_addr learned my addr 172.21.15.84:0/2519407243 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:24.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.335+0000 7f2cbb7fe700 1 --2- 172.21.15.84:0/2519407243 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2cbc15a8c0 0x7f2cbc14ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:24.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.336+0000 7f2cc099c700 1 --2- 172.21.15.84:0/2519407243 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2cbc15e890 0x7f2cbc13f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:24.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.336+0000 7f2cbbfff700 1 -- 172.21.15.84:0/2519407243 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2cbc15a8c0 msgr2=0x7f2cbc14ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:24.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.336+0000 7f2cbbfff700 1 --2- 172.21.15.84:0/2519407243 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2cbc15a8c0 0x7f2cbc14ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:24.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.336+0000 7f2cbbfff700 1 -- 172.21.15.84:0/2519407243 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2cbc15e890 msgr2=0x7f2cbc13f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:24.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.336+0000 7f2cbbfff700 1 --2- 172.21.15.84:0/2519407243 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2cbc15e890 0x7f2cbc13f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:24.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.336+0000 7f2cbbfff700 1 -- 172.21.15.84:0/2519407243 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb0009550 con 0x7f2cbc0b3e90 2023-07-14T11:18:24.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.336+0000 7f2cbbfff700 1 --2- 172.21.15.84:0/2519407243 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cbc0b3e90 0x7f2cbc14c8c0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f2cac00c550 tx=0x7f2cac00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:24.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.336+0000 7f2cb8ff9700 1 -- 172.21.15.84:0/2519407243 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cac004c80 con 0x7f2cbc0b3e90 2023-07-14T11:18:24.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.336+0000 7f2cb8ff9700 1 -- 172.21.15.84:0/2519407243 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cac004e00 con 0x7f2cbc0b3e90 2023-07-14T11:18:24.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.336+0000 7f2cc23ff700 1 -- 172.21.15.84:0/2519407243 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cbc153930 con 0x7f2cbc0b3e90 2023-07-14T11:18:24.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.336+0000 7f2cb8ff9700 1 -- 172.21.15.84:0/2519407243 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cac007310 con 0x7f2cbc0b3e90 2023-07-14T11:18:24.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.337+0000 7f2cc23ff700 1 -- 172.21.15.84:0/2519407243 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cbc14f7a0 con 0x7f2cbc0b3e90 2023-07-14T11:18:24.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.338+0000 7f2cc23ff700 1 -- 172.21.15.84:0/2519407243 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cbc04e280 con 0x7f2cbc0b3e90 2023-07-14T11:18:24.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.338+0000 7f2cb8ff9700 1 -- 172.21.15.84:0/2519407243 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 14) v1 ==== 44597+0+0 (secure 0 0 0) 0x7f2cac007470 con 0x7f2cbc0b3e90 2023-07-14T11:18:24.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.339+0000 7f2cb8ff9700 1 --2- 172.21.15.84:0/2519407243 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f2ca8037730 0x7f2ca8039be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:24.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.339+0000 7f2cb8ff9700 1 -- 172.21.15.84:0/2519407243 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6621+0+0 (secure 0 0 0) 0x7f2cac04a590 con 0x7f2cbc0b3e90 2023-07-14T11:18:24.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.339+0000 7f2cbb7fe700 1 --2- 172.21.15.84:0/2519407243 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f2ca8037730 0x7f2ca8039be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:24.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.340+0000 7f2cbb7fe700 1 --2- 172.21.15.84:0/2519407243 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f2ca8037730 0x7f2ca8039be0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc0b4280 tx=0x7f2cb0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:24.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.344+0000 7f2cb8ff9700 1 -- 172.21.15.84:0/2519407243 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f2cac0133c0 con 0x7f2cbc0b3e90 2023-07-14T11:18:24.452 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:18:24.450+0000 7fdddc059200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-07-14T11:18:24.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.602+0000 7f2cc23ff700 1 -- 172.21.15.84:0/2519407243 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2cbc154110 con 0x7f2cbc0b3e90 2023-07-14T11:18:24.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.603+0000 7f2cb8ff9700 1 -- 172.21.15.84:0/2519407243 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4717 (secure 0 0 0) 0x7f2cac011360 con 0x7f2cbc0b3e90 2023-07-14T11:18:24.606 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:18:24.606 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":46,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5615,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3014145470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3014145470},{"type":"v1","addr":"172.21.15.179:6834","nonce":3014145470}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":5621,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3377004712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":3377004712},{"type":"v1","addr":"172.21.15.179:6835","nonce":3377004712}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":6681,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1864489758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1864489758},{"type":"v1","addr":"172.21.15.84:6835","nonce":1864489758}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T11:17:55.741927+0000","modified":"2023-07-14T11:17:59.277009+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6690},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6690":{"gid":6690,"name":"c","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/2405785300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":2405785300},{"type":"v1","addr":"172.21.15.84:6837","nonce":2405785300}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-07-14T11:18:24.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.605+0000 7f2cc23ff700 1 -- 172.21.15.84:0/2519407243 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f2ca8037730 msgr2=0x7f2ca8039be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:24.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.605+0000 7f2cc23ff700 1 --2- 172.21.15.84:0/2519407243 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f2ca8037730 0x7f2ca8039be0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc0b4280 tx=0x7f2cb0008030 comp rx=0 tx=0).stop 2023-07-14T11:18:24.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.605+0000 7f2cc23ff700 1 -- 172.21.15.84:0/2519407243 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cbc0b3e90 msgr2=0x7f2cbc14c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:24.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.605+0000 7f2cc23ff700 1 --2- 172.21.15.84:0/2519407243 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cbc0b3e90 0x7f2cbc14c8c0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f2cac00c550 tx=0x7f2cac00c860 comp rx=0 tx=0).stop 2023-07-14T11:18:24.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.606+0000 7f2cc23ff700 1 -- 172.21.15.84:0/2519407243 shutdown_connections 2023-07-14T11:18:24.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.606+0000 7f2cc23ff700 1 --2- 172.21.15.84:0/2519407243 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2cbc15e890 0x7f2cbc13f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:24.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.606+0000 7f2cc23ff700 1 --2- 172.21.15.84:0/2519407243 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cbc0b3e90 0x7f2cbc14c8c0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:24.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.606+0000 7f2cc23ff700 1 --2- 172.21.15.84:0/2519407243 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f2ca8037730 0x7f2ca8039be0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:24.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.606+0000 7f2cc23ff700 1 --2- 172.21.15.84:0/2519407243 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2cbc15a8c0 0x7f2cbc14ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:24.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.606+0000 7f2cc23ff700 1 -- 172.21.15.84:0/2519407243 >> 172.21.15.84:0/2519407243 conn(0x7f2cbc069f30 msgr2=0x7f2cbc072f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:24.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.606+0000 7f2cc23ff700 1 -- 172.21.15.84:0/2519407243 shutdown_connections 2023-07-14T11:18:24.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.606+0000 7f2cc23ff700 1 -- 172.21.15.84:0/2519407243 wait complete. 2023-07-14T11:18:24.610 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 46 2023-07-14T11:18:24.626 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:18:24.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.824+0000 7f9b09fff700 1 Processor -- start 2023-07-14T11:18:24.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.824+0000 7f9b09fff700 1 -- start start 2023-07-14T11:18:24.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.826+0000 7f9b09fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9b040ce840 0x7f9b040cec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:24.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.826+0000 7f9b09fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9b040d0830 0x7f9b040d0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:24.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.826+0000 7f9b09fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b040cf1d0 con 0x7f9b0415ca30 2023-07-14T11:18:24.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.826+0000 7f9b09fff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b0406cf00 con 0x7f9b040d0830 2023-07-14T11:18:24.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.827+0000 7f9b09fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b0406c360 con 0x7f9b040ce840 2023-07-14T11:18:24.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.827+0000 7f9b03fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9b040d0830 0x7f9b040d0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:24.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.827+0000 7f9b037fe700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f9b0415ca30 0x7f9b0406c7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.84:49814/0 (socket says 172.21.15.84:49814) 2023-07-14T11:18:24.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.827+0000 7f9b037fe700 1 -- 172.21.15.84:0/1969599454 learned_addr learned my addr 172.21.15.84:0/1969599454 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:18:24.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.827+0000 7f9afbfff700 1 --2- 172.21.15.84:0/1969599454 >> v2:172.21.15.179:3300/0 conn(0x7f9b040ce840 0x7f9b040cec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:24.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.827+0000 7f9b03fff700 1 -- 172.21.15.84:0/1969599454 >> v2:172.21.15.179:3300/0 conn(0x7f9b040ce840 msgr2=0x7f9b040cec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:24.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.827+0000 7f9b03fff700 1 --2- 172.21.15.84:0/1969599454 >> v2:172.21.15.179:3300/0 conn(0x7f9b040ce840 0x7f9b040cec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:24.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.827+0000 7f9b03fff700 1 -- 172.21.15.84:0/1969599454 >> v1:172.21.15.179:6789/0 conn(0x7f9b0415ca30 legacy=0x7f9b0406c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:24.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.827+0000 7f9b03fff700 1 -- 172.21.15.84:0/1969599454 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b040d11f0 con 0x7f9b040d0830 2023-07-14T11:18:24.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.827+0000 7f9b02ffd700 1 -- 172.21.15.84:0/1969599454 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 694070442 0 0) 0x7f9af4001110 con 0x7f9b0415ca30 2023-07-14T11:18:24.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.827+0000 7f9b03fff700 1 --2- 172.21.15.84:0/1969599454 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b040d0830 0x7f9b040d0cb0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f9b040b6d20 tx=0x7f9afc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba0a52b30f504cc3 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:24.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.828+0000 7f9b02ffd700 1 -- 172.21.15.84:0/1969599454 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9afc00e070 con 0x7f9b040d0830 2023-07-14T11:18:24.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.828+0000 7f9b02ffd700 1 -- 172.21.15.84:0/1969599454 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9afc00bb20 con 0x7f9b040d0830 2023-07-14T11:18:24.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.828+0000 7f9b02ffd700 1 -- 172.21.15.84:0/1969599454 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9afc012430 con 0x7f9b040d0830 2023-07-14T11:18:24.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.828+0000 7f9b09fff700 1 -- 172.21.15.84:0/1969599454 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b040d0830 msgr2=0x7f9b040d0cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:24.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.828+0000 7f9b09fff700 1 --2- 172.21.15.84:0/1969599454 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b040d0830 0x7f9b040d0cb0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f9b040b6d20 tx=0x7f9afc00b330 comp rx=0 tx=0).stop 2023-07-14T11:18:24.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.828+0000 7f9b09fff700 1 -- 172.21.15.84:0/1969599454 shutdown_connections 2023-07-14T11:18:24.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.828+0000 7f9b09fff700 1 --2- 172.21.15.84:0/1969599454 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b040d0830 0x7f9b040d0cb0 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:24.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.828+0000 7f9b09fff700 1 --2- 172.21.15.84:0/1969599454 >> v2:172.21.15.179:3300/0 conn(0x7f9b040ce840 0x7f9b040cec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:24.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.828+0000 7f9b09fff700 1 -- 172.21.15.84:0/1969599454 >> 172.21.15.84:0/1969599454 conn(0x7f9b040664f0 msgr2=0x7f9b04099fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:24.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.829+0000 7f9b09fff700 1 -- 172.21.15.84:0/1969599454 shutdown_connections 2023-07-14T11:18:24.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.829+0000 7f9b09fff700 1 -- 172.21.15.84:0/1969599454 wait complete. 2023-07-14T11:18:24.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.830+0000 7f9b09fff700 1 Processor -- start 2023-07-14T11:18:24.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.830+0000 7f9b09fff700 1 -- start start 2023-07-14T11:18:24.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.831+0000 7f9b09fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b040ce840 0x7f9b04148380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:24.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.831+0000 7f9b09fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b040d0830 0x7f9b0415b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:24.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.831+0000 7f9b09fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b0415ca30 0x7f9b0415bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:24.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.831+0000 7f9b09fff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b040ce100 con 0x7f9b0415ca30 2023-07-14T11:18:24.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.831+0000 7f9b09fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b041488c0 con 0x7f9b040d0830 2023-07-14T11:18:24.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.831+0000 7f9b09fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0415eec0 con 0x7f9b040ce840 2023-07-14T11:18:24.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.832+0000 7f9b03fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b0415ca30 0x7f9b0415bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:24.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.832+0000 7f9b03fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b0415ca30 0x7f9b0415bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58714/0 (socket says 172.21.15.84:58714) 2023-07-14T11:18:24.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.832+0000 7f9b03fff700 1 -- 172.21.15.84:0/3223801583 learned_addr learned my addr 172.21.15.84:0/3223801583 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:24.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.832+0000 7f9b037fe700 1 --2- 172.21.15.84:0/3223801583 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b040ce840 0x7f9b04148380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:24.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.832+0000 7f9afbfff700 1 --2- 172.21.15.84:0/3223801583 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b040d0830 0x7f9b0415b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:24.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.832+0000 7f9b03fff700 1 -- 172.21.15.84:0/3223801583 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b040ce840 msgr2=0x7f9b04148380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:24.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.832+0000 7f9b03fff700 1 --2- 172.21.15.84:0/3223801583 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b040ce840 0x7f9b04148380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:24.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.832+0000 7f9b03fff700 1 -- 172.21.15.84:0/3223801583 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b040d0830 msgr2=0x7f9b0415b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:24.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.832+0000 7f9b03fff700 1 --2- 172.21.15.84:0/3223801583 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b040d0830 0x7f9b0415b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:24.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.832+0000 7f9b03fff700 1 -- 172.21.15.84:0/3223801583 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9afc009a70 con 0x7f9b0415ca30 2023-07-14T11:18:24.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.832+0000 7f9afbfff700 1 --2- 172.21.15.84:0/3223801583 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b040d0830 0x7f9b0415b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:18:24.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.832+0000 7f9b03fff700 1 --2- 172.21.15.84:0/3223801583 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b0415ca30 0x7f9b0415bb30 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f9b040ce7f0 tx=0x7f9afc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:24.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.833+0000 7f9b00ff9700 1 -- 172.21.15.84:0/3223801583 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9afc012430 con 0x7f9b0415ca30 2023-07-14T11:18:24.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.833+0000 7f9b00ff9700 1 -- 172.21.15.84:0/3223801583 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9afc020070 con 0x7f9b0415ca30 2023-07-14T11:18:24.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.833+0000 7f9b00ff9700 1 -- 172.21.15.84:0/3223801583 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9afc004280 con 0x7f9b0415ca30 2023-07-14T11:18:24.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.833+0000 7f9b09fff700 1 -- 172.21.15.84:0/3223801583 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b0415f1a0 con 0x7f9b0415ca30 2023-07-14T11:18:24.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.833+0000 7f9b09fff700 1 -- 172.21.15.84:0/3223801583 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b0415f760 con 0x7f9b0415ca30 2023-07-14T11:18:24.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.834+0000 7f9b00ff9700 1 -- 172.21.15.84:0/3223801583 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 14) v1 ==== 44597+0+0 (secure 0 0 0) 0x7f9afc0043e0 con 0x7f9b0415ca30 2023-07-14T11:18:24.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.834+0000 7f9b09fff700 1 -- 172.21.15.84:0/3223801583 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b040cfc20 con 0x7f9b0415ca30 2023-07-14T11:18:24.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.834+0000 7f9b00ff9700 1 --2- 172.21.15.84:0/3223801583 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f9ae4037730 0x7f9ae4039be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:24.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.834+0000 7f9b00ff9700 1 -- 172.21.15.84:0/3223801583 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6621+0+0 (secure 0 0 0) 0x7f9afc022070 con 0x7f9b0415ca30 2023-07-14T11:18:24.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.835+0000 7f9b037fe700 1 --2- 172.21.15.84:0/3223801583 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f9ae4037730 0x7f9ae4039be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:24.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.835+0000 7f9b037fe700 1 --2- 172.21.15.84:0/3223801583 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f9ae4037730 0x7f9ae4039be0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9af4000f60 tx=0x7f9af4007c20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:24.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.839+0000 7f9b00ff9700 1 -- 172.21.15.84:0/3223801583 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f9afc0263e0 con 0x7f9b0415ca30 2023-07-14T11:18:24.892 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:18:24.890+0000 7fdddc059200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-14T11:18:24.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:24.926+0000 7f9b00ff9700 1 -- 172.21.15.84:0/3223801583 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mgrmap(e 15) v1 ==== 44861+0+0 (secure 0 0 0) 0x7f9afc01b780 con 0x7f9b0415ca30 2023-07-14T11:18:25.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.044+0000 7f9b09fff700 1 -- 172.21.15.84:0/3223801583 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9b0406ba20 con 0x7f9b0415ca30 2023-07-14T11:18:25.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.045+0000 7f9b00ff9700 1 -- 172.21.15.84:0/3223801583 <== mon.0 v2:172.21.15.84:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+19138 (secure 0 0 0) 0x7f9afc0263e0 con 0x7f9b0415ca30 2023-07-14T11:18:25.048 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:18:25.048 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":76,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:18:22.884682+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-07-14T11:17:53.456029+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-07-14T11:17:54.724710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:0/3621960179":"2023-07-15T11:18:22.884618+0000","172.21.15.84:0/866699477":"2023-07-15T11:18:22.884618+0000","172.21.15.84:0/2313824978":"2023-07-15T11:18:22.884618+0000","172.21.15.84:0/1410429649":"2023-07-15T11:18:22.884618+0000","172.21.15.84:0/2317294276":"2023-07-15T11:18:22.884618+0000","172.21.15.84:0/2017899455":"2023-07-15T11:18:22.884618+0000","172.21.15.84:0/2585793132":"2023-07-15T11:18:22.884618+0000","172.21.15.84:6833/379617029":"2023-07-15T11:18:22.884618+0000","172.21.15.84:0/1962247770":"2023-07-15T11:18:22.884618+0000","172.21.15.84:6832/379617029":"2023-07-15T11:18:22.884618+0000","172.21.15.84:0/4142616364":"2023-07-15T11:18:22.884618+0000","172.21.15.84:0/3082191159":"2023-07-15T11:18:22.884618+0000","172.21.15.84:0/1609666652":"2023-07-15T11:18:22.884618+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:18:25.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.048+0000 7f9b09fff700 1 -- 172.21.15.84:0/3223801583 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f9ae4037730 msgr2=0x7f9ae4039be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:25.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.048+0000 7f9b09fff700 1 --2- 172.21.15.84:0/3223801583 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f9ae4037730 0x7f9ae4039be0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9af4000f60 tx=0x7f9af4007c20 comp rx=0 tx=0).stop 2023-07-14T11:18:25.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.048+0000 7f9b09fff700 1 -- 172.21.15.84:0/3223801583 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b0415ca30 msgr2=0x7f9b0415bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:25.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.048+0000 7f9b09fff700 1 --2- 172.21.15.84:0/3223801583 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b0415ca30 0x7f9b0415bb30 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f9b040ce7f0 tx=0x7f9afc004ad0 comp rx=0 tx=0).stop 2023-07-14T11:18:25.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.048+0000 7f9b09fff700 1 -- 172.21.15.84:0/3223801583 shutdown_connections 2023-07-14T11:18:25.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.048+0000 7f9b09fff700 1 --2- 172.21.15.84:0/3223801583 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f9ae4037730 0x7f9ae4039be0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:25.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.048+0000 7f9b09fff700 1 --2- 172.21.15.84:0/3223801583 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b040ce840 0x7f9b04148380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:25.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.048+0000 7f9b09fff700 1 --2- 172.21.15.84:0/3223801583 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b0415ca30 0x7f9b0415bb30 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:25.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.048+0000 7f9b09fff700 1 --2- 172.21.15.84:0/3223801583 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b040d0830 0x7f9b0415b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:25.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.048+0000 7f9b09fff700 1 -- 172.21.15.84:0/3223801583 >> 172.21.15.84:0/3223801583 conn(0x7f9b040664f0 msgr2=0x7f9b04099fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:25.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.048+0000 7f9b09fff700 1 -- 172.21.15.84:0/3223801583 shutdown_connections 2023-07-14T11:18:25.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.048+0000 7f9b09fff700 1 -- 172.21.15.84:0/3223801583 wait complete. 2023-07-14T11:18:25.069 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T11:13:00.125395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T11:13:06.803994+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T11:17:53.456029+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T11:17:54.724710+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T11:18:25.070 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T11:18:25.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.270+0000 7fddd03ff700 1 Processor -- start 2023-07-14T11:18:25.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.270+0000 7fddd03ff700 1 -- start start 2023-07-14T11:18:25.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.271+0000 7fddd03ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fddc80d12c0 0x7fddc80cc220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:25.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.271+0000 7fddd03ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fddc80cb330 0x7fddc806b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:25.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.271+0000 7fddd03ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddc80b0560 con 0x7fddc806b580 2023-07-14T11:18:25.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.272+0000 7fddd03ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddc806ba00 con 0x7fddc80cb330 2023-07-14T11:18:25.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.272+0000 7fddd03ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddc80d1690 con 0x7fddc80d12c0 2023-07-14T11:18:25.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.272+0000 7fddce19b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fddc80d12c0 0x7fddc80cc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:25.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.272+0000 7fddce19b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fddc80d12c0 0x7fddc80cc220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.84:52482/0 (socket says 172.21.15.84:52482) 2023-07-14T11:18:25.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.272+0000 7fddce99c700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fddc806b580 0x7fddc80cd560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.84:49826/0 (socket says 172.21.15.84:49826) 2023-07-14T11:18:25.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.272+0000 7fddce19b700 1 -- 172.21.15.84:0/1189713552 learned_addr learned my addr 172.21.15.84:0/1189713552 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:25.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.272+0000 7fddcd99a700 1 --2- 172.21.15.84:0/1189713552 >> v2:172.21.15.179:3300/0 conn(0x7fddc80cb330 0x7fddc806b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:25.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.273+0000 7fddce19b700 1 -- 172.21.15.84:0/1189713552 >> v2:172.21.15.179:3300/0 conn(0x7fddc80cb330 msgr2=0x7fddc806b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:25.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.273+0000 7fddce19b700 1 --2- 172.21.15.84:0/1189713552 >> v2:172.21.15.179:3300/0 conn(0x7fddc80cb330 0x7fddc806b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:25.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.273+0000 7fddce19b700 1 -- 172.21.15.84:0/1189713552 >> v1:172.21.15.179:6789/0 conn(0x7fddc806b580 legacy=0x7fddc80cd560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:25.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.273+0000 7fddce19b700 1 -- 172.21.15.84:0/1189713552 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddc80cc760 con 0x7fddc80d12c0 2023-07-14T11:18:25.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.273+0000 7fddcd99a700 1 --2- 172.21.15.84:0/1189713552 >> v2:172.21.15.179:3300/0 conn(0x7fddc80cb330 0x7fddc806b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:18:25.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.273+0000 7fddcd199700 1 -- 172.21.15.84:0/1189713552 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 369226301 0 0) 0x7fddc80b0560 con 0x7fddc806b580 2023-07-14T11:18:25.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.273+0000 7fddce19b700 1 --2- 172.21.15.84:0/1189713552 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fddc80d12c0 0x7fddc80cc220 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fddc40098f0 tx=0x7fddc4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=216d899cb7158253 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:25.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.273+0000 7fddcd199700 1 -- 172.21.15.84:0/1189713552 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc4011830 con 0x7fddc80d12c0 2023-07-14T11:18:25.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.273+0000 7fddcd199700 1 -- 172.21.15.84:0/1189713552 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddc4011990 con 0x7fddc80d12c0 2023-07-14T11:18:25.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.273+0000 7fddcd199700 1 -- 172.21.15.84:0/1189713552 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc4011d20 con 0x7fddc80d12c0 2023-07-14T11:18:25.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.274+0000 7fddd03ff700 1 -- 172.21.15.84:0/1189713552 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fddc80d12c0 msgr2=0x7fddc80cc220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:25.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.274+0000 7fddd03ff700 1 --2- 172.21.15.84:0/1189713552 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fddc80d12c0 0x7fddc80cc220 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fddc40098f0 tx=0x7fddc4009c00 comp rx=0 tx=0).stop 2023-07-14T11:18:25.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.274+0000 7fddd03ff700 1 -- 172.21.15.84:0/1189713552 shutdown_connections 2023-07-14T11:18:25.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.274+0000 7fddd03ff700 1 --2- 172.21.15.84:0/1189713552 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fddc80d12c0 0x7fddc80cc220 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:25.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.274+0000 7fddd03ff700 1 --2- 172.21.15.84:0/1189713552 >> v2:172.21.15.179:3300/0 conn(0x7fddc80cb330 0x7fddc806b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:25.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.274+0000 7fddd03ff700 1 -- 172.21.15.84:0/1189713552 >> 172.21.15.84:0/1189713552 conn(0x7fddc80999e0 msgr2=0x7fddc8099de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:25.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.274+0000 7fddd03ff700 1 -- 172.21.15.84:0/1189713552 shutdown_connections 2023-07-14T11:18:25.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.274+0000 7fddd03ff700 1 -- 172.21.15.84:0/1189713552 wait complete. 2023-07-14T11:18:25.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.275+0000 7fddd03ff700 1 Processor -- start 2023-07-14T11:18:25.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.276+0000 7fddd03ff700 1 -- start start 2023-07-14T11:18:25.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.277+0000 7fddd03ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fddc806b580 0x7fddc80c7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:25.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.277+0000 7fddd03ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fddc80cb330 0x7fddc815aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:25.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.277+0000 7fddd03ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddc80d12c0 0x7fddc8145d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:25.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.277+0000 7fddd03ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddc80c8700 con 0x7fddc80d12c0 2023-07-14T11:18:25.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.277+0000 7fddd03ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddc80c89e0 con 0x7fddc80cb330 2023-07-14T11:18:25.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.277+0000 7fddd03ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddc80c8cc0 con 0x7fddc806b580 2023-07-14T11:18:25.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.277+0000 7fddce99c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddc80d12c0 0x7fddc8145d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:25.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.277+0000 7fddce99c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddc80d12c0 0x7fddc8145d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58728/0 (socket says 172.21.15.84:58728) 2023-07-14T11:18:25.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.277+0000 7fddce99c700 1 -- 172.21.15.84:0/2722035971 learned_addr learned my addr 172.21.15.84:0/2722035971 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:25.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.277+0000 7fddce19b700 1 --2- 172.21.15.84:0/2722035971 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fddc806b580 0x7fddc80c7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:25.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.277+0000 7fddcd99a700 1 --2- 172.21.15.84:0/2722035971 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fddc80cb330 0x7fddc815aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:25.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.278+0000 7fddce19b700 1 -- 172.21.15.84:0/2722035971 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fddc80cb330 msgr2=0x7fddc815aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:25.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.278+0000 7fddce19b700 1 --2- 172.21.15.84:0/2722035971 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fddc80cb330 0x7fddc815aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:25.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.278+0000 7fddce19b700 1 -- 172.21.15.84:0/2722035971 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddc80d12c0 msgr2=0x7fddc8145d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:25.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.278+0000 7fddce19b700 1 --2- 172.21.15.84:0/2722035971 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddc80d12c0 0x7fddc8145d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:25.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.278+0000 7fddce19b700 1 -- 172.21.15.84:0/2722035971 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb80094a0 con 0x7fddc806b580 2023-07-14T11:18:25.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.278+0000 7fddce99c700 1 --2- 172.21.15.84:0/2722035971 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddc80d12c0 0x7fddc8145d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:18:25.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.278+0000 7fddce19b700 1 --2- 172.21.15.84:0/2722035971 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fddc806b580 0x7fddc80c7db0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fddc4016000 tx=0x7fddc4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:25.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.278+0000 7fddbeffd700 1 -- 172.21.15.84:0/2722035971 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc4004510 con 0x7fddc806b580 2023-07-14T11:18:25.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.278+0000 7fddbeffd700 1 -- 172.21.15.84:0/2722035971 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddc40036a0 con 0x7fddc806b580 2023-07-14T11:18:25.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.278+0000 7fddd03ff700 1 -- 172.21.15.84:0/2722035971 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddc4009550 con 0x7fddc806b580 2023-07-14T11:18:25.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.278+0000 7fddbeffd700 1 -- 172.21.15.84:0/2722035971 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc4003a10 con 0x7fddc806b580 2023-07-14T11:18:25.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.278+0000 7fddd03ff700 1 -- 172.21.15.84:0/2722035971 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddc80c9280 con 0x7fddc806b580 2023-07-14T11:18:25.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.279+0000 7fddd03ff700 1 -- 172.21.15.84:0/2722035971 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddc806c370 con 0x7fddc806b580 2023-07-14T11:18:25.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.279+0000 7fddbeffd700 1 -- 172.21.15.84:0/2722035971 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 15) v1 ==== 44861+0+0 (secure 0 0 0) 0x7fddc4003b70 con 0x7fddc806b580 2023-07-14T11:18:25.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.280+0000 7fddbeffd700 1 --2- 172.21.15.84:0/2722035971 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fddac037a00 0x7fddac039eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:25.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.280+0000 7fddbeffd700 1 -- 172.21.15.84:0/2722035971 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6621+0+0 (secure 0 0 0) 0x7fddc404c460 con 0x7fddc806b580 2023-07-14T11:18:25.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.280+0000 7fddcd99a700 1 --2- 172.21.15.84:0/2722035971 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fddac037a00 0x7fddac039eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:25.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.281+0000 7fddcd99a700 1 --2- 172.21.15.84:0/2722035971 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fddac037a00 0x7fddac039eb0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fddc815bb60 tx=0x7fddb8009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:25.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.285+0000 7fddbeffd700 1 -- 172.21.15.84:0/2722035971 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fddc4010380 con 0x7fddc806b580 2023-07-14T11:18:25.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.486+0000 7fddd03ff700 1 -- 172.21.15.84:0/2722035971 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fddc815ceb0 con 0x7fddc806b580 2023-07-14T11:18:25.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.487+0000 7fddbeffd700 1 -- 172.21.15.84:0/2722035971 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v76) v1 ==== 93+0+10 (secure 0 0 0) 0x7fddc815ceb0 con 0x7fddc806b580 2023-07-14T11:18:25.490 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-07-14T11:18:25.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.489+0000 7fddd03ff700 1 -- 172.21.15.84:0/2722035971 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fddac037a00 msgr2=0x7fddac039eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:25.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.489+0000 7fddd03ff700 1 --2- 172.21.15.84:0/2722035971 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fddac037a00 0x7fddac039eb0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fddc815bb60 tx=0x7fddb8009210 comp rx=0 tx=0).stop 2023-07-14T11:18:25.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.489+0000 7fddd03ff700 1 -- 172.21.15.84:0/2722035971 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fddc806b580 msgr2=0x7fddc80c7db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:25.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.489+0000 7fddd03ff700 1 --2- 172.21.15.84:0/2722035971 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fddc806b580 0x7fddc80c7db0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fddc4016000 tx=0x7fddc4004750 comp rx=0 tx=0).stop 2023-07-14T11:18:25.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.489+0000 7fddd03ff700 1 -- 172.21.15.84:0/2722035971 shutdown_connections 2023-07-14T11:18:25.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.489+0000 7fddd03ff700 1 --2- 172.21.15.84:0/2722035971 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fddac037a00 0x7fddac039eb0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:25.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.489+0000 7fddd03ff700 1 --2- 172.21.15.84:0/2722035971 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fddc806b580 0x7fddc80c7db0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:25.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.489+0000 7fddd03ff700 1 --2- 172.21.15.84:0/2722035971 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddc80d12c0 0x7fddc8145d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:25.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.489+0000 7fddd03ff700 1 --2- 172.21.15.84:0/2722035971 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fddc80cb330 0x7fddc815aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:25.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.489+0000 7fddd03ff700 1 -- 172.21.15.84:0/2722035971 >> 172.21.15.84:0/2722035971 conn(0x7fddc80999e0 msgr2=0x7fddc80cb9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:25.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.490+0000 7fddd03ff700 1 -- 172.21.15.84:0/2722035971 shutdown_connections 2023-07-14T11:18:25.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.490+0000 7fddd03ff700 1 -- 172.21.15.84:0/2722035971 wait complete. 2023-07-14T11:18:25.510 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T11:18:25.704 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:18:25.701+0000 7fdddc059200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-14T11:18:25.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.713+0000 7f73297ff700 1 Processor -- start 2023-07-14T11:18:25.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.713+0000 7f73297ff700 1 -- start start 2023-07-14T11:18:25.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.714+0000 7f73297ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7324071170 0x7f73240715f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:25.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.714+0000 7f73297ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f732406bcc0 con 0x7f732406c9f0 2023-07-14T11:18:25.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.714+0000 7f73297ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7324071b30 con 0x7f732415d9d0 2023-07-14T11:18:25.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.714+0000 7f73297ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f732406c4e0 con 0x7f7324071170 2023-07-14T11:18:25.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.714+0000 7f731bfff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f732406c9f0 0x7f73240b1910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48984/0 (socket says 172.21.15.84:48984) 2023-07-14T11:18:25.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.714+0000 7f731bfff700 1 -- 172.21.15.84:0/3802800704 learned_addr learned my addr 172.21.15.84:0/3802800704 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:18:25.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.714+0000 7f73237fe700 1 --2- 172.21.15.84:0/3802800704 >> v2:172.21.15.84:3300/0 conn(0x7f7324071170 0x7f73240715f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:25.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.715+0000 7f73227fc700 1 -- 172.21.15.84:0/3802800704 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1755957400 0 0) 0x7f732406bcc0 con 0x7f732406c9f0 2023-07-14T11:18:25.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.715+0000 7f73227fc700 1 -- 172.21.15.84:0/3802800704 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73100035b0 con 0x7f732406c9f0 2023-07-14T11:18:25.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.715+0000 7f73237fe700 1 -- 172.21.15.84:0/3802800704 >> v1:172.21.15.179:6789/0 conn(0x7f732415d9d0 legacy=0x7f732406b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:25.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.715+0000 7f73237fe700 1 -- 172.21.15.84:0/3802800704 >> v1:172.21.15.84:6789/0 conn(0x7f732406c9f0 legacy=0x7f73240b1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:25.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.715+0000 7f73237fe700 1 -- 172.21.15.84:0/3802800704 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73240b2020 con 0x7f7324071170 2023-07-14T11:18:25.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.715+0000 7f73237fe700 1 --2- 172.21.15.84:0/3802800704 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7324071170 0x7f73240715f0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f731c009d90 tx=0x7f731c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5ae74810a0f1bf6 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:25.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.715+0000 7f73227fc700 1 -- 172.21.15.84:0/3802800704 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731c00e070 con 0x7f7324071170 2023-07-14T11:18:25.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.715+0000 7f73227fc700 1 -- 172.21.15.84:0/3802800704 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f731c00bb20 con 0x7f7324071170 2023-07-14T11:18:25.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.715+0000 7f73227fc700 1 -- 172.21.15.84:0/3802800704 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731c012430 con 0x7f7324071170 2023-07-14T11:18:25.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.716+0000 7f73297ff700 1 -- 172.21.15.84:0/3802800704 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7324071170 msgr2=0x7f73240715f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:25.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.716+0000 7f73297ff700 1 --2- 172.21.15.84:0/3802800704 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7324071170 0x7f73240715f0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f731c009d90 tx=0x7f731c00b330 comp rx=0 tx=0).stop 2023-07-14T11:18:25.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.716+0000 7f73297ff700 1 -- 172.21.15.84:0/3802800704 shutdown_connections 2023-07-14T11:18:25.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.716+0000 7f73297ff700 1 --2- 172.21.15.84:0/3802800704 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7324071170 0x7f73240715f0 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:25.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.716+0000 7f73297ff700 1 -- 172.21.15.84:0/3802800704 >> 172.21.15.84:0/3802800704 conn(0x7f73240b05d0 msgr2=0x7f73240b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:25.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.716+0000 7f73297ff700 1 -- 172.21.15.84:0/3802800704 shutdown_connections 2023-07-14T11:18:25.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.716+0000 7f73297ff700 1 -- 172.21.15.84:0/3802800704 wait complete. 2023-07-14T11:18:25.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.719+0000 7f73297ff700 1 Processor -- start 2023-07-14T11:18:25.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.719+0000 7f73297ff700 1 -- start start 2023-07-14T11:18:25.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.721+0000 7f73297ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f732406c9f0 0x7f7324152e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:25.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.721+0000 7f73297ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7324071170 0x7f73240ab530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:25.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.721+0000 7f73297ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f732415d9d0 0x7f73240a95a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:25.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.721+0000 7f73297ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73240abfa0 con 0x7f732406c9f0 2023-07-14T11:18:25.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.721+0000 7f73297ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73240ac280 con 0x7f7324071170 2023-07-14T11:18:25.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.721+0000 7f73297ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73240ac560 con 0x7f732415d9d0 2023-07-14T11:18:25.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.721+0000 7f7322ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f732406c9f0 0x7f7324152e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:25.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.721+0000 7f7322ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f732406c9f0 0x7f7324152e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58748/0 (socket says 172.21.15.84:58748) 2023-07-14T11:18:25.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.721+0000 7f7322ffd700 1 -- 172.21.15.84:0/1884976622 learned_addr learned my addr 172.21.15.84:0/1884976622 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:25.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.721+0000 7f7322ffd700 1 -- 172.21.15.84:0/1884976622 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f732415d9d0 msgr2=0x7f73240a95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:25.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.721+0000 7f7322ffd700 1 --2- 172.21.15.84:0/1884976622 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f732415d9d0 0x7f73240a95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:25.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.721+0000 7f731bfff700 1 --2- 172.21.15.84:0/1884976622 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7324071170 0x7f73240ab530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:25.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.721+0000 7f7322ffd700 1 -- 172.21.15.84:0/1884976622 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7324071170 msgr2=0x7f73240ab530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:25.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.722+0000 7f7322ffd700 1 --2- 172.21.15.84:0/1884976622 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7324071170 0x7f73240ab530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:25.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.722+0000 7f7322ffd700 1 -- 172.21.15.84:0/1884976622 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f731c009a70 con 0x7f732406c9f0 2023-07-14T11:18:25.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.722+0000 7f731bfff700 1 --2- 172.21.15.84:0/1884976622 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7324071170 0x7f73240ab530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:18:25.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.722+0000 7f7322ffd700 1 --2- 172.21.15.84:0/1884976622 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f732406c9f0 0x7f7324152e70 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f731400c4d0 tx=0x7f731400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:25.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.722+0000 7f731b7fe700 1 -- 172.21.15.84:0/1884976622 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73140052d0 con 0x7f732406c9f0 2023-07-14T11:18:25.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.722+0000 7f731b7fe700 1 -- 172.21.15.84:0/1884976622 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7314005430 con 0x7f732406c9f0 2023-07-14T11:18:25.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.722+0000 7f73297ff700 1 -- 172.21.15.84:0/1884976622 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73240ac840 con 0x7f732406c9f0 2023-07-14T11:18:25.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.722+0000 7f731b7fe700 1 -- 172.21.15.84:0/1884976622 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7314003880 con 0x7f732406c9f0 2023-07-14T11:18:25.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.722+0000 7f73297ff700 1 -- 172.21.15.84:0/1884976622 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73240aba70 con 0x7f732406c9f0 2023-07-14T11:18:25.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.723+0000 7f731b7fe700 1 -- 172.21.15.84:0/1884976622 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 15) v1 ==== 44861+0+0 (secure 0 0 0) 0x7f73140039e0 con 0x7f732406c9f0 2023-07-14T11:18:25.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.723+0000 7f73297ff700 1 -- 172.21.15.84:0/1884976622 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7324074350 con 0x7f732406c9f0 2023-07-14T11:18:25.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.724+0000 7f731b7fe700 1 --2- 172.21.15.84:0/1884976622 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f7304037a00 0x7f7304039eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:25.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.724+0000 7f731b7fe700 1 -- 172.21.15.84:0/1884976622 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6621+0+0 (secure 0 0 0) 0x7f731404a2d0 con 0x7f732406c9f0 2023-07-14T11:18:25.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.724+0000 7f731bfff700 1 --2- 172.21.15.84:0/1884976622 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f7304037a00 0x7f7304039eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:25.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.725+0000 7f731bfff700 1 --2- 172.21.15.84:0/1884976622 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f7304037a00 0x7f7304039eb0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f73240cd590 tx=0x7f730c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:25.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.728+0000 7f731b7fe700 1 -- 172.21.15.84:0/1884976622 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7314019b40 con 0x7f732406c9f0 2023-07-14T11:18:25.800 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:18:25.798+0000 7fdddc059200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-14T11:18:25.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.928+0000 7f73297ff700 1 -- 172.21.15.84:0/1884976622 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f73240c3610 con 0x7f732406c9f0 2023-07-14T11:18:25.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.928+0000 7f731b7fe700 1 -- 172.21.15.84:0/1884976622 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v76) v1 ==== 92+0+10 (secure 0 0 0) 0x7f73140170a0 con 0x7f732406c9f0 2023-07-14T11:18:25.931 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-07-14T11:18:25.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.930+0000 7f73297ff700 1 -- 172.21.15.84:0/1884976622 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f7304037a00 msgr2=0x7f7304039eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:25.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.930+0000 7f73297ff700 1 --2- 172.21.15.84:0/1884976622 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f7304037a00 0x7f7304039eb0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f73240cd590 tx=0x7f730c009040 comp rx=0 tx=0).stop 2023-07-14T11:18:25.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.930+0000 7f73297ff700 1 -- 172.21.15.84:0/1884976622 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f732406c9f0 msgr2=0x7f7324152e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:25.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.930+0000 7f73297ff700 1 --2- 172.21.15.84:0/1884976622 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f732406c9f0 0x7f7324152e70 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f731400c4d0 tx=0x7f731400c890 comp rx=0 tx=0).stop 2023-07-14T11:18:25.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.930+0000 7f73297ff700 1 -- 172.21.15.84:0/1884976622 shutdown_connections 2023-07-14T11:18:25.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.930+0000 7f73297ff700 1 --2- 172.21.15.84:0/1884976622 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f7304037a00 0x7f7304039eb0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:25.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.931+0000 7f73297ff700 1 --2- 172.21.15.84:0/1884976622 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f732415d9d0 0x7f73240a95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:25.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.931+0000 7f73297ff700 1 --2- 172.21.15.84:0/1884976622 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f732406c9f0 0x7f7324152e70 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:25.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.931+0000 7f73297ff700 1 --2- 172.21.15.84:0/1884976622 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7324071170 0x7f73240ab530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:25.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.931+0000 7f73297ff700 1 -- 172.21.15.84:0/1884976622 >> 172.21.15.84:0/1884976622 conn(0x7f73240b05d0 msgr2=0x7f732406cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:25.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.931+0000 7f73297ff700 1 -- 172.21.15.84:0/1884976622 shutdown_connections 2023-07-14T11:18:25.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:25.931+0000 7f73297ff700 1 -- 172.21.15.84:0/1884976622 wait complete. 2023-07-14T11:18:25.951 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T11:18:25.963 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:18:25.961+0000 7fdddc059200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-14T11:18:26.058 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:18:26.055+0000 7fdddc059200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-14T11:18:26.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.153+0000 7f7024bff700 1 Processor -- start 2023-07-14T11:18:26.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.153+0000 7f7024bff700 1 -- start start 2023-07-14T11:18:26.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.155+0000 7f7024bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f70200afc40 0x7f70200b2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:26.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.155+0000 7f7024bff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f702015ca90 con 0x7f702006b8a0 2023-07-14T11:18:26.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.155+0000 7f7024bff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f702006b0e0 con 0x7f702015c6c0 2023-07-14T11:18:26.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.155+0000 7f7024bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70200d0370 con 0x7f70200afc40 2023-07-14T11:18:26.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.155+0000 7f701ed9d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f702006b8a0 0x7f702006bd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49000/0 (socket says 172.21.15.84:49000) 2023-07-14T11:18:26.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.155+0000 7f701ed9d700 1 -- 172.21.15.84:0/691683906 learned_addr learned my addr 172.21.15.84:0/691683906 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:18:26.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.155+0000 7f7017fff700 1 --2- 172.21.15.84:0/691683906 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f70200afc40 0x7f70200b2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:26.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.155+0000 7f701dd9b700 1 -- 172.21.15.84:0/691683906 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4103799980 0 0) 0x7f7018001490 con 0x7f702006b8a0 2023-07-14T11:18:26.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.156+0000 7f701dd9b700 1 -- 172.21.15.84:0/691683906 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f700c0035b0 con 0x7f702006b8a0 2023-07-14T11:18:26.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.156+0000 7f701dd9b700 1 -- 172.21.15.84:0/691683906 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3835222878 0 0) 0x7f702006b0e0 con 0x7f702015c6c0 2023-07-14T11:18:26.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.156+0000 7f701dd9b700 1 -- 172.21.15.84:0/691683906 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7018001490 con 0x7f702015c6c0 2023-07-14T11:18:26.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.156+0000 7f7017fff700 1 -- 172.21.15.84:0/691683906 >> v1:172.21.15.179:6789/0 conn(0x7f702015c6c0 legacy=0x7f70200b2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:26.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.156+0000 7f7017fff700 1 -- 172.21.15.84:0/691683906 >> v1:172.21.15.84:6789/0 conn(0x7f702006b8a0 legacy=0x7f702006bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:26.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.156+0000 7f701dd9b700 1 -- 172.21.15.84:0/691683906 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 325461813 0 0) 0x7f700c0035b0 con 0x7f702006b8a0 2023-07-14T11:18:26.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.156+0000 7f7017fff700 1 -- 172.21.15.84:0/691683906 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70200d0650 con 0x7f70200afc40 2023-07-14T11:18:26.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.156+0000 7f7017fff700 1 --2- 172.21.15.84:0/691683906 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f70200afc40 0x7f70200b2d40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7008009870 tx=0x7f7008009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c17c1e8ff1879aef server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:26.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.156+0000 7f701dd9b700 1 -- 172.21.15.84:0/691683906 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7018001b80 con 0x7f70200afc40 2023-07-14T11:18:26.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.157+0000 7f701dd9b700 1 -- 172.21.15.84:0/691683906 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7008004030 con 0x7f70200afc40 2023-07-14T11:18:26.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.157+0000 7f701dd9b700 1 -- 172.21.15.84:0/691683906 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70080043c0 con 0x7f70200afc40 2023-07-14T11:18:26.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.157+0000 7f7024bff700 1 -- 172.21.15.84:0/691683906 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f70200afc40 msgr2=0x7f70200b2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:26.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.157+0000 7f7024bff700 1 --2- 172.21.15.84:0/691683906 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f70200afc40 0x7f70200b2d40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7008009870 tx=0x7f7008009b80 comp rx=0 tx=0).stop 2023-07-14T11:18:26.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.157+0000 7f7024bff700 1 -- 172.21.15.84:0/691683906 shutdown_connections 2023-07-14T11:18:26.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.157+0000 7f7024bff700 1 --2- 172.21.15.84:0/691683906 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f70200afc40 0x7f70200b2d40 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:26.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.157+0000 7f7024bff700 1 -- 172.21.15.84:0/691683906 >> 172.21.15.84:0/691683906 conn(0x7f702006d980 msgr2=0x7f702006dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:26.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.157+0000 7f7024bff700 1 -- 172.21.15.84:0/691683906 shutdown_connections 2023-07-14T11:18:26.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.158+0000 7f7024bff700 1 -- 172.21.15.84:0/691683906 wait complete. 2023-07-14T11:18:26.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.159+0000 7f7024bff700 1 Processor -- start 2023-07-14T11:18:26.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.160+0000 7f7024bff700 1 -- start start 2023-07-14T11:18:26.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.161+0000 7f7024bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f702006b8a0 0x7f70200cba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:26.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.161+0000 7f7024bff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70200afc40 0x7f70200b40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:26.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.161+0000 7f7024bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f702015c6c0 0x7f70200b5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:26.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.161+0000 7f7024bff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70200cde00 con 0x7f70200afc40 2023-07-14T11:18:26.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.161+0000 7f7024bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70200cd460 con 0x7f702015c6c0 2023-07-14T11:18:26.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.161+0000 7f7024bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70200cd740 con 0x7f702006b8a0 2023-07-14T11:18:26.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.161+0000 7f7017fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70200afc40 0x7f70200b40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:26.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.161+0000 7f7017fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70200afc40 0x7f70200b40b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58762/0 (socket says 172.21.15.84:58762) 2023-07-14T11:18:26.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.161+0000 7f7017fff700 1 -- 172.21.15.84:0/3361832209 learned_addr learned my addr 172.21.15.84:0/3361832209 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:26.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.161+0000 7f701ed9d700 1 --2- 172.21.15.84:0/3361832209 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f702015c6c0 0x7f70200b5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:26.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.161+0000 7f701e59c700 1 --2- 172.21.15.84:0/3361832209 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f702006b8a0 0x7f70200cba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:26.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.162+0000 7f7017fff700 1 -- 172.21.15.84:0/3361832209 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f702006b8a0 msgr2=0x7f70200cba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:26.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.162+0000 7f7017fff700 1 --2- 172.21.15.84:0/3361832209 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f702006b8a0 0x7f70200cba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:26.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.162+0000 7f7017fff700 1 -- 172.21.15.84:0/3361832209 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f702015c6c0 msgr2=0x7f70200b5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:26.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.162+0000 7f7017fff700 1 --2- 172.21.15.84:0/3361832209 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f702015c6c0 0x7f70200b5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:26.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.162+0000 7f7017fff700 1 -- 172.21.15.84:0/3361832209 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70080094a0 con 0x7f70200afc40 2023-07-14T11:18:26.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.162+0000 7f701ed9d700 1 --2- 172.21.15.84:0/3361832209 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f702015c6c0 0x7f70200b5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:18:26.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.162+0000 7f7017fff700 1 --2- 172.21.15.84:0/3361832209 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70200afc40 0x7f70200b40b0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f7008000c00 tx=0x7f7008004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:26.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.162+0000 7f7016ffd700 1 -- 172.21.15.84:0/3361832209 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7008003c50 con 0x7f70200afc40 2023-07-14T11:18:26.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.162+0000 7f7016ffd700 1 -- 172.21.15.84:0/3361832209 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f700801f070 con 0x7f70200afc40 2023-07-14T11:18:26.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.162+0000 7f7016ffd700 1 -- 172.21.15.84:0/3361832209 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7008011630 con 0x7f70200afc40 2023-07-14T11:18:26.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.162+0000 7f7024bff700 1 -- 172.21.15.84:0/3361832209 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70200cda20 con 0x7f70200afc40 2023-07-14T11:18:26.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.163+0000 7f7024bff700 1 -- 172.21.15.84:0/3361832209 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70200b45f0 con 0x7f70200afc40 2023-07-14T11:18:26.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.163+0000 7f7016ffd700 1 -- 172.21.15.84:0/3361832209 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 15) v1 ==== 44861+0+0 (secure 0 0 0) 0x7f7008021030 con 0x7f70200afc40 2023-07-14T11:18:26.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.164+0000 7f7024bff700 1 -- 172.21.15.84:0/3361832209 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7020074350 con 0x7f70200afc40 2023-07-14T11:18:26.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.164+0000 7f7016ffd700 1 --2- 172.21.15.84:0/3361832209 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f7000037a00 0x7f7000039eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:26.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.164+0000 7f7016ffd700 1 -- 172.21.15.84:0/3361832209 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6621+0+0 (secure 0 0 0) 0x7f700804c110 con 0x7f70200afc40 2023-07-14T11:18:26.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.165+0000 7f701e59c700 1 --2- 172.21.15.84:0/3361832209 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f7000037a00 0x7f7000039eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:26.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.165+0000 7f701e59c700 1 --2- 172.21.15.84:0/3361832209 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f7000037a00 0x7f7000039eb0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f70100011e0 tx=0x7f7010009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:26.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.169+0000 7f7016ffd700 1 -- 172.21.15.84:0/3361832209 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7008023790 con 0x7f70200afc40 2023-07-14T11:18:26.281 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:18:26.278+0000 7fdddc059200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-14T11:18:26.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.371+0000 7f7024bff700 1 -- 172.21.15.84:0/3361832209 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f70200ce310 con 0x7f70200afc40 2023-07-14T11:18:26.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.371+0000 7f7016ffd700 1 -- 172.21.15.84:0/3361832209 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v76) v1 ==== 104+0+11 (secure 0 0 0) 0x7f700801b440 con 0x7f70200afc40 2023-07-14T11:18:26.374 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-07-14T11:18:26.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.374+0000 7f7024bff700 1 -- 172.21.15.84:0/3361832209 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f7000037a00 msgr2=0x7f7000039eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:26.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.374+0000 7f7024bff700 1 --2- 172.21.15.84:0/3361832209 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f7000037a00 0x7f7000039eb0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f70100011e0 tx=0x7f7010009040 comp rx=0 tx=0).stop 2023-07-14T11:18:26.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.374+0000 7f7024bff700 1 -- 172.21.15.84:0/3361832209 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70200afc40 msgr2=0x7f70200b40b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:26.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.374+0000 7f7024bff700 1 --2- 172.21.15.84:0/3361832209 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70200afc40 0x7f70200b40b0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f7008000c00 tx=0x7f7008004750 comp rx=0 tx=0).stop 2023-07-14T11:18:26.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.374+0000 7f7024bff700 1 -- 172.21.15.84:0/3361832209 shutdown_connections 2023-07-14T11:18:26.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.374+0000 7f7024bff700 1 --2- 172.21.15.84:0/3361832209 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f7000037a00 0x7f7000039eb0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:26.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.374+0000 7f7024bff700 1 --2- 172.21.15.84:0/3361832209 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f702006b8a0 0x7f70200cba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:26.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.374+0000 7f7024bff700 1 --2- 172.21.15.84:0/3361832209 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f702015c6c0 0x7f70200b5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:26.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.374+0000 7f7024bff700 1 --2- 172.21.15.84:0/3361832209 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70200afc40 0x7f70200b40b0 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:26.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.374+0000 7f7024bff700 1 -- 172.21.15.84:0/3361832209 >> 172.21.15.84:0/3361832209 conn(0x7f702006d980 msgr2=0x7f70200b05a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:26.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.374+0000 7f7024bff700 1 -- 172.21.15.84:0/3361832209 shutdown_connections 2023-07-14T11:18:26.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.375+0000 7f7024bff700 1 -- 172.21.15.84:0/3361832209 wait complete. 2023-07-14T11:18:26.385 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:18:26.383+0000 7fdddc059200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-14T11:18:26.395 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T11:18:26.486 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:18:26.484+0000 7fdddc059200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-14T11:18:26.590 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:18:26.588+0000 7fdddc059200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-14T11:18:26.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.635+0000 7fbd931ff700 1 Processor -- start 2023-07-14T11:18:26.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.635+0000 7fbd931ff700 1 -- start start 2023-07-14T11:18:26.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.636+0000 7fbd931ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbd8c06c9f0 0x7fbd8c0b1910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:26.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.637+0000 7fbd931ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbd8c0b1e50 0x7fbd8c071170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:26.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.637+0000 7fbd931ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd8c06bcc0 con 0x7fbd8c15d9d0 2023-07-14T11:18:26.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.637+0000 7fbd931ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd8c06c4e0 con 0x7fbd8c06c9f0 2023-07-14T11:18:26.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.637+0000 7fbd931ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd8c15dda0 con 0x7fbd8c0b1e50 2023-07-14T11:18:26.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.637+0000 7fbd8bfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbd8c06c9f0 0x7fbd8c0b1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:26.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.637+0000 7fbd8bfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbd8c06c9f0 0x7fbd8c0b1910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58768/0 (socket says 172.21.15.84:58768) 2023-07-14T11:18:26.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.637+0000 7fbd8bfff700 1 -- 172.21.15.84:0/3615680353 learned_addr learned my addr 172.21.15.84:0/3615680353 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:26.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.637+0000 7fbd90f9b700 1 --1- 172.21.15.84:0/3615680353 >> v1:172.21.15.84:6789/0 conn(0x7fbd8c15d9d0 0x7fbd8c06b5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49016/0 (socket says 172.21.15.84:49016) 2023-07-14T11:18:26.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.637+0000 7fbd9179c700 1 --2- 172.21.15.84:0/3615680353 >> v2:172.21.15.179:3300/0 conn(0x7fbd8c0b1e50 0x7fbd8c071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:26.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.637+0000 7fbd8bfff700 1 -- 172.21.15.84:0/3615680353 >> v2:172.21.15.179:3300/0 conn(0x7fbd8c0b1e50 msgr2=0x7fbd8c071170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:26.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.637+0000 7fbd8bfff700 1 --2- 172.21.15.84:0/3615680353 >> v2:172.21.15.179:3300/0 conn(0x7fbd8c0b1e50 0x7fbd8c071170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:26.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.637+0000 7fbd8bfff700 1 -- 172.21.15.84:0/3615680353 >> v1:172.21.15.84:6789/0 conn(0x7fbd8c15d9d0 legacy=0x7fbd8c06b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:26.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.637+0000 7fbd8bfff700 1 -- 172.21.15.84:0/3615680353 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd8c06bf20 con 0x7fbd8c06c9f0 2023-07-14T11:18:26.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.637+0000 7fbd8b7fe700 1 -- 172.21.15.84:0/3615680353 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 386360923 0 0) 0x7fbd8c06bcc0 con 0x7fbd8c15d9d0 2023-07-14T11:18:26.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.638+0000 7fbd8bfff700 1 --2- 172.21.15.84:0/3615680353 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd8c06c9f0 0x7fbd8c0b1910 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c0ae040 tx=0x7fbd78009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f1b570fbb762540 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:26.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.638+0000 7fbd8b7fe700 1 -- 172.21.15.84:0/3615680353 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd7800b870 con 0x7fbd8c06c9f0 2023-07-14T11:18:26.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.638+0000 7fbd8b7fe700 1 -- 172.21.15.84:0/3615680353 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd7800b9d0 con 0x7fbd8c06c9f0 2023-07-14T11:18:26.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.638+0000 7fbd8b7fe700 1 -- 172.21.15.84:0/3615680353 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd7800bd60 con 0x7fbd8c06c9f0 2023-07-14T11:18:26.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.638+0000 7fbd931ff700 1 -- 172.21.15.84:0/3615680353 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd8c06c9f0 msgr2=0x7fbd8c0b1910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:26.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.638+0000 7fbd931ff700 1 --2- 172.21.15.84:0/3615680353 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd8c06c9f0 0x7fbd8c0b1910 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c0ae040 tx=0x7fbd78009bd0 comp rx=0 tx=0).stop 2023-07-14T11:18:26.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.639+0000 7fbd931ff700 1 -- 172.21.15.84:0/3615680353 shutdown_connections 2023-07-14T11:18:26.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.639+0000 7fbd931ff700 1 --2- 172.21.15.84:0/3615680353 >> v2:172.21.15.179:3300/0 conn(0x7fbd8c0b1e50 0x7fbd8c071170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:26.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.639+0000 7fbd931ff700 1 --2- 172.21.15.84:0/3615680353 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd8c06c9f0 0x7fbd8c0b1910 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:26.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.639+0000 7fbd931ff700 1 -- 172.21.15.84:0/3615680353 >> 172.21.15.84:0/3615680353 conn(0x7fbd8c0b05d0 msgr2=0x7fbd8c0b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:26.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.639+0000 7fbd931ff700 1 -- 172.21.15.84:0/3615680353 shutdown_connections 2023-07-14T11:18:26.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.639+0000 7fbd931ff700 1 -- 172.21.15.84:0/3615680353 wait complete. 2023-07-14T11:18:26.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.641+0000 7fbd931ff700 1 Processor -- start 2023-07-14T11:18:26.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.641+0000 7fbd931ff700 1 -- start start 2023-07-14T11:18:26.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.642+0000 7fbd931ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd8c06c9f0 0x7fbd8c0c25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:26.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.642+0000 7fbd931ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd8c0b1e50 0x7fbd8c0cd130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:26.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.643+0000 7fbd931ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd8c15d9d0 0x7fbd8c15b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:26.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.643+0000 7fbd931ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8c0ccca0 con 0x7fbd8c0b1e50 2023-07-14T11:18:26.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.643+0000 7fbd931ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8c0cc690 con 0x7fbd8c06c9f0 2023-07-14T11:18:26.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.643+0000 7fbd931ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8c15b700 con 0x7fbd8c15d9d0 2023-07-14T11:18:26.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.643+0000 7fbd8bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd8c0b1e50 0x7fbd8c0cd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:26.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.643+0000 7fbd8bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd8c0b1e50 0x7fbd8c0cd130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58778/0 (socket says 172.21.15.84:58778) 2023-07-14T11:18:26.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.643+0000 7fbd8bfff700 1 -- 172.21.15.84:0/1937455170 learned_addr learned my addr 172.21.15.84:0/1937455170 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:26.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.643+0000 7fbd90f9b700 1 --2- 172.21.15.84:0/1937455170 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd8c06c9f0 0x7fbd8c0c25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:26.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.643+0000 7fbd9179c700 1 --2- 172.21.15.84:0/1937455170 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd8c15d9d0 0x7fbd8c15b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:26.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.643+0000 7fbd8bfff700 1 -- 172.21.15.84:0/1937455170 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd8c15d9d0 msgr2=0x7fbd8c15b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:26.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.643+0000 7fbd8bfff700 1 --2- 172.21.15.84:0/1937455170 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd8c15d9d0 0x7fbd8c15b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:26.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.643+0000 7fbd8bfff700 1 -- 172.21.15.84:0/1937455170 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd8c06c9f0 msgr2=0x7fbd8c0c25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:26.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.643+0000 7fbd8bfff700 1 --2- 172.21.15.84:0/1937455170 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd8c06c9f0 0x7fbd8c0c25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:26.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.643+0000 7fbd8bfff700 1 -- 172.21.15.84:0/1937455170 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd78009550 con 0x7fbd8c0b1e50 2023-07-14T11:18:26.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.644+0000 7fbd8bfff700 1 --2- 172.21.15.84:0/1937455170 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd8c0b1e50 0x7fbd8c0cd130 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fbd78000c00 tx=0x7fbd78004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:26.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.644+0000 7fbd897fa700 1 -- 172.21.15.84:0/1937455170 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd78004310 con 0x7fbd8c0b1e50 2023-07-14T11:18:26.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.644+0000 7fbd897fa700 1 -- 172.21.15.84:0/1937455170 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd7801f070 con 0x7fbd8c0b1e50 2023-07-14T11:18:26.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.644+0000 7fbd931ff700 1 -- 172.21.15.84:0/1937455170 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd8c15b9e0 con 0x7fbd8c0b1e50 2023-07-14T11:18:26.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.644+0000 7fbd897fa700 1 -- 172.21.15.84:0/1937455170 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd780036a0 con 0x7fbd8c0b1e50 2023-07-14T11:18:26.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.644+0000 7fbd931ff700 1 -- 172.21.15.84:0/1937455170 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd8c0cdf50 con 0x7fbd8c0b1e50 2023-07-14T11:18:26.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.645+0000 7fbd931ff700 1 -- 172.21.15.84:0/1937455170 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd8c074350 con 0x7fbd8c0b1e50 2023-07-14T11:18:26.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.645+0000 7fbd897fa700 1 -- 172.21.15.84:0/1937455170 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 15) v1 ==== 44861+0+0 (secure 0 0 0) 0x7fbd78021030 con 0x7fbd8c0b1e50 2023-07-14T11:18:26.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.646+0000 7fbd897fa700 1 --2- 172.21.15.84:0/1937455170 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fbd70037a00 0x7fbd70039eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:26.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.646+0000 7fbd897fa700 1 -- 172.21.15.84:0/1937455170 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6621+0+0 (secure 0 0 0) 0x7fbd7804c180 con 0x7fbd8c0b1e50 2023-07-14T11:18:26.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.646+0000 7fbd90f9b700 1 --2- 172.21.15.84:0/1937455170 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fbd70037a00 0x7fbd70039eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:26.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.647+0000 7fbd90f9b700 1 --2- 172.21.15.84:0/1937455170 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fbd70037a00 0x7fbd70039eb0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbd80000f60 tx=0x7fbd80007e70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:26.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.654+0000 7fbd897fa700 1 -- 172.21.15.84:0/1937455170 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fbd78019980 con 0x7fbd8c0b1e50 2023-07-14T11:18:26.793 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:18:26.791+0000 7fdddc059200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-14T11:18:26.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.856+0000 7fbd931ff700 1 -- 172.21.15.84:0/1937455170 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbd8c073800 con 0x7fbd8c0b1e50 2023-07-14T11:18:26.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.856+0000 7fbd897fa700 1 -- 172.21.15.84:0/1937455170 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v76) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbd78015020 con 0x7fbd8c0b1e50 2023-07-14T11:18:26.859 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-07-14T11:18:26.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.859+0000 7fbd931ff700 1 -- 172.21.15.84:0/1937455170 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fbd70037a00 msgr2=0x7fbd70039eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:26.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.859+0000 7fbd931ff700 1 --2- 172.21.15.84:0/1937455170 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fbd70037a00 0x7fbd70039eb0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbd80000f60 tx=0x7fbd80007e70 comp rx=0 tx=0).stop 2023-07-14T11:18:26.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.859+0000 7fbd931ff700 1 -- 172.21.15.84:0/1937455170 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd8c0b1e50 msgr2=0x7fbd8c0cd130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:26.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.859+0000 7fbd931ff700 1 --2- 172.21.15.84:0/1937455170 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd8c0b1e50 0x7fbd8c0cd130 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fbd78000c00 tx=0x7fbd78004750 comp rx=0 tx=0).stop 2023-07-14T11:18:26.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.859+0000 7fbd931ff700 1 -- 172.21.15.84:0/1937455170 shutdown_connections 2023-07-14T11:18:26.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.859+0000 7fbd931ff700 1 --2- 172.21.15.84:0/1937455170 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fbd70037a00 0x7fbd70039eb0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:26.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.859+0000 7fbd931ff700 1 --2- 172.21.15.84:0/1937455170 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd8c15d9d0 0x7fbd8c15b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:26.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.859+0000 7fbd931ff700 1 --2- 172.21.15.84:0/1937455170 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd8c06c9f0 0x7fbd8c0c25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:26.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.859+0000 7fbd931ff700 1 --2- 172.21.15.84:0/1937455170 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd8c0b1e50 0x7fbd8c0cd130 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:26.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.859+0000 7fbd931ff700 1 -- 172.21.15.84:0/1937455170 >> 172.21.15.84:0/1937455170 conn(0x7fbd8c0b05d0 msgr2=0x7fbd8c06cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:26.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.859+0000 7fbd931ff700 1 -- 172.21.15.84:0/1937455170 shutdown_connections 2023-07-14T11:18:26.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:26.859+0000 7fbd931ff700 1 -- 172.21.15.84:0/1937455170 wait complete. 2023-07-14T11:18:26.879 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T11:18:26.901 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:18:26.899+0000 7fdddc059200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-14T11:18:27.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.084+0000 7f39cd3ff700 1 Processor -- start 2023-07-14T11:18:27.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.084+0000 7f39cd3ff700 1 -- start start 2023-07-14T11:18:27.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.085+0000 7f39cd3ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f39c815c710 0x7f39c80cf510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:27.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.085+0000 7f39cd3ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f39c8069f30 0x7f39c806a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:27.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.085+0000 7f39cd3ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39c80cd320 con 0x7f39c806d420 2023-07-14T11:18:27.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.085+0000 7f39cd3ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39c80ce750 con 0x7f39c815c710 2023-07-14T11:18:27.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.085+0000 7f39cd3ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39c80cea30 con 0x7f39c8069f30 2023-07-14T11:18:27.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.086+0000 7f39c6ffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f39c815c710 0x7f39c80cf510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:27.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.086+0000 7f39c6ffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f39c815c710 0x7f39c80cf510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58794/0 (socket says 172.21.15.84:58794) 2023-07-14T11:18:27.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.086+0000 7f39c6ffd700 1 -- 172.21.15.84:0/3803320905 learned_addr learned my addr 172.21.15.84:0/3803320905 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:27.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.086+0000 7f39c77fe700 1 --1- 172.21.15.84:0/3803320905 >> v1:172.21.15.84:6789/0 conn(0x7f39c806d420 0x7f39c8070950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49018/0 (socket says 172.21.15.84:49018) 2023-07-14T11:18:27.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.086+0000 7f39c67fc700 1 --2- 172.21.15.84:0/3803320905 >> v2:172.21.15.179:3300/0 conn(0x7f39c8069f30 0x7f39c806a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:27.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.086+0000 7f39c6ffd700 1 -- 172.21.15.84:0/3803320905 >> v2:172.21.15.179:3300/0 conn(0x7f39c8069f30 msgr2=0x7f39c806a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:27.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.086+0000 7f39c6ffd700 1 --2- 172.21.15.84:0/3803320905 >> v2:172.21.15.179:3300/0 conn(0x7f39c8069f30 0x7f39c806a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:27.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.086+0000 7f39c6ffd700 1 -- 172.21.15.84:0/3803320905 >> v1:172.21.15.84:6789/0 conn(0x7f39c806d420 legacy=0x7f39c8070950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:27.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.086+0000 7f39c6ffd700 1 -- 172.21.15.84:0/3803320905 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39c80ced10 con 0x7f39c815c710 2023-07-14T11:18:27.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.086+0000 7f39c67fc700 1 --2- 172.21.15.84:0/3803320905 >> v2:172.21.15.179:3300/0 conn(0x7f39c8069f30 0x7f39c806a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:18:27.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.086+0000 7f39c6ffd700 1 --2- 172.21.15.84:0/3803320905 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39c815c710 0x7f39c80cf510 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f39c80d0bd0 tx=0x7f39b8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a05fefdbf37b59a4 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:27.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.087+0000 7f39c5ffb700 1 -- 172.21.15.84:0/3803320905 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b800b870 con 0x7f39c815c710 2023-07-14T11:18:27.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.087+0000 7f39c5ffb700 1 -- 172.21.15.84:0/3803320905 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39b800b9d0 con 0x7f39c815c710 2023-07-14T11:18:27.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.087+0000 7f39c5ffb700 1 -- 172.21.15.84:0/3803320905 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b800bd60 con 0x7f39c815c710 2023-07-14T11:18:27.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.087+0000 7f39cd3ff700 1 -- 172.21.15.84:0/3803320905 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39c815c710 msgr2=0x7f39c80cf510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:27.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.087+0000 7f39cd3ff700 1 --2- 172.21.15.84:0/3803320905 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39c815c710 0x7f39c80cf510 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f39c80d0bd0 tx=0x7f39b8009bd0 comp rx=0 tx=0).stop 2023-07-14T11:18:27.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.087+0000 7f39cd3ff700 1 -- 172.21.15.84:0/3803320905 shutdown_connections 2023-07-14T11:18:27.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.087+0000 7f39cd3ff700 1 --2- 172.21.15.84:0/3803320905 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39c815c710 0x7f39c80cf510 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:27.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.087+0000 7f39cd3ff700 1 --2- 172.21.15.84:0/3803320905 >> v2:172.21.15.179:3300/0 conn(0x7f39c8069f30 0x7f39c806a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:27.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.087+0000 7f39cd3ff700 1 -- 172.21.15.84:0/3803320905 >> 172.21.15.84:0/3803320905 conn(0x7f39c80b16c0 msgr2=0x7f39c80b1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:27.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.087+0000 7f39cd3ff700 1 -- 172.21.15.84:0/3803320905 shutdown_connections 2023-07-14T11:18:27.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.087+0000 7f39cd3ff700 1 -- 172.21.15.84:0/3803320905 wait complete. 2023-07-14T11:18:27.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.089+0000 7f39cd3ff700 1 Processor -- start 2023-07-14T11:18:27.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.089+0000 7f39cd3ff700 1 -- start start 2023-07-14T11:18:27.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.090+0000 7f39cd3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39c8069f30 0x7f39c81ec1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:27.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.090+0000 7f39cd3ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39c806d420 0x7f39c81f33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:27.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.090+0000 7f39cd3ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39c80b33d0 0x7f39c80b4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:27.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.090+0000 7f39cd3ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c80b54f0 con 0x7f39c80b33d0 2023-07-14T11:18:27.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.090+0000 7f39cd3ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c81ec720 con 0x7f39c806d420 2023-07-14T11:18:27.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.090+0000 7f39cd3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39c80b3db0 con 0x7f39c8069f30 2023-07-14T11:18:27.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.090+0000 7f39c77fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39c80b33d0 0x7f39c80b4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:27.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.090+0000 7f39c77fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39c80b33d0 0x7f39c80b4570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58808/0 (socket says 172.21.15.84:58808) 2023-07-14T11:18:27.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.090+0000 7f39c77fe700 1 -- 172.21.15.84:0/2622354410 learned_addr learned my addr 172.21.15.84:0/2622354410 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:27.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.090+0000 7f39c67fc700 1 --2- 172.21.15.84:0/2622354410 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39c806d420 0x7f39c81f33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:27.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.090+0000 7f39c6ffd700 1 --2- 172.21.15.84:0/2622354410 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39c8069f30 0x7f39c81ec1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:27.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.091+0000 7f39c77fe700 1 -- 172.21.15.84:0/2622354410 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39c8069f30 msgr2=0x7f39c81ec1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:27.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.091+0000 7f39c77fe700 1 --2- 172.21.15.84:0/2622354410 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39c8069f30 0x7f39c81ec1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:27.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.091+0000 7f39c77fe700 1 -- 172.21.15.84:0/2622354410 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39c806d420 msgr2=0x7f39c81f33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:27.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.091+0000 7f39c77fe700 1 --2- 172.21.15.84:0/2622354410 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39c806d420 0x7f39c81f33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:27.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.091+0000 7f39c77fe700 1 -- 172.21.15.84:0/2622354410 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b8009550 con 0x7f39c80b33d0 2023-07-14T11:18:27.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.091+0000 7f39c77fe700 1 --2- 172.21.15.84:0/2622354410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39c80b33d0 0x7f39c80b4570 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f39c000cc30 tx=0x7f39c000cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:27.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.091+0000 7f39af7fe700 1 -- 172.21.15.84:0/2622354410 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c000aa80 con 0x7f39c80b33d0 2023-07-14T11:18:27.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.091+0000 7f39af7fe700 1 -- 172.21.15.84:0/2622354410 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39c000abe0 con 0x7f39c80b33d0 2023-07-14T11:18:27.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.091+0000 7f39cd3ff700 1 -- 172.21.15.84:0/2622354410 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39c806ac20 con 0x7f39c80b33d0 2023-07-14T11:18:27.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.091+0000 7f39af7fe700 1 -- 172.21.15.84:0/2622354410 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c0007070 con 0x7f39c80b33d0 2023-07-14T11:18:27.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.092+0000 7f39cd3ff700 1 -- 172.21.15.84:0/2622354410 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39c815cf70 con 0x7f39c80b33d0 2023-07-14T11:18:27.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.093+0000 7f39af7fe700 1 -- 172.21.15.84:0/2622354410 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 15) v1 ==== 44861+0+0 (secure 0 0 0) 0x7f39c00071d0 con 0x7f39c80b33d0 2023-07-14T11:18:27.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.093+0000 7f39cd3ff700 1 -- 172.21.15.84:0/2622354410 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39c804e280 con 0x7f39c80b33d0 2023-07-14T11:18:27.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.093+0000 7f39af7fe700 1 --2- 172.21.15.84:0/2622354410 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f39b4037a00 0x7f39b4039eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:27.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.093+0000 7f39af7fe700 1 -- 172.21.15.84:0/2622354410 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6621+0+0 (secure 0 0 0) 0x7f39c004aa40 con 0x7f39c80b33d0 2023-07-14T11:18:27.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.094+0000 7f39c6ffd700 1 --2- 172.21.15.84:0/2622354410 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f39b4037a00 0x7f39b4039eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:27.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.094+0000 7f39c6ffd700 1 --2- 172.21.15.84:0/2622354410 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f39b4037a00 0x7f39b4039eb0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f39b8014040 tx=0x7f39b8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:27.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.098+0000 7f39af7fe700 1 -- 172.21.15.84:0/2622354410 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f39c001b3b0 con 0x7f39c80b33d0 2023-07-14T11:18:27.268 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:18:27.265+0000 7fdddc059200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-14T11:18:27.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.350+0000 7f39cd3ff700 1 -- 172.21.15.84:0/2622354410 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f39c815fb90 con 0x7f39c80b33d0 2023-07-14T11:18:27.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.350+0000 7f39af7fe700 1 -- 172.21.15.84:0/2622354410 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4717 (secure 0 0 0) 0x7f39c0017020 con 0x7f39c80b33d0 2023-07-14T11:18:27.353 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:18:27.353 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":46,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5615,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3014145470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3014145470},{"type":"v1","addr":"172.21.15.179:6834","nonce":3014145470}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":5621,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3377004712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":3377004712},{"type":"v1","addr":"172.21.15.179:6835","nonce":3377004712}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":6681,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1864489758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1864489758},{"type":"v1","addr":"172.21.15.84:6835","nonce":1864489758}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T11:17:55.741927+0000","modified":"2023-07-14T11:17:59.277009+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6690},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6690":{"gid":6690,"name":"c","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/2405785300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":2405785300},{"type":"v1","addr":"172.21.15.84:6837","nonce":2405785300}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-07-14T11:18:27.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.353+0000 7f39cd3ff700 1 -- 172.21.15.84:0/2622354410 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f39b4037a00 msgr2=0x7f39b4039eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:27.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.353+0000 7f39cd3ff700 1 --2- 172.21.15.84:0/2622354410 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f39b4037a00 0x7f39b4039eb0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f39b8014040 tx=0x7f39b8008030 comp rx=0 tx=0).stop 2023-07-14T11:18:27.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.353+0000 7f39cd3ff700 1 -- 172.21.15.84:0/2622354410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39c80b33d0 msgr2=0x7f39c80b4570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:27.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.353+0000 7f39cd3ff700 1 --2- 172.21.15.84:0/2622354410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39c80b33d0 0x7f39c80b4570 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f39c000cc30 tx=0x7f39c000cf40 comp rx=0 tx=0).stop 2023-07-14T11:18:27.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.353+0000 7f39cd3ff700 1 -- 172.21.15.84:0/2622354410 shutdown_connections 2023-07-14T11:18:27.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.353+0000 7f39cd3ff700 1 --2- 172.21.15.84:0/2622354410 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f39b4037a00 0x7f39b4039eb0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:27.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.353+0000 7f39cd3ff700 1 --2- 172.21.15.84:0/2622354410 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39c8069f30 0x7f39c81ec1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:27.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.353+0000 7f39cd3ff700 1 --2- 172.21.15.84:0/2622354410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39c80b33d0 0x7f39c80b4570 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:27.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.353+0000 7f39cd3ff700 1 --2- 172.21.15.84:0/2622354410 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39c806d420 0x7f39c81f33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:27.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.353+0000 7f39cd3ff700 1 -- 172.21.15.84:0/2622354410 >> 172.21.15.84:0/2622354410 conn(0x7f39c80b16c0 msgr2=0x7f39c8070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:27.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.353+0000 7f39cd3ff700 1 -- 172.21.15.84:0/2622354410 shutdown_connections 2023-07-14T11:18:27.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.353+0000 7f39cd3ff700 1 -- 172.21.15.84:0/2622354410 wait complete. 2023-07-14T11:18:27.357 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 46 2023-07-14T11:18:27.364 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:18:27.362+0000 7fdddc059200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-14T11:18:27.374 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:18:27.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.611+0000 7f3e2b7ff700 1 Processor -- start 2023-07-14T11:18:27.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.611+0000 7f3e2b7ff700 1 -- start start 2023-07-14T11:18:27.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.612+0000 7f3e2b7ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3e240b4570 0x7f3e240b4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:27.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.612+0000 7f3e2b7ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e24072080 con 0x7f3e240ccf10 2023-07-14T11:18:27.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.612+0000 7f3e2b7ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e2406a2b0 con 0x7f3e240cd360 2023-07-14T11:18:27.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.612+0000 7f3e2b7ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e2406d7a0 con 0x7f3e240b4570 2023-07-14T11:18:27.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.612+0000 7f3e2959b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3e240b4570 0x7f3e240b4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:27.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.612+0000 7f3e28d9a700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f3e240ccf10 0x7f3e2406cbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49024/0 (socket says 172.21.15.84:49024) 2023-07-14T11:18:27.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.612+0000 7f3e28d9a700 1 -- 172.21.15.84:0/2764991991 learned_addr learned my addr 172.21.15.84:0/2764991991 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:18:27.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.613+0000 7f3e1bfff700 1 -- 172.21.15.84:0/2764991991 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1007784925 0 0) 0x7f3e24072080 con 0x7f3e240ccf10 2023-07-14T11:18:27.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.613+0000 7f3e1bfff700 1 -- 172.21.15.84:0/2764991991 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e100035b0 con 0x7f3e240ccf10 2023-07-14T11:18:27.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.613+0000 7f3e2959b700 1 -- 172.21.15.84:0/2764991991 >> v1:172.21.15.179:6789/0 conn(0x7f3e240cd360 legacy=0x7f3e24160be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:27.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.613+0000 7f3e2959b700 1 -- 172.21.15.84:0/2764991991 >> v1:172.21.15.84:6789/0 conn(0x7f3e240ccf10 legacy=0x7f3e2406cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:27.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.613+0000 7f3e2959b700 1 -- 172.21.15.84:0/2764991991 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e2406d9b0 con 0x7f3e240b4570 2023-07-14T11:18:27.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.613+0000 7f3e2959b700 1 --2- 172.21.15.84:0/2764991991 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e240b4570 0x7f3e240b4940 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f3e20009840 tx=0x7f3e20009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=829ffb3a9fcfdff1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:27.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.613+0000 7f3e1bfff700 1 -- 172.21.15.84:0/2764991991 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e20011830 con 0x7f3e240b4570 2023-07-14T11:18:27.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.613+0000 7f3e1bfff700 1 -- 172.21.15.84:0/2764991991 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e20011990 con 0x7f3e240b4570 2023-07-14T11:18:27.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.613+0000 7f3e1bfff700 1 -- 172.21.15.84:0/2764991991 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e20011d20 con 0x7f3e240b4570 2023-07-14T11:18:27.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.614+0000 7f3e2b7ff700 1 -- 172.21.15.84:0/2764991991 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e240b4570 msgr2=0x7f3e240b4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:27.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.614+0000 7f3e2b7ff700 1 --2- 172.21.15.84:0/2764991991 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e240b4570 0x7f3e240b4940 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f3e20009840 tx=0x7f3e20009b50 comp rx=0 tx=0).stop 2023-07-14T11:18:27.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.614+0000 7f3e2b7ff700 1 -- 172.21.15.84:0/2764991991 shutdown_connections 2023-07-14T11:18:27.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.614+0000 7f3e2b7ff700 1 --2- 172.21.15.84:0/2764991991 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e240b4570 0x7f3e240b4940 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:27.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.614+0000 7f3e2b7ff700 1 -- 172.21.15.84:0/2764991991 >> 172.21.15.84:0/2764991991 conn(0x7f3e240b2ef0 msgr2=0x7f3e24071530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:27.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.614+0000 7f3e2b7ff700 1 -- 172.21.15.84:0/2764991991 shutdown_connections 2023-07-14T11:18:27.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.614+0000 7f3e2b7ff700 1 -- 172.21.15.84:0/2764991991 wait complete. 2023-07-14T11:18:27.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.616+0000 7f3e2b7ff700 1 Processor -- start 2023-07-14T11:18:27.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.616+0000 7f3e2b7ff700 1 -- start start 2023-07-14T11:18:27.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.617+0000 7f3e2b7ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e240b4570 0x7f3e240afce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:27.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.617+0000 7f3e2b7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3e240ccf10 0x7f3e240c4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:27.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.617+0000 7f3e2b7ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3e240cd360 0x7f3e240c53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:27.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.617+0000 7f3e2b7ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e24150220 con 0x7f3e240b4570 2023-07-14T11:18:27.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.617+0000 7f3e2b7ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e24150470 con 0x7f3e240cd360 2023-07-14T11:18:27.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.617+0000 7f3e2b7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e24150750 con 0x7f3e240ccf10 2023-07-14T11:18:27.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.617+0000 7f3e2959b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e240b4570 0x7f3e240afce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:27.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.618+0000 7f3e2959b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e240b4570 0x7f3e240afce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58824/0 (socket says 172.21.15.84:58824) 2023-07-14T11:18:27.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.618+0000 7f3e2959b700 1 -- 172.21.15.84:0/1915902415 learned_addr learned my addr 172.21.15.84:0/1915902415 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:27.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.618+0000 7f3e29d9c700 1 --2- 172.21.15.84:0/1915902415 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3e240cd360 0x7f3e240c53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:27.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.618+0000 7f3e28d9a700 1 --2- 172.21.15.84:0/1915902415 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3e240ccf10 0x7f3e240c4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:27.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.618+0000 7f3e2959b700 1 -- 172.21.15.84:0/1915902415 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3e240ccf10 msgr2=0x7f3e240c4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:27.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.618+0000 7f3e2959b700 1 --2- 172.21.15.84:0/1915902415 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3e240ccf10 0x7f3e240c4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:27.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.618+0000 7f3e2959b700 1 -- 172.21.15.84:0/1915902415 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3e240cd360 msgr2=0x7f3e240c53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:27.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.618+0000 7f3e2959b700 1 --2- 172.21.15.84:0/1915902415 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3e240cd360 0x7f3e240c53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:27.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.618+0000 7f3e2959b700 1 -- 172.21.15.84:0/1915902415 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e200094a0 con 0x7f3e240b4570 2023-07-14T11:18:27.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.618+0000 7f3e28d9a700 1 --2- 172.21.15.84:0/1915902415 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3e240ccf10 0x7f3e240c4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:18:27.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.618+0000 7f3e2959b700 1 --2- 172.21.15.84:0/1915902415 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e240b4570 0x7f3e240afce0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f3e20014040 tx=0x7f3e20004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:27.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.618+0000 7f3e19ffb700 1 -- 172.21.15.84:0/1915902415 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e200036a0 con 0x7f3e240b4570 2023-07-14T11:18:27.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.619+0000 7f3e19ffb700 1 -- 172.21.15.84:0/1915902415 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e2001e070 con 0x7f3e240b4570 2023-07-14T11:18:27.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.619+0000 7f3e19ffb700 1 -- 172.21.15.84:0/1915902415 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e20003a20 con 0x7f3e240b4570 2023-07-14T11:18:27.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.619+0000 7f3e2b7ff700 1 -- 172.21.15.84:0/1915902415 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e24150a30 con 0x7f3e240b4570 2023-07-14T11:18:27.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.619+0000 7f3e2b7ff700 1 -- 172.21.15.84:0/1915902415 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e240b0220 con 0x7f3e240b4570 2023-07-14T11:18:27.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.620+0000 7f3e2b7ff700 1 -- 172.21.15.84:0/1915902415 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e24150f50 con 0x7f3e240b4570 2023-07-14T11:18:27.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.620+0000 7f3e19ffb700 1 -- 172.21.15.84:0/1915902415 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 15) v1 ==== 44861+0+0 (secure 0 0 0) 0x7f3e20003b80 con 0x7f3e240b4570 2023-07-14T11:18:27.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.620+0000 7f3e19ffb700 1 --2- 172.21.15.84:0/1915902415 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f3e08037a00 0x7f3e08039eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:27.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.620+0000 7f3e19ffb700 1 -- 172.21.15.84:0/1915902415 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6621+0+0 (secure 0 0 0) 0x7f3e2004bed0 con 0x7f3e240b4570 2023-07-14T11:18:27.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.621+0000 7f3e28d9a700 1 --2- 172.21.15.84:0/1915902415 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f3e08037a00 0x7f3e08039eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:27.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.621+0000 7f3e28d9a700 1 --2- 172.21.15.84:0/1915902415 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f3e08037a00 0x7f3e08039eb0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3e140011e0 tx=0x7f3e14009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:27.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.625+0000 7f3e19ffb700 1 -- 172.21.15.84:0/1915902415 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3e24150f50 con 0x7f3e240b4570 2023-07-14T11:18:27.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.829+0000 7f3e2b7ff700 1 -- 172.21.15.84:0/1915902415 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3e24150f50 con 0x7f3e240b4570 2023-07-14T11:18:27.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.831+0000 7f3e19ffb700 1 -- 172.21.15.84:0/1915902415 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+19138 (secure 0 0 0) 0x7f3e24150f50 con 0x7f3e240b4570 2023-07-14T11:18:27.833 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:18:27.834 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":76,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:18:22.884682+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-07-14T11:17:53.456029+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-07-14T11:17:54.724710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:0/3621960179":"2023-07-15T11:18:22.884618+0000","172.21.15.84:0/866699477":"2023-07-15T11:18:22.884618+0000","172.21.15.84:0/2313824978":"2023-07-15T11:18:22.884618+0000","172.21.15.84:0/1410429649":"2023-07-15T11:18:22.884618+0000","172.21.15.84:0/2317294276":"2023-07-15T11:18:22.884618+0000","172.21.15.84:0/2017899455":"2023-07-15T11:18:22.884618+0000","172.21.15.84:0/2585793132":"2023-07-15T11:18:22.884618+0000","172.21.15.84:6833/379617029":"2023-07-15T11:18:22.884618+0000","172.21.15.84:0/1962247770":"2023-07-15T11:18:22.884618+0000","172.21.15.84:6832/379617029":"2023-07-15T11:18:22.884618+0000","172.21.15.84:0/4142616364":"2023-07-15T11:18:22.884618+0000","172.21.15.84:0/3082191159":"2023-07-15T11:18:22.884618+0000","172.21.15.84:0/1609666652":"2023-07-15T11:18:22.884618+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:18:27.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.833+0000 7f3e2b7ff700 1 -- 172.21.15.84:0/1915902415 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f3e08037a00 msgr2=0x7f3e08039eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:27.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.833+0000 7f3e2b7ff700 1 --2- 172.21.15.84:0/1915902415 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f3e08037a00 0x7f3e08039eb0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3e140011e0 tx=0x7f3e14009040 comp rx=0 tx=0).stop 2023-07-14T11:18:27.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.833+0000 7f3e2b7ff700 1 -- 172.21.15.84:0/1915902415 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e240b4570 msgr2=0x7f3e240afce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:27.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.833+0000 7f3e2b7ff700 1 --2- 172.21.15.84:0/1915902415 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e240b4570 0x7f3e240afce0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f3e20014040 tx=0x7f3e20004750 comp rx=0 tx=0).stop 2023-07-14T11:18:27.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.833+0000 7f3e2b7ff700 1 -- 172.21.15.84:0/1915902415 shutdown_connections 2023-07-14T11:18:27.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.833+0000 7f3e2b7ff700 1 --2- 172.21.15.84:0/1915902415 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3e240cd360 0x7f3e240c53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:27.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.833+0000 7f3e2b7ff700 1 --2- 172.21.15.84:0/1915902415 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e240b4570 0x7f3e240afce0 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:27.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.833+0000 7f3e2b7ff700 1 --2- 172.21.15.84:0/1915902415 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f3e08037a00 0x7f3e08039eb0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:27.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.833+0000 7f3e2b7ff700 1 --2- 172.21.15.84:0/1915902415 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3e240ccf10 0x7f3e240c4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:27.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.833+0000 7f3e2b7ff700 1 -- 172.21.15.84:0/1915902415 >> 172.21.15.84:0/1915902415 conn(0x7f3e240b2ef0 msgr2=0x7f3e240c6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:27.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.833+0000 7f3e2b7ff700 1 -- 172.21.15.84:0/1915902415 shutdown_connections 2023-07-14T11:18:27.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:27.833+0000 7f3e2b7ff700 1 -- 172.21.15.84:0/1915902415 wait complete. 2023-07-14T11:18:27.854 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-14T11:18:27.854 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T11:18:27.935 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:18:27.933+0000 7fdddc059200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-14T11:18:28.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.051+0000 7f5208bff700 1 Processor -- start 2023-07-14T11:18:28.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.052+0000 7f5208bff700 1 -- start start 2023-07-14T11:18:28.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.053+0000 7f5208bff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f520415e890 0x7f52040cee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:28.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.053+0000 7f5208bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f520415afd0 0x7f52040b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:28.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.053+0000 7f5208bff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52040ce110 con 0x7f52040b3780 2023-07-14T11:18:28.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.053+0000 7f5208bff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f520415b450 con 0x7f520415e890 2023-07-14T11:18:28.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.053+0000 7f5208bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52040cf380 con 0x7f520415afd0 2023-07-14T11:18:28.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.053+0000 7f51fbfff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f52040b3780 0x7f520415a8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49030/0 (socket says 172.21.15.84:49030) 2023-07-14T11:18:28.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.053+0000 7f51fbfff700 1 -- 172.21.15.84:0/3250102675 learned_addr learned my addr 172.21.15.84:0/3250102675 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:18:28.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.053+0000 7f520259c700 1 --2- 172.21.15.84:0/3250102675 >> v2:172.21.15.179:3300/0 conn(0x7f520415e890 0x7f52040cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:28.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.054+0000 7f5202d9d700 1 --2- 172.21.15.84:0/3250102675 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f520415afd0 0x7f52040b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:28.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.054+0000 7f5201d9b700 1 -- 172.21.15.84:0/3250102675 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3702866539 0 0) 0x7f52040ce110 con 0x7f52040b3780 2023-07-14T11:18:28.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.054+0000 7f5201d9b700 1 -- 172.21.15.84:0/3250102675 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51f00035b0 con 0x7f52040b3780 2023-07-14T11:18:28.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.054+0000 7f520259c700 1 -- 172.21.15.84:0/3250102675 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f520415afd0 msgr2=0x7f52040b3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:28.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.054+0000 7f520259c700 1 --2- 172.21.15.84:0/3250102675 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f520415afd0 0x7f52040b3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:28.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.054+0000 7f520259c700 1 -- 172.21.15.84:0/3250102675 >> v1:172.21.15.84:6789/0 conn(0x7f52040b3780 legacy=0x7f520415a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:28.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.054+0000 7f520259c700 1 -- 172.21.15.84:0/3250102675 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f520415b660 con 0x7f520415e890 2023-07-14T11:18:28.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.054+0000 7f520259c700 1 --2- 172.21.15.84:0/3250102675 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f520415e890 0x7f52040cee40 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f51f4009840 tx=0x7f51f4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5a9d8dccd143c5b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:28.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.055+0000 7f5201d9b700 1 -- 172.21.15.84:0/3250102675 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f4011830 con 0x7f520415e890 2023-07-14T11:18:28.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.055+0000 7f5201d9b700 1 -- 172.21.15.84:0/3250102675 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51f4011990 con 0x7f520415e890 2023-07-14T11:18:28.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.055+0000 7f5201d9b700 1 -- 172.21.15.84:0/3250102675 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f4011d20 con 0x7f520415e890 2023-07-14T11:18:28.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.055+0000 7f5208bff700 1 -- 172.21.15.84:0/3250102675 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f520415e890 msgr2=0x7f52040cee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:28.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.055+0000 7f5208bff700 1 --2- 172.21.15.84:0/3250102675 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f520415e890 0x7f52040cee40 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f51f4009840 tx=0x7f51f4009b50 comp rx=0 tx=0).stop 2023-07-14T11:18:28.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.055+0000 7f5208bff700 1 -- 172.21.15.84:0/3250102675 shutdown_connections 2023-07-14T11:18:28.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.055+0000 7f5208bff700 1 --2- 172.21.15.84:0/3250102675 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f520415afd0 0x7f52040b3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:28.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.055+0000 7f5208bff700 1 --2- 172.21.15.84:0/3250102675 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f520415e890 0x7f52040cee40 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:28.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.055+0000 7f5208bff700 1 -- 172.21.15.84:0/3250102675 >> 172.21.15.84:0/3250102675 conn(0x7f5204069f30 msgr2=0x7f520406a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:28.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.055+0000 7f5208bff700 1 -- 172.21.15.84:0/3250102675 shutdown_connections 2023-07-14T11:18:28.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.056+0000 7f5208bff700 1 -- 172.21.15.84:0/3250102675 wait complete. 2023-07-14T11:18:28.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.057+0000 7f5208bff700 1 Processor -- start 2023-07-14T11:18:28.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.057+0000 7f5208bff700 1 -- start start 2023-07-14T11:18:28.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.058+0000 7f5208bff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52040b3780 0x7f52040ca040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:28.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.058+0000 7f5208bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f520415afd0 0x7f52040b0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:28.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.058+0000 7f5208bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f520415e890 0x7f52041f3000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:28.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.058+0000 7f5208bff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52040ca580 con 0x7f52040b3780 2023-07-14T11:18:28.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.059+0000 7f5208bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5204071080 con 0x7f520415afd0 2023-07-14T11:18:28.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.059+0000 7f5208bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52041f59c0 con 0x7f520415e890 2023-07-14T11:18:28.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.059+0000 7f520259c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52040b3780 0x7f52040ca040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:28.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.059+0000 7f520259c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52040b3780 0x7f52040ca040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58834/0 (socket says 172.21.15.84:58834) 2023-07-14T11:18:28.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.059+0000 7f520259c700 1 -- 172.21.15.84:0/3529385938 learned_addr learned my addr 172.21.15.84:0/3529385938 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:28.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.059+0000 7f51fbfff700 1 --2- 172.21.15.84:0/3529385938 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f520415afd0 0x7f52040b0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:28.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.059+0000 7f5202d9d700 1 --2- 172.21.15.84:0/3529385938 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f520415e890 0x7f52041f3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:28.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.059+0000 7f520259c700 1 -- 172.21.15.84:0/3529385938 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f520415e890 msgr2=0x7f52041f3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:28.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.059+0000 7f520259c700 1 --2- 172.21.15.84:0/3529385938 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f520415e890 0x7f52041f3000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:28.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.059+0000 7f520259c700 1 -- 172.21.15.84:0/3529385938 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f520415afd0 msgr2=0x7f52040b0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:28.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.059+0000 7f520259c700 1 --2- 172.21.15.84:0/3529385938 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f520415afd0 0x7f52040b0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:28.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.059+0000 7f520259c700 1 -- 172.21.15.84:0/3529385938 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f40094a0 con 0x7f52040b3780 2023-07-14T11:18:28.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.060+0000 7f520259c700 1 --2- 172.21.15.84:0/3529385938 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52040b3780 0x7f52040ca040 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f51f4009fd0 tx=0x7f51f4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:28.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.060+0000 7f51faffd700 1 -- 172.21.15.84:0/3529385938 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f40036a0 con 0x7f52040b3780 2023-07-14T11:18:28.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.060+0000 7f51faffd700 1 -- 172.21.15.84:0/3529385938 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51f401e070 con 0x7f52040b3780 2023-07-14T11:18:28.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.060+0000 7f5208bff700 1 -- 172.21.15.84:0/3529385938 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52041f5ca0 con 0x7f52040b3780 2023-07-14T11:18:28.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.060+0000 7f51faffd700 1 -- 172.21.15.84:0/3529385938 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f4003a60 con 0x7f52040b3780 2023-07-14T11:18:28.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.060+0000 7f5208bff700 1 -- 172.21.15.84:0/3529385938 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52041f6260 con 0x7f52040b3780 2023-07-14T11:18:28.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.061+0000 7f51faffd700 1 -- 172.21.15.84:0/3529385938 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 15) v1 ==== 44861+0+0 (secure 0 0 0) 0x7f51f4003bc0 con 0x7f52040b3780 2023-07-14T11:18:28.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.061+0000 7f5208bff700 1 -- 172.21.15.84:0/3529385938 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f520406d000 con 0x7f52040b3780 2023-07-14T11:18:28.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.062+0000 7f51faffd700 1 --2- 172.21.15.84:0/3529385938 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f51e4037a00 0x7f51e4039eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:28.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.062+0000 7f51faffd700 1 -- 172.21.15.84:0/3529385938 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6621+0+0 (secure 0 0 0) 0x7f51f404bda0 con 0x7f52040b3780 2023-07-14T11:18:28.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.062+0000 7f51fbfff700 1 --2- 172.21.15.84:0/3529385938 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f51e4037a00 0x7f51e4039eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:28.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.063+0000 7f51fbfff700 1 --2- 172.21.15.84:0/3529385938 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f51e4037a00 0x7f51e4039eb0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f52040b2d80 tx=0x7f51ec007dc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:28.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.067+0000 7f51faffd700 1 -- 172.21.15.84:0/3529385938 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f51f402d970 con 0x7f52040b3780 2023-07-14T11:18:28.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.313+0000 7f5208bff700 1 -- 172.21.15.84:0/3529385938 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f520404e280 con 0x7f52040b3780 2023-07-14T11:18:28.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.314+0000 7f51faffd700 1 -- 172.21.15.84:0/3529385938 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4717 (secure 0 0 0) 0x7f51f4010b70 con 0x7f52040b3780 2023-07-14T11:18:28.316 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:18:28.317 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":46,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5615,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3014145470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3014145470},{"type":"v1","addr":"172.21.15.179:6834","nonce":3014145470}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":5621,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3377004712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":3377004712},{"type":"v1","addr":"172.21.15.179:6835","nonce":3377004712}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":6681,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1864489758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1864489758},{"type":"v1","addr":"172.21.15.84:6835","nonce":1864489758}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T11:17:55.741927+0000","modified":"2023-07-14T11:17:59.277009+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6690},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6690":{"gid":6690,"name":"c","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/2405785300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":2405785300},{"type":"v1","addr":"172.21.15.84:6837","nonce":2405785300}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-07-14T11:18:28.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.316+0000 7f5208bff700 1 -- 172.21.15.84:0/3529385938 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f51e4037a00 msgr2=0x7f51e4039eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:28.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.316+0000 7f5208bff700 1 --2- 172.21.15.84:0/3529385938 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f51e4037a00 0x7f51e4039eb0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f52040b2d80 tx=0x7f51ec007dc0 comp rx=0 tx=0).stop 2023-07-14T11:18:28.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.316+0000 7f5208bff700 1 -- 172.21.15.84:0/3529385938 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52040b3780 msgr2=0x7f52040ca040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:28.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.316+0000 7f5208bff700 1 --2- 172.21.15.84:0/3529385938 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52040b3780 0x7f52040ca040 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f51f4009fd0 tx=0x7f51f4004750 comp rx=0 tx=0).stop 2023-07-14T11:18:28.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.316+0000 7f5208bff700 1 -- 172.21.15.84:0/3529385938 shutdown_connections 2023-07-14T11:18:28.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.316+0000 7f5208bff700 1 --2- 172.21.15.84:0/3529385938 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f51e4037a00 0x7f51e4039eb0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:28.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.316+0000 7f5208bff700 1 --2- 172.21.15.84:0/3529385938 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f520415e890 0x7f52041f3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:28.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.316+0000 7f5208bff700 1 --2- 172.21.15.84:0/3529385938 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52040b3780 0x7f52040ca040 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:28.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.316+0000 7f5208bff700 1 --2- 172.21.15.84:0/3529385938 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f520415afd0 0x7f52040b0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:28.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.316+0000 7f5208bff700 1 -- 172.21.15.84:0/3529385938 >> 172.21.15.84:0/3529385938 conn(0x7f5204069f30 msgr2=0x7f52041546f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:28.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.316+0000 7f5208bff700 1 -- 172.21.15.84:0/3529385938 shutdown_connections 2023-07-14T11:18:28.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.317+0000 7f5208bff700 1 -- 172.21.15.84:0/3529385938 wait complete. 2023-07-14T11:18:28.321 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 46 2023-07-14T11:18:28.326 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:18:28.324+0000 7fdddc059200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-14T11:18:28.337 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T11:18:28.517 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:18:28.514+0000 7fdddc059200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-14T11:18:28.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.533+0000 7f27affff700 1 Processor -- start 2023-07-14T11:18:28.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.533+0000 7f27affff700 1 -- start start 2023-07-14T11:18:28.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.534+0000 7f27affff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f27a815c630 0x7f27a80ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:28.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.534+0000 7f27affff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f27a80b3fb0 0x7f27a80cee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:28.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.534+0000 7f27affff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27a8160080 0x7f27a80ac850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:28.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.534+0000 7f27affff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27a8160640 con 0x7f27a80b3fb0 2023-07-14T11:18:28.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.534+0000 7f27affff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27a8160920 con 0x7f27a815c630 2023-07-14T11:18:28.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.534+0000 7f27affff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27a8160c00 con 0x7f27a8160080 2023-07-14T11:18:28.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.534+0000 7f27ad59a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f27a80b3fb0 0x7f27a80cee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:28.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.535+0000 7f27ad59a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f27a80b3fb0 0x7f27a80cee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58850/0 (socket says 172.21.15.84:58850) 2023-07-14T11:18:28.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.535+0000 7f27ad59a700 1 -- 172.21.15.84:0/3104929506 learned_addr learned my addr 172.21.15.84:0/3104929506 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:28.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.535+0000 7f27add9b700 1 --2- 172.21.15.84:0/3104929506 >> v2:172.21.15.179:3300/0 conn(0x7f27a815c630 0x7f27a80ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:28.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.535+0000 7f27ae59c700 1 --2- 172.21.15.84:0/3104929506 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27a8160080 0x7f27a80ac850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:28.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.535+0000 7f27ad59a700 1 -- 172.21.15.84:0/3104929506 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27a8160080 msgr2=0x7f27a80ac850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:28.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.535+0000 7f27ad59a700 1 --2- 172.21.15.84:0/3104929506 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27a8160080 0x7f27a80ac850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:28.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.535+0000 7f27ad59a700 1 -- 172.21.15.84:0/3104929506 >> v2:172.21.15.179:3300/0 conn(0x7f27a815c630 msgr2=0x7f27a80ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:28.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.535+0000 7f27ad59a700 1 --2- 172.21.15.84:0/3104929506 >> v2:172.21.15.179:3300/0 conn(0x7f27a815c630 0x7f27a80ce940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:28.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.535+0000 7f27ad59a700 1 -- 172.21.15.84:0/3104929506 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27a806b9c0 con 0x7f27a80b3fb0 2023-07-14T11:18:28.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.535+0000 7f27ad59a700 1 --2- 172.21.15.84:0/3104929506 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27a80b3fb0 0x7f27a80cee80 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f27a80cfae0 tx=0x7f2798009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=924ab5b08494381f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:28.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.536+0000 7f27acd99700 1 -- 172.21.15.84:0/3104929506 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2798011830 con 0x7f27a80b3fb0 2023-07-14T11:18:28.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.536+0000 7f27acd99700 1 -- 172.21.15.84:0/3104929506 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2798011990 con 0x7f27a80b3fb0 2023-07-14T11:18:28.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.536+0000 7f27acd99700 1 -- 172.21.15.84:0/3104929506 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2798011d20 con 0x7f27a80b3fb0 2023-07-14T11:18:28.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.536+0000 7f27affff700 1 -- 172.21.15.84:0/3104929506 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27a80b3fb0 msgr2=0x7f27a80cee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:28.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.536+0000 7f27affff700 1 --2- 172.21.15.84:0/3104929506 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27a80b3fb0 0x7f27a80cee80 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f27a80cfae0 tx=0x7f2798009bd0 comp rx=0 tx=0).stop 2023-07-14T11:18:28.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.536+0000 7f27affff700 1 -- 172.21.15.84:0/3104929506 shutdown_connections 2023-07-14T11:18:28.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.536+0000 7f27affff700 1 --2- 172.21.15.84:0/3104929506 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27a8160080 0x7f27a80ac850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:28.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.536+0000 7f27affff700 1 --2- 172.21.15.84:0/3104929506 >> v2:172.21.15.179:3300/0 conn(0x7f27a815c630 0x7f27a80ce940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:28.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.536+0000 7f27affff700 1 --2- 172.21.15.84:0/3104929506 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27a80b3fb0 0x7f27a80cee80 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:28.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.536+0000 7f27affff700 1 -- 172.21.15.84:0/3104929506 >> 172.21.15.84:0/3104929506 conn(0x7f27a8069f30 msgr2=0x7f27a806a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:28.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.536+0000 7f27affff700 1 -- 172.21.15.84:0/3104929506 shutdown_connections 2023-07-14T11:18:28.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.536+0000 7f27affff700 1 -- 172.21.15.84:0/3104929506 wait complete. 2023-07-14T11:18:28.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.538+0000 7f27affff700 1 Processor -- start 2023-07-14T11:18:28.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.538+0000 7f27affff700 1 -- start start 2023-07-14T11:18:28.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.539+0000 7f27affff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27a80b3fb0 0x7f27a814dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:28.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.539+0000 7f27affff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27a815c630 0x7f27a80b1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:28.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.539+0000 7f27affff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f27a8160080 0x7f27a80b2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:28.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.539+0000 7f27affff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27a80cdb10 con 0x7f27a80b3fb0 2023-07-14T11:18:28.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.539+0000 7f27affff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27a80cddf0 con 0x7f27a8160080 2023-07-14T11:18:28.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.539+0000 7f27affff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27a80ce0d0 con 0x7f27a815c630 2023-07-14T11:18:28.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.540+0000 7f27add9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27a80b3fb0 0x7f27a814dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:28.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.540+0000 7f27add9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27a80b3fb0 0x7f27a814dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58856/0 (socket says 172.21.15.84:58856) 2023-07-14T11:18:28.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.540+0000 7f27add9b700 1 -- 172.21.15.84:0/992860745 learned_addr learned my addr 172.21.15.84:0/992860745 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:28.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.540+0000 7f27ad59a700 1 --2- 172.21.15.84:0/992860745 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27a815c630 0x7f27a80b1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:28.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.540+0000 7f27ae59c700 1 --2- 172.21.15.84:0/992860745 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f27a8160080 0x7f27a80b2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:28.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.540+0000 7f27add9b700 1 -- 172.21.15.84:0/992860745 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27a815c630 msgr2=0x7f27a80b1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:28.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.540+0000 7f27add9b700 1 --2- 172.21.15.84:0/992860745 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27a815c630 0x7f27a80b1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:28.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.540+0000 7f27add9b700 1 -- 172.21.15.84:0/992860745 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f27a8160080 msgr2=0x7f27a80b2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:28.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.540+0000 7f27add9b700 1 --2- 172.21.15.84:0/992860745 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f27a8160080 0x7f27a80b2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:28.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.540+0000 7f27add9b700 1 -- 172.21.15.84:0/992860745 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2798009550 con 0x7f27a80b3fb0 2023-07-14T11:18:28.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.540+0000 7f27add9b700 1 --2- 172.21.15.84:0/992860745 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27a80b3fb0 0x7f27a814dcf0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f27a400e870 tx=0x7f27a400eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:28.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.541+0000 7f279e7fc700 1 -- 172.21.15.84:0/992860745 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27a4013680 con 0x7f27a80b3fb0 2023-07-14T11:18:28.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.541+0000 7f279e7fc700 1 -- 172.21.15.84:0/992860745 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27a40137e0 con 0x7f27a80b3fb0 2023-07-14T11:18:28.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.541+0000 7f279e7fc700 1 -- 172.21.15.84:0/992860745 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27a4013b90 con 0x7f27a80b3fb0 2023-07-14T11:18:28.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.541+0000 7f27affff700 1 -- 172.21.15.84:0/992860745 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27a80ce3b0 con 0x7f27a80b3fb0 2023-07-14T11:18:28.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.541+0000 7f27affff700 1 -- 172.21.15.84:0/992860745 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27a814e230 con 0x7f27a80b3fb0 2023-07-14T11:18:28.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.542+0000 7f279e7fc700 1 -- 172.21.15.84:0/992860745 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 15) v1 ==== 44861+0+0 (secure 0 0 0) 0x7f27a4013cf0 con 0x7f27a80b3fb0 2023-07-14T11:18:28.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.542+0000 7f27affff700 1 -- 172.21.15.84:0/992860745 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27a80aeba0 con 0x7f27a80b3fb0 2023-07-14T11:18:28.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.542+0000 7f279e7fc700 1 --2- 172.21.15.84:0/992860745 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f278c037a00 0x7f278c039eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:28.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.542+0000 7f279e7fc700 1 -- 172.21.15.84:0/992860745 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6621+0+0 (secure 0 0 0) 0x7f27a404aba0 con 0x7f27a80b3fb0 2023-07-14T11:18:28.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.543+0000 7f27ad59a700 1 --2- 172.21.15.84:0/992860745 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f278c037a00 0x7f278c039eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:28.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.544+0000 7f27ad59a700 1 --2- 172.21.15.84:0/992860745 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f278c037a00 0x7f278c039eb0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2798014040 tx=0x7f2798008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:28.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.547+0000 7f279e7fc700 1 -- 172.21.15.84:0/992860745 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f27a401bbe0 con 0x7f27a80b3fb0 2023-07-14T11:18:28.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.795+0000 7f27affff700 1 -- 172.21.15.84:0/992860745 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f27a804e280 con 0x7f27a80b3fb0 2023-07-14T11:18:28.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.796+0000 7f279e7fc700 1 -- 172.21.15.84:0/992860745 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4717 (secure 0 0 0) 0x7f27a4017090 con 0x7f27a80b3fb0 2023-07-14T11:18:28.798 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:18:28.798 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":46,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5615,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3014145470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3014145470},{"type":"v1","addr":"172.21.15.179:6834","nonce":3014145470}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":5621,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3377004712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":3377004712},{"type":"v1","addr":"172.21.15.179:6835","nonce":3377004712}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":6681,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1864489758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1864489758},{"type":"v1","addr":"172.21.15.84:6835","nonce":1864489758}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T11:17:55.741927+0000","modified":"2023-07-14T11:17:59.277009+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6690},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6690":{"gid":6690,"name":"c","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/2405785300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":2405785300},{"type":"v1","addr":"172.21.15.84:6837","nonce":2405785300}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-07-14T11:18:28.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.798+0000 7f27affff700 1 -- 172.21.15.84:0/992860745 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f278c037a00 msgr2=0x7f278c039eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:28.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.798+0000 7f27affff700 1 --2- 172.21.15.84:0/992860745 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f278c037a00 0x7f278c039eb0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2798014040 tx=0x7f2798008030 comp rx=0 tx=0).stop 2023-07-14T11:18:28.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.798+0000 7f27affff700 1 -- 172.21.15.84:0/992860745 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27a80b3fb0 msgr2=0x7f27a814dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:28.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.798+0000 7f27affff700 1 --2- 172.21.15.84:0/992860745 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27a80b3fb0 0x7f27a814dcf0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f27a400e870 tx=0x7f27a400eb80 comp rx=0 tx=0).stop 2023-07-14T11:18:28.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.798+0000 7f27affff700 1 -- 172.21.15.84:0/992860745 shutdown_connections 2023-07-14T11:18:28.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.798+0000 7f27affff700 1 --2- 172.21.15.84:0/992860745 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f27a8160080 0x7f27a80b2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:28.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.798+0000 7f27affff700 1 --2- 172.21.15.84:0/992860745 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27a80b3fb0 0x7f27a814dcf0 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:28.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.798+0000 7f27affff700 1 --2- 172.21.15.84:0/992860745 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f278c037a00 0x7f278c039eb0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:28.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.798+0000 7f27affff700 1 --2- 172.21.15.84:0/992860745 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f27a815c630 0x7f27a80b1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:28.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.798+0000 7f27affff700 1 -- 172.21.15.84:0/992860745 >> 172.21.15.84:0/992860745 conn(0x7f27a8069f30 msgr2=0x7f27a80b30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:28.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.798+0000 7f27affff700 1 -- 172.21.15.84:0/992860745 shutdown_connections 2023-07-14T11:18:28.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:28.798+0000 7f27affff700 1 -- 172.21.15.84:0/992860745 wait complete. 2023-07-14T11:18:28.802 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 46 2023-07-14T11:18:28.820 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:18:28.964 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:18:28.961+0000 7fdddc059200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-14T11:18:29.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.020+0000 7fad6cfff700 1 Processor -- start 2023-07-14T11:18:29.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.020+0000 7fad6cfff700 1 -- start start 2023-07-14T11:18:29.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.021+0000 7fad6cfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fad6806a640 0x7fad680cf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:29.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.021+0000 7fad6cfff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fad6815cc10 0x7fad6815d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:29.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.021+0000 7fad6cfff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad680cef50 con 0x7fad68156b90 2023-07-14T11:18:29.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.021+0000 7fad6cfff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad680ce6a0 con 0x7fad6806a640 2023-07-14T11:18:29.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.021+0000 7fad6cfff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad680ce920 con 0x7fad6815cc10 2023-07-14T11:18:29.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.022+0000 7fad65d9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fad6806a640 0x7fad680cf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:29.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.022+0000 7fad65d9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fad6806a640 0x7fad680cf3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55542/0 (socket says 172.21.15.84:55542) 2023-07-14T11:18:29.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.022+0000 7fad65d9b700 1 -- 172.21.15.84:0/682321616 learned_addr learned my addr 172.21.15.84:0/682321616 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:29.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.022+0000 7fad66d9d700 1 --2- 172.21.15.84:0/682321616 >> v2:172.21.15.179:3300/0 conn(0x7fad6815cc10 0x7fad6815d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:29.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.022+0000 7fad65d9b700 1 -- 172.21.15.84:0/682321616 >> v2:172.21.15.179:3300/0 conn(0x7fad6815cc10 msgr2=0x7fad6815d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:29.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.022+0000 7fad65d9b700 1 --2- 172.21.15.84:0/682321616 >> v2:172.21.15.179:3300/0 conn(0x7fad6815cc10 0x7fad6815d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:29.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.022+0000 7fad65d9b700 1 -- 172.21.15.84:0/682321616 >> v1:172.21.15.179:6789/0 conn(0x7fad68156b90 legacy=0x7fad68069f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:29.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.022+0000 7fad65d9b700 1 -- 172.21.15.84:0/682321616 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad6815d9b0 con 0x7fad6806a640 2023-07-14T11:18:29.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.022+0000 7fad65d9b700 1 --2- 172.21.15.84:0/682321616 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad6806a640 0x7fad680cf3e0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fad680c6aa0 tx=0x7fad5c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34ed9b1ce30f66f9 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:29.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.023+0000 7fad6559a700 1 -- 172.21.15.84:0/682321616 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5c011830 con 0x7fad6806a640 2023-07-14T11:18:29.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.023+0000 7fad6559a700 1 -- 172.21.15.84:0/682321616 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad5c011990 con 0x7fad6806a640 2023-07-14T11:18:29.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.023+0000 7fad6559a700 1 -- 172.21.15.84:0/682321616 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5c011d20 con 0x7fad6806a640 2023-07-14T11:18:29.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.023+0000 7fad6cfff700 1 -- 172.21.15.84:0/682321616 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad6806a640 msgr2=0x7fad680cf3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:29.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.023+0000 7fad6cfff700 1 --2- 172.21.15.84:0/682321616 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad6806a640 0x7fad680cf3e0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fad680c6aa0 tx=0x7fad5c009bd0 comp rx=0 tx=0).stop 2023-07-14T11:18:29.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.023+0000 7fad6cfff700 1 -- 172.21.15.84:0/682321616 shutdown_connections 2023-07-14T11:18:29.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.023+0000 7fad6cfff700 1 --2- 172.21.15.84:0/682321616 >> v2:172.21.15.179:3300/0 conn(0x7fad6815cc10 0x7fad6815d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:29.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.023+0000 7fad6cfff700 1 --2- 172.21.15.84:0/682321616 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad6806a640 0x7fad680cf3e0 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:29.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.023+0000 7fad6cfff700 1 -- 172.21.15.84:0/682321616 >> 172.21.15.84:0/682321616 conn(0x7fad6806bcd0 msgr2=0x7fad680b1630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:29.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.024+0000 7fad6cfff700 1 -- 172.21.15.84:0/682321616 shutdown_connections 2023-07-14T11:18:29.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.024+0000 7fad6cfff700 1 -- 172.21.15.84:0/682321616 wait complete. 2023-07-14T11:18:29.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.025+0000 7fad6cfff700 1 Processor -- start 2023-07-14T11:18:29.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.025+0000 7fad6cfff700 1 -- start start 2023-07-14T11:18:29.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.026+0000 7fad6cfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fad6806a640 0x7fad680b4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:29.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.026+0000 7fad6cfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad68156b90 0x7fad680b0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:29.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.026+0000 7fad6cfff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad6815cc10 0x7fad681f2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:29.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.026+0000 7fad6cfff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad68150700 con 0x7fad68156b90 2023-07-14T11:18:29.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.026+0000 7fad6cfff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad680c3300 con 0x7fad6815cc10 2023-07-14T11:18:29.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.026+0000 7fad6cfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad680c35e0 con 0x7fad6806a640 2023-07-14T11:18:29.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.026+0000 7fad65d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad68156b90 0x7fad680b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:29.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.027+0000 7fad65d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad68156b90 0x7fad680b0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55546/0 (socket says 172.21.15.84:55546) 2023-07-14T11:18:29.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.027+0000 7fad65d9b700 1 -- 172.21.15.84:0/4219126347 learned_addr learned my addr 172.21.15.84:0/4219126347 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:29.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.027+0000 7fad66d9d700 1 --2- 172.21.15.84:0/4219126347 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad6815cc10 0x7fad681f2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:29.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.027+0000 7fad6659c700 1 --2- 172.21.15.84:0/4219126347 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fad6806a640 0x7fad680b4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:29.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.027+0000 7fad65d9b700 1 -- 172.21.15.84:0/4219126347 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fad6806a640 msgr2=0x7fad680b4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:29.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.027+0000 7fad65d9b700 1 --2- 172.21.15.84:0/4219126347 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fad6806a640 0x7fad680b4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:29.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.027+0000 7fad65d9b700 1 -- 172.21.15.84:0/4219126347 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad6815cc10 msgr2=0x7fad681f2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:29.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.027+0000 7fad65d9b700 1 --2- 172.21.15.84:0/4219126347 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad6815cc10 0x7fad681f2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:29.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.027+0000 7fad65d9b700 1 -- 172.21.15.84:0/4219126347 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad5c009550 con 0x7fad68156b90 2023-07-14T11:18:29.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.027+0000 7fad65d9b700 1 --2- 172.21.15.84:0/4219126347 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad68156b90 0x7fad680b0070 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fad5c000c00 tx=0x7fad5c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:29.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.027+0000 7fad56ffd700 1 -- 172.21.15.84:0/4219126347 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5c0045d0 con 0x7fad68156b90 2023-07-14T11:18:29.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.028+0000 7fad56ffd700 1 -- 172.21.15.84:0/4219126347 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad5c01f070 con 0x7fad68156b90 2023-07-14T11:18:29.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.028+0000 7fad6cfff700 1 -- 172.21.15.84:0/4219126347 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad680c38c0 con 0x7fad68156b90 2023-07-14T11:18:29.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.028+0000 7fad56ffd700 1 -- 172.21.15.84:0/4219126347 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5c0038a0 con 0x7fad68156b90 2023-07-14T11:18:29.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.028+0000 7fad6cfff700 1 -- 172.21.15.84:0/4219126347 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad680c3e80 con 0x7fad68156b90 2023-07-14T11:18:29.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.029+0000 7fad56ffd700 1 -- 172.21.15.84:0/4219126347 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 15) v1 ==== 44861+0+0 (secure 0 0 0) 0x7fad5c003a00 con 0x7fad68156b90 2023-07-14T11:18:29.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.029+0000 7fad6cfff700 1 -- 172.21.15.84:0/4219126347 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad6804e210 con 0x7fad68156b90 2023-07-14T11:18:29.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.029+0000 7fad56ffd700 1 --2- 172.21.15.84:0/4219126347 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fad48037a00 0x7fad48039eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:29.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.029+0000 7fad56ffd700 1 -- 172.21.15.84:0/4219126347 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6621+0+0 (secure 0 0 0) 0x7fad5c021070 con 0x7fad68156b90 2023-07-14T11:18:29.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.030+0000 7fad6659c700 1 --2- 172.21.15.84:0/4219126347 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fad48037a00 0x7fad48039eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:29.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.030+0000 7fad6659c700 1 --2- 172.21.15.84:0/4219126347 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fad48037a00 0x7fad48039eb0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fad680b54d0 tx=0x7fad58009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:29.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.034+0000 7fad56ffd700 1 -- 172.21.15.84:0/4219126347 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fad5c00bc40 con 0x7fad68156b90 2023-07-14T11:18:29.156 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:18:29.154+0000 7fdddc059200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-14T11:18:29.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.235+0000 7fad6cfff700 1 -- 172.21.15.84:0/4219126347 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fad680c6880 con 0x7fad68156b90 2023-07-14T11:18:29.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.236+0000 7fad56ffd700 1 -- 172.21.15.84:0/4219126347 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+19138 (secure 0 0 0) 0x7fad5c02b090 con 0x7fad68156b90 2023-07-14T11:18:29.239 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:18:29.239 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":76,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:18:22.884682+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-07-14T11:17:53.456029+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-07-14T11:17:54.724710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:0/3621960179":"2023-07-15T11:18:22.884618+0000","172.21.15.84:0/866699477":"2023-07-15T11:18:22.884618+0000","172.21.15.84:0/2313824978":"2023-07-15T11:18:22.884618+0000","172.21.15.84:0/1410429649":"2023-07-15T11:18:22.884618+0000","172.21.15.84:0/2317294276":"2023-07-15T11:18:22.884618+0000","172.21.15.84:0/2017899455":"2023-07-15T11:18:22.884618+0000","172.21.15.84:0/2585793132":"2023-07-15T11:18:22.884618+0000","172.21.15.84:6833/379617029":"2023-07-15T11:18:22.884618+0000","172.21.15.84:0/1962247770":"2023-07-15T11:18:22.884618+0000","172.21.15.84:6832/379617029":"2023-07-15T11:18:22.884618+0000","172.21.15.84:0/4142616364":"2023-07-15T11:18:22.884618+0000","172.21.15.84:0/3082191159":"2023-07-15T11:18:22.884618+0000","172.21.15.84:0/1609666652":"2023-07-15T11:18:22.884618+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:18:29.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.239+0000 7fad6cfff700 1 -- 172.21.15.84:0/4219126347 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fad48037a00 msgr2=0x7fad48039eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:29.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.239+0000 7fad6cfff700 1 --2- 172.21.15.84:0/4219126347 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fad48037a00 0x7fad48039eb0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fad680b54d0 tx=0x7fad58009040 comp rx=0 tx=0).stop 2023-07-14T11:18:29.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.239+0000 7fad6cfff700 1 -- 172.21.15.84:0/4219126347 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad68156b90 msgr2=0x7fad680b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:29.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.239+0000 7fad6cfff700 1 --2- 172.21.15.84:0/4219126347 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad68156b90 0x7fad680b0070 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fad5c000c00 tx=0x7fad5c004750 comp rx=0 tx=0).stop 2023-07-14T11:18:29.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.239+0000 7fad6cfff700 1 -- 172.21.15.84:0/4219126347 shutdown_connections 2023-07-14T11:18:29.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.239+0000 7fad6cfff700 1 --2- 172.21.15.84:0/4219126347 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fad48037a00 0x7fad48039eb0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:29.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.239+0000 7fad6cfff700 1 --2- 172.21.15.84:0/4219126347 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fad6806a640 0x7fad680b4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:29.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.239+0000 7fad6cfff700 1 --2- 172.21.15.84:0/4219126347 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad6815cc10 0x7fad681f2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:29.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.239+0000 7fad6cfff700 1 --2- 172.21.15.84:0/4219126347 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad68156b90 0x7fad680b0070 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:29.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.239+0000 7fad6cfff700 1 -- 172.21.15.84:0/4219126347 >> 172.21.15.84:0/4219126347 conn(0x7fad6806bcd0 msgr2=0x7fad680b2930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:29.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.239+0000 7fad6cfff700 1 -- 172.21.15.84:0/4219126347 shutdown_connections 2023-07-14T11:18:29.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.239+0000 7fad6cfff700 1 -- 172.21.15.84:0/4219126347 wait complete. 2023-07-14T11:18:29.260 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-14T11:18:29.359 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:18:29.356+0000 7fdddc059200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-14T11:18:29.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.464+0000 7f66d11ff700 1 Processor -- start 2023-07-14T11:18:29.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.464+0000 7f66d11ff700 1 -- start start 2023-07-14T11:18:29.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.465+0000 7f66d11ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66cc0d1e40 0x7f66cc0cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:29.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.465+0000 7f66d11ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f66cc0c71b0 0x7f66cc0b49d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:29.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.465+0000 7f66d11ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66cc0cd5a0 con 0x7f66cc15c860 2023-07-14T11:18:29.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.465+0000 7f66d11ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66cc0d22b0 con 0x7f66cc0c71b0 2023-07-14T11:18:29.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.465+0000 7f66d11ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66cc146740 con 0x7f66cc0d1e40 2023-07-14T11:18:29.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.466+0000 7f66ca59c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66cc0d1e40 0x7f66cc0cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:29.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.466+0000 7f66cad9d700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f66cc15c860 0x7f66cc0c6aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.84:54290/0 (socket says 172.21.15.84:54290) 2023-07-14T11:18:29.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.466+0000 7f66cad9d700 1 -- 172.21.15.84:0/958442636 learned_addr learned my addr 172.21.15.84:0/958442636 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:18:29.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.466+0000 7f66cb59e700 1 --2- 172.21.15.84:0/958442636 >> v2:172.21.15.179:3300/0 conn(0x7f66cc0c71b0 0x7f66cc0b49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:29.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.466+0000 7f66c9d9b700 1 -- 172.21.15.84:0/958442636 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 961900550 0 0) 0x7f66cc0cd5a0 con 0x7f66cc15c860 2023-07-14T11:18:29.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.466+0000 7f66c9d9b700 1 -- 172.21.15.84:0/958442636 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66b40035b0 con 0x7f66cc15c860 2023-07-14T11:18:29.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.466+0000 7f66cb59e700 1 -- 172.21.15.84:0/958442636 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66cc0d1e40 msgr2=0x7f66cc0cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:29.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.466+0000 7f66cb59e700 1 --2- 172.21.15.84:0/958442636 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66cc0d1e40 0x7f66cc0cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:29.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.466+0000 7f66cb59e700 1 -- 172.21.15.84:0/958442636 >> v1:172.21.15.179:6789/0 conn(0x7f66cc15c860 legacy=0x7f66cc0c6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:29.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.466+0000 7f66cb59e700 1 -- 172.21.15.84:0/958442636 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66cc0cd7f0 con 0x7f66cc0c71b0 2023-07-14T11:18:29.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.467+0000 7f66cb59e700 1 --2- 172.21.15.84:0/958442636 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66cc0c71b0 0x7f66cc0b49d0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f66c4009d90 tx=0x7f66c400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac24b8b80d264af4 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:29.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.467+0000 7f66c9d9b700 1 -- 172.21.15.84:0/958442636 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c400e070 con 0x7f66cc0c71b0 2023-07-14T11:18:29.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.467+0000 7f66c9d9b700 1 -- 172.21.15.84:0/958442636 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66c400bb20 con 0x7f66cc0c71b0 2023-07-14T11:18:29.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.467+0000 7f66c9d9b700 1 -- 172.21.15.84:0/958442636 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c4012430 con 0x7f66cc0c71b0 2023-07-14T11:18:29.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.467+0000 7f66d11ff700 1 -- 172.21.15.84:0/958442636 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66cc0c71b0 msgr2=0x7f66cc0b49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:29.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.467+0000 7f66d11ff700 1 --2- 172.21.15.84:0/958442636 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66cc0c71b0 0x7f66cc0b49d0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f66c4009d90 tx=0x7f66c400b330 comp rx=0 tx=0).stop 2023-07-14T11:18:29.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.468+0000 7f66d11ff700 1 -- 172.21.15.84:0/958442636 shutdown_connections 2023-07-14T11:18:29.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.468+0000 7f66d11ff700 1 --2- 172.21.15.84:0/958442636 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66cc0c71b0 0x7f66cc0b49d0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:29.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.468+0000 7f66d11ff700 1 --2- 172.21.15.84:0/958442636 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66cc0d1e40 0x7f66cc0cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:29.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.468+0000 7f66d11ff700 1 -- 172.21.15.84:0/958442636 >> 172.21.15.84:0/958442636 conn(0x7f66cc065bd0 msgr2=0x7f66cc065fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:29.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.468+0000 7f66d11ff700 1 -- 172.21.15.84:0/958442636 shutdown_connections 2023-07-14T11:18:29.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.468+0000 7f66d11ff700 1 -- 172.21.15.84:0/958442636 wait complete. 2023-07-14T11:18:29.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.470+0000 7f66d11ff700 1 Processor -- start 2023-07-14T11:18:29.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.471+0000 7f66d11ff700 1 -- start start 2023-07-14T11:18:29.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.472+0000 7f66d11ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66cc0c71b0 0x7f66cc156590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:29.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.472+0000 7f66d11ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66cc0d1e40 0x7f66cc1572d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:29.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.472+0000 7f66d11ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66cc15c860 0x7f66cc157810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:29.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.472+0000 7f66d11ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66cc0cb010 con 0x7f66cc15c860 2023-07-14T11:18:29.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.472+0000 7f66d11ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66cc0ca400 con 0x7f66cc0d1e40 2023-07-14T11:18:29.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.472+0000 7f66d11ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66cc0ca6e0 con 0x7f66cc0c71b0 2023-07-14T11:18:29.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.473+0000 7f66cb59e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66cc15c860 0x7f66cc157810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:29.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.473+0000 7f66cb59e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66cc15c860 0x7f66cc157810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55558/0 (socket says 172.21.15.84:55558) 2023-07-14T11:18:29.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.473+0000 7f66cb59e700 1 -- 172.21.15.84:0/3201897471 learned_addr learned my addr 172.21.15.84:0/3201897471 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:29.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.473+0000 7f66ca59c700 1 --2- 172.21.15.84:0/3201897471 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66cc0d1e40 0x7f66cc1572d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:29.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.473+0000 7f66cad9d700 1 --2- 172.21.15.84:0/3201897471 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66cc0c71b0 0x7f66cc156590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:29.477 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-07-14T11:18:29.473+0000 7fdddc059200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-14T11:18:29.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.473+0000 7f66ca59c700 1 -- 172.21.15.84:0/3201897471 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66cc0c71b0 msgr2=0x7f66cc156590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:29.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.473+0000 7f66ca59c700 1 --2- 172.21.15.84:0/3201897471 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66cc0c71b0 0x7f66cc156590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:29.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.473+0000 7f66ca59c700 1 -- 172.21.15.84:0/3201897471 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66cc15c860 msgr2=0x7f66cc157810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:29.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.473+0000 7f66ca59c700 1 --2- 172.21.15.84:0/3201897471 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66cc15c860 0x7f66cc157810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:29.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.473+0000 7f66ca59c700 1 -- 172.21.15.84:0/3201897471 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66c4009a70 con 0x7f66cc0d1e40 2023-07-14T11:18:29.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.473+0000 7f66cb59e700 1 --2- 172.21.15.84:0/3201897471 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66cc15c860 0x7f66cc157810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:18:29.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.474+0000 7f66ca59c700 1 --2- 172.21.15.84:0/3201897471 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66cc0d1e40 0x7f66cc1572d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f66c000e900 tx=0x7f66c000ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:29.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.474+0000 7f66b37fe700 1 -- 172.21.15.84:0/3201897471 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c0013680 con 0x7f66cc0d1e40 2023-07-14T11:18:29.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.474+0000 7f66b37fe700 1 -- 172.21.15.84:0/3201897471 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66c00137e0 con 0x7f66cc0d1e40 2023-07-14T11:18:29.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.474+0000 7f66d11ff700 1 -- 172.21.15.84:0/3201897471 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66cc0ca9c0 con 0x7f66cc0d1e40 2023-07-14T11:18:29.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.474+0000 7f66b37fe700 1 -- 172.21.15.84:0/3201897471 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c0013b50 con 0x7f66cc0d1e40 2023-07-14T11:18:29.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.474+0000 7f66d11ff700 1 -- 172.21.15.84:0/3201897471 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66cc156ad0 con 0x7f66cc0d1e40 2023-07-14T11:18:29.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.475+0000 7f66d11ff700 1 -- 172.21.15.84:0/3201897471 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66cc0cb1c0 con 0x7f66cc0d1e40 2023-07-14T11:18:29.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.475+0000 7f66b37fe700 1 -- 172.21.15.84:0/3201897471 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 15) v1 ==== 44861+0+0 (secure 0 0 0) 0x7f66c0013cb0 con 0x7f66cc0d1e40 2023-07-14T11:18:29.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.476+0000 7f66b37fe700 1 --2- 172.21.15.84:0/3201897471 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f66b8037a30 0x7f66b8039ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:29.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.476+0000 7f66b37fe700 1 -- 172.21.15.84:0/3201897471 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6621+0+0 (secure 0 0 0) 0x7f66c004adf0 con 0x7f66cc0d1e40 2023-07-14T11:18:29.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.477+0000 7f66cad9d700 1 --2- 172.21.15.84:0/3201897471 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f66b8037a30 0x7f66b8039ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:29.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.477+0000 7f66cad9d700 1 --2- 172.21.15.84:0/3201897471 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f66b8037a30 0x7f66b8039ee0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f66bc007fd0 tx=0x7f66bc007dc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:29.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.482+0000 7f66b37fe700 1 -- 172.21.15.84:0/3201897471 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f66cc0cb1c0 con 0x7f66cc0d1e40 2023-07-14T11:18:29.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.715+0000 7f66d11ff700 1 -- 172.21.15.84:0/3201897471 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f66cc0cb1c0 con 0x7f66cc0d1e40 2023-07-14T11:18:29.718 INFO:tasks.ceph.mon.a.smithi084.stderr:2023-07-14T11:18:29.716+0000 7f5e043f4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-14T11:18:29.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.722+0000 7f66b37fe700 1 -- 172.21.15.84:0/3201897471 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v47) v1 ==== 161+0+0 (secure 0 0 0) 0x7f66cc0cb1c0 con 0x7f66cc0d1e40 2023-07-14T11:18:29.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.724+0000 7f66d11ff700 1 -- 172.21.15.84:0/3201897471 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f66b8037a30 msgr2=0x7f66b8039ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:29.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.724+0000 7f66d11ff700 1 --2- 172.21.15.84:0/3201897471 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f66b8037a30 0x7f66b8039ee0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f66bc007fd0 tx=0x7f66bc007dc0 comp rx=0 tx=0).stop 2023-07-14T11:18:29.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.724+0000 7f66d11ff700 1 -- 172.21.15.84:0/3201897471 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66cc0d1e40 msgr2=0x7f66cc1572d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:29.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.724+0000 7f66d11ff700 1 --2- 172.21.15.84:0/3201897471 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66cc0d1e40 0x7f66cc1572d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f66c000e900 tx=0x7f66c000ec10 comp rx=0 tx=0).stop 2023-07-14T11:18:29.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.724+0000 7f66d11ff700 1 -- 172.21.15.84:0/3201897471 shutdown_connections 2023-07-14T11:18:29.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.724+0000 7f66d11ff700 1 --2- 172.21.15.84:0/3201897471 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f66b8037a30 0x7f66b8039ee0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:29.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.724+0000 7f66d11ff700 1 --2- 172.21.15.84:0/3201897471 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66cc0c71b0 0x7f66cc156590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:29.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.724+0000 7f66d11ff700 1 --2- 172.21.15.84:0/3201897471 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66cc15c860 0x7f66cc157810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:29.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.724+0000 7f66d11ff700 1 --2- 172.21.15.84:0/3201897471 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66cc0d1e40 0x7f66cc1572d0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:29.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.724+0000 7f66d11ff700 1 -- 172.21.15.84:0/3201897471 >> 172.21.15.84:0/3201897471 conn(0x7f66cc065bd0 msgr2=0x7f66cc0c7580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:29.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.725+0000 7f66d11ff700 1 -- 172.21.15.84:0/3201897471 shutdown_connections 2023-07-14T11:18:29.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.725+0000 7f66d11ff700 1 -- 172.21.15.84:0/3201897471 wait complete. 2023-07-14T11:18:29.729 INFO:teuthology.orchestra.run.smithi084.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-14T11:18:29.735 INFO:tasks.ceph.mds.c.smithi084.stderr: -9058> 2023-07-14T11:17:59.663+0000 7f5fa49f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-14T11:18:29.745 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-14T11:18:29.790 INFO:tasks.ceph.mds.c.smithi084.stdout:starting mds.c at 2023-07-14T11:18:29.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.948+0000 7f49789ff700 1 Processor -- start 2023-07-14T11:18:29.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.948+0000 7f49789ff700 1 -- start start 2023-07-14T11:18:29.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.949+0000 7f49789ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49740d0480 0x7f49740b6600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:29.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.949+0000 7f49789ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f497415cd60 con 0x7f49740d0010 2023-07-14T11:18:29.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.949+0000 7f49789ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49740cf340 con 0x7f49740b4600 2023-07-14T11:18:29.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.949+0000 7f49789ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49740d1550 con 0x7f49740d0480 2023-07-14T11:18:29.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.950+0000 7f4971d9b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f49740d0010 0x7f49740b5ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:59026/0 (socket says 172.21.15.84:59026) 2023-07-14T11:18:29.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.950+0000 7f4971d9b700 1 -- 172.21.15.84:0/4011725865 learned_addr learned my addr 172.21.15.84:0/4011725865 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:18:29.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.950+0000 7f4972d9d700 1 --2- 172.21.15.84:0/4011725865 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49740d0480 0x7f49740b6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:29.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.950+0000 7f497159a700 1 -- 172.21.15.84:0/4011725865 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1804419297 0 0) 0x7f497415cd60 con 0x7f49740d0010 2023-07-14T11:18:29.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.950+0000 7f497159a700 1 -- 172.21.15.84:0/4011725865 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f495c0035b0 con 0x7f49740d0010 2023-07-14T11:18:29.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.950+0000 7f4972d9d700 1 -- 172.21.15.84:0/4011725865 >> v1:172.21.15.179:6789/0 conn(0x7f49740b4600 legacy=0x7f49740cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:29.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.950+0000 7f4972d9d700 1 -- 172.21.15.84:0/4011725865 >> v1:172.21.15.84:6789/0 conn(0x7f49740d0010 legacy=0x7f49740b5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:29.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.950+0000 7f4972d9d700 1 -- 172.21.15.84:0/4011725865 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49740d0e90 con 0x7f49740d0480 2023-07-14T11:18:29.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.951+0000 7f4972d9d700 1 --2- 172.21.15.84:0/4011725865 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49740d0480 0x7f49740b6600 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f496c009dc0 tx=0x7f496c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f504fc9860b6db0c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:29.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.954+0000 7f497159a700 1 -- 172.21.15.84:0/4011725865 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f496c00e070 con 0x7f49740d0480 2023-07-14T11:18:29.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.954+0000 7f497159a700 1 -- 172.21.15.84:0/4011725865 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f496c00bb20 con 0x7f49740d0480 2023-07-14T11:18:29.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.954+0000 7f497159a700 1 -- 172.21.15.84:0/4011725865 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f496c012430 con 0x7f49740d0480 2023-07-14T11:18:29.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.954+0000 7f49789ff700 1 -- 172.21.15.84:0/4011725865 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49740d0480 msgr2=0x7f49740b6600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:29.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.954+0000 7f49789ff700 1 --2- 172.21.15.84:0/4011725865 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49740d0480 0x7f49740b6600 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f496c009dc0 tx=0x7f496c00b330 comp rx=0 tx=0).stop 2023-07-14T11:18:29.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.955+0000 7f49789ff700 1 -- 172.21.15.84:0/4011725865 shutdown_connections 2023-07-14T11:18:29.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.955+0000 7f49789ff700 1 --2- 172.21.15.84:0/4011725865 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49740d0480 0x7f49740b6600 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:29.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.955+0000 7f49789ff700 1 -- 172.21.15.84:0/4011725865 >> 172.21.15.84:0/4011725865 conn(0x7f497409c200 msgr2=0x7f49740d2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:29.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.955+0000 7f49789ff700 1 -- 172.21.15.84:0/4011725865 shutdown_connections 2023-07-14T11:18:29.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.955+0000 7f49789ff700 1 -- 172.21.15.84:0/4011725865 wait complete. 2023-07-14T11:18:29.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.956+0000 7f49789ff700 1 Processor -- start 2023-07-14T11:18:29.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.956+0000 7f49789ff700 1 -- start start 2023-07-14T11:18:29.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.957+0000 7f49789ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49740d0010 0x7f4974159570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:29.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.957+0000 7f49789ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49740d0480 0x7f49741f2e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:29.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.957+0000 7f49789ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f497415ae20 0x7f497415b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:29.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.957+0000 7f49789ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4974159ab0 con 0x7f49740d0480 2023-07-14T11:18:29.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.957+0000 7f49789ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f497415b7e0 con 0x7f49740d0010 2023-07-14T11:18:29.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.957+0000 7f49789ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49741f3380 con 0x7f497415ae20 2023-07-14T11:18:29.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.958+0000 7f4971d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49740d0480 0x7f49741f2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:29.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.958+0000 7f4971d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49740d0480 0x7f49741f2e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55600/0 (socket says 172.21.15.84:55600) 2023-07-14T11:18:29.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.958+0000 7f4971d9b700 1 -- 172.21.15.84:0/1581902596 learned_addr learned my addr 172.21.15.84:0/1581902596 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:29.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.958+0000 7f497259c700 1 --2- 172.21.15.84:0/1581902596 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49740d0010 0x7f4974159570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:29.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.958+0000 7f4972d9d700 1 --2- 172.21.15.84:0/1581902596 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f497415ae20 0x7f497415b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:29.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.958+0000 7f4971d9b700 1 -- 172.21.15.84:0/1581902596 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f497415ae20 msgr2=0x7f497415b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:29.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.958+0000 7f4971d9b700 1 --2- 172.21.15.84:0/1581902596 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f497415ae20 0x7f497415b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:29.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.958+0000 7f4971d9b700 1 -- 172.21.15.84:0/1581902596 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49740d0010 msgr2=0x7f4974159570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:29.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.958+0000 7f4971d9b700 1 --2- 172.21.15.84:0/1581902596 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49740d0010 0x7f4974159570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:29.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.958+0000 7f4971d9b700 1 -- 172.21.15.84:0/1581902596 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f496c009a70 con 0x7f49740d0480 2023-07-14T11:18:29.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.958+0000 7f4971d9b700 1 --2- 172.21.15.84:0/1581902596 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49740d0480 0x7f49741f2e40 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f496800c700 tx=0x7f496800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:29.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.959+0000 7f4962ffd700 1 -- 172.21.15.84:0/1581902596 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4968005d70 con 0x7f49740d0480 2023-07-14T11:18:29.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.959+0000 7f4962ffd700 1 -- 172.21.15.84:0/1581902596 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49680070d0 con 0x7f49740d0480 2023-07-14T11:18:29.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.959+0000 7f49789ff700 1 -- 172.21.15.84:0/1581902596 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49741e4ea0 con 0x7f49740d0480 2023-07-14T11:18:29.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.959+0000 7f4962ffd700 1 -- 172.21.15.84:0/1581902596 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4968007460 con 0x7f49740d0480 2023-07-14T11:18:29.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.959+0000 7f49789ff700 1 -- 172.21.15.84:0/1581902596 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49741e5460 con 0x7f49740d0480 2023-07-14T11:18:29.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.960+0000 7f49789ff700 1 -- 172.21.15.84:0/1581902596 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4974074350 con 0x7f49740d0480 2023-07-14T11:18:29.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.961+0000 7f4962ffd700 1 -- 172.21.15.84:0/1581902596 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f49680075c0 con 0x7f49740d0480 2023-07-14T11:18:29.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.962+0000 7f4962ffd700 1 --2- 172.21.15.84:0/1581902596 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f495406ae00 0x7f495406d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:29.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.962+0000 7f4962ffd700 1 -- 172.21.15.84:0/1581902596 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6707+0+0 (secure 0 0 0) 0x7f4968088df0 con 0x7f49740d0480 2023-07-14T11:18:29.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.962+0000 7f497259c700 1 --2- 172.21.15.84:0/1581902596 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f495406ae00 0x7f495406d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:29.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.963+0000 7f497259c700 1 --2- 172.21.15.84:0/1581902596 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f495406ae00 0x7f495406d2b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f497415bb60 tx=0x7f4964009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:29.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:29.966+0000 7f4962ffd700 1 -- 172.21.15.84:0/1581902596 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f4968053b00 con 0x7f49740d0480 2023-07-14T11:18:30.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.202+0000 7f49789ff700 1 -- 172.21.15.84:0/1581902596 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f49740d1830 con 0x7f49740d0480 2023-07-14T11:18:30.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.722+0000 7f4962ffd700 1 -- 172.21.15.84:0/1581902596 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v48) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4968057120 con 0x7f49740d0480 2023-07-14T11:18:30.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.724+0000 7f49789ff700 1 -- 172.21.15.84:0/1581902596 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f495406ae00 msgr2=0x7f495406d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:30.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.724+0000 7f49789ff700 1 --2- 172.21.15.84:0/1581902596 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f495406ae00 0x7f495406d2b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f497415bb60 tx=0x7f4964009040 comp rx=0 tx=0).stop 2023-07-14T11:18:30.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.724+0000 7f49789ff700 1 -- 172.21.15.84:0/1581902596 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49740d0480 msgr2=0x7f49741f2e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:30.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.724+0000 7f49789ff700 1 --2- 172.21.15.84:0/1581902596 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49740d0480 0x7f49741f2e40 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f496800c700 tx=0x7f496800ca10 comp rx=0 tx=0).stop 2023-07-14T11:18:30.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.725+0000 7f49789ff700 1 -- 172.21.15.84:0/1581902596 shutdown_connections 2023-07-14T11:18:30.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.725+0000 7f49789ff700 1 --2- 172.21.15.84:0/1581902596 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f495406ae00 0x7f495406d2b0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:30.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.725+0000 7f49789ff700 1 --2- 172.21.15.84:0/1581902596 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f497415ae20 0x7f497415b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:30.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.725+0000 7f49789ff700 1 --2- 172.21.15.84:0/1581902596 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49740d0010 0x7f4974159570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:30.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.725+0000 7f49789ff700 1 --2- 172.21.15.84:0/1581902596 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49740d0480 0x7f49741f2e40 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:30.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.725+0000 7f49789ff700 1 -- 172.21.15.84:0/1581902596 >> 172.21.15.84:0/1581902596 conn(0x7f497409c200 msgr2=0x7f49740b7690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:30.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.725+0000 7f49789ff700 1 -- 172.21.15.84:0/1581902596 shutdown_connections 2023-07-14T11:18:30.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.725+0000 7f49789ff700 1 -- 172.21.15.84:0/1581902596 wait complete. 2023-07-14T11:18:30.746 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-14T11:18:30.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.984+0000 7fe7b71ff700 1 Processor -- start 2023-07-14T11:18:30.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.984+0000 7fe7b71ff700 1 -- start start 2023-07-14T11:18:30.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.985+0000 7fe7b71ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe7b015c890 0x7fe7b00d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:30.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.986+0000 7fe7b71ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7b006c240 0x7fe7b00d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:30.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.986+0000 7fe7b71ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7b015cc60 con 0x7fe7b00b2440 2023-07-14T11:18:30.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.986+0000 7fe7b71ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7b006a7f0 con 0x7fe7b015c890 2023-07-14T11:18:30.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.986+0000 7fe7b71ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b006b760 con 0x7fe7b006c240 2023-07-14T11:18:30.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.986+0000 7fe7affff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fe7b00b2440 0x7fe7b00cf840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:59042/0 (socket says 172.21.15.84:59042) 2023-07-14T11:18:30.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.986+0000 7fe7affff700 1 -- 172.21.15.84:0/1086866200 learned_addr learned my addr 172.21.15.84:0/1086866200 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:18:30.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.986+0000 7fe7b579c700 1 --2- 172.21.15.84:0/1086866200 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7b006c240 0x7fe7b00d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:30.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.986+0000 7fe7b4f9b700 1 --2- 172.21.15.84:0/1086866200 >> v2:172.21.15.179:3300/0 conn(0x7fe7b015c890 0x7fe7b00d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:30.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.986+0000 7fe7af7fe700 1 -- 172.21.15.84:0/1086866200 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2658520096 0 0) 0x7fe7b015cc60 con 0x7fe7b00b2440 2023-07-14T11:18:30.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.986+0000 7fe7af7fe700 1 -- 172.21.15.84:0/1086866200 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7a00035b0 con 0x7fe7b00b2440 2023-07-14T11:18:30.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.987+0000 7fe7af7fe700 1 -- 172.21.15.84:0/1086866200 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 234935713 0 0) 0x7fe7a00035b0 con 0x7fe7b00b2440 2023-07-14T11:18:30.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.987+0000 7fe7af7fe700 1 -- 172.21.15.84:0/1086866200 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7b006c240 msgr2=0x7fe7b00d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:30.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.987+0000 7fe7af7fe700 1 --2- 172.21.15.84:0/1086866200 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7b006c240 0x7fe7b00d0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:30.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.987+0000 7fe7af7fe700 1 -- 172.21.15.84:0/1086866200 >> v2:172.21.15.179:3300/0 conn(0x7fe7b015c890 msgr2=0x7fe7b00d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:30.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.987+0000 7fe7af7fe700 1 --2- 172.21.15.84:0/1086866200 >> v2:172.21.15.179:3300/0 conn(0x7fe7b015c890 0x7fe7b00d0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:30.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.987+0000 7fe7af7fe700 1 -- 172.21.15.84:0/1086866200 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7b006ba40 con 0x7fe7b00b2440 2023-07-14T11:18:30.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.987+0000 7fe7af7fe700 1 -- 172.21.15.84:0/1086866200 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7fe79c001670 con 0x7fe7b00b2440 2023-07-14T11:18:30.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.987+0000 7fe7af7fe700 1 -- 172.21.15.84:0/1086866200 >> v1:172.21.15.84:6789/0 conn(0x7fe7b00b2440 legacy=0x7fe7b00cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:30.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.987+0000 7fe7af7fe700 1 --2- 172.21.15.84:0/1086866200 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7b006c240 0x7fe7a0003ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:30.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.987+0000 7fe7af7fe700 1 --2- 172.21.15.84:0/1086866200 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7a0004040 0x7fe7a0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:30.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.987+0000 7fe7af7fe700 1 --2- 172.21.15.84:0/1086866200 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7a0004d90 0x7fe7a0005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:30.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.987+0000 7fe7af7fe700 1 -- 172.21.15.84:0/1086866200 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b006a7f0 con 0x7fe7a0004040 2023-07-14T11:18:30.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.987+0000 7fe7af7fe700 1 -- 172.21.15.84:0/1086866200 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b006b760 con 0x7fe7a0004d90 2023-07-14T11:18:30.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.987+0000 7fe7af7fe700 1 -- 172.21.15.84:0/1086866200 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a000ba60 con 0x7fe7b006c240 2023-07-14T11:18:30.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.987+0000 7fe7affff700 1 --2- 172.21.15.84:0/1086866200 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7a0004040 0x7fe7a0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:30.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.987+0000 7fe7b4f9b700 1 --2- 172.21.15.84:0/1086866200 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7b006c240 0x7fe7a0003ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:30.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.987+0000 7fe7b579c700 1 --2- 172.21.15.84:0/1086866200 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7a0004d90 0x7fe7a0005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:30.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.987+0000 7fe7affff700 1 -- 172.21.15.84:0/1086866200 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7b006c240 msgr2=0x7fe7a0003ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:30.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.987+0000 7fe7affff700 1 --2- 172.21.15.84:0/1086866200 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7b006c240 0x7fe7a0003ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:30.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.987+0000 7fe7affff700 1 -- 172.21.15.84:0/1086866200 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7a0004d90 msgr2=0x7fe7a0005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:30.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.987+0000 7fe7affff700 1 --2- 172.21.15.84:0/1086866200 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7a0004d90 0x7fe7a0005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:30.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.987+0000 7fe7affff700 1 -- 172.21.15.84:0/1086866200 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a00035b0 con 0x7fe7a0004040 2023-07-14T11:18:30.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.988+0000 7fe7affff700 1 --2- 172.21.15.84:0/1086866200 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7a0004040 0x7fe7a0004850 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fe79c00c270 tx=0x7fe7a0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83263f067b50dd73 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:30.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.988+0000 7fe7af7fe700 1 -- 172.21.15.84:0/1086866200 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79c007c10 con 0x7fe7a0004040 2023-07-14T11:18:30.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.988+0000 7fe7af7fe700 1 -- 172.21.15.84:0/1086866200 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe79c00cdd0 con 0x7fe7a0004040 2023-07-14T11:18:30.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.988+0000 7fe7af7fe700 1 -- 172.21.15.84:0/1086866200 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79c005ba0 con 0x7fe7a0004040 2023-07-14T11:18:30.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.988+0000 7fe7b71ff700 1 -- 172.21.15.84:0/1086866200 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7a0004040 msgr2=0x7fe7a0004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:30.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.988+0000 7fe7b71ff700 1 --2- 172.21.15.84:0/1086866200 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7a0004040 0x7fe7a0004850 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fe79c00c270 tx=0x7fe7a0005880 comp rx=0 tx=0).stop 2023-07-14T11:18:30.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.988+0000 7fe7b579c700 1 -- 172.21.15.84:0/1086866200 reap_dead start 2023-07-14T11:18:30.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.989+0000 7fe7b71ff700 1 -- 172.21.15.84:0/1086866200 shutdown_connections 2023-07-14T11:18:30.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.989+0000 7fe7b71ff700 1 -- 172.21.15.84:0/1086866200 >> 172.21.15.84:0/1086866200 conn(0x7fe7b009c170 msgr2=0x7fe7b00d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:30.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.989+0000 7fe7b71ff700 1 -- 172.21.15.84:0/1086866200 shutdown_connections 2023-07-14T11:18:30.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.989+0000 7fe7b71ff700 1 -- 172.21.15.84:0/1086866200 wait complete. 2023-07-14T11:18:30.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.990+0000 7fe7b71ff700 1 Processor -- start 2023-07-14T11:18:30.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.991+0000 7fe7b71ff700 1 -- start start 2023-07-14T11:18:30.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.991+0000 7fe7b71ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7a0004040 0x7fe7b01f1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:30.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.991+0000 7fe7b71ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7b01f20e0 0x7fe7b0156ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:30.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.991+0000 7fe7b71ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7b0157530 0x7fe7b0154ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:30.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.991+0000 7fe7b71ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b01579a0 con 0x7fe7b0157530 2023-07-14T11:18:30.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.991+0000 7fe7b71ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b0155a50 con 0x7fe7b01f20e0 2023-07-14T11:18:30.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.991+0000 7fe7b71ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b0155d30 con 0x7fe7a0004040 2023-07-14T11:18:30.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.992+0000 7fe7b579c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7b0157530 0x7fe7b0154ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:30.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.992+0000 7fe7b579c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7b0157530 0x7fe7b0154ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55612/0 (socket says 172.21.15.84:55612) 2023-07-14T11:18:30.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.992+0000 7fe7b579c700 1 -- 172.21.15.84:0/4176113035 learned_addr learned my addr 172.21.15.84:0/4176113035 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:30.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.992+0000 7fe7b4f9b700 1 --2- 172.21.15.84:0/4176113035 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7a0004040 0x7fe7b01f1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:30.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.992+0000 7fe7affff700 1 --2- 172.21.15.84:0/4176113035 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7b01f20e0 0x7fe7b0156ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:30.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.992+0000 7fe7b579c700 1 -- 172.21.15.84:0/4176113035 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7a0004040 msgr2=0x7fe7b01f1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:30.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.992+0000 7fe7b579c700 1 --2- 172.21.15.84:0/4176113035 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7a0004040 0x7fe7b01f1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:31.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.992+0000 7fe7b579c700 1 -- 172.21.15.84:0/4176113035 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7b01f20e0 msgr2=0x7fe7b0156ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:31.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.992+0000 7fe7b579c700 1 --2- 172.21.15.84:0/4176113035 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7b01f20e0 0x7fe7b0156ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:31.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.992+0000 7fe7b579c700 1 -- 172.21.15.84:0/4176113035 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7b0156010 con 0x7fe7b0157530 2023-07-14T11:18:31.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.992+0000 7fe7affff700 1 --2- 172.21.15.84:0/4176113035 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7b01f20e0 0x7fe7b0156ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:18:31.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.992+0000 7fe7b579c700 1 --2- 172.21.15.84:0/4176113035 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7b0157530 0x7fe7b0154ce0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fe7b008bdc0 tx=0x7fe7a80114b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:31.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.992+0000 7fe7ad7fa700 1 -- 172.21.15.84:0/4176113035 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a800e070 con 0x7fe7b0157530 2023-07-14T11:18:31.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.993+0000 7fe7ad7fa700 1 -- 172.21.15.84:0/4176113035 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7a8003c30 con 0x7fe7b0157530 2023-07-14T11:18:31.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.993+0000 7fe7b71ff700 1 -- 172.21.15.84:0/4176113035 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7b01562f0 con 0x7fe7b0157530 2023-07-14T11:18:31.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.993+0000 7fe7ad7fa700 1 -- 172.21.15.84:0/4176113035 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a8003de0 con 0x7fe7b0157530 2023-07-14T11:18:31.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.993+0000 7fe7b71ff700 1 -- 172.21.15.84:0/4176113035 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7b0155400 con 0x7fe7b0157530 2023-07-14T11:18:31.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.994+0000 7fe7b71ff700 1 -- 172.21.15.84:0/4176113035 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7b0156660 con 0x7fe7b0157530 2023-07-14T11:18:31.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.995+0000 7fe7ad7fa700 1 -- 172.21.15.84:0/4176113035 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7fe7a8011a10 con 0x7fe7b0157530 2023-07-14T11:18:31.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.996+0000 7fe7ad7fa700 1 --2- 172.21.15.84:0/4176113035 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fe79406ae00 0x7fe79406d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:31.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.997+0000 7fe7ad7fa700 1 -- 172.21.15.84:0/4176113035 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6707+0+0 (secure 0 0 0) 0x7fe7a8089ec0 con 0x7fe7b0157530 2023-07-14T11:18:31.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.997+0000 7fe7b4f9b700 1 --2- 172.21.15.84:0/4176113035 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fe79406ae00 0x7fe79406d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:31.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:30.998+0000 7fe7b4f9b700 1 --2- 172.21.15.84:0/4176113035 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fe79406ae00 0x7fe79406d2b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe7a4009c60 tx=0x7fe7a4009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:31.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:31.001+0000 7fe7ad7fa700 1 -- 172.21.15.84:0/4176113035 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe7a8054a20 con 0x7fe7b0157530 2023-07-14T11:18:31.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:31.196+0000 7fe7b71ff700 1 -- 172.21.15.84:0/4176113035 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe7b0156810 con 0x7fe7b0157530 2023-07-14T11:18:31.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:31.956+0000 7fe7ad7fa700 1 -- 172.21.15.84:0/4176113035 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v78) v1 ==== 181+0+0 (secure 0 0 0) 0x7fe7b0156810 con 0x7fe7b0157530 2023-07-14T11:18:31.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:31.960+0000 7fe7b71ff700 1 -- 172.21.15.84:0/4176113035 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fe79406ae00 msgr2=0x7fe79406d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:31.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:31.960+0000 7fe7b71ff700 1 --2- 172.21.15.84:0/4176113035 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fe79406ae00 0x7fe79406d2b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe7a4009c60 tx=0x7fe7a4009210 comp rx=0 tx=0).stop 2023-07-14T11:18:31.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:31.960+0000 7fe7b71ff700 1 -- 172.21.15.84:0/4176113035 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7b0157530 msgr2=0x7fe7b0154ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:31.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:31.960+0000 7fe7b71ff700 1 --2- 172.21.15.84:0/4176113035 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7b0157530 0x7fe7b0154ce0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fe7b008bdc0 tx=0x7fe7a80114b0 comp rx=0 tx=0).stop 2023-07-14T11:18:31.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:31.961+0000 7fe7b71ff700 1 -- 172.21.15.84:0/4176113035 shutdown_connections 2023-07-14T11:18:31.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:31.961+0000 7fe7b71ff700 1 --2- 172.21.15.84:0/4176113035 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fe79406ae00 0x7fe79406d2b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:31.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:31.961+0000 7fe7b71ff700 1 --2- 172.21.15.84:0/4176113035 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7a0004040 0x7fe7b01f1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:31.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:31.961+0000 7fe7b71ff700 1 --2- 172.21.15.84:0/4176113035 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7b0157530 0x7fe7b0154ce0 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:31.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:31.961+0000 7fe7b71ff700 1 --2- 172.21.15.84:0/4176113035 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7b01f20e0 0x7fe7b0156ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:31.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:31.961+0000 7fe7b71ff700 1 -- 172.21.15.84:0/4176113035 >> 172.21.15.84:0/4176113035 conn(0x7fe7b009c170 msgr2=0x7fe7b01593a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:31.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:31.961+0000 7fe7b71ff700 1 -- 172.21.15.84:0/4176113035 shutdown_connections 2023-07-14T11:18:31.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:31.962+0000 7fe7b71ff700 1 -- 172.21.15.84:0/4176113035 wait complete. 2023-07-14T11:18:31.965 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_metadata' removed 2023-07-14T11:18:31.986 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-14T11:18:32.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:32.185+0000 7f97167ff700 1 Processor -- start 2023-07-14T11:18:32.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:32.185+0000 7f97167ff700 1 -- start start 2023-07-14T11:18:32.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:32.186+0000 7f97167ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f971006b750 0x7f97100cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:32.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:32.186+0000 7f97167ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97100cd410 con 0x7f97100cc340 2023-07-14T11:18:32.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:32.186+0000 7f97167ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97100cce50 con 0x7f97100cba30 2023-07-14T11:18:32.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:32.186+0000 7f97167ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97100cd130 con 0x7f971006b750 2023-07-14T11:18:32.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:32.186+0000 7f970f7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f971006b750 0x7f97100cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:32.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:32.186+0000 7f9714d9c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f97100cc340 0x7f97100cf0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:59044/0 (socket says 172.21.15.84:59044) 2023-07-14T11:18:32.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:32.186+0000 7f9714d9c700 1 -- 172.21.15.84:0/240080027 learned_addr learned my addr 172.21.15.84:0/240080027 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:18:32.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:32.187+0000 7f970f7fe700 1 -- 172.21.15.84:0/240080027 >> v1:172.21.15.179:6789/0 conn(0x7f97100cba30 legacy=0x7f971006b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:32.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:32.187+0000 7f970f7fe700 1 -- 172.21.15.84:0/240080027 >> v1:172.21.15.84:6789/0 conn(0x7f97100cc340 legacy=0x7f97100cf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:32.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:32.187+0000 7f970f7fe700 1 -- 172.21.15.84:0/240080027 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97100ce8f0 con 0x7f971006b750 2023-07-14T11:18:32.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:32.187+0000 7f970effd700 1 -- 172.21.15.84:0/240080027 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3832286916 0 0) 0x7f97100cd410 con 0x7f97100cc340 2023-07-14T11:18:32.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:32.187+0000 7f970f7fe700 1 --2- 172.21.15.84:0/240080027 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f971006b750 0x7f97100cbe00 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f9704009840 tx=0x7f9704009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c9f665cb7774806 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:32.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:32.187+0000 7f970effd700 1 -- 172.21.15.84:0/240080027 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9704011830 con 0x7f971006b750 2023-07-14T11:18:32.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:32.187+0000 7f970effd700 1 -- 172.21.15.84:0/240080027 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9704011990 con 0x7f971006b750 2023-07-14T11:18:32.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:32.187+0000 7f970effd700 1 -- 172.21.15.84:0/240080027 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9704011d20 con 0x7f971006b750 2023-07-14T11:18:32.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:32.188+0000 7f97167ff700 1 -- 172.21.15.84:0/240080027 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f971006b750 msgr2=0x7f97100cbe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:32.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:32.188+0000 7f97167ff700 1 --2- 172.21.15.84:0/240080027 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f971006b750 0x7f97100cbe00 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f9704009840 tx=0x7f9704009b50 comp rx=0 tx=0).stop 2023-07-14T11:18:32.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:32.188+0000 7f97167ff700 1 -- 172.21.15.84:0/240080027 shutdown_connections 2023-07-14T11:18:32.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:32.188+0000 7f97167ff700 1 --2- 172.21.15.84:0/240080027 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f971006b750 0x7f97100cbe00 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:32.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:32.188+0000 7f97167ff700 1 -- 172.21.15.84:0/240080027 >> 172.21.15.84:0/240080027 conn(0x7f9710099f40 msgr2=0x7f97100d0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:32.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:32.188+0000 7f97167ff700 1 -- 172.21.15.84:0/240080027 shutdown_connections 2023-07-14T11:18:32.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:32.188+0000 7f97167ff700 1 -- 172.21.15.84:0/240080027 wait complete. 2023-07-14T11:18:32.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:32.189+0000 7f97167ff700 1 Processor -- start 2023-07-14T11:18:32.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:32.190+0000 7f97167ff700 1 -- start start 2023-07-14T11:18:32.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:32.191+0000 7f97167ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f971006b750 0x7f971014d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:32.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:32.191+0000 7f97167ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97100cba30 0x7f97100b50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:32.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:32.191+0000 7f97167ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97100cc340 0x7f97100b55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:32.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:32.191+0000 7f97167ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f971014d600 con 0x7f97100cc340 2023-07-14T11:18:32.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:32.191+0000 7f97167ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97100c8c20 con 0x7f97100cba30 2023-07-14T11:18:32.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:32.191+0000 7f97167ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97100c8f00 con 0x7f971006b750 2023-07-14T11:18:32.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:32.191+0000 7f9714d9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97100cc340 0x7f97100b55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:32.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:32.191+0000 7f9714d9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97100cc340 0x7f97100b55f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55628/0 (socket says 172.21.15.84:55628) 2023-07-14T11:18:32.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:32.191+0000 7f9714d9c700 1 -- 172.21.15.84:0/3479557768 learned_addr learned my addr 172.21.15.84:0/3479557768 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:32.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:32.191+0000 7f970ffff700 1 --2- 172.21.15.84:0/3479557768 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f971006b750 0x7f971014d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:32.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:32.191+0000 7f970f7fe700 1 --2- 172.21.15.84:0/3479557768 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97100cba30 0x7f97100b50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:32.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:32.191+0000 7f9714d9c700 1 -- 172.21.15.84:0/3479557768 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f971006b750 msgr2=0x7f971014d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:32.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:32.191+0000 7f9714d9c700 1 --2- 172.21.15.84:0/3479557768 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f971006b750 0x7f971014d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:32.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:32.191+0000 7f9714d9c700 1 -- 172.21.15.84:0/3479557768 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97100cba30 msgr2=0x7f97100b50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:32.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:32.191+0000 7f9714d9c700 1 --2- 172.21.15.84:0/3479557768 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97100cba30 0x7f97100b50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:32.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:32.191+0000 7f9714d9c700 1 -- 172.21.15.84:0/3479557768 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97040094a0 con 0x7f97100cc340 2023-07-14T11:18:32.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:32.191+0000 7f970ffff700 1 --2- 172.21.15.84:0/3479557768 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f971006b750 0x7f971014d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:18:32.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:32.192+0000 7f9714d9c700 1 --2- 172.21.15.84:0/3479557768 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97100cc340 0x7f97100b55f0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f9708002230 tx=0x7f970800cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:32.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:32.192+0000 7f970cff9700 1 -- 172.21.15.84:0/3479557768 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f970800ab70 con 0x7f97100cc340 2023-07-14T11:18:32.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:32.192+0000 7f970cff9700 1 -- 172.21.15.84:0/3479557768 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f970800acf0 con 0x7f97100cc340 2023-07-14T11:18:32.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:32.192+0000 7f970cff9700 1 -- 172.21.15.84:0/3479557768 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9708007310 con 0x7f97100cc340 2023-07-14T11:18:32.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:32.192+0000 7f97167ff700 1 -- 172.21.15.84:0/3479557768 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97100c91e0 con 0x7f97100cc340 2023-07-14T11:18:32.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:32.192+0000 7f97167ff700 1 -- 172.21.15.84:0/3479557768 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97100c97a0 con 0x7f97100cc340 2023-07-14T11:18:32.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:32.193+0000 7f97167ff700 1 -- 172.21.15.84:0/3479557768 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97100ce520 con 0x7f97100cc340 2023-07-14T11:18:32.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:32.194+0000 7f970cff9700 1 -- 172.21.15.84:0/3479557768 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f9708007470 con 0x7f97100cc340 2023-07-14T11:18:32.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:32.195+0000 7f970cff9700 1 --2- 172.21.15.84:0/3479557768 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f96fc06ae00 0x7f96fc06d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:32.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:32.195+0000 7f970cff9700 1 -- 172.21.15.84:0/3479557768 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6269+0+0 (secure 0 0 0) 0x7f97080891a0 con 0x7f97100cc340 2023-07-14T11:18:32.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:32.195+0000 7f970ffff700 1 --2- 172.21.15.84:0/3479557768 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f96fc06ae00 0x7f96fc06d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:32.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:32.196+0000 7f970ffff700 1 --2- 172.21.15.84:0/3479557768 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f96fc06ae00 0x7f96fc06d2b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9700000fb0 tx=0x7f9700009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:32.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:32.199+0000 7f970cff9700 1 -- 172.21.15.84:0/3479557768 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f9708054070 con 0x7f97100cc340 2023-07-14T11:18:32.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:32.393+0000 7f97167ff700 1 -- 172.21.15.84:0/3479557768 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f97100c9990 con 0x7f97100cc340 2023-07-14T11:18:32.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:32.969+0000 7f970cff9700 1 -- 172.21.15.84:0/3479557768 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v79) v1 ==== 169+0+0 (secure 0 0 0) 0x7f970800ae60 con 0x7f97100cc340 2023-07-14T11:18:32.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:32.974+0000 7f97167ff700 1 -- 172.21.15.84:0/3479557768 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f96fc06ae00 msgr2=0x7f96fc06d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:32.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:32.974+0000 7f97167ff700 1 --2- 172.21.15.84:0/3479557768 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f96fc06ae00 0x7f96fc06d2b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9700000fb0 tx=0x7f9700009040 comp rx=0 tx=0).stop 2023-07-14T11:18:32.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:32.974+0000 7f97167ff700 1 -- 172.21.15.84:0/3479557768 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97100cc340 msgr2=0x7f97100b55f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:32.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:32.974+0000 7f97167ff700 1 --2- 172.21.15.84:0/3479557768 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97100cc340 0x7f97100b55f0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f9708002230 tx=0x7f970800cf50 comp rx=0 tx=0).stop 2023-07-14T11:18:32.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:32.974+0000 7f97167ff700 1 -- 172.21.15.84:0/3479557768 shutdown_connections 2023-07-14T11:18:32.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:32.974+0000 7f97167ff700 1 --2- 172.21.15.84:0/3479557768 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f96fc06ae00 0x7f96fc06d2b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:32.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:32.974+0000 7f97167ff700 1 --2- 172.21.15.84:0/3479557768 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f971006b750 0x7f971014d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:32.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:32.974+0000 7f97167ff700 1 --2- 172.21.15.84:0/3479557768 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97100cc340 0x7f97100b55f0 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:32.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:32.974+0000 7f97167ff700 1 --2- 172.21.15.84:0/3479557768 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97100cba30 0x7f97100b50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:32.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:32.974+0000 7f97167ff700 1 -- 172.21.15.84:0/3479557768 >> 172.21.15.84:0/3479557768 conn(0x7f9710099f40 msgr2=0x7f97100d0400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:32.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:32.974+0000 7f97167ff700 1 -- 172.21.15.84:0/3479557768 shutdown_connections 2023-07-14T11:18:32.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:32.974+0000 7f97167ff700 1 -- 172.21.15.84:0/3479557768 wait complete. 2023-07-14T11:18:32.978 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data' removed 2023-07-14T11:18:32.996 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-14T11:18:33.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.203+0000 7f03e3fff700 1 Processor -- start 2023-07-14T11:18:33.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.203+0000 7f03e3fff700 1 -- start start 2023-07-14T11:18:33.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.205+0000 7f03e3fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f03dc06a1a0 0x7f03dc071270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:33.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.205+0000 7f03e3fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f03dc0ce680 0x7f03dc0cad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:33.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.205+0000 7f03e3fff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03dc0ceae0 con 0x7f03dc06a570 2023-07-14T11:18:33.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.205+0000 7f03e3fff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03dc071f10 con 0x7f03dc0ce680 2023-07-14T11:18:33.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.205+0000 7f03e3fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03dc071950 con 0x7f03dc06a1a0 2023-07-14T11:18:33.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.205+0000 7f03e259c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f03dc0ce680 0x7f03dc0cad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:33.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.205+0000 7f03e259c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f03dc0ce680 0x7f03dc0cad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55630/0 (socket says 172.21.15.84:55630) 2023-07-14T11:18:33.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.205+0000 7f03e159a700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f03dc06a570 0x7f03dc160b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:59054/0 (socket says 172.21.15.84:59054) 2023-07-14T11:18:33.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.205+0000 7f03e259c700 1 -- 172.21.15.84:0/2279337434 learned_addr learned my addr 172.21.15.84:0/2279337434 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:33.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.205+0000 7f03e1d9b700 1 --2- 172.21.15.84:0/2279337434 >> v2:172.21.15.179:3300/0 conn(0x7f03dc06a1a0 0x7f03dc071270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:33.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.206+0000 7f03e259c700 1 -- 172.21.15.84:0/2279337434 >> v2:172.21.15.179:3300/0 conn(0x7f03dc06a1a0 msgr2=0x7f03dc071270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:33.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.206+0000 7f03e259c700 1 --2- 172.21.15.84:0/2279337434 >> v2:172.21.15.179:3300/0 conn(0x7f03dc06a1a0 0x7f03dc071270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:33.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.206+0000 7f03e259c700 1 -- 172.21.15.84:0/2279337434 >> v1:172.21.15.84:6789/0 conn(0x7f03dc06a570 legacy=0x7f03dc160b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:33.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.206+0000 7f03e259c700 1 -- 172.21.15.84:0/2279337434 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03dc071c30 con 0x7f03dc0ce680 2023-07-14T11:18:33.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.206+0000 7f03e259c700 1 --2- 172.21.15.84:0/2279337434 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03dc0ce680 0x7f03dc0cad80 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f03dc066fc0 tx=0x7f03d400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=641b560fecf27de8 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:33.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.206+0000 7f03e0d99700 1 -- 172.21.15.84:0/2279337434 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d400e070 con 0x7f03dc0ce680 2023-07-14T11:18:33.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.206+0000 7f03e0d99700 1 -- 172.21.15.84:0/2279337434 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03d400b9c0 con 0x7f03dc0ce680 2023-07-14T11:18:33.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.206+0000 7f03e0d99700 1 -- 172.21.15.84:0/2279337434 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d400bd70 con 0x7f03dc0ce680 2023-07-14T11:18:33.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.207+0000 7f03e3fff700 1 -- 172.21.15.84:0/2279337434 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03dc0ce680 msgr2=0x7f03dc0cad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:33.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.207+0000 7f03e3fff700 1 --2- 172.21.15.84:0/2279337434 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03dc0ce680 0x7f03dc0cad80 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f03dc066fc0 tx=0x7f03d400b330 comp rx=0 tx=0).stop 2023-07-14T11:18:33.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.207+0000 7f03e3fff700 1 -- 172.21.15.84:0/2279337434 shutdown_connections 2023-07-14T11:18:33.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.207+0000 7f03e3fff700 1 --2- 172.21.15.84:0/2279337434 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03dc0ce680 0x7f03dc0cad80 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:33.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.207+0000 7f03e3fff700 1 --2- 172.21.15.84:0/2279337434 >> v2:172.21.15.179:3300/0 conn(0x7f03dc06a1a0 0x7f03dc071270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:33.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.207+0000 7f03e3fff700 1 -- 172.21.15.84:0/2279337434 >> 172.21.15.84:0/2279337434 conn(0x7f03dc0cef10 msgr2=0x7f03dc0cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:33.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.207+0000 7f03e3fff700 1 -- 172.21.15.84:0/2279337434 shutdown_connections 2023-07-14T11:18:33.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.207+0000 7f03e3fff700 1 -- 172.21.15.84:0/2279337434 wait complete. 2023-07-14T11:18:33.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.208+0000 7f03e3fff700 1 Processor -- start 2023-07-14T11:18:33.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.209+0000 7f03e3fff700 1 -- start start 2023-07-14T11:18:33.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.209+0000 7f03e3fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03dc06a1a0 0x7f03dc1510a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:33.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.209+0000 7f03e3fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03dc06a570 0x7f03dc09b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:33.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.209+0000 7f03e3fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03dc0ce680 0x7f03dc09bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:33.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.209+0000 7f03e3fff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03dc09b4a0 con 0x7f03dc06a1a0 2023-07-14T11:18:33.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.209+0000 7f03e3fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03dc15d950 con 0x7f03dc0ce680 2023-07-14T11:18:33.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.209+0000 7f03e3fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03dc15dc30 con 0x7f03dc06a570 2023-07-14T11:18:33.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.210+0000 7f03e1d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03dc06a1a0 0x7f03dc1510a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:33.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.210+0000 7f03e1d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03dc06a1a0 0x7f03dc1510a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55646/0 (socket says 172.21.15.84:55646) 2023-07-14T11:18:33.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.210+0000 7f03e1d9b700 1 -- 172.21.15.84:0/3549182866 learned_addr learned my addr 172.21.15.84:0/3549182866 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:33.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.210+0000 7f03e259c700 1 --2- 172.21.15.84:0/3549182866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03dc0ce680 0x7f03dc09bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:33.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.210+0000 7f03e159a700 1 --2- 172.21.15.84:0/3549182866 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03dc06a570 0x7f03dc09b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:33.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.210+0000 7f03e1d9b700 1 -- 172.21.15.84:0/3549182866 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03dc06a570 msgr2=0x7f03dc09b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:33.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.210+0000 7f03e1d9b700 1 --2- 172.21.15.84:0/3549182866 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03dc06a570 0x7f03dc09b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:33.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.210+0000 7f03e1d9b700 1 -- 172.21.15.84:0/3549182866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03dc0ce680 msgr2=0x7f03dc09bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:33.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.210+0000 7f03e1d9b700 1 --2- 172.21.15.84:0/3549182866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03dc0ce680 0x7f03dc09bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:33.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.210+0000 7f03e1d9b700 1 -- 172.21.15.84:0/3549182866 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03d4009b30 con 0x7f03dc06a1a0 2023-07-14T11:18:33.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.210+0000 7f03e1d9b700 1 --2- 172.21.15.84:0/3549182866 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03dc06a1a0 0x7f03dc1510a0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f03d800e810 tx=0x7f03d800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:33.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.210+0000 7f03d27fc700 1 -- 172.21.15.84:0/3549182866 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d8013610 con 0x7f03dc06a1a0 2023-07-14T11:18:33.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.211+0000 7f03d27fc700 1 -- 172.21.15.84:0/3549182866 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03d8013770 con 0x7f03dc06a1a0 2023-07-14T11:18:33.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.211+0000 7f03d27fc700 1 -- 172.21.15.84:0/3549182866 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d8013b20 con 0x7f03dc06a1a0 2023-07-14T11:18:33.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.211+0000 7f03e3fff700 1 -- 172.21.15.84:0/3549182866 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03dc15df10 con 0x7f03dc06a1a0 2023-07-14T11:18:33.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.211+0000 7f03e3fff700 1 -- 172.21.15.84:0/3549182866 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03dc09a720 con 0x7f03dc06a1a0 2023-07-14T11:18:33.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.212+0000 7f03e3fff700 1 -- 172.21.15.84:0/3549182866 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03dc15e280 con 0x7f03dc06a1a0 2023-07-14T11:18:33.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.213+0000 7f03d27fc700 1 -- 172.21.15.84:0/3549182866 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f03d8013c80 con 0x7f03dc06a1a0 2023-07-14T11:18:33.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.214+0000 7f03d27fc700 1 --2- 172.21.15.84:0/3549182866 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f03c006ae00 0x7f03c006d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:33.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.214+0000 7f03d27fc700 1 -- 172.21.15.84:0/3549182866 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5855+0+0 (secure 0 0 0) 0x7f03d8089220 con 0x7f03dc06a1a0 2023-07-14T11:18:33.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.214+0000 7f03e159a700 1 --2- 172.21.15.84:0/3549182866 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f03c006ae00 0x7f03c006d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:33.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.215+0000 7f03e159a700 1 --2- 172.21.15.84:0/3549182866 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f03c006ae00 0x7f03c006d2b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f03dc0ac370 tx=0x7f03cc007d10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:33.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.218+0000 7f03d27fc700 1 -- 172.21.15.84:0/3549182866 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f03d8057c20 con 0x7f03dc06a1a0 2023-07-14T11:18:33.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.413+0000 7f03e3fff700 1 -- 172.21.15.84:0/3549182866 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f03dc15d790 con 0x7f03dc06a1a0 2023-07-14T11:18:33.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.417+0000 7f03d27fc700 1 -- 172.21.15.84:0/3549182866 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7f03d80577b0 con 0x7f03dc06a1a0 2023-07-14T11:18:33.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.419+0000 7f03e3fff700 1 -- 172.21.15.84:0/3549182866 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f03c006ae00 msgr2=0x7f03c006d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:33.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.419+0000 7f03e3fff700 1 --2- 172.21.15.84:0/3549182866 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f03c006ae00 0x7f03c006d2b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f03dc0ac370 tx=0x7f03cc007d10 comp rx=0 tx=0).stop 2023-07-14T11:18:33.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.419+0000 7f03e3fff700 1 -- 172.21.15.84:0/3549182866 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03dc06a1a0 msgr2=0x7f03dc1510a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:33.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.420+0000 7f03e3fff700 1 --2- 172.21.15.84:0/3549182866 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03dc06a1a0 0x7f03dc1510a0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f03d800e810 tx=0x7f03d800eb20 comp rx=0 tx=0).stop 2023-07-14T11:18:33.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.420+0000 7f03e3fff700 1 -- 172.21.15.84:0/3549182866 shutdown_connections 2023-07-14T11:18:33.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.420+0000 7f03e3fff700 1 --2- 172.21.15.84:0/3549182866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03dc0ce680 0x7f03dc09bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:33.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.420+0000 7f03e3fff700 1 --2- 172.21.15.84:0/3549182866 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03dc06a1a0 0x7f03dc1510a0 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:33.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.420+0000 7f03e3fff700 1 --2- 172.21.15.84:0/3549182866 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f03c006ae00 0x7f03c006d2b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:33.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.420+0000 7f03e3fff700 1 --2- 172.21.15.84:0/3549182866 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03dc06a570 0x7f03dc09b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:33.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.420+0000 7f03e3fff700 1 -- 172.21.15.84:0/3549182866 >> 172.21.15.84:0/3549182866 conn(0x7f03dc0cef10 msgr2=0x7f03dc0ad450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:33.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.420+0000 7f03e3fff700 1 -- 172.21.15.84:0/3549182866 shutdown_connections 2023-07-14T11:18:33.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.420+0000 7f03e3fff700 1 -- 172.21.15.84:0/3549182866 wait complete. 2023-07-14T11:18:33.440 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_mgr_eviction' 2023-07-14T11:18:33.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.634+0000 7fc772bff700 1 Processor -- start 2023-07-14T11:18:33.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.634+0000 7fc772bff700 1 -- start start 2023-07-14T11:18:33.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.635+0000 7fc772bff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc76c0b1e00 0x7fc76c0b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:33.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.635+0000 7fc772bff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc76c0d2ce0 con 0x7fc76c0d1220 2023-07-14T11:18:33.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.635+0000 7fc772bff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc76c0b3350 con 0x7fc76c15c950 2023-07-14T11:18:33.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.635+0000 7fc772bff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc76c0b3630 con 0x7fc76c0b1e00 2023-07-14T11:18:33.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.635+0000 7fc76bfff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fc76c0d1220 0x7fc76c0afac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:59060/0 (socket says 172.21.15.84:59060) 2023-07-14T11:18:33.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.635+0000 7fc76bfff700 1 -- 172.21.15.84:0/1290853188 learned_addr learned my addr 172.21.15.84:0/1290853188 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:18:33.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.635+0000 7fc77119c700 1 --2- 172.21.15.84:0/1290853188 >> v2:172.21.15.84:3300/0 conn(0x7fc76c0b1e00 0x7fc76c0b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:33.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.636+0000 7fc76b7fe700 1 -- 172.21.15.84:0/1290853188 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2549399809 0 0) 0x7fc76c0d2ce0 con 0x7fc76c0d1220 2023-07-14T11:18:33.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.636+0000 7fc76b7fe700 1 -- 172.21.15.84:0/1290853188 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc75c0035b0 con 0x7fc76c0d1220 2023-07-14T11:18:33.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.636+0000 7fc77119c700 1 -- 172.21.15.84:0/1290853188 >> v1:172.21.15.179:6789/0 conn(0x7fc76c15c950 legacy=0x7fc76c0d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:33.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.636+0000 7fc77119c700 1 -- 172.21.15.84:0/1290853188 >> v1:172.21.15.84:6789/0 conn(0x7fc76c0d1220 legacy=0x7fc76c0afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:33.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.636+0000 7fc77119c700 1 -- 172.21.15.84:0/1290853188 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc76c0b3910 con 0x7fc76c0b1e00 2023-07-14T11:18:33.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.636+0000 7fc77119c700 1 --2- 172.21.15.84:0/1290853188 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc76c0b1e00 0x7fc76c0b43f0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fc764009d90 tx=0x7fc76400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39722eb988eb2c58 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:33.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.636+0000 7fc76b7fe700 1 -- 172.21.15.84:0/1290853188 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc76400e070 con 0x7fc76c0b1e00 2023-07-14T11:18:33.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.636+0000 7fc76b7fe700 1 -- 172.21.15.84:0/1290853188 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc76400bb20 con 0x7fc76c0b1e00 2023-07-14T11:18:33.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.636+0000 7fc76b7fe700 1 -- 172.21.15.84:0/1290853188 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc764012430 con 0x7fc76c0b1e00 2023-07-14T11:18:33.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.637+0000 7fc772bff700 1 -- 172.21.15.84:0/1290853188 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc76c0b1e00 msgr2=0x7fc76c0b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:33.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.637+0000 7fc772bff700 1 --2- 172.21.15.84:0/1290853188 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc76c0b1e00 0x7fc76c0b43f0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fc764009d90 tx=0x7fc76400b330 comp rx=0 tx=0).stop 2023-07-14T11:18:33.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.637+0000 7fc772bff700 1 -- 172.21.15.84:0/1290853188 shutdown_connections 2023-07-14T11:18:33.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.637+0000 7fc772bff700 1 --2- 172.21.15.84:0/1290853188 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc76c0b1e00 0x7fc76c0b43f0 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:33.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.637+0000 7fc772bff700 1 -- 172.21.15.84:0/1290853188 >> 172.21.15.84:0/1290853188 conn(0x7fc76c09c1d0 msgr2=0x7fc76c0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:33.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.637+0000 7fc772bff700 1 -- 172.21.15.84:0/1290853188 shutdown_connections 2023-07-14T11:18:33.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.637+0000 7fc772bff700 1 -- 172.21.15.84:0/1290853188 wait complete. 2023-07-14T11:18:33.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.639+0000 7fc772bff700 1 Processor -- start 2023-07-14T11:18:33.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.639+0000 7fc772bff700 1 -- start start 2023-07-14T11:18:33.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.640+0000 7fc772bff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc76c0b1e00 0x7fc76c151b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:33.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.640+0000 7fc772bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc76c0d1220 0x7fc76c0caa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:33.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.640+0000 7fc772bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc76c15c950 0x7fc76c0c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:33.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.640+0000 7fc772bff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc76c152070 con 0x7fc76c0b1e00 2023-07-14T11:18:33.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.640+0000 7fc772bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc76c0cb7a0 con 0x7fc76c0d1220 2023-07-14T11:18:33.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.640+0000 7fc772bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc76c0cba80 con 0x7fc76c15c950 2023-07-14T11:18:33.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.640+0000 7fc77099b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc76c0b1e00 0x7fc76c151b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:33.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.640+0000 7fc77099b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc76c0b1e00 0x7fc76c151b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55650/0 (socket says 172.21.15.84:55650) 2023-07-14T11:18:33.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.640+0000 7fc77099b700 1 -- 172.21.15.84:0/2630190520 learned_addr learned my addr 172.21.15.84:0/2630190520 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:33.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.640+0000 7fc76bfff700 1 --2- 172.21.15.84:0/2630190520 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc76c0d1220 0x7fc76c0caa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:33.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.640+0000 7fc77119c700 1 --2- 172.21.15.84:0/2630190520 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc76c15c950 0x7fc76c0c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:33.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.640+0000 7fc77099b700 1 -- 172.21.15.84:0/2630190520 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc76c15c950 msgr2=0x7fc76c0c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:33.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.640+0000 7fc77099b700 1 --2- 172.21.15.84:0/2630190520 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc76c15c950 0x7fc76c0c8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:33.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.640+0000 7fc77099b700 1 -- 172.21.15.84:0/2630190520 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc76c0d1220 msgr2=0x7fc76c0caa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:33.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.640+0000 7fc77099b700 1 --2- 172.21.15.84:0/2630190520 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc76c0d1220 0x7fc76c0caa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:33.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.640+0000 7fc77099b700 1 -- 172.21.15.84:0/2630190520 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc764009a70 con 0x7fc76c0b1e00 2023-07-14T11:18:33.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.641+0000 7fc77099b700 1 --2- 172.21.15.84:0/2630190520 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc76c0b1e00 0x7fc76c151b30 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fc76000c4d0 tx=0x7fc76000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:33.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.641+0000 7fc7697fa700 1 -- 172.21.15.84:0/2630190520 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7600052d0 con 0x7fc76c0b1e00 2023-07-14T11:18:33.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.641+0000 7fc7697fa700 1 -- 172.21.15.84:0/2630190520 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc760005430 con 0x7fc76c0b1e00 2023-07-14T11:18:33.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.641+0000 7fc772bff700 1 -- 172.21.15.84:0/2630190520 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc76c0cbd60 con 0x7fc76c0b1e00 2023-07-14T11:18:33.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.641+0000 7fc7697fa700 1 -- 172.21.15.84:0/2630190520 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7600038f0 con 0x7fc76c0b1e00 2023-07-14T11:18:33.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.641+0000 7fc772bff700 1 -- 172.21.15.84:0/2630190520 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc76c0cc320 con 0x7fc76c0b1e00 2023-07-14T11:18:33.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.642+0000 7fc772bff700 1 -- 172.21.15.84:0/2630190520 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc76c0cc4e0 con 0x7fc76c0b1e00 2023-07-14T11:18:33.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.643+0000 7fc7697fa700 1 -- 172.21.15.84:0/2630190520 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7fc760003a50 con 0x7fc76c0b1e00 2023-07-14T11:18:33.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.645+0000 7fc7697fa700 1 --2- 172.21.15.84:0/2630190520 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fc75006ae00 0x7fc75006d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:33.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.645+0000 7fc7697fa700 1 -- 172.21.15.84:0/2630190520 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5855+0+0 (secure 0 0 0) 0x7fc760088a80 con 0x7fc76c0b1e00 2023-07-14T11:18:33.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.645+0000 7fc76bfff700 1 --2- 172.21.15.84:0/2630190520 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fc75006ae00 0x7fc75006d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:33.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.646+0000 7fc76bfff700 1 --2- 172.21.15.84:0/2630190520 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fc75006ae00 0x7fc75006d2b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc76c0cf350 tx=0x7fc758009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:33.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.649+0000 7fc7697fa700 1 -- 172.21.15.84:0/2630190520 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fc760053a50 con 0x7fc76c0b1e00 2023-07-14T11:18:33.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.922+0000 7fc772bff700 1 -- 172.21.15.84:0/2630190520 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_mgr_eviction"]} v 0) v1 -- 0x7fc76c04e280 con 0x7fc76c0b1e00 2023-07-14T11:18:33.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.970+0000 7fc7697fa700 1 -- 172.21.15.84:0/2630190520 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_mgr_eviction"]}]=0 v302) v1 ==== 131+0+0 (secure 0 0 0) 0x7fc760057070 con 0x7fc76c0b1e00 2023-07-14T11:18:33.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.973+0000 7fc772bff700 1 -- 172.21.15.84:0/2630190520 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fc75006ae00 msgr2=0x7fc75006d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:33.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.973+0000 7fc772bff700 1 --2- 172.21.15.84:0/2630190520 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fc75006ae00 0x7fc75006d2b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc76c0cf350 tx=0x7fc758009040 comp rx=0 tx=0).stop 2023-07-14T11:18:33.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.973+0000 7fc772bff700 1 -- 172.21.15.84:0/2630190520 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc76c0b1e00 msgr2=0x7fc76c151b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:33.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.973+0000 7fc772bff700 1 --2- 172.21.15.84:0/2630190520 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc76c0b1e00 0x7fc76c151b30 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fc76000c4d0 tx=0x7fc76000c890 comp rx=0 tx=0).stop 2023-07-14T11:18:33.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.973+0000 7fc772bff700 1 -- 172.21.15.84:0/2630190520 shutdown_connections 2023-07-14T11:18:33.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.973+0000 7fc772bff700 1 --2- 172.21.15.84:0/2630190520 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fc75006ae00 0x7fc75006d2b0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:33.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.973+0000 7fc772bff700 1 --2- 172.21.15.84:0/2630190520 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc76c15c950 0x7fc76c0c8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:33.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.973+0000 7fc772bff700 1 --2- 172.21.15.84:0/2630190520 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc76c0b1e00 0x7fc76c151b30 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:33.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.973+0000 7fc772bff700 1 --2- 172.21.15.84:0/2630190520 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc76c0d1220 0x7fc76c0caa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:33.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.973+0000 7fc772bff700 1 -- 172.21.15.84:0/2630190520 >> 172.21.15.84:0/2630190520 conn(0x7fc76c09c1d0 msgr2=0x7fc76c0b5280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:33.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.973+0000 7fc772bff700 1 -- 172.21.15.84:0/2630190520 shutdown_connections 2023-07-14T11:18:33.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:33.973+0000 7fc772bff700 1 -- 172.21.15.84:0/2630190520 wait complete. 2023-07-14T11:18:33.993 INFO:tasks.cephfs_test_runner:test_mgr_eviction (tasks.cephfs.test_volumes.TestMisc) ... ok 2023-07-14T11:18:33.994 INFO:tasks.cephfs_test_runner:Starting test: test_names_can_only_be_goodchars (tasks.cephfs.test_volumes.TestMisc) 2023-07-14T11:18:33.994 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_names_can_only_be_goodchars' 2023-07-14T11:18:34.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.187+0000 7ff9521ff700 1 Processor -- start 2023-07-14T11:18:34.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.187+0000 7ff9521ff700 1 -- start start 2023-07-14T11:18:34.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.188+0000 7ff9521ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff94c0adb50 0x7ff94c0b2300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:34.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.188+0000 7ff9521ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff94c071ae0 con 0x7ff94c0b2840 2023-07-14T11:18:34.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.188+0000 7ff9521ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff94c071560 con 0x7ff94c158a00 2023-07-14T11:18:34.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.188+0000 7ff9521ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff94c06b040 con 0x7ff94c0adb50 2023-07-14T11:18:34.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.189+0000 7ff94bfff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7ff94c0b2840 0x7ff94c06b490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:59064/0 (socket says 172.21.15.84:59064) 2023-07-14T11:18:34.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.189+0000 7ff94bfff700 1 -- 172.21.15.84:0/1231607978 learned_addr learned my addr 172.21.15.84:0/1231607978 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:18:34.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.189+0000 7ff94affd700 1 --2- 172.21.15.84:0/1231607978 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff94c0adb50 0x7ff94c0b2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:34.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.189+0000 7ff94a7fc700 1 -- 172.21.15.84:0/1231607978 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3366694778 0 0) 0x7ff94c071ae0 con 0x7ff94c0b2840 2023-07-14T11:18:34.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.189+0000 7ff94a7fc700 1 -- 172.21.15.84:0/1231607978 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9340035b0 con 0x7ff94c0b2840 2023-07-14T11:18:34.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.189+0000 7ff94a7fc700 1 -- 172.21.15.84:0/1231607978 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1763800006 0 0) 0x7ff94c071560 con 0x7ff94c158a00 2023-07-14T11:18:34.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.189+0000 7ff94a7fc700 1 -- 172.21.15.84:0/1231607978 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff94c071ae0 con 0x7ff94c158a00 2023-07-14T11:18:34.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.189+0000 7ff94a7fc700 1 -- 172.21.15.84:0/1231607978 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2372299448 0 0) 0x7ff9340035b0 con 0x7ff94c0b2840 2023-07-14T11:18:34.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.189+0000 7ff94a7fc700 1 -- 172.21.15.84:0/1231607978 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff94c0adb50 msgr2=0x7ff94c0b2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:34.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.189+0000 7ff94a7fc700 1 --2- 172.21.15.84:0/1231607978 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff94c0adb50 0x7ff94c0b2300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:34.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.189+0000 7ff94a7fc700 1 -- 172.21.15.84:0/1231607978 >> v1:172.21.15.179:6789/0 conn(0x7ff94c158a00 legacy=0x7ff94c0b1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:34.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.189+0000 7ff94a7fc700 1 -- 172.21.15.84:0/1231607978 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff94c071800 con 0x7ff94c0b2840 2023-07-14T11:18:34.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.189+0000 7ff94a7fc700 1 -- 172.21.15.84:0/1231607978 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7ff9440019f0 con 0x7ff94c0b2840 2023-07-14T11:18:34.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.189+0000 7ff94a7fc700 1 -- 172.21.15.84:0/1231607978 >> v1:172.21.15.84:6789/0 conn(0x7ff94c0b2840 legacy=0x7ff94c06b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:34.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.189+0000 7ff94a7fc700 1 --2- 172.21.15.84:0/1231607978 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff934003bc0 0x7ff934003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:34.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.189+0000 7ff94a7fc700 1 --2- 172.21.15.84:0/1231607978 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff934004850 0x7ff934004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:34.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.190+0000 7ff94a7fc700 1 --2- 172.21.15.84:0/1231607978 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff94c0adb50 0x7ff934005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:34.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.190+0000 7ff94a7fc700 1 -- 172.21.15.84:0/1231607978 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff93400bac0 con 0x7ff934004850 2023-07-14T11:18:34.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.190+0000 7ff94a7fc700 1 -- 172.21.15.84:0/1231607978 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff93400bc30 con 0x7ff934003bc0 2023-07-14T11:18:34.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.190+0000 7ff94a7fc700 1 -- 172.21.15.84:0/1231607978 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff93400e000 con 0x7ff94c0adb50 2023-07-14T11:18:34.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.190+0000 7ff94affd700 1 --2- 172.21.15.84:0/1231607978 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff934004850 0x7ff934004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:34.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.190+0000 7ff94b7fe700 1 --2- 172.21.15.84:0/1231607978 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff934003bc0 0x7ff934003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:34.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.190+0000 7ff94bfff700 1 --2- 172.21.15.84:0/1231607978 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff94c0adb50 0x7ff934005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:34.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.190+0000 7ff94affd700 1 -- 172.21.15.84:0/1231607978 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff94c0adb50 msgr2=0x7ff934005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:34.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.190+0000 7ff94affd700 1 --2- 172.21.15.84:0/1231607978 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff94c0adb50 0x7ff934005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:34.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.190+0000 7ff94affd700 1 -- 172.21.15.84:0/1231607978 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff934003bc0 msgr2=0x7ff934003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:34.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.190+0000 7ff94affd700 1 --2- 172.21.15.84:0/1231607978 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff934003bc0 0x7ff934003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:34.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.190+0000 7ff94affd700 1 -- 172.21.15.84:0/1231607978 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9340035b0 con 0x7ff934004850 2023-07-14T11:18:34.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.190+0000 7ff94affd700 1 --2- 172.21.15.84:0/1231607978 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff934004850 0x7ff934004cc0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7ff94000aae0 tx=0x7ff934005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d502e44b0dabc9aa server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:34.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.190+0000 7ff94a7fc700 1 -- 172.21.15.84:0/1231607978 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94000e960 con 0x7ff934004850 2023-07-14T11:18:34.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.191+0000 7ff94a7fc700 1 -- 172.21.15.84:0/1231607978 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff94000eac0 con 0x7ff934004850 2023-07-14T11:18:34.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.191+0000 7ff94a7fc700 1 -- 172.21.15.84:0/1231607978 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94000ee50 con 0x7ff934004850 2023-07-14T11:18:34.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.191+0000 7ff9521ff700 1 -- 172.21.15.84:0/1231607978 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff934004850 msgr2=0x7ff934004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:34.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.191+0000 7ff9521ff700 1 --2- 172.21.15.84:0/1231607978 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff934004850 0x7ff934004cc0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7ff94000aae0 tx=0x7ff934005880 comp rx=0 tx=0).stop 2023-07-14T11:18:34.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.191+0000 7ff94bfff700 1 -- 172.21.15.84:0/1231607978 reap_dead start 2023-07-14T11:18:34.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.191+0000 7ff9521ff700 1 -- 172.21.15.84:0/1231607978 shutdown_connections 2023-07-14T11:18:34.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.191+0000 7ff9521ff700 1 -- 172.21.15.84:0/1231607978 >> 172.21.15.84:0/1231607978 conn(0x7ff94c06ab70 msgr2=0x7ff94c0b05d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:34.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.191+0000 7ff9521ff700 1 -- 172.21.15.84:0/1231607978 shutdown_connections 2023-07-14T11:18:34.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.191+0000 7ff9521ff700 1 -- 172.21.15.84:0/1231607978 wait complete. 2023-07-14T11:18:34.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.193+0000 7ff9521ff700 1 Processor -- start 2023-07-14T11:18:34.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.194+0000 7ff9521ff700 1 -- start start 2023-07-14T11:18:34.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.195+0000 7ff9521ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff934004850 0x7ff94c14f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:34.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.195+0000 7ff9521ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff94c1535e0 0x7ff94c14d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:34.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.195+0000 7ff9521ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff94c151c60 0x7ff94c0ac880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:34.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.195+0000 7ff9521ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff94c152540 con 0x7ff934004850 2023-07-14T11:18:34.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.195+0000 7ff9521ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff94c152820 con 0x7ff94c151c60 2023-07-14T11:18:34.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.195+0000 7ff9521ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff94c152b00 con 0x7ff94c1535e0 2023-07-14T11:18:34.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.195+0000 7ff94b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff934004850 0x7ff94c14f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:34.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.195+0000 7ff94b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff934004850 0x7ff94c14f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55678/0 (socket says 172.21.15.84:55678) 2023-07-14T11:18:34.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.195+0000 7ff94b7fe700 1 -- 172.21.15.84:0/1504491757 learned_addr learned my addr 172.21.15.84:0/1504491757 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:34.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.195+0000 7ff94affd700 1 --2- 172.21.15.84:0/1504491757 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff94c1535e0 0x7ff94c14d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:34.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.195+0000 7ff94bfff700 1 --2- 172.21.15.84:0/1504491757 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff94c151c60 0x7ff94c0ac880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:34.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.196+0000 7ff94b7fe700 1 -- 172.21.15.84:0/1504491757 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff94c1535e0 msgr2=0x7ff94c14d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:34.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.196+0000 7ff94b7fe700 1 --2- 172.21.15.84:0/1504491757 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff94c1535e0 0x7ff94c14d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:34.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.196+0000 7ff94b7fe700 1 -- 172.21.15.84:0/1504491757 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff94c151c60 msgr2=0x7ff94c0ac880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:34.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.196+0000 7ff94b7fe700 1 --2- 172.21.15.84:0/1504491757 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff94c151c60 0x7ff94c0ac880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:34.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.196+0000 7ff94b7fe700 1 -- 172.21.15.84:0/1504491757 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff94c152de0 con 0x7ff934004850 2023-07-14T11:18:34.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.196+0000 7ff94affd700 1 --2- 172.21.15.84:0/1504491757 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff94c1535e0 0x7ff94c14d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:18:34.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.196+0000 7ff94b7fe700 1 --2- 172.21.15.84:0/1504491757 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff934004850 0x7ff94c14f530 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7ff93c00e7b0 tx=0x7ff93c00eb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:34.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.196+0000 7ff933fff700 1 -- 172.21.15.84:0/1504491757 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93c0052e0 con 0x7ff934004850 2023-07-14T11:18:34.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.196+0000 7ff933fff700 1 -- 172.21.15.84:0/1504491757 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff93c005460 con 0x7ff934004850 2023-07-14T11:18:34.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.196+0000 7ff9521ff700 1 -- 172.21.15.84:0/1504491757 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff94c1530c0 con 0x7ff934004850 2023-07-14T11:18:34.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.196+0000 7ff933fff700 1 -- 172.21.15.84:0/1504491757 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93c0038c0 con 0x7ff934004850 2023-07-14T11:18:34.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.196+0000 7ff9521ff700 1 -- 172.21.15.84:0/1504491757 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff94c1522b0 con 0x7ff934004850 2023-07-14T11:18:34.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.197+0000 7ff9521ff700 1 -- 172.21.15.84:0/1504491757 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff94c153430 con 0x7ff934004850 2023-07-14T11:18:34.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.198+0000 7ff933fff700 1 -- 172.21.15.84:0/1504491757 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7ff93c003a20 con 0x7ff934004850 2023-07-14T11:18:34.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.199+0000 7ff933fff700 1 --2- 172.21.15.84:0/1504491757 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7ff93806ae00 0x7ff93806d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:34.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.199+0000 7ff933fff700 1 -- 172.21.15.84:0/1504491757 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5855+0+0 (secure 0 0 0) 0x7ff93c089380 con 0x7ff934004850 2023-07-14T11:18:34.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.199+0000 7ff94affd700 1 --2- 172.21.15.84:0/1504491757 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7ff93806ae00 0x7ff93806d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:34.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.200+0000 7ff94affd700 1 --2- 172.21.15.84:0/1504491757 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7ff93806ae00 0x7ff93806d2b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff940000c00 tx=0x7ff940008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:34.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.203+0000 7ff933fff700 1 -- 172.21.15.84:0/1504491757 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ff93c0543f0 con 0x7ff934004850 2023-07-14T11:18:34.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.477+0000 7ff9521ff700 1 -- 172.21.15.84:0/1504491757 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_names_can_only_be_goodchars"]} v 0) v1 -- 0x7ff94c074350 con 0x7ff934004850 2023-07-14T11:18:34.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.975+0000 7ff933fff700 1 -- 172.21.15.84:0/1504491757 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_names_can_only_be_goodchars"]}]=0 v303) v1 ==== 149+0+0 (secure 0 0 0) 0x7ff93c057a10 con 0x7ff934004850 2023-07-14T11:18:34.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.978+0000 7ff9521ff700 1 -- 172.21.15.84:0/1504491757 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7ff93806ae00 msgr2=0x7ff93806d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:34.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.978+0000 7ff9521ff700 1 --2- 172.21.15.84:0/1504491757 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7ff93806ae00 0x7ff93806d2b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff940000c00 tx=0x7ff940008030 comp rx=0 tx=0).stop 2023-07-14T11:18:34.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.978+0000 7ff9521ff700 1 -- 172.21.15.84:0/1504491757 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff934004850 msgr2=0x7ff94c14f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:34.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.978+0000 7ff9521ff700 1 --2- 172.21.15.84:0/1504491757 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff934004850 0x7ff94c14f530 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7ff93c00e7b0 tx=0x7ff93c00eb70 comp rx=0 tx=0).stop 2023-07-14T11:18:34.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.978+0000 7ff9521ff700 1 -- 172.21.15.84:0/1504491757 shutdown_connections 2023-07-14T11:18:34.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.978+0000 7ff9521ff700 1 --2- 172.21.15.84:0/1504491757 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff94c151c60 0x7ff94c0ac880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:34.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.978+0000 7ff9521ff700 1 --2- 172.21.15.84:0/1504491757 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff934004850 0x7ff94c14f530 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:34.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.978+0000 7ff9521ff700 1 --2- 172.21.15.84:0/1504491757 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7ff93806ae00 0x7ff93806d2b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:34.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.978+0000 7ff9521ff700 1 --2- 172.21.15.84:0/1504491757 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff94c1535e0 0x7ff94c14d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:34.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.978+0000 7ff9521ff700 1 -- 172.21.15.84:0/1504491757 >> 172.21.15.84:0/1504491757 conn(0x7ff94c06ab70 msgr2=0x7ff94c1e3a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:34.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.978+0000 7ff9521ff700 1 -- 172.21.15.84:0/1504491757 shutdown_connections 2023-07-14T11:18:34.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:34.978+0000 7ff9521ff700 1 -- 172.21.15.84:0/1504491757 wait complete. 2023-07-14T11:18:35.000 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-14T11:18:35.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:35.197+0000 7f31763ff700 1 Processor -- start 2023-07-14T11:18:35.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:35.197+0000 7f31763ff700 1 -- start start 2023-07-14T11:18:35.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:35.198+0000 7f31763ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f317015c860 0x7f31700d1e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:35.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:35.198+0000 7f31763ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f31700c71b0 0x7f31700b49d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:35.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:35.199+0000 7f31763ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31700cd5a0 con 0x7f31700cf2a0 2023-07-14T11:18:35.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:35.199+0000 7f31763ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3170146740 con 0x7f317015c860 2023-07-14T11:18:35.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:35.199+0000 7f31763ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31700cf740 con 0x7f31700c71b0 2023-07-14T11:18:35.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:35.199+0000 7f316ffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f317015c860 0x7f31700d1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:35.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:35.199+0000 7f316ffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f317015c860 0x7f31700d1e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55682/0 (socket says 172.21.15.84:55682) 2023-07-14T11:18:35.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:35.199+0000 7f316ffff700 1 -- 172.21.15.84:0/560056148 learned_addr learned my addr 172.21.15.84:0/560056148 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:35.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:35.199+0000 7f317499c700 1 --2- 172.21.15.84:0/560056148 >> v2:172.21.15.179:3300/0 conn(0x7f31700c71b0 0x7f31700b49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:35.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:35.199+0000 7f316ffff700 1 -- 172.21.15.84:0/560056148 >> v2:172.21.15.179:3300/0 conn(0x7f31700c71b0 msgr2=0x7f31700b49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:35.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:35.199+0000 7f316ffff700 1 --2- 172.21.15.84:0/560056148 >> v2:172.21.15.179:3300/0 conn(0x7f31700c71b0 0x7f31700b49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:35.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:35.199+0000 7f316ffff700 1 -- 172.21.15.84:0/560056148 >> v1:172.21.15.179:6789/0 conn(0x7f31700cf2a0 legacy=0x7f31700c6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:35.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:35.199+0000 7f316ffff700 1 -- 172.21.15.84:0/560056148 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31700cd7f0 con 0x7f317015c860 2023-07-14T11:18:35.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:35.199+0000 7f316ffff700 1 --2- 172.21.15.84:0/560056148 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f317015c860 0x7f31700d1e40 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f31700d0ab0 tx=0x7f3160009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef405d069838feed server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:35.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:35.200+0000 7f316effd700 1 -- 172.21.15.84:0/560056148 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f316000b870 con 0x7f317015c860 2023-07-14T11:18:35.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:35.200+0000 7f316effd700 1 -- 172.21.15.84:0/560056148 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f316000b9d0 con 0x7f317015c860 2023-07-14T11:18:35.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:35.200+0000 7f316effd700 1 -- 172.21.15.84:0/560056148 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f316000bd60 con 0x7f317015c860 2023-07-14T11:18:35.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:35.200+0000 7f31763ff700 1 -- 172.21.15.84:0/560056148 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f317015c860 msgr2=0x7f31700d1e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:35.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:35.200+0000 7f31763ff700 1 --2- 172.21.15.84:0/560056148 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f317015c860 0x7f31700d1e40 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f31700d0ab0 tx=0x7f3160009bd0 comp rx=0 tx=0).stop 2023-07-14T11:18:35.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:35.200+0000 7f31763ff700 1 -- 172.21.15.84:0/560056148 shutdown_connections 2023-07-14T11:18:35.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:35.200+0000 7f31763ff700 1 --2- 172.21.15.84:0/560056148 >> v2:172.21.15.179:3300/0 conn(0x7f31700c71b0 0x7f31700b49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:35.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:35.200+0000 7f31763ff700 1 --2- 172.21.15.84:0/560056148 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f317015c860 0x7f31700d1e40 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:35.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:35.200+0000 7f31763ff700 1 -- 172.21.15.84:0/560056148 >> 172.21.15.84:0/560056148 conn(0x7f3170065bd0 msgr2=0x7f3170065fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:35.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:35.200+0000 7f31763ff700 1 -- 172.21.15.84:0/560056148 shutdown_connections 2023-07-14T11:18:35.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:35.201+0000 7f31763ff700 1 -- 172.21.15.84:0/560056148 wait complete. 2023-07-14T11:18:35.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:35.202+0000 7f31763ff700 1 Processor -- start 2023-07-14T11:18:35.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:35.202+0000 7f31763ff700 1 -- start start 2023-07-14T11:18:35.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:35.203+0000 7f31763ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31700c71b0 0x7f31700b5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:35.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:35.203+0000 7f31763ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31700cf2a0 0x7f31700c6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:35.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:35.203+0000 7f31763ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f317015c860 0x7f31700b7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:35.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:35.203+0000 7f31763ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f317015d160 con 0x7f31700c71b0 2023-07-14T11:18:35.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:35.203+0000 7f31763ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f317015d2f0 con 0x7f317015c860 2023-07-14T11:18:35.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:35.203+0000 7f31763ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31700b80a0 con 0x7f31700cf2a0 2023-07-14T11:18:35.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:35.204+0000 7f316ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31700c71b0 0x7f31700b5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:35.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:35.204+0000 7f316ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31700c71b0 0x7f31700b5d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55688/0 (socket says 172.21.15.84:55688) 2023-07-14T11:18:35.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:35.204+0000 7f316ffff700 1 -- 172.21.15.84:0/3437683231 learned_addr learned my addr 172.21.15.84:0/3437683231 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:35.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:35.204+0000 7f317499c700 1 --2- 172.21.15.84:0/3437683231 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f317015c860 0x7f31700b7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:35.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:35.204+0000 7f316f7fe700 1 --2- 172.21.15.84:0/3437683231 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31700cf2a0 0x7f31700c6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:35.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:35.204+0000 7f316ffff700 1 -- 172.21.15.84:0/3437683231 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31700cf2a0 msgr2=0x7f31700c6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:35.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:35.204+0000 7f316ffff700 1 --2- 172.21.15.84:0/3437683231 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31700cf2a0 0x7f31700c6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:35.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:35.204+0000 7f316ffff700 1 -- 172.21.15.84:0/3437683231 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f317015c860 msgr2=0x7f31700b7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:35.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:35.204+0000 7f316ffff700 1 --2- 172.21.15.84:0/3437683231 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f317015c860 0x7f31700b7b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:35.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:35.204+0000 7f316ffff700 1 -- 172.21.15.84:0/3437683231 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3160009550 con 0x7f31700c71b0 2023-07-14T11:18:35.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:35.204+0000 7f317499c700 1 --2- 172.21.15.84:0/3437683231 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f317015c860 0x7f31700b7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:18:35.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:35.204+0000 7f316ffff700 1 --2- 172.21.15.84:0/3437683231 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31700c71b0 0x7f31700b5d80 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f3160000c00 tx=0x7f3160004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:35.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:35.204+0000 7f316cff9700 1 -- 172.21.15.84:0/3437683231 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3160004520 con 0x7f31700c71b0 2023-07-14T11:18:35.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:35.205+0000 7f316cff9700 1 -- 172.21.15.84:0/3437683231 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f316001e070 con 0x7f31700c71b0 2023-07-14T11:18:35.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:35.205+0000 7f31763ff700 1 -- 172.21.15.84:0/3437683231 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31700b6360 con 0x7f31700c71b0 2023-07-14T11:18:35.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:35.205+0000 7f316cff9700 1 -- 172.21.15.84:0/3437683231 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31600038a0 con 0x7f31700c71b0 2023-07-14T11:18:35.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:35.205+0000 7f31763ff700 1 -- 172.21.15.84:0/3437683231 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31700b6920 con 0x7f31700c71b0 2023-07-14T11:18:35.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:35.206+0000 7f31763ff700 1 -- 172.21.15.84:0/3437683231 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3170074350 con 0x7f31700c71b0 2023-07-14T11:18:35.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:35.207+0000 7f316cff9700 1 -- 172.21.15.84:0/3437683231 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f3160003a00 con 0x7f31700c71b0 2023-07-14T11:18:35.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:35.207+0000 7f316cff9700 1 --2- 172.21.15.84:0/3437683231 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f315406ae00 0x7f315406d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:35.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:35.208+0000 7f316cff9700 1 -- 172.21.15.84:0/3437683231 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5855+0+0 (secure 0 0 0) 0x7f3160020070 con 0x7f31700c71b0 2023-07-14T11:18:35.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:35.208+0000 7f316f7fe700 1 --2- 172.21.15.84:0/3437683231 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f315406ae00 0x7f315406d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:35.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:35.209+0000 7f316f7fe700 1 --2- 172.21.15.84:0/3437683231 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f315406ae00 0x7f315406d2b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f31701f59c0 tx=0x7f3158009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:35.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:35.212+0000 7f316cff9700 1 -- 172.21.15.84:0/3437683231 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3160055c30 con 0x7f31700c71b0 2023-07-14T11:18:35.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:35.411+0000 7f31763ff700 1 -- 172.21.15.84:0/3437683231 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f31700c95a0 con 0x7f31700c71b0 2023-07-14T11:18:35.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:35.415+0000 7f316cff9700 1 -- 172.21.15.84:0/3437683231 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f316002a0c0 con 0x7f31700c71b0 2023-07-14T11:18:35.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:35.417+0000 7f31763ff700 1 -- 172.21.15.84:0/3437683231 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f315406ae00 msgr2=0x7f315406d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:35.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:35.417+0000 7f31763ff700 1 --2- 172.21.15.84:0/3437683231 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f315406ae00 0x7f315406d2b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f31701f59c0 tx=0x7f3158009040 comp rx=0 tx=0).stop 2023-07-14T11:18:35.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:35.417+0000 7f31763ff700 1 -- 172.21.15.84:0/3437683231 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31700c71b0 msgr2=0x7f31700b5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:35.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:35.417+0000 7f31763ff700 1 --2- 172.21.15.84:0/3437683231 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31700c71b0 0x7f31700b5d80 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f3160000c00 tx=0x7f3160004750 comp rx=0 tx=0).stop 2023-07-14T11:18:35.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:35.417+0000 7f31763ff700 1 -- 172.21.15.84:0/3437683231 shutdown_connections 2023-07-14T11:18:35.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:35.417+0000 7f31763ff700 1 --2- 172.21.15.84:0/3437683231 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f317015c860 0x7f31700b7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:35.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:35.417+0000 7f31763ff700 1 --2- 172.21.15.84:0/3437683231 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31700c71b0 0x7f31700b5d80 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:35.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:35.417+0000 7f31763ff700 1 --2- 172.21.15.84:0/3437683231 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f315406ae00 0x7f315406d2b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:35.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:35.417+0000 7f31763ff700 1 --2- 172.21.15.84:0/3437683231 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31700cf2a0 0x7f31700c6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:35.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:35.417+0000 7f31763ff700 1 -- 172.21.15.84:0/3437683231 >> 172.21.15.84:0/3437683231 conn(0x7f3170065bd0 msgr2=0x7f31700d0ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:35.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:35.417+0000 7f31763ff700 1 -- 172.21.15.84:0/3437683231 shutdown_connections 2023-07-14T11:18:35.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:35.417+0000 7f31763ff700 1 -- 172.21.15.84:0/3437683231 wait complete. 2023-07-14T11:18:35.438 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-14T11:18:35.438 DEBUG:teuthology.orchestra.run.smithi084:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-14T11:18:35.531 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-14T11:18:35.644 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-14T11:18:35.645 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-14T11:18:35.645 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:18:35.691 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345568k,nr_inodes=4086392,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=35,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275008k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-07-14T11:18:35.692 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-07-14T11:18:35.692 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:18:35.739 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345528k,nr_inodes=4086382,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=40,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275000k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-07-14T11:18:35.740 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-14T11:18:35.740 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:18:35.786 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345568k,nr_inodes=4086392,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=35,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275008k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-07-14T11:18:35.786 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-07-14T11:18:35.786 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:18:35.832 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345528k,nr_inodes=4086382,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=40,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275000k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-07-14T11:18:35.832 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-14T11:18:35.833 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T11:18:36.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.027+0000 7f64fc7ff700 1 Processor -- start 2023-07-14T11:18:36.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.027+0000 7f64fc7ff700 1 -- start start 2023-07-14T11:18:36.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.028+0000 7f64fc7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64f41500d0 0x7f64f4070350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:36.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.028+0000 7f64fc7ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f64f4070890 0x7f64f41597c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:36.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.028+0000 7f64fc7ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f64f4159d00 0x7f64f40cea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:36.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.028+0000 7f64fc7ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64f40cdf90 con 0x7f64f4159d00 2023-07-14T11:18:36.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.028+0000 7f64fc7ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64f415a2f0 con 0x7f64f4070890 2023-07-14T11:18:36.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.028+0000 7f64fc7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64f415a5d0 con 0x7f64f41500d0 2023-07-14T11:18:36.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.029+0000 7f64fad9c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f64f4159d00 0x7f64f40cea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:36.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.029+0000 7f64fad9c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f64f4159d00 0x7f64f40cea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55692/0 (socket says 172.21.15.84:55692) 2023-07-14T11:18:36.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.029+0000 7f64fad9c700 1 -- 172.21.15.84:0/2074832336 learned_addr learned my addr 172.21.15.84:0/2074832336 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:36.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.029+0000 7f64fad9c700 1 -- 172.21.15.84:0/2074832336 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64f41500d0 msgr2=0x7f64f4070350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:36.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.029+0000 7f64fad9c700 1 --2- 172.21.15.84:0/2074832336 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64f41500d0 0x7f64f4070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:36.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.029+0000 7f64fad9c700 1 -- 172.21.15.84:0/2074832336 >> v2:172.21.15.179:3300/0 conn(0x7f64f4070890 msgr2=0x7f64f41597c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:36.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.029+0000 7f64fad9c700 1 --2- 172.21.15.84:0/2074832336 >> v2:172.21.15.179:3300/0 conn(0x7f64f4070890 0x7f64f41597c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:36.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.029+0000 7f64fad9c700 1 -- 172.21.15.84:0/2074832336 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64f40ce250 con 0x7f64f4159d00 2023-07-14T11:18:36.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.029+0000 7f64fad9c700 1 --2- 172.21.15.84:0/2074832336 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64f4159d00 0x7f64f40cea50 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f64f406db50 tx=0x7f64ec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbde989bb67300b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:36.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.029+0000 7f64f9599700 1 -- 172.21.15.84:0/2074832336 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ec00e070 con 0x7f64f4159d00 2023-07-14T11:18:36.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.029+0000 7f64f9599700 1 -- 172.21.15.84:0/2074832336 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64ec00b9c0 con 0x7f64f4159d00 2023-07-14T11:18:36.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.029+0000 7f64f9599700 1 -- 172.21.15.84:0/2074832336 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ec00bd70 con 0x7f64f4159d00 2023-07-14T11:18:36.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.030+0000 7f64fc7ff700 1 -- 172.21.15.84:0/2074832336 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64f4159d00 msgr2=0x7f64f40cea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:36.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.030+0000 7f64fc7ff700 1 --2- 172.21.15.84:0/2074832336 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64f4159d00 0x7f64f40cea50 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f64f406db50 tx=0x7f64ec00b330 comp rx=0 tx=0).stop 2023-07-14T11:18:36.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.030+0000 7f64fc7ff700 1 -- 172.21.15.84:0/2074832336 shutdown_connections 2023-07-14T11:18:36.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.030+0000 7f64fc7ff700 1 --2- 172.21.15.84:0/2074832336 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64f41500d0 0x7f64f4070350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:36.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.030+0000 7f64fc7ff700 1 --2- 172.21.15.84:0/2074832336 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64f4159d00 0x7f64f40cea50 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:36.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.030+0000 7f64fc7ff700 1 --2- 172.21.15.84:0/2074832336 >> v2:172.21.15.179:3300/0 conn(0x7f64f4070890 0x7f64f41597c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:36.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.030+0000 7f64fc7ff700 1 -- 172.21.15.84:0/2074832336 >> 172.21.15.84:0/2074832336 conn(0x7f64f4069f30 msgr2=0x7f64f406a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:36.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.030+0000 7f64fc7ff700 1 -- 172.21.15.84:0/2074832336 shutdown_connections 2023-07-14T11:18:36.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.030+0000 7f64fc7ff700 1 -- 172.21.15.84:0/2074832336 wait complete. 2023-07-14T11:18:36.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.032+0000 7f64fc7ff700 1 Processor -- start 2023-07-14T11:18:36.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.032+0000 7f64fc7ff700 1 -- start start 2023-07-14T11:18:36.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.033+0000 7f64fc7ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64f4070890 0x7f64f413f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:36.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.033+0000 7f64fc7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64f41500d0 0x7f64f41448a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:36.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.033+0000 7f64fc7ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64f4159d00 0x7f64f4158200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:36.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.033+0000 7f64fc7ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64f413bb80 con 0x7f64f4159d00 2023-07-14T11:18:36.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.033+0000 7f64fc7ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64f41405e0 con 0x7f64f4070890 2023-07-14T11:18:36.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.033+0000 7f64fc7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64f41641e0 con 0x7f64f41500d0 2023-07-14T11:18:36.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.033+0000 7f64fad9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64f4159d00 0x7f64f4158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:36.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.033+0000 7f64fad9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64f4159d00 0x7f64f4158200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55698/0 (socket says 172.21.15.84:55698) 2023-07-14T11:18:36.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.033+0000 7f64fad9c700 1 -- 172.21.15.84:0/1616301642 learned_addr learned my addr 172.21.15.84:0/1616301642 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:36.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.033+0000 7f64fa59b700 1 --2- 172.21.15.84:0/1616301642 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64f4070890 0x7f64f413f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:36.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.033+0000 7f64f9d9a700 1 --2- 172.21.15.84:0/1616301642 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64f41500d0 0x7f64f41448a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:36.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.033+0000 7f64fad9c700 1 -- 172.21.15.84:0/1616301642 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64f41500d0 msgr2=0x7f64f41448a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:36.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.033+0000 7f64fad9c700 1 --2- 172.21.15.84:0/1616301642 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64f41500d0 0x7f64f41448a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:36.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.033+0000 7f64fad9c700 1 -- 172.21.15.84:0/1616301642 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64f4070890 msgr2=0x7f64f413f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:36.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.033+0000 7f64fad9c700 1 --2- 172.21.15.84:0/1616301642 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64f4070890 0x7f64f413f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:36.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.034+0000 7f64fad9c700 1 -- 172.21.15.84:0/1616301642 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64ec009b30 con 0x7f64f4159d00 2023-07-14T11:18:36.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.034+0000 7f64fa59b700 1 --2- 172.21.15.84:0/1616301642 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64f4070890 0x7f64f413f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:18:36.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.034+0000 7f64fad9c700 1 --2- 172.21.15.84:0/1616301642 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64f4159d00 0x7f64f4158200 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f64ec00b370 tx=0x7f64ec004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:36.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.034+0000 7f64eaffd700 1 -- 172.21.15.84:0/1616301642 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ec004510 con 0x7f64f4159d00 2023-07-14T11:18:36.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.034+0000 7f64eaffd700 1 -- 172.21.15.84:0/1616301642 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64ec004690 con 0x7f64f4159d00 2023-07-14T11:18:36.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.034+0000 7f64fc7ff700 1 -- 172.21.15.84:0/1616301642 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64f413fd40 con 0x7f64f4159d00 2023-07-14T11:18:36.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.034+0000 7f64eaffd700 1 -- 172.21.15.84:0/1616301642 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ec025460 con 0x7f64f4159d00 2023-07-14T11:18:36.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.034+0000 7f64fc7ff700 1 -- 172.21.15.84:0/1616301642 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64f4140300 con 0x7f64f4159d00 2023-07-14T11:18:36.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.035+0000 7f64fc7ff700 1 -- 172.21.15.84:0/1616301642 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64f404e280 con 0x7f64f4159d00 2023-07-14T11:18:36.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.036+0000 7f64eaffd700 1 -- 172.21.15.84:0/1616301642 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f64ec01c410 con 0x7f64f4159d00 2023-07-14T11:18:36.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.037+0000 7f64eaffd700 1 --2- 172.21.15.84:0/1616301642 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f64d806ae00 0x7f64d806d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:36.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.037+0000 7f64eaffd700 1 -- 172.21.15.84:0/1616301642 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5855+0+0 (secure 0 0 0) 0x7f64ec08b310 con 0x7f64f4159d00 2023-07-14T11:18:36.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.037+0000 7f64fa59b700 1 --2- 172.21.15.84:0/1616301642 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f64d806ae00 0x7f64d806d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:36.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.038+0000 7f64fa59b700 1 --2- 172.21.15.84:0/1616301642 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f64d806ae00 0x7f64d806d2b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f64f00099d0 tx=0x7f64f0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:36.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.041+0000 7f64eaffd700 1 -- 172.21.15.84:0/1616301642 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f64ec059d90 con 0x7f64f4159d00 2023-07-14T11:18:36.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.279+0000 7f64fc7ff700 1 -- 172.21.15.84:0/1616301642 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f64f4070130 con 0x7f64f4159d00 2023-07-14T11:18:36.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.280+0000 7f64eaffd700 1 -- 172.21.15.84:0/1616301642 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f64ec02ade0 con 0x7f64f4159d00 2023-07-14T11:18:36.283 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:18:36.283 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":48,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5615,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3014145470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3014145470},{"type":"v1","addr":"172.21.15.179:6834","nonce":3014145470}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":5621,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3377004712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":3377004712},{"type":"v1","addr":"172.21.15.179:6835","nonce":3377004712}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":6681,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1864489758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1864489758},{"type":"v1","addr":"172.21.15.84:6835","nonce":1864489758}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":7155,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6833/867870750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":867870750},{"type":"v1","addr":"172.21.15.84:6833","nonce":867870750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":48}],"filesystems":[]} 2023-07-14T11:18:36.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.282+0000 7f64fc7ff700 1 -- 172.21.15.84:0/1616301642 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f64d806ae00 msgr2=0x7f64d806d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:36.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.282+0000 7f64fc7ff700 1 --2- 172.21.15.84:0/1616301642 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f64d806ae00 0x7f64d806d2b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f64f00099d0 tx=0x7f64f0008040 comp rx=0 tx=0).stop 2023-07-14T11:18:36.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.282+0000 7f64fc7ff700 1 -- 172.21.15.84:0/1616301642 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64f4159d00 msgr2=0x7f64f4158200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:36.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.282+0000 7f64fc7ff700 1 --2- 172.21.15.84:0/1616301642 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64f4159d00 0x7f64f4158200 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f64ec00b370 tx=0x7f64ec004ad0 comp rx=0 tx=0).stop 2023-07-14T11:18:36.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.282+0000 7f64fc7ff700 1 -- 172.21.15.84:0/1616301642 shutdown_connections 2023-07-14T11:18:36.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.282+0000 7f64fc7ff700 1 --2- 172.21.15.84:0/1616301642 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64f4159d00 0x7f64f4158200 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:36.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.282+0000 7f64fc7ff700 1 --2- 172.21.15.84:0/1616301642 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64f4070890 0x7f64f413f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:36.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.282+0000 7f64fc7ff700 1 --2- 172.21.15.84:0/1616301642 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f64d806ae00 0x7f64d806d2b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:36.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.282+0000 7f64fc7ff700 1 --2- 172.21.15.84:0/1616301642 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64f41500d0 0x7f64f41448a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:36.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.282+0000 7f64fc7ff700 1 -- 172.21.15.84:0/1616301642 >> 172.21.15.84:0/1616301642 conn(0x7f64f4069f30 msgr2=0x7f64f414a290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:36.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.282+0000 7f64fc7ff700 1 -- 172.21.15.84:0/1616301642 shutdown_connections 2023-07-14T11:18:36.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.282+0000 7f64fc7ff700 1 -- 172.21.15.84:0/1616301642 wait complete. 2023-07-14T11:18:36.287 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 48 2023-07-14T11:18:36.303 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-14T11:18:36.303 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-14T11:18:36.303 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-14T11:18:36.304 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T11:18:36.304 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-14T11:18:36.304 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-14T11:18:36.304 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-14T11:18:36.305 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T11:18:36.305 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-14T11:18:36.305 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-14T11:18:36.305 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-14T11:18:36.305 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T11:18:36.306 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-14T11:18:36.306 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-14T11:18:36.306 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-14T11:18:36.306 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T11:18:36.317 INFO:tasks.ceph.mds.a:Stopped 2023-07-14T11:18:36.317 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-14T11:18:36.318 INFO:tasks.ceph.mds.c:Stopped 2023-07-14T11:18:36.319 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-14T11:18:36.323 INFO:tasks.ceph.mds.d:Stopped 2023-07-14T11:18:36.323 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-14T11:18:36.324 INFO:tasks.ceph.mds.b:Stopped 2023-07-14T11:18:36.324 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-14T11:18:36.362 INFO:tasks.ceph.mds.a:Started 2023-07-14T11:18:36.362 DEBUG:teuthology.parallel:result is None 2023-07-14T11:18:36.365 INFO:tasks.ceph.mds.c:Started 2023-07-14T11:18:36.365 DEBUG:teuthology.parallel:result is None 2023-07-14T11:18:36.367 INFO:tasks.ceph.mds.d:Started 2023-07-14T11:18:36.367 DEBUG:teuthology.parallel:result is None 2023-07-14T11:18:36.370 INFO:tasks.ceph.mds.b:Started 2023-07-14T11:18:36.370 DEBUG:teuthology.parallel:result is None 2023-07-14T11:18:36.370 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-14T11:18:36.511 INFO:tasks.ceph.mds.a.smithi084.stdout:starting mds.a at 2023-07-14T11:18:36.511 INFO:tasks.ceph.mds.c.smithi084.stdout:starting mds.c at 2023-07-14T11:18:36.513 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2023-07-14T11:18:36.514 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2023-07-14T11:18:36.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.575+0000 7f7d953ff700 1 Processor -- start 2023-07-14T11:18:36.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.576+0000 7f7d953ff700 1 -- start start 2023-07-14T11:18:36.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.577+0000 7f7d953ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d900cbe40 0x7f7d900cda40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:36.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.577+0000 7f7d953ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7d900cdf80 0x7f7d9006ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:36.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.577+0000 7f7d953ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d900ce8c0 con 0x7f7d90158bb0 2023-07-14T11:18:36.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.577+0000 7f7d953ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d9006b5b0 con 0x7f7d900cdf80 2023-07-14T11:18:36.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.577+0000 7f7d953ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d900ce400 con 0x7f7d900cbe40 2023-07-14T11:18:36.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.577+0000 7f7d8effd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f7d90158bb0 0x7f7d900cd0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:59096/0 (socket says 172.21.15.84:59096) 2023-07-14T11:18:36.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.578+0000 7f7d8effd700 1 -- 172.21.15.84:0/3550706994 learned_addr learned my addr 172.21.15.84:0/3550706994 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:18:36.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.578+0000 7f7d87fff700 1 --2- 172.21.15.84:0/3550706994 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d900cbe40 0x7f7d900cda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:36.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.578+0000 7f7d8f7fe700 1 --2- 172.21.15.84:0/3550706994 >> v2:172.21.15.179:3300/0 conn(0x7f7d900cdf80 0x7f7d9006ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:36.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.578+0000 7f7d8e7fc700 1 -- 172.21.15.84:0/3550706994 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 52428624 0 0) 0x7f7d900ce8c0 con 0x7f7d90158bb0 2023-07-14T11:18:36.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.578+0000 7f7d8e7fc700 1 -- 172.21.15.84:0/3550706994 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d7c0035b0 con 0x7f7d90158bb0 2023-07-14T11:18:36.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.578+0000 7f7d8f7fe700 1 -- 172.21.15.84:0/3550706994 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d900cbe40 msgr2=0x7f7d900cda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:36.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.578+0000 7f7d8f7fe700 1 --2- 172.21.15.84:0/3550706994 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d900cbe40 0x7f7d900cda40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:36.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.578+0000 7f7d8f7fe700 1 -- 172.21.15.84:0/3550706994 >> v1:172.21.15.84:6789/0 conn(0x7f7d90158bb0 legacy=0x7f7d900cd0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:36.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.578+0000 7f7d8f7fe700 1 -- 172.21.15.84:0/3550706994 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d900cc2b0 con 0x7f7d900cdf80 2023-07-14T11:18:36.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.578+0000 7f7d87fff700 1 --2- 172.21.15.84:0/3550706994 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d900cbe40 0x7f7d900cda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:18:36.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.578+0000 7f7d8f7fe700 1 --2- 172.21.15.84:0/3550706994 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d900cdf80 0x7f7d9006ba00 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f7d88009d90 tx=0x7f7d8800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ef6e4034a0c14ed server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:36.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.579+0000 7f7d8e7fc700 1 -- 172.21.15.84:0/3550706994 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d8800e070 con 0x7f7d900cdf80 2023-07-14T11:18:36.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.579+0000 7f7d8e7fc700 1 -- 172.21.15.84:0/3550706994 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d8800bb20 con 0x7f7d900cdf80 2023-07-14T11:18:36.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.579+0000 7f7d8e7fc700 1 -- 172.21.15.84:0/3550706994 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d88012430 con 0x7f7d900cdf80 2023-07-14T11:18:36.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.579+0000 7f7d953ff700 1 -- 172.21.15.84:0/3550706994 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d900cdf80 msgr2=0x7f7d9006ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:36.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.579+0000 7f7d953ff700 1 --2- 172.21.15.84:0/3550706994 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d900cdf80 0x7f7d9006ba00 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f7d88009d90 tx=0x7f7d8800b330 comp rx=0 tx=0).stop 2023-07-14T11:18:36.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.579+0000 7f7d953ff700 1 -- 172.21.15.84:0/3550706994 shutdown_connections 2023-07-14T11:18:36.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.579+0000 7f7d953ff700 1 --2- 172.21.15.84:0/3550706994 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d900cdf80 0x7f7d9006ba00 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:36.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.579+0000 7f7d953ff700 1 --2- 172.21.15.84:0/3550706994 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d900cbe40 0x7f7d900cda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:36.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.579+0000 7f7d953ff700 1 -- 172.21.15.84:0/3550706994 >> 172.21.15.84:0/3550706994 conn(0x7f7d900b05d0 msgr2=0x7f7d900b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:36.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.579+0000 7f7d953ff700 1 -- 172.21.15.84:0/3550706994 shutdown_connections 2023-07-14T11:18:36.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.579+0000 7f7d953ff700 1 -- 172.21.15.84:0/3550706994 wait complete. 2023-07-14T11:18:36.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.582+0000 7f7d953ff700 1 Processor -- start 2023-07-14T11:18:36.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.582+0000 7f7d953ff700 1 -- start start 2023-07-14T11:18:36.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.583+0000 7f7d953ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d900cbe40 0x7f7d9014bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:36.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.583+0000 7f7d953ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d900cdf80 0x7f7d90164ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:36.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.583+0000 7f7d953ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d90158bb0 0x7f7d90165010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:36.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.583+0000 7f7d953ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9014c530 con 0x7f7d900cdf80 2023-07-14T11:18:36.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.583+0000 7f7d953ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d900c2710 con 0x7f7d900cbe40 2023-07-14T11:18:36.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.583+0000 7f7d953ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d900c29f0 con 0x7f7d90158bb0 2023-07-14T11:18:36.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.583+0000 7f7d87fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d900cdf80 0x7f7d90164ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:36.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.583+0000 7f7d87fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d900cdf80 0x7f7d90164ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55728/0 (socket says 172.21.15.84:55728) 2023-07-14T11:18:36.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.583+0000 7f7d87fff700 1 -- 172.21.15.84:0/4053263900 learned_addr learned my addr 172.21.15.84:0/4053263900 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:36.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.583+0000 7f7d8effd700 1 --2- 172.21.15.84:0/4053263900 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d900cbe40 0x7f7d9014bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:36.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.583+0000 7f7d8f7fe700 1 --2- 172.21.15.84:0/4053263900 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d90158bb0 0x7f7d90165010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:36.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.584+0000 7f7d87fff700 1 -- 172.21.15.84:0/4053263900 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d90158bb0 msgr2=0x7f7d90165010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:36.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.584+0000 7f7d87fff700 1 --2- 172.21.15.84:0/4053263900 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d90158bb0 0x7f7d90165010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:36.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.584+0000 7f7d87fff700 1 -- 172.21.15.84:0/4053263900 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d900cbe40 msgr2=0x7f7d9014bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:36.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.584+0000 7f7d87fff700 1 --2- 172.21.15.84:0/4053263900 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d900cbe40 0x7f7d9014bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:36.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.584+0000 7f7d87fff700 1 -- 172.21.15.84:0/4053263900 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d780094a0 con 0x7f7d900cdf80 2023-07-14T11:18:36.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.584+0000 7f7d87fff700 1 --2- 172.21.15.84:0/4053263900 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d900cdf80 0x7f7d90164ad0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f7d7800e9b0 tx=0x7f7d7800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:36.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.584+0000 7f7d877fe700 1 -- 172.21.15.84:0/4053263900 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d7800ee50 con 0x7f7d900cdf80 2023-07-14T11:18:36.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.584+0000 7f7d877fe700 1 -- 172.21.15.84:0/4053263900 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d7800c850 con 0x7f7d900cdf80 2023-07-14T11:18:36.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.584+0000 7f7d877fe700 1 -- 172.21.15.84:0/4053263900 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d7800cc00 con 0x7f7d900cdf80 2023-07-14T11:18:36.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.585+0000 7f7d953ff700 1 -- 172.21.15.84:0/4053263900 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d88009a70 con 0x7f7d900cdf80 2023-07-14T11:18:36.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.585+0000 7f7d953ff700 1 -- 172.21.15.84:0/4053263900 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d900c50d0 con 0x7f7d900cdf80 2023-07-14T11:18:36.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.586+0000 7f7d953ff700 1 -- 172.21.15.84:0/4053263900 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d900714e0 con 0x7f7d900cdf80 2023-07-14T11:18:36.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.587+0000 7f7d877fe700 1 -- 172.21.15.84:0/4053263900 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f7d78013470 con 0x7f7d900cdf80 2023-07-14T11:18:36.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.588+0000 7f7d877fe700 1 --2- 172.21.15.84:0/4053263900 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f7d7006ae00 0x7f7d7006d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:36.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.588+0000 7f7d877fe700 1 -- 172.21.15.84:0/4053263900 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5855+0+0 (secure 0 0 0) 0x7f7d780891d0 con 0x7f7d900cdf80 2023-07-14T11:18:36.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.589+0000 7f7d8effd700 1 --2- 172.21.15.84:0/4053263900 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f7d7006ae00 0x7f7d7006d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:36.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.589+0000 7f7d8effd700 1 --2- 172.21.15.84:0/4053263900 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f7d7006ae00 0x7f7d7006d2b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7d80007fd0 tx=0x7f7d80007dc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:36.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.593+0000 7f7d877fe700 1 -- 172.21.15.84:0/4053263900 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7d900714e0 con 0x7f7d900cdf80 2023-07-14T11:18:36.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:36.800+0000 7f7d953ff700 1 -- 172.21.15.84:0/4053263900 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f7d900714e0 con 0x7f7d900cdf80 2023-07-14T11:18:37.580 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T11:18:37.585 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T11:18:37.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:37.842+0000 7f7d877fe700 1 -- 172.21.15.84:0/4053263900 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v84) v1 ==== 97+0+0 (secure 0 0 0) 0x7f7d900714e0 con 0x7f7d900cdf80 2023-07-14T11:18:37.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:37.844+0000 7f7d953ff700 1 -- 172.21.15.84:0/4053263900 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f7d7006ae00 msgr2=0x7f7d7006d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:37.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:37.844+0000 7f7d953ff700 1 --2- 172.21.15.84:0/4053263900 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f7d7006ae00 0x7f7d7006d2b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7d80007fd0 tx=0x7f7d80007dc0 comp rx=0 tx=0).stop 2023-07-14T11:18:37.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:37.844+0000 7f7d953ff700 1 -- 172.21.15.84:0/4053263900 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d900cdf80 msgr2=0x7f7d90164ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:37.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:37.844+0000 7f7d953ff700 1 --2- 172.21.15.84:0/4053263900 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d900cdf80 0x7f7d90164ad0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f7d7800e9b0 tx=0x7f7d7800ecc0 comp rx=0 tx=0).stop 2023-07-14T11:18:37.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:37.844+0000 7f7d953ff700 1 -- 172.21.15.84:0/4053263900 shutdown_connections 2023-07-14T11:18:37.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:37.844+0000 7f7d953ff700 1 --2- 172.21.15.84:0/4053263900 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f7d7006ae00 0x7f7d7006d2b0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:37.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:37.845+0000 7f7d953ff700 1 --2- 172.21.15.84:0/4053263900 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d90158bb0 0x7f7d90165010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:37.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:37.845+0000 7f7d953ff700 1 --2- 172.21.15.84:0/4053263900 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d900cbe40 0x7f7d9014bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:37.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:37.845+0000 7f7d953ff700 1 --2- 172.21.15.84:0/4053263900 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d900cdf80 0x7f7d90164ad0 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:37.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:37.845+0000 7f7d953ff700 1 -- 172.21.15.84:0/4053263900 >> 172.21.15.84:0/4053263900 conn(0x7f7d900b05d0 msgr2=0x7f7d900b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:37.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:37.845+0000 7f7d953ff700 1 -- 172.21.15.84:0/4053263900 shutdown_connections 2023-07-14T11:18:37.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:37.845+0000 7f7d953ff700 1 -- 172.21.15.84:0/4053263900 wait complete. 2023-07-14T11:18:37.849 INFO:teuthology.orchestra.run.smithi084.stderr: removed all blocklist entries 2023-07-14T11:18:37.867 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-14T11:18:38.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.064+0000 7f0feddff700 1 Processor -- start 2023-07-14T11:18:38.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.064+0000 7f0feddff700 1 -- start start 2023-07-14T11:18:38.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.066+0000 7f0feddff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0fe80d1160 0x7f0fe806c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:38.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.066+0000 7f0feddff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0fe80b5cd0 0x7f0fe80b0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:38.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.066+0000 7f0feddff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fe80d2cc0 con 0x7f0fe8160030 2023-07-14T11:18:38.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.066+0000 7f0feddff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fe80afbb0 con 0x7f0fe80b5cd0 2023-07-14T11:18:38.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.066+0000 7f0feddff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe80afe90 con 0x7f0fe80d1160 2023-07-14T11:18:38.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.066+0000 7f0fe77fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f0fe8160030 0x7f0fe80d0a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:59110/0 (socket says 172.21.15.84:59110) 2023-07-14T11:18:38.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.066+0000 7f0fe77fe700 1 -- 172.21.15.84:0/2516307832 learned_addr learned my addr 172.21.15.84:0/2516307832 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:18:38.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.066+0000 7f0fe7fff700 1 --2- 172.21.15.84:0/2516307832 >> v2:172.21.15.84:3300/0 conn(0x7f0fe80b5cd0 0x7f0fe80b0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:38.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.066+0000 7f0fe6ffd700 1 --2- 172.21.15.84:0/2516307832 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0fe80d1160 0x7f0fe806c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:38.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.066+0000 7f0fe67fc700 1 -- 172.21.15.84:0/2516307832 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3188559837 0 0) 0x7f0fe80d2cc0 con 0x7f0fe8160030 2023-07-14T11:18:38.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.066+0000 7f0fe67fc700 1 -- 172.21.15.84:0/2516307832 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fd00035b0 con 0x7f0fe8160030 2023-07-14T11:18:38.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.066+0000 7f0fe7fff700 1 -- 172.21.15.84:0/2516307832 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0fe80d1160 msgr2=0x7f0fe806c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:38.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.066+0000 7f0fe7fff700 1 --2- 172.21.15.84:0/2516307832 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0fe80d1160 0x7f0fe806c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:38.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.066+0000 7f0fe7fff700 1 -- 172.21.15.84:0/2516307832 >> v1:172.21.15.84:6789/0 conn(0x7f0fe8160030 legacy=0x7f0fe80d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:38.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.066+0000 7f0fe7fff700 1 -- 172.21.15.84:0/2516307832 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fe80b0170 con 0x7f0fe80b5cd0 2023-07-14T11:18:38.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.066+0000 7f0fe6ffd700 1 --2- 172.21.15.84:0/2516307832 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0fe80d1160 0x7f0fe806c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:18:38.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.067+0000 7f0fe7fff700 1 --2- 172.21.15.84:0/2516307832 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fe80b5cd0 0x7f0fe80b0c50 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f0fe0009d90 tx=0x7f0fe000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ba8b136b1737175 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:38.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.067+0000 7f0fe67fc700 1 -- 172.21.15.84:0/2516307832 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe000e070 con 0x7f0fe80b5cd0 2023-07-14T11:18:38.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.067+0000 7f0fe67fc700 1 -- 172.21.15.84:0/2516307832 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fe000bb20 con 0x7f0fe80b5cd0 2023-07-14T11:18:38.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.067+0000 7f0fe67fc700 1 -- 172.21.15.84:0/2516307832 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe0012430 con 0x7f0fe80b5cd0 2023-07-14T11:18:38.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.067+0000 7f0feddff700 1 -- 172.21.15.84:0/2516307832 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fe80b5cd0 msgr2=0x7f0fe80b0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:38.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.067+0000 7f0feddff700 1 --2- 172.21.15.84:0/2516307832 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fe80b5cd0 0x7f0fe80b0c50 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f0fe0009d90 tx=0x7f0fe000b330 comp rx=0 tx=0).stop 2023-07-14T11:18:38.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.068+0000 7f0feddff700 1 -- 172.21.15.84:0/2516307832 shutdown_connections 2023-07-14T11:18:38.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.068+0000 7f0feddff700 1 --2- 172.21.15.84:0/2516307832 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fe80b5cd0 0x7f0fe80b0c50 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:38.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.068+0000 7f0feddff700 1 --2- 172.21.15.84:0/2516307832 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0fe80d1160 0x7f0fe806c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:38.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.068+0000 7f0feddff700 1 -- 172.21.15.84:0/2516307832 >> 172.21.15.84:0/2516307832 conn(0x7f0fe809c190 msgr2=0x7f0fe80d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:38.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.068+0000 7f0feddff700 1 -- 172.21.15.84:0/2516307832 shutdown_connections 2023-07-14T11:18:38.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.068+0000 7f0feddff700 1 -- 172.21.15.84:0/2516307832 wait complete. 2023-07-14T11:18:38.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.070+0000 7f0feddff700 1 Processor -- start 2023-07-14T11:18:38.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.070+0000 7f0feddff700 1 -- start start 2023-07-14T11:18:38.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.071+0000 7f0feddff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fe80b5cd0 0x7f0fe814ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:38.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.071+0000 7f0feddff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0fe80d1160 0x7f0fe815c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:38.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.071+0000 7f0feddff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0fe8160030 0x7f0fe80c91a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:38.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.071+0000 7f0feddff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe81f5400 con 0x7f0fe80b5cd0 2023-07-14T11:18:38.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.071+0000 7f0feddff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe814c010 con 0x7f0fe8160030 2023-07-14T11:18:38.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.071+0000 7f0feddff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe814c2f0 con 0x7f0fe80d1160 2023-07-14T11:18:38.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.072+0000 7f0fe77fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fe80b5cd0 0x7f0fe814ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:38.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.072+0000 7f0fe77fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fe80b5cd0 0x7f0fe814ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55746/0 (socket says 172.21.15.84:55746) 2023-07-14T11:18:38.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.072+0000 7f0fe77fe700 1 -- 172.21.15.84:0/3402027102 learned_addr learned my addr 172.21.15.84:0/3402027102 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:38.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.072+0000 7f0fe7fff700 1 --2- 172.21.15.84:0/3402027102 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0fe8160030 0x7f0fe80c91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:38.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.072+0000 7f0fe6ffd700 1 --2- 172.21.15.84:0/3402027102 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0fe80d1160 0x7f0fe815c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:38.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.072+0000 7f0fe77fe700 1 -- 172.21.15.84:0/3402027102 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0fe80d1160 msgr2=0x7f0fe815c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:38.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.072+0000 7f0fe77fe700 1 --2- 172.21.15.84:0/3402027102 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0fe80d1160 0x7f0fe815c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:38.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.072+0000 7f0fe77fe700 1 -- 172.21.15.84:0/3402027102 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0fe8160030 msgr2=0x7f0fe80c91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:38.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.072+0000 7f0fe77fe700 1 --2- 172.21.15.84:0/3402027102 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0fe8160030 0x7f0fe80c91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:38.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.072+0000 7f0fe77fe700 1 -- 172.21.15.84:0/3402027102 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fe0009a70 con 0x7f0fe80b5cd0 2023-07-14T11:18:38.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.072+0000 7f0fe77fe700 1 --2- 172.21.15.84:0/3402027102 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fe80b5cd0 0x7f0fe814ba30 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f0fd8001eb0 tx=0x7f0fd800c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:38.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.073+0000 7f0fcffff700 1 -- 172.21.15.84:0/3402027102 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd8005d70 con 0x7f0fe80b5cd0 2023-07-14T11:18:38.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.073+0000 7f0fcffff700 1 -- 172.21.15.84:0/3402027102 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fd80070d0 con 0x7f0fe80b5cd0 2023-07-14T11:18:38.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.073+0000 7f0feddff700 1 -- 172.21.15.84:0/3402027102 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fe814c5d0 con 0x7f0fe80b5cd0 2023-07-14T11:18:38.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.073+0000 7f0fcffff700 1 -- 172.21.15.84:0/3402027102 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd8007460 con 0x7f0fe80b5cd0 2023-07-14T11:18:38.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.073+0000 7f0feddff700 1 -- 172.21.15.84:0/3402027102 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fe814c8b0 con 0x7f0fe80b5cd0 2023-07-14T11:18:38.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.074+0000 7f0feddff700 1 -- 172.21.15.84:0/3402027102 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fe81f55d0 con 0x7f0fe80b5cd0 2023-07-14T11:18:38.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.075+0000 7f0fcffff700 1 -- 172.21.15.84:0/3402027102 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f0fd80075c0 con 0x7f0fe80b5cd0 2023-07-14T11:18:38.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.076+0000 7f0fcffff700 1 --2- 172.21.15.84:0/3402027102 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f0fd406ae00 0x7f0fd406d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:38.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.076+0000 7f0fcffff700 1 -- 172.21.15.84:0/3402027102 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0fd8088720 con 0x7f0fe80b5cd0 2023-07-14T11:18:38.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.076+0000 7f0fe6ffd700 1 --2- 172.21.15.84:0/3402027102 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f0fd406ae00 0x7f0fd406d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:38.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.077+0000 7f0fe6ffd700 1 --2- 172.21.15.84:0/3402027102 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f0fd406ae00 0x7f0fd406d2b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0fe815e530 tx=0x7f0fdc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:38.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.080+0000 7f0fcffff700 1 -- 172.21.15.84:0/3402027102 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f0fe81f55d0 con 0x7f0fe80b5cd0 2023-07-14T11:18:38.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.347+0000 7f0feddff700 1 -- 172.21.15.84:0/3402027102 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f0fe81f55d0 con 0x7f0fe80b5cd0 2023-07-14T11:18:38.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.348+0000 7f0fcffff700 1 -- 172.21.15.84:0/3402027102 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v20) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f0fe81f55d0 con 0x7f0fe80b5cd0 2023-07-14T11:18:38.350 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:18:38.351 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-07-14T11:18:38.351 INFO:teuthology.orchestra.run.smithi084.stdout: "auth_dump": [ 2023-07-14T11:18:38.351 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:38.351 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.a", 2023-07-14T11:18:38.351 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCJLbFkprwsJhAAIZa03ewirqLtc0mn7ki6Vw==", 2023-07-14T11:18:38.351 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:18:38.351 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-07-14T11:18:38.352 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-07-14T11:18:38.352 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-07-14T11:18:38.352 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:18:38.352 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:38.352 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:38.352 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:38.352 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.b", 2023-07-14T11:18:38.353 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCKLbFkfYOoAhAAQcpDkBRXNSDyfnZp1A/BJw==", 2023-07-14T11:18:38.353 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:18:38.353 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-07-14T11:18:38.353 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-07-14T11:18:38.353 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-07-14T11:18:38.353 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:18:38.353 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:38.353 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:38.354 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:38.354 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.c", 2023-07-14T11:18:38.354 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCJLbFk9MZ4MhAAY2CpAoK7Bx7NyoccpK7MLA==", 2023-07-14T11:18:38.354 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:18:38.354 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-07-14T11:18:38.354 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-07-14T11:18:38.354 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-07-14T11:18:38.354 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:18:38.355 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:38.355 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:38.355 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:38.355 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.d", 2023-07-14T11:18:38.355 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCKLbFkfxxFDhAAFPvGUrg0RW1nYTAdACvEAA==", 2023-07-14T11:18:38.355 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:18:38.355 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-07-14T11:18:38.355 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-07-14T11:18:38.356 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-07-14T11:18:38.356 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:18:38.356 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:38.356 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:38.356 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:38.356 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.0", 2023-07-14T11:18:38.356 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCOLbFkd18mDBAA2tneRYzoJkGwIZNDW6+Z7w==", 2023-07-14T11:18:38.357 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:18:38.357 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-07-14T11:18:38.357 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-07-14T11:18:38.357 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:18:38.357 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:38.357 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:38.357 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:38.357 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.1", 2023-07-14T11:18:38.358 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCRLbFkwBlAEBAAoEG62Dam3KHra4oNXBGyfw==", 2023-07-14T11:18:38.358 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:18:38.358 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-07-14T11:18:38.358 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-07-14T11:18:38.358 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:18:38.358 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:38.358 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:38.358 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:38.359 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.2", 2023-07-14T11:18:38.359 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCULbFkCln2ExAAKM+sAwMtcH6yEbNUqHbN4Q==", 2023-07-14T11:18:38.359 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:18:38.359 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-07-14T11:18:38.359 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-07-14T11:18:38.359 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:18:38.359 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:38.360 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:38.360 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:38.360 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.3", 2023-07-14T11:18:38.360 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCXLbFk0ZGgFxAAgOEUoX5jqzic6bOxtG7qSw==", 2023-07-14T11:18:38.360 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:18:38.360 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-07-14T11:18:38.360 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-07-14T11:18:38.360 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:18:38.361 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:38.361 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:38.361 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:38.361 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.4", 2023-07-14T11:18:38.361 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCdLbFknOESLBAA9usIfRfkbbLiMOCvUR+pXQ==", 2023-07-14T11:18:38.361 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:18:38.361 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-07-14T11:18:38.361 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-07-14T11:18:38.362 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:18:38.362 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:38.362 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:38.362 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:38.362 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.5", 2023-07-14T11:18:38.362 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCgLbFk+Rk/LxAAGqk3ueTaGaSINPuxoW53Gw==", 2023-07-14T11:18:38.362 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:18:38.363 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-07-14T11:18:38.363 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-07-14T11:18:38.363 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:18:38.363 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:38.363 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:38.363 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:38.363 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.6", 2023-07-14T11:18:38.363 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCjLbFk1/QfMxAABnWxus7LXfn7R0iwMVTWiA==", 2023-07-14T11:18:38.364 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:18:38.364 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-07-14T11:18:38.364 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-07-14T11:18:38.364 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:18:38.364 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:38.364 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:38.364 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:38.364 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.7", 2023-07-14T11:18:38.365 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCmLbFkNnhmNhAAz85GY1Sb1NuKINJCyWpPGQ==", 2023-07-14T11:18:38.365 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:18:38.365 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-07-14T11:18:38.365 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-07-14T11:18:38.365 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:18:38.365 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:38.365 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:38.366 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:38.366 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.0", 2023-07-14T11:18:38.366 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCKLbFkKSl5GBAAwPK4Zs6+gv/6YKHh4JI3WA==", 2023-07-14T11:18:38.366 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:18:38.366 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-07-14T11:18:38.366 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow r", 2023-07-14T11:18:38.366 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-14T11:18:38.366 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:38.367 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:38.367 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:38.367 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.1", 2023-07-14T11:18:38.367 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCKLbFkieNzJxAARri6UfCWdcXA3NpeFfvILw==", 2023-07-14T11:18:38.367 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:18:38.367 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-07-14T11:18:38.367 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-07-14T11:18:38.367 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-07-14T11:18:38.368 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-07-14T11:18:38.368 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:38.368 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:38.368 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:38.368 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.2", 2023-07-14T11:18:38.368 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCKLbFkLhv6HxAACUfTJK618qRsXETPJagZXQ==", 2023-07-14T11:18:38.368 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:18:38.368 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-07-14T11:18:38.369 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-07-14T11:18:38.369 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-07-14T11:18:38.369 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-07-14T11:18:38.369 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:38.369 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:38.369 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:38.369 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.3", 2023-07-14T11:18:38.370 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCKLbFka9HxLhAA4OsQY/t7A2FIYLEyYgJ19Q==", 2023-07-14T11:18:38.370 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:18:38.370 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-07-14T11:18:38.370 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-07-14T11:18:38.370 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-07-14T11:18:38.370 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-07-14T11:18:38.370 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:38.370 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:38.371 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:38.371 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.admin", 2023-07-14T11:18:38.371 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCILbFkmVPbKRAAffsYBVR51b7R8sXpbdF0MQ==", 2023-07-14T11:18:38.371 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:18:38.371 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow *", 2023-07-14T11:18:38.371 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-07-14T11:18:38.371 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-07-14T11:18:38.371 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:18:38.372 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:38.372 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:38.372 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:38.372 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mgr.x", 2023-07-14T11:18:38.372 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCJLbFk28xTHhAAAlmm5bW9VTtgE+OujO+G2w==", 2023-07-14T11:18:38.372 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:18:38.372 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow *", 2023-07-14T11:18:38.372 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile mgr", 2023-07-14T11:18:38.373 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:18:38.373 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:38.373 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:38.373 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:38.373 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mgr.y", 2023-07-14T11:18:38.373 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCJLbFk5dM1FhAAJWbB+GogsfcSkaBdHrFg4A==", 2023-07-14T11:18:38.373 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:18:38.374 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow *", 2023-07-14T11:18:38.374 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile mgr", 2023-07-14T11:18:38.374 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:18:38.374 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:38.374 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:38.374 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2023-07-14T11:18:38.374 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-07-14T11:18:38.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.350+0000 7f0feddff700 1 -- 172.21.15.84:0/3402027102 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f0fd406ae00 msgr2=0x7f0fd406d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:38.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.350+0000 7f0feddff700 1 --2- 172.21.15.84:0/3402027102 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f0fd406ae00 0x7f0fd406d2b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0fe815e530 tx=0x7f0fdc008040 comp rx=0 tx=0).stop 2023-07-14T11:18:38.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.350+0000 7f0feddff700 1 -- 172.21.15.84:0/3402027102 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fe80b5cd0 msgr2=0x7f0fe814ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:38.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.350+0000 7f0feddff700 1 --2- 172.21.15.84:0/3402027102 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fe80b5cd0 0x7f0fe814ba30 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f0fd8001eb0 tx=0x7f0fd800c7b0 comp rx=0 tx=0).stop 2023-07-14T11:18:38.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.350+0000 7f0feddff700 1 -- 172.21.15.84:0/3402027102 shutdown_connections 2023-07-14T11:18:38.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.350+0000 7f0feddff700 1 --2- 172.21.15.84:0/3402027102 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0fe8160030 0x7f0fe80c91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:38.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.350+0000 7f0feddff700 1 --2- 172.21.15.84:0/3402027102 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fe80b5cd0 0x7f0fe814ba30 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:38.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.350+0000 7f0feddff700 1 --2- 172.21.15.84:0/3402027102 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f0fd406ae00 0x7f0fd406d2b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:38.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.350+0000 7f0feddff700 1 --2- 172.21.15.84:0/3402027102 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0fe80d1160 0x7f0fe815c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:38.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.350+0000 7f0feddff700 1 -- 172.21.15.84:0/3402027102 >> 172.21.15.84:0/3402027102 conn(0x7f0fe809c190 msgr2=0x7f0fe80b4b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:38.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.350+0000 7f0feddff700 1 -- 172.21.15.84:0/3402027102 shutdown_connections 2023-07-14T11:18:38.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.350+0000 7f0feddff700 1 -- 172.21.15.84:0/3402027102 wait complete. 2023-07-14T11:18:38.378 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:18:38.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.571+0000 7fd5c75ff700 1 Processor -- start 2023-07-14T11:18:38.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.571+0000 7fd5c75ff700 1 -- start start 2023-07-14T11:18:38.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.572+0000 7fd5c75ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd5c00b4510 0x7fd5c00b6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:38.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.572+0000 7fd5c75ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5c00b7f50 con 0x7fd5c00b5d90 2023-07-14T11:18:38.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.572+0000 7fd5c75ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5c00cdca0 con 0x7fd5c00d0b10 2023-07-14T11:18:38.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.572+0000 7fd5c75ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5c00b48e0 con 0x7fd5c00b4510 2023-07-14T11:18:38.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.572+0000 7fd5c539b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd5c00b4510 0x7fd5c00b6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:38.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.572+0000 7fd5c539b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd5c00b4510 0x7fd5c00b6c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55750/0 (socket says 172.21.15.84:55750) 2023-07-14T11:18:38.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.572+0000 7fd5c539b700 1 -- 172.21.15.84:0/3656640197 learned_addr learned my addr 172.21.15.84:0/3656640197 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:38.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.573+0000 7fd5c539b700 1 -- 172.21.15.84:0/3656640197 >> v1:172.21.15.179:6789/0 conn(0x7fd5c00d0b10 legacy=0x7fd5c00b83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:38.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.573+0000 7fd5c539b700 1 -- 172.21.15.84:0/3656640197 >> v1:172.21.15.84:6789/0 conn(0x7fd5c00b5d90 legacy=0x7fd5c00cd590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:38.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.573+0000 7fd5c539b700 1 -- 172.21.15.84:0/3656640197 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c00b7340 con 0x7fd5c00b4510 2023-07-14T11:18:38.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.573+0000 7fd5c539b700 1 --2- 172.21.15.84:0/3656640197 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5c00b4510 0x7fd5c00b6c80 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc0098e0 tx=0x7fd5bc009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6e45b99f8e5b56e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:38.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.573+0000 7fd5b7fff700 1 -- 172.21.15.84:0/3656640197 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc004230 con 0x7fd5c00b4510 2023-07-14T11:18:38.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.573+0000 7fd5b7fff700 1 -- 172.21.15.84:0/3656640197 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5bc004390 con 0x7fd5c00b4510 2023-07-14T11:18:38.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.573+0000 7fd5b7fff700 1 -- 172.21.15.84:0/3656640197 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc0036a0 con 0x7fd5c00b4510 2023-07-14T11:18:38.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.574+0000 7fd5c75ff700 1 -- 172.21.15.84:0/3656640197 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5c00b4510 msgr2=0x7fd5c00b6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:38.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.574+0000 7fd5c75ff700 1 --2- 172.21.15.84:0/3656640197 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5c00b4510 0x7fd5c00b6c80 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc0098e0 tx=0x7fd5bc009bf0 comp rx=0 tx=0).stop 2023-07-14T11:18:38.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.574+0000 7fd5c75ff700 1 -- 172.21.15.84:0/3656640197 shutdown_connections 2023-07-14T11:18:38.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.574+0000 7fd5c75ff700 1 --2- 172.21.15.84:0/3656640197 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5c00b4510 0x7fd5c00b6c80 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:38.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.574+0000 7fd5c75ff700 1 -- 172.21.15.84:0/3656640197 >> 172.21.15.84:0/3656640197 conn(0x7fd5c009c1d0 msgr2=0x7fd5c00d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:38.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.574+0000 7fd5c75ff700 1 -- 172.21.15.84:0/3656640197 shutdown_connections 2023-07-14T11:18:38.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.574+0000 7fd5c75ff700 1 -- 172.21.15.84:0/3656640197 wait complete. 2023-07-14T11:18:38.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.576+0000 7fd5c75ff700 1 Processor -- start 2023-07-14T11:18:38.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.576+0000 7fd5c75ff700 1 -- start start 2023-07-14T11:18:38.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.577+0000 7fd5c75ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5c00b4510 0x7fd5c015d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:38.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.577+0000 7fd5c75ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5c00b5d90 0x7fd5c00cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:38.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.577+0000 7fd5c75ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5c00d0b10 0x7fd5c0150210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:38.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.577+0000 7fd5c75ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c01f3ae0 con 0x7fd5c00b4510 2023-07-14T11:18:38.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.577+0000 7fd5c75ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c00cc830 con 0x7fd5c00d0b10 2023-07-14T11:18:38.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.577+0000 7fd5c75ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c00ca0b0 con 0x7fd5c00b5d90 2023-07-14T11:18:38.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.577+0000 7fd5c539b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5c00b4510 0x7fd5c015d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:38.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.577+0000 7fd5c539b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5c00b4510 0x7fd5c015d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55752/0 (socket says 172.21.15.84:55752) 2023-07-14T11:18:38.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.577+0000 7fd5c539b700 1 -- 172.21.15.84:0/2540630961 learned_addr learned my addr 172.21.15.84:0/2540630961 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:38.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.577+0000 7fd5c539b700 1 -- 172.21.15.84:0/2540630961 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5c00b5d90 msgr2=0x7fd5c00cc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:38.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.577+0000 7fd5c539b700 1 --2- 172.21.15.84:0/2540630961 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5c00b5d90 0x7fd5c00cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:38.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.577+0000 7fd5c539b700 1 -- 172.21.15.84:0/2540630961 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5c00d0b10 msgr2=0x7fd5c0150210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:38.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.577+0000 7fd5c539b700 1 --2- 172.21.15.84:0/2540630961 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5c00d0b10 0x7fd5c0150210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:38.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.577+0000 7fd5c539b700 1 -- 172.21.15.84:0/2540630961 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5bc0094f0 con 0x7fd5c00b4510 2023-07-14T11:18:38.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.577+0000 7fd5c539b700 1 --2- 172.21.15.84:0/2540630961 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5c00b4510 0x7fd5c015d7c0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fd5c0067360 tx=0x7fd5bc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:38.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.578+0000 7fd5b5ffb700 1 -- 172.21.15.84:0/2540630961 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc00b860 con 0x7fd5c00b4510 2023-07-14T11:18:38.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.578+0000 7fd5b5ffb700 1 -- 172.21.15.84:0/2540630961 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5bc00b9c0 con 0x7fd5c00b4510 2023-07-14T11:18:38.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.578+0000 7fd5c75ff700 1 -- 172.21.15.84:0/2540630961 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5c015dda0 con 0x7fd5c00b4510 2023-07-14T11:18:38.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.578+0000 7fd5b5ffb700 1 -- 172.21.15.84:0/2540630961 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc00bd70 con 0x7fd5c00b4510 2023-07-14T11:18:38.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.578+0000 7fd5c75ff700 1 -- 172.21.15.84:0/2540630961 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5c00ca350 con 0x7fd5c00b4510 2023-07-14T11:18:38.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.579+0000 7fd5c75ff700 1 -- 172.21.15.84:0/2540630961 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5c004e280 con 0x7fd5c00b4510 2023-07-14T11:18:38.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.580+0000 7fd5b5ffb700 1 -- 172.21.15.84:0/2540630961 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7fd5bc01b440 con 0x7fd5c00b4510 2023-07-14T11:18:38.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.581+0000 7fd5b5ffb700 1 --2- 172.21.15.84:0/2540630961 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fd5a406ae00 0x7fd5a406d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:38.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.581+0000 7fd5b5ffb700 1 -- 172.21.15.84:0/2540630961 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd5bc08aba0 con 0x7fd5c00b4510 2023-07-14T11:18:38.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.582+0000 7fd5c4b9a700 1 --2- 172.21.15.84:0/2540630961 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fd5a406ae00 0x7fd5a406d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:38.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.582+0000 7fd5c4b9a700 1 --2- 172.21.15.84:0/2540630961 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fd5a406ae00 0x7fd5a406d2b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd5b0000f60 tx=0x7fd5b0007a40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:38.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.585+0000 7fd5b5ffb700 1 -- 172.21.15.84:0/2540630961 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fd5bc055f20 con 0x7fd5c00b4510 2023-07-14T11:18:38.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.778+0000 7fd5c75ff700 1 -- 172.21.15.84:0/2540630961 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd5c015afd0 con 0x7fd5c00b4510 2023-07-14T11:18:38.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.779+0000 7fd5b5ffb700 1 -- 172.21.15.84:0/2540630961 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+14616 (secure 0 0 0) 0x7fd5bc006d80 con 0x7fd5c00b4510 2023-07-14T11:18:38.782 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:18:38.782 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":84,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:18:37.835790+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:18:38.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.781+0000 7fd5c75ff700 1 -- 172.21.15.84:0/2540630961 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fd5a406ae00 msgr2=0x7fd5a406d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:38.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.781+0000 7fd5c75ff700 1 --2- 172.21.15.84:0/2540630961 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fd5a406ae00 0x7fd5a406d2b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd5b0000f60 tx=0x7fd5b0007a40 comp rx=0 tx=0).stop 2023-07-14T11:18:38.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.781+0000 7fd5c75ff700 1 -- 172.21.15.84:0/2540630961 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5c00b4510 msgr2=0x7fd5c015d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:38.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.781+0000 7fd5c75ff700 1 --2- 172.21.15.84:0/2540630961 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5c00b4510 0x7fd5c015d7c0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fd5c0067360 tx=0x7fd5bc004750 comp rx=0 tx=0).stop 2023-07-14T11:18:38.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.781+0000 7fd5c75ff700 1 -- 172.21.15.84:0/2540630961 shutdown_connections 2023-07-14T11:18:38.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.781+0000 7fd5c75ff700 1 --2- 172.21.15.84:0/2540630961 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5c00d0b10 0x7fd5c0150210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:38.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.781+0000 7fd5c75ff700 1 --2- 172.21.15.84:0/2540630961 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5c00b4510 0x7fd5c015d7c0 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:38.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.781+0000 7fd5c75ff700 1 --2- 172.21.15.84:0/2540630961 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fd5a406ae00 0x7fd5a406d2b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:38.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.781+0000 7fd5c75ff700 1 --2- 172.21.15.84:0/2540630961 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5c00b5d90 0x7fd5c00cc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:38.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.781+0000 7fd5c75ff700 1 -- 172.21.15.84:0/2540630961 >> 172.21.15.84:0/2540630961 conn(0x7fd5c009c1d0 msgr2=0x7fd5c00ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:38.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.781+0000 7fd5c75ff700 1 -- 172.21.15.84:0/2540630961 shutdown_connections 2023-07-14T11:18:38.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.781+0000 7fd5c75ff700 1 -- 172.21.15.84:0/2540630961 wait complete. 2023-07-14T11:18:38.802 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T11:13:00.125395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T11:13:06.803994+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T11:18:38.803 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T11:18:39.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.998+0000 7f5376bff700 1 Processor -- start 2023-07-14T11:18:39.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.998+0000 7f5376bff700 1 -- start start 2023-07-14T11:18:39.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.999+0000 7f5376bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53700d0b10 0x7f53700d0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:39.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.999+0000 7f5376bff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f53700b0e20 0x7f53700b12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:39.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.999+0000 7f5376bff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53700d14a0 con 0x7f53700b8a60 2023-07-14T11:18:39.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.999+0000 7f5376bff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53700b8e30 con 0x7f53700b0e20 2023-07-14T11:18:39.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:38.999+0000 7f5376bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53700afaa0 con 0x7f53700d0b10 2023-07-14T11:18:39.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.000+0000 7f537519c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f53700b0e20 0x7f53700b12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:39.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.000+0000 7f537519c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f53700b0e20 0x7f53700b12a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39064/0 (socket says 172.21.15.84:39064) 2023-07-14T11:18:39.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.000+0000 7f537519c700 1 -- 172.21.15.84:0/2311837410 learned_addr learned my addr 172.21.15.84:0/2311837410 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:39.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.000+0000 7f536ffff700 1 --2- 172.21.15.84:0/2311837410 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53700d0b10 0x7f53700d0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:39.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.000+0000 7f537519c700 1 -- 172.21.15.84:0/2311837410 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53700d0b10 msgr2=0x7f53700d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:39.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.000+0000 7f537519c700 1 --2- 172.21.15.84:0/2311837410 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53700d0b10 0x7f53700d0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:39.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.000+0000 7f537519c700 1 -- 172.21.15.84:0/2311837410 >> v1:172.21.15.179:6789/0 conn(0x7f53700b8a60 legacy=0x7f53700b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:39.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.000+0000 7f537519c700 1 -- 172.21.15.84:0/2311837410 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53700afd80 con 0x7f53700b0e20 2023-07-14T11:18:39.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.000+0000 7f536ffff700 1 --2- 172.21.15.84:0/2311837410 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53700d0b10 0x7f53700d0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:18:39.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.000+0000 7f537519c700 1 --2- 172.21.15.84:0/2311837410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53700b0e20 0x7f53700b12a0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f5368009e50 tx=0x7f536800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4658304f7672adc server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:39.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.001+0000 7f536f7fe700 1 -- 172.21.15.84:0/2311837410 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f536800e070 con 0x7f53700b0e20 2023-07-14T11:18:39.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.001+0000 7f536f7fe700 1 -- 172.21.15.84:0/2311837410 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f536800b9c0 con 0x7f53700b0e20 2023-07-14T11:18:39.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.001+0000 7f536f7fe700 1 -- 172.21.15.84:0/2311837410 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f536800bd70 con 0x7f53700b0e20 2023-07-14T11:18:39.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.001+0000 7f5376bff700 1 -- 172.21.15.84:0/2311837410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53700b0e20 msgr2=0x7f53700b12a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:39.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.001+0000 7f5376bff700 1 --2- 172.21.15.84:0/2311837410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53700b0e20 0x7f53700b12a0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f5368009e50 tx=0x7f536800b330 comp rx=0 tx=0).stop 2023-07-14T11:18:39.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.001+0000 7f5376bff700 1 -- 172.21.15.84:0/2311837410 shutdown_connections 2023-07-14T11:18:39.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.001+0000 7f5376bff700 1 --2- 172.21.15.84:0/2311837410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53700b0e20 0x7f53700b12a0 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:39.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.001+0000 7f5376bff700 1 --2- 172.21.15.84:0/2311837410 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53700d0b10 0x7f53700d0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:39.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.001+0000 7f5376bff700 1 -- 172.21.15.84:0/2311837410 >> 172.21.15.84:0/2311837410 conn(0x7f537009c1b0 msgr2=0x7f53700d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:39.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.001+0000 7f5376bff700 1 -- 172.21.15.84:0/2311837410 shutdown_connections 2023-07-14T11:18:39.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.001+0000 7f5376bff700 1 -- 172.21.15.84:0/2311837410 wait complete. 2023-07-14T11:18:39.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.003+0000 7f5376bff700 1 Processor -- start 2023-07-14T11:18:39.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.003+0000 7f5376bff700 1 -- start start 2023-07-14T11:18:39.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.004+0000 7f5376bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53700b0e20 0x7f5370151100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:39.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.004+0000 7f5376bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53700b8a60 0x7f53701524d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:39.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.004+0000 7f5376bff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53700d0b10 0x7f53700cf700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:39.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.004+0000 7f5376bff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53700d0430 con 0x7f53700d0b10 2023-07-14T11:18:39.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.004+0000 7f5376bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53700cfc40 con 0x7f53700b0e20 2023-07-14T11:18:39.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.004+0000 7f5376bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53700cfe70 con 0x7f53700b8a60 2023-07-14T11:18:39.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.004+0000 7f537519c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53700d0b10 0x7f53700cf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:39.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.004+0000 7f537519c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53700d0b10 0x7f53700cf700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39068/0 (socket says 172.21.15.84:39068) 2023-07-14T11:18:39.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.004+0000 7f537519c700 1 -- 172.21.15.84:0/3675421057 learned_addr learned my addr 172.21.15.84:0/3675421057 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:39.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.005+0000 7f536ffff700 1 --2- 172.21.15.84:0/3675421057 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53700b8a60 0x7f53701524d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:39.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.005+0000 7f537499b700 1 --2- 172.21.15.84:0/3675421057 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53700b0e20 0x7f5370151100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:39.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.005+0000 7f537519c700 1 -- 172.21.15.84:0/3675421057 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53700b8a60 msgr2=0x7f53701524d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:39.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.005+0000 7f537519c700 1 --2- 172.21.15.84:0/3675421057 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53700b8a60 0x7f53701524d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:39.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.005+0000 7f537519c700 1 -- 172.21.15.84:0/3675421057 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53700b0e20 msgr2=0x7f5370151100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:39.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.005+0000 7f537519c700 1 --2- 172.21.15.84:0/3675421057 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53700b0e20 0x7f5370151100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:39.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.005+0000 7f537519c700 1 -- 172.21.15.84:0/3675421057 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5368009b30 con 0x7f53700d0b10 2023-07-14T11:18:39.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.005+0000 7f537499b700 1 --2- 172.21.15.84:0/3675421057 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53700b0e20 0x7f5370151100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:18:39.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.005+0000 7f537519c700 1 --2- 172.21.15.84:0/3675421057 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53700d0b10 0x7f53700cf700 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f53700681d0 tx=0x7f5368004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:39.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.005+0000 7f536d7fa700 1 -- 172.21.15.84:0/3675421057 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53680048f0 con 0x7f53700d0b10 2023-07-14T11:18:39.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.005+0000 7f536d7fa700 1 -- 172.21.15.84:0/3675421057 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53680092e0 con 0x7f53700d0b10 2023-07-14T11:18:39.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.005+0000 7f5376bff700 1 -- 172.21.15.84:0/3675421057 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53700d0150 con 0x7f53700d0b10 2023-07-14T11:18:39.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.005+0000 7f536d7fa700 1 -- 172.21.15.84:0/3675421057 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f536801c680 con 0x7f53700d0b10 2023-07-14T11:18:39.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.006+0000 7f5376bff700 1 -- 172.21.15.84:0/3675421057 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53700cd9f0 con 0x7f53700d0b10 2023-07-14T11:18:39.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.006+0000 7f5376bff700 1 -- 172.21.15.84:0/3675421057 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53700cd570 con 0x7f53700d0b10 2023-07-14T11:18:39.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.007+0000 7f536d7fa700 1 -- 172.21.15.84:0/3675421057 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f536801c7e0 con 0x7f53700d0b10 2023-07-14T11:18:39.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.008+0000 7f536d7fa700 1 --2- 172.21.15.84:0/3675421057 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f535406ae00 0x7f535406d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:39.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.009+0000 7f536d7fa700 1 -- 172.21.15.84:0/3675421057 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f536808a770 con 0x7f53700d0b10 2023-07-14T11:18:39.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.009+0000 7f537499b700 1 --2- 172.21.15.84:0/3675421057 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f535406ae00 0x7f535406d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:39.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.009+0000 7f537499b700 1 --2- 172.21.15.84:0/3675421057 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f535406ae00 0x7f535406d2b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5364000f60 tx=0x7f5364009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:39.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.012+0000 7f536d7fa700 1 -- 172.21.15.84:0/3675421057 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f53700cd570 con 0x7f53700d0b10 2023-07-14T11:18:39.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.206+0000 7f5376bff700 1 -- 172.21.15.84:0/3675421057 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f53700cd570 con 0x7f53700d0b10 2023-07-14T11:18:39.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.206+0000 7f536d7fa700 1 -- 172.21.15.84:0/3675421057 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) v1 ==== 93+0+10 (secure 0 0 0) 0x7f53700cd570 con 0x7f53700d0b10 2023-07-14T11:18:39.209 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-07-14T11:18:39.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.209+0000 7f5376bff700 1 -- 172.21.15.84:0/3675421057 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f535406ae00 msgr2=0x7f535406d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:39.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.209+0000 7f5376bff700 1 --2- 172.21.15.84:0/3675421057 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f535406ae00 0x7f535406d2b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5364000f60 tx=0x7f5364009040 comp rx=0 tx=0).stop 2023-07-14T11:18:39.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.209+0000 7f5376bff700 1 -- 172.21.15.84:0/3675421057 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53700d0b10 msgr2=0x7f53700cf700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:39.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.209+0000 7f5376bff700 1 --2- 172.21.15.84:0/3675421057 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53700d0b10 0x7f53700cf700 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f53700681d0 tx=0x7f5368004ad0 comp rx=0 tx=0).stop 2023-07-14T11:18:39.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.209+0000 7f5376bff700 1 -- 172.21.15.84:0/3675421057 shutdown_connections 2023-07-14T11:18:39.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.209+0000 7f5376bff700 1 --2- 172.21.15.84:0/3675421057 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53700d0b10 0x7f53700cf700 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:39.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.209+0000 7f5376bff700 1 --2- 172.21.15.84:0/3675421057 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53700b0e20 0x7f5370151100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:39.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.209+0000 7f5376bff700 1 --2- 172.21.15.84:0/3675421057 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f535406ae00 0x7f535406d2b0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:39.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.209+0000 7f5376bff700 1 --2- 172.21.15.84:0/3675421057 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53700b8a60 0x7f53701524d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:39.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.209+0000 7f5376bff700 1 -- 172.21.15.84:0/3675421057 >> 172.21.15.84:0/3675421057 conn(0x7f537009c1b0 msgr2=0x7f537006ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:39.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.209+0000 7f5376bff700 1 -- 172.21.15.84:0/3675421057 shutdown_connections 2023-07-14T11:18:39.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.209+0000 7f5376bff700 1 -- 172.21.15.84:0/3675421057 wait complete. 2023-07-14T11:18:39.229 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T11:18:39.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.424+0000 7fe9f5bff700 1 Processor -- start 2023-07-14T11:18:39.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.424+0000 7fe9f5bff700 1 -- start start 2023-07-14T11:18:39.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.425+0000 7fe9f5bff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe9f00d0b10 0x7fe9f00d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:39.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.426+0000 7fe9f5bff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9f00b8e30 con 0x7fe9f00b0e20 2023-07-14T11:18:39.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.426+0000 7fe9f5bff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9f00afaa0 con 0x7fe9f00b8a60 2023-07-14T11:18:39.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.426+0000 7fe9f5bff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9f00d14d0 con 0x7fe9f00d0b10 2023-07-14T11:18:39.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.426+0000 7fe9effff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fe9f00b0e20 0x7fe9f00b1260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:58318/0 (socket says 172.21.15.84:58318) 2023-07-14T11:18:39.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.426+0000 7fe9effff700 1 -- 172.21.15.84:0/2322299043 learned_addr learned my addr 172.21.15.84:0/2322299043 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:18:39.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.426+0000 7fe9eeffd700 1 --2- 172.21.15.84:0/2322299043 >> v2:172.21.15.179:3300/0 conn(0x7fe9f00d0b10 0x7fe9f00d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:39.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.426+0000 7fe9ee7fc700 1 -- 172.21.15.84:0/2322299043 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2088404121 0 0) 0x7fe9f00b8e30 con 0x7fe9f00b0e20 2023-07-14T11:18:39.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.426+0000 7fe9ee7fc700 1 -- 172.21.15.84:0/2322299043 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9d80035b0 con 0x7fe9f00b0e20 2023-07-14T11:18:39.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.427+0000 7fe9ee7fc700 1 -- 172.21.15.84:0/2322299043 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 733331192 0 0) 0x7fe9d80035b0 con 0x7fe9f00b0e20 2023-07-14T11:18:39.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.427+0000 7fe9ee7fc700 1 -- 172.21.15.84:0/2322299043 >> v2:172.21.15.179:3300/0 conn(0x7fe9f00d0b10 msgr2=0x7fe9f00d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:39.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.427+0000 7fe9ee7fc700 1 --2- 172.21.15.84:0/2322299043 >> v2:172.21.15.179:3300/0 conn(0x7fe9f00d0b10 0x7fe9f00d0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:39.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.427+0000 7fe9ee7fc700 1 -- 172.21.15.84:0/2322299043 >> v1:172.21.15.179:6789/0 conn(0x7fe9f00b8a60 legacy=0x7fe9f00b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:39.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.427+0000 7fe9ee7fc700 1 -- 172.21.15.84:0/2322299043 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9f00afd80 con 0x7fe9f00b0e20 2023-07-14T11:18:39.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.427+0000 7fe9ee7fc700 1 -- 172.21.15.84:0/2322299043 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7fe9e80019f0 con 0x7fe9f00b0e20 2023-07-14T11:18:39.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.427+0000 7fe9ee7fc700 1 -- 172.21.15.84:0/2322299043 >> v1:172.21.15.84:6789/0 conn(0x7fe9f00b0e20 legacy=0x7fe9f00b1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:39.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.427+0000 7fe9ee7fc700 1 --2- 172.21.15.84:0/2322299043 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9d8003a50 0x7fe9d8003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:39.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.427+0000 7fe9ee7fc700 1 --2- 172.21.15.84:0/2322299043 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9d8004850 0x7fe9d8004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:39.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.427+0000 7fe9ee7fc700 1 --2- 172.21.15.84:0/2322299043 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe9d8005200 0x7fe9d800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:39.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.427+0000 7fe9ee7fc700 1 -- 172.21.15.84:0/2322299043 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f00d14d0 con 0x7fe9d8004850 2023-07-14T11:18:39.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.427+0000 7fe9ee7fc700 1 -- 172.21.15.84:0/2322299043 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d800c0c0 con 0x7fe9d8005200 2023-07-14T11:18:39.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.427+0000 7fe9ee7fc700 1 -- 172.21.15.84:0/2322299043 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d800c280 con 0x7fe9d8003a50 2023-07-14T11:18:39.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.427+0000 7fe9eeffd700 1 --2- 172.21.15.84:0/2322299043 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9d8004850 0x7fe9d8004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:39.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.427+0000 7fe9ef7fe700 1 --2- 172.21.15.84:0/2322299043 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9d8003a50 0x7fe9d8003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:39.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.427+0000 7fe9effff700 1 --2- 172.21.15.84:0/2322299043 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe9d8005200 0x7fe9d800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:39.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.427+0000 7fe9eeffd700 1 -- 172.21.15.84:0/2322299043 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9d8003a50 msgr2=0x7fe9d8003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:39.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.427+0000 7fe9eeffd700 1 --2- 172.21.15.84:0/2322299043 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9d8003a50 0x7fe9d8003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:39.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.427+0000 7fe9eeffd700 1 -- 172.21.15.84:0/2322299043 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe9d8005200 msgr2=0x7fe9d800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:39.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.427+0000 7fe9eeffd700 1 --2- 172.21.15.84:0/2322299043 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe9d8005200 0x7fe9d800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:39.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.427+0000 7fe9eeffd700 1 -- 172.21.15.84:0/2322299043 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9d80035b0 con 0x7fe9d8004850 2023-07-14T11:18:39.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.427+0000 7fe9effff700 1 -- 172.21.15.84:0/2322299043 reap_dead start 2023-07-14T11:18:39.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.428+0000 7fe9eeffd700 1 --2- 172.21.15.84:0/2322299043 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9d8004850 0x7fe9d8004cc0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fe9e4009b60 tx=0x7fe9d8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86d4dd4b66c7f02c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:39.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.428+0000 7fe9ee7fc700 1 -- 172.21.15.84:0/2322299043 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e400e6c0 con 0x7fe9d8004850 2023-07-14T11:18:39.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.428+0000 7fe9ee7fc700 1 -- 172.21.15.84:0/2322299043 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9e400e820 con 0x7fe9d8004850 2023-07-14T11:18:39.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.428+0000 7fe9ee7fc700 1 -- 172.21.15.84:0/2322299043 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e400eb90 con 0x7fe9d8004850 2023-07-14T11:18:39.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.428+0000 7fe9f5bff700 1 -- 172.21.15.84:0/2322299043 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9d8004850 msgr2=0x7fe9d8004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:39.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.428+0000 7fe9f5bff700 1 --2- 172.21.15.84:0/2322299043 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9d8004850 0x7fe9d8004cc0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fe9e4009b60 tx=0x7fe9d8005880 comp rx=0 tx=0).stop 2023-07-14T11:18:39.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.428+0000 7fe9f5bff700 1 -- 172.21.15.84:0/2322299043 shutdown_connections 2023-07-14T11:18:39.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.428+0000 7fe9f5bff700 1 --2- 172.21.15.84:0/2322299043 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9d8004850 0x7fe9d8004cc0 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:39.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.428+0000 7fe9f5bff700 1 -- 172.21.15.84:0/2322299043 >> 172.21.15.84:0/2322299043 conn(0x7fe9f009c1b0 msgr2=0x7fe9f00d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:39.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.428+0000 7fe9f5bff700 1 -- 172.21.15.84:0/2322299043 shutdown_connections 2023-07-14T11:18:39.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.429+0000 7fe9f5bff700 1 -- 172.21.15.84:0/2322299043 wait complete. 2023-07-14T11:18:39.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.430+0000 7fe9f5bff700 1 Processor -- start 2023-07-14T11:18:39.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.430+0000 7fe9f5bff700 1 -- start start 2023-07-14T11:18:39.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.431+0000 7fe9f5bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe9d8004850 0x7fe9f00cc470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:39.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.431+0000 7fe9f5bff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9f015d4c0 0x7fe9f015dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:39.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.431+0000 7fe9f5bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9f015e180 0x7fe9f00cf370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:39.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.431+0000 7fe9f5bff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f00cc9b0 con 0x7fe9f015d4c0 2023-07-14T11:18:39.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.431+0000 7fe9f5bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f00cb3d0 con 0x7fe9d8004850 2023-07-14T11:18:39.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.431+0000 7fe9f5bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f00cb6b0 con 0x7fe9f015e180 2023-07-14T11:18:39.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.431+0000 7fe9eeffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9f015d4c0 0x7fe9f015dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:39.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.432+0000 7fe9eeffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9f015d4c0 0x7fe9f015dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39096/0 (socket says 172.21.15.84:39096) 2023-07-14T11:18:39.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.432+0000 7fe9eeffd700 1 -- 172.21.15.84:0/2116844789 learned_addr learned my addr 172.21.15.84:0/2116844789 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:39.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.432+0000 7fe9effff700 1 --2- 172.21.15.84:0/2116844789 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9f015e180 0x7fe9f00cf370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:39.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.432+0000 7fe9ef7fe700 1 --2- 172.21.15.84:0/2116844789 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe9d8004850 0x7fe9f00cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:39.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.432+0000 7fe9eeffd700 1 -- 172.21.15.84:0/2116844789 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9f015e180 msgr2=0x7fe9f00cf370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:39.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.432+0000 7fe9eeffd700 1 --2- 172.21.15.84:0/2116844789 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9f015e180 0x7fe9f00cf370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:39.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.432+0000 7fe9eeffd700 1 -- 172.21.15.84:0/2116844789 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe9d8004850 msgr2=0x7fe9f00cc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:39.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.432+0000 7fe9eeffd700 1 --2- 172.21.15.84:0/2116844789 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe9d8004850 0x7fe9f00cc470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:39.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.432+0000 7fe9eeffd700 1 -- 172.21.15.84:0/2116844789 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9f00cb990 con 0x7fe9f015d4c0 2023-07-14T11:18:39.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.432+0000 7fe9effff700 1 --2- 172.21.15.84:0/2116844789 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9f015e180 0x7fe9f00cf370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:18:39.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.432+0000 7fe9ef7fe700 1 --2- 172.21.15.84:0/2116844789 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe9d8004850 0x7fe9f00cc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:18:39.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.432+0000 7fe9eeffd700 1 --2- 172.21.15.84:0/2116844789 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9f015d4c0 0x7fe9f015dc40 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fe9d800c090 tx=0x7fe9e40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:39.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.432+0000 7fe9d7fff700 1 -- 172.21.15.84:0/2116844789 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e400e6c0 con 0x7fe9f015d4c0 2023-07-14T11:18:39.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.433+0000 7fe9d7fff700 1 -- 172.21.15.84:0/2116844789 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9e4003ad0 con 0x7fe9f015d4c0 2023-07-14T11:18:39.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.433+0000 7fe9f5bff700 1 -- 172.21.15.84:0/2116844789 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9f00cbc70 con 0x7fe9f015d4c0 2023-07-14T11:18:39.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.433+0000 7fe9d7fff700 1 -- 172.21.15.84:0/2116844789 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e4003e80 con 0x7fe9f015d4c0 2023-07-14T11:18:39.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.433+0000 7fe9f5bff700 1 -- 172.21.15.84:0/2116844789 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9f0152690 con 0x7fe9f015d4c0 2023-07-14T11:18:39.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.434+0000 7fe9f5bff700 1 -- 172.21.15.84:0/2116844789 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9f00cc2c0 con 0x7fe9f015d4c0 2023-07-14T11:18:39.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.435+0000 7fe9d7fff700 1 -- 172.21.15.84:0/2116844789 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7fe9e4013470 con 0x7fe9f015d4c0 2023-07-14T11:18:39.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.436+0000 7fe9d7fff700 1 --2- 172.21.15.84:0/2116844789 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fe9dc06ae00 0x7fe9dc06d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:39.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.436+0000 7fe9d7fff700 1 -- 172.21.15.84:0/2116844789 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fe9e408ac20 con 0x7fe9f015d4c0 2023-07-14T11:18:39.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.436+0000 7fe9ef7fe700 1 --2- 172.21.15.84:0/2116844789 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fe9dc06ae00 0x7fe9dc06d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:39.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.437+0000 7fe9ef7fe700 1 --2- 172.21.15.84:0/2116844789 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fe9dc06ae00 0x7fe9dc06d2b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe9e0000c00 tx=0x7fe9e0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:39.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.440+0000 7fe9d7fff700 1 -- 172.21.15.84:0/2116844789 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe9e4056020 con 0x7fe9f015d4c0 2023-07-14T11:18:39.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.635+0000 7fe9f5bff700 1 -- 172.21.15.84:0/2116844789 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe9f0074350 con 0x7fe9f015d4c0 2023-07-14T11:18:39.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.635+0000 7fe9d7fff700 1 -- 172.21.15.84:0/2116844789 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v84) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe9e40170a0 con 0x7fe9f015d4c0 2023-07-14T11:18:39.638 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-07-14T11:18:39.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.638+0000 7fe9f5bff700 1 -- 172.21.15.84:0/2116844789 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fe9dc06ae00 msgr2=0x7fe9dc06d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:39.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.638+0000 7fe9f5bff700 1 --2- 172.21.15.84:0/2116844789 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fe9dc06ae00 0x7fe9dc06d2b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe9e0000c00 tx=0x7fe9e0009040 comp rx=0 tx=0).stop 2023-07-14T11:18:39.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.638+0000 7fe9f5bff700 1 -- 172.21.15.84:0/2116844789 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9f015d4c0 msgr2=0x7fe9f015dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:39.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.638+0000 7fe9f5bff700 1 --2- 172.21.15.84:0/2116844789 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9f015d4c0 0x7fe9f015dc40 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fe9d800c090 tx=0x7fe9e40047c0 comp rx=0 tx=0).stop 2023-07-14T11:18:39.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.638+0000 7fe9f5bff700 1 -- 172.21.15.84:0/2116844789 shutdown_connections 2023-07-14T11:18:39.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.638+0000 7fe9f5bff700 1 --2- 172.21.15.84:0/2116844789 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fe9dc06ae00 0x7fe9dc06d2b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:39.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.638+0000 7fe9f5bff700 1 --2- 172.21.15.84:0/2116844789 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9f015e180 0x7fe9f00cf370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:39.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.638+0000 7fe9f5bff700 1 --2- 172.21.15.84:0/2116844789 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe9d8004850 0x7fe9f00cc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:39.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.638+0000 7fe9f5bff700 1 --2- 172.21.15.84:0/2116844789 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9f015d4c0 0x7fe9f015dc40 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:39.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.638+0000 7fe9f5bff700 1 -- 172.21.15.84:0/2116844789 >> 172.21.15.84:0/2116844789 conn(0x7fe9f009c1b0 msgr2=0x7fe9f00b49e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:39.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.638+0000 7fe9f5bff700 1 -- 172.21.15.84:0/2116844789 shutdown_connections 2023-07-14T11:18:39.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.638+0000 7fe9f5bff700 1 -- 172.21.15.84:0/2116844789 wait complete. 2023-07-14T11:18:39.658 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-14T11:18:39.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.852+0000 7f4b17dff700 1 Processor -- start 2023-07-14T11:18:39.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.852+0000 7f4b17dff700 1 -- start start 2023-07-14T11:18:39.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.853+0000 7f4b17dff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4b100d1220 0x7f4b100b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:39.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.853+0000 7f4b17dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b100b1e00 0x7f4b100afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:39.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.854+0000 7f4b17dff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b100d2ce0 con 0x7f4b1015c950 2023-07-14T11:18:39.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.854+0000 7f4b17dff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b100b3350 con 0x7f4b100d1220 2023-07-14T11:18:39.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.854+0000 7f4b17dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b100b3630 con 0x7f4b100b1e00 2023-07-14T11:18:39.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.854+0000 7f4b1539a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4b100d1220 0x7f4b100b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:39.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.854+0000 7f4b1539a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4b100d1220 0x7f4b100b43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39108/0 (socket says 172.21.15.84:39108) 2023-07-14T11:18:39.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.854+0000 7f4b1539a700 1 -- 172.21.15.84:0/4240657903 learned_addr learned my addr 172.21.15.84:0/4240657903 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:39.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.854+0000 7f4b1539a700 1 -- 172.21.15.84:0/4240657903 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b100b1e00 msgr2=0x7f4b100afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:39.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.854+0000 7f4b1639c700 1 --2- 172.21.15.84:0/4240657903 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b100b1e00 0x7f4b100afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:39.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.854+0000 7f4b1539a700 1 --2- 172.21.15.84:0/4240657903 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b100b1e00 0x7f4b100afac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:39.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.854+0000 7f4b1539a700 1 -- 172.21.15.84:0/4240657903 >> v1:172.21.15.179:6789/0 conn(0x7f4b1015c950 legacy=0x7f4b100d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:39.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.854+0000 7f4b1539a700 1 -- 172.21.15.84:0/4240657903 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b100b3910 con 0x7f4b100d1220 2023-07-14T11:18:39.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.854+0000 7f4b1639c700 1 --2- 172.21.15.84:0/4240657903 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b100b1e00 0x7f4b100afac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:18:39.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.855+0000 7f4b1539a700 1 --2- 172.21.15.84:0/4240657903 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b100d1220 0x7f4b100b43f0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f4b000098f0 tx=0x7f4b00009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1579e8f49772cbdb server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:39.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.855+0000 7f4b14b99700 1 -- 172.21.15.84:0/4240657903 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b00004230 con 0x7f4b100d1220 2023-07-14T11:18:39.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.855+0000 7f4b14b99700 1 -- 172.21.15.84:0/4240657903 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b00004390 con 0x7f4b100d1220 2023-07-14T11:18:39.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.855+0000 7f4b14b99700 1 -- 172.21.15.84:0/4240657903 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b000036a0 con 0x7f4b100d1220 2023-07-14T11:18:39.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.855+0000 7f4b17dff700 1 -- 172.21.15.84:0/4240657903 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b100d1220 msgr2=0x7f4b100b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:39.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.855+0000 7f4b17dff700 1 --2- 172.21.15.84:0/4240657903 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b100d1220 0x7f4b100b43f0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f4b000098f0 tx=0x7f4b00009c00 comp rx=0 tx=0).stop 2023-07-14T11:18:39.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.855+0000 7f4b17dff700 1 -- 172.21.15.84:0/4240657903 shutdown_connections 2023-07-14T11:18:39.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.855+0000 7f4b17dff700 1 --2- 172.21.15.84:0/4240657903 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b100b1e00 0x7f4b100afac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:39.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.855+0000 7f4b17dff700 1 --2- 172.21.15.84:0/4240657903 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b100d1220 0x7f4b100b43f0 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:39.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.855+0000 7f4b17dff700 1 -- 172.21.15.84:0/4240657903 >> 172.21.15.84:0/4240657903 conn(0x7f4b1009c1d0 msgr2=0x7f4b100d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:39.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.855+0000 7f4b17dff700 1 -- 172.21.15.84:0/4240657903 shutdown_connections 2023-07-14T11:18:39.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.856+0000 7f4b17dff700 1 -- 172.21.15.84:0/4240657903 wait complete. 2023-07-14T11:18:39.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.857+0000 7f4b17dff700 1 Processor -- start 2023-07-14T11:18:39.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.857+0000 7f4b17dff700 1 -- start start 2023-07-14T11:18:39.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.858+0000 7f4b17dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b100b1e00 0x7f4b100cc8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:39.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.858+0000 7f4b17dff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b100d1220 0x7f4b100c8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:39.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.858+0000 7f4b17dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b1015c950 0x7f4b100c8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:39.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.858+0000 7f4b17dff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b100cdcb0 con 0x7f4b100d1220 2023-07-14T11:18:39.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.858+0000 7f4b17dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b100c9280 con 0x7f4b1015c950 2023-07-14T11:18:39.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.858+0000 7f4b17dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1015bc10 con 0x7f4b100b1e00 2023-07-14T11:18:39.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.859+0000 7f4b1539a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b100d1220 0x7f4b100c8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:39.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.859+0000 7f4b1539a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b100d1220 0x7f4b100c8800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39112/0 (socket says 172.21.15.84:39112) 2023-07-14T11:18:39.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.859+0000 7f4b1539a700 1 -- 172.21.15.84:0/199302968 learned_addr learned my addr 172.21.15.84:0/199302968 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:39.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.859+0000 7f4b15b9b700 1 --2- 172.21.15.84:0/199302968 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b100b1e00 0x7f4b100cc8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:39.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.859+0000 7f4b1639c700 1 --2- 172.21.15.84:0/199302968 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b1015c950 0x7f4b100c8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:39.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.859+0000 7f4b1539a700 1 -- 172.21.15.84:0/199302968 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b100b1e00 msgr2=0x7f4b100cc8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:39.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.859+0000 7f4b1539a700 1 --2- 172.21.15.84:0/199302968 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b100b1e00 0x7f4b100cc8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:39.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.859+0000 7f4b1539a700 1 -- 172.21.15.84:0/199302968 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b1015c950 msgr2=0x7f4b100c8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:39.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.859+0000 7f4b1539a700 1 --2- 172.21.15.84:0/199302968 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b1015c950 0x7f4b100c8d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:39.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.859+0000 7f4b1539a700 1 -- 172.21.15.84:0/199302968 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b00009550 con 0x7f4b100d1220 2023-07-14T11:18:39.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.859+0000 7f4b1639c700 1 --2- 172.21.15.84:0/199302968 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b1015c950 0x7f4b100c8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:18:39.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.859+0000 7f4b1539a700 1 --2- 172.21.15.84:0/199302968 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b100d1220 0x7f4b100c8800 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f4b00004000 tx=0x7f4b00004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:39.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.860+0000 7f4b067fc700 1 -- 172.21.15.84:0/199302968 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b00003d80 con 0x7f4b100d1220 2023-07-14T11:18:39.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.860+0000 7f4b067fc700 1 -- 172.21.15.84:0/199302968 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b0001f070 con 0x7f4b100d1220 2023-07-14T11:18:39.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.860+0000 7f4b067fc700 1 -- 172.21.15.84:0/199302968 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0000b8a0 con 0x7f4b100d1220 2023-07-14T11:18:39.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.860+0000 7f4b17dff700 1 -- 172.21.15.84:0/199302968 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b100cd6a0 con 0x7f4b100d1220 2023-07-14T11:18:39.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.860+0000 7f4b17dff700 1 -- 172.21.15.84:0/199302968 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b100cd940 con 0x7f4b100d1220 2023-07-14T11:18:39.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.861+0000 7f4b17dff700 1 -- 172.21.15.84:0/199302968 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b100cde60 con 0x7f4b100d1220 2023-07-14T11:18:39.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.862+0000 7f4b067fc700 1 -- 172.21.15.84:0/199302968 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f4b00021030 con 0x7f4b100d1220 2023-07-14T11:18:39.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.862+0000 7f4b067fc700 1 --2- 172.21.15.84:0/199302968 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f4af406ae00 0x7f4af406d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:39.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.863+0000 7f4b067fc700 1 -- 172.21.15.84:0/199302968 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f4b0008a8b0 con 0x7f4b100d1220 2023-07-14T11:18:39.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.863+0000 7f4b15b9b700 1 --2- 172.21.15.84:0/199302968 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f4af406ae00 0x7f4af406d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:39.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.864+0000 7f4b15b9b700 1 --2- 172.21.15.84:0/199302968 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f4af406ae00 0x7f4af406d2b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c006fd0 tx=0x7f4b0c0090e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:39.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:39.866+0000 7f4b067fc700 1 -- 172.21.15.84:0/199302968 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f4b100cde60 con 0x7f4b100d1220 2023-07-14T11:18:40.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:40.063+0000 7f4b17dff700 1 -- 172.21.15.84:0/199302968 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f4b100cde60 con 0x7f4b100d1220 2023-07-14T11:18:40.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:40.064+0000 7f4b067fc700 1 -- 172.21.15.84:0/199302968 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v84) v1 ==== 84+0+126 (secure 0 0 0) 0x7f4b100cde60 con 0x7f4b100d1220 2023-07-14T11:18:40.067 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:18:40.067 INFO:teuthology.orchestra.run.smithi084.stdout:[ 2023-07-14T11:18:40.067 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:40.067 INFO:teuthology.orchestra.run.smithi084.stdout: "poolnum": 1, 2023-07-14T11:18:40.067 INFO:teuthology.orchestra.run.smithi084.stdout: "poolname": ".mgr" 2023-07-14T11:18:40.067 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:18:40.068 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:40.068 INFO:teuthology.orchestra.run.smithi084.stdout: "poolnum": 2, 2023-07-14T11:18:40.068 INFO:teuthology.orchestra.run.smithi084.stdout: "poolname": "rbd" 2023-07-14T11:18:40.068 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:40.068 INFO:teuthology.orchestra.run.smithi084.stdout:] 2023-07-14T11:18:40.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:40.066+0000 7f4b17dff700 1 -- 172.21.15.84:0/199302968 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f4af406ae00 msgr2=0x7f4af406d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:40.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:40.066+0000 7f4b17dff700 1 --2- 172.21.15.84:0/199302968 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f4af406ae00 0x7f4af406d2b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c006fd0 tx=0x7f4b0c0090e0 comp rx=0 tx=0).stop 2023-07-14T11:18:40.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:40.066+0000 7f4b17dff700 1 -- 172.21.15.84:0/199302968 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b100d1220 msgr2=0x7f4b100c8800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:40.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:40.066+0000 7f4b17dff700 1 --2- 172.21.15.84:0/199302968 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b100d1220 0x7f4b100c8800 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f4b00004000 tx=0x7f4b00004750 comp rx=0 tx=0).stop 2023-07-14T11:18:40.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:40.067+0000 7f4b17dff700 1 -- 172.21.15.84:0/199302968 shutdown_connections 2023-07-14T11:18:40.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:40.067+0000 7f4b17dff700 1 --2- 172.21.15.84:0/199302968 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f4af406ae00 0x7f4af406d2b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:40.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:40.067+0000 7f4b17dff700 1 --2- 172.21.15.84:0/199302968 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b100b1e00 0x7f4b100cc8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:40.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:40.067+0000 7f4b17dff700 1 --2- 172.21.15.84:0/199302968 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b1015c950 0x7f4b100c8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:40.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:40.067+0000 7f4b17dff700 1 --2- 172.21.15.84:0/199302968 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b100d1220 0x7f4b100c8800 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:40.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:40.067+0000 7f4b17dff700 1 -- 172.21.15.84:0/199302968 >> 172.21.15.84:0/199302968 conn(0x7f4b1009c1d0 msgr2=0x7f4b100b0460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:40.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:40.067+0000 7f4b17dff700 1 -- 172.21.15.84:0/199302968 shutdown_connections 2023-07-14T11:18:40.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:40.067+0000 7f4b17dff700 1 -- 172.21.15.84:0/199302968 wait complete. 2023-07-14T11:18:40.087 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-14T11:18:40.087 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-14T11:18:40.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:40.284+0000 7f948abff700 1 Processor -- start 2023-07-14T11:18:40.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:40.284+0000 7f948abff700 1 -- start start 2023-07-14T11:18:40.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:40.285+0000 7f948abff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f94840b2440 0x7f94840cdbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:40.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:40.285+0000 7f948abff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f948415cc60 con 0x7f94840d1160 2023-07-14T11:18:40.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:40.285+0000 7f948abff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f948406a7f0 con 0x7f948415c890 2023-07-14T11:18:40.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:40.285+0000 7f948abff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f948406b760 con 0x7f94840b2440 2023-07-14T11:18:40.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:40.286+0000 7f9483fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f94840d1160 0x7f94840cd4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:58326/0 (socket says 172.21.15.84:58326) 2023-07-14T11:18:40.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:40.286+0000 7f9483fff700 1 -- 172.21.15.84:0/2106719897 learned_addr learned my addr 172.21.15.84:0/2106719897 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:18:40.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:40.286+0000 7f948919c700 1 --2- 172.21.15.84:0/2106719897 >> v2:172.21.15.179:3300/0 conn(0x7f94840b2440 0x7f94840cdbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:40.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:40.286+0000 7f94837fe700 1 -- 172.21.15.84:0/2106719897 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2308510398 0 0) 0x7f948415cc60 con 0x7f94840d1160 2023-07-14T11:18:40.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:40.286+0000 7f94837fe700 1 -- 172.21.15.84:0/2106719897 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94740035b0 con 0x7f94840d1160 2023-07-14T11:18:40.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:40.286+0000 7f948919c700 1 -- 172.21.15.84:0/2106719897 >> v1:172.21.15.179:6789/0 conn(0x7f948415c890 legacy=0x7f94840d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:40.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:40.286+0000 7f948919c700 1 -- 172.21.15.84:0/2106719897 >> v1:172.21.15.84:6789/0 conn(0x7f94840d1160 legacy=0x7f94840cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:40.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:40.286+0000 7f948919c700 1 -- 172.21.15.84:0/2106719897 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f948406ba40 con 0x7f94840b2440 2023-07-14T11:18:40.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:40.287+0000 7f948919c700 1 --2- 172.21.15.84:0/2106719897 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f94840b2440 0x7f94840cdbe0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f947c009d90 tx=0x7f947c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2bc7541927a7ca6e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:40.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:40.287+0000 7f94837fe700 1 -- 172.21.15.84:0/2106719897 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f947c00e070 con 0x7f94840b2440 2023-07-14T11:18:40.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:40.287+0000 7f94837fe700 1 -- 172.21.15.84:0/2106719897 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f947c00bb20 con 0x7f94840b2440 2023-07-14T11:18:40.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:40.287+0000 7f94837fe700 1 -- 172.21.15.84:0/2106719897 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f947c012430 con 0x7f94840b2440 2023-07-14T11:18:40.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:40.287+0000 7f948abff700 1 -- 172.21.15.84:0/2106719897 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f94840b2440 msgr2=0x7f94840cdbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:40.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:40.287+0000 7f948abff700 1 --2- 172.21.15.84:0/2106719897 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f94840b2440 0x7f94840cdbe0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f947c009d90 tx=0x7f947c00b330 comp rx=0 tx=0).stop 2023-07-14T11:18:40.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:40.287+0000 7f948abff700 1 -- 172.21.15.84:0/2106719897 shutdown_connections 2023-07-14T11:18:40.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:40.287+0000 7f948abff700 1 --2- 172.21.15.84:0/2106719897 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f94840b2440 0x7f94840cdbe0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:40.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:40.287+0000 7f948abff700 1 -- 172.21.15.84:0/2106719897 >> 172.21.15.84:0/2106719897 conn(0x7f948409c170 msgr2=0x7f94840d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:40.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:40.288+0000 7f948abff700 1 -- 172.21.15.84:0/2106719897 shutdown_connections 2023-07-14T11:18:40.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:40.288+0000 7f948abff700 1 -- 172.21.15.84:0/2106719897 wait complete. 2023-07-14T11:18:40.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:40.289+0000 7f948abff700 1 Processor -- start 2023-07-14T11:18:40.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:40.289+0000 7f948abff700 1 -- start start 2023-07-14T11:18:40.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:40.290+0000 7f948abff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94840b2440 0x7f94840c9690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:40.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:40.290+0000 7f948abff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f94840d1160 0x7f94840b8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:40.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:40.290+0000 7f948abff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f948415c890 0x7f948414ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:40.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:40.290+0000 7f948abff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94841f1f50 con 0x7f94840b2440 2023-07-14T11:18:40.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:40.290+0000 7f948abff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94840c7050 con 0x7f94840d1160 2023-07-14T11:18:40.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:40.290+0000 7f948abff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f948414e7a0 con 0x7f948415c890 2023-07-14T11:18:40.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:40.291+0000 7f948899b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94840b2440 0x7f94840c9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:40.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:40.291+0000 7f948899b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94840b2440 0x7f94840c9690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39120/0 (socket says 172.21.15.84:39120) 2023-07-14T11:18:40.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:40.291+0000 7f948899b700 1 -- 172.21.15.84:0/2653674911 learned_addr learned my addr 172.21.15.84:0/2653674911 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:40.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:40.291+0000 7f948899b700 1 -- 172.21.15.84:0/2653674911 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f948415c890 msgr2=0x7f948414ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:40.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:40.291+0000 7f9483fff700 1 --2- 172.21.15.84:0/2653674911 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f94840d1160 0x7f94840b8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:40.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:40.291+0000 7f948899b700 1 --2- 172.21.15.84:0/2653674911 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f948415c890 0x7f948414ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:40.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:40.291+0000 7f948899b700 1 -- 172.21.15.84:0/2653674911 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f94840d1160 msgr2=0x7f94840b8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:40.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:40.291+0000 7f948899b700 1 --2- 172.21.15.84:0/2653674911 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f94840d1160 0x7f94840b8960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:40.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:40.291+0000 7f948899b700 1 -- 172.21.15.84:0/2653674911 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f947c009a70 con 0x7f94840b2440 2023-07-14T11:18:40.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:40.291+0000 7f9483fff700 1 --2- 172.21.15.84:0/2653674911 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f94840d1160 0x7f94840b8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:18:40.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:40.291+0000 7f948899b700 1 --2- 172.21.15.84:0/2653674911 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94840b2440 0x7f94840c9690 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f947800c510 tx=0x7f947800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:40.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:40.292+0000 7f94817fa700 1 -- 172.21.15.84:0/2653674911 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94780052d0 con 0x7f94840b2440 2023-07-14T11:18:40.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:40.292+0000 7f94817fa700 1 -- 172.21.15.84:0/2653674911 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9478005430 con 0x7f94840b2440 2023-07-14T11:18:40.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:40.292+0000 7f948abff700 1 -- 172.21.15.84:0/2653674911 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94841e5fa0 con 0x7f94840b2440 2023-07-14T11:18:40.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:40.292+0000 7f94817fa700 1 -- 172.21.15.84:0/2653674911 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94780038c0 con 0x7f94840b2440 2023-07-14T11:18:40.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:40.292+0000 7f948abff700 1 -- 172.21.15.84:0/2653674911 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94840c8f20 con 0x7f94840b2440 2023-07-14T11:18:40.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:40.293+0000 7f948abff700 1 -- 172.21.15.84:0/2653674911 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9484074350 con 0x7f94840b2440 2023-07-14T11:18:40.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:40.294+0000 7f94817fa700 1 -- 172.21.15.84:0/2653674911 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f9478003a20 con 0x7f94840b2440 2023-07-14T11:18:40.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:40.295+0000 7f94817fa700 1 --2- 172.21.15.84:0/2653674911 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f946806ae00 0x7f946806d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:40.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:40.295+0000 7f94817fa700 1 -- 172.21.15.84:0/2653674911 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f94780886f0 con 0x7f94840b2440 2023-07-14T11:18:40.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:40.295+0000 7f9483fff700 1 --2- 172.21.15.84:0/2653674911 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f946806ae00 0x7f946806d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:40.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:40.296+0000 7f9483fff700 1 --2- 172.21.15.84:0/2653674911 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f946806ae00 0x7f946806d2b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f948415b620 tx=0x7f9470009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:40.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:40.299+0000 7f94817fa700 1 -- 172.21.15.84:0/2653674911 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f9478053a70 con 0x7f94840b2440 2023-07-14T11:18:40.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:40.491+0000 7f948abff700 1 -- 172.21.15.84:0/2653674911 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f948406c720 con 0x7f94840b2440 2023-07-14T11:18:41.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:41.001+0000 7f94817fa700 1 -- 172.21.15.84:0/2653674911 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v85) v1 ==== 138+0+0 (secure 0 0 0) 0x7f9478057090 con 0x7f94840b2440 2023-07-14T11:18:41.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:41.004+0000 7f948abff700 1 -- 172.21.15.84:0/2653674911 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f946806ae00 msgr2=0x7f946806d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:41.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:41.004+0000 7f948abff700 1 --2- 172.21.15.84:0/2653674911 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f946806ae00 0x7f946806d2b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f948415b620 tx=0x7f9470009040 comp rx=0 tx=0).stop 2023-07-14T11:18:41.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:41.004+0000 7f948abff700 1 -- 172.21.15.84:0/2653674911 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94840b2440 msgr2=0x7f94840c9690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:41.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:41.004+0000 7f948abff700 1 --2- 172.21.15.84:0/2653674911 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94840b2440 0x7f94840c9690 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f947800c510 tx=0x7f947800c8d0 comp rx=0 tx=0).stop 2023-07-14T11:18:41.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:41.005+0000 7f948abff700 1 -- 172.21.15.84:0/2653674911 shutdown_connections 2023-07-14T11:18:41.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:41.005+0000 7f948abff700 1 --2- 172.21.15.84:0/2653674911 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f946806ae00 0x7f946806d2b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:41.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:41.005+0000 7f948abff700 1 --2- 172.21.15.84:0/2653674911 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f948415c890 0x7f948414ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:41.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:41.005+0000 7f948abff700 1 --2- 172.21.15.84:0/2653674911 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94840b2440 0x7f94840c9690 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:41.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:41.005+0000 7f948abff700 1 --2- 172.21.15.84:0/2653674911 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f94840d1160 0x7f94840b8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:41.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:41.005+0000 7f948abff700 1 -- 172.21.15.84:0/2653674911 >> 172.21.15.84:0/2653674911 conn(0x7f948409c170 msgr2=0x7f94840b1360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:41.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:41.005+0000 7f948abff700 1 -- 172.21.15.84:0/2653674911 shutdown_connections 2023-07-14T11:18:41.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:41.005+0000 7f948abff700 1 -- 172.21.15.84:0/2653674911 wait complete. 2023-07-14T11:18:41.011 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_metadata' created 2023-07-14T11:18:41.029 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-14T11:18:41.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:41.230+0000 7f39971ff700 1 Processor -- start 2023-07-14T11:18:41.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:41.230+0000 7f39971ff700 1 -- start start 2023-07-14T11:18:41.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:41.231+0000 7f39971ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f399015d9d0 0x7f399006b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:41.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:41.231+0000 7f39971ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f399006c9f0 0x7f39900b1910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:41.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:41.231+0000 7f39971ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f399006c4e0 con 0x7f39900b1e50 2023-07-14T11:18:41.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:41.231+0000 7f39971ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f399015dda0 con 0x7f399006c9f0 2023-07-14T11:18:41.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:41.231+0000 7f39971ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f399006bf20 con 0x7f399015d9d0 2023-07-14T11:18:41.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:41.231+0000 7f398ffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f399006c9f0 0x7f39900b1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:41.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:41.231+0000 7f398ffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f399006c9f0 0x7f39900b1910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39136/0 (socket says 172.21.15.84:39136) 2023-07-14T11:18:41.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:41.231+0000 7f398ffff700 1 -- 172.21.15.84:0/1789824755 learned_addr learned my addr 172.21.15.84:0/1789824755 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:41.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:41.231+0000 7f399579c700 1 --1- 172.21.15.84:0/1789824755 >> v1:172.21.15.84:6789/0 conn(0x7f39900b1e50 0x7f3990071170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:58338/0 (socket says 172.21.15.84:58338) 2023-07-14T11:18:41.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:41.231+0000 7f3994f9b700 1 --2- 172.21.15.84:0/1789824755 >> v2:172.21.15.179:3300/0 conn(0x7f399015d9d0 0x7f399006b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:41.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:41.232+0000 7f398ffff700 1 -- 172.21.15.84:0/1789824755 >> v2:172.21.15.179:3300/0 conn(0x7f399015d9d0 msgr2=0x7f399006b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:41.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:41.232+0000 7f398ffff700 1 --2- 172.21.15.84:0/1789824755 >> v2:172.21.15.179:3300/0 conn(0x7f399015d9d0 0x7f399006b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:41.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:41.232+0000 7f398ffff700 1 -- 172.21.15.84:0/1789824755 >> v1:172.21.15.84:6789/0 conn(0x7f39900b1e50 legacy=0x7f3990071170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:41.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:41.232+0000 7f398ffff700 1 -- 172.21.15.84:0/1789824755 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f399006c200 con 0x7f399006c9f0 2023-07-14T11:18:41.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:41.232+0000 7f398ffff700 1 --2- 172.21.15.84:0/1789824755 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f399006c9f0 0x7f39900b1910 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f399006dcc0 tx=0x7f397c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2afcbc6cc17aac41 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:41.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:41.232+0000 7f398f7fe700 1 -- 172.21.15.84:0/1789824755 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397c011830 con 0x7f399006c9f0 2023-07-14T11:18:41.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:41.232+0000 7f398f7fe700 1 -- 172.21.15.84:0/1789824755 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f397c011990 con 0x7f399006c9f0 2023-07-14T11:18:41.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:41.232+0000 7f398f7fe700 1 -- 172.21.15.84:0/1789824755 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397c011d20 con 0x7f399006c9f0 2023-07-14T11:18:41.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:41.233+0000 7f39971ff700 1 -- 172.21.15.84:0/1789824755 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f399006c9f0 msgr2=0x7f39900b1910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:41.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:41.233+0000 7f39971ff700 1 --2- 172.21.15.84:0/1789824755 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f399006c9f0 0x7f39900b1910 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f399006dcc0 tx=0x7f397c009bd0 comp rx=0 tx=0).stop 2023-07-14T11:18:41.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:41.233+0000 7f39971ff700 1 -- 172.21.15.84:0/1789824755 shutdown_connections 2023-07-14T11:18:41.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:41.233+0000 7f39971ff700 1 --2- 172.21.15.84:0/1789824755 >> v2:172.21.15.179:3300/0 conn(0x7f399015d9d0 0x7f399006b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:41.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:41.233+0000 7f39971ff700 1 --2- 172.21.15.84:0/1789824755 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f399006c9f0 0x7f39900b1910 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:41.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:41.233+0000 7f39971ff700 1 -- 172.21.15.84:0/1789824755 >> 172.21.15.84:0/1789824755 conn(0x7f39900b05d0 msgr2=0x7f39900b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:41.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:41.233+0000 7f39971ff700 1 -- 172.21.15.84:0/1789824755 shutdown_connections 2023-07-14T11:18:41.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:41.233+0000 7f39971ff700 1 -- 172.21.15.84:0/1789824755 wait complete. 2023-07-14T11:18:41.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:41.235+0000 7f39971ff700 1 Processor -- start 2023-07-14T11:18:41.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:41.235+0000 7f39971ff700 1 -- start start 2023-07-14T11:18:41.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:41.236+0000 7f39971ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f399006c9f0 0x7f39900c3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:41.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:41.236+0000 7f39971ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39900b1e50 0x7f3990155270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:41.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:41.236+0000 7f39971ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f399015d9d0 0x7f39900af5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:41.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:41.236+0000 7f39971ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39900c25c0 con 0x7f399015d9d0 2023-07-14T11:18:41.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:41.236+0000 7f39971ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39900c28a0 con 0x7f399006c9f0 2023-07-14T11:18:41.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:41.236+0000 7f39971ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39900c2b80 con 0x7f39900b1e50 2023-07-14T11:18:41.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:41.236+0000 7f399579c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f399015d9d0 0x7f39900af5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:41.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:41.236+0000 7f399579c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f399015d9d0 0x7f39900af5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39140/0 (socket says 172.21.15.84:39140) 2023-07-14T11:18:41.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:41.236+0000 7f399579c700 1 -- 172.21.15.84:0/2097359635 learned_addr learned my addr 172.21.15.84:0/2097359635 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:41.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:41.236+0000 7f3994f9b700 1 --2- 172.21.15.84:0/2097359635 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f399006c9f0 0x7f39900c3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:41.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:41.236+0000 7f398ffff700 1 --2- 172.21.15.84:0/2097359635 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39900b1e50 0x7f3990155270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:41.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:41.236+0000 7f399579c700 1 -- 172.21.15.84:0/2097359635 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39900b1e50 msgr2=0x7f3990155270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:41.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:41.236+0000 7f399579c700 1 --2- 172.21.15.84:0/2097359635 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39900b1e50 0x7f3990155270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:41.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:41.236+0000 7f399579c700 1 -- 172.21.15.84:0/2097359635 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f399006c9f0 msgr2=0x7f39900c3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:41.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:41.236+0000 7f399579c700 1 --2- 172.21.15.84:0/2097359635 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f399006c9f0 0x7f39900c3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:41.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:41.236+0000 7f399579c700 1 -- 172.21.15.84:0/2097359635 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f397c009550 con 0x7f399015d9d0 2023-07-14T11:18:41.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:41.237+0000 7f399579c700 1 --2- 172.21.15.84:0/2097359635 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f399015d9d0 0x7f39900af5c0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f398800cbd0 tx=0x7f398800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:41.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:41.237+0000 7f398d7fa700 1 -- 172.21.15.84:0/2097359635 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f398800abb0 con 0x7f399015d9d0 2023-07-14T11:18:41.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:41.237+0000 7f398d7fa700 1 -- 172.21.15.84:0/2097359635 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f398800ad10 con 0x7f399015d9d0 2023-07-14T11:18:41.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:41.237+0000 7f39971ff700 1 -- 172.21.15.84:0/2097359635 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39900c2e60 con 0x7f399015d9d0 2023-07-14T11:18:41.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:41.237+0000 7f398d7fa700 1 -- 172.21.15.84:0/2097359635 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3988007270 con 0x7f399015d9d0 2023-07-14T11:18:41.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:41.237+0000 7f39971ff700 1 -- 172.21.15.84:0/2097359635 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39900c3420 con 0x7f399015d9d0 2023-07-14T11:18:41.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:41.238+0000 7f39971ff700 1 -- 172.21.15.84:0/2097359635 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39900c35e0 con 0x7f399015d9d0 2023-07-14T11:18:41.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:41.240+0000 7f398d7fa700 1 -- 172.21.15.84:0/2097359635 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f39880073d0 con 0x7f399015d9d0 2023-07-14T11:18:41.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:41.241+0000 7f398d7fa700 1 --2- 172.21.15.84:0/2097359635 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f397406ae00 0x7f397406d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:41.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:41.241+0000 7f398d7fa700 1 -- 172.21.15.84:0/2097359635 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f3988089650 con 0x7f399015d9d0 2023-07-14T11:18:41.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:41.241+0000 7f3994f9b700 1 --2- 172.21.15.84:0/2097359635 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f397406ae00 0x7f397406d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:41.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:41.242+0000 7f3994f9b700 1 --2- 172.21.15.84:0/2097359635 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f397406ae00 0x7f397406d2b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f39901f57e0 tx=0x7f3984008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:41.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:41.244+0000 7f398d7fa700 1 -- 172.21.15.84:0/2097359635 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3988054860 con 0x7f399015d9d0 2023-07-14T11:18:41.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:41.436+0000 7f39971ff700 1 -- 172.21.15.84:0/2097359635 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f39900c3770 con 0x7f399015d9d0 2023-07-14T11:18:42.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:42.008+0000 7f398d7fa700 1 -- 172.21.15.84:0/2097359635 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v86) v1 ==== 170+0+0 (secure 0 0 0) 0x7f3988057e80 con 0x7f399015d9d0 2023-07-14T11:18:42.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:42.015+0000 7f39971ff700 1 -- 172.21.15.84:0/2097359635 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f397406ae00 msgr2=0x7f397406d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:42.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:42.015+0000 7f39971ff700 1 --2- 172.21.15.84:0/2097359635 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f397406ae00 0x7f397406d2b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f39901f57e0 tx=0x7f3984008040 comp rx=0 tx=0).stop 2023-07-14T11:18:42.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:42.015+0000 7f39971ff700 1 -- 172.21.15.84:0/2097359635 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f399015d9d0 msgr2=0x7f39900af5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:42.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:42.015+0000 7f39971ff700 1 --2- 172.21.15.84:0/2097359635 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f399015d9d0 0x7f39900af5c0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f398800cbd0 tx=0x7f398800cf90 comp rx=0 tx=0).stop 2023-07-14T11:18:42.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:42.016+0000 7f39971ff700 1 -- 172.21.15.84:0/2097359635 shutdown_connections 2023-07-14T11:18:42.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:42.016+0000 7f39971ff700 1 --2- 172.21.15.84:0/2097359635 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f399015d9d0 0x7f39900af5c0 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:42.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:42.016+0000 7f39971ff700 1 --2- 172.21.15.84:0/2097359635 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f399006c9f0 0x7f39900c3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:42.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:42.016+0000 7f39971ff700 1 --2- 172.21.15.84:0/2097359635 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f397406ae00 0x7f397406d2b0 secure :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f39901f57e0 tx=0x7f3984008040 comp rx=0 tx=0).stop 2023-07-14T11:18:42.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:42.016+0000 7f39971ff700 1 --2- 172.21.15.84:0/2097359635 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39900b1e50 0x7f3990155270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:42.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:42.016+0000 7f39971ff700 1 -- 172.21.15.84:0/2097359635 >> 172.21.15.84:0/2097359635 conn(0x7f39900b05d0 msgr2=0x7f3990071070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:42.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:42.021+0000 7f39971ff700 1 -- 172.21.15.84:0/2097359635 shutdown_connections 2023-07-14T11:18:42.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:42.021+0000 7f39971ff700 1 -- 172.21.15.84:0/2097359635 wait complete. 2023-07-14T11:18:42.029 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data' created 2023-07-14T11:18:42.049 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-14T11:18:42.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:42.245+0000 7ff0defff700 1 Processor -- start 2023-07-14T11:18:42.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:42.245+0000 7ff0defff700 1 -- start start 2023-07-14T11:18:42.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:42.246+0000 7ff0defff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff0d80c92d0 0x7ff0d80ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:42.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:42.246+0000 7ff0defff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff0d80b12f0 0x7ff0d80c96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:42.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:42.247+0000 7ff0defff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0d815ce70 con 0x7ff0d80adea0 2023-07-14T11:18:42.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:42.247+0000 7ff0defff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0d815da60 con 0x7ff0d80c92d0 2023-07-14T11:18:42.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:42.247+0000 7ff0defff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0d80c9be0 con 0x7ff0d80b12f0 2023-07-14T11:18:42.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:42.247+0000 7ff0dcd9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff0d80c92d0 0x7ff0d80ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:42.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:42.247+0000 7ff0dcd9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff0d80c92d0 0x7ff0d80ad8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39150/0 (socket says 172.21.15.84:39150) 2023-07-14T11:18:42.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:42.247+0000 7ff0dcd9b700 1 -- 172.21.15.84:0/459568362 learned_addr learned my addr 172.21.15.84:0/459568362 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:42.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:42.247+0000 7ff0d7fff700 1 --2- 172.21.15.84:0/459568362 >> v2:172.21.15.179:3300/0 conn(0x7ff0d80b12f0 0x7ff0d80c96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:42.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:42.247+0000 7ff0dcd9b700 1 -- 172.21.15.84:0/459568362 >> v2:172.21.15.179:3300/0 conn(0x7ff0d80b12f0 msgr2=0x7ff0d80c96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:42.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:42.247+0000 7ff0dcd9b700 1 --2- 172.21.15.84:0/459568362 >> v2:172.21.15.179:3300/0 conn(0x7ff0d80b12f0 0x7ff0d80c96a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:42.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:42.247+0000 7ff0dcd9b700 1 -- 172.21.15.84:0/459568362 >> v1:172.21.15.179:6789/0 conn(0x7ff0d80adea0 legacy=0x7ff0d806c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:42.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:42.247+0000 7ff0dcd9b700 1 -- 172.21.15.84:0/459568362 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d815d0c0 con 0x7ff0d80c92d0 2023-07-14T11:18:42.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:42.248+0000 7ff0dcd9b700 1 --2- 172.21.15.84:0/459568362 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0d80c92d0 0x7ff0d80ad8f0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7ff0d806d890 tx=0x7ff0cc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6336d0a5bad6127 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:42.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:42.248+0000 7ff0d77fe700 1 -- 172.21.15.84:0/459568362 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0cc004230 con 0x7ff0d80c92d0 2023-07-14T11:18:42.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:42.248+0000 7ff0d77fe700 1 -- 172.21.15.84:0/459568362 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0cc004390 con 0x7ff0d80c92d0 2023-07-14T11:18:42.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:42.248+0000 7ff0d77fe700 1 -- 172.21.15.84:0/459568362 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0cc0036a0 con 0x7ff0d80c92d0 2023-07-14T11:18:42.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:42.248+0000 7ff0defff700 1 -- 172.21.15.84:0/459568362 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0d80c92d0 msgr2=0x7ff0d80ad8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:42.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:42.248+0000 7ff0defff700 1 --2- 172.21.15.84:0/459568362 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0d80c92d0 0x7ff0d80ad8f0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7ff0d806d890 tx=0x7ff0cc009bd0 comp rx=0 tx=0).stop 2023-07-14T11:18:42.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:42.248+0000 7ff0defff700 1 -- 172.21.15.84:0/459568362 shutdown_connections 2023-07-14T11:18:42.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:42.248+0000 7ff0defff700 1 --2- 172.21.15.84:0/459568362 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0d80c92d0 0x7ff0d80ad8f0 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:42.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:42.248+0000 7ff0defff700 1 --2- 172.21.15.84:0/459568362 >> v2:172.21.15.179:3300/0 conn(0x7ff0d80b12f0 0x7ff0d80c96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:42.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:42.248+0000 7ff0defff700 1 -- 172.21.15.84:0/459568362 >> 172.21.15.84:0/459568362 conn(0x7ff0d80b05d0 msgr2=0x7ff0d80b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:42.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:42.249+0000 7ff0defff700 1 -- 172.21.15.84:0/459568362 shutdown_connections 2023-07-14T11:18:42.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:42.249+0000 7ff0defff700 1 -- 172.21.15.84:0/459568362 wait complete. 2023-07-14T11:18:42.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:42.250+0000 7ff0defff700 1 Processor -- start 2023-07-14T11:18:42.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:42.250+0000 7ff0defff700 1 -- start start 2023-07-14T11:18:42.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:42.251+0000 7ff0defff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0d80adea0 0x7ff0d80b2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:42.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:42.251+0000 7ff0defff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0d80b12f0 0x7ff0d80ac860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:42.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:42.251+0000 7ff0defff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff0d80c92d0 0x7ff0d80acda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:42.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:42.251+0000 7ff0defff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d80b37d0 con 0x7ff0d80b12f0 2023-07-14T11:18:42.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:42.251+0000 7ff0defff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d80b2b50 con 0x7ff0d80c92d0 2023-07-14T11:18:42.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:42.251+0000 7ff0defff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d80b2e30 con 0x7ff0d80adea0 2023-07-14T11:18:42.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:42.251+0000 7ff0d7fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0d80b12f0 0x7ff0d80ac860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:42.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:42.252+0000 7ff0d7fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0d80b12f0 0x7ff0d80ac860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39164/0 (socket says 172.21.15.84:39164) 2023-07-14T11:18:42.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:42.252+0000 7ff0d7fff700 1 -- 172.21.15.84:0/3090670851 learned_addr learned my addr 172.21.15.84:0/3090670851 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:42.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:42.252+0000 7ff0dd59c700 1 --2- 172.21.15.84:0/3090670851 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff0d80c92d0 0x7ff0d80acda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:42.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:42.252+0000 7ff0dcd9b700 1 --2- 172.21.15.84:0/3090670851 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0d80adea0 0x7ff0d80b2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:42.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:42.252+0000 7ff0d7fff700 1 -- 172.21.15.84:0/3090670851 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0d80adea0 msgr2=0x7ff0d80b2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:42.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:42.252+0000 7ff0d7fff700 1 --2- 172.21.15.84:0/3090670851 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0d80adea0 0x7ff0d80b2300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:42.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:42.252+0000 7ff0d7fff700 1 -- 172.21.15.84:0/3090670851 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff0d80c92d0 msgr2=0x7ff0d80acda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:42.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:42.252+0000 7ff0d7fff700 1 --2- 172.21.15.84:0/3090670851 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff0d80c92d0 0x7ff0d80acda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:42.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:42.252+0000 7ff0d7fff700 1 -- 172.21.15.84:0/3090670851 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0cc009550 con 0x7ff0d80b12f0 2023-07-14T11:18:42.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:42.252+0000 7ff0d7fff700 1 --2- 172.21.15.84:0/3090670851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0d80b12f0 0x7ff0d80ac860 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7ff0c400e810 tx=0x7ff0c400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:42.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:42.252+0000 7ff0d57fa700 1 -- 172.21.15.84:0/3090670851 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c400c070 con 0x7ff0d80b12f0 2023-07-14T11:18:42.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:42.252+0000 7ff0d57fa700 1 -- 172.21.15.84:0/3090670851 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0c4013610 con 0x7ff0d80b12f0 2023-07-14T11:18:42.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:42.252+0000 7ff0d57fa700 1 -- 172.21.15.84:0/3090670851 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c40139c0 con 0x7ff0d80b12f0 2023-07-14T11:18:42.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:42.252+0000 7ff0defff700 1 -- 172.21.15.84:0/3090670851 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0d80b3110 con 0x7ff0d80b12f0 2023-07-14T11:18:42.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:42.253+0000 7ff0defff700 1 -- 172.21.15.84:0/3090670851 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0d80b2840 con 0x7ff0d80b12f0 2023-07-14T11:18:42.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:42.253+0000 7ff0defff700 1 -- 172.21.15.84:0/3090670851 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0d8074350 con 0x7ff0d80b12f0 2023-07-14T11:18:42.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:42.255+0000 7ff0d57fa700 1 -- 172.21.15.84:0/3090670851 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7ff0c4013b20 con 0x7ff0d80b12f0 2023-07-14T11:18:42.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:42.256+0000 7ff0d57fa700 1 --2- 172.21.15.84:0/3090670851 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7ff0bc06ae00 0x7ff0bc06d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:42.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:42.256+0000 7ff0d57fa700 1 -- 172.21.15.84:0/3090670851 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5962+0+0 (secure 0 0 0) 0x7ff0c4089ad0 con 0x7ff0d80b12f0 2023-07-14T11:18:42.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:42.257+0000 7ff0dcd9b700 1 --2- 172.21.15.84:0/3090670851 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7ff0bc06ae00 0x7ff0bc06d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:42.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:42.257+0000 7ff0dcd9b700 1 --2- 172.21.15.84:0/3090670851 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7ff0bc06ae00 0x7ff0bc06d2b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc009130 tx=0x7ff0cc008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:42.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:42.260+0000 7ff0d57fa700 1 -- 172.21.15.84:0/3090670851 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ff0c4058440 con 0x7ff0d80b12f0 2023-07-14T11:18:42.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:42.498+0000 7ff0defff700 1 -- 172.21.15.84:0/3090670851 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7ff0d806d5d0 con 0x7ff0d80b12f0 2023-07-14T11:18:43.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.022+0000 7ff0d57fa700 1 -- 172.21.15.84:0/3090670851 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 13 and data pool 14 v50) v1 ==== 174+0+0 (secure 0 0 0) 0x7ff0c4057fd0 con 0x7ff0d80b12f0 2023-07-14T11:18:43.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.039+0000 7ff0defff700 1 -- 172.21.15.84:0/3090670851 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7ff0bc06ae00 msgr2=0x7ff0bc06d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:43.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.039+0000 7ff0defff700 1 --2- 172.21.15.84:0/3090670851 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7ff0bc06ae00 0x7ff0bc06d2b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc009130 tx=0x7ff0cc008030 comp rx=0 tx=0).stop 2023-07-14T11:18:43.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.039+0000 7ff0defff700 1 -- 172.21.15.84:0/3090670851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0d80b12f0 msgr2=0x7ff0d80ac860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:43.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.039+0000 7ff0defff700 1 --2- 172.21.15.84:0/3090670851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0d80b12f0 0x7ff0d80ac860 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7ff0c400e810 tx=0x7ff0c400eb20 comp rx=0 tx=0).stop 2023-07-14T11:18:43.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.039+0000 7ff0defff700 1 -- 172.21.15.84:0/3090670851 shutdown_connections 2023-07-14T11:18:43.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.039+0000 7ff0defff700 1 --2- 172.21.15.84:0/3090670851 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7ff0bc06ae00 0x7ff0bc06d2b0 secure :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc009130 tx=0x7ff0cc008030 comp rx=0 tx=0).stop 2023-07-14T11:18:43.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.039+0000 7ff0defff700 1 --2- 172.21.15.84:0/3090670851 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0d80adea0 0x7ff0d80b2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:43.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.039+0000 7ff0defff700 1 --2- 172.21.15.84:0/3090670851 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff0d80c92d0 0x7ff0d80acda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:43.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.039+0000 7ff0defff700 1 --2- 172.21.15.84:0/3090670851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0d80b12f0 0x7ff0d80ac860 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:43.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.039+0000 7ff0defff700 1 -- 172.21.15.84:0/3090670851 >> 172.21.15.84:0/3090670851 conn(0x7ff0d80b05d0 msgr2=0x7ff0d80cc8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:43.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.040+0000 7ff0defff700 1 -- 172.21.15.84:0/3090670851 shutdown_connections 2023-07-14T11:18:43.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.041+0000 7ff0defff700 1 -- 172.21.15.84:0/3090670851 wait complete. 2023-07-14T11:18:43.049 INFO:teuthology.orchestra.run.smithi084.stderr:new fs with metadata pool 13 and data pool 14 2023-07-14T11:18:43.067 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:18:43.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.260+0000 7f7e0bbff700 1 Processor -- start 2023-07-14T11:18:43.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.260+0000 7f7e0bbff700 1 -- start start 2023-07-14T11:18:43.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.262+0000 7f7e0bbff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7e040cf050 0x7f7e0406bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:43.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.262+0000 7f7e0bbff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e040b3fb0 0x7f7e0406c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:43.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.262+0000 7f7e0bbff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e04160640 con 0x7f7e0415c630 2023-07-14T11:18:43.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.262+0000 7f7e0bbff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e04160920 con 0x7f7e040cf050 2023-07-14T11:18:43.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.262+0000 7f7e0bbff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e04160c00 con 0x7f7e040b3fb0 2023-07-14T11:18:43.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.262+0000 7f7e0919a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7e040cf050 0x7f7e0406bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:43.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.262+0000 7f7e0919a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7e040cf050 0x7f7e0406bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39170/0 (socket says 172.21.15.84:39170) 2023-07-14T11:18:43.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.262+0000 7f7e0919a700 1 -- 172.21.15.84:0/337290312 learned_addr learned my addr 172.21.15.84:0/337290312 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:43.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.262+0000 7f7e0a19c700 1 --2- 172.21.15.84:0/337290312 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e040b3fb0 0x7f7e0406c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:43.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.262+0000 7f7e0919a700 1 -- 172.21.15.84:0/337290312 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e040b3fb0 msgr2=0x7f7e0406c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:43.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.262+0000 7f7e0919a700 1 --2- 172.21.15.84:0/337290312 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e040b3fb0 0x7f7e0406c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:43.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.262+0000 7f7e0919a700 1 -- 172.21.15.84:0/337290312 >> v1:172.21.15.179:6789/0 conn(0x7f7e0415c630 legacy=0x7f7e040ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:43.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.262+0000 7f7e0919a700 1 -- 172.21.15.84:0/337290312 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e0406b9c0 con 0x7f7e040cf050 2023-07-14T11:18:43.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.263+0000 7f7e0919a700 1 --2- 172.21.15.84:0/337290312 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e040cf050 0x7f7e0406bee0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f7df40098f0 tx=0x7f7df4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a36fd568f88b2030 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:43.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.263+0000 7f7e08999700 1 -- 172.21.15.84:0/337290312 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df4011830 con 0x7f7e040cf050 2023-07-14T11:18:43.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.263+0000 7f7e08999700 1 -- 172.21.15.84:0/337290312 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7df4011990 con 0x7f7e040cf050 2023-07-14T11:18:43.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.263+0000 7f7e08999700 1 -- 172.21.15.84:0/337290312 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df4011d20 con 0x7f7e040cf050 2023-07-14T11:18:43.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.263+0000 7f7e0bbff700 1 -- 172.21.15.84:0/337290312 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e040cf050 msgr2=0x7f7e0406bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:43.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.263+0000 7f7e0bbff700 1 --2- 172.21.15.84:0/337290312 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e040cf050 0x7f7e0406bee0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f7df40098f0 tx=0x7f7df4009c00 comp rx=0 tx=0).stop 2023-07-14T11:18:43.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.264+0000 7f7e0bbff700 1 -- 172.21.15.84:0/337290312 shutdown_connections 2023-07-14T11:18:43.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.264+0000 7f7e0bbff700 1 --2- 172.21.15.84:0/337290312 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e040b3fb0 0x7f7e0406c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:43.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.264+0000 7f7e0bbff700 1 --2- 172.21.15.84:0/337290312 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e040cf050 0x7f7e0406bee0 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:43.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.264+0000 7f7e0bbff700 1 -- 172.21.15.84:0/337290312 >> 172.21.15.84:0/337290312 conn(0x7f7e04069f30 msgr2=0x7f7e0406a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:43.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.264+0000 7f7e0bbff700 1 -- 172.21.15.84:0/337290312 shutdown_connections 2023-07-14T11:18:43.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.264+0000 7f7e0bbff700 1 -- 172.21.15.84:0/337290312 wait complete. 2023-07-14T11:18:43.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.266+0000 7f7e0bbff700 1 Processor -- start 2023-07-14T11:18:43.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.266+0000 7f7e0bbff700 1 -- start start 2023-07-14T11:18:43.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.267+0000 7f7e0bbff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e040b3fb0 0x7f7e040b1320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:43.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.267+0000 7f7e0bbff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e040cf050 0x7f7e0413aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:43.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.267+0000 7f7e0bbff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e0415c630 0x7f7e0413dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:43.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.267+0000 7f7e0bbff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e040b0f00 con 0x7f7e040cf050 2023-07-14T11:18:43.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.267+0000 7f7e0bbff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0413af50 con 0x7f7e040b3fb0 2023-07-14T11:18:43.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.267+0000 7f7e0bbff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e040b0280 con 0x7f7e0415c630 2023-07-14T11:18:43.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.268+0000 7f7e0919a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e040cf050 0x7f7e0413aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:43.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.268+0000 7f7e0919a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e040cf050 0x7f7e0413aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39184/0 (socket says 172.21.15.84:39184) 2023-07-14T11:18:43.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.268+0000 7f7e0919a700 1 -- 172.21.15.84:0/2826024192 learned_addr learned my addr 172.21.15.84:0/2826024192 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:43.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.268+0000 7f7e0999b700 1 --2- 172.21.15.84:0/2826024192 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e040b3fb0 0x7f7e040b1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:43.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.268+0000 7f7e0a19c700 1 --2- 172.21.15.84:0/2826024192 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e0415c630 0x7f7e0413dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:43.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.268+0000 7f7e0919a700 1 -- 172.21.15.84:0/2826024192 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e0415c630 msgr2=0x7f7e0413dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:43.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.268+0000 7f7e0919a700 1 --2- 172.21.15.84:0/2826024192 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e0415c630 0x7f7e0413dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:43.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.268+0000 7f7e0919a700 1 -- 172.21.15.84:0/2826024192 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e040b3fb0 msgr2=0x7f7e040b1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:43.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.268+0000 7f7e0919a700 1 --2- 172.21.15.84:0/2826024192 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e040b3fb0 0x7f7e040b1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:43.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.268+0000 7f7e0919a700 1 -- 172.21.15.84:0/2826024192 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7df4009550 con 0x7f7e040cf050 2023-07-14T11:18:43.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.268+0000 7f7e0919a700 1 --2- 172.21.15.84:0/2826024192 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e040cf050 0x7f7e0413aa10 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f7df4000c00 tx=0x7f7df4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:43.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.269+0000 7f7dfa7fc700 1 -- 172.21.15.84:0/2826024192 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df4004400 con 0x7f7e040cf050 2023-07-14T11:18:43.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.269+0000 7f7dfa7fc700 1 -- 172.21.15.84:0/2826024192 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7df401f070 con 0x7f7e040cf050 2023-07-14T11:18:43.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.269+0000 7f7e0bbff700 1 -- 172.21.15.84:0/2826024192 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e040b0560 con 0x7f7e040cf050 2023-07-14T11:18:43.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.269+0000 7f7dfa7fc700 1 -- 172.21.15.84:0/2826024192 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df40038e0 con 0x7f7e040cf050 2023-07-14T11:18:43.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.269+0000 7f7e0bbff700 1 -- 172.21.15.84:0/2826024192 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e040b0b20 con 0x7f7e040cf050 2023-07-14T11:18:43.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.270+0000 7f7e0bbff700 1 -- 172.21.15.84:0/2826024192 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e0404e280 con 0x7f7e040cf050 2023-07-14T11:18:43.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.271+0000 7f7dfa7fc700 1 -- 172.21.15.84:0/2826024192 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f7df4021030 con 0x7f7e040cf050 2023-07-14T11:18:43.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.272+0000 7f7dfa7fc700 1 --2- 172.21.15.84:0/2826024192 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f7de806ae00 0x7f7de806d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:43.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.272+0000 7f7dfa7fc700 1 -- 172.21.15.84:0/2826024192 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7df408aa60 con 0x7f7e040cf050 2023-07-14T11:18:43.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.272+0000 7f7e0999b700 1 --2- 172.21.15.84:0/2826024192 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f7de806ae00 0x7f7de806d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:43.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.273+0000 7f7e0999b700 1 --2- 172.21.15.84:0/2826024192 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f7de806ae00 0x7f7de806d2b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7e00007fd0 tx=0x7f7e00009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:43.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.276+0000 7f7dfa7fc700 1 -- 172.21.15.84:0/2826024192 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7df4055970 con 0x7f7e040cf050 2023-07-14T11:18:43.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.471+0000 7f7e0bbff700 1 -- 172.21.15.84:0/2826024192 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7e040ad960 con 0x7f7e040cf050 2023-07-14T11:18:43.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.472+0000 7f7dfa7fc700 1 -- 172.21.15.84:0/2826024192 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+18283 (secure 0 0 0) 0x7f7df4058f90 con 0x7f7e040cf050 2023-07-14T11:18:43.475 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:18:43.475 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":87,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:18:42.499988+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-07-14T11:18:40.531166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-07-14T11:18:41.475653+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:18:43.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.475+0000 7f7e0bbff700 1 -- 172.21.15.84:0/2826024192 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f7de806ae00 msgr2=0x7f7de806d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:43.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.475+0000 7f7e0bbff700 1 --2- 172.21.15.84:0/2826024192 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f7de806ae00 0x7f7de806d2b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7e00007fd0 tx=0x7f7e00009040 comp rx=0 tx=0).stop 2023-07-14T11:18:43.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.475+0000 7f7e0bbff700 1 -- 172.21.15.84:0/2826024192 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e040cf050 msgr2=0x7f7e0413aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:43.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.475+0000 7f7e0bbff700 1 --2- 172.21.15.84:0/2826024192 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e040cf050 0x7f7e0413aa10 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f7df4000c00 tx=0x7f7df4004750 comp rx=0 tx=0).stop 2023-07-14T11:18:43.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.475+0000 7f7e0bbff700 1 -- 172.21.15.84:0/2826024192 shutdown_connections 2023-07-14T11:18:43.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.475+0000 7f7e0bbff700 1 --2- 172.21.15.84:0/2826024192 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f7de806ae00 0x7f7de806d2b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:43.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.475+0000 7f7e0bbff700 1 --2- 172.21.15.84:0/2826024192 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e0415c630 0x7f7e0413dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:43.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.475+0000 7f7e0bbff700 1 --2- 172.21.15.84:0/2826024192 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e040b3fb0 0x7f7e040b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:43.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.475+0000 7f7e0bbff700 1 --2- 172.21.15.84:0/2826024192 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e040cf050 0x7f7e0413aa10 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:43.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.475+0000 7f7e0bbff700 1 -- 172.21.15.84:0/2826024192 >> 172.21.15.84:0/2826024192 conn(0x7f7e04069f30 msgr2=0x7f7e04158850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:43.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.475+0000 7f7e0bbff700 1 -- 172.21.15.84:0/2826024192 shutdown_connections 2023-07-14T11:18:43.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.475+0000 7f7e0bbff700 1 -- 172.21.15.84:0/2826024192 wait complete. 2023-07-14T11:18:43.495 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:18:43.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.690+0000 7f0faa9ff700 1 Processor -- start 2023-07-14T11:18:43.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.690+0000 7f0faa9ff700 1 -- start start 2023-07-14T11:18:43.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.691+0000 7f0faa9ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0fa4158fd0 0x7f0fa4070710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:43.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.691+0000 7f0faa9ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fa406c110 con 0x7f0fa4141ff0 2023-07-14T11:18:43.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.691+0000 7f0faa9ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fa4159410 con 0x7f0fa40b2180 2023-07-14T11:18:43.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.692+0000 7f0faa9ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fa4071140 con 0x7f0fa4158fd0 2023-07-14T11:18:43.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.692+0000 7f0fa3fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f0fa4141ff0 0x7f0fa40b1a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:58346/0 (socket says 172.21.15.84:58346) 2023-07-14T11:18:43.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.692+0000 7f0fa3fff700 1 -- 172.21.15.84:0/2911225675 learned_addr learned my addr 172.21.15.84:0/2911225675 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:18:43.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.692+0000 7f0fa8f9c700 1 --2- 172.21.15.84:0/2911225675 >> v2:172.21.15.179:3300/0 conn(0x7f0fa4158fd0 0x7f0fa4070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:43.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.692+0000 7f0fa2ffd700 1 -- 172.21.15.84:0/2911225675 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2404204348 0 0) 0x7f0fa406c110 con 0x7f0fa4141ff0 2023-07-14T11:18:43.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.692+0000 7f0fa2ffd700 1 -- 172.21.15.84:0/2911225675 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f8c0035b0 con 0x7f0fa4141ff0 2023-07-14T11:18:43.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.692+0000 7f0fa2ffd700 1 -- 172.21.15.84:0/2911225675 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 207060347 0 0) 0x7f0f8c0035b0 con 0x7f0fa4141ff0 2023-07-14T11:18:43.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.692+0000 7f0fa2ffd700 1 -- 172.21.15.84:0/2911225675 >> v2:172.21.15.179:3300/0 conn(0x7f0fa4158fd0 msgr2=0x7f0fa4070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:43.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.692+0000 7f0fa2ffd700 1 --2- 172.21.15.84:0/2911225675 >> v2:172.21.15.179:3300/0 conn(0x7f0fa4158fd0 0x7f0fa4070710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:43.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.692+0000 7f0fa2ffd700 1 -- 172.21.15.84:0/2911225675 >> v1:172.21.15.179:6789/0 conn(0x7f0fa40b2180 legacy=0x7f0fa406c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:43.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.692+0000 7f0fa2ffd700 1 -- 172.21.15.84:0/2911225675 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa4070e60 con 0x7f0fa4141ff0 2023-07-14T11:18:43.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.692+0000 7f0fa2ffd700 1 -- 172.21.15.84:0/2911225675 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7f0f94001670 con 0x7f0fa4141ff0 2023-07-14T11:18:43.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.693+0000 7f0fa2ffd700 1 -- 172.21.15.84:0/2911225675 >> v1:172.21.15.84:6789/0 conn(0x7f0fa4141ff0 legacy=0x7f0fa40b1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:43.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.693+0000 7f0fa2ffd700 1 --2- 172.21.15.84:0/2911225675 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f8c003a50 0x7f0f8c003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:43.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.693+0000 7f0fa2ffd700 1 --2- 172.21.15.84:0/2911225675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f8c004850 0x7f0f8c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:43.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.693+0000 7f0fa2ffd700 1 --2- 172.21.15.84:0/2911225675 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f8c005200 0x7f0f8c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:43.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.693+0000 7f0fa2ffd700 1 -- 172.21.15.84:0/2911225675 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa4071140 con 0x7f0f8c004850 2023-07-14T11:18:43.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.693+0000 7f0fa2ffd700 1 -- 172.21.15.84:0/2911225675 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8c00c0e0 con 0x7f0f8c003a50 2023-07-14T11:18:43.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.693+0000 7f0fa2ffd700 1 -- 172.21.15.84:0/2911225675 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8c00c2a0 con 0x7f0f8c005200 2023-07-14T11:18:43.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.693+0000 7f0fa37fe700 1 --2- 172.21.15.84:0/2911225675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f8c004850 0x7f0f8c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:43.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.693+0000 7f0fa3fff700 1 --2- 172.21.15.84:0/2911225675 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f8c003a50 0x7f0f8c003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:43.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.693+0000 7f0fa8f9c700 1 --2- 172.21.15.84:0/2911225675 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f8c005200 0x7f0f8c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:43.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.693+0000 7f0fa37fe700 1 -- 172.21.15.84:0/2911225675 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f8c005200 msgr2=0x7f0f8c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:43.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.693+0000 7f0fa37fe700 1 --2- 172.21.15.84:0/2911225675 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f8c005200 0x7f0f8c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:43.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.693+0000 7f0fa37fe700 1 -- 172.21.15.84:0/2911225675 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f8c003a50 msgr2=0x7f0f8c003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:43.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.693+0000 7f0fa37fe700 1 --2- 172.21.15.84:0/2911225675 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f8c003a50 0x7f0f8c003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:43.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.693+0000 7f0fa37fe700 1 -- 172.21.15.84:0/2911225675 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f8c0035b0 con 0x7f0f8c004850 2023-07-14T11:18:43.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.693+0000 7f0fa8f9c700 1 --2- 172.21.15.84:0/2911225675 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f8c005200 0x7f0f8c00ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:18:43.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.693+0000 7f0fa8f9c700 1 -- 172.21.15.84:0/2911225675 reap_dead start 2023-07-14T11:18:43.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.694+0000 7f0fa37fe700 1 --2- 172.21.15.84:0/2911225675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f8c004850 0x7f0f8c004cc0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f0f98007fd0 tx=0x7f0f8c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94b0d45e77cc22e1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:43.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.694+0000 7f0fa2ffd700 1 -- 172.21.15.84:0/2911225675 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f980052d0 con 0x7f0f8c004850 2023-07-14T11:18:43.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.694+0000 7f0fa2ffd700 1 -- 172.21.15.84:0/2911225675 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f98005430 con 0x7f0f8c004850 2023-07-14T11:18:43.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.694+0000 7f0fa2ffd700 1 -- 172.21.15.84:0/2911225675 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f980038c0 con 0x7f0f8c004850 2023-07-14T11:18:43.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.694+0000 7f0faa9ff700 1 -- 172.21.15.84:0/2911225675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f8c004850 msgr2=0x7f0f8c004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:43.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.694+0000 7f0faa9ff700 1 --2- 172.21.15.84:0/2911225675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f8c004850 0x7f0f8c004cc0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f0f98007fd0 tx=0x7f0f8c005880 comp rx=0 tx=0).stop 2023-07-14T11:18:43.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.694+0000 7f0faa9ff700 1 -- 172.21.15.84:0/2911225675 shutdown_connections 2023-07-14T11:18:43.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.694+0000 7f0faa9ff700 1 --2- 172.21.15.84:0/2911225675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f8c004850 0x7f0f8c004cc0 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:43.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.694+0000 7f0faa9ff700 1 -- 172.21.15.84:0/2911225675 >> 172.21.15.84:0/2911225675 conn(0x7f0fa4069f30 msgr2=0x7f0fa406a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:43.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.694+0000 7f0faa9ff700 1 -- 172.21.15.84:0/2911225675 shutdown_connections 2023-07-14T11:18:43.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.694+0000 7f0faa9ff700 1 -- 172.21.15.84:0/2911225675 wait complete. 2023-07-14T11:18:43.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.696+0000 7f0faa9ff700 1 Processor -- start 2023-07-14T11:18:43.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.696+0000 7f0faa9ff700 1 -- start start 2023-07-14T11:18:43.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.697+0000 7f0faa9ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f8c004850 0x7f0fa413a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:43.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.697+0000 7f0faa9ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fa4156c80 0x7f0fa41570f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:43.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.697+0000 7f0faa9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0fa413ab40 0x7f0fa4157630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:43.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.697+0000 7f0faa9ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa413b050 con 0x7f0fa4156c80 2023-07-14T11:18:43.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.697+0000 7f0faa9ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa413b330 con 0x7f0f8c004850 2023-07-14T11:18:43.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.697+0000 7f0faa9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa413b610 con 0x7f0fa413ab40 2023-07-14T11:18:43.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.698+0000 7f0fa37fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fa4156c80 0x7f0fa41570f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:43.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.698+0000 7f0fa37fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fa4156c80 0x7f0fa41570f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39188/0 (socket says 172.21.15.84:39188) 2023-07-14T11:18:43.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.698+0000 7f0fa37fe700 1 -- 172.21.15.84:0/3879962348 learned_addr learned my addr 172.21.15.84:0/3879962348 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:43.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.698+0000 7f0fa3fff700 1 --2- 172.21.15.84:0/3879962348 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f8c004850 0x7f0fa413a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:43.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.698+0000 7f0fa8f9c700 1 --2- 172.21.15.84:0/3879962348 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0fa413ab40 0x7f0fa4157630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:43.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.698+0000 7f0fa37fe700 1 -- 172.21.15.84:0/3879962348 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0fa413ab40 msgr2=0x7f0fa4157630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:43.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.698+0000 7f0fa37fe700 1 --2- 172.21.15.84:0/3879962348 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0fa413ab40 0x7f0fa4157630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:43.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.698+0000 7f0fa37fe700 1 -- 172.21.15.84:0/3879962348 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f8c004850 msgr2=0x7f0fa413a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:43.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.698+0000 7f0fa37fe700 1 --2- 172.21.15.84:0/3879962348 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f8c004850 0x7f0fa413a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:43.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.698+0000 7f0fa37fe700 1 -- 172.21.15.84:0/3879962348 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa413b8f0 con 0x7f0fa4156c80 2023-07-14T11:18:43.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.698+0000 7f0fa37fe700 1 --2- 172.21.15.84:0/3879962348 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fa4156c80 0x7f0fa41570f0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f0f98015040 tx=0x7f0f98001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:43.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.699+0000 7f0fa0ff9700 1 -- 172.21.15.84:0/3879962348 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f98001290 con 0x7f0fa4156c80 2023-07-14T11:18:43.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.699+0000 7f0fa0ff9700 1 -- 172.21.15.84:0/3879962348 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f98006860 con 0x7f0fa4156c80 2023-07-14T11:18:43.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.699+0000 7f0fa0ff9700 1 -- 172.21.15.84:0/3879962348 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f98006bf0 con 0x7f0fa4156c80 2023-07-14T11:18:43.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.699+0000 7f0faa9ff700 1 -- 172.21.15.84:0/3879962348 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fa413bbd0 con 0x7f0fa4156c80 2023-07-14T11:18:43.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.699+0000 7f0faa9ff700 1 -- 172.21.15.84:0/3879962348 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fa413c4b0 con 0x7f0fa4156c80 2023-07-14T11:18:43.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.700+0000 7f0faa9ff700 1 -- 172.21.15.84:0/3879962348 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fa404e280 con 0x7f0fa4156c80 2023-07-14T11:18:43.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.701+0000 7f0fa0ff9700 1 -- 172.21.15.84:0/3879962348 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f0f98019040 con 0x7f0fa4156c80 2023-07-14T11:18:43.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.702+0000 7f0fa0ff9700 1 --2- 172.21.15.84:0/3879962348 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f0f9006ae30 0x7f0f9006d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:43.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.702+0000 7f0fa0ff9700 1 -- 172.21.15.84:0/3879962348 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0f9808a0e0 con 0x7f0fa4156c80 2023-07-14T11:18:43.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.702+0000 7f0fa3fff700 1 --2- 172.21.15.84:0/3879962348 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f0f9006ae30 0x7f0f9006d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:43.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.703+0000 7f0fa3fff700 1 --2- 172.21.15.84:0/3879962348 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f0f9006ae30 0x7f0f9006d2e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0f94001050 tx=0x7f0f94009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:43.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.706+0000 7f0fa0ff9700 1 -- 172.21.15.84:0/3879962348 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f0f98055070 con 0x7f0fa4156c80 2023-07-14T11:18:43.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.900+0000 7f0faa9ff700 1 -- 172.21.15.84:0/3879962348 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0fa406f900 con 0x7f0fa4156c80 2023-07-14T11:18:43.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.901+0000 7f0fa0ff9700 1 -- 172.21.15.84:0/3879962348 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+18283 (secure 0 0 0) 0x7f0f9801b370 con 0x7f0fa4156c80 2023-07-14T11:18:43.904 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:18:43.904 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":87,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:18:42.499988+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-07-14T11:18:40.531166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-07-14T11:18:41.475653+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:18:43.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.904+0000 7f0faa9ff700 1 -- 172.21.15.84:0/3879962348 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f0f9006ae30 msgr2=0x7f0f9006d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:43.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.904+0000 7f0faa9ff700 1 --2- 172.21.15.84:0/3879962348 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f0f9006ae30 0x7f0f9006d2e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0f94001050 tx=0x7f0f94009040 comp rx=0 tx=0).stop 2023-07-14T11:18:43.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.904+0000 7f0faa9ff700 1 -- 172.21.15.84:0/3879962348 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fa4156c80 msgr2=0x7f0fa41570f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:43.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.904+0000 7f0faa9ff700 1 --2- 172.21.15.84:0/3879962348 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fa4156c80 0x7f0fa41570f0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f0f98015040 tx=0x7f0f98001120 comp rx=0 tx=0).stop 2023-07-14T11:18:43.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.904+0000 7f0faa9ff700 1 -- 172.21.15.84:0/3879962348 shutdown_connections 2023-07-14T11:18:43.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.904+0000 7f0faa9ff700 1 --2- 172.21.15.84:0/3879962348 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f0f9006ae30 0x7f0f9006d2e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:43.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.904+0000 7f0faa9ff700 1 --2- 172.21.15.84:0/3879962348 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0fa413ab40 0x7f0fa4157630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:43.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.904+0000 7f0faa9ff700 1 --2- 172.21.15.84:0/3879962348 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f8c004850 0x7f0fa413a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:43.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.904+0000 7f0faa9ff700 1 --2- 172.21.15.84:0/3879962348 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fa4156c80 0x7f0fa41570f0 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:43.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.904+0000 7f0faa9ff700 1 -- 172.21.15.84:0/3879962348 >> 172.21.15.84:0/3879962348 conn(0x7f0fa4069f30 msgr2=0x7f0fa4141650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:43.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.904+0000 7f0faa9ff700 1 -- 172.21.15.84:0/3879962348 shutdown_connections 2023-07-14T11:18:43.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:43.904+0000 7f0faa9ff700 1 -- 172.21.15.84:0/3879962348 wait complete. 2023-07-14T11:18:43.924 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-14T11:18:44.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:44.123+0000 7fbe677ff700 1 Processor -- start 2023-07-14T11:18:44.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:44.123+0000 7fbe677ff700 1 -- start start 2023-07-14T11:18:44.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:44.125+0000 7fbe677ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbe600c92d0 0x7fbe600ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:44.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:44.125+0000 7fbe677ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbe600adea0 0x7fbe600cc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:44.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:44.125+0000 7fbe677ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe6015ce70 con 0x7fbe600b12f0 2023-07-14T11:18:44.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:44.125+0000 7fbe677ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe6015da60 con 0x7fbe600adea0 2023-07-14T11:18:44.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:44.125+0000 7fbe677ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe6015d0c0 con 0x7fbe600c92d0 2023-07-14T11:18:44.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:44.125+0000 7fbe65d9c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbe600adea0 0x7fbe600cc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:44.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:44.125+0000 7fbe65d9c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbe600adea0 0x7fbe600cc690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39194/0 (socket says 172.21.15.84:39194) 2023-07-14T11:18:44.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:44.125+0000 7fbe65d9c700 1 -- 172.21.15.84:0/2719377107 learned_addr learned my addr 172.21.15.84:0/2719377107 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:44.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:44.125+0000 7fbe6559b700 1 --2- 172.21.15.84:0/2719377107 >> v2:172.21.15.179:3300/0 conn(0x7fbe600c92d0 0x7fbe600ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:44.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:44.125+0000 7fbe65d9c700 1 -- 172.21.15.84:0/2719377107 >> v2:172.21.15.179:3300/0 conn(0x7fbe600c92d0 msgr2=0x7fbe600ad8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:44.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:44.125+0000 7fbe65d9c700 1 --2- 172.21.15.84:0/2719377107 >> v2:172.21.15.179:3300/0 conn(0x7fbe600c92d0 0x7fbe600ad8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:44.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:44.125+0000 7fbe65d9c700 1 -- 172.21.15.84:0/2719377107 >> v1:172.21.15.179:6789/0 conn(0x7fbe600b12f0 legacy=0x7fbe600c96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:44.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:44.125+0000 7fbe65d9c700 1 -- 172.21.15.84:0/2719377107 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe6015d3a0 con 0x7fbe600adea0 2023-07-14T11:18:44.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:44.125+0000 7fbe6559b700 1 --2- 172.21.15.84:0/2719377107 >> v2:172.21.15.179:3300/0 conn(0x7fbe600c92d0 0x7fbe600ad8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:18:44.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:44.126+0000 7fbe65d9c700 1 --2- 172.21.15.84:0/2719377107 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe600adea0 0x7fbe600cc690 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fbe6006f630 tx=0x7fbe5800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d50beaa2aea77a3 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:44.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:44.126+0000 7fbe57fff700 1 -- 172.21.15.84:0/2719377107 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe5800e070 con 0x7fbe600adea0 2023-07-14T11:18:44.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:44.126+0000 7fbe57fff700 1 -- 172.21.15.84:0/2719377107 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe58003a20 con 0x7fbe600adea0 2023-07-14T11:18:44.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:44.126+0000 7fbe57fff700 1 -- 172.21.15.84:0/2719377107 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe58003dd0 con 0x7fbe600adea0 2023-07-14T11:18:44.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:44.126+0000 7fbe677ff700 1 -- 172.21.15.84:0/2719377107 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe600adea0 msgr2=0x7fbe600cc690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:44.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:44.126+0000 7fbe677ff700 1 --2- 172.21.15.84:0/2719377107 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe600adea0 0x7fbe600cc690 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fbe6006f630 tx=0x7fbe5800b330 comp rx=0 tx=0).stop 2023-07-14T11:18:44.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:44.127+0000 7fbe677ff700 1 -- 172.21.15.84:0/2719377107 shutdown_connections 2023-07-14T11:18:44.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:44.127+0000 7fbe677ff700 1 --2- 172.21.15.84:0/2719377107 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe600adea0 0x7fbe600cc690 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:44.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:44.127+0000 7fbe677ff700 1 --2- 172.21.15.84:0/2719377107 >> v2:172.21.15.179:3300/0 conn(0x7fbe600c92d0 0x7fbe600ad8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:44.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:44.127+0000 7fbe677ff700 1 -- 172.21.15.84:0/2719377107 >> 172.21.15.84:0/2719377107 conn(0x7fbe600b05d0 msgr2=0x7fbe600b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:44.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:44.127+0000 7fbe677ff700 1 -- 172.21.15.84:0/2719377107 shutdown_connections 2023-07-14T11:18:44.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:44.127+0000 7fbe677ff700 1 -- 172.21.15.84:0/2719377107 wait complete. 2023-07-14T11:18:44.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:44.128+0000 7fbe677ff700 1 Processor -- start 2023-07-14T11:18:44.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:44.129+0000 7fbe677ff700 1 -- start start 2023-07-14T11:18:44.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:44.129+0000 7fbe677ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe600adea0 0x7fbe601f5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:44.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:44.129+0000 7fbe677ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe600b12f0 0x7fbe601f5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:44.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:44.129+0000 7fbe677ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe600c92d0 0x7fbe6014a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:44.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:44.129+0000 7fbe677ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe600af000 con 0x7fbe600c92d0 2023-07-14T11:18:44.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:44.129+0000 7fbe677ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe600c74a0 con 0x7fbe600b12f0 2023-07-14T11:18:44.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:44.129+0000 7fbe677ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe600c71c0 con 0x7fbe600adea0 2023-07-14T11:18:44.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:44.130+0000 7fbe65d9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe600c92d0 0x7fbe6014a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:44.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:44.130+0000 7fbe65d9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe600c92d0 0x7fbe6014a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39208/0 (socket says 172.21.15.84:39208) 2023-07-14T11:18:44.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:44.130+0000 7fbe65d9c700 1 -- 172.21.15.84:0/3802017834 learned_addr learned my addr 172.21.15.84:0/3802017834 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:44.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:44.130+0000 7fbe6559b700 1 --2- 172.21.15.84:0/3802017834 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe600adea0 0x7fbe601f5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:44.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:44.130+0000 7fbe64d9a700 1 --2- 172.21.15.84:0/3802017834 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe600b12f0 0x7fbe601f5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:44.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:44.130+0000 7fbe65d9c700 1 -- 172.21.15.84:0/3802017834 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe600adea0 msgr2=0x7fbe601f5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:44.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:44.130+0000 7fbe65d9c700 1 --2- 172.21.15.84:0/3802017834 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe600adea0 0x7fbe601f5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:44.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:44.130+0000 7fbe65d9c700 1 -- 172.21.15.84:0/3802017834 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe600b12f0 msgr2=0x7fbe601f5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:44.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:44.130+0000 7fbe65d9c700 1 --2- 172.21.15.84:0/3802017834 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe600b12f0 0x7fbe601f5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:44.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:44.130+0000 7fbe65d9c700 1 -- 172.21.15.84:0/3802017834 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe58009b30 con 0x7fbe600c92d0 2023-07-14T11:18:44.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:44.130+0000 7fbe6559b700 1 --2- 172.21.15.84:0/3802017834 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe600adea0 0x7fbe601f5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:18:44.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:44.130+0000 7fbe64d9a700 1 --2- 172.21.15.84:0/3802017834 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe600b12f0 0x7fbe601f5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:18:44.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:44.130+0000 7fbe65d9c700 1 --2- 172.21.15.84:0/3802017834 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe600c92d0 0x7fbe6014a630 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7fbe58015040 tx=0x7fbe58004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:44.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:44.131+0000 7fbe55ffb700 1 -- 172.21.15.84:0/3802017834 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe58004240 con 0x7fbe600c92d0 2023-07-14T11:18:44.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:44.131+0000 7fbe55ffb700 1 -- 172.21.15.84:0/3802017834 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe580043a0 con 0x7fbe600c92d0 2023-07-14T11:18:44.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:44.131+0000 7fbe55ffb700 1 -- 172.21.15.84:0/3802017834 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe58004750 con 0x7fbe600c92d0 2023-07-14T11:18:44.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:44.131+0000 7fbe677ff700 1 -- 172.21.15.84:0/3802017834 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe600b1990 con 0x7fbe600c92d0 2023-07-14T11:18:44.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:44.131+0000 7fbe677ff700 1 -- 172.21.15.84:0/3802017834 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe600b1f50 con 0x7fbe600c92d0 2023-07-14T11:18:44.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:44.132+0000 7fbe677ff700 1 -- 172.21.15.84:0/3802017834 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe60074350 con 0x7fbe600c92d0 2023-07-14T11:18:44.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:44.133+0000 7fbe55ffb700 1 -- 172.21.15.84:0/3802017834 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7fbe58019070 con 0x7fbe600c92d0 2023-07-14T11:18:44.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:44.134+0000 7fbe55ffb700 1 --2- 172.21.15.84:0/3802017834 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fbe4406ae00 0x7fbe4406d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:44.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:44.134+0000 7fbe55ffb700 1 -- 172.21.15.84:0/3802017834 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbe5808a7e0 con 0x7fbe600c92d0 2023-07-14T11:18:44.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:44.134+0000 7fbe6559b700 1 --2- 172.21.15.84:0/3802017834 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fbe4406ae00 0x7fbe4406d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:44.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:44.135+0000 7fbe6559b700 1 --2- 172.21.15.84:0/3802017834 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fbe4406ae00 0x7fbe4406d2b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c006fd0 tx=0x7fbe5c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:44.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:44.138+0000 7fbe55ffb700 1 -- 172.21.15.84:0/3802017834 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fbe580555e0 con 0x7fbe600c92d0 2023-07-14T11:18:44.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:44.375+0000 7fbe677ff700 1 -- 172.21.15.84:0/3802017834 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fbe600cbab0 con 0x7fbe600c92d0 2023-07-14T11:18:45.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:45.029+0000 7fbe55ffb700 1 -- 172.21.15.84:0/3802017834 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v53) v1 ==== 118+0+0 (secure 0 0 0) 0x7fbe58007310 con 0x7fbe600c92d0 2023-07-14T11:18:45.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:45.032+0000 7fbe677ff700 1 -- 172.21.15.84:0/3802017834 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fbe4406ae00 msgr2=0x7fbe4406d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:45.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:45.032+0000 7fbe677ff700 1 --2- 172.21.15.84:0/3802017834 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fbe4406ae00 0x7fbe4406d2b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c006fd0 tx=0x7fbe5c008040 comp rx=0 tx=0).stop 2023-07-14T11:18:45.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:45.032+0000 7fbe677ff700 1 -- 172.21.15.84:0/3802017834 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe600c92d0 msgr2=0x7fbe6014a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:45.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:45.032+0000 7fbe677ff700 1 --2- 172.21.15.84:0/3802017834 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe600c92d0 0x7fbe6014a630 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7fbe58015040 tx=0x7fbe58004ad0 comp rx=0 tx=0).stop 2023-07-14T11:18:45.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:45.032+0000 7fbe677ff700 1 -- 172.21.15.84:0/3802017834 shutdown_connections 2023-07-14T11:18:45.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:45.032+0000 7fbe677ff700 1 --2- 172.21.15.84:0/3802017834 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fbe4406ae00 0x7fbe4406d2b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:45.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:45.032+0000 7fbe677ff700 1 --2- 172.21.15.84:0/3802017834 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe600adea0 0x7fbe601f5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:45.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:45.032+0000 7fbe677ff700 1 --2- 172.21.15.84:0/3802017834 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe600c92d0 0x7fbe6014a630 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:45.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:45.032+0000 7fbe677ff700 1 --2- 172.21.15.84:0/3802017834 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe600b12f0 0x7fbe601f5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:45.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:45.032+0000 7fbe677ff700 1 -- 172.21.15.84:0/3802017834 >> 172.21.15.84:0/3802017834 conn(0x7fbe600b05d0 msgr2=0x7fbe600c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:45.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:45.032+0000 7fbe677ff700 1 -- 172.21.15.84:0/3802017834 shutdown_connections 2023-07-14T11:18:45.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:45.032+0000 7fbe677ff700 1 -- 172.21.15.84:0/3802017834 wait complete. 2023-07-14T11:18:45.055 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-14T11:18:45.055 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-14T11:18:45.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:45.253+0000 7fcfb4dff700 1 Processor -- start 2023-07-14T11:18:45.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:45.254+0000 7fcfb4dff700 1 -- start start 2023-07-14T11:18:45.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:45.255+0000 7fcfb4dff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcfb015c860 0x7fcfb00d1e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:45.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:45.255+0000 7fcfb4dff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fcfb00c71b0 0x7fcfb00b49d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:45.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:45.255+0000 7fcfb4dff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfb00cd5a0 con 0x7fcfb00cf2a0 2023-07-14T11:18:45.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:45.255+0000 7fcfb4dff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfb0146740 con 0x7fcfb015c860 2023-07-14T11:18:45.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:45.255+0000 7fcfb4dff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfb00cf740 con 0x7fcfb00c71b0 2023-07-14T11:18:45.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:45.255+0000 7fcfae59c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcfb015c860 0x7fcfb00d1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:45.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:45.255+0000 7fcfae59c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcfb015c860 0x7fcfb00d1e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39214/0 (socket says 172.21.15.84:39214) 2023-07-14T11:18:45.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:45.255+0000 7fcfa7fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fcfb00cf2a0 0x7fcfb00c6aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:58352/0 (socket says 172.21.15.84:58352) 2023-07-14T11:18:45.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:45.255+0000 7fcfae59c700 1 -- 172.21.15.84:0/3478488280 learned_addr learned my addr 172.21.15.84:0/3478488280 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:45.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:45.255+0000 7fcfaed9d700 1 --2- 172.21.15.84:0/3478488280 >> v2:172.21.15.179:3300/0 conn(0x7fcfb00c71b0 0x7fcfb00b49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:45.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:45.256+0000 7fcfae59c700 1 -- 172.21.15.84:0/3478488280 >> v2:172.21.15.179:3300/0 conn(0x7fcfb00c71b0 msgr2=0x7fcfb00b49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:45.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:45.256+0000 7fcfae59c700 1 --2- 172.21.15.84:0/3478488280 >> v2:172.21.15.179:3300/0 conn(0x7fcfb00c71b0 0x7fcfb00b49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:45.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:45.256+0000 7fcfae59c700 1 -- 172.21.15.84:0/3478488280 >> v1:172.21.15.84:6789/0 conn(0x7fcfb00cf2a0 legacy=0x7fcfb00c6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:45.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:45.256+0000 7fcfae59c700 1 -- 172.21.15.84:0/3478488280 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb00cd7f0 con 0x7fcfb015c860 2023-07-14T11:18:45.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:45.256+0000 7fcfae59c700 1 --2- 172.21.15.84:0/3478488280 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcfb015c860 0x7fcfb00d1e40 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fcfb00d0ab0 tx=0x7fcfa0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a9b6a07f8308452 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:45.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:45.256+0000 7fcfadd9b700 1 -- 172.21.15.84:0/3478488280 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa000b870 con 0x7fcfb015c860 2023-07-14T11:18:45.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:45.256+0000 7fcfadd9b700 1 -- 172.21.15.84:0/3478488280 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfa000b9d0 con 0x7fcfb015c860 2023-07-14T11:18:45.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:45.256+0000 7fcfadd9b700 1 -- 172.21.15.84:0/3478488280 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa000bd60 con 0x7fcfb015c860 2023-07-14T11:18:45.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:45.257+0000 7fcfb4dff700 1 -- 172.21.15.84:0/3478488280 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcfb015c860 msgr2=0x7fcfb00d1e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:45.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:45.257+0000 7fcfb4dff700 1 --2- 172.21.15.84:0/3478488280 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcfb015c860 0x7fcfb00d1e40 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fcfb00d0ab0 tx=0x7fcfa0009bd0 comp rx=0 tx=0).stop 2023-07-14T11:18:45.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:45.257+0000 7fcfb4dff700 1 -- 172.21.15.84:0/3478488280 shutdown_connections 2023-07-14T11:18:45.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:45.257+0000 7fcfb4dff700 1 --2- 172.21.15.84:0/3478488280 >> v2:172.21.15.179:3300/0 conn(0x7fcfb00c71b0 0x7fcfb00b49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:45.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:45.257+0000 7fcfb4dff700 1 --2- 172.21.15.84:0/3478488280 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcfb015c860 0x7fcfb00d1e40 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:45.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:45.257+0000 7fcfb4dff700 1 -- 172.21.15.84:0/3478488280 >> 172.21.15.84:0/3478488280 conn(0x7fcfb0065bd0 msgr2=0x7fcfb0065fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:45.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:45.257+0000 7fcfb4dff700 1 -- 172.21.15.84:0/3478488280 shutdown_connections 2023-07-14T11:18:45.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:45.257+0000 7fcfb4dff700 1 -- 172.21.15.84:0/3478488280 wait complete. 2023-07-14T11:18:45.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:45.259+0000 7fcfb4dff700 1 Processor -- start 2023-07-14T11:18:45.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:45.259+0000 7fcfb4dff700 1 -- start start 2023-07-14T11:18:45.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:45.260+0000 7fcfb4dff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcfb00c71b0 0x7fcfb00b5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:45.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:45.261+0000 7fcfb4dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcfb00cf2a0 0x7fcfb00c6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:45.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:45.261+0000 7fcfb4dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcfb015c860 0x7fcfb00b7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:45.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:45.261+0000 7fcfb4dff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb015d160 con 0x7fcfb00c71b0 2023-07-14T11:18:45.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:45.261+0000 7fcfb4dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb015d2f0 con 0x7fcfb015c860 2023-07-14T11:18:45.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:45.261+0000 7fcfb4dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb00b80a0 con 0x7fcfb00cf2a0 2023-07-14T11:18:45.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:45.261+0000 7fcfae59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcfb00c71b0 0x7fcfb00b5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:45.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:45.261+0000 7fcfae59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcfb00c71b0 0x7fcfb00b5d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39218/0 (socket says 172.21.15.84:39218) 2023-07-14T11:18:45.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:45.261+0000 7fcfae59c700 1 -- 172.21.15.84:0/1108540473 learned_addr learned my addr 172.21.15.84:0/1108540473 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:45.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:45.261+0000 7fcfaed9d700 1 --2- 172.21.15.84:0/1108540473 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcfb015c860 0x7fcfb00b7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:45.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:45.261+0000 7fcfa7fff700 1 --2- 172.21.15.84:0/1108540473 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcfb00cf2a0 0x7fcfb00c6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:45.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:45.261+0000 7fcfae59c700 1 -- 172.21.15.84:0/1108540473 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcfb00cf2a0 msgr2=0x7fcfb00c6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:45.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:45.261+0000 7fcfae59c700 1 --2- 172.21.15.84:0/1108540473 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcfb00cf2a0 0x7fcfb00c6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:45.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:45.261+0000 7fcfae59c700 1 -- 172.21.15.84:0/1108540473 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcfb015c860 msgr2=0x7fcfb00b7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:45.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:45.261+0000 7fcfae59c700 1 --2- 172.21.15.84:0/1108540473 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcfb015c860 0x7fcfb00b7b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:45.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:45.261+0000 7fcfae59c700 1 -- 172.21.15.84:0/1108540473 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa0009550 con 0x7fcfb00c71b0 2023-07-14T11:18:45.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:45.261+0000 7fcfaed9d700 1 --2- 172.21.15.84:0/1108540473 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcfb015c860 0x7fcfb00b7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:18:45.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:45.262+0000 7fcfae59c700 1 --2- 172.21.15.84:0/1108540473 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcfb00c71b0 0x7fcfb00b5d80 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fcfa0000c00 tx=0x7fcfa0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:45.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:45.262+0000 7fcfa6ffd700 1 -- 172.21.15.84:0/1108540473 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa0004520 con 0x7fcfb00c71b0 2023-07-14T11:18:45.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:45.262+0000 7fcfa6ffd700 1 -- 172.21.15.84:0/1108540473 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfa001e070 con 0x7fcfb00c71b0 2023-07-14T11:18:45.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:45.262+0000 7fcfb4dff700 1 -- 172.21.15.84:0/1108540473 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfb00b6360 con 0x7fcfb00c71b0 2023-07-14T11:18:45.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:45.262+0000 7fcfa6ffd700 1 -- 172.21.15.84:0/1108540473 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa00038a0 con 0x7fcfb00c71b0 2023-07-14T11:18:45.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:45.262+0000 7fcfb4dff700 1 -- 172.21.15.84:0/1108540473 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfb00b6920 con 0x7fcfb00c71b0 2023-07-14T11:18:45.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:45.263+0000 7fcfb4dff700 1 -- 172.21.15.84:0/1108540473 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfb0074350 con 0x7fcfb00c71b0 2023-07-14T11:18:45.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:45.264+0000 7fcfa6ffd700 1 -- 172.21.15.84:0/1108540473 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7fcfa0003a00 con 0x7fcfb00c71b0 2023-07-14T11:18:45.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:45.265+0000 7fcfa6ffd700 1 --2- 172.21.15.84:0/1108540473 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fcf9006ae00 0x7fcf9006d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:45.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:45.265+0000 7fcfa6ffd700 1 -- 172.21.15.84:0/1108540473 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcfa0020070 con 0x7fcfb00c71b0 2023-07-14T11:18:45.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:45.266+0000 7fcfa7fff700 1 --2- 172.21.15.84:0/1108540473 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fcf9006ae00 0x7fcf9006d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:45.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:45.268+0000 7fcfa7fff700 1 --2- 172.21.15.84:0/1108540473 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fcf9006ae00 0x7fcf9006d2b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcfb01f59c0 tx=0x7fcf98007d10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:45.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:45.269+0000 7fcfa6ffd700 1 -- 172.21.15.84:0/1108540473 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fcfa0055c50 con 0x7fcfb00c71b0 2023-07-14T11:18:45.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:45.504+0000 7fcfb4dff700 1 -- 172.21.15.84:0/1108540473 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fcfb00c95a0 con 0x7fcfb00c71b0 2023-07-14T11:18:46.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.034+0000 7fcfa6ffd700 1 -- 172.21.15.84:0/1108540473 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v54) v1 ==== 122+0+0 (secure 0 0 0) 0x7fcfa0003cb0 con 0x7fcfb00c71b0 2023-07-14T11:18:46.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.037+0000 7fcfb4dff700 1 -- 172.21.15.84:0/1108540473 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fcf9006ae00 msgr2=0x7fcf9006d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:46.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.037+0000 7fcfb4dff700 1 --2- 172.21.15.84:0/1108540473 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fcf9006ae00 0x7fcf9006d2b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcfb01f59c0 tx=0x7fcf98007d10 comp rx=0 tx=0).stop 2023-07-14T11:18:46.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.037+0000 7fcfb4dff700 1 -- 172.21.15.84:0/1108540473 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcfb00c71b0 msgr2=0x7fcfb00b5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:46.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.037+0000 7fcfb4dff700 1 --2- 172.21.15.84:0/1108540473 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcfb00c71b0 0x7fcfb00b5d80 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fcfa0000c00 tx=0x7fcfa0004750 comp rx=0 tx=0).stop 2023-07-14T11:18:46.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.037+0000 7fcfb4dff700 1 -- 172.21.15.84:0/1108540473 shutdown_connections 2023-07-14T11:18:46.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.037+0000 7fcfb4dff700 1 --2- 172.21.15.84:0/1108540473 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcfb015c860 0x7fcfb00b7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:46.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.037+0000 7fcfb4dff700 1 --2- 172.21.15.84:0/1108540473 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcfb00c71b0 0x7fcfb00b5d80 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:46.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.037+0000 7fcfb4dff700 1 --2- 172.21.15.84:0/1108540473 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fcf9006ae00 0x7fcf9006d2b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:46.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.037+0000 7fcfb4dff700 1 --2- 172.21.15.84:0/1108540473 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcfb00cf2a0 0x7fcfb00c6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:46.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.037+0000 7fcfb4dff700 1 -- 172.21.15.84:0/1108540473 >> 172.21.15.84:0/1108540473 conn(0x7fcfb0065bd0 msgr2=0x7fcfb00d0ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:46.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.037+0000 7fcfb4dff700 1 -- 172.21.15.84:0/1108540473 shutdown_connections 2023-07-14T11:18:46.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.037+0000 7fcfb4dff700 1 -- 172.21.15.84:0/1108540473 wait complete. 2023-07-14T11:18:46.059 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-14T11:18:46.060 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T11:18:46.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.254+0000 7f2d81bff700 1 Processor -- start 2023-07-14T11:18:46.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.255+0000 7f2d81bff700 1 -- start start 2023-07-14T11:18:46.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.256+0000 7f2d81bff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2d7c15c950 0x7f2d7c0b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:46.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.256+0000 7f2d81bff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2d7c0d1220 0x7f2d7c0afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:46.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.256+0000 7f2d81bff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d7c0d2ce0 con 0x7f2d7c0b1e00 2023-07-14T11:18:46.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.256+0000 7f2d81bff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d7c0b3350 con 0x7f2d7c15c950 2023-07-14T11:18:46.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.256+0000 7f2d81bff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d7c0b3630 con 0x7f2d7c0d1220 2023-07-14T11:18:46.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.256+0000 7f2d7b7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2d7c15c950 0x7f2d7c0b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:46.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.256+0000 7f2d7b7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2d7c15c950 0x7f2d7c0b43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39234/0 (socket says 172.21.15.84:39234) 2023-07-14T11:18:46.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.256+0000 7f2d7b7fe700 1 -- 172.21.15.84:0/1756083887 learned_addr learned my addr 172.21.15.84:0/1756083887 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:46.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.256+0000 7f2d7bfff700 1 --2- 172.21.15.84:0/1756083887 >> v2:172.21.15.179:3300/0 conn(0x7f2d7c0d1220 0x7f2d7c0afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:46.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.256+0000 7f2d7b7fe700 1 -- 172.21.15.84:0/1756083887 >> v2:172.21.15.179:3300/0 conn(0x7f2d7c0d1220 msgr2=0x7f2d7c0afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:46.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.256+0000 7f2d7b7fe700 1 --2- 172.21.15.84:0/1756083887 >> v2:172.21.15.179:3300/0 conn(0x7f2d7c0d1220 0x7f2d7c0afac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:46.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.256+0000 7f2d7b7fe700 1 -- 172.21.15.84:0/1756083887 >> v1:172.21.15.84:6789/0 conn(0x7f2d7c0b1e00 legacy=0x7f2d7c0d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:46.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.256+0000 7f2d7b7fe700 1 -- 172.21.15.84:0/1756083887 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d7c0b3910 con 0x7f2d7c15c950 2023-07-14T11:18:46.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.257+0000 7f2d7bfff700 1 --2- 172.21.15.84:0/1756083887 >> v2:172.21.15.179:3300/0 conn(0x7f2d7c0d1220 0x7f2d7c0afac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:18:46.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.257+0000 7f2d7b7fe700 1 --2- 172.21.15.84:0/1756083887 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d7c15c950 0x7f2d7c0b43f0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c09c8e0 tx=0x7f2d6c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abee45b7a08fcb17 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:46.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.257+0000 7f2d7affd700 1 -- 172.21.15.84:0/1756083887 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d6c005e30 con 0x7f2d7c15c950 2023-07-14T11:18:46.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.257+0000 7f2d7affd700 1 -- 172.21.15.84:0/1756083887 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d6c004030 con 0x7f2d7c15c950 2023-07-14T11:18:46.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.257+0000 7f2d7affd700 1 -- 172.21.15.84:0/1756083887 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d6c0043e0 con 0x7f2d7c15c950 2023-07-14T11:18:46.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.257+0000 7f2d81bff700 1 -- 172.21.15.84:0/1756083887 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d7c15c950 msgr2=0x7f2d7c0b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:46.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.257+0000 7f2d81bff700 1 --2- 172.21.15.84:0/1756083887 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d7c15c950 0x7f2d7c0b43f0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c09c8e0 tx=0x7f2d6c009bd0 comp rx=0 tx=0).stop 2023-07-14T11:18:46.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.258+0000 7f2d81bff700 1 -- 172.21.15.84:0/1756083887 shutdown_connections 2023-07-14T11:18:46.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.258+0000 7f2d81bff700 1 --2- 172.21.15.84:0/1756083887 >> v2:172.21.15.179:3300/0 conn(0x7f2d7c0d1220 0x7f2d7c0afac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:46.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.258+0000 7f2d81bff700 1 --2- 172.21.15.84:0/1756083887 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d7c15c950 0x7f2d7c0b43f0 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:46.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.258+0000 7f2d81bff700 1 -- 172.21.15.84:0/1756083887 >> 172.21.15.84:0/1756083887 conn(0x7f2d7c09c1d0 msgr2=0x7f2d7c0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:46.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.258+0000 7f2d81bff700 1 -- 172.21.15.84:0/1756083887 shutdown_connections 2023-07-14T11:18:46.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.258+0000 7f2d81bff700 1 -- 172.21.15.84:0/1756083887 wait complete. 2023-07-14T11:18:46.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.259+0000 7f2d81bff700 1 Processor -- start 2023-07-14T11:18:46.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.259+0000 7f2d81bff700 1 -- start start 2023-07-14T11:18:46.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.260+0000 7f2d81bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2d7c0b1e00 0x7f2d7c1575d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:46.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.260+0000 7f2d81bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2d7c0d1220 0x7f2d7c0c6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:46.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.260+0000 7f2d81bff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d7c15c950 0x7f2d7c0c7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:46.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.260+0000 7f2d81bff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d7c0c78b0 con 0x7f2d7c15c950 2023-07-14T11:18:46.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.260+0000 7f2d81bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d7c1f5cf0 con 0x7f2d7c0b1e00 2023-07-14T11:18:46.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.260+0000 7f2d81bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d7c1f5fd0 con 0x7f2d7c0d1220 2023-07-14T11:18:46.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.261+0000 7f2d7bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d7c15c950 0x7f2d7c0c7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:46.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.261+0000 7f2d7bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d7c15c950 0x7f2d7c0c7370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39250/0 (socket says 172.21.15.84:39250) 2023-07-14T11:18:46.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.261+0000 7f2d7bfff700 1 -- 172.21.15.84:0/4233388978 learned_addr learned my addr 172.21.15.84:0/4233388978 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:46.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.261+0000 7f2d7b7fe700 1 --2- 172.21.15.84:0/4233388978 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2d7c0b1e00 0x7f2d7c1575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:46.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.261+0000 7f2d73fff700 1 --2- 172.21.15.84:0/4233388978 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2d7c0d1220 0x7f2d7c0c6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:46.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.261+0000 7f2d7bfff700 1 -- 172.21.15.84:0/4233388978 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2d7c0d1220 msgr2=0x7f2d7c0c6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:46.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.261+0000 7f2d7bfff700 1 --2- 172.21.15.84:0/4233388978 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2d7c0d1220 0x7f2d7c0c6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:46.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.261+0000 7f2d7bfff700 1 -- 172.21.15.84:0/4233388978 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2d7c0b1e00 msgr2=0x7f2d7c1575d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:46.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.261+0000 7f2d7bfff700 1 --2- 172.21.15.84:0/4233388978 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2d7c0b1e00 0x7f2d7c1575d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:46.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.261+0000 7f2d7bfff700 1 -- 172.21.15.84:0/4233388978 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d6c009500 con 0x7f2d7c15c950 2023-07-14T11:18:46.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.261+0000 7f2d7bfff700 1 --2- 172.21.15.84:0/4233388978 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d7c15c950 0x7f2d7c0c7370 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f2d7400ce80 tx=0x7f2d7400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:46.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.262+0000 7f2d78ff9700 1 -- 172.21.15.84:0/4233388978 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d7400ae20 con 0x7f2d7c15c950 2023-07-14T11:18:46.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.262+0000 7f2d78ff9700 1 -- 172.21.15.84:0/4233388978 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d74015440 con 0x7f2d7c15c950 2023-07-14T11:18:46.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.262+0000 7f2d78ff9700 1 -- 172.21.15.84:0/4233388978 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d740157f0 con 0x7f2d7c15c950 2023-07-14T11:18:46.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.262+0000 7f2d81bff700 1 -- 172.21.15.84:0/4233388978 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d7c1f62b0 con 0x7f2d7c15c950 2023-07-14T11:18:46.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.262+0000 7f2d81bff700 1 -- 172.21.15.84:0/4233388978 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d7c1f6870 con 0x7f2d7c15c950 2023-07-14T11:18:46.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.263+0000 7f2d81bff700 1 -- 172.21.15.84:0/4233388978 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d7c04e280 con 0x7f2d7c15c950 2023-07-14T11:18:46.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.264+0000 7f2d78ff9700 1 -- 172.21.15.84:0/4233388978 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f2d7400d430 con 0x7f2d7c15c950 2023-07-14T11:18:46.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.265+0000 7f2d78ff9700 1 --2- 172.21.15.84:0/4233388978 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f2d5c06ae00 0x7f2d5c06d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:46.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.265+0000 7f2d78ff9700 1 -- 172.21.15.84:0/4233388978 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2d74089c80 con 0x7f2d7c15c950 2023-07-14T11:18:46.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.265+0000 7f2d7b7fe700 1 --2- 172.21.15.84:0/4233388978 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f2d5c06ae00 0x7f2d5c06d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:46.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.266+0000 7f2d7b7fe700 1 --2- 172.21.15.84:0/4233388978 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f2d5c06ae00 0x7f2d5c06d2b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c09c8e0 tx=0x7f2d6c008070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:46.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.269+0000 7f2d78ff9700 1 -- 172.21.15.84:0/4233388978 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f2d74054b80 con 0x7f2d7c15c950 2023-07-14T11:18:46.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.506+0000 7f2d81bff700 1 -- 172.21.15.84:0/4233388978 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2d7c15c170 con 0x7f2d7c15c950 2023-07-14T11:18:46.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.506+0000 7f2d78ff9700 1 -- 172.21.15.84:0/4233388978 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+4717 (secure 0 0 0) 0x7f2d7401a090 con 0x7f2d7c15c950 2023-07-14T11:18:46.509 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:18:46.509 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":54,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5945,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6834/3102047639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":3102047639},{"type":"v1","addr":"172.21.15.84:6834","nonce":3102047639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":5951,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/1883008963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1883008963},{"type":"v1","addr":"172.21.15.179:6835","nonce":1883008963}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":6736,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/4019917691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":4019917691},{"type":"v1","addr":"172.21.15.179:6834","nonce":4019917691}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T11:18:42.500325+0000","modified":"2023-07-14T11:18:46.028519+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7227},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7227":{"gid":7227,"name":"c","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6835/3879250964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6833","nonce":3879250964},{"type":"v1","addr":"172.21.15.84:6835","nonce":3879250964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-07-14T11:18:46.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.509+0000 7f2d81bff700 1 -- 172.21.15.84:0/4233388978 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f2d5c06ae00 msgr2=0x7f2d5c06d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:46.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.509+0000 7f2d81bff700 1 --2- 172.21.15.84:0/4233388978 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f2d5c06ae00 0x7f2d5c06d2b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c09c8e0 tx=0x7f2d6c008070 comp rx=0 tx=0).stop 2023-07-14T11:18:46.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.509+0000 7f2d81bff700 1 -- 172.21.15.84:0/4233388978 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d7c15c950 msgr2=0x7f2d7c0c7370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:46.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.509+0000 7f2d81bff700 1 --2- 172.21.15.84:0/4233388978 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d7c15c950 0x7f2d7c0c7370 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f2d7400ce80 tx=0x7f2d7400cf60 comp rx=0 tx=0).stop 2023-07-14T11:18:46.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.509+0000 7f2d81bff700 1 -- 172.21.15.84:0/4233388978 shutdown_connections 2023-07-14T11:18:46.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.509+0000 7f2d81bff700 1 --2- 172.21.15.84:0/4233388978 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d7c15c950 0x7f2d7c0c7370 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:46.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.509+0000 7f2d81bff700 1 --2- 172.21.15.84:0/4233388978 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2d7c0b1e00 0x7f2d7c1575d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:46.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.509+0000 7f2d81bff700 1 --2- 172.21.15.84:0/4233388978 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f2d5c06ae00 0x7f2d5c06d2b0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:46.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.509+0000 7f2d81bff700 1 --2- 172.21.15.84:0/4233388978 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2d7c0d1220 0x7f2d7c0c6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:46.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.509+0000 7f2d81bff700 1 -- 172.21.15.84:0/4233388978 >> 172.21.15.84:0/4233388978 conn(0x7f2d7c09c1d0 msgr2=0x7f2d7c0afac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:46.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.509+0000 7f2d81bff700 1 -- 172.21.15.84:0/4233388978 shutdown_connections 2023-07-14T11:18:46.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.509+0000 7f2d81bff700 1 -- 172.21.15.84:0/4233388978 wait complete. 2023-07-14T11:18:46.513 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 54 2023-07-14T11:18:46.529 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:18:46.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.723+0000 7f0406bff700 1 Processor -- start 2023-07-14T11:18:46.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.723+0000 7f0406bff700 1 -- start start 2023-07-14T11:18:46.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.724+0000 7f0406bff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f04000d1160 0x7f040006c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:46.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.724+0000 7f0406bff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f04000b5cd0 0x7f04000b0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:46.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.724+0000 7f0406bff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04000d2cc0 con 0x7f0400160030 2023-07-14T11:18:46.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.724+0000 7f0406bff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04000afbb0 con 0x7f04000d1160 2023-07-14T11:18:46.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.724+0000 7f0406bff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04000afe90 con 0x7f04000b5cd0 2023-07-14T11:18:46.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.724+0000 7f040499b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f0400160030 0x7f04000d0a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:58366/0 (socket says 172.21.15.84:58366) 2023-07-14T11:18:46.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.724+0000 7f040499b700 1 -- 172.21.15.84:0/941740381 learned_addr learned my addr 172.21.15.84:0/941740381 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:18:46.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.724+0000 7f03fffff700 1 --2- 172.21.15.84:0/941740381 >> v2:172.21.15.84:3300/0 conn(0x7f04000d1160 0x7f040006c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:46.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.725+0000 7f03fffff700 1 -- 172.21.15.84:0/941740381 >> v2:172.21.15.179:3300/0 conn(0x7f04000b5cd0 msgr2=0x7f04000b0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:46.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.725+0000 7f040519c700 1 --2- 172.21.15.84:0/941740381 >> v2:172.21.15.179:3300/0 conn(0x7f04000b5cd0 0x7f04000b0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:46.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.725+0000 7f03fffff700 1 --2- 172.21.15.84:0/941740381 >> v2:172.21.15.179:3300/0 conn(0x7f04000b5cd0 0x7f04000b0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:46.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.725+0000 7f03fffff700 1 -- 172.21.15.84:0/941740381 >> v1:172.21.15.84:6789/0 conn(0x7f0400160030 legacy=0x7f04000d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:46.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.725+0000 7f03fffff700 1 -- 172.21.15.84:0/941740381 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04000b0170 con 0x7f04000d1160 2023-07-14T11:18:46.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.725+0000 7f040519c700 1 --2- 172.21.15.84:0/941740381 >> v2:172.21.15.179:3300/0 conn(0x7f04000b5cd0 0x7f04000b0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:18:46.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.725+0000 7f03ff7fe700 1 -- 172.21.15.84:0/941740381 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2725476435 0 0) 0x7f04000d2cc0 con 0x7f0400160030 2023-07-14T11:18:46.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.725+0000 7f03fffff700 1 --2- 172.21.15.84:0/941740381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04000d1160 0x7f040006c0f0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f040008c2c0 tx=0x7f03ec009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=927f7eb496b35f7d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:46.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.725+0000 7f03ff7fe700 1 -- 172.21.15.84:0/941740381 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03ec011830 con 0x7f04000d1160 2023-07-14T11:18:46.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.725+0000 7f03ff7fe700 1 -- 172.21.15.84:0/941740381 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03ec011990 con 0x7f04000d1160 2023-07-14T11:18:46.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.725+0000 7f03ff7fe700 1 -- 172.21.15.84:0/941740381 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03ec011d20 con 0x7f04000d1160 2023-07-14T11:18:46.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.726+0000 7f0406bff700 1 -- 172.21.15.84:0/941740381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04000d1160 msgr2=0x7f040006c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:46.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.726+0000 7f0406bff700 1 --2- 172.21.15.84:0/941740381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04000d1160 0x7f040006c0f0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f040008c2c0 tx=0x7f03ec009b20 comp rx=0 tx=0).stop 2023-07-14T11:18:46.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.726+0000 7f0406bff700 1 -- 172.21.15.84:0/941740381 shutdown_connections 2023-07-14T11:18:46.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.726+0000 7f0406bff700 1 --2- 172.21.15.84:0/941740381 >> v2:172.21.15.179:3300/0 conn(0x7f04000b5cd0 0x7f04000b0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:46.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.726+0000 7f0406bff700 1 --2- 172.21.15.84:0/941740381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04000d1160 0x7f040006c0f0 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:46.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.726+0000 7f0406bff700 1 -- 172.21.15.84:0/941740381 >> 172.21.15.84:0/941740381 conn(0x7f040009c190 msgr2=0x7f04000d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:46.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.726+0000 7f0406bff700 1 -- 172.21.15.84:0/941740381 shutdown_connections 2023-07-14T11:18:46.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.726+0000 7f0406bff700 1 -- 172.21.15.84:0/941740381 wait complete. 2023-07-14T11:18:46.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.727+0000 7f0406bff700 1 Processor -- start 2023-07-14T11:18:46.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.728+0000 7f0406bff700 1 -- start start 2023-07-14T11:18:46.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.729+0000 7f0406bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04000b5cd0 0x7f040015c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:46.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.729+0000 7f0406bff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04000d1160 0x7f040015a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:46.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.729+0000 7f0406bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0400160030 0x7f0400157b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:46.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.729+0000 7f0406bff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f040015c730 con 0x7f04000d1160 2023-07-14T11:18:46.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.729+0000 7f0406bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04000b22e0 con 0x7f04000b5cd0 2023-07-14T11:18:46.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.729+0000 7f0406bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0400155bd0 con 0x7f0400160030 2023-07-14T11:18:46.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.729+0000 7f03fffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04000d1160 0x7f040015a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:46.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.729+0000 7f03fffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04000d1160 0x7f040015a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39276/0 (socket says 172.21.15.84:39276) 2023-07-14T11:18:46.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.729+0000 7f03fffff700 1 -- 172.21.15.84:0/1022087156 learned_addr learned my addr 172.21.15.84:0/1022087156 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:46.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.729+0000 7f03fffff700 1 -- 172.21.15.84:0/1022087156 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0400160030 msgr2=0x7f0400157b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:46.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.729+0000 7f03fffff700 1 --2- 172.21.15.84:0/1022087156 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0400160030 0x7f0400157b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:46.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.729+0000 7f03fffff700 1 -- 172.21.15.84:0/1022087156 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04000b5cd0 msgr2=0x7f040015c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:46.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.729+0000 7f03fffff700 1 --2- 172.21.15.84:0/1022087156 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04000b5cd0 0x7f040015c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:46.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.729+0000 7f03fffff700 1 -- 172.21.15.84:0/1022087156 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03ec0094a0 con 0x7f04000d1160 2023-07-14T11:18:46.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.729+0000 7f03fffff700 1 --2- 172.21.15.84:0/1022087156 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04000d1160 0x7f040015a120 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f03ec000c00 tx=0x7f03ec004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:46.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.730+0000 7f03fd7fa700 1 -- 172.21.15.84:0/1022087156 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03ec0036a0 con 0x7f04000d1160 2023-07-14T11:18:46.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.730+0000 7f03fd7fa700 1 -- 172.21.15.84:0/1022087156 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03ec01f070 con 0x7f04000d1160 2023-07-14T11:18:46.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.730+0000 7f03fd7fa700 1 -- 172.21.15.84:0/1022087156 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03ec003a60 con 0x7f04000d1160 2023-07-14T11:18:46.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.730+0000 7f0406bff700 1 -- 172.21.15.84:0/1022087156 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04001584c0 con 0x7f04000d1160 2023-07-14T11:18:46.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.730+0000 7f0406bff700 1 -- 172.21.15.84:0/1022087156 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04000b2af0 con 0x7f04000d1160 2023-07-14T11:18:46.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.731+0000 7f0406bff700 1 -- 172.21.15.84:0/1022087156 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04000b2c80 con 0x7f04000d1160 2023-07-14T11:18:46.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.732+0000 7f03fd7fa700 1 -- 172.21.15.84:0/1022087156 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f03ec021030 con 0x7f04000d1160 2023-07-14T11:18:46.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.733+0000 7f03fd7fa700 1 --2- 172.21.15.84:0/1022087156 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f03e406ae00 0x7f03e406d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:46.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.733+0000 7f03fd7fa700 1 -- 172.21.15.84:0/1022087156 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f03ec08a980 con 0x7f04000d1160 2023-07-14T11:18:46.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.733+0000 7f040499b700 1 --2- 172.21.15.84:0/1022087156 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f03e406ae00 0x7f03e406d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:46.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.734+0000 7f040499b700 1 --2- 172.21.15.84:0/1022087156 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f03e406ae00 0x7f03e406d2b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f03f4001610 tx=0x7f03f40079f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:46.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.737+0000 7f03fd7fa700 1 -- 172.21.15.84:0/1022087156 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f03ec0559b0 con 0x7f04000d1160 2023-07-14T11:18:46.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.934+0000 7f0406bff700 1 -- 172.21.15.84:0/1022087156 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f040004e280 con 0x7f04000d1160 2023-07-14T11:18:46.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.935+0000 7f03fd7fa700 1 -- 172.21.15.84:0/1022087156 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+18270 (secure 0 0 0) 0x7f03ec08a030 con 0x7f04000d1160 2023-07-14T11:18:46.938 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:18:46.938 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":88,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:18:44.008298+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-07-14T11:18:40.531166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-07-14T11:18:41.475653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:18:46.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.938+0000 7f0406bff700 1 -- 172.21.15.84:0/1022087156 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f03e406ae00 msgr2=0x7f03e406d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:46.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.938+0000 7f0406bff700 1 --2- 172.21.15.84:0/1022087156 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f03e406ae00 0x7f03e406d2b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f03f4001610 tx=0x7f03f40079f0 comp rx=0 tx=0).stop 2023-07-14T11:18:46.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.938+0000 7f0406bff700 1 -- 172.21.15.84:0/1022087156 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04000d1160 msgr2=0x7f040015a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:46.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.938+0000 7f0406bff700 1 --2- 172.21.15.84:0/1022087156 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04000d1160 0x7f040015a120 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f03ec000c00 tx=0x7f03ec004750 comp rx=0 tx=0).stop 2023-07-14T11:18:46.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.938+0000 7f0406bff700 1 -- 172.21.15.84:0/1022087156 shutdown_connections 2023-07-14T11:18:46.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.938+0000 7f0406bff700 1 --2- 172.21.15.84:0/1022087156 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f03e406ae00 0x7f03e406d2b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:46.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.938+0000 7f0406bff700 1 --2- 172.21.15.84:0/1022087156 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0400160030 0x7f0400157b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:46.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.938+0000 7f0406bff700 1 --2- 172.21.15.84:0/1022087156 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04000b5cd0 0x7f040015c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:46.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.938+0000 7f0406bff700 1 --2- 172.21.15.84:0/1022087156 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04000d1160 0x7f040015a120 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:46.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.938+0000 7f0406bff700 1 -- 172.21.15.84:0/1022087156 >> 172.21.15.84:0/1022087156 conn(0x7f040009c190 msgr2=0x7f04000b8130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:46.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.938+0000 7f0406bff700 1 -- 172.21.15.84:0/1022087156 shutdown_connections 2023-07-14T11:18:46.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:46.938+0000 7f0406bff700 1 -- 172.21.15.84:0/1022087156 wait complete. 2023-07-14T11:18:46.959 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-14T11:18:46.959 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T11:18:46.987 INFO:tasks.ceph.mds.c.smithi084.stderr:2023-07-14T11:18:46.984+0000 7f06881f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-14T11:18:47.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.152+0000 7f9fcffff700 1 Processor -- start 2023-07-14T11:18:47.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.152+0000 7f9fcffff700 1 -- start start 2023-07-14T11:18:47.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.153+0000 7f9fcffff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fc806db30 0x7f9fc8070950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:47.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.153+0000 7f9fcffff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fc80cd320 con 0x7f9fc80cf510 2023-07-14T11:18:47.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.153+0000 7f9fcffff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fc80ce750 con 0x7f9fc815c710 2023-07-14T11:18:47.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.153+0000 7f9fcffff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc80cf980 con 0x7f9fc806db30 2023-07-14T11:18:47.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.154+0000 7f9fcd59a700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f9fc80cf510 0x7f9fc806d420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:58372/0 (socket says 172.21.15.84:58372) 2023-07-14T11:18:47.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.154+0000 7f9fcd59a700 1 -- 172.21.15.84:0/1559949465 learned_addr learned my addr 172.21.15.84:0/1559949465 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:18:47.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.154+0000 7f9fce59c700 1 --2- 172.21.15.84:0/1559949465 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fc806db30 0x7f9fc8070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:47.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.154+0000 7f9fccd99700 1 -- 172.21.15.84:0/1559949465 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 607901002 0 0) 0x7f9fc80cd320 con 0x7f9fc80cf510 2023-07-14T11:18:47.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.154+0000 7f9fccd99700 1 -- 172.21.15.84:0/1559949465 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fb40035b0 con 0x7f9fc80cf510 2023-07-14T11:18:47.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.154+0000 7f9fccd99700 1 -- 172.21.15.84:0/1559949465 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 708416415 0 0) 0x7f9fb40035b0 con 0x7f9fc80cf510 2023-07-14T11:18:47.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.154+0000 7f9fccd99700 1 -- 172.21.15.84:0/1559949465 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fc806db30 msgr2=0x7f9fc8070950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:47.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.154+0000 7f9fccd99700 1 --2- 172.21.15.84:0/1559949465 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fc806db30 0x7f9fc8070950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:47.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.154+0000 7f9fccd99700 1 -- 172.21.15.84:0/1559949465 >> v1:172.21.15.179:6789/0 conn(0x7f9fc815c710 legacy=0x7f9fc8069f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:47.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.154+0000 7f9fccd99700 1 -- 172.21.15.84:0/1559949465 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fc80cea30 con 0x7f9fc80cf510 2023-07-14T11:18:47.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.154+0000 7f9fccd99700 1 -- 172.21.15.84:0/1559949465 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7f9fb8001670 con 0x7f9fc80cf510 2023-07-14T11:18:47.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.154+0000 7f9fccd99700 1 -- 172.21.15.84:0/1559949465 >> v1:172.21.15.84:6789/0 conn(0x7f9fc80cf510 legacy=0x7f9fc806d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:47.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.154+0000 7f9fccd99700 1 --2- 172.21.15.84:0/1559949465 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fc806db30 0x7f9fb4003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:47.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.155+0000 7f9fccd99700 1 --2- 172.21.15.84:0/1559949465 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9fb4003f70 0x7f9fb4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:47.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.155+0000 7f9fccd99700 1 --2- 172.21.15.84:0/1559949465 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fb4004d90 0x7f9fb4005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:47.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.155+0000 7f9fccd99700 1 -- 172.21.15.84:0/1559949465 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb400bac0 con 0x7f9fb4003f70 2023-07-14T11:18:47.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.155+0000 7f9fccd99700 1 -- 172.21.15.84:0/1559949465 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb400bc00 con 0x7f9fb4004d90 2023-07-14T11:18:47.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.155+0000 7f9fccd99700 1 -- 172.21.15.84:0/1559949465 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb400bdc0 con 0x7f9fc806db30 2023-07-14T11:18:47.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.155+0000 7f9fcd59a700 1 --2- 172.21.15.84:0/1559949465 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9fb4003f70 0x7f9fb4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:47.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.155+0000 7f9fcdd9b700 1 --2- 172.21.15.84:0/1559949465 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fc806db30 0x7f9fb4003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:47.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.155+0000 7f9fce59c700 1 --2- 172.21.15.84:0/1559949465 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fb4004d90 0x7f9fb4005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:47.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.155+0000 7f9fcd59a700 1 -- 172.21.15.84:0/1559949465 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fc806db30 msgr2=0x7f9fb4003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:47.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.155+0000 7f9fcd59a700 1 --2- 172.21.15.84:0/1559949465 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fc806db30 0x7f9fb4003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:47.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.155+0000 7f9fcd59a700 1 -- 172.21.15.84:0/1559949465 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fb4004d90 msgr2=0x7f9fb4005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:47.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.155+0000 7f9fcd59a700 1 --2- 172.21.15.84:0/1559949465 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fb4004d90 0x7f9fb4005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:47.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.155+0000 7f9fcd59a700 1 -- 172.21.15.84:0/1559949465 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fb40035b0 con 0x7f9fb4003f70 2023-07-14T11:18:47.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.155+0000 7f9fcd59a700 1 --2- 172.21.15.84:0/1559949465 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9fb4003f70 0x7f9fb4004850 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f9fb800c1e0 tx=0x7f9fb4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=257cbc522a6d0f74 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:47.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.156+0000 7f9fccd99700 1 -- 172.21.15.84:0/1559949465 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb8007b70 con 0x7f9fb4003f70 2023-07-14T11:18:47.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.156+0000 7f9fccd99700 1 -- 172.21.15.84:0/1559949465 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fb800cd80 con 0x7f9fb4003f70 2023-07-14T11:18:47.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.156+0000 7f9fccd99700 1 -- 172.21.15.84:0/1559949465 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb8005ba0 con 0x7f9fb4003f70 2023-07-14T11:18:47.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.156+0000 7f9fcffff700 1 -- 172.21.15.84:0/1559949465 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9fb4003f70 msgr2=0x7f9fb4004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:47.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.156+0000 7f9fcffff700 1 --2- 172.21.15.84:0/1559949465 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9fb4003f70 0x7f9fb4004850 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f9fb800c1e0 tx=0x7f9fb4005880 comp rx=0 tx=0).stop 2023-07-14T11:18:47.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.156+0000 7f9fce59c700 1 -- 172.21.15.84:0/1559949465 reap_dead start 2023-07-14T11:18:47.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.156+0000 7f9fcffff700 1 -- 172.21.15.84:0/1559949465 shutdown_connections 2023-07-14T11:18:47.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.156+0000 7f9fcffff700 1 -- 172.21.15.84:0/1559949465 >> 172.21.15.84:0/1559949465 conn(0x7f9fc80b16c0 msgr2=0x7f9fc80b1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:47.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.156+0000 7f9fcffff700 1 -- 172.21.15.84:0/1559949465 shutdown_connections 2023-07-14T11:18:47.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.156+0000 7f9fcffff700 1 -- 172.21.15.84:0/1559949465 wait complete. 2023-07-14T11:18:47.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.158+0000 7f9fcffff700 1 Processor -- start 2023-07-14T11:18:47.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.158+0000 7f9fcffff700 1 -- start start 2023-07-14T11:18:47.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.159+0000 7f9fcffff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fb4003f70 0x7f9fc8154960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:47.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.159+0000 7f9fcffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9fc8157590 0x7f9fc815cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:47.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.159+0000 7f9fcffff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fc8154090 0x7f9fc80b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:47.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.159+0000 7f9fcffff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc8154ff0 con 0x7f9fc8157590 2023-07-14T11:18:47.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.159+0000 7f9fcffff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc81552d0 con 0x7f9fc8154090 2023-07-14T11:18:47.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.159+0000 7f9fcffff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc81555b0 con 0x7f9fb4003f70 2023-07-14T11:18:47.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.159+0000 7f9fcd59a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9fc8157590 0x7f9fc815cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:47.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.159+0000 7f9fcd59a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9fc8157590 0x7f9fc815cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39284/0 (socket says 172.21.15.84:39284) 2023-07-14T11:18:47.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.159+0000 7f9fcd59a700 1 -- 172.21.15.84:0/3335560694 learned_addr learned my addr 172.21.15.84:0/3335560694 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:47.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.160+0000 7f9fcdd9b700 1 --2- 172.21.15.84:0/3335560694 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fb4003f70 0x7f9fc8154960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:47.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.160+0000 7f9fcd59a700 1 -- 172.21.15.84:0/3335560694 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fb4003f70 msgr2=0x7f9fc8154960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:47.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.160+0000 7f9fcd59a700 1 --2- 172.21.15.84:0/3335560694 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fb4003f70 0x7f9fc8154960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:47.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.160+0000 7f9fcd59a700 1 -- 172.21.15.84:0/3335560694 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fc8154090 msgr2=0x7f9fc80b4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:47.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.160+0000 7f9fce59c700 1 --2- 172.21.15.84:0/3335560694 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fc8154090 0x7f9fc80b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:47.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.160+0000 7f9fcd59a700 1 --2- 172.21.15.84:0/3335560694 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fc8154090 0x7f9fc80b4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:47.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.160+0000 7f9fcd59a700 1 -- 172.21.15.84:0/3335560694 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fc8155890 con 0x7f9fc8157590 2023-07-14T11:18:47.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.160+0000 7f9fce59c700 1 --2- 172.21.15.84:0/3335560694 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fc8154090 0x7f9fc80b4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:18:47.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.160+0000 7f9fcd59a700 1 --2- 172.21.15.84:0/3335560694 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9fc8157590 0x7f9fc815cb60 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f9fb8011000 tx=0x7f9fb8001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:47.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.160+0000 7f9fbe7fc700 1 -- 172.21.15.84:0/3335560694 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb8000ed0 con 0x7f9fc8157590 2023-07-14T11:18:47.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.160+0000 7f9fbe7fc700 1 -- 172.21.15.84:0/3335560694 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fb80070d0 con 0x7f9fc8157590 2023-07-14T11:18:47.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.160+0000 7f9fbe7fc700 1 -- 172.21.15.84:0/3335560694 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb8007480 con 0x7f9fc8157590 2023-07-14T11:18:47.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.160+0000 7f9fcffff700 1 -- 172.21.15.84:0/3335560694 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fc8155b70 con 0x7f9fc8157590 2023-07-14T11:18:47.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.160+0000 7f9fcffff700 1 -- 172.21.15.84:0/3335560694 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fc8157a00 con 0x7f9fc8157590 2023-07-14T11:18:47.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.161+0000 7f9fcffff700 1 -- 172.21.15.84:0/3335560694 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fc8155db0 con 0x7f9fc8157590 2023-07-14T11:18:47.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.162+0000 7f9fbe7fc700 1 -- 172.21.15.84:0/3335560694 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f9fb8019030 con 0x7f9fc8157590 2023-07-14T11:18:47.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.163+0000 7f9fbe7fc700 1 --2- 172.21.15.84:0/3335560694 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f9fac06ae30 0x7f9fac06d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:47.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.163+0000 7f9fbe7fc700 1 -- 172.21.15.84:0/3335560694 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9fb808a4b0 con 0x7f9fc8157590 2023-07-14T11:18:47.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.164+0000 7f9fcdd9b700 1 --2- 172.21.15.84:0/3335560694 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f9fac06ae30 0x7f9fac06d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:47.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.164+0000 7f9fcdd9b700 1 --2- 172.21.15.84:0/3335560694 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f9fac06ae30 0x7f9fac06d2e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9fc4007fd0 tx=0x7f9fc4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:47.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.168+0000 7f9fbe7fc700 1 -- 172.21.15.84:0/3335560694 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f9fc8155db0 con 0x7f9fc8157590 2023-07-14T11:18:47.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.356+0000 7f9fcffff700 1 -- 172.21.15.84:0/3335560694 --> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9fc80ceff0 con 0x7f9fac06ae30 2023-07-14T11:18:47.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.368+0000 7f9fbe7fc700 1 -- 172.21.15.84:0/3335560694 <== mgr.4100 v2:172.21.15.179:6836/2094253834 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311060 (secure 0 0 0) 0x7f9fc40052d0 con 0x7f9fac06ae30 2023-07-14T11:18:47.374 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:18:47.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.373+0000 7f9fcffff700 1 -- 172.21.15.84:0/3335560694 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f9fac06ae30 msgr2=0x7f9fac06d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:47.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.373+0000 7f9fcffff700 1 --2- 172.21.15.84:0/3335560694 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f9fac06ae30 0x7f9fac06d2e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9fc4007fd0 tx=0x7f9fc4009040 comp rx=0 tx=0).stop 2023-07-14T11:18:47.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.373+0000 7f9fcffff700 1 -- 172.21.15.84:0/3335560694 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9fc8157590 msgr2=0x7f9fc815cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:47.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.373+0000 7f9fcffff700 1 --2- 172.21.15.84:0/3335560694 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9fc8157590 0x7f9fc815cb60 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f9fb8011000 tx=0x7f9fb8001930 comp rx=0 tx=0).stop 2023-07-14T11:18:47.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.373+0000 7f9fcffff700 1 -- 172.21.15.84:0/3335560694 shutdown_connections 2023-07-14T11:18:47.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.373+0000 7f9fcffff700 1 --2- 172.21.15.84:0/3335560694 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f9fac06ae30 0x7f9fac06d2e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:47.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.373+0000 7f9fcffff700 1 --2- 172.21.15.84:0/3335560694 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fb4003f70 0x7f9fc8154960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:47.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.373+0000 7f9fcffff700 1 --2- 172.21.15.84:0/3335560694 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fc8154090 0x7f9fc80b4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:47.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.373+0000 7f9fcffff700 1 --2- 172.21.15.84:0/3335560694 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9fc8157590 0x7f9fc815cb60 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:47.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.373+0000 7f9fcffff700 1 -- 172.21.15.84:0/3335560694 >> 172.21.15.84:0/3335560694 conn(0x7f9fc80b16c0 msgr2=0x7f9fc8159b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:47.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.373+0000 7f9fcffff700 1 -- 172.21.15.84:0/3335560694 shutdown_connections 2023-07-14T11:18:47.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.373+0000 7f9fcffff700 1 -- 172.21.15.84:0/3335560694 wait complete. 2023-07-14T11:18:47.378 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-07-14T11:18:47.393 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2023-07-14T11:18:46.927035+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":223,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":166,"ondisk_log_size":166,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":84,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225172,"kb_used_data":9556,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754749548,"statfs":{"total":773094113280,"available":772863537152,"internally_reserved":0,"allocated":9785344,"data_stored":5065740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.922899"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.053378+0000","last_change":"2023-07-14T11:18:43.049281+0000","last_active":"2023-07-14T11:18:43.053378+0000","last_peered":"2023-07-14T11:18:43.053378+0000","last_clean":"2023-07-14T11:18:43.053378+0000","last_became_active":"2023-07-14T11:18:43.048958+0000","last_became_peered":"2023-07-14T11:18:43.048958+0000","last_unstale":"2023-07-14T11:18:43.053378+0000","last_undegraded":"2023-07-14T11:18:43.053378+0000","last_fullsized":"2023-07-14T11:18:43.053378+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:41:24.975331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.033364+0000","last_change":"2023-07-14T11:18:43.029946+0000","last_active":"2023-07-14T11:18:43.033364+0000","last_peered":"2023-07-14T11:18:43.033364+0000","last_clean":"2023-07-14T11:18:43.033364+0000","last_became_active":"2023-07-14T11:18:43.029634+0000","last_became_peered":"2023-07-14T11:18:43.029634+0000","last_unstale":"2023-07-14T11:18:43.033364+0000","last_undegraded":"2023-07-14T11:18:43.033364+0000","last_fullsized":"2023-07-14T11:18:43.033364+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:18:38.847213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.041758+0000","last_change":"2023-07-14T11:18:43.038105+0000","last_active":"2023-07-14T11:18:43.041758+0000","last_peered":"2023-07-14T11:18:43.041758+0000","last_clean":"2023-07-14T11:18:43.041758+0000","last_became_active":"2023-07-14T11:18:43.037838+0000","last_became_peered":"2023-07-14T11:18:43.037838+0000","last_unstale":"2023-07-14T11:18:43.041758+0000","last_undegraded":"2023-07-14T11:18:43.041758+0000","last_fullsized":"2023-07-14T11:18:43.041758+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:34:29.410100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.031677+0000","last_change":"2023-07-14T11:18:43.027990+0000","last_active":"2023-07-14T11:18:43.031677+0000","last_peered":"2023-07-14T11:18:43.031677+0000","last_clean":"2023-07-14T11:18:43.031677+0000","last_became_active":"2023-07-14T11:18:43.027700+0000","last_became_peered":"2023-07-14T11:18:43.027700+0000","last_unstale":"2023-07-14T11:18:43.031677+0000","last_undegraded":"2023-07-14T11:18:43.031677+0000","last_fullsized":"2023-07-14T11:18:43.031677+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:16:41.903935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.035394+0000","last_change":"2023-07-14T11:18:43.030056+0000","last_active":"2023-07-14T11:18:43.035394+0000","last_peered":"2023-07-14T11:18:43.035394+0000","last_clean":"2023-07-14T11:18:43.035394+0000","last_became_active":"2023-07-14T11:18:43.029808+0000","last_became_peered":"2023-07-14T11:18:43.029808+0000","last_unstale":"2023-07-14T11:18:43.035394+0000","last_undegraded":"2023-07-14T11:18:43.035394+0000","last_fullsized":"2023-07-14T11:18:43.035394+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:43:54.282167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.045966+0000","last_change":"2023-07-14T11:18:43.033773+0000","last_active":"2023-07-14T11:18:43.045966+0000","last_peered":"2023-07-14T11:18:43.045966+0000","last_clean":"2023-07-14T11:18:43.045966+0000","last_became_active":"2023-07-14T11:18:43.033223+0000","last_became_peered":"2023-07-14T11:18:43.033223+0000","last_unstale":"2023-07-14T11:18:43.045966+0000","last_undegraded":"2023-07-14T11:18:43.045966+0000","last_fullsized":"2023-07-14T11:18:43.045966+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:51:11.397536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.038475+0000","last_change":"2023-07-14T11:18:43.031751+0000","last_active":"2023-07-14T11:18:43.038475+0000","last_peered":"2023-07-14T11:18:43.038475+0000","last_clean":"2023-07-14T11:18:43.038475+0000","last_became_active":"2023-07-14T11:18:43.031478+0000","last_became_peered":"2023-07-14T11:18:43.031478+0000","last_unstale":"2023-07-14T11:18:43.038475+0000","last_undegraded":"2023-07-14T11:18:43.038475+0000","last_fullsized":"2023-07-14T11:18:43.038475+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:05:56.328819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.027916+0000","last_change":"2023-07-14T11:18:43.016906+0000","last_active":"2023-07-14T11:18:43.027916+0000","last_peered":"2023-07-14T11:18:43.027916+0000","last_clean":"2023-07-14T11:18:43.027916+0000","last_became_active":"2023-07-14T11:18:43.016666+0000","last_became_peered":"2023-07-14T11:18:43.016666+0000","last_unstale":"2023-07-14T11:18:43.027916+0000","last_undegraded":"2023-07-14T11:18:43.027916+0000","last_fullsized":"2023-07-14T11:18:43.027916+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:09:08.761711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.033373+0000","last_change":"2023-07-14T11:18:43.028205+0000","last_active":"2023-07-14T11:18:43.033373+0000","last_peered":"2023-07-14T11:18:43.033373+0000","last_clean":"2023-07-14T11:18:43.033373+0000","last_became_active":"2023-07-14T11:18:43.027814+0000","last_became_peered":"2023-07-14T11:18:43.027814+0000","last_unstale":"2023-07-14T11:18:43.033373+0000","last_undegraded":"2023-07-14T11:18:43.033373+0000","last_fullsized":"2023-07-14T11:18:43.033373+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:21:36.615505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.039295+0000","last_change":"2023-07-14T11:18:43.030875+0000","last_active":"2023-07-14T11:18:43.039295+0000","last_peered":"2023-07-14T11:18:43.039295+0000","last_clean":"2023-07-14T11:18:43.039295+0000","last_became_active":"2023-07-14T11:18:43.030621+0000","last_became_peered":"2023-07-14T11:18:43.030621+0000","last_unstale":"2023-07-14T11:18:43.039295+0000","last_undegraded":"2023-07-14T11:18:43.039295+0000","last_fullsized":"2023-07-14T11:18:43.039295+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:08:57.353173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.048667+0000","last_change":"2023-07-14T11:18:43.047755+0000","last_active":"2023-07-14T11:18:43.048667+0000","last_peered":"2023-07-14T11:18:43.048667+0000","last_clean":"2023-07-14T11:18:43.048667+0000","last_became_active":"2023-07-14T11:18:43.047243+0000","last_became_peered":"2023-07-14T11:18:43.047243+0000","last_unstale":"2023-07-14T11:18:43.048667+0000","last_undegraded":"2023-07-14T11:18:43.048667+0000","last_fullsized":"2023-07-14T11:18:43.048667+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:28:49.185110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.040625+0000","last_change":"2023-07-14T11:18:43.032424+0000","last_active":"2023-07-14T11:18:43.040625+0000","last_peered":"2023-07-14T11:18:43.040625+0000","last_clean":"2023-07-14T11:18:43.040625+0000","last_became_active":"2023-07-14T11:18:43.032126+0000","last_became_peered":"2023-07-14T11:18:43.032126+0000","last_unstale":"2023-07-14T11:18:43.040625+0000","last_undegraded":"2023-07-14T11:18:43.040625+0000","last_fullsized":"2023-07-14T11:18:43.040625+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:54:28.114527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.025820+0000","last_change":"2023-07-14T11:18:43.016898+0000","last_active":"2023-07-14T11:18:43.025820+0000","last_peered":"2023-07-14T11:18:43.025820+0000","last_clean":"2023-07-14T11:18:43.025820+0000","last_became_active":"2023-07-14T11:18:43.016628+0000","last_became_peered":"2023-07-14T11:18:43.016628+0000","last_unstale":"2023-07-14T11:18:43.025820+0000","last_undegraded":"2023-07-14T11:18:43.025820+0000","last_fullsized":"2023-07-14T11:18:43.025820+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:18:38.847213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.043790+0000","last_change":"2023-07-14T11:18:43.042496+0000","last_active":"2023-07-14T11:18:43.043790+0000","last_peered":"2023-07-14T11:18:43.043790+0000","last_clean":"2023-07-14T11:18:43.043790+0000","last_became_active":"2023-07-14T11:18:43.042227+0000","last_became_peered":"2023-07-14T11:18:43.042227+0000","last_unstale":"2023-07-14T11:18:43.043790+0000","last_undegraded":"2023-07-14T11:18:43.043790+0000","last_fullsized":"2023-07-14T11:18:43.043790+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:46:39.315854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.039367+0000","last_change":"2023-07-14T11:18:43.029638+0000","last_active":"2023-07-14T11:18:43.039367+0000","last_peered":"2023-07-14T11:18:43.039367+0000","last_clean":"2023-07-14T11:18:43.039367+0000","last_became_active":"2023-07-14T11:18:43.029063+0000","last_became_peered":"2023-07-14T11:18:43.029063+0000","last_unstale":"2023-07-14T11:18:43.039367+0000","last_undegraded":"2023-07-14T11:18:43.039367+0000","last_fullsized":"2023-07-14T11:18:43.039367+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:13:16.696671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.046064+0000","last_change":"2023-07-14T11:18:43.040961+0000","last_active":"2023-07-14T11:18:43.046064+0000","last_peered":"2023-07-14T11:18:43.046064+0000","last_clean":"2023-07-14T11:18:43.046064+0000","last_became_active":"2023-07-14T11:18:43.040686+0000","last_became_peered":"2023-07-14T11:18:43.040686+0000","last_unstale":"2023-07-14T11:18:43.046064+0000","last_undegraded":"2023-07-14T11:18:43.046064+0000","last_fullsized":"2023-07-14T11:18:43.046064+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:41:46.974392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.046061+0000","last_change":"2023-07-14T11:18:43.033986+0000","last_active":"2023-07-14T11:18:43.046061+0000","last_peered":"2023-07-14T11:18:43.046061+0000","last_clean":"2023-07-14T11:18:43.046061+0000","last_became_active":"2023-07-14T11:18:43.033462+0000","last_became_peered":"2023-07-14T11:18:43.033462+0000","last_unstale":"2023-07-14T11:18:43.046061+0000","last_undegraded":"2023-07-14T11:18:43.046061+0000","last_fullsized":"2023-07-14T11:18:43.046061+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:53:08.739889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.040922+0000","last_change":"2023-07-14T11:18:43.033583+0000","last_active":"2023-07-14T11:18:43.040922+0000","last_peered":"2023-07-14T11:18:43.040922+0000","last_clean":"2023-07-14T11:18:43.040922+0000","last_became_active":"2023-07-14T11:18:43.033326+0000","last_became_peered":"2023-07-14T11:18:43.033326+0000","last_unstale":"2023-07-14T11:18:43.040922+0000","last_undegraded":"2023-07-14T11:18:43.040922+0000","last_fullsized":"2023-07-14T11:18:43.040922+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:17:32.499545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.041994+0000","last_change":"2023-07-14T11:18:43.036912+0000","last_active":"2023-07-14T11:18:43.041994+0000","last_peered":"2023-07-14T11:18:43.041994+0000","last_clean":"2023-07-14T11:18:43.041994+0000","last_became_active":"2023-07-14T11:18:43.036474+0000","last_became_peered":"2023-07-14T11:18:43.036474+0000","last_unstale":"2023-07-14T11:18:43.041994+0000","last_undegraded":"2023-07-14T11:18:43.041994+0000","last_fullsized":"2023-07-14T11:18:43.041994+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:41:22.845868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.031318+0000","last_change":"2023-07-14T11:18:43.026424+0000","last_active":"2023-07-14T11:18:43.031318+0000","last_peered":"2023-07-14T11:18:43.031318+0000","last_clean":"2023-07-14T11:18:43.031318+0000","last_became_active":"2023-07-14T11:18:43.026092+0000","last_became_peered":"2023-07-14T11:18:43.026092+0000","last_unstale":"2023-07-14T11:18:43.031318+0000","last_undegraded":"2023-07-14T11:18:43.031318+0000","last_fullsized":"2023-07-14T11:18:43.031318+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:14:13.100803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.035375+0000","last_change":"2023-07-14T11:18:43.029859+0000","last_active":"2023-07-14T11:18:43.035375+0000","last_peered":"2023-07-14T11:18:43.035375+0000","last_clean":"2023-07-14T11:18:43.035375+0000","last_became_active":"2023-07-14T11:18:43.028413+0000","last_became_peered":"2023-07-14T11:18:43.028413+0000","last_unstale":"2023-07-14T11:18:43.035375+0000","last_undegraded":"2023-07-14T11:18:43.035375+0000","last_fullsized":"2023-07-14T11:18:43.035375+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:01:54.137844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.042047+0000","last_change":"2023-07-14T11:18:43.037329+0000","last_active":"2023-07-14T11:18:43.042047+0000","last_peered":"2023-07-14T11:18:43.042047+0000","last_clean":"2023-07-14T11:18:43.042047+0000","last_became_active":"2023-07-14T11:18:43.037012+0000","last_became_peered":"2023-07-14T11:18:43.037012+0000","last_unstale":"2023-07-14T11:18:43.042047+0000","last_undegraded":"2023-07-14T11:18:43.042047+0000","last_fullsized":"2023-07-14T11:18:43.042047+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:29:43.329562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.039048+0000","last_change":"2023-07-14T11:18:43.033437+0000","last_active":"2023-07-14T11:18:43.039048+0000","last_peered":"2023-07-14T11:18:43.039048+0000","last_clean":"2023-07-14T11:18:43.039048+0000","last_became_active":"2023-07-14T11:18:43.033163+0000","last_became_peered":"2023-07-14T11:18:43.033163+0000","last_unstale":"2023-07-14T11:18:43.039048+0000","last_undegraded":"2023-07-14T11:18:43.039048+0000","last_fullsized":"2023-07-14T11:18:43.039048+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:15:18.458462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.038370+0000","last_change":"2023-07-14T11:18:43.028410+0000","last_active":"2023-07-14T11:18:43.038370+0000","last_peered":"2023-07-14T11:18:43.038370+0000","last_clean":"2023-07-14T11:18:43.038370+0000","last_became_active":"2023-07-14T11:18:43.028125+0000","last_became_peered":"2023-07-14T11:18:43.028125+0000","last_unstale":"2023-07-14T11:18:43.038370+0000","last_undegraded":"2023-07-14T11:18:43.038370+0000","last_fullsized":"2023-07-14T11:18:43.038370+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:31:20.897126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.033043+0000","last_change":"2023-07-14T11:18:43.029846+0000","last_active":"2023-07-14T11:18:43.033043+0000","last_peered":"2023-07-14T11:18:43.033043+0000","last_clean":"2023-07-14T11:18:43.033043+0000","last_became_active":"2023-07-14T11:18:43.028842+0000","last_became_peered":"2023-07-14T11:18:43.028842+0000","last_unstale":"2023-07-14T11:18:43.033043+0000","last_undegraded":"2023-07-14T11:18:43.033043+0000","last_fullsized":"2023-07-14T11:18:43.033043+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:13:07.574101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.043339+0000","last_change":"2023-07-14T11:18:43.041746+0000","last_active":"2023-07-14T11:18:43.043339+0000","last_peered":"2023-07-14T11:18:43.043339+0000","last_clean":"2023-07-14T11:18:43.043339+0000","last_became_active":"2023-07-14T11:18:43.041477+0000","last_became_peered":"2023-07-14T11:18:43.041477+0000","last_unstale":"2023-07-14T11:18:43.043339+0000","last_undegraded":"2023-07-14T11:18:43.043339+0000","last_fullsized":"2023-07-14T11:18:43.043339+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:12:43.438510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.027518+0000","last_change":"2023-07-14T11:18:43.026401+0000","last_active":"2023-07-14T11:18:43.027518+0000","last_peered":"2023-07-14T11:18:43.027518+0000","last_clean":"2023-07-14T11:18:43.027518+0000","last_became_active":"2023-07-14T11:18:43.026124+0000","last_became_peered":"2023-07-14T11:18:43.026124+0000","last_unstale":"2023-07-14T11:18:43.027518+0000","last_undegraded":"2023-07-14T11:18:43.027518+0000","last_fullsized":"2023-07-14T11:18:43.027518+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:15:37.009779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.039316+0000","last_change":"2023-07-14T11:18:43.030362+0000","last_active":"2023-07-14T11:18:43.039316+0000","last_peered":"2023-07-14T11:18:43.039316+0000","last_clean":"2023-07-14T11:18:43.039316+0000","last_became_active":"2023-07-14T11:18:43.029992+0000","last_became_peered":"2023-07-14T11:18:43.029992+0000","last_unstale":"2023-07-14T11:18:43.039316+0000","last_undegraded":"2023-07-14T11:18:43.039316+0000","last_fullsized":"2023-07-14T11:18:43.039316+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:42:24.975644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.038512+0000","last_change":"2023-07-14T11:18:43.029217+0000","last_active":"2023-07-14T11:18:43.038512+0000","last_peered":"2023-07-14T11:18:43.038512+0000","last_clean":"2023-07-14T11:18:43.038512+0000","last_became_active":"2023-07-14T11:18:43.028846+0000","last_became_peered":"2023-07-14T11:18:43.028846+0000","last_unstale":"2023-07-14T11:18:43.038512+0000","last_undegraded":"2023-07-14T11:18:43.038512+0000","last_fullsized":"2023-07-14T11:18:43.038512+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:19:43.397882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.030557+0000","last_change":"2023-07-14T11:18:43.024808+0000","last_active":"2023-07-14T11:18:43.030557+0000","last_peered":"2023-07-14T11:18:43.030557+0000","last_clean":"2023-07-14T11:18:43.030557+0000","last_became_active":"2023-07-14T11:18:43.024488+0000","last_became_peered":"2023-07-14T11:18:43.024488+0000","last_unstale":"2023-07-14T11:18:43.030557+0000","last_undegraded":"2023-07-14T11:18:43.030557+0000","last_fullsized":"2023-07-14T11:18:43.030557+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:20:35.310383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.035160+0000","last_change":"2023-07-14T11:18:43.031673+0000","last_active":"2023-07-14T11:18:43.035160+0000","last_peered":"2023-07-14T11:18:43.035160+0000","last_clean":"2023-07-14T11:18:43.035160+0000","last_became_active":"2023-07-14T11:18:43.031431+0000","last_became_peered":"2023-07-14T11:18:43.031431+0000","last_unstale":"2023-07-14T11:18:43.035160+0000","last_undegraded":"2023-07-14T11:18:43.035160+0000","last_fullsized":"2023-07-14T11:18:43.035160+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:14:13.100803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.046084+0000","last_change":"2023-07-14T11:18:43.041044+0000","last_active":"2023-07-14T11:18:43.046084+0000","last_peered":"2023-07-14T11:18:43.046084+0000","last_clean":"2023-07-14T11:18:43.046084+0000","last_became_active":"2023-07-14T11:18:43.040711+0000","last_became_peered":"2023-07-14T11:18:43.040711+0000","last_unstale":"2023-07-14T11:18:43.046084+0000","last_undegraded":"2023-07-14T11:18:43.046084+0000","last_fullsized":"2023-07-14T11:18:43.046084+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:05:02.296676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.046028+0000","last_change":"2023-07-14T11:18:43.035214+0000","last_active":"2023-07-14T11:18:43.046028+0000","last_peered":"2023-07-14T11:18:43.046028+0000","last_clean":"2023-07-14T11:18:43.046028+0000","last_became_active":"2023-07-14T11:18:43.034935+0000","last_became_peered":"2023-07-14T11:18:43.034935+0000","last_unstale":"2023-07-14T11:18:43.046028+0000","last_undegraded":"2023-07-14T11:18:43.046028+0000","last_fullsized":"2023-07-14T11:18:43.046028+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:35:43.196683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"87'4","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.048898+0000","last_change":"2023-07-14T11:18:42.034257+0000","last_active":"2023-07-14T11:18:43.048898+0000","last_peered":"2023-07-14T11:18:43.048898+0000","last_clean":"2023-07-14T11:18:43.048898+0000","last_became_active":"2023-07-14T11:18:42.033972+0000","last_became_peered":"2023-07-14T11:18:42.033972+0000","last_unstale":"2023-07-14T11:18:43.048898+0000","last_undegraded":"2023-07-14T11:18:43.048898+0000","last_fullsized":"2023-07-14T11:18:43.048898+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_clean_scrub_stamp":"2023-07-14T11:18:40.990355+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:07:19.224878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.046615+0000","last_change":"2023-07-14T11:18:43.045019+0000","last_active":"2023-07-14T11:18:43.046615+0000","last_peered":"2023-07-14T11:18:43.046615+0000","last_clean":"2023-07-14T11:18:43.046615+0000","last_became_active":"2023-07-14T11:18:43.043998+0000","last_became_peered":"2023-07-14T11:18:43.043998+0000","last_unstale":"2023-07-14T11:18:43.046615+0000","last_undegraded":"2023-07-14T11:18:43.046615+0000","last_fullsized":"2023-07-14T11:18:43.046615+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:26:02.886913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"87'1","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.041175+0000","last_change":"2023-07-14T11:18:42.026277+0000","last_active":"2023-07-14T11:18:43.041175+0000","last_peered":"2023-07-14T11:18:43.041175+0000","last_clean":"2023-07-14T11:18:43.041175+0000","last_became_active":"2023-07-14T11:18:42.025830+0000","last_became_peered":"2023-07-14T11:18:42.025830+0000","last_unstale":"2023-07-14T11:18:43.041175+0000","last_undegraded":"2023-07-14T11:18:43.041175+0000","last_fullsized":"2023-07-14T11:18:43.041175+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_clean_scrub_stamp":"2023-07-14T11:18:40.990355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:12:34.181491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.037523+0000","last_change":"2023-07-14T11:18:43.023792+0000","last_active":"2023-07-14T11:18:43.037523+0000","last_peered":"2023-07-14T11:18:43.037523+0000","last_clean":"2023-07-14T11:18:43.037523+0000","last_became_active":"2023-07-14T11:18:43.023460+0000","last_became_peered":"2023-07-14T11:18:43.023460+0000","last_unstale":"2023-07-14T11:18:43.037523+0000","last_undegraded":"2023-07-14T11:18:43.037523+0000","last_fullsized":"2023-07-14T11:18:43.037523+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:00:16.865829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"87'2","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.048654+0000","last_change":"2023-07-14T11:18:42.029561+0000","last_active":"2023-07-14T11:18:43.048654+0000","last_peered":"2023-07-14T11:18:43.048654+0000","last_clean":"2023-07-14T11:18:43.048654+0000","last_became_active":"2023-07-14T11:18:42.029031+0000","last_became_peered":"2023-07-14T11:18:42.029031+0000","last_unstale":"2023-07-14T11:18:43.048654+0000","last_undegraded":"2023-07-14T11:18:43.048654+0000","last_fullsized":"2023-07-14T11:18:43.048654+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_clean_scrub_stamp":"2023-07-14T11:18:40.990355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:56:06.067709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.046041+0000","last_change":"2023-07-14T11:18:43.033803+0000","last_active":"2023-07-14T11:18:43.046041+0000","last_peered":"2023-07-14T11:18:43.046041+0000","last_clean":"2023-07-14T11:18:43.046041+0000","last_became_active":"2023-07-14T11:18:43.033160+0000","last_became_peered":"2023-07-14T11:18:43.033160+0000","last_unstale":"2023-07-14T11:18:43.046041+0000","last_undegraded":"2023-07-14T11:18:43.046041+0000","last_fullsized":"2023-07-14T11:18:43.046041+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:05:53.448346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"87'2","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.045725+0000","last_change":"2023-07-14T11:18:42.031291+0000","last_active":"2023-07-14T11:18:43.045725+0000","last_peered":"2023-07-14T11:18:43.045725+0000","last_clean":"2023-07-14T11:18:43.045725+0000","last_became_active":"2023-07-14T11:18:42.030924+0000","last_became_peered":"2023-07-14T11:18:42.030924+0000","last_unstale":"2023-07-14T11:18:43.045725+0000","last_undegraded":"2023-07-14T11:18:43.045725+0000","last_fullsized":"2023-07-14T11:18:43.045725+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_clean_scrub_stamp":"2023-07-14T11:18:40.990355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:52:02.807374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.040073+0000","last_change":"2023-07-14T11:18:43.029203+0000","last_active":"2023-07-14T11:18:43.040073+0000","last_peered":"2023-07-14T11:18:43.040073+0000","last_clean":"2023-07-14T11:18:43.040073+0000","last_became_active":"2023-07-14T11:18:43.028548+0000","last_became_peered":"2023-07-14T11:18:43.028548+0000","last_unstale":"2023-07-14T11:18:43.040073+0000","last_undegraded":"2023-07-14T11:18:43.040073+0000","last_fullsized":"2023-07-14T11:18:43.040073+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:30:20.877390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"87'1","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.042797+0000","last_change":"2023-07-14T11:18:42.020254+0000","last_active":"2023-07-14T11:18:43.042797+0000","last_peered":"2023-07-14T11:18:43.042797+0000","last_clean":"2023-07-14T11:18:43.042797+0000","last_became_active":"2023-07-14T11:18:42.019960+0000","last_became_peered":"2023-07-14T11:18:42.019960+0000","last_unstale":"2023-07-14T11:18:43.042797+0000","last_undegraded":"2023-07-14T11:18:43.042797+0000","last_fullsized":"2023-07-14T11:18:43.042797+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_clean_scrub_stamp":"2023-07-14T11:18:40.990355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:36:07.683684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.041254+0000","last_change":"2023-07-14T11:18:43.038167+0000","last_active":"2023-07-14T11:18:43.041254+0000","last_peered":"2023-07-14T11:18:43.041254+0000","last_clean":"2023-07-14T11:18:43.041254+0000","last_became_active":"2023-07-14T11:18:43.037540+0000","last_became_peered":"2023-07-14T11:18:43.037540+0000","last_unstale":"2023-07-14T11:18:43.041254+0000","last_undegraded":"2023-07-14T11:18:43.041254+0000","last_fullsized":"2023-07-14T11:18:43.041254+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:25:20.161835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"87'1","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.045135+0000","last_change":"2023-07-14T11:18:42.023015+0000","last_active":"2023-07-14T11:18:43.045135+0000","last_peered":"2023-07-14T11:18:43.045135+0000","last_clean":"2023-07-14T11:18:43.045135+0000","last_became_active":"2023-07-14T11:18:42.022635+0000","last_became_peered":"2023-07-14T11:18:42.022635+0000","last_unstale":"2023-07-14T11:18:43.045135+0000","last_undegraded":"2023-07-14T11:18:43.045135+0000","last_fullsized":"2023-07-14T11:18:43.045135+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_clean_scrub_stamp":"2023-07-14T11:18:40.990355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:22:05.469374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.045986+0000","last_change":"2023-07-14T11:18:43.033984+0000","last_active":"2023-07-14T11:18:43.045986+0000","last_peered":"2023-07-14T11:18:43.045986+0000","last_clean":"2023-07-14T11:18:43.045986+0000","last_became_active":"2023-07-14T11:18:43.033514+0000","last_became_peered":"2023-07-14T11:18:43.033514+0000","last_unstale":"2023-07-14T11:18:43.045986+0000","last_undegraded":"2023-07-14T11:18:43.045986+0000","last_fullsized":"2023-07-14T11:18:43.045986+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:02:21.379663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.019803+0000","last_change":"2023-07-14T11:18:42.025986+0000","last_active":"2023-07-14T11:18:43.019803+0000","last_peered":"2023-07-14T11:18:43.019803+0000","last_clean":"2023-07-14T11:18:43.019803+0000","last_became_active":"2023-07-14T11:18:42.025720+0000","last_became_peered":"2023-07-14T11:18:42.025720+0000","last_unstale":"2023-07-14T11:18:43.019803+0000","last_undegraded":"2023-07-14T11:18:43.019803+0000","last_fullsized":"2023-07-14T11:18:43.019803+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_clean_scrub_stamp":"2023-07-14T11:18:40.990355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:15:25.389235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.031345+0000","last_change":"2023-07-14T11:18:43.027498+0000","last_active":"2023-07-14T11:18:43.031345+0000","last_peered":"2023-07-14T11:18:43.031345+0000","last_clean":"2023-07-14T11:18:43.031345+0000","last_became_active":"2023-07-14T11:18:43.027147+0000","last_became_peered":"2023-07-14T11:18:43.027147+0000","last_unstale":"2023-07-14T11:18:43.031345+0000","last_undegraded":"2023-07-14T11:18:43.031345+0000","last_fullsized":"2023-07-14T11:18:43.031345+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:50:18.079065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.011851+0000","last_change":"2023-07-14T11:18:42.033242+0000","last_active":"2023-07-14T11:18:43.011851+0000","last_peered":"2023-07-14T11:18:43.011851+0000","last_clean":"2023-07-14T11:18:43.011851+0000","last_became_active":"2023-07-14T11:18:42.032970+0000","last_became_peered":"2023-07-14T11:18:42.032970+0000","last_unstale":"2023-07-14T11:18:43.011851+0000","last_undegraded":"2023-07-14T11:18:43.011851+0000","last_fullsized":"2023-07-14T11:18:43.011851+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_clean_scrub_stamp":"2023-07-14T11:18:40.990355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:05:28.280291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.041957+0000","last_change":"2023-07-14T11:18:43.037313+0000","last_active":"2023-07-14T11:18:43.041957+0000","last_peered":"2023-07-14T11:18:43.041957+0000","last_clean":"2023-07-14T11:18:43.041957+0000","last_became_active":"2023-07-14T11:18:43.036843+0000","last_became_peered":"2023-07-14T11:18:43.036843+0000","last_unstale":"2023-07-14T11:18:43.041957+0000","last_undegraded":"2023-07-14T11:18:43.041957+0000","last_fullsized":"2023-07-14T11:18:43.041957+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:22:52.186347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.019202+0000","last_change":"2023-07-14T11:18:42.024420+0000","last_active":"2023-07-14T11:18:43.019202+0000","last_peered":"2023-07-14T11:18:43.019202+0000","last_clean":"2023-07-14T11:18:43.019202+0000","last_became_active":"2023-07-14T11:18:42.024127+0000","last_became_peered":"2023-07-14T11:18:42.024127+0000","last_unstale":"2023-07-14T11:18:43.019202+0000","last_undegraded":"2023-07-14T11:18:43.019202+0000","last_fullsized":"2023-07-14T11:18:43.019202+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_clean_scrub_stamp":"2023-07-14T11:18:40.990355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:57:38.764509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.038600+0000","last_change":"2023-07-14T11:18:43.034355+0000","last_active":"2023-07-14T11:18:43.038600+0000","last_peered":"2023-07-14T11:18:43.038600+0000","last_clean":"2023-07-14T11:18:43.038600+0000","last_became_active":"2023-07-14T11:18:43.034018+0000","last_became_peered":"2023-07-14T11:18:43.034018+0000","last_unstale":"2023-07-14T11:18:43.038600+0000","last_undegraded":"2023-07-14T11:18:43.038600+0000","last_fullsized":"2023-07-14T11:18:43.038600+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:47:28.319111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.020844+0000","last_change":"2023-07-14T11:18:42.023101+0000","last_active":"2023-07-14T11:18:43.020844+0000","last_peered":"2023-07-14T11:18:43.020844+0000","last_clean":"2023-07-14T11:18:43.020844+0000","last_became_active":"2023-07-14T11:18:42.022832+0000","last_became_peered":"2023-07-14T11:18:42.022832+0000","last_unstale":"2023-07-14T11:18:43.020844+0000","last_undegraded":"2023-07-14T11:18:43.020844+0000","last_fullsized":"2023-07-14T11:18:43.020844+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_clean_scrub_stamp":"2023-07-14T11:18:40.990355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:55:15.610726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.053356+0000","last_change":"2023-07-14T11:18:43.049141+0000","last_active":"2023-07-14T11:18:43.053356+0000","last_peered":"2023-07-14T11:18:43.053356+0000","last_clean":"2023-07-14T11:18:43.053356+0000","last_became_active":"2023-07-14T11:18:43.048851+0000","last_became_peered":"2023-07-14T11:18:43.048851+0000","last_unstale":"2023-07-14T11:18:43.053356+0000","last_undegraded":"2023-07-14T11:18:43.053356+0000","last_fullsized":"2023-07-14T11:18:43.053356+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:48:50.222244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"87'3","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.047575+0000","last_change":"2023-07-14T11:18:42.034511+0000","last_active":"2023-07-14T11:18:43.047575+0000","last_peered":"2023-07-14T11:18:43.047575+0000","last_clean":"2023-07-14T11:18:43.047575+0000","last_became_active":"2023-07-14T11:18:42.034119+0000","last_became_peered":"2023-07-14T11:18:42.034119+0000","last_unstale":"2023-07-14T11:18:43.047575+0000","last_undegraded":"2023-07-14T11:18:43.047575+0000","last_fullsized":"2023-07-14T11:18:43.047575+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_clean_scrub_stamp":"2023-07-14T11:18:40.990355+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:53:18.078136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.030348+0000","last_change":"2023-07-14T11:18:43.024452+0000","last_active":"2023-07-14T11:18:43.030348+0000","last_peered":"2023-07-14T11:18:43.030348+0000","last_clean":"2023-07-14T11:18:43.030348+0000","last_became_active":"2023-07-14T11:18:43.024183+0000","last_became_peered":"2023-07-14T11:18:43.024183+0000","last_unstale":"2023-07-14T11:18:43.030348+0000","last_undegraded":"2023-07-14T11:18:43.030348+0000","last_fullsized":"2023-07-14T11:18:43.030348+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:08:57.641193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"87'6","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.053325+0000","last_change":"2023-07-14T11:18:42.030263+0000","last_active":"2023-07-14T11:18:43.053325+0000","last_peered":"2023-07-14T11:18:43.053325+0000","last_clean":"2023-07-14T11:18:43.053325+0000","last_became_active":"2023-07-14T11:18:42.029995+0000","last_became_peered":"2023-07-14T11:18:42.029995+0000","last_unstale":"2023-07-14T11:18:43.053325+0000","last_undegraded":"2023-07-14T11:18:43.053325+0000","last_fullsized":"2023-07-14T11:18:43.053325+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_clean_scrub_stamp":"2023-07-14T11:18:40.990355+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:51:29.602053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.040053+0000","last_change":"2023-07-14T11:18:43.028862+0000","last_active":"2023-07-14T11:18:43.040053+0000","last_peered":"2023-07-14T11:18:43.040053+0000","last_clean":"2023-07-14T11:18:43.040053+0000","last_became_active":"2023-07-14T11:18:43.028116+0000","last_became_peered":"2023-07-14T11:18:43.028116+0000","last_unstale":"2023-07-14T11:18:43.040053+0000","last_undegraded":"2023-07-14T11:18:43.040053+0000","last_fullsized":"2023-07-14T11:18:43.040053+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:13:07.574101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"87'2","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.047758+0000","last_change":"2023-07-14T11:18:42.033604+0000","last_active":"2023-07-14T11:18:43.047758+0000","last_peered":"2023-07-14T11:18:43.047758+0000","last_clean":"2023-07-14T11:18:43.047758+0000","last_became_active":"2023-07-14T11:18:42.033336+0000","last_became_peered":"2023-07-14T11:18:42.033336+0000","last_unstale":"2023-07-14T11:18:43.047758+0000","last_undegraded":"2023-07-14T11:18:43.047758+0000","last_fullsized":"2023-07-14T11:18:43.047758+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_clean_scrub_stamp":"2023-07-14T11:18:40.990355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:15:25.859448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.035589+0000","last_change":"2023-07-14T11:18:43.029184+0000","last_active":"2023-07-14T11:18:43.035589+0000","last_peered":"2023-07-14T11:18:43.035589+0000","last_clean":"2023-07-14T11:18:43.035589+0000","last_became_active":"2023-07-14T11:18:43.028892+0000","last_became_peered":"2023-07-14T11:18:43.028892+0000","last_unstale":"2023-07-14T11:18:43.035589+0000","last_undegraded":"2023-07-14T11:18:43.035589+0000","last_fullsized":"2023-07-14T11:18:43.035589+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:56:00.496099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.020815+0000","last_change":"2023-07-14T11:18:42.032058+0000","last_active":"2023-07-14T11:18:43.020815+0000","last_peered":"2023-07-14T11:18:43.020815+0000","last_clean":"2023-07-14T11:18:43.020815+0000","last_became_active":"2023-07-14T11:18:42.031778+0000","last_became_peered":"2023-07-14T11:18:42.031778+0000","last_unstale":"2023-07-14T11:18:43.020815+0000","last_undegraded":"2023-07-14T11:18:43.020815+0000","last_fullsized":"2023-07-14T11:18:43.020815+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_clean_scrub_stamp":"2023-07-14T11:18:40.990355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:39:14.626782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.026653+0000","last_change":"2023-07-14T11:18:43.019011+0000","last_active":"2023-07-14T11:18:43.026653+0000","last_peered":"2023-07-14T11:18:43.026653+0000","last_clean":"2023-07-14T11:18:43.026653+0000","last_became_active":"2023-07-14T11:18:43.018701+0000","last_became_peered":"2023-07-14T11:18:43.018701+0000","last_unstale":"2023-07-14T11:18:43.026653+0000","last_undegraded":"2023-07-14T11:18:43.026653+0000","last_fullsized":"2023-07-14T11:18:43.026653+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:51:36.888776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.011828+0000","last_change":"2023-07-14T11:18:42.025904+0000","last_active":"2023-07-14T11:18:43.011828+0000","last_peered":"2023-07-14T11:18:43.011828+0000","last_clean":"2023-07-14T11:18:43.011828+0000","last_became_active":"2023-07-14T11:18:42.025512+0000","last_became_peered":"2023-07-14T11:18:42.025512+0000","last_unstale":"2023-07-14T11:18:43.011828+0000","last_undegraded":"2023-07-14T11:18:43.011828+0000","last_fullsized":"2023-07-14T11:18:43.011828+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_clean_scrub_stamp":"2023-07-14T11:18:40.990355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:27:40.360663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.041009+0000","last_change":"2023-07-14T11:18:43.031424+0000","last_active":"2023-07-14T11:18:43.041009+0000","last_peered":"2023-07-14T11:18:43.041009+0000","last_clean":"2023-07-14T11:18:43.041009+0000","last_became_active":"2023-07-14T11:18:43.031169+0000","last_became_peered":"2023-07-14T11:18:43.031169+0000","last_unstale":"2023-07-14T11:18:43.041009+0000","last_undegraded":"2023-07-14T11:18:43.041009+0000","last_fullsized":"2023-07-14T11:18:43.041009+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:24:12.369696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"87'8","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.050242+0000","last_change":"2023-07-14T11:18:42.023239+0000","last_active":"2023-07-14T11:18:43.050242+0000","last_peered":"2023-07-14T11:18:43.050242+0000","last_clean":"2023-07-14T11:18:43.050242+0000","last_became_active":"2023-07-14T11:18:42.022292+0000","last_became_peered":"2023-07-14T11:18:42.022292+0000","last_unstale":"2023-07-14T11:18:43.050242+0000","last_undegraded":"2023-07-14T11:18:43.050242+0000","last_fullsized":"2023-07-14T11:18:43.050242+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_clean_scrub_stamp":"2023-07-14T11:18:40.990355+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:27:31.894674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.039799+0000","last_change":"2023-07-14T11:18:43.028000+0000","last_active":"2023-07-14T11:18:43.039799+0000","last_peered":"2023-07-14T11:18:43.039799+0000","last_clean":"2023-07-14T11:18:43.039799+0000","last_became_active":"2023-07-14T11:18:43.027666+0000","last_became_peered":"2023-07-14T11:18:43.027666+0000","last_unstale":"2023-07-14T11:18:43.039799+0000","last_undegraded":"2023-07-14T11:18:43.039799+0000","last_fullsized":"2023-07-14T11:18:43.039799+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:21:25.267325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"87'2","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.044532+0000","last_change":"2023-07-14T11:18:42.028778+0000","last_active":"2023-07-14T11:18:43.044532+0000","last_peered":"2023-07-14T11:18:43.044532+0000","last_clean":"2023-07-14T11:18:43.044532+0000","last_became_active":"2023-07-14T11:18:42.028426+0000","last_became_peered":"2023-07-14T11:18:42.028426+0000","last_unstale":"2023-07-14T11:18:43.044532+0000","last_undegraded":"2023-07-14T11:18:43.044532+0000","last_fullsized":"2023-07-14T11:18:43.044532+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_clean_scrub_stamp":"2023-07-14T11:18:40.990355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:50:05.349740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.046597+0000","last_change":"2023-07-14T11:18:43.044035+0000","last_active":"2023-07-14T11:18:43.046597+0000","last_peered":"2023-07-14T11:18:43.046597+0000","last_clean":"2023-07-14T11:18:43.046597+0000","last_became_active":"2023-07-14T11:18:43.043719+0000","last_became_peered":"2023-07-14T11:18:43.043719+0000","last_unstale":"2023-07-14T11:18:43.046597+0000","last_undegraded":"2023-07-14T11:18:43.046597+0000","last_fullsized":"2023-07-14T11:18:43.046597+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:48:15.008090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.024134+0000","last_change":"2023-07-14T11:18:42.022576+0000","last_active":"2023-07-14T11:18:43.024134+0000","last_peered":"2023-07-14T11:18:43.024134+0000","last_clean":"2023-07-14T11:18:43.024134+0000","last_became_active":"2023-07-14T11:18:42.022259+0000","last_became_peered":"2023-07-14T11:18:42.022259+0000","last_unstale":"2023-07-14T11:18:43.024134+0000","last_undegraded":"2023-07-14T11:18:43.024134+0000","last_fullsized":"2023-07-14T11:18:43.024134+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_clean_scrub_stamp":"2023-07-14T11:18:40.990355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:21:27.277609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.046300+0000","last_change":"2023-07-14T11:18:43.043783+0000","last_active":"2023-07-14T11:18:43.046300+0000","last_peered":"2023-07-14T11:18:43.046300+0000","last_clean":"2023-07-14T11:18:43.046300+0000","last_became_active":"2023-07-14T11:18:43.043411+0000","last_became_peered":"2023-07-14T11:18:43.043411+0000","last_unstale":"2023-07-14T11:18:43.046300+0000","last_undegraded":"2023-07-14T11:18:43.046300+0000","last_fullsized":"2023-07-14T11:18:43.046300+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:39:14.676081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.024477+0000","last_change":"2023-07-14T11:18:42.032169+0000","last_active":"2023-07-14T11:18:43.024477+0000","last_peered":"2023-07-14T11:18:43.024477+0000","last_clean":"2023-07-14T11:18:43.024477+0000","last_became_active":"2023-07-14T11:18:42.031800+0000","last_became_peered":"2023-07-14T11:18:42.031800+0000","last_unstale":"2023-07-14T11:18:43.024477+0000","last_undegraded":"2023-07-14T11:18:43.024477+0000","last_fullsized":"2023-07-14T11:18:43.024477+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_clean_scrub_stamp":"2023-07-14T11:18:40.990355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:55:26.346445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.033061+0000","last_change":"2023-07-14T11:18:43.030047+0000","last_active":"2023-07-14T11:18:43.033061+0000","last_peered":"2023-07-14T11:18:43.033061+0000","last_clean":"2023-07-14T11:18:43.033061+0000","last_became_active":"2023-07-14T11:18:43.029388+0000","last_became_peered":"2023-07-14T11:18:43.029388+0000","last_unstale":"2023-07-14T11:18:43.033061+0000","last_undegraded":"2023-07-14T11:18:43.033061+0000","last_fullsized":"2023-07-14T11:18:43.033061+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:09:08.761711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.018352+0000","last_change":"2023-07-14T11:18:42.025412+0000","last_active":"2023-07-14T11:18:43.018352+0000","last_peered":"2023-07-14T11:18:43.018352+0000","last_clean":"2023-07-14T11:18:43.018352+0000","last_became_active":"2023-07-14T11:18:42.025060+0000","last_became_peered":"2023-07-14T11:18:42.025060+0000","last_unstale":"2023-07-14T11:18:43.018352+0000","last_undegraded":"2023-07-14T11:18:43.018352+0000","last_fullsized":"2023-07-14T11:18:43.018352+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_clean_scrub_stamp":"2023-07-14T11:18:40.990355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:52:32.381129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.041160+0000","last_change":"2023-07-14T11:18:43.037751+0000","last_active":"2023-07-14T11:18:43.041160+0000","last_peered":"2023-07-14T11:18:43.041160+0000","last_clean":"2023-07-14T11:18:43.041160+0000","last_became_active":"2023-07-14T11:18:43.037476+0000","last_became_peered":"2023-07-14T11:18:43.037476+0000","last_unstale":"2023-07-14T11:18:43.041160+0000","last_undegraded":"2023-07-14T11:18:43.041160+0000","last_fullsized":"2023-07-14T11:18:43.041160+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:58:43.599776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.022890+0000","last_change":"2023-07-14T11:18:42.032462+0000","last_active":"2023-07-14T11:18:43.022890+0000","last_peered":"2023-07-14T11:18:43.022890+0000","last_clean":"2023-07-14T11:18:43.022890+0000","last_became_active":"2023-07-14T11:18:42.032191+0000","last_became_peered":"2023-07-14T11:18:42.032191+0000","last_unstale":"2023-07-14T11:18:43.022890+0000","last_undegraded":"2023-07-14T11:18:43.022890+0000","last_fullsized":"2023-07-14T11:18:43.022890+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_clean_scrub_stamp":"2023-07-14T11:18:40.990355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:40:23.166911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.040063+0000","last_change":"2023-07-14T11:18:43.032919+0000","last_active":"2023-07-14T11:18:43.040063+0000","last_peered":"2023-07-14T11:18:43.040063+0000","last_clean":"2023-07-14T11:18:43.040063+0000","last_became_active":"2023-07-14T11:18:43.032588+0000","last_became_peered":"2023-07-14T11:18:43.032588+0000","last_unstale":"2023-07-14T11:18:43.040063+0000","last_undegraded":"2023-07-14T11:18:43.040063+0000","last_fullsized":"2023-07-14T11:18:43.040063+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:01:29.635020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.017641+0000","last_change":"2023-07-14T11:18:42.030094+0000","last_active":"2023-07-14T11:18:43.017641+0000","last_peered":"2023-07-14T11:18:43.017641+0000","last_clean":"2023-07-14T11:18:43.017641+0000","last_became_active":"2023-07-14T11:18:42.029816+0000","last_became_peered":"2023-07-14T11:18:42.029816+0000","last_unstale":"2023-07-14T11:18:43.017641+0000","last_undegraded":"2023-07-14T11:18:43.017641+0000","last_fullsized":"2023-07-14T11:18:43.017641+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_clean_scrub_stamp":"2023-07-14T11:18:40.990355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:50:17.071887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.038886+0000","last_change":"2023-07-14T11:18:43.033458+0000","last_active":"2023-07-14T11:18:43.038886+0000","last_peered":"2023-07-14T11:18:43.038886+0000","last_clean":"2023-07-14T11:18:43.038886+0000","last_became_active":"2023-07-14T11:18:43.033109+0000","last_became_peered":"2023-07-14T11:18:43.033109+0000","last_unstale":"2023-07-14T11:18:43.038886+0000","last_undegraded":"2023-07-14T11:18:43.038886+0000","last_fullsized":"2023-07-14T11:18:43.038886+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:49:53.538726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.018390+0000","last_change":"2023-07-14T11:18:42.023835+0000","last_active":"2023-07-14T11:18:43.018390+0000","last_peered":"2023-07-14T11:18:43.018390+0000","last_clean":"2023-07-14T11:18:43.018390+0000","last_became_active":"2023-07-14T11:18:42.023526+0000","last_became_peered":"2023-07-14T11:18:42.023526+0000","last_unstale":"2023-07-14T11:18:43.018390+0000","last_undegraded":"2023-07-14T11:18:43.018390+0000","last_fullsized":"2023-07-14T11:18:43.018390+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_clean_scrub_stamp":"2023-07-14T11:18:40.990355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:31:19.889949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.046162+0000","last_change":"2023-07-14T11:18:43.042676+0000","last_active":"2023-07-14T11:18:43.046162+0000","last_peered":"2023-07-14T11:18:43.046162+0000","last_clean":"2023-07-14T11:18:43.046162+0000","last_became_active":"2023-07-14T11:18:43.042409+0000","last_became_peered":"2023-07-14T11:18:43.042409+0000","last_unstale":"2023-07-14T11:18:43.046162+0000","last_undegraded":"2023-07-14T11:18:43.046162+0000","last_fullsized":"2023-07-14T11:18:43.046162+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:13:07.024735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.011850+0000","last_change":"2023-07-14T11:18:42.030312+0000","last_active":"2023-07-14T11:18:43.011850+0000","last_peered":"2023-07-14T11:18:43.011850+0000","last_clean":"2023-07-14T11:18:43.011850+0000","last_became_active":"2023-07-14T11:18:42.029972+0000","last_became_peered":"2023-07-14T11:18:42.029972+0000","last_unstale":"2023-07-14T11:18:43.011850+0000","last_undegraded":"2023-07-14T11:18:43.011850+0000","last_fullsized":"2023-07-14T11:18:43.011850+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_clean_scrub_stamp":"2023-07-14T11:18:40.990355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:12:30.717522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.046180+0000","last_change":"2023-07-14T11:18:43.043479+0000","last_active":"2023-07-14T11:18:43.046180+0000","last_peered":"2023-07-14T11:18:43.046180+0000","last_clean":"2023-07-14T11:18:43.046180+0000","last_became_active":"2023-07-14T11:18:43.043207+0000","last_became_peered":"2023-07-14T11:18:43.043207+0000","last_unstale":"2023-07-14T11:18:43.046180+0000","last_undegraded":"2023-07-14T11:18:43.046180+0000","last_fullsized":"2023-07-14T11:18:43.046180+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:55:54.662222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.015060+0000","last_change":"2023-07-14T11:18:42.026780+0000","last_active":"2023-07-14T11:18:43.015060+0000","last_peered":"2023-07-14T11:18:43.015060+0000","last_clean":"2023-07-14T11:18:43.015060+0000","last_became_active":"2023-07-14T11:18:42.026460+0000","last_became_peered":"2023-07-14T11:18:42.026460+0000","last_unstale":"2023-07-14T11:18:43.015060+0000","last_undegraded":"2023-07-14T11:18:43.015060+0000","last_fullsized":"2023-07-14T11:18:43.015060+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_clean_scrub_stamp":"2023-07-14T11:18:40.990355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:27:49.009555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":133,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.017998+0000","last_change":"2023-07-14T11:13:08.762084+0000","last_active":"2023-07-14T11:18:43.017998+0000","last_peered":"2023-07-14T11:18:43.017998+0000","last_clean":"2023-07-14T11:18:43.017998+0000","last_became_active":"2023-07-14T11:13:08.761763+0000","last_became_peered":"2023-07-14T11:13:08.761763+0000","last_unstale":"2023-07-14T11:18:43.017998+0000","last_undegraded":"2023-07-14T11:18:43.017998+0000","last_fullsized":"2023-07-14T11:18:43.017998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:36:23.065011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.037004+0000","last_change":"2023-07-14T11:18:43.032542+0000","last_active":"2023-07-14T11:18:43.037004+0000","last_peered":"2023-07-14T11:18:43.037004+0000","last_clean":"2023-07-14T11:18:43.037004+0000","last_became_active":"2023-07-14T11:18:43.032249+0000","last_became_peered":"2023-07-14T11:18:43.032249+0000","last_unstale":"2023-07-14T11:18:43.037004+0000","last_undegraded":"2023-07-14T11:18:43.037004+0000","last_fullsized":"2023-07-14T11:18:43.037004+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:16:41.903935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.017766+0000","last_change":"2023-07-14T11:18:42.031228+0000","last_active":"2023-07-14T11:18:43.017766+0000","last_peered":"2023-07-14T11:18:43.017766+0000","last_clean":"2023-07-14T11:18:43.017766+0000","last_became_active":"2023-07-14T11:18:42.030942+0000","last_became_peered":"2023-07-14T11:18:42.030942+0000","last_unstale":"2023-07-14T11:18:43.017766+0000","last_undegraded":"2023-07-14T11:18:43.017766+0000","last_fullsized":"2023-07-14T11:18:43.017766+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_clean_scrub_stamp":"2023-07-14T11:18:40.990355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:27:40.360663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":149,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.010824+0000","last_change":"2023-07-14T11:13:08.761726+0000","last_active":"2023-07-14T11:18:43.010824+0000","last_peered":"2023-07-14T11:18:43.010824+0000","last_clean":"2023-07-14T11:18:43.010824+0000","last_became_active":"2023-07-14T11:13:08.761365+0000","last_became_peered":"2023-07-14T11:13:08.761365+0000","last_unstale":"2023-07-14T11:18:43.010824+0000","last_undegraded":"2023-07-14T11:18:43.010824+0000","last_fullsized":"2023-07-14T11:18:43.010824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:31:52.972429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.033007+0000","last_change":"2023-07-14T11:18:43.029225+0000","last_active":"2023-07-14T11:18:43.033007+0000","last_peered":"2023-07-14T11:18:43.033007+0000","last_clean":"2023-07-14T11:18:43.033007+0000","last_became_active":"2023-07-14T11:18:43.028948+0000","last_became_peered":"2023-07-14T11:18:43.028948+0000","last_unstale":"2023-07-14T11:18:43.033007+0000","last_undegraded":"2023-07-14T11:18:43.033007+0000","last_fullsized":"2023-07-14T11:18:43.033007+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:30:20.877390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.014835+0000","last_change":"2023-07-14T11:18:42.024189+0000","last_active":"2023-07-14T11:18:43.014835+0000","last_peered":"2023-07-14T11:18:43.014835+0000","last_clean":"2023-07-14T11:18:43.014835+0000","last_became_active":"2023-07-14T11:18:42.023872+0000","last_became_peered":"2023-07-14T11:18:42.023872+0000","last_unstale":"2023-07-14T11:18:43.014835+0000","last_undegraded":"2023-07-14T11:18:43.014835+0000","last_fullsized":"2023-07-14T11:18:43.014835+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_clean_scrub_stamp":"2023-07-14T11:18:40.990355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:03:08.555415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":123,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.012890+0000","last_change":"2023-07-14T11:13:08.923899+0000","last_active":"2023-07-14T11:18:43.012890+0000","last_peered":"2023-07-14T11:18:43.012890+0000","last_clean":"2023-07-14T11:18:43.012890+0000","last_became_active":"2023-07-14T11:13:08.923513+0000","last_became_peered":"2023-07-14T11:13:08.923513+0000","last_unstale":"2023-07-14T11:18:43.012890+0000","last_undegraded":"2023-07-14T11:18:43.012890+0000","last_fullsized":"2023-07-14T11:18:43.012890+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:28:41.442376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.046263+0000","last_change":"2023-07-14T11:18:43.043369+0000","last_active":"2023-07-14T11:18:43.046263+0000","last_peered":"2023-07-14T11:18:43.046263+0000","last_clean":"2023-07-14T11:18:43.046263+0000","last_became_active":"2023-07-14T11:18:43.043096+0000","last_became_peered":"2023-07-14T11:18:43.043096+0000","last_unstale":"2023-07-14T11:18:43.046263+0000","last_undegraded":"2023-07-14T11:18:43.046263+0000","last_fullsized":"2023-07-14T11:18:43.046263+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:17:41.196270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"87'1","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.044776+0000","last_change":"2023-07-14T11:18:42.028359+0000","last_active":"2023-07-14T11:18:43.044776+0000","last_peered":"2023-07-14T11:18:43.044776+0000","last_clean":"2023-07-14T11:18:43.044776+0000","last_became_active":"2023-07-14T11:18:42.027788+0000","last_became_peered":"2023-07-14T11:18:42.027788+0000","last_unstale":"2023-07-14T11:18:43.044776+0000","last_undegraded":"2023-07-14T11:18:43.044776+0000","last_fullsized":"2023-07-14T11:18:43.044776+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_clean_scrub_stamp":"2023-07-14T11:18:40.990355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:06:45.226799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":123,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.013060+0000","last_change":"2023-07-14T11:13:08.760609+0000","last_active":"2023-07-14T11:18:43.013060+0000","last_peered":"2023-07-14T11:18:43.013060+0000","last_clean":"2023-07-14T11:18:43.013060+0000","last_became_active":"2023-07-14T11:13:08.760285+0000","last_became_peered":"2023-07-14T11:13:08.760285+0000","last_unstale":"2023-07-14T11:18:43.013060+0000","last_undegraded":"2023-07-14T11:18:43.013060+0000","last_fullsized":"2023-07-14T11:18:43.013060+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:18:35.419982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.041332+0000","last_change":"2023-07-14T11:18:43.032476+0000","last_active":"2023-07-14T11:18:43.041332+0000","last_peered":"2023-07-14T11:18:43.041332+0000","last_clean":"2023-07-14T11:18:43.041332+0000","last_became_active":"2023-07-14T11:18:43.032161+0000","last_became_peered":"2023-07-14T11:18:43.032161+0000","last_unstale":"2023-07-14T11:18:43.041332+0000","last_undegraded":"2023-07-14T11:18:43.041332+0000","last_fullsized":"2023-07-14T11:18:43.041332+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:06:52.742219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.012199+0000","last_change":"2023-07-14T11:18:42.020267+0000","last_active":"2023-07-14T11:18:43.012199+0000","last_peered":"2023-07-14T11:18:43.012199+0000","last_clean":"2023-07-14T11:18:43.012199+0000","last_became_active":"2023-07-14T11:18:42.019957+0000","last_became_peered":"2023-07-14T11:18:42.019957+0000","last_unstale":"2023-07-14T11:18:43.012199+0000","last_undegraded":"2023-07-14T11:18:43.012199+0000","last_fullsized":"2023-07-14T11:18:43.012199+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_clean_scrub_stamp":"2023-07-14T11:18:40.990355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:00:27.837182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"76'128","reported_seq":318,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.013174+0000","last_change":"2023-07-14T11:13:01.370649+0000","last_active":"2023-07-14T11:18:43.013174+0000","last_peered":"2023-07-14T11:18:43.013174+0000","last_clean":"2023-07-14T11:18:43.013174+0000","last_became_active":"2023-07-14T11:13:01.369478+0000","last_became_peered":"2023-07-14T11:13:01.369478+0000","last_unstale":"2023-07-14T11:18:43.013174+0000","last_undegraded":"2023-07-14T11:18:43.013174+0000","last_fullsized":"2023-07-14T11:18:43.013174+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:00.254800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:00.254800+0000","last_clean_scrub_stamp":"2023-07-14T11:13:00.254800+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:50:18.194529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":135,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.016830+0000","last_change":"2023-07-14T11:13:08.757882+0000","last_active":"2023-07-14T11:18:43.016830+0000","last_peered":"2023-07-14T11:18:43.016830+0000","last_clean":"2023-07-14T11:18:43.016830+0000","last_became_active":"2023-07-14T11:13:08.757541+0000","last_became_peered":"2023-07-14T11:13:08.757541+0000","last_unstale":"2023-07-14T11:18:43.016830+0000","last_undegraded":"2023-07-14T11:18:43.016830+0000","last_fullsized":"2023-07-14T11:18:43.016830+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:03:23.386388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.035959+0000","last_change":"2023-07-14T11:18:43.025581+0000","last_active":"2023-07-14T11:18:43.035959+0000","last_peered":"2023-07-14T11:18:43.035959+0000","last_clean":"2023-07-14T11:18:43.035959+0000","last_became_active":"2023-07-14T11:18:43.025228+0000","last_became_peered":"2023-07-14T11:18:43.025228+0000","last_unstale":"2023-07-14T11:18:43.035959+0000","last_undegraded":"2023-07-14T11:18:43.035959+0000","last_fullsized":"2023-07-14T11:18:43.035959+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:03:59.946702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"87'2","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.044425+0000","last_change":"2023-07-14T11:18:42.031822+0000","last_active":"2023-07-14T11:18:43.044425+0000","last_peered":"2023-07-14T11:18:43.044425+0000","last_clean":"2023-07-14T11:18:43.044425+0000","last_became_active":"2023-07-14T11:18:42.031449+0000","last_became_peered":"2023-07-14T11:18:42.031449+0000","last_unstale":"2023-07-14T11:18:43.044425+0000","last_undegraded":"2023-07-14T11:18:43.044425+0000","last_fullsized":"2023-07-14T11:18:43.044425+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_clean_scrub_stamp":"2023-07-14T11:18:40.990355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:41:06.955653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":141,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.014987+0000","last_change":"2023-07-14T11:13:08.862331+0000","last_active":"2023-07-14T11:18:43.014987+0000","last_peered":"2023-07-14T11:18:43.014987+0000","last_clean":"2023-07-14T11:18:43.014987+0000","last_became_active":"2023-07-14T11:13:08.861817+0000","last_became_peered":"2023-07-14T11:13:08.861817+0000","last_unstale":"2023-07-14T11:18:43.014987+0000","last_undegraded":"2023-07-14T11:18:43.014987+0000","last_fullsized":"2023-07-14T11:18:43.014987+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:45:56.431738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.042671+0000","last_change":"2023-07-14T11:18:43.040711+0000","last_active":"2023-07-14T11:18:43.042671+0000","last_peered":"2023-07-14T11:18:43.042671+0000","last_clean":"2023-07-14T11:18:43.042671+0000","last_became_active":"2023-07-14T11:18:43.040346+0000","last_became_peered":"2023-07-14T11:18:43.040346+0000","last_unstale":"2023-07-14T11:18:43.042671+0000","last_undegraded":"2023-07-14T11:18:43.042671+0000","last_fullsized":"2023-07-14T11:18:43.042671+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:57:21.782419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"87'1","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.045463+0000","last_change":"2023-07-14T11:18:42.021394+0000","last_active":"2023-07-14T11:18:43.045463+0000","last_peered":"2023-07-14T11:18:43.045463+0000","last_clean":"2023-07-14T11:18:43.045463+0000","last_became_active":"2023-07-14T11:18:42.021128+0000","last_became_peered":"2023-07-14T11:18:42.021128+0000","last_unstale":"2023-07-14T11:18:43.045463+0000","last_undegraded":"2023-07-14T11:18:43.045463+0000","last_fullsized":"2023-07-14T11:18:43.045463+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_clean_scrub_stamp":"2023-07-14T11:18:40.990355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:04:28.144685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":135,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.017866+0000","last_change":"2023-07-14T11:13:08.758749+0000","last_active":"2023-07-14T11:18:43.017866+0000","last_peered":"2023-07-14T11:18:43.017866+0000","last_clean":"2023-07-14T11:18:43.017866+0000","last_became_active":"2023-07-14T11:13:08.757956+0000","last_became_peered":"2023-07-14T11:13:08.757956+0000","last_unstale":"2023-07-14T11:18:43.017866+0000","last_undegraded":"2023-07-14T11:18:43.017866+0000","last_fullsized":"2023-07-14T11:18:43.017866+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:36:50.720839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.045885+0000","last_change":"2023-07-14T11:18:43.034811+0000","last_active":"2023-07-14T11:18:43.045885+0000","last_peered":"2023-07-14T11:18:43.045885+0000","last_clean":"2023-07-14T11:18:43.045885+0000","last_became_active":"2023-07-14T11:18:43.034505+0000","last_became_peered":"2023-07-14T11:18:43.034505+0000","last_unstale":"2023-07-14T11:18:43.045885+0000","last_undegraded":"2023-07-14T11:18:43.045885+0000","last_fullsized":"2023-07-14T11:18:43.045885+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:05:44.918734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"87'2","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.044262+0000","last_change":"2023-07-14T11:18:42.030420+0000","last_active":"2023-07-14T11:18:43.044262+0000","last_peered":"2023-07-14T11:18:43.044262+0000","last_clean":"2023-07-14T11:18:43.044262+0000","last_became_active":"2023-07-14T11:18:42.030061+0000","last_became_peered":"2023-07-14T11:18:42.030061+0000","last_unstale":"2023-07-14T11:18:43.044262+0000","last_undegraded":"2023-07-14T11:18:43.044262+0000","last_fullsized":"2023-07-14T11:18:43.044262+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_clean_scrub_stamp":"2023-07-14T11:18:40.990355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:27:31.894674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":149,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.012052+0000","last_change":"2023-07-14T11:13:08.923786+0000","last_active":"2023-07-14T11:18:43.012052+0000","last_peered":"2023-07-14T11:18:43.012052+0000","last_clean":"2023-07-14T11:18:43.012052+0000","last_became_active":"2023-07-14T11:13:08.923384+0000","last_became_peered":"2023-07-14T11:13:08.923384+0000","last_unstale":"2023-07-14T11:18:43.012052+0000","last_undegraded":"2023-07-14T11:18:43.012052+0000","last_fullsized":"2023-07-14T11:18:43.012052+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:52:05.516882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574921,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28584,"kb_used_data":1632,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343256,"statfs":{"total":96636764160,"available":96607494144,"internally_reserved":0,"allocated":1671168,"data_stored":1076370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.71799999999999997,"15min":0.91300000000000003},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.877,"5min":8.4339999999999993,"15min":8.4339999999999993},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.76000000000000001,"15min":0.95099999999999996},"min":{"1min":0.45500000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.78600000000000003,"5min":8.4559999999999995,"15min":8.4559999999999995},"last":0.55200000000000005}]},{"osd":1,"last update":"Fri Jul 14 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.72899999999999998,"15min":0.89000000000000001},"min":{"1min":0.42499999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.81799999999999995,"5min":6.3520000000000003,"15min":6.3520000000000003},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.76300000000000001,"15min":1.0429999999999999},"min":{"1min":0.47799999999999998,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.81499999999999995,"5min":6.8550000000000004,"15min":6.8550000000000004},"last":0.51200000000000001}]},{"osd":2,"last update":"Fri Jul 14 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.79000000000000004,"15min":1.0960000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.997,"5min":7.0289999999999999,"15min":7.0289999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.69699999999999995,"15min":0.69099999999999995},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.94999999999999996,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.442}]},{"osd":3,"last update":"Fri Jul 14 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.81799999999999995,"15min":1.1519999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.76500000000000001,"5min":10.337,"15min":10.337},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.73499999999999999,"15min":0.76100000000000001},"min":{"1min":0.53600000000000003,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.024,"5min":1.921,"15min":1.921},"last":0.53300000000000003}]},{"osd":4,"last update":"Fri Jul 14 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.64000000000000001,"15min":0.59599999999999997},"min":{"1min":0.42299999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.73199999999999998,"15min":0.70399999999999996},"min":{"1min":0.55500000000000005,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0580000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.67800000000000005}]},{"osd":5,"last update":"Fri Jul 14 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.69699999999999995,"15min":0.67800000000000005},"min":{"1min":0.42099999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.755,"15min":0.73699999999999999},"min":{"1min":0.58799999999999997,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.96699999999999997,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.66200000000000003}]},{"osd":6,"last update":"Fri Jul 14 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71999999999999997,"15min":0.68000000000000005},"min":{"1min":0.54600000000000004,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.85999999999999999,"5min":1.002,"15min":1.002},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.72899999999999998,"15min":0.69299999999999995},"min":{"1min":0.53500000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.72199999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574922,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28016,"kb_used_data":1064,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343824,"statfs":{"total":96636764160,"available":96608075776,"internally_reserved":0,"allocated":1089536,"data_stored":488114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:18:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.71399999999999997,"15min":0.70799999999999996},"min":{"1min":0.54100000000000004,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.998,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.499},{"interface":"front","average":{"1min":0.745,"5min":0.74099999999999999,"15min":0.72299999999999998},"min":{"1min":0.47799999999999998,"5min":0.441,"15min":0.441},"max":{"1min":0.99299999999999999,"5min":1.167,"15min":1.167},"last":0.79700000000000004}]},{"osd":1,"last update":"Fri Jul 14 11:18:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.71099999999999997,"15min":0.68899999999999995},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.90000000000000002,"5min":1.006,"15min":1.006},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.74099999999999999,"15min":0.71699999999999997},"min":{"1min":0.57699999999999996,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.94299999999999995,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.748}]},{"osd":2,"last update":"Fri Jul 14 11:18:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70099999999999996,"15min":0.67900000000000005},"min":{"1min":0.50700000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.88800000000000001,"5min":1.45,"15min":1.45},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.76000000000000001,"15min":0.77800000000000002},"min":{"1min":0.496,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.97099999999999997,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.60799999999999998}]},{"osd":3,"last update":"Fri Jul 14 11:18:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.746,"15min":0.748},"min":{"1min":0.56000000000000005,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.89400000000000002,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.95899999999999996,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.63700000000000001}]},{"osd":4,"last update":"Fri Jul 14 11:18:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68300000000000005,"15min":0.70399999999999996},"min":{"1min":0.40500000000000003,"5min":0.38,"15min":0.38},"max":{"1min":0.96499999999999997,"5min":1.712,"15min":1.712},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.71999999999999997,"15min":0.72599999999999998},"min":{"1min":0.44400000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0680000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.83899999999999997}]},{"osd":5,"last update":"Fri Jul 14 11:18:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.71499999999999997,"15min":0.71899999999999997},"min":{"1min":0.56999999999999995,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.0109999999999999,"5min":2.8820000000000001,"15min":2.8820000000000001},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.77300000000000002,"15min":0.78800000000000003},"min":{"1min":0.67300000000000004,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0449999999999999,"5min":1.129,"15min":1.129},"last":0.70599999999999996}]},{"osd":7,"last update":"Fri Jul 14 11:18:09 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.78200000000000003,"15min":0.80200000000000005},"min":{"1min":0.60699999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.1220000000000001,"5min":1.333,"15min":1.333},"last":0.879},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.76900000000000002,"15min":0.79100000000000004},"min":{"1min":0.64000000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.04,"5min":1.55,"15min":1.55},"last":0.77900000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574921,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28000,"kb_used_data":1048,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343840,"statfs":{"total":96636764160,"available":96608092160,"internally_reserved":0,"allocated":1073152,"data_stored":486016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.41099999999999998,"15min":0.434},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.55500000000000005,"5min":0.996,"15min":0.996},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.433,"5min":0.46600000000000003,"15min":0.47999999999999998},"min":{"1min":0.30199999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.58499999999999996,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.38}]},{"osd":2,"last update":"Fri Jul 14 11:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.502,"15min":0.55600000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.64700000000000002,"5min":2.476,"15min":2.476},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.52500000000000002,"15min":0.60699999999999998},"min":{"1min":0.38100000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.91700000000000004,"5min":2.6299999999999999,"15min":2.6299999999999999},"last":0.442}]},{"osd":3,"last update":"Fri Jul 14 11:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.52900000000000003,"15min":0.52200000000000002},"min":{"1min":0.42599999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.63100000000000001,"5min":0.748,"15min":0.748},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.47199999999999998,"15min":0.48999999999999999},"min":{"1min":0.35299999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.54800000000000004,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.42199999999999999}]},{"osd":4,"last update":"Fri Jul 14 11:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.74399999999999999,"15min":0.751},"min":{"1min":0.61099999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.91600000000000004,"5min":1.363,"15min":1.363},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.75900000000000001,"15min":0.77100000000000002},"min":{"1min":0.55400000000000005,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.89000000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.57099999999999995}]},{"osd":5,"last update":"Fri Jul 14 11:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.75800000000000001,"15min":0.76800000000000002},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.84799999999999998,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.77500000000000002,"15min":0.81200000000000006},"min":{"1min":0.60199999999999998,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.0660000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.59099999999999997}]},{"osd":6,"last update":"Fri Jul 14 11:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.753,"15min":0.79100000000000004},"min":{"1min":0.51900000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.91800000000000004,"5min":1.298,"15min":1.298},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.76500000000000001,"15min":0.78300000000000003},"min":{"1min":0.58999999999999997,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.92400000000000004,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.71499999999999997}]},{"osd":7,"last update":"Fri Jul 14 11:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.77000000000000002,"15min":0.81000000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.028,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.76000000000000001,"15min":0.78200000000000003},"min":{"1min":0.57099999999999995,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.879,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.68400000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574919,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28600,"kb_used_data":1648,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343240,"statfs":{"total":96636764160,"available":96607477760,"internally_reserved":0,"allocated":1687552,"data_stored":1078584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 11:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.44900000000000001,"15min":0.438},"min":{"1min":0.34999999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.58899999999999997,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.44800000000000001,"15min":0.442},"min":{"1min":0.34999999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.443}]},{"osd":2,"last update":"Fri Jul 14 11:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.35799999999999998,"5min":0.307,"15min":0.307},"max":{"1min":0.54400000000000004,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.498,"15min":0.502},"min":{"1min":0.435,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.69199999999999995,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.40100000000000002}]},{"osd":3,"last update":"Fri Jul 14 11:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45600000000000002,"15min":0.42999999999999999},"min":{"1min":0.35899999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.66400000000000003,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.42699999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.64300000000000002,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.47899999999999998}]},{"osd":4,"last update":"Fri Jul 14 11:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.75600000000000001,"15min":0.76400000000000001},"min":{"1min":0.53500000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0289999999999999,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.70999999999999996},"min":{"1min":0.60499999999999998,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.92600000000000005,"5min":1.101,"15min":1.101},"last":0.77800000000000002}]},{"osd":5,"last update":"Fri Jul 14 11:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.748,"15min":0.72999999999999998},"min":{"1min":0.61799999999999999,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.88500000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.77000000000000002,"15min":0.77800000000000002},"min":{"1min":0.57599999999999996,"5min":0.505,"15min":0.505},"max":{"1min":0.99299999999999999,"5min":1.04,"15min":1.04},"last":0.72599999999999998}]},{"osd":6,"last update":"Fri Jul 14 11:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.73899999999999999,"15min":0.72599999999999998},"min":{"1min":0.55800000000000005,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.97699999999999998,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.77600000000000002,"15min":0.78000000000000003},"min":{"1min":0.623,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.98299999999999998,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.746}]},{"osd":7,"last update":"Fri Jul 14 11:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.79700000000000004,"15min":0.81599999999999995},"min":{"1min":0.57299999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.94499999999999995,"5min":1.149,"15min":1.149},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.80700000000000005,"15min":0.78500000000000003},"min":{"1min":0.66100000000000003,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.014,"5min":1.081,"15min":1.081},"last":0.82199999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574919,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27996,"kb_used_data":1044,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343844,"statfs":{"total":96636764160,"available":96608096256,"internally_reserved":0,"allocated":1069056,"data_stored":485946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:18:18 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.41499999999999998,"15min":0.443},"min":{"1min":0.248,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.54700000000000004,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.442,"15min":0.44600000000000001},"min":{"1min":0.28799999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.63100000000000001,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.36599999999999999}]},{"osd":1,"last update":"Fri Jul 14 11:18:18 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.47099999999999997,"15min":0.48299999999999998},"min":{"1min":0.31900000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.64300000000000002,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.497},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.48499999999999999,"15min":0.48899999999999999},"min":{"1min":0.38,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.57899999999999996,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.432}]},{"osd":3,"last update":"Fri Jul 14 11:18:18 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.49199999999999999,"15min":0.49399999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.57499999999999996,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.56299999999999994,"15min":0.58199999999999996},"min":{"1min":0.41499999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.60899999999999999,"5min":1.034,"15min":1.034},"last":0.627}]},{"osd":4,"last update":"Fri Jul 14 11:18:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.752,"15min":0.76900000000000002},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.92600000000000005,"5min":1.212,"15min":1.212},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.76200000000000001,"15min":0.78300000000000003},"min":{"1min":0.52800000000000002,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.86399999999999999,"5min":1.198,"15min":1.198},"last":0.56200000000000006}]},{"osd":5,"last update":"Fri Jul 14 11:18:18 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.78700000000000003},"min":{"1min":0.51700000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.97299999999999998,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.78100000000000003,"15min":0.81699999999999995},"min":{"1min":0.53500000000000003,"5min":0.495,"15min":0.495},"max":{"1min":0.89200000000000002,"5min":1.351,"15min":1.351},"last":0.80100000000000005}]},{"osd":6,"last update":"Fri Jul 14 11:18:18 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.76900000000000002,"15min":0.78600000000000003},"min":{"1min":0.56100000000000005,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.94099999999999995,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.78000000000000003,"15min":0.81699999999999995},"min":{"1min":0.60699999999999998,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.032,"5min":1.282,"15min":1.282},"last":0.66700000000000004}]},{"osd":7,"last update":"Fri Jul 14 11:18:18 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.78000000000000003,"15min":0.80000000000000004},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.92400000000000004,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.77000000000000002,"15min":0.80200000000000005},"min":{"1min":0.57299999999999995,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.91100000000000003,"5min":1.244,"15min":1.244},"last":0.81999999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574919,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27996,"kb_used_data":1044,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343844,"statfs":{"total":96636764160,"available":96608096256,"internally_reserved":0,"allocated":1069056,"data_stored":485946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:18:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.41999999999999998,"15min":0.44500000000000001},"min":{"1min":0.28899999999999998,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.311,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.63600000000000001,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.40699999999999997}]},{"osd":1,"last update":"Fri Jul 14 11:18:06 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44900000000000001,"15min":0.45200000000000001},"min":{"1min":0.30199999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.44,"5min":0.48099999999999998,"15min":0.49399999999999999},"min":{"1min":0.35399999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.56599999999999995,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.42699999999999999}]},{"osd":2,"last update":"Fri Jul 14 11:18:06 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.54200000000000004,"15min":0.54300000000000004},"min":{"1min":0.36699999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.441},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.57199999999999995,"15min":0.59299999999999997},"min":{"1min":0.45100000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.69299999999999995,"5min":1.585,"15min":1.585},"last":0.48699999999999999}]},{"osd":4,"last update":"Fri Jul 14 11:18:06 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.754,"15min":0.76100000000000001},"min":{"1min":0.48699999999999999,"5min":0.372,"15min":0.372},"max":{"1min":1.1279999999999999,"5min":1.216,"15min":1.216},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.77500000000000002,"15min":0.75900000000000001},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.61699999999999999}]},{"osd":5,"last update":"Fri Jul 14 11:18:06 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.76500000000000001,"15min":0.76300000000000001},"min":{"1min":0.504,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.179,"5min":1.413,"15min":1.413},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.79800000000000004,"15min":0.84499999999999997},"min":{"1min":0.54000000000000004,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1539999999999999,"5min":1.657,"15min":1.657},"last":0.69099999999999995}]},{"osd":6,"last update":"Fri Jul 14 11:18:06 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.77800000000000002,"15min":0.78300000000000003},"min":{"1min":0.52300000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.98299999999999998,"5min":1.726,"15min":1.726},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.77900000000000003,"15min":0.79700000000000004},"min":{"1min":0.53800000000000003,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.286,"5min":1.333,"15min":1.333},"last":0.70399999999999996}]},{"osd":7,"last update":"Fri Jul 14 11:18:06 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.80900000000000005,"15min":0.83499999999999996},"min":{"1min":0.497,"5min":0.437,"15min":0.437},"max":{"1min":1.244,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.81899999999999995,"15min":0.83699999999999997},"min":{"1min":0.57599999999999996,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0740000000000001,"5min":1.268,"15min":1.268},"last":0.80700000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574919,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":1032,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":1056768,"data_stored":478818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.64000000000000001,"15min":0.63200000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.80100000000000005,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.65800000000000003,"15min":0.68600000000000005},"min":{"1min":0.38800000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.76500000000000001,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.67000000000000004}]},{"osd":1,"last update":"Fri Jul 14 11:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.65300000000000002,"15min":0.66700000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.79900000000000004,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.70599999999999996,"15min":0.71099999999999997},"min":{"1min":0.50800000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.84799999999999998,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.55300000000000005}]},{"osd":2,"last update":"Fri Jul 14 11:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.70799999999999996,"15min":0.70999999999999996},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.879,"5min":1.48,"15min":1.48},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.72499999999999998,"15min":0.73699999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.875,"5min":1.23,"15min":1.23},"last":0.60099999999999998}]},{"osd":3,"last update":"Fri Jul 14 11:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.68500000000000005,"15min":0.71099999999999997},"min":{"1min":0.49399999999999999,"5min":0.438,"15min":0.438},"max":{"1min":0.79900000000000004,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.91100000000000003,"5min":1.145,"15min":1.145},"last":0.68500000000000005}]},{"osd":5,"last update":"Fri Jul 14 11:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.69699999999999995,"15min":0.753},"min":{"1min":0.42999999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.92900000000000005,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.68799999999999994,"15min":0.755},"min":{"1min":0.44400000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.874,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.51900000000000002}]},{"osd":6,"last update":"Fri Jul 14 11:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.70299999999999996,"15min":0.71899999999999997},"min":{"1min":0.45000000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.95199999999999996,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.751,"15min":0.77100000000000002},"min":{"1min":0.49099999999999999,"5min":0.442,"15min":0.442},"max":{"1min":0.89900000000000002,"5min":1.3,"15min":1.3},"last":0.65200000000000002}]},{"osd":7,"last update":"Fri Jul 14 11:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.72499999999999998,"15min":0.76200000000000001},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.82599999999999996,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.78400000000000003,"15min":0.83599999999999997},"min":{"1min":0.56200000000000006,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0609999999999999,"5min":1.379,"15min":1.379},"last":0.76100000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574921,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27996,"kb_used_data":1044,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343844,"statfs":{"total":96636764160,"available":96608096256,"internally_reserved":0,"allocated":1069056,"data_stored":485946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.63100000000000001,"15min":0.64000000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.86199999999999999,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.64800000000000002,"15min":0.63900000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.85999999999999999,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.57199999999999995}]},{"osd":1,"last update":"Fri Jul 14 11:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.64000000000000001,"15min":0.67000000000000004},"min":{"1min":0.43099999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.79800000000000004,"5min":1.343,"15min":1.343},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.65400000000000003,"15min":0.64900000000000002},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.81200000000000006,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.58799999999999997}]},{"osd":2,"last update":"Fri Jul 14 11:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.71299999999999997,"15min":0.73299999999999998},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.90100000000000002,"5min":1.034,"15min":1.034},"last":0.624},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.72299999999999998,"15min":0.76000000000000001},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.84499999999999997,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.60599999999999998}]},{"osd":3,"last update":"Fri Jul 14 11:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.72399999999999998,"15min":0.76000000000000001},"min":{"1min":0.54500000000000004,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.81499999999999995,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.70799999999999996,"15min":0.76800000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.82699999999999996,"5min":1.806,"15min":1.806},"last":0.499}]},{"osd":4,"last update":"Fri Jul 14 11:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.624,"15min":0.64800000000000002},"min":{"1min":0.36199999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.878,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.69099999999999995,"15min":0.745},"min":{"1min":0.505,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.89300000000000002,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.46600000000000003}]},{"osd":6,"last update":"Fri Jul 14 11:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70699999999999996,"15min":0.74299999999999999},"min":{"1min":0.51800000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.92400000000000004,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.746,"15min":0.79400000000000004},"min":{"1min":0.45600000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.94999999999999996,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.71599999999999997}]},{"osd":7,"last update":"Fri Jul 14 11:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.76600000000000001,"15min":0.83599999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.95199999999999996,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.80600000000000005,"15min":0.86199999999999999},"min":{"1min":0.63500000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.97099999999999997,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.68799999999999994}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T11:18:47.400 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T11:18:47.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.625+0000 7fddf57ff700 1 Processor -- start 2023-07-14T11:18:47.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.625+0000 7fddf57ff700 1 -- start start 2023-07-14T11:18:47.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.626+0000 7fddf57ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fddf015c950 0x7fddf00b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:47.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.626+0000 7fddf57ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fddf00b1e00 0x7fddf00d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:47.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.626+0000 7fddf57ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddf00d2ce0 con 0x7fddf00b2350 2023-07-14T11:18:47.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.626+0000 7fddf57ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddf00b3350 con 0x7fddf015c950 2023-07-14T11:18:47.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.626+0000 7fddf57ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddf00b3630 con 0x7fddf00b1e00 2023-07-14T11:18:47.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.626+0000 7fddeeffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fddf015c950 0x7fddf00b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:47.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.626+0000 7fddeeffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fddf015c950 0x7fddf00b43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39294/0 (socket says 172.21.15.84:39294) 2023-07-14T11:18:47.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.626+0000 7fddeeffd700 1 -- 172.21.15.84:0/3186982308 learned_addr learned my addr 172.21.15.84:0/3186982308 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:47.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.627+0000 7fddee7fc700 1 --2- 172.21.15.84:0/3186982308 >> v2:172.21.15.179:3300/0 conn(0x7fddf00b1e00 0x7fddf00d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:47.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.627+0000 7fddeeffd700 1 -- 172.21.15.84:0/3186982308 >> v2:172.21.15.179:3300/0 conn(0x7fddf00b1e00 msgr2=0x7fddf00d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:47.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.627+0000 7fddeeffd700 1 --2- 172.21.15.84:0/3186982308 >> v2:172.21.15.179:3300/0 conn(0x7fddf00b1e00 0x7fddf00d0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:47.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.627+0000 7fddeeffd700 1 -- 172.21.15.84:0/3186982308 >> v1:172.21.15.84:6789/0 conn(0x7fddf00b2350 legacy=0x7fddf00afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:47.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.627+0000 7fddeeffd700 1 -- 172.21.15.84:0/3186982308 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf00b3910 con 0x7fddf015c950 2023-07-14T11:18:47.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.627+0000 7fddee7fc700 1 --2- 172.21.15.84:0/3186982308 >> v2:172.21.15.179:3300/0 conn(0x7fddf00b1e00 0x7fddf00d0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:18:47.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.627+0000 7fddeeffd700 1 --2- 172.21.15.84:0/3186982308 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddf015c950 0x7fddf00b43f0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fddf0072140 tx=0x7fdde0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6279a114b4bf389 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:47.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.627+0000 7fddedffb700 1 -- 172.21.15.84:0/3186982308 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde0005e30 con 0x7fddf015c950 2023-07-14T11:18:47.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.627+0000 7fddedffb700 1 -- 172.21.15.84:0/3186982308 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdde0004030 con 0x7fddf015c950 2023-07-14T11:18:47.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.627+0000 7fddedffb700 1 -- 172.21.15.84:0/3186982308 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde00043e0 con 0x7fddf015c950 2023-07-14T11:18:47.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.628+0000 7fddf57ff700 1 -- 172.21.15.84:0/3186982308 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddf015c950 msgr2=0x7fddf00b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:47.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.628+0000 7fddf57ff700 1 --2- 172.21.15.84:0/3186982308 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddf015c950 0x7fddf00b43f0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fddf0072140 tx=0x7fdde0009bd0 comp rx=0 tx=0).stop 2023-07-14T11:18:47.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.628+0000 7fddf57ff700 1 -- 172.21.15.84:0/3186982308 shutdown_connections 2023-07-14T11:18:47.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.628+0000 7fddf57ff700 1 --2- 172.21.15.84:0/3186982308 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddf015c950 0x7fddf00b43f0 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:47.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.628+0000 7fddf57ff700 1 --2- 172.21.15.84:0/3186982308 >> v2:172.21.15.179:3300/0 conn(0x7fddf00b1e00 0x7fddf00d0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:47.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.628+0000 7fddf57ff700 1 -- 172.21.15.84:0/3186982308 >> 172.21.15.84:0/3186982308 conn(0x7fddf009c1d0 msgr2=0x7fddf00d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:47.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.628+0000 7fddf57ff700 1 -- 172.21.15.84:0/3186982308 shutdown_connections 2023-07-14T11:18:47.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.628+0000 7fddf57ff700 1 -- 172.21.15.84:0/3186982308 wait complete. 2023-07-14T11:18:47.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.630+0000 7fddf57ff700 1 Processor -- start 2023-07-14T11:18:47.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.630+0000 7fddf57ff700 1 -- start start 2023-07-14T11:18:47.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.631+0000 7fddf57ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fddf00b1e00 0x7fddf0151910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:47.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.631+0000 7fddf57ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddf00b2350 0x7fddf00b0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:47.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.631+0000 7fddf57ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fddf015c950 0x7fddf00b0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:47.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.631+0000 7fddf57ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf01f2e70 con 0x7fddf00b2350 2023-07-14T11:18:47.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.631+0000 7fddf57ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf0151e50 con 0x7fddf00b1e00 2023-07-14T11:18:47.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.631+0000 7fddf57ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddf01f21f0 con 0x7fddf015c950 2023-07-14T11:18:47.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.631+0000 7fddee7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddf00b2350 0x7fddf00b0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:47.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.631+0000 7fddee7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddf00b2350 0x7fddf00b0700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39300/0 (socket says 172.21.15.84:39300) 2023-07-14T11:18:47.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.631+0000 7fddee7fc700 1 -- 172.21.15.84:0/2957027790 learned_addr learned my addr 172.21.15.84:0/2957027790 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:47.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.631+0000 7fddeeffd700 1 --2- 172.21.15.84:0/2957027790 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fddf00b1e00 0x7fddf0151910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:47.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.631+0000 7fddef7fe700 1 --2- 172.21.15.84:0/2957027790 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fddf015c950 0x7fddf00b0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:47.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.631+0000 7fddee7fc700 1 -- 172.21.15.84:0/2957027790 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fddf015c950 msgr2=0x7fddf00b0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:47.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.631+0000 7fddee7fc700 1 --2- 172.21.15.84:0/2957027790 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fddf015c950 0x7fddf00b0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:47.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.631+0000 7fddee7fc700 1 -- 172.21.15.84:0/2957027790 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fddf00b1e00 msgr2=0x7fddf0151910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:47.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.631+0000 7fddee7fc700 1 --2- 172.21.15.84:0/2957027790 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fddf00b1e00 0x7fddf0151910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:47.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.631+0000 7fddee7fc700 1 -- 172.21.15.84:0/2957027790 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdde0009500 con 0x7fddf00b2350 2023-07-14T11:18:47.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.631+0000 7fddef7fe700 1 --2- 172.21.15.84:0/2957027790 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fddf015c950 0x7fddf00b0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:18:47.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.632+0000 7fddee7fc700 1 --2- 172.21.15.84:0/2957027790 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddf00b2350 0x7fddf00b0700 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fdde400e810 tx=0x7fdde400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:47.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.632+0000 7fddd77fe700 1 -- 172.21.15.84:0/2957027790 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde4004230 con 0x7fddf00b2350 2023-07-14T11:18:47.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.632+0000 7fddd77fe700 1 -- 172.21.15.84:0/2957027790 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdde4004390 con 0x7fddf00b2350 2023-07-14T11:18:47.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.632+0000 7fddf57ff700 1 -- 172.21.15.84:0/2957027790 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddf01f24d0 con 0x7fddf00b2350 2023-07-14T11:18:47.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.632+0000 7fddd77fe700 1 -- 172.21.15.84:0/2957027790 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde40036a0 con 0x7fddf00b2350 2023-07-14T11:18:47.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.632+0000 7fddf57ff700 1 -- 172.21.15.84:0/2957027790 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddf01f2a90 con 0x7fddf00b2350 2023-07-14T11:18:47.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.633+0000 7fddf57ff700 1 -- 172.21.15.84:0/2957027790 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddf01f1fb0 con 0x7fddf00b2350 2023-07-14T11:18:47.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.634+0000 7fddd77fe700 1 -- 172.21.15.84:0/2957027790 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7fdde4003800 con 0x7fddf00b2350 2023-07-14T11:18:47.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.635+0000 7fddd77fe700 1 --2- 172.21.15.84:0/2957027790 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fdddc06ae00 0x7fdddc06d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:47.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.635+0000 7fddd77fe700 1 -- 172.21.15.84:0/2957027790 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdde4089230 con 0x7fddf00b2350 2023-07-14T11:18:47.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.635+0000 7fddeeffd700 1 --2- 172.21.15.84:0/2957027790 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fdddc06ae00 0x7fdddc06d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:47.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.636+0000 7fddeeffd700 1 --2- 172.21.15.84:0/2957027790 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fdddc06ae00 0x7fdddc06d2b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fddf0072140 tx=0x7fdde0008070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:47.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.639+0000 7fddd77fe700 1 -- 172.21.15.84:0/2957027790 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fddf01f1fb0 con 0x7fddf00b2350 2023-07-14T11:18:47.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.834+0000 7fddf57ff700 1 -- 172.21.15.84:0/2957027790 --> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fddf00b3ed0 con 0x7fdddc06ae00 2023-07-14T11:18:47.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.843+0000 7fddd77fe700 1 -- 172.21.15.84:0/2957027790 <== mgr.4100 v2:172.21.15.179:6836/2094253834 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311060 (secure 0 0 0) 0x7fdde0006ca0 con 0x7fdddc06ae00 2023-07-14T11:18:47.849 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:18:47.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.847+0000 7fddf57ff700 1 -- 172.21.15.84:0/2957027790 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fdddc06ae00 msgr2=0x7fdddc06d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:47.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.847+0000 7fddf57ff700 1 --2- 172.21.15.84:0/2957027790 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fdddc06ae00 0x7fdddc06d2b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fddf0072140 tx=0x7fdde0008070 comp rx=0 tx=0).stop 2023-07-14T11:18:47.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.847+0000 7fddf57ff700 1 -- 172.21.15.84:0/2957027790 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddf00b2350 msgr2=0x7fddf00b0700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:47.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.847+0000 7fddf57ff700 1 --2- 172.21.15.84:0/2957027790 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddf00b2350 0x7fddf00b0700 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fdde400e810 tx=0x7fdde400ebd0 comp rx=0 tx=0).stop 2023-07-14T11:18:47.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.847+0000 7fddf57ff700 1 -- 172.21.15.84:0/2957027790 shutdown_connections 2023-07-14T11:18:47.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.847+0000 7fddf57ff700 1 --2- 172.21.15.84:0/2957027790 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fdddc06ae00 0x7fdddc06d2b0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:47.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.847+0000 7fddf57ff700 1 --2- 172.21.15.84:0/2957027790 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fddf015c950 0x7fddf00b0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:47.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.847+0000 7fddf57ff700 1 --2- 172.21.15.84:0/2957027790 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fddf00b1e00 0x7fddf0151910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:47.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.847+0000 7fddf57ff700 1 --2- 172.21.15.84:0/2957027790 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddf00b2350 0x7fddf00b0700 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:47.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.847+0000 7fddf57ff700 1 -- 172.21.15.84:0/2957027790 >> 172.21.15.84:0/2957027790 conn(0x7fddf009c1d0 msgr2=0x7fddf00b5280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:47.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.847+0000 7fddf57ff700 1 -- 172.21.15.84:0/2957027790 shutdown_connections 2023-07-14T11:18:47.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:47.848+0000 7fddf57ff700 1 -- 172.21.15.84:0/2957027790 wait complete. 2023-07-14T11:18:47.853 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-07-14T11:18:47.868 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2023-07-14T11:18:46.927035+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":223,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":166,"ondisk_log_size":166,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":84,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225172,"kb_used_data":9556,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754749548,"statfs":{"total":773094113280,"available":772863537152,"internally_reserved":0,"allocated":9785344,"data_stored":5065740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.922899"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.053378+0000","last_change":"2023-07-14T11:18:43.049281+0000","last_active":"2023-07-14T11:18:43.053378+0000","last_peered":"2023-07-14T11:18:43.053378+0000","last_clean":"2023-07-14T11:18:43.053378+0000","last_became_active":"2023-07-14T11:18:43.048958+0000","last_became_peered":"2023-07-14T11:18:43.048958+0000","last_unstale":"2023-07-14T11:18:43.053378+0000","last_undegraded":"2023-07-14T11:18:43.053378+0000","last_fullsized":"2023-07-14T11:18:43.053378+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:41:24.975331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.033364+0000","last_change":"2023-07-14T11:18:43.029946+0000","last_active":"2023-07-14T11:18:43.033364+0000","last_peered":"2023-07-14T11:18:43.033364+0000","last_clean":"2023-07-14T11:18:43.033364+0000","last_became_active":"2023-07-14T11:18:43.029634+0000","last_became_peered":"2023-07-14T11:18:43.029634+0000","last_unstale":"2023-07-14T11:18:43.033364+0000","last_undegraded":"2023-07-14T11:18:43.033364+0000","last_fullsized":"2023-07-14T11:18:43.033364+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:18:38.847213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.041758+0000","last_change":"2023-07-14T11:18:43.038105+0000","last_active":"2023-07-14T11:18:43.041758+0000","last_peered":"2023-07-14T11:18:43.041758+0000","last_clean":"2023-07-14T11:18:43.041758+0000","last_became_active":"2023-07-14T11:18:43.037838+0000","last_became_peered":"2023-07-14T11:18:43.037838+0000","last_unstale":"2023-07-14T11:18:43.041758+0000","last_undegraded":"2023-07-14T11:18:43.041758+0000","last_fullsized":"2023-07-14T11:18:43.041758+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:34:29.410100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.031677+0000","last_change":"2023-07-14T11:18:43.027990+0000","last_active":"2023-07-14T11:18:43.031677+0000","last_peered":"2023-07-14T11:18:43.031677+0000","last_clean":"2023-07-14T11:18:43.031677+0000","last_became_active":"2023-07-14T11:18:43.027700+0000","last_became_peered":"2023-07-14T11:18:43.027700+0000","last_unstale":"2023-07-14T11:18:43.031677+0000","last_undegraded":"2023-07-14T11:18:43.031677+0000","last_fullsized":"2023-07-14T11:18:43.031677+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:16:41.903935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.035394+0000","last_change":"2023-07-14T11:18:43.030056+0000","last_active":"2023-07-14T11:18:43.035394+0000","last_peered":"2023-07-14T11:18:43.035394+0000","last_clean":"2023-07-14T11:18:43.035394+0000","last_became_active":"2023-07-14T11:18:43.029808+0000","last_became_peered":"2023-07-14T11:18:43.029808+0000","last_unstale":"2023-07-14T11:18:43.035394+0000","last_undegraded":"2023-07-14T11:18:43.035394+0000","last_fullsized":"2023-07-14T11:18:43.035394+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:43:54.282167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.045966+0000","last_change":"2023-07-14T11:18:43.033773+0000","last_active":"2023-07-14T11:18:43.045966+0000","last_peered":"2023-07-14T11:18:43.045966+0000","last_clean":"2023-07-14T11:18:43.045966+0000","last_became_active":"2023-07-14T11:18:43.033223+0000","last_became_peered":"2023-07-14T11:18:43.033223+0000","last_unstale":"2023-07-14T11:18:43.045966+0000","last_undegraded":"2023-07-14T11:18:43.045966+0000","last_fullsized":"2023-07-14T11:18:43.045966+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:51:11.397536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.038475+0000","last_change":"2023-07-14T11:18:43.031751+0000","last_active":"2023-07-14T11:18:43.038475+0000","last_peered":"2023-07-14T11:18:43.038475+0000","last_clean":"2023-07-14T11:18:43.038475+0000","last_became_active":"2023-07-14T11:18:43.031478+0000","last_became_peered":"2023-07-14T11:18:43.031478+0000","last_unstale":"2023-07-14T11:18:43.038475+0000","last_undegraded":"2023-07-14T11:18:43.038475+0000","last_fullsized":"2023-07-14T11:18:43.038475+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:05:56.328819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.027916+0000","last_change":"2023-07-14T11:18:43.016906+0000","last_active":"2023-07-14T11:18:43.027916+0000","last_peered":"2023-07-14T11:18:43.027916+0000","last_clean":"2023-07-14T11:18:43.027916+0000","last_became_active":"2023-07-14T11:18:43.016666+0000","last_became_peered":"2023-07-14T11:18:43.016666+0000","last_unstale":"2023-07-14T11:18:43.027916+0000","last_undegraded":"2023-07-14T11:18:43.027916+0000","last_fullsized":"2023-07-14T11:18:43.027916+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:09:08.761711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.033373+0000","last_change":"2023-07-14T11:18:43.028205+0000","last_active":"2023-07-14T11:18:43.033373+0000","last_peered":"2023-07-14T11:18:43.033373+0000","last_clean":"2023-07-14T11:18:43.033373+0000","last_became_active":"2023-07-14T11:18:43.027814+0000","last_became_peered":"2023-07-14T11:18:43.027814+0000","last_unstale":"2023-07-14T11:18:43.033373+0000","last_undegraded":"2023-07-14T11:18:43.033373+0000","last_fullsized":"2023-07-14T11:18:43.033373+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:21:36.615505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.039295+0000","last_change":"2023-07-14T11:18:43.030875+0000","last_active":"2023-07-14T11:18:43.039295+0000","last_peered":"2023-07-14T11:18:43.039295+0000","last_clean":"2023-07-14T11:18:43.039295+0000","last_became_active":"2023-07-14T11:18:43.030621+0000","last_became_peered":"2023-07-14T11:18:43.030621+0000","last_unstale":"2023-07-14T11:18:43.039295+0000","last_undegraded":"2023-07-14T11:18:43.039295+0000","last_fullsized":"2023-07-14T11:18:43.039295+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:08:57.353173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.048667+0000","last_change":"2023-07-14T11:18:43.047755+0000","last_active":"2023-07-14T11:18:43.048667+0000","last_peered":"2023-07-14T11:18:43.048667+0000","last_clean":"2023-07-14T11:18:43.048667+0000","last_became_active":"2023-07-14T11:18:43.047243+0000","last_became_peered":"2023-07-14T11:18:43.047243+0000","last_unstale":"2023-07-14T11:18:43.048667+0000","last_undegraded":"2023-07-14T11:18:43.048667+0000","last_fullsized":"2023-07-14T11:18:43.048667+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:28:49.185110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.040625+0000","last_change":"2023-07-14T11:18:43.032424+0000","last_active":"2023-07-14T11:18:43.040625+0000","last_peered":"2023-07-14T11:18:43.040625+0000","last_clean":"2023-07-14T11:18:43.040625+0000","last_became_active":"2023-07-14T11:18:43.032126+0000","last_became_peered":"2023-07-14T11:18:43.032126+0000","last_unstale":"2023-07-14T11:18:43.040625+0000","last_undegraded":"2023-07-14T11:18:43.040625+0000","last_fullsized":"2023-07-14T11:18:43.040625+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:54:28.114527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.025820+0000","last_change":"2023-07-14T11:18:43.016898+0000","last_active":"2023-07-14T11:18:43.025820+0000","last_peered":"2023-07-14T11:18:43.025820+0000","last_clean":"2023-07-14T11:18:43.025820+0000","last_became_active":"2023-07-14T11:18:43.016628+0000","last_became_peered":"2023-07-14T11:18:43.016628+0000","last_unstale":"2023-07-14T11:18:43.025820+0000","last_undegraded":"2023-07-14T11:18:43.025820+0000","last_fullsized":"2023-07-14T11:18:43.025820+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:18:38.847213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.043790+0000","last_change":"2023-07-14T11:18:43.042496+0000","last_active":"2023-07-14T11:18:43.043790+0000","last_peered":"2023-07-14T11:18:43.043790+0000","last_clean":"2023-07-14T11:18:43.043790+0000","last_became_active":"2023-07-14T11:18:43.042227+0000","last_became_peered":"2023-07-14T11:18:43.042227+0000","last_unstale":"2023-07-14T11:18:43.043790+0000","last_undegraded":"2023-07-14T11:18:43.043790+0000","last_fullsized":"2023-07-14T11:18:43.043790+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:46:39.315854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.039367+0000","last_change":"2023-07-14T11:18:43.029638+0000","last_active":"2023-07-14T11:18:43.039367+0000","last_peered":"2023-07-14T11:18:43.039367+0000","last_clean":"2023-07-14T11:18:43.039367+0000","last_became_active":"2023-07-14T11:18:43.029063+0000","last_became_peered":"2023-07-14T11:18:43.029063+0000","last_unstale":"2023-07-14T11:18:43.039367+0000","last_undegraded":"2023-07-14T11:18:43.039367+0000","last_fullsized":"2023-07-14T11:18:43.039367+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:13:16.696671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.046064+0000","last_change":"2023-07-14T11:18:43.040961+0000","last_active":"2023-07-14T11:18:43.046064+0000","last_peered":"2023-07-14T11:18:43.046064+0000","last_clean":"2023-07-14T11:18:43.046064+0000","last_became_active":"2023-07-14T11:18:43.040686+0000","last_became_peered":"2023-07-14T11:18:43.040686+0000","last_unstale":"2023-07-14T11:18:43.046064+0000","last_undegraded":"2023-07-14T11:18:43.046064+0000","last_fullsized":"2023-07-14T11:18:43.046064+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:41:46.974392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.046061+0000","last_change":"2023-07-14T11:18:43.033986+0000","last_active":"2023-07-14T11:18:43.046061+0000","last_peered":"2023-07-14T11:18:43.046061+0000","last_clean":"2023-07-14T11:18:43.046061+0000","last_became_active":"2023-07-14T11:18:43.033462+0000","last_became_peered":"2023-07-14T11:18:43.033462+0000","last_unstale":"2023-07-14T11:18:43.046061+0000","last_undegraded":"2023-07-14T11:18:43.046061+0000","last_fullsized":"2023-07-14T11:18:43.046061+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:53:08.739889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.040922+0000","last_change":"2023-07-14T11:18:43.033583+0000","last_active":"2023-07-14T11:18:43.040922+0000","last_peered":"2023-07-14T11:18:43.040922+0000","last_clean":"2023-07-14T11:18:43.040922+0000","last_became_active":"2023-07-14T11:18:43.033326+0000","last_became_peered":"2023-07-14T11:18:43.033326+0000","last_unstale":"2023-07-14T11:18:43.040922+0000","last_undegraded":"2023-07-14T11:18:43.040922+0000","last_fullsized":"2023-07-14T11:18:43.040922+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:17:32.499545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.041994+0000","last_change":"2023-07-14T11:18:43.036912+0000","last_active":"2023-07-14T11:18:43.041994+0000","last_peered":"2023-07-14T11:18:43.041994+0000","last_clean":"2023-07-14T11:18:43.041994+0000","last_became_active":"2023-07-14T11:18:43.036474+0000","last_became_peered":"2023-07-14T11:18:43.036474+0000","last_unstale":"2023-07-14T11:18:43.041994+0000","last_undegraded":"2023-07-14T11:18:43.041994+0000","last_fullsized":"2023-07-14T11:18:43.041994+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:41:22.845868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.031318+0000","last_change":"2023-07-14T11:18:43.026424+0000","last_active":"2023-07-14T11:18:43.031318+0000","last_peered":"2023-07-14T11:18:43.031318+0000","last_clean":"2023-07-14T11:18:43.031318+0000","last_became_active":"2023-07-14T11:18:43.026092+0000","last_became_peered":"2023-07-14T11:18:43.026092+0000","last_unstale":"2023-07-14T11:18:43.031318+0000","last_undegraded":"2023-07-14T11:18:43.031318+0000","last_fullsized":"2023-07-14T11:18:43.031318+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:14:13.100803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.035375+0000","last_change":"2023-07-14T11:18:43.029859+0000","last_active":"2023-07-14T11:18:43.035375+0000","last_peered":"2023-07-14T11:18:43.035375+0000","last_clean":"2023-07-14T11:18:43.035375+0000","last_became_active":"2023-07-14T11:18:43.028413+0000","last_became_peered":"2023-07-14T11:18:43.028413+0000","last_unstale":"2023-07-14T11:18:43.035375+0000","last_undegraded":"2023-07-14T11:18:43.035375+0000","last_fullsized":"2023-07-14T11:18:43.035375+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:01:54.137844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.042047+0000","last_change":"2023-07-14T11:18:43.037329+0000","last_active":"2023-07-14T11:18:43.042047+0000","last_peered":"2023-07-14T11:18:43.042047+0000","last_clean":"2023-07-14T11:18:43.042047+0000","last_became_active":"2023-07-14T11:18:43.037012+0000","last_became_peered":"2023-07-14T11:18:43.037012+0000","last_unstale":"2023-07-14T11:18:43.042047+0000","last_undegraded":"2023-07-14T11:18:43.042047+0000","last_fullsized":"2023-07-14T11:18:43.042047+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:29:43.329562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.039048+0000","last_change":"2023-07-14T11:18:43.033437+0000","last_active":"2023-07-14T11:18:43.039048+0000","last_peered":"2023-07-14T11:18:43.039048+0000","last_clean":"2023-07-14T11:18:43.039048+0000","last_became_active":"2023-07-14T11:18:43.033163+0000","last_became_peered":"2023-07-14T11:18:43.033163+0000","last_unstale":"2023-07-14T11:18:43.039048+0000","last_undegraded":"2023-07-14T11:18:43.039048+0000","last_fullsized":"2023-07-14T11:18:43.039048+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:15:18.458462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.038370+0000","last_change":"2023-07-14T11:18:43.028410+0000","last_active":"2023-07-14T11:18:43.038370+0000","last_peered":"2023-07-14T11:18:43.038370+0000","last_clean":"2023-07-14T11:18:43.038370+0000","last_became_active":"2023-07-14T11:18:43.028125+0000","last_became_peered":"2023-07-14T11:18:43.028125+0000","last_unstale":"2023-07-14T11:18:43.038370+0000","last_undegraded":"2023-07-14T11:18:43.038370+0000","last_fullsized":"2023-07-14T11:18:43.038370+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:31:20.897126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.033043+0000","last_change":"2023-07-14T11:18:43.029846+0000","last_active":"2023-07-14T11:18:43.033043+0000","last_peered":"2023-07-14T11:18:43.033043+0000","last_clean":"2023-07-14T11:18:43.033043+0000","last_became_active":"2023-07-14T11:18:43.028842+0000","last_became_peered":"2023-07-14T11:18:43.028842+0000","last_unstale":"2023-07-14T11:18:43.033043+0000","last_undegraded":"2023-07-14T11:18:43.033043+0000","last_fullsized":"2023-07-14T11:18:43.033043+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:13:07.574101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.043339+0000","last_change":"2023-07-14T11:18:43.041746+0000","last_active":"2023-07-14T11:18:43.043339+0000","last_peered":"2023-07-14T11:18:43.043339+0000","last_clean":"2023-07-14T11:18:43.043339+0000","last_became_active":"2023-07-14T11:18:43.041477+0000","last_became_peered":"2023-07-14T11:18:43.041477+0000","last_unstale":"2023-07-14T11:18:43.043339+0000","last_undegraded":"2023-07-14T11:18:43.043339+0000","last_fullsized":"2023-07-14T11:18:43.043339+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:12:43.438510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.027518+0000","last_change":"2023-07-14T11:18:43.026401+0000","last_active":"2023-07-14T11:18:43.027518+0000","last_peered":"2023-07-14T11:18:43.027518+0000","last_clean":"2023-07-14T11:18:43.027518+0000","last_became_active":"2023-07-14T11:18:43.026124+0000","last_became_peered":"2023-07-14T11:18:43.026124+0000","last_unstale":"2023-07-14T11:18:43.027518+0000","last_undegraded":"2023-07-14T11:18:43.027518+0000","last_fullsized":"2023-07-14T11:18:43.027518+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:15:37.009779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.039316+0000","last_change":"2023-07-14T11:18:43.030362+0000","last_active":"2023-07-14T11:18:43.039316+0000","last_peered":"2023-07-14T11:18:43.039316+0000","last_clean":"2023-07-14T11:18:43.039316+0000","last_became_active":"2023-07-14T11:18:43.029992+0000","last_became_peered":"2023-07-14T11:18:43.029992+0000","last_unstale":"2023-07-14T11:18:43.039316+0000","last_undegraded":"2023-07-14T11:18:43.039316+0000","last_fullsized":"2023-07-14T11:18:43.039316+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:42:24.975644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.038512+0000","last_change":"2023-07-14T11:18:43.029217+0000","last_active":"2023-07-14T11:18:43.038512+0000","last_peered":"2023-07-14T11:18:43.038512+0000","last_clean":"2023-07-14T11:18:43.038512+0000","last_became_active":"2023-07-14T11:18:43.028846+0000","last_became_peered":"2023-07-14T11:18:43.028846+0000","last_unstale":"2023-07-14T11:18:43.038512+0000","last_undegraded":"2023-07-14T11:18:43.038512+0000","last_fullsized":"2023-07-14T11:18:43.038512+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:19:43.397882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.030557+0000","last_change":"2023-07-14T11:18:43.024808+0000","last_active":"2023-07-14T11:18:43.030557+0000","last_peered":"2023-07-14T11:18:43.030557+0000","last_clean":"2023-07-14T11:18:43.030557+0000","last_became_active":"2023-07-14T11:18:43.024488+0000","last_became_peered":"2023-07-14T11:18:43.024488+0000","last_unstale":"2023-07-14T11:18:43.030557+0000","last_undegraded":"2023-07-14T11:18:43.030557+0000","last_fullsized":"2023-07-14T11:18:43.030557+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:20:35.310383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.035160+0000","last_change":"2023-07-14T11:18:43.031673+0000","last_active":"2023-07-14T11:18:43.035160+0000","last_peered":"2023-07-14T11:18:43.035160+0000","last_clean":"2023-07-14T11:18:43.035160+0000","last_became_active":"2023-07-14T11:18:43.031431+0000","last_became_peered":"2023-07-14T11:18:43.031431+0000","last_unstale":"2023-07-14T11:18:43.035160+0000","last_undegraded":"2023-07-14T11:18:43.035160+0000","last_fullsized":"2023-07-14T11:18:43.035160+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:14:13.100803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.046084+0000","last_change":"2023-07-14T11:18:43.041044+0000","last_active":"2023-07-14T11:18:43.046084+0000","last_peered":"2023-07-14T11:18:43.046084+0000","last_clean":"2023-07-14T11:18:43.046084+0000","last_became_active":"2023-07-14T11:18:43.040711+0000","last_became_peered":"2023-07-14T11:18:43.040711+0000","last_unstale":"2023-07-14T11:18:43.046084+0000","last_undegraded":"2023-07-14T11:18:43.046084+0000","last_fullsized":"2023-07-14T11:18:43.046084+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:05:02.296676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.046028+0000","last_change":"2023-07-14T11:18:43.035214+0000","last_active":"2023-07-14T11:18:43.046028+0000","last_peered":"2023-07-14T11:18:43.046028+0000","last_clean":"2023-07-14T11:18:43.046028+0000","last_became_active":"2023-07-14T11:18:43.034935+0000","last_became_peered":"2023-07-14T11:18:43.034935+0000","last_unstale":"2023-07-14T11:18:43.046028+0000","last_undegraded":"2023-07-14T11:18:43.046028+0000","last_fullsized":"2023-07-14T11:18:43.046028+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:35:43.196683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"87'4","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.048898+0000","last_change":"2023-07-14T11:18:42.034257+0000","last_active":"2023-07-14T11:18:43.048898+0000","last_peered":"2023-07-14T11:18:43.048898+0000","last_clean":"2023-07-14T11:18:43.048898+0000","last_became_active":"2023-07-14T11:18:42.033972+0000","last_became_peered":"2023-07-14T11:18:42.033972+0000","last_unstale":"2023-07-14T11:18:43.048898+0000","last_undegraded":"2023-07-14T11:18:43.048898+0000","last_fullsized":"2023-07-14T11:18:43.048898+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_clean_scrub_stamp":"2023-07-14T11:18:40.990355+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:07:19.224878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.046615+0000","last_change":"2023-07-14T11:18:43.045019+0000","last_active":"2023-07-14T11:18:43.046615+0000","last_peered":"2023-07-14T11:18:43.046615+0000","last_clean":"2023-07-14T11:18:43.046615+0000","last_became_active":"2023-07-14T11:18:43.043998+0000","last_became_peered":"2023-07-14T11:18:43.043998+0000","last_unstale":"2023-07-14T11:18:43.046615+0000","last_undegraded":"2023-07-14T11:18:43.046615+0000","last_fullsized":"2023-07-14T11:18:43.046615+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:26:02.886913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"87'1","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.041175+0000","last_change":"2023-07-14T11:18:42.026277+0000","last_active":"2023-07-14T11:18:43.041175+0000","last_peered":"2023-07-14T11:18:43.041175+0000","last_clean":"2023-07-14T11:18:43.041175+0000","last_became_active":"2023-07-14T11:18:42.025830+0000","last_became_peered":"2023-07-14T11:18:42.025830+0000","last_unstale":"2023-07-14T11:18:43.041175+0000","last_undegraded":"2023-07-14T11:18:43.041175+0000","last_fullsized":"2023-07-14T11:18:43.041175+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_clean_scrub_stamp":"2023-07-14T11:18:40.990355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:12:34.181491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.037523+0000","last_change":"2023-07-14T11:18:43.023792+0000","last_active":"2023-07-14T11:18:43.037523+0000","last_peered":"2023-07-14T11:18:43.037523+0000","last_clean":"2023-07-14T11:18:43.037523+0000","last_became_active":"2023-07-14T11:18:43.023460+0000","last_became_peered":"2023-07-14T11:18:43.023460+0000","last_unstale":"2023-07-14T11:18:43.037523+0000","last_undegraded":"2023-07-14T11:18:43.037523+0000","last_fullsized":"2023-07-14T11:18:43.037523+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:00:16.865829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"87'2","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.048654+0000","last_change":"2023-07-14T11:18:42.029561+0000","last_active":"2023-07-14T11:18:43.048654+0000","last_peered":"2023-07-14T11:18:43.048654+0000","last_clean":"2023-07-14T11:18:43.048654+0000","last_became_active":"2023-07-14T11:18:42.029031+0000","last_became_peered":"2023-07-14T11:18:42.029031+0000","last_unstale":"2023-07-14T11:18:43.048654+0000","last_undegraded":"2023-07-14T11:18:43.048654+0000","last_fullsized":"2023-07-14T11:18:43.048654+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_clean_scrub_stamp":"2023-07-14T11:18:40.990355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:56:06.067709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.046041+0000","last_change":"2023-07-14T11:18:43.033803+0000","last_active":"2023-07-14T11:18:43.046041+0000","last_peered":"2023-07-14T11:18:43.046041+0000","last_clean":"2023-07-14T11:18:43.046041+0000","last_became_active":"2023-07-14T11:18:43.033160+0000","last_became_peered":"2023-07-14T11:18:43.033160+0000","last_unstale":"2023-07-14T11:18:43.046041+0000","last_undegraded":"2023-07-14T11:18:43.046041+0000","last_fullsized":"2023-07-14T11:18:43.046041+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:05:53.448346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"87'2","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.045725+0000","last_change":"2023-07-14T11:18:42.031291+0000","last_active":"2023-07-14T11:18:43.045725+0000","last_peered":"2023-07-14T11:18:43.045725+0000","last_clean":"2023-07-14T11:18:43.045725+0000","last_became_active":"2023-07-14T11:18:42.030924+0000","last_became_peered":"2023-07-14T11:18:42.030924+0000","last_unstale":"2023-07-14T11:18:43.045725+0000","last_undegraded":"2023-07-14T11:18:43.045725+0000","last_fullsized":"2023-07-14T11:18:43.045725+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_clean_scrub_stamp":"2023-07-14T11:18:40.990355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:52:02.807374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.040073+0000","last_change":"2023-07-14T11:18:43.029203+0000","last_active":"2023-07-14T11:18:43.040073+0000","last_peered":"2023-07-14T11:18:43.040073+0000","last_clean":"2023-07-14T11:18:43.040073+0000","last_became_active":"2023-07-14T11:18:43.028548+0000","last_became_peered":"2023-07-14T11:18:43.028548+0000","last_unstale":"2023-07-14T11:18:43.040073+0000","last_undegraded":"2023-07-14T11:18:43.040073+0000","last_fullsized":"2023-07-14T11:18:43.040073+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:30:20.877390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"87'1","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.042797+0000","last_change":"2023-07-14T11:18:42.020254+0000","last_active":"2023-07-14T11:18:43.042797+0000","last_peered":"2023-07-14T11:18:43.042797+0000","last_clean":"2023-07-14T11:18:43.042797+0000","last_became_active":"2023-07-14T11:18:42.019960+0000","last_became_peered":"2023-07-14T11:18:42.019960+0000","last_unstale":"2023-07-14T11:18:43.042797+0000","last_undegraded":"2023-07-14T11:18:43.042797+0000","last_fullsized":"2023-07-14T11:18:43.042797+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_clean_scrub_stamp":"2023-07-14T11:18:40.990355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:36:07.683684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.041254+0000","last_change":"2023-07-14T11:18:43.038167+0000","last_active":"2023-07-14T11:18:43.041254+0000","last_peered":"2023-07-14T11:18:43.041254+0000","last_clean":"2023-07-14T11:18:43.041254+0000","last_became_active":"2023-07-14T11:18:43.037540+0000","last_became_peered":"2023-07-14T11:18:43.037540+0000","last_unstale":"2023-07-14T11:18:43.041254+0000","last_undegraded":"2023-07-14T11:18:43.041254+0000","last_fullsized":"2023-07-14T11:18:43.041254+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:25:20.161835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"87'1","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.045135+0000","last_change":"2023-07-14T11:18:42.023015+0000","last_active":"2023-07-14T11:18:43.045135+0000","last_peered":"2023-07-14T11:18:43.045135+0000","last_clean":"2023-07-14T11:18:43.045135+0000","last_became_active":"2023-07-14T11:18:42.022635+0000","last_became_peered":"2023-07-14T11:18:42.022635+0000","last_unstale":"2023-07-14T11:18:43.045135+0000","last_undegraded":"2023-07-14T11:18:43.045135+0000","last_fullsized":"2023-07-14T11:18:43.045135+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_clean_scrub_stamp":"2023-07-14T11:18:40.990355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:22:05.469374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.045986+0000","last_change":"2023-07-14T11:18:43.033984+0000","last_active":"2023-07-14T11:18:43.045986+0000","last_peered":"2023-07-14T11:18:43.045986+0000","last_clean":"2023-07-14T11:18:43.045986+0000","last_became_active":"2023-07-14T11:18:43.033514+0000","last_became_peered":"2023-07-14T11:18:43.033514+0000","last_unstale":"2023-07-14T11:18:43.045986+0000","last_undegraded":"2023-07-14T11:18:43.045986+0000","last_fullsized":"2023-07-14T11:18:43.045986+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:02:21.379663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.019803+0000","last_change":"2023-07-14T11:18:42.025986+0000","last_active":"2023-07-14T11:18:43.019803+0000","last_peered":"2023-07-14T11:18:43.019803+0000","last_clean":"2023-07-14T11:18:43.019803+0000","last_became_active":"2023-07-14T11:18:42.025720+0000","last_became_peered":"2023-07-14T11:18:42.025720+0000","last_unstale":"2023-07-14T11:18:43.019803+0000","last_undegraded":"2023-07-14T11:18:43.019803+0000","last_fullsized":"2023-07-14T11:18:43.019803+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_clean_scrub_stamp":"2023-07-14T11:18:40.990355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:15:25.389235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.031345+0000","last_change":"2023-07-14T11:18:43.027498+0000","last_active":"2023-07-14T11:18:43.031345+0000","last_peered":"2023-07-14T11:18:43.031345+0000","last_clean":"2023-07-14T11:18:43.031345+0000","last_became_active":"2023-07-14T11:18:43.027147+0000","last_became_peered":"2023-07-14T11:18:43.027147+0000","last_unstale":"2023-07-14T11:18:43.031345+0000","last_undegraded":"2023-07-14T11:18:43.031345+0000","last_fullsized":"2023-07-14T11:18:43.031345+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:50:18.079065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.011851+0000","last_change":"2023-07-14T11:18:42.033242+0000","last_active":"2023-07-14T11:18:43.011851+0000","last_peered":"2023-07-14T11:18:43.011851+0000","last_clean":"2023-07-14T11:18:43.011851+0000","last_became_active":"2023-07-14T11:18:42.032970+0000","last_became_peered":"2023-07-14T11:18:42.032970+0000","last_unstale":"2023-07-14T11:18:43.011851+0000","last_undegraded":"2023-07-14T11:18:43.011851+0000","last_fullsized":"2023-07-14T11:18:43.011851+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_clean_scrub_stamp":"2023-07-14T11:18:40.990355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:05:28.280291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.041957+0000","last_change":"2023-07-14T11:18:43.037313+0000","last_active":"2023-07-14T11:18:43.041957+0000","last_peered":"2023-07-14T11:18:43.041957+0000","last_clean":"2023-07-14T11:18:43.041957+0000","last_became_active":"2023-07-14T11:18:43.036843+0000","last_became_peered":"2023-07-14T11:18:43.036843+0000","last_unstale":"2023-07-14T11:18:43.041957+0000","last_undegraded":"2023-07-14T11:18:43.041957+0000","last_fullsized":"2023-07-14T11:18:43.041957+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:22:52.186347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.019202+0000","last_change":"2023-07-14T11:18:42.024420+0000","last_active":"2023-07-14T11:18:43.019202+0000","last_peered":"2023-07-14T11:18:43.019202+0000","last_clean":"2023-07-14T11:18:43.019202+0000","last_became_active":"2023-07-14T11:18:42.024127+0000","last_became_peered":"2023-07-14T11:18:42.024127+0000","last_unstale":"2023-07-14T11:18:43.019202+0000","last_undegraded":"2023-07-14T11:18:43.019202+0000","last_fullsized":"2023-07-14T11:18:43.019202+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_clean_scrub_stamp":"2023-07-14T11:18:40.990355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:57:38.764509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.038600+0000","last_change":"2023-07-14T11:18:43.034355+0000","last_active":"2023-07-14T11:18:43.038600+0000","last_peered":"2023-07-14T11:18:43.038600+0000","last_clean":"2023-07-14T11:18:43.038600+0000","last_became_active":"2023-07-14T11:18:43.034018+0000","last_became_peered":"2023-07-14T11:18:43.034018+0000","last_unstale":"2023-07-14T11:18:43.038600+0000","last_undegraded":"2023-07-14T11:18:43.038600+0000","last_fullsized":"2023-07-14T11:18:43.038600+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:47:28.319111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.020844+0000","last_change":"2023-07-14T11:18:42.023101+0000","last_active":"2023-07-14T11:18:43.020844+0000","last_peered":"2023-07-14T11:18:43.020844+0000","last_clean":"2023-07-14T11:18:43.020844+0000","last_became_active":"2023-07-14T11:18:42.022832+0000","last_became_peered":"2023-07-14T11:18:42.022832+0000","last_unstale":"2023-07-14T11:18:43.020844+0000","last_undegraded":"2023-07-14T11:18:43.020844+0000","last_fullsized":"2023-07-14T11:18:43.020844+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_clean_scrub_stamp":"2023-07-14T11:18:40.990355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:55:15.610726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.053356+0000","last_change":"2023-07-14T11:18:43.049141+0000","last_active":"2023-07-14T11:18:43.053356+0000","last_peered":"2023-07-14T11:18:43.053356+0000","last_clean":"2023-07-14T11:18:43.053356+0000","last_became_active":"2023-07-14T11:18:43.048851+0000","last_became_peered":"2023-07-14T11:18:43.048851+0000","last_unstale":"2023-07-14T11:18:43.053356+0000","last_undegraded":"2023-07-14T11:18:43.053356+0000","last_fullsized":"2023-07-14T11:18:43.053356+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:48:50.222244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"87'3","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.047575+0000","last_change":"2023-07-14T11:18:42.034511+0000","last_active":"2023-07-14T11:18:43.047575+0000","last_peered":"2023-07-14T11:18:43.047575+0000","last_clean":"2023-07-14T11:18:43.047575+0000","last_became_active":"2023-07-14T11:18:42.034119+0000","last_became_peered":"2023-07-14T11:18:42.034119+0000","last_unstale":"2023-07-14T11:18:43.047575+0000","last_undegraded":"2023-07-14T11:18:43.047575+0000","last_fullsized":"2023-07-14T11:18:43.047575+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_clean_scrub_stamp":"2023-07-14T11:18:40.990355+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:53:18.078136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.030348+0000","last_change":"2023-07-14T11:18:43.024452+0000","last_active":"2023-07-14T11:18:43.030348+0000","last_peered":"2023-07-14T11:18:43.030348+0000","last_clean":"2023-07-14T11:18:43.030348+0000","last_became_active":"2023-07-14T11:18:43.024183+0000","last_became_peered":"2023-07-14T11:18:43.024183+0000","last_unstale":"2023-07-14T11:18:43.030348+0000","last_undegraded":"2023-07-14T11:18:43.030348+0000","last_fullsized":"2023-07-14T11:18:43.030348+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:08:57.641193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"87'6","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.053325+0000","last_change":"2023-07-14T11:18:42.030263+0000","last_active":"2023-07-14T11:18:43.053325+0000","last_peered":"2023-07-14T11:18:43.053325+0000","last_clean":"2023-07-14T11:18:43.053325+0000","last_became_active":"2023-07-14T11:18:42.029995+0000","last_became_peered":"2023-07-14T11:18:42.029995+0000","last_unstale":"2023-07-14T11:18:43.053325+0000","last_undegraded":"2023-07-14T11:18:43.053325+0000","last_fullsized":"2023-07-14T11:18:43.053325+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_clean_scrub_stamp":"2023-07-14T11:18:40.990355+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:51:29.602053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.040053+0000","last_change":"2023-07-14T11:18:43.028862+0000","last_active":"2023-07-14T11:18:43.040053+0000","last_peered":"2023-07-14T11:18:43.040053+0000","last_clean":"2023-07-14T11:18:43.040053+0000","last_became_active":"2023-07-14T11:18:43.028116+0000","last_became_peered":"2023-07-14T11:18:43.028116+0000","last_unstale":"2023-07-14T11:18:43.040053+0000","last_undegraded":"2023-07-14T11:18:43.040053+0000","last_fullsized":"2023-07-14T11:18:43.040053+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:13:07.574101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"87'2","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.047758+0000","last_change":"2023-07-14T11:18:42.033604+0000","last_active":"2023-07-14T11:18:43.047758+0000","last_peered":"2023-07-14T11:18:43.047758+0000","last_clean":"2023-07-14T11:18:43.047758+0000","last_became_active":"2023-07-14T11:18:42.033336+0000","last_became_peered":"2023-07-14T11:18:42.033336+0000","last_unstale":"2023-07-14T11:18:43.047758+0000","last_undegraded":"2023-07-14T11:18:43.047758+0000","last_fullsized":"2023-07-14T11:18:43.047758+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_clean_scrub_stamp":"2023-07-14T11:18:40.990355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:15:25.859448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.035589+0000","last_change":"2023-07-14T11:18:43.029184+0000","last_active":"2023-07-14T11:18:43.035589+0000","last_peered":"2023-07-14T11:18:43.035589+0000","last_clean":"2023-07-14T11:18:43.035589+0000","last_became_active":"2023-07-14T11:18:43.028892+0000","last_became_peered":"2023-07-14T11:18:43.028892+0000","last_unstale":"2023-07-14T11:18:43.035589+0000","last_undegraded":"2023-07-14T11:18:43.035589+0000","last_fullsized":"2023-07-14T11:18:43.035589+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:56:00.496099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.020815+0000","last_change":"2023-07-14T11:18:42.032058+0000","last_active":"2023-07-14T11:18:43.020815+0000","last_peered":"2023-07-14T11:18:43.020815+0000","last_clean":"2023-07-14T11:18:43.020815+0000","last_became_active":"2023-07-14T11:18:42.031778+0000","last_became_peered":"2023-07-14T11:18:42.031778+0000","last_unstale":"2023-07-14T11:18:43.020815+0000","last_undegraded":"2023-07-14T11:18:43.020815+0000","last_fullsized":"2023-07-14T11:18:43.020815+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_clean_scrub_stamp":"2023-07-14T11:18:40.990355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:39:14.626782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.026653+0000","last_change":"2023-07-14T11:18:43.019011+0000","last_active":"2023-07-14T11:18:43.026653+0000","last_peered":"2023-07-14T11:18:43.026653+0000","last_clean":"2023-07-14T11:18:43.026653+0000","last_became_active":"2023-07-14T11:18:43.018701+0000","last_became_peered":"2023-07-14T11:18:43.018701+0000","last_unstale":"2023-07-14T11:18:43.026653+0000","last_undegraded":"2023-07-14T11:18:43.026653+0000","last_fullsized":"2023-07-14T11:18:43.026653+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:51:36.888776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.011828+0000","last_change":"2023-07-14T11:18:42.025904+0000","last_active":"2023-07-14T11:18:43.011828+0000","last_peered":"2023-07-14T11:18:43.011828+0000","last_clean":"2023-07-14T11:18:43.011828+0000","last_became_active":"2023-07-14T11:18:42.025512+0000","last_became_peered":"2023-07-14T11:18:42.025512+0000","last_unstale":"2023-07-14T11:18:43.011828+0000","last_undegraded":"2023-07-14T11:18:43.011828+0000","last_fullsized":"2023-07-14T11:18:43.011828+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_clean_scrub_stamp":"2023-07-14T11:18:40.990355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:27:40.360663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.041009+0000","last_change":"2023-07-14T11:18:43.031424+0000","last_active":"2023-07-14T11:18:43.041009+0000","last_peered":"2023-07-14T11:18:43.041009+0000","last_clean":"2023-07-14T11:18:43.041009+0000","last_became_active":"2023-07-14T11:18:43.031169+0000","last_became_peered":"2023-07-14T11:18:43.031169+0000","last_unstale":"2023-07-14T11:18:43.041009+0000","last_undegraded":"2023-07-14T11:18:43.041009+0000","last_fullsized":"2023-07-14T11:18:43.041009+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:24:12.369696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"87'8","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.050242+0000","last_change":"2023-07-14T11:18:42.023239+0000","last_active":"2023-07-14T11:18:43.050242+0000","last_peered":"2023-07-14T11:18:43.050242+0000","last_clean":"2023-07-14T11:18:43.050242+0000","last_became_active":"2023-07-14T11:18:42.022292+0000","last_became_peered":"2023-07-14T11:18:42.022292+0000","last_unstale":"2023-07-14T11:18:43.050242+0000","last_undegraded":"2023-07-14T11:18:43.050242+0000","last_fullsized":"2023-07-14T11:18:43.050242+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_clean_scrub_stamp":"2023-07-14T11:18:40.990355+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:27:31.894674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.039799+0000","last_change":"2023-07-14T11:18:43.028000+0000","last_active":"2023-07-14T11:18:43.039799+0000","last_peered":"2023-07-14T11:18:43.039799+0000","last_clean":"2023-07-14T11:18:43.039799+0000","last_became_active":"2023-07-14T11:18:43.027666+0000","last_became_peered":"2023-07-14T11:18:43.027666+0000","last_unstale":"2023-07-14T11:18:43.039799+0000","last_undegraded":"2023-07-14T11:18:43.039799+0000","last_fullsized":"2023-07-14T11:18:43.039799+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:21:25.267325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"87'2","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.044532+0000","last_change":"2023-07-14T11:18:42.028778+0000","last_active":"2023-07-14T11:18:43.044532+0000","last_peered":"2023-07-14T11:18:43.044532+0000","last_clean":"2023-07-14T11:18:43.044532+0000","last_became_active":"2023-07-14T11:18:42.028426+0000","last_became_peered":"2023-07-14T11:18:42.028426+0000","last_unstale":"2023-07-14T11:18:43.044532+0000","last_undegraded":"2023-07-14T11:18:43.044532+0000","last_fullsized":"2023-07-14T11:18:43.044532+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_clean_scrub_stamp":"2023-07-14T11:18:40.990355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:50:05.349740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.046597+0000","last_change":"2023-07-14T11:18:43.044035+0000","last_active":"2023-07-14T11:18:43.046597+0000","last_peered":"2023-07-14T11:18:43.046597+0000","last_clean":"2023-07-14T11:18:43.046597+0000","last_became_active":"2023-07-14T11:18:43.043719+0000","last_became_peered":"2023-07-14T11:18:43.043719+0000","last_unstale":"2023-07-14T11:18:43.046597+0000","last_undegraded":"2023-07-14T11:18:43.046597+0000","last_fullsized":"2023-07-14T11:18:43.046597+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:48:15.008090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.024134+0000","last_change":"2023-07-14T11:18:42.022576+0000","last_active":"2023-07-14T11:18:43.024134+0000","last_peered":"2023-07-14T11:18:43.024134+0000","last_clean":"2023-07-14T11:18:43.024134+0000","last_became_active":"2023-07-14T11:18:42.022259+0000","last_became_peered":"2023-07-14T11:18:42.022259+0000","last_unstale":"2023-07-14T11:18:43.024134+0000","last_undegraded":"2023-07-14T11:18:43.024134+0000","last_fullsized":"2023-07-14T11:18:43.024134+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_clean_scrub_stamp":"2023-07-14T11:18:40.990355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:21:27.277609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.046300+0000","last_change":"2023-07-14T11:18:43.043783+0000","last_active":"2023-07-14T11:18:43.046300+0000","last_peered":"2023-07-14T11:18:43.046300+0000","last_clean":"2023-07-14T11:18:43.046300+0000","last_became_active":"2023-07-14T11:18:43.043411+0000","last_became_peered":"2023-07-14T11:18:43.043411+0000","last_unstale":"2023-07-14T11:18:43.046300+0000","last_undegraded":"2023-07-14T11:18:43.046300+0000","last_fullsized":"2023-07-14T11:18:43.046300+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:39:14.676081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.024477+0000","last_change":"2023-07-14T11:18:42.032169+0000","last_active":"2023-07-14T11:18:43.024477+0000","last_peered":"2023-07-14T11:18:43.024477+0000","last_clean":"2023-07-14T11:18:43.024477+0000","last_became_active":"2023-07-14T11:18:42.031800+0000","last_became_peered":"2023-07-14T11:18:42.031800+0000","last_unstale":"2023-07-14T11:18:43.024477+0000","last_undegraded":"2023-07-14T11:18:43.024477+0000","last_fullsized":"2023-07-14T11:18:43.024477+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_clean_scrub_stamp":"2023-07-14T11:18:40.990355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:55:26.346445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.033061+0000","last_change":"2023-07-14T11:18:43.030047+0000","last_active":"2023-07-14T11:18:43.033061+0000","last_peered":"2023-07-14T11:18:43.033061+0000","last_clean":"2023-07-14T11:18:43.033061+0000","last_became_active":"2023-07-14T11:18:43.029388+0000","last_became_peered":"2023-07-14T11:18:43.029388+0000","last_unstale":"2023-07-14T11:18:43.033061+0000","last_undegraded":"2023-07-14T11:18:43.033061+0000","last_fullsized":"2023-07-14T11:18:43.033061+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:09:08.761711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.018352+0000","last_change":"2023-07-14T11:18:42.025412+0000","last_active":"2023-07-14T11:18:43.018352+0000","last_peered":"2023-07-14T11:18:43.018352+0000","last_clean":"2023-07-14T11:18:43.018352+0000","last_became_active":"2023-07-14T11:18:42.025060+0000","last_became_peered":"2023-07-14T11:18:42.025060+0000","last_unstale":"2023-07-14T11:18:43.018352+0000","last_undegraded":"2023-07-14T11:18:43.018352+0000","last_fullsized":"2023-07-14T11:18:43.018352+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_clean_scrub_stamp":"2023-07-14T11:18:40.990355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:52:32.381129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.041160+0000","last_change":"2023-07-14T11:18:43.037751+0000","last_active":"2023-07-14T11:18:43.041160+0000","last_peered":"2023-07-14T11:18:43.041160+0000","last_clean":"2023-07-14T11:18:43.041160+0000","last_became_active":"2023-07-14T11:18:43.037476+0000","last_became_peered":"2023-07-14T11:18:43.037476+0000","last_unstale":"2023-07-14T11:18:43.041160+0000","last_undegraded":"2023-07-14T11:18:43.041160+0000","last_fullsized":"2023-07-14T11:18:43.041160+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:58:43.599776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.022890+0000","last_change":"2023-07-14T11:18:42.032462+0000","last_active":"2023-07-14T11:18:43.022890+0000","last_peered":"2023-07-14T11:18:43.022890+0000","last_clean":"2023-07-14T11:18:43.022890+0000","last_became_active":"2023-07-14T11:18:42.032191+0000","last_became_peered":"2023-07-14T11:18:42.032191+0000","last_unstale":"2023-07-14T11:18:43.022890+0000","last_undegraded":"2023-07-14T11:18:43.022890+0000","last_fullsized":"2023-07-14T11:18:43.022890+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_clean_scrub_stamp":"2023-07-14T11:18:40.990355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:40:23.166911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.040063+0000","last_change":"2023-07-14T11:18:43.032919+0000","last_active":"2023-07-14T11:18:43.040063+0000","last_peered":"2023-07-14T11:18:43.040063+0000","last_clean":"2023-07-14T11:18:43.040063+0000","last_became_active":"2023-07-14T11:18:43.032588+0000","last_became_peered":"2023-07-14T11:18:43.032588+0000","last_unstale":"2023-07-14T11:18:43.040063+0000","last_undegraded":"2023-07-14T11:18:43.040063+0000","last_fullsized":"2023-07-14T11:18:43.040063+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:01:29.635020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.017641+0000","last_change":"2023-07-14T11:18:42.030094+0000","last_active":"2023-07-14T11:18:43.017641+0000","last_peered":"2023-07-14T11:18:43.017641+0000","last_clean":"2023-07-14T11:18:43.017641+0000","last_became_active":"2023-07-14T11:18:42.029816+0000","last_became_peered":"2023-07-14T11:18:42.029816+0000","last_unstale":"2023-07-14T11:18:43.017641+0000","last_undegraded":"2023-07-14T11:18:43.017641+0000","last_fullsized":"2023-07-14T11:18:43.017641+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_clean_scrub_stamp":"2023-07-14T11:18:40.990355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:50:17.071887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.038886+0000","last_change":"2023-07-14T11:18:43.033458+0000","last_active":"2023-07-14T11:18:43.038886+0000","last_peered":"2023-07-14T11:18:43.038886+0000","last_clean":"2023-07-14T11:18:43.038886+0000","last_became_active":"2023-07-14T11:18:43.033109+0000","last_became_peered":"2023-07-14T11:18:43.033109+0000","last_unstale":"2023-07-14T11:18:43.038886+0000","last_undegraded":"2023-07-14T11:18:43.038886+0000","last_fullsized":"2023-07-14T11:18:43.038886+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:49:53.538726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.018390+0000","last_change":"2023-07-14T11:18:42.023835+0000","last_active":"2023-07-14T11:18:43.018390+0000","last_peered":"2023-07-14T11:18:43.018390+0000","last_clean":"2023-07-14T11:18:43.018390+0000","last_became_active":"2023-07-14T11:18:42.023526+0000","last_became_peered":"2023-07-14T11:18:42.023526+0000","last_unstale":"2023-07-14T11:18:43.018390+0000","last_undegraded":"2023-07-14T11:18:43.018390+0000","last_fullsized":"2023-07-14T11:18:43.018390+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_clean_scrub_stamp":"2023-07-14T11:18:40.990355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:31:19.889949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.046162+0000","last_change":"2023-07-14T11:18:43.042676+0000","last_active":"2023-07-14T11:18:43.046162+0000","last_peered":"2023-07-14T11:18:43.046162+0000","last_clean":"2023-07-14T11:18:43.046162+0000","last_became_active":"2023-07-14T11:18:43.042409+0000","last_became_peered":"2023-07-14T11:18:43.042409+0000","last_unstale":"2023-07-14T11:18:43.046162+0000","last_undegraded":"2023-07-14T11:18:43.046162+0000","last_fullsized":"2023-07-14T11:18:43.046162+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:13:07.024735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.011850+0000","last_change":"2023-07-14T11:18:42.030312+0000","last_active":"2023-07-14T11:18:43.011850+0000","last_peered":"2023-07-14T11:18:43.011850+0000","last_clean":"2023-07-14T11:18:43.011850+0000","last_became_active":"2023-07-14T11:18:42.029972+0000","last_became_peered":"2023-07-14T11:18:42.029972+0000","last_unstale":"2023-07-14T11:18:43.011850+0000","last_undegraded":"2023-07-14T11:18:43.011850+0000","last_fullsized":"2023-07-14T11:18:43.011850+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_clean_scrub_stamp":"2023-07-14T11:18:40.990355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:12:30.717522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.046180+0000","last_change":"2023-07-14T11:18:43.043479+0000","last_active":"2023-07-14T11:18:43.046180+0000","last_peered":"2023-07-14T11:18:43.046180+0000","last_clean":"2023-07-14T11:18:43.046180+0000","last_became_active":"2023-07-14T11:18:43.043207+0000","last_became_peered":"2023-07-14T11:18:43.043207+0000","last_unstale":"2023-07-14T11:18:43.046180+0000","last_undegraded":"2023-07-14T11:18:43.046180+0000","last_fullsized":"2023-07-14T11:18:43.046180+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:55:54.662222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.015060+0000","last_change":"2023-07-14T11:18:42.026780+0000","last_active":"2023-07-14T11:18:43.015060+0000","last_peered":"2023-07-14T11:18:43.015060+0000","last_clean":"2023-07-14T11:18:43.015060+0000","last_became_active":"2023-07-14T11:18:42.026460+0000","last_became_peered":"2023-07-14T11:18:42.026460+0000","last_unstale":"2023-07-14T11:18:43.015060+0000","last_undegraded":"2023-07-14T11:18:43.015060+0000","last_fullsized":"2023-07-14T11:18:43.015060+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_clean_scrub_stamp":"2023-07-14T11:18:40.990355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:27:49.009555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":133,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.017998+0000","last_change":"2023-07-14T11:13:08.762084+0000","last_active":"2023-07-14T11:18:43.017998+0000","last_peered":"2023-07-14T11:18:43.017998+0000","last_clean":"2023-07-14T11:18:43.017998+0000","last_became_active":"2023-07-14T11:13:08.761763+0000","last_became_peered":"2023-07-14T11:13:08.761763+0000","last_unstale":"2023-07-14T11:18:43.017998+0000","last_undegraded":"2023-07-14T11:18:43.017998+0000","last_fullsized":"2023-07-14T11:18:43.017998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:36:23.065011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.037004+0000","last_change":"2023-07-14T11:18:43.032542+0000","last_active":"2023-07-14T11:18:43.037004+0000","last_peered":"2023-07-14T11:18:43.037004+0000","last_clean":"2023-07-14T11:18:43.037004+0000","last_became_active":"2023-07-14T11:18:43.032249+0000","last_became_peered":"2023-07-14T11:18:43.032249+0000","last_unstale":"2023-07-14T11:18:43.037004+0000","last_undegraded":"2023-07-14T11:18:43.037004+0000","last_fullsized":"2023-07-14T11:18:43.037004+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:16:41.903935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.017766+0000","last_change":"2023-07-14T11:18:42.031228+0000","last_active":"2023-07-14T11:18:43.017766+0000","last_peered":"2023-07-14T11:18:43.017766+0000","last_clean":"2023-07-14T11:18:43.017766+0000","last_became_active":"2023-07-14T11:18:42.030942+0000","last_became_peered":"2023-07-14T11:18:42.030942+0000","last_unstale":"2023-07-14T11:18:43.017766+0000","last_undegraded":"2023-07-14T11:18:43.017766+0000","last_fullsized":"2023-07-14T11:18:43.017766+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_clean_scrub_stamp":"2023-07-14T11:18:40.990355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:27:40.360663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":149,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.010824+0000","last_change":"2023-07-14T11:13:08.761726+0000","last_active":"2023-07-14T11:18:43.010824+0000","last_peered":"2023-07-14T11:18:43.010824+0000","last_clean":"2023-07-14T11:18:43.010824+0000","last_became_active":"2023-07-14T11:13:08.761365+0000","last_became_peered":"2023-07-14T11:13:08.761365+0000","last_unstale":"2023-07-14T11:18:43.010824+0000","last_undegraded":"2023-07-14T11:18:43.010824+0000","last_fullsized":"2023-07-14T11:18:43.010824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:31:52.972429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.033007+0000","last_change":"2023-07-14T11:18:43.029225+0000","last_active":"2023-07-14T11:18:43.033007+0000","last_peered":"2023-07-14T11:18:43.033007+0000","last_clean":"2023-07-14T11:18:43.033007+0000","last_became_active":"2023-07-14T11:18:43.028948+0000","last_became_peered":"2023-07-14T11:18:43.028948+0000","last_unstale":"2023-07-14T11:18:43.033007+0000","last_undegraded":"2023-07-14T11:18:43.033007+0000","last_fullsized":"2023-07-14T11:18:43.033007+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:30:20.877390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.014835+0000","last_change":"2023-07-14T11:18:42.024189+0000","last_active":"2023-07-14T11:18:43.014835+0000","last_peered":"2023-07-14T11:18:43.014835+0000","last_clean":"2023-07-14T11:18:43.014835+0000","last_became_active":"2023-07-14T11:18:42.023872+0000","last_became_peered":"2023-07-14T11:18:42.023872+0000","last_unstale":"2023-07-14T11:18:43.014835+0000","last_undegraded":"2023-07-14T11:18:43.014835+0000","last_fullsized":"2023-07-14T11:18:43.014835+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_clean_scrub_stamp":"2023-07-14T11:18:40.990355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:03:08.555415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":123,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.012890+0000","last_change":"2023-07-14T11:13:08.923899+0000","last_active":"2023-07-14T11:18:43.012890+0000","last_peered":"2023-07-14T11:18:43.012890+0000","last_clean":"2023-07-14T11:18:43.012890+0000","last_became_active":"2023-07-14T11:13:08.923513+0000","last_became_peered":"2023-07-14T11:13:08.923513+0000","last_unstale":"2023-07-14T11:18:43.012890+0000","last_undegraded":"2023-07-14T11:18:43.012890+0000","last_fullsized":"2023-07-14T11:18:43.012890+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:28:41.442376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.046263+0000","last_change":"2023-07-14T11:18:43.043369+0000","last_active":"2023-07-14T11:18:43.046263+0000","last_peered":"2023-07-14T11:18:43.046263+0000","last_clean":"2023-07-14T11:18:43.046263+0000","last_became_active":"2023-07-14T11:18:43.043096+0000","last_became_peered":"2023-07-14T11:18:43.043096+0000","last_unstale":"2023-07-14T11:18:43.046263+0000","last_undegraded":"2023-07-14T11:18:43.046263+0000","last_fullsized":"2023-07-14T11:18:43.046263+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:17:41.196270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"87'1","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.044776+0000","last_change":"2023-07-14T11:18:42.028359+0000","last_active":"2023-07-14T11:18:43.044776+0000","last_peered":"2023-07-14T11:18:43.044776+0000","last_clean":"2023-07-14T11:18:43.044776+0000","last_became_active":"2023-07-14T11:18:42.027788+0000","last_became_peered":"2023-07-14T11:18:42.027788+0000","last_unstale":"2023-07-14T11:18:43.044776+0000","last_undegraded":"2023-07-14T11:18:43.044776+0000","last_fullsized":"2023-07-14T11:18:43.044776+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_clean_scrub_stamp":"2023-07-14T11:18:40.990355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:06:45.226799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":123,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.013060+0000","last_change":"2023-07-14T11:13:08.760609+0000","last_active":"2023-07-14T11:18:43.013060+0000","last_peered":"2023-07-14T11:18:43.013060+0000","last_clean":"2023-07-14T11:18:43.013060+0000","last_became_active":"2023-07-14T11:13:08.760285+0000","last_became_peered":"2023-07-14T11:13:08.760285+0000","last_unstale":"2023-07-14T11:18:43.013060+0000","last_undegraded":"2023-07-14T11:18:43.013060+0000","last_fullsized":"2023-07-14T11:18:43.013060+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:18:35.419982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.041332+0000","last_change":"2023-07-14T11:18:43.032476+0000","last_active":"2023-07-14T11:18:43.041332+0000","last_peered":"2023-07-14T11:18:43.041332+0000","last_clean":"2023-07-14T11:18:43.041332+0000","last_became_active":"2023-07-14T11:18:43.032161+0000","last_became_peered":"2023-07-14T11:18:43.032161+0000","last_unstale":"2023-07-14T11:18:43.041332+0000","last_undegraded":"2023-07-14T11:18:43.041332+0000","last_fullsized":"2023-07-14T11:18:43.041332+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:06:52.742219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.012199+0000","last_change":"2023-07-14T11:18:42.020267+0000","last_active":"2023-07-14T11:18:43.012199+0000","last_peered":"2023-07-14T11:18:43.012199+0000","last_clean":"2023-07-14T11:18:43.012199+0000","last_became_active":"2023-07-14T11:18:42.019957+0000","last_became_peered":"2023-07-14T11:18:42.019957+0000","last_unstale":"2023-07-14T11:18:43.012199+0000","last_undegraded":"2023-07-14T11:18:43.012199+0000","last_fullsized":"2023-07-14T11:18:43.012199+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_clean_scrub_stamp":"2023-07-14T11:18:40.990355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:00:27.837182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"76'128","reported_seq":318,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.013174+0000","last_change":"2023-07-14T11:13:01.370649+0000","last_active":"2023-07-14T11:18:43.013174+0000","last_peered":"2023-07-14T11:18:43.013174+0000","last_clean":"2023-07-14T11:18:43.013174+0000","last_became_active":"2023-07-14T11:13:01.369478+0000","last_became_peered":"2023-07-14T11:13:01.369478+0000","last_unstale":"2023-07-14T11:18:43.013174+0000","last_undegraded":"2023-07-14T11:18:43.013174+0000","last_fullsized":"2023-07-14T11:18:43.013174+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:00.254800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:00.254800+0000","last_clean_scrub_stamp":"2023-07-14T11:13:00.254800+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:50:18.194529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":135,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.016830+0000","last_change":"2023-07-14T11:13:08.757882+0000","last_active":"2023-07-14T11:18:43.016830+0000","last_peered":"2023-07-14T11:18:43.016830+0000","last_clean":"2023-07-14T11:18:43.016830+0000","last_became_active":"2023-07-14T11:13:08.757541+0000","last_became_peered":"2023-07-14T11:13:08.757541+0000","last_unstale":"2023-07-14T11:18:43.016830+0000","last_undegraded":"2023-07-14T11:18:43.016830+0000","last_fullsized":"2023-07-14T11:18:43.016830+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:03:23.386388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.035959+0000","last_change":"2023-07-14T11:18:43.025581+0000","last_active":"2023-07-14T11:18:43.035959+0000","last_peered":"2023-07-14T11:18:43.035959+0000","last_clean":"2023-07-14T11:18:43.035959+0000","last_became_active":"2023-07-14T11:18:43.025228+0000","last_became_peered":"2023-07-14T11:18:43.025228+0000","last_unstale":"2023-07-14T11:18:43.035959+0000","last_undegraded":"2023-07-14T11:18:43.035959+0000","last_fullsized":"2023-07-14T11:18:43.035959+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:03:59.946702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"87'2","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.044425+0000","last_change":"2023-07-14T11:18:42.031822+0000","last_active":"2023-07-14T11:18:43.044425+0000","last_peered":"2023-07-14T11:18:43.044425+0000","last_clean":"2023-07-14T11:18:43.044425+0000","last_became_active":"2023-07-14T11:18:42.031449+0000","last_became_peered":"2023-07-14T11:18:42.031449+0000","last_unstale":"2023-07-14T11:18:43.044425+0000","last_undegraded":"2023-07-14T11:18:43.044425+0000","last_fullsized":"2023-07-14T11:18:43.044425+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_clean_scrub_stamp":"2023-07-14T11:18:40.990355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:41:06.955653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":141,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.014987+0000","last_change":"2023-07-14T11:13:08.862331+0000","last_active":"2023-07-14T11:18:43.014987+0000","last_peered":"2023-07-14T11:18:43.014987+0000","last_clean":"2023-07-14T11:18:43.014987+0000","last_became_active":"2023-07-14T11:13:08.861817+0000","last_became_peered":"2023-07-14T11:13:08.861817+0000","last_unstale":"2023-07-14T11:18:43.014987+0000","last_undegraded":"2023-07-14T11:18:43.014987+0000","last_fullsized":"2023-07-14T11:18:43.014987+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:45:56.431738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.042671+0000","last_change":"2023-07-14T11:18:43.040711+0000","last_active":"2023-07-14T11:18:43.042671+0000","last_peered":"2023-07-14T11:18:43.042671+0000","last_clean":"2023-07-14T11:18:43.042671+0000","last_became_active":"2023-07-14T11:18:43.040346+0000","last_became_peered":"2023-07-14T11:18:43.040346+0000","last_unstale":"2023-07-14T11:18:43.042671+0000","last_undegraded":"2023-07-14T11:18:43.042671+0000","last_fullsized":"2023-07-14T11:18:43.042671+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:57:21.782419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"87'1","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.045463+0000","last_change":"2023-07-14T11:18:42.021394+0000","last_active":"2023-07-14T11:18:43.045463+0000","last_peered":"2023-07-14T11:18:43.045463+0000","last_clean":"2023-07-14T11:18:43.045463+0000","last_became_active":"2023-07-14T11:18:42.021128+0000","last_became_peered":"2023-07-14T11:18:42.021128+0000","last_unstale":"2023-07-14T11:18:43.045463+0000","last_undegraded":"2023-07-14T11:18:43.045463+0000","last_fullsized":"2023-07-14T11:18:43.045463+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_clean_scrub_stamp":"2023-07-14T11:18:40.990355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:04:28.144685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":135,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.017866+0000","last_change":"2023-07-14T11:13:08.758749+0000","last_active":"2023-07-14T11:18:43.017866+0000","last_peered":"2023-07-14T11:18:43.017866+0000","last_clean":"2023-07-14T11:18:43.017866+0000","last_became_active":"2023-07-14T11:13:08.757956+0000","last_became_peered":"2023-07-14T11:13:08.757956+0000","last_unstale":"2023-07-14T11:18:43.017866+0000","last_undegraded":"2023-07-14T11:18:43.017866+0000","last_fullsized":"2023-07-14T11:18:43.017866+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:36:50.720839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.045885+0000","last_change":"2023-07-14T11:18:43.034811+0000","last_active":"2023-07-14T11:18:43.045885+0000","last_peered":"2023-07-14T11:18:43.045885+0000","last_clean":"2023-07-14T11:18:43.045885+0000","last_became_active":"2023-07-14T11:18:43.034505+0000","last_became_peered":"2023-07-14T11:18:43.034505+0000","last_unstale":"2023-07-14T11:18:43.045885+0000","last_undegraded":"2023-07-14T11:18:43.045885+0000","last_fullsized":"2023-07-14T11:18:43.045885+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:41.997532+0000","last_clean_scrub_stamp":"2023-07-14T11:18:41.997532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:05:44.918734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"87'2","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.044262+0000","last_change":"2023-07-14T11:18:42.030420+0000","last_active":"2023-07-14T11:18:43.044262+0000","last_peered":"2023-07-14T11:18:43.044262+0000","last_clean":"2023-07-14T11:18:43.044262+0000","last_became_active":"2023-07-14T11:18:42.030061+0000","last_became_peered":"2023-07-14T11:18:42.030061+0000","last_unstale":"2023-07-14T11:18:43.044262+0000","last_undegraded":"2023-07-14T11:18:43.044262+0000","last_fullsized":"2023-07-14T11:18:43.044262+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:18:40.990355+0000","last_clean_scrub_stamp":"2023-07-14T11:18:40.990355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:27:31.894674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":149,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-14T11:18:43.012052+0000","last_change":"2023-07-14T11:13:08.923786+0000","last_active":"2023-07-14T11:18:43.012052+0000","last_peered":"2023-07-14T11:18:43.012052+0000","last_clean":"2023-07-14T11:18:43.012052+0000","last_became_active":"2023-07-14T11:13:08.923384+0000","last_became_peered":"2023-07-14T11:13:08.923384+0000","last_unstale":"2023-07-14T11:18:43.012052+0000","last_undegraded":"2023-07-14T11:18:43.012052+0000","last_fullsized":"2023-07-14T11:18:43.012052+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:52:05.516882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574921,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28584,"kb_used_data":1632,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343256,"statfs":{"total":96636764160,"available":96607494144,"internally_reserved":0,"allocated":1671168,"data_stored":1076370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.71799999999999997,"15min":0.91300000000000003},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.877,"5min":8.4339999999999993,"15min":8.4339999999999993},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.76000000000000001,"15min":0.95099999999999996},"min":{"1min":0.45500000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.78600000000000003,"5min":8.4559999999999995,"15min":8.4559999999999995},"last":0.55200000000000005}]},{"osd":1,"last update":"Fri Jul 14 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.72899999999999998,"15min":0.89000000000000001},"min":{"1min":0.42499999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.81799999999999995,"5min":6.3520000000000003,"15min":6.3520000000000003},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.76300000000000001,"15min":1.0429999999999999},"min":{"1min":0.47799999999999998,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.81499999999999995,"5min":6.8550000000000004,"15min":6.8550000000000004},"last":0.51200000000000001}]},{"osd":2,"last update":"Fri Jul 14 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.79000000000000004,"15min":1.0960000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.997,"5min":7.0289999999999999,"15min":7.0289999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.69699999999999995,"15min":0.69099999999999995},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.94999999999999996,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.442}]},{"osd":3,"last update":"Fri Jul 14 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.81799999999999995,"15min":1.1519999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.76500000000000001,"5min":10.337,"15min":10.337},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.73499999999999999,"15min":0.76100000000000001},"min":{"1min":0.53600000000000003,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.024,"5min":1.921,"15min":1.921},"last":0.53300000000000003}]},{"osd":4,"last update":"Fri Jul 14 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.64000000000000001,"15min":0.59599999999999997},"min":{"1min":0.42299999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.73199999999999998,"15min":0.70399999999999996},"min":{"1min":0.55500000000000005,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0580000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.67800000000000005}]},{"osd":5,"last update":"Fri Jul 14 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.69699999999999995,"15min":0.67800000000000005},"min":{"1min":0.42099999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.755,"15min":0.73699999999999999},"min":{"1min":0.58799999999999997,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.96699999999999997,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.66200000000000003}]},{"osd":6,"last update":"Fri Jul 14 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71999999999999997,"15min":0.68000000000000005},"min":{"1min":0.54600000000000004,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.85999999999999999,"5min":1.002,"15min":1.002},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.72899999999999998,"15min":0.69299999999999995},"min":{"1min":0.53500000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.72199999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574922,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28016,"kb_used_data":1064,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343824,"statfs":{"total":96636764160,"available":96608075776,"internally_reserved":0,"allocated":1089536,"data_stored":488114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:18:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.71399999999999997,"15min":0.70799999999999996},"min":{"1min":0.54100000000000004,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.998,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.499},{"interface":"front","average":{"1min":0.745,"5min":0.74099999999999999,"15min":0.72299999999999998},"min":{"1min":0.47799999999999998,"5min":0.441,"15min":0.441},"max":{"1min":0.99299999999999999,"5min":1.167,"15min":1.167},"last":0.79700000000000004}]},{"osd":1,"last update":"Fri Jul 14 11:18:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.71099999999999997,"15min":0.68899999999999995},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.90000000000000002,"5min":1.006,"15min":1.006},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.74099999999999999,"15min":0.71699999999999997},"min":{"1min":0.57699999999999996,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.94299999999999995,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.748}]},{"osd":2,"last update":"Fri Jul 14 11:18:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70099999999999996,"15min":0.67900000000000005},"min":{"1min":0.50700000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.88800000000000001,"5min":1.45,"15min":1.45},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.76000000000000001,"15min":0.77800000000000002},"min":{"1min":0.496,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.97099999999999997,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.60799999999999998}]},{"osd":3,"last update":"Fri Jul 14 11:18:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.746,"15min":0.748},"min":{"1min":0.56000000000000005,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.89400000000000002,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.95899999999999996,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.63700000000000001}]},{"osd":4,"last update":"Fri Jul 14 11:18:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68300000000000005,"15min":0.70399999999999996},"min":{"1min":0.40500000000000003,"5min":0.38,"15min":0.38},"max":{"1min":0.96499999999999997,"5min":1.712,"15min":1.712},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.71999999999999997,"15min":0.72599999999999998},"min":{"1min":0.44400000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0680000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.83899999999999997}]},{"osd":5,"last update":"Fri Jul 14 11:18:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.71499999999999997,"15min":0.71899999999999997},"min":{"1min":0.56999999999999995,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.0109999999999999,"5min":2.8820000000000001,"15min":2.8820000000000001},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.77300000000000002,"15min":0.78800000000000003},"min":{"1min":0.67300000000000004,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0449999999999999,"5min":1.129,"15min":1.129},"last":0.70599999999999996}]},{"osd":7,"last update":"Fri Jul 14 11:18:09 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.78200000000000003,"15min":0.80200000000000005},"min":{"1min":0.60699999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.1220000000000001,"5min":1.333,"15min":1.333},"last":0.879},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.76900000000000002,"15min":0.79100000000000004},"min":{"1min":0.64000000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.04,"5min":1.55,"15min":1.55},"last":0.77900000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574921,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28000,"kb_used_data":1048,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343840,"statfs":{"total":96636764160,"available":96608092160,"internally_reserved":0,"allocated":1073152,"data_stored":486016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.41099999999999998,"15min":0.434},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.55500000000000005,"5min":0.996,"15min":0.996},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.433,"5min":0.46600000000000003,"15min":0.47999999999999998},"min":{"1min":0.30199999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.58499999999999996,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.38}]},{"osd":2,"last update":"Fri Jul 14 11:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.502,"15min":0.55600000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.64700000000000002,"5min":2.476,"15min":2.476},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.52500000000000002,"15min":0.60699999999999998},"min":{"1min":0.38100000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.91700000000000004,"5min":2.6299999999999999,"15min":2.6299999999999999},"last":0.442}]},{"osd":3,"last update":"Fri Jul 14 11:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.52900000000000003,"15min":0.52200000000000002},"min":{"1min":0.42599999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.63100000000000001,"5min":0.748,"15min":0.748},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.47199999999999998,"15min":0.48999999999999999},"min":{"1min":0.35299999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.54800000000000004,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.42199999999999999}]},{"osd":4,"last update":"Fri Jul 14 11:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.74399999999999999,"15min":0.751},"min":{"1min":0.61099999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.91600000000000004,"5min":1.363,"15min":1.363},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.75900000000000001,"15min":0.77100000000000002},"min":{"1min":0.55400000000000005,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.89000000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.57099999999999995}]},{"osd":5,"last update":"Fri Jul 14 11:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.75800000000000001,"15min":0.76800000000000002},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.84799999999999998,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.77500000000000002,"15min":0.81200000000000006},"min":{"1min":0.60199999999999998,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.0660000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.59099999999999997}]},{"osd":6,"last update":"Fri Jul 14 11:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.753,"15min":0.79100000000000004},"min":{"1min":0.51900000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.91800000000000004,"5min":1.298,"15min":1.298},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.76500000000000001,"15min":0.78300000000000003},"min":{"1min":0.58999999999999997,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.92400000000000004,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.71499999999999997}]},{"osd":7,"last update":"Fri Jul 14 11:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.77000000000000002,"15min":0.81000000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.028,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.76000000000000001,"15min":0.78200000000000003},"min":{"1min":0.57099999999999995,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.879,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.68400000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574919,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28600,"kb_used_data":1648,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343240,"statfs":{"total":96636764160,"available":96607477760,"internally_reserved":0,"allocated":1687552,"data_stored":1078584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 11:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.44900000000000001,"15min":0.438},"min":{"1min":0.34999999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.58899999999999997,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.44800000000000001,"15min":0.442},"min":{"1min":0.34999999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.443}]},{"osd":2,"last update":"Fri Jul 14 11:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.35799999999999998,"5min":0.307,"15min":0.307},"max":{"1min":0.54400000000000004,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.498,"15min":0.502},"min":{"1min":0.435,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.69199999999999995,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.40100000000000002}]},{"osd":3,"last update":"Fri Jul 14 11:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45600000000000002,"15min":0.42999999999999999},"min":{"1min":0.35899999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.66400000000000003,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.42699999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.64300000000000002,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.47899999999999998}]},{"osd":4,"last update":"Fri Jul 14 11:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.75600000000000001,"15min":0.76400000000000001},"min":{"1min":0.53500000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0289999999999999,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.70999999999999996},"min":{"1min":0.60499999999999998,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.92600000000000005,"5min":1.101,"15min":1.101},"last":0.77800000000000002}]},{"osd":5,"last update":"Fri Jul 14 11:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.748,"15min":0.72999999999999998},"min":{"1min":0.61799999999999999,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.88500000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.77000000000000002,"15min":0.77800000000000002},"min":{"1min":0.57599999999999996,"5min":0.505,"15min":0.505},"max":{"1min":0.99299999999999999,"5min":1.04,"15min":1.04},"last":0.72599999999999998}]},{"osd":6,"last update":"Fri Jul 14 11:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.73899999999999999,"15min":0.72599999999999998},"min":{"1min":0.55800000000000005,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.97699999999999998,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.77600000000000002,"15min":0.78000000000000003},"min":{"1min":0.623,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.98299999999999998,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.746}]},{"osd":7,"last update":"Fri Jul 14 11:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.79700000000000004,"15min":0.81599999999999995},"min":{"1min":0.57299999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.94499999999999995,"5min":1.149,"15min":1.149},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.80700000000000005,"15min":0.78500000000000003},"min":{"1min":0.66100000000000003,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.014,"5min":1.081,"15min":1.081},"last":0.82199999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574919,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27996,"kb_used_data":1044,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343844,"statfs":{"total":96636764160,"available":96608096256,"internally_reserved":0,"allocated":1069056,"data_stored":485946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:18:18 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.41499999999999998,"15min":0.443},"min":{"1min":0.248,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.54700000000000004,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.442,"15min":0.44600000000000001},"min":{"1min":0.28799999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.63100000000000001,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.36599999999999999}]},{"osd":1,"last update":"Fri Jul 14 11:18:18 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.47099999999999997,"15min":0.48299999999999998},"min":{"1min":0.31900000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.64300000000000002,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.497},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.48499999999999999,"15min":0.48899999999999999},"min":{"1min":0.38,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.57899999999999996,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.432}]},{"osd":3,"last update":"Fri Jul 14 11:18:18 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.49199999999999999,"15min":0.49399999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.57499999999999996,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.56299999999999994,"15min":0.58199999999999996},"min":{"1min":0.41499999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.60899999999999999,"5min":1.034,"15min":1.034},"last":0.627}]},{"osd":4,"last update":"Fri Jul 14 11:18:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.752,"15min":0.76900000000000002},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.92600000000000005,"5min":1.212,"15min":1.212},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.76200000000000001,"15min":0.78300000000000003},"min":{"1min":0.52800000000000002,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.86399999999999999,"5min":1.198,"15min":1.198},"last":0.56200000000000006}]},{"osd":5,"last update":"Fri Jul 14 11:18:18 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.78700000000000003},"min":{"1min":0.51700000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.97299999999999998,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.78100000000000003,"15min":0.81699999999999995},"min":{"1min":0.53500000000000003,"5min":0.495,"15min":0.495},"max":{"1min":0.89200000000000002,"5min":1.351,"15min":1.351},"last":0.80100000000000005}]},{"osd":6,"last update":"Fri Jul 14 11:18:18 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.76900000000000002,"15min":0.78600000000000003},"min":{"1min":0.56100000000000005,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.94099999999999995,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.78000000000000003,"15min":0.81699999999999995},"min":{"1min":0.60699999999999998,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.032,"5min":1.282,"15min":1.282},"last":0.66700000000000004}]},{"osd":7,"last update":"Fri Jul 14 11:18:18 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.78000000000000003,"15min":0.80000000000000004},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.92400000000000004,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.77000000000000002,"15min":0.80200000000000005},"min":{"1min":0.57299999999999995,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.91100000000000003,"5min":1.244,"15min":1.244},"last":0.81999999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574919,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27996,"kb_used_data":1044,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343844,"statfs":{"total":96636764160,"available":96608096256,"internally_reserved":0,"allocated":1069056,"data_stored":485946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:18:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.41999999999999998,"15min":0.44500000000000001},"min":{"1min":0.28899999999999998,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.311,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.63600000000000001,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.40699999999999997}]},{"osd":1,"last update":"Fri Jul 14 11:18:06 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44900000000000001,"15min":0.45200000000000001},"min":{"1min":0.30199999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.44,"5min":0.48099999999999998,"15min":0.49399999999999999},"min":{"1min":0.35399999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.56599999999999995,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.42699999999999999}]},{"osd":2,"last update":"Fri Jul 14 11:18:06 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.54200000000000004,"15min":0.54300000000000004},"min":{"1min":0.36699999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.441},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.57199999999999995,"15min":0.59299999999999997},"min":{"1min":0.45100000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.69299999999999995,"5min":1.585,"15min":1.585},"last":0.48699999999999999}]},{"osd":4,"last update":"Fri Jul 14 11:18:06 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.754,"15min":0.76100000000000001},"min":{"1min":0.48699999999999999,"5min":0.372,"15min":0.372},"max":{"1min":1.1279999999999999,"5min":1.216,"15min":1.216},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.77500000000000002,"15min":0.75900000000000001},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.61699999999999999}]},{"osd":5,"last update":"Fri Jul 14 11:18:06 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.76500000000000001,"15min":0.76300000000000001},"min":{"1min":0.504,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.179,"5min":1.413,"15min":1.413},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.79800000000000004,"15min":0.84499999999999997},"min":{"1min":0.54000000000000004,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1539999999999999,"5min":1.657,"15min":1.657},"last":0.69099999999999995}]},{"osd":6,"last update":"Fri Jul 14 11:18:06 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.77800000000000002,"15min":0.78300000000000003},"min":{"1min":0.52300000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.98299999999999998,"5min":1.726,"15min":1.726},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.77900000000000003,"15min":0.79700000000000004},"min":{"1min":0.53800000000000003,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.286,"5min":1.333,"15min":1.333},"last":0.70399999999999996}]},{"osd":7,"last update":"Fri Jul 14 11:18:06 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.80900000000000005,"15min":0.83499999999999996},"min":{"1min":0.497,"5min":0.437,"15min":0.437},"max":{"1min":1.244,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.81899999999999995,"15min":0.83699999999999997},"min":{"1min":0.57599999999999996,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0740000000000001,"5min":1.268,"15min":1.268},"last":0.80700000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574919,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":1032,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":1056768,"data_stored":478818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.64000000000000001,"15min":0.63200000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.80100000000000005,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.65800000000000003,"15min":0.68600000000000005},"min":{"1min":0.38800000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.76500000000000001,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.67000000000000004}]},{"osd":1,"last update":"Fri Jul 14 11:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.65300000000000002,"15min":0.66700000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.79900000000000004,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.70599999999999996,"15min":0.71099999999999997},"min":{"1min":0.50800000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.84799999999999998,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.55300000000000005}]},{"osd":2,"last update":"Fri Jul 14 11:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.70799999999999996,"15min":0.70999999999999996},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.879,"5min":1.48,"15min":1.48},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.72499999999999998,"15min":0.73699999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.875,"5min":1.23,"15min":1.23},"last":0.60099999999999998}]},{"osd":3,"last update":"Fri Jul 14 11:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.68500000000000005,"15min":0.71099999999999997},"min":{"1min":0.49399999999999999,"5min":0.438,"15min":0.438},"max":{"1min":0.79900000000000004,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.91100000000000003,"5min":1.145,"15min":1.145},"last":0.68500000000000005}]},{"osd":5,"last update":"Fri Jul 14 11:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.69699999999999995,"15min":0.753},"min":{"1min":0.42999999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.92900000000000005,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.68799999999999994,"15min":0.755},"min":{"1min":0.44400000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.874,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.51900000000000002}]},{"osd":6,"last update":"Fri Jul 14 11:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.70299999999999996,"15min":0.71899999999999997},"min":{"1min":0.45000000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.95199999999999996,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.751,"15min":0.77100000000000002},"min":{"1min":0.49099999999999999,"5min":0.442,"15min":0.442},"max":{"1min":0.89900000000000002,"5min":1.3,"15min":1.3},"last":0.65200000000000002}]},{"osd":7,"last update":"Fri Jul 14 11:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.72499999999999998,"15min":0.76200000000000001},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.82599999999999996,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.78400000000000003,"15min":0.83599999999999997},"min":{"1min":0.56200000000000006,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0609999999999999,"5min":1.379,"15min":1.379},"last":0.76100000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574921,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27996,"kb_used_data":1044,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343844,"statfs":{"total":96636764160,"available":96608096256,"internally_reserved":0,"allocated":1069056,"data_stored":485946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.63100000000000001,"15min":0.64000000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.86199999999999999,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.64800000000000002,"15min":0.63900000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.85999999999999999,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.57199999999999995}]},{"osd":1,"last update":"Fri Jul 14 11:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.64000000000000001,"15min":0.67000000000000004},"min":{"1min":0.43099999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.79800000000000004,"5min":1.343,"15min":1.343},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.65400000000000003,"15min":0.64900000000000002},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.81200000000000006,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.58799999999999997}]},{"osd":2,"last update":"Fri Jul 14 11:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.71299999999999997,"15min":0.73299999999999998},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.90100000000000002,"5min":1.034,"15min":1.034},"last":0.624},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.72299999999999998,"15min":0.76000000000000001},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.84499999999999997,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.60599999999999998}]},{"osd":3,"last update":"Fri Jul 14 11:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.72399999999999998,"15min":0.76000000000000001},"min":{"1min":0.54500000000000004,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.81499999999999995,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.70799999999999996,"15min":0.76800000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.82699999999999996,"5min":1.806,"15min":1.806},"last":0.499}]},{"osd":4,"last update":"Fri Jul 14 11:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.624,"15min":0.64800000000000002},"min":{"1min":0.36199999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.878,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.69099999999999995,"15min":0.745},"min":{"1min":0.505,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.89300000000000002,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.46600000000000003}]},{"osd":6,"last update":"Fri Jul 14 11:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70699999999999996,"15min":0.74299999999999999},"min":{"1min":0.51800000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.92400000000000004,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.746,"15min":0.79400000000000004},"min":{"1min":0.45600000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.94999999999999996,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.71599999999999997}]},{"osd":7,"last update":"Fri Jul 14 11:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.76600000000000001,"15min":0.83599999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.95199999999999996,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.80600000000000005,"15min":0.86199999999999999},"min":{"1min":0.63500000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.97099999999999997,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.68799999999999994}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T11:18:47.875 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-14T11:18:47.875 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-14T11:18:48.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.110+0000 7f80651ff700 1 Processor -- start 2023-07-14T11:18:48.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.110+0000 7f80651ff700 1 -- start start 2023-07-14T11:18:48.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.111+0000 7f80651ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f80600b8a60 0x7f80600b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:48.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.111+0000 7f80651ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f80600b4530 0x7f80600d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:48.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.111+0000 7f80651ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80600d1490 con 0x7f80600d1050 2023-07-14T11:18:48.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.111+0000 7f80651ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80600b8e30 con 0x7f80600b4530 2023-07-14T11:18:48.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.111+0000 7f80651ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80600b1e30 con 0x7f80600b8a60 2023-07-14T11:18:48.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.111+0000 7f805e59c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f80600b4530 0x7f80600d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:48.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.111+0000 7f805e59c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f80600b4530 0x7f80600d0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39310/0 (socket says 172.21.15.84:39310) 2023-07-14T11:18:48.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.111+0000 7f805e59c700 1 -- 172.21.15.84:0/3167952280 learned_addr learned my addr 172.21.15.84:0/3167952280 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:48.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.112+0000 7f805ed9d700 1 --2- 172.21.15.84:0/3167952280 >> v2:172.21.15.179:3300/0 conn(0x7f80600b8a60 0x7f80600b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:48.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.112+0000 7f805e59c700 1 -- 172.21.15.84:0/3167952280 >> v2:172.21.15.179:3300/0 conn(0x7f80600b8a60 msgr2=0x7f80600b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:48.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.112+0000 7f805e59c700 1 --2- 172.21.15.84:0/3167952280 >> v2:172.21.15.179:3300/0 conn(0x7f80600b8a60 0x7f80600b3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:48.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.112+0000 7f805e59c700 1 -- 172.21.15.84:0/3167952280 >> v1:172.21.15.84:6789/0 conn(0x7f80600d1050 legacy=0x7f80600b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:48.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.112+0000 7f805e59c700 1 -- 172.21.15.84:0/3167952280 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80600afaa0 con 0x7f80600b4530 2023-07-14T11:18:48.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.112+0000 7f805ed9d700 1 --2- 172.21.15.84:0/3167952280 >> v2:172.21.15.179:3300/0 conn(0x7f80600b8a60 0x7f80600b3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:18:48.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.112+0000 7f805e59c700 1 --2- 172.21.15.84:0/3167952280 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80600b4530 0x7f80600d0b10 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f80600b5b00 tx=0x7f8054009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9abefd1876e424a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:48.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.112+0000 7f805dd9b700 1 -- 172.21.15.84:0/3167952280 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f805400b870 con 0x7f80600b4530 2023-07-14T11:18:48.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.112+0000 7f805dd9b700 1 -- 172.21.15.84:0/3167952280 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f805400b9d0 con 0x7f80600b4530 2023-07-14T11:18:48.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.112+0000 7f805dd9b700 1 -- 172.21.15.84:0/3167952280 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f805400bd60 con 0x7f80600b4530 2023-07-14T11:18:48.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.113+0000 7f80651ff700 1 -- 172.21.15.84:0/3167952280 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80600b4530 msgr2=0x7f80600d0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:48.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.113+0000 7f80651ff700 1 --2- 172.21.15.84:0/3167952280 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80600b4530 0x7f80600d0b10 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f80600b5b00 tx=0x7f8054009bd0 comp rx=0 tx=0).stop 2023-07-14T11:18:48.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.113+0000 7f80651ff700 1 -- 172.21.15.84:0/3167952280 shutdown_connections 2023-07-14T11:18:48.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.113+0000 7f80651ff700 1 --2- 172.21.15.84:0/3167952280 >> v2:172.21.15.179:3300/0 conn(0x7f80600b8a60 0x7f80600b3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:48.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.113+0000 7f80651ff700 1 --2- 172.21.15.84:0/3167952280 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80600b4530 0x7f80600d0b10 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:48.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.113+0000 7f80651ff700 1 -- 172.21.15.84:0/3167952280 >> 172.21.15.84:0/3167952280 conn(0x7f806009c1b0 msgr2=0x7f80600d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:48.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.113+0000 7f80651ff700 1 -- 172.21.15.84:0/3167952280 shutdown_connections 2023-07-14T11:18:48.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.113+0000 7f80651ff700 1 -- 172.21.15.84:0/3167952280 wait complete. 2023-07-14T11:18:48.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.115+0000 7f80651ff700 1 Processor -- start 2023-07-14T11:18:48.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.116+0000 7f80651ff700 1 -- start start 2023-07-14T11:18:48.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.117+0000 7f80651ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80600b4530 0x7f80601f2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:48.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.117+0000 7f80651ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80600b8a60 0x7f80601f3020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:48.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.117+0000 7f80651ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80600d1050 0x7f806015f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:48.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.117+0000 7f80651ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80600ce5a0 con 0x7f80600b8a60 2023-07-14T11:18:48.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.117+0000 7f80651ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80600ce7f0 con 0x7f80600d1050 2023-07-14T11:18:48.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.117+0000 7f80651ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80600cead0 con 0x7f80600b4530 2023-07-14T11:18:48.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.117+0000 7f805e59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80600b8a60 0x7f80601f3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:48.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.117+0000 7f805e59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80600b8a60 0x7f80601f3020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39324/0 (socket says 172.21.15.84:39324) 2023-07-14T11:18:48.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.117+0000 7f805e59c700 1 -- 172.21.15.84:0/441240962 learned_addr learned my addr 172.21.15.84:0/441240962 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:48.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.117+0000 7f805ed9d700 1 --2- 172.21.15.84:0/441240962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80600b4530 0x7f80601f2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:48.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.118+0000 7f805e59c700 1 -- 172.21.15.84:0/441240962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80600b4530 msgr2=0x7f80601f2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:48.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.118+0000 7f805e59c700 1 --2- 172.21.15.84:0/441240962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80600b4530 0x7f80601f2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:48.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.118+0000 7f805e59c700 1 -- 172.21.15.84:0/441240962 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80600d1050 msgr2=0x7f806015f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:48.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.118+0000 7f805f59e700 1 --2- 172.21.15.84:0/441240962 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80600d1050 0x7f806015f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:48.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.118+0000 7f805e59c700 1 --2- 172.21.15.84:0/441240962 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80600d1050 0x7f806015f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:48.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.118+0000 7f805e59c700 1 -- 172.21.15.84:0/441240962 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8054009550 con 0x7f80600b8a60 2023-07-14T11:18:48.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.118+0000 7f805ed9d700 1 --2- 172.21.15.84:0/441240962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80600b4530 0x7f80601f2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:18:48.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.118+0000 7f805f59e700 1 --2- 172.21.15.84:0/441240962 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80600d1050 0x7f806015f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:18:48.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.118+0000 7f805e59c700 1 --2- 172.21.15.84:0/441240962 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80600b8a60 0x7f80601f3020 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f80600681d0 tx=0x7f8054004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:48.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.118+0000 7f80477fe700 1 -- 172.21.15.84:0/441240962 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8054004310 con 0x7f80600b8a60 2023-07-14T11:18:48.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.118+0000 7f80477fe700 1 -- 172.21.15.84:0/441240962 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f805401f070 con 0x7f80600b8a60 2023-07-14T11:18:48.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.118+0000 7f80651ff700 1 -- 172.21.15.84:0/441240962 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80600cedb0 con 0x7f80600b8a60 2023-07-14T11:18:48.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.118+0000 7f80477fe700 1 -- 172.21.15.84:0/441240962 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80540036a0 con 0x7f80600b8a60 2023-07-14T11:18:48.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.118+0000 7f80651ff700 1 -- 172.21.15.84:0/441240962 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80601f2b90 con 0x7f80600b8a60 2023-07-14T11:18:48.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.119+0000 7f80651ff700 1 -- 172.21.15.84:0/441240962 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80601f2d50 con 0x7f80600b8a60 2023-07-14T11:18:48.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.120+0000 7f80477fe700 1 -- 172.21.15.84:0/441240962 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f8054021030 con 0x7f80600b8a60 2023-07-14T11:18:48.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.121+0000 7f80477fe700 1 --2- 172.21.15.84:0/441240962 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f804c06ae00 0x7f804c06d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:48.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.121+0000 7f80477fe700 1 -- 172.21.15.84:0/441240962 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f805408ab10 con 0x7f80600b8a60 2023-07-14T11:18:48.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.121+0000 7f805ed9d700 1 --2- 172.21.15.84:0/441240962 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f804c06ae00 0x7f804c06d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:48.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.122+0000 7f805ed9d700 1 --2- 172.21.15.84:0/441240962 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f804c06ae00 0x7f804c06d2b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f80600d01c0 tx=0x7f8050008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:48.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.125+0000 7f80477fe700 1 -- 172.21.15.84:0/441240962 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f80601f2d50 con 0x7f80600b8a60 2023-07-14T11:18:48.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.400+0000 7f80651ff700 1 -- 172.21.15.84:0/441240962 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f80601f2d50 con 0x7f80600b8a60 2023-07-14T11:18:48.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.405+0000 7f80477fe700 1 -- 172.21.15.84:0/441240962 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v21) v1 ==== 190+0+147 (secure 0 0 0) 0x7f80601f2d50 con 0x7f80600b8a60 2023-07-14T11:18:48.407 INFO:teuthology.orchestra.run.smithi084.stdout:[client.0] 2023-07-14T11:18:48.407 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCKLbFkKSl5GBAAwPK4Zs6+gv/6YKHh4JI3WA== 2023-07-14T11:18:48.408 INFO:teuthology.orchestra.run.smithi084.stdout: caps mds = "allow" 2023-07-14T11:18:48.408 INFO:teuthology.orchestra.run.smithi084.stdout: caps mon = "allow r" 2023-07-14T11:18:48.408 INFO:teuthology.orchestra.run.smithi084.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-14T11:18:48.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.407+0000 7f80651ff700 1 -- 172.21.15.84:0/441240962 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f804c06ae00 msgr2=0x7f804c06d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:48.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.407+0000 7f80651ff700 1 --2- 172.21.15.84:0/441240962 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f804c06ae00 0x7f804c06d2b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f80600d01c0 tx=0x7f8050008040 comp rx=0 tx=0).stop 2023-07-14T11:18:48.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.407+0000 7f80651ff700 1 -- 172.21.15.84:0/441240962 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80600b8a60 msgr2=0x7f80601f3020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:48.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.407+0000 7f80651ff700 1 --2- 172.21.15.84:0/441240962 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80600b8a60 0x7f80601f3020 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f80600681d0 tx=0x7f8054004750 comp rx=0 tx=0).stop 2023-07-14T11:18:48.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.407+0000 7f80651ff700 1 -- 172.21.15.84:0/441240962 shutdown_connections 2023-07-14T11:18:48.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.407+0000 7f80651ff700 1 --2- 172.21.15.84:0/441240962 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f804c06ae00 0x7f804c06d2b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:48.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.407+0000 7f80651ff700 1 --2- 172.21.15.84:0/441240962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80600b4530 0x7f80601f2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:48.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.407+0000 7f80651ff700 1 --2- 172.21.15.84:0/441240962 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80600d1050 0x7f806015f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:48.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.407+0000 7f80651ff700 1 --2- 172.21.15.84:0/441240962 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80600b8a60 0x7f80601f3020 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:48.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.407+0000 7f80651ff700 1 -- 172.21.15.84:0/441240962 >> 172.21.15.84:0/441240962 conn(0x7f806009c1b0 msgr2=0x7f80600b5110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:48.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.407+0000 7f80651ff700 1 -- 172.21.15.84:0/441240962 shutdown_connections 2023-07-14T11:18:48.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.407+0000 7f80651ff700 1 -- 172.21.15.84:0/441240962 wait complete. 2023-07-14T11:18:48.412 INFO:teuthology.orchestra.run.smithi084.stderr:updated caps for client.0 2023-07-14T11:18:48.428 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T11:18:48.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.620+0000 7f03017ff700 1 Processor -- start 2023-07-14T11:18:48.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.620+0000 7f03017ff700 1 -- start start 2023-07-14T11:18:48.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.621+0000 7f03017ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02fc0b1e00 0x7f02fc0b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:48.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.621+0000 7f03017ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02fc0d2ce0 con 0x7f02fc15c950 2023-07-14T11:18:48.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.621+0000 7f03017ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02fc0b3350 con 0x7f02fc0d1220 2023-07-14T11:18:48.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.621+0000 7f03017ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02fc0b3630 con 0x7f02fc0b1e00 2023-07-14T11:18:48.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.621+0000 7f02faffd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f02fc15c950 0x7f02fc0d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:58398/0 (socket says 172.21.15.84:58398) 2023-07-14T11:18:48.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.621+0000 7f02faffd700 1 -- 172.21.15.84:0/873386384 learned_addr learned my addr 172.21.15.84:0/873386384 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:18:48.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.622+0000 7f02fb7fe700 1 --2- 172.21.15.84:0/873386384 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02fc0b1e00 0x7f02fc0b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:48.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.622+0000 7f02f9ffb700 1 -- 172.21.15.84:0/873386384 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1931608489 0 0) 0x7f02fc0d2ce0 con 0x7f02fc15c950 2023-07-14T11:18:48.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.622+0000 7f02f9ffb700 1 -- 172.21.15.84:0/873386384 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02e40035b0 con 0x7f02fc15c950 2023-07-14T11:18:48.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.622+0000 7f02f9ffb700 1 -- 172.21.15.84:0/873386384 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3611164178 0 0) 0x7f02e40035b0 con 0x7f02fc15c950 2023-07-14T11:18:48.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.622+0000 7f02f9ffb700 1 -- 172.21.15.84:0/873386384 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02fc0b1e00 msgr2=0x7f02fc0b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:48.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.622+0000 7f02f9ffb700 1 --2- 172.21.15.84:0/873386384 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02fc0b1e00 0x7f02fc0b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:48.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.622+0000 7f02f9ffb700 1 -- 172.21.15.84:0/873386384 >> v1:172.21.15.179:6789/0 conn(0x7f02fc0d1220 legacy=0x7f02fc0afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:48.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.622+0000 7f02f9ffb700 1 -- 172.21.15.84:0/873386384 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02fc0b3910 con 0x7f02fc15c950 2023-07-14T11:18:48.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.622+0000 7f02f9ffb700 1 -- 172.21.15.84:0/873386384 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7f02ec0017f0 con 0x7f02fc15c950 2023-07-14T11:18:48.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.622+0000 7f02f9ffb700 1 -- 172.21.15.84:0/873386384 >> v1:172.21.15.84:6789/0 conn(0x7f02fc15c950 legacy=0x7f02fc0d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:48.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.622+0000 7f02f9ffb700 1 --2- 172.21.15.84:0/873386384 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f02e4003a30 0x7f02e4003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:48.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.622+0000 7f02f9ffb700 1 --2- 172.21.15.84:0/873386384 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02fc0b1e00 0x7f02e4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:48.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.622+0000 7f02f9ffb700 1 --2- 172.21.15.84:0/873386384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02e4004d90 0x7f02e4005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:48.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.622+0000 7f02f9ffb700 1 -- 172.21.15.84:0/873386384 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02fc0b3630 con 0x7f02e4004d90 2023-07-14T11:18:48.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.622+0000 7f02f9ffb700 1 -- 172.21.15.84:0/873386384 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e400bba0 con 0x7f02e4003a30 2023-07-14T11:18:48.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.622+0000 7f02f9ffb700 1 -- 172.21.15.84:0/873386384 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02e400bd60 con 0x7f02fc0b1e00 2023-07-14T11:18:48.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.623+0000 7f02fb7fe700 1 --2- 172.21.15.84:0/873386384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02e4004d90 0x7f02e4005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:48.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.623+0000 7f02fa7fc700 1 --2- 172.21.15.84:0/873386384 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02fc0b1e00 0x7f02e4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:48.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.623+0000 7f02faffd700 1 --2- 172.21.15.84:0/873386384 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f02e4003a30 0x7f02e4003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:48.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.623+0000 7f02fb7fe700 1 -- 172.21.15.84:0/873386384 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02fc0b1e00 msgr2=0x7f02e4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:48.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.623+0000 7f02fb7fe700 1 --2- 172.21.15.84:0/873386384 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02fc0b1e00 0x7f02e4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:48.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.623+0000 7f02fb7fe700 1 -- 172.21.15.84:0/873386384 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f02e4003a30 msgr2=0x7f02e4003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:48.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.623+0000 7f02fb7fe700 1 --2- 172.21.15.84:0/873386384 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f02e4003a30 0x7f02e4003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:48.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.623+0000 7f02fb7fe700 1 -- 172.21.15.84:0/873386384 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02e40035b0 con 0x7f02e4004d90 2023-07-14T11:18:48.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.623+0000 7f02faffd700 1 --2- 172.21.15.84:0/873386384 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f02e4003a30 0x7f02e4003e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:18:48.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.623+0000 7f02fb7fe700 1 --2- 172.21.15.84:0/873386384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02e4004d90 0x7f02e4005200 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f02f4009fc0 tx=0x7f02e4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3961bd959a45d0e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:48.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.623+0000 7f02f9ffb700 1 -- 172.21.15.84:0/873386384 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f400ec30 con 0x7f02e4004d90 2023-07-14T11:18:48.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.623+0000 7f02f9ffb700 1 -- 172.21.15.84:0/873386384 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02f400f040 con 0x7f02e4004d90 2023-07-14T11:18:48.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.623+0000 7f02f9ffb700 1 -- 172.21.15.84:0/873386384 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f4014480 con 0x7f02e4004d90 2023-07-14T11:18:48.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.624+0000 7f03017ff700 1 -- 172.21.15.84:0/873386384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02e4004d90 msgr2=0x7f02e4005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:48.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.624+0000 7f03017ff700 1 --2- 172.21.15.84:0/873386384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02e4004d90 0x7f02e4005200 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f02f4009fc0 tx=0x7f02e4005880 comp rx=0 tx=0).stop 2023-07-14T11:18:48.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.624+0000 7f02fb7fe700 1 -- 172.21.15.84:0/873386384 reap_dead start 2023-07-14T11:18:48.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.624+0000 7f03017ff700 1 -- 172.21.15.84:0/873386384 shutdown_connections 2023-07-14T11:18:48.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.624+0000 7f03017ff700 1 -- 172.21.15.84:0/873386384 >> 172.21.15.84:0/873386384 conn(0x7f02fc09c1d0 msgr2=0x7f02fc0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:48.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.624+0000 7f03017ff700 1 -- 172.21.15.84:0/873386384 shutdown_connections 2023-07-14T11:18:48.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.624+0000 7f03017ff700 1 -- 172.21.15.84:0/873386384 wait complete. 2023-07-14T11:18:48.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.626+0000 7f03017ff700 1 Processor -- start 2023-07-14T11:18:48.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.626+0000 7f03017ff700 1 -- start start 2023-07-14T11:18:48.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.627+0000 7f03017ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f02e4004d90 0x7f02fc0ca590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:48.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.627+0000 7f03017ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02fc1f1fd0 0x7f02fc0c6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:48.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.627+0000 7f03017ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02fc0c8870 0x7f02fc0c8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:48.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.627+0000 7f03017ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02fc0b8a50 con 0x7f02fc0c8870 2023-07-14T11:18:48.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.627+0000 7f03017ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02fc0cab70 con 0x7f02e4004d90 2023-07-14T11:18:48.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.627+0000 7f03017ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02fc0cae50 con 0x7f02fc1f1fd0 2023-07-14T11:18:48.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.627+0000 7f02fb7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02fc0c8870 0x7f02fc0c8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:48.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.627+0000 7f02fb7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02fc0c8870 0x7f02fc0c8d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39348/0 (socket says 172.21.15.84:39348) 2023-07-14T11:18:48.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.627+0000 7f02fb7fe700 1 -- 172.21.15.84:0/3231104990 learned_addr learned my addr 172.21.15.84:0/3231104990 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:48.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.627+0000 7f02fa7fc700 1 --2- 172.21.15.84:0/3231104990 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02fc1f1fd0 0x7f02fc0c6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:48.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.627+0000 7f02faffd700 1 --2- 172.21.15.84:0/3231104990 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f02e4004d90 0x7f02fc0ca590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:48.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.628+0000 7f02fb7fe700 1 -- 172.21.15.84:0/3231104990 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02fc1f1fd0 msgr2=0x7f02fc0c6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:48.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.628+0000 7f02fb7fe700 1 --2- 172.21.15.84:0/3231104990 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02fc1f1fd0 0x7f02fc0c6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:48.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.628+0000 7f02fb7fe700 1 -- 172.21.15.84:0/3231104990 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f02e4004d90 msgr2=0x7f02fc0ca590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:48.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.628+0000 7f02fb7fe700 1 --2- 172.21.15.84:0/3231104990 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f02e4004d90 0x7f02fc0ca590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:48.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.628+0000 7f02fb7fe700 1 -- 172.21.15.84:0/3231104990 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02fc0cb130 con 0x7f02fc0c8870 2023-07-14T11:18:48.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.628+0000 7f02faffd700 1 --2- 172.21.15.84:0/3231104990 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f02e4004d90 0x7f02fc0ca590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:18:48.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.628+0000 7f02fb7fe700 1 --2- 172.21.15.84:0/3231104990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02fc0c8870 0x7f02fc0c8d10 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f02f4017040 tx=0x7f02f4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:48.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.628+0000 7f02e37fe700 1 -- 172.21.15.84:0/3231104990 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f4007000 con 0x7f02fc0c8870 2023-07-14T11:18:48.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.628+0000 7f02e37fe700 1 -- 172.21.15.84:0/3231104990 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02f4004470 con 0x7f02fc0c8870 2023-07-14T11:18:48.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.628+0000 7f02e37fe700 1 -- 172.21.15.84:0/3231104990 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f4004820 con 0x7f02fc0c8870 2023-07-14T11:18:48.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.628+0000 7f03017ff700 1 -- 172.21.15.84:0/3231104990 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02fc0cb410 con 0x7f02fc0c8870 2023-07-14T11:18:48.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.628+0000 7f03017ff700 1 -- 172.21.15.84:0/3231104990 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02fc0c9250 con 0x7f02fc0c8870 2023-07-14T11:18:48.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.629+0000 7f03017ff700 1 -- 172.21.15.84:0/3231104990 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02fc0cb930 con 0x7f02fc0c8870 2023-07-14T11:18:48.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.630+0000 7f02e37fe700 1 -- 172.21.15.84:0/3231104990 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f02f4023070 con 0x7f02fc0c8870 2023-07-14T11:18:48.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.631+0000 7f02e37fe700 1 --2- 172.21.15.84:0/3231104990 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f02e806ae00 0x7f02e806d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:48.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.631+0000 7f02e37fe700 1 -- 172.21.15.84:0/3231104990 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f02f408a650 con 0x7f02fc0c8870 2023-07-14T11:18:48.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.632+0000 7f02faffd700 1 --2- 172.21.15.84:0/3231104990 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f02e806ae00 0x7f02e806d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:48.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.632+0000 7f02faffd700 1 --2- 172.21.15.84:0/3231104990 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f02e806ae00 0x7f02e806d2b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f02ec0011b0 tx=0x7f02ec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:48.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.635+0000 7f02e37fe700 1 -- 172.21.15.84:0/3231104990 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f02fc0cb930 con 0x7f02fc0c8870 2023-07-14T11:18:48.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.869+0000 7f03017ff700 1 -- 172.21.15.84:0/3231104990 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f02fc0cb930 con 0x7f02fc0c8870 2023-07-14T11:18:48.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.870+0000 7f02e37fe700 1 -- 172.21.15.84:0/3231104990 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+4717 (secure 0 0 0) 0x7f02fc0cb930 con 0x7f02fc0c8870 2023-07-14T11:18:48.873 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:18:48.874 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":54,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5945,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6834/3102047639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":3102047639},{"type":"v1","addr":"172.21.15.84:6834","nonce":3102047639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":5951,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/1883008963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1883008963},{"type":"v1","addr":"172.21.15.179:6835","nonce":1883008963}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":6736,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/4019917691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":4019917691},{"type":"v1","addr":"172.21.15.179:6834","nonce":4019917691}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T11:18:42.500325+0000","modified":"2023-07-14T11:18:46.028519+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7227},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7227":{"gid":7227,"name":"c","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6835/3879250964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6833","nonce":3879250964},{"type":"v1","addr":"172.21.15.84:6835","nonce":3879250964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-07-14T11:18:48.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.872+0000 7f03017ff700 1 -- 172.21.15.84:0/3231104990 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f02e806ae00 msgr2=0x7f02e806d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:48.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.872+0000 7f03017ff700 1 --2- 172.21.15.84:0/3231104990 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f02e806ae00 0x7f02e806d2b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f02ec0011b0 tx=0x7f02ec009040 comp rx=0 tx=0).stop 2023-07-14T11:18:48.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.872+0000 7f03017ff700 1 -- 172.21.15.84:0/3231104990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02fc0c8870 msgr2=0x7f02fc0c8d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:48.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.872+0000 7f03017ff700 1 --2- 172.21.15.84:0/3231104990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02fc0c8870 0x7f02fc0c8d10 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f02f4017040 tx=0x7f02f4009750 comp rx=0 tx=0).stop 2023-07-14T11:18:48.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.872+0000 7f03017ff700 1 -- 172.21.15.84:0/3231104990 shutdown_connections 2023-07-14T11:18:48.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.872+0000 7f03017ff700 1 --2- 172.21.15.84:0/3231104990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02fc0c8870 0x7f02fc0c8d10 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:48.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.872+0000 7f03017ff700 1 --2- 172.21.15.84:0/3231104990 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f02e4004d90 0x7f02fc0ca590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:48.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.872+0000 7f03017ff700 1 --2- 172.21.15.84:0/3231104990 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f02e806ae00 0x7f02e806d2b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:48.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.872+0000 7f03017ff700 1 --2- 172.21.15.84:0/3231104990 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02fc1f1fd0 0x7f02fc0c6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:48.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.872+0000 7f03017ff700 1 -- 172.21.15.84:0/3231104990 >> 172.21.15.84:0/3231104990 conn(0x7f02fc09c1d0 msgr2=0x7f02fc0cd570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:48.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.872+0000 7f03017ff700 1 -- 172.21.15.84:0/3231104990 shutdown_connections 2023-07-14T11:18:48.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:48.872+0000 7f03017ff700 1 -- 172.21.15.84:0/3231104990 wait complete. 2023-07-14T11:18:48.878 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 54 2023-07-14T11:18:49.295 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 54, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-14T11:18:42.500325+0000', 'modified': '2023-07-14T11:18:46.028519+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7227}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7227': {'gid': 7227, 'name': 'c', 'rank': 0, 'incarnation': 50, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.84:6835/3879250964', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6833', 'nonce': 3879250964}, {'type': 'v1', 'addr': '172.21.15.84:6835', 'nonce': 3879250964}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-14T11:18:49.296 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-14T11:18:49.296 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-07-14T11:18:49.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.490+0000 7fc783dff700 1 Processor -- start 2023-07-14T11:18:49.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.490+0000 7fc783dff700 1 -- start start 2023-07-14T11:18:49.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.492+0000 7fc783dff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc77c0b4860 0x7fc77c0b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:49.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.492+0000 7fc783dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc77c0d12c0 0x7fc77c0d16e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:49.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.492+0000 7fc783dff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc77c0d02a0 con 0x7fc77c0b8660 2023-07-14T11:18:49.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.492+0000 7fc783dff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc77c0b5240 con 0x7fc77c0b4860 2023-07-14T11:18:49.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.492+0000 7fc783dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc77c0cfce0 con 0x7fc77c0d12c0 2023-07-14T11:18:49.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.492+0000 7fc78139a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc77c0b4860 0x7fc77c0b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:49.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.492+0000 7fc78139a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc77c0b4860 0x7fc77c0b4d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41110/0 (socket says 172.21.15.84:41110) 2023-07-14T11:18:49.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.492+0000 7fc78139a700 1 -- 172.21.15.84:0/3959827664 learned_addr learned my addr 172.21.15.84:0/3959827664 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:49.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.492+0000 7fc78139a700 1 -- 172.21.15.84:0/3959827664 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc77c0d12c0 msgr2=0x7fc77c0d16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:49.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.492+0000 7fc78239c700 1 --2- 172.21.15.84:0/3959827664 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc77c0d12c0 0x7fc77c0d16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:49.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.492+0000 7fc78139a700 1 --2- 172.21.15.84:0/3959827664 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc77c0d12c0 0x7fc77c0d16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:49.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.492+0000 7fc78139a700 1 -- 172.21.15.84:0/3959827664 >> v1:172.21.15.179:6789/0 conn(0x7fc77c0b8660 legacy=0x7fc77c0cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:49.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.492+0000 7fc78139a700 1 -- 172.21.15.84:0/3959827664 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc77c0cffc0 con 0x7fc77c0b4860 2023-07-14T11:18:49.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.492+0000 7fc78239c700 1 --2- 172.21.15.84:0/3959827664 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc77c0d12c0 0x7fc77c0d16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:18:49.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.493+0000 7fc78139a700 1 --2- 172.21.15.84:0/3959827664 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc77c0b4860 0x7fc77c0b4d00 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fc76c0098f0 tx=0x7fc76c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=578393faa0c35646 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:49.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.493+0000 7fc780b99700 1 -- 172.21.15.84:0/3959827664 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc76c004230 con 0x7fc77c0b4860 2023-07-14T11:18:49.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.493+0000 7fc780b99700 1 -- 172.21.15.84:0/3959827664 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc76c004390 con 0x7fc77c0b4860 2023-07-14T11:18:49.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.493+0000 7fc780b99700 1 -- 172.21.15.84:0/3959827664 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc76c0036a0 con 0x7fc77c0b4860 2023-07-14T11:18:49.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.493+0000 7fc783dff700 1 -- 172.21.15.84:0/3959827664 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc77c0b4860 msgr2=0x7fc77c0b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:49.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.493+0000 7fc783dff700 1 --2- 172.21.15.84:0/3959827664 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc77c0b4860 0x7fc77c0b4d00 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fc76c0098f0 tx=0x7fc76c009c00 comp rx=0 tx=0).stop 2023-07-14T11:18:49.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.493+0000 7fc783dff700 1 -- 172.21.15.84:0/3959827664 shutdown_connections 2023-07-14T11:18:49.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.493+0000 7fc783dff700 1 --2- 172.21.15.84:0/3959827664 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc77c0d12c0 0x7fc77c0d16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:49.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.493+0000 7fc783dff700 1 --2- 172.21.15.84:0/3959827664 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc77c0b4860 0x7fc77c0b4d00 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:49.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.493+0000 7fc783dff700 1 -- 172.21.15.84:0/3959827664 >> 172.21.15.84:0/3959827664 conn(0x7fc77c066860 msgr2=0x7fc77c06a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:49.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.494+0000 7fc783dff700 1 -- 172.21.15.84:0/3959827664 shutdown_connections 2023-07-14T11:18:49.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.494+0000 7fc783dff700 1 -- 172.21.15.84:0/3959827664 wait complete. 2023-07-14T11:18:49.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.495+0000 7fc783dff700 1 Processor -- start 2023-07-14T11:18:49.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.495+0000 7fc783dff700 1 -- start start 2023-07-14T11:18:49.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.496+0000 7fc783dff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc77c0b4860 0x7fc77c15e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:49.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.496+0000 7fc783dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc77c0b8660 0x7fc77c1478e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:49.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.496+0000 7fc783dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc77c0d12c0 0x7fc77c147e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:49.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.496+0000 7fc783dff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc77c148ce0 con 0x7fc77c0b4860 2023-07-14T11:18:49.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.496+0000 7fc783dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc77c15f580 con 0x7fc77c0b8660 2023-07-14T11:18:49.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.496+0000 7fc783dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc77c15efc0 con 0x7fc77c0d12c0 2023-07-14T11:18:49.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.497+0000 7fc781b9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc77c0b4860 0x7fc77c15e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:49.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.497+0000 7fc781b9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc77c0b4860 0x7fc77c15e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41114/0 (socket says 172.21.15.84:41114) 2023-07-14T11:18:49.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.497+0000 7fc781b9b700 1 -- 172.21.15.84:0/4018166304 learned_addr learned my addr 172.21.15.84:0/4018166304 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:49.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.497+0000 7fc78139a700 1 --2- 172.21.15.84:0/4018166304 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc77c0b8660 0x7fc77c1478e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:49.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.497+0000 7fc78239c700 1 --2- 172.21.15.84:0/4018166304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc77c0d12c0 0x7fc77c147e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:49.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.497+0000 7fc781b9b700 1 -- 172.21.15.84:0/4018166304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc77c0d12c0 msgr2=0x7fc77c147e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:49.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.497+0000 7fc781b9b700 1 --2- 172.21.15.84:0/4018166304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc77c0d12c0 0x7fc77c147e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:49.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.497+0000 7fc781b9b700 1 -- 172.21.15.84:0/4018166304 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc77c0b8660 msgr2=0x7fc77c1478e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:49.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.497+0000 7fc781b9b700 1 --2- 172.21.15.84:0/4018166304 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc77c0b8660 0x7fc77c1478e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:49.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.497+0000 7fc781b9b700 1 -- 172.21.15.84:0/4018166304 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc76c009550 con 0x7fc77c0b4860 2023-07-14T11:18:49.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.497+0000 7fc78239c700 1 --2- 172.21.15.84:0/4018166304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc77c0d12c0 0x7fc77c147e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:18:49.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.497+0000 7fc781b9b700 1 --2- 172.21.15.84:0/4018166304 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc77c0b4860 0x7fc77c15e620 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7fc77800c500 tx=0x7fc77800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:49.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.497+0000 7fc7727fc700 1 -- 172.21.15.84:0/4018166304 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc778011790 con 0x7fc77c0b4860 2023-07-14T11:18:49.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.497+0000 7fc7727fc700 1 -- 172.21.15.84:0/4018166304 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7780118f0 con 0x7fc77c0b4860 2023-07-14T11:18:49.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.497+0000 7fc7727fc700 1 -- 172.21.15.84:0/4018166304 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc778011ca0 con 0x7fc77c0b4860 2023-07-14T11:18:49.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.497+0000 7fc783dff700 1 -- 172.21.15.84:0/4018166304 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc77c15f2a0 con 0x7fc77c0b4860 2023-07-14T11:18:49.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.498+0000 7fc783dff700 1 -- 172.21.15.84:0/4018166304 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc77c15eb60 con 0x7fc77c0b4860 2023-07-14T11:18:49.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.500+0000 7fc7727fc700 1 -- 172.21.15.84:0/4018166304 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7fc77801c460 con 0x7fc77c0b4860 2023-07-14T11:18:49.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.500+0000 7fc7727fc700 1 --2- 172.21.15.84:0/4018166304 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fc76006ae00 0x7fc76006d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:49.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.500+0000 7fc7727fc700 1 -- 172.21.15.84:0/4018166304 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc778089540 con 0x7fc77c0b4860 2023-07-14T11:18:49.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.501+0000 7fc78139a700 1 --2- 172.21.15.84:0/4018166304 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fc76006ae00 0x7fc76006d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:49.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.502+0000 7fc78139a700 1 --2- 172.21.15.84:0/4018166304 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fc76006ae00 0x7fc76006d2b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc76c009130 tx=0x7fc76c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:49.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.502+0000 7fc7977d3b80 1 Processor -- start 2023-07-14T11:18:49.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.503+0000 7fc7977d3b80 1 -- start start 2023-07-14T11:18:49.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.503+0000 7fc7977d3b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b54b12880 0x561b54b425e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:49.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.503+0000 7fc7977d3b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561b54b14dc0 0x561b54b42b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:49.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.504+0000 7fc7977d3b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561b54b12c50 0x561b54b2d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:49.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.504+0000 7fc7977d3b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b54a8cea0 con 0x561b54b14dc0 2023-07-14T11:18:49.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.504+0000 7fc7977d3b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b54a00600 con 0x561b54b12880 2023-07-14T11:18:49.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.504+0000 7fc7977d3b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x561b54a6f910 con 0x561b54b12c50 2023-07-14T11:18:49.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.504+0000 7fc78139a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561b54b14dc0 0x561b54b42b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:49.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.504+0000 7fc78139a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561b54b14dc0 0x561b54b42b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41120/0 (socket says 172.21.15.84:41120) 2023-07-14T11:18:49.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.504+0000 7fc78139a700 1 -- 172.21.15.84:0/849381990 learned_addr learned my addr 172.21.15.84:0/849381990 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:49.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.504+0000 7fc78139a700 1 -- 172.21.15.84:0/849381990 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561b54b12c50 msgr2=0x561b54b2d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:49.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.504+0000 7fc781b9b700 1 --2- 172.21.15.84:0/849381990 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b54b12880 0x561b54b425e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:49.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.504+0000 7fc78239c700 1 --2- 172.21.15.84:0/849381990 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561b54b12c50 0x561b54b2d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:49.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.504+0000 7fc78139a700 1 --2- 172.21.15.84:0/849381990 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561b54b12c50 0x561b54b2d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:49.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.504+0000 7fc78139a700 1 -- 172.21.15.84:0/849381990 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b54b12880 msgr2=0x561b54b425e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:49.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.504+0000 7fc78139a700 1 --2- 172.21.15.84:0/849381990 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b54b12880 0x561b54b425e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:49.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.504+0000 7fc78139a700 1 -- 172.21.15.84:0/849381990 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b5485c790 con 0x561b54b14dc0 2023-07-14T11:18:49.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.504+0000 7fc781b9b700 1 --2- 172.21.15.84:0/849381990 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b54b12880 0x561b54b425e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:18:49.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.504+0000 7fc78239c700 1 --2- 172.21.15.84:0/849381990 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561b54b12c50 0x561b54b2d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:18:49.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.504+0000 7fc78139a700 1 --2- 172.21.15.84:0/849381990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561b54b14dc0 0x561b54b42b20 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7fc76c0037a0 tx=0x7fc76c010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a40834ab9d55b185 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:49.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.505+0000 7fc75f7fe700 1 -- 172.21.15.84:0/849381990 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc76c00b660 con 0x561b54b14dc0 2023-07-14T11:18:49.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.505+0000 7fc75f7fe700 1 -- 172.21.15.84:0/849381990 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc76c00b7c0 con 0x561b54b14dc0 2023-07-14T11:18:49.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.505+0000 7fc75f7fe700 1 -- 172.21.15.84:0/849381990 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc76c00bb30 con 0x561b54b14dc0 2023-07-14T11:18:49.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.505+0000 7fc7977d3b80 1 -- 172.21.15.84:0/849381990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561b54b14dc0 msgr2=0x561b54b42b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:49.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.505+0000 7fc7977d3b80 1 --2- 172.21.15.84:0/849381990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561b54b14dc0 0x561b54b42b20 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7fc76c0037a0 tx=0x7fc76c010000 comp rx=0 tx=0).stop 2023-07-14T11:18:49.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.505+0000 7fc7977d3b80 1 -- 172.21.15.84:0/849381990 shutdown_connections 2023-07-14T11:18:49.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.505+0000 7fc7977d3b80 1 --2- 172.21.15.84:0/849381990 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561b54b12c50 0x561b54b2d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:49.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.505+0000 7fc7977d3b80 1 --2- 172.21.15.84:0/849381990 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b54b12880 0x561b54b425e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:49.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.505+0000 7fc7977d3b80 1 --2- 172.21.15.84:0/849381990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561b54b14dc0 0x561b54b42b20 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:49.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.506+0000 7fc7977d3b80 1 -- 172.21.15.84:0/849381990 >> 172.21.15.84:0/849381990 conn(0x561b54b0d3b0 msgr2=0x561b54b18550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:49.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.506+0000 7fc7977d3b80 1 -- 172.21.15.84:0/849381990 shutdown_connections 2023-07-14T11:18:49.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.506+0000 7fc7977d3b80 1 -- 172.21.15.84:0/849381990 wait complete. 2023-07-14T11:18:49.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.506+0000 7fc7977d3b80 1 -- start start 2023-07-14T11:18:49.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.507+0000 7fc7977d3b80 1 Processor -- start 2023-07-14T11:18:49.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.508+0000 7fc7977d3b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561b54b12880 0x561b54b46070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:49.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.508+0000 7fc7977d3b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561b54b12c50 0x561b54b43d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:49.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.508+0000 7fc7977d3b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b54b14dc0 0x561b54b442b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:49.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.508+0000 7fc7977d3b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b54a68be0 con 0x561b54b12c50 2023-07-14T11:18:49.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.508+0000 7fc7977d3b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b54a265b0 con 0x561b54b14dc0 2023-07-14T11:18:49.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.508+0000 7fc7977d3b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x561b54a0c910 con 0x561b54b12880 2023-07-14T11:18:49.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.509+0000 7fc7977d3b80 10 client.0 _ll_register_callbacks cb 0x561b54a24b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T11:18:49.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.509+0000 7fc78139a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561b54b12c50 0x561b54b43d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:49.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.509+0000 7fc78139a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561b54b12c50 0x561b54b43d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41134/0 (socket says 172.21.15.84:41134) 2023-07-14T11:18:49.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.509+0000 7fc78139a700 1 -- 172.21.15.84:0/4195737498 learned_addr learned my addr 172.21.15.84:0/4195737498 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:49.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.509+0000 7fc78139a700 1 -- 172.21.15.84:0/4195737498 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561b54b12880 msgr2=0x561b54b46070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:49.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.509+0000 7fc78139a700 1 --2- 172.21.15.84:0/4195737498 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561b54b12880 0x561b54b46070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:49.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.509+0000 7fc78139a700 1 -- 172.21.15.84:0/4195737498 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b54b14dc0 msgr2=0x561b54b442b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:49.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.509+0000 7fc78139a700 1 --2- 172.21.15.84:0/4195737498 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b54b14dc0 0x561b54b442b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:49.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.509+0000 7fc78139a700 1 -- 172.21.15.84:0/4195737498 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc77c0cffc0 con 0x561b54b12c50 2023-07-14T11:18:49.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.509+0000 7fc78139a700 1 --2- 172.21.15.84:0/4195737498 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561b54b12c50 0x561b54b43d70 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x561b54b43720 tx=0x7fc76c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f56f87f704f71ee server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:49.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.509+0000 7fc75cff9700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-07-14T11:18:49.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.510+0000 7fc75cff9700 1 -- 172.21.15.84:0/4195737498 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc76c034070 con 0x561b54b12c50 2023-07-14T11:18:49.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.510+0000 7fc75cff9700 1 -- 172.21.15.84:0/4195737498 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc76c00bd70 con 0x561b54b12c50 2023-07-14T11:18:49.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.510+0000 7fc7977d3b80 1 -- 172.21.15.84:0/4195737498 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561b54b0a9c0 con 0x561b54b12c50 2023-07-14T11:18:49.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.510+0000 7fc75cff9700 1 -- 172.21.15.84:0/4195737498 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc76c02f480 con 0x561b54b12c50 2023-07-14T11:18:49.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.510+0000 7fc7977d3b80 10 client.7383 fetch_fsmap learned FSMap version 54 2023-07-14T11:18:49.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.510+0000 7fc7977d3b80 1 -- 172.21.15.84:0/4195737498 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) v3 -- 0x561b549490a0 con 0x561b54b12c50 2023-07-14T11:18:49.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.510+0000 7fc75cff9700 1 -- 172.21.15.84:0/4195737498 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561b54b0a9c0 con 0x561b54b12c50 2023-07-14T11:18:49.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.510+0000 7fc75cff9700 1 -- 172.21.15.84:0/4195737498 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 54) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fc76c02f5e0 con 0x561b54b12c50 2023-07-14T11:18:49.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.510+0000 7fc7977d3b80 10 client.7383 fetch_fsmap finished waiting for FSMap version 54 2023-07-14T11:18:49.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.510+0000 7fc7977d3b80 10 client.7383 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-14T11:18:49.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.510+0000 7fc7977d3b80 20 client.7383 populate_metadata read hostname 'smithi084' 2023-07-14T11:18:49.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.510+0000 7fc7977d3b80 1 --2- 172.21.15.84:0/4195737498 >> [v2:172.21.15.84:6833/3879250964,v1:172.21.15.84:6835/3879250964] conn(0x561b54b70530 0x561b54b70900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:49.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.510+0000 7fc7977d3b80 4 client.7383 mds_command: new command op to 7227 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T11:18:49.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.510+0000 7fc7977d3b80 1 -- 172.21.15.84:0/4195737498 --> [v2:172.21.15.84:6833/3879250964,v1:172.21.15.84:6835/3879250964] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561b54ae7170 con 0x561b54b70530 2023-07-14T11:18:49.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.510+0000 7fc781b9b700 1 --2- 172.21.15.84:0/4195737498 >> [v2:172.21.15.84:6833/3879250964,v1:172.21.15.84:6835/3879250964] conn(0x561b54b70530 0x561b54b70900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:49.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.511+0000 7fc75cff9700 10 client.7383 ms_handle_connect on v2:172.21.15.84:6833/3879250964 2023-07-14T11:18:49.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.511+0000 7fc781b9b700 1 --2- 172.21.15.84:0/4195737498 >> [v2:172.21.15.84:6833/3879250964,v1:172.21.15.84:6835/3879250964] conn(0x561b54b70530 0x561b54b70900 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f370e603247f841 server_cookie=9218a960d9cffa71 in_seq=0 out_seq=0 2023-07-14T11:18:49.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.512+0000 7fc75cff9700 1 -- 172.21.15.84:0/4195737498 <== mds.0 v2:172.21.15.84:6833/3879250964 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x561b54ae7170 con 0x561b54b70530 2023-07-14T11:18:49.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.512+0000 7fc75cff9700 10 client.7383 handle_command_reply: tid=0 2023-07-14T11:18:49.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.512+0000 7fc7977d3b80 1 client.7383 shutdown 2023-07-14T11:18:49.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.512+0000 7fc7977d3b80 1 -- 172.21.15.84:0/4195737498 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561b54b12c50 msgr2=0x561b54b43d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:49.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.512+0000 7fc7977d3b80 1 --2- 172.21.15.84:0/4195737498 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561b54b12c50 0x561b54b43d70 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x561b54b43720 tx=0x7fc76c0047c0 comp rx=0 tx=0).stop 2023-07-14T11:18:49.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.512+0000 7fc7977d3b80 1 -- 172.21.15.84:0/4195737498 shutdown_connections 2023-07-14T11:18:49.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.512+0000 7fc7977d3b80 1 --2- 172.21.15.84:0/4195737498 >> [v2:172.21.15.84:6833/3879250964,v1:172.21.15.84:6835/3879250964] conn(0x561b54b70530 0x561b54b70900 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:49.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.512+0000 7fc7977d3b80 1 --2- 172.21.15.84:0/4195737498 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561b54b12880 0x561b54b46070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:49.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.512+0000 7fc7977d3b80 1 --2- 172.21.15.84:0/4195737498 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b54b14dc0 0x561b54b442b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:49.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.512+0000 7fc75cff9700 0 client.7383 ms_handle_reset on v2:172.21.15.84:6833/3879250964 2023-07-14T11:18:49.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.512+0000 7fc7977d3b80 1 --2- 172.21.15.84:0/4195737498 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561b54b12c50 0x561b54b43d70 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:49.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.512+0000 7fc7977d3b80 1 -- 172.21.15.84:0/4195737498 >> 172.21.15.84:0/4195737498 conn(0x561b54b0d3b0 msgr2=0x561b54b42b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:49.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.512+0000 7fc7977d3b80 1 -- 172.21.15.84:0/4195737498 shutdown_connections 2023-07-14T11:18:49.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.512+0000 7fc7977d3b80 1 -- 172.21.15.84:0/4195737498 wait complete. 2023-07-14T11:18:49.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.513+0000 7fc7977d3b80 20 client.7383 trim_cache size 0 max 16384 2023-07-14T11:18:49.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.530+0000 7fc7977d3b80 1 Processor -- start 2023-07-14T11:18:49.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.530+0000 7fc7977d3b80 1 -- start start 2023-07-14T11:18:49.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.531+0000 7fc7977d3b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b54b0d3b0 0x561b54b5fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:49.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.531+0000 7fc7977d3b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561b54b12880 0x561b54b45980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:49.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.531+0000 7fc7977d3b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561b54b12c50 0x561b54b45ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:49.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.531+0000 7fc7977d3b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b5485d390 con 0x561b54b12880 2023-07-14T11:18:49.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.531+0000 7fc7977d3b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b54b575e0 con 0x561b54b0d3b0 2023-07-14T11:18:49.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.531+0000 7fc7977d3b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x561b54b11880 con 0x561b54b12c50 2023-07-14T11:18:49.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.531+0000 7fc78139a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561b54b12880 0x561b54b45980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:49.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.531+0000 7fc78139a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561b54b12880 0x561b54b45980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41138/0 (socket says 172.21.15.84:41138) 2023-07-14T11:18:49.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.531+0000 7fc78139a700 1 -- 172.21.15.84:0/405883873 learned_addr learned my addr 172.21.15.84:0/405883873 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:49.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.532+0000 7fc78139a700 1 -- 172.21.15.84:0/405883873 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561b54b12c50 msgr2=0x561b54b45ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:49.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.532+0000 7fc78139a700 1 --2- 172.21.15.84:0/405883873 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561b54b12c50 0x561b54b45ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:49.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.532+0000 7fc78139a700 1 -- 172.21.15.84:0/405883873 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b54b0d3b0 msgr2=0x561b54b5fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:49.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.532+0000 7fc78139a700 1 --2- 172.21.15.84:0/405883873 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b54b0d3b0 0x561b54b5fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:49.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.532+0000 7fc78139a700 1 -- 172.21.15.84:0/405883873 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b54a2eb10 con 0x561b54b12880 2023-07-14T11:18:49.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.532+0000 7fc78139a700 1 --2- 172.21.15.84:0/405883873 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561b54b12880 0x561b54b45980 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7fc76c003c90 tx=0x7fc76c034000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=920667c3fcf5abfc server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:49.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.532+0000 7fc75ffff700 1 -- 172.21.15.84:0/405883873 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc76c00b9e0 con 0x561b54b12880 2023-07-14T11:18:49.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.532+0000 7fc75ffff700 1 -- 172.21.15.84:0/405883873 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc76c02faf0 con 0x561b54b12880 2023-07-14T11:18:49.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.532+0000 7fc75ffff700 1 -- 172.21.15.84:0/405883873 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc76c02f680 con 0x561b54b12880 2023-07-14T11:18:49.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.533+0000 7fc7977d3b80 1 -- 172.21.15.84:0/405883873 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561b54b12880 msgr2=0x561b54b45980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:49.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.533+0000 7fc7977d3b80 1 --2- 172.21.15.84:0/405883873 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561b54b12880 0x561b54b45980 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7fc76c003c90 tx=0x7fc76c034000 comp rx=0 tx=0).stop 2023-07-14T11:18:49.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.533+0000 7fc7977d3b80 1 -- 172.21.15.84:0/405883873 shutdown_connections 2023-07-14T11:18:49.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.533+0000 7fc7977d3b80 1 --2- 172.21.15.84:0/405883873 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561b54b12c50 0x561b54b45ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:49.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.533+0000 7fc7977d3b80 1 --2- 172.21.15.84:0/405883873 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b54b0d3b0 0x561b54b5fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:49.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.533+0000 7fc7977d3b80 1 --2- 172.21.15.84:0/405883873 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561b54b12880 0x561b54b45980 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:49.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.533+0000 7fc7977d3b80 1 -- 172.21.15.84:0/405883873 >> 172.21.15.84:0/405883873 conn(0x561b54b42710 msgr2=0x561b54b18520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:49.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.533+0000 7fc7977d3b80 1 -- 172.21.15.84:0/405883873 shutdown_connections 2023-07-14T11:18:49.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.533+0000 7fc7977d3b80 1 -- 172.21.15.84:0/405883873 wait complete. 2023-07-14T11:18:49.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.533+0000 7fc7977d3b80 1 -- start start 2023-07-14T11:18:49.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.534+0000 7fc7977d3b80 1 Processor -- start 2023-07-14T11:18:49.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.534+0000 7fc7977d3b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561b54b0d3b0 0x561b54b60530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:49.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.535+0000 7fc7977d3b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b54b12880 0x561b54b60a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:49.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.535+0000 7fc7977d3b80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561b54b12c50 0x561b54b7d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:49.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.535+0000 7fc7977d3b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b54b18890 con 0x561b54b0d3b0 2023-07-14T11:18:49.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.535+0000 7fc7977d3b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b54bc44f0 con 0x561b54b12880 2023-07-14T11:18:49.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.535+0000 7fc7977d3b80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x561b54b18640 con 0x561b54b12c50 2023-07-14T11:18:49.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.535+0000 7fc7977d3b80 10 client.0 _ll_register_callbacks cb 0x7fc76c00b660 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T11:18:49.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.535+0000 7fc781b9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561b54b0d3b0 0x561b54b60530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:49.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.535+0000 7fc781b9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561b54b0d3b0 0x561b54b60530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41148/0 (socket says 172.21.15.84:41148) 2023-07-14T11:18:49.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.535+0000 7fc781b9b700 1 -- 172.21.15.84:0/1737451206 learned_addr learned my addr 172.21.15.84:0/1737451206 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:49.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.535+0000 7fc78139a700 1 --2- 172.21.15.84:0/1737451206 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b54b12880 0x561b54b60a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:49.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.535+0000 7fc78239c700 1 --2- 172.21.15.84:0/1737451206 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561b54b12c50 0x561b54b7d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:49.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.535+0000 7fc781b9b700 1 -- 172.21.15.84:0/1737451206 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561b54b12c50 msgr2=0x561b54b7d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:49.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.535+0000 7fc781b9b700 1 --2- 172.21.15.84:0/1737451206 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561b54b12c50 0x561b54b7d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:49.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.535+0000 7fc781b9b700 1 -- 172.21.15.84:0/1737451206 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b54b12880 msgr2=0x561b54b60a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:49.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.535+0000 7fc781b9b700 1 --2- 172.21.15.84:0/1737451206 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b54b12880 0x561b54b60a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:49.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.535+0000 7fc781b9b700 1 -- 172.21.15.84:0/1737451206 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561b549490a0 con 0x561b54b0d3b0 2023-07-14T11:18:49.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.535+0000 7fc781b9b700 1 --2- 172.21.15.84:0/1737451206 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561b54b0d3b0 0x561b54b60530 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fc77805c280 tx=0x7fc778054550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=babadd139927f09 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:49.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.535+0000 7fc75cff9700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-07-14T11:18:49.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.536+0000 7fc75cff9700 1 -- 172.21.15.84:0/1737451206 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc778087470 con 0x561b54b0d3b0 2023-07-14T11:18:49.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.536+0000 7fc7977d3b80 1 -- 172.21.15.84:0/1737451206 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc76c00b7c0 con 0x561b54b0d3b0 2023-07-14T11:18:49.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.536+0000 7fc75cff9700 1 -- 172.21.15.84:0/1737451206 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc7780575f0 con 0x561b54b0d3b0 2023-07-14T11:18:49.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.536+0000 7fc75cff9700 1 -- 172.21.15.84:0/1737451206 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc7780577b0 con 0x561b54b0d3b0 2023-07-14T11:18:49.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.536+0000 7fc7977d3b80 10 client.7389 fetch_fsmap learned FSMap version 54 2023-07-14T11:18:49.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.536+0000 7fc7977d3b80 1 -- 172.21.15.84:0/1737451206 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) v3 -- 0x561b548bd1d0 con 0x561b54b0d3b0 2023-07-14T11:18:49.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.536+0000 7fc75cff9700 1 -- 172.21.15.84:0/1737451206 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc76c00b7c0 con 0x561b54b0d3b0 2023-07-14T11:18:49.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.536+0000 7fc75cff9700 1 -- 172.21.15.84:0/1737451206 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 54) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fc77805ffc0 con 0x561b54b0d3b0 2023-07-14T11:18:49.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.536+0000 7fc7977d3b80 10 client.7389 fetch_fsmap finished waiting for FSMap version 54 2023-07-14T11:18:49.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.536+0000 7fc7977d3b80 10 client.7389 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-14T11:18:49.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.536+0000 7fc7977d3b80 20 client.7389 populate_metadata read hostname 'smithi084' 2023-07-14T11:18:49.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.536+0000 7fc7977d3b80 1 --2- 172.21.15.84:0/1737451206 >> [v2:172.21.15.84:6833/3879250964,v1:172.21.15.84:6835/3879250964] conn(0x561b54b14dc0 0x561b54b7dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:49.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.536+0000 7fc7977d3b80 4 client.7389 mds_command: new command op to 7227 tid=0[{"prefix": "status"}] 2023-07-14T11:18:49.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.536+0000 7fc7977d3b80 1 -- 172.21.15.84:0/1737451206 --> [v2:172.21.15.84:6833/3879250964,v1:172.21.15.84:6835/3879250964] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561b54a61d20 con 0x561b54b14dc0 2023-07-14T11:18:49.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.536+0000 7fc78139a700 1 --2- 172.21.15.84:0/1737451206 >> [v2:172.21.15.84:6833/3879250964,v1:172.21.15.84:6835/3879250964] conn(0x561b54b14dc0 0x561b54b7dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:49.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.537+0000 7fc75cff9700 10 client.7389 ms_handle_connect on v2:172.21.15.84:6833/3879250964 2023-07-14T11:18:49.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.537+0000 7fc78139a700 1 --2- 172.21.15.84:0/1737451206 >> [v2:172.21.15.84:6833/3879250964,v1:172.21.15.84:6835/3879250964] conn(0x561b54b14dc0 0x561b54b7dec0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=465766988ec50055 server_cookie=5df2bfc4e04ea4e9 in_seq=0 out_seq=0 2023-07-14T11:18:49.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.537+0000 7fc75cff9700 1 -- 172.21.15.84:0/1737451206 <== mds.0 v2:172.21.15.84:6833/3879250964 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+318 (crc 0 0 0) 0x561b54a61d20 con 0x561b54b14dc0 2023-07-14T11:18:49.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.537+0000 7fc75cff9700 10 client.7389 handle_command_reply: tid=0 2023-07-14T11:18:49.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.537+0000 7fc7977d3b80 1 client.7389 shutdown 2023-07-14T11:18:49.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.537+0000 7fc7977d3b80 1 -- 172.21.15.84:0/1737451206 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561b54b0d3b0 msgr2=0x561b54b60530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:49.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.537+0000 7fc7977d3b80 1 --2- 172.21.15.84:0/1737451206 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561b54b0d3b0 0x561b54b60530 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fc77805c280 tx=0x7fc778054550 comp rx=0 tx=0).stop 2023-07-14T11:18:49.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.537+0000 7fc7977d3b80 1 -- 172.21.15.84:0/1737451206 shutdown_connections 2023-07-14T11:18:49.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.537+0000 7fc7977d3b80 1 --2- 172.21.15.84:0/1737451206 >> [v2:172.21.15.84:6833/3879250964,v1:172.21.15.84:6835/3879250964] conn(0x561b54b14dc0 0x561b54b7dec0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:49.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.537+0000 7fc7977d3b80 1 --2- 172.21.15.84:0/1737451206 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561b54b12c50 0x561b54b7d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:49.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.537+0000 7fc7977d3b80 1 --2- 172.21.15.84:0/1737451206 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561b54b0d3b0 0x561b54b60530 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:49.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.537+0000 7fc7977d3b80 1 --2- 172.21.15.84:0/1737451206 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b54b12880 0x561b54b60a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:49.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.537+0000 7fc7977d3b80 1 -- 172.21.15.84:0/1737451206 >> 172.21.15.84:0/1737451206 conn(0x561b54b42710 msgr2=0x561b54b3fa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:49.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.537+0000 7fc75cff9700 0 client.7389 ms_handle_reset on v2:172.21.15.84:6833/3879250964 2023-07-14T11:18:49.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.538+0000 7fc7977d3b80 1 -- 172.21.15.84:0/1737451206 shutdown_connections 2023-07-14T11:18:49.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.538+0000 7fc7977d3b80 1 -- 172.21.15.84:0/1737451206 wait complete. 2023-07-14T11:18:49.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.538+0000 7fc7977d3b80 20 client.7389 trim_cache size 0 max 16384 2023-07-14T11:18:49.550 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-07-14T11:18:49.550 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f", 2023-07-14T11:18:49.551 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 0, 2023-07-14T11:18:49.551 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 7227, 2023-07-14T11:18:49.551 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2023-07-14T11:18:49.551 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2023-07-14T11:18:49.551 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2023-07-14T11:18:49.552 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 6.520539555, 2023-07-14T11:18:49.552 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 54, 2023-07-14T11:18:49.552 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 88, 2023-07-14T11:18:49.552 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 88, 2023-07-14T11:18:49.552 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 13.025845058 2023-07-14T11:18:49.552 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-07-14T11:18:49.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.538+0000 7fc783dff700 1 -- 172.21.15.84:0/4018166304 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fc76006ae00 msgr2=0x7fc76006d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:49.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.538+0000 7fc783dff700 1 --2- 172.21.15.84:0/4018166304 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fc76006ae00 0x7fc76006d2b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc76c009130 tx=0x7fc76c008030 comp rx=0 tx=0).stop 2023-07-14T11:18:49.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.538+0000 7fc783dff700 1 -- 172.21.15.84:0/4018166304 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc77c0b4860 msgr2=0x7fc77c15e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:49.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.538+0000 7fc783dff700 1 --2- 172.21.15.84:0/4018166304 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc77c0b4860 0x7fc77c15e620 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7fc77800c500 tx=0x7fc77800c8c0 comp rx=0 tx=0).stop 2023-07-14T11:18:49.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.538+0000 7fc783dff700 1 -- 172.21.15.84:0/4018166304 shutdown_connections 2023-07-14T11:18:49.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.538+0000 7fc783dff700 1 --2- 172.21.15.84:0/4018166304 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fc76006ae00 0x7fc76006d2b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:49.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.538+0000 7fc783dff700 1 --2- 172.21.15.84:0/4018166304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc77c0d12c0 0x7fc77c147e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:49.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.538+0000 7fc783dff700 1 --2- 172.21.15.84:0/4018166304 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc77c0b4860 0x7fc77c15e620 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:49.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.538+0000 7fc783dff700 1 --2- 172.21.15.84:0/4018166304 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc77c0b8660 0x7fc77c1478e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:49.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.538+0000 7fc783dff700 1 -- 172.21.15.84:0/4018166304 >> 172.21.15.84:0/4018166304 conn(0x7fc77c066860 msgr2=0x7fc77c0d2470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:49.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.538+0000 7fc783dff700 1 -- 172.21.15.84:0/4018166304 shutdown_connections 2023-07-14T11:18:49.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.538+0000 7fc783dff700 1 -- 172.21.15.84:0/4018166304 wait complete. 2023-07-14T11:18:49.559 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-14T11:18:49.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.750+0000 7f4d4bfff700 1 Processor -- start 2023-07-14T11:18:49.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.751+0000 7f4d4bfff700 1 -- start start 2023-07-14T11:18:49.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.752+0000 7f4d4bfff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4d441500d0 0x7f4d44070350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:49.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.752+0000 7f4d4bfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d44070890 0x7f4d441597c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:49.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.752+0000 7f4d4bfff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d440cdf90 con 0x7f4d44159d00 2023-07-14T11:18:49.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.752+0000 7f4d4bfff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d4415a2f0 con 0x7f4d441500d0 2023-07-14T11:18:49.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.752+0000 7f4d4bfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4415a5d0 con 0x7f4d44070890 2023-07-14T11:18:49.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.752+0000 7f4d4a59c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f4d44159d00 0x7f4d440cea50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51232/0 (socket says 172.21.15.84:51232) 2023-07-14T11:18:49.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.752+0000 7f4d4a59c700 1 -- 172.21.15.84:0/3073379214 learned_addr learned my addr 172.21.15.84:0/3073379214 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:18:49.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.752+0000 7f4d4959a700 1 --2- 172.21.15.84:0/3073379214 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d44070890 0x7f4d441597c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:49.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.752+0000 7f4d49d9b700 1 --2- 172.21.15.84:0/3073379214 >> v2:172.21.15.179:3300/0 conn(0x7f4d441500d0 0x7f4d44070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:49.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.753+0000 7f4d48d99700 1 -- 172.21.15.84:0/3073379214 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 278562130 0 0) 0x7f4d440cdf90 con 0x7f4d44159d00 2023-07-14T11:18:49.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.753+0000 7f4d48d99700 1 -- 172.21.15.84:0/3073379214 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d300035b0 con 0x7f4d44159d00 2023-07-14T11:18:49.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.753+0000 7f4d49d9b700 1 -- 172.21.15.84:0/3073379214 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d44070890 msgr2=0x7f4d441597c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:49.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.753+0000 7f4d49d9b700 1 --2- 172.21.15.84:0/3073379214 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d44070890 0x7f4d441597c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:49.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.753+0000 7f4d49d9b700 1 -- 172.21.15.84:0/3073379214 >> v1:172.21.15.84:6789/0 conn(0x7f4d44159d00 legacy=0x7f4d440cea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:49.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.753+0000 7f4d49d9b700 1 -- 172.21.15.84:0/3073379214 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d440ce250 con 0x7f4d441500d0 2023-07-14T11:18:49.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.753+0000 7f4d49d9b700 1 --2- 172.21.15.84:0/3073379214 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d441500d0 0x7f4d44070350 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f4d40009840 tx=0x7f4d40009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b96b2cc270e5431b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:49.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.753+0000 7f4d48d99700 1 -- 172.21.15.84:0/3073379214 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d40011830 con 0x7f4d441500d0 2023-07-14T11:18:49.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.753+0000 7f4d48d99700 1 -- 172.21.15.84:0/3073379214 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d40011990 con 0x7f4d441500d0 2023-07-14T11:18:49.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.753+0000 7f4d48d99700 1 -- 172.21.15.84:0/3073379214 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d40011d00 con 0x7f4d441500d0 2023-07-14T11:18:49.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.754+0000 7f4d4bfff700 1 -- 172.21.15.84:0/3073379214 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d441500d0 msgr2=0x7f4d44070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:49.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.754+0000 7f4d4bfff700 1 --2- 172.21.15.84:0/3073379214 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d441500d0 0x7f4d44070350 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f4d40009840 tx=0x7f4d40009b50 comp rx=0 tx=0).stop 2023-07-14T11:18:49.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.754+0000 7f4d4bfff700 1 -- 172.21.15.84:0/3073379214 shutdown_connections 2023-07-14T11:18:49.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.754+0000 7f4d4bfff700 1 --2- 172.21.15.84:0/3073379214 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d441500d0 0x7f4d44070350 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:49.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.754+0000 7f4d4bfff700 1 --2- 172.21.15.84:0/3073379214 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d44070890 0x7f4d441597c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:49.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.754+0000 7f4d4bfff700 1 -- 172.21.15.84:0/3073379214 >> 172.21.15.84:0/3073379214 conn(0x7f4d44069f30 msgr2=0x7f4d4406a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:49.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.754+0000 7f4d4bfff700 1 -- 172.21.15.84:0/3073379214 shutdown_connections 2023-07-14T11:18:49.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.754+0000 7f4d4bfff700 1 -- 172.21.15.84:0/3073379214 wait complete. 2023-07-14T11:18:49.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.756+0000 7f4d4bfff700 1 Processor -- start 2023-07-14T11:18:49.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.756+0000 7f4d4bfff700 1 -- start start 2023-07-14T11:18:49.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.757+0000 7f4d4bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d44070890 0x7f4d441477b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:49.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.757+0000 7f4d4bfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d441500d0 0x7f4d441e61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:49.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.757+0000 7f4d4bfff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d44159d00 0x7f4d44158200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:49.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.757+0000 7f4d4bfff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d44147cf0 con 0x7f4d44070890 2023-07-14T11:18:49.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.757+0000 7f4d4bfff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4414ab10 con 0x7f4d44159d00 2023-07-14T11:18:49.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.757+0000 7f4d4bfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4414adf0 con 0x7f4d441500d0 2023-07-14T11:18:49.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.757+0000 7f4d49d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d44070890 0x7f4d441477b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:49.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.757+0000 7f4d49d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d44070890 0x7f4d441477b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41156/0 (socket says 172.21.15.84:41156) 2023-07-14T11:18:49.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.757+0000 7f4d49d9b700 1 -- 172.21.15.84:0/4102401224 learned_addr learned my addr 172.21.15.84:0/4102401224 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:49.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.757+0000 7f4d4959a700 1 --2- 172.21.15.84:0/4102401224 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d441500d0 0x7f4d441e61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:49.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.757+0000 7f4d4a59c700 1 --2- 172.21.15.84:0/4102401224 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d44159d00 0x7f4d44158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:49.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.758+0000 7f4d49d9b700 1 -- 172.21.15.84:0/4102401224 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d441500d0 msgr2=0x7f4d441e61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:49.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.758+0000 7f4d49d9b700 1 --2- 172.21.15.84:0/4102401224 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d441500d0 0x7f4d441e61c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:49.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.758+0000 7f4d49d9b700 1 -- 172.21.15.84:0/4102401224 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d44159d00 msgr2=0x7f4d44158200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:49.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.758+0000 7f4d49d9b700 1 --2- 172.21.15.84:0/4102401224 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d44159d00 0x7f4d44158200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:49.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.758+0000 7f4d49d9b700 1 -- 172.21.15.84:0/4102401224 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d400094a0 con 0x7f4d44070890 2023-07-14T11:18:49.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.758+0000 7f4d49d9b700 1 --2- 172.21.15.84:0/4102401224 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d44070890 0x7f4d441477b0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f4d40009b90 tx=0x7f4d40004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:49.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.758+0000 7f4d3a7fc700 1 -- 172.21.15.84:0/4102401224 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d400036a0 con 0x7f4d44070890 2023-07-14T11:18:49.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.758+0000 7f4d3a7fc700 1 -- 172.21.15.84:0/4102401224 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d4001f070 con 0x7f4d44070890 2023-07-14T11:18:49.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.758+0000 7f4d4bfff700 1 -- 172.21.15.84:0/4102401224 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d4414b0d0 con 0x7f4d44070890 2023-07-14T11:18:49.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.758+0000 7f4d3a7fc700 1 -- 172.21.15.84:0/4102401224 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d40003a40 con 0x7f4d44070890 2023-07-14T11:18:49.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.758+0000 7f4d4bfff700 1 -- 172.21.15.84:0/4102401224 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d4414b690 con 0x7f4d44070890 2023-07-14T11:18:49.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.759+0000 7f4d4bfff700 1 -- 172.21.15.84:0/4102401224 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d44070590 con 0x7f4d44070890 2023-07-14T11:18:49.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.760+0000 7f4d3a7fc700 1 -- 172.21.15.84:0/4102401224 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f4d40003ba0 con 0x7f4d44070890 2023-07-14T11:18:49.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.761+0000 7f4d3a7fc700 1 --2- 172.21.15.84:0/4102401224 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f4d2806ae00 0x7f4d2806d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:49.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.761+0000 7f4d3a7fc700 1 -- 172.21.15.84:0/4102401224 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4d40021070 con 0x7f4d44070890 2023-07-14T11:18:49.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.762+0000 7f4d4959a700 1 --2- 172.21.15.84:0/4102401224 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f4d2806ae00 0x7f4d2806d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:49.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.762+0000 7f4d4959a700 1 --2- 172.21.15.84:0/4102401224 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f4d2806ae00 0x7f4d2806d2b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4d34009b70 tx=0x7f4d34008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:49.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:49.766+0000 7f4d3a7fc700 1 -- 172.21.15.84:0/4102401224 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f4d40055e90 con 0x7f4d44070890 2023-07-14T11:18:50.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:50.002+0000 7f4d4bfff700 1 -- 172.21.15.84:0/4102401224 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4d4404e280 con 0x7f4d44070890 2023-07-14T11:18:50.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:50.003+0000 7f4d3a7fc700 1 -- 172.21.15.84:0/4102401224 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v54) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4d40015020 con 0x7f4d44070890 2023-07-14T11:18:50.007 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-14T11:18:50.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:50.005+0000 7f4d4bfff700 1 -- 172.21.15.84:0/4102401224 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f4d2806ae00 msgr2=0x7f4d2806d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:50.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:50.005+0000 7f4d4bfff700 1 --2- 172.21.15.84:0/4102401224 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f4d2806ae00 0x7f4d2806d2b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4d34009b70 tx=0x7f4d34008040 comp rx=0 tx=0).stop 2023-07-14T11:18:50.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:50.005+0000 7f4d4bfff700 1 -- 172.21.15.84:0/4102401224 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d44070890 msgr2=0x7f4d441477b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:50.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:50.005+0000 7f4d4bfff700 1 --2- 172.21.15.84:0/4102401224 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d44070890 0x7f4d441477b0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f4d40009b90 tx=0x7f4d40004750 comp rx=0 tx=0).stop 2023-07-14T11:18:50.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:50.005+0000 7f4d4bfff700 1 -- 172.21.15.84:0/4102401224 shutdown_connections 2023-07-14T11:18:50.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:50.005+0000 7f4d4bfff700 1 --2- 172.21.15.84:0/4102401224 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d44159d00 0x7f4d44158200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:50.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:50.005+0000 7f4d4bfff700 1 --2- 172.21.15.84:0/4102401224 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d44070890 0x7f4d441477b0 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:50.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:50.005+0000 7f4d4bfff700 1 --2- 172.21.15.84:0/4102401224 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f4d2806ae00 0x7f4d2806d2b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:50.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:50.005+0000 7f4d4bfff700 1 --2- 172.21.15.84:0/4102401224 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d441500d0 0x7f4d441e61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:50.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:50.005+0000 7f4d4bfff700 1 -- 172.21.15.84:0/4102401224 >> 172.21.15.84:0/4102401224 conn(0x7f4d44069f30 msgr2=0x7f4d441504a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:50.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:50.005+0000 7f4d4bfff700 1 -- 172.21.15.84:0/4102401224 shutdown_connections 2023-07-14T11:18:50.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:50.005+0000 7f4d4bfff700 1 -- 172.21.15.84:0/4102401224 wait complete. 2023-07-14T11:18:50.027 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-14T11:18:50.027 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-14T11:18:50.027 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi084.front.sepia.ceph.com 2023-07-14T11:18:50.028 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-14T11:18:50.028 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-14T11:18:50.028 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-14T11:18:50.029 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-14T11:18:50.029 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-14T11:18:50.029 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-14T11:18:50.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:18:50.030 DEBUG:teuthology.orchestra.run.smithi084:> ip addr 2023-07-14T11:18:50.077 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-14T11:18:50.077 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-14T11:18:50.077 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2023-07-14T11:18:50.077 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:18:50.078 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2023-07-14T11:18:50.078 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:18:50.078 INFO:teuthology.orchestra.run.smithi084.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T11:18:50.078 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:68 brd ff:ff:ff:ff:ff:ff 2023-07-14T11:18:50.078 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f0 2023-07-14T11:18:50.078 INFO:teuthology.orchestra.run.smithi084.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T11:18:50.078 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:69 brd ff:ff:ff:ff:ff:ff 2023-07-14T11:18:50.078 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f1 2023-07-14T11:18:50.079 INFO:teuthology.orchestra.run.smithi084.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T11:18:50.079 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:50 brd ff:ff:ff:ff:ff:ff 2023-07-14T11:18:50.079 INFO:teuthology.orchestra.run.smithi084.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-14T11:18:50.079 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:51 brd ff:ff:ff:ff:ff:ff 2023-07-14T11:18:50.079 INFO:teuthology.orchestra.run.smithi084.stdout: inet 172.21.15.84/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-14T11:18:50.079 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft 41638sec preferred_lft 41638sec 2023-07-14T11:18:50.079 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::ec4:7aff:fe8f:d751/64 scope link 2023-07-14T11:18:50.079 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:18:50.080 INFO:teuthology.orchestra.run.smithi084.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-14T11:18:50.080 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 2e:15:90:61:8f:22 brd ff:ff:ff:ff:ff:ff 2023-07-14T11:18:50.080 INFO:teuthology.orchestra.run.smithi084.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-14T11:18:50.080 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:18:50.080 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::dc90:1eff:feca:b2b4/64 scope link 2023-07-14T11:18:50.080 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:18:50.080 INFO:teuthology.orchestra.run.smithi084.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-14T11:18:50.081 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 2e:15:90:61:8f:22 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-14T11:18:50.081 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::2c15:90ff:fe61:8f22/64 scope link 2023-07-14T11:18:50.081 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:18:50.081 INFO:teuthology.orchestra.run.smithi084.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-14T11:18:50.081 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 5e:77:8b:e6:63:60 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-14T11:18:50.081 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::5c77:8bff:fee6:6360/64 scope link 2023-07-14T11:18:50.081 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:18:50.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:18:50.083 DEBUG:teuthology.orchestra.run.smithi084:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-14T11:18:50.189 INFO:teuthology.orchestra.run.smithi084.stdout:1 2023-07-14T11:18:50.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:18:50.192 DEBUG:teuthology.orchestra.run.smithi084:> route 2023-07-14T11:18:50.240 INFO:teuthology.orchestra.run.smithi084.stdout:Kernel IP routing table 2023-07-14T11:18:50.241 INFO:teuthology.orchestra.run.smithi084.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-14T11:18:50.241 INFO:teuthology.orchestra.run.smithi084.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-14T11:18:50.241 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-14T11:18:50.241 INFO:teuthology.orchestra.run.smithi084.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-14T11:18:50.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:18:50.242 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-07-14T11:18:50.243 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-07-14T11:18:50.243 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-14T11:18:50.243 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-14T11:18:50.244 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-14T11:18:50.244 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-07-14T11:18:50.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:18:50.414 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2023-07-14T11:18:50.460 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-14T11:18:50.460 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-14T11:18:50.461 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-14T11:18:50.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:18:50.462 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set brx.0 up 2023-07-14T11:18:50.531 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T11:18:50.532 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-14T11:18:50.577 INFO:teuthology.orchestra.run.smithi084.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-14T11:18:50.578 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T11:18:50.578 DEBUG:teuthology.orchestra.run.smithi084:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-14T11:18:50.663 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-07-14T11:18:50.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:18:50.663 DEBUG:teuthology.orchestra.run.smithi084:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-14T11:18:50.807 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-14T11:18:50.807 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-14T11:18:50.834 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-14T11:18:50.834 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-14T11:18:50.834 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-07-14T11:18:50.834 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: trying mount with new device syntax: 0@3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f.cephfs=/ 2023-07-14T11:18:50.834 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.84:3300/172.21.15.179:3300/172.21.15.179:3301" will pass to kernel 2023-07-14T11:18:50.839 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-14T11:18:50.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:18:50.840 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-14T11:18:50.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:18:50.910 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-14T11:18:51.012 INFO:teuthology.orchestra.run.smithi084.stdout:client7398 2023-07-14T11:18:51.013 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-14T11:18:51.013 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:18:51.062 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-14T11:18:51.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:51.255+0000 7fabf7bff700 1 Processor -- start 2023-07-14T11:18:51.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:51.255+0000 7fabf7bff700 1 -- start start 2023-07-14T11:18:51.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:51.256+0000 7fabf7bff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fabf015ca30 0x7fabf006c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:51.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:51.256+0000 7fabf7bff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fabf00d0f40 0x7fabf00cec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:51.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:51.257+0000 7fabf7bff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabf00cf1d0 con 0x7fabf00ce840 2023-07-14T11:18:51.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:51.257+0000 7fabf7bff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabf006c360 con 0x7fabf00d0f40 2023-07-14T11:18:51.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:51.257+0000 7fabf7bff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabf006ba50 con 0x7fabf015ca30 2023-07-14T11:18:51.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:51.257+0000 7fabf619c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fabf00d0f40 0x7fabf00cec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:51.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:51.257+0000 7fabf619c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fabf00d0f40 0x7fabf00cec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41160/0 (socket says 172.21.15.84:41160) 2023-07-14T11:18:51.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:51.257+0000 7fabf619c700 1 -- 172.21.15.84:0/3153411805 learned_addr learned my addr 172.21.15.84:0/3153411805 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:51.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:51.257+0000 7fabf599b700 1 --2- 172.21.15.84:0/3153411805 >> v2:172.21.15.179:3300/0 conn(0x7fabf015ca30 0x7fabf006c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:51.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:51.257+0000 7fabf619c700 1 -- 172.21.15.84:0/3153411805 >> v2:172.21.15.179:3300/0 conn(0x7fabf015ca30 msgr2=0x7fabf006c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:51.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:51.257+0000 7fabf619c700 1 --2- 172.21.15.84:0/3153411805 >> v2:172.21.15.179:3300/0 conn(0x7fabf015ca30 0x7fabf006c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:51.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:51.257+0000 7fabf619c700 1 -- 172.21.15.84:0/3153411805 >> v1:172.21.15.179:6789/0 conn(0x7fabf00ce840 legacy=0x7fabf00d0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:51.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:51.257+0000 7fabf619c700 1 -- 172.21.15.84:0/3153411805 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf00d1b70 con 0x7fabf00d0f40 2023-07-14T11:18:51.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:51.258+0000 7fabf619c700 1 --2- 172.21.15.84:0/3153411805 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabf00d0f40 0x7fabf00cec90 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7fabf006aa00 tx=0x7fabe800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7f0588088c716b1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:51.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:51.258+0000 7fabf4999700 1 -- 172.21.15.84:0/3153411805 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe800e070 con 0x7fabf00d0f40 2023-07-14T11:18:51.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:51.258+0000 7fabf4999700 1 -- 172.21.15.84:0/3153411805 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabe800b910 con 0x7fabf00d0f40 2023-07-14T11:18:51.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:51.258+0000 7fabf4999700 1 -- 172.21.15.84:0/3153411805 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe800bcc0 con 0x7fabf00d0f40 2023-07-14T11:18:51.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:51.258+0000 7fabf7bff700 1 -- 172.21.15.84:0/3153411805 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabf00d0f40 msgr2=0x7fabf00cec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:51.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:51.258+0000 7fabf7bff700 1 --2- 172.21.15.84:0/3153411805 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabf00d0f40 0x7fabf00cec90 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7fabf006aa00 tx=0x7fabe800b330 comp rx=0 tx=0).stop 2023-07-14T11:18:51.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:51.258+0000 7fabf7bff700 1 -- 172.21.15.84:0/3153411805 shutdown_connections 2023-07-14T11:18:51.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:51.258+0000 7fabf7bff700 1 --2- 172.21.15.84:0/3153411805 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabf00d0f40 0x7fabf00cec90 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:51.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:51.258+0000 7fabf7bff700 1 --2- 172.21.15.84:0/3153411805 >> v2:172.21.15.179:3300/0 conn(0x7fabf015ca30 0x7fabf006c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:51.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:51.258+0000 7fabf7bff700 1 -- 172.21.15.84:0/3153411805 >> 172.21.15.84:0/3153411805 conn(0x7fabf00664f0 msgr2=0x7fabf0099fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:51.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:51.258+0000 7fabf7bff700 1 -- 172.21.15.84:0/3153411805 shutdown_connections 2023-07-14T11:18:51.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:51.259+0000 7fabf7bff700 1 -- 172.21.15.84:0/3153411805 wait complete. 2023-07-14T11:18:51.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:51.260+0000 7fabf7bff700 1 Processor -- start 2023-07-14T11:18:51.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:51.260+0000 7fabf7bff700 1 -- start start 2023-07-14T11:18:51.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:51.261+0000 7fabf7bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabf00ce840 0x7fabf00c5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:51.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:51.261+0000 7fabf7bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabf00d0f40 0x7fabf0154560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:51.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:51.261+0000 7fabf7bff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabf015ca30 0x7fabf00cd220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:51.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:51.261+0000 7fabf7bff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf00c59b0 con 0x7fabf015ca30 2023-07-14T11:18:51.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:51.261+0000 7fabf7bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf00b1c70 con 0x7fabf00d0f40 2023-07-14T11:18:51.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:51.261+0000 7fabf7bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabf00b1f50 con 0x7fabf00ce840 2023-07-14T11:18:51.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:51.262+0000 7fabf619c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabf015ca30 0x7fabf00cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:51.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:51.262+0000 7fabf619c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabf015ca30 0x7fabf00cd220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41166/0 (socket says 172.21.15.84:41166) 2023-07-14T11:18:51.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:51.262+0000 7fabf619c700 1 -- 172.21.15.84:0/1281116715 learned_addr learned my addr 172.21.15.84:0/1281116715 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:51.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:51.262+0000 7fabf599b700 1 --2- 172.21.15.84:0/1281116715 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabf00ce840 0x7fabf00c5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:51.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:51.262+0000 7fabf519a700 1 --2- 172.21.15.84:0/1281116715 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabf00d0f40 0x7fabf0154560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:51.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:51.262+0000 7fabf619c700 1 -- 172.21.15.84:0/1281116715 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabf00ce840 msgr2=0x7fabf00c5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:51.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:51.262+0000 7fabf619c700 1 --2- 172.21.15.84:0/1281116715 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabf00ce840 0x7fabf00c5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:51.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:51.262+0000 7fabf619c700 1 -- 172.21.15.84:0/1281116715 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabf00d0f40 msgr2=0x7fabf0154560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:51.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:51.262+0000 7fabf619c700 1 --2- 172.21.15.84:0/1281116715 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabf00d0f40 0x7fabf0154560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:51.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:51.262+0000 7fabf619c700 1 -- 172.21.15.84:0/1281116715 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe8009b30 con 0x7fabf015ca30 2023-07-14T11:18:51.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:51.262+0000 7fabf519a700 1 --2- 172.21.15.84:0/1281116715 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabf00d0f40 0x7fabf0154560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:18:51.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:51.262+0000 7fabf619c700 1 --2- 172.21.15.84:0/1281116715 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabf015ca30 0x7fabf00cd220 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7fabe800b370 tx=0x7fabe8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:51.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:51.262+0000 7fabe67fc700 1 -- 172.21.15.84:0/1281116715 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe80099b0 con 0x7fabf015ca30 2023-07-14T11:18:51.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:51.262+0000 7fabe67fc700 1 -- 172.21.15.84:0/1281116715 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabe80092e0 con 0x7fabf015ca30 2023-07-14T11:18:51.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:51.263+0000 7fabf7bff700 1 -- 172.21.15.84:0/1281116715 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabf00b2230 con 0x7fabf015ca30 2023-07-14T11:18:51.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:51.263+0000 7fabe67fc700 1 -- 172.21.15.84:0/1281116715 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe801c660 con 0x7fabf015ca30 2023-07-14T11:18:51.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:51.263+0000 7fabf7bff700 1 -- 172.21.15.84:0/1281116715 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabf0154aa0 con 0x7fabf015ca30 2023-07-14T11:18:51.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:51.264+0000 7fabf7bff700 1 -- 172.21.15.84:0/1281116715 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabf00cfc20 con 0x7fabf015ca30 2023-07-14T11:18:51.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:51.265+0000 7fabe67fc700 1 -- 172.21.15.84:0/1281116715 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7fabe801c7c0 con 0x7fabf015ca30 2023-07-14T11:18:51.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:51.265+0000 7fabe67fc700 1 --2- 172.21.15.84:0/1281116715 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fabd406ae30 0x7fabd406d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:51.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:51.266+0000 7fabe67fc700 1 -- 172.21.15.84:0/1281116715 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fabe808b400 con 0x7fabf015ca30 2023-07-14T11:18:51.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:51.266+0000 7fabf599b700 1 --2- 172.21.15.84:0/1281116715 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fabd406ae30 0x7fabd406d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:51.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:51.267+0000 7fabf599b700 1 --2- 172.21.15.84:0/1281116715 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fabd406ae30 0x7fabd406d2e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fabf00b6c10 tx=0x7fabec008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:51.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:51.270+0000 7fabe67fc700 1 -- 172.21.15.84:0/1281116715 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fabe8056280 con 0x7fabf015ca30 2023-07-14T11:18:51.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:51.507+0000 7fabf7bff700 1 -- 172.21.15.84:0/1281116715 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fabf004e280 con 0x7fabf015ca30 2023-07-14T11:18:51.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:51.507+0000 7fabe67fc700 1 -- 172.21.15.84:0/1281116715 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v54) v1 ==== 53+0+73 (secure 0 0 0) 0x7fabe80598a0 con 0x7fabf015ca30 2023-07-14T11:18:51.511 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-14T11:18:51.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:51.509+0000 7fabf7bff700 1 -- 172.21.15.84:0/1281116715 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fabd406ae30 msgr2=0x7fabd406d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:51.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:51.509+0000 7fabf7bff700 1 --2- 172.21.15.84:0/1281116715 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fabd406ae30 0x7fabd406d2e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fabf00b6c10 tx=0x7fabec008040 comp rx=0 tx=0).stop 2023-07-14T11:18:51.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:51.509+0000 7fabf7bff700 1 -- 172.21.15.84:0/1281116715 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabf015ca30 msgr2=0x7fabf00cd220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:51.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:51.509+0000 7fabf7bff700 1 --2- 172.21.15.84:0/1281116715 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabf015ca30 0x7fabf00cd220 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7fabe800b370 tx=0x7fabe8004ad0 comp rx=0 tx=0).stop 2023-07-14T11:18:51.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:51.509+0000 7fabf7bff700 1 -- 172.21.15.84:0/1281116715 shutdown_connections 2023-07-14T11:18:51.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:51.509+0000 7fabf7bff700 1 --2- 172.21.15.84:0/1281116715 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fabd406ae30 0x7fabd406d2e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:51.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:51.509+0000 7fabf7bff700 1 --2- 172.21.15.84:0/1281116715 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fabf00ce840 0x7fabf00c5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:51.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:51.509+0000 7fabf7bff700 1 --2- 172.21.15.84:0/1281116715 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabf015ca30 0x7fabf00cd220 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:51.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:51.509+0000 7fabf7bff700 1 --2- 172.21.15.84:0/1281116715 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabf00d0f40 0x7fabf0154560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:51.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:51.509+0000 7fabf7bff700 1 -- 172.21.15.84:0/1281116715 >> 172.21.15.84:0/1281116715 conn(0x7fabf00664f0 msgr2=0x7fabf006eed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:51.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:51.509+0000 7fabf7bff700 1 -- 172.21.15.84:0/1281116715 shutdown_connections 2023-07-14T11:18:51.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:51.509+0000 7fabf7bff700 1 -- 172.21.15.84:0/1281116715 wait complete. 2023-07-14T11:18:51.531 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-14T11:18:51.531 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-14T11:18:51.531 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi179.front.sepia.ceph.com 2023-07-14T11:18:51.532 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-07-14T11:18:51.532 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-14T11:18:51.532 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-14T11:18:51.532 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-14T11:18:51.533 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-14T11:18:51.533 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-14T11:18:51.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:18:51.534 DEBUG:teuthology.orchestra.run.smithi179:> ip addr 2023-07-14T11:18:51.585 INFO:teuthology.orchestra.run.smithi179.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-14T11:18:51.585 INFO:teuthology.orchestra.run.smithi179.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-14T11:18:51.586 INFO:teuthology.orchestra.run.smithi179.stdout: inet 127.0.0.1/8 scope host lo 2023-07-14T11:18:51.586 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:18:51.586 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 ::1/128 scope host 2023-07-14T11:18:51.586 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:18:51.586 INFO:teuthology.orchestra.run.smithi179.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T11:18:51.586 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:34 brd ff:ff:ff:ff:ff:ff 2023-07-14T11:18:51.586 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f0 2023-07-14T11:18:51.587 INFO:teuthology.orchestra.run.smithi179.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T11:18:51.587 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:35 brd ff:ff:ff:ff:ff:ff 2023-07-14T11:18:51.587 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f1 2023-07-14T11:18:51.587 INFO:teuthology.orchestra.run.smithi179.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T11:18:51.587 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5a brd ff:ff:ff:ff:ff:ff 2023-07-14T11:18:51.587 INFO:teuthology.orchestra.run.smithi179.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-14T11:18:51.587 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5b brd ff:ff:ff:ff:ff:ff 2023-07-14T11:18:51.587 INFO:teuthology.orchestra.run.smithi179.stdout: inet 172.21.15.179/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-14T11:18:51.588 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft 41524sec preferred_lft 41524sec 2023-07-14T11:18:51.588 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::ec4:7aff:fe88:725b/64 scope link 2023-07-14T11:18:51.588 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:18:51.588 INFO:teuthology.orchestra.run.smithi179.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-14T11:18:51.588 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 46:75:18:db:4e:84 brd ff:ff:ff:ff:ff:ff 2023-07-14T11:18:51.588 INFO:teuthology.orchestra.run.smithi179.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-14T11:18:51.588 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:18:51.589 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::fc06:a1ff:feba:ddf1/64 scope link 2023-07-14T11:18:51.589 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:18:51.589 INFO:teuthology.orchestra.run.smithi179.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-14T11:18:51.589 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 92:db:40:bf:aa:be brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-14T11:18:51.589 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::90db:40ff:febf:aabe/64 scope link 2023-07-14T11:18:51.589 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:18:51.590 INFO:teuthology.orchestra.run.smithi179.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-14T11:18:51.590 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 46:75:18:db:4e:84 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-07-14T11:18:51.590 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::4475:18ff:fedb:4e84/64 scope link 2023-07-14T11:18:51.590 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:18:51.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:18:51.591 DEBUG:teuthology.orchestra.run.smithi179:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-14T11:18:51.662 INFO:teuthology.orchestra.run.smithi179.stdout:1 2023-07-14T11:18:51.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:18:51.666 DEBUG:teuthology.orchestra.run.smithi179:> route 2023-07-14T11:18:51.714 INFO:teuthology.orchestra.run.smithi179.stdout:Kernel IP routing table 2023-07-14T11:18:51.715 INFO:teuthology.orchestra.run.smithi179.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-14T11:18:51.715 INFO:teuthology.orchestra.run.smithi179.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-14T11:18:51.715 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-14T11:18:51.715 INFO:teuthology.orchestra.run.smithi179.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-14T11:18:51.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:18:51.716 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2023-07-14T11:18:51.717 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2023-07-14T11:18:51.717 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-14T11:18:51.717 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-14T11:18:51.718 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-14T11:18:51.718 DEBUG:teuthology.orchestra.run.smithi179:> ') 2023-07-14T11:18:51.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:18:51.887 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2023-07-14T11:18:51.933 INFO:teuthology.orchestra.run.smithi179.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-07-14T11:18:51.934 INFO:teuthology.orchestra.run.smithi179.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-14T11:18:51.935 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-14T11:18:51.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:18:51.935 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link set brx.0 up 2023-07-14T11:18:52.004 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T11:18:52.005 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-07-14T11:18:52.051 INFO:teuthology.orchestra.run.smithi179.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-07-14T11:18:52.052 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T11:18:52.053 DEBUG:teuthology.orchestra.run.smithi179:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-07-14T11:18:52.137 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-07-14T11:18:52.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:18:52.138 DEBUG:teuthology.orchestra.run.smithi179:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-14T11:18:52.281 INFO:teuthology.orchestra.run.smithi179.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-14T11:18:52.281 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-14T11:18:52.308 INFO:teuthology.orchestra.run.smithi179.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-14T11:18:52.309 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-14T11:18:52.309 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-07-14T11:18:52.309 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: trying mount with new device syntax: 1@3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f.cephfs=/ 2023-07-14T11:18:52.309 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.84:3300/172.21.15.179:3300/172.21.15.179:3301" will pass to kernel 2023-07-14T11:18:52.313 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-14T11:18:52.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:18:52.314 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-07-14T11:18:52.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:18:52.383 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-14T11:18:52.470 INFO:teuthology.orchestra.run.smithi179.stdout:client7407 2023-07-14T11:18:52.471 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-07-14T11:18:52.471 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:18:52.517 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-07-14T11:18:52.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:52.722+0000 7f3536fff700 1 Processor -- start 2023-07-14T11:18:52.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:52.722+0000 7f3536fff700 1 -- start start 2023-07-14T11:18:52.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:52.723+0000 7f3536fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35300d1160 0x7f35300cd4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:52.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:52.723+0000 7f3536fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f35300b2440 0x7f35300cda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:52.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:52.723+0000 7f3536fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f353015cc60 con 0x7f353015c890 2023-07-14T11:18:52.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:52.723+0000 7f3536fff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f353006a7f0 con 0x7f35300b2440 2023-07-14T11:18:52.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:52.723+0000 7f3536fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f353006b760 con 0x7f35300d1160 2023-07-14T11:18:52.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:52.724+0000 7f353559c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f35300b2440 0x7f35300cda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:52.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:52.724+0000 7f353559c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f35300b2440 0x7f35300cda10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41180/0 (socket says 172.21.15.84:41180) 2023-07-14T11:18:52.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:52.724+0000 7f353559c700 1 -- 172.21.15.84:0/799642802 learned_addr learned my addr 172.21.15.84:0/799642802 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:52.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:52.724+0000 7f3534d9b700 1 --1- 172.21.15.84:0/799642802 >> v1:172.21.15.179:6789/0 conn(0x7f353015c890 0x7f35300d0a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.84:40776/0 (socket says 172.21.15.84:40776) 2023-07-14T11:18:52.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:52.724+0000 7f352ffff700 1 --2- 172.21.15.84:0/799642802 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35300d1160 0x7f35300cd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:52.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:52.724+0000 7f353559c700 1 -- 172.21.15.84:0/799642802 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35300d1160 msgr2=0x7f35300cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:52.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:52.724+0000 7f353559c700 1 --2- 172.21.15.84:0/799642802 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35300d1160 0x7f35300cd4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:52.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:52.724+0000 7f353559c700 1 -- 172.21.15.84:0/799642802 >> v1:172.21.15.179:6789/0 conn(0x7f353015c890 legacy=0x7f35300d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:52.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:52.724+0000 7f352f7fe700 1 -- 172.21.15.84:0/799642802 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3082062861 0 0) 0x7f353015cc60 con 0x7f353015c890 2023-07-14T11:18:52.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:52.724+0000 7f353559c700 1 -- 172.21.15.84:0/799642802 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f353006ba40 con 0x7f35300b2440 2023-07-14T11:18:52.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:52.724+0000 7f353559c700 1 --2- 172.21.15.84:0/799642802 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35300b2440 0x7f35300cda10 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f3528009e50 tx=0x7f352800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f16be69f80381261 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:52.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:52.725+0000 7f352f7fe700 1 -- 172.21.15.84:0/799642802 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352800e070 con 0x7f35300b2440 2023-07-14T11:18:52.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:52.725+0000 7f352f7fe700 1 -- 172.21.15.84:0/799642802 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f352800b910 con 0x7f35300b2440 2023-07-14T11:18:52.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:52.725+0000 7f352f7fe700 1 -- 172.21.15.84:0/799642802 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352800bcc0 con 0x7f35300b2440 2023-07-14T11:18:52.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:52.725+0000 7f3536fff700 1 -- 172.21.15.84:0/799642802 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35300b2440 msgr2=0x7f35300cda10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:52.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:52.725+0000 7f3536fff700 1 --2- 172.21.15.84:0/799642802 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35300b2440 0x7f35300cda10 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f3528009e50 tx=0x7f352800b330 comp rx=0 tx=0).stop 2023-07-14T11:18:52.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:52.725+0000 7f3536fff700 1 -- 172.21.15.84:0/799642802 shutdown_connections 2023-07-14T11:18:52.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:52.725+0000 7f3536fff700 1 --2- 172.21.15.84:0/799642802 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35300b2440 0x7f35300cda10 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:52.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:52.725+0000 7f3536fff700 1 --2- 172.21.15.84:0/799642802 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35300d1160 0x7f35300cd4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:52.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:52.725+0000 7f3536fff700 1 -- 172.21.15.84:0/799642802 >> 172.21.15.84:0/799642802 conn(0x7f353009c170 msgr2=0x7f35300d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:52.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:52.725+0000 7f3536fff700 1 -- 172.21.15.84:0/799642802 shutdown_connections 2023-07-14T11:18:52.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:52.725+0000 7f3536fff700 1 -- 172.21.15.84:0/799642802 wait complete. 2023-07-14T11:18:52.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:52.728+0000 7f3536fff700 1 Processor -- start 2023-07-14T11:18:52.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:52.728+0000 7f3536fff700 1 -- start start 2023-07-14T11:18:52.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:52.729+0000 7f3536fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35300b2440 0x7f35300b5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:52.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:52.729+0000 7f3536fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35300d1160 0x7f3530156e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:52.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:52.729+0000 7f3536fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f353015c890 0x7f35300b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:52.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:52.729+0000 7f3536fff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35300b72a0 con 0x7f353015c890 2023-07-14T11:18:52.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:52.729+0000 7f3536fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35300c6f60 con 0x7f35300d1160 2023-07-14T11:18:52.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:52.729+0000 7f3536fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35300c6c30 con 0x7f35300b2440 2023-07-14T11:18:52.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:52.729+0000 7f353559c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f353015c890 0x7f35300b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:52.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:52.730+0000 7f353559c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f353015c890 0x7f35300b77a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41192/0 (socket says 172.21.15.84:41192) 2023-07-14T11:18:52.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:52.730+0000 7f353559c700 1 -- 172.21.15.84:0/1014754215 learned_addr learned my addr 172.21.15.84:0/1014754215 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:52.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:52.730+0000 7f3534d9b700 1 --2- 172.21.15.84:0/1014754215 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35300b2440 0x7f35300b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:52.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:52.730+0000 7f352ffff700 1 --2- 172.21.15.84:0/1014754215 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35300d1160 0x7f3530156e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:52.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:52.730+0000 7f353559c700 1 -- 172.21.15.84:0/1014754215 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35300b2440 msgr2=0x7f35300b5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:52.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:52.730+0000 7f353559c700 1 --2- 172.21.15.84:0/1014754215 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35300b2440 0x7f35300b5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:52.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:52.730+0000 7f353559c700 1 -- 172.21.15.84:0/1014754215 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35300d1160 msgr2=0x7f3530156e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:52.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:52.730+0000 7f353559c700 1 --2- 172.21.15.84:0/1014754215 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35300d1160 0x7f3530156e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:52.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:52.730+0000 7f353559c700 1 -- 172.21.15.84:0/1014754215 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3528009b30 con 0x7f353015c890 2023-07-14T11:18:52.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:52.730+0000 7f353559c700 1 --2- 172.21.15.84:0/1014754215 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f353015c890 0x7f35300b77a0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f353006a120 tx=0x7f3528004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:52.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:52.730+0000 7f352d7fa700 1 -- 172.21.15.84:0/1014754215 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3528003ea0 con 0x7f353015c890 2023-07-14T11:18:52.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:52.730+0000 7f352d7fa700 1 -- 172.21.15.84:0/1014754215 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35280099b0 con 0x7f353015c890 2023-07-14T11:18:52.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:52.730+0000 7f352d7fa700 1 -- 172.21.15.84:0/1014754215 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352801c680 con 0x7f353015c890 2023-07-14T11:18:52.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:52.730+0000 7f3536fff700 1 -- 172.21.15.84:0/1014754215 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35300b61f0 con 0x7f353015c890 2023-07-14T11:18:52.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:52.731+0000 7f3536fff700 1 -- 172.21.15.84:0/1014754215 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35300b8900 con 0x7f353015c890 2023-07-14T11:18:52.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:52.731+0000 7f3536fff700 1 -- 172.21.15.84:0/1014754215 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35300c7110 con 0x7f353015c890 2023-07-14T11:18:52.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:52.733+0000 7f352d7fa700 1 -- 172.21.15.84:0/1014754215 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f352801c7e0 con 0x7f353015c890 2023-07-14T11:18:52.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:52.734+0000 7f352d7fa700 1 --2- 172.21.15.84:0/1014754215 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f351406ae00 0x7f351406d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:52.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:52.734+0000 7f352d7fa700 1 -- 172.21.15.84:0/1014754215 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f352808b440 con 0x7f353015c890 2023-07-14T11:18:52.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:52.734+0000 7f3534d9b700 1 --2- 172.21.15.84:0/1014754215 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f351406ae00 0x7f351406d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:52.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:52.735+0000 7f3534d9b700 1 --2- 172.21.15.84:0/1014754215 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f351406ae00 0x7f351406d2b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3524000f60 tx=0x7f3524007be0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:52.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:52.738+0000 7f352d7fa700 1 -- 172.21.15.84:0/1014754215 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f35300c7110 con 0x7f353015c890 2023-07-14T11:18:52.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:52.978+0000 7f3536fff700 1 -- 172.21.15.84:0/1014754215 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f35300c70d0 con 0x7f353015c890 2023-07-14T11:18:53.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.049+0000 7f352d7fa700 1 -- 172.21.15.84:0/1014754215 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v55) v1 ==== 136+0+0 (secure 0 0 0) 0x7f35280562c0 con 0x7f353015c890 2023-07-14T11:18:53.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.052+0000 7f3536fff700 1 -- 172.21.15.84:0/1014754215 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f351406ae00 msgr2=0x7f351406d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:53.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.052+0000 7f3536fff700 1 --2- 172.21.15.84:0/1014754215 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f351406ae00 0x7f351406d2b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3524000f60 tx=0x7f3524007be0 comp rx=0 tx=0).stop 2023-07-14T11:18:53.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.052+0000 7f3536fff700 1 -- 172.21.15.84:0/1014754215 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f353015c890 msgr2=0x7f35300b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:53.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.052+0000 7f3536fff700 1 --2- 172.21.15.84:0/1014754215 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f353015c890 0x7f35300b77a0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f353006a120 tx=0x7f3528004ad0 comp rx=0 tx=0).stop 2023-07-14T11:18:53.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.052+0000 7f3536fff700 1 -- 172.21.15.84:0/1014754215 shutdown_connections 2023-07-14T11:18:53.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.052+0000 7f3536fff700 1 --2- 172.21.15.84:0/1014754215 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f351406ae00 0x7f351406d2b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:53.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.052+0000 7f3536fff700 1 --2- 172.21.15.84:0/1014754215 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35300b2440 0x7f35300b5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:53.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.052+0000 7f3536fff700 1 --2- 172.21.15.84:0/1014754215 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f353015c890 0x7f35300b77a0 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:53.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.052+0000 7f3536fff700 1 --2- 172.21.15.84:0/1014754215 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35300d1160 0x7f3530156e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:53.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.052+0000 7f3536fff700 1 -- 172.21.15.84:0/1014754215 >> 172.21.15.84:0/1014754215 conn(0x7f353009c170 msgr2=0x7f353015bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:53.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.052+0000 7f3536fff700 1 -- 172.21.15.84:0/1014754215 shutdown_connections 2023-07-14T11:18:53.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.052+0000 7f3536fff700 1 -- 172.21.15.84:0/1014754215 wait complete. 2023-07-14T11:18:53.073 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-07-14T11:18:53.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.266+0000 7f7e56dff700 1 Processor -- start 2023-07-14T11:18:53.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.266+0000 7f7e56dff700 1 -- start start 2023-07-14T11:18:53.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.267+0000 7f7e56dff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7e500c92d0 0x7f7e500ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:53.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.267+0000 7f7e56dff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7e500adea0 0x7f7e500cc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:53.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.267+0000 7f7e56dff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e5015ce70 con 0x7f7e500b12f0 2023-07-14T11:18:53.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.267+0000 7f7e56dff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e5015da60 con 0x7f7e500c92d0 2023-07-14T11:18:53.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.267+0000 7f7e56dff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e5015d0c0 con 0x7f7e500adea0 2023-07-14T11:18:53.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.267+0000 7f7e54b9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7e500c92d0 0x7f7e500ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:53.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.267+0000 7f7e4ffff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f7e500b12f0 0x7f7e500c96a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51248/0 (socket says 172.21.15.84:51248) 2023-07-14T11:18:53.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.267+0000 7f7e4ffff700 1 -- 172.21.15.84:0/2593032927 learned_addr learned my addr 172.21.15.84:0/2593032927 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:18:53.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.268+0000 7f7e5539c700 1 --2- 172.21.15.84:0/2593032927 >> v2:172.21.15.179:3300/0 conn(0x7f7e500adea0 0x7f7e500cc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:53.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.268+0000 7f7e54b9b700 1 -- 172.21.15.84:0/2593032927 >> v2:172.21.15.179:3300/0 conn(0x7f7e500adea0 msgr2=0x7f7e500cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:53.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.268+0000 7f7e54b9b700 1 --2- 172.21.15.84:0/2593032927 >> v2:172.21.15.179:3300/0 conn(0x7f7e500adea0 0x7f7e500cc690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:53.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.268+0000 7f7e54b9b700 1 -- 172.21.15.84:0/2593032927 >> v1:172.21.15.84:6789/0 conn(0x7f7e500b12f0 legacy=0x7f7e500c96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:53.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.268+0000 7f7e54b9b700 1 -- 172.21.15.84:0/2593032927 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e5015d3a0 con 0x7f7e500c92d0 2023-07-14T11:18:53.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.268+0000 7f7e4f7fe700 1 -- 172.21.15.84:0/2593032927 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1005379574 0 0) 0x7f7e5015ce70 con 0x7f7e500b12f0 2023-07-14T11:18:53.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.268+0000 7f7e54b9b700 1 --2- 172.21.15.84:0/2593032927 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e500c92d0 0x7f7e500ad8f0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f7e500c9250 tx=0x7f7e44009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1748c64ef8c0e01 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:53.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.268+0000 7f7e4f7fe700 1 -- 172.21.15.84:0/2593032927 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e44011830 con 0x7f7e500c92d0 2023-07-14T11:18:53.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.268+0000 7f7e4f7fe700 1 -- 172.21.15.84:0/2593032927 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e44011990 con 0x7f7e500c92d0 2023-07-14T11:18:53.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.268+0000 7f7e4f7fe700 1 -- 172.21.15.84:0/2593032927 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e44011d20 con 0x7f7e500c92d0 2023-07-14T11:18:53.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.269+0000 7f7e56dff700 1 -- 172.21.15.84:0/2593032927 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e500c92d0 msgr2=0x7f7e500ad8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:53.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.269+0000 7f7e56dff700 1 --2- 172.21.15.84:0/2593032927 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e500c92d0 0x7f7e500ad8f0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f7e500c9250 tx=0x7f7e44009b20 comp rx=0 tx=0).stop 2023-07-14T11:18:53.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.269+0000 7f7e56dff700 1 -- 172.21.15.84:0/2593032927 shutdown_connections 2023-07-14T11:18:53.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.269+0000 7f7e56dff700 1 --2- 172.21.15.84:0/2593032927 >> v2:172.21.15.179:3300/0 conn(0x7f7e500adea0 0x7f7e500cc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:53.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.269+0000 7f7e56dff700 1 --2- 172.21.15.84:0/2593032927 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e500c92d0 0x7f7e500ad8f0 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:53.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.269+0000 7f7e56dff700 1 -- 172.21.15.84:0/2593032927 >> 172.21.15.84:0/2593032927 conn(0x7f7e500b05d0 msgr2=0x7f7e500b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:53.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.269+0000 7f7e56dff700 1 -- 172.21.15.84:0/2593032927 shutdown_connections 2023-07-14T11:18:53.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.269+0000 7f7e56dff700 1 -- 172.21.15.84:0/2593032927 wait complete. 2023-07-14T11:18:53.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.271+0000 7f7e56dff700 1 Processor -- start 2023-07-14T11:18:53.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.271+0000 7f7e56dff700 1 -- start start 2023-07-14T11:18:53.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.272+0000 7f7e56dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e500adea0 0x7f7e501f6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:53.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.272+0000 7f7e56dff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e500b12f0 0x7f7e5014a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:53.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.272+0000 7f7e56dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e500c92d0 0x7f7e500b4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:53.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.272+0000 7f7e56dff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e500b3ba0 con 0x7f7e500b12f0 2023-07-14T11:18:53.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.272+0000 7f7e56dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e501f6890 con 0x7f7e500c92d0 2023-07-14T11:18:53.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.272+0000 7f7e56dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e500b3270 con 0x7f7e500adea0 2023-07-14T11:18:53.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.272+0000 7f7e4ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e500b12f0 0x7f7e5014a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:53.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.272+0000 7f7e4ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e500b12f0 0x7f7e5014a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41200/0 (socket says 172.21.15.84:41200) 2023-07-14T11:18:53.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.272+0000 7f7e4ffff700 1 -- 172.21.15.84:0/378260880 learned_addr learned my addr 172.21.15.84:0/378260880 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:53.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.272+0000 7f7e54b9b700 1 --2- 172.21.15.84:0/378260880 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e500adea0 0x7f7e501f6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:53.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.272+0000 7f7e5539c700 1 --2- 172.21.15.84:0/378260880 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e500c92d0 0x7f7e500b4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:53.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.273+0000 7f7e4ffff700 1 -- 172.21.15.84:0/378260880 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e500adea0 msgr2=0x7f7e501f6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:53.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.273+0000 7f7e4ffff700 1 --2- 172.21.15.84:0/378260880 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e500adea0 0x7f7e501f6350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:53.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.273+0000 7f7e4ffff700 1 -- 172.21.15.84:0/378260880 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e500c92d0 msgr2=0x7f7e500b4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:53.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.273+0000 7f7e4ffff700 1 --2- 172.21.15.84:0/378260880 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e500c92d0 0x7f7e500b4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:53.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.273+0000 7f7e4ffff700 1 -- 172.21.15.84:0/378260880 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e440094a0 con 0x7f7e500b12f0 2023-07-14T11:18:53.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.273+0000 7f7e4ffff700 1 --2- 172.21.15.84:0/378260880 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e500b12f0 0x7f7e5014a010 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c00c750 tx=0x7f7e3c00cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:53.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.273+0000 7f7e4d7fa700 1 -- 172.21.15.84:0/378260880 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c004c80 con 0x7f7e500b12f0 2023-07-14T11:18:53.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.273+0000 7f7e4d7fa700 1 -- 172.21.15.84:0/378260880 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e3c004e00 con 0x7f7e500b12f0 2023-07-14T11:18:53.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.273+0000 7f7e4d7fa700 1 -- 172.21.15.84:0/378260880 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c007310 con 0x7f7e500b12f0 2023-07-14T11:18:53.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.273+0000 7f7e56dff700 1 -- 172.21.15.84:0/378260880 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e500b3550 con 0x7f7e500b12f0 2023-07-14T11:18:53.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.273+0000 7f7e56dff700 1 -- 172.21.15.84:0/378260880 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e5015c670 con 0x7f7e500b12f0 2023-07-14T11:18:53.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.274+0000 7f7e56dff700 1 -- 172.21.15.84:0/378260880 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e500b3d50 con 0x7f7e500b12f0 2023-07-14T11:18:53.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.275+0000 7f7e4d7fa700 1 -- 172.21.15.84:0/378260880 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f7e3c007470 con 0x7f7e500b12f0 2023-07-14T11:18:53.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.277+0000 7f7e4d7fa700 1 --2- 172.21.15.84:0/378260880 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f7e3406ae00 0x7f7e3406d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:53.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.277+0000 7f7e4d7fa700 1 -- 172.21.15.84:0/378260880 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7e3c089410 con 0x7f7e500b12f0 2023-07-14T11:18:53.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.278+0000 7f7e54b9b700 1 --2- 172.21.15.84:0/378260880 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f7e3406ae00 0x7f7e3406d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:53.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.278+0000 7f7e54b9b700 1 --2- 172.21.15.84:0/378260880 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f7e3406ae00 0x7f7e3406d2b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7e440090b0 tx=0x7f7e44008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:53.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.282+0000 7f7e4d7fa700 1 -- 172.21.15.84:0/378260880 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7e500b3d50 con 0x7f7e500b12f0 2023-07-14T11:18:53.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.506+0000 7f7e56dff700 1 -- 172.21.15.84:0/378260880 --> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f7e500b33e0 con 0x7f7e3406ae00 2023-07-14T11:18:53.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.509+0000 7f7e4d7fa700 1 -- 172.21.15.84:0/378260880 <== mgr.4100 v2:172.21.15.179:6836/2094253834 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f7e500b33e0 con 0x7f7e3406ae00 2023-07-14T11:18:53.512 INFO:teuthology.orchestra.run.smithi084.stdout:[ 2023-07-14T11:18:53.512 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:18:53.512 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "cephfs" 2023-07-14T11:18:53.512 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:18:53.513 INFO:teuthology.orchestra.run.smithi084.stdout:] 2023-07-14T11:18:53.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.510+0000 7f7e56dff700 1 -- 172.21.15.84:0/378260880 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f7e3406ae00 msgr2=0x7f7e3406d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:53.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.510+0000 7f7e56dff700 1 --2- 172.21.15.84:0/378260880 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f7e3406ae00 0x7f7e3406d2b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7e440090b0 tx=0x7f7e44008030 comp rx=0 tx=0).stop 2023-07-14T11:18:53.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.510+0000 7f7e56dff700 1 -- 172.21.15.84:0/378260880 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e500b12f0 msgr2=0x7f7e5014a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:53.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.510+0000 7f7e56dff700 1 --2- 172.21.15.84:0/378260880 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e500b12f0 0x7f7e5014a010 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c00c750 tx=0x7f7e3c00cb10 comp rx=0 tx=0).stop 2023-07-14T11:18:53.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.510+0000 7f7e56dff700 1 -- 172.21.15.84:0/378260880 shutdown_connections 2023-07-14T11:18:53.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.510+0000 7f7e56dff700 1 --2- 172.21.15.84:0/378260880 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f7e3406ae00 0x7f7e3406d2b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:53.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.510+0000 7f7e56dff700 1 --2- 172.21.15.84:0/378260880 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e500adea0 0x7f7e501f6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:53.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.510+0000 7f7e56dff700 1 --2- 172.21.15.84:0/378260880 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e500c92d0 0x7f7e500b4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:53.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.510+0000 7f7e56dff700 1 --2- 172.21.15.84:0/378260880 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e500b12f0 0x7f7e5014a010 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:53.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.510+0000 7f7e56dff700 1 -- 172.21.15.84:0/378260880 >> 172.21.15.84:0/378260880 conn(0x7f7e500b05d0 msgr2=0x7f7e50072f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:53.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.511+0000 7f7e56dff700 1 -- 172.21.15.84:0/378260880 shutdown_connections 2023-07-14T11:18:53.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.511+0000 7f7e56dff700 1 -- 172.21.15.84:0/378260880 wait complete. 2023-07-14T11:18:53.532 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-14T11:18:53.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.727+0000 7fc100bff700 1 Processor -- start 2023-07-14T11:18:53.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.727+0000 7fc100bff700 1 -- start start 2023-07-14T11:18:53.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.729+0000 7fc100bff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc0fc0b4d00 0x7fc0fc0d19d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:53.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.729+0000 7fc100bff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0fc0d02a0 con 0x7fc0fc0b4860 2023-07-14T11:18:53.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.729+0000 7fc100bff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0fc0cfce0 con 0x7fc0fc0b8660 2023-07-14T11:18:53.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.729+0000 7fc100bff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0fc0cffc0 con 0x7fc0fc0b4d00 2023-07-14T11:18:53.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.730+0000 7fc0f1d9b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fc0fc0b4860 0x7fc0fc0d12c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51252/0 (socket says 172.21.15.84:51252) 2023-07-14T11:18:53.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.730+0000 7fc0fad9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc0fc0b4d00 0x7fc0fc0d19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:53.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.730+0000 7fc0f1d9b700 1 -- 172.21.15.84:0/1708160966 learned_addr learned my addr 172.21.15.84:0/1708160966 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:18:53.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.730+0000 7fc0f9d9b700 1 -- 172.21.15.84:0/1708160966 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2131393596 0 0) 0x7fc0fc0d02a0 con 0x7fc0fc0b4860 2023-07-14T11:18:53.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.730+0000 7fc0f9d9b700 1 -- 172.21.15.84:0/1708160966 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0e80035b0 con 0x7fc0fc0b4860 2023-07-14T11:18:53.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.730+0000 7fc0fad9d700 1 -- 172.21.15.84:0/1708160966 >> v1:172.21.15.179:6789/0 conn(0x7fc0fc0b8660 legacy=0x7fc0fc0cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:53.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.730+0000 7fc0fad9d700 1 -- 172.21.15.84:0/1708160966 >> v1:172.21.15.84:6789/0 conn(0x7fc0fc0b4860 legacy=0x7fc0fc0d12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:53.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.730+0000 7fc0fad9d700 1 -- 172.21.15.84:0/1708160966 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0fc0d0ac0 con 0x7fc0fc0b4d00 2023-07-14T11:18:53.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.730+0000 7fc0fad9d700 1 --2- 172.21.15.84:0/1708160966 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0fc0b4d00 0x7fc0fc0d19d0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fc0f4009840 tx=0x7fc0f4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8f5ad888ed4c40d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:53.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.731+0000 7fc0f9d9b700 1 -- 172.21.15.84:0/1708160966 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f4011830 con 0x7fc0fc0b4d00 2023-07-14T11:18:53.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.731+0000 7fc0f9d9b700 1 -- 172.21.15.84:0/1708160966 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0f4011990 con 0x7fc0fc0b4d00 2023-07-14T11:18:53.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.731+0000 7fc0f9d9b700 1 -- 172.21.15.84:0/1708160966 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f4011d20 con 0x7fc0fc0b4d00 2023-07-14T11:18:53.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.731+0000 7fc100bff700 1 -- 172.21.15.84:0/1708160966 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0fc0b4d00 msgr2=0x7fc0fc0d19d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:53.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.731+0000 7fc100bff700 1 --2- 172.21.15.84:0/1708160966 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0fc0b4d00 0x7fc0fc0d19d0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fc0f4009840 tx=0x7fc0f4009b50 comp rx=0 tx=0).stop 2023-07-14T11:18:53.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.731+0000 7fc100bff700 1 -- 172.21.15.84:0/1708160966 shutdown_connections 2023-07-14T11:18:53.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.731+0000 7fc100bff700 1 --2- 172.21.15.84:0/1708160966 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0fc0b4d00 0x7fc0fc0d19d0 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:53.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.731+0000 7fc100bff700 1 -- 172.21.15.84:0/1708160966 >> 172.21.15.84:0/1708160966 conn(0x7fc0fc066860 msgr2=0x7fc0fc06a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:53.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.731+0000 7fc100bff700 1 -- 172.21.15.84:0/1708160966 shutdown_connections 2023-07-14T11:18:53.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.731+0000 7fc100bff700 1 -- 172.21.15.84:0/1708160966 wait complete. 2023-07-14T11:18:53.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.733+0000 7fc100bff700 1 Processor -- start 2023-07-14T11:18:53.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.733+0000 7fc100bff700 1 -- start start 2023-07-14T11:18:53.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.734+0000 7fc100bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0fc0b4860 0x7fc0fc1f16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:53.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.734+0000 7fc100bff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0fc0b4d00 0x7fc0fc15ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:53.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.734+0000 7fc100bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0fc0b8660 0x7fc0fc15f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:53.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.734+0000 7fc100bff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0fc157ca0 con 0x7fc0fc0b4d00 2023-07-14T11:18:53.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.734+0000 7fc100bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0fc0caea0 con 0x7fc0fc0b4860 2023-07-14T11:18:53.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.734+0000 7fc100bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0fc157300 con 0x7fc0fc0b8660 2023-07-14T11:18:53.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.734+0000 7fc0f1d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0fc0b4d00 0x7fc0fc15ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:53.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.734+0000 7fc0f1d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0fc0b4d00 0x7fc0fc15ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41222/0 (socket says 172.21.15.84:41222) 2023-07-14T11:18:53.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.734+0000 7fc0f1d9b700 1 -- 172.21.15.84:0/1115308471 learned_addr learned my addr 172.21.15.84:0/1115308471 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:53.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.735+0000 7fc0fad9d700 1 --2- 172.21.15.84:0/1115308471 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0fc0b8660 0x7fc0fc15f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:53.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.735+0000 7fc0fa59c700 1 --2- 172.21.15.84:0/1115308471 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0fc0b4860 0x7fc0fc1f16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:53.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.735+0000 7fc0f1d9b700 1 -- 172.21.15.84:0/1115308471 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0fc0b8660 msgr2=0x7fc0fc15f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:53.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.735+0000 7fc0f1d9b700 1 --2- 172.21.15.84:0/1115308471 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0fc0b8660 0x7fc0fc15f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:53.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.735+0000 7fc0f1d9b700 1 -- 172.21.15.84:0/1115308471 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0fc0b4860 msgr2=0x7fc0fc1f16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:53.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.735+0000 7fc0f1d9b700 1 --2- 172.21.15.84:0/1115308471 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0fc0b4860 0x7fc0fc1f16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:53.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.735+0000 7fc0f1d9b700 1 -- 172.21.15.84:0/1115308471 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0f40094a0 con 0x7fc0fc0b4d00 2023-07-14T11:18:53.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.735+0000 7fc0f1d9b700 1 --2- 172.21.15.84:0/1115308471 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0fc0b4d00 0x7fc0fc15ed90 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fc0e400c700 tx=0x7fc0e400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:53.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.735+0000 7fc0f37fe700 1 -- 172.21.15.84:0/1115308471 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e4005d70 con 0x7fc0fc0b4d00 2023-07-14T11:18:53.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.735+0000 7fc0f37fe700 1 -- 172.21.15.84:0/1115308471 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0e40070d0 con 0x7fc0fc0b4d00 2023-07-14T11:18:53.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.735+0000 7fc100bff700 1 -- 172.21.15.84:0/1115308471 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0fc1575e0 con 0x7fc0fc0b4d00 2023-07-14T11:18:53.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.735+0000 7fc0f37fe700 1 -- 172.21.15.84:0/1115308471 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e4007460 con 0x7fc0fc0b4d00 2023-07-14T11:18:53.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.736+0000 7fc100bff700 1 -- 172.21.15.84:0/1115308471 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0fc1f1c10 con 0x7fc0fc0b4d00 2023-07-14T11:18:53.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.737+0000 7fc100bff700 1 -- 172.21.15.84:0/1115308471 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0fc074350 con 0x7fc0fc0b4d00 2023-07-14T11:18:53.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.737+0000 7fc0f37fe700 1 -- 172.21.15.84:0/1115308471 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7fc0e40075c0 con 0x7fc0fc0b4d00 2023-07-14T11:18:53.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.738+0000 7fc0f37fe700 1 --2- 172.21.15.84:0/1115308471 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fc0dc06ae00 0x7fc0dc06d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:53.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.738+0000 7fc0f37fe700 1 -- 172.21.15.84:0/1115308471 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc0e4088a50 con 0x7fc0fc0b4d00 2023-07-14T11:18:53.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.739+0000 7fc0fa59c700 1 --2- 172.21.15.84:0/1115308471 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fc0dc06ae00 0x7fc0dc06d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:53.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.739+0000 7fc0fa59c700 1 --2- 172.21.15.84:0/1115308471 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fc0dc06ae00 0x7fc0dc06d2b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc0ec0012e0 tx=0x7fc0ec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:53.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.743+0000 7fc0f37fe700 1 -- 172.21.15.84:0/1115308471 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fc0e40539e0 con 0x7fc0fc0b4d00 2023-07-14T11:18:53.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.939+0000 7fc100bff700 1 -- 172.21.15.84:0/1115308471 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fc0fc0cdb10 con 0x7fc0fc0b4d00 2023-07-14T11:18:53.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.939+0000 7fc0f37fe700 1 -- 172.21.15.84:0/1115308471 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc0e40170c0 con 0x7fc0fc0b4d00 2023-07-14T11:18:53.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.942+0000 7fc100bff700 1 -- 172.21.15.84:0/1115308471 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fc0dc06ae00 msgr2=0x7fc0dc06d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:53.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.942+0000 7fc100bff700 1 --2- 172.21.15.84:0/1115308471 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fc0dc06ae00 0x7fc0dc06d2b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc0ec0012e0 tx=0x7fc0ec009040 comp rx=0 tx=0).stop 2023-07-14T11:18:53.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.942+0000 7fc100bff700 1 -- 172.21.15.84:0/1115308471 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0fc0b4d00 msgr2=0x7fc0fc15ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:53.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.942+0000 7fc100bff700 1 --2- 172.21.15.84:0/1115308471 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0fc0b4d00 0x7fc0fc15ed90 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fc0e400c700 tx=0x7fc0e400ca10 comp rx=0 tx=0).stop 2023-07-14T11:18:53.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.942+0000 7fc100bff700 1 -- 172.21.15.84:0/1115308471 shutdown_connections 2023-07-14T11:18:53.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.942+0000 7fc100bff700 1 --2- 172.21.15.84:0/1115308471 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fc0dc06ae00 0x7fc0dc06d2b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:53.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.942+0000 7fc100bff700 1 --2- 172.21.15.84:0/1115308471 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0fc0b8660 0x7fc0fc15f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:53.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.942+0000 7fc100bff700 1 --2- 172.21.15.84:0/1115308471 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0fc0b4860 0x7fc0fc1f16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:53.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.942+0000 7fc100bff700 1 --2- 172.21.15.84:0/1115308471 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0fc0b4d00 0x7fc0fc15ed90 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:53.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.942+0000 7fc100bff700 1 -- 172.21.15.84:0/1115308471 >> 172.21.15.84:0/1115308471 conn(0x7fc0fc066860 msgr2=0x7fc0fc0b6aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:53.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.942+0000 7fc100bff700 1 -- 172.21.15.84:0/1115308471 shutdown_connections 2023-07-14T11:18:53.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:53.942+0000 7fc100bff700 1 -- 172.21.15.84:0/1115308471 wait complete. 2023-07-14T11:18:53.963 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume create 'abcd@#' 2023-07-14T11:18:54.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.158+0000 7f32349ff700 1 Processor -- start 2023-07-14T11:18:54.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.158+0000 7f32349ff700 1 -- start start 2023-07-14T11:18:54.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.159+0000 7f32349ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f32300b4860 0x7f32300b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:54.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.159+0000 7f32349ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f32300d12c0 0x7f32300d16e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:54.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.159+0000 7f32349ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32300d02a0 con 0x7f32300b8660 2023-07-14T11:18:54.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.159+0000 7f32349ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32300b5240 con 0x7f32300b4860 2023-07-14T11:18:54.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.159+0000 7f32349ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32300cfce0 con 0x7f32300d12c0 2023-07-14T11:18:54.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.160+0000 7f322e59c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f32300b8660 0x7f32300cd430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51260/0 (socket says 172.21.15.84:51260) 2023-07-14T11:18:54.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.160+0000 7f322e59c700 1 -- 172.21.15.84:0/350736940 learned_addr learned my addr 172.21.15.84:0/350736940 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:18:54.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.160+0000 7f322dd9b700 1 --2- 172.21.15.84:0/350736940 >> v2:172.21.15.84:3300/0 conn(0x7f32300b4860 0x7f32300b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:54.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.160+0000 7f322ed9d700 1 --2- 172.21.15.84:0/350736940 >> v2:172.21.15.179:3300/0 conn(0x7f32300d12c0 0x7f32300d16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:54.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.160+0000 7f322dd9b700 1 -- 172.21.15.84:0/350736940 >> v2:172.21.15.179:3300/0 conn(0x7f32300d12c0 msgr2=0x7f32300d16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:54.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.160+0000 7f322dd9b700 1 --2- 172.21.15.84:0/350736940 >> v2:172.21.15.179:3300/0 conn(0x7f32300d12c0 0x7f32300d16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:54.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.160+0000 7f322d59a700 1 -- 172.21.15.84:0/350736940 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4174579664 0 0) 0x7f32300d02a0 con 0x7f32300b8660 2023-07-14T11:18:54.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.160+0000 7f322dd9b700 1 -- 172.21.15.84:0/350736940 >> v1:172.21.15.84:6789/0 conn(0x7f32300b8660 legacy=0x7f32300cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:54.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.160+0000 7f322dd9b700 1 -- 172.21.15.84:0/350736940 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32300cffc0 con 0x7f32300b4860 2023-07-14T11:18:54.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.160+0000 7f322dd9b700 1 --2- 172.21.15.84:0/350736940 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32300b4860 0x7f32300b4d00 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f32300d0630 tx=0x7f3224009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=197ede1dca55ea7a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:54.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.160+0000 7f322d59a700 1 -- 172.21.15.84:0/350736940 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3224011830 con 0x7f32300b4860 2023-07-14T11:18:54.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.161+0000 7f322d59a700 1 -- 172.21.15.84:0/350736940 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3224011990 con 0x7f32300b4860 2023-07-14T11:18:54.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.161+0000 7f322d59a700 1 -- 172.21.15.84:0/350736940 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3224011d20 con 0x7f32300b4860 2023-07-14T11:18:54.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.161+0000 7f32349ff700 1 -- 172.21.15.84:0/350736940 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32300b4860 msgr2=0x7f32300b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:54.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.161+0000 7f32349ff700 1 --2- 172.21.15.84:0/350736940 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32300b4860 0x7f32300b4d00 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f32300d0630 tx=0x7f3224009b20 comp rx=0 tx=0).stop 2023-07-14T11:18:54.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.161+0000 7f32349ff700 1 -- 172.21.15.84:0/350736940 shutdown_connections 2023-07-14T11:18:54.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.161+0000 7f32349ff700 1 --2- 172.21.15.84:0/350736940 >> v2:172.21.15.179:3300/0 conn(0x7f32300d12c0 0x7f32300d16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:54.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.161+0000 7f32349ff700 1 --2- 172.21.15.84:0/350736940 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32300b4860 0x7f32300b4d00 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:54.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.161+0000 7f32349ff700 1 -- 172.21.15.84:0/350736940 >> 172.21.15.84:0/350736940 conn(0x7f3230066860 msgr2=0x7f323006a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:54.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.161+0000 7f32349ff700 1 -- 172.21.15.84:0/350736940 shutdown_connections 2023-07-14T11:18:54.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.161+0000 7f32349ff700 1 -- 172.21.15.84:0/350736940 wait complete. 2023-07-14T11:18:54.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.163+0000 7f32349ff700 1 Processor -- start 2023-07-14T11:18:54.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.163+0000 7f32349ff700 1 -- start start 2023-07-14T11:18:54.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.164+0000 7f32349ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32300b4860 0x7f3230158670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:54.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.164+0000 7f32349ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32300b8660 0x7f3230156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:54.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.164+0000 7f32349ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32300d12c0 0x7f32300b2c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:54.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.164+0000 7f32349ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32301575d0 con 0x7f32300d12c0 2023-07-14T11:18:54.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.164+0000 7f32349ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32301578b0 con 0x7f32300b8660 2023-07-14T11:18:54.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.164+0000 7f32349ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3230157b90 con 0x7f32300b4860 2023-07-14T11:18:54.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.164+0000 7f322ed9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32300d12c0 0x7f32300b2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:54.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.164+0000 7f322ed9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32300d12c0 0x7f32300b2c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41248/0 (socket says 172.21.15.84:41248) 2023-07-14T11:18:54.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.164+0000 7f322ed9d700 1 -- 172.21.15.84:0/2095784119 learned_addr learned my addr 172.21.15.84:0/2095784119 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:54.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.164+0000 7f322e59c700 1 --2- 172.21.15.84:0/2095784119 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32300b4860 0x7f3230158670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:54.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.164+0000 7f322dd9b700 1 --2- 172.21.15.84:0/2095784119 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32300b8660 0x7f3230156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:54.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.165+0000 7f322ed9d700 1 -- 172.21.15.84:0/2095784119 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32300b4860 msgr2=0x7f3230158670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:54.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.165+0000 7f322ed9d700 1 --2- 172.21.15.84:0/2095784119 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32300b4860 0x7f3230158670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:54.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.165+0000 7f322ed9d700 1 -- 172.21.15.84:0/2095784119 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32300b8660 msgr2=0x7f3230156bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:54.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.165+0000 7f322ed9d700 1 --2- 172.21.15.84:0/2095784119 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32300b8660 0x7f3230156bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:54.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.165+0000 7f322ed9d700 1 -- 172.21.15.84:0/2095784119 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32240094a0 con 0x7f32300d12c0 2023-07-14T11:18:54.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.165+0000 7f322ed9d700 1 --2- 172.21.15.84:0/2095784119 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32300d12c0 0x7f32300b2c60 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f3228007e60 tx=0x7f322800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:54.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.165+0000 7f321effd700 1 -- 172.21.15.84:0/2095784119 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322800ede0 con 0x7f32300d12c0 2023-07-14T11:18:54.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.165+0000 7f321effd700 1 -- 172.21.15.84:0/2095784119 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3228014420 con 0x7f32300d12c0 2023-07-14T11:18:54.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.165+0000 7f321effd700 1 -- 172.21.15.84:0/2095784119 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32280147d0 con 0x7f32300d12c0 2023-07-14T11:18:54.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.165+0000 7f32349ff700 1 -- 172.21.15.84:0/2095784119 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3230157e70 con 0x7f32300d12c0 2023-07-14T11:18:54.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.165+0000 7f32349ff700 1 -- 172.21.15.84:0/2095784119 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32300c88e0 con 0x7f32300d12c0 2023-07-14T11:18:54.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.166+0000 7f32349ff700 1 -- 172.21.15.84:0/2095784119 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32300c8ad0 con 0x7f32300d12c0 2023-07-14T11:18:54.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.167+0000 7f321effd700 1 -- 172.21.15.84:0/2095784119 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f3228014930 con 0x7f32300d12c0 2023-07-14T11:18:54.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.168+0000 7f321effd700 1 --2- 172.21.15.84:0/2095784119 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f321006ae00 0x7f321006d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:54.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.168+0000 7f321effd700 1 -- 172.21.15.84:0/2095784119 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3228089df0 con 0x7f32300d12c0 2023-07-14T11:18:54.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.169+0000 7f322e59c700 1 --2- 172.21.15.84:0/2095784119 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f321006ae00 0x7f321006d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:54.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.169+0000 7f322e59c700 1 --2- 172.21.15.84:0/2095784119 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f321006ae00 0x7f321006d2b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3220000f60 tx=0x7f3220007be0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:54.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.172+0000 7f321effd700 1 -- 172.21.15.84:0/2095784119 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3228054e30 con 0x7f32300d12c0 2023-07-14T11:18:54.393 INFO:teuthology.orchestra.run.smithi084.stderr:Invalid command: invalid chars @# in abcd@# 2023-07-14T11:18:54.394 INFO:teuthology.orchestra.run.smithi084.stderr:fs volume create [] : Create a CephFS volume 2023-07-14T11:18:54.394 INFO:teuthology.orchestra.run.smithi084.stderr:Error EINVAL: invalid command 2023-07-14T11:18:54.402 DEBUG:teuthology.orchestra.run:got remote process result: 22 2023-07-14T11:18:54.403 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume create testvol 2023-07-14T11:18:54.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.596+0000 7f4f981ff700 1 Processor -- start 2023-07-14T11:18:54.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.596+0000 7f4f981ff700 1 -- start start 2023-07-14T11:18:54.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.597+0000 7f4f981ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4f900c92d0 0x7f4f900ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:54.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.597+0000 7f4f981ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f900b12f0 0x7f4f900c96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:54.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.597+0000 7f4f981ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f9015ce70 con 0x7f4f900adea0 2023-07-14T11:18:54.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.597+0000 7f4f981ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f9015da60 con 0x7f4f900c92d0 2023-07-14T11:18:54.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.597+0000 7f4f981ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f900c9be0 con 0x7f4f900b12f0 2023-07-14T11:18:54.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.598+0000 7f4f9679c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f4f900adea0 0x7f4f9006c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51268/0 (socket says 172.21.15.84:51268) 2023-07-14T11:18:54.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.598+0000 7f4f95f9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4f900c92d0 0x7f4f900ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:54.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.598+0000 7f4f9679c700 1 -- 172.21.15.84:0/3875515777 learned_addr learned my addr 172.21.15.84:0/3875515777 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:18:54.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.598+0000 7f4f9579a700 1 --2- 172.21.15.84:0/3875515777 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f900b12f0 0x7f4f900c96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:54.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.598+0000 7f4f95f9b700 1 -- 172.21.15.84:0/3875515777 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f900b12f0 msgr2=0x7f4f900c96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:54.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.598+0000 7f4f95f9b700 1 --2- 172.21.15.84:0/3875515777 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f900b12f0 0x7f4f900c96a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:54.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.598+0000 7f4f95f9b700 1 -- 172.21.15.84:0/3875515777 >> v1:172.21.15.84:6789/0 conn(0x7f4f900adea0 legacy=0x7f4f9006c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:54.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.598+0000 7f4f95f9b700 1 -- 172.21.15.84:0/3875515777 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f9015d0c0 con 0x7f4f900c92d0 2023-07-14T11:18:54.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.598+0000 7f4f9579a700 1 --2- 172.21.15.84:0/3875515777 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f900b12f0 0x7f4f900c96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:18:54.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.598+0000 7f4f95f9b700 1 --2- 172.21.15.84:0/3875515777 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f900c92d0 0x7f4f900ad8f0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c009840 tx=0x7f4f8c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4814781f4f98ba2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:54.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.598+0000 7f4f94f99700 1 -- 172.21.15.84:0/3875515777 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c011830 con 0x7f4f900c92d0 2023-07-14T11:18:54.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.598+0000 7f4f94f99700 1 -- 172.21.15.84:0/3875515777 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f8c011990 con 0x7f4f900c92d0 2023-07-14T11:18:54.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.599+0000 7f4f94f99700 1 -- 172.21.15.84:0/3875515777 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c011d20 con 0x7f4f900c92d0 2023-07-14T11:18:54.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.599+0000 7f4f981ff700 1 -- 172.21.15.84:0/3875515777 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f900c92d0 msgr2=0x7f4f900ad8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:54.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.599+0000 7f4f981ff700 1 --2- 172.21.15.84:0/3875515777 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f900c92d0 0x7f4f900ad8f0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c009840 tx=0x7f4f8c009b50 comp rx=0 tx=0).stop 2023-07-14T11:18:54.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.599+0000 7f4f981ff700 1 -- 172.21.15.84:0/3875515777 shutdown_connections 2023-07-14T11:18:54.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.599+0000 7f4f981ff700 1 --2- 172.21.15.84:0/3875515777 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f900c92d0 0x7f4f900ad8f0 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:54.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.599+0000 7f4f981ff700 1 --2- 172.21.15.84:0/3875515777 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f900b12f0 0x7f4f900c96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:54.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.599+0000 7f4f981ff700 1 -- 172.21.15.84:0/3875515777 >> 172.21.15.84:0/3875515777 conn(0x7f4f900b05d0 msgr2=0x7f4f900b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:54.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.599+0000 7f4f981ff700 1 -- 172.21.15.84:0/3875515777 shutdown_connections 2023-07-14T11:18:54.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.599+0000 7f4f981ff700 1 -- 172.21.15.84:0/3875515777 wait complete. 2023-07-14T11:18:54.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.601+0000 7f4f981ff700 1 Processor -- start 2023-07-14T11:18:54.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.601+0000 7f4f981ff700 1 -- start start 2023-07-14T11:18:54.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.602+0000 7f4f981ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f900adea0 0x7f4f900b18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:54.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.602+0000 7f4f981ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f900b12f0 0x7f4f900b4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:54.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.602+0000 7f4f981ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f900c92d0 0x7f4f90143260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:54.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.602+0000 7f4f981ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f901437a0 con 0x7f4f900c92d0 2023-07-14T11:18:54.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.602+0000 7f4f981ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f900b35f0 con 0x7f4f900b12f0 2023-07-14T11:18:54.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.602+0000 7f4f981ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f900b3890 con 0x7f4f900adea0 2023-07-14T11:18:54.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.602+0000 7f4f9679c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f900c92d0 0x7f4f90143260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:54.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.602+0000 7f4f9679c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f900c92d0 0x7f4f90143260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41272/0 (socket says 172.21.15.84:41272) 2023-07-14T11:18:54.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.602+0000 7f4f9679c700 1 -- 172.21.15.84:0/38525235 learned_addr learned my addr 172.21.15.84:0/38525235 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:54.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.602+0000 7f4f9579a700 1 --2- 172.21.15.84:0/38525235 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f900b12f0 0x7f4f900b4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:54.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.602+0000 7f4f95f9b700 1 --2- 172.21.15.84:0/38525235 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f900adea0 0x7f4f900b18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:54.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.603+0000 7f4f9679c700 1 -- 172.21.15.84:0/38525235 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f900adea0 msgr2=0x7f4f900b18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:54.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.603+0000 7f4f9679c700 1 --2- 172.21.15.84:0/38525235 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f900adea0 0x7f4f900b18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:54.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.603+0000 7f4f9679c700 1 -- 172.21.15.84:0/38525235 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f900b12f0 msgr2=0x7f4f900b4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:54.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.603+0000 7f4f9679c700 1 --2- 172.21.15.84:0/38525235 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f900b12f0 0x7f4f900b4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:54.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.603+0000 7f4f9679c700 1 -- 172.21.15.84:0/38525235 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f8c0094a0 con 0x7f4f900c92d0 2023-07-14T11:18:54.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.603+0000 7f4f9679c700 1 --2- 172.21.15.84:0/38525235 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f900c92d0 0x7f4f90143260 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f4f8800caf0 tx=0x7f4f8800ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:54.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.603+0000 7f4f867fc700 1 -- 172.21.15.84:0/38525235 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8800a9e0 con 0x7f4f900c92d0 2023-07-14T11:18:54.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.603+0000 7f4f867fc700 1 -- 172.21.15.84:0/38525235 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f8800ab40 con 0x7f4f900c92d0 2023-07-14T11:18:54.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.603+0000 7f4f867fc700 1 -- 172.21.15.84:0/38525235 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f88012400 con 0x7f4f900c92d0 2023-07-14T11:18:54.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.603+0000 7f4f981ff700 1 -- 172.21.15.84:0/38525235 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f900b3b70 con 0x7f4f900c92d0 2023-07-14T11:18:54.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.603+0000 7f4f981ff700 1 -- 172.21.15.84:0/38525235 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f900b1ed0 con 0x7f4f900c92d0 2023-07-14T11:18:54.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.604+0000 7f4f981ff700 1 -- 172.21.15.84:0/38525235 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f90074350 con 0x7f4f900c92d0 2023-07-14T11:18:54.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.605+0000 7f4f867fc700 1 -- 172.21.15.84:0/38525235 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f4f8801b3b0 con 0x7f4f900c92d0 2023-07-14T11:18:54.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.606+0000 7f4f867fc700 1 --2- 172.21.15.84:0/38525235 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f4f7406ae00 0x7f4f7406d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:54.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.606+0000 7f4f867fc700 1 -- 172.21.15.84:0/38525235 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4f88089090 con 0x7f4f900c92d0 2023-07-14T11:18:54.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.607+0000 7f4f95f9b700 1 --2- 172.21.15.84:0/38525235 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f4f7406ae00 0x7f4f7406d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:54.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.607+0000 7f4f95f9b700 1 --2- 172.21.15.84:0/38525235 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f4f7406ae00 0x7f4f7406d2b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c0090b0 tx=0x7f4f8c01c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:54.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.610+0000 7f4f867fc700 1 -- 172.21.15.84:0/38525235 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f4f880540d0 con 0x7f4f900c92d0 2023-07-14T11:18:54.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:54.830+0000 7f4f981ff700 1 -- 172.21.15.84:0/38525235 --> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "testvol", "target": ["mon-mgr", ""]}) v1 -- 0x7f4f9015d3a0 con 0x7f4f7406ae00 2023-07-14T11:18:57.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.089+0000 7f4f867fc700 1 -- 172.21.15.84:0/38525235 <== mgr.4100 v2:172.21.15.179:6836/2094253834 1 ==== mgr_command_reply(tid 0: 0 Volume created successfully (no MDS daemons created)) v1 ==== 60+0+0 (secure 0 0 0) 0x7f4f8c011630 con 0x7f4f7406ae00 2023-07-14T11:18:57.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.092+0000 7f4f981ff700 1 -- 172.21.15.84:0/38525235 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f4f7406ae00 msgr2=0x7f4f7406d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:57.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.092+0000 7f4f981ff700 1 --2- 172.21.15.84:0/38525235 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f4f7406ae00 0x7f4f7406d2b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c0090b0 tx=0x7f4f8c01c040 comp rx=0 tx=0).stop 2023-07-14T11:18:57.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.092+0000 7f4f981ff700 1 -- 172.21.15.84:0/38525235 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f900c92d0 msgr2=0x7f4f90143260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:57.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.092+0000 7f4f981ff700 1 --2- 172.21.15.84:0/38525235 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f900c92d0 0x7f4f90143260 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f4f8800caf0 tx=0x7f4f8800ce00 comp rx=0 tx=0).stop 2023-07-14T11:18:57.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.093+0000 7f4f981ff700 1 -- 172.21.15.84:0/38525235 shutdown_connections 2023-07-14T11:18:57.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.093+0000 7f4f981ff700 1 --2- 172.21.15.84:0/38525235 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f4f7406ae00 0x7f4f7406d2b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:57.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.093+0000 7f4f981ff700 1 --2- 172.21.15.84:0/38525235 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f900adea0 0x7f4f900b18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:57.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.093+0000 7f4f981ff700 1 --2- 172.21.15.84:0/38525235 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f900c92d0 0x7f4f90143260 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:57.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.093+0000 7f4f981ff700 1 --2- 172.21.15.84:0/38525235 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f900b12f0 0x7f4f900b4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:57.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.093+0000 7f4f981ff700 1 -- 172.21.15.84:0/38525235 >> 172.21.15.84:0/38525235 conn(0x7f4f900b05d0 msgr2=0x7f4f900ac860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:57.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.093+0000 7f4f981ff700 1 -- 172.21.15.84:0/38525235 shutdown_connections 2023-07-14T11:18:57.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.093+0000 7f4f981ff700 1 -- 172.21.15.84:0/38525235 wait complete. 2023-07-14T11:18:57.098 INFO:teuthology.orchestra.run.smithi084.stderr:Volume created successfully (no MDS daemons created) 2023-07-14T11:18:57.118 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create testvol 'abcd@#' 2023-07-14T11:18:57.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.315+0000 7febbebff700 1 Processor -- start 2023-07-14T11:18:57.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.315+0000 7febbebff700 1 -- start start 2023-07-14T11:18:57.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.317+0000 7febbebff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7febb80c92d0 0x7febb80ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:57.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.317+0000 7febbebff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7febb80b12f0 0x7febb80c96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:57.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.317+0000 7febbebff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febb815ce70 con 0x7febb80adea0 2023-07-14T11:18:57.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.317+0000 7febbebff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febb815da60 con 0x7febb80b12f0 2023-07-14T11:18:57.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.317+0000 7febbebff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febb80c9be0 con 0x7febb80c92d0 2023-07-14T11:18:57.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.317+0000 7febb7fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7febb80b12f0 0x7febb80c96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:57.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.317+0000 7febb7fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7febb80b12f0 0x7febb80c96a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41276/0 (socket says 172.21.15.84:41276) 2023-07-14T11:18:57.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.317+0000 7febb7fff700 1 -- 172.21.15.84:0/2346246929 learned_addr learned my addr 172.21.15.84:0/2346246929 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:57.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.317+0000 7febbc99b700 1 --2- 172.21.15.84:0/2346246929 >> v2:172.21.15.179:3300/0 conn(0x7febb80c92d0 0x7febb80ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:57.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.317+0000 7febb7fff700 1 -- 172.21.15.84:0/2346246929 >> v2:172.21.15.179:3300/0 conn(0x7febb80c92d0 msgr2=0x7febb80ad8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:57.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.317+0000 7febb7fff700 1 --2- 172.21.15.84:0/2346246929 >> v2:172.21.15.179:3300/0 conn(0x7febb80c92d0 0x7febb80ad8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:57.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.317+0000 7febb7fff700 1 -- 172.21.15.84:0/2346246929 >> v1:172.21.15.179:6789/0 conn(0x7febb80adea0 legacy=0x7febb806c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:57.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.317+0000 7febb7fff700 1 -- 172.21.15.84:0/2346246929 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febb815d0c0 con 0x7febb80b12f0 2023-07-14T11:18:57.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.318+0000 7febb7fff700 1 --2- 172.21.15.84:0/2346246929 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febb80b12f0 0x7febb80c96a0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7febb806f630 tx=0x7feba400be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52e1cf2e024bc8e9 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:57.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.318+0000 7febb77fe700 1 -- 172.21.15.84:0/2346246929 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba400dcf0 con 0x7febb80b12f0 2023-07-14T11:18:57.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.318+0000 7febb77fe700 1 -- 172.21.15.84:0/2346246929 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feba400de50 con 0x7febb80b12f0 2023-07-14T11:18:57.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.318+0000 7febb77fe700 1 -- 172.21.15.84:0/2346246929 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba4004250 con 0x7febb80b12f0 2023-07-14T11:18:57.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.318+0000 7febbebff700 1 -- 172.21.15.84:0/2346246929 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febb80b12f0 msgr2=0x7febb80c96a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:57.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.318+0000 7febbebff700 1 --2- 172.21.15.84:0/2346246929 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febb80b12f0 0x7febb80c96a0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7febb806f630 tx=0x7feba400be70 comp rx=0 tx=0).stop 2023-07-14T11:18:57.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.319+0000 7febbebff700 1 -- 172.21.15.84:0/2346246929 shutdown_connections 2023-07-14T11:18:57.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.319+0000 7febbebff700 1 --2- 172.21.15.84:0/2346246929 >> v2:172.21.15.179:3300/0 conn(0x7febb80c92d0 0x7febb80ad8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:57.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.319+0000 7febbebff700 1 --2- 172.21.15.84:0/2346246929 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febb80b12f0 0x7febb80c96a0 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:57.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.319+0000 7febbebff700 1 -- 172.21.15.84:0/2346246929 >> 172.21.15.84:0/2346246929 conn(0x7febb80b05d0 msgr2=0x7febb80b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:57.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.319+0000 7febbebff700 1 -- 172.21.15.84:0/2346246929 shutdown_connections 2023-07-14T11:18:57.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.319+0000 7febbebff700 1 -- 172.21.15.84:0/2346246929 wait complete. 2023-07-14T11:18:57.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.320+0000 7febbebff700 1 Processor -- start 2023-07-14T11:18:57.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.320+0000 7febbebff700 1 -- start start 2023-07-14T11:18:57.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.321+0000 7febbebff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febb80adea0 0x7febb81574a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:57.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.321+0000 7febbebff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7febb80b12f0 0x7febb80cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:57.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.321+0000 7febbebff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febb80c92d0 0x7febb80cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:57.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.321+0000 7febbebff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febb81579e0 con 0x7febb80c92d0 2023-07-14T11:18:57.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.321+0000 7febbebff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febb80b2fb0 con 0x7febb80b12f0 2023-07-14T11:18:57.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.321+0000 7febbebff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febb80b4160 con 0x7febb80adea0 2023-07-14T11:18:57.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.322+0000 7febbd19c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febb80c92d0 0x7febb80cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:57.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.322+0000 7febbc99b700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febb80adea0 0x7febb81574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:57.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.322+0000 7febbd19c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febb80c92d0 0x7febb80cbae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41290/0 (socket says 172.21.15.84:41290) 2023-07-14T11:18:57.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.322+0000 7febbd19c700 1 -- 172.21.15.84:0/483058422 learned_addr learned my addr 172.21.15.84:0/483058422 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:57.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.322+0000 7febb7fff700 1 --2- 172.21.15.84:0/483058422 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7febb80b12f0 0x7febb80cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:57.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.322+0000 7febbd19c700 1 -- 172.21.15.84:0/483058422 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febb80adea0 msgr2=0x7febb81574a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:57.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.322+0000 7febbd19c700 1 --2- 172.21.15.84:0/483058422 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febb80adea0 0x7febb81574a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:57.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.322+0000 7febbd19c700 1 -- 172.21.15.84:0/483058422 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7febb80b12f0 msgr2=0x7febb80cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:57.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.322+0000 7febbd19c700 1 --2- 172.21.15.84:0/483058422 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7febb80b12f0 0x7febb80cb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:57.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.322+0000 7febbd19c700 1 -- 172.21.15.84:0/483058422 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba400b7f0 con 0x7febb80c92d0 2023-07-14T11:18:57.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.322+0000 7febbd19c700 1 --2- 172.21.15.84:0/483058422 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febb80c92d0 0x7febb80cbae0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7febb000cc10 tx=0x7febb000cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:57.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.323+0000 7febb57fa700 1 -- 172.21.15.84:0/483058422 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb000aa60 con 0x7febb80c92d0 2023-07-14T11:18:57.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.323+0000 7febb57fa700 1 -- 172.21.15.84:0/483058422 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febb000abc0 con 0x7febb80c92d0 2023-07-14T11:18:57.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.323+0000 7febbebff700 1 -- 172.21.15.84:0/483058422 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febb80b4440 con 0x7febb80c92d0 2023-07-14T11:18:57.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.323+0000 7febb57fa700 1 -- 172.21.15.84:0/483058422 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb0012420 con 0x7febb80c92d0 2023-07-14T11:18:57.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.323+0000 7febbebff700 1 -- 172.21.15.84:0/483058422 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febb80b2c40 con 0x7febb80c92d0 2023-07-14T11:18:57.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.324+0000 7febbebff700 1 -- 172.21.15.84:0/483058422 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febb80b3fc0 con 0x7febb80c92d0 2023-07-14T11:18:57.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.325+0000 7febb57fa700 1 -- 172.21.15.84:0/483058422 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7febb0012580 con 0x7febb80c92d0 2023-07-14T11:18:57.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.327+0000 7febb57fa700 1 --2- 172.21.15.84:0/483058422 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7feb9c06ae00 0x7feb9c06d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:57.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.327+0000 7febb57fa700 1 -- 172.21.15.84:0/483058422 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6896+0+0 (secure 0 0 0) 0x7febb0089be0 con 0x7febb80c92d0 2023-07-14T11:18:57.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.327+0000 7febbc99b700 1 --2- 172.21.15.84:0/483058422 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7feb9c06ae00 0x7feb9c06d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:57.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.328+0000 7febbc99b700 1 --2- 172.21.15.84:0/483058422 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7feb9c06ae00 0x7feb9c06d2b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7febb80b2a20 tx=0x7febac008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:57.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.331+0000 7febb57fa700 1 -- 172.21.15.84:0/483058422 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7febb80b3fc0 con 0x7febb80c92d0 2023-07-14T11:18:57.554 INFO:teuthology.orchestra.run.smithi084.stderr:Invalid command: invalid chars #@ in abcd@# 2023-07-14T11:18:57.555 INFO:teuthology.orchestra.run.smithi084.stderr:fs subvolumegroup create [] [] [] [] [] : Create a CephFS subvolume group in a volume, and optionally, with a specific data pool layout, and a specific numeric mode 2023-07-14T11:18:57.555 INFO:teuthology.orchestra.run.smithi084.stderr:Error EINVAL: invalid command 2023-07-14T11:18:57.562 DEBUG:teuthology.orchestra.run:got remote process result: 22 2023-07-14T11:18:57.563 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create testvol 'abcd@#' 2023-07-14T11:18:57.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.758+0000 7f604ddff700 1 Processor -- start 2023-07-14T11:18:57.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.758+0000 7f604ddff700 1 -- start start 2023-07-14T11:18:57.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.759+0000 7f604ddff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f60480c92d0 0x7f60480ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:57.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.759+0000 7f604ddff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f60480b12f0 0x7f60480c96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:57.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.759+0000 7f604ddff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60480adea0 0x7f604806c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:57.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.760+0000 7f604ddff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f604815da60 con 0x7f60480b12f0 2023-07-14T11:18:57.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.760+0000 7f604ddff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f604815ce70 con 0x7f60480c92d0 2023-07-14T11:18:57.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.760+0000 7f604ddff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60480c9be0 con 0x7f60480adea0 2023-07-14T11:18:57.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.760+0000 7f603ffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f60480b12f0 0x7f60480c96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:57.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.760+0000 7f603ffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f60480b12f0 0x7f60480c96a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41304/0 (socket says 172.21.15.84:41304) 2023-07-14T11:18:57.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.760+0000 7f603ffff700 1 -- 172.21.15.84:0/2312871443 learned_addr learned my addr 172.21.15.84:0/2312871443 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:57.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.760+0000 7f6047fff700 1 --2- 172.21.15.84:0/2312871443 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60480adea0 0x7f604806c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:57.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.760+0000 7f60477fe700 1 --2- 172.21.15.84:0/2312871443 >> v2:172.21.15.179:3300/0 conn(0x7f60480c92d0 0x7f60480ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:57.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.760+0000 7f603ffff700 1 -- 172.21.15.84:0/2312871443 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60480adea0 msgr2=0x7f604806c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:57.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.760+0000 7f603ffff700 1 --2- 172.21.15.84:0/2312871443 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60480adea0 0x7f604806c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:57.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.760+0000 7f603ffff700 1 -- 172.21.15.84:0/2312871443 >> v2:172.21.15.179:3300/0 conn(0x7f60480c92d0 msgr2=0x7f60480ad8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:18:57.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.760+0000 7f603ffff700 1 --2- 172.21.15.84:0/2312871443 >> v2:172.21.15.179:3300/0 conn(0x7f60480c92d0 0x7f60480ad8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:57.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.760+0000 7f603ffff700 1 -- 172.21.15.84:0/2312871443 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f604815d0c0 con 0x7f60480b12f0 2023-07-14T11:18:57.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.761+0000 7f603ffff700 1 --2- 172.21.15.84:0/2312871443 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60480b12f0 0x7f60480c96a0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f604806f630 tx=0x7f6030009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e324fa779502abb server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:57.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.761+0000 7f6046ffd700 1 -- 172.21.15.84:0/2312871443 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6030011830 con 0x7f60480b12f0 2023-07-14T11:18:57.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.761+0000 7f6046ffd700 1 -- 172.21.15.84:0/2312871443 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6030011990 con 0x7f60480b12f0 2023-07-14T11:18:57.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.761+0000 7f6046ffd700 1 -- 172.21.15.84:0/2312871443 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6030011d20 con 0x7f60480b12f0 2023-07-14T11:18:57.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.761+0000 7f604ddff700 1 -- 172.21.15.84:0/2312871443 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60480b12f0 msgr2=0x7f60480c96a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:57.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.761+0000 7f604ddff700 1 --2- 172.21.15.84:0/2312871443 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60480b12f0 0x7f60480c96a0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f604806f630 tx=0x7f6030009bd0 comp rx=0 tx=0).stop 2023-07-14T11:18:57.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.761+0000 7f604ddff700 1 -- 172.21.15.84:0/2312871443 shutdown_connections 2023-07-14T11:18:57.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.761+0000 7f604ddff700 1 --2- 172.21.15.84:0/2312871443 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60480adea0 0x7f604806c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:57.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.761+0000 7f604ddff700 1 --2- 172.21.15.84:0/2312871443 >> v2:172.21.15.179:3300/0 conn(0x7f60480c92d0 0x7f60480ad8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:57.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.761+0000 7f604ddff700 1 --2- 172.21.15.84:0/2312871443 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60480b12f0 0x7f60480c96a0 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:57.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.761+0000 7f604ddff700 1 -- 172.21.15.84:0/2312871443 >> 172.21.15.84:0/2312871443 conn(0x7f60480b05d0 msgr2=0x7f60480b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:57.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.762+0000 7f604ddff700 1 -- 172.21.15.84:0/2312871443 shutdown_connections 2023-07-14T11:18:57.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.762+0000 7f604ddff700 1 -- 172.21.15.84:0/2312871443 wait complete. 2023-07-14T11:18:57.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.763+0000 7f604ddff700 1 Processor -- start 2023-07-14T11:18:57.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.763+0000 7f604ddff700 1 -- start start 2023-07-14T11:18:57.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.764+0000 7f604ddff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60480adea0 0x7f60480c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:57.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.764+0000 7f604ddff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60480b12f0 0x7f60480aed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:57.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.764+0000 7f604ddff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60480c92d0 0x7f60481f1f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:57.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.764+0000 7f604ddff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60480c7000 con 0x7f60480b12f0 2023-07-14T11:18:57.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.764+0000 7f604ddff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60480c72e0 con 0x7f60480adea0 2023-07-14T11:18:57.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.764+0000 7f604ddff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60480c75c0 con 0x7f60480c92d0 2023-07-14T11:18:57.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.765+0000 7f603ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60480b12f0 0x7f60480aed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:57.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.765+0000 7f603ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60480b12f0 0x7f60480aed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41316/0 (socket says 172.21.15.84:41316) 2023-07-14T11:18:57.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.765+0000 7f603ffff700 1 -- 172.21.15.84:0/799928618 learned_addr learned my addr 172.21.15.84:0/799928618 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:57.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.765+0000 7f6047fff700 1 --2- 172.21.15.84:0/799928618 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60480c92d0 0x7f60481f1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:57.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.765+0000 7f60477fe700 1 --2- 172.21.15.84:0/799928618 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60480adea0 0x7f60480c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:57.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.765+0000 7f603ffff700 1 -- 172.21.15.84:0/799928618 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60480c92d0 msgr2=0x7f60481f1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:57.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.765+0000 7f603ffff700 1 --2- 172.21.15.84:0/799928618 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f60480c92d0 0x7f60481f1f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:57.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.765+0000 7f603ffff700 1 -- 172.21.15.84:0/799928618 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60480adea0 msgr2=0x7f60480c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:57.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.765+0000 7f603ffff700 1 --2- 172.21.15.84:0/799928618 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60480adea0 0x7f60480c65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:57.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.765+0000 7f603ffff700 1 -- 172.21.15.84:0/799928618 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6030009550 con 0x7f60480b12f0 2023-07-14T11:18:57.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.765+0000 7f603ffff700 1 --2- 172.21.15.84:0/799928618 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60480b12f0 0x7f60480aed30 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f6030000c00 tx=0x7f6030004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:57.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.765+0000 7f6044ff9700 1 -- 172.21.15.84:0/799928618 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6030004240 con 0x7f60480b12f0 2023-07-14T11:18:57.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.766+0000 7f6044ff9700 1 -- 172.21.15.84:0/799928618 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f603001f070 con 0x7f60480b12f0 2023-07-14T11:18:57.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.766+0000 7f604ddff700 1 -- 172.21.15.84:0/799928618 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60480c78a0 con 0x7f60480b12f0 2023-07-14T11:18:57.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.766+0000 7f6044ff9700 1 -- 172.21.15.84:0/799928618 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60300036a0 con 0x7f60480b12f0 2023-07-14T11:18:57.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.766+0000 7f604ddff700 1 -- 172.21.15.84:0/799928618 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60480c6ae0 con 0x7f60480b12f0 2023-07-14T11:18:57.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.767+0000 7f604ddff700 1 -- 172.21.15.84:0/799928618 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60480c7dc0 con 0x7f60480b12f0 2023-07-14T11:18:57.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.768+0000 7f6044ff9700 1 -- 172.21.15.84:0/799928618 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f6030021030 con 0x7f60480b12f0 2023-07-14T11:18:57.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.768+0000 7f6044ff9700 1 --2- 172.21.15.84:0/799928618 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f602806ae00 0x7f602806d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:57.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.769+0000 7f6044ff9700 1 -- 172.21.15.84:0/799928618 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6896+0+0 (secure 0 0 0) 0x7f603008aab0 con 0x7f60480b12f0 2023-07-14T11:18:57.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.769+0000 7f60477fe700 1 --2- 172.21.15.84:0/799928618 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f602806ae00 0x7f602806d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:57.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.770+0000 7f60477fe700 1 --2- 172.21.15.84:0/799928618 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f602806ae00 0x7f602806d2b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6038009b40 tx=0x7f6038009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:57.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:57.773+0000 7f6044ff9700 1 -- 172.21.15.84:0/799928618 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f60480c7dc0 con 0x7f60480b12f0 2023-07-14T11:18:58.014 INFO:teuthology.orchestra.run.smithi084.stderr:Invalid command: invalid chars @# in abcd@# 2023-07-14T11:18:58.014 INFO:teuthology.orchestra.run.smithi084.stderr:fs subvolume create [] [] [] [] [] [] [--namespace-isolated] : Create a CephFS subvolume in a volume, and optionally, with a specific size (in bytes), a specific data pool layout, a specific mode, in a specific subvolume group and in separate RADOS namespace 2023-07-14T11:18:58.014 INFO:teuthology.orchestra.run.smithi084.stderr:Error EINVAL: invalid command 2023-07-14T11:18:58.021 DEBUG:teuthology.orchestra.run:got remote process result: 22 2023-07-14T11:18:58.022 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm testvol --yes-i-really-mean-it 2023-07-14T11:18:58.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:58.220+0000 7f23785ff700 1 Processor -- start 2023-07-14T11:18:58.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:58.220+0000 7f23785ff700 1 -- start start 2023-07-14T11:18:58.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:58.221+0000 7f23785ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f23700d0b10 0x7f23700d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:58.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:58.221+0000 7f23785ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23700b8e30 con 0x7f23700b0e20 2023-07-14T11:18:58.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:58.221+0000 7f23785ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23700afaa0 con 0x7f23700b8a60 2023-07-14T11:18:58.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:58.221+0000 7f23785ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23700d14d0 con 0x7f23700d0b10 2023-07-14T11:18:58.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:58.222+0000 7f2376b9c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f23700b0e20 0x7f23700b1260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51272/0 (socket says 172.21.15.84:51272) 2023-07-14T11:18:58.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:58.222+0000 7f2376b9c700 1 -- 172.21.15.84:0/1050623105 learned_addr learned my addr 172.21.15.84:0/1050623105 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:18:58.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:58.222+0000 7f2375b9a700 1 --2- 172.21.15.84:0/1050623105 >> v2:172.21.15.179:3300/0 conn(0x7f23700d0b10 0x7f23700d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:58.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:58.222+0000 7f2375399700 1 -- 172.21.15.84:0/1050623105 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4147769363 0 0) 0x7f23700b8e30 con 0x7f23700b0e20 2023-07-14T11:18:58.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:58.222+0000 7f2375399700 1 -- 172.21.15.84:0/1050623105 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f235c0035b0 con 0x7f23700b0e20 2023-07-14T11:18:58.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:58.222+0000 7f2375b9a700 1 -- 172.21.15.84:0/1050623105 >> v1:172.21.15.179:6789/0 conn(0x7f23700b8a60 legacy=0x7f23700b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:58.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:58.222+0000 7f2375b9a700 1 -- 172.21.15.84:0/1050623105 >> v1:172.21.15.84:6789/0 conn(0x7f23700b0e20 legacy=0x7f23700b1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:58.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:58.222+0000 7f2375b9a700 1 -- 172.21.15.84:0/1050623105 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23700afd80 con 0x7f23700d0b10 2023-07-14T11:18:58.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:58.223+0000 7f2375b9a700 1 --2- 172.21.15.84:0/1050623105 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23700d0b10 0x7f23700d0f90 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f2360009840 tx=0x7f2360009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ce743b3d27f5f64 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:58.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:58.223+0000 7f2375399700 1 -- 172.21.15.84:0/1050623105 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2360011830 con 0x7f23700d0b10 2023-07-14T11:18:58.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:58.223+0000 7f2375399700 1 -- 172.21.15.84:0/1050623105 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2360011990 con 0x7f23700d0b10 2023-07-14T11:18:58.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:58.223+0000 7f2375399700 1 -- 172.21.15.84:0/1050623105 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2360011d20 con 0x7f23700d0b10 2023-07-14T11:18:58.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:58.223+0000 7f23785ff700 1 -- 172.21.15.84:0/1050623105 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23700d0b10 msgr2=0x7f23700d0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:58.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:58.223+0000 7f23785ff700 1 --2- 172.21.15.84:0/1050623105 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23700d0b10 0x7f23700d0f90 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f2360009840 tx=0x7f2360009b50 comp rx=0 tx=0).stop 2023-07-14T11:18:58.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:58.223+0000 7f23785ff700 1 -- 172.21.15.84:0/1050623105 shutdown_connections 2023-07-14T11:18:58.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:58.223+0000 7f23785ff700 1 --2- 172.21.15.84:0/1050623105 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23700d0b10 0x7f23700d0f90 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:58.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:58.223+0000 7f23785ff700 1 -- 172.21.15.84:0/1050623105 >> 172.21.15.84:0/1050623105 conn(0x7f237009c1b0 msgr2=0x7f23700d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:18:58.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:58.224+0000 7f23785ff700 1 -- 172.21.15.84:0/1050623105 shutdown_connections 2023-07-14T11:18:58.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:58.224+0000 7f23785ff700 1 -- 172.21.15.84:0/1050623105 wait complete. 2023-07-14T11:18:58.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:58.226+0000 7f23785ff700 1 Processor -- start 2023-07-14T11:18:58.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:58.226+0000 7f23785ff700 1 -- start start 2023-07-14T11:18:58.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:58.227+0000 7f23785ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23700b0e20 0x7f237006b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:58.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:58.227+0000 7f23785ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23700b8a60 0x7f23700ce980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:58.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:58.227+0000 7f23785ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23700d0b10 0x7f237014f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:58.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:58.227+0000 7f23785ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23700cdc00 con 0x7f23700b8a60 2023-07-14T11:18:58.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:58.227+0000 7f23785ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23700cdea0 con 0x7f23700b0e20 2023-07-14T11:18:58.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:58.227+0000 7f23785ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23700ce180 con 0x7f23700d0b10 2023-07-14T11:18:58.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:58.228+0000 7f2375b9a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23700b8a60 0x7f23700ce980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:58.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:58.228+0000 7f2375b9a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23700b8a60 0x7f23700ce980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41332/0 (socket says 172.21.15.84:41332) 2023-07-14T11:18:58.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:58.228+0000 7f2375b9a700 1 -- 172.21.15.84:0/4206111569 learned_addr learned my addr 172.21.15.84:0/4206111569 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:18:58.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:58.228+0000 7f237639b700 1 --2- 172.21.15.84:0/4206111569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23700b0e20 0x7f237006b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:58.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:58.228+0000 7f2376b9c700 1 --2- 172.21.15.84:0/4206111569 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23700d0b10 0x7f237014f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:58.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:58.228+0000 7f2375b9a700 1 -- 172.21.15.84:0/4206111569 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23700d0b10 msgr2=0x7f237014f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:58.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:58.228+0000 7f2375b9a700 1 --2- 172.21.15.84:0/4206111569 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23700d0b10 0x7f237014f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:58.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:58.228+0000 7f2375b9a700 1 -- 172.21.15.84:0/4206111569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23700b0e20 msgr2=0x7f237006b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:18:58.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:58.228+0000 7f2375b9a700 1 --2- 172.21.15.84:0/4206111569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23700b0e20 0x7f237006b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:18:58.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:58.228+0000 7f2375b9a700 1 -- 172.21.15.84:0/4206111569 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23600094a0 con 0x7f23700b8a60 2023-07-14T11:18:58.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:58.228+0000 7f2375b9a700 1 --2- 172.21.15.84:0/4206111569 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23700b8a60 0x7f23700ce980 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f2360009b90 tx=0x7f2360004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:58.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:58.229+0000 7f2366ffd700 1 -- 172.21.15.84:0/4206111569 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23600036a0 con 0x7f23700b8a60 2023-07-14T11:18:58.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:58.229+0000 7f2366ffd700 1 -- 172.21.15.84:0/4206111569 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f236001e070 con 0x7f23700b8a60 2023-07-14T11:18:58.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:58.229+0000 7f2366ffd700 1 -- 172.21.15.84:0/4206111569 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2360003a60 con 0x7f23700b8a60 2023-07-14T11:18:58.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:58.229+0000 7f23785ff700 1 -- 172.21.15.84:0/4206111569 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23700ce460 con 0x7f23700b8a60 2023-07-14T11:18:58.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:58.229+0000 7f23785ff700 1 -- 172.21.15.84:0/4206111569 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23700cd570 con 0x7f23700b8a60 2023-07-14T11:18:58.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:58.230+0000 7f23785ff700 1 -- 172.21.15.84:0/4206111569 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2370074350 con 0x7f23700b8a60 2023-07-14T11:18:58.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:58.231+0000 7f2366ffd700 1 -- 172.21.15.84:0/4206111569 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f2360003bc0 con 0x7f23700b8a60 2023-07-14T11:18:58.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:58.232+0000 7f2366ffd700 1 --2- 172.21.15.84:0/4206111569 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f235406ae00 0x7f235406d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:18:58.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:58.232+0000 7f2366ffd700 1 -- 172.21.15.84:0/4206111569 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6896+0+0 (secure 0 0 0) 0x7f236008a850 con 0x7f23700b8a60 2023-07-14T11:18:58.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:58.232+0000 7f237639b700 1 --2- 172.21.15.84:0/4206111569 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f235406ae00 0x7f235406d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:18:58.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:58.233+0000 7f237639b700 1 --2- 172.21.15.84:0/4206111569 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f235406ae00 0x7f235406d2b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f236c000f60 tx=0x7f236c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:18:58.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:58.236+0000 7f2366ffd700 1 -- 172.21.15.84:0/4206111569 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f23600554b0 con 0x7f23700b8a60 2023-07-14T11:18:58.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:18:58.456+0000 7f23785ff700 1 -- 172.21.15.84:0/4206111569 --> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] -- mgr_command(tid 0: {"prefix": "fs volume rm", "vol_name": "testvol", "yes-i-really-mean-it": "--yes-i-really-mean-it", "target": ["mon-mgr", ""]}) v1 -- 0x7f23700b0340 con 0x7f235406ae00 2023-07-14T11:18:58.464 INFO:tasks.ceph.mon.a.smithi084.stderr:2023-07-14T11:18:58.462+0000 7f5e043f4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-14T11:18:58.515 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2023-07-14T11:19:01.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:01.496+0000 7f2366ffd700 1 -- 172.21.15.84:0/4206111569 <== mgr.4100 v2:172.21.15.179:6836/2094253834 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+78 (secure 0 0 0) 0x7f236c0015a0 con 0x7f235406ae00 2023-07-14T11:19:01.501 INFO:teuthology.orchestra.run.smithi084.stdout:metadata pool: cephfs.testvol.meta data pool: ['cephfs.testvol.data'] removed 2023-07-14T11:19:01.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:01.500+0000 7f23785ff700 1 -- 172.21.15.84:0/4206111569 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f235406ae00 msgr2=0x7f235406d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:01.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:01.500+0000 7f23785ff700 1 --2- 172.21.15.84:0/4206111569 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f235406ae00 0x7f235406d2b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f236c000f60 tx=0x7f236c009040 comp rx=0 tx=0).stop 2023-07-14T11:19:01.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:01.500+0000 7f23785ff700 1 -- 172.21.15.84:0/4206111569 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23700b8a60 msgr2=0x7f23700ce980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:01.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:01.500+0000 7f23785ff700 1 --2- 172.21.15.84:0/4206111569 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23700b8a60 0x7f23700ce980 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f2360009b90 tx=0x7f2360004750 comp rx=0 tx=0).stop 2023-07-14T11:19:01.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:01.500+0000 7f23785ff700 1 -- 172.21.15.84:0/4206111569 shutdown_connections 2023-07-14T11:19:01.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:01.500+0000 7f23785ff700 1 --2- 172.21.15.84:0/4206111569 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f235406ae00 0x7f235406d2b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:01.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:01.500+0000 7f23785ff700 1 --2- 172.21.15.84:0/4206111569 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23700d0b10 0x7f237014f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:01.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:01.500+0000 7f23785ff700 1 --2- 172.21.15.84:0/4206111569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23700b0e20 0x7f237006b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:01.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:01.500+0000 7f23785ff700 1 --2- 172.21.15.84:0/4206111569 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23700b8a60 0x7f23700ce980 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:01.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:01.500+0000 7f23785ff700 1 -- 172.21.15.84:0/4206111569 >> 172.21.15.84:0/4206111569 conn(0x7f237009c1b0 msgr2=0x7f23700d1640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:01.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:01.500+0000 7f23785ff700 1 -- 172.21.15.84:0/4206111569 shutdown_connections 2023-07-14T11:19:01.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:01.501+0000 7f23785ff700 1 -- 172.21.15.84:0/4206111569 wait complete. 2023-07-14T11:19:01.525 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-14T11:19:01.526 DEBUG:teuthology.orchestra.run.smithi084:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-14T11:19:01.623 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-14T11:19:01.729 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-14T11:19:01.730 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-14T11:19:01.730 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:19:01.776 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-14T11:19:01.777 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:19:01.863 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:19:02.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.096+0000 7ffb18fff700 1 Processor -- start 2023-07-14T11:19:02.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.097+0000 7ffb18fff700 1 -- start start 2023-07-14T11:19:02.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.098+0000 7ffb18fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb1415e890 0x7ffb140cee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:02.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.098+0000 7ffb18fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ffb1415afd0 0x7ffb140b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:02.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.098+0000 7ffb18fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb140ce110 con 0x7ffb140b3780 2023-07-14T11:19:02.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.098+0000 7ffb18fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb1415b450 con 0x7ffb1415afd0 2023-07-14T11:19:02.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.098+0000 7ffb18fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb140cf380 con 0x7ffb1415e890 2023-07-14T11:19:02.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.098+0000 7ffb12d9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ffb1415afd0 0x7ffb140b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:02.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.098+0000 7ffb1259c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb1415e890 0x7ffb140cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:02.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.098+0000 7ffb12d9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ffb1415afd0 0x7ffb140b3bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.84:34798/0 (socket says 172.21.15.84:34798) 2023-07-14T11:19:02.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.098+0000 7ffb0bfff700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7ffb140b3780 0x7ffb1415a8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.84:49290/0 (socket says 172.21.15.84:49290) 2023-07-14T11:19:02.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.098+0000 7ffb12d9d700 1 -- 172.21.15.84:0/1894640850 learned_addr learned my addr 172.21.15.84:0/1894640850 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:02.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.099+0000 7ffb12d9d700 1 -- 172.21.15.84:0/1894640850 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb1415e890 msgr2=0x7ffb140cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:02.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.099+0000 7ffb12d9d700 1 --2- 172.21.15.84:0/1894640850 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb1415e890 0x7ffb140cee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:02.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.099+0000 7ffb12d9d700 1 -- 172.21.15.84:0/1894640850 >> v1:172.21.15.179:6789/0 conn(0x7ffb140b3780 legacy=0x7ffb1415a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:02.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.099+0000 7ffb12d9d700 1 -- 172.21.15.84:0/1894640850 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb1415b660 con 0x7ffb1415afd0 2023-07-14T11:19:02.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.099+0000 7ffb11d9b700 1 -- 172.21.15.84:0/1894640850 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3694134177 0 0) 0x7ffb140ce110 con 0x7ffb140b3780 2023-07-14T11:19:02.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.099+0000 7ffb12d9d700 1 --2- 172.21.15.84:0/1894640850 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb1415afd0 0x7ffb140b3bf0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c009e50 tx=0x7ffb0c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e2e3b24a1a2d15f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:02.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.100+0000 7ffb11d9b700 1 -- 172.21.15.84:0/1894640850 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c00e070 con 0x7ffb1415afd0 2023-07-14T11:19:02.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.100+0000 7ffb11d9b700 1 -- 172.21.15.84:0/1894640850 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb0c00b910 con 0x7ffb1415afd0 2023-07-14T11:19:02.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.100+0000 7ffb11d9b700 1 -- 172.21.15.84:0/1894640850 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c00bcc0 con 0x7ffb1415afd0 2023-07-14T11:19:02.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.100+0000 7ffb18fff700 1 -- 172.21.15.84:0/1894640850 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb1415afd0 msgr2=0x7ffb140b3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:02.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.100+0000 7ffb18fff700 1 --2- 172.21.15.84:0/1894640850 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb1415afd0 0x7ffb140b3bf0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c009e50 tx=0x7ffb0c00b330 comp rx=0 tx=0).stop 2023-07-14T11:19:02.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.100+0000 7ffb18fff700 1 -- 172.21.15.84:0/1894640850 shutdown_connections 2023-07-14T11:19:02.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.100+0000 7ffb18fff700 1 --2- 172.21.15.84:0/1894640850 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb1415afd0 0x7ffb140b3bf0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:02.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.100+0000 7ffb18fff700 1 --2- 172.21.15.84:0/1894640850 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb1415e890 0x7ffb140cee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:02.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.100+0000 7ffb18fff700 1 -- 172.21.15.84:0/1894640850 >> 172.21.15.84:0/1894640850 conn(0x7ffb14069f30 msgr2=0x7ffb1406a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:02.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.100+0000 7ffb18fff700 1 -- 172.21.15.84:0/1894640850 shutdown_connections 2023-07-14T11:19:02.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.100+0000 7ffb18fff700 1 -- 172.21.15.84:0/1894640850 wait complete. 2023-07-14T11:19:02.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.102+0000 7ffb18fff700 1 Processor -- start 2023-07-14T11:19:02.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.102+0000 7ffb18fff700 1 -- start start 2023-07-14T11:19:02.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.103+0000 7ffb18fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb140b3780 0x7ffb14071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:02.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.103+0000 7ffb18fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb1415afd0 0x7ffb14159300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:02.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.103+0000 7ffb18fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb1415e890 0x7ffb14159840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:02.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.103+0000 7ffb18fff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1414ba70 con 0x7ffb1415e890 2023-07-14T11:19:02.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.103+0000 7ffb18fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1414ebf0 con 0x7ffb140b3780 2023-07-14T11:19:02.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.103+0000 7ffb18fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1414eed0 con 0x7ffb1415afd0 2023-07-14T11:19:02.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.103+0000 7ffb12d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb1415e890 0x7ffb14159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:02.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.104+0000 7ffb12d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb1415e890 0x7ffb14159840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39074/0 (socket says 172.21.15.84:39074) 2023-07-14T11:19:02.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.104+0000 7ffb12d9d700 1 -- 172.21.15.84:0/1377193409 learned_addr learned my addr 172.21.15.84:0/1377193409 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:02.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.104+0000 7ffb0bfff700 1 --2- 172.21.15.84:0/1377193409 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb1415afd0 0x7ffb14159300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:02.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.104+0000 7ffb1259c700 1 --2- 172.21.15.84:0/1377193409 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb140b3780 0x7ffb14071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:02.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.104+0000 7ffb12d9d700 1 -- 172.21.15.84:0/1377193409 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb1415afd0 msgr2=0x7ffb14159300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:02.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.104+0000 7ffb12d9d700 1 --2- 172.21.15.84:0/1377193409 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb1415afd0 0x7ffb14159300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:02.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.104+0000 7ffb12d9d700 1 -- 172.21.15.84:0/1377193409 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb140b3780 msgr2=0x7ffb14071190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:02.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.104+0000 7ffb12d9d700 1 --2- 172.21.15.84:0/1377193409 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb140b3780 0x7ffb14071190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:02.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.104+0000 7ffb12d9d700 1 -- 172.21.15.84:0/1377193409 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb0c009b30 con 0x7ffb1415e890 2023-07-14T11:19:02.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.104+0000 7ffb0bfff700 1 --2- 172.21.15.84:0/1377193409 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb1415afd0 0x7ffb14159300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:19:02.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.104+0000 7ffb1259c700 1 --2- 172.21.15.84:0/1377193409 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb140b3780 0x7ffb14071190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:19:02.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.104+0000 7ffb12d9d700 1 --2- 172.21.15.84:0/1377193409 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb1415e890 0x7ffb14159840 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c00b680 tx=0x7ffb0c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:02.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.104+0000 7ffb0affd700 1 -- 172.21.15.84:0/1377193409 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c0099b0 con 0x7ffb1415e890 2023-07-14T11:19:02.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.104+0000 7ffb0affd700 1 -- 172.21.15.84:0/1377193409 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb0c0092e0 con 0x7ffb1415e890 2023-07-14T11:19:02.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.104+0000 7ffb18fff700 1 -- 172.21.15.84:0/1377193409 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb1414f1b0 con 0x7ffb1415e890 2023-07-14T11:19:02.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.104+0000 7ffb0affd700 1 -- 172.21.15.84:0/1377193409 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c01c640 con 0x7ffb1415e890 2023-07-14T11:19:02.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.105+0000 7ffb18fff700 1 -- 172.21.15.84:0/1377193409 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb141417c0 con 0x7ffb1415e890 2023-07-14T11:19:02.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.106+0000 7ffb18fff700 1 -- 172.21.15.84:0/1377193409 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb1414bbb0 con 0x7ffb1415e890 2023-07-14T11:19:02.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.106+0000 7ffb0affd700 1 -- 172.21.15.84:0/1377193409 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7ffb0c01c7a0 con 0x7ffb1415e890 2023-07-14T11:19:02.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.108+0000 7ffb0affd700 1 --2- 172.21.15.84:0/1377193409 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7ffaf406ae00 0x7ffaf406d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:02.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.108+0000 7ffb0affd700 1 -- 172.21.15.84:0/1377193409 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6148+0+0 (secure 0 0 0) 0x7ffb0c08b480 con 0x7ffb1415e890 2023-07-14T11:19:02.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.108+0000 7ffb1259c700 1 --2- 172.21.15.84:0/1377193409 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7ffaf406ae00 0x7ffaf406d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:02.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.109+0000 7ffb1259c700 1 --2- 172.21.15.84:0/1377193409 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7ffaf406ae00 0x7ffaf406d2b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ffb04009b60 tx=0x7ffb04008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:02.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.113+0000 7ffb0affd700 1 -- 172.21.15.84:0/1377193409 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ffb0c056340 con 0x7ffb1415e890 2023-07-14T11:19:02.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.308+0000 7ffb18fff700 1 -- 172.21.15.84:0/1377193409 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffb1404e280 con 0x7ffb1415e890 2023-07-14T11:19:02.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.309+0000 7ffb0affd700 1 -- 172.21.15.84:0/1377193409 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+18401 (secure 0 0 0) 0x7ffb0c059960 con 0x7ffb1415e890 2023-07-14T11:19:02.312 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:19:02.312 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":95,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:19:01.484069+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-07-14T11:18:40.531166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-07-14T11:18:41.475653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.179:6834/4019917691":"2023-07-15T11:18:58.463254+0000","172.21.15.179:6833/4019917691":"2023-07-15T11:18:58.463254+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:19:02.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.312+0000 7ffb18fff700 1 -- 172.21.15.84:0/1377193409 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7ffaf406ae00 msgr2=0x7ffaf406d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:02.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.312+0000 7ffb18fff700 1 --2- 172.21.15.84:0/1377193409 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7ffaf406ae00 0x7ffaf406d2b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ffb04009b60 tx=0x7ffb04008040 comp rx=0 tx=0).stop 2023-07-14T11:19:02.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.312+0000 7ffb18fff700 1 -- 172.21.15.84:0/1377193409 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb1415e890 msgr2=0x7ffb14159840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:02.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.312+0000 7ffb18fff700 1 --2- 172.21.15.84:0/1377193409 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb1415e890 0x7ffb14159840 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c00b680 tx=0x7ffb0c004ad0 comp rx=0 tx=0).stop 2023-07-14T11:19:02.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.312+0000 7ffb18fff700 1 -- 172.21.15.84:0/1377193409 shutdown_connections 2023-07-14T11:19:02.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.312+0000 7ffb18fff700 1 --2- 172.21.15.84:0/1377193409 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb1415e890 0x7ffb14159840 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:02.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.312+0000 7ffb18fff700 1 --2- 172.21.15.84:0/1377193409 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb140b3780 0x7ffb14071190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:02.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.312+0000 7ffb18fff700 1 --2- 172.21.15.84:0/1377193409 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7ffaf406ae00 0x7ffaf406d2b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:02.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.312+0000 7ffb18fff700 1 --2- 172.21.15.84:0/1377193409 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb1415afd0 0x7ffb14159300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:02.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.312+0000 7ffb18fff700 1 -- 172.21.15.84:0/1377193409 >> 172.21.15.84:0/1377193409 conn(0x7ffb14069f30 msgr2=0x7ffb1415ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:02.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.312+0000 7ffb18fff700 1 -- 172.21.15.84:0/1377193409 shutdown_connections 2023-07-14T11:19:02.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.312+0000 7ffb18fff700 1 -- 172.21.15.84:0/1377193409 wait complete. 2023-07-14T11:19:02.332 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T11:13:00.125395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T11:13:06.803994+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T11:18:40.531166+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T11:18:41.475653+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T11:19:02.333 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T11:19:02.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.530+0000 7fd7989ff700 1 Processor -- start 2023-07-14T11:19:02.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.530+0000 7fd7989ff700 1 -- start start 2023-07-14T11:19:02.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.531+0000 7fd7989ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd79406f010 0x7fd794071650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:02.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.531+0000 7fd7989ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd7940ce030 0x7fd794069f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:02.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.531+0000 7fd7989ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7940cdba0 con 0x7fd79406a470 2023-07-14T11:19:02.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.531+0000 7fd7989ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd79406f3e0 con 0x7fd79406f010 2023-07-14T11:19:02.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.531+0000 7fd7989ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd79406a8f0 con 0x7fd7940ce030 2023-07-14T11:19:02.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.532+0000 7fd79259c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd79406f010 0x7fd794071650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:02.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.532+0000 7fd79259c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd79406f010 0x7fd794071650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39078/0 (socket says 172.21.15.84:39078) 2023-07-14T11:19:02.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.532+0000 7fd79259c700 1 -- 172.21.15.84:0/4125242772 learned_addr learned my addr 172.21.15.84:0/4125242772 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:02.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.532+0000 7fd791d9b700 1 --2- 172.21.15.84:0/4125242772 >> v2:172.21.15.179:3300/0 conn(0x7fd7940ce030 0x7fd794069f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:02.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.532+0000 7fd79259c700 1 -- 172.21.15.84:0/4125242772 >> v2:172.21.15.179:3300/0 conn(0x7fd7940ce030 msgr2=0x7fd794069f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:02.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.532+0000 7fd79259c700 1 --2- 172.21.15.84:0/4125242772 >> v2:172.21.15.179:3300/0 conn(0x7fd7940ce030 0x7fd794069f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:02.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.532+0000 7fd79259c700 1 -- 172.21.15.84:0/4125242772 >> v1:172.21.15.179:6789/0 conn(0x7fd79406a470 legacy=0x7fd7941601d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:02.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.532+0000 7fd79259c700 1 -- 172.21.15.84:0/4125242772 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7940cf370 con 0x7fd79406f010 2023-07-14T11:19:02.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.532+0000 7fd79259c700 1 --2- 172.21.15.84:0/4125242772 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd79406f010 0x7fd794071650 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7fd7940cb410 tx=0x7fd784009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d36de265d8a10cd9 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:02.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.532+0000 7fd79159a700 1 -- 172.21.15.84:0/4125242772 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd784004230 con 0x7fd79406f010 2023-07-14T11:19:02.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.532+0000 7fd79159a700 1 -- 172.21.15.84:0/4125242772 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd784004390 con 0x7fd79406f010 2023-07-14T11:19:02.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.532+0000 7fd79159a700 1 -- 172.21.15.84:0/4125242772 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7840036a0 con 0x7fd79406f010 2023-07-14T11:19:02.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.533+0000 7fd7989ff700 1 -- 172.21.15.84:0/4125242772 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd79406f010 msgr2=0x7fd794071650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:02.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.533+0000 7fd7989ff700 1 --2- 172.21.15.84:0/4125242772 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd79406f010 0x7fd794071650 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7fd7940cb410 tx=0x7fd784009bd0 comp rx=0 tx=0).stop 2023-07-14T11:19:02.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.533+0000 7fd7989ff700 1 -- 172.21.15.84:0/4125242772 shutdown_connections 2023-07-14T11:19:02.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.533+0000 7fd7989ff700 1 --2- 172.21.15.84:0/4125242772 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd79406f010 0x7fd794071650 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:02.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.533+0000 7fd7989ff700 1 --2- 172.21.15.84:0/4125242772 >> v2:172.21.15.179:3300/0 conn(0x7fd7940ce030 0x7fd794069f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:02.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.533+0000 7fd7989ff700 1 -- 172.21.15.84:0/4125242772 >> 172.21.15.84:0/4125242772 conn(0x7fd7940cc640 msgr2=0x7fd7940cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:02.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.533+0000 7fd7989ff700 1 -- 172.21.15.84:0/4125242772 shutdown_connections 2023-07-14T11:19:02.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.533+0000 7fd7989ff700 1 -- 172.21.15.84:0/4125242772 wait complete. 2023-07-14T11:19:02.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.535+0000 7fd7989ff700 1 Processor -- start 2023-07-14T11:19:02.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.536+0000 7fd7989ff700 1 -- start start 2023-07-14T11:19:02.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.537+0000 7fd7989ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd79406a470 0x7fd7941f27a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:02.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.537+0000 7fd7989ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd79406f010 0x7fd79414dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:02.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.537+0000 7fd7989ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7940ce030 0x7fd7940b44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:02.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.537+0000 7fd7989ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7941f2ce0 con 0x7fd79406a470 2023-07-14T11:19:02.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.537+0000 7fd7989ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7941f3ae0 con 0x7fd79406f010 2023-07-14T11:19:02.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.537+0000 7fd7989ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7940b5810 con 0x7fd7940ce030 2023-07-14T11:19:02.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.537+0000 7fd79259c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd79406a470 0x7fd7941f27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:02.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.537+0000 7fd79259c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd79406a470 0x7fd7941f27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39080/0 (socket says 172.21.15.84:39080) 2023-07-14T11:19:02.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.537+0000 7fd79259c700 1 -- 172.21.15.84:0/3919049037 learned_addr learned my addr 172.21.15.84:0/3919049037 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:02.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.538+0000 7fd79259c700 1 -- 172.21.15.84:0/3919049037 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7940ce030 msgr2=0x7fd7940b44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:02.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.538+0000 7fd79259c700 1 --2- 172.21.15.84:0/3919049037 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7940ce030 0x7fd7940b44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:02.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.538+0000 7fd79259c700 1 -- 172.21.15.84:0/3919049037 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd79406f010 msgr2=0x7fd79414dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:02.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.538+0000 7fd79259c700 1 --2- 172.21.15.84:0/3919049037 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd79406f010 0x7fd79414dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:02.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.538+0000 7fd79259c700 1 -- 172.21.15.84:0/3919049037 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd784009550 con 0x7fd79406a470 2023-07-14T11:19:02.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.538+0000 7fd79259c700 1 --2- 172.21.15.84:0/3919049037 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd79406a470 0x7fd7941f27a0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fd784009130 tx=0x7fd784004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:02.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.538+0000 7fd782ffd700 1 -- 172.21.15.84:0/3919049037 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd784003d40 con 0x7fd79406a470 2023-07-14T11:19:02.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.538+0000 7fd782ffd700 1 -- 172.21.15.84:0/3919049037 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd78401f070 con 0x7fd79406a470 2023-07-14T11:19:02.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.538+0000 7fd7989ff700 1 -- 172.21.15.84:0/3919049037 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7941f2ed0 con 0x7fd79406a470 2023-07-14T11:19:02.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.538+0000 7fd782ffd700 1 -- 172.21.15.84:0/3919049037 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd784003ea0 con 0x7fd79406a470 2023-07-14T11:19:02.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.538+0000 7fd7989ff700 1 -- 172.21.15.84:0/3919049037 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7941f3490 con 0x7fd79406a470 2023-07-14T11:19:02.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.539+0000 7fd7989ff700 1 -- 172.21.15.84:0/3919049037 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd794074350 con 0x7fd79406a470 2023-07-14T11:19:02.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.540+0000 7fd782ffd700 1 -- 172.21.15.84:0/3919049037 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7fd784021030 con 0x7fd79406a470 2023-07-14T11:19:02.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.541+0000 7fd782ffd700 1 --2- 172.21.15.84:0/3919049037 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fd77406ae00 0x7fd77406d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:02.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.541+0000 7fd782ffd700 1 -- 172.21.15.84:0/3919049037 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6148+0+0 (secure 0 0 0) 0x7fd78408acd0 con 0x7fd79406a470 2023-07-14T11:19:02.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.542+0000 7fd791d9b700 1 --2- 172.21.15.84:0/3919049037 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fd77406ae00 0x7fd77406d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:02.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.542+0000 7fd791d9b700 1 --2- 172.21.15.84:0/3919049037 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fd77406ae00 0x7fd77406d2b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd7941e88b0 tx=0x7fd788008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:02.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.545+0000 7fd782ffd700 1 -- 172.21.15.84:0/3919049037 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fd784055ca0 con 0x7fd79406a470 2023-07-14T11:19:02.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.736+0000 7fd7989ff700 1 -- 172.21.15.84:0/3919049037 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd794074350 con 0x7fd79406a470 2023-07-14T11:19:02.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.736+0000 7fd782ffd700 1 -- 172.21.15.84:0/3919049037 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v95) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd7840592c0 con 0x7fd79406a470 2023-07-14T11:19:02.739 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-07-14T11:19:02.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.738+0000 7fd7989ff700 1 -- 172.21.15.84:0/3919049037 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fd77406ae00 msgr2=0x7fd77406d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:02.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.738+0000 7fd7989ff700 1 --2- 172.21.15.84:0/3919049037 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fd77406ae00 0x7fd77406d2b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd7941e88b0 tx=0x7fd788008040 comp rx=0 tx=0).stop 2023-07-14T11:19:02.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.738+0000 7fd7989ff700 1 -- 172.21.15.84:0/3919049037 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd79406a470 msgr2=0x7fd7941f27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:02.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.738+0000 7fd7989ff700 1 --2- 172.21.15.84:0/3919049037 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd79406a470 0x7fd7941f27a0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fd784009130 tx=0x7fd784004750 comp rx=0 tx=0).stop 2023-07-14T11:19:02.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.738+0000 7fd7989ff700 1 -- 172.21.15.84:0/3919049037 shutdown_connections 2023-07-14T11:19:02.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.738+0000 7fd7989ff700 1 --2- 172.21.15.84:0/3919049037 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fd77406ae00 0x7fd77406d2b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:02.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.738+0000 7fd7989ff700 1 --2- 172.21.15.84:0/3919049037 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7940ce030 0x7fd7940b44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:02.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.738+0000 7fd7989ff700 1 --2- 172.21.15.84:0/3919049037 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd79406a470 0x7fd7941f27a0 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:02.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.738+0000 7fd7989ff700 1 --2- 172.21.15.84:0/3919049037 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd79406f010 0x7fd79414dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:02.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.738+0000 7fd7989ff700 1 -- 172.21.15.84:0/3919049037 >> 172.21.15.84:0/3919049037 conn(0x7fd7940cc640 msgr2=0x7fd7940cfb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:02.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.739+0000 7fd7989ff700 1 -- 172.21.15.84:0/3919049037 shutdown_connections 2023-07-14T11:19:02.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.739+0000 7fd7989ff700 1 -- 172.21.15.84:0/3919049037 wait complete. 2023-07-14T11:19:02.759 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T11:19:02.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.955+0000 7f84c1bff700 1 Processor -- start 2023-07-14T11:19:02.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.955+0000 7f84c1bff700 1 -- start start 2023-07-14T11:19:02.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.956+0000 7f84c1bff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f84bc15c860 0x7f84bc0d1e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:02.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.956+0000 7f84c1bff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84bc0cd5a0 con 0x7f84bc0c71b0 2023-07-14T11:19:02.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.956+0000 7f84c1bff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84bc0cd7f0 con 0x7f84bc0cf2a0 2023-07-14T11:19:02.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.956+0000 7f84c1bff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84bc146740 con 0x7f84bc15c860 2023-07-14T11:19:02.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.957+0000 7f84bb7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f84bc15c860 0x7f84bc0d1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:02.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.957+0000 7f84bbfff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f84bc0c71b0 0x7f84bc0b49d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52126/0 (socket says 172.21.15.84:52126) 2023-07-14T11:19:02.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.957+0000 7f84bbfff700 1 -- 172.21.15.84:0/1309311951 learned_addr learned my addr 172.21.15.84:0/1309311951 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:19:02.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.957+0000 7f84bb7fe700 1 -- 172.21.15.84:0/1309311951 >> v1:172.21.15.179:6789/0 conn(0x7f84bc0cf2a0 legacy=0x7f84bc0c6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:02.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.957+0000 7f84bb7fe700 1 -- 172.21.15.84:0/1309311951 >> v1:172.21.15.84:6789/0 conn(0x7f84bc0c71b0 legacy=0x7f84bc0b49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:02.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.957+0000 7f84bb7fe700 1 -- 172.21.15.84:0/1309311951 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84bc0cdad0 con 0x7f84bc15c860 2023-07-14T11:19:02.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.957+0000 7f84bb7fe700 1 --2- 172.21.15.84:0/1309311951 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84bc15c860 0x7f84bc0d1e40 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f84ac009840 tx=0x7f84ac009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2f20b2615af7652 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:02.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.957+0000 7f84baffd700 1 -- 172.21.15.84:0/1309311951 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ac004230 con 0x7f84bc15c860 2023-07-14T11:19:02.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.958+0000 7f84baffd700 1 -- 172.21.15.84:0/1309311951 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84ac004390 con 0x7f84bc15c860 2023-07-14T11:19:02.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.958+0000 7f84baffd700 1 -- 172.21.15.84:0/1309311951 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ac0036a0 con 0x7f84bc15c860 2023-07-14T11:19:02.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.958+0000 7f84c1bff700 1 -- 172.21.15.84:0/1309311951 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84bc15c860 msgr2=0x7f84bc0d1e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:02.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.958+0000 7f84c1bff700 1 --2- 172.21.15.84:0/1309311951 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84bc15c860 0x7f84bc0d1e40 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f84ac009840 tx=0x7f84ac009b50 comp rx=0 tx=0).stop 2023-07-14T11:19:02.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.958+0000 7f84c1bff700 1 -- 172.21.15.84:0/1309311951 shutdown_connections 2023-07-14T11:19:02.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.958+0000 7f84c1bff700 1 --2- 172.21.15.84:0/1309311951 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84bc15c860 0x7f84bc0d1e40 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:02.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.958+0000 7f84c1bff700 1 -- 172.21.15.84:0/1309311951 >> 172.21.15.84:0/1309311951 conn(0x7f84bc065bd0 msgr2=0x7f84bc065fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:02.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.958+0000 7f84c1bff700 1 -- 172.21.15.84:0/1309311951 shutdown_connections 2023-07-14T11:19:02.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.958+0000 7f84c1bff700 1 -- 172.21.15.84:0/1309311951 wait complete. 2023-07-14T11:19:02.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.960+0000 7f84c1bff700 1 Processor -- start 2023-07-14T11:19:02.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.960+0000 7f84c1bff700 1 -- start start 2023-07-14T11:19:02.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.961+0000 7f84c1bff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84bc0c71b0 0x7f84bc158400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:02.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.961+0000 7f84c1bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84bc0cf2a0 0x7f84bc1f2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:02.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.961+0000 7f84c1bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84bc15c860 0x7f84bc0cc030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:02.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.961+0000 7f84c1bff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc158940 con 0x7f84bc0c71b0 2023-07-14T11:19:02.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.961+0000 7f84c1bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc0b8bc0 con 0x7f84bc0cf2a0 2023-07-14T11:19:02.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.961+0000 7f84c1bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc0b79b0 con 0x7f84bc15c860 2023-07-14T11:19:02.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.961+0000 7f84bb7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84bc0c71b0 0x7f84bc158400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:02.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.961+0000 7f84bb7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84bc0c71b0 0x7f84bc158400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39098/0 (socket says 172.21.15.84:39098) 2023-07-14T11:19:02.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.961+0000 7f84bb7fe700 1 -- 172.21.15.84:0/1790050534 learned_addr learned my addr 172.21.15.84:0/1790050534 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:02.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.961+0000 7f84bbfff700 1 --2- 172.21.15.84:0/1790050534 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84bc15c860 0x7f84bc0cc030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:02.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.961+0000 7f84b3fff700 1 --2- 172.21.15.84:0/1790050534 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84bc0cf2a0 0x7f84bc1f2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:02.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.961+0000 7f84bb7fe700 1 -- 172.21.15.84:0/1790050534 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84bc15c860 msgr2=0x7f84bc0cc030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:02.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.962+0000 7f84bb7fe700 1 --2- 172.21.15.84:0/1790050534 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84bc15c860 0x7f84bc0cc030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:02.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.962+0000 7f84bb7fe700 1 -- 172.21.15.84:0/1790050534 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84bc0cf2a0 msgr2=0x7f84bc1f2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:02.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.962+0000 7f84bb7fe700 1 --2- 172.21.15.84:0/1790050534 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84bc0cf2a0 0x7f84bc1f2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:02.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.962+0000 7f84bb7fe700 1 -- 172.21.15.84:0/1790050534 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84ac0094a0 con 0x7f84bc0c71b0 2023-07-14T11:19:02.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.962+0000 7f84bbfff700 1 --2- 172.21.15.84:0/1790050534 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84bc15c860 0x7f84bc0cc030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:19:02.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.962+0000 7f84b3fff700 1 --2- 172.21.15.84:0/1790050534 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84bc0cf2a0 0x7f84bc1f2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:19:02.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.962+0000 7f84bb7fe700 1 --2- 172.21.15.84:0/1790050534 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84bc0c71b0 0x7f84bc158400 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f84ac0090b0 tx=0x7f84ac0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:02.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.962+0000 7f84b8ff9700 1 -- 172.21.15.84:0/1790050534 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ac011830 con 0x7f84bc0c71b0 2023-07-14T11:19:02.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.962+0000 7f84b8ff9700 1 -- 172.21.15.84:0/1790050534 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84ac011990 con 0x7f84bc0c71b0 2023-07-14T11:19:02.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.962+0000 7f84c1bff700 1 -- 172.21.15.84:0/1790050534 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84bc0b7c90 con 0x7f84bc0c71b0 2023-07-14T11:19:02.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.962+0000 7f84b8ff9700 1 -- 172.21.15.84:0/1790050534 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ac011d40 con 0x7f84bc0c71b0 2023-07-14T11:19:02.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.962+0000 7f84c1bff700 1 -- 172.21.15.84:0/1790050534 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84bc15d1c0 con 0x7f84bc0c71b0 2023-07-14T11:19:02.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.963+0000 7f84c1bff700 1 -- 172.21.15.84:0/1790050534 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84bc074350 con 0x7f84bc0c71b0 2023-07-14T11:19:02.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.964+0000 7f84b8ff9700 1 -- 172.21.15.84:0/1790050534 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f84ac01b440 con 0x7f84bc0c71b0 2023-07-14T11:19:02.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.965+0000 7f84b8ff9700 1 --2- 172.21.15.84:0/1790050534 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f849c06ae00 0x7f849c06d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:02.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.965+0000 7f84b8ff9700 1 -- 172.21.15.84:0/1790050534 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f84ac08afe0 con 0x7f84bc0c71b0 2023-07-14T11:19:02.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.966+0000 7f84b3fff700 1 --2- 172.21.15.84:0/1790050534 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f849c06ae00 0x7f849c06d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:02.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.966+0000 7f84b3fff700 1 --2- 172.21.15.84:0/1790050534 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f849c06ae00 0x7f849c06d2b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f84bc0b5a10 tx=0x7f84a4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:02.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:02.969+0000 7f84b8ff9700 1 -- 172.21.15.84:0/1790050534 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f84ac055f30 con 0x7f84bc0c71b0 2023-07-14T11:19:03.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.164+0000 7f84c1bff700 1 -- 172.21.15.84:0/1790050534 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f84bc071970 con 0x7f84bc0c71b0 2023-07-14T11:19:03.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.165+0000 7f84b8ff9700 1 -- 172.21.15.84:0/1790050534 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v95) v1 ==== 92+0+10 (secure 0 0 0) 0x7f84ac059550 con 0x7f84bc0c71b0 2023-07-14T11:19:03.168 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-07-14T11:19:03.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.167+0000 7f84c1bff700 1 -- 172.21.15.84:0/1790050534 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f849c06ae00 msgr2=0x7f849c06d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:03.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.167+0000 7f84c1bff700 1 --2- 172.21.15.84:0/1790050534 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f849c06ae00 0x7f849c06d2b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f84bc0b5a10 tx=0x7f84a4009040 comp rx=0 tx=0).stop 2023-07-14T11:19:03.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.167+0000 7f84c1bff700 1 -- 172.21.15.84:0/1790050534 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84bc0c71b0 msgr2=0x7f84bc158400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:03.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.167+0000 7f84c1bff700 1 --2- 172.21.15.84:0/1790050534 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84bc0c71b0 0x7f84bc158400 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f84ac0090b0 tx=0x7f84ac0047c0 comp rx=0 tx=0).stop 2023-07-14T11:19:03.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.167+0000 7f84c1bff700 1 -- 172.21.15.84:0/1790050534 shutdown_connections 2023-07-14T11:19:03.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.167+0000 7f84c1bff700 1 --2- 172.21.15.84:0/1790050534 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f849c06ae00 0x7f849c06d2b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:03.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.167+0000 7f84c1bff700 1 --2- 172.21.15.84:0/1790050534 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84bc15c860 0x7f84bc0cc030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:03.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.167+0000 7f84c1bff700 1 --2- 172.21.15.84:0/1790050534 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84bc0c71b0 0x7f84bc158400 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:03.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.167+0000 7f84c1bff700 1 --2- 172.21.15.84:0/1790050534 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84bc0cf2a0 0x7f84bc1f2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:03.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.167+0000 7f84c1bff700 1 -- 172.21.15.84:0/1790050534 >> 172.21.15.84:0/1790050534 conn(0x7f84bc065bd0 msgr2=0x7f84bc15a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:03.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.168+0000 7f84c1bff700 1 -- 172.21.15.84:0/1790050534 shutdown_connections 2023-07-14T11:19:03.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.168+0000 7f84c1bff700 1 -- 172.21.15.84:0/1790050534 wait complete. 2023-07-14T11:19:03.188 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T11:19:03.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.384+0000 7f9094dff700 1 Processor -- start 2023-07-14T11:19:03.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.384+0000 7f9094dff700 1 -- start start 2023-07-14T11:19:03.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.385+0000 7f9094dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90900b8a60 0x7f90900b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:03.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.385+0000 7f9094dff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f90900b4530 0x7f90900d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:03.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.385+0000 7f9094dff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90900b8e30 con 0x7f90900d1050 2023-07-14T11:19:03.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.385+0000 7f9094dff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90900d14d0 con 0x7f90900b4530 2023-07-14T11:19:03.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.385+0000 7f9094dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90900b1e30 con 0x7f90900b8a60 2023-07-14T11:19:03.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.385+0000 7f908dd9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f90900b4530 0x7f90900d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:03.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.385+0000 7f908ed9d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f90900d1050 0x7f90900b25d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52140/0 (socket says 172.21.15.84:52140) 2023-07-14T11:19:03.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.385+0000 7f908ed9d700 1 -- 172.21.15.84:0/3900916629 learned_addr learned my addr 172.21.15.84:0/3900916629 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:19:03.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.386+0000 7f908e59c700 1 --2- 172.21.15.84:0/3900916629 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90900b8a60 0x7f90900b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:03.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.386+0000 7f908dd9b700 1 -- 172.21.15.84:0/3900916629 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90900b8a60 msgr2=0x7f90900b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:03.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.386+0000 7f908dd9b700 1 --2- 172.21.15.84:0/3900916629 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90900b8a60 0x7f90900b3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:03.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.386+0000 7f908dd9b700 1 -- 172.21.15.84:0/3900916629 >> v1:172.21.15.84:6789/0 conn(0x7f90900d1050 legacy=0x7f90900b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:03.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.386+0000 7f908dd9b700 1 -- 172.21.15.84:0/3900916629 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90900afaa0 con 0x7f90900b4530 2023-07-14T11:19:03.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.386+0000 7f908d59a700 1 -- 172.21.15.84:0/3900916629 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1204414471 0 0) 0x7f90900b8e30 con 0x7f90900d1050 2023-07-14T11:19:03.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.386+0000 7f908dd9b700 1 --2- 172.21.15.84:0/3900916629 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90900b4530 0x7f90900d0b10 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f9084009840 tx=0x7f9084009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8155cffc4c6fe14 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:03.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.386+0000 7f908d59a700 1 -- 172.21.15.84:0/3900916629 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9084011830 con 0x7f90900b4530 2023-07-14T11:19:03.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.386+0000 7f908d59a700 1 -- 172.21.15.84:0/3900916629 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9084011990 con 0x7f90900b4530 2023-07-14T11:19:03.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.386+0000 7f908d59a700 1 -- 172.21.15.84:0/3900916629 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9084011d20 con 0x7f90900b4530 2023-07-14T11:19:03.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.387+0000 7f9094dff700 1 -- 172.21.15.84:0/3900916629 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90900b4530 msgr2=0x7f90900d0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:03.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.387+0000 7f9094dff700 1 --2- 172.21.15.84:0/3900916629 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90900b4530 0x7f90900d0b10 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f9084009840 tx=0x7f9084009b50 comp rx=0 tx=0).stop 2023-07-14T11:19:03.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.387+0000 7f9094dff700 1 -- 172.21.15.84:0/3900916629 shutdown_connections 2023-07-14T11:19:03.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.387+0000 7f9094dff700 1 --2- 172.21.15.84:0/3900916629 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90900b8a60 0x7f90900b3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:03.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.387+0000 7f9094dff700 1 --2- 172.21.15.84:0/3900916629 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90900b4530 0x7f90900d0b10 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:03.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.387+0000 7f9094dff700 1 -- 172.21.15.84:0/3900916629 >> 172.21.15.84:0/3900916629 conn(0x7f909009c1b0 msgr2=0x7f90900d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:03.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.387+0000 7f9094dff700 1 -- 172.21.15.84:0/3900916629 shutdown_connections 2023-07-14T11:19:03.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.387+0000 7f9094dff700 1 -- 172.21.15.84:0/3900916629 wait complete. 2023-07-14T11:19:03.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.389+0000 7f9094dff700 1 Processor -- start 2023-07-14T11:19:03.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.389+0000 7f9094dff700 1 -- start start 2023-07-14T11:19:03.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.390+0000 7f9094dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90900b4530 0x7f90900d0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:03.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.390+0000 7f9094dff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90900b8a60 0x7f90900ca9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:03.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.390+0000 7f9094dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90900d1050 0x7f90900cc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:03.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.390+0000 7f9094dff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f909015be70 con 0x7f90900b8a60 2023-07-14T11:19:03.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.390+0000 7f9094dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90900ca670 con 0x7f90900b4530 2023-07-14T11:19:03.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.390+0000 7f9094dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f909015c300 con 0x7f90900d1050 2023-07-14T11:19:03.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.390+0000 7f908dd9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90900b8a60 0x7f90900ca9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:03.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.390+0000 7f908dd9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90900b8a60 0x7f90900ca9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39114/0 (socket says 172.21.15.84:39114) 2023-07-14T11:19:03.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.390+0000 7f908dd9b700 1 -- 172.21.15.84:0/2720143074 learned_addr learned my addr 172.21.15.84:0/2720143074 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:03.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.390+0000 7f908e59c700 1 --2- 172.21.15.84:0/2720143074 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90900b4530 0x7f90900d0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:03.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.390+0000 7f908ed9d700 1 --2- 172.21.15.84:0/2720143074 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90900d1050 0x7f90900cc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:03.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.391+0000 7f908dd9b700 1 -- 172.21.15.84:0/2720143074 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90900d1050 msgr2=0x7f90900cc4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:03.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.391+0000 7f908dd9b700 1 --2- 172.21.15.84:0/2720143074 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90900d1050 0x7f90900cc4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:03.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.391+0000 7f908dd9b700 1 -- 172.21.15.84:0/2720143074 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90900b4530 msgr2=0x7f90900d0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:03.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.391+0000 7f908dd9b700 1 --2- 172.21.15.84:0/2720143074 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90900b4530 0x7f90900d0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:03.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.391+0000 7f908dd9b700 1 -- 172.21.15.84:0/2720143074 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90840094a0 con 0x7f90900b8a60 2023-07-14T11:19:03.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.391+0000 7f908e59c700 1 --2- 172.21.15.84:0/2720143074 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90900b4530 0x7f90900d0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:19:03.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.391+0000 7f908ed9d700 1 --2- 172.21.15.84:0/2720143074 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90900d1050 0x7f90900cc4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:19:03.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.391+0000 7f908dd9b700 1 --2- 172.21.15.84:0/2720143074 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90900b8a60 0x7f90900ca9c0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f9084009b90 tx=0x7f9084004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:03.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.391+0000 7f907effd700 1 -- 172.21.15.84:0/2720143074 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90840038a0 con 0x7f90900b8a60 2023-07-14T11:19:03.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.391+0000 7f907effd700 1 -- 172.21.15.84:0/2720143074 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f908401f070 con 0x7f90900b8a60 2023-07-14T11:19:03.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.391+0000 7f907effd700 1 -- 172.21.15.84:0/2720143074 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9084003c20 con 0x7f90900b8a60 2023-07-14T11:19:03.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.391+0000 7f9094dff700 1 -- 172.21.15.84:0/2720143074 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90900ca0b0 con 0x7f90900b8a60 2023-07-14T11:19:03.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.391+0000 7f9094dff700 1 -- 172.21.15.84:0/2720143074 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f909015bb00 con 0x7f90900b8a60 2023-07-14T11:19:03.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.392+0000 7f9094dff700 1 -- 172.21.15.84:0/2720143074 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f909015bfe0 con 0x7f90900b8a60 2023-07-14T11:19:03.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.393+0000 7f907effd700 1 -- 172.21.15.84:0/2720143074 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f908401a430 con 0x7f90900b8a60 2023-07-14T11:19:03.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.394+0000 7f907effd700 1 --2- 172.21.15.84:0/2720143074 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f907006ae00 0x7f907006d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:03.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.394+0000 7f907effd700 1 -- 172.21.15.84:0/2720143074 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f9084021070 con 0x7f90900b8a60 2023-07-14T11:19:03.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.394+0000 7f908e59c700 1 --2- 172.21.15.84:0/2720143074 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f907006ae00 0x7f907006d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:03.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.395+0000 7f908e59c700 1 --2- 172.21.15.84:0/2720143074 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f907006ae00 0x7f907006d2b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9080009b60 tx=0x7f9080008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:03.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.398+0000 7f907effd700 1 -- 172.21.15.84:0/2720143074 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f9084055f50 con 0x7f90900b8a60 2023-07-14T11:19:03.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.592+0000 7f9094dff700 1 -- 172.21.15.84:0/2720143074 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9090074350 con 0x7f90900b8a60 2023-07-14T11:19:03.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.593+0000 7f907effd700 1 -- 172.21.15.84:0/2720143074 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v95) v1 ==== 104+0+11 (secure 0 0 0) 0x7f908402b020 con 0x7f90900b8a60 2023-07-14T11:19:03.596 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-07-14T11:19:03.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.595+0000 7f9094dff700 1 -- 172.21.15.84:0/2720143074 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f907006ae00 msgr2=0x7f907006d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:03.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.595+0000 7f9094dff700 1 --2- 172.21.15.84:0/2720143074 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f907006ae00 0x7f907006d2b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9080009b60 tx=0x7f9080008040 comp rx=0 tx=0).stop 2023-07-14T11:19:03.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.595+0000 7f9094dff700 1 -- 172.21.15.84:0/2720143074 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90900b8a60 msgr2=0x7f90900ca9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:03.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.595+0000 7f9094dff700 1 --2- 172.21.15.84:0/2720143074 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90900b8a60 0x7f90900ca9c0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f9084009b90 tx=0x7f9084004750 comp rx=0 tx=0).stop 2023-07-14T11:19:03.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.595+0000 7f9094dff700 1 -- 172.21.15.84:0/2720143074 shutdown_connections 2023-07-14T11:19:03.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.595+0000 7f9094dff700 1 --2- 172.21.15.84:0/2720143074 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f907006ae00 0x7f907006d2b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:03.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.595+0000 7f9094dff700 1 --2- 172.21.15.84:0/2720143074 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90900d1050 0x7f90900cc4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:03.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.595+0000 7f9094dff700 1 --2- 172.21.15.84:0/2720143074 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90900b4530 0x7f90900d0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:03.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.595+0000 7f9094dff700 1 --2- 172.21.15.84:0/2720143074 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90900b8a60 0x7f90900ca9c0 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:03.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.595+0000 7f9094dff700 1 -- 172.21.15.84:0/2720143074 >> 172.21.15.84:0/2720143074 conn(0x7f909009c1b0 msgr2=0x7f90900b39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:03.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.595+0000 7f9094dff700 1 -- 172.21.15.84:0/2720143074 shutdown_connections 2023-07-14T11:19:03.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.595+0000 7f9094dff700 1 -- 172.21.15.84:0/2720143074 wait complete. 2023-07-14T11:19:03.616 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T11:19:03.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.811+0000 7f9fb55ff700 1 Processor -- start 2023-07-14T11:19:03.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.811+0000 7f9fb55ff700 1 -- start start 2023-07-14T11:19:03.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.812+0000 7f9fb55ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fb00d0b10 0x7f9fb00d0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:03.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.812+0000 7f9fb55ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9fb00b0e20 0x7f9fb00b12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:03.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.812+0000 7f9fb55ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fb00d14a0 con 0x7f9fb00b8a60 2023-07-14T11:19:03.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.812+0000 7f9fb55ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fb00b8e30 con 0x7f9fb00b0e20 2023-07-14T11:19:03.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.812+0000 7f9fb55ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb00afaa0 con 0x7f9fb00d0b10 2023-07-14T11:19:03.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.813+0000 7f9faf7fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9fb00b0e20 0x7f9fb00b12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:03.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.813+0000 7f9fae7fc700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fb00d0b10 0x7f9fb00d0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:03.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.813+0000 7f9faf7fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9fb00b0e20 0x7f9fb00b12a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.84:34860/0 (socket says 172.21.15.84:34860) 2023-07-14T11:19:03.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.813+0000 7f9faf7fe700 1 -- 172.21.15.84:0/772516716 learned_addr learned my addr 172.21.15.84:0/772516716 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:03.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.813+0000 7f9faf7fe700 1 -- 172.21.15.84:0/772516716 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fb00d0b10 msgr2=0x7f9fb00d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:03.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.813+0000 7f9faf7fe700 1 --2- 172.21.15.84:0/772516716 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fb00d0b10 0x7f9fb00d0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:03.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.813+0000 7f9faf7fe700 1 -- 172.21.15.84:0/772516716 >> v1:172.21.15.179:6789/0 conn(0x7f9fb00b8a60 legacy=0x7f9fb00b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:03.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.813+0000 7f9faf7fe700 1 -- 172.21.15.84:0/772516716 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fb00afd80 con 0x7f9fb00b0e20 2023-07-14T11:19:03.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.813+0000 7f9fadffb700 1 -- 172.21.15.84:0/772516716 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3784573761 0 0) 0x7f9fa0001110 con 0x7f9fb00b8a60 2023-07-14T11:19:03.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.813+0000 7f9fae7fc700 1 --2- 172.21.15.84:0/772516716 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fb00d0b10 0x7f9fb00d0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:19:03.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.814+0000 7f9faf7fe700 1 --2- 172.21.15.84:0/772516716 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fb00b0e20 0x7f9fb00b12a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f9fa8009e50 tx=0x7f9fa800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41e294c97da368ed server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:03.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.814+0000 7f9fadffb700 1 -- 172.21.15.84:0/772516716 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa800e070 con 0x7f9fb00b0e20 2023-07-14T11:19:03.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.814+0000 7f9fadffb700 1 -- 172.21.15.84:0/772516716 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fa800b910 con 0x7f9fb00b0e20 2023-07-14T11:19:03.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.814+0000 7f9fadffb700 1 -- 172.21.15.84:0/772516716 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa800bcc0 con 0x7f9fb00b0e20 2023-07-14T11:19:03.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.814+0000 7f9fb55ff700 1 -- 172.21.15.84:0/772516716 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fb00b0e20 msgr2=0x7f9fb00b12a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:03.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.814+0000 7f9fb55ff700 1 --2- 172.21.15.84:0/772516716 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fb00b0e20 0x7f9fb00b12a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f9fa8009e50 tx=0x7f9fa800b330 comp rx=0 tx=0).stop 2023-07-14T11:19:03.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.814+0000 7f9fb55ff700 1 -- 172.21.15.84:0/772516716 shutdown_connections 2023-07-14T11:19:03.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.814+0000 7f9fb55ff700 1 --2- 172.21.15.84:0/772516716 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fb00b0e20 0x7f9fb00b12a0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:03.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.814+0000 7f9fb55ff700 1 --2- 172.21.15.84:0/772516716 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fb00d0b10 0x7f9fb00d0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:03.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.814+0000 7f9fb55ff700 1 -- 172.21.15.84:0/772516716 >> 172.21.15.84:0/772516716 conn(0x7f9fb009c1b0 msgr2=0x7f9fb00d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:03.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.815+0000 7f9fb55ff700 1 -- 172.21.15.84:0/772516716 shutdown_connections 2023-07-14T11:19:03.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.815+0000 7f9fb55ff700 1 -- 172.21.15.84:0/772516716 wait complete. 2023-07-14T11:19:03.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.816+0000 7f9fb55ff700 1 Processor -- start 2023-07-14T11:19:03.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.816+0000 7f9fb55ff700 1 -- start start 2023-07-14T11:19:03.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.817+0000 7f9fb55ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fb00b0e20 0x7f9fb01f2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:03.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.817+0000 7f9fb55ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9fb00b8a60 0x7f9fb015f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:03.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.817+0000 7f9fb55ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fb00d0b10 0x7f9fb00ca730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:03.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.817+0000 7f9fb55ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb015fde0 con 0x7f9fb00b8a60 2023-07-14T11:19:03.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.817+0000 7f9fb55ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb00cbca0 con 0x7f9fb00b0e20 2023-07-14T11:19:03.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.817+0000 7f9fb55ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb00cbf80 con 0x7f9fb00d0b10 2023-07-14T11:19:03.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.818+0000 7f9fae7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9fb00b8a60 0x7f9fb015f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:03.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.818+0000 7f9fae7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9fb00b8a60 0x7f9fb015f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39128/0 (socket says 172.21.15.84:39128) 2023-07-14T11:19:03.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.818+0000 7f9fae7fc700 1 -- 172.21.15.84:0/2778373715 learned_addr learned my addr 172.21.15.84:0/2778373715 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:03.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.818+0000 7f9faeffd700 1 --2- 172.21.15.84:0/2778373715 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fb00b0e20 0x7f9fb01f2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:03.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.818+0000 7f9faf7fe700 1 --2- 172.21.15.84:0/2778373715 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fb00d0b10 0x7f9fb00ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:03.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.818+0000 7f9fae7fc700 1 -- 172.21.15.84:0/2778373715 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fb00d0b10 msgr2=0x7f9fb00ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:03.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.818+0000 7f9fae7fc700 1 --2- 172.21.15.84:0/2778373715 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fb00d0b10 0x7f9fb00ca730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:03.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.818+0000 7f9fae7fc700 1 -- 172.21.15.84:0/2778373715 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fb00b0e20 msgr2=0x7f9fb01f2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:03.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.818+0000 7f9fae7fc700 1 --2- 172.21.15.84:0/2778373715 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fb00b0e20 0x7f9fb01f2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:03.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.818+0000 7f9fae7fc700 1 -- 172.21.15.84:0/2778373715 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa40094a0 con 0x7f9fb00b8a60 2023-07-14T11:19:03.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.818+0000 7f9fae7fc700 1 --2- 172.21.15.84:0/2778373715 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9fb00b8a60 0x7f9fb015f700 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f9fa400ebe0 tx=0x7f9fa400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:03.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.818+0000 7f9f977fe700 1 -- 172.21.15.84:0/2778373715 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa4009760 con 0x7f9fb00b8a60 2023-07-14T11:19:03.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.818+0000 7f9f977fe700 1 -- 172.21.15.84:0/2778373715 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fa400c850 con 0x7f9fb00b8a60 2023-07-14T11:19:03.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.818+0000 7f9f977fe700 1 -- 172.21.15.84:0/2778373715 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa400cbe0 con 0x7f9fb00b8a60 2023-07-14T11:19:03.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.818+0000 7f9fb55ff700 1 -- 172.21.15.84:0/2778373715 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fa8009b30 con 0x7f9fb00b8a60 2023-07-14T11:19:03.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.819+0000 7f9fb55ff700 1 -- 172.21.15.84:0/2778373715 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fb00cc540 con 0x7f9fb00b8a60 2023-07-14T11:19:03.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.820+0000 7f9fb55ff700 1 -- 172.21.15.84:0/2778373715 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fb0074350 con 0x7f9fb00b8a60 2023-07-14T11:19:03.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.821+0000 7f9f977fe700 1 -- 172.21.15.84:0/2778373715 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f9fa400cd40 con 0x7f9fb00b8a60 2023-07-14T11:19:03.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.822+0000 7f9f977fe700 1 --2- 172.21.15.84:0/2778373715 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f9f9c06ae00 0x7f9f9c06d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:03.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.822+0000 7f9f977fe700 1 -- 172.21.15.84:0/2778373715 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f9fa40896a0 con 0x7f9fb00b8a60 2023-07-14T11:19:03.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.822+0000 7f9faeffd700 1 --2- 172.21.15.84:0/2778373715 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f9f9c06ae00 0x7f9f9c06d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:03.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.823+0000 7f9faeffd700 1 --2- 172.21.15.84:0/2778373715 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f9f9c06ae00 0x7f9f9c06d2b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9fa0000f60 tx=0x7f9fa0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:03.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:03.826+0000 7f9f977fe700 1 -- 172.21.15.84:0/2778373715 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f9fa40545e0 con 0x7f9fb00b8a60 2023-07-14T11:19:04.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.022+0000 7f9fb55ff700 1 -- 172.21.15.84:0/2778373715 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9fb00cd160 con 0x7f9fb00b8a60 2023-07-14T11:19:04.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.023+0000 7f9f977fe700 1 -- 172.21.15.84:0/2778373715 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v95) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9fa4057c00 con 0x7f9fb00b8a60 2023-07-14T11:19:04.025 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-07-14T11:19:04.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.025+0000 7f9fb55ff700 1 -- 172.21.15.84:0/2778373715 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f9f9c06ae00 msgr2=0x7f9f9c06d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:04.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.025+0000 7f9fb55ff700 1 --2- 172.21.15.84:0/2778373715 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f9f9c06ae00 0x7f9f9c06d2b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9fa0000f60 tx=0x7f9fa0009040 comp rx=0 tx=0).stop 2023-07-14T11:19:04.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.025+0000 7f9fb55ff700 1 -- 172.21.15.84:0/2778373715 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9fb00b8a60 msgr2=0x7f9fb015f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:04.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.025+0000 7f9fb55ff700 1 --2- 172.21.15.84:0/2778373715 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9fb00b8a60 0x7f9fb015f700 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f9fa400ebe0 tx=0x7f9fa400eef0 comp rx=0 tx=0).stop 2023-07-14T11:19:04.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.025+0000 7f9fb55ff700 1 -- 172.21.15.84:0/2778373715 shutdown_connections 2023-07-14T11:19:04.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.025+0000 7f9fb55ff700 1 --2- 172.21.15.84:0/2778373715 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f9f9c06ae00 0x7f9f9c06d2b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:04.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.025+0000 7f9fb55ff700 1 --2- 172.21.15.84:0/2778373715 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fb00d0b10 0x7f9fb00ca730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:04.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.025+0000 7f9fb55ff700 1 --2- 172.21.15.84:0/2778373715 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fb00b0e20 0x7f9fb01f2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:04.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.025+0000 7f9fb55ff700 1 --2- 172.21.15.84:0/2778373715 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9fb00b8a60 0x7f9fb015f700 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:04.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.025+0000 7f9fb55ff700 1 -- 172.21.15.84:0/2778373715 >> 172.21.15.84:0/2778373715 conn(0x7f9fb009c1b0 msgr2=0x7f9fb00b25b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:04.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.025+0000 7f9fb55ff700 1 -- 172.21.15.84:0/2778373715 shutdown_connections 2023-07-14T11:19:04.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.025+0000 7f9fb55ff700 1 -- 172.21.15.84:0/2778373715 wait complete. 2023-07-14T11:19:04.045 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-14T11:19:04.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.238+0000 7f042dfff700 1 Processor -- start 2023-07-14T11:19:04.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.238+0000 7f042dfff700 1 -- start start 2023-07-14T11:19:04.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.239+0000 7f042dfff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f04280d0f90 0x7f04280b1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:04.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.239+0000 7f042dfff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04280b8e30 con 0x7f04280b8a60 2023-07-14T11:19:04.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.239+0000 7f042dfff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04280afaa0 con 0x7f04280d0b10 2023-07-14T11:19:04.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.239+0000 7f042dfff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04280afd80 con 0x7f04280d0f90 2023-07-14T11:19:04.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.240+0000 7f04277fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f04280b8a60 0x7f04280b3ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52144/0 (socket says 172.21.15.84:52144) 2023-07-14T11:19:04.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.240+0000 7f04277fe700 1 -- 172.21.15.84:0/1885132775 learned_addr learned my addr 172.21.15.84:0/1885132775 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:19:04.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.240+0000 7f0427fff700 1 --2- 172.21.15.84:0/1885132775 >> v2:172.21.15.179:3300/0 conn(0x7f04280d0f90 0x7f04280b1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:04.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.240+0000 7f04267fc700 1 -- 172.21.15.84:0/1885132775 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1257108995 0 0) 0x7f04280b8e30 con 0x7f04280b8a60 2023-07-14T11:19:04.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.240+0000 7f04267fc700 1 -- 172.21.15.84:0/1885132775 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04100035b0 con 0x7f04280b8a60 2023-07-14T11:19:04.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.240+0000 7f04267fc700 1 -- 172.21.15.84:0/1885132775 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1424129505 0 0) 0x7f04100035b0 con 0x7f04280b8a60 2023-07-14T11:19:04.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.240+0000 7f04267fc700 1 -- 172.21.15.84:0/1885132775 >> v2:172.21.15.179:3300/0 conn(0x7f04280d0f90 msgr2=0x7f04280b1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:04.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.240+0000 7f04267fc700 1 --2- 172.21.15.84:0/1885132775 >> v2:172.21.15.179:3300/0 conn(0x7f04280d0f90 0x7f04280b1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:04.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.240+0000 7f04267fc700 1 -- 172.21.15.84:0/1885132775 >> v1:172.21.15.179:6789/0 conn(0x7f04280d0b10 legacy=0x7f04280b0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:04.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.240+0000 7f04267fc700 1 -- 172.21.15.84:0/1885132775 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04280b0060 con 0x7f04280b8a60 2023-07-14T11:19:04.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.240+0000 7f04267fc700 1 -- 172.21.15.84:0/1885132775 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7f0418001670 con 0x7f04280b8a60 2023-07-14T11:19:04.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.240+0000 7f04267fc700 1 -- 172.21.15.84:0/1885132775 >> v1:172.21.15.84:6789/0 conn(0x7f04280b8a60 legacy=0x7f04280b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:04.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.240+0000 7f04267fc700 1 --2- 172.21.15.84:0/1885132775 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0410003a00 0x7f0410003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:04.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.240+0000 7f04267fc700 1 --2- 172.21.15.84:0/1885132775 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0410004850 0x7f0410004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:04.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.240+0000 7f04267fc700 1 --2- 172.21.15.84:0/1885132775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0410005200 0x7f041000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:04.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.241+0000 7f04267fc700 1 -- 172.21.15.84:0/1885132775 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04280afd80 con 0x7f0410005200 2023-07-14T11:19:04.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.241+0000 7f04267fc700 1 -- 172.21.15.84:0/1885132775 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f041000c060 con 0x7f0410004850 2023-07-14T11:19:04.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.241+0000 7f04267fc700 1 -- 172.21.15.84:0/1885132775 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f041000c220 con 0x7f0410003a00 2023-07-14T11:19:04.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.241+0000 7f0427fff700 1 --2- 172.21.15.84:0/1885132775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0410005200 0x7f041000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:04.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.241+0000 7f04277fe700 1 --2- 172.21.15.84:0/1885132775 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0410003a00 0x7f0410003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:04.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.241+0000 7f0426ffd700 1 --2- 172.21.15.84:0/1885132775 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0410004850 0x7f0410004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:04.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.241+0000 7f0427fff700 1 -- 172.21.15.84:0/1885132775 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0410003a00 msgr2=0x7f0410003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:04.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.241+0000 7f0427fff700 1 --2- 172.21.15.84:0/1885132775 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0410003a00 0x7f0410003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:04.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.241+0000 7f0427fff700 1 -- 172.21.15.84:0/1885132775 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0410004850 msgr2=0x7f0410004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:04.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.241+0000 7f0427fff700 1 --2- 172.21.15.84:0/1885132775 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0410004850 0x7f0410004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:04.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.241+0000 7f0427fff700 1 -- 172.21.15.84:0/1885132775 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04100035b0 con 0x7f0410005200 2023-07-14T11:19:04.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.241+0000 7f0426ffd700 1 --2- 172.21.15.84:0/1885132775 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0410004850 0x7f0410004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:19:04.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.241+0000 7f0427fff700 1 -- 172.21.15.84:0/1885132775 reap_dead start 2023-07-14T11:19:04.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.241+0000 7f0427fff700 1 --2- 172.21.15.84:0/1885132775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0410005200 0x7f041000ba10 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f0420009fc0 tx=0x7f0410005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edf131a73424957a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:04.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.242+0000 7f04267fc700 1 -- 172.21.15.84:0/1885132775 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0420003a20 con 0x7f0410005200 2023-07-14T11:19:04.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.242+0000 7f04267fc700 1 -- 172.21.15.84:0/1885132775 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f042000f040 con 0x7f0410005200 2023-07-14T11:19:04.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.242+0000 7f04267fc700 1 -- 172.21.15.84:0/1885132775 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0420003da0 con 0x7f0410005200 2023-07-14T11:19:04.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.242+0000 7f042dfff700 1 -- 172.21.15.84:0/1885132775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0410005200 msgr2=0x7f041000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:04.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.242+0000 7f042dfff700 1 --2- 172.21.15.84:0/1885132775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0410005200 0x7f041000ba10 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f0420009fc0 tx=0x7f0410005880 comp rx=0 tx=0).stop 2023-07-14T11:19:04.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.242+0000 7f042dfff700 1 -- 172.21.15.84:0/1885132775 shutdown_connections 2023-07-14T11:19:04.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.242+0000 7f042dfff700 1 --2- 172.21.15.84:0/1885132775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0410005200 0x7f041000ba10 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:04.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.242+0000 7f042dfff700 1 -- 172.21.15.84:0/1885132775 >> 172.21.15.84:0/1885132775 conn(0x7f042809c1b0 msgr2=0x7f04280d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:04.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.242+0000 7f042dfff700 1 -- 172.21.15.84:0/1885132775 shutdown_connections 2023-07-14T11:19:04.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.242+0000 7f042dfff700 1 -- 172.21.15.84:0/1885132775 wait complete. 2023-07-14T11:19:04.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.244+0000 7f042dfff700 1 Processor -- start 2023-07-14T11:19:04.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.244+0000 7f042dfff700 1 -- start start 2023-07-14T11:19:04.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.245+0000 7f042dfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0410005200 0x7f042815f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:04.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.245+0000 7f042dfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04281f68d0 0x7f0428151ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:04.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.245+0000 7f042dfff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04281f5c50 0x7f04281f60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:04.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.245+0000 7f042dfff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04281f65e0 con 0x7f04281f68d0 2023-07-14T11:19:04.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.245+0000 7f042dfff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04280caa20 con 0x7f04281f5c50 2023-07-14T11:19:04.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.245+0000 7f042dfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f042815e720 con 0x7f0410005200 2023-07-14T11:19:04.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.245+0000 7f0426ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04281f68d0 0x7f0428151ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:04.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.245+0000 7f0426ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04281f68d0 0x7f0428151ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39144/0 (socket says 172.21.15.84:39144) 2023-07-14T11:19:04.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.245+0000 7f0426ffd700 1 -- 172.21.15.84:0/4214470419 learned_addr learned my addr 172.21.15.84:0/4214470419 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:04.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.245+0000 7f04277fe700 1 --2- 172.21.15.84:0/4214470419 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0410005200 0x7f042815f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:04.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.246+0000 7f0427fff700 1 --2- 172.21.15.84:0/4214470419 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04281f5c50 0x7f04281f60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:04.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.246+0000 7f0426ffd700 1 -- 172.21.15.84:0/4214470419 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0410005200 msgr2=0x7f042815f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:04.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.246+0000 7f0426ffd700 1 --2- 172.21.15.84:0/4214470419 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0410005200 0x7f042815f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:04.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.246+0000 7f0426ffd700 1 -- 172.21.15.84:0/4214470419 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04281f5c50 msgr2=0x7f04281f60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:04.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.246+0000 7f0426ffd700 1 --2- 172.21.15.84:0/4214470419 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04281f5c50 0x7f04281f60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:04.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.246+0000 7f0426ffd700 1 -- 172.21.15.84:0/4214470419 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04280cac70 con 0x7f04281f68d0 2023-07-14T11:19:04.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.246+0000 7f0426ffd700 1 --2- 172.21.15.84:0/4214470419 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04281f68d0 0x7f0428151ae0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f041c00e5a0 tx=0x7f041c00e8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:04.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.246+0000 7f040ffff700 1 -- 172.21.15.84:0/4214470419 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041c0052e0 con 0x7f04281f68d0 2023-07-14T11:19:04.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.246+0000 7f040ffff700 1 -- 172.21.15.84:0/4214470419 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f041c005440 con 0x7f04281f68d0 2023-07-14T11:19:04.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.246+0000 7f040ffff700 1 -- 172.21.15.84:0/4214470419 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041c0038a0 con 0x7f04281f68d0 2023-07-14T11:19:04.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.246+0000 7f042dfff700 1 -- 172.21.15.84:0/4214470419 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04280caf50 con 0x7f04281f68d0 2023-07-14T11:19:04.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.246+0000 7f042dfff700 1 -- 172.21.15.84:0/4214470419 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04280ceb90 con 0x7f04281f68d0 2023-07-14T11:19:04.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.247+0000 7f042dfff700 1 -- 172.21.15.84:0/4214470419 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0428074350 con 0x7f04281f68d0 2023-07-14T11:19:04.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.248+0000 7f040ffff700 1 -- 172.21.15.84:0/4214470419 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f041c003a00 con 0x7f04281f68d0 2023-07-14T11:19:04.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.249+0000 7f040ffff700 1 --2- 172.21.15.84:0/4214470419 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f041406ae30 0x7f041406d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:04.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.249+0000 7f040ffff700 1 -- 172.21.15.84:0/4214470419 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f041c088a90 con 0x7f04281f68d0 2023-07-14T11:19:04.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.250+0000 7f04277fe700 1 --2- 172.21.15.84:0/4214470419 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f041406ae30 0x7f041406d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:04.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.250+0000 7f04277fe700 1 --2- 172.21.15.84:0/4214470419 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f041406ae30 0x7f041406d2e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0418001c90 tx=0x7f0418000ed0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:04.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.253+0000 7f040ffff700 1 -- 172.21.15.84:0/4214470419 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f041c053930 con 0x7f04281f68d0 2023-07-14T11:19:04.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.463+0000 7f042dfff700 1 -- 172.21.15.84:0/4214470419 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f04280c9600 con 0x7f04281f68d0 2023-07-14T11:19:04.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.463+0000 7f040ffff700 1 -- 172.21.15.84:0/4214470419 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v95) v1 ==== 80+0+124 (secure 0 0 0) 0x7f041c019080 con 0x7f04281f68d0 2023-07-14T11:19:04.466 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.179:6834/4019917691 2023-07-15T11:18:58.463254+0000 2023-07-14T11:19:04.466 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.179:6833/4019917691 2023-07-15T11:18:58.463254+0000 2023-07-14T11:19:04.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.465+0000 7f042dfff700 1 -- 172.21.15.84:0/4214470419 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f041406ae30 msgr2=0x7f041406d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:04.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.465+0000 7f042dfff700 1 --2- 172.21.15.84:0/4214470419 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f041406ae30 0x7f041406d2e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0418001c90 tx=0x7f0418000ed0 comp rx=0 tx=0).stop 2023-07-14T11:19:04.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.465+0000 7f042dfff700 1 -- 172.21.15.84:0/4214470419 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04281f68d0 msgr2=0x7f0428151ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:04.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.465+0000 7f042dfff700 1 --2- 172.21.15.84:0/4214470419 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04281f68d0 0x7f0428151ae0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f041c00e5a0 tx=0x7f041c00e8b0 comp rx=0 tx=0).stop 2023-07-14T11:19:04.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.465+0000 7f042dfff700 1 -- 172.21.15.84:0/4214470419 shutdown_connections 2023-07-14T11:19:04.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.465+0000 7f042dfff700 1 --2- 172.21.15.84:0/4214470419 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f041406ae30 0x7f041406d2e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:04.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.465+0000 7f042dfff700 1 --2- 172.21.15.84:0/4214470419 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0410005200 0x7f042815f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:04.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.465+0000 7f042dfff700 1 --2- 172.21.15.84:0/4214470419 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04281f5c50 0x7f04281f60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:04.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.465+0000 7f042dfff700 1 --2- 172.21.15.84:0/4214470419 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04281f68d0 0x7f0428151ae0 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:04.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.465+0000 7f042dfff700 1 -- 172.21.15.84:0/4214470419 >> 172.21.15.84:0/4214470419 conn(0x7f042809c1b0 msgr2=0x7f04280d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:04.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.466+0000 7f042dfff700 1 -- 172.21.15.84:0/4214470419 shutdown_connections 2023-07-14T11:19:04.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.466+0000 7f042dfff700 1 -- 172.21.15.84:0/4214470419 wait complete. 2023-07-14T11:19:04.470 INFO:teuthology.orchestra.run.smithi084.stderr:listed 2 entries 2023-07-14T11:19:04.486 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-14T11:19:04.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:19:04.486 DEBUG:teuthology.orchestra.run.smithi084:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-14T11:19:04.585 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi084.front.sepia.ceph.com 2023-07-14T11:19:04.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:19:04.585 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-14T11:19:04.632 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-07-14T11:19:04.632 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:19:04.682 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-07-14T11:19:04.683 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:19:04.730 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:19:04.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.923+0000 7f4dfb3ff700 1 Processor -- start 2023-07-14T11:19:04.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.924+0000 7f4dfb3ff700 1 -- start start 2023-07-14T11:19:04.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.925+0000 7f4dfb3ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4df415c950 0x7f4df40b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:04.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.925+0000 7f4dfb3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4df40d1220 0x7f4df40afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:04.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.925+0000 7f4dfb3ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4df40d2ce0 con 0x7f4df40b1e00 2023-07-14T11:19:04.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.925+0000 7f4dfb3ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4df40b3350 con 0x7f4df415c950 2023-07-14T11:19:04.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.925+0000 7f4dfb3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4df40b3630 con 0x7f4df40d1220 2023-07-14T11:19:04.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.925+0000 7f4df919b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4df415c950 0x7f4df40b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:04.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.925+0000 7f4df999c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4df40d1220 0x7f4df40afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:04.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.925+0000 7f4df919b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4df415c950 0x7f4df40b43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.84:34892/0 (socket says 172.21.15.84:34892) 2023-07-14T11:19:04.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.925+0000 7f4df999c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4df40d1220 0x7f4df40afac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.84:40106/0 (socket says 172.21.15.84:40106) 2023-07-14T11:19:04.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.925+0000 7f4df919b700 1 -- 172.21.15.84:0/3579449145 learned_addr learned my addr 172.21.15.84:0/3579449145 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:04.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.925+0000 7f4df899a700 1 --1- 172.21.15.84:0/3579449145 >> v1:172.21.15.179:6789/0 conn(0x7f4df40b1e00 0x7f4df40d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.84:49332/0 (socket says 172.21.15.84:49332) 2023-07-14T11:19:04.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.926+0000 7f4debfff700 1 -- 172.21.15.84:0/3579449145 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4231062135 0 0) 0x7f4df40d2ce0 con 0x7f4df40b1e00 2023-07-14T11:19:04.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.926+0000 7f4debfff700 1 -- 172.21.15.84:0/3579449145 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4de00035b0 con 0x7f4df40b1e00 2023-07-14T11:19:04.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.926+0000 7f4df999c700 1 -- 172.21.15.84:0/3579449145 >> v2:172.21.15.179:3300/0 conn(0x7f4df415c950 msgr2=0x7f4df40b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:04.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.926+0000 7f4df999c700 1 --2- 172.21.15.84:0/3579449145 >> v2:172.21.15.179:3300/0 conn(0x7f4df415c950 0x7f4df40b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:04.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.926+0000 7f4df999c700 1 -- 172.21.15.84:0/3579449145 >> v1:172.21.15.179:6789/0 conn(0x7f4df40b1e00 legacy=0x7f4df40d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:04.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.926+0000 7f4df999c700 1 -- 172.21.15.84:0/3579449145 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4df40b3910 con 0x7f4df40d1220 2023-07-14T11:19:04.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.926+0000 7f4df919b700 1 --2- 172.21.15.84:0/3579449145 >> v2:172.21.15.179:3300/0 conn(0x7f4df415c950 0x7f4df40b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:19:04.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.926+0000 7f4df999c700 1 --2- 172.21.15.84:0/3579449145 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4df40d1220 0x7f4df40afac0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4dec009d90 tx=0x7f4dec00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd5bf3df4a653d1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:04.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.926+0000 7f4debfff700 1 -- 172.21.15.84:0/3579449145 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dec00e070 con 0x7f4df40d1220 2023-07-14T11:19:04.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.926+0000 7f4debfff700 1 -- 172.21.15.84:0/3579449145 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dec00bb20 con 0x7f4df40d1220 2023-07-14T11:19:04.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.926+0000 7f4debfff700 1 -- 172.21.15.84:0/3579449145 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dec012430 con 0x7f4df40d1220 2023-07-14T11:19:04.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.927+0000 7f4dfb3ff700 1 -- 172.21.15.84:0/3579449145 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4df40d1220 msgr2=0x7f4df40afac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:04.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.927+0000 7f4dfb3ff700 1 --2- 172.21.15.84:0/3579449145 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4df40d1220 0x7f4df40afac0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4dec009d90 tx=0x7f4dec00b330 comp rx=0 tx=0).stop 2023-07-14T11:19:04.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.927+0000 7f4dfb3ff700 1 -- 172.21.15.84:0/3579449145 shutdown_connections 2023-07-14T11:19:04.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.927+0000 7f4dfb3ff700 1 --2- 172.21.15.84:0/3579449145 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4df40d1220 0x7f4df40afac0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:04.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.927+0000 7f4dfb3ff700 1 --2- 172.21.15.84:0/3579449145 >> v2:172.21.15.179:3300/0 conn(0x7f4df415c950 0x7f4df40b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:04.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.927+0000 7f4dfb3ff700 1 -- 172.21.15.84:0/3579449145 >> 172.21.15.84:0/3579449145 conn(0x7f4df409c1d0 msgr2=0x7f4df40d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:04.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.927+0000 7f4dfb3ff700 1 -- 172.21.15.84:0/3579449145 shutdown_connections 2023-07-14T11:19:04.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.927+0000 7f4dfb3ff700 1 -- 172.21.15.84:0/3579449145 wait complete. 2023-07-14T11:19:04.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.929+0000 7f4dfb3ff700 1 Processor -- start 2023-07-14T11:19:04.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.929+0000 7f4dfb3ff700 1 -- start start 2023-07-14T11:19:04.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.930+0000 7f4dfb3ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4df40b1e00 0x7f4df40c9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:04.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.930+0000 7f4dfb3ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4df40d1220 0x7f4df41f14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:04.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.930+0000 7f4dfb3ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4df415c950 0x7f4df40b8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:04.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.930+0000 7f4dfb3ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df4146000 con 0x7f4df40d1220 2023-07-14T11:19:04.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.930+0000 7f4dfb3ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df41462a0 con 0x7f4df40b1e00 2023-07-14T11:19:04.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.930+0000 7f4dfb3ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4df4146580 con 0x7f4df415c950 2023-07-14T11:19:04.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.930+0000 7f4df899a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4df40d1220 0x7f4df41f14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:04.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.930+0000 7f4df899a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4df40d1220 0x7f4df41f14f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39152/0 (socket says 172.21.15.84:39152) 2023-07-14T11:19:04.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.930+0000 7f4df899a700 1 -- 172.21.15.84:0/1954181567 learned_addr learned my addr 172.21.15.84:0/1954181567 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:04.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.930+0000 7f4df919b700 1 --2- 172.21.15.84:0/1954181567 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4df40b1e00 0x7f4df40c9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:04.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.930+0000 7f4df999c700 1 --2- 172.21.15.84:0/1954181567 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4df415c950 0x7f4df40b8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:04.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.931+0000 7f4df899a700 1 -- 172.21.15.84:0/1954181567 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4df415c950 msgr2=0x7f4df40b8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:04.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.931+0000 7f4df899a700 1 --2- 172.21.15.84:0/1954181567 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4df415c950 0x7f4df40b8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:04.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.931+0000 7f4df899a700 1 -- 172.21.15.84:0/1954181567 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4df40b1e00 msgr2=0x7f4df40c9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:04.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.931+0000 7f4df899a700 1 --2- 172.21.15.84:0/1954181567 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4df40b1e00 0x7f4df40c9460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:04.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.931+0000 7f4df899a700 1 -- 172.21.15.84:0/1954181567 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4df0009500 con 0x7f4df40d1220 2023-07-14T11:19:04.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.931+0000 7f4df999c700 1 --2- 172.21.15.84:0/1954181567 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4df415c950 0x7f4df40b8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:19:04.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.931+0000 7f4df899a700 1 --2- 172.21.15.84:0/1954181567 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4df40d1220 0x7f4df41f14f0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f4de400c700 tx=0x7f4de400cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:04.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.931+0000 7f4de9ffb700 1 -- 172.21.15.84:0/1954181567 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de4005cb0 con 0x7f4df40d1220 2023-07-14T11:19:04.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.931+0000 7f4de9ffb700 1 -- 172.21.15.84:0/1954181567 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4de4005e10 con 0x7f4df40d1220 2023-07-14T11:19:04.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.931+0000 7f4de9ffb700 1 -- 172.21.15.84:0/1954181567 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de40072d0 con 0x7f4df40d1220 2023-07-14T11:19:04.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.931+0000 7f4dfb3ff700 1 -- 172.21.15.84:0/1954181567 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dec009a70 con 0x7f4df40d1220 2023-07-14T11:19:04.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.931+0000 7f4dfb3ff700 1 -- 172.21.15.84:0/1954181567 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4df4146b40 con 0x7f4df40d1220 2023-07-14T11:19:04.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.932+0000 7f4dfb3ff700 1 -- 172.21.15.84:0/1954181567 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4df40afb30 con 0x7f4df40d1220 2023-07-14T11:19:04.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.934+0000 7f4de9ffb700 1 -- 172.21.15.84:0/1954181567 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f4de4007430 con 0x7f4df40d1220 2023-07-14T11:19:04.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.935+0000 7f4de9ffb700 1 --2- 172.21.15.84:0/1954181567 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f4dd806ae00 0x7f4dd806d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:04.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.935+0000 7f4de9ffb700 1 -- 172.21.15.84:0/1954181567 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f4de40890d0 con 0x7f4df40d1220 2023-07-14T11:19:04.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.936+0000 7f4df919b700 1 --2- 172.21.15.84:0/1954181567 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f4dd806ae00 0x7f4dd806d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:04.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.936+0000 7f4df919b700 1 --2- 172.21.15.84:0/1954181567 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f4dd806ae00 0x7f4dd806d2b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4df0006fd0 tx=0x7f4df0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:04.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:04.938+0000 7f4de9ffb700 1 -- 172.21.15.84:0/1954181567 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f4de4054020 con 0x7f4df40d1220 2023-07-14T11:19:05.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.130+0000 7f4dfb3ff700 1 -- 172.21.15.84:0/1954181567 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4df404e280 con 0x7f4df40d1220 2023-07-14T11:19:05.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.131+0000 7f4de9ffb700 1 -- 172.21.15.84:0/1954181567 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+18401 (secure 0 0 0) 0x7f4de4021090 con 0x7f4df40d1220 2023-07-14T11:19:05.136 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:19:05.136 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":95,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:19:01.484069+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-07-14T11:18:40.531166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-07-14T11:18:41.475653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.179:6834/4019917691":"2023-07-15T11:18:58.463254+0000","172.21.15.179:6833/4019917691":"2023-07-15T11:18:58.463254+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:19:05.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.134+0000 7f4dfb3ff700 1 -- 172.21.15.84:0/1954181567 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f4dd806ae00 msgr2=0x7f4dd806d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:05.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.134+0000 7f4dfb3ff700 1 --2- 172.21.15.84:0/1954181567 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f4dd806ae00 0x7f4dd806d2b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4df0006fd0 tx=0x7f4df0008040 comp rx=0 tx=0).stop 2023-07-14T11:19:05.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.134+0000 7f4dfb3ff700 1 -- 172.21.15.84:0/1954181567 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4df40d1220 msgr2=0x7f4df41f14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:05.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.134+0000 7f4dfb3ff700 1 --2- 172.21.15.84:0/1954181567 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4df40d1220 0x7f4df41f14f0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f4de400c700 tx=0x7f4de400cac0 comp rx=0 tx=0).stop 2023-07-14T11:19:05.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.134+0000 7f4dfb3ff700 1 -- 172.21.15.84:0/1954181567 shutdown_connections 2023-07-14T11:19:05.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.134+0000 7f4dfb3ff700 1 --2- 172.21.15.84:0/1954181567 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f4dd806ae00 0x7f4dd806d2b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:05.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.134+0000 7f4dfb3ff700 1 --2- 172.21.15.84:0/1954181567 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4df415c950 0x7f4df40b8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:05.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.134+0000 7f4dfb3ff700 1 --2- 172.21.15.84:0/1954181567 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4df40b1e00 0x7f4df40c9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:05.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.134+0000 7f4dfb3ff700 1 --2- 172.21.15.84:0/1954181567 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4df40d1220 0x7f4df41f14f0 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:05.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.134+0000 7f4dfb3ff700 1 -- 172.21.15.84:0/1954181567 >> 172.21.15.84:0/1954181567 conn(0x7f4df409c1d0 msgr2=0x7f4df40d1640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:05.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.134+0000 7f4dfb3ff700 1 -- 172.21.15.84:0/1954181567 shutdown_connections 2023-07-14T11:19:05.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.134+0000 7f4dfb3ff700 1 -- 172.21.15.84:0/1954181567 wait complete. 2023-07-14T11:19:05.155 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T11:13:00.125395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T11:13:06.803994+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T11:18:40.531166+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T11:18:41.475653+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T11:19:05.156 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T11:19:05.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.350+0000 7f7cfb7ff700 1 Processor -- start 2023-07-14T11:19:05.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.351+0000 7f7cfb7ff700 1 -- start start 2023-07-14T11:19:05.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.352+0000 7f7cfb7ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7cf415c6c0 0x7f7cf40b2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:05.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.352+0000 7f7cfb7ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7cf406b8a0 0x7f7cf406bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:05.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.352+0000 7f7cfb7ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cf415ca90 con 0x7f7cf40afc40 2023-07-14T11:19:05.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.352+0000 7f7cfb7ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cf406b0e0 con 0x7f7cf415c6c0 2023-07-14T11:19:05.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.352+0000 7f7cfb7ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cf40d0370 con 0x7f7cf406b8a0 2023-07-14T11:19:05.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.352+0000 7f7cf959b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7cf415c6c0 0x7f7cf40b2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:05.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.352+0000 7f7cf959b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7cf415c6c0 0x7f7cf40b2630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39166/0 (socket says 172.21.15.84:39166) 2023-07-14T11:19:05.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.352+0000 7f7cf959b700 1 -- 172.21.15.84:0/371054451 learned_addr learned my addr 172.21.15.84:0/371054451 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:05.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.352+0000 7f7cf8d9a700 1 --1- 172.21.15.84:0/371054451 >> v1:172.21.15.84:6789/0 conn(0x7f7cf40afc40 0x7f7cf40b2b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52150/0 (socket says 172.21.15.84:52150) 2023-07-14T11:19:05.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.352+0000 7f7cf9d9c700 1 --2- 172.21.15.84:0/371054451 >> v2:172.21.15.179:3300/0 conn(0x7f7cf406b8a0 0x7f7cf406bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:05.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.353+0000 7f7cf959b700 1 -- 172.21.15.84:0/371054451 >> v2:172.21.15.179:3300/0 conn(0x7f7cf406b8a0 msgr2=0x7f7cf406bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:05.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.353+0000 7f7cf959b700 1 --2- 172.21.15.84:0/371054451 >> v2:172.21.15.179:3300/0 conn(0x7f7cf406b8a0 0x7f7cf406bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:05.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.353+0000 7f7cf959b700 1 -- 172.21.15.84:0/371054451 >> v1:172.21.15.84:6789/0 conn(0x7f7cf40afc40 legacy=0x7f7cf40b2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:05.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.353+0000 7f7cf959b700 1 -- 172.21.15.84:0/371054451 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf40d0650 con 0x7f7cf415c6c0 2023-07-14T11:19:05.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.353+0000 7f7cebfff700 1 -- 172.21.15.84:0/371054451 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3339449455 0 0) 0x7f7ce4001110 con 0x7f7cf40afc40 2023-07-14T11:19:05.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.353+0000 7f7cf959b700 1 --2- 172.21.15.84:0/371054451 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7cf415c6c0 0x7f7cf40b2630 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f7cf00098f0 tx=0x7f7cf0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b98578646d33060a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:05.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.353+0000 7f7cebfff700 1 -- 172.21.15.84:0/371054451 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf000b860 con 0x7f7cf415c6c0 2023-07-14T11:19:05.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.353+0000 7f7cebfff700 1 -- 172.21.15.84:0/371054451 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cf000b9c0 con 0x7f7cf415c6c0 2023-07-14T11:19:05.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.353+0000 7f7cebfff700 1 -- 172.21.15.84:0/371054451 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf000bd50 con 0x7f7cf415c6c0 2023-07-14T11:19:05.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.354+0000 7f7cfb7ff700 1 -- 172.21.15.84:0/371054451 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7cf415c6c0 msgr2=0x7f7cf40b2630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:05.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.354+0000 7f7cfb7ff700 1 --2- 172.21.15.84:0/371054451 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7cf415c6c0 0x7f7cf40b2630 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f7cf00098f0 tx=0x7f7cf0009c00 comp rx=0 tx=0).stop 2023-07-14T11:19:05.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.354+0000 7f7cfb7ff700 1 -- 172.21.15.84:0/371054451 shutdown_connections 2023-07-14T11:19:05.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.354+0000 7f7cfb7ff700 1 --2- 172.21.15.84:0/371054451 >> v2:172.21.15.179:3300/0 conn(0x7f7cf406b8a0 0x7f7cf406bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:05.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.354+0000 7f7cfb7ff700 1 --2- 172.21.15.84:0/371054451 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7cf415c6c0 0x7f7cf40b2630 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:05.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.354+0000 7f7cfb7ff700 1 -- 172.21.15.84:0/371054451 >> 172.21.15.84:0/371054451 conn(0x7f7cf406d980 msgr2=0x7f7cf406dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:05.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.354+0000 7f7cfb7ff700 1 -- 172.21.15.84:0/371054451 shutdown_connections 2023-07-14T11:19:05.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.354+0000 7f7cfb7ff700 1 -- 172.21.15.84:0/371054451 wait complete. 2023-07-14T11:19:05.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.355+0000 7f7cfb7ff700 1 Processor -- start 2023-07-14T11:19:05.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.356+0000 7f7cfb7ff700 1 -- start start 2023-07-14T11:19:05.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.356+0000 7f7cfb7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cf406b8a0 0x7f7cf40c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:05.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.356+0000 7f7cfb7ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7cf40afc40 0x7f7cf415b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:05.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.356+0000 7f7cfb7ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7cf415c6c0 0x7f7cf4154880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:05.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.356+0000 7f7cfb7ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf415ab70 con 0x7f7cf415c6c0 2023-07-14T11:19:05.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.356+0000 7f7cfb7ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf4159ad0 con 0x7f7cf40afc40 2023-07-14T11:19:05.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.356+0000 7f7cfb7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf4159db0 con 0x7f7cf406b8a0 2023-07-14T11:19:05.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.357+0000 7f7cf9d9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7cf415c6c0 0x7f7cf4154880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:05.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.357+0000 7f7cf9d9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7cf415c6c0 0x7f7cf4154880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39176/0 (socket says 172.21.15.84:39176) 2023-07-14T11:19:05.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.357+0000 7f7cf9d9c700 1 -- 172.21.15.84:0/379861911 learned_addr learned my addr 172.21.15.84:0/379861911 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:05.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.357+0000 7f7cf959b700 1 --2- 172.21.15.84:0/379861911 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cf406b8a0 0x7f7cf40c7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:05.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.357+0000 7f7cf8d9a700 1 --2- 172.21.15.84:0/379861911 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7cf40afc40 0x7f7cf415b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:05.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.357+0000 7f7cf9d9c700 1 -- 172.21.15.84:0/379861911 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cf406b8a0 msgr2=0x7f7cf40c7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:05.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.357+0000 7f7cf9d9c700 1 --2- 172.21.15.84:0/379861911 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cf406b8a0 0x7f7cf40c7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:05.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.357+0000 7f7cf9d9c700 1 -- 172.21.15.84:0/379861911 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7cf40afc40 msgr2=0x7f7cf415b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:05.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.357+0000 7f7cf9d9c700 1 --2- 172.21.15.84:0/379861911 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7cf40afc40 0x7f7cf415b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:05.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.357+0000 7f7cf9d9c700 1 -- 172.21.15.84:0/379861911 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf0009550 con 0x7f7cf415c6c0 2023-07-14T11:19:05.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.357+0000 7f7cf9d9c700 1 --2- 172.21.15.84:0/379861911 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7cf415c6c0 0x7f7cf4154880 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f7cec007e60 tx=0x7f7cec00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:05.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.358+0000 7f7ce9ffb700 1 -- 172.21.15.84:0/379861911 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cec00ed30 con 0x7f7cf415c6c0 2023-07-14T11:19:05.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.358+0000 7f7ce9ffb700 1 -- 172.21.15.84:0/379861911 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cec014420 con 0x7f7cf415c6c0 2023-07-14T11:19:05.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.358+0000 7f7ce9ffb700 1 -- 172.21.15.84:0/379861911 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cec0147d0 con 0x7f7cf415c6c0 2023-07-14T11:19:05.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.358+0000 7f7cfb7ff700 1 -- 172.21.15.84:0/379861911 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cf415a090 con 0x7f7cf415c6c0 2023-07-14T11:19:05.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.358+0000 7f7cfb7ff700 1 -- 172.21.15.84:0/379861911 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cf415a650 con 0x7f7cf415c6c0 2023-07-14T11:19:05.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.359+0000 7f7cfb7ff700 1 -- 172.21.15.84:0/379861911 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cf4074350 con 0x7f7cf415c6c0 2023-07-14T11:19:05.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.360+0000 7f7ce9ffb700 1 -- 172.21.15.84:0/379861911 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f7cec014930 con 0x7f7cf415c6c0 2023-07-14T11:19:05.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.361+0000 7f7ce9ffb700 1 --2- 172.21.15.84:0/379861911 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f7cd806ae00 0x7f7cd806d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:05.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.361+0000 7f7ce9ffb700 1 -- 172.21.15.84:0/379861911 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f7cec089ca0 con 0x7f7cf415c6c0 2023-07-14T11:19:05.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.361+0000 7f7cf959b700 1 --2- 172.21.15.84:0/379861911 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f7cd806ae00 0x7f7cd806d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:05.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.362+0000 7f7cf959b700 1 --2- 172.21.15.84:0/379861911 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f7cd806ae00 0x7f7cd806d2b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0009c40 tx=0x7f7cf0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:05.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.365+0000 7f7ce9ffb700 1 -- 172.21.15.84:0/379861911 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7cec054c80 con 0x7f7cf415c6c0 2023-07-14T11:19:05.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.560+0000 7f7cfb7ff700 1 -- 172.21.15.84:0/379861911 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7cf40ce310 con 0x7f7cf415c6c0 2023-07-14T11:19:05.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.561+0000 7f7ce9ffb700 1 -- 172.21.15.84:0/379861911 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v95) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7cec0582a0 con 0x7f7cf415c6c0 2023-07-14T11:19:05.564 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-07-14T11:19:05.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.563+0000 7f7cfb7ff700 1 -- 172.21.15.84:0/379861911 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f7cd806ae00 msgr2=0x7f7cd806d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:05.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.563+0000 7f7cfb7ff700 1 --2- 172.21.15.84:0/379861911 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f7cd806ae00 0x7f7cd806d2b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0009c40 tx=0x7f7cf0008030 comp rx=0 tx=0).stop 2023-07-14T11:19:05.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.563+0000 7f7cfb7ff700 1 -- 172.21.15.84:0/379861911 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7cf415c6c0 msgr2=0x7f7cf4154880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:05.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.563+0000 7f7cfb7ff700 1 --2- 172.21.15.84:0/379861911 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7cf415c6c0 0x7f7cf4154880 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f7cec007e60 tx=0x7f7cec00e3c0 comp rx=0 tx=0).stop 2023-07-14T11:19:05.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.563+0000 7f7cfb7ff700 1 -- 172.21.15.84:0/379861911 shutdown_connections 2023-07-14T11:19:05.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.563+0000 7f7cfb7ff700 1 --2- 172.21.15.84:0/379861911 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f7cd806ae00 0x7f7cd806d2b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:05.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.563+0000 7f7cfb7ff700 1 --2- 172.21.15.84:0/379861911 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cf406b8a0 0x7f7cf40c7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:05.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.563+0000 7f7cfb7ff700 1 --2- 172.21.15.84:0/379861911 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7cf415c6c0 0x7f7cf4154880 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:05.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.563+0000 7f7cfb7ff700 1 --2- 172.21.15.84:0/379861911 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7cf40afc40 0x7f7cf415b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:05.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.563+0000 7f7cfb7ff700 1 -- 172.21.15.84:0/379861911 >> 172.21.15.84:0/379861911 conn(0x7f7cf406d980 msgr2=0x7f7cf40b1d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:05.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.563+0000 7f7cfb7ff700 1 -- 172.21.15.84:0/379861911 shutdown_connections 2023-07-14T11:19:05.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.563+0000 7f7cfb7ff700 1 -- 172.21.15.84:0/379861911 wait complete. 2023-07-14T11:19:05.583 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T11:19:05.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.778+0000 7f30437ff700 1 Processor -- start 2023-07-14T11:19:05.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.778+0000 7f30437ff700 1 -- start start 2023-07-14T11:19:05.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.779+0000 7f30437ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f303c0d0010 0x7f303c0b5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:05.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.779+0000 7f30437ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f303c0d0480 0x7f303c0b6430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:05.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.779+0000 7f30437ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f303c15cd60 con 0x7f303c0b4600 2023-07-14T11:19:05.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.779+0000 7f30437ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f303c0d1550 con 0x7f303c0d0480 2023-07-14T11:19:05.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.779+0000 7f30437ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f303c0d2d90 con 0x7f303c0d0010 2023-07-14T11:19:05.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.780+0000 7f3041d9c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f303c0d0480 0x7f303c0b6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:05.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.780+0000 7f3041d9c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f303c0d0480 0x7f303c0b6430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39182/0 (socket says 172.21.15.84:39182) 2023-07-14T11:19:05.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.780+0000 7f3041d9c700 1 -- 172.21.15.84:0/268776230 learned_addr learned my addr 172.21.15.84:0/268776230 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:05.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.780+0000 7f3040d9a700 1 --2- 172.21.15.84:0/268776230 >> v2:172.21.15.179:3300/0 conn(0x7f303c0d0010 0x7f303c0b5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:05.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.780+0000 7f3041d9c700 1 -- 172.21.15.84:0/268776230 >> v2:172.21.15.179:3300/0 conn(0x7f303c0d0010 msgr2=0x7f303c0b5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:05.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.780+0000 7f3041d9c700 1 --2- 172.21.15.84:0/268776230 >> v2:172.21.15.179:3300/0 conn(0x7f303c0d0010 0x7f303c0b5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:05.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.780+0000 7f3041d9c700 1 -- 172.21.15.84:0/268776230 >> v1:172.21.15.179:6789/0 conn(0x7f303c0b4600 legacy=0x7f303c0cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:05.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.780+0000 7f3041d9c700 1 -- 172.21.15.84:0/268776230 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f303c0cf340 con 0x7f303c0d0480 2023-07-14T11:19:05.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.780+0000 7f3040d9a700 1 --2- 172.21.15.84:0/268776230 >> v2:172.21.15.179:3300/0 conn(0x7f303c0d0010 0x7f303c0b5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:19:05.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.780+0000 7f3041d9c700 1 --2- 172.21.15.84:0/268776230 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f303c0d0480 0x7f303c0b6430 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f303c08bdb0 tx=0x7f303400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a078c73f30e18701 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:05.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.781+0000 7f3033fff700 1 -- 172.21.15.84:0/268776230 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303400e070 con 0x7f303c0d0480 2023-07-14T11:19:05.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.781+0000 7f3033fff700 1 -- 172.21.15.84:0/268776230 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3034003a20 con 0x7f303c0d0480 2023-07-14T11:19:05.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.781+0000 7f3033fff700 1 -- 172.21.15.84:0/268776230 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3034003dd0 con 0x7f303c0d0480 2023-07-14T11:19:05.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.781+0000 7f30437ff700 1 -- 172.21.15.84:0/268776230 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f303c0d0480 msgr2=0x7f303c0b6430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:05.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.781+0000 7f30437ff700 1 --2- 172.21.15.84:0/268776230 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f303c0d0480 0x7f303c0b6430 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f303c08bdb0 tx=0x7f303400b330 comp rx=0 tx=0).stop 2023-07-14T11:19:05.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.781+0000 7f30437ff700 1 -- 172.21.15.84:0/268776230 shutdown_connections 2023-07-14T11:19:05.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.781+0000 7f30437ff700 1 --2- 172.21.15.84:0/268776230 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f303c0d0480 0x7f303c0b6430 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:05.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.781+0000 7f30437ff700 1 --2- 172.21.15.84:0/268776230 >> v2:172.21.15.179:3300/0 conn(0x7f303c0d0010 0x7f303c0b5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:05.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.781+0000 7f30437ff700 1 -- 172.21.15.84:0/268776230 >> 172.21.15.84:0/268776230 conn(0x7f303c09c200 msgr2=0x7f303c0d2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:05.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.781+0000 7f30437ff700 1 -- 172.21.15.84:0/268776230 shutdown_connections 2023-07-14T11:19:05.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.781+0000 7f30437ff700 1 -- 172.21.15.84:0/268776230 wait complete. 2023-07-14T11:19:05.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.783+0000 7f30437ff700 1 Processor -- start 2023-07-14T11:19:05.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.783+0000 7f30437ff700 1 -- start start 2023-07-14T11:19:05.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.784+0000 7f30437ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f303c0d0010 0x7f303c0cd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:05.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.784+0000 7f30437ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f303c0d0480 0x7f303c1e7690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:05.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.784+0000 7f30437ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f303c0c8440 0x7f303c0c88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:05.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.784+0000 7f30437ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f303c155350 con 0x7f303c0c8440 2023-07-14T11:19:05.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.784+0000 7f30437ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f303c0c8e20 con 0x7f303c0d0010 2023-07-14T11:19:05.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.784+0000 7f30437ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f303c154d20 con 0x7f303c0d0480 2023-07-14T11:19:05.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.784+0000 7f3041d9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f303c0c8440 0x7f303c0c88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:05.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.785+0000 7f3041d9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f303c0c8440 0x7f303c0c88e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39190/0 (socket says 172.21.15.84:39190) 2023-07-14T11:19:05.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.785+0000 7f3041d9c700 1 -- 172.21.15.84:0/2768196293 learned_addr learned my addr 172.21.15.84:0/2768196293 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:05.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.785+0000 7f3040d9a700 1 --2- 172.21.15.84:0/2768196293 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f303c0d0480 0x7f303c1e7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:05.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.785+0000 7f304159b700 1 --2- 172.21.15.84:0/2768196293 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f303c0d0010 0x7f303c0cd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:05.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.785+0000 7f3041d9c700 1 -- 172.21.15.84:0/2768196293 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f303c0d0480 msgr2=0x7f303c1e7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:05.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.785+0000 7f3041d9c700 1 --2- 172.21.15.84:0/2768196293 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f303c0d0480 0x7f303c1e7690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:05.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.785+0000 7f3041d9c700 1 -- 172.21.15.84:0/2768196293 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f303c0d0010 msgr2=0x7f303c0cd8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:05.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.785+0000 7f3041d9c700 1 --2- 172.21.15.84:0/2768196293 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f303c0d0010 0x7f303c0cd8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:05.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.785+0000 7f3041d9c700 1 -- 172.21.15.84:0/2768196293 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3034009b30 con 0x7f303c0c8440 2023-07-14T11:19:05.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.785+0000 7f3041d9c700 1 --2- 172.21.15.84:0/2768196293 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f303c0c8440 0x7f303c0c88e0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f303c0b5ae0 tx=0x7f3034004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:05.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.785+0000 7f3031ffb700 1 -- 172.21.15.84:0/2768196293 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3034004440 con 0x7f303c0c8440 2023-07-14T11:19:05.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.786+0000 7f3031ffb700 1 -- 172.21.15.84:0/2768196293 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30340092e0 con 0x7f303c0c8440 2023-07-14T11:19:05.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.786+0000 7f30437ff700 1 -- 172.21.15.84:0/2768196293 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f303c0cdde0 con 0x7f303c0c8440 2023-07-14T11:19:05.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.786+0000 7f3031ffb700 1 -- 172.21.15.84:0/2768196293 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30340047e0 con 0x7f303c0c8440 2023-07-14T11:19:05.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.786+0000 7f30437ff700 1 -- 172.21.15.84:0/2768196293 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f303c1e82e0 con 0x7f303c0c8440 2023-07-14T11:19:05.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.787+0000 7f30437ff700 1 -- 172.21.15.84:0/2768196293 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f303c155490 con 0x7f303c0c8440 2023-07-14T11:19:05.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.788+0000 7f3031ffb700 1 -- 172.21.15.84:0/2768196293 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f303401c440 con 0x7f303c0c8440 2023-07-14T11:19:05.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.789+0000 7f3031ffb700 1 --2- 172.21.15.84:0/2768196293 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f302006ae00 0x7f302006d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:05.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.789+0000 7f3031ffb700 1 -- 172.21.15.84:0/2768196293 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f303408aa40 con 0x7f303c0c8440 2023-07-14T11:19:05.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.789+0000 7f304159b700 1 --2- 172.21.15.84:0/2768196293 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f302006ae00 0x7f302006d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:05.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.790+0000 7f304159b700 1 --2- 172.21.15.84:0/2768196293 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f302006ae00 0x7f302006d2b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3038007fd0 tx=0x7f3038007ec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:05.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.793+0000 7f3031ffb700 1 -- 172.21.15.84:0/2768196293 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3034055860 con 0x7f303c0c8440 2023-07-14T11:19:05.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.987+0000 7f30437ff700 1 -- 172.21.15.84:0/2768196293 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f303c074350 con 0x7f303c0c8440 2023-07-14T11:19:05.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.988+0000 7f3031ffb700 1 -- 172.21.15.84:0/2768196293 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v95) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3034058e80 con 0x7f303c0c8440 2023-07-14T11:19:05.991 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-07-14T11:19:05.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.990+0000 7f30437ff700 1 -- 172.21.15.84:0/2768196293 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f302006ae00 msgr2=0x7f302006d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:05.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.990+0000 7f30437ff700 1 --2- 172.21.15.84:0/2768196293 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f302006ae00 0x7f302006d2b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3038007fd0 tx=0x7f3038007ec0 comp rx=0 tx=0).stop 2023-07-14T11:19:05.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.990+0000 7f30437ff700 1 -- 172.21.15.84:0/2768196293 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f303c0c8440 msgr2=0x7f303c0c88e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:05.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.990+0000 7f30437ff700 1 --2- 172.21.15.84:0/2768196293 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f303c0c8440 0x7f303c0c88e0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f303c0b5ae0 tx=0x7f3034004ad0 comp rx=0 tx=0).stop 2023-07-14T11:19:05.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.990+0000 7f30437ff700 1 -- 172.21.15.84:0/2768196293 shutdown_connections 2023-07-14T11:19:05.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.990+0000 7f30437ff700 1 --2- 172.21.15.84:0/2768196293 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f303c0c8440 0x7f303c0c88e0 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:05.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.990+0000 7f30437ff700 1 --2- 172.21.15.84:0/2768196293 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f303c0d0010 0x7f303c0cd8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:05.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.990+0000 7f30437ff700 1 --2- 172.21.15.84:0/2768196293 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f302006ae00 0x7f302006d2b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:05.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.990+0000 7f30437ff700 1 --2- 172.21.15.84:0/2768196293 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f303c0d0480 0x7f303c1e7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:05.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.990+0000 7f30437ff700 1 -- 172.21.15.84:0/2768196293 >> 172.21.15.84:0/2768196293 conn(0x7f303c09c200 msgr2=0x7f303c0b7390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:05.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.990+0000 7f30437ff700 1 -- 172.21.15.84:0/2768196293 shutdown_connections 2023-07-14T11:19:05.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:05.990+0000 7f30437ff700 1 -- 172.21.15.84:0/2768196293 wait complete. 2023-07-14T11:19:06.010 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T11:19:06.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.205+0000 7f16c8bff700 1 Processor -- start 2023-07-14T11:19:06.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.206+0000 7f16c8bff700 1 -- start start 2023-07-14T11:19:06.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.207+0000 7f16c8bff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f16c415d9d0 0x7f16c406b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:06.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.207+0000 7f16c8bff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f16c406c9f0 0x7f16c40b1910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:06.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.207+0000 7f16c8bff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16c406c4e0 con 0x7f16c40b1e50 2023-07-14T11:19:06.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.207+0000 7f16c8bff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16c415dda0 con 0x7f16c415d9d0 2023-07-14T11:19:06.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.207+0000 7f16c8bff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16c406bf20 con 0x7f16c406c9f0 2023-07-14T11:19:06.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.207+0000 7f16c259c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f16c415d9d0 0x7f16c406b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:06.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.207+0000 7f16c259c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f16c415d9d0 0x7f16c406b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39196/0 (socket says 172.21.15.84:39196) 2023-07-14T11:19:06.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.207+0000 7f16c259c700 1 -- 172.21.15.84:0/2147990773 learned_addr learned my addr 172.21.15.84:0/2147990773 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:06.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.207+0000 7f16bbfff700 1 --2- 172.21.15.84:0/2147990773 >> v2:172.21.15.179:3300/0 conn(0x7f16c406c9f0 0x7f16c40b1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:06.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.207+0000 7f16c259c700 1 -- 172.21.15.84:0/2147990773 >> v2:172.21.15.179:3300/0 conn(0x7f16c406c9f0 msgr2=0x7f16c40b1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:06.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.208+0000 7f16c259c700 1 --2- 172.21.15.84:0/2147990773 >> v2:172.21.15.179:3300/0 conn(0x7f16c406c9f0 0x7f16c40b1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:06.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.208+0000 7f16c259c700 1 -- 172.21.15.84:0/2147990773 >> v1:172.21.15.179:6789/0 conn(0x7f16c40b1e50 legacy=0x7f16c4071170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:06.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.208+0000 7f16c259c700 1 -- 172.21.15.84:0/2147990773 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c406c200 con 0x7f16c415d9d0 2023-07-14T11:19:06.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.208+0000 7f16c259c700 1 --2- 172.21.15.84:0/2147990773 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16c415d9d0 0x7f16c406b5b0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f16c40720b0 tx=0x7f16b4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b223b77fc53c4eeb server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:06.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.208+0000 7f16c1d9b700 1 -- 172.21.15.84:0/2147990773 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b400b870 con 0x7f16c415d9d0 2023-07-14T11:19:06.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.208+0000 7f16c1d9b700 1 -- 172.21.15.84:0/2147990773 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16b400b9d0 con 0x7f16c415d9d0 2023-07-14T11:19:06.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.208+0000 7f16c1d9b700 1 -- 172.21.15.84:0/2147990773 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b400bd60 con 0x7f16c415d9d0 2023-07-14T11:19:06.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.209+0000 7f16c8bff700 1 -- 172.21.15.84:0/2147990773 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16c415d9d0 msgr2=0x7f16c406b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:06.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.209+0000 7f16c8bff700 1 --2- 172.21.15.84:0/2147990773 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16c415d9d0 0x7f16c406b5b0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f16c40720b0 tx=0x7f16b4009bd0 comp rx=0 tx=0).stop 2023-07-14T11:19:06.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.209+0000 7f16c8bff700 1 -- 172.21.15.84:0/2147990773 shutdown_connections 2023-07-14T11:19:06.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.209+0000 7f16c8bff700 1 --2- 172.21.15.84:0/2147990773 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16c415d9d0 0x7f16c406b5b0 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:06.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.209+0000 7f16c8bff700 1 --2- 172.21.15.84:0/2147990773 >> v2:172.21.15.179:3300/0 conn(0x7f16c406c9f0 0x7f16c40b1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:06.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.209+0000 7f16c8bff700 1 -- 172.21.15.84:0/2147990773 >> 172.21.15.84:0/2147990773 conn(0x7f16c40b05d0 msgr2=0x7f16c40b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:06.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.209+0000 7f16c8bff700 1 -- 172.21.15.84:0/2147990773 shutdown_connections 2023-07-14T11:19:06.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.209+0000 7f16c8bff700 1 -- 172.21.15.84:0/2147990773 wait complete. 2023-07-14T11:19:06.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.210+0000 7f16c8bff700 1 Processor -- start 2023-07-14T11:19:06.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.211+0000 7f16c8bff700 1 -- start start 2023-07-14T11:19:06.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.211+0000 7f16c8bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16c406c9f0 0x7f16c41599d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:06.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.211+0000 7f16c8bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16c40b1e50 0x7f16c41e3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:06.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.212+0000 7f16c8bff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16c415d9d0 0x7f16c41f0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:06.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.212+0000 7f16c8bff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c41f0070 con 0x7f16c415d9d0 2023-07-14T11:19:06.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.212+0000 7f16c8bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c41efd10 con 0x7f16c40b1e50 2023-07-14T11:19:06.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.212+0000 7f16c8bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16c4154960 con 0x7f16c406c9f0 2023-07-14T11:19:06.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.212+0000 7f16c2d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16c415d9d0 0x7f16c41f0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:06.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.212+0000 7f16c2d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16c415d9d0 0x7f16c41f0490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39202/0 (socket says 172.21.15.84:39202) 2023-07-14T11:19:06.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.212+0000 7f16c2d9d700 1 -- 172.21.15.84:0/1226195013 learned_addr learned my addr 172.21.15.84:0/1226195013 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:06.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.212+0000 7f16bbfff700 1 --2- 172.21.15.84:0/1226195013 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16c40b1e50 0x7f16c41e3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:06.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.212+0000 7f16c2d9d700 1 -- 172.21.15.84:0/1226195013 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16c406c9f0 msgr2=0x7f16c41599d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:06.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.212+0000 7f16c259c700 1 --2- 172.21.15.84:0/1226195013 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16c406c9f0 0x7f16c41599d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:06.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.212+0000 7f16c2d9d700 1 --2- 172.21.15.84:0/1226195013 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16c406c9f0 0x7f16c41599d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:06.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.212+0000 7f16c2d9d700 1 -- 172.21.15.84:0/1226195013 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16c40b1e50 msgr2=0x7f16c41e3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:06.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.212+0000 7f16c2d9d700 1 --2- 172.21.15.84:0/1226195013 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16c40b1e50 0x7f16c41e3f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:06.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.212+0000 7f16c2d9d700 1 -- 172.21.15.84:0/1226195013 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16b4009550 con 0x7f16c415d9d0 2023-07-14T11:19:06.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.212+0000 7f16bbfff700 1 --2- 172.21.15.84:0/1226195013 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16c40b1e50 0x7f16c41e3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:19:06.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.212+0000 7f16c259c700 1 --2- 172.21.15.84:0/1226195013 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16c406c9f0 0x7f16c41599d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:19:06.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.213+0000 7f16c2d9d700 1 --2- 172.21.15.84:0/1226195013 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16c415d9d0 0x7f16c41f0490 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f16bc00cc50 tx=0x7f16bc00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:06.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.213+0000 7f16baffd700 1 -- 172.21.15.84:0/1226195013 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16bc00ad80 con 0x7f16c415d9d0 2023-07-14T11:19:06.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.213+0000 7f16baffd700 1 -- 172.21.15.84:0/1226195013 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16bc00ce50 con 0x7f16c415d9d0 2023-07-14T11:19:06.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.213+0000 7f16c8bff700 1 -- 172.21.15.84:0/1226195013 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16c41540c0 con 0x7f16c415d9d0 2023-07-14T11:19:06.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.213+0000 7f16baffd700 1 -- 172.21.15.84:0/1226195013 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16bc003c40 con 0x7f16c415d9d0 2023-07-14T11:19:06.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.213+0000 7f16c8bff700 1 -- 172.21.15.84:0/1226195013 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16c4154680 con 0x7f16c415d9d0 2023-07-14T11:19:06.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.214+0000 7f16c8bff700 1 -- 172.21.15.84:0/1226195013 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16c41f01b0 con 0x7f16c415d9d0 2023-07-14T11:19:06.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.215+0000 7f16baffd700 1 -- 172.21.15.84:0/1226195013 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f16bc0050d0 con 0x7f16c415d9d0 2023-07-14T11:19:06.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.216+0000 7f16baffd700 1 --2- 172.21.15.84:0/1226195013 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f16a406ae00 0x7f16a406d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:06.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.216+0000 7f16baffd700 1 -- 172.21.15.84:0/1226195013 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f16bc089780 con 0x7f16c415d9d0 2023-07-14T11:19:06.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.216+0000 7f16c259c700 1 --2- 172.21.15.84:0/1226195013 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f16a406ae00 0x7f16a406d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:06.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.217+0000 7f16c259c700 1 --2- 172.21.15.84:0/1226195013 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f16a406ae00 0x7f16a406d2b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f16b4009130 tx=0x7f16b4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:06.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.220+0000 7f16baffd700 1 -- 172.21.15.84:0/1226195013 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f16c41f01b0 con 0x7f16c415d9d0 2023-07-14T11:19:06.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.412+0000 7f16c8bff700 1 -- 172.21.15.84:0/1226195013 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f16c41f01b0 con 0x7f16c415d9d0 2023-07-14T11:19:06.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.412+0000 7f16baffd700 1 -- 172.21.15.84:0/1226195013 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v95) v1 ==== 104+0+11 (secure 0 0 0) 0x7f16c41f01b0 con 0x7f16c415d9d0 2023-07-14T11:19:06.415 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-07-14T11:19:06.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.415+0000 7f16c8bff700 1 -- 172.21.15.84:0/1226195013 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f16a406ae00 msgr2=0x7f16a406d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:06.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.415+0000 7f16c8bff700 1 --2- 172.21.15.84:0/1226195013 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f16a406ae00 0x7f16a406d2b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f16b4009130 tx=0x7f16b4008030 comp rx=0 tx=0).stop 2023-07-14T11:19:06.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.415+0000 7f16c8bff700 1 -- 172.21.15.84:0/1226195013 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16c415d9d0 msgr2=0x7f16c41f0490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:06.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.415+0000 7f16c8bff700 1 --2- 172.21.15.84:0/1226195013 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16c415d9d0 0x7f16c41f0490 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f16bc00cc50 tx=0x7f16bc00a340 comp rx=0 tx=0).stop 2023-07-14T11:19:06.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.415+0000 7f16c8bff700 1 -- 172.21.15.84:0/1226195013 shutdown_connections 2023-07-14T11:19:06.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.415+0000 7f16c8bff700 1 --2- 172.21.15.84:0/1226195013 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f16a406ae00 0x7f16a406d2b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:06.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.415+0000 7f16c8bff700 1 --2- 172.21.15.84:0/1226195013 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16c406c9f0 0x7f16c41599d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:06.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.415+0000 7f16c8bff700 1 --2- 172.21.15.84:0/1226195013 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16c415d9d0 0x7f16c41f0490 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:06.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.415+0000 7f16c8bff700 1 --2- 172.21.15.84:0/1226195013 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16c40b1e50 0x7f16c41e3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:06.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.415+0000 7f16c8bff700 1 -- 172.21.15.84:0/1226195013 >> 172.21.15.84:0/1226195013 conn(0x7f16c40b05d0 msgr2=0x7f16c40ae540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:06.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.415+0000 7f16c8bff700 1 -- 172.21.15.84:0/1226195013 shutdown_connections 2023-07-14T11:19:06.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.415+0000 7f16c8bff700 1 -- 172.21.15.84:0/1226195013 wait complete. 2023-07-14T11:19:06.436 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T11:19:06.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.632+0000 7fcb2ffff700 1 Processor -- start 2023-07-14T11:19:06.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.632+0000 7fcb2ffff700 1 -- start start 2023-07-14T11:19:06.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.633+0000 7fcb2ffff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fcb280c92d0 0x7fcb280ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:06.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.634+0000 7fcb2ffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcb280b12f0 0x7fcb280c96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:06.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.634+0000 7fcb2ffff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb2815ce70 con 0x7fcb280adea0 2023-07-14T11:19:06.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.634+0000 7fcb2ffff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb2815da60 con 0x7fcb280b12f0 2023-07-14T11:19:06.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.634+0000 7fcb2ffff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb280c9be0 con 0x7fcb280c92d0 2023-07-14T11:19:06.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.634+0000 7fcb2d59a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcb280b12f0 0x7fcb280c96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:06.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.634+0000 7fcb2d59a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcb280b12f0 0x7fcb280c96a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39220/0 (socket says 172.21.15.84:39220) 2023-07-14T11:19:06.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.634+0000 7fcb2d59a700 1 -- 172.21.15.84:0/56747960 learned_addr learned my addr 172.21.15.84:0/56747960 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:06.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.634+0000 7fcb2dd9b700 1 --2- 172.21.15.84:0/56747960 >> v2:172.21.15.179:3300/0 conn(0x7fcb280c92d0 0x7fcb280ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:06.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.634+0000 7fcb2d59a700 1 -- 172.21.15.84:0/56747960 >> v2:172.21.15.179:3300/0 conn(0x7fcb280c92d0 msgr2=0x7fcb280ad8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:06.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.634+0000 7fcb2d59a700 1 --2- 172.21.15.84:0/56747960 >> v2:172.21.15.179:3300/0 conn(0x7fcb280c92d0 0x7fcb280ad8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:06.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.634+0000 7fcb2d59a700 1 -- 172.21.15.84:0/56747960 >> v1:172.21.15.179:6789/0 conn(0x7fcb280adea0 legacy=0x7fcb2806c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:06.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.634+0000 7fcb2d59a700 1 -- 172.21.15.84:0/56747960 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb2815d0c0 con 0x7fcb280b12f0 2023-07-14T11:19:06.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.634+0000 7fcb2dd9b700 1 --2- 172.21.15.84:0/56747960 >> v2:172.21.15.179:3300/0 conn(0x7fcb280c92d0 0x7fcb280ad8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:19:06.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.635+0000 7fcb2d59a700 1 --2- 172.21.15.84:0/56747960 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb280b12f0 0x7fcb280c96a0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fcb2806f630 tx=0x7fcb18009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c46d59b6bc9b6b3 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:06.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.635+0000 7fcb2cd99700 1 -- 172.21.15.84:0/56747960 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1800b870 con 0x7fcb280b12f0 2023-07-14T11:19:06.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.635+0000 7fcb2cd99700 1 -- 172.21.15.84:0/56747960 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb1800b9d0 con 0x7fcb280b12f0 2023-07-14T11:19:06.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.635+0000 7fcb2cd99700 1 -- 172.21.15.84:0/56747960 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1800bd60 con 0x7fcb280b12f0 2023-07-14T11:19:06.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.635+0000 7fcb2ffff700 1 -- 172.21.15.84:0/56747960 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb280b12f0 msgr2=0x7fcb280c96a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:06.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.635+0000 7fcb2ffff700 1 --2- 172.21.15.84:0/56747960 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb280b12f0 0x7fcb280c96a0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fcb2806f630 tx=0x7fcb18009bd0 comp rx=0 tx=0).stop 2023-07-14T11:19:06.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.635+0000 7fcb2ffff700 1 -- 172.21.15.84:0/56747960 shutdown_connections 2023-07-14T11:19:06.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.635+0000 7fcb2ffff700 1 --2- 172.21.15.84:0/56747960 >> v2:172.21.15.179:3300/0 conn(0x7fcb280c92d0 0x7fcb280ad8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:06.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.635+0000 7fcb2ffff700 1 --2- 172.21.15.84:0/56747960 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb280b12f0 0x7fcb280c96a0 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:06.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.635+0000 7fcb2ffff700 1 -- 172.21.15.84:0/56747960 >> 172.21.15.84:0/56747960 conn(0x7fcb280b05d0 msgr2=0x7fcb280b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:06.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.635+0000 7fcb2ffff700 1 -- 172.21.15.84:0/56747960 shutdown_connections 2023-07-14T11:19:06.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.636+0000 7fcb2ffff700 1 -- 172.21.15.84:0/56747960 wait complete. 2023-07-14T11:19:06.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.637+0000 7fcb2ffff700 1 Processor -- start 2023-07-14T11:19:06.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.637+0000 7fcb2ffff700 1 -- start start 2023-07-14T11:19:06.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.639+0000 7fcb2ffff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb280adea0 0x7fcb281552f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:06.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.639+0000 7fcb2ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb280b12f0 0x7fcb28147dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:06.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.639+0000 7fcb2ffff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb280c92d0 0x7fcb280c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:06.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.639+0000 7fcb2ffff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb28148300 con 0x7fcb280b12f0 2023-07-14T11:19:06.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.639+0000 7fcb2ffff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb280c6cc0 con 0x7fcb280c92d0 2023-07-14T11:19:06.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.639+0000 7fcb2ffff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb280c6fa0 con 0x7fcb280adea0 2023-07-14T11:19:06.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.639+0000 7fcb2d59a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb280b12f0 0x7fcb28147dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:06.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.639+0000 7fcb2d59a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb280b12f0 0x7fcb28147dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39222/0 (socket says 172.21.15.84:39222) 2023-07-14T11:19:06.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.639+0000 7fcb2d59a700 1 -- 172.21.15.84:0/45604709 learned_addr learned my addr 172.21.15.84:0/45604709 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:06.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.639+0000 7fcb2dd9b700 1 --2- 172.21.15.84:0/45604709 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb280adea0 0x7fcb281552f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:06.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.639+0000 7fcb2e59c700 1 --2- 172.21.15.84:0/45604709 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb280c92d0 0x7fcb280c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:06.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.639+0000 7fcb2d59a700 1 -- 172.21.15.84:0/45604709 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb280adea0 msgr2=0x7fcb281552f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:06.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.639+0000 7fcb2d59a700 1 --2- 172.21.15.84:0/45604709 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb280adea0 0x7fcb281552f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:06.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.639+0000 7fcb2d59a700 1 -- 172.21.15.84:0/45604709 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb280c92d0 msgr2=0x7fcb280c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:06.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.639+0000 7fcb2d59a700 1 --2- 172.21.15.84:0/45604709 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb280c92d0 0x7fcb280c8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:06.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.639+0000 7fcb2d59a700 1 -- 172.21.15.84:0/45604709 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb18009550 con 0x7fcb280b12f0 2023-07-14T11:19:06.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.640+0000 7fcb2d59a700 1 --2- 172.21.15.84:0/45604709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb280b12f0 0x7fcb28147dc0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7fcb18000c00 tx=0x7fcb18004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:06.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.640+0000 7fcb1e7fc700 1 -- 172.21.15.84:0/45604709 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb18004540 con 0x7fcb280b12f0 2023-07-14T11:19:06.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.640+0000 7fcb1e7fc700 1 -- 172.21.15.84:0/45604709 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb180036a0 con 0x7fcb280b12f0 2023-07-14T11:19:06.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.640+0000 7fcb2ffff700 1 -- 172.21.15.84:0/45604709 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb280c7280 con 0x7fcb280b12f0 2023-07-14T11:19:06.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.640+0000 7fcb1e7fc700 1 -- 172.21.15.84:0/45604709 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb18003a10 con 0x7fcb280b12f0 2023-07-14T11:19:06.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.640+0000 7fcb2ffff700 1 -- 172.21.15.84:0/45604709 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb280c7840 con 0x7fcb280b12f0 2023-07-14T11:19:06.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.641+0000 7fcb2ffff700 1 -- 172.21.15.84:0/45604709 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb28074350 con 0x7fcb280b12f0 2023-07-14T11:19:06.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.642+0000 7fcb1e7fc700 1 -- 172.21.15.84:0/45604709 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7fcb18021070 con 0x7fcb280b12f0 2023-07-14T11:19:06.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.643+0000 7fcb1e7fc700 1 --2- 172.21.15.84:0/45604709 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fcb0c06ae00 0x7fcb0c06d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:06.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.643+0000 7fcb1e7fc700 1 -- 172.21.15.84:0/45604709 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6148+0+0 (secure 0 0 0) 0x7fcb1808ad90 con 0x7fcb280b12f0 2023-07-14T11:19:06.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.643+0000 7fcb2dd9b700 1 --2- 172.21.15.84:0/45604709 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fcb0c06ae00 0x7fcb0c06d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:06.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.644+0000 7fcb2dd9b700 1 --2- 172.21.15.84:0/45604709 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fcb0c06ae00 0x7fcb0c06d2b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcb2400c940 tx=0x7fcb24008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:06.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.647+0000 7fcb1e7fc700 1 -- 172.21.15.84:0/45604709 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fcb18055de0 con 0x7fcb280b12f0 2023-07-14T11:19:06.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.841+0000 7fcb2ffff700 1 -- 172.21.15.84:0/45604709 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcb280b4a40 con 0x7fcb280b12f0 2023-07-14T11:19:06.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.841+0000 7fcb1e7fc700 1 -- 172.21.15.84:0/45604709 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v95) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcb18059400 con 0x7fcb280b12f0 2023-07-14T11:19:06.844 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-07-14T11:19:06.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.844+0000 7fcb2ffff700 1 -- 172.21.15.84:0/45604709 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fcb0c06ae00 msgr2=0x7fcb0c06d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:06.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.844+0000 7fcb2ffff700 1 --2- 172.21.15.84:0/45604709 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fcb0c06ae00 0x7fcb0c06d2b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcb2400c940 tx=0x7fcb24008040 comp rx=0 tx=0).stop 2023-07-14T11:19:06.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.844+0000 7fcb2ffff700 1 -- 172.21.15.84:0/45604709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb280b12f0 msgr2=0x7fcb28147dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:06.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.844+0000 7fcb2ffff700 1 --2- 172.21.15.84:0/45604709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb280b12f0 0x7fcb28147dc0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7fcb18000c00 tx=0x7fcb18004750 comp rx=0 tx=0).stop 2023-07-14T11:19:06.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.844+0000 7fcb2ffff700 1 -- 172.21.15.84:0/45604709 shutdown_connections 2023-07-14T11:19:06.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.844+0000 7fcb2ffff700 1 --2- 172.21.15.84:0/45604709 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fcb0c06ae00 0x7fcb0c06d2b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:06.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.844+0000 7fcb2ffff700 1 --2- 172.21.15.84:0/45604709 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb280adea0 0x7fcb281552f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:06.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.844+0000 7fcb2ffff700 1 --2- 172.21.15.84:0/45604709 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb280c92d0 0x7fcb280c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:06.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.844+0000 7fcb2ffff700 1 --2- 172.21.15.84:0/45604709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb280b12f0 0x7fcb28147dc0 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:06.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.844+0000 7fcb2ffff700 1 -- 172.21.15.84:0/45604709 >> 172.21.15.84:0/45604709 conn(0x7fcb280b05d0 msgr2=0x7fcb2806b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:06.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.844+0000 7fcb2ffff700 1 -- 172.21.15.84:0/45604709 shutdown_connections 2023-07-14T11:19:06.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:06.844+0000 7fcb2ffff700 1 -- 172.21.15.84:0/45604709 wait complete. 2023-07-14T11:19:06.864 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-14T11:19:07.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.064+0000 7f15a1dff700 1 Processor -- start 2023-07-14T11:19:07.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.064+0000 7f15a1dff700 1 -- start start 2023-07-14T11:19:07.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.065+0000 7f15a1dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f159c0b4600 0x7f159c0cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:07.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.066+0000 7f15a1dff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f159c15cd60 con 0x7f159c0b6f00 2023-07-14T11:19:07.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.066+0000 7f15a1dff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f159c0ce360 con 0x7f159c0cfe40 2023-07-14T11:19:07.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.066+0000 7f15a1dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f159c0d1550 con 0x7f159c0b4600 2023-07-14T11:19:07.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.066+0000 7f159bfff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f159c0b6f00 0x7f159c0cdc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52162/0 (socket says 172.21.15.84:52162) 2023-07-14T11:19:07.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.066+0000 7f159bfff700 1 -- 172.21.15.84:0/1615945971 learned_addr learned my addr 172.21.15.84:0/1615945971 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:19:07.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.066+0000 7f159b7fe700 1 --2- 172.21.15.84:0/1615945971 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f159c0b4600 0x7f159c0cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:07.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.066+0000 7f159a7fc700 1 -- 172.21.15.84:0/1615945971 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1676248329 0 0) 0x7f159c15cd60 con 0x7f159c0b6f00 2023-07-14T11:19:07.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.066+0000 7f159a7fc700 1 -- 172.21.15.84:0/1615945971 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15840035b0 con 0x7f159c0b6f00 2023-07-14T11:19:07.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.067+0000 7f159a7fc700 1 -- 172.21.15.84:0/1615945971 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3599194491 0 0) 0x7f15840035b0 con 0x7f159c0b6f00 2023-07-14T11:19:07.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.067+0000 7f159b7fe700 1 -- 172.21.15.84:0/1615945971 >> v1:172.21.15.179:6789/0 conn(0x7f159c0cfe40 legacy=0x7f159c0cd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:07.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.067+0000 7f159b7fe700 1 -- 172.21.15.84:0/1615945971 >> v1:172.21.15.84:6789/0 conn(0x7f159c0b6f00 legacy=0x7f159c0cdc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:07.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.067+0000 7f159b7fe700 1 -- 172.21.15.84:0/1615945971 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f159c0cf340 con 0x7f159c0b4600 2023-07-14T11:19:07.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.067+0000 7f159b7fe700 1 --2- 172.21.15.84:0/1615945971 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f159c0b4600 0x7f159c0cf900 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f158c009870 tx=0x7f158c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93150027c328e5fa server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:07.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.067+0000 7f159a7fc700 1 -- 172.21.15.84:0/1615945971 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15940019f0 con 0x7f159c0b4600 2023-07-14T11:19:07.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.067+0000 7f159a7fc700 1 -- 172.21.15.84:0/1615945971 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f158c004030 con 0x7f159c0b4600 2023-07-14T11:19:07.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.067+0000 7f159a7fc700 1 -- 172.21.15.84:0/1615945971 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158c0043a0 con 0x7f159c0b4600 2023-07-14T11:19:07.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.068+0000 7f15a1dff700 1 -- 172.21.15.84:0/1615945971 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f159c0b4600 msgr2=0x7f159c0cf900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:07.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.068+0000 7f15a1dff700 1 --2- 172.21.15.84:0/1615945971 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f159c0b4600 0x7f159c0cf900 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f158c009870 tx=0x7f158c009b80 comp rx=0 tx=0).stop 2023-07-14T11:19:07.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.068+0000 7f15a1dff700 1 -- 172.21.15.84:0/1615945971 shutdown_connections 2023-07-14T11:19:07.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.068+0000 7f15a1dff700 1 --2- 172.21.15.84:0/1615945971 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f159c0b4600 0x7f159c0cf900 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:07.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.068+0000 7f15a1dff700 1 -- 172.21.15.84:0/1615945971 >> 172.21.15.84:0/1615945971 conn(0x7f159c09c200 msgr2=0x7f159c0d2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:07.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.068+0000 7f15a1dff700 1 -- 172.21.15.84:0/1615945971 shutdown_connections 2023-07-14T11:19:07.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.068+0000 7f15a1dff700 1 -- 172.21.15.84:0/1615945971 wait complete. 2023-07-14T11:19:07.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.069+0000 7f15a1dff700 1 Processor -- start 2023-07-14T11:19:07.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.070+0000 7f15a1dff700 1 -- start start 2023-07-14T11:19:07.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.070+0000 7f15a1dff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f159c0b6f00 0x7f159c1f1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:07.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.070+0000 7f15a1dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f159c0cfe40 0x7f159c1594b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:07.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.071+0000 7f15a1dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f159c1599f0 0x7f159c157350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:07.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.071+0000 7f15a1dff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f159c0c9af0 con 0x7f159c0b6f00 2023-07-14T11:19:07.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.071+0000 7f15a1dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f159c159e70 con 0x7f159c1599f0 2023-07-14T11:19:07.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.071+0000 7f15a1dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f159c157fd0 con 0x7f159c0cfe40 2023-07-14T11:19:07.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.071+0000 7f159b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f159c0b6f00 0x7f159c1f1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:07.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.071+0000 7f159b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f159c0b6f00 0x7f159c1f1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39236/0 (socket says 172.21.15.84:39236) 2023-07-14T11:19:07.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.071+0000 7f159b7fe700 1 -- 172.21.15.84:0/3818190644 learned_addr learned my addr 172.21.15.84:0/3818190644 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:07.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.071+0000 7f159bfff700 1 --2- 172.21.15.84:0/3818190644 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f159c1599f0 0x7f159c157350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:07.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.071+0000 7f159affd700 1 --2- 172.21.15.84:0/3818190644 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f159c0cfe40 0x7f159c1594b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:07.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.071+0000 7f159b7fe700 1 -- 172.21.15.84:0/3818190644 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f159c0cfe40 msgr2=0x7f159c1594b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:07.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.071+0000 7f159b7fe700 1 --2- 172.21.15.84:0/3818190644 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f159c0cfe40 0x7f159c1594b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:07.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.071+0000 7f159b7fe700 1 -- 172.21.15.84:0/3818190644 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f159c1599f0 msgr2=0x7f159c157350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:07.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.071+0000 7f159b7fe700 1 --2- 172.21.15.84:0/3818190644 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f159c1599f0 0x7f159c157350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:07.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.071+0000 7f159b7fe700 1 -- 172.21.15.84:0/3818190644 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f158c0094a0 con 0x7f159c0b6f00 2023-07-14T11:19:07.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.071+0000 7f159affd700 1 --2- 172.21.15.84:0/3818190644 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f159c0cfe40 0x7f159c1594b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:19:07.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.071+0000 7f159b7fe700 1 --2- 172.21.15.84:0/3818190644 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f159c0b6f00 0x7f159c1f1f10 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f158c000c00 tx=0x7f158c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:07.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.072+0000 7f1583fff700 1 -- 172.21.15.84:0/3818190644 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158c010790 con 0x7f159c0b6f00 2023-07-14T11:19:07.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.072+0000 7f1583fff700 1 -- 172.21.15.84:0/3818190644 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f158c0108f0 con 0x7f159c0b6f00 2023-07-14T11:19:07.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.072+0000 7f15a1dff700 1 -- 172.21.15.84:0/3818190644 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f159c1582b0 con 0x7f159c0b6f00 2023-07-14T11:19:07.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.072+0000 7f1583fff700 1 -- 172.21.15.84:0/3818190644 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158c010c80 con 0x7f159c0b6f00 2023-07-14T11:19:07.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.072+0000 7f15a1dff700 1 -- 172.21.15.84:0/3818190644 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f159c158870 con 0x7f159c0b6f00 2023-07-14T11:19:07.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.073+0000 7f15a1dff700 1 -- 172.21.15.84:0/3818190644 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f159c074350 con 0x7f159c0b6f00 2023-07-14T11:19:07.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.074+0000 7f1583fff700 1 -- 172.21.15.84:0/3818190644 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f158c01c420 con 0x7f159c0b6f00 2023-07-14T11:19:07.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.075+0000 7f1583fff700 1 --2- 172.21.15.84:0/3818190644 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f158806ae00 0x7f158806d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:07.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.075+0000 7f1583fff700 1 -- 172.21.15.84:0/3818190644 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f158c08aec0 con 0x7f159c0b6f00 2023-07-14T11:19:07.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.075+0000 7f159affd700 1 --2- 172.21.15.84:0/3818190644 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f158806ae00 0x7f158806d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:07.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.076+0000 7f159affd700 1 --2- 172.21.15.84:0/3818190644 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f158806ae00 0x7f158806d2b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f159c15a880 tx=0x7f1590009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:07.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.079+0000 7f1583fff700 1 -- 172.21.15.84:0/3818190644 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f158c055e90 con 0x7f159c0b6f00 2023-07-14T11:19:07.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.288+0000 7f15a1dff700 1 -- 172.21.15.84:0/3818190644 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f159c154a00 con 0x7f159c0b6f00 2023-07-14T11:19:07.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.288+0000 7f1583fff700 1 -- 172.21.15.84:0/3818190644 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v95) v1 ==== 80+0+124 (secure 0 0 0) 0x7f158c020090 con 0x7f159c0b6f00 2023-07-14T11:19:07.291 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.179:6834/4019917691 2023-07-15T11:18:58.463254+0000 2023-07-14T11:19:07.291 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.179:6833/4019917691 2023-07-15T11:18:58.463254+0000 2023-07-14T11:19:07.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.291+0000 7f15a1dff700 1 -- 172.21.15.84:0/3818190644 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f158806ae00 msgr2=0x7f158806d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:07.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.291+0000 7f15a1dff700 1 --2- 172.21.15.84:0/3818190644 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f158806ae00 0x7f158806d2b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f159c15a880 tx=0x7f1590009040 comp rx=0 tx=0).stop 2023-07-14T11:19:07.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.291+0000 7f15a1dff700 1 -- 172.21.15.84:0/3818190644 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f159c0b6f00 msgr2=0x7f159c1f1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:07.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.291+0000 7f15a1dff700 1 --2- 172.21.15.84:0/3818190644 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f159c0b6f00 0x7f159c1f1f10 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f158c000c00 tx=0x7f158c004750 comp rx=0 tx=0).stop 2023-07-14T11:19:07.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.291+0000 7f15a1dff700 1 -- 172.21.15.84:0/3818190644 shutdown_connections 2023-07-14T11:19:07.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.291+0000 7f15a1dff700 1 --2- 172.21.15.84:0/3818190644 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f159c1599f0 0x7f159c157350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:07.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.291+0000 7f15a1dff700 1 --2- 172.21.15.84:0/3818190644 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f159c0b6f00 0x7f159c1f1f10 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:07.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.291+0000 7f15a1dff700 1 --2- 172.21.15.84:0/3818190644 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f158806ae00 0x7f158806d2b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:07.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.291+0000 7f15a1dff700 1 --2- 172.21.15.84:0/3818190644 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f159c0cfe40 0x7f159c1594b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:07.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.291+0000 7f15a1dff700 1 -- 172.21.15.84:0/3818190644 >> 172.21.15.84:0/3818190644 conn(0x7f159c09c200 msgr2=0x7f159c0b8650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:07.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.291+0000 7f15a1dff700 1 -- 172.21.15.84:0/3818190644 shutdown_connections 2023-07-14T11:19:07.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.291+0000 7f15a1dff700 1 -- 172.21.15.84:0/3818190644 wait complete. 2023-07-14T11:19:07.295 INFO:teuthology.orchestra.run.smithi084.stderr:listed 2 entries 2023-07-14T11:19:07.312 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-07-14T11:19:07.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:19:07.312 DEBUG:teuthology.orchestra.run.smithi179:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-07-14T11:19:07.409 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi179.front.sepia.ceph.com 2023-07-14T11:19:07.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:19:07.410 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-14T11:19:07.457 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-14T11:19:07.457 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:19:07.504 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345568k,nr_inodes=4086392,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=35,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275008k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-07-14T11:19:07.504 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-07-14T11:19:07.505 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:19:07.551 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345528k,nr_inodes=4086382,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=40,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275000k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-07-14T11:19:07.551 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T11:19:07.704 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T11:19:07.708 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T11:19:07.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.744+0000 7f77b71ff700 1 Processor -- start 2023-07-14T11:19:07.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.744+0000 7f77b71ff700 1 -- start start 2023-07-14T11:19:07.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.746+0000 7f77b71ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f77b00b5d90 0x7f77b00b6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:07.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.746+0000 7f77b71ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f77b00d0b10 0x7f77b00d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:07.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.746+0000 7f77b71ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77b00b7f50 con 0x7f77b00b4510 2023-07-14T11:19:07.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.746+0000 7f77b71ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77b00b48e0 con 0x7f77b00b5d90 2023-07-14T11:19:07.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.746+0000 7f77b71ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77b00d14d0 con 0x7f77b00d0b10 2023-07-14T11:19:07.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.746+0000 7f77affff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f77b00b5d90 0x7f77b00b6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:07.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.746+0000 7f77affff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f77b00b5d90 0x7f77b00b6c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39238/0 (socket says 172.21.15.84:39238) 2023-07-14T11:19:07.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.746+0000 7f77b579c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f77b00d0b10 0x7f77b00d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:07.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.746+0000 7f77affff700 1 -- 172.21.15.84:0/724495146 learned_addr learned my addr 172.21.15.84:0/724495146 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:07.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.747+0000 7f77affff700 1 -- 172.21.15.84:0/724495146 >> v2:172.21.15.179:3300/0 conn(0x7f77b00d0b10 msgr2=0x7f77b00d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:07.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.747+0000 7f77affff700 1 --2- 172.21.15.84:0/724495146 >> v2:172.21.15.179:3300/0 conn(0x7f77b00d0b10 0x7f77b00d0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:07.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.747+0000 7f77affff700 1 -- 172.21.15.84:0/724495146 >> v1:172.21.15.179:6789/0 conn(0x7f77b00b4510 legacy=0x7f77b00cd590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:07.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.747+0000 7f77affff700 1 -- 172.21.15.84:0/724495146 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77b00cdca0 con 0x7f77b00b5d90 2023-07-14T11:19:07.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.747+0000 7f77af7fe700 1 -- 172.21.15.84:0/724495146 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3485175247 0 0) 0x7f77b00b7f50 con 0x7f77b00b4510 2023-07-14T11:19:07.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.747+0000 7f77affff700 1 --2- 172.21.15.84:0/724495146 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77b00b5d90 0x7f77b00b6c80 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f77b0067390 tx=0x7f779c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da6bd5a7d1842b19 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:07.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.747+0000 7f77af7fe700 1 -- 172.21.15.84:0/724495146 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779c011830 con 0x7f77b00b5d90 2023-07-14T11:19:07.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.747+0000 7f77af7fe700 1 -- 172.21.15.84:0/724495146 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f779c011990 con 0x7f77b00b5d90 2023-07-14T11:19:07.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.747+0000 7f77af7fe700 1 -- 172.21.15.84:0/724495146 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779c011d20 con 0x7f77b00b5d90 2023-07-14T11:19:07.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.748+0000 7f77b71ff700 1 -- 172.21.15.84:0/724495146 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77b00b5d90 msgr2=0x7f77b00b6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:07.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.748+0000 7f77b71ff700 1 --2- 172.21.15.84:0/724495146 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77b00b5d90 0x7f77b00b6c80 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f77b0067390 tx=0x7f779c009bd0 comp rx=0 tx=0).stop 2023-07-14T11:19:07.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.748+0000 7f77b71ff700 1 -- 172.21.15.84:0/724495146 shutdown_connections 2023-07-14T11:19:07.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.748+0000 7f77b71ff700 1 --2- 172.21.15.84:0/724495146 >> v2:172.21.15.179:3300/0 conn(0x7f77b00d0b10 0x7f77b00d0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:07.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.748+0000 7f77b71ff700 1 --2- 172.21.15.84:0/724495146 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77b00b5d90 0x7f77b00b6c80 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:07.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.748+0000 7f77b71ff700 1 -- 172.21.15.84:0/724495146 >> 172.21.15.84:0/724495146 conn(0x7f77b009c1d0 msgr2=0x7f77b00d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:07.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.748+0000 7f77b71ff700 1 -- 172.21.15.84:0/724495146 shutdown_connections 2023-07-14T11:19:07.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.748+0000 7f77b71ff700 1 -- 172.21.15.84:0/724495146 wait complete. 2023-07-14T11:19:07.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.750+0000 7f77b71ff700 1 Processor -- start 2023-07-14T11:19:07.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.750+0000 7f77b71ff700 1 -- start start 2023-07-14T11:19:07.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.751+0000 7f77b71ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77b00b4510 0x7f77b01504b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:07.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.751+0000 7f77b71ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77b00b5d90 0x7f77b006b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:07.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.751+0000 7f77b71ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77b00d0b10 0x7f77b006bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:07.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.751+0000 7f77b71ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77b0151e00 con 0x7f77b00b5d90 2023-07-14T11:19:07.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.751+0000 7f77b71ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77b00ca570 con 0x7f77b00d0b10 2023-07-14T11:19:07.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.751+0000 7f77b71ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77b01540b0 con 0x7f77b00b4510 2023-07-14T11:19:07.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.751+0000 7f77affff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77b00b5d90 0x7f77b006b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:07.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.751+0000 7f77affff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77b00b5d90 0x7f77b006b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39252/0 (socket says 172.21.15.84:39252) 2023-07-14T11:19:07.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.751+0000 7f77affff700 1 -- 172.21.15.84:0/905421505 learned_addr learned my addr 172.21.15.84:0/905421505 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:07.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.751+0000 7f77b579c700 1 --2- 172.21.15.84:0/905421505 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77b00d0b10 0x7f77b006bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:07.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.751+0000 7f77b4f9b700 1 --2- 172.21.15.84:0/905421505 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77b00b4510 0x7f77b01504b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:07.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.752+0000 7f77affff700 1 -- 172.21.15.84:0/905421505 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77b00b4510 msgr2=0x7f77b01504b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:07.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.752+0000 7f77affff700 1 --2- 172.21.15.84:0/905421505 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77b00b4510 0x7f77b01504b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:07.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.752+0000 7f77affff700 1 -- 172.21.15.84:0/905421505 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77b00d0b10 msgr2=0x7f77b006bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:07.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.752+0000 7f77affff700 1 --2- 172.21.15.84:0/905421505 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77b00d0b10 0x7f77b006bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:07.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.752+0000 7f77affff700 1 -- 172.21.15.84:0/905421505 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f779c009550 con 0x7f77b00b5d90 2023-07-14T11:19:07.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.752+0000 7f77b4f9b700 1 --2- 172.21.15.84:0/905421505 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77b00b4510 0x7f77b01504b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:19:07.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.752+0000 7f77affff700 1 --2- 172.21.15.84:0/905421505 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77b00b5d90 0x7f77b006b880 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f779c009c10 tx=0x7f779c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:07.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.752+0000 7f77ad7fa700 1 -- 172.21.15.84:0/905421505 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779c004590 con 0x7f77b00b5d90 2023-07-14T11:19:07.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.752+0000 7f77ad7fa700 1 -- 172.21.15.84:0/905421505 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f779c01e070 con 0x7f77b00b5d90 2023-07-14T11:19:07.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.752+0000 7f77ad7fa700 1 -- 172.21.15.84:0/905421505 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779c0038a0 con 0x7f77b00b5d90 2023-07-14T11:19:07.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.752+0000 7f77b71ff700 1 -- 172.21.15.84:0/905421505 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77b0154390 con 0x7f77b00b5d90 2023-07-14T11:19:07.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.753+0000 7f77b71ff700 1 -- 172.21.15.84:0/905421505 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77b01509f0 con 0x7f77b00b5d90 2023-07-14T11:19:07.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.754+0000 7f77b71ff700 1 -- 172.21.15.84:0/905421505 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77b00c9ff0 con 0x7f77b00b5d90 2023-07-14T11:19:07.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.754+0000 7f77ad7fa700 1 -- 172.21.15.84:0/905421505 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f779c003a00 con 0x7f77b00b5d90 2023-07-14T11:19:07.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.756+0000 7f77ad7fa700 1 --2- 172.21.15.84:0/905421505 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f779406ae00 0x7f779406d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:07.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.756+0000 7f77ad7fa700 1 -- 172.21.15.84:0/905421505 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f779c020070 con 0x7f77b00b5d90 2023-07-14T11:19:07.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.756+0000 7f77b4f9b700 1 --2- 172.21.15.84:0/905421505 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f779406ae00 0x7f779406d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:07.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.757+0000 7f77b4f9b700 1 --2- 172.21.15.84:0/905421505 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f779406ae00 0x7f779406d2b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f77a4000fb0 tx=0x7f77a4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:07.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:07.761+0000 7f77ad7fa700 1 -- 172.21.15.84:0/905421505 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f77b00c9ff0 con 0x7f77b00b5d90 2023-07-14T11:19:08.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.002+0000 7f77b71ff700 1 -- 172.21.15.84:0/905421505 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f77b00ca6b0 con 0x7f77b00b5d90 2023-07-14T11:19:08.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.003+0000 7f77ad7fa700 1 -- 172.21.15.84:0/905421505 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4717 (secure 0 0 0) 0x7f77b00ca6b0 con 0x7f77b00b5d90 2023-07-14T11:19:08.005 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:19:08.006 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":60,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5945,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6834/3102047639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":3102047639},{"type":"v1","addr":"172.21.15.84:6834","nonce":3102047639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":5951,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/1883008963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1883008963},{"type":"v1","addr":"172.21.15.179:6835","nonce":1883008963}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":6901,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3521110991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":3521110991},{"type":"v1","addr":"172.21.15.179:6834","nonce":3521110991}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T11:18:42.500325+0000","modified":"2023-07-14T11:18:46.028519+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7227},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7227":{"gid":7227,"name":"c","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6835/3879250964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6833","nonce":3879250964},{"type":"v1","addr":"172.21.15.84:6835","nonce":3879250964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-07-14T11:19:08.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.005+0000 7f77b71ff700 1 -- 172.21.15.84:0/905421505 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f779406ae00 msgr2=0x7f779406d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:08.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.005+0000 7f77b71ff700 1 --2- 172.21.15.84:0/905421505 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f779406ae00 0x7f779406d2b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f77a4000fb0 tx=0x7f77a4009040 comp rx=0 tx=0).stop 2023-07-14T11:19:08.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.005+0000 7f77b71ff700 1 -- 172.21.15.84:0/905421505 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77b00b5d90 msgr2=0x7f77b006b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:08.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.005+0000 7f77b71ff700 1 --2- 172.21.15.84:0/905421505 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77b00b5d90 0x7f77b006b880 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f779c009c10 tx=0x7f779c004750 comp rx=0 tx=0).stop 2023-07-14T11:19:08.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.005+0000 7f77b71ff700 1 -- 172.21.15.84:0/905421505 shutdown_connections 2023-07-14T11:19:08.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.005+0000 7f77b71ff700 1 --2- 172.21.15.84:0/905421505 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f779406ae00 0x7f779406d2b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:08.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.005+0000 7f77b71ff700 1 --2- 172.21.15.84:0/905421505 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77b00b4510 0x7f77b01504b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:08.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.005+0000 7f77b71ff700 1 --2- 172.21.15.84:0/905421505 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77b00d0b10 0x7f77b006bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:08.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.005+0000 7f77b71ff700 1 --2- 172.21.15.84:0/905421505 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77b00b5d90 0x7f77b006b880 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:08.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.005+0000 7f77b71ff700 1 -- 172.21.15.84:0/905421505 >> 172.21.15.84:0/905421505 conn(0x7f77b009c1d0 msgr2=0x7f77b015b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:08.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.005+0000 7f77b71ff700 1 -- 172.21.15.84:0/905421505 shutdown_connections 2023-07-14T11:19:08.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.005+0000 7f77b71ff700 1 -- 172.21.15.84:0/905421505 wait complete. 2023-07-14T11:19:08.010 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 60 2023-07-14T11:19:08.025 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:19:08.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.218+0000 7f865e1ff700 1 Processor -- start 2023-07-14T11:19:08.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.219+0000 7f865e1ff700 1 -- start start 2023-07-14T11:19:08.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.220+0000 7f865e1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f865815e890 0x7f86580cee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:08.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.220+0000 7f865e1ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86580ce110 con 0x7f865815afd0 2023-07-14T11:19:08.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.220+0000 7f865e1ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f865815b660 con 0x7f86580b3780 2023-07-14T11:19:08.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.220+0000 7f865e1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f865815b450 con 0x7f865815e890 2023-07-14T11:19:08.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.220+0000 7f8657fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f865815afd0 0x7f8658150c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52170/0 (socket says 172.21.15.84:52170) 2023-07-14T11:19:08.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.220+0000 7f8657fff700 1 -- 172.21.15.84:0/932266469 learned_addr learned my addr 172.21.15.84:0/932266469 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:19:08.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.220+0000 7f86577fe700 1 --2- 172.21.15.84:0/932266469 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f865815e890 0x7f86580cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:08.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.221+0000 7f8656ffd700 1 -- 172.21.15.84:0/932266469 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4263096065 0 0) 0x7f86580ce110 con 0x7f865815afd0 2023-07-14T11:19:08.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.221+0000 7f8656ffd700 1 -- 172.21.15.84:0/932266469 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86440035b0 con 0x7f865815afd0 2023-07-14T11:19:08.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.221+0000 7f86577fe700 1 -- 172.21.15.84:0/932266469 >> v1:172.21.15.179:6789/0 conn(0x7f86580b3780 legacy=0x7f865815a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:08.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.221+0000 7f8656ffd700 1 -- 172.21.15.84:0/932266469 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 97461100 0 0) 0x7f865815b660 con 0x7f86580b3780 2023-07-14T11:19:08.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.221+0000 7f86577fe700 1 -- 172.21.15.84:0/932266469 >> v1:172.21.15.84:6789/0 conn(0x7f865815afd0 legacy=0x7f8658150c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:08.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.221+0000 7f86577fe700 1 -- 172.21.15.84:0/932266469 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86580ce360 con 0x7f865815e890 2023-07-14T11:19:08.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.221+0000 7f86577fe700 1 --2- 172.21.15.84:0/932266469 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f865815e890 0x7f86580cee40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8648009870 tx=0x7f8648009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43cad6bfe4875dfd server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:08.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.221+0000 7f8656ffd700 1 -- 172.21.15.84:0/932266469 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8648011830 con 0x7f865815e890 2023-07-14T11:19:08.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.221+0000 7f8656ffd700 1 -- 172.21.15.84:0/932266469 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8648011990 con 0x7f865815e890 2023-07-14T11:19:08.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.221+0000 7f8656ffd700 1 -- 172.21.15.84:0/932266469 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8648011d20 con 0x7f865815e890 2023-07-14T11:19:08.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.222+0000 7f865e1ff700 1 -- 172.21.15.84:0/932266469 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f865815e890 msgr2=0x7f86580cee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:08.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.222+0000 7f865e1ff700 1 --2- 172.21.15.84:0/932266469 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f865815e890 0x7f86580cee40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8648009870 tx=0x7f8648009b80 comp rx=0 tx=0).stop 2023-07-14T11:19:08.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.222+0000 7f865e1ff700 1 -- 172.21.15.84:0/932266469 shutdown_connections 2023-07-14T11:19:08.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.222+0000 7f865e1ff700 1 --2- 172.21.15.84:0/932266469 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f865815e890 0x7f86580cee40 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:08.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.222+0000 7f865e1ff700 1 -- 172.21.15.84:0/932266469 >> 172.21.15.84:0/932266469 conn(0x7f8658069f30 msgr2=0x7f865806a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:08.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.222+0000 7f865e1ff700 1 -- 172.21.15.84:0/932266469 shutdown_connections 2023-07-14T11:19:08.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.222+0000 7f865e1ff700 1 -- 172.21.15.84:0/932266469 wait complete. 2023-07-14T11:19:08.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.224+0000 7f865e1ff700 1 Processor -- start 2023-07-14T11:19:08.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.224+0000 7f865e1ff700 1 -- start start 2023-07-14T11:19:08.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.225+0000 7f865e1ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86580b3780 0x7f86581f62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:08.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.225+0000 7f865e1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f865815afd0 0x7f865814d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:08.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.225+0000 7f865e1ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f865815e890 0x7f8658159570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:08.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.225+0000 7f865e1ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f865814d990 con 0x7f865815e890 2023-07-14T11:19:08.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.225+0000 7f865e1ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86581f22a0 con 0x7f86580b3780 2023-07-14T11:19:08.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.225+0000 7f865e1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86581f2540 con 0x7f865815afd0 2023-07-14T11:19:08.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.225+0000 7f8657fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f865815e890 0x7f8658159570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:08.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.225+0000 7f8657fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f865815e890 0x7f8658159570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39254/0 (socket says 172.21.15.84:39254) 2023-07-14T11:19:08.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.225+0000 7f8657fff700 1 -- 172.21.15.84:0/3988954682 learned_addr learned my addr 172.21.15.84:0/3988954682 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:08.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.225+0000 7f864ffff700 1 --2- 172.21.15.84:0/3988954682 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f865815afd0 0x7f865814d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:08.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.225+0000 7f86577fe700 1 --2- 172.21.15.84:0/3988954682 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86580b3780 0x7f86581f62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:08.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.225+0000 7f8657fff700 1 -- 172.21.15.84:0/3988954682 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f865815afd0 msgr2=0x7f865814d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:08.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.225+0000 7f8657fff700 1 --2- 172.21.15.84:0/3988954682 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f865815afd0 0x7f865814d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:08.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.225+0000 7f8657fff700 1 -- 172.21.15.84:0/3988954682 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86580b3780 msgr2=0x7f86581f62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:08.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.225+0000 7f8657fff700 1 --2- 172.21.15.84:0/3988954682 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86580b3780 0x7f86581f62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:08.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.225+0000 7f8657fff700 1 -- 172.21.15.84:0/3988954682 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86480094a0 con 0x7f865815e890 2023-07-14T11:19:08.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.226+0000 7f8657fff700 1 --2- 172.21.15.84:0/3988954682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f865815e890 0x7f8658159570 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f865000cb40 tx=0x7f865000cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:08.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.226+0000 7f8654ff9700 1 -- 172.21.15.84:0/3988954682 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865000ab50 con 0x7f865815e890 2023-07-14T11:19:08.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.226+0000 7f8654ff9700 1 -- 172.21.15.84:0/3988954682 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f865000acb0 con 0x7f865815e890 2023-07-14T11:19:08.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.226+0000 7f8654ff9700 1 -- 172.21.15.84:0/3988954682 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8650012620 con 0x7f865815e890 2023-07-14T11:19:08.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.226+0000 7f865e1ff700 1 -- 172.21.15.84:0/3988954682 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86581f2820 con 0x7f865815e890 2023-07-14T11:19:08.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.226+0000 7f865e1ff700 1 -- 172.21.15.84:0/3988954682 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f865814dbf0 con 0x7f865815e890 2023-07-14T11:19:08.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.227+0000 7f865e1ff700 1 -- 172.21.15.84:0/3988954682 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86581f2d40 con 0x7f865815e890 2023-07-14T11:19:08.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.228+0000 7f8654ff9700 1 -- 172.21.15.84:0/3988954682 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f865001b3b0 con 0x7f865815e890 2023-07-14T11:19:08.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.229+0000 7f8654ff9700 1 --2- 172.21.15.84:0/3988954682 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f863806ae00 0x7f863806d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:08.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.229+0000 7f8654ff9700 1 -- 172.21.15.84:0/3988954682 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f86500894c0 con 0x7f865815e890 2023-07-14T11:19:08.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.229+0000 7f86577fe700 1 --2- 172.21.15.84:0/3988954682 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f863806ae00 0x7f863806d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:08.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.230+0000 7f86577fe700 1 --2- 172.21.15.84:0/3988954682 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f863806ae00 0x7f863806d2b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f86480097c0 tx=0x7f864801c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:08.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.233+0000 7f8654ff9700 1 -- 172.21.15.84:0/3988954682 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f86581f2d40 con 0x7f865815e890 2023-07-14T11:19:08.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.426+0000 7f865e1ff700 1 -- 172.21.15.84:0/3988954682 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f86581f2d40 con 0x7f865815e890 2023-07-14T11:19:08.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.428+0000 7f8654ff9700 1 -- 172.21.15.84:0/3988954682 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+18401 (secure 0 0 0) 0x7f86581f2d40 con 0x7f865815e890 2023-07-14T11:19:08.430 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:19:08.431 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":95,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:19:01.484069+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-07-14T11:18:40.531166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-07-14T11:18:41.475653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.179:6834/4019917691":"2023-07-15T11:18:58.463254+0000","172.21.15.179:6833/4019917691":"2023-07-15T11:18:58.463254+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:19:08.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.430+0000 7f865e1ff700 1 -- 172.21.15.84:0/3988954682 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f863806ae00 msgr2=0x7f863806d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:08.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.430+0000 7f865e1ff700 1 --2- 172.21.15.84:0/3988954682 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f863806ae00 0x7f863806d2b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f86480097c0 tx=0x7f864801c040 comp rx=0 tx=0).stop 2023-07-14T11:19:08.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.430+0000 7f865e1ff700 1 -- 172.21.15.84:0/3988954682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f865815e890 msgr2=0x7f8658159570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:08.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.430+0000 7f865e1ff700 1 --2- 172.21.15.84:0/3988954682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f865815e890 0x7f8658159570 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f865000cb40 tx=0x7f865000cf00 comp rx=0 tx=0).stop 2023-07-14T11:19:08.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.430+0000 7f865e1ff700 1 -- 172.21.15.84:0/3988954682 shutdown_connections 2023-07-14T11:19:08.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.430+0000 7f865e1ff700 1 --2- 172.21.15.84:0/3988954682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f865815e890 0x7f8658159570 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:08.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.430+0000 7f865e1ff700 1 --2- 172.21.15.84:0/3988954682 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86580b3780 0x7f86581f62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:08.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.430+0000 7f865e1ff700 1 --2- 172.21.15.84:0/3988954682 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f863806ae00 0x7f863806d2b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:08.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.430+0000 7f865e1ff700 1 --2- 172.21.15.84:0/3988954682 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f865815afd0 0x7f865814d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:08.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.430+0000 7f865e1ff700 1 -- 172.21.15.84:0/3988954682 >> 172.21.15.84:0/3988954682 conn(0x7f8658069f30 msgr2=0x7f865815a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:08.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.430+0000 7f865e1ff700 1 -- 172.21.15.84:0/3988954682 shutdown_connections 2023-07-14T11:19:08.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.431+0000 7f865e1ff700 1 -- 172.21.15.84:0/3988954682 wait complete. 2023-07-14T11:19:08.451 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T11:13:00.125395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T11:13:06.803994+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T11:18:40.531166+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T11:18:41.475653+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T11:19:08.452 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T11:19:08.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.647+0000 7f5645fff700 1 Processor -- start 2023-07-14T11:19:08.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.647+0000 7f5645fff700 1 -- start start 2023-07-14T11:19:08.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.649+0000 7f5645fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f564006f010 0x7f5640071650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:08.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.649+0000 7f5645fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f56400ce030 0x7f5640069f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:08.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.649+0000 7f5645fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f564006a470 0x7f56401601d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:08.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.649+0000 7f5645fff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f564006f3e0 con 0x7f56400ce030 2023-07-14T11:19:08.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.649+0000 7f5645fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f564006a8f0 con 0x7f564006f010 2023-07-14T11:19:08.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.649+0000 7f5645fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56400cdba0 con 0x7f564006a470 2023-07-14T11:19:08.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.649+0000 7f5637fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f56400ce030 0x7f5640069f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:08.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.649+0000 7f5637fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f56400ce030 0x7f5640069f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39258/0 (socket says 172.21.15.84:39258) 2023-07-14T11:19:08.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.649+0000 7f5637fff700 1 -- 172.21.15.84:0/1738473666 learned_addr learned my addr 172.21.15.84:0/1738473666 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:08.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.649+0000 7f563f7fe700 1 --2- 172.21.15.84:0/1738473666 >> v2:172.21.15.179:3300/0 conn(0x7f564006f010 0x7f5640071650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:08.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.649+0000 7f563ffff700 1 --2- 172.21.15.84:0/1738473666 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f564006a470 0x7f56401601d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:08.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.649+0000 7f5637fff700 1 -- 172.21.15.84:0/1738473666 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f564006a470 msgr2=0x7f56401601d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:08.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.649+0000 7f5637fff700 1 --2- 172.21.15.84:0/1738473666 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f564006a470 0x7f56401601d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:08.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.649+0000 7f5637fff700 1 -- 172.21.15.84:0/1738473666 >> v2:172.21.15.179:3300/0 conn(0x7f564006f010 msgr2=0x7f5640071650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:08.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.649+0000 7f5637fff700 1 --2- 172.21.15.84:0/1738473666 >> v2:172.21.15.179:3300/0 conn(0x7f564006f010 0x7f5640071650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:08.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.649+0000 7f5637fff700 1 -- 172.21.15.84:0/1738473666 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56400cf370 con 0x7f56400ce030 2023-07-14T11:19:08.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.649+0000 7f563ffff700 1 --2- 172.21.15.84:0/1738473666 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f564006a470 0x7f56401601d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:19:08.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.649+0000 7f563f7fe700 1 --2- 172.21.15.84:0/1738473666 >> v2:172.21.15.179:3300/0 conn(0x7f564006f010 0x7f5640071650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:19:08.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.650+0000 7f5637fff700 1 --2- 172.21.15.84:0/1738473666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56400ce030 0x7f5640069f30 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f56400cd6c0 tx=0x7f5628009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fff7ee9fdcdd6b5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:08.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.650+0000 7f563effd700 1 -- 172.21.15.84:0/1738473666 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f562800b870 con 0x7f56400ce030 2023-07-14T11:19:08.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.650+0000 7f563effd700 1 -- 172.21.15.84:0/1738473666 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f562800b9d0 con 0x7f56400ce030 2023-07-14T11:19:08.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.650+0000 7f563effd700 1 -- 172.21.15.84:0/1738473666 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f562800bd60 con 0x7f56400ce030 2023-07-14T11:19:08.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.650+0000 7f5645fff700 1 -- 172.21.15.84:0/1738473666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56400ce030 msgr2=0x7f5640069f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:08.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.650+0000 7f5645fff700 1 --2- 172.21.15.84:0/1738473666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56400ce030 0x7f5640069f30 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f56400cd6c0 tx=0x7f5628009bd0 comp rx=0 tx=0).stop 2023-07-14T11:19:08.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.650+0000 7f5645fff700 1 -- 172.21.15.84:0/1738473666 shutdown_connections 2023-07-14T11:19:08.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.650+0000 7f5645fff700 1 --2- 172.21.15.84:0/1738473666 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f564006a470 0x7f56401601d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:08.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.650+0000 7f5645fff700 1 --2- 172.21.15.84:0/1738473666 >> v2:172.21.15.179:3300/0 conn(0x7f564006f010 0x7f5640071650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:08.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.650+0000 7f5645fff700 1 --2- 172.21.15.84:0/1738473666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56400ce030 0x7f5640069f30 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:08.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.650+0000 7f5645fff700 1 -- 172.21.15.84:0/1738473666 >> 172.21.15.84:0/1738473666 conn(0x7f56400cc640 msgr2=0x7f56400cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:08.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.651+0000 7f5645fff700 1 -- 172.21.15.84:0/1738473666 shutdown_connections 2023-07-14T11:19:08.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.651+0000 7f5645fff700 1 -- 172.21.15.84:0/1738473666 wait complete. 2023-07-14T11:19:08.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.652+0000 7f5645fff700 1 Processor -- start 2023-07-14T11:19:08.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.652+0000 7f5645fff700 1 -- start start 2023-07-14T11:19:08.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.653+0000 7f5645fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f564006a470 0x7f56400b3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:08.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.653+0000 7f5645fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f564006f010 0x7f5640155020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:08.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.653+0000 7f5645fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56400ce030 0x7f56400b3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:08.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.653+0000 7f5645fff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5640155560 con 0x7f564006a470 2023-07-14T11:19:08.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.653+0000 7f5645fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56400b4a60 con 0x7f56400ce030 2023-07-14T11:19:08.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.653+0000 7f5645fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56400b2a90 con 0x7f564006f010 2023-07-14T11:19:08.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.654+0000 7f563f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f564006a470 0x7f56400b3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:08.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.654+0000 7f563f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f564006a470 0x7f56400b3850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39272/0 (socket says 172.21.15.84:39272) 2023-07-14T11:19:08.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.654+0000 7f563f7fe700 1 -- 172.21.15.84:0/2130043179 learned_addr learned my addr 172.21.15.84:0/2130043179 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:08.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.654+0000 7f5637fff700 1 --2- 172.21.15.84:0/2130043179 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f564006f010 0x7f5640155020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:08.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.654+0000 7f563ffff700 1 --2- 172.21.15.84:0/2130043179 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56400ce030 0x7f56400b3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:08.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.654+0000 7f563f7fe700 1 -- 172.21.15.84:0/2130043179 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f564006f010 msgr2=0x7f5640155020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:08.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.654+0000 7f563f7fe700 1 --2- 172.21.15.84:0/2130043179 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f564006f010 0x7f5640155020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:08.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.654+0000 7f563f7fe700 1 -- 172.21.15.84:0/2130043179 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56400ce030 msgr2=0x7f56400b3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:08.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.654+0000 7f563f7fe700 1 --2- 172.21.15.84:0/2130043179 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56400ce030 0x7f56400b3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:08.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.654+0000 7f563f7fe700 1 -- 172.21.15.84:0/2130043179 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5628009550 con 0x7f564006a470 2023-07-14T11:19:08.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.654+0000 7f563ffff700 1 --2- 172.21.15.84:0/2130043179 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56400ce030 0x7f56400b3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:19:08.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.654+0000 7f563f7fe700 1 --2- 172.21.15.84:0/2130043179 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f564006a470 0x7f56400b3850 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f563000c750 tx=0x7f563000ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:08.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.654+0000 7f563cff9700 1 -- 172.21.15.84:0/2130043179 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5630011800 con 0x7f564006a470 2023-07-14T11:19:08.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.655+0000 7f563cff9700 1 -- 172.21.15.84:0/2130043179 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5630011960 con 0x7f564006a470 2023-07-14T11:19:08.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.655+0000 7f563cff9700 1 -- 172.21.15.84:0/2130043179 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5630011cd0 con 0x7f564006a470 2023-07-14T11:19:08.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.655+0000 7f5645fff700 1 -- 172.21.15.84:0/2130043179 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56400b2d70 con 0x7f564006a470 2023-07-14T11:19:08.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.655+0000 7f5645fff700 1 -- 172.21.15.84:0/2130043179 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56400b3330 con 0x7f564006a470 2023-07-14T11:19:08.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.656+0000 7f5645fff700 1 -- 172.21.15.84:0/2130043179 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5640074350 con 0x7f564006a470 2023-07-14T11:19:08.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.657+0000 7f563cff9700 1 -- 172.21.15.84:0/2130043179 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f5630021350 con 0x7f564006a470 2023-07-14T11:19:08.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.658+0000 7f563cff9700 1 --2- 172.21.15.84:0/2130043179 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f562006ae00 0x7f562006d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:08.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.658+0000 7f563cff9700 1 -- 172.21.15.84:0/2130043179 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f5630089700 con 0x7f564006a470 2023-07-14T11:19:08.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.659+0000 7f5637fff700 1 --2- 172.21.15.84:0/2130043179 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f562006ae00 0x7f562006d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:08.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.659+0000 7f5637fff700 1 --2- 172.21.15.84:0/2130043179 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f562006ae00 0x7f562006d2b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5628014040 tx=0x7f5628008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:08.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.662+0000 7f563cff9700 1 -- 172.21.15.84:0/2130043179 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f5630057f20 con 0x7f564006a470 2023-07-14T11:19:08.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.858+0000 7f5645fff700 1 -- 172.21.15.84:0/2130043179 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f56400710e0 con 0x7f564006a470 2023-07-14T11:19:08.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.858+0000 7f563cff9700 1 -- 172.21.15.84:0/2130043179 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v95) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5630057ab0 con 0x7f564006a470 2023-07-14T11:19:08.861 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-07-14T11:19:08.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.860+0000 7f5645fff700 1 -- 172.21.15.84:0/2130043179 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f562006ae00 msgr2=0x7f562006d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:08.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.860+0000 7f5645fff700 1 --2- 172.21.15.84:0/2130043179 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f562006ae00 0x7f562006d2b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5628014040 tx=0x7f5628008030 comp rx=0 tx=0).stop 2023-07-14T11:19:08.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.860+0000 7f5645fff700 1 -- 172.21.15.84:0/2130043179 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f564006a470 msgr2=0x7f56400b3850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:08.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.860+0000 7f5645fff700 1 --2- 172.21.15.84:0/2130043179 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f564006a470 0x7f56400b3850 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f563000c750 tx=0x7f563000ca60 comp rx=0 tx=0).stop 2023-07-14T11:19:08.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.861+0000 7f5645fff700 1 -- 172.21.15.84:0/2130043179 shutdown_connections 2023-07-14T11:19:08.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.861+0000 7f5645fff700 1 --2- 172.21.15.84:0/2130043179 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56400ce030 0x7f56400b3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:08.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.861+0000 7f5645fff700 1 --2- 172.21.15.84:0/2130043179 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f564006a470 0x7f56400b3850 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:08.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.861+0000 7f5645fff700 1 --2- 172.21.15.84:0/2130043179 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f562006ae00 0x7f562006d2b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:08.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.861+0000 7f5645fff700 1 --2- 172.21.15.84:0/2130043179 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f564006f010 0x7f5640155020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:08.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.861+0000 7f5645fff700 1 -- 172.21.15.84:0/2130043179 >> 172.21.15.84:0/2130043179 conn(0x7f56400cc640 msgr2=0x7f56400ce470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:08.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.861+0000 7f5645fff700 1 -- 172.21.15.84:0/2130043179 shutdown_connections 2023-07-14T11:19:08.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:08.861+0000 7f5645fff700 1 -- 172.21.15.84:0/2130043179 wait complete. 2023-07-14T11:19:08.881 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T11:19:09.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.077+0000 7fb9415ff700 1 Processor -- start 2023-07-14T11:19:09.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.078+0000 7fb9415ff700 1 -- start start 2023-07-14T11:19:09.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.079+0000 7fb9415ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb93c0b4860 0x7fb93c0b4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:09.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.079+0000 7fb9415ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb93c0d02a0 con 0x7fb93c0d12c0 2023-07-14T11:19:09.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.079+0000 7fb9415ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb93c0cfce0 con 0x7fb93c0b8660 2023-07-14T11:19:09.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.079+0000 7fb9415ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb93c0b5210 con 0x7fb93c0b4860 2023-07-14T11:19:09.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.079+0000 7fb93b7fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fb93c0d12c0 0x7fb93c0d1700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:34274/0 (socket says 172.21.15.84:34274) 2023-07-14T11:19:09.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.079+0000 7fb93b7fe700 1 -- 172.21.15.84:0/1723570646 learned_addr learned my addr 172.21.15.84:0/1723570646 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:19:09.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.079+0000 7fb93a7fc700 1 -- 172.21.15.84:0/1723570646 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3466401974 0 0) 0x7fb93c0d02a0 con 0x7fb93c0d12c0 2023-07-14T11:19:09.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.079+0000 7fb933fff700 1 --2- 172.21.15.84:0/1723570646 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb93c0b4860 0x7fb93c0b4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:09.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.079+0000 7fb93a7fc700 1 -- 172.21.15.84:0/1723570646 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9280035b0 con 0x7fb93c0d12c0 2023-07-14T11:19:09.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.080+0000 7fb93a7fc700 1 -- 172.21.15.84:0/1723570646 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3920581252 0 0) 0x7fb9280035b0 con 0x7fb93c0d12c0 2023-07-14T11:19:09.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.080+0000 7fb93a7fc700 1 -- 172.21.15.84:0/1723570646 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb93c0b4860 msgr2=0x7fb93c0b4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:09.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.080+0000 7fb93a7fc700 1 --2- 172.21.15.84:0/1723570646 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb93c0b4860 0x7fb93c0b4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:09.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.080+0000 7fb93a7fc700 1 -- 172.21.15.84:0/1723570646 >> v1:172.21.15.179:6789/0 conn(0x7fb93c0b8660 legacy=0x7fb93c0cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:09.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.080+0000 7fb93a7fc700 1 -- 172.21.15.84:0/1723570646 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb93c0cffc0 con 0x7fb93c0d12c0 2023-07-14T11:19:09.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.080+0000 7fb93a7fc700 1 -- 172.21.15.84:0/1723570646 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7fb9340019f0 con 0x7fb93c0d12c0 2023-07-14T11:19:09.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.080+0000 7fb93a7fc700 1 -- 172.21.15.84:0/1723570646 >> v1:172.21.15.84:6789/0 conn(0x7fb93c0d12c0 legacy=0x7fb93c0d1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:09.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.080+0000 7fb93a7fc700 1 --2- 172.21.15.84:0/1723570646 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb93c0b4860 0x7fb928003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:09.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.080+0000 7fb93a7fc700 1 --2- 172.21.15.84:0/1723570646 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb928004000 0x7fb928004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:09.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.080+0000 7fb93a7fc700 1 --2- 172.21.15.84:0/1723570646 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb928004d90 0x7fb928005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:09.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.080+0000 7fb93a7fc700 1 -- 172.21.15.84:0/1723570646 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb93c0b5210 con 0x7fb928004000 2023-07-14T11:19:09.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.080+0000 7fb93a7fc700 1 -- 172.21.15.84:0/1723570646 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb92800bb20 con 0x7fb928004d90 2023-07-14T11:19:09.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.080+0000 7fb93a7fc700 1 -- 172.21.15.84:0/1723570646 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb92800bce0 con 0x7fb93c0b4860 2023-07-14T11:19:09.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.080+0000 7fb933fff700 1 --2- 172.21.15.84:0/1723570646 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb928004000 0x7fb928004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:09.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.080+0000 7fb93affd700 1 --2- 172.21.15.84:0/1723570646 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb93c0b4860 0x7fb928003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:09.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.080+0000 7fb93b7fe700 1 --2- 172.21.15.84:0/1723570646 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb928004d90 0x7fb928005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:09.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.081+0000 7fb933fff700 1 -- 172.21.15.84:0/1723570646 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb93c0b4860 msgr2=0x7fb928003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:09.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.081+0000 7fb933fff700 1 --2- 172.21.15.84:0/1723570646 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb93c0b4860 0x7fb928003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:09.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.081+0000 7fb933fff700 1 -- 172.21.15.84:0/1723570646 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb928004d90 msgr2=0x7fb928005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:09.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.081+0000 7fb933fff700 1 --2- 172.21.15.84:0/1723570646 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb928004d90 0x7fb928005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:09.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.081+0000 7fb933fff700 1 -- 172.21.15.84:0/1723570646 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9280035b0 con 0x7fb928004000 2023-07-14T11:19:09.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.081+0000 7fb93b7fe700 1 --2- 172.21.15.84:0/1723570646 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb928004d90 0x7fb928005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:19:09.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.081+0000 7fb933fff700 1 --2- 172.21.15.84:0/1723570646 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb928004000 0x7fb928004850 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7fb924009b60 tx=0x7fb928005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=292c4de212a9d6dc server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:09.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.081+0000 7fb93a7fc700 1 -- 172.21.15.84:0/1723570646 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92400e6c0 con 0x7fb928004000 2023-07-14T11:19:09.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.081+0000 7fb93a7fc700 1 -- 172.21.15.84:0/1723570646 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb92400e820 con 0x7fb928004000 2023-07-14T11:19:09.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.081+0000 7fb93a7fc700 1 -- 172.21.15.84:0/1723570646 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92400eb90 con 0x7fb928004000 2023-07-14T11:19:09.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.082+0000 7fb9415ff700 1 -- 172.21.15.84:0/1723570646 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb928004000 msgr2=0x7fb928004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:09.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.082+0000 7fb9415ff700 1 --2- 172.21.15.84:0/1723570646 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb928004000 0x7fb928004850 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7fb924009b60 tx=0x7fb928005880 comp rx=0 tx=0).stop 2023-07-14T11:19:09.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.082+0000 7fb93b7fe700 1 -- 172.21.15.84:0/1723570646 reap_dead start 2023-07-14T11:19:09.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.082+0000 7fb9415ff700 1 -- 172.21.15.84:0/1723570646 shutdown_connections 2023-07-14T11:19:09.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.082+0000 7fb9415ff700 1 -- 172.21.15.84:0/1723570646 >> 172.21.15.84:0/1723570646 conn(0x7fb93c066860 msgr2=0x7fb93c06a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:09.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.082+0000 7fb9415ff700 1 -- 172.21.15.84:0/1723570646 shutdown_connections 2023-07-14T11:19:09.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.082+0000 7fb9415ff700 1 -- 172.21.15.84:0/1723570646 wait complete. 2023-07-14T11:19:09.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.084+0000 7fb9415ff700 1 Processor -- start 2023-07-14T11:19:09.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.084+0000 7fb9415ff700 1 -- start start 2023-07-14T11:19:09.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.085+0000 7fb9415ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb928004000 0x7fb93c1584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:09.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.085+0000 7fb9415ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb93c158c80 0x7fb93c0c7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:09.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.085+0000 7fb9415ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb93c1f2360 0x7fb93c0b24b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:09.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.085+0000 7fb9415ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb93c0cb5e0 con 0x7fb93c158c80 2023-07-14T11:19:09.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.085+0000 7fb9415ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb93c158a10 con 0x7fb928004000 2023-07-14T11:19:09.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.085+0000 7fb9415ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb93c0c95b0 con 0x7fb93c1f2360 2023-07-14T11:19:09.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.085+0000 7fb933fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb93c158c80 0x7fb93c0c7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:09.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.085+0000 7fb933fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb93c158c80 0x7fb93c0c7b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34104/0 (socket says 172.21.15.84:34104) 2023-07-14T11:19:09.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.085+0000 7fb933fff700 1 -- 172.21.15.84:0/2844129165 learned_addr learned my addr 172.21.15.84:0/2844129165 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:09.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.085+0000 7fb93affd700 1 --2- 172.21.15.84:0/2844129165 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb928004000 0x7fb93c1584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:09.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.085+0000 7fb93b7fe700 1 --2- 172.21.15.84:0/2844129165 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb93c1f2360 0x7fb93c0b24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:09.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.085+0000 7fb933fff700 1 -- 172.21.15.84:0/2844129165 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb93c1f2360 msgr2=0x7fb93c0b24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:09.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.085+0000 7fb933fff700 1 --2- 172.21.15.84:0/2844129165 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb93c1f2360 0x7fb93c0b24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:09.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.085+0000 7fb933fff700 1 -- 172.21.15.84:0/2844129165 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb928004000 msgr2=0x7fb93c1584d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:09.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.085+0000 7fb933fff700 1 --2- 172.21.15.84:0/2844129165 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb928004000 0x7fb93c1584d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:09.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.085+0000 7fb933fff700 1 -- 172.21.15.84:0/2844129165 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb93c0c9850 con 0x7fb93c158c80 2023-07-14T11:19:09.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.086+0000 7fb933fff700 1 --2- 172.21.15.84:0/2844129165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb93c158c80 0x7fb93c0c7b10 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7fb92800baf0 tx=0x7fb9240047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:09.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.086+0000 7fb9337fe700 1 -- 172.21.15.84:0/2844129165 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92400e6c0 con 0x7fb93c158c80 2023-07-14T11:19:09.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.086+0000 7fb9337fe700 1 -- 172.21.15.84:0/2844129165 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9240038a0 con 0x7fb93c158c80 2023-07-14T11:19:09.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.086+0000 7fb9415ff700 1 -- 172.21.15.84:0/2844129165 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb93c0c9af0 con 0x7fb93c158c80 2023-07-14T11:19:09.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.086+0000 7fb9337fe700 1 -- 172.21.15.84:0/2844129165 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb924003c50 con 0x7fb93c158c80 2023-07-14T11:19:09.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.086+0000 7fb9415ff700 1 -- 172.21.15.84:0/2844129165 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb93c0cbb10 con 0x7fb93c158c80 2023-07-14T11:19:09.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.087+0000 7fb9415ff700 1 -- 172.21.15.84:0/2844129165 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb93c0cbcd0 con 0x7fb93c158c80 2023-07-14T11:19:09.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.088+0000 7fb9337fe700 1 -- 172.21.15.84:0/2844129165 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7fb924013470 con 0x7fb93c158c80 2023-07-14T11:19:09.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.089+0000 7fb9337fe700 1 --2- 172.21.15.84:0/2844129165 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fb91c06ae00 0x7fb91c06d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:09.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.089+0000 7fb9337fe700 1 -- 172.21.15.84:0/2844129165 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6148+0+0 (secure 0 0 0) 0x7fb92408af90 con 0x7fb93c158c80 2023-07-14T11:19:09.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.090+0000 7fb93affd700 1 --2- 172.21.15.84:0/2844129165 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fb91c06ae00 0x7fb91c06d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:09.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.090+0000 7fb93affd700 1 --2- 172.21.15.84:0/2844129165 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fb91c06ae00 0x7fb91c06d2b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb93c0d3bf0 tx=0x7fb92c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:09.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.093+0000 7fb9337fe700 1 -- 172.21.15.84:0/2844129165 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fb9240bd330 con 0x7fb93c158c80 2023-07-14T11:19:09.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.285+0000 7fb9415ff700 1 -- 172.21.15.84:0/2844129165 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb93c0cbe80 con 0x7fb93c158c80 2023-07-14T11:19:09.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.286+0000 7fb9337fe700 1 -- 172.21.15.84:0/2844129165 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v95) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb924017020 con 0x7fb93c158c80 2023-07-14T11:19:09.289 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-07-14T11:19:09.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.288+0000 7fb9415ff700 1 -- 172.21.15.84:0/2844129165 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fb91c06ae00 msgr2=0x7fb91c06d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:09.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.288+0000 7fb9415ff700 1 --2- 172.21.15.84:0/2844129165 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fb91c06ae00 0x7fb91c06d2b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb93c0d3bf0 tx=0x7fb92c009040 comp rx=0 tx=0).stop 2023-07-14T11:19:09.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.288+0000 7fb9415ff700 1 -- 172.21.15.84:0/2844129165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb93c158c80 msgr2=0x7fb93c0c7b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:09.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.288+0000 7fb9415ff700 1 --2- 172.21.15.84:0/2844129165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb93c158c80 0x7fb93c0c7b10 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7fb92800baf0 tx=0x7fb9240047c0 comp rx=0 tx=0).stop 2023-07-14T11:19:09.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.288+0000 7fb9415ff700 1 -- 172.21.15.84:0/2844129165 shutdown_connections 2023-07-14T11:19:09.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.288+0000 7fb9415ff700 1 --2- 172.21.15.84:0/2844129165 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fb91c06ae00 0x7fb91c06d2b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:09.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.288+0000 7fb9415ff700 1 --2- 172.21.15.84:0/2844129165 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb93c1f2360 0x7fb93c0b24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:09.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.288+0000 7fb9415ff700 1 --2- 172.21.15.84:0/2844129165 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb928004000 0x7fb93c1584d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:09.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.288+0000 7fb9415ff700 1 --2- 172.21.15.84:0/2844129165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb93c158c80 0x7fb93c0c7b10 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:09.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.288+0000 7fb9415ff700 1 -- 172.21.15.84:0/2844129165 >> 172.21.15.84:0/2844129165 conn(0x7fb93c066860 msgr2=0x7fb93c0cf250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:09.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.288+0000 7fb9415ff700 1 -- 172.21.15.84:0/2844129165 shutdown_connections 2023-07-14T11:19:09.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.288+0000 7fb9415ff700 1 -- 172.21.15.84:0/2844129165 wait complete. 2023-07-14T11:19:09.309 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T11:19:09.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.505+0000 7f64e23ff700 1 Processor -- start 2023-07-14T11:19:09.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.505+0000 7f64e23ff700 1 -- start start 2023-07-14T11:19:09.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.506+0000 7f64e23ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64dc0d0b10 0x7f64dc0d0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:09.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.506+0000 7f64e23ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f64dc0b0e20 0x7f64dc0b12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:09.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.506+0000 7f64e23ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64dc0d14a0 con 0x7f64dc0b8a60 2023-07-14T11:19:09.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.506+0000 7f64e23ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64dc0b8e30 con 0x7f64dc0b0e20 2023-07-14T11:19:09.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.506+0000 7f64e23ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64dc0afaa0 con 0x7f64dc0d0b10 2023-07-14T11:19:09.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.507+0000 7f64dbfff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f64dc0b8a60 0x7f64dc0b3ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:34282/0 (socket says 172.21.15.84:34282) 2023-07-14T11:19:09.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.507+0000 7f64dbfff700 1 -- 172.21.15.84:0/1137323161 learned_addr learned my addr 172.21.15.84:0/1137323161 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:19:09.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.507+0000 7f64e099c700 1 --2- 172.21.15.84:0/1137323161 >> v2:172.21.15.179:3300/0 conn(0x7f64dc0b0e20 0x7f64dc0b12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:09.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.507+0000 7f64db7fe700 1 --2- 172.21.15.84:0/1137323161 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64dc0d0b10 0x7f64dc0d0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:09.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.507+0000 7f64daffd700 1 -- 172.21.15.84:0/1137323161 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2527075076 0 0) 0x7f64cc001110 con 0x7f64dc0b8a60 2023-07-14T11:19:09.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.507+0000 7f64daffd700 1 -- 172.21.15.84:0/1137323161 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64c40035b0 con 0x7f64dc0b8a60 2023-07-14T11:19:09.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.507+0000 7f64e099c700 1 -- 172.21.15.84:0/1137323161 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64dc0d0b10 msgr2=0x7f64dc0d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:09.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.507+0000 7f64e099c700 1 --2- 172.21.15.84:0/1137323161 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64dc0d0b10 0x7f64dc0d0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:09.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.507+0000 7f64e099c700 1 -- 172.21.15.84:0/1137323161 >> v1:172.21.15.84:6789/0 conn(0x7f64dc0b8a60 legacy=0x7f64dc0b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:09.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.507+0000 7f64e099c700 1 -- 172.21.15.84:0/1137323161 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64dc0afd80 con 0x7f64dc0b0e20 2023-07-14T11:19:09.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.507+0000 7f64db7fe700 1 --2- 172.21.15.84:0/1137323161 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64dc0d0b10 0x7f64dc0d0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:19:09.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.508+0000 7f64e099c700 1 --2- 172.21.15.84:0/1137323161 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64dc0b0e20 0x7f64dc0b12a0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f64d4009d90 tx=0x7f64d400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5fe33123f9d3095c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:09.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.508+0000 7f64daffd700 1 -- 172.21.15.84:0/1137323161 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d400e070 con 0x7f64dc0b0e20 2023-07-14T11:19:09.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.508+0000 7f64daffd700 1 -- 172.21.15.84:0/1137323161 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64d400bb20 con 0x7f64dc0b0e20 2023-07-14T11:19:09.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.508+0000 7f64daffd700 1 -- 172.21.15.84:0/1137323161 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d400be90 con 0x7f64dc0b0e20 2023-07-14T11:19:09.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.508+0000 7f64e23ff700 1 -- 172.21.15.84:0/1137323161 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64dc0b0e20 msgr2=0x7f64dc0b12a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:09.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.508+0000 7f64e23ff700 1 --2- 172.21.15.84:0/1137323161 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64dc0b0e20 0x7f64dc0b12a0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f64d4009d90 tx=0x7f64d400b330 comp rx=0 tx=0).stop 2023-07-14T11:19:09.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.509+0000 7f64e23ff700 1 -- 172.21.15.84:0/1137323161 shutdown_connections 2023-07-14T11:19:09.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.509+0000 7f64e23ff700 1 --2- 172.21.15.84:0/1137323161 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64dc0b0e20 0x7f64dc0b12a0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:09.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.509+0000 7f64e23ff700 1 --2- 172.21.15.84:0/1137323161 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64dc0d0b10 0x7f64dc0d0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:09.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.509+0000 7f64e23ff700 1 -- 172.21.15.84:0/1137323161 >> 172.21.15.84:0/1137323161 conn(0x7f64dc09c1b0 msgr2=0x7f64dc0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:09.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.509+0000 7f64e23ff700 1 -- 172.21.15.84:0/1137323161 shutdown_connections 2023-07-14T11:19:09.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.509+0000 7f64e23ff700 1 -- 172.21.15.84:0/1137323161 wait complete. 2023-07-14T11:19:09.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.511+0000 7f64e23ff700 1 Processor -- start 2023-07-14T11:19:09.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.511+0000 7f64e23ff700 1 -- start start 2023-07-14T11:19:09.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.512+0000 7f64e23ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64dc0b0e20 0x7f64dc151d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:09.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.512+0000 7f64e23ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64dc0b8a60 0x7f64dc0cf100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:09.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.512+0000 7f64e23ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64dc0d0b10 0x7f64dc0cf640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:09.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.512+0000 7f64e23ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64dc0ce7a0 con 0x7f64dc0b8a60 2023-07-14T11:19:09.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.512+0000 7f64e23ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64dc1528c0 con 0x7f64dc0b0e20 2023-07-14T11:19:09.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.512+0000 7f64e23ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64dc0cdb90 con 0x7f64dc0d0b10 2023-07-14T11:19:09.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.513+0000 7f64db7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64dc0b8a60 0x7f64dc0cf100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:09.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.513+0000 7f64db7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64dc0b8a60 0x7f64dc0cf100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34120/0 (socket says 172.21.15.84:34120) 2023-07-14T11:19:09.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.513+0000 7f64db7fe700 1 -- 172.21.15.84:0/4190224699 learned_addr learned my addr 172.21.15.84:0/4190224699 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:09.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.513+0000 7f64dbfff700 1 --2- 172.21.15.84:0/4190224699 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64dc0b0e20 0x7f64dc151d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:09.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.513+0000 7f64e099c700 1 --2- 172.21.15.84:0/4190224699 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64dc0d0b10 0x7f64dc0cf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:09.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.513+0000 7f64db7fe700 1 -- 172.21.15.84:0/4190224699 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64dc0d0b10 msgr2=0x7f64dc0cf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:09.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.513+0000 7f64db7fe700 1 --2- 172.21.15.84:0/4190224699 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64dc0d0b10 0x7f64dc0cf640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:09.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.513+0000 7f64db7fe700 1 -- 172.21.15.84:0/4190224699 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64dc0b0e20 msgr2=0x7f64dc151d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:09.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.513+0000 7f64db7fe700 1 --2- 172.21.15.84:0/4190224699 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64dc0b0e20 0x7f64dc151d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:09.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.513+0000 7f64db7fe700 1 -- 172.21.15.84:0/4190224699 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64d00094a0 con 0x7f64dc0b8a60 2023-07-14T11:19:09.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.513+0000 7f64db7fe700 1 --2- 172.21.15.84:0/4190224699 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64dc0b8a60 0x7f64dc0cf100 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f64d000ebe0 tx=0x7f64d0009e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:09.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.514+0000 7f64d8ff9700 1 -- 172.21.15.84:0/4190224699 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d000c8b0 con 0x7f64dc0b8a60 2023-07-14T11:19:09.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.514+0000 7f64d8ff9700 1 -- 172.21.15.84:0/4190224699 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64d000ca10 con 0x7f64dc0b8a60 2023-07-14T11:19:09.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.514+0000 7f64d8ff9700 1 -- 172.21.15.84:0/4190224699 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d000cda0 con 0x7f64dc0b8a60 2023-07-14T11:19:09.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.514+0000 7f64e23ff700 1 -- 172.21.15.84:0/4190224699 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64d4009a70 con 0x7f64dc0b8a60 2023-07-14T11:19:09.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.514+0000 7f64e23ff700 1 -- 172.21.15.84:0/4190224699 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64dc0ce150 con 0x7f64dc0b8a60 2023-07-14T11:19:09.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.515+0000 7f64e23ff700 1 -- 172.21.15.84:0/4190224699 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64dc0ce910 con 0x7f64dc0b8a60 2023-07-14T11:19:09.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.516+0000 7f64d8ff9700 1 -- 172.21.15.84:0/4190224699 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f64d0013470 con 0x7f64dc0b8a60 2023-07-14T11:19:09.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.516+0000 7f64d8ff9700 1 --2- 172.21.15.84:0/4190224699 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f64c806ae00 0x7f64c806d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:09.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.516+0000 7f64d8ff9700 1 -- 172.21.15.84:0/4190224699 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f64d00898a0 con 0x7f64dc0b8a60 2023-07-14T11:19:09.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.517+0000 7f64dbfff700 1 --2- 172.21.15.84:0/4190224699 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f64c806ae00 0x7f64c806d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:09.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.517+0000 7f64dbfff700 1 --2- 172.21.15.84:0/4190224699 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f64c806ae00 0x7f64c806d2b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f64cc005910 tx=0x7f64cc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:09.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.521+0000 7f64d8ff9700 1 -- 172.21.15.84:0/4190224699 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f64d0054740 con 0x7f64dc0b8a60 2023-07-14T11:19:09.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.716+0000 7f64e23ff700 1 -- 172.21.15.84:0/4190224699 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f64dc074350 con 0x7f64dc0b8a60 2023-07-14T11:19:09.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.716+0000 7f64d8ff9700 1 -- 172.21.15.84:0/4190224699 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v95) v1 ==== 104+0+11 (secure 0 0 0) 0x7f64d0057d60 con 0x7f64dc0b8a60 2023-07-14T11:19:09.719 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-07-14T11:19:09.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.718+0000 7f64e23ff700 1 -- 172.21.15.84:0/4190224699 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f64c806ae00 msgr2=0x7f64c806d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:09.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.718+0000 7f64e23ff700 1 --2- 172.21.15.84:0/4190224699 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f64c806ae00 0x7f64c806d2b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f64cc005910 tx=0x7f64cc009040 comp rx=0 tx=0).stop 2023-07-14T11:19:09.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.718+0000 7f64e23ff700 1 -- 172.21.15.84:0/4190224699 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64dc0b8a60 msgr2=0x7f64dc0cf100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:09.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.718+0000 7f64e23ff700 1 --2- 172.21.15.84:0/4190224699 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64dc0b8a60 0x7f64dc0cf100 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f64d000ebe0 tx=0x7f64d0009e20 comp rx=0 tx=0).stop 2023-07-14T11:19:09.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.718+0000 7f64e23ff700 1 -- 172.21.15.84:0/4190224699 shutdown_connections 2023-07-14T11:19:09.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.718+0000 7f64e23ff700 1 --2- 172.21.15.84:0/4190224699 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f64c806ae00 0x7f64c806d2b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:09.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.718+0000 7f64e23ff700 1 --2- 172.21.15.84:0/4190224699 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64dc0d0b10 0x7f64dc0cf640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:09.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.718+0000 7f64e23ff700 1 --2- 172.21.15.84:0/4190224699 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64dc0b0e20 0x7f64dc151d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:09.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.718+0000 7f64e23ff700 1 --2- 172.21.15.84:0/4190224699 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64dc0b8a60 0x7f64dc0cf100 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:09.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.718+0000 7f64e23ff700 1 -- 172.21.15.84:0/4190224699 >> 172.21.15.84:0/4190224699 conn(0x7f64dc09c1b0 msgr2=0x7f64dc06a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:09.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.719+0000 7f64e23ff700 1 -- 172.21.15.84:0/4190224699 shutdown_connections 2023-07-14T11:19:09.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.719+0000 7f64e23ff700 1 -- 172.21.15.84:0/4190224699 wait complete. 2023-07-14T11:19:09.739 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T11:19:09.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.938+0000 7faf86dff700 1 Processor -- start 2023-07-14T11:19:09.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.938+0000 7faf86dff700 1 -- start start 2023-07-14T11:19:09.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.939+0000 7faf86dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf800c92d0 0x7faf800ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:09.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.939+0000 7faf86dff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf8015ce70 con 0x7faf800b12f0 2023-07-14T11:19:09.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.939+0000 7faf86dff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf8015d0c0 con 0x7faf800adea0 2023-07-14T11:19:09.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.939+0000 7faf86dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf8015da60 con 0x7faf800c92d0 2023-07-14T11:19:09.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.939+0000 7faf7ffff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7faf800b12f0 0x7faf800c96a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:34296/0 (socket says 172.21.15.84:34296) 2023-07-14T11:19:09.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.939+0000 7faf7ffff700 1 -- 172.21.15.84:0/3648934174 learned_addr learned my addr 172.21.15.84:0/3648934174 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:19:09.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.940+0000 7faf84b9b700 1 --2- 172.21.15.84:0/3648934174 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf800c92d0 0x7faf800ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:09.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.940+0000 7faf7f7fe700 1 -- 172.21.15.84:0/3648934174 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2814565943 0 0) 0x7faf8015ce70 con 0x7faf800b12f0 2023-07-14T11:19:09.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.940+0000 7faf7f7fe700 1 -- 172.21.15.84:0/3648934174 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf700035b0 con 0x7faf800b12f0 2023-07-14T11:19:09.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.940+0000 7faf7f7fe700 1 -- 172.21.15.84:0/3648934174 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 710659383 0 0) 0x7faf700035b0 con 0x7faf800b12f0 2023-07-14T11:19:09.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.940+0000 7faf7f7fe700 1 -- 172.21.15.84:0/3648934174 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf800c92d0 msgr2=0x7faf800ad8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:09.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.940+0000 7faf7f7fe700 1 --2- 172.21.15.84:0/3648934174 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf800c92d0 0x7faf800ad8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:09.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.940+0000 7faf7f7fe700 1 -- 172.21.15.84:0/3648934174 >> v1:172.21.15.179:6789/0 conn(0x7faf800adea0 legacy=0x7faf800cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:09.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.940+0000 7faf7f7fe700 1 -- 172.21.15.84:0/3648934174 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf8015d3a0 con 0x7faf800b12f0 2023-07-14T11:19:09.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.940+0000 7faf7f7fe700 1 -- 172.21.15.84:0/3648934174 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7faf6c001670 con 0x7faf800b12f0 2023-07-14T11:19:09.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.940+0000 7faf84b9b700 1 --2- 172.21.15.84:0/3648934174 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf800c92d0 0x7faf800ad8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:19:09.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.940+0000 7faf7f7fe700 1 -- 172.21.15.84:0/3648934174 >> v1:172.21.15.84:6789/0 conn(0x7faf800b12f0 legacy=0x7faf800c96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:09.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.940+0000 7faf7f7fe700 1 --2- 172.21.15.84:0/3648934174 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf70003a30 0x7faf70003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:09.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.940+0000 7faf7f7fe700 1 --2- 172.21.15.84:0/3648934174 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf700043d0 0x7faf70004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:09.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.940+0000 7faf7f7fe700 1 --2- 172.21.15.84:0/3648934174 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf800c92d0 0x7faf70005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:09.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.940+0000 7faf7f7fe700 1 -- 172.21.15.84:0/3648934174 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf8015da60 con 0x7faf700043d0 2023-07-14T11:19:09.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.941+0000 7faf7f7fe700 1 -- 172.21.15.84:0/3648934174 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf7000dc50 con 0x7faf70003a30 2023-07-14T11:19:09.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.941+0000 7faf7f7fe700 1 -- 172.21.15.84:0/3648934174 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf7000de10 con 0x7faf800c92d0 2023-07-14T11:19:09.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.941+0000 7faf7ffff700 1 --2- 172.21.15.84:0/3648934174 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf700043d0 0x7faf70004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:09.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.941+0000 7faf84b9b700 1 --2- 172.21.15.84:0/3648934174 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf70003a30 0x7faf70003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:09.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.941+0000 7faf8539c700 1 --2- 172.21.15.84:0/3648934174 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf800c92d0 0x7faf70005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:09.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.941+0000 7faf7ffff700 1 -- 172.21.15.84:0/3648934174 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf800c92d0 msgr2=0x7faf70005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:09.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.941+0000 7faf7ffff700 1 --2- 172.21.15.84:0/3648934174 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf800c92d0 0x7faf70005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:09.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.941+0000 7faf7ffff700 1 -- 172.21.15.84:0/3648934174 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf70003a30 msgr2=0x7faf70003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:09.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.941+0000 7faf7ffff700 1 --2- 172.21.15.84:0/3648934174 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf70003a30 0x7faf70003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:09.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.941+0000 7faf7ffff700 1 -- 172.21.15.84:0/3648934174 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf740094a0 con 0x7faf700043d0 2023-07-14T11:19:09.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.941+0000 7faf7ffff700 1 --2- 172.21.15.84:0/3648934174 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf700043d0 0x7faf70004890 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7faf6c00c2f0 tx=0x7faf70005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9fb7cdc139a0b44 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:09.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.942+0000 7faf7f7fe700 1 -- 172.21.15.84:0/3648934174 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf6c00ce30 con 0x7faf700043d0 2023-07-14T11:19:09.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.942+0000 7faf7f7fe700 1 -- 172.21.15.84:0/3648934174 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf6c005960 con 0x7faf700043d0 2023-07-14T11:19:09.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.942+0000 7faf7f7fe700 1 -- 172.21.15.84:0/3648934174 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf6c005d10 con 0x7faf700043d0 2023-07-14T11:19:09.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.942+0000 7faf86dff700 1 -- 172.21.15.84:0/3648934174 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf700043d0 msgr2=0x7faf70004890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:09.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.942+0000 7faf86dff700 1 --2- 172.21.15.84:0/3648934174 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf700043d0 0x7faf70004890 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7faf6c00c2f0 tx=0x7faf70005880 comp rx=0 tx=0).stop 2023-07-14T11:19:09.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.942+0000 7faf8539c700 1 -- 172.21.15.84:0/3648934174 reap_dead start 2023-07-14T11:19:09.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.942+0000 7faf86dff700 1 -- 172.21.15.84:0/3648934174 shutdown_connections 2023-07-14T11:19:09.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.942+0000 7faf86dff700 1 -- 172.21.15.84:0/3648934174 >> 172.21.15.84:0/3648934174 conn(0x7faf800b05d0 msgr2=0x7faf800b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:09.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.942+0000 7faf86dff700 1 -- 172.21.15.84:0/3648934174 shutdown_connections 2023-07-14T11:19:09.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.942+0000 7faf86dff700 1 -- 172.21.15.84:0/3648934174 wait complete. 2023-07-14T11:19:09.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.944+0000 7faf86dff700 1 Processor -- start 2023-07-14T11:19:09.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.944+0000 7faf86dff700 1 -- start start 2023-07-14T11:19:09.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.945+0000 7faf86dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf700043d0 0x7faf800c6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:09.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.945+0000 7faf86dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf800c65e0 0x7faf80157530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:09.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.945+0000 7faf86dff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf801f1230 0x7faf800ac860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:09.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.945+0000 7faf86dff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf80157a70 con 0x7faf801f1230 2023-07-14T11:19:09.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.945+0000 7faf86dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf800c5b90 con 0x7faf800c65e0 2023-07-14T11:19:09.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.945+0000 7faf86dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf800c6a50 con 0x7faf700043d0 2023-07-14T11:19:09.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.946+0000 7faf8539c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf801f1230 0x7faf800ac860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:09.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.946+0000 7faf8539c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf801f1230 0x7faf800ac860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34130/0 (socket says 172.21.15.84:34130) 2023-07-14T11:19:09.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.946+0000 7faf8539c700 1 -- 172.21.15.84:0/1889050324 learned_addr learned my addr 172.21.15.84:0/1889050324 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:09.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.946+0000 7faf84b9b700 1 --2- 172.21.15.84:0/1889050324 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf700043d0 0x7faf800c6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:09.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.946+0000 7faf7ffff700 1 --2- 172.21.15.84:0/1889050324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf800c65e0 0x7faf80157530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:09.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.946+0000 7faf8539c700 1 -- 172.21.15.84:0/1889050324 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf700043d0 msgr2=0x7faf800c6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:09.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.946+0000 7faf8539c700 1 --2- 172.21.15.84:0/1889050324 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf700043d0 0x7faf800c6cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:09.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.946+0000 7faf8539c700 1 -- 172.21.15.84:0/1889050324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf800c65e0 msgr2=0x7faf80157530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:09.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.946+0000 7faf8539c700 1 --2- 172.21.15.84:0/1889050324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf800c65e0 0x7faf80157530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:09.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.946+0000 7faf8539c700 1 -- 172.21.15.84:0/1889050324 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf800c7340 con 0x7faf801f1230 2023-07-14T11:19:09.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.946+0000 7faf8539c700 1 --2- 172.21.15.84:0/1889050324 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf801f1230 0x7faf800ac860 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7faf78001520 tx=0x7faf7800d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:09.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.946+0000 7faf7d7fa700 1 -- 172.21.15.84:0/1889050324 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf78003c10 con 0x7faf801f1230 2023-07-14T11:19:09.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.947+0000 7faf7d7fa700 1 -- 172.21.15.84:0/1889050324 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf78003d70 con 0x7faf801f1230 2023-07-14T11:19:09.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.947+0000 7faf7d7fa700 1 -- 172.21.15.84:0/1889050324 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf7800daa0 con 0x7faf801f1230 2023-07-14T11:19:09.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.947+0000 7faf86dff700 1 -- 172.21.15.84:0/1889050324 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf800c7620 con 0x7faf801f1230 2023-07-14T11:19:09.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.947+0000 7faf86dff700 1 -- 172.21.15.84:0/1889050324 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf800c60c0 con 0x7faf801f1230 2023-07-14T11:19:09.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.948+0000 7faf86dff700 1 -- 172.21.15.84:0/1889050324 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf800c7810 con 0x7faf801f1230 2023-07-14T11:19:09.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.949+0000 7faf7d7fa700 1 -- 172.21.15.84:0/1889050324 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7faf7800dc00 con 0x7faf801f1230 2023-07-14T11:19:09.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.950+0000 7faf7d7fa700 1 --2- 172.21.15.84:0/1889050324 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7faf6406ae00 0x7faf6406d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:09.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.950+0000 7faf7d7fa700 1 -- 172.21.15.84:0/1889050324 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6148+0+0 (secure 0 0 0) 0x7faf780898a0 con 0x7faf801f1230 2023-07-14T11:19:09.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.950+0000 7faf84b9b700 1 --2- 172.21.15.84:0/1889050324 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7faf6406ae00 0x7faf6406d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:09.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.951+0000 7faf84b9b700 1 --2- 172.21.15.84:0/1889050324 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7faf6406ae00 0x7faf6406d2b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7faf74009dc0 tx=0x7faf74009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:09.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:09.954+0000 7faf7d7fa700 1 -- 172.21.15.84:0/1889050324 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7faf78054740 con 0x7faf801f1230 2023-07-14T11:19:10.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.148+0000 7faf86dff700 1 -- 172.21.15.84:0/1889050324 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7faf80074350 con 0x7faf801f1230 2023-07-14T11:19:10.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.148+0000 7faf7d7fa700 1 -- 172.21.15.84:0/1889050324 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v95) v1 ==== 100+0+11 (secure 0 0 0) 0x7faf78057d60 con 0x7faf801f1230 2023-07-14T11:19:10.151 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-07-14T11:19:10.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.151+0000 7faf86dff700 1 -- 172.21.15.84:0/1889050324 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7faf6406ae00 msgr2=0x7faf6406d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:10.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.151+0000 7faf86dff700 1 --2- 172.21.15.84:0/1889050324 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7faf6406ae00 0x7faf6406d2b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7faf74009dc0 tx=0x7faf74009210 comp rx=0 tx=0).stop 2023-07-14T11:19:10.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.151+0000 7faf86dff700 1 -- 172.21.15.84:0/1889050324 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf801f1230 msgr2=0x7faf800ac860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:10.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.151+0000 7faf86dff700 1 --2- 172.21.15.84:0/1889050324 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf801f1230 0x7faf800ac860 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7faf78001520 tx=0x7faf7800d430 comp rx=0 tx=0).stop 2023-07-14T11:19:10.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.151+0000 7faf86dff700 1 -- 172.21.15.84:0/1889050324 shutdown_connections 2023-07-14T11:19:10.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.151+0000 7faf86dff700 1 --2- 172.21.15.84:0/1889050324 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7faf6406ae00 0x7faf6406d2b0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:10.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.151+0000 7faf86dff700 1 --2- 172.21.15.84:0/1889050324 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf700043d0 0x7faf800c6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:10.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.151+0000 7faf86dff700 1 --2- 172.21.15.84:0/1889050324 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf801f1230 0x7faf800ac860 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:10.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.151+0000 7faf86dff700 1 --2- 172.21.15.84:0/1889050324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf800c65e0 0x7faf80157530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:10.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.151+0000 7faf86dff700 1 -- 172.21.15.84:0/1889050324 >> 172.21.15.84:0/1889050324 conn(0x7faf800b05d0 msgr2=0x7faf80155ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:10.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.151+0000 7faf86dff700 1 -- 172.21.15.84:0/1889050324 shutdown_connections 2023-07-14T11:19:10.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.151+0000 7faf86dff700 1 -- 172.21.15.84:0/1889050324 wait complete. 2023-07-14T11:19:10.171 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T11:19:10.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.363+0000 7ff7173ff700 1 Processor -- start 2023-07-14T11:19:10.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.364+0000 7ff7173ff700 1 -- start start 2023-07-14T11:19:10.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.365+0000 7ff7173ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7101500d0 0x7ff710070350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:10.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.365+0000 7ff7173ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff710070890 0x7ff7101597c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:10.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.365+0000 7ff7173ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7100cdf90 con 0x7ff710159d00 2023-07-14T11:19:10.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.365+0000 7ff7173ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff71015a2f0 con 0x7ff710070890 2023-07-14T11:19:10.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.365+0000 7ff7173ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff71015a5d0 con 0x7ff7101500d0 2023-07-14T11:19:10.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.365+0000 7ff71499a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff710070890 0x7ff7101597c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:10.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.365+0000 7ff71499a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff710070890 0x7ff7101597c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34146/0 (socket says 172.21.15.84:34146) 2023-07-14T11:19:10.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.365+0000 7ff71499a700 1 -- 172.21.15.84:0/572894785 learned_addr learned my addr 172.21.15.84:0/572894785 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:10.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.365+0000 7ff71519b700 1 --2- 172.21.15.84:0/572894785 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7101500d0 0x7ff710070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:10.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.366+0000 7ff71499a700 1 -- 172.21.15.84:0/572894785 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7101500d0 msgr2=0x7ff710070350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:10.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.366+0000 7ff71499a700 1 --2- 172.21.15.84:0/572894785 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7101500d0 0x7ff710070350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:10.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.366+0000 7ff71499a700 1 -- 172.21.15.84:0/572894785 >> v1:172.21.15.179:6789/0 conn(0x7ff710159d00 legacy=0x7ff7100cea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:10.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.366+0000 7ff71499a700 1 -- 172.21.15.84:0/572894785 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7100ce250 con 0x7ff710070890 2023-07-14T11:19:10.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.366+0000 7ff71499a700 1 --2- 172.21.15.84:0/572894785 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff710070890 0x7ff7101597c0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7ff7000098f0 tx=0x7ff700009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=998f643dc3c11cfb server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:10.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.366+0000 7ff707fff700 1 -- 172.21.15.84:0/572894785 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff70000f8a0 con 0x7ff710070890 2023-07-14T11:19:10.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.366+0000 7ff707fff700 1 -- 172.21.15.84:0/572894785 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff70000fa00 con 0x7ff710070890 2023-07-14T11:19:10.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.366+0000 7ff707fff700 1 -- 172.21.15.84:0/572894785 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff70000fd90 con 0x7ff710070890 2023-07-14T11:19:10.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.367+0000 7ff7173ff700 1 -- 172.21.15.84:0/572894785 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff710070890 msgr2=0x7ff7101597c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:10.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.367+0000 7ff7173ff700 1 --2- 172.21.15.84:0/572894785 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff710070890 0x7ff7101597c0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7ff7000098f0 tx=0x7ff700009c00 comp rx=0 tx=0).stop 2023-07-14T11:19:10.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.367+0000 7ff7173ff700 1 -- 172.21.15.84:0/572894785 shutdown_connections 2023-07-14T11:19:10.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.367+0000 7ff7173ff700 1 --2- 172.21.15.84:0/572894785 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7101500d0 0x7ff710070350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:10.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.367+0000 7ff7173ff700 1 --2- 172.21.15.84:0/572894785 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff710070890 0x7ff7101597c0 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:10.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.367+0000 7ff7173ff700 1 -- 172.21.15.84:0/572894785 >> 172.21.15.84:0/572894785 conn(0x7ff710069f30 msgr2=0x7ff71006a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:10.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.367+0000 7ff7173ff700 1 -- 172.21.15.84:0/572894785 shutdown_connections 2023-07-14T11:19:10.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.367+0000 7ff7173ff700 1 -- 172.21.15.84:0/572894785 wait complete. 2023-07-14T11:19:10.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.368+0000 7ff7173ff700 1 Processor -- start 2023-07-14T11:19:10.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.369+0000 7ff7173ff700 1 -- start start 2023-07-14T11:19:10.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.369+0000 7ff7173ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff710070890 0x7ff71014ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:10.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.369+0000 7ff7173ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7101500d0 0x7ff7101f21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:10.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.369+0000 7ff7173ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff710159d00 0x7ff7101514b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:10.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.369+0000 7ff7173ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7101504a0 con 0x7ff710159d00 2023-07-14T11:19:10.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.369+0000 7ff7173ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff710151020 con 0x7ff7101500d0 2023-07-14T11:19:10.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.369+0000 7ff7173ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7101506f0 con 0x7ff710070890 2023-07-14T11:19:10.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.370+0000 7ff71599c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff710159d00 0x7ff7101514b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:10.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.370+0000 7ff71599c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff710159d00 0x7ff7101514b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34152/0 (socket says 172.21.15.84:34152) 2023-07-14T11:19:10.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.370+0000 7ff71599c700 1 -- 172.21.15.84:0/2346273313 learned_addr learned my addr 172.21.15.84:0/2346273313 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:10.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.370+0000 7ff71519b700 1 --2- 172.21.15.84:0/2346273313 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff710070890 0x7ff71014ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:10.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.370+0000 7ff71499a700 1 --2- 172.21.15.84:0/2346273313 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7101500d0 0x7ff7101f21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:10.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.370+0000 7ff71599c700 1 -- 172.21.15.84:0/2346273313 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff710070890 msgr2=0x7ff71014ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:10.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.370+0000 7ff71599c700 1 --2- 172.21.15.84:0/2346273313 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff710070890 0x7ff71014ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:10.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.370+0000 7ff71599c700 1 -- 172.21.15.84:0/2346273313 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7101500d0 msgr2=0x7ff7101f21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:10.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.370+0000 7ff71599c700 1 --2- 172.21.15.84:0/2346273313 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7101500d0 0x7ff7101f21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:10.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.370+0000 7ff71599c700 1 -- 172.21.15.84:0/2346273313 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff700009550 con 0x7ff710159d00 2023-07-14T11:19:10.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.370+0000 7ff71499a700 1 --2- 172.21.15.84:0/2346273313 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7101500d0 0x7ff7101f21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:19:10.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.370+0000 7ff71599c700 1 --2- 172.21.15.84:0/2346273313 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff710159d00 0x7ff7101514b0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7ff70800cb80 tx=0x7ff70800cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:10.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.371+0000 7ff705ffb700 1 -- 172.21.15.84:0/2346273313 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff708003c00 con 0x7ff710159d00 2023-07-14T11:19:10.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.371+0000 7ff705ffb700 1 -- 172.21.15.84:0/2346273313 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff708003d60 con 0x7ff710159d00 2023-07-14T11:19:10.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.371+0000 7ff7173ff700 1 -- 172.21.15.84:0/2346273313 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7101509d0 con 0x7ff710159d00 2023-07-14T11:19:10.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.371+0000 7ff705ffb700 1 -- 172.21.15.84:0/2346273313 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff70800abb0 con 0x7ff710159d00 2023-07-14T11:19:10.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.371+0000 7ff7173ff700 1 -- 172.21.15.84:0/2346273313 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff71014b2c0 con 0x7ff710159d00 2023-07-14T11:19:10.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.372+0000 7ff7173ff700 1 -- 172.21.15.84:0/2346273313 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff71014b4b0 con 0x7ff710159d00 2023-07-14T11:19:10.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.373+0000 7ff705ffb700 1 -- 172.21.15.84:0/2346273313 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7ff70800ad10 con 0x7ff710159d00 2023-07-14T11:19:10.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.374+0000 7ff705ffb700 1 --2- 172.21.15.84:0/2346273313 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7ff6f406ae00 0x7ff6f406d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:10.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.374+0000 7ff705ffb700 1 -- 172.21.15.84:0/2346273313 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6148+0+0 (secure 0 0 0) 0x7ff708089750 con 0x7ff710159d00 2023-07-14T11:19:10.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.374+0000 7ff71519b700 1 --2- 172.21.15.84:0/2346273313 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7ff6f406ae00 0x7ff6f406d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:10.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.375+0000 7ff71519b700 1 --2- 172.21.15.84:0/2346273313 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7ff6f406ae00 0x7ff6f406d2b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff70c009930 tx=0x7ff70c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:10.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.378+0000 7ff705ffb700 1 -- 172.21.15.84:0/2346273313 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ff7080545f0 con 0x7ff710159d00 2023-07-14T11:19:10.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.610+0000 7ff7173ff700 1 -- 172.21.15.84:0/2346273313 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff71004e280 con 0x7ff710159d00 2023-07-14T11:19:10.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.611+0000 7ff705ffb700 1 -- 172.21.15.84:0/2346273313 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4717 (secure 0 0 0) 0x7ff708057c10 con 0x7ff710159d00 2023-07-14T11:19:10.613 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:19:10.614 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":60,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5945,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6834/3102047639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":3102047639},{"type":"v1","addr":"172.21.15.84:6834","nonce":3102047639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":5951,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/1883008963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1883008963},{"type":"v1","addr":"172.21.15.179:6835","nonce":1883008963}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":6901,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3521110991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":3521110991},{"type":"v1","addr":"172.21.15.179:6834","nonce":3521110991}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T11:18:42.500325+0000","modified":"2023-07-14T11:18:46.028519+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7227},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7227":{"gid":7227,"name":"c","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6835/3879250964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6833","nonce":3879250964},{"type":"v1","addr":"172.21.15.84:6835","nonce":3879250964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-07-14T11:19:10.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.613+0000 7ff7173ff700 1 -- 172.21.15.84:0/2346273313 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7ff6f406ae00 msgr2=0x7ff6f406d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:10.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.613+0000 7ff7173ff700 1 --2- 172.21.15.84:0/2346273313 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7ff6f406ae00 0x7ff6f406d2b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff70c009930 tx=0x7ff70c008040 comp rx=0 tx=0).stop 2023-07-14T11:19:10.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.613+0000 7ff7173ff700 1 -- 172.21.15.84:0/2346273313 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff710159d00 msgr2=0x7ff7101514b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:10.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.613+0000 7ff7173ff700 1 --2- 172.21.15.84:0/2346273313 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff710159d00 0x7ff7101514b0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7ff70800cb80 tx=0x7ff70800cf40 comp rx=0 tx=0).stop 2023-07-14T11:19:10.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.613+0000 7ff7173ff700 1 -- 172.21.15.84:0/2346273313 shutdown_connections 2023-07-14T11:19:10.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.613+0000 7ff7173ff700 1 --2- 172.21.15.84:0/2346273313 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7ff6f406ae00 0x7ff6f406d2b0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:10.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.613+0000 7ff7173ff700 1 --2- 172.21.15.84:0/2346273313 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff710070890 0x7ff71014ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:10.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.613+0000 7ff7173ff700 1 --2- 172.21.15.84:0/2346273313 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff710159d00 0x7ff7101514b0 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:10.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.613+0000 7ff7173ff700 1 --2- 172.21.15.84:0/2346273313 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7101500d0 0x7ff7101f21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:10.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.613+0000 7ff7173ff700 1 -- 172.21.15.84:0/2346273313 >> 172.21.15.84:0/2346273313 conn(0x7ff710069f30 msgr2=0x7ff710158200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:10.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.613+0000 7ff7173ff700 1 -- 172.21.15.84:0/2346273313 shutdown_connections 2023-07-14T11:19:10.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.613+0000 7ff7173ff700 1 -- 172.21.15.84:0/2346273313 wait complete. 2023-07-14T11:19:10.617 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 60 2023-07-14T11:19:10.633 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:19:10.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.825+0000 7f7dbe5ff700 1 Processor -- start 2023-07-14T11:19:10.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.826+0000 7f7dbe5ff700 1 -- start start 2023-07-14T11:19:10.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.827+0000 7f7dbe5ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7db815c950 0x7f7db80b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:10.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.827+0000 7f7dbe5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7db80b1e00 0x7f7db80d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:10.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.827+0000 7f7dbe5ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7db80d2ce0 con 0x7f7db80b2350 2023-07-14T11:19:10.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.827+0000 7f7dbe5ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7db80b3350 con 0x7f7db815c950 2023-07-14T11:19:10.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.827+0000 7f7dbe5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7db80b3630 con 0x7f7db80b1e00 2023-07-14T11:19:10.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.827+0000 7f7db7fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7db815c950 0x7f7db80b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:10.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.827+0000 7f7db7fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7db815c950 0x7f7db80b43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34166/0 (socket says 172.21.15.84:34166) 2023-07-14T11:19:10.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.827+0000 7f7db7fff700 1 -- 172.21.15.84:0/1397469601 learned_addr learned my addr 172.21.15.84:0/1397469601 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:10.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.827+0000 7f7db7fff700 1 -- 172.21.15.84:0/1397469601 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7db80b1e00 msgr2=0x7f7db80d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:10.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.827+0000 7f7db7fff700 1 --2- 172.21.15.84:0/1397469601 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7db80b1e00 0x7f7db80d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:10.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.827+0000 7f7db7fff700 1 -- 172.21.15.84:0/1397469601 >> v1:172.21.15.84:6789/0 conn(0x7f7db80b2350 legacy=0x7f7db80afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:10.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.827+0000 7f7db7fff700 1 -- 172.21.15.84:0/1397469601 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7db80b3910 con 0x7f7db815c950 2023-07-14T11:19:10.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.828+0000 7f7db7fff700 1 --2- 172.21.15.84:0/1397469601 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7db815c950 0x7f7db80b43f0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f7da8006fd0 tx=0x7f7da8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a6f1cafdfceb46b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:10.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.828+0000 7f7db6ffd700 1 -- 172.21.15.84:0/1397469601 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da8005e30 con 0x7f7db815c950 2023-07-14T11:19:10.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.828+0000 7f7db6ffd700 1 -- 172.21.15.84:0/1397469601 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7da8004030 con 0x7f7db815c950 2023-07-14T11:19:10.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.828+0000 7f7db6ffd700 1 -- 172.21.15.84:0/1397469601 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da80043e0 con 0x7f7db815c950 2023-07-14T11:19:10.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.828+0000 7f7dbe5ff700 1 -- 172.21.15.84:0/1397469601 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7db815c950 msgr2=0x7f7db80b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:10.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.828+0000 7f7dbe5ff700 1 --2- 172.21.15.84:0/1397469601 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7db815c950 0x7f7db80b43f0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f7da8006fd0 tx=0x7f7da8009bd0 comp rx=0 tx=0).stop 2023-07-14T11:19:10.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.828+0000 7f7dbe5ff700 1 -- 172.21.15.84:0/1397469601 shutdown_connections 2023-07-14T11:19:10.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.828+0000 7f7dbe5ff700 1 --2- 172.21.15.84:0/1397469601 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7db815c950 0x7f7db80b43f0 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:10.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.828+0000 7f7dbe5ff700 1 --2- 172.21.15.84:0/1397469601 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7db80b1e00 0x7f7db80d0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:10.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.828+0000 7f7dbe5ff700 1 -- 172.21.15.84:0/1397469601 >> 172.21.15.84:0/1397469601 conn(0x7f7db809c1d0 msgr2=0x7f7db80d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:10.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.829+0000 7f7dbe5ff700 1 -- 172.21.15.84:0/1397469601 shutdown_connections 2023-07-14T11:19:10.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.829+0000 7f7dbe5ff700 1 -- 172.21.15.84:0/1397469601 wait complete. 2023-07-14T11:19:10.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.830+0000 7f7dbe5ff700 1 Processor -- start 2023-07-14T11:19:10.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.830+0000 7f7dbe5ff700 1 -- start start 2023-07-14T11:19:10.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.831+0000 7f7dbe5ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7db80b1e00 0x7f7db80c7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:10.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.831+0000 7f7dbe5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7db80b2350 0x7f7db81f5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:10.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.831+0000 7f7dbe5ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7db815c950 0x7f7db81f6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:10.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.831+0000 7f7dbe5ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7db80b8b30 con 0x7f7db80b1e00 2023-07-14T11:19:10.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.831+0000 7f7dbe5ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7db8152c10 con 0x7f7db815c950 2023-07-14T11:19:10.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.831+0000 7f7dbe5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7db80cb800 con 0x7f7db80b2350 2023-07-14T11:19:10.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.832+0000 7f7db7fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7db80b1e00 0x7f7db80c7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:10.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.832+0000 7f7db7fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7db80b1e00 0x7f7db80c7eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34174/0 (socket says 172.21.15.84:34174) 2023-07-14T11:19:10.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.832+0000 7f7db7fff700 1 -- 172.21.15.84:0/3457789879 learned_addr learned my addr 172.21.15.84:0/3457789879 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:10.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.832+0000 7f7db77fe700 1 --2- 172.21.15.84:0/3457789879 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7db80b2350 0x7f7db81f5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:10.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.832+0000 7f7dbcb9c700 1 --2- 172.21.15.84:0/3457789879 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7db815c950 0x7f7db81f6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:10.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.832+0000 7f7db7fff700 1 -- 172.21.15.84:0/3457789879 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7db80b2350 msgr2=0x7f7db81f5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:10.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.832+0000 7f7db7fff700 1 --2- 172.21.15.84:0/3457789879 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7db80b2350 0x7f7db81f5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:10.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.832+0000 7f7db7fff700 1 -- 172.21.15.84:0/3457789879 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7db815c950 msgr2=0x7f7db81f6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:10.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.832+0000 7f7db7fff700 1 --2- 172.21.15.84:0/3457789879 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7db815c950 0x7f7db81f6220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:10.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.832+0000 7f7db7fff700 1 -- 172.21.15.84:0/3457789879 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7da8009500 con 0x7f7db80b1e00 2023-07-14T11:19:10.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.832+0000 7f7db7fff700 1 --2- 172.21.15.84:0/3457789879 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7db80b1e00 0x7f7db80c7eb0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f7da8009c10 tx=0x7f7da8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:10.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.832+0000 7f7db4ff9700 1 -- 172.21.15.84:0/3457789879 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da8003e30 con 0x7f7db80b1e00 2023-07-14T11:19:10.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.833+0000 7f7db4ff9700 1 -- 172.21.15.84:0/3457789879 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7da8011420 con 0x7f7db80b1e00 2023-07-14T11:19:10.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.833+0000 7f7dbe5ff700 1 -- 172.21.15.84:0/3457789879 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7db8152e60 con 0x7f7db80b1e00 2023-07-14T11:19:10.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.833+0000 7f7db4ff9700 1 -- 172.21.15.84:0/3457789879 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da80117d0 con 0x7f7db80b1e00 2023-07-14T11:19:10.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.833+0000 7f7dbe5ff700 1 -- 172.21.15.84:0/3457789879 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7db8153420 con 0x7f7db80b1e00 2023-07-14T11:19:10.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.834+0000 7f7dbe5ff700 1 -- 172.21.15.84:0/3457789879 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7db804e280 con 0x7f7db80b1e00 2023-07-14T11:19:10.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.835+0000 7f7db4ff9700 1 -- 172.21.15.84:0/3457789879 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f7da8011930 con 0x7f7db80b1e00 2023-07-14T11:19:10.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.835+0000 7f7db4ff9700 1 --2- 172.21.15.84:0/3457789879 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f7da406ae00 0x7f7da406d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:10.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.835+0000 7f7db4ff9700 1 -- 172.21.15.84:0/3457789879 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f7da808a7b0 con 0x7f7db80b1e00 2023-07-14T11:19:10.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.836+0000 7f7db77fe700 1 --2- 172.21.15.84:0/3457789879 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f7da406ae00 0x7f7da406d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:10.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.837+0000 7f7db77fe700 1 --2- 172.21.15.84:0/3457789879 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f7da406ae00 0x7f7da406d2b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7dac006fd0 tx=0x7f7dac008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:10.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:10.840+0000 7f7db4ff9700 1 -- 172.21.15.84:0/3457789879 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7da80556e0 con 0x7f7db80b1e00 2023-07-14T11:19:11.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.037+0000 7f7dbe5ff700 1 -- 172.21.15.84:0/3457789879 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7db80cd300 con 0x7f7db80b1e00 2023-07-14T11:19:11.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.038+0000 7f7db4ff9700 1 -- 172.21.15.84:0/3457789879 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+18401 (secure 0 0 0) 0x7f7da8058d00 con 0x7f7db80b1e00 2023-07-14T11:19:11.041 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:19:11.041 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":95,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:19:01.484069+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-07-14T11:18:40.531166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-07-14T11:18:41.475653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.179:6834/4019917691":"2023-07-15T11:18:58.463254+0000","172.21.15.179:6833/4019917691":"2023-07-15T11:18:58.463254+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:19:11.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.041+0000 7f7dbe5ff700 1 -- 172.21.15.84:0/3457789879 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f7da406ae00 msgr2=0x7f7da406d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:11.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.041+0000 7f7dbe5ff700 1 --2- 172.21.15.84:0/3457789879 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f7da406ae00 0x7f7da406d2b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7dac006fd0 tx=0x7f7dac008040 comp rx=0 tx=0).stop 2023-07-14T11:19:11.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.041+0000 7f7dbe5ff700 1 -- 172.21.15.84:0/3457789879 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7db80b1e00 msgr2=0x7f7db80c7eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:11.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.041+0000 7f7dbe5ff700 1 --2- 172.21.15.84:0/3457789879 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7db80b1e00 0x7f7db80c7eb0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f7da8009c10 tx=0x7f7da8004750 comp rx=0 tx=0).stop 2023-07-14T11:19:11.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.041+0000 7f7dbe5ff700 1 -- 172.21.15.84:0/3457789879 shutdown_connections 2023-07-14T11:19:11.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.041+0000 7f7dbe5ff700 1 --2- 172.21.15.84:0/3457789879 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7db815c950 0x7f7db81f6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:11.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.041+0000 7f7dbe5ff700 1 --2- 172.21.15.84:0/3457789879 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7db80b1e00 0x7f7db80c7eb0 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:11.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.041+0000 7f7dbe5ff700 1 --2- 172.21.15.84:0/3457789879 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f7da406ae00 0x7f7da406d2b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:11.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.041+0000 7f7dbe5ff700 1 --2- 172.21.15.84:0/3457789879 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7db80b2350 0x7f7db81f5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:11.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.041+0000 7f7dbe5ff700 1 -- 172.21.15.84:0/3457789879 >> 172.21.15.84:0/3457789879 conn(0x7f7db809c1d0 msgr2=0x7f7db80afac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:11.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.041+0000 7f7dbe5ff700 1 -- 172.21.15.84:0/3457789879 shutdown_connections 2023-07-14T11:19:11.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.041+0000 7f7dbe5ff700 1 -- 172.21.15.84:0/3457789879 wait complete. 2023-07-14T11:19:11.062 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-14T11:19:11.062 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T11:19:11.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.253+0000 7f3577dff700 1 Processor -- start 2023-07-14T11:19:11.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.254+0000 7f3577dff700 1 -- start start 2023-07-14T11:19:11.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.255+0000 7f3577dff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f357015c950 0x7f35700b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:11.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.255+0000 7f3577dff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35700d2ce0 con 0x7f35700b1e00 2023-07-14T11:19:11.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.255+0000 7f3577dff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35700b3350 con 0x7f35700d1220 2023-07-14T11:19:11.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.255+0000 7f3577dff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35700b3630 con 0x7f357015c950 2023-07-14T11:19:11.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.255+0000 7f357539a700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f35700b1e00 0x7f35700d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:34318/0 (socket says 172.21.15.84:34318) 2023-07-14T11:19:11.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.255+0000 7f357539a700 1 -- 172.21.15.84:0/619588213 learned_addr learned my addr 172.21.15.84:0/619588213 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:19:11.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.255+0000 7f3575b9b700 1 --2- 172.21.15.84:0/619588213 >> v2:172.21.15.179:3300/0 conn(0x7f357015c950 0x7f35700b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:11.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.255+0000 7f3574b99700 1 -- 172.21.15.84:0/619588213 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 564700115 0 0) 0x7f35700d2ce0 con 0x7f35700b1e00 2023-07-14T11:19:11.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.255+0000 7f3574b99700 1 -- 172.21.15.84:0/619588213 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f355c0035b0 con 0x7f35700b1e00 2023-07-14T11:19:11.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.256+0000 7f3574b99700 1 -- 172.21.15.84:0/619588213 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1119014702 0 0) 0x7f355c0035b0 con 0x7f35700b1e00 2023-07-14T11:19:11.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.256+0000 7f3574b99700 1 -- 172.21.15.84:0/619588213 >> v2:172.21.15.179:3300/0 conn(0x7f357015c950 msgr2=0x7f35700b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:11.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.256+0000 7f3574b99700 1 --2- 172.21.15.84:0/619588213 >> v2:172.21.15.179:3300/0 conn(0x7f357015c950 0x7f35700b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:11.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.256+0000 7f3574b99700 1 -- 172.21.15.84:0/619588213 >> v1:172.21.15.179:6789/0 conn(0x7f35700d1220 legacy=0x7f35700afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:11.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.256+0000 7f3574b99700 1 -- 172.21.15.84:0/619588213 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35700b3910 con 0x7f35700b1e00 2023-07-14T11:19:11.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.256+0000 7f3574b99700 1 -- 172.21.15.84:0/619588213 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7f3560001670 con 0x7f35700b1e00 2023-07-14T11:19:11.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.256+0000 7f3574b99700 1 -- 172.21.15.84:0/619588213 >> v1:172.21.15.84:6789/0 conn(0x7f35700b1e00 legacy=0x7f35700d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:11.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.256+0000 7f3574b99700 1 --2- 172.21.15.84:0/619588213 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f355c003a00 0x7f355c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:11.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.256+0000 7f3574b99700 1 --2- 172.21.15.84:0/619588213 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f355c0043f0 0x7f355c0048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:11.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.256+0000 7f3574b99700 1 --2- 172.21.15.84:0/619588213 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f355c005150 0x7f355c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:11.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.256+0000 7f3574b99700 1 -- 172.21.15.84:0/619588213 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35700b3630 con 0x7f355c003a00 2023-07-14T11:19:11.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.256+0000 7f3574b99700 1 -- 172.21.15.84:0/619588213 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f355c00c080 con 0x7f355c005150 2023-07-14T11:19:11.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.256+0000 7f3574b99700 1 -- 172.21.15.84:0/619588213 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f355c00c240 con 0x7f355c0043f0 2023-07-14T11:19:11.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.256+0000 7f3575b9b700 1 --2- 172.21.15.84:0/619588213 >> v2:172.21.15.179:3300/0 conn(0x7f357015c950 0x7f35700b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:19:11.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.256+0000 7f3575b9b700 1 --2- 172.21.15.84:0/619588213 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f355c003a00 0x7f355c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:11.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.256+0000 7f357539a700 1 --2- 172.21.15.84:0/619588213 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f355c0043f0 0x7f355c0048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:11.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.256+0000 7f357639c700 1 --2- 172.21.15.84:0/619588213 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f355c005150 0x7f355c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:11.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.257+0000 7f3575b9b700 1 -- 172.21.15.84:0/619588213 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f355c0043f0 msgr2=0x7f355c0048b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:11.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.257+0000 7f3575b9b700 1 --2- 172.21.15.84:0/619588213 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f355c0043f0 0x7f355c0048b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:11.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.257+0000 7f3575b9b700 1 -- 172.21.15.84:0/619588213 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f355c005150 msgr2=0x7f355c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:11.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.257+0000 7f3575b9b700 1 --2- 172.21.15.84:0/619588213 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f355c005150 0x7f355c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:11.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.257+0000 7f3575b9b700 1 -- 172.21.15.84:0/619588213 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f355c0035b0 con 0x7f355c003a00 2023-07-14T11:19:11.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.257+0000 7f357639c700 1 -- 172.21.15.84:0/619588213 reap_dead start 2023-07-14T11:19:11.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.257+0000 7f3575b9b700 1 --2- 172.21.15.84:0/619588213 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f355c003a00 0x7f355c003dd0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f356c009cf0 tx=0x7f355c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9b9a5de6f8e3da3 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:11.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.257+0000 7f3574b99700 1 -- 172.21.15.84:0/619588213 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356c005a20 con 0x7f355c003a00 2023-07-14T11:19:11.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.257+0000 7f3574b99700 1 -- 172.21.15.84:0/619588213 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f356c005b80 con 0x7f355c003a00 2023-07-14T11:19:11.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.257+0000 7f3574b99700 1 -- 172.21.15.84:0/619588213 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356c004030 con 0x7f355c003a00 2023-07-14T11:19:11.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.258+0000 7f3577dff700 1 -- 172.21.15.84:0/619588213 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f355c003a00 msgr2=0x7f355c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:11.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.258+0000 7f3577dff700 1 --2- 172.21.15.84:0/619588213 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f355c003a00 0x7f355c003dd0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f356c009cf0 tx=0x7f355c005880 comp rx=0 tx=0).stop 2023-07-14T11:19:11.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.258+0000 7f3577dff700 1 -- 172.21.15.84:0/619588213 shutdown_connections 2023-07-14T11:19:11.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.258+0000 7f3577dff700 1 --2- 172.21.15.84:0/619588213 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f355c003a00 0x7f355c003dd0 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:11.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.258+0000 7f3577dff700 1 -- 172.21.15.84:0/619588213 >> 172.21.15.84:0/619588213 conn(0x7f357009c1d0 msgr2=0x7f35700d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:11.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.258+0000 7f3577dff700 1 -- 172.21.15.84:0/619588213 shutdown_connections 2023-07-14T11:19:11.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.258+0000 7f3577dff700 1 -- 172.21.15.84:0/619588213 wait complete. 2023-07-14T11:19:11.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.260+0000 7f3577dff700 1 Processor -- start 2023-07-14T11:19:11.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.260+0000 7f3577dff700 1 -- start start 2023-07-14T11:19:11.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.261+0000 7f3577dff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f355c003a00 0x7f35700d0040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:11.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.261+0000 7f3577dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35701f1cd0 0x7f35700cdf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:11.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.261+0000 7f3577dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35701e5c00 0x7f35701e6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:11.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.261+0000 7f3577dff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35700c72c0 con 0x7f355c003a00 2023-07-14T11:19:11.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.261+0000 7f3577dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35700cf070 con 0x7f35701f1cd0 2023-07-14T11:19:11.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.261+0000 7f3577dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35701e65b0 con 0x7f35701e5c00 2023-07-14T11:19:11.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.261+0000 7f3575b9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f355c003a00 0x7f35700d0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:11.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.261+0000 7f3575b9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f355c003a00 0x7f35700d0040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34188/0 (socket says 172.21.15.84:34188) 2023-07-14T11:19:11.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.261+0000 7f3575b9b700 1 -- 172.21.15.84:0/1195084440 learned_addr learned my addr 172.21.15.84:0/1195084440 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:11.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.261+0000 7f357539a700 1 --2- 172.21.15.84:0/1195084440 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35701f1cd0 0x7f35700cdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:11.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.261+0000 7f357639c700 1 --2- 172.21.15.84:0/1195084440 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35701e5c00 0x7f35701e6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:11.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.262+0000 7f3575b9b700 1 -- 172.21.15.84:0/1195084440 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35701e5c00 msgr2=0x7f35701e6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:11.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.262+0000 7f3575b9b700 1 --2- 172.21.15.84:0/1195084440 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35701e5c00 0x7f35701e6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:11.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.262+0000 7f3575b9b700 1 -- 172.21.15.84:0/1195084440 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35701f1cd0 msgr2=0x7f35700cdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:11.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.262+0000 7f3575b9b700 1 --2- 172.21.15.84:0/1195084440 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35701f1cd0 0x7f35700cdf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:11.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.262+0000 7f3575b9b700 1 -- 172.21.15.84:0/1195084440 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35700c7b00 con 0x7f355c003a00 2023-07-14T11:19:11.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.262+0000 7f357539a700 1 --2- 172.21.15.84:0/1195084440 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35701f1cd0 0x7f35700cdf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:19:11.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.262+0000 7f357639c700 1 --2- 172.21.15.84:0/1195084440 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35701e5c00 0x7f35701e6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:19:11.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.262+0000 7f3575b9b700 1 --2- 172.21.15.84:0/1195084440 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f355c003a00 0x7f35700d0040 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f356c00eac0 tx=0x7f356c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:11.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.262+0000 7f35667fc700 1 -- 172.21.15.84:0/1195084440 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356c005a20 con 0x7f355c003a00 2023-07-14T11:19:11.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.262+0000 7f35667fc700 1 -- 172.21.15.84:0/1195084440 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f356c0038b0 con 0x7f355c003a00 2023-07-14T11:19:11.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.262+0000 7f35667fc700 1 -- 172.21.15.84:0/1195084440 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356c003c40 con 0x7f355c003a00 2023-07-14T11:19:11.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.262+0000 7f3577dff700 1 -- 172.21.15.84:0/1195084440 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35700c77d0 con 0x7f355c003a00 2023-07-14T11:19:11.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.262+0000 7f3577dff700 1 -- 172.21.15.84:0/1195084440 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35700ce7d0 con 0x7f355c003a00 2023-07-14T11:19:11.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.263+0000 7f3577dff700 1 -- 172.21.15.84:0/1195084440 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f357004e280 con 0x7f355c003a00 2023-07-14T11:19:11.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.264+0000 7f35667fc700 1 -- 172.21.15.84:0/1195084440 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f356c013470 con 0x7f355c003a00 2023-07-14T11:19:11.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.265+0000 7f35667fc700 1 --2- 172.21.15.84:0/1195084440 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f355406ae00 0x7f355406d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:11.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.265+0000 7f35667fc700 1 -- 172.21.15.84:0/1195084440 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f356c08acf0 con 0x7f355c003a00 2023-07-14T11:19:11.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.266+0000 7f357539a700 1 --2- 172.21.15.84:0/1195084440 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f355406ae00 0x7f355406d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:11.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.266+0000 7f357539a700 1 --2- 172.21.15.84:0/1195084440 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f355406ae00 0x7f355406d2b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3560000c00 tx=0x7f3560009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:11.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.269+0000 7f35667fc700 1 -- 172.21.15.84:0/1195084440 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f356c055c20 con 0x7f355c003a00 2023-07-14T11:19:11.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.503+0000 7f3577dff700 1 -- 172.21.15.84:0/1195084440 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f357008c5a0 con 0x7f355c003a00 2023-07-14T11:19:11.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.503+0000 7f35667fc700 1 -- 172.21.15.84:0/1195084440 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4717 (secure 0 0 0) 0x7f356c059240 con 0x7f355c003a00 2023-07-14T11:19:11.506 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:19:11.506 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":60,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5945,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6834/3102047639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":3102047639},{"type":"v1","addr":"172.21.15.84:6834","nonce":3102047639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":5951,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/1883008963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1883008963},{"type":"v1","addr":"172.21.15.179:6835","nonce":1883008963}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":6901,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3521110991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":3521110991},{"type":"v1","addr":"172.21.15.179:6834","nonce":3521110991}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T11:18:42.500325+0000","modified":"2023-07-14T11:18:46.028519+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7227},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7227":{"gid":7227,"name":"c","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6835/3879250964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6833","nonce":3879250964},{"type":"v1","addr":"172.21.15.84:6835","nonce":3879250964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-07-14T11:19:11.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.505+0000 7f3577dff700 1 -- 172.21.15.84:0/1195084440 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f355406ae00 msgr2=0x7f355406d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:11.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.505+0000 7f3577dff700 1 --2- 172.21.15.84:0/1195084440 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f355406ae00 0x7f355406d2b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3560000c00 tx=0x7f3560009040 comp rx=0 tx=0).stop 2023-07-14T11:19:11.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.505+0000 7f3577dff700 1 -- 172.21.15.84:0/1195084440 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f355c003a00 msgr2=0x7f35700d0040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:11.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.505+0000 7f3577dff700 1 --2- 172.21.15.84:0/1195084440 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f355c003a00 0x7f35700d0040 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f356c00eac0 tx=0x7f356c0047c0 comp rx=0 tx=0).stop 2023-07-14T11:19:11.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.505+0000 7f3577dff700 1 -- 172.21.15.84:0/1195084440 shutdown_connections 2023-07-14T11:19:11.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.505+0000 7f3577dff700 1 --2- 172.21.15.84:0/1195084440 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f355406ae00 0x7f355406d2b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:11.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.505+0000 7f3577dff700 1 --2- 172.21.15.84:0/1195084440 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35701e5c00 0x7f35701e6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:11.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.505+0000 7f3577dff700 1 --2- 172.21.15.84:0/1195084440 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f355c003a00 0x7f35700d0040 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:11.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.505+0000 7f3577dff700 1 --2- 172.21.15.84:0/1195084440 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35701f1cd0 0x7f35700cdf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:11.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.505+0000 7f3577dff700 1 -- 172.21.15.84:0/1195084440 >> 172.21.15.84:0/1195084440 conn(0x7f357009c1d0 msgr2=0x7f35700d0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:11.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.506+0000 7f3577dff700 1 -- 172.21.15.84:0/1195084440 shutdown_connections 2023-07-14T11:19:11.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.506+0000 7f3577dff700 1 -- 172.21.15.84:0/1195084440 wait complete. 2023-07-14T11:19:11.510 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 60 2023-07-14T11:19:11.526 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T11:19:11.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.719+0000 7f4314bff700 1 Processor -- start 2023-07-14T11:19:11.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.719+0000 7f4314bff700 1 -- start start 2023-07-14T11:19:11.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.720+0000 7f4314bff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4310160030 0x7f431006c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:11.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.720+0000 7f4314bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43100b5cd0 0x7f43100d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:11.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.720+0000 7f4314bff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f43100b1f70 0x7f43100d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:11.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.720+0000 7f4314bff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43100d2cc0 con 0x7f43100b1f70 2023-07-14T11:19:11.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.720+0000 7f4314bff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43100afbb0 con 0x7f4310160030 2023-07-14T11:19:11.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.720+0000 7f4314bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43100afe90 con 0x7f43100b5cd0 2023-07-14T11:19:11.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.720+0000 7f430ed9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f43100b1f70 0x7f43100d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:11.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.721+0000 7f430ed9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f43100b1f70 0x7f43100d0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34204/0 (socket says 172.21.15.84:34204) 2023-07-14T11:19:11.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.721+0000 7f430ed9d700 1 -- 172.21.15.84:0/3654964804 learned_addr learned my addr 172.21.15.84:0/3654964804 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:11.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.721+0000 7f430dd9b700 1 --2- 172.21.15.84:0/3654964804 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43100b5cd0 0x7f43100d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:11.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.721+0000 7f430e59c700 1 --2- 172.21.15.84:0/3654964804 >> v2:172.21.15.179:3300/0 conn(0x7f4310160030 0x7f431006c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:11.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.721+0000 7f430ed9d700 1 -- 172.21.15.84:0/3654964804 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43100b5cd0 msgr2=0x7f43100d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:11.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.721+0000 7f430ed9d700 1 --2- 172.21.15.84:0/3654964804 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43100b5cd0 0x7f43100d0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:11.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.721+0000 7f430ed9d700 1 -- 172.21.15.84:0/3654964804 >> v2:172.21.15.179:3300/0 conn(0x7f4310160030 msgr2=0x7f431006c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:11.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.721+0000 7f430ed9d700 1 --2- 172.21.15.84:0/3654964804 >> v2:172.21.15.179:3300/0 conn(0x7f4310160030 0x7f431006c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:11.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.721+0000 7f430ed9d700 1 -- 172.21.15.84:0/3654964804 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43100b0170 con 0x7f43100b1f70 2023-07-14T11:19:11.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.721+0000 7f430ed9d700 1 --2- 172.21.15.84:0/3654964804 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43100b1f70 0x7f43100d0f90 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f431006d1a0 tx=0x7f430800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1baf6aff44760a68 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:11.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.721+0000 7f430d59a700 1 -- 172.21.15.84:0/3654964804 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f430800e070 con 0x7f43100b1f70 2023-07-14T11:19:11.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.721+0000 7f430d59a700 1 -- 172.21.15.84:0/3654964804 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f430800b910 con 0x7f43100b1f70 2023-07-14T11:19:11.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.721+0000 7f430d59a700 1 -- 172.21.15.84:0/3654964804 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f430800bcc0 con 0x7f43100b1f70 2023-07-14T11:19:11.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.722+0000 7f4314bff700 1 -- 172.21.15.84:0/3654964804 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43100b1f70 msgr2=0x7f43100d0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:11.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.722+0000 7f4314bff700 1 --2- 172.21.15.84:0/3654964804 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43100b1f70 0x7f43100d0f90 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f431006d1a0 tx=0x7f430800b330 comp rx=0 tx=0).stop 2023-07-14T11:19:11.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.722+0000 7f4314bff700 1 -- 172.21.15.84:0/3654964804 shutdown_connections 2023-07-14T11:19:11.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.722+0000 7f4314bff700 1 --2- 172.21.15.84:0/3654964804 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43100b1f70 0x7f43100d0f90 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:11.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.722+0000 7f4314bff700 1 --2- 172.21.15.84:0/3654964804 >> v2:172.21.15.179:3300/0 conn(0x7f4310160030 0x7f431006c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:11.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.722+0000 7f4314bff700 1 --2- 172.21.15.84:0/3654964804 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43100b5cd0 0x7f43100d0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:11.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.722+0000 7f4314bff700 1 -- 172.21.15.84:0/3654964804 >> 172.21.15.84:0/3654964804 conn(0x7f431009c190 msgr2=0x7f43100d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:11.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.722+0000 7f4314bff700 1 -- 172.21.15.84:0/3654964804 shutdown_connections 2023-07-14T11:19:11.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.722+0000 7f4314bff700 1 -- 172.21.15.84:0/3654964804 wait complete. 2023-07-14T11:19:11.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.724+0000 7f4314bff700 1 Processor -- start 2023-07-14T11:19:11.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.724+0000 7f4314bff700 1 -- start start 2023-07-14T11:19:11.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.725+0000 7f4314bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43100b1f70 0x7f43100b1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:11.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.725+0000 7f4314bff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43100b5cd0 0x7f43100b6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:11.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.725+0000 7f4314bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4310160030 0x7f431015c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:11.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.725+0000 7f4314bff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f431015aa40 con 0x7f43100b5cd0 2023-07-14T11:19:11.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.725+0000 7f4314bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43100b15c0 con 0x7f4310160030 2023-07-14T11:19:11.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.725+0000 7f4314bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43100b6a00 con 0x7f43100b1f70 2023-07-14T11:19:11.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.725+0000 7f430dd9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43100b5cd0 0x7f43100b6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:11.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.725+0000 7f430dd9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43100b5cd0 0x7f43100b6100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34216/0 (socket says 172.21.15.84:34216) 2023-07-14T11:19:11.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.725+0000 7f430dd9b700 1 -- 172.21.15.84:0/533094172 learned_addr learned my addr 172.21.15.84:0/533094172 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:11.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.726+0000 7f430ed9d700 1 --2- 172.21.15.84:0/533094172 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4310160030 0x7f431015c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:11.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.726+0000 7f430e59c700 1 --2- 172.21.15.84:0/533094172 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43100b1f70 0x7f43100b1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:11.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.726+0000 7f430dd9b700 1 -- 172.21.15.84:0/533094172 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43100b1f70 msgr2=0x7f43100b1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:11.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.726+0000 7f430dd9b700 1 --2- 172.21.15.84:0/533094172 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43100b1f70 0x7f43100b1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:11.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.726+0000 7f430dd9b700 1 -- 172.21.15.84:0/533094172 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4310160030 msgr2=0x7f431015c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:11.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.726+0000 7f430dd9b700 1 --2- 172.21.15.84:0/533094172 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4310160030 0x7f431015c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:11.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.726+0000 7f430dd9b700 1 -- 172.21.15.84:0/533094172 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4308009b30 con 0x7f43100b5cd0 2023-07-14T11:19:11.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.726+0000 7f430ed9d700 1 --2- 172.21.15.84:0/533094172 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4310160030 0x7f431015c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:19:11.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.726+0000 7f430dd9b700 1 --2- 172.21.15.84:0/533094172 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43100b5cd0 0x7f43100b6100 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f430400e930 tx=0x7f430400ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:11.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.726+0000 7f42feffd700 1 -- 172.21.15.84:0/533094172 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4304009690 con 0x7f43100b5cd0 2023-07-14T11:19:11.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.726+0000 7f42feffd700 1 -- 172.21.15.84:0/533094172 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f430400c850 con 0x7f43100b5cd0 2023-07-14T11:19:11.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.726+0000 7f4314bff700 1 -- 172.21.15.84:0/533094172 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43100b6ce0 con 0x7f43100b5cd0 2023-07-14T11:19:11.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.726+0000 7f42feffd700 1 -- 172.21.15.84:0/533094172 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f430400cbe0 con 0x7f43100b5cd0 2023-07-14T11:19:11.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.726+0000 7f4314bff700 1 -- 172.21.15.84:0/533094172 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f431015a660 con 0x7f43100b5cd0 2023-07-14T11:19:11.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.727+0000 7f4314bff700 1 -- 172.21.15.84:0/533094172 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f431015ab80 con 0x7f43100b5cd0 2023-07-14T11:19:11.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.728+0000 7f42feffd700 1 -- 172.21.15.84:0/533094172 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f430400cd40 con 0x7f43100b5cd0 2023-07-14T11:19:11.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.729+0000 7f42feffd700 1 --2- 172.21.15.84:0/533094172 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f42f006ae00 0x7f42f006d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:11.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.729+0000 7f42feffd700 1 -- 172.21.15.84:0/533094172 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f4304089b60 con 0x7f43100b5cd0 2023-07-14T11:19:11.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.730+0000 7f430e59c700 1 --2- 172.21.15.84:0/533094172 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f42f006ae00 0x7f42f006d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:11.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.730+0000 7f430e59c700 1 --2- 172.21.15.84:0/533094172 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f42f006ae00 0x7f42f006d2b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4300009ad0 tx=0x7f4300008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:11.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.733+0000 7f42feffd700 1 -- 172.21.15.84:0/533094172 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f4304054a00 con 0x7f43100b5cd0 2023-07-14T11:19:11.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.988+0000 7f4314bff700 1 -- 172.21.15.84:0/533094172 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f431004e280 con 0x7f43100b5cd0 2023-07-14T11:19:11.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.988+0000 7f42feffd700 1 -- 172.21.15.84:0/533094172 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4717 (secure 0 0 0) 0x7f4304058020 con 0x7f43100b5cd0 2023-07-14T11:19:11.991 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:19:11.991 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":60,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5945,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6834/3102047639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":3102047639},{"type":"v1","addr":"172.21.15.84:6834","nonce":3102047639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":5951,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/1883008963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1883008963},{"type":"v1","addr":"172.21.15.179:6835","nonce":1883008963}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":6901,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3521110991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":3521110991},{"type":"v1","addr":"172.21.15.179:6834","nonce":3521110991}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T11:18:42.500325+0000","modified":"2023-07-14T11:18:46.028519+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7227},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7227":{"gid":7227,"name":"c","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6835/3879250964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6833","nonce":3879250964},{"type":"v1","addr":"172.21.15.84:6835","nonce":3879250964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-07-14T11:19:11.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.991+0000 7f4314bff700 1 -- 172.21.15.84:0/533094172 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f42f006ae00 msgr2=0x7f42f006d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:11.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.991+0000 7f4314bff700 1 --2- 172.21.15.84:0/533094172 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f42f006ae00 0x7f42f006d2b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4300009ad0 tx=0x7f4300008040 comp rx=0 tx=0).stop 2023-07-14T11:19:11.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.991+0000 7f4314bff700 1 -- 172.21.15.84:0/533094172 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43100b5cd0 msgr2=0x7f43100b6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:11.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.991+0000 7f4314bff700 1 --2- 172.21.15.84:0/533094172 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43100b5cd0 0x7f43100b6100 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f430400e930 tx=0x7f430400ecf0 comp rx=0 tx=0).stop 2023-07-14T11:19:11.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.991+0000 7f4314bff700 1 -- 172.21.15.84:0/533094172 shutdown_connections 2023-07-14T11:19:11.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.991+0000 7f4314bff700 1 --2- 172.21.15.84:0/533094172 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f42f006ae00 0x7f42f006d2b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:11.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.991+0000 7f4314bff700 1 --2- 172.21.15.84:0/533094172 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43100b1f70 0x7f43100b1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:11.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.991+0000 7f4314bff700 1 --2- 172.21.15.84:0/533094172 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4310160030 0x7f431015c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:11.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.991+0000 7f4314bff700 1 --2- 172.21.15.84:0/533094172 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43100b5cd0 0x7f43100b6100 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:11.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.991+0000 7f4314bff700 1 -- 172.21.15.84:0/533094172 >> 172.21.15.84:0/533094172 conn(0x7f431009c190 msgr2=0x7f431006c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:11.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.991+0000 7f4314bff700 1 -- 172.21.15.84:0/533094172 shutdown_connections 2023-07-14T11:19:11.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:11.991+0000 7f4314bff700 1 -- 172.21.15.84:0/533094172 wait complete. 2023-07-14T11:19:11.995 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 60 2023-07-14T11:19:12.011 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:19:12.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.203+0000 7f4b21dff700 1 Processor -- start 2023-07-14T11:19:12.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.203+0000 7f4b21dff700 1 -- start start 2023-07-14T11:19:12.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.204+0000 7f4b21dff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4b1c0b5d90 0x7f4b1c0b6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:12.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.204+0000 7f4b21dff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4b1c0d0b10 0x7f4b1c0d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:12.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.204+0000 7f4b21dff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b1c0b7f50 con 0x7f4b1c0b4510 2023-07-14T11:19:12.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.204+0000 7f4b21dff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b1c0b48e0 con 0x7f4b1c0d0b10 2023-07-14T11:19:12.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.204+0000 7f4b21dff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b1c0d14d0 con 0x7f4b1c0b5d90 2023-07-14T11:19:12.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.205+0000 7f4b1bfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4b1c0d0b10 0x7f4b1c0d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:12.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.205+0000 7f4b1bfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4b1c0d0b10 0x7f4b1c0d0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34218/0 (socket says 172.21.15.84:34218) 2023-07-14T11:19:12.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.205+0000 7f4b1bfff700 1 -- 172.21.15.84:0/41969400 learned_addr learned my addr 172.21.15.84:0/41969400 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:12.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.205+0000 7f4b1affd700 1 --2- 172.21.15.84:0/41969400 >> v2:172.21.15.179:3300/0 conn(0x7f4b1c0b5d90 0x7f4b1c0b6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:12.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.205+0000 7f4b1bfff700 1 -- 172.21.15.84:0/41969400 >> v2:172.21.15.179:3300/0 conn(0x7f4b1c0b5d90 msgr2=0x7f4b1c0b6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:12.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.205+0000 7f4b1bfff700 1 --2- 172.21.15.84:0/41969400 >> v2:172.21.15.179:3300/0 conn(0x7f4b1c0b5d90 0x7f4b1c0b6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:12.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.205+0000 7f4b1bfff700 1 -- 172.21.15.84:0/41969400 >> v1:172.21.15.179:6789/0 conn(0x7f4b1c0b4510 legacy=0x7f4b1c0cd590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:12.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.205+0000 7f4b1bfff700 1 -- 172.21.15.84:0/41969400 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b1c0cdca0 con 0x7f4b1c0d0b10 2023-07-14T11:19:12.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.205+0000 7f4b1bfff700 1 --2- 172.21.15.84:0/41969400 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b1c0d0b10 0x7f4b1c0d0f90 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c0b5b30 tx=0x7f4b1400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aa34cfdc39a9866 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:12.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.206+0000 7f4b1a7fc700 1 -- 172.21.15.84:0/41969400 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1400e070 con 0x7f4b1c0d0b10 2023-07-14T11:19:12.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.206+0000 7f4b1a7fc700 1 -- 172.21.15.84:0/41969400 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b14003a20 con 0x7f4b1c0d0b10 2023-07-14T11:19:12.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.206+0000 7f4b1a7fc700 1 -- 172.21.15.84:0/41969400 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b14003dd0 con 0x7f4b1c0d0b10 2023-07-14T11:19:12.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.206+0000 7f4b21dff700 1 -- 172.21.15.84:0/41969400 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b1c0d0b10 msgr2=0x7f4b1c0d0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:12.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.206+0000 7f4b21dff700 1 --2- 172.21.15.84:0/41969400 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b1c0d0b10 0x7f4b1c0d0f90 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c0b5b30 tx=0x7f4b1400b330 comp rx=0 tx=0).stop 2023-07-14T11:19:12.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.206+0000 7f4b21dff700 1 -- 172.21.15.84:0/41969400 shutdown_connections 2023-07-14T11:19:12.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.206+0000 7f4b21dff700 1 --2- 172.21.15.84:0/41969400 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b1c0d0b10 0x7f4b1c0d0f90 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:12.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.206+0000 7f4b21dff700 1 --2- 172.21.15.84:0/41969400 >> v2:172.21.15.179:3300/0 conn(0x7f4b1c0b5d90 0x7f4b1c0b6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:12.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.206+0000 7f4b21dff700 1 -- 172.21.15.84:0/41969400 >> 172.21.15.84:0/41969400 conn(0x7f4b1c09c1d0 msgr2=0x7f4b1c0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:12.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.206+0000 7f4b21dff700 1 -- 172.21.15.84:0/41969400 shutdown_connections 2023-07-14T11:19:12.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.206+0000 7f4b21dff700 1 -- 172.21.15.84:0/41969400 wait complete. 2023-07-14T11:19:12.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.209+0000 7f4b21dff700 1 Processor -- start 2023-07-14T11:19:12.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.209+0000 7f4b21dff700 1 -- start start 2023-07-14T11:19:12.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.210+0000 7f4b21dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b1c0b4510 0x7f4b1c15e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:12.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.210+0000 7f4b21dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b1c0b5d90 0x7f4b1c15cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:12.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.210+0000 7f4b21dff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b1c0d0b10 0x7f4b1c151190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:12.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.210+0000 7f4b21dff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1c15a150 con 0x7f4b1c0d0b10 2023-07-14T11:19:12.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.210+0000 7f4b21dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1c15d4b0 con 0x7f4b1c0b5d90 2023-07-14T11:19:12.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.210+0000 7f4b21dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1c15d790 con 0x7f4b1c0b4510 2023-07-14T11:19:12.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.210+0000 7f4b1bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b1c0d0b10 0x7f4b1c151190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:12.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.210+0000 7f4b1bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b1c0d0b10 0x7f4b1c151190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34234/0 (socket says 172.21.15.84:34234) 2023-07-14T11:19:12.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.210+0000 7f4b1bfff700 1 -- 172.21.15.84:0/2547909977 learned_addr learned my addr 172.21.15.84:0/2547909977 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:12.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.211+0000 7f4b1affd700 1 --2- 172.21.15.84:0/2547909977 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b1c0b5d90 0x7f4b1c15cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:12.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.211+0000 7f4b1b7fe700 1 --2- 172.21.15.84:0/2547909977 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b1c0b4510 0x7f4b1c15e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:12.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.211+0000 7f4b1bfff700 1 -- 172.21.15.84:0/2547909977 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b1c0b4510 msgr2=0x7f4b1c15e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:12.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.211+0000 7f4b1bfff700 1 --2- 172.21.15.84:0/2547909977 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b1c0b4510 0x7f4b1c15e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:12.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.211+0000 7f4b1bfff700 1 -- 172.21.15.84:0/2547909977 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b1c0b5d90 msgr2=0x7f4b1c15cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:12.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.211+0000 7f4b1bfff700 1 --2- 172.21.15.84:0/2547909977 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b1c0b5d90 0x7f4b1c15cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:12.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.211+0000 7f4b1bfff700 1 -- 172.21.15.84:0/2547909977 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b14009b30 con 0x7f4b1c0d0b10 2023-07-14T11:19:12.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.211+0000 7f4b1bfff700 1 --2- 172.21.15.84:0/2547909977 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b1c0d0b10 0x7f4b1c151190 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f4b14015040 tx=0x7f4b14004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:12.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.211+0000 7f4b03fff700 1 -- 172.21.15.84:0/2547909977 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b140092e0 con 0x7f4b1c0d0b10 2023-07-14T11:19:12.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.211+0000 7f4b03fff700 1 -- 172.21.15.84:0/2547909977 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b14004240 con 0x7f4b1c0d0b10 2023-07-14T11:19:12.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.211+0000 7f4b21dff700 1 -- 172.21.15.84:0/2547909977 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b1c15da70 con 0x7f4b1c0d0b10 2023-07-14T11:19:12.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.211+0000 7f4b03fff700 1 -- 172.21.15.84:0/2547909977 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b14004610 con 0x7f4b1c0d0b10 2023-07-14T11:19:12.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.212+0000 7f4b21dff700 1 -- 172.21.15.84:0/2547909977 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b1c15e030 con 0x7f4b1c0d0b10 2023-07-14T11:19:12.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.213+0000 7f4b21dff700 1 -- 172.21.15.84:0/2547909977 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b1c04e280 con 0x7f4b1c0d0b10 2023-07-14T11:19:12.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.214+0000 7f4b03fff700 1 -- 172.21.15.84:0/2547909977 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f4b14019070 con 0x7f4b1c0d0b10 2023-07-14T11:19:12.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.214+0000 7f4b03fff700 1 --2- 172.21.15.84:0/2547909977 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f4b0806ae00 0x7f4b0806d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:12.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.215+0000 7f4b03fff700 1 -- 172.21.15.84:0/2547909977 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f4b1408a4f0 con 0x7f4b1c0d0b10 2023-07-14T11:19:12.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.215+0000 7f4b1b7fe700 1 --2- 172.21.15.84:0/2547909977 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f4b0806ae00 0x7f4b0806d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:12.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.216+0000 7f4b1b7fe700 1 --2- 172.21.15.84:0/2547909977 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f4b0806ae00 0x7f4b0806d2b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c159a10 tx=0x7f4b0c0090e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:12.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.219+0000 7f4b03fff700 1 -- 172.21.15.84:0/2547909977 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f4b140553b0 con 0x7f4b1c0d0b10 2023-07-14T11:19:12.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.413+0000 7f4b21dff700 1 -- 172.21.15.84:0/2547909977 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4b1c08b890 con 0x7f4b1c0d0b10 2023-07-14T11:19:12.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.415+0000 7f4b03fff700 1 -- 172.21.15.84:0/2547909977 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+18401 (secure 0 0 0) 0x7f4b140589d0 con 0x7f4b1c0d0b10 2023-07-14T11:19:12.417 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:19:12.418 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":95,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:19:01.484069+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-07-14T11:18:40.531166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-07-14T11:18:41.475653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.179:6834/4019917691":"2023-07-15T11:18:58.463254+0000","172.21.15.179:6833/4019917691":"2023-07-15T11:18:58.463254+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:19:12.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.417+0000 7f4b21dff700 1 -- 172.21.15.84:0/2547909977 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f4b0806ae00 msgr2=0x7f4b0806d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:12.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.417+0000 7f4b21dff700 1 --2- 172.21.15.84:0/2547909977 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f4b0806ae00 0x7f4b0806d2b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c159a10 tx=0x7f4b0c0090e0 comp rx=0 tx=0).stop 2023-07-14T11:19:12.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.417+0000 7f4b21dff700 1 -- 172.21.15.84:0/2547909977 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b1c0d0b10 msgr2=0x7f4b1c151190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:12.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.417+0000 7f4b21dff700 1 --2- 172.21.15.84:0/2547909977 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b1c0d0b10 0x7f4b1c151190 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f4b14015040 tx=0x7f4b14004ad0 comp rx=0 tx=0).stop 2023-07-14T11:19:12.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.417+0000 7f4b21dff700 1 -- 172.21.15.84:0/2547909977 shutdown_connections 2023-07-14T11:19:12.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.417+0000 7f4b21dff700 1 --2- 172.21.15.84:0/2547909977 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f4b0806ae00 0x7f4b0806d2b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:12.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.417+0000 7f4b21dff700 1 --2- 172.21.15.84:0/2547909977 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b1c0b4510 0x7f4b1c15e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:12.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.417+0000 7f4b21dff700 1 --2- 172.21.15.84:0/2547909977 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b1c0d0b10 0x7f4b1c151190 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:12.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.417+0000 7f4b21dff700 1 --2- 172.21.15.84:0/2547909977 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b1c0b5d90 0x7f4b1c15cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:12.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.417+0000 7f4b21dff700 1 -- 172.21.15.84:0/2547909977 >> 172.21.15.84:0/2547909977 conn(0x7f4b1c09c1d0 msgr2=0x7f4b1c160a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:12.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.417+0000 7f4b21dff700 1 -- 172.21.15.84:0/2547909977 shutdown_connections 2023-07-14T11:19:12.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.417+0000 7f4b21dff700 1 -- 172.21.15.84:0/2547909977 wait complete. 2023-07-14T11:19:12.438 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-14T11:19:12.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.631+0000 7f4d10fff700 1 Processor -- start 2023-07-14T11:19:12.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.631+0000 7f4d10fff700 1 -- start start 2023-07-14T11:19:12.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.632+0000 7f4d10fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d0c0b8660 0x7f4d0c0cd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:12.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.632+0000 7f4d10fff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d0c0d02a0 con 0x7f4d0c0b4f70 2023-07-14T11:19:12.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.632+0000 7f4d10fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d0c0cfce0 con 0x7f4d0c0cd970 2023-07-14T11:19:12.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.632+0000 7f4d10fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0c0cffc0 con 0x7f4d0c0b8660 2023-07-14T11:19:12.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.633+0000 7f4d0ad9d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f4d0c0b4f70 0x7f4d0c0d12c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:34326/0 (socket says 172.21.15.84:34326) 2023-07-14T11:19:12.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.633+0000 7f4d0ad9d700 1 -- 172.21.15.84:0/4145737207 learned_addr learned my addr 172.21.15.84:0/4145737207 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:19:12.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.633+0000 7f4d0a59c700 1 --2- 172.21.15.84:0/4145737207 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d0c0b8660 0x7f4d0c0cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:12.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.633+0000 7f4d0959a700 1 -- 172.21.15.84:0/4145737207 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1313416047 0 0) 0x7f4d0c0d02a0 con 0x7f4d0c0b4f70 2023-07-14T11:19:12.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.633+0000 7f4d0959a700 1 -- 172.21.15.84:0/4145737207 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4cf40035b0 con 0x7f4d0c0b4f70 2023-07-14T11:19:12.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.633+0000 7f4d0959a700 1 -- 172.21.15.84:0/4145737207 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 651227856 0 0) 0x7f4d0c0cfce0 con 0x7f4d0c0cd970 2023-07-14T11:19:12.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.633+0000 7f4d0959a700 1 -- 172.21.15.84:0/4145737207 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d0c0d02a0 con 0x7f4d0c0cd970 2023-07-14T11:19:12.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.633+0000 7f4d0a59c700 1 -- 172.21.15.84:0/4145737207 >> v1:172.21.15.179:6789/0 conn(0x7f4d0c0cd970 legacy=0x7f4d0c0b4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:12.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.633+0000 7f4d0a59c700 1 -- 172.21.15.84:0/4145737207 >> v1:172.21.15.84:6789/0 conn(0x7f4d0c0b4f70 legacy=0x7f4d0c0d12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:12.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.633+0000 7f4d0a59c700 1 -- 172.21.15.84:0/4145737207 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d0c0d0ac0 con 0x7f4d0c0b8660 2023-07-14T11:19:12.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.634+0000 7f4d0a59c700 1 --2- 172.21.15.84:0/4145737207 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d0c0b8660 0x7f4d0c0cd430 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc009870 tx=0x7f4cfc009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c8e07742edf8697 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:12.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.634+0000 7f4d0959a700 1 -- 172.21.15.84:0/4145737207 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc011830 con 0x7f4d0c0b8660 2023-07-14T11:19:12.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.634+0000 7f4d0959a700 1 -- 172.21.15.84:0/4145737207 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cfc011990 con 0x7f4d0c0b8660 2023-07-14T11:19:12.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.634+0000 7f4d0959a700 1 -- 172.21.15.84:0/4145737207 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc011d20 con 0x7f4d0c0b8660 2023-07-14T11:19:12.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.634+0000 7f4d10fff700 1 -- 172.21.15.84:0/4145737207 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d0c0b8660 msgr2=0x7f4d0c0cd430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:12.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.634+0000 7f4d10fff700 1 --2- 172.21.15.84:0/4145737207 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d0c0b8660 0x7f4d0c0cd430 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc009870 tx=0x7f4cfc009b80 comp rx=0 tx=0).stop 2023-07-14T11:19:12.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.634+0000 7f4d10fff700 1 -- 172.21.15.84:0/4145737207 shutdown_connections 2023-07-14T11:19:12.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.634+0000 7f4d10fff700 1 --2- 172.21.15.84:0/4145737207 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d0c0b8660 0x7f4d0c0cd430 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:12.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.634+0000 7f4d10fff700 1 -- 172.21.15.84:0/4145737207 >> 172.21.15.84:0/4145737207 conn(0x7f4d0c066860 msgr2=0x7f4d0c06a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:12.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.634+0000 7f4d10fff700 1 -- 172.21.15.84:0/4145737207 shutdown_connections 2023-07-14T11:19:12.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.635+0000 7f4d10fff700 1 -- 172.21.15.84:0/4145737207 wait complete. 2023-07-14T11:19:12.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.636+0000 7f4d10fff700 1 Processor -- start 2023-07-14T11:19:12.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.636+0000 7f4d10fff700 1 -- start start 2023-07-14T11:19:12.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.637+0000 7f4d10fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d0c0b4f70 0x7f4d0c153a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:12.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.637+0000 7f4d10fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d0c0b8660 0x7f4d0c1542c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:12.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.637+0000 7f4d10fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d0c0cd970 0x7f4d0c157a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:12.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.637+0000 7f4d10fff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0c153640 con 0x7f4d0c0b8660 2023-07-14T11:19:12.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.637+0000 7f4d10fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0c0ca980 con 0x7f4d0c0cd970 2023-07-14T11:19:12.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.637+0000 7f4d10fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0c152f80 con 0x7f4d0c0b4f70 2023-07-14T11:19:12.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.637+0000 7f4d09d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d0c0b8660 0x7f4d0c1542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:12.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.638+0000 7f4d09d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d0c0b8660 0x7f4d0c1542c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34244/0 (socket says 172.21.15.84:34244) 2023-07-14T11:19:12.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.638+0000 7f4d09d9b700 1 -- 172.21.15.84:0/2039664338 learned_addr learned my addr 172.21.15.84:0/2039664338 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:12.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.638+0000 7f4d0ad9d700 1 --2- 172.21.15.84:0/2039664338 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d0c0cd970 0x7f4d0c157a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:12.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.638+0000 7f4d0a59c700 1 --2- 172.21.15.84:0/2039664338 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d0c0b4f70 0x7f4d0c153a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:12.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.638+0000 7f4d09d9b700 1 -- 172.21.15.84:0/2039664338 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d0c0b4f70 msgr2=0x7f4d0c153a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:12.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.638+0000 7f4d09d9b700 1 --2- 172.21.15.84:0/2039664338 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d0c0b4f70 0x7f4d0c153a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:12.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.638+0000 7f4d09d9b700 1 -- 172.21.15.84:0/2039664338 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d0c0cd970 msgr2=0x7f4d0c157a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:12.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.638+0000 7f4d09d9b700 1 --2- 172.21.15.84:0/2039664338 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d0c0cd970 0x7f4d0c157a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:12.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.638+0000 7f4d09d9b700 1 -- 172.21.15.84:0/2039664338 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cfc0094a0 con 0x7f4d0c0b8660 2023-07-14T11:19:12.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.638+0000 7f4d09d9b700 1 --2- 172.21.15.84:0/2039664338 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d0c0b8660 0x7f4d0c1542c0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f4d0000c4d0 tx=0x7f4d0000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:12.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.638+0000 7f4cfaffd700 1 -- 172.21.15.84:0/2039664338 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d000052d0 con 0x7f4d0c0b8660 2023-07-14T11:19:12.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.638+0000 7f4cfaffd700 1 -- 172.21.15.84:0/2039664338 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d00005430 con 0x7f4d0c0b8660 2023-07-14T11:19:12.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.638+0000 7f4d10fff700 1 -- 172.21.15.84:0/2039664338 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d0c153260 con 0x7f4d0c0b8660 2023-07-14T11:19:12.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.638+0000 7f4cfaffd700 1 -- 172.21.15.84:0/2039664338 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d000038a0 con 0x7f4d0c0b8660 2023-07-14T11:19:12.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.639+0000 7f4d10fff700 1 -- 172.21.15.84:0/2039664338 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d0c0ca480 con 0x7f4d0c0b8660 2023-07-14T11:19:12.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.640+0000 7f4d10fff700 1 -- 172.21.15.84:0/2039664338 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d0c152de0 con 0x7f4d0c0b8660 2023-07-14T11:19:12.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.640+0000 7f4cfaffd700 1 -- 172.21.15.84:0/2039664338 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f4d00003a00 con 0x7f4d0c0b8660 2023-07-14T11:19:12.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.641+0000 7f4cfaffd700 1 --2- 172.21.15.84:0/2039664338 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f4cec06ae00 0x7f4cec06d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:12.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.641+0000 7f4cfaffd700 1 -- 172.21.15.84:0/2039664338 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f4d00088a80 con 0x7f4d0c0b8660 2023-07-14T11:19:12.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.642+0000 7f4d0a59c700 1 --2- 172.21.15.84:0/2039664338 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f4cec06ae00 0x7f4cec06d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:12.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.642+0000 7f4d0a59c700 1 --2- 172.21.15.84:0/2039664338 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f4cec06ae00 0x7f4cec06d2b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc0097c0 tx=0x7f4cfc01c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:12.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.645+0000 7f4cfaffd700 1 -- 172.21.15.84:0/2039664338 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f4d0c152de0 con 0x7f4d0c0b8660 2023-07-14T11:19:12.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.883+0000 7f4d10fff700 1 -- 172.21.15.84:0/2039664338 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f4d0c153780 con 0x7f4d0c0b8660 2023-07-14T11:19:12.886 INFO:tasks.ceph.mon.a.smithi084.stderr:2023-07-14T11:19:12.884+0000 7f5e043f4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-14T11:19:12.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.889+0000 7f4cfaffd700 1 -- 172.21.15.84:0/2039664338 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v61) v1 ==== 161+0+0 (secure 0 0 0) 0x7f4d0c153780 con 0x7f4d0c0b8660 2023-07-14T11:19:12.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.892+0000 7f4d10fff700 1 -- 172.21.15.84:0/2039664338 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f4cec06ae00 msgr2=0x7f4cec06d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:12.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.892+0000 7f4d10fff700 1 --2- 172.21.15.84:0/2039664338 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f4cec06ae00 0x7f4cec06d2b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc0097c0 tx=0x7f4cfc01c040 comp rx=0 tx=0).stop 2023-07-14T11:19:12.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.892+0000 7f4d10fff700 1 -- 172.21.15.84:0/2039664338 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d0c0b8660 msgr2=0x7f4d0c1542c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:12.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.892+0000 7f4d10fff700 1 --2- 172.21.15.84:0/2039664338 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d0c0b8660 0x7f4d0c1542c0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f4d0000c4d0 tx=0x7f4d0000c890 comp rx=0 tx=0).stop 2023-07-14T11:19:12.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.892+0000 7f4d10fff700 1 -- 172.21.15.84:0/2039664338 shutdown_connections 2023-07-14T11:19:12.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.892+0000 7f4d10fff700 1 --2- 172.21.15.84:0/2039664338 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f4cec06ae00 0x7f4cec06d2b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:12.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.892+0000 7f4d10fff700 1 --2- 172.21.15.84:0/2039664338 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d0c0b4f70 0x7f4d0c153a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:12.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.892+0000 7f4d10fff700 1 --2- 172.21.15.84:0/2039664338 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d0c0cd970 0x7f4d0c157a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:12.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.892+0000 7f4d10fff700 1 --2- 172.21.15.84:0/2039664338 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d0c0b8660 0x7f4d0c1542c0 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:12.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.892+0000 7f4d10fff700 1 -- 172.21.15.84:0/2039664338 >> 172.21.15.84:0/2039664338 conn(0x7f4d0c066860 msgr2=0x7f4d0c0b4670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:12.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.892+0000 7f4d10fff700 1 -- 172.21.15.84:0/2039664338 shutdown_connections 2023-07-14T11:19:12.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:12.892+0000 7f4d10fff700 1 -- 172.21.15.84:0/2039664338 wait complete. 2023-07-14T11:19:12.896 INFO:teuthology.orchestra.run.smithi084.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-14T11:19:12.899 INFO:tasks.ceph.mds.c.smithi084.stderr: -3746> 2023-07-14T11:18:46.984+0000 7f06881f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-14T11:19:12.913 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-14T11:19:12.950 INFO:tasks.ceph.mds.c.smithi084.stdout:starting mds.c at 2023-07-14T11:19:13.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:13.111+0000 7f2ba6bff700 1 Processor -- start 2023-07-14T11:19:13.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:13.111+0000 7f2ba6bff700 1 -- start start 2023-07-14T11:19:13.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:13.113+0000 7f2ba6bff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2ba00cf2a0 0x7f2ba01673d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:13.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:13.113+0000 7f2ba6bff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ba00cf720 con 0x7f2ba015c860 2023-07-14T11:19:13.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:13.113+0000 7f2ba6bff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ba00cd5a0 con 0x7f2ba00d1e40 2023-07-14T11:19:13.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:13.113+0000 7f2ba6bff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ba0146740 con 0x7f2ba00cf2a0 2023-07-14T11:19:13.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:13.113+0000 7f2ba499b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f2ba015c860 0x7f2ba00c6aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:34328/0 (socket says 172.21.15.84:34328) 2023-07-14T11:19:13.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:13.113+0000 7f2ba499b700 1 -- 172.21.15.84:0/2705886661 learned_addr learned my addr 172.21.15.84:0/2705886661 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:19:13.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:13.113+0000 7f2ba519c700 1 --2- 172.21.15.84:0/2705886661 >> v2:172.21.15.179:3300/0 conn(0x7f2ba00cf2a0 0x7f2ba01673d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:13.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:13.113+0000 7f2b9f7fe700 1 -- 172.21.15.84:0/2705886661 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2376186528 0 0) 0x7f2ba00cf720 con 0x7f2ba015c860 2023-07-14T11:19:13.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:13.113+0000 7f2b9f7fe700 1 -- 172.21.15.84:0/2705886661 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b900035b0 con 0x7f2ba015c860 2023-07-14T11:19:13.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:13.113+0000 7f2b9f7fe700 1 -- 172.21.15.84:0/2705886661 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 699376963 0 0) 0x7f2ba00cd5a0 con 0x7f2ba00d1e40 2023-07-14T11:19:13.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:13.113+0000 7f2b9f7fe700 1 -- 172.21.15.84:0/2705886661 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ba00cf720 con 0x7f2ba00d1e40 2023-07-14T11:19:13.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:13.114+0000 7f2ba519c700 1 -- 172.21.15.84:0/2705886661 >> v1:172.21.15.179:6789/0 conn(0x7f2ba00d1e40 legacy=0x7f2ba00c71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:13.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:13.114+0000 7f2ba519c700 1 -- 172.21.15.84:0/2705886661 >> v1:172.21.15.84:6789/0 conn(0x7f2ba015c860 legacy=0x7f2ba00c6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:13.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:13.114+0000 7f2ba519c700 1 -- 172.21.15.84:0/2705886661 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba00cd7f0 con 0x7f2ba00cf2a0 2023-07-14T11:19:13.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:13.114+0000 7f2ba519c700 1 --2- 172.21.15.84:0/2705886661 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ba00cf2a0 0x7f2ba01673d0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f2b98009d90 tx=0x7f2b9800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84563878dfd44f9e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:13.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:13.114+0000 7f2b9f7fe700 1 -- 172.21.15.84:0/2705886661 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9800e070 con 0x7f2ba00cf2a0 2023-07-14T11:19:13.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:13.114+0000 7f2b9f7fe700 1 -- 172.21.15.84:0/2705886661 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b9800bb20 con 0x7f2ba00cf2a0 2023-07-14T11:19:13.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:13.114+0000 7f2b9f7fe700 1 -- 172.21.15.84:0/2705886661 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9800be90 con 0x7f2ba00cf2a0 2023-07-14T11:19:13.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:13.115+0000 7f2ba6bff700 1 -- 172.21.15.84:0/2705886661 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ba00cf2a0 msgr2=0x7f2ba01673d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:13.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:13.115+0000 7f2ba6bff700 1 --2- 172.21.15.84:0/2705886661 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ba00cf2a0 0x7f2ba01673d0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f2b98009d90 tx=0x7f2b9800b330 comp rx=0 tx=0).stop 2023-07-14T11:19:13.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:13.115+0000 7f2ba6bff700 1 -- 172.21.15.84:0/2705886661 shutdown_connections 2023-07-14T11:19:13.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:13.115+0000 7f2ba6bff700 1 --2- 172.21.15.84:0/2705886661 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ba00cf2a0 0x7f2ba01673d0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:13.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:13.115+0000 7f2ba6bff700 1 -- 172.21.15.84:0/2705886661 >> 172.21.15.84:0/2705886661 conn(0x7f2ba0065bd0 msgr2=0x7f2ba0065fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:13.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:13.115+0000 7f2ba6bff700 1 -- 172.21.15.84:0/2705886661 shutdown_connections 2023-07-14T11:19:13.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:13.115+0000 7f2ba6bff700 1 -- 172.21.15.84:0/2705886661 wait complete. 2023-07-14T11:19:13.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:13.116+0000 7f2ba6bff700 1 Processor -- start 2023-07-14T11:19:13.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:13.117+0000 7f2ba6bff700 1 -- start start 2023-07-14T11:19:13.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:13.118+0000 7f2ba6bff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ba00cf2a0 0x7f2ba00cba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:13.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:13.118+0000 7f2ba6bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ba00d1e40 0x7f2ba00c5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:13.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:13.118+0000 7f2ba6bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ba015c860 0x7f2ba00c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:13.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:13.118+0000 7f2ba6bff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba00b8c50 con 0x7f2ba00cf2a0 2023-07-14T11:19:13.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:13.118+0000 7f2ba6bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba00caa30 con 0x7f2ba015c860 2023-07-14T11:19:13.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:13.118+0000 7f2ba6bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba00cacd0 con 0x7f2ba00d1e40 2023-07-14T11:19:13.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:13.118+0000 7f2ba499b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ba00cf2a0 0x7f2ba00cba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:13.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:13.118+0000 7f2ba499b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ba00cf2a0 0x7f2ba00cba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34276/0 (socket says 172.21.15.84:34276) 2023-07-14T11:19:13.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:13.118+0000 7f2ba499b700 1 -- 172.21.15.84:0/1615110487 learned_addr learned my addr 172.21.15.84:0/1615110487 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:13.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:13.118+0000 7f2ba499b700 1 -- 172.21.15.84:0/1615110487 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ba00d1e40 msgr2=0x7f2ba00c5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:13.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:13.118+0000 7f2b9ffff700 1 --2- 172.21.15.84:0/1615110487 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ba00d1e40 0x7f2ba00c5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:13.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:13.118+0000 7f2ba519c700 1 --2- 172.21.15.84:0/1615110487 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ba015c860 0x7f2ba00c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:13.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:13.118+0000 7f2ba499b700 1 --2- 172.21.15.84:0/1615110487 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ba00d1e40 0x7f2ba00c5740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:13.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:13.118+0000 7f2ba499b700 1 -- 172.21.15.84:0/1615110487 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ba015c860 msgr2=0x7f2ba00c5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:13.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:13.118+0000 7f2ba499b700 1 --2- 172.21.15.84:0/1615110487 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ba015c860 0x7f2ba00c5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:13.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:13.118+0000 7f2ba499b700 1 -- 172.21.15.84:0/1615110487 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b98009a70 con 0x7f2ba00cf2a0 2023-07-14T11:19:13.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:13.118+0000 7f2ba519c700 1 --2- 172.21.15.84:0/1615110487 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ba015c860 0x7f2ba00c5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:19:13.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:13.118+0000 7f2b9ffff700 1 --2- 172.21.15.84:0/1615110487 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ba00d1e40 0x7f2ba00c5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:19:13.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:13.119+0000 7f2ba499b700 1 --2- 172.21.15.84:0/1615110487 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ba00cf2a0 0x7f2ba00cba90 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f2b9400c4d0 tx=0x7f2b9400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:13.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:13.119+0000 7f2b9d7fa700 1 -- 172.21.15.84:0/1615110487 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b94005d70 con 0x7f2ba00cf2a0 2023-07-14T11:19:13.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:13.119+0000 7f2b9d7fa700 1 -- 172.21.15.84:0/1615110487 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b940070d0 con 0x7f2ba00cf2a0 2023-07-14T11:19:13.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:13.119+0000 7f2b9d7fa700 1 -- 172.21.15.84:0/1615110487 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b94007480 con 0x7f2ba00cf2a0 2023-07-14T11:19:13.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:13.119+0000 7f2ba6bff700 1 -- 172.21.15.84:0/1615110487 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ba00cafb0 con 0x7f2ba00cf2a0 2023-07-14T11:19:13.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:13.119+0000 7f2ba6bff700 1 -- 172.21.15.84:0/1615110487 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ba00cb570 con 0x7f2ba00cf2a0 2023-07-14T11:19:13.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:13.120+0000 7f2ba6bff700 1 -- 172.21.15.84:0/1615110487 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ba015cc30 con 0x7f2ba00cf2a0 2023-07-14T11:19:13.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:13.121+0000 7f2b9d7fa700 1 -- 172.21.15.84:0/1615110487 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f2b940075e0 con 0x7f2ba00cf2a0 2023-07-14T11:19:13.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:13.122+0000 7f2b9d7fa700 1 --2- 172.21.15.84:0/1615110487 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f2b8406ae00 0x7f2b8406d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:13.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:13.122+0000 7f2b9d7fa700 1 -- 172.21.15.84:0/1615110487 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6234+0+0 (secure 0 0 0) 0x7f2b94088d00 con 0x7f2ba00cf2a0 2023-07-14T11:19:13.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:13.123+0000 7f2b9ffff700 1 --2- 172.21.15.84:0/1615110487 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f2b8406ae00 0x7f2b8406d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:13.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:13.123+0000 7f2b9ffff700 1 --2- 172.21.15.84:0/1615110487 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f2b8406ae00 0x7f2b8406d2b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2ba01f59e0 tx=0x7f2b8c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:13.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:13.126+0000 7f2b9d7fa700 1 -- 172.21.15.84:0/1615110487 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f2b94053b50 con 0x7f2ba00cf2a0 2023-07-14T11:19:13.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:13.362+0000 7f2ba6bff700 1 -- 172.21.15.84:0/1615110487 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f2ba0074350 con 0x7f2ba00cf2a0 2023-07-14T11:19:13.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:13.889+0000 7f2b9d7fa700 1 -- 172.21.15.84:0/1615110487 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v62) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2b94057170 con 0x7f2ba00cf2a0 2023-07-14T11:19:13.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:13.892+0000 7f2ba6bff700 1 -- 172.21.15.84:0/1615110487 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f2b8406ae00 msgr2=0x7f2b8406d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:13.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:13.892+0000 7f2ba6bff700 1 --2- 172.21.15.84:0/1615110487 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f2b8406ae00 0x7f2b8406d2b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2ba01f59e0 tx=0x7f2b8c009040 comp rx=0 tx=0).stop 2023-07-14T11:19:13.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:13.892+0000 7f2ba6bff700 1 -- 172.21.15.84:0/1615110487 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ba00cf2a0 msgr2=0x7f2ba00cba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:13.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:13.892+0000 7f2ba6bff700 1 --2- 172.21.15.84:0/1615110487 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ba00cf2a0 0x7f2ba00cba90 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f2b9400c4d0 tx=0x7f2b9400c890 comp rx=0 tx=0).stop 2023-07-14T11:19:13.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:13.892+0000 7f2ba6bff700 1 -- 172.21.15.84:0/1615110487 shutdown_connections 2023-07-14T11:19:13.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:13.892+0000 7f2ba6bff700 1 --2- 172.21.15.84:0/1615110487 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ba015c860 0x7f2ba00c5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:13.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:13.892+0000 7f2ba6bff700 1 --2- 172.21.15.84:0/1615110487 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ba00cf2a0 0x7f2ba00cba90 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:13.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:13.892+0000 7f2ba6bff700 1 --2- 172.21.15.84:0/1615110487 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f2b8406ae00 0x7f2b8406d2b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:13.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:13.892+0000 7f2ba6bff700 1 --2- 172.21.15.84:0/1615110487 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ba00d1e40 0x7f2ba00c5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:13.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:13.892+0000 7f2ba6bff700 1 -- 172.21.15.84:0/1615110487 >> 172.21.15.84:0/1615110487 conn(0x7f2ba0065bd0 msgr2=0x7f2ba00d2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:13.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:13.892+0000 7f2ba6bff700 1 -- 172.21.15.84:0/1615110487 shutdown_connections 2023-07-14T11:19:13.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:13.892+0000 7f2ba6bff700 1 -- 172.21.15.84:0/1615110487 wait complete. 2023-07-14T11:19:13.913 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-14T11:19:14.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:14.153+0000 7fac427ff700 1 Processor -- start 2023-07-14T11:19:14.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:14.154+0000 7fac427ff700 1 -- start start 2023-07-14T11:19:14.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:14.155+0000 7fac427ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac3c0d1160 0x7fac3c0cd4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:14.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:14.155+0000 7fac427ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac3c15cc60 con 0x7fac3c0b2440 2023-07-14T11:19:14.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:14.155+0000 7fac427ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac3c06a7f0 con 0x7fac3c15c890 2023-07-14T11:19:14.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:14.155+0000 7fac427ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac3c06b760 con 0x7fac3c0d1160 2023-07-14T11:19:14.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:14.155+0000 7fac40d9c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fac3c0b2440 0x7fac3c0cda10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:34344/0 (socket says 172.21.15.84:34344) 2023-07-14T11:19:14.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:14.155+0000 7fac40d9c700 1 -- 172.21.15.84:0/1665126033 learned_addr learned my addr 172.21.15.84:0/1665126033 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:19:14.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:14.155+0000 7fac3b7fe700 1 --2- 172.21.15.84:0/1665126033 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac3c0d1160 0x7fac3c0cd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:14.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:14.155+0000 7fac3affd700 1 -- 172.21.15.84:0/1665126033 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 458120227 0 0) 0x7fac3c15cc60 con 0x7fac3c0b2440 2023-07-14T11:19:14.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:14.155+0000 7fac3affd700 1 -- 172.21.15.84:0/1665126033 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac240035b0 con 0x7fac3c0b2440 2023-07-14T11:19:14.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:14.156+0000 7fac3affd700 1 -- 172.21.15.84:0/1665126033 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2919524321 0 0) 0x7fac3c06a7f0 con 0x7fac3c15c890 2023-07-14T11:19:14.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:14.156+0000 7fac3affd700 1 -- 172.21.15.84:0/1665126033 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac3c15cc60 con 0x7fac3c15c890 2023-07-14T11:19:14.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:14.156+0000 7fac3b7fe700 1 -- 172.21.15.84:0/1665126033 >> v1:172.21.15.179:6789/0 conn(0x7fac3c15c890 legacy=0x7fac3c0d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:14.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:14.156+0000 7fac3b7fe700 1 -- 172.21.15.84:0/1665126033 >> v1:172.21.15.84:6789/0 conn(0x7fac3c0b2440 legacy=0x7fac3c0cda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:14.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:14.156+0000 7fac3affd700 1 -- 172.21.15.84:0/1665126033 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2947613427 0 0) 0x7fac240035b0 con 0x7fac3c0b2440 2023-07-14T11:19:14.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:14.156+0000 7fac3b7fe700 1 -- 172.21.15.84:0/1665126033 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac3c06ba40 con 0x7fac3c0d1160 2023-07-14T11:19:14.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:14.156+0000 7fac3b7fe700 1 --2- 172.21.15.84:0/1665126033 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac3c0d1160 0x7fac3c0cd4d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fac30009870 tx=0x7fac30009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fdcce731b78d40ed server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:14.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:14.156+0000 7fac3affd700 1 -- 172.21.15.84:0/1665126033 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac340019f0 con 0x7fac3c0d1160 2023-07-14T11:19:14.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:14.156+0000 7fac3affd700 1 -- 172.21.15.84:0/1665126033 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac30004030 con 0x7fac3c0d1160 2023-07-14T11:19:14.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:14.156+0000 7fac3affd700 1 -- 172.21.15.84:0/1665126033 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac300043a0 con 0x7fac3c0d1160 2023-07-14T11:19:14.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:14.157+0000 7fac427ff700 1 -- 172.21.15.84:0/1665126033 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac3c0d1160 msgr2=0x7fac3c0cd4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:14.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:14.157+0000 7fac427ff700 1 --2- 172.21.15.84:0/1665126033 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac3c0d1160 0x7fac3c0cd4d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fac30009870 tx=0x7fac30009b80 comp rx=0 tx=0).stop 2023-07-14T11:19:14.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:14.157+0000 7fac427ff700 1 -- 172.21.15.84:0/1665126033 shutdown_connections 2023-07-14T11:19:14.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:14.157+0000 7fac427ff700 1 --2- 172.21.15.84:0/1665126033 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac3c0d1160 0x7fac3c0cd4d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:14.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:14.157+0000 7fac427ff700 1 -- 172.21.15.84:0/1665126033 >> 172.21.15.84:0/1665126033 conn(0x7fac3c09c170 msgr2=0x7fac3c0d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:14.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:14.157+0000 7fac427ff700 1 -- 172.21.15.84:0/1665126033 shutdown_connections 2023-07-14T11:19:14.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:14.157+0000 7fac427ff700 1 -- 172.21.15.84:0/1665126033 wait complete. 2023-07-14T11:19:14.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:14.159+0000 7fac427ff700 1 Processor -- start 2023-07-14T11:19:14.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:14.160+0000 7fac427ff700 1 -- start start 2023-07-14T11:19:14.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:14.161+0000 7fac427ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac3c0b2440 0x7fac3c1f3030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:14.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:14.161+0000 7fac427ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac3c0d1160 0x7fac3c15b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:14.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:14.161+0000 7fac427ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac3c15c890 0x7fac3c0c6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:14.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:14.161+0000 7fac427ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac3c1f2420 con 0x7fac3c15c890 2023-07-14T11:19:14.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:14.161+0000 7fac427ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac3c1f2700 con 0x7fac3c0b2440 2023-07-14T11:19:14.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:14.161+0000 7fac427ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac3c1f29e0 con 0x7fac3c0d1160 2023-07-14T11:19:14.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:14.161+0000 7fac40d9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac3c15c890 0x7fac3c0c6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:14.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:14.161+0000 7fac40d9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac3c15c890 0x7fac3c0c6df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34284/0 (socket says 172.21.15.84:34284) 2023-07-14T11:19:14.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:14.161+0000 7fac40d9c700 1 -- 172.21.15.84:0/175724335 learned_addr learned my addr 172.21.15.84:0/175724335 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:14.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:14.161+0000 7fac3b7fe700 1 --2- 172.21.15.84:0/175724335 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac3c0d1160 0x7fac3c15b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:14.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:14.161+0000 7fac3bfff700 1 --2- 172.21.15.84:0/175724335 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac3c0b2440 0x7fac3c1f3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:14.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:14.162+0000 7fac40d9c700 1 -- 172.21.15.84:0/175724335 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac3c0d1160 msgr2=0x7fac3c15b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:14.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:14.162+0000 7fac40d9c700 1 --2- 172.21.15.84:0/175724335 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac3c0d1160 0x7fac3c15b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:14.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:14.162+0000 7fac40d9c700 1 -- 172.21.15.84:0/175724335 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac3c0b2440 msgr2=0x7fac3c1f3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:14.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:14.162+0000 7fac40d9c700 1 --2- 172.21.15.84:0/175724335 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac3c0b2440 0x7fac3c1f3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:14.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:14.162+0000 7fac40d9c700 1 -- 172.21.15.84:0/175724335 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac300094a0 con 0x7fac3c15c890 2023-07-14T11:19:14.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:14.162+0000 7fac40d9c700 1 --2- 172.21.15.84:0/175724335 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac3c15c890 0x7fac3c0c6df0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7fac3400cc40 tx=0x7fac3400cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:14.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:14.162+0000 7fac38ff9700 1 -- 172.21.15.84:0/175724335 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac3400aac0 con 0x7fac3c15c890 2023-07-14T11:19:14.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:14.162+0000 7fac38ff9700 1 -- 172.21.15.84:0/175724335 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac3400ac20 con 0x7fac3c15c890 2023-07-14T11:19:14.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:14.162+0000 7fac38ff9700 1 -- 172.21.15.84:0/175724335 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac340070d0 con 0x7fac3c15c890 2023-07-14T11:19:14.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:14.162+0000 7fac427ff700 1 -- 172.21.15.84:0/175724335 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac3c1f2cc0 con 0x7fac3c15c890 2023-07-14T11:19:14.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:14.162+0000 7fac427ff700 1 -- 172.21.15.84:0/175724335 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac3c15bc00 con 0x7fac3c15c890 2023-07-14T11:19:14.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:14.163+0000 7fac427ff700 1 -- 172.21.15.84:0/175724335 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac3c074350 con 0x7fac3c15c890 2023-07-14T11:19:14.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:14.164+0000 7fac38ff9700 1 -- 172.21.15.84:0/175724335 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7fac34007230 con 0x7fac3c15c890 2023-07-14T11:19:14.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:14.165+0000 7fac38ff9700 1 --2- 172.21.15.84:0/175724335 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fac2806ae00 0x7fac2806d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:14.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:14.165+0000 7fac38ff9700 1 -- 172.21.15.84:0/175724335 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6234+0+0 (secure 0 0 0) 0x7fac34089250 con 0x7fac3c15c890 2023-07-14T11:19:14.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:14.165+0000 7fac3bfff700 1 --2- 172.21.15.84:0/175724335 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fac2806ae00 0x7fac2806d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:14.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:14.166+0000 7fac3bfff700 1 --2- 172.21.15.84:0/175724335 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fac2806ae00 0x7fac2806d2b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fac2c0011e0 tx=0x7fac2c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:14.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:14.169+0000 7fac38ff9700 1 -- 172.21.15.84:0/175724335 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fac34054140 con 0x7fac3c15c890 2023-07-14T11:19:14.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:14.362+0000 7fac427ff700 1 -- 172.21.15.84:0/175724335 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fac3c0d34d0 con 0x7fac3c15c890 2023-07-14T11:19:14.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:14.897+0000 7fac38ff9700 1 -- 172.21.15.84:0/175724335 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v97) v1 ==== 181+0+0 (secure 0 0 0) 0x7fac34057760 con 0x7fac3c15c890 2023-07-14T11:19:14.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:14.902+0000 7fac427ff700 1 -- 172.21.15.84:0/175724335 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fac2806ae00 msgr2=0x7fac2806d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:14.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:14.902+0000 7fac427ff700 1 --2- 172.21.15.84:0/175724335 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fac2806ae00 0x7fac2806d2b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fac2c0011e0 tx=0x7fac2c009040 comp rx=0 tx=0).stop 2023-07-14T11:19:14.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:14.902+0000 7fac427ff700 1 -- 172.21.15.84:0/175724335 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac3c15c890 msgr2=0x7fac3c0c6df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:14.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:14.902+0000 7fac427ff700 1 --2- 172.21.15.84:0/175724335 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac3c15c890 0x7fac3c0c6df0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7fac3400cc40 tx=0x7fac3400cf50 comp rx=0 tx=0).stop 2023-07-14T11:19:14.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:14.902+0000 7fac427ff700 1 -- 172.21.15.84:0/175724335 shutdown_connections 2023-07-14T11:19:14.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:14.903+0000 7fac427ff700 1 --2- 172.21.15.84:0/175724335 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac3c15c890 0x7fac3c0c6df0 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:14.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:14.903+0000 7fac427ff700 1 --2- 172.21.15.84:0/175724335 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac3c0b2440 0x7fac3c1f3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:14.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:14.903+0000 7fac427ff700 1 --2- 172.21.15.84:0/175724335 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fac2806ae00 0x7fac2806d2b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:14.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:14.903+0000 7fac427ff700 1 --2- 172.21.15.84:0/175724335 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac3c0d1160 0x7fac3c15b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:14.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:14.903+0000 7fac427ff700 1 -- 172.21.15.84:0/175724335 >> 172.21.15.84:0/175724335 conn(0x7fac3c09c170 msgr2=0x7fac3c0b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:14.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:14.903+0000 7fac427ff700 1 -- 172.21.15.84:0/175724335 shutdown_connections 2023-07-14T11:19:14.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:14.903+0000 7fac427ff700 1 -- 172.21.15.84:0/175724335 wait complete. 2023-07-14T11:19:14.907 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_metadata' removed 2023-07-14T11:19:14.926 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-14T11:19:15.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:15.130+0000 7fb2f21ff700 1 Processor -- start 2023-07-14T11:19:15.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:15.130+0000 7fb2f21ff700 1 -- start start 2023-07-14T11:19:15.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:15.131+0000 7fb2f21ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2ec15c890 0x7fb2ec0d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:15.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:15.131+0000 7fb2f21ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb2ec0b2440 0x7fb2ec0d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:15.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:15.131+0000 7fb2f21ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2ec15cc60 con 0x7fb2ec06c240 2023-07-14T11:19:15.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:15.131+0000 7fb2f21ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2ec06a7f0 con 0x7fb2ec0b2440 2023-07-14T11:19:15.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:15.131+0000 7fb2f21ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ec06b760 con 0x7fb2ec15c890 2023-07-14T11:19:15.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:15.132+0000 7fb2eaffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb2ec0b2440 0x7fb2ec0d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:15.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:15.132+0000 7fb2eaffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb2ec0b2440 0x7fb2ec0d0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34296/0 (socket says 172.21.15.84:34296) 2023-07-14T11:19:15.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:15.132+0000 7fb2eaffd700 1 -- 172.21.15.84:0/142052325 learned_addr learned my addr 172.21.15.84:0/142052325 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:15.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:15.132+0000 7fb2eb7fe700 1 --2- 172.21.15.84:0/142052325 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2ec15c890 0x7fb2ec0d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:15.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:15.132+0000 7fb2eaffd700 1 -- 172.21.15.84:0/142052325 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2ec15c890 msgr2=0x7fb2ec0d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:15.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:15.132+0000 7fb2eaffd700 1 --2- 172.21.15.84:0/142052325 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2ec15c890 0x7fb2ec0d0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:15.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:15.132+0000 7fb2eaffd700 1 -- 172.21.15.84:0/142052325 >> v1:172.21.15.179:6789/0 conn(0x7fb2ec06c240 legacy=0x7fb2ec0cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:15.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:15.132+0000 7fb2eaffd700 1 -- 172.21.15.84:0/142052325 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2ec06ba40 con 0x7fb2ec0b2440 2023-07-14T11:19:15.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:15.132+0000 7fb2eb7fe700 1 --2- 172.21.15.84:0/142052325 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2ec15c890 0x7fb2ec0d0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:19:15.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:15.132+0000 7fb2eaffd700 1 --2- 172.21.15.84:0/142052325 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2ec0b2440 0x7fb2ec0d0f90 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7fb2e00098f0 tx=0x7fb2e0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7702a9f1c3bdb846 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:15.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:15.133+0000 7fb2ea7fc700 1 -- 172.21.15.84:0/142052325 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e000b8a0 con 0x7fb2ec0b2440 2023-07-14T11:19:15.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:15.133+0000 7fb2ea7fc700 1 -- 172.21.15.84:0/142052325 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2e000ba00 con 0x7fb2ec0b2440 2023-07-14T11:19:15.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:15.133+0000 7fb2ea7fc700 1 -- 172.21.15.84:0/142052325 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e000bd90 con 0x7fb2ec0b2440 2023-07-14T11:19:15.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:15.133+0000 7fb2f21ff700 1 -- 172.21.15.84:0/142052325 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2ec0b2440 msgr2=0x7fb2ec0d0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:15.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:15.133+0000 7fb2f21ff700 1 --2- 172.21.15.84:0/142052325 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2ec0b2440 0x7fb2ec0d0f90 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7fb2e00098f0 tx=0x7fb2e0009c00 comp rx=0 tx=0).stop 2023-07-14T11:19:15.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:15.133+0000 7fb2f21ff700 1 -- 172.21.15.84:0/142052325 shutdown_connections 2023-07-14T11:19:15.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:15.133+0000 7fb2f21ff700 1 --2- 172.21.15.84:0/142052325 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2ec15c890 0x7fb2ec0d0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:15.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:15.133+0000 7fb2f21ff700 1 --2- 172.21.15.84:0/142052325 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2ec0b2440 0x7fb2ec0d0f90 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:15.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:15.133+0000 7fb2f21ff700 1 -- 172.21.15.84:0/142052325 >> 172.21.15.84:0/142052325 conn(0x7fb2ec09c170 msgr2=0x7fb2ec0d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:15.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:15.133+0000 7fb2f21ff700 1 -- 172.21.15.84:0/142052325 shutdown_connections 2023-07-14T11:19:15.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:15.133+0000 7fb2f21ff700 1 -- 172.21.15.84:0/142052325 wait complete. 2023-07-14T11:19:15.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:15.135+0000 7fb2f21ff700 1 Processor -- start 2023-07-14T11:19:15.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:15.135+0000 7fb2f21ff700 1 -- start start 2023-07-14T11:19:15.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:15.136+0000 7fb2f21ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb2ec06c240 0x7fb2ec15ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:15.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:15.136+0000 7fb2f21ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2ec0b2440 0x7fb2ec1f49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:15.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:15.136+0000 7fb2f21ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2ec15c890 0x7fb2ec14a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:15.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:15.136+0000 7fb2f21ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ec0b6e00 con 0x7fb2ec15c890 2023-07-14T11:19:15.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:15.136+0000 7fb2f21ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ec15f6d0 con 0x7fb2ec06c240 2023-07-14T11:19:15.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:15.136+0000 7fb2f21ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ec15f9b0 con 0x7fb2ec0b2440 2023-07-14T11:19:15.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:15.136+0000 7fb2ebfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2ec15c890 0x7fb2ec14a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:15.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:15.136+0000 7fb2ebfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2ec15c890 0x7fb2ec14a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34298/0 (socket says 172.21.15.84:34298) 2023-07-14T11:19:15.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:15.136+0000 7fb2ebfff700 1 -- 172.21.15.84:0/4294388935 learned_addr learned my addr 172.21.15.84:0/4294388935 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:15.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:15.137+0000 7fb2eaffd700 1 --2- 172.21.15.84:0/4294388935 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2ec0b2440 0x7fb2ec1f49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:15.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:15.137+0000 7fb2eb7fe700 1 --2- 172.21.15.84:0/4294388935 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb2ec06c240 0x7fb2ec15ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:15.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:15.137+0000 7fb2ebfff700 1 -- 172.21.15.84:0/4294388935 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2ec0b2440 msgr2=0x7fb2ec1f49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:15.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:15.137+0000 7fb2ebfff700 1 --2- 172.21.15.84:0/4294388935 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2ec0b2440 0x7fb2ec1f49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:15.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:15.137+0000 7fb2ebfff700 1 -- 172.21.15.84:0/4294388935 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb2ec06c240 msgr2=0x7fb2ec15ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:15.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:15.137+0000 7fb2ebfff700 1 --2- 172.21.15.84:0/4294388935 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb2ec06c240 0x7fb2ec15ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:15.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:15.137+0000 7fb2ebfff700 1 -- 172.21.15.84:0/4294388935 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e0009550 con 0x7fb2ec15c890 2023-07-14T11:19:15.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:15.137+0000 7fb2ebfff700 1 --2- 172.21.15.84:0/4294388935 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2ec15c890 0x7fb2ec14a1b0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7fb2e400cb50 tx=0x7fb2e400ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:15.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:15.137+0000 7fb2d3fff700 1 -- 172.21.15.84:0/4294388935 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e4003c00 con 0x7fb2ec15c890 2023-07-14T11:19:15.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:15.137+0000 7fb2d3fff700 1 -- 172.21.15.84:0/4294388935 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2e4003d60 con 0x7fb2ec15c890 2023-07-14T11:19:15.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:15.137+0000 7fb2d3fff700 1 -- 172.21.15.84:0/4294388935 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e400aa20 con 0x7fb2ec15c890 2023-07-14T11:19:15.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:15.137+0000 7fb2f21ff700 1 -- 172.21.15.84:0/4294388935 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2ec15fc90 con 0x7fb2ec15c890 2023-07-14T11:19:15.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:15.138+0000 7fb2f21ff700 1 -- 172.21.15.84:0/4294388935 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2ec15d390 con 0x7fb2ec15c890 2023-07-14T11:19:15.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:15.139+0000 7fb2f21ff700 1 -- 172.21.15.84:0/4294388935 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2ec074350 con 0x7fb2ec15c890 2023-07-14T11:19:15.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:15.140+0000 7fb2d3fff700 1 -- 172.21.15.84:0/4294388935 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7fb2e400ab80 con 0x7fb2ec15c890 2023-07-14T11:19:15.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:15.140+0000 7fb2d3fff700 1 --2- 172.21.15.84:0/4294388935 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fb2d806ae00 0x7fb2d806d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:15.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:15.141+0000 7fb2d3fff700 1 -- 172.21.15.84:0/4294388935 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5796+0+0 (secure 0 0 0) 0x7fb2e4089480 con 0x7fb2ec15c890 2023-07-14T11:19:15.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:15.141+0000 7fb2eb7fe700 1 --2- 172.21.15.84:0/4294388935 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fb2d806ae00 0x7fb2d806d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:15.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:15.142+0000 7fb2eb7fe700 1 --2- 172.21.15.84:0/4294388935 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fb2d806ae00 0x7fb2d806d2b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc0099d0 tx=0x7fb2dc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:15.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:15.144+0000 7fb2d3fff700 1 -- 172.21.15.84:0/4294388935 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fb2e40545b0 con 0x7fb2ec15c890 2023-07-14T11:19:15.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:15.339+0000 7fb2f21ff700 1 -- 172.21.15.84:0/4294388935 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb2ec0b6f40 con 0x7fb2ec15c890 2023-07-14T11:19:15.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:15.909+0000 7fb2d3fff700 1 -- 172.21.15.84:0/4294388935 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v98) v1 ==== 169+0+0 (secure 0 0 0) 0x7fb2ec0b6f40 con 0x7fb2ec15c890 2023-07-14T11:19:15.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:15.913+0000 7fb2f21ff700 1 -- 172.21.15.84:0/4294388935 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fb2d806ae00 msgr2=0x7fb2d806d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:15.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:15.913+0000 7fb2f21ff700 1 --2- 172.21.15.84:0/4294388935 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fb2d806ae00 0x7fb2d806d2b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc0099d0 tx=0x7fb2dc008040 comp rx=0 tx=0).stop 2023-07-14T11:19:15.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:15.913+0000 7fb2f21ff700 1 -- 172.21.15.84:0/4294388935 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2ec15c890 msgr2=0x7fb2ec14a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:15.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:15.913+0000 7fb2f21ff700 1 --2- 172.21.15.84:0/4294388935 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2ec15c890 0x7fb2ec14a1b0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7fb2e400cb50 tx=0x7fb2e400ce60 comp rx=0 tx=0).stop 2023-07-14T11:19:15.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:15.913+0000 7fb2f21ff700 1 -- 172.21.15.84:0/4294388935 shutdown_connections 2023-07-14T11:19:15.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:15.913+0000 7fb2f21ff700 1 --2- 172.21.15.84:0/4294388935 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2ec15c890 0x7fb2ec14a1b0 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:15.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:15.913+0000 7fb2f21ff700 1 --2- 172.21.15.84:0/4294388935 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb2ec06c240 0x7fb2ec15ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:15.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:15.913+0000 7fb2f21ff700 1 --2- 172.21.15.84:0/4294388935 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fb2d806ae00 0x7fb2d806d2b0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:15.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:15.913+0000 7fb2f21ff700 1 --2- 172.21.15.84:0/4294388935 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2ec0b2440 0x7fb2ec1f49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:15.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:15.913+0000 7fb2f21ff700 1 -- 172.21.15.84:0/4294388935 >> 172.21.15.84:0/4294388935 conn(0x7fb2ec09c170 msgr2=0x7fb2ec15bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:15.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:15.914+0000 7fb2f21ff700 1 -- 172.21.15.84:0/4294388935 shutdown_connections 2023-07-14T11:19:15.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:15.914+0000 7fb2f21ff700 1 -- 172.21.15.84:0/4294388935 wait complete. 2023-07-14T11:19:15.918 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data' removed 2023-07-14T11:19:15.937 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-14T11:19:16.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.133+0000 7fee6efff700 1 Processor -- start 2023-07-14T11:19:16.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.133+0000 7fee6efff700 1 -- start start 2023-07-14T11:19:16.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.134+0000 7fee6efff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fee6815d9d0 0x7fee6806b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:16.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.134+0000 7fee6efff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fee6806c9f0 0x7fee680b1910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:16.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.135+0000 7fee6efff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee6806c4e0 con 0x7fee680b1e50 2023-07-14T11:19:16.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.135+0000 7fee6efff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee6815dda0 con 0x7fee6806c9f0 2023-07-14T11:19:16.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.135+0000 7fee6efff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee6806bf20 con 0x7fee6815d9d0 2023-07-14T11:19:16.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.135+0000 7fee67fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fee6806c9f0 0x7fee680b1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:16.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.135+0000 7fee67fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fee6806c9f0 0x7fee680b1910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34302/0 (socket says 172.21.15.84:34302) 2023-07-14T11:19:16.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.135+0000 7fee67fff700 1 -- 172.21.15.84:0/1416792107 learned_addr learned my addr 172.21.15.84:0/1416792107 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:16.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.135+0000 7fee6cd9b700 1 --2- 172.21.15.84:0/1416792107 >> v2:172.21.15.179:3300/0 conn(0x7fee6815d9d0 0x7fee6806b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:16.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.135+0000 7fee67fff700 1 -- 172.21.15.84:0/1416792107 >> v2:172.21.15.179:3300/0 conn(0x7fee6815d9d0 msgr2=0x7fee6806b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:16.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.135+0000 7fee67fff700 1 --2- 172.21.15.84:0/1416792107 >> v2:172.21.15.179:3300/0 conn(0x7fee6815d9d0 0x7fee6806b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:16.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.135+0000 7fee67fff700 1 -- 172.21.15.84:0/1416792107 >> v1:172.21.15.179:6789/0 conn(0x7fee680b1e50 legacy=0x7fee68071170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:16.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.135+0000 7fee67fff700 1 -- 172.21.15.84:0/1416792107 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee6806c200 con 0x7fee6806c9f0 2023-07-14T11:19:16.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.135+0000 7fee67fff700 1 --2- 172.21.15.84:0/1416792107 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee6806c9f0 0x7fee680b1910 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7fee6806dcc0 tx=0x7fee54009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8efe694b85ab78e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:16.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.136+0000 7fee677fe700 1 -- 172.21.15.84:0/1416792107 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee54004230 con 0x7fee6806c9f0 2023-07-14T11:19:16.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.136+0000 7fee677fe700 1 -- 172.21.15.84:0/1416792107 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee54004390 con 0x7fee6806c9f0 2023-07-14T11:19:16.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.136+0000 7fee677fe700 1 -- 172.21.15.84:0/1416792107 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee540036a0 con 0x7fee6806c9f0 2023-07-14T11:19:16.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.136+0000 7fee6efff700 1 -- 172.21.15.84:0/1416792107 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee6806c9f0 msgr2=0x7fee680b1910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:16.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.136+0000 7fee6efff700 1 --2- 172.21.15.84:0/1416792107 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee6806c9f0 0x7fee680b1910 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7fee6806dcc0 tx=0x7fee54009bd0 comp rx=0 tx=0).stop 2023-07-14T11:19:16.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.136+0000 7fee6efff700 1 -- 172.21.15.84:0/1416792107 shutdown_connections 2023-07-14T11:19:16.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.136+0000 7fee6efff700 1 --2- 172.21.15.84:0/1416792107 >> v2:172.21.15.179:3300/0 conn(0x7fee6815d9d0 0x7fee6806b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:16.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.136+0000 7fee6efff700 1 --2- 172.21.15.84:0/1416792107 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee6806c9f0 0x7fee680b1910 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:16.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.136+0000 7fee6efff700 1 -- 172.21.15.84:0/1416792107 >> 172.21.15.84:0/1416792107 conn(0x7fee680b05d0 msgr2=0x7fee680b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:16.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.136+0000 7fee6efff700 1 -- 172.21.15.84:0/1416792107 shutdown_connections 2023-07-14T11:19:16.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.136+0000 7fee6efff700 1 -- 172.21.15.84:0/1416792107 wait complete. 2023-07-14T11:19:16.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.138+0000 7fee6efff700 1 Processor -- start 2023-07-14T11:19:16.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.138+0000 7fee6efff700 1 -- start start 2023-07-14T11:19:16.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.139+0000 7fee6efff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee6806c9f0 0x7fee6815b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:16.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.139+0000 7fee6efff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee680b1e50 0x7fee680c4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:16.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.139+0000 7fee6efff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee6815d9d0 0x7fee681f5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:16.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.140+0000 7fee6efff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee681e6850 con 0x7fee6806c9f0 2023-07-14T11:19:16.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.140+0000 7fee6efff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee681f1e60 con 0x7fee6815d9d0 2023-07-14T11:19:16.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.140+0000 7fee6efff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee680c25c0 con 0x7fee680b1e50 2023-07-14T11:19:16.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.140+0000 7fee6cd9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee6806c9f0 0x7fee6815b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:16.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.140+0000 7fee6cd9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee6806c9f0 0x7fee6815b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34304/0 (socket says 172.21.15.84:34304) 2023-07-14T11:19:16.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.140+0000 7fee6cd9b700 1 -- 172.21.15.84:0/3683124265 learned_addr learned my addr 172.21.15.84:0/3683124265 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:16.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.140+0000 7fee67fff700 1 --2- 172.21.15.84:0/3683124265 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee680b1e50 0x7fee680c4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:16.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.140+0000 7fee6d59c700 1 --2- 172.21.15.84:0/3683124265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee6815d9d0 0x7fee681f5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:16.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.140+0000 7fee6cd9b700 1 -- 172.21.15.84:0/3683124265 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee680b1e50 msgr2=0x7fee680c4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:16.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.140+0000 7fee6cd9b700 1 --2- 172.21.15.84:0/3683124265 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee680b1e50 0x7fee680c4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:16.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.140+0000 7fee6cd9b700 1 -- 172.21.15.84:0/3683124265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee6815d9d0 msgr2=0x7fee681f5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:16.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.140+0000 7fee6cd9b700 1 --2- 172.21.15.84:0/3683124265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee6815d9d0 0x7fee681f5380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:16.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.140+0000 7fee6cd9b700 1 -- 172.21.15.84:0/3683124265 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee54009550 con 0x7fee6806c9f0 2023-07-14T11:19:16.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.140+0000 7fee67fff700 1 --2- 172.21.15.84:0/3683124265 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee680b1e50 0x7fee680c4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:19:16.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.140+0000 7fee6d59c700 1 --2- 172.21.15.84:0/3683124265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee6815d9d0 0x7fee681f5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:19:16.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.141+0000 7fee6cd9b700 1 --2- 172.21.15.84:0/3683124265 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee6806c9f0 0x7fee6815b090 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7fee5c00c7f0 tx=0x7fee5c00cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:16.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.141+0000 7fee657fa700 1 -- 172.21.15.84:0/3683124265 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5c011800 con 0x7fee6806c9f0 2023-07-14T11:19:16.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.141+0000 7fee657fa700 1 -- 172.21.15.84:0/3683124265 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee5c011960 con 0x7fee6806c9f0 2023-07-14T11:19:16.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.141+0000 7fee657fa700 1 -- 172.21.15.84:0/3683124265 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5c011cf0 con 0x7fee6806c9f0 2023-07-14T11:19:16.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.141+0000 7fee6efff700 1 -- 172.21.15.84:0/3683124265 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee6815b5d0 con 0x7fee6806c9f0 2023-07-14T11:19:16.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.142+0000 7fee6efff700 1 -- 172.21.15.84:0/3683124265 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee681e3e40 con 0x7fee6806c9f0 2023-07-14T11:19:16.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.143+0000 7fee6efff700 1 -- 172.21.15.84:0/3683124265 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee68074350 con 0x7fee6806c9f0 2023-07-14T11:19:16.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.144+0000 7fee657fa700 1 -- 172.21.15.84:0/3683124265 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7fee5c018360 con 0x7fee6806c9f0 2023-07-14T11:19:16.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.146+0000 7fee657fa700 1 --2- 172.21.15.84:0/3683124265 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fee4c06ae50 0x7fee4c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:16.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.146+0000 7fee657fa700 1 -- 172.21.15.84:0/3683124265 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fee5c089480 con 0x7fee6806c9f0 2023-07-14T11:19:16.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.146+0000 7fee67fff700 1 --2- 172.21.15.84:0/3683124265 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fee4c06ae50 0x7fee4c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:16.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.147+0000 7fee67fff700 1 --2- 172.21.15.84:0/3683124265 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fee4c06ae50 0x7fee4c06d300 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fee6806cdc0 tx=0x7fee54008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:16.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.150+0000 7fee657fa700 1 -- 172.21.15.84:0/3683124265 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fee5c054500 con 0x7fee6806c9f0 2023-07-14T11:19:16.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.344+0000 7fee6efff700 1 -- 172.21.15.84:0/3683124265 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fee680cd7c0 con 0x7fee6806c9f0 2023-07-14T11:19:16.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.349+0000 7fee657fa700 1 -- 172.21.15.84:0/3683124265 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7fee5c057b20 con 0x7fee6806c9f0 2023-07-14T11:19:16.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.351+0000 7fee6efff700 1 -- 172.21.15.84:0/3683124265 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fee4c06ae50 msgr2=0x7fee4c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:16.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.351+0000 7fee6efff700 1 --2- 172.21.15.84:0/3683124265 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fee4c06ae50 0x7fee4c06d300 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fee6806cdc0 tx=0x7fee54008030 comp rx=0 tx=0).stop 2023-07-14T11:19:16.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.351+0000 7fee6efff700 1 -- 172.21.15.84:0/3683124265 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee6806c9f0 msgr2=0x7fee6815b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:16.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.351+0000 7fee6efff700 1 --2- 172.21.15.84:0/3683124265 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee6806c9f0 0x7fee6815b090 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7fee5c00c7f0 tx=0x7fee5c00cbb0 comp rx=0 tx=0).stop 2023-07-14T11:19:16.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.351+0000 7fee6efff700 1 -- 172.21.15.84:0/3683124265 shutdown_connections 2023-07-14T11:19:16.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.351+0000 7fee6efff700 1 --2- 172.21.15.84:0/3683124265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee6815d9d0 0x7fee681f5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:16.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.351+0000 7fee6efff700 1 --2- 172.21.15.84:0/3683124265 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee6806c9f0 0x7fee6815b090 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:16.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.351+0000 7fee6efff700 1 --2- 172.21.15.84:0/3683124265 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fee4c06ae50 0x7fee4c06d300 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:16.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.351+0000 7fee6efff700 1 --2- 172.21.15.84:0/3683124265 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee680b1e50 0x7fee680c4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:16.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.351+0000 7fee6efff700 1 -- 172.21.15.84:0/3683124265 >> 172.21.15.84:0/3683124265 conn(0x7fee680b05d0 msgr2=0x7fee680cdfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:16.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.352+0000 7fee6efff700 1 -- 172.21.15.84:0/3683124265 shutdown_connections 2023-07-14T11:19:16.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.352+0000 7fee6efff700 1 -- 172.21.15.84:0/3683124265 wait complete. 2023-07-14T11:19:16.372 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_names_can_only_be_goodchars' 2023-07-14T11:19:16.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.564+0000 7f0795dff700 1 Processor -- start 2023-07-14T11:19:16.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.564+0000 7f0795dff700 1 -- start start 2023-07-14T11:19:16.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.566+0000 7f0795dff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0790071560 0x7f07900cc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:16.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.566+0000 7f0795dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07900ce2c0 0x7f07900ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:16.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.566+0000 7f0795dff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f079006b040 con 0x7f079015a650 2023-07-14T11:19:16.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.566+0000 7f0795dff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f079006fb50 con 0x7f0790071560 2023-07-14T11:19:16.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.566+0000 7f0795dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f079006f870 con 0x7f07900ce2c0 2023-07-14T11:19:16.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.566+0000 7f0787fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0790071560 0x7f07900cc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:16.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.566+0000 7f078ffff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07900ce2c0 0x7f07900ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:16.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.566+0000 7f0787fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0790071560 0x7f07900cc690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.84:50230/0 (socket says 172.21.15.84:50230) 2023-07-14T11:19:16.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.566+0000 7f0787fff700 1 -- 172.21.15.84:0/3359897005 learned_addr learned my addr 172.21.15.84:0/3359897005 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:16.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.567+0000 7f0787fff700 1 -- 172.21.15.84:0/3359897005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07900ce2c0 msgr2=0x7f07900ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:16.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.567+0000 7f0787fff700 1 --2- 172.21.15.84:0/3359897005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07900ce2c0 0x7f07900ccbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:16.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.567+0000 7f0787fff700 1 -- 172.21.15.84:0/3359897005 >> v1:172.21.15.179:6789/0 conn(0x7f079015a650 legacy=0x7f0790070e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:16.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.567+0000 7f0787fff700 1 -- 172.21.15.84:0/3359897005 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0790070890 con 0x7f0790071560 2023-07-14T11:19:16.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.567+0000 7f078effd700 1 -- 172.21.15.84:0/3359897005 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2884091301 0 0) 0x7f079006b040 con 0x7f079015a650 2023-07-14T11:19:16.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.567+0000 7f0787fff700 1 --2- 172.21.15.84:0/3359897005 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0790071560 0x7f07900cc690 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f07780098f0 tx=0x7f0778009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2354cd649bdc416 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:16.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.567+0000 7f078effd700 1 -- 172.21.15.84:0/3359897005 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0778011830 con 0x7f0790071560 2023-07-14T11:19:16.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.568+0000 7f078effd700 1 -- 172.21.15.84:0/3359897005 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0778011990 con 0x7f0790071560 2023-07-14T11:19:16.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.568+0000 7f078effd700 1 -- 172.21.15.84:0/3359897005 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0778011d20 con 0x7f0790071560 2023-07-14T11:19:16.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.568+0000 7f0795dff700 1 -- 172.21.15.84:0/3359897005 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0790071560 msgr2=0x7f07900cc690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:16.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.568+0000 7f0795dff700 1 --2- 172.21.15.84:0/3359897005 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0790071560 0x7f07900cc690 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f07780098f0 tx=0x7f0778009c00 comp rx=0 tx=0).stop 2023-07-14T11:19:16.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.568+0000 7f0795dff700 1 -- 172.21.15.84:0/3359897005 shutdown_connections 2023-07-14T11:19:16.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.568+0000 7f0795dff700 1 --2- 172.21.15.84:0/3359897005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07900ce2c0 0x7f07900ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:16.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.568+0000 7f0795dff700 1 --2- 172.21.15.84:0/3359897005 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0790071560 0x7f07900cc690 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:16.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.568+0000 7f0795dff700 1 -- 172.21.15.84:0/3359897005 >> 172.21.15.84:0/3359897005 conn(0x7f079006ab70 msgr2=0x7f07900b05d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:16.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.568+0000 7f0795dff700 1 -- 172.21.15.84:0/3359897005 shutdown_connections 2023-07-14T11:19:16.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.568+0000 7f0795dff700 1 -- 172.21.15.84:0/3359897005 wait complete. 2023-07-14T11:19:16.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.570+0000 7f0795dff700 1 Processor -- start 2023-07-14T11:19:16.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.570+0000 7f0795dff700 1 -- start start 2023-07-14T11:19:16.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.571+0000 7f0795dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0790071560 0x7f07901e4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:16.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.571+0000 7f0795dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07900ce2c0 0x7f07901f2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:16.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.571+0000 7f0795dff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f079015a650 0x7f079006bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:16.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.571+0000 7f0795dff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07901f3160 con 0x7f079015a650 2023-07-14T11:19:16.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.571+0000 7f0795dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07901e53d0 con 0x7f07900ce2c0 2023-07-14T11:19:16.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.571+0000 7f0795dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07901e56b0 con 0x7f0790071560 2023-07-14T11:19:16.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.571+0000 7f078ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f079015a650 0x7f079006bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:16.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.571+0000 7f078ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f079015a650 0x7f079006bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34314/0 (socket says 172.21.15.84:34314) 2023-07-14T11:19:16.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.571+0000 7f078ffff700 1 -- 172.21.15.84:0/2014099789 learned_addr learned my addr 172.21.15.84:0/2014099789 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:16.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.572+0000 7f0787fff700 1 --2- 172.21.15.84:0/2014099789 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07900ce2c0 0x7f07901f2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:16.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.572+0000 7f078f7fe700 1 --2- 172.21.15.84:0/2014099789 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0790071560 0x7f07901e4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:16.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.572+0000 7f078ffff700 1 -- 172.21.15.84:0/2014099789 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0790071560 msgr2=0x7f07901e4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:16.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.572+0000 7f078ffff700 1 --2- 172.21.15.84:0/2014099789 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0790071560 0x7f07901e4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:16.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.572+0000 7f078ffff700 1 -- 172.21.15.84:0/2014099789 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07900ce2c0 msgr2=0x7f07901f2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:16.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.572+0000 7f078ffff700 1 --2- 172.21.15.84:0/2014099789 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07900ce2c0 0x7f07901f2c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:16.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.572+0000 7f078ffff700 1 -- 172.21.15.84:0/2014099789 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0778009550 con 0x7f079015a650 2023-07-14T11:19:16.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.572+0000 7f078ffff700 1 --2- 172.21.15.84:0/2014099789 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f079015a650 0x7f079006bc50 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f078800efc0 tx=0x7f078800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:16.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.572+0000 7f078cff9700 1 -- 172.21.15.84:0/2014099789 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0788009ea0 con 0x7f079015a650 2023-07-14T11:19:16.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.572+0000 7f078cff9700 1 -- 172.21.15.84:0/2014099789 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f078800f040 con 0x7f079015a650 2023-07-14T11:19:16.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.572+0000 7f0795dff700 1 -- 172.21.15.84:0/2014099789 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07901e5990 con 0x7f079015a650 2023-07-14T11:19:16.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.572+0000 7f078cff9700 1 -- 172.21.15.84:0/2014099789 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f078800ced0 con 0x7f079015a650 2023-07-14T11:19:16.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.573+0000 7f0795dff700 1 -- 172.21.15.84:0/2014099789 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07901e5f50 con 0x7f079015a650 2023-07-14T11:19:16.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.574+0000 7f0795dff700 1 -- 172.21.15.84:0/2014099789 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0790074350 con 0x7f079015a650 2023-07-14T11:19:16.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.574+0000 7f078cff9700 1 -- 172.21.15.84:0/2014099789 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f0788014480 con 0x7f079015a650 2023-07-14T11:19:16.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.575+0000 7f078cff9700 1 --2- 172.21.15.84:0/2014099789 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f077006ae00 0x7f077006d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:16.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.575+0000 7f078cff9700 1 -- 172.21.15.84:0/2014099789 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f0788089fc0 con 0x7f079015a650 2023-07-14T11:19:16.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.576+0000 7f078f7fe700 1 --2- 172.21.15.84:0/2014099789 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f077006ae00 0x7f077006d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:16.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.576+0000 7f078f7fe700 1 --2- 172.21.15.84:0/2014099789 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f077006ae00 0x7f077006d2b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0780000f60 tx=0x7f0780009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:16.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.579+0000 7f078cff9700 1 -- 172.21.15.84:0/2014099789 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f07880bc330 con 0x7f079015a650 2023-07-14T11:19:16.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.851+0000 7f0795dff700 1 -- 172.21.15.84:0/2014099789 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_names_can_only_be_goodchars"]} v 0) v1 -- 0x7f079006c910 con 0x7f079015a650 2023-07-14T11:19:16.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.904+0000 7f078cff9700 1 -- 172.21.15.84:0/2014099789 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_names_can_only_be_goodchars"]}]=0 v343) v1 ==== 146+0+0 (secure 0 0 0) 0x7f0788055100 con 0x7f079015a650 2023-07-14T11:19:16.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.907+0000 7f0795dff700 1 -- 172.21.15.84:0/2014099789 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f077006ae00 msgr2=0x7f077006d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:16.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.907+0000 7f0795dff700 1 --2- 172.21.15.84:0/2014099789 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f077006ae00 0x7f077006d2b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0780000f60 tx=0x7f0780009040 comp rx=0 tx=0).stop 2023-07-14T11:19:16.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.907+0000 7f0795dff700 1 -- 172.21.15.84:0/2014099789 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f079015a650 msgr2=0x7f079006bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:16.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.907+0000 7f0795dff700 1 --2- 172.21.15.84:0/2014099789 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f079015a650 0x7f079006bc50 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f078800efc0 tx=0x7f078800c3a0 comp rx=0 tx=0).stop 2023-07-14T11:19:16.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.907+0000 7f0795dff700 1 -- 172.21.15.84:0/2014099789 shutdown_connections 2023-07-14T11:19:16.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.907+0000 7f0795dff700 1 --2- 172.21.15.84:0/2014099789 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f077006ae00 0x7f077006d2b0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:16.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.907+0000 7f0795dff700 1 --2- 172.21.15.84:0/2014099789 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0790071560 0x7f07901e4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:16.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.907+0000 7f0795dff700 1 --2- 172.21.15.84:0/2014099789 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f079015a650 0x7f079006bc50 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:16.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.907+0000 7f0795dff700 1 --2- 172.21.15.84:0/2014099789 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07900ce2c0 0x7f07901f2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:16.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.907+0000 7f0795dff700 1 -- 172.21.15.84:0/2014099789 >> 172.21.15.84:0/2014099789 conn(0x7f079006ab70 msgr2=0x7f07901518b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:16.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.907+0000 7f0795dff700 1 -- 172.21.15.84:0/2014099789 shutdown_connections 2023-07-14T11:19:16.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:16.907+0000 7f0795dff700 1 -- 172.21.15.84:0/2014099789 wait complete. 2023-07-14T11:19:16.927 INFO:tasks.cephfs_test_runner:test_names_can_only_be_goodchars (tasks.cephfs.test_volumes.TestMisc) ... ok 2023-07-14T11:19:16.927 INFO:tasks.cephfs_test_runner:Starting test: test_subvolume_no_upgrade_v1_sanity (tasks.cephfs.test_volumes.TestMisc) 2023-07-14T11:19:16.928 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_sanity' 2023-07-14T11:19:17.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:17.121+0000 7f3f74dff700 1 Processor -- start 2023-07-14T11:19:17.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:17.121+0000 7f3f74dff700 1 -- start start 2023-07-14T11:19:17.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:17.122+0000 7f3f74dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f700cd460 0x7f3f700d1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:17.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:17.122+0000 7f3f74dff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f700d0d10 con 0x7f3f7015cb40 2023-07-14T11:19:17.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:17.122+0000 7f3f74dff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f700d0ff0 con 0x7f3f700b1b70 2023-07-14T11:19:17.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:17.122+0000 7f3f74dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f700d12d0 con 0x7f3f700cd460 2023-07-14T11:19:17.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:17.122+0000 7f3f6ed9d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f3f7015cb40 0x7f3f700b5c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:34348/0 (socket says 172.21.15.84:34348) 2023-07-14T11:19:17.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:17.122+0000 7f3f6ed9d700 1 -- 172.21.15.84:0/1537629876 learned_addr learned my addr 172.21.15.84:0/1537629876 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:19:17.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:17.122+0000 7f3f6e59c700 1 --2- 172.21.15.84:0/1537629876 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f700cd460 0x7f3f700d1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:17.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:17.123+0000 7f3f6dd9b700 1 -- 172.21.15.84:0/1537629876 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1790485389 0 0) 0x7f3f700d0d10 con 0x7f3f7015cb40 2023-07-14T11:19:17.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:17.123+0000 7f3f6dd9b700 1 -- 172.21.15.84:0/1537629876 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f5c0035b0 con 0x7f3f7015cb40 2023-07-14T11:19:17.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:17.123+0000 7f3f6dd9b700 1 -- 172.21.15.84:0/1537629876 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 754450813 0 0) 0x7f3f700d0ff0 con 0x7f3f700b1b70 2023-07-14T11:19:17.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:17.123+0000 7f3f6dd9b700 1 -- 172.21.15.84:0/1537629876 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f700d0d10 con 0x7f3f700b1b70 2023-07-14T11:19:17.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:17.123+0000 7f3f6e59c700 1 -- 172.21.15.84:0/1537629876 >> v1:172.21.15.179:6789/0 conn(0x7f3f700b1b70 legacy=0x7f3f700cd830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:17.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:17.123+0000 7f3f6e59c700 1 -- 172.21.15.84:0/1537629876 >> v1:172.21.15.84:6789/0 conn(0x7f3f7015cb40 legacy=0x7f3f700b5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:17.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:17.123+0000 7f3f6e59c700 1 -- 172.21.15.84:0/1537629876 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f700d15b0 con 0x7f3f700cd460 2023-07-14T11:19:17.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:17.123+0000 7f3f6e59c700 1 --2- 172.21.15.84:0/1537629876 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f700cd460 0x7f3f700d1db0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3f60009870 tx=0x7f3f60009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7782cc0cfa3b6597 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:17.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:17.124+0000 7f3f6dd9b700 1 -- 172.21.15.84:0/1537629876 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f60011830 con 0x7f3f700cd460 2023-07-14T11:19:17.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:17.124+0000 7f3f6dd9b700 1 -- 172.21.15.84:0/1537629876 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f60011990 con 0x7f3f700cd460 2023-07-14T11:19:17.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:17.124+0000 7f3f6dd9b700 1 -- 172.21.15.84:0/1537629876 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f60011d20 con 0x7f3f700cd460 2023-07-14T11:19:17.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:17.124+0000 7f3f74dff700 1 -- 172.21.15.84:0/1537629876 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f700cd460 msgr2=0x7f3f700d1db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:17.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:17.124+0000 7f3f74dff700 1 --2- 172.21.15.84:0/1537629876 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f700cd460 0x7f3f700d1db0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3f60009870 tx=0x7f3f60009b80 comp rx=0 tx=0).stop 2023-07-14T11:19:17.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:17.124+0000 7f3f74dff700 1 -- 172.21.15.84:0/1537629876 shutdown_connections 2023-07-14T11:19:17.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:17.124+0000 7f3f74dff700 1 --2- 172.21.15.84:0/1537629876 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f700cd460 0x7f3f700d1db0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:17.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:17.124+0000 7f3f74dff700 1 -- 172.21.15.84:0/1537629876 >> 172.21.15.84:0/1537629876 conn(0x7f3f7006a680 msgr2=0x7f3f7006aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:17.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:17.124+0000 7f3f74dff700 1 -- 172.21.15.84:0/1537629876 shutdown_connections 2023-07-14T11:19:17.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:17.124+0000 7f3f74dff700 1 -- 172.21.15.84:0/1537629876 wait complete. 2023-07-14T11:19:17.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:17.126+0000 7f3f74dff700 1 Processor -- start 2023-07-14T11:19:17.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:17.126+0000 7f3f74dff700 1 -- start start 2023-07-14T11:19:17.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:17.127+0000 7f3f74dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f700b1b70 0x7f3f7014b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:17.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:17.127+0000 7f3f74dff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f700cd460 0x7f3f7015de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:17.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:17.127+0000 7f3f74dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f7015cb40 0x7f3f700b2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:17.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:17.127+0000 7f3f74dff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f700cafb0 con 0x7f3f700cd460 2023-07-14T11:19:17.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:17.127+0000 7f3f74dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f700b32c0 con 0x7f3f7015cb40 2023-07-14T11:19:17.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:17.127+0000 7f3f74dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f700ca330 con 0x7f3f700b1b70 2023-07-14T11:19:17.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:17.127+0000 7f3f67fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f700cd460 0x7f3f7015de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:17.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:17.127+0000 7f3f67fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f700cd460 0x7f3f7015de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34330/0 (socket says 172.21.15.84:34330) 2023-07-14T11:19:17.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:17.127+0000 7f3f67fff700 1 -- 172.21.15.84:0/3296602441 learned_addr learned my addr 172.21.15.84:0/3296602441 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:17.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:17.128+0000 7f3f6e59c700 1 --2- 172.21.15.84:0/3296602441 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f700b1b70 0x7f3f7014b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:17.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:17.128+0000 7f3f6ed9d700 1 --2- 172.21.15.84:0/3296602441 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f7015cb40 0x7f3f700b2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:17.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:17.128+0000 7f3f67fff700 1 -- 172.21.15.84:0/3296602441 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f700b1b70 msgr2=0x7f3f7014b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:17.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:17.128+0000 7f3f67fff700 1 --2- 172.21.15.84:0/3296602441 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f700b1b70 0x7f3f7014b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:17.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:17.128+0000 7f3f67fff700 1 -- 172.21.15.84:0/3296602441 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f7015cb40 msgr2=0x7f3f700b2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:17.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:17.128+0000 7f3f67fff700 1 --2- 172.21.15.84:0/3296602441 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f7015cb40 0x7f3f700b2d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:17.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:17.128+0000 7f3f67fff700 1 -- 172.21.15.84:0/3296602441 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f600094a0 con 0x7f3f700cd460 2023-07-14T11:19:17.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:17.128+0000 7f3f6ed9d700 1 --2- 172.21.15.84:0/3296602441 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f7015cb40 0x7f3f700b2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:19:17.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:17.128+0000 7f3f67fff700 1 --2- 172.21.15.84:0/3296602441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f700cd460 0x7f3f7015de60 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f3f5800c520 tx=0x7f3f5800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:17.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:17.128+0000 7f3f66ffd700 1 -- 172.21.15.84:0/3296602441 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f580052d0 con 0x7f3f700cd460 2023-07-14T11:19:17.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:17.128+0000 7f3f66ffd700 1 -- 172.21.15.84:0/3296602441 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f58005430 con 0x7f3f700cd460 2023-07-14T11:19:17.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:17.128+0000 7f3f66ffd700 1 -- 172.21.15.84:0/3296602441 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f580038c0 con 0x7f3f700cd460 2023-07-14T11:19:17.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:17.128+0000 7f3f74dff700 1 -- 172.21.15.84:0/3296602441 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f700ca610 con 0x7f3f700cd460 2023-07-14T11:19:17.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:17.128+0000 7f3f74dff700 1 -- 172.21.15.84:0/3296602441 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f700cabd0 con 0x7f3f700cd460 2023-07-14T11:19:17.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:17.129+0000 7f3f74dff700 1 -- 172.21.15.84:0/3296602441 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f700cad90 con 0x7f3f700cd460 2023-07-14T11:19:17.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:17.130+0000 7f3f66ffd700 1 -- 172.21.15.84:0/3296602441 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f3f58003a20 con 0x7f3f700cd460 2023-07-14T11:19:17.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:17.131+0000 7f3f66ffd700 1 --2- 172.21.15.84:0/3296602441 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f3f5006ae00 0x7f3f5006d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:17.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:17.131+0000 7f3f66ffd700 1 -- 172.21.15.84:0/3296602441 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f3f580889a0 con 0x7f3f700cd460 2023-07-14T11:19:17.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:17.132+0000 7f3f6e59c700 1 --2- 172.21.15.84:0/3296602441 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f3f5006ae00 0x7f3f5006d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:17.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:17.132+0000 7f3f6e59c700 1 --2- 172.21.15.84:0/3296602441 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f3f5006ae00 0x7f3f5006d2b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3f600097c0 tx=0x7f3f6001c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:17.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:17.136+0000 7f3f66ffd700 1 -- 172.21.15.84:0/3296602441 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3f58053b40 con 0x7f3f700cd460 2023-07-14T11:19:17.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:17.406+0000 7f3f74dff700 1 -- 172.21.15.84:0/3296602441 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_sanity"]} v 0) v1 -- 0x7f3f700cb0f0 con 0x7f3f700cd460 2023-07-14T11:19:17.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:17.909+0000 7f3f66ffd700 1 -- 172.21.15.84:0/3296602441 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_sanity"]}]=0 v344) v1 ==== 152+0+0 (secure 0 0 0) 0x7f3f700cb0f0 con 0x7f3f700cd460 2023-07-14T11:19:17.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:17.912+0000 7f3f74dff700 1 -- 172.21.15.84:0/3296602441 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f3f5006ae00 msgr2=0x7f3f5006d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:17.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:17.912+0000 7f3f74dff700 1 --2- 172.21.15.84:0/3296602441 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f3f5006ae00 0x7f3f5006d2b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3f600097c0 tx=0x7f3f6001c040 comp rx=0 tx=0).stop 2023-07-14T11:19:17.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:17.912+0000 7f3f74dff700 1 -- 172.21.15.84:0/3296602441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f700cd460 msgr2=0x7f3f7015de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:17.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:17.912+0000 7f3f74dff700 1 --2- 172.21.15.84:0/3296602441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f700cd460 0x7f3f7015de60 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f3f5800c520 tx=0x7f3f5800c8e0 comp rx=0 tx=0).stop 2023-07-14T11:19:17.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:17.912+0000 7f3f74dff700 1 -- 172.21.15.84:0/3296602441 shutdown_connections 2023-07-14T11:19:17.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:17.912+0000 7f3f74dff700 1 --2- 172.21.15.84:0/3296602441 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f3f5006ae00 0x7f3f5006d2b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:17.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:17.912+0000 7f3f74dff700 1 --2- 172.21.15.84:0/3296602441 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f700b1b70 0x7f3f7014b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:17.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:17.912+0000 7f3f74dff700 1 --2- 172.21.15.84:0/3296602441 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f7015cb40 0x7f3f700b2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:17.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:17.912+0000 7f3f74dff700 1 --2- 172.21.15.84:0/3296602441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f700cd460 0x7f3f7015de60 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:17.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:17.912+0000 7f3f74dff700 1 -- 172.21.15.84:0/3296602441 >> 172.21.15.84:0/3296602441 conn(0x7f3f7006a680 msgr2=0x7f3f700b6aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:17.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:17.912+0000 7f3f74dff700 1 -- 172.21.15.84:0/3296602441 shutdown_connections 2023-07-14T11:19:17.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:17.912+0000 7f3f74dff700 1 -- 172.21.15.84:0/3296602441 wait complete. 2023-07-14T11:19:17.934 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-14T11:19:18.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.130+0000 7f6a823ff700 1 Processor -- start 2023-07-14T11:19:18.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.130+0000 7f6a823ff700 1 -- start start 2023-07-14T11:19:18.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.131+0000 7f6a823ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6a7c0c92d0 0x7f6a7c0ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:18.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.131+0000 7f6a823ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6a7c0adea0 0x7f6a7c0cc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:18.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.131+0000 7f6a823ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a7c15ce70 con 0x7f6a7c0b12f0 2023-07-14T11:19:18.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.131+0000 7f6a823ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a7c15da60 con 0x7f6a7c0c92d0 2023-07-14T11:19:18.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.131+0000 7f6a823ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a7c15d0c0 con 0x7f6a7c0adea0 2023-07-14T11:19:18.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.132+0000 7f6a7bfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6a7c0c92d0 0x7f6a7c0ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:18.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.132+0000 7f6a73fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f6a7c0b12f0 0x7f6a7c0c96a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:34364/0 (socket says 172.21.15.84:34364) 2023-07-14T11:19:18.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.132+0000 7f6a7bfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6a7c0c92d0 0x7f6a7c0ad8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34344/0 (socket says 172.21.15.84:34344) 2023-07-14T11:19:18.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.132+0000 7f6a73fff700 1 -- 172.21.15.84:0/2906981270 learned_addr learned my addr 172.21.15.84:0/2906981270 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:19:18.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.132+0000 7f6a8099c700 1 --2- 172.21.15.84:0/2906981270 >> v2:172.21.15.179:3300/0 conn(0x7f6a7c0adea0 0x7f6a7c0cc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:18.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.132+0000 7f6a7bfff700 1 -- 172.21.15.84:0/2906981270 >> v2:172.21.15.179:3300/0 conn(0x7f6a7c0adea0 msgr2=0x7f6a7c0cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:18.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.132+0000 7f6a7bfff700 1 --2- 172.21.15.84:0/2906981270 >> v2:172.21.15.179:3300/0 conn(0x7f6a7c0adea0 0x7f6a7c0cc690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:18.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.132+0000 7f6a7bfff700 1 -- 172.21.15.84:0/2906981270 >> v1:172.21.15.84:6789/0 conn(0x7f6a7c0b12f0 legacy=0x7f6a7c0c96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:18.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.132+0000 7f6a7bfff700 1 -- 172.21.15.84:0/2906981270 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a7c15d3a0 con 0x7f6a7c0c92d0 2023-07-14T11:19:18.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.132+0000 7f6a7b7fe700 1 -- 172.21.15.84:0/2906981270 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 376288703 0 0) 0x7f6a7c15ce70 con 0x7f6a7c0b12f0 2023-07-14T11:19:18.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.132+0000 7f6a7bfff700 1 --2- 172.21.15.84:0/2906981270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a7c0c92d0 0x7f6a7c0ad8f0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c0c9250 tx=0x7f6a6c00bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=868be89a7c7aa1b7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:18.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.133+0000 7f6a7b7fe700 1 -- 172.21.15.84:0/2906981270 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c00dc70 con 0x7f6a7c0c92d0 2023-07-14T11:19:18.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.133+0000 7f6a7b7fe700 1 -- 172.21.15.84:0/2906981270 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a6c00ddd0 con 0x7f6a7c0c92d0 2023-07-14T11:19:18.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.133+0000 7f6a7b7fe700 1 -- 172.21.15.84:0/2906981270 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c010690 con 0x7f6a7c0c92d0 2023-07-14T11:19:18.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.133+0000 7f6a823ff700 1 -- 172.21.15.84:0/2906981270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a7c0c92d0 msgr2=0x7f6a7c0ad8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:18.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.133+0000 7f6a823ff700 1 --2- 172.21.15.84:0/2906981270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a7c0c92d0 0x7f6a7c0ad8f0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c0c9250 tx=0x7f6a6c00bdc0 comp rx=0 tx=0).stop 2023-07-14T11:19:18.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.133+0000 7f6a823ff700 1 -- 172.21.15.84:0/2906981270 shutdown_connections 2023-07-14T11:19:18.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.134+0000 7f6a823ff700 1 --2- 172.21.15.84:0/2906981270 >> v2:172.21.15.179:3300/0 conn(0x7f6a7c0adea0 0x7f6a7c0cc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:18.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.134+0000 7f6a823ff700 1 --2- 172.21.15.84:0/2906981270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a7c0c92d0 0x7f6a7c0ad8f0 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:18.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.134+0000 7f6a823ff700 1 -- 172.21.15.84:0/2906981270 >> 172.21.15.84:0/2906981270 conn(0x7f6a7c0b05d0 msgr2=0x7f6a7c0b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:18.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.134+0000 7f6a823ff700 1 -- 172.21.15.84:0/2906981270 shutdown_connections 2023-07-14T11:19:18.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.134+0000 7f6a823ff700 1 -- 172.21.15.84:0/2906981270 wait complete. 2023-07-14T11:19:18.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.135+0000 7f6a823ff700 1 Processor -- start 2023-07-14T11:19:18.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.136+0000 7f6a823ff700 1 -- start start 2023-07-14T11:19:18.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.136+0000 7f6a823ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a7c0adea0 0x7f6a7c06b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:18.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.137+0000 7f6a823ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a7c0b12f0 0x7f6a7c06d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:18.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.137+0000 7f6a823ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a7c0c92d0 0x7f6a7c0b24c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:18.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.137+0000 7f6a823ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7c0c5b90 con 0x7f6a7c0c92d0 2023-07-14T11:19:18.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.137+0000 7f6a823ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7c0b2a00 con 0x7f6a7c0adea0 2023-07-14T11:19:18.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.137+0000 7f6a823ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7c06bb90 con 0x7f6a7c0b12f0 2023-07-14T11:19:18.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.137+0000 7f6a8099c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a7c0c92d0 0x7f6a7c0b24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:18.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.137+0000 7f6a8099c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a7c0c92d0 0x7f6a7c0b24c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34346/0 (socket says 172.21.15.84:34346) 2023-07-14T11:19:18.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.137+0000 7f6a8099c700 1 -- 172.21.15.84:0/1287727717 learned_addr learned my addr 172.21.15.84:0/1287727717 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:18.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.137+0000 7f6a7bfff700 1 --2- 172.21.15.84:0/1287727717 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a7c0adea0 0x7f6a7c06b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:18.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.137+0000 7f6a73fff700 1 --2- 172.21.15.84:0/1287727717 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a7c0b12f0 0x7f6a7c06d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:18.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.137+0000 7f6a8099c700 1 -- 172.21.15.84:0/1287727717 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a7c0b12f0 msgr2=0x7f6a7c06d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:18.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.137+0000 7f6a8099c700 1 --2- 172.21.15.84:0/1287727717 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a7c0b12f0 0x7f6a7c06d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:18.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.137+0000 7f6a8099c700 1 -- 172.21.15.84:0/1287727717 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a7c0adea0 msgr2=0x7f6a7c06b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:18.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.137+0000 7f6a8099c700 1 --2- 172.21.15.84:0/1287727717 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a7c0adea0 0x7f6a7c06b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:18.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.137+0000 7f6a8099c700 1 -- 172.21.15.84:0/1287727717 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a6c00b740 con 0x7f6a7c0c92d0 2023-07-14T11:19:18.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.137+0000 7f6a73fff700 1 --2- 172.21.15.84:0/1287727717 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a7c0b12f0 0x7f6a7c06d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:19:18.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.137+0000 7f6a8099c700 1 --2- 172.21.15.84:0/1287727717 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a7c0c92d0 0x7f6a7c0b24c0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f6a7400efc0 tx=0x7f6a7400c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:18.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.138+0000 7f6a797fa700 1 -- 172.21.15.84:0/1287727717 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a7400cb80 con 0x7f6a7c0c92d0 2023-07-14T11:19:18.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.138+0000 7f6a797fa700 1 -- 172.21.15.84:0/1287727717 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a7400f040 con 0x7f6a7c0c92d0 2023-07-14T11:19:18.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.138+0000 7f6a823ff700 1 -- 172.21.15.84:0/1287727717 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a7c06be70 con 0x7f6a7c0c92d0 2023-07-14T11:19:18.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.138+0000 7f6a797fa700 1 -- 172.21.15.84:0/1287727717 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a74014480 con 0x7f6a7c0c92d0 2023-07-14T11:19:18.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.138+0000 7f6a823ff700 1 -- 172.21.15.84:0/1287727717 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a7c06c430 con 0x7f6a7c0c92d0 2023-07-14T11:19:18.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.139+0000 7f6a823ff700 1 -- 172.21.15.84:0/1287727717 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a7c06c650 con 0x7f6a7c0c92d0 2023-07-14T11:19:18.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.140+0000 7f6a797fa700 1 -- 172.21.15.84:0/1287727717 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f6a740145e0 con 0x7f6a7c0c92d0 2023-07-14T11:19:18.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.141+0000 7f6a797fa700 1 --2- 172.21.15.84:0/1287727717 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f6a5c06ae00 0x7f6a5c06d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:18.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.141+0000 7f6a797fa700 1 -- 172.21.15.84:0/1287727717 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f6a74089ca0 con 0x7f6a7c0c92d0 2023-07-14T11:19:18.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.141+0000 7f6a7bfff700 1 --2- 172.21.15.84:0/1287727717 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f6a5c06ae00 0x7f6a5c06d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:18.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.142+0000 7f6a7bfff700 1 --2- 172.21.15.84:0/1287727717 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f6a5c06ae00 0x7f6a5c06d2b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c00b2c0 tx=0x7f6a6c01c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:18.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.145+0000 7f6a797fa700 1 -- 172.21.15.84:0/1287727717 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f6a74054dc0 con 0x7f6a7c0c92d0 2023-07-14T11:19:18.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.341+0000 7f6a823ff700 1 -- 172.21.15.84:0/1287727717 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f6a7c074350 con 0x7f6a7c0c92d0 2023-07-14T11:19:18.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.345+0000 7f6a797fa700 1 -- 172.21.15.84:0/1287727717 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6a740583e0 con 0x7f6a7c0c92d0 2023-07-14T11:19:18.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.348+0000 7f6a823ff700 1 -- 172.21.15.84:0/1287727717 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f6a5c06ae00 msgr2=0x7f6a5c06d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:18.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.348+0000 7f6a823ff700 1 --2- 172.21.15.84:0/1287727717 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f6a5c06ae00 0x7f6a5c06d2b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c00b2c0 tx=0x7f6a6c01c040 comp rx=0 tx=0).stop 2023-07-14T11:19:18.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.348+0000 7f6a823ff700 1 -- 172.21.15.84:0/1287727717 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a7c0c92d0 msgr2=0x7f6a7c0b24c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:18.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.348+0000 7f6a823ff700 1 --2- 172.21.15.84:0/1287727717 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a7c0c92d0 0x7f6a7c0b24c0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f6a7400efc0 tx=0x7f6a7400c0c0 comp rx=0 tx=0).stop 2023-07-14T11:19:18.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.348+0000 7f6a823ff700 1 -- 172.21.15.84:0/1287727717 shutdown_connections 2023-07-14T11:19:18.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.348+0000 7f6a823ff700 1 --2- 172.21.15.84:0/1287727717 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a7c0c92d0 0x7f6a7c0b24c0 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:18.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.348+0000 7f6a823ff700 1 --2- 172.21.15.84:0/1287727717 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a7c0adea0 0x7f6a7c06b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:18.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.348+0000 7f6a823ff700 1 --2- 172.21.15.84:0/1287727717 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f6a5c06ae00 0x7f6a5c06d2b0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:18.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.348+0000 7f6a823ff700 1 --2- 172.21.15.84:0/1287727717 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a7c0b12f0 0x7f6a7c06d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:18.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.348+0000 7f6a823ff700 1 -- 172.21.15.84:0/1287727717 >> 172.21.15.84:0/1287727717 conn(0x7f6a7c0b05d0 msgr2=0x7f6a7c06f730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:18.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.348+0000 7f6a823ff700 1 -- 172.21.15.84:0/1287727717 shutdown_connections 2023-07-14T11:19:18.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.348+0000 7f6a823ff700 1 -- 172.21.15.84:0/1287727717 wait complete. 2023-07-14T11:19:18.368 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-14T11:19:18.368 DEBUG:teuthology.orchestra.run.smithi084:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-14T11:19:18.466 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-14T11:19:18.572 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-14T11:19:18.573 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-14T11:19:18.573 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:19:18.619 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345568k,nr_inodes=4086392,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=35,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275008k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-07-14T11:19:18.619 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-07-14T11:19:18.620 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:19:18.668 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345528k,nr_inodes=4086382,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=40,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275000k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-07-14T11:19:18.668 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-14T11:19:18.669 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:19:18.714 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345568k,nr_inodes=4086392,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=35,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275008k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-07-14T11:19:18.715 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-07-14T11:19:18.715 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:19:18.761 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345528k,nr_inodes=4086382,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=40,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275000k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-07-14T11:19:18.762 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-14T11:19:18.762 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T11:19:18.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.955+0000 7ff2161ff700 1 Processor -- start 2023-07-14T11:19:18.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.955+0000 7ff2161ff700 1 -- start start 2023-07-14T11:19:18.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.956+0000 7ff2161ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff210160030 0x7ff21006c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:18.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.956+0000 7ff2161ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff2100d1160 0x7ff2100b0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:18.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.957+0000 7ff2161ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2100d2cc0 con 0x7ff2100b5cd0 2023-07-14T11:19:18.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.957+0000 7ff2161ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2100afbb0 con 0x7ff2100d1160 2023-07-14T11:19:18.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.957+0000 7ff2161ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2100afe90 con 0x7ff210160030 2023-07-14T11:19:18.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.957+0000 7ff20ffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff2100d1160 0x7ff2100b0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:18.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.957+0000 7ff20ffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff2100d1160 0x7ff2100b0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53970/0 (socket says 172.21.15.84:53970) 2023-07-14T11:19:18.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.957+0000 7ff20ffff700 1 -- 172.21.15.84:0/2323458550 learned_addr learned my addr 172.21.15.84:0/2323458550 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:18.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.957+0000 7ff20f7fe700 1 --2- 172.21.15.84:0/2323458550 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff210160030 0x7ff21006c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:18.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.957+0000 7ff20ffff700 1 -- 172.21.15.84:0/2323458550 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff210160030 msgr2=0x7ff21006c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:18.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.957+0000 7ff20ffff700 1 --2- 172.21.15.84:0/2323458550 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff210160030 0x7ff21006c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:18.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.957+0000 7ff20ffff700 1 -- 172.21.15.84:0/2323458550 >> v1:172.21.15.179:6789/0 conn(0x7ff2100b5cd0 legacy=0x7ff2100d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:18.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.957+0000 7ff20ffff700 1 -- 172.21.15.84:0/2323458550 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2100b0170 con 0x7ff2100d1160 2023-07-14T11:19:18.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.958+0000 7ff20ffff700 1 --2- 172.21.15.84:0/2323458550 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2100d1160 0x7ff2100b0c50 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7ff208009e50 tx=0x7ff20800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d751d22b9c36706d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:18.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.958+0000 7ff20effd700 1 -- 172.21.15.84:0/2323458550 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20800e070 con 0x7ff2100d1160 2023-07-14T11:19:18.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.958+0000 7ff20effd700 1 -- 172.21.15.84:0/2323458550 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff20800b9c0 con 0x7ff2100d1160 2023-07-14T11:19:18.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.958+0000 7ff20effd700 1 -- 172.21.15.84:0/2323458550 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20800bd70 con 0x7ff2100d1160 2023-07-14T11:19:18.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.958+0000 7ff2161ff700 1 -- 172.21.15.84:0/2323458550 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2100d1160 msgr2=0x7ff2100b0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:18.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.958+0000 7ff2161ff700 1 --2- 172.21.15.84:0/2323458550 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2100d1160 0x7ff2100b0c50 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7ff208009e50 tx=0x7ff20800b330 comp rx=0 tx=0).stop 2023-07-14T11:19:18.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.958+0000 7ff2161ff700 1 -- 172.21.15.84:0/2323458550 shutdown_connections 2023-07-14T11:19:18.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.958+0000 7ff2161ff700 1 --2- 172.21.15.84:0/2323458550 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2100d1160 0x7ff2100b0c50 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:18.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.958+0000 7ff2161ff700 1 --2- 172.21.15.84:0/2323458550 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff210160030 0x7ff21006c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:18.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.958+0000 7ff2161ff700 1 -- 172.21.15.84:0/2323458550 >> 172.21.15.84:0/2323458550 conn(0x7ff21009c190 msgr2=0x7ff2100d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:18.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.959+0000 7ff2161ff700 1 -- 172.21.15.84:0/2323458550 shutdown_connections 2023-07-14T11:19:18.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.959+0000 7ff2161ff700 1 -- 172.21.15.84:0/2323458550 wait complete. 2023-07-14T11:19:18.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.960+0000 7ff2161ff700 1 Processor -- start 2023-07-14T11:19:18.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.960+0000 7ff2161ff700 1 -- start start 2023-07-14T11:19:18.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.961+0000 7ff2161ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2100b5cd0 0x7ff21015a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:18.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.961+0000 7ff2161ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2100d1160 0x7ff2101484b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:18.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.961+0000 7ff2161ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff210160030 0x7ff2101489f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:18.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.961+0000 7ff2161ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff21015d360 con 0x7ff2100d1160 2023-07-14T11:19:18.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.961+0000 7ff2161ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff21015cde0 con 0x7ff210160030 2023-07-14T11:19:18.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.961+0000 7ff2161ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2100c7aa0 con 0x7ff2100b5cd0 2023-07-14T11:19:18.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.961+0000 7ff207fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2100d1160 0x7ff2101484b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:18.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.962+0000 7ff207fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2100d1160 0x7ff2101484b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53974/0 (socket says 172.21.15.84:53974) 2023-07-14T11:19:18.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.962+0000 7ff207fff700 1 -- 172.21.15.84:0/27356277 learned_addr learned my addr 172.21.15.84:0/27356277 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:18.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.962+0000 7ff20f7fe700 1 --2- 172.21.15.84:0/27356277 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2100b5cd0 0x7ff21015a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:18.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.962+0000 7ff20ffff700 1 --2- 172.21.15.84:0/27356277 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff210160030 0x7ff2101489f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:18.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.962+0000 7ff207fff700 1 -- 172.21.15.84:0/27356277 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2100b5cd0 msgr2=0x7ff21015a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:18.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.962+0000 7ff207fff700 1 --2- 172.21.15.84:0/27356277 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2100b5cd0 0x7ff21015a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:18.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.962+0000 7ff207fff700 1 -- 172.21.15.84:0/27356277 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff210160030 msgr2=0x7ff2101489f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:18.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.962+0000 7ff207fff700 1 --2- 172.21.15.84:0/27356277 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff210160030 0x7ff2101489f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:18.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.962+0000 7ff207fff700 1 -- 172.21.15.84:0/27356277 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff208009b30 con 0x7ff2100d1160 2023-07-14T11:19:18.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.962+0000 7ff207fff700 1 --2- 172.21.15.84:0/27356277 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2100d1160 0x7ff2101484b0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7ff1f800c4e0 tx=0x7ff1f800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:18.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.962+0000 7ff20cff9700 1 -- 172.21.15.84:0/27356277 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f80052d0 con 0x7ff2100d1160 2023-07-14T11:19:18.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.962+0000 7ff20cff9700 1 -- 172.21.15.84:0/27356277 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1f8005430 con 0x7ff2100d1160 2023-07-14T11:19:18.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.962+0000 7ff2161ff700 1 -- 172.21.15.84:0/27356277 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff21015d080 con 0x7ff2100d1160 2023-07-14T11:19:18.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.962+0000 7ff20cff9700 1 -- 172.21.15.84:0/27356277 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f80038c0 con 0x7ff2100d1160 2023-07-14T11:19:18.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.963+0000 7ff2161ff700 1 -- 172.21.15.84:0/27356277 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff21015a7d0 con 0x7ff2100d1160 2023-07-14T11:19:18.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.963+0000 7ff2161ff700 1 -- 172.21.15.84:0/27356277 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2100c7f80 con 0x7ff2100d1160 2023-07-14T11:19:18.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.964+0000 7ff20cff9700 1 -- 172.21.15.84:0/27356277 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7ff1f8003a20 con 0x7ff2100d1160 2023-07-14T11:19:18.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.966+0000 7ff20cff9700 1 --2- 172.21.15.84:0/27356277 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7ff1f006ae00 0x7ff1f006d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:18.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.966+0000 7ff20cff9700 1 -- 172.21.15.84:0/27356277 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5382+0+0 (secure 0 0 0) 0x7ff1f8088670 con 0x7ff2100d1160 2023-07-14T11:19:18.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.966+0000 7ff20f7fe700 1 --2- 172.21.15.84:0/27356277 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7ff1f006ae00 0x7ff1f006d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:18.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.967+0000 7ff20f7fe700 1 --2- 172.21.15.84:0/27356277 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7ff1f006ae00 0x7ff1f006d2b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff200007a30 tx=0x7ff200008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:18.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:18.970+0000 7ff20cff9700 1 -- 172.21.15.84:0/27356277 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ff2100c7f80 con 0x7ff2100d1160 2023-07-14T11:19:19.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.207+0000 7ff2161ff700 1 -- 172.21.15.84:0/27356277 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff2100c7f80 con 0x7ff2100d1160 2023-07-14T11:19:19.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.207+0000 7ff20cff9700 1 -- 172.21.15.84:0/27356277 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+3535 (secure 0 0 0) 0x7ff1f8017de0 con 0x7ff2100d1160 2023-07-14T11:19:19.210 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:19:19.210 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":62,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5945,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6834/3102047639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":3102047639},{"type":"v1","addr":"172.21.15.84:6834","nonce":3102047639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":5951,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/1883008963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1883008963},{"type":"v1","addr":"172.21.15.179:6835","nonce":1883008963}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49},{"gid":6901,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3521110991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":3521110991},{"type":"v1","addr":"172.21.15.179:6834","nonce":3521110991}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":7620,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/2283239938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6833","nonce":2283239938},{"type":"v1","addr":"172.21.15.84:6835","nonce":2283239938}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[]} 2023-07-14T11:19:19.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.209+0000 7ff2161ff700 1 -- 172.21.15.84:0/27356277 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7ff1f006ae00 msgr2=0x7ff1f006d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:19.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.209+0000 7ff2161ff700 1 --2- 172.21.15.84:0/27356277 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7ff1f006ae00 0x7ff1f006d2b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff200007a30 tx=0x7ff200008040 comp rx=0 tx=0).stop 2023-07-14T11:19:19.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.209+0000 7ff2161ff700 1 -- 172.21.15.84:0/27356277 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2100d1160 msgr2=0x7ff2101484b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:19.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.209+0000 7ff2161ff700 1 --2- 172.21.15.84:0/27356277 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2100d1160 0x7ff2101484b0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7ff1f800c4e0 tx=0x7ff1f800c7f0 comp rx=0 tx=0).stop 2023-07-14T11:19:19.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.209+0000 7ff2161ff700 1 -- 172.21.15.84:0/27356277 shutdown_connections 2023-07-14T11:19:19.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.209+0000 7ff2161ff700 1 --2- 172.21.15.84:0/27356277 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7ff1f006ae00 0x7ff1f006d2b0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:19.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.209+0000 7ff2161ff700 1 --2- 172.21.15.84:0/27356277 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2100b5cd0 0x7ff21015a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:19.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.209+0000 7ff2161ff700 1 --2- 172.21.15.84:0/27356277 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff210160030 0x7ff2101489f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:19.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.209+0000 7ff2161ff700 1 --2- 172.21.15.84:0/27356277 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2100d1160 0x7ff2101484b0 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:19.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.209+0000 7ff2161ff700 1 -- 172.21.15.84:0/27356277 >> 172.21.15.84:0/27356277 conn(0x7ff21009c190 msgr2=0x7ff21015f390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:19.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.210+0000 7ff2161ff700 1 -- 172.21.15.84:0/27356277 shutdown_connections 2023-07-14T11:19:19.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.210+0000 7ff2161ff700 1 -- 172.21.15.84:0/27356277 wait complete. 2023-07-14T11:19:19.214 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 62 2023-07-14T11:19:19.230 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-14T11:19:19.230 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-14T11:19:19.230 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-14T11:19:19.231 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T11:19:19.231 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-14T11:19:19.231 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-14T11:19:19.231 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-14T11:19:19.231 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T11:19:19.232 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-14T11:19:19.232 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-14T11:19:19.232 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-14T11:19:19.232 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T11:19:19.233 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-14T11:19:19.233 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-14T11:19:19.233 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-14T11:19:19.233 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T11:19:19.243 INFO:tasks.ceph.mds.a:Stopped 2023-07-14T11:19:19.243 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-14T11:19:19.244 INFO:tasks.ceph.mds.c:Stopped 2023-07-14T11:19:19.245 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-14T11:19:19.247 INFO:tasks.ceph.mds.b:Stopped 2023-07-14T11:19:19.247 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-14T11:19:19.249 INFO:tasks.ceph.mds.d:Stopped 2023-07-14T11:19:19.249 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-14T11:19:19.288 INFO:tasks.ceph.mds.a:Started 2023-07-14T11:19:19.288 DEBUG:teuthology.parallel:result is None 2023-07-14T11:19:19.291 INFO:tasks.ceph.mds.c:Started 2023-07-14T11:19:19.291 DEBUG:teuthology.parallel:result is None 2023-07-14T11:19:19.293 INFO:tasks.ceph.mds.b:Started 2023-07-14T11:19:19.293 DEBUG:teuthology.parallel:result is None 2023-07-14T11:19:19.296 INFO:tasks.ceph.mds.d:Started 2023-07-14T11:19:19.296 DEBUG:teuthology.parallel:result is None 2023-07-14T11:19:19.297 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-14T11:19:19.436 INFO:tasks.ceph.mds.a.smithi084.stdout:starting mds.a at 2023-07-14T11:19:19.437 INFO:tasks.ceph.mds.c.smithi084.stdout:starting mds.c at 2023-07-14T11:19:19.442 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2023-07-14T11:19:19.442 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2023-07-14T11:19:19.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.501+0000 7f84a13ff700 1 Processor -- start 2023-07-14T11:19:19.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.501+0000 7f84a13ff700 1 -- start start 2023-07-14T11:19:19.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.502+0000 7f84a13ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f849c0c92d0 0x7f849c0ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:19.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.503+0000 7f84a13ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f849c15ce70 con 0x7f849c0adea0 2023-07-14T11:19:19.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.503+0000 7f84a13ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f849c15d0c0 con 0x7f849c0b12f0 2023-07-14T11:19:19.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.503+0000 7f84a13ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f849c15da60 con 0x7f849c0c92d0 2023-07-14T11:19:19.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.503+0000 7f849b7fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f849c0adea0 0x7f849c0cc690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50170/0 (socket says 172.21.15.84:50170) 2023-07-14T11:19:19.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.503+0000 7f849b7fe700 1 -- 172.21.15.84:0/1139395415 learned_addr learned my addr 172.21.15.84:0/1139395415 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:19:19.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.503+0000 7f849affd700 1 --2- 172.21.15.84:0/1139395415 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f849c0c92d0 0x7f849c0ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:19.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.503+0000 7f849a7fc700 1 -- 172.21.15.84:0/1139395415 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2888053166 0 0) 0x7f849c15d0c0 con 0x7f849c0b12f0 2023-07-14T11:19:19.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.503+0000 7f849a7fc700 1 -- 172.21.15.84:0/1139395415 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84880035b0 con 0x7f849c0b12f0 2023-07-14T11:19:19.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.503+0000 7f849a7fc700 1 -- 172.21.15.84:0/1139395415 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 730813282 0 0) 0x7f849c15ce70 con 0x7f849c0adea0 2023-07-14T11:19:19.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.503+0000 7f849a7fc700 1 -- 172.21.15.84:0/1139395415 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f849c15d0c0 con 0x7f849c0adea0 2023-07-14T11:19:19.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.503+0000 7f849affd700 1 -- 172.21.15.84:0/1139395415 >> v1:172.21.15.179:6789/0 conn(0x7f849c0b12f0 legacy=0x7f849c0c96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:19.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.503+0000 7f849affd700 1 -- 172.21.15.84:0/1139395415 >> v1:172.21.15.84:6789/0 conn(0x7f849c0adea0 legacy=0x7f849c0cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:19.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.503+0000 7f849affd700 1 -- 172.21.15.84:0/1139395415 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f849c15d3a0 con 0x7f849c0c92d0 2023-07-14T11:19:19.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.504+0000 7f849affd700 1 --2- 172.21.15.84:0/1139395415 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f849c0c92d0 0x7f849c0ad8f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f848c009870 tx=0x7f848c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70b6933b021f7bea server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:19.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.504+0000 7f849a7fc700 1 -- 172.21.15.84:0/1139395415 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848c011830 con 0x7f849c0c92d0 2023-07-14T11:19:19.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.504+0000 7f849a7fc700 1 -- 172.21.15.84:0/1139395415 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f848c011990 con 0x7f849c0c92d0 2023-07-14T11:19:19.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.504+0000 7f849a7fc700 1 -- 172.21.15.84:0/1139395415 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848c011d20 con 0x7f849c0c92d0 2023-07-14T11:19:19.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.504+0000 7f84a13ff700 1 -- 172.21.15.84:0/1139395415 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f849c0c92d0 msgr2=0x7f849c0ad8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:19.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.505+0000 7f84a13ff700 1 --2- 172.21.15.84:0/1139395415 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f849c0c92d0 0x7f849c0ad8f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f848c009870 tx=0x7f848c009b80 comp rx=0 tx=0).stop 2023-07-14T11:19:19.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.505+0000 7f84a13ff700 1 -- 172.21.15.84:0/1139395415 shutdown_connections 2023-07-14T11:19:19.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.505+0000 7f84a13ff700 1 --2- 172.21.15.84:0/1139395415 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f849c0c92d0 0x7f849c0ad8f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:19.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.505+0000 7f84a13ff700 1 -- 172.21.15.84:0/1139395415 >> 172.21.15.84:0/1139395415 conn(0x7f849c0b05d0 msgr2=0x7f849c0b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:19.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.505+0000 7f84a13ff700 1 -- 172.21.15.84:0/1139395415 shutdown_connections 2023-07-14T11:19:19.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.505+0000 7f84a13ff700 1 -- 172.21.15.84:0/1139395415 wait complete. 2023-07-14T11:19:19.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.506+0000 7f84a13ff700 1 Processor -- start 2023-07-14T11:19:19.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.507+0000 7f84a13ff700 1 -- start start 2023-07-14T11:19:19.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.507+0000 7f84a13ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f849c0adea0 0x7f849c0b4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:19.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.507+0000 7f84a13ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f849c0b12f0 0x7f849c0b18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:19.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.508+0000 7f84a13ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f849c0c92d0 0x7f849c143440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:19.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.508+0000 7f84a13ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f849c143980 con 0x7f849c0c92d0 2023-07-14T11:19:19.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.508+0000 7f84a13ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f849c0b3380 con 0x7f849c0adea0 2023-07-14T11:19:19.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.508+0000 7f84a13ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f849c0b3660 con 0x7f849c0b12f0 2023-07-14T11:19:19.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.508+0000 7f849b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f849c0c92d0 0x7f849c143440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:19.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.508+0000 7f849b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f849c0c92d0 0x7f849c143440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54010/0 (socket says 172.21.15.84:54010) 2023-07-14T11:19:19.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.508+0000 7f849b7fe700 1 -- 172.21.15.84:0/696941699 learned_addr learned my addr 172.21.15.84:0/696941699 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:19.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.508+0000 7f849affd700 1 --2- 172.21.15.84:0/696941699 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f849c0adea0 0x7f849c0b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:19.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.508+0000 7f8493fff700 1 --2- 172.21.15.84:0/696941699 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f849c0b12f0 0x7f849c0b18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:19.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.508+0000 7f849b7fe700 1 -- 172.21.15.84:0/696941699 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f849c0b12f0 msgr2=0x7f849c0b18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:19.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.508+0000 7f849b7fe700 1 --2- 172.21.15.84:0/696941699 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f849c0b12f0 0x7f849c0b18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:19.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.508+0000 7f849b7fe700 1 -- 172.21.15.84:0/696941699 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f849c0adea0 msgr2=0x7f849c0b4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:19.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.508+0000 7f849b7fe700 1 --2- 172.21.15.84:0/696941699 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f849c0adea0 0x7f849c0b4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:19.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.508+0000 7f849b7fe700 1 -- 172.21.15.84:0/696941699 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f848c0094a0 con 0x7f849c0c92d0 2023-07-14T11:19:19.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.508+0000 7f849b7fe700 1 --2- 172.21.15.84:0/696941699 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f849c0c92d0 0x7f849c143440 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f849400cb40 tx=0x7f849400cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:19.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.509+0000 7f84937fe700 1 -- 172.21.15.84:0/696941699 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f849400ab50 con 0x7f849c0c92d0 2023-07-14T11:19:19.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.509+0000 7f84937fe700 1 -- 172.21.15.84:0/696941699 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f849400acb0 con 0x7f849c0c92d0 2023-07-14T11:19:19.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.509+0000 7f84937fe700 1 -- 172.21.15.84:0/696941699 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8494012620 con 0x7f849c0c92d0 2023-07-14T11:19:19.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.509+0000 7f84a13ff700 1 -- 172.21.15.84:0/696941699 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f849c0b3940 con 0x7f849c0c92d0 2023-07-14T11:19:19.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.509+0000 7f84a13ff700 1 -- 172.21.15.84:0/696941699 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f849c0b3f00 con 0x7f849c0c92d0 2023-07-14T11:19:19.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.510+0000 7f84a13ff700 1 -- 172.21.15.84:0/696941699 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f849c074350 con 0x7f849c0c92d0 2023-07-14T11:19:19.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.511+0000 7f84937fe700 1 -- 172.21.15.84:0/696941699 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f849401b3b0 con 0x7f849c0c92d0 2023-07-14T11:19:19.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.512+0000 7f84937fe700 1 --2- 172.21.15.84:0/696941699 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f847c06ae00 0x7f847c06d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:19.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.512+0000 7f84937fe700 1 -- 172.21.15.84:0/696941699 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f8494089220 con 0x7f849c0c92d0 2023-07-14T11:19:19.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.512+0000 7f849affd700 1 --2- 172.21.15.84:0/696941699 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f847c06ae00 0x7f847c06d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:19.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.513+0000 7f849affd700 1 --2- 172.21.15.84:0/696941699 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f847c06ae00 0x7f847c06d2b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f848c0090b0 tx=0x7f848c01c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:19.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.516+0000 7f84937fe700 1 -- 172.21.15.84:0/696941699 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f84940543c0 con 0x7f849c0c92d0 2023-07-14T11:19:19.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.726+0000 7f84a13ff700 1 -- 172.21.15.84:0/696941699 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f849c06fed0 con 0x7f849c0c92d0 2023-07-14T11:19:19.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.928+0000 7f84937fe700 1 -- 172.21.15.84:0/696941699 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v100) v1 ==== 97+0+0 (secure 0 0 0) 0x7f84940579e0 con 0x7f849c0c92d0 2023-07-14T11:19:19.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.931+0000 7f84a13ff700 1 -- 172.21.15.84:0/696941699 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f847c06ae00 msgr2=0x7f847c06d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:19.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.931+0000 7f84a13ff700 1 --2- 172.21.15.84:0/696941699 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f847c06ae00 0x7f847c06d2b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f848c0090b0 tx=0x7f848c01c040 comp rx=0 tx=0).stop 2023-07-14T11:19:19.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.931+0000 7f84a13ff700 1 -- 172.21.15.84:0/696941699 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f849c0c92d0 msgr2=0x7f849c143440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:19.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.931+0000 7f84a13ff700 1 --2- 172.21.15.84:0/696941699 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f849c0c92d0 0x7f849c143440 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f849400cb40 tx=0x7f849400cf00 comp rx=0 tx=0).stop 2023-07-14T11:19:19.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.931+0000 7f84a13ff700 1 -- 172.21.15.84:0/696941699 shutdown_connections 2023-07-14T11:19:19.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.931+0000 7f84a13ff700 1 --2- 172.21.15.84:0/696941699 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f849c0c92d0 0x7f849c143440 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:19.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.931+0000 7f84a13ff700 1 --2- 172.21.15.84:0/696941699 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f849c0adea0 0x7f849c0b4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:19.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.931+0000 7f84a13ff700 1 --2- 172.21.15.84:0/696941699 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f847c06ae00 0x7f847c06d2b0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:19.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.931+0000 7f84a13ff700 1 --2- 172.21.15.84:0/696941699 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f849c0b12f0 0x7f849c0b18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:19.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.931+0000 7f84a13ff700 1 -- 172.21.15.84:0/696941699 >> 172.21.15.84:0/696941699 conn(0x7f849c0b05d0 msgr2=0x7f849c0cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:19.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.931+0000 7f84a13ff700 1 -- 172.21.15.84:0/696941699 shutdown_connections 2023-07-14T11:19:19.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:19.931+0000 7f84a13ff700 1 -- 172.21.15.84:0/696941699 wait complete. 2023-07-14T11:19:19.935 INFO:teuthology.orchestra.run.smithi084.stderr: removed all blocklist entries 2023-07-14T11:19:19.953 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-14T11:19:20.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.144+0000 7f6b8e7ff700 1 Processor -- start 2023-07-14T11:19:20.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.145+0000 7f6b8e7ff700 1 -- start start 2023-07-14T11:19:20.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.146+0000 7f6b8e7ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6b880b4510 0x7f6b880b6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:20.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.146+0000 7f6b8e7ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b880b7f50 con 0x7f6b880b5d90 2023-07-14T11:19:20.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.146+0000 7f6b8e7ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b880cdca0 con 0x7f6b880d0b10 2023-07-14T11:19:20.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.146+0000 7f6b8e7ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b880b48e0 con 0x7f6b880b4510 2023-07-14T11:19:20.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.146+0000 7f6b87fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6b880b4510 0x7f6b880b6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:20.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.146+0000 7f6b7ffff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f6b880b5d90 0x7f6b880cd590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50186/0 (socket says 172.21.15.84:50186) 2023-07-14T11:19:20.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.146+0000 7f6b7ffff700 1 -- 172.21.15.84:0/3808499297 learned_addr learned my addr 172.21.15.84:0/3808499297 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:19:20.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.146+0000 7f6b87fff700 1 -- 172.21.15.84:0/3808499297 >> v1:172.21.15.179:6789/0 conn(0x7f6b880d0b10 legacy=0x7f6b880b83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:20.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.146+0000 7f6b87fff700 1 -- 172.21.15.84:0/3808499297 >> v1:172.21.15.84:6789/0 conn(0x7f6b880b5d90 legacy=0x7f6b880cd590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:20.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.147+0000 7f6b877fe700 1 -- 172.21.15.84:0/3808499297 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4168052392 0 0) 0x7f6b880b7f50 con 0x7f6b880b5d90 2023-07-14T11:19:20.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.147+0000 7f6b87fff700 1 -- 172.21.15.84:0/3808499297 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b880b7340 con 0x7f6b880b4510 2023-07-14T11:19:20.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.147+0000 7f6b87fff700 1 --2- 172.21.15.84:0/3808499297 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b880b4510 0x7f6b880b6c80 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f6b78009820 tx=0x7f6b78009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50a8c0adab61d3fc server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:20.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.147+0000 7f6b877fe700 1 -- 172.21.15.84:0/3808499297 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b78005e30 con 0x7f6b880b4510 2023-07-14T11:19:20.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.147+0000 7f6b877fe700 1 -- 172.21.15.84:0/3808499297 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b78006030 con 0x7f6b880b4510 2023-07-14T11:19:20.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.147+0000 7f6b877fe700 1 -- 172.21.15.84:0/3808499297 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b780063e0 con 0x7f6b880b4510 2023-07-14T11:19:20.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.147+0000 7f6b8e7ff700 1 -- 172.21.15.84:0/3808499297 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b880b4510 msgr2=0x7f6b880b6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:20.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.148+0000 7f6b8e7ff700 1 --2- 172.21.15.84:0/3808499297 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b880b4510 0x7f6b880b6c80 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f6b78009820 tx=0x7f6b78009b30 comp rx=0 tx=0).stop 2023-07-14T11:19:20.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.148+0000 7f6b8e7ff700 1 -- 172.21.15.84:0/3808499297 shutdown_connections 2023-07-14T11:19:20.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.148+0000 7f6b8e7ff700 1 --2- 172.21.15.84:0/3808499297 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b880b4510 0x7f6b880b6c80 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:20.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.148+0000 7f6b8e7ff700 1 -- 172.21.15.84:0/3808499297 >> 172.21.15.84:0/3808499297 conn(0x7f6b8809c1d0 msgr2=0x7f6b880d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:20.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.148+0000 7f6b8e7ff700 1 -- 172.21.15.84:0/3808499297 shutdown_connections 2023-07-14T11:19:20.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.148+0000 7f6b8e7ff700 1 -- 172.21.15.84:0/3808499297 wait complete. 2023-07-14T11:19:20.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.149+0000 7f6b8e7ff700 1 Processor -- start 2023-07-14T11:19:20.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.150+0000 7f6b8e7ff700 1 -- start start 2023-07-14T11:19:20.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.150+0000 7f6b8e7ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b880b4510 0x7f6b880c9240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:20.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.150+0000 7f6b8e7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b880b5d90 0x7f6b880cc1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:20.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.151+0000 7f6b8e7ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b880d0b10 0x7f6b88149d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:20.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.151+0000 7f6b8e7ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b880c78d0 con 0x7f6b880b4510 2023-07-14T11:19:20.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.151+0000 7f6b8e7ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b880c7bb0 con 0x7f6b880d0b10 2023-07-14T11:19:20.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.151+0000 7f6b8e7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b880c7e90 con 0x7f6b880b5d90 2023-07-14T11:19:20.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.151+0000 7f6b87fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b880b4510 0x7f6b880c9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:20.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.151+0000 7f6b87fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b880b4510 0x7f6b880c9240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54020/0 (socket says 172.21.15.84:54020) 2023-07-14T11:19:20.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.151+0000 7f6b87fff700 1 -- 172.21.15.84:0/2935226306 learned_addr learned my addr 172.21.15.84:0/2935226306 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:20.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.151+0000 7f6b7ffff700 1 --2- 172.21.15.84:0/2935226306 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b880b5d90 0x7f6b880cc1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:20.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.151+0000 7f6b8cd9c700 1 --2- 172.21.15.84:0/2935226306 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b880d0b10 0x7f6b88149d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:20.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.151+0000 7f6b87fff700 1 -- 172.21.15.84:0/2935226306 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b880b5d90 msgr2=0x7f6b880cc1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:20.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.151+0000 7f6b87fff700 1 --2- 172.21.15.84:0/2935226306 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b880b5d90 0x7f6b880cc1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:20.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.151+0000 7f6b87fff700 1 -- 172.21.15.84:0/2935226306 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b880d0b10 msgr2=0x7f6b88149d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:20.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.151+0000 7f6b87fff700 1 --2- 172.21.15.84:0/2935226306 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b880d0b10 0x7f6b88149d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:20.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.151+0000 7f6b87fff700 1 -- 172.21.15.84:0/2935226306 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b78009430 con 0x7f6b880b4510 2023-07-14T11:19:20.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.151+0000 7f6b7ffff700 1 --2- 172.21.15.84:0/2935226306 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b880b5d90 0x7f6b880cc1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:19:20.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.151+0000 7f6b8cd9c700 1 --2- 172.21.15.84:0/2935226306 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b880d0b10 0x7f6b88149d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:19:20.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.151+0000 7f6b87fff700 1 --2- 172.21.15.84:0/2935226306 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b880b4510 0x7f6b880c9240 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f6b78013040 tx=0x7f6b78004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:20.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.152+0000 7f6b857fa700 1 -- 172.21.15.84:0/2935226306 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b78025430 con 0x7f6b880b4510 2023-07-14T11:19:20.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.152+0000 7f6b857fa700 1 -- 172.21.15.84:0/2935226306 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b78020070 con 0x7f6b880b4510 2023-07-14T11:19:20.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.152+0000 7f6b8e7ff700 1 -- 172.21.15.84:0/2935226306 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b880c8170 con 0x7f6b880b4510 2023-07-14T11:19:20.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.152+0000 7f6b857fa700 1 -- 172.21.15.84:0/2935226306 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b780257d0 con 0x7f6b880b4510 2023-07-14T11:19:20.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.152+0000 7f6b8e7ff700 1 -- 172.21.15.84:0/2935226306 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b880c9780 con 0x7f6b880b4510 2023-07-14T11:19:20.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.153+0000 7f6b8e7ff700 1 -- 172.21.15.84:0/2935226306 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b880c8690 con 0x7f6b880b4510 2023-07-14T11:19:20.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.154+0000 7f6b857fa700 1 -- 172.21.15.84:0/2935226306 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f6b78022030 con 0x7f6b880b4510 2023-07-14T11:19:20.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.155+0000 7f6b857fa700 1 --2- 172.21.15.84:0/2935226306 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f6b6806ae00 0x7f6b6806d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:20.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.155+0000 7f6b857fa700 1 -- 172.21.15.84:0/2935226306 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6b7808aa00 con 0x7f6b880b4510 2023-07-14T11:19:20.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.155+0000 7f6b7ffff700 1 --2- 172.21.15.84:0/2935226306 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f6b6806ae00 0x7f6b6806d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:20.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.156+0000 7f6b7ffff700 1 --2- 172.21.15.84:0/2935226306 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f6b6806ae00 0x7f6b6806d2b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6b880c9b70 tx=0x7f6b70007e50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:20.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.159+0000 7f6b857fa700 1 -- 172.21.15.84:0/2935226306 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f6b880c8690 con 0x7f6b880b4510 2023-07-14T11:19:20.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.431+0000 7f6b8e7ff700 1 -- 172.21.15.84:0/2935226306 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f6b880c8690 con 0x7f6b880b4510 2023-07-14T11:19:20.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.431+0000 7f6b857fa700 1 -- 172.21.15.84:0/2935226306 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v21) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f6b880c8690 con 0x7f6b880b4510 2023-07-14T11:19:20.434 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:19:20.434 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-07-14T11:19:20.434 INFO:teuthology.orchestra.run.smithi084.stdout: "auth_dump": [ 2023-07-14T11:19:20.434 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:19:20.435 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.a", 2023-07-14T11:19:20.435 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCJLbFkprwsJhAAIZa03ewirqLtc0mn7ki6Vw==", 2023-07-14T11:19:20.435 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:19:20.435 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-07-14T11:19:20.435 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-07-14T11:19:20.435 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-07-14T11:19:20.435 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:19:20.436 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:19:20.436 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:19:20.436 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:19:20.436 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.b", 2023-07-14T11:19:20.436 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCKLbFkfYOoAhAAQcpDkBRXNSDyfnZp1A/BJw==", 2023-07-14T11:19:20.436 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:19:20.436 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-07-14T11:19:20.436 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-07-14T11:19:20.437 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-07-14T11:19:20.437 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:19:20.437 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:19:20.437 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:19:20.437 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:19:20.438 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.c", 2023-07-14T11:19:20.438 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCJLbFk9MZ4MhAAY2CpAoK7Bx7NyoccpK7MLA==", 2023-07-14T11:19:20.438 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:19:20.438 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-07-14T11:19:20.438 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-07-14T11:19:20.438 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-07-14T11:19:20.438 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:19:20.438 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:19:20.439 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:19:20.439 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:19:20.439 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.d", 2023-07-14T11:19:20.439 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCKLbFkfxxFDhAAFPvGUrg0RW1nYTAdACvEAA==", 2023-07-14T11:19:20.439 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:19:20.439 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-07-14T11:19:20.439 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-07-14T11:19:20.439 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-07-14T11:19:20.440 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:19:20.440 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:19:20.440 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:19:20.440 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:19:20.440 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.0", 2023-07-14T11:19:20.440 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCOLbFkd18mDBAA2tneRYzoJkGwIZNDW6+Z7w==", 2023-07-14T11:19:20.440 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:19:20.440 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-07-14T11:19:20.441 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-07-14T11:19:20.441 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:19:20.441 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:19:20.441 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:19:20.441 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:19:20.441 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.1", 2023-07-14T11:19:20.441 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCRLbFkwBlAEBAAoEG62Dam3KHra4oNXBGyfw==", 2023-07-14T11:19:20.442 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:19:20.442 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-07-14T11:19:20.442 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-07-14T11:19:20.442 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:19:20.442 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:19:20.442 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:19:20.442 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:19:20.442 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.2", 2023-07-14T11:19:20.443 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCULbFkCln2ExAAKM+sAwMtcH6yEbNUqHbN4Q==", 2023-07-14T11:19:20.443 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:19:20.443 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-07-14T11:19:20.443 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-07-14T11:19:20.443 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:19:20.443 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:19:20.443 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:19:20.443 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:19:20.444 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.3", 2023-07-14T11:19:20.444 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCXLbFk0ZGgFxAAgOEUoX5jqzic6bOxtG7qSw==", 2023-07-14T11:19:20.444 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:19:20.444 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-07-14T11:19:20.444 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-07-14T11:19:20.444 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:19:20.444 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:19:20.444 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:19:20.445 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:19:20.445 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.4", 2023-07-14T11:19:20.445 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCdLbFknOESLBAA9usIfRfkbbLiMOCvUR+pXQ==", 2023-07-14T11:19:20.445 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:19:20.445 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-07-14T11:19:20.445 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-07-14T11:19:20.445 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:19:20.445 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:19:20.446 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:19:20.446 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:19:20.446 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.5", 2023-07-14T11:19:20.446 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCgLbFk+Rk/LxAAGqk3ueTaGaSINPuxoW53Gw==", 2023-07-14T11:19:20.446 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:19:20.446 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-07-14T11:19:20.446 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-07-14T11:19:20.447 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:19:20.447 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:19:20.447 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:19:20.447 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:19:20.447 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.6", 2023-07-14T11:19:20.447 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCjLbFk1/QfMxAABnWxus7LXfn7R0iwMVTWiA==", 2023-07-14T11:19:20.447 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:19:20.447 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-07-14T11:19:20.448 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-07-14T11:19:20.448 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:19:20.448 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:19:20.448 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:19:20.448 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:19:20.448 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.7", 2023-07-14T11:19:20.448 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCmLbFkNnhmNhAAz85GY1Sb1NuKINJCyWpPGQ==", 2023-07-14T11:19:20.448 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:19:20.449 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-07-14T11:19:20.449 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-07-14T11:19:20.449 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:19:20.449 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:19:20.449 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:19:20.449 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:19:20.449 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.0", 2023-07-14T11:19:20.449 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCKLbFkKSl5GBAAwPK4Zs6+gv/6YKHh4JI3WA==", 2023-07-14T11:19:20.450 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:19:20.450 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-07-14T11:19:20.450 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow r", 2023-07-14T11:19:20.450 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-14T11:19:20.450 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:19:20.450 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:19:20.450 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:19:20.451 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.1", 2023-07-14T11:19:20.451 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCKLbFkieNzJxAARri6UfCWdcXA3NpeFfvILw==", 2023-07-14T11:19:20.451 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:19:20.451 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-07-14T11:19:20.451 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-07-14T11:19:20.451 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-07-14T11:19:20.451 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-07-14T11:19:20.451 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:19:20.452 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:19:20.452 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:19:20.452 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.2", 2023-07-14T11:19:20.452 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCKLbFkLhv6HxAACUfTJK618qRsXETPJagZXQ==", 2023-07-14T11:19:20.452 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:19:20.452 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-07-14T11:19:20.452 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-07-14T11:19:20.452 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-07-14T11:19:20.453 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-07-14T11:19:20.453 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:19:20.453 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:19:20.453 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:19:20.453 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.3", 2023-07-14T11:19:20.453 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCKLbFka9HxLhAA4OsQY/t7A2FIYLEyYgJ19Q==", 2023-07-14T11:19:20.453 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:19:20.453 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-07-14T11:19:20.454 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-07-14T11:19:20.454 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-07-14T11:19:20.454 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-07-14T11:19:20.454 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:19:20.454 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:19:20.454 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:19:20.454 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.admin", 2023-07-14T11:19:20.454 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCILbFkmVPbKRAAffsYBVR51b7R8sXpbdF0MQ==", 2023-07-14T11:19:20.455 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:19:20.455 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow *", 2023-07-14T11:19:20.455 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-07-14T11:19:20.455 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-07-14T11:19:20.455 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:19:20.455 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:19:20.455 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:19:20.456 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:19:20.456 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mgr.x", 2023-07-14T11:19:20.456 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCJLbFk28xTHhAAAlmm5bW9VTtgE+OujO+G2w==", 2023-07-14T11:19:20.456 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:19:20.456 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow *", 2023-07-14T11:19:20.456 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile mgr", 2023-07-14T11:19:20.456 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:19:20.456 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:19:20.457 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:19:20.457 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:19:20.457 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mgr.y", 2023-07-14T11:19:20.457 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCJLbFk5dM1FhAAJWbB+GogsfcSkaBdHrFg4A==", 2023-07-14T11:19:20.457 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-07-14T11:19:20.457 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow *", 2023-07-14T11:19:20.457 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile mgr", 2023-07-14T11:19:20.457 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-07-14T11:19:20.458 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:19:20.458 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:19:20.458 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2023-07-14T11:19:20.458 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-07-14T11:19:20.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.434+0000 7f6b8e7ff700 1 -- 172.21.15.84:0/2935226306 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f6b6806ae00 msgr2=0x7f6b6806d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:20.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.434+0000 7f6b8e7ff700 1 --2- 172.21.15.84:0/2935226306 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f6b6806ae00 0x7f6b6806d2b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6b880c9b70 tx=0x7f6b70007e50 comp rx=0 tx=0).stop 2023-07-14T11:19:20.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.434+0000 7f6b8e7ff700 1 -- 172.21.15.84:0/2935226306 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b880b4510 msgr2=0x7f6b880c9240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:20.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.434+0000 7f6b8e7ff700 1 --2- 172.21.15.84:0/2935226306 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b880b4510 0x7f6b880c9240 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f6b78013040 tx=0x7f6b78004750 comp rx=0 tx=0).stop 2023-07-14T11:19:20.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.434+0000 7f6b8e7ff700 1 -- 172.21.15.84:0/2935226306 shutdown_connections 2023-07-14T11:19:20.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.434+0000 7f6b8e7ff700 1 --2- 172.21.15.84:0/2935226306 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b880d0b10 0x7f6b88149d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:20.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.434+0000 7f6b8e7ff700 1 --2- 172.21.15.84:0/2935226306 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b880b4510 0x7f6b880c9240 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:20.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.434+0000 7f6b8e7ff700 1 --2- 172.21.15.84:0/2935226306 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f6b6806ae00 0x7f6b6806d2b0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:20.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.434+0000 7f6b8e7ff700 1 --2- 172.21.15.84:0/2935226306 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b880b5d90 0x7f6b880cc1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:20.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.434+0000 7f6b8e7ff700 1 -- 172.21.15.84:0/2935226306 >> 172.21.15.84:0/2935226306 conn(0x7f6b8809c1d0 msgr2=0x7f6b880ce2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:20.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.434+0000 7f6b8e7ff700 1 -- 172.21.15.84:0/2935226306 shutdown_connections 2023-07-14T11:19:20.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.434+0000 7f6b8e7ff700 1 -- 172.21.15.84:0/2935226306 wait complete. 2023-07-14T11:19:20.461 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:19:20.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.653+0000 7f31711ff700 1 Processor -- start 2023-07-14T11:19:20.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.653+0000 7f31711ff700 1 -- start start 2023-07-14T11:19:20.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.654+0000 7f31711ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f316c141ff0 0x7f316c158fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:20.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.654+0000 7f31711ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f316c070710 0x7f316c0b4000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:20.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.655+0000 7f31711ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f316c0b4540 con 0x7f316c0b1a70 2023-07-14T11:19:20.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.655+0000 7f31711ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f316c071140 con 0x7f316c141ff0 2023-07-14T11:19:20.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.655+0000 7f31711ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f316c06c110 con 0x7f316c070710 2023-07-14T11:19:20.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.655+0000 7f316b59e700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f316c0b1a70 0x7f316c06c5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50200/0 (socket says 172.21.15.84:50200) 2023-07-14T11:19:20.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.655+0000 7f316b59e700 1 -- 172.21.15.84:0/1665168830 learned_addr learned my addr 172.21.15.84:0/1665168830 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:19:20.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.655+0000 7f316a59c700 1 --2- 172.21.15.84:0/1665168830 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f316c070710 0x7f316c0b4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:20.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.655+0000 7f316ad9d700 1 --2- 172.21.15.84:0/1665168830 >> v2:172.21.15.179:3300/0 conn(0x7f316c141ff0 0x7f316c158fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:20.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.655+0000 7f3169d9b700 1 -- 172.21.15.84:0/1665168830 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2072091922 0 0) 0x7f3164001490 con 0x7f316c0b1a70 2023-07-14T11:19:20.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.655+0000 7f3169d9b700 1 -- 172.21.15.84:0/1665168830 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31540035b0 con 0x7f316c0b1a70 2023-07-14T11:19:20.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.655+0000 7f316a59c700 1 -- 172.21.15.84:0/1665168830 >> v2:172.21.15.179:3300/0 conn(0x7f316c141ff0 msgr2=0x7f316c158fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:20.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.655+0000 7f316a59c700 1 --2- 172.21.15.84:0/1665168830 >> v2:172.21.15.179:3300/0 conn(0x7f316c141ff0 0x7f316c158fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:20.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.655+0000 7f316a59c700 1 -- 172.21.15.84:0/1665168830 >> v1:172.21.15.84:6789/0 conn(0x7f316c0b1a70 legacy=0x7f316c06c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:20.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.656+0000 7f316a59c700 1 -- 172.21.15.84:0/1665168830 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f316c070e60 con 0x7f316c070710 2023-07-14T11:19:20.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.656+0000 7f316ad9d700 1 --2- 172.21.15.84:0/1665168830 >> v2:172.21.15.179:3300/0 conn(0x7f316c141ff0 0x7f316c158fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:19:20.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.656+0000 7f316a59c700 1 --2- 172.21.15.84:0/1665168830 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f316c070710 0x7f316c0b4000 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3160009840 tx=0x7f3160009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18a6606ec3710806 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:20.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.656+0000 7f3169d9b700 1 -- 172.21.15.84:0/1665168830 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3160011830 con 0x7f316c070710 2023-07-14T11:19:20.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.656+0000 7f3169d9b700 1 -- 172.21.15.84:0/1665168830 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3160011990 con 0x7f316c070710 2023-07-14T11:19:20.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.656+0000 7f3169d9b700 1 -- 172.21.15.84:0/1665168830 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3160011d20 con 0x7f316c070710 2023-07-14T11:19:20.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.657+0000 7f31711ff700 1 -- 172.21.15.84:0/1665168830 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f316c070710 msgr2=0x7f316c0b4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:20.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.657+0000 7f31711ff700 1 --2- 172.21.15.84:0/1665168830 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f316c070710 0x7f316c0b4000 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3160009840 tx=0x7f3160009b50 comp rx=0 tx=0).stop 2023-07-14T11:19:20.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.657+0000 7f31711ff700 1 -- 172.21.15.84:0/1665168830 shutdown_connections 2023-07-14T11:19:20.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.657+0000 7f31711ff700 1 --2- 172.21.15.84:0/1665168830 >> v2:172.21.15.179:3300/0 conn(0x7f316c141ff0 0x7f316c158fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:20.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.657+0000 7f31711ff700 1 --2- 172.21.15.84:0/1665168830 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f316c070710 0x7f316c0b4000 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:20.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.657+0000 7f31711ff700 1 -- 172.21.15.84:0/1665168830 >> 172.21.15.84:0/1665168830 conn(0x7f316c069f30 msgr2=0x7f316c06a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:20.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.657+0000 7f31711ff700 1 -- 172.21.15.84:0/1665168830 shutdown_connections 2023-07-14T11:19:20.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.657+0000 7f31711ff700 1 -- 172.21.15.84:0/1665168830 wait complete. 2023-07-14T11:19:20.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.659+0000 7f31711ff700 1 Processor -- start 2023-07-14T11:19:20.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.659+0000 7f31711ff700 1 -- start start 2023-07-14T11:19:20.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.660+0000 7f31711ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f316c070710 0x7f316c135990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:20.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.660+0000 7f31711ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f316c0b1a70 0x7f316c1f0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:20.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.661+0000 7f31711ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f316c141ff0 0x7f316c1f0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:20.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.661+0000 7f31711ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f316c132d90 con 0x7f316c141ff0 2023-07-14T11:19:20.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.661+0000 7f31711ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f316c158c10 con 0x7f316c0b1a70 2023-07-14T11:19:20.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.661+0000 7f31711ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f316c1412a0 con 0x7f316c070710 2023-07-14T11:19:20.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.661+0000 7f316b59e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f316c141ff0 0x7f316c1f0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:20.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.661+0000 7f316b59e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f316c141ff0 0x7f316c1f0560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54024/0 (socket says 172.21.15.84:54024) 2023-07-14T11:19:20.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.661+0000 7f316b59e700 1 -- 172.21.15.84:0/3795987835 learned_addr learned my addr 172.21.15.84:0/3795987835 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:20.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.661+0000 7f316a59c700 1 --2- 172.21.15.84:0/3795987835 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f316c0b1a70 0x7f316c1f0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:20.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.661+0000 7f316ad9d700 1 --2- 172.21.15.84:0/3795987835 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f316c070710 0x7f316c135990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:20.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.661+0000 7f316b59e700 1 -- 172.21.15.84:0/3795987835 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f316c070710 msgr2=0x7f316c135990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:20.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.661+0000 7f316b59e700 1 --2- 172.21.15.84:0/3795987835 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f316c070710 0x7f316c135990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:20.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.661+0000 7f316b59e700 1 -- 172.21.15.84:0/3795987835 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f316c0b1a70 msgr2=0x7f316c1f0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:20.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.661+0000 7f316b59e700 1 --2- 172.21.15.84:0/3795987835 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f316c0b1a70 0x7f316c1f0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:20.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.661+0000 7f316b59e700 1 -- 172.21.15.84:0/3795987835 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f315c0094a0 con 0x7f316c141ff0 2023-07-14T11:19:20.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.661+0000 7f316a59c700 1 --2- 172.21.15.84:0/3795987835 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f316c0b1a70 0x7f316c1f0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:19:20.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.662+0000 7f316b59e700 1 --2- 172.21.15.84:0/3795987835 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f316c141ff0 0x7f316c1f0560 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f316400cb40 tx=0x7f316400cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:20.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.662+0000 7f31537fe700 1 -- 172.21.15.84:0/3795987835 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f316400ab50 con 0x7f316c141ff0 2023-07-14T11:19:20.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.662+0000 7f31537fe700 1 -- 172.21.15.84:0/3795987835 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f316400acb0 con 0x7f316c141ff0 2023-07-14T11:19:20.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.662+0000 7f31711ff700 1 -- 172.21.15.84:0/3795987835 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31600094a0 con 0x7f316c141ff0 2023-07-14T11:19:20.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.662+0000 7f31537fe700 1 -- 172.21.15.84:0/3795987835 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3164012620 con 0x7f316c141ff0 2023-07-14T11:19:20.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.662+0000 7f31711ff700 1 -- 172.21.15.84:0/3795987835 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f316c141860 con 0x7f316c141ff0 2023-07-14T11:19:20.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.663+0000 7f31711ff700 1 -- 172.21.15.84:0/3795987835 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f316c04e280 con 0x7f316c141ff0 2023-07-14T11:19:20.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.664+0000 7f31537fe700 1 -- 172.21.15.84:0/3795987835 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f316401b3b0 con 0x7f316c141ff0 2023-07-14T11:19:20.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.665+0000 7f31537fe700 1 --2- 172.21.15.84:0/3795987835 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f315806ae00 0x7f315806d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:20.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.665+0000 7f31537fe700 1 -- 172.21.15.84:0/3795987835 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f3164088e80 con 0x7f316c141ff0 2023-07-14T11:19:20.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.665+0000 7f316ad9d700 1 --2- 172.21.15.84:0/3795987835 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f315806ae00 0x7f315806d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:20.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.666+0000 7f316ad9d700 1 --2- 172.21.15.84:0/3795987835 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f315806ae00 0x7f315806d2b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f315c009d00 tx=0x7f315c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:20.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.669+0000 7f31537fe700 1 -- 172.21.15.84:0/3795987835 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3164054200 con 0x7f316c141ff0 2023-07-14T11:19:20.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.864+0000 7f31711ff700 1 -- 172.21.15.84:0/3795987835 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f316c0b4540 con 0x7f316c141ff0 2023-07-14T11:19:20.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.865+0000 7f31537fe700 1 -- 172.21.15.84:0/3795987835 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) v1 ==== 74+0+14617 (secure 0 0 0) 0x7f316c0b4540 con 0x7f316c141ff0 2023-07-14T11:19:20.868 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:19:20.868 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":102,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:19:19.935797+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:19:20.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.868+0000 7f31711ff700 1 -- 172.21.15.84:0/3795987835 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f315806ae00 msgr2=0x7f315806d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:20.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.868+0000 7f31711ff700 1 --2- 172.21.15.84:0/3795987835 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f315806ae00 0x7f315806d2b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f315c009d00 tx=0x7f315c008040 comp rx=0 tx=0).stop 2023-07-14T11:19:20.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.868+0000 7f31711ff700 1 -- 172.21.15.84:0/3795987835 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f316c141ff0 msgr2=0x7f316c1f0560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:20.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.868+0000 7f31711ff700 1 --2- 172.21.15.84:0/3795987835 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f316c141ff0 0x7f316c1f0560 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f316400cb40 tx=0x7f316400cf00 comp rx=0 tx=0).stop 2023-07-14T11:19:20.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.868+0000 7f31711ff700 1 -- 172.21.15.84:0/3795987835 shutdown_connections 2023-07-14T11:19:20.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.868+0000 7f31711ff700 1 --2- 172.21.15.84:0/3795987835 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f315806ae00 0x7f315806d2b0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:20.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.868+0000 7f31711ff700 1 --2- 172.21.15.84:0/3795987835 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f316c070710 0x7f316c135990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:20.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.868+0000 7f31711ff700 1 --2- 172.21.15.84:0/3795987835 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f316c141ff0 0x7f316c1f0560 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:20.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.868+0000 7f31711ff700 1 --2- 172.21.15.84:0/3795987835 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f316c0b1a70 0x7f316c1f0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:20.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.868+0000 7f31711ff700 1 -- 172.21.15.84:0/3795987835 >> 172.21.15.84:0/3795987835 conn(0x7f316c069f30 msgr2=0x7f316c073090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:20.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.868+0000 7f31711ff700 1 -- 172.21.15.84:0/3795987835 shutdown_connections 2023-07-14T11:19:20.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:20.868+0000 7f31711ff700 1 -- 172.21.15.84:0/3795987835 wait complete. 2023-07-14T11:19:20.889 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T11:13:00.125395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T11:13:06.803994+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T11:19:20.889 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T11:19:21.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.087+0000 7f8699fff700 1 Processor -- start 2023-07-14T11:19:21.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.087+0000 7f8699fff700 1 -- start start 2023-07-14T11:19:21.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.088+0000 7f8699fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86940d0f90 0x7f86940b1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:21.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.088+0000 7f8699fff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86940b8e30 con 0x7f86940d0b10 2023-07-14T11:19:21.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.088+0000 7f8699fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86940d1410 con 0x7f86940b8a60 2023-07-14T11:19:21.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.088+0000 7f8699fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86940afaa0 con 0x7f86940d0f90 2023-07-14T11:19:21.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.088+0000 7f8692ffd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f86940d0b10 0x7f86940b0e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50214/0 (socket says 172.21.15.84:50214) 2023-07-14T11:19:21.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.088+0000 7f8692ffd700 1 -- 172.21.15.84:0/4059309065 learned_addr learned my addr 172.21.15.84:0/4059309065 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:19:21.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.089+0000 7f8693fff700 1 --2- 172.21.15.84:0/4059309065 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86940d0f90 0x7f86940b1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:21.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.089+0000 7f86927fc700 1 -- 172.21.15.84:0/4059309065 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2211094683 0 0) 0x7f86940b8e30 con 0x7f86940d0b10 2023-07-14T11:19:21.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.089+0000 7f86927fc700 1 -- 172.21.15.84:0/4059309065 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f867c0035b0 con 0x7f86940d0b10 2023-07-14T11:19:21.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.089+0000 7f86927fc700 1 -- 172.21.15.84:0/4059309065 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3750887875 0 0) 0x7f86940d1410 con 0x7f86940b8a60 2023-07-14T11:19:21.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.089+0000 7f86927fc700 1 -- 172.21.15.84:0/4059309065 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86940b8e30 con 0x7f86940b8a60 2023-07-14T11:19:21.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.089+0000 7f8693fff700 1 -- 172.21.15.84:0/4059309065 >> v1:172.21.15.179:6789/0 conn(0x7f86940b8a60 legacy=0x7f86940b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:21.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.089+0000 7f8693fff700 1 -- 172.21.15.84:0/4059309065 >> v1:172.21.15.84:6789/0 conn(0x7f86940d0b10 legacy=0x7f86940b0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:21.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.089+0000 7f8693fff700 1 -- 172.21.15.84:0/4059309065 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86940afd80 con 0x7f86940d0f90 2023-07-14T11:19:21.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.089+0000 7f8693fff700 1 --2- 172.21.15.84:0/4059309065 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86940d0f90 0x7f86940b1530 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f868c009dc0 tx=0x7f868c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ce09dc589aa6d55 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:21.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.090+0000 7f86927fc700 1 -- 172.21.15.84:0/4059309065 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f868c00e070 con 0x7f86940d0f90 2023-07-14T11:19:21.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.090+0000 7f86927fc700 1 -- 172.21.15.84:0/4059309065 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f868c00bb20 con 0x7f86940d0f90 2023-07-14T11:19:21.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.090+0000 7f86927fc700 1 -- 172.21.15.84:0/4059309065 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f868c012430 con 0x7f86940d0f90 2023-07-14T11:19:21.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.090+0000 7f8699fff700 1 -- 172.21.15.84:0/4059309065 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86940d0f90 msgr2=0x7f86940b1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:21.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.090+0000 7f8699fff700 1 --2- 172.21.15.84:0/4059309065 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86940d0f90 0x7f86940b1530 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f868c009dc0 tx=0x7f868c00b330 comp rx=0 tx=0).stop 2023-07-14T11:19:21.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.090+0000 7f8699fff700 1 -- 172.21.15.84:0/4059309065 shutdown_connections 2023-07-14T11:19:21.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.090+0000 7f8699fff700 1 --2- 172.21.15.84:0/4059309065 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86940d0f90 0x7f86940b1530 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:21.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.090+0000 7f8699fff700 1 -- 172.21.15.84:0/4059309065 >> 172.21.15.84:0/4059309065 conn(0x7f869409c1b0 msgr2=0x7f86940d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:21.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.090+0000 7f8699fff700 1 -- 172.21.15.84:0/4059309065 shutdown_connections 2023-07-14T11:19:21.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.090+0000 7f8699fff700 1 -- 172.21.15.84:0/4059309065 wait complete. 2023-07-14T11:19:21.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.092+0000 7f8699fff700 1 Processor -- start 2023-07-14T11:19:21.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.092+0000 7f8699fff700 1 -- start start 2023-07-14T11:19:21.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.093+0000 7f8699fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86940b8a60 0x7f86940cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:21.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.093+0000 7f8699fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86940d0b10 0x7f86941f1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:21.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.093+0000 7f8699fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86940d0f90 0x7f86941f2400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:21.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.093+0000 7f8699fff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86940cdaa0 con 0x7f86940d0b10 2023-07-14T11:19:21.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.093+0000 7f8699fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86940cdd80 con 0x7f86940d0f90 2023-07-14T11:19:21.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.093+0000 7f8699fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86940ce060 con 0x7f86940b8a60 2023-07-14T11:19:21.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.093+0000 7f8692ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86940d0b10 0x7f86941f1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:21.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.093+0000 7f8692ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86940d0b10 0x7f86941f1ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54026/0 (socket says 172.21.15.84:54026) 2023-07-14T11:19:21.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.093+0000 7f8692ffd700 1 -- 172.21.15.84:0/1367701282 learned_addr learned my addr 172.21.15.84:0/1367701282 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:21.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.094+0000 7f86937fe700 1 --2- 172.21.15.84:0/1367701282 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86940b8a60 0x7f86940cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:21.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.094+0000 7f8693fff700 1 --2- 172.21.15.84:0/1367701282 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86940d0f90 0x7f86941f2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:21.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.094+0000 7f8692ffd700 1 -- 172.21.15.84:0/1367701282 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86940b8a60 msgr2=0x7f86940cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:21.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.094+0000 7f8692ffd700 1 --2- 172.21.15.84:0/1367701282 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86940b8a60 0x7f86940cfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:21.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.094+0000 7f8692ffd700 1 -- 172.21.15.84:0/1367701282 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86940d0f90 msgr2=0x7f86941f2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:21.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.094+0000 7f8692ffd700 1 --2- 172.21.15.84:0/1367701282 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86940d0f90 0x7f86941f2400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:21.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.094+0000 7f8692ffd700 1 -- 172.21.15.84:0/1367701282 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f868c009a70 con 0x7f86940d0b10 2023-07-14T11:19:21.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.094+0000 7f8692ffd700 1 --2- 172.21.15.84:0/1367701282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86940d0b10 0x7f86941f1ec0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f868800c700 tx=0x7f868800cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:21.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.094+0000 7f867bfff700 1 -- 172.21.15.84:0/1367701282 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8688005d70 con 0x7f86940d0b10 2023-07-14T11:19:21.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.094+0000 7f867bfff700 1 -- 172.21.15.84:0/1367701282 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86880070d0 con 0x7f86940d0b10 2023-07-14T11:19:21.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.094+0000 7f8699fff700 1 -- 172.21.15.84:0/1367701282 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86940ce340 con 0x7f86940d0b10 2023-07-14T11:19:21.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.094+0000 7f867bfff700 1 -- 172.21.15.84:0/1367701282 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8688007460 con 0x7f86940d0b10 2023-07-14T11:19:21.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.094+0000 7f8699fff700 1 -- 172.21.15.84:0/1367701282 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86940d0040 con 0x7f86940d0b10 2023-07-14T11:19:21.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.095+0000 7f8699fff700 1 -- 172.21.15.84:0/1367701282 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86940ce860 con 0x7f86940d0b10 2023-07-14T11:19:21.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.096+0000 7f867bfff700 1 -- 172.21.15.84:0/1367701282 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f86880075c0 con 0x7f86940d0b10 2023-07-14T11:19:21.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.098+0000 7f867bfff700 1 --2- 172.21.15.84:0/1367701282 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f868006ae00 0x7f868006d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:21.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.098+0000 7f867bfff700 1 -- 172.21.15.84:0/1367701282 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8688088970 con 0x7f86940d0b10 2023-07-14T11:19:21.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.098+0000 7f86937fe700 1 --2- 172.21.15.84:0/1367701282 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f868006ae00 0x7f868006d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:21.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.099+0000 7f86937fe700 1 --2- 172.21.15.84:0/1367701282 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f868006ae00 0x7f868006d2b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8684001220 tx=0x7f8684009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:21.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.102+0000 7f867bfff700 1 -- 172.21.15.84:0/1367701282 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f86940ce860 con 0x7f86940d0b10 2023-07-14T11:19:21.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.292+0000 7f8699fff700 1 -- 172.21.15.84:0/1367701282 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f86940ce860 con 0x7f86940d0b10 2023-07-14T11:19:21.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.293+0000 7f867bfff700 1 -- 172.21.15.84:0/1367701282 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v102) v1 ==== 93+0+10 (secure 0 0 0) 0x7f86940ce860 con 0x7f86940d0b10 2023-07-14T11:19:21.295 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-07-14T11:19:21.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.295+0000 7f8699fff700 1 -- 172.21.15.84:0/1367701282 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f868006ae00 msgr2=0x7f868006d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:21.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.295+0000 7f8699fff700 1 --2- 172.21.15.84:0/1367701282 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f868006ae00 0x7f868006d2b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8684001220 tx=0x7f8684009040 comp rx=0 tx=0).stop 2023-07-14T11:19:21.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.295+0000 7f8699fff700 1 -- 172.21.15.84:0/1367701282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86940d0b10 msgr2=0x7f86941f1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:21.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.295+0000 7f8699fff700 1 --2- 172.21.15.84:0/1367701282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86940d0b10 0x7f86941f1ec0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f868800c700 tx=0x7f868800cac0 comp rx=0 tx=0).stop 2023-07-14T11:19:21.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.295+0000 7f8699fff700 1 -- 172.21.15.84:0/1367701282 shutdown_connections 2023-07-14T11:19:21.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.295+0000 7f8699fff700 1 --2- 172.21.15.84:0/1367701282 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f868006ae00 0x7f868006d2b0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:21.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.295+0000 7f8699fff700 1 --2- 172.21.15.84:0/1367701282 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86940b8a60 0x7f86940cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:21.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.295+0000 7f8699fff700 1 --2- 172.21.15.84:0/1367701282 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86940d0f90 0x7f86941f2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:21.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.295+0000 7f8699fff700 1 --2- 172.21.15.84:0/1367701282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86940d0b10 0x7f86941f1ec0 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:21.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.295+0000 7f8699fff700 1 -- 172.21.15.84:0/1367701282 >> 172.21.15.84:0/1367701282 conn(0x7f869409c1b0 msgr2=0x7f869406b600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:21.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.295+0000 7f8699fff700 1 -- 172.21.15.84:0/1367701282 shutdown_connections 2023-07-14T11:19:21.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.295+0000 7f8699fff700 1 -- 172.21.15.84:0/1367701282 wait complete. 2023-07-14T11:19:21.316 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T11:19:21.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.512+0000 7f3b5fdff700 1 Processor -- start 2023-07-14T11:19:21.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.512+0000 7f3b5fdff700 1 -- start start 2023-07-14T11:19:21.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.513+0000 7f3b5fdff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b580b8660 0x7f3b580cd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:21.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.513+0000 7f3b5fdff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3b580b4f70 0x7f3b580d12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:21.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.513+0000 7f3b5fdff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b580d02a0 con 0x7f3b580cd970 2023-07-14T11:19:21.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.513+0000 7f3b5fdff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b580cfce0 con 0x7f3b580b4f70 2023-07-14T11:19:21.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.513+0000 7f3b5fdff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b580cffc0 con 0x7f3b580b8660 2023-07-14T11:19:21.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.514+0000 7f3b5d39a700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f3b580cd970 0x7f3b580b4860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50230/0 (socket says 172.21.15.84:50230) 2023-07-14T11:19:21.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.514+0000 7f3b5d39a700 1 -- 172.21.15.84:0/770561942 learned_addr learned my addr 172.21.15.84:0/770561942 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:19:21.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.514+0000 7f3b5e39c700 1 --2- 172.21.15.84:0/770561942 >> v2:172.21.15.179:3300/0 conn(0x7f3b580b4f70 0x7f3b580d12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:21.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.514+0000 7f3b5db9b700 1 --2- 172.21.15.84:0/770561942 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b580b8660 0x7f3b580cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:21.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.514+0000 7f3b5cb99700 1 -- 172.21.15.84:0/770561942 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4103250571 0 0) 0x7f3b580d02a0 con 0x7f3b580cd970 2023-07-14T11:19:21.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.514+0000 7f3b5cb99700 1 -- 172.21.15.84:0/770561942 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b440035b0 con 0x7f3b580cd970 2023-07-14T11:19:21.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.514+0000 7f3b5cb99700 1 -- 172.21.15.84:0/770561942 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 686752960 0 0) 0x7f3b440035b0 con 0x7f3b580cd970 2023-07-14T11:19:21.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.514+0000 7f3b5cb99700 1 -- 172.21.15.84:0/770561942 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b580b8660 msgr2=0x7f3b580cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:21.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.514+0000 7f3b5cb99700 1 --2- 172.21.15.84:0/770561942 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b580b8660 0x7f3b580cd430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:21.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.514+0000 7f3b5cb99700 1 -- 172.21.15.84:0/770561942 >> v2:172.21.15.179:3300/0 conn(0x7f3b580b4f70 msgr2=0x7f3b580d12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:21.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.514+0000 7f3b5cb99700 1 --2- 172.21.15.84:0/770561942 >> v2:172.21.15.179:3300/0 conn(0x7f3b580b4f70 0x7f3b580d12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:21.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.514+0000 7f3b5cb99700 1 -- 172.21.15.84:0/770561942 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b580d0ac0 con 0x7f3b580cd970 2023-07-14T11:19:21.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.514+0000 7f3b5cb99700 1 -- 172.21.15.84:0/770561942 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7f3b48001670 con 0x7f3b580cd970 2023-07-14T11:19:21.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.515+0000 7f3b5cb99700 1 -- 172.21.15.84:0/770561942 >> v1:172.21.15.84:6789/0 conn(0x7f3b580cd970 legacy=0x7f3b580b4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:21.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.515+0000 7f3b5cb99700 1 --2- 172.21.15.84:0/770561942 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b44003a00 0x7f3b44003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:21.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.515+0000 7f3b5cb99700 1 --2- 172.21.15.84:0/770561942 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b580b8660 0x7f3b44004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:21.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.515+0000 7f3b5cb99700 1 --2- 172.21.15.84:0/770561942 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b44004d90 0x7f3b44005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:21.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.515+0000 7f3b5cb99700 1 -- 172.21.15.84:0/770561942 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b580cfce0 con 0x7f3b44003a00 2023-07-14T11:19:21.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.515+0000 7f3b5cb99700 1 -- 172.21.15.84:0/770561942 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b580cffc0 con 0x7f3b44004d90 2023-07-14T11:19:21.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.515+0000 7f3b5cb99700 1 -- 172.21.15.84:0/770561942 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b4400ba10 con 0x7f3b580b8660 2023-07-14T11:19:21.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.515+0000 7f3b5db9b700 1 --2- 172.21.15.84:0/770561942 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b44003a00 0x7f3b44003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:21.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.515+0000 7f3b5e39c700 1 --2- 172.21.15.84:0/770561942 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b44004d90 0x7f3b44005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:21.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.515+0000 7f3b5d39a700 1 --2- 172.21.15.84:0/770561942 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b580b8660 0x7f3b44004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:21.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.515+0000 7f3b5db9b700 1 -- 172.21.15.84:0/770561942 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b580b8660 msgr2=0x7f3b44004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:21.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.515+0000 7f3b5db9b700 1 --2- 172.21.15.84:0/770561942 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b580b8660 0x7f3b44004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:21.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.515+0000 7f3b5db9b700 1 -- 172.21.15.84:0/770561942 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b44004d90 msgr2=0x7f3b44005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:21.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.515+0000 7f3b5db9b700 1 --2- 172.21.15.84:0/770561942 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b44004d90 0x7f3b44005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:21.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.515+0000 7f3b5db9b700 1 -- 172.21.15.84:0/770561942 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b440035b0 con 0x7f3b44003a00 2023-07-14T11:19:21.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.515+0000 7f3b5e39c700 1 --2- 172.21.15.84:0/770561942 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b44004d90 0x7f3b44005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:19:21.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.515+0000 7f3b5db9b700 1 --2- 172.21.15.84:0/770561942 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b44003a00 0x7f3b44003e10 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f3b54009b60 tx=0x7f3b44005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a562f839f3a4259a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:21.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.516+0000 7f3b5cb99700 1 -- 172.21.15.84:0/770561942 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5400e660 con 0x7f3b44003a00 2023-07-14T11:19:21.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.516+0000 7f3b5cb99700 1 -- 172.21.15.84:0/770561942 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b5400e7c0 con 0x7f3b44003a00 2023-07-14T11:19:21.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.516+0000 7f3b5cb99700 1 -- 172.21.15.84:0/770561942 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5400eb30 con 0x7f3b44003a00 2023-07-14T11:19:21.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.516+0000 7f3b5fdff700 1 -- 172.21.15.84:0/770561942 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b44003a00 msgr2=0x7f3b44003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:21.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.516+0000 7f3b5fdff700 1 --2- 172.21.15.84:0/770561942 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b44003a00 0x7f3b44003e10 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f3b54009b60 tx=0x7f3b44005880 comp rx=0 tx=0).stop 2023-07-14T11:19:21.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.516+0000 7f3b5e39c700 1 -- 172.21.15.84:0/770561942 reap_dead start 2023-07-14T11:19:21.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.516+0000 7f3b5fdff700 1 -- 172.21.15.84:0/770561942 shutdown_connections 2023-07-14T11:19:21.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.516+0000 7f3b5fdff700 1 -- 172.21.15.84:0/770561942 >> 172.21.15.84:0/770561942 conn(0x7f3b58066860 msgr2=0x7f3b5806a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:21.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.516+0000 7f3b5fdff700 1 -- 172.21.15.84:0/770561942 shutdown_connections 2023-07-14T11:19:21.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.516+0000 7f3b5fdff700 1 -- 172.21.15.84:0/770561942 wait complete. 2023-07-14T11:19:21.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.518+0000 7f3b5fdff700 1 Processor -- start 2023-07-14T11:19:21.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.518+0000 7f3b5fdff700 1 -- start start 2023-07-14T11:19:21.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.519+0000 7f3b5fdff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b44003a00 0x7f3b5814d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:21.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.519+0000 7f3b5fdff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b581e6dc0 0x7f3b580c8920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:21.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.519+0000 7f3b5fdff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b581e7230 0x7f3b580c8e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:21.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.519+0000 7f3b5fdff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b581e7780 con 0x7f3b44003a00 2023-07-14T11:19:21.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.519+0000 7f3b5fdff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b581e7a60 con 0x7f3b581e6dc0 2023-07-14T11:19:21.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.519+0000 7f3b5fdff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b580c9f50 con 0x7f3b581e7230 2023-07-14T11:19:21.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.519+0000 7f3b5db9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b44003a00 0x7f3b5814d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:21.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.519+0000 7f3b5db9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b44003a00 0x7f3b5814d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54046/0 (socket says 172.21.15.84:54046) 2023-07-14T11:19:21.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.519+0000 7f3b5db9b700 1 -- 172.21.15.84:0/1359939810 learned_addr learned my addr 172.21.15.84:0/1359939810 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:21.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.520+0000 7f3b5e39c700 1 --2- 172.21.15.84:0/1359939810 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b581e7230 0x7f3b580c8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:21.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.520+0000 7f3b5d39a700 1 --2- 172.21.15.84:0/1359939810 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b581e6dc0 0x7f3b580c8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:21.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.520+0000 7f3b5db9b700 1 -- 172.21.15.84:0/1359939810 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b581e7230 msgr2=0x7f3b580c8e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:21.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.520+0000 7f3b5db9b700 1 --2- 172.21.15.84:0/1359939810 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b581e7230 0x7f3b580c8e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:21.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.520+0000 7f3b5db9b700 1 -- 172.21.15.84:0/1359939810 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b581e6dc0 msgr2=0x7f3b580c8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:21.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.520+0000 7f3b5db9b700 1 --2- 172.21.15.84:0/1359939810 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b581e6dc0 0x7f3b580c8920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:21.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.520+0000 7f3b5db9b700 1 -- 172.21.15.84:0/1359939810 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b580ca230 con 0x7f3b44003a00 2023-07-14T11:19:21.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.520+0000 7f3b5db9b700 1 --2- 172.21.15.84:0/1359939810 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b44003a00 0x7f3b5814d290 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f3b440046d0 tx=0x7f3b540047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:21.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.520+0000 7f3b4e7fc700 1 -- 172.21.15.84:0/1359939810 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5400e660 con 0x7f3b44003a00 2023-07-14T11:19:21.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.520+0000 7f3b4e7fc700 1 -- 172.21.15.84:0/1359939810 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b54003ab0 con 0x7f3b44003a00 2023-07-14T11:19:21.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.520+0000 7f3b4e7fc700 1 -- 172.21.15.84:0/1359939810 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b54003e60 con 0x7f3b44003a00 2023-07-14T11:19:21.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.520+0000 7f3b5fdff700 1 -- 172.21.15.84:0/1359939810 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b5814d7d0 con 0x7f3b44003a00 2023-07-14T11:19:21.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.521+0000 7f3b5fdff700 1 -- 172.21.15.84:0/1359939810 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b581e2600 con 0x7f3b44003a00 2023-07-14T11:19:21.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.521+0000 7f3b5fdff700 1 -- 172.21.15.84:0/1359939810 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b58074350 con 0x7f3b44003a00 2023-07-14T11:19:21.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.522+0000 7f3b4e7fc700 1 -- 172.21.15.84:0/1359939810 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f3b54013470 con 0x7f3b44003a00 2023-07-14T11:19:21.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.523+0000 7f3b4e7fc700 1 --2- 172.21.15.84:0/1359939810 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f3b3c06ae00 0x7f3b3c06d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:21.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.523+0000 7f3b4e7fc700 1 -- 172.21.15.84:0/1359939810 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f3b5408ab20 con 0x7f3b44003a00 2023-07-14T11:19:21.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.524+0000 7f3b5d39a700 1 --2- 172.21.15.84:0/1359939810 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f3b3c06ae00 0x7f3b3c06d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:21.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.524+0000 7f3b5d39a700 1 --2- 172.21.15.84:0/1359939810 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f3b3c06ae00 0x7f3b3c06d2b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3b48001050 tx=0x7f3b48009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:21.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.527+0000 7f3b4e7fc700 1 -- 172.21.15.84:0/1359939810 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3b54055f20 con 0x7f3b44003a00 2023-07-14T11:19:21.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.719+0000 7f3b5fdff700 1 -- 172.21.15.84:0/1359939810 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3b580b2150 con 0x7f3b44003a00 2023-07-14T11:19:21.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.719+0000 7f3b4e7fc700 1 -- 172.21.15.84:0/1359939810 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v102) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3b54059540 con 0x7f3b44003a00 2023-07-14T11:19:21.722 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-07-14T11:19:21.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.721+0000 7f3b5fdff700 1 -- 172.21.15.84:0/1359939810 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f3b3c06ae00 msgr2=0x7f3b3c06d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:21.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.721+0000 7f3b5fdff700 1 --2- 172.21.15.84:0/1359939810 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f3b3c06ae00 0x7f3b3c06d2b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3b48001050 tx=0x7f3b48009040 comp rx=0 tx=0).stop 2023-07-14T11:19:21.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.721+0000 7f3b5fdff700 1 -- 172.21.15.84:0/1359939810 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b44003a00 msgr2=0x7f3b5814d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:21.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.721+0000 7f3b5fdff700 1 --2- 172.21.15.84:0/1359939810 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b44003a00 0x7f3b5814d290 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f3b440046d0 tx=0x7f3b540047c0 comp rx=0 tx=0).stop 2023-07-14T11:19:21.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.721+0000 7f3b5fdff700 1 -- 172.21.15.84:0/1359939810 shutdown_connections 2023-07-14T11:19:21.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.721+0000 7f3b5fdff700 1 --2- 172.21.15.84:0/1359939810 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f3b3c06ae00 0x7f3b3c06d2b0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:21.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.721+0000 7f3b5fdff700 1 --2- 172.21.15.84:0/1359939810 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b581e7230 0x7f3b580c8e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:21.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.721+0000 7f3b5fdff700 1 --2- 172.21.15.84:0/1359939810 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b44003a00 0x7f3b5814d290 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:21.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.721+0000 7f3b5fdff700 1 --2- 172.21.15.84:0/1359939810 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b581e6dc0 0x7f3b580c8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:21.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.721+0000 7f3b5fdff700 1 -- 172.21.15.84:0/1359939810 >> 172.21.15.84:0/1359939810 conn(0x7f3b58066860 msgr2=0x7f3b580d11c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:21.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.721+0000 7f3b5fdff700 1 -- 172.21.15.84:0/1359939810 shutdown_connections 2023-07-14T11:19:21.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.722+0000 7f3b5fdff700 1 -- 172.21.15.84:0/1359939810 wait complete. 2023-07-14T11:19:21.742 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-14T11:19:21.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.936+0000 7f75063ff700 1 Processor -- start 2023-07-14T11:19:21.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.936+0000 7f75063ff700 1 -- start start 2023-07-14T11:19:21.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.937+0000 7f75063ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f750015c950 0x7f75000b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:21.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.937+0000 7f75063ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75000d1220 0x7f75000afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:21.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.937+0000 7f75063ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75000d2ce0 con 0x7f75000b1e00 2023-07-14T11:19:21.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.937+0000 7f75063ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75000b3350 con 0x7f750015c950 2023-07-14T11:19:21.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.937+0000 7f75063ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75000b3630 con 0x7f75000d1220 2023-07-14T11:19:21.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.937+0000 7f74fffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f750015c950 0x7f75000b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:21.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.937+0000 7f74fffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f750015c950 0x7f75000b43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54052/0 (socket says 172.21.15.84:54052) 2023-07-14T11:19:21.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.937+0000 7f74fffff700 1 -- 172.21.15.84:0/3404683658 learned_addr learned my addr 172.21.15.84:0/3404683658 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:21.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.938+0000 7f750499c700 1 --2- 172.21.15.84:0/3404683658 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75000d1220 0x7f75000afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:21.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.938+0000 7f74fffff700 1 -- 172.21.15.84:0/3404683658 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75000d1220 msgr2=0x7f75000afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:21.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.938+0000 7f74fffff700 1 --2- 172.21.15.84:0/3404683658 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75000d1220 0x7f75000afac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:21.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.938+0000 7f74fffff700 1 -- 172.21.15.84:0/3404683658 >> v1:172.21.15.179:6789/0 conn(0x7f75000b1e00 legacy=0x7f75000d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:21.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.938+0000 7f74fffff700 1 -- 172.21.15.84:0/3404683658 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75000b3910 con 0x7f750015c950 2023-07-14T11:19:21.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.938+0000 7f74fffff700 1 --2- 172.21.15.84:0/3404683658 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f750015c950 0x7f75000b43f0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f74f0006fd0 tx=0x7f74f0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73bdfb1cac6beab4 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:21.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.938+0000 7f74feffd700 1 -- 172.21.15.84:0/3404683658 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f0005e30 con 0x7f750015c950 2023-07-14T11:19:21.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.938+0000 7f74feffd700 1 -- 172.21.15.84:0/3404683658 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74f0004030 con 0x7f750015c950 2023-07-14T11:19:21.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.938+0000 7f74feffd700 1 -- 172.21.15.84:0/3404683658 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f00043e0 con 0x7f750015c950 2023-07-14T11:19:21.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.939+0000 7f75063ff700 1 -- 172.21.15.84:0/3404683658 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f750015c950 msgr2=0x7f75000b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:21.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.939+0000 7f75063ff700 1 --2- 172.21.15.84:0/3404683658 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f750015c950 0x7f75000b43f0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f74f0006fd0 tx=0x7f74f0009bd0 comp rx=0 tx=0).stop 2023-07-14T11:19:21.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.939+0000 7f75063ff700 1 -- 172.21.15.84:0/3404683658 shutdown_connections 2023-07-14T11:19:21.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.939+0000 7f75063ff700 1 --2- 172.21.15.84:0/3404683658 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75000d1220 0x7f75000afac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:21.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.939+0000 7f75063ff700 1 --2- 172.21.15.84:0/3404683658 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f750015c950 0x7f75000b43f0 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:21.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.939+0000 7f75063ff700 1 -- 172.21.15.84:0/3404683658 >> 172.21.15.84:0/3404683658 conn(0x7f750009c1d0 msgr2=0x7f75000d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:21.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.939+0000 7f75063ff700 1 -- 172.21.15.84:0/3404683658 shutdown_connections 2023-07-14T11:19:21.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.939+0000 7f75063ff700 1 -- 172.21.15.84:0/3404683658 wait complete. 2023-07-14T11:19:21.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.941+0000 7f75063ff700 1 Processor -- start 2023-07-14T11:19:21.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.941+0000 7f75063ff700 1 -- start start 2023-07-14T11:19:21.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.942+0000 7f75063ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75000b1e00 0x7f75001f2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:21.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.942+0000 7f75063ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75000d1220 0x7f7500151d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:21.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.942+0000 7f75063ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f750015c950 0x7f75000c7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:21.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.942+0000 7f75063ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7500152290 con 0x7f750015c950 2023-07-14T11:19:21.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.942+0000 7f75063ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75000cd610 con 0x7f75000b1e00 2023-07-14T11:19:21.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.942+0000 7f75063ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75000cd8f0 con 0x7f75000d1220 2023-07-14T11:19:21.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.942+0000 7f750499c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f750015c950 0x7f75000c7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:21.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.942+0000 7f750499c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f750015c950 0x7f75000c7c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54060/0 (socket says 172.21.15.84:54060) 2023-07-14T11:19:21.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.942+0000 7f750499c700 1 -- 172.21.15.84:0/2857037466 learned_addr learned my addr 172.21.15.84:0/2857037466 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:21.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.942+0000 7f74fffff700 1 --2- 172.21.15.84:0/2857037466 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75000b1e00 0x7f75001f2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:21.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.942+0000 7f74ff7fe700 1 --2- 172.21.15.84:0/2857037466 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75000d1220 0x7f7500151d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:21.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.943+0000 7f750499c700 1 -- 172.21.15.84:0/2857037466 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75000d1220 msgr2=0x7f7500151d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:21.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.943+0000 7f750499c700 1 --2- 172.21.15.84:0/2857037466 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75000d1220 0x7f7500151d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:21.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.943+0000 7f750499c700 1 -- 172.21.15.84:0/2857037466 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75000b1e00 msgr2=0x7f75001f2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:21.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.943+0000 7f750499c700 1 --2- 172.21.15.84:0/2857037466 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75000b1e00 0x7f75001f2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:21.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.943+0000 7f750499c700 1 -- 172.21.15.84:0/2857037466 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74f0009500 con 0x7f750015c950 2023-07-14T11:19:21.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.943+0000 7f74fffff700 1 --2- 172.21.15.84:0/2857037466 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75000b1e00 0x7f75001f2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:19:21.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.943+0000 7f750499c700 1 --2- 172.21.15.84:0/2857037466 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f750015c950 0x7f75000c7c90 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f74f8007e40 tx=0x7f74f800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:21.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.943+0000 7f74fcff9700 1 -- 172.21.15.84:0/2857037466 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f800eea0 con 0x7f750015c950 2023-07-14T11:19:21.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.943+0000 7f74fcff9700 1 -- 172.21.15.84:0/2857037466 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74f8014420 con 0x7f750015c950 2023-07-14T11:19:21.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.943+0000 7f75063ff700 1 -- 172.21.15.84:0/2857037466 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75000cdbd0 con 0x7f750015c950 2023-07-14T11:19:21.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.943+0000 7f74fcff9700 1 -- 172.21.15.84:0/2857037466 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f80147b0 con 0x7f750015c950 2023-07-14T11:19:21.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.943+0000 7f75063ff700 1 -- 172.21.15.84:0/2857037466 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75000ce190 con 0x7f750015c950 2023-07-14T11:19:21.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.944+0000 7f75063ff700 1 -- 172.21.15.84:0/2857037466 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75000723e0 con 0x7f750015c950 2023-07-14T11:19:21.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.945+0000 7f74fcff9700 1 -- 172.21.15.84:0/2857037466 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f74f8014910 con 0x7f750015c950 2023-07-14T11:19:21.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.946+0000 7f74fcff9700 1 --2- 172.21.15.84:0/2857037466 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f74ec06ae00 0x7f74ec06d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:21.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.946+0000 7f74fcff9700 1 -- 172.21.15.84:0/2857037466 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f74f8089b60 con 0x7f750015c950 2023-07-14T11:19:21.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.947+0000 7f74fffff700 1 --2- 172.21.15.84:0/2857037466 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f74ec06ae00 0x7f74ec06d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:21.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.947+0000 7f74fffff700 1 --2- 172.21.15.84:0/2857037466 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f74ec06ae00 0x7f74ec06d2b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f74f0009c10 tx=0x7f74f0008070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:21.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:21.950+0000 7f74fcff9700 1 -- 172.21.15.84:0/2857037466 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f74f8054db0 con 0x7f750015c950 2023-07-14T11:19:22.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.151+0000 7f75063ff700 1 -- 172.21.15.84:0/2857037466 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f750008c5a0 con 0x7f750015c950 2023-07-14T11:19:22.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.151+0000 7f74fcff9700 1 -- 172.21.15.84:0/2857037466 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v102) v1 ==== 84+0+126 (secure 0 0 0) 0x7f74f80583d0 con 0x7f750015c950 2023-07-14T11:19:22.154 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:19:22.154 INFO:teuthology.orchestra.run.smithi084.stdout:[ 2023-07-14T11:19:22.154 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:19:22.154 INFO:teuthology.orchestra.run.smithi084.stdout: "poolnum": 1, 2023-07-14T11:19:22.154 INFO:teuthology.orchestra.run.smithi084.stdout: "poolname": ".mgr" 2023-07-14T11:19:22.155 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-07-14T11:19:22.155 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:19:22.155 INFO:teuthology.orchestra.run.smithi084.stdout: "poolnum": 2, 2023-07-14T11:19:22.155 INFO:teuthology.orchestra.run.smithi084.stdout: "poolname": "rbd" 2023-07-14T11:19:22.155 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:19:22.155 INFO:teuthology.orchestra.run.smithi084.stdout:] 2023-07-14T11:19:22.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.153+0000 7f75063ff700 1 -- 172.21.15.84:0/2857037466 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f74ec06ae00 msgr2=0x7f74ec06d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:22.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.153+0000 7f75063ff700 1 --2- 172.21.15.84:0/2857037466 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f74ec06ae00 0x7f74ec06d2b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f74f0009c10 tx=0x7f74f0008070 comp rx=0 tx=0).stop 2023-07-14T11:19:22.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.153+0000 7f75063ff700 1 -- 172.21.15.84:0/2857037466 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f750015c950 msgr2=0x7f75000c7c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:22.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.153+0000 7f75063ff700 1 --2- 172.21.15.84:0/2857037466 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f750015c950 0x7f75000c7c90 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f74f8007e40 tx=0x7f74f800e3c0 comp rx=0 tx=0).stop 2023-07-14T11:19:22.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.154+0000 7f75063ff700 1 -- 172.21.15.84:0/2857037466 shutdown_connections 2023-07-14T11:19:22.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.154+0000 7f75063ff700 1 --2- 172.21.15.84:0/2857037466 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f750015c950 0x7f75000c7c90 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:22.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.154+0000 7f75063ff700 1 --2- 172.21.15.84:0/2857037466 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75000b1e00 0x7f75001f2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:22.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.154+0000 7f75063ff700 1 --2- 172.21.15.84:0/2857037466 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f74ec06ae00 0x7f74ec06d2b0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:22.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.154+0000 7f75063ff700 1 --2- 172.21.15.84:0/2857037466 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75000d1220 0x7f7500151d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:22.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.154+0000 7f75063ff700 1 -- 172.21.15.84:0/2857037466 >> 172.21.15.84:0/2857037466 conn(0x7f750009c1d0 msgr2=0x7f75000b8300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:22.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.154+0000 7f75063ff700 1 -- 172.21.15.84:0/2857037466 shutdown_connections 2023-07-14T11:19:22.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.154+0000 7f75063ff700 1 -- 172.21.15.84:0/2857037466 wait complete. 2023-07-14T11:19:22.174 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-14T11:19:22.174 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-14T11:19:22.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.369+0000 7f85549ff700 1 Processor -- start 2023-07-14T11:19:22.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.369+0000 7f85549ff700 1 -- start start 2023-07-14T11:19:22.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.371+0000 7f85549ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f855015c890 0x7f85500d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:22.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.371+0000 7f85549ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f85500b2440 0x7f85500d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:22.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.371+0000 7f85549ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f855006c240 0x7f85500cf840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:22.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.371+0000 7f85549ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f855015cc60 con 0x7f85500b2440 2023-07-14T11:19:22.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.371+0000 7f85549ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f855006a7f0 con 0x7f855006c240 2023-07-14T11:19:22.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.371+0000 7f85549ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f855006b760 con 0x7f855015c890 2023-07-14T11:19:22.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.371+0000 7f8547fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f85500b2440 0x7f85500d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:22.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.371+0000 7f8547fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f85500b2440 0x7f85500d0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54064/0 (socket says 172.21.15.84:54064) 2023-07-14T11:19:22.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.371+0000 7f8547fff700 1 -- 172.21.15.84:0/2862045977 learned_addr learned my addr 172.21.15.84:0/2862045977 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:22.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.371+0000 7f8547fff700 1 -- 172.21.15.84:0/2862045977 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f855015c890 msgr2=0x7f85500d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:22.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.371+0000 7f854e59c700 1 --2- 172.21.15.84:0/2862045977 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f855015c890 0x7f85500d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:22.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.371+0000 7f854ed9d700 1 --2- 172.21.15.84:0/2862045977 >> v2:172.21.15.179:3300/0 conn(0x7f855006c240 0x7f85500cf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:22.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.371+0000 7f8547fff700 1 --2- 172.21.15.84:0/2862045977 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f855015c890 0x7f85500d0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:22.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.371+0000 7f8547fff700 1 -- 172.21.15.84:0/2862045977 >> v2:172.21.15.179:3300/0 conn(0x7f855006c240 msgr2=0x7f85500cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:22.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.371+0000 7f8547fff700 1 --2- 172.21.15.84:0/2862045977 >> v2:172.21.15.179:3300/0 conn(0x7f855006c240 0x7f85500cf840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:22.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.371+0000 7f8547fff700 1 -- 172.21.15.84:0/2862045977 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f855006ba40 con 0x7f85500b2440 2023-07-14T11:19:22.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.372+0000 7f8547fff700 1 --2- 172.21.15.84:0/2862045977 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85500b2440 0x7f85500d0f90 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f855008d330 tx=0x7f8538009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b279b7d3604321e6 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:22.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.372+0000 7f854dd9b700 1 -- 172.21.15.84:0/2862045977 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853800b870 con 0x7f85500b2440 2023-07-14T11:19:22.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.372+0000 7f854dd9b700 1 -- 172.21.15.84:0/2862045977 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f853800b9d0 con 0x7f85500b2440 2023-07-14T11:19:22.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.372+0000 7f854dd9b700 1 -- 172.21.15.84:0/2862045977 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853800bd60 con 0x7f85500b2440 2023-07-14T11:19:22.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.372+0000 7f85549ff700 1 -- 172.21.15.84:0/2862045977 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85500b2440 msgr2=0x7f85500d0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:22.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.372+0000 7f85549ff700 1 --2- 172.21.15.84:0/2862045977 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85500b2440 0x7f85500d0f90 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f855008d330 tx=0x7f8538009bd0 comp rx=0 tx=0).stop 2023-07-14T11:19:22.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.373+0000 7f85549ff700 1 -- 172.21.15.84:0/2862045977 shutdown_connections 2023-07-14T11:19:22.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.373+0000 7f85549ff700 1 --2- 172.21.15.84:0/2862045977 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f855015c890 0x7f85500d0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:22.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.373+0000 7f85549ff700 1 --2- 172.21.15.84:0/2862045977 >> v2:172.21.15.179:3300/0 conn(0x7f855006c240 0x7f85500cf840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:22.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.373+0000 7f85549ff700 1 --2- 172.21.15.84:0/2862045977 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85500b2440 0x7f85500d0f90 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:22.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.373+0000 7f85549ff700 1 -- 172.21.15.84:0/2862045977 >> 172.21.15.84:0/2862045977 conn(0x7f855009c170 msgr2=0x7f85500d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:22.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.373+0000 7f85549ff700 1 -- 172.21.15.84:0/2862045977 shutdown_connections 2023-07-14T11:19:22.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.373+0000 7f85549ff700 1 -- 172.21.15.84:0/2862045977 wait complete. 2023-07-14T11:19:22.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.374+0000 7f85549ff700 1 Processor -- start 2023-07-14T11:19:22.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.374+0000 7f85549ff700 1 -- start start 2023-07-14T11:19:22.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.375+0000 7f85549ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f855006c240 0x7f85500c9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:22.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.375+0000 7f85549ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85500b2440 0x7f85501f3020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:22.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.375+0000 7f85549ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f855015c890 0x7f855015d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:22.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.375+0000 7f85549ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85500c9970 con 0x7f855006c240 2023-07-14T11:19:22.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.375+0000 7f85549ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85500b5cb0 con 0x7f855015c890 2023-07-14T11:19:22.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.375+0000 7f85549ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85500b5f90 con 0x7f85500b2440 2023-07-14T11:19:22.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.376+0000 7f854e59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f855006c240 0x7f85500c9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:22.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.376+0000 7f854e59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f855006c240 0x7f85500c9430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54076/0 (socket says 172.21.15.84:54076) 2023-07-14T11:19:22.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.376+0000 7f854e59c700 1 -- 172.21.15.84:0/545469069 learned_addr learned my addr 172.21.15.84:0/545469069 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:22.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.376+0000 7f8547fff700 1 --2- 172.21.15.84:0/545469069 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85500b2440 0x7f85501f3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:22.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.376+0000 7f854ed9d700 1 --2- 172.21.15.84:0/545469069 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f855015c890 0x7f855015d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:22.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.376+0000 7f854e59c700 1 -- 172.21.15.84:0/545469069 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85500b2440 msgr2=0x7f85501f3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:22.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.376+0000 7f854e59c700 1 --2- 172.21.15.84:0/545469069 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85500b2440 0x7f85501f3020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:22.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.376+0000 7f854e59c700 1 -- 172.21.15.84:0/545469069 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f855015c890 msgr2=0x7f855015d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:22.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.376+0000 7f854e59c700 1 --2- 172.21.15.84:0/545469069 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f855015c890 0x7f855015d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:22.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.376+0000 7f854e59c700 1 -- 172.21.15.84:0/545469069 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8538009550 con 0x7f855006c240 2023-07-14T11:19:22.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.376+0000 7f854ed9d700 1 --2- 172.21.15.84:0/545469069 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f855015c890 0x7f855015d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:19:22.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.376+0000 7f854e59c700 1 --2- 172.21.15.84:0/545469069 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f855006c240 0x7f85500c9430 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f854000c7f0 tx=0x7f854000cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:22.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.376+0000 7f8546ffd700 1 -- 172.21.15.84:0/545469069 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8540011800 con 0x7f855006c240 2023-07-14T11:19:22.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.376+0000 7f8546ffd700 1 -- 172.21.15.84:0/545469069 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8540011960 con 0x7f855006c240 2023-07-14T11:19:22.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.377+0000 7f8546ffd700 1 -- 172.21.15.84:0/545469069 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8540011cd0 con 0x7f855006c240 2023-07-14T11:19:22.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.377+0000 7f85549ff700 1 -- 172.21.15.84:0/545469069 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85500b6270 con 0x7f855006c240 2023-07-14T11:19:22.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.377+0000 7f85549ff700 1 -- 172.21.15.84:0/545469069 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85500b6830 con 0x7f855006c240 2023-07-14T11:19:22.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.378+0000 7f85549ff700 1 -- 172.21.15.84:0/545469069 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8550074350 con 0x7f855006c240 2023-07-14T11:19:22.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.378+0000 7f8546ffd700 1 -- 172.21.15.84:0/545469069 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f8540010350 con 0x7f855006c240 2023-07-14T11:19:22.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.379+0000 7f8546ffd700 1 --2- 172.21.15.84:0/545469069 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f853006ae00 0x7f853006d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:22.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.379+0000 7f8546ffd700 1 -- 172.21.15.84:0/545469069 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8540088f40 con 0x7f855006c240 2023-07-14T11:19:22.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.380+0000 7f8547fff700 1 --2- 172.21.15.84:0/545469069 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f853006ae00 0x7f853006d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:22.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.381+0000 7f8547fff700 1 --2- 172.21.15.84:0/545469069 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f853006ae00 0x7f853006d2b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8538000c00 tx=0x7f8538008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:22.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.384+0000 7f8546ffd700 1 -- 172.21.15.84:0/545469069 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f8540054090 con 0x7f855006c240 2023-07-14T11:19:22.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.575+0000 7f85549ff700 1 -- 172.21.15.84:0/545469069 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f855006c700 con 0x7f855006c240 2023-07-14T11:19:22.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.939+0000 7f8546ffd700 1 -- 172.21.15.84:0/545469069 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v103) v1 ==== 138+0+0 (secure 0 0 0) 0x7f85400576b0 con 0x7f855006c240 2023-07-14T11:19:22.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.943+0000 7f85549ff700 1 -- 172.21.15.84:0/545469069 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f853006ae00 msgr2=0x7f853006d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:22.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.943+0000 7f85549ff700 1 --2- 172.21.15.84:0/545469069 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f853006ae00 0x7f853006d2b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8538000c00 tx=0x7f8538008030 comp rx=0 tx=0).stop 2023-07-14T11:19:22.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.943+0000 7f85549ff700 1 -- 172.21.15.84:0/545469069 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f855006c240 msgr2=0x7f85500c9430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:22.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.943+0000 7f85549ff700 1 --2- 172.21.15.84:0/545469069 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f855006c240 0x7f85500c9430 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f854000c7f0 tx=0x7f854000cb00 comp rx=0 tx=0).stop 2023-07-14T11:19:22.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.943+0000 7f85549ff700 1 -- 172.21.15.84:0/545469069 shutdown_connections 2023-07-14T11:19:22.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.943+0000 7f85549ff700 1 --2- 172.21.15.84:0/545469069 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f855015c890 0x7f855015d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:22.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.943+0000 7f85549ff700 1 --2- 172.21.15.84:0/545469069 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f855006c240 0x7f85500c9430 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:22.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.943+0000 7f85549ff700 1 --2- 172.21.15.84:0/545469069 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f853006ae00 0x7f853006d2b0 secure :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8538000c00 tx=0x7f8538008030 comp rx=0 tx=0).stop 2023-07-14T11:19:22.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.943+0000 7f85549ff700 1 --2- 172.21.15.84:0/545469069 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85500b2440 0x7f85501f3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:22.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.943+0000 7f85549ff700 1 -- 172.21.15.84:0/545469069 >> 172.21.15.84:0/545469069 conn(0x7f855009c170 msgr2=0x7f855015bb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:22.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.944+0000 7f85549ff700 1 -- 172.21.15.84:0/545469069 shutdown_connections 2023-07-14T11:19:22.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:22.944+0000 7f85549ff700 1 -- 172.21.15.84:0/545469069 wait complete. 2023-07-14T11:19:22.948 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_metadata' created 2023-07-14T11:19:22.967 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-14T11:19:23.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:23.167+0000 7f819fdff700 1 Processor -- start 2023-07-14T11:19:23.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:23.167+0000 7f819fdff700 1 -- start start 2023-07-14T11:19:23.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:23.168+0000 7f819fdff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f819815c6c0 0x7f81980b2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:23.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:23.168+0000 7f819fdff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f819815ca90 con 0x7f819806b8a0 2023-07-14T11:19:23.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:23.168+0000 7f819fdff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f819806b0e0 con 0x7f81980afc40 2023-07-14T11:19:23.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:23.168+0000 7f819fdff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81980d0370 con 0x7f819815c6c0 2023-07-14T11:19:23.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:23.168+0000 7f819db9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f819815c6c0 0x7f81980b2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:23.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:23.168+0000 7f819e39c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f819806b8a0 0x7f819806bce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50236/0 (socket says 172.21.15.84:50236) 2023-07-14T11:19:23.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:23.168+0000 7f819e39c700 1 -- 172.21.15.84:0/1158584326 learned_addr learned my addr 172.21.15.84:0/1158584326 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:19:23.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:23.169+0000 7f819db9b700 1 -- 172.21.15.84:0/1158584326 >> v1:172.21.15.179:6789/0 conn(0x7f81980afc40 legacy=0x7f81980b2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:23.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:23.169+0000 7f819db9b700 1 -- 172.21.15.84:0/1158584326 >> v1:172.21.15.84:6789/0 conn(0x7f819806b8a0 legacy=0x7f819806bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:23.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:23.169+0000 7f819db9b700 1 -- 172.21.15.84:0/1158584326 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81980d0650 con 0x7f819815c6c0 2023-07-14T11:19:23.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:23.169+0000 7f819cb99700 1 -- 172.21.15.84:0/1158584326 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2468033045 0 0) 0x7f8190001490 con 0x7f819806b8a0 2023-07-14T11:19:23.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:23.169+0000 7f819db9b700 1 --2- 172.21.15.84:0/1158584326 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f819815c6c0 0x7f81980b2630 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f8194009870 tx=0x7f8194009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d22105c3a39e95 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:23.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:23.169+0000 7f819cb99700 1 -- 172.21.15.84:0/1158584326 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8194011830 con 0x7f819815c6c0 2023-07-14T11:19:23.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:23.169+0000 7f819cb99700 1 -- 172.21.15.84:0/1158584326 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8194011990 con 0x7f819815c6c0 2023-07-14T11:19:23.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:23.169+0000 7f819cb99700 1 -- 172.21.15.84:0/1158584326 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8194011d20 con 0x7f819815c6c0 2023-07-14T11:19:23.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:23.170+0000 7f819fdff700 1 -- 172.21.15.84:0/1158584326 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f819815c6c0 msgr2=0x7f81980b2630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:23.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:23.170+0000 7f819fdff700 1 --2- 172.21.15.84:0/1158584326 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f819815c6c0 0x7f81980b2630 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f8194009870 tx=0x7f8194009b80 comp rx=0 tx=0).stop 2023-07-14T11:19:23.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:23.170+0000 7f819fdff700 1 -- 172.21.15.84:0/1158584326 shutdown_connections 2023-07-14T11:19:23.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:23.170+0000 7f819fdff700 1 --2- 172.21.15.84:0/1158584326 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f819815c6c0 0x7f81980b2630 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:23.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:23.170+0000 7f819fdff700 1 -- 172.21.15.84:0/1158584326 >> 172.21.15.84:0/1158584326 conn(0x7f819806d980 msgr2=0x7f819806dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:23.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:23.170+0000 7f819fdff700 1 -- 172.21.15.84:0/1158584326 shutdown_connections 2023-07-14T11:19:23.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:23.170+0000 7f819fdff700 1 -- 172.21.15.84:0/1158584326 wait complete. 2023-07-14T11:19:23.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:23.172+0000 7f819fdff700 1 Processor -- start 2023-07-14T11:19:23.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:23.173+0000 7f819fdff700 1 -- start start 2023-07-14T11:19:23.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:23.174+0000 7f819fdff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f819806b8a0 0x7f81981f5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:23.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:23.174+0000 7f819fdff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81980afc40 0x7f8198159ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:23.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:23.174+0000 7f819fdff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f819815c6c0 0x7f8198147e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:23.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:23.174+0000 7f819fdff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81980cac30 con 0x7f819815c6c0 2023-07-14T11:19:23.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:23.174+0000 7f819fdff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f819815af20 con 0x7f819806b8a0 2023-07-14T11:19:23.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:23.174+0000 7f819fdff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f819815a310 con 0x7f81980afc40 2023-07-14T11:19:23.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:23.174+0000 7f819e39c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f819815c6c0 0x7f8198147e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:23.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:23.174+0000 7f819e39c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f819815c6c0 0x7f8198147e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54088/0 (socket says 172.21.15.84:54088) 2023-07-14T11:19:23.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:23.174+0000 7f819e39c700 1 -- 172.21.15.84:0/770669395 learned_addr learned my addr 172.21.15.84:0/770669395 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:23.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:23.174+0000 7f819db9b700 1 --2- 172.21.15.84:0/770669395 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f819806b8a0 0x7f81981f5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:23.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:23.174+0000 7f819d39a700 1 --2- 172.21.15.84:0/770669395 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81980afc40 0x7f8198159ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:23.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:23.175+0000 7f819e39c700 1 -- 172.21.15.84:0/770669395 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81980afc40 msgr2=0x7f8198159ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:23.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:23.175+0000 7f819e39c700 1 --2- 172.21.15.84:0/770669395 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81980afc40 0x7f8198159ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:23.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:23.175+0000 7f819e39c700 1 -- 172.21.15.84:0/770669395 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f819806b8a0 msgr2=0x7f81981f5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:23.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:23.175+0000 7f819e39c700 1 --2- 172.21.15.84:0/770669395 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f819806b8a0 0x7f81981f5f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:23.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:23.175+0000 7f819e39c700 1 -- 172.21.15.84:0/770669395 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81940094a0 con 0x7f819815c6c0 2023-07-14T11:19:23.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:23.175+0000 7f819e39c700 1 --2- 172.21.15.84:0/770669395 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f819815c6c0 0x7f8198147e60 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f819000cbd0 tx=0x7f819000cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:23.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:23.175+0000 7f818e7fc700 1 -- 172.21.15.84:0/770669395 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819000aa60 con 0x7f819815c6c0 2023-07-14T11:19:23.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:23.175+0000 7f818e7fc700 1 -- 172.21.15.84:0/770669395 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f819000abe0 con 0x7f819815c6c0 2023-07-14T11:19:23.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:23.175+0000 7f819fdff700 1 -- 172.21.15.84:0/770669395 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f819815a5f0 con 0x7f819815c6c0 2023-07-14T11:19:23.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:23.175+0000 7f818e7fc700 1 -- 172.21.15.84:0/770669395 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81900070d0 con 0x7f819815c6c0 2023-07-14T11:19:23.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:23.175+0000 7f819fdff700 1 -- 172.21.15.84:0/770669395 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f819815abb0 con 0x7f819815c6c0 2023-07-14T11:19:23.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:23.176+0000 7f819fdff700 1 -- 172.21.15.84:0/770669395 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8198074350 con 0x7f819815c6c0 2023-07-14T11:19:23.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:23.178+0000 7f818e7fc700 1 -- 172.21.15.84:0/770669395 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f8190007230 con 0x7f819815c6c0 2023-07-14T11:19:23.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:23.179+0000 7f818e7fc700 1 --2- 172.21.15.84:0/770669395 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f817c06ae00 0x7f817c06d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:23.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:23.179+0000 7f818e7fc700 1 -- 172.21.15.84:0/770669395 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f8190088d80 con 0x7f819815c6c0 2023-07-14T11:19:23.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:23.179+0000 7f819db9b700 1 --2- 172.21.15.84:0/770669395 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f817c06ae00 0x7f817c06d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:23.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:23.180+0000 7f819db9b700 1 --2- 172.21.15.84:0/770669395 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f817c06ae00 0x7f817c06d2b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f81940090b0 tx=0x7f8194008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:23.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:23.183+0000 7f818e7fc700 1 -- 172.21.15.84:0/770669395 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f8190053de0 con 0x7f819815c6c0 2023-07-14T11:19:23.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:23.377+0000 7f819fdff700 1 -- 172.21.15.84:0/770669395 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f819815ca90 con 0x7f819815c6c0 2023-07-14T11:19:23.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:23.950+0000 7f818e7fc700 1 -- 172.21.15.84:0/770669395 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v104) v1 ==== 170+0+0 (secure 0 0 0) 0x7f819815ca90 con 0x7f819815c6c0 2023-07-14T11:19:23.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:23.957+0000 7f819fdff700 1 -- 172.21.15.84:0/770669395 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f817c06ae00 msgr2=0x7f817c06d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:23.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:23.957+0000 7f819fdff700 1 --2- 172.21.15.84:0/770669395 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f817c06ae00 0x7f817c06d2b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f81940090b0 tx=0x7f8194008030 comp rx=0 tx=0).stop 2023-07-14T11:19:23.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:23.957+0000 7f819fdff700 1 -- 172.21.15.84:0/770669395 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f819815c6c0 msgr2=0x7f8198147e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:23.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:23.957+0000 7f819fdff700 1 --2- 172.21.15.84:0/770669395 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f819815c6c0 0x7f8198147e60 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f819000cbd0 tx=0x7f819000cee0 comp rx=0 tx=0).stop 2023-07-14T11:19:23.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:23.958+0000 7f819fdff700 1 -- 172.21.15.84:0/770669395 shutdown_connections 2023-07-14T11:19:23.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:23.958+0000 7f819fdff700 1 --2- 172.21.15.84:0/770669395 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f819815c6c0 0x7f8198147e60 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:23.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:23.958+0000 7f819fdff700 1 --2- 172.21.15.84:0/770669395 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f819806b8a0 0x7f81981f5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:23.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:23.958+0000 7f819fdff700 1 --2- 172.21.15.84:0/770669395 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f817c06ae00 0x7f817c06d2b0 secure :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f81940090b0 tx=0x7f8194008030 comp rx=0 tx=0).stop 2023-07-14T11:19:23.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:23.958+0000 7f819fdff700 1 --2- 172.21.15.84:0/770669395 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81980afc40 0x7f8198159ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:23.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:23.958+0000 7f819fdff700 1 -- 172.21.15.84:0/770669395 >> 172.21.15.84:0/770669395 conn(0x7f819806d980 msgr2=0x7f81980b39e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:23.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:23.961+0000 7f819fdff700 1 -- 172.21.15.84:0/770669395 shutdown_connections 2023-07-14T11:19:23.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:23.962+0000 7f819fdff700 1 -- 172.21.15.84:0/770669395 wait complete. 2023-07-14T11:19:23.969 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data' created 2023-07-14T11:19:23.989 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-14T11:19:24.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:24.186+0000 7fcf18dff700 1 Processor -- start 2023-07-14T11:19:24.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:24.187+0000 7fcf18dff700 1 -- start start 2023-07-14T11:19:24.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:24.188+0000 7fcf18dff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcf140b4600 0x7fcf140cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:24.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:24.188+0000 7fcf18dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf140b6f00 0x7fcf140d02b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:24.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:24.188+0000 7fcf18dff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf1415cd60 con 0x7fcf140cfe40 2023-07-14T11:19:24.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:24.188+0000 7fcf18dff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf140d1550 con 0x7fcf140b4600 2023-07-14T11:19:24.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:24.188+0000 7fcf18dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf140d2d90 con 0x7fcf140b6f00 2023-07-14T11:19:24.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:24.188+0000 7fcf1259c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcf140b4600 0x7fcf140cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:24.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:24.188+0000 7fcf1259c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcf140b4600 0x7fcf140cf900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54100/0 (socket says 172.21.15.84:54100) 2023-07-14T11:19:24.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:24.188+0000 7fcf1259c700 1 -- 172.21.15.84:0/3858286404 learned_addr learned my addr 172.21.15.84:0/3858286404 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:24.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:24.188+0000 7fcf0bfff700 1 --1- 172.21.15.84:0/3858286404 >> v1:172.21.15.84:6789/0 conn(0x7fcf140cfe40 0x7fcf140cd540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50252/0 (socket says 172.21.15.84:50252) 2023-07-14T11:19:24.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:24.188+0000 7fcf12d9d700 1 --2- 172.21.15.84:0/3858286404 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf140b6f00 0x7fcf140d02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:24.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:24.188+0000 7fcf1259c700 1 -- 172.21.15.84:0/3858286404 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf140b6f00 msgr2=0x7fcf140d02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:24.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:24.188+0000 7fcf1259c700 1 --2- 172.21.15.84:0/3858286404 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf140b6f00 0x7fcf140d02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:24.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:24.188+0000 7fcf1259c700 1 -- 172.21.15.84:0/3858286404 >> v1:172.21.15.84:6789/0 conn(0x7fcf140cfe40 legacy=0x7fcf140cd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:24.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:24.189+0000 7fcf1259c700 1 -- 172.21.15.84:0/3858286404 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf140cf340 con 0x7fcf140b4600 2023-07-14T11:19:24.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:24.189+0000 7fcf11d9b700 1 -- 172.21.15.84:0/3858286404 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1051226523 0 0) 0x7fcf1415cd60 con 0x7fcf140cfe40 2023-07-14T11:19:24.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:24.189+0000 7fcf12d9d700 1 --2- 172.21.15.84:0/3858286404 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf140b6f00 0x7fcf140d02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:19:24.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:24.189+0000 7fcf1259c700 1 --2- 172.21.15.84:0/3858286404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf140b4600 0x7fcf140cf900 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7fcf040098f0 tx=0x7fcf04009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d20c1586e69f5ad server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:24.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:24.189+0000 7fcf11d9b700 1 -- 172.21.15.84:0/3858286404 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf0400b8a0 con 0x7fcf140b4600 2023-07-14T11:19:24.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:24.189+0000 7fcf11d9b700 1 -- 172.21.15.84:0/3858286404 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf0400ba00 con 0x7fcf140b4600 2023-07-14T11:19:24.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:24.189+0000 7fcf11d9b700 1 -- 172.21.15.84:0/3858286404 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf0400bd90 con 0x7fcf140b4600 2023-07-14T11:19:24.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:24.189+0000 7fcf18dff700 1 -- 172.21.15.84:0/3858286404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf140b4600 msgr2=0x7fcf140cf900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:24.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:24.189+0000 7fcf18dff700 1 --2- 172.21.15.84:0/3858286404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf140b4600 0x7fcf140cf900 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7fcf040098f0 tx=0x7fcf04009c00 comp rx=0 tx=0).stop 2023-07-14T11:19:24.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:24.190+0000 7fcf18dff700 1 -- 172.21.15.84:0/3858286404 shutdown_connections 2023-07-14T11:19:24.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:24.190+0000 7fcf18dff700 1 --2- 172.21.15.84:0/3858286404 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf140b6f00 0x7fcf140d02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:24.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:24.190+0000 7fcf18dff700 1 --2- 172.21.15.84:0/3858286404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf140b4600 0x7fcf140cf900 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:24.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:24.190+0000 7fcf18dff700 1 -- 172.21.15.84:0/3858286404 >> 172.21.15.84:0/3858286404 conn(0x7fcf1409c200 msgr2=0x7fcf140d2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:24.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:24.190+0000 7fcf18dff700 1 -- 172.21.15.84:0/3858286404 shutdown_connections 2023-07-14T11:19:24.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:24.190+0000 7fcf18dff700 1 -- 172.21.15.84:0/3858286404 wait complete. 2023-07-14T11:19:24.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:24.191+0000 7fcf18dff700 1 Processor -- start 2023-07-14T11:19:24.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:24.191+0000 7fcf18dff700 1 -- start start 2023-07-14T11:19:24.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:24.192+0000 7fcf18dff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf140b6f00 0x7fcf14157860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:24.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:24.192+0000 7fcf18dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf140cfe40 0x7fcf14151fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:24.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:24.192+0000 7fcf18dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf14158590 0x7fcf14158a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:24.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:24.192+0000 7fcf18dff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf141573d0 con 0x7fcf140b6f00 2023-07-14T11:19:24.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:24.192+0000 7fcf18dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf14157da0 con 0x7fcf14158590 2023-07-14T11:19:24.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:24.192+0000 7fcf18dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf141567c0 con 0x7fcf140cfe40 2023-07-14T11:19:24.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:24.193+0000 7fcf1259c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf140b6f00 0x7fcf14157860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:24.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:24.193+0000 7fcf0bfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf140cfe40 0x7fcf14151fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:24.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:24.193+0000 7fcf1259c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf140b6f00 0x7fcf14157860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54108/0 (socket says 172.21.15.84:54108) 2023-07-14T11:19:24.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:24.193+0000 7fcf1259c700 1 -- 172.21.15.84:0/2846384311 learned_addr learned my addr 172.21.15.84:0/2846384311 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:24.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:24.193+0000 7fcf12d9d700 1 --2- 172.21.15.84:0/2846384311 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf14158590 0x7fcf14158a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:24.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:24.193+0000 7fcf1259c700 1 -- 172.21.15.84:0/2846384311 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf140cfe40 msgr2=0x7fcf14151fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:24.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:24.193+0000 7fcf1259c700 1 --2- 172.21.15.84:0/2846384311 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf140cfe40 0x7fcf14151fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:24.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:24.193+0000 7fcf1259c700 1 -- 172.21.15.84:0/2846384311 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf14158590 msgr2=0x7fcf14158a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:24.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:24.193+0000 7fcf1259c700 1 --2- 172.21.15.84:0/2846384311 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf14158590 0x7fcf14158a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:24.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:24.193+0000 7fcf1259c700 1 -- 172.21.15.84:0/2846384311 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf04009550 con 0x7fcf140b6f00 2023-07-14T11:19:24.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:24.193+0000 7fcf1259c700 1 --2- 172.21.15.84:0/2846384311 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf140b6f00 0x7fcf14157860 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7fcf04009c40 tx=0x7fcf04004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:24.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:24.194+0000 7fcf0affd700 1 -- 172.21.15.84:0/2846384311 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf04004240 con 0x7fcf140b6f00 2023-07-14T11:19:24.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:24.194+0000 7fcf0affd700 1 -- 172.21.15.84:0/2846384311 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf0401f070 con 0x7fcf140b6f00 2023-07-14T11:19:24.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:24.194+0000 7fcf0affd700 1 -- 172.21.15.84:0/2846384311 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf040045c0 con 0x7fcf140b6f00 2023-07-14T11:19:24.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:24.194+0000 7fcf18dff700 1 -- 172.21.15.84:0/2846384311 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf14156aa0 con 0x7fcf140b6f00 2023-07-14T11:19:24.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:24.194+0000 7fcf18dff700 1 -- 172.21.15.84:0/2846384311 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf14157060 con 0x7fcf140b6f00 2023-07-14T11:19:24.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:24.195+0000 7fcf18dff700 1 -- 172.21.15.84:0/2846384311 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf141571f0 con 0x7fcf140b6f00 2023-07-14T11:19:24.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:24.196+0000 7fcf0affd700 1 -- 172.21.15.84:0/2846384311 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7fcf04021030 con 0x7fcf140b6f00 2023-07-14T11:19:24.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:24.197+0000 7fcf0affd700 1 --2- 172.21.15.84:0/2846384311 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fcef406ae00 0x7fcef406d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:24.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:24.197+0000 7fcf0affd700 1 -- 172.21.15.84:0/2846384311 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5962+0+0 (secure 0 0 0) 0x7fcf0408a860 con 0x7fcf140b6f00 2023-07-14T11:19:24.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:24.197+0000 7fcf0bfff700 1 --2- 172.21.15.84:0/2846384311 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fcef406ae00 0x7fcef406d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:24.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:24.198+0000 7fcf0bfff700 1 --2- 172.21.15.84:0/2846384311 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fcef406ae00 0x7fcef406d2b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fcf141f5980 tx=0x7fcefc007e70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:24.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:24.202+0000 7fcf0affd700 1 -- 172.21.15.84:0/2846384311 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fcf040557d0 con 0x7fcf140b6f00 2023-07-14T11:19:24.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:24.439+0000 7fcf18dff700 1 -- 172.21.15.84:0/2846384311 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fcf14074350 con 0x7fcf140b6f00 2023-07-14T11:19:24.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:24.952+0000 7fcf0affd700 1 -- 172.21.15.84:0/2846384311 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 17 and data pool 18 v65) v1 ==== 174+0+0 (secure 0 0 0) 0x7fcf04058df0 con 0x7fcf140b6f00 2023-07-14T11:19:24.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:24.959+0000 7fcf18dff700 1 -- 172.21.15.84:0/2846384311 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fcef406ae00 msgr2=0x7fcef406d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:24.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:24.959+0000 7fcf18dff700 1 --2- 172.21.15.84:0/2846384311 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fcef406ae00 0x7fcef406d2b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fcf141f5980 tx=0x7fcefc007e70 comp rx=0 tx=0).stop 2023-07-14T11:19:24.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:24.959+0000 7fcf18dff700 1 -- 172.21.15.84:0/2846384311 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf140b6f00 msgr2=0x7fcf14157860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:24.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:24.959+0000 7fcf18dff700 1 --2- 172.21.15.84:0/2846384311 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf140b6f00 0x7fcf14157860 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7fcf04009c40 tx=0x7fcf04004750 comp rx=0 tx=0).stop 2023-07-14T11:19:24.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:24.961+0000 7fcf18dff700 1 -- 172.21.15.84:0/2846384311 shutdown_connections 2023-07-14T11:19:24.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:24.961+0000 7fcf18dff700 1 --2- 172.21.15.84:0/2846384311 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf14158590 0x7fcf14158a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:24.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:24.961+0000 7fcf18dff700 1 --2- 172.21.15.84:0/2846384311 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf140b6f00 0x7fcf14157860 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:24.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:24.961+0000 7fcf18dff700 1 --2- 172.21.15.84:0/2846384311 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fcef406ae00 0x7fcef406d2b0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:24.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:24.961+0000 7fcf18dff700 1 --2- 172.21.15.84:0/2846384311 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf140cfe40 0x7fcf14151fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:24.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:24.961+0000 7fcf18dff700 1 -- 172.21.15.84:0/2846384311 >> 172.21.15.84:0/2846384311 conn(0x7fcf1409c200 msgr2=0x7fcf1406b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:24.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:24.964+0000 7fcf18dff700 1 -- 172.21.15.84:0/2846384311 shutdown_connections 2023-07-14T11:19:24.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:24.965+0000 7fcf18dff700 1 -- 172.21.15.84:0/2846384311 wait complete. 2023-07-14T11:19:24.971 INFO:teuthology.orchestra.run.smithi084.stderr:new fs with metadata pool 17 and data pool 18 2023-07-14T11:19:24.999 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:19:25.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.192+0000 7fb6811ff700 1 Processor -- start 2023-07-14T11:19:25.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.192+0000 7fb6811ff700 1 -- start start 2023-07-14T11:19:25.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.194+0000 7fb6811ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb67c1597c0 0x7fb67c159c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:25.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.194+0000 7fb6811ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb67c0cea50 0x7fb67c0ceeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:25.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.194+0000 7fb6811ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb67c0cdf90 con 0x7fb67c1500d0 2023-07-14T11:19:25.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.194+0000 7fb6811ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb67c15a2f0 con 0x7fb67c0cea50 2023-07-14T11:19:25.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.194+0000 7fb6811ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb67c15a5d0 con 0x7fb67c1597c0 2023-07-14T11:19:25.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.194+0000 7fb67b59e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb67c0cea50 0x7fb67c0ceeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:25.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.194+0000 7fb67ad9d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fb67c1500d0 0x7fb67c070350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50264/0 (socket says 172.21.15.84:50264) 2023-07-14T11:19:25.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.194+0000 7fb67ad9d700 1 -- 172.21.15.84:0/43287895 learned_addr learned my addr 172.21.15.84:0/43287895 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:19:25.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.194+0000 7fb67a59c700 1 --2- 172.21.15.84:0/43287895 >> v2:172.21.15.179:3300/0 conn(0x7fb67c1597c0 0x7fb67c159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:25.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.194+0000 7fb67b59e700 1 -- 172.21.15.84:0/43287895 >> v2:172.21.15.179:3300/0 conn(0x7fb67c1597c0 msgr2=0x7fb67c159c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:25.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.194+0000 7fb67b59e700 1 --2- 172.21.15.84:0/43287895 >> v2:172.21.15.179:3300/0 conn(0x7fb67c1597c0 0x7fb67c159c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:25.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.194+0000 7fb67b59e700 1 -- 172.21.15.84:0/43287895 >> v1:172.21.15.84:6789/0 conn(0x7fb67c1500d0 legacy=0x7fb67c070350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:25.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.194+0000 7fb67b59e700 1 -- 172.21.15.84:0/43287895 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb67c0ce250 con 0x7fb67c0cea50 2023-07-14T11:19:25.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.194+0000 7fb679d9b700 1 -- 172.21.15.84:0/43287895 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3429160609 0 0) 0x7fb67c0cdf90 con 0x7fb67c1500d0 2023-07-14T11:19:25.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.194+0000 7fb67a59c700 1 --2- 172.21.15.84:0/43287895 >> v2:172.21.15.179:3300/0 conn(0x7fb67c1597c0 0x7fb67c159c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:19:25.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.195+0000 7fb67b59e700 1 --2- 172.21.15.84:0/43287895 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb67c0cea50 0x7fb67c0ceeb0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7fb67c06f640 tx=0x7fb67400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b6341f635749fb0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:25.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.195+0000 7fb679d9b700 1 -- 172.21.15.84:0/43287895 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67400e070 con 0x7fb67c0cea50 2023-07-14T11:19:25.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.195+0000 7fb679d9b700 1 -- 172.21.15.84:0/43287895 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb67400bbd0 con 0x7fb67c0cea50 2023-07-14T11:19:25.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.195+0000 7fb679d9b700 1 -- 172.21.15.84:0/43287895 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb674012430 con 0x7fb67c0cea50 2023-07-14T11:19:25.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.195+0000 7fb6811ff700 1 -- 172.21.15.84:0/43287895 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb67c0cea50 msgr2=0x7fb67c0ceeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:25.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.195+0000 7fb6811ff700 1 --2- 172.21.15.84:0/43287895 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb67c0cea50 0x7fb67c0ceeb0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7fb67c06f640 tx=0x7fb67400b330 comp rx=0 tx=0).stop 2023-07-14T11:19:25.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.196+0000 7fb6811ff700 1 -- 172.21.15.84:0/43287895 shutdown_connections 2023-07-14T11:19:25.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.196+0000 7fb6811ff700 1 --2- 172.21.15.84:0/43287895 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb67c0cea50 0x7fb67c0ceeb0 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:25.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.196+0000 7fb6811ff700 1 --2- 172.21.15.84:0/43287895 >> v2:172.21.15.179:3300/0 conn(0x7fb67c1597c0 0x7fb67c159c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:25.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.196+0000 7fb6811ff700 1 -- 172.21.15.84:0/43287895 >> 172.21.15.84:0/43287895 conn(0x7fb67c069f30 msgr2=0x7fb67c06a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:25.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.196+0000 7fb6811ff700 1 -- 172.21.15.84:0/43287895 shutdown_connections 2023-07-14T11:19:25.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.196+0000 7fb6811ff700 1 -- 172.21.15.84:0/43287895 wait complete. 2023-07-14T11:19:25.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.197+0000 7fb6811ff700 1 Processor -- start 2023-07-14T11:19:25.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.197+0000 7fb6811ff700 1 -- start start 2023-07-14T11:19:25.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.198+0000 7fb6811ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb67c0cea50 0x7fb67c13b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:25.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.198+0000 7fb6811ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb67c1500d0 0x7fb67c14cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:25.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.198+0000 7fb6811ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb67c1597c0 0x7fb67c14da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:25.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.198+0000 7fb6811ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb67c14d2b0 con 0x7fb67c1500d0 2023-07-14T11:19:25.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.198+0000 7fb6811ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb67c13be00 con 0x7fb67c0cea50 2023-07-14T11:19:25.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.198+0000 7fb6811ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb67c13c0e0 con 0x7fb67c1597c0 2023-07-14T11:19:25.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.199+0000 7fb67a59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb67c1500d0 0x7fb67c14cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:25.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.199+0000 7fb67a59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb67c1500d0 0x7fb67c14cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54126/0 (socket says 172.21.15.84:54126) 2023-07-14T11:19:25.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.199+0000 7fb67a59c700 1 -- 172.21.15.84:0/2727616172 learned_addr learned my addr 172.21.15.84:0/2727616172 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:25.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.199+0000 7fb67b59e700 1 --2- 172.21.15.84:0/2727616172 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb67c1597c0 0x7fb67c14da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:25.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.199+0000 7fb67ad9d700 1 --2- 172.21.15.84:0/2727616172 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb67c0cea50 0x7fb67c13b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:25.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.199+0000 7fb67a59c700 1 -- 172.21.15.84:0/2727616172 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb67c1597c0 msgr2=0x7fb67c14da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:25.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.199+0000 7fb67a59c700 1 --2- 172.21.15.84:0/2727616172 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb67c1597c0 0x7fb67c14da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:25.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.199+0000 7fb67a59c700 1 -- 172.21.15.84:0/2727616172 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb67c0cea50 msgr2=0x7fb67c13b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:25.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.199+0000 7fb67a59c700 1 --2- 172.21.15.84:0/2727616172 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb67c0cea50 0x7fb67c13b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:25.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.199+0000 7fb67a59c700 1 -- 172.21.15.84:0/2727616172 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb674009a70 con 0x7fb67c1500d0 2023-07-14T11:19:25.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.199+0000 7fb67a59c700 1 --2- 172.21.15.84:0/2727616172 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb67c1500d0 0x7fb67c14cd70 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7fb67000c7f0 tx=0x7fb67000cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:25.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.199+0000 7fb6637fe700 1 -- 172.21.15.84:0/2727616172 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb670011800 con 0x7fb67c1500d0 2023-07-14T11:19:25.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.199+0000 7fb6637fe700 1 -- 172.21.15.84:0/2727616172 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb670011960 con 0x7fb67c1500d0 2023-07-14T11:19:25.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.200+0000 7fb6637fe700 1 -- 172.21.15.84:0/2727616172 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb670011d10 con 0x7fb67c1500d0 2023-07-14T11:19:25.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.200+0000 7fb6811ff700 1 -- 172.21.15.84:0/2727616172 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb67c13c3c0 con 0x7fb67c1500d0 2023-07-14T11:19:25.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.200+0000 7fb6811ff700 1 -- 172.21.15.84:0/2727616172 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb67c13c980 con 0x7fb67c1500d0 2023-07-14T11:19:25.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.201+0000 7fb6811ff700 1 -- 172.21.15.84:0/2727616172 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb67c13cba0 con 0x7fb67c1500d0 2023-07-14T11:19:25.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.202+0000 7fb6637fe700 1 -- 172.21.15.84:0/2727616172 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7fb670018360 con 0x7fb67c1500d0 2023-07-14T11:19:25.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.202+0000 7fb6637fe700 1 --2- 172.21.15.84:0/2727616172 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fb66806ae00 0x7fb66806d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:25.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.203+0000 7fb6637fe700 1 -- 172.21.15.84:0/2727616172 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb670089790 con 0x7fb67c1500d0 2023-07-14T11:19:25.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.203+0000 7fb67ad9d700 1 --2- 172.21.15.84:0/2727616172 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fb66806ae00 0x7fb66806d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:25.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.204+0000 7fb67ad9d700 1 --2- 172.21.15.84:0/2727616172 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fb66806ae00 0x7fb66806d2b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb66c000f60 tx=0x7fb66c007be0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:25.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.207+0000 7fb6637fe700 1 -- 172.21.15.84:0/2727616172 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fb670058010 con 0x7fb67c1500d0 2023-07-14T11:19:25.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.401+0000 7fb6811ff700 1 -- 172.21.15.84:0/2727616172 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb67c04e280 con 0x7fb67c1500d0 2023-07-14T11:19:25.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.403+0000 7fb6637fe700 1 -- 172.21.15.84:0/2727616172 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v105) v1 ==== 74+0+18350 (secure 0 0 0) 0x7fb670057ba0 con 0x7fb67c1500d0 2023-07-14T11:19:25.405 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:19:25.406 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":105,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:19:24.440949+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-07-14T11:19:22.615201+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-07-14T11:19:23.416792+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:19:25.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.405+0000 7fb6811ff700 1 -- 172.21.15.84:0/2727616172 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fb66806ae00 msgr2=0x7fb66806d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:25.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.405+0000 7fb6811ff700 1 --2- 172.21.15.84:0/2727616172 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fb66806ae00 0x7fb66806d2b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb66c000f60 tx=0x7fb66c007be0 comp rx=0 tx=0).stop 2023-07-14T11:19:25.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.405+0000 7fb6811ff700 1 -- 172.21.15.84:0/2727616172 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb67c1500d0 msgr2=0x7fb67c14cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:25.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.405+0000 7fb6811ff700 1 --2- 172.21.15.84:0/2727616172 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb67c1500d0 0x7fb67c14cd70 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7fb67000c7f0 tx=0x7fb67000cbb0 comp rx=0 tx=0).stop 2023-07-14T11:19:25.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.405+0000 7fb6811ff700 1 -- 172.21.15.84:0/2727616172 shutdown_connections 2023-07-14T11:19:25.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.405+0000 7fb6811ff700 1 --2- 172.21.15.84:0/2727616172 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fb66806ae00 0x7fb66806d2b0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:25.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.405+0000 7fb6811ff700 1 --2- 172.21.15.84:0/2727616172 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb67c1597c0 0x7fb67c14da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:25.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.405+0000 7fb6811ff700 1 --2- 172.21.15.84:0/2727616172 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb67c0cea50 0x7fb67c13b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:25.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.405+0000 7fb6811ff700 1 --2- 172.21.15.84:0/2727616172 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb67c1500d0 0x7fb67c14cd70 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:25.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.405+0000 7fb6811ff700 1 -- 172.21.15.84:0/2727616172 >> 172.21.15.84:0/2727616172 conn(0x7fb67c069f30 msgr2=0x7fb67c0cb6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:25.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.405+0000 7fb6811ff700 1 -- 172.21.15.84:0/2727616172 shutdown_connections 2023-07-14T11:19:25.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.405+0000 7fb6811ff700 1 -- 172.21.15.84:0/2727616172 wait complete. 2023-07-14T11:19:25.426 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:19:25.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.620+0000 7f49cc5ff700 1 Processor -- start 2023-07-14T11:19:25.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.620+0000 7f49cc5ff700 1 -- start start 2023-07-14T11:19:25.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.622+0000 7f49cc5ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f49c40d1220 0x7f49c40b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:25.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.622+0000 7f49cc5ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f49c40b1e00 0x7f49c40afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:25.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.622+0000 7f49cc5ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49c40d2ce0 con 0x7f49c415c950 2023-07-14T11:19:25.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.622+0000 7f49cc5ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49c40b3350 con 0x7f49c40b1e00 2023-07-14T11:19:25.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.622+0000 7f49cc5ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49c40b3630 con 0x7f49c40d1220 2023-07-14T11:19:25.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.622+0000 7f49cab9c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f49c40b1e00 0x7f49c40afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:25.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.622+0000 7f49cab9c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f49c40b1e00 0x7f49c40afac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54142/0 (socket says 172.21.15.84:54142) 2023-07-14T11:19:25.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.622+0000 7f49cab9c700 1 -- 172.21.15.84:0/3372355616 learned_addr learned my addr 172.21.15.84:0/3372355616 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:25.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.622+0000 7f49c9b9a700 1 --2- 172.21.15.84:0/3372355616 >> v2:172.21.15.179:3300/0 conn(0x7f49c40d1220 0x7f49c40b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:25.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.622+0000 7f49cab9c700 1 -- 172.21.15.84:0/3372355616 >> v2:172.21.15.179:3300/0 conn(0x7f49c40d1220 msgr2=0x7f49c40b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:25.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.622+0000 7f49cab9c700 1 --2- 172.21.15.84:0/3372355616 >> v2:172.21.15.179:3300/0 conn(0x7f49c40d1220 0x7f49c40b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:25.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.622+0000 7f49cab9c700 1 -- 172.21.15.84:0/3372355616 >> v1:172.21.15.84:6789/0 conn(0x7f49c415c950 legacy=0x7f49c40d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:25.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.622+0000 7f49cab9c700 1 -- 172.21.15.84:0/3372355616 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49c40b3910 con 0x7f49c40b1e00 2023-07-14T11:19:25.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.623+0000 7f49cab9c700 1 --2- 172.21.15.84:0/3372355616 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49c40b1e00 0x7f49c40afac0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f49c4072140 tx=0x7f49bc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f93f20e45a18415a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:25.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.623+0000 7f49c9399700 1 -- 172.21.15.84:0/3372355616 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49bc00e070 con 0x7f49c40b1e00 2023-07-14T11:19:25.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.623+0000 7f49c9399700 1 -- 172.21.15.84:0/3372355616 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49bc00b9c0 con 0x7f49c40b1e00 2023-07-14T11:19:25.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.623+0000 7f49c9399700 1 -- 172.21.15.84:0/3372355616 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49bc00bd70 con 0x7f49c40b1e00 2023-07-14T11:19:25.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.623+0000 7f49cc5ff700 1 -- 172.21.15.84:0/3372355616 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49c40b1e00 msgr2=0x7f49c40afac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:25.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.623+0000 7f49cc5ff700 1 --2- 172.21.15.84:0/3372355616 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49c40b1e00 0x7f49c40afac0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f49c4072140 tx=0x7f49bc00b330 comp rx=0 tx=0).stop 2023-07-14T11:19:25.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.623+0000 7f49cc5ff700 1 -- 172.21.15.84:0/3372355616 shutdown_connections 2023-07-14T11:19:25.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.623+0000 7f49cc5ff700 1 --2- 172.21.15.84:0/3372355616 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49c40b1e00 0x7f49c40afac0 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:25.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.623+0000 7f49cc5ff700 1 --2- 172.21.15.84:0/3372355616 >> v2:172.21.15.179:3300/0 conn(0x7f49c40d1220 0x7f49c40b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:25.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.623+0000 7f49cc5ff700 1 -- 172.21.15.84:0/3372355616 >> 172.21.15.84:0/3372355616 conn(0x7f49c409c1d0 msgr2=0x7f49c40d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:25.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.623+0000 7f49cc5ff700 1 -- 172.21.15.84:0/3372355616 shutdown_connections 2023-07-14T11:19:25.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.624+0000 7f49cc5ff700 1 -- 172.21.15.84:0/3372355616 wait complete. 2023-07-14T11:19:25.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.625+0000 7f49cc5ff700 1 Processor -- start 2023-07-14T11:19:25.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.625+0000 7f49cc5ff700 1 -- start start 2023-07-14T11:19:25.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.626+0000 7f49cc5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49c40b1e00 0x7f49c4156d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:25.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.626+0000 7f49cc5ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49c40d1220 0x7f49c40cc810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:25.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.626+0000 7f49cc5ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49c415c950 0x7f49c40c8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:25.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.626+0000 7f49cc5ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c41572c0 con 0x7f49c415c950 2023-07-14T11:19:25.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.626+0000 7f49cc5ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c40cb770 con 0x7f49c40d1220 2023-07-14T11:19:25.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.626+0000 7f49cc5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49c40cba50 con 0x7f49c40b1e00 2023-07-14T11:19:25.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.627+0000 7f49cab9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49c415c950 0x7f49c40c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:25.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.627+0000 7f49cab9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49c415c950 0x7f49c40c8310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54148/0 (socket says 172.21.15.84:54148) 2023-07-14T11:19:25.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.627+0000 7f49cab9c700 1 -- 172.21.15.84:0/489318171 learned_addr learned my addr 172.21.15.84:0/489318171 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:25.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.627+0000 7f49c9b9a700 1 --2- 172.21.15.84:0/489318171 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49c40d1220 0x7f49c40cc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:25.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.627+0000 7f49ca39b700 1 --2- 172.21.15.84:0/489318171 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49c40b1e00 0x7f49c4156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:25.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.627+0000 7f49cab9c700 1 -- 172.21.15.84:0/489318171 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49c40b1e00 msgr2=0x7f49c4156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:25.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.627+0000 7f49cab9c700 1 --2- 172.21.15.84:0/489318171 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49c40b1e00 0x7f49c4156d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:25.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.627+0000 7f49cab9c700 1 -- 172.21.15.84:0/489318171 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49c40d1220 msgr2=0x7f49c40cc810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:25.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.627+0000 7f49cab9c700 1 --2- 172.21.15.84:0/489318171 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49c40d1220 0x7f49c40cc810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:25.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.627+0000 7f49cab9c700 1 -- 172.21.15.84:0/489318171 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49bc009b30 con 0x7f49c415c950 2023-07-14T11:19:25.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.627+0000 7f49cab9c700 1 --2- 172.21.15.84:0/489318171 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49c415c950 0x7f49c40c8310 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f49bc00b370 tx=0x7f49bc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:25.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.628+0000 7f49baffd700 1 -- 172.21.15.84:0/489318171 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49bc004880 con 0x7f49c415c950 2023-07-14T11:19:25.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.628+0000 7f49baffd700 1 -- 172.21.15.84:0/489318171 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49bc0099b0 con 0x7f49c415c950 2023-07-14T11:19:25.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.628+0000 7f49baffd700 1 -- 172.21.15.84:0/489318171 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49bc01c680 con 0x7f49c415c950 2023-07-14T11:19:25.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.628+0000 7f49cc5ff700 1 -- 172.21.15.84:0/489318171 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49c40cbd30 con 0x7f49c415c950 2023-07-14T11:19:25.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.628+0000 7f49cc5ff700 1 -- 172.21.15.84:0/489318171 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49c40cc2f0 con 0x7f49c415c950 2023-07-14T11:19:25.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.629+0000 7f49cc5ff700 1 -- 172.21.15.84:0/489318171 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49c404e280 con 0x7f49c415c950 2023-07-14T11:19:25.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.630+0000 7f49baffd700 1 -- 172.21.15.84:0/489318171 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f49bc01c7e0 con 0x7f49c415c950 2023-07-14T11:19:25.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.631+0000 7f49baffd700 1 --2- 172.21.15.84:0/489318171 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f49a806ae00 0x7f49a806d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:25.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.631+0000 7f49baffd700 1 -- 172.21.15.84:0/489318171 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f49bc08aff0 con 0x7f49c415c950 2023-07-14T11:19:25.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.632+0000 7f49ca39b700 1 --2- 172.21.15.84:0/489318171 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f49a806ae00 0x7f49a806d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:25.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.632+0000 7f49ca39b700 1 --2- 172.21.15.84:0/489318171 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f49a806ae00 0x7f49a806d2b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f49c40a0e10 tx=0x7f49c0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:25.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.635+0000 7f49baffd700 1 -- 172.21.15.84:0/489318171 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f49bc0bd330 con 0x7f49c415c950 2023-07-14T11:19:25.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.830+0000 7f49cc5ff700 1 -- 172.21.15.84:0/489318171 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f49c408c5a0 con 0x7f49c415c950 2023-07-14T11:19:25.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.831+0000 7f49baffd700 1 -- 172.21.15.84:0/489318171 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v105) v1 ==== 74+0+18350 (secure 0 0 0) 0x7f49bc055eb0 con 0x7f49c415c950 2023-07-14T11:19:25.834 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:19:25.834 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":105,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:19:24.440949+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-07-14T11:19:22.615201+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-07-14T11:19:23.416792+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:19:25.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.834+0000 7f49cc5ff700 1 -- 172.21.15.84:0/489318171 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f49a806ae00 msgr2=0x7f49a806d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:25.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.834+0000 7f49cc5ff700 1 --2- 172.21.15.84:0/489318171 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f49a806ae00 0x7f49a806d2b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f49c40a0e10 tx=0x7f49c0009040 comp rx=0 tx=0).stop 2023-07-14T11:19:25.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.834+0000 7f49cc5ff700 1 -- 172.21.15.84:0/489318171 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49c415c950 msgr2=0x7f49c40c8310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:25.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.834+0000 7f49cc5ff700 1 --2- 172.21.15.84:0/489318171 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49c415c950 0x7f49c40c8310 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f49bc00b370 tx=0x7f49bc004ad0 comp rx=0 tx=0).stop 2023-07-14T11:19:25.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.834+0000 7f49cc5ff700 1 -- 172.21.15.84:0/489318171 shutdown_connections 2023-07-14T11:19:25.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.834+0000 7f49cc5ff700 1 --2- 172.21.15.84:0/489318171 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f49a806ae00 0x7f49a806d2b0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:25.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.834+0000 7f49cc5ff700 1 --2- 172.21.15.84:0/489318171 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49c40b1e00 0x7f49c4156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:25.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.834+0000 7f49cc5ff700 1 --2- 172.21.15.84:0/489318171 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49c415c950 0x7f49c40c8310 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:25.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.834+0000 7f49cc5ff700 1 --2- 172.21.15.84:0/489318171 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49c40d1220 0x7f49c40cc810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:25.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.834+0000 7f49cc5ff700 1 -- 172.21.15.84:0/489318171 >> 172.21.15.84:0/489318171 conn(0x7f49c409c1d0 msgr2=0x7f49c40b0730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:25.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.834+0000 7f49cc5ff700 1 -- 172.21.15.84:0/489318171 shutdown_connections 2023-07-14T11:19:25.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:25.834+0000 7f49cc5ff700 1 -- 172.21.15.84:0/489318171 wait complete. 2023-07-14T11:19:25.854 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-14T11:19:26.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:26.056+0000 7f6e8a1ff700 1 Processor -- start 2023-07-14T11:19:26.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:26.056+0000 7f6e8a1ff700 1 -- start start 2023-07-14T11:19:26.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:26.057+0000 7f6e8a1ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6e84158bb0 0x7f6e840cd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:26.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:26.057+0000 7f6e8a1ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6e840cbe40 0x7f6e840cda40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:26.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:26.057+0000 7f6e8a1ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e840ce3a0 con 0x7f6e840cdf80 2023-07-14T11:19:26.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:26.057+0000 7f6e8a1ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e8406b5b0 con 0x7f6e84158bb0 2023-07-14T11:19:26.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:26.057+0000 7f6e8a1ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e84071500 con 0x7f6e840cbe40 2023-07-14T11:19:26.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:26.058+0000 7f6e837fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6e84158bb0 0x7f6e840cd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:26.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:26.058+0000 7f6e837fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6e84158bb0 0x7f6e840cd0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54158/0 (socket says 172.21.15.84:54158) 2023-07-14T11:19:26.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:26.058+0000 7f6e837fe700 1 -- 172.21.15.84:0/519445691 learned_addr learned my addr 172.21.15.84:0/519445691 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:26.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:26.058+0000 7f6e82ffd700 1 --2- 172.21.15.84:0/519445691 >> v2:172.21.15.179:3300/0 conn(0x7f6e840cbe40 0x7f6e840cda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:26.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:26.058+0000 7f6e837fe700 1 -- 172.21.15.84:0/519445691 >> v2:172.21.15.179:3300/0 conn(0x7f6e840cbe40 msgr2=0x7f6e840cda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:26.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:26.058+0000 7f6e837fe700 1 --2- 172.21.15.84:0/519445691 >> v2:172.21.15.179:3300/0 conn(0x7f6e840cbe40 0x7f6e840cda40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:26.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:26.058+0000 7f6e837fe700 1 -- 172.21.15.84:0/519445691 >> v1:172.21.15.179:6789/0 conn(0x7f6e840cdf80 legacy=0x7f6e8415c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:26.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:26.058+0000 7f6e837fe700 1 -- 172.21.15.84:0/519445691 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e840ce8c0 con 0x7f6e84158bb0 2023-07-14T11:19:26.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:26.058+0000 7f6e837fe700 1 --2- 172.21.15.84:0/519445691 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e84158bb0 0x7f6e840cd0a0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f6e84072040 tx=0x7f6e74009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d80b485e396273e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:26.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:26.059+0000 7f6e827fc700 1 -- 172.21.15.84:0/519445691 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e74004230 con 0x7f6e84158bb0 2023-07-14T11:19:26.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:26.059+0000 7f6e827fc700 1 -- 172.21.15.84:0/519445691 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e74004390 con 0x7f6e84158bb0 2023-07-14T11:19:26.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:26.059+0000 7f6e827fc700 1 -- 172.21.15.84:0/519445691 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e740036a0 con 0x7f6e84158bb0 2023-07-14T11:19:26.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:26.059+0000 7f6e8a1ff700 1 -- 172.21.15.84:0/519445691 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e84158bb0 msgr2=0x7f6e840cd0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:26.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:26.059+0000 7f6e8a1ff700 1 --2- 172.21.15.84:0/519445691 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e84158bb0 0x7f6e840cd0a0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f6e84072040 tx=0x7f6e74009bd0 comp rx=0 tx=0).stop 2023-07-14T11:19:26.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:26.059+0000 7f6e8a1ff700 1 -- 172.21.15.84:0/519445691 shutdown_connections 2023-07-14T11:19:26.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:26.059+0000 7f6e8a1ff700 1 --2- 172.21.15.84:0/519445691 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e84158bb0 0x7f6e840cd0a0 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:26.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:26.059+0000 7f6e8a1ff700 1 --2- 172.21.15.84:0/519445691 >> v2:172.21.15.179:3300/0 conn(0x7f6e840cbe40 0x7f6e840cda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:26.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:26.059+0000 7f6e8a1ff700 1 -- 172.21.15.84:0/519445691 >> 172.21.15.84:0/519445691 conn(0x7f6e840b05d0 msgr2=0x7f6e840b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:26.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:26.059+0000 7f6e8a1ff700 1 -- 172.21.15.84:0/519445691 shutdown_connections 2023-07-14T11:19:26.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:26.059+0000 7f6e8a1ff700 1 -- 172.21.15.84:0/519445691 wait complete. 2023-07-14T11:19:26.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:26.061+0000 7f6e8a1ff700 1 Processor -- start 2023-07-14T11:19:26.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:26.061+0000 7f6e8a1ff700 1 -- start start 2023-07-14T11:19:26.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:26.062+0000 7f6e8a1ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e840cbe40 0x7f6e84150190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:26.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:26.062+0000 7f6e8a1ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e840cdf80 0x7f6e840b2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:26.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:26.062+0000 7f6e8a1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e84158bb0 0x7f6e840b3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:26.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:26.062+0000 7f6e8a1ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e840b4040 con 0x7f6e840cdf80 2023-07-14T11:19:26.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:26.062+0000 7f6e8a1ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e840b31a0 con 0x7f6e840cbe40 2023-07-14T11:19:26.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:26.062+0000 7f6e8a1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e84151810 con 0x7f6e84158bb0 2023-07-14T11:19:26.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:26.062+0000 7f6e82ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e840cdf80 0x7f6e840b2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:26.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:26.062+0000 7f6e82ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e840cdf80 0x7f6e840b2b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54166/0 (socket says 172.21.15.84:54166) 2023-07-14T11:19:26.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:26.062+0000 7f6e82ffd700 1 -- 172.21.15.84:0/428779534 learned_addr learned my addr 172.21.15.84:0/428779534 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:26.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:26.062+0000 7f6e837fe700 1 --2- 172.21.15.84:0/428779534 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e840cbe40 0x7f6e84150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:26.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:26.062+0000 7f6e83fff700 1 --2- 172.21.15.84:0/428779534 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e84158bb0 0x7f6e840b3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:26.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:26.063+0000 7f6e82ffd700 1 -- 172.21.15.84:0/428779534 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e84158bb0 msgr2=0x7f6e840b3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:26.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:26.063+0000 7f6e82ffd700 1 --2- 172.21.15.84:0/428779534 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e84158bb0 0x7f6e840b3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:26.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:26.063+0000 7f6e82ffd700 1 -- 172.21.15.84:0/428779534 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e840cbe40 msgr2=0x7f6e84150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:26.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:26.063+0000 7f6e82ffd700 1 --2- 172.21.15.84:0/428779534 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e840cbe40 0x7f6e84150190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:26.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:26.063+0000 7f6e82ffd700 1 -- 172.21.15.84:0/428779534 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e74009550 con 0x7f6e840cdf80 2023-07-14T11:19:26.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:26.063+0000 7f6e837fe700 1 --2- 172.21.15.84:0/428779534 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e840cbe40 0x7f6e84150190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:19:26.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:26.063+0000 7f6e82ffd700 1 --2- 172.21.15.84:0/428779534 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e840cdf80 0x7f6e840b2b10 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f6e7800e810 tx=0x7f6e7800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:26.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:26.063+0000 7f6e6bfff700 1 -- 172.21.15.84:0/428779534 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e78013610 con 0x7f6e840cdf80 2023-07-14T11:19:26.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:26.063+0000 7f6e6bfff700 1 -- 172.21.15.84:0/428779534 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e78013770 con 0x7f6e840cdf80 2023-07-14T11:19:26.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:26.063+0000 7f6e6bfff700 1 -- 172.21.15.84:0/428779534 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e78013b00 con 0x7f6e840cdf80 2023-07-14T11:19:26.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:26.063+0000 7f6e8a1ff700 1 -- 172.21.15.84:0/428779534 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e84151af0 con 0x7f6e840cdf80 2023-07-14T11:19:26.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:26.063+0000 7f6e8a1ff700 1 -- 172.21.15.84:0/428779534 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e840b3480 con 0x7f6e840cdf80 2023-07-14T11:19:26.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:26.064+0000 7f6e8a1ff700 1 -- 172.21.15.84:0/428779534 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e840c8f60 con 0x7f6e840cdf80 2023-07-14T11:19:26.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:26.065+0000 7f6e6bfff700 1 -- 172.21.15.84:0/428779534 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f6e78013c60 con 0x7f6e840cdf80 2023-07-14T11:19:26.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:26.066+0000 7f6e6bfff700 1 --2- 172.21.15.84:0/428779534 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f6e7006ae00 0x7f6e7006d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:26.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:26.066+0000 7f6e6bfff700 1 -- 172.21.15.84:0/428779534 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6e78089490 con 0x7f6e840cdf80 2023-07-14T11:19:26.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:26.067+0000 7f6e837fe700 1 --2- 172.21.15.84:0/428779534 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f6e7006ae00 0x7f6e7006d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:26.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:26.068+0000 7f6e837fe700 1 --2- 172.21.15.84:0/428779534 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f6e7006ae00 0x7f6e7006d2b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6e74009130 tx=0x7f6e74008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:26.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:26.070+0000 7f6e6bfff700 1 -- 172.21.15.84:0/428779534 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f6e78057d10 con 0x7f6e840cdf80 2023-07-14T11:19:26.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:26.311+0000 7f6e8a1ff700 1 -- 172.21.15.84:0/428779534 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f6e84074350 con 0x7f6e840cdf80 2023-07-14T11:19:26.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:26.975+0000 7f6e6bfff700 1 -- 172.21.15.84:0/428779534 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v68) v1 ==== 118+0+0 (secure 0 0 0) 0x7f6e780578a0 con 0x7f6e840cdf80 2023-07-14T11:19:26.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:26.978+0000 7f6e8a1ff700 1 -- 172.21.15.84:0/428779534 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f6e7006ae00 msgr2=0x7f6e7006d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:26.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:26.978+0000 7f6e8a1ff700 1 --2- 172.21.15.84:0/428779534 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f6e7006ae00 0x7f6e7006d2b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6e74009130 tx=0x7f6e74008030 comp rx=0 tx=0).stop 2023-07-14T11:19:26.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:26.978+0000 7f6e8a1ff700 1 -- 172.21.15.84:0/428779534 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e840cdf80 msgr2=0x7f6e840b2b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:26.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:26.978+0000 7f6e8a1ff700 1 --2- 172.21.15.84:0/428779534 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e840cdf80 0x7f6e840b2b10 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f6e7800e810 tx=0x7f6e7800ebd0 comp rx=0 tx=0).stop 2023-07-14T11:19:26.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:26.978+0000 7f6e8a1ff700 1 -- 172.21.15.84:0/428779534 shutdown_connections 2023-07-14T11:19:26.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:26.978+0000 7f6e8a1ff700 1 --2- 172.21.15.84:0/428779534 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f6e7006ae00 0x7f6e7006d2b0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:26.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:26.978+0000 7f6e8a1ff700 1 --2- 172.21.15.84:0/428779534 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e84158bb0 0x7f6e840b3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:26.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:26.978+0000 7f6e8a1ff700 1 --2- 172.21.15.84:0/428779534 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e840cbe40 0x7f6e84150190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:26.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:26.978+0000 7f6e8a1ff700 1 --2- 172.21.15.84:0/428779534 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e840cdf80 0x7f6e840b2b10 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:26.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:26.978+0000 7f6e8a1ff700 1 -- 172.21.15.84:0/428779534 >> 172.21.15.84:0/428779534 conn(0x7f6e840b05d0 msgr2=0x7f6e840cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:26.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:26.979+0000 7f6e8a1ff700 1 -- 172.21.15.84:0/428779534 shutdown_connections 2023-07-14T11:19:26.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:26.979+0000 7f6e8a1ff700 1 -- 172.21.15.84:0/428779534 wait complete. 2023-07-14T11:19:27.002 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-14T11:19:27.002 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-14T11:19:27.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.201+0000 7f9c719ff700 1 Processor -- start 2023-07-14T11:19:27.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.202+0000 7f9c719ff700 1 -- start start 2023-07-14T11:19:27.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.203+0000 7f9c719ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c6c15d9d0 0x7f9c6c06b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:27.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.203+0000 7f9c719ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c6c06c4e0 con 0x7f9c6c071170 2023-07-14T11:19:27.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.203+0000 7f9c719ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c6c0b2020 con 0x7f9c6c06c9f0 2023-07-14T11:19:27.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.203+0000 7f9c719ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6c15dda0 con 0x7f9c6c15d9d0 2023-07-14T11:19:27.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.203+0000 7f9c6b7fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f9c6c071170 0x7f9c6c0715a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50276/0 (socket says 172.21.15.84:50276) 2023-07-14T11:19:27.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.203+0000 7f9c6b7fe700 1 -- 172.21.15.84:0/1260000765 learned_addr learned my addr 172.21.15.84:0/1260000765 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:19:27.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.203+0000 7f9c6affd700 1 --2- 172.21.15.84:0/1260000765 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c6c15d9d0 0x7f9c6c06b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:27.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.203+0000 7f9c6a7fc700 1 -- 172.21.15.84:0/1260000765 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3745626829 0 0) 0x7f9c6c06c4e0 con 0x7f9c6c071170 2023-07-14T11:19:27.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.203+0000 7f9c6a7fc700 1 -- 172.21.15.84:0/1260000765 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c580035b0 con 0x7f9c6c071170 2023-07-14T11:19:27.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.204+0000 7f9c6a7fc700 1 -- 172.21.15.84:0/1260000765 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2670350975 0 0) 0x7f9c6c0b2020 con 0x7f9c6c06c9f0 2023-07-14T11:19:27.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.204+0000 7f9c6a7fc700 1 -- 172.21.15.84:0/1260000765 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c6c06c4e0 con 0x7f9c6c06c9f0 2023-07-14T11:19:27.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.204+0000 7f9c6a7fc700 1 -- 172.21.15.84:0/1260000765 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 75981352 0 0) 0x7f9c580035b0 con 0x7f9c6c071170 2023-07-14T11:19:27.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.204+0000 7f9c6a7fc700 1 -- 172.21.15.84:0/1260000765 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c6c15d9d0 msgr2=0x7f9c6c06b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:27.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.204+0000 7f9c6a7fc700 1 --2- 172.21.15.84:0/1260000765 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c6c15d9d0 0x7f9c6c06b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:27.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.204+0000 7f9c6a7fc700 1 -- 172.21.15.84:0/1260000765 >> v1:172.21.15.179:6789/0 conn(0x7f9c6c06c9f0 legacy=0x7f9c6c0b1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:27.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.204+0000 7f9c6a7fc700 1 -- 172.21.15.84:0/1260000765 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c6c06bf20 con 0x7f9c6c071170 2023-07-14T11:19:27.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.204+0000 7f9c6a7fc700 1 -- 172.21.15.84:0/1260000765 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7f9c640019f0 con 0x7f9c6c071170 2023-07-14T11:19:27.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.204+0000 7f9c6affd700 1 --2- 172.21.15.84:0/1260000765 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c6c15d9d0 0x7f9c6c06b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:19:27.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.204+0000 7f9c6a7fc700 1 -- 172.21.15.84:0/1260000765 >> v1:172.21.15.84:6789/0 conn(0x7f9c6c071170 legacy=0x7f9c6c0715a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:27.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.204+0000 7f9c6a7fc700 1 --2- 172.21.15.84:0/1260000765 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c58003bc0 0x7f9c58003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:27.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.204+0000 7f9c6a7fc700 1 --2- 172.21.15.84:0/1260000765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c58004850 0x7f9c58004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:27.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.204+0000 7f9c6a7fc700 1 --2- 172.21.15.84:0/1260000765 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c6c15d9d0 0x7f9c58005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:27.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.204+0000 7f9c6a7fc700 1 -- 172.21.15.84:0/1260000765 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6c15dda0 con 0x7f9c58003bc0 2023-07-14T11:19:27.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.204+0000 7f9c6a7fc700 1 -- 172.21.15.84:0/1260000765 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5800bac0 con 0x7f9c58004850 2023-07-14T11:19:27.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.204+0000 7f9c6a7fc700 1 -- 172.21.15.84:0/1260000765 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5800bc50 con 0x7f9c6c15d9d0 2023-07-14T11:19:27.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.204+0000 7f9c6affd700 1 --2- 172.21.15.84:0/1260000765 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c58003bc0 0x7f9c58003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:27.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.204+0000 7f9c6b7fe700 1 --2- 172.21.15.84:0/1260000765 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c6c15d9d0 0x7f9c58005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:27.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.204+0000 7f9c63fff700 1 --2- 172.21.15.84:0/1260000765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c58004850 0x7f9c58004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:27.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.205+0000 7f9c6affd700 1 -- 172.21.15.84:0/1260000765 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c6c15d9d0 msgr2=0x7f9c58005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:27.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.205+0000 7f9c6affd700 1 --2- 172.21.15.84:0/1260000765 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c6c15d9d0 0x7f9c58005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:27.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.205+0000 7f9c6affd700 1 -- 172.21.15.84:0/1260000765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c58004850 msgr2=0x7f9c58004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:27.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.205+0000 7f9c6affd700 1 --2- 172.21.15.84:0/1260000765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c58004850 0x7f9c58004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:27.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.205+0000 7f9c6affd700 1 -- 172.21.15.84:0/1260000765 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c5c0094a0 con 0x7f9c58003bc0 2023-07-14T11:19:27.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.205+0000 7f9c6b7fe700 1 --2- 172.21.15.84:0/1260000765 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c6c15d9d0 0x7f9c58005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:19:27.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.205+0000 7f9c6affd700 1 --2- 172.21.15.84:0/1260000765 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c58003bc0 0x7f9c58003fb0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c009d60 tx=0x7f9c58005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdcac4b99f4be23b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:27.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.205+0000 7f9c6a7fc700 1 -- 172.21.15.84:0/1260000765 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5c00e9a0 con 0x7f9c58003bc0 2023-07-14T11:19:27.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.205+0000 7f9c6a7fc700 1 -- 172.21.15.84:0/1260000765 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c5c00eb00 con 0x7f9c58003bc0 2023-07-14T11:19:27.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.205+0000 7f9c6a7fc700 1 -- 172.21.15.84:0/1260000765 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5c00ee90 con 0x7f9c58003bc0 2023-07-14T11:19:27.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.205+0000 7f9c719ff700 1 -- 172.21.15.84:0/1260000765 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c58003bc0 msgr2=0x7f9c58003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:27.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.205+0000 7f9c719ff700 1 --2- 172.21.15.84:0/1260000765 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c58003bc0 0x7f9c58003fb0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c009d60 tx=0x7f9c58005880 comp rx=0 tx=0).stop 2023-07-14T11:19:27.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.205+0000 7f9c6b7fe700 1 -- 172.21.15.84:0/1260000765 reap_dead start 2023-07-14T11:19:27.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.206+0000 7f9c719ff700 1 -- 172.21.15.84:0/1260000765 shutdown_connections 2023-07-14T11:19:27.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.206+0000 7f9c719ff700 1 -- 172.21.15.84:0/1260000765 >> 172.21.15.84:0/1260000765 conn(0x7f9c6c0b05d0 msgr2=0x7f9c6c0b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:27.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.206+0000 7f9c719ff700 1 -- 172.21.15.84:0/1260000765 shutdown_connections 2023-07-14T11:19:27.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.206+0000 7f9c719ff700 1 -- 172.21.15.84:0/1260000765 wait complete. 2023-07-14T11:19:27.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.207+0000 7f9c719ff700 1 Processor -- start 2023-07-14T11:19:27.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.208+0000 7f9c719ff700 1 -- start start 2023-07-14T11:19:27.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.209+0000 7f9c719ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c58003bc0 0x7f9c6c0c7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:27.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.209+0000 7f9c719ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c6c0c9bf0 0x7f9c6c14c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:27.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.209+0000 7f9c719ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c6c14cec0 0x7f9c6c14bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:27.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.209+0000 7f9c719ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6c1e4b50 con 0x7f9c6c14cec0 2023-07-14T11:19:27.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.209+0000 7f9c719ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6c1e3ed0 con 0x7f9c6c0c9bf0 2023-07-14T11:19:27.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.209+0000 7f9c719ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6c1e41b0 con 0x7f9c58003bc0 2023-07-14T11:19:27.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.209+0000 7f9c6b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c6c14cec0 0x7f9c6c14bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:27.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.209+0000 7f9c6b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c6c14cec0 0x7f9c6c14bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54190/0 (socket says 172.21.15.84:54190) 2023-07-14T11:19:27.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.209+0000 7f9c6b7fe700 1 -- 172.21.15.84:0/3157190553 learned_addr learned my addr 172.21.15.84:0/3157190553 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:27.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.209+0000 7f9c6affd700 1 --2- 172.21.15.84:0/3157190553 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c58003bc0 0x7f9c6c0c7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:27.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.209+0000 7f9c63fff700 1 --2- 172.21.15.84:0/3157190553 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c6c0c9bf0 0x7f9c6c14c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:27.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.209+0000 7f9c6b7fe700 1 -- 172.21.15.84:0/3157190553 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c58003bc0 msgr2=0x7f9c6c0c7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:27.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.209+0000 7f9c6b7fe700 1 --2- 172.21.15.84:0/3157190553 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c58003bc0 0x7f9c6c0c7e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:27.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.209+0000 7f9c6b7fe700 1 -- 172.21.15.84:0/3157190553 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c6c0c9bf0 msgr2=0x7f9c6c14c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:27.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.209+0000 7f9c6b7fe700 1 --2- 172.21.15.84:0/3157190553 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c6c0c9bf0 0x7f9c6c14c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:27.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.209+0000 7f9c6b7fe700 1 -- 172.21.15.84:0/3157190553 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c6c1e4490 con 0x7f9c6c14cec0 2023-07-14T11:19:27.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.209+0000 7f9c63fff700 1 --2- 172.21.15.84:0/3157190553 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c6c0c9bf0 0x7f9c6c14c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:19:27.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.210+0000 7f9c6b7fe700 1 --2- 172.21.15.84:0/3157190553 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c6c14cec0 0x7f9c6c14bb00 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f9c5800bde0 tx=0x7f9c6400e440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:27.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.210+0000 7f9c68ff9700 1 -- 172.21.15.84:0/3157190553 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c6400ec70 con 0x7f9c6c14cec0 2023-07-14T11:19:27.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.210+0000 7f9c68ff9700 1 -- 172.21.15.84:0/3157190553 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c6400edd0 con 0x7f9c6c14cec0 2023-07-14T11:19:27.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.210+0000 7f9c68ff9700 1 -- 172.21.15.84:0/3157190553 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c64013660 con 0x7f9c6c14cec0 2023-07-14T11:19:27.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.210+0000 7f9c719ff700 1 -- 172.21.15.84:0/3157190553 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c6c1e4770 con 0x7f9c6c14cec0 2023-07-14T11:19:27.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.210+0000 7f9c719ff700 1 -- 172.21.15.84:0/3157190553 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c6c0c8590 con 0x7f9c6c14cec0 2023-07-14T11:19:27.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.211+0000 7f9c719ff700 1 -- 172.21.15.84:0/3157190553 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c6c1e4c90 con 0x7f9c6c14cec0 2023-07-14T11:19:27.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.212+0000 7f9c68ff9700 1 -- 172.21.15.84:0/3157190553 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f9c640137c0 con 0x7f9c6c14cec0 2023-07-14T11:19:27.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.213+0000 7f9c68ff9700 1 --2- 172.21.15.84:0/3157190553 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f9c4c06ae00 0x7f9c4c06d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:27.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.213+0000 7f9c68ff9700 1 -- 172.21.15.84:0/3157190553 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9c64089a30 con 0x7f9c6c14cec0 2023-07-14T11:19:27.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.214+0000 7f9c6affd700 1 --2- 172.21.15.84:0/3157190553 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f9c4c06ae00 0x7f9c4c06d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:27.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.214+0000 7f9c6affd700 1 --2- 172.21.15.84:0/3157190553 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f9c4c06ae00 0x7f9c4c06d2b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c0090b0 tx=0x7f9c5c01f040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:27.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.218+0000 7f9c68ff9700 1 -- 172.21.15.84:0/3157190553 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f9c6c1e4c90 con 0x7f9c6c14cec0 2023-07-14T11:19:27.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.458+0000 7f9c719ff700 1 -- 172.21.15.84:0/3157190553 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f9c6c0c8590 con 0x7f9c6c14cec0 2023-07-14T11:19:27.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.976+0000 7f9c68ff9700 1 -- 172.21.15.84:0/3157190553 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v69) v1 ==== 122+0+0 (secure 0 0 0) 0x7f9c6c0c8590 con 0x7f9c6c14cec0 2023-07-14T11:19:27.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.979+0000 7f9c719ff700 1 -- 172.21.15.84:0/3157190553 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f9c4c06ae00 msgr2=0x7f9c4c06d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:27.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.979+0000 7f9c719ff700 1 --2- 172.21.15.84:0/3157190553 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f9c4c06ae00 0x7f9c4c06d2b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c0090b0 tx=0x7f9c5c01f040 comp rx=0 tx=0).stop 2023-07-14T11:19:27.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.979+0000 7f9c719ff700 1 -- 172.21.15.84:0/3157190553 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c6c14cec0 msgr2=0x7f9c6c14bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:27.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.979+0000 7f9c719ff700 1 --2- 172.21.15.84:0/3157190553 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c6c14cec0 0x7f9c6c14bb00 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f9c5800bde0 tx=0x7f9c6400e440 comp rx=0 tx=0).stop 2023-07-14T11:19:27.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.979+0000 7f9c719ff700 1 -- 172.21.15.84:0/3157190553 shutdown_connections 2023-07-14T11:19:27.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.979+0000 7f9c719ff700 1 --2- 172.21.15.84:0/3157190553 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f9c4c06ae00 0x7f9c4c06d2b0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:27.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.979+0000 7f9c719ff700 1 --2- 172.21.15.84:0/3157190553 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c58003bc0 0x7f9c6c0c7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:27.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.979+0000 7f9c719ff700 1 --2- 172.21.15.84:0/3157190553 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c6c14cec0 0x7f9c6c14bb00 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:27.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.979+0000 7f9c719ff700 1 --2- 172.21.15.84:0/3157190553 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c6c0c9bf0 0x7f9c6c14c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:27.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.979+0000 7f9c719ff700 1 -- 172.21.15.84:0/3157190553 >> 172.21.15.84:0/3157190553 conn(0x7f9c6c0b05d0 msgr2=0x7f9c6c0b2880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:27.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.980+0000 7f9c719ff700 1 -- 172.21.15.84:0/3157190553 shutdown_connections 2023-07-14T11:19:27.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:27.980+0000 7f9c719ff700 1 -- 172.21.15.84:0/3157190553 wait complete. 2023-07-14T11:19:28.001 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-14T11:19:28.002 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T11:19:28.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.194+0000 7feebe7ff700 1 Processor -- start 2023-07-14T11:19:28.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.194+0000 7feebe7ff700 1 -- start start 2023-07-14T11:19:28.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.195+0000 7feebe7ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7feeb8158fd0 0x7feeb8070710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:28.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.195+0000 7feebe7ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeb806c110 con 0x7feeb8141ff0 2023-07-14T11:19:28.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.195+0000 7feebe7ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeb8159410 con 0x7feeb80b2180 2023-07-14T11:19:28.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.195+0000 7feebe7ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeb8071140 con 0x7feeb8158fd0 2023-07-14T11:19:28.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.196+0000 7feebcd9c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7feeb8158fd0 0x7feeb8070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:28.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.196+0000 7feebcd9c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7feeb8158fd0 0x7feeb8070710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54196/0 (socket says 172.21.15.84:54196) 2023-07-14T11:19:28.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.196+0000 7feebcd9c700 1 -- 172.21.15.84:0/1984467948 learned_addr learned my addr 172.21.15.84:0/1984467948 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:28.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.196+0000 7feebcd9c700 1 -- 172.21.15.84:0/1984467948 >> v1:172.21.15.179:6789/0 conn(0x7feeb80b2180 legacy=0x7feeb806c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:28.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.196+0000 7feebcd9c700 1 -- 172.21.15.84:0/1984467948 >> v1:172.21.15.84:6789/0 conn(0x7feeb8141ff0 legacy=0x7feeb80b1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:28.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.196+0000 7feebcd9c700 1 -- 172.21.15.84:0/1984467948 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb8070e60 con 0x7feeb8158fd0 2023-07-14T11:19:28.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.196+0000 7feebcd9c700 1 --2- 172.21.15.84:0/1984467948 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feeb8158fd0 0x7feeb8070710 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7feeb000d150 tx=0x7feeb000d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22472f1cd5afda32 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:28.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.196+0000 7feeb77fe700 1 -- 172.21.15.84:0/1984467948 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb0010070 con 0x7feeb8158fd0 2023-07-14T11:19:28.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.197+0000 7feeb77fe700 1 -- 172.21.15.84:0/1984467948 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb000dbb0 con 0x7feeb8158fd0 2023-07-14T11:19:28.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.197+0000 7feeb77fe700 1 -- 172.21.15.84:0/1984467948 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb0016400 con 0x7feeb8158fd0 2023-07-14T11:19:28.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.197+0000 7feebe7ff700 1 -- 172.21.15.84:0/1984467948 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feeb8158fd0 msgr2=0x7feeb8070710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:28.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.197+0000 7feebe7ff700 1 --2- 172.21.15.84:0/1984467948 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feeb8158fd0 0x7feeb8070710 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7feeb000d150 tx=0x7feeb000d460 comp rx=0 tx=0).stop 2023-07-14T11:19:28.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.197+0000 7feebe7ff700 1 -- 172.21.15.84:0/1984467948 shutdown_connections 2023-07-14T11:19:28.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.197+0000 7feebe7ff700 1 --2- 172.21.15.84:0/1984467948 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feeb8158fd0 0x7feeb8070710 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:28.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.197+0000 7feebe7ff700 1 -- 172.21.15.84:0/1984467948 >> 172.21.15.84:0/1984467948 conn(0x7feeb8069f30 msgr2=0x7feeb806a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:28.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.197+0000 7feebe7ff700 1 -- 172.21.15.84:0/1984467948 shutdown_connections 2023-07-14T11:19:28.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.197+0000 7feebe7ff700 1 -- 172.21.15.84:0/1984467948 wait complete. 2023-07-14T11:19:28.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.199+0000 7feebe7ff700 1 Processor -- start 2023-07-14T11:19:28.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.199+0000 7feebe7ff700 1 -- start start 2023-07-14T11:19:28.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.200+0000 7feebe7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feeb80b2180 0x7feeb8139cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:28.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.200+0000 7feebe7ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feeb8141ff0 0x7feeb8157390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:28.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.200+0000 7feebe7ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feeb8158fd0 0x7feeb8146e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:28.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.200+0000 7feebe7ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb8157ec0 con 0x7feeb8158fd0 2023-07-14T11:19:28.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.200+0000 7feebe7ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb80afc00 con 0x7feeb8141ff0 2023-07-14T11:19:28.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.200+0000 7feebe7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeb8157be0 con 0x7feeb80b2180 2023-07-14T11:19:28.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.200+0000 7feebcd9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feeb8158fd0 0x7feeb8146e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:28.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.200+0000 7feebcd9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feeb8158fd0 0x7feeb8146e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54212/0 (socket says 172.21.15.84:54212) 2023-07-14T11:19:28.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.200+0000 7feebcd9c700 1 -- 172.21.15.84:0/1552729033 learned_addr learned my addr 172.21.15.84:0/1552729033 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:28.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.200+0000 7feebcd9c700 1 -- 172.21.15.84:0/1552729033 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feeb80b2180 msgr2=0x7feeb8139cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:28.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.200+0000 7feeb7fff700 1 --2- 172.21.15.84:0/1552729033 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feeb80b2180 0x7feeb8139cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:28.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.200+0000 7feeaffff700 1 --2- 172.21.15.84:0/1552729033 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feeb8141ff0 0x7feeb8157390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:28.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.201+0000 7feebcd9c700 1 --2- 172.21.15.84:0/1552729033 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feeb80b2180 0x7feeb8139cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:28.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.201+0000 7feebcd9c700 1 -- 172.21.15.84:0/1552729033 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feeb8141ff0 msgr2=0x7feeb8157390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:28.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.201+0000 7feebcd9c700 1 --2- 172.21.15.84:0/1552729033 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feeb8141ff0 0x7feeb8157390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:28.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.201+0000 7feebcd9c700 1 -- 172.21.15.84:0/1552729033 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb000bd40 con 0x7feeb8158fd0 2023-07-14T11:19:28.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.201+0000 7feeb7fff700 1 --2- 172.21.15.84:0/1552729033 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feeb80b2180 0x7feeb8139cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:19:28.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.201+0000 7feebcd9c700 1 --2- 172.21.15.84:0/1552729033 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feeb8158fd0 0x7feeb8146e20 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7feeb000d860 tx=0x7feeb0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:28.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.201+0000 7feeb57fa700 1 -- 172.21.15.84:0/1552729033 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb0016400 con 0x7feeb8158fd0 2023-07-14T11:19:28.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.201+0000 7feeb57fa700 1 -- 172.21.15.84:0/1552729033 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb0016e30 con 0x7feeb8158fd0 2023-07-14T11:19:28.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.201+0000 7feeb57fa700 1 -- 172.21.15.84:0/1552729033 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb000b260 con 0x7feeb8158fd0 2023-07-14T11:19:28.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.201+0000 7feebe7ff700 1 -- 172.21.15.84:0/1552729033 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeb80af5b0 con 0x7feeb8158fd0 2023-07-14T11:19:28.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.201+0000 7feebe7ff700 1 -- 172.21.15.84:0/1552729033 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeb81578d0 con 0x7feeb8158fd0 2023-07-14T11:19:28.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.202+0000 7feebe7ff700 1 -- 172.21.15.84:0/1552729033 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeb80af410 con 0x7feeb8158fd0 2023-07-14T11:19:28.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.203+0000 7feeb57fa700 1 -- 172.21.15.84:0/1552729033 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7feeb000b3c0 con 0x7feeb8158fd0 2023-07-14T11:19:28.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.204+0000 7feeb57fa700 1 --2- 172.21.15.84:0/1552729033 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fee9806ae00 0x7fee9806d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:28.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.205+0000 7feeb57fa700 1 -- 172.21.15.84:0/1552729033 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7feeb008d750 con 0x7feeb8158fd0 2023-07-14T11:19:28.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.205+0000 7feeb7fff700 1 --2- 172.21.15.84:0/1552729033 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fee9806ae00 0x7fee9806d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:28.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.206+0000 7feeb7fff700 1 --2- 172.21.15.84:0/1552729033 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fee9806ae00 0x7fee9806d2b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7feea8000f60 tx=0x7feea8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:28.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.209+0000 7feeb57fa700 1 -- 172.21.15.84:0/1552729033 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7feeb80af410 con 0x7feeb8158fd0 2023-07-14T11:19:28.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.448+0000 7feebe7ff700 1 -- 172.21.15.84:0/1552729033 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feeb80af410 con 0x7feeb8158fd0 2023-07-14T11:19:28.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.449+0000 7feeb57fa700 1 -- 172.21.15.84:0/1552729033 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+4711 (secure 0 0 0) 0x7feeb80af410 con 0x7feeb8158fd0 2023-07-14T11:19:28.451 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:19:28.452 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":69,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6197,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/396743399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":396743399},{"type":"v1","addr":"172.21.15.179:6835","nonce":396743399}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":7105,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3729505201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3729505201},{"type":"v1","addr":"172.21.15.179:6834","nonce":3729505201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":7680,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6833/411491873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":411491873},{"type":"v1","addr":"172.21.15.84:6833","nonce":411491873}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T11:19:24.441292+0000","modified":"2023-07-14T11:19:27.974517+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7683},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7683":{"gid":7683,"name":"c","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6835/2350815422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2350815422},{"type":"v1","addr":"172.21.15.84:6835","nonce":2350815422}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-07-14T11:19:28.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.451+0000 7feebe7ff700 1 -- 172.21.15.84:0/1552729033 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fee9806ae00 msgr2=0x7fee9806d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:28.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.451+0000 7feebe7ff700 1 --2- 172.21.15.84:0/1552729033 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fee9806ae00 0x7fee9806d2b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7feea8000f60 tx=0x7feea8009040 comp rx=0 tx=0).stop 2023-07-14T11:19:28.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.451+0000 7feebe7ff700 1 -- 172.21.15.84:0/1552729033 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feeb8158fd0 msgr2=0x7feeb8146e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:28.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.451+0000 7feebe7ff700 1 --2- 172.21.15.84:0/1552729033 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feeb8158fd0 0x7feeb8146e20 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7feeb000d860 tx=0x7feeb0004ad0 comp rx=0 tx=0).stop 2023-07-14T11:19:28.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.451+0000 7feebe7ff700 1 -- 172.21.15.84:0/1552729033 shutdown_connections 2023-07-14T11:19:28.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.451+0000 7feebe7ff700 1 --2- 172.21.15.84:0/1552729033 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fee9806ae00 0x7fee9806d2b0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:28.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.451+0000 7feebe7ff700 1 --2- 172.21.15.84:0/1552729033 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feeb80b2180 0x7feeb8139cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:28.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.451+0000 7feebe7ff700 1 --2- 172.21.15.84:0/1552729033 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feeb8158fd0 0x7feeb8146e20 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:28.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.451+0000 7feebe7ff700 1 --2- 172.21.15.84:0/1552729033 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feeb8141ff0 0x7feeb8157390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:28.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.451+0000 7feebe7ff700 1 -- 172.21.15.84:0/1552729033 >> 172.21.15.84:0/1552729033 conn(0x7feeb8069f30 msgr2=0x7feeb8158670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:28.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.451+0000 7feebe7ff700 1 -- 172.21.15.84:0/1552729033 shutdown_connections 2023-07-14T11:19:28.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.451+0000 7feebe7ff700 1 -- 172.21.15.84:0/1552729033 wait complete. 2023-07-14T11:19:28.456 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 69 2023-07-14T11:19:28.472 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:19:28.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.664+0000 7ff3725ff700 1 Processor -- start 2023-07-14T11:19:28.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.664+0000 7ff3725ff700 1 -- start start 2023-07-14T11:19:28.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.666+0000 7ff3725ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff36c1500d0 0x7ff36c070350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:28.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.666+0000 7ff3725ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff36c0cea50 0x7ff36c0ceeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:28.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.666+0000 7ff3725ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff36c0cdf90 con 0x7ff36c070890 2023-07-14T11:19:28.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.666+0000 7ff3725ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff36c15a2f0 con 0x7ff36c0cea50 2023-07-14T11:19:28.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.666+0000 7ff3725ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff36c15a5d0 con 0x7ff36c1500d0 2023-07-14T11:19:28.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.666+0000 7ff370b9c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff36c0cea50 0x7ff36c0ceeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:28.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.666+0000 7ff370b9c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff36c0cea50 0x7ff36c0ceeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54222/0 (socket says 172.21.15.84:54222) 2023-07-14T11:19:28.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.666+0000 7ff370b9c700 1 -- 172.21.15.84:0/3831875090 learned_addr learned my addr 172.21.15.84:0/3831875090 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:28.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.666+0000 7ff36bfff700 1 --2- 172.21.15.84:0/3831875090 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff36c1500d0 0x7ff36c070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:28.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.666+0000 7ff370b9c700 1 -- 172.21.15.84:0/3831875090 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff36c1500d0 msgr2=0x7ff36c070350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:28.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.666+0000 7ff370b9c700 1 --2- 172.21.15.84:0/3831875090 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff36c1500d0 0x7ff36c070350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:28.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.666+0000 7ff370b9c700 1 -- 172.21.15.84:0/3831875090 >> v1:172.21.15.84:6789/0 conn(0x7ff36c070890 legacy=0x7ff36c1597c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:28.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.666+0000 7ff370b9c700 1 -- 172.21.15.84:0/3831875090 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff36c0ce250 con 0x7ff36c0cea50 2023-07-14T11:19:28.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.666+0000 7ff36affd700 1 -- 172.21.15.84:0/3831875090 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 269768457 0 0) 0x7ff36c0cdf90 con 0x7ff36c070890 2023-07-14T11:19:28.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.667+0000 7ff370b9c700 1 --2- 172.21.15.84:0/3831875090 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff36c0cea50 0x7ff36c0ceeb0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7ff36400d150 tx=0x7ff36400d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=329136c9ed03eb8f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:28.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.667+0000 7ff36affd700 1 -- 172.21.15.84:0/3831875090 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff364010070 con 0x7ff36c0cea50 2023-07-14T11:19:28.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.667+0000 7ff36affd700 1 -- 172.21.15.84:0/3831875090 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff36400ddc0 con 0x7ff36c0cea50 2023-07-14T11:19:28.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.667+0000 7ff36affd700 1 -- 172.21.15.84:0/3831875090 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36400b310 con 0x7ff36c0cea50 2023-07-14T11:19:28.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.667+0000 7ff3725ff700 1 -- 172.21.15.84:0/3831875090 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff36c0cea50 msgr2=0x7ff36c0ceeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:28.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.667+0000 7ff3725ff700 1 --2- 172.21.15.84:0/3831875090 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff36c0cea50 0x7ff36c0ceeb0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7ff36400d150 tx=0x7ff36400d460 comp rx=0 tx=0).stop 2023-07-14T11:19:28.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.667+0000 7ff3725ff700 1 -- 172.21.15.84:0/3831875090 shutdown_connections 2023-07-14T11:19:28.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.667+0000 7ff3725ff700 1 --2- 172.21.15.84:0/3831875090 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff36c0cea50 0x7ff36c0ceeb0 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:28.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.667+0000 7ff3725ff700 1 --2- 172.21.15.84:0/3831875090 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff36c1500d0 0x7ff36c070350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:28.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.668+0000 7ff3725ff700 1 -- 172.21.15.84:0/3831875090 >> 172.21.15.84:0/3831875090 conn(0x7ff36c069f30 msgr2=0x7ff36c06a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:28.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.668+0000 7ff3725ff700 1 -- 172.21.15.84:0/3831875090 shutdown_connections 2023-07-14T11:19:28.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.668+0000 7ff3725ff700 1 -- 172.21.15.84:0/3831875090 wait complete. 2023-07-14T11:19:28.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.669+0000 7ff3725ff700 1 Processor -- start 2023-07-14T11:19:28.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.669+0000 7ff3725ff700 1 -- start start 2023-07-14T11:19:28.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.670+0000 7ff3725ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff36c070890 0x7ff36c1443d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:28.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.670+0000 7ff3725ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff36c0cea50 0x7ff36c1f5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:28.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.670+0000 7ff3725ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff36c1500d0 0x7ff36c158200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:28.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.670+0000 7ff3725ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff36c1df5c0 con 0x7ff36c070890 2023-07-14T11:19:28.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.670+0000 7ff3725ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff36c1f61b0 con 0x7ff36c0cea50 2023-07-14T11:19:28.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.670+0000 7ff3725ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff36c1f6490 con 0x7ff36c1500d0 2023-07-14T11:19:28.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.670+0000 7ff36bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff36c070890 0x7ff36c1443d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:28.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.671+0000 7ff36bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff36c070890 0x7ff36c1443d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54238/0 (socket says 172.21.15.84:54238) 2023-07-14T11:19:28.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.671+0000 7ff36bfff700 1 -- 172.21.15.84:0/1457955433 learned_addr learned my addr 172.21.15.84:0/1457955433 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:28.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.671+0000 7ff370b9c700 1 --2- 172.21.15.84:0/1457955433 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff36c1500d0 0x7ff36c158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:28.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.671+0000 7ff36b7fe700 1 --2- 172.21.15.84:0/1457955433 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff36c0cea50 0x7ff36c1f5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:28.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.671+0000 7ff36bfff700 1 -- 172.21.15.84:0/1457955433 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff36c1500d0 msgr2=0x7ff36c158200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:28.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.671+0000 7ff36bfff700 1 --2- 172.21.15.84:0/1457955433 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff36c1500d0 0x7ff36c158200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:28.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.671+0000 7ff36bfff700 1 -- 172.21.15.84:0/1457955433 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff36c0cea50 msgr2=0x7ff36c1f5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:28.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.671+0000 7ff36bfff700 1 --2- 172.21.15.84:0/1457955433 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff36c0cea50 0x7ff36c1f5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:28.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.671+0000 7ff36bfff700 1 -- 172.21.15.84:0/1457955433 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff36400bd40 con 0x7ff36c070890 2023-07-14T11:19:28.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.671+0000 7ff370b9c700 1 --2- 172.21.15.84:0/1457955433 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff36c1500d0 0x7ff36c158200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:19:28.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.671+0000 7ff36bfff700 1 --2- 172.21.15.84:0/1457955433 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff36c070890 0x7ff36c1443d0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7ff35c00d800 tx=0x7ff35c00dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:28.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.671+0000 7ff368ff9700 1 -- 172.21.15.84:0/1457955433 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35c0125f0 con 0x7ff36c070890 2023-07-14T11:19:28.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.671+0000 7ff368ff9700 1 -- 172.21.15.84:0/1457955433 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff35c012750 con 0x7ff36c070890 2023-07-14T11:19:28.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.671+0000 7ff3725ff700 1 -- 172.21.15.84:0/1457955433 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff36c1df810 con 0x7ff36c070890 2023-07-14T11:19:28.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.671+0000 7ff368ff9700 1 -- 172.21.15.84:0/1457955433 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35c012b00 con 0x7ff36c070890 2023-07-14T11:19:28.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.672+0000 7ff3725ff700 1 -- 172.21.15.84:0/1457955433 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff36c144910 con 0x7ff36c070890 2023-07-14T11:19:28.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.672+0000 7ff3725ff700 1 -- 172.21.15.84:0/1457955433 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff36c1dfe60 con 0x7ff36c070890 2023-07-14T11:19:28.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.673+0000 7ff368ff9700 1 -- 172.21.15.84:0/1457955433 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7ff35c012c60 con 0x7ff36c070890 2023-07-14T11:19:28.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.674+0000 7ff368ff9700 1 --2- 172.21.15.84:0/1457955433 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7ff35806ae00 0x7ff35806d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:28.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.674+0000 7ff368ff9700 1 -- 172.21.15.84:0/1457955433 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff35c089960 con 0x7ff36c070890 2023-07-14T11:19:28.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.675+0000 7ff36b7fe700 1 --2- 172.21.15.84:0/1457955433 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7ff35806ae00 0x7ff35806d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:28.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.676+0000 7ff36b7fe700 1 --2- 172.21.15.84:0/1457955433 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7ff35806ae00 0x7ff35806d2b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff36c1e28b0 tx=0x7ff360009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:28.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.679+0000 7ff368ff9700 1 -- 172.21.15.84:0/1457955433 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ff35c054990 con 0x7ff36c070890 2023-07-14T11:19:28.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.871+0000 7ff3725ff700 1 -- 172.21.15.84:0/1457955433 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff36c0717f0 con 0x7ff36c070890 2023-07-14T11:19:28.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.873+0000 7ff368ff9700 1 -- 172.21.15.84:0/1457955433 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v106) v1 ==== 74+0+18337 (secure 0 0 0) 0x7ff35c057fb0 con 0x7ff36c070890 2023-07-14T11:19:28.875 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:19:28.876 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":106,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:19:25.959900+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-07-14T11:19:22.615201+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-07-14T11:19:23.416792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:19:28.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.875+0000 7ff3725ff700 1 -- 172.21.15.84:0/1457955433 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7ff35806ae00 msgr2=0x7ff35806d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:28.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.875+0000 7ff3725ff700 1 --2- 172.21.15.84:0/1457955433 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7ff35806ae00 0x7ff35806d2b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff36c1e28b0 tx=0x7ff360009040 comp rx=0 tx=0).stop 2023-07-14T11:19:28.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.875+0000 7ff3725ff700 1 -- 172.21.15.84:0/1457955433 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff36c070890 msgr2=0x7ff36c1443d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:28.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.875+0000 7ff3725ff700 1 --2- 172.21.15.84:0/1457955433 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff36c070890 0x7ff36c1443d0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7ff35c00d800 tx=0x7ff35c00dbc0 comp rx=0 tx=0).stop 2023-07-14T11:19:28.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.875+0000 7ff3725ff700 1 -- 172.21.15.84:0/1457955433 shutdown_connections 2023-07-14T11:19:28.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.875+0000 7ff3725ff700 1 --2- 172.21.15.84:0/1457955433 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7ff35806ae00 0x7ff35806d2b0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:28.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.875+0000 7ff3725ff700 1 --2- 172.21.15.84:0/1457955433 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff36c1500d0 0x7ff36c158200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:28.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.875+0000 7ff3725ff700 1 --2- 172.21.15.84:0/1457955433 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff36c070890 0x7ff36c1443d0 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:28.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.875+0000 7ff3725ff700 1 --2- 172.21.15.84:0/1457955433 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff36c0cea50 0x7ff36c1f5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:28.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.875+0000 7ff3725ff700 1 -- 172.21.15.84:0/1457955433 >> 172.21.15.84:0/1457955433 conn(0x7ff36c069f30 msgr2=0x7ff36c0cce40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:28.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.875+0000 7ff3725ff700 1 -- 172.21.15.84:0/1457955433 shutdown_connections 2023-07-14T11:19:28.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:28.875+0000 7ff3725ff700 1 -- 172.21.15.84:0/1457955433 wait complete. 2023-07-14T11:19:28.896 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-14T11:19:28.897 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T11:19:29.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.091+0000 7f0e6979d700 1 Processor -- start 2023-07-14T11:19:29.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.092+0000 7f0e6979d700 1 -- start start 2023-07-14T11:19:29.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.093+0000 7f0e6979d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0e6406ca60 0x7f0e6415d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:29.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.093+0000 7f0e6979d700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e64160870 con 0x7f0e6415d800 2023-07-14T11:19:29.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.093+0000 7f0e6979d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e64160b50 con 0x7f0e64156a80 2023-07-14T11:19:29.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.093+0000 7f0e6979d700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e64160e30 con 0x7f0e6406ca60 2023-07-14T11:19:29.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.093+0000 7f0e637fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0e6406ca60 0x7f0e6415d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:29.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.093+0000 7f0e68f9c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f0e6415d800 0x7f0e640cf670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55394/0 (socket says 172.21.15.84:55394) 2023-07-14T11:19:29.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.093+0000 7f0e68f9c700 1 -- 172.21.15.84:0/1639583377 learned_addr learned my addr 172.21.15.84:0/1639583377 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:19:29.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.093+0000 7f0e637fe700 1 -- 172.21.15.84:0/1639583377 >> v1:172.21.15.179:6789/0 conn(0x7f0e64156a80 legacy=0x7f0e64160040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:29.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.093+0000 7f0e637fe700 1 -- 172.21.15.84:0/1639583377 >> v1:172.21.15.84:6789/0 conn(0x7f0e6415d800 legacy=0x7f0e640cf670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:29.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.093+0000 7f0e637fe700 1 -- 172.21.15.84:0/1639583377 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e6415cda0 con 0x7f0e6406ca60 2023-07-14T11:19:29.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.094+0000 7f0e637fe700 1 --2- 172.21.15.84:0/1639583377 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e6406ca60 0x7f0e6415d2c0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f0e58009840 tx=0x7f0e58009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a609bdbafaea408f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:29.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.094+0000 7f0e62ffd700 1 -- 172.21.15.84:0/1639583377 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e58004230 con 0x7f0e6406ca60 2023-07-14T11:19:29.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.094+0000 7f0e62ffd700 1 -- 172.21.15.84:0/1639583377 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e58004390 con 0x7f0e6406ca60 2023-07-14T11:19:29.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.094+0000 7f0e62ffd700 1 -- 172.21.15.84:0/1639583377 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e580036a0 con 0x7f0e6406ca60 2023-07-14T11:19:29.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.094+0000 7f0e6979d700 1 -- 172.21.15.84:0/1639583377 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e6406ca60 msgr2=0x7f0e6415d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:29.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.094+0000 7f0e6979d700 1 --2- 172.21.15.84:0/1639583377 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e6406ca60 0x7f0e6415d2c0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f0e58009840 tx=0x7f0e58009b50 comp rx=0 tx=0).stop 2023-07-14T11:19:29.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.094+0000 7f0e6979d700 1 -- 172.21.15.84:0/1639583377 shutdown_connections 2023-07-14T11:19:29.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.094+0000 7f0e6979d700 1 --2- 172.21.15.84:0/1639583377 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e6406ca60 0x7f0e6415d2c0 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:29.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.094+0000 7f0e6979d700 1 -- 172.21.15.84:0/1639583377 >> 172.21.15.84:0/1639583377 conn(0x7f0e6406a480 msgr2=0x7f0e6406a850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:29.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.095+0000 7f0e6979d700 1 -- 172.21.15.84:0/1639583377 shutdown_connections 2023-07-14T11:19:29.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.095+0000 7f0e6979d700 1 -- 172.21.15.84:0/1639583377 wait complete. 2023-07-14T11:19:29.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.096+0000 7f0e6979d700 1 Processor -- start 2023-07-14T11:19:29.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.096+0000 7f0e6979d700 1 -- start start 2023-07-14T11:19:29.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.097+0000 7f0e6979d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e6406ca60 0x7f0e641502f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:29.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.097+0000 7f0e6979d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e64156a80 0x7f0e640c6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:29.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.097+0000 7f0e6979d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e6415d800 0x7f0e64154090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:29.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.097+0000 7f0e6979d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e640cb4a0 con 0x7f0e6406ca60 2023-07-14T11:19:29.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.097+0000 7f0e6979d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e64155ef0 con 0x7f0e6415d800 2023-07-14T11:19:29.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.097+0000 7f0e6979d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e64154c00 con 0x7f0e64156a80 2023-07-14T11:19:29.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.097+0000 7f0e63fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e6406ca60 0x7f0e641502f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:29.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.098+0000 7f0e63fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e6406ca60 0x7f0e641502f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40716/0 (socket says 172.21.15.84:40716) 2023-07-14T11:19:29.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.098+0000 7f0e63fff700 1 -- 172.21.15.84:0/3592532786 learned_addr learned my addr 172.21.15.84:0/3592532786 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:29.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.098+0000 7f0e68f9c700 1 --2- 172.21.15.84:0/3592532786 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e6415d800 0x7f0e64154090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:29.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.098+0000 7f0e637fe700 1 --2- 172.21.15.84:0/3592532786 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e64156a80 0x7f0e640c6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:29.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.098+0000 7f0e63fff700 1 -- 172.21.15.84:0/3592532786 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e64156a80 msgr2=0x7f0e640c6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:29.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.098+0000 7f0e63fff700 1 --2- 172.21.15.84:0/3592532786 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e64156a80 0x7f0e640c6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:29.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.098+0000 7f0e63fff700 1 -- 172.21.15.84:0/3592532786 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e6415d800 msgr2=0x7f0e64154090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:29.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.098+0000 7f0e63fff700 1 --2- 172.21.15.84:0/3592532786 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e6415d800 0x7f0e64154090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:29.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.098+0000 7f0e63fff700 1 -- 172.21.15.84:0/3592532786 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e580094a0 con 0x7f0e6406ca60 2023-07-14T11:19:29.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.098+0000 7f0e63fff700 1 --2- 172.21.15.84:0/3592532786 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e6406ca60 0x7f0e641502f0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f0e5400c4d0 tx=0x7f0e5400c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:29.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.099+0000 7f0e60ff9700 1 -- 172.21.15.84:0/3592532786 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e54011790 con 0x7f0e6406ca60 2023-07-14T11:19:29.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.099+0000 7f0e60ff9700 1 -- 172.21.15.84:0/3592532786 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e540118f0 con 0x7f0e6406ca60 2023-07-14T11:19:29.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.099+0000 7f0e6979d700 1 -- 172.21.15.84:0/3592532786 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e64154ee0 con 0x7f0e6406ca60 2023-07-14T11:19:29.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.099+0000 7f0e60ff9700 1 -- 172.21.15.84:0/3592532786 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e54011ca0 con 0x7f0e6406ca60 2023-07-14T11:19:29.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.099+0000 7f0e6979d700 1 -- 172.21.15.84:0/3592532786 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e64150830 con 0x7f0e6406ca60 2023-07-14T11:19:29.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.100+0000 7f0e6979d700 1 -- 172.21.15.84:0/3592532786 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e64155120 con 0x7f0e6406ca60 2023-07-14T11:19:29.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.101+0000 7f0e60ff9700 1 -- 172.21.15.84:0/3592532786 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f0e5401c460 con 0x7f0e6406ca60 2023-07-14T11:19:29.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.101+0000 7f0e60ff9700 1 --2- 172.21.15.84:0/3592532786 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f0e5006ae00 0x7f0e5006d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:29.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.102+0000 7f0e60ff9700 1 -- 172.21.15.84:0/3592532786 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0e54089320 con 0x7f0e6406ca60 2023-07-14T11:19:29.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.102+0000 7f0e637fe700 1 --2- 172.21.15.84:0/3592532786 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f0e5006ae00 0x7f0e5006d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:29.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.103+0000 7f0e637fe700 1 --2- 172.21.15.84:0/3592532786 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f0e5006ae00 0x7f0e5006d2b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0e580090b0 tx=0x7f0e58008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:29.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.106+0000 7f0e60ff9700 1 -- 172.21.15.84:0/3592532786 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f0e540542b0 con 0x7f0e6406ca60 2023-07-14T11:19:29.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.295+0000 7f0e6979d700 1 -- 172.21.15.84:0/3592532786 --> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0e64156e50 con 0x7f0e5006ae00 2023-07-14T11:19:29.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.306+0000 7f0e60ff9700 1 -- 172.21.15.84:0/3592532786 <== mgr.4100 v2:172.21.15.179:6836/2094253834 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306542 (secure 0 0 0) 0x7f0e58006c60 con 0x7f0e5006ae00 2023-07-14T11:19:29.312 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:19:29.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.310+0000 7f0e6979d700 1 -- 172.21.15.84:0/3592532786 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f0e5006ae00 msgr2=0x7f0e5006d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:29.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.310+0000 7f0e6979d700 1 --2- 172.21.15.84:0/3592532786 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f0e5006ae00 0x7f0e5006d2b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0e580090b0 tx=0x7f0e58008030 comp rx=0 tx=0).stop 2023-07-14T11:19:29.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.310+0000 7f0e6979d700 1 -- 172.21.15.84:0/3592532786 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e6406ca60 msgr2=0x7f0e641502f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:29.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.310+0000 7f0e6979d700 1 --2- 172.21.15.84:0/3592532786 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e6406ca60 0x7f0e641502f0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f0e5400c4d0 tx=0x7f0e5400c7e0 comp rx=0 tx=0).stop 2023-07-14T11:19:29.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.310+0000 7f0e6979d700 1 -- 172.21.15.84:0/3592532786 shutdown_connections 2023-07-14T11:19:29.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.310+0000 7f0e6979d700 1 --2- 172.21.15.84:0/3592532786 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e6415d800 0x7f0e64154090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:29.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.310+0000 7f0e6979d700 1 --2- 172.21.15.84:0/3592532786 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e6406ca60 0x7f0e641502f0 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:29.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.310+0000 7f0e6979d700 1 --2- 172.21.15.84:0/3592532786 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f0e5006ae00 0x7f0e5006d2b0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:29.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.310+0000 7f0e6979d700 1 --2- 172.21.15.84:0/3592532786 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e64156a80 0x7f0e640c6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:29.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.310+0000 7f0e6979d700 1 -- 172.21.15.84:0/3592532786 >> 172.21.15.84:0/3592532786 conn(0x7f0e6406a480 msgr2=0x7f0e640d2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:29.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.310+0000 7f0e6979d700 1 -- 172.21.15.84:0/3592532786 shutdown_connections 2023-07-14T11:19:29.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.310+0000 7f0e6979d700 1 -- 172.21.15.84:0/3592532786 wait complete. 2023-07-14T11:19:29.315 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-07-14T11:19:29.331 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2023-07-14T11:19:28.937804+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590480,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":194,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":143,"ondisk_log_size":143,"up":164,"acting":164,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":135,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231096,"kb_used_data":11384,"kb_used_omap":0,"kb_used_meta":219648,"kb_avail":754743624,"statfs":{"total":773094113280,"available":772857470976,"internally_reserved":0,"allocated":11657216,"data_stored":6013429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":224919552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":112,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.997240"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967358+0000","last_change":"2023-07-14T11:19:24.976160+0000","last_active":"2023-07-14T11:19:25.967358+0000","last_peered":"2023-07-14T11:19:25.967358+0000","last_clean":"2023-07-14T11:19:25.967358+0000","last_became_active":"2023-07-14T11:19:24.975861+0000","last_became_peered":"2023-07-14T11:19:24.975861+0000","last_unstale":"2023-07-14T11:19:25.967358+0000","last_undegraded":"2023-07-14T11:19:25.967358+0000","last_fullsized":"2023-07-14T11:19:25.967358+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:52:51.076969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:19:23.938624+0000","last_change":"2023-07-14T11:19:23.938624+0000","last_active":"2023-07-14T11:19:23.938624+0000","last_peered":"2023-07-14T11:19:23.938624+0000","last_clean":"2023-07-14T11:19:23.938624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:23.938624+0000","last_undegraded":"2023-07-14T11:19:23.938624+0000","last_fullsized":"2023-07-14T11:19:23.938624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:19:23.938624+0000","last_change":"2023-07-14T11:19:23.938624+0000","last_active":"2023-07-14T11:19:23.938624+0000","last_peered":"2023-07-14T11:19:23.938624+0000","last_clean":"2023-07-14T11:19:23.938624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:23.938624+0000","last_undegraded":"2023-07-14T11:19:23.938624+0000","last_fullsized":"2023-07-14T11:19:23.938624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:19:23.938624+0000","last_change":"2023-07-14T11:19:23.938624+0000","last_active":"2023-07-14T11:19:23.938624+0000","last_peered":"2023-07-14T11:19:23.938624+0000","last_clean":"2023-07-14T11:19:23.938624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:23.938624+0000","last_undegraded":"2023-07-14T11:19:23.938624+0000","last_fullsized":"2023-07-14T11:19:23.938624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967158+0000","last_change":"2023-07-14T11:19:24.975419+0000","last_active":"2023-07-14T11:19:25.967158+0000","last_peered":"2023-07-14T11:19:25.967158+0000","last_clean":"2023-07-14T11:19:25.967158+0000","last_became_active":"2023-07-14T11:19:24.975150+0000","last_became_peered":"2023-07-14T11:19:24.975150+0000","last_unstale":"2023-07-14T11:19:25.967158+0000","last_undegraded":"2023-07-14T11:19:25.967158+0000","last_fullsized":"2023-07-14T11:19:25.967158+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:06:39.320547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400149+0000","last_change":"2023-07-14T11:19:24.980389+0000","last_active":"2023-07-14T11:19:27.400149+0000","last_peered":"2023-07-14T11:19:27.400149+0000","last_clean":"2023-07-14T11:19:27.400149+0000","last_became_active":"2023-07-14T11:19:24.980134+0000","last_became_peered":"2023-07-14T11:19:24.980134+0000","last_unstale":"2023-07-14T11:19:27.400149+0000","last_undegraded":"2023-07-14T11:19:27.400149+0000","last_fullsized":"2023-07-14T11:19:27.400149+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:53:15.231674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400689+0000","last_change":"2023-07-14T11:19:24.980001+0000","last_active":"2023-07-14T11:19:27.400689+0000","last_peered":"2023-07-14T11:19:27.400689+0000","last_clean":"2023-07-14T11:19:27.400689+0000","last_became_active":"2023-07-14T11:19:24.979653+0000","last_became_peered":"2023-07-14T11:19:24.979653+0000","last_unstale":"2023-07-14T11:19:27.400689+0000","last_undegraded":"2023-07-14T11:19:27.400689+0000","last_fullsized":"2023-07-14T11:19:27.400689+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:14:55.889716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:19:23.938624+0000","last_change":"2023-07-14T11:19:23.938624+0000","last_active":"2023-07-14T11:19:23.938624+0000","last_peered":"2023-07-14T11:19:23.938624+0000","last_clean":"2023-07-14T11:19:23.938624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:23.938624+0000","last_undegraded":"2023-07-14T11:19:23.938624+0000","last_fullsized":"2023-07-14T11:19:23.938624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:19:23.938624+0000","last_change":"2023-07-14T11:19:23.938624+0000","last_active":"2023-07-14T11:19:23.938624+0000","last_peered":"2023-07-14T11:19:23.938624+0000","last_clean":"2023-07-14T11:19:23.938624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:23.938624+0000","last_undegraded":"2023-07-14T11:19:23.938624+0000","last_fullsized":"2023-07-14T11:19:23.938624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.964603+0000","last_change":"2023-07-14T11:19:24.986113+0000","last_active":"2023-07-14T11:19:25.964603+0000","last_peered":"2023-07-14T11:19:25.964603+0000","last_clean":"2023-07-14T11:19:25.964603+0000","last_became_active":"2023-07-14T11:19:24.985802+0000","last_became_peered":"2023-07-14T11:19:24.985802+0000","last_unstale":"2023-07-14T11:19:25.964603+0000","last_undegraded":"2023-07-14T11:19:25.964603+0000","last_fullsized":"2023-07-14T11:19:25.964603+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:48:20.004928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.966858+0000","last_change":"2023-07-14T11:19:24.981712+0000","last_active":"2023-07-14T11:19:25.966858+0000","last_peered":"2023-07-14T11:19:25.966858+0000","last_clean":"2023-07-14T11:19:25.966858+0000","last_became_active":"2023-07-14T11:19:24.981417+0000","last_became_peered":"2023-07-14T11:19:24.981417+0000","last_unstale":"2023-07-14T11:19:25.966858+0000","last_undegraded":"2023-07-14T11:19:25.966858+0000","last_fullsized":"2023-07-14T11:19:25.966858+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:52:06.185710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.401119+0000","last_change":"2023-07-14T11:19:24.981753+0000","last_active":"2023-07-14T11:19:27.401119+0000","last_peered":"2023-07-14T11:19:27.401119+0000","last_clean":"2023-07-14T11:19:27.401119+0000","last_became_active":"2023-07-14T11:19:24.980821+0000","last_became_peered":"2023-07-14T11:19:24.980821+0000","last_unstale":"2023-07-14T11:19:27.401119+0000","last_undegraded":"2023-07-14T11:19:27.401119+0000","last_fullsized":"2023-07-14T11:19:27.401119+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:17:28.127989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.964356+0000","last_change":"2023-07-14T11:19:24.969706+0000","last_active":"2023-07-14T11:19:25.964356+0000","last_peered":"2023-07-14T11:19:25.964356+0000","last_clean":"2023-07-14T11:19:25.964356+0000","last_became_active":"2023-07-14T11:19:24.969426+0000","last_became_peered":"2023-07-14T11:19:24.969426+0000","last_unstale":"2023-07-14T11:19:25.964356+0000","last_undegraded":"2023-07-14T11:19:25.964356+0000","last_fullsized":"2023-07-14T11:19:25.964356+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:45:06.308741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:19:23.938624+0000","last_change":"2023-07-14T11:19:23.938624+0000","last_active":"2023-07-14T11:19:23.938624+0000","last_peered":"2023-07-14T11:19:23.938624+0000","last_clean":"2023-07-14T11:19:23.938624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:23.938624+0000","last_undegraded":"2023-07-14T11:19:23.938624+0000","last_fullsized":"2023-07-14T11:19:23.938624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967511+0000","last_change":"2023-07-14T11:19:24.981766+0000","last_active":"2023-07-14T11:19:25.967511+0000","last_peered":"2023-07-14T11:19:25.967511+0000","last_clean":"2023-07-14T11:19:25.967511+0000","last_became_active":"2023-07-14T11:19:24.981081+0000","last_became_peered":"2023-07-14T11:19:24.981081+0000","last_unstale":"2023-07-14T11:19:25.967511+0000","last_undegraded":"2023-07-14T11:19:25.967511+0000","last_fullsized":"2023-07-14T11:19:25.967511+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:53:41.464458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400197+0000","last_change":"2023-07-14T11:19:24.980504+0000","last_active":"2023-07-14T11:19:27.400197+0000","last_peered":"2023-07-14T11:19:27.400197+0000","last_clean":"2023-07-14T11:19:27.400197+0000","last_became_active":"2023-07-14T11:19:24.980260+0000","last_became_peered":"2023-07-14T11:19:24.980260+0000","last_unstale":"2023-07-14T11:19:27.400197+0000","last_undegraded":"2023-07-14T11:19:27.400197+0000","last_fullsized":"2023-07-14T11:19:27.400197+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:14:30.331432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.964757+0000","last_change":"2023-07-14T11:19:24.974486+0000","last_active":"2023-07-14T11:19:25.964757+0000","last_peered":"2023-07-14T11:19:25.964757+0000","last_clean":"2023-07-14T11:19:25.964757+0000","last_became_active":"2023-07-14T11:19:24.974200+0000","last_became_peered":"2023-07-14T11:19:24.974200+0000","last_unstale":"2023-07-14T11:19:25.964757+0000","last_undegraded":"2023-07-14T11:19:25.964757+0000","last_fullsized":"2023-07-14T11:19:25.964757+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:24:28.100458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:19:23.938624+0000","last_change":"2023-07-14T11:19:23.938624+0000","last_active":"2023-07-14T11:19:23.938624+0000","last_peered":"2023-07-14T11:19:23.938624+0000","last_clean":"2023-07-14T11:19:23.938624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:23.938624+0000","last_undegraded":"2023-07-14T11:19:23.938624+0000","last_fullsized":"2023-07-14T11:19:23.938624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:19:23.938624+0000","last_change":"2023-07-14T11:19:23.938624+0000","last_active":"2023-07-14T11:19:23.938624+0000","last_peered":"2023-07-14T11:19:23.938624+0000","last_clean":"2023-07-14T11:19:23.938624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:23.938624+0000","last_undegraded":"2023-07-14T11:19:23.938624+0000","last_fullsized":"2023-07-14T11:19:23.938624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400466+0000","last_change":"2023-07-14T11:19:24.990479+0000","last_active":"2023-07-14T11:19:27.400466+0000","last_peered":"2023-07-14T11:19:27.400466+0000","last_clean":"2023-07-14T11:19:27.400466+0000","last_became_active":"2023-07-14T11:19:24.990017+0000","last_became_peered":"2023-07-14T11:19:24.990017+0000","last_unstale":"2023-07-14T11:19:27.400466+0000","last_undegraded":"2023-07-14T11:19:27.400466+0000","last_fullsized":"2023-07-14T11:19:27.400466+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:06:38.269911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:19:23.938624+0000","last_change":"2023-07-14T11:19:23.938624+0000","last_active":"2023-07-14T11:19:23.938624+0000","last_peered":"2023-07-14T11:19:23.938624+0000","last_clean":"2023-07-14T11:19:23.938624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:23.938624+0000","last_undegraded":"2023-07-14T11:19:23.938624+0000","last_fullsized":"2023-07-14T11:19:23.938624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967103+0000","last_change":"2023-07-14T11:19:24.983855+0000","last_active":"2023-07-14T11:19:25.967103+0000","last_peered":"2023-07-14T11:19:25.967103+0000","last_clean":"2023-07-14T11:19:25.967103+0000","last_became_active":"2023-07-14T11:19:24.983432+0000","last_became_peered":"2023-07-14T11:19:24.983432+0000","last_unstale":"2023-07-14T11:19:25.967103+0000","last_undegraded":"2023-07-14T11:19:25.967103+0000","last_fullsized":"2023-07-14T11:19:25.967103+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:10:43.341934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:19:23.938624+0000","last_change":"2023-07-14T11:19:23.938624+0000","last_active":"2023-07-14T11:19:23.938624+0000","last_peered":"2023-07-14T11:19:23.938624+0000","last_clean":"2023-07-14T11:19:23.938624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:23.938624+0000","last_undegraded":"2023-07-14T11:19:23.938624+0000","last_fullsized":"2023-07-14T11:19:23.938624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967396+0000","last_change":"2023-07-14T11:19:24.975332+0000","last_active":"2023-07-14T11:19:25.967396+0000","last_peered":"2023-07-14T11:19:25.967396+0000","last_clean":"2023-07-14T11:19:25.967396+0000","last_became_active":"2023-07-14T11:19:24.974888+0000","last_became_peered":"2023-07-14T11:19:24.974888+0000","last_unstale":"2023-07-14T11:19:25.967396+0000","last_undegraded":"2023-07-14T11:19:25.967396+0000","last_fullsized":"2023-07-14T11:19:25.967396+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:27:43.025658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.968145+0000","last_change":"2023-07-14T11:19:24.986904+0000","last_active":"2023-07-14T11:19:25.968145+0000","last_peered":"2023-07-14T11:19:25.968145+0000","last_clean":"2023-07-14T11:19:25.968145+0000","last_became_active":"2023-07-14T11:19:24.986246+0000","last_became_peered":"2023-07-14T11:19:24.986246+0000","last_unstale":"2023-07-14T11:19:25.968145+0000","last_undegraded":"2023-07-14T11:19:25.968145+0000","last_fullsized":"2023-07-14T11:19:25.968145+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:36:57.980619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400824+0000","last_change":"2023-07-14T11:19:24.980011+0000","last_active":"2023-07-14T11:19:27.400824+0000","last_peered":"2023-07-14T11:19:27.400824+0000","last_clean":"2023-07-14T11:19:27.400824+0000","last_became_active":"2023-07-14T11:19:24.979707+0000","last_became_peered":"2023-07-14T11:19:24.979707+0000","last_unstale":"2023-07-14T11:19:27.400824+0000","last_undegraded":"2023-07-14T11:19:27.400824+0000","last_fullsized":"2023-07-14T11:19:27.400824+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:20:25.338974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:19:23.938624+0000","last_change":"2023-07-14T11:19:23.938624+0000","last_active":"2023-07-14T11:19:23.938624+0000","last_peered":"2023-07-14T11:19:23.938624+0000","last_clean":"2023-07-14T11:19:23.938624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:23.938624+0000","last_undegraded":"2023-07-14T11:19:23.938624+0000","last_fullsized":"2023-07-14T11:19:23.938624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400991+0000","last_change":"2023-07-14T11:19:24.982086+0000","last_active":"2023-07-14T11:19:27.400991+0000","last_peered":"2023-07-14T11:19:27.400991+0000","last_clean":"2023-07-14T11:19:27.400991+0000","last_became_active":"2023-07-14T11:19:24.981377+0000","last_became_peered":"2023-07-14T11:19:24.981377+0000","last_unstale":"2023-07-14T11:19:27.400991+0000","last_undegraded":"2023-07-14T11:19:27.400991+0000","last_fullsized":"2023-07-14T11:19:27.400991+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:19:51.206070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.399944+0000","last_change":"2023-07-14T11:19:24.984485+0000","last_active":"2023-07-14T11:19:27.399944+0000","last_peered":"2023-07-14T11:19:27.399944+0000","last_clean":"2023-07-14T11:19:27.399944+0000","last_became_active":"2023-07-14T11:19:24.984144+0000","last_became_peered":"2023-07-14T11:19:24.984144+0000","last_unstale":"2023-07-14T11:19:27.399944+0000","last_undegraded":"2023-07-14T11:19:27.399944+0000","last_fullsized":"2023-07-14T11:19:27.399944+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:41:49.903922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:19:23.938624+0000","last_change":"2023-07-14T11:19:23.938624+0000","last_active":"2023-07-14T11:19:23.938624+0000","last_peered":"2023-07-14T11:19:23.938624+0000","last_clean":"2023-07-14T11:19:23.938624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:23.938624+0000","last_undegraded":"2023-07-14T11:19:23.938624+0000","last_fullsized":"2023-07-14T11:19:23.938624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967193+0000","last_change":"2023-07-14T11:19:24.981395+0000","last_active":"2023-07-14T11:19:25.967193+0000","last_peered":"2023-07-14T11:19:25.967193+0000","last_clean":"2023-07-14T11:19:25.967193+0000","last_became_active":"2023-07-14T11:19:24.980523+0000","last_became_peered":"2023-07-14T11:19:24.980523+0000","last_unstale":"2023-07-14T11:19:25.967193+0000","last_undegraded":"2023-07-14T11:19:25.967193+0000","last_fullsized":"2023-07-14T11:19:25.967193+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:04:50.668701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.966856+0000","last_change":"2023-07-14T11:19:24.975124+0000","last_active":"2023-07-14T11:19:25.966856+0000","last_peered":"2023-07-14T11:19:25.966856+0000","last_clean":"2023-07-14T11:19:25.966856+0000","last_became_active":"2023-07-14T11:19:24.974559+0000","last_became_peered":"2023-07-14T11:19:24.974559+0000","last_unstale":"2023-07-14T11:19:25.966856+0000","last_undegraded":"2023-07-14T11:19:25.966856+0000","last_fullsized":"2023-07-14T11:19:25.966856+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:05:30.379389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.964378+0000","last_change":"2023-07-14T11:19:24.985367+0000","last_active":"2023-07-14T11:19:25.964378+0000","last_peered":"2023-07-14T11:19:25.964378+0000","last_clean":"2023-07-14T11:19:25.964378+0000","last_became_active":"2023-07-14T11:19:24.984934+0000","last_became_peered":"2023-07-14T11:19:24.984934+0000","last_unstale":"2023-07-14T11:19:25.964378+0000","last_undegraded":"2023-07-14T11:19:25.964378+0000","last_fullsized":"2023-07-14T11:19:25.964378+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:30:06.079180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-07-14T11:19:22.947281+0000","last_change":"2023-07-14T11:19:22.947281+0000","last_active":"2023-07-14T11:19:22.930757+0000","last_peered":"2023-07-14T11:19:22.930757+0000","last_clean":"2023-07-14T11:19:22.930757+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:22.947281+0000","last_undegraded":"2023-07-14T11:19:22.947281+0000","last_fullsized":"2023-07-14T11:19:22.947281+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400906+0000","last_change":"2023-07-14T11:19:24.985452+0000","last_active":"2023-07-14T11:19:27.400906+0000","last_peered":"2023-07-14T11:19:27.400906+0000","last_clean":"2023-07-14T11:19:27.400906+0000","last_became_active":"2023-07-14T11:19:24.983795+0000","last_became_peered":"2023-07-14T11:19:24.983795+0000","last_unstale":"2023-07-14T11:19:27.400906+0000","last_undegraded":"2023-07-14T11:19:27.400906+0000","last_fullsized":"2023-07-14T11:19:27.400906+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:42:39.569277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"105'1","reported_seq":14,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.964705+0000","last_change":"2023-07-14T11:19:23.957148+0000","last_active":"2023-07-14T11:19:25.964705+0000","last_peered":"2023-07-14T11:19:25.964705+0000","last_clean":"2023-07-14T11:19:25.964705+0000","last_became_active":"2023-07-14T11:19:23.956826+0000","last_became_peered":"2023-07-14T11:19:23.956826+0000","last_unstale":"2023-07-14T11:19:25.964705+0000","last_undegraded":"2023-07-14T11:19:25.964705+0000","last_fullsized":"2023-07-14T11:19:25.964705+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:40:31.643180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967855+0000","last_change":"2023-07-14T11:19:24.981190+0000","last_active":"2023-07-14T11:19:25.967855+0000","last_peered":"2023-07-14T11:19:25.967855+0000","last_clean":"2023-07-14T11:19:25.967855+0000","last_became_active":"2023-07-14T11:19:24.980911+0000","last_became_peered":"2023-07-14T11:19:24.980911+0000","last_unstale":"2023-07-14T11:19:25.967855+0000","last_undegraded":"2023-07-14T11:19:25.967855+0000","last_fullsized":"2023-07-14T11:19:25.967855+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:45:06.083751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-07-14T11:19:22.948199+0000","last_change":"2023-07-14T11:19:22.948199+0000","last_active":"2023-07-14T11:19:22.930757+0000","last_peered":"2023-07-14T11:19:22.930757+0000","last_clean":"2023-07-14T11:19:22.930757+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:22.948199+0000","last_undegraded":"2023-07-14T11:19:22.948199+0000","last_fullsized":"2023-07-14T11:19:22.948199+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:19:23.938624+0000","last_change":"2023-07-14T11:19:23.938624+0000","last_active":"2023-07-14T11:19:23.938624+0000","last_peered":"2023-07-14T11:19:23.938624+0000","last_clean":"2023-07-14T11:19:23.938624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:23.938624+0000","last_undegraded":"2023-07-14T11:19:23.938624+0000","last_fullsized":"2023-07-14T11:19:23.938624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1c","version":"105'2","reported_seq":15,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.964353+0000","last_change":"2023-07-14T11:19:23.963900+0000","last_active":"2023-07-14T11:19:25.964353+0000","last_peered":"2023-07-14T11:19:25.964353+0000","last_clean":"2023-07-14T11:19:25.964353+0000","last_became_active":"2023-07-14T11:19:23.963623+0000","last_became_peered":"2023-07-14T11:19:23.963623+0000","last_unstale":"2023-07-14T11:19:25.964353+0000","last_undegraded":"2023-07-14T11:19:25.964353+0000","last_fullsized":"2023-07-14T11:19:25.964353+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:25:03.366408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.964152+0000","last_change":"2023-07-14T11:19:24.971636+0000","last_active":"2023-07-14T11:19:25.964152+0000","last_peered":"2023-07-14T11:19:25.964152+0000","last_clean":"2023-07-14T11:19:25.964152+0000","last_became_active":"2023-07-14T11:19:24.971328+0000","last_became_peered":"2023-07-14T11:19:24.971328+0000","last_unstale":"2023-07-14T11:19:25.964152+0000","last_undegraded":"2023-07-14T11:19:25.964152+0000","last_fullsized":"2023-07-14T11:19:25.964152+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:48:38.451247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"105'1","reported_seq":14,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967274+0000","last_change":"2023-07-14T11:19:23.962575+0000","last_active":"2023-07-14T11:19:25.967274+0000","last_peered":"2023-07-14T11:19:25.967274+0000","last_clean":"2023-07-14T11:19:25.967274+0000","last_became_active":"2023-07-14T11:19:23.962299+0000","last_became_peered":"2023-07-14T11:19:23.962299+0000","last_unstale":"2023-07-14T11:19:25.967274+0000","last_undegraded":"2023-07-14T11:19:25.967274+0000","last_fullsized":"2023-07-14T11:19:25.967274+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:56:49.505955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.966859+0000","last_change":"2023-07-14T11:19:24.981916+0000","last_active":"2023-07-14T11:19:25.966859+0000","last_peered":"2023-07-14T11:19:25.966859+0000","last_clean":"2023-07-14T11:19:25.966859+0000","last_became_active":"2023-07-14T11:19:24.981458+0000","last_became_peered":"2023-07-14T11:19:24.981458+0000","last_unstale":"2023-07-14T11:19:25.966859+0000","last_undegraded":"2023-07-14T11:19:25.966859+0000","last_fullsized":"2023-07-14T11:19:25.966859+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:33:58.183494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"105'1","reported_seq":14,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400247+0000","last_change":"2023-07-14T11:19:23.965613+0000","last_active":"2023-07-14T11:19:27.400247+0000","last_peered":"2023-07-14T11:19:27.400247+0000","last_clean":"2023-07-14T11:19:27.400247+0000","last_became_active":"2023-07-14T11:19:23.965357+0000","last_became_peered":"2023-07-14T11:19:23.965357+0000","last_unstale":"2023-07-14T11:19:27.400247+0000","last_undegraded":"2023-07-14T11:19:27.400247+0000","last_fullsized":"2023-07-14T11:19:27.400247+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:45:25.952053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:19:23.938624+0000","last_change":"2023-07-14T11:19:23.938624+0000","last_active":"2023-07-14T11:19:23.938624+0000","last_peered":"2023-07-14T11:19:23.938624+0000","last_clean":"2023-07-14T11:19:23.938624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:23.938624+0000","last_undegraded":"2023-07-14T11:19:23.938624+0000","last_fullsized":"2023-07-14T11:19:23.938624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967284+0000","last_change":"2023-07-14T11:19:23.963545+0000","last_active":"2023-07-14T11:19:25.967284+0000","last_peered":"2023-07-14T11:19:25.967284+0000","last_clean":"2023-07-14T11:19:25.967284+0000","last_became_active":"2023-07-14T11:19:23.963258+0000","last_became_peered":"2023-07-14T11:19:23.963258+0000","last_unstale":"2023-07-14T11:19:25.967284+0000","last_undegraded":"2023-07-14T11:19:25.967284+0000","last_fullsized":"2023-07-14T11:19:25.967284+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:52:08.897066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.964495+0000","last_change":"2023-07-14T11:19:24.963229+0000","last_active":"2023-07-14T11:19:25.964495+0000","last_peered":"2023-07-14T11:19:25.964495+0000","last_clean":"2023-07-14T11:19:25.964495+0000","last_became_active":"2023-07-14T11:19:24.962953+0000","last_became_peered":"2023-07-14T11:19:24.962953+0000","last_unstale":"2023-07-14T11:19:25.964495+0000","last_undegraded":"2023-07-14T11:19:25.964495+0000","last_fullsized":"2023-07-14T11:19:25.964495+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:01:44.444334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400404+0000","last_change":"2023-07-14T11:19:23.967430+0000","last_active":"2023-07-14T11:19:27.400404+0000","last_peered":"2023-07-14T11:19:27.400404+0000","last_clean":"2023-07-14T11:19:27.400404+0000","last_became_active":"2023-07-14T11:19:23.967136+0000","last_became_peered":"2023-07-14T11:19:23.967136+0000","last_unstale":"2023-07-14T11:19:27.400404+0000","last_undegraded":"2023-07-14T11:19:27.400404+0000","last_fullsized":"2023-07-14T11:19:27.400404+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:52:17.347729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967669+0000","last_change":"2023-07-14T11:19:24.984882+0000","last_active":"2023-07-14T11:19:25.967669+0000","last_peered":"2023-07-14T11:19:25.967669+0000","last_clean":"2023-07-14T11:19:25.967669+0000","last_became_active":"2023-07-14T11:19:24.984584+0000","last_became_peered":"2023-07-14T11:19:24.984584+0000","last_unstale":"2023-07-14T11:19:25.967669+0000","last_undegraded":"2023-07-14T11:19:25.967669+0000","last_fullsized":"2023-07-14T11:19:25.967669+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:15:45.414169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"105'1","reported_seq":14,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.964627+0000","last_change":"2023-07-14T11:19:23.966279+0000","last_active":"2023-07-14T11:19:25.964627+0000","last_peered":"2023-07-14T11:19:25.964627+0000","last_clean":"2023-07-14T11:19:25.964627+0000","last_became_active":"2023-07-14T11:19:23.965983+0000","last_became_peered":"2023-07-14T11:19:23.965983+0000","last_unstale":"2023-07-14T11:19:25.964627+0000","last_undegraded":"2023-07-14T11:19:25.964627+0000","last_fullsized":"2023-07-14T11:19:25.964627+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:37:11.528205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967019+0000","last_change":"2023-07-14T11:19:24.976404+0000","last_active":"2023-07-14T11:19:25.967019+0000","last_peered":"2023-07-14T11:19:25.967019+0000","last_clean":"2023-07-14T11:19:25.967019+0000","last_became_active":"2023-07-14T11:19:24.975878+0000","last_became_peered":"2023-07-14T11:19:24.975878+0000","last_unstale":"2023-07-14T11:19:25.967019+0000","last_undegraded":"2023-07-14T11:19:25.967019+0000","last_fullsized":"2023-07-14T11:19:25.967019+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:35:40.868054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"105'2","reported_seq":15,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400912+0000","last_change":"2023-07-14T11:19:23.970931+0000","last_active":"2023-07-14T11:19:27.400912+0000","last_peered":"2023-07-14T11:19:27.400912+0000","last_clean":"2023-07-14T11:19:27.400912+0000","last_became_active":"2023-07-14T11:19:23.970611+0000","last_became_peered":"2023-07-14T11:19:23.970611+0000","last_unstale":"2023-07-14T11:19:27.400912+0000","last_undegraded":"2023-07-14T11:19:27.400912+0000","last_fullsized":"2023-07-14T11:19:27.400912+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:00:57.799054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.401192+0000","last_change":"2023-07-14T11:19:24.983441+0000","last_active":"2023-07-14T11:19:27.401192+0000","last_peered":"2023-07-14T11:19:27.401192+0000","last_clean":"2023-07-14T11:19:27.401192+0000","last_became_active":"2023-07-14T11:19:24.983143+0000","last_became_peered":"2023-07-14T11:19:24.983143+0000","last_unstale":"2023-07-14T11:19:27.401192+0000","last_undegraded":"2023-07-14T11:19:27.401192+0000","last_fullsized":"2023-07-14T11:19:27.401192+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:43:03.332951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-07-14T11:19:22.947732+0000","last_change":"2023-07-14T11:19:22.947732+0000","last_active":"2023-07-14T11:19:22.930757+0000","last_peered":"2023-07-14T11:19:22.930757+0000","last_clean":"2023-07-14T11:19:22.930757+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:22.947732+0000","last_undegraded":"2023-07-14T11:19:22.947732+0000","last_fullsized":"2023-07-14T11:19:22.947732+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.968229+0000","last_change":"2023-07-14T11:19:24.981805+0000","last_active":"2023-07-14T11:19:25.968229+0000","last_peered":"2023-07-14T11:19:25.968229+0000","last_clean":"2023-07-14T11:19:25.968229+0000","last_became_active":"2023-07-14T11:19:24.981478+0000","last_became_peered":"2023-07-14T11:19:24.981478+0000","last_unstale":"2023-07-14T11:19:25.968229+0000","last_undegraded":"2023-07-14T11:19:25.968229+0000","last_fullsized":"2023-07-14T11:19:25.968229+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:52:18.355596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-07-14T11:19:22.948728+0000","last_change":"2023-07-14T11:19:22.948728+0000","last_active":"2023-07-14T11:19:22.930757+0000","last_peered":"2023-07-14T11:19:22.930757+0000","last_clean":"2023-07-14T11:19:22.930757+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:22.948728+0000","last_undegraded":"2023-07-14T11:19:22.948728+0000","last_fullsized":"2023-07-14T11:19:22.948728+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400328+0000","last_change":"2023-07-14T11:19:24.982953+0000","last_active":"2023-07-14T11:19:27.400328+0000","last_peered":"2023-07-14T11:19:27.400328+0000","last_clean":"2023-07-14T11:19:27.400328+0000","last_became_active":"2023-07-14T11:19:24.982715+0000","last_became_peered":"2023-07-14T11:19:24.982715+0000","last_unstale":"2023-07-14T11:19:27.400328+0000","last_undegraded":"2023-07-14T11:19:27.400328+0000","last_fullsized":"2023-07-14T11:19:27.400328+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:36:57.980619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"105'2","reported_seq":15,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.399715+0000","last_change":"2023-07-14T11:19:23.969963+0000","last_active":"2023-07-14T11:19:27.399715+0000","last_peered":"2023-07-14T11:19:27.399715+0000","last_clean":"2023-07-14T11:19:27.399715+0000","last_became_active":"2023-07-14T11:19:23.969677+0000","last_became_peered":"2023-07-14T11:19:23.969677+0000","last_unstale":"2023-07-14T11:19:27.399715+0000","last_undegraded":"2023-07-14T11:19:27.399715+0000","last_fullsized":"2023-07-14T11:19:27.399715+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:45:05.075884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:19:23.938624+0000","last_change":"2023-07-14T11:19:23.938624+0000","last_active":"2023-07-14T11:19:23.938624+0000","last_peered":"2023-07-14T11:19:23.938624+0000","last_clean":"2023-07-14T11:19:23.938624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:23.938624+0000","last_undegraded":"2023-07-14T11:19:23.938624+0000","last_fullsized":"2023-07-14T11:19:23.938624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-07-14T11:19:22.947660+0000","last_change":"2023-07-14T11:19:22.947660+0000","last_active":"2023-07-14T11:19:22.930757+0000","last_peered":"2023-07-14T11:19:22.930757+0000","last_clean":"2023-07-14T11:19:22.930757+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:22.947660+0000","last_undegraded":"2023-07-14T11:19:22.947660+0000","last_fullsized":"2023-07-14T11:19:22.947660+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:19:23.938624+0000","last_change":"2023-07-14T11:19:23.938624+0000","last_active":"2023-07-14T11:19:23.938624+0000","last_peered":"2023-07-14T11:19:23.938624+0000","last_clean":"2023-07-14T11:19:23.938624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:23.938624+0000","last_undegraded":"2023-07-14T11:19:23.938624+0000","last_fullsized":"2023-07-14T11:19:23.938624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-07-14T11:19:22.945911+0000","last_change":"2023-07-14T11:19:22.945911+0000","last_active":"2023-07-14T11:19:22.930757+0000","last_peered":"2023-07-14T11:19:22.930757+0000","last_clean":"2023-07-14T11:19:22.930757+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:22.945911+0000","last_undegraded":"2023-07-14T11:19:22.945911+0000","last_fullsized":"2023-07-14T11:19:22.945911+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967601+0000","last_change":"2023-07-14T11:19:24.978534+0000","last_active":"2023-07-14T11:19:25.967601+0000","last_peered":"2023-07-14T11:19:25.967601+0000","last_clean":"2023-07-14T11:19:25.967601+0000","last_became_active":"2023-07-14T11:19:24.978198+0000","last_became_peered":"2023-07-14T11:19:24.978198+0000","last_unstale":"2023-07-14T11:19:25.967601+0000","last_undegraded":"2023-07-14T11:19:25.967601+0000","last_fullsized":"2023-07-14T11:19:25.967601+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:28:09.892883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-07-14T11:19:22.949000+0000","last_change":"2023-07-14T11:19:22.949000+0000","last_active":"2023-07-14T11:19:22.930757+0000","last_peered":"2023-07-14T11:19:22.930757+0000","last_clean":"2023-07-14T11:19:22.930757+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:22.949000+0000","last_undegraded":"2023-07-14T11:19:22.949000+0000","last_fullsized":"2023-07-14T11:19:22.949000+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.401189+0000","last_change":"2023-07-14T11:19:24.981929+0000","last_active":"2023-07-14T11:19:27.401189+0000","last_peered":"2023-07-14T11:19:27.401189+0000","last_clean":"2023-07-14T11:19:27.401189+0000","last_became_active":"2023-07-14T11:19:24.981116+0000","last_became_peered":"2023-07-14T11:19:24.981116+0000","last_unstale":"2023-07-14T11:19:27.401189+0000","last_undegraded":"2023-07-14T11:19:27.401189+0000","last_fullsized":"2023-07-14T11:19:27.401189+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:11:36.584744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"105'2","reported_seq":15,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400000+0000","last_change":"2023-07-14T11:19:23.964927+0000","last_active":"2023-07-14T11:19:27.400000+0000","last_peered":"2023-07-14T11:19:27.400000+0000","last_clean":"2023-07-14T11:19:27.400000+0000","last_became_active":"2023-07-14T11:19:23.964561+0000","last_became_peered":"2023-07-14T11:19:23.964561+0000","last_unstale":"2023-07-14T11:19:27.400000+0000","last_undegraded":"2023-07-14T11:19:27.400000+0000","last_fullsized":"2023-07-14T11:19:27.400000+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:56:43.945140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.964338+0000","last_change":"2023-07-14T11:19:24.971692+0000","last_active":"2023-07-14T11:19:25.964338+0000","last_peered":"2023-07-14T11:19:25.964338+0000","last_clean":"2023-07-14T11:19:25.964338+0000","last_became_active":"2023-07-14T11:19:24.971436+0000","last_became_peered":"2023-07-14T11:19:24.971436+0000","last_unstale":"2023-07-14T11:19:25.964338+0000","last_undegraded":"2023-07-14T11:19:25.964338+0000","last_fullsized":"2023-07-14T11:19:25.964338+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:57:11.662188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-07-14T11:19:22.946542+0000","last_change":"2023-07-14T11:19:22.946542+0000","last_active":"2023-07-14T11:19:22.930757+0000","last_peered":"2023-07-14T11:19:22.930757+0000","last_clean":"2023-07-14T11:19:22.930757+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:22.946542+0000","last_undegraded":"2023-07-14T11:19:22.946542+0000","last_fullsized":"2023-07-14T11:19:22.946542+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:19:23.938624+0000","last_change":"2023-07-14T11:19:23.938624+0000","last_active":"2023-07-14T11:19:23.938624+0000","last_peered":"2023-07-14T11:19:23.938624+0000","last_clean":"2023-07-14T11:19:23.938624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:23.938624+0000","last_undegraded":"2023-07-14T11:19:23.938624+0000","last_fullsized":"2023-07-14T11:19:23.938624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-07-14T11:19:22.946466+0000","last_change":"2023-07-14T11:19:22.946466+0000","last_active":"2023-07-14T11:19:22.930757+0000","last_peered":"2023-07-14T11:19:22.930757+0000","last_clean":"2023-07-14T11:19:22.930757+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:22.946466+0000","last_undegraded":"2023-07-14T11:19:22.946466+0000","last_fullsized":"2023-07-14T11:19:22.946466+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400005+0000","last_change":"2023-07-14T11:19:24.982564+0000","last_active":"2023-07-14T11:19:27.400005+0000","last_peered":"2023-07-14T11:19:27.400005+0000","last_clean":"2023-07-14T11:19:27.400005+0000","last_became_active":"2023-07-14T11:19:24.982238+0000","last_became_peered":"2023-07-14T11:19:24.982238+0000","last_unstale":"2023-07-14T11:19:27.400005+0000","last_undegraded":"2023-07-14T11:19:27.400005+0000","last_fullsized":"2023-07-14T11:19:27.400005+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:48:10.260203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.401208+0000","last_change":"2023-07-14T11:19:23.967504+0000","last_active":"2023-07-14T11:19:27.401208+0000","last_peered":"2023-07-14T11:19:27.401208+0000","last_clean":"2023-07-14T11:19:27.401208+0000","last_became_active":"2023-07-14T11:19:23.967103+0000","last_became_peered":"2023-07-14T11:19:23.967103+0000","last_unstale":"2023-07-14T11:19:27.401208+0000","last_undegraded":"2023-07-14T11:19:27.401208+0000","last_fullsized":"2023-07-14T11:19:27.401208+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:06:38.495123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400575+0000","last_change":"2023-07-14T11:19:24.980008+0000","last_active":"2023-07-14T11:19:27.400575+0000","last_peered":"2023-07-14T11:19:27.400575+0000","last_clean":"2023-07-14T11:19:27.400575+0000","last_became_active":"2023-07-14T11:19:24.979729+0000","last_became_peered":"2023-07-14T11:19:24.979729+0000","last_unstale":"2023-07-14T11:19:27.400575+0000","last_undegraded":"2023-07-14T11:19:27.400575+0000","last_fullsized":"2023-07-14T11:19:27.400575+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:59:22.004159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967419+0000","last_change":"2023-07-14T11:19:23.966672+0000","last_active":"2023-07-14T11:19:25.967419+0000","last_peered":"2023-07-14T11:19:25.967419+0000","last_clean":"2023-07-14T11:19:25.967419+0000","last_became_active":"2023-07-14T11:19:23.966360+0000","last_became_peered":"2023-07-14T11:19:23.966360+0000","last_unstale":"2023-07-14T11:19:25.967419+0000","last_undegraded":"2023-07-14T11:19:25.967419+0000","last_fullsized":"2023-07-14T11:19:25.967419+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:18:10.519816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:19:23.938624+0000","last_change":"2023-07-14T11:19:23.938624+0000","last_active":"2023-07-14T11:19:23.938624+0000","last_peered":"2023-07-14T11:19:23.938624+0000","last_clean":"2023-07-14T11:19:23.938624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:23.938624+0000","last_undegraded":"2023-07-14T11:19:23.938624+0000","last_fullsized":"2023-07-14T11:19:23.938624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967195+0000","last_change":"2023-07-14T11:19:23.965288+0000","last_active":"2023-07-14T11:19:25.967195+0000","last_peered":"2023-07-14T11:19:25.967195+0000","last_clean":"2023-07-14T11:19:25.967195+0000","last_became_active":"2023-07-14T11:19:23.965026+0000","last_became_peered":"2023-07-14T11:19:23.965026+0000","last_unstale":"2023-07-14T11:19:25.967195+0000","last_undegraded":"2023-07-14T11:19:25.967195+0000","last_fullsized":"2023-07-14T11:19:25.967195+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:01:26.582106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:19:23.938624+0000","last_change":"2023-07-14T11:19:23.938624+0000","last_active":"2023-07-14T11:19:23.938624+0000","last_peered":"2023-07-14T11:19:23.938624+0000","last_clean":"2023-07-14T11:19:23.938624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:23.938624+0000","last_undegraded":"2023-07-14T11:19:23.938624+0000","last_fullsized":"2023-07-14T11:19:23.938624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400784+0000","last_change":"2023-07-14T11:19:23.967500+0000","last_active":"2023-07-14T11:19:27.400784+0000","last_peered":"2023-07-14T11:19:27.400784+0000","last_clean":"2023-07-14T11:19:27.400784+0000","last_became_active":"2023-07-14T11:19:23.967047+0000","last_became_peered":"2023-07-14T11:19:23.967047+0000","last_unstale":"2023-07-14T11:19:27.400784+0000","last_undegraded":"2023-07-14T11:19:27.400784+0000","last_fullsized":"2023-07-14T11:19:27.400784+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:28:25.198305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.964622+0000","last_change":"2023-07-14T11:19:24.975857+0000","last_active":"2023-07-14T11:19:25.964622+0000","last_peered":"2023-07-14T11:19:25.964622+0000","last_clean":"2023-07-14T11:19:25.964622+0000","last_became_active":"2023-07-14T11:19:24.975556+0000","last_became_peered":"2023-07-14T11:19:24.975556+0000","last_unstale":"2023-07-14T11:19:25.964622+0000","last_undegraded":"2023-07-14T11:19:25.964622+0000","last_fullsized":"2023-07-14T11:19:25.964622+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:02:11.711759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-07-14T11:19:22.948552+0000","last_change":"2023-07-14T11:19:22.948552+0000","last_active":"2023-07-14T11:19:22.930757+0000","last_peered":"2023-07-14T11:19:22.930757+0000","last_clean":"2023-07-14T11:19:22.930757+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:22.948552+0000","last_undegraded":"2023-07-14T11:19:22.948552+0000","last_fullsized":"2023-07-14T11:19:22.948552+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.968126+0000","last_change":"2023-07-14T11:19:24.978612+0000","last_active":"2023-07-14T11:19:25.968126+0000","last_peered":"2023-07-14T11:19:25.968126+0000","last_clean":"2023-07-14T11:19:25.968126+0000","last_became_active":"2023-07-14T11:19:24.978260+0000","last_became_peered":"2023-07-14T11:19:24.978260+0000","last_unstale":"2023-07-14T11:19:25.968126+0000","last_undegraded":"2023-07-14T11:19:25.968126+0000","last_fullsized":"2023-07-14T11:19:25.968126+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:45:26.959920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-07-14T11:19:22.947747+0000","last_change":"2023-07-14T11:19:22.947747+0000","last_active":"2023-07-14T11:19:22.930757+0000","last_peered":"2023-07-14T11:19:22.930757+0000","last_clean":"2023-07-14T11:19:22.930757+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:22.947747+0000","last_undegraded":"2023-07-14T11:19:22.947747+0000","last_fullsized":"2023-07-14T11:19:22.947747+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":161,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-14T11:19:22.947870+0000","last_change":"2023-07-14T11:13:08.762084+0000","last_active":"2023-07-14T11:19:22.947870+0000","last_peered":"2023-07-14T11:19:22.947870+0000","last_clean":"2023-07-14T11:19:22.947870+0000","last_became_active":"2023-07-14T11:13:08.761763+0000","last_became_peered":"2023-07-14T11:13:08.761763+0000","last_unstale":"2023-07-14T11:19:22.947870+0000","last_undegraded":"2023-07-14T11:19:22.947870+0000","last_fullsized":"2023-07-14T11:19:22.947870+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:18:09.688083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:19:23.938624+0000","last_change":"2023-07-14T11:19:23.938624+0000","last_active":"2023-07-14T11:19:23.938624+0000","last_peered":"2023-07-14T11:19:23.938624+0000","last_clean":"2023-07-14T11:19:23.938624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:23.938624+0000","last_undegraded":"2023-07-14T11:19:23.938624+0000","last_fullsized":"2023-07-14T11:19:23.938624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.15","version":"105'3","reported_seq":16,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967842+0000","last_change":"2023-07-14T11:19:23.969233+0000","last_active":"2023-07-14T11:19:25.967842+0000","last_peered":"2023-07-14T11:19:25.967842+0000","last_clean":"2023-07-14T11:19:25.967842+0000","last_became_active":"2023-07-14T11:19:23.968938+0000","last_became_peered":"2023-07-14T11:19:23.968938+0000","last_unstale":"2023-07-14T11:19:25.967842+0000","last_undegraded":"2023-07-14T11:19:25.967842+0000","last_fullsized":"2023-07-14T11:19:25.967842+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:53:14.223807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":187,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.964710+0000","last_change":"2023-07-14T11:13:08.761726+0000","last_active":"2023-07-14T11:19:25.964710+0000","last_peered":"2023-07-14T11:19:25.964710+0000","last_clean":"2023-07-14T11:19:25.964710+0000","last_became_active":"2023-07-14T11:13:08.761365+0000","last_became_peered":"2023-07-14T11:13:08.761365+0000","last_unstale":"2023-07-14T11:19:25.964710+0000","last_undegraded":"2023-07-14T11:19:25.964710+0000","last_fullsized":"2023-07-14T11:19:25.964710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:19:34.910190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967811+0000","last_change":"2023-07-14T11:19:24.985128+0000","last_active":"2023-07-14T11:19:25.967811+0000","last_peered":"2023-07-14T11:19:25.967811+0000","last_clean":"2023-07-14T11:19:25.967811+0000","last_became_active":"2023-07-14T11:19:24.984814+0000","last_became_peered":"2023-07-14T11:19:24.984814+0000","last_unstale":"2023-07-14T11:19:25.967811+0000","last_undegraded":"2023-07-14T11:19:25.967811+0000","last_fullsized":"2023-07-14T11:19:25.967811+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:37:46.235964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.968001+0000","last_change":"2023-07-14T11:19:23.959733+0000","last_active":"2023-07-14T11:19:25.968001+0000","last_peered":"2023-07-14T11:19:25.968001+0000","last_clean":"2023-07-14T11:19:25.968001+0000","last_became_active":"2023-07-14T11:19:23.959449+0000","last_became_peered":"2023-07-14T11:19:23.959449+0000","last_unstale":"2023-07-14T11:19:25.968001+0000","last_undegraded":"2023-07-14T11:19:25.968001+0000","last_fullsized":"2023-07-14T11:19:25.968001+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:14:29.323565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":151,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-14T11:19:22.949527+0000","last_change":"2023-07-14T11:13:08.923899+0000","last_active":"2023-07-14T11:19:22.949527+0000","last_peered":"2023-07-14T11:19:22.949527+0000","last_clean":"2023-07-14T11:19:22.949527+0000","last_became_active":"2023-07-14T11:13:08.923513+0000","last_became_peered":"2023-07-14T11:13:08.923513+0000","last_unstale":"2023-07-14T11:19:22.949527+0000","last_undegraded":"2023-07-14T11:19:22.949527+0000","last_fullsized":"2023-07-14T11:19:22.949527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:02:09.817122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:19:23.938624+0000","last_change":"2023-07-14T11:19:23.938624+0000","last_active":"2023-07-14T11:19:23.938624+0000","last_peered":"2023-07-14T11:19:23.938624+0000","last_clean":"2023-07-14T11:19:23.938624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:23.938624+0000","last_undegraded":"2023-07-14T11:19:23.938624+0000","last_fullsized":"2023-07-14T11:19:23.938624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-07-14T11:19:22.947360+0000","last_change":"2023-07-14T11:19:22.947360+0000","last_active":"2023-07-14T11:19:22.930757+0000","last_peered":"2023-07-14T11:19:22.930757+0000","last_clean":"2023-07-14T11:19:22.930757+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:22.947360+0000","last_undegraded":"2023-07-14T11:19:22.947360+0000","last_fullsized":"2023-07-14T11:19:22.947360+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":152,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-14T11:19:22.949891+0000","last_change":"2023-07-14T11:13:08.760609+0000","last_active":"2023-07-14T11:19:22.949891+0000","last_peered":"2023-07-14T11:19:22.949891+0000","last_clean":"2023-07-14T11:19:22.949891+0000","last_became_active":"2023-07-14T11:13:08.760285+0000","last_became_peered":"2023-07-14T11:13:08.760285+0000","last_unstale":"2023-07-14T11:19:22.949891+0000","last_undegraded":"2023-07-14T11:19:22.949891+0000","last_fullsized":"2023-07-14T11:19:22.949891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:28:15.435436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:19:23.938624+0000","last_change":"2023-07-14T11:19:23.938624+0000","last_active":"2023-07-14T11:19:23.938624+0000","last_peered":"2023-07-14T11:19:23.938624+0000","last_clean":"2023-07-14T11:19:23.938624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:23.938624+0000","last_undegraded":"2023-07-14T11:19:23.938624+0000","last_fullsized":"2023-07-14T11:19:23.938624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-07-14T11:19:22.945755+0000","last_change":"2023-07-14T11:19:22.945755+0000","last_active":"2023-07-14T11:19:22.930757+0000","last_peered":"2023-07-14T11:19:22.930757+0000","last_clean":"2023-07-14T11:19:22.930757+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:22.945755+0000","last_undegraded":"2023-07-14T11:19:22.945755+0000","last_fullsized":"2023-07-14T11:19:22.945755+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"76'128","reported_seq":347,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-14T11:19:22.950012+0000","last_change":"2023-07-14T11:13:01.370649+0000","last_active":"2023-07-14T11:19:22.950012+0000","last_peered":"2023-07-14T11:19:22.950012+0000","last_clean":"2023-07-14T11:19:22.950012+0000","last_became_active":"2023-07-14T11:13:01.369478+0000","last_became_peered":"2023-07-14T11:13:01.369478+0000","last_unstale":"2023-07-14T11:19:22.950012+0000","last_undegraded":"2023-07-14T11:19:22.950012+0000","last_fullsized":"2023-07-14T11:19:22.950012+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:00.254800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:00.254800+0000","last_clean_scrub_stamp":"2023-07-14T11:13:00.254800+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:35:05.301387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":172,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967539+0000","last_change":"2023-07-14T11:13:08.757882+0000","last_active":"2023-07-14T11:19:25.967539+0000","last_peered":"2023-07-14T11:19:25.967539+0000","last_clean":"2023-07-14T11:19:25.967539+0000","last_became_active":"2023-07-14T11:13:08.757541+0000","last_became_peered":"2023-07-14T11:13:08.757541+0000","last_unstale":"2023-07-14T11:19:25.967539+0000","last_undegraded":"2023-07-14T11:19:25.967539+0000","last_fullsized":"2023-07-14T11:19:25.967539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:44:22.274150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.964372+0000","last_change":"2023-07-14T11:19:24.972447+0000","last_active":"2023-07-14T11:19:25.964372+0000","last_peered":"2023-07-14T11:19:25.964372+0000","last_clean":"2023-07-14T11:19:25.964372+0000","last_became_active":"2023-07-14T11:19:24.972170+0000","last_became_peered":"2023-07-14T11:19:24.972170+0000","last_unstale":"2023-07-14T11:19:25.964372+0000","last_undegraded":"2023-07-14T11:19:25.964372+0000","last_fullsized":"2023-07-14T11:19:25.964372+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:06:12.493242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-07-14T11:19:22.947609+0000","last_change":"2023-07-14T11:19:22.947609+0000","last_active":"2023-07-14T11:19:22.930757+0000","last_peered":"2023-07-14T11:19:22.930757+0000","last_clean":"2023-07-14T11:19:22.930757+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:22.947609+0000","last_undegraded":"2023-07-14T11:19:22.947609+0000","last_fullsized":"2023-07-14T11:19:22.947609+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":176,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.399575+0000","last_change":"2023-07-14T11:13:08.862331+0000","last_active":"2023-07-14T11:19:27.399575+0000","last_peered":"2023-07-14T11:19:27.399575+0000","last_clean":"2023-07-14T11:19:27.399575+0000","last_became_active":"2023-07-14T11:13:08.861817+0000","last_became_peered":"2023-07-14T11:13:08.861817+0000","last_unstale":"2023-07-14T11:19:27.399575+0000","last_undegraded":"2023-07-14T11:19:27.399575+0000","last_fullsized":"2023-07-14T11:19:27.399575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:06:57.469895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.399635+0000","last_change":"2023-07-14T11:19:24.980611+0000","last_active":"2023-07-14T11:19:27.399635+0000","last_peered":"2023-07-14T11:19:27.399635+0000","last_clean":"2023-07-14T11:19:27.399635+0000","last_became_active":"2023-07-14T11:19:24.980359+0000","last_became_peered":"2023-07-14T11:19:24.980359+0000","last_unstale":"2023-07-14T11:19:27.399635+0000","last_undegraded":"2023-07-14T11:19:27.399635+0000","last_fullsized":"2023-07-14T11:19:27.399635+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:16:08.807717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-07-14T11:19:22.947503+0000","last_change":"2023-07-14T11:19:22.947503+0000","last_active":"2023-07-14T11:19:22.930757+0000","last_peered":"2023-07-14T11:19:22.930757+0000","last_clean":"2023-07-14T11:19:22.930757+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:22.947503+0000","last_undegraded":"2023-07-14T11:19:22.947503+0000","last_fullsized":"2023-07-14T11:19:22.947503+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":172,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967485+0000","last_change":"2023-07-14T11:13:08.758749+0000","last_active":"2023-07-14T11:19:25.967485+0000","last_peered":"2023-07-14T11:19:25.967485+0000","last_clean":"2023-07-14T11:19:25.967485+0000","last_became_active":"2023-07-14T11:13:08.757956+0000","last_became_peered":"2023-07-14T11:13:08.757956+0000","last_unstale":"2023-07-14T11:19:25.967485+0000","last_undegraded":"2023-07-14T11:19:25.967485+0000","last_fullsized":"2023-07-14T11:19:25.967485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:50:28.757111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:19:23.938624+0000","last_change":"2023-07-14T11:19:23.938624+0000","last_active":"2023-07-14T11:19:23.938624+0000","last_peered":"2023-07-14T11:19:23.938624+0000","last_clean":"2023-07-14T11:19:23.938624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:23.938624+0000","last_undegraded":"2023-07-14T11:19:23.938624+0000","last_fullsized":"2023-07-14T11:19:23.938624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-07-14T11:19:22.946805+0000","last_change":"2023-07-14T11:19:22.946805+0000","last_active":"2023-07-14T11:19:22.930757+0000","last_peered":"2023-07-14T11:19:22.930757+0000","last_clean":"2023-07-14T11:19:22.930757+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:22.946805+0000","last_undegraded":"2023-07-14T11:19:22.946805+0000","last_fullsized":"2023-07-14T11:19:22.946805+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":188,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.964499+0000","last_change":"2023-07-14T11:13:08.923786+0000","last_active":"2023-07-14T11:19:25.964499+0000","last_peered":"2023-07-14T11:19:25.964499+0000","last_clean":"2023-07-14T11:19:25.964499+0000","last_became_active":"2023-07-14T11:13:08.923384+0000","last_became_peered":"2023-07-14T11:13:08.923384+0000","last_unstale":"2023-07-14T11:19:25.964499+0000","last_undegraded":"2023-07-14T11:19:25.964499+0000","last_fullsized":"2023-07-14T11:19:25.964499+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:32:52.150831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":82,"acting":82,"num_store_stats":5},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":112,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15,"ondisk_log_size":15,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574929,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32880,"kb_used_data":1832,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338960,"statfs":{"total":96636764160,"available":96603095040,"internally_reserved":0,"allocated":1875968,"data_stored":1181478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:19:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.66200000000000003,"15min":0.89400000000000002},"min":{"1min":0.55500000000000005,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":8.4339999999999993},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.69199999999999995,"15min":0.92800000000000005},"min":{"1min":0.47599999999999998,"5min":0.45500000000000002,"15min":0.377},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":8.4559999999999995},"last":0.65100000000000002}]},{"osd":1,"last update":"Fri Jul 14 11:19:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.67200000000000004,"15min":0.871},"min":{"1min":0.52100000000000002,"5min":0.40400000000000003,"15min":0.34899999999999998},"max":{"1min":0.90400000000000003,"5min":0.92800000000000005,"15min":6.3520000000000003},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.66100000000000003,"15min":1.0089999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":6.8550000000000004},"last":0.71199999999999997}]},{"osd":2,"last update":"Fri Jul 14 11:19:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.67100000000000004,"15min":1.0569999999999999},"min":{"1min":0.499,"5min":0.434,"15min":0.434},"max":{"1min":0.83599999999999997,"5min":0.997,"15min":7.0289999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.70399999999999996,"15min":0.69299999999999995},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.86399999999999999,"5min":0.98199999999999998,"15min":1.0580000000000001},"last":0.81000000000000005}]},{"osd":3,"last update":"Fri Jul 14 11:19:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.68899999999999995,"15min":1.109},"min":{"1min":0.55200000000000005,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.91100000000000003,"5min":0.95699999999999996,"15min":10.337},"last":0.755},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.72699999999999998,"15min":0.75800000000000001},"min":{"1min":0.53300000000000003,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.90100000000000002,"5min":1.024,"15min":1.921},"last":0.53400000000000003}]},{"osd":4,"last update":"Fri Jul 14 11:19:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.64700000000000002,"15min":0.59899999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.73599999999999999,"15min":0.70599999999999996},"min":{"1min":0.57299999999999995,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.90800000000000003,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.59099999999999997}]},{"osd":5,"last update":"Fri Jul 14 11:19:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.70099999999999996,"15min":0.67900000000000005},"min":{"1min":0.39700000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.92800000000000005,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.76400000000000001,"15min":0.73999999999999999},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.47499999999999998}]},{"osd":6,"last update":"Fri Jul 14 11:19:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.72899999999999998,"15min":0.68300000000000005},"min":{"1min":0.505,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.98799999999999999,"5min":1.002,"15min":1.002},"last":0.5},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.73299999999999998,"15min":0.69399999999999995},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.48899999999999999},"max":{"1min":0.97399999999999998,"5min":1.129,"15min":1.129},"last":0.51300000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574930,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28204,"kb_used_data":1252,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343636,"statfs":{"total":96636764160,"available":96607883264,"internally_reserved":0,"allocated":1282048,"data_stored":591110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.69899999999999995,"15min":0.70299999999999996},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93799999999999994,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.73499999999999999,"15min":0.72099999999999997},"min":{"1min":0.51100000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.83899999999999997,"5min":1.167,"15min":1.167},"last":0.55900000000000005}]},{"osd":1,"last update":"Fri Jul 14 11:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71899999999999997,"15min":0.69099999999999995},"min":{"1min":0.443,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.73099999999999998,"15min":0.71399999999999997},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39300000000000002},"max":{"1min":0.90400000000000003,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.64400000000000002}]},{"osd":2,"last update":"Fri Jul 14 11:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.69899999999999995,"15min":0.67900000000000005},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.41299999999999998},"max":{"1min":0.89000000000000001,"5min":1.45,"15min":1.45},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.755,"5min":0.754,"15min":0.77600000000000002},"min":{"1min":0.56399999999999995,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.075,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.66300000000000003}]},{"osd":3,"last update":"Fri Jul 14 11:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.73099999999999998,"15min":0.74299999999999999},"min":{"1min":0.50900000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.86499999999999999,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.73299999999999998,"15min":0.73899999999999999},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0469999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.496}]},{"osd":4,"last update":"Fri Jul 14 11:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.69099999999999995,"15min":0.70699999999999996},"min":{"1min":0.53300000000000003,"5min":0.38,"15min":0.38},"max":{"1min":1.177,"5min":1.712,"15min":1.712},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.71999999999999997,"15min":0.72599999999999998},"min":{"1min":0.48199999999999998,"5min":0.438,"15min":0.42899999999999999},"max":{"1min":0.998,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.67800000000000005}]},{"osd":5,"last update":"Fri Jul 14 11:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.71199999999999997,"15min":0.71799999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.93500000000000005,"5min":2.8820000000000001,"15min":2.8820000000000001},"last":0.628},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.77200000000000002,"15min":0.78800000000000003},"min":{"1min":0.58399999999999996,"5min":0.46100000000000002,"15min":0.44500000000000001},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.71199999999999997}]},{"osd":7,"last update":"Fri Jul 14 11:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.77500000000000002,"15min":0.79900000000000004},"min":{"1min":0.59899999999999998,"5min":0.47399999999999998,"15min":0.47099999999999997},"max":{"1min":0.95499999999999996,"5min":1.333,"15min":1.333},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.76300000000000001,"15min":0.78900000000000003},"min":{"1min":0.46899999999999997,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.1579999999999999,"5min":1.55,"15min":1.55},"last":0.746}]}]},{"osd":1,"up_from":13,"seq":55834574930,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28244,"kb_used_data":1292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343596,"statfs":{"total":96636764160,"available":96607842304,"internally_reserved":0,"allocated":1323008,"data_stored":611541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.40500000000000003,"15min":0.432},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.54200000000000004,"5min":0.59099999999999997,"15min":0.996},"last":0.745},{"interface":"front","average":{"1min":0.432,"5min":0.45500000000000002,"15min":0.47599999999999998},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.57299999999999995,"5min":0.81599999999999995,"15min":0.84299999999999997},"last":0.40699999999999997}]},{"osd":2,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.48099999999999998,"15min":0.54900000000000004},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.60299999999999998,"5min":0.70799999999999996,"15min":2.476},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.48899999999999999,"15min":0.59499999999999997},"min":{"1min":0.36899999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.64700000000000002,"5min":0.91700000000000004,"15min":2.6299999999999999},"last":0.57499999999999996}]},{"osd":3,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.52800000000000002,"15min":0.52200000000000002},"min":{"1min":0.40899999999999997,"5min":0.39300000000000002,"15min":0.38900000000000001},"max":{"1min":0.72599999999999998,"5min":0.748,"15min":0.748},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46500000000000002,"15min":0.48799999999999999},"min":{"1min":0.33600000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.59499999999999997,"5min":0.67700000000000005,"15min":0.73199999999999998},"last":0.47799999999999998}]},{"osd":4,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.73699999999999999,"15min":0.749},"min":{"1min":0.52400000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.363},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.751,"5min":0.754,"15min":0.76900000000000002},"min":{"1min":0.57099999999999995,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.93999999999999995,"5min":1.1160000000000001,"15min":1.4890000000000001},"last":0.625}]},{"osd":5,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.749,"15min":0.76500000000000001},"min":{"1min":0.54200000000000004,"5min":0.499,"15min":0.499},"max":{"1min":1.0589999999999999,"5min":1.2250000000000001,"15min":1.3759999999999999},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76200000000000001,"15min":0.80800000000000005},"min":{"1min":0.59099999999999997,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.4330000000000001},"last":0.68799999999999994}]},{"osd":6,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.745,"15min":0.78800000000000003},"min":{"1min":0.55900000000000005,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.028,"5min":1.141,"15min":1.298},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.753,"15min":0.77900000000000003},"min":{"1min":0.60199999999999998,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.97199999999999998,"5min":1.1899999999999999,"15min":1.2130000000000001},"last":0.85699999999999998}]},{"osd":7,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.75900000000000001,"15min":0.80700000000000005},"min":{"1min":0.58299999999999996,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0780000000000001,"5min":1.2010000000000001,"15min":1.4590000000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.75,"15min":0.77900000000000003},"min":{"1min":0.56299999999999994,"5min":0.55000000000000004,"15min":0.54200000000000004},"max":{"1min":1.129,"5min":1.129,"15min":1.3700000000000001},"last":0.71099999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574928,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28824,"kb_used_data":1872,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343016,"statfs":{"total":96636764160,"available":96607248384,"internally_reserved":0,"allocated":1916928,"data_stored":1201909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 11:19:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.47699999999999998,"15min":0.44700000000000001},"min":{"1min":0.26800000000000002,"5min":0.252,"15min":0.252},"max":{"1min":2.972,"5min":2.972,"15min":2.972},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.47599999999999998,"15min":0.45200000000000001},"min":{"1min":0.33300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":2.758,"5min":2.758,"15min":2.758},"last":0.31900000000000001}]},{"osd":2,"last update":"Fri Jul 14 11:19:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.499,"15min":0.47299999999999998},"min":{"1min":0.35599999999999998,"5min":0.307,"15min":0.307},"max":{"1min":2.9409999999999998,"5min":2.9409999999999998,"15min":2.9409999999999998},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.51900000000000002,"15min":0.50900000000000001},"min":{"1min":0.376,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":2.556,"5min":2.556,"15min":2.556},"last":0.45900000000000002}]},{"osd":3,"last update":"Fri Jul 14 11:19:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.48199999999999998,"15min":0.438},"min":{"1min":0.33700000000000002,"5min":0.32000000000000001,"15min":0.309},"max":{"1min":2.6019999999999999,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.55600000000000005,"15min":0.53500000000000003},"min":{"1min":0.44900000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":2.9990000000000001,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":0.56599999999999995}]},{"osd":4,"last update":"Fri Jul 14 11:19:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.73699999999999999,"15min":0.75700000000000001},"min":{"1min":0.51200000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0229999999999999,"5min":1.099,"15min":1.1060000000000001},"last":0.874},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.76400000000000001,"15min":0.71799999999999997},"min":{"1min":0.57499999999999996,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.651,"5min":1.651,"15min":1.651},"last":0.82299999999999995}]},{"osd":5,"last update":"Fri Jul 14 11:19:12 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.77200000000000002,"15min":0.73799999999999999},"min":{"1min":0.51900000000000002,"5min":0.502,"15min":0.47999999999999998},"max":{"1min":2.9089999999999998,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.76500000000000001,"15min":0.77600000000000002},"min":{"1min":0.53200000000000003,"5min":0.505,"15min":0.505},"max":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.77800000000000002}]},{"osd":6,"last update":"Fri Jul 14 11:19:12 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.745,"15min":0.72799999999999998},"min":{"1min":0.499,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.78700000000000003,"15min":0.78300000000000003},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":2.8679999999999999,"5min":2.8679999999999999,"15min":2.8679999999999999},"last":0.76000000000000001}]},{"osd":7,"last update":"Fri Jul 14 11:19:12 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.77700000000000002,"15min":0.80900000000000005},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.97599999999999998,"5min":1.0900000000000001,"15min":1.149},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.81899999999999995,"15min":0.78900000000000003},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.7410000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":0.85799999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574928,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28240,"kb_used_data":1288,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343600,"statfs":{"total":96636764160,"available":96607846400,"internally_reserved":0,"allocated":1318912,"data_stored":611519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:19:20 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.40899999999999997,"15min":0.441},"min":{"1min":0.27100000000000002,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.623,"5min":0.63900000000000001,"15min":0.64700000000000002},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.438,"15min":0.44400000000000001},"min":{"1min":0.32100000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.63700000000000001,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.36399999999999999}]},{"osd":1,"last update":"Fri Jul 14 11:19:20 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46700000000000003,"15min":0.48199999999999998},"min":{"1min":0.371,"5min":0.31,"15min":0.31},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.98299999999999998},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.47899999999999998,"15min":0.48699999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.59199999999999997,"5min":0.629,"15min":0.91200000000000003},"last":0.498}]},{"osd":3,"last update":"Fri Jul 14 11:19:20 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.48699999999999999,"15min":0.49299999999999999},"min":{"1min":0.34999999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.623,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.55700000000000005,"15min":0.57999999999999996},"min":{"1min":0.44500000000000001,"5min":0.41499999999999998,"15min":0.40799999999999997},"max":{"1min":0.72899999999999998,"5min":0.80000000000000004,"15min":1.034},"last":0.53500000000000003}]},{"osd":4,"last update":"Fri Jul 14 11:19:20 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.73499999999999999,"15min":0.76300000000000001},"min":{"1min":0.53900000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.036,"5min":1.171,"15min":1.212},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.749,"15min":0.77900000000000003},"min":{"1min":0.53800000000000003,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.83899999999999997}]},{"osd":5,"last update":"Fri Jul 14 11:19:20 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.74399999999999999,"15min":0.78200000000000003},"min":{"1min":0.53900000000000003,"5min":0.51700000000000002,"15min":0.43099999999999999},"max":{"1min":1.202,"5min":1.202,"15min":1.4019999999999999},"last":0.751},{"interface":"front","average":{"1min":0.75,"5min":0.76300000000000001,"15min":0.81100000000000005},"min":{"1min":0.55800000000000005,"5min":0.495,"15min":0.495},"max":{"1min":1.044,"5min":1.351,"15min":1.351},"last":0.86799999999999999}]},{"osd":6,"last update":"Fri Jul 14 11:19:20 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.753,"15min":0.78100000000000003},"min":{"1min":0.53100000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0089999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.76800000000000002,"15min":0.81299999999999994},"min":{"1min":0.60199999999999998,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.218,"5min":1.282,"15min":1.282},"last":0.80800000000000005}]},{"osd":7,"last update":"Fri Jul 14 11:19:20 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.754,"15min":0.79100000000000004},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.93400000000000005,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.754,"15min":0.79600000000000004},"min":{"1min":0.60899999999999999,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.96399999999999997,"5min":1.244,"15min":1.244},"last":0.77700000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574927,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28204,"kb_used_data":1252,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343636,"statfs":{"total":96636764160,"available":96607883264,"internally_reserved":0,"allocated":1282048,"data_stored":591110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.41099999999999998,"15min":0.442},"min":{"1min":0.24299999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.55900000000000005,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.44500000000000001,"15min":0.44800000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.621,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.29499999999999998}]},{"osd":1,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.44,"15min":0.44900000000000001},"min":{"1min":0.29499999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.52000000000000002,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.47199999999999998,"15min":0.49099999999999999},"min":{"1min":0.317,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.60899999999999999,"5min":0.72699999999999998,"15min":0.86399999999999999},"last":0.47499999999999998}]},{"osd":2,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.53400000000000003,"15min":0.54000000000000004},"min":{"1min":0.39600000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.64900000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56200000000000006,"15min":0.58999999999999997},"min":{"1min":0.44,"5min":0.37,"15min":0.37},"max":{"1min":0.76100000000000001,"5min":0.79600000000000004,"15min":1.585},"last":0.61699999999999999}]},{"osd":4,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.73299999999999998,"15min":0.754},"min":{"1min":0.45400000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.96399999999999997,"5min":1.1279999999999999,"15min":1.216},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.76700000000000002,"15min":0.75700000000000001},"min":{"1min":0.48599999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.67100000000000004}]},{"osd":5,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.747,"15min":0.75700000000000001},"min":{"1min":0.48499999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.089,"5min":1.179,"15min":1.413},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.76700000000000002,"15min":0.83499999999999996},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.94999999999999996,"5min":1.1619999999999999,"15min":1.657},"last":0.57899999999999996}]},{"osd":6,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77700000000000002,"15min":0.78300000000000003},"min":{"1min":0.56699999999999995,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.726},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.755,"5min":0.76800000000000002,"15min":0.79400000000000004},"min":{"1min":0.57099999999999995,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.143,"5min":1.286,"15min":1.333},"last":0.63}]},{"osd":7,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.79700000000000004,"15min":0.83099999999999996},"min":{"1min":0.53800000000000003,"5min":0.437,"15min":0.437},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.3939999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.80800000000000005,"15min":0.83399999999999996},"min":{"1min":0.60299999999999998,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.59999999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574928,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28252,"kb_used_data":1300,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343588,"statfs":{"total":96636764160,"available":96607834112,"internally_reserved":0,"allocated":1331200,"data_stored":613083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:19:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.64900000000000002,"15min":0.63500000000000001},"min":{"1min":0.437,"5min":0.311,"15min":0.311},"max":{"1min":0.89600000000000002,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.65200000000000002,"15min":0.68400000000000005},"min":{"1min":0.47699999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85199999999999998,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.70099999999999996}]},{"osd":1,"last update":"Fri Jul 14 11:19:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.65200000000000002,"15min":0.66600000000000004},"min":{"1min":0.51700000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.83599999999999997,"5min":0.92000000000000004,"15min":1.4259999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70299999999999996,"15min":0.70999999999999996},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.45800000000000002},"max":{"1min":0.95799999999999996,"5min":1.0149999999999999,"15min":1.1659999999999999},"last":0.80400000000000005}]},{"osd":2,"last update":"Fri Jul 14 11:19:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.69999999999999996,"15min":0.70699999999999996},"min":{"1min":0.501,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.88200000000000001,"5min":1.0209999999999999,"15min":1.48},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71999999999999997,"15min":0.73599999999999999},"min":{"1min":0.54800000000000004,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.91800000000000004,"5min":1.1080000000000001,"15min":1.23},"last":0.66600000000000004}]},{"osd":3,"last update":"Fri Jul 14 11:19:15 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.67800000000000005,"15min":0.70799999999999996},"min":{"1min":0.51300000000000001,"5min":0.438,"15min":0.438},"max":{"1min":0.95599999999999996,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.72999999999999998,"15min":0.73599999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.90700000000000003,"5min":1.1259999999999999,"15min":1.145},"last":0.59099999999999997}]},{"osd":5,"last update":"Fri Jul 14 11:19:15 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.66600000000000004,"15min":0.74299999999999999},"min":{"1min":0.47399999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.81799999999999995,"5min":0.95999999999999996,"15min":1.6559999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.65700000000000003,"15min":0.745},"min":{"1min":0.41999999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.90500000000000003,"5min":0.96999999999999997,"15min":1.3839999999999999},"last":0.48299999999999998}]},{"osd":6,"last update":"Fri Jul 14 11:19:15 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.68500000000000005,"15min":0.71299999999999997},"min":{"1min":0.45200000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.86799999999999999,"5min":1.1659999999999999,"15min":1.1970000000000001},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.73699999999999999,"15min":0.76600000000000001},"min":{"1min":0.56899999999999995,"5min":0.442,"15min":0.442},"max":{"1min":0.878,"5min":1.1479999999999999,"15min":1.3},"last":0.84099999999999997}]},{"osd":7,"last update":"Fri Jul 14 11:19:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.70499999999999996,"15min":0.755},"min":{"1min":0.47899999999999998,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.88,"5min":1.028,"15min":1.4810000000000001},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.755,"15min":0.82599999999999996},"min":{"1min":0.59099999999999997,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.82499999999999996,"5min":1.21,"15min":1.379},"last":0.71799999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574930,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28248,"kb_used_data":1296,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343592,"statfs":{"total":96636764160,"available":96607838208,"internally_reserved":0,"allocated":1327104,"data_stored":611679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:19:05 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.61899999999999999,"15min":0.63600000000000001},"min":{"1min":0.371,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.84199999999999997,"5min":0.996,"15min":1.3140000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65200000000000002,"15min":0.64000000000000001},"min":{"1min":0.42399999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":1.0980000000000001},"last":0.80900000000000005}]},{"osd":1,"last update":"Fri Jul 14 11:19:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.624,"15min":0.66400000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.75600000000000001,"5min":0.88800000000000001,"15min":1.343},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.63,"5min":0.65100000000000002,"15min":0.64800000000000002},"min":{"1min":0.442,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.86599999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.65500000000000003}]},{"osd":2,"last update":"Fri Jul 14 11:19:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.69899999999999995,"15min":0.72899999999999998},"min":{"1min":0.46700000000000003,"5min":0.436,"15min":0.436},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.70299999999999996,"15min":0.753},"min":{"1min":0.504,"5min":0.496,"15min":0.496},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":1.3939999999999999},"last":0.84099999999999997}]},{"osd":3,"last update":"Fri Jul 14 11:19:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71199999999999997,"15min":0.75600000000000001},"min":{"1min":0.54500000000000004,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":1.2130000000000001},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.67700000000000005,"15min":0.75700000000000001},"min":{"1min":0.46400000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":1.806},"last":0.72299999999999998}]},{"osd":4,"last update":"Fri Jul 14 11:19:05 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.61699999999999999,"15min":0.64600000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.878,"5min":1.0229999999999999,"15min":1.1319999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.66500000000000004,"15min":0.73699999999999999},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.3999999999999999},"last":0.53400000000000003}]},{"osd":6,"last update":"Fri Jul 14 11:19:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.69699999999999995,"15min":0.73999999999999999},"min":{"1min":0.502,"5min":0.435,"15min":0.435},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.73499999999999999,"15min":0.79000000000000004},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.004,"5min":1.0629999999999999,"15min":1.3640000000000001},"last":0.73599999999999999}]},{"osd":7,"last update":"Fri Jul 14 11:19:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.747,"15min":0.82999999999999996},"min":{"1min":0.54400000000000004,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.4970000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78500000000000003,"15min":0.85499999999999998},"min":{"1min":0.60399999999999998,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.8540000000000001},"last":0.58699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T11:19:29.338 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T11:19:29.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.564+0000 7fae2c9ff700 1 Processor -- start 2023-07-14T11:19:29.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.564+0000 7fae2c9ff700 1 -- start start 2023-07-14T11:19:29.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.565+0000 7fae2c9ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fae280b4510 0x7fae280b6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:29.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.566+0000 7fae2c9ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fae280d0b10 0x7fae280d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:29.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.566+0000 7fae2c9ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae280b7f50 con 0x7fae280b5d90 2023-07-14T11:19:29.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.566+0000 7fae2c9ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae280b48e0 con 0x7fae280b4510 2023-07-14T11:19:29.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.566+0000 7fae2c9ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae280d14d0 con 0x7fae280d0b10 2023-07-14T11:19:29.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.566+0000 7fae2659c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fae280b4510 0x7fae280b6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:29.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.566+0000 7fae2659c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fae280b4510 0x7fae280b6c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40722/0 (socket says 172.21.15.84:40722) 2023-07-14T11:19:29.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.566+0000 7fae1ffff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fae280b5d90 0x7fae280cd590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55404/0 (socket says 172.21.15.84:55404) 2023-07-14T11:19:29.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.566+0000 7fae2659c700 1 -- 172.21.15.84:0/589076437 learned_addr learned my addr 172.21.15.84:0/589076437 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:29.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.566+0000 7fae26d9d700 1 --2- 172.21.15.84:0/589076437 >> v2:172.21.15.179:3300/0 conn(0x7fae280d0b10 0x7fae280d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:29.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.566+0000 7fae2659c700 1 -- 172.21.15.84:0/589076437 >> v2:172.21.15.179:3300/0 conn(0x7fae280d0b10 msgr2=0x7fae280d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:29.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.566+0000 7fae2659c700 1 --2- 172.21.15.84:0/589076437 >> v2:172.21.15.179:3300/0 conn(0x7fae280d0b10 0x7fae280d0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:29.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.566+0000 7fae2659c700 1 -- 172.21.15.84:0/589076437 >> v1:172.21.15.84:6789/0 conn(0x7fae280b5d90 legacy=0x7fae280cd590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:29.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.566+0000 7fae2659c700 1 -- 172.21.15.84:0/589076437 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae280cdca0 con 0x7fae280b4510 2023-07-14T11:19:29.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.566+0000 7fae26d9d700 1 --2- 172.21.15.84:0/589076437 >> v2:172.21.15.179:3300/0 conn(0x7fae280d0b10 0x7fae280d0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:19:29.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.566+0000 7fae25d9b700 1 -- 172.21.15.84:0/589076437 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3963471902 0 0) 0x7fae280b7f50 con 0x7fae280b5d90 2023-07-14T11:19:29.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.567+0000 7fae2659c700 1 --2- 172.21.15.84:0/589076437 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae280b4510 0x7fae280b6c80 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7fae28067390 tx=0x7fae18009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c884c3156637c2e3 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:29.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.567+0000 7fae25d9b700 1 -- 172.21.15.84:0/589076437 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae18005e30 con 0x7fae280b4510 2023-07-14T11:19:29.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.567+0000 7fae25d9b700 1 -- 172.21.15.84:0/589076437 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae18004030 con 0x7fae280b4510 2023-07-14T11:19:29.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.567+0000 7fae25d9b700 1 -- 172.21.15.84:0/589076437 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae180043e0 con 0x7fae280b4510 2023-07-14T11:19:29.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.567+0000 7fae2c9ff700 1 -- 172.21.15.84:0/589076437 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae280b4510 msgr2=0x7fae280b6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:29.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.567+0000 7fae2c9ff700 1 --2- 172.21.15.84:0/589076437 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae280b4510 0x7fae280b6c80 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7fae28067390 tx=0x7fae18009bd0 comp rx=0 tx=0).stop 2023-07-14T11:19:29.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.567+0000 7fae2c9ff700 1 -- 172.21.15.84:0/589076437 shutdown_connections 2023-07-14T11:19:29.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.567+0000 7fae2c9ff700 1 --2- 172.21.15.84:0/589076437 >> v2:172.21.15.179:3300/0 conn(0x7fae280d0b10 0x7fae280d0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:29.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.567+0000 7fae2c9ff700 1 --2- 172.21.15.84:0/589076437 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae280b4510 0x7fae280b6c80 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:29.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.567+0000 7fae2c9ff700 1 -- 172.21.15.84:0/589076437 >> 172.21.15.84:0/589076437 conn(0x7fae2809c1d0 msgr2=0x7fae280d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:29.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.567+0000 7fae2c9ff700 1 -- 172.21.15.84:0/589076437 shutdown_connections 2023-07-14T11:19:29.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.567+0000 7fae2c9ff700 1 -- 172.21.15.84:0/589076437 wait complete. 2023-07-14T11:19:29.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.569+0000 7fae2c9ff700 1 Processor -- start 2023-07-14T11:19:29.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.569+0000 7fae2c9ff700 1 -- start start 2023-07-14T11:19:29.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.570+0000 7fae2c9ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae280b4510 0x7fae281f54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:29.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.570+0000 7fae2c9ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae280b5d90 0x7fae281551f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:29.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.570+0000 7fae2c9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae280d0b10 0x7fae280c7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:29.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.570+0000 7fae2c9ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae28151660 con 0x7fae280b4510 2023-07-14T11:19:29.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.570+0000 7fae2c9ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae28152340 con 0x7fae280b5d90 2023-07-14T11:19:29.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.570+0000 7fae2c9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae28152620 con 0x7fae280d0b10 2023-07-14T11:19:29.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.570+0000 7fae2659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae280b4510 0x7fae281f54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:29.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.570+0000 7fae2659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae280b4510 0x7fae281f54c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40736/0 (socket says 172.21.15.84:40736) 2023-07-14T11:19:29.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.570+0000 7fae2659c700 1 -- 172.21.15.84:0/1000032778 learned_addr learned my addr 172.21.15.84:0/1000032778 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:29.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.571+0000 7fae1ffff700 1 --2- 172.21.15.84:0/1000032778 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae280b5d90 0x7fae281551f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:29.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.571+0000 7fae2659c700 1 -- 172.21.15.84:0/1000032778 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae280d0b10 msgr2=0x7fae280c7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:29.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.571+0000 7fae2659c700 1 --2- 172.21.15.84:0/1000032778 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae280d0b10 0x7fae280c7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:29.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.571+0000 7fae2659c700 1 -- 172.21.15.84:0/1000032778 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae280b5d90 msgr2=0x7fae281551f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:29.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.571+0000 7fae2659c700 1 --2- 172.21.15.84:0/1000032778 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae280b5d90 0x7fae281551f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:29.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.571+0000 7fae2659c700 1 -- 172.21.15.84:0/1000032778 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae18009500 con 0x7fae280b4510 2023-07-14T11:19:29.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.571+0000 7fae1ffff700 1 --2- 172.21.15.84:0/1000032778 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae280b5d90 0x7fae281551f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:19:29.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.571+0000 7fae2659c700 1 --2- 172.21.15.84:0/1000032778 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae280b4510 0x7fae281f54c0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7fae18000c00 tx=0x7fae18004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:29.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.571+0000 7fae1effd700 1 -- 172.21.15.84:0/1000032778 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae18003e10 con 0x7fae280b4510 2023-07-14T11:19:29.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.571+0000 7fae1effd700 1 -- 172.21.15.84:0/1000032778 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae1801d430 con 0x7fae280b4510 2023-07-14T11:19:29.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.571+0000 7fae1effd700 1 -- 172.21.15.84:0/1000032778 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae1801d7e0 con 0x7fae280b4510 2023-07-14T11:19:29.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.571+0000 7fae2c9ff700 1 -- 172.21.15.84:0/1000032778 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae281f5a00 con 0x7fae280b4510 2023-07-14T11:19:29.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.571+0000 7fae2c9ff700 1 -- 172.21.15.84:0/1000032778 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae281580f0 con 0x7fae280b4510 2023-07-14T11:19:29.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.572+0000 7fae2c9ff700 1 -- 172.21.15.84:0/1000032778 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae2804e280 con 0x7fae280b4510 2023-07-14T11:19:29.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.573+0000 7fae1effd700 1 -- 172.21.15.84:0/1000032778 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7fae1801d940 con 0x7fae280b4510 2023-07-14T11:19:29.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.574+0000 7fae1effd700 1 --2- 172.21.15.84:0/1000032778 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fae0806ae00 0x7fae0806d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:29.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.574+0000 7fae1effd700 1 -- 172.21.15.84:0/1000032778 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fae1808abc0 con 0x7fae280b4510 2023-07-14T11:19:29.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.575+0000 7fae1ffff700 1 --2- 172.21.15.84:0/1000032778 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fae0806ae00 0x7fae0806d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:29.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.575+0000 7fae1ffff700 1 --2- 172.21.15.84:0/1000032778 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fae0806ae00 0x7fae0806d2b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fae10007fd0 tx=0x7fae10009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:29.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.578+0000 7fae1effd700 1 -- 172.21.15.84:0/1000032778 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fae18055c70 con 0x7fae280b4510 2023-07-14T11:19:29.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.767+0000 7fae2c9ff700 1 -- 172.21.15.84:0/1000032778 --> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fae280b7620 con 0x7fae0806ae00 2023-07-14T11:19:29.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.776+0000 7fae1effd700 1 -- 172.21.15.84:0/1000032778 <== mgr.4100 v2:172.21.15.179:6836/2094253834 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306542 (secure 0 0 0) 0x7fae10001420 con 0x7fae0806ae00 2023-07-14T11:19:29.782 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:19:29.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.780+0000 7fae2c9ff700 1 -- 172.21.15.84:0/1000032778 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fae0806ae00 msgr2=0x7fae0806d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:29.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.780+0000 7fae2c9ff700 1 --2- 172.21.15.84:0/1000032778 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fae0806ae00 0x7fae0806d2b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fae10007fd0 tx=0x7fae10009040 comp rx=0 tx=0).stop 2023-07-14T11:19:29.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.780+0000 7fae2c9ff700 1 -- 172.21.15.84:0/1000032778 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae280b4510 msgr2=0x7fae281f54c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:29.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.780+0000 7fae2c9ff700 1 --2- 172.21.15.84:0/1000032778 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae280b4510 0x7fae281f54c0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7fae18000c00 tx=0x7fae18004750 comp rx=0 tx=0).stop 2023-07-14T11:19:29.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.780+0000 7fae2c9ff700 1 -- 172.21.15.84:0/1000032778 shutdown_connections 2023-07-14T11:19:29.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.780+0000 7fae2c9ff700 1 --2- 172.21.15.84:0/1000032778 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fae0806ae00 0x7fae0806d2b0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:29.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.780+0000 7fae2c9ff700 1 --2- 172.21.15.84:0/1000032778 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae280d0b10 0x7fae280c7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:29.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.780+0000 7fae2c9ff700 1 --2- 172.21.15.84:0/1000032778 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae280b4510 0x7fae281f54c0 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:29.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.780+0000 7fae2c9ff700 1 --2- 172.21.15.84:0/1000032778 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae280b5d90 0x7fae281551f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:29.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.780+0000 7fae2c9ff700 1 -- 172.21.15.84:0/1000032778 >> 172.21.15.84:0/1000032778 conn(0x7fae2809c1d0 msgr2=0x7fae280d3650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:29.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.780+0000 7fae2c9ff700 1 -- 172.21.15.84:0/1000032778 shutdown_connections 2023-07-14T11:19:29.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:29.780+0000 7fae2c9ff700 1 -- 172.21.15.84:0/1000032778 wait complete. 2023-07-14T11:19:29.786 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-07-14T11:19:29.801 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2023-07-14T11:19:28.937804+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590480,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":194,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":143,"ondisk_log_size":143,"up":164,"acting":164,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":135,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231096,"kb_used_data":11384,"kb_used_omap":0,"kb_used_meta":219648,"kb_avail":754743624,"statfs":{"total":773094113280,"available":772857470976,"internally_reserved":0,"allocated":11657216,"data_stored":6013429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":224919552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":112,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.997240"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967358+0000","last_change":"2023-07-14T11:19:24.976160+0000","last_active":"2023-07-14T11:19:25.967358+0000","last_peered":"2023-07-14T11:19:25.967358+0000","last_clean":"2023-07-14T11:19:25.967358+0000","last_became_active":"2023-07-14T11:19:24.975861+0000","last_became_peered":"2023-07-14T11:19:24.975861+0000","last_unstale":"2023-07-14T11:19:25.967358+0000","last_undegraded":"2023-07-14T11:19:25.967358+0000","last_fullsized":"2023-07-14T11:19:25.967358+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:52:51.076969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:19:23.938624+0000","last_change":"2023-07-14T11:19:23.938624+0000","last_active":"2023-07-14T11:19:23.938624+0000","last_peered":"2023-07-14T11:19:23.938624+0000","last_clean":"2023-07-14T11:19:23.938624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:23.938624+0000","last_undegraded":"2023-07-14T11:19:23.938624+0000","last_fullsized":"2023-07-14T11:19:23.938624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:19:23.938624+0000","last_change":"2023-07-14T11:19:23.938624+0000","last_active":"2023-07-14T11:19:23.938624+0000","last_peered":"2023-07-14T11:19:23.938624+0000","last_clean":"2023-07-14T11:19:23.938624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:23.938624+0000","last_undegraded":"2023-07-14T11:19:23.938624+0000","last_fullsized":"2023-07-14T11:19:23.938624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:19:23.938624+0000","last_change":"2023-07-14T11:19:23.938624+0000","last_active":"2023-07-14T11:19:23.938624+0000","last_peered":"2023-07-14T11:19:23.938624+0000","last_clean":"2023-07-14T11:19:23.938624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:23.938624+0000","last_undegraded":"2023-07-14T11:19:23.938624+0000","last_fullsized":"2023-07-14T11:19:23.938624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967158+0000","last_change":"2023-07-14T11:19:24.975419+0000","last_active":"2023-07-14T11:19:25.967158+0000","last_peered":"2023-07-14T11:19:25.967158+0000","last_clean":"2023-07-14T11:19:25.967158+0000","last_became_active":"2023-07-14T11:19:24.975150+0000","last_became_peered":"2023-07-14T11:19:24.975150+0000","last_unstale":"2023-07-14T11:19:25.967158+0000","last_undegraded":"2023-07-14T11:19:25.967158+0000","last_fullsized":"2023-07-14T11:19:25.967158+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:06:39.320547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400149+0000","last_change":"2023-07-14T11:19:24.980389+0000","last_active":"2023-07-14T11:19:27.400149+0000","last_peered":"2023-07-14T11:19:27.400149+0000","last_clean":"2023-07-14T11:19:27.400149+0000","last_became_active":"2023-07-14T11:19:24.980134+0000","last_became_peered":"2023-07-14T11:19:24.980134+0000","last_unstale":"2023-07-14T11:19:27.400149+0000","last_undegraded":"2023-07-14T11:19:27.400149+0000","last_fullsized":"2023-07-14T11:19:27.400149+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:53:15.231674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400689+0000","last_change":"2023-07-14T11:19:24.980001+0000","last_active":"2023-07-14T11:19:27.400689+0000","last_peered":"2023-07-14T11:19:27.400689+0000","last_clean":"2023-07-14T11:19:27.400689+0000","last_became_active":"2023-07-14T11:19:24.979653+0000","last_became_peered":"2023-07-14T11:19:24.979653+0000","last_unstale":"2023-07-14T11:19:27.400689+0000","last_undegraded":"2023-07-14T11:19:27.400689+0000","last_fullsized":"2023-07-14T11:19:27.400689+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:14:55.889716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:19:23.938624+0000","last_change":"2023-07-14T11:19:23.938624+0000","last_active":"2023-07-14T11:19:23.938624+0000","last_peered":"2023-07-14T11:19:23.938624+0000","last_clean":"2023-07-14T11:19:23.938624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:23.938624+0000","last_undegraded":"2023-07-14T11:19:23.938624+0000","last_fullsized":"2023-07-14T11:19:23.938624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:19:23.938624+0000","last_change":"2023-07-14T11:19:23.938624+0000","last_active":"2023-07-14T11:19:23.938624+0000","last_peered":"2023-07-14T11:19:23.938624+0000","last_clean":"2023-07-14T11:19:23.938624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:23.938624+0000","last_undegraded":"2023-07-14T11:19:23.938624+0000","last_fullsized":"2023-07-14T11:19:23.938624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.964603+0000","last_change":"2023-07-14T11:19:24.986113+0000","last_active":"2023-07-14T11:19:25.964603+0000","last_peered":"2023-07-14T11:19:25.964603+0000","last_clean":"2023-07-14T11:19:25.964603+0000","last_became_active":"2023-07-14T11:19:24.985802+0000","last_became_peered":"2023-07-14T11:19:24.985802+0000","last_unstale":"2023-07-14T11:19:25.964603+0000","last_undegraded":"2023-07-14T11:19:25.964603+0000","last_fullsized":"2023-07-14T11:19:25.964603+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:48:20.004928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.966858+0000","last_change":"2023-07-14T11:19:24.981712+0000","last_active":"2023-07-14T11:19:25.966858+0000","last_peered":"2023-07-14T11:19:25.966858+0000","last_clean":"2023-07-14T11:19:25.966858+0000","last_became_active":"2023-07-14T11:19:24.981417+0000","last_became_peered":"2023-07-14T11:19:24.981417+0000","last_unstale":"2023-07-14T11:19:25.966858+0000","last_undegraded":"2023-07-14T11:19:25.966858+0000","last_fullsized":"2023-07-14T11:19:25.966858+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:52:06.185710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.401119+0000","last_change":"2023-07-14T11:19:24.981753+0000","last_active":"2023-07-14T11:19:27.401119+0000","last_peered":"2023-07-14T11:19:27.401119+0000","last_clean":"2023-07-14T11:19:27.401119+0000","last_became_active":"2023-07-14T11:19:24.980821+0000","last_became_peered":"2023-07-14T11:19:24.980821+0000","last_unstale":"2023-07-14T11:19:27.401119+0000","last_undegraded":"2023-07-14T11:19:27.401119+0000","last_fullsized":"2023-07-14T11:19:27.401119+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:17:28.127989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.964356+0000","last_change":"2023-07-14T11:19:24.969706+0000","last_active":"2023-07-14T11:19:25.964356+0000","last_peered":"2023-07-14T11:19:25.964356+0000","last_clean":"2023-07-14T11:19:25.964356+0000","last_became_active":"2023-07-14T11:19:24.969426+0000","last_became_peered":"2023-07-14T11:19:24.969426+0000","last_unstale":"2023-07-14T11:19:25.964356+0000","last_undegraded":"2023-07-14T11:19:25.964356+0000","last_fullsized":"2023-07-14T11:19:25.964356+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:45:06.308741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:19:23.938624+0000","last_change":"2023-07-14T11:19:23.938624+0000","last_active":"2023-07-14T11:19:23.938624+0000","last_peered":"2023-07-14T11:19:23.938624+0000","last_clean":"2023-07-14T11:19:23.938624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:23.938624+0000","last_undegraded":"2023-07-14T11:19:23.938624+0000","last_fullsized":"2023-07-14T11:19:23.938624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967511+0000","last_change":"2023-07-14T11:19:24.981766+0000","last_active":"2023-07-14T11:19:25.967511+0000","last_peered":"2023-07-14T11:19:25.967511+0000","last_clean":"2023-07-14T11:19:25.967511+0000","last_became_active":"2023-07-14T11:19:24.981081+0000","last_became_peered":"2023-07-14T11:19:24.981081+0000","last_unstale":"2023-07-14T11:19:25.967511+0000","last_undegraded":"2023-07-14T11:19:25.967511+0000","last_fullsized":"2023-07-14T11:19:25.967511+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:53:41.464458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400197+0000","last_change":"2023-07-14T11:19:24.980504+0000","last_active":"2023-07-14T11:19:27.400197+0000","last_peered":"2023-07-14T11:19:27.400197+0000","last_clean":"2023-07-14T11:19:27.400197+0000","last_became_active":"2023-07-14T11:19:24.980260+0000","last_became_peered":"2023-07-14T11:19:24.980260+0000","last_unstale":"2023-07-14T11:19:27.400197+0000","last_undegraded":"2023-07-14T11:19:27.400197+0000","last_fullsized":"2023-07-14T11:19:27.400197+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:14:30.331432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.964757+0000","last_change":"2023-07-14T11:19:24.974486+0000","last_active":"2023-07-14T11:19:25.964757+0000","last_peered":"2023-07-14T11:19:25.964757+0000","last_clean":"2023-07-14T11:19:25.964757+0000","last_became_active":"2023-07-14T11:19:24.974200+0000","last_became_peered":"2023-07-14T11:19:24.974200+0000","last_unstale":"2023-07-14T11:19:25.964757+0000","last_undegraded":"2023-07-14T11:19:25.964757+0000","last_fullsized":"2023-07-14T11:19:25.964757+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:24:28.100458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:19:23.938624+0000","last_change":"2023-07-14T11:19:23.938624+0000","last_active":"2023-07-14T11:19:23.938624+0000","last_peered":"2023-07-14T11:19:23.938624+0000","last_clean":"2023-07-14T11:19:23.938624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:23.938624+0000","last_undegraded":"2023-07-14T11:19:23.938624+0000","last_fullsized":"2023-07-14T11:19:23.938624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:19:23.938624+0000","last_change":"2023-07-14T11:19:23.938624+0000","last_active":"2023-07-14T11:19:23.938624+0000","last_peered":"2023-07-14T11:19:23.938624+0000","last_clean":"2023-07-14T11:19:23.938624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:23.938624+0000","last_undegraded":"2023-07-14T11:19:23.938624+0000","last_fullsized":"2023-07-14T11:19:23.938624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400466+0000","last_change":"2023-07-14T11:19:24.990479+0000","last_active":"2023-07-14T11:19:27.400466+0000","last_peered":"2023-07-14T11:19:27.400466+0000","last_clean":"2023-07-14T11:19:27.400466+0000","last_became_active":"2023-07-14T11:19:24.990017+0000","last_became_peered":"2023-07-14T11:19:24.990017+0000","last_unstale":"2023-07-14T11:19:27.400466+0000","last_undegraded":"2023-07-14T11:19:27.400466+0000","last_fullsized":"2023-07-14T11:19:27.400466+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:06:38.269911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:19:23.938624+0000","last_change":"2023-07-14T11:19:23.938624+0000","last_active":"2023-07-14T11:19:23.938624+0000","last_peered":"2023-07-14T11:19:23.938624+0000","last_clean":"2023-07-14T11:19:23.938624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:23.938624+0000","last_undegraded":"2023-07-14T11:19:23.938624+0000","last_fullsized":"2023-07-14T11:19:23.938624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967103+0000","last_change":"2023-07-14T11:19:24.983855+0000","last_active":"2023-07-14T11:19:25.967103+0000","last_peered":"2023-07-14T11:19:25.967103+0000","last_clean":"2023-07-14T11:19:25.967103+0000","last_became_active":"2023-07-14T11:19:24.983432+0000","last_became_peered":"2023-07-14T11:19:24.983432+0000","last_unstale":"2023-07-14T11:19:25.967103+0000","last_undegraded":"2023-07-14T11:19:25.967103+0000","last_fullsized":"2023-07-14T11:19:25.967103+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:10:43.341934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:19:23.938624+0000","last_change":"2023-07-14T11:19:23.938624+0000","last_active":"2023-07-14T11:19:23.938624+0000","last_peered":"2023-07-14T11:19:23.938624+0000","last_clean":"2023-07-14T11:19:23.938624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:23.938624+0000","last_undegraded":"2023-07-14T11:19:23.938624+0000","last_fullsized":"2023-07-14T11:19:23.938624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967396+0000","last_change":"2023-07-14T11:19:24.975332+0000","last_active":"2023-07-14T11:19:25.967396+0000","last_peered":"2023-07-14T11:19:25.967396+0000","last_clean":"2023-07-14T11:19:25.967396+0000","last_became_active":"2023-07-14T11:19:24.974888+0000","last_became_peered":"2023-07-14T11:19:24.974888+0000","last_unstale":"2023-07-14T11:19:25.967396+0000","last_undegraded":"2023-07-14T11:19:25.967396+0000","last_fullsized":"2023-07-14T11:19:25.967396+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:27:43.025658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.968145+0000","last_change":"2023-07-14T11:19:24.986904+0000","last_active":"2023-07-14T11:19:25.968145+0000","last_peered":"2023-07-14T11:19:25.968145+0000","last_clean":"2023-07-14T11:19:25.968145+0000","last_became_active":"2023-07-14T11:19:24.986246+0000","last_became_peered":"2023-07-14T11:19:24.986246+0000","last_unstale":"2023-07-14T11:19:25.968145+0000","last_undegraded":"2023-07-14T11:19:25.968145+0000","last_fullsized":"2023-07-14T11:19:25.968145+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:36:57.980619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400824+0000","last_change":"2023-07-14T11:19:24.980011+0000","last_active":"2023-07-14T11:19:27.400824+0000","last_peered":"2023-07-14T11:19:27.400824+0000","last_clean":"2023-07-14T11:19:27.400824+0000","last_became_active":"2023-07-14T11:19:24.979707+0000","last_became_peered":"2023-07-14T11:19:24.979707+0000","last_unstale":"2023-07-14T11:19:27.400824+0000","last_undegraded":"2023-07-14T11:19:27.400824+0000","last_fullsized":"2023-07-14T11:19:27.400824+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:20:25.338974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:19:23.938624+0000","last_change":"2023-07-14T11:19:23.938624+0000","last_active":"2023-07-14T11:19:23.938624+0000","last_peered":"2023-07-14T11:19:23.938624+0000","last_clean":"2023-07-14T11:19:23.938624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:23.938624+0000","last_undegraded":"2023-07-14T11:19:23.938624+0000","last_fullsized":"2023-07-14T11:19:23.938624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400991+0000","last_change":"2023-07-14T11:19:24.982086+0000","last_active":"2023-07-14T11:19:27.400991+0000","last_peered":"2023-07-14T11:19:27.400991+0000","last_clean":"2023-07-14T11:19:27.400991+0000","last_became_active":"2023-07-14T11:19:24.981377+0000","last_became_peered":"2023-07-14T11:19:24.981377+0000","last_unstale":"2023-07-14T11:19:27.400991+0000","last_undegraded":"2023-07-14T11:19:27.400991+0000","last_fullsized":"2023-07-14T11:19:27.400991+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:19:51.206070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.399944+0000","last_change":"2023-07-14T11:19:24.984485+0000","last_active":"2023-07-14T11:19:27.399944+0000","last_peered":"2023-07-14T11:19:27.399944+0000","last_clean":"2023-07-14T11:19:27.399944+0000","last_became_active":"2023-07-14T11:19:24.984144+0000","last_became_peered":"2023-07-14T11:19:24.984144+0000","last_unstale":"2023-07-14T11:19:27.399944+0000","last_undegraded":"2023-07-14T11:19:27.399944+0000","last_fullsized":"2023-07-14T11:19:27.399944+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:41:49.903922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:19:23.938624+0000","last_change":"2023-07-14T11:19:23.938624+0000","last_active":"2023-07-14T11:19:23.938624+0000","last_peered":"2023-07-14T11:19:23.938624+0000","last_clean":"2023-07-14T11:19:23.938624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:23.938624+0000","last_undegraded":"2023-07-14T11:19:23.938624+0000","last_fullsized":"2023-07-14T11:19:23.938624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967193+0000","last_change":"2023-07-14T11:19:24.981395+0000","last_active":"2023-07-14T11:19:25.967193+0000","last_peered":"2023-07-14T11:19:25.967193+0000","last_clean":"2023-07-14T11:19:25.967193+0000","last_became_active":"2023-07-14T11:19:24.980523+0000","last_became_peered":"2023-07-14T11:19:24.980523+0000","last_unstale":"2023-07-14T11:19:25.967193+0000","last_undegraded":"2023-07-14T11:19:25.967193+0000","last_fullsized":"2023-07-14T11:19:25.967193+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:04:50.668701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.966856+0000","last_change":"2023-07-14T11:19:24.975124+0000","last_active":"2023-07-14T11:19:25.966856+0000","last_peered":"2023-07-14T11:19:25.966856+0000","last_clean":"2023-07-14T11:19:25.966856+0000","last_became_active":"2023-07-14T11:19:24.974559+0000","last_became_peered":"2023-07-14T11:19:24.974559+0000","last_unstale":"2023-07-14T11:19:25.966856+0000","last_undegraded":"2023-07-14T11:19:25.966856+0000","last_fullsized":"2023-07-14T11:19:25.966856+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:05:30.379389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.964378+0000","last_change":"2023-07-14T11:19:24.985367+0000","last_active":"2023-07-14T11:19:25.964378+0000","last_peered":"2023-07-14T11:19:25.964378+0000","last_clean":"2023-07-14T11:19:25.964378+0000","last_became_active":"2023-07-14T11:19:24.984934+0000","last_became_peered":"2023-07-14T11:19:24.984934+0000","last_unstale":"2023-07-14T11:19:25.964378+0000","last_undegraded":"2023-07-14T11:19:25.964378+0000","last_fullsized":"2023-07-14T11:19:25.964378+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:30:06.079180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-07-14T11:19:22.947281+0000","last_change":"2023-07-14T11:19:22.947281+0000","last_active":"2023-07-14T11:19:22.930757+0000","last_peered":"2023-07-14T11:19:22.930757+0000","last_clean":"2023-07-14T11:19:22.930757+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:22.947281+0000","last_undegraded":"2023-07-14T11:19:22.947281+0000","last_fullsized":"2023-07-14T11:19:22.947281+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400906+0000","last_change":"2023-07-14T11:19:24.985452+0000","last_active":"2023-07-14T11:19:27.400906+0000","last_peered":"2023-07-14T11:19:27.400906+0000","last_clean":"2023-07-14T11:19:27.400906+0000","last_became_active":"2023-07-14T11:19:24.983795+0000","last_became_peered":"2023-07-14T11:19:24.983795+0000","last_unstale":"2023-07-14T11:19:27.400906+0000","last_undegraded":"2023-07-14T11:19:27.400906+0000","last_fullsized":"2023-07-14T11:19:27.400906+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:42:39.569277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"105'1","reported_seq":14,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.964705+0000","last_change":"2023-07-14T11:19:23.957148+0000","last_active":"2023-07-14T11:19:25.964705+0000","last_peered":"2023-07-14T11:19:25.964705+0000","last_clean":"2023-07-14T11:19:25.964705+0000","last_became_active":"2023-07-14T11:19:23.956826+0000","last_became_peered":"2023-07-14T11:19:23.956826+0000","last_unstale":"2023-07-14T11:19:25.964705+0000","last_undegraded":"2023-07-14T11:19:25.964705+0000","last_fullsized":"2023-07-14T11:19:25.964705+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:40:31.643180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967855+0000","last_change":"2023-07-14T11:19:24.981190+0000","last_active":"2023-07-14T11:19:25.967855+0000","last_peered":"2023-07-14T11:19:25.967855+0000","last_clean":"2023-07-14T11:19:25.967855+0000","last_became_active":"2023-07-14T11:19:24.980911+0000","last_became_peered":"2023-07-14T11:19:24.980911+0000","last_unstale":"2023-07-14T11:19:25.967855+0000","last_undegraded":"2023-07-14T11:19:25.967855+0000","last_fullsized":"2023-07-14T11:19:25.967855+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:45:06.083751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-07-14T11:19:22.948199+0000","last_change":"2023-07-14T11:19:22.948199+0000","last_active":"2023-07-14T11:19:22.930757+0000","last_peered":"2023-07-14T11:19:22.930757+0000","last_clean":"2023-07-14T11:19:22.930757+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:22.948199+0000","last_undegraded":"2023-07-14T11:19:22.948199+0000","last_fullsized":"2023-07-14T11:19:22.948199+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:19:23.938624+0000","last_change":"2023-07-14T11:19:23.938624+0000","last_active":"2023-07-14T11:19:23.938624+0000","last_peered":"2023-07-14T11:19:23.938624+0000","last_clean":"2023-07-14T11:19:23.938624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:23.938624+0000","last_undegraded":"2023-07-14T11:19:23.938624+0000","last_fullsized":"2023-07-14T11:19:23.938624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1c","version":"105'2","reported_seq":15,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.964353+0000","last_change":"2023-07-14T11:19:23.963900+0000","last_active":"2023-07-14T11:19:25.964353+0000","last_peered":"2023-07-14T11:19:25.964353+0000","last_clean":"2023-07-14T11:19:25.964353+0000","last_became_active":"2023-07-14T11:19:23.963623+0000","last_became_peered":"2023-07-14T11:19:23.963623+0000","last_unstale":"2023-07-14T11:19:25.964353+0000","last_undegraded":"2023-07-14T11:19:25.964353+0000","last_fullsized":"2023-07-14T11:19:25.964353+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:25:03.366408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.964152+0000","last_change":"2023-07-14T11:19:24.971636+0000","last_active":"2023-07-14T11:19:25.964152+0000","last_peered":"2023-07-14T11:19:25.964152+0000","last_clean":"2023-07-14T11:19:25.964152+0000","last_became_active":"2023-07-14T11:19:24.971328+0000","last_became_peered":"2023-07-14T11:19:24.971328+0000","last_unstale":"2023-07-14T11:19:25.964152+0000","last_undegraded":"2023-07-14T11:19:25.964152+0000","last_fullsized":"2023-07-14T11:19:25.964152+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:48:38.451247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"105'1","reported_seq":14,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967274+0000","last_change":"2023-07-14T11:19:23.962575+0000","last_active":"2023-07-14T11:19:25.967274+0000","last_peered":"2023-07-14T11:19:25.967274+0000","last_clean":"2023-07-14T11:19:25.967274+0000","last_became_active":"2023-07-14T11:19:23.962299+0000","last_became_peered":"2023-07-14T11:19:23.962299+0000","last_unstale":"2023-07-14T11:19:25.967274+0000","last_undegraded":"2023-07-14T11:19:25.967274+0000","last_fullsized":"2023-07-14T11:19:25.967274+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:56:49.505955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.966859+0000","last_change":"2023-07-14T11:19:24.981916+0000","last_active":"2023-07-14T11:19:25.966859+0000","last_peered":"2023-07-14T11:19:25.966859+0000","last_clean":"2023-07-14T11:19:25.966859+0000","last_became_active":"2023-07-14T11:19:24.981458+0000","last_became_peered":"2023-07-14T11:19:24.981458+0000","last_unstale":"2023-07-14T11:19:25.966859+0000","last_undegraded":"2023-07-14T11:19:25.966859+0000","last_fullsized":"2023-07-14T11:19:25.966859+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:33:58.183494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"105'1","reported_seq":14,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400247+0000","last_change":"2023-07-14T11:19:23.965613+0000","last_active":"2023-07-14T11:19:27.400247+0000","last_peered":"2023-07-14T11:19:27.400247+0000","last_clean":"2023-07-14T11:19:27.400247+0000","last_became_active":"2023-07-14T11:19:23.965357+0000","last_became_peered":"2023-07-14T11:19:23.965357+0000","last_unstale":"2023-07-14T11:19:27.400247+0000","last_undegraded":"2023-07-14T11:19:27.400247+0000","last_fullsized":"2023-07-14T11:19:27.400247+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:45:25.952053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:19:23.938624+0000","last_change":"2023-07-14T11:19:23.938624+0000","last_active":"2023-07-14T11:19:23.938624+0000","last_peered":"2023-07-14T11:19:23.938624+0000","last_clean":"2023-07-14T11:19:23.938624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:23.938624+0000","last_undegraded":"2023-07-14T11:19:23.938624+0000","last_fullsized":"2023-07-14T11:19:23.938624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967284+0000","last_change":"2023-07-14T11:19:23.963545+0000","last_active":"2023-07-14T11:19:25.967284+0000","last_peered":"2023-07-14T11:19:25.967284+0000","last_clean":"2023-07-14T11:19:25.967284+0000","last_became_active":"2023-07-14T11:19:23.963258+0000","last_became_peered":"2023-07-14T11:19:23.963258+0000","last_unstale":"2023-07-14T11:19:25.967284+0000","last_undegraded":"2023-07-14T11:19:25.967284+0000","last_fullsized":"2023-07-14T11:19:25.967284+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:52:08.897066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.964495+0000","last_change":"2023-07-14T11:19:24.963229+0000","last_active":"2023-07-14T11:19:25.964495+0000","last_peered":"2023-07-14T11:19:25.964495+0000","last_clean":"2023-07-14T11:19:25.964495+0000","last_became_active":"2023-07-14T11:19:24.962953+0000","last_became_peered":"2023-07-14T11:19:24.962953+0000","last_unstale":"2023-07-14T11:19:25.964495+0000","last_undegraded":"2023-07-14T11:19:25.964495+0000","last_fullsized":"2023-07-14T11:19:25.964495+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:01:44.444334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400404+0000","last_change":"2023-07-14T11:19:23.967430+0000","last_active":"2023-07-14T11:19:27.400404+0000","last_peered":"2023-07-14T11:19:27.400404+0000","last_clean":"2023-07-14T11:19:27.400404+0000","last_became_active":"2023-07-14T11:19:23.967136+0000","last_became_peered":"2023-07-14T11:19:23.967136+0000","last_unstale":"2023-07-14T11:19:27.400404+0000","last_undegraded":"2023-07-14T11:19:27.400404+0000","last_fullsized":"2023-07-14T11:19:27.400404+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:52:17.347729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967669+0000","last_change":"2023-07-14T11:19:24.984882+0000","last_active":"2023-07-14T11:19:25.967669+0000","last_peered":"2023-07-14T11:19:25.967669+0000","last_clean":"2023-07-14T11:19:25.967669+0000","last_became_active":"2023-07-14T11:19:24.984584+0000","last_became_peered":"2023-07-14T11:19:24.984584+0000","last_unstale":"2023-07-14T11:19:25.967669+0000","last_undegraded":"2023-07-14T11:19:25.967669+0000","last_fullsized":"2023-07-14T11:19:25.967669+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:15:45.414169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"105'1","reported_seq":14,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.964627+0000","last_change":"2023-07-14T11:19:23.966279+0000","last_active":"2023-07-14T11:19:25.964627+0000","last_peered":"2023-07-14T11:19:25.964627+0000","last_clean":"2023-07-14T11:19:25.964627+0000","last_became_active":"2023-07-14T11:19:23.965983+0000","last_became_peered":"2023-07-14T11:19:23.965983+0000","last_unstale":"2023-07-14T11:19:25.964627+0000","last_undegraded":"2023-07-14T11:19:25.964627+0000","last_fullsized":"2023-07-14T11:19:25.964627+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:37:11.528205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967019+0000","last_change":"2023-07-14T11:19:24.976404+0000","last_active":"2023-07-14T11:19:25.967019+0000","last_peered":"2023-07-14T11:19:25.967019+0000","last_clean":"2023-07-14T11:19:25.967019+0000","last_became_active":"2023-07-14T11:19:24.975878+0000","last_became_peered":"2023-07-14T11:19:24.975878+0000","last_unstale":"2023-07-14T11:19:25.967019+0000","last_undegraded":"2023-07-14T11:19:25.967019+0000","last_fullsized":"2023-07-14T11:19:25.967019+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:35:40.868054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"105'2","reported_seq":15,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400912+0000","last_change":"2023-07-14T11:19:23.970931+0000","last_active":"2023-07-14T11:19:27.400912+0000","last_peered":"2023-07-14T11:19:27.400912+0000","last_clean":"2023-07-14T11:19:27.400912+0000","last_became_active":"2023-07-14T11:19:23.970611+0000","last_became_peered":"2023-07-14T11:19:23.970611+0000","last_unstale":"2023-07-14T11:19:27.400912+0000","last_undegraded":"2023-07-14T11:19:27.400912+0000","last_fullsized":"2023-07-14T11:19:27.400912+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:00:57.799054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.401192+0000","last_change":"2023-07-14T11:19:24.983441+0000","last_active":"2023-07-14T11:19:27.401192+0000","last_peered":"2023-07-14T11:19:27.401192+0000","last_clean":"2023-07-14T11:19:27.401192+0000","last_became_active":"2023-07-14T11:19:24.983143+0000","last_became_peered":"2023-07-14T11:19:24.983143+0000","last_unstale":"2023-07-14T11:19:27.401192+0000","last_undegraded":"2023-07-14T11:19:27.401192+0000","last_fullsized":"2023-07-14T11:19:27.401192+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:43:03.332951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-07-14T11:19:22.947732+0000","last_change":"2023-07-14T11:19:22.947732+0000","last_active":"2023-07-14T11:19:22.930757+0000","last_peered":"2023-07-14T11:19:22.930757+0000","last_clean":"2023-07-14T11:19:22.930757+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:22.947732+0000","last_undegraded":"2023-07-14T11:19:22.947732+0000","last_fullsized":"2023-07-14T11:19:22.947732+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.968229+0000","last_change":"2023-07-14T11:19:24.981805+0000","last_active":"2023-07-14T11:19:25.968229+0000","last_peered":"2023-07-14T11:19:25.968229+0000","last_clean":"2023-07-14T11:19:25.968229+0000","last_became_active":"2023-07-14T11:19:24.981478+0000","last_became_peered":"2023-07-14T11:19:24.981478+0000","last_unstale":"2023-07-14T11:19:25.968229+0000","last_undegraded":"2023-07-14T11:19:25.968229+0000","last_fullsized":"2023-07-14T11:19:25.968229+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:52:18.355596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-07-14T11:19:22.948728+0000","last_change":"2023-07-14T11:19:22.948728+0000","last_active":"2023-07-14T11:19:22.930757+0000","last_peered":"2023-07-14T11:19:22.930757+0000","last_clean":"2023-07-14T11:19:22.930757+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:22.948728+0000","last_undegraded":"2023-07-14T11:19:22.948728+0000","last_fullsized":"2023-07-14T11:19:22.948728+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400328+0000","last_change":"2023-07-14T11:19:24.982953+0000","last_active":"2023-07-14T11:19:27.400328+0000","last_peered":"2023-07-14T11:19:27.400328+0000","last_clean":"2023-07-14T11:19:27.400328+0000","last_became_active":"2023-07-14T11:19:24.982715+0000","last_became_peered":"2023-07-14T11:19:24.982715+0000","last_unstale":"2023-07-14T11:19:27.400328+0000","last_undegraded":"2023-07-14T11:19:27.400328+0000","last_fullsized":"2023-07-14T11:19:27.400328+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:36:57.980619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"105'2","reported_seq":15,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.399715+0000","last_change":"2023-07-14T11:19:23.969963+0000","last_active":"2023-07-14T11:19:27.399715+0000","last_peered":"2023-07-14T11:19:27.399715+0000","last_clean":"2023-07-14T11:19:27.399715+0000","last_became_active":"2023-07-14T11:19:23.969677+0000","last_became_peered":"2023-07-14T11:19:23.969677+0000","last_unstale":"2023-07-14T11:19:27.399715+0000","last_undegraded":"2023-07-14T11:19:27.399715+0000","last_fullsized":"2023-07-14T11:19:27.399715+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:45:05.075884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:19:23.938624+0000","last_change":"2023-07-14T11:19:23.938624+0000","last_active":"2023-07-14T11:19:23.938624+0000","last_peered":"2023-07-14T11:19:23.938624+0000","last_clean":"2023-07-14T11:19:23.938624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:23.938624+0000","last_undegraded":"2023-07-14T11:19:23.938624+0000","last_fullsized":"2023-07-14T11:19:23.938624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-07-14T11:19:22.947660+0000","last_change":"2023-07-14T11:19:22.947660+0000","last_active":"2023-07-14T11:19:22.930757+0000","last_peered":"2023-07-14T11:19:22.930757+0000","last_clean":"2023-07-14T11:19:22.930757+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:22.947660+0000","last_undegraded":"2023-07-14T11:19:22.947660+0000","last_fullsized":"2023-07-14T11:19:22.947660+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:19:23.938624+0000","last_change":"2023-07-14T11:19:23.938624+0000","last_active":"2023-07-14T11:19:23.938624+0000","last_peered":"2023-07-14T11:19:23.938624+0000","last_clean":"2023-07-14T11:19:23.938624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:23.938624+0000","last_undegraded":"2023-07-14T11:19:23.938624+0000","last_fullsized":"2023-07-14T11:19:23.938624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-07-14T11:19:22.945911+0000","last_change":"2023-07-14T11:19:22.945911+0000","last_active":"2023-07-14T11:19:22.930757+0000","last_peered":"2023-07-14T11:19:22.930757+0000","last_clean":"2023-07-14T11:19:22.930757+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:22.945911+0000","last_undegraded":"2023-07-14T11:19:22.945911+0000","last_fullsized":"2023-07-14T11:19:22.945911+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967601+0000","last_change":"2023-07-14T11:19:24.978534+0000","last_active":"2023-07-14T11:19:25.967601+0000","last_peered":"2023-07-14T11:19:25.967601+0000","last_clean":"2023-07-14T11:19:25.967601+0000","last_became_active":"2023-07-14T11:19:24.978198+0000","last_became_peered":"2023-07-14T11:19:24.978198+0000","last_unstale":"2023-07-14T11:19:25.967601+0000","last_undegraded":"2023-07-14T11:19:25.967601+0000","last_fullsized":"2023-07-14T11:19:25.967601+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:28:09.892883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-07-14T11:19:22.949000+0000","last_change":"2023-07-14T11:19:22.949000+0000","last_active":"2023-07-14T11:19:22.930757+0000","last_peered":"2023-07-14T11:19:22.930757+0000","last_clean":"2023-07-14T11:19:22.930757+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:22.949000+0000","last_undegraded":"2023-07-14T11:19:22.949000+0000","last_fullsized":"2023-07-14T11:19:22.949000+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.401189+0000","last_change":"2023-07-14T11:19:24.981929+0000","last_active":"2023-07-14T11:19:27.401189+0000","last_peered":"2023-07-14T11:19:27.401189+0000","last_clean":"2023-07-14T11:19:27.401189+0000","last_became_active":"2023-07-14T11:19:24.981116+0000","last_became_peered":"2023-07-14T11:19:24.981116+0000","last_unstale":"2023-07-14T11:19:27.401189+0000","last_undegraded":"2023-07-14T11:19:27.401189+0000","last_fullsized":"2023-07-14T11:19:27.401189+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:11:36.584744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"105'2","reported_seq":15,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400000+0000","last_change":"2023-07-14T11:19:23.964927+0000","last_active":"2023-07-14T11:19:27.400000+0000","last_peered":"2023-07-14T11:19:27.400000+0000","last_clean":"2023-07-14T11:19:27.400000+0000","last_became_active":"2023-07-14T11:19:23.964561+0000","last_became_peered":"2023-07-14T11:19:23.964561+0000","last_unstale":"2023-07-14T11:19:27.400000+0000","last_undegraded":"2023-07-14T11:19:27.400000+0000","last_fullsized":"2023-07-14T11:19:27.400000+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:56:43.945140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.964338+0000","last_change":"2023-07-14T11:19:24.971692+0000","last_active":"2023-07-14T11:19:25.964338+0000","last_peered":"2023-07-14T11:19:25.964338+0000","last_clean":"2023-07-14T11:19:25.964338+0000","last_became_active":"2023-07-14T11:19:24.971436+0000","last_became_peered":"2023-07-14T11:19:24.971436+0000","last_unstale":"2023-07-14T11:19:25.964338+0000","last_undegraded":"2023-07-14T11:19:25.964338+0000","last_fullsized":"2023-07-14T11:19:25.964338+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:57:11.662188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-07-14T11:19:22.946542+0000","last_change":"2023-07-14T11:19:22.946542+0000","last_active":"2023-07-14T11:19:22.930757+0000","last_peered":"2023-07-14T11:19:22.930757+0000","last_clean":"2023-07-14T11:19:22.930757+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:22.946542+0000","last_undegraded":"2023-07-14T11:19:22.946542+0000","last_fullsized":"2023-07-14T11:19:22.946542+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:19:23.938624+0000","last_change":"2023-07-14T11:19:23.938624+0000","last_active":"2023-07-14T11:19:23.938624+0000","last_peered":"2023-07-14T11:19:23.938624+0000","last_clean":"2023-07-14T11:19:23.938624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:23.938624+0000","last_undegraded":"2023-07-14T11:19:23.938624+0000","last_fullsized":"2023-07-14T11:19:23.938624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-07-14T11:19:22.946466+0000","last_change":"2023-07-14T11:19:22.946466+0000","last_active":"2023-07-14T11:19:22.930757+0000","last_peered":"2023-07-14T11:19:22.930757+0000","last_clean":"2023-07-14T11:19:22.930757+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:22.946466+0000","last_undegraded":"2023-07-14T11:19:22.946466+0000","last_fullsized":"2023-07-14T11:19:22.946466+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400005+0000","last_change":"2023-07-14T11:19:24.982564+0000","last_active":"2023-07-14T11:19:27.400005+0000","last_peered":"2023-07-14T11:19:27.400005+0000","last_clean":"2023-07-14T11:19:27.400005+0000","last_became_active":"2023-07-14T11:19:24.982238+0000","last_became_peered":"2023-07-14T11:19:24.982238+0000","last_unstale":"2023-07-14T11:19:27.400005+0000","last_undegraded":"2023-07-14T11:19:27.400005+0000","last_fullsized":"2023-07-14T11:19:27.400005+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:48:10.260203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.401208+0000","last_change":"2023-07-14T11:19:23.967504+0000","last_active":"2023-07-14T11:19:27.401208+0000","last_peered":"2023-07-14T11:19:27.401208+0000","last_clean":"2023-07-14T11:19:27.401208+0000","last_became_active":"2023-07-14T11:19:23.967103+0000","last_became_peered":"2023-07-14T11:19:23.967103+0000","last_unstale":"2023-07-14T11:19:27.401208+0000","last_undegraded":"2023-07-14T11:19:27.401208+0000","last_fullsized":"2023-07-14T11:19:27.401208+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:06:38.495123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400575+0000","last_change":"2023-07-14T11:19:24.980008+0000","last_active":"2023-07-14T11:19:27.400575+0000","last_peered":"2023-07-14T11:19:27.400575+0000","last_clean":"2023-07-14T11:19:27.400575+0000","last_became_active":"2023-07-14T11:19:24.979729+0000","last_became_peered":"2023-07-14T11:19:24.979729+0000","last_unstale":"2023-07-14T11:19:27.400575+0000","last_undegraded":"2023-07-14T11:19:27.400575+0000","last_fullsized":"2023-07-14T11:19:27.400575+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:59:22.004159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967419+0000","last_change":"2023-07-14T11:19:23.966672+0000","last_active":"2023-07-14T11:19:25.967419+0000","last_peered":"2023-07-14T11:19:25.967419+0000","last_clean":"2023-07-14T11:19:25.967419+0000","last_became_active":"2023-07-14T11:19:23.966360+0000","last_became_peered":"2023-07-14T11:19:23.966360+0000","last_unstale":"2023-07-14T11:19:25.967419+0000","last_undegraded":"2023-07-14T11:19:25.967419+0000","last_fullsized":"2023-07-14T11:19:25.967419+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:18:10.519816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:19:23.938624+0000","last_change":"2023-07-14T11:19:23.938624+0000","last_active":"2023-07-14T11:19:23.938624+0000","last_peered":"2023-07-14T11:19:23.938624+0000","last_clean":"2023-07-14T11:19:23.938624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:23.938624+0000","last_undegraded":"2023-07-14T11:19:23.938624+0000","last_fullsized":"2023-07-14T11:19:23.938624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967195+0000","last_change":"2023-07-14T11:19:23.965288+0000","last_active":"2023-07-14T11:19:25.967195+0000","last_peered":"2023-07-14T11:19:25.967195+0000","last_clean":"2023-07-14T11:19:25.967195+0000","last_became_active":"2023-07-14T11:19:23.965026+0000","last_became_peered":"2023-07-14T11:19:23.965026+0000","last_unstale":"2023-07-14T11:19:25.967195+0000","last_undegraded":"2023-07-14T11:19:25.967195+0000","last_fullsized":"2023-07-14T11:19:25.967195+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:01:26.582106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:19:23.938624+0000","last_change":"2023-07-14T11:19:23.938624+0000","last_active":"2023-07-14T11:19:23.938624+0000","last_peered":"2023-07-14T11:19:23.938624+0000","last_clean":"2023-07-14T11:19:23.938624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:23.938624+0000","last_undegraded":"2023-07-14T11:19:23.938624+0000","last_fullsized":"2023-07-14T11:19:23.938624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400784+0000","last_change":"2023-07-14T11:19:23.967500+0000","last_active":"2023-07-14T11:19:27.400784+0000","last_peered":"2023-07-14T11:19:27.400784+0000","last_clean":"2023-07-14T11:19:27.400784+0000","last_became_active":"2023-07-14T11:19:23.967047+0000","last_became_peered":"2023-07-14T11:19:23.967047+0000","last_unstale":"2023-07-14T11:19:27.400784+0000","last_undegraded":"2023-07-14T11:19:27.400784+0000","last_fullsized":"2023-07-14T11:19:27.400784+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:28:25.198305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.964622+0000","last_change":"2023-07-14T11:19:24.975857+0000","last_active":"2023-07-14T11:19:25.964622+0000","last_peered":"2023-07-14T11:19:25.964622+0000","last_clean":"2023-07-14T11:19:25.964622+0000","last_became_active":"2023-07-14T11:19:24.975556+0000","last_became_peered":"2023-07-14T11:19:24.975556+0000","last_unstale":"2023-07-14T11:19:25.964622+0000","last_undegraded":"2023-07-14T11:19:25.964622+0000","last_fullsized":"2023-07-14T11:19:25.964622+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:02:11.711759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-07-14T11:19:22.948552+0000","last_change":"2023-07-14T11:19:22.948552+0000","last_active":"2023-07-14T11:19:22.930757+0000","last_peered":"2023-07-14T11:19:22.930757+0000","last_clean":"2023-07-14T11:19:22.930757+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:22.948552+0000","last_undegraded":"2023-07-14T11:19:22.948552+0000","last_fullsized":"2023-07-14T11:19:22.948552+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.968126+0000","last_change":"2023-07-14T11:19:24.978612+0000","last_active":"2023-07-14T11:19:25.968126+0000","last_peered":"2023-07-14T11:19:25.968126+0000","last_clean":"2023-07-14T11:19:25.968126+0000","last_became_active":"2023-07-14T11:19:24.978260+0000","last_became_peered":"2023-07-14T11:19:24.978260+0000","last_unstale":"2023-07-14T11:19:25.968126+0000","last_undegraded":"2023-07-14T11:19:25.968126+0000","last_fullsized":"2023-07-14T11:19:25.968126+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:45:26.959920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-07-14T11:19:22.947747+0000","last_change":"2023-07-14T11:19:22.947747+0000","last_active":"2023-07-14T11:19:22.930757+0000","last_peered":"2023-07-14T11:19:22.930757+0000","last_clean":"2023-07-14T11:19:22.930757+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:22.947747+0000","last_undegraded":"2023-07-14T11:19:22.947747+0000","last_fullsized":"2023-07-14T11:19:22.947747+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":161,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-14T11:19:22.947870+0000","last_change":"2023-07-14T11:13:08.762084+0000","last_active":"2023-07-14T11:19:22.947870+0000","last_peered":"2023-07-14T11:19:22.947870+0000","last_clean":"2023-07-14T11:19:22.947870+0000","last_became_active":"2023-07-14T11:13:08.761763+0000","last_became_peered":"2023-07-14T11:13:08.761763+0000","last_unstale":"2023-07-14T11:19:22.947870+0000","last_undegraded":"2023-07-14T11:19:22.947870+0000","last_fullsized":"2023-07-14T11:19:22.947870+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:18:09.688083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:19:23.938624+0000","last_change":"2023-07-14T11:19:23.938624+0000","last_active":"2023-07-14T11:19:23.938624+0000","last_peered":"2023-07-14T11:19:23.938624+0000","last_clean":"2023-07-14T11:19:23.938624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:23.938624+0000","last_undegraded":"2023-07-14T11:19:23.938624+0000","last_fullsized":"2023-07-14T11:19:23.938624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.15","version":"105'3","reported_seq":16,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967842+0000","last_change":"2023-07-14T11:19:23.969233+0000","last_active":"2023-07-14T11:19:25.967842+0000","last_peered":"2023-07-14T11:19:25.967842+0000","last_clean":"2023-07-14T11:19:25.967842+0000","last_became_active":"2023-07-14T11:19:23.968938+0000","last_became_peered":"2023-07-14T11:19:23.968938+0000","last_unstale":"2023-07-14T11:19:25.967842+0000","last_undegraded":"2023-07-14T11:19:25.967842+0000","last_fullsized":"2023-07-14T11:19:25.967842+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:53:14.223807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":187,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.964710+0000","last_change":"2023-07-14T11:13:08.761726+0000","last_active":"2023-07-14T11:19:25.964710+0000","last_peered":"2023-07-14T11:19:25.964710+0000","last_clean":"2023-07-14T11:19:25.964710+0000","last_became_active":"2023-07-14T11:13:08.761365+0000","last_became_peered":"2023-07-14T11:13:08.761365+0000","last_unstale":"2023-07-14T11:19:25.964710+0000","last_undegraded":"2023-07-14T11:19:25.964710+0000","last_fullsized":"2023-07-14T11:19:25.964710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:19:34.910190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967811+0000","last_change":"2023-07-14T11:19:24.985128+0000","last_active":"2023-07-14T11:19:25.967811+0000","last_peered":"2023-07-14T11:19:25.967811+0000","last_clean":"2023-07-14T11:19:25.967811+0000","last_became_active":"2023-07-14T11:19:24.984814+0000","last_became_peered":"2023-07-14T11:19:24.984814+0000","last_unstale":"2023-07-14T11:19:25.967811+0000","last_undegraded":"2023-07-14T11:19:25.967811+0000","last_fullsized":"2023-07-14T11:19:25.967811+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:37:46.235964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.968001+0000","last_change":"2023-07-14T11:19:23.959733+0000","last_active":"2023-07-14T11:19:25.968001+0000","last_peered":"2023-07-14T11:19:25.968001+0000","last_clean":"2023-07-14T11:19:25.968001+0000","last_became_active":"2023-07-14T11:19:23.959449+0000","last_became_peered":"2023-07-14T11:19:23.959449+0000","last_unstale":"2023-07-14T11:19:25.968001+0000","last_undegraded":"2023-07-14T11:19:25.968001+0000","last_fullsized":"2023-07-14T11:19:25.968001+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:14:29.323565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":151,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-14T11:19:22.949527+0000","last_change":"2023-07-14T11:13:08.923899+0000","last_active":"2023-07-14T11:19:22.949527+0000","last_peered":"2023-07-14T11:19:22.949527+0000","last_clean":"2023-07-14T11:19:22.949527+0000","last_became_active":"2023-07-14T11:13:08.923513+0000","last_became_peered":"2023-07-14T11:13:08.923513+0000","last_unstale":"2023-07-14T11:19:22.949527+0000","last_undegraded":"2023-07-14T11:19:22.949527+0000","last_fullsized":"2023-07-14T11:19:22.949527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:02:09.817122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:19:23.938624+0000","last_change":"2023-07-14T11:19:23.938624+0000","last_active":"2023-07-14T11:19:23.938624+0000","last_peered":"2023-07-14T11:19:23.938624+0000","last_clean":"2023-07-14T11:19:23.938624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:23.938624+0000","last_undegraded":"2023-07-14T11:19:23.938624+0000","last_fullsized":"2023-07-14T11:19:23.938624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-07-14T11:19:22.947360+0000","last_change":"2023-07-14T11:19:22.947360+0000","last_active":"2023-07-14T11:19:22.930757+0000","last_peered":"2023-07-14T11:19:22.930757+0000","last_clean":"2023-07-14T11:19:22.930757+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:22.947360+0000","last_undegraded":"2023-07-14T11:19:22.947360+0000","last_fullsized":"2023-07-14T11:19:22.947360+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":152,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-14T11:19:22.949891+0000","last_change":"2023-07-14T11:13:08.760609+0000","last_active":"2023-07-14T11:19:22.949891+0000","last_peered":"2023-07-14T11:19:22.949891+0000","last_clean":"2023-07-14T11:19:22.949891+0000","last_became_active":"2023-07-14T11:13:08.760285+0000","last_became_peered":"2023-07-14T11:13:08.760285+0000","last_unstale":"2023-07-14T11:19:22.949891+0000","last_undegraded":"2023-07-14T11:19:22.949891+0000","last_fullsized":"2023-07-14T11:19:22.949891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:28:15.435436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:19:23.938624+0000","last_change":"2023-07-14T11:19:23.938624+0000","last_active":"2023-07-14T11:19:23.938624+0000","last_peered":"2023-07-14T11:19:23.938624+0000","last_clean":"2023-07-14T11:19:23.938624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:23.938624+0000","last_undegraded":"2023-07-14T11:19:23.938624+0000","last_fullsized":"2023-07-14T11:19:23.938624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-07-14T11:19:22.945755+0000","last_change":"2023-07-14T11:19:22.945755+0000","last_active":"2023-07-14T11:19:22.930757+0000","last_peered":"2023-07-14T11:19:22.930757+0000","last_clean":"2023-07-14T11:19:22.930757+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:22.945755+0000","last_undegraded":"2023-07-14T11:19:22.945755+0000","last_fullsized":"2023-07-14T11:19:22.945755+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"76'128","reported_seq":347,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-14T11:19:22.950012+0000","last_change":"2023-07-14T11:13:01.370649+0000","last_active":"2023-07-14T11:19:22.950012+0000","last_peered":"2023-07-14T11:19:22.950012+0000","last_clean":"2023-07-14T11:19:22.950012+0000","last_became_active":"2023-07-14T11:13:01.369478+0000","last_became_peered":"2023-07-14T11:13:01.369478+0000","last_unstale":"2023-07-14T11:19:22.950012+0000","last_undegraded":"2023-07-14T11:19:22.950012+0000","last_fullsized":"2023-07-14T11:19:22.950012+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:00.254800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:00.254800+0000","last_clean_scrub_stamp":"2023-07-14T11:13:00.254800+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:35:05.301387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":172,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967539+0000","last_change":"2023-07-14T11:13:08.757882+0000","last_active":"2023-07-14T11:19:25.967539+0000","last_peered":"2023-07-14T11:19:25.967539+0000","last_clean":"2023-07-14T11:19:25.967539+0000","last_became_active":"2023-07-14T11:13:08.757541+0000","last_became_peered":"2023-07-14T11:13:08.757541+0000","last_unstale":"2023-07-14T11:19:25.967539+0000","last_undegraded":"2023-07-14T11:19:25.967539+0000","last_fullsized":"2023-07-14T11:19:25.967539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:44:22.274150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.964372+0000","last_change":"2023-07-14T11:19:24.972447+0000","last_active":"2023-07-14T11:19:25.964372+0000","last_peered":"2023-07-14T11:19:25.964372+0000","last_clean":"2023-07-14T11:19:25.964372+0000","last_became_active":"2023-07-14T11:19:24.972170+0000","last_became_peered":"2023-07-14T11:19:24.972170+0000","last_unstale":"2023-07-14T11:19:25.964372+0000","last_undegraded":"2023-07-14T11:19:25.964372+0000","last_fullsized":"2023-07-14T11:19:25.964372+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:06:12.493242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-07-14T11:19:22.947609+0000","last_change":"2023-07-14T11:19:22.947609+0000","last_active":"2023-07-14T11:19:22.930757+0000","last_peered":"2023-07-14T11:19:22.930757+0000","last_clean":"2023-07-14T11:19:22.930757+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:22.947609+0000","last_undegraded":"2023-07-14T11:19:22.947609+0000","last_fullsized":"2023-07-14T11:19:22.947609+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":176,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.399575+0000","last_change":"2023-07-14T11:13:08.862331+0000","last_active":"2023-07-14T11:19:27.399575+0000","last_peered":"2023-07-14T11:19:27.399575+0000","last_clean":"2023-07-14T11:19:27.399575+0000","last_became_active":"2023-07-14T11:13:08.861817+0000","last_became_peered":"2023-07-14T11:13:08.861817+0000","last_unstale":"2023-07-14T11:19:27.399575+0000","last_undegraded":"2023-07-14T11:19:27.399575+0000","last_fullsized":"2023-07-14T11:19:27.399575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:06:57.469895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.399635+0000","last_change":"2023-07-14T11:19:24.980611+0000","last_active":"2023-07-14T11:19:27.399635+0000","last_peered":"2023-07-14T11:19:27.399635+0000","last_clean":"2023-07-14T11:19:27.399635+0000","last_became_active":"2023-07-14T11:19:24.980359+0000","last_became_peered":"2023-07-14T11:19:24.980359+0000","last_unstale":"2023-07-14T11:19:27.399635+0000","last_undegraded":"2023-07-14T11:19:27.399635+0000","last_fullsized":"2023-07-14T11:19:27.399635+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:16:08.807717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-07-14T11:19:22.947503+0000","last_change":"2023-07-14T11:19:22.947503+0000","last_active":"2023-07-14T11:19:22.930757+0000","last_peered":"2023-07-14T11:19:22.930757+0000","last_clean":"2023-07-14T11:19:22.930757+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:22.947503+0000","last_undegraded":"2023-07-14T11:19:22.947503+0000","last_fullsized":"2023-07-14T11:19:22.947503+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":172,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967485+0000","last_change":"2023-07-14T11:13:08.758749+0000","last_active":"2023-07-14T11:19:25.967485+0000","last_peered":"2023-07-14T11:19:25.967485+0000","last_clean":"2023-07-14T11:19:25.967485+0000","last_became_active":"2023-07-14T11:13:08.757956+0000","last_became_peered":"2023-07-14T11:13:08.757956+0000","last_unstale":"2023-07-14T11:19:25.967485+0000","last_undegraded":"2023-07-14T11:19:25.967485+0000","last_fullsized":"2023-07-14T11:19:25.967485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:50:28.757111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:19:23.938624+0000","last_change":"2023-07-14T11:19:23.938624+0000","last_active":"2023-07-14T11:19:23.938624+0000","last_peered":"2023-07-14T11:19:23.938624+0000","last_clean":"2023-07-14T11:19:23.938624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:23.938624+0000","last_undegraded":"2023-07-14T11:19:23.938624+0000","last_fullsized":"2023-07-14T11:19:23.938624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-07-14T11:19:22.946805+0000","last_change":"2023-07-14T11:19:22.946805+0000","last_active":"2023-07-14T11:19:22.930757+0000","last_peered":"2023-07-14T11:19:22.930757+0000","last_clean":"2023-07-14T11:19:22.930757+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:22.946805+0000","last_undegraded":"2023-07-14T11:19:22.946805+0000","last_fullsized":"2023-07-14T11:19:22.946805+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":188,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.964499+0000","last_change":"2023-07-14T11:13:08.923786+0000","last_active":"2023-07-14T11:19:25.964499+0000","last_peered":"2023-07-14T11:19:25.964499+0000","last_clean":"2023-07-14T11:19:25.964499+0000","last_became_active":"2023-07-14T11:13:08.923384+0000","last_became_peered":"2023-07-14T11:13:08.923384+0000","last_unstale":"2023-07-14T11:19:25.964499+0000","last_undegraded":"2023-07-14T11:19:25.964499+0000","last_fullsized":"2023-07-14T11:19:25.964499+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:32:52.150831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":82,"acting":82,"num_store_stats":5},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":112,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15,"ondisk_log_size":15,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574929,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32880,"kb_used_data":1832,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338960,"statfs":{"total":96636764160,"available":96603095040,"internally_reserved":0,"allocated":1875968,"data_stored":1181478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:19:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.66200000000000003,"15min":0.89400000000000002},"min":{"1min":0.55500000000000005,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":8.4339999999999993},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.69199999999999995,"15min":0.92800000000000005},"min":{"1min":0.47599999999999998,"5min":0.45500000000000002,"15min":0.377},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":8.4559999999999995},"last":0.65100000000000002}]},{"osd":1,"last update":"Fri Jul 14 11:19:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.67200000000000004,"15min":0.871},"min":{"1min":0.52100000000000002,"5min":0.40400000000000003,"15min":0.34899999999999998},"max":{"1min":0.90400000000000003,"5min":0.92800000000000005,"15min":6.3520000000000003},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.66100000000000003,"15min":1.0089999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":6.8550000000000004},"last":0.71199999999999997}]},{"osd":2,"last update":"Fri Jul 14 11:19:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.67100000000000004,"15min":1.0569999999999999},"min":{"1min":0.499,"5min":0.434,"15min":0.434},"max":{"1min":0.83599999999999997,"5min":0.997,"15min":7.0289999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.70399999999999996,"15min":0.69299999999999995},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.86399999999999999,"5min":0.98199999999999998,"15min":1.0580000000000001},"last":0.81000000000000005}]},{"osd":3,"last update":"Fri Jul 14 11:19:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.68899999999999995,"15min":1.109},"min":{"1min":0.55200000000000005,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.91100000000000003,"5min":0.95699999999999996,"15min":10.337},"last":0.755},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.72699999999999998,"15min":0.75800000000000001},"min":{"1min":0.53300000000000003,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.90100000000000002,"5min":1.024,"15min":1.921},"last":0.53400000000000003}]},{"osd":4,"last update":"Fri Jul 14 11:19:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.64700000000000002,"15min":0.59899999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.73599999999999999,"15min":0.70599999999999996},"min":{"1min":0.57299999999999995,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.90800000000000003,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.59099999999999997}]},{"osd":5,"last update":"Fri Jul 14 11:19:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.70099999999999996,"15min":0.67900000000000005},"min":{"1min":0.39700000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.92800000000000005,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.76400000000000001,"15min":0.73999999999999999},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.47499999999999998}]},{"osd":6,"last update":"Fri Jul 14 11:19:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.72899999999999998,"15min":0.68300000000000005},"min":{"1min":0.505,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.98799999999999999,"5min":1.002,"15min":1.002},"last":0.5},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.73299999999999998,"15min":0.69399999999999995},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.48899999999999999},"max":{"1min":0.97399999999999998,"5min":1.129,"15min":1.129},"last":0.51300000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574930,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28204,"kb_used_data":1252,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343636,"statfs":{"total":96636764160,"available":96607883264,"internally_reserved":0,"allocated":1282048,"data_stored":591110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.69899999999999995,"15min":0.70299999999999996},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93799999999999994,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.73499999999999999,"15min":0.72099999999999997},"min":{"1min":0.51100000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.83899999999999997,"5min":1.167,"15min":1.167},"last":0.55900000000000005}]},{"osd":1,"last update":"Fri Jul 14 11:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71899999999999997,"15min":0.69099999999999995},"min":{"1min":0.443,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.73099999999999998,"15min":0.71399999999999997},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39300000000000002},"max":{"1min":0.90400000000000003,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.64400000000000002}]},{"osd":2,"last update":"Fri Jul 14 11:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.69899999999999995,"15min":0.67900000000000005},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.41299999999999998},"max":{"1min":0.89000000000000001,"5min":1.45,"15min":1.45},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.755,"5min":0.754,"15min":0.77600000000000002},"min":{"1min":0.56399999999999995,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.075,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.66300000000000003}]},{"osd":3,"last update":"Fri Jul 14 11:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.73099999999999998,"15min":0.74299999999999999},"min":{"1min":0.50900000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.86499999999999999,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.73299999999999998,"15min":0.73899999999999999},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0469999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.496}]},{"osd":4,"last update":"Fri Jul 14 11:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.69099999999999995,"15min":0.70699999999999996},"min":{"1min":0.53300000000000003,"5min":0.38,"15min":0.38},"max":{"1min":1.177,"5min":1.712,"15min":1.712},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.71999999999999997,"15min":0.72599999999999998},"min":{"1min":0.48199999999999998,"5min":0.438,"15min":0.42899999999999999},"max":{"1min":0.998,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.67800000000000005}]},{"osd":5,"last update":"Fri Jul 14 11:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.71199999999999997,"15min":0.71799999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.93500000000000005,"5min":2.8820000000000001,"15min":2.8820000000000001},"last":0.628},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.77200000000000002,"15min":0.78800000000000003},"min":{"1min":0.58399999999999996,"5min":0.46100000000000002,"15min":0.44500000000000001},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.71199999999999997}]},{"osd":7,"last update":"Fri Jul 14 11:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.77500000000000002,"15min":0.79900000000000004},"min":{"1min":0.59899999999999998,"5min":0.47399999999999998,"15min":0.47099999999999997},"max":{"1min":0.95499999999999996,"5min":1.333,"15min":1.333},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.76300000000000001,"15min":0.78900000000000003},"min":{"1min":0.46899999999999997,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.1579999999999999,"5min":1.55,"15min":1.55},"last":0.746}]}]},{"osd":1,"up_from":13,"seq":55834574930,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28244,"kb_used_data":1292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343596,"statfs":{"total":96636764160,"available":96607842304,"internally_reserved":0,"allocated":1323008,"data_stored":611541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.40500000000000003,"15min":0.432},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.54200000000000004,"5min":0.59099999999999997,"15min":0.996},"last":0.745},{"interface":"front","average":{"1min":0.432,"5min":0.45500000000000002,"15min":0.47599999999999998},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.57299999999999995,"5min":0.81599999999999995,"15min":0.84299999999999997},"last":0.40699999999999997}]},{"osd":2,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.48099999999999998,"15min":0.54900000000000004},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.60299999999999998,"5min":0.70799999999999996,"15min":2.476},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.48899999999999999,"15min":0.59499999999999997},"min":{"1min":0.36899999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.64700000000000002,"5min":0.91700000000000004,"15min":2.6299999999999999},"last":0.57499999999999996}]},{"osd":3,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.52800000000000002,"15min":0.52200000000000002},"min":{"1min":0.40899999999999997,"5min":0.39300000000000002,"15min":0.38900000000000001},"max":{"1min":0.72599999999999998,"5min":0.748,"15min":0.748},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46500000000000002,"15min":0.48799999999999999},"min":{"1min":0.33600000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.59499999999999997,"5min":0.67700000000000005,"15min":0.73199999999999998},"last":0.47799999999999998}]},{"osd":4,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.73699999999999999,"15min":0.749},"min":{"1min":0.52400000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.363},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.751,"5min":0.754,"15min":0.76900000000000002},"min":{"1min":0.57099999999999995,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.93999999999999995,"5min":1.1160000000000001,"15min":1.4890000000000001},"last":0.625}]},{"osd":5,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.749,"15min":0.76500000000000001},"min":{"1min":0.54200000000000004,"5min":0.499,"15min":0.499},"max":{"1min":1.0589999999999999,"5min":1.2250000000000001,"15min":1.3759999999999999},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76200000000000001,"15min":0.80800000000000005},"min":{"1min":0.59099999999999997,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.4330000000000001},"last":0.68799999999999994}]},{"osd":6,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.745,"15min":0.78800000000000003},"min":{"1min":0.55900000000000005,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.028,"5min":1.141,"15min":1.298},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.753,"15min":0.77900000000000003},"min":{"1min":0.60199999999999998,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.97199999999999998,"5min":1.1899999999999999,"15min":1.2130000000000001},"last":0.85699999999999998}]},{"osd":7,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.75900000000000001,"15min":0.80700000000000005},"min":{"1min":0.58299999999999996,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0780000000000001,"5min":1.2010000000000001,"15min":1.4590000000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.75,"15min":0.77900000000000003},"min":{"1min":0.56299999999999994,"5min":0.55000000000000004,"15min":0.54200000000000004},"max":{"1min":1.129,"5min":1.129,"15min":1.3700000000000001},"last":0.71099999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574928,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28824,"kb_used_data":1872,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343016,"statfs":{"total":96636764160,"available":96607248384,"internally_reserved":0,"allocated":1916928,"data_stored":1201909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 11:19:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.47699999999999998,"15min":0.44700000000000001},"min":{"1min":0.26800000000000002,"5min":0.252,"15min":0.252},"max":{"1min":2.972,"5min":2.972,"15min":2.972},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.47599999999999998,"15min":0.45200000000000001},"min":{"1min":0.33300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":2.758,"5min":2.758,"15min":2.758},"last":0.31900000000000001}]},{"osd":2,"last update":"Fri Jul 14 11:19:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.499,"15min":0.47299999999999998},"min":{"1min":0.35599999999999998,"5min":0.307,"15min":0.307},"max":{"1min":2.9409999999999998,"5min":2.9409999999999998,"15min":2.9409999999999998},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.51900000000000002,"15min":0.50900000000000001},"min":{"1min":0.376,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":2.556,"5min":2.556,"15min":2.556},"last":0.45900000000000002}]},{"osd":3,"last update":"Fri Jul 14 11:19:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.48199999999999998,"15min":0.438},"min":{"1min":0.33700000000000002,"5min":0.32000000000000001,"15min":0.309},"max":{"1min":2.6019999999999999,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.55600000000000005,"15min":0.53500000000000003},"min":{"1min":0.44900000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":2.9990000000000001,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":0.56599999999999995}]},{"osd":4,"last update":"Fri Jul 14 11:19:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.73699999999999999,"15min":0.75700000000000001},"min":{"1min":0.51200000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0229999999999999,"5min":1.099,"15min":1.1060000000000001},"last":0.874},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.76400000000000001,"15min":0.71799999999999997},"min":{"1min":0.57499999999999996,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.651,"5min":1.651,"15min":1.651},"last":0.82299999999999995}]},{"osd":5,"last update":"Fri Jul 14 11:19:12 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.77200000000000002,"15min":0.73799999999999999},"min":{"1min":0.51900000000000002,"5min":0.502,"15min":0.47999999999999998},"max":{"1min":2.9089999999999998,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.76500000000000001,"15min":0.77600000000000002},"min":{"1min":0.53200000000000003,"5min":0.505,"15min":0.505},"max":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.77800000000000002}]},{"osd":6,"last update":"Fri Jul 14 11:19:12 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.745,"15min":0.72799999999999998},"min":{"1min":0.499,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.78700000000000003,"15min":0.78300000000000003},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":2.8679999999999999,"5min":2.8679999999999999,"15min":2.8679999999999999},"last":0.76000000000000001}]},{"osd":7,"last update":"Fri Jul 14 11:19:12 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.77700000000000002,"15min":0.80900000000000005},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.97599999999999998,"5min":1.0900000000000001,"15min":1.149},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.81899999999999995,"15min":0.78900000000000003},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.7410000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":0.85799999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574928,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28240,"kb_used_data":1288,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343600,"statfs":{"total":96636764160,"available":96607846400,"internally_reserved":0,"allocated":1318912,"data_stored":611519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:19:20 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.40899999999999997,"15min":0.441},"min":{"1min":0.27100000000000002,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.623,"5min":0.63900000000000001,"15min":0.64700000000000002},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.438,"15min":0.44400000000000001},"min":{"1min":0.32100000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.63700000000000001,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.36399999999999999}]},{"osd":1,"last update":"Fri Jul 14 11:19:20 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46700000000000003,"15min":0.48199999999999998},"min":{"1min":0.371,"5min":0.31,"15min":0.31},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.98299999999999998},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.47899999999999998,"15min":0.48699999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.59199999999999997,"5min":0.629,"15min":0.91200000000000003},"last":0.498}]},{"osd":3,"last update":"Fri Jul 14 11:19:20 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.48699999999999999,"15min":0.49299999999999999},"min":{"1min":0.34999999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.623,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.55700000000000005,"15min":0.57999999999999996},"min":{"1min":0.44500000000000001,"5min":0.41499999999999998,"15min":0.40799999999999997},"max":{"1min":0.72899999999999998,"5min":0.80000000000000004,"15min":1.034},"last":0.53500000000000003}]},{"osd":4,"last update":"Fri Jul 14 11:19:20 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.73499999999999999,"15min":0.76300000000000001},"min":{"1min":0.53900000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.036,"5min":1.171,"15min":1.212},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.749,"15min":0.77900000000000003},"min":{"1min":0.53800000000000003,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.83899999999999997}]},{"osd":5,"last update":"Fri Jul 14 11:19:20 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.74399999999999999,"15min":0.78200000000000003},"min":{"1min":0.53900000000000003,"5min":0.51700000000000002,"15min":0.43099999999999999},"max":{"1min":1.202,"5min":1.202,"15min":1.4019999999999999},"last":0.751},{"interface":"front","average":{"1min":0.75,"5min":0.76300000000000001,"15min":0.81100000000000005},"min":{"1min":0.55800000000000005,"5min":0.495,"15min":0.495},"max":{"1min":1.044,"5min":1.351,"15min":1.351},"last":0.86799999999999999}]},{"osd":6,"last update":"Fri Jul 14 11:19:20 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.753,"15min":0.78100000000000003},"min":{"1min":0.53100000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0089999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.76800000000000002,"15min":0.81299999999999994},"min":{"1min":0.60199999999999998,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.218,"5min":1.282,"15min":1.282},"last":0.80800000000000005}]},{"osd":7,"last update":"Fri Jul 14 11:19:20 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.754,"15min":0.79100000000000004},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.93400000000000005,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.754,"15min":0.79600000000000004},"min":{"1min":0.60899999999999999,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.96399999999999997,"5min":1.244,"15min":1.244},"last":0.77700000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574927,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28204,"kb_used_data":1252,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343636,"statfs":{"total":96636764160,"available":96607883264,"internally_reserved":0,"allocated":1282048,"data_stored":591110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.41099999999999998,"15min":0.442},"min":{"1min":0.24299999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.55900000000000005,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.44500000000000001,"15min":0.44800000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.621,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.29499999999999998}]},{"osd":1,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.44,"15min":0.44900000000000001},"min":{"1min":0.29499999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.52000000000000002,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.47199999999999998,"15min":0.49099999999999999},"min":{"1min":0.317,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.60899999999999999,"5min":0.72699999999999998,"15min":0.86399999999999999},"last":0.47499999999999998}]},{"osd":2,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.53400000000000003,"15min":0.54000000000000004},"min":{"1min":0.39600000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.64900000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56200000000000006,"15min":0.58999999999999997},"min":{"1min":0.44,"5min":0.37,"15min":0.37},"max":{"1min":0.76100000000000001,"5min":0.79600000000000004,"15min":1.585},"last":0.61699999999999999}]},{"osd":4,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.73299999999999998,"15min":0.754},"min":{"1min":0.45400000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.96399999999999997,"5min":1.1279999999999999,"15min":1.216},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.76700000000000002,"15min":0.75700000000000001},"min":{"1min":0.48599999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.67100000000000004}]},{"osd":5,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.747,"15min":0.75700000000000001},"min":{"1min":0.48499999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.089,"5min":1.179,"15min":1.413},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.76700000000000002,"15min":0.83499999999999996},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.94999999999999996,"5min":1.1619999999999999,"15min":1.657},"last":0.57899999999999996}]},{"osd":6,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77700000000000002,"15min":0.78300000000000003},"min":{"1min":0.56699999999999995,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.726},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.755,"5min":0.76800000000000002,"15min":0.79400000000000004},"min":{"1min":0.57099999999999995,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.143,"5min":1.286,"15min":1.333},"last":0.63}]},{"osd":7,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.79700000000000004,"15min":0.83099999999999996},"min":{"1min":0.53800000000000003,"5min":0.437,"15min":0.437},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.3939999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.80800000000000005,"15min":0.83399999999999996},"min":{"1min":0.60299999999999998,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.59999999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574928,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28252,"kb_used_data":1300,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343588,"statfs":{"total":96636764160,"available":96607834112,"internally_reserved":0,"allocated":1331200,"data_stored":613083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:19:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.64900000000000002,"15min":0.63500000000000001},"min":{"1min":0.437,"5min":0.311,"15min":0.311},"max":{"1min":0.89600000000000002,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.65200000000000002,"15min":0.68400000000000005},"min":{"1min":0.47699999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85199999999999998,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.70099999999999996}]},{"osd":1,"last update":"Fri Jul 14 11:19:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.65200000000000002,"15min":0.66600000000000004},"min":{"1min":0.51700000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.83599999999999997,"5min":0.92000000000000004,"15min":1.4259999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70299999999999996,"15min":0.70999999999999996},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.45800000000000002},"max":{"1min":0.95799999999999996,"5min":1.0149999999999999,"15min":1.1659999999999999},"last":0.80400000000000005}]},{"osd":2,"last update":"Fri Jul 14 11:19:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.69999999999999996,"15min":0.70699999999999996},"min":{"1min":0.501,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.88200000000000001,"5min":1.0209999999999999,"15min":1.48},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71999999999999997,"15min":0.73599999999999999},"min":{"1min":0.54800000000000004,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.91800000000000004,"5min":1.1080000000000001,"15min":1.23},"last":0.66600000000000004}]},{"osd":3,"last update":"Fri Jul 14 11:19:15 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.67800000000000005,"15min":0.70799999999999996},"min":{"1min":0.51300000000000001,"5min":0.438,"15min":0.438},"max":{"1min":0.95599999999999996,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.72999999999999998,"15min":0.73599999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.90700000000000003,"5min":1.1259999999999999,"15min":1.145},"last":0.59099999999999997}]},{"osd":5,"last update":"Fri Jul 14 11:19:15 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.66600000000000004,"15min":0.74299999999999999},"min":{"1min":0.47399999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.81799999999999995,"5min":0.95999999999999996,"15min":1.6559999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.65700000000000003,"15min":0.745},"min":{"1min":0.41999999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.90500000000000003,"5min":0.96999999999999997,"15min":1.3839999999999999},"last":0.48299999999999998}]},{"osd":6,"last update":"Fri Jul 14 11:19:15 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.68500000000000005,"15min":0.71299999999999997},"min":{"1min":0.45200000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.86799999999999999,"5min":1.1659999999999999,"15min":1.1970000000000001},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.73699999999999999,"15min":0.76600000000000001},"min":{"1min":0.56899999999999995,"5min":0.442,"15min":0.442},"max":{"1min":0.878,"5min":1.1479999999999999,"15min":1.3},"last":0.84099999999999997}]},{"osd":7,"last update":"Fri Jul 14 11:19:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.70499999999999996,"15min":0.755},"min":{"1min":0.47899999999999998,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.88,"5min":1.028,"15min":1.4810000000000001},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.755,"15min":0.82599999999999996},"min":{"1min":0.59099999999999997,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.82499999999999996,"5min":1.21,"15min":1.379},"last":0.71799999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574930,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28248,"kb_used_data":1296,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343592,"statfs":{"total":96636764160,"available":96607838208,"internally_reserved":0,"allocated":1327104,"data_stored":611679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:19:05 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.61899999999999999,"15min":0.63600000000000001},"min":{"1min":0.371,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.84199999999999997,"5min":0.996,"15min":1.3140000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65200000000000002,"15min":0.64000000000000001},"min":{"1min":0.42399999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":1.0980000000000001},"last":0.80900000000000005}]},{"osd":1,"last update":"Fri Jul 14 11:19:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.624,"15min":0.66400000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.75600000000000001,"5min":0.88800000000000001,"15min":1.343},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.63,"5min":0.65100000000000002,"15min":0.64800000000000002},"min":{"1min":0.442,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.86599999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.65500000000000003}]},{"osd":2,"last update":"Fri Jul 14 11:19:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.69899999999999995,"15min":0.72899999999999998},"min":{"1min":0.46700000000000003,"5min":0.436,"15min":0.436},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.70299999999999996,"15min":0.753},"min":{"1min":0.504,"5min":0.496,"15min":0.496},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":1.3939999999999999},"last":0.84099999999999997}]},{"osd":3,"last update":"Fri Jul 14 11:19:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71199999999999997,"15min":0.75600000000000001},"min":{"1min":0.54500000000000004,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":1.2130000000000001},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.67700000000000005,"15min":0.75700000000000001},"min":{"1min":0.46400000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":1.806},"last":0.72299999999999998}]},{"osd":4,"last update":"Fri Jul 14 11:19:05 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.61699999999999999,"15min":0.64600000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.878,"5min":1.0229999999999999,"15min":1.1319999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.66500000000000004,"15min":0.73699999999999999},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.3999999999999999},"last":0.53400000000000003}]},{"osd":6,"last update":"Fri Jul 14 11:19:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.69699999999999995,"15min":0.73999999999999999},"min":{"1min":0.502,"5min":0.435,"15min":0.435},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.73499999999999999,"15min":0.79000000000000004},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.004,"5min":1.0629999999999999,"15min":1.3640000000000001},"last":0.73599999999999999}]},{"osd":7,"last update":"Fri Jul 14 11:19:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.747,"15min":0.82999999999999996},"min":{"1min":0.54400000000000004,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.4970000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78500000000000003,"15min":0.85499999999999998},"min":{"1min":0.60399999999999998,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.8540000000000001},"last":0.58699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T11:19:29.809 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T11:19:30.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.036+0000 7f891a5ff700 1 Processor -- start 2023-07-14T11:19:30.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.036+0000 7f891a5ff700 1 -- start start 2023-07-14T11:19:30.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.037+0000 7f891a5ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f89140d1160 0x7f891406c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:30.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.037+0000 7f891a5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89140b5cd0 0x7f89140b0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:30.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.037+0000 7f891a5ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89140d2cc0 con 0x7f8914160030 2023-07-14T11:19:30.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.037+0000 7f891a5ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89140afbb0 con 0x7f89140d1160 2023-07-14T11:19:30.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.037+0000 7f891a5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89140afe90 con 0x7f89140b5cd0 2023-07-14T11:19:30.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.038+0000 7f89137fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f89140d1160 0x7f891406c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:30.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.038+0000 7f89137fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f89140d1160 0x7f891406c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40746/0 (socket says 172.21.15.84:40746) 2023-07-14T11:19:30.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.038+0000 7f89137fe700 1 -- 172.21.15.84:0/1456879593 learned_addr learned my addr 172.21.15.84:0/1456879593 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:30.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.038+0000 7f8918b9c700 1 --2- 172.21.15.84:0/1456879593 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89140b5cd0 0x7f89140b0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:30.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.038+0000 7f89137fe700 1 -- 172.21.15.84:0/1456879593 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89140b5cd0 msgr2=0x7f89140b0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:30.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.038+0000 7f89137fe700 1 --2- 172.21.15.84:0/1456879593 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89140b5cd0 0x7f89140b0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:30.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.038+0000 7f89137fe700 1 -- 172.21.15.84:0/1456879593 >> v1:172.21.15.179:6789/0 conn(0x7f8914160030 legacy=0x7f89140d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:30.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.038+0000 7f89137fe700 1 -- 172.21.15.84:0/1456879593 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89140b0170 con 0x7f89140d1160 2023-07-14T11:19:30.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.038+0000 7f89137fe700 1 --2- 172.21.15.84:0/1456879593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89140d1160 0x7f891406c0f0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f89080098f0 tx=0x7f8908009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c11951d7c636455a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:30.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.039+0000 7f8912ffd700 1 -- 172.21.15.84:0/1456879593 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f890800b8a0 con 0x7f89140d1160 2023-07-14T11:19:30.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.039+0000 7f8912ffd700 1 -- 172.21.15.84:0/1456879593 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f890800ba00 con 0x7f89140d1160 2023-07-14T11:19:30.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.039+0000 7f8912ffd700 1 -- 172.21.15.84:0/1456879593 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f890800bd90 con 0x7f89140d1160 2023-07-14T11:19:30.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.039+0000 7f891a5ff700 1 -- 172.21.15.84:0/1456879593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89140d1160 msgr2=0x7f891406c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:30.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.039+0000 7f891a5ff700 1 --2- 172.21.15.84:0/1456879593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89140d1160 0x7f891406c0f0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f89080098f0 tx=0x7f8908009c00 comp rx=0 tx=0).stop 2023-07-14T11:19:30.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.039+0000 7f891a5ff700 1 -- 172.21.15.84:0/1456879593 shutdown_connections 2023-07-14T11:19:30.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.039+0000 7f891a5ff700 1 --2- 172.21.15.84:0/1456879593 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89140b5cd0 0x7f89140b0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:30.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.039+0000 7f891a5ff700 1 --2- 172.21.15.84:0/1456879593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89140d1160 0x7f891406c0f0 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:30.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.039+0000 7f891a5ff700 1 -- 172.21.15.84:0/1456879593 >> 172.21.15.84:0/1456879593 conn(0x7f891409c190 msgr2=0x7f89140d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:30.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.039+0000 7f891a5ff700 1 -- 172.21.15.84:0/1456879593 shutdown_connections 2023-07-14T11:19:30.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.039+0000 7f891a5ff700 1 -- 172.21.15.84:0/1456879593 wait complete. 2023-07-14T11:19:30.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.041+0000 7f891a5ff700 1 Processor -- start 2023-07-14T11:19:30.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.041+0000 7f891a5ff700 1 -- start start 2023-07-14T11:19:30.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.042+0000 7f891a5ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89140b5cd0 0x7f891415bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:30.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.042+0000 7f891a5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89140d1160 0x7f89141e5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:30.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.042+0000 7f891a5ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8914160030 0x7f89140c7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:30.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.042+0000 7f891a5ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f891415d380 con 0x7f89140b5cd0 2023-07-14T11:19:30.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.042+0000 7f891a5ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f891415ce00 con 0x7f8914160030 2023-07-14T11:19:30.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.042+0000 7f891a5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89141e5650 con 0x7f89140d1160 2023-07-14T11:19:30.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.042+0000 7f8913fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89140b5cd0 0x7f891415bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:30.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.042+0000 7f8913fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89140b5cd0 0x7f891415bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40758/0 (socket says 172.21.15.84:40758) 2023-07-14T11:19:30.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.042+0000 7f8913fff700 1 -- 172.21.15.84:0/1481032208 learned_addr learned my addr 172.21.15.84:0/1481032208 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:30.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.042+0000 7f89137fe700 1 --2- 172.21.15.84:0/1481032208 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89140d1160 0x7f89141e5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:30.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.042+0000 7f8918b9c700 1 --2- 172.21.15.84:0/1481032208 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8914160030 0x7f89140c7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:30.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.043+0000 7f8913fff700 1 -- 172.21.15.84:0/1481032208 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89140d1160 msgr2=0x7f89141e5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:30.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.043+0000 7f8913fff700 1 --2- 172.21.15.84:0/1481032208 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89140d1160 0x7f89141e5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:30.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.043+0000 7f8913fff700 1 -- 172.21.15.84:0/1481032208 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8914160030 msgr2=0x7f89140c7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:30.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.043+0000 7f8913fff700 1 --2- 172.21.15.84:0/1481032208 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8914160030 0x7f89140c7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:30.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.043+0000 7f8913fff700 1 -- 172.21.15.84:0/1481032208 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8908009550 con 0x7f89140b5cd0 2023-07-14T11:19:30.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.043+0000 7f8913fff700 1 --2- 172.21.15.84:0/1481032208 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89140b5cd0 0x7f891415bdd0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f890400c450 tx=0x7f890400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:30.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.043+0000 7f8910ff9700 1 -- 172.21.15.84:0/1481032208 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89040052d0 con 0x7f89140b5cd0 2023-07-14T11:19:30.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.043+0000 7f8910ff9700 1 -- 172.21.15.84:0/1481032208 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8904005430 con 0x7f89140b5cd0 2023-07-14T11:19:30.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.043+0000 7f8910ff9700 1 -- 172.21.15.84:0/1481032208 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89040038c0 con 0x7f89140b5cd0 2023-07-14T11:19:30.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.043+0000 7f891a5ff700 1 -- 172.21.15.84:0/1481032208 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f891415d0a0 con 0x7f89140b5cd0 2023-07-14T11:19:30.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.043+0000 7f891a5ff700 1 -- 172.21.15.84:0/1481032208 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89140c9120 con 0x7f89140b5cd0 2023-07-14T11:19:30.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.044+0000 7f891a5ff700 1 -- 172.21.15.84:0/1481032208 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f891404e280 con 0x7f89140b5cd0 2023-07-14T11:19:30.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.045+0000 7f8910ff9700 1 -- 172.21.15.84:0/1481032208 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f8904003a20 con 0x7f89140b5cd0 2023-07-14T11:19:30.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.046+0000 7f8910ff9700 1 --2- 172.21.15.84:0/1481032208 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f890006ae00 0x7f890006d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:30.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.046+0000 7f8910ff9700 1 -- 172.21.15.84:0/1481032208 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8904088910 con 0x7f89140b5cd0 2023-07-14T11:19:30.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.047+0000 7f89137fe700 1 --2- 172.21.15.84:0/1481032208 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f890006ae00 0x7f890006d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:30.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.047+0000 7f89137fe700 1 --2- 172.21.15.84:0/1481032208 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f890006ae00 0x7f890006d2b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f89140d1550 tx=0x7f8908008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:30.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.050+0000 7f8910ff9700 1 -- 172.21.15.84:0/1481032208 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f8904053940 con 0x7f89140b5cd0 2023-07-14T11:19:30.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.239+0000 7f891a5ff700 1 -- 172.21.15.84:0/1481032208 --> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f89140b0730 con 0x7f890006ae00 2023-07-14T11:19:30.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.249+0000 7f8910ff9700 1 -- 172.21.15.84:0/1481032208 <== mgr.4100 v2:172.21.15.179:6836/2094253834 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306542 (secure 0 0 0) 0x7f890800bb70 con 0x7f890006ae00 2023-07-14T11:19:30.255 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:19:30.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.253+0000 7f891a5ff700 1 -- 172.21.15.84:0/1481032208 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f890006ae00 msgr2=0x7f890006d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:30.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.253+0000 7f891a5ff700 1 --2- 172.21.15.84:0/1481032208 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f890006ae00 0x7f890006d2b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f89140d1550 tx=0x7f8908008030 comp rx=0 tx=0).stop 2023-07-14T11:19:30.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.253+0000 7f891a5ff700 1 -- 172.21.15.84:0/1481032208 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89140b5cd0 msgr2=0x7f891415bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:30.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.253+0000 7f891a5ff700 1 --2- 172.21.15.84:0/1481032208 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89140b5cd0 0x7f891415bdd0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f890400c450 tx=0x7f890400c810 comp rx=0 tx=0).stop 2023-07-14T11:19:30.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.253+0000 7f891a5ff700 1 -- 172.21.15.84:0/1481032208 shutdown_connections 2023-07-14T11:19:30.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.253+0000 7f891a5ff700 1 --2- 172.21.15.84:0/1481032208 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8914160030 0x7f89140c7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:30.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.253+0000 7f891a5ff700 1 --2- 172.21.15.84:0/1481032208 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89140b5cd0 0x7f891415bdd0 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:30.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.253+0000 7f891a5ff700 1 --2- 172.21.15.84:0/1481032208 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f890006ae00 0x7f890006d2b0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:30.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.253+0000 7f891a5ff700 1 --2- 172.21.15.84:0/1481032208 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89140d1160 0x7f89141e5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:30.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.253+0000 7f891a5ff700 1 -- 172.21.15.84:0/1481032208 >> 172.21.15.84:0/1481032208 conn(0x7f891409c190 msgr2=0x7f89140b7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:30.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.253+0000 7f891a5ff700 1 -- 172.21.15.84:0/1481032208 shutdown_connections 2023-07-14T11:19:30.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.253+0000 7f891a5ff700 1 -- 172.21.15.84:0/1481032208 wait complete. 2023-07-14T11:19:30.259 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-07-14T11:19:30.273 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2023-07-14T11:19:28.937804+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590480,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":194,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":143,"ondisk_log_size":143,"up":164,"acting":164,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":135,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231096,"kb_used_data":11384,"kb_used_omap":0,"kb_used_meta":219648,"kb_avail":754743624,"statfs":{"total":773094113280,"available":772857470976,"internally_reserved":0,"allocated":11657216,"data_stored":6013429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":224919552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":112,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.997240"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967358+0000","last_change":"2023-07-14T11:19:24.976160+0000","last_active":"2023-07-14T11:19:25.967358+0000","last_peered":"2023-07-14T11:19:25.967358+0000","last_clean":"2023-07-14T11:19:25.967358+0000","last_became_active":"2023-07-14T11:19:24.975861+0000","last_became_peered":"2023-07-14T11:19:24.975861+0000","last_unstale":"2023-07-14T11:19:25.967358+0000","last_undegraded":"2023-07-14T11:19:25.967358+0000","last_fullsized":"2023-07-14T11:19:25.967358+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:52:51.076969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:19:23.938624+0000","last_change":"2023-07-14T11:19:23.938624+0000","last_active":"2023-07-14T11:19:23.938624+0000","last_peered":"2023-07-14T11:19:23.938624+0000","last_clean":"2023-07-14T11:19:23.938624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:23.938624+0000","last_undegraded":"2023-07-14T11:19:23.938624+0000","last_fullsized":"2023-07-14T11:19:23.938624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:19:23.938624+0000","last_change":"2023-07-14T11:19:23.938624+0000","last_active":"2023-07-14T11:19:23.938624+0000","last_peered":"2023-07-14T11:19:23.938624+0000","last_clean":"2023-07-14T11:19:23.938624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:23.938624+0000","last_undegraded":"2023-07-14T11:19:23.938624+0000","last_fullsized":"2023-07-14T11:19:23.938624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:19:23.938624+0000","last_change":"2023-07-14T11:19:23.938624+0000","last_active":"2023-07-14T11:19:23.938624+0000","last_peered":"2023-07-14T11:19:23.938624+0000","last_clean":"2023-07-14T11:19:23.938624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:23.938624+0000","last_undegraded":"2023-07-14T11:19:23.938624+0000","last_fullsized":"2023-07-14T11:19:23.938624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967158+0000","last_change":"2023-07-14T11:19:24.975419+0000","last_active":"2023-07-14T11:19:25.967158+0000","last_peered":"2023-07-14T11:19:25.967158+0000","last_clean":"2023-07-14T11:19:25.967158+0000","last_became_active":"2023-07-14T11:19:24.975150+0000","last_became_peered":"2023-07-14T11:19:24.975150+0000","last_unstale":"2023-07-14T11:19:25.967158+0000","last_undegraded":"2023-07-14T11:19:25.967158+0000","last_fullsized":"2023-07-14T11:19:25.967158+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:06:39.320547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400149+0000","last_change":"2023-07-14T11:19:24.980389+0000","last_active":"2023-07-14T11:19:27.400149+0000","last_peered":"2023-07-14T11:19:27.400149+0000","last_clean":"2023-07-14T11:19:27.400149+0000","last_became_active":"2023-07-14T11:19:24.980134+0000","last_became_peered":"2023-07-14T11:19:24.980134+0000","last_unstale":"2023-07-14T11:19:27.400149+0000","last_undegraded":"2023-07-14T11:19:27.400149+0000","last_fullsized":"2023-07-14T11:19:27.400149+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:53:15.231674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400689+0000","last_change":"2023-07-14T11:19:24.980001+0000","last_active":"2023-07-14T11:19:27.400689+0000","last_peered":"2023-07-14T11:19:27.400689+0000","last_clean":"2023-07-14T11:19:27.400689+0000","last_became_active":"2023-07-14T11:19:24.979653+0000","last_became_peered":"2023-07-14T11:19:24.979653+0000","last_unstale":"2023-07-14T11:19:27.400689+0000","last_undegraded":"2023-07-14T11:19:27.400689+0000","last_fullsized":"2023-07-14T11:19:27.400689+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:14:55.889716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:19:23.938624+0000","last_change":"2023-07-14T11:19:23.938624+0000","last_active":"2023-07-14T11:19:23.938624+0000","last_peered":"2023-07-14T11:19:23.938624+0000","last_clean":"2023-07-14T11:19:23.938624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:23.938624+0000","last_undegraded":"2023-07-14T11:19:23.938624+0000","last_fullsized":"2023-07-14T11:19:23.938624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:19:23.938624+0000","last_change":"2023-07-14T11:19:23.938624+0000","last_active":"2023-07-14T11:19:23.938624+0000","last_peered":"2023-07-14T11:19:23.938624+0000","last_clean":"2023-07-14T11:19:23.938624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:23.938624+0000","last_undegraded":"2023-07-14T11:19:23.938624+0000","last_fullsized":"2023-07-14T11:19:23.938624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.964603+0000","last_change":"2023-07-14T11:19:24.986113+0000","last_active":"2023-07-14T11:19:25.964603+0000","last_peered":"2023-07-14T11:19:25.964603+0000","last_clean":"2023-07-14T11:19:25.964603+0000","last_became_active":"2023-07-14T11:19:24.985802+0000","last_became_peered":"2023-07-14T11:19:24.985802+0000","last_unstale":"2023-07-14T11:19:25.964603+0000","last_undegraded":"2023-07-14T11:19:25.964603+0000","last_fullsized":"2023-07-14T11:19:25.964603+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:48:20.004928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.966858+0000","last_change":"2023-07-14T11:19:24.981712+0000","last_active":"2023-07-14T11:19:25.966858+0000","last_peered":"2023-07-14T11:19:25.966858+0000","last_clean":"2023-07-14T11:19:25.966858+0000","last_became_active":"2023-07-14T11:19:24.981417+0000","last_became_peered":"2023-07-14T11:19:24.981417+0000","last_unstale":"2023-07-14T11:19:25.966858+0000","last_undegraded":"2023-07-14T11:19:25.966858+0000","last_fullsized":"2023-07-14T11:19:25.966858+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:52:06.185710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.401119+0000","last_change":"2023-07-14T11:19:24.981753+0000","last_active":"2023-07-14T11:19:27.401119+0000","last_peered":"2023-07-14T11:19:27.401119+0000","last_clean":"2023-07-14T11:19:27.401119+0000","last_became_active":"2023-07-14T11:19:24.980821+0000","last_became_peered":"2023-07-14T11:19:24.980821+0000","last_unstale":"2023-07-14T11:19:27.401119+0000","last_undegraded":"2023-07-14T11:19:27.401119+0000","last_fullsized":"2023-07-14T11:19:27.401119+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:17:28.127989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.964356+0000","last_change":"2023-07-14T11:19:24.969706+0000","last_active":"2023-07-14T11:19:25.964356+0000","last_peered":"2023-07-14T11:19:25.964356+0000","last_clean":"2023-07-14T11:19:25.964356+0000","last_became_active":"2023-07-14T11:19:24.969426+0000","last_became_peered":"2023-07-14T11:19:24.969426+0000","last_unstale":"2023-07-14T11:19:25.964356+0000","last_undegraded":"2023-07-14T11:19:25.964356+0000","last_fullsized":"2023-07-14T11:19:25.964356+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:45:06.308741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:19:23.938624+0000","last_change":"2023-07-14T11:19:23.938624+0000","last_active":"2023-07-14T11:19:23.938624+0000","last_peered":"2023-07-14T11:19:23.938624+0000","last_clean":"2023-07-14T11:19:23.938624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:23.938624+0000","last_undegraded":"2023-07-14T11:19:23.938624+0000","last_fullsized":"2023-07-14T11:19:23.938624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967511+0000","last_change":"2023-07-14T11:19:24.981766+0000","last_active":"2023-07-14T11:19:25.967511+0000","last_peered":"2023-07-14T11:19:25.967511+0000","last_clean":"2023-07-14T11:19:25.967511+0000","last_became_active":"2023-07-14T11:19:24.981081+0000","last_became_peered":"2023-07-14T11:19:24.981081+0000","last_unstale":"2023-07-14T11:19:25.967511+0000","last_undegraded":"2023-07-14T11:19:25.967511+0000","last_fullsized":"2023-07-14T11:19:25.967511+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:53:41.464458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400197+0000","last_change":"2023-07-14T11:19:24.980504+0000","last_active":"2023-07-14T11:19:27.400197+0000","last_peered":"2023-07-14T11:19:27.400197+0000","last_clean":"2023-07-14T11:19:27.400197+0000","last_became_active":"2023-07-14T11:19:24.980260+0000","last_became_peered":"2023-07-14T11:19:24.980260+0000","last_unstale":"2023-07-14T11:19:27.400197+0000","last_undegraded":"2023-07-14T11:19:27.400197+0000","last_fullsized":"2023-07-14T11:19:27.400197+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:14:30.331432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.964757+0000","last_change":"2023-07-14T11:19:24.974486+0000","last_active":"2023-07-14T11:19:25.964757+0000","last_peered":"2023-07-14T11:19:25.964757+0000","last_clean":"2023-07-14T11:19:25.964757+0000","last_became_active":"2023-07-14T11:19:24.974200+0000","last_became_peered":"2023-07-14T11:19:24.974200+0000","last_unstale":"2023-07-14T11:19:25.964757+0000","last_undegraded":"2023-07-14T11:19:25.964757+0000","last_fullsized":"2023-07-14T11:19:25.964757+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:24:28.100458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:19:23.938624+0000","last_change":"2023-07-14T11:19:23.938624+0000","last_active":"2023-07-14T11:19:23.938624+0000","last_peered":"2023-07-14T11:19:23.938624+0000","last_clean":"2023-07-14T11:19:23.938624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:23.938624+0000","last_undegraded":"2023-07-14T11:19:23.938624+0000","last_fullsized":"2023-07-14T11:19:23.938624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:19:23.938624+0000","last_change":"2023-07-14T11:19:23.938624+0000","last_active":"2023-07-14T11:19:23.938624+0000","last_peered":"2023-07-14T11:19:23.938624+0000","last_clean":"2023-07-14T11:19:23.938624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:23.938624+0000","last_undegraded":"2023-07-14T11:19:23.938624+0000","last_fullsized":"2023-07-14T11:19:23.938624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400466+0000","last_change":"2023-07-14T11:19:24.990479+0000","last_active":"2023-07-14T11:19:27.400466+0000","last_peered":"2023-07-14T11:19:27.400466+0000","last_clean":"2023-07-14T11:19:27.400466+0000","last_became_active":"2023-07-14T11:19:24.990017+0000","last_became_peered":"2023-07-14T11:19:24.990017+0000","last_unstale":"2023-07-14T11:19:27.400466+0000","last_undegraded":"2023-07-14T11:19:27.400466+0000","last_fullsized":"2023-07-14T11:19:27.400466+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:06:38.269911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:19:23.938624+0000","last_change":"2023-07-14T11:19:23.938624+0000","last_active":"2023-07-14T11:19:23.938624+0000","last_peered":"2023-07-14T11:19:23.938624+0000","last_clean":"2023-07-14T11:19:23.938624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:23.938624+0000","last_undegraded":"2023-07-14T11:19:23.938624+0000","last_fullsized":"2023-07-14T11:19:23.938624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967103+0000","last_change":"2023-07-14T11:19:24.983855+0000","last_active":"2023-07-14T11:19:25.967103+0000","last_peered":"2023-07-14T11:19:25.967103+0000","last_clean":"2023-07-14T11:19:25.967103+0000","last_became_active":"2023-07-14T11:19:24.983432+0000","last_became_peered":"2023-07-14T11:19:24.983432+0000","last_unstale":"2023-07-14T11:19:25.967103+0000","last_undegraded":"2023-07-14T11:19:25.967103+0000","last_fullsized":"2023-07-14T11:19:25.967103+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:10:43.341934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:19:23.938624+0000","last_change":"2023-07-14T11:19:23.938624+0000","last_active":"2023-07-14T11:19:23.938624+0000","last_peered":"2023-07-14T11:19:23.938624+0000","last_clean":"2023-07-14T11:19:23.938624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:23.938624+0000","last_undegraded":"2023-07-14T11:19:23.938624+0000","last_fullsized":"2023-07-14T11:19:23.938624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967396+0000","last_change":"2023-07-14T11:19:24.975332+0000","last_active":"2023-07-14T11:19:25.967396+0000","last_peered":"2023-07-14T11:19:25.967396+0000","last_clean":"2023-07-14T11:19:25.967396+0000","last_became_active":"2023-07-14T11:19:24.974888+0000","last_became_peered":"2023-07-14T11:19:24.974888+0000","last_unstale":"2023-07-14T11:19:25.967396+0000","last_undegraded":"2023-07-14T11:19:25.967396+0000","last_fullsized":"2023-07-14T11:19:25.967396+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:27:43.025658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.968145+0000","last_change":"2023-07-14T11:19:24.986904+0000","last_active":"2023-07-14T11:19:25.968145+0000","last_peered":"2023-07-14T11:19:25.968145+0000","last_clean":"2023-07-14T11:19:25.968145+0000","last_became_active":"2023-07-14T11:19:24.986246+0000","last_became_peered":"2023-07-14T11:19:24.986246+0000","last_unstale":"2023-07-14T11:19:25.968145+0000","last_undegraded":"2023-07-14T11:19:25.968145+0000","last_fullsized":"2023-07-14T11:19:25.968145+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:36:57.980619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400824+0000","last_change":"2023-07-14T11:19:24.980011+0000","last_active":"2023-07-14T11:19:27.400824+0000","last_peered":"2023-07-14T11:19:27.400824+0000","last_clean":"2023-07-14T11:19:27.400824+0000","last_became_active":"2023-07-14T11:19:24.979707+0000","last_became_peered":"2023-07-14T11:19:24.979707+0000","last_unstale":"2023-07-14T11:19:27.400824+0000","last_undegraded":"2023-07-14T11:19:27.400824+0000","last_fullsized":"2023-07-14T11:19:27.400824+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:20:25.338974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:19:23.938624+0000","last_change":"2023-07-14T11:19:23.938624+0000","last_active":"2023-07-14T11:19:23.938624+0000","last_peered":"2023-07-14T11:19:23.938624+0000","last_clean":"2023-07-14T11:19:23.938624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:23.938624+0000","last_undegraded":"2023-07-14T11:19:23.938624+0000","last_fullsized":"2023-07-14T11:19:23.938624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400991+0000","last_change":"2023-07-14T11:19:24.982086+0000","last_active":"2023-07-14T11:19:27.400991+0000","last_peered":"2023-07-14T11:19:27.400991+0000","last_clean":"2023-07-14T11:19:27.400991+0000","last_became_active":"2023-07-14T11:19:24.981377+0000","last_became_peered":"2023-07-14T11:19:24.981377+0000","last_unstale":"2023-07-14T11:19:27.400991+0000","last_undegraded":"2023-07-14T11:19:27.400991+0000","last_fullsized":"2023-07-14T11:19:27.400991+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:19:51.206070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.399944+0000","last_change":"2023-07-14T11:19:24.984485+0000","last_active":"2023-07-14T11:19:27.399944+0000","last_peered":"2023-07-14T11:19:27.399944+0000","last_clean":"2023-07-14T11:19:27.399944+0000","last_became_active":"2023-07-14T11:19:24.984144+0000","last_became_peered":"2023-07-14T11:19:24.984144+0000","last_unstale":"2023-07-14T11:19:27.399944+0000","last_undegraded":"2023-07-14T11:19:27.399944+0000","last_fullsized":"2023-07-14T11:19:27.399944+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:41:49.903922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:19:23.938624+0000","last_change":"2023-07-14T11:19:23.938624+0000","last_active":"2023-07-14T11:19:23.938624+0000","last_peered":"2023-07-14T11:19:23.938624+0000","last_clean":"2023-07-14T11:19:23.938624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:23.938624+0000","last_undegraded":"2023-07-14T11:19:23.938624+0000","last_fullsized":"2023-07-14T11:19:23.938624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967193+0000","last_change":"2023-07-14T11:19:24.981395+0000","last_active":"2023-07-14T11:19:25.967193+0000","last_peered":"2023-07-14T11:19:25.967193+0000","last_clean":"2023-07-14T11:19:25.967193+0000","last_became_active":"2023-07-14T11:19:24.980523+0000","last_became_peered":"2023-07-14T11:19:24.980523+0000","last_unstale":"2023-07-14T11:19:25.967193+0000","last_undegraded":"2023-07-14T11:19:25.967193+0000","last_fullsized":"2023-07-14T11:19:25.967193+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:04:50.668701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.966856+0000","last_change":"2023-07-14T11:19:24.975124+0000","last_active":"2023-07-14T11:19:25.966856+0000","last_peered":"2023-07-14T11:19:25.966856+0000","last_clean":"2023-07-14T11:19:25.966856+0000","last_became_active":"2023-07-14T11:19:24.974559+0000","last_became_peered":"2023-07-14T11:19:24.974559+0000","last_unstale":"2023-07-14T11:19:25.966856+0000","last_undegraded":"2023-07-14T11:19:25.966856+0000","last_fullsized":"2023-07-14T11:19:25.966856+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:05:30.379389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.964378+0000","last_change":"2023-07-14T11:19:24.985367+0000","last_active":"2023-07-14T11:19:25.964378+0000","last_peered":"2023-07-14T11:19:25.964378+0000","last_clean":"2023-07-14T11:19:25.964378+0000","last_became_active":"2023-07-14T11:19:24.984934+0000","last_became_peered":"2023-07-14T11:19:24.984934+0000","last_unstale":"2023-07-14T11:19:25.964378+0000","last_undegraded":"2023-07-14T11:19:25.964378+0000","last_fullsized":"2023-07-14T11:19:25.964378+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:30:06.079180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-07-14T11:19:22.947281+0000","last_change":"2023-07-14T11:19:22.947281+0000","last_active":"2023-07-14T11:19:22.930757+0000","last_peered":"2023-07-14T11:19:22.930757+0000","last_clean":"2023-07-14T11:19:22.930757+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:22.947281+0000","last_undegraded":"2023-07-14T11:19:22.947281+0000","last_fullsized":"2023-07-14T11:19:22.947281+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400906+0000","last_change":"2023-07-14T11:19:24.985452+0000","last_active":"2023-07-14T11:19:27.400906+0000","last_peered":"2023-07-14T11:19:27.400906+0000","last_clean":"2023-07-14T11:19:27.400906+0000","last_became_active":"2023-07-14T11:19:24.983795+0000","last_became_peered":"2023-07-14T11:19:24.983795+0000","last_unstale":"2023-07-14T11:19:27.400906+0000","last_undegraded":"2023-07-14T11:19:27.400906+0000","last_fullsized":"2023-07-14T11:19:27.400906+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:42:39.569277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"105'1","reported_seq":14,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.964705+0000","last_change":"2023-07-14T11:19:23.957148+0000","last_active":"2023-07-14T11:19:25.964705+0000","last_peered":"2023-07-14T11:19:25.964705+0000","last_clean":"2023-07-14T11:19:25.964705+0000","last_became_active":"2023-07-14T11:19:23.956826+0000","last_became_peered":"2023-07-14T11:19:23.956826+0000","last_unstale":"2023-07-14T11:19:25.964705+0000","last_undegraded":"2023-07-14T11:19:25.964705+0000","last_fullsized":"2023-07-14T11:19:25.964705+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:40:31.643180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967855+0000","last_change":"2023-07-14T11:19:24.981190+0000","last_active":"2023-07-14T11:19:25.967855+0000","last_peered":"2023-07-14T11:19:25.967855+0000","last_clean":"2023-07-14T11:19:25.967855+0000","last_became_active":"2023-07-14T11:19:24.980911+0000","last_became_peered":"2023-07-14T11:19:24.980911+0000","last_unstale":"2023-07-14T11:19:25.967855+0000","last_undegraded":"2023-07-14T11:19:25.967855+0000","last_fullsized":"2023-07-14T11:19:25.967855+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:45:06.083751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-07-14T11:19:22.948199+0000","last_change":"2023-07-14T11:19:22.948199+0000","last_active":"2023-07-14T11:19:22.930757+0000","last_peered":"2023-07-14T11:19:22.930757+0000","last_clean":"2023-07-14T11:19:22.930757+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:22.948199+0000","last_undegraded":"2023-07-14T11:19:22.948199+0000","last_fullsized":"2023-07-14T11:19:22.948199+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:19:23.938624+0000","last_change":"2023-07-14T11:19:23.938624+0000","last_active":"2023-07-14T11:19:23.938624+0000","last_peered":"2023-07-14T11:19:23.938624+0000","last_clean":"2023-07-14T11:19:23.938624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:23.938624+0000","last_undegraded":"2023-07-14T11:19:23.938624+0000","last_fullsized":"2023-07-14T11:19:23.938624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1c","version":"105'2","reported_seq":15,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.964353+0000","last_change":"2023-07-14T11:19:23.963900+0000","last_active":"2023-07-14T11:19:25.964353+0000","last_peered":"2023-07-14T11:19:25.964353+0000","last_clean":"2023-07-14T11:19:25.964353+0000","last_became_active":"2023-07-14T11:19:23.963623+0000","last_became_peered":"2023-07-14T11:19:23.963623+0000","last_unstale":"2023-07-14T11:19:25.964353+0000","last_undegraded":"2023-07-14T11:19:25.964353+0000","last_fullsized":"2023-07-14T11:19:25.964353+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:25:03.366408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.964152+0000","last_change":"2023-07-14T11:19:24.971636+0000","last_active":"2023-07-14T11:19:25.964152+0000","last_peered":"2023-07-14T11:19:25.964152+0000","last_clean":"2023-07-14T11:19:25.964152+0000","last_became_active":"2023-07-14T11:19:24.971328+0000","last_became_peered":"2023-07-14T11:19:24.971328+0000","last_unstale":"2023-07-14T11:19:25.964152+0000","last_undegraded":"2023-07-14T11:19:25.964152+0000","last_fullsized":"2023-07-14T11:19:25.964152+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:48:38.451247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"105'1","reported_seq":14,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967274+0000","last_change":"2023-07-14T11:19:23.962575+0000","last_active":"2023-07-14T11:19:25.967274+0000","last_peered":"2023-07-14T11:19:25.967274+0000","last_clean":"2023-07-14T11:19:25.967274+0000","last_became_active":"2023-07-14T11:19:23.962299+0000","last_became_peered":"2023-07-14T11:19:23.962299+0000","last_unstale":"2023-07-14T11:19:25.967274+0000","last_undegraded":"2023-07-14T11:19:25.967274+0000","last_fullsized":"2023-07-14T11:19:25.967274+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:56:49.505955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.966859+0000","last_change":"2023-07-14T11:19:24.981916+0000","last_active":"2023-07-14T11:19:25.966859+0000","last_peered":"2023-07-14T11:19:25.966859+0000","last_clean":"2023-07-14T11:19:25.966859+0000","last_became_active":"2023-07-14T11:19:24.981458+0000","last_became_peered":"2023-07-14T11:19:24.981458+0000","last_unstale":"2023-07-14T11:19:25.966859+0000","last_undegraded":"2023-07-14T11:19:25.966859+0000","last_fullsized":"2023-07-14T11:19:25.966859+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:33:58.183494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"105'1","reported_seq":14,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400247+0000","last_change":"2023-07-14T11:19:23.965613+0000","last_active":"2023-07-14T11:19:27.400247+0000","last_peered":"2023-07-14T11:19:27.400247+0000","last_clean":"2023-07-14T11:19:27.400247+0000","last_became_active":"2023-07-14T11:19:23.965357+0000","last_became_peered":"2023-07-14T11:19:23.965357+0000","last_unstale":"2023-07-14T11:19:27.400247+0000","last_undegraded":"2023-07-14T11:19:27.400247+0000","last_fullsized":"2023-07-14T11:19:27.400247+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:45:25.952053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:19:23.938624+0000","last_change":"2023-07-14T11:19:23.938624+0000","last_active":"2023-07-14T11:19:23.938624+0000","last_peered":"2023-07-14T11:19:23.938624+0000","last_clean":"2023-07-14T11:19:23.938624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:23.938624+0000","last_undegraded":"2023-07-14T11:19:23.938624+0000","last_fullsized":"2023-07-14T11:19:23.938624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967284+0000","last_change":"2023-07-14T11:19:23.963545+0000","last_active":"2023-07-14T11:19:25.967284+0000","last_peered":"2023-07-14T11:19:25.967284+0000","last_clean":"2023-07-14T11:19:25.967284+0000","last_became_active":"2023-07-14T11:19:23.963258+0000","last_became_peered":"2023-07-14T11:19:23.963258+0000","last_unstale":"2023-07-14T11:19:25.967284+0000","last_undegraded":"2023-07-14T11:19:25.967284+0000","last_fullsized":"2023-07-14T11:19:25.967284+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:52:08.897066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.964495+0000","last_change":"2023-07-14T11:19:24.963229+0000","last_active":"2023-07-14T11:19:25.964495+0000","last_peered":"2023-07-14T11:19:25.964495+0000","last_clean":"2023-07-14T11:19:25.964495+0000","last_became_active":"2023-07-14T11:19:24.962953+0000","last_became_peered":"2023-07-14T11:19:24.962953+0000","last_unstale":"2023-07-14T11:19:25.964495+0000","last_undegraded":"2023-07-14T11:19:25.964495+0000","last_fullsized":"2023-07-14T11:19:25.964495+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:01:44.444334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400404+0000","last_change":"2023-07-14T11:19:23.967430+0000","last_active":"2023-07-14T11:19:27.400404+0000","last_peered":"2023-07-14T11:19:27.400404+0000","last_clean":"2023-07-14T11:19:27.400404+0000","last_became_active":"2023-07-14T11:19:23.967136+0000","last_became_peered":"2023-07-14T11:19:23.967136+0000","last_unstale":"2023-07-14T11:19:27.400404+0000","last_undegraded":"2023-07-14T11:19:27.400404+0000","last_fullsized":"2023-07-14T11:19:27.400404+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:52:17.347729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967669+0000","last_change":"2023-07-14T11:19:24.984882+0000","last_active":"2023-07-14T11:19:25.967669+0000","last_peered":"2023-07-14T11:19:25.967669+0000","last_clean":"2023-07-14T11:19:25.967669+0000","last_became_active":"2023-07-14T11:19:24.984584+0000","last_became_peered":"2023-07-14T11:19:24.984584+0000","last_unstale":"2023-07-14T11:19:25.967669+0000","last_undegraded":"2023-07-14T11:19:25.967669+0000","last_fullsized":"2023-07-14T11:19:25.967669+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:15:45.414169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"105'1","reported_seq":14,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.964627+0000","last_change":"2023-07-14T11:19:23.966279+0000","last_active":"2023-07-14T11:19:25.964627+0000","last_peered":"2023-07-14T11:19:25.964627+0000","last_clean":"2023-07-14T11:19:25.964627+0000","last_became_active":"2023-07-14T11:19:23.965983+0000","last_became_peered":"2023-07-14T11:19:23.965983+0000","last_unstale":"2023-07-14T11:19:25.964627+0000","last_undegraded":"2023-07-14T11:19:25.964627+0000","last_fullsized":"2023-07-14T11:19:25.964627+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:37:11.528205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967019+0000","last_change":"2023-07-14T11:19:24.976404+0000","last_active":"2023-07-14T11:19:25.967019+0000","last_peered":"2023-07-14T11:19:25.967019+0000","last_clean":"2023-07-14T11:19:25.967019+0000","last_became_active":"2023-07-14T11:19:24.975878+0000","last_became_peered":"2023-07-14T11:19:24.975878+0000","last_unstale":"2023-07-14T11:19:25.967019+0000","last_undegraded":"2023-07-14T11:19:25.967019+0000","last_fullsized":"2023-07-14T11:19:25.967019+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:35:40.868054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"105'2","reported_seq":15,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400912+0000","last_change":"2023-07-14T11:19:23.970931+0000","last_active":"2023-07-14T11:19:27.400912+0000","last_peered":"2023-07-14T11:19:27.400912+0000","last_clean":"2023-07-14T11:19:27.400912+0000","last_became_active":"2023-07-14T11:19:23.970611+0000","last_became_peered":"2023-07-14T11:19:23.970611+0000","last_unstale":"2023-07-14T11:19:27.400912+0000","last_undegraded":"2023-07-14T11:19:27.400912+0000","last_fullsized":"2023-07-14T11:19:27.400912+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:00:57.799054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.401192+0000","last_change":"2023-07-14T11:19:24.983441+0000","last_active":"2023-07-14T11:19:27.401192+0000","last_peered":"2023-07-14T11:19:27.401192+0000","last_clean":"2023-07-14T11:19:27.401192+0000","last_became_active":"2023-07-14T11:19:24.983143+0000","last_became_peered":"2023-07-14T11:19:24.983143+0000","last_unstale":"2023-07-14T11:19:27.401192+0000","last_undegraded":"2023-07-14T11:19:27.401192+0000","last_fullsized":"2023-07-14T11:19:27.401192+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:43:03.332951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-07-14T11:19:22.947732+0000","last_change":"2023-07-14T11:19:22.947732+0000","last_active":"2023-07-14T11:19:22.930757+0000","last_peered":"2023-07-14T11:19:22.930757+0000","last_clean":"2023-07-14T11:19:22.930757+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:22.947732+0000","last_undegraded":"2023-07-14T11:19:22.947732+0000","last_fullsized":"2023-07-14T11:19:22.947732+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.968229+0000","last_change":"2023-07-14T11:19:24.981805+0000","last_active":"2023-07-14T11:19:25.968229+0000","last_peered":"2023-07-14T11:19:25.968229+0000","last_clean":"2023-07-14T11:19:25.968229+0000","last_became_active":"2023-07-14T11:19:24.981478+0000","last_became_peered":"2023-07-14T11:19:24.981478+0000","last_unstale":"2023-07-14T11:19:25.968229+0000","last_undegraded":"2023-07-14T11:19:25.968229+0000","last_fullsized":"2023-07-14T11:19:25.968229+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:52:18.355596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-07-14T11:19:22.948728+0000","last_change":"2023-07-14T11:19:22.948728+0000","last_active":"2023-07-14T11:19:22.930757+0000","last_peered":"2023-07-14T11:19:22.930757+0000","last_clean":"2023-07-14T11:19:22.930757+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:22.948728+0000","last_undegraded":"2023-07-14T11:19:22.948728+0000","last_fullsized":"2023-07-14T11:19:22.948728+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400328+0000","last_change":"2023-07-14T11:19:24.982953+0000","last_active":"2023-07-14T11:19:27.400328+0000","last_peered":"2023-07-14T11:19:27.400328+0000","last_clean":"2023-07-14T11:19:27.400328+0000","last_became_active":"2023-07-14T11:19:24.982715+0000","last_became_peered":"2023-07-14T11:19:24.982715+0000","last_unstale":"2023-07-14T11:19:27.400328+0000","last_undegraded":"2023-07-14T11:19:27.400328+0000","last_fullsized":"2023-07-14T11:19:27.400328+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:36:57.980619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"105'2","reported_seq":15,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.399715+0000","last_change":"2023-07-14T11:19:23.969963+0000","last_active":"2023-07-14T11:19:27.399715+0000","last_peered":"2023-07-14T11:19:27.399715+0000","last_clean":"2023-07-14T11:19:27.399715+0000","last_became_active":"2023-07-14T11:19:23.969677+0000","last_became_peered":"2023-07-14T11:19:23.969677+0000","last_unstale":"2023-07-14T11:19:27.399715+0000","last_undegraded":"2023-07-14T11:19:27.399715+0000","last_fullsized":"2023-07-14T11:19:27.399715+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:45:05.075884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:19:23.938624+0000","last_change":"2023-07-14T11:19:23.938624+0000","last_active":"2023-07-14T11:19:23.938624+0000","last_peered":"2023-07-14T11:19:23.938624+0000","last_clean":"2023-07-14T11:19:23.938624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:23.938624+0000","last_undegraded":"2023-07-14T11:19:23.938624+0000","last_fullsized":"2023-07-14T11:19:23.938624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-07-14T11:19:22.947660+0000","last_change":"2023-07-14T11:19:22.947660+0000","last_active":"2023-07-14T11:19:22.930757+0000","last_peered":"2023-07-14T11:19:22.930757+0000","last_clean":"2023-07-14T11:19:22.930757+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:22.947660+0000","last_undegraded":"2023-07-14T11:19:22.947660+0000","last_fullsized":"2023-07-14T11:19:22.947660+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:19:23.938624+0000","last_change":"2023-07-14T11:19:23.938624+0000","last_active":"2023-07-14T11:19:23.938624+0000","last_peered":"2023-07-14T11:19:23.938624+0000","last_clean":"2023-07-14T11:19:23.938624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:23.938624+0000","last_undegraded":"2023-07-14T11:19:23.938624+0000","last_fullsized":"2023-07-14T11:19:23.938624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-07-14T11:19:22.945911+0000","last_change":"2023-07-14T11:19:22.945911+0000","last_active":"2023-07-14T11:19:22.930757+0000","last_peered":"2023-07-14T11:19:22.930757+0000","last_clean":"2023-07-14T11:19:22.930757+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:22.945911+0000","last_undegraded":"2023-07-14T11:19:22.945911+0000","last_fullsized":"2023-07-14T11:19:22.945911+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967601+0000","last_change":"2023-07-14T11:19:24.978534+0000","last_active":"2023-07-14T11:19:25.967601+0000","last_peered":"2023-07-14T11:19:25.967601+0000","last_clean":"2023-07-14T11:19:25.967601+0000","last_became_active":"2023-07-14T11:19:24.978198+0000","last_became_peered":"2023-07-14T11:19:24.978198+0000","last_unstale":"2023-07-14T11:19:25.967601+0000","last_undegraded":"2023-07-14T11:19:25.967601+0000","last_fullsized":"2023-07-14T11:19:25.967601+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:28:09.892883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-07-14T11:19:22.949000+0000","last_change":"2023-07-14T11:19:22.949000+0000","last_active":"2023-07-14T11:19:22.930757+0000","last_peered":"2023-07-14T11:19:22.930757+0000","last_clean":"2023-07-14T11:19:22.930757+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:22.949000+0000","last_undegraded":"2023-07-14T11:19:22.949000+0000","last_fullsized":"2023-07-14T11:19:22.949000+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.401189+0000","last_change":"2023-07-14T11:19:24.981929+0000","last_active":"2023-07-14T11:19:27.401189+0000","last_peered":"2023-07-14T11:19:27.401189+0000","last_clean":"2023-07-14T11:19:27.401189+0000","last_became_active":"2023-07-14T11:19:24.981116+0000","last_became_peered":"2023-07-14T11:19:24.981116+0000","last_unstale":"2023-07-14T11:19:27.401189+0000","last_undegraded":"2023-07-14T11:19:27.401189+0000","last_fullsized":"2023-07-14T11:19:27.401189+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:11:36.584744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"105'2","reported_seq":15,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400000+0000","last_change":"2023-07-14T11:19:23.964927+0000","last_active":"2023-07-14T11:19:27.400000+0000","last_peered":"2023-07-14T11:19:27.400000+0000","last_clean":"2023-07-14T11:19:27.400000+0000","last_became_active":"2023-07-14T11:19:23.964561+0000","last_became_peered":"2023-07-14T11:19:23.964561+0000","last_unstale":"2023-07-14T11:19:27.400000+0000","last_undegraded":"2023-07-14T11:19:27.400000+0000","last_fullsized":"2023-07-14T11:19:27.400000+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:56:43.945140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.964338+0000","last_change":"2023-07-14T11:19:24.971692+0000","last_active":"2023-07-14T11:19:25.964338+0000","last_peered":"2023-07-14T11:19:25.964338+0000","last_clean":"2023-07-14T11:19:25.964338+0000","last_became_active":"2023-07-14T11:19:24.971436+0000","last_became_peered":"2023-07-14T11:19:24.971436+0000","last_unstale":"2023-07-14T11:19:25.964338+0000","last_undegraded":"2023-07-14T11:19:25.964338+0000","last_fullsized":"2023-07-14T11:19:25.964338+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:57:11.662188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-07-14T11:19:22.946542+0000","last_change":"2023-07-14T11:19:22.946542+0000","last_active":"2023-07-14T11:19:22.930757+0000","last_peered":"2023-07-14T11:19:22.930757+0000","last_clean":"2023-07-14T11:19:22.930757+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:22.946542+0000","last_undegraded":"2023-07-14T11:19:22.946542+0000","last_fullsized":"2023-07-14T11:19:22.946542+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:19:23.938624+0000","last_change":"2023-07-14T11:19:23.938624+0000","last_active":"2023-07-14T11:19:23.938624+0000","last_peered":"2023-07-14T11:19:23.938624+0000","last_clean":"2023-07-14T11:19:23.938624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:23.938624+0000","last_undegraded":"2023-07-14T11:19:23.938624+0000","last_fullsized":"2023-07-14T11:19:23.938624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-07-14T11:19:22.946466+0000","last_change":"2023-07-14T11:19:22.946466+0000","last_active":"2023-07-14T11:19:22.930757+0000","last_peered":"2023-07-14T11:19:22.930757+0000","last_clean":"2023-07-14T11:19:22.930757+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:22.946466+0000","last_undegraded":"2023-07-14T11:19:22.946466+0000","last_fullsized":"2023-07-14T11:19:22.946466+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400005+0000","last_change":"2023-07-14T11:19:24.982564+0000","last_active":"2023-07-14T11:19:27.400005+0000","last_peered":"2023-07-14T11:19:27.400005+0000","last_clean":"2023-07-14T11:19:27.400005+0000","last_became_active":"2023-07-14T11:19:24.982238+0000","last_became_peered":"2023-07-14T11:19:24.982238+0000","last_unstale":"2023-07-14T11:19:27.400005+0000","last_undegraded":"2023-07-14T11:19:27.400005+0000","last_fullsized":"2023-07-14T11:19:27.400005+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:48:10.260203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.401208+0000","last_change":"2023-07-14T11:19:23.967504+0000","last_active":"2023-07-14T11:19:27.401208+0000","last_peered":"2023-07-14T11:19:27.401208+0000","last_clean":"2023-07-14T11:19:27.401208+0000","last_became_active":"2023-07-14T11:19:23.967103+0000","last_became_peered":"2023-07-14T11:19:23.967103+0000","last_unstale":"2023-07-14T11:19:27.401208+0000","last_undegraded":"2023-07-14T11:19:27.401208+0000","last_fullsized":"2023-07-14T11:19:27.401208+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:06:38.495123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400575+0000","last_change":"2023-07-14T11:19:24.980008+0000","last_active":"2023-07-14T11:19:27.400575+0000","last_peered":"2023-07-14T11:19:27.400575+0000","last_clean":"2023-07-14T11:19:27.400575+0000","last_became_active":"2023-07-14T11:19:24.979729+0000","last_became_peered":"2023-07-14T11:19:24.979729+0000","last_unstale":"2023-07-14T11:19:27.400575+0000","last_undegraded":"2023-07-14T11:19:27.400575+0000","last_fullsized":"2023-07-14T11:19:27.400575+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:59:22.004159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967419+0000","last_change":"2023-07-14T11:19:23.966672+0000","last_active":"2023-07-14T11:19:25.967419+0000","last_peered":"2023-07-14T11:19:25.967419+0000","last_clean":"2023-07-14T11:19:25.967419+0000","last_became_active":"2023-07-14T11:19:23.966360+0000","last_became_peered":"2023-07-14T11:19:23.966360+0000","last_unstale":"2023-07-14T11:19:25.967419+0000","last_undegraded":"2023-07-14T11:19:25.967419+0000","last_fullsized":"2023-07-14T11:19:25.967419+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:18:10.519816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:19:23.938624+0000","last_change":"2023-07-14T11:19:23.938624+0000","last_active":"2023-07-14T11:19:23.938624+0000","last_peered":"2023-07-14T11:19:23.938624+0000","last_clean":"2023-07-14T11:19:23.938624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:23.938624+0000","last_undegraded":"2023-07-14T11:19:23.938624+0000","last_fullsized":"2023-07-14T11:19:23.938624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967195+0000","last_change":"2023-07-14T11:19:23.965288+0000","last_active":"2023-07-14T11:19:25.967195+0000","last_peered":"2023-07-14T11:19:25.967195+0000","last_clean":"2023-07-14T11:19:25.967195+0000","last_became_active":"2023-07-14T11:19:23.965026+0000","last_became_peered":"2023-07-14T11:19:23.965026+0000","last_unstale":"2023-07-14T11:19:25.967195+0000","last_undegraded":"2023-07-14T11:19:25.967195+0000","last_fullsized":"2023-07-14T11:19:25.967195+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:01:26.582106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:19:23.938624+0000","last_change":"2023-07-14T11:19:23.938624+0000","last_active":"2023-07-14T11:19:23.938624+0000","last_peered":"2023-07-14T11:19:23.938624+0000","last_clean":"2023-07-14T11:19:23.938624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:23.938624+0000","last_undegraded":"2023-07-14T11:19:23.938624+0000","last_fullsized":"2023-07-14T11:19:23.938624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400784+0000","last_change":"2023-07-14T11:19:23.967500+0000","last_active":"2023-07-14T11:19:27.400784+0000","last_peered":"2023-07-14T11:19:27.400784+0000","last_clean":"2023-07-14T11:19:27.400784+0000","last_became_active":"2023-07-14T11:19:23.967047+0000","last_became_peered":"2023-07-14T11:19:23.967047+0000","last_unstale":"2023-07-14T11:19:27.400784+0000","last_undegraded":"2023-07-14T11:19:27.400784+0000","last_fullsized":"2023-07-14T11:19:27.400784+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:28:25.198305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.964622+0000","last_change":"2023-07-14T11:19:24.975857+0000","last_active":"2023-07-14T11:19:25.964622+0000","last_peered":"2023-07-14T11:19:25.964622+0000","last_clean":"2023-07-14T11:19:25.964622+0000","last_became_active":"2023-07-14T11:19:24.975556+0000","last_became_peered":"2023-07-14T11:19:24.975556+0000","last_unstale":"2023-07-14T11:19:25.964622+0000","last_undegraded":"2023-07-14T11:19:25.964622+0000","last_fullsized":"2023-07-14T11:19:25.964622+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:02:11.711759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-07-14T11:19:22.948552+0000","last_change":"2023-07-14T11:19:22.948552+0000","last_active":"2023-07-14T11:19:22.930757+0000","last_peered":"2023-07-14T11:19:22.930757+0000","last_clean":"2023-07-14T11:19:22.930757+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:22.948552+0000","last_undegraded":"2023-07-14T11:19:22.948552+0000","last_fullsized":"2023-07-14T11:19:22.948552+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.968126+0000","last_change":"2023-07-14T11:19:24.978612+0000","last_active":"2023-07-14T11:19:25.968126+0000","last_peered":"2023-07-14T11:19:25.968126+0000","last_clean":"2023-07-14T11:19:25.968126+0000","last_became_active":"2023-07-14T11:19:24.978260+0000","last_became_peered":"2023-07-14T11:19:24.978260+0000","last_unstale":"2023-07-14T11:19:25.968126+0000","last_undegraded":"2023-07-14T11:19:25.968126+0000","last_fullsized":"2023-07-14T11:19:25.968126+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:45:26.959920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-07-14T11:19:22.947747+0000","last_change":"2023-07-14T11:19:22.947747+0000","last_active":"2023-07-14T11:19:22.930757+0000","last_peered":"2023-07-14T11:19:22.930757+0000","last_clean":"2023-07-14T11:19:22.930757+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:22.947747+0000","last_undegraded":"2023-07-14T11:19:22.947747+0000","last_fullsized":"2023-07-14T11:19:22.947747+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":161,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-14T11:19:22.947870+0000","last_change":"2023-07-14T11:13:08.762084+0000","last_active":"2023-07-14T11:19:22.947870+0000","last_peered":"2023-07-14T11:19:22.947870+0000","last_clean":"2023-07-14T11:19:22.947870+0000","last_became_active":"2023-07-14T11:13:08.761763+0000","last_became_peered":"2023-07-14T11:13:08.761763+0000","last_unstale":"2023-07-14T11:19:22.947870+0000","last_undegraded":"2023-07-14T11:19:22.947870+0000","last_fullsized":"2023-07-14T11:19:22.947870+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:18:09.688083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:19:23.938624+0000","last_change":"2023-07-14T11:19:23.938624+0000","last_active":"2023-07-14T11:19:23.938624+0000","last_peered":"2023-07-14T11:19:23.938624+0000","last_clean":"2023-07-14T11:19:23.938624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:23.938624+0000","last_undegraded":"2023-07-14T11:19:23.938624+0000","last_fullsized":"2023-07-14T11:19:23.938624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.15","version":"105'3","reported_seq":16,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967842+0000","last_change":"2023-07-14T11:19:23.969233+0000","last_active":"2023-07-14T11:19:25.967842+0000","last_peered":"2023-07-14T11:19:25.967842+0000","last_clean":"2023-07-14T11:19:25.967842+0000","last_became_active":"2023-07-14T11:19:23.968938+0000","last_became_peered":"2023-07-14T11:19:23.968938+0000","last_unstale":"2023-07-14T11:19:25.967842+0000","last_undegraded":"2023-07-14T11:19:25.967842+0000","last_fullsized":"2023-07-14T11:19:25.967842+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:53:14.223807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":187,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.964710+0000","last_change":"2023-07-14T11:13:08.761726+0000","last_active":"2023-07-14T11:19:25.964710+0000","last_peered":"2023-07-14T11:19:25.964710+0000","last_clean":"2023-07-14T11:19:25.964710+0000","last_became_active":"2023-07-14T11:13:08.761365+0000","last_became_peered":"2023-07-14T11:13:08.761365+0000","last_unstale":"2023-07-14T11:19:25.964710+0000","last_undegraded":"2023-07-14T11:19:25.964710+0000","last_fullsized":"2023-07-14T11:19:25.964710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:19:34.910190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967811+0000","last_change":"2023-07-14T11:19:24.985128+0000","last_active":"2023-07-14T11:19:25.967811+0000","last_peered":"2023-07-14T11:19:25.967811+0000","last_clean":"2023-07-14T11:19:25.967811+0000","last_became_active":"2023-07-14T11:19:24.984814+0000","last_became_peered":"2023-07-14T11:19:24.984814+0000","last_unstale":"2023-07-14T11:19:25.967811+0000","last_undegraded":"2023-07-14T11:19:25.967811+0000","last_fullsized":"2023-07-14T11:19:25.967811+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:37:46.235964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.968001+0000","last_change":"2023-07-14T11:19:23.959733+0000","last_active":"2023-07-14T11:19:25.968001+0000","last_peered":"2023-07-14T11:19:25.968001+0000","last_clean":"2023-07-14T11:19:25.968001+0000","last_became_active":"2023-07-14T11:19:23.959449+0000","last_became_peered":"2023-07-14T11:19:23.959449+0000","last_unstale":"2023-07-14T11:19:25.968001+0000","last_undegraded":"2023-07-14T11:19:25.968001+0000","last_fullsized":"2023-07-14T11:19:25.968001+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:14:29.323565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":151,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-14T11:19:22.949527+0000","last_change":"2023-07-14T11:13:08.923899+0000","last_active":"2023-07-14T11:19:22.949527+0000","last_peered":"2023-07-14T11:19:22.949527+0000","last_clean":"2023-07-14T11:19:22.949527+0000","last_became_active":"2023-07-14T11:13:08.923513+0000","last_became_peered":"2023-07-14T11:13:08.923513+0000","last_unstale":"2023-07-14T11:19:22.949527+0000","last_undegraded":"2023-07-14T11:19:22.949527+0000","last_fullsized":"2023-07-14T11:19:22.949527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:02:09.817122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:19:23.938624+0000","last_change":"2023-07-14T11:19:23.938624+0000","last_active":"2023-07-14T11:19:23.938624+0000","last_peered":"2023-07-14T11:19:23.938624+0000","last_clean":"2023-07-14T11:19:23.938624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:23.938624+0000","last_undegraded":"2023-07-14T11:19:23.938624+0000","last_fullsized":"2023-07-14T11:19:23.938624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-07-14T11:19:22.947360+0000","last_change":"2023-07-14T11:19:22.947360+0000","last_active":"2023-07-14T11:19:22.930757+0000","last_peered":"2023-07-14T11:19:22.930757+0000","last_clean":"2023-07-14T11:19:22.930757+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:22.947360+0000","last_undegraded":"2023-07-14T11:19:22.947360+0000","last_fullsized":"2023-07-14T11:19:22.947360+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":152,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-14T11:19:22.949891+0000","last_change":"2023-07-14T11:13:08.760609+0000","last_active":"2023-07-14T11:19:22.949891+0000","last_peered":"2023-07-14T11:19:22.949891+0000","last_clean":"2023-07-14T11:19:22.949891+0000","last_became_active":"2023-07-14T11:13:08.760285+0000","last_became_peered":"2023-07-14T11:13:08.760285+0000","last_unstale":"2023-07-14T11:19:22.949891+0000","last_undegraded":"2023-07-14T11:19:22.949891+0000","last_fullsized":"2023-07-14T11:19:22.949891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:28:15.435436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:19:23.938624+0000","last_change":"2023-07-14T11:19:23.938624+0000","last_active":"2023-07-14T11:19:23.938624+0000","last_peered":"2023-07-14T11:19:23.938624+0000","last_clean":"2023-07-14T11:19:23.938624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:23.938624+0000","last_undegraded":"2023-07-14T11:19:23.938624+0000","last_fullsized":"2023-07-14T11:19:23.938624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-07-14T11:19:22.945755+0000","last_change":"2023-07-14T11:19:22.945755+0000","last_active":"2023-07-14T11:19:22.930757+0000","last_peered":"2023-07-14T11:19:22.930757+0000","last_clean":"2023-07-14T11:19:22.930757+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:22.945755+0000","last_undegraded":"2023-07-14T11:19:22.945755+0000","last_fullsized":"2023-07-14T11:19:22.945755+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"76'128","reported_seq":347,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-07-14T11:19:22.950012+0000","last_change":"2023-07-14T11:13:01.370649+0000","last_active":"2023-07-14T11:19:22.950012+0000","last_peered":"2023-07-14T11:19:22.950012+0000","last_clean":"2023-07-14T11:19:22.950012+0000","last_became_active":"2023-07-14T11:13:01.369478+0000","last_became_peered":"2023-07-14T11:13:01.369478+0000","last_unstale":"2023-07-14T11:19:22.950012+0000","last_undegraded":"2023-07-14T11:19:22.950012+0000","last_fullsized":"2023-07-14T11:19:22.950012+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:00.254800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:00.254800+0000","last_clean_scrub_stamp":"2023-07-14T11:13:00.254800+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:35:05.301387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":172,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967539+0000","last_change":"2023-07-14T11:13:08.757882+0000","last_active":"2023-07-14T11:19:25.967539+0000","last_peered":"2023-07-14T11:19:25.967539+0000","last_clean":"2023-07-14T11:19:25.967539+0000","last_became_active":"2023-07-14T11:13:08.757541+0000","last_became_peered":"2023-07-14T11:13:08.757541+0000","last_unstale":"2023-07-14T11:19:25.967539+0000","last_undegraded":"2023-07-14T11:19:25.967539+0000","last_fullsized":"2023-07-14T11:19:25.967539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:44:22.274150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.964372+0000","last_change":"2023-07-14T11:19:24.972447+0000","last_active":"2023-07-14T11:19:25.964372+0000","last_peered":"2023-07-14T11:19:25.964372+0000","last_clean":"2023-07-14T11:19:25.964372+0000","last_became_active":"2023-07-14T11:19:24.972170+0000","last_became_peered":"2023-07-14T11:19:24.972170+0000","last_unstale":"2023-07-14T11:19:25.964372+0000","last_undegraded":"2023-07-14T11:19:25.964372+0000","last_fullsized":"2023-07-14T11:19:25.964372+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:06:12.493242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-07-14T11:19:22.947609+0000","last_change":"2023-07-14T11:19:22.947609+0000","last_active":"2023-07-14T11:19:22.930757+0000","last_peered":"2023-07-14T11:19:22.930757+0000","last_clean":"2023-07-14T11:19:22.930757+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:22.947609+0000","last_undegraded":"2023-07-14T11:19:22.947609+0000","last_fullsized":"2023-07-14T11:19:22.947609+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":176,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.399575+0000","last_change":"2023-07-14T11:13:08.862331+0000","last_active":"2023-07-14T11:19:27.399575+0000","last_peered":"2023-07-14T11:19:27.399575+0000","last_clean":"2023-07-14T11:19:27.399575+0000","last_became_active":"2023-07-14T11:13:08.861817+0000","last_became_peered":"2023-07-14T11:13:08.861817+0000","last_unstale":"2023-07-14T11:19:27.399575+0000","last_undegraded":"2023-07-14T11:19:27.399575+0000","last_fullsized":"2023-07-14T11:19:27.399575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:06:57.469895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.399635+0000","last_change":"2023-07-14T11:19:24.980611+0000","last_active":"2023-07-14T11:19:27.399635+0000","last_peered":"2023-07-14T11:19:27.399635+0000","last_clean":"2023-07-14T11:19:27.399635+0000","last_became_active":"2023-07-14T11:19:24.980359+0000","last_became_peered":"2023-07-14T11:19:24.980359+0000","last_unstale":"2023-07-14T11:19:27.399635+0000","last_undegraded":"2023-07-14T11:19:27.399635+0000","last_fullsized":"2023-07-14T11:19:27.399635+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:16:08.807717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-07-14T11:19:22.947503+0000","last_change":"2023-07-14T11:19:22.947503+0000","last_active":"2023-07-14T11:19:22.930757+0000","last_peered":"2023-07-14T11:19:22.930757+0000","last_clean":"2023-07-14T11:19:22.930757+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:22.947503+0000","last_undegraded":"2023-07-14T11:19:22.947503+0000","last_fullsized":"2023-07-14T11:19:22.947503+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":172,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967485+0000","last_change":"2023-07-14T11:13:08.758749+0000","last_active":"2023-07-14T11:19:25.967485+0000","last_peered":"2023-07-14T11:19:25.967485+0000","last_clean":"2023-07-14T11:19:25.967485+0000","last_became_active":"2023-07-14T11:13:08.757956+0000","last_became_peered":"2023-07-14T11:13:08.757956+0000","last_unstale":"2023-07-14T11:19:25.967485+0000","last_undegraded":"2023-07-14T11:19:25.967485+0000","last_fullsized":"2023-07-14T11:19:25.967485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:50:28.757111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T11:19:23.938624+0000","last_change":"2023-07-14T11:19:23.938624+0000","last_active":"2023-07-14T11:19:23.938624+0000","last_peered":"2023-07-14T11:19:23.938624+0000","last_clean":"2023-07-14T11:19:23.938624+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:23.938624+0000","last_undegraded":"2023-07-14T11:19:23.938624+0000","last_fullsized":"2023-07-14T11:19:23.938624+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-07-14T11:19:22.946805+0000","last_change":"2023-07-14T11:19:22.946805+0000","last_active":"2023-07-14T11:19:22.930757+0000","last_peered":"2023-07-14T11:19:22.930757+0000","last_clean":"2023-07-14T11:19:22.930757+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T11:19:22.946805+0000","last_undegraded":"2023-07-14T11:19:22.946805+0000","last_fullsized":"2023-07-14T11:19:22.946805+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":188,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.964499+0000","last_change":"2023-07-14T11:13:08.923786+0000","last_active":"2023-07-14T11:19:25.964499+0000","last_peered":"2023-07-14T11:19:25.964499+0000","last_clean":"2023-07-14T11:19:25.964499+0000","last_became_active":"2023-07-14T11:13:08.923384+0000","last_became_peered":"2023-07-14T11:13:08.923384+0000","last_unstale":"2023-07-14T11:19:25.964499+0000","last_undegraded":"2023-07-14T11:19:25.964499+0000","last_fullsized":"2023-07-14T11:19:25.964499+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:32:52.150831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":82,"acting":82,"num_store_stats":5},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":112,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15,"ondisk_log_size":15,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574929,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32880,"kb_used_data":1832,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338960,"statfs":{"total":96636764160,"available":96603095040,"internally_reserved":0,"allocated":1875968,"data_stored":1181478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:19:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.66200000000000003,"15min":0.89400000000000002},"min":{"1min":0.55500000000000005,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":8.4339999999999993},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.69199999999999995,"15min":0.92800000000000005},"min":{"1min":0.47599999999999998,"5min":0.45500000000000002,"15min":0.377},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":8.4559999999999995},"last":0.65100000000000002}]},{"osd":1,"last update":"Fri Jul 14 11:19:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.67200000000000004,"15min":0.871},"min":{"1min":0.52100000000000002,"5min":0.40400000000000003,"15min":0.34899999999999998},"max":{"1min":0.90400000000000003,"5min":0.92800000000000005,"15min":6.3520000000000003},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.66100000000000003,"15min":1.0089999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":6.8550000000000004},"last":0.71199999999999997}]},{"osd":2,"last update":"Fri Jul 14 11:19:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.67100000000000004,"15min":1.0569999999999999},"min":{"1min":0.499,"5min":0.434,"15min":0.434},"max":{"1min":0.83599999999999997,"5min":0.997,"15min":7.0289999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.70399999999999996,"15min":0.69299999999999995},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.86399999999999999,"5min":0.98199999999999998,"15min":1.0580000000000001},"last":0.81000000000000005}]},{"osd":3,"last update":"Fri Jul 14 11:19:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.68899999999999995,"15min":1.109},"min":{"1min":0.55200000000000005,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.91100000000000003,"5min":0.95699999999999996,"15min":10.337},"last":0.755},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.72699999999999998,"15min":0.75800000000000001},"min":{"1min":0.53300000000000003,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.90100000000000002,"5min":1.024,"15min":1.921},"last":0.53400000000000003}]},{"osd":4,"last update":"Fri Jul 14 11:19:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.64700000000000002,"15min":0.59899999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.73599999999999999,"15min":0.70599999999999996},"min":{"1min":0.57299999999999995,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.90800000000000003,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.59099999999999997}]},{"osd":5,"last update":"Fri Jul 14 11:19:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.70099999999999996,"15min":0.67900000000000005},"min":{"1min":0.39700000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.92800000000000005,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.76400000000000001,"15min":0.73999999999999999},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.47499999999999998}]},{"osd":6,"last update":"Fri Jul 14 11:19:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.72899999999999998,"15min":0.68300000000000005},"min":{"1min":0.505,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.98799999999999999,"5min":1.002,"15min":1.002},"last":0.5},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.73299999999999998,"15min":0.69399999999999995},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.48899999999999999},"max":{"1min":0.97399999999999998,"5min":1.129,"15min":1.129},"last":0.51300000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574930,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28204,"kb_used_data":1252,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343636,"statfs":{"total":96636764160,"available":96607883264,"internally_reserved":0,"allocated":1282048,"data_stored":591110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.69899999999999995,"15min":0.70299999999999996},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93799999999999994,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.73499999999999999,"15min":0.72099999999999997},"min":{"1min":0.51100000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.83899999999999997,"5min":1.167,"15min":1.167},"last":0.55900000000000005}]},{"osd":1,"last update":"Fri Jul 14 11:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71899999999999997,"15min":0.69099999999999995},"min":{"1min":0.443,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.73099999999999998,"15min":0.71399999999999997},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39300000000000002},"max":{"1min":0.90400000000000003,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.64400000000000002}]},{"osd":2,"last update":"Fri Jul 14 11:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.69899999999999995,"15min":0.67900000000000005},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.41299999999999998},"max":{"1min":0.89000000000000001,"5min":1.45,"15min":1.45},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.755,"5min":0.754,"15min":0.77600000000000002},"min":{"1min":0.56399999999999995,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.075,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.66300000000000003}]},{"osd":3,"last update":"Fri Jul 14 11:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.73099999999999998,"15min":0.74299999999999999},"min":{"1min":0.50900000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.86499999999999999,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.73299999999999998,"15min":0.73899999999999999},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0469999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.496}]},{"osd":4,"last update":"Fri Jul 14 11:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.69099999999999995,"15min":0.70699999999999996},"min":{"1min":0.53300000000000003,"5min":0.38,"15min":0.38},"max":{"1min":1.177,"5min":1.712,"15min":1.712},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.71999999999999997,"15min":0.72599999999999998},"min":{"1min":0.48199999999999998,"5min":0.438,"15min":0.42899999999999999},"max":{"1min":0.998,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.67800000000000005}]},{"osd":5,"last update":"Fri Jul 14 11:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.71199999999999997,"15min":0.71799999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.93500000000000005,"5min":2.8820000000000001,"15min":2.8820000000000001},"last":0.628},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.77200000000000002,"15min":0.78800000000000003},"min":{"1min":0.58399999999999996,"5min":0.46100000000000002,"15min":0.44500000000000001},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.71199999999999997}]},{"osd":7,"last update":"Fri Jul 14 11:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.77500000000000002,"15min":0.79900000000000004},"min":{"1min":0.59899999999999998,"5min":0.47399999999999998,"15min":0.47099999999999997},"max":{"1min":0.95499999999999996,"5min":1.333,"15min":1.333},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.76300000000000001,"15min":0.78900000000000003},"min":{"1min":0.46899999999999997,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.1579999999999999,"5min":1.55,"15min":1.55},"last":0.746}]}]},{"osd":1,"up_from":13,"seq":55834574930,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28244,"kb_used_data":1292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343596,"statfs":{"total":96636764160,"available":96607842304,"internally_reserved":0,"allocated":1323008,"data_stored":611541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.40500000000000003,"15min":0.432},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.54200000000000004,"5min":0.59099999999999997,"15min":0.996},"last":0.745},{"interface":"front","average":{"1min":0.432,"5min":0.45500000000000002,"15min":0.47599999999999998},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.57299999999999995,"5min":0.81599999999999995,"15min":0.84299999999999997},"last":0.40699999999999997}]},{"osd":2,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.48099999999999998,"15min":0.54900000000000004},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.60299999999999998,"5min":0.70799999999999996,"15min":2.476},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.48899999999999999,"15min":0.59499999999999997},"min":{"1min":0.36899999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.64700000000000002,"5min":0.91700000000000004,"15min":2.6299999999999999},"last":0.57499999999999996}]},{"osd":3,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.52800000000000002,"15min":0.52200000000000002},"min":{"1min":0.40899999999999997,"5min":0.39300000000000002,"15min":0.38900000000000001},"max":{"1min":0.72599999999999998,"5min":0.748,"15min":0.748},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46500000000000002,"15min":0.48799999999999999},"min":{"1min":0.33600000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.59499999999999997,"5min":0.67700000000000005,"15min":0.73199999999999998},"last":0.47799999999999998}]},{"osd":4,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.73699999999999999,"15min":0.749},"min":{"1min":0.52400000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.363},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.751,"5min":0.754,"15min":0.76900000000000002},"min":{"1min":0.57099999999999995,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.93999999999999995,"5min":1.1160000000000001,"15min":1.4890000000000001},"last":0.625}]},{"osd":5,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.749,"15min":0.76500000000000001},"min":{"1min":0.54200000000000004,"5min":0.499,"15min":0.499},"max":{"1min":1.0589999999999999,"5min":1.2250000000000001,"15min":1.3759999999999999},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76200000000000001,"15min":0.80800000000000005},"min":{"1min":0.59099999999999997,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.4330000000000001},"last":0.68799999999999994}]},{"osd":6,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.745,"15min":0.78800000000000003},"min":{"1min":0.55900000000000005,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.028,"5min":1.141,"15min":1.298},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.753,"15min":0.77900000000000003},"min":{"1min":0.60199999999999998,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.97199999999999998,"5min":1.1899999999999999,"15min":1.2130000000000001},"last":0.85699999999999998}]},{"osd":7,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.75900000000000001,"15min":0.80700000000000005},"min":{"1min":0.58299999999999996,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0780000000000001,"5min":1.2010000000000001,"15min":1.4590000000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.75,"15min":0.77900000000000003},"min":{"1min":0.56299999999999994,"5min":0.55000000000000004,"15min":0.54200000000000004},"max":{"1min":1.129,"5min":1.129,"15min":1.3700000000000001},"last":0.71099999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574928,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28824,"kb_used_data":1872,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343016,"statfs":{"total":96636764160,"available":96607248384,"internally_reserved":0,"allocated":1916928,"data_stored":1201909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 11:19:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.47699999999999998,"15min":0.44700000000000001},"min":{"1min":0.26800000000000002,"5min":0.252,"15min":0.252},"max":{"1min":2.972,"5min":2.972,"15min":2.972},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.47599999999999998,"15min":0.45200000000000001},"min":{"1min":0.33300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":2.758,"5min":2.758,"15min":2.758},"last":0.31900000000000001}]},{"osd":2,"last update":"Fri Jul 14 11:19:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.499,"15min":0.47299999999999998},"min":{"1min":0.35599999999999998,"5min":0.307,"15min":0.307},"max":{"1min":2.9409999999999998,"5min":2.9409999999999998,"15min":2.9409999999999998},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.51900000000000002,"15min":0.50900000000000001},"min":{"1min":0.376,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":2.556,"5min":2.556,"15min":2.556},"last":0.45900000000000002}]},{"osd":3,"last update":"Fri Jul 14 11:19:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.48199999999999998,"15min":0.438},"min":{"1min":0.33700000000000002,"5min":0.32000000000000001,"15min":0.309},"max":{"1min":2.6019999999999999,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.55600000000000005,"15min":0.53500000000000003},"min":{"1min":0.44900000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":2.9990000000000001,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":0.56599999999999995}]},{"osd":4,"last update":"Fri Jul 14 11:19:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.73699999999999999,"15min":0.75700000000000001},"min":{"1min":0.51200000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0229999999999999,"5min":1.099,"15min":1.1060000000000001},"last":0.874},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.76400000000000001,"15min":0.71799999999999997},"min":{"1min":0.57499999999999996,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.651,"5min":1.651,"15min":1.651},"last":0.82299999999999995}]},{"osd":5,"last update":"Fri Jul 14 11:19:12 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.77200000000000002,"15min":0.73799999999999999},"min":{"1min":0.51900000000000002,"5min":0.502,"15min":0.47999999999999998},"max":{"1min":2.9089999999999998,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.76500000000000001,"15min":0.77600000000000002},"min":{"1min":0.53200000000000003,"5min":0.505,"15min":0.505},"max":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.77800000000000002}]},{"osd":6,"last update":"Fri Jul 14 11:19:12 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.745,"15min":0.72799999999999998},"min":{"1min":0.499,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.78700000000000003,"15min":0.78300000000000003},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":2.8679999999999999,"5min":2.8679999999999999,"15min":2.8679999999999999},"last":0.76000000000000001}]},{"osd":7,"last update":"Fri Jul 14 11:19:12 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.77700000000000002,"15min":0.80900000000000005},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.97599999999999998,"5min":1.0900000000000001,"15min":1.149},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.81899999999999995,"15min":0.78900000000000003},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.7410000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":0.85799999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574928,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28240,"kb_used_data":1288,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343600,"statfs":{"total":96636764160,"available":96607846400,"internally_reserved":0,"allocated":1318912,"data_stored":611519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:19:20 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.40899999999999997,"15min":0.441},"min":{"1min":0.27100000000000002,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.623,"5min":0.63900000000000001,"15min":0.64700000000000002},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.438,"15min":0.44400000000000001},"min":{"1min":0.32100000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.63700000000000001,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.36399999999999999}]},{"osd":1,"last update":"Fri Jul 14 11:19:20 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46700000000000003,"15min":0.48199999999999998},"min":{"1min":0.371,"5min":0.31,"15min":0.31},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.98299999999999998},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.47899999999999998,"15min":0.48699999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.59199999999999997,"5min":0.629,"15min":0.91200000000000003},"last":0.498}]},{"osd":3,"last update":"Fri Jul 14 11:19:20 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.48699999999999999,"15min":0.49299999999999999},"min":{"1min":0.34999999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.623,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.55700000000000005,"15min":0.57999999999999996},"min":{"1min":0.44500000000000001,"5min":0.41499999999999998,"15min":0.40799999999999997},"max":{"1min":0.72899999999999998,"5min":0.80000000000000004,"15min":1.034},"last":0.53500000000000003}]},{"osd":4,"last update":"Fri Jul 14 11:19:20 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.73499999999999999,"15min":0.76300000000000001},"min":{"1min":0.53900000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.036,"5min":1.171,"15min":1.212},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.749,"15min":0.77900000000000003},"min":{"1min":0.53800000000000003,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.83899999999999997}]},{"osd":5,"last update":"Fri Jul 14 11:19:20 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.74399999999999999,"15min":0.78200000000000003},"min":{"1min":0.53900000000000003,"5min":0.51700000000000002,"15min":0.43099999999999999},"max":{"1min":1.202,"5min":1.202,"15min":1.4019999999999999},"last":0.751},{"interface":"front","average":{"1min":0.75,"5min":0.76300000000000001,"15min":0.81100000000000005},"min":{"1min":0.55800000000000005,"5min":0.495,"15min":0.495},"max":{"1min":1.044,"5min":1.351,"15min":1.351},"last":0.86799999999999999}]},{"osd":6,"last update":"Fri Jul 14 11:19:20 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.753,"15min":0.78100000000000003},"min":{"1min":0.53100000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0089999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.76800000000000002,"15min":0.81299999999999994},"min":{"1min":0.60199999999999998,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.218,"5min":1.282,"15min":1.282},"last":0.80800000000000005}]},{"osd":7,"last update":"Fri Jul 14 11:19:20 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.754,"15min":0.79100000000000004},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.93400000000000005,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.754,"15min":0.79600000000000004},"min":{"1min":0.60899999999999999,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.96399999999999997,"5min":1.244,"15min":1.244},"last":0.77700000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574927,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28204,"kb_used_data":1252,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343636,"statfs":{"total":96636764160,"available":96607883264,"internally_reserved":0,"allocated":1282048,"data_stored":591110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.41099999999999998,"15min":0.442},"min":{"1min":0.24299999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.55900000000000005,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.44500000000000001,"15min":0.44800000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.621,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.29499999999999998}]},{"osd":1,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.44,"15min":0.44900000000000001},"min":{"1min":0.29499999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.52000000000000002,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.47199999999999998,"15min":0.49099999999999999},"min":{"1min":0.317,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.60899999999999999,"5min":0.72699999999999998,"15min":0.86399999999999999},"last":0.47499999999999998}]},{"osd":2,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.53400000000000003,"15min":0.54000000000000004},"min":{"1min":0.39600000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.64900000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56200000000000006,"15min":0.58999999999999997},"min":{"1min":0.44,"5min":0.37,"15min":0.37},"max":{"1min":0.76100000000000001,"5min":0.79600000000000004,"15min":1.585},"last":0.61699999999999999}]},{"osd":4,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.73299999999999998,"15min":0.754},"min":{"1min":0.45400000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.96399999999999997,"5min":1.1279999999999999,"15min":1.216},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.76700000000000002,"15min":0.75700000000000001},"min":{"1min":0.48599999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.67100000000000004}]},{"osd":5,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.747,"15min":0.75700000000000001},"min":{"1min":0.48499999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.089,"5min":1.179,"15min":1.413},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.76700000000000002,"15min":0.83499999999999996},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.94999999999999996,"5min":1.1619999999999999,"15min":1.657},"last":0.57899999999999996}]},{"osd":6,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77700000000000002,"15min":0.78300000000000003},"min":{"1min":0.56699999999999995,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.726},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.755,"5min":0.76800000000000002,"15min":0.79400000000000004},"min":{"1min":0.57099999999999995,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.143,"5min":1.286,"15min":1.333},"last":0.63}]},{"osd":7,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.79700000000000004,"15min":0.83099999999999996},"min":{"1min":0.53800000000000003,"5min":0.437,"15min":0.437},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.3939999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.80800000000000005,"15min":0.83399999999999996},"min":{"1min":0.60299999999999998,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.59999999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574928,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28252,"kb_used_data":1300,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343588,"statfs":{"total":96636764160,"available":96607834112,"internally_reserved":0,"allocated":1331200,"data_stored":613083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:19:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.64900000000000002,"15min":0.63500000000000001},"min":{"1min":0.437,"5min":0.311,"15min":0.311},"max":{"1min":0.89600000000000002,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.65200000000000002,"15min":0.68400000000000005},"min":{"1min":0.47699999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85199999999999998,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.70099999999999996}]},{"osd":1,"last update":"Fri Jul 14 11:19:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.65200000000000002,"15min":0.66600000000000004},"min":{"1min":0.51700000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.83599999999999997,"5min":0.92000000000000004,"15min":1.4259999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70299999999999996,"15min":0.70999999999999996},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.45800000000000002},"max":{"1min":0.95799999999999996,"5min":1.0149999999999999,"15min":1.1659999999999999},"last":0.80400000000000005}]},{"osd":2,"last update":"Fri Jul 14 11:19:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.69999999999999996,"15min":0.70699999999999996},"min":{"1min":0.501,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.88200000000000001,"5min":1.0209999999999999,"15min":1.48},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71999999999999997,"15min":0.73599999999999999},"min":{"1min":0.54800000000000004,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.91800000000000004,"5min":1.1080000000000001,"15min":1.23},"last":0.66600000000000004}]},{"osd":3,"last update":"Fri Jul 14 11:19:15 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.67800000000000005,"15min":0.70799999999999996},"min":{"1min":0.51300000000000001,"5min":0.438,"15min":0.438},"max":{"1min":0.95599999999999996,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.72999999999999998,"15min":0.73599999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.90700000000000003,"5min":1.1259999999999999,"15min":1.145},"last":0.59099999999999997}]},{"osd":5,"last update":"Fri Jul 14 11:19:15 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.66600000000000004,"15min":0.74299999999999999},"min":{"1min":0.47399999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.81799999999999995,"5min":0.95999999999999996,"15min":1.6559999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.65700000000000003,"15min":0.745},"min":{"1min":0.41999999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.90500000000000003,"5min":0.96999999999999997,"15min":1.3839999999999999},"last":0.48299999999999998}]},{"osd":6,"last update":"Fri Jul 14 11:19:15 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.68500000000000005,"15min":0.71299999999999997},"min":{"1min":0.45200000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.86799999999999999,"5min":1.1659999999999999,"15min":1.1970000000000001},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.73699999999999999,"15min":0.76600000000000001},"min":{"1min":0.56899999999999995,"5min":0.442,"15min":0.442},"max":{"1min":0.878,"5min":1.1479999999999999,"15min":1.3},"last":0.84099999999999997}]},{"osd":7,"last update":"Fri Jul 14 11:19:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.70499999999999996,"15min":0.755},"min":{"1min":0.47899999999999998,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.88,"5min":1.028,"15min":1.4810000000000001},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.755,"15min":0.82599999999999996},"min":{"1min":0.59099999999999997,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.82499999999999996,"5min":1.21,"15min":1.379},"last":0.71799999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574930,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28248,"kb_used_data":1296,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343592,"statfs":{"total":96636764160,"available":96607838208,"internally_reserved":0,"allocated":1327104,"data_stored":611679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:19:05 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.61899999999999999,"15min":0.63600000000000001},"min":{"1min":0.371,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.84199999999999997,"5min":0.996,"15min":1.3140000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65200000000000002,"15min":0.64000000000000001},"min":{"1min":0.42399999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":1.0980000000000001},"last":0.80900000000000005}]},{"osd":1,"last update":"Fri Jul 14 11:19:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.624,"15min":0.66400000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.75600000000000001,"5min":0.88800000000000001,"15min":1.343},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.63,"5min":0.65100000000000002,"15min":0.64800000000000002},"min":{"1min":0.442,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.86599999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.65500000000000003}]},{"osd":2,"last update":"Fri Jul 14 11:19:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.69899999999999995,"15min":0.72899999999999998},"min":{"1min":0.46700000000000003,"5min":0.436,"15min":0.436},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.70299999999999996,"15min":0.753},"min":{"1min":0.504,"5min":0.496,"15min":0.496},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":1.3939999999999999},"last":0.84099999999999997}]},{"osd":3,"last update":"Fri Jul 14 11:19:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71199999999999997,"15min":0.75600000000000001},"min":{"1min":0.54500000000000004,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":1.2130000000000001},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.67700000000000005,"15min":0.75700000000000001},"min":{"1min":0.46400000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":1.806},"last":0.72299999999999998}]},{"osd":4,"last update":"Fri Jul 14 11:19:05 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.61699999999999999,"15min":0.64600000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.878,"5min":1.0229999999999999,"15min":1.1319999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.66500000000000004,"15min":0.73699999999999999},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.3999999999999999},"last":0.53400000000000003}]},{"osd":6,"last update":"Fri Jul 14 11:19:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.69699999999999995,"15min":0.73999999999999999},"min":{"1min":0.502,"5min":0.435,"15min":0.435},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.73499999999999999,"15min":0.79000000000000004},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.004,"5min":1.0629999999999999,"15min":1.3640000000000001},"last":0.73599999999999999}]},{"osd":7,"last update":"Fri Jul 14 11:19:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.747,"15min":0.82999999999999996},"min":{"1min":0.54400000000000004,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.4970000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78500000000000003,"15min":0.85499999999999998},"min":{"1min":0.60399999999999998,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.8540000000000001},"last":0.58699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T11:19:30.280 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.3e is not active+clean 2023-07-14T11:19:30.280 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:19:23.938624+0000', 'last_change': '2023-07-14T11:19:23.938624+0000', 'last_active': '2023-07-14T11:19:23.938624+0000', 'last_peered': '2023-07-14T11:19:23.938624+0000', 'last_clean': '2023-07-14T11:19:23.938624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:19:23.938624+0000', 'last_undegraded': '2023-07-14T11:19:23.938624+0000', 'last_fullsized': '2023-07-14T11:19:23.938624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:19:23.938624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:19:23.938624+0000', 'last_clean_scrub_stamp': '2023-07-14T11:19:23.938624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:19:30.281 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.3d is not active+clean 2023-07-14T11:19:30.281 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:19:23.938624+0000', 'last_change': '2023-07-14T11:19:23.938624+0000', 'last_active': '2023-07-14T11:19:23.938624+0000', 'last_peered': '2023-07-14T11:19:23.938624+0000', 'last_clean': '2023-07-14T11:19:23.938624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:19:23.938624+0000', 'last_undegraded': '2023-07-14T11:19:23.938624+0000', 'last_fullsized': '2023-07-14T11:19:23.938624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:19:23.938624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:19:23.938624+0000', 'last_clean_scrub_stamp': '2023-07-14T11:19:23.938624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:19:30.281 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.3c is not active+clean 2023-07-14T11:19:30.282 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:19:23.938624+0000', 'last_change': '2023-07-14T11:19:23.938624+0000', 'last_active': '2023-07-14T11:19:23.938624+0000', 'last_peered': '2023-07-14T11:19:23.938624+0000', 'last_clean': '2023-07-14T11:19:23.938624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:19:23.938624+0000', 'last_undegraded': '2023-07-14T11:19:23.938624+0000', 'last_fullsized': '2023-07-14T11:19:23.938624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:19:23.938624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:19:23.938624+0000', 'last_clean_scrub_stamp': '2023-07-14T11:19:23.938624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:19:30.282 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.38 is not active+clean 2023-07-14T11:19:30.282 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:19:23.938624+0000', 'last_change': '2023-07-14T11:19:23.938624+0000', 'last_active': '2023-07-14T11:19:23.938624+0000', 'last_peered': '2023-07-14T11:19:23.938624+0000', 'last_clean': '2023-07-14T11:19:23.938624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:19:23.938624+0000', 'last_undegraded': '2023-07-14T11:19:23.938624+0000', 'last_fullsized': '2023-07-14T11:19:23.938624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:19:23.938624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:19:23.938624+0000', 'last_clean_scrub_stamp': '2023-07-14T11:19:23.938624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:19:30.283 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.37 is not active+clean 2023-07-14T11:19:30.283 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:19:23.938624+0000', 'last_change': '2023-07-14T11:19:23.938624+0000', 'last_active': '2023-07-14T11:19:23.938624+0000', 'last_peered': '2023-07-14T11:19:23.938624+0000', 'last_clean': '2023-07-14T11:19:23.938624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:19:23.938624+0000', 'last_undegraded': '2023-07-14T11:19:23.938624+0000', 'last_fullsized': '2023-07-14T11:19:23.938624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:19:23.938624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:19:23.938624+0000', 'last_clean_scrub_stamp': '2023-07-14T11:19:23.938624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:19:30.283 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.32 is not active+clean 2023-07-14T11:19:30.284 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:19:23.938624+0000', 'last_change': '2023-07-14T11:19:23.938624+0000', 'last_active': '2023-07-14T11:19:23.938624+0000', 'last_peered': '2023-07-14T11:19:23.938624+0000', 'last_clean': '2023-07-14T11:19:23.938624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:19:23.938624+0000', 'last_undegraded': '2023-07-14T11:19:23.938624+0000', 'last_fullsized': '2023-07-14T11:19:23.938624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:19:23.938624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:19:23.938624+0000', 'last_clean_scrub_stamp': '2023-07-14T11:19:23.938624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:19:30.284 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.2e is not active+clean 2023-07-14T11:19:30.284 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:19:23.938624+0000', 'last_change': '2023-07-14T11:19:23.938624+0000', 'last_active': '2023-07-14T11:19:23.938624+0000', 'last_peered': '2023-07-14T11:19:23.938624+0000', 'last_clean': '2023-07-14T11:19:23.938624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:19:23.938624+0000', 'last_undegraded': '2023-07-14T11:19:23.938624+0000', 'last_fullsized': '2023-07-14T11:19:23.938624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:19:23.938624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:19:23.938624+0000', 'last_clean_scrub_stamp': '2023-07-14T11:19:23.938624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:19:30.285 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.2d is not active+clean 2023-07-14T11:19:30.285 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:19:23.938624+0000', 'last_change': '2023-07-14T11:19:23.938624+0000', 'last_active': '2023-07-14T11:19:23.938624+0000', 'last_peered': '2023-07-14T11:19:23.938624+0000', 'last_clean': '2023-07-14T11:19:23.938624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:19:23.938624+0000', 'last_undegraded': '2023-07-14T11:19:23.938624+0000', 'last_fullsized': '2023-07-14T11:19:23.938624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:19:23.938624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:19:23.938624+0000', 'last_clean_scrub_stamp': '2023-07-14T11:19:23.938624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:19:30.285 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.2b is not active+clean 2023-07-14T11:19:30.286 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:19:23.938624+0000', 'last_change': '2023-07-14T11:19:23.938624+0000', 'last_active': '2023-07-14T11:19:23.938624+0000', 'last_peered': '2023-07-14T11:19:23.938624+0000', 'last_clean': '2023-07-14T11:19:23.938624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:19:23.938624+0000', 'last_undegraded': '2023-07-14T11:19:23.938624+0000', 'last_fullsized': '2023-07-14T11:19:23.938624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:19:23.938624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:19:23.938624+0000', 'last_clean_scrub_stamp': '2023-07-14T11:19:23.938624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:19:30.286 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.29 is not active+clean 2023-07-14T11:19:30.286 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:19:23.938624+0000', 'last_change': '2023-07-14T11:19:23.938624+0000', 'last_active': '2023-07-14T11:19:23.938624+0000', 'last_peered': '2023-07-14T11:19:23.938624+0000', 'last_clean': '2023-07-14T11:19:23.938624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:19:23.938624+0000', 'last_undegraded': '2023-07-14T11:19:23.938624+0000', 'last_fullsized': '2023-07-14T11:19:23.938624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:19:23.938624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:19:23.938624+0000', 'last_clean_scrub_stamp': '2023-07-14T11:19:23.938624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:19:30.287 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.25 is not active+clean 2023-07-14T11:19:30.287 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:19:23.938624+0000', 'last_change': '2023-07-14T11:19:23.938624+0000', 'last_active': '2023-07-14T11:19:23.938624+0000', 'last_peered': '2023-07-14T11:19:23.938624+0000', 'last_clean': '2023-07-14T11:19:23.938624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:19:23.938624+0000', 'last_undegraded': '2023-07-14T11:19:23.938624+0000', 'last_fullsized': '2023-07-14T11:19:23.938624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:19:23.938624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:19:23.938624+0000', 'last_clean_scrub_stamp': '2023-07-14T11:19:23.938624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:19:30.287 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.22 is not active+clean 2023-07-14T11:19:30.288 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:19:23.938624+0000', 'last_change': '2023-07-14T11:19:23.938624+0000', 'last_active': '2023-07-14T11:19:23.938624+0000', 'last_peered': '2023-07-14T11:19:23.938624+0000', 'last_clean': '2023-07-14T11:19:23.938624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:19:23.938624+0000', 'last_undegraded': '2023-07-14T11:19:23.938624+0000', 'last_fullsized': '2023-07-14T11:19:23.938624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:19:23.938624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:19:23.938624+0000', 'last_clean_scrub_stamp': '2023-07-14T11:19:23.938624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:19:30.288 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1f is not active+clean 2023-07-14T11:19:30.288 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 103, 'state': 'creating+peering', 'last_fresh': '2023-07-14T11:19:22.947281+0000', 'last_change': '2023-07-14T11:19:22.947281+0000', 'last_active': '2023-07-14T11:19:22.930757+0000', 'last_peered': '2023-07-14T11:19:22.930757+0000', 'last_clean': '2023-07-14T11:19:22.930757+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:19:22.947281+0000', 'last_undegraded': '2023-07-14T11:19:22.947281+0000', 'last_fullsized': '2023-07-14T11:19:22.947281+0000', 'mapping_epoch': 103, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 103, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:19:22.930757+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:19:22.930757+0000', 'last_clean_scrub_stamp': '2023-07-14T11:19:22.930757+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-14T11:19:30.289 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1d is not active+clean 2023-07-14T11:19:30.289 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 103, 'state': 'creating+peering', 'last_fresh': '2023-07-14T11:19:22.948199+0000', 'last_change': '2023-07-14T11:19:22.948199+0000', 'last_active': '2023-07-14T11:19:22.930757+0000', 'last_peered': '2023-07-14T11:19:22.930757+0000', 'last_clean': '2023-07-14T11:19:22.930757+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:19:22.948199+0000', 'last_undegraded': '2023-07-14T11:19:22.948199+0000', 'last_fullsized': '2023-07-14T11:19:22.948199+0000', 'mapping_epoch': 103, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 103, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:19:22.930757+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:19:22.930757+0000', 'last_clean_scrub_stamp': '2023-07-14T11:19:22.930757+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T11:19:30.289 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1f is not active+clean 2023-07-14T11:19:30.290 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:19:23.938624+0000', 'last_change': '2023-07-14T11:19:23.938624+0000', 'last_active': '2023-07-14T11:19:23.938624+0000', 'last_peered': '2023-07-14T11:19:23.938624+0000', 'last_clean': '2023-07-14T11:19:23.938624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:19:23.938624+0000', 'last_undegraded': '2023-07-14T11:19:23.938624+0000', 'last_fullsized': '2023-07-14T11:19:23.938624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:19:23.938624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:19:23.938624+0000', 'last_clean_scrub_stamp': '2023-07-14T11:19:23.938624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:19:30.290 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1a is not active+clean 2023-07-14T11:19:30.290 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:19:23.938624+0000', 'last_change': '2023-07-14T11:19:23.938624+0000', 'last_active': '2023-07-14T11:19:23.938624+0000', 'last_peered': '2023-07-14T11:19:23.938624+0000', 'last_clean': '2023-07-14T11:19:23.938624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:19:23.938624+0000', 'last_undegraded': '2023-07-14T11:19:23.938624+0000', 'last_fullsized': '2023-07-14T11:19:23.938624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:19:23.938624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:19:23.938624+0000', 'last_clean_scrub_stamp': '2023-07-14T11:19:23.938624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:19:30.291 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.d is not active+clean 2023-07-14T11:19:30.291 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 103, 'state': 'creating+peering', 'last_fresh': '2023-07-14T11:19:22.947732+0000', 'last_change': '2023-07-14T11:19:22.947732+0000', 'last_active': '2023-07-14T11:19:22.930757+0000', 'last_peered': '2023-07-14T11:19:22.930757+0000', 'last_clean': '2023-07-14T11:19:22.930757+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:19:22.947732+0000', 'last_undegraded': '2023-07-14T11:19:22.947732+0000', 'last_fullsized': '2023-07-14T11:19:22.947732+0000', 'mapping_epoch': 103, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 103, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:19:22.930757+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:19:22.930757+0000', 'last_clean_scrub_stamp': '2023-07-14T11:19:22.930757+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T11:19:30.291 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.c is not active+clean 2023-07-14T11:19:30.292 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 103, 'state': 'creating+peering', 'last_fresh': '2023-07-14T11:19:22.948728+0000', 'last_change': '2023-07-14T11:19:22.948728+0000', 'last_active': '2023-07-14T11:19:22.930757+0000', 'last_peered': '2023-07-14T11:19:22.930757+0000', 'last_clean': '2023-07-14T11:19:22.930757+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:19:22.948728+0000', 'last_undegraded': '2023-07-14T11:19:22.948728+0000', 'last_fullsized': '2023-07-14T11:19:22.948728+0000', 'mapping_epoch': 103, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 103, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:19:22.930757+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:19:22.930757+0000', 'last_clean_scrub_stamp': '2023-07-14T11:19:22.930757+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T11:19:30.292 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.9 is not active+clean 2023-07-14T11:19:30.292 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:19:23.938624+0000', 'last_change': '2023-07-14T11:19:23.938624+0000', 'last_active': '2023-07-14T11:19:23.938624+0000', 'last_peered': '2023-07-14T11:19:23.938624+0000', 'last_clean': '2023-07-14T11:19:23.938624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:19:23.938624+0000', 'last_undegraded': '2023-07-14T11:19:23.938624+0000', 'last_fullsized': '2023-07-14T11:19:23.938624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:19:23.938624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:19:23.938624+0000', 'last_clean_scrub_stamp': '2023-07-14T11:19:23.938624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:19:30.293 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.a is not active+clean 2023-07-14T11:19:30.293 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 103, 'state': 'creating+peering', 'last_fresh': '2023-07-14T11:19:22.947660+0000', 'last_change': '2023-07-14T11:19:22.947660+0000', 'last_active': '2023-07-14T11:19:22.930757+0000', 'last_peered': '2023-07-14T11:19:22.930757+0000', 'last_clean': '2023-07-14T11:19:22.930757+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:19:22.947660+0000', 'last_undegraded': '2023-07-14T11:19:22.947660+0000', 'last_fullsized': '2023-07-14T11:19:22.947660+0000', 'mapping_epoch': 103, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 103, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:19:22.930757+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:19:22.930757+0000', 'last_clean_scrub_stamp': '2023-07-14T11:19:22.930757+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T11:19:30.293 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.a is not active+clean 2023-07-14T11:19:30.294 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:19:23.938624+0000', 'last_change': '2023-07-14T11:19:23.938624+0000', 'last_active': '2023-07-14T11:19:23.938624+0000', 'last_peered': '2023-07-14T11:19:23.938624+0000', 'last_clean': '2023-07-14T11:19:23.938624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:19:23.938624+0000', 'last_undegraded': '2023-07-14T11:19:23.938624+0000', 'last_fullsized': '2023-07-14T11:19:23.938624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:19:23.938624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:19:23.938624+0000', 'last_clean_scrub_stamp': '2023-07-14T11:19:23.938624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:19:30.294 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.9 is not active+clean 2023-07-14T11:19:30.294 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 103, 'state': 'creating+peering', 'last_fresh': '2023-07-14T11:19:22.945911+0000', 'last_change': '2023-07-14T11:19:22.945911+0000', 'last_active': '2023-07-14T11:19:22.930757+0000', 'last_peered': '2023-07-14T11:19:22.930757+0000', 'last_clean': '2023-07-14T11:19:22.930757+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:19:22.945911+0000', 'last_undegraded': '2023-07-14T11:19:22.945911+0000', 'last_fullsized': '2023-07-14T11:19:22.945911+0000', 'mapping_epoch': 103, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 103, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:19:22.930757+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:19:22.930757+0000', 'last_clean_scrub_stamp': '2023-07-14T11:19:22.930757+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T11:19:30.295 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.8 is not active+clean 2023-07-14T11:19:30.295 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 103, 'state': 'creating+peering', 'last_fresh': '2023-07-14T11:19:22.949000+0000', 'last_change': '2023-07-14T11:19:22.949000+0000', 'last_active': '2023-07-14T11:19:22.930757+0000', 'last_peered': '2023-07-14T11:19:22.930757+0000', 'last_clean': '2023-07-14T11:19:22.930757+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:19:22.949000+0000', 'last_undegraded': '2023-07-14T11:19:22.949000+0000', 'last_fullsized': '2023-07-14T11:19:22.949000+0000', 'mapping_epoch': 103, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 103, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:19:22.930757+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:19:22.930757+0000', 'last_clean_scrub_stamp': '2023-07-14T11:19:22.930757+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T11:19:30.295 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.6 is not active+clean 2023-07-14T11:19:30.296 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 103, 'state': 'creating+peering', 'last_fresh': '2023-07-14T11:19:22.946542+0000', 'last_change': '2023-07-14T11:19:22.946542+0000', 'last_active': '2023-07-14T11:19:22.930757+0000', 'last_peered': '2023-07-14T11:19:22.930757+0000', 'last_clean': '2023-07-14T11:19:22.930757+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:19:22.946542+0000', 'last_undegraded': '2023-07-14T11:19:22.946542+0000', 'last_fullsized': '2023-07-14T11:19:22.946542+0000', 'mapping_epoch': 103, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 103, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:19:22.930757+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:19:22.930757+0000', 'last_clean_scrub_stamp': '2023-07-14T11:19:22.930757+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-14T11:19:30.296 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.6 is not active+clean 2023-07-14T11:19:30.297 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:19:23.938624+0000', 'last_change': '2023-07-14T11:19:23.938624+0000', 'last_active': '2023-07-14T11:19:23.938624+0000', 'last_peered': '2023-07-14T11:19:23.938624+0000', 'last_clean': '2023-07-14T11:19:23.938624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:19:23.938624+0000', 'last_undegraded': '2023-07-14T11:19:23.938624+0000', 'last_fullsized': '2023-07-14T11:19:23.938624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:19:23.938624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:19:23.938624+0000', 'last_clean_scrub_stamp': '2023-07-14T11:19:23.938624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:19:30.297 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.5 is not active+clean 2023-07-14T11:19:30.297 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 103, 'state': 'creating+peering', 'last_fresh': '2023-07-14T11:19:22.946466+0000', 'last_change': '2023-07-14T11:19:22.946466+0000', 'last_active': '2023-07-14T11:19:22.930757+0000', 'last_peered': '2023-07-14T11:19:22.930757+0000', 'last_clean': '2023-07-14T11:19:22.930757+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:19:22.946466+0000', 'last_undegraded': '2023-07-14T11:19:22.946466+0000', 'last_fullsized': '2023-07-14T11:19:22.946466+0000', 'mapping_epoch': 103, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 103, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:19:22.930757+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:19:22.930757+0000', 'last_clean_scrub_stamp': '2023-07-14T11:19:22.930757+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-14T11:19:30.298 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1 is not active+clean 2023-07-14T11:19:30.298 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:19:23.938624+0000', 'last_change': '2023-07-14T11:19:23.938624+0000', 'last_active': '2023-07-14T11:19:23.938624+0000', 'last_peered': '2023-07-14T11:19:23.938624+0000', 'last_clean': '2023-07-14T11:19:23.938624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:19:23.938624+0000', 'last_undegraded': '2023-07-14T11:19:23.938624+0000', 'last_fullsized': '2023-07-14T11:19:23.938624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:19:23.938624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:19:23.938624+0000', 'last_clean_scrub_stamp': '2023-07-14T11:19:23.938624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:19:30.299 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.2 is not active+clean 2023-07-14T11:19:30.299 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:19:23.938624+0000', 'last_change': '2023-07-14T11:19:23.938624+0000', 'last_active': '2023-07-14T11:19:23.938624+0000', 'last_peered': '2023-07-14T11:19:23.938624+0000', 'last_clean': '2023-07-14T11:19:23.938624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:19:23.938624+0000', 'last_undegraded': '2023-07-14T11:19:23.938624+0000', 'last_fullsized': '2023-07-14T11:19:23.938624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:19:23.938624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:19:23.938624+0000', 'last_clean_scrub_stamp': '2023-07-14T11:19:23.938624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:19:30.299 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.0 is not active+clean 2023-07-14T11:19:30.299 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 103, 'state': 'creating+peering', 'last_fresh': '2023-07-14T11:19:22.948552+0000', 'last_change': '2023-07-14T11:19:22.948552+0000', 'last_active': '2023-07-14T11:19:22.930757+0000', 'last_peered': '2023-07-14T11:19:22.930757+0000', 'last_clean': '2023-07-14T11:19:22.930757+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:19:22.948552+0000', 'last_undegraded': '2023-07-14T11:19:22.948552+0000', 'last_fullsized': '2023-07-14T11:19:22.948552+0000', 'mapping_epoch': 103, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 103, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:19:22.930757+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:19:22.930757+0000', 'last_clean_scrub_stamp': '2023-07-14T11:19:22.930757+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T11:19:30.300 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.14 is not active+clean 2023-07-14T11:19:30.300 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 103, 'state': 'creating+peering', 'last_fresh': '2023-07-14T11:19:22.947747+0000', 'last_change': '2023-07-14T11:19:22.947747+0000', 'last_active': '2023-07-14T11:19:22.930757+0000', 'last_peered': '2023-07-14T11:19:22.930757+0000', 'last_clean': '2023-07-14T11:19:22.930757+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:19:22.947747+0000', 'last_undegraded': '2023-07-14T11:19:22.947747+0000', 'last_fullsized': '2023-07-14T11:19:22.947747+0000', 'mapping_epoch': 103, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 103, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:19:22.930757+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:19:22.930757+0000', 'last_clean_scrub_stamp': '2023-07-14T11:19:22.930757+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T11:19:30.301 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.16 is not active+clean 2023-07-14T11:19:30.301 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:19:23.938624+0000', 'last_change': '2023-07-14T11:19:23.938624+0000', 'last_active': '2023-07-14T11:19:23.938624+0000', 'last_peered': '2023-07-14T11:19:23.938624+0000', 'last_clean': '2023-07-14T11:19:23.938624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:19:23.938624+0000', 'last_undegraded': '2023-07-14T11:19:23.938624+0000', 'last_fullsized': '2023-07-14T11:19:23.938624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:19:23.938624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:19:23.938624+0000', 'last_clean_scrub_stamp': '2023-07-14T11:19:23.938624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:19:30.302 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.10 is not active+clean 2023-07-14T11:19:30.302 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:19:23.938624+0000', 'last_change': '2023-07-14T11:19:23.938624+0000', 'last_active': '2023-07-14T11:19:23.938624+0000', 'last_peered': '2023-07-14T11:19:23.938624+0000', 'last_clean': '2023-07-14T11:19:23.938624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:19:23.938624+0000', 'last_undegraded': '2023-07-14T11:19:23.938624+0000', 'last_fullsized': '2023-07-14T11:19:23.938624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:19:23.938624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:19:23.938624+0000', 'last_clean_scrub_stamp': '2023-07-14T11:19:23.938624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:19:30.302 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.13 is not active+clean 2023-07-14T11:19:30.303 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 103, 'state': 'creating+peering', 'last_fresh': '2023-07-14T11:19:22.947360+0000', 'last_change': '2023-07-14T11:19:22.947360+0000', 'last_active': '2023-07-14T11:19:22.930757+0000', 'last_peered': '2023-07-14T11:19:22.930757+0000', 'last_clean': '2023-07-14T11:19:22.930757+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:19:22.947360+0000', 'last_undegraded': '2023-07-14T11:19:22.947360+0000', 'last_fullsized': '2023-07-14T11:19:22.947360+0000', 'mapping_epoch': 103, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 103, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:19:22.930757+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:19:22.930757+0000', 'last_clean_scrub_stamp': '2023-07-14T11:19:22.930757+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T11:19:30.303 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.13 is not active+clean 2023-07-14T11:19:30.303 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:19:23.938624+0000', 'last_change': '2023-07-14T11:19:23.938624+0000', 'last_active': '2023-07-14T11:19:23.938624+0000', 'last_peered': '2023-07-14T11:19:23.938624+0000', 'last_clean': '2023-07-14T11:19:23.938624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:19:23.938624+0000', 'last_undegraded': '2023-07-14T11:19:23.938624+0000', 'last_fullsized': '2023-07-14T11:19:23.938624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:19:23.938624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:19:23.938624+0000', 'last_clean_scrub_stamp': '2023-07-14T11:19:23.938624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:19:30.304 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.10 is not active+clean 2023-07-14T11:19:30.304 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 103, 'state': 'creating+peering', 'last_fresh': '2023-07-14T11:19:22.945755+0000', 'last_change': '2023-07-14T11:19:22.945755+0000', 'last_active': '2023-07-14T11:19:22.930757+0000', 'last_peered': '2023-07-14T11:19:22.930757+0000', 'last_clean': '2023-07-14T11:19:22.930757+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:19:22.945755+0000', 'last_undegraded': '2023-07-14T11:19:22.945755+0000', 'last_fullsized': '2023-07-14T11:19:22.945755+0000', 'mapping_epoch': 103, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 103, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:19:22.930757+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:19:22.930757+0000', 'last_clean_scrub_stamp': '2023-07-14T11:19:22.930757+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T11:19:30.304 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.12 is not active+clean 2023-07-14T11:19:30.305 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 103, 'state': 'creating+peering', 'last_fresh': '2023-07-14T11:19:22.947609+0000', 'last_change': '2023-07-14T11:19:22.947609+0000', 'last_active': '2023-07-14T11:19:22.930757+0000', 'last_peered': '2023-07-14T11:19:22.930757+0000', 'last_clean': '2023-07-14T11:19:22.930757+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:19:22.947609+0000', 'last_undegraded': '2023-07-14T11:19:22.947609+0000', 'last_fullsized': '2023-07-14T11:19:22.947609+0000', 'mapping_epoch': 103, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 103, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:19:22.930757+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:19:22.930757+0000', 'last_clean_scrub_stamp': '2023-07-14T11:19:22.930757+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T11:19:30.305 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.11 is not active+clean 2023-07-14T11:19:30.305 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 103, 'state': 'creating+peering', 'last_fresh': '2023-07-14T11:19:22.947503+0000', 'last_change': '2023-07-14T11:19:22.947503+0000', 'last_active': '2023-07-14T11:19:22.930757+0000', 'last_peered': '2023-07-14T11:19:22.930757+0000', 'last_clean': '2023-07-14T11:19:22.930757+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:19:22.947503+0000', 'last_undegraded': '2023-07-14T11:19:22.947503+0000', 'last_fullsized': '2023-07-14T11:19:22.947503+0000', 'mapping_epoch': 103, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 103, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:19:22.930757+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:19:22.930757+0000', 'last_clean_scrub_stamp': '2023-07-14T11:19:22.930757+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T11:19:30.306 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.14 is not active+clean 2023-07-14T11:19:30.306 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T11:19:23.938624+0000', 'last_change': '2023-07-14T11:19:23.938624+0000', 'last_active': '2023-07-14T11:19:23.938624+0000', 'last_peered': '2023-07-14T11:19:23.938624+0000', 'last_clean': '2023-07-14T11:19:23.938624+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:19:23.938624+0000', 'last_undegraded': '2023-07-14T11:19:23.938624+0000', 'last_fullsized': '2023-07-14T11:19:23.938624+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:19:23.938624+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:19:23.938624+0000', 'last_clean_scrub_stamp': '2023-07-14T11:19:23.938624+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T11:19:30.306 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.17 is not active+clean 2023-07-14T11:19:30.307 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 103, 'state': 'creating+peering', 'last_fresh': '2023-07-14T11:19:22.946805+0000', 'last_change': '2023-07-14T11:19:22.946805+0000', 'last_active': '2023-07-14T11:19:22.930757+0000', 'last_peered': '2023-07-14T11:19:22.930757+0000', 'last_clean': '2023-07-14T11:19:22.930757+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T11:19:22.946805+0000', 'last_undegraded': '2023-07-14T11:19:22.946805+0000', 'last_fullsized': '2023-07-14T11:19:22.946805+0000', 'mapping_epoch': 103, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 103, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T11:19:22.930757+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T11:19:22.930757+0000', 'last_clean_scrub_stamp': '2023-07-14T11:19:22.930757+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-14T11:19:30.307 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-07-14T11:19:30.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.505+0000 7f48bb1ff700 1 Processor -- start 2023-07-14T11:19:30.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.506+0000 7f48bb1ff700 1 -- start start 2023-07-14T11:19:30.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.507+0000 7f48bb1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48b40b5d90 0x7f48b40b6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:30.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.507+0000 7f48bb1ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f48b40d0b10 0x7f48b40d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:30.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.507+0000 7f48bb1ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48b40b7f50 con 0x7f48b40b4510 2023-07-14T11:19:30.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.507+0000 7f48bb1ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48b40b48e0 con 0x7f48b40d0b10 2023-07-14T11:19:30.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.507+0000 7f48bb1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48b40d14d0 con 0x7f48b40b5d90 2023-07-14T11:19:30.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.507+0000 7f48b979c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f48b40d0b10 0x7f48b40d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:30.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.507+0000 7f48b979c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f48b40d0b10 0x7f48b40d0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40768/0 (socket says 172.21.15.84:40768) 2023-07-14T11:19:30.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.507+0000 7f48b979c700 1 -- 172.21.15.84:0/2995376754 learned_addr learned my addr 172.21.15.84:0/2995376754 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:30.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.507+0000 7f48b3fff700 1 --2- 172.21.15.84:0/2995376754 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48b40b5d90 0x7f48b40b6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:30.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.507+0000 7f48b979c700 1 -- 172.21.15.84:0/2995376754 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48b40b5d90 msgr2=0x7f48b40b6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:30.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.507+0000 7f48b979c700 1 --2- 172.21.15.84:0/2995376754 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48b40b5d90 0x7f48b40b6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:30.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.507+0000 7f48b979c700 1 -- 172.21.15.84:0/2995376754 >> v1:172.21.15.179:6789/0 conn(0x7f48b40b4510 legacy=0x7f48b40cd590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:30.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.507+0000 7f48b979c700 1 -- 172.21.15.84:0/2995376754 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b40cdca0 con 0x7f48b40d0b10 2023-07-14T11:19:30.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.508+0000 7f48b979c700 1 --2- 172.21.15.84:0/2995376754 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48b40d0b10 0x7f48b40d0f90 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f48ac009e50 tx=0x7f48ac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa321caf772dec01 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:30.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.508+0000 7f48b37fe700 1 -- 172.21.15.84:0/2995376754 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ac00e070 con 0x7f48b40d0b10 2023-07-14T11:19:30.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.508+0000 7f48b37fe700 1 -- 172.21.15.84:0/2995376754 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48ac00b9c0 con 0x7f48b40d0b10 2023-07-14T11:19:30.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.508+0000 7f48b37fe700 1 -- 172.21.15.84:0/2995376754 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ac00bd70 con 0x7f48b40d0b10 2023-07-14T11:19:30.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.508+0000 7f48bb1ff700 1 -- 172.21.15.84:0/2995376754 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48b40d0b10 msgr2=0x7f48b40d0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:30.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.508+0000 7f48bb1ff700 1 --2- 172.21.15.84:0/2995376754 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48b40d0b10 0x7f48b40d0f90 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f48ac009e50 tx=0x7f48ac00b330 comp rx=0 tx=0).stop 2023-07-14T11:19:30.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.509+0000 7f48bb1ff700 1 -- 172.21.15.84:0/2995376754 shutdown_connections 2023-07-14T11:19:30.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.509+0000 7f48bb1ff700 1 --2- 172.21.15.84:0/2995376754 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48b40d0b10 0x7f48b40d0f90 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:30.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.509+0000 7f48bb1ff700 1 --2- 172.21.15.84:0/2995376754 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48b40b5d90 0x7f48b40b6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:30.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.509+0000 7f48bb1ff700 1 -- 172.21.15.84:0/2995376754 >> 172.21.15.84:0/2995376754 conn(0x7f48b409c1d0 msgr2=0x7f48b40d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:30.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.509+0000 7f48bb1ff700 1 -- 172.21.15.84:0/2995376754 shutdown_connections 2023-07-14T11:19:30.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.509+0000 7f48bb1ff700 1 -- 172.21.15.84:0/2995376754 wait complete. 2023-07-14T11:19:30.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.510+0000 7f48bb1ff700 1 Processor -- start 2023-07-14T11:19:30.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.510+0000 7f48bb1ff700 1 -- start start 2023-07-14T11:19:30.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.511+0000 7f48bb1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48b40b4510 0x7f48b415a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:30.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.511+0000 7f48bb1ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48b40b5d90 0x7f48b40cf880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:30.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.511+0000 7f48bb1ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48b40d0b10 0x7f48b40cfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:30.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.511+0000 7f48bb1ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b40cc9f0 con 0x7f48b40b5d90 2023-07-14T11:19:30.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.511+0000 7f48bb1ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b40c8c50 con 0x7f48b40d0b10 2023-07-14T11:19:30.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.511+0000 7f48bb1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48b40c7bb0 con 0x7f48b40b4510 2023-07-14T11:19:30.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.512+0000 7f48b3fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48b40b5d90 0x7f48b40cf880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:30.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.512+0000 7f48b3fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48b40b5d90 0x7f48b40cf880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40770/0 (socket says 172.21.15.84:40770) 2023-07-14T11:19:30.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.512+0000 7f48b3fff700 1 -- 172.21.15.84:0/1601227302 learned_addr learned my addr 172.21.15.84:0/1601227302 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:30.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.512+0000 7f48b979c700 1 --2- 172.21.15.84:0/1601227302 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48b40d0b10 0x7f48b40cfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:30.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.512+0000 7f48b8f9b700 1 --2- 172.21.15.84:0/1601227302 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48b40b4510 0x7f48b415a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:30.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.512+0000 7f48b3fff700 1 -- 172.21.15.84:0/1601227302 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48b40b4510 msgr2=0x7f48b415a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:30.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.512+0000 7f48b3fff700 1 --2- 172.21.15.84:0/1601227302 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48b40b4510 0x7f48b415a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:30.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.512+0000 7f48b3fff700 1 -- 172.21.15.84:0/1601227302 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48b40d0b10 msgr2=0x7f48b40cfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:30.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.512+0000 7f48b3fff700 1 --2- 172.21.15.84:0/1601227302 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48b40d0b10 0x7f48b40cfdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:30.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.512+0000 7f48b3fff700 1 -- 172.21.15.84:0/1601227302 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48ac009b30 con 0x7f48b40b5d90 2023-07-14T11:19:30.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.512+0000 7f48b979c700 1 --2- 172.21.15.84:0/1601227302 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48b40d0b10 0x7f48b40cfdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:19:30.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.512+0000 7f48b3fff700 1 --2- 172.21.15.84:0/1601227302 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48b40b5d90 0x7f48b40cf880 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f48a000e840 tx=0x7f48a000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:30.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.512+0000 7f48b17fa700 1 -- 172.21.15.84:0/1601227302 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a0013610 con 0x7f48b40b5d90 2023-07-14T11:19:30.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.513+0000 7f48b17fa700 1 -- 172.21.15.84:0/1601227302 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48a0013770 con 0x7f48b40b5d90 2023-07-14T11:19:30.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.513+0000 7f48b17fa700 1 -- 172.21.15.84:0/1601227302 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a0013b20 con 0x7f48b40b5d90 2023-07-14T11:19:30.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.513+0000 7f48bb1ff700 1 -- 172.21.15.84:0/1601227302 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48b40c7e90 con 0x7f48b40b5d90 2023-07-14T11:19:30.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.513+0000 7f48bb1ff700 1 -- 172.21.15.84:0/1601227302 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48b40c8450 con 0x7f48b40b5d90 2023-07-14T11:19:30.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.514+0000 7f48bb1ff700 1 -- 172.21.15.84:0/1601227302 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48b40c8aa0 con 0x7f48b40b5d90 2023-07-14T11:19:30.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.515+0000 7f48b17fa700 1 -- 172.21.15.84:0/1601227302 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f48a0013c80 con 0x7f48b40b5d90 2023-07-14T11:19:30.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.516+0000 7f48b17fa700 1 --2- 172.21.15.84:0/1601227302 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f489806ae00 0x7f489806d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:30.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.516+0000 7f48b17fa700 1 -- 172.21.15.84:0/1601227302 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f48a0089400 con 0x7f48b40b5d90 2023-07-14T11:19:30.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.516+0000 7f48b8f9b700 1 --2- 172.21.15.84:0/1601227302 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f489806ae00 0x7f489806d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:30.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.517+0000 7f48b8f9b700 1 --2- 172.21.15.84:0/1601227302 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f489806ae00 0x7f489806d2b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f48b41f53e0 tx=0x7f48a8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:30.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.519+0000 7f48b17fa700 1 -- 172.21.15.84:0/1601227302 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f48a00541f0 con 0x7f48b40b5d90 2023-07-14T11:19:30.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.789+0000 7f48bb1ff700 1 -- 172.21.15.84:0/1601227302 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f48b404e280 con 0x7f48b40b5d90 2023-07-14T11:19:30.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.790+0000 7f48b17fa700 1 -- 172.21.15.84:0/1601227302 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1885 (secure 0 0 0) 0x7f48a0057810 con 0x7f48b40b5d90 2023-07-14T11:19:30.793 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:19:30.793 INFO:teuthology.orchestra.run.smithi084.stdout:{"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":403,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":106,"num_osds":8,"num_up_osds":8,"osd_up_since":1689333179,"num_in_osds":8,"osd_in_since":1689333170,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":66},{"state_name":"unknown","count":23},{"state_name":"creating+peering","count":16}],"num_pgs":105,"num_pools":4,"num_objects":9,"data_bytes":590480,"bytes_used":236642304,"bytes_avail":772857470976,"bytes_total":773094113280,"unknown_pgs_ratio":0.21904762089252472,"inactive_pgs_ratio":0.15238095819950104,"write_bytes_sec":341,"read_op_per_sec":0,"write_op_per_sec":2},"fsmap":{"epoch":69,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"c","status":"up:active","gid":7683}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":11,"modified":"2023-07-14T11:19:24.936818+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mgr":{"daemons":{"summary":"","y":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-07-14T11:19:30.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.792+0000 7f48bb1ff700 1 -- 172.21.15.84:0/1601227302 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f489806ae00 msgr2=0x7f489806d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:30.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.792+0000 7f48bb1ff700 1 --2- 172.21.15.84:0/1601227302 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f489806ae00 0x7f489806d2b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f48b41f53e0 tx=0x7f48a8009040 comp rx=0 tx=0).stop 2023-07-14T11:19:30.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.792+0000 7f48bb1ff700 1 -- 172.21.15.84:0/1601227302 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48b40b5d90 msgr2=0x7f48b40cf880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:30.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.792+0000 7f48bb1ff700 1 --2- 172.21.15.84:0/1601227302 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48b40b5d90 0x7f48b40cf880 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f48a000e840 tx=0x7f48a000ec00 comp rx=0 tx=0).stop 2023-07-14T11:19:30.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.793+0000 7f48bb1ff700 1 -- 172.21.15.84:0/1601227302 shutdown_connections 2023-07-14T11:19:30.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.793+0000 7f48bb1ff700 1 --2- 172.21.15.84:0/1601227302 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f489806ae00 0x7f489806d2b0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:30.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.793+0000 7f48bb1ff700 1 --2- 172.21.15.84:0/1601227302 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48b40b4510 0x7f48b415a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:30.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.793+0000 7f48bb1ff700 1 --2- 172.21.15.84:0/1601227302 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48b40d0b10 0x7f48b40cfdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:30.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.793+0000 7f48bb1ff700 1 --2- 172.21.15.84:0/1601227302 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48b40b5d90 0x7f48b40cf880 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:30.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.793+0000 7f48bb1ff700 1 -- 172.21.15.84:0/1601227302 >> 172.21.15.84:0/1601227302 conn(0x7f48b409c1d0 msgr2=0x7f48b406b880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:30.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.793+0000 7f48bb1ff700 1 -- 172.21.15.84:0/1601227302 shutdown_connections 2023-07-14T11:19:30.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:30.793+0000 7f48bb1ff700 1 -- 172.21.15.84:0/1601227302 wait complete. 2023-07-14T11:19:30.814 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-07-14T11:19:30.814 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T11:19:30.929 INFO:tasks.ceph.mds.c.smithi084.stderr:2023-07-14T11:19:30.926+0000 7fbc6ddf1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-14T11:19:31.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:31.008+0000 7f97811ff700 1 Processor -- start 2023-07-14T11:19:31.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:31.009+0000 7f97811ff700 1 -- start start 2023-07-14T11:19:31.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:31.010+0000 7f97811ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f977c15c950 0x7f977c0b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:31.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:31.010+0000 7f97811ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f977c0b1e00 0x7f977c0d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:31.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:31.010+0000 7f97811ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f977c0d2ce0 con 0x7f977c0b2350 2023-07-14T11:19:31.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:31.010+0000 7f97811ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f977c0b3350 con 0x7f977c15c950 2023-07-14T11:19:31.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:31.010+0000 7f97811ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f977c0b3630 con 0x7f977c0b1e00 2023-07-14T11:19:31.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:31.010+0000 7f977b59e700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f977c0b2350 0x7f977c0afac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55408/0 (socket says 172.21.15.84:55408) 2023-07-14T11:19:31.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:31.010+0000 7f977b59e700 1 -- 172.21.15.84:0/3969541565 learned_addr learned my addr 172.21.15.84:0/3969541565 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:19:31.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:31.010+0000 7f977ad9d700 1 --2- 172.21.15.84:0/3969541565 >> v2:172.21.15.179:3300/0 conn(0x7f977c15c950 0x7f977c0b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:31.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:31.010+0000 7f9773fff700 1 --2- 172.21.15.84:0/3969541565 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f977c0b1e00 0x7f977c0d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:31.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:31.010+0000 7f977a59c700 1 -- 172.21.15.84:0/3969541565 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1281888314 0 0) 0x7f977c0d2ce0 con 0x7f977c0b2350 2023-07-14T11:19:31.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:31.011+0000 7f977a59c700 1 -- 172.21.15.84:0/3969541565 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97680035b0 con 0x7f977c0b2350 2023-07-14T11:19:31.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:31.011+0000 7f977ad9d700 1 -- 172.21.15.84:0/3969541565 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f977c0b1e00 msgr2=0x7f977c0d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:31.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:31.011+0000 7f977ad9d700 1 --2- 172.21.15.84:0/3969541565 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f977c0b1e00 0x7f977c0d0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:31.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:31.011+0000 7f977ad9d700 1 -- 172.21.15.84:0/3969541565 >> v1:172.21.15.84:6789/0 conn(0x7f977c0b2350 legacy=0x7f977c0afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:31.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:31.011+0000 7f977ad9d700 1 -- 172.21.15.84:0/3969541565 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f977c0b3910 con 0x7f977c15c950 2023-07-14T11:19:31.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:31.011+0000 7f977ad9d700 1 --2- 172.21.15.84:0/3969541565 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f977c15c950 0x7f977c0b43f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f976c009820 tx=0x7f976c009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b0c61b92797901d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:31.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:31.011+0000 7f977a59c700 1 -- 172.21.15.84:0/3969541565 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976c005e30 con 0x7f977c15c950 2023-07-14T11:19:31.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:31.011+0000 7f977a59c700 1 -- 172.21.15.84:0/3969541565 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f976c006030 con 0x7f977c15c950 2023-07-14T11:19:31.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:31.011+0000 7f977a59c700 1 -- 172.21.15.84:0/3969541565 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976c0063a0 con 0x7f977c15c950 2023-07-14T11:19:31.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:31.012+0000 7f97811ff700 1 -- 172.21.15.84:0/3969541565 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f977c15c950 msgr2=0x7f977c0b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:31.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:31.012+0000 7f97811ff700 1 --2- 172.21.15.84:0/3969541565 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f977c15c950 0x7f977c0b43f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f976c009820 tx=0x7f976c009b30 comp rx=0 tx=0).stop 2023-07-14T11:19:31.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:31.012+0000 7f97811ff700 1 -- 172.21.15.84:0/3969541565 shutdown_connections 2023-07-14T11:19:31.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:31.012+0000 7f97811ff700 1 --2- 172.21.15.84:0/3969541565 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f977c15c950 0x7f977c0b43f0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:31.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:31.012+0000 7f97811ff700 1 --2- 172.21.15.84:0/3969541565 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f977c0b1e00 0x7f977c0d0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:31.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:31.012+0000 7f97811ff700 1 -- 172.21.15.84:0/3969541565 >> 172.21.15.84:0/3969541565 conn(0x7f977c09c1d0 msgr2=0x7f977c0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:31.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:31.012+0000 7f97811ff700 1 -- 172.21.15.84:0/3969541565 shutdown_connections 2023-07-14T11:19:31.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:31.012+0000 7f97811ff700 1 -- 172.21.15.84:0/3969541565 wait complete. 2023-07-14T11:19:31.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:31.014+0000 7f97811ff700 1 Processor -- start 2023-07-14T11:19:31.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:31.014+0000 7f97811ff700 1 -- start start 2023-07-14T11:19:31.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:31.015+0000 7f97811ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f977c0b1e00 0x7f977c0c94e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:31.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:31.015+0000 7f97811ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f977c0b2350 0x7f977c14c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:31.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:31.015+0000 7f97811ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f977c15c950 0x7f977c0b42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:31.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:31.015+0000 7f97811ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977c1e4400 con 0x7f977c0b1e00 2023-07-14T11:19:31.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:31.015+0000 7f97811ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977c1e46e0 con 0x7f977c0b2350 2023-07-14T11:19:31.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:31.015+0000 7f97811ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f977c1e49c0 con 0x7f977c15c950 2023-07-14T11:19:31.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:31.015+0000 7f977ad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f977c0b1e00 0x7f977c0c94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:31.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:31.015+0000 7f977ad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f977c0b1e00 0x7f977c0c94e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40778/0 (socket says 172.21.15.84:40778) 2023-07-14T11:19:31.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:31.015+0000 7f977ad9d700 1 -- 172.21.15.84:0/3980474672 learned_addr learned my addr 172.21.15.84:0/3980474672 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:31.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:31.015+0000 7f9773fff700 1 --2- 172.21.15.84:0/3980474672 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f977c0b2350 0x7f977c14c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:31.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:31.015+0000 7f977b59e700 1 --2- 172.21.15.84:0/3980474672 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f977c15c950 0x7f977c0b42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:31.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:31.016+0000 7f977ad9d700 1 -- 172.21.15.84:0/3980474672 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f977c15c950 msgr2=0x7f977c0b42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:31.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:31.016+0000 7f977ad9d700 1 --2- 172.21.15.84:0/3980474672 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f977c15c950 0x7f977c0b42f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:31.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:31.016+0000 7f977ad9d700 1 -- 172.21.15.84:0/3980474672 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f977c0b2350 msgr2=0x7f977c14c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:31.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:31.016+0000 7f977ad9d700 1 --2- 172.21.15.84:0/3980474672 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f977c0b2350 0x7f977c14c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:31.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:31.016+0000 7f977ad9d700 1 -- 172.21.15.84:0/3980474672 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f976c009430 con 0x7f977c0b1e00 2023-07-14T11:19:31.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:31.016+0000 7f977ad9d700 1 --2- 172.21.15.84:0/3980474672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f977c0b1e00 0x7f977c0c94e0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f976c000c00 tx=0x7f976c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:31.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:31.016+0000 7f97737fe700 1 -- 172.21.15.84:0/3980474672 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976c0065b0 con 0x7f977c0b1e00 2023-07-14T11:19:31.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:31.016+0000 7f97737fe700 1 -- 172.21.15.84:0/3980474672 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f976c006710 con 0x7f977c0b1e00 2023-07-14T11:19:31.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:31.016+0000 7f97811ff700 1 -- 172.21.15.84:0/3980474672 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f977c1e4ca0 con 0x7f977c0b1e00 2023-07-14T11:19:31.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:31.016+0000 7f97737fe700 1 -- 172.21.15.84:0/3980474672 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976c0036a0 con 0x7f977c0b1e00 2023-07-14T11:19:31.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:31.016+0000 7f97811ff700 1 -- 172.21.15.84:0/3980474672 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f977c0c9a20 con 0x7f977c0b1e00 2023-07-14T11:19:31.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:31.017+0000 7f97811ff700 1 -- 172.21.15.84:0/3980474672 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f977c0b50c0 con 0x7f977c0b1e00 2023-07-14T11:19:31.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:31.018+0000 7f97737fe700 1 -- 172.21.15.84:0/3980474672 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f976c022070 con 0x7f977c0b1e00 2023-07-14T11:19:31.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:31.020+0000 7f97737fe700 1 --2- 172.21.15.84:0/3980474672 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f975c06ae00 0x7f975c06d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:31.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:31.020+0000 7f97737fe700 1 -- 172.21.15.84:0/3980474672 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f976c08ada0 con 0x7f977c0b1e00 2023-07-14T11:19:31.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:31.020+0000 7f9773fff700 1 --2- 172.21.15.84:0/3980474672 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f975c06ae00 0x7f975c06d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:31.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:31.021+0000 7f9773fff700 1 --2- 172.21.15.84:0/3980474672 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f975c06ae00 0x7f975c06d2b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f977c1e3200 tx=0x7f9764008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:31.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:31.024+0000 7f97737fe700 1 -- 172.21.15.84:0/3980474672 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f976c055d30 con 0x7f977c0b1e00 2023-07-14T11:19:31.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:31.212+0000 7f97811ff700 1 -- 172.21.15.84:0/3980474672 --> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f977c1e4850 con 0x7f975c06ae00 2023-07-14T11:19:31.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:31.222+0000 7f97737fe700 1 -- 172.21.15.84:0/3980474672 <== mgr.4100 v2:172.21.15.179:6836/2094253834 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311357 (secure 0 0 0) 0x7f977c1e4850 con 0x7f975c06ae00 2023-07-14T11:19:31.228 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:19:31.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:31.227+0000 7f97811ff700 1 -- 172.21.15.84:0/3980474672 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f975c06ae00 msgr2=0x7f975c06d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:31.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:31.227+0000 7f97811ff700 1 --2- 172.21.15.84:0/3980474672 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f975c06ae00 0x7f975c06d2b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f977c1e3200 tx=0x7f9764008040 comp rx=0 tx=0).stop 2023-07-14T11:19:31.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:31.227+0000 7f97811ff700 1 -- 172.21.15.84:0/3980474672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f977c0b1e00 msgr2=0x7f977c0c94e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:31.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:31.227+0000 7f97811ff700 1 --2- 172.21.15.84:0/3980474672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f977c0b1e00 0x7f977c0c94e0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f976c000c00 tx=0x7f976c004750 comp rx=0 tx=0).stop 2023-07-14T11:19:31.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:31.227+0000 7f97811ff700 1 -- 172.21.15.84:0/3980474672 shutdown_connections 2023-07-14T11:19:31.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:31.227+0000 7f97811ff700 1 --2- 172.21.15.84:0/3980474672 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f975c06ae00 0x7f975c06d2b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:31.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:31.227+0000 7f97811ff700 1 --2- 172.21.15.84:0/3980474672 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f977c15c950 0x7f977c0b42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:31.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:31.227+0000 7f97811ff700 1 --2- 172.21.15.84:0/3980474672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f977c0b1e00 0x7f977c0c94e0 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:31.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:31.227+0000 7f97811ff700 1 --2- 172.21.15.84:0/3980474672 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f977c0b2350 0x7f977c14c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:31.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:31.227+0000 7f97811ff700 1 -- 172.21.15.84:0/3980474672 >> 172.21.15.84:0/3980474672 conn(0x7f977c09c1d0 msgr2=0x7f977c0b0670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:31.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:31.227+0000 7f97811ff700 1 -- 172.21.15.84:0/3980474672 shutdown_connections 2023-07-14T11:19:31.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:31.227+0000 7f97811ff700 1 -- 172.21.15.84:0/3980474672 wait complete. 2023-07-14T11:19:31.232 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-07-14T11:19:31.247 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":68,"stamp":"2023-07-14T11:19:30.938419+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":223,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":166,"ondisk_log_size":166,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":187,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231240,"kb_used_data":11528,"kb_used_omap":0,"kb_used_meta":219648,"kb_avail":754743480,"statfs":{"total":773094113280,"available":772857323520,"internally_reserved":0,"allocated":11804672,"data_stored":6077612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":224919552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.990560"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967358+0000","last_change":"2023-07-14T11:19:24.976160+0000","last_active":"2023-07-14T11:19:25.967358+0000","last_peered":"2023-07-14T11:19:25.967358+0000","last_clean":"2023-07-14T11:19:25.967358+0000","last_became_active":"2023-07-14T11:19:24.975861+0000","last_became_peered":"2023-07-14T11:19:24.975861+0000","last_unstale":"2023-07-14T11:19:25.967358+0000","last_undegraded":"2023-07-14T11:19:25.967358+0000","last_fullsized":"2023-07-14T11:19:25.967358+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:52:51.076969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.399879+0000","last_change":"2023-07-14T11:19:24.979084+0000","last_active":"2023-07-14T11:19:27.399879+0000","last_peered":"2023-07-14T11:19:27.399879+0000","last_clean":"2023-07-14T11:19:27.399879+0000","last_became_active":"2023-07-14T11:19:24.978793+0000","last_became_peered":"2023-07-14T11:19:24.978793+0000","last_unstale":"2023-07-14T11:19:27.399879+0000","last_undegraded":"2023-07-14T11:19:27.399879+0000","last_fullsized":"2023-07-14T11:19:27.399879+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:24:25.883979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400493+0000","last_change":"2023-07-14T11:19:24.974510+0000","last_active":"2023-07-14T11:19:27.400493+0000","last_peered":"2023-07-14T11:19:27.400493+0000","last_clean":"2023-07-14T11:19:27.400493+0000","last_became_active":"2023-07-14T11:19:24.974190+0000","last_became_peered":"2023-07-14T11:19:24.974190+0000","last_unstale":"2023-07-14T11:19:27.400493+0000","last_undegraded":"2023-07-14T11:19:27.400493+0000","last_fullsized":"2023-07-14T11:19:27.400493+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:16:14.096108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400652+0000","last_change":"2023-07-14T11:19:24.988874+0000","last_active":"2023-07-14T11:19:27.400652+0000","last_peered":"2023-07-14T11:19:27.400652+0000","last_clean":"2023-07-14T11:19:27.400652+0000","last_became_active":"2023-07-14T11:19:24.988026+0000","last_became_peered":"2023-07-14T11:19:24.988026+0000","last_unstale":"2023-07-14T11:19:27.400652+0000","last_undegraded":"2023-07-14T11:19:27.400652+0000","last_fullsized":"2023-07-14T11:19:27.400652+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:42:21.619441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967158+0000","last_change":"2023-07-14T11:19:24.975419+0000","last_active":"2023-07-14T11:19:25.967158+0000","last_peered":"2023-07-14T11:19:25.967158+0000","last_clean":"2023-07-14T11:19:25.967158+0000","last_became_active":"2023-07-14T11:19:24.975150+0000","last_became_peered":"2023-07-14T11:19:24.975150+0000","last_unstale":"2023-07-14T11:19:25.967158+0000","last_undegraded":"2023-07-14T11:19:25.967158+0000","last_fullsized":"2023-07-14T11:19:25.967158+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:06:39.320547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400149+0000","last_change":"2023-07-14T11:19:24.980389+0000","last_active":"2023-07-14T11:19:27.400149+0000","last_peered":"2023-07-14T11:19:27.400149+0000","last_clean":"2023-07-14T11:19:27.400149+0000","last_became_active":"2023-07-14T11:19:24.980134+0000","last_became_peered":"2023-07-14T11:19:24.980134+0000","last_unstale":"2023-07-14T11:19:27.400149+0000","last_undegraded":"2023-07-14T11:19:27.400149+0000","last_fullsized":"2023-07-14T11:19:27.400149+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:53:15.231674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400689+0000","last_change":"2023-07-14T11:19:24.980001+0000","last_active":"2023-07-14T11:19:27.400689+0000","last_peered":"2023-07-14T11:19:27.400689+0000","last_clean":"2023-07-14T11:19:27.400689+0000","last_became_active":"2023-07-14T11:19:24.979653+0000","last_became_peered":"2023-07-14T11:19:24.979653+0000","last_unstale":"2023-07-14T11:19:27.400689+0000","last_undegraded":"2023-07-14T11:19:27.400689+0000","last_fullsized":"2023-07-14T11:19:27.400689+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:14:55.889716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.401574+0000","last_change":"2023-07-14T11:19:24.977426+0000","last_active":"2023-07-14T11:19:27.401574+0000","last_peered":"2023-07-14T11:19:27.401574+0000","last_clean":"2023-07-14T11:19:27.401574+0000","last_became_active":"2023-07-14T11:19:24.977139+0000","last_became_peered":"2023-07-14T11:19:24.977139+0000","last_unstale":"2023-07-14T11:19:27.401574+0000","last_undegraded":"2023-07-14T11:19:27.401574+0000","last_fullsized":"2023-07-14T11:19:27.401574+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:06:02.853066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.401069+0000","last_change":"2023-07-14T11:19:24.988772+0000","last_active":"2023-07-14T11:19:27.401069+0000","last_peered":"2023-07-14T11:19:27.401069+0000","last_clean":"2023-07-14T11:19:27.401069+0000","last_became_active":"2023-07-14T11:19:24.988420+0000","last_became_peered":"2023-07-14T11:19:24.988420+0000","last_unstale":"2023-07-14T11:19:27.401069+0000","last_undegraded":"2023-07-14T11:19:27.401069+0000","last_fullsized":"2023-07-14T11:19:27.401069+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:53:46.190423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.964603+0000","last_change":"2023-07-14T11:19:24.986113+0000","last_active":"2023-07-14T11:19:25.964603+0000","last_peered":"2023-07-14T11:19:25.964603+0000","last_clean":"2023-07-14T11:19:25.964603+0000","last_became_active":"2023-07-14T11:19:24.985802+0000","last_became_peered":"2023-07-14T11:19:24.985802+0000","last_unstale":"2023-07-14T11:19:25.964603+0000","last_undegraded":"2023-07-14T11:19:25.964603+0000","last_fullsized":"2023-07-14T11:19:25.964603+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:48:20.004928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.966858+0000","last_change":"2023-07-14T11:19:24.981712+0000","last_active":"2023-07-14T11:19:25.966858+0000","last_peered":"2023-07-14T11:19:25.966858+0000","last_clean":"2023-07-14T11:19:25.966858+0000","last_became_active":"2023-07-14T11:19:24.981417+0000","last_became_peered":"2023-07-14T11:19:24.981417+0000","last_unstale":"2023-07-14T11:19:25.966858+0000","last_undegraded":"2023-07-14T11:19:25.966858+0000","last_fullsized":"2023-07-14T11:19:25.966858+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:52:06.185710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.401119+0000","last_change":"2023-07-14T11:19:24.981753+0000","last_active":"2023-07-14T11:19:27.401119+0000","last_peered":"2023-07-14T11:19:27.401119+0000","last_clean":"2023-07-14T11:19:27.401119+0000","last_became_active":"2023-07-14T11:19:24.980821+0000","last_became_peered":"2023-07-14T11:19:24.980821+0000","last_unstale":"2023-07-14T11:19:27.401119+0000","last_undegraded":"2023-07-14T11:19:27.401119+0000","last_fullsized":"2023-07-14T11:19:27.401119+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:17:28.127989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.964356+0000","last_change":"2023-07-14T11:19:24.969706+0000","last_active":"2023-07-14T11:19:25.964356+0000","last_peered":"2023-07-14T11:19:25.964356+0000","last_clean":"2023-07-14T11:19:25.964356+0000","last_became_active":"2023-07-14T11:19:24.969426+0000","last_became_peered":"2023-07-14T11:19:24.969426+0000","last_unstale":"2023-07-14T11:19:25.964356+0000","last_undegraded":"2023-07-14T11:19:25.964356+0000","last_fullsized":"2023-07-14T11:19:25.964356+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:45:06.308741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400652+0000","last_change":"2023-07-14T11:19:24.972352+0000","last_active":"2023-07-14T11:19:27.400652+0000","last_peered":"2023-07-14T11:19:27.400652+0000","last_clean":"2023-07-14T11:19:27.400652+0000","last_became_active":"2023-07-14T11:19:24.972057+0000","last_became_peered":"2023-07-14T11:19:24.972057+0000","last_unstale":"2023-07-14T11:19:27.400652+0000","last_undegraded":"2023-07-14T11:19:27.400652+0000","last_fullsized":"2023-07-14T11:19:27.400652+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:45:44.234075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967511+0000","last_change":"2023-07-14T11:19:24.981766+0000","last_active":"2023-07-14T11:19:25.967511+0000","last_peered":"2023-07-14T11:19:25.967511+0000","last_clean":"2023-07-14T11:19:25.967511+0000","last_became_active":"2023-07-14T11:19:24.981081+0000","last_became_peered":"2023-07-14T11:19:24.981081+0000","last_unstale":"2023-07-14T11:19:25.967511+0000","last_undegraded":"2023-07-14T11:19:25.967511+0000","last_fullsized":"2023-07-14T11:19:25.967511+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:53:41.464458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400197+0000","last_change":"2023-07-14T11:19:24.980504+0000","last_active":"2023-07-14T11:19:27.400197+0000","last_peered":"2023-07-14T11:19:27.400197+0000","last_clean":"2023-07-14T11:19:27.400197+0000","last_became_active":"2023-07-14T11:19:24.980260+0000","last_became_peered":"2023-07-14T11:19:24.980260+0000","last_unstale":"2023-07-14T11:19:27.400197+0000","last_undegraded":"2023-07-14T11:19:27.400197+0000","last_fullsized":"2023-07-14T11:19:27.400197+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:14:30.331432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.964757+0000","last_change":"2023-07-14T11:19:24.974486+0000","last_active":"2023-07-14T11:19:25.964757+0000","last_peered":"2023-07-14T11:19:25.964757+0000","last_clean":"2023-07-14T11:19:25.964757+0000","last_became_active":"2023-07-14T11:19:24.974200+0000","last_became_peered":"2023-07-14T11:19:24.974200+0000","last_unstale":"2023-07-14T11:19:25.964757+0000","last_undegraded":"2023-07-14T11:19:25.964757+0000","last_fullsized":"2023-07-14T11:19:25.964757+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:24:28.100458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400004+0000","last_change":"2023-07-14T11:19:24.971933+0000","last_active":"2023-07-14T11:19:27.400004+0000","last_peered":"2023-07-14T11:19:27.400004+0000","last_clean":"2023-07-14T11:19:27.400004+0000","last_became_active":"2023-07-14T11:19:24.971600+0000","last_became_peered":"2023-07-14T11:19:24.971600+0000","last_unstale":"2023-07-14T11:19:27.400004+0000","last_undegraded":"2023-07-14T11:19:27.400004+0000","last_fullsized":"2023-07-14T11:19:27.400004+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:08:27.837698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:26.811879+0000","last_change":"2023-07-14T11:19:24.983027+0000","last_active":"2023-07-14T11:19:26.811879+0000","last_peered":"2023-07-14T11:19:26.811879+0000","last_clean":"2023-07-14T11:19:26.811879+0000","last_became_active":"2023-07-14T11:19:24.982724+0000","last_became_peered":"2023-07-14T11:19:24.982724+0000","last_unstale":"2023-07-14T11:19:26.811879+0000","last_undegraded":"2023-07-14T11:19:26.811879+0000","last_fullsized":"2023-07-14T11:19:26.811879+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:16:14.889261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400466+0000","last_change":"2023-07-14T11:19:24.990479+0000","last_active":"2023-07-14T11:19:27.400466+0000","last_peered":"2023-07-14T11:19:27.400466+0000","last_clean":"2023-07-14T11:19:27.400466+0000","last_became_active":"2023-07-14T11:19:24.990017+0000","last_became_peered":"2023-07-14T11:19:24.990017+0000","last_unstale":"2023-07-14T11:19:27.400466+0000","last_undegraded":"2023-07-14T11:19:27.400466+0000","last_fullsized":"2023-07-14T11:19:27.400466+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:06:38.269911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400663+0000","last_change":"2023-07-14T11:19:24.980376+0000","last_active":"2023-07-14T11:19:27.400663+0000","last_peered":"2023-07-14T11:19:27.400663+0000","last_clean":"2023-07-14T11:19:27.400663+0000","last_became_active":"2023-07-14T11:19:24.980042+0000","last_became_peered":"2023-07-14T11:19:24.980042+0000","last_unstale":"2023-07-14T11:19:27.400663+0000","last_undegraded":"2023-07-14T11:19:27.400663+0000","last_fullsized":"2023-07-14T11:19:27.400663+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:12:35.031686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967103+0000","last_change":"2023-07-14T11:19:24.983855+0000","last_active":"2023-07-14T11:19:25.967103+0000","last_peered":"2023-07-14T11:19:25.967103+0000","last_clean":"2023-07-14T11:19:25.967103+0000","last_became_active":"2023-07-14T11:19:24.983432+0000","last_became_peered":"2023-07-14T11:19:24.983432+0000","last_unstale":"2023-07-14T11:19:25.967103+0000","last_undegraded":"2023-07-14T11:19:25.967103+0000","last_fullsized":"2023-07-14T11:19:25.967103+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:10:43.341934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400752+0000","last_change":"2023-07-14T11:19:24.971669+0000","last_active":"2023-07-14T11:19:27.400752+0000","last_peered":"2023-07-14T11:19:27.400752+0000","last_clean":"2023-07-14T11:19:27.400752+0000","last_became_active":"2023-07-14T11:19:24.971394+0000","last_became_peered":"2023-07-14T11:19:24.971394+0000","last_unstale":"2023-07-14T11:19:27.400752+0000","last_undegraded":"2023-07-14T11:19:27.400752+0000","last_fullsized":"2023-07-14T11:19:27.400752+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:27:45.819918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967396+0000","last_change":"2023-07-14T11:19:24.975332+0000","last_active":"2023-07-14T11:19:25.967396+0000","last_peered":"2023-07-14T11:19:25.967396+0000","last_clean":"2023-07-14T11:19:25.967396+0000","last_became_active":"2023-07-14T11:19:24.974888+0000","last_became_peered":"2023-07-14T11:19:24.974888+0000","last_unstale":"2023-07-14T11:19:25.967396+0000","last_undegraded":"2023-07-14T11:19:25.967396+0000","last_fullsized":"2023-07-14T11:19:25.967396+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:27:43.025658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.968145+0000","last_change":"2023-07-14T11:19:24.986904+0000","last_active":"2023-07-14T11:19:25.968145+0000","last_peered":"2023-07-14T11:19:25.968145+0000","last_clean":"2023-07-14T11:19:25.968145+0000","last_became_active":"2023-07-14T11:19:24.986246+0000","last_became_peered":"2023-07-14T11:19:24.986246+0000","last_unstale":"2023-07-14T11:19:25.968145+0000","last_undegraded":"2023-07-14T11:19:25.968145+0000","last_fullsized":"2023-07-14T11:19:25.968145+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:36:57.980619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400824+0000","last_change":"2023-07-14T11:19:24.980011+0000","last_active":"2023-07-14T11:19:27.400824+0000","last_peered":"2023-07-14T11:19:27.400824+0000","last_clean":"2023-07-14T11:19:27.400824+0000","last_became_active":"2023-07-14T11:19:24.979707+0000","last_became_peered":"2023-07-14T11:19:24.979707+0000","last_unstale":"2023-07-14T11:19:27.400824+0000","last_undegraded":"2023-07-14T11:19:27.400824+0000","last_fullsized":"2023-07-14T11:19:27.400824+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:20:25.338974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:26.811918+0000","last_change":"2023-07-14T11:19:24.990440+0000","last_active":"2023-07-14T11:19:26.811918+0000","last_peered":"2023-07-14T11:19:26.811918+0000","last_clean":"2023-07-14T11:19:26.811918+0000","last_became_active":"2023-07-14T11:19:24.990146+0000","last_became_peered":"2023-07-14T11:19:24.990146+0000","last_unstale":"2023-07-14T11:19:26.811918+0000","last_undegraded":"2023-07-14T11:19:26.811918+0000","last_fullsized":"2023-07-14T11:19:26.811918+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:12:15.517874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400991+0000","last_change":"2023-07-14T11:19:24.982086+0000","last_active":"2023-07-14T11:19:27.400991+0000","last_peered":"2023-07-14T11:19:27.400991+0000","last_clean":"2023-07-14T11:19:27.400991+0000","last_became_active":"2023-07-14T11:19:24.981377+0000","last_became_peered":"2023-07-14T11:19:24.981377+0000","last_unstale":"2023-07-14T11:19:27.400991+0000","last_undegraded":"2023-07-14T11:19:27.400991+0000","last_fullsized":"2023-07-14T11:19:27.400991+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:19:51.206070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.399944+0000","last_change":"2023-07-14T11:19:24.984485+0000","last_active":"2023-07-14T11:19:27.399944+0000","last_peered":"2023-07-14T11:19:27.399944+0000","last_clean":"2023-07-14T11:19:27.399944+0000","last_became_active":"2023-07-14T11:19:24.984144+0000","last_became_peered":"2023-07-14T11:19:24.984144+0000","last_unstale":"2023-07-14T11:19:27.399944+0000","last_undegraded":"2023-07-14T11:19:27.399944+0000","last_fullsized":"2023-07-14T11:19:27.399944+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:41:49.903922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400784+0000","last_change":"2023-07-14T11:19:24.977658+0000","last_active":"2023-07-14T11:19:27.400784+0000","last_peered":"2023-07-14T11:19:27.400784+0000","last_clean":"2023-07-14T11:19:27.400784+0000","last_became_active":"2023-07-14T11:19:24.977318+0000","last_became_peered":"2023-07-14T11:19:24.977318+0000","last_unstale":"2023-07-14T11:19:27.400784+0000","last_undegraded":"2023-07-14T11:19:27.400784+0000","last_fullsized":"2023-07-14T11:19:27.400784+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:55:42.440468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967193+0000","last_change":"2023-07-14T11:19:24.981395+0000","last_active":"2023-07-14T11:19:25.967193+0000","last_peered":"2023-07-14T11:19:25.967193+0000","last_clean":"2023-07-14T11:19:25.967193+0000","last_became_active":"2023-07-14T11:19:24.980523+0000","last_became_peered":"2023-07-14T11:19:24.980523+0000","last_unstale":"2023-07-14T11:19:25.967193+0000","last_undegraded":"2023-07-14T11:19:25.967193+0000","last_fullsized":"2023-07-14T11:19:25.967193+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:04:50.668701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.966856+0000","last_change":"2023-07-14T11:19:24.975124+0000","last_active":"2023-07-14T11:19:25.966856+0000","last_peered":"2023-07-14T11:19:25.966856+0000","last_clean":"2023-07-14T11:19:25.966856+0000","last_became_active":"2023-07-14T11:19:24.974559+0000","last_became_peered":"2023-07-14T11:19:24.974559+0000","last_unstale":"2023-07-14T11:19:25.966856+0000","last_undegraded":"2023-07-14T11:19:25.966856+0000","last_fullsized":"2023-07-14T11:19:25.966856+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:05:30.379389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.964378+0000","last_change":"2023-07-14T11:19:24.985367+0000","last_active":"2023-07-14T11:19:25.964378+0000","last_peered":"2023-07-14T11:19:25.964378+0000","last_clean":"2023-07-14T11:19:25.964378+0000","last_became_active":"2023-07-14T11:19:24.984934+0000","last_became_peered":"2023-07-14T11:19:24.984934+0000","last_unstale":"2023-07-14T11:19:25.964378+0000","last_undegraded":"2023-07-14T11:19:25.964378+0000","last_fullsized":"2023-07-14T11:19:25.964378+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:30:06.079180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"105'4","reported_seq":17,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:26.811614+0000","last_change":"2023-07-14T11:19:23.970000+0000","last_active":"2023-07-14T11:19:26.811614+0000","last_peered":"2023-07-14T11:19:26.811614+0000","last_clean":"2023-07-14T11:19:26.811614+0000","last_became_active":"2023-07-14T11:19:23.969719+0000","last_became_peered":"2023-07-14T11:19:23.969719+0000","last_unstale":"2023-07-14T11:19:26.811614+0000","last_undegraded":"2023-07-14T11:19:26.811614+0000","last_fullsized":"2023-07-14T11:19:26.811614+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:05:30.102665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400906+0000","last_change":"2023-07-14T11:19:24.985452+0000","last_active":"2023-07-14T11:19:27.400906+0000","last_peered":"2023-07-14T11:19:27.400906+0000","last_clean":"2023-07-14T11:19:27.400906+0000","last_became_active":"2023-07-14T11:19:24.983795+0000","last_became_peered":"2023-07-14T11:19:24.983795+0000","last_unstale":"2023-07-14T11:19:27.400906+0000","last_undegraded":"2023-07-14T11:19:27.400906+0000","last_fullsized":"2023-07-14T11:19:27.400906+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:42:39.569277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"105'1","reported_seq":14,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.964705+0000","last_change":"2023-07-14T11:19:23.957148+0000","last_active":"2023-07-14T11:19:25.964705+0000","last_peered":"2023-07-14T11:19:25.964705+0000","last_clean":"2023-07-14T11:19:25.964705+0000","last_became_active":"2023-07-14T11:19:23.956826+0000","last_became_peered":"2023-07-14T11:19:23.956826+0000","last_unstale":"2023-07-14T11:19:25.964705+0000","last_undegraded":"2023-07-14T11:19:25.964705+0000","last_fullsized":"2023-07-14T11:19:25.964705+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:40:31.643180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967855+0000","last_change":"2023-07-14T11:19:24.981190+0000","last_active":"2023-07-14T11:19:25.967855+0000","last_peered":"2023-07-14T11:19:25.967855+0000","last_clean":"2023-07-14T11:19:25.967855+0000","last_became_active":"2023-07-14T11:19:24.980911+0000","last_became_peered":"2023-07-14T11:19:24.980911+0000","last_unstale":"2023-07-14T11:19:25.967855+0000","last_undegraded":"2023-07-14T11:19:25.967855+0000","last_fullsized":"2023-07-14T11:19:25.967855+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:45:06.083751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"105'2","reported_seq":15,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400961+0000","last_change":"2023-07-14T11:19:23.973008+0000","last_active":"2023-07-14T11:19:27.400961+0000","last_peered":"2023-07-14T11:19:27.400961+0000","last_clean":"2023-07-14T11:19:27.400961+0000","last_became_active":"2023-07-14T11:19:23.972497+0000","last_became_peered":"2023-07-14T11:19:23.972497+0000","last_unstale":"2023-07-14T11:19:27.400961+0000","last_undegraded":"2023-07-14T11:19:27.400961+0000","last_fullsized":"2023-07-14T11:19:27.400961+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:42:29.763419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.401102+0000","last_change":"2023-07-14T11:19:24.979467+0000","last_active":"2023-07-14T11:19:27.401102+0000","last_peered":"2023-07-14T11:19:27.401102+0000","last_clean":"2023-07-14T11:19:27.401102+0000","last_became_active":"2023-07-14T11:19:24.978621+0000","last_became_peered":"2023-07-14T11:19:24.978621+0000","last_unstale":"2023-07-14T11:19:27.401102+0000","last_undegraded":"2023-07-14T11:19:27.401102+0000","last_fullsized":"2023-07-14T11:19:27.401102+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:56:55.211407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"105'2","reported_seq":15,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.964353+0000","last_change":"2023-07-14T11:19:23.963900+0000","last_active":"2023-07-14T11:19:25.964353+0000","last_peered":"2023-07-14T11:19:25.964353+0000","last_clean":"2023-07-14T11:19:25.964353+0000","last_became_active":"2023-07-14T11:19:23.963623+0000","last_became_peered":"2023-07-14T11:19:23.963623+0000","last_unstale":"2023-07-14T11:19:25.964353+0000","last_undegraded":"2023-07-14T11:19:25.964353+0000","last_fullsized":"2023-07-14T11:19:25.964353+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:25:03.366408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.964152+0000","last_change":"2023-07-14T11:19:24.971636+0000","last_active":"2023-07-14T11:19:25.964152+0000","last_peered":"2023-07-14T11:19:25.964152+0000","last_clean":"2023-07-14T11:19:25.964152+0000","last_became_active":"2023-07-14T11:19:24.971328+0000","last_became_peered":"2023-07-14T11:19:24.971328+0000","last_unstale":"2023-07-14T11:19:25.964152+0000","last_undegraded":"2023-07-14T11:19:25.964152+0000","last_fullsized":"2023-07-14T11:19:25.964152+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:48:38.451247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"105'1","reported_seq":14,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967274+0000","last_change":"2023-07-14T11:19:23.962575+0000","last_active":"2023-07-14T11:19:25.967274+0000","last_peered":"2023-07-14T11:19:25.967274+0000","last_clean":"2023-07-14T11:19:25.967274+0000","last_became_active":"2023-07-14T11:19:23.962299+0000","last_became_peered":"2023-07-14T11:19:23.962299+0000","last_unstale":"2023-07-14T11:19:25.967274+0000","last_undegraded":"2023-07-14T11:19:25.967274+0000","last_fullsized":"2023-07-14T11:19:25.967274+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:56:49.505955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.966859+0000","last_change":"2023-07-14T11:19:24.981916+0000","last_active":"2023-07-14T11:19:25.966859+0000","last_peered":"2023-07-14T11:19:25.966859+0000","last_clean":"2023-07-14T11:19:25.966859+0000","last_became_active":"2023-07-14T11:19:24.981458+0000","last_became_peered":"2023-07-14T11:19:24.981458+0000","last_unstale":"2023-07-14T11:19:25.966859+0000","last_undegraded":"2023-07-14T11:19:25.966859+0000","last_fullsized":"2023-07-14T11:19:25.966859+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:33:58.183494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"105'1","reported_seq":14,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400247+0000","last_change":"2023-07-14T11:19:23.965613+0000","last_active":"2023-07-14T11:19:27.400247+0000","last_peered":"2023-07-14T11:19:27.400247+0000","last_clean":"2023-07-14T11:19:27.400247+0000","last_became_active":"2023-07-14T11:19:23.965357+0000","last_became_peered":"2023-07-14T11:19:23.965357+0000","last_unstale":"2023-07-14T11:19:27.400247+0000","last_undegraded":"2023-07-14T11:19:27.400247+0000","last_fullsized":"2023-07-14T11:19:27.400247+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:45:25.952053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400903+0000","last_change":"2023-07-14T11:19:24.968533+0000","last_active":"2023-07-14T11:19:27.400903+0000","last_peered":"2023-07-14T11:19:27.400903+0000","last_clean":"2023-07-14T11:19:27.400903+0000","last_became_active":"2023-07-14T11:19:24.967167+0000","last_became_peered":"2023-07-14T11:19:24.967167+0000","last_unstale":"2023-07-14T11:19:27.400903+0000","last_undegraded":"2023-07-14T11:19:27.400903+0000","last_fullsized":"2023-07-14T11:19:27.400903+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:36:37.305304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967284+0000","last_change":"2023-07-14T11:19:23.963545+0000","last_active":"2023-07-14T11:19:25.967284+0000","last_peered":"2023-07-14T11:19:25.967284+0000","last_clean":"2023-07-14T11:19:25.967284+0000","last_became_active":"2023-07-14T11:19:23.963258+0000","last_became_peered":"2023-07-14T11:19:23.963258+0000","last_unstale":"2023-07-14T11:19:25.967284+0000","last_undegraded":"2023-07-14T11:19:25.967284+0000","last_fullsized":"2023-07-14T11:19:25.967284+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:52:08.897066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.964495+0000","last_change":"2023-07-14T11:19:24.963229+0000","last_active":"2023-07-14T11:19:25.964495+0000","last_peered":"2023-07-14T11:19:25.964495+0000","last_clean":"2023-07-14T11:19:25.964495+0000","last_became_active":"2023-07-14T11:19:24.962953+0000","last_became_peered":"2023-07-14T11:19:24.962953+0000","last_unstale":"2023-07-14T11:19:25.964495+0000","last_undegraded":"2023-07-14T11:19:25.964495+0000","last_fullsized":"2023-07-14T11:19:25.964495+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:01:44.444334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400404+0000","last_change":"2023-07-14T11:19:23.967430+0000","last_active":"2023-07-14T11:19:27.400404+0000","last_peered":"2023-07-14T11:19:27.400404+0000","last_clean":"2023-07-14T11:19:27.400404+0000","last_became_active":"2023-07-14T11:19:23.967136+0000","last_became_peered":"2023-07-14T11:19:23.967136+0000","last_unstale":"2023-07-14T11:19:27.400404+0000","last_undegraded":"2023-07-14T11:19:27.400404+0000","last_fullsized":"2023-07-14T11:19:27.400404+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:52:17.347729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967669+0000","last_change":"2023-07-14T11:19:24.984882+0000","last_active":"2023-07-14T11:19:25.967669+0000","last_peered":"2023-07-14T11:19:25.967669+0000","last_clean":"2023-07-14T11:19:25.967669+0000","last_became_active":"2023-07-14T11:19:24.984584+0000","last_became_peered":"2023-07-14T11:19:24.984584+0000","last_unstale":"2023-07-14T11:19:25.967669+0000","last_undegraded":"2023-07-14T11:19:25.967669+0000","last_fullsized":"2023-07-14T11:19:25.967669+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:15:45.414169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"105'1","reported_seq":14,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.964627+0000","last_change":"2023-07-14T11:19:23.966279+0000","last_active":"2023-07-14T11:19:25.964627+0000","last_peered":"2023-07-14T11:19:25.964627+0000","last_clean":"2023-07-14T11:19:25.964627+0000","last_became_active":"2023-07-14T11:19:23.965983+0000","last_became_peered":"2023-07-14T11:19:23.965983+0000","last_unstale":"2023-07-14T11:19:25.964627+0000","last_undegraded":"2023-07-14T11:19:25.964627+0000","last_fullsized":"2023-07-14T11:19:25.964627+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:37:11.528205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967019+0000","last_change":"2023-07-14T11:19:24.976404+0000","last_active":"2023-07-14T11:19:25.967019+0000","last_peered":"2023-07-14T11:19:25.967019+0000","last_clean":"2023-07-14T11:19:25.967019+0000","last_became_active":"2023-07-14T11:19:24.975878+0000","last_became_peered":"2023-07-14T11:19:24.975878+0000","last_unstale":"2023-07-14T11:19:25.967019+0000","last_undegraded":"2023-07-14T11:19:25.967019+0000","last_fullsized":"2023-07-14T11:19:25.967019+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:35:40.868054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"105'2","reported_seq":15,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400912+0000","last_change":"2023-07-14T11:19:23.970931+0000","last_active":"2023-07-14T11:19:27.400912+0000","last_peered":"2023-07-14T11:19:27.400912+0000","last_clean":"2023-07-14T11:19:27.400912+0000","last_became_active":"2023-07-14T11:19:23.970611+0000","last_became_peered":"2023-07-14T11:19:23.970611+0000","last_unstale":"2023-07-14T11:19:27.400912+0000","last_undegraded":"2023-07-14T11:19:27.400912+0000","last_fullsized":"2023-07-14T11:19:27.400912+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:00:57.799054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.401192+0000","last_change":"2023-07-14T11:19:24.983441+0000","last_active":"2023-07-14T11:19:27.401192+0000","last_peered":"2023-07-14T11:19:27.401192+0000","last_clean":"2023-07-14T11:19:27.401192+0000","last_became_active":"2023-07-14T11:19:24.983143+0000","last_became_peered":"2023-07-14T11:19:24.983143+0000","last_unstale":"2023-07-14T11:19:27.401192+0000","last_undegraded":"2023-07-14T11:19:27.401192+0000","last_fullsized":"2023-07-14T11:19:27.401192+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:43:03.332951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"105'1","reported_seq":14,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400601+0000","last_change":"2023-07-14T11:19:23.969338+0000","last_active":"2023-07-14T11:19:27.400601+0000","last_peered":"2023-07-14T11:19:27.400601+0000","last_clean":"2023-07-14T11:19:27.400601+0000","last_became_active":"2023-07-14T11:19:23.969022+0000","last_became_peered":"2023-07-14T11:19:23.969022+0000","last_unstale":"2023-07-14T11:19:27.400601+0000","last_undegraded":"2023-07-14T11:19:27.400601+0000","last_fullsized":"2023-07-14T11:19:27.400601+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:45:59.478598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.968229+0000","last_change":"2023-07-14T11:19:24.981805+0000","last_active":"2023-07-14T11:19:25.968229+0000","last_peered":"2023-07-14T11:19:25.968229+0000","last_clean":"2023-07-14T11:19:25.968229+0000","last_became_active":"2023-07-14T11:19:24.981478+0000","last_became_peered":"2023-07-14T11:19:24.981478+0000","last_unstale":"2023-07-14T11:19:25.968229+0000","last_undegraded":"2023-07-14T11:19:25.968229+0000","last_fullsized":"2023-07-14T11:19:25.968229+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:52:18.355596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400630+0000","last_change":"2023-07-14T11:19:23.972003+0000","last_active":"2023-07-14T11:19:27.400630+0000","last_peered":"2023-07-14T11:19:27.400630+0000","last_clean":"2023-07-14T11:19:27.400630+0000","last_became_active":"2023-07-14T11:19:23.971667+0000","last_became_peered":"2023-07-14T11:19:23.971667+0000","last_unstale":"2023-07-14T11:19:27.400630+0000","last_undegraded":"2023-07-14T11:19:27.400630+0000","last_fullsized":"2023-07-14T11:19:27.400630+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:05:05.340223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400328+0000","last_change":"2023-07-14T11:19:24.982953+0000","last_active":"2023-07-14T11:19:27.400328+0000","last_peered":"2023-07-14T11:19:27.400328+0000","last_clean":"2023-07-14T11:19:27.400328+0000","last_became_active":"2023-07-14T11:19:24.982715+0000","last_became_peered":"2023-07-14T11:19:24.982715+0000","last_unstale":"2023-07-14T11:19:27.400328+0000","last_undegraded":"2023-07-14T11:19:27.400328+0000","last_fullsized":"2023-07-14T11:19:27.400328+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:36:57.980619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"105'2","reported_seq":15,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.399715+0000","last_change":"2023-07-14T11:19:23.969963+0000","last_active":"2023-07-14T11:19:27.399715+0000","last_peered":"2023-07-14T11:19:27.399715+0000","last_clean":"2023-07-14T11:19:27.399715+0000","last_became_active":"2023-07-14T11:19:23.969677+0000","last_became_peered":"2023-07-14T11:19:23.969677+0000","last_unstale":"2023-07-14T11:19:27.399715+0000","last_undegraded":"2023-07-14T11:19:27.399715+0000","last_fullsized":"2023-07-14T11:19:27.399715+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:45:05.075884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.401357+0000","last_change":"2023-07-14T11:19:24.975316+0000","last_active":"2023-07-14T11:19:27.401357+0000","last_peered":"2023-07-14T11:19:27.401357+0000","last_clean":"2023-07-14T11:19:27.401357+0000","last_became_active":"2023-07-14T11:19:24.974918+0000","last_became_peered":"2023-07-14T11:19:24.974918+0000","last_unstale":"2023-07-14T11:19:27.401357+0000","last_undegraded":"2023-07-14T11:19:27.401357+0000","last_fullsized":"2023-07-14T11:19:27.401357+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:43:47.804436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400524+0000","last_change":"2023-07-14T11:19:23.971157+0000","last_active":"2023-07-14T11:19:27.400524+0000","last_peered":"2023-07-14T11:19:27.400524+0000","last_clean":"2023-07-14T11:19:27.400524+0000","last_became_active":"2023-07-14T11:19:23.970829+0000","last_became_peered":"2023-07-14T11:19:23.970829+0000","last_unstale":"2023-07-14T11:19:27.400524+0000","last_undegraded":"2023-07-14T11:19:27.400524+0000","last_fullsized":"2023-07-14T11:19:27.400524+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:08:25.987616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.401018+0000","last_change":"2023-07-14T11:19:24.970037+0000","last_active":"2023-07-14T11:19:27.401018+0000","last_peered":"2023-07-14T11:19:27.401018+0000","last_clean":"2023-07-14T11:19:27.401018+0000","last_became_active":"2023-07-14T11:19:24.969739+0000","last_became_peered":"2023-07-14T11:19:24.969739+0000","last_unstale":"2023-07-14T11:19:27.401018+0000","last_undegraded":"2023-07-14T11:19:27.401018+0000","last_fullsized":"2023-07-14T11:19:27.401018+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:07:01.848428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.401464+0000","last_change":"2023-07-14T11:19:23.971167+0000","last_active":"2023-07-14T11:19:27.401464+0000","last_peered":"2023-07-14T11:19:27.401464+0000","last_clean":"2023-07-14T11:19:27.401464+0000","last_became_active":"2023-07-14T11:19:23.970900+0000","last_became_peered":"2023-07-14T11:19:23.970900+0000","last_unstale":"2023-07-14T11:19:27.401464+0000","last_undegraded":"2023-07-14T11:19:27.401464+0000","last_fullsized":"2023-07-14T11:19:27.401464+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:13:23.260979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967601+0000","last_change":"2023-07-14T11:19:24.978534+0000","last_active":"2023-07-14T11:19:25.967601+0000","last_peered":"2023-07-14T11:19:25.967601+0000","last_clean":"2023-07-14T11:19:25.967601+0000","last_became_active":"2023-07-14T11:19:24.978198+0000","last_became_peered":"2023-07-14T11:19:24.978198+0000","last_unstale":"2023-07-14T11:19:25.967601+0000","last_undegraded":"2023-07-14T11:19:25.967601+0000","last_fullsized":"2023-07-14T11:19:25.967601+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:28:09.892883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400246+0000","last_change":"2023-07-14T11:19:23.972513+0000","last_active":"2023-07-14T11:19:27.400246+0000","last_peered":"2023-07-14T11:19:27.400246+0000","last_clean":"2023-07-14T11:19:27.400246+0000","last_became_active":"2023-07-14T11:19:23.972139+0000","last_became_peered":"2023-07-14T11:19:23.972139+0000","last_unstale":"2023-07-14T11:19:27.400246+0000","last_undegraded":"2023-07-14T11:19:27.400246+0000","last_fullsized":"2023-07-14T11:19:27.400246+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:46:31.067778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.401189+0000","last_change":"2023-07-14T11:19:24.981929+0000","last_active":"2023-07-14T11:19:27.401189+0000","last_peered":"2023-07-14T11:19:27.401189+0000","last_clean":"2023-07-14T11:19:27.401189+0000","last_became_active":"2023-07-14T11:19:24.981116+0000","last_became_peered":"2023-07-14T11:19:24.981116+0000","last_unstale":"2023-07-14T11:19:27.401189+0000","last_undegraded":"2023-07-14T11:19:27.401189+0000","last_fullsized":"2023-07-14T11:19:27.401189+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:11:36.584744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"105'2","reported_seq":15,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400000+0000","last_change":"2023-07-14T11:19:23.964927+0000","last_active":"2023-07-14T11:19:27.400000+0000","last_peered":"2023-07-14T11:19:27.400000+0000","last_clean":"2023-07-14T11:19:27.400000+0000","last_became_active":"2023-07-14T11:19:23.964561+0000","last_became_peered":"2023-07-14T11:19:23.964561+0000","last_unstale":"2023-07-14T11:19:27.400000+0000","last_undegraded":"2023-07-14T11:19:27.400000+0000","last_fullsized":"2023-07-14T11:19:27.400000+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:56:43.945140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.964338+0000","last_change":"2023-07-14T11:19:24.971692+0000","last_active":"2023-07-14T11:19:25.964338+0000","last_peered":"2023-07-14T11:19:25.964338+0000","last_clean":"2023-07-14T11:19:25.964338+0000","last_became_active":"2023-07-14T11:19:24.971436+0000","last_became_peered":"2023-07-14T11:19:24.971436+0000","last_unstale":"2023-07-14T11:19:25.964338+0000","last_undegraded":"2023-07-14T11:19:25.964338+0000","last_fullsized":"2023-07-14T11:19:25.964338+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:57:11.662188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:26.811721+0000","last_change":"2023-07-14T11:19:23.972387+0000","last_active":"2023-07-14T11:19:26.811721+0000","last_peered":"2023-07-14T11:19:26.811721+0000","last_clean":"2023-07-14T11:19:26.811721+0000","last_became_active":"2023-07-14T11:19:23.971170+0000","last_became_peered":"2023-07-14T11:19:23.971170+0000","last_unstale":"2023-07-14T11:19:26.811721+0000","last_undegraded":"2023-07-14T11:19:26.811721+0000","last_fullsized":"2023-07-14T11:19:26.811721+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:05:34.687179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.401128+0000","last_change":"2023-07-14T11:19:24.989128+0000","last_active":"2023-07-14T11:19:27.401128+0000","last_peered":"2023-07-14T11:19:27.401128+0000","last_clean":"2023-07-14T11:19:27.401128+0000","last_became_active":"2023-07-14T11:19:24.988238+0000","last_became_peered":"2023-07-14T11:19:24.988238+0000","last_unstale":"2023-07-14T11:19:27.401128+0000","last_undegraded":"2023-07-14T11:19:27.401128+0000","last_fullsized":"2023-07-14T11:19:27.401128+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:12:11.724645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:26.811948+0000","last_change":"2023-07-14T11:19:23.971440+0000","last_active":"2023-07-14T11:19:26.811948+0000","last_peered":"2023-07-14T11:19:26.811948+0000","last_clean":"2023-07-14T11:19:26.811948+0000","last_became_active":"2023-07-14T11:19:23.971141+0000","last_became_peered":"2023-07-14T11:19:23.971141+0000","last_unstale":"2023-07-14T11:19:26.811948+0000","last_undegraded":"2023-07-14T11:19:26.811948+0000","last_fullsized":"2023-07-14T11:19:26.811948+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:53:13.795884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400005+0000","last_change":"2023-07-14T11:19:24.982564+0000","last_active":"2023-07-14T11:19:27.400005+0000","last_peered":"2023-07-14T11:19:27.400005+0000","last_clean":"2023-07-14T11:19:27.400005+0000","last_became_active":"2023-07-14T11:19:24.982238+0000","last_became_peered":"2023-07-14T11:19:24.982238+0000","last_unstale":"2023-07-14T11:19:27.400005+0000","last_undegraded":"2023-07-14T11:19:27.400005+0000","last_fullsized":"2023-07-14T11:19:27.400005+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:48:10.260203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.401208+0000","last_change":"2023-07-14T11:19:23.967504+0000","last_active":"2023-07-14T11:19:27.401208+0000","last_peered":"2023-07-14T11:19:27.401208+0000","last_clean":"2023-07-14T11:19:27.401208+0000","last_became_active":"2023-07-14T11:19:23.967103+0000","last_became_peered":"2023-07-14T11:19:23.967103+0000","last_unstale":"2023-07-14T11:19:27.401208+0000","last_undegraded":"2023-07-14T11:19:27.401208+0000","last_fullsized":"2023-07-14T11:19:27.401208+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:06:38.495123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400575+0000","last_change":"2023-07-14T11:19:24.980008+0000","last_active":"2023-07-14T11:19:27.400575+0000","last_peered":"2023-07-14T11:19:27.400575+0000","last_clean":"2023-07-14T11:19:27.400575+0000","last_became_active":"2023-07-14T11:19:24.979729+0000","last_became_peered":"2023-07-14T11:19:24.979729+0000","last_unstale":"2023-07-14T11:19:27.400575+0000","last_undegraded":"2023-07-14T11:19:27.400575+0000","last_fullsized":"2023-07-14T11:19:27.400575+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:59:22.004159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967419+0000","last_change":"2023-07-14T11:19:23.966672+0000","last_active":"2023-07-14T11:19:25.967419+0000","last_peered":"2023-07-14T11:19:25.967419+0000","last_clean":"2023-07-14T11:19:25.967419+0000","last_became_active":"2023-07-14T11:19:23.966360+0000","last_became_peered":"2023-07-14T11:19:23.966360+0000","last_unstale":"2023-07-14T11:19:25.967419+0000","last_undegraded":"2023-07-14T11:19:25.967419+0000","last_fullsized":"2023-07-14T11:19:25.967419+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:18:10.519816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.401434+0000","last_change":"2023-07-14T11:19:24.969545+0000","last_active":"2023-07-14T11:19:27.401434+0000","last_peered":"2023-07-14T11:19:27.401434+0000","last_clean":"2023-07-14T11:19:27.401434+0000","last_became_active":"2023-07-14T11:19:24.969283+0000","last_became_peered":"2023-07-14T11:19:24.969283+0000","last_unstale":"2023-07-14T11:19:27.401434+0000","last_undegraded":"2023-07-14T11:19:27.401434+0000","last_fullsized":"2023-07-14T11:19:27.401434+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:45:32.822142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967195+0000","last_change":"2023-07-14T11:19:23.965288+0000","last_active":"2023-07-14T11:19:25.967195+0000","last_peered":"2023-07-14T11:19:25.967195+0000","last_clean":"2023-07-14T11:19:25.967195+0000","last_became_active":"2023-07-14T11:19:23.965026+0000","last_became_peered":"2023-07-14T11:19:23.965026+0000","last_unstale":"2023-07-14T11:19:25.967195+0000","last_undegraded":"2023-07-14T11:19:25.967195+0000","last_fullsized":"2023-07-14T11:19:25.967195+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:01:26.582106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400398+0000","last_change":"2023-07-14T11:19:24.988882+0000","last_active":"2023-07-14T11:19:27.400398+0000","last_peered":"2023-07-14T11:19:27.400398+0000","last_clean":"2023-07-14T11:19:27.400398+0000","last_became_active":"2023-07-14T11:19:24.988506+0000","last_became_peered":"2023-07-14T11:19:24.988506+0000","last_unstale":"2023-07-14T11:19:27.400398+0000","last_undegraded":"2023-07-14T11:19:27.400398+0000","last_fullsized":"2023-07-14T11:19:27.400398+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:36:36.076442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400784+0000","last_change":"2023-07-14T11:19:23.967500+0000","last_active":"2023-07-14T11:19:27.400784+0000","last_peered":"2023-07-14T11:19:27.400784+0000","last_clean":"2023-07-14T11:19:27.400784+0000","last_became_active":"2023-07-14T11:19:23.967047+0000","last_became_peered":"2023-07-14T11:19:23.967047+0000","last_unstale":"2023-07-14T11:19:27.400784+0000","last_undegraded":"2023-07-14T11:19:27.400784+0000","last_fullsized":"2023-07-14T11:19:27.400784+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:28:25.198305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.964622+0000","last_change":"2023-07-14T11:19:24.975857+0000","last_active":"2023-07-14T11:19:25.964622+0000","last_peered":"2023-07-14T11:19:25.964622+0000","last_clean":"2023-07-14T11:19:25.964622+0000","last_became_active":"2023-07-14T11:19:24.975556+0000","last_became_peered":"2023-07-14T11:19:24.975556+0000","last_unstale":"2023-07-14T11:19:25.964622+0000","last_undegraded":"2023-07-14T11:19:25.964622+0000","last_fullsized":"2023-07-14T11:19:25.964622+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:02:11.711759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400246+0000","last_change":"2023-07-14T11:19:23.969220+0000","last_active":"2023-07-14T11:19:27.400246+0000","last_peered":"2023-07-14T11:19:27.400246+0000","last_clean":"2023-07-14T11:19:27.400246+0000","last_became_active":"2023-07-14T11:19:23.968907+0000","last_became_peered":"2023-07-14T11:19:23.968907+0000","last_unstale":"2023-07-14T11:19:27.400246+0000","last_undegraded":"2023-07-14T11:19:27.400246+0000","last_fullsized":"2023-07-14T11:19:27.400246+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:30:14.810287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.968126+0000","last_change":"2023-07-14T11:19:24.978612+0000","last_active":"2023-07-14T11:19:25.968126+0000","last_peered":"2023-07-14T11:19:25.968126+0000","last_clean":"2023-07-14T11:19:25.968126+0000","last_became_active":"2023-07-14T11:19:24.978260+0000","last_became_peered":"2023-07-14T11:19:24.978260+0000","last_unstale":"2023-07-14T11:19:25.968126+0000","last_undegraded":"2023-07-14T11:19:25.968126+0000","last_fullsized":"2023-07-14T11:19:25.968126+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:45:26.959920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"105'6","reported_seq":19,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400211+0000","last_change":"2023-07-14T11:19:23.965164+0000","last_active":"2023-07-14T11:19:27.400211+0000","last_peered":"2023-07-14T11:19:27.400211+0000","last_clean":"2023-07-14T11:19:27.400211+0000","last_became_active":"2023-07-14T11:19:23.964680+0000","last_became_peered":"2023-07-14T11:19:23.964680+0000","last_unstale":"2023-07-14T11:19:27.400211+0000","last_undegraded":"2023-07-14T11:19:27.400211+0000","last_fullsized":"2023-07-14T11:19:27.400211+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:22:16.518767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":167,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:26.811844+0000","last_change":"2023-07-14T11:13:08.762084+0000","last_active":"2023-07-14T11:19:26.811844+0000","last_peered":"2023-07-14T11:19:26.811844+0000","last_clean":"2023-07-14T11:19:26.811844+0000","last_became_active":"2023-07-14T11:13:08.761763+0000","last_became_peered":"2023-07-14T11:13:08.761763+0000","last_unstale":"2023-07-14T11:19:26.811844+0000","last_undegraded":"2023-07-14T11:19:26.811844+0000","last_fullsized":"2023-07-14T11:19:26.811844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:53:32.176184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400135+0000","last_change":"2023-07-14T11:19:24.971531+0000","last_active":"2023-07-14T11:19:27.400135+0000","last_peered":"2023-07-14T11:19:27.400135+0000","last_clean":"2023-07-14T11:19:27.400135+0000","last_became_active":"2023-07-14T11:19:24.971190+0000","last_became_peered":"2023-07-14T11:19:24.971190+0000","last_unstale":"2023-07-14T11:19:27.400135+0000","last_undegraded":"2023-07-14T11:19:27.400135+0000","last_fullsized":"2023-07-14T11:19:27.400135+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:01:25.077995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"105'3","reported_seq":16,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967842+0000","last_change":"2023-07-14T11:19:23.969233+0000","last_active":"2023-07-14T11:19:25.967842+0000","last_peered":"2023-07-14T11:19:25.967842+0000","last_clean":"2023-07-14T11:19:25.967842+0000","last_became_active":"2023-07-14T11:19:23.968938+0000","last_became_peered":"2023-07-14T11:19:23.968938+0000","last_unstale":"2023-07-14T11:19:25.967842+0000","last_undegraded":"2023-07-14T11:19:25.967842+0000","last_fullsized":"2023-07-14T11:19:25.967842+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:53:14.223807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":187,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.964710+0000","last_change":"2023-07-14T11:13:08.761726+0000","last_active":"2023-07-14T11:19:25.964710+0000","last_peered":"2023-07-14T11:19:25.964710+0000","last_clean":"2023-07-14T11:19:25.964710+0000","last_became_active":"2023-07-14T11:13:08.761365+0000","last_became_peered":"2023-07-14T11:13:08.761365+0000","last_unstale":"2023-07-14T11:19:25.964710+0000","last_undegraded":"2023-07-14T11:19:25.964710+0000","last_fullsized":"2023-07-14T11:19:25.964710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:19:34.910190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967811+0000","last_change":"2023-07-14T11:19:24.985128+0000","last_active":"2023-07-14T11:19:25.967811+0000","last_peered":"2023-07-14T11:19:25.967811+0000","last_clean":"2023-07-14T11:19:25.967811+0000","last_became_active":"2023-07-14T11:19:24.984814+0000","last_became_peered":"2023-07-14T11:19:24.984814+0000","last_unstale":"2023-07-14T11:19:25.967811+0000","last_undegraded":"2023-07-14T11:19:25.967811+0000","last_fullsized":"2023-07-14T11:19:25.967811+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:37:46.235964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.968001+0000","last_change":"2023-07-14T11:19:23.959733+0000","last_active":"2023-07-14T11:19:25.968001+0000","last_peered":"2023-07-14T11:19:25.968001+0000","last_clean":"2023-07-14T11:19:25.968001+0000","last_became_active":"2023-07-14T11:19:23.959449+0000","last_became_peered":"2023-07-14T11:19:23.959449+0000","last_unstale":"2023-07-14T11:19:25.968001+0000","last_undegraded":"2023-07-14T11:19:25.968001+0000","last_fullsized":"2023-07-14T11:19:25.968001+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:14:29.323565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":158,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400857+0000","last_change":"2023-07-14T11:13:08.923899+0000","last_active":"2023-07-14T11:19:27.400857+0000","last_peered":"2023-07-14T11:19:27.400857+0000","last_clean":"2023-07-14T11:19:27.400857+0000","last_became_active":"2023-07-14T11:13:08.923513+0000","last_became_peered":"2023-07-14T11:13:08.923513+0000","last_unstale":"2023-07-14T11:19:27.400857+0000","last_undegraded":"2023-07-14T11:19:27.400857+0000","last_fullsized":"2023-07-14T11:19:27.400857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:58:50.925932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:26.811915+0000","last_change":"2023-07-14T11:19:24.983897+0000","last_active":"2023-07-14T11:19:26.811915+0000","last_peered":"2023-07-14T11:19:26.811915+0000","last_clean":"2023-07-14T11:19:26.811915+0000","last_became_active":"2023-07-14T11:19:24.983447+0000","last_became_peered":"2023-07-14T11:19:24.983447+0000","last_unstale":"2023-07-14T11:19:26.811915+0000","last_undegraded":"2023-07-14T11:19:26.811915+0000","last_fullsized":"2023-07-14T11:19:26.811915+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:54:18.545171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"105'2","reported_seq":15,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400378+0000","last_change":"2023-07-14T11:19:23.969743+0000","last_active":"2023-07-14T11:19:27.400378+0000","last_peered":"2023-07-14T11:19:27.400378+0000","last_clean":"2023-07-14T11:19:27.400378+0000","last_became_active":"2023-07-14T11:19:23.969481+0000","last_became_peered":"2023-07-14T11:19:23.969481+0000","last_unstale":"2023-07-14T11:19:27.400378+0000","last_undegraded":"2023-07-14T11:19:27.400378+0000","last_fullsized":"2023-07-14T11:19:27.400378+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:47:10.929997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":158,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400651+0000","last_change":"2023-07-14T11:13:08.760609+0000","last_active":"2023-07-14T11:19:27.400651+0000","last_peered":"2023-07-14T11:19:27.400651+0000","last_clean":"2023-07-14T11:19:27.400651+0000","last_became_active":"2023-07-14T11:13:08.760285+0000","last_became_peered":"2023-07-14T11:13:08.760285+0000","last_unstale":"2023-07-14T11:19:27.400651+0000","last_undegraded":"2023-07-14T11:19:27.400651+0000","last_fullsized":"2023-07-14T11:19:27.400651+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:53:22.176667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400797+0000","last_change":"2023-07-14T11:19:24.980041+0000","last_active":"2023-07-14T11:19:27.400797+0000","last_peered":"2023-07-14T11:19:27.400797+0000","last_clean":"2023-07-14T11:19:27.400797+0000","last_became_active":"2023-07-14T11:19:24.979435+0000","last_became_peered":"2023-07-14T11:19:24.979435+0000","last_unstale":"2023-07-14T11:19:27.400797+0000","last_undegraded":"2023-07-14T11:19:27.400797+0000","last_fullsized":"2023-07-14T11:19:27.400797+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:10:32.407475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"105'8","reported_seq":21,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.401632+0000","last_change":"2023-07-14T11:19:23.969006+0000","last_active":"2023-07-14T11:19:27.401632+0000","last_peered":"2023-07-14T11:19:27.401632+0000","last_clean":"2023-07-14T11:19:27.401632+0000","last_became_active":"2023-07-14T11:19:23.968741+0000","last_became_peered":"2023-07-14T11:19:23.968741+0000","last_unstale":"2023-07-14T11:19:27.401632+0000","last_undegraded":"2023-07-14T11:19:27.401632+0000","last_fullsized":"2023-07-14T11:19:27.401632+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:26:03.770926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"76'128","reported_seq":353,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400632+0000","last_change":"2023-07-14T11:13:01.370649+0000","last_active":"2023-07-14T11:19:27.400632+0000","last_peered":"2023-07-14T11:19:27.400632+0000","last_clean":"2023-07-14T11:19:27.400632+0000","last_became_active":"2023-07-14T11:13:01.369478+0000","last_became_peered":"2023-07-14T11:13:01.369478+0000","last_unstale":"2023-07-14T11:19:27.400632+0000","last_undegraded":"2023-07-14T11:19:27.400632+0000","last_fullsized":"2023-07-14T11:19:27.400632+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:00.254800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:00.254800+0000","last_clean_scrub_stamp":"2023-07-14T11:13:00.254800+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:32:37.718542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":172,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967539+0000","last_change":"2023-07-14T11:13:08.757882+0000","last_active":"2023-07-14T11:19:25.967539+0000","last_peered":"2023-07-14T11:19:25.967539+0000","last_clean":"2023-07-14T11:19:25.967539+0000","last_became_active":"2023-07-14T11:13:08.757541+0000","last_became_peered":"2023-07-14T11:13:08.757541+0000","last_unstale":"2023-07-14T11:19:25.967539+0000","last_undegraded":"2023-07-14T11:19:25.967539+0000","last_fullsized":"2023-07-14T11:19:25.967539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:44:22.274150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.964372+0000","last_change":"2023-07-14T11:19:24.972447+0000","last_active":"2023-07-14T11:19:25.964372+0000","last_peered":"2023-07-14T11:19:25.964372+0000","last_clean":"2023-07-14T11:19:25.964372+0000","last_became_active":"2023-07-14T11:19:24.972170+0000","last_became_peered":"2023-07-14T11:19:24.972170+0000","last_unstale":"2023-07-14T11:19:25.964372+0000","last_undegraded":"2023-07-14T11:19:25.964372+0000","last_fullsized":"2023-07-14T11:19:25.964372+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:06:12.493242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.401097+0000","last_change":"2023-07-14T11:19:23.961825+0000","last_active":"2023-07-14T11:19:27.401097+0000","last_peered":"2023-07-14T11:19:27.401097+0000","last_clean":"2023-07-14T11:19:27.401097+0000","last_became_active":"2023-07-14T11:19:23.961499+0000","last_became_peered":"2023-07-14T11:19:23.961499+0000","last_unstale":"2023-07-14T11:19:27.401097+0000","last_undegraded":"2023-07-14T11:19:27.401097+0000","last_fullsized":"2023-07-14T11:19:27.401097+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:52:14.188912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":176,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.399575+0000","last_change":"2023-07-14T11:13:08.862331+0000","last_active":"2023-07-14T11:19:27.399575+0000","last_peered":"2023-07-14T11:19:27.399575+0000","last_clean":"2023-07-14T11:19:27.399575+0000","last_became_active":"2023-07-14T11:13:08.861817+0000","last_became_peered":"2023-07-14T11:13:08.861817+0000","last_unstale":"2023-07-14T11:19:27.399575+0000","last_undegraded":"2023-07-14T11:19:27.399575+0000","last_fullsized":"2023-07-14T11:19:27.399575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:06:57.469895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.399635+0000","last_change":"2023-07-14T11:19:24.980611+0000","last_active":"2023-07-14T11:19:27.399635+0000","last_peered":"2023-07-14T11:19:27.399635+0000","last_clean":"2023-07-14T11:19:27.399635+0000","last_became_active":"2023-07-14T11:19:24.980359+0000","last_became_peered":"2023-07-14T11:19:24.980359+0000","last_unstale":"2023-07-14T11:19:27.399635+0000","last_undegraded":"2023-07-14T11:19:27.399635+0000","last_fullsized":"2023-07-14T11:19:27.399635+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:16:08.807717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.401402+0000","last_change":"2023-07-14T11:19:23.964816+0000","last_active":"2023-07-14T11:19:27.401402+0000","last_peered":"2023-07-14T11:19:27.401402+0000","last_clean":"2023-07-14T11:19:27.401402+0000","last_became_active":"2023-07-14T11:19:23.964532+0000","last_became_peered":"2023-07-14T11:19:23.964532+0000","last_unstale":"2023-07-14T11:19:27.401402+0000","last_undegraded":"2023-07-14T11:19:27.401402+0000","last_fullsized":"2023-07-14T11:19:27.401402+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:22:08.182081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":172,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967485+0000","last_change":"2023-07-14T11:13:08.758749+0000","last_active":"2023-07-14T11:19:25.967485+0000","last_peered":"2023-07-14T11:19:25.967485+0000","last_clean":"2023-07-14T11:19:25.967485+0000","last_became_active":"2023-07-14T11:13:08.757956+0000","last_became_peered":"2023-07-14T11:13:08.757956+0000","last_unstale":"2023-07-14T11:19:25.967485+0000","last_undegraded":"2023-07-14T11:19:25.967485+0000","last_fullsized":"2023-07-14T11:19:25.967485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:50:28.757111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:26.811687+0000","last_change":"2023-07-14T11:19:24.983636+0000","last_active":"2023-07-14T11:19:26.811687+0000","last_peered":"2023-07-14T11:19:26.811687+0000","last_clean":"2023-07-14T11:19:26.811687+0000","last_became_active":"2023-07-14T11:19:24.983344+0000","last_became_peered":"2023-07-14T11:19:24.983344+0000","last_unstale":"2023-07-14T11:19:26.811687+0000","last_undegraded":"2023-07-14T11:19:26.811687+0000","last_fullsized":"2023-07-14T11:19:26.811687+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:45:10.660543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:26.811798+0000","last_change":"2023-07-14T11:19:23.971573+0000","last_active":"2023-07-14T11:19:26.811798+0000","last_peered":"2023-07-14T11:19:26.811798+0000","last_clean":"2023-07-14T11:19:26.811798+0000","last_became_active":"2023-07-14T11:19:23.971250+0000","last_became_peered":"2023-07-14T11:19:23.971250+0000","last_unstale":"2023-07-14T11:19:26.811798+0000","last_undegraded":"2023-07-14T11:19:26.811798+0000","last_fullsized":"2023-07-14T11:19:26.811798+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:36:06.868468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":188,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.964499+0000","last_change":"2023-07-14T11:13:08.923786+0000","last_active":"2023-07-14T11:19:25.964499+0000","last_peered":"2023-07-14T11:19:25.964499+0000","last_clean":"2023-07-14T11:19:25.964499+0000","last_became_active":"2023-07-14T11:13:08.923384+0000","last_became_peered":"2023-07-14T11:13:08.923384+0000","last_unstale":"2023-07-14T11:19:25.964499+0000","last_undegraded":"2023-07-14T11:19:25.964499+0000","last_fullsized":"2023-07-14T11:19:25.964499+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:32:52.150831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574930,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32932,"kb_used_data":1884,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338908,"statfs":{"total":96636764160,"available":96603041792,"internally_reserved":0,"allocated":1929216,"data_stored":1202663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:19:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.66200000000000003,"15min":0.89400000000000002},"min":{"1min":0.55500000000000005,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":8.4339999999999993},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.69199999999999995,"15min":0.92800000000000005},"min":{"1min":0.47599999999999998,"5min":0.45500000000000002,"15min":0.377},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":8.4559999999999995},"last":0.65100000000000002}]},{"osd":1,"last update":"Fri Jul 14 11:19:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.67200000000000004,"15min":0.871},"min":{"1min":0.52100000000000002,"5min":0.40400000000000003,"15min":0.34899999999999998},"max":{"1min":0.90400000000000003,"5min":0.92800000000000005,"15min":6.3520000000000003},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.66100000000000003,"15min":1.0089999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":6.8550000000000004},"last":0.71199999999999997}]},{"osd":2,"last update":"Fri Jul 14 11:19:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.67100000000000004,"15min":1.0569999999999999},"min":{"1min":0.499,"5min":0.434,"15min":0.434},"max":{"1min":0.83599999999999997,"5min":0.997,"15min":7.0289999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.70399999999999996,"15min":0.69299999999999995},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.86399999999999999,"5min":0.98199999999999998,"15min":1.0580000000000001},"last":0.81000000000000005}]},{"osd":3,"last update":"Fri Jul 14 11:19:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.68899999999999995,"15min":1.109},"min":{"1min":0.55200000000000005,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.91100000000000003,"5min":0.95699999999999996,"15min":10.337},"last":0.755},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.72699999999999998,"15min":0.75800000000000001},"min":{"1min":0.53300000000000003,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.90100000000000002,"5min":1.024,"15min":1.921},"last":0.53400000000000003}]},{"osd":4,"last update":"Fri Jul 14 11:19:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.64700000000000002,"15min":0.59899999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.73599999999999999,"15min":0.70599999999999996},"min":{"1min":0.57299999999999995,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.90800000000000003,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.59099999999999997}]},{"osd":5,"last update":"Fri Jul 14 11:19:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.70099999999999996,"15min":0.67900000000000005},"min":{"1min":0.39700000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.92800000000000005,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.76400000000000001,"15min":0.73999999999999999},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.47499999999999998}]},{"osd":6,"last update":"Fri Jul 14 11:19:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.72899999999999998,"15min":0.68300000000000005},"min":{"1min":0.505,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.98799999999999999,"5min":1.002,"15min":1.002},"last":0.5},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.73299999999999998,"15min":0.69399999999999995},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.48899999999999999},"max":{"1min":0.97399999999999998,"5min":1.129,"15min":1.129},"last":0.51300000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574931,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28244,"kb_used_data":1292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343596,"statfs":{"total":96636764160,"available":96607842304,"internally_reserved":0,"allocated":1323008,"data_stored":612101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.69899999999999995,"15min":0.70299999999999996},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93799999999999994,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.73499999999999999,"15min":0.72099999999999997},"min":{"1min":0.51100000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.83899999999999997,"5min":1.167,"15min":1.167},"last":0.78800000000000003}]},{"osd":1,"last update":"Fri Jul 14 11:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71899999999999997,"15min":0.69099999999999995},"min":{"1min":0.443,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":1.0329999999999999},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.73099999999999998,"15min":0.71399999999999997},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39300000000000002},"max":{"1min":0.90400000000000003,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.74399999999999999}]},{"osd":2,"last update":"Fri Jul 14 11:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.69899999999999995,"15min":0.67900000000000005},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.41299999999999998},"max":{"1min":0.89000000000000001,"5min":1.45,"15min":1.45},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.755,"5min":0.754,"15min":0.77600000000000002},"min":{"1min":0.56399999999999995,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.075,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.95399999999999996}]},{"osd":3,"last update":"Fri Jul 14 11:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.73099999999999998,"15min":0.74299999999999999},"min":{"1min":0.50900000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.86499999999999999,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.73299999999999998,"15min":0.73899999999999999},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0469999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.876}]},{"osd":4,"last update":"Fri Jul 14 11:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.69099999999999995,"15min":0.70699999999999996},"min":{"1min":0.53300000000000003,"5min":0.38,"15min":0.38},"max":{"1min":1.177,"5min":1.712,"15min":1.712},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.71999999999999997,"15min":0.72599999999999998},"min":{"1min":0.48199999999999998,"5min":0.438,"15min":0.42899999999999999},"max":{"1min":0.998,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.69099999999999995}]},{"osd":5,"last update":"Fri Jul 14 11:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.71199999999999997,"15min":0.71799999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.93500000000000005,"5min":2.8820000000000001,"15min":2.8820000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.77200000000000002,"15min":0.78800000000000003},"min":{"1min":0.58399999999999996,"5min":0.46100000000000002,"15min":0.44500000000000001},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.98799999999999999}]},{"osd":7,"last update":"Fri Jul 14 11:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.77500000000000002,"15min":0.79900000000000004},"min":{"1min":0.59899999999999998,"5min":0.47399999999999998,"15min":0.47099999999999997},"max":{"1min":0.95499999999999996,"5min":1.333,"15min":1.333},"last":0.628},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.76300000000000001,"15min":0.78900000000000003},"min":{"1min":0.46899999999999997,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.1579999999999999,"5min":1.55,"15min":1.55},"last":0.92800000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574930,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28244,"kb_used_data":1292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343596,"statfs":{"total":96636764160,"available":96607842304,"internally_reserved":0,"allocated":1323008,"data_stored":611541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.40500000000000003,"15min":0.432},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.54200000000000004,"5min":0.59099999999999997,"15min":0.996},"last":0.745},{"interface":"front","average":{"1min":0.432,"5min":0.45500000000000002,"15min":0.47599999999999998},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.57299999999999995,"5min":0.81599999999999995,"15min":0.84299999999999997},"last":0.40699999999999997}]},{"osd":2,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.48099999999999998,"15min":0.54900000000000004},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.60299999999999998,"5min":0.70799999999999996,"15min":2.476},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.48899999999999999,"15min":0.59499999999999997},"min":{"1min":0.36899999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.64700000000000002,"5min":0.91700000000000004,"15min":2.6299999999999999},"last":0.57499999999999996}]},{"osd":3,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.52800000000000002,"15min":0.52200000000000002},"min":{"1min":0.40899999999999997,"5min":0.39300000000000002,"15min":0.38900000000000001},"max":{"1min":0.72599999999999998,"5min":0.748,"15min":0.748},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46500000000000002,"15min":0.48799999999999999},"min":{"1min":0.33600000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.59499999999999997,"5min":0.67700000000000005,"15min":0.73199999999999998},"last":0.47799999999999998}]},{"osd":4,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.73699999999999999,"15min":0.749},"min":{"1min":0.52400000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.363},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.751,"5min":0.754,"15min":0.76900000000000002},"min":{"1min":0.57099999999999995,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.93999999999999995,"5min":1.1160000000000001,"15min":1.4890000000000001},"last":0.625}]},{"osd":5,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.749,"15min":0.76500000000000001},"min":{"1min":0.54200000000000004,"5min":0.499,"15min":0.499},"max":{"1min":1.0589999999999999,"5min":1.2250000000000001,"15min":1.3759999999999999},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76200000000000001,"15min":0.80800000000000005},"min":{"1min":0.59099999999999997,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.4330000000000001},"last":0.68799999999999994}]},{"osd":6,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.745,"15min":0.78800000000000003},"min":{"1min":0.55900000000000005,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.028,"5min":1.141,"15min":1.298},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.753,"15min":0.77900000000000003},"min":{"1min":0.60199999999999998,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.97199999999999998,"5min":1.1899999999999999,"15min":1.2130000000000001},"last":0.85699999999999998}]},{"osd":7,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.75900000000000001,"15min":0.80700000000000005},"min":{"1min":0.58299999999999996,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0780000000000001,"5min":1.2010000000000001,"15min":1.4590000000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.75,"15min":0.77900000000000003},"min":{"1min":0.56299999999999994,"5min":0.55000000000000004,"15min":0.54200000000000004},"max":{"1min":1.129,"5min":1.129,"15min":1.3700000000000001},"last":0.71099999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574928,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28824,"kb_used_data":1872,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343016,"statfs":{"total":96636764160,"available":96607248384,"internally_reserved":0,"allocated":1916928,"data_stored":1201909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 11:19:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.47699999999999998,"15min":0.44700000000000001},"min":{"1min":0.26800000000000002,"5min":0.252,"15min":0.252},"max":{"1min":2.972,"5min":2.972,"15min":2.972},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.47599999999999998,"15min":0.45200000000000001},"min":{"1min":0.33300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":2.758,"5min":2.758,"15min":2.758},"last":0.31900000000000001}]},{"osd":2,"last update":"Fri Jul 14 11:19:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.499,"15min":0.47299999999999998},"min":{"1min":0.35599999999999998,"5min":0.307,"15min":0.307},"max":{"1min":2.9409999999999998,"5min":2.9409999999999998,"15min":2.9409999999999998},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.51900000000000002,"15min":0.50900000000000001},"min":{"1min":0.376,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":2.556,"5min":2.556,"15min":2.556},"last":0.45900000000000002}]},{"osd":3,"last update":"Fri Jul 14 11:19:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.48199999999999998,"15min":0.438},"min":{"1min":0.33700000000000002,"5min":0.32000000000000001,"15min":0.309},"max":{"1min":2.6019999999999999,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.55600000000000005,"15min":0.53500000000000003},"min":{"1min":0.44900000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":2.9990000000000001,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":0.56599999999999995}]},{"osd":4,"last update":"Fri Jul 14 11:19:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.73699999999999999,"15min":0.75700000000000001},"min":{"1min":0.51200000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0229999999999999,"5min":1.099,"15min":1.1060000000000001},"last":0.874},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.76400000000000001,"15min":0.71799999999999997},"min":{"1min":0.57499999999999996,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.651,"5min":1.651,"15min":1.651},"last":0.82299999999999995}]},{"osd":5,"last update":"Fri Jul 14 11:19:12 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.77200000000000002,"15min":0.73799999999999999},"min":{"1min":0.51900000000000002,"5min":0.502,"15min":0.47999999999999998},"max":{"1min":2.9089999999999998,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.76500000000000001,"15min":0.77600000000000002},"min":{"1min":0.53200000000000003,"5min":0.505,"15min":0.505},"max":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.77800000000000002}]},{"osd":6,"last update":"Fri Jul 14 11:19:12 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.745,"15min":0.72799999999999998},"min":{"1min":0.499,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.78700000000000003,"15min":0.78300000000000003},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":2.8679999999999999,"5min":2.8679999999999999,"15min":2.8679999999999999},"last":0.76000000000000001}]},{"osd":7,"last update":"Fri Jul 14 11:19:12 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.77700000000000002,"15min":0.80900000000000005},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.97599999999999998,"5min":1.0900000000000001,"15min":1.149},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.81899999999999995,"15min":0.78900000000000003},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.7410000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":0.85799999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574928,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28240,"kb_used_data":1288,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343600,"statfs":{"total":96636764160,"available":96607846400,"internally_reserved":0,"allocated":1318912,"data_stored":611519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:19:20 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.40899999999999997,"15min":0.441},"min":{"1min":0.27100000000000002,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.623,"5min":0.63900000000000001,"15min":0.64700000000000002},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.438,"15min":0.44400000000000001},"min":{"1min":0.32100000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.63700000000000001,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.36399999999999999}]},{"osd":1,"last update":"Fri Jul 14 11:19:20 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46700000000000003,"15min":0.48199999999999998},"min":{"1min":0.371,"5min":0.31,"15min":0.31},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.98299999999999998},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.47899999999999998,"15min":0.48699999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.59199999999999997,"5min":0.629,"15min":0.91200000000000003},"last":0.498}]},{"osd":3,"last update":"Fri Jul 14 11:19:20 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.48699999999999999,"15min":0.49299999999999999},"min":{"1min":0.34999999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.623,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.55700000000000005,"15min":0.57999999999999996},"min":{"1min":0.44500000000000001,"5min":0.41499999999999998,"15min":0.40799999999999997},"max":{"1min":0.72899999999999998,"5min":0.80000000000000004,"15min":1.034},"last":0.53500000000000003}]},{"osd":4,"last update":"Fri Jul 14 11:19:20 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.73499999999999999,"15min":0.76300000000000001},"min":{"1min":0.53900000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.036,"5min":1.171,"15min":1.212},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.749,"15min":0.77900000000000003},"min":{"1min":0.53800000000000003,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.83899999999999997}]},{"osd":5,"last update":"Fri Jul 14 11:19:20 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.74399999999999999,"15min":0.78200000000000003},"min":{"1min":0.53900000000000003,"5min":0.51700000000000002,"15min":0.43099999999999999},"max":{"1min":1.202,"5min":1.202,"15min":1.4019999999999999},"last":0.751},{"interface":"front","average":{"1min":0.75,"5min":0.76300000000000001,"15min":0.81100000000000005},"min":{"1min":0.55800000000000005,"5min":0.495,"15min":0.495},"max":{"1min":1.044,"5min":1.351,"15min":1.351},"last":0.86799999999999999}]},{"osd":6,"last update":"Fri Jul 14 11:19:20 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.753,"15min":0.78100000000000003},"min":{"1min":0.53100000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0089999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.76800000000000002,"15min":0.81299999999999994},"min":{"1min":0.60199999999999998,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.218,"5min":1.282,"15min":1.282},"last":0.80800000000000005}]},{"osd":7,"last update":"Fri Jul 14 11:19:20 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.754,"15min":0.79100000000000004},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.93400000000000005,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.754,"15min":0.79600000000000004},"min":{"1min":0.60899999999999999,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.96399999999999997,"5min":1.244,"15min":1.244},"last":0.77700000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574928,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28256,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343584,"statfs":{"total":96636764160,"available":96607830016,"internally_reserved":0,"allocated":1335296,"data_stored":613117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.41099999999999998,"15min":0.442},"min":{"1min":0.24299999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.55900000000000005,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.44500000000000001,"15min":0.44800000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.621,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.51100000000000001}]},{"osd":1,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.44,"15min":0.44900000000000001},"min":{"1min":0.29499999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.52000000000000002,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.47199999999999998,"15min":0.49099999999999999},"min":{"1min":0.317,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.60899999999999999,"5min":0.72699999999999998,"15min":0.86399999999999999},"last":0.42799999999999999}]},{"osd":2,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.53400000000000003,"15min":0.54000000000000004},"min":{"1min":0.39600000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.64900000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56200000000000006,"15min":0.58999999999999997},"min":{"1min":0.44,"5min":0.37,"15min":0.37},"max":{"1min":0.76100000000000001,"5min":0.79600000000000004,"15min":1.585},"last":0.60299999999999998}]},{"osd":4,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.73299999999999998,"15min":0.754},"min":{"1min":0.45400000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.96399999999999997,"5min":1.1279999999999999,"15min":1.216},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.76700000000000002,"15min":0.75700000000000001},"min":{"1min":0.48599999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.73999999999999999}]},{"osd":5,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.747,"15min":0.75700000000000001},"min":{"1min":0.48499999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.089,"5min":1.179,"15min":1.413},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.76700000000000002,"15min":0.83499999999999996},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.94999999999999996,"5min":1.1619999999999999,"15min":1.657},"last":0.80400000000000005}]},{"osd":6,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77700000000000002,"15min":0.78300000000000003},"min":{"1min":0.56699999999999995,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.726},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.755,"5min":0.76800000000000002,"15min":0.79400000000000004},"min":{"1min":0.57099999999999995,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.143,"5min":1.286,"15min":1.333},"last":0.70299999999999996}]},{"osd":7,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.79700000000000004,"15min":0.83099999999999996},"min":{"1min":0.53800000000000003,"5min":0.437,"15min":0.437},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.3939999999999999},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.80800000000000005,"15min":0.83399999999999996},"min":{"1min":0.60299999999999998,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.89400000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574928,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28252,"kb_used_data":1300,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343588,"statfs":{"total":96636764160,"available":96607834112,"internally_reserved":0,"allocated":1331200,"data_stored":613083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:19:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.64900000000000002,"15min":0.63500000000000001},"min":{"1min":0.437,"5min":0.311,"15min":0.311},"max":{"1min":0.89600000000000002,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.65200000000000002,"15min":0.68400000000000005},"min":{"1min":0.47699999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85199999999999998,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.70099999999999996}]},{"osd":1,"last update":"Fri Jul 14 11:19:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.65200000000000002,"15min":0.66600000000000004},"min":{"1min":0.51700000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.83599999999999997,"5min":0.92000000000000004,"15min":1.4259999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70299999999999996,"15min":0.70999999999999996},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.45800000000000002},"max":{"1min":0.95799999999999996,"5min":1.0149999999999999,"15min":1.1659999999999999},"last":0.80400000000000005}]},{"osd":2,"last update":"Fri Jul 14 11:19:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.69999999999999996,"15min":0.70699999999999996},"min":{"1min":0.501,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.88200000000000001,"5min":1.0209999999999999,"15min":1.48},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71999999999999997,"15min":0.73599999999999999},"min":{"1min":0.54800000000000004,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.91800000000000004,"5min":1.1080000000000001,"15min":1.23},"last":0.66600000000000004}]},{"osd":3,"last update":"Fri Jul 14 11:19:15 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.67800000000000005,"15min":0.70799999999999996},"min":{"1min":0.51300000000000001,"5min":0.438,"15min":0.438},"max":{"1min":0.95599999999999996,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.72999999999999998,"15min":0.73599999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.90700000000000003,"5min":1.1259999999999999,"15min":1.145},"last":0.59099999999999997}]},{"osd":5,"last update":"Fri Jul 14 11:19:15 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.66600000000000004,"15min":0.74299999999999999},"min":{"1min":0.47399999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.81799999999999995,"5min":0.95999999999999996,"15min":1.6559999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.65700000000000003,"15min":0.745},"min":{"1min":0.41999999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.90500000000000003,"5min":0.96999999999999997,"15min":1.3839999999999999},"last":0.48299999999999998}]},{"osd":6,"last update":"Fri Jul 14 11:19:15 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.68500000000000005,"15min":0.71299999999999997},"min":{"1min":0.45200000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.86799999999999999,"5min":1.1659999999999999,"15min":1.1970000000000001},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.73699999999999999,"15min":0.76600000000000001},"min":{"1min":0.56899999999999995,"5min":0.442,"15min":0.442},"max":{"1min":0.878,"5min":1.1479999999999999,"15min":1.3},"last":0.84099999999999997}]},{"osd":7,"last update":"Fri Jul 14 11:19:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.70499999999999996,"15min":0.755},"min":{"1min":0.47899999999999998,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.88,"5min":1.028,"15min":1.4810000000000001},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.755,"15min":0.82599999999999996},"min":{"1min":0.59099999999999997,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.82499999999999996,"5min":1.21,"15min":1.379},"last":0.71799999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574930,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28248,"kb_used_data":1296,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343592,"statfs":{"total":96636764160,"available":96607838208,"internally_reserved":0,"allocated":1327104,"data_stored":611679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:19:05 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.61899999999999999,"15min":0.63600000000000001},"min":{"1min":0.371,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.84199999999999997,"5min":0.996,"15min":1.3140000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65200000000000002,"15min":0.64000000000000001},"min":{"1min":0.42399999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":1.0980000000000001},"last":0.80900000000000005}]},{"osd":1,"last update":"Fri Jul 14 11:19:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.624,"15min":0.66400000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.75600000000000001,"5min":0.88800000000000001,"15min":1.343},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.63,"5min":0.65100000000000002,"15min":0.64800000000000002},"min":{"1min":0.442,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.86599999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.65500000000000003}]},{"osd":2,"last update":"Fri Jul 14 11:19:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.69899999999999995,"15min":0.72899999999999998},"min":{"1min":0.46700000000000003,"5min":0.436,"15min":0.436},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.70299999999999996,"15min":0.753},"min":{"1min":0.504,"5min":0.496,"15min":0.496},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":1.3939999999999999},"last":0.84099999999999997}]},{"osd":3,"last update":"Fri Jul 14 11:19:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71199999999999997,"15min":0.75600000000000001},"min":{"1min":0.54500000000000004,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":1.2130000000000001},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.67700000000000005,"15min":0.75700000000000001},"min":{"1min":0.46400000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":1.806},"last":0.72299999999999998}]},{"osd":4,"last update":"Fri Jul 14 11:19:05 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.61699999999999999,"15min":0.64600000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.878,"5min":1.0229999999999999,"15min":1.1319999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.66500000000000004,"15min":0.73699999999999999},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.3999999999999999},"last":0.53400000000000003}]},{"osd":6,"last update":"Fri Jul 14 11:19:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.69699999999999995,"15min":0.73999999999999999},"min":{"1min":0.502,"5min":0.435,"15min":0.435},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.73499999999999999,"15min":0.79000000000000004},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.004,"5min":1.0629999999999999,"15min":1.3640000000000001},"last":0.73599999999999999}]},{"osd":7,"last update":"Fri Jul 14 11:19:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.747,"15min":0.82999999999999996},"min":{"1min":0.54400000000000004,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.4970000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78500000000000003,"15min":0.85499999999999998},"min":{"1min":0.60399999999999998,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.8540000000000001},"last":0.58699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T11:19:34.255 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T11:19:34.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.459+0000 7f50e45ff700 1 Processor -- start 2023-07-14T11:19:34.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.459+0000 7f50e45ff700 1 -- start start 2023-07-14T11:19:34.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.460+0000 7f50e45ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f50dc15c950 0x7f50dc0b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:34.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.460+0000 7f50e45ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50dc0b1e00 0x7f50dc0d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:34.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.461+0000 7f50e45ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50dc0d2ce0 con 0x7f50dc0b2350 2023-07-14T11:19:34.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.461+0000 7f50e45ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50dc0b3350 con 0x7f50dc15c950 2023-07-14T11:19:34.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.461+0000 7f50e45ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50dc0b3630 con 0x7f50dc0b1e00 2023-07-14T11:19:34.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.461+0000 7f50e2b9c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f50dc0b2350 0x7f50dc0afac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55418/0 (socket says 172.21.15.84:55418) 2023-07-14T11:19:34.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.461+0000 7f50e2b9c700 1 -- 172.21.15.84:0/3097765327 learned_addr learned my addr 172.21.15.84:0/3097765327 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:19:34.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.461+0000 7f50e1b9a700 1 --2- 172.21.15.84:0/3097765327 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50dc0b1e00 0x7f50dc0d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:34.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.461+0000 7f50e239b700 1 --2- 172.21.15.84:0/3097765327 >> v2:172.21.15.179:3300/0 conn(0x7f50dc15c950 0x7f50dc0b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:34.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.461+0000 7f50e1399700 1 -- 172.21.15.84:0/3097765327 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 985205023 0 0) 0x7f50dc0d2ce0 con 0x7f50dc0b2350 2023-07-14T11:19:34.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.461+0000 7f50e1399700 1 -- 172.21.15.84:0/3097765327 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50c80035b0 con 0x7f50dc0b2350 2023-07-14T11:19:34.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.461+0000 7f50e1b9a700 1 -- 172.21.15.84:0/3097765327 >> v2:172.21.15.179:3300/0 conn(0x7f50dc15c950 msgr2=0x7f50dc0b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:34.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.461+0000 7f50e1b9a700 1 --2- 172.21.15.84:0/3097765327 >> v2:172.21.15.179:3300/0 conn(0x7f50dc15c950 0x7f50dc0b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:34.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.462+0000 7f50e1b9a700 1 -- 172.21.15.84:0/3097765327 >> v1:172.21.15.84:6789/0 conn(0x7f50dc0b2350 legacy=0x7f50dc0afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:34.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.462+0000 7f50e1b9a700 1 -- 172.21.15.84:0/3097765327 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50dc0b3910 con 0x7f50dc0b1e00 2023-07-14T11:19:34.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.462+0000 7f50e239b700 1 --2- 172.21.15.84:0/3097765327 >> v2:172.21.15.179:3300/0 conn(0x7f50dc15c950 0x7f50dc0b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:19:34.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.462+0000 7f50e1b9a700 1 --2- 172.21.15.84:0/3097765327 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50dc0b1e00 0x7f50dc0d0b10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f50cc009840 tx=0x7f50cc009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43ff8d0fed0f0153 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:34.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.462+0000 7f50e1399700 1 -- 172.21.15.84:0/3097765327 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50cc011830 con 0x7f50dc0b1e00 2023-07-14T11:19:34.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.462+0000 7f50e1399700 1 -- 172.21.15.84:0/3097765327 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50cc011990 con 0x7f50dc0b1e00 2023-07-14T11:19:34.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.462+0000 7f50e1399700 1 -- 172.21.15.84:0/3097765327 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50cc011d00 con 0x7f50dc0b1e00 2023-07-14T11:19:34.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.463+0000 7f50e45ff700 1 -- 172.21.15.84:0/3097765327 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50dc0b1e00 msgr2=0x7f50dc0d0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:34.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.463+0000 7f50e45ff700 1 --2- 172.21.15.84:0/3097765327 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50dc0b1e00 0x7f50dc0d0b10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f50cc009840 tx=0x7f50cc009b50 comp rx=0 tx=0).stop 2023-07-14T11:19:34.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.463+0000 7f50e45ff700 1 -- 172.21.15.84:0/3097765327 shutdown_connections 2023-07-14T11:19:34.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.463+0000 7f50e45ff700 1 --2- 172.21.15.84:0/3097765327 >> v2:172.21.15.179:3300/0 conn(0x7f50dc15c950 0x7f50dc0b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:34.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.463+0000 7f50e45ff700 1 --2- 172.21.15.84:0/3097765327 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50dc0b1e00 0x7f50dc0d0b10 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:34.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.463+0000 7f50e45ff700 1 -- 172.21.15.84:0/3097765327 >> 172.21.15.84:0/3097765327 conn(0x7f50dc09c1d0 msgr2=0x7f50dc0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:34.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.463+0000 7f50e45ff700 1 -- 172.21.15.84:0/3097765327 shutdown_connections 2023-07-14T11:19:34.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.463+0000 7f50e45ff700 1 -- 172.21.15.84:0/3097765327 wait complete. 2023-07-14T11:19:34.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.465+0000 7f50e45ff700 1 Processor -- start 2023-07-14T11:19:34.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.465+0000 7f50e45ff700 1 -- start start 2023-07-14T11:19:34.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.466+0000 7f50e45ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50dc0b1e00 0x7f50dc149440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:34.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.466+0000 7f50e45ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50dc0b2350 0x7f50dc15b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:34.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.466+0000 7f50e45ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50dc15c950 0x7f50dc155bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:34.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.466+0000 7f50e45ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50dc0b6b50 con 0x7f50dc15c950 2023-07-14T11:19:34.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.466+0000 7f50e45ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50dc0b5f10 con 0x7f50dc0b1e00 2023-07-14T11:19:34.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.466+0000 7f50e45ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50dc0b61b0 con 0x7f50dc0b2350 2023-07-14T11:19:34.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.466+0000 7f50e2b9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50dc15c950 0x7f50dc155bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:34.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.466+0000 7f50e2b9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50dc15c950 0x7f50dc155bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40788/0 (socket says 172.21.15.84:40788) 2023-07-14T11:19:34.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.466+0000 7f50e2b9c700 1 -- 172.21.15.84:0/614021568 learned_addr learned my addr 172.21.15.84:0/614021568 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:34.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.466+0000 7f50e1b9a700 1 --2- 172.21.15.84:0/614021568 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50dc0b2350 0x7f50dc15b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:34.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.466+0000 7f50e239b700 1 --2- 172.21.15.84:0/614021568 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50dc0b1e00 0x7f50dc149440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:34.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.466+0000 7f50e2b9c700 1 -- 172.21.15.84:0/614021568 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50dc0b2350 msgr2=0x7f50dc15b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:34.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.466+0000 7f50e2b9c700 1 --2- 172.21.15.84:0/614021568 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50dc0b2350 0x7f50dc15b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:34.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.466+0000 7f50e2b9c700 1 -- 172.21.15.84:0/614021568 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50dc0b1e00 msgr2=0x7f50dc149440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:34.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.466+0000 7f50e2b9c700 1 --2- 172.21.15.84:0/614021568 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50dc0b1e00 0x7f50dc149440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:34.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.466+0000 7f50e2b9c700 1 -- 172.21.15.84:0/614021568 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50d8009430 con 0x7f50dc15c950 2023-07-14T11:19:34.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.467+0000 7f50e2b9c700 1 --2- 172.21.15.84:0/614021568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50dc15c950 0x7f50dc155bf0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f50d400cb40 tx=0x7f50d400ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:34.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.467+0000 7f50d2ffd700 1 -- 172.21.15.84:0/614021568 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d400a9e0 con 0x7f50dc15c950 2023-07-14T11:19:34.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.467+0000 7f50d2ffd700 1 -- 172.21.15.84:0/614021568 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50d400ab40 con 0x7f50dc15c950 2023-07-14T11:19:34.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.467+0000 7f50d2ffd700 1 -- 172.21.15.84:0/614021568 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d4012400 con 0x7f50dc15c950 2023-07-14T11:19:34.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.467+0000 7f50e45ff700 1 -- 172.21.15.84:0/614021568 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50cc0094a0 con 0x7f50dc15c950 2023-07-14T11:19:34.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.467+0000 7f50e45ff700 1 -- 172.21.15.84:0/614021568 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50dc0b6770 con 0x7f50dc15c950 2023-07-14T11:19:34.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.468+0000 7f50e45ff700 1 -- 172.21.15.84:0/614021568 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50dc0b6c90 con 0x7f50dc15c950 2023-07-14T11:19:34.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.469+0000 7f50d2ffd700 1 -- 172.21.15.84:0/614021568 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f50d401b3b0 con 0x7f50dc15c950 2023-07-14T11:19:34.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.470+0000 7f50d2ffd700 1 --2- 172.21.15.84:0/614021568 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f50c006ae00 0x7f50c006d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:34.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.470+0000 7f50d2ffd700 1 -- 172.21.15.84:0/614021568 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f50d4089160 con 0x7f50dc15c950 2023-07-14T11:19:34.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.471+0000 7f50e239b700 1 --2- 172.21.15.84:0/614021568 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f50c006ae00 0x7f50c006d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:34.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.471+0000 7f50e239b700 1 --2- 172.21.15.84:0/614021568 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f50c006ae00 0x7f50c006d2b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f50dc15b250 tx=0x7f50d80091c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:34.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.474+0000 7f50d2ffd700 1 -- 172.21.15.84:0/614021568 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f50dc0b6c90 con 0x7f50dc15c950 2023-07-14T11:19:34.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.662+0000 7f50e45ff700 1 -- 172.21.15.84:0/614021568 --> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f50dc0b3ed0 con 0x7f50c006ae00 2023-07-14T11:19:34.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.671+0000 7f50d2ffd700 1 -- 172.21.15.84:0/614021568 <== mgr.4100 v2:172.21.15.179:6836/2094253834 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311357 (secure 0 0 0) 0x7f50d8009e70 con 0x7f50c006ae00 2023-07-14T11:19:34.677 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:19:34.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.676+0000 7f50e45ff700 1 -- 172.21.15.84:0/614021568 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f50c006ae00 msgr2=0x7f50c006d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:34.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.676+0000 7f50e45ff700 1 --2- 172.21.15.84:0/614021568 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f50c006ae00 0x7f50c006d2b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f50dc15b250 tx=0x7f50d80091c0 comp rx=0 tx=0).stop 2023-07-14T11:19:34.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.676+0000 7f50e45ff700 1 -- 172.21.15.84:0/614021568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50dc15c950 msgr2=0x7f50dc155bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:34.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.676+0000 7f50e45ff700 1 --2- 172.21.15.84:0/614021568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50dc15c950 0x7f50dc155bf0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f50d400cb40 tx=0x7f50d400ce50 comp rx=0 tx=0).stop 2023-07-14T11:19:34.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.676+0000 7f50e45ff700 1 -- 172.21.15.84:0/614021568 shutdown_connections 2023-07-14T11:19:34.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.676+0000 7f50e45ff700 1 --2- 172.21.15.84:0/614021568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50dc15c950 0x7f50dc155bf0 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:34.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.676+0000 7f50e45ff700 1 --2- 172.21.15.84:0/614021568 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50dc0b1e00 0x7f50dc149440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:34.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.676+0000 7f50e45ff700 1 --2- 172.21.15.84:0/614021568 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f50c006ae00 0x7f50c006d2b0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:34.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.676+0000 7f50e45ff700 1 --2- 172.21.15.84:0/614021568 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50dc0b2350 0x7f50dc15b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:34.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.676+0000 7f50e45ff700 1 -- 172.21.15.84:0/614021568 >> 172.21.15.84:0/614021568 conn(0x7f50dc09c1d0 msgr2=0x7f50dc0b13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:34.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.676+0000 7f50e45ff700 1 -- 172.21.15.84:0/614021568 shutdown_connections 2023-07-14T11:19:34.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.676+0000 7f50e45ff700 1 -- 172.21.15.84:0/614021568 wait complete. 2023-07-14T11:19:34.681 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-07-14T11:19:34.697 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2023-07-14T11:19:32.938898+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":223,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":166,"ondisk_log_size":166,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":187,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231240,"kb_used_data":11528,"kb_used_omap":0,"kb_used_meta":219648,"kb_avail":754743480,"statfs":{"total":773094113280,"available":772857323520,"internally_reserved":0,"allocated":11804672,"data_stored":6077612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":224919552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002248"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967358+0000","last_change":"2023-07-14T11:19:24.976160+0000","last_active":"2023-07-14T11:19:25.967358+0000","last_peered":"2023-07-14T11:19:25.967358+0000","last_clean":"2023-07-14T11:19:25.967358+0000","last_became_active":"2023-07-14T11:19:24.975861+0000","last_became_peered":"2023-07-14T11:19:24.975861+0000","last_unstale":"2023-07-14T11:19:25.967358+0000","last_undegraded":"2023-07-14T11:19:25.967358+0000","last_fullsized":"2023-07-14T11:19:25.967358+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:52:51.076969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.399879+0000","last_change":"2023-07-14T11:19:24.979084+0000","last_active":"2023-07-14T11:19:27.399879+0000","last_peered":"2023-07-14T11:19:27.399879+0000","last_clean":"2023-07-14T11:19:27.399879+0000","last_became_active":"2023-07-14T11:19:24.978793+0000","last_became_peered":"2023-07-14T11:19:24.978793+0000","last_unstale":"2023-07-14T11:19:27.399879+0000","last_undegraded":"2023-07-14T11:19:27.399879+0000","last_fullsized":"2023-07-14T11:19:27.399879+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:24:25.883979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400493+0000","last_change":"2023-07-14T11:19:24.974510+0000","last_active":"2023-07-14T11:19:27.400493+0000","last_peered":"2023-07-14T11:19:27.400493+0000","last_clean":"2023-07-14T11:19:27.400493+0000","last_became_active":"2023-07-14T11:19:24.974190+0000","last_became_peered":"2023-07-14T11:19:24.974190+0000","last_unstale":"2023-07-14T11:19:27.400493+0000","last_undegraded":"2023-07-14T11:19:27.400493+0000","last_fullsized":"2023-07-14T11:19:27.400493+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:16:14.096108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400652+0000","last_change":"2023-07-14T11:19:24.988874+0000","last_active":"2023-07-14T11:19:27.400652+0000","last_peered":"2023-07-14T11:19:27.400652+0000","last_clean":"2023-07-14T11:19:27.400652+0000","last_became_active":"2023-07-14T11:19:24.988026+0000","last_became_peered":"2023-07-14T11:19:24.988026+0000","last_unstale":"2023-07-14T11:19:27.400652+0000","last_undegraded":"2023-07-14T11:19:27.400652+0000","last_fullsized":"2023-07-14T11:19:27.400652+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:42:21.619441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967158+0000","last_change":"2023-07-14T11:19:24.975419+0000","last_active":"2023-07-14T11:19:25.967158+0000","last_peered":"2023-07-14T11:19:25.967158+0000","last_clean":"2023-07-14T11:19:25.967158+0000","last_became_active":"2023-07-14T11:19:24.975150+0000","last_became_peered":"2023-07-14T11:19:24.975150+0000","last_unstale":"2023-07-14T11:19:25.967158+0000","last_undegraded":"2023-07-14T11:19:25.967158+0000","last_fullsized":"2023-07-14T11:19:25.967158+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:06:39.320547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400149+0000","last_change":"2023-07-14T11:19:24.980389+0000","last_active":"2023-07-14T11:19:27.400149+0000","last_peered":"2023-07-14T11:19:27.400149+0000","last_clean":"2023-07-14T11:19:27.400149+0000","last_became_active":"2023-07-14T11:19:24.980134+0000","last_became_peered":"2023-07-14T11:19:24.980134+0000","last_unstale":"2023-07-14T11:19:27.400149+0000","last_undegraded":"2023-07-14T11:19:27.400149+0000","last_fullsized":"2023-07-14T11:19:27.400149+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:53:15.231674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400689+0000","last_change":"2023-07-14T11:19:24.980001+0000","last_active":"2023-07-14T11:19:27.400689+0000","last_peered":"2023-07-14T11:19:27.400689+0000","last_clean":"2023-07-14T11:19:27.400689+0000","last_became_active":"2023-07-14T11:19:24.979653+0000","last_became_peered":"2023-07-14T11:19:24.979653+0000","last_unstale":"2023-07-14T11:19:27.400689+0000","last_undegraded":"2023-07-14T11:19:27.400689+0000","last_fullsized":"2023-07-14T11:19:27.400689+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:14:55.889716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.401574+0000","last_change":"2023-07-14T11:19:24.977426+0000","last_active":"2023-07-14T11:19:27.401574+0000","last_peered":"2023-07-14T11:19:27.401574+0000","last_clean":"2023-07-14T11:19:27.401574+0000","last_became_active":"2023-07-14T11:19:24.977139+0000","last_became_peered":"2023-07-14T11:19:24.977139+0000","last_unstale":"2023-07-14T11:19:27.401574+0000","last_undegraded":"2023-07-14T11:19:27.401574+0000","last_fullsized":"2023-07-14T11:19:27.401574+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:06:02.853066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.401069+0000","last_change":"2023-07-14T11:19:24.988772+0000","last_active":"2023-07-14T11:19:27.401069+0000","last_peered":"2023-07-14T11:19:27.401069+0000","last_clean":"2023-07-14T11:19:27.401069+0000","last_became_active":"2023-07-14T11:19:24.988420+0000","last_became_peered":"2023-07-14T11:19:24.988420+0000","last_unstale":"2023-07-14T11:19:27.401069+0000","last_undegraded":"2023-07-14T11:19:27.401069+0000","last_fullsized":"2023-07-14T11:19:27.401069+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:53:46.190423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.964603+0000","last_change":"2023-07-14T11:19:24.986113+0000","last_active":"2023-07-14T11:19:25.964603+0000","last_peered":"2023-07-14T11:19:25.964603+0000","last_clean":"2023-07-14T11:19:25.964603+0000","last_became_active":"2023-07-14T11:19:24.985802+0000","last_became_peered":"2023-07-14T11:19:24.985802+0000","last_unstale":"2023-07-14T11:19:25.964603+0000","last_undegraded":"2023-07-14T11:19:25.964603+0000","last_fullsized":"2023-07-14T11:19:25.964603+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:48:20.004928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.966858+0000","last_change":"2023-07-14T11:19:24.981712+0000","last_active":"2023-07-14T11:19:25.966858+0000","last_peered":"2023-07-14T11:19:25.966858+0000","last_clean":"2023-07-14T11:19:25.966858+0000","last_became_active":"2023-07-14T11:19:24.981417+0000","last_became_peered":"2023-07-14T11:19:24.981417+0000","last_unstale":"2023-07-14T11:19:25.966858+0000","last_undegraded":"2023-07-14T11:19:25.966858+0000","last_fullsized":"2023-07-14T11:19:25.966858+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:52:06.185710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.401119+0000","last_change":"2023-07-14T11:19:24.981753+0000","last_active":"2023-07-14T11:19:27.401119+0000","last_peered":"2023-07-14T11:19:27.401119+0000","last_clean":"2023-07-14T11:19:27.401119+0000","last_became_active":"2023-07-14T11:19:24.980821+0000","last_became_peered":"2023-07-14T11:19:24.980821+0000","last_unstale":"2023-07-14T11:19:27.401119+0000","last_undegraded":"2023-07-14T11:19:27.401119+0000","last_fullsized":"2023-07-14T11:19:27.401119+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:17:28.127989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.964356+0000","last_change":"2023-07-14T11:19:24.969706+0000","last_active":"2023-07-14T11:19:25.964356+0000","last_peered":"2023-07-14T11:19:25.964356+0000","last_clean":"2023-07-14T11:19:25.964356+0000","last_became_active":"2023-07-14T11:19:24.969426+0000","last_became_peered":"2023-07-14T11:19:24.969426+0000","last_unstale":"2023-07-14T11:19:25.964356+0000","last_undegraded":"2023-07-14T11:19:25.964356+0000","last_fullsized":"2023-07-14T11:19:25.964356+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:45:06.308741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400652+0000","last_change":"2023-07-14T11:19:24.972352+0000","last_active":"2023-07-14T11:19:27.400652+0000","last_peered":"2023-07-14T11:19:27.400652+0000","last_clean":"2023-07-14T11:19:27.400652+0000","last_became_active":"2023-07-14T11:19:24.972057+0000","last_became_peered":"2023-07-14T11:19:24.972057+0000","last_unstale":"2023-07-14T11:19:27.400652+0000","last_undegraded":"2023-07-14T11:19:27.400652+0000","last_fullsized":"2023-07-14T11:19:27.400652+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:45:44.234075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967511+0000","last_change":"2023-07-14T11:19:24.981766+0000","last_active":"2023-07-14T11:19:25.967511+0000","last_peered":"2023-07-14T11:19:25.967511+0000","last_clean":"2023-07-14T11:19:25.967511+0000","last_became_active":"2023-07-14T11:19:24.981081+0000","last_became_peered":"2023-07-14T11:19:24.981081+0000","last_unstale":"2023-07-14T11:19:25.967511+0000","last_undegraded":"2023-07-14T11:19:25.967511+0000","last_fullsized":"2023-07-14T11:19:25.967511+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:53:41.464458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400197+0000","last_change":"2023-07-14T11:19:24.980504+0000","last_active":"2023-07-14T11:19:27.400197+0000","last_peered":"2023-07-14T11:19:27.400197+0000","last_clean":"2023-07-14T11:19:27.400197+0000","last_became_active":"2023-07-14T11:19:24.980260+0000","last_became_peered":"2023-07-14T11:19:24.980260+0000","last_unstale":"2023-07-14T11:19:27.400197+0000","last_undegraded":"2023-07-14T11:19:27.400197+0000","last_fullsized":"2023-07-14T11:19:27.400197+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:14:30.331432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.964757+0000","last_change":"2023-07-14T11:19:24.974486+0000","last_active":"2023-07-14T11:19:25.964757+0000","last_peered":"2023-07-14T11:19:25.964757+0000","last_clean":"2023-07-14T11:19:25.964757+0000","last_became_active":"2023-07-14T11:19:24.974200+0000","last_became_peered":"2023-07-14T11:19:24.974200+0000","last_unstale":"2023-07-14T11:19:25.964757+0000","last_undegraded":"2023-07-14T11:19:25.964757+0000","last_fullsized":"2023-07-14T11:19:25.964757+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:24:28.100458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400004+0000","last_change":"2023-07-14T11:19:24.971933+0000","last_active":"2023-07-14T11:19:27.400004+0000","last_peered":"2023-07-14T11:19:27.400004+0000","last_clean":"2023-07-14T11:19:27.400004+0000","last_became_active":"2023-07-14T11:19:24.971600+0000","last_became_peered":"2023-07-14T11:19:24.971600+0000","last_unstale":"2023-07-14T11:19:27.400004+0000","last_undegraded":"2023-07-14T11:19:27.400004+0000","last_fullsized":"2023-07-14T11:19:27.400004+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:08:27.837698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:26.811879+0000","last_change":"2023-07-14T11:19:24.983027+0000","last_active":"2023-07-14T11:19:26.811879+0000","last_peered":"2023-07-14T11:19:26.811879+0000","last_clean":"2023-07-14T11:19:26.811879+0000","last_became_active":"2023-07-14T11:19:24.982724+0000","last_became_peered":"2023-07-14T11:19:24.982724+0000","last_unstale":"2023-07-14T11:19:26.811879+0000","last_undegraded":"2023-07-14T11:19:26.811879+0000","last_fullsized":"2023-07-14T11:19:26.811879+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:16:14.889261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400466+0000","last_change":"2023-07-14T11:19:24.990479+0000","last_active":"2023-07-14T11:19:27.400466+0000","last_peered":"2023-07-14T11:19:27.400466+0000","last_clean":"2023-07-14T11:19:27.400466+0000","last_became_active":"2023-07-14T11:19:24.990017+0000","last_became_peered":"2023-07-14T11:19:24.990017+0000","last_unstale":"2023-07-14T11:19:27.400466+0000","last_undegraded":"2023-07-14T11:19:27.400466+0000","last_fullsized":"2023-07-14T11:19:27.400466+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:06:38.269911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400663+0000","last_change":"2023-07-14T11:19:24.980376+0000","last_active":"2023-07-14T11:19:27.400663+0000","last_peered":"2023-07-14T11:19:27.400663+0000","last_clean":"2023-07-14T11:19:27.400663+0000","last_became_active":"2023-07-14T11:19:24.980042+0000","last_became_peered":"2023-07-14T11:19:24.980042+0000","last_unstale":"2023-07-14T11:19:27.400663+0000","last_undegraded":"2023-07-14T11:19:27.400663+0000","last_fullsized":"2023-07-14T11:19:27.400663+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:12:35.031686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967103+0000","last_change":"2023-07-14T11:19:24.983855+0000","last_active":"2023-07-14T11:19:25.967103+0000","last_peered":"2023-07-14T11:19:25.967103+0000","last_clean":"2023-07-14T11:19:25.967103+0000","last_became_active":"2023-07-14T11:19:24.983432+0000","last_became_peered":"2023-07-14T11:19:24.983432+0000","last_unstale":"2023-07-14T11:19:25.967103+0000","last_undegraded":"2023-07-14T11:19:25.967103+0000","last_fullsized":"2023-07-14T11:19:25.967103+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:10:43.341934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400752+0000","last_change":"2023-07-14T11:19:24.971669+0000","last_active":"2023-07-14T11:19:27.400752+0000","last_peered":"2023-07-14T11:19:27.400752+0000","last_clean":"2023-07-14T11:19:27.400752+0000","last_became_active":"2023-07-14T11:19:24.971394+0000","last_became_peered":"2023-07-14T11:19:24.971394+0000","last_unstale":"2023-07-14T11:19:27.400752+0000","last_undegraded":"2023-07-14T11:19:27.400752+0000","last_fullsized":"2023-07-14T11:19:27.400752+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:27:45.819918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967396+0000","last_change":"2023-07-14T11:19:24.975332+0000","last_active":"2023-07-14T11:19:25.967396+0000","last_peered":"2023-07-14T11:19:25.967396+0000","last_clean":"2023-07-14T11:19:25.967396+0000","last_became_active":"2023-07-14T11:19:24.974888+0000","last_became_peered":"2023-07-14T11:19:24.974888+0000","last_unstale":"2023-07-14T11:19:25.967396+0000","last_undegraded":"2023-07-14T11:19:25.967396+0000","last_fullsized":"2023-07-14T11:19:25.967396+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:27:43.025658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.968145+0000","last_change":"2023-07-14T11:19:24.986904+0000","last_active":"2023-07-14T11:19:25.968145+0000","last_peered":"2023-07-14T11:19:25.968145+0000","last_clean":"2023-07-14T11:19:25.968145+0000","last_became_active":"2023-07-14T11:19:24.986246+0000","last_became_peered":"2023-07-14T11:19:24.986246+0000","last_unstale":"2023-07-14T11:19:25.968145+0000","last_undegraded":"2023-07-14T11:19:25.968145+0000","last_fullsized":"2023-07-14T11:19:25.968145+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:36:57.980619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400824+0000","last_change":"2023-07-14T11:19:24.980011+0000","last_active":"2023-07-14T11:19:27.400824+0000","last_peered":"2023-07-14T11:19:27.400824+0000","last_clean":"2023-07-14T11:19:27.400824+0000","last_became_active":"2023-07-14T11:19:24.979707+0000","last_became_peered":"2023-07-14T11:19:24.979707+0000","last_unstale":"2023-07-14T11:19:27.400824+0000","last_undegraded":"2023-07-14T11:19:27.400824+0000","last_fullsized":"2023-07-14T11:19:27.400824+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:20:25.338974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:26.811918+0000","last_change":"2023-07-14T11:19:24.990440+0000","last_active":"2023-07-14T11:19:26.811918+0000","last_peered":"2023-07-14T11:19:26.811918+0000","last_clean":"2023-07-14T11:19:26.811918+0000","last_became_active":"2023-07-14T11:19:24.990146+0000","last_became_peered":"2023-07-14T11:19:24.990146+0000","last_unstale":"2023-07-14T11:19:26.811918+0000","last_undegraded":"2023-07-14T11:19:26.811918+0000","last_fullsized":"2023-07-14T11:19:26.811918+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:12:15.517874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400991+0000","last_change":"2023-07-14T11:19:24.982086+0000","last_active":"2023-07-14T11:19:27.400991+0000","last_peered":"2023-07-14T11:19:27.400991+0000","last_clean":"2023-07-14T11:19:27.400991+0000","last_became_active":"2023-07-14T11:19:24.981377+0000","last_became_peered":"2023-07-14T11:19:24.981377+0000","last_unstale":"2023-07-14T11:19:27.400991+0000","last_undegraded":"2023-07-14T11:19:27.400991+0000","last_fullsized":"2023-07-14T11:19:27.400991+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:19:51.206070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.399944+0000","last_change":"2023-07-14T11:19:24.984485+0000","last_active":"2023-07-14T11:19:27.399944+0000","last_peered":"2023-07-14T11:19:27.399944+0000","last_clean":"2023-07-14T11:19:27.399944+0000","last_became_active":"2023-07-14T11:19:24.984144+0000","last_became_peered":"2023-07-14T11:19:24.984144+0000","last_unstale":"2023-07-14T11:19:27.399944+0000","last_undegraded":"2023-07-14T11:19:27.399944+0000","last_fullsized":"2023-07-14T11:19:27.399944+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:41:49.903922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400784+0000","last_change":"2023-07-14T11:19:24.977658+0000","last_active":"2023-07-14T11:19:27.400784+0000","last_peered":"2023-07-14T11:19:27.400784+0000","last_clean":"2023-07-14T11:19:27.400784+0000","last_became_active":"2023-07-14T11:19:24.977318+0000","last_became_peered":"2023-07-14T11:19:24.977318+0000","last_unstale":"2023-07-14T11:19:27.400784+0000","last_undegraded":"2023-07-14T11:19:27.400784+0000","last_fullsized":"2023-07-14T11:19:27.400784+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:55:42.440468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967193+0000","last_change":"2023-07-14T11:19:24.981395+0000","last_active":"2023-07-14T11:19:25.967193+0000","last_peered":"2023-07-14T11:19:25.967193+0000","last_clean":"2023-07-14T11:19:25.967193+0000","last_became_active":"2023-07-14T11:19:24.980523+0000","last_became_peered":"2023-07-14T11:19:24.980523+0000","last_unstale":"2023-07-14T11:19:25.967193+0000","last_undegraded":"2023-07-14T11:19:25.967193+0000","last_fullsized":"2023-07-14T11:19:25.967193+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:04:50.668701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.966856+0000","last_change":"2023-07-14T11:19:24.975124+0000","last_active":"2023-07-14T11:19:25.966856+0000","last_peered":"2023-07-14T11:19:25.966856+0000","last_clean":"2023-07-14T11:19:25.966856+0000","last_became_active":"2023-07-14T11:19:24.974559+0000","last_became_peered":"2023-07-14T11:19:24.974559+0000","last_unstale":"2023-07-14T11:19:25.966856+0000","last_undegraded":"2023-07-14T11:19:25.966856+0000","last_fullsized":"2023-07-14T11:19:25.966856+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:05:30.379389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.964378+0000","last_change":"2023-07-14T11:19:24.985367+0000","last_active":"2023-07-14T11:19:25.964378+0000","last_peered":"2023-07-14T11:19:25.964378+0000","last_clean":"2023-07-14T11:19:25.964378+0000","last_became_active":"2023-07-14T11:19:24.984934+0000","last_became_peered":"2023-07-14T11:19:24.984934+0000","last_unstale":"2023-07-14T11:19:25.964378+0000","last_undegraded":"2023-07-14T11:19:25.964378+0000","last_fullsized":"2023-07-14T11:19:25.964378+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:30:06.079180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"105'4","reported_seq":17,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:26.811614+0000","last_change":"2023-07-14T11:19:23.970000+0000","last_active":"2023-07-14T11:19:26.811614+0000","last_peered":"2023-07-14T11:19:26.811614+0000","last_clean":"2023-07-14T11:19:26.811614+0000","last_became_active":"2023-07-14T11:19:23.969719+0000","last_became_peered":"2023-07-14T11:19:23.969719+0000","last_unstale":"2023-07-14T11:19:26.811614+0000","last_undegraded":"2023-07-14T11:19:26.811614+0000","last_fullsized":"2023-07-14T11:19:26.811614+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:05:30.102665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400906+0000","last_change":"2023-07-14T11:19:24.985452+0000","last_active":"2023-07-14T11:19:27.400906+0000","last_peered":"2023-07-14T11:19:27.400906+0000","last_clean":"2023-07-14T11:19:27.400906+0000","last_became_active":"2023-07-14T11:19:24.983795+0000","last_became_peered":"2023-07-14T11:19:24.983795+0000","last_unstale":"2023-07-14T11:19:27.400906+0000","last_undegraded":"2023-07-14T11:19:27.400906+0000","last_fullsized":"2023-07-14T11:19:27.400906+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:42:39.569277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"105'1","reported_seq":14,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.964705+0000","last_change":"2023-07-14T11:19:23.957148+0000","last_active":"2023-07-14T11:19:25.964705+0000","last_peered":"2023-07-14T11:19:25.964705+0000","last_clean":"2023-07-14T11:19:25.964705+0000","last_became_active":"2023-07-14T11:19:23.956826+0000","last_became_peered":"2023-07-14T11:19:23.956826+0000","last_unstale":"2023-07-14T11:19:25.964705+0000","last_undegraded":"2023-07-14T11:19:25.964705+0000","last_fullsized":"2023-07-14T11:19:25.964705+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:40:31.643180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967855+0000","last_change":"2023-07-14T11:19:24.981190+0000","last_active":"2023-07-14T11:19:25.967855+0000","last_peered":"2023-07-14T11:19:25.967855+0000","last_clean":"2023-07-14T11:19:25.967855+0000","last_became_active":"2023-07-14T11:19:24.980911+0000","last_became_peered":"2023-07-14T11:19:24.980911+0000","last_unstale":"2023-07-14T11:19:25.967855+0000","last_undegraded":"2023-07-14T11:19:25.967855+0000","last_fullsized":"2023-07-14T11:19:25.967855+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:45:06.083751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"105'2","reported_seq":15,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400961+0000","last_change":"2023-07-14T11:19:23.973008+0000","last_active":"2023-07-14T11:19:27.400961+0000","last_peered":"2023-07-14T11:19:27.400961+0000","last_clean":"2023-07-14T11:19:27.400961+0000","last_became_active":"2023-07-14T11:19:23.972497+0000","last_became_peered":"2023-07-14T11:19:23.972497+0000","last_unstale":"2023-07-14T11:19:27.400961+0000","last_undegraded":"2023-07-14T11:19:27.400961+0000","last_fullsized":"2023-07-14T11:19:27.400961+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:42:29.763419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.401102+0000","last_change":"2023-07-14T11:19:24.979467+0000","last_active":"2023-07-14T11:19:27.401102+0000","last_peered":"2023-07-14T11:19:27.401102+0000","last_clean":"2023-07-14T11:19:27.401102+0000","last_became_active":"2023-07-14T11:19:24.978621+0000","last_became_peered":"2023-07-14T11:19:24.978621+0000","last_unstale":"2023-07-14T11:19:27.401102+0000","last_undegraded":"2023-07-14T11:19:27.401102+0000","last_fullsized":"2023-07-14T11:19:27.401102+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:56:55.211407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"105'2","reported_seq":15,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.964353+0000","last_change":"2023-07-14T11:19:23.963900+0000","last_active":"2023-07-14T11:19:25.964353+0000","last_peered":"2023-07-14T11:19:25.964353+0000","last_clean":"2023-07-14T11:19:25.964353+0000","last_became_active":"2023-07-14T11:19:23.963623+0000","last_became_peered":"2023-07-14T11:19:23.963623+0000","last_unstale":"2023-07-14T11:19:25.964353+0000","last_undegraded":"2023-07-14T11:19:25.964353+0000","last_fullsized":"2023-07-14T11:19:25.964353+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:25:03.366408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.964152+0000","last_change":"2023-07-14T11:19:24.971636+0000","last_active":"2023-07-14T11:19:25.964152+0000","last_peered":"2023-07-14T11:19:25.964152+0000","last_clean":"2023-07-14T11:19:25.964152+0000","last_became_active":"2023-07-14T11:19:24.971328+0000","last_became_peered":"2023-07-14T11:19:24.971328+0000","last_unstale":"2023-07-14T11:19:25.964152+0000","last_undegraded":"2023-07-14T11:19:25.964152+0000","last_fullsized":"2023-07-14T11:19:25.964152+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:48:38.451247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"105'1","reported_seq":14,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967274+0000","last_change":"2023-07-14T11:19:23.962575+0000","last_active":"2023-07-14T11:19:25.967274+0000","last_peered":"2023-07-14T11:19:25.967274+0000","last_clean":"2023-07-14T11:19:25.967274+0000","last_became_active":"2023-07-14T11:19:23.962299+0000","last_became_peered":"2023-07-14T11:19:23.962299+0000","last_unstale":"2023-07-14T11:19:25.967274+0000","last_undegraded":"2023-07-14T11:19:25.967274+0000","last_fullsized":"2023-07-14T11:19:25.967274+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:56:49.505955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.966859+0000","last_change":"2023-07-14T11:19:24.981916+0000","last_active":"2023-07-14T11:19:25.966859+0000","last_peered":"2023-07-14T11:19:25.966859+0000","last_clean":"2023-07-14T11:19:25.966859+0000","last_became_active":"2023-07-14T11:19:24.981458+0000","last_became_peered":"2023-07-14T11:19:24.981458+0000","last_unstale":"2023-07-14T11:19:25.966859+0000","last_undegraded":"2023-07-14T11:19:25.966859+0000","last_fullsized":"2023-07-14T11:19:25.966859+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:33:58.183494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"105'1","reported_seq":14,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400247+0000","last_change":"2023-07-14T11:19:23.965613+0000","last_active":"2023-07-14T11:19:27.400247+0000","last_peered":"2023-07-14T11:19:27.400247+0000","last_clean":"2023-07-14T11:19:27.400247+0000","last_became_active":"2023-07-14T11:19:23.965357+0000","last_became_peered":"2023-07-14T11:19:23.965357+0000","last_unstale":"2023-07-14T11:19:27.400247+0000","last_undegraded":"2023-07-14T11:19:27.400247+0000","last_fullsized":"2023-07-14T11:19:27.400247+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:45:25.952053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400903+0000","last_change":"2023-07-14T11:19:24.968533+0000","last_active":"2023-07-14T11:19:27.400903+0000","last_peered":"2023-07-14T11:19:27.400903+0000","last_clean":"2023-07-14T11:19:27.400903+0000","last_became_active":"2023-07-14T11:19:24.967167+0000","last_became_peered":"2023-07-14T11:19:24.967167+0000","last_unstale":"2023-07-14T11:19:27.400903+0000","last_undegraded":"2023-07-14T11:19:27.400903+0000","last_fullsized":"2023-07-14T11:19:27.400903+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:36:37.305304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967284+0000","last_change":"2023-07-14T11:19:23.963545+0000","last_active":"2023-07-14T11:19:25.967284+0000","last_peered":"2023-07-14T11:19:25.967284+0000","last_clean":"2023-07-14T11:19:25.967284+0000","last_became_active":"2023-07-14T11:19:23.963258+0000","last_became_peered":"2023-07-14T11:19:23.963258+0000","last_unstale":"2023-07-14T11:19:25.967284+0000","last_undegraded":"2023-07-14T11:19:25.967284+0000","last_fullsized":"2023-07-14T11:19:25.967284+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:52:08.897066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.964495+0000","last_change":"2023-07-14T11:19:24.963229+0000","last_active":"2023-07-14T11:19:25.964495+0000","last_peered":"2023-07-14T11:19:25.964495+0000","last_clean":"2023-07-14T11:19:25.964495+0000","last_became_active":"2023-07-14T11:19:24.962953+0000","last_became_peered":"2023-07-14T11:19:24.962953+0000","last_unstale":"2023-07-14T11:19:25.964495+0000","last_undegraded":"2023-07-14T11:19:25.964495+0000","last_fullsized":"2023-07-14T11:19:25.964495+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:01:44.444334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400404+0000","last_change":"2023-07-14T11:19:23.967430+0000","last_active":"2023-07-14T11:19:27.400404+0000","last_peered":"2023-07-14T11:19:27.400404+0000","last_clean":"2023-07-14T11:19:27.400404+0000","last_became_active":"2023-07-14T11:19:23.967136+0000","last_became_peered":"2023-07-14T11:19:23.967136+0000","last_unstale":"2023-07-14T11:19:27.400404+0000","last_undegraded":"2023-07-14T11:19:27.400404+0000","last_fullsized":"2023-07-14T11:19:27.400404+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:52:17.347729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967669+0000","last_change":"2023-07-14T11:19:24.984882+0000","last_active":"2023-07-14T11:19:25.967669+0000","last_peered":"2023-07-14T11:19:25.967669+0000","last_clean":"2023-07-14T11:19:25.967669+0000","last_became_active":"2023-07-14T11:19:24.984584+0000","last_became_peered":"2023-07-14T11:19:24.984584+0000","last_unstale":"2023-07-14T11:19:25.967669+0000","last_undegraded":"2023-07-14T11:19:25.967669+0000","last_fullsized":"2023-07-14T11:19:25.967669+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:15:45.414169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"105'1","reported_seq":14,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.964627+0000","last_change":"2023-07-14T11:19:23.966279+0000","last_active":"2023-07-14T11:19:25.964627+0000","last_peered":"2023-07-14T11:19:25.964627+0000","last_clean":"2023-07-14T11:19:25.964627+0000","last_became_active":"2023-07-14T11:19:23.965983+0000","last_became_peered":"2023-07-14T11:19:23.965983+0000","last_unstale":"2023-07-14T11:19:25.964627+0000","last_undegraded":"2023-07-14T11:19:25.964627+0000","last_fullsized":"2023-07-14T11:19:25.964627+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:37:11.528205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967019+0000","last_change":"2023-07-14T11:19:24.976404+0000","last_active":"2023-07-14T11:19:25.967019+0000","last_peered":"2023-07-14T11:19:25.967019+0000","last_clean":"2023-07-14T11:19:25.967019+0000","last_became_active":"2023-07-14T11:19:24.975878+0000","last_became_peered":"2023-07-14T11:19:24.975878+0000","last_unstale":"2023-07-14T11:19:25.967019+0000","last_undegraded":"2023-07-14T11:19:25.967019+0000","last_fullsized":"2023-07-14T11:19:25.967019+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:35:40.868054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"105'2","reported_seq":15,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400912+0000","last_change":"2023-07-14T11:19:23.970931+0000","last_active":"2023-07-14T11:19:27.400912+0000","last_peered":"2023-07-14T11:19:27.400912+0000","last_clean":"2023-07-14T11:19:27.400912+0000","last_became_active":"2023-07-14T11:19:23.970611+0000","last_became_peered":"2023-07-14T11:19:23.970611+0000","last_unstale":"2023-07-14T11:19:27.400912+0000","last_undegraded":"2023-07-14T11:19:27.400912+0000","last_fullsized":"2023-07-14T11:19:27.400912+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:00:57.799054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.401192+0000","last_change":"2023-07-14T11:19:24.983441+0000","last_active":"2023-07-14T11:19:27.401192+0000","last_peered":"2023-07-14T11:19:27.401192+0000","last_clean":"2023-07-14T11:19:27.401192+0000","last_became_active":"2023-07-14T11:19:24.983143+0000","last_became_peered":"2023-07-14T11:19:24.983143+0000","last_unstale":"2023-07-14T11:19:27.401192+0000","last_undegraded":"2023-07-14T11:19:27.401192+0000","last_fullsized":"2023-07-14T11:19:27.401192+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:43:03.332951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"105'1","reported_seq":14,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400601+0000","last_change":"2023-07-14T11:19:23.969338+0000","last_active":"2023-07-14T11:19:27.400601+0000","last_peered":"2023-07-14T11:19:27.400601+0000","last_clean":"2023-07-14T11:19:27.400601+0000","last_became_active":"2023-07-14T11:19:23.969022+0000","last_became_peered":"2023-07-14T11:19:23.969022+0000","last_unstale":"2023-07-14T11:19:27.400601+0000","last_undegraded":"2023-07-14T11:19:27.400601+0000","last_fullsized":"2023-07-14T11:19:27.400601+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:45:59.478598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.968229+0000","last_change":"2023-07-14T11:19:24.981805+0000","last_active":"2023-07-14T11:19:25.968229+0000","last_peered":"2023-07-14T11:19:25.968229+0000","last_clean":"2023-07-14T11:19:25.968229+0000","last_became_active":"2023-07-14T11:19:24.981478+0000","last_became_peered":"2023-07-14T11:19:24.981478+0000","last_unstale":"2023-07-14T11:19:25.968229+0000","last_undegraded":"2023-07-14T11:19:25.968229+0000","last_fullsized":"2023-07-14T11:19:25.968229+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:52:18.355596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400630+0000","last_change":"2023-07-14T11:19:23.972003+0000","last_active":"2023-07-14T11:19:27.400630+0000","last_peered":"2023-07-14T11:19:27.400630+0000","last_clean":"2023-07-14T11:19:27.400630+0000","last_became_active":"2023-07-14T11:19:23.971667+0000","last_became_peered":"2023-07-14T11:19:23.971667+0000","last_unstale":"2023-07-14T11:19:27.400630+0000","last_undegraded":"2023-07-14T11:19:27.400630+0000","last_fullsized":"2023-07-14T11:19:27.400630+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:05:05.340223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400328+0000","last_change":"2023-07-14T11:19:24.982953+0000","last_active":"2023-07-14T11:19:27.400328+0000","last_peered":"2023-07-14T11:19:27.400328+0000","last_clean":"2023-07-14T11:19:27.400328+0000","last_became_active":"2023-07-14T11:19:24.982715+0000","last_became_peered":"2023-07-14T11:19:24.982715+0000","last_unstale":"2023-07-14T11:19:27.400328+0000","last_undegraded":"2023-07-14T11:19:27.400328+0000","last_fullsized":"2023-07-14T11:19:27.400328+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:36:57.980619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"105'2","reported_seq":15,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.399715+0000","last_change":"2023-07-14T11:19:23.969963+0000","last_active":"2023-07-14T11:19:27.399715+0000","last_peered":"2023-07-14T11:19:27.399715+0000","last_clean":"2023-07-14T11:19:27.399715+0000","last_became_active":"2023-07-14T11:19:23.969677+0000","last_became_peered":"2023-07-14T11:19:23.969677+0000","last_unstale":"2023-07-14T11:19:27.399715+0000","last_undegraded":"2023-07-14T11:19:27.399715+0000","last_fullsized":"2023-07-14T11:19:27.399715+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:45:05.075884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.401357+0000","last_change":"2023-07-14T11:19:24.975316+0000","last_active":"2023-07-14T11:19:27.401357+0000","last_peered":"2023-07-14T11:19:27.401357+0000","last_clean":"2023-07-14T11:19:27.401357+0000","last_became_active":"2023-07-14T11:19:24.974918+0000","last_became_peered":"2023-07-14T11:19:24.974918+0000","last_unstale":"2023-07-14T11:19:27.401357+0000","last_undegraded":"2023-07-14T11:19:27.401357+0000","last_fullsized":"2023-07-14T11:19:27.401357+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:43:47.804436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400524+0000","last_change":"2023-07-14T11:19:23.971157+0000","last_active":"2023-07-14T11:19:27.400524+0000","last_peered":"2023-07-14T11:19:27.400524+0000","last_clean":"2023-07-14T11:19:27.400524+0000","last_became_active":"2023-07-14T11:19:23.970829+0000","last_became_peered":"2023-07-14T11:19:23.970829+0000","last_unstale":"2023-07-14T11:19:27.400524+0000","last_undegraded":"2023-07-14T11:19:27.400524+0000","last_fullsized":"2023-07-14T11:19:27.400524+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:08:25.987616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.401018+0000","last_change":"2023-07-14T11:19:24.970037+0000","last_active":"2023-07-14T11:19:27.401018+0000","last_peered":"2023-07-14T11:19:27.401018+0000","last_clean":"2023-07-14T11:19:27.401018+0000","last_became_active":"2023-07-14T11:19:24.969739+0000","last_became_peered":"2023-07-14T11:19:24.969739+0000","last_unstale":"2023-07-14T11:19:27.401018+0000","last_undegraded":"2023-07-14T11:19:27.401018+0000","last_fullsized":"2023-07-14T11:19:27.401018+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:07:01.848428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.401464+0000","last_change":"2023-07-14T11:19:23.971167+0000","last_active":"2023-07-14T11:19:27.401464+0000","last_peered":"2023-07-14T11:19:27.401464+0000","last_clean":"2023-07-14T11:19:27.401464+0000","last_became_active":"2023-07-14T11:19:23.970900+0000","last_became_peered":"2023-07-14T11:19:23.970900+0000","last_unstale":"2023-07-14T11:19:27.401464+0000","last_undegraded":"2023-07-14T11:19:27.401464+0000","last_fullsized":"2023-07-14T11:19:27.401464+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:13:23.260979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967601+0000","last_change":"2023-07-14T11:19:24.978534+0000","last_active":"2023-07-14T11:19:25.967601+0000","last_peered":"2023-07-14T11:19:25.967601+0000","last_clean":"2023-07-14T11:19:25.967601+0000","last_became_active":"2023-07-14T11:19:24.978198+0000","last_became_peered":"2023-07-14T11:19:24.978198+0000","last_unstale":"2023-07-14T11:19:25.967601+0000","last_undegraded":"2023-07-14T11:19:25.967601+0000","last_fullsized":"2023-07-14T11:19:25.967601+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:28:09.892883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400246+0000","last_change":"2023-07-14T11:19:23.972513+0000","last_active":"2023-07-14T11:19:27.400246+0000","last_peered":"2023-07-14T11:19:27.400246+0000","last_clean":"2023-07-14T11:19:27.400246+0000","last_became_active":"2023-07-14T11:19:23.972139+0000","last_became_peered":"2023-07-14T11:19:23.972139+0000","last_unstale":"2023-07-14T11:19:27.400246+0000","last_undegraded":"2023-07-14T11:19:27.400246+0000","last_fullsized":"2023-07-14T11:19:27.400246+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:46:31.067778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.401189+0000","last_change":"2023-07-14T11:19:24.981929+0000","last_active":"2023-07-14T11:19:27.401189+0000","last_peered":"2023-07-14T11:19:27.401189+0000","last_clean":"2023-07-14T11:19:27.401189+0000","last_became_active":"2023-07-14T11:19:24.981116+0000","last_became_peered":"2023-07-14T11:19:24.981116+0000","last_unstale":"2023-07-14T11:19:27.401189+0000","last_undegraded":"2023-07-14T11:19:27.401189+0000","last_fullsized":"2023-07-14T11:19:27.401189+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:11:36.584744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"105'2","reported_seq":15,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400000+0000","last_change":"2023-07-14T11:19:23.964927+0000","last_active":"2023-07-14T11:19:27.400000+0000","last_peered":"2023-07-14T11:19:27.400000+0000","last_clean":"2023-07-14T11:19:27.400000+0000","last_became_active":"2023-07-14T11:19:23.964561+0000","last_became_peered":"2023-07-14T11:19:23.964561+0000","last_unstale":"2023-07-14T11:19:27.400000+0000","last_undegraded":"2023-07-14T11:19:27.400000+0000","last_fullsized":"2023-07-14T11:19:27.400000+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:56:43.945140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.964338+0000","last_change":"2023-07-14T11:19:24.971692+0000","last_active":"2023-07-14T11:19:25.964338+0000","last_peered":"2023-07-14T11:19:25.964338+0000","last_clean":"2023-07-14T11:19:25.964338+0000","last_became_active":"2023-07-14T11:19:24.971436+0000","last_became_peered":"2023-07-14T11:19:24.971436+0000","last_unstale":"2023-07-14T11:19:25.964338+0000","last_undegraded":"2023-07-14T11:19:25.964338+0000","last_fullsized":"2023-07-14T11:19:25.964338+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:57:11.662188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:26.811721+0000","last_change":"2023-07-14T11:19:23.972387+0000","last_active":"2023-07-14T11:19:26.811721+0000","last_peered":"2023-07-14T11:19:26.811721+0000","last_clean":"2023-07-14T11:19:26.811721+0000","last_became_active":"2023-07-14T11:19:23.971170+0000","last_became_peered":"2023-07-14T11:19:23.971170+0000","last_unstale":"2023-07-14T11:19:26.811721+0000","last_undegraded":"2023-07-14T11:19:26.811721+0000","last_fullsized":"2023-07-14T11:19:26.811721+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:05:34.687179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.401128+0000","last_change":"2023-07-14T11:19:24.989128+0000","last_active":"2023-07-14T11:19:27.401128+0000","last_peered":"2023-07-14T11:19:27.401128+0000","last_clean":"2023-07-14T11:19:27.401128+0000","last_became_active":"2023-07-14T11:19:24.988238+0000","last_became_peered":"2023-07-14T11:19:24.988238+0000","last_unstale":"2023-07-14T11:19:27.401128+0000","last_undegraded":"2023-07-14T11:19:27.401128+0000","last_fullsized":"2023-07-14T11:19:27.401128+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:12:11.724645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:26.811948+0000","last_change":"2023-07-14T11:19:23.971440+0000","last_active":"2023-07-14T11:19:26.811948+0000","last_peered":"2023-07-14T11:19:26.811948+0000","last_clean":"2023-07-14T11:19:26.811948+0000","last_became_active":"2023-07-14T11:19:23.971141+0000","last_became_peered":"2023-07-14T11:19:23.971141+0000","last_unstale":"2023-07-14T11:19:26.811948+0000","last_undegraded":"2023-07-14T11:19:26.811948+0000","last_fullsized":"2023-07-14T11:19:26.811948+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:53:13.795884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400005+0000","last_change":"2023-07-14T11:19:24.982564+0000","last_active":"2023-07-14T11:19:27.400005+0000","last_peered":"2023-07-14T11:19:27.400005+0000","last_clean":"2023-07-14T11:19:27.400005+0000","last_became_active":"2023-07-14T11:19:24.982238+0000","last_became_peered":"2023-07-14T11:19:24.982238+0000","last_unstale":"2023-07-14T11:19:27.400005+0000","last_undegraded":"2023-07-14T11:19:27.400005+0000","last_fullsized":"2023-07-14T11:19:27.400005+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:48:10.260203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.401208+0000","last_change":"2023-07-14T11:19:23.967504+0000","last_active":"2023-07-14T11:19:27.401208+0000","last_peered":"2023-07-14T11:19:27.401208+0000","last_clean":"2023-07-14T11:19:27.401208+0000","last_became_active":"2023-07-14T11:19:23.967103+0000","last_became_peered":"2023-07-14T11:19:23.967103+0000","last_unstale":"2023-07-14T11:19:27.401208+0000","last_undegraded":"2023-07-14T11:19:27.401208+0000","last_fullsized":"2023-07-14T11:19:27.401208+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:06:38.495123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400575+0000","last_change":"2023-07-14T11:19:24.980008+0000","last_active":"2023-07-14T11:19:27.400575+0000","last_peered":"2023-07-14T11:19:27.400575+0000","last_clean":"2023-07-14T11:19:27.400575+0000","last_became_active":"2023-07-14T11:19:24.979729+0000","last_became_peered":"2023-07-14T11:19:24.979729+0000","last_unstale":"2023-07-14T11:19:27.400575+0000","last_undegraded":"2023-07-14T11:19:27.400575+0000","last_fullsized":"2023-07-14T11:19:27.400575+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:59:22.004159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967419+0000","last_change":"2023-07-14T11:19:23.966672+0000","last_active":"2023-07-14T11:19:25.967419+0000","last_peered":"2023-07-14T11:19:25.967419+0000","last_clean":"2023-07-14T11:19:25.967419+0000","last_became_active":"2023-07-14T11:19:23.966360+0000","last_became_peered":"2023-07-14T11:19:23.966360+0000","last_unstale":"2023-07-14T11:19:25.967419+0000","last_undegraded":"2023-07-14T11:19:25.967419+0000","last_fullsized":"2023-07-14T11:19:25.967419+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:18:10.519816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.401434+0000","last_change":"2023-07-14T11:19:24.969545+0000","last_active":"2023-07-14T11:19:27.401434+0000","last_peered":"2023-07-14T11:19:27.401434+0000","last_clean":"2023-07-14T11:19:27.401434+0000","last_became_active":"2023-07-14T11:19:24.969283+0000","last_became_peered":"2023-07-14T11:19:24.969283+0000","last_unstale":"2023-07-14T11:19:27.401434+0000","last_undegraded":"2023-07-14T11:19:27.401434+0000","last_fullsized":"2023-07-14T11:19:27.401434+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:45:32.822142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967195+0000","last_change":"2023-07-14T11:19:23.965288+0000","last_active":"2023-07-14T11:19:25.967195+0000","last_peered":"2023-07-14T11:19:25.967195+0000","last_clean":"2023-07-14T11:19:25.967195+0000","last_became_active":"2023-07-14T11:19:23.965026+0000","last_became_peered":"2023-07-14T11:19:23.965026+0000","last_unstale":"2023-07-14T11:19:25.967195+0000","last_undegraded":"2023-07-14T11:19:25.967195+0000","last_fullsized":"2023-07-14T11:19:25.967195+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:01:26.582106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400398+0000","last_change":"2023-07-14T11:19:24.988882+0000","last_active":"2023-07-14T11:19:27.400398+0000","last_peered":"2023-07-14T11:19:27.400398+0000","last_clean":"2023-07-14T11:19:27.400398+0000","last_became_active":"2023-07-14T11:19:24.988506+0000","last_became_peered":"2023-07-14T11:19:24.988506+0000","last_unstale":"2023-07-14T11:19:27.400398+0000","last_undegraded":"2023-07-14T11:19:27.400398+0000","last_fullsized":"2023-07-14T11:19:27.400398+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:36:36.076442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400784+0000","last_change":"2023-07-14T11:19:23.967500+0000","last_active":"2023-07-14T11:19:27.400784+0000","last_peered":"2023-07-14T11:19:27.400784+0000","last_clean":"2023-07-14T11:19:27.400784+0000","last_became_active":"2023-07-14T11:19:23.967047+0000","last_became_peered":"2023-07-14T11:19:23.967047+0000","last_unstale":"2023-07-14T11:19:27.400784+0000","last_undegraded":"2023-07-14T11:19:27.400784+0000","last_fullsized":"2023-07-14T11:19:27.400784+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:28:25.198305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.964622+0000","last_change":"2023-07-14T11:19:24.975857+0000","last_active":"2023-07-14T11:19:25.964622+0000","last_peered":"2023-07-14T11:19:25.964622+0000","last_clean":"2023-07-14T11:19:25.964622+0000","last_became_active":"2023-07-14T11:19:24.975556+0000","last_became_peered":"2023-07-14T11:19:24.975556+0000","last_unstale":"2023-07-14T11:19:25.964622+0000","last_undegraded":"2023-07-14T11:19:25.964622+0000","last_fullsized":"2023-07-14T11:19:25.964622+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:02:11.711759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400246+0000","last_change":"2023-07-14T11:19:23.969220+0000","last_active":"2023-07-14T11:19:27.400246+0000","last_peered":"2023-07-14T11:19:27.400246+0000","last_clean":"2023-07-14T11:19:27.400246+0000","last_became_active":"2023-07-14T11:19:23.968907+0000","last_became_peered":"2023-07-14T11:19:23.968907+0000","last_unstale":"2023-07-14T11:19:27.400246+0000","last_undegraded":"2023-07-14T11:19:27.400246+0000","last_fullsized":"2023-07-14T11:19:27.400246+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:30:14.810287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.968126+0000","last_change":"2023-07-14T11:19:24.978612+0000","last_active":"2023-07-14T11:19:25.968126+0000","last_peered":"2023-07-14T11:19:25.968126+0000","last_clean":"2023-07-14T11:19:25.968126+0000","last_became_active":"2023-07-14T11:19:24.978260+0000","last_became_peered":"2023-07-14T11:19:24.978260+0000","last_unstale":"2023-07-14T11:19:25.968126+0000","last_undegraded":"2023-07-14T11:19:25.968126+0000","last_fullsized":"2023-07-14T11:19:25.968126+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:45:26.959920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"105'6","reported_seq":19,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400211+0000","last_change":"2023-07-14T11:19:23.965164+0000","last_active":"2023-07-14T11:19:27.400211+0000","last_peered":"2023-07-14T11:19:27.400211+0000","last_clean":"2023-07-14T11:19:27.400211+0000","last_became_active":"2023-07-14T11:19:23.964680+0000","last_became_peered":"2023-07-14T11:19:23.964680+0000","last_unstale":"2023-07-14T11:19:27.400211+0000","last_undegraded":"2023-07-14T11:19:27.400211+0000","last_fullsized":"2023-07-14T11:19:27.400211+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:22:16.518767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":167,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:26.811844+0000","last_change":"2023-07-14T11:13:08.762084+0000","last_active":"2023-07-14T11:19:26.811844+0000","last_peered":"2023-07-14T11:19:26.811844+0000","last_clean":"2023-07-14T11:19:26.811844+0000","last_became_active":"2023-07-14T11:13:08.761763+0000","last_became_peered":"2023-07-14T11:13:08.761763+0000","last_unstale":"2023-07-14T11:19:26.811844+0000","last_undegraded":"2023-07-14T11:19:26.811844+0000","last_fullsized":"2023-07-14T11:19:26.811844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:53:32.176184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400135+0000","last_change":"2023-07-14T11:19:24.971531+0000","last_active":"2023-07-14T11:19:27.400135+0000","last_peered":"2023-07-14T11:19:27.400135+0000","last_clean":"2023-07-14T11:19:27.400135+0000","last_became_active":"2023-07-14T11:19:24.971190+0000","last_became_peered":"2023-07-14T11:19:24.971190+0000","last_unstale":"2023-07-14T11:19:27.400135+0000","last_undegraded":"2023-07-14T11:19:27.400135+0000","last_fullsized":"2023-07-14T11:19:27.400135+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:01:25.077995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"105'3","reported_seq":16,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967842+0000","last_change":"2023-07-14T11:19:23.969233+0000","last_active":"2023-07-14T11:19:25.967842+0000","last_peered":"2023-07-14T11:19:25.967842+0000","last_clean":"2023-07-14T11:19:25.967842+0000","last_became_active":"2023-07-14T11:19:23.968938+0000","last_became_peered":"2023-07-14T11:19:23.968938+0000","last_unstale":"2023-07-14T11:19:25.967842+0000","last_undegraded":"2023-07-14T11:19:25.967842+0000","last_fullsized":"2023-07-14T11:19:25.967842+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:53:14.223807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":187,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.964710+0000","last_change":"2023-07-14T11:13:08.761726+0000","last_active":"2023-07-14T11:19:25.964710+0000","last_peered":"2023-07-14T11:19:25.964710+0000","last_clean":"2023-07-14T11:19:25.964710+0000","last_became_active":"2023-07-14T11:13:08.761365+0000","last_became_peered":"2023-07-14T11:13:08.761365+0000","last_unstale":"2023-07-14T11:19:25.964710+0000","last_undegraded":"2023-07-14T11:19:25.964710+0000","last_fullsized":"2023-07-14T11:19:25.964710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:19:34.910190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967811+0000","last_change":"2023-07-14T11:19:24.985128+0000","last_active":"2023-07-14T11:19:25.967811+0000","last_peered":"2023-07-14T11:19:25.967811+0000","last_clean":"2023-07-14T11:19:25.967811+0000","last_became_active":"2023-07-14T11:19:24.984814+0000","last_became_peered":"2023-07-14T11:19:24.984814+0000","last_unstale":"2023-07-14T11:19:25.967811+0000","last_undegraded":"2023-07-14T11:19:25.967811+0000","last_fullsized":"2023-07-14T11:19:25.967811+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:37:46.235964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.968001+0000","last_change":"2023-07-14T11:19:23.959733+0000","last_active":"2023-07-14T11:19:25.968001+0000","last_peered":"2023-07-14T11:19:25.968001+0000","last_clean":"2023-07-14T11:19:25.968001+0000","last_became_active":"2023-07-14T11:19:23.959449+0000","last_became_peered":"2023-07-14T11:19:23.959449+0000","last_unstale":"2023-07-14T11:19:25.968001+0000","last_undegraded":"2023-07-14T11:19:25.968001+0000","last_fullsized":"2023-07-14T11:19:25.968001+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:14:29.323565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":158,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400857+0000","last_change":"2023-07-14T11:13:08.923899+0000","last_active":"2023-07-14T11:19:27.400857+0000","last_peered":"2023-07-14T11:19:27.400857+0000","last_clean":"2023-07-14T11:19:27.400857+0000","last_became_active":"2023-07-14T11:13:08.923513+0000","last_became_peered":"2023-07-14T11:13:08.923513+0000","last_unstale":"2023-07-14T11:19:27.400857+0000","last_undegraded":"2023-07-14T11:19:27.400857+0000","last_fullsized":"2023-07-14T11:19:27.400857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:58:50.925932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:26.811915+0000","last_change":"2023-07-14T11:19:24.983897+0000","last_active":"2023-07-14T11:19:26.811915+0000","last_peered":"2023-07-14T11:19:26.811915+0000","last_clean":"2023-07-14T11:19:26.811915+0000","last_became_active":"2023-07-14T11:19:24.983447+0000","last_became_peered":"2023-07-14T11:19:24.983447+0000","last_unstale":"2023-07-14T11:19:26.811915+0000","last_undegraded":"2023-07-14T11:19:26.811915+0000","last_fullsized":"2023-07-14T11:19:26.811915+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:54:18.545171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"105'2","reported_seq":15,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400378+0000","last_change":"2023-07-14T11:19:23.969743+0000","last_active":"2023-07-14T11:19:27.400378+0000","last_peered":"2023-07-14T11:19:27.400378+0000","last_clean":"2023-07-14T11:19:27.400378+0000","last_became_active":"2023-07-14T11:19:23.969481+0000","last_became_peered":"2023-07-14T11:19:23.969481+0000","last_unstale":"2023-07-14T11:19:27.400378+0000","last_undegraded":"2023-07-14T11:19:27.400378+0000","last_fullsized":"2023-07-14T11:19:27.400378+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:47:10.929997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":158,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400651+0000","last_change":"2023-07-14T11:13:08.760609+0000","last_active":"2023-07-14T11:19:27.400651+0000","last_peered":"2023-07-14T11:19:27.400651+0000","last_clean":"2023-07-14T11:19:27.400651+0000","last_became_active":"2023-07-14T11:13:08.760285+0000","last_became_peered":"2023-07-14T11:13:08.760285+0000","last_unstale":"2023-07-14T11:19:27.400651+0000","last_undegraded":"2023-07-14T11:19:27.400651+0000","last_fullsized":"2023-07-14T11:19:27.400651+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:53:22.176667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400797+0000","last_change":"2023-07-14T11:19:24.980041+0000","last_active":"2023-07-14T11:19:27.400797+0000","last_peered":"2023-07-14T11:19:27.400797+0000","last_clean":"2023-07-14T11:19:27.400797+0000","last_became_active":"2023-07-14T11:19:24.979435+0000","last_became_peered":"2023-07-14T11:19:24.979435+0000","last_unstale":"2023-07-14T11:19:27.400797+0000","last_undegraded":"2023-07-14T11:19:27.400797+0000","last_fullsized":"2023-07-14T11:19:27.400797+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:10:32.407475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"105'8","reported_seq":21,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.401632+0000","last_change":"2023-07-14T11:19:23.969006+0000","last_active":"2023-07-14T11:19:27.401632+0000","last_peered":"2023-07-14T11:19:27.401632+0000","last_clean":"2023-07-14T11:19:27.401632+0000","last_became_active":"2023-07-14T11:19:23.968741+0000","last_became_peered":"2023-07-14T11:19:23.968741+0000","last_unstale":"2023-07-14T11:19:27.401632+0000","last_undegraded":"2023-07-14T11:19:27.401632+0000","last_fullsized":"2023-07-14T11:19:27.401632+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:26:03.770926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"76'128","reported_seq":353,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400632+0000","last_change":"2023-07-14T11:13:01.370649+0000","last_active":"2023-07-14T11:19:27.400632+0000","last_peered":"2023-07-14T11:19:27.400632+0000","last_clean":"2023-07-14T11:19:27.400632+0000","last_became_active":"2023-07-14T11:13:01.369478+0000","last_became_peered":"2023-07-14T11:13:01.369478+0000","last_unstale":"2023-07-14T11:19:27.400632+0000","last_undegraded":"2023-07-14T11:19:27.400632+0000","last_fullsized":"2023-07-14T11:19:27.400632+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:00.254800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:00.254800+0000","last_clean_scrub_stamp":"2023-07-14T11:13:00.254800+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:32:37.718542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":172,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967539+0000","last_change":"2023-07-14T11:13:08.757882+0000","last_active":"2023-07-14T11:19:25.967539+0000","last_peered":"2023-07-14T11:19:25.967539+0000","last_clean":"2023-07-14T11:19:25.967539+0000","last_became_active":"2023-07-14T11:13:08.757541+0000","last_became_peered":"2023-07-14T11:13:08.757541+0000","last_unstale":"2023-07-14T11:19:25.967539+0000","last_undegraded":"2023-07-14T11:19:25.967539+0000","last_fullsized":"2023-07-14T11:19:25.967539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:44:22.274150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.964372+0000","last_change":"2023-07-14T11:19:24.972447+0000","last_active":"2023-07-14T11:19:25.964372+0000","last_peered":"2023-07-14T11:19:25.964372+0000","last_clean":"2023-07-14T11:19:25.964372+0000","last_became_active":"2023-07-14T11:19:24.972170+0000","last_became_peered":"2023-07-14T11:19:24.972170+0000","last_unstale":"2023-07-14T11:19:25.964372+0000","last_undegraded":"2023-07-14T11:19:25.964372+0000","last_fullsized":"2023-07-14T11:19:25.964372+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:06:12.493242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.401097+0000","last_change":"2023-07-14T11:19:23.961825+0000","last_active":"2023-07-14T11:19:27.401097+0000","last_peered":"2023-07-14T11:19:27.401097+0000","last_clean":"2023-07-14T11:19:27.401097+0000","last_became_active":"2023-07-14T11:19:23.961499+0000","last_became_peered":"2023-07-14T11:19:23.961499+0000","last_unstale":"2023-07-14T11:19:27.401097+0000","last_undegraded":"2023-07-14T11:19:27.401097+0000","last_fullsized":"2023-07-14T11:19:27.401097+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:52:14.188912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":176,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.399575+0000","last_change":"2023-07-14T11:13:08.862331+0000","last_active":"2023-07-14T11:19:27.399575+0000","last_peered":"2023-07-14T11:19:27.399575+0000","last_clean":"2023-07-14T11:19:27.399575+0000","last_became_active":"2023-07-14T11:13:08.861817+0000","last_became_peered":"2023-07-14T11:13:08.861817+0000","last_unstale":"2023-07-14T11:19:27.399575+0000","last_undegraded":"2023-07-14T11:19:27.399575+0000","last_fullsized":"2023-07-14T11:19:27.399575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:06:57.469895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.399635+0000","last_change":"2023-07-14T11:19:24.980611+0000","last_active":"2023-07-14T11:19:27.399635+0000","last_peered":"2023-07-14T11:19:27.399635+0000","last_clean":"2023-07-14T11:19:27.399635+0000","last_became_active":"2023-07-14T11:19:24.980359+0000","last_became_peered":"2023-07-14T11:19:24.980359+0000","last_unstale":"2023-07-14T11:19:27.399635+0000","last_undegraded":"2023-07-14T11:19:27.399635+0000","last_fullsized":"2023-07-14T11:19:27.399635+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:16:08.807717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.401402+0000","last_change":"2023-07-14T11:19:23.964816+0000","last_active":"2023-07-14T11:19:27.401402+0000","last_peered":"2023-07-14T11:19:27.401402+0000","last_clean":"2023-07-14T11:19:27.401402+0000","last_became_active":"2023-07-14T11:19:23.964532+0000","last_became_peered":"2023-07-14T11:19:23.964532+0000","last_unstale":"2023-07-14T11:19:27.401402+0000","last_undegraded":"2023-07-14T11:19:27.401402+0000","last_fullsized":"2023-07-14T11:19:27.401402+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:22:08.182081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":172,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.967485+0000","last_change":"2023-07-14T11:13:08.758749+0000","last_active":"2023-07-14T11:19:25.967485+0000","last_peered":"2023-07-14T11:19:25.967485+0000","last_clean":"2023-07-14T11:19:25.967485+0000","last_became_active":"2023-07-14T11:13:08.757956+0000","last_became_peered":"2023-07-14T11:13:08.757956+0000","last_unstale":"2023-07-14T11:19:25.967485+0000","last_undegraded":"2023-07-14T11:19:25.967485+0000","last_fullsized":"2023-07-14T11:19:25.967485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:50:28.757111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:26.811687+0000","last_change":"2023-07-14T11:19:24.983636+0000","last_active":"2023-07-14T11:19:26.811687+0000","last_peered":"2023-07-14T11:19:26.811687+0000","last_clean":"2023-07-14T11:19:26.811687+0000","last_became_active":"2023-07-14T11:19:24.983344+0000","last_became_peered":"2023-07-14T11:19:24.983344+0000","last_unstale":"2023-07-14T11:19:26.811687+0000","last_undegraded":"2023-07-14T11:19:26.811687+0000","last_fullsized":"2023-07-14T11:19:26.811687+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:23.938624+0000","last_clean_scrub_stamp":"2023-07-14T11:19:23.938624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:45:10.660543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:26.811798+0000","last_change":"2023-07-14T11:19:23.971573+0000","last_active":"2023-07-14T11:19:26.811798+0000","last_peered":"2023-07-14T11:19:26.811798+0000","last_clean":"2023-07-14T11:19:26.811798+0000","last_became_active":"2023-07-14T11:19:23.971250+0000","last_became_peered":"2023-07-14T11:19:23.971250+0000","last_unstale":"2023-07-14T11:19:26.811798+0000","last_undegraded":"2023-07-14T11:19:26.811798+0000","last_fullsized":"2023-07-14T11:19:26.811798+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:19:22.930757+0000","last_clean_scrub_stamp":"2023-07-14T11:19:22.930757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:36:06.868468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":188,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:25.964499+0000","last_change":"2023-07-14T11:13:08.923786+0000","last_active":"2023-07-14T11:19:25.964499+0000","last_peered":"2023-07-14T11:19:25.964499+0000","last_clean":"2023-07-14T11:19:25.964499+0000","last_became_active":"2023-07-14T11:13:08.923384+0000","last_became_peered":"2023-07-14T11:13:08.923384+0000","last_unstale":"2023-07-14T11:19:25.964499+0000","last_undegraded":"2023-07-14T11:19:25.964499+0000","last_fullsized":"2023-07-14T11:19:25.964499+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:32:52.150831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574930,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32932,"kb_used_data":1884,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338908,"statfs":{"total":96636764160,"available":96603041792,"internally_reserved":0,"allocated":1929216,"data_stored":1202663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:19:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.66200000000000003,"15min":0.89400000000000002},"min":{"1min":0.55500000000000005,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":8.4339999999999993},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.69199999999999995,"15min":0.92800000000000005},"min":{"1min":0.47599999999999998,"5min":0.45500000000000002,"15min":0.377},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":8.4559999999999995},"last":0.65100000000000002}]},{"osd":1,"last update":"Fri Jul 14 11:19:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.67200000000000004,"15min":0.871},"min":{"1min":0.52100000000000002,"5min":0.40400000000000003,"15min":0.34899999999999998},"max":{"1min":0.90400000000000003,"5min":0.92800000000000005,"15min":6.3520000000000003},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.66100000000000003,"15min":1.0089999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":6.8550000000000004},"last":0.71199999999999997}]},{"osd":2,"last update":"Fri Jul 14 11:19:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.67100000000000004,"15min":1.0569999999999999},"min":{"1min":0.499,"5min":0.434,"15min":0.434},"max":{"1min":0.83599999999999997,"5min":0.997,"15min":7.0289999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.70399999999999996,"15min":0.69299999999999995},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.86399999999999999,"5min":0.98199999999999998,"15min":1.0580000000000001},"last":0.81000000000000005}]},{"osd":3,"last update":"Fri Jul 14 11:19:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.68899999999999995,"15min":1.109},"min":{"1min":0.55200000000000005,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.91100000000000003,"5min":0.95699999999999996,"15min":10.337},"last":0.755},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.72699999999999998,"15min":0.75800000000000001},"min":{"1min":0.53300000000000003,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.90100000000000002,"5min":1.024,"15min":1.921},"last":0.53400000000000003}]},{"osd":4,"last update":"Fri Jul 14 11:19:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.64700000000000002,"15min":0.59899999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.73599999999999999,"15min":0.70599999999999996},"min":{"1min":0.57299999999999995,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.90800000000000003,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.59099999999999997}]},{"osd":5,"last update":"Fri Jul 14 11:19:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.70099999999999996,"15min":0.67900000000000005},"min":{"1min":0.39700000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.92800000000000005,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.76400000000000001,"15min":0.73999999999999999},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.47499999999999998}]},{"osd":6,"last update":"Fri Jul 14 11:19:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.72899999999999998,"15min":0.68300000000000005},"min":{"1min":0.505,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.98799999999999999,"5min":1.002,"15min":1.002},"last":0.5},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.73299999999999998,"15min":0.69399999999999995},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.48899999999999999},"max":{"1min":0.97399999999999998,"5min":1.129,"15min":1.129},"last":0.51300000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574931,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28244,"kb_used_data":1292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343596,"statfs":{"total":96636764160,"available":96607842304,"internally_reserved":0,"allocated":1323008,"data_stored":612101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.69899999999999995,"15min":0.70299999999999996},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93799999999999994,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.73499999999999999,"15min":0.72099999999999997},"min":{"1min":0.51100000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.83899999999999997,"5min":1.167,"15min":1.167},"last":0.78800000000000003}]},{"osd":1,"last update":"Fri Jul 14 11:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71899999999999997,"15min":0.69099999999999995},"min":{"1min":0.443,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":1.0329999999999999},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.73099999999999998,"15min":0.71399999999999997},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39300000000000002},"max":{"1min":0.90400000000000003,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.74399999999999999}]},{"osd":2,"last update":"Fri Jul 14 11:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.69899999999999995,"15min":0.67900000000000005},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.41299999999999998},"max":{"1min":0.89000000000000001,"5min":1.45,"15min":1.45},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.755,"5min":0.754,"15min":0.77600000000000002},"min":{"1min":0.56399999999999995,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.075,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.95399999999999996}]},{"osd":3,"last update":"Fri Jul 14 11:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.73099999999999998,"15min":0.74299999999999999},"min":{"1min":0.50900000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.86499999999999999,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.73299999999999998,"15min":0.73899999999999999},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0469999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.876}]},{"osd":4,"last update":"Fri Jul 14 11:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.69099999999999995,"15min":0.70699999999999996},"min":{"1min":0.53300000000000003,"5min":0.38,"15min":0.38},"max":{"1min":1.177,"5min":1.712,"15min":1.712},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.71999999999999997,"15min":0.72599999999999998},"min":{"1min":0.48199999999999998,"5min":0.438,"15min":0.42899999999999999},"max":{"1min":0.998,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.69099999999999995}]},{"osd":5,"last update":"Fri Jul 14 11:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.71199999999999997,"15min":0.71799999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.93500000000000005,"5min":2.8820000000000001,"15min":2.8820000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.77200000000000002,"15min":0.78800000000000003},"min":{"1min":0.58399999999999996,"5min":0.46100000000000002,"15min":0.44500000000000001},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.98799999999999999}]},{"osd":7,"last update":"Fri Jul 14 11:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.77500000000000002,"15min":0.79900000000000004},"min":{"1min":0.59899999999999998,"5min":0.47399999999999998,"15min":0.47099999999999997},"max":{"1min":0.95499999999999996,"5min":1.333,"15min":1.333},"last":0.628},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.76300000000000001,"15min":0.78900000000000003},"min":{"1min":0.46899999999999997,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.1579999999999999,"5min":1.55,"15min":1.55},"last":0.92800000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574930,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28244,"kb_used_data":1292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343596,"statfs":{"total":96636764160,"available":96607842304,"internally_reserved":0,"allocated":1323008,"data_stored":611541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.40500000000000003,"15min":0.432},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.54200000000000004,"5min":0.59099999999999997,"15min":0.996},"last":0.745},{"interface":"front","average":{"1min":0.432,"5min":0.45500000000000002,"15min":0.47599999999999998},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.57299999999999995,"5min":0.81599999999999995,"15min":0.84299999999999997},"last":0.40699999999999997}]},{"osd":2,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.48099999999999998,"15min":0.54900000000000004},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.60299999999999998,"5min":0.70799999999999996,"15min":2.476},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.48899999999999999,"15min":0.59499999999999997},"min":{"1min":0.36899999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.64700000000000002,"5min":0.91700000000000004,"15min":2.6299999999999999},"last":0.57499999999999996}]},{"osd":3,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.52800000000000002,"15min":0.52200000000000002},"min":{"1min":0.40899999999999997,"5min":0.39300000000000002,"15min":0.38900000000000001},"max":{"1min":0.72599999999999998,"5min":0.748,"15min":0.748},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46500000000000002,"15min":0.48799999999999999},"min":{"1min":0.33600000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.59499999999999997,"5min":0.67700000000000005,"15min":0.73199999999999998},"last":0.47799999999999998}]},{"osd":4,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.73699999999999999,"15min":0.749},"min":{"1min":0.52400000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.363},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.751,"5min":0.754,"15min":0.76900000000000002},"min":{"1min":0.57099999999999995,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.93999999999999995,"5min":1.1160000000000001,"15min":1.4890000000000001},"last":0.625}]},{"osd":5,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.749,"15min":0.76500000000000001},"min":{"1min":0.54200000000000004,"5min":0.499,"15min":0.499},"max":{"1min":1.0589999999999999,"5min":1.2250000000000001,"15min":1.3759999999999999},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76200000000000001,"15min":0.80800000000000005},"min":{"1min":0.59099999999999997,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.4330000000000001},"last":0.68799999999999994}]},{"osd":6,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.745,"15min":0.78800000000000003},"min":{"1min":0.55900000000000005,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.028,"5min":1.141,"15min":1.298},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.753,"15min":0.77900000000000003},"min":{"1min":0.60199999999999998,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.97199999999999998,"5min":1.1899999999999999,"15min":1.2130000000000001},"last":0.85699999999999998}]},{"osd":7,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.75900000000000001,"15min":0.80700000000000005},"min":{"1min":0.58299999999999996,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0780000000000001,"5min":1.2010000000000001,"15min":1.4590000000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.75,"15min":0.77900000000000003},"min":{"1min":0.56299999999999994,"5min":0.55000000000000004,"15min":0.54200000000000004},"max":{"1min":1.129,"5min":1.129,"15min":1.3700000000000001},"last":0.71099999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574928,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28824,"kb_used_data":1872,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343016,"statfs":{"total":96636764160,"available":96607248384,"internally_reserved":0,"allocated":1916928,"data_stored":1201909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 11:19:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.47699999999999998,"15min":0.44700000000000001},"min":{"1min":0.26800000000000002,"5min":0.252,"15min":0.252},"max":{"1min":2.972,"5min":2.972,"15min":2.972},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.47599999999999998,"15min":0.45200000000000001},"min":{"1min":0.33300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":2.758,"5min":2.758,"15min":2.758},"last":0.31900000000000001}]},{"osd":2,"last update":"Fri Jul 14 11:19:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.499,"15min":0.47299999999999998},"min":{"1min":0.35599999999999998,"5min":0.307,"15min":0.307},"max":{"1min":2.9409999999999998,"5min":2.9409999999999998,"15min":2.9409999999999998},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.51900000000000002,"15min":0.50900000000000001},"min":{"1min":0.376,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":2.556,"5min":2.556,"15min":2.556},"last":0.45900000000000002}]},{"osd":3,"last update":"Fri Jul 14 11:19:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.48199999999999998,"15min":0.438},"min":{"1min":0.33700000000000002,"5min":0.32000000000000001,"15min":0.309},"max":{"1min":2.6019999999999999,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.55600000000000005,"15min":0.53500000000000003},"min":{"1min":0.44900000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":2.9990000000000001,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":0.56599999999999995}]},{"osd":4,"last update":"Fri Jul 14 11:19:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.73699999999999999,"15min":0.75700000000000001},"min":{"1min":0.51200000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0229999999999999,"5min":1.099,"15min":1.1060000000000001},"last":0.874},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.76400000000000001,"15min":0.71799999999999997},"min":{"1min":0.57499999999999996,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.651,"5min":1.651,"15min":1.651},"last":0.82299999999999995}]},{"osd":5,"last update":"Fri Jul 14 11:19:12 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.77200000000000002,"15min":0.73799999999999999},"min":{"1min":0.51900000000000002,"5min":0.502,"15min":0.47999999999999998},"max":{"1min":2.9089999999999998,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.76500000000000001,"15min":0.77600000000000002},"min":{"1min":0.53200000000000003,"5min":0.505,"15min":0.505},"max":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.77800000000000002}]},{"osd":6,"last update":"Fri Jul 14 11:19:12 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.745,"15min":0.72799999999999998},"min":{"1min":0.499,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.78700000000000003,"15min":0.78300000000000003},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":2.8679999999999999,"5min":2.8679999999999999,"15min":2.8679999999999999},"last":0.76000000000000001}]},{"osd":7,"last update":"Fri Jul 14 11:19:12 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.77700000000000002,"15min":0.80900000000000005},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.97599999999999998,"5min":1.0900000000000001,"15min":1.149},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.81899999999999995,"15min":0.78900000000000003},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.7410000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":0.85799999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574928,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28240,"kb_used_data":1288,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343600,"statfs":{"total":96636764160,"available":96607846400,"internally_reserved":0,"allocated":1318912,"data_stored":611519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:19:20 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.40899999999999997,"15min":0.441},"min":{"1min":0.27100000000000002,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.623,"5min":0.63900000000000001,"15min":0.64700000000000002},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.438,"15min":0.44400000000000001},"min":{"1min":0.32100000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.63700000000000001,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.36399999999999999}]},{"osd":1,"last update":"Fri Jul 14 11:19:20 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46700000000000003,"15min":0.48199999999999998},"min":{"1min":0.371,"5min":0.31,"15min":0.31},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.98299999999999998},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.47899999999999998,"15min":0.48699999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.59199999999999997,"5min":0.629,"15min":0.91200000000000003},"last":0.498}]},{"osd":3,"last update":"Fri Jul 14 11:19:20 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.48699999999999999,"15min":0.49299999999999999},"min":{"1min":0.34999999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.623,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.55700000000000005,"15min":0.57999999999999996},"min":{"1min":0.44500000000000001,"5min":0.41499999999999998,"15min":0.40799999999999997},"max":{"1min":0.72899999999999998,"5min":0.80000000000000004,"15min":1.034},"last":0.53500000000000003}]},{"osd":4,"last update":"Fri Jul 14 11:19:20 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.73499999999999999,"15min":0.76300000000000001},"min":{"1min":0.53900000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.036,"5min":1.171,"15min":1.212},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.749,"15min":0.77900000000000003},"min":{"1min":0.53800000000000003,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.83899999999999997}]},{"osd":5,"last update":"Fri Jul 14 11:19:20 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.74399999999999999,"15min":0.78200000000000003},"min":{"1min":0.53900000000000003,"5min":0.51700000000000002,"15min":0.43099999999999999},"max":{"1min":1.202,"5min":1.202,"15min":1.4019999999999999},"last":0.751},{"interface":"front","average":{"1min":0.75,"5min":0.76300000000000001,"15min":0.81100000000000005},"min":{"1min":0.55800000000000005,"5min":0.495,"15min":0.495},"max":{"1min":1.044,"5min":1.351,"15min":1.351},"last":0.86799999999999999}]},{"osd":6,"last update":"Fri Jul 14 11:19:20 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.753,"15min":0.78100000000000003},"min":{"1min":0.53100000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0089999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.76800000000000002,"15min":0.81299999999999994},"min":{"1min":0.60199999999999998,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.218,"5min":1.282,"15min":1.282},"last":0.80800000000000005}]},{"osd":7,"last update":"Fri Jul 14 11:19:20 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.754,"15min":0.79100000000000004},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.93400000000000005,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.754,"15min":0.79600000000000004},"min":{"1min":0.60899999999999999,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.96399999999999997,"5min":1.244,"15min":1.244},"last":0.77700000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574928,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28256,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343584,"statfs":{"total":96636764160,"available":96607830016,"internally_reserved":0,"allocated":1335296,"data_stored":613117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.41099999999999998,"15min":0.442},"min":{"1min":0.24299999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.55900000000000005,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.44500000000000001,"15min":0.44800000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.621,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.51100000000000001}]},{"osd":1,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.44,"15min":0.44900000000000001},"min":{"1min":0.29499999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.52000000000000002,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.47199999999999998,"15min":0.49099999999999999},"min":{"1min":0.317,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.60899999999999999,"5min":0.72699999999999998,"15min":0.86399999999999999},"last":0.42799999999999999}]},{"osd":2,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.53400000000000003,"15min":0.54000000000000004},"min":{"1min":0.39600000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.64900000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56200000000000006,"15min":0.58999999999999997},"min":{"1min":0.44,"5min":0.37,"15min":0.37},"max":{"1min":0.76100000000000001,"5min":0.79600000000000004,"15min":1.585},"last":0.60299999999999998}]},{"osd":4,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.73299999999999998,"15min":0.754},"min":{"1min":0.45400000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.96399999999999997,"5min":1.1279999999999999,"15min":1.216},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.76700000000000002,"15min":0.75700000000000001},"min":{"1min":0.48599999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.73999999999999999}]},{"osd":5,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.747,"15min":0.75700000000000001},"min":{"1min":0.48499999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.089,"5min":1.179,"15min":1.413},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.76700000000000002,"15min":0.83499999999999996},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.94999999999999996,"5min":1.1619999999999999,"15min":1.657},"last":0.80400000000000005}]},{"osd":6,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77700000000000002,"15min":0.78300000000000003},"min":{"1min":0.56699999999999995,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.726},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.755,"5min":0.76800000000000002,"15min":0.79400000000000004},"min":{"1min":0.57099999999999995,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.143,"5min":1.286,"15min":1.333},"last":0.70299999999999996}]},{"osd":7,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.79700000000000004,"15min":0.83099999999999996},"min":{"1min":0.53800000000000003,"5min":0.437,"15min":0.437},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.3939999999999999},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.80800000000000005,"15min":0.83399999999999996},"min":{"1min":0.60299999999999998,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.89400000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574928,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28252,"kb_used_data":1300,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343588,"statfs":{"total":96636764160,"available":96607834112,"internally_reserved":0,"allocated":1331200,"data_stored":613083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:19:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.64900000000000002,"15min":0.63500000000000001},"min":{"1min":0.437,"5min":0.311,"15min":0.311},"max":{"1min":0.89600000000000002,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.65200000000000002,"15min":0.68400000000000005},"min":{"1min":0.47699999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85199999999999998,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.70099999999999996}]},{"osd":1,"last update":"Fri Jul 14 11:19:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.65200000000000002,"15min":0.66600000000000004},"min":{"1min":0.51700000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.83599999999999997,"5min":0.92000000000000004,"15min":1.4259999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70299999999999996,"15min":0.70999999999999996},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.45800000000000002},"max":{"1min":0.95799999999999996,"5min":1.0149999999999999,"15min":1.1659999999999999},"last":0.80400000000000005}]},{"osd":2,"last update":"Fri Jul 14 11:19:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.69999999999999996,"15min":0.70699999999999996},"min":{"1min":0.501,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.88200000000000001,"5min":1.0209999999999999,"15min":1.48},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71999999999999997,"15min":0.73599999999999999},"min":{"1min":0.54800000000000004,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.91800000000000004,"5min":1.1080000000000001,"15min":1.23},"last":0.66600000000000004}]},{"osd":3,"last update":"Fri Jul 14 11:19:15 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.67800000000000005,"15min":0.70799999999999996},"min":{"1min":0.51300000000000001,"5min":0.438,"15min":0.438},"max":{"1min":0.95599999999999996,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.72999999999999998,"15min":0.73599999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.90700000000000003,"5min":1.1259999999999999,"15min":1.145},"last":0.59099999999999997}]},{"osd":5,"last update":"Fri Jul 14 11:19:15 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.66600000000000004,"15min":0.74299999999999999},"min":{"1min":0.47399999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.81799999999999995,"5min":0.95999999999999996,"15min":1.6559999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.65700000000000003,"15min":0.745},"min":{"1min":0.41999999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.90500000000000003,"5min":0.96999999999999997,"15min":1.3839999999999999},"last":0.48299999999999998}]},{"osd":6,"last update":"Fri Jul 14 11:19:15 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.68500000000000005,"15min":0.71299999999999997},"min":{"1min":0.45200000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.86799999999999999,"5min":1.1659999999999999,"15min":1.1970000000000001},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.73699999999999999,"15min":0.76600000000000001},"min":{"1min":0.56899999999999995,"5min":0.442,"15min":0.442},"max":{"1min":0.878,"5min":1.1479999999999999,"15min":1.3},"last":0.84099999999999997}]},{"osd":7,"last update":"Fri Jul 14 11:19:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.70499999999999996,"15min":0.755},"min":{"1min":0.47899999999999998,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.88,"5min":1.028,"15min":1.4810000000000001},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.755,"15min":0.82599999999999996},"min":{"1min":0.59099999999999997,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.82499999999999996,"5min":1.21,"15min":1.379},"last":0.71799999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574930,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28248,"kb_used_data":1296,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343592,"statfs":{"total":96636764160,"available":96607838208,"internally_reserved":0,"allocated":1327104,"data_stored":611679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:19:05 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.61899999999999999,"15min":0.63600000000000001},"min":{"1min":0.371,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.84199999999999997,"5min":0.996,"15min":1.3140000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65200000000000002,"15min":0.64000000000000001},"min":{"1min":0.42399999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":1.0980000000000001},"last":0.80900000000000005}]},{"osd":1,"last update":"Fri Jul 14 11:19:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.624,"15min":0.66400000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.75600000000000001,"5min":0.88800000000000001,"15min":1.343},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.63,"5min":0.65100000000000002,"15min":0.64800000000000002},"min":{"1min":0.442,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.86599999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.65500000000000003}]},{"osd":2,"last update":"Fri Jul 14 11:19:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.69899999999999995,"15min":0.72899999999999998},"min":{"1min":0.46700000000000003,"5min":0.436,"15min":0.436},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.70299999999999996,"15min":0.753},"min":{"1min":0.504,"5min":0.496,"15min":0.496},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":1.3939999999999999},"last":0.84099999999999997}]},{"osd":3,"last update":"Fri Jul 14 11:19:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71199999999999997,"15min":0.75600000000000001},"min":{"1min":0.54500000000000004,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":1.2130000000000001},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.67700000000000005,"15min":0.75700000000000001},"min":{"1min":0.46400000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":1.806},"last":0.72299999999999998}]},{"osd":4,"last update":"Fri Jul 14 11:19:05 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.61699999999999999,"15min":0.64600000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.878,"5min":1.0229999999999999,"15min":1.1319999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.66500000000000004,"15min":0.73699999999999999},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.3999999999999999},"last":0.53400000000000003}]},{"osd":6,"last update":"Fri Jul 14 11:19:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.69699999999999995,"15min":0.73999999999999999},"min":{"1min":0.502,"5min":0.435,"15min":0.435},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.73499999999999999,"15min":0.79000000000000004},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.004,"5min":1.0629999999999999,"15min":1.3640000000000001},"last":0.73599999999999999}]},{"osd":7,"last update":"Fri Jul 14 11:19:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.747,"15min":0.82999999999999996},"min":{"1min":0.54400000000000004,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.4970000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78500000000000003,"15min":0.85499999999999998},"min":{"1min":0.60399999999999998,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.8540000000000001},"last":0.58699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T11:19:34.746 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-14T11:19:34.747 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-14T11:19:34.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.947+0000 7fa2ea7ff700 1 Processor -- start 2023-07-14T11:19:34.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.947+0000 7fa2ea7ff700 1 -- start start 2023-07-14T11:19:34.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.949+0000 7fa2ea7ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa2e40c92d0 0x7fa2e40ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:34.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.949+0000 7fa2ea7ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa2e40b12f0 0x7fa2e40c96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:34.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.949+0000 7fa2ea7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2e40adea0 0x7fa2e406c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:34.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.949+0000 7fa2ea7ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2e415da60 con 0x7fa2e40b12f0 2023-07-14T11:19:34.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.949+0000 7fa2ea7ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2e415ce70 con 0x7fa2e40c92d0 2023-07-14T11:19:34.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.949+0000 7fa2ea7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e40c9be0 con 0x7fa2e40adea0 2023-07-14T11:19:34.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.949+0000 7fa2e37fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa2e40b12f0 0x7fa2e40c96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:34.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.949+0000 7fa2e37fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa2e40b12f0 0x7fa2e40c96a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40790/0 (socket says 172.21.15.84:40790) 2023-07-14T11:19:34.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.949+0000 7fa2e37fe700 1 -- 172.21.15.84:0/1818328719 learned_addr learned my addr 172.21.15.84:0/1818328719 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:34.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.949+0000 7fa2e3fff700 1 --2- 172.21.15.84:0/1818328719 >> v2:172.21.15.179:3300/0 conn(0x7fa2e40c92d0 0x7fa2e40ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:34.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.949+0000 7fa2e8d9c700 1 --2- 172.21.15.84:0/1818328719 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2e40adea0 0x7fa2e406c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:34.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.949+0000 7fa2e37fe700 1 -- 172.21.15.84:0/1818328719 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2e40adea0 msgr2=0x7fa2e406c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:34.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.949+0000 7fa2e37fe700 1 --2- 172.21.15.84:0/1818328719 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2e40adea0 0x7fa2e406c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:34.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.949+0000 7fa2e37fe700 1 -- 172.21.15.84:0/1818328719 >> v2:172.21.15.179:3300/0 conn(0x7fa2e40c92d0 msgr2=0x7fa2e40ad8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:34.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.949+0000 7fa2e37fe700 1 --2- 172.21.15.84:0/1818328719 >> v2:172.21.15.179:3300/0 conn(0x7fa2e40c92d0 0x7fa2e40ad8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:34.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.949+0000 7fa2e37fe700 1 -- 172.21.15.84:0/1818328719 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e415d0c0 con 0x7fa2e40b12f0 2023-07-14T11:19:34.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.949+0000 7fa2e3fff700 1 --2- 172.21.15.84:0/1818328719 >> v2:172.21.15.179:3300/0 conn(0x7fa2e40c92d0 0x7fa2e40ad8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:19:34.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.950+0000 7fa2e37fe700 1 --2- 172.21.15.84:0/1818328719 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2e40b12f0 0x7fa2e40c96a0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7fa2e406f630 tx=0x7fa2d8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cfd087edc7ed7b1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:34.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.950+0000 7fa2e2ffd700 1 -- 172.21.15.84:0/1818328719 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d800f8a0 con 0x7fa2e40b12f0 2023-07-14T11:19:34.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.950+0000 7fa2e2ffd700 1 -- 172.21.15.84:0/1818328719 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2d800fa00 con 0x7fa2e40b12f0 2023-07-14T11:19:34.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.950+0000 7fa2e2ffd700 1 -- 172.21.15.84:0/1818328719 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d800fd90 con 0x7fa2e40b12f0 2023-07-14T11:19:34.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.950+0000 7fa2ea7ff700 1 -- 172.21.15.84:0/1818328719 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2e40b12f0 msgr2=0x7fa2e40c96a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:34.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.950+0000 7fa2ea7ff700 1 --2- 172.21.15.84:0/1818328719 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2e40b12f0 0x7fa2e40c96a0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7fa2e406f630 tx=0x7fa2d8009bd0 comp rx=0 tx=0).stop 2023-07-14T11:19:34.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.951+0000 7fa2ea7ff700 1 -- 172.21.15.84:0/1818328719 shutdown_connections 2023-07-14T11:19:34.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.951+0000 7fa2ea7ff700 1 --2- 172.21.15.84:0/1818328719 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2e40adea0 0x7fa2e406c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:34.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.951+0000 7fa2ea7ff700 1 --2- 172.21.15.84:0/1818328719 >> v2:172.21.15.179:3300/0 conn(0x7fa2e40c92d0 0x7fa2e40ad8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:34.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.951+0000 7fa2ea7ff700 1 --2- 172.21.15.84:0/1818328719 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2e40b12f0 0x7fa2e40c96a0 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:34.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.951+0000 7fa2ea7ff700 1 -- 172.21.15.84:0/1818328719 >> 172.21.15.84:0/1818328719 conn(0x7fa2e40b05d0 msgr2=0x7fa2e40b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:34.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.951+0000 7fa2ea7ff700 1 -- 172.21.15.84:0/1818328719 shutdown_connections 2023-07-14T11:19:34.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.951+0000 7fa2ea7ff700 1 -- 172.21.15.84:0/1818328719 wait complete. 2023-07-14T11:19:34.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.952+0000 7fa2ea7ff700 1 Processor -- start 2023-07-14T11:19:34.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.952+0000 7fa2ea7ff700 1 -- start start 2023-07-14T11:19:34.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.953+0000 7fa2ea7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2e40adea0 0x7fa2e4152070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:34.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.953+0000 7fa2ea7ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2e40b12f0 0x7fa2e40b2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:34.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.953+0000 7fa2ea7ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2e40c92d0 0x7fa2e40af380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:34.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.953+0000 7fa2ea7ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e41599c0 con 0x7fa2e40c92d0 2023-07-14T11:19:34.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.953+0000 7fa2ea7ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e40b35f0 con 0x7fa2e40b12f0 2023-07-14T11:19:34.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.953+0000 7fa2ea7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e40b2d50 con 0x7fa2e40adea0 2023-07-14T11:19:34.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.954+0000 7fa2e8d9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2e40c92d0 0x7fa2e40af380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:34.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.954+0000 7fa2e8d9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2e40c92d0 0x7fa2e40af380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40806/0 (socket says 172.21.15.84:40806) 2023-07-14T11:19:34.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.954+0000 7fa2e8d9c700 1 -- 172.21.15.84:0/2812475736 learned_addr learned my addr 172.21.15.84:0/2812475736 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:34.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.954+0000 7fa2e37fe700 1 --2- 172.21.15.84:0/2812475736 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2e40b12f0 0x7fa2e40b2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:34.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.954+0000 7fa2e3fff700 1 --2- 172.21.15.84:0/2812475736 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2e40adea0 0x7fa2e4152070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:34.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.954+0000 7fa2e8d9c700 1 -- 172.21.15.84:0/2812475736 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2e40adea0 msgr2=0x7fa2e4152070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:34.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.954+0000 7fa2e8d9c700 1 --2- 172.21.15.84:0/2812475736 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2e40adea0 0x7fa2e4152070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:34.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.954+0000 7fa2e8d9c700 1 -- 172.21.15.84:0/2812475736 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2e40b12f0 msgr2=0x7fa2e40b2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:34.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.954+0000 7fa2e8d9c700 1 --2- 172.21.15.84:0/2812475736 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2e40b12f0 0x7fa2e40b2300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:34.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.954+0000 7fa2e8d9c700 1 -- 172.21.15.84:0/2812475736 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d8009550 con 0x7fa2e40c92d0 2023-07-14T11:19:34.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.954+0000 7fa2e37fe700 1 --2- 172.21.15.84:0/2812475736 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2e40b12f0 0x7fa2e40b2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:19:34.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.954+0000 7fa2e3fff700 1 --2- 172.21.15.84:0/2812475736 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2e40adea0 0x7fa2e4152070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:19:34.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.954+0000 7fa2e8d9c700 1 --2- 172.21.15.84:0/2812475736 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2e40c92d0 0x7fa2e40af380 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc007e60 tx=0x7fa2dc00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:34.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.954+0000 7fa2e0ff9700 1 -- 172.21.15.84:0/2812475736 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2dc00ede0 con 0x7fa2e40c92d0 2023-07-14T11:19:34.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.954+0000 7fa2e0ff9700 1 -- 172.21.15.84:0/2812475736 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2dc014420 con 0x7fa2e40c92d0 2023-07-14T11:19:34.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.954+0000 7fa2ea7ff700 1 -- 172.21.15.84:0/2812475736 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2e40b3030 con 0x7fa2e40c92d0 2023-07-14T11:19:34.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.955+0000 7fa2e0ff9700 1 -- 172.21.15.84:0/2812475736 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2dc0147d0 con 0x7fa2e40c92d0 2023-07-14T11:19:34.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.955+0000 7fa2ea7ff700 1 -- 172.21.15.84:0/2812475736 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2e4159bf0 con 0x7fa2e40c92d0 2023-07-14T11:19:34.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.956+0000 7fa2ea7ff700 1 -- 172.21.15.84:0/2812475736 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2e4159db0 con 0x7fa2e40c92d0 2023-07-14T11:19:34.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.957+0000 7fa2e0ff9700 1 -- 172.21.15.84:0/2812475736 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7fa2dc014930 con 0x7fa2e40c92d0 2023-07-14T11:19:34.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.957+0000 7fa2e0ff9700 1 --2- 172.21.15.84:0/2812475736 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fa2d006ae00 0x7fa2d006d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:34.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.958+0000 7fa2e0ff9700 1 -- 172.21.15.84:0/2812475736 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa2dc089cb0 con 0x7fa2e40c92d0 2023-07-14T11:19:34.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.958+0000 7fa2e3fff700 1 --2- 172.21.15.84:0/2812475736 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fa2d006ae00 0x7fa2d006d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:34.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.959+0000 7fa2e3fff700 1 --2- 172.21.15.84:0/2812475736 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fa2d006ae00 0x7fa2d006d2b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa2d4009960 tx=0x7fa2d4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:34.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:34.962+0000 7fa2e0ff9700 1 -- 172.21.15.84:0/2812475736 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fa2dc054ce0 con 0x7fa2e40c92d0 2023-07-14T11:19:35.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.231+0000 7fa2ea7ff700 1 -- 172.21.15.84:0/2812475736 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fa2e4074350 con 0x7fa2e40c92d0 2023-07-14T11:19:35.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.236+0000 7fa2e0ff9700 1 -- 172.21.15.84:0/2812475736 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v22) v1 ==== 190+0+147 (secure 0 0 0) 0x7fa2dc058300 con 0x7fa2e40c92d0 2023-07-14T11:19:35.239 INFO:teuthology.orchestra.run.smithi084.stdout:[client.0] 2023-07-14T11:19:35.239 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCKLbFkKSl5GBAAwPK4Zs6+gv/6YKHh4JI3WA== 2023-07-14T11:19:35.239 INFO:teuthology.orchestra.run.smithi084.stdout: caps mds = "allow" 2023-07-14T11:19:35.239 INFO:teuthology.orchestra.run.smithi084.stdout: caps mon = "allow r" 2023-07-14T11:19:35.239 INFO:teuthology.orchestra.run.smithi084.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-14T11:19:35.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.238+0000 7fa2ea7ff700 1 -- 172.21.15.84:0/2812475736 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fa2d006ae00 msgr2=0x7fa2d006d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:35.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.238+0000 7fa2ea7ff700 1 --2- 172.21.15.84:0/2812475736 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fa2d006ae00 0x7fa2d006d2b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa2d4009960 tx=0x7fa2d4008040 comp rx=0 tx=0).stop 2023-07-14T11:19:35.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.238+0000 7fa2ea7ff700 1 -- 172.21.15.84:0/2812475736 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2e40c92d0 msgr2=0x7fa2e40af380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:35.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.238+0000 7fa2ea7ff700 1 --2- 172.21.15.84:0/2812475736 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2e40c92d0 0x7fa2e40af380 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc007e60 tx=0x7fa2dc00e3c0 comp rx=0 tx=0).stop 2023-07-14T11:19:35.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.238+0000 7fa2ea7ff700 1 -- 172.21.15.84:0/2812475736 shutdown_connections 2023-07-14T11:19:35.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.238+0000 7fa2ea7ff700 1 --2- 172.21.15.84:0/2812475736 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fa2d006ae00 0x7fa2d006d2b0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:35.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.238+0000 7fa2ea7ff700 1 --2- 172.21.15.84:0/2812475736 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2e40adea0 0x7fa2e4152070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:35.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.238+0000 7fa2ea7ff700 1 --2- 172.21.15.84:0/2812475736 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2e40c92d0 0x7fa2e40af380 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:35.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.238+0000 7fa2ea7ff700 1 --2- 172.21.15.84:0/2812475736 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2e40b12f0 0x7fa2e40b2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:35.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.238+0000 7fa2ea7ff700 1 -- 172.21.15.84:0/2812475736 >> 172.21.15.84:0/2812475736 conn(0x7fa2e40b05d0 msgr2=0x7fa2e40ac860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:35.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.239+0000 7fa2ea7ff700 1 -- 172.21.15.84:0/2812475736 shutdown_connections 2023-07-14T11:19:35.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.239+0000 7fa2ea7ff700 1 -- 172.21.15.84:0/2812475736 wait complete. 2023-07-14T11:19:35.243 INFO:teuthology.orchestra.run.smithi084.stderr:updated caps for client.0 2023-07-14T11:19:35.259 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T11:19:35.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.453+0000 7f67eddff700 1 Processor -- start 2023-07-14T11:19:35.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.453+0000 7f67eddff700 1 -- start start 2023-07-14T11:19:35.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.454+0000 7f67eddff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f67e815c950 0x7f67e80b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:35.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.454+0000 7f67eddff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67e80d2ce0 con 0x7f67e80b1e00 2023-07-14T11:19:35.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.455+0000 7f67eddff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67e80b3350 con 0x7f67e80d1220 2023-07-14T11:19:35.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.455+0000 7f67eddff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67e80b3630 con 0x7f67e815c950 2023-07-14T11:19:35.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.455+0000 7f67dffff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f67e80b1e00 0x7f67e80d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55434/0 (socket says 172.21.15.84:55434) 2023-07-14T11:19:35.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.455+0000 7f67dffff700 1 -- 172.21.15.84:0/612665628 learned_addr learned my addr 172.21.15.84:0/612665628 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:19:35.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.455+0000 7f67e77fe700 1 --2- 172.21.15.84:0/612665628 >> v2:172.21.15.179:3300/0 conn(0x7f67e815c950 0x7f67e80b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:35.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.455+0000 7f67e6ffd700 1 -- 172.21.15.84:0/612665628 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4135817066 0 0) 0x7f67e80d2ce0 con 0x7f67e80b1e00 2023-07-14T11:19:35.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.455+0000 7f67e6ffd700 1 -- 172.21.15.84:0/612665628 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67d40035b0 con 0x7f67e80b1e00 2023-07-14T11:19:35.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.455+0000 7f67e6ffd700 1 -- 172.21.15.84:0/612665628 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 853353 0 0) 0x7f67e80b3350 con 0x7f67e80d1220 2023-07-14T11:19:35.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.455+0000 7f67e6ffd700 1 -- 172.21.15.84:0/612665628 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67e80d2ce0 con 0x7f67e80d1220 2023-07-14T11:19:35.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.455+0000 7f67e6ffd700 1 -- 172.21.15.84:0/612665628 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1605653363 0 0) 0x7f67d40035b0 con 0x7f67e80b1e00 2023-07-14T11:19:35.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.455+0000 7f67e6ffd700 1 -- 172.21.15.84:0/612665628 >> v2:172.21.15.179:3300/0 conn(0x7f67e815c950 msgr2=0x7f67e80b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:35.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.455+0000 7f67e6ffd700 1 --2- 172.21.15.84:0/612665628 >> v2:172.21.15.179:3300/0 conn(0x7f67e815c950 0x7f67e80b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:35.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.455+0000 7f67e6ffd700 1 -- 172.21.15.84:0/612665628 >> v1:172.21.15.179:6789/0 conn(0x7f67e80d1220 legacy=0x7f67e80afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:35.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.455+0000 7f67e6ffd700 1 -- 172.21.15.84:0/612665628 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67e80b3910 con 0x7f67e80b1e00 2023-07-14T11:19:35.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.455+0000 7f67e6ffd700 1 -- 172.21.15.84:0/612665628 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7f67d0001670 con 0x7f67e80b1e00 2023-07-14T11:19:35.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.456+0000 7f67e6ffd700 1 -- 172.21.15.84:0/612665628 >> v1:172.21.15.84:6789/0 conn(0x7f67e80b1e00 legacy=0x7f67e80d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:35.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.456+0000 7f67e6ffd700 1 --2- 172.21.15.84:0/612665628 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67d4003b90 0x7f67d4003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:35.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.456+0000 7f67e6ffd700 1 --2- 172.21.15.84:0/612665628 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f67d4004850 0x7f67d4004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:35.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.456+0000 7f67e6ffd700 1 --2- 172.21.15.84:0/612665628 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f67d4005200 0x7f67d400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:35.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.456+0000 7f67e6ffd700 1 -- 172.21.15.84:0/612665628 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67e80b3630 con 0x7f67d4003b90 2023-07-14T11:19:35.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.456+0000 7f67e6ffd700 1 -- 172.21.15.84:0/612665628 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67d400c110 con 0x7f67d4005200 2023-07-14T11:19:35.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.456+0000 7f67e6ffd700 1 -- 172.21.15.84:0/612665628 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67d400c2d0 con 0x7f67d4004850 2023-07-14T11:19:35.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.456+0000 7f67e77fe700 1 --2- 172.21.15.84:0/612665628 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67d4003b90 0x7f67d4003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:35.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.456+0000 7f67dffff700 1 --2- 172.21.15.84:0/612665628 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f67d4004850 0x7f67d4004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:35.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.456+0000 7f67e7fff700 1 --2- 172.21.15.84:0/612665628 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f67d4005200 0x7f67d400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:35.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.456+0000 7f67e77fe700 1 -- 172.21.15.84:0/612665628 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f67d4004850 msgr2=0x7f67d4004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:35.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.456+0000 7f67e77fe700 1 --2- 172.21.15.84:0/612665628 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f67d4004850 0x7f67d4004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:35.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.456+0000 7f67e77fe700 1 -- 172.21.15.84:0/612665628 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f67d4005200 msgr2=0x7f67d400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:35.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.456+0000 7f67e77fe700 1 --2- 172.21.15.84:0/612665628 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f67d4005200 0x7f67d400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:35.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.456+0000 7f67e77fe700 1 -- 172.21.15.84:0/612665628 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67d40035b0 con 0x7f67d4003b90 2023-07-14T11:19:35.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.456+0000 7f67e7fff700 1 --2- 172.21.15.84:0/612665628 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f67d4005200 0x7f67d400ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:19:35.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.456+0000 7f67e7fff700 1 -- 172.21.15.84:0/612665628 reap_dead start 2023-07-14T11:19:35.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.456+0000 7f67e77fe700 1 --2- 172.21.15.84:0/612665628 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67d4003b90 0x7f67d4003f80 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f67d8009b10 tx=0x7f67d4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1543fdcc70875a14 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:35.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.457+0000 7f67e6ffd700 1 -- 172.21.15.84:0/612665628 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d8005a20 con 0x7f67d4003b90 2023-07-14T11:19:35.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.457+0000 7f67e6ffd700 1 -- 172.21.15.84:0/612665628 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67d8005b80 con 0x7f67d4003b90 2023-07-14T11:19:35.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.457+0000 7f67e6ffd700 1 -- 172.21.15.84:0/612665628 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d800e6c0 con 0x7f67d4003b90 2023-07-14T11:19:35.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.457+0000 7f67eddff700 1 -- 172.21.15.84:0/612665628 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67d4003b90 msgr2=0x7f67d4003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:35.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.457+0000 7f67eddff700 1 --2- 172.21.15.84:0/612665628 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67d4003b90 0x7f67d4003f80 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f67d8009b10 tx=0x7f67d4005880 comp rx=0 tx=0).stop 2023-07-14T11:19:35.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.457+0000 7f67eddff700 1 -- 172.21.15.84:0/612665628 shutdown_connections 2023-07-14T11:19:35.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.457+0000 7f67eddff700 1 --2- 172.21.15.84:0/612665628 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67d4003b90 0x7f67d4003f80 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:35.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.457+0000 7f67eddff700 1 -- 172.21.15.84:0/612665628 >> 172.21.15.84:0/612665628 conn(0x7f67e809c1d0 msgr2=0x7f67e80d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:35.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.457+0000 7f67eddff700 1 -- 172.21.15.84:0/612665628 shutdown_connections 2023-07-14T11:19:35.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.457+0000 7f67eddff700 1 -- 172.21.15.84:0/612665628 wait complete. 2023-07-14T11:19:35.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.459+0000 7f67eddff700 1 Processor -- start 2023-07-14T11:19:35.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.459+0000 7f67eddff700 1 -- start start 2023-07-14T11:19:35.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.460+0000 7f67eddff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67d4003b90 0x7f67e80c9470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:35.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.460+0000 7f67eddff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f67e81f1fd0 0x7f67e80cf740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:35.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.460+0000 7f67eddff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f67e80cfc80 0x7f67e80b5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:35.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.460+0000 7f67eddff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67e80d00f0 con 0x7f67d4003b90 2023-07-14T11:19:35.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.460+0000 7f67eddff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67e80c99b0 con 0x7f67e80cfc80 2023-07-14T11:19:35.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.460+0000 7f67eddff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67e80c78d0 con 0x7f67e81f1fd0 2023-07-14T11:19:35.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.460+0000 7f67e77fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67d4003b90 0x7f67e80c9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:35.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.460+0000 7f67e77fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67d4003b90 0x7f67e80c9470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40822/0 (socket says 172.21.15.84:40822) 2023-07-14T11:19:35.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.460+0000 7f67e77fe700 1 -- 172.21.15.84:0/345696912 learned_addr learned my addr 172.21.15.84:0/345696912 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:35.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.461+0000 7f67e77fe700 1 -- 172.21.15.84:0/345696912 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f67e81f1fd0 msgr2=0x7f67e80cf740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:35.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.461+0000 7f67e77fe700 1 --2- 172.21.15.84:0/345696912 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f67e81f1fd0 0x7f67e80cf740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:35.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.461+0000 7f67e77fe700 1 -- 172.21.15.84:0/345696912 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f67e80cfc80 msgr2=0x7f67e80b5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:35.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.461+0000 7f67e77fe700 1 --2- 172.21.15.84:0/345696912 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f67e80cfc80 0x7f67e80b5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:35.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.461+0000 7f67e77fe700 1 -- 172.21.15.84:0/345696912 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67e80c7bb0 con 0x7f67d4003b90 2023-07-14T11:19:35.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.461+0000 7f67e77fe700 1 --2- 172.21.15.84:0/345696912 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67d4003b90 0x7f67e80c9470 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f67d400c0e0 tx=0x7f67d80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:35.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.461+0000 7f67e4ff9700 1 -- 172.21.15.84:0/345696912 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d8020070 con 0x7f67d4003b90 2023-07-14T11:19:35.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.461+0000 7f67e4ff9700 1 -- 172.21.15.84:0/345696912 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67d8005e70 con 0x7f67d4003b90 2023-07-14T11:19:35.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.461+0000 7f67e4ff9700 1 -- 172.21.15.84:0/345696912 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d8004020 con 0x7f67d4003b90 2023-07-14T11:19:35.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.461+0000 7f67eddff700 1 -- 172.21.15.84:0/345696912 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67e80b6fb0 con 0x7f67d4003b90 2023-07-14T11:19:35.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.462+0000 7f67eddff700 1 -- 172.21.15.84:0/345696912 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67e8151d70 con 0x7f67d4003b90 2023-07-14T11:19:35.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.463+0000 7f67eddff700 1 -- 172.21.15.84:0/345696912 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67e815bf80 con 0x7f67d4003b90 2023-07-14T11:19:35.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.463+0000 7f67e4ff9700 1 -- 172.21.15.84:0/345696912 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f67d8004180 con 0x7f67d4003b90 2023-07-14T11:19:35.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.465+0000 7f67e4ff9700 1 --2- 172.21.15.84:0/345696912 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f67c806ae00 0x7f67c806d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:35.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.465+0000 7f67e4ff9700 1 -- 172.21.15.84:0/345696912 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f67d808a890 con 0x7f67d4003b90 2023-07-14T11:19:35.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.466+0000 7f67dffff700 1 --2- 172.21.15.84:0/345696912 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f67c806ae00 0x7f67c806d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:35.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.466+0000 7f67dffff700 1 --2- 172.21.15.84:0/345696912 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f67c806ae00 0x7f67c806d2b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f67e80b6ea0 tx=0x7f67d0001d10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:35.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.469+0000 7f67e4ff9700 1 -- 172.21.15.84:0/345696912 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f67d80559e0 con 0x7f67d4003b90 2023-07-14T11:19:35.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.706+0000 7f67eddff700 1 -- 172.21.15.84:0/345696912 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f67e80b7600 con 0x7f67d4003b90 2023-07-14T11:19:35.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.706+0000 7f67e4ff9700 1 -- 172.21.15.84:0/345696912 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+4711 (secure 0 0 0) 0x7f67d8004430 con 0x7f67d4003b90 2023-07-14T11:19:35.709 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:19:35.709 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":69,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6197,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/396743399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":396743399},{"type":"v1","addr":"172.21.15.179:6835","nonce":396743399}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":7105,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3729505201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3729505201},{"type":"v1","addr":"172.21.15.179:6834","nonce":3729505201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":7680,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6833/411491873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":411491873},{"type":"v1","addr":"172.21.15.84:6833","nonce":411491873}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T11:19:24.441292+0000","modified":"2023-07-14T11:19:27.974517+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7683},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7683":{"gid":7683,"name":"c","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6835/2350815422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2350815422},{"type":"v1","addr":"172.21.15.84:6835","nonce":2350815422}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-07-14T11:19:35.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.709+0000 7f67eddff700 1 -- 172.21.15.84:0/345696912 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f67c806ae00 msgr2=0x7f67c806d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:35.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.709+0000 7f67eddff700 1 --2- 172.21.15.84:0/345696912 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f67c806ae00 0x7f67c806d2b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f67e80b6ea0 tx=0x7f67d0001d10 comp rx=0 tx=0).stop 2023-07-14T11:19:35.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.709+0000 7f67eddff700 1 -- 172.21.15.84:0/345696912 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67d4003b90 msgr2=0x7f67e80c9470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:35.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.709+0000 7f67eddff700 1 --2- 172.21.15.84:0/345696912 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67d4003b90 0x7f67e80c9470 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f67d400c0e0 tx=0x7f67d80047c0 comp rx=0 tx=0).stop 2023-07-14T11:19:35.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.709+0000 7f67eddff700 1 -- 172.21.15.84:0/345696912 shutdown_connections 2023-07-14T11:19:35.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.709+0000 7f67eddff700 1 --2- 172.21.15.84:0/345696912 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f67e80cfc80 0x7f67e80b5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:35.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.709+0000 7f67eddff700 1 --2- 172.21.15.84:0/345696912 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67d4003b90 0x7f67e80c9470 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:35.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.709+0000 7f67eddff700 1 --2- 172.21.15.84:0/345696912 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f67c806ae00 0x7f67c806d2b0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:35.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.709+0000 7f67eddff700 1 --2- 172.21.15.84:0/345696912 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f67e81f1fd0 0x7f67e80cf740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:35.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.709+0000 7f67eddff700 1 -- 172.21.15.84:0/345696912 >> 172.21.15.84:0/345696912 conn(0x7f67e809c1d0 msgr2=0x7f67e80b02b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:35.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.709+0000 7f67eddff700 1 -- 172.21.15.84:0/345696912 shutdown_connections 2023-07-14T11:19:35.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:35.709+0000 7f67eddff700 1 -- 172.21.15.84:0/345696912 wait complete. 2023-07-14T11:19:35.713 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 69 2023-07-14T11:19:36.131 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 69, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-14T11:19:24.441292+0000', 'modified': '2023-07-14T11:19:27.974517+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7683}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7683': {'gid': 7683, 'name': 'c', 'rank': 0, 'incarnation': 65, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.84:6835/2350815422', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6834', 'nonce': 2350815422}, {'type': 'v1', 'addr': '172.21.15.84:6835', 'nonce': 2350815422}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-14T11:19:36.132 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-14T11:19:36.132 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-07-14T11:19:36.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.327+0000 7f7a795ff700 1 Processor -- start 2023-07-14T11:19:36.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.327+0000 7f7a795ff700 1 -- start start 2023-07-14T11:19:36.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.328+0000 7f7a795ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a740afc40 0x7f7a740b2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:36.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.328+0000 7f7a795ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a7415ca90 con 0x7f7a7415c6c0 2023-07-14T11:19:36.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.328+0000 7f7a795ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a7406b0e0 con 0x7f7a7406b8a0 2023-07-14T11:19:36.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.328+0000 7f7a795ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a740d0370 con 0x7f7a740afc40 2023-07-14T11:19:36.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.328+0000 7f7a72ffd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f7a7415c6c0 0x7f7a740b2630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55444/0 (socket says 172.21.15.84:55444) 2023-07-14T11:19:36.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.328+0000 7f7a72ffd700 1 -- 172.21.15.84:0/3701542641 learned_addr learned my addr 172.21.15.84:0/3701542641 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:19:36.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.329+0000 7f7a6bfff700 1 --2- 172.21.15.84:0/3701542641 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a740afc40 0x7f7a740b2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:36.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.329+0000 7f7a727fc700 1 -- 172.21.15.84:0/3701542641 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3697792007 0 0) 0x7f7a64001110 con 0x7f7a7415c6c0 2023-07-14T11:19:36.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.329+0000 7f7a727fc700 1 -- 172.21.15.84:0/3701542641 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a600035b0 con 0x7f7a7415c6c0 2023-07-14T11:19:36.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.329+0000 7f7a727fc700 1 -- 172.21.15.84:0/3701542641 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1628067915 0 0) 0x7f7a7406b0e0 con 0x7f7a7406b8a0 2023-07-14T11:19:36.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.329+0000 7f7a727fc700 1 -- 172.21.15.84:0/3701542641 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a64001110 con 0x7f7a7406b8a0 2023-07-14T11:19:36.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.329+0000 7f7a727fc700 1 -- 172.21.15.84:0/3701542641 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 26408985 0 0) 0x7f7a600035b0 con 0x7f7a7415c6c0 2023-07-14T11:19:36.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.329+0000 7f7a727fc700 1 -- 172.21.15.84:0/3701542641 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a740afc40 msgr2=0x7f7a740b2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:36.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.329+0000 7f7a727fc700 1 --2- 172.21.15.84:0/3701542641 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a740afc40 0x7f7a740b2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:36.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.329+0000 7f7a727fc700 1 -- 172.21.15.84:0/3701542641 >> v1:172.21.15.179:6789/0 conn(0x7f7a7406b8a0 legacy=0x7f7a7406bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:36.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.329+0000 7f7a727fc700 1 -- 172.21.15.84:0/3701542641 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a740d0650 con 0x7f7a7415c6c0 2023-07-14T11:19:36.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.329+0000 7f7a727fc700 1 -- 172.21.15.84:0/3701542641 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7f7a64001800 con 0x7f7a7415c6c0 2023-07-14T11:19:36.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.329+0000 7f7a727fc700 1 -- 172.21.15.84:0/3701542641 >> v1:172.21.15.84:6789/0 conn(0x7f7a7415c6c0 legacy=0x7f7a740b2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:36.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.329+0000 7f7a727fc700 1 --2- 172.21.15.84:0/3701542641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a60003bc0 0x7f7a60003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:36.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.329+0000 7f7a727fc700 1 --2- 172.21.15.84:0/3701542641 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a60004850 0x7f7a60004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:36.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.329+0000 7f7a727fc700 1 --2- 172.21.15.84:0/3701542641 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a60005200 0x7f7a6000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:36.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.329+0000 7f7a727fc700 1 -- 172.21.15.84:0/3701542641 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a740d0370 con 0x7f7a60003bc0 2023-07-14T11:19:36.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.329+0000 7f7a727fc700 1 -- 172.21.15.84:0/3701542641 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a6000bfd0 con 0x7f7a60005200 2023-07-14T11:19:36.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.329+0000 7f7a727fc700 1 -- 172.21.15.84:0/3701542641 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a6000c190 con 0x7f7a60004850 2023-07-14T11:19:36.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.329+0000 7f7a6bfff700 1 --2- 172.21.15.84:0/3701542641 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a740afc40 0x7f7a740b2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:19:36.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.330+0000 7f7a72ffd700 1 --2- 172.21.15.84:0/3701542641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a60003bc0 0x7f7a60003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:36.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.330+0000 7f7a737fe700 1 --2- 172.21.15.84:0/3701542641 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a60005200 0x7f7a6000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:36.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.330+0000 7f7a6bfff700 1 --2- 172.21.15.84:0/3701542641 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a60004850 0x7f7a60004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:36.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.330+0000 7f7a72ffd700 1 -- 172.21.15.84:0/3701542641 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a60004850 msgr2=0x7f7a60004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:36.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.330+0000 7f7a72ffd700 1 --2- 172.21.15.84:0/3701542641 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a60004850 0x7f7a60004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:36.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.330+0000 7f7a72ffd700 1 -- 172.21.15.84:0/3701542641 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a60005200 msgr2=0x7f7a6000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:36.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.330+0000 7f7a72ffd700 1 --2- 172.21.15.84:0/3701542641 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a60005200 0x7f7a6000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:36.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.330+0000 7f7a72ffd700 1 -- 172.21.15.84:0/3701542641 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a600035b0 con 0x7f7a60003bc0 2023-07-14T11:19:36.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.330+0000 7f7a737fe700 1 --2- 172.21.15.84:0/3701542641 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a60005200 0x7f7a6000ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:19:36.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.330+0000 7f7a6bfff700 1 --2- 172.21.15.84:0/3701542641 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a60004850 0x7f7a60004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:19:36.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.330+0000 7f7a72ffd700 1 --2- 172.21.15.84:0/3701542641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a60003bc0 0x7f7a60003fb0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f7a6400c210 tx=0x7f7a60005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3ab4531b3edae01 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:36.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.330+0000 7f7a727fc700 1 -- 172.21.15.84:0/3701542641 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a6400cc90 con 0x7f7a60003bc0 2023-07-14T11:19:36.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.330+0000 7f7a727fc700 1 -- 172.21.15.84:0/3701542641 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a6400cdf0 con 0x7f7a60003bc0 2023-07-14T11:19:36.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.330+0000 7f7a727fc700 1 -- 172.21.15.84:0/3701542641 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a64005ba0 con 0x7f7a60003bc0 2023-07-14T11:19:36.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.331+0000 7f7a795ff700 1 -- 172.21.15.84:0/3701542641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a60003bc0 msgr2=0x7f7a60003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:36.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.331+0000 7f7a795ff700 1 --2- 172.21.15.84:0/3701542641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a60003bc0 0x7f7a60003fb0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f7a6400c210 tx=0x7f7a60005880 comp rx=0 tx=0).stop 2023-07-14T11:19:36.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.331+0000 7f7a737fe700 1 -- 172.21.15.84:0/3701542641 reap_dead start 2023-07-14T11:19:36.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.331+0000 7f7a795ff700 1 -- 172.21.15.84:0/3701542641 shutdown_connections 2023-07-14T11:19:36.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.331+0000 7f7a795ff700 1 -- 172.21.15.84:0/3701542641 >> 172.21.15.84:0/3701542641 conn(0x7f7a7406d980 msgr2=0x7f7a7406dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:36.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.331+0000 7f7a795ff700 1 -- 172.21.15.84:0/3701542641 shutdown_connections 2023-07-14T11:19:36.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.331+0000 7f7a795ff700 1 -- 172.21.15.84:0/3701542641 wait complete. 2023-07-14T11:19:36.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.333+0000 7f7a795ff700 1 Processor -- start 2023-07-14T11:19:36.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.333+0000 7f7a795ff700 1 -- start start 2023-07-14T11:19:36.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.334+0000 7f7a795ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a60003bc0 0x7f7a740ca490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:36.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.334+0000 7f7a795ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a74155410 0x7f7a74151e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:36.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.334+0000 7f7a795ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a74152370 0x7f7a741544d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:36.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.334+0000 7f7a795ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a740cb530 con 0x7f7a60003bc0 2023-07-14T11:19:36.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.334+0000 7f7a795ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a740cb1e0 con 0x7f7a74152370 2023-07-14T11:19:36.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.334+0000 7f7a795ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a741528b0 con 0x7f7a74155410 2023-07-14T11:19:36.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.334+0000 7f7a72ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a60003bc0 0x7f7a740ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:36.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.334+0000 7f7a72ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a60003bc0 0x7f7a740ca490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40850/0 (socket says 172.21.15.84:40850) 2023-07-14T11:19:36.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.334+0000 7f7a72ffd700 1 -- 172.21.15.84:0/1040754471 learned_addr learned my addr 172.21.15.84:0/1040754471 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:36.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.334+0000 7f7a6bfff700 1 --2- 172.21.15.84:0/1040754471 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a74155410 0x7f7a74151e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:36.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.334+0000 7f7a737fe700 1 --2- 172.21.15.84:0/1040754471 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a74152370 0x7f7a741544d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:36.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.334+0000 7f7a72ffd700 1 -- 172.21.15.84:0/1040754471 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a74155410 msgr2=0x7f7a74151e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:36.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.334+0000 7f7a72ffd700 1 --2- 172.21.15.84:0/1040754471 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a74155410 0x7f7a74151e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:36.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.335+0000 7f7a72ffd700 1 -- 172.21.15.84:0/1040754471 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a74152370 msgr2=0x7f7a741544d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:36.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.335+0000 7f7a72ffd700 1 --2- 172.21.15.84:0/1040754471 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a74152370 0x7f7a741544d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:36.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.335+0000 7f7a72ffd700 1 -- 172.21.15.84:0/1040754471 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a74152b50 con 0x7f7a60003bc0 2023-07-14T11:19:36.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.335+0000 7f7a72ffd700 1 --2- 172.21.15.84:0/1040754471 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a60003bc0 0x7f7a740ca490 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f7a6400c800 tx=0x7f7a64001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:36.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.335+0000 7f7a6b7fe700 1 -- 172.21.15.84:0/1040754471 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a64005e50 con 0x7f7a60003bc0 2023-07-14T11:19:36.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.335+0000 7f7a6b7fe700 1 -- 172.21.15.84:0/1040754471 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a640072e0 con 0x7f7a60003bc0 2023-07-14T11:19:36.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.335+0000 7f7a795ff700 1 -- 172.21.15.84:0/1040754471 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a74152e30 con 0x7f7a60003bc0 2023-07-14T11:19:36.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.335+0000 7f7a6b7fe700 1 -- 172.21.15.84:0/1040754471 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a64007650 con 0x7f7a60003bc0 2023-07-14T11:19:36.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.335+0000 7f7a795ff700 1 -- 172.21.15.84:0/1040754471 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a74154a10 con 0x7f7a60003bc0 2023-07-14T11:19:36.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.337+0000 7f7a6b7fe700 1 -- 172.21.15.84:0/1040754471 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f7a64019030 con 0x7f7a60003bc0 2023-07-14T11:19:36.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.338+0000 7f7a6b7fe700 1 --2- 172.21.15.84:0/1040754471 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f7a5406ae00 0x7f7a5406d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:36.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.338+0000 7f7a6b7fe700 1 -- 172.21.15.84:0/1040754471 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7a6408a860 con 0x7f7a60003bc0 2023-07-14T11:19:36.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.339+0000 7f7a6bfff700 1 --2- 172.21.15.84:0/1040754471 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f7a5406ae00 0x7f7a5406d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:36.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.339+0000 7f7a6bfff700 1 --2- 172.21.15.84:0/1040754471 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f7a5406ae00 0x7f7a5406d2b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7a74158650 tx=0x7f7a5c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:36.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.340+0000 7f7a8d01fb80 1 Processor -- start 2023-07-14T11:19:36.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.340+0000 7f7a8d01fb80 1 -- start start 2023-07-14T11:19:36.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.341+0000 7f7a8d01fb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56494b8aa880 0x56494b8da5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:36.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.341+0000 7f7a8d01fb80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56494b8acdc0 0x56494b8dab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:36.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.341+0000 7f7a8d01fb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56494b8aac50 0x56494b8c5120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:36.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.341+0000 7f7a8d01fb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x56494b824ea0 con 0x56494b8aa880 2023-07-14T11:19:36.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.341+0000 7f7a8d01fb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x56494b798600 con 0x56494b8aac50 2023-07-14T11:19:36.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.341+0000 7f7a8d01fb80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x56494b807910 con 0x56494b8acdc0 2023-07-14T11:19:36.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.341+0000 7f7a72ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56494b8aa880 0x56494b8da5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:36.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.341+0000 7f7a72ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56494b8aa880 0x56494b8da5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40856/0 (socket says 172.21.15.84:40856) 2023-07-14T11:19:36.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.341+0000 7f7a72ffd700 1 -- 172.21.15.84:0/796747163 learned_addr learned my addr 172.21.15.84:0/796747163 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:36.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.342+0000 7f7a6bfff700 1 --2- 172.21.15.84:0/796747163 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56494b8acdc0 0x56494b8dab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:36.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.342+0000 7f7a737fe700 1 --2- 172.21.15.84:0/796747163 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56494b8aac50 0x56494b8c5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:36.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.342+0000 7f7a72ffd700 1 -- 172.21.15.84:0/796747163 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56494b8acdc0 msgr2=0x56494b8dab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:36.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.342+0000 7f7a72ffd700 1 --2- 172.21.15.84:0/796747163 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56494b8acdc0 0x56494b8dab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:36.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.342+0000 7f7a72ffd700 1 -- 172.21.15.84:0/796747163 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56494b8aac50 msgr2=0x56494b8c5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:36.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.342+0000 7f7a72ffd700 1 --2- 172.21.15.84:0/796747163 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56494b8aac50 0x56494b8c5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:36.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.342+0000 7f7a72ffd700 1 -- 172.21.15.84:0/796747163 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56494b5f4790 con 0x56494b8aa880 2023-07-14T11:19:36.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.342+0000 7f7a6bfff700 1 --2- 172.21.15.84:0/796747163 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56494b8acdc0 0x56494b8dab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:19:36.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.342+0000 7f7a72ffd700 1 --2- 172.21.15.84:0/796747163 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56494b8aa880 0x56494b8da5e0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f7a64059440 tx=0x7f7a6400cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee2e70a29d137cec server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:36.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.342+0000 7f7a68ff9700 1 -- 172.21.15.84:0/796747163 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a64061800 con 0x56494b8aa880 2023-07-14T11:19:36.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.342+0000 7f7a68ff9700 1 -- 172.21.15.84:0/796747163 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a6405d170 con 0x56494b8aa880 2023-07-14T11:19:36.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.342+0000 7f7a68ff9700 1 -- 172.21.15.84:0/796747163 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a64055bc0 con 0x56494b8aa880 2023-07-14T11:19:36.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.343+0000 7f7a8d01fb80 1 -- 172.21.15.84:0/796747163 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56494b8aa880 msgr2=0x56494b8da5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:36.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.343+0000 7f7a8d01fb80 1 --2- 172.21.15.84:0/796747163 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56494b8aa880 0x56494b8da5e0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f7a64059440 tx=0x7f7a6400cd80 comp rx=0 tx=0).stop 2023-07-14T11:19:36.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.343+0000 7f7a8d01fb80 1 -- 172.21.15.84:0/796747163 shutdown_connections 2023-07-14T11:19:36.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.343+0000 7f7a8d01fb80 1 --2- 172.21.15.84:0/796747163 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56494b8aac50 0x56494b8c5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:36.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.343+0000 7f7a8d01fb80 1 --2- 172.21.15.84:0/796747163 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56494b8aa880 0x56494b8da5e0 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:36.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.343+0000 7f7a8d01fb80 1 --2- 172.21.15.84:0/796747163 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56494b8acdc0 0x56494b8dab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:36.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.343+0000 7f7a8d01fb80 1 -- 172.21.15.84:0/796747163 >> 172.21.15.84:0/796747163 conn(0x56494b8a53b0 msgr2=0x56494b8b0550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:36.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.343+0000 7f7a8d01fb80 1 -- 172.21.15.84:0/796747163 shutdown_connections 2023-07-14T11:19:36.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.343+0000 7f7a8d01fb80 1 -- 172.21.15.84:0/796747163 wait complete. 2023-07-14T11:19:36.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.344+0000 7f7a8d01fb80 1 -- start start 2023-07-14T11:19:36.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.344+0000 7f7a8d01fb80 1 Processor -- start 2023-07-14T11:19:36.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.346+0000 7f7a8d01fb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56494b8aa880 0x56494b9079d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:36.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.346+0000 7f7a8d01fb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56494b8aac50 0x56494b904f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:36.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.346+0000 7f7a8d01fb80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56494b8acdc0 0x56494b8ee950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:36.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.346+0000 7f7a8d01fb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x56494b800be0 con 0x56494b8aac50 2023-07-14T11:19:36.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.346+0000 7f7a8d01fb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x56494b7be5b0 con 0x56494b8aa880 2023-07-14T11:19:36.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.346+0000 7f7a8d01fb80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x56494b7a4910 con 0x56494b8acdc0 2023-07-14T11:19:36.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.346+0000 7f7a8d01fb80 10 client.0 _ll_register_callbacks cb 0x56494b7bcb70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T11:19:36.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.346+0000 7f7a6bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56494b8aac50 0x56494b904f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:36.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.346+0000 7f7a6bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56494b8aac50 0x56494b904f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40864/0 (socket says 172.21.15.84:40864) 2023-07-14T11:19:36.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.346+0000 7f7a6bfff700 1 -- 172.21.15.84:0/4260015866 learned_addr learned my addr 172.21.15.84:0/4260015866 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:36.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.346+0000 7f7a737fe700 1 --2- 172.21.15.84:0/4260015866 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56494b8acdc0 0x56494b8ee950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:36.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.347+0000 7f7a72ffd700 1 --2- 172.21.15.84:0/4260015866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56494b8aa880 0x56494b9079d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:36.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.347+0000 7f7a6bfff700 1 -- 172.21.15.84:0/4260015866 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56494b8acdc0 msgr2=0x56494b8ee950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:36.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.347+0000 7f7a6bfff700 1 --2- 172.21.15.84:0/4260015866 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56494b8acdc0 0x56494b8ee950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:36.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.347+0000 7f7a6bfff700 1 -- 172.21.15.84:0/4260015866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56494b8aa880 msgr2=0x56494b9079d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:36.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.347+0000 7f7a6bfff700 1 --2- 172.21.15.84:0/4260015866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56494b8aa880 0x56494b9079d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:36.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.347+0000 7f7a6bfff700 1 -- 172.21.15.84:0/4260015866 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a74154a10 con 0x56494b8aac50 2023-07-14T11:19:36.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.347+0000 7f7a6bfff700 1 --2- 172.21.15.84:0/4260015866 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56494b8aac50 0x56494b904f80 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f7a7415f970 tx=0x7f7a5c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbe8b57726240d1b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:36.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.347+0000 7f7a51ffb700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-07-14T11:19:36.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.347+0000 7f7a51ffb700 1 -- 172.21.15.84:0/4260015866 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a5c023420 con 0x56494b8aac50 2023-07-14T11:19:36.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.347+0000 7f7a51ffb700 1 -- 172.21.15.84:0/4260015866 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7a5c023580 con 0x56494b8aac50 2023-07-14T11:19:36.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.347+0000 7f7a8d01fb80 1 -- 172.21.15.84:0/4260015866 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56494b8a29c0 con 0x56494b8aac50 2023-07-14T11:19:36.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.347+0000 7f7a51ffb700 1 -- 172.21.15.84:0/4260015866 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7a5c005a20 con 0x56494b8aac50 2023-07-14T11:19:36.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.347+0000 7f7a8d01fb80 10 client.7866 fetch_fsmap learned FSMap version 69 2023-07-14T11:19:36.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.347+0000 7f7a8d01fb80 1 -- 172.21.15.84:0/4260015866 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=2+}) v3 -- 0x56494b6e10a0 con 0x56494b8aac50 2023-07-14T11:19:36.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.348+0000 7f7a51ffb700 1 -- 172.21.15.84:0/4260015866 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56494b8a29c0 con 0x56494b8aac50 2023-07-14T11:19:36.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.348+0000 7f7a51ffb700 1 -- 172.21.15.84:0/4260015866 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 69) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f7a5c005b80 con 0x56494b8aac50 2023-07-14T11:19:36.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.348+0000 7f7a8d01fb80 10 client.7866 fetch_fsmap finished waiting for FSMap version 69 2023-07-14T11:19:36.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.348+0000 7f7a8d01fb80 10 client.7866 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-14T11:19:36.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.348+0000 7f7a8d01fb80 20 client.7866 populate_metadata read hostname 'smithi084' 2023-07-14T11:19:36.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.348+0000 7f7a8d01fb80 1 --2- 172.21.15.84:0/4260015866 >> [v2:172.21.15.84:6834/2350815422,v1:172.21.15.84:6835/2350815422] conn(0x56494b8eee90 0x56494b8f0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:36.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.348+0000 7f7a8d01fb80 4 client.7866 mds_command: new command op to 7683 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T11:19:36.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.348+0000 7f7a8d01fb80 1 -- 172.21.15.84:0/4260015866 --> [v2:172.21.15.84:6834/2350815422,v1:172.21.15.84:6835/2350815422] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56494b87f170 con 0x56494b8eee90 2023-07-14T11:19:36.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.348+0000 7f7a72ffd700 1 --2- 172.21.15.84:0/4260015866 >> [v2:172.21.15.84:6834/2350815422,v1:172.21.15.84:6835/2350815422] conn(0x56494b8eee90 0x56494b8f0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:36.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.349+0000 7f7a72ffd700 1 --2- 172.21.15.84:0/4260015866 >> [v2:172.21.15.84:6834/2350815422,v1:172.21.15.84:6835/2350815422] conn(0x56494b8eee90 0x56494b8f0e10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=151efaedf55caa1d server_cookie=196c9773eae47f43 in_seq=0 out_seq=0 2023-07-14T11:19:36.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.349+0000 7f7a51ffb700 10 client.7866 ms_handle_connect on v2:172.21.15.84:6834/2350815422 2023-07-14T11:19:36.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.349+0000 7f7a51ffb700 1 -- 172.21.15.84:0/4260015866 <== mds.0 v2:172.21.15.84:6834/2350815422 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x56494b87f170 con 0x56494b8eee90 2023-07-14T11:19:36.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.349+0000 7f7a51ffb700 10 client.7866 handle_command_reply: tid=0 2023-07-14T11:19:36.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.349+0000 7f7a8d01fb80 1 client.7866 shutdown 2023-07-14T11:19:36.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.350+0000 7f7a8d01fb80 1 -- 172.21.15.84:0/4260015866 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56494b8aac50 msgr2=0x56494b904f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:36.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.350+0000 7f7a8d01fb80 1 --2- 172.21.15.84:0/4260015866 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56494b8aac50 0x56494b904f80 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f7a7415f970 tx=0x7f7a5c0047c0 comp rx=0 tx=0).stop 2023-07-14T11:19:36.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.350+0000 7f7a8d01fb80 1 -- 172.21.15.84:0/4260015866 shutdown_connections 2023-07-14T11:19:36.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.350+0000 7f7a8d01fb80 1 --2- 172.21.15.84:0/4260015866 >> [v2:172.21.15.84:6834/2350815422,v1:172.21.15.84:6835/2350815422] conn(0x56494b8eee90 0x56494b8f0e10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:36.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.350+0000 7f7a8d01fb80 1 --2- 172.21.15.84:0/4260015866 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56494b8acdc0 0x56494b8ee950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:36.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.350+0000 7f7a8d01fb80 1 --2- 172.21.15.84:0/4260015866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56494b8aa880 0x56494b9079d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:36.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.350+0000 7f7a8d01fb80 1 --2- 172.21.15.84:0/4260015866 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56494b8aac50 0x56494b904f80 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:36.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.350+0000 7f7a51ffb700 0 client.7866 ms_handle_reset on v2:172.21.15.84:6834/2350815422 2023-07-14T11:19:36.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.350+0000 7f7a8d01fb80 1 -- 172.21.15.84:0/4260015866 >> 172.21.15.84:0/4260015866 conn(0x56494b8a53b0 msgr2=0x56494b8d85c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:36.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.350+0000 7f7a8d01fb80 1 -- 172.21.15.84:0/4260015866 shutdown_connections 2023-07-14T11:19:36.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.350+0000 7f7a8d01fb80 1 -- 172.21.15.84:0/4260015866 wait complete. 2023-07-14T11:19:36.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.350+0000 7f7a8d01fb80 20 client.7866 trim_cache size 0 max 16384 2023-07-14T11:19:36.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.368+0000 7f7a8d01fb80 1 Processor -- start 2023-07-14T11:19:36.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.368+0000 7f7a8d01fb80 1 -- start start 2023-07-14T11:19:36.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.369+0000 7f7a8d01fb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56494b8aa880 0x56494b8ee2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:36.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.369+0000 7f7a8d01fb80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56494b8aac50 0x56494b8c5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:36.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.369+0000 7f7a8d01fb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56494b8acdc0 0x56494b8c6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:36.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.369+0000 7f7a8d01fb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x56494b5f5390 con 0x56494b8aa880 2023-07-14T11:19:36.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.369+0000 7f7a8d01fb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x56494b8f2180 con 0x56494b8acdc0 2023-07-14T11:19:36.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.369+0000 7f7a8d01fb80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x56494b8f1f80 con 0x56494b8aac50 2023-07-14T11:19:36.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.369+0000 7f7a72ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56494b8aa880 0x56494b8ee2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:36.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.369+0000 7f7a72ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56494b8aa880 0x56494b8ee2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40872/0 (socket says 172.21.15.84:40872) 2023-07-14T11:19:36.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.369+0000 7f7a72ffd700 1 -- 172.21.15.84:0/3593223230 learned_addr learned my addr 172.21.15.84:0/3593223230 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:36.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.369+0000 7f7a72ffd700 1 -- 172.21.15.84:0/3593223230 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56494b8aac50 msgr2=0x56494b8c5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:36.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.369+0000 7f7a72ffd700 1 --2- 172.21.15.84:0/3593223230 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56494b8aac50 0x56494b8c5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:36.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.369+0000 7f7a72ffd700 1 -- 172.21.15.84:0/3593223230 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56494b8acdc0 msgr2=0x56494b8c6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:36.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.369+0000 7f7a72ffd700 1 --2- 172.21.15.84:0/3593223230 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56494b8acdc0 0x56494b8c6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:36.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.369+0000 7f7a72ffd700 1 -- 172.21.15.84:0/3593223230 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56494b8ae070 con 0x56494b8aa880 2023-07-14T11:19:36.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.370+0000 7f7a72ffd700 1 --2- 172.21.15.84:0/3593223230 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56494b8aa880 0x56494b8ee2e0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f7a640559b0 tx=0x7f7a6405d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e1a0bc5078d9679 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:36.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.370+0000 7f7a697fa700 1 -- 172.21.15.84:0/3593223230 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a64061800 con 0x56494b8aa880 2023-07-14T11:19:36.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.370+0000 7f7a697fa700 1 -- 172.21.15.84:0/3593223230 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a64057850 con 0x56494b8aa880 2023-07-14T11:19:36.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.370+0000 7f7a697fa700 1 -- 172.21.15.84:0/3593223230 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a64055bc0 con 0x56494b8aa880 2023-07-14T11:19:36.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.370+0000 7f7a8d01fb80 1 -- 172.21.15.84:0/3593223230 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56494b8aa880 msgr2=0x56494b8ee2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:36.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.370+0000 7f7a8d01fb80 1 --2- 172.21.15.84:0/3593223230 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56494b8aa880 0x56494b8ee2e0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f7a640559b0 tx=0x7f7a6405d000 comp rx=0 tx=0).stop 2023-07-14T11:19:36.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.370+0000 7f7a8d01fb80 1 -- 172.21.15.84:0/3593223230 shutdown_connections 2023-07-14T11:19:36.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.370+0000 7f7a8d01fb80 1 --2- 172.21.15.84:0/3593223230 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56494b8acdc0 0x56494b8c6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:36.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.370+0000 7f7a8d01fb80 1 --2- 172.21.15.84:0/3593223230 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56494b8aa880 0x56494b8ee2e0 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:36.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.370+0000 7f7a8d01fb80 1 --2- 172.21.15.84:0/3593223230 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56494b8aac50 0x56494b8c5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:36.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.370+0000 7f7a8d01fb80 1 -- 172.21.15.84:0/3593223230 >> 172.21.15.84:0/3593223230 conn(0x56494b8a53b0 msgr2=0x56494b8b0520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:36.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.371+0000 7f7a8d01fb80 1 -- 172.21.15.84:0/3593223230 shutdown_connections 2023-07-14T11:19:36.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.371+0000 7f7a8d01fb80 1 -- 172.21.15.84:0/3593223230 wait complete. 2023-07-14T11:19:36.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.371+0000 7f7a8d01fb80 1 -- start start 2023-07-14T11:19:36.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.372+0000 7f7a8d01fb80 1 Processor -- start 2023-07-14T11:19:36.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.373+0000 7f7a8d01fb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56494b8aa880 0x56494b941a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:36.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.373+0000 7f7a8d01fb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56494b8aac50 0x56494b8d69a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:36.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.373+0000 7f7a8d01fb80 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56494b8acdc0 0x56494b8c5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:36.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.373+0000 7f7a8d01fb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x56494b8f8950 con 0x56494b8aa880 2023-07-14T11:19:36.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.373+0000 7f7a8d01fb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x56494b8dc620 con 0x56494b8aac50 2023-07-14T11:19:36.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.373+0000 7f7a8d01fb80 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x56494b8dc060 con 0x56494b8acdc0 2023-07-14T11:19:36.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.373+0000 7f7a8d01fb80 10 client.0 _ll_register_callbacks cb 0x7f7a5c012ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T11:19:36.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.373+0000 7f7a72ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56494b8aa880 0x56494b941a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:36.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.374+0000 7f7a72ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56494b8aa880 0x56494b941a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40884/0 (socket says 172.21.15.84:40884) 2023-07-14T11:19:36.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.374+0000 7f7a72ffd700 1 -- 172.21.15.84:0/763568127 learned_addr learned my addr 172.21.15.84:0/763568127 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:36.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.374+0000 7f7a737fe700 1 --2- 172.21.15.84:0/763568127 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56494b8acdc0 0x56494b8c5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:36.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.374+0000 7f7a6bfff700 1 --2- 172.21.15.84:0/763568127 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56494b8aac50 0x56494b8d69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:36.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.374+0000 7f7a72ffd700 1 -- 172.21.15.84:0/763568127 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56494b8acdc0 msgr2=0x56494b8c5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:36.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.374+0000 7f7a72ffd700 1 --2- 172.21.15.84:0/763568127 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56494b8acdc0 0x56494b8c5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:36.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.374+0000 7f7a72ffd700 1 -- 172.21.15.84:0/763568127 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56494b8aac50 msgr2=0x56494b8d69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:36.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.374+0000 7f7a72ffd700 1 --2- 172.21.15.84:0/763568127 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56494b8aac50 0x56494b8d69a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:36.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.374+0000 7f7a72ffd700 1 -- 172.21.15.84:0/763568127 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56494b5f4790 con 0x56494b8aa880 2023-07-14T11:19:36.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.374+0000 7f7a6bfff700 1 --2- 172.21.15.84:0/763568127 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56494b8aac50 0x56494b8d69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:19:36.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.374+0000 7f7a72ffd700 1 --2- 172.21.15.84:0/763568127 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56494b8aa880 0x56494b941a20 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f7a64057800 tx=0x7f7a6402b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d997b0848530437c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:36.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.374+0000 7f7a51ffb700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-07-14T11:19:36.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.374+0000 7f7a51ffb700 1 -- 172.21.15.84:0/763568127 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a64055bc0 con 0x56494b8aa880 2023-07-14T11:19:36.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.374+0000 7f7a51ffb700 1 -- 172.21.15.84:0/763568127 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7a64055d20 con 0x56494b8aa880 2023-07-14T11:19:36.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.374+0000 7f7a8d01fb80 1 -- 172.21.15.84:0/763568127 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7a6405d170 con 0x56494b8aa880 2023-07-14T11:19:36.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.374+0000 7f7a51ffb700 1 -- 172.21.15.84:0/763568127 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7a6405f0e0 con 0x56494b8aa880 2023-07-14T11:19:36.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.374+0000 7f7a8d01fb80 10 client.7872 fetch_fsmap learned FSMap version 69 2023-07-14T11:19:36.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.374+0000 7f7a8d01fb80 1 -- 172.21.15.84:0/763568127 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=2+}) v3 -- 0x56494b7c6b10 con 0x56494b8aa880 2023-07-14T11:19:36.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.375+0000 7f7a51ffb700 1 -- 172.21.15.84:0/763568127 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a64065020 con 0x56494b8aa880 2023-07-14T11:19:36.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.375+0000 7f7a51ffb700 1 -- 172.21.15.84:0/763568127 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 69) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f7a640589a0 con 0x56494b8aa880 2023-07-14T11:19:36.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.375+0000 7f7a8d01fb80 10 client.7872 fetch_fsmap finished waiting for FSMap version 69 2023-07-14T11:19:36.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.375+0000 7f7a8d01fb80 10 client.7872 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-14T11:19:36.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.375+0000 7f7a8d01fb80 20 client.7872 populate_metadata read hostname 'smithi084' 2023-07-14T11:19:36.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.375+0000 7f7a8d01fb80 1 --2- 172.21.15.84:0/763568127 >> [v2:172.21.15.84:6834/2350815422,v1:172.21.15.84:6835/2350815422] conn(0x56494b8c5fe0 0x56494b906550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:36.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.375+0000 7f7a8d01fb80 4 client.7872 mds_command: new command op to 7683 tid=0[{"prefix": "status"}] 2023-07-14T11:19:36.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.375+0000 7f7a8d01fb80 1 -- 172.21.15.84:0/763568127 --> [v2:172.21.15.84:6834/2350815422,v1:172.21.15.84:6835/2350815422] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56494b7f9d20 con 0x56494b8c5fe0 2023-07-14T11:19:36.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.375+0000 7f7a6bfff700 1 --2- 172.21.15.84:0/763568127 >> [v2:172.21.15.84:6834/2350815422,v1:172.21.15.84:6835/2350815422] conn(0x56494b8c5fe0 0x56494b906550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:36.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.376+0000 7f7a6bfff700 1 --2- 172.21.15.84:0/763568127 >> [v2:172.21.15.84:6834/2350815422,v1:172.21.15.84:6835/2350815422] conn(0x56494b8c5fe0 0x56494b906550 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=945b144b7db8e40b server_cookie=ca4c14e6e8b39fc5 in_seq=0 out_seq=0 2023-07-14T11:19:36.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.376+0000 7f7a51ffb700 10 client.7872 ms_handle_connect on v2:172.21.15.84:6834/2350815422 2023-07-14T11:19:36.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.376+0000 7f7a51ffb700 1 -- 172.21.15.84:0/763568127 <== mds.0 v2:172.21.15.84:6834/2350815422 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x56494b7f9d20 con 0x56494b8c5fe0 2023-07-14T11:19:36.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.376+0000 7f7a51ffb700 10 client.7872 handle_command_reply: tid=0 2023-07-14T11:19:36.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.376+0000 7f7a8d01fb80 1 client.7872 shutdown 2023-07-14T11:19:36.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.376+0000 7f7a8d01fb80 1 -- 172.21.15.84:0/763568127 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56494b8aa880 msgr2=0x56494b941a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:36.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.376+0000 7f7a8d01fb80 1 --2- 172.21.15.84:0/763568127 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56494b8aa880 0x56494b941a20 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f7a64057800 tx=0x7f7a6402b000 comp rx=0 tx=0).stop 2023-07-14T11:19:36.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.376+0000 7f7a8d01fb80 1 -- 172.21.15.84:0/763568127 shutdown_connections 2023-07-14T11:19:36.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.376+0000 7f7a8d01fb80 1 --2- 172.21.15.84:0/763568127 >> [v2:172.21.15.84:6834/2350815422,v1:172.21.15.84:6835/2350815422] conn(0x56494b8c5fe0 0x56494b906550 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:36.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.376+0000 7f7a8d01fb80 1 --2- 172.21.15.84:0/763568127 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56494b8acdc0 0x56494b8c5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:36.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.376+0000 7f7a8d01fb80 1 --2- 172.21.15.84:0/763568127 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56494b8aa880 0x56494b941a20 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:36.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.376+0000 7f7a8d01fb80 1 --2- 172.21.15.84:0/763568127 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56494b8aac50 0x56494b8d69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:36.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.376+0000 7f7a8d01fb80 1 -- 172.21.15.84:0/763568127 >> 172.21.15.84:0/763568127 conn(0x56494b8a53b0 msgr2=0x56494b8d85c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:36.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.376+0000 7f7a51ffb700 0 client.7872 ms_handle_reset on v2:172.21.15.84:6834/2350815422 2023-07-14T11:19:36.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.376+0000 7f7a8d01fb80 1 -- 172.21.15.84:0/763568127 shutdown_connections 2023-07-14T11:19:36.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.376+0000 7f7a8d01fb80 1 -- 172.21.15.84:0/763568127 wait complete. 2023-07-14T11:19:36.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.376+0000 7f7a8d01fb80 20 client.7872 trim_cache size 0 max 16384 2023-07-14T11:19:36.393 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-07-14T11:19:36.393 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f", 2023-07-14T11:19:36.394 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 0, 2023-07-14T11:19:36.394 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 7683, 2023-07-14T11:19:36.394 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2023-07-14T11:19:36.394 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2023-07-14T11:19:36.394 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2023-07-14T11:19:36.394 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 11.427643782000001, 2023-07-14T11:19:36.395 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 69, 2023-07-14T11:19:36.395 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 106, 2023-07-14T11:19:36.395 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 106, 2023-07-14T11:19:36.395 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 16.936176564 2023-07-14T11:19:36.395 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-07-14T11:19:36.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.377+0000 7f7a795ff700 1 -- 172.21.15.84:0/1040754471 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f7a5406ae00 msgr2=0x7f7a5406d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:36.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.377+0000 7f7a795ff700 1 --2- 172.21.15.84:0/1040754471 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f7a5406ae00 0x7f7a5406d2b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7a74158650 tx=0x7f7a5c008040 comp rx=0 tx=0).stop 2023-07-14T11:19:36.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.377+0000 7f7a795ff700 1 -- 172.21.15.84:0/1040754471 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a60003bc0 msgr2=0x7f7a740ca490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:36.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.377+0000 7f7a795ff700 1 --2- 172.21.15.84:0/1040754471 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a60003bc0 0x7f7a740ca490 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f7a6400c800 tx=0x7f7a64001b10 comp rx=0 tx=0).stop 2023-07-14T11:19:36.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.377+0000 7f7a795ff700 1 -- 172.21.15.84:0/1040754471 shutdown_connections 2023-07-14T11:19:36.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.377+0000 7f7a795ff700 1 --2- 172.21.15.84:0/1040754471 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a74152370 0x7f7a741544d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:36.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.377+0000 7f7a795ff700 1 --2- 172.21.15.84:0/1040754471 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a60003bc0 0x7f7a740ca490 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:36.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.377+0000 7f7a795ff700 1 --2- 172.21.15.84:0/1040754471 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f7a5406ae00 0x7f7a5406d2b0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:36.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.377+0000 7f7a795ff700 1 --2- 172.21.15.84:0/1040754471 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a74155410 0x7f7a74151e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:36.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.377+0000 7f7a795ff700 1 -- 172.21.15.84:0/1040754471 >> 172.21.15.84:0/1040754471 conn(0x7f7a7406d980 msgr2=0x7f7a740b3a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:36.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.377+0000 7f7a795ff700 1 -- 172.21.15.84:0/1040754471 shutdown_connections 2023-07-14T11:19:36.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.377+0000 7f7a795ff700 1 -- 172.21.15.84:0/1040754471 wait complete. 2023-07-14T11:19:36.399 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-14T11:19:36.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.591+0000 7fc07adff700 1 Processor -- start 2023-07-14T11:19:36.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.591+0000 7fc07adff700 1 -- start start 2023-07-14T11:19:36.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.592+0000 7fc07adff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc0740d1160 0x7fc07406c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:36.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.592+0000 7fc07adff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc0740b5cd0 0x7fc0740b0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:36.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.592+0000 7fc07adff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0740d2cc0 con 0x7fc074160030 2023-07-14T11:19:36.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.592+0000 7fc07adff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0740afbb0 con 0x7fc0740b5cd0 2023-07-14T11:19:36.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.592+0000 7fc07adff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0740afe90 con 0x7fc0740d1160 2023-07-14T11:19:36.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.592+0000 7fc07939c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc0740b5cd0 0x7fc0740b0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:36.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.592+0000 7fc078b9b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fc074160030 0x7fc0740d0a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55450/0 (socket says 172.21.15.84:55450) 2023-07-14T11:19:36.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.592+0000 7fc078b9b700 1 -- 172.21.15.84:0/1883220246 learned_addr learned my addr 172.21.15.84:0/1883220246 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:19:36.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.593+0000 7fc073fff700 1 --2- 172.21.15.84:0/1883220246 >> v2:172.21.15.179:3300/0 conn(0x7fc0740d1160 0x7fc07406c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:36.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.593+0000 7fc0737fe700 1 -- 172.21.15.84:0/1883220246 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1976830121 0 0) 0x7fc0740d2cc0 con 0x7fc074160030 2023-07-14T11:19:36.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.593+0000 7fc07939c700 1 -- 172.21.15.84:0/1883220246 >> v2:172.21.15.179:3300/0 conn(0x7fc0740d1160 msgr2=0x7fc07406c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:36.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.593+0000 7fc07939c700 1 --2- 172.21.15.84:0/1883220246 >> v2:172.21.15.179:3300/0 conn(0x7fc0740d1160 0x7fc07406c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:36.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.593+0000 7fc07939c700 1 -- 172.21.15.84:0/1883220246 >> v1:172.21.15.84:6789/0 conn(0x7fc074160030 legacy=0x7fc0740d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:36.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.593+0000 7fc07939c700 1 -- 172.21.15.84:0/1883220246 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0740b0170 con 0x7fc0740b5cd0 2023-07-14T11:19:36.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.593+0000 7fc07939c700 1 --2- 172.21.15.84:0/1883220246 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0740b5cd0 0x7fc0740b0c50 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7fc074072140 tx=0x7fc06c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfe4ba5d037e898e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:36.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.593+0000 7fc0737fe700 1 -- 172.21.15.84:0/1883220246 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc06c00e070 con 0x7fc0740b5cd0 2023-07-14T11:19:36.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.593+0000 7fc0737fe700 1 -- 172.21.15.84:0/1883220246 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc06c00bb20 con 0x7fc0740b5cd0 2023-07-14T11:19:36.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.593+0000 7fc0737fe700 1 -- 172.21.15.84:0/1883220246 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc06c012430 con 0x7fc0740b5cd0 2023-07-14T11:19:36.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.594+0000 7fc07adff700 1 -- 172.21.15.84:0/1883220246 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0740b5cd0 msgr2=0x7fc0740b0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:36.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.594+0000 7fc07adff700 1 --2- 172.21.15.84:0/1883220246 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0740b5cd0 0x7fc0740b0c50 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7fc074072140 tx=0x7fc06c00b330 comp rx=0 tx=0).stop 2023-07-14T11:19:36.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.594+0000 7fc07adff700 1 -- 172.21.15.84:0/1883220246 shutdown_connections 2023-07-14T11:19:36.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.594+0000 7fc07adff700 1 --2- 172.21.15.84:0/1883220246 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0740b5cd0 0x7fc0740b0c50 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:36.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.594+0000 7fc07adff700 1 --2- 172.21.15.84:0/1883220246 >> v2:172.21.15.179:3300/0 conn(0x7fc0740d1160 0x7fc07406c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:36.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.594+0000 7fc07adff700 1 -- 172.21.15.84:0/1883220246 >> 172.21.15.84:0/1883220246 conn(0x7fc07409c190 msgr2=0x7fc0740d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:36.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.594+0000 7fc07adff700 1 -- 172.21.15.84:0/1883220246 shutdown_connections 2023-07-14T11:19:36.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.594+0000 7fc07adff700 1 -- 172.21.15.84:0/1883220246 wait complete. 2023-07-14T11:19:36.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.596+0000 7fc07adff700 1 Processor -- start 2023-07-14T11:19:36.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.596+0000 7fc07adff700 1 -- start start 2023-07-14T11:19:36.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.597+0000 7fc07adff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0740b5cd0 0x7fc0741f2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:36.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.597+0000 7fc07adff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0740d1160 0x7fc07414e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:36.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.597+0000 7fc07adff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc074160030 0x7fc0740b28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:36.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.597+0000 7fc07adff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc07414e810 con 0x7fc0740b5cd0 2023-07-14T11:19:36.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.597+0000 7fc07adff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0740b5110 con 0x7fc074160030 2023-07-14T11:19:36.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.597+0000 7fc07adff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0740c7980 con 0x7fc0740d1160 2023-07-14T11:19:36.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.597+0000 7fc078b9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0740b5cd0 0x7fc0741f2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:36.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.597+0000 7fc078b9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0740b5cd0 0x7fc0741f2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40912/0 (socket says 172.21.15.84:40912) 2023-07-14T11:19:36.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.597+0000 7fc078b9b700 1 -- 172.21.15.84:0/3073867701 learned_addr learned my addr 172.21.15.84:0/3073867701 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:36.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.597+0000 7fc07939c700 1 --2- 172.21.15.84:0/3073867701 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc074160030 0x7fc0740b28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:36.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.597+0000 7fc073fff700 1 --2- 172.21.15.84:0/3073867701 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0740d1160 0x7fc07414e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:36.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.598+0000 7fc078b9b700 1 -- 172.21.15.84:0/3073867701 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0740d1160 msgr2=0x7fc07414e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:36.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.598+0000 7fc078b9b700 1 --2- 172.21.15.84:0/3073867701 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0740d1160 0x7fc07414e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:36.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.598+0000 7fc078b9b700 1 -- 172.21.15.84:0/3073867701 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc074160030 msgr2=0x7fc0740b28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:36.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.598+0000 7fc078b9b700 1 --2- 172.21.15.84:0/3073867701 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc074160030 0x7fc0740b28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:36.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.598+0000 7fc078b9b700 1 -- 172.21.15.84:0/3073867701 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc06c009a70 con 0x7fc0740b5cd0 2023-07-14T11:19:36.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.598+0000 7fc073fff700 1 --2- 172.21.15.84:0/3073867701 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0740d1160 0x7fc07414e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:19:36.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.598+0000 7fc078b9b700 1 --2- 172.21.15.84:0/3073867701 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0740b5cd0 0x7fc0741f2b00 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7fc06800c550 tx=0x7fc06800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:36.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.598+0000 7fc0717fa700 1 -- 172.21.15.84:0/3073867701 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc068004c80 con 0x7fc0740b5cd0 2023-07-14T11:19:36.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.598+0000 7fc0717fa700 1 -- 172.21.15.84:0/3073867701 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc068004e00 con 0x7fc0740b5cd0 2023-07-14T11:19:36.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.598+0000 7fc07adff700 1 -- 172.21.15.84:0/3073867701 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0740c7c60 con 0x7fc0740b5cd0 2023-07-14T11:19:36.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.598+0000 7fc0717fa700 1 -- 172.21.15.84:0/3073867701 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc068007310 con 0x7fc0740b5cd0 2023-07-14T11:19:36.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.598+0000 7fc07adff700 1 -- 172.21.15.84:0/3073867701 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0740c8220 con 0x7fc0740b5cd0 2023-07-14T11:19:36.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.599+0000 7fc07adff700 1 -- 172.21.15.84:0/3073867701 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0740c8440 con 0x7fc0740b5cd0 2023-07-14T11:19:36.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.600+0000 7fc0717fa700 1 -- 172.21.15.84:0/3073867701 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7fc068007470 con 0x7fc0740b5cd0 2023-07-14T11:19:36.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.601+0000 7fc0717fa700 1 --2- 172.21.15.84:0/3073867701 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fc05806ae00 0x7fc05806d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:36.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.601+0000 7fc0717fa700 1 -- 172.21.15.84:0/3073867701 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc068089350 con 0x7fc0740b5cd0 2023-07-14T11:19:36.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.602+0000 7fc073fff700 1 --2- 172.21.15.84:0/3073867701 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fc05806ae00 0x7fc05806d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:36.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.602+0000 7fc073fff700 1 --2- 172.21.15.84:0/3073867701 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fc05806ae00 0x7fc05806d2b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc07415e290 tx=0x7fc060008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:36.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.605+0000 7fc0717fa700 1 -- 172.21.15.84:0/3073867701 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fc0680542e0 con 0x7fc0740b5cd0 2023-07-14T11:19:36.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.842+0000 7fc07adff700 1 -- 172.21.15.84:0/3073867701 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc07404e280 con 0x7fc0740b5cd0 2023-07-14T11:19:36.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.842+0000 7fc0717fa700 1 -- 172.21.15.84:0/3073867701 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v69) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc068057900 con 0x7fc0740b5cd0 2023-07-14T11:19:36.845 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-14T11:19:36.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.845+0000 7fc07adff700 1 -- 172.21.15.84:0/3073867701 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fc05806ae00 msgr2=0x7fc05806d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:36.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.845+0000 7fc07adff700 1 --2- 172.21.15.84:0/3073867701 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fc05806ae00 0x7fc05806d2b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc07415e290 tx=0x7fc060008040 comp rx=0 tx=0).stop 2023-07-14T11:19:36.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.845+0000 7fc07adff700 1 -- 172.21.15.84:0/3073867701 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0740b5cd0 msgr2=0x7fc0741f2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:36.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.845+0000 7fc07adff700 1 --2- 172.21.15.84:0/3073867701 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0740b5cd0 0x7fc0741f2b00 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7fc06800c550 tx=0x7fc06800c910 comp rx=0 tx=0).stop 2023-07-14T11:19:36.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.845+0000 7fc07adff700 1 -- 172.21.15.84:0/3073867701 shutdown_connections 2023-07-14T11:19:36.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.845+0000 7fc07adff700 1 --2- 172.21.15.84:0/3073867701 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc074160030 0x7fc0740b28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:36.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.845+0000 7fc07adff700 1 --2- 172.21.15.84:0/3073867701 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0740b5cd0 0x7fc0741f2b00 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:36.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.845+0000 7fc07adff700 1 --2- 172.21.15.84:0/3073867701 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fc05806ae00 0x7fc05806d2b0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:36.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.845+0000 7fc07adff700 1 --2- 172.21.15.84:0/3073867701 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0740d1160 0x7fc07414e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:36.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.845+0000 7fc07adff700 1 -- 172.21.15.84:0/3073867701 >> 172.21.15.84:0/3073867701 conn(0x7fc07409c190 msgr2=0x7fc0740b1660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:36.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.845+0000 7fc07adff700 1 -- 172.21.15.84:0/3073867701 shutdown_connections 2023-07-14T11:19:36.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:36.845+0000 7fc07adff700 1 -- 172.21.15.84:0/3073867701 wait complete. 2023-07-14T11:19:36.865 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-14T11:19:36.865 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-14T11:19:36.865 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi084.front.sepia.ceph.com 2023-07-14T11:19:36.866 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-14T11:19:36.866 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-14T11:19:36.866 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-14T11:19:36.866 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-14T11:19:36.867 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-14T11:19:36.867 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-14T11:19:36.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:19:36.868 DEBUG:teuthology.orchestra.run.smithi084:> ip addr 2023-07-14T11:19:36.914 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-14T11:19:36.915 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-14T11:19:36.915 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2023-07-14T11:19:36.915 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:19:36.915 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2023-07-14T11:19:36.915 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:19:36.915 INFO:teuthology.orchestra.run.smithi084.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T11:19:36.915 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:68 brd ff:ff:ff:ff:ff:ff 2023-07-14T11:19:36.916 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f0 2023-07-14T11:19:36.916 INFO:teuthology.orchestra.run.smithi084.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T11:19:36.916 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:69 brd ff:ff:ff:ff:ff:ff 2023-07-14T11:19:36.916 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f1 2023-07-14T11:19:36.916 INFO:teuthology.orchestra.run.smithi084.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T11:19:36.916 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:50 brd ff:ff:ff:ff:ff:ff 2023-07-14T11:19:36.916 INFO:teuthology.orchestra.run.smithi084.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-14T11:19:36.917 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:51 brd ff:ff:ff:ff:ff:ff 2023-07-14T11:19:36.917 INFO:teuthology.orchestra.run.smithi084.stdout: inet 172.21.15.84/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-14T11:19:36.917 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft 41591sec preferred_lft 41591sec 2023-07-14T11:19:36.917 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::ec4:7aff:fe8f:d751/64 scope link 2023-07-14T11:19:36.917 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:19:36.917 INFO:teuthology.orchestra.run.smithi084.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-14T11:19:36.917 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 2e:15:90:61:8f:22 brd ff:ff:ff:ff:ff:ff 2023-07-14T11:19:36.917 INFO:teuthology.orchestra.run.smithi084.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-14T11:19:36.918 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:19:36.918 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::dc90:1eff:feca:b2b4/64 scope link 2023-07-14T11:19:36.918 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:19:36.918 INFO:teuthology.orchestra.run.smithi084.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-14T11:19:36.918 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 2e:15:90:61:8f:22 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-14T11:19:36.918 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::2c15:90ff:fe61:8f22/64 scope link 2023-07-14T11:19:36.918 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:19:36.919 INFO:teuthology.orchestra.run.smithi084.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-14T11:19:36.919 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 5e:77:8b:e6:63:60 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-14T11:19:36.919 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::5c77:8bff:fee6:6360/64 scope link 2023-07-14T11:19:36.919 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:19:36.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:19:36.920 DEBUG:teuthology.orchestra.run.smithi084:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-14T11:19:36.987 INFO:teuthology.orchestra.run.smithi084.stdout:1 2023-07-14T11:19:36.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:19:36.991 DEBUG:teuthology.orchestra.run.smithi084:> route 2023-07-14T11:19:37.039 INFO:teuthology.orchestra.run.smithi084.stdout:Kernel IP routing table 2023-07-14T11:19:37.039 INFO:teuthology.orchestra.run.smithi084.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-14T11:19:37.040 INFO:teuthology.orchestra.run.smithi084.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-14T11:19:37.040 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-14T11:19:37.040 INFO:teuthology.orchestra.run.smithi084.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-14T11:19:37.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:19:37.041 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-07-14T11:19:37.042 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-07-14T11:19:37.042 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-14T11:19:37.042 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-14T11:19:37.042 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-14T11:19:37.043 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-07-14T11:19:37.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:19:37.212 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2023-07-14T11:19:37.258 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-14T11:19:37.259 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-14T11:19:37.259 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-14T11:19:37.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:19:37.260 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set brx.0 up 2023-07-14T11:19:37.329 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T11:19:37.330 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-14T11:19:37.376 INFO:teuthology.orchestra.run.smithi084.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-14T11:19:37.376 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T11:19:37.376 DEBUG:teuthology.orchestra.run.smithi084:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-14T11:19:37.421 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-07-14T11:19:37.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:19:37.422 DEBUG:teuthology.orchestra.run.smithi084:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-14T11:19:37.565 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-14T11:19:37.565 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-14T11:19:37.593 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-14T11:19:37.594 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-14T11:19:37.594 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-07-14T11:19:37.594 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: trying mount with new device syntax: 0@3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f.cephfs=/ 2023-07-14T11:19:37.594 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.84:3300/172.21.15.179:3300/172.21.15.179:3301" will pass to kernel 2023-07-14T11:19:37.600 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-14T11:19:37.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:19:37.601 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-14T11:19:37.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:19:37.671 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-14T11:19:37.772 INFO:teuthology.orchestra.run.smithi084.stdout:client7246 2023-07-14T11:19:37.772 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-14T11:19:37.773 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:19:37.818 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-14T11:19:37.828 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T11:19:37.866 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T11:19:38.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:38.057+0000 7f8382dff700 1 Processor -- start 2023-07-14T11:19:38.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:38.057+0000 7f8382dff700 1 -- start start 2023-07-14T11:19:38.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:38.058+0000 7f8382dff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f837c1597c0 0x7f837c159c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:38.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:38.058+0000 7f8382dff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f837c0cea50 0x7f837c0ceeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:38.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:38.058+0000 7f8382dff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f837c0cdf90 con 0x7f837c1500d0 2023-07-14T11:19:38.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:38.058+0000 7f8382dff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f837c15a2f0 con 0x7f837c1597c0 2023-07-14T11:19:38.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:38.058+0000 7f8382dff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f837c15a5d0 con 0x7f837c0cea50 2023-07-14T11:19:38.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:38.058+0000 7f837bfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f837c1597c0 0x7f837c159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:38.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:38.058+0000 7f8380b9b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f837c1500d0 0x7f837c070350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55458/0 (socket says 172.21.15.84:55458) 2023-07-14T11:19:38.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:38.059+0000 7f8380b9b700 1 -- 172.21.15.84:0/2386715772 learned_addr learned my addr 172.21.15.84:0/2386715772 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:19:38.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:38.059+0000 7f837bfff700 1 -- 172.21.15.84:0/2386715772 >> v2:172.21.15.179:3300/0 conn(0x7f837c0cea50 msgr2=0x7f837c0ceeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:38.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:38.059+0000 7f837bfff700 1 --2- 172.21.15.84:0/2386715772 >> v2:172.21.15.179:3300/0 conn(0x7f837c0cea50 0x7f837c0ceeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:38.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:38.059+0000 7f837bfff700 1 -- 172.21.15.84:0/2386715772 >> v1:172.21.15.84:6789/0 conn(0x7f837c1500d0 legacy=0x7f837c070350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:38.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:38.059+0000 7f837bfff700 1 -- 172.21.15.84:0/2386715772 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f837c0ce250 con 0x7f837c1597c0 2023-07-14T11:19:38.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:38.059+0000 7f837b7fe700 1 -- 172.21.15.84:0/2386715772 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 573932094 0 0) 0x7f837c0cdf90 con 0x7f837c1500d0 2023-07-14T11:19:38.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:38.059+0000 7f837bfff700 1 --2- 172.21.15.84:0/2386715772 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f837c1597c0 0x7f837c159c60 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f837c0b3c40 tx=0x7f8368009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7872348f41ea63c6 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:38.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:38.059+0000 7f837b7fe700 1 -- 172.21.15.84:0/2386715772 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8368011830 con 0x7f837c1597c0 2023-07-14T11:19:38.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:38.059+0000 7f837b7fe700 1 -- 172.21.15.84:0/2386715772 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8368011990 con 0x7f837c1597c0 2023-07-14T11:19:38.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:38.059+0000 7f837b7fe700 1 -- 172.21.15.84:0/2386715772 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8368011d20 con 0x7f837c1597c0 2023-07-14T11:19:38.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:38.060+0000 7f8382dff700 1 -- 172.21.15.84:0/2386715772 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f837c1597c0 msgr2=0x7f837c159c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:38.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:38.060+0000 7f8382dff700 1 --2- 172.21.15.84:0/2386715772 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f837c1597c0 0x7f837c159c60 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f837c0b3c40 tx=0x7f8368009b20 comp rx=0 tx=0).stop 2023-07-14T11:19:38.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:38.060+0000 7f8382dff700 1 -- 172.21.15.84:0/2386715772 shutdown_connections 2023-07-14T11:19:38.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:38.060+0000 7f8382dff700 1 --2- 172.21.15.84:0/2386715772 >> v2:172.21.15.179:3300/0 conn(0x7f837c0cea50 0x7f837c0ceeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:38.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:38.060+0000 7f8382dff700 1 --2- 172.21.15.84:0/2386715772 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f837c1597c0 0x7f837c159c60 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:38.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:38.060+0000 7f8382dff700 1 -- 172.21.15.84:0/2386715772 >> 172.21.15.84:0/2386715772 conn(0x7f837c069f30 msgr2=0x7f837c06a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:38.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:38.060+0000 7f8382dff700 1 -- 172.21.15.84:0/2386715772 shutdown_connections 2023-07-14T11:19:38.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:38.060+0000 7f8382dff700 1 -- 172.21.15.84:0/2386715772 wait complete. 2023-07-14T11:19:38.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:38.062+0000 7f8382dff700 1 Processor -- start 2023-07-14T11:19:38.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:38.063+0000 7f8382dff700 1 -- start start 2023-07-14T11:19:38.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:38.064+0000 7f8382dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f837c0cea50 0x7f837c137260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:38.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:38.064+0000 7f8382dff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f837c1500d0 0x7f837c149ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:38.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:38.064+0000 7f8382dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f837c1597c0 0x7f837c14a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:38.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:38.064+0000 7f8382dff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f837c139650 con 0x7f837c1500d0 2023-07-14T11:19:38.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:38.064+0000 7f8382dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f837c138a40 con 0x7f837c1597c0 2023-07-14T11:19:38.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:38.064+0000 7f8382dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f837c138d20 con 0x7f837c0cea50 2023-07-14T11:19:38.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:38.064+0000 7f837bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f837c1500d0 0x7f837c149ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:38.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:38.064+0000 7f837bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f837c1500d0 0x7f837c149ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40936/0 (socket says 172.21.15.84:40936) 2023-07-14T11:19:38.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:38.064+0000 7f837bfff700 1 -- 172.21.15.84:0/886291725 learned_addr learned my addr 172.21.15.84:0/886291725 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:38.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:38.064+0000 7f837bfff700 1 -- 172.21.15.84:0/886291725 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f837c0cea50 msgr2=0x7f837c137260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:38.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:38.064+0000 7f837bfff700 1 --2- 172.21.15.84:0/886291725 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f837c0cea50 0x7f837c137260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:38.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:38.064+0000 7f837bfff700 1 -- 172.21.15.84:0/886291725 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f837c1597c0 msgr2=0x7f837c14a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:38.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:38.064+0000 7f837bfff700 1 --2- 172.21.15.84:0/886291725 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f837c1597c0 0x7f837c14a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:38.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:38.064+0000 7f837bfff700 1 -- 172.21.15.84:0/886291725 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83680094a0 con 0x7f837c1500d0 2023-07-14T11:19:38.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:38.065+0000 7f837bfff700 1 --2- 172.21.15.84:0/886291725 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f837c1500d0 0x7f837c149ff0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f8368014040 tx=0x7f8368004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:38.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:38.065+0000 7f83797fa700 1 -- 172.21.15.84:0/886291725 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83680038a0 con 0x7f837c1500d0 2023-07-14T11:19:38.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:38.065+0000 7f83797fa700 1 -- 172.21.15.84:0/886291725 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f836801e070 con 0x7f837c1500d0 2023-07-14T11:19:38.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:38.065+0000 7f83797fa700 1 -- 172.21.15.84:0/886291725 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8368003c60 con 0x7f837c1500d0 2023-07-14T11:19:38.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:38.065+0000 7f8382dff700 1 -- 172.21.15.84:0/886291725 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f837c139000 con 0x7f837c1500d0 2023-07-14T11:19:38.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:38.065+0000 7f8382dff700 1 -- 172.21.15.84:0/886291725 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f837c138690 con 0x7f837c1500d0 2023-07-14T11:19:38.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:38.066+0000 7f8382dff700 1 -- 172.21.15.84:0/886291725 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f837c04e280 con 0x7f837c1500d0 2023-07-14T11:19:38.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:38.067+0000 7f83797fa700 1 -- 172.21.15.84:0/886291725 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f836802d450 con 0x7f837c1500d0 2023-07-14T11:19:38.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:38.068+0000 7f83797fa700 1 --2- 172.21.15.84:0/886291725 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f836006ae00 0x7f836006d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:38.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:38.068+0000 7f83797fa700 1 -- 172.21.15.84:0/886291725 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f836808a800 con 0x7f837c1500d0 2023-07-14T11:19:38.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:38.069+0000 7f8380b9b700 1 --2- 172.21.15.84:0/886291725 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f836006ae00 0x7f836006d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:38.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:38.069+0000 7f8380b9b700 1 --2- 172.21.15.84:0/886291725 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f836006ae00 0x7f836006d2b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f83700011e0 tx=0x7f83700079b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:38.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:38.072+0000 7f83797fa700 1 -- 172.21.15.84:0/886291725 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f8368055790 con 0x7f837c1500d0 2023-07-14T11:19:38.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:38.309+0000 7f8382dff700 1 -- 172.21.15.84:0/886291725 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f837c0cb2a0 con 0x7f837c1500d0 2023-07-14T11:19:38.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:38.309+0000 7f83797fa700 1 -- 172.21.15.84:0/886291725 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v69) v1 ==== 53+0+73 (secure 0 0 0) 0x7f8368020060 con 0x7f837c1500d0 2023-07-14T11:19:38.312 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-14T11:19:38.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:38.312+0000 7f8382dff700 1 -- 172.21.15.84:0/886291725 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f836006ae00 msgr2=0x7f836006d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:38.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:38.312+0000 7f8382dff700 1 --2- 172.21.15.84:0/886291725 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f836006ae00 0x7f836006d2b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f83700011e0 tx=0x7f83700079b0 comp rx=0 tx=0).stop 2023-07-14T11:19:38.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:38.312+0000 7f8382dff700 1 -- 172.21.15.84:0/886291725 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f837c1500d0 msgr2=0x7f837c149ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:38.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:38.312+0000 7f8382dff700 1 --2- 172.21.15.84:0/886291725 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f837c1500d0 0x7f837c149ff0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f8368014040 tx=0x7f8368004750 comp rx=0 tx=0).stop 2023-07-14T11:19:38.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:38.312+0000 7f8382dff700 1 -- 172.21.15.84:0/886291725 shutdown_connections 2023-07-14T11:19:38.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:38.312+0000 7f8382dff700 1 --2- 172.21.15.84:0/886291725 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f836006ae00 0x7f836006d2b0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:38.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:38.312+0000 7f8382dff700 1 --2- 172.21.15.84:0/886291725 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f837c0cea50 0x7f837c137260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:38.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:38.312+0000 7f8382dff700 1 --2- 172.21.15.84:0/886291725 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f837c1597c0 0x7f837c14a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:38.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:38.312+0000 7f8382dff700 1 --2- 172.21.15.84:0/886291725 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f837c1500d0 0x7f837c149ff0 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:38.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:38.312+0000 7f8382dff700 1 -- 172.21.15.84:0/886291725 >> 172.21.15.84:0/886291725 conn(0x7f837c069f30 msgr2=0x7f837c0cd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:38.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:38.312+0000 7f8382dff700 1 -- 172.21.15.84:0/886291725 shutdown_connections 2023-07-14T11:19:38.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:38.312+0000 7f8382dff700 1 -- 172.21.15.84:0/886291725 wait complete. 2023-07-14T11:19:38.332 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-14T11:19:38.333 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-14T11:19:38.333 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi179.front.sepia.ceph.com 2023-07-14T11:19:38.333 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-07-14T11:19:38.334 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-14T11:19:38.334 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-14T11:19:38.334 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-14T11:19:38.334 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-14T11:19:38.335 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-14T11:19:38.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:19:38.336 DEBUG:teuthology.orchestra.run.smithi179:> ip addr 2023-07-14T11:19:38.384 INFO:teuthology.orchestra.run.smithi179.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-14T11:19:38.385 INFO:teuthology.orchestra.run.smithi179.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-14T11:19:38.385 INFO:teuthology.orchestra.run.smithi179.stdout: inet 127.0.0.1/8 scope host lo 2023-07-14T11:19:38.385 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:19:38.385 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 ::1/128 scope host 2023-07-14T11:19:38.385 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:19:38.385 INFO:teuthology.orchestra.run.smithi179.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T11:19:38.386 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:34 brd ff:ff:ff:ff:ff:ff 2023-07-14T11:19:38.386 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f0 2023-07-14T11:19:38.386 INFO:teuthology.orchestra.run.smithi179.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T11:19:38.386 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:35 brd ff:ff:ff:ff:ff:ff 2023-07-14T11:19:38.386 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f1 2023-07-14T11:19:38.386 INFO:teuthology.orchestra.run.smithi179.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T11:19:38.387 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5a brd ff:ff:ff:ff:ff:ff 2023-07-14T11:19:38.387 INFO:teuthology.orchestra.run.smithi179.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-14T11:19:38.387 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5b brd ff:ff:ff:ff:ff:ff 2023-07-14T11:19:38.387 INFO:teuthology.orchestra.run.smithi179.stdout: inet 172.21.15.179/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-14T11:19:38.387 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft 41477sec preferred_lft 41477sec 2023-07-14T11:19:38.387 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::ec4:7aff:fe88:725b/64 scope link 2023-07-14T11:19:38.387 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:19:38.388 INFO:teuthology.orchestra.run.smithi179.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-14T11:19:38.388 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 46:75:18:db:4e:84 brd ff:ff:ff:ff:ff:ff 2023-07-14T11:19:38.388 INFO:teuthology.orchestra.run.smithi179.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-14T11:19:38.388 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:19:38.388 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::fc06:a1ff:feba:ddf1/64 scope link 2023-07-14T11:19:38.388 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:19:38.388 INFO:teuthology.orchestra.run.smithi179.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-14T11:19:38.389 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 92:db:40:bf:aa:be brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-14T11:19:38.389 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::90db:40ff:febf:aabe/64 scope link 2023-07-14T11:19:38.389 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:19:38.389 INFO:teuthology.orchestra.run.smithi179.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-14T11:19:38.389 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 46:75:18:db:4e:84 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-07-14T11:19:38.389 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::4475:18ff:fedb:4e84/64 scope link 2023-07-14T11:19:38.390 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-07-14T11:19:38.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:19:38.391 DEBUG:teuthology.orchestra.run.smithi179:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-14T11:19:38.459 INFO:teuthology.orchestra.run.smithi179.stdout:1 2023-07-14T11:19:38.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:19:38.462 DEBUG:teuthology.orchestra.run.smithi179:> route 2023-07-14T11:19:38.511 INFO:teuthology.orchestra.run.smithi179.stdout:Kernel IP routing table 2023-07-14T11:19:38.511 INFO:teuthology.orchestra.run.smithi179.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-14T11:19:38.511 INFO:teuthology.orchestra.run.smithi179.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-14T11:19:38.512 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-14T11:19:38.512 INFO:teuthology.orchestra.run.smithi179.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-14T11:19:38.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:19:38.513 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2023-07-14T11:19:38.513 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2023-07-14T11:19:38.513 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-14T11:19:38.514 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-14T11:19:38.514 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-14T11:19:38.515 DEBUG:teuthology.orchestra.run.smithi179:> ') 2023-07-14T11:19:38.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:19:38.685 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2023-07-14T11:19:38.731 INFO:teuthology.orchestra.run.smithi179.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-07-14T11:19:38.732 INFO:teuthology.orchestra.run.smithi179.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-14T11:19:38.732 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-14T11:19:38.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:19:38.733 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link set brx.0 up 2023-07-14T11:19:38.802 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T11:19:38.803 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-07-14T11:19:38.850 INFO:teuthology.orchestra.run.smithi179.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-07-14T11:19:38.850 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T11:19:38.850 DEBUG:teuthology.orchestra.run.smithi179:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-07-14T11:19:38.895 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-07-14T11:19:38.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:19:38.896 DEBUG:teuthology.orchestra.run.smithi179:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-14T11:19:39.041 INFO:teuthology.orchestra.run.smithi179.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-14T11:19:39.041 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-14T11:19:39.068 INFO:teuthology.orchestra.run.smithi179.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-14T11:19:39.068 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-14T11:19:39.068 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.179:3300,172.21.15.179:3301" 2023-07-14T11:19:39.068 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: trying mount with new device syntax: 1@3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f.cephfs=/ 2023-07-14T11:19:39.068 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.84:3300/172.21.15.179:3300/172.21.15.179:3301" will pass to kernel 2023-07-14T11:19:39.073 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-14T11:19:39.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:19:39.074 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-07-14T11:19:39.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:19:39.144 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-14T11:19:39.230 INFO:teuthology.orchestra.run.smithi179.stdout:client7893 2023-07-14T11:19:39.231 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-07-14T11:19:39.231 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:19:39.277 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-07-14T11:19:39.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:39.476+0000 7f3e001ff700 1 Processor -- start 2023-07-14T11:19:39.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:39.476+0000 7f3e001ff700 1 -- start start 2023-07-14T11:19:39.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:39.478+0000 7f3e001ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3df80d1160 0x7f3df80cd4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:39.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:39.478+0000 7f3e001ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3df815cc60 con 0x7f3df815c890 2023-07-14T11:19:39.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:39.478+0000 7f3e001ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3df806a7f0 con 0x7f3df80b2440 2023-07-14T11:19:39.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:39.478+0000 7f3e001ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3df806b760 con 0x7f3df80d1160 2023-07-14T11:19:39.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:39.478+0000 7f3dfd79a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3df80d1160 0x7f3df80cd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:39.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:39.478+0000 7f3dfdf9b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f3df815c890 0x7f3df80d0a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53038/0 (socket says 172.21.15.84:53038) 2023-07-14T11:19:39.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:39.478+0000 7f3dfdf9b700 1 -- 172.21.15.84:0/3908028915 learned_addr learned my addr 172.21.15.84:0/3908028915 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:19:39.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:39.478+0000 7f3dfcf99700 1 -- 172.21.15.84:0/3908028915 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3919515726 0 0) 0x7f3df815cc60 con 0x7f3df815c890 2023-07-14T11:19:39.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:39.478+0000 7f3dfcf99700 1 -- 172.21.15.84:0/3908028915 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3de40035b0 con 0x7f3df815c890 2023-07-14T11:19:39.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:39.478+0000 7f3dfd79a700 1 -- 172.21.15.84:0/3908028915 >> v1:172.21.15.179:6789/0 conn(0x7f3df80b2440 legacy=0x7f3df80cda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:39.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:39.478+0000 7f3dfd79a700 1 -- 172.21.15.84:0/3908028915 >> v1:172.21.15.84:6789/0 conn(0x7f3df815c890 legacy=0x7f3df80d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:39.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:39.478+0000 7f3dfd79a700 1 -- 172.21.15.84:0/3908028915 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df806ba40 con 0x7f3df80d1160 2023-07-14T11:19:39.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:39.479+0000 7f3dfd79a700 1 --2- 172.21.15.84:0/3908028915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3df80d1160 0x7f3df80cd4d0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f3de8009840 tx=0x7f3de8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ae83d17fe674af7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:39.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:39.479+0000 7f3dfcf99700 1 -- 172.21.15.84:0/3908028915 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de8011830 con 0x7f3df80d1160 2023-07-14T11:19:39.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:39.479+0000 7f3dfcf99700 1 -- 172.21.15.84:0/3908028915 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de8011990 con 0x7f3df80d1160 2023-07-14T11:19:39.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:39.479+0000 7f3dfcf99700 1 -- 172.21.15.84:0/3908028915 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de8011d20 con 0x7f3df80d1160 2023-07-14T11:19:39.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:39.479+0000 7f3e001ff700 1 -- 172.21.15.84:0/3908028915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3df80d1160 msgr2=0x7f3df80cd4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:39.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:39.479+0000 7f3e001ff700 1 --2- 172.21.15.84:0/3908028915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3df80d1160 0x7f3df80cd4d0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f3de8009840 tx=0x7f3de8009b50 comp rx=0 tx=0).stop 2023-07-14T11:19:39.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:39.480+0000 7f3e001ff700 1 -- 172.21.15.84:0/3908028915 shutdown_connections 2023-07-14T11:19:39.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:39.480+0000 7f3e001ff700 1 --2- 172.21.15.84:0/3908028915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3df80d1160 0x7f3df80cd4d0 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:39.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:39.480+0000 7f3e001ff700 1 -- 172.21.15.84:0/3908028915 >> 172.21.15.84:0/3908028915 conn(0x7f3df809c170 msgr2=0x7f3df80d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:39.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:39.480+0000 7f3e001ff700 1 -- 172.21.15.84:0/3908028915 shutdown_connections 2023-07-14T11:19:39.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:39.480+0000 7f3e001ff700 1 -- 172.21.15.84:0/3908028915 wait complete. 2023-07-14T11:19:39.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:39.481+0000 7f3e001ff700 1 Processor -- start 2023-07-14T11:19:39.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:39.482+0000 7f3e001ff700 1 -- start start 2023-07-14T11:19:39.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:39.482+0000 7f3e001ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3df80b2440 0x7f3df80c6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:39.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:39.482+0000 7f3e001ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3df80d1160 0x7f3df80cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:39.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:39.482+0000 7f3e001ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3df815c890 0x7f3df80c57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:39.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:39.482+0000 7f3e001ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df80c6ed0 con 0x7f3df80d1160 2023-07-14T11:19:39.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:39.482+0000 7f3e001ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df81f5900 con 0x7f3df815c890 2023-07-14T11:19:39.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:39.482+0000 7f3e001ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3df81f5be0 con 0x7f3df80b2440 2023-07-14T11:19:39.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:39.483+0000 7f3dfd79a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3df80d1160 0x7f3df80cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:39.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:39.483+0000 7f3dfd79a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3df80d1160 0x7f3df80cf8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36266/0 (socket says 172.21.15.84:36266) 2023-07-14T11:19:39.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:39.483+0000 7f3dfd79a700 1 -- 172.21.15.84:0/2678237012 learned_addr learned my addr 172.21.15.84:0/2678237012 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:39.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:39.483+0000 7f3dfe79c700 1 --2- 172.21.15.84:0/2678237012 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3df815c890 0x7f3df80c57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:39.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:39.483+0000 7f3dfdf9b700 1 --2- 172.21.15.84:0/2678237012 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3df80b2440 0x7f3df80c6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:39.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:39.483+0000 7f3dfd79a700 1 -- 172.21.15.84:0/2678237012 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3df80b2440 msgr2=0x7f3df80c6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:39.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:39.483+0000 7f3dfd79a700 1 --2- 172.21.15.84:0/2678237012 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3df80b2440 0x7f3df80c6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:39.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:39.483+0000 7f3dfd79a700 1 -- 172.21.15.84:0/2678237012 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3df815c890 msgr2=0x7f3df80c57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:39.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:39.483+0000 7f3dfd79a700 1 --2- 172.21.15.84:0/2678237012 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3df815c890 0x7f3df80c57b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:39.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:39.483+0000 7f3dfd79a700 1 -- 172.21.15.84:0/2678237012 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de80094a0 con 0x7f3df80d1160 2023-07-14T11:19:39.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:39.483+0000 7f3dfd79a700 1 --2- 172.21.15.84:0/2678237012 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3df80d1160 0x7f3df80cf8a0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f3de8009fd0 tx=0x7f3de8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:39.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:39.484+0000 7f3dee7fc700 1 -- 172.21.15.84:0/2678237012 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de80036a0 con 0x7f3df80d1160 2023-07-14T11:19:39.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:39.484+0000 7f3dee7fc700 1 -- 172.21.15.84:0/2678237012 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de801f070 con 0x7f3df80d1160 2023-07-14T11:19:39.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:39.484+0000 7f3e001ff700 1 -- 172.21.15.84:0/2678237012 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3df81f5ec0 con 0x7f3df80d1160 2023-07-14T11:19:39.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:39.484+0000 7f3dee7fc700 1 -- 172.21.15.84:0/2678237012 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de8003a60 con 0x7f3df80d1160 2023-07-14T11:19:39.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:39.484+0000 7f3e001ff700 1 -- 172.21.15.84:0/2678237012 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3df80b2e30 con 0x7f3df80d1160 2023-07-14T11:19:39.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:39.485+0000 7f3e001ff700 1 -- 172.21.15.84:0/2678237012 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3df8074350 con 0x7f3df80d1160 2023-07-14T11:19:39.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:39.486+0000 7f3dee7fc700 1 -- 172.21.15.84:0/2678237012 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f3de8003bc0 con 0x7f3df80d1160 2023-07-14T11:19:39.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:39.487+0000 7f3dee7fc700 1 --2- 172.21.15.84:0/2678237012 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f3ddc06ae00 0x7f3ddc06d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:39.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:39.487+0000 7f3dee7fc700 1 -- 172.21.15.84:0/2678237012 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3de8021070 con 0x7f3df80d1160 2023-07-14T11:19:39.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:39.487+0000 7f3dfdf9b700 1 --2- 172.21.15.84:0/2678237012 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f3ddc06ae00 0x7f3ddc06d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:39.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:39.488+0000 7f3dfdf9b700 1 --2- 172.21.15.84:0/2678237012 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f3ddc06ae00 0x7f3ddc06d2b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3df4007fd0 tx=0x7f3df4007dc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:39.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:39.491+0000 7f3dee7fc700 1 -- 172.21.15.84:0/2678237012 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3de8055dd0 con 0x7f3df80d1160 2023-07-14T11:19:39.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:39.728+0000 7f3e001ff700 1 -- 172.21.15.84:0/2678237012 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f3df80d2290 con 0x7f3df80d1160 2023-07-14T11:19:39.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:39.852+0000 7f3dee7fc700 1 -- 172.21.15.84:0/2678237012 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v70) v1 ==== 136+0+0 (secure 0 0 0) 0x7f3de80593f0 con 0x7f3df80d1160 2023-07-14T11:19:39.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:39.854+0000 7f3e001ff700 1 -- 172.21.15.84:0/2678237012 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f3ddc06ae00 msgr2=0x7f3ddc06d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:39.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:39.854+0000 7f3e001ff700 1 --2- 172.21.15.84:0/2678237012 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f3ddc06ae00 0x7f3ddc06d2b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3df4007fd0 tx=0x7f3df4007dc0 comp rx=0 tx=0).stop 2023-07-14T11:19:39.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:39.854+0000 7f3e001ff700 1 -- 172.21.15.84:0/2678237012 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3df80d1160 msgr2=0x7f3df80cf8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:39.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:39.854+0000 7f3e001ff700 1 --2- 172.21.15.84:0/2678237012 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3df80d1160 0x7f3df80cf8a0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f3de8009fd0 tx=0x7f3de8004750 comp rx=0 tx=0).stop 2023-07-14T11:19:39.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:39.855+0000 7f3e001ff700 1 -- 172.21.15.84:0/2678237012 shutdown_connections 2023-07-14T11:19:39.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:39.855+0000 7f3e001ff700 1 --2- 172.21.15.84:0/2678237012 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f3ddc06ae00 0x7f3ddc06d2b0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:39.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:39.855+0000 7f3e001ff700 1 --2- 172.21.15.84:0/2678237012 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3df80b2440 0x7f3df80c6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:39.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:39.855+0000 7f3e001ff700 1 --2- 172.21.15.84:0/2678237012 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3df815c890 0x7f3df80c57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:39.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:39.855+0000 7f3e001ff700 1 --2- 172.21.15.84:0/2678237012 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3df80d1160 0x7f3df80cf8a0 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:39.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:39.855+0000 7f3e001ff700 1 -- 172.21.15.84:0/2678237012 >> 172.21.15.84:0/2678237012 conn(0x7f3df809c170 msgr2=0x7f3df80d0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:39.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:39.855+0000 7f3e001ff700 1 -- 172.21.15.84:0/2678237012 shutdown_connections 2023-07-14T11:19:39.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:39.855+0000 7f3e001ff700 1 -- 172.21.15.84:0/2678237012 wait complete. 2023-07-14T11:19:39.875 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-07-14T11:19:40.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.070+0000 7f4d3fbff700 1 Processor -- start 2023-07-14T11:19:40.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.070+0000 7f4d3fbff700 1 -- start start 2023-07-14T11:19:40.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.071+0000 7f4d3fbff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4d380c92d0 0x7f4d380ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:40.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.072+0000 7f4d3fbff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d3815ce70 con 0x7f4d380adea0 2023-07-14T11:19:40.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.072+0000 7f4d3fbff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d3815d0c0 con 0x7f4d380b12f0 2023-07-14T11:19:40.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.072+0000 7f4d3fbff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d3815da60 con 0x7f4d380c92d0 2023-07-14T11:19:40.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.072+0000 7f4d3e19c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f4d380adea0 0x7f4d380cc690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53040/0 (socket says 172.21.15.84:53040) 2023-07-14T11:19:40.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.072+0000 7f4d3d99b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4d380c92d0 0x7f4d380ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:40.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.072+0000 7f4d3e19c700 1 -- 172.21.15.84:0/1943963100 learned_addr learned my addr 172.21.15.84:0/1943963100 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:19:40.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.072+0000 7f4d3c999700 1 -- 172.21.15.84:0/1943963100 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3398671840 0 0) 0x7f4d3815ce70 con 0x7f4d380adea0 2023-07-14T11:19:40.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.072+0000 7f4d3c999700 1 -- 172.21.15.84:0/1943963100 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d240035b0 con 0x7f4d380adea0 2023-07-14T11:19:40.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.072+0000 7f4d3c999700 1 -- 172.21.15.84:0/1943963100 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 930746973 0 0) 0x7f4d3815d0c0 con 0x7f4d380b12f0 2023-07-14T11:19:40.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.072+0000 7f4d3c999700 1 -- 172.21.15.84:0/1943963100 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d3815ce70 con 0x7f4d380b12f0 2023-07-14T11:19:40.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.072+0000 7f4d3d99b700 1 -- 172.21.15.84:0/1943963100 >> v1:172.21.15.179:6789/0 conn(0x7f4d380b12f0 legacy=0x7f4d380c96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:40.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.072+0000 7f4d3d99b700 1 -- 172.21.15.84:0/1943963100 >> v1:172.21.15.84:6789/0 conn(0x7f4d380adea0 legacy=0x7f4d380cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:40.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.072+0000 7f4d3d99b700 1 -- 172.21.15.84:0/1943963100 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d3815d3a0 con 0x7f4d380c92d0 2023-07-14T11:19:40.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.073+0000 7f4d3d99b700 1 --2- 172.21.15.84:0/1943963100 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d380c92d0 0x7f4d380ad8f0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f4d34009840 tx=0x7f4d34009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47547d84daa92a9 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:40.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.073+0000 7f4d3c999700 1 -- 172.21.15.84:0/1943963100 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d34011830 con 0x7f4d380c92d0 2023-07-14T11:19:40.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.073+0000 7f4d3c999700 1 -- 172.21.15.84:0/1943963100 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d34011990 con 0x7f4d380c92d0 2023-07-14T11:19:40.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.073+0000 7f4d3c999700 1 -- 172.21.15.84:0/1943963100 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d34011d20 con 0x7f4d380c92d0 2023-07-14T11:19:40.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.073+0000 7f4d3fbff700 1 -- 172.21.15.84:0/1943963100 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d380c92d0 msgr2=0x7f4d380ad8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:40.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.073+0000 7f4d3fbff700 1 --2- 172.21.15.84:0/1943963100 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d380c92d0 0x7f4d380ad8f0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f4d34009840 tx=0x7f4d34009b50 comp rx=0 tx=0).stop 2023-07-14T11:19:40.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.074+0000 7f4d3fbff700 1 -- 172.21.15.84:0/1943963100 shutdown_connections 2023-07-14T11:19:40.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.074+0000 7f4d3fbff700 1 --2- 172.21.15.84:0/1943963100 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d380c92d0 0x7f4d380ad8f0 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:40.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.074+0000 7f4d3fbff700 1 -- 172.21.15.84:0/1943963100 >> 172.21.15.84:0/1943963100 conn(0x7f4d380b05d0 msgr2=0x7f4d380b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:40.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.074+0000 7f4d3fbff700 1 -- 172.21.15.84:0/1943963100 shutdown_connections 2023-07-14T11:19:40.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.074+0000 7f4d3fbff700 1 -- 172.21.15.84:0/1943963100 wait complete. 2023-07-14T11:19:40.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.075+0000 7f4d3fbff700 1 Processor -- start 2023-07-14T11:19:40.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.075+0000 7f4d3fbff700 1 -- start start 2023-07-14T11:19:40.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.076+0000 7f4d3fbff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d380adea0 0x7f4d381efc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:40.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.076+0000 7f4d3fbff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d380b12f0 0x7f4d381f4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:40.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.076+0000 7f4d3fbff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d380c92d0 0x7f4d3806b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:40.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.076+0000 7f4d3fbff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d380c5330 con 0x7f4d380b12f0 2023-07-14T11:19:40.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.076+0000 7f4d3fbff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d381f46d0 con 0x7f4d380c92d0 2023-07-14T11:19:40.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.076+0000 7f4d3fbff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d38146ce0 con 0x7f4d380adea0 2023-07-14T11:19:40.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.077+0000 7f4d3d19a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d380b12f0 0x7f4d381f4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:40.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.077+0000 7f4d3d19a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d380b12f0 0x7f4d381f4190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36274/0 (socket says 172.21.15.84:36274) 2023-07-14T11:19:40.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.077+0000 7f4d3d19a700 1 -- 172.21.15.84:0/379408327 learned_addr learned my addr 172.21.15.84:0/379408327 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:40.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.077+0000 7f4d3d99b700 1 --2- 172.21.15.84:0/379408327 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d380adea0 0x7f4d381efc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:40.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.077+0000 7f4d3e19c700 1 --2- 172.21.15.84:0/379408327 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d380c92d0 0x7f4d3806b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:40.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.077+0000 7f4d3d19a700 1 -- 172.21.15.84:0/379408327 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d380adea0 msgr2=0x7f4d381efc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:40.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.077+0000 7f4d3d19a700 1 --2- 172.21.15.84:0/379408327 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d380adea0 0x7f4d381efc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:40.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.077+0000 7f4d3d19a700 1 -- 172.21.15.84:0/379408327 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d380c92d0 msgr2=0x7f4d3806b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:40.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.077+0000 7f4d3d19a700 1 --2- 172.21.15.84:0/379408327 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d380c92d0 0x7f4d3806b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:40.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.077+0000 7f4d3d19a700 1 -- 172.21.15.84:0/379408327 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d340094a0 con 0x7f4d380b12f0 2023-07-14T11:19:40.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.077+0000 7f4d3d19a700 1 --2- 172.21.15.84:0/379408327 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d380b12f0 0x7f4d381f4190 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f4d2800c550 tx=0x7f4d2800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:40.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.077+0000 7f4d2e7fc700 1 -- 172.21.15.84:0/379408327 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d280052d0 con 0x7f4d380b12f0 2023-07-14T11:19:40.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.077+0000 7f4d2e7fc700 1 -- 172.21.15.84:0/379408327 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d28005430 con 0x7f4d380b12f0 2023-07-14T11:19:40.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.077+0000 7f4d2e7fc700 1 -- 172.21.15.84:0/379408327 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d280038c0 con 0x7f4d380b12f0 2023-07-14T11:19:40.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.077+0000 7f4d3fbff700 1 -- 172.21.15.84:0/379408327 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d38146160 con 0x7f4d380b12f0 2023-07-14T11:19:40.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.078+0000 7f4d3fbff700 1 -- 172.21.15.84:0/379408327 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d38146720 con 0x7f4d380b12f0 2023-07-14T11:19:40.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.079+0000 7f4d3fbff700 1 -- 172.21.15.84:0/379408327 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d38074350 con 0x7f4d380b12f0 2023-07-14T11:19:40.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.080+0000 7f4d2e7fc700 1 -- 172.21.15.84:0/379408327 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f4d28003a20 con 0x7f4d380b12f0 2023-07-14T11:19:40.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.081+0000 7f4d2e7fc700 1 --2- 172.21.15.84:0/379408327 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f4d1c06ae00 0x7f4d1c06d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:40.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.081+0000 7f4d2e7fc700 1 -- 172.21.15.84:0/379408327 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4d28088ad0 con 0x7f4d380b12f0 2023-07-14T11:19:40.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.081+0000 7f4d3d99b700 1 --2- 172.21.15.84:0/379408327 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f4d1c06ae00 0x7f4d1c06d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:40.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.082+0000 7f4d3d99b700 1 --2- 172.21.15.84:0/379408327 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f4d1c06ae00 0x7f4d1c06d2b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4d34009fd0 tx=0x7f4d3401c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:40.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.085+0000 7f4d2e7fc700 1 -- 172.21.15.84:0/379408327 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f4d280539d0 con 0x7f4d380b12f0 2023-07-14T11:19:40.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.307+0000 7f4d3fbff700 1 -- 172.21.15.84:0/379408327 --> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f4d3815d680 con 0x7f4d1c06ae00 2023-07-14T11:19:40.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.308+0000 7f4d2e7fc700 1 -- 172.21.15.84:0/379408327 <== mgr.4100 v2:172.21.15.179:6836/2094253834 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f4d34011b00 con 0x7f4d1c06ae00 2023-07-14T11:19:40.311 INFO:teuthology.orchestra.run.smithi084.stdout:[ 2023-07-14T11:19:40.311 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:19:40.311 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "cephfs" 2023-07-14T11:19:40.311 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:19:40.312 INFO:teuthology.orchestra.run.smithi084.stdout:] 2023-07-14T11:19:40.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.311+0000 7f4d3fbff700 1 -- 172.21.15.84:0/379408327 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f4d1c06ae00 msgr2=0x7f4d1c06d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:40.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.311+0000 7f4d3fbff700 1 --2- 172.21.15.84:0/379408327 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f4d1c06ae00 0x7f4d1c06d2b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4d34009fd0 tx=0x7f4d3401c040 comp rx=0 tx=0).stop 2023-07-14T11:19:40.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.311+0000 7f4d3fbff700 1 -- 172.21.15.84:0/379408327 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d380b12f0 msgr2=0x7f4d381f4190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:40.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.311+0000 7f4d3fbff700 1 --2- 172.21.15.84:0/379408327 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d380b12f0 0x7f4d381f4190 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f4d2800c550 tx=0x7f4d2800c860 comp rx=0 tx=0).stop 2023-07-14T11:19:40.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.311+0000 7f4d3fbff700 1 -- 172.21.15.84:0/379408327 shutdown_connections 2023-07-14T11:19:40.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.311+0000 7f4d3fbff700 1 --2- 172.21.15.84:0/379408327 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f4d1c06ae00 0x7f4d1c06d2b0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:40.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.311+0000 7f4d3fbff700 1 --2- 172.21.15.84:0/379408327 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d380adea0 0x7f4d381efc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:40.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.311+0000 7f4d3fbff700 1 --2- 172.21.15.84:0/379408327 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d380c92d0 0x7f4d3806b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:40.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.311+0000 7f4d3fbff700 1 --2- 172.21.15.84:0/379408327 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d380b12f0 0x7f4d381f4190 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:40.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.311+0000 7f4d3fbff700 1 -- 172.21.15.84:0/379408327 >> 172.21.15.84:0/379408327 conn(0x7f4d380b05d0 msgr2=0x7f4d380710f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:40.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.311+0000 7f4d3fbff700 1 -- 172.21.15.84:0/379408327 shutdown_connections 2023-07-14T11:19:40.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.311+0000 7f4d3fbff700 1 -- 172.21.15.84:0/379408327 wait complete. 2023-07-14T11:19:40.331 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-14T11:19:40.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.527+0000 7fe7b99ff700 1 Processor -- start 2023-07-14T11:19:40.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.528+0000 7fe7b99ff700 1 -- start start 2023-07-14T11:19:40.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.529+0000 7fe7b99ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe7b40c92d0 0x7fe7b40ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:40.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.529+0000 7fe7b99ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe7b40b12f0 0x7fe7b40c96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:40.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.529+0000 7fe7b99ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7b415ce70 con 0x7fe7b40adea0 2023-07-14T11:19:40.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.529+0000 7fe7b99ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7b415da60 con 0x7fe7b40b12f0 2023-07-14T11:19:40.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.529+0000 7fe7b99ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7b40c9be0 con 0x7fe7b40c92d0 2023-07-14T11:19:40.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.529+0000 7fe7abfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe7b40b12f0 0x7fe7b40c96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:40.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.529+0000 7fe7abfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe7b40b12f0 0x7fe7b40c96a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36276/0 (socket says 172.21.15.84:36276) 2023-07-14T11:19:40.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.529+0000 7fe7abfff700 1 -- 172.21.15.84:0/2508212882 learned_addr learned my addr 172.21.15.84:0/2508212882 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:40.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.529+0000 7fe7b2ffd700 1 --2- 172.21.15.84:0/2508212882 >> v2:172.21.15.179:3300/0 conn(0x7fe7b40c92d0 0x7fe7b40ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:40.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.529+0000 7fe7abfff700 1 -- 172.21.15.84:0/2508212882 >> v2:172.21.15.179:3300/0 conn(0x7fe7b40c92d0 msgr2=0x7fe7b40ad8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:40.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.529+0000 7fe7abfff700 1 --2- 172.21.15.84:0/2508212882 >> v2:172.21.15.179:3300/0 conn(0x7fe7b40c92d0 0x7fe7b40ad8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:40.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.529+0000 7fe7abfff700 1 -- 172.21.15.84:0/2508212882 >> v1:172.21.15.179:6789/0 conn(0x7fe7b40adea0 legacy=0x7fe7b406c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:40.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.529+0000 7fe7abfff700 1 -- 172.21.15.84:0/2508212882 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7b415d0c0 con 0x7fe7b40b12f0 2023-07-14T11:19:40.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.529+0000 7fe7b2ffd700 1 --2- 172.21.15.84:0/2508212882 >> v2:172.21.15.179:3300/0 conn(0x7fe7b40c92d0 0x7fe7b40ad8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:19:40.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.530+0000 7fe7abfff700 1 --2- 172.21.15.84:0/2508212882 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7b40b12f0 0x7fe7b40c96a0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7fe7b406f630 tx=0x7fe79c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c0424c5b8065ed0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:40.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.530+0000 7fe7b27fc700 1 -- 172.21.15.84:0/2508212882 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79c00b870 con 0x7fe7b40b12f0 2023-07-14T11:19:40.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.530+0000 7fe7b27fc700 1 -- 172.21.15.84:0/2508212882 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe79c00b9d0 con 0x7fe7b40b12f0 2023-07-14T11:19:40.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.530+0000 7fe7b27fc700 1 -- 172.21.15.84:0/2508212882 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79c00bd60 con 0x7fe7b40b12f0 2023-07-14T11:19:40.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.530+0000 7fe7b99ff700 1 -- 172.21.15.84:0/2508212882 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7b40b12f0 msgr2=0x7fe7b40c96a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:40.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.530+0000 7fe7b99ff700 1 --2- 172.21.15.84:0/2508212882 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7b40b12f0 0x7fe7b40c96a0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7fe7b406f630 tx=0x7fe79c009bd0 comp rx=0 tx=0).stop 2023-07-14T11:19:40.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.531+0000 7fe7b99ff700 1 -- 172.21.15.84:0/2508212882 shutdown_connections 2023-07-14T11:19:40.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.531+0000 7fe7b99ff700 1 --2- 172.21.15.84:0/2508212882 >> v2:172.21.15.179:3300/0 conn(0x7fe7b40c92d0 0x7fe7b40ad8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:40.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.531+0000 7fe7b99ff700 1 --2- 172.21.15.84:0/2508212882 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7b40b12f0 0x7fe7b40c96a0 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:40.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.531+0000 7fe7b99ff700 1 -- 172.21.15.84:0/2508212882 >> 172.21.15.84:0/2508212882 conn(0x7fe7b40b05d0 msgr2=0x7fe7b40b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:40.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.531+0000 7fe7b99ff700 1 -- 172.21.15.84:0/2508212882 shutdown_connections 2023-07-14T11:19:40.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.531+0000 7fe7b99ff700 1 -- 172.21.15.84:0/2508212882 wait complete. 2023-07-14T11:19:40.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.532+0000 7fe7b99ff700 1 Processor -- start 2023-07-14T11:19:40.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.532+0000 7fe7b99ff700 1 -- start start 2023-07-14T11:19:40.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.533+0000 7fe7b99ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7b40adea0 0x7fe7b40c6a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:40.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.533+0000 7fe7b99ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7b40b12f0 0x7fe7b40b2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:40.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.533+0000 7fe7b99ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7b40c92d0 0x7fe7b414cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:40.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.533+0000 7fe7b99ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b40c7c80 con 0x7fe7b40adea0 2023-07-14T11:19:40.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.533+0000 7fe7b99ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b40c7070 con 0x7fe7b40b12f0 2023-07-14T11:19:40.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.533+0000 7fe7b99ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b40c7350 con 0x7fe7b40c92d0 2023-07-14T11:19:40.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.534+0000 7fe7b2ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7b40adea0 0x7fe7b40c6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:40.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.534+0000 7fe7b2ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7b40adea0 0x7fe7b40c6a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36280/0 (socket says 172.21.15.84:36280) 2023-07-14T11:19:40.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.534+0000 7fe7b2ffd700 1 -- 172.21.15.84:0/1080749124 learned_addr learned my addr 172.21.15.84:0/1080749124 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:40.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.534+0000 7fe7abfff700 1 --2- 172.21.15.84:0/1080749124 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7b40b12f0 0x7fe7b40b2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:40.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.534+0000 7fe7b37fe700 1 --2- 172.21.15.84:0/1080749124 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7b40c92d0 0x7fe7b414cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:40.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.534+0000 7fe7b2ffd700 1 -- 172.21.15.84:0/1080749124 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7b40c92d0 msgr2=0x7fe7b414cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:40.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.534+0000 7fe7b2ffd700 1 --2- 172.21.15.84:0/1080749124 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7b40c92d0 0x7fe7b414cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:40.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.534+0000 7fe7b2ffd700 1 -- 172.21.15.84:0/1080749124 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7b40b12f0 msgr2=0x7fe7b40b2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:40.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.534+0000 7fe7b2ffd700 1 --2- 172.21.15.84:0/1080749124 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7b40b12f0 0x7fe7b40b2c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:40.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.534+0000 7fe7b2ffd700 1 -- 172.21.15.84:0/1080749124 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe79c009550 con 0x7fe7b40adea0 2023-07-14T11:19:40.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.534+0000 7fe7b2ffd700 1 --2- 172.21.15.84:0/1080749124 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7b40adea0 0x7fe7b40c6a80 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7fe7a400e810 tx=0x7fe7a400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:40.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.534+0000 7fe7b0ff9700 1 -- 172.21.15.84:0/1080749124 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a400c020 con 0x7fe7b40adea0 2023-07-14T11:19:40.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.535+0000 7fe7b0ff9700 1 -- 172.21.15.84:0/1080749124 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7a4004250 con 0x7fe7b40adea0 2023-07-14T11:19:40.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.535+0000 7fe7b0ff9700 1 -- 172.21.15.84:0/1080749124 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a40036a0 con 0x7fe7b40adea0 2023-07-14T11:19:40.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.535+0000 7fe7b99ff700 1 -- 172.21.15.84:0/1080749124 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7b40c7630 con 0x7fe7b40adea0 2023-07-14T11:19:40.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.535+0000 7fe7b99ff700 1 -- 172.21.15.84:0/1080749124 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7b40c8930 con 0x7fe7b40adea0 2023-07-14T11:19:40.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.536+0000 7fe7b99ff700 1 -- 172.21.15.84:0/1080749124 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7b4074350 con 0x7fe7b40adea0 2023-07-14T11:19:40.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.537+0000 7fe7b0ff9700 1 -- 172.21.15.84:0/1080749124 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7fe7a4003800 con 0x7fe7b40adea0 2023-07-14T11:19:40.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.537+0000 7fe7b0ff9700 1 --2- 172.21.15.84:0/1080749124 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fe79406ae00 0x7fe79406d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:40.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.538+0000 7fe7b0ff9700 1 -- 172.21.15.84:0/1080749124 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe7a4089150 con 0x7fe7b40adea0 2023-07-14T11:19:40.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.538+0000 7fe7abfff700 1 --2- 172.21.15.84:0/1080749124 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fe79406ae00 0x7fe79406d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:40.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.539+0000 7fe7abfff700 1 --2- 172.21.15.84:0/1080749124 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fe79406ae00 0x7fe79406d2b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe79c000c00 tx=0x7fe79c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:40.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.541+0000 7fe7b0ff9700 1 -- 172.21.15.84:0/1080749124 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe7a4053fd0 con 0x7fe7b40adea0 2023-07-14T11:19:40.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.736+0000 7fe7b99ff700 1 -- 172.21.15.84:0/1080749124 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fe7b40b4a40 con 0x7fe7b40adea0 2023-07-14T11:19:40.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.736+0000 7fe7b0ff9700 1 -- 172.21.15.84:0/1080749124 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe7a40575f0 con 0x7fe7b40adea0 2023-07-14T11:19:40.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.738+0000 7fe7b99ff700 1 -- 172.21.15.84:0/1080749124 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fe79406ae00 msgr2=0x7fe79406d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:40.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.738+0000 7fe7b99ff700 1 --2- 172.21.15.84:0/1080749124 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fe79406ae00 0x7fe79406d2b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe79c000c00 tx=0x7fe79c008030 comp rx=0 tx=0).stop 2023-07-14T11:19:40.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.738+0000 7fe7b99ff700 1 -- 172.21.15.84:0/1080749124 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7b40adea0 msgr2=0x7fe7b40c6a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:40.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.738+0000 7fe7b99ff700 1 --2- 172.21.15.84:0/1080749124 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7b40adea0 0x7fe7b40c6a80 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7fe7a400e810 tx=0x7fe7a400eb20 comp rx=0 tx=0).stop 2023-07-14T11:19:40.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.739+0000 7fe7b99ff700 1 -- 172.21.15.84:0/1080749124 shutdown_connections 2023-07-14T11:19:40.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.739+0000 7fe7b99ff700 1 --2- 172.21.15.84:0/1080749124 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fe79406ae00 0x7fe79406d2b0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:40.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.739+0000 7fe7b99ff700 1 --2- 172.21.15.84:0/1080749124 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7b40c92d0 0x7fe7b414cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:40.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.739+0000 7fe7b99ff700 1 --2- 172.21.15.84:0/1080749124 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7b40adea0 0x7fe7b40c6a80 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:40.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.739+0000 7fe7b99ff700 1 --2- 172.21.15.84:0/1080749124 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7b40b12f0 0x7fe7b40b2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:40.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.739+0000 7fe7b99ff700 1 -- 172.21.15.84:0/1080749124 >> 172.21.15.84:0/1080749124 conn(0x7fe7b40b05d0 msgr2=0x7fe7b40c9d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:40.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.739+0000 7fe7b99ff700 1 -- 172.21.15.84:0/1080749124 shutdown_connections 2023-07-14T11:19:40.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:40.739+0000 7fe7b99ff700 1 -- 172.21.15.84:0/1080749124 wait complete. 2023-07-14T11:19:40.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:19:40.760 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p volumes/_nogroup/subvolume_0000000000536115/a771854e-a90b-4690-8065-77cb49819054) 2023-07-14T11:19:40.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:19:40.838 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p volumes/_nogroup/subvolume_0000000000536115/a771854e-a90b-4690-8065-77cb49819054/.snap/fake) 2023-07-14T11:19:40.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:19:40.919 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool .) 2023-07-14T11:19:40.965 INFO:teuthology.orchestra.run.smithi084.stdout:cephfs_data 2023-07-14T11:19:40.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:19:40.966 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo setfattr -n ceph.dir.layout.pool -v cephfs_data volumes/_nogroup/subvolume_0000000000536115/a771854e-a90b-4690-8065-77cb49819054) 2023-07-14T11:19:41.042 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-14T11:19:41.042 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/subvolume_0000000000536115/.meta 2023-07-14T11:19:41.115 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvolume_0000000000536115 2023-07-14T11:19:41.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.352+0000 7feb8d9ff700 1 Processor -- start 2023-07-14T11:19:41.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.352+0000 7feb8d9ff700 1 -- start start 2023-07-14T11:19:41.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.353+0000 7feb8d9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb880b12f0 0x7feb880ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:41.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.354+0000 7feb8d9ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb8815ce70 con 0x7feb880c92d0 2023-07-14T11:19:41.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.354+0000 7feb8d9ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb8815d0c0 con 0x7feb880adea0 2023-07-14T11:19:41.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.354+0000 7feb8d9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb8815da60 con 0x7feb880b12f0 2023-07-14T11:19:41.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.354+0000 7feb86ffd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7feb880c92d0 0x7feb880c96a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53042/0 (socket says 172.21.15.84:53042) 2023-07-14T11:19:41.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.354+0000 7feb86ffd700 1 -- 172.21.15.84:0/3515135976 learned_addr learned my addr 172.21.15.84:0/3515135976 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:19:41.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.354+0000 7feb867fc700 1 -- 172.21.15.84:0/3515135976 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2651991796 0 0) 0x7feb8815ce70 con 0x7feb880c92d0 2023-07-14T11:19:41.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.354+0000 7feb867fc700 1 -- 172.21.15.84:0/3515135976 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb740035b0 con 0x7feb880c92d0 2023-07-14T11:19:41.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.354+0000 7feb7ffff700 1 --2- 172.21.15.84:0/3515135976 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb880b12f0 0x7feb880ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:41.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.354+0000 7feb867fc700 1 -- 172.21.15.84:0/3515135976 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4067953805 0 0) 0x7feb740035b0 con 0x7feb880c92d0 2023-07-14T11:19:41.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.355+0000 7feb867fc700 1 -- 172.21.15.84:0/3515135976 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb880b12f0 msgr2=0x7feb880ad8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:41.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.355+0000 7feb867fc700 1 --2- 172.21.15.84:0/3515135976 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb880b12f0 0x7feb880ad8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:41.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.355+0000 7feb867fc700 1 -- 172.21.15.84:0/3515135976 >> v1:172.21.15.179:6789/0 conn(0x7feb880adea0 legacy=0x7feb880cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:41.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.355+0000 7feb867fc700 1 -- 172.21.15.84:0/3515135976 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb8815d3a0 con 0x7feb880c92d0 2023-07-14T11:19:41.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.355+0000 7feb867fc700 1 -- 172.21.15.84:0/3515135976 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7feb78001670 con 0x7feb880c92d0 2023-07-14T11:19:41.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.355+0000 7feb867fc700 1 -- 172.21.15.84:0/3515135976 >> v1:172.21.15.84:6789/0 conn(0x7feb880c92d0 legacy=0x7feb880c96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:41.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.355+0000 7feb867fc700 1 --2- 172.21.15.84:0/3515135976 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb880b12f0 0x7feb74003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:41.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.355+0000 7feb867fc700 1 --2- 172.21.15.84:0/3515135976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb74003fb0 0x7feb74004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:41.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.355+0000 7feb867fc700 1 --2- 172.21.15.84:0/3515135976 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb74004d90 0x7feb74005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:41.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.355+0000 7feb867fc700 1 -- 172.21.15.84:0/3515135976 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb8815da60 con 0x7feb74003fb0 2023-07-14T11:19:41.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.355+0000 7feb867fc700 1 -- 172.21.15.84:0/3515135976 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb7400ddb0 con 0x7feb74004d90 2023-07-14T11:19:41.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.355+0000 7feb867fc700 1 -- 172.21.15.84:0/3515135976 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb7400df70 con 0x7feb880b12f0 2023-07-14T11:19:41.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.355+0000 7feb7ffff700 1 --2- 172.21.15.84:0/3515135976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb74003fb0 0x7feb74004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:41.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.355+0000 7feb86ffd700 1 --2- 172.21.15.84:0/3515135976 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb880b12f0 0x7feb74003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:41.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.355+0000 7feb877fe700 1 --2- 172.21.15.84:0/3515135976 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb74004d90 0x7feb74005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:41.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.355+0000 7feb7ffff700 1 -- 172.21.15.84:0/3515135976 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb880b12f0 msgr2=0x7feb74003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:41.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.355+0000 7feb7ffff700 1 --2- 172.21.15.84:0/3515135976 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb880b12f0 0x7feb74003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:41.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.355+0000 7feb7ffff700 1 -- 172.21.15.84:0/3515135976 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb74004d90 msgr2=0x7feb74005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:41.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.355+0000 7feb7ffff700 1 --2- 172.21.15.84:0/3515135976 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb74004d90 0x7feb74005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:41.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.355+0000 7feb7ffff700 1 -- 172.21.15.84:0/3515135976 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb740035b0 con 0x7feb74003fb0 2023-07-14T11:19:41.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.356+0000 7feb7ffff700 1 --2- 172.21.15.84:0/3515135976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb74003fb0 0x7feb74004850 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7feb70009b30 tx=0x7feb74005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cd5021ed5a9dfc8 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:41.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.356+0000 7feb867fc700 1 -- 172.21.15.84:0/3515135976 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7000e6c0 con 0x7feb74003fb0 2023-07-14T11:19:41.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.356+0000 7feb867fc700 1 -- 172.21.15.84:0/3515135976 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb7000e820 con 0x7feb74003fb0 2023-07-14T11:19:41.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.356+0000 7feb867fc700 1 -- 172.21.15.84:0/3515135976 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7000eb90 con 0x7feb74003fb0 2023-07-14T11:19:41.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.356+0000 7feb8d9ff700 1 -- 172.21.15.84:0/3515135976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb74003fb0 msgr2=0x7feb74004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:41.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.356+0000 7feb8d9ff700 1 --2- 172.21.15.84:0/3515135976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb74003fb0 0x7feb74004850 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7feb70009b30 tx=0x7feb74005880 comp rx=0 tx=0).stop 2023-07-14T11:19:41.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.356+0000 7feb877fe700 1 -- 172.21.15.84:0/3515135976 reap_dead start 2023-07-14T11:19:41.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.356+0000 7feb8d9ff700 1 -- 172.21.15.84:0/3515135976 shutdown_connections 2023-07-14T11:19:41.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.356+0000 7feb8d9ff700 1 -- 172.21.15.84:0/3515135976 >> 172.21.15.84:0/3515135976 conn(0x7feb880b05d0 msgr2=0x7feb880b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:41.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.356+0000 7feb8d9ff700 1 -- 172.21.15.84:0/3515135976 shutdown_connections 2023-07-14T11:19:41.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.357+0000 7feb8d9ff700 1 -- 172.21.15.84:0/3515135976 wait complete. 2023-07-14T11:19:41.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.358+0000 7feb8d9ff700 1 Processor -- start 2023-07-14T11:19:41.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.358+0000 7feb8d9ff700 1 -- start start 2023-07-14T11:19:41.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.359+0000 7feb8d9ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb74003fb0 0x7feb880c7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:41.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.359+0000 7feb8d9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb88156b40 0x7feb8806cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:41.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.359+0000 7feb8d9ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb88157860 0x7feb880ac860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:41.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.359+0000 7feb8d9ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb88156fb0 con 0x7feb88157860 2023-07-14T11:19:41.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.359+0000 7feb8d9ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb880c7f20 con 0x7feb74003fb0 2023-07-14T11:19:41.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.359+0000 7feb8d9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb880c8200 con 0x7feb88156b40 2023-07-14T11:19:41.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.360+0000 7feb877fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb88157860 0x7feb880ac860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:41.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.360+0000 7feb877fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb88157860 0x7feb880ac860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36308/0 (socket says 172.21.15.84:36308) 2023-07-14T11:19:41.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.360+0000 7feb877fe700 1 -- 172.21.15.84:0/844334825 learned_addr learned my addr 172.21.15.84:0/844334825 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:41.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.360+0000 7feb7ffff700 1 --2- 172.21.15.84:0/844334825 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb88156b40 0x7feb8806cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:41.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.360+0000 7feb86ffd700 1 --2- 172.21.15.84:0/844334825 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb74003fb0 0x7feb880c7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:41.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.360+0000 7feb877fe700 1 -- 172.21.15.84:0/844334825 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb88156b40 msgr2=0x7feb8806cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:41.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.360+0000 7feb877fe700 1 --2- 172.21.15.84:0/844334825 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb88156b40 0x7feb8806cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:41.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.360+0000 7feb877fe700 1 -- 172.21.15.84:0/844334825 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb74003fb0 msgr2=0x7feb880c7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:41.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.360+0000 7feb877fe700 1 --2- 172.21.15.84:0/844334825 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb74003fb0 0x7feb880c7920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:41.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.360+0000 7feb877fe700 1 -- 172.21.15.84:0/844334825 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb880c84e0 con 0x7feb88157860 2023-07-14T11:19:41.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.360+0000 7feb877fe700 1 --2- 172.21.15.84:0/844334825 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb88157860 0x7feb880ac860 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7feb80000f80 tx=0x7feb8000edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:41.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.360+0000 7feb84ff9700 1 -- 172.21.15.84:0/844334825 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb80003c10 con 0x7feb88157860 2023-07-14T11:19:41.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.360+0000 7feb84ff9700 1 -- 172.21.15.84:0/844334825 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb80003d90 con 0x7feb88157860 2023-07-14T11:19:41.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.360+0000 7feb8d9ff700 1 -- 172.21.15.84:0/844334825 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb880c87c0 con 0x7feb88157860 2023-07-14T11:19:41.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.360+0000 7feb84ff9700 1 -- 172.21.15.84:0/844334825 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb80005310 con 0x7feb88157860 2023-07-14T11:19:41.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.361+0000 7feb8d9ff700 1 -- 172.21.15.84:0/844334825 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb88157cd0 con 0x7feb88157860 2023-07-14T11:19:41.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.361+0000 7feb8d9ff700 1 -- 172.21.15.84:0/844334825 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb88157ec0 con 0x7feb88157860 2023-07-14T11:19:41.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.362+0000 7feb84ff9700 1 -- 172.21.15.84:0/844334825 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7feb80005470 con 0x7feb88157860 2023-07-14T11:19:41.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.363+0000 7feb84ff9700 1 --2- 172.21.15.84:0/844334825 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7feb6806ae00 0x7feb6806d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:41.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.363+0000 7feb84ff9700 1 -- 172.21.15.84:0/844334825 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7feb800895f0 con 0x7feb88157860 2023-07-14T11:19:41.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.364+0000 7feb86ffd700 1 --2- 172.21.15.84:0/844334825 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7feb6806ae00 0x7feb6806d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:41.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.364+0000 7feb86ffd700 1 --2- 172.21.15.84:0/844334825 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7feb6806ae00 0x7feb6806d2b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7feb78005b00 tx=0x7feb78007040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:41.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.367+0000 7feb84ff9700 1 -- 172.21.15.84:0/844334825 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7feb88157ec0 con 0x7feb88157860 2023-07-14T11:19:41.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.595+0000 7feb8d9ff700 1 -- 172.21.15.84:0/844334825 --> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_0000000000536115", "target": ["mon-mgr", ""]}) v1 -- 0x7feb8815d680 con 0x7feb6806ae00 2023-07-14T11:19:41.605 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-07-14T11:19:41.602+0000 7f8e258bd700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T11:19:41.605 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-07-14T11:19:41.602+0000 7f8e258bd700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T11:19:41.605 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-07-14T11:19:41.602+0000 7f8e258bd700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T11:19:41.605 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-07-14T11:19:41.602+0000 7f8e258bd700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T11:19:41.605 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-07-14T11:19:41.602+0000 7f8e258bd700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T11:19:41.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.651+0000 7feb84ff9700 1 -- 172.21.15.84:0/844334825 <== mgr.4100 v2:172.21.15.179:6836/2094253834 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+82 (secure 0 0 0) 0x7feb78001b20 con 0x7feb6806ae00 2023-07-14T11:19:41.654 INFO:teuthology.orchestra.run.smithi084.stdout:/volumes/_nogroup/subvolume_0000000000536115/a771854e-a90b-4690-8065-77cb49819054 2023-07-14T11:19:41.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.654+0000 7feb8d9ff700 1 -- 172.21.15.84:0/844334825 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7feb6806ae00 msgr2=0x7feb6806d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:41.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.654+0000 7feb8d9ff700 1 --2- 172.21.15.84:0/844334825 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7feb6806ae00 0x7feb6806d2b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7feb78005b00 tx=0x7feb78007040 comp rx=0 tx=0).stop 2023-07-14T11:19:41.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.654+0000 7feb8d9ff700 1 -- 172.21.15.84:0/844334825 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb88157860 msgr2=0x7feb880ac860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:41.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.654+0000 7feb8d9ff700 1 --2- 172.21.15.84:0/844334825 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb88157860 0x7feb880ac860 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7feb80000f80 tx=0x7feb8000edd0 comp rx=0 tx=0).stop 2023-07-14T11:19:41.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.654+0000 7feb8d9ff700 1 -- 172.21.15.84:0/844334825 shutdown_connections 2023-07-14T11:19:41.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.654+0000 7feb8d9ff700 1 --2- 172.21.15.84:0/844334825 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb88157860 0x7feb880ac860 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:41.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.654+0000 7feb8d9ff700 1 --2- 172.21.15.84:0/844334825 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb74003fb0 0x7feb880c7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:41.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.654+0000 7feb8d9ff700 1 --2- 172.21.15.84:0/844334825 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7feb6806ae00 0x7feb6806d2b0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:41.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.654+0000 7feb8d9ff700 1 --2- 172.21.15.84:0/844334825 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb88156b40 0x7feb8806cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:41.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.654+0000 7feb8d9ff700 1 -- 172.21.15.84:0/844334825 >> 172.21.15.84:0/844334825 conn(0x7feb880b05d0 msgr2=0x7feb8806fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:41.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.654+0000 7feb8d9ff700 1 -- 172.21.15.84:0/844334825 shutdown_connections 2023-07-14T11:19:41.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.654+0000 7feb8d9ff700 1 -- 172.21.15.84:0/844334825 wait complete. 2023-07-14T11:19:41.674 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume ls cephfs 2023-07-14T11:19:41.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.871+0000 7f73233ff700 1 Processor -- start 2023-07-14T11:19:41.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.871+0000 7f73233ff700 1 -- start start 2023-07-14T11:19:41.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.872+0000 7f73233ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f731c0d0b10 0x7f731c0d0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:41.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.872+0000 7f73233ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f731c0b0e20 0x7f731c0b12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:41.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.872+0000 7f73233ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f731c0d14a0 con 0x7f731c0b8a60 2023-07-14T11:19:41.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.873+0000 7f73233ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f731c0b8e30 con 0x7f731c0b0e20 2023-07-14T11:19:41.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.873+0000 7f73233ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f731c0afaa0 con 0x7f731c0d0b10 2023-07-14T11:19:41.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.873+0000 7f732119b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f731c0b8a60 0x7f731c0b3ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53052/0 (socket says 172.21.15.84:53052) 2023-07-14T11:19:41.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.873+0000 7f732119b700 1 -- 172.21.15.84:0/2748393103 learned_addr learned my addr 172.21.15.84:0/2748393103 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:19:41.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.873+0000 7f732199c700 1 --2- 172.21.15.84:0/2748393103 >> v2:172.21.15.84:3300/0 conn(0x7f731c0b0e20 0x7f731c0b12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:41.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.873+0000 7f732099a700 1 --2- 172.21.15.84:0/2748393103 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f731c0d0b10 0x7f731c0d0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:41.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.873+0000 7f7313fff700 1 -- 172.21.15.84:0/2748393103 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3067104191 0 0) 0x7f7318001110 con 0x7f731c0b8a60 2023-07-14T11:19:41.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.873+0000 7f7313fff700 1 -- 172.21.15.84:0/2748393103 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73080035b0 con 0x7f731c0b8a60 2023-07-14T11:19:41.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.873+0000 7f732199c700 1 -- 172.21.15.84:0/2748393103 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f731c0d0b10 msgr2=0x7f731c0d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:41.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.873+0000 7f732199c700 1 --2- 172.21.15.84:0/2748393103 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f731c0d0b10 0x7f731c0d0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:41.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.873+0000 7f732199c700 1 -- 172.21.15.84:0/2748393103 >> v1:172.21.15.84:6789/0 conn(0x7f731c0b8a60 legacy=0x7f731c0b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:41.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.873+0000 7f732199c700 1 -- 172.21.15.84:0/2748393103 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f731c0afd80 con 0x7f731c0b0e20 2023-07-14T11:19:41.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.874+0000 7f732199c700 1 --2- 172.21.15.84:0/2748393103 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f731c0b0e20 0x7f731c0b12a0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f7314009d90 tx=0x7f731400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efceddf82d65d9ce server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:41.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.874+0000 7f7313fff700 1 -- 172.21.15.84:0/2748393103 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731400e070 con 0x7f731c0b0e20 2023-07-14T11:19:41.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.874+0000 7f7313fff700 1 -- 172.21.15.84:0/2748393103 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f731400bb20 con 0x7f731c0b0e20 2023-07-14T11:19:41.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.874+0000 7f7313fff700 1 -- 172.21.15.84:0/2748393103 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7314012430 con 0x7f731c0b0e20 2023-07-14T11:19:41.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.874+0000 7f73233ff700 1 -- 172.21.15.84:0/2748393103 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f731c0b0e20 msgr2=0x7f731c0b12a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:41.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.874+0000 7f73233ff700 1 --2- 172.21.15.84:0/2748393103 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f731c0b0e20 0x7f731c0b12a0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f7314009d90 tx=0x7f731400b330 comp rx=0 tx=0).stop 2023-07-14T11:19:41.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.874+0000 7f73233ff700 1 -- 172.21.15.84:0/2748393103 shutdown_connections 2023-07-14T11:19:41.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.874+0000 7f73233ff700 1 --2- 172.21.15.84:0/2748393103 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f731c0b0e20 0x7f731c0b12a0 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:41.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.874+0000 7f73233ff700 1 --2- 172.21.15.84:0/2748393103 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f731c0d0b10 0x7f731c0d0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:41.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.874+0000 7f73233ff700 1 -- 172.21.15.84:0/2748393103 >> 172.21.15.84:0/2748393103 conn(0x7f731c09c1b0 msgr2=0x7f731c0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:41.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.874+0000 7f73233ff700 1 -- 172.21.15.84:0/2748393103 shutdown_connections 2023-07-14T11:19:41.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.874+0000 7f73233ff700 1 -- 172.21.15.84:0/2748393103 wait complete. 2023-07-14T11:19:41.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.876+0000 7f73233ff700 1 Processor -- start 2023-07-14T11:19:41.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.876+0000 7f73233ff700 1 -- start start 2023-07-14T11:19:41.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.877+0000 7f73233ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f731c0b0e20 0x7f731c1523d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:41.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.877+0000 7f73233ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f731c0b8a60 0x7f731c0cabe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:41.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.877+0000 7f73233ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f731c0d0b10 0x7f731c0cb740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:41.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.877+0000 7f73233ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f731c0ceb40 con 0x7f731c0d0b10 2023-07-14T11:19:41.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.877+0000 7f73233ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f731c0cc8e0 con 0x7f731c0b8a60 2023-07-14T11:19:41.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.877+0000 7f73233ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f731c0ccbc0 con 0x7f731c0b0e20 2023-07-14T11:19:41.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.877+0000 7f732199c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f731c0d0b10 0x7f731c0cb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:41.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.878+0000 7f732199c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f731c0d0b10 0x7f731c0cb740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36336/0 (socket says 172.21.15.84:36336) 2023-07-14T11:19:41.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.878+0000 7f732199c700 1 -- 172.21.15.84:0/1812704216 learned_addr learned my addr 172.21.15.84:0/1812704216 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:41.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.878+0000 7f732199c700 1 -- 172.21.15.84:0/1812704216 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f731c0b0e20 msgr2=0x7f731c1523d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:41.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.878+0000 7f732099a700 1 --2- 172.21.15.84:0/1812704216 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f731c0b8a60 0x7f731c0cabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:41.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.878+0000 7f732119b700 1 --2- 172.21.15.84:0/1812704216 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f731c0b0e20 0x7f731c1523d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:41.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.878+0000 7f732199c700 1 --2- 172.21.15.84:0/1812704216 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f731c0b0e20 0x7f731c1523d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:41.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.878+0000 7f732199c700 1 -- 172.21.15.84:0/1812704216 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f731c0b8a60 msgr2=0x7f731c0cabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:41.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.878+0000 7f732199c700 1 --2- 172.21.15.84:0/1812704216 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f731c0b8a60 0x7f731c0cabe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:41.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.878+0000 7f732199c700 1 -- 172.21.15.84:0/1812704216 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7314009a70 con 0x7f731c0d0b10 2023-07-14T11:19:41.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.878+0000 7f732099a700 1 --2- 172.21.15.84:0/1812704216 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f731c0b8a60 0x7f731c0cabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:19:41.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.878+0000 7f732119b700 1 --2- 172.21.15.84:0/1812704216 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f731c0b0e20 0x7f731c1523d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:19:41.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.878+0000 7f732199c700 1 --2- 172.21.15.84:0/1812704216 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f731c0d0b10 0x7f731c0cb740 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f7314014040 tx=0x7f7314004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:41.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.878+0000 7f7311ffb700 1 -- 172.21.15.84:0/1812704216 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7314012430 con 0x7f731c0d0b10 2023-07-14T11:19:41.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.879+0000 7f7311ffb700 1 -- 172.21.15.84:0/1812704216 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7314020070 con 0x7f731c0d0b10 2023-07-14T11:19:41.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.879+0000 7f73233ff700 1 -- 172.21.15.84:0/1812704216 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f731c0ccea0 con 0x7f731c0d0b10 2023-07-14T11:19:41.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.879+0000 7f7311ffb700 1 -- 172.21.15.84:0/1812704216 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7314003ea0 con 0x7f731c0d0b10 2023-07-14T11:19:41.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.879+0000 7f73233ff700 1 -- 172.21.15.84:0/1812704216 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f731c0ce760 con 0x7f731c0d0b10 2023-07-14T11:19:41.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.880+0000 7f73233ff700 1 -- 172.21.15.84:0/1812704216 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f731c0cd0e0 con 0x7f731c0d0b10 2023-07-14T11:19:41.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.881+0000 7f7311ffb700 1 -- 172.21.15.84:0/1812704216 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f7314004280 con 0x7f731c0d0b10 2023-07-14T11:19:41.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.881+0000 7f7311ffb700 1 --2- 172.21.15.84:0/1812704216 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f730006ae00 0x7f730006d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:41.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.882+0000 7f7311ffb700 1 -- 172.21.15.84:0/1812704216 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7314022070 con 0x7f731c0d0b10 2023-07-14T11:19:41.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.882+0000 7f732119b700 1 --2- 172.21.15.84:0/1812704216 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f730006ae00 0x7f730006d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:41.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.882+0000 7f732119b700 1 --2- 172.21.15.84:0/1812704216 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f730006ae00 0x7f730006d2b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7318007fd0 tx=0x7f7318009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:41.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:41.886+0000 7f7311ffb700 1 -- 172.21.15.84:0/1812704216 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f73140565a0 con 0x7f731c0d0b10 2023-07-14T11:19:42.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.110+0000 7f73233ff700 1 -- 172.21.15.84:0/1812704216 --> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] -- mgr_command(tid 0: {"prefix": "fs subvolume ls", "vol_name": "cephfs", "target": ["mon-mgr", ""]}) v1 -- 0x7f731c0b0340 con 0x7f730006ae00 2023-07-14T11:19:42.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.115+0000 7f7311ffb700 1 -- 172.21.15.84:0/1812704216 <== mgr.4100 v2:172.21.15.179:6836/2094253834 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+61 (secure 0 0 0) 0x7f73180014e0 con 0x7f730006ae00 2023-07-14T11:19:42.118 INFO:teuthology.orchestra.run.smithi084.stdout:[ 2023-07-14T11:19:42.118 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-07-14T11:19:42.118 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "subvolume_0000000000536115" 2023-07-14T11:19:42.118 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-07-14T11:19:42.118 INFO:teuthology.orchestra.run.smithi084.stdout:] 2023-07-14T11:19:42.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.118+0000 7f73233ff700 1 -- 172.21.15.84:0/1812704216 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f730006ae00 msgr2=0x7f730006d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:42.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.118+0000 7f73233ff700 1 --2- 172.21.15.84:0/1812704216 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f730006ae00 0x7f730006d2b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7318007fd0 tx=0x7f7318009040 comp rx=0 tx=0).stop 2023-07-14T11:19:42.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.118+0000 7f73233ff700 1 -- 172.21.15.84:0/1812704216 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f731c0d0b10 msgr2=0x7f731c0cb740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:42.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.118+0000 7f73233ff700 1 --2- 172.21.15.84:0/1812704216 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f731c0d0b10 0x7f731c0cb740 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f7314014040 tx=0x7f7314004ad0 comp rx=0 tx=0).stop 2023-07-14T11:19:42.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.118+0000 7f73233ff700 1 -- 172.21.15.84:0/1812704216 shutdown_connections 2023-07-14T11:19:42.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.118+0000 7f73233ff700 1 --2- 172.21.15.84:0/1812704216 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f730006ae00 0x7f730006d2b0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:42.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.118+0000 7f73233ff700 1 --2- 172.21.15.84:0/1812704216 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f731c0b0e20 0x7f731c1523d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:42.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.118+0000 7f73233ff700 1 --2- 172.21.15.84:0/1812704216 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f731c0d0b10 0x7f731c0cb740 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:42.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.118+0000 7f73233ff700 1 --2- 172.21.15.84:0/1812704216 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f731c0b8a60 0x7f731c0cabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:42.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.118+0000 7f73233ff700 1 -- 172.21.15.84:0/1812704216 >> 172.21.15.84:0/1812704216 conn(0x7f731c09c1b0 msgr2=0x7f731c06a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:42.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.118+0000 7f73233ff700 1 -- 172.21.15.84:0/1812704216 shutdown_connections 2023-07-14T11:19:42.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.118+0000 7f73233ff700 1 -- 172.21.15.84:0/1812704216 wait complete. 2023-07-14T11:19:42.138 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume info cephfs subvolume_0000000000536115 2023-07-14T11:19:42.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.334+0000 7fd21f5ff700 1 Processor -- start 2023-07-14T11:19:42.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.334+0000 7fd21f5ff700 1 -- start start 2023-07-14T11:19:42.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.335+0000 7fd21f5ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd2180b8660 0x7fd2180cd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:42.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.335+0000 7fd21f5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2180cd970 0x7fd2180b4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:42.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.335+0000 7fd21f5ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd2180b4da0 0x7fd2181601f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:42.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.335+0000 7fd21f5ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2180d02a0 con 0x7fd2180b4da0 2023-07-14T11:19:42.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.335+0000 7fd21f5ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2180b51c0 con 0x7fd2180b8660 2023-07-14T11:19:42.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.335+0000 7fd21f5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2180cfce0 con 0x7fd2180cd970 2023-07-14T11:19:42.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.336+0000 7fd21db9c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd2180b4da0 0x7fd2181601f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:42.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.336+0000 7fd21db9c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd2180b4da0 0x7fd2181601f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36340/0 (socket says 172.21.15.84:36340) 2023-07-14T11:19:42.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.336+0000 7fd21db9c700 1 -- 172.21.15.84:0/2913952088 learned_addr learned my addr 172.21.15.84:0/2913952088 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:42.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.336+0000 7fd21cb9a700 1 --2- 172.21.15.84:0/2913952088 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2180cd970 0x7fd2180b4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:42.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.336+0000 7fd21d39b700 1 --2- 172.21.15.84:0/2913952088 >> v2:172.21.15.179:3300/0 conn(0x7fd2180b8660 0x7fd2180cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:42.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.336+0000 7fd21db9c700 1 -- 172.21.15.84:0/2913952088 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2180cd970 msgr2=0x7fd2180b4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:42.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.336+0000 7fd21db9c700 1 --2- 172.21.15.84:0/2913952088 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2180cd970 0x7fd2180b4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:42.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.336+0000 7fd21db9c700 1 -- 172.21.15.84:0/2913952088 >> v2:172.21.15.179:3300/0 conn(0x7fd2180b8660 msgr2=0x7fd2180cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:42.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.336+0000 7fd21db9c700 1 --2- 172.21.15.84:0/2913952088 >> v2:172.21.15.179:3300/0 conn(0x7fd2180b8660 0x7fd2180cd430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:42.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.336+0000 7fd21db9c700 1 -- 172.21.15.84:0/2913952088 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2180cffc0 con 0x7fd2180b4da0 2023-07-14T11:19:42.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.336+0000 7fd21cb9a700 1 --2- 172.21.15.84:0/2913952088 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2180cd970 0x7fd2180b4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:19:42.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.336+0000 7fd21db9c700 1 --2- 172.21.15.84:0/2913952088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2180b4da0 0x7fd2181601f0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7fd2180c9e60 tx=0x7fd21000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=621f58b6e776b525 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:42.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.337+0000 7fd20ffff700 1 -- 172.21.15.84:0/2913952088 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21000e070 con 0x7fd2180b4da0 2023-07-14T11:19:42.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.337+0000 7fd20ffff700 1 -- 172.21.15.84:0/2913952088 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd21000b910 con 0x7fd2180b4da0 2023-07-14T11:19:42.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.337+0000 7fd20ffff700 1 -- 172.21.15.84:0/2913952088 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21000bcc0 con 0x7fd2180b4da0 2023-07-14T11:19:42.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.337+0000 7fd21f5ff700 1 -- 172.21.15.84:0/2913952088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2180b4da0 msgr2=0x7fd2181601f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:42.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.337+0000 7fd21f5ff700 1 --2- 172.21.15.84:0/2913952088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2180b4da0 0x7fd2181601f0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7fd2180c9e60 tx=0x7fd21000b330 comp rx=0 tx=0).stop 2023-07-14T11:19:42.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.337+0000 7fd21f5ff700 1 -- 172.21.15.84:0/2913952088 shutdown_connections 2023-07-14T11:19:42.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.337+0000 7fd21f5ff700 1 --2- 172.21.15.84:0/2913952088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2180b4da0 0x7fd2181601f0 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:42.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.337+0000 7fd21f5ff700 1 --2- 172.21.15.84:0/2913952088 >> v2:172.21.15.179:3300/0 conn(0x7fd2180b8660 0x7fd2180cd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:42.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.337+0000 7fd21f5ff700 1 --2- 172.21.15.84:0/2913952088 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2180cd970 0x7fd2180b4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:42.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.337+0000 7fd21f5ff700 1 -- 172.21.15.84:0/2913952088 >> 172.21.15.84:0/2913952088 conn(0x7fd218066860 msgr2=0x7fd21806a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:42.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.337+0000 7fd21f5ff700 1 -- 172.21.15.84:0/2913952088 shutdown_connections 2023-07-14T11:19:42.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.337+0000 7fd21f5ff700 1 -- 172.21.15.84:0/2913952088 wait complete. 2023-07-14T11:19:42.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.339+0000 7fd21f5ff700 1 Processor -- start 2023-07-14T11:19:42.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.339+0000 7fd21f5ff700 1 -- start start 2023-07-14T11:19:42.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.340+0000 7fd21f5ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2180b4da0 0x7fd21815f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:42.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.340+0000 7fd21f5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2180b8660 0x7fd2180b7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:42.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.340+0000 7fd21f5ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2180cd970 0x7fd218149dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:42.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.340+0000 7fd21f5ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd21815db70 con 0x7fd2180cd970 2023-07-14T11:19:42.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.340+0000 7fd21f5ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd21815d890 con 0x7fd2180b4da0 2023-07-14T11:19:42.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.340+0000 7fd21f5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd21815e540 con 0x7fd2180b8660 2023-07-14T11:19:42.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.340+0000 7fd21db9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2180cd970 0x7fd218149dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:42.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.340+0000 7fd21db9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2180cd970 0x7fd218149dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36350/0 (socket says 172.21.15.84:36350) 2023-07-14T11:19:42.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.340+0000 7fd21db9c700 1 -- 172.21.15.84:0/53456368 learned_addr learned my addr 172.21.15.84:0/53456368 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:42.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.341+0000 7fd21cb9a700 1 --2- 172.21.15.84:0/53456368 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2180b8660 0x7fd2180b7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:42.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.341+0000 7fd21d39b700 1 --2- 172.21.15.84:0/53456368 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2180b4da0 0x7fd21815f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:42.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.341+0000 7fd21db9c700 1 -- 172.21.15.84:0/53456368 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2180b8660 msgr2=0x7fd2180b7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:42.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.341+0000 7fd21db9c700 1 --2- 172.21.15.84:0/53456368 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2180b8660 0x7fd2180b7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:42.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.341+0000 7fd21db9c700 1 -- 172.21.15.84:0/53456368 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2180b4da0 msgr2=0x7fd21815f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:42.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.341+0000 7fd21db9c700 1 --2- 172.21.15.84:0/53456368 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2180b4da0 0x7fd21815f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:42.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.341+0000 7fd21db9c700 1 -- 172.21.15.84:0/53456368 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd210009b30 con 0x7fd2180cd970 2023-07-14T11:19:42.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.341+0000 7fd21db9c700 1 --2- 172.21.15.84:0/53456368 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2180cd970 0x7fd218149dc0 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7fd2180673b0 tx=0x7fd210004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:42.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.341+0000 7fd20dffb700 1 -- 172.21.15.84:0/53456368 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2100099b0 con 0x7fd2180cd970 2023-07-14T11:19:42.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.341+0000 7fd20dffb700 1 -- 172.21.15.84:0/53456368 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd210004250 con 0x7fd2180cd970 2023-07-14T11:19:42.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.341+0000 7fd21f5ff700 1 -- 172.21.15.84:0/53456368 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd21815e820 con 0x7fd2180cd970 2023-07-14T11:19:42.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.341+0000 7fd20dffb700 1 -- 172.21.15.84:0/53456368 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd210004600 con 0x7fd2180cd970 2023-07-14T11:19:42.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.341+0000 7fd21f5ff700 1 -- 172.21.15.84:0/53456368 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd21815f560 con 0x7fd2180cd970 2023-07-14T11:19:42.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.343+0000 7fd21f5ff700 1 -- 172.21.15.84:0/53456368 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2180cd400 con 0x7fd2180cd970 2023-07-14T11:19:42.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.343+0000 7fd20dffb700 1 -- 172.21.15.84:0/53456368 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7fd210004760 con 0x7fd2180cd970 2023-07-14T11:19:42.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.344+0000 7fd20dffb700 1 --2- 172.21.15.84:0/53456368 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fd1fc06ae00 0x7fd1fc06d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:42.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.344+0000 7fd20dffb700 1 -- 172.21.15.84:0/53456368 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd21008ac70 con 0x7fd2180cd970 2023-07-14T11:19:42.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.345+0000 7fd21d39b700 1 --2- 172.21.15.84:0/53456368 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fd1fc06ae00 0x7fd1fc06d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:42.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.345+0000 7fd21d39b700 1 --2- 172.21.15.84:0/53456368 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fd1fc06ae00 0x7fd1fc06d2b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd214009af0 tx=0x7fd214008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:42.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.349+0000 7fd20dffb700 1 -- 172.21.15.84:0/53456368 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fd210055af0 con 0x7fd2180cd970 2023-07-14T11:19:42.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.573+0000 7fd21f5ff700 1 -- 172.21.15.84:0/53456368 --> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] -- mgr_command(tid 0: {"prefix": "fs subvolume info", "vol_name": "cephfs", "sub_name": "subvolume_0000000000536115", "target": ["mon-mgr", ""]}) v1 -- 0x7fd2180d0da0 con 0x7fd1fc06ae00 2023-07-14T11:19:42.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.601+0000 7fd20dffb700 1 -- 172.21.15.84:0/53456368 <== mgr.4100 v2:172.21.15.179:6836/2094253834 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+684 (secure 0 0 0) 0x7fd214011750 con 0x7fd1fc06ae00 2023-07-14T11:19:42.604 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-07-14T11:19:42.605 INFO:teuthology.orchestra.run.smithi084.stdout: "atime": "2023-07-14 11:19:40", 2023-07-14T11:19:42.605 INFO:teuthology.orchestra.run.smithi084.stdout: "bytes_pcent": "undefined", 2023-07-14T11:19:42.605 INFO:teuthology.orchestra.run.smithi084.stdout: "bytes_quota": "infinite", 2023-07-14T11:19:42.605 INFO:teuthology.orchestra.run.smithi084.stdout: "bytes_used": 0, 2023-07-14T11:19:42.605 INFO:teuthology.orchestra.run.smithi084.stdout: "created_at": "2023-07-14 11:19:40", 2023-07-14T11:19:42.605 INFO:teuthology.orchestra.run.smithi084.stdout: "ctime": "2023-07-14 11:19:41", 2023-07-14T11:19:42.606 INFO:teuthology.orchestra.run.smithi084.stdout: "data_pool": "cephfs_data", 2023-07-14T11:19:42.606 INFO:teuthology.orchestra.run.smithi084.stdout: "features": [ 2023-07-14T11:19:42.606 INFO:teuthology.orchestra.run.smithi084.stdout: "snapshot-clone", 2023-07-14T11:19:42.606 INFO:teuthology.orchestra.run.smithi084.stdout: "snapshot-autoprotect" 2023-07-14T11:19:42.606 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:19:42.606 INFO:teuthology.orchestra.run.smithi084.stdout: "gid": 0, 2023-07-14T11:19:42.606 INFO:teuthology.orchestra.run.smithi084.stdout: "mode": 16877, 2023-07-14T11:19:42.606 INFO:teuthology.orchestra.run.smithi084.stdout: "mon_addrs": [ 2023-07-14T11:19:42.607 INFO:teuthology.orchestra.run.smithi084.stdout: "172.21.15.84:6789", 2023-07-14T11:19:42.607 INFO:teuthology.orchestra.run.smithi084.stdout: "172.21.15.179:6789", 2023-07-14T11:19:42.607 INFO:teuthology.orchestra.run.smithi084.stdout: "172.21.15.179:6790" 2023-07-14T11:19:42.607 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2023-07-14T11:19:42.607 INFO:teuthology.orchestra.run.smithi084.stdout: "mtime": "2023-07-14 11:19:40", 2023-07-14T11:19:42.607 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/volumes/_nogroup/subvolume_0000000000536115/a771854e-a90b-4690-8065-77cb49819054", 2023-07-14T11:19:42.607 INFO:teuthology.orchestra.run.smithi084.stdout: "pool_namespace": "", 2023-07-14T11:19:42.607 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "complete", 2023-07-14T11:19:42.608 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "subvolume", 2023-07-14T11:19:42.608 INFO:teuthology.orchestra.run.smithi084.stdout: "uid": 0 2023-07-14T11:19:42.608 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-07-14T11:19:42.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.604+0000 7fd21f5ff700 1 -- 172.21.15.84:0/53456368 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fd1fc06ae00 msgr2=0x7fd1fc06d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:42.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.604+0000 7fd21f5ff700 1 --2- 172.21.15.84:0/53456368 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fd1fc06ae00 0x7fd1fc06d2b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd214009af0 tx=0x7fd214008040 comp rx=0 tx=0).stop 2023-07-14T11:19:42.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.604+0000 7fd21f5ff700 1 -- 172.21.15.84:0/53456368 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2180cd970 msgr2=0x7fd218149dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:42.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.604+0000 7fd21f5ff700 1 --2- 172.21.15.84:0/53456368 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2180cd970 0x7fd218149dc0 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7fd2180673b0 tx=0x7fd210004ad0 comp rx=0 tx=0).stop 2023-07-14T11:19:42.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.604+0000 7fd21f5ff700 1 -- 172.21.15.84:0/53456368 shutdown_connections 2023-07-14T11:19:42.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.604+0000 7fd21f5ff700 1 --2- 172.21.15.84:0/53456368 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2180cd970 0x7fd218149dc0 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:42.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.604+0000 7fd21f5ff700 1 --2- 172.21.15.84:0/53456368 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2180b4da0 0x7fd21815f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:42.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.604+0000 7fd21f5ff700 1 --2- 172.21.15.84:0/53456368 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fd1fc06ae00 0x7fd1fc06d2b0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:42.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.604+0000 7fd21f5ff700 1 --2- 172.21.15.84:0/53456368 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2180b8660 0x7fd2180b7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:42.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.604+0000 7fd21f5ff700 1 -- 172.21.15.84:0/53456368 >> 172.21.15.84:0/53456368 conn(0x7fd218066860 msgr2=0x7fd2180d1580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:42.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.604+0000 7fd21f5ff700 1 -- 172.21.15.84:0/53456368 shutdown_connections 2023-07-14T11:19:42.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.604+0000 7fd21f5ff700 1 -- 172.21.15.84:0/53456368 wait complete. 2023-07-14T11:19:42.624 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume resize cephfs subvolume_0000000000536115 10485760 2023-07-14T11:19:42.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.820+0000 7fe4777ff700 1 Processor -- start 2023-07-14T11:19:42.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.821+0000 7fe4777ff700 1 -- start start 2023-07-14T11:19:42.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.822+0000 7fe4777ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe470151460 0x7fe4700b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:42.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.822+0000 7fe4777ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe4700cefa0 0x7fe4700cf3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:42.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.822+0000 7fe4777ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4700b2cb0 0x7fe4700b3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:42.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.822+0000 7fe4777ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4700ce420 con 0x7fe4700cefa0 2023-07-14T11:19:42.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.822+0000 7fe4777ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4700b3670 con 0x7fe470151460 2023-07-14T11:19:42.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.822+0000 7fe4777ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe470151830 con 0x7fe4700b2cb0 2023-07-14T11:19:42.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.822+0000 7fe474d9a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe4700cefa0 0x7fe4700cf3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:42.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.822+0000 7fe474d9a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe4700cefa0 0x7fe4700cf3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36366/0 (socket says 172.21.15.84:36366) 2023-07-14T11:19:42.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.822+0000 7fe474d9a700 1 -- 172.21.15.84:0/3254794671 learned_addr learned my addr 172.21.15.84:0/3254794671 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:42.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.823+0000 7fe475d9c700 1 --2- 172.21.15.84:0/3254794671 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4700b2cb0 0x7fe4700b3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:42.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.823+0000 7fe47559b700 1 --2- 172.21.15.84:0/3254794671 >> v2:172.21.15.179:3300/0 conn(0x7fe470151460 0x7fe4700b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:42.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.823+0000 7fe474d9a700 1 -- 172.21.15.84:0/3254794671 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4700b2cb0 msgr2=0x7fe4700b3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:42.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.823+0000 7fe474d9a700 1 --2- 172.21.15.84:0/3254794671 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4700b2cb0 0x7fe4700b3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:42.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.823+0000 7fe474d9a700 1 -- 172.21.15.84:0/3254794671 >> v2:172.21.15.179:3300/0 conn(0x7fe470151460 msgr2=0x7fe4700b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:42.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.823+0000 7fe474d9a700 1 --2- 172.21.15.84:0/3254794671 >> v2:172.21.15.179:3300/0 conn(0x7fe470151460 0x7fe4700b2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:42.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.823+0000 7fe474d9a700 1 -- 172.21.15.84:0/3254794671 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4700cf930 con 0x7fe4700cefa0 2023-07-14T11:19:42.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.823+0000 7fe474d9a700 1 --2- 172.21.15.84:0/3254794671 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4700cefa0 0x7fe4700cf3f0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7fe47006f530 tx=0x7fe460009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbce207d0438cd16 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:42.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.823+0000 7fe467fff700 1 -- 172.21.15.84:0/3254794671 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46000b870 con 0x7fe4700cefa0 2023-07-14T11:19:42.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.823+0000 7fe467fff700 1 -- 172.21.15.84:0/3254794671 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe46000b9d0 con 0x7fe4700cefa0 2023-07-14T11:19:42.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.823+0000 7fe467fff700 1 -- 172.21.15.84:0/3254794671 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46000bd60 con 0x7fe4700cefa0 2023-07-14T11:19:42.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.824+0000 7fe4777ff700 1 -- 172.21.15.84:0/3254794671 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4700cefa0 msgr2=0x7fe4700cf3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:42.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.824+0000 7fe4777ff700 1 --2- 172.21.15.84:0/3254794671 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4700cefa0 0x7fe4700cf3f0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7fe47006f530 tx=0x7fe460009bd0 comp rx=0 tx=0).stop 2023-07-14T11:19:42.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.824+0000 7fe4777ff700 1 -- 172.21.15.84:0/3254794671 shutdown_connections 2023-07-14T11:19:42.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.824+0000 7fe4777ff700 1 --2- 172.21.15.84:0/3254794671 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4700b2cb0 0x7fe4700b3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:42.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.824+0000 7fe4777ff700 1 --2- 172.21.15.84:0/3254794671 >> v2:172.21.15.179:3300/0 conn(0x7fe470151460 0x7fe4700b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:42.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.824+0000 7fe4777ff700 1 --2- 172.21.15.84:0/3254794671 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4700cefa0 0x7fe4700cf3f0 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:42.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.824+0000 7fe4777ff700 1 -- 172.21.15.84:0/3254794671 >> 172.21.15.84:0/3254794671 conn(0x7fe470065bd0 msgr2=0x7fe470065fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:42.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.824+0000 7fe4777ff700 1 -- 172.21.15.84:0/3254794671 shutdown_connections 2023-07-14T11:19:42.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.824+0000 7fe4777ff700 1 -- 172.21.15.84:0/3254794671 wait complete. 2023-07-14T11:19:42.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.826+0000 7fe4777ff700 1 Processor -- start 2023-07-14T11:19:42.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.826+0000 7fe4777ff700 1 -- start start 2023-07-14T11:19:42.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.827+0000 7fe4777ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4700b2cb0 0x7fe47014c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:42.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.827+0000 7fe4777ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4700cefa0 0x7fe4701e36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:42.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.827+0000 7fe4777ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe470151460 0x7fe4701e3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:42.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.827+0000 7fe4777ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4700ae100 con 0x7fe470151460 2023-07-14T11:19:42.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.827+0000 7fe4777ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4700ad4f0 con 0x7fe4700cefa0 2023-07-14T11:19:42.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.827+0000 7fe4777ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4700ad7d0 con 0x7fe4700b2cb0 2023-07-14T11:19:42.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.827+0000 7fe475d9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe470151460 0x7fe4701e3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:42.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.827+0000 7fe475d9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe470151460 0x7fe4701e3c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36378/0 (socket says 172.21.15.84:36378) 2023-07-14T11:19:42.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.827+0000 7fe475d9c700 1 -- 172.21.15.84:0/3705595435 learned_addr learned my addr 172.21.15.84:0/3705595435 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:42.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.827+0000 7fe47559b700 1 --2- 172.21.15.84:0/3705595435 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4700b2cb0 0x7fe47014c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:42.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.827+0000 7fe474d9a700 1 --2- 172.21.15.84:0/3705595435 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4700cefa0 0x7fe4701e36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:42.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.828+0000 7fe475d9c700 1 -- 172.21.15.84:0/3705595435 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4700b2cb0 msgr2=0x7fe47014c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:42.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.828+0000 7fe475d9c700 1 --2- 172.21.15.84:0/3705595435 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4700b2cb0 0x7fe47014c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:42.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.828+0000 7fe475d9c700 1 -- 172.21.15.84:0/3705595435 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4700cefa0 msgr2=0x7fe4701e36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:42.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.828+0000 7fe475d9c700 1 --2- 172.21.15.84:0/3705595435 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4700cefa0 0x7fe4701e36d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:42.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.828+0000 7fe475d9c700 1 -- 172.21.15.84:0/3705595435 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe460009550 con 0x7fe470151460 2023-07-14T11:19:42.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.828+0000 7fe474d9a700 1 --2- 172.21.15.84:0/3705595435 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4700cefa0 0x7fe4701e36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:19:42.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.828+0000 7fe475d9c700 1 --2- 172.21.15.84:0/3705595435 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe470151460 0x7fe4701e3c10 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fe468007e60 tx=0x7fe46800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:42.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.828+0000 7fe465ffb700 1 -- 172.21.15.84:0/3705595435 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46800ede0 con 0x7fe470151460 2023-07-14T11:19:42.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.828+0000 7fe465ffb700 1 -- 172.21.15.84:0/3705595435 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe468014420 con 0x7fe470151460 2023-07-14T11:19:42.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.828+0000 7fe465ffb700 1 -- 172.21.15.84:0/3705595435 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4680147d0 con 0x7fe470151460 2023-07-14T11:19:42.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.828+0000 7fe4777ff700 1 -- 172.21.15.84:0/3705595435 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4700adab0 con 0x7fe470151460 2023-07-14T11:19:42.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.828+0000 7fe4777ff700 1 -- 172.21.15.84:0/3705595435 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe47014c820 con 0x7fe470151460 2023-07-14T11:19:42.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.829+0000 7fe4777ff700 1 -- 172.21.15.84:0/3705595435 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe470074350 con 0x7fe470151460 2023-07-14T11:19:42.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.830+0000 7fe465ffb700 1 -- 172.21.15.84:0/3705595435 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 89139+0+0 (secure 0 0 0) 0x7fe468014930 con 0x7fe470151460 2023-07-14T11:19:42.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.831+0000 7fe465ffb700 1 --2- 172.21.15.84:0/3705595435 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fe45406ae00 0x7fe45406d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:42.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.831+0000 7fe465ffb700 1 -- 172.21.15.84:0/3705595435 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe468089e80 con 0x7fe470151460 2023-07-14T11:19:42.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.832+0000 7fe47559b700 1 --2- 172.21.15.84:0/3705595435 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fe45406ae00 0x7fe45406d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:42.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.832+0000 7fe47559b700 1 --2- 172.21.15.84:0/3705595435 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fe45406ae00 0x7fe45406d2b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe46c00b930 tx=0x7fe46c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:42.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.835+0000 7fe465ffb700 1 -- 172.21.15.84:0/3705595435 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe468054e30 con 0x7fe470151460 2023-07-14T11:19:42.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:42.869+0000 7fe465ffb700 1 -- 172.21.15.84:0/3705595435 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mgrmap(e 17) v1 ==== 89190+0+0 (secure 0 0 0) 0x7fe468055200 con 0x7fe470151460 2023-07-14T11:19:43.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.073+0000 7fe4777ff700 1 -- 172.21.15.84:0/3705595435 --> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] -- mgr_command(tid 0: {"prefix": "fs subvolume resize", "vol_name": "cephfs", "sub_name": "subvolume_0000000000536115", "new_size": "10485760", "target": ["mon-mgr", ""]}) v1 -- 0x7fe4700ad940 con 0x7fe45406ae00 2023-07-14T11:19:43.107 INFO:tasks.ceph.mgr.x.smithi179.stderr:2023-07-14T11:19:43.104+0000 7f8e258bd700 -1 mgr.server reply reply (22) Invalid argument Cannot set new sizefor the subvolume. 'error in setxattr' 2023-07-14T11:19:43.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.104+0000 7fe465ffb700 1 -- 172.21.15.84:0/3705595435 <== mgr.4100 v2:172.21.15.179:6836/2094253834 1 ==== mgr_command_reply(tid 0: -22 Cannot set new sizefor the subvolume. 'error in setxattr') v1 ==== 65+0+0 (secure 0 0 0) 0x7fe4700ad940 con 0x7fe45406ae00 2023-07-14T11:19:43.109 INFO:teuthology.orchestra.run.smithi084.stderr:Error EINVAL: Cannot set new sizefor the subvolume. 'error in setxattr' 2023-07-14T11:19:43.116 DEBUG:teuthology.orchestra.run:got remote process result: 22 2023-07-14T11:19:43.117 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-14T11:19:43.117 DEBUG:teuthology.orchestra.run.smithi084:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-14T11:19:43.218 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-14T11:19:43.324 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-14T11:19:43.325 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-14T11:19:43.325 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:19:43.371 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-14T11:19:43.371 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:19:43.457 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:19:43.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.690+0000 7f8c711ff700 1 Processor -- start 2023-07-14T11:19:43.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.691+0000 7f8c711ff700 1 -- start start 2023-07-14T11:19:43.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.692+0000 7f8c711ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8c6c160030 0x7f8c6c06c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:43.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.692+0000 7f8c711ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c6c0b5cd0 0x7f8c6c0d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:43.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.692+0000 7f8c711ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8c6c0b1f70 0x7f8c6c0d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:43.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.692+0000 7f8c711ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c6c0d2cc0 con 0x7f8c6c0b1f70 2023-07-14T11:19:43.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.692+0000 7f8c711ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c6c0afbb0 con 0x7f8c6c160030 2023-07-14T11:19:43.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.692+0000 7f8c711ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6c0afe90 con 0x7f8c6c0b5cd0 2023-07-14T11:19:43.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.692+0000 7f8c6b59e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8c6c0b1f70 0x7f8c6c0d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:43.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.692+0000 7f8c6b59e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8c6c0b1f70 0x7f8c6c0d0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36382/0 (socket says 172.21.15.84:36382) 2023-07-14T11:19:43.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.692+0000 7f8c6b59e700 1 -- 172.21.15.84:0/2397681357 learned_addr learned my addr 172.21.15.84:0/2397681357 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:43.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.692+0000 7f8c63fff700 1 --2- 172.21.15.84:0/2397681357 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c6c0b5cd0 0x7f8c6c0d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:43.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.692+0000 7f8c6ad9d700 1 --2- 172.21.15.84:0/2397681357 >> v2:172.21.15.179:3300/0 conn(0x7f8c6c160030 0x7f8c6c06c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:43.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.693+0000 7f8c6b59e700 1 -- 172.21.15.84:0/2397681357 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c6c0b5cd0 msgr2=0x7f8c6c0d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:43.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.693+0000 7f8c6b59e700 1 --2- 172.21.15.84:0/2397681357 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c6c0b5cd0 0x7f8c6c0d0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:43.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.693+0000 7f8c6b59e700 1 -- 172.21.15.84:0/2397681357 >> v2:172.21.15.179:3300/0 conn(0x7f8c6c160030 msgr2=0x7f8c6c06c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:43.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.693+0000 7f8c6b59e700 1 --2- 172.21.15.84:0/2397681357 >> v2:172.21.15.179:3300/0 conn(0x7f8c6c160030 0x7f8c6c06c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:43.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.693+0000 7f8c6b59e700 1 -- 172.21.15.84:0/2397681357 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c6c0b0170 con 0x7f8c6c0b1f70 2023-07-14T11:19:43.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.693+0000 7f8c6ad9d700 1 --2- 172.21.15.84:0/2397681357 >> v2:172.21.15.179:3300/0 conn(0x7f8c6c160030 0x7f8c6c06c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:19:43.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.693+0000 7f8c6b59e700 1 --2- 172.21.15.84:0/2397681357 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c6c0b1f70 0x7f8c6c0d0f90 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c06d1a0 tx=0x7f8c6400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d567c8dc4bcc50a1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:43.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.693+0000 7f8c6a59c700 1 -- 172.21.15.84:0/2397681357 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6400e070 con 0x7f8c6c0b1f70 2023-07-14T11:19:43.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.693+0000 7f8c6a59c700 1 -- 172.21.15.84:0/2397681357 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c6400b9c0 con 0x7f8c6c0b1f70 2023-07-14T11:19:43.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.693+0000 7f8c6a59c700 1 -- 172.21.15.84:0/2397681357 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6400bd70 con 0x7f8c6c0b1f70 2023-07-14T11:19:43.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.694+0000 7f8c711ff700 1 -- 172.21.15.84:0/2397681357 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c6c0b1f70 msgr2=0x7f8c6c0d0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:43.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.694+0000 7f8c711ff700 1 --2- 172.21.15.84:0/2397681357 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c6c0b1f70 0x7f8c6c0d0f90 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c06d1a0 tx=0x7f8c6400b330 comp rx=0 tx=0).stop 2023-07-14T11:19:43.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.694+0000 7f8c711ff700 1 -- 172.21.15.84:0/2397681357 shutdown_connections 2023-07-14T11:19:43.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.694+0000 7f8c711ff700 1 --2- 172.21.15.84:0/2397681357 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c6c0b1f70 0x7f8c6c0d0f90 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:43.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.694+0000 7f8c711ff700 1 --2- 172.21.15.84:0/2397681357 >> v2:172.21.15.179:3300/0 conn(0x7f8c6c160030 0x7f8c6c06c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:43.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.694+0000 7f8c711ff700 1 --2- 172.21.15.84:0/2397681357 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c6c0b5cd0 0x7f8c6c0d0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:43.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.694+0000 7f8c711ff700 1 -- 172.21.15.84:0/2397681357 >> 172.21.15.84:0/2397681357 conn(0x7f8c6c09c190 msgr2=0x7f8c6c0d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:43.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.694+0000 7f8c711ff700 1 -- 172.21.15.84:0/2397681357 shutdown_connections 2023-07-14T11:19:43.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.694+0000 7f8c711ff700 1 -- 172.21.15.84:0/2397681357 wait complete. 2023-07-14T11:19:43.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.695+0000 7f8c711ff700 1 Processor -- start 2023-07-14T11:19:43.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.696+0000 7f8c711ff700 1 -- start start 2023-07-14T11:19:43.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.696+0000 7f8c711ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c6c0b1f70 0x7f8c6c0c8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:43.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.696+0000 7f8c711ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c6c0b5cd0 0x7f8c6c1f28a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:43.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.697+0000 7f8c711ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c6c160030 0x7f8c6c1f2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:43.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.697+0000 7f8c711ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6c0c7df0 con 0x7f8c6c0b5cd0 2023-07-14T11:19:43.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.697+0000 7f8c711ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6c0c80d0 con 0x7f8c6c0b1f70 2023-07-14T11:19:43.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.697+0000 7f8c711ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6c0c83b0 con 0x7f8c6c160030 2023-07-14T11:19:43.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.697+0000 7f8c63fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c6c0b5cd0 0x7f8c6c1f28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:43.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.697+0000 7f8c63fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c6c0b5cd0 0x7f8c6c1f28a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36398/0 (socket says 172.21.15.84:36398) 2023-07-14T11:19:43.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.697+0000 7f8c63fff700 1 -- 172.21.15.84:0/4220559017 learned_addr learned my addr 172.21.15.84:0/4220559017 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:43.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.697+0000 7f8c6ad9d700 1 --2- 172.21.15.84:0/4220559017 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c6c0b1f70 0x7f8c6c0c8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:43.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.697+0000 7f8c6b59e700 1 --2- 172.21.15.84:0/4220559017 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c6c160030 0x7f8c6c1f2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:43.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.697+0000 7f8c63fff700 1 -- 172.21.15.84:0/4220559017 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c6c160030 msgr2=0x7f8c6c1f2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:43.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.697+0000 7f8c63fff700 1 --2- 172.21.15.84:0/4220559017 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c6c160030 0x7f8c6c1f2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:43.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.697+0000 7f8c63fff700 1 -- 172.21.15.84:0/4220559017 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c6c0b1f70 msgr2=0x7f8c6c0c8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:43.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.697+0000 7f8c63fff700 1 --2- 172.21.15.84:0/4220559017 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c6c0b1f70 0x7f8c6c0c8e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:43.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.697+0000 7f8c63fff700 1 -- 172.21.15.84:0/4220559017 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c64009b30 con 0x7f8c6c0b5cd0 2023-07-14T11:19:43.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.697+0000 7f8c63fff700 1 --2- 172.21.15.84:0/4220559017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c6c0b5cd0 0x7f8c6c1f28a0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f8c5400e810 tx=0x7f8c5400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:43.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.698+0000 7f8c637fe700 1 -- 172.21.15.84:0/4220559017 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c5400c070 con 0x7f8c6c0b5cd0 2023-07-14T11:19:43.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.698+0000 7f8c637fe700 1 -- 172.21.15.84:0/4220559017 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c54013610 con 0x7f8c6c0b5cd0 2023-07-14T11:19:43.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.698+0000 7f8c637fe700 1 -- 172.21.15.84:0/4220559017 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c540139a0 con 0x7f8c6c0b5cd0 2023-07-14T11:19:43.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.698+0000 7f8c711ff700 1 -- 172.21.15.84:0/4220559017 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c6c0c8690 con 0x7f8c6c0b5cd0 2023-07-14T11:19:43.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.698+0000 7f8c711ff700 1 -- 172.21.15.84:0/4220559017 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c6c0c78c0 con 0x7f8c6c0b5cd0 2023-07-14T11:19:43.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.699+0000 7f8c711ff700 1 -- 172.21.15.84:0/4220559017 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c6c0d1560 con 0x7f8c6c0b5cd0 2023-07-14T11:19:43.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.700+0000 7f8c637fe700 1 -- 172.21.15.84:0/4220559017 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f8c54013b00 con 0x7f8c6c0b5cd0 2023-07-14T11:19:43.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.701+0000 7f8c637fe700 1 --2- 172.21.15.84:0/4220559017 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f8c4c06ae90 0x7f8c4c06d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:43.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.701+0000 7f8c637fe700 1 -- 172.21.15.84:0/4220559017 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8c54089580 con 0x7f8c6c0b5cd0 2023-07-14T11:19:43.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.701+0000 7f8c6ad9d700 1 --2- 172.21.15.84:0/4220559017 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f8c4c06ae90 0x7f8c4c06d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:43.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.702+0000 7f8c6ad9d700 1 --2- 172.21.15.84:0/4220559017 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f8c4c06ae90 0x7f8c4c06d340 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c0b0f60 tx=0x7f8c5c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:43.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.705+0000 7f8c637fe700 1 -- 172.21.15.84:0/4220559017 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f8c540542a0 con 0x7f8c6c0b5cd0 2023-07-14T11:19:43.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.899+0000 7f8c711ff700 1 -- 172.21.15.84:0/4220559017 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8c6c0c8210 con 0x7f8c6c0b5cd0 2023-07-14T11:19:43.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.900+0000 7f8c637fe700 1 -- 172.21.15.84:0/4220559017 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v106) v1 ==== 74+0+18337 (secure 0 0 0) 0x7f8c6c0c8210 con 0x7f8c6c0b5cd0 2023-07-14T11:19:43.904 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:19:43.904 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":106,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:19:25.959900+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-07-14T11:19:22.615201+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-07-14T11:19:23.416792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:19:43.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.903+0000 7f8c711ff700 1 -- 172.21.15.84:0/4220559017 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f8c4c06ae90 msgr2=0x7f8c4c06d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:43.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.903+0000 7f8c711ff700 1 --2- 172.21.15.84:0/4220559017 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f8c4c06ae90 0x7f8c4c06d340 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c0b0f60 tx=0x7f8c5c008040 comp rx=0 tx=0).stop 2023-07-14T11:19:43.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.903+0000 7f8c711ff700 1 -- 172.21.15.84:0/4220559017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c6c0b5cd0 msgr2=0x7f8c6c1f28a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:43.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.903+0000 7f8c711ff700 1 --2- 172.21.15.84:0/4220559017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c6c0b5cd0 0x7f8c6c1f28a0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f8c5400e810 tx=0x7f8c5400eb20 comp rx=0 tx=0).stop 2023-07-14T11:19:43.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.903+0000 7f8c711ff700 1 -- 172.21.15.84:0/4220559017 shutdown_connections 2023-07-14T11:19:43.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.903+0000 7f8c711ff700 1 --2- 172.21.15.84:0/4220559017 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f8c4c06ae90 0x7f8c4c06d340 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:43.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.903+0000 7f8c711ff700 1 --2- 172.21.15.84:0/4220559017 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c6c160030 0x7f8c6c1f2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:43.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.903+0000 7f8c711ff700 1 --2- 172.21.15.84:0/4220559017 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c6c0b1f70 0x7f8c6c0c8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:43.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.903+0000 7f8c711ff700 1 --2- 172.21.15.84:0/4220559017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c6c0b5cd0 0x7f8c6c1f28a0 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:43.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.903+0000 7f8c711ff700 1 -- 172.21.15.84:0/4220559017 >> 172.21.15.84:0/4220559017 conn(0x7f8c6c09c190 msgr2=0x7f8c6c06c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:43.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.903+0000 7f8c711ff700 1 -- 172.21.15.84:0/4220559017 shutdown_connections 2023-07-14T11:19:43.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:43.903+0000 7f8c711ff700 1 -- 172.21.15.84:0/4220559017 wait complete. 2023-07-14T11:19:43.924 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T11:13:00.125395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T11:13:06.803994+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T11:19:22.615201+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '105', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T11:19:23.416792+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '106', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T11:19:43.926 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T11:19:44.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.123+0000 7f7669fff700 1 Processor -- start 2023-07-14T11:19:44.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.123+0000 7f7669fff700 1 -- start start 2023-07-14T11:19:44.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.125+0000 7f7669fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76640b4600 0x7f76640cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:44.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.125+0000 7f7669fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f76640cfe40 0x7f76640d02b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:44.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.125+0000 7f7669fff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f766415cd60 con 0x7f76640cd540 2023-07-14T11:19:44.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.125+0000 7f7669fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76640d1550 con 0x7f76640cfe40 2023-07-14T11:19:44.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.125+0000 7f7669fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76640d2d90 con 0x7f76640b4600 2023-07-14T11:19:44.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.125+0000 7f7663fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f76640cd540 0x7f76640cd9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53060/0 (socket says 172.21.15.84:53060) 2023-07-14T11:19:44.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.125+0000 7f7663fff700 1 -- 172.21.15.84:0/3176361752 learned_addr learned my addr 172.21.15.84:0/3176361752 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:19:44.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.125+0000 7f76637fe700 1 --2- 172.21.15.84:0/3176361752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76640b4600 0x7f76640cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:44.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.125+0000 7f765bfff700 1 --2- 172.21.15.84:0/3176361752 >> v2:172.21.15.179:3300/0 conn(0x7f76640cfe40 0x7f76640d02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:44.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.125+0000 7f7662ffd700 1 -- 172.21.15.84:0/3176361752 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2244813304 0 0) 0x7f766415cd60 con 0x7f76640cd540 2023-07-14T11:19:44.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.125+0000 7f7662ffd700 1 -- 172.21.15.84:0/3176361752 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76500035b0 con 0x7f76640cd540 2023-07-14T11:19:44.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.126+0000 7f7662ffd700 1 -- 172.21.15.84:0/3176361752 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3940307354 0 0) 0x7f76500035b0 con 0x7f76640cd540 2023-07-14T11:19:44.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.126+0000 7f7662ffd700 1 -- 172.21.15.84:0/3176361752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76640b4600 msgr2=0x7f76640cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:44.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.126+0000 7f7662ffd700 1 --2- 172.21.15.84:0/3176361752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76640b4600 0x7f76640cf900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:44.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.126+0000 7f7662ffd700 1 -- 172.21.15.84:0/3176361752 >> v2:172.21.15.179:3300/0 conn(0x7f76640cfe40 msgr2=0x7f76640d02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:44.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.126+0000 7f7662ffd700 1 --2- 172.21.15.84:0/3176361752 >> v2:172.21.15.179:3300/0 conn(0x7f76640cfe40 0x7f76640d02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:44.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.126+0000 7f7662ffd700 1 -- 172.21.15.84:0/3176361752 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76640cf340 con 0x7f76640cd540 2023-07-14T11:19:44.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.126+0000 7f7662ffd700 1 -- 172.21.15.84:0/3176361752 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7f765c0019f0 con 0x7f76640cd540 2023-07-14T11:19:44.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.126+0000 7f765bfff700 1 --2- 172.21.15.84:0/3176361752 >> v2:172.21.15.179:3300/0 conn(0x7f76640cfe40 0x7f76640d02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:19:44.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.126+0000 7f7662ffd700 1 -- 172.21.15.84:0/3176361752 >> v1:172.21.15.84:6789/0 conn(0x7f76640cd540 legacy=0x7f76640cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:44.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.126+0000 7f7662ffd700 1 --2- 172.21.15.84:0/3176361752 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7650003a30 0x7f7650003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:44.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.126+0000 7f7662ffd700 1 --2- 172.21.15.84:0/3176361752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7650004850 0x7f7650004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:44.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.126+0000 7f7662ffd700 1 --2- 172.21.15.84:0/3176361752 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76500051c0 0x7f765000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:44.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.126+0000 7f7662ffd700 1 -- 172.21.15.84:0/3176361752 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76640d1550 con 0x7f7650003a30 2023-07-14T11:19:44.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.126+0000 7f7662ffd700 1 -- 172.21.15.84:0/3176361752 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76640d2d90 con 0x7f76500051c0 2023-07-14T11:19:44.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.126+0000 7f7662ffd700 1 -- 172.21.15.84:0/3176361752 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f765000bf50 con 0x7f7650004850 2023-07-14T11:19:44.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.126+0000 7f76637fe700 1 --2- 172.21.15.84:0/3176361752 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7650003a30 0x7f7650003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:44.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.126+0000 7f765bfff700 1 --2- 172.21.15.84:0/3176361752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7650004850 0x7f7650004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:44.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.126+0000 7f7663fff700 1 --2- 172.21.15.84:0/3176361752 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76500051c0 0x7f765000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:44.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.127+0000 7f76637fe700 1 -- 172.21.15.84:0/3176361752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7650004850 msgr2=0x7f7650004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:44.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.127+0000 7f76637fe700 1 --2- 172.21.15.84:0/3176361752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7650004850 0x7f7650004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:44.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.127+0000 7f76637fe700 1 -- 172.21.15.84:0/3176361752 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76500051c0 msgr2=0x7f765000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:44.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.127+0000 7f76637fe700 1 --2- 172.21.15.84:0/3176361752 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76500051c0 0x7f765000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:44.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.127+0000 7f76637fe700 1 -- 172.21.15.84:0/3176361752 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76500035b0 con 0x7f7650003a30 2023-07-14T11:19:44.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.127+0000 7f76637fe700 1 --2- 172.21.15.84:0/3176361752 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7650003a30 0x7f7650003e40 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f7654009b60 tx=0x7f7650005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=974fa7d47feaa7ad server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:44.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.127+0000 7f7662ffd700 1 -- 172.21.15.84:0/3176361752 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765400e660 con 0x7f7650003a30 2023-07-14T11:19:44.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.127+0000 7f7662ffd700 1 -- 172.21.15.84:0/3176361752 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f765400e7c0 con 0x7f7650003a30 2023-07-14T11:19:44.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.127+0000 7f7662ffd700 1 -- 172.21.15.84:0/3176361752 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765400eb30 con 0x7f7650003a30 2023-07-14T11:19:44.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.127+0000 7f7669fff700 1 -- 172.21.15.84:0/3176361752 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7650003a30 msgr2=0x7f7650003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:44.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.127+0000 7f7669fff700 1 --2- 172.21.15.84:0/3176361752 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7650003a30 0x7f7650003e40 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f7654009b60 tx=0x7f7650005880 comp rx=0 tx=0).stop 2023-07-14T11:19:44.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.127+0000 7f7663fff700 1 -- 172.21.15.84:0/3176361752 reap_dead start 2023-07-14T11:19:44.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.128+0000 7f7669fff700 1 -- 172.21.15.84:0/3176361752 shutdown_connections 2023-07-14T11:19:44.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.128+0000 7f7669fff700 1 -- 172.21.15.84:0/3176361752 >> 172.21.15.84:0/3176361752 conn(0x7f766409c200 msgr2=0x7f76640d2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:44.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.128+0000 7f7669fff700 1 -- 172.21.15.84:0/3176361752 shutdown_connections 2023-07-14T11:19:44.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.128+0000 7f7669fff700 1 -- 172.21.15.84:0/3176361752 wait complete. 2023-07-14T11:19:44.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.129+0000 7f7669fff700 1 Processor -- start 2023-07-14T11:19:44.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.130+0000 7f7669fff700 1 -- start start 2023-07-14T11:19:44.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.130+0000 7f7669fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7650003a30 0x7f766414f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:44.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.130+0000 7f7669fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76641e6950 0x7f766406b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:44.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.131+0000 7f7669fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76641e6dc0 0x7f766406bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:44.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.131+0000 7f7669fff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f766414fb20 con 0x7f76641e6dc0 2023-07-14T11:19:44.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.131+0000 7f7669fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76641e4f40 con 0x7f7650003a30 2023-07-14T11:19:44.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.131+0000 7f7669fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76641e5220 con 0x7f76641e6950 2023-07-14T11:19:44.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.131+0000 7f7663fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76641e6dc0 0x7f766406bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:44.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.131+0000 7f7663fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76641e6dc0 0x7f766406bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36406/0 (socket says 172.21.15.84:36406) 2023-07-14T11:19:44.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.131+0000 7f7663fff700 1 -- 172.21.15.84:0/3112703926 learned_addr learned my addr 172.21.15.84:0/3112703926 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:44.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.131+0000 7f76637fe700 1 --2- 172.21.15.84:0/3112703926 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7650003a30 0x7f766414f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:44.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.131+0000 7f765bfff700 1 --2- 172.21.15.84:0/3112703926 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76641e6950 0x7f766406b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:44.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.131+0000 7f7663fff700 1 -- 172.21.15.84:0/3112703926 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76641e6950 msgr2=0x7f766406b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:44.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.131+0000 7f7663fff700 1 --2- 172.21.15.84:0/3112703926 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76641e6950 0x7f766406b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:44.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.131+0000 7f7663fff700 1 -- 172.21.15.84:0/3112703926 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7650003a30 msgr2=0x7f766414f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:44.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.131+0000 7f7663fff700 1 --2- 172.21.15.84:0/3112703926 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7650003a30 0x7f766414f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:44.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.131+0000 7f7663fff700 1 -- 172.21.15.84:0/3112703926 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76641e5500 con 0x7f76641e6dc0 2023-07-14T11:19:44.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.131+0000 7f765bfff700 1 --2- 172.21.15.84:0/3112703926 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76641e6950 0x7f766406b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:19:44.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.131+0000 7f7663fff700 1 --2- 172.21.15.84:0/3112703926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76641e6dc0 0x7f766406bd00 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f76640b8fa0 tx=0x7f765c007c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:44.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.132+0000 7f7660ff9700 1 -- 172.21.15.84:0/3112703926 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765c00ed10 con 0x7f76641e6dc0 2023-07-14T11:19:44.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.132+0000 7f7660ff9700 1 -- 172.21.15.84:0/3112703926 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f765c00ee90 con 0x7f76641e6dc0 2023-07-14T11:19:44.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.132+0000 7f7669fff700 1 -- 172.21.15.84:0/3112703926 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76641e57e0 con 0x7f76641e6dc0 2023-07-14T11:19:44.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.132+0000 7f7660ff9700 1 -- 172.21.15.84:0/3112703926 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765c013660 con 0x7f76641e6dc0 2023-07-14T11:19:44.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.132+0000 7f7669fff700 1 -- 172.21.15.84:0/3112703926 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76640cb6b0 con 0x7f76641e6dc0 2023-07-14T11:19:44.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.133+0000 7f7669fff700 1 -- 172.21.15.84:0/3112703926 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76640cb8d0 con 0x7f76641e6dc0 2023-07-14T11:19:44.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.134+0000 7f7660ff9700 1 -- 172.21.15.84:0/3112703926 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f765c0137c0 con 0x7f76641e6dc0 2023-07-14T11:19:44.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.135+0000 7f7660ff9700 1 --2- 172.21.15.84:0/3112703926 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f764406ae90 0x7f764406d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:44.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.135+0000 7f7660ff9700 1 -- 172.21.15.84:0/3112703926 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f765c089de0 con 0x7f76641e6dc0 2023-07-14T11:19:44.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.135+0000 7f76637fe700 1 --2- 172.21.15.84:0/3112703926 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f764406ae90 0x7f764406d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:44.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.136+0000 7f76637fe700 1 --2- 172.21.15.84:0/3112703926 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f764406ae90 0x7f764406d340 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f76540090b0 tx=0x7f7654008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:44.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.139+0000 7f7660ff9700 1 -- 172.21.15.84:0/3112703926 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f76640cb8d0 con 0x7f76641e6dc0 2023-07-14T11:19:44.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.330+0000 7f7669fff700 1 -- 172.21.15.84:0/3112703926 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f76640cb8d0 con 0x7f76641e6dc0 2023-07-14T11:19:44.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.330+0000 7f7660ff9700 1 -- 172.21.15.84:0/3112703926 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v106) v1 ==== 93+0+10 (secure 0 0 0) 0x7f76640cb8d0 con 0x7f76641e6dc0 2023-07-14T11:19:44.333 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-07-14T11:19:44.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.333+0000 7f7669fff700 1 -- 172.21.15.84:0/3112703926 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f764406ae90 msgr2=0x7f764406d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:44.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.333+0000 7f7669fff700 1 --2- 172.21.15.84:0/3112703926 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f764406ae90 0x7f764406d340 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f76540090b0 tx=0x7f7654008030 comp rx=0 tx=0).stop 2023-07-14T11:19:44.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.333+0000 7f7669fff700 1 -- 172.21.15.84:0/3112703926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76641e6dc0 msgr2=0x7f766406bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:44.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.333+0000 7f7669fff700 1 --2- 172.21.15.84:0/3112703926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76641e6dc0 0x7f766406bd00 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f76640b8fa0 tx=0x7f765c007c90 comp rx=0 tx=0).stop 2023-07-14T11:19:44.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.333+0000 7f7669fff700 1 -- 172.21.15.84:0/3112703926 shutdown_connections 2023-07-14T11:19:44.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.333+0000 7f7669fff700 1 --2- 172.21.15.84:0/3112703926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76641e6dc0 0x7f766406bd00 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:44.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.333+0000 7f7669fff700 1 --2- 172.21.15.84:0/3112703926 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7650003a30 0x7f766414f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:44.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.333+0000 7f7669fff700 1 --2- 172.21.15.84:0/3112703926 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f764406ae90 0x7f764406d340 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:44.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.333+0000 7f7669fff700 1 --2- 172.21.15.84:0/3112703926 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76641e6950 0x7f766406b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:44.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.333+0000 7f7669fff700 1 -- 172.21.15.84:0/3112703926 >> 172.21.15.84:0/3112703926 conn(0x7f766409c200 msgr2=0x7f766415c380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:44.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.333+0000 7f7669fff700 1 -- 172.21.15.84:0/3112703926 shutdown_connections 2023-07-14T11:19:44.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.333+0000 7f7669fff700 1 -- 172.21.15.84:0/3112703926 wait complete. 2023-07-14T11:19:44.353 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T11:19:44.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.550+0000 7ffb5ffff700 1 Processor -- start 2023-07-14T11:19:44.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.550+0000 7ffb5ffff700 1 -- start start 2023-07-14T11:19:44.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.551+0000 7ffb5ffff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ffb5815d9d0 0x7ffb5806b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:44.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.551+0000 7ffb5ffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ffb5806c9f0 0x7ffb580b1910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:44.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.551+0000 7ffb5ffff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb5806c4e0 con 0x7ffb580b1e50 2023-07-14T11:19:44.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.551+0000 7ffb5ffff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb5815dda0 con 0x7ffb5806c9f0 2023-07-14T11:19:44.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.551+0000 7ffb5ffff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb5806bf20 con 0x7ffb5815d9d0 2023-07-14T11:19:44.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.551+0000 7ffb5d59a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ffb5806c9f0 0x7ffb580b1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:44.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.551+0000 7ffb5d59a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ffb5806c9f0 0x7ffb580b1910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36410/0 (socket says 172.21.15.84:36410) 2023-07-14T11:19:44.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.551+0000 7ffb5d59a700 1 -- 172.21.15.84:0/3267932112 learned_addr learned my addr 172.21.15.84:0/3267932112 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:44.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.551+0000 7ffb5dd9b700 1 --2- 172.21.15.84:0/3267932112 >> v2:172.21.15.179:3300/0 conn(0x7ffb5815d9d0 0x7ffb5806b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:44.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.552+0000 7ffb5d59a700 1 -- 172.21.15.84:0/3267932112 >> v2:172.21.15.179:3300/0 conn(0x7ffb5815d9d0 msgr2=0x7ffb5806b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:44.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.552+0000 7ffb5d59a700 1 --2- 172.21.15.84:0/3267932112 >> v2:172.21.15.179:3300/0 conn(0x7ffb5815d9d0 0x7ffb5806b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:44.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.552+0000 7ffb5d59a700 1 -- 172.21.15.84:0/3267932112 >> v1:172.21.15.179:6789/0 conn(0x7ffb580b1e50 legacy=0x7ffb58071170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:44.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.552+0000 7ffb5d59a700 1 -- 172.21.15.84:0/3267932112 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb5806c200 con 0x7ffb5806c9f0 2023-07-14T11:19:44.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.552+0000 7ffb5dd9b700 1 --2- 172.21.15.84:0/3267932112 >> v2:172.21.15.179:3300/0 conn(0x7ffb5815d9d0 0x7ffb5806b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:19:44.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.552+0000 7ffb5d59a700 1 --2- 172.21.15.84:0/3267932112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb5806c9f0 0x7ffb580b1910 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7ffb5806dcc0 tx=0x7ffb48009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4bfd377e8ad55e0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:44.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.552+0000 7ffb5cd99700 1 -- 172.21.15.84:0/3267932112 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb48004230 con 0x7ffb5806c9f0 2023-07-14T11:19:44.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.552+0000 7ffb5cd99700 1 -- 172.21.15.84:0/3267932112 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb48004390 con 0x7ffb5806c9f0 2023-07-14T11:19:44.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.552+0000 7ffb5cd99700 1 -- 172.21.15.84:0/3267932112 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb480036a0 con 0x7ffb5806c9f0 2023-07-14T11:19:44.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.553+0000 7ffb5ffff700 1 -- 172.21.15.84:0/3267932112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb5806c9f0 msgr2=0x7ffb580b1910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:44.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.553+0000 7ffb5ffff700 1 --2- 172.21.15.84:0/3267932112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb5806c9f0 0x7ffb580b1910 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7ffb5806dcc0 tx=0x7ffb48009bd0 comp rx=0 tx=0).stop 2023-07-14T11:19:44.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.553+0000 7ffb5ffff700 1 -- 172.21.15.84:0/3267932112 shutdown_connections 2023-07-14T11:19:44.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.553+0000 7ffb5ffff700 1 --2- 172.21.15.84:0/3267932112 >> v2:172.21.15.179:3300/0 conn(0x7ffb5815d9d0 0x7ffb5806b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:44.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.553+0000 7ffb5ffff700 1 --2- 172.21.15.84:0/3267932112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb5806c9f0 0x7ffb580b1910 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:44.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.553+0000 7ffb5ffff700 1 -- 172.21.15.84:0/3267932112 >> 172.21.15.84:0/3267932112 conn(0x7ffb580b05d0 msgr2=0x7ffb580b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:44.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.553+0000 7ffb5ffff700 1 -- 172.21.15.84:0/3267932112 shutdown_connections 2023-07-14T11:19:44.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.553+0000 7ffb5ffff700 1 -- 172.21.15.84:0/3267932112 wait complete. 2023-07-14T11:19:44.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.554+0000 7ffb5ffff700 1 Processor -- start 2023-07-14T11:19:44.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.555+0000 7ffb5ffff700 1 -- start start 2023-07-14T11:19:44.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.555+0000 7ffb5ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb5806c9f0 0x7ffb580cdd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:44.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.555+0000 7ffb5ffff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb580b1e50 0x7ffb581f1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:44.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.556+0000 7ffb5ffff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb5815d9d0 0x7ffb580ac860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:44.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.556+0000 7ffb5ffff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb581f1b40 con 0x7ffb5806c9f0 2023-07-14T11:19:44.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.556+0000 7ffb5ffff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb580ce390 con 0x7ffb580b1e50 2023-07-14T11:19:44.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.556+0000 7ffb5ffff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb580cc7c0 con 0x7ffb5815d9d0 2023-07-14T11:19:44.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.556+0000 7ffb5dd9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb5806c9f0 0x7ffb580cdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:44.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.556+0000 7ffb5dd9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb5806c9f0 0x7ffb580cdd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36412/0 (socket says 172.21.15.84:36412) 2023-07-14T11:19:44.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.556+0000 7ffb5dd9b700 1 -- 172.21.15.84:0/4006395911 learned_addr learned my addr 172.21.15.84:0/4006395911 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:44.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.556+0000 7ffb5d59a700 1 --2- 172.21.15.84:0/4006395911 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb580b1e50 0x7ffb581f1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:44.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.556+0000 7ffb5e59c700 1 --2- 172.21.15.84:0/4006395911 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb5815d9d0 0x7ffb580ac860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:44.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.556+0000 7ffb5dd9b700 1 -- 172.21.15.84:0/4006395911 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb5815d9d0 msgr2=0x7ffb580ac860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:44.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.556+0000 7ffb5dd9b700 1 --2- 172.21.15.84:0/4006395911 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb5815d9d0 0x7ffb580ac860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:44.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.556+0000 7ffb5dd9b700 1 -- 172.21.15.84:0/4006395911 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb580b1e50 msgr2=0x7ffb581f1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:44.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.556+0000 7ffb5dd9b700 1 --2- 172.21.15.84:0/4006395911 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb580b1e50 0x7ffb581f1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:44.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.556+0000 7ffb5dd9b700 1 -- 172.21.15.84:0/4006395911 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb48009550 con 0x7ffb5806c9f0 2023-07-14T11:19:44.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.556+0000 7ffb5d59a700 1 --2- 172.21.15.84:0/4006395911 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb580b1e50 0x7ffb581f1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:19:44.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.556+0000 7ffb5e59c700 1 --2- 172.21.15.84:0/4006395911 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb5815d9d0 0x7ffb580ac860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:19:44.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.556+0000 7ffb5dd9b700 1 --2- 172.21.15.84:0/4006395911 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb5806c9f0 0x7ffb580cdd00 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7ffb5400c7f0 tx=0x7ffb5400cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:44.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.557+0000 7ffb4e7fc700 1 -- 172.21.15.84:0/4006395911 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb54011800 con 0x7ffb5806c9f0 2023-07-14T11:19:44.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.557+0000 7ffb4e7fc700 1 -- 172.21.15.84:0/4006395911 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb54011960 con 0x7ffb5806c9f0 2023-07-14T11:19:44.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.557+0000 7ffb4e7fc700 1 -- 172.21.15.84:0/4006395911 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb54011d10 con 0x7ffb5806c9f0 2023-07-14T11:19:44.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.557+0000 7ffb5ffff700 1 -- 172.21.15.84:0/4006395911 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb58154ab0 con 0x7ffb5806c9f0 2023-07-14T11:19:44.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.557+0000 7ffb5ffff700 1 -- 172.21.15.84:0/4006395911 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb580ccd40 con 0x7ffb5806c9f0 2023-07-14T11:19:44.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.558+0000 7ffb5ffff700 1 -- 172.21.15.84:0/4006395911 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb58074350 con 0x7ffb5806c9f0 2023-07-14T11:19:44.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.559+0000 7ffb4e7fc700 1 -- 172.21.15.84:0/4006395911 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) v1 ==== 89190+0+0 (secure 0 0 0) 0x7ffb54018360 con 0x7ffb5806c9f0 2023-07-14T11:19:44.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.560+0000 7ffb4e7fc700 1 --2- 172.21.15.84:0/4006395911 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7ffb3c06ae90 0x7ffb3c06d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:44.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.560+0000 7ffb4e7fc700 1 -- 172.21.15.84:0/4006395911 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ffb540898a0 con 0x7ffb5806c9f0 2023-07-14T11:19:44.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.560+0000 7ffb5d59a700 1 --2- 172.21.15.84:0/4006395911 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7ffb3c06ae90 0x7ffb3c06d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:44.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.561+0000 7ffb5d59a700 1 --2- 172.21.15.84:0/4006395911 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7ffb3c06ae90 0x7ffb3c06d340 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ffb5806cdc0 tx=0x7ffb48008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:44.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.564+0000 7ffb4e7fc700 1 -- 172.21.15.84:0/4006395911 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ffb540545b0 con 0x7ffb5806c9f0 2023-07-14T11:19:44.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.758+0000 7ffb5ffff700 1 -- 172.21.15.84:0/4006395911 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ffb580ce500 con 0x7ffb5806c9f0 2023-07-14T11:19:44.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.759+0000 7ffb4e7fc700 1 -- 172.21.15.84:0/4006395911 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v106) v1 ==== 92+0+10 (secure 0 0 0) 0x7ffb54057bd0 con 0x7ffb5806c9f0 2023-07-14T11:19:44.762 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-07-14T11:19:44.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.761+0000 7ffb5ffff700 1 -- 172.21.15.84:0/4006395911 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7ffb3c06ae90 msgr2=0x7ffb3c06d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:44.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.761+0000 7ffb5ffff700 1 --2- 172.21.15.84:0/4006395911 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7ffb3c06ae90 0x7ffb3c06d340 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ffb5806cdc0 tx=0x7ffb48008030 comp rx=0 tx=0).stop 2023-07-14T11:19:44.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.761+0000 7ffb5ffff700 1 -- 172.21.15.84:0/4006395911 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb5806c9f0 msgr2=0x7ffb580cdd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:44.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.761+0000 7ffb5ffff700 1 --2- 172.21.15.84:0/4006395911 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb5806c9f0 0x7ffb580cdd00 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7ffb5400c7f0 tx=0x7ffb5400cbb0 comp rx=0 tx=0).stop 2023-07-14T11:19:44.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.761+0000 7ffb5ffff700 1 -- 172.21.15.84:0/4006395911 shutdown_connections 2023-07-14T11:19:44.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.761+0000 7ffb5ffff700 1 --2- 172.21.15.84:0/4006395911 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7ffb3c06ae90 0x7ffb3c06d340 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:44.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.761+0000 7ffb5ffff700 1 --2- 172.21.15.84:0/4006395911 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb5815d9d0 0x7ffb580ac860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:44.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.761+0000 7ffb5ffff700 1 --2- 172.21.15.84:0/4006395911 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb5806c9f0 0x7ffb580cdd00 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:44.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.761+0000 7ffb5ffff700 1 --2- 172.21.15.84:0/4006395911 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb580b1e50 0x7ffb581f1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:44.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.761+0000 7ffb5ffff700 1 -- 172.21.15.84:0/4006395911 >> 172.21.15.84:0/4006395911 conn(0x7ffb580b05d0 msgr2=0x7ffb580ae540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:44.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.761+0000 7ffb5ffff700 1 -- 172.21.15.84:0/4006395911 shutdown_connections 2023-07-14T11:19:44.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.761+0000 7ffb5ffff700 1 -- 172.21.15.84:0/4006395911 wait complete. 2023-07-14T11:19:44.782 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T11:19:44.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.980+0000 7f2808bff700 1 Processor -- start 2023-07-14T11:19:44.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.980+0000 7f2808bff700 1 -- start start 2023-07-14T11:19:44.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.981+0000 7f2808bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28040b8a60 0x7f28040b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:44.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.981+0000 7f2808bff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f28040d1220 0x7f28040b0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:44.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.981+0000 7f2808bff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28040b8e30 con 0x7f28040b4530 2023-07-14T11:19:44.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.981+0000 7f2808bff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28040afaa0 con 0x7f28040d1220 2023-07-14T11:19:44.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.981+0000 7f2808bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28040afd80 con 0x7f28040b8a60 2023-07-14T11:19:44.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.982+0000 7f2802d9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f28040d1220 0x7f28040b0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:44.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.982+0000 7f2802d9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f28040d1220 0x7f28040b0e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36426/0 (socket says 172.21.15.84:36426) 2023-07-14T11:19:44.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.982+0000 7f2802d9d700 1 -- 172.21.15.84:0/1998498246 learned_addr learned my addr 172.21.15.84:0/1998498246 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:44.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.982+0000 7f280259c700 1 --2- 172.21.15.84:0/1998498246 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28040b8a60 0x7f28040b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:44.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.982+0000 7f2802d9d700 1 -- 172.21.15.84:0/1998498246 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28040b8a60 msgr2=0x7f28040b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:44.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.982+0000 7f2802d9d700 1 --2- 172.21.15.84:0/1998498246 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28040b8a60 0x7f28040b3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:44.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.982+0000 7f2802d9d700 1 -- 172.21.15.84:0/1998498246 >> v1:172.21.15.179:6789/0 conn(0x7f28040b4530 legacy=0x7f28040d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:44.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.982+0000 7f2802d9d700 1 -- 172.21.15.84:0/1998498246 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28040b0060 con 0x7f28040d1220 2023-07-14T11:19:44.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.982+0000 7f2802d9d700 1 --2- 172.21.15.84:0/1998498246 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28040d1220 0x7f28040b0e20 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f27fc009e50 tx=0x7f27fc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a0cabe683a10080 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:44.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.983+0000 7f2801d9b700 1 -- 172.21.15.84:0/1998498246 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27fc00e070 con 0x7f28040d1220 2023-07-14T11:19:44.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.983+0000 7f2801d9b700 1 -- 172.21.15.84:0/1998498246 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27fc00b9c0 con 0x7f28040d1220 2023-07-14T11:19:44.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.983+0000 7f2801d9b700 1 -- 172.21.15.84:0/1998498246 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27fc00bd70 con 0x7f28040d1220 2023-07-14T11:19:44.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.983+0000 7f2808bff700 1 -- 172.21.15.84:0/1998498246 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28040d1220 msgr2=0x7f28040b0e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:44.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.983+0000 7f2808bff700 1 --2- 172.21.15.84:0/1998498246 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28040d1220 0x7f28040b0e20 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f27fc009e50 tx=0x7f27fc00b330 comp rx=0 tx=0).stop 2023-07-14T11:19:44.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.983+0000 7f2808bff700 1 -- 172.21.15.84:0/1998498246 shutdown_connections 2023-07-14T11:19:44.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.983+0000 7f2808bff700 1 --2- 172.21.15.84:0/1998498246 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28040d1220 0x7f28040b0e20 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:44.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.983+0000 7f2808bff700 1 --2- 172.21.15.84:0/1998498246 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28040b8a60 0x7f28040b3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:44.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.983+0000 7f2808bff700 1 -- 172.21.15.84:0/1998498246 >> 172.21.15.84:0/1998498246 conn(0x7f280409c1b0 msgr2=0x7f28040d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:44.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.983+0000 7f2808bff700 1 -- 172.21.15.84:0/1998498246 shutdown_connections 2023-07-14T11:19:44.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.983+0000 7f2808bff700 1 -- 172.21.15.84:0/1998498246 wait complete. 2023-07-14T11:19:44.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.986+0000 7f2808bff700 1 Processor -- start 2023-07-14T11:19:44.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.986+0000 7f2808bff700 1 -- start start 2023-07-14T11:19:44.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.987+0000 7f2808bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28040b4530 0x7f28040cfc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:44.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.987+0000 7f2808bff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28040b8a60 0x7f28040cb060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:44.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.987+0000 7f2808bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28040d1220 0x7f28040cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:44.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.987+0000 7f2808bff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28040cc850 con 0x7f28040b8a60 2023-07-14T11:19:44.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.987+0000 7f2808bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28040cbc40 con 0x7f28040b4530 2023-07-14T11:19:44.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.987+0000 7f2808bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28040cbf20 con 0x7f28040d1220 2023-07-14T11:19:44.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.987+0000 7f27fbfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28040b8a60 0x7f28040cb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:44.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.987+0000 7f27fbfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28040b8a60 0x7f28040cb060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36432/0 (socket says 172.21.15.84:36432) 2023-07-14T11:19:44.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.987+0000 7f27fbfff700 1 -- 172.21.15.84:0/1114512990 learned_addr learned my addr 172.21.15.84:0/1114512990 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:44.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.987+0000 7f2802d9d700 1 --2- 172.21.15.84:0/1114512990 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28040d1220 0x7f28040cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:44.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.987+0000 7f280259c700 1 --2- 172.21.15.84:0/1114512990 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28040b4530 0x7f28040cfc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:44.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.988+0000 7f27fbfff700 1 -- 172.21.15.84:0/1114512990 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28040d1220 msgr2=0x7f28040cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:44.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.988+0000 7f27fbfff700 1 --2- 172.21.15.84:0/1114512990 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28040d1220 0x7f28040cb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:44.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.988+0000 7f27fbfff700 1 -- 172.21.15.84:0/1114512990 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28040b4530 msgr2=0x7f28040cfc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:44.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.988+0000 7f27fbfff700 1 --2- 172.21.15.84:0/1114512990 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28040b4530 0x7f28040cfc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:44.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.988+0000 7f27fbfff700 1 -- 172.21.15.84:0/1114512990 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27fc009b30 con 0x7f28040b8a60 2023-07-14T11:19:44.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.988+0000 7f280259c700 1 --2- 172.21.15.84:0/1114512990 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28040b4530 0x7f28040cfc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:19:44.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.988+0000 7f27fbfff700 1 --2- 172.21.15.84:0/1114512990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28040b8a60 0x7f28040cb060 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f27ec00c4e0 tx=0x7f27ec00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:44.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.988+0000 7f27faffd700 1 -- 172.21.15.84:0/1114512990 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ec0052d0 con 0x7f28040b8a60 2023-07-14T11:19:44.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.988+0000 7f27faffd700 1 -- 172.21.15.84:0/1114512990 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27ec005430 con 0x7f28040b8a60 2023-07-14T11:19:44.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.988+0000 7f2808bff700 1 -- 172.21.15.84:0/1114512990 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28040cc200 con 0x7f28040b8a60 2023-07-14T11:19:44.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.988+0000 7f27faffd700 1 -- 172.21.15.84:0/1114512990 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ec0038c0 con 0x7f28040b8a60 2023-07-14T11:19:44.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.988+0000 7f2808bff700 1 -- 172.21.15.84:0/1114512990 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28041f55a0 con 0x7f28040b8a60 2023-07-14T11:19:44.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.989+0000 7f2808bff700 1 -- 172.21.15.84:0/1114512990 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28040cc9c0 con 0x7f28040b8a60 2023-07-14T11:19:44.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.990+0000 7f27faffd700 1 -- 172.21.15.84:0/1114512990 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f27ec003a20 con 0x7f28040b8a60 2023-07-14T11:19:44.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.991+0000 7f27faffd700 1 --2- 172.21.15.84:0/1114512990 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f27e406aec0 0x7f27e406d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:44.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.991+0000 7f27faffd700 1 -- 172.21.15.84:0/1114512990 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f27ec088c50 con 0x7f28040b8a60 2023-07-14T11:19:44.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.992+0000 7f280259c700 1 --2- 172.21.15.84:0/1114512990 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f27e406aec0 0x7f27e406d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:44.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.992+0000 7f280259c700 1 --2- 172.21.15.84:0/1114512990 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f27e406aec0 0x7f27e406d370 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f27f40099f0 tx=0x7f27f4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:44.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:44.996+0000 7f27faffd700 1 -- 172.21.15.84:0/1114512990 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f27ec053a70 con 0x7f28040b8a60 2023-07-14T11:19:45.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.188+0000 7f2808bff700 1 -- 172.21.15.84:0/1114512990 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2804074350 con 0x7f28040b8a60 2023-07-14T11:19:45.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.188+0000 7f27faffd700 1 -- 172.21.15.84:0/1114512990 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v106) v1 ==== 104+0+11 (secure 0 0 0) 0x7f27ec057090 con 0x7f28040b8a60 2023-07-14T11:19:45.191 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-07-14T11:19:45.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.190+0000 7f2808bff700 1 -- 172.21.15.84:0/1114512990 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f27e406aec0 msgr2=0x7f27e406d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:45.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.190+0000 7f2808bff700 1 --2- 172.21.15.84:0/1114512990 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f27e406aec0 0x7f27e406d370 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f27f40099f0 tx=0x7f27f4008040 comp rx=0 tx=0).stop 2023-07-14T11:19:45.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.190+0000 7f2808bff700 1 -- 172.21.15.84:0/1114512990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28040b8a60 msgr2=0x7f28040cb060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:45.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.190+0000 7f2808bff700 1 --2- 172.21.15.84:0/1114512990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28040b8a60 0x7f28040cb060 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f27ec00c4e0 tx=0x7f27ec00c7f0 comp rx=0 tx=0).stop 2023-07-14T11:19:45.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.191+0000 7f2808bff700 1 -- 172.21.15.84:0/1114512990 shutdown_connections 2023-07-14T11:19:45.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.191+0000 7f2808bff700 1 --2- 172.21.15.84:0/1114512990 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f27e406aec0 0x7f27e406d370 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:45.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.191+0000 7f2808bff700 1 --2- 172.21.15.84:0/1114512990 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28040d1220 0x7f28040cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:45.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.191+0000 7f2808bff700 1 --2- 172.21.15.84:0/1114512990 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28040b4530 0x7f28040cfc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:45.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.191+0000 7f2808bff700 1 --2- 172.21.15.84:0/1114512990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28040b8a60 0x7f28040cb060 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:45.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.191+0000 7f2808bff700 1 -- 172.21.15.84:0/1114512990 >> 172.21.15.84:0/1114512990 conn(0x7f280409c1b0 msgr2=0x7f28040b0e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:45.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.191+0000 7f2808bff700 1 -- 172.21.15.84:0/1114512990 shutdown_connections 2023-07-14T11:19:45.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.191+0000 7f2808bff700 1 -- 172.21.15.84:0/1114512990 wait complete. 2023-07-14T11:19:45.211 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T11:19:45.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.406+0000 7fb081bff700 1 Processor -- start 2023-07-14T11:19:45.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.406+0000 7fb081bff700 1 -- start start 2023-07-14T11:19:45.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.407+0000 7fb081bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb07c0c92d0 0x7fb07c0ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:45.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.407+0000 7fb081bff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb07c0b12f0 0x7fb07c0c96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:45.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.407+0000 7fb081bff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb07c0adea0 0x7fb07c06c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:45.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.407+0000 7fb081bff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb07c15da60 con 0x7fb07c0adea0 2023-07-14T11:19:45.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.407+0000 7fb081bff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb07c15ce70 con 0x7fb07c0b12f0 2023-07-14T11:19:45.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.407+0000 7fb081bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c0c9be0 con 0x7fb07c0c92d0 2023-07-14T11:19:45.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.408+0000 7fb07bfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb07c0adea0 0x7fb07c06c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:45.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.408+0000 7fb07bfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb07c0adea0 0x7fb07c06c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36434/0 (socket says 172.21.15.84:36434) 2023-07-14T11:19:45.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.408+0000 7fb07bfff700 1 -- 172.21.15.84:0/2496603273 learned_addr learned my addr 172.21.15.84:0/2496603273 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:45.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.408+0000 7fb07b7fe700 1 --2- 172.21.15.84:0/2496603273 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb07c0c92d0 0x7fb07c0ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:45.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.408+0000 7fb07affd700 1 --2- 172.21.15.84:0/2496603273 >> v2:172.21.15.179:3300/0 conn(0x7fb07c0b12f0 0x7fb07c0c96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:45.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.408+0000 7fb07bfff700 1 -- 172.21.15.84:0/2496603273 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb07c0c92d0 msgr2=0x7fb07c0ad8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:45.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.408+0000 7fb07bfff700 1 --2- 172.21.15.84:0/2496603273 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb07c0c92d0 0x7fb07c0ad8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:45.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.408+0000 7fb07bfff700 1 -- 172.21.15.84:0/2496603273 >> v2:172.21.15.179:3300/0 conn(0x7fb07c0b12f0 msgr2=0x7fb07c0c96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:45.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.408+0000 7fb07bfff700 1 --2- 172.21.15.84:0/2496603273 >> v2:172.21.15.179:3300/0 conn(0x7fb07c0b12f0 0x7fb07c0c96a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:45.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.408+0000 7fb07bfff700 1 -- 172.21.15.84:0/2496603273 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb07c15d0c0 con 0x7fb07c0adea0 2023-07-14T11:19:45.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.408+0000 7fb07bfff700 1 --2- 172.21.15.84:0/2496603273 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb07c0adea0 0x7fb07c06c6c0 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7fb07c06d700 tx=0x7fb07400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c786c9e8264b7237 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:45.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.409+0000 7fb07a7fc700 1 -- 172.21.15.84:0/2496603273 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07400e070 con 0x7fb07c0adea0 2023-07-14T11:19:45.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.409+0000 7fb07a7fc700 1 -- 172.21.15.84:0/2496603273 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb07400b910 con 0x7fb07c0adea0 2023-07-14T11:19:45.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.409+0000 7fb07a7fc700 1 -- 172.21.15.84:0/2496603273 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07400bcc0 con 0x7fb07c0adea0 2023-07-14T11:19:45.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.409+0000 7fb081bff700 1 -- 172.21.15.84:0/2496603273 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb07c0adea0 msgr2=0x7fb07c06c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:45.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.409+0000 7fb081bff700 1 --2- 172.21.15.84:0/2496603273 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb07c0adea0 0x7fb07c06c6c0 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7fb07c06d700 tx=0x7fb07400b330 comp rx=0 tx=0).stop 2023-07-14T11:19:45.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.409+0000 7fb081bff700 1 -- 172.21.15.84:0/2496603273 shutdown_connections 2023-07-14T11:19:45.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.409+0000 7fb081bff700 1 --2- 172.21.15.84:0/2496603273 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb07c0c92d0 0x7fb07c0ad8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:45.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.409+0000 7fb081bff700 1 --2- 172.21.15.84:0/2496603273 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb07c0adea0 0x7fb07c06c6c0 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:45.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.409+0000 7fb081bff700 1 --2- 172.21.15.84:0/2496603273 >> v2:172.21.15.179:3300/0 conn(0x7fb07c0b12f0 0x7fb07c0c96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:45.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.409+0000 7fb081bff700 1 -- 172.21.15.84:0/2496603273 >> 172.21.15.84:0/2496603273 conn(0x7fb07c0b05d0 msgr2=0x7fb07c0b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:45.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.409+0000 7fb081bff700 1 -- 172.21.15.84:0/2496603273 shutdown_connections 2023-07-14T11:19:45.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.409+0000 7fb081bff700 1 -- 172.21.15.84:0/2496603273 wait complete. 2023-07-14T11:19:45.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.411+0000 7fb081bff700 1 Processor -- start 2023-07-14T11:19:45.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.411+0000 7fb081bff700 1 -- start start 2023-07-14T11:19:45.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.412+0000 7fb081bff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb07c0adea0 0x7fb07c149090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:45.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.412+0000 7fb081bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb07c0b12f0 0x7fb07c06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:45.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.412+0000 7fb081bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb07c0c92d0 0x7fb07c0ad400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:45.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.412+0000 7fb081bff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c0ad940 con 0x7fb07c0adea0 2023-07-14T11:19:45.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.412+0000 7fb081bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c070350 con 0x7fb07c0b12f0 2023-07-14T11:19:45.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.412+0000 7fb081bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c0c5cc0 con 0x7fb07c0c92d0 2023-07-14T11:19:45.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.412+0000 7fb07b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb07c0adea0 0x7fb07c149090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:45.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.412+0000 7fb07b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb07c0adea0 0x7fb07c149090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36446/0 (socket says 172.21.15.84:36446) 2023-07-14T11:19:45.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.412+0000 7fb07b7fe700 1 -- 172.21.15.84:0/2020823062 learned_addr learned my addr 172.21.15.84:0/2020823062 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:45.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.413+0000 7fb07bfff700 1 --2- 172.21.15.84:0/2020823062 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb07c0c92d0 0x7fb07c0ad400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:45.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.413+0000 7fb07affd700 1 --2- 172.21.15.84:0/2020823062 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb07c0b12f0 0x7fb07c06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:45.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.413+0000 7fb07b7fe700 1 -- 172.21.15.84:0/2020823062 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb07c0c92d0 msgr2=0x7fb07c0ad400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:45.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.413+0000 7fb07b7fe700 1 --2- 172.21.15.84:0/2020823062 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb07c0c92d0 0x7fb07c0ad400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:45.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.413+0000 7fb07b7fe700 1 -- 172.21.15.84:0/2020823062 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb07c0b12f0 msgr2=0x7fb07c06fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:45.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.413+0000 7fb07b7fe700 1 --2- 172.21.15.84:0/2020823062 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb07c0b12f0 0x7fb07c06fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:45.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.413+0000 7fb07b7fe700 1 -- 172.21.15.84:0/2020823062 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb074009b30 con 0x7fb07c0adea0 2023-07-14T11:19:45.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.413+0000 7fb07b7fe700 1 --2- 172.21.15.84:0/2020823062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb07c0adea0 0x7fb07c149090 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7fb06c00e9b0 tx=0x7fb06c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:45.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.413+0000 7fb063fff700 1 -- 172.21.15.84:0/2020823062 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06c009710 con 0x7fb07c0adea0 2023-07-14T11:19:45.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.413+0000 7fb063fff700 1 -- 172.21.15.84:0/2020823062 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb06c00c850 con 0x7fb07c0adea0 2023-07-14T11:19:45.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.413+0000 7fb063fff700 1 -- 172.21.15.84:0/2020823062 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06c00cbc0 con 0x7fb07c0adea0 2023-07-14T11:19:45.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.413+0000 7fb081bff700 1 -- 172.21.15.84:0/2020823062 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb07c0c5fa0 con 0x7fb07c0adea0 2023-07-14T11:19:45.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.413+0000 7fb081bff700 1 -- 172.21.15.84:0/2020823062 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb07c0c6560 con 0x7fb07c0adea0 2023-07-14T11:19:45.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.414+0000 7fb081bff700 1 -- 172.21.15.84:0/2020823062 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb07c0c6780 con 0x7fb07c0adea0 2023-07-14T11:19:45.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.415+0000 7fb063fff700 1 -- 172.21.15.84:0/2020823062 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) v1 ==== 89190+0+0 (secure 0 0 0) 0x7fb06c00cd20 con 0x7fb07c0adea0 2023-07-14T11:19:45.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.416+0000 7fb063fff700 1 --2- 172.21.15.84:0/2020823062 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fb06806ae90 0x7fb06806d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:45.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.416+0000 7fb063fff700 1 -- 172.21.15.84:0/2020823062 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb06c089880 con 0x7fb07c0adea0 2023-07-14T11:19:45.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.417+0000 7fb07affd700 1 --2- 172.21.15.84:0/2020823062 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fb06806ae90 0x7fb06806d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:45.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.418+0000 7fb07affd700 1 --2- 172.21.15.84:0/2020823062 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fb06806ae90 0x7fb06806d340 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb07c155fa0 tx=0x7fb070008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:45.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.421+0000 7fb063fff700 1 -- 172.21.15.84:0/2020823062 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fb06c054740 con 0x7fb07c0adea0 2023-07-14T11:19:45.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.614+0000 7fb081bff700 1 -- 172.21.15.84:0/2020823062 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb07c074350 con 0x7fb07c0adea0 2023-07-14T11:19:45.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.615+0000 7fb063fff700 1 -- 172.21.15.84:0/2020823062 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v106) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb06c057d60 con 0x7fb07c0adea0 2023-07-14T11:19:45.619 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-07-14T11:19:45.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.617+0000 7fb081bff700 1 -- 172.21.15.84:0/2020823062 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fb06806ae90 msgr2=0x7fb06806d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:45.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.617+0000 7fb081bff700 1 --2- 172.21.15.84:0/2020823062 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fb06806ae90 0x7fb06806d340 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb07c155fa0 tx=0x7fb070008040 comp rx=0 tx=0).stop 2023-07-14T11:19:45.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.617+0000 7fb081bff700 1 -- 172.21.15.84:0/2020823062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb07c0adea0 msgr2=0x7fb07c149090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:45.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.617+0000 7fb081bff700 1 --2- 172.21.15.84:0/2020823062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb07c0adea0 0x7fb07c149090 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7fb06c00e9b0 tx=0x7fb06c00ed70 comp rx=0 tx=0).stop 2023-07-14T11:19:45.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.617+0000 7fb081bff700 1 -- 172.21.15.84:0/2020823062 shutdown_connections 2023-07-14T11:19:45.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.617+0000 7fb081bff700 1 --2- 172.21.15.84:0/2020823062 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fb06806ae90 0x7fb06806d340 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:45.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.617+0000 7fb081bff700 1 --2- 172.21.15.84:0/2020823062 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb07c0c92d0 0x7fb07c0ad400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:45.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.617+0000 7fb081bff700 1 --2- 172.21.15.84:0/2020823062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb07c0adea0 0x7fb07c149090 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:45.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.617+0000 7fb081bff700 1 --2- 172.21.15.84:0/2020823062 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb07c0b12f0 0x7fb07c06fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:45.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.617+0000 7fb081bff700 1 -- 172.21.15.84:0/2020823062 >> 172.21.15.84:0/2020823062 conn(0x7fb07c0b05d0 msgr2=0x7fb07c0cb2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:45.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.618+0000 7fb081bff700 1 -- 172.21.15.84:0/2020823062 shutdown_connections 2023-07-14T11:19:45.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.618+0000 7fb081bff700 1 -- 172.21.15.84:0/2020823062 wait complete. 2023-07-14T11:19:45.639 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-14T11:19:45.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.831+0000 7f88421ff700 1 Processor -- start 2023-07-14T11:19:45.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.832+0000 7f88421ff700 1 -- start start 2023-07-14T11:19:45.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.833+0000 7f88421ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f883c0b4860 0x7f883c0b4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:45.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.833+0000 7f88421ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f883c0d02a0 con 0x7f883c0b8660 2023-07-14T11:19:45.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.833+0000 7f88421ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f883c0cfce0 con 0x7f883c0d12c0 2023-07-14T11:19:45.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.833+0000 7f88421ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f883c0b5210 con 0x7f883c0b4860 2023-07-14T11:19:45.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.833+0000 7f883b7fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f883c0b8660 0x7f883c0cd430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53064/0 (socket says 172.21.15.84:53064) 2023-07-14T11:19:45.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.833+0000 7f883b7fe700 1 -- 172.21.15.84:0/84908814 learned_addr learned my addr 172.21.15.84:0/84908814 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:19:45.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.833+0000 7f883affd700 1 --2- 172.21.15.84:0/84908814 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f883c0b4860 0x7f883c0b4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:45.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.834+0000 7f883a7fc700 1 -- 172.21.15.84:0/84908814 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 545745118 0 0) 0x7f883c0d02a0 con 0x7f883c0b8660 2023-07-14T11:19:45.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.834+0000 7f883a7fc700 1 -- 172.21.15.84:0/84908814 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88240035b0 con 0x7f883c0b8660 2023-07-14T11:19:45.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.834+0000 7f883a7fc700 1 -- 172.21.15.84:0/84908814 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3170760526 0 0) 0x7f883c0cfce0 con 0x7f883c0d12c0 2023-07-14T11:19:45.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.834+0000 7f883a7fc700 1 -- 172.21.15.84:0/84908814 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f883c0d02a0 con 0x7f883c0d12c0 2023-07-14T11:19:45.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.834+0000 7f883affd700 1 -- 172.21.15.84:0/84908814 >> v1:172.21.15.179:6789/0 conn(0x7f883c0d12c0 legacy=0x7f883c0d1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:45.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.834+0000 7f883affd700 1 -- 172.21.15.84:0/84908814 >> v1:172.21.15.84:6789/0 conn(0x7f883c0b8660 legacy=0x7f883c0cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:45.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.834+0000 7f883affd700 1 -- 172.21.15.84:0/84908814 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f883c0cffc0 con 0x7f883c0b4860 2023-07-14T11:19:45.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.834+0000 7f883affd700 1 --2- 172.21.15.84:0/84908814 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f883c0b4860 0x7f883c0b4cd0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8830009870 tx=0x7f8830009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7197ff7e9daf52d4 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:45.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.834+0000 7f883a7fc700 1 -- 172.21.15.84:0/84908814 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8830011830 con 0x7f883c0b4860 2023-07-14T11:19:45.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.834+0000 7f883a7fc700 1 -- 172.21.15.84:0/84908814 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8830011990 con 0x7f883c0b4860 2023-07-14T11:19:45.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.834+0000 7f883a7fc700 1 -- 172.21.15.84:0/84908814 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8830011d00 con 0x7f883c0b4860 2023-07-14T11:19:45.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.835+0000 7f88421ff700 1 -- 172.21.15.84:0/84908814 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f883c0b4860 msgr2=0x7f883c0b4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:45.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.835+0000 7f88421ff700 1 --2- 172.21.15.84:0/84908814 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f883c0b4860 0x7f883c0b4cd0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8830009870 tx=0x7f8830009b80 comp rx=0 tx=0).stop 2023-07-14T11:19:45.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.835+0000 7f88421ff700 1 -- 172.21.15.84:0/84908814 shutdown_connections 2023-07-14T11:19:45.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.835+0000 7f88421ff700 1 --2- 172.21.15.84:0/84908814 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f883c0b4860 0x7f883c0b4cd0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:45.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.835+0000 7f88421ff700 1 -- 172.21.15.84:0/84908814 >> 172.21.15.84:0/84908814 conn(0x7f883c066860 msgr2=0x7f883c06a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:45.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.835+0000 7f88421ff700 1 -- 172.21.15.84:0/84908814 shutdown_connections 2023-07-14T11:19:45.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.835+0000 7f88421ff700 1 -- 172.21.15.84:0/84908814 wait complete. 2023-07-14T11:19:45.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.837+0000 7f88421ff700 1 Processor -- start 2023-07-14T11:19:45.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.837+0000 7f88421ff700 1 -- start start 2023-07-14T11:19:45.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.838+0000 7f88421ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f883c0b4860 0x7f883c0c96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:45.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.838+0000 7f88421ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f883c0b8660 0x7f883c0cb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:45.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.838+0000 7f88421ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f883c0d12c0 0x7f883c159300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:45.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.838+0000 7f88421ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f883c1e18d0 con 0x7f883c0d12c0 2023-07-14T11:19:45.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.838+0000 7f88421ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f883c15a790 con 0x7f883c0b4860 2023-07-14T11:19:45.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.838+0000 7f88421ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f883c0cb3e0 con 0x7f883c0b8660 2023-07-14T11:19:45.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.838+0000 7f883bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f883c0d12c0 0x7f883c159300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:45.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.838+0000 7f883bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f883c0d12c0 0x7f883c159300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36452/0 (socket says 172.21.15.84:36452) 2023-07-14T11:19:45.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.838+0000 7f883bfff700 1 -- 172.21.15.84:0/4255542810 learned_addr learned my addr 172.21.15.84:0/4255542810 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:45.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.838+0000 7f883b7fe700 1 --2- 172.21.15.84:0/4255542810 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f883c0b4860 0x7f883c0c96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:45.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.839+0000 7f883bfff700 1 -- 172.21.15.84:0/4255542810 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f883c0b8660 msgr2=0x7f883c0cb8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:45.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.839+0000 7f883affd700 1 --2- 172.21.15.84:0/4255542810 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f883c0b8660 0x7f883c0cb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:45.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.839+0000 7f883bfff700 1 --2- 172.21.15.84:0/4255542810 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f883c0b8660 0x7f883c0cb8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:45.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.839+0000 7f883bfff700 1 -- 172.21.15.84:0/4255542810 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f883c0b4860 msgr2=0x7f883c0c96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:45.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.839+0000 7f883bfff700 1 --2- 172.21.15.84:0/4255542810 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f883c0b4860 0x7f883c0c96c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:45.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.839+0000 7f883bfff700 1 -- 172.21.15.84:0/4255542810 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88300094a0 con 0x7f883c0d12c0 2023-07-14T11:19:45.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.839+0000 7f883b7fe700 1 --2- 172.21.15.84:0/4255542810 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f883c0b4860 0x7f883c0c96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:19:45.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.839+0000 7f883affd700 1 --2- 172.21.15.84:0/4255542810 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f883c0b8660 0x7f883c0cb8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:19:45.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.839+0000 7f883bfff700 1 --2- 172.21.15.84:0/4255542810 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f883c0d12c0 0x7f883c159300 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f883400cbc0 tx=0x7f883400cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:45.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.839+0000 7f8823fff700 1 -- 172.21.15.84:0/4255542810 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8834003c00 con 0x7f883c0d12c0 2023-07-14T11:19:45.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.839+0000 7f8823fff700 1 -- 172.21.15.84:0/4255542810 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8834003d60 con 0x7f883c0d12c0 2023-07-14T11:19:45.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.839+0000 7f8823fff700 1 -- 172.21.15.84:0/4255542810 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883400abb0 con 0x7f883c0d12c0 2023-07-14T11:19:45.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.839+0000 7f88421ff700 1 -- 172.21.15.84:0/4255542810 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f883c0c9c00 con 0x7f883c0d12c0 2023-07-14T11:19:45.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.839+0000 7f88421ff700 1 -- 172.21.15.84:0/4255542810 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f883c0ca900 con 0x7f883c0d12c0 2023-07-14T11:19:45.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.840+0000 7f88421ff700 1 -- 172.21.15.84:0/4255542810 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f883c074350 con 0x7f883c0d12c0 2023-07-14T11:19:45.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.841+0000 7f8823fff700 1 -- 172.21.15.84:0/4255542810 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f883400ad10 con 0x7f883c0d12c0 2023-07-14T11:19:45.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.842+0000 7f8823fff700 1 --2- 172.21.15.84:0/4255542810 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f882806ae90 0x7f882806d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:45.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.842+0000 7f8823fff700 1 -- 172.21.15.84:0/4255542810 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8834089a30 con 0x7f883c0d12c0 2023-07-14T11:19:45.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.843+0000 7f883b7fe700 1 --2- 172.21.15.84:0/4255542810 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f882806ae90 0x7f882806d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:45.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.843+0000 7f883b7fe700 1 --2- 172.21.15.84:0/4255542810 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f882806ae90 0x7f882806d340 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f882c0011e0 tx=0x7f882c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:45.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:45.846+0000 7f8823fff700 1 -- 172.21.15.84:0/4255542810 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f8834054730 con 0x7f883c0d12c0 2023-07-14T11:19:46.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.060+0000 7f88421ff700 1 -- 172.21.15.84:0/4255542810 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f883c0cdb10 con 0x7f883c0d12c0 2023-07-14T11:19:46.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.060+0000 7f8823fff700 1 -- 172.21.15.84:0/4255542810 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v106) v1 ==== 80+0+0 (secure 0 0 0) 0x7f8834057d50 con 0x7f883c0d12c0 2023-07-14T11:19:46.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.063+0000 7f88421ff700 1 -- 172.21.15.84:0/4255542810 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f882806ae90 msgr2=0x7f882806d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:46.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.063+0000 7f88421ff700 1 --2- 172.21.15.84:0/4255542810 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f882806ae90 0x7f882806d340 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f882c0011e0 tx=0x7f882c009040 comp rx=0 tx=0).stop 2023-07-14T11:19:46.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.063+0000 7f88421ff700 1 -- 172.21.15.84:0/4255542810 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f883c0d12c0 msgr2=0x7f883c159300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:46.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.063+0000 7f88421ff700 1 --2- 172.21.15.84:0/4255542810 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f883c0d12c0 0x7f883c159300 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f883400cbc0 tx=0x7f883400cf80 comp rx=0 tx=0).stop 2023-07-14T11:19:46.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.063+0000 7f88421ff700 1 -- 172.21.15.84:0/4255542810 shutdown_connections 2023-07-14T11:19:46.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.063+0000 7f88421ff700 1 --2- 172.21.15.84:0/4255542810 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f883c0d12c0 0x7f883c159300 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:46.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.063+0000 7f88421ff700 1 --2- 172.21.15.84:0/4255542810 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f883c0b4860 0x7f883c0c96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:46.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.063+0000 7f88421ff700 1 --2- 172.21.15.84:0/4255542810 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f882806ae90 0x7f882806d340 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:46.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.063+0000 7f88421ff700 1 --2- 172.21.15.84:0/4255542810 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f883c0b8660 0x7f883c0cb8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:46.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.063+0000 7f88421ff700 1 -- 172.21.15.84:0/4255542810 >> 172.21.15.84:0/4255542810 conn(0x7f883c066860 msgr2=0x7f883c0d2e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:46.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.063+0000 7f88421ff700 1 -- 172.21.15.84:0/4255542810 shutdown_connections 2023-07-14T11:19:46.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.063+0000 7f88421ff700 1 -- 172.21.15.84:0/4255542810 wait complete. 2023-07-14T11:19:46.068 INFO:teuthology.orchestra.run.smithi084.stderr:listed 0 entries 2023-07-14T11:19:46.084 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-14T11:19:46.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:19:46.085 DEBUG:teuthology.orchestra.run.smithi084:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-14T11:19:46.201 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi084.front.sepia.ceph.com 2023-07-14T11:19:46.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:19:46.202 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-14T11:19:46.251 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-07-14T11:19:46.251 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:19:46.299 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-07-14T11:19:46.300 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:19:46.386 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:19:46.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.578+0000 7f50c1dff700 1 Processor -- start 2023-07-14T11:19:46.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.578+0000 7f50c1dff700 1 -- start start 2023-07-14T11:19:46.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.579+0000 7f50c1dff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f50bc15c710 0x7f50bc0cf510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:46.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.579+0000 7f50c1dff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f50bc069f30 0x7f50bc06a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:46.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.579+0000 7f50c1dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50bc06d420 0x7f50bc06d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:46.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.579+0000 7f50c1dff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50bc06dde0 con 0x7f50bc069f30 2023-07-14T11:19:46.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.579+0000 7f50c1dff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50bc0cd320 con 0x7f50bc15c710 2023-07-14T11:19:46.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.579+0000 7f50c1dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50bc0ce750 con 0x7f50bc06d420 2023-07-14T11:19:46.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.580+0000 7f50baffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f50bc069f30 0x7f50bc06a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:46.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.580+0000 7f50baffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f50bc069f30 0x7f50bc06a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36468/0 (socket says 172.21.15.84:36468) 2023-07-14T11:19:46.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.580+0000 7f50baffd700 1 -- 172.21.15.84:0/699810468 learned_addr learned my addr 172.21.15.84:0/699810468 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:46.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.580+0000 7f50bbfff700 1 --2- 172.21.15.84:0/699810468 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50bc06d420 0x7f50bc06d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:46.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.580+0000 7f50bb7fe700 1 --2- 172.21.15.84:0/699810468 >> v2:172.21.15.179:3300/0 conn(0x7f50bc15c710 0x7f50bc0cf510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:46.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.580+0000 7f50baffd700 1 -- 172.21.15.84:0/699810468 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50bc06d420 msgr2=0x7f50bc06d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:46.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.580+0000 7f50baffd700 1 --2- 172.21.15.84:0/699810468 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50bc06d420 0x7f50bc06d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:46.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.580+0000 7f50baffd700 1 -- 172.21.15.84:0/699810468 >> v2:172.21.15.179:3300/0 conn(0x7f50bc15c710 msgr2=0x7f50bc0cf510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:46.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.580+0000 7f50baffd700 1 --2- 172.21.15.84:0/699810468 >> v2:172.21.15.179:3300/0 conn(0x7f50bc15c710 0x7f50bc0cf510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:46.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.580+0000 7f50baffd700 1 -- 172.21.15.84:0/699810468 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50bc0cea30 con 0x7f50bc069f30 2023-07-14T11:19:46.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.580+0000 7f50baffd700 1 --2- 172.21.15.84:0/699810468 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50bc069f30 0x7f50bc06a3a0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f50bc072690 tx=0x7f50b0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=183e51c8e5ddd99f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:46.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.581+0000 7f50ba7fc700 1 -- 172.21.15.84:0/699810468 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b0011830 con 0x7f50bc069f30 2023-07-14T11:19:46.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.581+0000 7f50ba7fc700 1 -- 172.21.15.84:0/699810468 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50b0011990 con 0x7f50bc069f30 2023-07-14T11:19:46.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.581+0000 7f50ba7fc700 1 -- 172.21.15.84:0/699810468 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b0011d20 con 0x7f50bc069f30 2023-07-14T11:19:46.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.581+0000 7f50c1dff700 1 -- 172.21.15.84:0/699810468 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50bc069f30 msgr2=0x7f50bc06a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:46.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.581+0000 7f50c1dff700 1 --2- 172.21.15.84:0/699810468 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50bc069f30 0x7f50bc06a3a0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f50bc072690 tx=0x7f50b0009bd0 comp rx=0 tx=0).stop 2023-07-14T11:19:46.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.581+0000 7f50c1dff700 1 -- 172.21.15.84:0/699810468 shutdown_connections 2023-07-14T11:19:46.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.581+0000 7f50c1dff700 1 --2- 172.21.15.84:0/699810468 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50bc06d420 0x7f50bc06d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:46.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.581+0000 7f50c1dff700 1 --2- 172.21.15.84:0/699810468 >> v2:172.21.15.179:3300/0 conn(0x7f50bc15c710 0x7f50bc0cf510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:46.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.581+0000 7f50c1dff700 1 --2- 172.21.15.84:0/699810468 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50bc069f30 0x7f50bc06a3a0 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:46.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.581+0000 7f50c1dff700 1 -- 172.21.15.84:0/699810468 >> 172.21.15.84:0/699810468 conn(0x7f50bc0b16c0 msgr2=0x7f50bc0b1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:46.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.581+0000 7f50c1dff700 1 -- 172.21.15.84:0/699810468 shutdown_connections 2023-07-14T11:19:46.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.581+0000 7f50c1dff700 1 -- 172.21.15.84:0/699810468 wait complete. 2023-07-14T11:19:46.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.583+0000 7f50c1dff700 1 Processor -- start 2023-07-14T11:19:46.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.583+0000 7f50c1dff700 1 -- start start 2023-07-14T11:19:46.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.584+0000 7f50c1dff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50bc069f30 0x7f50bc15cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:46.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.584+0000 7f50c1dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50bc06d420 0x7f50bc15daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:46.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.584+0000 7f50c1dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50bc15e030 0x7f50bc1498c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:46.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.584+0000 7f50c1dff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50bc14dbb0 con 0x7f50bc069f30 2023-07-14T11:19:46.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.584+0000 7f50c1dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50bc0b2b40 con 0x7f50bc06d420 2023-07-14T11:19:46.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.584+0000 7f50c1dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50bc0b2e20 con 0x7f50bc15e030 2023-07-14T11:19:46.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.584+0000 7f50bb7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50bc069f30 0x7f50bc15cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:46.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.584+0000 7f50bb7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50bc069f30 0x7f50bc15cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36478/0 (socket says 172.21.15.84:36478) 2023-07-14T11:19:46.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.585+0000 7f50bb7fe700 1 -- 172.21.15.84:0/1224328708 learned_addr learned my addr 172.21.15.84:0/1224328708 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:46.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.585+0000 7f50baffd700 1 --2- 172.21.15.84:0/1224328708 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50bc06d420 0x7f50bc15daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:46.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.585+0000 7f50bbfff700 1 --2- 172.21.15.84:0/1224328708 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50bc15e030 0x7f50bc1498c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:46.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.585+0000 7f50bb7fe700 1 -- 172.21.15.84:0/1224328708 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50bc15e030 msgr2=0x7f50bc1498c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:46.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.585+0000 7f50bb7fe700 1 --2- 172.21.15.84:0/1224328708 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50bc15e030 0x7f50bc1498c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:46.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.585+0000 7f50bb7fe700 1 -- 172.21.15.84:0/1224328708 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50bc06d420 msgr2=0x7f50bc15daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:46.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.585+0000 7f50bb7fe700 1 --2- 172.21.15.84:0/1224328708 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50bc06d420 0x7f50bc15daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:46.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.585+0000 7f50bb7fe700 1 -- 172.21.15.84:0/1224328708 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b0009550 con 0x7f50bc069f30 2023-07-14T11:19:46.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.585+0000 7f50bb7fe700 1 --2- 172.21.15.84:0/1224328708 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50bc069f30 0x7f50bc15cd60 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f50ac00e870 tx=0x7f50ac00eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:46.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.585+0000 7f50a3fff700 1 -- 172.21.15.84:0/1224328708 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50ac009590 con 0x7f50bc069f30 2023-07-14T11:19:46.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.585+0000 7f50a3fff700 1 -- 172.21.15.84:0/1224328708 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50ac013680 con 0x7f50bc069f30 2023-07-14T11:19:46.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.585+0000 7f50a3fff700 1 -- 172.21.15.84:0/1224328708 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50ac0139f0 con 0x7f50bc069f30 2023-07-14T11:19:46.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.585+0000 7f50c1dff700 1 -- 172.21.15.84:0/1224328708 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50bc0b3100 con 0x7f50bc069f30 2023-07-14T11:19:46.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.586+0000 7f50c1dff700 1 -- 172.21.15.84:0/1224328708 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50bc0b36c0 con 0x7f50bc069f30 2023-07-14T11:19:46.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.587+0000 7f50c1dff700 1 -- 172.21.15.84:0/1224328708 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50bc0b3a30 con 0x7f50bc069f30 2023-07-14T11:19:46.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.587+0000 7f50a3fff700 1 -- 172.21.15.84:0/1224328708 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f50ac013b50 con 0x7f50bc069f30 2023-07-14T11:19:46.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.588+0000 7f50a3fff700 1 --2- 172.21.15.84:0/1224328708 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f50a806ae90 0x7f50a806d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:46.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.588+0000 7f50a3fff700 1 -- 172.21.15.84:0/1224328708 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f50ac089700 con 0x7f50bc069f30 2023-07-14T11:19:46.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.589+0000 7f50baffd700 1 --2- 172.21.15.84:0/1224328708 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f50a806ae90 0x7f50a806d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:46.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.589+0000 7f50baffd700 1 --2- 172.21.15.84:0/1224328708 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f50a806ae90 0x7f50a806d340 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f50b0009c10 tx=0x7f50b0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:46.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.593+0000 7f50a3fff700 1 -- 172.21.15.84:0/1224328708 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f50ac054490 con 0x7f50bc069f30 2023-07-14T11:19:46.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.786+0000 7f50c1dff700 1 -- 172.21.15.84:0/1224328708 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f50bc070370 con 0x7f50bc069f30 2023-07-14T11:19:46.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.788+0000 7f50a3fff700 1 -- 172.21.15.84:0/1224328708 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v106) v1 ==== 74+0+18337 (secure 0 0 0) 0x7f50ac057ab0 con 0x7f50bc069f30 2023-07-14T11:19:46.792 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:19:46.792 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":106,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:19:25.959900+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-07-14T11:19:22.615201+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-07-14T11:19:23.416792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:19:46.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.790+0000 7f50c1dff700 1 -- 172.21.15.84:0/1224328708 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f50a806ae90 msgr2=0x7f50a806d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:46.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.790+0000 7f50c1dff700 1 --2- 172.21.15.84:0/1224328708 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f50a806ae90 0x7f50a806d340 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f50b0009c10 tx=0x7f50b0008030 comp rx=0 tx=0).stop 2023-07-14T11:19:46.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.790+0000 7f50c1dff700 1 -- 172.21.15.84:0/1224328708 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50bc069f30 msgr2=0x7f50bc15cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:46.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.790+0000 7f50c1dff700 1 --2- 172.21.15.84:0/1224328708 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50bc069f30 0x7f50bc15cd60 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f50ac00e870 tx=0x7f50ac00eb80 comp rx=0 tx=0).stop 2023-07-14T11:19:46.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.790+0000 7f50c1dff700 1 -- 172.21.15.84:0/1224328708 shutdown_connections 2023-07-14T11:19:46.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.790+0000 7f50c1dff700 1 --2- 172.21.15.84:0/1224328708 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f50a806ae90 0x7f50a806d340 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:46.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.790+0000 7f50c1dff700 1 --2- 172.21.15.84:0/1224328708 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50bc15e030 0x7f50bc1498c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:46.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.790+0000 7f50c1dff700 1 --2- 172.21.15.84:0/1224328708 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50bc069f30 0x7f50bc15cd60 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:46.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.790+0000 7f50c1dff700 1 --2- 172.21.15.84:0/1224328708 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50bc06d420 0x7f50bc15daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:46.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.790+0000 7f50c1dff700 1 -- 172.21.15.84:0/1224328708 >> 172.21.15.84:0/1224328708 conn(0x7f50bc0b16c0 msgr2=0x7f50bc070df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:46.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.790+0000 7f50c1dff700 1 -- 172.21.15.84:0/1224328708 shutdown_connections 2023-07-14T11:19:46.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:46.790+0000 7f50c1dff700 1 -- 172.21.15.84:0/1224328708 wait complete. 2023-07-14T11:19:46.811 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T11:13:00.125395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T11:13:06.803994+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T11:19:22.615201+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '105', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T11:19:23.416792+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '106', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T11:19:46.812 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T11:19:47.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.010+0000 7feeb5bff700 1 Processor -- start 2023-07-14T11:19:47.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.010+0000 7feeb5bff700 1 -- start start 2023-07-14T11:19:47.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.011+0000 7feeb5bff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7feeb00b4d00 0x7feeb00d19d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:47.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.011+0000 7feeb5bff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeb00d02a0 con 0x7feeb00b4860 2023-07-14T11:19:47.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.011+0000 7feeb5bff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeb00cfce0 con 0x7feeb00b8660 2023-07-14T11:19:47.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.011+0000 7feeb5bff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeb00cffc0 con 0x7feeb00b4d00 2023-07-14T11:19:47.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.011+0000 7feeaeffd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7feeb00b4860 0x7feeb00d12c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53072/0 (socket says 172.21.15.84:53072) 2023-07-14T11:19:47.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.011+0000 7feeaeffd700 1 -- 172.21.15.84:0/2015567705 learned_addr learned my addr 172.21.15.84:0/2015567705 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:19:47.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.011+0000 7feeaffff700 1 --2- 172.21.15.84:0/2015567705 >> v2:172.21.15.179:3300/0 conn(0x7feeb00b4d00 0x7feeb00d19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:47.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.012+0000 7feeae7fc700 1 -- 172.21.15.84:0/2015567705 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2829295492 0 0) 0x7feeb00d02a0 con 0x7feeb00b4860 2023-07-14T11:19:47.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.012+0000 7feeae7fc700 1 -- 172.21.15.84:0/2015567705 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee980035b0 con 0x7feeb00b4860 2023-07-14T11:19:47.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.012+0000 7feeaffff700 1 -- 172.21.15.84:0/2015567705 >> v1:172.21.15.179:6789/0 conn(0x7feeb00b8660 legacy=0x7feeb00cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:47.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.012+0000 7feeae7fc700 1 -- 172.21.15.84:0/2015567705 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 945683031 0 0) 0x7fee980035b0 con 0x7feeb00b4860 2023-07-14T11:19:47.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.012+0000 7feeaffff700 1 -- 172.21.15.84:0/2015567705 >> v1:172.21.15.84:6789/0 conn(0x7feeb00b4860 legacy=0x7feeb00d12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:47.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.012+0000 7feeaffff700 1 -- 172.21.15.84:0/2015567705 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb00d0ac0 con 0x7feeb00b4d00 2023-07-14T11:19:47.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.012+0000 7feeaffff700 1 --2- 172.21.15.84:0/2015567705 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feeb00b4d00 0x7feeb00d19d0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7feea8009d90 tx=0x7feea800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61bd725132442aea server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:47.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.012+0000 7feeae7fc700 1 -- 172.21.15.84:0/2015567705 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea800e070 con 0x7feeb00b4d00 2023-07-14T11:19:47.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.013+0000 7feeae7fc700 1 -- 172.21.15.84:0/2015567705 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea8003a20 con 0x7feeb00b4d00 2023-07-14T11:19:47.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.013+0000 7feeae7fc700 1 -- 172.21.15.84:0/2015567705 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea4001670 con 0x7feeb00b4d00 2023-07-14T11:19:47.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.013+0000 7feeb5bff700 1 -- 172.21.15.84:0/2015567705 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feeb00b4d00 msgr2=0x7feeb00d19d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:47.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.013+0000 7feeb5bff700 1 --2- 172.21.15.84:0/2015567705 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feeb00b4d00 0x7feeb00d19d0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7feea8009d90 tx=0x7feea800b330 comp rx=0 tx=0).stop 2023-07-14T11:19:47.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.013+0000 7feeb5bff700 1 -- 172.21.15.84:0/2015567705 shutdown_connections 2023-07-14T11:19:47.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.013+0000 7feeb5bff700 1 --2- 172.21.15.84:0/2015567705 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feeb00b4d00 0x7feeb00d19d0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:47.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.013+0000 7feeb5bff700 1 -- 172.21.15.84:0/2015567705 >> 172.21.15.84:0/2015567705 conn(0x7feeb0066860 msgr2=0x7feeb006a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:47.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.013+0000 7feeb5bff700 1 -- 172.21.15.84:0/2015567705 shutdown_connections 2023-07-14T11:19:47.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.013+0000 7feeb5bff700 1 -- 172.21.15.84:0/2015567705 wait complete. 2023-07-14T11:19:47.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.015+0000 7feeb5bff700 1 Processor -- start 2023-07-14T11:19:47.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.015+0000 7feeb5bff700 1 -- start start 2023-07-14T11:19:47.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.016+0000 7feeb5bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feeb00b4860 0x7feeb015b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:47.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.016+0000 7feeb5bff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feeb00b4d00 0x7feeb00b6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:47.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.016+0000 7feeb5bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feeb00b8660 0x7feeb00b6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:47.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.016+0000 7feeb5bff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb00cd010 con 0x7feeb00b4d00 2023-07-14T11:19:47.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.016+0000 7feeb5bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb015b8b0 con 0x7feeb00b4860 2023-07-14T11:19:47.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.016+0000 7feeb5bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeb01f2fe0 con 0x7feeb00b8660 2023-07-14T11:19:47.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.016+0000 7feeaeffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feeb00b4d00 0x7feeb00b6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:47.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.016+0000 7feeaeffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feeb00b4d00 0x7feeb00b6aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36494/0 (socket says 172.21.15.84:36494) 2023-07-14T11:19:47.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.016+0000 7feeaeffd700 1 -- 172.21.15.84:0/1880363998 learned_addr learned my addr 172.21.15.84:0/1880363998 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:47.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.016+0000 7feeaf7fe700 1 --2- 172.21.15.84:0/1880363998 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feeb00b4860 0x7feeb015b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:47.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.016+0000 7feeaffff700 1 --2- 172.21.15.84:0/1880363998 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feeb00b8660 0x7feeb00b6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:47.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.017+0000 7feeaeffd700 1 -- 172.21.15.84:0/1880363998 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feeb00b8660 msgr2=0x7feeb00b6fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:47.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.017+0000 7feeaeffd700 1 --2- 172.21.15.84:0/1880363998 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feeb00b8660 0x7feeb00b6fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:47.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.017+0000 7feeaeffd700 1 -- 172.21.15.84:0/1880363998 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feeb00b4860 msgr2=0x7feeb015b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:47.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.017+0000 7feeaeffd700 1 --2- 172.21.15.84:0/1880363998 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feeb00b4860 0x7feeb015b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:47.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.017+0000 7feeaeffd700 1 -- 172.21.15.84:0/1880363998 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea8009a70 con 0x7feeb00b4d00 2023-07-14T11:19:47.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.017+0000 7feeaf7fe700 1 --2- 172.21.15.84:0/1880363998 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feeb00b4860 0x7feeb015b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:19:47.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.017+0000 7feeaeffd700 1 --2- 172.21.15.84:0/1880363998 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feeb00b4d00 0x7feeb00b6aa0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7feea40011e0 tx=0x7feea400ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:47.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.017+0000 7fee97fff700 1 -- 172.21.15.84:0/1880363998 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea4004c80 con 0x7feeb00b4d00 2023-07-14T11:19:47.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.017+0000 7fee97fff700 1 -- 172.21.15.84:0/1880363998 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea4004de0 con 0x7feeb00b4d00 2023-07-14T11:19:47.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.017+0000 7feeb5bff700 1 -- 172.21.15.84:0/1880363998 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeb01f2d00 con 0x7feeb00b4d00 2023-07-14T11:19:47.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.017+0000 7fee97fff700 1 -- 172.21.15.84:0/1880363998 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea40072d0 con 0x7feeb00b4d00 2023-07-14T11:19:47.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.017+0000 7feeb5bff700 1 -- 172.21.15.84:0/1880363998 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeb00c7160 con 0x7feeb00b4d00 2023-07-14T11:19:47.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.019+0000 7feeb5bff700 1 -- 172.21.15.84:0/1880363998 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeb0074350 con 0x7feeb00b4d00 2023-07-14T11:19:47.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.019+0000 7fee97fff700 1 -- 172.21.15.84:0/1880363998 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) v1 ==== 89190+0+0 (secure 0 0 0) 0x7feea4007430 con 0x7feeb00b4d00 2023-07-14T11:19:47.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.020+0000 7fee97fff700 1 --2- 172.21.15.84:0/1880363998 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fee9c06ae90 0x7fee9c06d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:47.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.020+0000 7fee97fff700 1 -- 172.21.15.84:0/1880363998 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7feea40895e0 con 0x7feeb00b4d00 2023-07-14T11:19:47.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.021+0000 7feeaf7fe700 1 --2- 172.21.15.84:0/1880363998 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fee9c06ae90 0x7fee9c06d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:47.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.021+0000 7feeaf7fe700 1 --2- 172.21.15.84:0/1880363998 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fee9c06ae90 0x7fee9c06d340 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7feea0007fd0 tx=0x7feea0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:47.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.025+0000 7fee97fff700 1 -- 172.21.15.84:0/1880363998 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7feea4054410 con 0x7feeb00b4d00 2023-07-14T11:19:47.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.219+0000 7feeb5bff700 1 -- 172.21.15.84:0/1880363998 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7feeb00b2150 con 0x7feeb00b4d00 2023-07-14T11:19:47.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.219+0000 7fee97fff700 1 -- 172.21.15.84:0/1880363998 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v106) v1 ==== 93+0+10 (secure 0 0 0) 0x7feea4057a30 con 0x7feeb00b4d00 2023-07-14T11:19:47.224 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-07-14T11:19:47.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.222+0000 7feeb5bff700 1 -- 172.21.15.84:0/1880363998 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fee9c06ae90 msgr2=0x7fee9c06d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:47.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.222+0000 7feeb5bff700 1 --2- 172.21.15.84:0/1880363998 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fee9c06ae90 0x7fee9c06d340 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7feea0007fd0 tx=0x7feea0009040 comp rx=0 tx=0).stop 2023-07-14T11:19:47.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.222+0000 7feeb5bff700 1 -- 172.21.15.84:0/1880363998 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feeb00b4d00 msgr2=0x7feeb00b6aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:47.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.222+0000 7feeb5bff700 1 --2- 172.21.15.84:0/1880363998 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feeb00b4d00 0x7feeb00b6aa0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7feea40011e0 tx=0x7feea400ca50 comp rx=0 tx=0).stop 2023-07-14T11:19:47.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.222+0000 7feeb5bff700 1 -- 172.21.15.84:0/1880363998 shutdown_connections 2023-07-14T11:19:47.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.222+0000 7feeb5bff700 1 --2- 172.21.15.84:0/1880363998 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fee9c06ae90 0x7fee9c06d340 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:47.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.222+0000 7feeb5bff700 1 --2- 172.21.15.84:0/1880363998 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feeb00b8660 0x7feeb00b6fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:47.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.222+0000 7feeb5bff700 1 --2- 172.21.15.84:0/1880363998 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feeb00b4860 0x7feeb015b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:47.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.222+0000 7feeb5bff700 1 --2- 172.21.15.84:0/1880363998 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feeb00b4d00 0x7feeb00b6aa0 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:47.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.222+0000 7feeb5bff700 1 -- 172.21.15.84:0/1880363998 >> 172.21.15.84:0/1880363998 conn(0x7feeb0066860 msgr2=0x7feeb00b3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:47.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.222+0000 7feeb5bff700 1 -- 172.21.15.84:0/1880363998 shutdown_connections 2023-07-14T11:19:47.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.222+0000 7feeb5bff700 1 -- 172.21.15.84:0/1880363998 wait complete. 2023-07-14T11:19:47.244 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T11:19:47.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.439+0000 7f03739ff700 1 Processor -- start 2023-07-14T11:19:47.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.439+0000 7f03739ff700 1 -- start start 2023-07-14T11:19:47.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.441+0000 7f03739ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f036c0b8660 0x7f036c0cd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:47.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.441+0000 7f03739ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f036c0cd970 0x7f036c0b4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:47.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.441+0000 7f03739ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f036c0d02a0 con 0x7f036c0b4da0 2023-07-14T11:19:47.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.441+0000 7f03739ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f036c0b51b0 con 0x7f036c0b8660 2023-07-14T11:19:47.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.441+0000 7f03739ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f036c0cfce0 con 0x7f036c0cd970 2023-07-14T11:19:47.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.441+0000 7f037179b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f036c0b8660 0x7f036c0cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:47.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.441+0000 7f037179b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f036c0b8660 0x7f036c0cd430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36506/0 (socket says 172.21.15.84:36506) 2023-07-14T11:19:47.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.441+0000 7f037179b700 1 -- 172.21.15.84:0/3078386181 learned_addr learned my addr 172.21.15.84:0/3078386181 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:47.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.441+0000 7f0370f9a700 1 --2- 172.21.15.84:0/3078386181 >> v2:172.21.15.179:3300/0 conn(0x7f036c0cd970 0x7f036c0b4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:47.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.442+0000 7f037179b700 1 -- 172.21.15.84:0/3078386181 >> v2:172.21.15.179:3300/0 conn(0x7f036c0cd970 msgr2=0x7f036c0b4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:47.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.442+0000 7f037179b700 1 --2- 172.21.15.84:0/3078386181 >> v2:172.21.15.179:3300/0 conn(0x7f036c0cd970 0x7f036c0b4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:47.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.442+0000 7f037179b700 1 -- 172.21.15.84:0/3078386181 >> v1:172.21.15.179:6789/0 conn(0x7f036c0b4da0 legacy=0x7f036c1601f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:47.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.442+0000 7f037179b700 1 -- 172.21.15.84:0/3078386181 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f036c0cffc0 con 0x7f036c0b8660 2023-07-14T11:19:47.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.442+0000 7f037179b700 1 --2- 172.21.15.84:0/3078386181 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f036c0b8660 0x7f036c0cd430 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f036c0d0600 tx=0x7f0368009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7ff6a72e350682b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:47.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.442+0000 7f0363fff700 1 -- 172.21.15.84:0/3078386181 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0368011830 con 0x7f036c0b8660 2023-07-14T11:19:47.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.442+0000 7f0363fff700 1 -- 172.21.15.84:0/3078386181 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0368011990 con 0x7f036c0b8660 2023-07-14T11:19:47.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.442+0000 7f0363fff700 1 -- 172.21.15.84:0/3078386181 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0368011d20 con 0x7f036c0b8660 2023-07-14T11:19:47.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.442+0000 7f03739ff700 1 -- 172.21.15.84:0/3078386181 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f036c0b8660 msgr2=0x7f036c0cd430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:47.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.442+0000 7f03739ff700 1 --2- 172.21.15.84:0/3078386181 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f036c0b8660 0x7f036c0cd430 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f036c0d0600 tx=0x7f0368009bd0 comp rx=0 tx=0).stop 2023-07-14T11:19:47.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.443+0000 7f03739ff700 1 -- 172.21.15.84:0/3078386181 shutdown_connections 2023-07-14T11:19:47.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.443+0000 7f03739ff700 1 --2- 172.21.15.84:0/3078386181 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f036c0b8660 0x7f036c0cd430 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:47.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.443+0000 7f03739ff700 1 --2- 172.21.15.84:0/3078386181 >> v2:172.21.15.179:3300/0 conn(0x7f036c0cd970 0x7f036c0b4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:47.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.443+0000 7f03739ff700 1 -- 172.21.15.84:0/3078386181 >> 172.21.15.84:0/3078386181 conn(0x7f036c066860 msgr2=0x7f036c06a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:47.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.443+0000 7f03739ff700 1 -- 172.21.15.84:0/3078386181 shutdown_connections 2023-07-14T11:19:47.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.443+0000 7f03739ff700 1 -- 172.21.15.84:0/3078386181 wait complete. 2023-07-14T11:19:47.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.444+0000 7f03739ff700 1 Processor -- start 2023-07-14T11:19:47.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.444+0000 7f03739ff700 1 -- start start 2023-07-14T11:19:47.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.445+0000 7f03739ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f036c0b4da0 0x7f036c1e7d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:47.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.445+0000 7f03739ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f036c0b8660 0x7f036c0b3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:47.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.445+0000 7f03739ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f036c0cd970 0x7f036c0d20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:47.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.445+0000 7f03739ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f036c1e6010 con 0x7f036c0b4da0 2023-07-14T11:19:47.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.445+0000 7f03739ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f036c1e7b70 con 0x7f036c0b8660 2023-07-14T11:19:47.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.445+0000 7f03739ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f036c1e5390 con 0x7f036c0cd970 2023-07-14T11:19:47.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.446+0000 7f037179b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f036c0b4da0 0x7f036c1e7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:47.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.446+0000 7f037179b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f036c0b4da0 0x7f036c1e7d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36512/0 (socket says 172.21.15.84:36512) 2023-07-14T11:19:47.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.446+0000 7f037179b700 1 -- 172.21.15.84:0/1890701745 learned_addr learned my addr 172.21.15.84:0/1890701745 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:47.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.446+0000 7f0370f9a700 1 --2- 172.21.15.84:0/1890701745 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f036c0b8660 0x7f036c0b3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:47.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.446+0000 7f0371f9c700 1 --2- 172.21.15.84:0/1890701745 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f036c0cd970 0x7f036c0d20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:47.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.446+0000 7f037179b700 1 -- 172.21.15.84:0/1890701745 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f036c0cd970 msgr2=0x7f036c0d20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:47.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.446+0000 7f037179b700 1 --2- 172.21.15.84:0/1890701745 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f036c0cd970 0x7f036c0d20c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:47.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.446+0000 7f037179b700 1 -- 172.21.15.84:0/1890701745 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f036c0b8660 msgr2=0x7f036c0b3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:47.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.446+0000 7f037179b700 1 --2- 172.21.15.84:0/1890701745 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f036c0b8660 0x7f036c0b3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:47.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.446+0000 7f037179b700 1 -- 172.21.15.84:0/1890701745 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0368009550 con 0x7f036c0b4da0 2023-07-14T11:19:47.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.446+0000 7f037179b700 1 --2- 172.21.15.84:0/1890701745 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f036c0b4da0 0x7f036c1e7d80 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f0368000c00 tx=0x7f0368004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:47.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.447+0000 7f0361ffb700 1 -- 172.21.15.84:0/1890701745 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0368004380 con 0x7f036c0b4da0 2023-07-14T11:19:47.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.447+0000 7f0361ffb700 1 -- 172.21.15.84:0/1890701745 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f036801f070 con 0x7f036c0b4da0 2023-07-14T11:19:47.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.447+0000 7f03739ff700 1 -- 172.21.15.84:0/1890701745 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f036c1e5670 con 0x7f036c0b4da0 2023-07-14T11:19:47.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.447+0000 7f0361ffb700 1 -- 172.21.15.84:0/1890701745 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03680036a0 con 0x7f036c0b4da0 2023-07-14T11:19:47.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.447+0000 7f03739ff700 1 -- 172.21.15.84:0/1890701745 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f036c1e5c30 con 0x7f036c0b4da0 2023-07-14T11:19:47.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.448+0000 7f03739ff700 1 -- 172.21.15.84:0/1890701745 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f036c074350 con 0x7f036c0b4da0 2023-07-14T11:19:47.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.449+0000 7f0361ffb700 1 -- 172.21.15.84:0/1890701745 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f0368021030 con 0x7f036c0b4da0 2023-07-14T11:19:47.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.449+0000 7f0361ffb700 1 --2- 172.21.15.84:0/1890701745 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f035006ae90 0x7f035006d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:47.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.450+0000 7f0361ffb700 1 -- 172.21.15.84:0/1890701745 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f036808ab30 con 0x7f036c0b4da0 2023-07-14T11:19:47.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.450+0000 7f0370f9a700 1 --2- 172.21.15.84:0/1890701745 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f035006ae90 0x7f035006d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:47.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.451+0000 7f0370f9a700 1 --2- 172.21.15.84:0/1890701745 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f035006ae90 0x7f035006d340 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f036c06a5c0 tx=0x7f035c009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:47.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.454+0000 7f0361ffb700 1 -- 172.21.15.84:0/1890701745 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f0368055970 con 0x7f036c0b4da0 2023-07-14T11:19:47.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.648+0000 7f03739ff700 1 -- 172.21.15.84:0/1890701745 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f036c0b2150 con 0x7f036c0b4da0 2023-07-14T11:19:47.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.648+0000 7f0361ffb700 1 -- 172.21.15.84:0/1890701745 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v106) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0368058f90 con 0x7f036c0b4da0 2023-07-14T11:19:47.652 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-07-14T11:19:47.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.650+0000 7f03739ff700 1 -- 172.21.15.84:0/1890701745 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f035006ae90 msgr2=0x7f035006d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:47.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.650+0000 7f03739ff700 1 --2- 172.21.15.84:0/1890701745 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f035006ae90 0x7f035006d340 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f036c06a5c0 tx=0x7f035c009210 comp rx=0 tx=0).stop 2023-07-14T11:19:47.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.650+0000 7f03739ff700 1 -- 172.21.15.84:0/1890701745 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f036c0b4da0 msgr2=0x7f036c1e7d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:47.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.650+0000 7f03739ff700 1 --2- 172.21.15.84:0/1890701745 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f036c0b4da0 0x7f036c1e7d80 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f0368000c00 tx=0x7f0368004750 comp rx=0 tx=0).stop 2023-07-14T11:19:47.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.650+0000 7f03739ff700 1 -- 172.21.15.84:0/1890701745 shutdown_connections 2023-07-14T11:19:47.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.650+0000 7f03739ff700 1 --2- 172.21.15.84:0/1890701745 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f035006ae90 0x7f035006d340 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:47.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.650+0000 7f03739ff700 1 --2- 172.21.15.84:0/1890701745 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f036c0cd970 0x7f036c0d20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:47.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.650+0000 7f03739ff700 1 --2- 172.21.15.84:0/1890701745 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f036c0b4da0 0x7f036c1e7d80 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:47.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.650+0000 7f03739ff700 1 --2- 172.21.15.84:0/1890701745 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f036c0b8660 0x7f036c0b3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:47.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.650+0000 7f03739ff700 1 -- 172.21.15.84:0/1890701745 >> 172.21.15.84:0/1890701745 conn(0x7f036c066860 msgr2=0x7f036c15ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:47.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.651+0000 7f03739ff700 1 -- 172.21.15.84:0/1890701745 shutdown_connections 2023-07-14T11:19:47.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.651+0000 7f03739ff700 1 -- 172.21.15.84:0/1890701745 wait complete. 2023-07-14T11:19:47.672 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T11:19:47.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.867+0000 7efcd53ff700 1 Processor -- start 2023-07-14T11:19:47.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.867+0000 7efcd53ff700 1 -- start start 2023-07-14T11:19:47.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.868+0000 7efcd53ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7efcd00b8a60 0x7efcd00b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:47.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.868+0000 7efcd53ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7efcd00b4530 0x7efcd00d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:47.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.868+0000 7efcd53ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcd00d1490 con 0x7efcd00d1050 2023-07-14T11:19:47.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.868+0000 7efcd53ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcd00b8e30 con 0x7efcd00b4530 2023-07-14T11:19:47.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.868+0000 7efcd53ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcd00b1e30 con 0x7efcd00b8a60 2023-07-14T11:19:47.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.868+0000 7efcce7fc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7efcd00b4530 0x7efcd00d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:47.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.868+0000 7efcce7fc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7efcd00b4530 0x7efcd00d0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36526/0 (socket says 172.21.15.84:36526) 2023-07-14T11:19:47.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.868+0000 7efcce7fc700 1 -- 172.21.15.84:0/4116404761 learned_addr learned my addr 172.21.15.84:0/4116404761 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:47.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.868+0000 7efcceffd700 1 --2- 172.21.15.84:0/4116404761 >> v2:172.21.15.179:3300/0 conn(0x7efcd00b8a60 0x7efcd00b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:47.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.869+0000 7efcce7fc700 1 -- 172.21.15.84:0/4116404761 >> v2:172.21.15.179:3300/0 conn(0x7efcd00b8a60 msgr2=0x7efcd00b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:47.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.869+0000 7efcce7fc700 1 --2- 172.21.15.84:0/4116404761 >> v2:172.21.15.179:3300/0 conn(0x7efcd00b8a60 0x7efcd00b3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:47.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.869+0000 7efcce7fc700 1 -- 172.21.15.84:0/4116404761 >> v1:172.21.15.179:6789/0 conn(0x7efcd00d1050 legacy=0x7efcd00b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:47.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.869+0000 7efcce7fc700 1 -- 172.21.15.84:0/4116404761 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcd00afaa0 con 0x7efcd00b4530 2023-07-14T11:19:47.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.869+0000 7efcce7fc700 1 --2- 172.21.15.84:0/4116404761 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efcd00b4530 0x7efcd00d0b10 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7efcd00b5b00 tx=0x7efcc4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3285bf6d0b9ed3a1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:47.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.869+0000 7efccdffb700 1 -- 172.21.15.84:0/4116404761 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc4011830 con 0x7efcd00b4530 2023-07-14T11:19:47.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.869+0000 7efccdffb700 1 -- 172.21.15.84:0/4116404761 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcc4011990 con 0x7efcd00b4530 2023-07-14T11:19:47.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.869+0000 7efccdffb700 1 -- 172.21.15.84:0/4116404761 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc4011d20 con 0x7efcd00b4530 2023-07-14T11:19:47.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.870+0000 7efcd53ff700 1 -- 172.21.15.84:0/4116404761 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efcd00b4530 msgr2=0x7efcd00d0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:47.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.870+0000 7efcd53ff700 1 --2- 172.21.15.84:0/4116404761 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efcd00b4530 0x7efcd00d0b10 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7efcd00b5b00 tx=0x7efcc4009bd0 comp rx=0 tx=0).stop 2023-07-14T11:19:47.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.870+0000 7efcd53ff700 1 -- 172.21.15.84:0/4116404761 shutdown_connections 2023-07-14T11:19:47.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.870+0000 7efcd53ff700 1 --2- 172.21.15.84:0/4116404761 >> v2:172.21.15.179:3300/0 conn(0x7efcd00b8a60 0x7efcd00b3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:47.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.870+0000 7efcd53ff700 1 --2- 172.21.15.84:0/4116404761 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efcd00b4530 0x7efcd00d0b10 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:47.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.870+0000 7efcd53ff700 1 -- 172.21.15.84:0/4116404761 >> 172.21.15.84:0/4116404761 conn(0x7efcd009c1b0 msgr2=0x7efcd00d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:47.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.870+0000 7efcd53ff700 1 -- 172.21.15.84:0/4116404761 shutdown_connections 2023-07-14T11:19:47.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.870+0000 7efcd53ff700 1 -- 172.21.15.84:0/4116404761 wait complete. 2023-07-14T11:19:47.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.872+0000 7efcd53ff700 1 Processor -- start 2023-07-14T11:19:47.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.872+0000 7efcd53ff700 1 -- start start 2023-07-14T11:19:47.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.873+0000 7efcd53ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efcd00b4530 0x7efcd00ca010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:47.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.873+0000 7efcd53ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efcd00b8a60 0x7efcd00cf720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:47.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.873+0000 7efcd53ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efcd00d1050 0x7efcd00cfc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:47.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.873+0000 7efcd53ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd015f590 con 0x7efcd00b8a60 2023-07-14T11:19:47.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.873+0000 7efcd53ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd015fac0 con 0x7efcd00b4530 2023-07-14T11:19:47.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.873+0000 7efcd53ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcd015f7e0 con 0x7efcd00d1050 2023-07-14T11:19:47.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.873+0000 7efcce7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efcd00b8a60 0x7efcd00cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:47.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.873+0000 7efcce7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efcd00b8a60 0x7efcd00cf720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36534/0 (socket says 172.21.15.84:36534) 2023-07-14T11:19:47.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.873+0000 7efcce7fc700 1 -- 172.21.15.84:0/3025622370 learned_addr learned my addr 172.21.15.84:0/3025622370 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:47.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.873+0000 7efcce7fc700 1 -- 172.21.15.84:0/3025622370 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efcd00d1050 msgr2=0x7efcd00cfc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:47.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.873+0000 7efcce7fc700 1 --2- 172.21.15.84:0/3025622370 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efcd00d1050 0x7efcd00cfc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:47.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.873+0000 7efcce7fc700 1 -- 172.21.15.84:0/3025622370 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efcd00b4530 msgr2=0x7efcd00ca010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:47.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.873+0000 7efcceffd700 1 --2- 172.21.15.84:0/3025622370 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efcd00b4530 0x7efcd00ca010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:47.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.873+0000 7efcce7fc700 1 --2- 172.21.15.84:0/3025622370 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efcd00b4530 0x7efcd00ca010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:47.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.873+0000 7efcce7fc700 1 -- 172.21.15.84:0/3025622370 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcc4009550 con 0x7efcd00b8a60 2023-07-14T11:19:47.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.874+0000 7efcceffd700 1 --2- 172.21.15.84:0/3025622370 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efcd00b4530 0x7efcd00ca010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:19:47.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.874+0000 7efcce7fc700 1 --2- 172.21.15.84:0/3025622370 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efcd00b8a60 0x7efcd00cf720 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7efcc4009c10 tx=0x7efcc4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:47.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.874+0000 7efcb77fe700 1 -- 172.21.15.84:0/3025622370 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc4004530 con 0x7efcd00b8a60 2023-07-14T11:19:47.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.874+0000 7efcb77fe700 1 -- 172.21.15.84:0/3025622370 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcc401f070 con 0x7efcd00b8a60 2023-07-14T11:19:47.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.874+0000 7efcb77fe700 1 -- 172.21.15.84:0/3025622370 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc40038e0 con 0x7efcd00b8a60 2023-07-14T11:19:47.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.874+0000 7efcd53ff700 1 -- 172.21.15.84:0/3025622370 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcd01f4000 con 0x7efcd00b8a60 2023-07-14T11:19:47.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.874+0000 7efcd53ff700 1 -- 172.21.15.84:0/3025622370 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcd00ca550 con 0x7efcd00b8a60 2023-07-14T11:19:47.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.875+0000 7efcd53ff700 1 -- 172.21.15.84:0/3025622370 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcd0074350 con 0x7efcd00b8a60 2023-07-14T11:19:47.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.876+0000 7efcb77fe700 1 -- 172.21.15.84:0/3025622370 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) v1 ==== 89190+0+0 (secure 0 0 0) 0x7efcc4021030 con 0x7efcd00b8a60 2023-07-14T11:19:47.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.877+0000 7efcb77fe700 1 --2- 172.21.15.84:0/3025622370 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7efcbc06ae90 0x7efcbc06d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:47.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.877+0000 7efcb77fe700 1 -- 172.21.15.84:0/3025622370 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efcc408ac90 con 0x7efcd00b8a60 2023-07-14T11:19:47.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.877+0000 7efcceffd700 1 --2- 172.21.15.84:0/3025622370 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7efcbc06ae90 0x7efcbc06d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:47.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.878+0000 7efcceffd700 1 --2- 172.21.15.84:0/3025622370 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7efcbc06ae90 0x7efcbc06d340 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7efcd015eb90 tx=0x7efcc0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:47.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:47.881+0000 7efcb77fe700 1 -- 172.21.15.84:0/3025622370 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7efcc4055bd0 con 0x7efcd00b8a60 2023-07-14T11:19:48.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.079+0000 7efcd53ff700 1 -- 172.21.15.84:0/3025622370 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7efcd00b4310 con 0x7efcd00b8a60 2023-07-14T11:19:48.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.080+0000 7efcb77fe700 1 -- 172.21.15.84:0/3025622370 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v106) v1 ==== 104+0+11 (secure 0 0 0) 0x7efcc4015020 con 0x7efcd00b8a60 2023-07-14T11:19:48.084 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-07-14T11:19:48.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.082+0000 7efcd53ff700 1 -- 172.21.15.84:0/3025622370 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7efcbc06ae90 msgr2=0x7efcbc06d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:48.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.082+0000 7efcd53ff700 1 --2- 172.21.15.84:0/3025622370 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7efcbc06ae90 0x7efcbc06d340 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7efcd015eb90 tx=0x7efcc0008040 comp rx=0 tx=0).stop 2023-07-14T11:19:48.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.082+0000 7efcd53ff700 1 -- 172.21.15.84:0/3025622370 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efcd00b8a60 msgr2=0x7efcd00cf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:48.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.082+0000 7efcd53ff700 1 --2- 172.21.15.84:0/3025622370 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efcd00b8a60 0x7efcd00cf720 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7efcc4009c10 tx=0x7efcc4004750 comp rx=0 tx=0).stop 2023-07-14T11:19:48.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.083+0000 7efcd53ff700 1 -- 172.21.15.84:0/3025622370 shutdown_connections 2023-07-14T11:19:48.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.083+0000 7efcd53ff700 1 --2- 172.21.15.84:0/3025622370 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7efcbc06ae90 0x7efcbc06d340 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:48.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.083+0000 7efcd53ff700 1 --2- 172.21.15.84:0/3025622370 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efcd00d1050 0x7efcd00cfc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:48.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.083+0000 7efcd53ff700 1 --2- 172.21.15.84:0/3025622370 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efcd00b4530 0x7efcd00ca010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:48.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.083+0000 7efcd53ff700 1 --2- 172.21.15.84:0/3025622370 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efcd00b8a60 0x7efcd00cf720 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:48.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.083+0000 7efcd53ff700 1 -- 172.21.15.84:0/3025622370 >> 172.21.15.84:0/3025622370 conn(0x7efcd009c1b0 msgr2=0x7efcd00b7d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:48.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.083+0000 7efcd53ff700 1 -- 172.21.15.84:0/3025622370 shutdown_connections 2023-07-14T11:19:48.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.083+0000 7efcd53ff700 1 -- 172.21.15.84:0/3025622370 wait complete. 2023-07-14T11:19:48.104 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T11:19:48.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.299+0000 7f563a9ff700 1 Processor -- start 2023-07-14T11:19:48.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.299+0000 7f563a9ff700 1 -- start start 2023-07-14T11:19:48.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.300+0000 7f563a9ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f56340afc40 0x7f56340b2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:48.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.300+0000 7f563a9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f563406b8a0 0x7f563406bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:48.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.300+0000 7f563a9ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f563415ca90 con 0x7f563415c6c0 2023-07-14T11:19:48.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.300+0000 7f563a9ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f563406b0e0 con 0x7f56340afc40 2023-07-14T11:19:48.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.300+0000 7f563a9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56340d0370 con 0x7f563406b8a0 2023-07-14T11:19:48.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.301+0000 7f5633fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f563415c6c0 0x7f56340b2630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53074/0 (socket says 172.21.15.84:53074) 2023-07-14T11:19:48.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.301+0000 7f56337fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f56340afc40 0x7f56340b2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:48.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.301+0000 7f5633fff700 1 -- 172.21.15.84:0/1126119044 learned_addr learned my addr 172.21.15.84:0/1126119044 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:19:48.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.301+0000 7f5638f9c700 1 --2- 172.21.15.84:0/1126119044 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f563406b8a0 0x7f563406bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:48.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.301+0000 7f56337fe700 1 -- 172.21.15.84:0/1126119044 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f563406b8a0 msgr2=0x7f563406bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:48.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.301+0000 7f56337fe700 1 --2- 172.21.15.84:0/1126119044 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f563406b8a0 0x7f563406bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:48.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.301+0000 7f56337fe700 1 -- 172.21.15.84:0/1126119044 >> v1:172.21.15.84:6789/0 conn(0x7f563415c6c0 legacy=0x7f56340b2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:48.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.301+0000 7f56337fe700 1 -- 172.21.15.84:0/1126119044 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56340d0650 con 0x7f56340afc40 2023-07-14T11:19:48.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.301+0000 7f5632ffd700 1 -- 172.21.15.84:0/1126119044 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2653946866 0 0) 0x7f5624001110 con 0x7f563415c6c0 2023-07-14T11:19:48.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.301+0000 7f56337fe700 1 --2- 172.21.15.84:0/1126119044 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56340afc40 0x7f56340b2d40 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f5628009870 tx=0x7f5628009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24b7178a4df914d9 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:48.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.302+0000 7f5632ffd700 1 -- 172.21.15.84:0/1126119044 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5628011830 con 0x7f56340afc40 2023-07-14T11:19:48.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.302+0000 7f5632ffd700 1 -- 172.21.15.84:0/1126119044 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5628011990 con 0x7f56340afc40 2023-07-14T11:19:48.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.302+0000 7f5632ffd700 1 -- 172.21.15.84:0/1126119044 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5628011d20 con 0x7f56340afc40 2023-07-14T11:19:48.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.302+0000 7f563a9ff700 1 -- 172.21.15.84:0/1126119044 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56340afc40 msgr2=0x7f56340b2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:48.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.302+0000 7f563a9ff700 1 --2- 172.21.15.84:0/1126119044 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56340afc40 0x7f56340b2d40 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f5628009870 tx=0x7f5628009b80 comp rx=0 tx=0).stop 2023-07-14T11:19:48.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.302+0000 7f563a9ff700 1 -- 172.21.15.84:0/1126119044 shutdown_connections 2023-07-14T11:19:48.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.302+0000 7f563a9ff700 1 --2- 172.21.15.84:0/1126119044 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f563406b8a0 0x7f563406bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:48.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.302+0000 7f563a9ff700 1 --2- 172.21.15.84:0/1126119044 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56340afc40 0x7f56340b2d40 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:48.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.302+0000 7f563a9ff700 1 -- 172.21.15.84:0/1126119044 >> 172.21.15.84:0/1126119044 conn(0x7f563406d980 msgr2=0x7f563406dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:48.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.302+0000 7f563a9ff700 1 -- 172.21.15.84:0/1126119044 shutdown_connections 2023-07-14T11:19:48.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.302+0000 7f563a9ff700 1 -- 172.21.15.84:0/1126119044 wait complete. 2023-07-14T11:19:48.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.304+0000 7f563a9ff700 1 Processor -- start 2023-07-14T11:19:48.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.304+0000 7f563a9ff700 1 -- start start 2023-07-14T11:19:48.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.305+0000 7f563a9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f563406b8a0 0x7f5634154430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:48.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.305+0000 7f563a9ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56340afc40 0x7f56340cca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:48.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.305+0000 7f563a9ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f563415c6c0 0x7f56340ccfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:48.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.305+0000 7f563a9ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56340cdca0 con 0x7f56340afc40 2023-07-14T11:19:48.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.305+0000 7f563a9ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56340ce130 con 0x7f563415c6c0 2023-07-14T11:19:48.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.305+0000 7f563a9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5634154970 con 0x7f563406b8a0 2023-07-14T11:19:48.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.305+0000 7f56337fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56340afc40 0x7f56340cca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:48.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.305+0000 7f56337fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56340afc40 0x7f56340cca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36552/0 (socket says 172.21.15.84:36552) 2023-07-14T11:19:48.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.305+0000 7f56337fe700 1 -- 172.21.15.84:0/582257772 learned_addr learned my addr 172.21.15.84:0/582257772 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:48.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.306+0000 7f5633fff700 1 --2- 172.21.15.84:0/582257772 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f563406b8a0 0x7f5634154430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:48.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.306+0000 7f5638f9c700 1 --2- 172.21.15.84:0/582257772 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f563415c6c0 0x7f56340ccfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:48.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.306+0000 7f56337fe700 1 -- 172.21.15.84:0/582257772 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f563406b8a0 msgr2=0x7f5634154430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:48.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.306+0000 7f56337fe700 1 --2- 172.21.15.84:0/582257772 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f563406b8a0 0x7f5634154430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:48.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.306+0000 7f56337fe700 1 -- 172.21.15.84:0/582257772 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f563415c6c0 msgr2=0x7f56340ccfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:48.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.306+0000 7f56337fe700 1 --2- 172.21.15.84:0/582257772 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f563415c6c0 0x7f56340ccfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:48.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.306+0000 7f56337fe700 1 -- 172.21.15.84:0/582257772 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56280094a0 con 0x7f56340afc40 2023-07-14T11:19:48.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.306+0000 7f56337fe700 1 --2- 172.21.15.84:0/582257772 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56340afc40 0x7f56340cca60 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f5628009840 tx=0x7f5628004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:48.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.306+0000 7f5630ff9700 1 -- 172.21.15.84:0/582257772 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56280036a0 con 0x7f56340afc40 2023-07-14T11:19:48.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.306+0000 7f5630ff9700 1 -- 172.21.15.84:0/582257772 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f562801e070 con 0x7f56340afc40 2023-07-14T11:19:48.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.306+0000 7f563a9ff700 1 -- 172.21.15.84:0/582257772 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56340b6020 con 0x7f56340afc40 2023-07-14T11:19:48.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.306+0000 7f5630ff9700 1 -- 172.21.15.84:0/582257772 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5628003a80 con 0x7f56340afc40 2023-07-14T11:19:48.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.306+0000 7f563a9ff700 1 -- 172.21.15.84:0/582257772 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56340cd650 con 0x7f56340afc40 2023-07-14T11:19:48.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.308+0000 7f563a9ff700 1 -- 172.21.15.84:0/582257772 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56340cde10 con 0x7f56340afc40 2023-07-14T11:19:48.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.308+0000 7f5630ff9700 1 -- 172.21.15.84:0/582257772 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f5628003be0 con 0x7f56340afc40 2023-07-14T11:19:48.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.310+0000 7f5630ff9700 1 --2- 172.21.15.84:0/582257772 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f562006ae90 0x7f562006d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:48.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.310+0000 7f5630ff9700 1 -- 172.21.15.84:0/582257772 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f562808a6c0 con 0x7f56340afc40 2023-07-14T11:19:48.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.310+0000 7f5633fff700 1 --2- 172.21.15.84:0/582257772 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f562006ae90 0x7f562006d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:48.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.311+0000 7f5633fff700 1 --2- 172.21.15.84:0/582257772 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f562006ae90 0x7f562006d340 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5624000f60 tx=0x7f5624007a40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:48.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.314+0000 7f5630ff9700 1 -- 172.21.15.84:0/582257772 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f5628055580 con 0x7f56340afc40 2023-07-14T11:19:48.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.507+0000 7f563a9ff700 1 -- 172.21.15.84:0/582257772 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5634074350 con 0x7f56340afc40 2023-07-14T11:19:48.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.507+0000 7f5630ff9700 1 -- 172.21.15.84:0/582257772 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v106) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5628020020 con 0x7f56340afc40 2023-07-14T11:19:48.511 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-07-14T11:19:48.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.510+0000 7f563a9ff700 1 -- 172.21.15.84:0/582257772 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f562006ae90 msgr2=0x7f562006d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:48.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.510+0000 7f563a9ff700 1 --2- 172.21.15.84:0/582257772 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f562006ae90 0x7f562006d340 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5624000f60 tx=0x7f5624007a40 comp rx=0 tx=0).stop 2023-07-14T11:19:48.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.510+0000 7f563a9ff700 1 -- 172.21.15.84:0/582257772 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56340afc40 msgr2=0x7f56340cca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:48.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.510+0000 7f563a9ff700 1 --2- 172.21.15.84:0/582257772 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56340afc40 0x7f56340cca60 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f5628009840 tx=0x7f5628004750 comp rx=0 tx=0).stop 2023-07-14T11:19:48.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.510+0000 7f563a9ff700 1 -- 172.21.15.84:0/582257772 shutdown_connections 2023-07-14T11:19:48.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.510+0000 7f563a9ff700 1 --2- 172.21.15.84:0/582257772 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f562006ae90 0x7f562006d340 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:48.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.510+0000 7f563a9ff700 1 --2- 172.21.15.84:0/582257772 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f563406b8a0 0x7f5634154430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:48.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.510+0000 7f563a9ff700 1 --2- 172.21.15.84:0/582257772 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f563415c6c0 0x7f56340ccfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:48.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.510+0000 7f563a9ff700 1 --2- 172.21.15.84:0/582257772 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56340afc40 0x7f56340cca60 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:48.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.510+0000 7f563a9ff700 1 -- 172.21.15.84:0/582257772 >> 172.21.15.84:0/582257772 conn(0x7f563406d980 msgr2=0x7f56340b17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:48.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.510+0000 7f563a9ff700 1 -- 172.21.15.84:0/582257772 shutdown_connections 2023-07-14T11:19:48.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.510+0000 7f563a9ff700 1 -- 172.21.15.84:0/582257772 wait complete. 2023-07-14T11:19:48.531 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-14T11:19:48.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.723+0000 7f515e5ff700 1 Processor -- start 2023-07-14T11:19:48.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.723+0000 7f515e5ff700 1 -- start start 2023-07-14T11:19:48.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.724+0000 7f515e5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51580b8660 0x7f51580cd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:48.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.724+0000 7f515e5ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f51580cd970 0x7f51580b4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:48.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.724+0000 7f515e5ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f51580b4da0 0x7f51581601f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:48.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.725+0000 7f515e5ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51580d02a0 con 0x7f51580cd970 2023-07-14T11:19:48.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.725+0000 7f515e5ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51580b51c0 con 0x7f51580b4da0 2023-07-14T11:19:48.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.725+0000 7f515e5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51580cfce0 con 0x7f51580b8660 2023-07-14T11:19:48.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.725+0000 7f514ffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f51580cd970 0x7f51580b4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:48.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.725+0000 7f514ffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f51580cd970 0x7f51580b4860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36558/0 (socket says 172.21.15.84:36558) 2023-07-14T11:19:48.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.725+0000 7f514ffff700 1 -- 172.21.15.84:0/1955637064 learned_addr learned my addr 172.21.15.84:0/1955637064 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:48.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.725+0000 7f5157fff700 1 --2- 172.21.15.84:0/1955637064 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51580b8660 0x7f51580cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:48.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.725+0000 7f515cb9c700 1 --2- 172.21.15.84:0/1955637064 >> v2:172.21.15.179:3300/0 conn(0x7f51580b4da0 0x7f51581601f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:48.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.725+0000 7f514ffff700 1 -- 172.21.15.84:0/1955637064 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51580b8660 msgr2=0x7f51580cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:48.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.725+0000 7f514ffff700 1 --2- 172.21.15.84:0/1955637064 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51580b8660 0x7f51580cd430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:48.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.725+0000 7f514ffff700 1 -- 172.21.15.84:0/1955637064 >> v2:172.21.15.179:3300/0 conn(0x7f51580b4da0 msgr2=0x7f51581601f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:48.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.725+0000 7f514ffff700 1 --2- 172.21.15.84:0/1955637064 >> v2:172.21.15.179:3300/0 conn(0x7f51580b4da0 0x7f51581601f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:48.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.725+0000 7f514ffff700 1 -- 172.21.15.84:0/1955637064 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51580cffc0 con 0x7f51580cd970 2023-07-14T11:19:48.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.725+0000 7f515cb9c700 1 --2- 172.21.15.84:0/1955637064 >> v2:172.21.15.179:3300/0 conn(0x7f51580b4da0 0x7f51581601f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:19:48.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.725+0000 7f5157fff700 1 --2- 172.21.15.84:0/1955637064 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51580b8660 0x7f51580cd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:19:48.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.726+0000 7f514ffff700 1 --2- 172.21.15.84:0/1955637064 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51580cd970 0x7f51580b4860 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f5158160130 tx=0x7f5140009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2969db8d23f34b89 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:48.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.726+0000 7f51577fe700 1 -- 172.21.15.84:0/1955637064 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514000b870 con 0x7f51580cd970 2023-07-14T11:19:48.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.726+0000 7f51577fe700 1 -- 172.21.15.84:0/1955637064 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f514000b9d0 con 0x7f51580cd970 2023-07-14T11:19:48.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.726+0000 7f51577fe700 1 -- 172.21.15.84:0/1955637064 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514000bd60 con 0x7f51580cd970 2023-07-14T11:19:48.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.726+0000 7f515e5ff700 1 -- 172.21.15.84:0/1955637064 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51580cd970 msgr2=0x7f51580b4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:48.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.726+0000 7f515e5ff700 1 --2- 172.21.15.84:0/1955637064 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51580cd970 0x7f51580b4860 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f5158160130 tx=0x7f5140009bd0 comp rx=0 tx=0).stop 2023-07-14T11:19:48.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.726+0000 7f515e5ff700 1 -- 172.21.15.84:0/1955637064 shutdown_connections 2023-07-14T11:19:48.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.726+0000 7f515e5ff700 1 --2- 172.21.15.84:0/1955637064 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51580b8660 0x7f51580cd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:48.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.726+0000 7f515e5ff700 1 --2- 172.21.15.84:0/1955637064 >> v2:172.21.15.179:3300/0 conn(0x7f51580b4da0 0x7f51581601f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:48.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.727+0000 7f515e5ff700 1 --2- 172.21.15.84:0/1955637064 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51580cd970 0x7f51580b4860 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:48.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.727+0000 7f515e5ff700 1 -- 172.21.15.84:0/1955637064 >> 172.21.15.84:0/1955637064 conn(0x7f5158066860 msgr2=0x7f515806a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:48.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.727+0000 7f515e5ff700 1 -- 172.21.15.84:0/1955637064 shutdown_connections 2023-07-14T11:19:48.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.727+0000 7f515e5ff700 1 -- 172.21.15.84:0/1955637064 wait complete. 2023-07-14T11:19:48.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.728+0000 7f515e5ff700 1 Processor -- start 2023-07-14T11:19:48.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.728+0000 7f515e5ff700 1 -- start start 2023-07-14T11:19:48.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.729+0000 7f515e5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51580b4da0 0x7f515815b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:48.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.729+0000 7f515e5ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51580b8660 0x7f51580cafb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:48.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.729+0000 7f515e5ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51580cd970 0x7f51581f22c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:48.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.729+0000 7f515e5ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51580c9f50 con 0x7f51580b8660 2023-07-14T11:19:48.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.729+0000 7f515e5ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51580ca1f0 con 0x7f51580cd970 2023-07-14T11:19:48.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.729+0000 7f515e5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51580ca4d0 con 0x7f51580b4da0 2023-07-14T11:19:48.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.730+0000 7f514ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51580b8660 0x7f51580cafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:48.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.730+0000 7f514ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51580b8660 0x7f51580cafb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36572/0 (socket says 172.21.15.84:36572) 2023-07-14T11:19:48.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.730+0000 7f514ffff700 1 -- 172.21.15.84:0/3378964267 learned_addr learned my addr 172.21.15.84:0/3378964267 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:48.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.730+0000 7f5157fff700 1 --2- 172.21.15.84:0/3378964267 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51580b4da0 0x7f515815b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:48.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.730+0000 7f515cb9c700 1 --2- 172.21.15.84:0/3378964267 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51580cd970 0x7f51581f22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:48.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.730+0000 7f514ffff700 1 -- 172.21.15.84:0/3378964267 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51580b4da0 msgr2=0x7f515815b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:48.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.730+0000 7f514ffff700 1 --2- 172.21.15.84:0/3378964267 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51580b4da0 0x7f515815b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:48.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.730+0000 7f514ffff700 1 -- 172.21.15.84:0/3378964267 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51580cd970 msgr2=0x7f51581f22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:48.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.730+0000 7f514ffff700 1 --2- 172.21.15.84:0/3378964267 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51580cd970 0x7f51581f22c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:48.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.730+0000 7f514ffff700 1 -- 172.21.15.84:0/3378964267 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5140009550 con 0x7f51580b8660 2023-07-14T11:19:48.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.730+0000 7f514ffff700 1 --2- 172.21.15.84:0/3378964267 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51580b8660 0x7f51580cafb0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f5140014040 tx=0x7f5140004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:48.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.730+0000 7f51557fa700 1 -- 172.21.15.84:0/3378964267 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5140004310 con 0x7f51580b8660 2023-07-14T11:19:48.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.731+0000 7f51557fa700 1 -- 172.21.15.84:0/3378964267 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f514001e070 con 0x7f51580b8660 2023-07-14T11:19:48.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.731+0000 7f51557fa700 1 -- 172.21.15.84:0/3378964267 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51400036a0 con 0x7f51580b8660 2023-07-14T11:19:48.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.731+0000 7f515e5ff700 1 -- 172.21.15.84:0/3378964267 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51580ca7b0 con 0x7f51580b8660 2023-07-14T11:19:48.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.731+0000 7f515e5ff700 1 -- 172.21.15.84:0/3378964267 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f515815b5f0 con 0x7f51580b8660 2023-07-14T11:19:48.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.732+0000 7f515e5ff700 1 -- 172.21.15.84:0/3378964267 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51580cacd0 con 0x7f51580b8660 2023-07-14T11:19:48.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.733+0000 7f51557fa700 1 -- 172.21.15.84:0/3378964267 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f5140020030 con 0x7f51580b8660 2023-07-14T11:19:48.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.733+0000 7f51557fa700 1 --2- 172.21.15.84:0/3378964267 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f513806ae90 0x7f513806d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:48.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.734+0000 7f51557fa700 1 -- 172.21.15.84:0/3378964267 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f514008a810 con 0x7f51580b8660 2023-07-14T11:19:48.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.734+0000 7f5157fff700 1 --2- 172.21.15.84:0/3378964267 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f513806ae90 0x7f513806d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:48.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.735+0000 7f5157fff700 1 --2- 172.21.15.84:0/3378964267 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f513806ae90 0x7f513806d340 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5148006fd0 tx=0x7f5148008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:48.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.738+0000 7f51557fa700 1 -- 172.21.15.84:0/3378964267 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f51580cacd0 con 0x7f51580b8660 2023-07-14T11:19:48.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.949+0000 7f515e5ff700 1 -- 172.21.15.84:0/3378964267 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f51580cacd0 con 0x7f51580b8660 2023-07-14T11:19:48.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.949+0000 7f51557fa700 1 -- 172.21.15.84:0/3378964267 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v106) v1 ==== 80+0+0 (secure 0 0 0) 0x7f51580cacd0 con 0x7f51580b8660 2023-07-14T11:19:48.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.951+0000 7f515e5ff700 1 -- 172.21.15.84:0/3378964267 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f513806ae90 msgr2=0x7f513806d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:48.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.951+0000 7f515e5ff700 1 --2- 172.21.15.84:0/3378964267 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f513806ae90 0x7f513806d340 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5148006fd0 tx=0x7f5148008040 comp rx=0 tx=0).stop 2023-07-14T11:19:48.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.951+0000 7f515e5ff700 1 -- 172.21.15.84:0/3378964267 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51580b8660 msgr2=0x7f51580cafb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:48.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.951+0000 7f515e5ff700 1 --2- 172.21.15.84:0/3378964267 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51580b8660 0x7f51580cafb0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f5140014040 tx=0x7f5140004750 comp rx=0 tx=0).stop 2023-07-14T11:19:48.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.951+0000 7f515e5ff700 1 -- 172.21.15.84:0/3378964267 shutdown_connections 2023-07-14T11:19:48.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.951+0000 7f515e5ff700 1 --2- 172.21.15.84:0/3378964267 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f513806ae90 0x7f513806d340 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:48.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.951+0000 7f515e5ff700 1 --2- 172.21.15.84:0/3378964267 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51580b4da0 0x7f515815b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:48.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.951+0000 7f515e5ff700 1 --2- 172.21.15.84:0/3378964267 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51580cd970 0x7f51581f22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:48.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.951+0000 7f515e5ff700 1 --2- 172.21.15.84:0/3378964267 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51580b8660 0x7f51580cafb0 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:48.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.951+0000 7f515e5ff700 1 -- 172.21.15.84:0/3378964267 >> 172.21.15.84:0/3378964267 conn(0x7f5158066860 msgr2=0x7f51580d1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:48.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.951+0000 7f515e5ff700 1 -- 172.21.15.84:0/3378964267 shutdown_connections 2023-07-14T11:19:48.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:48.952+0000 7f515e5ff700 1 -- 172.21.15.84:0/3378964267 wait complete. 2023-07-14T11:19:48.957 INFO:teuthology.orchestra.run.smithi084.stderr:listed 0 entries 2023-07-14T11:19:48.972 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-07-14T11:19:48.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:19:48.974 DEBUG:teuthology.orchestra.run.smithi179:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-07-14T11:19:49.072 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi179.front.sepia.ceph.com 2023-07-14T11:19:49.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:19:49.073 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-14T11:19:49.121 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-14T11:19:49.122 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:19:49.168 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345568k,nr_inodes=4086392,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=35,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275008k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-07-14T11:19:49.169 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-07-14T11:19:49.169 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:19:49.215 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345528k,nr_inodes=4086382,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=40,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275000k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-07-14T11:19:49.216 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T11:19:49.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.408+0000 7f0fc61ff700 1 Processor -- start 2023-07-14T11:19:49.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.408+0000 7f0fc61ff700 1 -- start start 2023-07-14T11:19:49.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.409+0000 7f0fc61ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0fc00d1220 0x7f0fc00b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:49.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.409+0000 7f0fc61ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0fc00b1e00 0x7f0fc00afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:49.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.409+0000 7f0fc61ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fc00d2ce0 con 0x7f0fc015c950 2023-07-14T11:19:49.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.409+0000 7f0fc61ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fc00b3350 con 0x7f0fc00d1220 2023-07-14T11:19:49.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.409+0000 7f0fc61ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fc00b3630 con 0x7f0fc00b1e00 2023-07-14T11:19:49.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.410+0000 7f0fbeffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0fc00d1220 0x7f0fc00b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:49.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.410+0000 7f0fbeffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0fc00d1220 0x7f0fc00b43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34142/0 (socket says 172.21.15.84:34142) 2023-07-14T11:19:49.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.410+0000 7f0fbeffd700 1 -- 172.21.15.84:0/1281277668 learned_addr learned my addr 172.21.15.84:0/1281277668 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:49.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.410+0000 7f0fbffff700 1 --2- 172.21.15.84:0/1281277668 >> v2:172.21.15.179:3300/0 conn(0x7f0fc00b1e00 0x7f0fc00afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:49.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.410+0000 7f0fbeffd700 1 -- 172.21.15.84:0/1281277668 >> v2:172.21.15.179:3300/0 conn(0x7f0fc00b1e00 msgr2=0x7f0fc00afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:49.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.410+0000 7f0fbeffd700 1 --2- 172.21.15.84:0/1281277668 >> v2:172.21.15.179:3300/0 conn(0x7f0fc00b1e00 0x7f0fc00afac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:49.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.410+0000 7f0fbeffd700 1 -- 172.21.15.84:0/1281277668 >> v1:172.21.15.179:6789/0 conn(0x7f0fc015c950 legacy=0x7f0fc00d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:49.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.410+0000 7f0fbeffd700 1 -- 172.21.15.84:0/1281277668 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc00b3910 con 0x7f0fc00d1220 2023-07-14T11:19:49.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.410+0000 7f0fbeffd700 1 --2- 172.21.15.84:0/1281277668 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fc00d1220 0x7f0fc00b43f0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f0fc008c300 tx=0x7f0fb4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a0ecb45da4c5316 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:49.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.410+0000 7f0fbe7fc700 1 -- 172.21.15.84:0/1281277668 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb4004230 con 0x7f0fc00d1220 2023-07-14T11:19:49.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.410+0000 7f0fbe7fc700 1 -- 172.21.15.84:0/1281277668 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fb4004390 con 0x7f0fc00d1220 2023-07-14T11:19:49.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.410+0000 7f0fbe7fc700 1 -- 172.21.15.84:0/1281277668 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb40036a0 con 0x7f0fc00d1220 2023-07-14T11:19:49.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.411+0000 7f0fc61ff700 1 -- 172.21.15.84:0/1281277668 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fc00d1220 msgr2=0x7f0fc00b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:49.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.411+0000 7f0fc61ff700 1 --2- 172.21.15.84:0/1281277668 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fc00d1220 0x7f0fc00b43f0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f0fc008c300 tx=0x7f0fb4009bd0 comp rx=0 tx=0).stop 2023-07-14T11:19:49.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.411+0000 7f0fc61ff700 1 -- 172.21.15.84:0/1281277668 shutdown_connections 2023-07-14T11:19:49.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.411+0000 7f0fc61ff700 1 --2- 172.21.15.84:0/1281277668 >> v2:172.21.15.179:3300/0 conn(0x7f0fc00b1e00 0x7f0fc00afac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:49.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.411+0000 7f0fc61ff700 1 --2- 172.21.15.84:0/1281277668 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fc00d1220 0x7f0fc00b43f0 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:49.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.411+0000 7f0fc61ff700 1 -- 172.21.15.84:0/1281277668 >> 172.21.15.84:0/1281277668 conn(0x7f0fc009c1d0 msgr2=0x7f0fc00d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:49.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.411+0000 7f0fc61ff700 1 -- 172.21.15.84:0/1281277668 shutdown_connections 2023-07-14T11:19:49.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.411+0000 7f0fc61ff700 1 -- 172.21.15.84:0/1281277668 wait complete. 2023-07-14T11:19:49.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.413+0000 7f0fc61ff700 1 Processor -- start 2023-07-14T11:19:49.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.413+0000 7f0fc61ff700 1 -- start start 2023-07-14T11:19:49.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.414+0000 7f0fc61ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0fc00b1e00 0x7f0fc00cf800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:49.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.414+0000 7f0fc61ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0fc00d1220 0x7f0fc01f5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:49.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.414+0000 7f0fc61ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fc015c950 0x7f0fc01f56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:49.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.414+0000 7f0fc61ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc00cef00 con 0x7f0fc015c950 2023-07-14T11:19:49.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.414+0000 7f0fc61ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc01f2ff0 con 0x7f0fc00b1e00 2023-07-14T11:19:49.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.414+0000 7f0fc61ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc01f4f50 con 0x7f0fc00d1220 2023-07-14T11:19:49.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.414+0000 7f0fbffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fc015c950 0x7f0fc01f56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:49.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.414+0000 7f0fbffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fc015c950 0x7f0fc01f56c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34156/0 (socket says 172.21.15.84:34156) 2023-07-14T11:19:49.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.414+0000 7f0fbffff700 1 -- 172.21.15.84:0/1276437646 learned_addr learned my addr 172.21.15.84:0/1276437646 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:49.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.414+0000 7f0fbf7fe700 1 --2- 172.21.15.84:0/1276437646 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0fc00b1e00 0x7f0fc00cf800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:49.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.414+0000 7f0fbeffd700 1 --2- 172.21.15.84:0/1276437646 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0fc00d1220 0x7f0fc01f5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:49.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.415+0000 7f0fbffff700 1 -- 172.21.15.84:0/1276437646 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0fc00d1220 msgr2=0x7f0fc01f5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:49.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.415+0000 7f0fbffff700 1 --2- 172.21.15.84:0/1276437646 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0fc00d1220 0x7f0fc01f5180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:49.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.415+0000 7f0fbffff700 1 -- 172.21.15.84:0/1276437646 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0fc00b1e00 msgr2=0x7f0fc00cf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:49.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.415+0000 7f0fbffff700 1 --2- 172.21.15.84:0/1276437646 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0fc00b1e00 0x7f0fc00cf800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:49.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.415+0000 7f0fbffff700 1 -- 172.21.15.84:0/1276437646 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fb4009550 con 0x7f0fc015c950 2023-07-14T11:19:49.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.415+0000 7f0fbffff700 1 --2- 172.21.15.84:0/1276437646 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fc015c950 0x7f0fc01f56c0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f0fb8007e40 tx=0x7f0fb800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:49.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.415+0000 7f0fa7fff700 1 -- 172.21.15.84:0/1276437646 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb800ed30 con 0x7f0fc015c950 2023-07-14T11:19:49.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.415+0000 7f0fa7fff700 1 -- 172.21.15.84:0/1276437646 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fb8014420 con 0x7f0fc015c950 2023-07-14T11:19:49.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.415+0000 7f0fc61ff700 1 -- 172.21.15.84:0/1276437646 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fc00ce660 con 0x7f0fc015c950 2023-07-14T11:19:49.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.415+0000 7f0fa7fff700 1 -- 172.21.15.84:0/1276437646 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb80147d0 con 0x7f0fc015c950 2023-07-14T11:19:49.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.415+0000 7f0fc61ff700 1 -- 172.21.15.84:0/1276437646 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fc00cec20 con 0x7f0fc015c950 2023-07-14T11:19:49.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.416+0000 7f0fc61ff700 1 -- 172.21.15.84:0/1276437646 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fc01f2d50 con 0x7f0fc015c950 2023-07-14T11:19:49.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.417+0000 7f0fa7fff700 1 -- 172.21.15.84:0/1276437646 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f0fb8014930 con 0x7f0fc015c950 2023-07-14T11:19:49.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.419+0000 7f0fa7fff700 1 --2- 172.21.15.84:0/1276437646 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f0fac06ae90 0x7f0fac06d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:49.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.419+0000 7f0fa7fff700 1 -- 172.21.15.84:0/1276437646 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0fb8089ea0 con 0x7f0fc015c950 2023-07-14T11:19:49.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.419+0000 7f0fbf7fe700 1 --2- 172.21.15.84:0/1276437646 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f0fac06ae90 0x7f0fac06d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:49.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.420+0000 7f0fbf7fe700 1 --2- 172.21.15.84:0/1276437646 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f0fac06ae90 0x7f0fac06d340 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0fc00b8e90 tx=0x7f0fb00090e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:49.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.423+0000 7f0fa7fff700 1 -- 172.21.15.84:0/1276437646 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f0fc01f2d50 con 0x7f0fc015c950 2023-07-14T11:19:49.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.663+0000 7f0fc61ff700 1 -- 172.21.15.84:0/1276437646 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0fc01f3130 con 0x7f0fc015c950 2023-07-14T11:19:49.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.664+0000 7f0fa7fff700 1 -- 172.21.15.84:0/1276437646 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4711 (secure 0 0 0) 0x7f0fc01f3130 con 0x7f0fc015c950 2023-07-14T11:19:49.667 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:19:49.668 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":70,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6197,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/396743399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":396743399},{"type":"v1","addr":"172.21.15.179:6835","nonce":396743399}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":7105,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3729505201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3729505201},{"type":"v1","addr":"172.21.15.179:6834","nonce":3729505201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":7680,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6833/411491873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":411491873},{"type":"v1","addr":"172.21.15.84:6833","nonce":411491873}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T11:19:24.441292+0000","modified":"2023-07-14T11:19:27.974517+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7683},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7683":{"gid":7683,"name":"c","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6835/2350815422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2350815422},{"type":"v1","addr":"172.21.15.84:6835","nonce":2350815422}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-07-14T11:19:49.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.666+0000 7f0fc61ff700 1 -- 172.21.15.84:0/1276437646 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f0fac06ae90 msgr2=0x7f0fac06d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:49.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.666+0000 7f0fc61ff700 1 --2- 172.21.15.84:0/1276437646 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f0fac06ae90 0x7f0fac06d340 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0fc00b8e90 tx=0x7f0fb00090e0 comp rx=0 tx=0).stop 2023-07-14T11:19:49.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.666+0000 7f0fc61ff700 1 -- 172.21.15.84:0/1276437646 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fc015c950 msgr2=0x7f0fc01f56c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:49.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.666+0000 7f0fc61ff700 1 --2- 172.21.15.84:0/1276437646 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fc015c950 0x7f0fc01f56c0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f0fb8007e40 tx=0x7f0fb800e3c0 comp rx=0 tx=0).stop 2023-07-14T11:19:49.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.666+0000 7f0fc61ff700 1 -- 172.21.15.84:0/1276437646 shutdown_connections 2023-07-14T11:19:49.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.666+0000 7f0fc61ff700 1 --2- 172.21.15.84:0/1276437646 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fc015c950 0x7f0fc01f56c0 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:49.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.666+0000 7f0fc61ff700 1 --2- 172.21.15.84:0/1276437646 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0fc00b1e00 0x7f0fc00cf800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:49.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.666+0000 7f0fc61ff700 1 --2- 172.21.15.84:0/1276437646 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f0fac06ae90 0x7f0fac06d340 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:49.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.666+0000 7f0fc61ff700 1 --2- 172.21.15.84:0/1276437646 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0fc00d1220 0x7f0fc01f5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:49.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.666+0000 7f0fc61ff700 1 -- 172.21.15.84:0/1276437646 >> 172.21.15.84:0/1276437646 conn(0x7f0fc009c1d0 msgr2=0x7f0fc0158670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:49.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.666+0000 7f0fc61ff700 1 -- 172.21.15.84:0/1276437646 shutdown_connections 2023-07-14T11:19:49.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.666+0000 7f0fc61ff700 1 -- 172.21.15.84:0/1276437646 wait complete. 2023-07-14T11:19:49.672 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 70 2023-07-14T11:19:49.687 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:19:49.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.879+0000 7fbd747ff700 1 Processor -- start 2023-07-14T11:19:49.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.879+0000 7fbd747ff700 1 -- start start 2023-07-14T11:19:49.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.880+0000 7fbd747ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbd6c0d1160 0x7fbd6c06c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:49.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.880+0000 7fbd747ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd6c0b5cd0 0x7fbd6c0b0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:49.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.880+0000 7fbd747ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd6c0d2cc0 con 0x7fbd6c160030 2023-07-14T11:19:49.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.880+0000 7fbd747ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd6c0afbb0 con 0x7fbd6c0d1160 2023-07-14T11:19:49.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.880+0000 7fbd747ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6c0afe90 con 0x7fbd6c0b5cd0 2023-07-14T11:19:49.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.881+0000 7fbd7259b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fbd6c160030 0x7fbd6c0d0a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:35020/0 (socket says 172.21.15.84:35020) 2023-07-14T11:19:49.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.881+0000 7fbd7259b700 1 -- 172.21.15.84:0/2086202380 learned_addr learned my addr 172.21.15.84:0/2086202380 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:19:49.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.881+0000 7fbd72d9c700 1 --2- 172.21.15.84:0/2086202380 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd6c0b5cd0 0x7fbd6c0b0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:49.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.881+0000 7fbd71d9a700 1 --2- 172.21.15.84:0/2086202380 >> v2:172.21.15.179:3300/0 conn(0x7fbd6c0d1160 0x7fbd6c06c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:49.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.881+0000 7fbd71599700 1 -- 172.21.15.84:0/2086202380 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3124190793 0 0) 0x7fbd6c0d2cc0 con 0x7fbd6c160030 2023-07-14T11:19:49.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.881+0000 7fbd71599700 1 -- 172.21.15.84:0/2086202380 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd580035b0 con 0x7fbd6c160030 2023-07-14T11:19:49.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.881+0000 7fbd72d9c700 1 -- 172.21.15.84:0/2086202380 >> v2:172.21.15.179:3300/0 conn(0x7fbd6c0d1160 msgr2=0x7fbd6c06c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:49.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.881+0000 7fbd72d9c700 1 --2- 172.21.15.84:0/2086202380 >> v2:172.21.15.179:3300/0 conn(0x7fbd6c0d1160 0x7fbd6c06c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:49.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.881+0000 7fbd72d9c700 1 -- 172.21.15.84:0/2086202380 >> v1:172.21.15.84:6789/0 conn(0x7fbd6c160030 legacy=0x7fbd6c0d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:49.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.881+0000 7fbd72d9c700 1 -- 172.21.15.84:0/2086202380 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd6c0b0170 con 0x7fbd6c0b5cd0 2023-07-14T11:19:49.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.881+0000 7fbd71d9a700 1 --2- 172.21.15.84:0/2086202380 >> v2:172.21.15.179:3300/0 conn(0x7fbd6c0d1160 0x7fbd6c06c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:19:49.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.882+0000 7fbd72d9c700 1 --2- 172.21.15.84:0/2086202380 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd6c0b5cd0 0x7fbd6c0b0c50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fbd64009d90 tx=0x7fbd6400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf7212f456affd74 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:49.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.882+0000 7fbd71599700 1 -- 172.21.15.84:0/2086202380 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6400e070 con 0x7fbd6c0b5cd0 2023-07-14T11:19:49.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.882+0000 7fbd71599700 1 -- 172.21.15.84:0/2086202380 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd6400bb20 con 0x7fbd6c0b5cd0 2023-07-14T11:19:49.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.882+0000 7fbd71599700 1 -- 172.21.15.84:0/2086202380 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd64012430 con 0x7fbd6c0b5cd0 2023-07-14T11:19:49.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.882+0000 7fbd747ff700 1 -- 172.21.15.84:0/2086202380 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd6c0b5cd0 msgr2=0x7fbd6c0b0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:49.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.882+0000 7fbd747ff700 1 --2- 172.21.15.84:0/2086202380 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd6c0b5cd0 0x7fbd6c0b0c50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fbd64009d90 tx=0x7fbd6400b330 comp rx=0 tx=0).stop 2023-07-14T11:19:49.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.882+0000 7fbd747ff700 1 -- 172.21.15.84:0/2086202380 shutdown_connections 2023-07-14T11:19:49.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.882+0000 7fbd747ff700 1 --2- 172.21.15.84:0/2086202380 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd6c0b5cd0 0x7fbd6c0b0c50 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:49.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.883+0000 7fbd747ff700 1 --2- 172.21.15.84:0/2086202380 >> v2:172.21.15.179:3300/0 conn(0x7fbd6c0d1160 0x7fbd6c06c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:49.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.883+0000 7fbd747ff700 1 -- 172.21.15.84:0/2086202380 >> 172.21.15.84:0/2086202380 conn(0x7fbd6c09c190 msgr2=0x7fbd6c0d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:49.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.883+0000 7fbd747ff700 1 -- 172.21.15.84:0/2086202380 shutdown_connections 2023-07-14T11:19:49.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.883+0000 7fbd747ff700 1 -- 172.21.15.84:0/2086202380 wait complete. 2023-07-14T11:19:49.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.884+0000 7fbd747ff700 1 Processor -- start 2023-07-14T11:19:49.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.884+0000 7fbd747ff700 1 -- start start 2023-07-14T11:19:49.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.885+0000 7fbd747ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd6c0b5cd0 0x7fbd6c158f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:49.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.885+0000 7fbd747ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd6c0d1160 0x7fbd6c15c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:49.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.885+0000 7fbd747ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd6c160030 0x7fbd6c15c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:49.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.885+0000 7fbd747ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6c1594c0 con 0x7fbd6c0b5cd0 2023-07-14T11:19:49.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.885+0000 7fbd747ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6c15a980 con 0x7fbd6c160030 2023-07-14T11:19:49.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.885+0000 7fbd747ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6c15ac60 con 0x7fbd6c0d1160 2023-07-14T11:19:49.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.886+0000 7fbd7259b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd6c0b5cd0 0x7fbd6c158f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:49.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.886+0000 7fbd7259b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd6c0b5cd0 0x7fbd6c158f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34160/0 (socket says 172.21.15.84:34160) 2023-07-14T11:19:49.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.886+0000 7fbd7259b700 1 -- 172.21.15.84:0/2656714682 learned_addr learned my addr 172.21.15.84:0/2656714682 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:49.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.886+0000 7fbd71d9a700 1 --2- 172.21.15.84:0/2656714682 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd6c0d1160 0x7fbd6c15c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:49.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.886+0000 7fbd72d9c700 1 --2- 172.21.15.84:0/2656714682 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd6c160030 0x7fbd6c15c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:49.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.886+0000 7fbd7259b700 1 -- 172.21.15.84:0/2656714682 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd6c0d1160 msgr2=0x7fbd6c15c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:49.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.886+0000 7fbd7259b700 1 --2- 172.21.15.84:0/2656714682 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd6c0d1160 0x7fbd6c15c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:49.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.886+0000 7fbd7259b700 1 -- 172.21.15.84:0/2656714682 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd6c160030 msgr2=0x7fbd6c15c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:49.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.886+0000 7fbd7259b700 1 --2- 172.21.15.84:0/2656714682 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd6c160030 0x7fbd6c15c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:49.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.886+0000 7fbd7259b700 1 -- 172.21.15.84:0/2656714682 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd5c0094a0 con 0x7fbd6c0b5cd0 2023-07-14T11:19:49.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.886+0000 7fbd7259b700 1 --2- 172.21.15.84:0/2656714682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd6c0b5cd0 0x7fbd6c158f80 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7fbd68001eb0 tx=0x7fbd6800c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:49.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.886+0000 7fbd62ffd700 1 -- 172.21.15.84:0/2656714682 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd68005d70 con 0x7fbd6c0b5cd0 2023-07-14T11:19:49.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.887+0000 7fbd62ffd700 1 -- 172.21.15.84:0/2656714682 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd680070d0 con 0x7fbd6c0b5cd0 2023-07-14T11:19:49.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.887+0000 7fbd62ffd700 1 -- 172.21.15.84:0/2656714682 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd68007460 con 0x7fbd6c0b5cd0 2023-07-14T11:19:49.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.887+0000 7fbd747ff700 1 -- 172.21.15.84:0/2656714682 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd64009a70 con 0x7fbd6c0b5cd0 2023-07-14T11:19:49.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.887+0000 7fbd747ff700 1 -- 172.21.15.84:0/2656714682 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd6c15b220 con 0x7fbd6c0b5cd0 2023-07-14T11:19:49.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.888+0000 7fbd747ff700 1 -- 172.21.15.84:0/2656714682 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd6c09dcf0 con 0x7fbd6c0b5cd0 2023-07-14T11:19:49.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.889+0000 7fbd62ffd700 1 -- 172.21.15.84:0/2656714682 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) v1 ==== 89190+0+0 (secure 0 0 0) 0x7fbd680075c0 con 0x7fbd6c0b5cd0 2023-07-14T11:19:49.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.890+0000 7fbd62ffd700 1 --2- 172.21.15.84:0/2656714682 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fbd5006ae90 0x7fbd5006d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:49.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.890+0000 7fbd62ffd700 1 -- 172.21.15.84:0/2656714682 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbd68088c50 con 0x7fbd6c0b5cd0 2023-07-14T11:19:49.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.891+0000 7fbd71d9a700 1 --2- 172.21.15.84:0/2656714682 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fbd5006ae90 0x7fbd5006d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:49.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.891+0000 7fbd71d9a700 1 --2- 172.21.15.84:0/2656714682 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fbd5006ae90 0x7fbd5006d340 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c15c0f0 tx=0x7fbd5c009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:49.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:49.895+0000 7fbd62ffd700 1 -- 172.21.15.84:0/2656714682 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fbd6808e020 con 0x7fbd6c0b5cd0 2023-07-14T11:19:50.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.093+0000 7fbd747ff700 1 -- 172.21.15.84:0/2656714682 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbd6c04e280 con 0x7fbd6c0b5cd0 2023-07-14T11:19:50.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.095+0000 7fbd62ffd700 1 -- 172.21.15.84:0/2656714682 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v106) v1 ==== 74+0+18337 (secure 0 0 0) 0x7fbd68053a80 con 0x7fbd6c0b5cd0 2023-07-14T11:19:50.099 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:19:50.099 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":106,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:19:25.959900+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-07-14T11:19:22.615201+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-07-14T11:19:23.416792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:19:50.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.097+0000 7fbd747ff700 1 -- 172.21.15.84:0/2656714682 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fbd5006ae90 msgr2=0x7fbd5006d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:50.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.097+0000 7fbd747ff700 1 --2- 172.21.15.84:0/2656714682 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fbd5006ae90 0x7fbd5006d340 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c15c0f0 tx=0x7fbd5c009210 comp rx=0 tx=0).stop 2023-07-14T11:19:50.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.097+0000 7fbd747ff700 1 -- 172.21.15.84:0/2656714682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd6c0b5cd0 msgr2=0x7fbd6c158f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:50.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.097+0000 7fbd747ff700 1 --2- 172.21.15.84:0/2656714682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd6c0b5cd0 0x7fbd6c158f80 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7fbd68001eb0 tx=0x7fbd6800c7b0 comp rx=0 tx=0).stop 2023-07-14T11:19:50.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.097+0000 7fbd747ff700 1 -- 172.21.15.84:0/2656714682 shutdown_connections 2023-07-14T11:19:50.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.097+0000 7fbd747ff700 1 --2- 172.21.15.84:0/2656714682 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd6c160030 0x7fbd6c15c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:50.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.097+0000 7fbd747ff700 1 --2- 172.21.15.84:0/2656714682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd6c0b5cd0 0x7fbd6c158f80 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:50.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.097+0000 7fbd747ff700 1 --2- 172.21.15.84:0/2656714682 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fbd5006ae90 0x7fbd5006d340 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:50.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.097+0000 7fbd747ff700 1 --2- 172.21.15.84:0/2656714682 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd6c0d1160 0x7fbd6c15c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:50.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.097+0000 7fbd747ff700 1 -- 172.21.15.84:0/2656714682 >> 172.21.15.84:0/2656714682 conn(0x7fbd6c09c190 msgr2=0x7fbd6c15f360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:50.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.097+0000 7fbd747ff700 1 -- 172.21.15.84:0/2656714682 shutdown_connections 2023-07-14T11:19:50.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.097+0000 7fbd747ff700 1 -- 172.21.15.84:0/2656714682 wait complete. 2023-07-14T11:19:50.119 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T11:13:00.125395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T11:13:06.803994+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T11:19:22.615201+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '105', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T11:19:23.416792+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '106', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T11:19:50.120 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T11:19:50.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.314+0000 7fc5417ff700 1 Processor -- start 2023-07-14T11:19:50.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.314+0000 7fc5417ff700 1 -- start start 2023-07-14T11:19:50.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.315+0000 7fc5417ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc53c0b8a60 0x7fc53c0b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:50.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.315+0000 7fc5417ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc53c0b4530 0x7fc53c0d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:50.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.316+0000 7fc5417ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc53c0d1490 con 0x7fc53c0d1050 2023-07-14T11:19:50.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.316+0000 7fc5417ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc53c0b8e30 con 0x7fc53c0b4530 2023-07-14T11:19:50.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.316+0000 7fc5417ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc53c0b1e30 con 0x7fc53c0b8a60 2023-07-14T11:19:50.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.316+0000 7fc53a7fc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc53c0b4530 0x7fc53c0d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:50.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.316+0000 7fc53b7fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fc53c0d1050 0x7fc53c0b25d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:35032/0 (socket says 172.21.15.84:35032) 2023-07-14T11:19:50.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.316+0000 7fc53b7fe700 1 -- 172.21.15.84:0/3297276551 learned_addr learned my addr 172.21.15.84:0/3297276551 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:19:50.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.316+0000 7fc53affd700 1 --2- 172.21.15.84:0/3297276551 >> v2:172.21.15.179:3300/0 conn(0x7fc53c0b8a60 0x7fc53c0b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:50.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.316+0000 7fc53a7fc700 1 -- 172.21.15.84:0/3297276551 >> v2:172.21.15.179:3300/0 conn(0x7fc53c0b8a60 msgr2=0x7fc53c0b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:50.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.316+0000 7fc53a7fc700 1 --2- 172.21.15.84:0/3297276551 >> v2:172.21.15.179:3300/0 conn(0x7fc53c0b8a60 0x7fc53c0b3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:50.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.316+0000 7fc53a7fc700 1 -- 172.21.15.84:0/3297276551 >> v1:172.21.15.84:6789/0 conn(0x7fc53c0d1050 legacy=0x7fc53c0b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:50.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.316+0000 7fc53a7fc700 1 -- 172.21.15.84:0/3297276551 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc53c0afaa0 con 0x7fc53c0b4530 2023-07-14T11:19:50.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.316+0000 7fc53affd700 1 --2- 172.21.15.84:0/3297276551 >> v2:172.21.15.179:3300/0 conn(0x7fc53c0b8a60 0x7fc53c0b3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:19:50.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.316+0000 7fc53a7fc700 1 --2- 172.21.15.84:0/3297276551 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc53c0b4530 0x7fc53c0d0b10 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7fc53c0b5b00 tx=0x7fc530009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e9cfc36ee72d704 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:50.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.317+0000 7fc539ffb700 1 -- 172.21.15.84:0/3297276551 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc530011830 con 0x7fc53c0b4530 2023-07-14T11:19:50.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.317+0000 7fc539ffb700 1 -- 172.21.15.84:0/3297276551 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc530011990 con 0x7fc53c0b4530 2023-07-14T11:19:50.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.317+0000 7fc539ffb700 1 -- 172.21.15.84:0/3297276551 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc530011d20 con 0x7fc53c0b4530 2023-07-14T11:19:50.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.317+0000 7fc5417ff700 1 -- 172.21.15.84:0/3297276551 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc53c0b4530 msgr2=0x7fc53c0d0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:50.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.317+0000 7fc5417ff700 1 --2- 172.21.15.84:0/3297276551 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc53c0b4530 0x7fc53c0d0b10 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7fc53c0b5b00 tx=0x7fc530009b20 comp rx=0 tx=0).stop 2023-07-14T11:19:50.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.317+0000 7fc5417ff700 1 -- 172.21.15.84:0/3297276551 shutdown_connections 2023-07-14T11:19:50.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.317+0000 7fc5417ff700 1 --2- 172.21.15.84:0/3297276551 >> v2:172.21.15.179:3300/0 conn(0x7fc53c0b8a60 0x7fc53c0b3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:50.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.317+0000 7fc5417ff700 1 --2- 172.21.15.84:0/3297276551 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc53c0b4530 0x7fc53c0d0b10 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:50.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.317+0000 7fc5417ff700 1 -- 172.21.15.84:0/3297276551 >> 172.21.15.84:0/3297276551 conn(0x7fc53c09c1b0 msgr2=0x7fc53c0d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:50.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.317+0000 7fc5417ff700 1 -- 172.21.15.84:0/3297276551 shutdown_connections 2023-07-14T11:19:50.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.317+0000 7fc5417ff700 1 -- 172.21.15.84:0/3297276551 wait complete. 2023-07-14T11:19:50.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.319+0000 7fc5417ff700 1 Processor -- start 2023-07-14T11:19:50.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.319+0000 7fc5417ff700 1 -- start start 2023-07-14T11:19:50.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.320+0000 7fc5417ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc53c0b4530 0x7fc53c0cf990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:50.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.320+0000 7fc5417ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc53c0b8a60 0x7fc53c1561a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:50.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.320+0000 7fc5417ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc53c0d1050 0x7fc53c1566e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:50.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.320+0000 7fc5417ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc53c1f6470 con 0x7fc53c0b8a60 2023-07-14T11:19:50.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.320+0000 7fc5417ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc53c1f1e90 con 0x7fc53c0d1050 2023-07-14T11:19:50.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.320+0000 7fc5417ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc53c1f6190 con 0x7fc53c0b4530 2023-07-14T11:19:50.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.320+0000 7fc53a7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc53c0b8a60 0x7fc53c1561a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:50.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.320+0000 7fc53a7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc53c0b8a60 0x7fc53c1561a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34182/0 (socket says 172.21.15.84:34182) 2023-07-14T11:19:50.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.320+0000 7fc53a7fc700 1 -- 172.21.15.84:0/1421766516 learned_addr learned my addr 172.21.15.84:0/1421766516 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:50.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.320+0000 7fc53affd700 1 --2- 172.21.15.84:0/1421766516 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc53c0b4530 0x7fc53c0cf990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:50.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.321+0000 7fc53b7fe700 1 --2- 172.21.15.84:0/1421766516 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc53c0d1050 0x7fc53c1566e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:50.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.321+0000 7fc53a7fc700 1 -- 172.21.15.84:0/1421766516 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc53c0b4530 msgr2=0x7fc53c0cf990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:50.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.321+0000 7fc53a7fc700 1 --2- 172.21.15.84:0/1421766516 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc53c0b4530 0x7fc53c0cf990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:50.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.321+0000 7fc53a7fc700 1 -- 172.21.15.84:0/1421766516 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc53c0d1050 msgr2=0x7fc53c1566e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:50.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.321+0000 7fc53a7fc700 1 --2- 172.21.15.84:0/1421766516 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc53c0d1050 0x7fc53c1566e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:50.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.321+0000 7fc53a7fc700 1 -- 172.21.15.84:0/1421766516 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5300094a0 con 0x7fc53c0b8a60 2023-07-14T11:19:50.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.321+0000 7fc53a7fc700 1 --2- 172.21.15.84:0/1421766516 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc53c0b8a60 0x7fc53c1561a0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7fc5300090b0 tx=0x7fc530004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:50.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.321+0000 7fc5237fe700 1 -- 172.21.15.84:0/1421766516 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5300038a0 con 0x7fc53c0b8a60 2023-07-14T11:19:50.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.321+0000 7fc5237fe700 1 -- 172.21.15.84:0/1421766516 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc53001f070 con 0x7fc53c0b8a60 2023-07-14T11:19:50.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.321+0000 7fc5417ff700 1 -- 172.21.15.84:0/1421766516 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc53c1f20a0 con 0x7fc53c0b8a60 2023-07-14T11:19:50.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.321+0000 7fc5237fe700 1 -- 172.21.15.84:0/1421766516 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc530003c60 con 0x7fc53c0b8a60 2023-07-14T11:19:50.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.321+0000 7fc5417ff700 1 -- 172.21.15.84:0/1421766516 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc53c1f2660 con 0x7fc53c0b8a60 2023-07-14T11:19:50.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.322+0000 7fc5417ff700 1 -- 172.21.15.84:0/1421766516 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc53c1f2850 con 0x7fc53c0b8a60 2023-07-14T11:19:50.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.323+0000 7fc5237fe700 1 -- 172.21.15.84:0/1421766516 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) v1 ==== 89190+0+0 (secure 0 0 0) 0x7fc530026480 con 0x7fc53c0b8a60 2023-07-14T11:19:50.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.324+0000 7fc5237fe700 1 --2- 172.21.15.84:0/1421766516 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fc52806ae90 0x7fc52806d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:50.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.324+0000 7fc5237fe700 1 -- 172.21.15.84:0/1421766516 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc530021070 con 0x7fc53c0b8a60 2023-07-14T11:19:50.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.325+0000 7fc53affd700 1 --2- 172.21.15.84:0/1421766516 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fc52806ae90 0x7fc52806d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:50.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.326+0000 7fc53affd700 1 --2- 172.21.15.84:0/1421766516 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fc52806ae90 0x7fc52806d340 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc52c006fd0 tx=0x7fc52c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:50.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.329+0000 7fc5237fe700 1 -- 172.21.15.84:0/1421766516 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fc5300bd330 con 0x7fc53c0b8a60 2023-07-14T11:19:50.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.522+0000 7fc5417ff700 1 -- 172.21.15.84:0/1421766516 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc53c074350 con 0x7fc53c0b8a60 2023-07-14T11:19:50.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.523+0000 7fc5237fe700 1 -- 172.21.15.84:0/1421766516 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v106) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc530056040 con 0x7fc53c0b8a60 2023-07-14T11:19:50.527 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-07-14T11:19:50.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.525+0000 7fc5417ff700 1 -- 172.21.15.84:0/1421766516 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fc52806ae90 msgr2=0x7fc52806d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:50.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.525+0000 7fc5417ff700 1 --2- 172.21.15.84:0/1421766516 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fc52806ae90 0x7fc52806d340 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc52c006fd0 tx=0x7fc52c008040 comp rx=0 tx=0).stop 2023-07-14T11:19:50.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.525+0000 7fc5417ff700 1 -- 172.21.15.84:0/1421766516 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc53c0b8a60 msgr2=0x7fc53c1561a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:50.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.525+0000 7fc5417ff700 1 --2- 172.21.15.84:0/1421766516 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc53c0b8a60 0x7fc53c1561a0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7fc5300090b0 tx=0x7fc530004750 comp rx=0 tx=0).stop 2023-07-14T11:19:50.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.525+0000 7fc5417ff700 1 -- 172.21.15.84:0/1421766516 shutdown_connections 2023-07-14T11:19:50.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.525+0000 7fc5417ff700 1 --2- 172.21.15.84:0/1421766516 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fc52806ae90 0x7fc52806d340 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:50.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.525+0000 7fc5417ff700 1 --2- 172.21.15.84:0/1421766516 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc53c0b4530 0x7fc53c0cf990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:50.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.525+0000 7fc5417ff700 1 --2- 172.21.15.84:0/1421766516 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc53c0d1050 0x7fc53c1566e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:50.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.525+0000 7fc5417ff700 1 --2- 172.21.15.84:0/1421766516 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc53c0b8a60 0x7fc53c1561a0 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:50.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.525+0000 7fc5417ff700 1 -- 172.21.15.84:0/1421766516 >> 172.21.15.84:0/1421766516 conn(0x7fc53c09c1b0 msgr2=0x7fc53c0b7d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:50.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.525+0000 7fc5417ff700 1 -- 172.21.15.84:0/1421766516 shutdown_connections 2023-07-14T11:19:50.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.526+0000 7fc5417ff700 1 -- 172.21.15.84:0/1421766516 wait complete. 2023-07-14T11:19:50.546 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T11:19:50.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.741+0000 7fee43bff700 1 Processor -- start 2023-07-14T11:19:50.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.742+0000 7fee43bff700 1 -- start start 2023-07-14T11:19:50.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.743+0000 7fee43bff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fee3c15c860 0x7fee3c0d1e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:50.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.743+0000 7fee43bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee3c0c71b0 0x7fee3c0b49d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:50.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.743+0000 7fee43bff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee3c0cd5a0 con 0x7fee3c0cf2a0 2023-07-14T11:19:50.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.743+0000 7fee43bff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee3c146740 con 0x7fee3c15c860 2023-07-14T11:19:50.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.743+0000 7fee43bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee3c0cf740 con 0x7fee3c0c71b0 2023-07-14T11:19:50.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.743+0000 7fee4199b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fee3c15c860 0x7fee3c0d1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:50.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.743+0000 7fee4199b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fee3c15c860 0x7fee3c0d1e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34194/0 (socket says 172.21.15.84:34194) 2023-07-14T11:19:50.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.743+0000 7fee4199b700 1 -- 172.21.15.84:0/888468275 learned_addr learned my addr 172.21.15.84:0/888468275 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:50.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.743+0000 7fee4219c700 1 --2- 172.21.15.84:0/888468275 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee3c0c71b0 0x7fee3c0b49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:50.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.744+0000 7fee4199b700 1 -- 172.21.15.84:0/888468275 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee3c0c71b0 msgr2=0x7fee3c0b49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:50.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.744+0000 7fee4199b700 1 --2- 172.21.15.84:0/888468275 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee3c0c71b0 0x7fee3c0b49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:50.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.744+0000 7fee4199b700 1 -- 172.21.15.84:0/888468275 >> v1:172.21.15.179:6789/0 conn(0x7fee3c0cf2a0 legacy=0x7fee3c0c6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:50.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.744+0000 7fee4199b700 1 -- 172.21.15.84:0/888468275 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee3c0cd7f0 con 0x7fee3c15c860 2023-07-14T11:19:50.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.744+0000 7fee4199b700 1 --2- 172.21.15.84:0/888468275 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee3c15c860 0x7fee3c0d1e40 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7fee380098f0 tx=0x7fee38009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54c1dba433700897 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:50.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.744+0000 7fee40999700 1 -- 172.21.15.84:0/888468275 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee38004230 con 0x7fee3c15c860 2023-07-14T11:19:50.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.744+0000 7fee40999700 1 -- 172.21.15.84:0/888468275 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee38004390 con 0x7fee3c15c860 2023-07-14T11:19:50.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.744+0000 7fee40999700 1 -- 172.21.15.84:0/888468275 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee380036a0 con 0x7fee3c15c860 2023-07-14T11:19:50.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.745+0000 7fee43bff700 1 -- 172.21.15.84:0/888468275 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee3c15c860 msgr2=0x7fee3c0d1e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:50.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.745+0000 7fee43bff700 1 --2- 172.21.15.84:0/888468275 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee3c15c860 0x7fee3c0d1e40 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7fee380098f0 tx=0x7fee38009c00 comp rx=0 tx=0).stop 2023-07-14T11:19:50.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.745+0000 7fee43bff700 1 -- 172.21.15.84:0/888468275 shutdown_connections 2023-07-14T11:19:50.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.745+0000 7fee43bff700 1 --2- 172.21.15.84:0/888468275 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee3c0c71b0 0x7fee3c0b49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:50.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.745+0000 7fee43bff700 1 --2- 172.21.15.84:0/888468275 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee3c15c860 0x7fee3c0d1e40 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:50.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.745+0000 7fee43bff700 1 -- 172.21.15.84:0/888468275 >> 172.21.15.84:0/888468275 conn(0x7fee3c065bd0 msgr2=0x7fee3c065fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:50.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.745+0000 7fee43bff700 1 -- 172.21.15.84:0/888468275 shutdown_connections 2023-07-14T11:19:50.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.745+0000 7fee43bff700 1 -- 172.21.15.84:0/888468275 wait complete. 2023-07-14T11:19:50.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.747+0000 7fee43bff700 1 Processor -- start 2023-07-14T11:19:50.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.747+0000 7fee43bff700 1 -- start start 2023-07-14T11:19:50.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.748+0000 7fee43bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee3c0c71b0 0x7fee3c145f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:50.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.748+0000 7fee43bff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee3c0cf2a0 0x7fee3c0c4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:50.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.748+0000 7fee43bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee3c15c860 0x7fee3c0b5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:50.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.748+0000 7fee43bff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee3c0c5ed0 con 0x7fee3c0cf2a0 2023-07-14T11:19:50.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.748+0000 7fee43bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee3c0b8b40 con 0x7fee3c0c71b0 2023-07-14T11:19:50.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.748+0000 7fee43bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee3c14fb20 con 0x7fee3c15c860 2023-07-14T11:19:50.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.748+0000 7fee4119a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee3c0cf2a0 0x7fee3c0c4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:50.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.748+0000 7fee4119a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee3c0cf2a0 0x7fee3c0c4e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34196/0 (socket says 172.21.15.84:34196) 2023-07-14T11:19:50.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.748+0000 7fee4119a700 1 -- 172.21.15.84:0/791500626 learned_addr learned my addr 172.21.15.84:0/791500626 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:50.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.748+0000 7fee4119a700 1 -- 172.21.15.84:0/791500626 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee3c15c860 msgr2=0x7fee3c0b5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:50.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.748+0000 7fee4119a700 1 --2- 172.21.15.84:0/791500626 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee3c15c860 0x7fee3c0b5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:50.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.748+0000 7fee4119a700 1 -- 172.21.15.84:0/791500626 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee3c0c71b0 msgr2=0x7fee3c145f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:50.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.748+0000 7fee4119a700 1 --2- 172.21.15.84:0/791500626 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee3c0c71b0 0x7fee3c145f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:50.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.748+0000 7fee4119a700 1 -- 172.21.15.84:0/791500626 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee38009550 con 0x7fee3c0cf2a0 2023-07-14T11:19:50.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.749+0000 7fee4119a700 1 --2- 172.21.15.84:0/791500626 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee3c0cf2a0 0x7fee3c0c4e30 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7fee2c00c700 tx=0x7fee2c00cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:50.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.749+0000 7fee327fc700 1 -- 172.21.15.84:0/791500626 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee2c011790 con 0x7fee3c0cf2a0 2023-07-14T11:19:50.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.749+0000 7fee327fc700 1 -- 172.21.15.84:0/791500626 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee2c0118f0 con 0x7fee3c0cf2a0 2023-07-14T11:19:50.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.749+0000 7fee43bff700 1 -- 172.21.15.84:0/791500626 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee3c14fe00 con 0x7fee3c0cf2a0 2023-07-14T11:19:50.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.749+0000 7fee327fc700 1 -- 172.21.15.84:0/791500626 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee2c011ca0 con 0x7fee3c0cf2a0 2023-07-14T11:19:50.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.749+0000 7fee43bff700 1 -- 172.21.15.84:0/791500626 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee3c1503c0 con 0x7fee3c0cf2a0 2023-07-14T11:19:50.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.750+0000 7fee43bff700 1 -- 172.21.15.84:0/791500626 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee3c074350 con 0x7fee3c0cf2a0 2023-07-14T11:19:50.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.751+0000 7fee327fc700 1 -- 172.21.15.84:0/791500626 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) v1 ==== 89190+0+0 (secure 0 0 0) 0x7fee2c005080 con 0x7fee3c0cf2a0 2023-07-14T11:19:50.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.752+0000 7fee327fc700 1 --2- 172.21.15.84:0/791500626 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fee2006ae90 0x7fee2006d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:50.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.752+0000 7fee327fc700 1 -- 172.21.15.84:0/791500626 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fee2c0892b0 con 0x7fee3c0cf2a0 2023-07-14T11:19:50.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.752+0000 7fee4199b700 1 --2- 172.21.15.84:0/791500626 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fee2006ae90 0x7fee2006d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:50.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.753+0000 7fee4199b700 1 --2- 172.21.15.84:0/791500626 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fee2006ae90 0x7fee2006d340 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fee3c1602a0 tx=0x7fee38010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:50.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.756+0000 7fee327fc700 1 -- 172.21.15.84:0/791500626 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fee2c0540d0 con 0x7fee3c0cf2a0 2023-07-14T11:19:50.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.949+0000 7fee43bff700 1 -- 172.21.15.84:0/791500626 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fee3c150580 con 0x7fee3c0cf2a0 2023-07-14T11:19:50.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.949+0000 7fee327fc700 1 -- 172.21.15.84:0/791500626 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v106) v1 ==== 92+0+10 (secure 0 0 0) 0x7fee2c0576f0 con 0x7fee3c0cf2a0 2023-07-14T11:19:50.953 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-07-14T11:19:50.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.952+0000 7fee43bff700 1 -- 172.21.15.84:0/791500626 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fee2006ae90 msgr2=0x7fee2006d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:50.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.952+0000 7fee43bff700 1 --2- 172.21.15.84:0/791500626 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fee2006ae90 0x7fee2006d340 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fee3c1602a0 tx=0x7fee38010000 comp rx=0 tx=0).stop 2023-07-14T11:19:50.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.952+0000 7fee43bff700 1 -- 172.21.15.84:0/791500626 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee3c0cf2a0 msgr2=0x7fee3c0c4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:50.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.952+0000 7fee43bff700 1 --2- 172.21.15.84:0/791500626 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee3c0cf2a0 0x7fee3c0c4e30 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7fee2c00c700 tx=0x7fee2c00cac0 comp rx=0 tx=0).stop 2023-07-14T11:19:50.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.952+0000 7fee43bff700 1 -- 172.21.15.84:0/791500626 shutdown_connections 2023-07-14T11:19:50.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.952+0000 7fee43bff700 1 --2- 172.21.15.84:0/791500626 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fee2006ae90 0x7fee2006d340 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:50.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.952+0000 7fee43bff700 1 --2- 172.21.15.84:0/791500626 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee3c15c860 0x7fee3c0b5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:50.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.952+0000 7fee43bff700 1 --2- 172.21.15.84:0/791500626 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee3c0c71b0 0x7fee3c145f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:50.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.952+0000 7fee43bff700 1 --2- 172.21.15.84:0/791500626 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee3c0cf2a0 0x7fee3c0c4e30 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:50.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.952+0000 7fee43bff700 1 -- 172.21.15.84:0/791500626 >> 172.21.15.84:0/791500626 conn(0x7fee3c065bd0 msgr2=0x7fee3c159cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:50.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.952+0000 7fee43bff700 1 -- 172.21.15.84:0/791500626 shutdown_connections 2023-07-14T11:19:50.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:50.952+0000 7fee43bff700 1 -- 172.21.15.84:0/791500626 wait complete. 2023-07-14T11:19:50.973 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T11:19:51.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.167+0000 7fb664fff700 1 Processor -- start 2023-07-14T11:19:51.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.167+0000 7fb664fff700 1 -- start start 2023-07-14T11:19:51.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.168+0000 7fb664fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb6600d0b10 0x7fb6600d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:51.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.168+0000 7fb664fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6600b0e20 0x7fb6600b12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:51.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.168+0000 7fb664fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6600b8e30 con 0x7fb6600b8a60 2023-07-14T11:19:51.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.168+0000 7fb664fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6600d14d0 con 0x7fb6600d0b10 2023-07-14T11:19:51.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.168+0000 7fb664fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6600afaa0 con 0x7fb6600b0e20 2023-07-14T11:19:51.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.169+0000 7fb65ed9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6600b0e20 0x7fb6600b12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:51.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.169+0000 7fb65dd9b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb6600d0b10 0x7fb6600d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:51.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.169+0000 7fb65dd9b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb6600d0b10 0x7fb6600d0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.84:57460/0 (socket says 172.21.15.84:57460) 2023-07-14T11:19:51.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.169+0000 7fb65ed9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6600b0e20 0x7fb6600b12a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.84:38386/0 (socket says 172.21.15.84:38386) 2023-07-14T11:19:51.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.169+0000 7fb65e59c700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fb6600b8a60 0x7fb6600b3ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.84:43364/0 (socket says 172.21.15.84:43364) 2023-07-14T11:19:51.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.169+0000 7fb65dd9b700 1 -- 172.21.15.84:0/3845515341 learned_addr learned my addr 172.21.15.84:0/3845515341 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:51.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.169+0000 7fb65d59a700 1 -- 172.21.15.84:0/3845515341 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3955719257 0 0) 0x7fb6600b8e30 con 0x7fb6600b8a60 2023-07-14T11:19:51.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.169+0000 7fb65d59a700 1 -- 172.21.15.84:0/3845515341 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6480035b0 con 0x7fb6600b8a60 2023-07-14T11:19:51.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.169+0000 7fb65dd9b700 1 -- 172.21.15.84:0/3845515341 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6600b0e20 msgr2=0x7fb6600b12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:51.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.169+0000 7fb65dd9b700 1 --2- 172.21.15.84:0/3845515341 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6600b0e20 0x7fb6600b12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:51.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.169+0000 7fb65dd9b700 1 -- 172.21.15.84:0/3845515341 >> v1:172.21.15.179:6789/0 conn(0x7fb6600b8a60 legacy=0x7fb6600b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:51.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.169+0000 7fb65dd9b700 1 -- 172.21.15.84:0/3845515341 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6600afd80 con 0x7fb6600d0b10 2023-07-14T11:19:51.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.170+0000 7fb65ed9d700 1 --2- 172.21.15.84:0/3845515341 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6600b0e20 0x7fb6600b12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:19:51.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.170+0000 7fb65dd9b700 1 --2- 172.21.15.84:0/3845515341 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6600d0b10 0x7fb6600d0f90 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fb6540098f0 tx=0x7fb654009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72224f3e0c795f3d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:51.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.170+0000 7fb65d59a700 1 -- 172.21.15.84:0/3845515341 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb654011830 con 0x7fb6600d0b10 2023-07-14T11:19:51.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.170+0000 7fb65d59a700 1 -- 172.21.15.84:0/3845515341 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb654011990 con 0x7fb6600d0b10 2023-07-14T11:19:51.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.170+0000 7fb65d59a700 1 -- 172.21.15.84:0/3845515341 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb654011d20 con 0x7fb6600d0b10 2023-07-14T11:19:51.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.171+0000 7fb664fff700 1 -- 172.21.15.84:0/3845515341 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6600d0b10 msgr2=0x7fb6600d0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:51.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.171+0000 7fb664fff700 1 --2- 172.21.15.84:0/3845515341 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6600d0b10 0x7fb6600d0f90 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fb6540098f0 tx=0x7fb654009c00 comp rx=0 tx=0).stop 2023-07-14T11:19:51.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.171+0000 7fb664fff700 1 -- 172.21.15.84:0/3845515341 shutdown_connections 2023-07-14T11:19:51.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.171+0000 7fb664fff700 1 --2- 172.21.15.84:0/3845515341 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6600b0e20 0x7fb6600b12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:51.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.171+0000 7fb664fff700 1 --2- 172.21.15.84:0/3845515341 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6600d0b10 0x7fb6600d0f90 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:51.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.171+0000 7fb664fff700 1 -- 172.21.15.84:0/3845515341 >> 172.21.15.84:0/3845515341 conn(0x7fb66009c1b0 msgr2=0x7fb6600d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:51.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.171+0000 7fb664fff700 1 -- 172.21.15.84:0/3845515341 shutdown_connections 2023-07-14T11:19:51.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.171+0000 7fb664fff700 1 -- 172.21.15.84:0/3845515341 wait complete. 2023-07-14T11:19:51.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.172+0000 7fb664fff700 1 Processor -- start 2023-07-14T11:19:51.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.173+0000 7fb664fff700 1 -- start start 2023-07-14T11:19:51.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.173+0000 7fb664fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6600b0e20 0x7fb6601efb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:51.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.173+0000 7fb664fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6600b8a60 0x7fb6601f56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:51.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.173+0000 7fb664fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6600d0b10 0x7fb6600cf950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:51.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.173+0000 7fb664fff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6600d06d0 con 0x7fb6600d0b10 2023-07-14T11:19:51.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.173+0000 7fb664fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb660158f10 con 0x7fb6600b8a60 2023-07-14T11:19:51.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.173+0000 7fb664fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6600d03f0 con 0x7fb6600b0e20 2023-07-14T11:19:51.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.174+0000 7fb65ed9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6600d0b10 0x7fb6600cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:51.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.174+0000 7fb65ed9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6600d0b10 0x7fb6600cf950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34212/0 (socket says 172.21.15.84:34212) 2023-07-14T11:19:51.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.174+0000 7fb65ed9d700 1 -- 172.21.15.84:0/2259977796 learned_addr learned my addr 172.21.15.84:0/2259977796 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:51.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.174+0000 7fb65e59c700 1 --2- 172.21.15.84:0/2259977796 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6600b0e20 0x7fb6601efb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:51.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.174+0000 7fb65dd9b700 1 --2- 172.21.15.84:0/2259977796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6600b8a60 0x7fb6601f56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:51.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.174+0000 7fb65ed9d700 1 -- 172.21.15.84:0/2259977796 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6600b0e20 msgr2=0x7fb6601efb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:51.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.174+0000 7fb65ed9d700 1 --2- 172.21.15.84:0/2259977796 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6600b0e20 0x7fb6601efb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:51.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.174+0000 7fb65ed9d700 1 -- 172.21.15.84:0/2259977796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6600b8a60 msgr2=0x7fb6601f56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:51.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.174+0000 7fb65ed9d700 1 --2- 172.21.15.84:0/2259977796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6600b8a60 0x7fb6601f56b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:51.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.174+0000 7fb65ed9d700 1 -- 172.21.15.84:0/2259977796 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb658009a70 con 0x7fb6600d0b10 2023-07-14T11:19:51.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.175+0000 7fb65ed9d700 1 --2- 172.21.15.84:0/2259977796 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6600d0b10 0x7fb6600cf950 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7fb65800efc0 tx=0x7fb65800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:51.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.175+0000 7fb64effd700 1 -- 172.21.15.84:0/2259977796 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb65800ca90 con 0x7fb6600d0b10 2023-07-14T11:19:51.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.175+0000 7fb64effd700 1 -- 172.21.15.84:0/2259977796 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb65800f040 con 0x7fb6600d0b10 2023-07-14T11:19:51.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.175+0000 7fb64effd700 1 -- 172.21.15.84:0/2259977796 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb65800ce10 con 0x7fb6600d0b10 2023-07-14T11:19:51.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.175+0000 7fb664fff700 1 -- 172.21.15.84:0/2259977796 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb654009550 con 0x7fb6600d0b10 2023-07-14T11:19:51.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.175+0000 7fb664fff700 1 -- 172.21.15.84:0/2259977796 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb660159490 con 0x7fb6600d0b10 2023-07-14T11:19:51.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.176+0000 7fb664fff700 1 -- 172.21.15.84:0/2259977796 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb660158d70 con 0x7fb6600d0b10 2023-07-14T11:19:51.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.177+0000 7fb64effd700 1 -- 172.21.15.84:0/2259977796 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) v1 ==== 89190+0+0 (secure 0 0 0) 0x7fb658014480 con 0x7fb6600d0b10 2023-07-14T11:19:51.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.178+0000 7fb64effd700 1 --2- 172.21.15.84:0/2259977796 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fb64006ae90 0x7fb64006d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:51.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.178+0000 7fb64effd700 1 -- 172.21.15.84:0/2259977796 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb658089e60 con 0x7fb6600d0b10 2023-07-14T11:19:51.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.178+0000 7fb65e59c700 1 --2- 172.21.15.84:0/2259977796 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fb64006ae90 0x7fb64006d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:51.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.179+0000 7fb65e59c700 1 --2- 172.21.15.84:0/2259977796 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fb64006ae90 0x7fb64006d340 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb650007fd0 tx=0x7fb650007dc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:51.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.182+0000 7fb64effd700 1 -- 172.21.15.84:0/2259977796 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fb660158d70 con 0x7fb6600d0b10 2023-07-14T11:19:51.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.374+0000 7fb664fff700 1 -- 172.21.15.84:0/2259977796 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb660158d70 con 0x7fb6600d0b10 2023-07-14T11:19:51.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.374+0000 7fb64effd700 1 -- 172.21.15.84:0/2259977796 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v106) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb660158d70 con 0x7fb6600d0b10 2023-07-14T11:19:51.378 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-07-14T11:19:51.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.376+0000 7fb664fff700 1 -- 172.21.15.84:0/2259977796 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fb64006ae90 msgr2=0x7fb64006d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:51.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.376+0000 7fb664fff700 1 --2- 172.21.15.84:0/2259977796 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fb64006ae90 0x7fb64006d340 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb650007fd0 tx=0x7fb650007dc0 comp rx=0 tx=0).stop 2023-07-14T11:19:51.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.376+0000 7fb664fff700 1 -- 172.21.15.84:0/2259977796 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6600d0b10 msgr2=0x7fb6600cf950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:51.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.376+0000 7fb664fff700 1 --2- 172.21.15.84:0/2259977796 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6600d0b10 0x7fb6600cf950 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7fb65800efc0 tx=0x7fb65800c3a0 comp rx=0 tx=0).stop 2023-07-14T11:19:51.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.376+0000 7fb664fff700 1 -- 172.21.15.84:0/2259977796 shutdown_connections 2023-07-14T11:19:51.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.376+0000 7fb664fff700 1 --2- 172.21.15.84:0/2259977796 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fb64006ae90 0x7fb64006d340 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:51.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.376+0000 7fb664fff700 1 --2- 172.21.15.84:0/2259977796 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6600b0e20 0x7fb6601efb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:51.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.376+0000 7fb664fff700 1 --2- 172.21.15.84:0/2259977796 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6600d0b10 0x7fb6600cf950 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:51.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.376+0000 7fb664fff700 1 --2- 172.21.15.84:0/2259977796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6600b8a60 0x7fb6601f56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:51.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.376+0000 7fb664fff700 1 -- 172.21.15.84:0/2259977796 >> 172.21.15.84:0/2259977796 conn(0x7fb66009c1b0 msgr2=0x7fb66006a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:51.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.377+0000 7fb664fff700 1 -- 172.21.15.84:0/2259977796 shutdown_connections 2023-07-14T11:19:51.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.377+0000 7fb664fff700 1 -- 172.21.15.84:0/2259977796 wait complete. 2023-07-14T11:19:51.397 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T11:19:51.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.593+0000 7f65419ff700 1 Processor -- start 2023-07-14T11:19:51.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.593+0000 7f65419ff700 1 -- start start 2023-07-14T11:19:51.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.594+0000 7f65419ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f653c158bb0 0x7f653c0cd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:51.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.594+0000 7f65419ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f653c0cbe40 0x7f653c0cda40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:51.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.594+0000 7f65419ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f653c0cdf80 0x7f653c15c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:51.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.595+0000 7f65419ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f653c06b5b0 con 0x7f653c0cbe40 2023-07-14T11:19:51.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.595+0000 7f65419ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f653c071500 con 0x7f653c158bb0 2023-07-14T11:19:51.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.595+0000 7f65419ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f653c0ce3e0 con 0x7f653c0cdf80 2023-07-14T11:19:51.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.595+0000 7f6533fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f653c0cbe40 0x7f653c0cda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:51.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.595+0000 7f6533fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f653c0cbe40 0x7f653c0cda40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34220/0 (socket says 172.21.15.84:34220) 2023-07-14T11:19:51.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.595+0000 7f6533fff700 1 -- 172.21.15.84:0/1511207350 learned_addr learned my addr 172.21.15.84:0/1511207350 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:51.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.595+0000 7f653b7fe700 1 --2- 172.21.15.84:0/1511207350 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f653c0cdf80 0x7f653c15c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:51.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.595+0000 7f653affd700 1 --2- 172.21.15.84:0/1511207350 >> v2:172.21.15.179:3300/0 conn(0x7f653c158bb0 0x7f653c0cd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:51.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.595+0000 7f6533fff700 1 -- 172.21.15.84:0/1511207350 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f653c0cdf80 msgr2=0x7f653c15c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:51.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.595+0000 7f6533fff700 1 --2- 172.21.15.84:0/1511207350 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f653c0cdf80 0x7f653c15c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:51.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.595+0000 7f6533fff700 1 -- 172.21.15.84:0/1511207350 >> v2:172.21.15.179:3300/0 conn(0x7f653c158bb0 msgr2=0x7f653c0cd0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:51.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.595+0000 7f6533fff700 1 --2- 172.21.15.84:0/1511207350 >> v2:172.21.15.179:3300/0 conn(0x7f653c158bb0 0x7f653c0cd0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:51.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.595+0000 7f6533fff700 1 -- 172.21.15.84:0/1511207350 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f653c0ce8c0 con 0x7f653c0cbe40 2023-07-14T11:19:51.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.595+0000 7f6533fff700 1 --2- 172.21.15.84:0/1511207350 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f653c0cbe40 0x7f653c0cda40 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f653c06f630 tx=0x7f6524009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f8916f4c4627102 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:51.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.596+0000 7f653a7fc700 1 -- 172.21.15.84:0/1511207350 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f652400b860 con 0x7f653c0cbe40 2023-07-14T11:19:51.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.596+0000 7f653a7fc700 1 -- 172.21.15.84:0/1511207350 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f652400b9c0 con 0x7f653c0cbe40 2023-07-14T11:19:51.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.596+0000 7f653a7fc700 1 -- 172.21.15.84:0/1511207350 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f652400bd50 con 0x7f653c0cbe40 2023-07-14T11:19:51.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.596+0000 7f65419ff700 1 -- 172.21.15.84:0/1511207350 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f653c0cbe40 msgr2=0x7f653c0cda40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:51.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.596+0000 7f65419ff700 1 --2- 172.21.15.84:0/1511207350 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f653c0cbe40 0x7f653c0cda40 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f653c06f630 tx=0x7f6524009c00 comp rx=0 tx=0).stop 2023-07-14T11:19:51.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.596+0000 7f65419ff700 1 -- 172.21.15.84:0/1511207350 shutdown_connections 2023-07-14T11:19:51.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.596+0000 7f65419ff700 1 --2- 172.21.15.84:0/1511207350 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f653c0cdf80 0x7f653c15c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:51.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.596+0000 7f65419ff700 1 --2- 172.21.15.84:0/1511207350 >> v2:172.21.15.179:3300/0 conn(0x7f653c158bb0 0x7f653c0cd0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:51.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.596+0000 7f65419ff700 1 --2- 172.21.15.84:0/1511207350 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f653c0cbe40 0x7f653c0cda40 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:51.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.596+0000 7f65419ff700 1 -- 172.21.15.84:0/1511207350 >> 172.21.15.84:0/1511207350 conn(0x7f653c0b05d0 msgr2=0x7f653c0b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:51.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.596+0000 7f65419ff700 1 -- 172.21.15.84:0/1511207350 shutdown_connections 2023-07-14T11:19:51.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.596+0000 7f65419ff700 1 -- 172.21.15.84:0/1511207350 wait complete. 2023-07-14T11:19:51.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.598+0000 7f65419ff700 1 Processor -- start 2023-07-14T11:19:51.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.598+0000 7f65419ff700 1 -- start start 2023-07-14T11:19:51.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.599+0000 7f65419ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f653c0cbe40 0x7f653c0c86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:51.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.599+0000 7f65419ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f653c0cdf80 0x7f653c15c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:51.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.599+0000 7f65419ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f653c158bb0 0x7f653c15ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:51.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.599+0000 7f65419ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f653c1f3130 con 0x7f653c158bb0 2023-07-14T11:19:51.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.599+0000 7f65419ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f653c15b5c0 con 0x7f653c0cbe40 2023-07-14T11:19:51.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.599+0000 7f65419ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f653c0c8c20 con 0x7f653c0cdf80 2023-07-14T11:19:51.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.599+0000 7f653b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f653c158bb0 0x7f653c15ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:51.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.599+0000 7f653b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f653c158bb0 0x7f653c15ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34222/0 (socket says 172.21.15.84:34222) 2023-07-14T11:19:51.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.599+0000 7f653b7fe700 1 -- 172.21.15.84:0/475796416 learned_addr learned my addr 172.21.15.84:0/475796416 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:51.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.600+0000 7f6533fff700 1 --2- 172.21.15.84:0/475796416 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f653c0cdf80 0x7f653c15c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:51.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.600+0000 7f653affd700 1 --2- 172.21.15.84:0/475796416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f653c0cbe40 0x7f653c0c86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:51.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.600+0000 7f653b7fe700 1 -- 172.21.15.84:0/475796416 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f653c0cdf80 msgr2=0x7f653c15c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:51.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.600+0000 7f653b7fe700 1 --2- 172.21.15.84:0/475796416 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f653c0cdf80 0x7f653c15c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:51.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.600+0000 7f653b7fe700 1 -- 172.21.15.84:0/475796416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f653c0cbe40 msgr2=0x7f653c0c86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:51.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.600+0000 7f653b7fe700 1 --2- 172.21.15.84:0/475796416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f653c0cbe40 0x7f653c0c86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:51.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.600+0000 7f653b7fe700 1 -- 172.21.15.84:0/475796416 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6524009550 con 0x7f653c158bb0 2023-07-14T11:19:51.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.600+0000 7f653affd700 1 --2- 172.21.15.84:0/475796416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f653c0cbe40 0x7f653c0c86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:19:51.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.600+0000 7f653b7fe700 1 --2- 172.21.15.84:0/475796416 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f653c158bb0 0x7f653c15ca10 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f6534007e40 tx=0x7f653400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:51.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.600+0000 7f6538ff9700 1 -- 172.21.15.84:0/475796416 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f653400ede0 con 0x7f653c158bb0 2023-07-14T11:19:51.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.600+0000 7f6538ff9700 1 -- 172.21.15.84:0/475796416 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6534014420 con 0x7f653c158bb0 2023-07-14T11:19:51.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.600+0000 7f65419ff700 1 -- 172.21.15.84:0/475796416 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f653c1f2e50 con 0x7f653c158bb0 2023-07-14T11:19:51.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.600+0000 7f6538ff9700 1 -- 172.21.15.84:0/475796416 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65340147d0 con 0x7f653c158bb0 2023-07-14T11:19:51.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.600+0000 7f65419ff700 1 -- 172.21.15.84:0/475796416 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f653c1f5c20 con 0x7f653c158bb0 2023-07-14T11:19:51.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.601+0000 7f65419ff700 1 -- 172.21.15.84:0/475796416 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f653c066a90 con 0x7f653c158bb0 2023-07-14T11:19:51.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.602+0000 7f6538ff9700 1 -- 172.21.15.84:0/475796416 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f6534014930 con 0x7f653c158bb0 2023-07-14T11:19:51.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.604+0000 7f6538ff9700 1 --2- 172.21.15.84:0/475796416 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f651c06ae90 0x7f651c06d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:51.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.604+0000 7f6538ff9700 1 -- 172.21.15.84:0/475796416 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6534089e90 con 0x7f653c158bb0 2023-07-14T11:19:51.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.604+0000 7f653affd700 1 --2- 172.21.15.84:0/475796416 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f651c06ae90 0x7f651c06d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:51.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.605+0000 7f653affd700 1 --2- 172.21.15.84:0/475796416 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f651c06ae90 0x7f651c06d340 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f652c00ba40 tx=0x7f652c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:51.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.608+0000 7f6538ff9700 1 -- 172.21.15.84:0/475796416 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f6534054d50 con 0x7f653c158bb0 2023-07-14T11:19:51.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.799+0000 7f65419ff700 1 -- 172.21.15.84:0/475796416 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f653c0caae0 con 0x7f653c158bb0 2023-07-14T11:19:51.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.800+0000 7f6538ff9700 1 -- 172.21.15.84:0/475796416 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v106) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6534058370 con 0x7f653c158bb0 2023-07-14T11:19:51.804 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-07-14T11:19:51.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.802+0000 7f65419ff700 1 -- 172.21.15.84:0/475796416 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f651c06ae90 msgr2=0x7f651c06d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:51.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.802+0000 7f65419ff700 1 --2- 172.21.15.84:0/475796416 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f651c06ae90 0x7f651c06d340 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f652c00ba40 tx=0x7f652c008040 comp rx=0 tx=0).stop 2023-07-14T11:19:51.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.802+0000 7f65419ff700 1 -- 172.21.15.84:0/475796416 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f653c158bb0 msgr2=0x7f653c15ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:51.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.802+0000 7f65419ff700 1 --2- 172.21.15.84:0/475796416 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f653c158bb0 0x7f653c15ca10 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f6534007e40 tx=0x7f653400e3c0 comp rx=0 tx=0).stop 2023-07-14T11:19:51.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.802+0000 7f65419ff700 1 -- 172.21.15.84:0/475796416 shutdown_connections 2023-07-14T11:19:51.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.802+0000 7f65419ff700 1 --2- 172.21.15.84:0/475796416 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f653c158bb0 0x7f653c15ca10 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:51.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.802+0000 7f65419ff700 1 --2- 172.21.15.84:0/475796416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f653c0cbe40 0x7f653c0c86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:51.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.802+0000 7f65419ff700 1 --2- 172.21.15.84:0/475796416 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f651c06ae90 0x7f651c06d340 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:51.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.802+0000 7f65419ff700 1 --2- 172.21.15.84:0/475796416 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f653c0cdf80 0x7f653c15c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:51.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.802+0000 7f65419ff700 1 -- 172.21.15.84:0/475796416 >> 172.21.15.84:0/475796416 conn(0x7f653c0b05d0 msgr2=0x7f653c06c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:51.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.802+0000 7f65419ff700 1 -- 172.21.15.84:0/475796416 shutdown_connections 2023-07-14T11:19:51.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:51.802+0000 7f65419ff700 1 -- 172.21.15.84:0/475796416 wait complete. 2023-07-14T11:19:51.823 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T11:19:52.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.017+0000 7fb5993ff700 1 Processor -- start 2023-07-14T11:19:52.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.017+0000 7fb5993ff700 1 -- start start 2023-07-14T11:19:52.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.018+0000 7fb5993ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb59415afd0 0x7fb5940cee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:52.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.018+0000 7fb5993ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5940ce110 con 0x7fb59415e890 2023-07-14T11:19:52.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.018+0000 7fb5993ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb59415b660 con 0x7fb5940b3e90 2023-07-14T11:19:52.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.018+0000 7fb5993ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb59415b470 con 0x7fb59415afd0 2023-07-14T11:19:52.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.019+0000 7fb592ffd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fb59415e890 0x7fb5940b3780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:35040/0 (socket says 172.21.15.84:35040) 2023-07-14T11:19:52.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.019+0000 7fb592ffd700 1 -- 172.21.15.84:0/4223676768 learned_addr learned my addr 172.21.15.84:0/4223676768 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:19:52.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.019+0000 7fb5937fe700 1 --2- 172.21.15.84:0/4223676768 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb59415afd0 0x7fb5940cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:52.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.019+0000 7fb591ffb700 1 -- 172.21.15.84:0/4223676768 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 258122652 0 0) 0x7fb5940ce110 con 0x7fb59415e890 2023-07-14T11:19:52.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.019+0000 7fb591ffb700 1 -- 172.21.15.84:0/4223676768 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb57c0035b0 con 0x7fb59415e890 2023-07-14T11:19:52.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.019+0000 7fb591ffb700 1 -- 172.21.15.84:0/4223676768 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 623597276 0 0) 0x7fb59415b660 con 0x7fb5940b3e90 2023-07-14T11:19:52.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.019+0000 7fb591ffb700 1 -- 172.21.15.84:0/4223676768 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5940ce110 con 0x7fb5940b3e90 2023-07-14T11:19:52.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.019+0000 7fb5937fe700 1 -- 172.21.15.84:0/4223676768 >> v1:172.21.15.179:6789/0 conn(0x7fb5940b3e90 legacy=0x7fb59415a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:52.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.019+0000 7fb5937fe700 1 -- 172.21.15.84:0/4223676768 >> v1:172.21.15.84:6789/0 conn(0x7fb59415e890 legacy=0x7fb5940b3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:52.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.019+0000 7fb5937fe700 1 -- 172.21.15.84:0/4223676768 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5940ce360 con 0x7fb59415afd0 2023-07-14T11:19:52.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.020+0000 7fb5937fe700 1 --2- 172.21.15.84:0/4223676768 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb59415afd0 0x7fb5940cee40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb58c009dc0 tx=0x7fb58c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49572236c9b31914 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:52.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.020+0000 7fb591ffb700 1 -- 172.21.15.84:0/4223676768 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58c00e070 con 0x7fb59415afd0 2023-07-14T11:19:52.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.020+0000 7fb591ffb700 1 -- 172.21.15.84:0/4223676768 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb58c00bb20 con 0x7fb59415afd0 2023-07-14T11:19:52.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.020+0000 7fb591ffb700 1 -- 172.21.15.84:0/4223676768 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58c012430 con 0x7fb59415afd0 2023-07-14T11:19:52.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.020+0000 7fb5993ff700 1 -- 172.21.15.84:0/4223676768 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb59415afd0 msgr2=0x7fb5940cee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:52.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.020+0000 7fb5993ff700 1 --2- 172.21.15.84:0/4223676768 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb59415afd0 0x7fb5940cee40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb58c009dc0 tx=0x7fb58c00b330 comp rx=0 tx=0).stop 2023-07-14T11:19:52.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.021+0000 7fb5993ff700 1 -- 172.21.15.84:0/4223676768 shutdown_connections 2023-07-14T11:19:52.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.021+0000 7fb5993ff700 1 --2- 172.21.15.84:0/4223676768 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb59415afd0 0x7fb5940cee40 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:52.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.021+0000 7fb5993ff700 1 -- 172.21.15.84:0/4223676768 >> 172.21.15.84:0/4223676768 conn(0x7fb594069f30 msgr2=0x7fb59406a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:52.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.021+0000 7fb5993ff700 1 -- 172.21.15.84:0/4223676768 shutdown_connections 2023-07-14T11:19:52.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.021+0000 7fb5993ff700 1 -- 172.21.15.84:0/4223676768 wait complete. 2023-07-14T11:19:52.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.022+0000 7fb5993ff700 1 Processor -- start 2023-07-14T11:19:52.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.022+0000 7fb5993ff700 1 -- start start 2023-07-14T11:19:52.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.023+0000 7fb5993ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5940b3e90 0x7fb594070280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:52.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.023+0000 7fb5993ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb59415afd0 0x7fb59414b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:52.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.023+0000 7fb5993ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb59415e890 0x7fb59414b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:52.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.023+0000 7fb5993ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5940711b0 con 0x7fb59415afd0 2023-07-14T11:19:52.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.023+0000 7fb5993ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb594138250 con 0x7fb5940b3e90 2023-07-14T11:19:52.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.023+0000 7fb5993ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb594070910 con 0x7fb59415e890 2023-07-14T11:19:52.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.024+0000 7fb5927fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb59415afd0 0x7fb59414b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:52.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.024+0000 7fb592ffd700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5940b3e90 0x7fb594070280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:52.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.024+0000 7fb5927fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb59415afd0 0x7fb59414b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34228/0 (socket says 172.21.15.84:34228) 2023-07-14T11:19:52.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.024+0000 7fb5927fc700 1 -- 172.21.15.84:0/3861684068 learned_addr learned my addr 172.21.15.84:0/3861684068 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:52.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.024+0000 7fb5937fe700 1 --2- 172.21.15.84:0/3861684068 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb59415e890 0x7fb59414b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:52.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.024+0000 7fb5927fc700 1 -- 172.21.15.84:0/3861684068 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb59415e890 msgr2=0x7fb59414b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:52.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.024+0000 7fb5927fc700 1 --2- 172.21.15.84:0/3861684068 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb59415e890 0x7fb59414b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:52.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.024+0000 7fb5927fc700 1 -- 172.21.15.84:0/3861684068 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5940b3e90 msgr2=0x7fb594070280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:52.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.024+0000 7fb5927fc700 1 --2- 172.21.15.84:0/3861684068 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5940b3e90 0x7fb594070280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:52.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.024+0000 7fb5927fc700 1 -- 172.21.15.84:0/3861684068 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb58c009a70 con 0x7fb59415afd0 2023-07-14T11:19:52.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.024+0000 7fb5927fc700 1 --2- 172.21.15.84:0/3861684068 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb59415afd0 0x7fb59414b0d0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7fb58800c450 tx=0x7fb58800c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:52.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.025+0000 7fb57b7fe700 1 -- 172.21.15.84:0/3861684068 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5880052d0 con 0x7fb59415afd0 2023-07-14T11:19:52.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.025+0000 7fb57b7fe700 1 -- 172.21.15.84:0/3861684068 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb588005430 con 0x7fb59415afd0 2023-07-14T11:19:52.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.025+0000 7fb57b7fe700 1 -- 172.21.15.84:0/3861684068 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5880038c0 con 0x7fb59415afd0 2023-07-14T11:19:52.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.025+0000 7fb5993ff700 1 -- 172.21.15.84:0/3861684068 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb594070bf0 con 0x7fb59415afd0 2023-07-14T11:19:52.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.025+0000 7fb5993ff700 1 -- 172.21.15.84:0/3861684068 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb59414bdf0 con 0x7fb59415afd0 2023-07-14T11:19:52.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.026+0000 7fb5993ff700 1 -- 172.21.15.84:0/3861684068 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb59404e280 con 0x7fb59415afd0 2023-07-14T11:19:52.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.027+0000 7fb57b7fe700 1 -- 172.21.15.84:0/3861684068 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) v1 ==== 89190+0+0 (secure 0 0 0) 0x7fb588003a20 con 0x7fb59415afd0 2023-07-14T11:19:52.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.027+0000 7fb57b7fe700 1 --2- 172.21.15.84:0/3861684068 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fb58006ae90 0x7fb58006d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:52.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.028+0000 7fb57b7fe700 1 -- 172.21.15.84:0/3861684068 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb588088a30 con 0x7fb59415afd0 2023-07-14T11:19:52.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.028+0000 7fb592ffd700 1 --2- 172.21.15.84:0/3861684068 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fb58006ae90 0x7fb58006d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:52.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.029+0000 7fb592ffd700 1 --2- 172.21.15.84:0/3861684068 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fb58006ae90 0x7fb58006d340 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb584007fd0 tx=0x7fb584007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:52.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.032+0000 7fb57b7fe700 1 -- 172.21.15.84:0/3861684068 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fb5880539b0 con 0x7fb59415afd0 2023-07-14T11:19:52.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.267+0000 7fb5993ff700 1 -- 172.21.15.84:0/3861684068 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb5940b2bb0 con 0x7fb59415afd0 2023-07-14T11:19:52.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.268+0000 7fb57b7fe700 1 -- 172.21.15.84:0/3861684068 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4711 (secure 0 0 0) 0x7fb58800ce60 con 0x7fb59415afd0 2023-07-14T11:19:52.271 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:19:52.272 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":70,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6197,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/396743399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":396743399},{"type":"v1","addr":"172.21.15.179:6835","nonce":396743399}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":7105,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3729505201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3729505201},{"type":"v1","addr":"172.21.15.179:6834","nonce":3729505201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":7680,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6833/411491873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":411491873},{"type":"v1","addr":"172.21.15.84:6833","nonce":411491873}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T11:19:24.441292+0000","modified":"2023-07-14T11:19:27.974517+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7683},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7683":{"gid":7683,"name":"c","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6835/2350815422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2350815422},{"type":"v1","addr":"172.21.15.84:6835","nonce":2350815422}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-07-14T11:19:52.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.270+0000 7fb5993ff700 1 -- 172.21.15.84:0/3861684068 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fb58006ae90 msgr2=0x7fb58006d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:52.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.270+0000 7fb5993ff700 1 --2- 172.21.15.84:0/3861684068 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fb58006ae90 0x7fb58006d340 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb584007fd0 tx=0x7fb584007de0 comp rx=0 tx=0).stop 2023-07-14T11:19:52.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.270+0000 7fb5993ff700 1 -- 172.21.15.84:0/3861684068 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb59415afd0 msgr2=0x7fb59414b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:52.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.270+0000 7fb5993ff700 1 --2- 172.21.15.84:0/3861684068 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb59415afd0 0x7fb59414b0d0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7fb58800c450 tx=0x7fb58800c760 comp rx=0 tx=0).stop 2023-07-14T11:19:52.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.270+0000 7fb5993ff700 1 -- 172.21.15.84:0/3861684068 shutdown_connections 2023-07-14T11:19:52.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.270+0000 7fb5993ff700 1 --2- 172.21.15.84:0/3861684068 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fb58006ae90 0x7fb58006d340 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:52.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.270+0000 7fb5993ff700 1 --2- 172.21.15.84:0/3861684068 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb59415e890 0x7fb59414b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:52.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.270+0000 7fb5993ff700 1 --2- 172.21.15.84:0/3861684068 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5940b3e90 0x7fb594070280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:52.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.270+0000 7fb5993ff700 1 --2- 172.21.15.84:0/3861684068 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb59415afd0 0x7fb59414b0d0 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:52.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.270+0000 7fb5993ff700 1 -- 172.21.15.84:0/3861684068 >> 172.21.15.84:0/3861684068 conn(0x7fb594069f30 msgr2=0x7fb59415a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:52.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.270+0000 7fb5993ff700 1 -- 172.21.15.84:0/3861684068 shutdown_connections 2023-07-14T11:19:52.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.270+0000 7fb5993ff700 1 -- 172.21.15.84:0/3861684068 wait complete. 2023-07-14T11:19:52.276 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 70 2023-07-14T11:19:52.292 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:19:52.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.486+0000 7f2ad95ff700 1 Processor -- start 2023-07-14T11:19:52.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.486+0000 7f2ad95ff700 1 -- start start 2023-07-14T11:19:52.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.487+0000 7f2ad95ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2ad41592e0 0x7f2ad40adea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:52.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.487+0000 7f2ad95ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2ad40ad950 0x7f2ad40b0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:52.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.487+0000 7f2ad95ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ad40b09c0 0x7f2ad40cd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:52.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.487+0000 7f2ad95ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ad40ca2e0 con 0x7f2ad41592e0 2023-07-14T11:19:52.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.487+0000 7f2ad95ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ad40b0e00 con 0x7f2ad40ad950 2023-07-14T11:19:52.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.487+0000 7f2ad95ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad41596b0 con 0x7f2ad40b09c0 2023-07-14T11:19:52.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.487+0000 7f2ad2ffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2ad41592e0 0x7f2ad40adea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:52.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.487+0000 7f2ad2ffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2ad41592e0 0x7f2ad40adea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34240/0 (socket says 172.21.15.84:34240) 2023-07-14T11:19:52.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.487+0000 7f2ad2ffd700 1 -- 172.21.15.84:0/3147172006 learned_addr learned my addr 172.21.15.84:0/3147172006 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:52.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.487+0000 7f2acbfff700 1 --2- 172.21.15.84:0/3147172006 >> v2:172.21.15.179:3300/0 conn(0x7f2ad40ad950 0x7f2ad40b0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:52.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.487+0000 7f2ad37fe700 1 --2- 172.21.15.84:0/3147172006 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ad40b09c0 0x7f2ad40cd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:52.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.488+0000 7f2ad2ffd700 1 -- 172.21.15.84:0/3147172006 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ad40b09c0 msgr2=0x7f2ad40cd5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:52.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.488+0000 7f2ad2ffd700 1 --2- 172.21.15.84:0/3147172006 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ad40b09c0 0x7f2ad40cd5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:52.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.488+0000 7f2ad2ffd700 1 -- 172.21.15.84:0/3147172006 >> v2:172.21.15.179:3300/0 conn(0x7f2ad40ad950 msgr2=0x7f2ad40b0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:52.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.488+0000 7f2ad2ffd700 1 --2- 172.21.15.84:0/3147172006 >> v2:172.21.15.179:3300/0 conn(0x7f2ad40ad950 0x7f2ad40b0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:52.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.488+0000 7f2ad2ffd700 1 -- 172.21.15.84:0/3147172006 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad40c96d0 con 0x7f2ad41592e0 2023-07-14T11:19:52.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.488+0000 7f2ad2ffd700 1 --2- 172.21.15.84:0/3147172006 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ad41592e0 0x7f2ad40adea0 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f2ad4073bf0 tx=0x7f2ac4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fca310007868271 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:52.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.488+0000 7f2ad27fc700 1 -- 172.21.15.84:0/3147172006 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac4011830 con 0x7f2ad41592e0 2023-07-14T11:19:52.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.488+0000 7f2ad27fc700 1 -- 172.21.15.84:0/3147172006 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ac4011990 con 0x7f2ad41592e0 2023-07-14T11:19:52.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.488+0000 7f2ad27fc700 1 -- 172.21.15.84:0/3147172006 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac4011d20 con 0x7f2ad41592e0 2023-07-14T11:19:52.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.489+0000 7f2ad95ff700 1 -- 172.21.15.84:0/3147172006 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ad41592e0 msgr2=0x7f2ad40adea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:52.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.489+0000 7f2ad95ff700 1 --2- 172.21.15.84:0/3147172006 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ad41592e0 0x7f2ad40adea0 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f2ad4073bf0 tx=0x7f2ac4009bd0 comp rx=0 tx=0).stop 2023-07-14T11:19:52.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.489+0000 7f2ad95ff700 1 -- 172.21.15.84:0/3147172006 shutdown_connections 2023-07-14T11:19:52.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.489+0000 7f2ad95ff700 1 --2- 172.21.15.84:0/3147172006 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ad40b09c0 0x7f2ad40cd5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:52.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.489+0000 7f2ad95ff700 1 --2- 172.21.15.84:0/3147172006 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ad41592e0 0x7f2ad40adea0 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:52.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.489+0000 7f2ad95ff700 1 --2- 172.21.15.84:0/3147172006 >> v2:172.21.15.179:3300/0 conn(0x7f2ad40ad950 0x7f2ad40b0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:52.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.489+0000 7f2ad95ff700 1 -- 172.21.15.84:0/3147172006 >> 172.21.15.84:0/3147172006 conn(0x7f2ad40ce980 msgr2=0x7f2ad40ced50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:52.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.489+0000 7f2ad95ff700 1 -- 172.21.15.84:0/3147172006 shutdown_connections 2023-07-14T11:19:52.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.489+0000 7f2ad95ff700 1 -- 172.21.15.84:0/3147172006 wait complete. 2023-07-14T11:19:52.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.491+0000 7f2ad95ff700 1 Processor -- start 2023-07-14T11:19:52.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.491+0000 7f2ad95ff700 1 -- start start 2023-07-14T11:19:52.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.492+0000 7f2ad95ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ad40ad950 0x7f2ad41f5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:52.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.492+0000 7f2ad95ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ad40b09c0 0x7f2ad4159880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:52.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.492+0000 7f2ad95ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ad41592e0 0x7f2ad414e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:52.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.492+0000 7f2ad95ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad415a2d0 con 0x7f2ad40b09c0 2023-07-14T11:19:52.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.492+0000 7f2ad95ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad415a5b0 con 0x7f2ad41592e0 2023-07-14T11:19:52.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.492+0000 7f2ad95ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad415a890 con 0x7f2ad40ad950 2023-07-14T11:19:52.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.492+0000 7f2acbfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ad40b09c0 0x7f2ad4159880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:52.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.492+0000 7f2acbfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ad40b09c0 0x7f2ad4159880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34246/0 (socket says 172.21.15.84:34246) 2023-07-14T11:19:52.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.492+0000 7f2acbfff700 1 -- 172.21.15.84:0/2283176938 learned_addr learned my addr 172.21.15.84:0/2283176938 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:52.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.492+0000 7f2ad2ffd700 1 --2- 172.21.15.84:0/2283176938 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ad40ad950 0x7f2ad41f5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:52.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.492+0000 7f2ad37fe700 1 --2- 172.21.15.84:0/2283176938 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ad41592e0 0x7f2ad414e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:52.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.492+0000 7f2acbfff700 1 -- 172.21.15.84:0/2283176938 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ad40ad950 msgr2=0x7f2ad41f5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:52.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.492+0000 7f2acbfff700 1 --2- 172.21.15.84:0/2283176938 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ad40ad950 0x7f2ad41f5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:52.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.492+0000 7f2acbfff700 1 -- 172.21.15.84:0/2283176938 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ad41592e0 msgr2=0x7f2ad414e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:52.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.492+0000 7f2acbfff700 1 --2- 172.21.15.84:0/2283176938 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ad41592e0 0x7f2ad414e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:52.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.492+0000 7f2acbfff700 1 -- 172.21.15.84:0/2283176938 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac4009550 con 0x7f2ad40b09c0 2023-07-14T11:19:52.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.492+0000 7f2ad2ffd700 1 --2- 172.21.15.84:0/2283176938 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ad40ad950 0x7f2ad41f5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:19:52.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.492+0000 7f2ad37fe700 1 --2- 172.21.15.84:0/2283176938 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ad41592e0 0x7f2ad414e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:19:52.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.493+0000 7f2acbfff700 1 --2- 172.21.15.84:0/2283176938 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ad40b09c0 0x7f2ad4159880 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f2abc00e870 tx=0x7f2abc00ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:52.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.493+0000 7f2acb7fe700 1 -- 172.21.15.84:0/2283176938 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2abc009590 con 0x7f2ad40b09c0 2023-07-14T11:19:52.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.493+0000 7f2acb7fe700 1 -- 172.21.15.84:0/2283176938 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2abc00ee70 con 0x7f2ad40b09c0 2023-07-14T11:19:52.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.493+0000 7f2acb7fe700 1 -- 172.21.15.84:0/2283176938 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2abc00ca50 con 0x7f2ad40b09c0 2023-07-14T11:19:52.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.493+0000 7f2ad95ff700 1 -- 172.21.15.84:0/2283176938 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ad415ab70 con 0x7f2ad40b09c0 2023-07-14T11:19:52.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.493+0000 7f2ad95ff700 1 -- 172.21.15.84:0/2283176938 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ad41f5780 con 0x7f2ad40b09c0 2023-07-14T11:19:52.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.494+0000 7f2ad95ff700 1 -- 172.21.15.84:0/2283176938 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ad404e210 con 0x7f2ad40b09c0 2023-07-14T11:19:52.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.495+0000 7f2acb7fe700 1 -- 172.21.15.84:0/2283176938 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f2abc00cbb0 con 0x7f2ad40b09c0 2023-07-14T11:19:52.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.496+0000 7f2acb7fe700 1 --2- 172.21.15.84:0/2283176938 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f2ab406ae90 0x7f2ab406d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:52.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.496+0000 7f2acb7fe700 1 -- 172.21.15.84:0/2283176938 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2abc0898a0 con 0x7f2ad40b09c0 2023-07-14T11:19:52.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.497+0000 7f2ad2ffd700 1 --2- 172.21.15.84:0/2283176938 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f2ab406ae90 0x7f2ab406d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:52.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.497+0000 7f2ad2ffd700 1 --2- 172.21.15.84:0/2283176938 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f2ab406ae90 0x7f2ab406d340 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2ac4009fd0 tx=0x7f2ac4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:52.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.501+0000 7f2acb7fe700 1 -- 172.21.15.84:0/2283176938 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f2abc0545a0 con 0x7f2ad40b09c0 2023-07-14T11:19:52.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.692+0000 7f2ad95ff700 1 -- 172.21.15.84:0/2283176938 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2ad40b1000 con 0x7f2ad40b09c0 2023-07-14T11:19:52.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.694+0000 7f2acb7fe700 1 -- 172.21.15.84:0/2283176938 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v106) v1 ==== 74+0+18337 (secure 0 0 0) 0x7f2abc017090 con 0x7f2ad40b09c0 2023-07-14T11:19:52.698 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:19:52.698 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":106,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:19:25.959900+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-07-14T11:19:22.615201+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-07-14T11:19:23.416792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:19:52.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.696+0000 7f2ad95ff700 1 -- 172.21.15.84:0/2283176938 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f2ab406ae90 msgr2=0x7f2ab406d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:52.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.696+0000 7f2ad95ff700 1 --2- 172.21.15.84:0/2283176938 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f2ab406ae90 0x7f2ab406d340 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2ac4009fd0 tx=0x7f2ac4008030 comp rx=0 tx=0).stop 2023-07-14T11:19:52.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.696+0000 7f2ad95ff700 1 -- 172.21.15.84:0/2283176938 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ad40b09c0 msgr2=0x7f2ad4159880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:52.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.696+0000 7f2ad95ff700 1 --2- 172.21.15.84:0/2283176938 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ad40b09c0 0x7f2ad4159880 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f2abc00e870 tx=0x7f2abc00ec30 comp rx=0 tx=0).stop 2023-07-14T11:19:52.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.696+0000 7f2ad95ff700 1 -- 172.21.15.84:0/2283176938 shutdown_connections 2023-07-14T11:19:52.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.696+0000 7f2ad95ff700 1 --2- 172.21.15.84:0/2283176938 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f2ab406ae90 0x7f2ab406d340 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:52.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.696+0000 7f2ad95ff700 1 --2- 172.21.15.84:0/2283176938 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ad40ad950 0x7f2ad41f5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:52.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.696+0000 7f2ad95ff700 1 --2- 172.21.15.84:0/2283176938 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ad41592e0 0x7f2ad414e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:52.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.696+0000 7f2ad95ff700 1 --2- 172.21.15.84:0/2283176938 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ad40b09c0 0x7f2ad4159880 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:52.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.696+0000 7f2ad95ff700 1 -- 172.21.15.84:0/2283176938 >> 172.21.15.84:0/2283176938 conn(0x7f2ad40ce980 msgr2=0x7f2ad41534b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:52.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.696+0000 7f2ad95ff700 1 -- 172.21.15.84:0/2283176938 shutdown_connections 2023-07-14T11:19:52.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.696+0000 7f2ad95ff700 1 -- 172.21.15.84:0/2283176938 wait complete. 2023-07-14T11:19:52.718 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-14T11:19:52.718 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T11:19:52.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.911+0000 7f18661ff700 1 Processor -- start 2023-07-14T11:19:52.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.911+0000 7f18661ff700 1 -- start start 2023-07-14T11:19:52.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.913+0000 7f18661ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f186015c950 0x7f18600b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:52.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.913+0000 7f18661ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18600b1e00 0x7f18600d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:52.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.913+0000 7f18661ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18600d2ce0 con 0x7f18600b2350 2023-07-14T11:19:52.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.913+0000 7f18661ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18600b3350 con 0x7f186015c950 2023-07-14T11:19:52.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.913+0000 7f18661ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18600b3630 con 0x7f18600b1e00 2023-07-14T11:19:52.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.913+0000 7f185f7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f186015c950 0x7f18600b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:52.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.913+0000 7f185ffff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f18600b2350 0x7f18600afac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:35044/0 (socket says 172.21.15.84:35044) 2023-07-14T11:19:52.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.913+0000 7f185ffff700 1 -- 172.21.15.84:0/3295896388 learned_addr learned my addr 172.21.15.84:0/3295896388 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:19:52.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.913+0000 7f1857fff700 1 --2- 172.21.15.84:0/3295896388 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18600b1e00 0x7f18600d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:52.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.913+0000 7f185f7fe700 1 -- 172.21.15.84:0/3295896388 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18600b1e00 msgr2=0x7f18600d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:52.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.913+0000 7f185f7fe700 1 --2- 172.21.15.84:0/3295896388 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18600b1e00 0x7f18600d0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:52.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.913+0000 7f185f7fe700 1 -- 172.21.15.84:0/3295896388 >> v1:172.21.15.84:6789/0 conn(0x7f18600b2350 legacy=0x7f18600afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:52.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.913+0000 7f185f7fe700 1 -- 172.21.15.84:0/3295896388 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18600b3910 con 0x7f186015c950 2023-07-14T11:19:52.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.914+0000 7f185f7fe700 1 --2- 172.21.15.84:0/3295896388 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f186015c950 0x7f18600b43f0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f1850009820 tx=0x7f1850009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3657a5368ee1604b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:52.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.914+0000 7f185effd700 1 -- 172.21.15.84:0/3295896388 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1850005e30 con 0x7f186015c950 2023-07-14T11:19:52.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.914+0000 7f185effd700 1 -- 172.21.15.84:0/3295896388 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1850006030 con 0x7f186015c950 2023-07-14T11:19:52.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.914+0000 7f185effd700 1 -- 172.21.15.84:0/3295896388 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18500063e0 con 0x7f186015c950 2023-07-14T11:19:52.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.914+0000 7f18661ff700 1 -- 172.21.15.84:0/3295896388 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f186015c950 msgr2=0x7f18600b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:52.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.914+0000 7f18661ff700 1 --2- 172.21.15.84:0/3295896388 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f186015c950 0x7f18600b43f0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f1850009820 tx=0x7f1850009b30 comp rx=0 tx=0).stop 2023-07-14T11:19:52.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.914+0000 7f18661ff700 1 -- 172.21.15.84:0/3295896388 shutdown_connections 2023-07-14T11:19:52.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.914+0000 7f18661ff700 1 --2- 172.21.15.84:0/3295896388 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f186015c950 0x7f18600b43f0 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:52.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.914+0000 7f18661ff700 1 --2- 172.21.15.84:0/3295896388 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18600b1e00 0x7f18600d0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:52.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.914+0000 7f18661ff700 1 -- 172.21.15.84:0/3295896388 >> 172.21.15.84:0/3295896388 conn(0x7f186009c1d0 msgr2=0x7f18600d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:52.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.914+0000 7f18661ff700 1 -- 172.21.15.84:0/3295896388 shutdown_connections 2023-07-14T11:19:52.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.915+0000 7f18661ff700 1 -- 172.21.15.84:0/3295896388 wait complete. 2023-07-14T11:19:52.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.917+0000 7f18661ff700 1 Processor -- start 2023-07-14T11:19:52.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.917+0000 7f18661ff700 1 -- start start 2023-07-14T11:19:52.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.918+0000 7f18661ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18600b1e00 0x7f18601569d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:52.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.918+0000 7f18661ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18600b2350 0x7f186009f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:52.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.918+0000 7f18661ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f186015c950 0x7f186009fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:52.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.918+0000 7f18661ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18600a0010 con 0x7f18600b2350 2023-07-14T11:19:52.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.918+0000 7f18661ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18600a02f0 con 0x7f18600b1e00 2023-07-14T11:19:52.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.918+0000 7f18661ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18600a05d0 con 0x7f186015c950 2023-07-14T11:19:52.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.919+0000 7f1857fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18600b2350 0x7f186009f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:52.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.919+0000 7f1857fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18600b2350 0x7f186009f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34260/0 (socket says 172.21.15.84:34260) 2023-07-14T11:19:52.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.919+0000 7f1857fff700 1 -- 172.21.15.84:0/4004042751 learned_addr learned my addr 172.21.15.84:0/4004042751 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:52.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.919+0000 7f185f7fe700 1 --2- 172.21.15.84:0/4004042751 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18600b1e00 0x7f18601569d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:52.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.919+0000 7f185ffff700 1 --2- 172.21.15.84:0/4004042751 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f186015c950 0x7f186009fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:52.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.919+0000 7f1857fff700 1 -- 172.21.15.84:0/4004042751 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f186015c950 msgr2=0x7f186009fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:52.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.919+0000 7f1857fff700 1 --2- 172.21.15.84:0/4004042751 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f186015c950 0x7f186009fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:52.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.919+0000 7f1857fff700 1 -- 172.21.15.84:0/4004042751 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18600b1e00 msgr2=0x7f18601569d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:52.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.919+0000 7f1857fff700 1 --2- 172.21.15.84:0/4004042751 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18600b1e00 0x7f18601569d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:52.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.919+0000 7f1857fff700 1 -- 172.21.15.84:0/4004042751 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1850009430 con 0x7f18600b2350 2023-07-14T11:19:52.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.919+0000 7f185ffff700 1 --2- 172.21.15.84:0/4004042751 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f186015c950 0x7f186009fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:19:52.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.919+0000 7f185f7fe700 1 --2- 172.21.15.84:0/4004042751 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18600b1e00 0x7f18601569d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:19:52.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.919+0000 7f1857fff700 1 --2- 172.21.15.84:0/4004042751 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18600b2350 0x7f186009f4c0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f184800e810 tx=0x7f184800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:52.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.919+0000 7f185cff9700 1 -- 172.21.15.84:0/4004042751 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1848013610 con 0x7f18600b2350 2023-07-14T11:19:52.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.919+0000 7f185cff9700 1 -- 172.21.15.84:0/4004042751 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1848013770 con 0x7f18600b2350 2023-07-14T11:19:52.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.919+0000 7f185cff9700 1 -- 172.21.15.84:0/4004042751 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1848013b20 con 0x7f18600b2350 2023-07-14T11:19:52.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.919+0000 7f18661ff700 1 -- 172.21.15.84:0/4004042751 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18600a08b0 con 0x7f18600b2350 2023-07-14T11:19:52.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.920+0000 7f18661ff700 1 -- 172.21.15.84:0/4004042751 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1860156f10 con 0x7f18600b2350 2023-07-14T11:19:52.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.921+0000 7f18661ff700 1 -- 172.21.15.84:0/4004042751 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f186004e280 con 0x7f18600b2350 2023-07-14T11:19:52.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.921+0000 7f185cff9700 1 -- 172.21.15.84:0/4004042751 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f1848013c80 con 0x7f18600b2350 2023-07-14T11:19:52.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.922+0000 7f185cff9700 1 --2- 172.21.15.84:0/4004042751 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f184006ae90 0x7f184006d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:52.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.922+0000 7f185cff9700 1 -- 172.21.15.84:0/4004042751 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1848089580 con 0x7f18600b2350 2023-07-14T11:19:52.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.923+0000 7f185f7fe700 1 --2- 172.21.15.84:0/4004042751 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f184006ae90 0x7f184006d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:52.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.923+0000 7f185f7fe700 1 --2- 172.21.15.84:0/4004042751 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f184006ae90 0x7f184006d340 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1850013040 tx=0x7f1850008070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:52.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:52.926+0000 7f185cff9700 1 -- 172.21.15.84:0/4004042751 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f18480542b0 con 0x7f18600b2350 2023-07-14T11:19:53.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.167+0000 7f18661ff700 1 -- 172.21.15.84:0/4004042751 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f186008c5a0 con 0x7f18600b2350 2023-07-14T11:19:53.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.167+0000 7f185cff9700 1 -- 172.21.15.84:0/4004042751 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4711 (secure 0 0 0) 0x7f18480578d0 con 0x7f18600b2350 2023-07-14T11:19:53.171 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:19:53.172 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":70,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6197,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/396743399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":396743399},{"type":"v1","addr":"172.21.15.179:6835","nonce":396743399}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":7105,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3729505201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3729505201},{"type":"v1","addr":"172.21.15.179:6834","nonce":3729505201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":7680,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6833/411491873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":411491873},{"type":"v1","addr":"172.21.15.84:6833","nonce":411491873}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T11:19:24.441292+0000","modified":"2023-07-14T11:19:27.974517+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7683},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7683":{"gid":7683,"name":"c","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6835/2350815422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2350815422},{"type":"v1","addr":"172.21.15.84:6835","nonce":2350815422}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-07-14T11:19:53.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.170+0000 7f18661ff700 1 -- 172.21.15.84:0/4004042751 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f184006ae90 msgr2=0x7f184006d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:53.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.170+0000 7f18661ff700 1 --2- 172.21.15.84:0/4004042751 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f184006ae90 0x7f184006d340 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1850013040 tx=0x7f1850008070 comp rx=0 tx=0).stop 2023-07-14T11:19:53.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.170+0000 7f18661ff700 1 -- 172.21.15.84:0/4004042751 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18600b2350 msgr2=0x7f186009f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:53.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.170+0000 7f18661ff700 1 --2- 172.21.15.84:0/4004042751 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18600b2350 0x7f186009f4c0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f184800e810 tx=0x7f184800ebd0 comp rx=0 tx=0).stop 2023-07-14T11:19:53.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.170+0000 7f18661ff700 1 -- 172.21.15.84:0/4004042751 shutdown_connections 2023-07-14T11:19:53.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.170+0000 7f18661ff700 1 --2- 172.21.15.84:0/4004042751 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f184006ae90 0x7f184006d340 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:53.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.170+0000 7f18661ff700 1 --2- 172.21.15.84:0/4004042751 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f186015c950 0x7f186009fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:53.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.170+0000 7f18661ff700 1 --2- 172.21.15.84:0/4004042751 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18600b1e00 0x7f18601569d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:53.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.170+0000 7f18661ff700 1 --2- 172.21.15.84:0/4004042751 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18600b2350 0x7f186009f4c0 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:53.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.170+0000 7f18661ff700 1 -- 172.21.15.84:0/4004042751 >> 172.21.15.84:0/4004042751 conn(0x7f186009c1d0 msgr2=0x7f18600b8690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:53.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.170+0000 7f18661ff700 1 -- 172.21.15.84:0/4004042751 shutdown_connections 2023-07-14T11:19:53.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.170+0000 7f18661ff700 1 -- 172.21.15.84:0/4004042751 wait complete. 2023-07-14T11:19:53.175 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 70 2023-07-14T11:19:53.191 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T11:19:53.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.384+0000 7faa90fff700 1 Processor -- start 2023-07-14T11:19:53.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.384+0000 7faa90fff700 1 -- start start 2023-07-14T11:19:53.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.386+0000 7faa90fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faa8c15c710 0x7faa8c0cf510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:53.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.386+0000 7faa90fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7faa8c06db30 0x7faa8c06a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:53.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.386+0000 7faa90fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa8c0cd320 con 0x7faa8c069f30 2023-07-14T11:19:53.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.386+0000 7faa90fff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa8c0ce750 con 0x7faa8c06db30 2023-07-14T11:19:53.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.386+0000 7faa90fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa8c0cea30 con 0x7faa8c15c710 2023-07-14T11:19:53.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.386+0000 7faa8ad9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7faa8c06db30 0x7faa8c06a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:53.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.386+0000 7faa8a59c700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faa8c15c710 0x7faa8c0cf510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:53.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.386+0000 7faa8ad9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7faa8c06db30 0x7faa8c06a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.84:57552/0 (socket says 172.21.15.84:57552) 2023-07-14T11:19:53.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.386+0000 7faa8ad9d700 1 -- 172.21.15.84:0/108313697 learned_addr learned my addr 172.21.15.84:0/108313697 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:53.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.387+0000 7faa8a59c700 1 -- 172.21.15.84:0/108313697 >> v2:172.21.15.179:3300/0 conn(0x7faa8c06db30 msgr2=0x7faa8c06a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:53.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.387+0000 7faa8a59c700 1 --2- 172.21.15.84:0/108313697 >> v2:172.21.15.179:3300/0 conn(0x7faa8c06db30 0x7faa8c06a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:53.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.387+0000 7faa8a59c700 1 -- 172.21.15.84:0/108313697 >> v1:172.21.15.179:6789/0 conn(0x7faa8c069f30 legacy=0x7faa8c06d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:53.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.387+0000 7faa8a59c700 1 -- 172.21.15.84:0/108313697 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa8c0ced10 con 0x7faa8c15c710 2023-07-14T11:19:53.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.387+0000 7faa8ad9d700 1 --2- 172.21.15.84:0/108313697 >> v2:172.21.15.179:3300/0 conn(0x7faa8c06db30 0x7faa8c06a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:19:53.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.387+0000 7faa8a59c700 1 --2- 172.21.15.84:0/108313697 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faa8c15c710 0x7faa8c0cf510 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7faa7c009840 tx=0x7faa7c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=225c97ba5068b04f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:53.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.387+0000 7faa89d9b700 1 -- 172.21.15.84:0/108313697 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa7c011830 con 0x7faa8c15c710 2023-07-14T11:19:53.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.387+0000 7faa89d9b700 1 -- 172.21.15.84:0/108313697 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa7c011990 con 0x7faa8c15c710 2023-07-14T11:19:53.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.388+0000 7faa89d9b700 1 -- 172.21.15.84:0/108313697 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa7c011d20 con 0x7faa8c15c710 2023-07-14T11:19:53.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.388+0000 7faa90fff700 1 -- 172.21.15.84:0/108313697 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faa8c15c710 msgr2=0x7faa8c0cf510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:53.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.388+0000 7faa90fff700 1 --2- 172.21.15.84:0/108313697 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faa8c15c710 0x7faa8c0cf510 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7faa7c009840 tx=0x7faa7c009b50 comp rx=0 tx=0).stop 2023-07-14T11:19:53.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.388+0000 7faa90fff700 1 -- 172.21.15.84:0/108313697 shutdown_connections 2023-07-14T11:19:53.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.388+0000 7faa90fff700 1 --2- 172.21.15.84:0/108313697 >> v2:172.21.15.179:3300/0 conn(0x7faa8c06db30 0x7faa8c06a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:53.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.388+0000 7faa90fff700 1 --2- 172.21.15.84:0/108313697 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faa8c15c710 0x7faa8c0cf510 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:53.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.388+0000 7faa90fff700 1 -- 172.21.15.84:0/108313697 >> 172.21.15.84:0/108313697 conn(0x7faa8c0b16c0 msgr2=0x7faa8c0b1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:53.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.388+0000 7faa90fff700 1 -- 172.21.15.84:0/108313697 shutdown_connections 2023-07-14T11:19:53.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.388+0000 7faa90fff700 1 -- 172.21.15.84:0/108313697 wait complete. 2023-07-14T11:19:53.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.390+0000 7faa90fff700 1 Processor -- start 2023-07-14T11:19:53.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.390+0000 7faa90fff700 1 -- start start 2023-07-14T11:19:53.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.391+0000 7faa90fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faa8c069f30 0x7faa8c1596c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:53.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.391+0000 7faa90fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa8c06db30 0x7faa8c142cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:53.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.391+0000 7faa90fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faa8c15ae90 0x7faa8c15caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:53.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.391+0000 7faa90fff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa8c159c00 con 0x7faa8c06db30 2023-07-14T11:19:53.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.391+0000 7faa90fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa8c143230 con 0x7faa8c069f30 2023-07-14T11:19:53.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.391+0000 7faa90fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa8c159df0 con 0x7faa8c15ae90 2023-07-14T11:19:53.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.391+0000 7faa83fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa8c06db30 0x7faa8c142cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:53.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.391+0000 7faa83fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa8c06db30 0x7faa8c142cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34262/0 (socket says 172.21.15.84:34262) 2023-07-14T11:19:53.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.391+0000 7faa83fff700 1 -- 172.21.15.84:0/733034308 learned_addr learned my addr 172.21.15.84:0/733034308 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:53.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.392+0000 7faa8a59c700 1 --2- 172.21.15.84:0/733034308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faa8c069f30 0x7faa8c1596c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:53.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.392+0000 7faa8ad9d700 1 --2- 172.21.15.84:0/733034308 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faa8c15ae90 0x7faa8c15caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:53.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.392+0000 7faa83fff700 1 -- 172.21.15.84:0/733034308 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faa8c15ae90 msgr2=0x7faa8c15caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:53.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.392+0000 7faa83fff700 1 --2- 172.21.15.84:0/733034308 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faa8c15ae90 0x7faa8c15caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:53.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.392+0000 7faa83fff700 1 -- 172.21.15.84:0/733034308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faa8c069f30 msgr2=0x7faa8c1596c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:53.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.392+0000 7faa83fff700 1 --2- 172.21.15.84:0/733034308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faa8c069f30 0x7faa8c1596c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:53.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.392+0000 7faa83fff700 1 -- 172.21.15.84:0/733034308 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa84009b30 con 0x7faa8c06db30 2023-07-14T11:19:53.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.392+0000 7faa83fff700 1 --2- 172.21.15.84:0/733034308 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa8c06db30 0x7faa8c142cf0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7faa7400c510 tx=0x7faa7400c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:53.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.392+0000 7faa82ffd700 1 -- 172.21.15.84:0/733034308 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa740052d0 con 0x7faa8c06db30 2023-07-14T11:19:53.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.392+0000 7faa82ffd700 1 -- 172.21.15.84:0/733034308 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa74005430 con 0x7faa8c06db30 2023-07-14T11:19:53.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.392+0000 7faa82ffd700 1 -- 172.21.15.84:0/733034308 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa740038c0 con 0x7faa8c06db30 2023-07-14T11:19:53.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.392+0000 7faa90fff700 1 -- 172.21.15.84:0/733034308 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa7c0094a0 con 0x7faa8c06db30 2023-07-14T11:19:53.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.393+0000 7faa90fff700 1 -- 172.21.15.84:0/733034308 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa8c06ac20 con 0x7faa8c06db30 2023-07-14T11:19:53.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.393+0000 7faa90fff700 1 -- 172.21.15.84:0/733034308 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa8c04e280 con 0x7faa8c06db30 2023-07-14T11:19:53.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.395+0000 7faa82ffd700 1 -- 172.21.15.84:0/733034308 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) v1 ==== 89190+0+0 (secure 0 0 0) 0x7faa74003a20 con 0x7faa8c06db30 2023-07-14T11:19:53.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.395+0000 7faa82ffd700 1 --2- 172.21.15.84:0/733034308 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7faa6c06ae90 0x7faa6c06d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:53.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.395+0000 7faa82ffd700 1 -- 172.21.15.84:0/733034308 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7faa74088bc0 con 0x7faa8c06db30 2023-07-14T11:19:53.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.396+0000 7faa8a59c700 1 --2- 172.21.15.84:0/733034308 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7faa6c06ae90 0x7faa6c06d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:53.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.396+0000 7faa8a59c700 1 --2- 172.21.15.84:0/733034308 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7faa6c06ae90 0x7faa6c06d340 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7faa7c000c00 tx=0x7faa7c01c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:53.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.399+0000 7faa82ffd700 1 -- 172.21.15.84:0/733034308 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7faa74053950 con 0x7faa8c06db30 2023-07-14T11:19:53.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.634+0000 7faa90fff700 1 -- 172.21.15.84:0/733034308 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faa8c0b0b00 con 0x7faa8c06db30 2023-07-14T11:19:53.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.635+0000 7faa82ffd700 1 -- 172.21.15.84:0/733034308 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4711 (secure 0 0 0) 0x7faa74056f70 con 0x7faa8c06db30 2023-07-14T11:19:53.638 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:19:53.639 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":70,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6197,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/396743399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":396743399},{"type":"v1","addr":"172.21.15.179:6835","nonce":396743399}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":7105,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3729505201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3729505201},{"type":"v1","addr":"172.21.15.179:6834","nonce":3729505201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":7680,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6833/411491873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":411491873},{"type":"v1","addr":"172.21.15.84:6833","nonce":411491873}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T11:19:24.441292+0000","modified":"2023-07-14T11:19:27.974517+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7683},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7683":{"gid":7683,"name":"c","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6835/2350815422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2350815422},{"type":"v1","addr":"172.21.15.84:6835","nonce":2350815422}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-07-14T11:19:53.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.637+0000 7faa90fff700 1 -- 172.21.15.84:0/733034308 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7faa6c06ae90 msgr2=0x7faa6c06d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:53.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.637+0000 7faa90fff700 1 --2- 172.21.15.84:0/733034308 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7faa6c06ae90 0x7faa6c06d340 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7faa7c000c00 tx=0x7faa7c01c040 comp rx=0 tx=0).stop 2023-07-14T11:19:53.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.637+0000 7faa90fff700 1 -- 172.21.15.84:0/733034308 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa8c06db30 msgr2=0x7faa8c142cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:53.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.637+0000 7faa90fff700 1 --2- 172.21.15.84:0/733034308 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa8c06db30 0x7faa8c142cf0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7faa7400c510 tx=0x7faa7400c820 comp rx=0 tx=0).stop 2023-07-14T11:19:53.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.637+0000 7faa90fff700 1 -- 172.21.15.84:0/733034308 shutdown_connections 2023-07-14T11:19:53.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.637+0000 7faa90fff700 1 --2- 172.21.15.84:0/733034308 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7faa6c06ae90 0x7faa6c06d340 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:53.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.637+0000 7faa90fff700 1 --2- 172.21.15.84:0/733034308 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faa8c15ae90 0x7faa8c15caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:53.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.637+0000 7faa90fff700 1 --2- 172.21.15.84:0/733034308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faa8c069f30 0x7faa8c1596c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:53.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.637+0000 7faa90fff700 1 --2- 172.21.15.84:0/733034308 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa8c06db30 0x7faa8c142cf0 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:53.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.637+0000 7faa90fff700 1 -- 172.21.15.84:0/733034308 >> 172.21.15.84:0/733034308 conn(0x7faa8c0b16c0 msgr2=0x7faa8c06d420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:53.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.637+0000 7faa90fff700 1 -- 172.21.15.84:0/733034308 shutdown_connections 2023-07-14T11:19:53.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.637+0000 7faa90fff700 1 -- 172.21.15.84:0/733034308 wait complete. 2023-07-14T11:19:53.642 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 70 2023-07-14T11:19:53.658 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:19:53.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.850+0000 7fe82d9ff700 1 Processor -- start 2023-07-14T11:19:53.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.851+0000 7fe82d9ff700 1 -- start start 2023-07-14T11:19:53.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.852+0000 7fe82d9ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe8281500d0 0x7fe828070350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:53.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.852+0000 7fe82d9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe828070890 0x7fe8281597c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:53.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.852+0000 7fe82d9ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8280cdf90 con 0x7fe828159d00 2023-07-14T11:19:53.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.852+0000 7fe82d9ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe82815a2f0 con 0x7fe8281500d0 2023-07-14T11:19:53.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.852+0000 7fe82d9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe82815a5d0 con 0x7fe828070890 2023-07-14T11:19:53.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.852+0000 7fe826ffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe8281500d0 0x7fe828070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:53.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.852+0000 7fe826ffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe8281500d0 0x7fe828070350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34270/0 (socket says 172.21.15.84:34270) 2023-07-14T11:19:53.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.852+0000 7fe826ffd700 1 -- 172.21.15.84:0/3331731069 learned_addr learned my addr 172.21.15.84:0/3331731069 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:53.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.852+0000 7fe81ffff700 1 --2- 172.21.15.84:0/3331731069 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe828070890 0x7fe8281597c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:53.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.853+0000 7fe826ffd700 1 -- 172.21.15.84:0/3331731069 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe828070890 msgr2=0x7fe8281597c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:53.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.853+0000 7fe826ffd700 1 --2- 172.21.15.84:0/3331731069 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe828070890 0x7fe8281597c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:53.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.853+0000 7fe826ffd700 1 -- 172.21.15.84:0/3331731069 >> v1:172.21.15.179:6789/0 conn(0x7fe828159d00 legacy=0x7fe8280cea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:53.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.853+0000 7fe826ffd700 1 -- 172.21.15.84:0/3331731069 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8280ce250 con 0x7fe8281500d0 2023-07-14T11:19:53.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.853+0000 7fe81ffff700 1 --2- 172.21.15.84:0/3331731069 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe828070890 0x7fe8281597c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:19:53.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.853+0000 7fe826ffd700 1 --2- 172.21.15.84:0/3331731069 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8281500d0 0x7fe828070350 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fe8180098f0 tx=0x7fe818009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ce070d0929ca339 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:53.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.853+0000 7fe8267fc700 1 -- 172.21.15.84:0/3331731069 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe818004230 con 0x7fe8281500d0 2023-07-14T11:19:53.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.853+0000 7fe8267fc700 1 -- 172.21.15.84:0/3331731069 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe818004390 con 0x7fe8281500d0 2023-07-14T11:19:53.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.853+0000 7fe8267fc700 1 -- 172.21.15.84:0/3331731069 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8180036a0 con 0x7fe8281500d0 2023-07-14T11:19:53.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.854+0000 7fe82d9ff700 1 -- 172.21.15.84:0/3331731069 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8281500d0 msgr2=0x7fe828070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:53.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.854+0000 7fe82d9ff700 1 --2- 172.21.15.84:0/3331731069 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8281500d0 0x7fe828070350 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fe8180098f0 tx=0x7fe818009c00 comp rx=0 tx=0).stop 2023-07-14T11:19:53.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.854+0000 7fe82d9ff700 1 -- 172.21.15.84:0/3331731069 shutdown_connections 2023-07-14T11:19:53.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.854+0000 7fe82d9ff700 1 --2- 172.21.15.84:0/3331731069 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8281500d0 0x7fe828070350 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:53.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.854+0000 7fe82d9ff700 1 --2- 172.21.15.84:0/3331731069 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe828070890 0x7fe8281597c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:53.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.854+0000 7fe82d9ff700 1 -- 172.21.15.84:0/3331731069 >> 172.21.15.84:0/3331731069 conn(0x7fe828069f30 msgr2=0x7fe82806a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:53.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.854+0000 7fe82d9ff700 1 -- 172.21.15.84:0/3331731069 shutdown_connections 2023-07-14T11:19:53.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.854+0000 7fe82d9ff700 1 -- 172.21.15.84:0/3331731069 wait complete. 2023-07-14T11:19:53.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.856+0000 7fe82d9ff700 1 Processor -- start 2023-07-14T11:19:53.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.856+0000 7fe82d9ff700 1 -- start start 2023-07-14T11:19:53.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.857+0000 7fe82d9ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe828070890 0x7fe828139540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:53.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.857+0000 7fe82d9ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8281500d0 0x7fe828158200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:53.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.857+0000 7fe82d9ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe828159d00 0x7fe828158740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:53.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.857+0000 7fe82d9ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe82813a0c0 con 0x7fe8281500d0 2023-07-14T11:19:53.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.857+0000 7fe82d9ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe82813a2a0 con 0x7fe828070890 2023-07-14T11:19:53.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.857+0000 7fe82d9ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe82813a580 con 0x7fe828159d00 2023-07-14T11:19:53.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.857+0000 7fe81ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8281500d0 0x7fe828158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:53.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.857+0000 7fe81ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8281500d0 0x7fe828158200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34274/0 (socket says 172.21.15.84:34274) 2023-07-14T11:19:53.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.857+0000 7fe81ffff700 1 -- 172.21.15.84:0/1175294050 learned_addr learned my addr 172.21.15.84:0/1175294050 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:53.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.857+0000 7fe826ffd700 1 --2- 172.21.15.84:0/1175294050 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe828070890 0x7fe828139540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:53.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.857+0000 7fe8277fe700 1 --2- 172.21.15.84:0/1175294050 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe828159d00 0x7fe828158740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:53.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.857+0000 7fe81ffff700 1 -- 172.21.15.84:0/1175294050 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe828159d00 msgr2=0x7fe828158740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:53.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.857+0000 7fe81ffff700 1 --2- 172.21.15.84:0/1175294050 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe828159d00 0x7fe828158740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:53.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.857+0000 7fe81ffff700 1 -- 172.21.15.84:0/1175294050 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe828070890 msgr2=0x7fe828139540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:53.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.857+0000 7fe81ffff700 1 --2- 172.21.15.84:0/1175294050 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe828070890 0x7fe828139540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:53.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.857+0000 7fe81ffff700 1 -- 172.21.15.84:0/1175294050 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe818009550 con 0x7fe8281500d0 2023-07-14T11:19:53.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.857+0000 7fe826ffd700 1 --2- 172.21.15.84:0/1175294050 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe828070890 0x7fe828139540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:19:53.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.857+0000 7fe8277fe700 1 --2- 172.21.15.84:0/1175294050 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe828159d00 0x7fe828158740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:19:53.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.858+0000 7fe81ffff700 1 --2- 172.21.15.84:0/1175294050 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8281500d0 0x7fe828158200 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7fe81000c750 tx=0x7fe81000cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:53.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.858+0000 7fe824ff9700 1 -- 172.21.15.84:0/1175294050 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe810011800 con 0x7fe8281500d0 2023-07-14T11:19:53.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.858+0000 7fe824ff9700 1 -- 172.21.15.84:0/1175294050 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe810011960 con 0x7fe8281500d0 2023-07-14T11:19:53.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.858+0000 7fe82d9ff700 1 -- 172.21.15.84:0/1175294050 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe82813a860 con 0x7fe8281500d0 2023-07-14T11:19:53.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.858+0000 7fe824ff9700 1 -- 172.21.15.84:0/1175294050 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe810011cd0 con 0x7fe8281500d0 2023-07-14T11:19:53.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.858+0000 7fe82d9ff700 1 -- 172.21.15.84:0/1175294050 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe82813ae20 con 0x7fe8281500d0 2023-07-14T11:19:53.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.859+0000 7fe82d9ff700 1 -- 172.21.15.84:0/1175294050 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe82813b040 con 0x7fe8281500d0 2023-07-14T11:19:53.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.860+0000 7fe824ff9700 1 -- 172.21.15.84:0/1175294050 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) v1 ==== 89190+0+0 (secure 0 0 0) 0x7fe810021350 con 0x7fe8281500d0 2023-07-14T11:19:53.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.861+0000 7fe824ff9700 1 --2- 172.21.15.84:0/1175294050 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fe80806ae90 0x7fe80806d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:53.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.861+0000 7fe824ff9700 1 -- 172.21.15.84:0/1175294050 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe8100898a0 con 0x7fe8281500d0 2023-07-14T11:19:53.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.861+0000 7fe826ffd700 1 --2- 172.21.15.84:0/1175294050 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fe80806ae90 0x7fe80806d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:53.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.862+0000 7fe826ffd700 1 --2- 172.21.15.84:0/1175294050 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fe80806ae90 0x7fe80806d340 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe818009c40 tx=0x7fe818008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:53.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:53.865+0000 7fe824ff9700 1 -- 172.21.15.84:0/1175294050 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe8100545b0 con 0x7fe8281500d0 2023-07-14T11:19:54.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.063+0000 7fe82d9ff700 1 -- 172.21.15.84:0/1175294050 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe8280cf5d0 con 0x7fe8281500d0 2023-07-14T11:19:54.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.065+0000 7fe824ff9700 1 -- 172.21.15.84:0/1175294050 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v106) v1 ==== 74+0+18337 (secure 0 0 0) 0x7fe810057bd0 con 0x7fe8281500d0 2023-07-14T11:19:54.068 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:19:54.069 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":106,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:19:25.959900+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-07-14T11:19:22.615201+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-07-14T11:19:23.416792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:19:54.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.067+0000 7fe82d9ff700 1 -- 172.21.15.84:0/1175294050 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fe80806ae90 msgr2=0x7fe80806d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:54.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.067+0000 7fe82d9ff700 1 --2- 172.21.15.84:0/1175294050 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fe80806ae90 0x7fe80806d340 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe818009c40 tx=0x7fe818008030 comp rx=0 tx=0).stop 2023-07-14T11:19:54.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.067+0000 7fe82d9ff700 1 -- 172.21.15.84:0/1175294050 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8281500d0 msgr2=0x7fe828158200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:54.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.067+0000 7fe82d9ff700 1 --2- 172.21.15.84:0/1175294050 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8281500d0 0x7fe828158200 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7fe81000c750 tx=0x7fe81000cb10 comp rx=0 tx=0).stop 2023-07-14T11:19:54.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.067+0000 7fe82d9ff700 1 -- 172.21.15.84:0/1175294050 shutdown_connections 2023-07-14T11:19:54.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.067+0000 7fe82d9ff700 1 --2- 172.21.15.84:0/1175294050 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fe80806ae90 0x7fe80806d340 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:54.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.067+0000 7fe82d9ff700 1 --2- 172.21.15.84:0/1175294050 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe828159d00 0x7fe828158740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:54.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.067+0000 7fe82d9ff700 1 --2- 172.21.15.84:0/1175294050 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe828070890 0x7fe828139540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:54.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.067+0000 7fe82d9ff700 1 --2- 172.21.15.84:0/1175294050 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8281500d0 0x7fe828158200 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:54.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.067+0000 7fe82d9ff700 1 -- 172.21.15.84:0/1175294050 >> 172.21.15.84:0/1175294050 conn(0x7fe828069f30 msgr2=0x7fe8281504a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:54.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.067+0000 7fe82d9ff700 1 -- 172.21.15.84:0/1175294050 shutdown_connections 2023-07-14T11:19:54.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.067+0000 7fe82d9ff700 1 -- 172.21.15.84:0/1175294050 wait complete. 2023-07-14T11:19:54.089 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-14T11:19:54.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.282+0000 7f79a13ff700 1 Processor -- start 2023-07-14T11:19:54.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.282+0000 7f79a13ff700 1 -- start start 2023-07-14T11:19:54.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.283+0000 7f79a13ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f799c0b21f0 0x7f799c0cfc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:54.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.283+0000 7f79a13ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f799c0d29c0 0x7f799c0d2e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:54.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.283+0000 7f79a13ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f799c0cd8e0 con 0x7f799c0cf890 2023-07-14T11:19:54.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.283+0000 7f79a13ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f799c0d2760 con 0x7f799c0b21f0 2023-07-14T11:19:54.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.283+0000 7f79a13ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f799c0d01a0 con 0x7f799c0d29c0 2023-07-14T11:19:54.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.284+0000 7f7993fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f799c0b21f0 0x7f799c0cfc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:54.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.284+0000 7f7993fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f799c0b21f0 0x7f799c0cfc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34278/0 (socket says 172.21.15.84:34278) 2023-07-14T11:19:54.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.284+0000 7f7993fff700 1 -- 172.21.15.84:0/3914320716 learned_addr learned my addr 172.21.15.84:0/3914320716 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:54.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.284+0000 7f799b7fe700 1 --2- 172.21.15.84:0/3914320716 >> v2:172.21.15.179:3300/0 conn(0x7f799c0d29c0 0x7f799c0d2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:54.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.284+0000 7f7993fff700 1 -- 172.21.15.84:0/3914320716 >> v2:172.21.15.179:3300/0 conn(0x7f799c0d29c0 msgr2=0x7f799c0d2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:54.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.284+0000 7f7993fff700 1 --2- 172.21.15.84:0/3914320716 >> v2:172.21.15.179:3300/0 conn(0x7f799c0d29c0 0x7f799c0d2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:54.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.284+0000 7f7993fff700 1 -- 172.21.15.84:0/3914320716 >> v1:172.21.15.179:6789/0 conn(0x7f799c0cf890 legacy=0x7f799c0cf030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:54.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.284+0000 7f7993fff700 1 -- 172.21.15.84:0/3914320716 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f799c0d1740 con 0x7f799c0b21f0 2023-07-14T11:19:54.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.284+0000 7f7993fff700 1 --2- 172.21.15.84:0/3914320716 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f799c0b21f0 0x7f799c0cfc60 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f799c0cf810 tx=0x7f7984009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=739ce771b5cbfbca server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:54.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.285+0000 7f799a7fc700 1 -- 172.21.15.84:0/3914320716 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7984004230 con 0x7f799c0b21f0 2023-07-14T11:19:54.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.285+0000 7f799a7fc700 1 -- 172.21.15.84:0/3914320716 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7984004390 con 0x7f799c0b21f0 2023-07-14T11:19:54.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.285+0000 7f799a7fc700 1 -- 172.21.15.84:0/3914320716 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79840036a0 con 0x7f799c0b21f0 2023-07-14T11:19:54.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.285+0000 7f79a13ff700 1 -- 172.21.15.84:0/3914320716 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f799c0b21f0 msgr2=0x7f799c0cfc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:54.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.285+0000 7f79a13ff700 1 --2- 172.21.15.84:0/3914320716 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f799c0b21f0 0x7f799c0cfc60 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f799c0cf810 tx=0x7f7984009bd0 comp rx=0 tx=0).stop 2023-07-14T11:19:54.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.285+0000 7f79a13ff700 1 -- 172.21.15.84:0/3914320716 shutdown_connections 2023-07-14T11:19:54.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.285+0000 7f79a13ff700 1 --2- 172.21.15.84:0/3914320716 >> v2:172.21.15.179:3300/0 conn(0x7f799c0d29c0 0x7f799c0d2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:54.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.285+0000 7f79a13ff700 1 --2- 172.21.15.84:0/3914320716 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f799c0b21f0 0x7f799c0cfc60 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:54.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.285+0000 7f79a13ff700 1 -- 172.21.15.84:0/3914320716 >> 172.21.15.84:0/3914320716 conn(0x7f799c06c170 msgr2=0x7f799c06c540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:54.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.285+0000 7f79a13ff700 1 -- 172.21.15.84:0/3914320716 shutdown_connections 2023-07-14T11:19:54.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.285+0000 7f79a13ff700 1 -- 172.21.15.84:0/3914320716 wait complete. 2023-07-14T11:19:54.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.287+0000 7f79a13ff700 1 Processor -- start 2023-07-14T11:19:54.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.287+0000 7f79a13ff700 1 -- start start 2023-07-14T11:19:54.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.288+0000 7f79a13ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f799c0b21f0 0x7f799c1f2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:54.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.288+0000 7f79a13ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f799c0cf890 0x7f799c147db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:54.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.288+0000 7f79a13ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f799c0d29c0 0x7f799c1482f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:54.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.288+0000 7f79a13ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f799c0ccb00 con 0x7f799c0cf890 2023-07-14T11:19:54.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.288+0000 7f79a13ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f799c1f2fe0 con 0x7f799c0b21f0 2023-07-14T11:19:54.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.288+0000 7f79a13ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f799c158ad0 con 0x7f799c0d29c0 2023-07-14T11:19:54.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.288+0000 7f7993fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f799c0cf890 0x7f799c147db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:54.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.288+0000 7f7993fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f799c0cf890 0x7f799c147db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34280/0 (socket says 172.21.15.84:34280) 2023-07-14T11:19:54.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.288+0000 7f7993fff700 1 -- 172.21.15.84:0/1070812451 learned_addr learned my addr 172.21.15.84:0/1070812451 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:54.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.289+0000 7f799affd700 1 --2- 172.21.15.84:0/1070812451 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f799c0b21f0 0x7f799c1f2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:54.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.289+0000 7f799b7fe700 1 --2- 172.21.15.84:0/1070812451 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f799c0d29c0 0x7f799c1482f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:54.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.289+0000 7f7993fff700 1 -- 172.21.15.84:0/1070812451 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f799c0d29c0 msgr2=0x7f799c1482f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:54.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.289+0000 7f7993fff700 1 --2- 172.21.15.84:0/1070812451 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f799c0d29c0 0x7f799c1482f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:54.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.289+0000 7f7993fff700 1 -- 172.21.15.84:0/1070812451 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f799c0b21f0 msgr2=0x7f799c1f2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:54.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.289+0000 7f7993fff700 1 --2- 172.21.15.84:0/1070812451 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f799c0b21f0 0x7f799c1f2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:54.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.289+0000 7f7993fff700 1 -- 172.21.15.84:0/1070812451 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7984009550 con 0x7f799c0cf890 2023-07-14T11:19:54.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.289+0000 7f7993fff700 1 --2- 172.21.15.84:0/1070812451 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f799c0cf890 0x7f799c147db0 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f7984009130 tx=0x7f7984004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:54.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.289+0000 7f79937fe700 1 -- 172.21.15.84:0/1070812451 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7984011630 con 0x7f799c0cf890 2023-07-14T11:19:54.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.289+0000 7f79937fe700 1 -- 172.21.15.84:0/1070812451 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7984011790 con 0x7f799c0cf890 2023-07-14T11:19:54.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.289+0000 7f79a13ff700 1 -- 172.21.15.84:0/1070812451 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f799c158db0 con 0x7f799c0cf890 2023-07-14T11:19:54.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.289+0000 7f79937fe700 1 -- 172.21.15.84:0/1070812451 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7984011b40 con 0x7f799c0cf890 2023-07-14T11:19:54.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.289+0000 7f79a13ff700 1 -- 172.21.15.84:0/1070812451 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f799c159370 con 0x7f799c0cf890 2023-07-14T11:19:54.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.290+0000 7f79a13ff700 1 -- 172.21.15.84:0/1070812451 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f799c067350 con 0x7f799c0cf890 2023-07-14T11:19:54.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.291+0000 7f79937fe700 1 -- 172.21.15.84:0/1070812451 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f7984011ca0 con 0x7f799c0cf890 2023-07-14T11:19:54.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.292+0000 7f79937fe700 1 --2- 172.21.15.84:0/1070812451 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f797c06ae90 0x7f797c06d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:54.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.292+0000 7f79937fe700 1 -- 172.21.15.84:0/1070812451 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f798408ade0 con 0x7f799c0cf890 2023-07-14T11:19:54.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.293+0000 7f799affd700 1 --2- 172.21.15.84:0/1070812451 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f797c06ae90 0x7f797c06d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:54.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.293+0000 7f799affd700 1 --2- 172.21.15.84:0/1070812451 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f797c06ae90 0x7f797c06d340 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f798c009870 tx=0x7f798c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:54.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.296+0000 7f79937fe700 1 -- 172.21.15.84:0/1070812451 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7984055d60 con 0x7f799c0cf890 2023-07-14T11:19:54.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.533+0000 7f79a13ff700 1 -- 172.21.15.84:0/1070812451 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f799c0b5230 con 0x7f799c0cf890 2023-07-14T11:19:54.537 INFO:tasks.ceph.mon.a.smithi084.stderr:2023-07-14T11:19:54.534+0000 7f5e043f4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-14T11:19:54.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.538+0000 7f79937fe700 1 -- 172.21.15.84:0/1070812451 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v71) v1 ==== 161+0+0 (secure 0 0 0) 0x7f7984059380 con 0x7f799c0cf890 2023-07-14T11:19:54.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.541+0000 7f79a13ff700 1 -- 172.21.15.84:0/1070812451 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f797c06ae90 msgr2=0x7f797c06d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:54.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.541+0000 7f79a13ff700 1 --2- 172.21.15.84:0/1070812451 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f797c06ae90 0x7f797c06d340 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f798c009870 tx=0x7f798c008040 comp rx=0 tx=0).stop 2023-07-14T11:19:54.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.541+0000 7f79a13ff700 1 -- 172.21.15.84:0/1070812451 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f799c0cf890 msgr2=0x7f799c147db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:54.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.541+0000 7f79a13ff700 1 --2- 172.21.15.84:0/1070812451 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f799c0cf890 0x7f799c147db0 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f7984009130 tx=0x7f7984004750 comp rx=0 tx=0).stop 2023-07-14T11:19:54.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.541+0000 7f79a13ff700 1 -- 172.21.15.84:0/1070812451 shutdown_connections 2023-07-14T11:19:54.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.541+0000 7f79a13ff700 1 --2- 172.21.15.84:0/1070812451 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f797c06ae90 0x7f797c06d340 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:54.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.541+0000 7f79a13ff700 1 --2- 172.21.15.84:0/1070812451 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f799c0d29c0 0x7f799c1482f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:54.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.541+0000 7f79a13ff700 1 --2- 172.21.15.84:0/1070812451 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f799c0b21f0 0x7f799c1f2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:54.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.541+0000 7f79a13ff700 1 --2- 172.21.15.84:0/1070812451 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f799c0cf890 0x7f799c147db0 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:54.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.541+0000 7f79a13ff700 1 -- 172.21.15.84:0/1070812451 >> 172.21.15.84:0/1070812451 conn(0x7f799c06c170 msgr2=0x7f799c0d0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:54.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.541+0000 7f79a13ff700 1 -- 172.21.15.84:0/1070812451 shutdown_connections 2023-07-14T11:19:54.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.541+0000 7f79a13ff700 1 -- 172.21.15.84:0/1070812451 wait complete. 2023-07-14T11:19:54.547 INFO:teuthology.orchestra.run.smithi084.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-14T11:19:54.563 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-14T11:19:54.611 INFO:tasks.ceph.mds.c.smithi084.stdout:starting mds.c at 2023-07-14T11:19:54.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.759+0000 7fec2d7ff700 1 Processor -- start 2023-07-14T11:19:54.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.759+0000 7fec2d7ff700 1 -- start start 2023-07-14T11:19:54.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.760+0000 7fec2d7ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fec28158bb0 0x7fec280cd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:54.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.760+0000 7fec2d7ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec280ce8c0 con 0x7fec280cbe40 2023-07-14T11:19:54.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.760+0000 7fec2d7ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec280cc2b0 con 0x7fec280ce150 2023-07-14T11:19:54.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.760+0000 7fec2d7ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec2806b5b0 con 0x7fec28158bb0 2023-07-14T11:19:54.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.760+0000 7fec1ffff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fec280cbe40 0x7fec280cda40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:35050/0 (socket says 172.21.15.84:35050) 2023-07-14T11:19:54.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.761+0000 7fec1ffff700 1 -- 172.21.15.84:0/1588951245 learned_addr learned my addr 172.21.15.84:0/1588951245 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:19:54.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.761+0000 7fec26ffd700 1 --2- 172.21.15.84:0/1588951245 >> v2:172.21.15.179:3300/0 conn(0x7fec28158bb0 0x7fec280cd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:54.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.761+0000 7fec267fc700 1 -- 172.21.15.84:0/1588951245 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1545514411 0 0) 0x7fec280ce8c0 con 0x7fec280cbe40 2023-07-14T11:19:54.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.761+0000 7fec267fc700 1 -- 172.21.15.84:0/1588951245 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec140035b0 con 0x7fec280cbe40 2023-07-14T11:19:54.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.761+0000 7fec26ffd700 1 -- 172.21.15.84:0/1588951245 >> v1:172.21.15.179:6789/0 conn(0x7fec280ce150 legacy=0x7fec2806ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:54.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.761+0000 7fec26ffd700 1 -- 172.21.15.84:0/1588951245 >> v1:172.21.15.84:6789/0 conn(0x7fec280cbe40 legacy=0x7fec280cda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:54.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.761+0000 7fec26ffd700 1 -- 172.21.15.84:0/1588951245 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec280cae30 con 0x7fec28158bb0 2023-07-14T11:19:54.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.762+0000 7fec26ffd700 1 --2- 172.21.15.84:0/1588951245 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec28158bb0 0x7fec280cd0a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fec18009840 tx=0x7fec18009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c0cd57a6cf52c66 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:54.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.762+0000 7fec267fc700 1 -- 172.21.15.84:0/1588951245 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec18011830 con 0x7fec28158bb0 2023-07-14T11:19:54.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.762+0000 7fec267fc700 1 -- 172.21.15.84:0/1588951245 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec18011990 con 0x7fec28158bb0 2023-07-14T11:19:54.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.762+0000 7fec267fc700 1 -- 172.21.15.84:0/1588951245 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec18011d20 con 0x7fec28158bb0 2023-07-14T11:19:54.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.762+0000 7fec2d7ff700 1 -- 172.21.15.84:0/1588951245 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec28158bb0 msgr2=0x7fec280cd0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:54.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.762+0000 7fec2d7ff700 1 --2- 172.21.15.84:0/1588951245 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec28158bb0 0x7fec280cd0a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fec18009840 tx=0x7fec18009b50 comp rx=0 tx=0).stop 2023-07-14T11:19:54.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.762+0000 7fec2d7ff700 1 -- 172.21.15.84:0/1588951245 shutdown_connections 2023-07-14T11:19:54.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.762+0000 7fec2d7ff700 1 --2- 172.21.15.84:0/1588951245 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec28158bb0 0x7fec280cd0a0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:54.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.762+0000 7fec2d7ff700 1 -- 172.21.15.84:0/1588951245 >> 172.21.15.84:0/1588951245 conn(0x7fec280b05d0 msgr2=0x7fec280b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:54.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.762+0000 7fec2d7ff700 1 -- 172.21.15.84:0/1588951245 shutdown_connections 2023-07-14T11:19:54.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.762+0000 7fec2d7ff700 1 -- 172.21.15.84:0/1588951245 wait complete. 2023-07-14T11:19:54.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.764+0000 7fec2d7ff700 1 Processor -- start 2023-07-14T11:19:54.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.764+0000 7fec2d7ff700 1 -- start start 2023-07-14T11:19:54.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.765+0000 7fec2d7ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec280cbe40 0x7fec28155240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:54.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.765+0000 7fec2d7ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec280ce150 0x7fec281509a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:54.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.765+0000 7fec2d7ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec28158bb0 0x7fec28150ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:54.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.765+0000 7fec2d7ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec28154820 con 0x7fec280cbe40 2023-07-14T11:19:54.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.765+0000 7fec2d7ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec280c7300 con 0x7fec28158bb0 2023-07-14T11:19:54.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.765+0000 7fec2d7ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec28153c10 con 0x7fec280ce150 2023-07-14T11:19:54.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.765+0000 7fec26ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec280cbe40 0x7fec28155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:54.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.765+0000 7fec26ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec280cbe40 0x7fec28155240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34306/0 (socket says 172.21.15.84:34306) 2023-07-14T11:19:54.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.765+0000 7fec26ffd700 1 -- 172.21.15.84:0/1304714412 learned_addr learned my addr 172.21.15.84:0/1304714412 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:54.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.766+0000 7fec1ffff700 1 --2- 172.21.15.84:0/1304714412 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec280ce150 0x7fec281509a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:54.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.766+0000 7fec26ffd700 1 -- 172.21.15.84:0/1304714412 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec280ce150 msgr2=0x7fec281509a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:54.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.766+0000 7fec277fe700 1 --2- 172.21.15.84:0/1304714412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec28158bb0 0x7fec28150ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:54.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.766+0000 7fec26ffd700 1 --2- 172.21.15.84:0/1304714412 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec280ce150 0x7fec281509a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:54.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.766+0000 7fec26ffd700 1 -- 172.21.15.84:0/1304714412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec28158bb0 msgr2=0x7fec28150ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:54.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.766+0000 7fec26ffd700 1 --2- 172.21.15.84:0/1304714412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec28158bb0 0x7fec28150ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:54.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.766+0000 7fec26ffd700 1 -- 172.21.15.84:0/1304714412 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec180094a0 con 0x7fec280cbe40 2023-07-14T11:19:54.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.766+0000 7fec277fe700 1 --2- 172.21.15.84:0/1304714412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec28158bb0 0x7fec28150ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:19:54.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.766+0000 7fec1ffff700 1 --2- 172.21.15.84:0/1304714412 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec280ce150 0x7fec281509a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:19:54.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.766+0000 7fec26ffd700 1 --2- 172.21.15.84:0/1304714412 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec280cbe40 0x7fec28155240 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7fec18009fd0 tx=0x7fec18004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:54.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.766+0000 7fec1f7fe700 1 -- 172.21.15.84:0/1304714412 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec180038a0 con 0x7fec280cbe40 2023-07-14T11:19:54.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.766+0000 7fec1f7fe700 1 -- 172.21.15.84:0/1304714412 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec1801f070 con 0x7fec280cbe40 2023-07-14T11:19:54.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.766+0000 7fec2d7ff700 1 -- 172.21.15.84:0/1304714412 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec28153ef0 con 0x7fec280cbe40 2023-07-14T11:19:54.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.766+0000 7fec1f7fe700 1 -- 172.21.15.84:0/1304714412 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec18003c40 con 0x7fec280cbe40 2023-07-14T11:19:54.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.767+0000 7fec2d7ff700 1 -- 172.21.15.84:0/1304714412 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec281544b0 con 0x7fec280cbe40 2023-07-14T11:19:54.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.767+0000 7fec2d7ff700 1 -- 172.21.15.84:0/1304714412 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec280714e0 con 0x7fec280cbe40 2023-07-14T11:19:54.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.768+0000 7fec1f7fe700 1 -- 172.21.15.84:0/1304714412 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) v1 ==== 89190+0+0 (secure 0 0 0) 0x7fec18026480 con 0x7fec280cbe40 2023-07-14T11:19:54.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.769+0000 7fec1f7fe700 1 --2- 172.21.15.84:0/1304714412 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fec0806ae90 0x7fec0806d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:54.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.769+0000 7fec1f7fe700 1 -- 172.21.15.84:0/1304714412 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6148+0+0 (secure 0 0 0) 0x7fec18021070 con 0x7fec280cbe40 2023-07-14T11:19:54.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.770+0000 7fec1ffff700 1 --2- 172.21.15.84:0/1304714412 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fec0806ae90 0x7fec0806d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:54.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.770+0000 7fec1ffff700 1 --2- 172.21.15.84:0/1304714412 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fec0806ae90 0x7fec0806d340 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fec281e59f0 tx=0x7fec10009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:54.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:54.773+0000 7fec1f7fe700 1 -- 172.21.15.84:0/1304714412 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fec280714e0 con 0x7fec280cbe40 2023-07-14T11:19:55.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.011+0000 7fec2d7ff700 1 -- 172.21.15.84:0/1304714412 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fec280714e0 con 0x7fec280cbe40 2023-07-14T11:19:55.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.539+0000 7fec1f7fe700 1 -- 172.21.15.84:0/1304714412 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v72) v1 ==== 104+0+0 (secure 0 0 0) 0x7fec280714e0 con 0x7fec280cbe40 2023-07-14T11:19:55.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.542+0000 7fec2d7ff700 1 -- 172.21.15.84:0/1304714412 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fec0806ae90 msgr2=0x7fec0806d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:55.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.542+0000 7fec2d7ff700 1 --2- 172.21.15.84:0/1304714412 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fec0806ae90 0x7fec0806d340 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fec281e59f0 tx=0x7fec10009040 comp rx=0 tx=0).stop 2023-07-14T11:19:55.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.542+0000 7fec2d7ff700 1 -- 172.21.15.84:0/1304714412 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec280cbe40 msgr2=0x7fec28155240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:55.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.542+0000 7fec2d7ff700 1 --2- 172.21.15.84:0/1304714412 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec280cbe40 0x7fec28155240 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7fec18009fd0 tx=0x7fec18004750 comp rx=0 tx=0).stop 2023-07-14T11:19:55.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.542+0000 7fec2d7ff700 1 -- 172.21.15.84:0/1304714412 shutdown_connections 2023-07-14T11:19:55.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.542+0000 7fec2d7ff700 1 --2- 172.21.15.84:0/1304714412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec28158bb0 0x7fec28150ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:55.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.542+0000 7fec2d7ff700 1 --2- 172.21.15.84:0/1304714412 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec280cbe40 0x7fec28155240 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:55.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.542+0000 7fec2d7ff700 1 --2- 172.21.15.84:0/1304714412 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fec0806ae90 0x7fec0806d340 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:55.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.542+0000 7fec2d7ff700 1 --2- 172.21.15.84:0/1304714412 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec280ce150 0x7fec281509a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:55.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.542+0000 7fec2d7ff700 1 -- 172.21.15.84:0/1304714412 >> 172.21.15.84:0/1304714412 conn(0x7fec280b05d0 msgr2=0x7fec280cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:55.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.542+0000 7fec2d7ff700 1 -- 172.21.15.84:0/1304714412 shutdown_connections 2023-07-14T11:19:55.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.543+0000 7fec2d7ff700 1 -- 172.21.15.84:0/1304714412 wait complete. 2023-07-14T11:19:55.565 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-14T11:19:55.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.762+0000 7f6bbd1ff700 1 Processor -- start 2023-07-14T11:19:55.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.763+0000 7f6bbd1ff700 1 -- start start 2023-07-14T11:19:55.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.764+0000 7f6bbd1ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6bb815c890 0x7f6bb80d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:55.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.764+0000 7f6bbd1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6bb80b2440 0x7f6bb80d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:55.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.764+0000 7f6bbd1ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6bb806c240 0x7f6bb80cf840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:55.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.764+0000 7f6bbd1ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bb815cc60 con 0x7f6bb806c240 2023-07-14T11:19:55.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.764+0000 7f6bbd1ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bb806a7f0 con 0x7f6bb815c890 2023-07-14T11:19:55.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.764+0000 7f6bbd1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb806b760 con 0x7f6bb80b2440 2023-07-14T11:19:55.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.764+0000 7f6bb759e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6bb806c240 0x7f6bb80cf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:55.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.764+0000 7f6bb759e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6bb806c240 0x7f6bb80cf840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34310/0 (socket says 172.21.15.84:34310) 2023-07-14T11:19:55.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.764+0000 7f6bb759e700 1 -- 172.21.15.84:0/1799825932 learned_addr learned my addr 172.21.15.84:0/1799825932 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:55.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.764+0000 7f6bb6d9d700 1 --2- 172.21.15.84:0/1799825932 >> v2:172.21.15.179:3300/0 conn(0x7f6bb815c890 0x7f6bb80d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:55.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.764+0000 7f6bb659c700 1 --2- 172.21.15.84:0/1799825932 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6bb80b2440 0x7f6bb80d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:55.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.764+0000 7f6bb759e700 1 -- 172.21.15.84:0/1799825932 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6bb80b2440 msgr2=0x7f6bb80d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:55.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.764+0000 7f6bb759e700 1 --2- 172.21.15.84:0/1799825932 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6bb80b2440 0x7f6bb80d0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:55.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.764+0000 7f6bb759e700 1 -- 172.21.15.84:0/1799825932 >> v2:172.21.15.179:3300/0 conn(0x7f6bb815c890 msgr2=0x7f6bb80d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:55.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.764+0000 7f6bb759e700 1 --2- 172.21.15.84:0/1799825932 >> v2:172.21.15.179:3300/0 conn(0x7f6bb815c890 0x7f6bb80d0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:55.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.764+0000 7f6bb759e700 1 -- 172.21.15.84:0/1799825932 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb806ba40 con 0x7f6bb806c240 2023-07-14T11:19:55.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.765+0000 7f6bb759e700 1 --2- 172.21.15.84:0/1799825932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6bb806c240 0x7f6bb80cf840 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f6bb806a650 tx=0x7f6bb000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d93a85d1bd8f0b5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:55.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.765+0000 7f6bb5d9b700 1 -- 172.21.15.84:0/1799825932 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb000e070 con 0x7f6bb806c240 2023-07-14T11:19:55.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.765+0000 7f6bb5d9b700 1 -- 172.21.15.84:0/1799825932 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb000b910 con 0x7f6bb806c240 2023-07-14T11:19:55.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.765+0000 7f6bb5d9b700 1 -- 172.21.15.84:0/1799825932 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb000bcc0 con 0x7f6bb806c240 2023-07-14T11:19:55.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.765+0000 7f6bbd1ff700 1 -- 172.21.15.84:0/1799825932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6bb806c240 msgr2=0x7f6bb80cf840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:55.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.765+0000 7f6bbd1ff700 1 --2- 172.21.15.84:0/1799825932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6bb806c240 0x7f6bb80cf840 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f6bb806a650 tx=0x7f6bb000b330 comp rx=0 tx=0).stop 2023-07-14T11:19:55.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.765+0000 7f6bbd1ff700 1 -- 172.21.15.84:0/1799825932 shutdown_connections 2023-07-14T11:19:55.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.766+0000 7f6bbd1ff700 1 --2- 172.21.15.84:0/1799825932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6bb806c240 0x7f6bb80cf840 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:55.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.766+0000 7f6bbd1ff700 1 --2- 172.21.15.84:0/1799825932 >> v2:172.21.15.179:3300/0 conn(0x7f6bb815c890 0x7f6bb80d0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:55.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.766+0000 7f6bbd1ff700 1 --2- 172.21.15.84:0/1799825932 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6bb80b2440 0x7f6bb80d0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:55.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.766+0000 7f6bbd1ff700 1 -- 172.21.15.84:0/1799825932 >> 172.21.15.84:0/1799825932 conn(0x7f6bb809c170 msgr2=0x7f6bb80d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:55.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.766+0000 7f6bbd1ff700 1 -- 172.21.15.84:0/1799825932 shutdown_connections 2023-07-14T11:19:55.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.766+0000 7f6bbd1ff700 1 -- 172.21.15.84:0/1799825932 wait complete. 2023-07-14T11:19:55.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.768+0000 7f6bbd1ff700 1 Processor -- start 2023-07-14T11:19:55.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.768+0000 7f6bbd1ff700 1 -- start start 2023-07-14T11:19:55.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.769+0000 7f6bbd1ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6bb806c240 0x7f6bb814e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:55.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.769+0000 7f6bbd1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6bb80b2440 0x7f6bb80b5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:55.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.769+0000 7f6bbd1ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6bb815c890 0x7f6bb8156d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:55.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.769+0000 7f6bbd1ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb80b4cd0 con 0x7f6bb815c890 2023-07-14T11:19:55.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.769+0000 7f6bbd1ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb80b40c0 con 0x7f6bb806c240 2023-07-14T11:19:55.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.769+0000 7f6bbd1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb80b43a0 con 0x7f6bb80b2440 2023-07-14T11:19:55.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.769+0000 7f6bb759e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6bb815c890 0x7f6bb8156d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:55.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.769+0000 7f6bb6d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6bb806c240 0x7f6bb814e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:55.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.769+0000 7f6bb6d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6bb806c240 0x7f6bb814e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.84:57652/0 (socket says 172.21.15.84:57652) 2023-07-14T11:19:55.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.769+0000 7f6bb6d9d700 1 -- 172.21.15.84:0/3624485845 learned_addr learned my addr 172.21.15.84:0/3624485845 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:55.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.769+0000 7f6bb659c700 1 --2- 172.21.15.84:0/3624485845 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6bb80b2440 0x7f6bb80b5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:55.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.769+0000 7f6bb759e700 1 -- 172.21.15.84:0/3624485845 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6bb80b2440 msgr2=0x7f6bb80b5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:55.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.769+0000 7f6bb759e700 1 --2- 172.21.15.84:0/3624485845 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6bb80b2440 0x7f6bb80b5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:55.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.769+0000 7f6bb759e700 1 -- 172.21.15.84:0/3624485845 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6bb806c240 msgr2=0x7f6bb814e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:55.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.769+0000 7f6bb759e700 1 --2- 172.21.15.84:0/3624485845 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6bb806c240 0x7f6bb814e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:55.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.769+0000 7f6bb759e700 1 -- 172.21.15.84:0/3624485845 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb0009b30 con 0x7f6bb815c890 2023-07-14T11:19:55.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.770+0000 7f6bb759e700 1 --2- 172.21.15.84:0/3624485845 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6bb815c890 0x7f6bb8156d70 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f6bb0015000 tx=0x7f6bb0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:55.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.770+0000 7f6b9f7fe700 1 -- 172.21.15.84:0/3624485845 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb00099b0 con 0x7f6bb815c890 2023-07-14T11:19:55.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.770+0000 7f6b9f7fe700 1 -- 172.21.15.84:0/3624485845 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb00092e0 con 0x7f6bb815c890 2023-07-14T11:19:55.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.770+0000 7f6b9f7fe700 1 -- 172.21.15.84:0/3624485845 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb0004470 con 0x7f6bb815c890 2023-07-14T11:19:55.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.770+0000 7f6bbd1ff700 1 -- 172.21.15.84:0/3624485845 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bb80b4680 con 0x7f6bb815c890 2023-07-14T11:19:55.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.770+0000 7f6bbd1ff700 1 -- 172.21.15.84:0/3624485845 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bb814e9a0 con 0x7f6bb815c890 2023-07-14T11:19:55.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.771+0000 7f6bbd1ff700 1 -- 172.21.15.84:0/3624485845 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bb8074350 con 0x7f6bb815c890 2023-07-14T11:19:55.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.772+0000 7f6b9f7fe700 1 -- 172.21.15.84:0/3624485845 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f6bb00045d0 con 0x7f6bb815c890 2023-07-14T11:19:55.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.773+0000 7f6b9f7fe700 1 --2- 172.21.15.84:0/3624485845 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f6ba406ae90 0x7f6ba406d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:55.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.773+0000 7f6b9f7fe700 1 -- 172.21.15.84:0/3624485845 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f6bb008acd0 con 0x7f6bb815c890 2023-07-14T11:19:55.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.773+0000 7f6bb6d9d700 1 --2- 172.21.15.84:0/3624485845 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f6ba406ae90 0x7f6ba406d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:55.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.774+0000 7f6bb6d9d700 1 --2- 172.21.15.84:0/3624485845 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f6ba406ae90 0x7f6ba406d340 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6ba8009c00 tx=0x7f6ba8009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:55.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.777+0000 7f6b9f7fe700 1 -- 172.21.15.84:0/3624485845 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f6bb0055980 con 0x7f6bb815c890 2023-07-14T11:19:55.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:55.975+0000 7f6bbd1ff700 1 -- 172.21.15.84:0/3624485845 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6bb80b4e10 con 0x7f6bb815c890 2023-07-14T11:19:56.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:56.930+0000 7f6b9f7fe700 1 -- 172.21.15.84:0/3624485845 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v108) v1 ==== 181+0+0 (secure 0 0 0) 0x7f6bb0058fa0 con 0x7f6bb815c890 2023-07-14T11:19:56.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:56.935+0000 7f6bbd1ff700 1 -- 172.21.15.84:0/3624485845 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f6ba406ae90 msgr2=0x7f6ba406d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:56.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:56.935+0000 7f6bbd1ff700 1 --2- 172.21.15.84:0/3624485845 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f6ba406ae90 0x7f6ba406d340 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6ba8009c00 tx=0x7f6ba8009210 comp rx=0 tx=0).stop 2023-07-14T11:19:56.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:56.935+0000 7f6bbd1ff700 1 -- 172.21.15.84:0/3624485845 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6bb815c890 msgr2=0x7f6bb8156d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:56.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:56.935+0000 7f6bbd1ff700 1 --2- 172.21.15.84:0/3624485845 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6bb815c890 0x7f6bb8156d70 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f6bb0015000 tx=0x7f6bb0004ad0 comp rx=0 tx=0).stop 2023-07-14T11:19:56.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:56.935+0000 7f6bbd1ff700 1 -- 172.21.15.84:0/3624485845 shutdown_connections 2023-07-14T11:19:56.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:56.935+0000 7f6bbd1ff700 1 --2- 172.21.15.84:0/3624485845 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6bb815c890 0x7f6bb8156d70 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:56.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:56.935+0000 7f6bbd1ff700 1 --2- 172.21.15.84:0/3624485845 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6bb806c240 0x7f6bb814e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:56.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:56.935+0000 7f6bbd1ff700 1 --2- 172.21.15.84:0/3624485845 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f6ba406ae90 0x7f6ba406d340 secure :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6ba8009c00 tx=0x7f6ba8009210 comp rx=0 tx=0).stop 2023-07-14T11:19:56.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:56.935+0000 7f6bbd1ff700 1 --2- 172.21.15.84:0/3624485845 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6bb80b2440 0x7f6bb80b5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:56.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:56.935+0000 7f6bbd1ff700 1 -- 172.21.15.84:0/3624485845 >> 172.21.15.84:0/3624485845 conn(0x7f6bb809c170 msgr2=0x7f6bb80b1420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:56.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:56.936+0000 7f6bbd1ff700 1 -- 172.21.15.84:0/3624485845 shutdown_connections 2023-07-14T11:19:56.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:56.936+0000 7f6bbd1ff700 1 -- 172.21.15.84:0/3624485845 wait complete. 2023-07-14T11:19:56.941 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_metadata' removed 2023-07-14T11:19:56.961 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-14T11:19:57.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:57.164+0000 7f21d49ff700 1 Processor -- start 2023-07-14T11:19:57.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:57.164+0000 7f21d49ff700 1 -- start start 2023-07-14T11:19:57.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:57.166+0000 7f21d49ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f21d015d810 0x7f21d00b2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:57.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:57.166+0000 7f21d49ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f21d00b2770 0x7f21d006fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:57.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:57.166+0000 7f21d49ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21d0159fb0 con 0x7f21d0156e40 2023-07-14T11:19:57.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:57.166+0000 7f21d49ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21d0159db0 con 0x7f21d00b2770 2023-07-14T11:19:57.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:57.166+0000 7f21d49ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21d015a290 con 0x7f21d015d810 2023-07-14T11:19:57.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:57.166+0000 7f21ced9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f21d00b2770 0x7f21d006fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:57.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:57.166+0000 7f21ced9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f21d00b2770 0x7f21d006fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34324/0 (socket says 172.21.15.84:34324) 2023-07-14T11:19:57.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:57.166+0000 7f21ced9d700 1 -- 172.21.15.84:0/1937391851 learned_addr learned my addr 172.21.15.84:0/1937391851 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:57.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:57.166+0000 7f21c7fff700 1 --2- 172.21.15.84:0/1937391851 >> v2:172.21.15.179:3300/0 conn(0x7f21d015d810 0x7f21d00b2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:57.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:57.166+0000 7f21ced9d700 1 -- 172.21.15.84:0/1937391851 >> v2:172.21.15.179:3300/0 conn(0x7f21d015d810 msgr2=0x7f21d00b2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:57.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:57.166+0000 7f21ced9d700 1 --2- 172.21.15.84:0/1937391851 >> v2:172.21.15.179:3300/0 conn(0x7f21d015d810 0x7f21d00b2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:57.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:57.166+0000 7f21ced9d700 1 -- 172.21.15.84:0/1937391851 >> v1:172.21.15.179:6789/0 conn(0x7f21d0156e40 legacy=0x7f21d01596a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:57.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:57.166+0000 7f21ced9d700 1 -- 172.21.15.84:0/1937391851 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21d015a570 con 0x7f21d00b2770 2023-07-14T11:19:57.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:57.167+0000 7f21ced9d700 1 --2- 172.21.15.84:0/1937391851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21d00b2770 0x7f21d006fde0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f21d006dbd0 tx=0x7f21c800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ab505eb7a5be7ae server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:57.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:57.167+0000 7f21cdd9b700 1 -- 172.21.15.84:0/1937391851 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c800e070 con 0x7f21d00b2770 2023-07-14T11:19:57.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:57.167+0000 7f21cdd9b700 1 -- 172.21.15.84:0/1937391851 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21c8003a20 con 0x7f21d00b2770 2023-07-14T11:19:57.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:57.167+0000 7f21cdd9b700 1 -- 172.21.15.84:0/1937391851 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c8003dd0 con 0x7f21d00b2770 2023-07-14T11:19:57.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:57.167+0000 7f21d49ff700 1 -- 172.21.15.84:0/1937391851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21d00b2770 msgr2=0x7f21d006fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:57.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:57.167+0000 7f21d49ff700 1 --2- 172.21.15.84:0/1937391851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21d00b2770 0x7f21d006fde0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f21d006dbd0 tx=0x7f21c800b330 comp rx=0 tx=0).stop 2023-07-14T11:19:57.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:57.168+0000 7f21d49ff700 1 -- 172.21.15.84:0/1937391851 shutdown_connections 2023-07-14T11:19:57.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:57.168+0000 7f21d49ff700 1 --2- 172.21.15.84:0/1937391851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21d00b2770 0x7f21d006fde0 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:57.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:57.168+0000 7f21d49ff700 1 --2- 172.21.15.84:0/1937391851 >> v2:172.21.15.179:3300/0 conn(0x7f21d015d810 0x7f21d00b2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:57.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:57.168+0000 7f21d49ff700 1 -- 172.21.15.84:0/1937391851 >> 172.21.15.84:0/1937391851 conn(0x7f21d0065bd0 msgr2=0x7f21d0065fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:57.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:57.168+0000 7f21d49ff700 1 -- 172.21.15.84:0/1937391851 shutdown_connections 2023-07-14T11:19:57.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:57.168+0000 7f21d49ff700 1 -- 172.21.15.84:0/1937391851 wait complete. 2023-07-14T11:19:57.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:57.170+0000 7f21d49ff700 1 Processor -- start 2023-07-14T11:19:57.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:57.170+0000 7f21d49ff700 1 -- start start 2023-07-14T11:19:57.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:57.171+0000 7f21d49ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21d00b2770 0x7f21d01481a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:57.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:57.171+0000 7f21d49ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21d0156e40 0x7f21d014c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:57.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:57.171+0000 7f21d49ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21d015d810 0x7f21d014c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:57.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:57.172+0000 7f21d49ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d00afc10 con 0x7f21d015d810 2023-07-14T11:19:57.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:57.172+0000 7f21d49ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d014cbc0 con 0x7f21d00b2770 2023-07-14T11:19:57.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:57.172+0000 7f21d49ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21d00af000 con 0x7f21d0156e40 2023-07-14T11:19:57.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:57.172+0000 7f21ced9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21d015d810 0x7f21d014c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:57.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:57.172+0000 7f21ced9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21d015d810 0x7f21d014c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34340/0 (socket says 172.21.15.84:34340) 2023-07-14T11:19:57.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:57.172+0000 7f21ced9d700 1 -- 172.21.15.84:0/508596253 learned_addr learned my addr 172.21.15.84:0/508596253 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:57.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:57.172+0000 7f21ced9d700 1 -- 172.21.15.84:0/508596253 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21d0156e40 msgr2=0x7f21d014c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:57.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:57.172+0000 7f21c7fff700 1 --2- 172.21.15.84:0/508596253 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21d0156e40 0x7f21d014c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:57.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:57.172+0000 7f21ce59c700 1 --2- 172.21.15.84:0/508596253 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21d00b2770 0x7f21d01481a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:57.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:57.172+0000 7f21ced9d700 1 --2- 172.21.15.84:0/508596253 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21d0156e40 0x7f21d014c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:57.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:57.172+0000 7f21ced9d700 1 -- 172.21.15.84:0/508596253 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21d00b2770 msgr2=0x7f21d01481a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:57.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:57.172+0000 7f21ced9d700 1 --2- 172.21.15.84:0/508596253 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21d00b2770 0x7f21d01481a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:57.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:57.172+0000 7f21ced9d700 1 -- 172.21.15.84:0/508596253 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c8009b30 con 0x7f21d015d810 2023-07-14T11:19:57.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:57.172+0000 7f21c7fff700 1 --2- 172.21.15.84:0/508596253 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21d0156e40 0x7f21d014c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:19:57.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:57.172+0000 7f21ce59c700 1 --2- 172.21.15.84:0/508596253 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21d00b2770 0x7f21d01481a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:19:57.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:57.172+0000 7f21ced9d700 1 --2- 172.21.15.84:0/508596253 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21d015d810 0x7f21d014c680 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f21c800b370 tx=0x7f21c8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:57.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:57.173+0000 7f21c6ffd700 1 -- 172.21.15.84:0/508596253 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c8004240 con 0x7f21d015d810 2023-07-14T11:19:57.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:57.173+0000 7f21c6ffd700 1 -- 172.21.15.84:0/508596253 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21c80043a0 con 0x7f21d015d810 2023-07-14T11:19:57.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:57.173+0000 7f21d49ff700 1 -- 172.21.15.84:0/508596253 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21d00af2e0 con 0x7f21d015d810 2023-07-14T11:19:57.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:57.173+0000 7f21c6ffd700 1 -- 172.21.15.84:0/508596253 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c8004750 con 0x7f21d015d810 2023-07-14T11:19:57.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:57.173+0000 7f21d49ff700 1 -- 172.21.15.84:0/508596253 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21d00af8a0 con 0x7f21d015d810 2023-07-14T11:19:57.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:57.174+0000 7f21d49ff700 1 -- 172.21.15.84:0/508596253 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21d00afda0 con 0x7f21d015d810 2023-07-14T11:19:57.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:57.175+0000 7f21c6ffd700 1 -- 172.21.15.84:0/508596253 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f21c8019070 con 0x7f21d015d810 2023-07-14T11:19:57.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:57.176+0000 7f21c6ffd700 1 --2- 172.21.15.84:0/508596253 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f21b006ae90 0x7f21b006d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:57.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:57.176+0000 7f21c6ffd700 1 -- 172.21.15.84:0/508596253 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5710+0+0 (secure 0 0 0) 0x7f21c808a600 con 0x7f21d015d810 2023-07-14T11:19:57.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:57.176+0000 7f21ce59c700 1 --2- 172.21.15.84:0/508596253 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f21b006ae90 0x7f21b006d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:57.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:57.177+0000 7f21ce59c700 1 --2- 172.21.15.84:0/508596253 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f21b006ae90 0x7f21b006d340 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f21d00ae5a0 tx=0x7f21c0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:57.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:57.180+0000 7f21c6ffd700 1 -- 172.21.15.84:0/508596253 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f21c8055510 con 0x7f21d015d810 2023-07-14T11:19:57.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:57.379+0000 7f21d49ff700 1 -- 172.21.15.84:0/508596253 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f21d015b870 con 0x7f21d015d810 2023-07-14T11:19:57.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:57.945+0000 7f21c6ffd700 1 -- 172.21.15.84:0/508596253 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v109) v1 ==== 169+0+0 (secure 0 0 0) 0x7f21c8007310 con 0x7f21d015d810 2023-07-14T11:19:57.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:57.949+0000 7f21d49ff700 1 -- 172.21.15.84:0/508596253 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f21b006ae90 msgr2=0x7f21b006d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:57.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:57.949+0000 7f21d49ff700 1 --2- 172.21.15.84:0/508596253 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f21b006ae90 0x7f21b006d340 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f21d00ae5a0 tx=0x7f21c0009040 comp rx=0 tx=0).stop 2023-07-14T11:19:57.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:57.949+0000 7f21d49ff700 1 -- 172.21.15.84:0/508596253 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21d015d810 msgr2=0x7f21d014c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:57.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:57.949+0000 7f21d49ff700 1 --2- 172.21.15.84:0/508596253 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21d015d810 0x7f21d014c680 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f21c800b370 tx=0x7f21c8004ad0 comp rx=0 tx=0).stop 2023-07-14T11:19:57.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:57.949+0000 7f21d49ff700 1 -- 172.21.15.84:0/508596253 shutdown_connections 2023-07-14T11:19:57.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:57.949+0000 7f21d49ff700 1 --2- 172.21.15.84:0/508596253 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21d015d810 0x7f21d014c680 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:57.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:57.949+0000 7f21d49ff700 1 --2- 172.21.15.84:0/508596253 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21d00b2770 0x7f21d01481a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:57.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:57.949+0000 7f21d49ff700 1 --2- 172.21.15.84:0/508596253 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f21b006ae90 0x7f21b006d340 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:57.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:57.949+0000 7f21d49ff700 1 --2- 172.21.15.84:0/508596253 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21d0156e40 0x7f21d014c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:57.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:57.949+0000 7f21d49ff700 1 -- 172.21.15.84:0/508596253 >> 172.21.15.84:0/508596253 conn(0x7f21d0065bd0 msgr2=0x7f21d015ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:57.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:57.949+0000 7f21d49ff700 1 -- 172.21.15.84:0/508596253 shutdown_connections 2023-07-14T11:19:57.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:57.950+0000 7f21d49ff700 1 -- 172.21.15.84:0/508596253 wait complete. 2023-07-14T11:19:57.955 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data' removed 2023-07-14T11:19:57.972 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-14T11:19:58.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.174+0000 7fcdb53ff700 1 Processor -- start 2023-07-14T11:19:58.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.174+0000 7fcdb53ff700 1 -- start start 2023-07-14T11:19:58.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.174+0000 7fcdb53ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcdb00c92d0 0x7fcdb00ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:58.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.174+0000 7fcdb53ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fcdb00b12f0 0x7fcdb00c96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:58.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.174+0000 7fcdb53ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdb015ce70 con 0x7fcdb00adea0 2023-07-14T11:19:58.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.174+0000 7fcdb53ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdb015da60 con 0x7fcdb00c92d0 2023-07-14T11:19:58.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.174+0000 7fcdb53ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdb00c9be0 con 0x7fcdb00b12f0 2023-07-14T11:19:58.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.174+0000 7fcdaeffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcdb00c92d0 0x7fcdb00ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:58.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.174+0000 7fcdaf7fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fcdb00adea0 0x7fcdb006c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:35058/0 (socket says 172.21.15.84:35058) 2023-07-14T11:19:58.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.174+0000 7fcdaeffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcdb00c92d0 0x7fcdb00ad8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34342/0 (socket says 172.21.15.84:34342) 2023-07-14T11:19:58.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.174+0000 7fcdaf7fe700 1 -- 172.21.15.84:0/1961622974 learned_addr learned my addr 172.21.15.84:0/1961622974 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:19:58.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.175+0000 7fcda7fff700 1 --2- 172.21.15.84:0/1961622974 >> v2:172.21.15.179:3300/0 conn(0x7fcdb00b12f0 0x7fcdb00c96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:58.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.175+0000 7fcdaeffd700 1 -- 172.21.15.84:0/1961622974 >> v2:172.21.15.179:3300/0 conn(0x7fcdb00b12f0 msgr2=0x7fcdb00c96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:58.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.175+0000 7fcdaeffd700 1 --2- 172.21.15.84:0/1961622974 >> v2:172.21.15.179:3300/0 conn(0x7fcdb00b12f0 0x7fcdb00c96a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:58.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.175+0000 7fcdaeffd700 1 -- 172.21.15.84:0/1961622974 >> v1:172.21.15.84:6789/0 conn(0x7fcdb00adea0 legacy=0x7fcdb006c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:58.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.175+0000 7fcdaeffd700 1 -- 172.21.15.84:0/1961622974 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdb015d0c0 con 0x7fcdb00c92d0 2023-07-14T11:19:58.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.175+0000 7fcdae7fc700 1 -- 172.21.15.84:0/1961622974 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3964418986 0 0) 0x7fcdb015ce70 con 0x7fcdb00adea0 2023-07-14T11:19:58.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.175+0000 7fcdaeffd700 1 --2- 172.21.15.84:0/1961622974 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcdb00c92d0 0x7fcdb00ad8f0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7fcdb006d890 tx=0x7fcda000bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cde2835f6cb73bc8 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:58.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.175+0000 7fcdae7fc700 1 -- 172.21.15.84:0/1961622974 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda000dc70 con 0x7fcdb00c92d0 2023-07-14T11:19:58.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.175+0000 7fcdae7fc700 1 -- 172.21.15.84:0/1961622974 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcda000ddd0 con 0x7fcdb00c92d0 2023-07-14T11:19:58.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.175+0000 7fcdae7fc700 1 -- 172.21.15.84:0/1961622974 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda0010690 con 0x7fcdb00c92d0 2023-07-14T11:19:58.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.176+0000 7fcdb53ff700 1 -- 172.21.15.84:0/1961622974 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcdb00c92d0 msgr2=0x7fcdb00ad8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:58.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.176+0000 7fcdb53ff700 1 --2- 172.21.15.84:0/1961622974 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcdb00c92d0 0x7fcdb00ad8f0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7fcdb006d890 tx=0x7fcda000bdc0 comp rx=0 tx=0).stop 2023-07-14T11:19:58.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.176+0000 7fcdb53ff700 1 -- 172.21.15.84:0/1961622974 shutdown_connections 2023-07-14T11:19:58.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.176+0000 7fcdb53ff700 1 --2- 172.21.15.84:0/1961622974 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcdb00c92d0 0x7fcdb00ad8f0 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:58.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.176+0000 7fcdb53ff700 1 --2- 172.21.15.84:0/1961622974 >> v2:172.21.15.179:3300/0 conn(0x7fcdb00b12f0 0x7fcdb00c96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:58.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.176+0000 7fcdb53ff700 1 -- 172.21.15.84:0/1961622974 >> 172.21.15.84:0/1961622974 conn(0x7fcdb00b05d0 msgr2=0x7fcdb00b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:58.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.176+0000 7fcdb53ff700 1 -- 172.21.15.84:0/1961622974 shutdown_connections 2023-07-14T11:19:58.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.176+0000 7fcdb53ff700 1 -- 172.21.15.84:0/1961622974 wait complete. 2023-07-14T11:19:58.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.178+0000 7fcdb53ff700 1 Processor -- start 2023-07-14T11:19:58.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.178+0000 7fcdb53ff700 1 -- start start 2023-07-14T11:19:58.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.179+0000 7fcdb53ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcdb00adea0 0x7fcdb01ee5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:58.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.179+0000 7fcdb53ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcdb00b12f0 0x7fcdb01f1a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:58.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.179+0000 7fcdb53ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcdb00c92d0 0x7fcdb00c7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:58.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.179+0000 7fcdb53ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb01ee110 con 0x7fcdb00adea0 2023-07-14T11:19:58.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.179+0000 7fcdb53ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb01f1f50 con 0x7fcdb00c92d0 2023-07-14T11:19:58.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.179+0000 7fcdb53ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb00c85e0 con 0x7fcdb00b12f0 2023-07-14T11:19:58.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.179+0000 7fcdaeffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcdb00adea0 0x7fcdb01ee5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:58.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.179+0000 7fcdaeffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcdb00adea0 0x7fcdb01ee5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34358/0 (socket says 172.21.15.84:34358) 2023-07-14T11:19:58.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.179+0000 7fcdaeffd700 1 -- 172.21.15.84:0/2206825754 learned_addr learned my addr 172.21.15.84:0/2206825754 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:58.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.180+0000 7fcdaf7fe700 1 --2- 172.21.15.84:0/2206825754 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcdb00c92d0 0x7fcdb00c7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:58.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.180+0000 7fcda7fff700 1 --2- 172.21.15.84:0/2206825754 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcdb00b12f0 0x7fcdb01f1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:58.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.180+0000 7fcdaeffd700 1 -- 172.21.15.84:0/2206825754 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcdb00b12f0 msgr2=0x7fcdb01f1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:58.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.180+0000 7fcdaeffd700 1 --2- 172.21.15.84:0/2206825754 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcdb00b12f0 0x7fcdb01f1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:58.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.180+0000 7fcdaeffd700 1 -- 172.21.15.84:0/2206825754 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcdb00c92d0 msgr2=0x7fcdb00c7b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:58.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.180+0000 7fcdaeffd700 1 --2- 172.21.15.84:0/2206825754 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcdb00c92d0 0x7fcdb00c7b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:58.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.180+0000 7fcdaeffd700 1 -- 172.21.15.84:0/2206825754 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda000b740 con 0x7fcdb00adea0 2023-07-14T11:19:58.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.180+0000 7fcda7fff700 1 --2- 172.21.15.84:0/2206825754 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcdb00b12f0 0x7fcdb01f1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:19:58.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.180+0000 7fcdaf7fe700 1 --2- 172.21.15.84:0/2206825754 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcdb00c92d0 0x7fcdb00c7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:19:58.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.180+0000 7fcdaeffd700 1 --2- 172.21.15.84:0/2206825754 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcdb00adea0 0x7fcdb01ee5a0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7fcda000b2c0 tx=0x7fcda0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:58.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.180+0000 7fcda77fe700 1 -- 172.21.15.84:0/2206825754 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda001d070 con 0x7fcdb00adea0 2023-07-14T11:19:58.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.180+0000 7fcda77fe700 1 -- 172.21.15.84:0/2206825754 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcda001e040 con 0x7fcdb00adea0 2023-07-14T11:19:58.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.180+0000 7fcda77fe700 1 -- 172.21.15.84:0/2206825754 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda0010e90 con 0x7fcdb00adea0 2023-07-14T11:19:58.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.180+0000 7fcdb53ff700 1 -- 172.21.15.84:0/2206825754 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdb00c88c0 con 0x7fcdb00adea0 2023-07-14T11:19:58.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.180+0000 7fcdb53ff700 1 -- 172.21.15.84:0/2206825754 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdb01eda70 con 0x7fcdb00adea0 2023-07-14T11:19:58.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.181+0000 7fcdb53ff700 1 -- 172.21.15.84:0/2206825754 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdb01ee3f0 con 0x7fcdb00adea0 2023-07-14T11:19:58.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.182+0000 7fcda77fe700 1 -- 172.21.15.84:0/2206825754 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) v1 ==== 89190+0+0 (secure 0 0 0) 0x7fcda00036a0 con 0x7fcdb00adea0 2023-07-14T11:19:58.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.183+0000 7fcda77fe700 1 --2- 172.21.15.84:0/2206825754 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fcd9006ae90 0x7fcd9006d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:58.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.183+0000 7fcda77fe700 1 -- 172.21.15.84:0/2206825754 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fcda008da20 con 0x7fcdb00adea0 2023-07-14T11:19:58.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.184+0000 7fcda7fff700 1 --2- 172.21.15.84:0/2206825754 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fcd9006ae90 0x7fcd9006d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:58.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.184+0000 7fcda7fff700 1 --2- 172.21.15.84:0/2206825754 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fcd9006ae90 0x7fcd9006d340 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fcdb0154980 tx=0x7fcd98008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:58.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.187+0000 7fcda77fe700 1 -- 172.21.15.84:0/2206825754 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fcda0058a50 con 0x7fcdb00adea0 2023-07-14T11:19:58.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.382+0000 7fcdb53ff700 1 -- 172.21.15.84:0/2206825754 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fcdb006ad10 con 0x7fcdb00adea0 2023-07-14T11:19:58.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.386+0000 7fcda77fe700 1 -- 172.21.15.84:0/2206825754 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7fcda005c070 con 0x7fcdb00adea0 2023-07-14T11:19:58.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.389+0000 7fcdb53ff700 1 -- 172.21.15.84:0/2206825754 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fcd9006ae90 msgr2=0x7fcd9006d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:58.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.389+0000 7fcdb53ff700 1 --2- 172.21.15.84:0/2206825754 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fcd9006ae90 0x7fcd9006d340 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fcdb0154980 tx=0x7fcd98008040 comp rx=0 tx=0).stop 2023-07-14T11:19:58.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.389+0000 7fcdb53ff700 1 -- 172.21.15.84:0/2206825754 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcdb00adea0 msgr2=0x7fcdb01ee5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:58.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.389+0000 7fcdb53ff700 1 --2- 172.21.15.84:0/2206825754 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcdb00adea0 0x7fcdb01ee5a0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7fcda000b2c0 tx=0x7fcda0004750 comp rx=0 tx=0).stop 2023-07-14T11:19:58.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.389+0000 7fcdb53ff700 1 -- 172.21.15.84:0/2206825754 shutdown_connections 2023-07-14T11:19:58.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.389+0000 7fcdb53ff700 1 --2- 172.21.15.84:0/2206825754 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcdb00c92d0 0x7fcdb00c7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:58.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.389+0000 7fcdb53ff700 1 --2- 172.21.15.84:0/2206825754 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcdb00adea0 0x7fcdb01ee5a0 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:58.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.389+0000 7fcdb53ff700 1 --2- 172.21.15.84:0/2206825754 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fcd9006ae90 0x7fcd9006d340 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:58.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.389+0000 7fcdb53ff700 1 --2- 172.21.15.84:0/2206825754 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcdb00b12f0 0x7fcdb01f1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:58.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.389+0000 7fcdb53ff700 1 -- 172.21.15.84:0/2206825754 >> 172.21.15.84:0/2206825754 conn(0x7fcdb00b05d0 msgr2=0x7fcdb00cea10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:58.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.389+0000 7fcdb53ff700 1 -- 172.21.15.84:0/2206825754 shutdown_connections 2023-07-14T11:19:58.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.389+0000 7fcdb53ff700 1 -- 172.21.15.84:0/2206825754 wait complete. 2023-07-14T11:19:58.410 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_sanity' 2023-07-14T11:19:58.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.602+0000 7f58f13ff700 1 Processor -- start 2023-07-14T11:19:58.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.602+0000 7f58f13ff700 1 -- start start 2023-07-14T11:19:58.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.604+0000 7f58f13ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58ec0b39c0 0x7f58ec06c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:58.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.604+0000 7f58f13ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58ec0707a0 con 0x7f58ec15cb50 2023-07-14T11:19:58.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.604+0000 7f58f13ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58ec0ce190 con 0x7f58ec06c690 2023-07-14T11:19:58.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.604+0000 7f58f13ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58ec0cb650 con 0x7f58ec0b39c0 2023-07-14T11:19:58.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.604+0000 7f58eaffd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f58ec15cb50 0x7f58ec06f940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:35064/0 (socket says 172.21.15.84:35064) 2023-07-14T11:19:58.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.604+0000 7f58eaffd700 1 -- 172.21.15.84:0/2559951926 learned_addr learned my addr 172.21.15.84:0/2559951926 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:19:58.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.604+0000 7f58ea7fc700 1 --2- 172.21.15.84:0/2559951926 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58ec0b39c0 0x7f58ec06c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:58.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.604+0000 7f58e9ffb700 1 -- 172.21.15.84:0/2559951926 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2643911772 0 0) 0x7f58ec0707a0 con 0x7f58ec15cb50 2023-07-14T11:19:58.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.604+0000 7f58e9ffb700 1 -- 172.21.15.84:0/2559951926 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58d40035b0 con 0x7f58ec15cb50 2023-07-14T11:19:58.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.605+0000 7f58e9ffb700 1 -- 172.21.15.84:0/2559951926 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2181839240 0 0) 0x7f58ec0ce190 con 0x7f58ec06c690 2023-07-14T11:19:58.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.605+0000 7f58e9ffb700 1 -- 172.21.15.84:0/2559951926 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58ec0707a0 con 0x7f58ec06c690 2023-07-14T11:19:58.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.605+0000 7f58e9ffb700 1 -- 172.21.15.84:0/2559951926 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1359382104 0 0) 0x7f58d40035b0 con 0x7f58ec15cb50 2023-07-14T11:19:58.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.605+0000 7f58e9ffb700 1 -- 172.21.15.84:0/2559951926 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58ec0b39c0 msgr2=0x7f58ec06c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:58.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.605+0000 7f58e9ffb700 1 --2- 172.21.15.84:0/2559951926 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58ec0b39c0 0x7f58ec06c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:58.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.605+0000 7f58e9ffb700 1 -- 172.21.15.84:0/2559951926 >> v1:172.21.15.179:6789/0 conn(0x7f58ec06c690 legacy=0x7f58ec0b22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:58.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.605+0000 7f58e9ffb700 1 -- 172.21.15.84:0/2559951926 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58ec0701e0 con 0x7f58ec15cb50 2023-07-14T11:19:58.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.605+0000 7f58e9ffb700 1 -- 172.21.15.84:0/2559951926 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7f58dc001670 con 0x7f58ec15cb50 2023-07-14T11:19:58.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.605+0000 7f58e9ffb700 1 -- 172.21.15.84:0/2559951926 >> v1:172.21.15.84:6789/0 conn(0x7f58ec15cb50 legacy=0x7f58ec06f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:58.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.605+0000 7f58e9ffb700 1 --2- 172.21.15.84:0/2559951926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58d4003bc0 0x7f58d4003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:58.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.605+0000 7f58e9ffb700 1 --2- 172.21.15.84:0/2559951926 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58d4004850 0x7f58d4004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:58.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.605+0000 7f58e9ffb700 1 --2- 172.21.15.84:0/2559951926 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58ec0b39c0 0x7f58d4005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:58.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.605+0000 7f58e9ffb700 1 -- 172.21.15.84:0/2559951926 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58ec0cb650 con 0x7f58d4003bc0 2023-07-14T11:19:58.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.605+0000 7f58e9ffb700 1 -- 172.21.15.84:0/2559951926 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d400dcd0 con 0x7f58d4004850 2023-07-14T11:19:58.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.605+0000 7f58e9ffb700 1 -- 172.21.15.84:0/2559951926 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58d400de40 con 0x7f58ec0b39c0 2023-07-14T11:19:58.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.605+0000 7f58eaffd700 1 --2- 172.21.15.84:0/2559951926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58d4003bc0 0x7f58d4003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:58.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.605+0000 7f58ea7fc700 1 --2- 172.21.15.84:0/2559951926 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58d4004850 0x7f58d4004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:58.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.605+0000 7f58eb7fe700 1 --2- 172.21.15.84:0/2559951926 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58ec0b39c0 0x7f58d4005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:58.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.606+0000 7f58eaffd700 1 -- 172.21.15.84:0/2559951926 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58ec0b39c0 msgr2=0x7f58d4005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:58.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.606+0000 7f58eaffd700 1 --2- 172.21.15.84:0/2559951926 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58ec0b39c0 0x7f58d4005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:58.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.606+0000 7f58eaffd700 1 -- 172.21.15.84:0/2559951926 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58d4004850 msgr2=0x7f58d4004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:19:58.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.606+0000 7f58eaffd700 1 --2- 172.21.15.84:0/2559951926 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58d4004850 0x7f58d4004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:58.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.606+0000 7f58eaffd700 1 -- 172.21.15.84:0/2559951926 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d40035b0 con 0x7f58d4003bc0 2023-07-14T11:19:58.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.606+0000 7f58eaffd700 1 --2- 172.21.15.84:0/2559951926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58d4003bc0 0x7f58d4003fb0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f58dc00c210 tx=0x7f58d4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b816a1eecbba66 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:58.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.606+0000 7f58e9ffb700 1 -- 172.21.15.84:0/2559951926 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58dc00cd50 con 0x7f58d4003bc0 2023-07-14T11:19:58.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.606+0000 7f58e9ffb700 1 -- 172.21.15.84:0/2559951926 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58dc005960 con 0x7f58d4003bc0 2023-07-14T11:19:58.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.606+0000 7f58e9ffb700 1 -- 172.21.15.84:0/2559951926 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58dc005d10 con 0x7f58d4003bc0 2023-07-14T11:19:58.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.607+0000 7f58f13ff700 1 -- 172.21.15.84:0/2559951926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58d4003bc0 msgr2=0x7f58d4003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:58.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.607+0000 7f58f13ff700 1 --2- 172.21.15.84:0/2559951926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58d4003bc0 0x7f58d4003fb0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f58dc00c210 tx=0x7f58d4005880 comp rx=0 tx=0).stop 2023-07-14T11:19:58.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.607+0000 7f58eb7fe700 1 -- 172.21.15.84:0/2559951926 reap_dead start 2023-07-14T11:19:58.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.607+0000 7f58f13ff700 1 -- 172.21.15.84:0/2559951926 shutdown_connections 2023-07-14T11:19:58.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.607+0000 7f58f13ff700 1 -- 172.21.15.84:0/2559951926 >> 172.21.15.84:0/2559951926 conn(0x7f58ec06ab70 msgr2=0x7f58ec0b05d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:58.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.607+0000 7f58f13ff700 1 -- 172.21.15.84:0/2559951926 shutdown_connections 2023-07-14T11:19:58.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.607+0000 7f58f13ff700 1 -- 172.21.15.84:0/2559951926 wait complete. 2023-07-14T11:19:58.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.608+0000 7f58f13ff700 1 Processor -- start 2023-07-14T11:19:58.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.609+0000 7f58f13ff700 1 -- start start 2023-07-14T11:19:58.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.609+0000 7f58f13ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58d4003bc0 0x7f58ec151ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:58.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.609+0000 7f58f13ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58ec15b8a0 0x7f58ec15bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:58.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.610+0000 7f58f13ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58ec159030 0x7f58ec1594a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:58.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.610+0000 7f58f13ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58ec15c250 con 0x7f58ec159030 2023-07-14T11:19:58.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.610+0000 7f58f13ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58ec159d70 con 0x7f58ec15b8a0 2023-07-14T11:19:58.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.610+0000 7f58f13ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58ec15a050 con 0x7f58d4003bc0 2023-07-14T11:19:58.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.610+0000 7f58eb7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58ec159030 0x7f58ec1594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:58.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.610+0000 7f58eb7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58ec159030 0x7f58ec1594a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34384/0 (socket says 172.21.15.84:34384) 2023-07-14T11:19:58.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.610+0000 7f58eb7fe700 1 -- 172.21.15.84:0/725452659 learned_addr learned my addr 172.21.15.84:0/725452659 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:19:58.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.610+0000 7f58eaffd700 1 --2- 172.21.15.84:0/725452659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58d4003bc0 0x7f58ec151ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:58.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.610+0000 7f58ea7fc700 1 --2- 172.21.15.84:0/725452659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58ec15b8a0 0x7f58ec15bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:58.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.610+0000 7f58eb7fe700 1 -- 172.21.15.84:0/725452659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58d4003bc0 msgr2=0x7f58ec151ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:58.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.610+0000 7f58eb7fe700 1 --2- 172.21.15.84:0/725452659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58d4003bc0 0x7f58ec151ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:58.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.610+0000 7f58eb7fe700 1 -- 172.21.15.84:0/725452659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58ec15b8a0 msgr2=0x7f58ec15bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:58.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.610+0000 7f58eb7fe700 1 --2- 172.21.15.84:0/725452659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58ec15b8a0 0x7f58ec15bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:58.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.610+0000 7f58eb7fe700 1 -- 172.21.15.84:0/725452659 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58ec15a330 con 0x7f58ec159030 2023-07-14T11:19:58.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.610+0000 7f58eaffd700 1 --2- 172.21.15.84:0/725452659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58d4003bc0 0x7f58ec151ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:19:58.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.610+0000 7f58ea7fc700 1 --2- 172.21.15.84:0/725452659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58ec15b8a0 0x7f58ec15bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:19:58.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.610+0000 7f58eb7fe700 1 --2- 172.21.15.84:0/725452659 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58ec159030 0x7f58ec1594a0 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f58ec067fd0 tx=0x7f58e400d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:58.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.611+0000 7f58d37fe700 1 -- 172.21.15.84:0/725452659 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e4003cd0 con 0x7f58ec159030 2023-07-14T11:19:58.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.611+0000 7f58d37fe700 1 -- 172.21.15.84:0/725452659 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58e4003e50 con 0x7f58ec159030 2023-07-14T11:19:58.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.611+0000 7f58d37fe700 1 -- 172.21.15.84:0/725452659 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e400dbd0 con 0x7f58ec159030 2023-07-14T11:19:58.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.611+0000 7f58f13ff700 1 -- 172.21.15.84:0/725452659 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58ec15a610 con 0x7f58ec159030 2023-07-14T11:19:58.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.611+0000 7f58f13ff700 1 -- 172.21.15.84:0/725452659 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58ec1599e0 con 0x7f58ec159030 2023-07-14T11:19:58.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.612+0000 7f58f13ff700 1 -- 172.21.15.84:0/725452659 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58ec15ac60 con 0x7f58ec159030 2023-07-14T11:19:58.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.613+0000 7f58d37fe700 1 -- 172.21.15.84:0/725452659 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f58e400dd30 con 0x7f58ec159030 2023-07-14T11:19:58.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.613+0000 7f58d37fe700 1 --2- 172.21.15.84:0/725452659 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f58d806ae90 0x7f58d806d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:19:58.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.614+0000 7f58d37fe700 1 -- 172.21.15.84:0/725452659 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f58e4089840 con 0x7f58ec159030 2023-07-14T11:19:58.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.614+0000 7f58eaffd700 1 --2- 172.21.15.84:0/725452659 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f58d806ae90 0x7f58d806d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:19:58.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.615+0000 7f58eaffd700 1 --2- 172.21.15.84:0/725452659 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f58d806ae90 0x7f58d806d340 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f58ec15c560 tx=0x7f58dc007f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:19:58.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.618+0000 7f58d37fe700 1 -- 172.21.15.84:0/725452659 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f58e4054970 con 0x7f58ec159030 2023-07-14T11:19:58.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.892+0000 7f58f13ff700 1 -- 172.21.15.84:0/725452659 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_sanity"]} v 0) v1 -- 0x7f58ec06cb00 con 0x7f58ec159030 2023-07-14T11:19:58.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.940+0000 7f58d37fe700 1 -- 172.21.15.84:0/725452659 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_sanity"]}]=0 v383) v1 ==== 149+0+0 (secure 0 0 0) 0x7f58e4057f90 con 0x7f58ec159030 2023-07-14T11:19:58.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.943+0000 7f58f13ff700 1 -- 172.21.15.84:0/725452659 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f58d806ae90 msgr2=0x7f58d806d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:58.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.943+0000 7f58f13ff700 1 --2- 172.21.15.84:0/725452659 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f58d806ae90 0x7f58d806d340 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f58ec15c560 tx=0x7f58dc007f90 comp rx=0 tx=0).stop 2023-07-14T11:19:58.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.943+0000 7f58f13ff700 1 -- 172.21.15.84:0/725452659 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58ec159030 msgr2=0x7f58ec1594a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:19:58.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.943+0000 7f58f13ff700 1 --2- 172.21.15.84:0/725452659 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58ec159030 0x7f58ec1594a0 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f58ec067fd0 tx=0x7f58e400d430 comp rx=0 tx=0).stop 2023-07-14T11:19:58.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.943+0000 7f58f13ff700 1 -- 172.21.15.84:0/725452659 shutdown_connections 2023-07-14T11:19:58.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.943+0000 7f58f13ff700 1 --2- 172.21.15.84:0/725452659 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f58d806ae90 0x7f58d806d340 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:58.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.943+0000 7f58f13ff700 1 --2- 172.21.15.84:0/725452659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58d4003bc0 0x7f58ec151ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:58.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.943+0000 7f58f13ff700 1 --2- 172.21.15.84:0/725452659 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58ec159030 0x7f58ec1594a0 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:58.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.943+0000 7f58f13ff700 1 --2- 172.21.15.84:0/725452659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58ec15b8a0 0x7f58ec15bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:19:58.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.943+0000 7f58f13ff700 1 -- 172.21.15.84:0/725452659 >> 172.21.15.84:0/725452659 conn(0x7f58ec06ab70 msgr2=0x7f58ec0b1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:19:58.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.943+0000 7f58f13ff700 1 -- 172.21.15.84:0/725452659 shutdown_connections 2023-07-14T11:19:58.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:19:58.943+0000 7f58f13ff700 1 -- 172.21.15.84:0/725452659 wait complete. 2023-07-14T11:19:58.963 INFO:tasks.cephfs_test_runner:test_subvolume_no_upgrade_v1_sanity (tasks.cephfs.test_volumes.TestMisc) ... ERROR 2023-07-14T11:19:58.964 INFO:tasks.cephfs_test_runner: 2023-07-14T11:19:58.964 INFO:tasks.cephfs_test_runner:====================================================================== 2023-07-14T11:19:58.964 INFO:tasks.cephfs_test_runner:ERROR: test_subvolume_no_upgrade_v1_sanity (tasks.cephfs.test_volumes.TestMisc) 2023-07-14T11:19:58.965 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-07-14T11:19:58.965 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-07-14T11:19:58.965 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_3fc0089cc1082313a98853d48b892acdc1385b8b/qa/tasks/cephfs/test_volumes.py", line 7597, in test_subvolume_no_upgrade_v1_sanity 2023-07-14T11:19:58.965 INFO:tasks.cephfs_test_runner: self._fs_cmd("subvolume", "resize", self.volname, subvolume, str(nsize)) 2023-07-14T11:19:58.965 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_3fc0089cc1082313a98853d48b892acdc1385b8b/qa/tasks/cephfs/test_volumes.py", line 38, in _fs_cmd 2023-07-14T11:19:58.966 INFO:tasks.cephfs_test_runner: return self.mgr_cluster.mon_manager.raw_cluster_cmd("fs", *args) 2023-07-14T11:19:58.966 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_3fc0089cc1082313a98853d48b892acdc1385b8b/qa/tasks/ceph_manager.py", line 1597, in raw_cluster_cmd 2023-07-14T11:19:58.966 INFO:tasks.cephfs_test_runner: return self.run_cluster_cmd(**kwargs).stdout.getvalue() 2023-07-14T11:19:58.966 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_3fc0089cc1082313a98853d48b892acdc1385b8b/qa/tasks/ceph_manager.py", line 1588, in run_cluster_cmd 2023-07-14T11:19:58.966 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2023-07-14T11:19:58.966 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_aa6a80e6cc655fff48452a7eca02070e61d074fc/teuthology/orchestra/remote.py", line 522, in run 2023-07-14T11:19:58.967 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-07-14T11:19:58.967 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_aa6a80e6cc655fff48452a7eca02070e61d074fc/teuthology/orchestra/run.py", line 455, in run 2023-07-14T11:19:58.967 INFO:tasks.cephfs_test_runner: r.wait() 2023-07-14T11:19:58.967 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_aa6a80e6cc655fff48452a7eca02070e61d074fc/teuthology/orchestra/run.py", line 161, in wait 2023-07-14T11:19:58.967 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-07-14T11:19:58.968 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_aa6a80e6cc655fff48452a7eca02070e61d074fc/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-07-14T11:19:58.968 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-07-14T11:19:58.968 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi084 with status 22: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume resize cephfs subvolume_0000000000536115 10485760' 2023-07-14T11:19:58.968 INFO:tasks.cephfs_test_runner: 2023-07-14T11:19:58.968 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-07-14T11:19:58.969 INFO:tasks.cephfs_test_runner:Ran 6 tests in 363.999s 2023-07-14T11:19:58.969 INFO:tasks.cephfs_test_runner: 2023-07-14T11:19:58.969 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2023-07-14T11:19:58.969 INFO:tasks.cephfs_test_runner: 2023-07-14T11:19:58.969 INFO:tasks.cephfs_test_runner:====================================================================== 2023-07-14T11:19:58.970 INFO:tasks.cephfs_test_runner:ERROR: test_subvolume_no_upgrade_v1_sanity (tasks.cephfs.test_volumes.TestMisc) 2023-07-14T11:19:58.970 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-07-14T11:19:58.970 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-07-14T11:19:58.970 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_3fc0089cc1082313a98853d48b892acdc1385b8b/qa/tasks/cephfs/test_volumes.py", line 7597, in test_subvolume_no_upgrade_v1_sanity 2023-07-14T11:19:58.970 INFO:tasks.cephfs_test_runner: self._fs_cmd("subvolume", "resize", self.volname, subvolume, str(nsize)) 2023-07-14T11:19:58.971 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_3fc0089cc1082313a98853d48b892acdc1385b8b/qa/tasks/cephfs/test_volumes.py", line 38, in _fs_cmd 2023-07-14T11:19:58.971 INFO:tasks.cephfs_test_runner: return self.mgr_cluster.mon_manager.raw_cluster_cmd("fs", *args) 2023-07-14T11:19:58.971 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_3fc0089cc1082313a98853d48b892acdc1385b8b/qa/tasks/ceph_manager.py", line 1597, in raw_cluster_cmd 2023-07-14T11:19:58.971 INFO:tasks.cephfs_test_runner: return self.run_cluster_cmd(**kwargs).stdout.getvalue() 2023-07-14T11:19:58.971 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_3fc0089cc1082313a98853d48b892acdc1385b8b/qa/tasks/ceph_manager.py", line 1588, in run_cluster_cmd 2023-07-14T11:19:58.971 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2023-07-14T11:19:58.972 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_aa6a80e6cc655fff48452a7eca02070e61d074fc/teuthology/orchestra/remote.py", line 522, in run 2023-07-14T11:19:58.972 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-07-14T11:19:58.972 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_aa6a80e6cc655fff48452a7eca02070e61d074fc/teuthology/orchestra/run.py", line 455, in run 2023-07-14T11:19:58.972 INFO:tasks.cephfs_test_runner: r.wait() 2023-07-14T11:19:58.973 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_aa6a80e6cc655fff48452a7eca02070e61d074fc/teuthology/orchestra/run.py", line 161, in wait 2023-07-14T11:19:58.973 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-07-14T11:19:58.973 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_aa6a80e6cc655fff48452a7eca02070e61d074fc/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-07-14T11:19:58.973 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-07-14T11:19:58.973 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi084 with status 22: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume resize cephfs subvolume_0000000000536115 10485760' 2023-07-14T11:19:58.974 INFO:tasks.cephfs_test_runner: 2023-07-14T11:19:58.974 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_aa6a80e6cc655fff48452a7eca02070e61d074fc/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_3fc0089cc1082313a98853d48b892acdc1385b8b/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_subvolume_no_upgrade_v1_sanity (tasks.cephfs.test_volumes.TestMisc) 2023-07-14T11:19:59.035 ERROR:teuthology.run_tasks: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=8ba8de7579104a0eaa3f0b3f2757b762 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_aa6a80e6cc655fff48452a7eca02070e61d074fc/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_3fc0089cc1082313a98853d48b892acdc1385b8b/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_subvolume_no_upgrade_v1_sanity (tasks.cephfs.test_volumes.TestMisc) 2023-07-14T11:19:59.036 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-07-14T11:19:59.048 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-07-14T11:19:59.073 INFO:tasks.kclient:Unmounting kernel clients... 2023-07-14T11:19:59.073 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-14T11:19:59.073 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:19:59.159 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345568k,nr_inodes=4086392,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=35,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275008k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-07-14T11:19:59.160 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-14T11:19:59.160 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:19:59.245 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345568k,nr_inodes=4086392,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=35,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275008k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-07-14T11:19:59.245 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-07-14T11:19:59.246 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:19:59.296 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345528k,nr_inodes=4086382,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=40,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275000k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-07-14T11:19:59.297 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-07-14T11:19:59.297 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T11:19:59.345 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345528k,nr_inodes=4086382,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=40,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275000k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-07-14T11:19:59.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:19:59.346 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2023-07-14T11:19:59.392 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-14T11:19:59.393 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-14T11:19:59.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:19:59.394 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-14T11:19:59.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:19:59.465 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-14T11:19:59.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:19:59.541 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link delete ceph-brx 2023-07-14T11:19:59.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:19:59.678 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2023-07-14T11:19:59.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:19:59.730 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link delete ceph-brx 2023-07-14T11:19:59.804 INFO:teuthology.orchestra.run.smithi084.stderr:Cannot find device "ceph-brx" 2023-07-14T11:19:59.807 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-14T11:19:59.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:19:59.809 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2023-07-14T11:19:59.860 INFO:teuthology.orchestra.run.smithi179.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-07-14T11:19:59.861 INFO:teuthology.orchestra.run.smithi179.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-14T11:19:59.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:19:59.862 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-07-14T11:19:59.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:19:59.936 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-14T11:20:00.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:20:00.012 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link delete ceph-brx 2023-07-14T11:20:00.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:20:00.139 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2023-07-14T11:20:00.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T11:20:00.189 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link delete ceph-brx 2023-07-14T11:20:00.263 INFO:teuthology.orchestra.run.smithi179.stderr:Cannot find device "ceph-brx" 2023-07-14T11:20:00.265 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-14T11:20:00.266 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-07-14T11:20:00.281 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-07-14T11:20:00.282 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T11:20:00.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.487+0000 7f3b575ff700 1 Processor -- start 2023-07-14T11:20:00.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.487+0000 7f3b575ff700 1 -- start start 2023-07-14T11:20:00.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.488+0000 7f3b575ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b500b5d90 0x7f3b500b6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:00.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.488+0000 7f3b575ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3b500d0b10 0x7f3b500d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:00.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.488+0000 7f3b575ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b500b7f50 con 0x7f3b500b4510 2023-07-14T11:20:00.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.488+0000 7f3b575ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b500b48e0 con 0x7f3b500d0b10 2023-07-14T11:20:00.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.488+0000 7f3b575ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b500d14d0 con 0x7f3b500b5d90 2023-07-14T11:20:00.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.488+0000 7f3b55b9c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3b500d0b10 0x7f3b500d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:00.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.488+0000 7f3b55b9c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3b500d0b10 0x7f3b500d0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60066/0 (socket says 172.21.15.84:60066) 2023-07-14T11:20:00.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.488+0000 7f3b55b9c700 1 -- 172.21.15.84:0/3865286756 learned_addr learned my addr 172.21.15.84:0/3865286756 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:20:00.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.488+0000 7f3b54b9a700 1 --2- 172.21.15.84:0/3865286756 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b500b5d90 0x7f3b500b6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:00.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.489+0000 7f3b55b9c700 1 -- 172.21.15.84:0/3865286756 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b500b5d90 msgr2=0x7f3b500b6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:20:00.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.489+0000 7f3b55b9c700 1 --2- 172.21.15.84:0/3865286756 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b500b5d90 0x7f3b500b6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:00.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.489+0000 7f3b55b9c700 1 -- 172.21.15.84:0/3865286756 >> v1:172.21.15.179:6789/0 conn(0x7f3b500b4510 legacy=0x7f3b500cd590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:00.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.489+0000 7f3b55b9c700 1 -- 172.21.15.84:0/3865286756 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b500cdca0 con 0x7f3b500d0b10 2023-07-14T11:20:00.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.489+0000 7f3b54b9a700 1 --2- 172.21.15.84:0/3865286756 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b500b5d90 0x7f3b500b6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:20:00.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.489+0000 7f3b55b9c700 1 --2- 172.21.15.84:0/3865286756 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b500d0b10 0x7f3b500d0f90 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f3b48009e50 tx=0x7f3b4800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1f33eb1a9685ba7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:00.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.489+0000 7f3b47fff700 1 -- 172.21.15.84:0/3865286756 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4800e070 con 0x7f3b500d0b10 2023-07-14T11:20:00.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.489+0000 7f3b47fff700 1 -- 172.21.15.84:0/3865286756 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b4800b9c0 con 0x7f3b500d0b10 2023-07-14T11:20:00.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.489+0000 7f3b47fff700 1 -- 172.21.15.84:0/3865286756 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4800bd70 con 0x7f3b500d0b10 2023-07-14T11:20:00.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.490+0000 7f3b575ff700 1 -- 172.21.15.84:0/3865286756 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b500d0b10 msgr2=0x7f3b500d0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:00.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.490+0000 7f3b575ff700 1 --2- 172.21.15.84:0/3865286756 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b500d0b10 0x7f3b500d0f90 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f3b48009e50 tx=0x7f3b4800b330 comp rx=0 tx=0).stop 2023-07-14T11:20:00.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.490+0000 7f3b575ff700 1 -- 172.21.15.84:0/3865286756 shutdown_connections 2023-07-14T11:20:00.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.490+0000 7f3b575ff700 1 --2- 172.21.15.84:0/3865286756 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b500d0b10 0x7f3b500d0f90 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:00.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.490+0000 7f3b575ff700 1 --2- 172.21.15.84:0/3865286756 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b500b5d90 0x7f3b500b6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:00.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.490+0000 7f3b575ff700 1 -- 172.21.15.84:0/3865286756 >> 172.21.15.84:0/3865286756 conn(0x7f3b5009c1d0 msgr2=0x7f3b500d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:20:00.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.490+0000 7f3b575ff700 1 -- 172.21.15.84:0/3865286756 shutdown_connections 2023-07-14T11:20:00.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.490+0000 7f3b575ff700 1 -- 172.21.15.84:0/3865286756 wait complete. 2023-07-14T11:20:00.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.492+0000 7f3b575ff700 1 Processor -- start 2023-07-14T11:20:00.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.492+0000 7f3b575ff700 1 -- start start 2023-07-14T11:20:00.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.493+0000 7f3b575ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b500b4510 0x7f3b500c7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:00.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.493+0000 7f3b575ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b500b5d90 0x7f3b50151d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:00.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.493+0000 7f3b575ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b500d0b10 0x7f3b5015e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:00.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.493+0000 7f3b575ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b50152860 con 0x7f3b500b4510 2023-07-14T11:20:00.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.493+0000 7f3b575ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b500c79c0 con 0x7f3b500b5d90 2023-07-14T11:20:00.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.493+0000 7f3b575ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b501f2c30 con 0x7f3b500d0b10 2023-07-14T11:20:00.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.493+0000 7f3b5539b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b500b4510 0x7f3b500c7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:00.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.493+0000 7f3b5539b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b500b4510 0x7f3b500c7480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60068/0 (socket says 172.21.15.84:60068) 2023-07-14T11:20:00.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.493+0000 7f3b5539b700 1 -- 172.21.15.84:0/151601063 learned_addr learned my addr 172.21.15.84:0/151601063 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:20:00.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.493+0000 7f3b5539b700 1 -- 172.21.15.84:0/151601063 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b500d0b10 msgr2=0x7f3b5015e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:00.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.493+0000 7f3b5539b700 1 --2- 172.21.15.84:0/151601063 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b500d0b10 0x7f3b5015e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:00.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.493+0000 7f3b5539b700 1 -- 172.21.15.84:0/151601063 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b500b5d90 msgr2=0x7f3b50151d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:00.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.493+0000 7f3b5539b700 1 --2- 172.21.15.84:0/151601063 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b500b5d90 0x7f3b50151d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:00.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.493+0000 7f3b5539b700 1 -- 172.21.15.84:0/151601063 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b48009b30 con 0x7f3b500b4510 2023-07-14T11:20:00.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.493+0000 7f3b5539b700 1 --2- 172.21.15.84:0/151601063 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b500b4510 0x7f3b500c7480 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c00c4d0 tx=0x7f3b4c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:00.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.494+0000 7f3b45ffb700 1 -- 172.21.15.84:0/151601063 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c0052d0 con 0x7f3b500b4510 2023-07-14T11:20:00.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.494+0000 7f3b45ffb700 1 -- 172.21.15.84:0/151601063 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b4c005430 con 0x7f3b500b4510 2023-07-14T11:20:00.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.494+0000 7f3b575ff700 1 -- 172.21.15.84:0/151601063 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b501f2f10 con 0x7f3b500b4510 2023-07-14T11:20:00.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.494+0000 7f3b45ffb700 1 -- 172.21.15.84:0/151601063 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c0038f0 con 0x7f3b500b4510 2023-07-14T11:20:00.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.494+0000 7f3b575ff700 1 -- 172.21.15.84:0/151601063 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b501f34d0 con 0x7f3b500b4510 2023-07-14T11:20:00.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.495+0000 7f3b575ff700 1 -- 172.21.15.84:0/151601063 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b5004e280 con 0x7f3b500b4510 2023-07-14T11:20:00.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.496+0000 7f3b45ffb700 1 -- 172.21.15.84:0/151601063 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f3b4c003a50 con 0x7f3b500b4510 2023-07-14T11:20:00.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.497+0000 7f3b45ffb700 1 --2- 172.21.15.84:0/151601063 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f3b3406ae90 0x7f3b3406d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:00.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.497+0000 7f3b45ffb700 1 -- 172.21.15.84:0/151601063 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f3b4c0889b0 con 0x7f3b500b4510 2023-07-14T11:20:00.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.497+0000 7f3b54b9a700 1 --2- 172.21.15.84:0/151601063 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f3b3406ae90 0x7f3b3406d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:00.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.498+0000 7f3b54b9a700 1 --2- 172.21.15.84:0/151601063 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f3b3406ae90 0x7f3b3406d340 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3b40006fd0 tx=0x7f3b40008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:00.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.501+0000 7f3b45ffb700 1 -- 172.21.15.84:0/151601063 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3b4c053a60 con 0x7f3b500b4510 2023-07-14T11:20:00.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.693+0000 7f3b575ff700 1 -- 172.21.15.84:0/151601063 --> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3b500b7620 con 0x7f3b3406ae90 2023-07-14T11:20:00.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.696+0000 7f3b45ffb700 1 -- 172.21.15.84:0/151601063 <== mgr.4100 v2:172.21.15.179:6836/2094253834 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72333 (secure 0 0 0) 0x7f3b40004030 con 0x7f3b3406ae90 2023-07-14T11:20:00.700 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:20:00.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.699+0000 7f3b575ff700 1 -- 172.21.15.84:0/151601063 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f3b3406ae90 msgr2=0x7f3b3406d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:00.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.699+0000 7f3b575ff700 1 --2- 172.21.15.84:0/151601063 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f3b3406ae90 0x7f3b3406d340 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3b40006fd0 tx=0x7f3b40008040 comp rx=0 tx=0).stop 2023-07-14T11:20:00.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.699+0000 7f3b575ff700 1 -- 172.21.15.84:0/151601063 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b500b4510 msgr2=0x7f3b500c7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:00.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.699+0000 7f3b575ff700 1 --2- 172.21.15.84:0/151601063 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b500b4510 0x7f3b500c7480 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c00c4d0 tx=0x7f3b4c00c890 comp rx=0 tx=0).stop 2023-07-14T11:20:00.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.699+0000 7f3b575ff700 1 -- 172.21.15.84:0/151601063 shutdown_connections 2023-07-14T11:20:00.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.699+0000 7f3b575ff700 1 --2- 172.21.15.84:0/151601063 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f3b3406ae90 0x7f3b3406d340 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:00.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.699+0000 7f3b575ff700 1 --2- 172.21.15.84:0/151601063 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b500d0b10 0x7f3b5015e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:00.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.699+0000 7f3b575ff700 1 --2- 172.21.15.84:0/151601063 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b500b4510 0x7f3b500c7480 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:00.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.699+0000 7f3b575ff700 1 --2- 172.21.15.84:0/151601063 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b500b5d90 0x7f3b50151d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:00.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.699+0000 7f3b575ff700 1 -- 172.21.15.84:0/151601063 >> 172.21.15.84:0/151601063 conn(0x7f3b5009c1d0 msgr2=0x7f3b500ce250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:20:00.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.699+0000 7f3b575ff700 1 -- 172.21.15.84:0/151601063 shutdown_connections 2023-07-14T11:20:00.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.699+0000 7f3b575ff700 1 -- 172.21.15.84:0/151601063 wait complete. 2023-07-14T11:20:00.704 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-07-14T11:20:00.719 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":85,"stamp":"2023-07-14T11:19:58.945740+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":137,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":235560,"kb_used_data":11752,"kb_used_omap":0,"kb_used_meta":223744,"kb_avail":754739160,"statfs":{"total":773094113280,"available":772852899840,"internally_reserved":0,"allocated":12034048,"data_stored":6209313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":229113856},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-36634,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-22,"num_read_kb":-12,"num_write":-60,"num_write_kb":-58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001304"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":168,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:26.811887+0000","last_change":"2023-07-14T11:13:08.762084+0000","last_active":"2023-07-14T11:19:26.811887+0000","last_peered":"2023-07-14T11:19:26.811887+0000","last_clean":"2023-07-14T11:19:26.811887+0000","last_became_active":"2023-07-14T11:13:08.761763+0000","last_became_peered":"2023-07-14T11:13:08.761763+0000","last_unstale":"2023-07-14T11:19:26.811887+0000","last_undegraded":"2023-07-14T11:19:26.811887+0000","last_fullsized":"2023-07-14T11:19:26.811887+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:53:32.176184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":194,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T11:19:57.946665+0000","last_change":"2023-07-14T11:13:08.761726+0000","last_active":"2023-07-14T11:19:57.946665+0000","last_peered":"2023-07-14T11:19:57.946665+0000","last_clean":"2023-07-14T11:19:57.946665+0000","last_became_active":"2023-07-14T11:13:08.761365+0000","last_became_peered":"2023-07-14T11:13:08.761365+0000","last_unstale":"2023-07-14T11:19:57.946665+0000","last_undegraded":"2023-07-14T11:19:57.946665+0000","last_fullsized":"2023-07-14T11:19:57.946665+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:21:57.190044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":158,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400857+0000","last_change":"2023-07-14T11:13:08.923899+0000","last_active":"2023-07-14T11:19:27.400857+0000","last_peered":"2023-07-14T11:19:27.400857+0000","last_clean":"2023-07-14T11:19:27.400857+0000","last_became_active":"2023-07-14T11:13:08.923513+0000","last_became_peered":"2023-07-14T11:13:08.923513+0000","last_unstale":"2023-07-14T11:19:27.400857+0000","last_undegraded":"2023-07-14T11:19:27.400857+0000","last_fullsized":"2023-07-14T11:19:27.400857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:58:50.925932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":158,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400651+0000","last_change":"2023-07-14T11:13:08.760609+0000","last_active":"2023-07-14T11:19:27.400651+0000","last_peered":"2023-07-14T11:19:27.400651+0000","last_clean":"2023-07-14T11:19:27.400651+0000","last_became_active":"2023-07-14T11:13:08.760285+0000","last_became_peered":"2023-07-14T11:13:08.760285+0000","last_unstale":"2023-07-14T11:19:27.400651+0000","last_undegraded":"2023-07-14T11:19:27.400651+0000","last_fullsized":"2023-07-14T11:19:27.400651+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:53:22.176667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"76'128","reported_seq":353,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-14T11:19:27.400632+0000","last_change":"2023-07-14T11:13:01.370649+0000","last_active":"2023-07-14T11:19:27.400632+0000","last_peered":"2023-07-14T11:19:27.400632+0000","last_clean":"2023-07-14T11:19:27.400632+0000","last_became_active":"2023-07-14T11:13:01.369478+0000","last_became_peered":"2023-07-14T11:13:01.369478+0000","last_unstale":"2023-07-14T11:19:27.400632+0000","last_undegraded":"2023-07-14T11:19:27.400632+0000","last_fullsized":"2023-07-14T11:19:27.400632+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:00.254800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:00.254800+0000","last_clean_scrub_stamp":"2023-07-14T11:13:00.254800+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:32:37.718542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":178,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T11:19:57.942399+0000","last_change":"2023-07-14T11:13:08.757882+0000","last_active":"2023-07-14T11:19:57.942399+0000","last_peered":"2023-07-14T11:19:57.942399+0000","last_clean":"2023-07-14T11:19:57.942399+0000","last_became_active":"2023-07-14T11:13:08.757541+0000","last_became_peered":"2023-07-14T11:13:08.757541+0000","last_unstale":"2023-07-14T11:19:57.942399+0000","last_undegraded":"2023-07-14T11:19:57.942399+0000","last_fullsized":"2023-07-14T11:19:57.942399+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:49:40.833577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":182,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T11:19:57.943174+0000","last_change":"2023-07-14T11:13:08.862331+0000","last_active":"2023-07-14T11:19:57.943174+0000","last_peered":"2023-07-14T11:19:57.943174+0000","last_clean":"2023-07-14T11:19:57.943174+0000","last_became_active":"2023-07-14T11:13:08.861817+0000","last_became_peered":"2023-07-14T11:13:08.861817+0000","last_unstale":"2023-07-14T11:19:57.943174+0000","last_undegraded":"2023-07-14T11:19:57.943174+0000","last_fullsized":"2023-07-14T11:19:57.943174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:30:21.109407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":178,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T11:19:57.941200+0000","last_change":"2023-07-14T11:13:08.758749+0000","last_active":"2023-07-14T11:19:57.941200+0000","last_peered":"2023-07-14T11:19:57.941200+0000","last_clean":"2023-07-14T11:19:57.941200+0000","last_became_active":"2023-07-14T11:13:08.757956+0000","last_became_peered":"2023-07-14T11:13:08.757956+0000","last_unstale":"2023-07-14T11:19:57.941200+0000","last_undegraded":"2023-07-14T11:19:57.941200+0000","last_fullsized":"2023-07-14T11:19:57.941200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:14:24.142374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":194,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T11:19:57.946723+0000","last_change":"2023-07-14T11:13:08.923786+0000","last_active":"2023-07-14T11:19:57.946723+0000","last_peered":"2023-07-14T11:19:57.946723+0000","last_clean":"2023-07-14T11:19:57.946723+0000","last_became_active":"2023-07-14T11:13:08.923384+0000","last_became_peered":"2023-07-14T11:13:08.923384+0000","last_unstale":"2023-07-14T11:19:57.946723+0000","last_undegraded":"2023-07-14T11:19:57.946723+0000","last_fullsized":"2023-07-14T11:19:57.946723+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:36:32.179796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574935,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32932,"kb_used_data":1884,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338908,"statfs":{"total":96636764160,"available":96603041792,"internally_reserved":0,"allocated":1929216,"data_stored":1202663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:19:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.66200000000000003,"15min":0.89400000000000002},"min":{"1min":0.55500000000000005,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":8.4339999999999993},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.69199999999999995,"15min":0.92800000000000005},"min":{"1min":0.47599999999999998,"5min":0.45500000000000002,"15min":0.377},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":8.4559999999999995},"last":0.86099999999999999}]},{"osd":1,"last update":"Fri Jul 14 11:19:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.67200000000000004,"15min":0.871},"min":{"1min":0.52100000000000002,"5min":0.40400000000000003,"15min":0.34899999999999998},"max":{"1min":0.90400000000000003,"5min":0.92800000000000005,"15min":6.3520000000000003},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.66100000000000003,"15min":1.0089999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":6.8550000000000004},"last":0.78600000000000003}]},{"osd":2,"last update":"Fri Jul 14 11:19:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.67100000000000004,"15min":1.0569999999999999},"min":{"1min":0.499,"5min":0.434,"15min":0.434},"max":{"1min":0.83599999999999997,"5min":0.997,"15min":7.0289999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.70399999999999996,"15min":0.69299999999999995},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.86399999999999999,"5min":0.98199999999999998,"15min":1.0580000000000001},"last":0.57199999999999995}]},{"osd":3,"last update":"Fri Jul 14 11:19:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.68899999999999995,"15min":1.109},"min":{"1min":0.55200000000000005,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.91100000000000003,"5min":0.95699999999999996,"15min":10.337},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.72699999999999998,"15min":0.75800000000000001},"min":{"1min":0.53300000000000003,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.90100000000000002,"5min":1.024,"15min":1.921},"last":0.72099999999999997}]},{"osd":4,"last update":"Fri Jul 14 11:19:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.64700000000000002,"15min":0.59899999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.73599999999999999,"15min":0.70599999999999996},"min":{"1min":0.57299999999999995,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.90800000000000003,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.82799999999999996}]},{"osd":5,"last update":"Fri Jul 14 11:19:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.70099999999999996,"15min":0.67900000000000005},"min":{"1min":0.39700000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.92800000000000005,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.76400000000000001,"15min":0.73999999999999999},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.91800000000000004}]},{"osd":6,"last update":"Fri Jul 14 11:19:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.72899999999999998,"15min":0.68300000000000005},"min":{"1min":0.505,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.98799999999999999,"5min":1.002,"15min":1.002},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.73299999999999998,"15min":0.69399999999999995},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.48899999999999999},"max":{"1min":0.97399999999999998,"5min":1.129,"15min":1.129},"last":0.748}]}]},{"osd":6,"up_from":13,"seq":55834574936,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28248,"kb_used_data":1296,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343592,"statfs":{"total":96636764160,"available":96607838208,"internally_reserved":0,"allocated":1327104,"data_stored":612245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.69899999999999995,"15min":0.70299999999999996},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93799999999999994,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.73499999999999999,"15min":0.72099999999999997},"min":{"1min":0.51100000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.83899999999999997,"5min":1.167,"15min":1.167},"last":0.60899999999999999}]},{"osd":1,"last update":"Fri Jul 14 11:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71899999999999997,"15min":0.69099999999999995},"min":{"1min":0.443,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.73099999999999998,"15min":0.71399999999999997},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39300000000000002},"max":{"1min":0.90400000000000003,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.67100000000000004}]},{"osd":2,"last update":"Fri Jul 14 11:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.69899999999999995,"15min":0.67900000000000005},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.41299999999999998},"max":{"1min":0.89000000000000001,"5min":1.45,"15min":1.45},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.755,"5min":0.754,"15min":0.77600000000000002},"min":{"1min":0.56399999999999995,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.075,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.63100000000000001}]},{"osd":3,"last update":"Fri Jul 14 11:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.73099999999999998,"15min":0.74299999999999999},"min":{"1min":0.50900000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.86499999999999999,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.73299999999999998,"15min":0.73899999999999999},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0469999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.55100000000000005}]},{"osd":4,"last update":"Fri Jul 14 11:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.69099999999999995,"15min":0.70699999999999996},"min":{"1min":0.53300000000000003,"5min":0.38,"15min":0.38},"max":{"1min":1.177,"5min":1.712,"15min":1.712},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.71999999999999997,"15min":0.72599999999999998},"min":{"1min":0.48199999999999998,"5min":0.438,"15min":0.42899999999999999},"max":{"1min":0.998,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.75}]},{"osd":5,"last update":"Fri Jul 14 11:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.71199999999999997,"15min":0.71799999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.93500000000000005,"5min":2.8820000000000001,"15min":2.8820000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.77200000000000002,"15min":0.78800000000000003},"min":{"1min":0.58399999999999996,"5min":0.46100000000000002,"15min":0.44500000000000001},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.57599999999999996}]},{"osd":7,"last update":"Fri Jul 14 11:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.77500000000000002,"15min":0.79900000000000004},"min":{"1min":0.59899999999999998,"5min":0.47399999999999998,"15min":0.47099999999999997},"max":{"1min":0.95499999999999996,"5min":1.333,"15min":1.333},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.76300000000000001,"15min":0.78900000000000003},"min":{"1min":0.46899999999999997,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.1579999999999999,"5min":1.55,"15min":1.55},"last":0.68999999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574936,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32380,"kb_used_data":1332,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339460,"statfs":{"total":96636764160,"available":96603607040,"internally_reserved":0,"allocated":1363968,"data_stored":630227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.40500000000000003,"15min":0.432},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.54200000000000004,"5min":0.59099999999999997,"15min":0.996},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.432,"5min":0.45500000000000002,"15min":0.47599999999999998},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.57299999999999995,"5min":0.81599999999999995,"15min":0.84299999999999997},"last":0.33800000000000002}]},{"osd":2,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.48099999999999998,"15min":0.54900000000000004},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.60299999999999998,"5min":0.70799999999999996,"15min":2.476},"last":0.504},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.48899999999999999,"15min":0.59499999999999997},"min":{"1min":0.36899999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.64700000000000002,"5min":0.91700000000000004,"15min":2.6299999999999999},"last":0.44900000000000001}]},{"osd":3,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.52800000000000002,"15min":0.52200000000000002},"min":{"1min":0.40899999999999997,"5min":0.39300000000000002,"15min":0.38900000000000001},"max":{"1min":0.72599999999999998,"5min":0.748,"15min":0.748},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46500000000000002,"15min":0.48799999999999999},"min":{"1min":0.33600000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.59499999999999997,"5min":0.67700000000000005,"15min":0.73199999999999998},"last":0.41699999999999998}]},{"osd":4,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.73699999999999999,"15min":0.749},"min":{"1min":0.52400000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.363},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.751,"5min":0.754,"15min":0.76900000000000002},"min":{"1min":0.57099999999999995,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.93999999999999995,"5min":1.1160000000000001,"15min":1.4890000000000001},"last":0.65200000000000002}]},{"osd":5,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.749,"15min":0.76500000000000001},"min":{"1min":0.54200000000000004,"5min":0.499,"15min":0.499},"max":{"1min":1.0589999999999999,"5min":1.2250000000000001,"15min":1.3759999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76200000000000001,"15min":0.80800000000000005},"min":{"1min":0.59099999999999997,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.4330000000000001},"last":0.79200000000000004}]},{"osd":6,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.745,"15min":0.78800000000000003},"min":{"1min":0.55900000000000005,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.028,"5min":1.141,"15min":1.298},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.753,"15min":0.77900000000000003},"min":{"1min":0.60199999999999998,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.97199999999999998,"5min":1.1899999999999999,"15min":1.2130000000000001},"last":0.84199999999999997}]},{"osd":7,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.75900000000000001,"15min":0.80700000000000005},"min":{"1min":0.58299999999999996,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0780000000000001,"5min":1.2010000000000001,"15min":1.4590000000000001},"last":0.872},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.75,"15min":0.77900000000000003},"min":{"1min":0.56299999999999994,"5min":0.55000000000000004,"15min":0.54200000000000004},"max":{"1min":1.129,"5min":1.129,"15min":1.3700000000000001},"last":0.61099999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574934,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28864,"kb_used_data":1912,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94342976,"statfs":{"total":96636764160,"available":96607207424,"internally_reserved":0,"allocated":1957888,"data_stored":1220595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 11:19:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.47699999999999998,"15min":0.44700000000000001},"min":{"1min":0.26800000000000002,"5min":0.252,"15min":0.252},"max":{"1min":2.972,"5min":2.972,"15min":2.972},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.47599999999999998,"15min":0.45200000000000001},"min":{"1min":0.33300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":2.758,"5min":2.758,"15min":2.758},"last":0.40999999999999998}]},{"osd":2,"last update":"Fri Jul 14 11:19:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.499,"15min":0.47299999999999998},"min":{"1min":0.35599999999999998,"5min":0.307,"15min":0.307},"max":{"1min":2.9409999999999998,"5min":2.9409999999999998,"15min":2.9409999999999998},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.51900000000000002,"15min":0.50900000000000001},"min":{"1min":0.376,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":2.556,"5min":2.556,"15min":2.556},"last":0.47299999999999998}]},{"osd":3,"last update":"Fri Jul 14 11:19:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.48199999999999998,"15min":0.438},"min":{"1min":0.33700000000000002,"5min":0.32000000000000001,"15min":0.309},"max":{"1min":2.6019999999999999,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.55600000000000005,"15min":0.53500000000000003},"min":{"1min":0.44900000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":2.9990000000000001,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":0.433}]},{"osd":4,"last update":"Fri Jul 14 11:19:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.73699999999999999,"15min":0.75700000000000001},"min":{"1min":0.51200000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0229999999999999,"5min":1.099,"15min":1.1060000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.76400000000000001,"15min":0.71799999999999997},"min":{"1min":0.57499999999999996,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.651,"5min":1.651,"15min":1.651},"last":0.58299999999999996}]},{"osd":5,"last update":"Fri Jul 14 11:19:12 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.77200000000000002,"15min":0.73799999999999999},"min":{"1min":0.51900000000000002,"5min":0.502,"15min":0.47999999999999998},"max":{"1min":2.9089999999999998,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.76500000000000001,"15min":0.77600000000000002},"min":{"1min":0.53200000000000003,"5min":0.505,"15min":0.505},"max":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.60399999999999998}]},{"osd":6,"last update":"Fri Jul 14 11:19:12 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.745,"15min":0.72799999999999998},"min":{"1min":0.499,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.78700000000000003,"15min":0.78300000000000003},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":2.8679999999999999,"5min":2.8679999999999999,"15min":2.8679999999999999},"last":0.63300000000000001}]},{"osd":7,"last update":"Fri Jul 14 11:19:12 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.77700000000000002,"15min":0.80900000000000005},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.97599999999999998,"5min":1.0900000000000001,"15min":1.149},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.81899999999999995,"15min":0.78900000000000003},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.7410000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":0.61799999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574934,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28284,"kb_used_data":1332,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343556,"statfs":{"total":96636764160,"available":96607801344,"internally_reserved":0,"allocated":1363968,"data_stored":630227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:19:20 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.40899999999999997,"15min":0.441},"min":{"1min":0.27100000000000002,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.623,"5min":0.63900000000000001,"15min":0.64700000000000002},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.438,"15min":0.44400000000000001},"min":{"1min":0.32100000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.63700000000000001,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.44500000000000001}]},{"osd":1,"last update":"Fri Jul 14 11:19:20 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46700000000000003,"15min":0.48199999999999998},"min":{"1min":0.371,"5min":0.31,"15min":0.31},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.98299999999999998},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.47899999999999998,"15min":0.48699999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.59199999999999997,"5min":0.629,"15min":0.91200000000000003},"last":0.47999999999999998}]},{"osd":3,"last update":"Fri Jul 14 11:19:20 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.48699999999999999,"15min":0.49299999999999999},"min":{"1min":0.34999999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.623,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.55700000000000005,"15min":0.57999999999999996},"min":{"1min":0.44500000000000001,"5min":0.41499999999999998,"15min":0.40799999999999997},"max":{"1min":0.72899999999999998,"5min":0.80000000000000004,"15min":1.034},"last":0.55100000000000005}]},{"osd":4,"last update":"Fri Jul 14 11:19:20 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.73499999999999999,"15min":0.76300000000000001},"min":{"1min":0.53900000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.036,"5min":1.171,"15min":1.212},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.749,"15min":0.77900000000000003},"min":{"1min":0.53800000000000003,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.56699999999999995}]},{"osd":5,"last update":"Fri Jul 14 11:19:20 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.74399999999999999,"15min":0.78200000000000003},"min":{"1min":0.53900000000000003,"5min":0.51700000000000002,"15min":0.43099999999999999},"max":{"1min":1.202,"5min":1.202,"15min":1.4019999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.75,"5min":0.76300000000000001,"15min":0.81100000000000005},"min":{"1min":0.55800000000000005,"5min":0.495,"15min":0.495},"max":{"1min":1.044,"5min":1.351,"15min":1.351},"last":0.63500000000000001}]},{"osd":6,"last update":"Fri Jul 14 11:19:20 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.753,"15min":0.78100000000000003},"min":{"1min":0.53100000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0089999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.76800000000000002,"15min":0.81299999999999994},"min":{"1min":0.60199999999999998,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.218,"5min":1.282,"15min":1.282},"last":0.60499999999999998}]},{"osd":7,"last update":"Fri Jul 14 11:19:20 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.754,"15min":0.79100000000000004},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.93400000000000005,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.621},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.754,"15min":0.79600000000000004},"min":{"1min":0.60899999999999999,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.96399999999999997,"5min":1.244,"15min":1.244},"last":0.58599999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574933,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28300,"kb_used_data":1348,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343540,"statfs":{"total":96636764160,"available":96607784960,"internally_reserved":0,"allocated":1380352,"data_stored":658820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.41099999999999998,"15min":0.442},"min":{"1min":0.24299999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.55900000000000005,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.44500000000000001,"15min":0.44800000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.621,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.41499999999999998}]},{"osd":1,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.44,"15min":0.44900000000000001},"min":{"1min":0.29499999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.52000000000000002,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.47199999999999998,"15min":0.49099999999999999},"min":{"1min":0.317,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.60899999999999999,"5min":0.72699999999999998,"15min":0.86399999999999999},"last":0.53600000000000003}]},{"osd":2,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.53400000000000003,"15min":0.54000000000000004},"min":{"1min":0.39600000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.64900000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56200000000000006,"15min":0.58999999999999997},"min":{"1min":0.44,"5min":0.37,"15min":0.37},"max":{"1min":0.76100000000000001,"5min":0.79600000000000004,"15min":1.585},"last":0.60799999999999998}]},{"osd":4,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.73299999999999998,"15min":0.754},"min":{"1min":0.45400000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.96399999999999997,"5min":1.1279999999999999,"15min":1.216},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.76700000000000002,"15min":0.75700000000000001},"min":{"1min":0.48599999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.65100000000000002}]},{"osd":5,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.747,"15min":0.75700000000000001},"min":{"1min":0.48499999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.089,"5min":1.179,"15min":1.413},"last":0.626},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.76700000000000002,"15min":0.83499999999999996},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.94999999999999996,"5min":1.1619999999999999,"15min":1.657},"last":0.66600000000000004}]},{"osd":6,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77700000000000002,"15min":0.78300000000000003},"min":{"1min":0.56699999999999995,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.726},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.76800000000000002,"15min":0.79400000000000004},"min":{"1min":0.57099999999999995,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.143,"5min":1.286,"15min":1.333},"last":0.73799999999999999}]},{"osd":7,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.79700000000000004,"15min":0.83099999999999996},"min":{"1min":0.53800000000000003,"5min":0.437,"15min":0.437},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.3939999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.80800000000000005,"15min":0.83399999999999996},"min":{"1min":0.60299999999999998,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.67500000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574934,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28268,"kb_used_data":1316,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343572,"statfs":{"total":96636764160,"available":96607817728,"internally_reserved":0,"allocated":1347584,"data_stored":624309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:19:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.64900000000000002,"15min":0.63500000000000001},"min":{"1min":0.437,"5min":0.311,"15min":0.311},"max":{"1min":0.89600000000000002,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.65200000000000002,"15min":0.68400000000000005},"min":{"1min":0.47699999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85199999999999998,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.70999999999999996}]},{"osd":1,"last update":"Fri Jul 14 11:19:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.65200000000000002,"15min":0.66600000000000004},"min":{"1min":0.51700000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.83599999999999997,"5min":0.92000000000000004,"15min":1.4259999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70299999999999996,"15min":0.70999999999999996},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.45800000000000002},"max":{"1min":0.95799999999999996,"5min":1.0149999999999999,"15min":1.1659999999999999},"last":0.59899999999999998}]},{"osd":2,"last update":"Fri Jul 14 11:19:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.69999999999999996,"15min":0.70699999999999996},"min":{"1min":0.501,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.88200000000000001,"5min":1.0209999999999999,"15min":1.48},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71999999999999997,"15min":0.73599999999999999},"min":{"1min":0.54800000000000004,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.91800000000000004,"5min":1.1080000000000001,"15min":1.23},"last":0.68300000000000005}]},{"osd":3,"last update":"Fri Jul 14 11:19:15 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.67800000000000005,"15min":0.70799999999999996},"min":{"1min":0.51300000000000001,"5min":0.438,"15min":0.438},"max":{"1min":0.95599999999999996,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.72999999999999998,"15min":0.73599999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.90700000000000003,"5min":1.1259999999999999,"15min":1.145},"last":0.77900000000000003}]},{"osd":5,"last update":"Fri Jul 14 11:19:15 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.66600000000000004,"15min":0.74299999999999999},"min":{"1min":0.47399999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.81799999999999995,"5min":0.95999999999999996,"15min":1.6559999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.65700000000000003,"15min":0.745},"min":{"1min":0.41999999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.90500000000000003,"5min":0.96999999999999997,"15min":1.3839999999999999},"last":0.496}]},{"osd":6,"last update":"Fri Jul 14 11:19:15 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.68500000000000005,"15min":0.71299999999999997},"min":{"1min":0.45200000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.86799999999999999,"5min":1.1659999999999999,"15min":1.1970000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.73699999999999999,"15min":0.76600000000000001},"min":{"1min":0.56899999999999995,"5min":0.442,"15min":0.442},"max":{"1min":0.878,"5min":1.1479999999999999,"15min":1.3},"last":0.79800000000000004}]},{"osd":7,"last update":"Fri Jul 14 11:19:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.70499999999999996,"15min":0.755},"min":{"1min":0.47899999999999998,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.88,"5min":1.028,"15min":1.4810000000000001},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.755,"15min":0.82599999999999996},"min":{"1min":0.59099999999999997,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.82499999999999996,"5min":1.21,"15min":1.379},"last":0.622}]}]},{"osd":5,"up_from":13,"seq":55834574936,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28284,"kb_used_data":1332,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343556,"statfs":{"total":96636764160,"available":96607801344,"internally_reserved":0,"allocated":1363968,"data_stored":630227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:19:05 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.61899999999999999,"15min":0.63600000000000001},"min":{"1min":0.371,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.84199999999999997,"5min":0.996,"15min":1.3140000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65200000000000002,"15min":0.64000000000000001},"min":{"1min":0.42399999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":1.0980000000000001},"last":0.66000000000000003}]},{"osd":1,"last update":"Fri Jul 14 11:19:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.624,"15min":0.66400000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.75600000000000001,"5min":0.88800000000000001,"15min":1.343},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.65100000000000002,"15min":0.64800000000000002},"min":{"1min":0.442,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.86599999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.85799999999999998}]},{"osd":2,"last update":"Fri Jul 14 11:19:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.69899999999999995,"15min":0.72899999999999998},"min":{"1min":0.46700000000000003,"5min":0.436,"15min":0.436},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.70299999999999996,"15min":0.753},"min":{"1min":0.504,"5min":0.496,"15min":0.496},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":1.3939999999999999},"last":0.83299999999999996}]},{"osd":3,"last update":"Fri Jul 14 11:19:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71199999999999997,"15min":0.75600000000000001},"min":{"1min":0.54500000000000004,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":1.2130000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.67700000000000005,"15min":0.75700000000000001},"min":{"1min":0.46400000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":1.806},"last":0.91800000000000004}]},{"osd":4,"last update":"Fri Jul 14 11:19:05 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.61699999999999999,"15min":0.64600000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.878,"5min":1.0229999999999999,"15min":1.1319999999999999},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.66500000000000004,"15min":0.73699999999999999},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.3999999999999999},"last":0.98599999999999999}]},{"osd":6,"last update":"Fri Jul 14 11:19:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.69699999999999995,"15min":0.73999999999999999},"min":{"1min":0.502,"5min":0.435,"15min":0.435},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":1.0149999999999999},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.73499999999999999,"15min":0.79000000000000004},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.004,"5min":1.0629999999999999,"15min":1.3640000000000001},"last":1.155}]},{"osd":7,"last update":"Fri Jul 14 11:19:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.747,"15min":0.82999999999999996},"min":{"1min":0.54400000000000004,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.4970000000000001},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78500000000000003,"15min":0.85499999999999998},"min":{"1min":0.60399999999999998,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.8540000000000001},"last":0.96899999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T11:20:00.722 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T11:20:00.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.916+0000 7ffb959ff700 1 Processor -- start 2023-07-14T11:20:00.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.916+0000 7ffb959ff700 1 -- start start 2023-07-14T11:20:00.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.917+0000 7ffb959ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb90141ff0 0x7ffb90158fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:00.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.917+0000 7ffb959ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb9006c110 con 0x7ffb900b2180 2023-07-14T11:20:00.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.917+0000 7ffb959ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb90070e60 con 0x7ffb90070710 2023-07-14T11:20:00.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.917+0000 7ffb959ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb90071140 con 0x7ffb90141ff0 2023-07-14T11:20:00.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.917+0000 7ffb8f7fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7ffb900b2180 0x7ffb9006c5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49438/0 (socket says 172.21.15.84:49438) 2023-07-14T11:20:00.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.917+0000 7ffb8f7fe700 1 -- 172.21.15.84:0/1567666364 learned_addr learned my addr 172.21.15.84:0/1567666364 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:20:00.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.918+0000 7ffb8effd700 1 --2- 172.21.15.84:0/1567666364 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb90141ff0 0x7ffb90158fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:00.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.918+0000 7ffb8dffb700 1 -- 172.21.15.84:0/1567666364 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1651571380 0 0) 0x7ffb9006c110 con 0x7ffb900b2180 2023-07-14T11:20:00.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.918+0000 7ffb8dffb700 1 -- 172.21.15.84:0/1567666364 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb780057c0 con 0x7ffb900b2180 2023-07-14T11:20:00.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.918+0000 7ffb8effd700 1 -- 172.21.15.84:0/1567666364 >> v1:172.21.15.179:6789/0 conn(0x7ffb90070710 legacy=0x7ffb900b1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:00.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.918+0000 7ffb8effd700 1 -- 172.21.15.84:0/1567666364 >> v1:172.21.15.84:6789/0 conn(0x7ffb900b2180 legacy=0x7ffb9006c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:00.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.918+0000 7ffb8dffb700 1 -- 172.21.15.84:0/1567666364 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 203153149 0 0) 0x7ffb90070e60 con 0x7ffb90070710 2023-07-14T11:20:00.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.918+0000 7ffb8effd700 1 -- 172.21.15.84:0/1567666364 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb9006bac0 con 0x7ffb90141ff0 2023-07-14T11:20:00.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.918+0000 7ffb8effd700 1 --2- 172.21.15.84:0/1567666364 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb90141ff0 0x7ffb90158fd0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ffb80009870 tx=0x7ffb80009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b58fdb6318f8106 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:00.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.919+0000 7ffb8dffb700 1 -- 172.21.15.84:0/1567666364 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb80011830 con 0x7ffb90141ff0 2023-07-14T11:20:00.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.919+0000 7ffb8dffb700 1 -- 172.21.15.84:0/1567666364 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb80011990 con 0x7ffb90141ff0 2023-07-14T11:20:00.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.919+0000 7ffb8dffb700 1 -- 172.21.15.84:0/1567666364 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb80011d20 con 0x7ffb90141ff0 2023-07-14T11:20:00.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.919+0000 7ffb959ff700 1 -- 172.21.15.84:0/1567666364 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb90141ff0 msgr2=0x7ffb90158fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:00.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.919+0000 7ffb959ff700 1 --2- 172.21.15.84:0/1567666364 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb90141ff0 0x7ffb90158fd0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ffb80009870 tx=0x7ffb80009b80 comp rx=0 tx=0).stop 2023-07-14T11:20:00.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.919+0000 7ffb959ff700 1 -- 172.21.15.84:0/1567666364 shutdown_connections 2023-07-14T11:20:00.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.919+0000 7ffb959ff700 1 --2- 172.21.15.84:0/1567666364 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb90141ff0 0x7ffb90158fd0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:00.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.919+0000 7ffb959ff700 1 -- 172.21.15.84:0/1567666364 >> 172.21.15.84:0/1567666364 conn(0x7ffb90069f30 msgr2=0x7ffb9006a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:20:00.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.919+0000 7ffb959ff700 1 -- 172.21.15.84:0/1567666364 shutdown_connections 2023-07-14T11:20:00.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.919+0000 7ffb959ff700 1 -- 172.21.15.84:0/1567666364 wait complete. 2023-07-14T11:20:00.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.921+0000 7ffb959ff700 1 Processor -- start 2023-07-14T11:20:00.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.921+0000 7ffb959ff700 1 -- start start 2023-07-14T11:20:00.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.922+0000 7ffb959ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb90070710 0x7ffb9013bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:00.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.922+0000 7ffb959ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb900b2180 0x7ffb901f1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:00.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.922+0000 7ffb959ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb90141ff0 0x7ffb900b0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:00.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.922+0000 7ffb959ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb90138c70 con 0x7ffb90070710 2023-07-14T11:20:00.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.922+0000 7ffb959ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb901f2700 con 0x7ffb90141ff0 2023-07-14T11:20:00.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.922+0000 7ffb959ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb901f29e0 con 0x7ffb900b2180 2023-07-14T11:20:00.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.922+0000 7ffb8effd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb90070710 0x7ffb9013bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:00.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.922+0000 7ffb8effd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb90070710 0x7ffb9013bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60072/0 (socket says 172.21.15.84:60072) 2023-07-14T11:20:00.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.922+0000 7ffb8effd700 1 -- 172.21.15.84:0/3191293269 learned_addr learned my addr 172.21.15.84:0/3191293269 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:20:00.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.923+0000 7ffb8effd700 1 -- 172.21.15.84:0/3191293269 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb900b2180 msgr2=0x7ffb901f1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:00.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.923+0000 7ffb8effd700 1 --2- 172.21.15.84:0/3191293269 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb900b2180 0x7ffb901f1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:00.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.923+0000 7ffb8effd700 1 -- 172.21.15.84:0/3191293269 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb90141ff0 msgr2=0x7ffb900b0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:00.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.923+0000 7ffb8effd700 1 --2- 172.21.15.84:0/3191293269 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb90141ff0 0x7ffb900b0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:00.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.923+0000 7ffb8effd700 1 -- 172.21.15.84:0/3191293269 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb800094a0 con 0x7ffb90070710 2023-07-14T11:20:00.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.923+0000 7ffb8effd700 1 --2- 172.21.15.84:0/3191293269 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb90070710 0x7ffb9013bbc0 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7ffb800090b0 tx=0x7ffb80004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:00.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.923+0000 7ffb77fff700 1 -- 172.21.15.84:0/3191293269 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb8001a910 con 0x7ffb90070710 2023-07-14T11:20:00.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.923+0000 7ffb77fff700 1 -- 172.21.15.84:0/3191293269 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb8001aa70 con 0x7ffb90070710 2023-07-14T11:20:00.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.923+0000 7ffb77fff700 1 -- 172.21.15.84:0/3191293269 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb8001ae00 con 0x7ffb90070710 2023-07-14T11:20:00.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.923+0000 7ffb959ff700 1 -- 172.21.15.84:0/3191293269 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb901f2cc0 con 0x7ffb90070710 2023-07-14T11:20:00.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.923+0000 7ffb959ff700 1 -- 172.21.15.84:0/3191293269 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb901f2410 con 0x7ffb90070710 2023-07-14T11:20:00.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.924+0000 7ffb959ff700 1 -- 172.21.15.84:0/3191293269 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb901f2e80 con 0x7ffb90070710 2023-07-14T11:20:00.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.925+0000 7ffb77fff700 1 -- 172.21.15.84:0/3191293269 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) v1 ==== 89190+0+0 (secure 0 0 0) 0x7ffb80022070 con 0x7ffb90070710 2023-07-14T11:20:00.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.926+0000 7ffb77fff700 1 --2- 172.21.15.84:0/3191293269 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7ffb7c06ae90 0x7ffb7c06d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:00.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.926+0000 7ffb77fff700 1 -- 172.21.15.84:0/3191293269 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5296+0+0 (secure 0 0 0) 0x7ffb8008a2f0 con 0x7ffb90070710 2023-07-14T11:20:00.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.927+0000 7ffb8e7fc700 1 --2- 172.21.15.84:0/3191293269 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7ffb7c06ae90 0x7ffb7c06d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:00.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.927+0000 7ffb8e7fc700 1 --2- 172.21.15.84:0/3191293269 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7ffb7c06ae90 0x7ffb7c06d340 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ffb901efac0 tx=0x7ffb840079c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:00.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:00.930+0000 7ffb77fff700 1 -- 172.21.15.84:0/3191293269 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ffb80055430 con 0x7ffb90070710 2023-07-14T11:20:01.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.122+0000 7ffb959ff700 1 -- 172.21.15.84:0/3191293269 --> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ffb9006bda0 con 0x7ffb7c06ae90 2023-07-14T11:20:01.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.125+0000 7ffb77fff700 1 -- 172.21.15.84:0/3191293269 <== mgr.4100 v2:172.21.15.179:6836/2094253834 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72326 (secure 0 0 0) 0x7ffb84005080 con 0x7ffb7c06ae90 2023-07-14T11:20:01.128 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:20:01.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.127+0000 7ffb959ff700 1 -- 172.21.15.84:0/3191293269 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7ffb7c06ae90 msgr2=0x7ffb7c06d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:01.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.127+0000 7ffb959ff700 1 --2- 172.21.15.84:0/3191293269 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7ffb7c06ae90 0x7ffb7c06d340 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ffb901efac0 tx=0x7ffb840079c0 comp rx=0 tx=0).stop 2023-07-14T11:20:01.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.127+0000 7ffb959ff700 1 -- 172.21.15.84:0/3191293269 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb90070710 msgr2=0x7ffb9013bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:01.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.127+0000 7ffb959ff700 1 --2- 172.21.15.84:0/3191293269 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb90070710 0x7ffb9013bbc0 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7ffb800090b0 tx=0x7ffb80004750 comp rx=0 tx=0).stop 2023-07-14T11:20:01.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.127+0000 7ffb959ff700 1 -- 172.21.15.84:0/3191293269 shutdown_connections 2023-07-14T11:20:01.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.127+0000 7ffb959ff700 1 --2- 172.21.15.84:0/3191293269 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb90141ff0 0x7ffb900b0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:01.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.127+0000 7ffb959ff700 1 --2- 172.21.15.84:0/3191293269 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb90070710 0x7ffb9013bbc0 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:01.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.127+0000 7ffb959ff700 1 --2- 172.21.15.84:0/3191293269 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7ffb7c06ae90 0x7ffb7c06d340 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:01.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.127+0000 7ffb959ff700 1 --2- 172.21.15.84:0/3191293269 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb900b2180 0x7ffb901f1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:01.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.127+0000 7ffb959ff700 1 -- 172.21.15.84:0/3191293269 >> 172.21.15.84:0/3191293269 conn(0x7ffb90069f30 msgr2=0x7ffb9013ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:20:01.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.127+0000 7ffb959ff700 1 -- 172.21.15.84:0/3191293269 shutdown_connections 2023-07-14T11:20:01.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.127+0000 7ffb959ff700 1 -- 172.21.15.84:0/3191293269 wait complete. 2023-07-14T11:20:01.132 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-07-14T11:20:01.147 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":86,"stamp":"2023-07-14T11:20:00.946058+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":102,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":235580,"kb_used_data":11772,"kb_used_omap":0,"kb_used_meta":223744,"kb_avail":754739140,"statfs":{"total":773094113280,"available":772852879360,"internally_reserved":0,"allocated":12054528,"data_stored":6204942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":229113856},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-48209,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-22,"num_read_kb":-12,"num_write":-66,"num_write_kb":-72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.406630"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":174,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T11:19:58.072924+0000","last_change":"2023-07-14T11:13:08.762084+0000","last_active":"2023-07-14T11:19:58.072924+0000","last_peered":"2023-07-14T11:19:58.072924+0000","last_clean":"2023-07-14T11:19:58.072924+0000","last_became_active":"2023-07-14T11:13:08.761763+0000","last_became_peered":"2023-07-14T11:13:08.761763+0000","last_unstale":"2023-07-14T11:19:58.072924+0000","last_undegraded":"2023-07-14T11:19:58.072924+0000","last_fullsized":"2023-07-14T11:19:58.072924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:40:50.844385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":194,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T11:19:57.946665+0000","last_change":"2023-07-14T11:13:08.761726+0000","last_active":"2023-07-14T11:19:57.946665+0000","last_peered":"2023-07-14T11:19:57.946665+0000","last_clean":"2023-07-14T11:19:57.946665+0000","last_became_active":"2023-07-14T11:13:08.761365+0000","last_became_peered":"2023-07-14T11:13:08.761365+0000","last_unstale":"2023-07-14T11:19:57.946665+0000","last_undegraded":"2023-07-14T11:19:57.946665+0000","last_fullsized":"2023-07-14T11:19:57.946665+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:21:57.190044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":164,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T11:19:58.076903+0000","last_change":"2023-07-14T11:13:08.923899+0000","last_active":"2023-07-14T11:19:58.076903+0000","last_peered":"2023-07-14T11:19:58.076903+0000","last_clean":"2023-07-14T11:19:58.076903+0000","last_became_active":"2023-07-14T11:13:08.923513+0000","last_became_peered":"2023-07-14T11:13:08.923513+0000","last_unstale":"2023-07-14T11:19:58.076903+0000","last_undegraded":"2023-07-14T11:19:58.076903+0000","last_fullsized":"2023-07-14T11:19:58.076903+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:25:27.112633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":164,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T11:19:58.071740+0000","last_change":"2023-07-14T11:13:08.760609+0000","last_active":"2023-07-14T11:19:58.071740+0000","last_peered":"2023-07-14T11:19:58.071740+0000","last_clean":"2023-07-14T11:19:58.071740+0000","last_became_active":"2023-07-14T11:13:08.760285+0000","last_became_peered":"2023-07-14T11:13:08.760285+0000","last_unstale":"2023-07-14T11:19:58.071740+0000","last_undegraded":"2023-07-14T11:19:58.071740+0000","last_fullsized":"2023-07-14T11:19:58.071740+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:21:36.334067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"76'128","reported_seq":359,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T11:19:58.071909+0000","last_change":"2023-07-14T11:13:01.370649+0000","last_active":"2023-07-14T11:19:58.071909+0000","last_peered":"2023-07-14T11:19:58.071909+0000","last_clean":"2023-07-14T11:19:58.071909+0000","last_became_active":"2023-07-14T11:13:01.369478+0000","last_became_peered":"2023-07-14T11:13:01.369478+0000","last_unstale":"2023-07-14T11:19:58.071909+0000","last_undegraded":"2023-07-14T11:19:58.071909+0000","last_fullsized":"2023-07-14T11:19:58.071909+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:00.254800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:00.254800+0000","last_clean_scrub_stamp":"2023-07-14T11:13:00.254800+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:07:22.146964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":178,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T11:19:57.942399+0000","last_change":"2023-07-14T11:13:08.757882+0000","last_active":"2023-07-14T11:19:57.942399+0000","last_peered":"2023-07-14T11:19:57.942399+0000","last_clean":"2023-07-14T11:19:57.942399+0000","last_became_active":"2023-07-14T11:13:08.757541+0000","last_became_peered":"2023-07-14T11:13:08.757541+0000","last_unstale":"2023-07-14T11:19:57.942399+0000","last_undegraded":"2023-07-14T11:19:57.942399+0000","last_fullsized":"2023-07-14T11:19:57.942399+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:49:40.833577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":182,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T11:19:57.943174+0000","last_change":"2023-07-14T11:13:08.862331+0000","last_active":"2023-07-14T11:19:57.943174+0000","last_peered":"2023-07-14T11:19:57.943174+0000","last_clean":"2023-07-14T11:19:57.943174+0000","last_became_active":"2023-07-14T11:13:08.861817+0000","last_became_peered":"2023-07-14T11:13:08.861817+0000","last_unstale":"2023-07-14T11:19:57.943174+0000","last_undegraded":"2023-07-14T11:19:57.943174+0000","last_fullsized":"2023-07-14T11:19:57.943174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:30:21.109407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":178,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T11:19:57.941200+0000","last_change":"2023-07-14T11:13:08.758749+0000","last_active":"2023-07-14T11:19:57.941200+0000","last_peered":"2023-07-14T11:19:57.941200+0000","last_clean":"2023-07-14T11:19:57.941200+0000","last_became_active":"2023-07-14T11:13:08.757956+0000","last_became_peered":"2023-07-14T11:13:08.757956+0000","last_unstale":"2023-07-14T11:19:57.941200+0000","last_undegraded":"2023-07-14T11:19:57.941200+0000","last_fullsized":"2023-07-14T11:19:57.941200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:14:24.142374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":194,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T11:19:57.946723+0000","last_change":"2023-07-14T11:13:08.923786+0000","last_active":"2023-07-14T11:19:57.946723+0000","last_peered":"2023-07-14T11:19:57.946723+0000","last_clean":"2023-07-14T11:19:57.946723+0000","last_became_active":"2023-07-14T11:13:08.923384+0000","last_became_peered":"2023-07-14T11:13:08.923384+0000","last_unstale":"2023-07-14T11:19:57.946723+0000","last_undegraded":"2023-07-14T11:19:57.946723+0000","last_fullsized":"2023-07-14T11:19:57.946723+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:36:32.179796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574936,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32944,"kb_used_data":1896,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338896,"statfs":{"total":96636764160,"available":96603029504,"internally_reserved":0,"allocated":1941504,"data_stored":1214677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:19:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.66200000000000003,"15min":0.89400000000000002},"min":{"1min":0.55500000000000005,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":8.4339999999999993},"last":0.88},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.69199999999999995,"15min":0.92800000000000005},"min":{"1min":0.47599999999999998,"5min":0.45500000000000002,"15min":0.377},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":8.4559999999999995},"last":0.68000000000000005}]},{"osd":1,"last update":"Fri Jul 14 11:19:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.67200000000000004,"15min":0.871},"min":{"1min":0.52100000000000002,"5min":0.40400000000000003,"15min":0.34899999999999998},"max":{"1min":0.90400000000000003,"5min":0.92800000000000005,"15min":6.3520000000000003},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.66100000000000003,"15min":1.0089999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":6.8550000000000004},"last":0.55000000000000004}]},{"osd":2,"last update":"Fri Jul 14 11:19:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.67100000000000004,"15min":1.0569999999999999},"min":{"1min":0.499,"5min":0.434,"15min":0.434},"max":{"1min":0.83599999999999997,"5min":0.997,"15min":7.0289999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.70399999999999996,"15min":0.69299999999999995},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.86399999999999999,"5min":0.98199999999999998,"15min":1.0580000000000001},"last":0.73199999999999998}]},{"osd":3,"last update":"Fri Jul 14 11:19:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.68899999999999995,"15min":1.109},"min":{"1min":0.55200000000000005,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.91100000000000003,"5min":0.95699999999999996,"15min":10.337},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.72699999999999998,"15min":0.75800000000000001},"min":{"1min":0.53300000000000003,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.90100000000000002,"5min":1.024,"15min":1.921},"last":0.85199999999999998}]},{"osd":4,"last update":"Fri Jul 14 11:19:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.64700000000000002,"15min":0.59899999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.73599999999999999,"15min":0.70599999999999996},"min":{"1min":0.57299999999999995,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.90800000000000003,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.70399999999999996}]},{"osd":5,"last update":"Fri Jul 14 11:19:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.70099999999999996,"15min":0.67900000000000005},"min":{"1min":0.39700000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.92800000000000005,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.76400000000000001,"15min":0.73999999999999999},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.79800000000000004}]},{"osd":6,"last update":"Fri Jul 14 11:19:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.72899999999999998,"15min":0.68300000000000005},"min":{"1min":0.505,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.98799999999999999,"5min":1.002,"15min":1.002},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.73299999999999998,"15min":0.69399999999999995},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.48899999999999999},"max":{"1min":0.97399999999999998,"5min":1.129,"15min":1.129},"last":0.78000000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574937,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28272,"kb_used_data":1320,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343568,"statfs":{"total":96636764160,"available":96607813632,"internally_reserved":0,"allocated":1351680,"data_stored":624453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.69899999999999995,"15min":0.70299999999999996},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93799999999999994,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.73499999999999999,"15min":0.72099999999999997},"min":{"1min":0.51100000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.83899999999999997,"5min":1.167,"15min":1.167},"last":0.504}]},{"osd":1,"last update":"Fri Jul 14 11:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71899999999999997,"15min":0.69099999999999995},"min":{"1min":0.443,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.73099999999999998,"15min":0.71399999999999997},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39300000000000002},"max":{"1min":0.90400000000000003,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.72199999999999998}]},{"osd":2,"last update":"Fri Jul 14 11:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.69899999999999995,"15min":0.67900000000000005},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.41299999999999998},"max":{"1min":0.89000000000000001,"5min":1.45,"15min":1.45},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.755,"5min":0.754,"15min":0.77600000000000002},"min":{"1min":0.56399999999999995,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.075,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.58899999999999997}]},{"osd":3,"last update":"Fri Jul 14 11:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.73099999999999998,"15min":0.74299999999999999},"min":{"1min":0.50900000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.86499999999999999,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.73299999999999998,"15min":0.73899999999999999},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0469999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.76200000000000001}]},{"osd":4,"last update":"Fri Jul 14 11:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.69099999999999995,"15min":0.70699999999999996},"min":{"1min":0.53300000000000003,"5min":0.38,"15min":0.38},"max":{"1min":1.177,"5min":1.712,"15min":1.712},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.71999999999999997,"15min":0.72599999999999998},"min":{"1min":0.48199999999999998,"5min":0.438,"15min":0.42899999999999999},"max":{"1min":0.998,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.81000000000000005}]},{"osd":5,"last update":"Fri Jul 14 11:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.71199999999999997,"15min":0.71799999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.93500000000000005,"5min":2.8820000000000001,"15min":2.8820000000000001},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.77200000000000002,"15min":0.78800000000000003},"min":{"1min":0.58399999999999996,"5min":0.46100000000000002,"15min":0.44500000000000001},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.83099999999999996}]},{"osd":7,"last update":"Fri Jul 14 11:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.77500000000000002,"15min":0.79900000000000004},"min":{"1min":0.59899999999999998,"5min":0.47399999999999998,"15min":0.47099999999999997},"max":{"1min":0.95499999999999996,"5min":1.333,"15min":1.333},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.76300000000000001,"15min":0.78900000000000003},"min":{"1min":0.46899999999999997,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.1579999999999999,"5min":1.55,"15min":1.55},"last":0.95099999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574936,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32380,"kb_used_data":1332,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339460,"statfs":{"total":96636764160,"available":96603607040,"internally_reserved":0,"allocated":1363968,"data_stored":630227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.40500000000000003,"15min":0.432},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.54200000000000004,"5min":0.59099999999999997,"15min":0.996},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.432,"5min":0.45500000000000002,"15min":0.47599999999999998},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.57299999999999995,"5min":0.81599999999999995,"15min":0.84299999999999997},"last":0.33800000000000002}]},{"osd":2,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.48099999999999998,"15min":0.54900000000000004},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.60299999999999998,"5min":0.70799999999999996,"15min":2.476},"last":0.504},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.48899999999999999,"15min":0.59499999999999997},"min":{"1min":0.36899999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.64700000000000002,"5min":0.91700000000000004,"15min":2.6299999999999999},"last":0.44900000000000001}]},{"osd":3,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.52800000000000002,"15min":0.52200000000000002},"min":{"1min":0.40899999999999997,"5min":0.39300000000000002,"15min":0.38900000000000001},"max":{"1min":0.72599999999999998,"5min":0.748,"15min":0.748},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46500000000000002,"15min":0.48799999999999999},"min":{"1min":0.33600000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.59499999999999997,"5min":0.67700000000000005,"15min":0.73199999999999998},"last":0.41699999999999998}]},{"osd":4,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.73699999999999999,"15min":0.749},"min":{"1min":0.52400000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.363},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.751,"5min":0.754,"15min":0.76900000000000002},"min":{"1min":0.57099999999999995,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.93999999999999995,"5min":1.1160000000000001,"15min":1.4890000000000001},"last":0.65200000000000002}]},{"osd":5,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.749,"15min":0.76500000000000001},"min":{"1min":0.54200000000000004,"5min":0.499,"15min":0.499},"max":{"1min":1.0589999999999999,"5min":1.2250000000000001,"15min":1.3759999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76200000000000001,"15min":0.80800000000000005},"min":{"1min":0.59099999999999997,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.4330000000000001},"last":0.79200000000000004}]},{"osd":6,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.745,"15min":0.78800000000000003},"min":{"1min":0.55900000000000005,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.028,"5min":1.141,"15min":1.298},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.753,"15min":0.77900000000000003},"min":{"1min":0.60199999999999998,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.97199999999999998,"5min":1.1899999999999999,"15min":1.2130000000000001},"last":0.84199999999999997}]},{"osd":7,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.75900000000000001,"15min":0.80700000000000005},"min":{"1min":0.58299999999999996,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0780000000000001,"5min":1.2010000000000001,"15min":1.4590000000000001},"last":0.872},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.75,"15min":0.77900000000000003},"min":{"1min":0.56299999999999994,"5min":0.55000000000000004,"15min":0.54200000000000004},"max":{"1min":1.129,"5min":1.129,"15min":1.3700000000000001},"last":0.61099999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574934,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28864,"kb_used_data":1912,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94342976,"statfs":{"total":96636764160,"available":96607207424,"internally_reserved":0,"allocated":1957888,"data_stored":1220595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 11:19:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.47699999999999998,"15min":0.44700000000000001},"min":{"1min":0.26800000000000002,"5min":0.252,"15min":0.252},"max":{"1min":2.972,"5min":2.972,"15min":2.972},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.47599999999999998,"15min":0.45200000000000001},"min":{"1min":0.33300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":2.758,"5min":2.758,"15min":2.758},"last":0.40999999999999998}]},{"osd":2,"last update":"Fri Jul 14 11:19:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.499,"15min":0.47299999999999998},"min":{"1min":0.35599999999999998,"5min":0.307,"15min":0.307},"max":{"1min":2.9409999999999998,"5min":2.9409999999999998,"15min":2.9409999999999998},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.51900000000000002,"15min":0.50900000000000001},"min":{"1min":0.376,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":2.556,"5min":2.556,"15min":2.556},"last":0.47299999999999998}]},{"osd":3,"last update":"Fri Jul 14 11:19:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.48199999999999998,"15min":0.438},"min":{"1min":0.33700000000000002,"5min":0.32000000000000001,"15min":0.309},"max":{"1min":2.6019999999999999,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.55600000000000005,"15min":0.53500000000000003},"min":{"1min":0.44900000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":2.9990000000000001,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":0.433}]},{"osd":4,"last update":"Fri Jul 14 11:19:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.73699999999999999,"15min":0.75700000000000001},"min":{"1min":0.51200000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0229999999999999,"5min":1.099,"15min":1.1060000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.76400000000000001,"15min":0.71799999999999997},"min":{"1min":0.57499999999999996,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.651,"5min":1.651,"15min":1.651},"last":0.58299999999999996}]},{"osd":5,"last update":"Fri Jul 14 11:19:12 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.77200000000000002,"15min":0.73799999999999999},"min":{"1min":0.51900000000000002,"5min":0.502,"15min":0.47999999999999998},"max":{"1min":2.9089999999999998,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.76500000000000001,"15min":0.77600000000000002},"min":{"1min":0.53200000000000003,"5min":0.505,"15min":0.505},"max":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.60399999999999998}]},{"osd":6,"last update":"Fri Jul 14 11:19:12 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.745,"15min":0.72799999999999998},"min":{"1min":0.499,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.78700000000000003,"15min":0.78300000000000003},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":2.8679999999999999,"5min":2.8679999999999999,"15min":2.8679999999999999},"last":0.63300000000000001}]},{"osd":7,"last update":"Fri Jul 14 11:19:12 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.77700000000000002,"15min":0.80900000000000005},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.97599999999999998,"5min":1.0900000000000001,"15min":1.149},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.81899999999999995,"15min":0.78900000000000003},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.7410000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":0.61799999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574934,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28284,"kb_used_data":1332,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343556,"statfs":{"total":96636764160,"available":96607801344,"internally_reserved":0,"allocated":1363968,"data_stored":630227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:19:20 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.40899999999999997,"15min":0.441},"min":{"1min":0.27100000000000002,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.623,"5min":0.63900000000000001,"15min":0.64700000000000002},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.438,"15min":0.44400000000000001},"min":{"1min":0.32100000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.63700000000000001,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.44500000000000001}]},{"osd":1,"last update":"Fri Jul 14 11:19:20 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46700000000000003,"15min":0.48199999999999998},"min":{"1min":0.371,"5min":0.31,"15min":0.31},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.98299999999999998},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.47899999999999998,"15min":0.48699999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.59199999999999997,"5min":0.629,"15min":0.91200000000000003},"last":0.47999999999999998}]},{"osd":3,"last update":"Fri Jul 14 11:19:20 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.48699999999999999,"15min":0.49299999999999999},"min":{"1min":0.34999999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.623,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.55700000000000005,"15min":0.57999999999999996},"min":{"1min":0.44500000000000001,"5min":0.41499999999999998,"15min":0.40799999999999997},"max":{"1min":0.72899999999999998,"5min":0.80000000000000004,"15min":1.034},"last":0.55100000000000005}]},{"osd":4,"last update":"Fri Jul 14 11:19:20 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.73499999999999999,"15min":0.76300000000000001},"min":{"1min":0.53900000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.036,"5min":1.171,"15min":1.212},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.749,"15min":0.77900000000000003},"min":{"1min":0.53800000000000003,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.56699999999999995}]},{"osd":5,"last update":"Fri Jul 14 11:19:20 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.74399999999999999,"15min":0.78200000000000003},"min":{"1min":0.53900000000000003,"5min":0.51700000000000002,"15min":0.43099999999999999},"max":{"1min":1.202,"5min":1.202,"15min":1.4019999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.75,"5min":0.76300000000000001,"15min":0.81100000000000005},"min":{"1min":0.55800000000000005,"5min":0.495,"15min":0.495},"max":{"1min":1.044,"5min":1.351,"15min":1.351},"last":0.63500000000000001}]},{"osd":6,"last update":"Fri Jul 14 11:19:20 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.753,"15min":0.78100000000000003},"min":{"1min":0.53100000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0089999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.76800000000000002,"15min":0.81299999999999994},"min":{"1min":0.60199999999999998,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.218,"5min":1.282,"15min":1.282},"last":0.60499999999999998}]},{"osd":7,"last update":"Fri Jul 14 11:19:20 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.754,"15min":0.79100000000000004},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.93400000000000005,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.621},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.754,"15min":0.79600000000000004},"min":{"1min":0.60899999999999999,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.96399999999999997,"5min":1.244,"15min":1.244},"last":0.58599999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574934,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28284,"kb_used_data":1332,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343556,"statfs":{"total":96636764160,"available":96607801344,"internally_reserved":0,"allocated":1363968,"data_stored":630227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.41099999999999998,"15min":0.442},"min":{"1min":0.24299999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.55900000000000005,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.44500000000000001,"15min":0.44800000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.621,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.371}]},{"osd":1,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.44,"15min":0.44900000000000001},"min":{"1min":0.29499999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.52000000000000002,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.47199999999999998,"15min":0.49099999999999999},"min":{"1min":0.317,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.60899999999999999,"5min":0.72699999999999998,"15min":0.86399999999999999},"last":0.39400000000000002}]},{"osd":2,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.53400000000000003,"15min":0.54000000000000004},"min":{"1min":0.39600000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.64900000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56200000000000006,"15min":0.58999999999999997},"min":{"1min":0.44,"5min":0.37,"15min":0.37},"max":{"1min":0.76100000000000001,"5min":0.79600000000000004,"15min":1.585},"last":0.441}]},{"osd":4,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.73299999999999998,"15min":0.754},"min":{"1min":0.45400000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.96399999999999997,"5min":1.1279999999999999,"15min":1.216},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.76700000000000002,"15min":0.75700000000000001},"min":{"1min":0.48599999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.61499999999999999}]},{"osd":5,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.747,"15min":0.75700000000000001},"min":{"1min":0.48499999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.089,"5min":1.179,"15min":1.413},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.76700000000000002,"15min":0.83499999999999996},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.94999999999999996,"5min":1.1619999999999999,"15min":1.657},"last":0.624}]},{"osd":6,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77700000000000002,"15min":0.78300000000000003},"min":{"1min":0.56699999999999995,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.726},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.755,"5min":0.76800000000000002,"15min":0.79400000000000004},"min":{"1min":0.57099999999999995,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.143,"5min":1.286,"15min":1.333},"last":0.746}]},{"osd":7,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.79700000000000004,"15min":0.83099999999999996},"min":{"1min":0.53800000000000003,"5min":0.437,"15min":0.437},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.3939999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.80800000000000005,"15min":0.83399999999999996},"min":{"1min":0.60299999999999998,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.66500000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574934,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28268,"kb_used_data":1316,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343572,"statfs":{"total":96636764160,"available":96607817728,"internally_reserved":0,"allocated":1347584,"data_stored":624309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:19:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.64900000000000002,"15min":0.63500000000000001},"min":{"1min":0.437,"5min":0.311,"15min":0.311},"max":{"1min":0.89600000000000002,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.65200000000000002,"15min":0.68400000000000005},"min":{"1min":0.47699999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85199999999999998,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.70999999999999996}]},{"osd":1,"last update":"Fri Jul 14 11:19:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.65200000000000002,"15min":0.66600000000000004},"min":{"1min":0.51700000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.83599999999999997,"5min":0.92000000000000004,"15min":1.4259999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70299999999999996,"15min":0.70999999999999996},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.45800000000000002},"max":{"1min":0.95799999999999996,"5min":1.0149999999999999,"15min":1.1659999999999999},"last":0.59899999999999998}]},{"osd":2,"last update":"Fri Jul 14 11:19:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.69999999999999996,"15min":0.70699999999999996},"min":{"1min":0.501,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.88200000000000001,"5min":1.0209999999999999,"15min":1.48},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71999999999999997,"15min":0.73599999999999999},"min":{"1min":0.54800000000000004,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.91800000000000004,"5min":1.1080000000000001,"15min":1.23},"last":0.68300000000000005}]},{"osd":3,"last update":"Fri Jul 14 11:19:15 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.67800000000000005,"15min":0.70799999999999996},"min":{"1min":0.51300000000000001,"5min":0.438,"15min":0.438},"max":{"1min":0.95599999999999996,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.72999999999999998,"15min":0.73599999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.90700000000000003,"5min":1.1259999999999999,"15min":1.145},"last":0.77900000000000003}]},{"osd":5,"last update":"Fri Jul 14 11:19:15 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.66600000000000004,"15min":0.74299999999999999},"min":{"1min":0.47399999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.81799999999999995,"5min":0.95999999999999996,"15min":1.6559999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.65700000000000003,"15min":0.745},"min":{"1min":0.41999999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.90500000000000003,"5min":0.96999999999999997,"15min":1.3839999999999999},"last":0.496}]},{"osd":6,"last update":"Fri Jul 14 11:19:15 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.68500000000000005,"15min":0.71299999999999997},"min":{"1min":0.45200000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.86799999999999999,"5min":1.1659999999999999,"15min":1.1970000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.73699999999999999,"15min":0.76600000000000001},"min":{"1min":0.56899999999999995,"5min":0.442,"15min":0.442},"max":{"1min":0.878,"5min":1.1479999999999999,"15min":1.3},"last":0.79800000000000004}]},{"osd":7,"last update":"Fri Jul 14 11:19:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.70499999999999996,"15min":0.755},"min":{"1min":0.47899999999999998,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.88,"5min":1.028,"15min":1.4810000000000001},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.755,"15min":0.82599999999999996},"min":{"1min":0.59099999999999997,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.82499999999999996,"5min":1.21,"15min":1.379},"last":0.622}]}]},{"osd":5,"up_from":13,"seq":55834574936,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28284,"kb_used_data":1332,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343556,"statfs":{"total":96636764160,"available":96607801344,"internally_reserved":0,"allocated":1363968,"data_stored":630227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:19:05 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.61899999999999999,"15min":0.63600000000000001},"min":{"1min":0.371,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.84199999999999997,"5min":0.996,"15min":1.3140000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65200000000000002,"15min":0.64000000000000001},"min":{"1min":0.42399999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":1.0980000000000001},"last":0.66000000000000003}]},{"osd":1,"last update":"Fri Jul 14 11:19:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.624,"15min":0.66400000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.75600000000000001,"5min":0.88800000000000001,"15min":1.343},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.65100000000000002,"15min":0.64800000000000002},"min":{"1min":0.442,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.86599999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.85799999999999998}]},{"osd":2,"last update":"Fri Jul 14 11:19:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.69899999999999995,"15min":0.72899999999999998},"min":{"1min":0.46700000000000003,"5min":0.436,"15min":0.436},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.70299999999999996,"15min":0.753},"min":{"1min":0.504,"5min":0.496,"15min":0.496},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":1.3939999999999999},"last":0.83299999999999996}]},{"osd":3,"last update":"Fri Jul 14 11:19:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71199999999999997,"15min":0.75600000000000001},"min":{"1min":0.54500000000000004,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":1.2130000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.67700000000000005,"15min":0.75700000000000001},"min":{"1min":0.46400000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":1.806},"last":0.91800000000000004}]},{"osd":4,"last update":"Fri Jul 14 11:19:05 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.61699999999999999,"15min":0.64600000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.878,"5min":1.0229999999999999,"15min":1.1319999999999999},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.66500000000000004,"15min":0.73699999999999999},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.3999999999999999},"last":0.98599999999999999}]},{"osd":6,"last update":"Fri Jul 14 11:19:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.69699999999999995,"15min":0.73999999999999999},"min":{"1min":0.502,"5min":0.435,"15min":0.435},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":1.0149999999999999},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.73499999999999999,"15min":0.79000000000000004},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.004,"5min":1.0629999999999999,"15min":1.3640000000000001},"last":1.155}]},{"osd":7,"last update":"Fri Jul 14 11:19:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.747,"15min":0.82999999999999996},"min":{"1min":0.54400000000000004,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.4970000000000001},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78500000000000003,"15min":0.85499999999999998},"min":{"1min":0.60399999999999998,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.8540000000000001},"last":0.96899999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T11:20:01.150 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-07-14T11:20:01.150 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T11:20:01.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.342+0000 7f4225fff700 1 Processor -- start 2023-07-14T11:20:01.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.342+0000 7f4225fff700 1 -- start start 2023-07-14T11:20:01.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.344+0000 7f4225fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42201597c0 0x7f4220159c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:01.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.344+0000 7f4225fff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42200cdf90 con 0x7f42201500d0 2023-07-14T11:20:01.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.344+0000 7f4225fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f422015a2f0 con 0x7f42200cea50 2023-07-14T11:20:01.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.344+0000 7f4225fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f422015a5d0 con 0x7f42201597c0 2023-07-14T11:20:01.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.344+0000 7f421f7fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f42201500d0 0x7f4220070350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49446/0 (socket says 172.21.15.84:49446) 2023-07-14T11:20:01.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.344+0000 7f421f7fe700 1 -- 172.21.15.84:0/388560162 learned_addr learned my addr 172.21.15.84:0/388560162 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:20:01.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.344+0000 7f4217fff700 1 --2- 172.21.15.84:0/388560162 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42201597c0 0x7f4220159c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:01.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.344+0000 7f421effd700 1 -- 172.21.15.84:0/388560162 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 529602003 0 0) 0x7f42200cdf90 con 0x7f42201500d0 2023-07-14T11:20:01.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.344+0000 7f421effd700 1 -- 172.21.15.84:0/388560162 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f420c0035b0 con 0x7f42201500d0 2023-07-14T11:20:01.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.345+0000 7f421effd700 1 -- 172.21.15.84:0/388560162 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4073892927 0 0) 0x7f422015a2f0 con 0x7f42200cea50 2023-07-14T11:20:01.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.345+0000 7f421effd700 1 -- 172.21.15.84:0/388560162 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42200cdf90 con 0x7f42200cea50 2023-07-14T11:20:01.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.345+0000 7f421effd700 1 -- 172.21.15.84:0/388560162 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 80175459 0 0) 0x7f420c0035b0 con 0x7f42201500d0 2023-07-14T11:20:01.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.345+0000 7f421effd700 1 -- 172.21.15.84:0/388560162 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42201597c0 msgr2=0x7f4220159c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:20:01.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.345+0000 7f421effd700 1 --2- 172.21.15.84:0/388560162 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42201597c0 0x7f4220159c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:01.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.345+0000 7f421effd700 1 -- 172.21.15.84:0/388560162 >> v1:172.21.15.179:6789/0 conn(0x7f42200cea50 legacy=0x7f42200b2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:01.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.345+0000 7f421effd700 1 -- 172.21.15.84:0/388560162 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42200ce250 con 0x7f42201500d0 2023-07-14T11:20:01.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.345+0000 7f421effd700 1 -- 172.21.15.84:0/388560162 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7f4210001670 con 0x7f42201500d0 2023-07-14T11:20:01.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.345+0000 7f421effd700 1 -- 172.21.15.84:0/388560162 >> v1:172.21.15.84:6789/0 conn(0x7f42201500d0 legacy=0x7f4220070350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:01.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.345+0000 7f421effd700 1 --2- 172.21.15.84:0/388560162 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42201597c0 0x7f420c003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:01.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.345+0000 7f421effd700 1 --2- 172.21.15.84:0/388560162 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f420c004120 0x7f420c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:01.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.345+0000 7f421effd700 1 --2- 172.21.15.84:0/388560162 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f420c004d90 0x7f420c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:01.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.345+0000 7f421effd700 1 -- 172.21.15.84:0/388560162 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f422015a5d0 con 0x7f420c004d90 2023-07-14T11:20:01.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.345+0000 7f421effd700 1 -- 172.21.15.84:0/388560162 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f420c00bac0 con 0x7f420c004120 2023-07-14T11:20:01.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.345+0000 7f421effd700 1 -- 172.21.15.84:0/388560162 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f420c00de90 con 0x7f42201597c0 2023-07-14T11:20:01.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.345+0000 7f421ffff700 1 --2- 172.21.15.84:0/388560162 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f420c004d90 0x7f420c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:01.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.345+0000 7f4217fff700 1 --2- 172.21.15.84:0/388560162 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f420c004120 0x7f420c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:01.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.345+0000 7f421f7fe700 1 --2- 172.21.15.84:0/388560162 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42201597c0 0x7f420c003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:01.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.345+0000 7f421ffff700 1 -- 172.21.15.84:0/388560162 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42201597c0 msgr2=0x7f420c003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:20:01.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.345+0000 7f421ffff700 1 --2- 172.21.15.84:0/388560162 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42201597c0 0x7f420c003bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:01.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.345+0000 7f421ffff700 1 -- 172.21.15.84:0/388560162 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f420c004120 msgr2=0x7f420c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:20:01.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.345+0000 7f421ffff700 1 --2- 172.21.15.84:0/388560162 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f420c004120 0x7f420c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:01.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.346+0000 7f421ffff700 1 -- 172.21.15.84:0/388560162 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f420c0035b0 con 0x7f420c004d90 2023-07-14T11:20:01.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.346+0000 7f421ffff700 1 --2- 172.21.15.84:0/388560162 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f420c004d90 0x7f420c005200 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f4218002230 tx=0x7f420c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a3c8547cdb42471 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:01.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.346+0000 7f421effd700 1 -- 172.21.15.84:0/388560162 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4218001f30 con 0x7f420c004d90 2023-07-14T11:20:01.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.346+0000 7f421effd700 1 -- 172.21.15.84:0/388560162 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f421800ce80 con 0x7f420c004d90 2023-07-14T11:20:01.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.346+0000 7f421effd700 1 -- 172.21.15.84:0/388560162 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4218003c40 con 0x7f420c004d90 2023-07-14T11:20:01.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.346+0000 7f4225fff700 1 -- 172.21.15.84:0/388560162 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f420c004d90 msgr2=0x7f420c005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:01.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.346+0000 7f4225fff700 1 --2- 172.21.15.84:0/388560162 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f420c004d90 0x7f420c005200 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f4218002230 tx=0x7f420c005880 comp rx=0 tx=0).stop 2023-07-14T11:20:01.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.346+0000 7f421ffff700 1 -- 172.21.15.84:0/388560162 reap_dead start 2023-07-14T11:20:01.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.346+0000 7f4225fff700 1 -- 172.21.15.84:0/388560162 shutdown_connections 2023-07-14T11:20:01.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.346+0000 7f4225fff700 1 -- 172.21.15.84:0/388560162 >> 172.21.15.84:0/388560162 conn(0x7f4220069f30 msgr2=0x7f422006a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:20:01.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.347+0000 7f4225fff700 1 -- 172.21.15.84:0/388560162 shutdown_connections 2023-07-14T11:20:01.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.347+0000 7f4225fff700 1 -- 172.21.15.84:0/388560162 wait complete. 2023-07-14T11:20:01.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.349+0000 7f4225fff700 1 Processor -- start 2023-07-14T11:20:01.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.349+0000 7f4225fff700 1 -- start start 2023-07-14T11:20:01.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.350+0000 7f4225fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f420c004d90 0x7f4220158600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:01.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.350+0000 7f4225fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f422014bc30 0x7f422014c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:01.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.350+0000 7f4225fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4220135d30 0x7f42201361a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:01.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.350+0000 7f4225fff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42201377a0 con 0x7f422014bc30 2023-07-14T11:20:01.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.350+0000 7f4225fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42201366e0 con 0x7f4220135d30 2023-07-14T11:20:01.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.350+0000 7f4225fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4220137170 con 0x7f420c004d90 2023-07-14T11:20:01.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.351+0000 7f4217fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f422014bc30 0x7f422014c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:01.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.351+0000 7f4217fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f422014bc30 0x7f422014c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60092/0 (socket says 172.21.15.84:60092) 2023-07-14T11:20:01.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.351+0000 7f4217fff700 1 -- 172.21.15.84:0/3757006671 learned_addr learned my addr 172.21.15.84:0/3757006671 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:20:01.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.351+0000 7f421f7fe700 1 --2- 172.21.15.84:0/3757006671 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f420c004d90 0x7f4220158600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:01.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.351+0000 7f421ffff700 1 --2- 172.21.15.84:0/3757006671 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4220135d30 0x7f42201361a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:01.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.351+0000 7f4217fff700 1 -- 172.21.15.84:0/3757006671 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f420c004d90 msgr2=0x7f4220158600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:01.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.351+0000 7f4217fff700 1 --2- 172.21.15.84:0/3757006671 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f420c004d90 0x7f4220158600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:01.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.351+0000 7f4217fff700 1 -- 172.21.15.84:0/3757006671 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4220135d30 msgr2=0x7f42201361a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:01.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.351+0000 7f4217fff700 1 --2- 172.21.15.84:0/3757006671 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4220135d30 0x7f42201361a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:01.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.351+0000 7f4217fff700 1 -- 172.21.15.84:0/3757006671 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f422014c7a0 con 0x7f422014bc30 2023-07-14T11:20:01.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.351+0000 7f421ffff700 1 --2- 172.21.15.84:0/3757006671 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4220135d30 0x7f42201361a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:20:01.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.351+0000 7f4217fff700 1 --2- 172.21.15.84:0/3757006671 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f422014bc30 0x7f422014c0a0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f4208011ad0 tx=0x7f4208011de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:01.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.352+0000 7f421cff9700 1 -- 172.21.15.84:0/3757006671 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420800f8e0 con 0x7f422014bc30 2023-07-14T11:20:01.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.352+0000 7f421cff9700 1 -- 172.21.15.84:0/3757006671 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f420800fa40 con 0x7f422014bc30 2023-07-14T11:20:01.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.352+0000 7f4225fff700 1 -- 172.21.15.84:0/3757006671 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f422014ca80 con 0x7f422014bc30 2023-07-14T11:20:01.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.352+0000 7f421cff9700 1 -- 172.21.15.84:0/3757006671 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420800fdf0 con 0x7f422014bc30 2023-07-14T11:20:01.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.352+0000 7f4225fff700 1 -- 172.21.15.84:0/3757006671 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4220139fe0 con 0x7f422014bc30 2023-07-14T11:20:01.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.353+0000 7f4225fff700 1 -- 172.21.15.84:0/3757006671 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42201378e0 con 0x7f422014bc30 2023-07-14T11:20:01.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.354+0000 7f421cff9700 1 -- 172.21.15.84:0/3757006671 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f4208014440 con 0x7f422014bc30 2023-07-14T11:20:01.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.354+0000 7f421cff9700 1 --2- 172.21.15.84:0/3757006671 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f420006ae90 0x7f420006d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:01.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.355+0000 7f421cff9700 1 -- 172.21.15.84:0/3757006671 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f4208089be0 con 0x7f422014bc30 2023-07-14T11:20:01.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.355+0000 7f421f7fe700 1 --2- 172.21.15.84:0/3757006671 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f420006ae90 0x7f420006d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:01.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.356+0000 7f421f7fe700 1 --2- 172.21.15.84:0/3757006671 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f420006ae90 0x7f420006d340 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4210001c20 tx=0x7f4210001e00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:01.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.358+0000 7f421cff9700 1 -- 172.21.15.84:0/3757006671 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f42201378e0 con 0x7f422014bc30 2023-07-14T11:20:01.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.548+0000 7f4225fff700 1 -- 172.21.15.84:0/3757006671 --> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f42200ce530 con 0x7f420006ae90 2023-07-14T11:20:01.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.552+0000 7f421cff9700 1 -- 172.21.15.84:0/3757006671 <== mgr.4100 v2:172.21.15.179:6836/2094253834 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72326 (secure 0 0 0) 0x7f4210007170 con 0x7f420006ae90 2023-07-14T11:20:01.555 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:20:01.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.554+0000 7f4225fff700 1 -- 172.21.15.84:0/3757006671 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f420006ae90 msgr2=0x7f420006d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:01.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.554+0000 7f4225fff700 1 --2- 172.21.15.84:0/3757006671 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f420006ae90 0x7f420006d340 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4210001c20 tx=0x7f4210001e00 comp rx=0 tx=0).stop 2023-07-14T11:20:01.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.554+0000 7f4225fff700 1 -- 172.21.15.84:0/3757006671 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f422014bc30 msgr2=0x7f422014c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:01.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.554+0000 7f4225fff700 1 --2- 172.21.15.84:0/3757006671 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f422014bc30 0x7f422014c0a0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f4208011ad0 tx=0x7f4208011de0 comp rx=0 tx=0).stop 2023-07-14T11:20:01.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.554+0000 7f4225fff700 1 -- 172.21.15.84:0/3757006671 shutdown_connections 2023-07-14T11:20:01.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.554+0000 7f4225fff700 1 --2- 172.21.15.84:0/3757006671 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f420006ae90 0x7f420006d340 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:01.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.554+0000 7f4225fff700 1 --2- 172.21.15.84:0/3757006671 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f420c004d90 0x7f4220158600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:01.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.554+0000 7f4225fff700 1 --2- 172.21.15.84:0/3757006671 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4220135d30 0x7f42201361a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:01.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.554+0000 7f4225fff700 1 --2- 172.21.15.84:0/3757006671 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f422014bc30 0x7f422014c0a0 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:01.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.554+0000 7f4225fff700 1 -- 172.21.15.84:0/3757006671 >> 172.21.15.84:0/3757006671 conn(0x7f4220069f30 msgr2=0x7f4220149550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:20:01.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.554+0000 7f4225fff700 1 -- 172.21.15.84:0/3757006671 shutdown_connections 2023-07-14T11:20:01.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.554+0000 7f4225fff700 1 -- 172.21.15.84:0/3757006671 wait complete. 2023-07-14T11:20:01.559 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-07-14T11:20:01.574 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":86,"stamp":"2023-07-14T11:20:00.946058+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":102,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":235580,"kb_used_data":11772,"kb_used_omap":0,"kb_used_meta":223744,"kb_avail":754739140,"statfs":{"total":773094113280,"available":772852879360,"internally_reserved":0,"allocated":12054528,"data_stored":6204942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":229113856},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-48209,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-22,"num_read_kb":-12,"num_write":-66,"num_write_kb":-72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.406630"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":174,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T11:19:58.072924+0000","last_change":"2023-07-14T11:13:08.762084+0000","last_active":"2023-07-14T11:19:58.072924+0000","last_peered":"2023-07-14T11:19:58.072924+0000","last_clean":"2023-07-14T11:19:58.072924+0000","last_became_active":"2023-07-14T11:13:08.761763+0000","last_became_peered":"2023-07-14T11:13:08.761763+0000","last_unstale":"2023-07-14T11:19:58.072924+0000","last_undegraded":"2023-07-14T11:19:58.072924+0000","last_fullsized":"2023-07-14T11:19:58.072924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:40:50.844385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":194,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T11:19:57.946665+0000","last_change":"2023-07-14T11:13:08.761726+0000","last_active":"2023-07-14T11:19:57.946665+0000","last_peered":"2023-07-14T11:19:57.946665+0000","last_clean":"2023-07-14T11:19:57.946665+0000","last_became_active":"2023-07-14T11:13:08.761365+0000","last_became_peered":"2023-07-14T11:13:08.761365+0000","last_unstale":"2023-07-14T11:19:57.946665+0000","last_undegraded":"2023-07-14T11:19:57.946665+0000","last_fullsized":"2023-07-14T11:19:57.946665+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:21:57.190044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":164,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T11:19:58.076903+0000","last_change":"2023-07-14T11:13:08.923899+0000","last_active":"2023-07-14T11:19:58.076903+0000","last_peered":"2023-07-14T11:19:58.076903+0000","last_clean":"2023-07-14T11:19:58.076903+0000","last_became_active":"2023-07-14T11:13:08.923513+0000","last_became_peered":"2023-07-14T11:13:08.923513+0000","last_unstale":"2023-07-14T11:19:58.076903+0000","last_undegraded":"2023-07-14T11:19:58.076903+0000","last_fullsized":"2023-07-14T11:19:58.076903+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:25:27.112633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":164,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T11:19:58.071740+0000","last_change":"2023-07-14T11:13:08.760609+0000","last_active":"2023-07-14T11:19:58.071740+0000","last_peered":"2023-07-14T11:19:58.071740+0000","last_clean":"2023-07-14T11:19:58.071740+0000","last_became_active":"2023-07-14T11:13:08.760285+0000","last_became_peered":"2023-07-14T11:13:08.760285+0000","last_unstale":"2023-07-14T11:19:58.071740+0000","last_undegraded":"2023-07-14T11:19:58.071740+0000","last_fullsized":"2023-07-14T11:19:58.071740+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:21:36.334067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"76'128","reported_seq":359,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T11:19:58.071909+0000","last_change":"2023-07-14T11:13:01.370649+0000","last_active":"2023-07-14T11:19:58.071909+0000","last_peered":"2023-07-14T11:19:58.071909+0000","last_clean":"2023-07-14T11:19:58.071909+0000","last_became_active":"2023-07-14T11:13:01.369478+0000","last_became_peered":"2023-07-14T11:13:01.369478+0000","last_unstale":"2023-07-14T11:19:58.071909+0000","last_undegraded":"2023-07-14T11:19:58.071909+0000","last_fullsized":"2023-07-14T11:19:58.071909+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:00.254800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:00.254800+0000","last_clean_scrub_stamp":"2023-07-14T11:13:00.254800+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:07:22.146964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":178,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T11:19:57.942399+0000","last_change":"2023-07-14T11:13:08.757882+0000","last_active":"2023-07-14T11:19:57.942399+0000","last_peered":"2023-07-14T11:19:57.942399+0000","last_clean":"2023-07-14T11:19:57.942399+0000","last_became_active":"2023-07-14T11:13:08.757541+0000","last_became_peered":"2023-07-14T11:13:08.757541+0000","last_unstale":"2023-07-14T11:19:57.942399+0000","last_undegraded":"2023-07-14T11:19:57.942399+0000","last_fullsized":"2023-07-14T11:19:57.942399+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:49:40.833577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":182,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T11:19:57.943174+0000","last_change":"2023-07-14T11:13:08.862331+0000","last_active":"2023-07-14T11:19:57.943174+0000","last_peered":"2023-07-14T11:19:57.943174+0000","last_clean":"2023-07-14T11:19:57.943174+0000","last_became_active":"2023-07-14T11:13:08.861817+0000","last_became_peered":"2023-07-14T11:13:08.861817+0000","last_unstale":"2023-07-14T11:19:57.943174+0000","last_undegraded":"2023-07-14T11:19:57.943174+0000","last_fullsized":"2023-07-14T11:19:57.943174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:30:21.109407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":178,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T11:19:57.941200+0000","last_change":"2023-07-14T11:13:08.758749+0000","last_active":"2023-07-14T11:19:57.941200+0000","last_peered":"2023-07-14T11:19:57.941200+0000","last_clean":"2023-07-14T11:19:57.941200+0000","last_became_active":"2023-07-14T11:13:08.757956+0000","last_became_peered":"2023-07-14T11:13:08.757956+0000","last_unstale":"2023-07-14T11:19:57.941200+0000","last_undegraded":"2023-07-14T11:19:57.941200+0000","last_fullsized":"2023-07-14T11:19:57.941200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:14:24.142374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":194,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T11:19:57.946723+0000","last_change":"2023-07-14T11:13:08.923786+0000","last_active":"2023-07-14T11:19:57.946723+0000","last_peered":"2023-07-14T11:19:57.946723+0000","last_clean":"2023-07-14T11:19:57.946723+0000","last_became_active":"2023-07-14T11:13:08.923384+0000","last_became_peered":"2023-07-14T11:13:08.923384+0000","last_unstale":"2023-07-14T11:19:57.946723+0000","last_undegraded":"2023-07-14T11:19:57.946723+0000","last_fullsized":"2023-07-14T11:19:57.946723+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:36:32.179796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574936,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32944,"kb_used_data":1896,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338896,"statfs":{"total":96636764160,"available":96603029504,"internally_reserved":0,"allocated":1941504,"data_stored":1214677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:19:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.66200000000000003,"15min":0.89400000000000002},"min":{"1min":0.55500000000000005,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":8.4339999999999993},"last":0.88},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.69199999999999995,"15min":0.92800000000000005},"min":{"1min":0.47599999999999998,"5min":0.45500000000000002,"15min":0.377},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":8.4559999999999995},"last":0.68000000000000005}]},{"osd":1,"last update":"Fri Jul 14 11:19:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.67200000000000004,"15min":0.871},"min":{"1min":0.52100000000000002,"5min":0.40400000000000003,"15min":0.34899999999999998},"max":{"1min":0.90400000000000003,"5min":0.92800000000000005,"15min":6.3520000000000003},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.66100000000000003,"15min":1.0089999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":6.8550000000000004},"last":0.55000000000000004}]},{"osd":2,"last update":"Fri Jul 14 11:19:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.67100000000000004,"15min":1.0569999999999999},"min":{"1min":0.499,"5min":0.434,"15min":0.434},"max":{"1min":0.83599999999999997,"5min":0.997,"15min":7.0289999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.70399999999999996,"15min":0.69299999999999995},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.86399999999999999,"5min":0.98199999999999998,"15min":1.0580000000000001},"last":0.73199999999999998}]},{"osd":3,"last update":"Fri Jul 14 11:19:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.68899999999999995,"15min":1.109},"min":{"1min":0.55200000000000005,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.91100000000000003,"5min":0.95699999999999996,"15min":10.337},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.72699999999999998,"15min":0.75800000000000001},"min":{"1min":0.53300000000000003,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.90100000000000002,"5min":1.024,"15min":1.921},"last":0.85199999999999998}]},{"osd":4,"last update":"Fri Jul 14 11:19:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.64700000000000002,"15min":0.59899999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.73599999999999999,"15min":0.70599999999999996},"min":{"1min":0.57299999999999995,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.90800000000000003,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.70399999999999996}]},{"osd":5,"last update":"Fri Jul 14 11:19:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.70099999999999996,"15min":0.67900000000000005},"min":{"1min":0.39700000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.92800000000000005,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.76400000000000001,"15min":0.73999999999999999},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.79800000000000004}]},{"osd":6,"last update":"Fri Jul 14 11:19:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.72899999999999998,"15min":0.68300000000000005},"min":{"1min":0.505,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.98799999999999999,"5min":1.002,"15min":1.002},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.73299999999999998,"15min":0.69399999999999995},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.48899999999999999},"max":{"1min":0.97399999999999998,"5min":1.129,"15min":1.129},"last":0.78000000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574937,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28272,"kb_used_data":1320,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343568,"statfs":{"total":96636764160,"available":96607813632,"internally_reserved":0,"allocated":1351680,"data_stored":624453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.69899999999999995,"15min":0.70299999999999996},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93799999999999994,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.73499999999999999,"15min":0.72099999999999997},"min":{"1min":0.51100000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.83899999999999997,"5min":1.167,"15min":1.167},"last":0.504}]},{"osd":1,"last update":"Fri Jul 14 11:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71899999999999997,"15min":0.69099999999999995},"min":{"1min":0.443,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.73099999999999998,"15min":0.71399999999999997},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39300000000000002},"max":{"1min":0.90400000000000003,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.72199999999999998}]},{"osd":2,"last update":"Fri Jul 14 11:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.69899999999999995,"15min":0.67900000000000005},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.41299999999999998},"max":{"1min":0.89000000000000001,"5min":1.45,"15min":1.45},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.755,"5min":0.754,"15min":0.77600000000000002},"min":{"1min":0.56399999999999995,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.075,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.58899999999999997}]},{"osd":3,"last update":"Fri Jul 14 11:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.73099999999999998,"15min":0.74299999999999999},"min":{"1min":0.50900000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.86499999999999999,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.73299999999999998,"15min":0.73899999999999999},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0469999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.76200000000000001}]},{"osd":4,"last update":"Fri Jul 14 11:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.69099999999999995,"15min":0.70699999999999996},"min":{"1min":0.53300000000000003,"5min":0.38,"15min":0.38},"max":{"1min":1.177,"5min":1.712,"15min":1.712},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.71999999999999997,"15min":0.72599999999999998},"min":{"1min":0.48199999999999998,"5min":0.438,"15min":0.42899999999999999},"max":{"1min":0.998,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.81000000000000005}]},{"osd":5,"last update":"Fri Jul 14 11:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.71199999999999997,"15min":0.71799999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.93500000000000005,"5min":2.8820000000000001,"15min":2.8820000000000001},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.77200000000000002,"15min":0.78800000000000003},"min":{"1min":0.58399999999999996,"5min":0.46100000000000002,"15min":0.44500000000000001},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.83099999999999996}]},{"osd":7,"last update":"Fri Jul 14 11:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.77500000000000002,"15min":0.79900000000000004},"min":{"1min":0.59899999999999998,"5min":0.47399999999999998,"15min":0.47099999999999997},"max":{"1min":0.95499999999999996,"5min":1.333,"15min":1.333},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.76300000000000001,"15min":0.78900000000000003},"min":{"1min":0.46899999999999997,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.1579999999999999,"5min":1.55,"15min":1.55},"last":0.95099999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574936,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32380,"kb_used_data":1332,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339460,"statfs":{"total":96636764160,"available":96603607040,"internally_reserved":0,"allocated":1363968,"data_stored":630227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.40500000000000003,"15min":0.432},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.54200000000000004,"5min":0.59099999999999997,"15min":0.996},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.432,"5min":0.45500000000000002,"15min":0.47599999999999998},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.57299999999999995,"5min":0.81599999999999995,"15min":0.84299999999999997},"last":0.33800000000000002}]},{"osd":2,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.48099999999999998,"15min":0.54900000000000004},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.60299999999999998,"5min":0.70799999999999996,"15min":2.476},"last":0.504},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.48899999999999999,"15min":0.59499999999999997},"min":{"1min":0.36899999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.64700000000000002,"5min":0.91700000000000004,"15min":2.6299999999999999},"last":0.44900000000000001}]},{"osd":3,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.52800000000000002,"15min":0.52200000000000002},"min":{"1min":0.40899999999999997,"5min":0.39300000000000002,"15min":0.38900000000000001},"max":{"1min":0.72599999999999998,"5min":0.748,"15min":0.748},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46500000000000002,"15min":0.48799999999999999},"min":{"1min":0.33600000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.59499999999999997,"5min":0.67700000000000005,"15min":0.73199999999999998},"last":0.41699999999999998}]},{"osd":4,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.73699999999999999,"15min":0.749},"min":{"1min":0.52400000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.363},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.751,"5min":0.754,"15min":0.76900000000000002},"min":{"1min":0.57099999999999995,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.93999999999999995,"5min":1.1160000000000001,"15min":1.4890000000000001},"last":0.65200000000000002}]},{"osd":5,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.749,"15min":0.76500000000000001},"min":{"1min":0.54200000000000004,"5min":0.499,"15min":0.499},"max":{"1min":1.0589999999999999,"5min":1.2250000000000001,"15min":1.3759999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76200000000000001,"15min":0.80800000000000005},"min":{"1min":0.59099999999999997,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.4330000000000001},"last":0.79200000000000004}]},{"osd":6,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.745,"15min":0.78800000000000003},"min":{"1min":0.55900000000000005,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.028,"5min":1.141,"15min":1.298},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.753,"15min":0.77900000000000003},"min":{"1min":0.60199999999999998,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.97199999999999998,"5min":1.1899999999999999,"15min":1.2130000000000001},"last":0.84199999999999997}]},{"osd":7,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.75900000000000001,"15min":0.80700000000000005},"min":{"1min":0.58299999999999996,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0780000000000001,"5min":1.2010000000000001,"15min":1.4590000000000001},"last":0.872},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.75,"15min":0.77900000000000003},"min":{"1min":0.56299999999999994,"5min":0.55000000000000004,"15min":0.54200000000000004},"max":{"1min":1.129,"5min":1.129,"15min":1.3700000000000001},"last":0.61099999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574934,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28864,"kb_used_data":1912,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94342976,"statfs":{"total":96636764160,"available":96607207424,"internally_reserved":0,"allocated":1957888,"data_stored":1220595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 11:19:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.47699999999999998,"15min":0.44700000000000001},"min":{"1min":0.26800000000000002,"5min":0.252,"15min":0.252},"max":{"1min":2.972,"5min":2.972,"15min":2.972},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.47599999999999998,"15min":0.45200000000000001},"min":{"1min":0.33300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":2.758,"5min":2.758,"15min":2.758},"last":0.40999999999999998}]},{"osd":2,"last update":"Fri Jul 14 11:19:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.499,"15min":0.47299999999999998},"min":{"1min":0.35599999999999998,"5min":0.307,"15min":0.307},"max":{"1min":2.9409999999999998,"5min":2.9409999999999998,"15min":2.9409999999999998},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.51900000000000002,"15min":0.50900000000000001},"min":{"1min":0.376,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":2.556,"5min":2.556,"15min":2.556},"last":0.47299999999999998}]},{"osd":3,"last update":"Fri Jul 14 11:19:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.48199999999999998,"15min":0.438},"min":{"1min":0.33700000000000002,"5min":0.32000000000000001,"15min":0.309},"max":{"1min":2.6019999999999999,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.55600000000000005,"15min":0.53500000000000003},"min":{"1min":0.44900000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":2.9990000000000001,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":0.433}]},{"osd":4,"last update":"Fri Jul 14 11:19:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.73699999999999999,"15min":0.75700000000000001},"min":{"1min":0.51200000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0229999999999999,"5min":1.099,"15min":1.1060000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.76400000000000001,"15min":0.71799999999999997},"min":{"1min":0.57499999999999996,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.651,"5min":1.651,"15min":1.651},"last":0.58299999999999996}]},{"osd":5,"last update":"Fri Jul 14 11:19:12 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.77200000000000002,"15min":0.73799999999999999},"min":{"1min":0.51900000000000002,"5min":0.502,"15min":0.47999999999999998},"max":{"1min":2.9089999999999998,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.76500000000000001,"15min":0.77600000000000002},"min":{"1min":0.53200000000000003,"5min":0.505,"15min":0.505},"max":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.60399999999999998}]},{"osd":6,"last update":"Fri Jul 14 11:19:12 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.745,"15min":0.72799999999999998},"min":{"1min":0.499,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.78700000000000003,"15min":0.78300000000000003},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":2.8679999999999999,"5min":2.8679999999999999,"15min":2.8679999999999999},"last":0.63300000000000001}]},{"osd":7,"last update":"Fri Jul 14 11:19:12 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.77700000000000002,"15min":0.80900000000000005},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.97599999999999998,"5min":1.0900000000000001,"15min":1.149},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.81899999999999995,"15min":0.78900000000000003},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.7410000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":0.61799999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574934,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28284,"kb_used_data":1332,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343556,"statfs":{"total":96636764160,"available":96607801344,"internally_reserved":0,"allocated":1363968,"data_stored":630227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:19:20 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.40899999999999997,"15min":0.441},"min":{"1min":0.27100000000000002,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.623,"5min":0.63900000000000001,"15min":0.64700000000000002},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.438,"15min":0.44400000000000001},"min":{"1min":0.32100000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.63700000000000001,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.44500000000000001}]},{"osd":1,"last update":"Fri Jul 14 11:19:20 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46700000000000003,"15min":0.48199999999999998},"min":{"1min":0.371,"5min":0.31,"15min":0.31},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.98299999999999998},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.47899999999999998,"15min":0.48699999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.59199999999999997,"5min":0.629,"15min":0.91200000000000003},"last":0.47999999999999998}]},{"osd":3,"last update":"Fri Jul 14 11:19:20 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.48699999999999999,"15min":0.49299999999999999},"min":{"1min":0.34999999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.623,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.55700000000000005,"15min":0.57999999999999996},"min":{"1min":0.44500000000000001,"5min":0.41499999999999998,"15min":0.40799999999999997},"max":{"1min":0.72899999999999998,"5min":0.80000000000000004,"15min":1.034},"last":0.55100000000000005}]},{"osd":4,"last update":"Fri Jul 14 11:19:20 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.73499999999999999,"15min":0.76300000000000001},"min":{"1min":0.53900000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.036,"5min":1.171,"15min":1.212},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.749,"15min":0.77900000000000003},"min":{"1min":0.53800000000000003,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.56699999999999995}]},{"osd":5,"last update":"Fri Jul 14 11:19:20 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.74399999999999999,"15min":0.78200000000000003},"min":{"1min":0.53900000000000003,"5min":0.51700000000000002,"15min":0.43099999999999999},"max":{"1min":1.202,"5min":1.202,"15min":1.4019999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.75,"5min":0.76300000000000001,"15min":0.81100000000000005},"min":{"1min":0.55800000000000005,"5min":0.495,"15min":0.495},"max":{"1min":1.044,"5min":1.351,"15min":1.351},"last":0.63500000000000001}]},{"osd":6,"last update":"Fri Jul 14 11:19:20 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.753,"15min":0.78100000000000003},"min":{"1min":0.53100000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0089999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.76800000000000002,"15min":0.81299999999999994},"min":{"1min":0.60199999999999998,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.218,"5min":1.282,"15min":1.282},"last":0.60499999999999998}]},{"osd":7,"last update":"Fri Jul 14 11:19:20 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.754,"15min":0.79100000000000004},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.93400000000000005,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.621},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.754,"15min":0.79600000000000004},"min":{"1min":0.60899999999999999,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.96399999999999997,"5min":1.244,"15min":1.244},"last":0.58599999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574934,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28284,"kb_used_data":1332,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343556,"statfs":{"total":96636764160,"available":96607801344,"internally_reserved":0,"allocated":1363968,"data_stored":630227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.41099999999999998,"15min":0.442},"min":{"1min":0.24299999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.55900000000000005,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.44500000000000001,"15min":0.44800000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.621,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.371}]},{"osd":1,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.44,"15min":0.44900000000000001},"min":{"1min":0.29499999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.52000000000000002,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.47199999999999998,"15min":0.49099999999999999},"min":{"1min":0.317,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.60899999999999999,"5min":0.72699999999999998,"15min":0.86399999999999999},"last":0.39400000000000002}]},{"osd":2,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.53400000000000003,"15min":0.54000000000000004},"min":{"1min":0.39600000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.64900000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56200000000000006,"15min":0.58999999999999997},"min":{"1min":0.44,"5min":0.37,"15min":0.37},"max":{"1min":0.76100000000000001,"5min":0.79600000000000004,"15min":1.585},"last":0.441}]},{"osd":4,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.73299999999999998,"15min":0.754},"min":{"1min":0.45400000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.96399999999999997,"5min":1.1279999999999999,"15min":1.216},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.76700000000000002,"15min":0.75700000000000001},"min":{"1min":0.48599999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.61499999999999999}]},{"osd":5,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.747,"15min":0.75700000000000001},"min":{"1min":0.48499999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.089,"5min":1.179,"15min":1.413},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.76700000000000002,"15min":0.83499999999999996},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.94999999999999996,"5min":1.1619999999999999,"15min":1.657},"last":0.624}]},{"osd":6,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77700000000000002,"15min":0.78300000000000003},"min":{"1min":0.56699999999999995,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.726},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.755,"5min":0.76800000000000002,"15min":0.79400000000000004},"min":{"1min":0.57099999999999995,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.143,"5min":1.286,"15min":1.333},"last":0.746}]},{"osd":7,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.79700000000000004,"15min":0.83099999999999996},"min":{"1min":0.53800000000000003,"5min":0.437,"15min":0.437},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.3939999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.80800000000000005,"15min":0.83399999999999996},"min":{"1min":0.60299999999999998,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.66500000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574934,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28268,"kb_used_data":1316,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343572,"statfs":{"total":96636764160,"available":96607817728,"internally_reserved":0,"allocated":1347584,"data_stored":624309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:19:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.64900000000000002,"15min":0.63500000000000001},"min":{"1min":0.437,"5min":0.311,"15min":0.311},"max":{"1min":0.89600000000000002,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.65200000000000002,"15min":0.68400000000000005},"min":{"1min":0.47699999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85199999999999998,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.70999999999999996}]},{"osd":1,"last update":"Fri Jul 14 11:19:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.65200000000000002,"15min":0.66600000000000004},"min":{"1min":0.51700000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.83599999999999997,"5min":0.92000000000000004,"15min":1.4259999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70299999999999996,"15min":0.70999999999999996},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.45800000000000002},"max":{"1min":0.95799999999999996,"5min":1.0149999999999999,"15min":1.1659999999999999},"last":0.59899999999999998}]},{"osd":2,"last update":"Fri Jul 14 11:19:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.69999999999999996,"15min":0.70699999999999996},"min":{"1min":0.501,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.88200000000000001,"5min":1.0209999999999999,"15min":1.48},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71999999999999997,"15min":0.73599999999999999},"min":{"1min":0.54800000000000004,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.91800000000000004,"5min":1.1080000000000001,"15min":1.23},"last":0.68300000000000005}]},{"osd":3,"last update":"Fri Jul 14 11:19:15 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.67800000000000005,"15min":0.70799999999999996},"min":{"1min":0.51300000000000001,"5min":0.438,"15min":0.438},"max":{"1min":0.95599999999999996,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.72999999999999998,"15min":0.73599999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.90700000000000003,"5min":1.1259999999999999,"15min":1.145},"last":0.77900000000000003}]},{"osd":5,"last update":"Fri Jul 14 11:19:15 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.66600000000000004,"15min":0.74299999999999999},"min":{"1min":0.47399999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.81799999999999995,"5min":0.95999999999999996,"15min":1.6559999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.65700000000000003,"15min":0.745},"min":{"1min":0.41999999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.90500000000000003,"5min":0.96999999999999997,"15min":1.3839999999999999},"last":0.496}]},{"osd":6,"last update":"Fri Jul 14 11:19:15 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.68500000000000005,"15min":0.71299999999999997},"min":{"1min":0.45200000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.86799999999999999,"5min":1.1659999999999999,"15min":1.1970000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.73699999999999999,"15min":0.76600000000000001},"min":{"1min":0.56899999999999995,"5min":0.442,"15min":0.442},"max":{"1min":0.878,"5min":1.1479999999999999,"15min":1.3},"last":0.79800000000000004}]},{"osd":7,"last update":"Fri Jul 14 11:19:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.70499999999999996,"15min":0.755},"min":{"1min":0.47899999999999998,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.88,"5min":1.028,"15min":1.4810000000000001},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.755,"15min":0.82599999999999996},"min":{"1min":0.59099999999999997,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.82499999999999996,"5min":1.21,"15min":1.379},"last":0.622}]}]},{"osd":5,"up_from":13,"seq":55834574936,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28284,"kb_used_data":1332,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343556,"statfs":{"total":96636764160,"available":96607801344,"internally_reserved":0,"allocated":1363968,"data_stored":630227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:19:05 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.61899999999999999,"15min":0.63600000000000001},"min":{"1min":0.371,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.84199999999999997,"5min":0.996,"15min":1.3140000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65200000000000002,"15min":0.64000000000000001},"min":{"1min":0.42399999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":1.0980000000000001},"last":0.66000000000000003}]},{"osd":1,"last update":"Fri Jul 14 11:19:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.624,"15min":0.66400000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.75600000000000001,"5min":0.88800000000000001,"15min":1.343},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.65100000000000002,"15min":0.64800000000000002},"min":{"1min":0.442,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.86599999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.85799999999999998}]},{"osd":2,"last update":"Fri Jul 14 11:19:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.69899999999999995,"15min":0.72899999999999998},"min":{"1min":0.46700000000000003,"5min":0.436,"15min":0.436},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.70299999999999996,"15min":0.753},"min":{"1min":0.504,"5min":0.496,"15min":0.496},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":1.3939999999999999},"last":0.83299999999999996}]},{"osd":3,"last update":"Fri Jul 14 11:19:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71199999999999997,"15min":0.75600000000000001},"min":{"1min":0.54500000000000004,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":1.2130000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.67700000000000005,"15min":0.75700000000000001},"min":{"1min":0.46400000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":1.806},"last":0.91800000000000004}]},{"osd":4,"last update":"Fri Jul 14 11:19:05 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.61699999999999999,"15min":0.64600000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.878,"5min":1.0229999999999999,"15min":1.1319999999999999},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.66500000000000004,"15min":0.73699999999999999},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.3999999999999999},"last":0.98599999999999999}]},{"osd":6,"last update":"Fri Jul 14 11:19:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.69699999999999995,"15min":0.73999999999999999},"min":{"1min":0.502,"5min":0.435,"15min":0.435},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":1.0149999999999999},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.73499999999999999,"15min":0.79000000000000004},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.004,"5min":1.0629999999999999,"15min":1.3640000000000001},"last":1.155}]},{"osd":7,"last update":"Fri Jul 14 11:19:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.747,"15min":0.82999999999999996},"min":{"1min":0.54400000000000004,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.4970000000000001},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78500000000000003,"15min":0.85499999999999998},"min":{"1min":0.60399999999999998,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.8540000000000001},"last":0.96899999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T11:20:01.577 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T11:20:01.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.768+0000 7f2f3a1ff700 1 Processor -- start 2023-07-14T11:20:01.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.768+0000 7f2f3a1ff700 1 -- start start 2023-07-14T11:20:01.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.770+0000 7f2f3a1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f340d1220 0x7f2f340b6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:01.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.770+0000 7f2f3a1ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f340b7f50 con 0x7f2f340b4510 2023-07-14T11:20:01.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.770+0000 7f2f3a1ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f340cdca0 con 0x7f2f340b5d90 2023-07-14T11:20:01.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.770+0000 7f2f3a1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f340b48e0 con 0x7f2f340d1220 2023-07-14T11:20:01.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.770+0000 7f2f337fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f2f340b4510 0x7f2f340cd590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49456/0 (socket says 172.21.15.84:49456) 2023-07-14T11:20:01.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.770+0000 7f2f337fe700 1 -- 172.21.15.84:0/3646723223 learned_addr learned my addr 172.21.15.84:0/3646723223 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:20:01.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.770+0000 7f2f33fff700 1 --2- 172.21.15.84:0/3646723223 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f340d1220 0x7f2f340b6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:01.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.770+0000 7f2f32ffd700 1 -- 172.21.15.84:0/3646723223 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2570540026 0 0) 0x7f2f340b7f50 con 0x7f2f340b4510 2023-07-14T11:20:01.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.770+0000 7f2f32ffd700 1 -- 172.21.15.84:0/3646723223 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f200035b0 con 0x7f2f340b4510 2023-07-14T11:20:01.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.770+0000 7f2f32ffd700 1 -- 172.21.15.84:0/3646723223 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2978872322 0 0) 0x7f2f340cdca0 con 0x7f2f340b5d90 2023-07-14T11:20:01.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.770+0000 7f2f32ffd700 1 -- 172.21.15.84:0/3646723223 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f340b7f50 con 0x7f2f340b5d90 2023-07-14T11:20:01.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.771+0000 7f2f33fff700 1 -- 172.21.15.84:0/3646723223 >> v1:172.21.15.179:6789/0 conn(0x7f2f340b5d90 legacy=0x7f2f340d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:01.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.771+0000 7f2f33fff700 1 -- 172.21.15.84:0/3646723223 >> v1:172.21.15.84:6789/0 conn(0x7f2f340b4510 legacy=0x7f2f340cd590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:01.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.771+0000 7f2f33fff700 1 -- 172.21.15.84:0/3646723223 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f340b7340 con 0x7f2f340d1220 2023-07-14T11:20:01.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.771+0000 7f2f33fff700 1 --2- 172.21.15.84:0/3646723223 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f340d1220 0x7f2f340b6c80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c009dc0 tx=0x7f2f2c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aff0fbfc2c9d8c81 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:01.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.771+0000 7f2f32ffd700 1 -- 172.21.15.84:0/3646723223 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f2c00e070 con 0x7f2f340d1220 2023-07-14T11:20:01.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.771+0000 7f2f32ffd700 1 -- 172.21.15.84:0/3646723223 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f2c00bb20 con 0x7f2f340d1220 2023-07-14T11:20:01.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.771+0000 7f2f32ffd700 1 -- 172.21.15.84:0/3646723223 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f2c012430 con 0x7f2f340d1220 2023-07-14T11:20:01.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.772+0000 7f2f3a1ff700 1 -- 172.21.15.84:0/3646723223 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f340d1220 msgr2=0x7f2f340b6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:01.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.772+0000 7f2f3a1ff700 1 --2- 172.21.15.84:0/3646723223 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f340d1220 0x7f2f340b6c80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c009dc0 tx=0x7f2f2c00b330 comp rx=0 tx=0).stop 2023-07-14T11:20:01.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.772+0000 7f2f3a1ff700 1 -- 172.21.15.84:0/3646723223 shutdown_connections 2023-07-14T11:20:01.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.772+0000 7f2f3a1ff700 1 --2- 172.21.15.84:0/3646723223 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f340d1220 0x7f2f340b6c80 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:01.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.772+0000 7f2f3a1ff700 1 -- 172.21.15.84:0/3646723223 >> 172.21.15.84:0/3646723223 conn(0x7f2f3409c1d0 msgr2=0x7f2f340d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:20:01.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.772+0000 7f2f3a1ff700 1 -- 172.21.15.84:0/3646723223 shutdown_connections 2023-07-14T11:20:01.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.772+0000 7f2f3a1ff700 1 -- 172.21.15.84:0/3646723223 wait complete. 2023-07-14T11:20:01.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.773+0000 7f2f3a1ff700 1 Processor -- start 2023-07-14T11:20:01.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.774+0000 7f2f3a1ff700 1 -- start start 2023-07-14T11:20:01.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.774+0000 7f2f3a1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f340b4510 0x7f2f341f3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:01.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.774+0000 7f2f3a1ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f340b5d90 0x7f2f34152440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:01.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.774+0000 7f2f3a1ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f340d1220 0x7f2f340c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:01.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.774+0000 7f2f3a1ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f340cb890 con 0x7f2f340b5d90 2023-07-14T11:20:01.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.774+0000 7f2f3a1ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f341f3ec0 con 0x7f2f340d1220 2023-07-14T11:20:01.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.774+0000 7f2f3a1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f34152980 con 0x7f2f340b4510 2023-07-14T11:20:01.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.775+0000 7f2f2bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f340b5d90 0x7f2f34152440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:01.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.775+0000 7f2f2bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f340b5d90 0x7f2f34152440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60108/0 (socket says 172.21.15.84:60108) 2023-07-14T11:20:01.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.775+0000 7f2f2bfff700 1 -- 172.21.15.84:0/1677914553 learned_addr learned my addr 172.21.15.84:0/1677914553 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:20:01.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.775+0000 7f2f337fe700 1 --2- 172.21.15.84:0/1677914553 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f340b4510 0x7f2f341f3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:01.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.775+0000 7f2f33fff700 1 --2- 172.21.15.84:0/1677914553 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f340d1220 0x7f2f340c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:01.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.775+0000 7f2f2bfff700 1 -- 172.21.15.84:0/1677914553 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f340b4510 msgr2=0x7f2f341f3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:01.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.775+0000 7f2f2bfff700 1 --2- 172.21.15.84:0/1677914553 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f340b4510 0x7f2f341f3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:01.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.775+0000 7f2f2bfff700 1 -- 172.21.15.84:0/1677914553 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f340d1220 msgr2=0x7f2f340c8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:01.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.775+0000 7f2f2bfff700 1 --2- 172.21.15.84:0/1677914553 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f340d1220 0x7f2f340c8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:01.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.775+0000 7f2f2bfff700 1 -- 172.21.15.84:0/1677914553 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f2c009a70 con 0x7f2f340b5d90 2023-07-14T11:20:01.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.775+0000 7f2f2bfff700 1 --2- 172.21.15.84:0/1677914553 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f340b5d90 0x7f2f34152440 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c00c520 tx=0x7f2f1c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:01.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.775+0000 7f2f30ff9700 1 -- 172.21.15.84:0/1677914553 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1c0052d0 con 0x7f2f340b5d90 2023-07-14T11:20:01.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.776+0000 7f2f30ff9700 1 -- 172.21.15.84:0/1677914553 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f1c005430 con 0x7f2f340b5d90 2023-07-14T11:20:01.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.776+0000 7f2f3a1ff700 1 -- 172.21.15.84:0/1677914553 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f340cac10 con 0x7f2f340b5d90 2023-07-14T11:20:01.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.776+0000 7f2f30ff9700 1 -- 172.21.15.84:0/1677914553 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1c0038c0 con 0x7f2f340b5d90 2023-07-14T11:20:01.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.776+0000 7f2f3a1ff700 1 -- 172.21.15.84:0/1677914553 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f340cb1d0 con 0x7f2f340b5d90 2023-07-14T11:20:01.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.777+0000 7f2f3a1ff700 1 -- 172.21.15.84:0/1677914553 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f340cb9d0 con 0x7f2f340b5d90 2023-07-14T11:20:01.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.778+0000 7f2f30ff9700 1 -- 172.21.15.84:0/1677914553 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f2f1c003a20 con 0x7f2f340b5d90 2023-07-14T11:20:01.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.778+0000 7f2f30ff9700 1 --2- 172.21.15.84:0/1677914553 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f2f1406ae90 0x7f2f1406d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:01.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.779+0000 7f2f30ff9700 1 -- 172.21.15.84:0/1677914553 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f2f1c088a70 con 0x7f2f340b5d90 2023-07-14T11:20:01.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.779+0000 7f2f337fe700 1 --2- 172.21.15.84:0/1677914553 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f2f1406ae90 0x7f2f1406d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:01.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.780+0000 7f2f337fe700 1 --2- 172.21.15.84:0/1677914553 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f2f1406ae90 0x7f2f1406d340 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2f240010e0 tx=0x7f2f24009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:01.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.783+0000 7f2f30ff9700 1 -- 172.21.15.84:0/1677914553 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f2f340cb9d0 con 0x7f2f340b5d90 2023-07-14T11:20:01.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.981+0000 7f2f3a1ff700 1 -- 172.21.15.84:0/1677914553 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2f340cb9d0 con 0x7f2f340b5d90 2023-07-14T11:20:01.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.982+0000 7f2f30ff9700 1 -- 172.21.15.84:0/1677914553 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v109) v1 ==== 74+0+14754 (secure 0 0 0) 0x7f2f340cb9d0 con 0x7f2f340b5d90 2023-07-14T11:20:01.985 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:20:01.985 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":109,"fsid":"3a4ca3fb-e71b-44ea-99ca-ef7c6db6eb8f","created":"2023-07-14T11:12:46.961200+0000","modified":"2023-07-14T11:19:57.930670+0000","last_up_change":"2023-07-14T11:12:59.147243+0000","last_in_change":"2023-07-14T11:12:50.425783+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T11:13:00.125395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T11:13:06.803994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af0b2b54-5f73-424e-a946-83a521ddd973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6809","nonce":288822924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6811","nonce":288822924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6815","nonce":288822924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":288822924},{"type":"v1","addr":"172.21.15.84:6813","nonce":288822924}]},"public_addr":"172.21.15.84:6809/288822924","cluster_addr":"172.21.15.84:6811/288822924","heartbeat_back_addr":"172.21.15.84:6815/288822924","heartbeat_front_addr":"172.21.15.84:6813/288822924","state":["exists","up"]},{"osd":1,"uuid":"df0d7e21-1ca8-4511-8ded-3d55acac7e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6825","nonce":1060220522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6827","nonce":1060220522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6831","nonce":1060220522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1060220522},{"type":"v1","addr":"172.21.15.84:6829","nonce":1060220522}]},"public_addr":"172.21.15.84:6825/1060220522","cluster_addr":"172.21.15.84:6827/1060220522","heartbeat_back_addr":"172.21.15.84:6831/1060220522","heartbeat_front_addr":"172.21.15.84:6829/1060220522","state":["exists","up"]},{"osd":2,"uuid":"1ce33f02-2334-4187-bdd5-82a300a1f9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6801","nonce":3001671542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6803","nonce":3001671542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6807","nonce":3001671542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3001671542},{"type":"v1","addr":"172.21.15.84:6805","nonce":3001671542}]},"public_addr":"172.21.15.84:6801/3001671542","cluster_addr":"172.21.15.84:6803/3001671542","heartbeat_back_addr":"172.21.15.84:6807/3001671542","heartbeat_front_addr":"172.21.15.84:6805/3001671542","state":["exists","up"]},{"osd":3,"uuid":"fec68cd7-c176-487d-9941-811be1202897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6817","nonce":3292558976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6819","nonce":3292558976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6823","nonce":3292558976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3292558976},{"type":"v1","addr":"172.21.15.84:6821","nonce":3292558976}]},"public_addr":"172.21.15.84:6817/3292558976","cluster_addr":"172.21.15.84:6819/3292558976","heartbeat_back_addr":"172.21.15.84:6823/3292558976","heartbeat_front_addr":"172.21.15.84:6821/3292558976","state":["exists","up"]},{"osd":4,"uuid":"0f0296be-6337-4c76-866c-0cac384bc6fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6801","nonce":3819177669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6803","nonce":3819177669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6807","nonce":3819177669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3819177669},{"type":"v1","addr":"172.21.15.179:6805","nonce":3819177669}]},"public_addr":"172.21.15.179:6801/3819177669","cluster_addr":"172.21.15.179:6803/3819177669","heartbeat_back_addr":"172.21.15.179:6807/3819177669","heartbeat_front_addr":"172.21.15.179:6805/3819177669","state":["exists","up"]},{"osd":5,"uuid":"37ad400d-d06a-4888-9719-ae5d53b73128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6817","nonce":446039797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6819","nonce":446039797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6825","nonce":446039797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":446039797},{"type":"v1","addr":"172.21.15.179:6822","nonce":446039797}]},"public_addr":"172.21.15.179:6817/446039797","cluster_addr":"172.21.15.179:6819/446039797","heartbeat_back_addr":"172.21.15.179:6825/446039797","heartbeat_front_addr":"172.21.15.179:6822/446039797","state":["exists","up"]},{"osd":6,"uuid":"79f265bc-42b0-496b-b3aa-5d1356c80a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6809","nonce":174345035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6811","nonce":174345035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6815","nonce":174345035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":174345035},{"type":"v1","addr":"172.21.15.179:6813","nonce":174345035}]},"public_addr":"172.21.15.179:6809/174345035","cluster_addr":"172.21.15.179:6811/174345035","heartbeat_back_addr":"172.21.15.179:6815/174345035","heartbeat_front_addr":"172.21.15.179:6813/174345035","state":["exists","up"]},{"osd":7,"uuid":"9aac86cf-4c87-4536-be1a-d2db27abe4a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6821","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6823","nonce":2934497681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6827","nonce":2934497681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6831","nonce":2934497681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2934497681},{"type":"v1","addr":"172.21.15.179:6829","nonce":2934497681}]},"public_addr":"172.21.15.179:6823/2934497681","cluster_addr":"172.21.15.179:6827/2934497681","heartbeat_back_addr":"172.21.15.179:6831/2934497681","heartbeat_front_addr":"172.21.15.179:6829/2934497681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.020475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.012098+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.028237+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.061082+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.992148+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.787914+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:55.689149+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T11:12:56.040182+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:6835/2350815422":"2023-07-15T11:19:54.535495+0000","172.21.15.84:6834/2350815422":"2023-07-15T11:19:54.535495+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T11:20:01.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.984+0000 7f2f3a1ff700 1 -- 172.21.15.84:0/1677914553 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f2f1406ae90 msgr2=0x7f2f1406d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:01.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.984+0000 7f2f3a1ff700 1 --2- 172.21.15.84:0/1677914553 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f2f1406ae90 0x7f2f1406d340 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2f240010e0 tx=0x7f2f24009040 comp rx=0 tx=0).stop 2023-07-14T11:20:01.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.984+0000 7f2f3a1ff700 1 -- 172.21.15.84:0/1677914553 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f340b5d90 msgr2=0x7f2f34152440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:01.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.984+0000 7f2f3a1ff700 1 --2- 172.21.15.84:0/1677914553 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f340b5d90 0x7f2f34152440 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c00c520 tx=0x7f2f1c00c8e0 comp rx=0 tx=0).stop 2023-07-14T11:20:01.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.984+0000 7f2f3a1ff700 1 -- 172.21.15.84:0/1677914553 shutdown_connections 2023-07-14T11:20:01.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.984+0000 7f2f3a1ff700 1 --2- 172.21.15.84:0/1677914553 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f2f1406ae90 0x7f2f1406d340 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:01.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.984+0000 7f2f3a1ff700 1 --2- 172.21.15.84:0/1677914553 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f340b4510 0x7f2f341f3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:01.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.984+0000 7f2f3a1ff700 1 --2- 172.21.15.84:0/1677914553 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f340d1220 0x7f2f340c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:01.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.984+0000 7f2f3a1ff700 1 --2- 172.21.15.84:0/1677914553 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f340b5d90 0x7f2f34152440 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:01.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.984+0000 7f2f3a1ff700 1 -- 172.21.15.84:0/1677914553 >> 172.21.15.84:0/1677914553 conn(0x7f2f3409c1d0 msgr2=0x7f2f340d0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:20:01.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.985+0000 7f2f3a1ff700 1 -- 172.21.15.84:0/1677914553 shutdown_connections 2023-07-14T11:20:01.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:01.985+0000 7f2f3a1ff700 1 -- 172.21.15.84:0/1677914553 wait complete. 2023-07-14T11:20:03.006 INFO:tasks.ceph:Scrubbing osd.0 2023-07-14T11:20:03.006 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-07-14T11:20:03.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.212+0000 7ff5ecdff700 1 Processor -- start 2023-07-14T11:20:03.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.212+0000 7ff5ecdff700 1 -- start start 2023-07-14T11:20:03.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.213+0000 7ff5ecdff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5e815c890 0x7ff5e80d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:03.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.213+0000 7ff5ecdff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff5e806c240 0x7ff5e80d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:03.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.213+0000 7ff5ecdff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5e815cc60 con 0x7ff5e80b2440 2023-07-14T11:20:03.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.213+0000 7ff5ecdff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5e806a7f0 con 0x7ff5e806c240 2023-07-14T11:20:03.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.213+0000 7ff5ecdff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e806b760 con 0x7ff5e815c890 2023-07-14T11:20:03.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.214+0000 7ff5e5d9b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7ff5e80b2440 0x7ff5e80cf840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49464/0 (socket says 172.21.15.84:49464) 2023-07-14T11:20:03.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.214+0000 7ff5e5d9b700 1 -- 172.21.15.84:0/4060055252 learned_addr learned my addr 172.21.15.84:0/4060055252 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:20:03.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.214+0000 7ff5e6d9d700 1 --2- 172.21.15.84:0/4060055252 >> v2:172.21.15.179:3300/0 conn(0x7ff5e806c240 0x7ff5e80d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:03.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.214+0000 7ff5e659c700 1 --2- 172.21.15.84:0/4060055252 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5e815c890 0x7ff5e80d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:03.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.214+0000 7ff5e559a700 1 -- 172.21.15.84:0/4060055252 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4173662667 0 0) 0x7ff5e815cc60 con 0x7ff5e80b2440 2023-07-14T11:20:03.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.214+0000 7ff5e559a700 1 -- 172.21.15.84:0/4060055252 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5d00035b0 con 0x7ff5e80b2440 2023-07-14T11:20:03.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.214+0000 7ff5e6d9d700 1 -- 172.21.15.84:0/4060055252 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5e815c890 msgr2=0x7ff5e80d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:20:03.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.214+0000 7ff5e6d9d700 1 --2- 172.21.15.84:0/4060055252 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5e815c890 0x7ff5e80d0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:03.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.214+0000 7ff5e6d9d700 1 -- 172.21.15.84:0/4060055252 >> v1:172.21.15.84:6789/0 conn(0x7ff5e80b2440 legacy=0x7ff5e80cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:03.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.214+0000 7ff5e6d9d700 1 -- 172.21.15.84:0/4060055252 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e806ba40 con 0x7ff5e806c240 2023-07-14T11:20:03.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.215+0000 7ff5e6d9d700 1 --2- 172.21.15.84:0/4060055252 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5e806c240 0x7ff5e80d0f90 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7ff5e0009d90 tx=0x7ff5e000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa9b7b65e11999ad server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:03.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.215+0000 7ff5e559a700 1 -- 172.21.15.84:0/4060055252 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e000e070 con 0x7ff5e806c240 2023-07-14T11:20:03.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.215+0000 7ff5e559a700 1 -- 172.21.15.84:0/4060055252 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5e000bb20 con 0x7ff5e806c240 2023-07-14T11:20:03.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.215+0000 7ff5e559a700 1 -- 172.21.15.84:0/4060055252 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e000be90 con 0x7ff5e806c240 2023-07-14T11:20:03.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.215+0000 7ff5ecdff700 1 -- 172.21.15.84:0/4060055252 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5e806c240 msgr2=0x7ff5e80d0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:03.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.215+0000 7ff5ecdff700 1 --2- 172.21.15.84:0/4060055252 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5e806c240 0x7ff5e80d0f90 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7ff5e0009d90 tx=0x7ff5e000b330 comp rx=0 tx=0).stop 2023-07-14T11:20:03.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.215+0000 7ff5ecdff700 1 -- 172.21.15.84:0/4060055252 shutdown_connections 2023-07-14T11:20:03.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.215+0000 7ff5ecdff700 1 --2- 172.21.15.84:0/4060055252 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5e806c240 0x7ff5e80d0f90 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:03.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.215+0000 7ff5ecdff700 1 --2- 172.21.15.84:0/4060055252 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5e815c890 0x7ff5e80d0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:03.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.215+0000 7ff5ecdff700 1 -- 172.21.15.84:0/4060055252 >> 172.21.15.84:0/4060055252 conn(0x7ff5e809c170 msgr2=0x7ff5e80d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:20:03.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.216+0000 7ff5ecdff700 1 -- 172.21.15.84:0/4060055252 shutdown_connections 2023-07-14T11:20:03.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.216+0000 7ff5ecdff700 1 -- 172.21.15.84:0/4060055252 wait complete. 2023-07-14T11:20:03.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.218+0000 7ff5ecdff700 1 Processor -- start 2023-07-14T11:20:03.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.218+0000 7ff5ecdff700 1 -- start start 2023-07-14T11:20:03.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.219+0000 7ff5ecdff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5e806c240 0x7ff5e8145340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:03.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.219+0000 7ff5ecdff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5e80b2440 0x7ff5e815e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:03.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.219+0000 7ff5ecdff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5e815c890 0x7ff5e80afbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:03.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.219+0000 7ff5ecdff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e815fdc0 con 0x7ff5e80b2440 2023-07-14T11:20:03.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.219+0000 7ff5ecdff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e815f240 con 0x7ff5e806c240 2023-07-14T11:20:03.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.219+0000 7ff5ecdff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e815f520 con 0x7ff5e815c890 2023-07-14T11:20:03.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.220+0000 7ff5e5d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5e80b2440 0x7ff5e815e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:03.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.220+0000 7ff5e659c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5e806c240 0x7ff5e8145340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:03.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.220+0000 7ff5e5d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5e80b2440 0x7ff5e815e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60116/0 (socket says 172.21.15.84:60116) 2023-07-14T11:20:03.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.220+0000 7ff5e5d9b700 1 -- 172.21.15.84:0/1610254020 learned_addr learned my addr 172.21.15.84:0/1610254020 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:20:03.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.220+0000 7ff5e6d9d700 1 --2- 172.21.15.84:0/1610254020 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5e815c890 0x7ff5e80afbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:03.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.220+0000 7ff5e5d9b700 1 -- 172.21.15.84:0/1610254020 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5e815c890 msgr2=0x7ff5e80afbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:03.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.220+0000 7ff5e5d9b700 1 --2- 172.21.15.84:0/1610254020 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5e815c890 0x7ff5e80afbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:03.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.220+0000 7ff5e5d9b700 1 -- 172.21.15.84:0/1610254020 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5e806c240 msgr2=0x7ff5e8145340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:03.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.220+0000 7ff5e5d9b700 1 --2- 172.21.15.84:0/1610254020 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5e806c240 0x7ff5e8145340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:03.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.220+0000 7ff5e5d9b700 1 -- 172.21.15.84:0/1610254020 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e0009a70 con 0x7ff5e80b2440 2023-07-14T11:20:03.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.220+0000 7ff5e5d9b700 1 --2- 172.21.15.84:0/1610254020 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5e80b2440 0x7ff5e815e840 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc00c4d0 tx=0x7ff5dc00c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:03.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.220+0000 7ff5d6ffd700 1 -- 172.21.15.84:0/1610254020 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5dc005d70 con 0x7ff5e80b2440 2023-07-14T11:20:03.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.221+0000 7ff5d6ffd700 1 -- 172.21.15.84:0/1610254020 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5dc0070d0 con 0x7ff5e80b2440 2023-07-14T11:20:03.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.221+0000 7ff5ecdff700 1 -- 172.21.15.84:0/1610254020 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5e815f800 con 0x7ff5e80b2440 2023-07-14T11:20:03.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.221+0000 7ff5d6ffd700 1 -- 172.21.15.84:0/1610254020 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5dc007440 con 0x7ff5e80b2440 2023-07-14T11:20:03.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.221+0000 7ff5ecdff700 1 -- 172.21.15.84:0/1610254020 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5e815ed80 con 0x7ff5e80b2440 2023-07-14T11:20:03.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.221+0000 7ff5ecdff700 1 -- 172.21.15.84:0/1610254020 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff5e806bd20 con 0x7ff5e80b2440 2023-07-14T11:20:03.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.223+0000 7ff5d6ffd700 1 -- 172.21.15.84:0/1610254020 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) v1 ==== 89190+0+0 (secure 0 0 0) 0x7ff5dc0075a0 con 0x7ff5e80b2440 2023-07-14T11:20:03.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.223+0000 7ff5d6ffd700 1 --2- 172.21.15.84:0/1610254020 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7ff5c806ae90 0x7ff5c806d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:03.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.224+0000 7ff5d6ffd700 1 -- 172.21.15.84:0/1610254020 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5296+0+0 (secure 0 0 0) 0x7ff5dc088ee0 con 0x7ff5e80b2440 2023-07-14T11:20:03.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.224+0000 7ff5d6ffd700 1 --2- 172.21.15.84:0/1610254020 >> [v2:172.21.15.84:6808/288822924,v1:172.21.15.84:6809/288822924] conn(0x7ff5c8071300 0x7ff5c8073710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:03.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.224+0000 7ff5d6ffd700 1 -- 172.21.15.84:0/1610254020 --> [v2:172.21.15.84:6808/288822924,v1:172.21.15.84:6809/288822924] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff5c8073de0 con 0x7ff5c8071300 2023-07-14T11:20:03.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.224+0000 7ff5d6ffd700 1 -- 172.21.15.84:0/1610254020 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=109) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff5dc089310 con 0x7ff5e80b2440 2023-07-14T11:20:03.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.224+0000 7ff5e6d9d700 1 --2- 172.21.15.84:0/1610254020 >> [v2:172.21.15.84:6808/288822924,v1:172.21.15.84:6809/288822924] conn(0x7ff5c8071300 0x7ff5c8073710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:03.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.224+0000 7ff5e659c700 1 --2- 172.21.15.84:0/1610254020 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7ff5c806ae90 0x7ff5c806d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:03.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.225+0000 7ff5e6d9d700 1 --2- 172.21.15.84:0/1610254020 >> [v2:172.21.15.84:6808/288822924,v1:172.21.15.84:6809/288822924] conn(0x7ff5c8071300 0x7ff5c8073710 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:03.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.225+0000 7ff5e659c700 1 --2- 172.21.15.84:0/1610254020 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7ff5c806ae90 0x7ff5c806d340 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff5d8009be0 tx=0x7ff5d8009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:03.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.225+0000 7ff5d6ffd700 1 -- 172.21.15.84:0/1610254020 <== osd.0 v2:172.21.15.84:6808/288822924 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7ff5c8073de0 con 0x7ff5c8071300 2023-07-14T11:20:03.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.240+0000 7ff5ecdff700 1 -- 172.21.15.84:0/1610254020 --> [v2:172.21.15.84:6808/288822924,v1:172.21.15.84:6809/288822924] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff5e8074350 con 0x7ff5c8071300 2023-07-14T11:20:03.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.240+0000 7ff5d6ffd700 1 -- 172.21.15.84:0/1610254020 <== osd.0 v2:172.21.15.84:6808/288822924 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7ff5e8074350 con 0x7ff5c8071300 2023-07-14T11:20:03.243 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-07-14T11:20:03.243 INFO:teuthology.orchestra.run.smithi084.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-14T11:20:03.243 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-07-14T11:20:03.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.240+0000 7ff5ecdff700 1 -- 172.21.15.84:0/1610254020 >> [v2:172.21.15.84:6808/288822924,v1:172.21.15.84:6809/288822924] conn(0x7ff5c8071300 msgr2=0x7ff5c8073710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:03.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.240+0000 7ff5ecdff700 1 --2- 172.21.15.84:0/1610254020 >> [v2:172.21.15.84:6808/288822924,v1:172.21.15.84:6809/288822924] conn(0x7ff5c8071300 0x7ff5c8073710 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:03.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.240+0000 7ff5ecdff700 1 -- 172.21.15.84:0/1610254020 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7ff5c806ae90 msgr2=0x7ff5c806d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:03.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.240+0000 7ff5ecdff700 1 --2- 172.21.15.84:0/1610254020 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7ff5c806ae90 0x7ff5c806d340 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff5d8009be0 tx=0x7ff5d8009210 comp rx=0 tx=0).stop 2023-07-14T11:20:03.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.240+0000 7ff5ecdff700 1 -- 172.21.15.84:0/1610254020 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5e80b2440 msgr2=0x7ff5e815e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:03.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.240+0000 7ff5ecdff700 1 --2- 172.21.15.84:0/1610254020 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5e80b2440 0x7ff5e815e840 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc00c4d0 tx=0x7ff5dc00c7e0 comp rx=0 tx=0).stop 2023-07-14T11:20:03.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.240+0000 7ff5e6d9d700 1 -- 172.21.15.84:0/1610254020 reap_dead start 2023-07-14T11:20:03.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.240+0000 7ff5ecdff700 1 -- 172.21.15.84:0/1610254020 shutdown_connections 2023-07-14T11:20:03.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.240+0000 7ff5ecdff700 1 -- 172.21.15.84:0/1610254020 >> 172.21.15.84:0/1610254020 conn(0x7ff5e809c170 msgr2=0x7ff5e80b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:20:03.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.241+0000 7ff5ecdff700 1 -- 172.21.15.84:0/1610254020 shutdown_connections 2023-07-14T11:20:03.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.241+0000 7ff5ecdff700 1 -- 172.21.15.84:0/1610254020 wait complete. 2023-07-14T11:20:03.260 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-07-14T11:20:03.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.453+0000 7fc920d9d700 1 Processor -- start 2023-07-14T11:20:03.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.453+0000 7fc920d9d700 1 -- start start 2023-07-14T11:20:03.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.454+0000 7fc920d9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc91c0cd200 0x7fc91c0cd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:03.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.455+0000 7fc920d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc91c0d0b40 0x7fc91c0cf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:03.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.455+0000 7fc920d9d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc91c0cdb10 con 0x7fc91c0cfb30 2023-07-14T11:20:03.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.455+0000 7fc920d9d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc91c15dab0 con 0x7fc91c0cd200 2023-07-14T11:20:03.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.455+0000 7fc920d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc91c0cec40 con 0x7fc91c0d0b40 2023-07-14T11:20:03.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.455+0000 7fc913fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc91c0d0b40 0x7fc91c0cf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:03.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.455+0000 7fc91b7fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc91c0cd200 0x7fc91c0cd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:03.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.455+0000 7fc913fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc91c0d0b40 0x7fc91c0cf5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.84:54064/0 (socket says 172.21.15.84:54064) 2023-07-14T11:20:03.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.455+0000 7fc913fff700 1 -- 172.21.15.84:0/659243147 learned_addr learned my addr 172.21.15.84:0/659243147 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:20:03.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.455+0000 7fc913fff700 1 -- 172.21.15.84:0/659243147 >> v2:172.21.15.179:3300/0 conn(0x7fc91c0cd200 msgr2=0x7fc91c0cd5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:20:03.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.455+0000 7fc913fff700 1 --2- 172.21.15.84:0/659243147 >> v2:172.21.15.179:3300/0 conn(0x7fc91c0cd200 0x7fc91c0cd5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:03.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.455+0000 7fc913fff700 1 -- 172.21.15.84:0/659243147 >> v1:172.21.15.179:6789/0 conn(0x7fc91c0cfb30 legacy=0x7fc91c160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:03.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.455+0000 7fc913fff700 1 -- 172.21.15.84:0/659243147 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc91c15ce30 con 0x7fc91c0d0b40 2023-07-14T11:20:03.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.456+0000 7fc913fff700 1 --2- 172.21.15.84:0/659243147 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc91c0d0b40 0x7fc91c0cf5f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc9040098f0 tx=0x7fc904009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f62757a9c93f23c5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:03.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.456+0000 7fc91affd700 1 -- 172.21.15.84:0/659243147 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc904011830 con 0x7fc91c0d0b40 2023-07-14T11:20:03.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.456+0000 7fc91affd700 1 -- 172.21.15.84:0/659243147 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc904011990 con 0x7fc91c0d0b40 2023-07-14T11:20:03.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.456+0000 7fc91affd700 1 -- 172.21.15.84:0/659243147 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc904011d20 con 0x7fc91c0d0b40 2023-07-14T11:20:03.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.456+0000 7fc920d9d700 1 -- 172.21.15.84:0/659243147 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc91c0d0b40 msgr2=0x7fc91c0cf5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:03.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.456+0000 7fc920d9d700 1 --2- 172.21.15.84:0/659243147 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc91c0d0b40 0x7fc91c0cf5f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc9040098f0 tx=0x7fc904009c00 comp rx=0 tx=0).stop 2023-07-14T11:20:03.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.457+0000 7fc920d9d700 1 -- 172.21.15.84:0/659243147 shutdown_connections 2023-07-14T11:20:03.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.457+0000 7fc920d9d700 1 --2- 172.21.15.84:0/659243147 >> v2:172.21.15.179:3300/0 conn(0x7fc91c0cd200 0x7fc91c0cd5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:03.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.457+0000 7fc920d9d700 1 --2- 172.21.15.84:0/659243147 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc91c0d0b40 0x7fc91c0cf5f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:03.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.457+0000 7fc920d9d700 1 -- 172.21.15.84:0/659243147 >> 172.21.15.84:0/659243147 conn(0x7fc91c06a430 msgr2=0x7fc91c06a800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:20:03.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.457+0000 7fc920d9d700 1 -- 172.21.15.84:0/659243147 shutdown_connections 2023-07-14T11:20:03.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.457+0000 7fc920d9d700 1 -- 172.21.15.84:0/659243147 wait complete. 2023-07-14T11:20:03.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.458+0000 7fc920d9d700 1 Processor -- start 2023-07-14T11:20:03.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.458+0000 7fc920d9d700 1 -- start start 2023-07-14T11:20:03.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.459+0000 7fc920d9d700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc91c0cd200 0x7fc91c158f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:03.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.459+0000 7fc920d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc91c0cfb30 0x7fc91c0b6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:03.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.459+0000 7fc920d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc91c0d0b40 0x7fc91c0b6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:03.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.459+0000 7fc920d9d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc91c0b5590 con 0x7fc91c0d0b40 2023-07-14T11:20:03.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.459+0000 7fc920d9d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc91c0b52b0 con 0x7fc91c0cfb30 2023-07-14T11:20:03.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.459+0000 7fc920d9d700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc91c0b5ba0 con 0x7fc91c0cd200 2023-07-14T11:20:03.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.460+0000 7fc91bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc91c0d0b40 0x7fc91c0b6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:03.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.460+0000 7fc91b7fe700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc91c0cd200 0x7fc91c158f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:03.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.460+0000 7fc91bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc91c0d0b40 0x7fc91c0b6bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60118/0 (socket says 172.21.15.84:60118) 2023-07-14T11:20:03.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.460+0000 7fc913fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc91c0cfb30 0x7fc91c0b6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:03.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.460+0000 7fc91bfff700 1 -- 172.21.15.84:0/2061950924 learned_addr learned my addr 172.21.15.84:0/2061950924 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:20:03.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.460+0000 7fc91bfff700 1 -- 172.21.15.84:0/2061950924 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc91c0cd200 msgr2=0x7fc91c158f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:03.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.460+0000 7fc91bfff700 1 --2- 172.21.15.84:0/2061950924 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc91c0cd200 0x7fc91c158f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:03.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.460+0000 7fc91bfff700 1 -- 172.21.15.84:0/2061950924 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc91c0cfb30 msgr2=0x7fc91c0b6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:03.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.460+0000 7fc91bfff700 1 --2- 172.21.15.84:0/2061950924 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc91c0cfb30 0x7fc91c0b6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:03.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.460+0000 7fc91bfff700 1 -- 172.21.15.84:0/2061950924 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc904009550 con 0x7fc91c0d0b40 2023-07-14T11:20:03.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.460+0000 7fc91bfff700 1 --2- 172.21.15.84:0/2061950924 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc91c0d0b40 0x7fc91c0b6bc0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7fc91400cc50 tx=0x7fc91400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:03.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.460+0000 7fc918ff9700 1 -- 172.21.15.84:0/2061950924 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc914003c00 con 0x7fc91c0d0b40 2023-07-14T11:20:03.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.461+0000 7fc918ff9700 1 -- 172.21.15.84:0/2061950924 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc914003d60 con 0x7fc91c0d0b40 2023-07-14T11:20:03.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.461+0000 7fc918ff9700 1 -- 172.21.15.84:0/2061950924 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91400aab0 con 0x7fc91c0d0b40 2023-07-14T11:20:03.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.461+0000 7fc920d9d700 1 -- 172.21.15.84:0/2061950924 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc91c0b5e80 con 0x7fc91c0d0b40 2023-07-14T11:20:03.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.461+0000 7fc920d9d700 1 -- 172.21.15.84:0/2061950924 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc91c1f2820 con 0x7fc91c0d0b40 2023-07-14T11:20:03.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.462+0000 7fc920d9d700 1 -- 172.21.15.84:0/2061950924 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc91c04e210 con 0x7fc91c0d0b40 2023-07-14T11:20:03.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.463+0000 7fc918ff9700 1 -- 172.21.15.84:0/2061950924 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) v1 ==== 89190+0+0 (secure 0 0 0) 0x7fc91400ac10 con 0x7fc91c0d0b40 2023-07-14T11:20:03.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.464+0000 7fc918ff9700 1 --2- 172.21.15.84:0/2061950924 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fc8fc06ae90 0x7fc8fc06d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:03.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.464+0000 7fc918ff9700 1 -- 172.21.15.84:0/2061950924 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fc914089450 con 0x7fc91c0d0b40 2023-07-14T11:20:03.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.464+0000 7fc91b7fe700 1 --2- 172.21.15.84:0/2061950924 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fc8fc06ae90 0x7fc8fc06d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:03.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.465+0000 7fc91b7fe700 1 --2- 172.21.15.84:0/2061950924 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fc8fc06ae90 0x7fc8fc06d340 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc90c009b40 tx=0x7fc90c009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:03.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.469+0000 7fc918ff9700 1 -- 172.21.15.84:0/2061950924 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fc914054590 con 0x7fc91c0d0b40 2023-07-14T11:20:03.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.662+0000 7fc920d9d700 1 -- 172.21.15.84:0/2061950924 --> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fc91c15d3f0 con 0x7fc8fc06ae90 2023-07-14T11:20:03.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.663+0000 7fc918ff9700 1 -- 172.21.15.84:0/2061950924 <== mgr.4100 v2:172.21.15.179:6836/2094253834 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc90c004020 con 0x7fc8fc06ae90 2023-07-14T11:20:03.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.665+0000 7fc920d9d700 1 -- 172.21.15.84:0/2061950924 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fc8fc06ae90 msgr2=0x7fc8fc06d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:03.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.665+0000 7fc920d9d700 1 --2- 172.21.15.84:0/2061950924 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fc8fc06ae90 0x7fc8fc06d340 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc90c009b40 tx=0x7fc90c009210 comp rx=0 tx=0).stop 2023-07-14T11:20:03.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.665+0000 7fc920d9d700 1 -- 172.21.15.84:0/2061950924 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc91c0d0b40 msgr2=0x7fc91c0b6bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:03.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.665+0000 7fc920d9d700 1 --2- 172.21.15.84:0/2061950924 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc91c0d0b40 0x7fc91c0b6bc0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7fc91400cc50 tx=0x7fc91400cf60 comp rx=0 tx=0).stop 2023-07-14T11:20:03.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.665+0000 7fc920d9d700 1 -- 172.21.15.84:0/2061950924 shutdown_connections 2023-07-14T11:20:03.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.665+0000 7fc920d9d700 1 --2- 172.21.15.84:0/2061950924 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fc8fc06ae90 0x7fc8fc06d340 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:03.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.665+0000 7fc920d9d700 1 --2- 172.21.15.84:0/2061950924 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc91c0cd200 0x7fc91c158f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:03.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.665+0000 7fc920d9d700 1 --2- 172.21.15.84:0/2061950924 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc91c0d0b40 0x7fc91c0b6bc0 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:03.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.665+0000 7fc920d9d700 1 --2- 172.21.15.84:0/2061950924 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc91c0cfb30 0x7fc91c0b6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:03.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.665+0000 7fc920d9d700 1 -- 172.21.15.84:0/2061950924 >> 172.21.15.84:0/2061950924 conn(0x7fc91c06a430 msgr2=0x7fc91c15af00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:20:03.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.666+0000 7fc920d9d700 1 -- 172.21.15.84:0/2061950924 shutdown_connections 2023-07-14T11:20:03.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.666+0000 7fc920d9d700 1 -- 172.21.15.84:0/2061950924 wait complete. 2023-07-14T11:20:03.671 INFO:teuthology.orchestra.run.smithi084.stderr:instructed osd(s) 0 to deep-scrub 2023-07-14T11:20:03.686 INFO:tasks.ceph:Scrubbing osd.1 2023-07-14T11:20:03.686 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-07-14T11:20:03.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.882+0000 7f4f92fff700 1 Processor -- start 2023-07-14T11:20:03.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.882+0000 7f4f92fff700 1 -- start start 2023-07-14T11:20:03.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.883+0000 7f4f92fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f8c06b750 0x7f4f8c0cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:03.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.883+0000 7f4f92fff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f8c0cd410 con 0x7f4f8c0cba30 2023-07-14T11:20:03.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.883+0000 7f4f92fff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f8c0cce50 con 0x7f4f8c0cc340 2023-07-14T11:20:03.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.883+0000 7f4f92fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8c0cd130 con 0x7f4f8c06b750 2023-07-14T11:20:03.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.884+0000 7f4f90d9b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f4f8c0cba30 0x7f4f8c06b040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49472/0 (socket says 172.21.15.84:49472) 2023-07-14T11:20:03.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.884+0000 7f4f90d9b700 1 -- 172.21.15.84:0/2576423333 learned_addr learned my addr 172.21.15.84:0/2576423333 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:20:03.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.884+0000 7f4f8bfff700 1 --2- 172.21.15.84:0/2576423333 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f8c06b750 0x7f4f8c0cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:03.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.884+0000 7f4f8b7fe700 1 -- 172.21.15.84:0/2576423333 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 422239376 0 0) 0x7f4f8c0cd410 con 0x7f4f8c0cba30 2023-07-14T11:20:03.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.884+0000 7f4f8b7fe700 1 -- 172.21.15.84:0/2576423333 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f7c0035b0 con 0x7f4f8c0cba30 2023-07-14T11:20:03.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.884+0000 7f4f8b7fe700 1 -- 172.21.15.84:0/2576423333 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3314359379 0 0) 0x7f4f8c0cce50 con 0x7f4f8c0cc340 2023-07-14T11:20:03.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.884+0000 7f4f8bfff700 1 -- 172.21.15.84:0/2576423333 >> v1:172.21.15.179:6789/0 conn(0x7f4f8c0cc340 legacy=0x7f4f8c0cf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:03.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.884+0000 7f4f8bfff700 1 -- 172.21.15.84:0/2576423333 >> v1:172.21.15.84:6789/0 conn(0x7f4f8c0cba30 legacy=0x7f4f8c06b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:03.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.885+0000 7f4f8bfff700 1 -- 172.21.15.84:0/2576423333 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f8c0ce8f0 con 0x7f4f8c06b750 2023-07-14T11:20:03.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.885+0000 7f4f8bfff700 1 --2- 172.21.15.84:0/2576423333 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f8c06b750 0x7f4f8c0cbe00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4f78009870 tx=0x7f4f78009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8687aa4d4f5ef6cb server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:03.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.885+0000 7f4f8b7fe700 1 -- 172.21.15.84:0/2576423333 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f800017f0 con 0x7f4f8c06b750 2023-07-14T11:20:03.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.885+0000 7f4f8b7fe700 1 -- 172.21.15.84:0/2576423333 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f78004030 con 0x7f4f8c06b750 2023-07-14T11:20:03.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.885+0000 7f4f8b7fe700 1 -- 172.21.15.84:0/2576423333 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f780043c0 con 0x7f4f8c06b750 2023-07-14T11:20:03.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.886+0000 7f4f92fff700 1 -- 172.21.15.84:0/2576423333 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f8c06b750 msgr2=0x7f4f8c0cbe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:03.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.886+0000 7f4f92fff700 1 --2- 172.21.15.84:0/2576423333 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f8c06b750 0x7f4f8c0cbe00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4f78009870 tx=0x7f4f78009b80 comp rx=0 tx=0).stop 2023-07-14T11:20:03.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.886+0000 7f4f92fff700 1 -- 172.21.15.84:0/2576423333 shutdown_connections 2023-07-14T11:20:03.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.886+0000 7f4f92fff700 1 --2- 172.21.15.84:0/2576423333 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f8c06b750 0x7f4f8c0cbe00 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:03.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.886+0000 7f4f92fff700 1 -- 172.21.15.84:0/2576423333 >> 172.21.15.84:0/2576423333 conn(0x7f4f8c099f40 msgr2=0x7f4f8c0d0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:20:03.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.886+0000 7f4f92fff700 1 -- 172.21.15.84:0/2576423333 shutdown_connections 2023-07-14T11:20:03.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.886+0000 7f4f92fff700 1 -- 172.21.15.84:0/2576423333 wait complete. 2023-07-14T11:20:03.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.888+0000 7f4f92fff700 1 Processor -- start 2023-07-14T11:20:03.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.888+0000 7f4f92fff700 1 -- start start 2023-07-14T11:20:03.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.889+0000 7f4f92fff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f8c06b750 0x7f4f8c0cac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:03.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.889+0000 7f4f92fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f8c0cba30 0x7f4f8c15a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:03.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.889+0000 7f4f92fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f8c0cc340 0x7f4f8c1e4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:03.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.889+0000 7f4f92fff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8c1f2110 con 0x7f4f8c0cba30 2023-07-14T11:20:03.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.889+0000 7f4f92fff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8c15aa10 con 0x7f4f8c0cc340 2023-07-14T11:20:03.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.889+0000 7f4f92fff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8c1f1e00 con 0x7f4f8c06b750 2023-07-14T11:20:03.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.889+0000 7f4f8bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f8c0cba30 0x7f4f8c15a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:03.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.889+0000 7f4f8bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f8c0cba30 0x7f4f8c15a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60122/0 (socket says 172.21.15.84:60122) 2023-07-14T11:20:03.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.889+0000 7f4f8bfff700 1 -- 172.21.15.84:0/990266665 learned_addr learned my addr 172.21.15.84:0/990266665 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:20:03.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.889+0000 7f4f90d9b700 1 --2- 172.21.15.84:0/990266665 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f8c06b750 0x7f4f8c0cac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:03.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.889+0000 7f4f9159c700 1 --2- 172.21.15.84:0/990266665 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f8c0cc340 0x7f4f8c1e4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:03.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.889+0000 7f4f8bfff700 1 -- 172.21.15.84:0/990266665 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f8c06b750 msgr2=0x7f4f8c0cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:03.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.889+0000 7f4f8bfff700 1 --2- 172.21.15.84:0/990266665 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f8c06b750 0x7f4f8c0cac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:03.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.889+0000 7f4f8bfff700 1 -- 172.21.15.84:0/990266665 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f8c0cc340 msgr2=0x7f4f8c1e4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:03.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.889+0000 7f4f8bfff700 1 --2- 172.21.15.84:0/990266665 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f8c0cc340 0x7f4f8c1e4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:03.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.889+0000 7f4f8bfff700 1 -- 172.21.15.84:0/990266665 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f780094a0 con 0x7f4f8c0cba30 2023-07-14T11:20:03.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.890+0000 7f4f8bfff700 1 --2- 172.21.15.84:0/990266665 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f8c0cba30 0x7f4f8c15a4d0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f4f78009ed0 tx=0x7f4f78004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:03.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.890+0000 7f4f897fa700 1 -- 172.21.15.84:0/990266665 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f78010590 con 0x7f4f8c0cba30 2023-07-14T11:20:03.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.890+0000 7f4f897fa700 1 -- 172.21.15.84:0/990266665 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f780106f0 con 0x7f4f8c0cba30 2023-07-14T11:20:03.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.890+0000 7f4f92fff700 1 -- 172.21.15.84:0/990266665 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f8c1e3cb0 con 0x7f4f8c0cba30 2023-07-14T11:20:03.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.890+0000 7f4f897fa700 1 -- 172.21.15.84:0/990266665 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f78010aa0 con 0x7f4f8c0cba30 2023-07-14T11:20:03.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.890+0000 7f4f92fff700 1 -- 172.21.15.84:0/990266665 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f8c1e4230 con 0x7f4f8c0cba30 2023-07-14T11:20:03.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.891+0000 7f4f92fff700 1 -- 172.21.15.84:0/990266665 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4f8c0cebd0 con 0x7f4f8c0cba30 2023-07-14T11:20:03.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.892+0000 7f4f897fa700 1 -- 172.21.15.84:0/990266665 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f4f78010c00 con 0x7f4f8c0cba30 2023-07-14T11:20:03.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.893+0000 7f4f897fa700 1 --2- 172.21.15.84:0/990266665 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f4f7006ae90 0x7f4f7006d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:03.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.893+0000 7f4f897fa700 1 -- 172.21.15.84:0/990266665 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f4f7808abc0 con 0x7f4f8c0cba30 2023-07-14T11:20:03.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.893+0000 7f4f897fa700 1 --2- 172.21.15.84:0/990266665 >> [v2:172.21.15.84:6824/1060220522,v1:172.21.15.84:6825/1060220522] conn(0x7f4f70071300 0x7f4f70073710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:03.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.893+0000 7f4f897fa700 1 -- 172.21.15.84:0/990266665 --> [v2:172.21.15.84:6824/1060220522,v1:172.21.15.84:6825/1060220522] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4f70073de0 con 0x7f4f70071300 2023-07-14T11:20:03.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.893+0000 7f4f897fa700 1 -- 172.21.15.84:0/990266665 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=109) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f7808f2a0 con 0x7f4f8c0cba30 2023-07-14T11:20:03.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.894+0000 7f4f90d9b700 1 --2- 172.21.15.84:0/990266665 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f4f7006ae90 0x7f4f7006d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:03.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.894+0000 7f4f9159c700 1 --2- 172.21.15.84:0/990266665 >> [v2:172.21.15.84:6824/1060220522,v1:172.21.15.84:6825/1060220522] conn(0x7f4f70071300 0x7f4f70073710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:03.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.894+0000 7f4f9159c700 1 --2- 172.21.15.84:0/990266665 >> [v2:172.21.15.84:6824/1060220522,v1:172.21.15.84:6825/1060220522] conn(0x7f4f70071300 0x7f4f70073710 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:03.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.894+0000 7f4f90d9b700 1 --2- 172.21.15.84:0/990266665 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f4f7006ae90 0x7f4f7006d340 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4f80001920 tx=0x7f4f80001e30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:03.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.895+0000 7f4f897fa700 1 -- 172.21.15.84:0/990266665 <== osd.1 v2:172.21.15.84:6824/1060220522 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f4f70073de0 con 0x7f4f70071300 2023-07-14T11:20:03.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.910+0000 7f4f92fff700 1 -- 172.21.15.84:0/990266665 --> [v2:172.21.15.84:6824/1060220522,v1:172.21.15.84:6825/1060220522] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4f8c074350 con 0x7f4f70071300 2023-07-14T11:20:03.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.910+0000 7f4f897fa700 1 -- 172.21.15.84:0/990266665 <== osd.1 v2:172.21.15.84:6824/1060220522 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f4f8c074350 con 0x7f4f70071300 2023-07-14T11:20:03.913 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-07-14T11:20:03.913 INFO:teuthology.orchestra.run.smithi084.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-14T11:20:03.913 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-07-14T11:20:03.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.910+0000 7f4f92fff700 1 -- 172.21.15.84:0/990266665 >> [v2:172.21.15.84:6824/1060220522,v1:172.21.15.84:6825/1060220522] conn(0x7f4f70071300 msgr2=0x7f4f70073710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:03.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.910+0000 7f4f92fff700 1 --2- 172.21.15.84:0/990266665 >> [v2:172.21.15.84:6824/1060220522,v1:172.21.15.84:6825/1060220522] conn(0x7f4f70071300 0x7f4f70073710 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:03.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.910+0000 7f4f92fff700 1 -- 172.21.15.84:0/990266665 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f4f7006ae90 msgr2=0x7f4f7006d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:03.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.910+0000 7f4f92fff700 1 --2- 172.21.15.84:0/990266665 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f4f7006ae90 0x7f4f7006d340 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4f80001920 tx=0x7f4f80001e30 comp rx=0 tx=0).stop 2023-07-14T11:20:03.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.910+0000 7f4f92fff700 1 -- 172.21.15.84:0/990266665 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f8c0cba30 msgr2=0x7f4f8c15a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:03.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.910+0000 7f4f92fff700 1 --2- 172.21.15.84:0/990266665 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f8c0cba30 0x7f4f8c15a4d0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f4f78009ed0 tx=0x7f4f78004750 comp rx=0 tx=0).stop 2023-07-14T11:20:03.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.910+0000 7f4f9159c700 1 -- 172.21.15.84:0/990266665 reap_dead start 2023-07-14T11:20:03.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.911+0000 7f4f92fff700 1 -- 172.21.15.84:0/990266665 shutdown_connections 2023-07-14T11:20:03.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.911+0000 7f4f92fff700 1 -- 172.21.15.84:0/990266665 >> 172.21.15.84:0/990266665 conn(0x7f4f8c099f40 msgr2=0x7f4f8c06da00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:20:03.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.911+0000 7f4f92fff700 1 -- 172.21.15.84:0/990266665 shutdown_connections 2023-07-14T11:20:03.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:03.911+0000 7f4f92fff700 1 -- 172.21.15.84:0/990266665 wait complete. 2023-07-14T11:20:03.930 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-07-14T11:20:04.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.125+0000 7f9c481ff700 1 Processor -- start 2023-07-14T11:20:04.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.126+0000 7f9c481ff700 1 -- start start 2023-07-14T11:20:04.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.127+0000 7f9c481ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9c400d0b10 0x7f9c400d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:04.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.127+0000 7f9c481ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9c400b0e20 0x7f9c400b1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:04.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.127+0000 7f9c481ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c400b8e30 con 0x7f9c400b8a60 2023-07-14T11:20:04.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.127+0000 7f9c481ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c400d14d0 con 0x7f9c400d0b10 2023-07-14T11:20:04.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.127+0000 7f9c481ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c400afaa0 con 0x7f9c400b0e20 2023-07-14T11:20:04.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.127+0000 7f9c4579a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9c400d0b10 0x7f9c400d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:04.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.127+0000 7f9c4579a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9c400d0b10 0x7f9c400d0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60136/0 (socket says 172.21.15.84:60136) 2023-07-14T11:20:04.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.127+0000 7f9c4579a700 1 -- 172.21.15.84:0/2991540617 learned_addr learned my addr 172.21.15.84:0/2991540617 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:20:04.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.127+0000 7f9c4679c700 1 --2- 172.21.15.84:0/2991540617 >> v2:172.21.15.179:3300/0 conn(0x7f9c400b0e20 0x7f9c400b1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:04.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.127+0000 7f9c4579a700 1 -- 172.21.15.84:0/2991540617 >> v2:172.21.15.179:3300/0 conn(0x7f9c400b0e20 msgr2=0x7f9c400b1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:20:04.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.127+0000 7f9c4579a700 1 --2- 172.21.15.84:0/2991540617 >> v2:172.21.15.179:3300/0 conn(0x7f9c400b0e20 0x7f9c400b1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:04.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.127+0000 7f9c4579a700 1 -- 172.21.15.84:0/2991540617 >> v1:172.21.15.179:6789/0 conn(0x7f9c400b8a60 legacy=0x7f9c400b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:20:04.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.128+0000 7f9c4579a700 1 -- 172.21.15.84:0/2991540617 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c400afd80 con 0x7f9c400d0b10 2023-07-14T11:20:04.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.128+0000 7f9c4579a700 1 --2- 172.21.15.84:0/2991540617 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c400d0b10 0x7f9c400d0f90 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f9c400674e0 tx=0x7f9c30009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93127634f5d56b2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:04.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.128+0000 7f9c44f99700 1 -- 172.21.15.84:0/2991540617 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c30004230 con 0x7f9c400d0b10 2023-07-14T11:20:04.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.128+0000 7f9c44f99700 1 -- 172.21.15.84:0/2991540617 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c30004390 con 0x7f9c400d0b10 2023-07-14T11:20:04.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.128+0000 7f9c44f99700 1 -- 172.21.15.84:0/2991540617 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c300036a0 con 0x7f9c400d0b10 2023-07-14T11:20:04.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.128+0000 7f9c481ff700 1 -- 172.21.15.84:0/2991540617 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c400d0b10 msgr2=0x7f9c400d0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:04.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.128+0000 7f9c481ff700 1 --2- 172.21.15.84:0/2991540617 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c400d0b10 0x7f9c400d0f90 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f9c400674e0 tx=0x7f9c30009bd0 comp rx=0 tx=0).stop 2023-07-14T11:20:04.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.129+0000 7f9c481ff700 1 -- 172.21.15.84:0/2991540617 shutdown_connections 2023-07-14T11:20:04.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.129+0000 7f9c481ff700 1 --2- 172.21.15.84:0/2991540617 >> v2:172.21.15.179:3300/0 conn(0x7f9c400b0e20 0x7f9c400b1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:04.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.129+0000 7f9c481ff700 1 --2- 172.21.15.84:0/2991540617 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c400d0b10 0x7f9c400d0f90 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:04.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.129+0000 7f9c481ff700 1 -- 172.21.15.84:0/2991540617 >> 172.21.15.84:0/2991540617 conn(0x7f9c4009c1b0 msgr2=0x7f9c400d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:20:04.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.129+0000 7f9c481ff700 1 -- 172.21.15.84:0/2991540617 shutdown_connections 2023-07-14T11:20:04.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.129+0000 7f9c481ff700 1 -- 172.21.15.84:0/2991540617 wait complete. 2023-07-14T11:20:04.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.130+0000 7f9c481ff700 1 Processor -- start 2023-07-14T11:20:04.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.131+0000 7f9c481ff700 1 -- start start 2023-07-14T11:20:04.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.131+0000 7f9c481ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c400b0e20 0x7f9c40151350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:04.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.131+0000 7f9c481ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c400b8a60 0x7f9c401f1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:04.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.132+0000 7f9c481ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c400d0b10 0x7f9c4015f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:04.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.132+0000 7f9c481ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c400cb8a0 con 0x7f9c400b8a60 2023-07-14T11:20:04.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.132+0000 7f9c481ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c401f2e70 con 0x7f9c400d0b10 2023-07-14T11:20:04.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.132+0000 7f9c481ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c400cb270 con 0x7f9c400b0e20 2023-07-14T11:20:04.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.132+0000 7f9c4579a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c400b8a60 0x7f9c401f1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:04.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.132+0000 7f9c4579a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c400b8a60 0x7f9c401f1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60138/0 (socket says 172.21.15.84:60138) 2023-07-14T11:20:04.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.132+0000 7f9c4579a700 1 -- 172.21.15.84:0/3748201224 learned_addr learned my addr 172.21.15.84:0/3748201224 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:20:04.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.132+0000 7f9c45f9b700 1 --2- 172.21.15.84:0/3748201224 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c400b0e20 0x7f9c40151350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:04.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.132+0000 7f9c4579a700 1 -- 172.21.15.84:0/3748201224 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c400b0e20 msgr2=0x7f9c40151350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:04.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.132+0000 7f9c4579a700 1 --2- 172.21.15.84:0/3748201224 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c400b0e20 0x7f9c40151350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:04.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.132+0000 7f9c4579a700 1 -- 172.21.15.84:0/3748201224 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c400d0b10 msgr2=0x7f9c4015f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:04.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.132+0000 7f9c4679c700 1 --2- 172.21.15.84:0/3748201224 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c400d0b10 0x7f9c4015f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:04.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.132+0000 7f9c4579a700 1 --2- 172.21.15.84:0/3748201224 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c400d0b10 0x7f9c4015f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:04.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.132+0000 7f9c4579a700 1 -- 172.21.15.84:0/3748201224 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c30009550 con 0x7f9c400b8a60 2023-07-14T11:20:04.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.132+0000 7f9c4679c700 1 --2- 172.21.15.84:0/3748201224 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c400d0b10 0x7f9c4015f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:20:04.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.132+0000 7f9c4579a700 1 --2- 172.21.15.84:0/3748201224 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c400b8a60 0x7f9c401f1cb0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f9c30009130 tx=0x7f9c30004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:04.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.133+0000 7f9c367fc700 1 -- 172.21.15.84:0/3748201224 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c30011630 con 0x7f9c400b8a60 2023-07-14T11:20:04.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.133+0000 7f9c367fc700 1 -- 172.21.15.84:0/3748201224 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c30011790 con 0x7f9c400b8a60 2023-07-14T11:20:04.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.133+0000 7f9c481ff700 1 -- 172.21.15.84:0/3748201224 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c401f27a0 con 0x7f9c400b8a60 2023-07-14T11:20:04.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.133+0000 7f9c367fc700 1 -- 172.21.15.84:0/3748201224 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c30011b40 con 0x7f9c400b8a60 2023-07-14T11:20:04.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.133+0000 7f9c481ff700 1 -- 172.21.15.84:0/3748201224 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c400cb4c0 con 0x7f9c400b8a60 2023-07-14T11:20:04.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.134+0000 7f9c481ff700 1 -- 172.21.15.84:0/3748201224 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c400cb9e0 con 0x7f9c400b8a60 2023-07-14T11:20:04.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.135+0000 7f9c367fc700 1 -- 172.21.15.84:0/3748201224 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f9c30011ca0 con 0x7f9c400b8a60 2023-07-14T11:20:04.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.136+0000 7f9c367fc700 1 --2- 172.21.15.84:0/3748201224 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f9c2406ae90 0x7f9c2406d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:04.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.136+0000 7f9c367fc700 1 -- 172.21.15.84:0/3748201224 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f9c3008aad0 con 0x7f9c400b8a60 2023-07-14T11:20:04.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.136+0000 7f9c45f9b700 1 --2- 172.21.15.84:0/3748201224 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f9c2406ae90 0x7f9c2406d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:04.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.137+0000 7f9c45f9b700 1 --2- 172.21.15.84:0/3748201224 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f9c2406ae90 0x7f9c2406d340 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c007fd0 tx=0x7f9c3c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:04.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.140+0000 7f9c367fc700 1 -- 172.21.15.84:0/3748201224 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f9c400cb9e0 con 0x7f9c400b8a60 2023-07-14T11:20:04.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.332+0000 7f9c481ff700 1 -- 172.21.15.84:0/3748201224 --> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f9c400b0340 con 0x7f9c2406ae90 2023-07-14T11:20:04.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.333+0000 7f9c367fc700 1 -- 172.21.15.84:0/3748201224 <== mgr.4100 v2:172.21.15.179:6836/2094253834 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f9c3c014420 con 0x7f9c2406ae90 2023-07-14T11:20:04.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.335+0000 7f9c481ff700 1 -- 172.21.15.84:0/3748201224 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f9c2406ae90 msgr2=0x7f9c2406d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:04.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.335+0000 7f9c481ff700 1 --2- 172.21.15.84:0/3748201224 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f9c2406ae90 0x7f9c2406d340 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c007fd0 tx=0x7f9c3c009040 comp rx=0 tx=0).stop 2023-07-14T11:20:04.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.335+0000 7f9c481ff700 1 -- 172.21.15.84:0/3748201224 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c400b8a60 msgr2=0x7f9c401f1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:04.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.335+0000 7f9c481ff700 1 --2- 172.21.15.84:0/3748201224 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c400b8a60 0x7f9c401f1cb0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f9c30009130 tx=0x7f9c30004750 comp rx=0 tx=0).stop 2023-07-14T11:20:04.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.335+0000 7f9c481ff700 1 -- 172.21.15.84:0/3748201224 shutdown_connections 2023-07-14T11:20:04.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.335+0000 7f9c481ff700 1 --2- 172.21.15.84:0/3748201224 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f9c2406ae90 0x7f9c2406d340 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:04.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.335+0000 7f9c481ff700 1 --2- 172.21.15.84:0/3748201224 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c400b0e20 0x7f9c40151350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:04.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.335+0000 7f9c481ff700 1 --2- 172.21.15.84:0/3748201224 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c400d0b10 0x7f9c4015f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:04.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.335+0000 7f9c481ff700 1 --2- 172.21.15.84:0/3748201224 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c400b8a60 0x7f9c401f1cb0 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:04.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.335+0000 7f9c481ff700 1 -- 172.21.15.84:0/3748201224 >> 172.21.15.84:0/3748201224 conn(0x7f9c4009c1b0 msgr2=0x7f9c4006b630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:20:04.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.336+0000 7f9c481ff700 1 -- 172.21.15.84:0/3748201224 shutdown_connections 2023-07-14T11:20:04.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.336+0000 7f9c481ff700 1 -- 172.21.15.84:0/3748201224 wait complete. 2023-07-14T11:20:04.341 INFO:teuthology.orchestra.run.smithi084.stderr:instructed osd(s) 1 to deep-scrub 2023-07-14T11:20:04.356 INFO:tasks.ceph:Scrubbing osd.2 2023-07-14T11:20:04.357 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-07-14T11:20:04.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.553+0000 7f4b1ffff700 1 Processor -- start 2023-07-14T11:20:04.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.554+0000 7f4b1ffff700 1 -- start start 2023-07-14T11:20:04.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.555+0000 7f4b1ffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4b1815c890 0x7f4b180d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:04.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.555+0000 7f4b1ffff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4b1806c240 0x7f4b180d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:04.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.555+0000 7f4b1ffff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b1815cc60 con 0x7f4b180b2440 2023-07-14T11:20:04.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.555+0000 7f4b1ffff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b1806a7f0 con 0x7f4b1815c890 2023-07-14T11:20:04.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.555+0000 7f4b1ffff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b1806b760 con 0x7f4b1806c240 2023-07-14T11:20:04.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.555+0000 7f4b1dd9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4b1815c890 0x7f4b180d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:04.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.555+0000 7f4b1dd9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4b1815c890 0x7f4b180d0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60154/0 (socket says 172.21.15.84:60154) 2023-07-14T11:20:04.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.555+0000 7f4b1dd9b700 1 -- 172.21.15.84:0/2047395009 learned_addr learned my addr 172.21.15.84:0/2047395009 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:20:04.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.555+0000 7f4b1e59c700 1 --2- 172.21.15.84:0/2047395009 >> v2:172.21.15.179:3300/0 conn(0x7f4b1806c240 0x7f4b180d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:04.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.556+0000 7f4b1dd9b700 1 -- 172.21.15.84:0/2047395009 >> v2:172.21.15.179:3300/0 conn(0x7f4b1806c240 msgr2=0x7f4b180d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:20:04.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.556+0000 7f4b1dd9b700 1 --2- 172.21.15.84:0/2047395009 >> v2:172.21.15.179:3300/0 conn(0x7f4b1806c240 0x7f4b180d0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:04.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.556+0000 7f4b1dd9b700 1 -- 172.21.15.84:0/2047395009 >> v1:172.21.15.84:6789/0 conn(0x7f4b180b2440 legacy=0x7f4b180cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:04.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.556+0000 7f4b1dd9b700 1 -- 172.21.15.84:0/2047395009 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b1806ba40 con 0x7f4b1815c890 2023-07-14T11:20:04.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.556+0000 7f4b1cd99700 1 -- 172.21.15.84:0/2047395009 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3216028995 0 0) 0x7f4b1815cc60 con 0x7f4b180b2440 2023-07-14T11:20:04.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.556+0000 7f4b1dd9b700 1 --2- 172.21.15.84:0/2047395009 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b1815c890 0x7f4b180d0a50 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f4b140098f0 tx=0x7f4b14009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=223e8a5fe6e75d5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:04.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.556+0000 7f4b1cd99700 1 -- 172.21.15.84:0/2047395009 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1400b860 con 0x7f4b1815c890 2023-07-14T11:20:04.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.556+0000 7f4b1cd99700 1 -- 172.21.15.84:0/2047395009 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b1400b9c0 con 0x7f4b1815c890 2023-07-14T11:20:04.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.556+0000 7f4b1cd99700 1 -- 172.21.15.84:0/2047395009 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1400bd50 con 0x7f4b1815c890 2023-07-14T11:20:04.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.557+0000 7f4b1ffff700 1 -- 172.21.15.84:0/2047395009 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b1815c890 msgr2=0x7f4b180d0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:04.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.557+0000 7f4b1ffff700 1 --2- 172.21.15.84:0/2047395009 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b1815c890 0x7f4b180d0a50 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f4b140098f0 tx=0x7f4b14009c00 comp rx=0 tx=0).stop 2023-07-14T11:20:04.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.557+0000 7f4b1ffff700 1 -- 172.21.15.84:0/2047395009 shutdown_connections 2023-07-14T11:20:04.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.557+0000 7f4b1ffff700 1 --2- 172.21.15.84:0/2047395009 >> v2:172.21.15.179:3300/0 conn(0x7f4b1806c240 0x7f4b180d0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:04.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.557+0000 7f4b1ffff700 1 --2- 172.21.15.84:0/2047395009 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b1815c890 0x7f4b180d0a50 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:04.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.557+0000 7f4b1ffff700 1 -- 172.21.15.84:0/2047395009 >> 172.21.15.84:0/2047395009 conn(0x7f4b1809c170 msgr2=0x7f4b180d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:20:04.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.557+0000 7f4b1ffff700 1 -- 172.21.15.84:0/2047395009 shutdown_connections 2023-07-14T11:20:04.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.557+0000 7f4b1ffff700 1 -- 172.21.15.84:0/2047395009 wait complete. 2023-07-14T11:20:04.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.558+0000 7f4b1ffff700 1 Processor -- start 2023-07-14T11:20:04.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.559+0000 7f4b1ffff700 1 -- start start 2023-07-14T11:20:04.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.559+0000 7f4b1ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b1806c240 0x7f4b181567a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:04.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.559+0000 7f4b1ffff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b180b2440 0x7f4b180b4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:04.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.559+0000 7f4b1ffff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b1815c890 0x7f4b181f17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:04.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.559+0000 7f4b1ffff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b18155a20 con 0x7f4b1806c240 2023-07-14T11:20:04.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.559+0000 7f4b1ffff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b181f6720 con 0x7f4b1815c890 2023-07-14T11:20:04.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.559+0000 7f4b1ffff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b18155cc0 con 0x7f4b180b2440 2023-07-14T11:20:04.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.560+0000 7f4b1dd9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b1806c240 0x7f4b181567a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:04.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.560+0000 7f4b1dd9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b1806c240 0x7f4b181567a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60170/0 (socket says 172.21.15.84:60170) 2023-07-14T11:20:04.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.560+0000 7f4b1dd9b700 1 -- 172.21.15.84:0/4133341913 learned_addr learned my addr 172.21.15.84:0/4133341913 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:20:04.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.560+0000 7f4b1d59a700 1 --2- 172.21.15.84:0/4133341913 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b180b2440 0x7f4b180b4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:04.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.560+0000 7f4b1e59c700 1 --2- 172.21.15.84:0/4133341913 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b1815c890 0x7f4b181f17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:04.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.560+0000 7f4b1dd9b700 1 -- 172.21.15.84:0/4133341913 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b180b2440 msgr2=0x7f4b180b4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:04.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.560+0000 7f4b1dd9b700 1 --2- 172.21.15.84:0/4133341913 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b180b2440 0x7f4b180b4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:04.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.560+0000 7f4b1dd9b700 1 -- 172.21.15.84:0/4133341913 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b1815c890 msgr2=0x7f4b181f17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:04.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.560+0000 7f4b1dd9b700 1 --2- 172.21.15.84:0/4133341913 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b1815c890 0x7f4b181f17f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:04.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.560+0000 7f4b1dd9b700 1 -- 172.21.15.84:0/4133341913 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b14009550 con 0x7f4b1806c240 2023-07-14T11:20:04.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.560+0000 7f4b1d59a700 1 --2- 172.21.15.84:0/4133341913 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b180b2440 0x7f4b180b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:20:04.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.560+0000 7f4b1dd9b700 1 --2- 172.21.15.84:0/4133341913 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b1806c240 0x7f4b181567a0 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f4b1806a120 tx=0x7f4b14004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:04.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.561+0000 7f4b0e7fc700 1 -- 172.21.15.84:0/4133341913 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b14004400 con 0x7f4b1806c240 2023-07-14T11:20:04.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.561+0000 7f4b0e7fc700 1 -- 172.21.15.84:0/4133341913 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b1401f070 con 0x7f4b1806c240 2023-07-14T11:20:04.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.561+0000 7f4b1ffff700 1 -- 172.21.15.84:0/4133341913 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b18155fa0 con 0x7f4b1806c240 2023-07-14T11:20:04.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.561+0000 7f4b0e7fc700 1 -- 172.21.15.84:0/4133341913 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b140038c0 con 0x7f4b1806c240 2023-07-14T11:20:04.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.561+0000 7f4b1ffff700 1 -- 172.21.15.84:0/4133341913 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b180b4640 con 0x7f4b1806c240 2023-07-14T11:20:04.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.561+0000 7f4b1ffff700 1 -- 172.21.15.84:0/4133341913 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4b1806bd20 con 0x7f4b1806c240 2023-07-14T11:20:04.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.563+0000 7f4b0e7fc700 1 -- 172.21.15.84:0/4133341913 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f4b14021030 con 0x7f4b1806c240 2023-07-14T11:20:04.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.564+0000 7f4b0e7fc700 1 --2- 172.21.15.84:0/4133341913 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f4afc06ae90 0x7f4afc06d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:04.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.564+0000 7f4b0e7fc700 1 -- 172.21.15.84:0/4133341913 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f4b1408afa0 con 0x7f4b1806c240 2023-07-14T11:20:04.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.564+0000 7f4b0e7fc700 1 --2- 172.21.15.84:0/4133341913 >> [v2:172.21.15.84:6800/3001671542,v1:172.21.15.84:6801/3001671542] conn(0x7f4afc071300 0x7f4afc073710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:04.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.564+0000 7f4b0e7fc700 1 -- 172.21.15.84:0/4133341913 --> [v2:172.21.15.84:6800/3001671542,v1:172.21.15.84:6801/3001671542] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4afc073de0 con 0x7f4afc071300 2023-07-14T11:20:04.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.564+0000 7f4b0e7fc700 1 -- 172.21.15.84:0/4133341913 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=109) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4b1408b310 con 0x7f4b1806c240 2023-07-14T11:20:04.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.564+0000 7f4b1e59c700 1 --2- 172.21.15.84:0/4133341913 >> [v2:172.21.15.84:6800/3001671542,v1:172.21.15.84:6801/3001671542] conn(0x7f4afc071300 0x7f4afc073710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:04.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.564+0000 7f4b1d59a700 1 --2- 172.21.15.84:0/4133341913 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f4afc06ae90 0x7f4afc06d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:04.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.565+0000 7f4b1e59c700 1 --2- 172.21.15.84:0/4133341913 >> [v2:172.21.15.84:6800/3001671542,v1:172.21.15.84:6801/3001671542] conn(0x7f4afc071300 0x7f4afc073710 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:04.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.565+0000 7f4b1d59a700 1 --2- 172.21.15.84:0/4133341913 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f4afc06ae90 0x7f4afc06d340 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4b180d3590 tx=0x7f4b08009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:04.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.565+0000 7f4b0e7fc700 1 -- 172.21.15.84:0/4133341913 <== osd.2 v2:172.21.15.84:6800/3001671542 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f4afc073de0 con 0x7f4afc071300 2023-07-14T11:20:04.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.580+0000 7f4b1ffff700 1 -- 172.21.15.84:0/4133341913 --> [v2:172.21.15.84:6800/3001671542,v1:172.21.15.84:6801/3001671542] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4b18074350 con 0x7f4afc071300 2023-07-14T11:20:04.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.580+0000 7f4b0e7fc700 1 -- 172.21.15.84:0/4133341913 <== osd.2 v2:172.21.15.84:6800/3001671542 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f4b18074350 con 0x7f4afc071300 2023-07-14T11:20:04.583 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-07-14T11:20:04.584 INFO:teuthology.orchestra.run.smithi084.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-14T11:20:04.584 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-07-14T11:20:04.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.581+0000 7f4b1ffff700 1 -- 172.21.15.84:0/4133341913 >> [v2:172.21.15.84:6800/3001671542,v1:172.21.15.84:6801/3001671542] conn(0x7f4afc071300 msgr2=0x7f4afc073710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:04.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.581+0000 7f4b1ffff700 1 --2- 172.21.15.84:0/4133341913 >> [v2:172.21.15.84:6800/3001671542,v1:172.21.15.84:6801/3001671542] conn(0x7f4afc071300 0x7f4afc073710 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:04.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.581+0000 7f4b1ffff700 1 -- 172.21.15.84:0/4133341913 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f4afc06ae90 msgr2=0x7f4afc06d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:04.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.581+0000 7f4b1ffff700 1 --2- 172.21.15.84:0/4133341913 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f4afc06ae90 0x7f4afc06d340 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4b180d3590 tx=0x7f4b08009040 comp rx=0 tx=0).stop 2023-07-14T11:20:04.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.581+0000 7f4b1ffff700 1 -- 172.21.15.84:0/4133341913 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b1806c240 msgr2=0x7f4b181567a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:04.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.581+0000 7f4b1ffff700 1 --2- 172.21.15.84:0/4133341913 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b1806c240 0x7f4b181567a0 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f4b1806a120 tx=0x7f4b14004750 comp rx=0 tx=0).stop 2023-07-14T11:20:04.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.581+0000 7f4b1e59c700 1 -- 172.21.15.84:0/4133341913 reap_dead start 2023-07-14T11:20:04.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.581+0000 7f4b1ffff700 1 -- 172.21.15.84:0/4133341913 shutdown_connections 2023-07-14T11:20:04.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.581+0000 7f4b1ffff700 1 -- 172.21.15.84:0/4133341913 >> 172.21.15.84:0/4133341913 conn(0x7f4b1809c170 msgr2=0x7f4b180b1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:20:04.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.581+0000 7f4b1ffff700 1 -- 172.21.15.84:0/4133341913 shutdown_connections 2023-07-14T11:20:04.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.581+0000 7f4b1ffff700 1 -- 172.21.15.84:0/4133341913 wait complete. 2023-07-14T11:20:04.600 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-07-14T11:20:04.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.794+0000 7f19d5dff700 1 Processor -- start 2023-07-14T11:20:04.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.795+0000 7f19d5dff700 1 -- start start 2023-07-14T11:20:04.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.796+0000 7f19d5dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19d00c92d0 0x7f19d00ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:04.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.796+0000 7f19d5dff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f19d00b12f0 0x7f19d00c96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:04.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.796+0000 7f19d5dff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19d015ce70 con 0x7f19d00adea0 2023-07-14T11:20:04.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.796+0000 7f19d5dff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19d015da60 con 0x7f19d00b12f0 2023-07-14T11:20:04.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.796+0000 7f19d5dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19d00c9be0 con 0x7f19d00c92d0 2023-07-14T11:20:04.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.796+0000 7f19cffff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f19d00adea0 0x7f19d006c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49484/0 (socket says 172.21.15.84:49484) 2023-07-14T11:20:04.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.796+0000 7f19cffff700 1 -- 172.21.15.84:0/3535012282 learned_addr learned my addr 172.21.15.84:0/3535012282 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:20:04.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.797+0000 7f19c7fff700 1 --2- 172.21.15.84:0/3535012282 >> v2:172.21.15.179:3300/0 conn(0x7f19d00b12f0 0x7f19d00c96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:04.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.797+0000 7f19cf7fe700 1 --2- 172.21.15.84:0/3535012282 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19d00c92d0 0x7f19d00ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:04.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.797+0000 7f19ceffd700 1 -- 172.21.15.84:0/3535012282 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4281964470 0 0) 0x7f19d015ce70 con 0x7f19d00adea0 2023-07-14T11:20:04.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.797+0000 7f19ceffd700 1 -- 172.21.15.84:0/3535012282 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19bc0035b0 con 0x7f19d00adea0 2023-07-14T11:20:04.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.797+0000 7f19ceffd700 1 -- 172.21.15.84:0/3535012282 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1129931695 0 0) 0x7f19bc0035b0 con 0x7f19d00adea0 2023-07-14T11:20:04.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.797+0000 7f19ceffd700 1 -- 172.21.15.84:0/3535012282 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19d00c92d0 msgr2=0x7f19d00ad8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:20:04.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.797+0000 7f19ceffd700 1 --2- 172.21.15.84:0/3535012282 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19d00c92d0 0x7f19d00ad8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:04.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.797+0000 7f19ceffd700 1 -- 172.21.15.84:0/3535012282 >> v2:172.21.15.179:3300/0 conn(0x7f19d00b12f0 msgr2=0x7f19d00c96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:20:04.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.797+0000 7f19ceffd700 1 --2- 172.21.15.84:0/3535012282 >> v2:172.21.15.179:3300/0 conn(0x7f19d00b12f0 0x7f19d00c96a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:04.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.797+0000 7f19ceffd700 1 -- 172.21.15.84:0/3535012282 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d015d0c0 con 0x7f19d00adea0 2023-07-14T11:20:04.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.797+0000 7f19ceffd700 1 -- 172.21.15.84:0/3535012282 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7f19c80019f0 con 0x7f19d00adea0 2023-07-14T11:20:04.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.797+0000 7f19ceffd700 1 -- 172.21.15.84:0/3535012282 >> v1:172.21.15.84:6789/0 conn(0x7f19d00adea0 legacy=0x7f19d006c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:04.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.797+0000 7f19ceffd700 1 --2- 172.21.15.84:0/3535012282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19bc003a00 0x7f19bc003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:04.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.797+0000 7f19ceffd700 1 --2- 172.21.15.84:0/3535012282 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19d00c92d0 0x7f19bc004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:04.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.797+0000 7f19ceffd700 1 --2- 172.21.15.84:0/3535012282 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19bc004d90 0x7f19bc005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:04.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.797+0000 7f19ceffd700 1 -- 172.21.15.84:0/3535012282 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d015da60 con 0x7f19bc003a00 2023-07-14T11:20:04.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.797+0000 7f19ceffd700 1 -- 172.21.15.84:0/3535012282 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d00c9be0 con 0x7f19bc004d90 2023-07-14T11:20:04.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.797+0000 7f19ceffd700 1 -- 172.21.15.84:0/3535012282 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19bc00ba40 con 0x7f19d00c92d0 2023-07-14T11:20:04.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.797+0000 7f19cf7fe700 1 --2- 172.21.15.84:0/3535012282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19bc003a00 0x7f19bc003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:04.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.798+0000 7f19c7fff700 1 --2- 172.21.15.84:0/3535012282 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19d00c92d0 0x7f19bc004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:04.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.798+0000 7f19cffff700 1 --2- 172.21.15.84:0/3535012282 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19bc004d90 0x7f19bc005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:04.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.798+0000 7f19cf7fe700 1 -- 172.21.15.84:0/3535012282 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19d00c92d0 msgr2=0x7f19bc004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:20:04.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.798+0000 7f19cf7fe700 1 --2- 172.21.15.84:0/3535012282 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19d00c92d0 0x7f19bc004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:04.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.798+0000 7f19cf7fe700 1 -- 172.21.15.84:0/3535012282 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19bc004d90 msgr2=0x7f19bc005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:20:04.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.798+0000 7f19cf7fe700 1 --2- 172.21.15.84:0/3535012282 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19bc004d90 0x7f19bc005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:04.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.798+0000 7f19cf7fe700 1 -- 172.21.15.84:0/3535012282 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19bc0035b0 con 0x7f19bc003a00 2023-07-14T11:20:04.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.798+0000 7f19cf7fe700 1 --2- 172.21.15.84:0/3535012282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19bc003a00 0x7f19bc003e10 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f19c0009b60 tx=0x7f19bc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13ea7522bbb71b33 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:04.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.798+0000 7f19ceffd700 1 -- 172.21.15.84:0/3535012282 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c0010a70 con 0x7f19bc003a00 2023-07-14T11:20:04.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.798+0000 7f19ceffd700 1 -- 172.21.15.84:0/3535012282 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19c0010bd0 con 0x7f19bc003a00 2023-07-14T11:20:04.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.798+0000 7f19ceffd700 1 -- 172.21.15.84:0/3535012282 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c0011450 con 0x7f19bc003a00 2023-07-14T11:20:04.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.799+0000 7f19d5dff700 1 -- 172.21.15.84:0/3535012282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19bc003a00 msgr2=0x7f19bc003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:04.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.799+0000 7f19d5dff700 1 --2- 172.21.15.84:0/3535012282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19bc003a00 0x7f19bc003e10 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f19c0009b60 tx=0x7f19bc005880 comp rx=0 tx=0).stop 2023-07-14T11:20:04.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.799+0000 7f19cffff700 1 -- 172.21.15.84:0/3535012282 reap_dead start 2023-07-14T11:20:04.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.799+0000 7f19d5dff700 1 -- 172.21.15.84:0/3535012282 shutdown_connections 2023-07-14T11:20:04.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.799+0000 7f19d5dff700 1 -- 172.21.15.84:0/3535012282 >> 172.21.15.84:0/3535012282 conn(0x7f19d00b05d0 msgr2=0x7f19d00b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:20:04.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.799+0000 7f19d5dff700 1 -- 172.21.15.84:0/3535012282 shutdown_connections 2023-07-14T11:20:04.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.799+0000 7f19d5dff700 1 -- 172.21.15.84:0/3535012282 wait complete. 2023-07-14T11:20:04.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.801+0000 7f19d5dff700 1 Processor -- start 2023-07-14T11:20:04.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.801+0000 7f19d5dff700 1 -- start start 2023-07-14T11:20:04.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.802+0000 7f19d5dff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19bc003a00 0x7f19d01f2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:04.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.802+0000 7f19d5dff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19d006f730 0x7f19d0152f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:04.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.802+0000 7f19d5dff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19d00ac860 0x7f19d00acce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:04.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.802+0000 7f19d5dff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d00b29c0 con 0x7f19bc003a00 2023-07-14T11:20:04.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.802+0000 7f19d5dff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d00ad220 con 0x7f19d006f730 2023-07-14T11:20:04.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.802+0000 7f19d5dff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19d0070740 con 0x7f19d00ac860 2023-07-14T11:20:04.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.802+0000 7f19cf7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19bc003a00 0x7f19d01f2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:04.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.802+0000 7f19cf7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19bc003a00 0x7f19d01f2df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60200/0 (socket says 172.21.15.84:60200) 2023-07-14T11:20:04.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.802+0000 7f19cf7fe700 1 -- 172.21.15.84:0/1287037760 learned_addr learned my addr 172.21.15.84:0/1287037760 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:20:04.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.802+0000 7f19c7fff700 1 --2- 172.21.15.84:0/1287037760 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19d006f730 0x7f19d0152f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:04.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.803+0000 7f19cffff700 1 --2- 172.21.15.84:0/1287037760 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19d00ac860 0x7f19d00acce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:04.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.803+0000 7f19cf7fe700 1 -- 172.21.15.84:0/1287037760 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19d00ac860 msgr2=0x7f19d00acce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:04.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.803+0000 7f19cf7fe700 1 --2- 172.21.15.84:0/1287037760 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19d00ac860 0x7f19d00acce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:04.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.803+0000 7f19cf7fe700 1 -- 172.21.15.84:0/1287037760 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19d006f730 msgr2=0x7f19d0152f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:04.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.803+0000 7f19cf7fe700 1 --2- 172.21.15.84:0/1287037760 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19d006f730 0x7f19d0152f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:04.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.803+0000 7f19cf7fe700 1 -- 172.21.15.84:0/1287037760 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d006fbc0 con 0x7f19bc003a00 2023-07-14T11:20:04.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.803+0000 7f19c7fff700 1 --2- 172.21.15.84:0/1287037760 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19d006f730 0x7f19d0152f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:20:04.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.803+0000 7f19cf7fe700 1 --2- 172.21.15.84:0/1287037760 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19bc003a00 0x7f19d01f2df0 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f19c00090b0 tx=0x7f19c00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:04.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.803+0000 7f19ccff9700 1 -- 172.21.15.84:0/1287037760 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c00038a0 con 0x7f19bc003a00 2023-07-14T11:20:04.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.803+0000 7f19ccff9700 1 -- 172.21.15.84:0/1287037760 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19c0003a00 con 0x7f19bc003a00 2023-07-14T11:20:04.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.803+0000 7f19ccff9700 1 -- 172.21.15.84:0/1287037760 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c0003db0 con 0x7f19bc003a00 2023-07-14T11:20:04.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.803+0000 7f19d5dff700 1 -- 172.21.15.84:0/1287037760 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19d006fea0 con 0x7f19bc003a00 2023-07-14T11:20:04.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.803+0000 7f19d5dff700 1 -- 172.21.15.84:0/1287037760 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19d0070460 con 0x7f19bc003a00 2023-07-14T11:20:04.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.804+0000 7f19d5dff700 1 -- 172.21.15.84:0/1287037760 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19d0074350 con 0x7f19bc003a00 2023-07-14T11:20:04.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.805+0000 7f19ccff9700 1 -- 172.21.15.84:0/1287037760 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f19c0011450 con 0x7f19bc003a00 2023-07-14T11:20:04.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.806+0000 7f19ccff9700 1 --2- 172.21.15.84:0/1287037760 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f19b006ae90 0x7f19b006d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:04.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.806+0000 7f19ccff9700 1 -- 172.21.15.84:0/1287037760 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f19c008aaa0 con 0x7f19bc003a00 2023-07-14T11:20:04.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.807+0000 7f19c7fff700 1 --2- 172.21.15.84:0/1287037760 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f19b006ae90 0x7f19b006d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:04.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.807+0000 7f19c7fff700 1 --2- 172.21.15.84:0/1287037760 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f19b006ae90 0x7f19b006d340 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f19d00ad420 tx=0x7f19b8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:04.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:04.810+0000 7f19ccff9700 1 -- 172.21.15.84:0/1287037760 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f19c0055d00 con 0x7f19bc003a00 2023-07-14T11:20:05.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.009+0000 7f19d5dff700 1 -- 172.21.15.84:0/1287037760 --> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f19d015d680 con 0x7f19b006ae90 2023-07-14T11:20:05.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.010+0000 7f19ccff9700 1 -- 172.21.15.84:0/1287037760 <== mgr.4100 v2:172.21.15.179:6836/2094253834 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f19b80098a0 con 0x7f19b006ae90 2023-07-14T11:20:05.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.012+0000 7f19d5dff700 1 -- 172.21.15.84:0/1287037760 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f19b006ae90 msgr2=0x7f19b006d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:05.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.012+0000 7f19d5dff700 1 --2- 172.21.15.84:0/1287037760 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f19b006ae90 0x7f19b006d340 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f19d00ad420 tx=0x7f19b8008040 comp rx=0 tx=0).stop 2023-07-14T11:20:05.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.012+0000 7f19d5dff700 1 -- 172.21.15.84:0/1287037760 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19bc003a00 msgr2=0x7f19d01f2df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:05.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.012+0000 7f19d5dff700 1 --2- 172.21.15.84:0/1287037760 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19bc003a00 0x7f19d01f2df0 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f19c00090b0 tx=0x7f19c00047c0 comp rx=0 tx=0).stop 2023-07-14T11:20:05.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.012+0000 7f19d5dff700 1 -- 172.21.15.84:0/1287037760 shutdown_connections 2023-07-14T11:20:05.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.012+0000 7f19d5dff700 1 --2- 172.21.15.84:0/1287037760 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f19b006ae90 0x7f19b006d340 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:05.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.012+0000 7f19d5dff700 1 --2- 172.21.15.84:0/1287037760 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19d00ac860 0x7f19d00acce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:05.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.012+0000 7f19d5dff700 1 --2- 172.21.15.84:0/1287037760 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19bc003a00 0x7f19d01f2df0 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:05.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.012+0000 7f19d5dff700 1 --2- 172.21.15.84:0/1287037760 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19d006f730 0x7f19d0152f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:05.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.012+0000 7f19d5dff700 1 -- 172.21.15.84:0/1287037760 >> 172.21.15.84:0/1287037760 conn(0x7f19d00b05d0 msgr2=0x7f19d0156890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:20:05.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.012+0000 7f19d5dff700 1 -- 172.21.15.84:0/1287037760 shutdown_connections 2023-07-14T11:20:05.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.012+0000 7f19d5dff700 1 -- 172.21.15.84:0/1287037760 wait complete. 2023-07-14T11:20:05.017 INFO:teuthology.orchestra.run.smithi084.stderr:instructed osd(s) 2 to deep-scrub 2023-07-14T11:20:05.032 INFO:tasks.ceph:Scrubbing osd.3 2023-07-14T11:20:05.033 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-07-14T11:20:05.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.230+0000 7f0c5e1ff700 1 Processor -- start 2023-07-14T11:20:05.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.230+0000 7f0c5e1ff700 1 -- start start 2023-07-14T11:20:05.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.231+0000 7f0c5e1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c5815c890 0x7f0c580d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:05.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.231+0000 7f0c5e1ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0c580b2440 0x7f0c580d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:05.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.232+0000 7f0c5e1ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c5815cc60 con 0x7f0c5806c240 2023-07-14T11:20:05.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.232+0000 7f0c5e1ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c5806a7f0 con 0x7f0c580b2440 2023-07-14T11:20:05.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.232+0000 7f0c5e1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5806b760 con 0x7f0c5815c890 2023-07-14T11:20:05.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.232+0000 7f0c57fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f0c5806c240 0x7f0c580cf840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49492/0 (socket says 172.21.15.84:49492) 2023-07-14T11:20:05.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.232+0000 7f0c57fff700 1 -- 172.21.15.84:0/1203497517 learned_addr learned my addr 172.21.15.84:0/1203497517 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:20:05.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.232+0000 7f0c577fe700 1 --2- 172.21.15.84:0/1203497517 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c5815c890 0x7f0c580d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:05.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.232+0000 7f0c4ffff700 1 --2- 172.21.15.84:0/1203497517 >> v2:172.21.15.179:3300/0 conn(0x7f0c580b2440 0x7f0c580d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:05.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.232+0000 7f0c56ffd700 1 -- 172.21.15.84:0/1203497517 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2160010311 0 0) 0x7f0c5815cc60 con 0x7f0c5806c240 2023-07-14T11:20:05.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.232+0000 7f0c56ffd700 1 -- 172.21.15.84:0/1203497517 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c440035b0 con 0x7f0c5806c240 2023-07-14T11:20:05.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.233+0000 7f0c577fe700 1 -- 172.21.15.84:0/1203497517 >> v2:172.21.15.179:3300/0 conn(0x7f0c580b2440 msgr2=0x7f0c580d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:20:05.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.233+0000 7f0c577fe700 1 --2- 172.21.15.84:0/1203497517 >> v2:172.21.15.179:3300/0 conn(0x7f0c580b2440 0x7f0c580d0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:05.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.233+0000 7f0c56ffd700 1 -- 172.21.15.84:0/1203497517 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3368248268 0 0) 0x7f0c440035b0 con 0x7f0c5806c240 2023-07-14T11:20:05.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.233+0000 7f0c577fe700 1 -- 172.21.15.84:0/1203497517 >> v1:172.21.15.84:6789/0 conn(0x7f0c5806c240 legacy=0x7f0c580cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:05.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.233+0000 7f0c577fe700 1 -- 172.21.15.84:0/1203497517 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c5806ba40 con 0x7f0c5815c890 2023-07-14T11:20:05.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.233+0000 7f0c577fe700 1 --2- 172.21.15.84:0/1203497517 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c5815c890 0x7f0c580d0a50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0c48009840 tx=0x7f0c48009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5cd4b1ca2c7769db server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:05.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.233+0000 7f0c56ffd700 1 -- 172.21.15.84:0/1203497517 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c500019f0 con 0x7f0c5815c890 2023-07-14T11:20:05.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.233+0000 7f0c56ffd700 1 -- 172.21.15.84:0/1203497517 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c48004030 con 0x7f0c5815c890 2023-07-14T11:20:05.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.233+0000 7f0c56ffd700 1 -- 172.21.15.84:0/1203497517 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c480043c0 con 0x7f0c5815c890 2023-07-14T11:20:05.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.234+0000 7f0c5e1ff700 1 -- 172.21.15.84:0/1203497517 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c5815c890 msgr2=0x7f0c580d0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:05.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.234+0000 7f0c5e1ff700 1 --2- 172.21.15.84:0/1203497517 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c5815c890 0x7f0c580d0a50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0c48009840 tx=0x7f0c48009b50 comp rx=0 tx=0).stop 2023-07-14T11:20:05.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.234+0000 7f0c5e1ff700 1 -- 172.21.15.84:0/1203497517 shutdown_connections 2023-07-14T11:20:05.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.234+0000 7f0c5e1ff700 1 --2- 172.21.15.84:0/1203497517 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c5815c890 0x7f0c580d0a50 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:05.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.234+0000 7f0c5e1ff700 1 --2- 172.21.15.84:0/1203497517 >> v2:172.21.15.179:3300/0 conn(0x7f0c580b2440 0x7f0c580d0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:05.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.234+0000 7f0c5e1ff700 1 -- 172.21.15.84:0/1203497517 >> 172.21.15.84:0/1203497517 conn(0x7f0c5809c170 msgr2=0x7f0c580d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:20:05.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.234+0000 7f0c5e1ff700 1 -- 172.21.15.84:0/1203497517 shutdown_connections 2023-07-14T11:20:05.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.234+0000 7f0c5e1ff700 1 -- 172.21.15.84:0/1203497517 wait complete. 2023-07-14T11:20:05.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.236+0000 7f0c5e1ff700 1 Processor -- start 2023-07-14T11:20:05.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.236+0000 7f0c5e1ff700 1 -- start start 2023-07-14T11:20:05.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.237+0000 7f0c5e1ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c5806c240 0x7f0c580c7430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:05.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.237+0000 7f0c5e1ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c580b2440 0x7f0c580c7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:05.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.237+0000 7f0c5e1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c5815c890 0x7f0c581f2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:05.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.237+0000 7f0c5e1ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c580c84d0 con 0x7f0c580b2440 2023-07-14T11:20:05.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.237+0000 7f0c5e1ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c580c81f0 con 0x7f0c5806c240 2023-07-14T11:20:05.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.237+0000 7f0c5e1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5815cff0 con 0x7f0c5815c890 2023-07-14T11:20:05.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.237+0000 7f0c4ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c580b2440 0x7f0c580c7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:05.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.237+0000 7f0c4ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c580b2440 0x7f0c580c7970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60210/0 (socket says 172.21.15.84:60210) 2023-07-14T11:20:05.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.237+0000 7f0c4ffff700 1 -- 172.21.15.84:0/1250902435 learned_addr learned my addr 172.21.15.84:0/1250902435 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:20:05.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.237+0000 7f0c57fff700 1 --2- 172.21.15.84:0/1250902435 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c5815c890 0x7f0c581f2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:05.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.237+0000 7f0c577fe700 1 --2- 172.21.15.84:0/1250902435 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c5806c240 0x7f0c580c7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:05.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.237+0000 7f0c4ffff700 1 -- 172.21.15.84:0/1250902435 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c5815c890 msgr2=0x7f0c581f2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:05.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.237+0000 7f0c4ffff700 1 --2- 172.21.15.84:0/1250902435 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c5815c890 0x7f0c581f2340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:05.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.237+0000 7f0c4ffff700 1 -- 172.21.15.84:0/1250902435 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c5806c240 msgr2=0x7f0c580c7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:05.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.237+0000 7f0c4ffff700 1 --2- 172.21.15.84:0/1250902435 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c5806c240 0x7f0c580c7430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:05.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.237+0000 7f0c4ffff700 1 -- 172.21.15.84:0/1250902435 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c480094a0 con 0x7f0c580b2440 2023-07-14T11:20:05.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.237+0000 7f0c577fe700 1 --2- 172.21.15.84:0/1250902435 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c5806c240 0x7f0c580c7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:20:05.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.238+0000 7f0c4ffff700 1 --2- 172.21.15.84:0/1250902435 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c580b2440 0x7f0c580c7970 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f0c4000e9b0 tx=0x7f0c4000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:05.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.238+0000 7f0c54ff9700 1 -- 172.21.15.84:0/1250902435 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c40009710 con 0x7f0c580b2440 2023-07-14T11:20:05.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.238+0000 7f0c54ff9700 1 -- 172.21.15.84:0/1250902435 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c4000c850 con 0x7f0c580b2440 2023-07-14T11:20:05.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.238+0000 7f0c5e1ff700 1 -- 172.21.15.84:0/1250902435 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c5815d2d0 con 0x7f0c580b2440 2023-07-14T11:20:05.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.238+0000 7f0c54ff9700 1 -- 172.21.15.84:0/1250902435 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4000cbc0 con 0x7f0c580b2440 2023-07-14T11:20:05.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.238+0000 7f0c5e1ff700 1 -- 172.21.15.84:0/1250902435 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c581efcc0 con 0x7f0c580b2440 2023-07-14T11:20:05.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.239+0000 7f0c5e1ff700 1 -- 172.21.15.84:0/1250902435 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0c5806bd20 con 0x7f0c580b2440 2023-07-14T11:20:05.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.240+0000 7f0c54ff9700 1 -- 172.21.15.84:0/1250902435 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f0c4000cd20 con 0x7f0c580b2440 2023-07-14T11:20:05.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.241+0000 7f0c54ff9700 1 --2- 172.21.15.84:0/1250902435 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f0c3806ae90 0x7f0c3806d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:05.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.241+0000 7f0c54ff9700 1 -- 172.21.15.84:0/1250902435 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f0c40089880 con 0x7f0c580b2440 2023-07-14T11:20:05.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.241+0000 7f0c54ff9700 1 --2- 172.21.15.84:0/1250902435 >> [v2:172.21.15.84:6816/3292558976,v1:172.21.15.84:6817/3292558976] conn(0x7f0c38071300 0x7f0c38073710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:05.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.241+0000 7f0c54ff9700 1 -- 172.21.15.84:0/1250902435 --> [v2:172.21.15.84:6816/3292558976,v1:172.21.15.84:6817/3292558976] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0c38073de0 con 0x7f0c38071300 2023-07-14T11:20:05.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.241+0000 7f0c54ff9700 1 -- 172.21.15.84:0/1250902435 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=109) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0c40089bf0 con 0x7f0c580b2440 2023-07-14T11:20:05.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.241+0000 7f0c57fff700 1 --2- 172.21.15.84:0/1250902435 >> [v2:172.21.15.84:6816/3292558976,v1:172.21.15.84:6817/3292558976] conn(0x7f0c38071300 0x7f0c38073710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:05.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.241+0000 7f0c577fe700 1 --2- 172.21.15.84:0/1250902435 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f0c3806ae90 0x7f0c3806d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:05.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.242+0000 7f0c57fff700 1 --2- 172.21.15.84:0/1250902435 >> [v2:172.21.15.84:6816/3292558976,v1:172.21.15.84:6817/3292558976] conn(0x7f0c38071300 0x7f0c38073710 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:05.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.242+0000 7f0c577fe700 1 --2- 172.21.15.84:0/1250902435 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f0c3806ae90 0x7f0c3806d340 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0c480090b0 tx=0x7f0c48008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:05.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.243+0000 7f0c54ff9700 1 -- 172.21.15.84:0/1250902435 <== osd.3 v2:172.21.15.84:6816/3292558976 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f0c38073de0 con 0x7f0c38071300 2023-07-14T11:20:05.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.257+0000 7f0c5e1ff700 1 -- 172.21.15.84:0/1250902435 --> [v2:172.21.15.84:6816/3292558976,v1:172.21.15.84:6817/3292558976] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f0c580d12c0 con 0x7f0c38071300 2023-07-14T11:20:05.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.257+0000 7f0c54ff9700 1 -- 172.21.15.84:0/1250902435 <== osd.3 v2:172.21.15.84:6816/3292558976 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f0c580d12c0 con 0x7f0c38071300 2023-07-14T11:20:05.287 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-07-14T11:20:05.287 INFO:teuthology.orchestra.run.smithi084.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-14T11:20:05.287 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-07-14T11:20:05.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.257+0000 7f0c5e1ff700 1 -- 172.21.15.84:0/1250902435 >> [v2:172.21.15.84:6816/3292558976,v1:172.21.15.84:6817/3292558976] conn(0x7f0c38071300 msgr2=0x7f0c38073710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:05.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.257+0000 7f0c5e1ff700 1 --2- 172.21.15.84:0/1250902435 >> [v2:172.21.15.84:6816/3292558976,v1:172.21.15.84:6817/3292558976] conn(0x7f0c38071300 0x7f0c38073710 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:05.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.258+0000 7f0c5e1ff700 1 -- 172.21.15.84:0/1250902435 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f0c3806ae90 msgr2=0x7f0c3806d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:05.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.258+0000 7f0c5e1ff700 1 --2- 172.21.15.84:0/1250902435 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f0c3806ae90 0x7f0c3806d340 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0c480090b0 tx=0x7f0c48008030 comp rx=0 tx=0).stop 2023-07-14T11:20:05.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.258+0000 7f0c5e1ff700 1 -- 172.21.15.84:0/1250902435 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c580b2440 msgr2=0x7f0c580c7970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:05.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.258+0000 7f0c5e1ff700 1 --2- 172.21.15.84:0/1250902435 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c580b2440 0x7f0c580c7970 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f0c4000e9b0 tx=0x7f0c4000ecc0 comp rx=0 tx=0).stop 2023-07-14T11:20:05.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.258+0000 7f0c57fff700 1 -- 172.21.15.84:0/1250902435 reap_dead start 2023-07-14T11:20:05.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.258+0000 7f0c5e1ff700 1 -- 172.21.15.84:0/1250902435 shutdown_connections 2023-07-14T11:20:05.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.258+0000 7f0c5e1ff700 1 -- 172.21.15.84:0/1250902435 >> 172.21.15.84:0/1250902435 conn(0x7f0c5809c170 msgr2=0x7f0c580d2970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:20:05.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.258+0000 7f0c5e1ff700 1 -- 172.21.15.84:0/1250902435 shutdown_connections 2023-07-14T11:20:05.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.258+0000 7f0c5e1ff700 1 -- 172.21.15.84:0/1250902435 wait complete. 2023-07-14T11:20:05.291 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-07-14T11:20:05.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.485+0000 7f847bdff700 1 Processor -- start 2023-07-14T11:20:05.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.485+0000 7f847bdff700 1 -- start start 2023-07-14T11:20:05.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.486+0000 7f847bdff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f847406f010 0x7f8474071650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:05.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.486+0000 7f847bdff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f847406a640 0x7f84741601d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:05.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.486+0000 7f847bdff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84740cdba0 con 0x7f84740ce030 2023-07-14T11:20:05.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.486+0000 7f847bdff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f847406f3e0 con 0x7f847406a640 2023-07-14T11:20:05.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.486+0000 7f847bdff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84740cf370 con 0x7f847406f010 2023-07-14T11:20:05.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.486+0000 7f847a39c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f847406a640 0x7f84741601d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:05.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.486+0000 7f847a39c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f847406a640 0x7f84741601d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60224/0 (socket says 172.21.15.84:60224) 2023-07-14T11:20:05.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.486+0000 7f847a39c700 1 -- 172.21.15.84:0/1572887408 learned_addr learned my addr 172.21.15.84:0/1572887408 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:20:05.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.486+0000 7f8479b9b700 1 --2- 172.21.15.84:0/1572887408 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f847406f010 0x7f8474071650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:05.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.487+0000 7f847a39c700 1 -- 172.21.15.84:0/1572887408 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f847406f010 msgr2=0x7f8474071650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:20:05.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.487+0000 7f847a39c700 1 --2- 172.21.15.84:0/1572887408 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f847406f010 0x7f8474071650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:05.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.487+0000 7f847a39c700 1 -- 172.21.15.84:0/1572887408 >> v1:172.21.15.179:6789/0 conn(0x7f84740ce030 legacy=0x7f8474069f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:05.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.487+0000 7f847a39c700 1 -- 172.21.15.84:0/1572887408 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84740cf650 con 0x7f847406a640 2023-07-14T11:20:05.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.487+0000 7f8479b9b700 1 --2- 172.21.15.84:0/1572887408 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f847406f010 0x7f8474071650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:20:05.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.487+0000 7f847a39c700 1 --2- 172.21.15.84:0/1572887408 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f847406a640 0x7f84741601d0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f846c009e50 tx=0x7f846c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a902485f05b7da2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:05.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.487+0000 7f8478b99700 1 -- 172.21.15.84:0/1572887408 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f846c00e070 con 0x7f847406a640 2023-07-14T11:20:05.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.487+0000 7f8478b99700 1 -- 172.21.15.84:0/1572887408 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f846c00b9c0 con 0x7f847406a640 2023-07-14T11:20:05.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.487+0000 7f8478b99700 1 -- 172.21.15.84:0/1572887408 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f846c00bd70 con 0x7f847406a640 2023-07-14T11:20:05.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.488+0000 7f847bdff700 1 -- 172.21.15.84:0/1572887408 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f847406a640 msgr2=0x7f84741601d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:05.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.488+0000 7f847bdff700 1 --2- 172.21.15.84:0/1572887408 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f847406a640 0x7f84741601d0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f846c009e50 tx=0x7f846c00b330 comp rx=0 tx=0).stop 2023-07-14T11:20:05.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.488+0000 7f847bdff700 1 -- 172.21.15.84:0/1572887408 shutdown_connections 2023-07-14T11:20:05.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.488+0000 7f847bdff700 1 --2- 172.21.15.84:0/1572887408 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f847406a640 0x7f84741601d0 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:05.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.488+0000 7f847bdff700 1 --2- 172.21.15.84:0/1572887408 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f847406f010 0x7f8474071650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:05.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.488+0000 7f847bdff700 1 -- 172.21.15.84:0/1572887408 >> 172.21.15.84:0/1572887408 conn(0x7f84740cc640 msgr2=0x7f84740cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:20:05.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.488+0000 7f847bdff700 1 -- 172.21.15.84:0/1572887408 shutdown_connections 2023-07-14T11:20:05.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.488+0000 7f847bdff700 1 -- 172.21.15.84:0/1572887408 wait complete. 2023-07-14T11:20:05.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.490+0000 7f847bdff700 1 Processor -- start 2023-07-14T11:20:05.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.490+0000 7f847bdff700 1 -- start start 2023-07-14T11:20:05.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.491+0000 7f847bdff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f847406a640 0x7f84740b33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:05.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.491+0000 7f847bdff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f847406f010 0x7f84740b51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:05.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.491+0000 7f847bdff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84740ce030 0x7f8474153000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:05.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.491+0000 7f847bdff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84740b5700 con 0x7f847406a640 2023-07-14T11:20:05.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.491+0000 7f847bdff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8474153540 con 0x7f84740ce030 2023-07-14T11:20:05.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.491+0000 7f847bdff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84740b3a70 con 0x7f847406f010 2023-07-14T11:20:05.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.491+0000 7f8479b9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f847406a640 0x7f84740b33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:05.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.491+0000 7f8479b9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f847406a640 0x7f84740b33d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60234/0 (socket says 172.21.15.84:60234) 2023-07-14T11:20:05.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.491+0000 7f8479b9b700 1 -- 172.21.15.84:0/2404915774 learned_addr learned my addr 172.21.15.84:0/2404915774 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:20:05.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.491+0000 7f847939a700 1 --2- 172.21.15.84:0/2404915774 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f847406f010 0x7f84740b51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:05.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.491+0000 7f847a39c700 1 --2- 172.21.15.84:0/2404915774 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84740ce030 0x7f8474153000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:05.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.491+0000 7f8479b9b700 1 -- 172.21.15.84:0/2404915774 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f847406f010 msgr2=0x7f84740b51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:05.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.491+0000 7f8479b9b700 1 --2- 172.21.15.84:0/2404915774 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f847406f010 0x7f84740b51c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:05.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.491+0000 7f8479b9b700 1 -- 172.21.15.84:0/2404915774 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84740ce030 msgr2=0x7f8474153000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:05.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.491+0000 7f8479b9b700 1 --2- 172.21.15.84:0/2404915774 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84740ce030 0x7f8474153000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:05.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.491+0000 7f8479b9b700 1 -- 172.21.15.84:0/2404915774 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f846c009b30 con 0x7f847406a640 2023-07-14T11:20:05.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.491+0000 7f847939a700 1 --2- 172.21.15.84:0/2404915774 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f847406f010 0x7f84740b51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:20:05.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.492+0000 7f8479b9b700 1 --2- 172.21.15.84:0/2404915774 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f847406a640 0x7f84740b33d0 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f847000e810 tx=0x7f847000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:05.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.492+0000 7f846a7fc700 1 -- 172.21.15.84:0/2404915774 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8470013610 con 0x7f847406a640 2023-07-14T11:20:05.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.492+0000 7f846a7fc700 1 -- 172.21.15.84:0/2404915774 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8470013770 con 0x7f847406a640 2023-07-14T11:20:05.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.492+0000 7f846a7fc700 1 -- 172.21.15.84:0/2404915774 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8470013b20 con 0x7f847406a640 2023-07-14T11:20:05.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.492+0000 7f847bdff700 1 -- 172.21.15.84:0/2404915774 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84740b3d50 con 0x7f847406a640 2023-07-14T11:20:05.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.492+0000 7f847bdff700 1 -- 172.21.15.84:0/2404915774 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84740b4310 con 0x7f847406a640 2023-07-14T11:20:05.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.493+0000 7f847bdff700 1 -- 172.21.15.84:0/2404915774 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8474074350 con 0x7f847406a640 2023-07-14T11:20:05.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.494+0000 7f846a7fc700 1 -- 172.21.15.84:0/2404915774 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f8470013c80 con 0x7f847406a640 2023-07-14T11:20:05.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.495+0000 7f846a7fc700 1 --2- 172.21.15.84:0/2404915774 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f845806ae90 0x7f845806d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:05.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.495+0000 7f846a7fc700 1 -- 172.21.15.84:0/2404915774 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f8470089380 con 0x7f847406a640 2023-07-14T11:20:05.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.495+0000 7f847939a700 1 --2- 172.21.15.84:0/2404915774 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f845806ae90 0x7f845806d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:05.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.496+0000 7f847939a700 1 --2- 172.21.15.84:0/2404915774 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f845806ae90 0x7f845806d340 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8474160020 tx=0x7f8464009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:05.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.499+0000 7f846a7fc700 1 -- 172.21.15.84:0/2404915774 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f8470054320 con 0x7f847406a640 2023-07-14T11:20:05.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.692+0000 7f847bdff700 1 -- 172.21.15.84:0/2404915774 --> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f84740cd830 con 0x7f845806ae90 2023-07-14T11:20:05.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.693+0000 7f846a7fc700 1 -- 172.21.15.84:0/2404915774 <== mgr.4100 v2:172.21.15.179:6836/2094253834 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f8464001450 con 0x7f845806ae90 2023-07-14T11:20:05.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.695+0000 7f847bdff700 1 -- 172.21.15.84:0/2404915774 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f845806ae90 msgr2=0x7f845806d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:05.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.695+0000 7f847bdff700 1 --2- 172.21.15.84:0/2404915774 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f845806ae90 0x7f845806d340 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8474160020 tx=0x7f8464009040 comp rx=0 tx=0).stop 2023-07-14T11:20:05.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.695+0000 7f847bdff700 1 -- 172.21.15.84:0/2404915774 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f847406a640 msgr2=0x7f84740b33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:05.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.695+0000 7f847bdff700 1 --2- 172.21.15.84:0/2404915774 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f847406a640 0x7f84740b33d0 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f847000e810 tx=0x7f847000ebd0 comp rx=0 tx=0).stop 2023-07-14T11:20:05.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.695+0000 7f847bdff700 1 -- 172.21.15.84:0/2404915774 shutdown_connections 2023-07-14T11:20:05.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.695+0000 7f847bdff700 1 --2- 172.21.15.84:0/2404915774 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84740ce030 0x7f8474153000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:05.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.695+0000 7f847bdff700 1 --2- 172.21.15.84:0/2404915774 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f847406a640 0x7f84740b33d0 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:05.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.695+0000 7f847bdff700 1 --2- 172.21.15.84:0/2404915774 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f845806ae90 0x7f845806d340 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:05.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.695+0000 7f847bdff700 1 --2- 172.21.15.84:0/2404915774 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f847406f010 0x7f84740b51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:05.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.695+0000 7f847bdff700 1 -- 172.21.15.84:0/2404915774 >> 172.21.15.84:0/2404915774 conn(0x7f84740cc640 msgr2=0x7f847406e350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:20:05.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.695+0000 7f847bdff700 1 -- 172.21.15.84:0/2404915774 shutdown_connections 2023-07-14T11:20:05.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.695+0000 7f847bdff700 1 -- 172.21.15.84:0/2404915774 wait complete. 2023-07-14T11:20:05.700 INFO:teuthology.orchestra.run.smithi084.stderr:instructed osd(s) 3 to deep-scrub 2023-07-14T11:20:05.715 INFO:tasks.ceph:Scrubbing osd.4 2023-07-14T11:20:05.716 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-07-14T11:20:05.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.911+0000 7f8d7b1ff700 1 Processor -- start 2023-07-14T11:20:05.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.911+0000 7f8d7b1ff700 1 -- start start 2023-07-14T11:20:05.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.913+0000 7f8d7b1ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8d740b2440 0x7f8d740cdbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:05.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.913+0000 7f8d7b1ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d7415cc60 con 0x7f8d740d1160 2023-07-14T11:20:05.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.913+0000 7f8d7b1ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d7406a7f0 con 0x7f8d7415c890 2023-07-14T11:20:05.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.913+0000 7f8d7b1ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d7406b760 con 0x7f8d740b2440 2023-07-14T11:20:05.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.913+0000 7f8d73fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f8d740d1160 0x7f8d740cd4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49496/0 (socket says 172.21.15.84:49496) 2023-07-14T11:20:05.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.913+0000 7f8d73fff700 1 -- 172.21.15.84:0/291771134 learned_addr learned my addr 172.21.15.84:0/291771134 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:20:05.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.913+0000 7f8d7979c700 1 --2- 172.21.15.84:0/291771134 >> v2:172.21.15.179:3300/0 conn(0x7f8d740b2440 0x7f8d740cdbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:05.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.913+0000 7f8d737fe700 1 -- 172.21.15.84:0/291771134 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 922087101 0 0) 0x7f8d7415cc60 con 0x7f8d740d1160 2023-07-14T11:20:05.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.913+0000 7f8d737fe700 1 -- 172.21.15.84:0/291771134 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d640035b0 con 0x7f8d740d1160 2023-07-14T11:20:05.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.914+0000 7f8d737fe700 1 -- 172.21.15.84:0/291771134 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2405108793 0 0) 0x7f8d640035b0 con 0x7f8d740d1160 2023-07-14T11:20:05.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.914+0000 7f8d737fe700 1 -- 172.21.15.84:0/291771134 >> v2:172.21.15.179:3300/0 conn(0x7f8d740b2440 msgr2=0x7f8d740cdbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:20:05.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.914+0000 7f8d737fe700 1 --2- 172.21.15.84:0/291771134 >> v2:172.21.15.179:3300/0 conn(0x7f8d740b2440 0x7f8d740cdbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:05.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.914+0000 7f8d737fe700 1 -- 172.21.15.84:0/291771134 >> v1:172.21.15.179:6789/0 conn(0x7f8d7415c890 legacy=0x7f8d740d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:05.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.914+0000 7f8d737fe700 1 -- 172.21.15.84:0/291771134 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d7406ba40 con 0x7f8d740d1160 2023-07-14T11:20:05.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.914+0000 7f8d737fe700 1 -- 172.21.15.84:0/291771134 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7f8d60001670 con 0x7f8d740d1160 2023-07-14T11:20:05.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.914+0000 7f8d737fe700 1 -- 172.21.15.84:0/291771134 >> v1:172.21.15.84:6789/0 conn(0x7f8d740d1160 legacy=0x7f8d740cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:05.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.914+0000 7f8d737fe700 1 --2- 172.21.15.84:0/291771134 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d64003ac0 0x7f8d64003ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:05.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.914+0000 7f8d737fe700 1 --2- 172.21.15.84:0/291771134 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d64004850 0x7f8d64004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:05.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.914+0000 7f8d737fe700 1 --2- 172.21.15.84:0/291771134 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d64005200 0x7f8d6400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:05.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.914+0000 7f8d737fe700 1 -- 172.21.15.84:0/291771134 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7406b760 con 0x7f8d64005200 2023-07-14T11:20:05.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.914+0000 7f8d737fe700 1 -- 172.21.15.84:0/291771134 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6400c140 con 0x7f8d64004850 2023-07-14T11:20:05.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.914+0000 7f8d737fe700 1 -- 172.21.15.84:0/291771134 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6400c300 con 0x7f8d64003ac0 2023-07-14T11:20:05.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.914+0000 7f8d7979c700 1 --2- 172.21.15.84:0/291771134 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d64005200 0x7f8d6400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:05.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.914+0000 7f8d78f9b700 1 --2- 172.21.15.84:0/291771134 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d64003ac0 0x7f8d64003ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:05.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.914+0000 7f8d73fff700 1 --2- 172.21.15.84:0/291771134 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d64004850 0x7f8d64004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:05.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.914+0000 7f8d7979c700 1 -- 172.21.15.84:0/291771134 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d64003ac0 msgr2=0x7f8d64003ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:20:05.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.914+0000 7f8d7979c700 1 --2- 172.21.15.84:0/291771134 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d64003ac0 0x7f8d64003ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:05.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.914+0000 7f8d7979c700 1 -- 172.21.15.84:0/291771134 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d64004850 msgr2=0x7f8d64004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:20:05.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.914+0000 7f8d7979c700 1 --2- 172.21.15.84:0/291771134 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d64004850 0x7f8d64004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:05.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.914+0000 7f8d7979c700 1 -- 172.21.15.84:0/291771134 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d640035b0 con 0x7f8d64005200 2023-07-14T11:20:05.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.915+0000 7f8d7979c700 1 -- 172.21.15.84:0/291771134 reap_dead start 2023-07-14T11:20:05.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.915+0000 7f8d7979c700 1 --2- 172.21.15.84:0/291771134 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d64005200 0x7f8d6400ba10 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c009f90 tx=0x7f8d64005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56735d1105f9f930 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:05.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.915+0000 7f8d737fe700 1 -- 172.21.15.84:0/291771134 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c003a20 con 0x7f8d64005200 2023-07-14T11:20:05.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.915+0000 7f8d737fe700 1 -- 172.21.15.84:0/291771134 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d6c00f040 con 0x7f8d64005200 2023-07-14T11:20:05.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.915+0000 7f8d737fe700 1 -- 172.21.15.84:0/291771134 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c003dc0 con 0x7f8d64005200 2023-07-14T11:20:05.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.915+0000 7f8d7b1ff700 1 -- 172.21.15.84:0/291771134 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d64005200 msgr2=0x7f8d6400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:05.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.915+0000 7f8d7b1ff700 1 --2- 172.21.15.84:0/291771134 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d64005200 0x7f8d6400ba10 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c009f90 tx=0x7f8d64005880 comp rx=0 tx=0).stop 2023-07-14T11:20:05.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.916+0000 7f8d7b1ff700 1 -- 172.21.15.84:0/291771134 shutdown_connections 2023-07-14T11:20:05.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.916+0000 7f8d7b1ff700 1 --2- 172.21.15.84:0/291771134 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d64005200 0x7f8d6400ba10 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:05.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.916+0000 7f8d7b1ff700 1 -- 172.21.15.84:0/291771134 >> 172.21.15.84:0/291771134 conn(0x7f8d7409c170 msgr2=0x7f8d740d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:20:05.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.916+0000 7f8d7b1ff700 1 -- 172.21.15.84:0/291771134 shutdown_connections 2023-07-14T11:20:05.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.916+0000 7f8d7b1ff700 1 -- 172.21.15.84:0/291771134 wait complete. 2023-07-14T11:20:05.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.917+0000 7f8d7b1ff700 1 Processor -- start 2023-07-14T11:20:05.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.918+0000 7f8d7b1ff700 1 -- start start 2023-07-14T11:20:05.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.918+0000 7f8d7b1ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d64005200 0x7f8d740b7940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:05.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.918+0000 7f8d7b1ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d74155de0 0x7f8d74151280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:05.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.919+0000 7f8d7b1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d74156250 0x7f8d741517c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:05.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.919+0000 7f8d7b1ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d740b5d70 con 0x7f8d64005200 2023-07-14T11:20:05.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.919+0000 7f8d7b1ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d741e5040 con 0x7f8d74155de0 2023-07-14T11:20:05.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.919+0000 7f8d7b1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d741e5320 con 0x7f8d74156250 2023-07-14T11:20:05.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.919+0000 7f8d78f9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d64005200 0x7f8d740b7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:05.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.919+0000 7f8d78f9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d64005200 0x7f8d740b7940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60256/0 (socket says 172.21.15.84:60256) 2023-07-14T11:20:05.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.919+0000 7f8d78f9b700 1 -- 172.21.15.84:0/760122565 learned_addr learned my addr 172.21.15.84:0/760122565 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:20:05.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.919+0000 7f8d73fff700 1 --2- 172.21.15.84:0/760122565 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d74155de0 0x7f8d74151280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:05.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.919+0000 7f8d7979c700 1 --2- 172.21.15.84:0/760122565 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d74156250 0x7f8d741517c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:05.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.919+0000 7f8d78f9b700 1 -- 172.21.15.84:0/760122565 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d74156250 msgr2=0x7f8d741517c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:05.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.919+0000 7f8d78f9b700 1 --2- 172.21.15.84:0/760122565 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d74156250 0x7f8d741517c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:05.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.919+0000 7f8d78f9b700 1 -- 172.21.15.84:0/760122565 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d74155de0 msgr2=0x7f8d74151280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:05.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.919+0000 7f8d78f9b700 1 --2- 172.21.15.84:0/760122565 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d74155de0 0x7f8d74151280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:05.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.919+0000 7f8d78f9b700 1 -- 172.21.15.84:0/760122565 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d741e5600 con 0x7f8d64005200 2023-07-14T11:20:05.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.919+0000 7f8d78f9b700 1 --2- 172.21.15.84:0/760122565 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d64005200 0x7f8d740b7940 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f8d6800f820 tx=0x7f8d6800fb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:05.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.920+0000 7f8d717fa700 1 -- 172.21.15.84:0/760122565 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d680052e0 con 0x7f8d64005200 2023-07-14T11:20:05.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.920+0000 7f8d717fa700 1 -- 172.21.15.84:0/760122565 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d68005440 con 0x7f8d64005200 2023-07-14T11:20:05.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.920+0000 7f8d7b1ff700 1 -- 172.21.15.84:0/760122565 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d741e58e0 con 0x7f8d64005200 2023-07-14T11:20:05.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.920+0000 7f8d717fa700 1 -- 172.21.15.84:0/760122565 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d680038a0 con 0x7f8d64005200 2023-07-14T11:20:05.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.920+0000 7f8d7b1ff700 1 -- 172.21.15.84:0/760122565 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d741e63a0 con 0x7f8d64005200 2023-07-14T11:20:05.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.920+0000 7f8d7b1ff700 1 -- 172.21.15.84:0/760122565 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8d741e5490 con 0x7f8d64005200 2023-07-14T11:20:05.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.922+0000 7f8d717fa700 1 -- 172.21.15.84:0/760122565 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f8d68003a00 con 0x7f8d64005200 2023-07-14T11:20:05.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.923+0000 7f8d717fa700 1 --2- 172.21.15.84:0/760122565 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f8d5806ae90 0x7f8d5806d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:05.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.923+0000 7f8d717fa700 1 -- 172.21.15.84:0/760122565 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f8d68089370 con 0x7f8d64005200 2023-07-14T11:20:05.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.923+0000 7f8d717fa700 1 --2- 172.21.15.84:0/760122565 >> [v2:172.21.15.179:6800/3819177669,v1:172.21.15.179:6801/3819177669] conn(0x7f8d58071300 0x7f8d58073710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:05.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.923+0000 7f8d717fa700 1 -- 172.21.15.84:0/760122565 --> [v2:172.21.15.179:6800/3819177669,v1:172.21.15.179:6801/3819177669] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8d58073de0 con 0x7f8d58071300 2023-07-14T11:20:05.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.923+0000 7f8d717fa700 1 -- 172.21.15.84:0/760122565 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=109) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8d680896e0 con 0x7f8d64005200 2023-07-14T11:20:05.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.923+0000 7f8d73fff700 1 --2- 172.21.15.84:0/760122565 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f8d5806ae90 0x7f8d5806d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:05.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.924+0000 7f8d7979c700 1 --2- 172.21.15.84:0/760122565 >> [v2:172.21.15.179:6800/3819177669,v1:172.21.15.179:6801/3819177669] conn(0x7f8d58071300 0x7f8d58073710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:05.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.924+0000 7f8d73fff700 1 --2- 172.21.15.84:0/760122565 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f8d5806ae90 0x7f8d5806d340 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8d60001c90 tx=0x7f8d60000ed0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:05.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.924+0000 7f8d7979c700 1 --2- 172.21.15.84:0/760122565 >> [v2:172.21.15.179:6800/3819177669,v1:172.21.15.179:6801/3819177669] conn(0x7f8d58071300 0x7f8d58073710 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:05.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.925+0000 7f8d717fa700 1 -- 172.21.15.84:0/760122565 <== osd.4 v2:172.21.15.179:6800/3819177669 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f8d58073de0 con 0x7f8d58071300 2023-07-14T11:20:05.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.940+0000 7f8d7b1ff700 1 -- 172.21.15.84:0/760122565 --> [v2:172.21.15.179:6800/3819177669,v1:172.21.15.179:6801/3819177669] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f8d7406bd20 con 0x7f8d58071300 2023-07-14T11:20:05.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.940+0000 7f8d717fa700 1 -- 172.21.15.84:0/760122565 <== osd.4 v2:172.21.15.179:6800/3819177669 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f8d6c003a20 con 0x7f8d58071300 2023-07-14T11:20:05.943 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-07-14T11:20:05.944 INFO:teuthology.orchestra.run.smithi084.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-14T11:20:05.944 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-07-14T11:20:05.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.941+0000 7f8d7b1ff700 1 -- 172.21.15.84:0/760122565 >> [v2:172.21.15.179:6800/3819177669,v1:172.21.15.179:6801/3819177669] conn(0x7f8d58071300 msgr2=0x7f8d58073710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:05.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.941+0000 7f8d7b1ff700 1 --2- 172.21.15.84:0/760122565 >> [v2:172.21.15.179:6800/3819177669,v1:172.21.15.179:6801/3819177669] conn(0x7f8d58071300 0x7f8d58073710 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:05.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.941+0000 7f8d7b1ff700 1 -- 172.21.15.84:0/760122565 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f8d5806ae90 msgr2=0x7f8d5806d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:05.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.941+0000 7f8d7b1ff700 1 --2- 172.21.15.84:0/760122565 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f8d5806ae90 0x7f8d5806d340 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8d60001c90 tx=0x7f8d60000ed0 comp rx=0 tx=0).stop 2023-07-14T11:20:05.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.941+0000 7f8d7b1ff700 1 -- 172.21.15.84:0/760122565 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d64005200 msgr2=0x7f8d740b7940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:05.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.941+0000 7f8d7b1ff700 1 --2- 172.21.15.84:0/760122565 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d64005200 0x7f8d740b7940 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f8d6800f820 tx=0x7f8d6800fb30 comp rx=0 tx=0).stop 2023-07-14T11:20:05.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.941+0000 7f8d7979c700 1 -- 172.21.15.84:0/760122565 reap_dead start 2023-07-14T11:20:05.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.941+0000 7f8d7b1ff700 1 -- 172.21.15.84:0/760122565 shutdown_connections 2023-07-14T11:20:05.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.941+0000 7f8d7b1ff700 1 -- 172.21.15.84:0/760122565 >> 172.21.15.84:0/760122565 conn(0x7f8d7409c170 msgr2=0x7f8d740b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:20:05.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.941+0000 7f8d7b1ff700 1 -- 172.21.15.84:0/760122565 shutdown_connections 2023-07-14T11:20:05.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:05.941+0000 7f8d7b1ff700 1 -- 172.21.15.84:0/760122565 wait complete. 2023-07-14T11:20:05.960 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-07-14T11:20:06.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.154+0000 7f8ce27ff700 1 Processor -- start 2023-07-14T11:20:06.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.154+0000 7f8ce27ff700 1 -- start start 2023-07-14T11:20:06.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.155+0000 7f8ce27ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8cdc0c92d0 0x7f8cdc0ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:06.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.156+0000 7f8ce27ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8cdc0b12f0 0x7f8cdc0c96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:06.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.156+0000 7f8ce27ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cdc15ce70 con 0x7f8cdc0adea0 2023-07-14T11:20:06.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.156+0000 7f8ce27ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cdc15da60 con 0x7f8cdc0c92d0 2023-07-14T11:20:06.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.156+0000 7f8ce27ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cdc0c9be0 con 0x7f8cdc0b12f0 2023-07-14T11:20:06.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.156+0000 7f8cdbfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8cdc0c92d0 0x7f8cdc0ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:06.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.156+0000 7f8cdbfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8cdc0c92d0 0x7f8cdc0ad8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60268/0 (socket says 172.21.15.84:60268) 2023-07-14T11:20:06.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.156+0000 7f8cdbfff700 1 -- 172.21.15.84:0/3307129024 learned_addr learned my addr 172.21.15.84:0/3307129024 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:20:06.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.156+0000 7f8cdb7fe700 1 --2- 172.21.15.84:0/3307129024 >> v2:172.21.15.179:3300/0 conn(0x7f8cdc0b12f0 0x7f8cdc0c96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:06.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.156+0000 7f8cdbfff700 1 -- 172.21.15.84:0/3307129024 >> v2:172.21.15.179:3300/0 conn(0x7f8cdc0b12f0 msgr2=0x7f8cdc0c96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:20:06.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.156+0000 7f8cdbfff700 1 --2- 172.21.15.84:0/3307129024 >> v2:172.21.15.179:3300/0 conn(0x7f8cdc0b12f0 0x7f8cdc0c96a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:06.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.156+0000 7f8cdbfff700 1 -- 172.21.15.84:0/3307129024 >> v1:172.21.15.179:6789/0 conn(0x7f8cdc0adea0 legacy=0x7f8cdc06c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:06.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.156+0000 7f8cdbfff700 1 -- 172.21.15.84:0/3307129024 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cdc15d0c0 con 0x7f8cdc0c92d0 2023-07-14T11:20:06.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.157+0000 7f8cdbfff700 1 --2- 172.21.15.84:0/3307129024 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8cdc0c92d0 0x7f8cdc0ad8f0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc06d890 tx=0x7f8ccc00be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a72d81ae9cb362 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:06.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.157+0000 7f8cdaffd700 1 -- 172.21.15.84:0/3307129024 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ccc00dd30 con 0x7f8cdc0c92d0 2023-07-14T11:20:06.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.157+0000 7f8cdaffd700 1 -- 172.21.15.84:0/3307129024 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ccc00de90 con 0x7f8cdc0c92d0 2023-07-14T11:20:06.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.157+0000 7f8cdaffd700 1 -- 172.21.15.84:0/3307129024 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ccc010690 con 0x7f8cdc0c92d0 2023-07-14T11:20:06.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.157+0000 7f8ce27ff700 1 -- 172.21.15.84:0/3307129024 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8cdc0c92d0 msgr2=0x7f8cdc0ad8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:06.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.157+0000 7f8ce27ff700 1 --2- 172.21.15.84:0/3307129024 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8cdc0c92d0 0x7f8cdc0ad8f0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc06d890 tx=0x7f8ccc00be70 comp rx=0 tx=0).stop 2023-07-14T11:20:06.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.157+0000 7f8ce27ff700 1 -- 172.21.15.84:0/3307129024 shutdown_connections 2023-07-14T11:20:06.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.157+0000 7f8ce27ff700 1 --2- 172.21.15.84:0/3307129024 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8cdc0c92d0 0x7f8cdc0ad8f0 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:06.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.157+0000 7f8ce27ff700 1 --2- 172.21.15.84:0/3307129024 >> v2:172.21.15.179:3300/0 conn(0x7f8cdc0b12f0 0x7f8cdc0c96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:06.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.158+0000 7f8ce27ff700 1 -- 172.21.15.84:0/3307129024 >> 172.21.15.84:0/3307129024 conn(0x7f8cdc0b05d0 msgr2=0x7f8cdc0b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:20:06.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.158+0000 7f8ce27ff700 1 -- 172.21.15.84:0/3307129024 shutdown_connections 2023-07-14T11:20:06.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.158+0000 7f8ce27ff700 1 -- 172.21.15.84:0/3307129024 wait complete. 2023-07-14T11:20:06.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.159+0000 7f8ce27ff700 1 Processor -- start 2023-07-14T11:20:06.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.159+0000 7f8ce27ff700 1 -- start start 2023-07-14T11:20:06.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.160+0000 7f8ce27ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8cdc0adea0 0x7f8cdc0b18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:06.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.160+0000 7f8ce27ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8cdc0b12f0 0x7f8cdc0b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:06.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.160+0000 7f8ce27ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8cdc0c92d0 0x7f8cdc1f19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:06.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.160+0000 7f8ce27ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cdc153c10 con 0x7f8cdc0c92d0 2023-07-14T11:20:06.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.160+0000 7f8ce27ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cdc0c53c0 con 0x7f8cdc0b12f0 2023-07-14T11:20:06.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.160+0000 7f8ce27ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cdc144520 con 0x7f8cdc0adea0 2023-07-14T11:20:06.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.161+0000 7f8ce0d9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8cdc0c92d0 0x7f8cdc1f19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:06.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.161+0000 7f8ce0d9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8cdc0c92d0 0x7f8cdc1f19f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60276/0 (socket says 172.21.15.84:60276) 2023-07-14T11:20:06.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.161+0000 7f8ce0d9c700 1 -- 172.21.15.84:0/877047863 learned_addr learned my addr 172.21.15.84:0/877047863 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:20:06.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.161+0000 7f8cdbfff700 1 --2- 172.21.15.84:0/877047863 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8cdc0adea0 0x7f8cdc0b18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:06.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.161+0000 7f8cdb7fe700 1 --2- 172.21.15.84:0/877047863 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8cdc0b12f0 0x7f8cdc0b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:06.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.161+0000 7f8ce0d9c700 1 -- 172.21.15.84:0/877047863 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8cdc0adea0 msgr2=0x7f8cdc0b18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:06.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.161+0000 7f8ce0d9c700 1 --2- 172.21.15.84:0/877047863 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8cdc0adea0 0x7f8cdc0b18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:06.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.161+0000 7f8ce0d9c700 1 -- 172.21.15.84:0/877047863 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8cdc0b12f0 msgr2=0x7f8cdc0b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:06.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.161+0000 7f8ce0d9c700 1 --2- 172.21.15.84:0/877047863 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8cdc0b12f0 0x7f8cdc0b1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:06.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.161+0000 7f8ce0d9c700 1 -- 172.21.15.84:0/877047863 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ccc00b7f0 con 0x7f8cdc0c92d0 2023-07-14T11:20:06.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.161+0000 7f8ce0d9c700 1 --2- 172.21.15.84:0/877047863 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8cdc0c92d0 0x7f8cdc1f19f0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f8cd400cc50 tx=0x7f8cd400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:06.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.162+0000 7f8cd8ff9700 1 -- 172.21.15.84:0/877047863 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd4003c00 con 0x7f8cdc0c92d0 2023-07-14T11:20:06.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.162+0000 7f8cd8ff9700 1 -- 172.21.15.84:0/877047863 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cd4003d60 con 0x7f8cdc0c92d0 2023-07-14T11:20:06.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.162+0000 7f8ce27ff700 1 -- 172.21.15.84:0/877047863 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cdc144800 con 0x7f8cdc0c92d0 2023-07-14T11:20:06.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.162+0000 7f8cd8ff9700 1 -- 172.21.15.84:0/877047863 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd400aab0 con 0x7f8cdc0c92d0 2023-07-14T11:20:06.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.162+0000 7f8ce27ff700 1 -- 172.21.15.84:0/877047863 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cdc153e60 con 0x7f8cdc0c92d0 2023-07-14T11:20:06.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.163+0000 7f8ce27ff700 1 -- 172.21.15.84:0/877047863 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cdc074350 con 0x7f8cdc0c92d0 2023-07-14T11:20:06.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.164+0000 7f8cd8ff9700 1 -- 172.21.15.84:0/877047863 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f8cd400ac10 con 0x7f8cdc0c92d0 2023-07-14T11:20:06.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.165+0000 7f8cd8ff9700 1 --2- 172.21.15.84:0/877047863 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f8cc806ae90 0x7f8cc806d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:06.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.165+0000 7f8cd8ff9700 1 -- 172.21.15.84:0/877047863 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f8cd4089450 con 0x7f8cdc0c92d0 2023-07-14T11:20:06.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.166+0000 7f8cdbfff700 1 --2- 172.21.15.84:0/877047863 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f8cc806ae90 0x7f8cc806d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:06.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.167+0000 7f8cdbfff700 1 --2- 172.21.15.84:0/877047863 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f8cc806ae90 0x7f8cc806d340 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc00b6f0 tx=0x7f8ccc012000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:06.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.170+0000 7f8cd8ff9700 1 -- 172.21.15.84:0/877047863 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f8cd4054580 con 0x7f8cdc0c92d0 2023-07-14T11:20:06.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.365+0000 7f8ce27ff700 1 -- 172.21.15.84:0/877047863 --> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f8cdc15d680 con 0x7f8cc806ae90 2023-07-14T11:20:06.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.366+0000 7f8cd8ff9700 1 -- 172.21.15.84:0/877047863 <== mgr.4100 v2:172.21.15.179:6836/2094253834 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f8ccc020040 con 0x7f8cc806ae90 2023-07-14T11:20:06.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.368+0000 7f8ce27ff700 1 -- 172.21.15.84:0/877047863 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f8cc806ae90 msgr2=0x7f8cc806d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:06.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.368+0000 7f8ce27ff700 1 --2- 172.21.15.84:0/877047863 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f8cc806ae90 0x7f8cc806d340 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc00b6f0 tx=0x7f8ccc012000 comp rx=0 tx=0).stop 2023-07-14T11:20:06.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.368+0000 7f8ce27ff700 1 -- 172.21.15.84:0/877047863 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8cdc0c92d0 msgr2=0x7f8cdc1f19f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:06.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.368+0000 7f8ce27ff700 1 --2- 172.21.15.84:0/877047863 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8cdc0c92d0 0x7f8cdc1f19f0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f8cd400cc50 tx=0x7f8cd400cf60 comp rx=0 tx=0).stop 2023-07-14T11:20:06.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.369+0000 7f8ce27ff700 1 -- 172.21.15.84:0/877047863 shutdown_connections 2023-07-14T11:20:06.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.369+0000 7f8ce27ff700 1 --2- 172.21.15.84:0/877047863 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f8cc806ae90 0x7f8cc806d340 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:06.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.369+0000 7f8ce27ff700 1 --2- 172.21.15.84:0/877047863 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8cdc0adea0 0x7f8cdc0b18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:06.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.369+0000 7f8ce27ff700 1 --2- 172.21.15.84:0/877047863 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8cdc0c92d0 0x7f8cdc1f19f0 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:06.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.369+0000 7f8ce27ff700 1 --2- 172.21.15.84:0/877047863 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8cdc0b12f0 0x7f8cdc0b1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:06.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.369+0000 7f8ce27ff700 1 -- 172.21.15.84:0/877047863 >> 172.21.15.84:0/877047863 conn(0x7f8cdc0b05d0 msgr2=0x7f8cdc0ad740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:20:06.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.369+0000 7f8ce27ff700 1 -- 172.21.15.84:0/877047863 shutdown_connections 2023-07-14T11:20:06.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.369+0000 7f8ce27ff700 1 -- 172.21.15.84:0/877047863 wait complete. 2023-07-14T11:20:06.374 INFO:teuthology.orchestra.run.smithi084.stderr:instructed osd(s) 4 to deep-scrub 2023-07-14T11:20:06.389 INFO:tasks.ceph:Scrubbing osd.5 2023-07-14T11:20:06.390 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-07-14T11:20:06.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.585+0000 7fd1ee5ff700 1 Processor -- start 2023-07-14T11:20:06.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.586+0000 7fd1ee5ff700 1 -- start start 2023-07-14T11:20:06.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.587+0000 7fd1ee5ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd1e815cc70 0x7fd1e80cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:06.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.587+0000 7fd1ee5ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd1e8071590 0x7fd1e81610d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:06.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.587+0000 7fd1ee5ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1e8161610 con 0x7fd1e8069f30 2023-07-14T11:20:06.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.587+0000 7fd1ee5ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1e80ca4d0 con 0x7fd1e815cc70 2023-07-14T11:20:06.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.587+0000 7fd1ee5ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1e815d040 con 0x7fd1e8071590 2023-07-14T11:20:06.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.587+0000 7fd1e7fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd1e815cc70 0x7fd1e80cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:06.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.587+0000 7fd1e7fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd1e815cc70 0x7fd1e80cbae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60278/0 (socket says 172.21.15.84:60278) 2023-07-14T11:20:06.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.587+0000 7fd1e7fff700 1 -- 172.21.15.84:0/721806984 learned_addr learned my addr 172.21.15.84:0/721806984 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:20:06.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.587+0000 7fd1e77fe700 1 --2- 172.21.15.84:0/721806984 >> v2:172.21.15.179:3300/0 conn(0x7fd1e8071590 0x7fd1e81610d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:06.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.587+0000 7fd1e7fff700 1 -- 172.21.15.84:0/721806984 >> v2:172.21.15.179:3300/0 conn(0x7fd1e8071590 msgr2=0x7fd1e81610d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:20:06.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.587+0000 7fd1e7fff700 1 --2- 172.21.15.84:0/721806984 >> v2:172.21.15.179:3300/0 conn(0x7fd1e8071590 0x7fd1e81610d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:06.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.588+0000 7fd1e7fff700 1 -- 172.21.15.84:0/721806984 >> v1:172.21.15.179:6789/0 conn(0x7fd1e8069f30 legacy=0x7fd1e80cd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:06.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.588+0000 7fd1e7fff700 1 -- 172.21.15.84:0/721806984 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1e8070860 con 0x7fd1e815cc70 2023-07-14T11:20:06.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.588+0000 7fd1e7fff700 1 --2- 172.21.15.84:0/721806984 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1e815cc70 0x7fd1e80cbae0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7fd1e80b25c0 tx=0x7fd1d8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3b86e4eb3c4c351 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:06.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.588+0000 7fd1e6ffd700 1 -- 172.21.15.84:0/721806984 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d800b860 con 0x7fd1e815cc70 2023-07-14T11:20:06.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.588+0000 7fd1e6ffd700 1 -- 172.21.15.84:0/721806984 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1d800b9c0 con 0x7fd1e815cc70 2023-07-14T11:20:06.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.588+0000 7fd1e6ffd700 1 -- 172.21.15.84:0/721806984 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d800bd50 con 0x7fd1e815cc70 2023-07-14T11:20:06.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.589+0000 7fd1ee5ff700 1 -- 172.21.15.84:0/721806984 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1e815cc70 msgr2=0x7fd1e80cbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:06.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.589+0000 7fd1ee5ff700 1 --2- 172.21.15.84:0/721806984 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1e815cc70 0x7fd1e80cbae0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7fd1e80b25c0 tx=0x7fd1d8009c00 comp rx=0 tx=0).stop 2023-07-14T11:20:06.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.589+0000 7fd1ee5ff700 1 -- 172.21.15.84:0/721806984 shutdown_connections 2023-07-14T11:20:06.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.589+0000 7fd1ee5ff700 1 --2- 172.21.15.84:0/721806984 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1e815cc70 0x7fd1e80cbae0 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:06.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.589+0000 7fd1ee5ff700 1 --2- 172.21.15.84:0/721806984 >> v2:172.21.15.179:3300/0 conn(0x7fd1e8071590 0x7fd1e81610d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:06.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.589+0000 7fd1ee5ff700 1 -- 172.21.15.84:0/721806984 >> 172.21.15.84:0/721806984 conn(0x7fd1e80cd180 msgr2=0x7fd1e80cfac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:20:06.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.589+0000 7fd1ee5ff700 1 -- 172.21.15.84:0/721806984 shutdown_connections 2023-07-14T11:20:06.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.589+0000 7fd1ee5ff700 1 -- 172.21.15.84:0/721806984 wait complete. 2023-07-14T11:20:06.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.590+0000 7fd1ee5ff700 1 Processor -- start 2023-07-14T11:20:06.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.591+0000 7fd1ee5ff700 1 -- start start 2023-07-14T11:20:06.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.591+0000 7fd1ee5ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1e8069f30 0x7fd1e80b28f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:06.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.591+0000 7fd1ee5ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1e8071590 0x7fd1e815a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:06.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.591+0000 7fd1ee5ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1e815cc70 0x7fd1e815f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:06.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.592+0000 7fd1ee5ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e815ad00 con 0x7fd1e8069f30 2023-07-14T11:20:06.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.592+0000 7fd1ee5ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e80b2e30 con 0x7fd1e815cc70 2023-07-14T11:20:06.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.592+0000 7fd1ee5ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e80c4310 con 0x7fd1e8071590 2023-07-14T11:20:06.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.592+0000 7fd1e7fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1e8069f30 0x7fd1e80b28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:06.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.592+0000 7fd1e7fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1e8069f30 0x7fd1e80b28f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60286/0 (socket says 172.21.15.84:60286) 2023-07-14T11:20:06.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.592+0000 7fd1e7fff700 1 -- 172.21.15.84:0/4144468600 learned_addr learned my addr 172.21.15.84:0/4144468600 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:20:06.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.592+0000 7fd1ecb9c700 1 --2- 172.21.15.84:0/4144468600 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1e815cc70 0x7fd1e815f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:06.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.592+0000 7fd1e77fe700 1 --2- 172.21.15.84:0/4144468600 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1e8071590 0x7fd1e815a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:06.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.592+0000 7fd1e7fff700 1 -- 172.21.15.84:0/4144468600 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1e8071590 msgr2=0x7fd1e815a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:06.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.592+0000 7fd1e7fff700 1 --2- 172.21.15.84:0/4144468600 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1e8071590 0x7fd1e815a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:06.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.592+0000 7fd1e7fff700 1 -- 172.21.15.84:0/4144468600 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1e815cc70 msgr2=0x7fd1e815f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:06.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.592+0000 7fd1e7fff700 1 --2- 172.21.15.84:0/4144468600 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1e815cc70 0x7fd1e815f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:06.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.592+0000 7fd1e7fff700 1 -- 172.21.15.84:0/4144468600 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1d8009550 con 0x7fd1e8069f30 2023-07-14T11:20:06.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.592+0000 7fd1e7fff700 1 --2- 172.21.15.84:0/4144468600 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1e8069f30 0x7fd1e80b28f0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7fd1d8000c00 tx=0x7fd1d8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:06.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.593+0000 7fd1e4ff9700 1 -- 172.21.15.84:0/4144468600 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d8004380 con 0x7fd1e8069f30 2023-07-14T11:20:06.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.593+0000 7fd1e4ff9700 1 -- 172.21.15.84:0/4144468600 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1d801f070 con 0x7fd1e8069f30 2023-07-14T11:20:06.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.593+0000 7fd1ee5ff700 1 -- 172.21.15.84:0/4144468600 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1e80b3040 con 0x7fd1e8069f30 2023-07-14T11:20:06.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.593+0000 7fd1e4ff9700 1 -- 172.21.15.84:0/4144468600 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d80036a0 con 0x7fd1e8069f30 2023-07-14T11:20:06.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.593+0000 7fd1ee5ff700 1 -- 172.21.15.84:0/4144468600 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1e80b3600 con 0x7fd1e8069f30 2023-07-14T11:20:06.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.594+0000 7fd1ee5ff700 1 -- 172.21.15.84:0/4144468600 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd1e80cc180 con 0x7fd1e8069f30 2023-07-14T11:20:06.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.595+0000 7fd1e4ff9700 1 -- 172.21.15.84:0/4144468600 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) v1 ==== 89190+0+0 (secure 0 0 0) 0x7fd1d8021030 con 0x7fd1e8069f30 2023-07-14T11:20:06.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.596+0000 7fd1e4ff9700 1 --2- 172.21.15.84:0/4144468600 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fd1d406ae90 0x7fd1d406d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:06.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.596+0000 7fd1e4ff9700 1 -- 172.21.15.84:0/4144468600 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fd1d808a880 con 0x7fd1e8069f30 2023-07-14T11:20:06.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.596+0000 7fd1e4ff9700 1 --2- 172.21.15.84:0/4144468600 >> [v2:172.21.15.179:6816/446039797,v1:172.21.15.179:6817/446039797] conn(0x7fd1d4071300 0x7fd1d4073710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:06.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.596+0000 7fd1e4ff9700 1 -- 172.21.15.84:0/4144468600 --> [v2:172.21.15.179:6816/446039797,v1:172.21.15.179:6817/446039797] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd1d4073de0 con 0x7fd1d4071300 2023-07-14T11:20:06.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.596+0000 7fd1e4ff9700 1 -- 172.21.15.84:0/4144468600 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=109) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd1d808ce60 con 0x7fd1e8069f30 2023-07-14T11:20:06.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.596+0000 7fd1e77fe700 1 --2- 172.21.15.84:0/4144468600 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fd1d406ae90 0x7fd1d406d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:06.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.596+0000 7fd1ecb9c700 1 --2- 172.21.15.84:0/4144468600 >> [v2:172.21.15.179:6816/446039797,v1:172.21.15.179:6817/446039797] conn(0x7fd1d4071300 0x7fd1d4073710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:06.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.597+0000 7fd1e77fe700 1 --2- 172.21.15.84:0/4144468600 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fd1d406ae90 0x7fd1d406d340 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd1e80c6820 tx=0x7fd1dc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:06.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.597+0000 7fd1ecb9c700 1 --2- 172.21.15.84:0/4144468600 >> [v2:172.21.15.179:6816/446039797,v1:172.21.15.179:6817/446039797] conn(0x7fd1d4071300 0x7fd1d4073710 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:06.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.598+0000 7fd1e4ff9700 1 -- 172.21.15.84:0/4144468600 <== osd.5 v2:172.21.15.179:6816/446039797 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fd1d4073de0 con 0x7fd1d4071300 2023-07-14T11:20:06.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.613+0000 7fd1ee5ff700 1 -- 172.21.15.84:0/4144468600 --> [v2:172.21.15.179:6816/446039797,v1:172.21.15.179:6817/446039797] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd1e8071100 con 0x7fd1d4071300 2023-07-14T11:20:06.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.614+0000 7fd1e4ff9700 1 -- 172.21.15.84:0/4144468600 <== osd.5 v2:172.21.15.179:6816/446039797 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fd1e0001f20 con 0x7fd1d4071300 2023-07-14T11:20:06.620 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-07-14T11:20:06.621 INFO:teuthology.orchestra.run.smithi084.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-14T11:20:06.621 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-07-14T11:20:06.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.614+0000 7fd1ee5ff700 1 -- 172.21.15.84:0/4144468600 >> [v2:172.21.15.179:6816/446039797,v1:172.21.15.179:6817/446039797] conn(0x7fd1d4071300 msgr2=0x7fd1d4073710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:06.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.614+0000 7fd1ee5ff700 1 --2- 172.21.15.84:0/4144468600 >> [v2:172.21.15.179:6816/446039797,v1:172.21.15.179:6817/446039797] conn(0x7fd1d4071300 0x7fd1d4073710 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:06.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.614+0000 7fd1ee5ff700 1 -- 172.21.15.84:0/4144468600 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fd1d406ae90 msgr2=0x7fd1d406d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:06.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.614+0000 7fd1ee5ff700 1 --2- 172.21.15.84:0/4144468600 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fd1d406ae90 0x7fd1d406d340 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd1e80c6820 tx=0x7fd1dc008040 comp rx=0 tx=0).stop 2023-07-14T11:20:06.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.614+0000 7fd1ee5ff700 1 -- 172.21.15.84:0/4144468600 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1e8069f30 msgr2=0x7fd1e80b28f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:06.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.614+0000 7fd1ee5ff700 1 --2- 172.21.15.84:0/4144468600 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1e8069f30 0x7fd1e80b28f0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7fd1d8000c00 tx=0x7fd1d8004750 comp rx=0 tx=0).stop 2023-07-14T11:20:06.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.614+0000 7fd1ecb9c700 1 -- 172.21.15.84:0/4144468600 reap_dead start 2023-07-14T11:20:06.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.614+0000 7fd1ee5ff700 1 -- 172.21.15.84:0/4144468600 shutdown_connections 2023-07-14T11:20:06.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.614+0000 7fd1ee5ff700 1 -- 172.21.15.84:0/4144468600 >> 172.21.15.84:0/4144468600 conn(0x7fd1e80cd180 msgr2=0x7fd1e815bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:20:06.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.614+0000 7fd1ee5ff700 1 -- 172.21.15.84:0/4144468600 shutdown_connections 2023-07-14T11:20:06.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.614+0000 7fd1ee5ff700 1 -- 172.21.15.84:0/4144468600 wait complete. 2023-07-14T11:20:06.633 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-07-14T11:20:06.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.827+0000 7f88cb1ff700 1 Processor -- start 2023-07-14T11:20:06.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.828+0000 7f88cb1ff700 1 -- start start 2023-07-14T11:20:06.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.829+0000 7f88cb1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88c415c860 0x7f88c40d1e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:06.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.829+0000 7f88cb1ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f88c40c71b0 0x7f88c40b49d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:06.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.829+0000 7f88cb1ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88c40cf710 con 0x7f88c40cf2a0 2023-07-14T11:20:06.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.829+0000 7f88cb1ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88c4146740 con 0x7f88c40c71b0 2023-07-14T11:20:06.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.829+0000 7f88cb1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88c40cd5a0 con 0x7f88c415c860 2023-07-14T11:20:06.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.829+0000 7f88c3fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f88c40cf2a0 0x7f88c40c6aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49508/0 (socket says 172.21.15.84:49508) 2023-07-14T11:20:06.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.829+0000 7f88c3fff700 1 -- 172.21.15.84:0/2055948938 learned_addr learned my addr 172.21.15.84:0/2055948938 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:20:06.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.829+0000 7f88c979c700 1 --2- 172.21.15.84:0/2055948938 >> v2:172.21.15.179:3300/0 conn(0x7f88c40c71b0 0x7f88c40b49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:06.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.829+0000 7f88c37fe700 1 -- 172.21.15.84:0/2055948938 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3130773882 0 0) 0x7f88b0001110 con 0x7f88c40cf2a0 2023-07-14T11:20:06.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.830+0000 7f88c37fe700 1 -- 172.21.15.84:0/2055948938 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88b40035b0 con 0x7f88c40cf2a0 2023-07-14T11:20:06.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.830+0000 7f88c8f9b700 1 --2- 172.21.15.84:0/2055948938 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88c415c860 0x7f88c40d1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:06.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.830+0000 7f88c37fe700 1 -- 172.21.15.84:0/2055948938 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 579648425 0 0) 0x7f88b40035b0 con 0x7f88c40cf2a0 2023-07-14T11:20:06.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.830+0000 7f88c37fe700 1 -- 172.21.15.84:0/2055948938 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88c415c860 msgr2=0x7f88c40d1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:20:06.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.830+0000 7f88c37fe700 1 --2- 172.21.15.84:0/2055948938 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88c415c860 0x7f88c40d1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:06.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.830+0000 7f88c37fe700 1 -- 172.21.15.84:0/2055948938 >> v2:172.21.15.179:3300/0 conn(0x7f88c40c71b0 msgr2=0x7f88c40b49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:20:06.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.830+0000 7f88c37fe700 1 --2- 172.21.15.84:0/2055948938 >> v2:172.21.15.179:3300/0 conn(0x7f88c40c71b0 0x7f88c40b49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:06.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.830+0000 7f88c37fe700 1 -- 172.21.15.84:0/2055948938 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c40cd7f0 con 0x7f88c40cf2a0 2023-07-14T11:20:06.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.830+0000 7f88c37fe700 1 -- 172.21.15.84:0/2055948938 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7f88b0001800 con 0x7f88c40cf2a0 2023-07-14T11:20:06.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.830+0000 7f88c37fe700 1 -- 172.21.15.84:0/2055948938 >> v1:172.21.15.84:6789/0 conn(0x7f88c40cf2a0 legacy=0x7f88c40c6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:06.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.830+0000 7f88c37fe700 1 --2- 172.21.15.84:0/2055948938 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88c415c860 0x7f88b4003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:06.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.830+0000 7f88c37fe700 1 --2- 172.21.15.84:0/2055948938 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88b4003fd0 0x7f88b4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:06.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.830+0000 7f88c37fe700 1 --2- 172.21.15.84:0/2055948938 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88b4004d90 0x7f88b4005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:06.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.830+0000 7f88c37fe700 1 -- 172.21.15.84:0/2055948938 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c40cd5a0 con 0x7f88b4004d90 2023-07-14T11:20:06.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.830+0000 7f88c37fe700 1 -- 172.21.15.84:0/2055948938 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b400ba10 con 0x7f88b4003fd0 2023-07-14T11:20:06.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.830+0000 7f88c37fe700 1 -- 172.21.15.84:0/2055948938 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88b400bb50 con 0x7f88c415c860 2023-07-14T11:20:06.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.830+0000 7f88c979c700 1 --2- 172.21.15.84:0/2055948938 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88b4004d90 0x7f88b4005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:06.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.830+0000 7f88c8f9b700 1 --2- 172.21.15.84:0/2055948938 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88c415c860 0x7f88b4003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:06.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.830+0000 7f88c3fff700 1 --2- 172.21.15.84:0/2055948938 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88b4003fd0 0x7f88b4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:06.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.831+0000 7f88c979c700 1 -- 172.21.15.84:0/2055948938 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88c415c860 msgr2=0x7f88b4003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:20:06.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.831+0000 7f88c979c700 1 --2- 172.21.15.84:0/2055948938 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88c415c860 0x7f88b4003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:06.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.831+0000 7f88c979c700 1 -- 172.21.15.84:0/2055948938 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88b4003fd0 msgr2=0x7f88b4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:20:06.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.831+0000 7f88c979c700 1 --2- 172.21.15.84:0/2055948938 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88b4003fd0 0x7f88b4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:06.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.831+0000 7f88c979c700 1 -- 172.21.15.84:0/2055948938 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b40035b0 con 0x7f88b4004d90 2023-07-14T11:20:06.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.831+0000 7f88c979c700 1 --2- 172.21.15.84:0/2055948938 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88b4004d90 0x7f88b4005200 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f88bc009fc0 tx=0x7f88b4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da775b8f3a5e5690 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:06.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.831+0000 7f88c37fe700 1 -- 172.21.15.84:0/2055948938 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88bc00ec30 con 0x7f88b4004d90 2023-07-14T11:20:06.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.831+0000 7f88c37fe700 1 -- 172.21.15.84:0/2055948938 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88bc00f040 con 0x7f88b4004d90 2023-07-14T11:20:06.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.831+0000 7f88c37fe700 1 -- 172.21.15.84:0/2055948938 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88bc014480 con 0x7f88b4004d90 2023-07-14T11:20:06.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.832+0000 7f88cb1ff700 1 -- 172.21.15.84:0/2055948938 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88b4004d90 msgr2=0x7f88b4005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:06.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.832+0000 7f88cb1ff700 1 --2- 172.21.15.84:0/2055948938 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88b4004d90 0x7f88b4005200 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f88bc009fc0 tx=0x7f88b4005880 comp rx=0 tx=0).stop 2023-07-14T11:20:06.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.832+0000 7f88c979c700 1 -- 172.21.15.84:0/2055948938 reap_dead start 2023-07-14T11:20:06.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.832+0000 7f88cb1ff700 1 -- 172.21.15.84:0/2055948938 shutdown_connections 2023-07-14T11:20:06.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.832+0000 7f88cb1ff700 1 -- 172.21.15.84:0/2055948938 >> 172.21.15.84:0/2055948938 conn(0x7f88c4065bd0 msgr2=0x7f88c4065fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:20:06.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.832+0000 7f88cb1ff700 1 -- 172.21.15.84:0/2055948938 shutdown_connections 2023-07-14T11:20:06.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.832+0000 7f88cb1ff700 1 -- 172.21.15.84:0/2055948938 wait complete. 2023-07-14T11:20:06.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.834+0000 7f88cb1ff700 1 Processor -- start 2023-07-14T11:20:06.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.834+0000 7f88cb1ff700 1 -- start start 2023-07-14T11:20:06.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.835+0000 7f88cb1ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88b4004d90 0x7f88c4156520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:06.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.835+0000 7f88cb1ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88c40ca130 0x7f88c40b7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:06.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.835+0000 7f88cb1ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88c415b5a0 0x7f88c415de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:06.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.835+0000 7f88cb1ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c415dca0 con 0x7f88c415b5a0 2023-07-14T11:20:06.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.835+0000 7f88cb1ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c4156a60 con 0x7f88c40ca130 2023-07-14T11:20:06.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.835+0000 7f88cb1ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88c415d6e0 con 0x7f88b4004d90 2023-07-14T11:20:06.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.835+0000 7f88c979c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88c415b5a0 0x7f88c415de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:06.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.835+0000 7f88c979c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88c415b5a0 0x7f88c415de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60302/0 (socket says 172.21.15.84:60302) 2023-07-14T11:20:06.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.835+0000 7f88c979c700 1 -- 172.21.15.84:0/3107860731 learned_addr learned my addr 172.21.15.84:0/3107860731 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:20:06.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.835+0000 7f88c3fff700 1 --2- 172.21.15.84:0/3107860731 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88c40ca130 0x7f88c40b7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:06.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.835+0000 7f88c8f9b700 1 --2- 172.21.15.84:0/3107860731 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88b4004d90 0x7f88c4156520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:06.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.835+0000 7f88c979c700 1 -- 172.21.15.84:0/3107860731 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88b4004d90 msgr2=0x7f88c4156520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:06.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.835+0000 7f88c979c700 1 --2- 172.21.15.84:0/3107860731 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88b4004d90 0x7f88c4156520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:06.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.835+0000 7f88c979c700 1 -- 172.21.15.84:0/3107860731 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88c40ca130 msgr2=0x7f88c40b7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:06.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.835+0000 7f88c979c700 1 --2- 172.21.15.84:0/3107860731 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88c40ca130 0x7f88c40b7ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:06.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.835+0000 7f88c979c700 1 -- 172.21.15.84:0/3107860731 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c415d9c0 con 0x7f88c415b5a0 2023-07-14T11:20:06.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.836+0000 7f88c979c700 1 --2- 172.21.15.84:0/3107860731 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88c415b5a0 0x7f88c415de10 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f88bc016000 tx=0x7f88bc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:06.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.836+0000 7f88c17fa700 1 -- 172.21.15.84:0/3107860731 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88bc007000 con 0x7f88c415b5a0 2023-07-14T11:20:06.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.836+0000 7f88c17fa700 1 -- 172.21.15.84:0/3107860731 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88bc003e50 con 0x7f88c415b5a0 2023-07-14T11:20:06.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.836+0000 7f88cb1ff700 1 -- 172.21.15.84:0/3107860731 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88c40b5f20 con 0x7f88c415b5a0 2023-07-14T11:20:06.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.836+0000 7f88c17fa700 1 -- 172.21.15.84:0/3107860731 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88bc014aa0 con 0x7f88c415b5a0 2023-07-14T11:20:06.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.836+0000 7f88cb1ff700 1 -- 172.21.15.84:0/3107860731 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88c40b8010 con 0x7f88c415b5a0 2023-07-14T11:20:06.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.838+0000 7f88cb1ff700 1 -- 172.21.15.84:0/3107860731 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88c40b81d0 con 0x7f88c415b5a0 2023-07-14T11:20:06.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.838+0000 7f88c17fa700 1 -- 172.21.15.84:0/3107860731 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f88bc024020 con 0x7f88c415b5a0 2023-07-14T11:20:06.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.839+0000 7f88c17fa700 1 --2- 172.21.15.84:0/3107860731 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f88a806ae90 0x7f88a806d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:06.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.840+0000 7f88c17fa700 1 -- 172.21.15.84:0/3107860731 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f88bc08ac30 con 0x7f88c415b5a0 2023-07-14T11:20:06.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.840+0000 7f88c8f9b700 1 --2- 172.21.15.84:0/3107860731 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f88a806ae90 0x7f88a806d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:06.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.841+0000 7f88c8f9b700 1 --2- 172.21.15.84:0/3107860731 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f88a806ae90 0x7f88a806d340 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f88c40cd190 tx=0x7f88b8009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:06.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:06.844+0000 7f88c17fa700 1 -- 172.21.15.84:0/3107860731 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f88bc055e90 con 0x7f88c415b5a0 2023-07-14T11:20:07.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.040+0000 7f88cb1ff700 1 -- 172.21.15.84:0/3107860731 --> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f88c40d1640 con 0x7f88a806ae90 2023-07-14T11:20:07.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.040+0000 7f88c17fa700 1 -- 172.21.15.84:0/3107860731 <== mgr.4100 v2:172.21.15.179:6836/2094253834 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f88b8019070 con 0x7f88a806ae90 2023-07-14T11:20:07.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.043+0000 7f88cb1ff700 1 -- 172.21.15.84:0/3107860731 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f88a806ae90 msgr2=0x7f88a806d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:07.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.043+0000 7f88cb1ff700 1 --2- 172.21.15.84:0/3107860731 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f88a806ae90 0x7f88a806d340 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f88c40cd190 tx=0x7f88b8009210 comp rx=0 tx=0).stop 2023-07-14T11:20:07.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.043+0000 7f88cb1ff700 1 -- 172.21.15.84:0/3107860731 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88c415b5a0 msgr2=0x7f88c415de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:07.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.043+0000 7f88cb1ff700 1 --2- 172.21.15.84:0/3107860731 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88c415b5a0 0x7f88c415de10 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f88bc016000 tx=0x7f88bc009750 comp rx=0 tx=0).stop 2023-07-14T11:20:07.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.043+0000 7f88cb1ff700 1 -- 172.21.15.84:0/3107860731 shutdown_connections 2023-07-14T11:20:07.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.043+0000 7f88cb1ff700 1 --2- 172.21.15.84:0/3107860731 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f88a806ae90 0x7f88a806d340 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:07.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.043+0000 7f88cb1ff700 1 --2- 172.21.15.84:0/3107860731 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88b4004d90 0x7f88c4156520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:07.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.043+0000 7f88cb1ff700 1 --2- 172.21.15.84:0/3107860731 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88c415b5a0 0x7f88c415de10 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:07.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.043+0000 7f88cb1ff700 1 --2- 172.21.15.84:0/3107860731 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88c40ca130 0x7f88c40b7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:07.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.043+0000 7f88cb1ff700 1 -- 172.21.15.84:0/3107860731 >> 172.21.15.84:0/3107860731 conn(0x7f88c4065bd0 msgr2=0x7f88c4158260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:20:07.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.043+0000 7f88cb1ff700 1 -- 172.21.15.84:0/3107860731 shutdown_connections 2023-07-14T11:20:07.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.043+0000 7f88cb1ff700 1 -- 172.21.15.84:0/3107860731 wait complete. 2023-07-14T11:20:07.048 INFO:teuthology.orchestra.run.smithi084.stderr:instructed osd(s) 5 to deep-scrub 2023-07-14T11:20:07.063 INFO:tasks.ceph:Scrubbing osd.6 2023-07-14T11:20:07.064 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-07-14T11:20:07.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.259+0000 7f84719ff700 1 Processor -- start 2023-07-14T11:20:07.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.260+0000 7f84719ff700 1 -- start start 2023-07-14T11:20:07.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.261+0000 7f84719ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f846c15c890 0x7f846c0d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:07.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.261+0000 7f84719ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f846c0d0660 con 0x7f846c0b2440 2023-07-14T11:20:07.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.261+0000 7f84719ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f846c15cc60 con 0x7f846c06c240 2023-07-14T11:20:07.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.261+0000 7f84719ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f846c06a7f0 con 0x7f846c15c890 2023-07-14T11:20:07.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.261+0000 7f846a7fc700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f846c0b2440 0x7f846c0cf840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49520/0 (socket says 172.21.15.84:49520) 2023-07-14T11:20:07.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.261+0000 7f846a7fc700 1 -- 172.21.15.84:0/284691828 learned_addr learned my addr 172.21.15.84:0/284691828 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:20:07.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.261+0000 7f846affd700 1 --2- 172.21.15.84:0/284691828 >> v2:172.21.15.179:3300/0 conn(0x7f846c15c890 0x7f846c0d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:07.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.261+0000 7f8469ffb700 1 -- 172.21.15.84:0/284691828 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2049480707 0 0) 0x7f846c0d0660 con 0x7f846c0b2440 2023-07-14T11:20:07.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.262+0000 7f8469ffb700 1 -- 172.21.15.84:0/284691828 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84540035b0 con 0x7f846c0b2440 2023-07-14T11:20:07.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.262+0000 7f8469ffb700 1 -- 172.21.15.84:0/284691828 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2709660057 0 0) 0x7f84540035b0 con 0x7f846c0b2440 2023-07-14T11:20:07.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.262+0000 7f8469ffb700 1 -- 172.21.15.84:0/284691828 >> v2:172.21.15.179:3300/0 conn(0x7f846c15c890 msgr2=0x7f846c0d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:20:07.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.262+0000 7f8469ffb700 1 --2- 172.21.15.84:0/284691828 >> v2:172.21.15.179:3300/0 conn(0x7f846c15c890 0x7f846c0d0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:07.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.262+0000 7f8469ffb700 1 -- 172.21.15.84:0/284691828 >> v1:172.21.15.179:6789/0 conn(0x7f846c06c240 legacy=0x7f846c0cff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:07.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.262+0000 7f8469ffb700 1 -- 172.21.15.84:0/284691828 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f846c06b760 con 0x7f846c0b2440 2023-07-14T11:20:07.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.262+0000 7f8469ffb700 1 -- 172.21.15.84:0/284691828 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2873556736 0 0) 0x7f8460001670 con 0x7f846c0b2440 2023-07-14T11:20:07.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.262+0000 7f8469ffb700 1 -- 172.21.15.84:0/284691828 >> v1:172.21.15.84:6789/0 conn(0x7f846c0b2440 legacy=0x7f846c0cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:07.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.262+0000 7f8469ffb700 1 --2- 172.21.15.84:0/284691828 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8454003ac0 0x7f8454003ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:07.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.262+0000 7f8469ffb700 1 --2- 172.21.15.84:0/284691828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8454004850 0x7f8454004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:07.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.262+0000 7f8469ffb700 1 --2- 172.21.15.84:0/284691828 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8454005200 0x7f845400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:07.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.262+0000 7f8469ffb700 1 -- 172.21.15.84:0/284691828 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f846c06a7f0 con 0x7f8454004850 2023-07-14T11:20:07.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.262+0000 7f8469ffb700 1 -- 172.21.15.84:0/284691828 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845400c140 con 0x7f8454003ac0 2023-07-14T11:20:07.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.262+0000 7f8469ffb700 1 -- 172.21.15.84:0/284691828 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f845400c300 con 0x7f8454005200 2023-07-14T11:20:07.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.262+0000 7f846affd700 1 --2- 172.21.15.84:0/284691828 >> v2:172.21.15.179:3300/0 conn(0x7f846c15c890 0x7f846c0d0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:20:07.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.262+0000 7f846a7fc700 1 --2- 172.21.15.84:0/284691828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8454004850 0x7f8454004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:07.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.262+0000 7f846b7fe700 1 --2- 172.21.15.84:0/284691828 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8454005200 0x7f845400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:07.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.263+0000 7f846affd700 1 --2- 172.21.15.84:0/284691828 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8454003ac0 0x7f8454003ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:07.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.263+0000 7f846a7fc700 1 -- 172.21.15.84:0/284691828 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8454005200 msgr2=0x7f845400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:20:07.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.263+0000 7f846a7fc700 1 --2- 172.21.15.84:0/284691828 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8454005200 0x7f845400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:07.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.263+0000 7f846a7fc700 1 -- 172.21.15.84:0/284691828 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8454003ac0 msgr2=0x7f8454003ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:20:07.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.263+0000 7f846a7fc700 1 --2- 172.21.15.84:0/284691828 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8454003ac0 0x7f8454003ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:07.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.263+0000 7f846a7fc700 1 -- 172.21.15.84:0/284691828 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84540035b0 con 0x7f8454004850 2023-07-14T11:20:07.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.263+0000 7f846b7fe700 1 -- 172.21.15.84:0/284691828 reap_dead start 2023-07-14T11:20:07.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.263+0000 7f846a7fc700 1 --2- 172.21.15.84:0/284691828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8454004850 0x7f8454004cc0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f846000c210 tx=0x7f8454005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72dab5819e1b79fd server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:07.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.263+0000 7f8469ffb700 1 -- 172.21.15.84:0/284691828 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8460007c10 con 0x7f8454004850 2023-07-14T11:20:07.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.263+0000 7f8469ffb700 1 -- 172.21.15.84:0/284691828 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f846000cdd0 con 0x7f8454004850 2023-07-14T11:20:07.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.263+0000 7f8469ffb700 1 -- 172.21.15.84:0/284691828 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8460005ba0 con 0x7f8454004850 2023-07-14T11:20:07.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.264+0000 7f84719ff700 1 -- 172.21.15.84:0/284691828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8454004850 msgr2=0x7f8454004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:07.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.264+0000 7f84719ff700 1 --2- 172.21.15.84:0/284691828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8454004850 0x7f8454004cc0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f846000c210 tx=0x7f8454005880 comp rx=0 tx=0).stop 2023-07-14T11:20:07.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.264+0000 7f84719ff700 1 -- 172.21.15.84:0/284691828 shutdown_connections 2023-07-14T11:20:07.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.264+0000 7f84719ff700 1 --2- 172.21.15.84:0/284691828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8454004850 0x7f8454004cc0 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:07.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.264+0000 7f84719ff700 1 -- 172.21.15.84:0/284691828 >> 172.21.15.84:0/284691828 conn(0x7f846c09c170 msgr2=0x7f846c0d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:20:07.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.264+0000 7f84719ff700 1 -- 172.21.15.84:0/284691828 shutdown_connections 2023-07-14T11:20:07.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.264+0000 7f84719ff700 1 -- 172.21.15.84:0/284691828 wait complete. 2023-07-14T11:20:07.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.265+0000 7f84719ff700 1 Processor -- start 2023-07-14T11:20:07.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.266+0000 7f84719ff700 1 -- start start 2023-07-14T11:20:07.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.266+0000 7f84719ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8454004850 0x7f846c152df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:07.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.266+0000 7f84719ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f846c154390 0x7f846c15abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:07.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.266+0000 7f84719ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f846c152030 0x7f846c152460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:07.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.267+0000 7f84719ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f846c1f6230 con 0x7f846c154390 2023-07-14T11:20:07.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.267+0000 7f84719ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f846c153740 con 0x7f846c152030 2023-07-14T11:20:07.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.267+0000 7f84719ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f846c1f55b0 con 0x7f8454004850 2023-07-14T11:20:07.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.267+0000 7f846a7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f846c154390 0x7f846c15abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:07.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.267+0000 7f846a7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f846c154390 0x7f846c15abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60320/0 (socket says 172.21.15.84:60320) 2023-07-14T11:20:07.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.267+0000 7f846a7fc700 1 -- 172.21.15.84:0/1085322775 learned_addr learned my addr 172.21.15.84:0/1085322775 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:20:07.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.267+0000 7f846affd700 1 --2- 172.21.15.84:0/1085322775 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8454004850 0x7f846c152df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:07.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.267+0000 7f846b7fe700 1 --2- 172.21.15.84:0/1085322775 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f846c152030 0x7f846c152460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:07.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.267+0000 7f846a7fc700 1 -- 172.21.15.84:0/1085322775 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8454004850 msgr2=0x7f846c152df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:07.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.267+0000 7f846a7fc700 1 --2- 172.21.15.84:0/1085322775 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8454004850 0x7f846c152df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:07.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.267+0000 7f846a7fc700 1 -- 172.21.15.84:0/1085322775 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f846c152030 msgr2=0x7f846c152460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:07.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.267+0000 7f846a7fc700 1 --2- 172.21.15.84:0/1085322775 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f846c152030 0x7f846c152460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:07.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.267+0000 7f846a7fc700 1 -- 172.21.15.84:0/1085322775 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f846c1f5890 con 0x7f846c154390 2023-07-14T11:20:07.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.267+0000 7f846a7fc700 1 --2- 172.21.15.84:0/1085322775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f846c154390 0x7f846c15abb0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f846000c800 tx=0x7f8460001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:07.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.268+0000 7f8453fff700 1 -- 172.21.15.84:0/1085322775 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8460001630 con 0x7f846c154390 2023-07-14T11:20:07.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.268+0000 7f8453fff700 1 -- 172.21.15.84:0/1085322775 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84600070d0 con 0x7f846c154390 2023-07-14T11:20:07.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.268+0000 7f8453fff700 1 -- 172.21.15.84:0/1085322775 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8460007460 con 0x7f846c154390 2023-07-14T11:20:07.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.268+0000 7f84719ff700 1 -- 172.21.15.84:0/1085322775 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f846c1f5b70 con 0x7f846c154390 2023-07-14T11:20:07.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.268+0000 7f84719ff700 1 -- 172.21.15.84:0/1085322775 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f846c15b0f0 con 0x7f846c154390 2023-07-14T11:20:07.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.269+0000 7f84719ff700 1 -- 172.21.15.84:0/1085322775 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f846c06bd20 con 0x7f846c154390 2023-07-14T11:20:07.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.270+0000 7f8453fff700 1 -- 172.21.15.84:0/1085322775 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f84600075c0 con 0x7f846c154390 2023-07-14T11:20:07.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.270+0000 7f8453fff700 1 --2- 172.21.15.84:0/1085322775 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f845806ae90 0x7f845806d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:07.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.271+0000 7f8453fff700 1 -- 172.21.15.84:0/1085322775 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f846008a7a0 con 0x7f846c154390 2023-07-14T11:20:07.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.271+0000 7f8453fff700 1 --2- 172.21.15.84:0/1085322775 >> [v2:172.21.15.179:6808/174345035,v1:172.21.15.179:6809/174345035] conn(0x7f8458071300 0x7f8458073710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:07.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.271+0000 7f8453fff700 1 -- 172.21.15.84:0/1085322775 --> [v2:172.21.15.179:6808/174345035,v1:172.21.15.179:6809/174345035] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8458073de0 con 0x7f8458071300 2023-07-14T11:20:07.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.271+0000 7f8453fff700 1 -- 172.21.15.84:0/1085322775 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=109) v2 ==== 24+0+0 (secure 0 0 0) 0x7f846008ab10 con 0x7f846c154390 2023-07-14T11:20:07.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.271+0000 7f846affd700 1 --2- 172.21.15.84:0/1085322775 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f845806ae90 0x7f845806d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:07.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.271+0000 7f846b7fe700 1 --2- 172.21.15.84:0/1085322775 >> [v2:172.21.15.179:6808/174345035,v1:172.21.15.179:6809/174345035] conn(0x7f8458071300 0x7f8458073710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:07.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.272+0000 7f846b7fe700 1 --2- 172.21.15.84:0/1085322775 >> [v2:172.21.15.179:6808/174345035,v1:172.21.15.179:6809/174345035] conn(0x7f8458071300 0x7f8458073710 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:07.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.272+0000 7f846affd700 1 --2- 172.21.15.84:0/1085322775 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f845806ae90 0x7f845806d340 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f845c009cc0 tx=0x7f845c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:07.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.273+0000 7f8453fff700 1 -- 172.21.15.84:0/1085322775 <== osd.6 v2:172.21.15.179:6808/174345035 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f8458073de0 con 0x7f8458071300 2023-07-14T11:20:07.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.288+0000 7f84719ff700 1 -- 172.21.15.84:0/1085322775 --> [v2:172.21.15.179:6808/174345035,v1:172.21.15.179:6809/174345035] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f846c06ba40 con 0x7f8458071300 2023-07-14T11:20:07.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.288+0000 7f8453fff700 1 -- 172.21.15.84:0/1085322775 <== osd.6 v2:172.21.15.179:6808/174345035 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f8464001b40 con 0x7f8458071300 2023-07-14T11:20:07.291 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-07-14T11:20:07.291 INFO:teuthology.orchestra.run.smithi084.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-14T11:20:07.291 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-07-14T11:20:07.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.289+0000 7f84719ff700 1 -- 172.21.15.84:0/1085322775 >> [v2:172.21.15.179:6808/174345035,v1:172.21.15.179:6809/174345035] conn(0x7f8458071300 msgr2=0x7f8458073710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:07.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.289+0000 7f84719ff700 1 --2- 172.21.15.84:0/1085322775 >> [v2:172.21.15.179:6808/174345035,v1:172.21.15.179:6809/174345035] conn(0x7f8458071300 0x7f8458073710 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:07.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.289+0000 7f84719ff700 1 -- 172.21.15.84:0/1085322775 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f845806ae90 msgr2=0x7f845806d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:07.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.289+0000 7f84719ff700 1 --2- 172.21.15.84:0/1085322775 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f845806ae90 0x7f845806d340 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f845c009cc0 tx=0x7f845c008040 comp rx=0 tx=0).stop 2023-07-14T11:20:07.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.289+0000 7f84719ff700 1 -- 172.21.15.84:0/1085322775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f846c154390 msgr2=0x7f846c15abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:07.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.289+0000 7f84719ff700 1 --2- 172.21.15.84:0/1085322775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f846c154390 0x7f846c15abb0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f846000c800 tx=0x7f8460001a00 comp rx=0 tx=0).stop 2023-07-14T11:20:07.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.289+0000 7f846b7fe700 1 -- 172.21.15.84:0/1085322775 reap_dead start 2023-07-14T11:20:07.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.289+0000 7f84719ff700 1 -- 172.21.15.84:0/1085322775 shutdown_connections 2023-07-14T11:20:07.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.289+0000 7f84719ff700 1 -- 172.21.15.84:0/1085322775 >> 172.21.15.84:0/1085322775 conn(0x7f846c09c170 msgr2=0x7f846c0b4850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:20:07.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.289+0000 7f84719ff700 1 -- 172.21.15.84:0/1085322775 shutdown_connections 2023-07-14T11:20:07.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.289+0000 7f84719ff700 1 -- 172.21.15.84:0/1085322775 wait complete. 2023-07-14T11:20:07.308 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-07-14T11:20:07.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.502+0000 7f8b8cfff700 1 Processor -- start 2023-07-14T11:20:07.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.502+0000 7f8b8cfff700 1 -- start start 2023-07-14T11:20:07.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.503+0000 7f8b8cfff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8b880adea0 0x7f8b880ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:07.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.504+0000 7f8b8cfff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b8815ce70 con 0x7f8b880c92d0 2023-07-14T11:20:07.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.504+0000 7f8b8cfff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b8815d0c0 con 0x7f8b880b12f0 2023-07-14T11:20:07.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.504+0000 7f8b8cfff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b8815da60 con 0x7f8b880adea0 2023-07-14T11:20:07.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.504+0000 7f8b8659c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f8b880c92d0 0x7f8b880c96a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49530/0 (socket says 172.21.15.84:49530) 2023-07-14T11:20:07.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.504+0000 7f8b8659c700 1 -- 172.21.15.84:0/2008288308 learned_addr learned my addr 172.21.15.84:0/2008288308 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:20:07.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.504+0000 7f8b86d9d700 1 --2- 172.21.15.84:0/2008288308 >> v2:172.21.15.179:3300/0 conn(0x7f8b880adea0 0x7f8b880ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:07.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.504+0000 7f8b8559a700 1 -- 172.21.15.84:0/2008288308 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3316700493 0 0) 0x7f8b8815ce70 con 0x7f8b880c92d0 2023-07-14T11:20:07.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.504+0000 7f8b8559a700 1 -- 172.21.15.84:0/2008288308 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b700035b0 con 0x7f8b880c92d0 2023-07-14T11:20:07.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.504+0000 7f8b86d9d700 1 -- 172.21.15.84:0/2008288308 >> v1:172.21.15.179:6789/0 conn(0x7f8b880b12f0 legacy=0x7f8b880cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:07.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.504+0000 7f8b86d9d700 1 -- 172.21.15.84:0/2008288308 >> v1:172.21.15.84:6789/0 conn(0x7f8b880c92d0 legacy=0x7f8b880c96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:07.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.505+0000 7f8b86d9d700 1 -- 172.21.15.84:0/2008288308 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b8815d3a0 con 0x7f8b880adea0 2023-07-14T11:20:07.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.505+0000 7f8b86d9d700 1 --2- 172.21.15.84:0/2008288308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b880adea0 0x7f8b880ad8f0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f8b80009d90 tx=0x7f8b8000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e85bf871babba5c9 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:07.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.505+0000 7f8b8559a700 1 -- 172.21.15.84:0/2008288308 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8000e070 con 0x7f8b880adea0 2023-07-14T11:20:07.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.505+0000 7f8b8559a700 1 -- 172.21.15.84:0/2008288308 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b8000bb20 con 0x7f8b880adea0 2023-07-14T11:20:07.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.505+0000 7f8b8559a700 1 -- 172.21.15.84:0/2008288308 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b80012430 con 0x7f8b880adea0 2023-07-14T11:20:07.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.506+0000 7f8b8cfff700 1 -- 172.21.15.84:0/2008288308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b880adea0 msgr2=0x7f8b880ad8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:07.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.506+0000 7f8b8cfff700 1 --2- 172.21.15.84:0/2008288308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b880adea0 0x7f8b880ad8f0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f8b80009d90 tx=0x7f8b8000b330 comp rx=0 tx=0).stop 2023-07-14T11:20:07.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.506+0000 7f8b8cfff700 1 -- 172.21.15.84:0/2008288308 shutdown_connections 2023-07-14T11:20:07.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.506+0000 7f8b8cfff700 1 --2- 172.21.15.84:0/2008288308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b880adea0 0x7f8b880ad8f0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:07.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.506+0000 7f8b8cfff700 1 -- 172.21.15.84:0/2008288308 >> 172.21.15.84:0/2008288308 conn(0x7f8b880b05d0 msgr2=0x7f8b880b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:20:07.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.506+0000 7f8b8cfff700 1 -- 172.21.15.84:0/2008288308 shutdown_connections 2023-07-14T11:20:07.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.506+0000 7f8b8cfff700 1 -- 172.21.15.84:0/2008288308 wait complete. 2023-07-14T11:20:07.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.507+0000 7f8b8cfff700 1 Processor -- start 2023-07-14T11:20:07.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.508+0000 7f8b8cfff700 1 -- start start 2023-07-14T11:20:07.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.508+0000 7f8b8cfff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b880adea0 0x7f8b88159910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:07.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.508+0000 7f8b8cfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b880b12f0 0x7f8b8815b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:07.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.508+0000 7f8b8cfff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b880c92d0 0x7f8b8815ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:07.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.508+0000 7f8b8cfff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8815c390 con 0x7f8b880b12f0 2023-07-14T11:20:07.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.508+0000 7f8b8cfff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8815c670 con 0x7f8b880c92d0 2023-07-14T11:20:07.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.508+0000 7f8b8cfff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8815c950 con 0x7f8b880adea0 2023-07-14T11:20:07.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.509+0000 7f8b85d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b880b12f0 0x7f8b8815b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:07.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.509+0000 7f8b85d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b880b12f0 0x7f8b8815b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60330/0 (socket says 172.21.15.84:60330) 2023-07-14T11:20:07.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.509+0000 7f8b85d9b700 1 -- 172.21.15.84:0/3158529483 learned_addr learned my addr 172.21.15.84:0/3158529483 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:20:07.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.509+0000 7f8b86d9d700 1 --2- 172.21.15.84:0/3158529483 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b880c92d0 0x7f8b8815ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:07.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.509+0000 7f8b8659c700 1 --2- 172.21.15.84:0/3158529483 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b880adea0 0x7f8b88159910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:07.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.509+0000 7f8b85d9b700 1 -- 172.21.15.84:0/3158529483 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b880adea0 msgr2=0x7f8b88159910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:07.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.509+0000 7f8b85d9b700 1 --2- 172.21.15.84:0/3158529483 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b880adea0 0x7f8b88159910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:07.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.509+0000 7f8b85d9b700 1 -- 172.21.15.84:0/3158529483 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b880c92d0 msgr2=0x7f8b8815ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:07.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.509+0000 7f8b85d9b700 1 --2- 172.21.15.84:0/3158529483 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b880c92d0 0x7f8b8815ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:07.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.509+0000 7f8b85d9b700 1 -- 172.21.15.84:0/3158529483 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b80009a70 con 0x7f8b880b12f0 2023-07-14T11:20:07.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.509+0000 7f8b85d9b700 1 --2- 172.21.15.84:0/3158529483 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b880b12f0 0x7f8b8815b510 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c00c4e0 tx=0x7f8b7c00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:07.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.510+0000 7f8b76ffd700 1 -- 172.21.15.84:0/3158529483 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c0052d0 con 0x7f8b880b12f0 2023-07-14T11:20:07.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.510+0000 7f8b76ffd700 1 -- 172.21.15.84:0/3158529483 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b7c005430 con 0x7f8b880b12f0 2023-07-14T11:20:07.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.510+0000 7f8b76ffd700 1 -- 172.21.15.84:0/3158529483 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c0038c0 con 0x7f8b880b12f0 2023-07-14T11:20:07.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.510+0000 7f8b8cfff700 1 -- 172.21.15.84:0/3158529483 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b88159e50 con 0x7f8b880b12f0 2023-07-14T11:20:07.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.510+0000 7f8b8cfff700 1 -- 172.21.15.84:0/3158529483 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b8815bf90 con 0x7f8b880b12f0 2023-07-14T11:20:07.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.511+0000 7f8b8cfff700 1 -- 172.21.15.84:0/3158529483 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b88074350 con 0x7f8b880b12f0 2023-07-14T11:20:07.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.512+0000 7f8b76ffd700 1 -- 172.21.15.84:0/3158529483 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f8b7c003a20 con 0x7f8b880b12f0 2023-07-14T11:20:07.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.513+0000 7f8b76ffd700 1 --2- 172.21.15.84:0/3158529483 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f8b6806ae90 0x7f8b6806d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:07.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.513+0000 7f8b76ffd700 1 -- 172.21.15.84:0/3158529483 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f8b7c0889d0 con 0x7f8b880b12f0 2023-07-14T11:20:07.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.514+0000 7f8b8659c700 1 --2- 172.21.15.84:0/3158529483 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f8b6806ae90 0x7f8b6806d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:07.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.514+0000 7f8b8659c700 1 --2- 172.21.15.84:0/3158529483 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f8b6806ae90 0x7f8b6806d340 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8b780011e0 tx=0x7f8b78009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:07.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.518+0000 7f8b76ffd700 1 -- 172.21.15.84:0/3158529483 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f8b7c053a70 con 0x7f8b880b12f0 2023-07-14T11:20:07.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.710+0000 7f8b8cfff700 1 -- 172.21.15.84:0/3158529483 --> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f8b8815d680 con 0x7f8b6806ae90 2023-07-14T11:20:07.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.710+0000 7f8b76ffd700 1 -- 172.21.15.84:0/3158529483 <== mgr.4100 v2:172.21.15.179:6836/2094253834 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f8b780058e0 con 0x7f8b6806ae90 2023-07-14T11:20:07.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.713+0000 7f8b8cfff700 1 -- 172.21.15.84:0/3158529483 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f8b6806ae90 msgr2=0x7f8b6806d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:07.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.713+0000 7f8b8cfff700 1 --2- 172.21.15.84:0/3158529483 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f8b6806ae90 0x7f8b6806d340 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8b780011e0 tx=0x7f8b78009040 comp rx=0 tx=0).stop 2023-07-14T11:20:07.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.713+0000 7f8b8cfff700 1 -- 172.21.15.84:0/3158529483 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b880b12f0 msgr2=0x7f8b8815b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:07.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.713+0000 7f8b8cfff700 1 --2- 172.21.15.84:0/3158529483 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b880b12f0 0x7f8b8815b510 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c00c4e0 tx=0x7f8b7c00c7f0 comp rx=0 tx=0).stop 2023-07-14T11:20:07.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.713+0000 7f8b8cfff700 1 -- 172.21.15.84:0/3158529483 shutdown_connections 2023-07-14T11:20:07.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.713+0000 7f8b8cfff700 1 --2- 172.21.15.84:0/3158529483 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f8b6806ae90 0x7f8b6806d340 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:07.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.713+0000 7f8b8cfff700 1 --2- 172.21.15.84:0/3158529483 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b880adea0 0x7f8b88159910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:07.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.713+0000 7f8b8cfff700 1 --2- 172.21.15.84:0/3158529483 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b880c92d0 0x7f8b8815ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:07.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.713+0000 7f8b8cfff700 1 --2- 172.21.15.84:0/3158529483 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b880b12f0 0x7f8b8815b510 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:07.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.713+0000 7f8b8cfff700 1 -- 172.21.15.84:0/3158529483 >> 172.21.15.84:0/3158529483 conn(0x7f8b880b05d0 msgr2=0x7f8b880c96a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:20:07.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.713+0000 7f8b8cfff700 1 -- 172.21.15.84:0/3158529483 shutdown_connections 2023-07-14T11:20:07.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.713+0000 7f8b8cfff700 1 -- 172.21.15.84:0/3158529483 wait complete. 2023-07-14T11:20:07.718 INFO:teuthology.orchestra.run.smithi084.stderr:instructed osd(s) 6 to deep-scrub 2023-07-14T11:20:07.733 INFO:tasks.ceph:Scrubbing osd.7 2023-07-14T11:20:07.733 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-07-14T11:20:07.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.932+0000 7fb79abff700 1 Processor -- start 2023-07-14T11:20:07.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.932+0000 7fb79abff700 1 -- start start 2023-07-14T11:20:07.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.934+0000 7fb79abff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb79406b750 0x7fb7940cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:07.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.934+0000 7fb79abff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7940cd410 con 0x7fb7940cba30 2023-07-14T11:20:07.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.934+0000 7fb79abff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7940cce50 con 0x7fb7940cc340 2023-07-14T11:20:07.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.934+0000 7fb79abff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7940cd130 con 0x7fb79406b750 2023-07-14T11:20:07.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.934+0000 7fb79899b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fb7940cba30 0x7fb79406b040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49540/0 (socket says 172.21.15.84:49540) 2023-07-14T11:20:07.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.934+0000 7fb79899b700 1 -- 172.21.15.84:0/3264649684 learned_addr learned my addr 172.21.15.84:0/3264649684 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:20:07.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.934+0000 7fb793fff700 1 --2- 172.21.15.84:0/3264649684 >> v2:172.21.15.84:3300/0 conn(0x7fb79406b750 0x7fb7940cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:07.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.934+0000 7fb7937fe700 1 -- 172.21.15.84:0/3264649684 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 906285960 0 0) 0x7fb7940cd410 con 0x7fb7940cba30 2023-07-14T11:20:07.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.934+0000 7fb7937fe700 1 -- 172.21.15.84:0/3264649684 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7840035b0 con 0x7fb7940cba30 2023-07-14T11:20:07.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.934+0000 7fb793fff700 1 -- 172.21.15.84:0/3264649684 >> v1:172.21.15.179:6789/0 conn(0x7fb7940cc340 legacy=0x7fb7940cf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:07.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.934+0000 7fb793fff700 1 -- 172.21.15.84:0/3264649684 >> v1:172.21.15.84:6789/0 conn(0x7fb7940cba30 legacy=0x7fb79406b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:07.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.934+0000 7fb793fff700 1 -- 172.21.15.84:0/3264649684 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7940ce8f0 con 0x7fb79406b750 2023-07-14T11:20:07.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.935+0000 7fb793fff700 1 --2- 172.21.15.84:0/3264649684 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb79406b750 0x7fb7940cbe00 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7fb780009840 tx=0x7fb780009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efd7a8d1afbdc936 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:07.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.935+0000 7fb7937fe700 1 -- 172.21.15.84:0/3264649684 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb780011830 con 0x7fb79406b750 2023-07-14T11:20:07.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.935+0000 7fb7937fe700 1 -- 172.21.15.84:0/3264649684 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb780011990 con 0x7fb79406b750 2023-07-14T11:20:07.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.935+0000 7fb7937fe700 1 -- 172.21.15.84:0/3264649684 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb780011d20 con 0x7fb79406b750 2023-07-14T11:20:07.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.935+0000 7fb79abff700 1 -- 172.21.15.84:0/3264649684 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb79406b750 msgr2=0x7fb7940cbe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:07.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.935+0000 7fb79abff700 1 --2- 172.21.15.84:0/3264649684 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb79406b750 0x7fb7940cbe00 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7fb780009840 tx=0x7fb780009b50 comp rx=0 tx=0).stop 2023-07-14T11:20:07.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.935+0000 7fb79abff700 1 -- 172.21.15.84:0/3264649684 shutdown_connections 2023-07-14T11:20:07.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.935+0000 7fb79abff700 1 --2- 172.21.15.84:0/3264649684 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb79406b750 0x7fb7940cbe00 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:07.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.935+0000 7fb79abff700 1 -- 172.21.15.84:0/3264649684 >> 172.21.15.84:0/3264649684 conn(0x7fb794099f40 msgr2=0x7fb7940d0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:20:07.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.936+0000 7fb79abff700 1 -- 172.21.15.84:0/3264649684 shutdown_connections 2023-07-14T11:20:07.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.936+0000 7fb79abff700 1 -- 172.21.15.84:0/3264649684 wait complete. 2023-07-14T11:20:07.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.937+0000 7fb79abff700 1 Processor -- start 2023-07-14T11:20:07.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.937+0000 7fb79abff700 1 -- start start 2023-07-14T11:20:07.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.938+0000 7fb79abff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb79406b750 0x7fb7941e2e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:07.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.938+0000 7fb79abff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7940cba30 0x7fb7941e6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:07.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.938+0000 7fb79abff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb7940cc340 0x7fb79415b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:07.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.938+0000 7fb79abff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7941f6270 con 0x7fb7940cc340 2023-07-14T11:20:07.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.938+0000 7fb79abff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7941e56b0 con 0x7fb79406b750 2023-07-14T11:20:07.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.938+0000 7fb79abff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7941e5ec0 con 0x7fb7940cba30 2023-07-14T11:20:07.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.939+0000 7fb79919c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb7940cc340 0x7fb79415b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:07.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.939+0000 7fb79899b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb79406b750 0x7fb7941e2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:07.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.939+0000 7fb79899b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb79406b750 0x7fb7941e2e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.84:42330/0 (socket says 172.21.15.84:42330) 2023-07-14T11:20:07.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.939+0000 7fb79899b700 1 -- 172.21.15.84:0/2240890942 learned_addr learned my addr 172.21.15.84:0/2240890942 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:20:07.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.939+0000 7fb793fff700 1 --2- 172.21.15.84:0/2240890942 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7940cba30 0x7fb7941e6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:07.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.939+0000 7fb79899b700 1 -- 172.21.15.84:0/2240890942 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7940cba30 msgr2=0x7fb7941e6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:07.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.939+0000 7fb79899b700 1 --2- 172.21.15.84:0/2240890942 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7940cba30 0x7fb7941e6290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:07.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.939+0000 7fb79899b700 1 -- 172.21.15.84:0/2240890942 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb7940cc340 msgr2=0x7fb79415b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:07.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.939+0000 7fb79899b700 1 --2- 172.21.15.84:0/2240890942 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb7940cc340 0x7fb79415b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:07.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.939+0000 7fb79899b700 1 -- 172.21.15.84:0/2240890942 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7800094a0 con 0x7fb79406b750 2023-07-14T11:20:07.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.939+0000 7fb79919c700 1 --2- 172.21.15.84:0/2240890942 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb7940cc340 0x7fb79415b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T11:20:07.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.939+0000 7fb79899b700 1 --2- 172.21.15.84:0/2240890942 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb79406b750 0x7fb7941e2e70 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fb788001260 tx=0x7fb78800c9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:07.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.940+0000 7fb7917fa700 1 -- 172.21.15.84:0/2240890942 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7880074e0 con 0x7fb79406b750 2023-07-14T11:20:07.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.940+0000 7fb7917fa700 1 -- 172.21.15.84:0/2240890942 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb788007640 con 0x7fb79406b750 2023-07-14T11:20:07.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.940+0000 7fb79abff700 1 -- 172.21.15.84:0/2240890942 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7941e5900 con 0x7fb79406b750 2023-07-14T11:20:07.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.940+0000 7fb7917fa700 1 -- 172.21.15.84:0/2240890942 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb788005a50 con 0x7fb79406b750 2023-07-14T11:20:07.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.940+0000 7fb79abff700 1 -- 172.21.15.84:0/2240890942 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7940c4780 con 0x7fb79406b750 2023-07-14T11:20:07.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.941+0000 7fb79abff700 1 -- 172.21.15.84:0/2240890942 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb7940cebd0 con 0x7fb79406b750 2023-07-14T11:20:07.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.942+0000 7fb7917fa700 1 -- 172.21.15.84:0/2240890942 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 17) v1 ==== 89190+0+0 (secure 0 0 0) 0x7fb788005bb0 con 0x7fb79406b750 2023-07-14T11:20:07.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.943+0000 7fb7917fa700 1 --2- 172.21.15.84:0/2240890942 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fb77806ae90 0x7fb77806d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:07.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.943+0000 7fb7917fa700 1 -- 172.21.15.84:0/2240890942 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fb788088910 con 0x7fb79406b750 2023-07-14T11:20:07.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.943+0000 7fb7917fa700 1 --2- 172.21.15.84:0/2240890942 >> [v2:172.21.15.179:6821/2934497681,v1:172.21.15.179:6823/2934497681] conn(0x7fb778071300 0x7fb778073710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:07.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.943+0000 7fb7917fa700 1 -- 172.21.15.84:0/2240890942 --> [v2:172.21.15.179:6821/2934497681,v1:172.21.15.179:6823/2934497681] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb778073de0 con 0x7fb778071300 2023-07-14T11:20:07.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.943+0000 7fb7917fa700 1 -- 172.21.15.84:0/2240890942 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_get_version_reply(handle=1 version=109) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb78808d2a0 con 0x7fb79406b750 2023-07-14T11:20:07.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.943+0000 7fb793fff700 1 --2- 172.21.15.84:0/2240890942 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fb77806ae90 0x7fb77806d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:07.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.944+0000 7fb79919c700 1 --2- 172.21.15.84:0/2240890942 >> [v2:172.21.15.179:6821/2934497681,v1:172.21.15.179:6823/2934497681] conn(0x7fb778071300 0x7fb778073710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:07.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.944+0000 7fb793fff700 1 --2- 172.21.15.84:0/2240890942 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fb77806ae90 0x7fb77806d340 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb7800090b0 tx=0x7fb78001c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:07.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.944+0000 7fb79919c700 1 --2- 172.21.15.84:0/2240890942 >> [v2:172.21.15.179:6821/2934497681,v1:172.21.15.179:6823/2934497681] conn(0x7fb778071300 0x7fb778073710 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:07.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.945+0000 7fb7917fa700 1 -- 172.21.15.84:0/2240890942 <== osd.7 v2:172.21.15.179:6821/2934497681 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fb778073de0 con 0x7fb778071300 2023-07-14T11:20:07.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.960+0000 7fb79abff700 1 -- 172.21.15.84:0/2240890942 --> [v2:172.21.15.179:6821/2934497681,v1:172.21.15.179:6823/2934497681] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb7940c4dd0 con 0x7fb778071300 2023-07-14T11:20:07.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.960+0000 7fb7917fa700 1 -- 172.21.15.84:0/2240890942 <== osd.7 v2:172.21.15.179:6821/2934497681 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fb7940c4dd0 con 0x7fb778071300 2023-07-14T11:20:07.963 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-07-14T11:20:07.963 INFO:teuthology.orchestra.run.smithi084.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-14T11:20:07.963 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-07-14T11:20:07.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.961+0000 7fb79abff700 1 -- 172.21.15.84:0/2240890942 >> [v2:172.21.15.179:6821/2934497681,v1:172.21.15.179:6823/2934497681] conn(0x7fb778071300 msgr2=0x7fb778073710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:07.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.961+0000 7fb79abff700 1 --2- 172.21.15.84:0/2240890942 >> [v2:172.21.15.179:6821/2934497681,v1:172.21.15.179:6823/2934497681] conn(0x7fb778071300 0x7fb778073710 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:07.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.961+0000 7fb79abff700 1 -- 172.21.15.84:0/2240890942 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fb77806ae90 msgr2=0x7fb77806d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:07.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.961+0000 7fb79abff700 1 --2- 172.21.15.84:0/2240890942 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fb77806ae90 0x7fb77806d340 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb7800090b0 tx=0x7fb78001c040 comp rx=0 tx=0).stop 2023-07-14T11:20:07.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.961+0000 7fb79abff700 1 -- 172.21.15.84:0/2240890942 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb79406b750 msgr2=0x7fb7941e2e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:07.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.961+0000 7fb79abff700 1 --2- 172.21.15.84:0/2240890942 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb79406b750 0x7fb7941e2e70 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fb788001260 tx=0x7fb78800c9e0 comp rx=0 tx=0).stop 2023-07-14T11:20:07.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.961+0000 7fb79919c700 1 -- 172.21.15.84:0/2240890942 reap_dead start 2023-07-14T11:20:07.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.961+0000 7fb79abff700 1 -- 172.21.15.84:0/2240890942 shutdown_connections 2023-07-14T11:20:07.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.961+0000 7fb79abff700 1 -- 172.21.15.84:0/2240890942 >> 172.21.15.84:0/2240890942 conn(0x7fb794099f40 msgr2=0x7fb79406ebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:20:07.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.961+0000 7fb79abff700 1 -- 172.21.15.84:0/2240890942 shutdown_connections 2023-07-14T11:20:07.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:07.961+0000 7fb79abff700 1 -- 172.21.15.84:0/2240890942 wait complete. 2023-07-14T11:20:07.974 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T11:20:07.978 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T11:20:07.982 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-07-14T11:20:08.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.219+0000 7f66429ff700 1 Processor -- start 2023-07-14T11:20:08.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.219+0000 7f66429ff700 1 -- start start 2023-07-14T11:20:08.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.220+0000 7f66429ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f663c0d1e40 0x7f663c0cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:08.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.220+0000 7f66429ff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f663c0c71b0 0x7f663c0b49d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:08.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.221+0000 7f66429ff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f663c0cd5a0 con 0x7f663c15c860 2023-07-14T11:20:08.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.221+0000 7f66429ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f663c146740 con 0x7f663c0d1e40 2023-07-14T11:20:08.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.221+0000 7f66429ff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f663c0cd7f0 con 0x7f663c0c71b0 2023-07-14T11:20:08.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.221+0000 7f663b7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f663c0d1e40 0x7f663c0cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:08.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.221+0000 7f663b7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f663c0d1e40 0x7f663c0cf2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60358/0 (socket says 172.21.15.84:60358) 2023-07-14T11:20:08.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.221+0000 7f663b7fe700 1 -- 172.21.15.84:0/3537061753 learned_addr learned my addr 172.21.15.84:0/3537061753 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:20:08.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.221+0000 7f6640f9c700 1 --2- 172.21.15.84:0/3537061753 >> v2:172.21.15.179:3300/0 conn(0x7f663c0c71b0 0x7f663c0b49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:08.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.221+0000 7f663b7fe700 1 -- 172.21.15.84:0/3537061753 >> v2:172.21.15.179:3300/0 conn(0x7f663c0c71b0 msgr2=0x7f663c0b49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:20:08.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.221+0000 7f663b7fe700 1 --2- 172.21.15.84:0/3537061753 >> v2:172.21.15.179:3300/0 conn(0x7f663c0c71b0 0x7f663c0b49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:08.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.221+0000 7f663b7fe700 1 -- 172.21.15.84:0/3537061753 >> v1:172.21.15.179:6789/0 conn(0x7f663c15c860 legacy=0x7f663c0c6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:08.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.221+0000 7f663b7fe700 1 -- 172.21.15.84:0/3537061753 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f663c0cdad0 con 0x7f663c0d1e40 2023-07-14T11:20:08.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.222+0000 7f663b7fe700 1 --2- 172.21.15.84:0/3537061753 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f663c0d1e40 0x7f663c0cf2a0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f663c0d0ab0 tx=0x7f6630009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27ac7b4dbaf4f8e5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:08.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.222+0000 7f663affd700 1 -- 172.21.15.84:0/3537061753 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6630011830 con 0x7f663c0d1e40 2023-07-14T11:20:08.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.222+0000 7f663affd700 1 -- 172.21.15.84:0/3537061753 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6630011990 con 0x7f663c0d1e40 2023-07-14T11:20:08.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.222+0000 7f663affd700 1 -- 172.21.15.84:0/3537061753 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6630011d20 con 0x7f663c0d1e40 2023-07-14T11:20:08.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.222+0000 7f66429ff700 1 -- 172.21.15.84:0/3537061753 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f663c0d1e40 msgr2=0x7f663c0cf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:08.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.222+0000 7f66429ff700 1 --2- 172.21.15.84:0/3537061753 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f663c0d1e40 0x7f663c0cf2a0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f663c0d0ab0 tx=0x7f6630009bd0 comp rx=0 tx=0).stop 2023-07-14T11:20:08.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.223+0000 7f66429ff700 1 -- 172.21.15.84:0/3537061753 shutdown_connections 2023-07-14T11:20:08.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.223+0000 7f66429ff700 1 --2- 172.21.15.84:0/3537061753 >> v2:172.21.15.179:3300/0 conn(0x7f663c0c71b0 0x7f663c0b49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:08.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.223+0000 7f66429ff700 1 --2- 172.21.15.84:0/3537061753 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f663c0d1e40 0x7f663c0cf2a0 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:08.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.223+0000 7f66429ff700 1 -- 172.21.15.84:0/3537061753 >> 172.21.15.84:0/3537061753 conn(0x7f663c065bd0 msgr2=0x7f663c065fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:20:08.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.223+0000 7f66429ff700 1 -- 172.21.15.84:0/3537061753 shutdown_connections 2023-07-14T11:20:08.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.223+0000 7f66429ff700 1 -- 172.21.15.84:0/3537061753 wait complete. 2023-07-14T11:20:08.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.224+0000 7f66429ff700 1 Processor -- start 2023-07-14T11:20:08.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.224+0000 7f66429ff700 1 -- start start 2023-07-14T11:20:08.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.225+0000 7f66429ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f663c0c71b0 0x7f663c1f4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:08.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.225+0000 7f66429ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f663c0d1e40 0x7f663c1e66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:08.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.225+0000 7f66429ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f663c15c860 0x7f663c1e6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:08.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.225+0000 7f66429ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f663c15f150 con 0x7f663c0c71b0 2023-07-14T11:20:08.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.225+0000 7f66429ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f663c0ca2e0 con 0x7f663c0d1e40 2023-07-14T11:20:08.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.225+0000 7f66429ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f663c15e5d0 con 0x7f663c15c860 2023-07-14T11:20:08.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.226+0000 7f663bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f663c0c71b0 0x7f663c1f4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:08.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.226+0000 7f663bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f663c0c71b0 0x7f663c1f4c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60366/0 (socket says 172.21.15.84:60366) 2023-07-14T11:20:08.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.226+0000 7f663bfff700 1 -- 172.21.15.84:0/3171560085 learned_addr learned my addr 172.21.15.84:0/3171560085 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:20:08.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.226+0000 7f663b7fe700 1 --2- 172.21.15.84:0/3171560085 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f663c0d1e40 0x7f663c1e66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:08.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.226+0000 7f6640f9c700 1 --2- 172.21.15.84:0/3171560085 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f663c15c860 0x7f663c1e6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:08.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.226+0000 7f663bfff700 1 -- 172.21.15.84:0/3171560085 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f663c15c860 msgr2=0x7f663c1e6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:08.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.226+0000 7f663bfff700 1 --2- 172.21.15.84:0/3171560085 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f663c15c860 0x7f663c1e6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:08.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.226+0000 7f663bfff700 1 -- 172.21.15.84:0/3171560085 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f663c0d1e40 msgr2=0x7f663c1e66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:08.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.226+0000 7f663bfff700 1 --2- 172.21.15.84:0/3171560085 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f663c0d1e40 0x7f663c1e66c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:08.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.226+0000 7f663bfff700 1 -- 172.21.15.84:0/3171560085 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6630009550 con 0x7f663c0c71b0 2023-07-14T11:20:08.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.226+0000 7f663bfff700 1 --2- 172.21.15.84:0/3171560085 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f663c0c71b0 0x7f663c1f4c90 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f662c00c450 tx=0x7f662c00c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:08.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.226+0000 7f6638ff9700 1 -- 172.21.15.84:0/3171560085 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662c0052d0 con 0x7f663c0c71b0 2023-07-14T11:20:08.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.227+0000 7f6638ff9700 1 -- 172.21.15.84:0/3171560085 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f662c005430 con 0x7f663c0c71b0 2023-07-14T11:20:08.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.227+0000 7f66429ff700 1 -- 172.21.15.84:0/3171560085 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f663c15e8b0 con 0x7f663c0c71b0 2023-07-14T11:20:08.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.227+0000 7f6638ff9700 1 -- 172.21.15.84:0/3171560085 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662c0038c0 con 0x7f663c0c71b0 2023-07-14T11:20:08.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.227+0000 7f66429ff700 1 -- 172.21.15.84:0/3171560085 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f663c15ee70 con 0x7f663c0c71b0 2023-07-14T11:20:08.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.228+0000 7f66429ff700 1 -- 172.21.15.84:0/3171560085 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f663c0ca4a0 con 0x7f663c0c71b0 2023-07-14T11:20:08.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.229+0000 7f6638ff9700 1 -- 172.21.15.84:0/3171560085 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f662c003a20 con 0x7f663c0c71b0 2023-07-14T11:20:08.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.229+0000 7f6638ff9700 1 --2- 172.21.15.84:0/3171560085 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f662806ae90 0x7f662806d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:08.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.230+0000 7f6638ff9700 1 -- 172.21.15.84:0/3171560085 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f662c0887b0 con 0x7f663c0c71b0 2023-07-14T11:20:08.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.230+0000 7f663b7fe700 1 --2- 172.21.15.84:0/3171560085 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f662806ae90 0x7f662806d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:08.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.231+0000 7f663b7fe700 1 --2- 172.21.15.84:0/3171560085 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f662806ae90 0x7f662806d340 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6630009c10 tx=0x7f6630008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:08.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.234+0000 7f6638ff9700 1 -- 172.21.15.84:0/3171560085 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f662c0538f0 con 0x7f663c0c71b0 2023-07-14T11:20:08.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.429+0000 7f66429ff700 1 -- 172.21.15.84:0/3171560085 --> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f663c0d1920 con 0x7f662806ae90 2023-07-14T11:20:08.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.430+0000 7f6638ff9700 1 -- 172.21.15.84:0/3171560085 <== mgr.4100 v2:172.21.15.179:6836/2094253834 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6630011b80 con 0x7f662806ae90 2023-07-14T11:20:08.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.433+0000 7f66429ff700 1 -- 172.21.15.84:0/3171560085 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f662806ae90 msgr2=0x7f662806d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:08.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.433+0000 7f66429ff700 1 --2- 172.21.15.84:0/3171560085 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f662806ae90 0x7f662806d340 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6630009c10 tx=0x7f6630008030 comp rx=0 tx=0).stop 2023-07-14T11:20:08.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.433+0000 7f66429ff700 1 -- 172.21.15.84:0/3171560085 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f663c0c71b0 msgr2=0x7f663c1f4c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:08.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.433+0000 7f66429ff700 1 --2- 172.21.15.84:0/3171560085 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f663c0c71b0 0x7f663c1f4c90 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f662c00c450 tx=0x7f662c00c760 comp rx=0 tx=0).stop 2023-07-14T11:20:08.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.433+0000 7f66429ff700 1 -- 172.21.15.84:0/3171560085 shutdown_connections 2023-07-14T11:20:08.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.433+0000 7f66429ff700 1 --2- 172.21.15.84:0/3171560085 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f662806ae90 0x7f662806d340 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:08.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.433+0000 7f66429ff700 1 --2- 172.21.15.84:0/3171560085 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f663c15c860 0x7f663c1e6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:08.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.433+0000 7f66429ff700 1 --2- 172.21.15.84:0/3171560085 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f663c0c71b0 0x7f663c1f4c90 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:08.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.433+0000 7f66429ff700 1 --2- 172.21.15.84:0/3171560085 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f663c0d1e40 0x7f663c1e66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:08.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.433+0000 7f66429ff700 1 -- 172.21.15.84:0/3171560085 >> 172.21.15.84:0/3171560085 conn(0x7f663c065bd0 msgr2=0x7f663c15b150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:20:08.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.433+0000 7f66429ff700 1 -- 172.21.15.84:0/3171560085 shutdown_connections 2023-07-14T11:20:08.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.433+0000 7f66429ff700 1 -- 172.21.15.84:0/3171560085 wait complete. 2023-07-14T11:20:08.438 INFO:teuthology.orchestra.run.smithi084.stderr:instructed osd(s) 7 to deep-scrub 2023-07-14T11:20:08.453 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T11:20:08.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.646+0000 7f8fbbdff700 1 Processor -- start 2023-07-14T11:20:08.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.646+0000 7f8fbbdff700 1 -- start start 2023-07-14T11:20:08.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.647+0000 7f8fbbdff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8fb40d1310 0x7f8fb40cd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:08.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.647+0000 7f8fbbdff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8fb40cdb20 0x7f8fb40cdf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:08.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.647+0000 7f8fbbdff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8fb406e1c0 0x7f8fb406e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:08.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.647+0000 7f8fbbdff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fb40ce4d0 con 0x7f8fb406e1c0 2023-07-14T11:20:08.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.647+0000 7f8fbbdff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fb406dd30 con 0x7f8fb40d1310 2023-07-14T11:20:08.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.647+0000 7f8fbbdff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb415cda0 con 0x7f8fb40cdb20 2023-07-14T11:20:08.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.648+0000 7f8fba39c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8fb406e1c0 0x7f8fb406e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:08.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.648+0000 7f8fba39c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8fb406e1c0 0x7f8fb406e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60368/0 (socket says 172.21.15.84:60368) 2023-07-14T11:20:08.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.648+0000 7f8fba39c700 1 -- 172.21.15.84:0/1103476535 learned_addr learned my addr 172.21.15.84:0/1103476535 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:20:08.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.648+0000 7f8fb939a700 1 --2- 172.21.15.84:0/1103476535 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8fb40cdb20 0x7f8fb40cdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:08.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.648+0000 7f8fb9b9b700 1 --2- 172.21.15.84:0/1103476535 >> v2:172.21.15.179:3300/0 conn(0x7f8fb40d1310 0x7f8fb40cd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:08.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.648+0000 7f8fba39c700 1 -- 172.21.15.84:0/1103476535 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8fb40cdb20 msgr2=0x7f8fb40cdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:20:08.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.648+0000 7f8fba39c700 1 --2- 172.21.15.84:0/1103476535 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8fb40cdb20 0x7f8fb40cdf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:08.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.648+0000 7f8fba39c700 1 -- 172.21.15.84:0/1103476535 >> v2:172.21.15.179:3300/0 conn(0x7f8fb40d1310 msgr2=0x7f8fb40cd5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:20:08.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.648+0000 7f8fba39c700 1 --2- 172.21.15.84:0/1103476535 >> v2:172.21.15.179:3300/0 conn(0x7f8fb40d1310 0x7f8fb40cd5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:08.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.648+0000 7f8fba39c700 1 -- 172.21.15.84:0/1103476535 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb40cc8f0 con 0x7f8fb406e1c0 2023-07-14T11:20:08.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.648+0000 7f8fb9b9b700 1 --2- 172.21.15.84:0/1103476535 >> v2:172.21.15.179:3300/0 conn(0x7f8fb40d1310 0x7f8fb40cd5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:20:08.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.648+0000 7f8fba39c700 1 --2- 172.21.15.84:0/1103476535 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fb406e1c0 0x7f8fb406e610 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f8fb4070a50 tx=0x7f8fac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8baba9a4b77091dc server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:08.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.649+0000 7f8fb8b99700 1 -- 172.21.15.84:0/1103476535 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fac00e070 con 0x7f8fb406e1c0 2023-07-14T11:20:08.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.649+0000 7f8fb8b99700 1 -- 172.21.15.84:0/1103476535 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fac00b910 con 0x7f8fb406e1c0 2023-07-14T11:20:08.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.649+0000 7f8fb8b99700 1 -- 172.21.15.84:0/1103476535 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fac00bcc0 con 0x7f8fb406e1c0 2023-07-14T11:20:08.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.649+0000 7f8fbbdff700 1 -- 172.21.15.84:0/1103476535 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fb406e1c0 msgr2=0x7f8fb406e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:08.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.649+0000 7f8fbbdff700 1 --2- 172.21.15.84:0/1103476535 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fb406e1c0 0x7f8fb406e610 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f8fb4070a50 tx=0x7f8fac00b330 comp rx=0 tx=0).stop 2023-07-14T11:20:08.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.649+0000 7f8fbbdff700 1 -- 172.21.15.84:0/1103476535 shutdown_connections 2023-07-14T11:20:08.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.649+0000 7f8fbbdff700 1 --2- 172.21.15.84:0/1103476535 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fb406e1c0 0x7f8fb406e610 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:08.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.649+0000 7f8fbbdff700 1 --2- 172.21.15.84:0/1103476535 >> v2:172.21.15.179:3300/0 conn(0x7f8fb40d1310 0x7f8fb40cd5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:08.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.649+0000 7f8fbbdff700 1 --2- 172.21.15.84:0/1103476535 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8fb40cdb20 0x7f8fb40cdf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:08.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.649+0000 7f8fbbdff700 1 -- 172.21.15.84:0/1103476535 >> 172.21.15.84:0/1103476535 conn(0x7f8fb40999e0 msgr2=0x7f8fb4099de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:20:08.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.649+0000 7f8fbbdff700 1 -- 172.21.15.84:0/1103476535 shutdown_connections 2023-07-14T11:20:08.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.650+0000 7f8fbbdff700 1 -- 172.21.15.84:0/1103476535 wait complete. 2023-07-14T11:20:08.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.651+0000 7f8fbbdff700 1 Processor -- start 2023-07-14T11:20:08.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.651+0000 7f8fbbdff700 1 -- start start 2023-07-14T11:20:08.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.652+0000 7f8fbbdff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8fb406e1c0 0x7f8fb41e1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:08.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.652+0000 7f8fbbdff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8fb40cdb20 0x7f8fb40c70a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:08.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.652+0000 7f8fbbdff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fb40d1310 0x7f8fb40b3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:08.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.652+0000 7f8fbbdff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb40c75e0 con 0x7f8fb40d1310 2023-07-14T11:20:08.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.652+0000 7f8fbbdff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb41e22d0 con 0x7f8fb406e1c0 2023-07-14T11:20:08.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.652+0000 7f8fbbdff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb41e25b0 con 0x7f8fb40cdb20 2023-07-14T11:20:08.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.652+0000 7f8fba39c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fb40d1310 0x7f8fb40b3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:08.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.653+0000 7f8fba39c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fb40d1310 0x7f8fb40b3040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60372/0 (socket says 172.21.15.84:60372) 2023-07-14T11:20:08.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.653+0000 7f8fba39c700 1 -- 172.21.15.84:0/2688914139 learned_addr learned my addr 172.21.15.84:0/2688914139 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:20:08.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.653+0000 7f8fb939a700 1 --2- 172.21.15.84:0/2688914139 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8fb40cdb20 0x7f8fb40c70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:08.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.653+0000 7f8fb9b9b700 1 --2- 172.21.15.84:0/2688914139 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8fb406e1c0 0x7f8fb41e1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:08.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.653+0000 7f8fba39c700 1 -- 172.21.15.84:0/2688914139 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8fb40cdb20 msgr2=0x7f8fb40c70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:08.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.653+0000 7f8fba39c700 1 --2- 172.21.15.84:0/2688914139 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8fb40cdb20 0x7f8fb40c70a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:08.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.653+0000 7f8fba39c700 1 -- 172.21.15.84:0/2688914139 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8fb406e1c0 msgr2=0x7f8fb41e1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:08.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.653+0000 7f8fba39c700 1 --2- 172.21.15.84:0/2688914139 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8fb406e1c0 0x7f8fb41e1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:08.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.653+0000 7f8fba39c700 1 -- 172.21.15.84:0/2688914139 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fac009b30 con 0x7f8fb40d1310 2023-07-14T11:20:08.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.653+0000 7f8fba39c700 1 --2- 172.21.15.84:0/2688914139 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fb40d1310 0x7f8fb40b3040 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f8fb4070fd0 tx=0x7f8fac004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:08.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.653+0000 7f8faa7fc700 1 -- 172.21.15.84:0/2688914139 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fac0099b0 con 0x7f8fb40d1310 2023-07-14T11:20:08.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.653+0000 7f8faa7fc700 1 -- 172.21.15.84:0/2688914139 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fac004250 con 0x7f8fb40d1310 2023-07-14T11:20:08.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.653+0000 7f8faa7fc700 1 -- 172.21.15.84:0/2688914139 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fac004600 con 0x7f8fb40d1310 2023-07-14T11:20:08.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.653+0000 7f8fbbdff700 1 -- 172.21.15.84:0/2688914139 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fb41e2890 con 0x7f8fb40d1310 2023-07-14T11:20:08.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.654+0000 7f8fbbdff700 1 -- 172.21.15.84:0/2688914139 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fb41e2e50 con 0x7f8fb40d1310 2023-07-14T11:20:08.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.655+0000 7f8fbbdff700 1 -- 172.21.15.84:0/2688914139 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fb404e280 con 0x7f8fb40d1310 2023-07-14T11:20:08.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.655+0000 7f8faa7fc700 1 -- 172.21.15.84:0/2688914139 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f8fac004760 con 0x7f8fb40d1310 2023-07-14T11:20:08.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.656+0000 7f8faa7fc700 1 --2- 172.21.15.84:0/2688914139 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f8f9806ae90 0x7f8f9806d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:08.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.657+0000 7f8faa7fc700 1 -- 172.21.15.84:0/2688914139 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f8fac08aaf0 con 0x7f8fb40d1310 2023-07-14T11:20:08.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.657+0000 7f8fb9b9b700 1 --2- 172.21.15.84:0/2688914139 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f8f9806ae90 0x7f8f9806d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:08.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.658+0000 7f8fb9b9b700 1 --2- 172.21.15.84:0/2688914139 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f8f9806ae90 0x7f8f9806d340 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8fb40cd7b0 tx=0x7f8fb0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:08.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.661+0000 7f8faa7fc700 1 -- 172.21.15.84:0/2688914139 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f8fac055b20 con 0x7f8fb40d1310 2023-07-14T11:20:08.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.850+0000 7f8fbbdff700 1 -- 172.21.15.84:0/2688914139 --> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8fb40cceb0 con 0x7f8f9806ae90 2023-07-14T11:20:08.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.853+0000 7f8faa7fc700 1 -- 172.21.15.84:0/2688914139 <== mgr.4100 v2:172.21.15.179:6836/2094253834 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72245 (secure 0 0 0) 0x7f8fb000c590 con 0x7f8f9806ae90 2023-07-14T11:20:08.857 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:20:08.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.856+0000 7f8fbbdff700 1 -- 172.21.15.84:0/2688914139 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f8f9806ae90 msgr2=0x7f8f9806d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:08.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.856+0000 7f8fbbdff700 1 --2- 172.21.15.84:0/2688914139 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f8f9806ae90 0x7f8f9806d340 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8fb40cd7b0 tx=0x7f8fb0008040 comp rx=0 tx=0).stop 2023-07-14T11:20:08.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.856+0000 7f8fbbdff700 1 -- 172.21.15.84:0/2688914139 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fb40d1310 msgr2=0x7f8fb40b3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:08.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.856+0000 7f8fbbdff700 1 --2- 172.21.15.84:0/2688914139 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fb40d1310 0x7f8fb40b3040 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f8fb4070fd0 tx=0x7f8fac004ad0 comp rx=0 tx=0).stop 2023-07-14T11:20:08.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.856+0000 7f8fbbdff700 1 -- 172.21.15.84:0/2688914139 shutdown_connections 2023-07-14T11:20:08.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.856+0000 7f8fbbdff700 1 --2- 172.21.15.84:0/2688914139 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fb40d1310 0x7f8fb40b3040 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:08.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.856+0000 7f8fbbdff700 1 --2- 172.21.15.84:0/2688914139 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8fb406e1c0 0x7f8fb41e1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:08.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.856+0000 7f8fbbdff700 1 --2- 172.21.15.84:0/2688914139 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f8f9806ae90 0x7f8f9806d340 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:08.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.856+0000 7f8fbbdff700 1 --2- 172.21.15.84:0/2688914139 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8fb40cdb20 0x7f8fb40c70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:08.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.856+0000 7f8fbbdff700 1 -- 172.21.15.84:0/2688914139 >> 172.21.15.84:0/2688914139 conn(0x7f8fb40999e0 msgr2=0x7f8fb40ad950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:20:08.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.856+0000 7f8fbbdff700 1 -- 172.21.15.84:0/2688914139 shutdown_connections 2023-07-14T11:20:08.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:08.856+0000 7f8fbbdff700 1 -- 172.21.15.84:0/2688914139 wait complete. 2023-07-14T11:20:08.862 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-07-14T11:20:08.876 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":89,"stamp":"2023-07-14T11:20:06.947379+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":239720,"kb_used_data":11816,"kb_used_omap":0,"kb_used_meta":227840,"kb_avail":754735000,"statfs":{"total":773094113280,"available":772848640000,"internally_reserved":0,"allocated":12099584,"data_stored":6222552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":233308160},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-144,"num_objects":-1,"num_object_clones":0,"num_object_copies":-2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1,"num_whiteouts":0,"num_read":-22,"num_read_kb":-12,"num_write":-1,"num_write_kb":-1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002050"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":174,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T11:19:58.072924+0000","last_change":"2023-07-14T11:13:08.762084+0000","last_active":"2023-07-14T11:19:58.072924+0000","last_peered":"2023-07-14T11:19:58.072924+0000","last_clean":"2023-07-14T11:19:58.072924+0000","last_became_active":"2023-07-14T11:13:08.761763+0000","last_became_peered":"2023-07-14T11:13:08.761763+0000","last_unstale":"2023-07-14T11:19:58.072924+0000","last_undegraded":"2023-07-14T11:19:58.072924+0000","last_fullsized":"2023-07-14T11:19:58.072924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:40:50.844385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":194,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T11:19:57.946665+0000","last_change":"2023-07-14T11:13:08.761726+0000","last_active":"2023-07-14T11:19:57.946665+0000","last_peered":"2023-07-14T11:19:57.946665+0000","last_clean":"2023-07-14T11:19:57.946665+0000","last_became_active":"2023-07-14T11:13:08.761365+0000","last_became_peered":"2023-07-14T11:13:08.761365+0000","last_unstale":"2023-07-14T11:19:57.946665+0000","last_undegraded":"2023-07-14T11:19:57.946665+0000","last_fullsized":"2023-07-14T11:19:57.946665+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:21:57.190044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":164,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T11:19:58.076903+0000","last_change":"2023-07-14T11:13:08.923899+0000","last_active":"2023-07-14T11:19:58.076903+0000","last_peered":"2023-07-14T11:19:58.076903+0000","last_clean":"2023-07-14T11:19:58.076903+0000","last_became_active":"2023-07-14T11:13:08.923513+0000","last_became_peered":"2023-07-14T11:13:08.923513+0000","last_unstale":"2023-07-14T11:19:58.076903+0000","last_undegraded":"2023-07-14T11:19:58.076903+0000","last_fullsized":"2023-07-14T11:19:58.076903+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:25:27.112633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":164,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T11:19:58.071740+0000","last_change":"2023-07-14T11:13:08.760609+0000","last_active":"2023-07-14T11:19:58.071740+0000","last_peered":"2023-07-14T11:19:58.071740+0000","last_clean":"2023-07-14T11:19:58.071740+0000","last_became_active":"2023-07-14T11:13:08.760285+0000","last_became_peered":"2023-07-14T11:13:08.760285+0000","last_unstale":"2023-07-14T11:19:58.071740+0000","last_undegraded":"2023-07-14T11:19:58.071740+0000","last_fullsized":"2023-07-14T11:19:58.071740+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:21:36.334067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"76'128","reported_seq":359,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T11:19:58.071909+0000","last_change":"2023-07-14T11:13:01.370649+0000","last_active":"2023-07-14T11:19:58.071909+0000","last_peered":"2023-07-14T11:19:58.071909+0000","last_clean":"2023-07-14T11:19:58.071909+0000","last_became_active":"2023-07-14T11:13:01.369478+0000","last_became_peered":"2023-07-14T11:13:01.369478+0000","last_unstale":"2023-07-14T11:19:58.071909+0000","last_undegraded":"2023-07-14T11:19:58.071909+0000","last_fullsized":"2023-07-14T11:19:58.071909+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:00.254800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:00.254800+0000","last_clean_scrub_stamp":"2023-07-14T11:13:00.254800+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:07:22.146964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":178,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T11:19:57.942399+0000","last_change":"2023-07-14T11:13:08.757882+0000","last_active":"2023-07-14T11:19:57.942399+0000","last_peered":"2023-07-14T11:19:57.942399+0000","last_clean":"2023-07-14T11:19:57.942399+0000","last_became_active":"2023-07-14T11:13:08.757541+0000","last_became_peered":"2023-07-14T11:13:08.757541+0000","last_unstale":"2023-07-14T11:19:57.942399+0000","last_undegraded":"2023-07-14T11:19:57.942399+0000","last_fullsized":"2023-07-14T11:19:57.942399+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:49:40.833577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":182,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T11:19:57.943174+0000","last_change":"2023-07-14T11:13:08.862331+0000","last_active":"2023-07-14T11:19:57.943174+0000","last_peered":"2023-07-14T11:19:57.943174+0000","last_clean":"2023-07-14T11:19:57.943174+0000","last_became_active":"2023-07-14T11:13:08.861817+0000","last_became_peered":"2023-07-14T11:13:08.861817+0000","last_unstale":"2023-07-14T11:19:57.943174+0000","last_undegraded":"2023-07-14T11:19:57.943174+0000","last_fullsized":"2023-07-14T11:19:57.943174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:30:21.109407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":178,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T11:19:57.941200+0000","last_change":"2023-07-14T11:13:08.758749+0000","last_active":"2023-07-14T11:19:57.941200+0000","last_peered":"2023-07-14T11:19:57.941200+0000","last_clean":"2023-07-14T11:19:57.941200+0000","last_became_active":"2023-07-14T11:13:08.757956+0000","last_became_peered":"2023-07-14T11:13:08.757956+0000","last_unstale":"2023-07-14T11:19:57.941200+0000","last_undegraded":"2023-07-14T11:19:57.941200+0000","last_fullsized":"2023-07-14T11:19:57.941200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T11:14:24.142374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":194,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T11:19:57.946723+0000","last_change":"2023-07-14T11:13:08.923786+0000","last_active":"2023-07-14T11:19:57.946723+0000","last_peered":"2023-07-14T11:19:57.946723+0000","last_clean":"2023-07-14T11:19:57.946723+0000","last_became_active":"2023-07-14T11:13:08.923384+0000","last_became_peered":"2023-07-14T11:13:08.923384+0000","last_unstale":"2023-07-14T11:19:57.946723+0000","last_undegraded":"2023-07-14T11:19:57.946723+0000","last_fullsized":"2023-07-14T11:19:57.946723+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:13:07.742728+0000","last_clean_scrub_stamp":"2023-07-14T11:13:07.742728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:36:32.179796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574937,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32960,"kb_used_data":1912,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338880,"statfs":{"total":96636764160,"available":96603013120,"internally_reserved":0,"allocated":1957888,"data_stored":1220595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:19:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.66200000000000003,"15min":0.89400000000000002},"min":{"1min":0.55500000000000005,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":8.4339999999999993},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.69199999999999995,"15min":0.92800000000000005},"min":{"1min":0.47599999999999998,"5min":0.45500000000000002,"15min":0.377},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":8.4559999999999995},"last":0.85299999999999998}]},{"osd":1,"last update":"Fri Jul 14 11:19:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.67200000000000004,"15min":0.871},"min":{"1min":0.52100000000000002,"5min":0.40400000000000003,"15min":0.34899999999999998},"max":{"1min":0.90400000000000003,"5min":0.92800000000000005,"15min":6.3520000000000003},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.66100000000000003,"15min":1.0089999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":6.8550000000000004},"last":0.80600000000000005}]},{"osd":2,"last update":"Fri Jul 14 11:19:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.67100000000000004,"15min":1.0569999999999999},"min":{"1min":0.499,"5min":0.434,"15min":0.434},"max":{"1min":0.83599999999999997,"5min":0.997,"15min":7.0289999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.70399999999999996,"15min":0.69299999999999995},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.86399999999999999,"5min":0.98199999999999998,"15min":1.0580000000000001},"last":0.77700000000000002}]},{"osd":3,"last update":"Fri Jul 14 11:19:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.68899999999999995,"15min":1.109},"min":{"1min":0.55200000000000005,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.91100000000000003,"5min":0.95699999999999996,"15min":10.337},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.72699999999999998,"15min":0.75800000000000001},"min":{"1min":0.53300000000000003,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.90100000000000002,"5min":1.024,"15min":1.921},"last":0.83899999999999997}]},{"osd":4,"last update":"Fri Jul 14 11:19:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.64700000000000002,"15min":0.59899999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.629},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.73599999999999999,"15min":0.70599999999999996},"min":{"1min":0.57299999999999995,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.90800000000000003,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.68500000000000005}]},{"osd":5,"last update":"Fri Jul 14 11:19:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.70099999999999996,"15min":0.67900000000000005},"min":{"1min":0.39700000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.92800000000000005,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.76400000000000001,"15min":0.73999999999999999},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.746}]},{"osd":6,"last update":"Fri Jul 14 11:19:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.72899999999999998,"15min":0.68300000000000005},"min":{"1min":0.505,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.98799999999999999,"5min":1.002,"15min":1.002},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.73299999999999998,"15min":0.69399999999999995},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.48899999999999999},"max":{"1min":0.97399999999999998,"5min":1.129,"15min":1.129},"last":0.64800000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574938,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32380,"kb_used_data":1332,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339460,"statfs":{"total":96636764160,"available":96603607040,"internally_reserved":0,"allocated":1363968,"data_stored":630227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.69899999999999995,"15min":0.70299999999999996},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93799999999999994,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.73499999999999999,"15min":0.72099999999999997},"min":{"1min":0.51100000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.83899999999999997,"5min":1.167,"15min":1.167},"last":0.54500000000000004}]},{"osd":1,"last update":"Fri Jul 14 11:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71899999999999997,"15min":0.69099999999999995},"min":{"1min":0.443,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.73099999999999998,"15min":0.71399999999999997},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39300000000000002},"max":{"1min":0.90400000000000003,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.73999999999999999}]},{"osd":2,"last update":"Fri Jul 14 11:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.69899999999999995,"15min":0.67900000000000005},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.41299999999999998},"max":{"1min":0.89000000000000001,"5min":1.45,"15min":1.45},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.755,"5min":0.754,"15min":0.77600000000000002},"min":{"1min":0.56399999999999995,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.075,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.81200000000000006}]},{"osd":3,"last update":"Fri Jul 14 11:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.73099999999999998,"15min":0.74299999999999999},"min":{"1min":0.50900000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.86499999999999999,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.73299999999999998,"15min":0.73899999999999999},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0469999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.83499999999999996}]},{"osd":4,"last update":"Fri Jul 14 11:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.69099999999999995,"15min":0.70699999999999996},"min":{"1min":0.53300000000000003,"5min":0.38,"15min":0.38},"max":{"1min":1.177,"5min":1.712,"15min":1.712},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.71999999999999997,"15min":0.72599999999999998},"min":{"1min":0.48199999999999998,"5min":0.438,"15min":0.42899999999999999},"max":{"1min":0.998,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.88100000000000001}]},{"osd":5,"last update":"Fri Jul 14 11:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.71199999999999997,"15min":0.71799999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.93500000000000005,"5min":2.8820000000000001,"15min":2.8820000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.77200000000000002,"15min":0.78800000000000003},"min":{"1min":0.58399999999999996,"5min":0.46100000000000002,"15min":0.44500000000000001},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.85699999999999998}]},{"osd":7,"last update":"Fri Jul 14 11:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.77500000000000002,"15min":0.79900000000000004},"min":{"1min":0.59899999999999998,"5min":0.47399999999999998,"15min":0.47099999999999997},"max":{"1min":0.95499999999999996,"5min":1.333,"15min":1.333},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.76300000000000001,"15min":0.78900000000000003},"min":{"1min":0.46899999999999997,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.1579999999999999,"5min":1.55,"15min":1.55},"last":0.94699999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574937,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32380,"kb_used_data":1332,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339460,"statfs":{"total":96636764160,"available":96603607040,"internally_reserved":0,"allocated":1363968,"data_stored":630227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.40500000000000003,"15min":0.432},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.54200000000000004,"5min":0.59099999999999997,"15min":0.996},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.432,"5min":0.45500000000000002,"15min":0.47599999999999998},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.57299999999999995,"5min":0.81599999999999995,"15min":0.84299999999999997},"last":0.58799999999999997}]},{"osd":2,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.48099999999999998,"15min":0.54900000000000004},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.60299999999999998,"5min":0.70799999999999996,"15min":2.476},"last":0.496},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.48899999999999999,"15min":0.59499999999999997},"min":{"1min":0.36899999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.64700000000000002,"5min":0.91700000000000004,"15min":2.6299999999999999},"last":0.54800000000000004}]},{"osd":3,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.52800000000000002,"15min":0.52200000000000002},"min":{"1min":0.40899999999999997,"5min":0.39300000000000002,"15min":0.38900000000000001},"max":{"1min":0.72599999999999998,"5min":0.748,"15min":0.748},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46500000000000002,"15min":0.48799999999999999},"min":{"1min":0.33600000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.59499999999999997,"5min":0.67700000000000005,"15min":0.73199999999999998},"last":0.372}]},{"osd":4,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.73699999999999999,"15min":0.749},"min":{"1min":0.52400000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.363},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.751,"5min":0.754,"15min":0.76900000000000002},"min":{"1min":0.57099999999999995,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.93999999999999995,"5min":1.1160000000000001,"15min":1.4890000000000001},"last":0.64600000000000002}]},{"osd":5,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.749,"15min":0.76500000000000001},"min":{"1min":0.54200000000000004,"5min":0.499,"15min":0.499},"max":{"1min":1.0589999999999999,"5min":1.2250000000000001,"15min":1.3759999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76200000000000001,"15min":0.80800000000000005},"min":{"1min":0.59099999999999997,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.4330000000000001},"last":0.68100000000000005}]},{"osd":6,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.745,"15min":0.78800000000000003},"min":{"1min":0.55900000000000005,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.028,"5min":1.141,"15min":1.298},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.753,"15min":0.77900000000000003},"min":{"1min":0.60199999999999998,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.97199999999999998,"5min":1.1899999999999999,"15min":1.2130000000000001},"last":0.69399999999999995}]},{"osd":7,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.75900000000000001,"15min":0.80700000000000005},"min":{"1min":0.58299999999999996,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0780000000000001,"5min":1.2010000000000001,"15min":1.4590000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.75,"15min":0.77900000000000003},"min":{"1min":0.56299999999999994,"5min":0.55000000000000004,"15min":0.54200000000000004},"max":{"1min":1.129,"5min":1.129,"15min":1.3700000000000001},"last":0.51400000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574935,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28864,"kb_used_data":1912,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94342976,"statfs":{"total":96636764160,"available":96607207424,"internally_reserved":0,"allocated":1957888,"data_stored":1220595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 11:19:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.47699999999999998,"15min":0.44700000000000001},"min":{"1min":0.26800000000000002,"5min":0.252,"15min":0.252},"max":{"1min":2.972,"5min":2.972,"15min":2.972},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.47599999999999998,"15min":0.45200000000000001},"min":{"1min":0.33300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":2.758,"5min":2.758,"15min":2.758},"last":0.40999999999999998}]},{"osd":2,"last update":"Fri Jul 14 11:19:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.499,"15min":0.47299999999999998},"min":{"1min":0.35599999999999998,"5min":0.307,"15min":0.307},"max":{"1min":2.9409999999999998,"5min":2.9409999999999998,"15min":2.9409999999999998},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.51900000000000002,"15min":0.50900000000000001},"min":{"1min":0.376,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":2.556,"5min":2.556,"15min":2.556},"last":0.47299999999999998}]},{"osd":3,"last update":"Fri Jul 14 11:19:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.48199999999999998,"15min":0.438},"min":{"1min":0.33700000000000002,"5min":0.32000000000000001,"15min":0.309},"max":{"1min":2.6019999999999999,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.55600000000000005,"15min":0.53500000000000003},"min":{"1min":0.44900000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":2.9990000000000001,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":0.433}]},{"osd":4,"last update":"Fri Jul 14 11:19:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.73699999999999999,"15min":0.75700000000000001},"min":{"1min":0.51200000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0229999999999999,"5min":1.099,"15min":1.1060000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.76400000000000001,"15min":0.71799999999999997},"min":{"1min":0.57499999999999996,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.651,"5min":1.651,"15min":1.651},"last":0.58299999999999996}]},{"osd":5,"last update":"Fri Jul 14 11:19:12 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.77200000000000002,"15min":0.73799999999999999},"min":{"1min":0.51900000000000002,"5min":0.502,"15min":0.47999999999999998},"max":{"1min":2.9089999999999998,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.76500000000000001,"15min":0.77600000000000002},"min":{"1min":0.53200000000000003,"5min":0.505,"15min":0.505},"max":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.60399999999999998}]},{"osd":6,"last update":"Fri Jul 14 11:19:12 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.745,"15min":0.72799999999999998},"min":{"1min":0.499,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.78700000000000003,"15min":0.78300000000000003},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":2.8679999999999999,"5min":2.8679999999999999,"15min":2.8679999999999999},"last":0.63300000000000001}]},{"osd":7,"last update":"Fri Jul 14 11:19:12 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.77700000000000002,"15min":0.80900000000000005},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.97599999999999998,"5min":1.0900000000000001,"15min":1.149},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.81899999999999995,"15min":0.78900000000000003},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.7410000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":0.61799999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574935,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28284,"kb_used_data":1332,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343556,"statfs":{"total":96636764160,"available":96607801344,"internally_reserved":0,"allocated":1363968,"data_stored":630227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:19:20 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.40899999999999997,"15min":0.441},"min":{"1min":0.27100000000000002,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.623,"5min":0.63900000000000001,"15min":0.64700000000000002},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.438,"15min":0.44400000000000001},"min":{"1min":0.32100000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.63700000000000001,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.41799999999999998}]},{"osd":1,"last update":"Fri Jul 14 11:19:20 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46700000000000003,"15min":0.48199999999999998},"min":{"1min":0.371,"5min":0.31,"15min":0.31},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.98299999999999998},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.47899999999999998,"15min":0.48699999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.59199999999999997,"5min":0.629,"15min":0.91200000000000003},"last":0.45600000000000002}]},{"osd":3,"last update":"Fri Jul 14 11:19:20 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.48699999999999999,"15min":0.49299999999999999},"min":{"1min":0.34999999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.623,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.55700000000000005,"15min":0.57999999999999996},"min":{"1min":0.44500000000000001,"5min":0.41499999999999998,"15min":0.40799999999999997},"max":{"1min":0.72899999999999998,"5min":0.80000000000000004,"15min":1.034},"last":0.52600000000000002}]},{"osd":4,"last update":"Fri Jul 14 11:19:20 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.73499999999999999,"15min":0.76300000000000001},"min":{"1min":0.53900000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.036,"5min":1.171,"15min":1.212},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.749,"15min":0.77900000000000003},"min":{"1min":0.53800000000000003,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.64900000000000002}]},{"osd":5,"last update":"Fri Jul 14 11:19:20 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.74399999999999999,"15min":0.78200000000000003},"min":{"1min":0.53900000000000003,"5min":0.51700000000000002,"15min":0.43099999999999999},"max":{"1min":1.202,"5min":1.202,"15min":1.4019999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.75,"5min":0.76300000000000001,"15min":0.81100000000000005},"min":{"1min":0.55800000000000005,"5min":0.495,"15min":0.495},"max":{"1min":1.044,"5min":1.351,"15min":1.351},"last":0.57499999999999996}]},{"osd":6,"last update":"Fri Jul 14 11:19:20 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.753,"15min":0.78100000000000003},"min":{"1min":0.53100000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0089999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.76800000000000002,"15min":0.81299999999999994},"min":{"1min":0.60199999999999998,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.218,"5min":1.282,"15min":1.282},"last":0.63400000000000001}]},{"osd":7,"last update":"Fri Jul 14 11:19:20 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.754,"15min":0.79100000000000004},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.93400000000000005,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.754,"15min":0.79600000000000004},"min":{"1min":0.60899999999999999,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.96399999999999997,"5min":1.244,"15min":1.244},"last":0.61899999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574935,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28284,"kb_used_data":1332,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343556,"statfs":{"total":96636764160,"available":96607801344,"internally_reserved":0,"allocated":1363968,"data_stored":630227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.41099999999999998,"15min":0.442},"min":{"1min":0.24299999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.55900000000000005,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.44500000000000001,"15min":0.44800000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.621,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.502}]},{"osd":1,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.44,"15min":0.44900000000000001},"min":{"1min":0.29499999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.52000000000000002,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.47199999999999998,"15min":0.49099999999999999},"min":{"1min":0.317,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.60899999999999999,"5min":0.72699999999999998,"15min":0.86399999999999999},"last":0.55300000000000005}]},{"osd":2,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.53400000000000003,"15min":0.54000000000000004},"min":{"1min":0.39600000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.64900000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56200000000000006,"15min":0.58999999999999997},"min":{"1min":0.44,"5min":0.37,"15min":0.37},"max":{"1min":0.76100000000000001,"5min":0.79600000000000004,"15min":1.585},"last":0.61099999999999999}]},{"osd":4,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.73299999999999998,"15min":0.754},"min":{"1min":0.45400000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.96399999999999997,"5min":1.1279999999999999,"15min":1.216},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.76700000000000002,"15min":0.75700000000000001},"min":{"1min":0.48599999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.60099999999999998}]},{"osd":5,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.747,"15min":0.75700000000000001},"min":{"1min":0.48499999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.089,"5min":1.179,"15min":1.413},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.76700000000000002,"15min":0.83499999999999996},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.94999999999999996,"5min":1.1619999999999999,"15min":1.657},"last":0.66000000000000003}]},{"osd":6,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77700000000000002,"15min":0.78300000000000003},"min":{"1min":0.56699999999999995,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.726},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.76800000000000002,"15min":0.79400000000000004},"min":{"1min":0.57099999999999995,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.143,"5min":1.286,"15min":1.333},"last":0.67500000000000004}]},{"osd":7,"last update":"Fri Jul 14 11:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.79700000000000004,"15min":0.83099999999999996},"min":{"1min":0.53800000000000003,"5min":0.437,"15min":0.437},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.3939999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.80800000000000005,"15min":0.83399999999999996},"min":{"1min":0.60299999999999998,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.622}]}]},{"osd":4,"up_from":13,"seq":55834574935,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28284,"kb_used_data":1332,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343556,"statfs":{"total":96636764160,"available":96607801344,"internally_reserved":0,"allocated":1363968,"data_stored":630227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:19:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.64900000000000002,"15min":0.63500000000000001},"min":{"1min":0.437,"5min":0.311,"15min":0.311},"max":{"1min":0.89600000000000002,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.65200000000000002,"15min":0.68400000000000005},"min":{"1min":0.47699999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85199999999999998,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.52000000000000002}]},{"osd":1,"last update":"Fri Jul 14 11:19:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.65200000000000002,"15min":0.66600000000000004},"min":{"1min":0.51700000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.83599999999999997,"5min":0.92000000000000004,"15min":1.4259999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70299999999999996,"15min":0.70999999999999996},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.45800000000000002},"max":{"1min":0.95799999999999996,"5min":1.0149999999999999,"15min":1.1659999999999999},"last":0.65300000000000002}]},{"osd":2,"last update":"Fri Jul 14 11:19:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.69999999999999996,"15min":0.70699999999999996},"min":{"1min":0.501,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.88200000000000001,"5min":1.0209999999999999,"15min":1.48},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71999999999999997,"15min":0.73599999999999999},"min":{"1min":0.54800000000000004,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.91800000000000004,"5min":1.1080000000000001,"15min":1.23},"last":0.625}]},{"osd":3,"last update":"Fri Jul 14 11:19:15 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.67800000000000005,"15min":0.70799999999999996},"min":{"1min":0.51300000000000001,"5min":0.438,"15min":0.438},"max":{"1min":0.95599999999999996,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.72999999999999998,"15min":0.73599999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.90700000000000003,"5min":1.1259999999999999,"15min":1.145},"last":0.56299999999999994}]},{"osd":5,"last update":"Fri Jul 14 11:19:15 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.66600000000000004,"15min":0.74299999999999999},"min":{"1min":0.47399999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.81799999999999995,"5min":0.95999999999999996,"15min":1.6559999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.65700000000000003,"15min":0.745},"min":{"1min":0.41999999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.90500000000000003,"5min":0.96999999999999997,"15min":1.3839999999999999},"last":0.55000000000000004}]},{"osd":6,"last update":"Fri Jul 14 11:19:15 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.68500000000000005,"15min":0.71299999999999997},"min":{"1min":0.45200000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.86799999999999999,"5min":1.1659999999999999,"15min":1.1970000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.73699999999999999,"15min":0.76600000000000001},"min":{"1min":0.56899999999999995,"5min":0.442,"15min":0.442},"max":{"1min":0.878,"5min":1.1479999999999999,"15min":1.3},"last":0.67200000000000004}]},{"osd":7,"last update":"Fri Jul 14 11:19:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.70499999999999996,"15min":0.755},"min":{"1min":0.47899999999999998,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.88,"5min":1.028,"15min":1.4810000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.755,"15min":0.82599999999999996},"min":{"1min":0.59099999999999997,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.82499999999999996,"5min":1.21,"15min":1.379},"last":0.77800000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574937,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28284,"kb_used_data":1332,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343556,"statfs":{"total":96636764160,"available":96607801344,"internally_reserved":0,"allocated":1363968,"data_stored":630227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:19:05 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.61899999999999999,"15min":0.63600000000000001},"min":{"1min":0.371,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.84199999999999997,"5min":0.996,"15min":1.3140000000000001},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65200000000000002,"15min":0.64000000000000001},"min":{"1min":0.42399999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":1.0980000000000001},"last":0.46899999999999997}]},{"osd":1,"last update":"Fri Jul 14 11:19:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.624,"15min":0.66400000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.75600000000000001,"5min":0.88800000000000001,"15min":1.343},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.63,"5min":0.65100000000000002,"15min":0.64800000000000002},"min":{"1min":0.442,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.86599999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.505}]},{"osd":2,"last update":"Fri Jul 14 11:19:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.69899999999999995,"15min":0.72899999999999998},"min":{"1min":0.46700000000000003,"5min":0.436,"15min":0.436},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.70299999999999996,"15min":0.753},"min":{"1min":0.504,"5min":0.496,"15min":0.496},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":1.3939999999999999},"last":0.69399999999999995}]},{"osd":3,"last update":"Fri Jul 14 11:19:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71199999999999997,"15min":0.75600000000000001},"min":{"1min":0.54500000000000004,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":1.2130000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.67700000000000005,"15min":0.75700000000000001},"min":{"1min":0.46400000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":1.806},"last":0.63700000000000001}]},{"osd":4,"last update":"Fri Jul 14 11:19:05 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.61699999999999999,"15min":0.64600000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.878,"5min":1.0229999999999999,"15min":1.1319999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.66500000000000004,"15min":0.73699999999999999},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.3999999999999999},"last":0.61399999999999999}]},{"osd":6,"last update":"Fri Jul 14 11:19:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.69699999999999995,"15min":0.73999999999999999},"min":{"1min":0.502,"5min":0.435,"15min":0.435},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.73499999999999999,"15min":0.79000000000000004},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.004,"5min":1.0629999999999999,"15min":1.3640000000000001},"last":0.76400000000000001}]},{"osd":7,"last update":"Fri Jul 14 11:19:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.747,"15min":0.82999999999999996},"min":{"1min":0.54400000000000004,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.4970000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78500000000000003,"15min":0.85499999999999998},"min":{"1min":0.60399999999999998,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.8540000000000001},"last":0.751}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T11:20:08.881 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-07-14T11:13:07.742728+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=14, tm_hour=11, tm_min=13, tm_sec=7, tm_wday=4, tm_yday=195, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=14, tm_hour=11, tm_min=20, tm_sec=2, tm_wday=4, tm_yday=195, tm_isdst=0) 2023-07-14T11:20:08.881 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-07-14T11:13:07.742728+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=14, tm_hour=11, tm_min=13, tm_sec=7, tm_wday=4, tm_yday=195, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=14, tm_hour=11, tm_min=20, tm_sec=2, tm_wday=4, tm_yday=195, tm_isdst=0) 2023-07-14T11:20:08.881 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-07-14T11:13:07.742728+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=14, tm_hour=11, tm_min=13, tm_sec=7, tm_wday=4, tm_yday=195, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=14, tm_hour=11, tm_min=20, tm_sec=2, tm_wday=4, tm_yday=195, tm_isdst=0) 2023-07-14T11:20:08.882 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-07-14T11:13:07.742728+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=14, tm_hour=11, tm_min=13, tm_sec=7, tm_wday=4, tm_yday=195, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=14, tm_hour=11, tm_min=20, tm_sec=2, tm_wday=4, tm_yday=195, tm_isdst=0) 2023-07-14T11:20:08.882 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-07-14T11:13:00.254800+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=14, tm_hour=11, tm_min=13, tm_sec=0, tm_wday=4, tm_yday=195, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=14, tm_hour=11, tm_min=20, tm_sec=2, tm_wday=4, tm_yday=195, tm_isdst=0) 2023-07-14T11:20:08.882 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-07-14T11:13:07.742728+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=14, tm_hour=11, tm_min=13, tm_sec=7, tm_wday=4, tm_yday=195, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=14, tm_hour=11, tm_min=20, tm_sec=2, tm_wday=4, tm_yday=195, tm_isdst=0) 2023-07-14T11:20:08.882 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-07-14T11:13:07.742728+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=14, tm_hour=11, tm_min=13, tm_sec=7, tm_wday=4, tm_yday=195, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=14, tm_hour=11, tm_min=20, tm_sec=2, tm_wday=4, tm_yday=195, tm_isdst=0) 2023-07-14T11:20:08.883 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-07-14T11:13:07.742728+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=14, tm_hour=11, tm_min=13, tm_sec=7, tm_wday=4, tm_yday=195, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=14, tm_hour=11, tm_min=20, tm_sec=2, tm_wday=4, tm_yday=195, tm_isdst=0) 2023-07-14T11:20:08.883 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-07-14T11:13:07.742728+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=14, tm_hour=11, tm_min=13, tm_sec=7, tm_wday=4, tm_yday=195, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=14, tm_hour=11, tm_min=20, tm_sec=2, tm_wday=4, tm_yday=195, tm_isdst=0) 2023-07-14T11:20:08.883 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-07-14T11:20:28.884 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T11:20:29.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.089+0000 7effb3bff700 1 Processor -- start 2023-07-14T11:20:29.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.089+0000 7effb3bff700 1 -- start start 2023-07-14T11:20:29.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.090+0000 7effb3bff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7effac15ca30 0x7effac06c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:29.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.090+0000 7effb3bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7effac0d0f40 0x7effac0cec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:29.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.090+0000 7effb3bff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effac0cf1d0 con 0x7effac0ce840 2023-07-14T11:20:29.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.090+0000 7effb3bff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effac06c360 con 0x7effac15ca30 2023-07-14T11:20:29.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.090+0000 7effb3bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effac06ba50 con 0x7effac0d0f40 2023-07-14T11:20:29.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.091+0000 7effb119a700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7effac0ce840 0x7effac0d0830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:34196/0 (socket says 172.21.15.84:34196) 2023-07-14T11:20:29.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.091+0000 7effb119a700 1 -- 172.21.15.84:0/2512472791 learned_addr learned my addr 172.21.15.84:0/2512472791 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-07-14T11:20:29.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.091+0000 7effb199b700 1 --2- 172.21.15.84:0/2512472791 >> v2:172.21.15.179:3300/0 conn(0x7effac15ca30 0x7effac06c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:29.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.091+0000 7effb219c700 1 --2- 172.21.15.84:0/2512472791 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7effac0d0f40 0x7effac0cec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:29.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.091+0000 7effb0999700 1 -- 172.21.15.84:0/2512472791 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 172001146 0 0) 0x7eff9c001110 con 0x7effac0ce840 2023-07-14T11:20:29.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.091+0000 7effb0999700 1 -- 172.21.15.84:0/2512472791 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff980035b0 con 0x7effac0ce840 2023-07-14T11:20:29.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.091+0000 7effb199b700 1 -- 172.21.15.84:0/2512472791 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7effac0d0f40 msgr2=0x7effac0cec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:20:29.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.091+0000 7effb199b700 1 --2- 172.21.15.84:0/2512472791 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7effac0d0f40 0x7effac0cec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:29.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.091+0000 7effb199b700 1 -- 172.21.15.84:0/2512472791 >> v1:172.21.15.84:6789/0 conn(0x7effac0ce840 legacy=0x7effac0d0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:29.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.091+0000 7effb199b700 1 -- 172.21.15.84:0/2512472791 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effac0d1b70 con 0x7effac15ca30 2023-07-14T11:20:29.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.092+0000 7effb199b700 1 --2- 172.21.15.84:0/2512472791 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7effac15ca30 0x7effac06c7f0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7effa8009840 tx=0x7effa8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4afaa6016f681471 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:29.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.092+0000 7effb0999700 1 -- 172.21.15.84:0/2512472791 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa8011830 con 0x7effac15ca30 2023-07-14T11:20:29.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.092+0000 7effb0999700 1 -- 172.21.15.84:0/2512472791 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effa8011990 con 0x7effac15ca30 2023-07-14T11:20:29.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.092+0000 7effb0999700 1 -- 172.21.15.84:0/2512472791 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa8011d20 con 0x7effac15ca30 2023-07-14T11:20:29.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.093+0000 7effb3bff700 1 -- 172.21.15.84:0/2512472791 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7effac15ca30 msgr2=0x7effac06c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:29.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.093+0000 7effb3bff700 1 --2- 172.21.15.84:0/2512472791 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7effac15ca30 0x7effac06c7f0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7effa8009840 tx=0x7effa8009b50 comp rx=0 tx=0).stop 2023-07-14T11:20:29.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.093+0000 7effb3bff700 1 -- 172.21.15.84:0/2512472791 shutdown_connections 2023-07-14T11:20:29.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.093+0000 7effb3bff700 1 --2- 172.21.15.84:0/2512472791 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7effac0d0f40 0x7effac0cec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:29.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.093+0000 7effb3bff700 1 --2- 172.21.15.84:0/2512472791 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7effac15ca30 0x7effac06c7f0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:29.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.093+0000 7effb3bff700 1 -- 172.21.15.84:0/2512472791 >> 172.21.15.84:0/2512472791 conn(0x7effac0664f0 msgr2=0x7effac099fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:20:29.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.093+0000 7effb3bff700 1 -- 172.21.15.84:0/2512472791 shutdown_connections 2023-07-14T11:20:29.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.093+0000 7effb3bff700 1 -- 172.21.15.84:0/2512472791 wait complete. 2023-07-14T11:20:29.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.094+0000 7effb3bff700 1 Processor -- start 2023-07-14T11:20:29.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.095+0000 7effb3bff700 1 -- start start 2023-07-14T11:20:29.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.095+0000 7effb3bff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7effac0ce840 0x7effac0cd500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:29.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.095+0000 7effb3bff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7effac0d0f40 0x7effac1f1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:29.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.096+0000 7effb3bff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7effac15ca30 0x7effac1f5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:29.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.096+0000 7effb3bff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effac1f1ea0 con 0x7effac15ca30 2023-07-14T11:20:29.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.096+0000 7effb3bff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effac0cb730 con 0x7effac0ce840 2023-07-14T11:20:29.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.096+0000 7effb3bff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effac0cba10 con 0x7effac0d0f40 2023-07-14T11:20:29.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.096+0000 7effb219c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7effac15ca30 0x7effac1f5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:29.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.096+0000 7effb219c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7effac15ca30 0x7effac1f5370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36850/0 (socket says 172.21.15.84:36850) 2023-07-14T11:20:29.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.096+0000 7effb219c700 1 -- 172.21.15.84:0/989071104 learned_addr learned my addr 172.21.15.84:0/989071104 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:20:29.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.096+0000 7effb199b700 1 --2- 172.21.15.84:0/989071104 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7effac0ce840 0x7effac0cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:29.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.096+0000 7effb119a700 1 --2- 172.21.15.84:0/989071104 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7effac0d0f40 0x7effac1f1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:29.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.096+0000 7effb219c700 1 -- 172.21.15.84:0/989071104 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7effac0d0f40 msgr2=0x7effac1f1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:29.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.096+0000 7effb219c700 1 --2- 172.21.15.84:0/989071104 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7effac0d0f40 0x7effac1f1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:29.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.096+0000 7effb219c700 1 -- 172.21.15.84:0/989071104 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7effac0ce840 msgr2=0x7effac0cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:29.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.096+0000 7effb219c700 1 --2- 172.21.15.84:0/989071104 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7effac0ce840 0x7effac0cd500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:29.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.096+0000 7effb219c700 1 -- 172.21.15.84:0/989071104 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa80094a0 con 0x7effac15ca30 2023-07-14T11:20:29.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.096+0000 7effb119a700 1 --2- 172.21.15.84:0/989071104 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7effac0d0f40 0x7effac1f1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T11:20:29.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.096+0000 7effb219c700 1 --2- 172.21.15.84:0/989071104 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7effac15ca30 0x7effac1f5370 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7effa400efc0 tx=0x7effa400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:29.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.097+0000 7effa27fc700 1 -- 172.21.15.84:0/989071104 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa4009ea0 con 0x7effac15ca30 2023-07-14T11:20:29.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.097+0000 7effa27fc700 1 -- 172.21.15.84:0/989071104 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effa400f040 con 0x7effac15ca30 2023-07-14T11:20:29.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.097+0000 7effb3bff700 1 -- 172.21.15.84:0/989071104 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effac0cbcf0 con 0x7effac15ca30 2023-07-14T11:20:29.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.097+0000 7effa27fc700 1 -- 172.21.15.84:0/989071104 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa4014480 con 0x7effac15ca30 2023-07-14T11:20:29.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.097+0000 7effb3bff700 1 -- 172.21.15.84:0/989071104 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effac0cda40 con 0x7effac15ca30 2023-07-14T11:20:29.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.098+0000 7effb3bff700 1 -- 172.21.15.84:0/989071104 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effac0cfc20 con 0x7effac15ca30 2023-07-14T11:20:29.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.099+0000 7effa27fc700 1 -- 172.21.15.84:0/989071104 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) v1 ==== 89190+0+0 (secure 0 0 0) 0x7effa40145e0 con 0x7effac15ca30 2023-07-14T11:20:29.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.100+0000 7effa27fc700 1 --2- 172.21.15.84:0/989071104 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7eff9006ae90 0x7eff9006d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:29.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.100+0000 7effa27fc700 1 -- 172.21.15.84:0/989071104 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5296+0+0 (secure 0 0 0) 0x7effa408a140 con 0x7effac15ca30 2023-07-14T11:20:29.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.100+0000 7effb199b700 1 --2- 172.21.15.84:0/989071104 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7eff9006ae90 0x7eff9006d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:29.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.101+0000 7effb199b700 1 --2- 172.21.15.84:0/989071104 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7eff9006ae90 0x7eff9006d340 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7effa8000c00 tx=0x7effa8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:29.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.104+0000 7effa27fc700 1 -- 172.21.15.84:0/989071104 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7effa4055170 con 0x7effac15ca30 2023-07-14T11:20:29.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.291+0000 7effb3bff700 1 -- 172.21.15.84:0/989071104 --> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7effac06bd10 con 0x7eff9006ae90 2023-07-14T11:20:29.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.295+0000 7effa27fc700 1 -- 172.21.15.84:0/989071104 <== mgr.4100 v2:172.21.15.179:6836/2094253834 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72777 (secure 0 0 0) 0x7effa8011630 con 0x7eff9006ae90 2023-07-14T11:20:29.298 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:20:29.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.297+0000 7effb3bff700 1 -- 172.21.15.84:0/989071104 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7eff9006ae90 msgr2=0x7eff9006d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:29.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.297+0000 7effb3bff700 1 --2- 172.21.15.84:0/989071104 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7eff9006ae90 0x7eff9006d340 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7effa8000c00 tx=0x7effa8008030 comp rx=0 tx=0).stop 2023-07-14T11:20:29.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.297+0000 7effb3bff700 1 -- 172.21.15.84:0/989071104 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7effac15ca30 msgr2=0x7effac1f5370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:29.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.297+0000 7effb3bff700 1 --2- 172.21.15.84:0/989071104 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7effac15ca30 0x7effac1f5370 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7effa400efc0 tx=0x7effa400c3a0 comp rx=0 tx=0).stop 2023-07-14T11:20:29.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.297+0000 7effb3bff700 1 -- 172.21.15.84:0/989071104 shutdown_connections 2023-07-14T11:20:29.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.297+0000 7effb3bff700 1 --2- 172.21.15.84:0/989071104 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7effac15ca30 0x7effac1f5370 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:29.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.297+0000 7effb3bff700 1 --2- 172.21.15.84:0/989071104 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7effac0ce840 0x7effac0cd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:29.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.297+0000 7effb3bff700 1 --2- 172.21.15.84:0/989071104 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7eff9006ae90 0x7eff9006d340 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:29.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.297+0000 7effb3bff700 1 --2- 172.21.15.84:0/989071104 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7effac0d0f40 0x7effac1f1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:29.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.297+0000 7effb3bff700 1 -- 172.21.15.84:0/989071104 >> 172.21.15.84:0/989071104 conn(0x7effac0664f0 msgr2=0x7effac15bcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:20:29.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.297+0000 7effb3bff700 1 -- 172.21.15.84:0/989071104 shutdown_connections 2023-07-14T11:20:29.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.297+0000 7effb3bff700 1 -- 172.21.15.84:0/989071104 wait complete. 2023-07-14T11:20:29.303 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-07-14T11:20:29.318 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":100,"stamp":"2023-07-14T11:20:28.952446+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":239720,"kb_used_data":11816,"kb_used_omap":0,"kb_used_meta":227840,"kb_avail":754735000,"statfs":{"total":773094113280,"available":772848640000,"internally_reserved":0,"allocated":12099584,"data_stored":6222552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":233308160},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002792"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":183,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T11:20:10.083612+0000","last_change":"2023-07-14T11:20:10.083659+0000","last_active":"2023-07-14T11:20:10.083612+0000","last_peered":"2023-07-14T11:20:10.083612+0000","last_clean":"2023-07-14T11:20:10.083612+0000","last_became_active":"2023-07-14T11:13:08.761763+0000","last_became_peered":"2023-07-14T11:13:08.761763+0000","last_unstale":"2023-07-14T11:20:10.083612+0000","last_undegraded":"2023-07-14T11:20:10.083612+0000","last_fullsized":"2023-07-14T11:20:10.083612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:20:10.083513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:20:10.083513+0000","last_clean_scrub_stamp":"2023-07-14T11:20:10.083513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:49:34.331195+0000","scrub_duration":0.0016353730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":203,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T11:20:06.607226+0000","last_change":"2023-07-14T11:20:06.607263+0000","last_active":"2023-07-14T11:20:06.607226+0000","last_peered":"2023-07-14T11:20:06.607226+0000","last_clean":"2023-07-14T11:20:06.607226+0000","last_became_active":"2023-07-14T11:13:08.761365+0000","last_became_peered":"2023-07-14T11:13:08.761365+0000","last_unstale":"2023-07-14T11:20:06.607226+0000","last_undegraded":"2023-07-14T11:20:06.607226+0000","last_fullsized":"2023-07-14T11:20:06.607226+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:20:06.607154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:20:06.607154+0000","last_clean_scrub_stamp":"2023-07-14T11:20:06.607154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:46:00.030417+0000","scrub_duration":0.001498739,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":173,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T11:20:15.866791+0000","last_change":"2023-07-14T11:20:15.866865+0000","last_active":"2023-07-14T11:20:15.866791+0000","last_peered":"2023-07-14T11:20:15.866791+0000","last_clean":"2023-07-14T11:20:15.866791+0000","last_became_active":"2023-07-14T11:13:08.923513+0000","last_became_peered":"2023-07-14T11:13:08.923513+0000","last_unstale":"2023-07-14T11:20:15.866791+0000","last_undegraded":"2023-07-14T11:20:15.866791+0000","last_fullsized":"2023-07-14T11:20:15.866791+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:20:15.866663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:20:15.866663+0000","last_clean_scrub_stamp":"2023-07-14T11:20:15.866663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:16:35.225177+0000","scrub_duration":0.0024826370000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":173,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T11:20:13.849707+0000","last_change":"2023-07-14T11:20:13.849755+0000","last_active":"2023-07-14T11:20:13.849707+0000","last_peered":"2023-07-14T11:20:13.849707+0000","last_clean":"2023-07-14T11:20:13.849707+0000","last_became_active":"2023-07-14T11:13:08.760285+0000","last_became_peered":"2023-07-14T11:13:08.760285+0000","last_unstale":"2023-07-14T11:20:13.849707+0000","last_undegraded":"2023-07-14T11:20:13.849707+0000","last_fullsized":"2023-07-14T11:20:13.849707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:20:13.849603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:20:13.849603+0000","last_clean_scrub_stamp":"2023-07-14T11:20:13.849603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:02:39.756891+0000","scrub_duration":0.0022832970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"109'130","reported_seq":370,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T11:20:11.876069+0000","last_change":"2023-07-14T11:20:11.876128+0000","last_active":"2023-07-14T11:20:11.876069+0000","last_peered":"2023-07-14T11:20:11.876069+0000","last_clean":"2023-07-14T11:20:11.876069+0000","last_became_active":"2023-07-14T11:13:01.369478+0000","last_became_peered":"2023-07-14T11:13:01.369478+0000","last_unstale":"2023-07-14T11:20:11.876069+0000","last_undegraded":"2023-07-14T11:20:11.876069+0000","last_fullsized":"2023-07-14T11:20:11.876069+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"109'130","last_scrub_stamp":"2023-07-14T11:20:11.875986+0000","last_deep_scrub":"109'130","last_deep_scrub_stamp":"2023-07-14T11:20:11.875986+0000","last_clean_scrub_stamp":"2023-07-14T11:20:11.875986+0000","objects_scrubbed":2,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:28:22.848162+0000","scrub_duration":0.0065458859999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":187,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T11:20:14.817241+0000","last_change":"2023-07-14T11:20:14.817294+0000","last_active":"2023-07-14T11:20:14.817241+0000","last_peered":"2023-07-14T11:20:14.817241+0000","last_clean":"2023-07-14T11:20:14.817241+0000","last_became_active":"2023-07-14T11:13:08.757541+0000","last_became_peered":"2023-07-14T11:13:08.757541+0000","last_unstale":"2023-07-14T11:20:14.817241+0000","last_undegraded":"2023-07-14T11:20:14.817241+0000","last_fullsized":"2023-07-14T11:20:14.817241+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:20:14.817144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:20:14.817144+0000","last_clean_scrub_stamp":"2023-07-14T11:20:14.817144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:19:53.294378+0000","scrub_duration":0.002574645,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":191,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T11:20:06.301540+0000","last_change":"2023-07-14T11:20:06.301578+0000","last_active":"2023-07-14T11:20:06.301540+0000","last_peered":"2023-07-14T11:20:06.301540+0000","last_clean":"2023-07-14T11:20:06.301540+0000","last_became_active":"2023-07-14T11:13:08.861817+0000","last_became_peered":"2023-07-14T11:13:08.861817+0000","last_unstale":"2023-07-14T11:20:06.301540+0000","last_undegraded":"2023-07-14T11:20:06.301540+0000","last_fullsized":"2023-07-14T11:20:06.301540+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:20:06.301465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:20:06.301465+0000","last_clean_scrub_stamp":"2023-07-14T11:20:06.301465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:06:18.057887+0000","scrub_duration":0.0014181809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":187,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T11:20:12.750650+0000","last_change":"2023-07-14T11:20:12.750743+0000","last_active":"2023-07-14T11:20:12.750650+0000","last_peered":"2023-07-14T11:20:12.750650+0000","last_clean":"2023-07-14T11:20:12.750650+0000","last_became_active":"2023-07-14T11:13:08.757956+0000","last_became_peered":"2023-07-14T11:13:08.757956+0000","last_unstale":"2023-07-14T11:20:12.750650+0000","last_undegraded":"2023-07-14T11:20:12.750650+0000","last_fullsized":"2023-07-14T11:20:12.750650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:20:12.750530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:20:12.750530+0000","last_clean_scrub_stamp":"2023-07-14T11:20:12.750530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:55:12.548562+0000","scrub_duration":0.002289119,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":203,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T11:20:04.617807+0000","last_change":"2023-07-14T11:20:04.617850+0000","last_active":"2023-07-14T11:20:04.617807+0000","last_peered":"2023-07-14T11:20:04.617807+0000","last_clean":"2023-07-14T11:20:04.617807+0000","last_became_active":"2023-07-14T11:13:08.923384+0000","last_became_peered":"2023-07-14T11:13:08.923384+0000","last_unstale":"2023-07-14T11:20:04.617807+0000","last_undegraded":"2023-07-14T11:20:04.617807+0000","last_fullsized":"2023-07-14T11:20:04.617807+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T11:20:04.617699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T11:20:04.617699+0000","last_clean_scrub_stamp":"2023-07-14T11:20:04.617699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:09:44.644995+0000","scrub_duration":0.0014467429999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574941,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32960,"kb_used_data":1912,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338880,"statfs":{"total":96636764160,"available":96603013120,"internally_reserved":0,"allocated":1957888,"data_stored":1220595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:20:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.66500000000000004,"15min":0.86899999999999999},"min":{"1min":0.40899999999999997,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.95199999999999996,"5min":0.95699999999999996,"15min":8.4339999999999993},"last":0.751},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.69399999999999995,"15min":0.90400000000000003},"min":{"1min":0.48699999999999999,"5min":0.45500000000000002,"15min":0.377},"max":{"1min":1.04,"5min":1.04,"15min":8.4559999999999995},"last":0.78100000000000003}]},{"osd":1,"last update":"Fri Jul 14 11:20:05 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.67300000000000004,"15min":0.84799999999999998},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.34899999999999998},"max":{"1min":0.89700000000000002,"5min":0.92800000000000005,"15min":6.3520000000000003},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.624,"5min":0.65300000000000002,"15min":0.97199999999999998},"min":{"1min":0.48099999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.92800000000000005,"5min":0.93999999999999995,"15min":6.8550000000000004},"last":0.70999999999999996}]},{"osd":2,"last update":"Fri Jul 14 11:20:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.66300000000000003,"15min":1.016},"min":{"1min":0.45300000000000001,"5min":0.434,"15min":0.434},"max":{"1min":1.121,"5min":1.121,"15min":7.0289999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.68899999999999995,"15min":0.68999999999999995},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.80200000000000005}]},{"osd":3,"last update":"Fri Jul 14 11:20:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.67900000000000005,"15min":1.0629999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.179,"5min":1.179,"15min":10.337},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.70999999999999996,"15min":0.752},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.921},"last":0.83899999999999997}]},{"osd":4,"last update":"Fri Jul 14 11:20:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.61299999999999999,"15min":0.59599999999999997},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.76100000000000001,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.72299999999999998,"15min":0.70699999999999996},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0049999999999999,"5min":1.0580000000000001,"15min":1.0840000000000001},"last":0.73499999999999999}]},{"osd":5,"last update":"Fri Jul 14 11:20:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.68999999999999995,"15min":0.67900000000000005},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.93600000000000005,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.74399999999999999,"15min":0.73899999999999999},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.91800000000000004,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.60099999999999998}]},{"osd":6,"last update":"Fri Jul 14 11:20:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.71199999999999997,"15min":0.68500000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.89300000000000002,"5min":0.98799999999999999,"15min":1.002},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.71999999999999997,"15min":0.69599999999999995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.91400000000000003,"5min":1.129,"15min":1.129},"last":0.64300000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574942,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32380,"kb_used_data":1332,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339460,"statfs":{"total":96636764160,"available":96603607040,"internally_reserved":0,"allocated":1363968,"data_stored":630227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:20:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68700000000000006,"15min":0.70099999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.90800000000000003,"5min":0.998,"15min":1.0569999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.72199999999999998,"15min":0.71899999999999997},"min":{"1min":0.504,"5min":0.441,"15min":0.441},"max":{"1min":0.83699999999999997,"5min":0.99299999999999999,"15min":1.167},"last":0.72599999999999998}]},{"osd":1,"last update":"Fri Jul 14 11:20:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.72199999999999998,"15min":0.69399999999999995},"min":{"1min":0.49199999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.0329999999999999,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.72799999999999998,"15min":0.71599999999999997},"min":{"1min":0.57299999999999995,"5min":0.39600000000000002,"15min":0.39300000000000002},"max":{"1min":0.89600000000000002,"5min":1.0109999999999999,"15min":1.2929999999999999},"last":0.76200000000000001}]},{"osd":2,"last update":"Fri Jul 14 11:20:11 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69899999999999995,"15min":0.68100000000000005},"min":{"1min":0.56000000000000005,"5min":0.42699999999999999,"15min":0.41299999999999998},"max":{"1min":0.90400000000000003,"5min":0.95199999999999996,"15min":1.45},"last":0.749},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.74299999999999999,"15min":0.77100000000000002},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.95799999999999996,"5min":1.075,"15min":1.0960000000000001},"last":0.70999999999999996}]},{"osd":3,"last update":"Fri Jul 14 11:20:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72599999999999998,"15min":0.74099999999999999},"min":{"1min":0.57199999999999995,"5min":0.50900000000000001,"15min":0.45700000000000002},"max":{"1min":0.89800000000000002,"5min":1.002,"15min":1.2250000000000001},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71999999999999997,"15min":0.73699999999999999},"min":{"1min":0.496,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.93700000000000006,"5min":1.0469999999999999,"15min":1.5049999999999999},"last":0.621}]},{"osd":4,"last update":"Fri Jul 14 11:20:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.67800000000000005,"15min":0.70199999999999996},"min":{"1min":0.46500000000000002,"5min":0.40500000000000003,"15min":0.38},"max":{"1min":0.91300000000000003,"5min":1.177,"15min":1.712},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.71799999999999997,"15min":0.72699999999999998},"min":{"1min":0.54200000000000004,"5min":0.44400000000000001,"15min":0.42899999999999999},"max":{"1min":0.94599999999999995,"5min":1.0680000000000001,"15min":1.4330000000000001},"last":0.57699999999999996}]},{"osd":5,"last update":"Fri Jul 14 11:20:11 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.68899999999999995,"15min":0.71599999999999997},"min":{"1min":0.53800000000000003,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.90000000000000002,"5min":1.0109999999999999,"15min":2.8820000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77500000000000002,"15min":0.78600000000000003},"min":{"1min":0.53700000000000003,"5min":0.48899999999999999,"15min":0.44500000000000001},"max":{"1min":1.0189999999999999,"5min":1.214,"15min":1.214},"last":0.64500000000000002}]},{"osd":7,"last update":"Fri Jul 14 11:20:11 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.77700000000000002,"15min":0.79800000000000004},"min":{"1min":0.60299999999999998,"5min":0.47399999999999998,"15min":0.47099999999999997},"max":{"1min":0.995,"5min":1.1220000000000001,"15min":1.333},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.76700000000000002,"15min":0.78800000000000003},"min":{"1min":0.52800000000000002,"5min":0.44600000000000001,"15min":0.41999999999999998},"max":{"1min":0.97899999999999998,"5min":1.1579999999999999,"15min":1.55},"last":0.68700000000000006}]}]},{"osd":1,"up_from":13,"seq":55834574942,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32380,"kb_used_data":1332,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339460,"statfs":{"total":96636764160,"available":96603607040,"internally_reserved":0,"allocated":1363968,"data_stored":630227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40300000000000002,"15min":0.42899999999999999},"min":{"1min":0.28000000000000003,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.996},"last":0.44},{"interface":"front","average":{"1min":0.44,"5min":0.45800000000000002,"15min":0.47299999999999998},"min":{"1min":0.30299999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.58799999999999997,"5min":0.70199999999999996,"15min":0.84299999999999997},"last":0.52200000000000002}]},{"osd":2,"last update":"Fri Jul 14 11:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.47099999999999997,"15min":0.54000000000000004},"min":{"1min":0.34599999999999997,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.56100000000000005,"5min":0.70799999999999996,"15min":2.476},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.49399999999999999,"15min":0.58499999999999996},"min":{"1min":0.38,"5min":0.36899999999999999,"15min":0.35199999999999998},"max":{"1min":0.57499999999999996,"5min":0.91700000000000004,"15min":2.6299999999999999},"last":0.46100000000000002}]},{"osd":3,"last update":"Fri Jul 14 11:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.53000000000000003,"15min":0.52200000000000002},"min":{"1min":0.42499999999999999,"5min":0.40200000000000002,"15min":0.38900000000000001},"max":{"1min":0.65400000000000003,"5min":0.748,"15min":0.748},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46899999999999997,"15min":0.48599999999999999},"min":{"1min":0.372,"5min":0.33600000000000002,"15min":0.33300000000000002},"max":{"1min":0.60599999999999998,"5min":0.67700000000000005,"15min":0.73199999999999998},"last":0.63500000000000001}]},{"osd":4,"last update":"Fri Jul 14 11:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.72899999999999998,"15min":0.745},"min":{"1min":0.54600000000000004,"5min":0.52400000000000002,"15min":0.49399999999999999},"max":{"1min":0.88500000000000001,"5min":1.1930000000000001,"15min":1.363},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.72899999999999998,"15min":0.76100000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.93600000000000005,"5min":1.1160000000000001,"15min":1.4890000000000001},"last":0.91600000000000004}]},{"osd":5,"last update":"Fri Jul 14 11:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.72999999999999998,"15min":0.76000000000000001},"min":{"1min":0.54100000000000004,"5min":0.499,"15min":0.499},"max":{"1min":0.98199999999999998,"5min":1.2250000000000001,"15min":1.3759999999999999},"last":0.877},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.74399999999999999,"15min":0.79700000000000004},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.85399999999999998,"5min":1.1739999999999999,"15min":1.4330000000000001},"last":0.77400000000000002}]},{"osd":6,"last update":"Fri Jul 14 11:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.72999999999999998,"15min":0.77900000000000003},"min":{"1min":0.56299999999999994,"5min":0.51900000000000002,"15min":0.51700000000000002},"max":{"1min":0.94999999999999996,"5min":1.028,"15min":1.298},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.745,"15min":0.77400000000000002},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.50600000000000001},"max":{"1min":0.94699999999999995,"5min":1.1899999999999999,"15min":1.2130000000000001},"last":0.747}]},{"osd":7,"last update":"Fri Jul 14 11:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.73999999999999999,"15min":0.79900000000000004},"min":{"1min":0.57499999999999996,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0029999999999999,"5min":1.097,"15min":1.4590000000000001},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.73399999999999999,"15min":0.77100000000000002},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.90900000000000003,"5min":1.129,"15min":1.3700000000000001},"last":0.75800000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574940,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28864,"kb_used_data":1912,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94342976,"statfs":{"total":96636764160,"available":96607207424,"internally_reserved":0,"allocated":1957888,"data_stored":1220595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 11:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.47699999999999998,"15min":0.44600000000000001},"min":{"1min":0.29299999999999998,"5min":0.26800000000000002,"15min":0.252},"max":{"1min":0.78400000000000003,"5min":2.972,"15min":2.972},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.48499999999999999,"15min":0.45300000000000001},"min":{"1min":0.29699999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.73999999999999999,"5min":2.758,"15min":2.758},"last":0.57799999999999996}]},{"osd":2,"last update":"Fri Jul 14 11:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.50700000000000001,"15min":0.47499999999999998},"min":{"1min":0.35299999999999998,"5min":0.307,"15min":0.307},"max":{"1min":0.71299999999999997,"5min":2.9409999999999998,"15min":2.9409999999999998},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.53000000000000003,"15min":0.51100000000000001},"min":{"1min":0.36199999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.83699999999999997,"5min":2.556,"15min":2.556},"last":0.496}]},{"osd":3,"last update":"Fri Jul 14 11:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.48899999999999999,"15min":0.442},"min":{"1min":0.33800000000000002,"5min":0.33700000000000002,"15min":0.309},"max":{"1min":0.68600000000000005,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.56100000000000005,"15min":0.53500000000000003},"min":{"1min":0.41599999999999998,"5min":0.39900000000000002,"15min":0.38100000000000001},"max":{"1min":0.84999999999999998,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":0.56599999999999995}]},{"osd":4,"last update":"Fri Jul 14 11:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.73799999999999999,"15min":0.754},"min":{"1min":0.55100000000000005,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.874,"5min":1.099,"15min":1.1060000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.75900000000000001,"15min":0.71799999999999997},"min":{"1min":0.54800000000000004,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.98099999999999998,"5min":1.651,"15min":1.651},"last":0.77300000000000002}]},{"osd":5,"last update":"Fri Jul 14 11:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.77700000000000002,"15min":0.73799999999999999},"min":{"1min":0.54500000000000004,"5min":0.50700000000000001,"15min":0.47999999999999998},"max":{"1min":0.91000000000000003,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.76400000000000001,"15min":0.77300000000000002},"min":{"1min":0.60399999999999998,"5min":0.505,"15min":0.505},"max":{"1min":0.95899999999999996,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.80300000000000005}]},{"osd":6,"last update":"Fri Jul 14 11:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.73899999999999999,"15min":0.72399999999999998},"min":{"1min":0.53700000000000003,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.91200000000000003,"5min":1.538,"15min":1.538},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.78100000000000003,"15min":0.77800000000000002},"min":{"1min":0.51900000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.94699999999999995,"5min":2.8679999999999999,"15min":2.8679999999999999},"last":0.745}]},{"osd":7,"last update":"Fri Jul 14 11:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.77500000000000002,"15min":0.80300000000000005},"min":{"1min":0.61699999999999999,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.997,"5min":1.0900000000000001,"15min":1.149},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.81100000000000005,"15min":0.78600000000000003},"min":{"1min":0.56100000000000005,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.96899999999999997,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":0.91000000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574940,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28284,"kb_used_data":1332,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343556,"statfs":{"total":96636764160,"available":96607801344,"internally_reserved":0,"allocated":1363968,"data_stored":630227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:20:20 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.41299999999999998,"15min":0.438},"min":{"1min":0.27500000000000002,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.56399999999999995,"5min":0.63900000000000001,"15min":0.64700000000000002},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.435,"5min":0.441,"15min":0.443},"min":{"1min":0.307,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.57599999999999996,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.48399999999999999}]},{"osd":1,"last update":"Fri Jul 14 11:20:20 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46899999999999997,"15min":0.48099999999999998},"min":{"1min":0.38200000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.54700000000000004,"5min":0.68600000000000005,"15min":0.98299999999999998},"last":0.437},{"interface":"front","average":{"1min":0.442,"5min":0.47099999999999997,"15min":0.48399999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.501,"5min":0.629,"15min":0.91200000000000003},"last":0.53200000000000003}]},{"osd":3,"last update":"Fri Jul 14 11:20:20 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.48199999999999998,"15min":0.48999999999999999},"min":{"1min":0.34799999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.58699999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.55700000000000005,"15min":0.57599999999999996},"min":{"1min":0.41999999999999998,"5min":0.41499999999999998,"15min":0.40799999999999997},"max":{"1min":0.64200000000000002,"5min":0.80000000000000004,"15min":1.034},"last":0.68999999999999995}]},{"osd":4,"last update":"Fri Jul 14 11:20:20 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.73599999999999999,"15min":0.75900000000000001},"min":{"1min":0.497,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.002,"5min":1.171,"15min":1.212},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.74099999999999999,"15min":0.77200000000000002},"min":{"1min":0.56699999999999995,"5min":0.52800000000000002,"15min":0.51200000000000001},"max":{"1min":1.038,"5min":1.246,"15min":1.246},"last":0.61399999999999999}]},{"osd":5,"last update":"Fri Jul 14 11:20:20 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.73999999999999999,"15min":0.77600000000000002},"min":{"1min":0.55200000000000005,"5min":0.51700000000000002,"15min":0.43099999999999999},"max":{"1min":0.96999999999999997,"5min":1.202,"15min":1.4019999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.752,"15min":0.80200000000000005},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.86799999999999999,"5min":1.351,"15min":1.351},"last":0.71399999999999997}]},{"osd":6,"last update":"Fri Jul 14 11:20:20 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.73899999999999999,"15min":0.77300000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.48399999999999999},"max":{"1min":0.95899999999999996,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.76300000000000001,"15min":0.80500000000000005},"min":{"1min":0.59599999999999997,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.85899999999999999,"5min":1.282,"15min":1.282},"last":0.752}]},{"osd":7,"last update":"Fri Jul 14 11:20:20 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.745,"15min":0.78400000000000003},"min":{"1min":0.57699999999999996,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.88500000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.753,"15min":0.78900000000000003},"min":{"1min":0.56200000000000006,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.98799999999999999,"5min":1.244,"15min":1.244},"last":0.80300000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574939,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28284,"kb_used_data":1332,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343556,"statfs":{"total":96636764160,"available":96607801344,"internally_reserved":0,"allocated":1363968,"data_stored":630227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.41699999999999998,"15min":0.438},"min":{"1min":0.30099999999999999,"5min":0.24299999999999999,"15min":0.23899999999999999},"max":{"1min":0.58399999999999996,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.29499999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.51100000000000001,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.52900000000000003}]},{"osd":1,"last update":"Fri Jul 14 11:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.45000000000000001,"15min":0.45100000000000001},"min":{"1min":0.30599999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.78600000000000003,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.503},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.47599999999999998,"15min":0.48799999999999999},"min":{"1min":0.34699999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.59099999999999997,"5min":0.72699999999999998,"15min":0.86399999999999999},"last":0.47299999999999998}]},{"osd":2,"last update":"Fri Jul 14 11:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54400000000000004,"15min":0.54100000000000004},"min":{"1min":0.39700000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.85299999999999998,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.56599999999999995,"15min":0.58499999999999996},"min":{"1min":0.42599999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.65300000000000002,"5min":0.79600000000000004,"15min":1.585},"last":0.61899999999999999}]},{"osd":4,"last update":"Fri Jul 14 11:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.72399999999999998,"15min":0.748},"min":{"1min":0.49399999999999999,"5min":0.45400000000000001,"15min":0.372},"max":{"1min":0.93799999999999994,"5min":1.1279999999999999,"15min":1.216},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.751,"15min":0.751},"min":{"1min":0.54700000000000004,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.90200000000000002,"5min":1.242,"15min":1.242},"last":0.71099999999999997}]},{"osd":5,"last update":"Fri Jul 14 11:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.747,"15min":0.754},"min":{"1min":0.52700000000000002,"5min":0.48499999999999999,"15min":0.41699999999999998},"max":{"1min":1.085,"5min":1.179,"15min":1.413},"last":0.751},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.749,"15min":0.82099999999999995},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.92900000000000005,"5min":1.1539999999999999,"15min":1.657},"last":0.73999999999999999}]},{"osd":6,"last update":"Fri Jul 14 11:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.76000000000000001,"15min":0.77300000000000002},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.42899999999999999},"max":{"1min":0.80100000000000005,"5min":1.1930000000000001,"15min":1.726},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.76300000000000001,"15min":0.78700000000000003},"min":{"1min":0.58099999999999996,"5min":0.498,"15min":0.49199999999999999},"max":{"1min":0.85399999999999998,"5min":1.286,"15min":1.333},"last":0.86899999999999999}]},{"osd":7,"last update":"Fri Jul 14 11:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.78900000000000003,"15min":0.82099999999999995},"min":{"1min":0.52000000000000002,"5min":0.497,"15min":0.437},"max":{"1min":0.94599999999999995,"5min":1.2909999999999999,"15min":1.3939999999999999},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.79600000000000004,"15min":0.82599999999999996},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.53200000000000003},"max":{"1min":0.95499999999999996,"5min":1.329,"15min":1.329},"last":0.77500000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574940,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28284,"kb_used_data":1332,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343556,"statfs":{"total":96636764160,"available":96607801344,"internally_reserved":0,"allocated":1363968,"data_stored":630227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.66000000000000003,"15min":0.63900000000000001},"min":{"1min":0.42199999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.874,"5min":0.96699999999999997,"15min":0.99299999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.64900000000000002,"15min":0.68200000000000005},"min":{"1min":0.48799999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.82199999999999995,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.88600000000000001}]},{"osd":1,"last update":"Fri Jul 14 11:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.66100000000000003,"15min":0.66700000000000004},"min":{"1min":0.43099999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":1.4259999999999999},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.70299999999999996,"15min":0.70899999999999996},"min":{"1min":0.53800000000000003,"5min":0.49299999999999999,"15min":0.45800000000000002},"max":{"1min":0.88800000000000001,"5min":1.0149999999999999,"15min":1.1659999999999999},"last":0.65000000000000002}]},{"osd":2,"last update":"Fri Jul 14 11:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.69899999999999995,"15min":0.70699999999999996},"min":{"1min":0.504,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.876,"5min":0.93500000000000005,"15min":1.48},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.71299999999999997,"15min":0.73399999999999999},"min":{"1min":0.51800000000000002,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.89700000000000002,"5min":1.0489999999999999,"15min":1.23},"last":0.92200000000000004}]},{"osd":3,"last update":"Fri Jul 14 11:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.70499999999999996},"min":{"1min":0.46200000000000002,"5min":0.438,"15min":0.438},"max":{"1min":0.81999999999999995,"5min":0.95599999999999996,"15min":1.0589999999999999},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.72299999999999998,"15min":0.73599999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":1.145},"last":0.90100000000000002}]},{"osd":5,"last update":"Fri Jul 14 11:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.66700000000000004,"15min":0.73599999999999999},"min":{"1min":0.45900000000000002,"5min":0.42999999999999999,"15min":0.40000000000000002},"max":{"1min":0.91300000000000003,"5min":0.95999999999999996,"15min":1.6559999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.64600000000000002,"15min":0.73499999999999999},"min":{"1min":0.45200000000000001,"5min":0.41999999999999998,"15min":0.40300000000000002},"max":{"1min":0.874,"5min":0.90500000000000003,"15min":1.3839999999999999},"last":0.68200000000000005}]},{"osd":6,"last update":"Fri Jul 14 11:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.68500000000000005,"15min":0.71299999999999997},"min":{"1min":0.51400000000000001,"5min":0.45000000000000001,"15min":0.436},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":1.1970000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.749,"5min":0.73299999999999998,"15min":0.76400000000000001},"min":{"1min":0.498,"5min":0.442,"15min":0.442},"max":{"1min":0.96199999999999997,"5min":1.107,"15min":1.3},"last":0.83699999999999997}]},{"osd":7,"last update":"Fri Jul 14 11:20:16 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.69899999999999995,"15min":0.751},"min":{"1min":0.55400000000000005,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.90500000000000003,"5min":0.93799999999999994,"15min":1.4810000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.755,"15min":0.82099999999999995},"min":{"1min":0.55300000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.012,"5min":1.0609999999999999,"15min":1.379},"last":0.94399999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574942,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28284,"kb_used_data":1332,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343556,"statfs":{"total":96636764160,"available":96607801344,"internally_reserved":0,"allocated":1363968,"data_stored":630227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.60799999999999998,"15min":0.63},"min":{"1min":0.375,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.73799999999999999,"5min":0.97299999999999998,"15min":1.3140000000000001},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.64600000000000002,"15min":0.63800000000000001},"min":{"1min":0.46899999999999997,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.83099999999999996,"5min":0.92300000000000004,"15min":1.0980000000000001},"last":0.79000000000000004}]},{"osd":1,"last update":"Fri Jul 14 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.62,"15min":0.66100000000000003},"min":{"1min":0.48399999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":1.343},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.64100000000000001,"15min":0.64500000000000002},"min":{"1min":0.46999999999999997,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.85799999999999998,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.77500000000000002}]},{"osd":2,"last update":"Fri Jul 14 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.68600000000000005,"15min":0.72199999999999998},"min":{"1min":0.44700000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.85999999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.69899999999999995,"15min":0.747},"min":{"1min":0.54400000000000004,"5min":0.496,"15min":0.496},"max":{"1min":0.84099999999999997,"5min":0.90200000000000002,"15min":1.3939999999999999},"last":0.92200000000000004}]},{"osd":3,"last update":"Fri Jul 14 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.70899999999999996,"15min":0.75},"min":{"1min":0.53900000000000003,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.79900000000000004,"5min":0.95899999999999996,"15min":1.2130000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.68300000000000005,"15min":0.749},"min":{"1min":0.504,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":1.806},"last":0.73899999999999999}]},{"osd":4,"last update":"Fri Jul 14 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.60899999999999999,"15min":0.64200000000000002},"min":{"1min":0.38200000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":1.1319999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66300000000000003,"15min":0.72999999999999998},"min":{"1min":0.43099999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.98599999999999999,"5min":1.0589999999999999,"15min":1.3999999999999999},"last":0.63400000000000001}]},{"osd":6,"last update":"Fri Jul 14 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69799999999999995,"15min":0.73599999999999999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.435},"max":{"1min":1.0149999999999999,"5min":1.042,"15min":1.042},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.72799999999999998,"15min":0.78300000000000003},"min":{"1min":0.53800000000000003,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.155,"5min":1.155,"15min":1.3640000000000001},"last":0.71199999999999997}]},{"osd":7,"last update":"Fri Jul 14 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.753,"15min":0.82099999999999995},"min":{"1min":0.48399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.90100000000000002,"5min":1.1000000000000001,"15min":1.4970000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.77900000000000003,"15min":0.84499999999999997},"min":{"1min":0.57599999999999996,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.96899999999999997,"5min":1.0780000000000001,"15min":1.8540000000000001},"last":0.89100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T11:20:29.321 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-07-14T11:20:29.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.508+0000 7f998adff700 1 Processor -- start 2023-07-14T11:20:29.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.508+0000 7f998adff700 1 -- start start 2023-07-14T11:20:29.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.509+0000 7f998adff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f99840b8660 0x7f99840cd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:29.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.509+0000 7f998adff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f99840cd970 0x7f99840b4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:29.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.509+0000 7f998adff700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99840d02a0 con 0x7f99840b4da0 2023-07-14T11:20:29.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.509+0000 7f998adff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99840b51b0 con 0x7f99840b8660 2023-07-14T11:20:29.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.509+0000 7f998adff700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99840cfce0 con 0x7f99840cd970 2023-07-14T11:20:29.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.510+0000 7f9988b9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f99840b8660 0x7f99840cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:29.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.510+0000 7f9988b9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f99840b8660 0x7f99840cd430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36864/0 (socket says 172.21.15.84:36864) 2023-07-14T11:20:29.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.510+0000 7f9983fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f99840cd970 0x7f99840b4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:29.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.510+0000 7f9988b9b700 1 -- 172.21.15.84:0/35593778 learned_addr learned my addr 172.21.15.84:0/35593778 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:20:29.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.510+0000 7f9988b9b700 1 -- 172.21.15.84:0/35593778 >> v2:172.21.15.179:3300/0 conn(0x7f99840cd970 msgr2=0x7f99840b4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:20:29.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.510+0000 7f9988b9b700 1 --2- 172.21.15.84:0/35593778 >> v2:172.21.15.179:3300/0 conn(0x7f99840cd970 0x7f99840b4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:29.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.510+0000 7f9988b9b700 1 -- 172.21.15.84:0/35593778 >> v1:172.21.15.179:6789/0 conn(0x7f99840b4da0 legacy=0x7f99841601f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:29.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.510+0000 7f9988b9b700 1 -- 172.21.15.84:0/35593778 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99840cffc0 con 0x7f99840b8660 2023-07-14T11:20:29.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.510+0000 7f9988b9b700 1 --2- 172.21.15.84:0/35593778 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99840b8660 0x7f99840cd430 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f99840d0600 tx=0x7f9978009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9960e8846d016cac server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:29.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.511+0000 7f99837fe700 1 -- 172.21.15.84:0/35593778 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9978011830 con 0x7f99840b8660 2023-07-14T11:20:29.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.511+0000 7f99837fe700 1 -- 172.21.15.84:0/35593778 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9978011990 con 0x7f99840b8660 2023-07-14T11:20:29.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.511+0000 7f99837fe700 1 -- 172.21.15.84:0/35593778 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9978011d20 con 0x7f99840b8660 2023-07-14T11:20:29.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.511+0000 7f998adff700 1 -- 172.21.15.84:0/35593778 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99840b8660 msgr2=0x7f99840cd430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:29.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.511+0000 7f998adff700 1 --2- 172.21.15.84:0/35593778 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99840b8660 0x7f99840cd430 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f99840d0600 tx=0x7f9978009bd0 comp rx=0 tx=0).stop 2023-07-14T11:20:29.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.511+0000 7f998adff700 1 -- 172.21.15.84:0/35593778 shutdown_connections 2023-07-14T11:20:29.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.511+0000 7f998adff700 1 --2- 172.21.15.84:0/35593778 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99840b8660 0x7f99840cd430 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:29.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.511+0000 7f998adff700 1 --2- 172.21.15.84:0/35593778 >> v2:172.21.15.179:3300/0 conn(0x7f99840cd970 0x7f99840b4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:29.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.511+0000 7f998adff700 1 -- 172.21.15.84:0/35593778 >> 172.21.15.84:0/35593778 conn(0x7f9984066860 msgr2=0x7f998406a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:20:29.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.511+0000 7f998adff700 1 -- 172.21.15.84:0/35593778 shutdown_connections 2023-07-14T11:20:29.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.511+0000 7f998adff700 1 -- 172.21.15.84:0/35593778 wait complete. 2023-07-14T11:20:29.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.513+0000 7f998adff700 1 Processor -- start 2023-07-14T11:20:29.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.514+0000 7f998adff700 1 -- start start 2023-07-14T11:20:29.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.514+0000 7f998adff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99840b4da0 0x7f99840b3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:29.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.514+0000 7f998adff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99840b8660 0x7f99841e74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:29.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.514+0000 7f998adff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99840cd970 0x7f99841e5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:29.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.514+0000 7f998adff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99841e7a30 con 0x7f99840b4da0 2023-07-14T11:20:29.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.514+0000 7f998adff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99840b4180 con 0x7f99840cd970 2023-07-14T11:20:29.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.514+0000 7f998adff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99841e4e70 con 0x7f99840b8660 2023-07-14T11:20:29.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.515+0000 7f9988b9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99840b4da0 0x7f99840b3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:29.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.515+0000 7f9988b9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99840b4da0 0x7f99840b3a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36876/0 (socket says 172.21.15.84:36876) 2023-07-14T11:20:29.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.515+0000 7f9988b9b700 1 -- 172.21.15.84:0/2825663018 learned_addr learned my addr 172.21.15.84:0/2825663018 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:20:29.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.515+0000 7f998939c700 1 --2- 172.21.15.84:0/2825663018 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99840cd970 0x7f99841e5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:29.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.515+0000 7f9983fff700 1 --2- 172.21.15.84:0/2825663018 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99840b8660 0x7f99841e74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:29.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.515+0000 7f9988b9b700 1 -- 172.21.15.84:0/2825663018 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99840b8660 msgr2=0x7f99841e74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:29.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.515+0000 7f9988b9b700 1 --2- 172.21.15.84:0/2825663018 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99840b8660 0x7f99841e74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:29.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.515+0000 7f9988b9b700 1 -- 172.21.15.84:0/2825663018 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99840cd970 msgr2=0x7f99841e5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:29.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.515+0000 7f9988b9b700 1 --2- 172.21.15.84:0/2825663018 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99840cd970 0x7f99841e5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:29.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.515+0000 7f9988b9b700 1 -- 172.21.15.84:0/2825663018 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9978009550 con 0x7f99840b4da0 2023-07-14T11:20:29.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.515+0000 7f9983fff700 1 --2- 172.21.15.84:0/2825663018 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99840b8660 0x7f99841e74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:20:29.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.515+0000 7f998939c700 1 --2- 172.21.15.84:0/2825663018 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99840cd970 0x7f99841e5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:20:29.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.515+0000 7f9988b9b700 1 --2- 172.21.15.84:0/2825663018 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99840b4da0 0x7f99840b3a80 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f9978000c00 tx=0x7f9978004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:29.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.516+0000 7f99817fa700 1 -- 172.21.15.84:0/2825663018 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9978004570 con 0x7f99840b4da0 2023-07-14T11:20:29.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.516+0000 7f99817fa700 1 -- 172.21.15.84:0/2825663018 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f997801f070 con 0x7f99840b4da0 2023-07-14T11:20:29.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.516+0000 7f99817fa700 1 -- 172.21.15.84:0/2825663018 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99780038e0 con 0x7f99840b4da0 2023-07-14T11:20:29.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.516+0000 7f998adff700 1 -- 172.21.15.84:0/2825663018 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99841e5150 con 0x7f99840b4da0 2023-07-14T11:20:29.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.516+0000 7f998adff700 1 -- 172.21.15.84:0/2825663018 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99841e5710 con 0x7f99840b4da0 2023-07-14T11:20:29.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.517+0000 7f998adff700 1 -- 172.21.15.84:0/2825663018 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9984074350 con 0x7f99840b4da0 2023-07-14T11:20:29.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.518+0000 7f99817fa700 1 -- 172.21.15.84:0/2825663018 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) v1 ==== 89190+0+0 (secure 0 0 0) 0x7f9978021030 con 0x7f99840b4da0 2023-07-14T11:20:29.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.519+0000 7f99817fa700 1 --2- 172.21.15.84:0/2825663018 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f996806ae90 0x7f996806d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:29.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.519+0000 7f99817fa700 1 -- 172.21.15.84:0/2825663018 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f997808aa00 con 0x7f99840b4da0 2023-07-14T11:20:29.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.519+0000 7f9983fff700 1 --2- 172.21.15.84:0/2825663018 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f996806ae90 0x7f996806d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:29.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.520+0000 7f9983fff700 1 --2- 172.21.15.84:0/2825663018 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f996806ae90 0x7f996806d340 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f998415b190 tx=0x7f9970008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:29.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.523+0000 7f99817fa700 1 -- 172.21.15.84:0/2825663018 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f9978055ab0 con 0x7f99840b4da0 2023-07-14T11:20:29.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.716+0000 7f998adff700 1 -- 172.21.15.84:0/2825663018 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f99840b2150 con 0x7f99840b4da0 2023-07-14T11:20:29.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.720+0000 7f99817fa700 1 -- 172.21.15.84:0/2825663018 <== mon.0 v2:172.21.15.84:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f9978055ab0 con 0x7f99840b4da0 2023-07-14T11:20:29.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.720+0000 7f99817fa700 1 -- 172.21.15.84:0/2825663018 <== mon.0 v2:172.21.15.84:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v22)=0 v22) v1 ==== 123+0+0 (secure 0 0 0) 0x7f99780150c0 con 0x7f99840b4da0 2023-07-14T11:20:29.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.723+0000 7f998adff700 1 -- 172.21.15.84:0/2825663018 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f996806ae90 msgr2=0x7f996806d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:29.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.723+0000 7f998adff700 1 --2- 172.21.15.84:0/2825663018 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f996806ae90 0x7f996806d340 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f998415b190 tx=0x7f9970008040 comp rx=0 tx=0).stop 2023-07-14T11:20:29.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.723+0000 7f998adff700 1 -- 172.21.15.84:0/2825663018 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99840b4da0 msgr2=0x7f99840b3a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:29.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.723+0000 7f998adff700 1 --2- 172.21.15.84:0/2825663018 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99840b4da0 0x7f99840b3a80 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f9978000c00 tx=0x7f9978004750 comp rx=0 tx=0).stop 2023-07-14T11:20:29.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.723+0000 7f998adff700 1 -- 172.21.15.84:0/2825663018 shutdown_connections 2023-07-14T11:20:29.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.723+0000 7f998adff700 1 --2- 172.21.15.84:0/2825663018 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99840cd970 0x7f99841e5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:29.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.723+0000 7f998adff700 1 --2- 172.21.15.84:0/2825663018 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99840b4da0 0x7f99840b3a80 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:29.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.723+0000 7f998adff700 1 --2- 172.21.15.84:0/2825663018 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7f996806ae90 0x7f996806d340 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:29.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.723+0000 7f998adff700 1 --2- 172.21.15.84:0/2825663018 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99840b8660 0x7f99841e74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:29.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.723+0000 7f998adff700 1 -- 172.21.15.84:0/2825663018 >> 172.21.15.84:0/2825663018 conn(0x7f9984066860 msgr2=0x7f998415ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:20:29.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.723+0000 7f998adff700 1 -- 172.21.15.84:0/2825663018 shutdown_connections 2023-07-14T11:20:29.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.723+0000 7f998adff700 1 -- 172.21.15.84:0/2825663018 wait complete. 2023-07-14T11:20:29.744 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-14T11:20:29.745 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T11:20:29.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.937+0000 7fa3157ff700 1 Processor -- start 2023-07-14T11:20:29.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.937+0000 7fa3157ff700 1 -- start start 2023-07-14T11:20:29.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.939+0000 7fa3157ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa3100d1220 0x7fa3100b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:29.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.939+0000 7fa3157ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3100b1e00 0x7fa3100afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:29.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.939+0000 7fa3157ff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3100d2ce0 con 0x7fa31015c950 2023-07-14T11:20:29.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.939+0000 7fa3157ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3100b3350 con 0x7fa3100d1220 2023-07-14T11:20:29.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.939+0000 7fa3157ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3100b3630 con 0x7fa3100b1e00 2023-07-14T11:20:29.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.939+0000 7fa307fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa3100d1220 0x7fa3100b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:29.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.939+0000 7fa307fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa3100d1220 0x7fa3100b43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36888/0 (socket says 172.21.15.84:36888) 2023-07-14T11:20:29.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.939+0000 7fa307fff700 1 -- 172.21.15.84:0/3690763396 learned_addr learned my addr 172.21.15.84:0/3690763396 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:20:29.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.939+0000 7fa30f7fe700 1 --2- 172.21.15.84:0/3690763396 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3100b1e00 0x7fa3100afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:29.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.939+0000 7fa307fff700 1 -- 172.21.15.84:0/3690763396 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3100b1e00 msgr2=0x7fa3100afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T11:20:29.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.939+0000 7fa307fff700 1 --2- 172.21.15.84:0/3690763396 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3100b1e00 0x7fa3100afac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:29.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.939+0000 7fa307fff700 1 -- 172.21.15.84:0/3690763396 >> v1:172.21.15.84:6789/0 conn(0x7fa31015c950 legacy=0x7fa3100d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:29.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.939+0000 7fa307fff700 1 -- 172.21.15.84:0/3690763396 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3100b3910 con 0x7fa3100d1220 2023-07-14T11:20:29.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.939+0000 7fa30f7fe700 1 --2- 172.21.15.84:0/3690763396 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3100b1e00 0x7fa3100afac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:20:29.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.939+0000 7fa30e7fc700 1 -- 172.21.15.84:0/3690763396 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3189494021 0 0) 0x7fa3100d2ce0 con 0x7fa31015c950 2023-07-14T11:20:29.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.940+0000 7fa307fff700 1 --2- 172.21.15.84:0/3690763396 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3100d1220 0x7fa3100b43f0 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7fa2f80098f0 tx=0x7fa2f8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85a45f51be4e20a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:29.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.940+0000 7fa30e7fc700 1 -- 172.21.15.84:0/3690763396 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f800b8a0 con 0x7fa3100d1220 2023-07-14T11:20:29.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.940+0000 7fa30e7fc700 1 -- 172.21.15.84:0/3690763396 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fa2f800ba00 con 0x7fa3100d1220 2023-07-14T11:20:29.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.940+0000 7fa30e7fc700 1 -- 172.21.15.84:0/3690763396 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f800bdb0 con 0x7fa3100d1220 2023-07-14T11:20:29.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.940+0000 7fa3157ff700 1 -- 172.21.15.84:0/3690763396 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3100d1220 msgr2=0x7fa3100b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:29.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.940+0000 7fa3157ff700 1 --2- 172.21.15.84:0/3690763396 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3100d1220 0x7fa3100b43f0 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7fa2f80098f0 tx=0x7fa2f8009c00 comp rx=0 tx=0).stop 2023-07-14T11:20:29.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.940+0000 7fa3157ff700 1 -- 172.21.15.84:0/3690763396 shutdown_connections 2023-07-14T11:20:29.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.940+0000 7fa3157ff700 1 --2- 172.21.15.84:0/3690763396 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3100b1e00 0x7fa3100afac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:29.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.940+0000 7fa3157ff700 1 --2- 172.21.15.84:0/3690763396 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3100d1220 0x7fa3100b43f0 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:29.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.940+0000 7fa3157ff700 1 -- 172.21.15.84:0/3690763396 >> 172.21.15.84:0/3690763396 conn(0x7fa31009c1d0 msgr2=0x7fa3100d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:20:29.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.941+0000 7fa3157ff700 1 -- 172.21.15.84:0/3690763396 shutdown_connections 2023-07-14T11:20:29.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.941+0000 7fa3157ff700 1 -- 172.21.15.84:0/3690763396 wait complete. 2023-07-14T11:20:29.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.942+0000 7fa3157ff700 1 Processor -- start 2023-07-14T11:20:29.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.942+0000 7fa3157ff700 1 -- start start 2023-07-14T11:20:29.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.943+0000 7fa3157ff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3100b1e00 0x7fa3101571d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:29.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.943+0000 7fa3157ff700 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3100d1220 0x7fa3100ced80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:29.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.943+0000 7fa3157ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa31015c950 0x7fa3100c8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:29.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.943+0000 7fa3157ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3100c7e60 con 0x7fa31015c950 2023-07-14T11:20:29.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.943+0000 7fa3157ff700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3100c8140 con 0x7fa3100b1e00 2023-07-14T11:20:29.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.943+0000 7fa3157ff700 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3100c8420 con 0x7fa3100d1220 2023-07-14T11:20:29.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.944+0000 7fa30f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa31015c950 0x7fa3100c8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:29.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.944+0000 7fa30f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa31015c950 0x7fa3100c8f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36900/0 (socket says 172.21.15.84:36900) 2023-07-14T11:20:29.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.944+0000 7fa30f7fe700 1 -- 172.21.15.84:0/2505550843 learned_addr learned my addr 172.21.15.84:0/2505550843 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-07-14T11:20:29.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.944+0000 7fa307fff700 1 --2- 172.21.15.84:0/2505550843 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3100d1220 0x7fa3100ced80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:29.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.944+0000 7fa30effd700 1 --2- 172.21.15.84:0/2505550843 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3100b1e00 0x7fa3101571d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:29.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.944+0000 7fa30f7fe700 1 -- 172.21.15.84:0/2505550843 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3100d1220 msgr2=0x7fa3100ced80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:29.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.944+0000 7fa30f7fe700 1 --2- 172.21.15.84:0/2505550843 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3100d1220 0x7fa3100ced80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:29.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.944+0000 7fa30f7fe700 1 -- 172.21.15.84:0/2505550843 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3100b1e00 msgr2=0x7fa3101571d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:29.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.944+0000 7fa30f7fe700 1 --2- 172.21.15.84:0/2505550843 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3100b1e00 0x7fa3101571d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:29.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.944+0000 7fa30f7fe700 1 -- 172.21.15.84:0/2505550843 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f8009550 con 0x7fa31015c950 2023-07-14T11:20:29.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.944+0000 7fa30effd700 1 --2- 172.21.15.84:0/2505550843 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3100b1e00 0x7fa3101571d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T11:20:29.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.944+0000 7fa30f7fe700 1 --2- 172.21.15.84:0/2505550843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa31015c950 0x7fa3100c8f00 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7fa30800cef0 tx=0x7fa30800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:29.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.944+0000 7fa3077fe700 1 -- 172.21.15.84:0/2505550843 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30800ae50 con 0x7fa31015c950 2023-07-14T11:20:29.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.944+0000 7fa3077fe700 1 -- 172.21.15.84:0/2505550843 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fa308015440 con 0x7fa31015c950 2023-07-14T11:20:29.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.944+0000 7fa3157ff700 1 -- 172.21.15.84:0/2505550843 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3100c8700 con 0x7fa31015c950 2023-07-14T11:20:29.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.945+0000 7fa3077fe700 1 -- 172.21.15.84:0/2505550843 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa308015810 con 0x7fa31015c950 2023-07-14T11:20:29.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.945+0000 7fa3157ff700 1 -- 172.21.15.84:0/2505550843 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa310157710 con 0x7fa31015c950 2023-07-14T11:20:29.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.946+0000 7fa3157ff700 1 -- 172.21.15.84:0/2505550843 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3100c8c20 con 0x7fa31015c950 2023-07-14T11:20:29.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.946+0000 7fa3077fe700 1 -- 172.21.15.84:0/2505550843 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) v1 ==== 89190+0+0 (secure 0 0 0) 0x7fa30800d430 con 0x7fa31015c950 2023-07-14T11:20:29.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.947+0000 7fa3077fe700 1 --2- 172.21.15.84:0/2505550843 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fa2f006ae90 0x7fa2f006d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T11:20:29.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.947+0000 7fa3077fe700 1 -- 172.21.15.84:0/2505550843 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fa308089b90 con 0x7fa31015c950 2023-07-14T11:20:29.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.948+0000 7fa30effd700 1 --2- 172.21.15.84:0/2505550843 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fa2f006ae90 0x7fa2f006d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T11:20:29.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.949+0000 7fa30effd700 1 --2- 172.21.15.84:0/2505550843 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fa2f006ae90 0x7fa2f006d340 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa300000fd0 tx=0x7fa300009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T11:20:29.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:29.952+0000 7fa3077fe700 1 -- 172.21.15.84:0/2505550843 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fa3100c8c20 con 0x7fa31015c950 2023-07-14T11:20:30.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:30.190+0000 7fa3157ff700 1 -- 172.21.15.84:0/2505550843 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa3100c8c20 con 0x7fa31015c950 2023-07-14T11:20:30.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:30.191+0000 7fa3077fe700 1 -- 172.21.15.84:0/2505550843 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+3529 (secure 0 0 0) 0x7fa3100c8c20 con 0x7fa31015c950 2023-07-14T11:20:30.194 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-07-14T11:20:30.195 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":72,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6197,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/396743399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6833","nonce":396743399},{"type":"v1","addr":"172.21.15.179:6835","nonce":396743399}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":7105,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6834/3729505201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":3729505201},{"type":"v1","addr":"172.21.15.179:6834","nonce":3729505201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":7680,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6833/411491873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":411491873},{"type":"v1","addr":"172.21.15.84:6833","nonce":411491873}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":8100,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/3783367318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3783367318},{"type":"v1","addr":"172.21.15.84:6835","nonce":3783367318}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72}],"filesystems":[]} 2023-07-14T11:20:30.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:30.193+0000 7fa3157ff700 1 -- 172.21.15.84:0/2505550843 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fa2f006ae90 msgr2=0x7fa2f006d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:30.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:30.193+0000 7fa3157ff700 1 --2- 172.21.15.84:0/2505550843 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fa2f006ae90 0x7fa2f006d340 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa300000fd0 tx=0x7fa300009040 comp rx=0 tx=0).stop 2023-07-14T11:20:30.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:30.193+0000 7fa3157ff700 1 -- 172.21.15.84:0/2505550843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa31015c950 msgr2=0x7fa3100c8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T11:20:30.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:30.193+0000 7fa3157ff700 1 --2- 172.21.15.84:0/2505550843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa31015c950 0x7fa3100c8f00 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7fa30800cef0 tx=0x7fa30800a340 comp rx=0 tx=0).stop 2023-07-14T11:20:30.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:30.193+0000 7fa3157ff700 1 -- 172.21.15.84:0/2505550843 shutdown_connections 2023-07-14T11:20:30.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:30.193+0000 7fa3157ff700 1 --2- 172.21.15.84:0/2505550843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa31015c950 0x7fa3100c8f00 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:30.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:30.193+0000 7fa3157ff700 1 --2- 172.21.15.84:0/2505550843 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3100b1e00 0x7fa3101571d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:30.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:30.193+0000 7fa3157ff700 1 --2- 172.21.15.84:0/2505550843 >> [v2:172.21.15.179:6836/2094253834,v1:172.21.15.179:6837/2094253834] conn(0x7fa2f006ae90 0x7fa2f006d340 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:30.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:30.193+0000 7fa3157ff700 1 --2- 172.21.15.84:0/2505550843 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3100d1220 0x7fa3100ced80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T11:20:30.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:30.193+0000 7fa3157ff700 1 -- 172.21.15.84:0/2505550843 >> 172.21.15.84:0/2505550843 conn(0x7fa31009c1d0 msgr2=0x7fa3100b0360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T11:20:30.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:30.194+0000 7fa3157ff700 1 -- 172.21.15.84:0/2505550843 shutdown_connections 2023-07-14T11:20:30.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-07-14T11:20:30.194+0000 7fa3157ff700 1 -- 172.21.15.84:0/2505550843 wait complete. 2023-07-14T11:20:30.199 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 72 2023-07-14T11:20:30.214 DEBUG:tasks.cephfs.filesystem:already dead... 2023-07-14T11:20:30.215 INFO:teuthology.misc:Shutting down mds daemons... 2023-07-14T11:20:30.215 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-14T11:20:30.216 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T11:20:30.228 INFO:tasks.ceph.mds.a:Stopped 2023-07-14T11:20:30.229 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-14T11:20:30.229 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T11:20:30.282 INFO:tasks.ceph.mds.c:Stopped 2023-07-14T11:20:30.282 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-14T11:20:30.283 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T11:20:30.298 INFO:tasks.ceph.mds.b:Stopped 2023-07-14T11:20:30.298 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-14T11:20:30.299 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T11:20:30.355 INFO:tasks.ceph.mds.d:Stopped 2023-07-14T11:20:30.355 INFO:teuthology.misc:Shutting down osd daemons... 2023-07-14T11:20:30.356 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-07-14T11:20:30.356 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T11:20:30.397 INFO:tasks.ceph.osd.0:Stopped 2023-07-14T11:20:30.397 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-07-14T11:20:30.397 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T11:20:30.446 INFO:tasks.ceph.osd.1:Stopped 2023-07-14T11:20:30.447 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-07-14T11:20:30.447 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T11:20:30.488 INFO:tasks.ceph.osd.2:Stopped 2023-07-14T11:20:30.489 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-07-14T11:20:30.489 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T11:20:30.534 INFO:tasks.ceph.osd.3:Stopped 2023-07-14T11:20:30.536 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-07-14T11:20:30.536 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T11:20:30.577 INFO:tasks.ceph.osd.4:Stopped 2023-07-14T11:20:30.577 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-07-14T11:20:30.578 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T11:20:30.633 INFO:tasks.ceph.osd.5:Stopped 2023-07-14T11:20:30.634 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-07-14T11:20:30.634 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T11:20:30.682 INFO:tasks.ceph.osd.6:Stopped 2023-07-14T11:20:30.683 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-07-14T11:20:30.683 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T11:20:30.732 INFO:tasks.ceph.osd.7:Stopped 2023-07-14T11:20:30.733 INFO:teuthology.misc:Shutting down mgr daemons... 2023-07-14T11:20:30.733 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-07-14T11:20:30.734 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T11:20:30.795 INFO:tasks.ceph.mgr.y:Stopped 2023-07-14T11:20:30.796 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-07-14T11:20:30.796 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T11:20:30.860 INFO:tasks.ceph.mgr.x:Stopped 2023-07-14T11:20:30.860 INFO:teuthology.misc:Shutting down mon daemons... 2023-07-14T11:20:30.861 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-07-14T11:20:30.861 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T11:20:30.882 INFO:tasks.ceph.mon.a:Stopped 2023-07-14T11:20:30.883 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-07-14T11:20:30.883 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T11:20:30.900 INFO:tasks.ceph.mon.b:Stopped 2023-07-14T11:20:30.901 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-07-14T11:20:30.901 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T11:20:30.959 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-07-14T11:20:30.960 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2023-07-14T11:20:30.960 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2023-07-14T11:20:30.960 INFO:tasks.ceph.mon.c:Stopped 2023-07-14T11:20:30.961 INFO:tasks.ceph:Checking cluster log for badness... 2023-07-14T11:20:30.961 DEBUG:teuthology.orchestra.run.smithi084:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2023-07-14T11:20:31.050 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi084.front.sepia.ceph.com 2023-07-14T11:20:31.051 DEBUG:teuthology.orchestra.run.smithi084:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-07-14T11:20:31.415 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi084.front.sepia.ceph.com 2023-07-14T11:20:31.416 DEBUG:teuthology.orchestra.run.smithi084:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-07-14T11:20:31.599 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi084.front.sepia.ceph.com 2023-07-14T11:20:31.600 DEBUG:teuthology.orchestra.run.smithi084:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-07-14T11:20:31.814 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi084.front.sepia.ceph.com 2023-07-14T11:20:31.815 DEBUG:teuthology.orchestra.run.smithi084:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-07-14T11:20:31.993 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi179.front.sepia.ceph.com 2023-07-14T11:20:31.994 DEBUG:teuthology.orchestra.run.smithi179:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-07-14T11:20:32.310 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi179.front.sepia.ceph.com 2023-07-14T11:20:32.311 DEBUG:teuthology.orchestra.run.smithi179:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-07-14T11:20:32.496 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi179.front.sepia.ceph.com 2023-07-14T11:20:32.496 DEBUG:teuthology.orchestra.run.smithi179:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-07-14T11:20:32.702 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi179.front.sepia.ceph.com 2023-07-14T11:20:32.702 DEBUG:teuthology.orchestra.run.smithi179:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-07-14T11:20:32.901 INFO:tasks.ceph:Archiving mon data... 2023-07-14T11:20:32.902 DEBUG:teuthology.misc:Transferring archived files from smithi084:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi/7337410/data/mon.a.tgz 2023-07-14T11:20:32.903 DEBUG:teuthology.orchestra.run.smithi084:> mktemp 2023-07-14T11:20:32.953 INFO:teuthology.orchestra.run.smithi084.stdout:/tmp/tmp.F6qmI6V7t8 2023-07-14T11:20:32.954 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.F6qmI6V7t8 2023-07-14T11:20:33.169 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 0666 /tmp/tmp.F6qmI6V7t8 2023-07-14T11:20:33.286 DEBUG:teuthology.orchestra.remote:smithi084:/tmp/tmp.F6qmI6V7t8 is 783KB 2023-07-14T11:20:33.392 DEBUG:teuthology.orchestra.run.smithi084:> rm -fr /tmp/tmp.F6qmI6V7t8 2023-07-14T11:20:33.438 DEBUG:teuthology.misc:Transferring archived files from smithi179:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi/7337410/data/mon.b.tgz 2023-07-14T11:20:33.438 DEBUG:teuthology.orchestra.run.smithi179:> mktemp 2023-07-14T11:20:33.485 INFO:teuthology.orchestra.run.smithi179.stdout:/tmp/tmp.DFZnKzlpL4 2023-07-14T11:20:33.486 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.DFZnKzlpL4 2023-07-14T11:20:33.748 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 0666 /tmp/tmp.DFZnKzlpL4 2023-07-14T11:20:33.864 DEBUG:teuthology.orchestra.remote:smithi179:/tmp/tmp.DFZnKzlpL4 is 812KB 2023-07-14T11:20:33.968 DEBUG:teuthology.orchestra.run.smithi179:> rm -fr /tmp/tmp.DFZnKzlpL4 2023-07-14T11:20:34.015 DEBUG:teuthology.misc:Transferring archived files from smithi179:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi/7337410/data/mon.c.tgz 2023-07-14T11:20:34.016 DEBUG:teuthology.orchestra.run.smithi179:> mktemp 2023-07-14T11:20:34.100 INFO:teuthology.orchestra.run.smithi179.stdout:/tmp/tmp.A5RmGLawuu 2023-07-14T11:20:34.101 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.A5RmGLawuu 2023-07-14T11:20:34.350 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 0666 /tmp/tmp.A5RmGLawuu 2023-07-14T11:20:34.467 DEBUG:teuthology.orchestra.remote:smithi179:/tmp/tmp.A5RmGLawuu is 812KB 2023-07-14T11:20:34.569 DEBUG:teuthology.orchestra.run.smithi179:> rm -fr /tmp/tmp.A5RmGLawuu 2023-07-14T11:20:34.616 INFO:tasks.ceph:Cleaning ceph cluster... 2023-07-14T11:20:34.617 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-07-14T11:20:34.622 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-07-14T11:20:34.725 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-07-14T11:20:34.726 DEBUG:teuthology.orchestra.run.smithi084:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-07-14T11:20:34.730 DEBUG:teuthology.orchestra.run.smithi179:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-07-14T11:20:34.818 INFO:teuthology.orchestra.run.smithi084.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-07-14T11:20:34.818 INFO:teuthology.orchestra.run.smithi179.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-07-14T11:20:34.835 INFO:tasks.ceph:Archiving crash dumps... 2023-07-14T11:20:34.836 DEBUG:teuthology.misc:Transferring archived files from smithi084:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi/7337410/remote/smithi084/crash 2023-07-14T11:20:34.837 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-07-14T11:20:34.906 DEBUG:teuthology.misc:Transferring archived files from smithi179:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi/7337410/remote/smithi179/crash 2023-07-14T11:20:34.907 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-07-14T11:20:34.975 INFO:tasks.ceph:Shutting down logrotate 2023-07-14T11:20:34.976 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T11:20:34.981 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T11:20:35.079 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-07-14T11:20:35.148 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-07-14T11:20:35.216 INFO:tasks.ceph:Compressing logs... 2023-07-14T11:20:35.217 DEBUG:teuthology.orchestra.run.smithi084:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-07-14T11:20:35.221 DEBUG:teuthology.orchestra.run.smithi179:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-07-14T11:20:35.286 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176228.log 2023-07-14T11:20:35.287 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166420.log 2023-07-14T11:20:35.288 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.176228.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.176228.log.gz 2023-07-14T11:20:35.288 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.157174.log 2023-07-14T11:20:35.289 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.166420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154525.log 2023-07-14T11:20:35.290 INFO:teuthology.orchestra.run.smithi084.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.166420.log.gz 2023-07-14T11:20:35.290 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.119258.log 2023-07-14T11:20:35.291 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.0.157174.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.157174.log.gz 2023-07-14T11:20:35.291 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172955.log 2023-07-14T11:20:35.292 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112267.log 2023-07-14T11:20:35.292 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.3.119258.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.119258.log.gz 2023-07-14T11:20:35.293 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.154525.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.154525.log.gz 2023-07-14T11:20:35.293 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147300.log 2023-07-14T11:20:35.293 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.172955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171822.log 2023-07-14T11:20:35.294 INFO:teuthology.orchestra.run.smithi084.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.172955.log.gz 2023-07-14T11:20:35.295 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.147300.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.147300.log.gz 2023-07-14T11:20:35.295 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166949.log 2023-07-14T11:20:35.296 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.171822.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.171822.log.gz 2023-07-14T11:20:35.296 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175684.log 2023-07-14T11:20:35.297 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.123093.log 2023-07-14T11:20:35.297 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.112267.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.112267.log.gz 2023-07-14T11:20:35.297 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-07-14T11:20:35.297 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.1.123093.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.123093.log.gz 2023-07-14T11:20:35.298 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112217.log 2023-07-14T11:20:35.298 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.120135.log 2023-07-14T11:20:35.298 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.112217.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.112217.log.gz 2023-07-14T11:20:35.298 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-07-14T11:20:35.298 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.1.120135.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.120135.log.gz 2023-07-14T11:20:35.300 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112168.log 2023-07-14T11:20:35.300 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.122295.log 2023-07-14T11:20:35.301 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.112168.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.112168.log.gz 2023-07-14T11:20:35.301 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.123814.log 2023-07-14T11:20:35.303 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.166949.log: gzip 88.6%-5 -- replaced with /var/log/ceph/ceph-client.admin.166949.log.gz 2023-07-14T11:20:35.303 INFO:teuthology.orchestra.run.smithi084.stderr:--verbose -- /var/log/ceph/ceph-client.admin.179347.log 2023-07-14T11:20:35.303 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.175684.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.175684.log.gz 2023-07-14T11:20:35.304 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177549.log 2023-07-14T11:20:35.304 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.179347.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.179347.log.gz 2023-07-14T11:20:35.305 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150137.log 2023-07-14T11:20:35.305 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.177549.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.177549.log.gz 2023-07-14T11:20:35.306 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167379.log 2023-07-14T11:20:35.306 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.150137.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.150137.log.gz 2023-07-14T11:20:35.307 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178261.log 2023-07-14T11:20:35.307 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.167379.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.167379.log.gz 2023-07-14T11:20:35.307 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153823.log 2023-07-14T11:20:35.308 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.178261.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.178261.log.gz 2023-07-14T11:20:35.308 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165130.log 2023-07-14T11:20:35.308 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.153823.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.153823.log.gz 2023-07-14T11:20:35.309 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162667.log 2023-07-14T11:20:35.314 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.1.122295.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.122295.log.gz 2023-07-14T11:20:35.315 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.121586.log 2023-07-14T11:20:35.315 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.1.123814.log: 93.4% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-07-14T11:20:35.315 INFO:teuthology.orchestra.run.smithi179.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.123814.log.gz 2023-07-14T11:20:35.315 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-07-14T11:20:35.316 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.1.121586.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.121586.log.gz 2023-07-14T11:20:35.316 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112315.log 2023-07-14T11:20:35.316 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-07-14T11:20:35.316 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.112315.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.112315.log.gz 2023-07-14T11:20:35.317 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-07-14T11:20:35.317 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112116.log 2023-07-14T11:20:35.317 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-07-14T11:20:35.317 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.112116.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.112116.log.gz 2023-07-14T11:20:35.317 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112019.log 2023-07-14T11:20:35.318 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-07-14T11:20:35.318 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.112019.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.112019.log.gz 2023-07-14T11:20:35.318 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-07-14T11:20:35.320 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-07-14T11:20:35.320 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-mds.d.log: /var/log/ceph/ceph.log: 92.5% -- replaced with /var/log/ceph/ceph.log.gz 2023-07-14T11:20:35.322 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.165130.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.165130.log.gz 2023-07-14T11:20:35.322 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174881.log 2023-07-14T11:20:35.323 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.162667.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.162667.log.gz 2023-07-14T11:20:35.323 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149696.log 2023-07-14T11:20:35.323 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.174881.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.174881.log.gz 2023-07-14T11:20:35.323 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177341.log 2023-07-14T11:20:35.323 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.149696.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.149696.log.gz 2023-07-14T11:20:35.324 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164272.log 2023-07-14T11:20:35.324 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.177341.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.177341.log.gz 2023-07-14T11:20:35.324 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178714.log 2023-07-14T11:20:35.324 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.164272.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.164272.log.gz 2023-07-14T11:20:35.324 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155578.log 2023-07-14T11:20:35.325 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.178714.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.178714.log.gz 2023-07-14T11:20:35.325 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171168.log 2023-07-14T11:20:35.325 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.155578.log: gzip -5 89.5%--verbose -- replaced with /var/log/ceph/ceph-client.admin.155578.log.gz-- 2023-07-14T11:20:35.325 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.152261.log 2023-07-14T11:20:35.325 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.171168.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.171168.log.gz 2023-07-14T11:20:35.326 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160802.log 2023-07-14T11:20:35.326 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.152261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169854.log 2023-07-14T11:20:35.326 INFO:teuthology.orchestra.run.smithi084.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.152261.log.gz 2023-07-14T11:20:35.326 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.160802.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.160802.log.gz 2023-07-14T11:20:35.326 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162895.log 2023-07-14T11:20:35.327 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.169854.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.169854.log.gz 2023-07-14T11:20:35.327 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160102.log 2023-07-14T11:20:35.327 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.162895.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.162895.log.gz 2023-07-14T11:20:35.327 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168110.log 2023-07-14T11:20:35.327 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.160102.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.160102.log.gz 2023-07-14T11:20:35.327 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177845.log 2023-07-14T11:20:35.328 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.168110.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.168110.log.gz 2023-07-14T11:20:35.328 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148994.log 2023-07-14T11:20:35.328 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.177845.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.177845.log.gz 2023-07-14T11:20:35.328 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156694.log 2023-07-14T11:20:35.329 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.148994.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.148994.log.gz 2023-07-14T11:20:35.329 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159952.log 2023-07-14T11:20:35.329 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.156694.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.156694.log.gz 2023-07-14T11:20:35.329 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147487.log 2023-07-14T11:20:35.329 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.159952.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.159952.log.gz 2023-07-14T11:20:35.329 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164643.log 2023-07-14T11:20:35.330 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-07-14T11:20:35.333 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.147487.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.147487.log.gz 2023-07-14T11:20:35.333 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147783.log 2023-07-14T11:20:35.334 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.164643.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.164643.log.gz 2023-07-14T11:20:35.334 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148602.log 2023-07-14T11:20:35.334 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.147783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181976.log 2023-07-14T11:20:35.334 INFO:teuthology.orchestra.run.smithi084.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.147783.log.gz 2023-07-14T11:20:35.335 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.148602.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.148602.log.gz 2023-07-14T11:20:35.335 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148600.log 2023-07-14T11:20:35.335 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.181976.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.181976.log.gz 2023-07-14T11:20:35.336 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169153.log 2023-07-14T11:20:35.336 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.148600.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.148600.log.gz 2023-07-14T11:20:35.337 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168502.log 2023-07-14T11:20:35.337 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.169153.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.169153.log.gz 2023-07-14T11:20:35.337 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172641.log 2023-07-14T11:20:35.338 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.168502.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.168502.log.gz 2023-07-14T11:20:35.338 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165179.log 2023-07-14T11:20:35.339 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.172641.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.172641.log.gz 2023-07-14T11:20:35.339 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165328.log 2023-07-14T11:20:35.339 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.165179.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.165179.log.gz 2023-07-14T11:20:35.340 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148597.log 2023-07-14T11:20:35.340 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.165328.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.165328.log.gz 2023-07-14T11:20:35.341 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152800.log 2023-07-14T11:20:35.342 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-07-14T11:20:35.345 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.148597.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.148597.log.gz 2023-07-14T11:20:35.346 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171879.log 2023-07-14T11:20:35.346 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.152800.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.152800.log.gz 2023-07-14T11:20:35.346 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155823.log 2023-07-14T11:20:35.346 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.171879.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.171879.log.gz 2023-07-14T11:20:35.346 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149370.log 2023-07-14T11:20:35.347 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.155823.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.155823.log.gz 2023-07-14T11:20:35.347 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153481.log 2023-07-14T11:20:35.347 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.149370.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.149370.log.gz 2023-07-14T11:20:35.347 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170302.log 2023-07-14T11:20:35.347 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.153481.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.153481.log.gz 2023-07-14T11:20:35.348 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149387.log 2023-07-14T11:20:35.348 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.170302.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.170302.log.gz 2023-07-14T11:20:35.348 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158203.log 2023-07-14T11:20:35.348 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.149387.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.149387.log.gz 2023-07-14T11:20:35.348 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164388.log 2023-07-14T11:20:35.349 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.158203.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.158203.log.gz 2023-07-14T11:20:35.349 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167574.log 2023-07-14T11:20:35.349 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.164388.log: gzip 89.3%-5 -- replaced with /var/log/ceph/ceph-client.admin.164388.log.gz--verbose 2023-07-14T11:20:35.349 INFO:teuthology.orchestra.run.smithi084.stderr:-- /var/log/ceph/ceph-client.admin.159637.log 2023-07-14T11:20:35.349 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.167574.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.167574.log.gz 2023-07-14T11:20:35.350 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173683.log 2023-07-14T11:20:35.350 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.159637.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.159637.log.gz 2023-07-14T11:20:35.350 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156474.log 2023-07-14T11:20:35.352 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.173683.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.173683.log.gz 2023-07-14T11:20:35.352 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159823.log 2023-07-14T11:20:35.352 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.156474.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.156474.log.gz 2023-07-14T11:20:35.353 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148996.log 2023-07-14T11:20:35.353 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.159823.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.159823.log.gz 2023-07-14T11:20:35.353 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156117.log 2023-07-14T11:20:35.353 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.148996.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.148996.log.gz 2023-07-14T11:20:35.353 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160655.log 2023-07-14T11:20:35.354 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.156117.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.156117.log.gz 2023-07-14T11:20:35.354 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172320.log 2023-07-14T11:20:35.354 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.160655.log: gzip -5 88.7%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.160655.log.gz/var/log/ceph/ceph-client.admin.161022.log 2023-07-14T11:20:35.354 INFO:teuthology.orchestra.run.smithi084.stderr: 2023-07-14T11:20:35.354 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.172320.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.172320.log.gz 2023-07-14T11:20:35.355 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150235.log 2023-07-14T11:20:35.355 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.120800.log 2023-07-14T11:20:35.356 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.161022.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.161022.log.gz 2023-07-14T11:20:35.357 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155439.log 2023-07-14T11:20:35.357 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.150235.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.150235.log.gz 2023-07-14T11:20:35.357 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175244.log 2023-07-14T11:20:35.357 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.155439.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.155439.log.gz 2023-07-14T11:20:35.357 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165918.log 2023-07-14T11:20:35.358 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.175244.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.175244.log.gz 2023-07-14T11:20:35.358 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156645.log 2023-07-14T11:20:35.358 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.165918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147981.log 2023-07-14T11:20:35.359 INFO:teuthology.orchestra.run.smithi084.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.165918.log.gz 2023-07-14T11:20:35.359 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.156645.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.156645.log.gz 2023-07-14T11:20:35.359 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173336.log 2023-07-14T11:20:35.360 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.147981.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.147981.log.gz 2023-07-14T11:20:35.360 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172163.log 2023-07-14T11:20:35.361 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.173336.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.173336.log.gz 2023-07-14T11:20:35.361 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156068.log 2023-07-14T11:20:35.361 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.172163.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.172163.log.gz 2023-07-14T11:20:35.361 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149892.log 2023-07-14T11:20:35.362 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.156068.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.156068.log.gz 2023-07-14T11:20:35.362 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164692.log 2023-07-14T11:20:35.363 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.149892.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.149892.log.gz 2023-07-14T11:20:35.363 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152947.log 2023-07-14T11:20:35.364 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.164692.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.164692.log.gz 2023-07-14T11:20:35.364 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149794.log 2023-07-14T11:20:35.365 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.152947.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.152947.log.gz 2023-07-14T11:20:35.365 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180614.log 2023-07-14T11:20:35.366 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.149794.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.149794.log.gz 2023-07-14T11:20:35.366 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171560.log 2023-07-14T11:20:35.366 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.180614.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.180614.log.gz 2023-07-14T11:20:35.367 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159468.log 2023-07-14T11:20:35.367 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.171560.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.171560.log.gz 2023-07-14T11:20:35.368 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181650.log 2023-07-14T11:20:35.368 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.159468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168208.log 2023-07-14T11:20:35.369 INFO:teuthology.orchestra.run.smithi084.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.159468.log.gz 2023-07-14T11:20:35.369 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.181650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173532.log 2023-07-14T11:20:35.370 INFO:teuthology.orchestra.run.smithi084.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.181650.log.gz 2023-07-14T11:20:35.370 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.168208.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.168208.log.gz 2023-07-14T11:20:35.371 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149941.log 2023-07-14T11:20:35.371 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.173532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168966.log 2023-07-14T11:20:35.372 INFO:teuthology.orchestra.run.smithi084.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.173532.log.gz 2023-07-14T11:20:35.372 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.149941.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.149941.log.gz 2023-07-14T11:20:35.373 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161549.log 2023-07-14T11:20:35.373 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.168966.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.168966.log.gz 2023-07-14T11:20:35.374 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166851.log 2023-07-14T11:20:35.374 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.161549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175635.log 2023-07-14T11:20:35.375 INFO:teuthology.orchestra.run.smithi084.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.161549.log.gz 2023-07-14T11:20:35.375 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.166851.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.166851.log.gz 2023-07-14T11:20:35.376 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181503.log 2023-07-14T11:20:35.376 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-osd.5.log: /var/log/ceph/ceph-client.1.120800.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.120800.log.gz 2023-07-14T11:20:35.376 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.118579.log 2023-07-14T11:20:35.377 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.175635.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.175635.log.gz 2023-07-14T11:20:35.378 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168747.log 2023-07-14T11:20:35.378 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.181503.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.181503.log.gz 2023-07-14T11:20:35.378 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160153.log 2023-07-14T11:20:35.379 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.168747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173223.log 2023-07-14T11:20:35.379 INFO:teuthology.orchestra.run.smithi084.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.168747.log.gz 2023-07-14T11:20:35.379 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.160153.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.160153.log.gz 2023-07-14T11:20:35.380 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152996.log 2023-07-14T11:20:35.380 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.173223.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.173223.log.gz 2023-07-14T11:20:35.381 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168867.log 2023-07-14T11:20:35.381 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.152996.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.152996.log.gz 2023-07-14T11:20:35.382 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175391.log 2023-07-14T11:20:35.382 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.168867.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.168867.log.gz 2023-07-14T11:20:35.382 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175075.log 2023-07-14T11:20:35.383 INFO:teuthology.orchestra.run.smithi179.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-07-14T11:20:35.384 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.175391.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.175391.log.gz 2023-07-14T11:20:35.384 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170971.log 2023-07-14T11:20:35.385 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.175075.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.175075.log.gz 2023-07-14T11:20:35.385 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163929.log 2023-07-14T11:20:35.385 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.170971.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.170971.log.gz 2023-07-14T11:20:35.386 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173124.log 2023-07-14T11:20:35.386 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.163929.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.163929.log.gz 2023-07-14T11:20:35.387 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179789.log 2023-07-14T11:20:35.387 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.173124.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.173124.log.gz 2023-07-14T11:20:35.388 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155774.log 2023-07-14T11:20:35.388 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.179789.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.179789.log.gz 2023-07-14T11:20:35.388 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177144.log 2023-07-14T11:20:35.389 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.155774.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.155774.log.gz 2023-07-14T11:20:35.389 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178665.log 2023-07-14T11:20:35.390 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.177144.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.177144.log.gz 2023-07-14T11:20:35.390 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149598.log 2023-07-14T11:20:35.391 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.178665.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.178665.log.gz 2023-07-14T11:20:35.392 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167022.log 2023-07-14T11:20:35.393 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.149598.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.149598.log.gz 2023-07-14T11:20:35.393 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177194.log 2023-07-14T11:20:35.394 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.167022.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.167022.log.gz 2023-07-14T11:20:35.394 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167428.log 2023-07-14T11:20:35.394 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112365.log 2023-07-14T11:20:35.395 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.177194.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.177194.log.gz 2023-07-14T11:20:35.395 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155627.log 2023-07-14T11:20:35.396 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.167428.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.167428.log.gz 2023-07-14T11:20:35.396 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152457.log 2023-07-14T11:20:35.397 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.155627.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.155627.log.gz 2023-07-14T11:20:35.397 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179593.log 2023-07-14T11:20:35.398 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.1.118579.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.118579.log.gz 2023-07-14T11:20:35.398 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.152457.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.152457.log.gz 2023-07-14T11:20:35.399 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159736.log 2023-07-14T11:20:35.399 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.179593.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.179593.log.gz 2023-07-14T11:20:35.400 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158616.log 2023-07-14T11:20:35.400 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.159736.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.159736.log.gz 2023-07-14T11:20:35.400 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165079.log 2023-07-14T11:20:35.402 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.158616.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.158616.log.gz 2023-07-14T11:20:35.402 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-07-14T11:20:35.403 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.165079.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.165079.log.gz 2023-07-14T11:20:35.403 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180056.log 2023-07-14T11:20:35.403 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174232.log 2023-07-14T11:20:35.404 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.180056.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.180056.log.gz 2023-07-14T11:20:35.404 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152849.log 2023-07-14T11:20:35.405 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.174232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162591.log 2023-07-14T11:20:35.406 INFO:teuthology.orchestra.run.smithi084.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.174232.log.gz 2023-07-14T11:20:35.406 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.152849.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.152849.log.gz 2023-07-14T11:20:35.406 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168404.log 2023-07-14T11:20:35.407 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.162591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158496.log 2023-07-14T11:20:35.408 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112068.log 2023-07-14T11:20:35.408 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.112365.log: 95.3% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-07-14T11:20:35.408 INFO:teuthology.orchestra.run.smithi179.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.112365.log.gz 2023-07-14T11:20:35.409 INFO:teuthology.orchestra.run.smithi084.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.162591.log.gz 2023-07-14T11:20:35.409 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.168404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147932.log 2023-07-14T11:20:35.409 INFO:teuthology.orchestra.run.smithi084.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.168404.log.gz 2023-07-14T11:20:35.410 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.158496.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.158496.log.gz 2023-07-14T11:20:35.410 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160851.log 2023-07-14T11:20:35.411 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.147932.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.147932.log.gz 2023-07-14T11:20:35.411 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147732.log 2023-07-14T11:20:35.412 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.112068.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.112068.log.gz 2023-07-14T11:20:35.413 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.160851.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.160851.log.gz 2023-07-14T11:20:35.413 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-07-14T11:20:35.413 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.147732.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.147732.log.gz 2023-07-14T11:20:35.414 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160459.log 2023-07-14T11:20:35.414 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170780.log 2023-07-14T11:20:35.415 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.160459.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.160459.log.gz 2023-07-14T11:20:35.416 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168306.log 2023-07-14T11:20:35.416 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.170780.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.170780.log.gz 2023-07-14T11:20:35.417 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171511.log 2023-07-14T11:20:35.418 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.168306.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.168306.log.gz 2023-07-14T11:20:35.418 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164027.log 2023-07-14T11:20:35.419 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.171511.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.171511.log.gz 2023-07-14T11:20:35.419 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180565.log 2023-07-14T11:20:35.420 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.164027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181307.log 2023-07-14T11:20:35.421 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.164027.log.gz 2023-07-14T11:20:35.421 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.180565.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.180565.log.gz 2023-07-14T11:20:35.422 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141182.log 2023-07-14T11:20:35.423 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.181307.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.181307.log.gz 2023-07-14T11:20:35.423 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150039.log 2023-07-14T11:20:35.423 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.141182.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.141182.log.gz 2023-07-14T11:20:35.424 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175195.log 2023-07-14T11:20:35.425 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.150039.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.150039.log.gz 2023-07-14T11:20:35.425 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147536.log 2023-07-14T11:20:35.426 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.175195.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.175195.log.gz 2023-07-14T11:20:35.426 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150600.log 2023-07-14T11:20:35.427 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.147536.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.147536.log.gz 2023-07-14T11:20:35.428 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154476.log 2023-07-14T11:20:35.428 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.150600.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.150600.log.gz 2023-07-14T11:20:35.429 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152408.log 2023-07-14T11:20:35.429 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.154476.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.154476.log.gz 2023-07-14T11:20:35.430 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158714.log 2023-07-14T11:20:35.430 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.152408.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.152408.log.gz 2023-07-14T11:20:35.431 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169400.log 2023-07-14T11:20:35.432 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.158714.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.158714.log.gz 2023-07-14T11:20:35.432 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.170562.log 2023-07-14T11:20:35.433 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.169400.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.169400.log.gz 2023-07-14T11:20:35.433 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159419.log 2023-07-14T11:20:35.434 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.0.170562.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.170562.log.gz 2023-07-14T11:20:35.434 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167232.log 2023-07-14T11:20:35.435 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.159419.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.159419.log.gz 2023-07-14T11:20:35.435 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167721.log 2023-07-14T11:20:35.436 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.167232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168453.log 2023-07-14T11:20:35.437 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.167232.log.gz 2023-07-14T11:20:35.437 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.167721.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.167721.log.gz 2023-07-14T11:20:35.438 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177243.log 2023-07-14T11:20:35.439 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.168453.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.168453.log.gz 2023-07-14T11:20:35.439 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171364.log 2023-07-14T11:20:35.440 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.177243.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.177243.log.gz 2023-07-14T11:20:35.440 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181111.log 2023-07-14T11:20:35.441 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.171364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149380.log 2023-07-14T11:20:35.441 INFO:teuthology.orchestra.run.smithi084.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.171364.log.gz 2023-07-14T11:20:35.442 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.181111.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.181111.log.gz 2023-07-14T11:20:35.442 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171070.log 2023-07-14T11:20:35.443 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.149380.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.149380.log.gz 2023-07-14T11:20:35.443 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175934.log 2023-07-14T11:20:35.444 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.171070.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.171070.log.gz 2023-07-14T11:20:35.445 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159008.log 2023-07-14T11:20:35.445 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.175934.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.175934.log.gz 2023-07-14T11:20:35.446 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169202.log 2023-07-14T11:20:35.447 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.159008.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.159008.log.gz 2023-07-14T11:20:35.447 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152604.log 2023-07-14T11:20:35.448 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.169202.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.169202.log.gz 2023-07-14T11:20:35.448 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176492.log 2023-07-14T11:20:35.449 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.152604.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.152604.log.gz 2023-07-14T11:20:35.449 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160004.log 2023-07-14T11:20:35.450 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.176492.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.176492.log.gz 2023-07-14T11:20:35.450 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163831.log 2023-07-14T11:20:35.451 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.160004.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.160004.log.gz 2023-07-14T11:20:35.452 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163003.log 2023-07-14T11:20:35.452 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.163831.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.163831.log.gz 2023-07-14T11:20:35.453 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170050.log 2023-07-14T11:20:35.453 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.163003.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.163003.log.gz 2023-07-14T11:20:35.454 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176591.log 2023-07-14T11:20:35.454 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.170050.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.170050.log.gz 2023-07-14T11:20:35.455 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172374.log 2023-07-14T11:20:35.456 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.176591.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.176591.log.gz 2023-07-14T11:20:35.456 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154606.log 2023-07-14T11:20:35.457 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.172374.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.172374.log.gz 2023-07-14T11:20:35.458 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155194.log 2023-07-14T11:20:35.458 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.154606.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.154606.log.gz 2023-07-14T11:20:35.459 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179445.log 2023-07-14T11:20:35.459 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.155194.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.155194.log.gz 2023-07-14T11:20:35.460 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156423.log 2023-07-14T11:20:35.461 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.179445.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.179445.log.gz 2023-07-14T11:20:35.461 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152751.log 2023-07-14T11:20:35.462 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.156423.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.156423.log.gz 2023-07-14T11:20:35.462 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158349.log 2023-07-14T11:20:35.463 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.152751.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.152751.log.gz 2023-07-14T11:20:35.464 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171413.log 2023-07-14T11:20:35.464 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.158349.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.158349.log.gz 2023-07-14T11:20:35.465 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180301.log 2023-07-14T11:20:35.465 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.171413.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.171413.log.gz 2023-07-14T11:20:35.466 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156743.log 2023-07-14T11:20:35.467 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.180301.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.180301.log.gz 2023-07-14T11:20:35.467 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174685.log 2023-07-14T11:20:35.468 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.156743.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.156743.log.gz 2023-07-14T11:20:35.468 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180350.log 2023-07-14T11:20:35.469 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.174685.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.174685.log.gz 2023-07-14T11:20:35.470 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180203.log 2023-07-14T11:20:35.470 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.180350.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.180350.log.gz 2023-07-14T11:20:35.471 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158959.log 2023-07-14T11:20:35.472 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.180203.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.180203.log.gz 2023-07-14T11:20:35.472 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158398.log 2023-07-14T11:20:35.473 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.158959.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.158959.log.gz 2023-07-14T11:20:35.474 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155921.log 2023-07-14T11:20:35.474 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.158398.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.158398.log.gz 2023-07-14T11:20:35.475 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162180.log 2023-07-14T11:20:35.476 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.155921.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.155921.log.gz 2023-07-14T11:20:35.476 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-07-14T11:20:35.477 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.162180.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.162180.log.gz 2023-07-14T11:20:35.478 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168551.log 2023-07-14T11:20:35.478 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153094.log 2023-07-14T11:20:35.479 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.168551.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.168551.log.gz 2023-07-14T11:20:35.480 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181160.log 2023-07-14T11:20:35.481 INFO:teuthology.orchestra.run.smithi084.stderr: 89.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-07-14T11:20:35.481 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.153094.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.153094.log.gz 2023-07-14T11:20:35.482 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176179.log 2023-07-14T11:20:35.482 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.181160.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.181160.log.gz 2023-07-14T11:20:35.483 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162131.log 2023-07-14T11:20:35.483 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.176179.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.176179.log.gz 2023-07-14T11:20:35.484 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179249.log 2023-07-14T11:20:35.484 INFO:teuthology.orchestra.run.smithi179.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-07-14T11:20:35.485 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.162131.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.162131.log.gz 2023-07-14T11:20:35.485 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179032.log 2023-07-14T11:20:35.486 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.179249.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.179249.log.gz 2023-07-14T11:20:35.486 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154134.log 2023-07-14T11:20:35.487 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.179032.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.179032.log.gz 2023-07-14T11:20:35.488 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169055.log 2023-07-14T11:20:35.488 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.154134.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.154134.log.gz 2023-07-14T11:20:35.489 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163155.log 2023-07-14T11:20:35.490 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.169055.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.169055.log.gz 2023-07-14T11:20:35.490 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150333.log 2023-07-14T11:20:35.491 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.163155.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.163155.log.gz 2023-07-14T11:20:35.492 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175028.log 2023-07-14T11:20:35.492 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.150333.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.150333.log.gz 2023-07-14T11:20:35.493 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171266.log 2023-07-14T11:20:35.494 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.175028.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.175028.log.gz 2023-07-14T11:20:35.494 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179740.log 2023-07-14T11:20:35.495 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.171266.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.171266.log.gz 2023-07-14T11:20:35.495 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176689.log 2023-07-14T11:20:35.496 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.179740.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.179740.log.gz 2023-07-14T11:20:35.497 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159222.log 2023-07-14T11:20:35.497 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.176689.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.176689.log.gz 2023-07-14T11:20:35.498 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165771.log 2023-07-14T11:20:35.499 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.159222.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.159222.log.gz 2023-07-14T11:20:35.499 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163559.log 2023-07-14T11:20:35.500 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.165771.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.165771.log.gz 2023-07-14T11:20:35.501 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151395.log 2023-07-14T11:20:35.502 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.163559.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.163559.log.gz 2023-07-14T11:20:35.502 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150186.log 2023-07-14T11:20:35.503 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.151395.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.151395.log.gz 2023-07-14T11:20:35.504 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181062.log 2023-07-14T11:20:35.504 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.150186.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.150186.log.gz 2023-07-14T11:20:35.505 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157392.log 2023-07-14T11:20:35.505 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.181062.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.181062.log.gz 2023-07-14T11:20:35.506 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170099.log 2023-07-14T11:20:35.507 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.157392.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.157392.log.gz 2023-07-14T11:20:35.507 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160508.log 2023-07-14T11:20:35.508 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.170099.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.170099.log.gz 2023-07-14T11:20:35.508 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176376.log 2023-07-14T11:20:35.509 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.160508.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.160508.log.gz 2023-07-14T11:20:35.510 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161789.log 2023-07-14T11:20:35.510 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.176376.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.176376.log.gz 2023-07-14T11:20:35.511 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177649.log 2023-07-14T11:20:35.511 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.161789.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.161789.log.gz 2023-07-14T11:20:35.512 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176032.log 2023-07-14T11:20:35.513 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.177649.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.177649.log.gz 2023-07-14T11:20:35.514 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152555.log 2023-07-14T11:20:35.515 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.176032.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.176032.log.gz 2023-07-14T11:20:35.515 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157958.log 2023-07-14T11:20:35.516 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.152555.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.152555.log.gz 2023-07-14T11:20:35.516 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167963.log 2023-07-14T11:20:35.517 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.157958.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.157958.log.gz 2023-07-14T11:20:35.517 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168600.log 2023-07-14T11:20:35.518 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.167963.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.167963.log.gz 2023-07-14T11:20:35.519 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169805.log 2023-07-14T11:20:35.519 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.168600.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.168600.log.gz 2023-07-14T11:20:35.520 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149369.log 2023-07-14T11:20:35.521 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.169805.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.169805.log.gz 2023-07-14T11:20:35.521 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155243.log 2023-07-14T11:20:35.521 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.149369.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.149369.log.gz 2023-07-14T11:20:35.522 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173004.log 2023-07-14T11:20:35.523 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.155243.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.155243.log.gz 2023-07-14T11:20:35.523 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176326.log 2023-07-14T11:20:35.524 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.173004.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.173004.log.gz 2023-07-14T11:20:35.524 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182073.log 2023-07-14T11:20:35.525 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.176326.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.176326.log.gz 2023-07-14T11:20:35.526 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158105.log 2023-07-14T11:20:35.526 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.182073.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.182073.log.gz 2023-07-14T11:20:35.527 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172587.log 2023-07-14T11:20:35.527 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.158105.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.158105.log.gz 2023-07-14T11:20:35.528 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170229.log 2023-07-14T11:20:35.528 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.172587.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.172587.log.gz 2023-07-14T11:20:35.529 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.151116.log 2023-07-14T11:20:35.530 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.170229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176081.log 2023-07-14T11:20:35.530 INFO:teuthology.orchestra.run.smithi084.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.170229.log.gz 2023-07-14T11:20:35.531 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.0.151116.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.151116.log.gz 2023-07-14T11:20:35.531 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159106.log 2023-07-14T11:20:35.532 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.176081.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.176081.log.gz 2023-07-14T11:20:35.533 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154330.log 2023-07-14T11:20:35.533 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.159106.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.159106.log.gz 2023-07-14T11:20:35.534 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153628.log 2023-07-14T11:20:35.535 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.154330.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.154330.log.gz 2023-07-14T11:20:35.535 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165379.log 2023-07-14T11:20:35.536 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.153628.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.153628.log.gz 2023-07-14T11:20:35.536 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-07-14T11:20:35.537 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.165379.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.165379.log.gz 2023-07-14T11:20:35.538 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157650.log 2023-07-14T11:20:35.539 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153045.log 2023-07-14T11:20:35.540 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.157650.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.157650.log.gz 2023-07-14T11:20:35.540 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163978.log 2023-07-14T11:20:35.541 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.153045.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.153045.log.gz 2023-07-14T11:20:35.542 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167525.log 2023-07-14T11:20:35.543 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.163978.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.163978.log.gz 2023-07-14T11:20:35.543 INFO:teuthology.orchestra.run.smithi084.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-07-14T11:20:35.543 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179691.log 2023-07-14T11:20:35.544 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.167525.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.167525.log.gz 2023-07-14T11:20:35.545 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148604.log 2023-07-14T11:20:35.546 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.179691.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.179691.log.gz 2023-07-14T11:20:35.546 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178812.log 2023-07-14T11:20:35.547 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.148604.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.148604.log.gz 2023-07-14T11:20:35.547 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162415.log 2023-07-14T11:20:35.548 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.178812.log: 88.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.178812.log.gz-5 2023-07-14T11:20:35.549 INFO:teuthology.orchestra.run.smithi084.stderr:--verbose -- /var/log/ceph/ceph-client.admin.179130.log 2023-07-14T11:20:35.549 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.162415.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.162415.log.gz 2023-07-14T11:20:35.550 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170682.log 2023-07-14T11:20:35.551 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.179130.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.179130.log.gz 2023-07-14T11:20:35.551 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148226.log 2023-07-14T11:20:35.552 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.170682.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.170682.log.gz 2023-07-14T11:20:35.552 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164174.log 2023-07-14T11:20:35.553 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.148226.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.148226.log.gz 2023-07-14T11:20:35.553 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153530.log 2023-07-14T11:20:35.554 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.164174.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.164174.log.gz 2023-07-14T11:20:35.554 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170829.log 2023-07-14T11:20:35.555 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.153530.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.153530.log.gz 2023-07-14T11:20:35.555 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153921.log 2023-07-14T11:20:35.556 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.170829.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.170829.log.gz 2023-07-14T11:20:35.556 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173889.log 2023-07-14T11:20:35.557 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.153921.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.153921.log.gz 2023-07-14T11:20:35.558 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182026.log 2023-07-14T11:20:35.558 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.173889.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.173889.log.gz 2023-07-14T11:20:35.559 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-07-14T11:20:35.560 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.182026.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.182026.log.gz 2023-07-14T11:20:35.560 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154183.log 2023-07-14T11:20:35.561 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154655.log 2023-07-14T11:20:35.562 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.154183.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.154183.log.gz 2023-07-14T11:20:35.562 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177747.log 2023-07-14T11:20:35.563 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.154655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150431.log 2023-07-14T11:20:35.564 INFO:teuthology.orchestra.run.smithi084.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.154655.log.gz 2023-07-14T11:20:35.564 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.177747.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.177747.log.gz 2023-07-14T11:20:35.565 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164223.log 2023-07-14T11:20:35.566 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.150431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178763.log 2023-07-14T11:20:35.567 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.164223.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.150431.log.gz 2023-07-14T11:20:35.567 INFO:teuthology.orchestra.run.smithi084.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.164223.log.gz 2023-07-14T11:20:35.568 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172709.log 2023-07-14T11:20:35.569 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.178763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147585.log 2023-07-14T11:20:35.569 INFO:teuthology.orchestra.run.smithi084.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.178763.log.gz 2023-07-14T11:20:35.570 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.172709.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.172709.log.gz 2023-07-14T11:20:35.570 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168061.log 2023-07-14T11:20:35.572 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.147585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165277.log 2023-07-14T11:20:35.572 INFO:teuthology.orchestra.run.smithi084.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.147585.log.gz 2023-07-14T11:20:35.573 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.168061.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.168061.log.gz 2023-07-14T11:20:35.573 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180154.log 2023-07-14T11:20:35.575 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.165277.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.165277.log.gz 2023-07-14T11:20:35.575 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153774.log 2023-07-14T11:20:35.576 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.180154.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.180154.log.gz 2023-07-14T11:20:35.576 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147201.log 2023-07-14T11:20:35.577 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.153774.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.153774.log.gz 2023-07-14T11:20:35.578 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148596.log 2023-07-14T11:20:35.579 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.147201.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.147201.log.gz 2023-07-14T11:20:35.579 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147634.log 2023-07-14T11:20:35.580 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.148596.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.148596.log.gz 2023-07-14T11:20:35.581 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147437.log 2023-07-14T11:20:35.582 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.147634.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.147634.log.gz 2023-07-14T11:20:35.582 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156374.log 2023-07-14T11:20:35.583 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.147437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166728.log 2023-07-14T11:20:35.584 INFO:teuthology.orchestra.run.smithi084.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.147437.log.gz 2023-07-14T11:20:35.585 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.156374.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.156374.log.gz 2023-07-14T11:20:35.585 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171119.log 2023-07-14T11:20:35.586 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.166728.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.166728.log.gz 2023-07-14T11:20:35.587 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180252.log 2023-07-14T11:20:35.588 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.171119.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.171119.log.gz 2023-07-14T11:20:35.588 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154900.log 2023-07-14T11:20:35.589 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.180252.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.180252.log.gz 2023-07-14T11:20:35.590 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181013.log 2023-07-14T11:20:35.591 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.154900.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.154900.log.gz 2023-07-14T11:20:35.591 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156217.log 2023-07-14T11:20:35.592 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.181013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179494.log 2023-07-14T11:20:35.593 INFO:teuthology.orchestra.run.smithi084.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.181013.log.gz 2023-07-14T11:20:35.594 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.156217.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.156217.log.gz 2023-07-14T11:20:35.595 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158861.log 2023-07-14T11:20:35.595 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.179494.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.179494.log.gz 2023-07-14T11:20:35.595 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152653.log 2023-07-14T11:20:35.596 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.158861.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.158861.log.gz 2023-07-14T11:20:35.597 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169707.log 2023-07-14T11:20:35.598 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.152653.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.152653.log.gz 2023-07-14T11:20:35.599 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175983.log 2023-07-14T11:20:35.600 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.169707.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.169707.log.gz 2023-07-14T11:20:35.600 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177598.log 2023-07-14T11:20:35.601 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.175983.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.175983.log.gz 2023-07-14T11:20:35.602 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.151868.log 2023-07-14T11:20:35.603 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.177598.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.177598.log.gz 2023-07-14T11:20:35.603 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169251.log 2023-07-14T11:20:35.604 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.2.151868.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.151868.log.gz 2023-07-14T11:20:35.604 INFO:teuthology.orchestra.run.smithi179.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-07-14T11:20:35.605 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176130.log 2023-07-14T11:20:35.606 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.169251.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.169251.log.gz 2023-07-14T11:20:35.606 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161642.log 2023-07-14T11:20:35.607 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.176130.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.176130.log.gz 2023-07-14T11:20:35.608 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172759.log 2023-07-14T11:20:35.608 INFO:teuthology.orchestra.run.smithi179.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-07-14T11:20:35.609 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.161642.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.161642.log.gz 2023-07-14T11:20:35.609 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156792.log 2023-07-14T11:20:35.611 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.172759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153241.log 2023-07-14T11:20:35.611 INFO:teuthology.orchestra.run.smithi084.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.172759.log.gz 2023-07-14T11:20:35.612 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.156792.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.156792.log.gz 2023-07-14T11:20:35.613 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179298.log 2023-07-14T11:20:35.613 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.153241.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.153241.log.gz 2023-07-14T11:20:35.614 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154949.log 2023-07-14T11:20:35.615 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.179298.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.179298.log.gz 2023-07-14T11:20:35.616 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173483.log 2023-07-14T11:20:35.616 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.154949.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.154949.log.gz 2023-07-14T11:20:35.617 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160261.log 2023-07-14T11:20:35.618 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.173483.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.173483.log.gz 2023-07-14T11:20:35.619 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152359.log 2023-07-14T11:20:35.620 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.160261.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.160261.log.gz 2023-07-14T11:20:35.620 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173434.log 2023-07-14T11:20:35.621 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.152359.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.152359.log.gz 2023-07-14T11:20:35.622 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179838.log 2023-07-14T11:20:35.623 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.173434.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.173434.log.gz 2023-07-14T11:20:35.623 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148989.log 2023-07-14T11:20:35.624 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.179838.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.179838.log.gz 2023-07-14T11:20:35.625 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169300.log 2023-07-14T11:20:35.626 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.148989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175293.log 2023-07-14T11:20:35.626 INFO:teuthology.orchestra.run.smithi084.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.148989.log.gz 2023-07-14T11:20:35.627 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.169300.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.169300.log.gz 2023-07-14T11:20:35.628 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154998.log 2023-07-14T11:20:35.628 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.175293.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.175293.log.gz 2023-07-14T11:20:35.629 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170001.log 2023-07-14T11:20:35.630 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.154998.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.154998.log.gz 2023-07-14T11:20:35.631 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158763.log 2023-07-14T11:20:35.632 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.170001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173938.log 2023-07-14T11:20:35.632 INFO:teuthology.orchestra.run.smithi084.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.170001.log.gz 2023-07-14T11:20:35.633 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.158763.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.158763.log.gz 2023-07-14T11:20:35.633 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160310.log 2023-07-14T11:20:35.634 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.173938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172857.log 2023-07-14T11:20:35.635 INFO:teuthology.orchestra.run.smithi084.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.173938.log.gz 2023-07-14T11:20:35.636 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.160310.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.160310.log.gz 2023-07-14T11:20:35.636 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177943.log 2023-07-14T11:20:35.637 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.172857.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.172857.log.gz 2023-07-14T11:20:35.638 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169903.log 2023-07-14T11:20:35.639 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.177943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166777.log 2023-07-14T11:20:35.639 INFO:teuthology.orchestra.run.smithi084.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.177943.log.gz 2023-07-14T11:20:35.640 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.169903.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.169903.log.gz 2023-07-14T11:20:35.641 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165624.log 2023-07-14T11:20:35.642 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.166777.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.166777.log.gz 2023-07-14T11:20:35.643 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147144.log 2023-07-14T11:20:35.643 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.165624.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.165624.log.gz 2023-07-14T11:20:35.644 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164496.log 2023-07-14T11:20:35.645 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.147144.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.147144.log.gz 2023-07-14T11:20:35.645 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148324.log 2023-07-14T11:20:35.646 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.164496.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.164496.log.gz 2023-07-14T11:20:35.647 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168257.log 2023-07-14T11:20:35.648 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.148324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173789.log 2023-07-14T11:20:35.648 INFO:teuthology.orchestra.run.smithi084.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.148324.log.gz 2023-07-14T11:20:35.649 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.168257.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.168257.log.gz 2023-07-14T11:20:35.649 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155341.log 2023-07-14T11:20:35.650 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.173789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164076.log 2023-07-14T11:20:35.651 INFO:teuthology.orchestra.run.smithi084.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.173789.log.gz 2023-07-14T11:20:35.651 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.155341.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.155341.log.gz 2023-07-14T11:20:35.652 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164125.log 2023-07-14T11:20:35.653 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.164076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148977.log 2023-07-14T11:20:35.653 INFO:teuthology.orchestra.run.smithi084.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.164076.log.gz 2023-07-14T11:20:35.654 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.164125.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.164125.log.gz 2023-07-14T11:20:35.654 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157587.log 2023-07-14T11:20:35.655 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.148977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156914.log 2023-07-14T11:20:35.656 INFO:teuthology.orchestra.run.smithi084.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.148977.log.gz 2023-07-14T11:20:35.657 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.157587.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.157587.log.gz 2023-07-14T11:20:35.657 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181699.log 2023-07-14T11:20:35.658 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.156914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175537.log 2023-07-14T11:20:35.658 INFO:teuthology.orchestra.run.smithi084.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.156914.log.gz 2023-07-14T11:20:35.659 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.181699.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.181699.log.gz 2023-07-14T11:20:35.660 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152212.log 2023-07-14T11:20:35.660 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.175537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146952.log 2023-07-14T11:20:35.661 INFO:teuthology.orchestra.run.smithi084.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.175537.log.gz 2023-07-14T11:20:35.661 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.152212.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.152212.log.gz 2023-07-14T11:20:35.662 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181748.log 2023-07-14T11:20:35.663 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.146952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155390.log 2023-07-14T11:20:35.664 INFO:teuthology.orchestra.run.smithi084.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.146952.log.gz 2023-07-14T11:20:35.664 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.181748.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.181748.log.gz 2023-07-14T11:20:35.665 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171020.log 2023-07-14T11:20:35.666 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.155390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165869.log 2023-07-14T11:20:35.666 INFO:teuthology.orchestra.run.smithi084.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.155390.log.gz 2023-07-14T11:20:35.667 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.171020.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.171020.log.gz 2023-07-14T11:20:35.667 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161500.log 2023-07-14T11:20:35.668 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.165869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154802.log 2023-07-14T11:20:35.669 INFO:teuthology.orchestra.run.smithi084.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.165869.log.gz 2023-07-14T11:20:35.669 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.161500.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.161500.log.gz 2023-07-14T11:20:35.670 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163407.log 2023-07-14T11:20:35.671 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.154802.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.154802.log.gz 2023-07-14T11:20:35.671 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149388.log 2023-07-14T11:20:35.672 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.163407.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.163407.log.gz 2023-07-14T11:20:35.673 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163880.log 2023-07-14T11:20:35.674 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.149388.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.149388.log.gz 2023-07-14T11:20:35.674 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163307.log 2023-07-14T11:20:35.675 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.163880.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.163880.log.gz 2023-07-14T11:20:35.676 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148603.log 2023-07-14T11:20:35.677 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.163307.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.163307.log.gz 2023-07-14T11:20:35.678 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174183.log 2023-07-14T11:20:35.679 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.148603.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.148603.log.gz 2023-07-14T11:20:35.679 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172427.log 2023-07-14T11:20:35.680 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.174183.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.174183.log.gz 2023-07-14T11:20:35.681 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177796.log 2023-07-14T11:20:35.682 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.172427.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.172427.log.gz 2023-07-14T11:20:35.682 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169608.log 2023-07-14T11:20:35.683 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.177796.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.177796.log.gz 2023-07-14T11:20:35.684 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155047.log 2023-07-14T11:20:35.685 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.169608.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.169608.log.gz 2023-07-14T11:20:35.685 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158545.log 2023-07-14T11:20:35.686 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.155047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157343.log 2023-07-14T11:20:35.687 INFO:teuthology.orchestra.run.smithi084.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.155047.log.gz 2023-07-14T11:20:35.688 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.158545.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.158545.log.gz 2023-07-14T11:20:35.688 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181209.log 2023-07-14T11:20:35.689 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.157343.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.157343.log.gz 2023-07-14T11:20:35.690 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169104.log 2023-07-14T11:20:35.691 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.181209.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.181209.log.gz 2023-07-14T11:20:35.691 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152702.log 2023-07-14T11:20:35.692 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.169104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165575.log 2023-07-14T11:20:35.693 INFO:teuthology.orchestra.run.smithi084.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.169104.log.gz 2023-07-14T11:20:35.694 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.152702.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.152702.log.gz 2023-07-14T11:20:35.694 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175342.log 2023-07-14T11:20:35.695 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.165575.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.165575.log.gz 2023-07-14T11:20:35.695 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179909.log 2023-07-14T11:20:35.696 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.175342.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.175342.log.gz 2023-07-14T11:20:35.697 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.174565.log 2023-07-14T11:20:35.698 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.179909.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.179909.log.gz 2023-07-14T11:20:35.699 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161838.log 2023-07-14T11:20:35.699 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.0.174565.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.174565.log.gz 2023-07-14T11:20:35.700 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158447.log 2023-07-14T11:20:35.701 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.161838.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.161838.log.gz 2023-07-14T11:20:35.701 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176640.log 2023-07-14T11:20:35.702 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.158447.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.158447.log.gz 2023-07-14T11:20:35.703 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172906.log 2023-07-14T11:20:35.704 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.176640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178041.log 2023-07-14T11:20:35.705 INFO:teuthology.orchestra.run.smithi084.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.176640.log.gz 2023-07-14T11:20:35.705 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.172906.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.172906.log.gz 2023-07-14T11:20:35.706 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158812.log 2023-07-14T11:20:35.707 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.178041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158007.log 2023-07-14T11:20:35.707 INFO:teuthology.orchestra.run.smithi084.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.178041.log.gz 2023-07-14T11:20:35.708 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.158812.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.158812.log.gz 2023-07-14T11:20:35.708 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153432.log 2023-07-14T11:20:35.710 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.158007.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.158007.log.gz 2023-07-14T11:20:35.710 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167672.log 2023-07-14T11:20:35.710 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.153432.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.153432.log.gz 2023-07-14T11:20:35.711 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158056.log 2023-07-14T11:20:35.712 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.167672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153725.log 2023-07-14T11:20:35.713 INFO:teuthology.orchestra.run.smithi084.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.167672.log.gz 2023-07-14T11:20:35.713 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.158056.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.158056.log.gz 2023-07-14T11:20:35.714 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164447.log 2023-07-14T11:20:35.715 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.153725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162229.log 2023-07-14T11:20:35.716 INFO:teuthology.orchestra.run.smithi084.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.153725.log.gz 2023-07-14T11:20:35.716 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.164447.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.164447.log.gz 2023-07-14T11:20:35.717 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170731.log 2023-07-14T11:20:35.718 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.162229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167281.log 2023-07-14T11:20:35.718 INFO:teuthology.orchestra.run.smithi084.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.162229.log.gz 2023-07-14T11:20:35.719 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.170731.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.170731.log.gz 2023-07-14T11:20:35.720 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161691.log 2023-07-14T11:20:35.721 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.167281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166371.log 2023-07-14T11:20:35.721 INFO:teuthology.orchestra.run.smithi084.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.167281.log.gz 2023-07-14T11:20:35.722 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.161691.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.161691.log.gz 2023-07-14T11:20:35.722 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168012.log 2023-07-14T11:20:35.724 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.166371.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.166371.log.gz 2023-07-14T11:20:35.724 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181356.log 2023-07-14T11:20:35.725 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.168012.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.168012.log.gz 2023-07-14T11:20:35.725 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181552.log 2023-07-14T11:20:35.727 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.181356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150088.log 2023-07-14T11:20:35.727 INFO:teuthology.orchestra.run.smithi084.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.181356.log.gz 2023-07-14T11:20:35.728 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.181552.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.181552.log.gz 2023-07-14T11:20:35.728 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165526.log 2023-07-14T11:20:35.729 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.150088.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.150088.log.gz 2023-07-14T11:20:35.730 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174832.log 2023-07-14T11:20:35.731 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.165526.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.165526.log.gz 2023-07-14T11:20:35.731 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157838.log 2023-07-14T11:20:35.732 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.174832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159872.log 2023-07-14T11:20:35.733 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.174832.log.gz 2023-07-14T11:20:35.733 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.157838.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.157838.log.gz 2023-07-14T11:20:35.734 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173385.log 2023-07-14T11:20:35.735 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.159872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165722.log 2023-07-14T11:20:35.736 INFO:teuthology.orchestra.run.smithi084.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.159872.log.gz 2023-07-14T11:20:35.736 INFO:teuthology.orchestra.run.smithi179.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-07-14T11:20:35.737 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.173385.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.173385.log.gz 2023-07-14T11:20:35.737 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178139.log 2023-07-14T11:20:35.738 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.165722.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.165722.log.gz 2023-07-14T11:20:35.738 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160704.log 2023-07-14T11:20:35.739 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.178139.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.178139.log.gz 2023-07-14T11:20:35.740 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180963.log 2023-07-14T11:20:35.741 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.160704.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.160704.log.gz 2023-07-14T11:20:35.741 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160361.log 2023-07-14T11:20:35.742 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.180963.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.180963.log.gz 2023-07-14T11:20:35.743 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141311.log 2023-07-14T11:20:35.744 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.160361.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.160361.log.gz 2023-07-14T11:20:35.744 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155725.log 2023-07-14T11:20:35.745 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.141311.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.141311.log.gz 2023-07-14T11:20:35.745 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175782.log 2023-07-14T11:20:35.747 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.155725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172532.log 2023-07-14T11:20:35.747 INFO:teuthology.orchestra.run.smithi084.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.155725.log.gz 2023-07-14T11:20:35.748 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.175782.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.175782.log.gz 2023-07-14T11:20:35.748 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177443.log 2023-07-14T11:20:35.750 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.172532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165428.log 2023-07-14T11:20:35.750 INFO:teuthology.orchestra.run.smithi084.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.172532.log.gz 2023-07-14T11:20:35.751 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.177443.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.177443.log.gz 2023-07-14T11:20:35.751 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148030.log 2023-07-14T11:20:35.753 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.165428.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.165428.log.gz 2023-07-14T11:20:35.753 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148275.log 2023-07-14T11:20:35.754 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.148030.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.148030.log.gz 2023-07-14T11:20:35.754 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148984.log 2023-07-14T11:20:35.755 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.148275.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.148275.log.gz 2023-07-14T11:20:35.756 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173581.log 2023-07-14T11:20:35.757 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.148984.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.148984.log.gz 2023-07-14T11:20:35.757 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158910.log 2023-07-14T11:20:35.759 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.173581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163079.log 2023-07-14T11:20:35.759 INFO:teuthology.orchestra.run.smithi084.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.173581.log.gz 2023-07-14T11:20:35.760 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.158910.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.158910.log.gz 2023-07-14T11:20:35.760 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176908.log 2023-07-14T11:20:35.761 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.163079.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.163079.log.gz 2023-07-14T11:20:35.762 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149745.log 2023-07-14T11:20:35.763 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.176908.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.176908.log.gz 2023-07-14T11:20:35.763 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175586.log 2023-07-14T11:20:35.764 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.149745.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.149745.log.gz 2023-07-14T11:20:35.765 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181927.log 2023-07-14T11:20:35.765 INFO:teuthology.orchestra.run.smithi179.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-07-14T11:20:35.766 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.175586.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.175586.log.gz 2023-07-14T11:20:35.766 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148079.log 2023-07-14T11:20:35.767 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.181927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177392.log 2023-07-14T11:20:35.768 INFO:teuthology.orchestra.run.smithi084.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.181927.log.gz 2023-07-14T11:20:35.768 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.148079.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.148079.log.gz 2023-07-14T11:20:35.769 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182122.log 2023-07-14T11:20:35.770 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.177392.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.177392.log.gz 2023-07-14T11:20:35.771 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180515.log 2023-07-14T11:20:35.772 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.182122.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.182122.log.gz 2023-07-14T11:20:35.773 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160204.log 2023-07-14T11:20:35.774 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.180515.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.180515.log.gz 2023-07-14T11:20:35.774 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179081.log 2023-07-14T11:20:35.775 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.160204.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.160204.log.gz 2023-07-14T11:20:35.776 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172267.log 2023-07-14T11:20:35.777 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.179081.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.179081.log.gz 2023-07-14T11:20:35.777 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155872.log 2023-07-14T11:20:35.778 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.172267.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.172267.log.gz 2023-07-14T11:20:35.779 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156019.log 2023-07-14T11:20:35.780 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.155872.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.155872.log.gz 2023-07-14T11:20:35.781 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154704.log 2023-07-14T11:20:35.781 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.156019.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.156019.log.gz 2023-07-14T11:20:35.782 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165673.log 2023-07-14T11:20:35.783 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.154704.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.154704.log.gz 2023-07-14T11:20:35.783 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168698.log 2023-07-14T11:20:35.784 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.165673.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.165673.log.gz 2023-07-14T11:20:35.785 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169349.log 2023-07-14T11:20:35.786 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.168698.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.168698.log.gz 2023-07-14T11:20:35.787 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149265.log 2023-07-14T11:20:35.787 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.169349.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.169349.log.gz 2023-07-14T11:20:35.788 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160949.log 2023-07-14T11:20:35.789 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.149265.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.149265.log.gz 2023-07-14T11:20:35.790 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163231.log 2023-07-14T11:20:35.791 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.160949.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.160949.log.gz 2023-07-14T11:20:35.791 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148373.log 2023-07-14T11:20:35.792 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.163231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176788.log 2023-07-14T11:20:35.793 INFO:teuthology.orchestra.run.smithi084.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.163231.log.gz 2023-07-14T11:20:35.793 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.148373.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.148373.log.gz 2023-07-14T11:20:35.794 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172111.log 2023-07-14T11:20:35.795 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.176788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162743.log 2023-07-14T11:20:35.795 INFO:teuthology.orchestra.run.smithi084.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.176788.log.gz 2023-07-14T11:20:35.796 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.172111.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.172111.log.gz 2023-07-14T11:20:35.797 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167890.log 2023-07-14T11:20:35.798 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.162743.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.162743.log.gz 2023-07-14T11:20:35.798 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-07-14T11:20:35.799 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.167890.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.167890.log.gz 2023-07-14T11:20:35.800 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-07-14T11:20:35.801 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178090.log 2023-07-14T11:20:35.803 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156841.log 2023-07-14T11:20:35.804 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.178090.log: 92.6% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-07-14T11:20:35.804 INFO:teuthology.orchestra.run.smithi084.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.178090.log.gz 2023-07-14T11:20:35.805 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164594.log 2023-07-14T11:20:35.806 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.156841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161451.log 2023-07-14T11:20:35.807 INFO:teuthology.orchestra.run.smithi084.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.156841.log.gz 2023-07-14T11:20:35.808 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.164594.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.164594.log.gz 2023-07-14T11:20:35.808 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152506.log 2023-07-14T11:20:35.809 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.161451.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.161451.log.gz 2023-07-14T11:20:35.810 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156325.log 2023-07-14T11:20:35.811 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.152506.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.152506.log.gz 2023-07-14T11:20:35.811 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172808.log 2023-07-14T11:20:35.813 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.156325.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.156325.log.gz 2023-07-14T11:20:35.813 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167330.log 2023-07-14T11:20:35.814 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.172808.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.172808.log.gz 2023-07-14T11:20:35.815 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148593.log 2023-07-14T11:20:35.816 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.167330.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.167330.log.gz 2023-07-14T11:20:35.816 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165228.log 2023-07-14T11:20:35.817 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.148593.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.148593.log.gz 2023-07-14T11:20:35.818 INFO:teuthology.orchestra.run.smithi084.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-07-14T11:20:35.818 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181601.log 2023-07-14T11:20:35.819 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.165228.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.165228.log.gz 2023-07-14T11:20:35.819 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160606.log 2023-07-14T11:20:35.820 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.181601.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.181601.log.gz 2023-07-14T11:20:35.821 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174305.log 2023-07-14T11:20:35.822 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.160606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162491.log 2023-07-14T11:20:35.822 INFO:teuthology.orchestra.run.smithi084.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.160606.log.gz 2023-07-14T11:20:35.823 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.174305.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.174305.log.gz 2023-07-14T11:20:35.823 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172056.log 2023-07-14T11:20:35.824 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.162491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180663.log 2023-07-14T11:20:35.825 INFO:teuthology.orchestra.run.smithi084.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.162491.log.gz 2023-07-14T11:20:35.826 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.172056.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.172056.log.gz 2023-07-14T11:20:35.826 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175861.log 2023-07-14T11:20:35.827 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.180663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153970.log 2023-07-14T11:20:35.828 INFO:teuthology.orchestra.run.smithi084.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.180663.log.gz 2023-07-14T11:20:35.828 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.175861.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.175861.log.gz 2023-07-14T11:20:35.829 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-07-14T11:20:35.830 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.153970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174134.log 2023-07-14T11:20:35.830 INFO:teuthology.orchestra.run.smithi084.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.153970.log.gz 2023-07-14T11:20:35.831 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159057.log 2023-07-14T11:20:35.833 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.174134.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.174134.log.gz 2023-07-14T11:20:35.833 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169508.log 2023-07-14T11:20:35.834 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.159057.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.159057.log.gz 2023-07-14T11:20:35.834 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.161282.log 2023-07-14T11:20:35.835 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.169508.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.169508.log.gz 2023-07-14T11:20:35.836 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158665.log 2023-07-14T11:20:35.837 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.0.161282.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.161282.log.gz 2023-07-14T11:20:35.838 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175440.log 2023-07-14T11:20:35.839 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.158665.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.158665.log.gz 2023-07-14T11:20:35.839 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171697.log 2023-07-14T11:20:35.840 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.175440.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.175440.log.gz 2023-07-14T11:20:35.841 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148980.log 2023-07-14T11:20:35.842 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.171697.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.171697.log.gz 2023-07-14T11:20:35.842 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173632.log 2023-07-14T11:20:35.843 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.148980.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.148980.log.gz 2023-07-14T11:20:35.844 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165991.log 2023-07-14T11:20:35.845 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.173632.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.173632.log.gz 2023-07-14T11:20:35.846 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173838.log 2023-07-14T11:20:35.847 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.165991.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.165991.log.gz 2023-07-14T11:20:35.848 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177007.log 2023-07-14T11:20:35.848 INFO:teuthology.orchestra.run.smithi179.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-07-14T11:20:35.849 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.173838.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.173838.log.gz 2023-07-14T11:20:35.849 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177992.log 2023-07-14T11:20:35.850 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.177007.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.177007.log.gz 2023-07-14T11:20:35.851 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173987.log 2023-07-14T11:20:35.852 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.177992.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.177992.log.gz 2023-07-14T11:20:35.852 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159370.log 2023-07-14T11:20:35.853 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.173987.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.173987.log.gz 2023-07-14T11:20:35.854 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162278.log 2023-07-14T11:20:35.855 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.159370.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.159370.log.gz 2023-07-14T11:20:35.855 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176739.log 2023-07-14T11:20:35.857 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.162278.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.162278.log.gz 2023-07-14T11:20:35.857 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174085.log 2023-07-14T11:20:35.858 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.176739.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.176739.log.gz 2023-07-14T11:20:35.858 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153383.log 2023-07-14T11:20:35.860 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.174085.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.174085.log.gz 2023-07-14T11:20:35.860 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178188.log 2023-07-14T11:20:35.861 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.153383.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.153383.log.gz 2023-07-14T11:20:35.862 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166518.log 2023-07-14T11:20:35.863 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.178188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147388.log 2023-07-14T11:20:35.864 INFO:teuthology.orchestra.run.smithi084.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.178188.log.gz 2023-07-14T11:20:35.865 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.166518.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.166518.log.gz 2023-07-14T11:20:35.865 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156268.log 2023-07-14T11:20:35.866 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.147388.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.147388.log.gz 2023-07-14T11:20:35.866 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162354.log 2023-07-14T11:20:35.868 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.156268.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.156268.log.gz 2023-07-14T11:20:35.868 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157724.log 2023-07-14T11:20:35.869 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.162354.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.162354.log.gz 2023-07-14T11:20:35.870 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159155.log 2023-07-14T11:20:35.871 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.157724.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.157724.log.gz 2023-07-14T11:20:35.871 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163483.log 2023-07-14T11:20:35.872 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.159155.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.159155.log.gz 2023-07-14T11:20:35.873 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-07-14T11:20:35.874 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.163483.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.163483.log.gz 2023-07-14T11:20:35.874 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152113.log 2023-07-14T11:20:35.876 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166640.log 2023-07-14T11:20:35.877 INFO:teuthology.orchestra.run.smithi179.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-07-14T11:20:35.877 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.152113.log: 86.3% -- replaced with /var/log/ceph/ceph.log.gz 2023-07-14T11:20:35.878 INFO:teuthology.orchestra.run.smithi084.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.152113.log.gz 2023-07-14T11:20:35.878 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154851.log 2023-07-14T11:20:35.879 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.166640.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.166640.log.gz 2023-07-14T11:20:35.879 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174734.log 2023-07-14T11:20:35.880 INFO:teuthology.orchestra.run.smithi179.stderr: 2023-07-14T11:20:35.880 INFO:teuthology.orchestra.run.smithi179.stderr:real 0m0.615s 2023-07-14T11:20:35.881 INFO:teuthology.orchestra.run.smithi179.stderr:user 0m2.610s 2023-07-14T11:20:35.881 INFO:teuthology.orchestra.run.smithi179.stderr:sys 0m0.355s 2023-07-14T11:20:35.882 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.154851.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.154851.log.gz 2023-07-14T11:20:35.882 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169559.log 2023-07-14T11:20:35.883 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.174734.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.174734.log.gz 2023-07-14T11:20:35.883 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171636.log 2023-07-14T11:20:35.884 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.169559.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.169559.log.gz 2023-07-14T11:20:35.884 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176277.log 2023-07-14T11:20:35.885 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.171636.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.171636.log.gz 2023-07-14T11:20:35.885 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177095.log 2023-07-14T11:20:35.887 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.176277.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.176277.log.gz 2023-07-14T11:20:35.887 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169451.log 2023-07-14T11:20:35.888 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.177095.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.177095.log.gz 2023-07-14T11:20:35.889 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163782.log 2023-07-14T11:20:35.890 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.169451.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.169451.log.gz 2023-07-14T11:20:35.890 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157294.log 2023-07-14T11:20:35.892 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.163782.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.163782.log.gz 2023-07-14T11:20:35.892 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167841.log 2023-07-14T11:20:35.893 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.157294.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.157294.log.gz 2023-07-14T11:20:35.893 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160753.log 2023-07-14T11:20:35.895 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.167841.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.167841.log.gz 2023-07-14T11:20:35.895 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155676.log 2023-07-14T11:20:35.896 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.160753.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.160753.log.gz 2023-07-14T11:20:35.897 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168355.log 2023-07-14T11:20:35.898 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.155676.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.155676.log.gz 2023-07-14T11:20:35.899 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180712.log 2023-07-14T11:20:35.899 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.168355.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.168355.log.gz 2023-07-14T11:20:35.900 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160557.log 2023-07-14T11:20:35.901 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.180712.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.180712.log.gz 2023-07-14T11:20:35.902 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174981.log 2023-07-14T11:20:35.903 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.160557.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.160557.log.gz 2023-07-14T11:20:35.903 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177894.log 2023-07-14T11:20:35.904 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.174981.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.174981.log.gz 2023-07-14T11:20:35.905 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165477.log 2023-07-14T11:20:35.906 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.177894.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.177894.log.gz 2023-07-14T11:20:35.906 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153872.log 2023-07-14T11:20:35.907 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.165477.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.165477.log.gz 2023-07-14T11:20:35.908 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160410.log 2023-07-14T11:20:35.909 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.153872.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.153872.log.gz 2023-07-14T11:20:35.909 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175733.log 2023-07-14T11:20:35.910 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.160410.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.160410.log.gz 2023-07-14T11:20:35.911 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149647.log 2023-07-14T11:20:35.912 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.175733.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.175733.log.gz 2023-07-14T11:20:35.913 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179642.log 2023-07-14T11:20:35.914 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.149647.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.149647.log.gz 2023-07-14T11:20:35.914 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171462.log 2023-07-14T11:20:35.915 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.179642.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.179642.log.gz 2023-07-14T11:20:35.916 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154085.log 2023-07-14T11:20:35.917 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.171462.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.171462.log.gz 2023-07-14T11:20:35.918 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147883.log 2023-07-14T11:20:35.918 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.154085.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.154085.log.gz 2023-07-14T11:20:35.919 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168649.log 2023-07-14T11:20:35.920 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.147883.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.147883.log.gz 2023-07-14T11:20:35.921 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164321.log 2023-07-14T11:20:35.922 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.168649.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.168649.log.gz 2023-07-14T11:20:35.922 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162033.log 2023-07-14T11:20:35.923 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.164321.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.164321.log.gz 2023-07-14T11:20:35.924 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180105.log 2023-07-14T11:20:35.925 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.162033.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.162033.log.gz 2023-07-14T11:20:35.925 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172215.log 2023-07-14T11:20:35.926 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.180105.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.180105.log.gz 2023-07-14T11:20:35.927 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152898.log 2023-07-14T11:20:35.928 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.172215.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.172215.log.gz 2023-07-14T11:20:35.929 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156523.log 2023-07-14T11:20:35.930 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.152898.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.152898.log.gz 2023-07-14T11:20:35.930 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162082.log 2023-07-14T11:20:35.931 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.156523.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.156523.log.gz 2023-07-14T11:20:35.932 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167183.log 2023-07-14T11:20:35.933 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.162082.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.162082.log.gz 2023-07-14T11:20:35.933 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169657.log 2023-07-14T11:20:35.934 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.167183.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.167183.log.gz 2023-07-14T11:20:35.935 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158154.log 2023-07-14T11:20:35.936 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.169657.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.169657.log.gz 2023-07-14T11:20:35.937 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161984.log 2023-07-14T11:20:35.937 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.158154.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.158154.log.gz 2023-07-14T11:20:35.938 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157441.log 2023-07-14T11:20:35.939 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.161984.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.161984.log.gz 2023-07-14T11:20:35.940 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165820.log 2023-07-14T11:20:35.941 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.157441.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.157441.log.gz 2023-07-14T11:20:35.941 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147051.log 2023-07-14T11:20:35.942 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.165820.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.165820.log.gz 2023-07-14T11:20:35.943 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.132944.log 2023-07-14T11:20:35.944 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.147051.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.147051.log.gz 2023-07-14T11:20:35.945 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164812.log 2023-07-14T11:20:35.945 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph.tmp-client.admin.132944.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.132944.log.gz 2023-07-14T11:20:35.946 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153192.log 2023-07-14T11:20:35.947 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.164812.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.164812.log.gz 2023-07-14T11:20:35.948 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148992.log 2023-07-14T11:20:35.949 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.153192.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.153192.log.gz 2023-07-14T11:20:35.949 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174036.log 2023-07-14T11:20:35.950 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.148992.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.148992.log.gz 2023-07-14T11:20:35.951 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181258.log 2023-07-14T11:20:35.952 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.174036.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.174036.log.gz 2023-07-14T11:20:35.978 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166469.log 2023-07-14T11:20:35.978 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2023-07-14T11:20:35.978 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2023-07-14T11:20:35.979 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2023-07-14T11:20:35.982 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.181258.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.181258.log.gz 2023-07-14T11:20:35.983 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177292.log 2023-07-14T11:20:35.983 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.166469.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.166469.log.gz 2023-07-14T11:20:35.983 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179958.log 2023-07-14T11:20:35.983 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.177292.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.177292.log.gz 2023-07-14T11:20:35.983 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148177.log 2023-07-14T11:20:35.984 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.179958.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.179958.log.gz 2023-07-14T11:20:35.984 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155145.log 2023-07-14T11:20:35.984 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.148177.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.148177.log.gz 2023-07-14T11:20:35.984 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154232.log 2023-07-14T11:20:35.984 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.155145.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.155145.log.gz 2023-07-14T11:20:35.985 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169952.log 2023-07-14T11:20:35.985 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.154232.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.154232.log.gz 2023-07-14T11:20:35.985 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164545.log 2023-07-14T11:20:35.985 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.169952.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.169952.log.gz 2023-07-14T11:20:35.985 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177500.log 2023-07-14T11:20:35.986 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.164545.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.164545.log.gz 2023-07-14T11:20:35.986 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160900.log 2023-07-14T11:20:35.986 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.177500.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.177500.log.gz 2023-07-14T11:20:35.986 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.178521.log 2023-07-14T11:20:35.986 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.160900.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.160900.log.gz 2023-07-14T11:20:35.987 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162819.log 2023-07-14T11:20:35.987 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.0.178521.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.178521.log.gz 2023-07-14T11:20:35.987 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156166.log 2023-07-14T11:20:35.987 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.162819.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.162819.log.gz 2023-07-14T11:20:35.987 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171773.log 2023-07-14T11:20:35.988 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.156166.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.156166.log.gz 2023-07-14T11:20:35.988 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152162.log 2023-07-14T11:20:35.988 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.171773.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.171773.log.gz 2023-07-14T11:20:35.988 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149346.log 2023-07-14T11:20:35.988 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.152162.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.152162.log.gz 2023-07-14T11:20:35.989 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148991.log 2023-07-14T11:20:35.989 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.149346.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.149346.log.gz 2023-07-14T11:20:35.989 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154427.log 2023-07-14T11:20:35.989 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.148991.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.148991.log.gz 2023-07-14T11:20:35.989 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160053.log 2023-07-14T11:20:35.990 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.154427.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.154427.log.gz 2023-07-14T11:20:35.991 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170148.log 2023-07-14T11:20:35.992 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.160053.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.160053.log.gz 2023-07-14T11:20:35.992 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178983.log 2023-07-14T11:20:35.992 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.170148.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.170148.log.gz 2023-07-14T11:20:35.992 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158300.log 2023-07-14T11:20:35.992 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.178983.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.178983.log.gz 2023-07-14T11:20:35.993 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147834.log 2023-07-14T11:20:35.993 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.158300.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.158300.log.gz 2023-07-14T11:20:35.993 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140841.log 2023-07-14T11:20:35.993 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.147834.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.147834.log.gz 2023-07-14T11:20:35.993 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148128.log 2023-07-14T11:20:35.994 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.140841.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.140841.log.gz 2023-07-14T11:20:35.994 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164943.log 2023-07-14T11:20:35.995 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.148128.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.148128.log.gz 2023-07-14T11:20:35.995 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174783.log 2023-07-14T11:20:35.995 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.164943.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.164943.log.gz 2023-07-14T11:20:35.996 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173740.log 2023-07-14T11:20:35.997 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.174783.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.174783.log.gz 2023-07-14T11:20:35.997 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172479.log 2023-07-14T11:20:35.998 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.173740.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.173740.log.gz 2023-07-14T11:20:35.999 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176542.log 2023-07-14T11:20:36.000 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.172479.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.172479.log.gz 2023-07-14T11:20:36.000 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147683.log 2023-07-14T11:20:36.001 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.176542.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.176542.log.gz 2023-07-14T11:20:36.002 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153143.log 2023-07-14T11:20:36.003 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.147683.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.147683.log.gz 2023-07-14T11:20:36.004 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161740.log 2023-07-14T11:20:36.004 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.153143.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.153143.log.gz 2023-07-14T11:20:36.005 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169756.log 2023-07-14T11:20:36.006 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.161740.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.161740.log.gz 2023-07-14T11:20:36.007 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181854.log 2023-07-14T11:20:36.008 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.169756.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.169756.log.gz 2023-07-14T11:20:36.009 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150382.log 2023-07-14T11:20:36.009 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.181854.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.181854.log.gz 2023-07-14T11:20:36.010 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161402.log 2023-07-14T11:20:36.011 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.150382.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.150382.log.gz 2023-07-14T11:20:36.012 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181454.log 2023-07-14T11:20:36.013 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.161402.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.161402.log.gz 2023-07-14T11:20:36.013 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154753.log 2023-07-14T11:20:36.015 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.181454.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.181454.log.gz 2023-07-14T11:20:36.015 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181405.log 2023-07-14T11:20:36.016 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.154753.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.154753.log.gz 2023-07-14T11:20:36.016 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149373.log 2023-07-14T11:20:36.018 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.181405.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-07-14T11:20:36.018 INFO:teuthology.orchestra.run.smithi084.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.181405.log.gz 2023-07-14T11:20:36.019 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.149373.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.149373.log.gz 2023-07-14T11:20:36.020 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148585.log 2023-07-14T11:20:36.021 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159321.log 2023-07-14T11:20:36.022 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.148585.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.148585.log.gz 2023-07-14T11:20:36.023 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171315.log 2023-07-14T11:20:36.024 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.159321.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.159321.log.gz 2023-07-14T11:20:36.025 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163635.log 2023-07-14T11:20:36.025 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.171315.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.171315.log.gz 2023-07-14T11:20:36.026 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150284.log 2023-07-14T11:20:36.028 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.163635.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.163635.log.gz 2023-07-14T11:20:36.028 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.150284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159272.log 2023-07-14T11:20:36.029 INFO:teuthology.orchestra.run.smithi084.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.150284.log.gz 2023-07-14T11:20:36.030 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167770.log 2023-07-14T11:20:36.032 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.159272.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.159272.log.gz 2023-07-14T11:20:36.032 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167623.log 2023-07-14T11:20:36.033 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.167770.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.167770.log.gz 2023-07-14T11:20:36.034 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154281.log 2023-07-14T11:20:36.034 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.167623.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.167623.log.gz 2023-07-14T11:20:36.035 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174928.log 2023-07-14T11:20:36.036 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.154281.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.154281.log.gz 2023-07-14T11:20:36.037 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152310.log 2023-07-14T11:20:36.038 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.174928.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.174928.log.gz 2023-07-14T11:20:36.039 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170922.log 2023-07-14T11:20:36.039 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.152310.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.152310.log.gz 2023-07-14T11:20:36.040 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153579.log 2023-07-14T11:20:36.041 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.170922.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.170922.log.gz 2023-07-14T11:20:36.042 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177698.log 2023-07-14T11:20:36.043 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.153579.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.153579.log.gz 2023-07-14T11:20:36.044 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155970.log 2023-07-14T11:20:36.044 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.177698.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.177698.log.gz 2023-07-14T11:20:36.045 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166900.log 2023-07-14T11:20:36.046 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.155970.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.155970.log.gz 2023-07-14T11:20:36.047 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165030.log 2023-07-14T11:20:36.048 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.166900.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.166900.log.gz 2023-07-14T11:20:36.048 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179396.log 2023-07-14T11:20:36.050 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.165030.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.165030.log.gz 2023-07-14T11:20:36.050 INFO:teuthology.orchestra.run.smithi084.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-07-14T11:20:36.051 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.179396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180399.log 2023-07-14T11:20:36.051 INFO:teuthology.orchestra.run.smithi084.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.179396.log.gz 2023-07-14T11:20:36.052 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149990.log 2023-07-14T11:20:36.053 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.180399.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.180399.log.gz 2023-07-14T11:20:36.054 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155292.log 2023-07-14T11:20:36.055 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.149990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180007.log 2023-07-14T11:20:36.055 INFO:teuthology.orchestra.run.smithi084.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.149990.log.gz 2023-07-14T11:20:36.056 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.155292.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.155292.log.gz 2023-07-14T11:20:36.057 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180448.log 2023-07-14T11:20:36.058 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.180007.log: gzip -5 --verbose -- 88.3%/var/log/ceph/ceph-client.admin.176425.log 2023-07-14T11:20:36.058 INFO:teuthology.orchestra.run.smithi084.stderr: -- replaced with /var/log/ceph/ceph-client.admin.180007.log.gz 2023-07-14T11:20:36.059 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.180448.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.180448.log.gz 2023-07-14T11:20:36.059 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155096.log 2023-07-14T11:20:36.061 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.176425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181805.log 2023-07-14T11:20:36.061 INFO:teuthology.orchestra.run.smithi084.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.176425.log.gz 2023-07-14T11:20:36.062 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.155096.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.155096.log.gz 2023-07-14T11:20:36.062 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149843.log 2023-07-14T11:20:36.063 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.181805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161887.log 2023-07-14T11:20:36.064 INFO:teuthology.orchestra.run.smithi084.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.181805.log.gz 2023-07-14T11:20:36.064 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.149843.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.149843.log.gz 2023-07-14T11:20:36.065 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156572.log 2023-07-14T11:20:36.066 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.161887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.166251.log 2023-07-14T11:20:36.067 INFO:teuthology.orchestra.run.smithi084.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.161887.log.gz 2023-07-14T11:20:36.067 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.156572.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.156572.log.gz 2023-07-14T11:20:36.068 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168159.log 2023-07-14T11:20:36.069 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.0.166251.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.166251.log.gz 2023-07-14T11:20:36.070 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159517.log 2023-07-14T11:20:36.070 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.168159.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.168159.log.gz 2023-07-14T11:20:36.072 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.159517.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.159517.log.gz 2023-07-14T11:20:36.107 INFO:teuthology.orchestra.run.smithi084.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-07-14T11:20:36.133 INFO:teuthology.orchestra.run.smithi084.stderr: 93.5% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-07-14T11:20:36.373 INFO:teuthology.orchestra.run.smithi084.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-07-14T11:20:36.461 INFO:teuthology.orchestra.run.smithi084.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-07-14T11:20:36.465 INFO:teuthology.orchestra.run.smithi084.stderr: 2023-07-14T11:20:36.466 INFO:teuthology.orchestra.run.smithi084.stderr:real 0m1.204s 2023-07-14T11:20:36.466 INFO:teuthology.orchestra.run.smithi084.stderr:user 0m2.853s 2023-07-14T11:20:36.467 INFO:teuthology.orchestra.run.smithi084.stderr:sys 0m1.724s 2023-07-14T11:20:36.467 INFO:tasks.ceph:Archiving logs... 2023-07-14T11:20:36.468 DEBUG:teuthology.misc:Transferring archived files from smithi084:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi/7337410/remote/smithi084/log 2023-07-14T11:20:36.469 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar c -f - -C /var/log/ceph -- . 2023-07-14T11:20:37.236 DEBUG:teuthology.misc:Transferring archived files from smithi179:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi/7337410/remote/smithi179/log 2023-07-14T11:20:37.237 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar c -f - -C /var/log/ceph -- . 2023-07-14T11:20:37.588 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-07-14T11:20:37.602 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-07-14T11:20:37.603 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-07-14T11:20:37.608 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-07-14T11:20:37.730 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-07-14T11:20:37.740 INFO:teuthology.task.clock:Checking final clock skew... 2023-07-14T11:20:37.741 DEBUG:teuthology.orchestra.run.smithi084:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-14T11:20:37.745 DEBUG:teuthology.orchestra.run.smithi179:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-14T11:20:37.785 INFO:teuthology.orchestra.run.smithi084.stderr:bash: ntpq: command not found 2023-07-14T11:20:37.789 INFO:teuthology.orchestra.run.smithi179.stderr:bash: ntpq: command not found 2023-07-14T11:20:37.793 INFO:teuthology.orchestra.run.smithi084.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-14T11:20:37.793 INFO:teuthology.orchestra.run.smithi084.stdout:=============================================================================== 2023-07-14T11:20:37.793 INFO:teuthology.orchestra.run.smithi084.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 37 -836us[ -831us] +/- 92ms 2023-07-14T11:20:37.793 INFO:teuthology.orchestra.run.smithi084.stdout:^* hv02.front.sepia.ceph.com 3 6 377 36 -668us[ -663us] +/- 61ms 2023-07-14T11:20:37.794 INFO:teuthology.orchestra.run.smithi084.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 37 +1664us[+1670us] +/- 81ms 2023-07-14T11:20:37.794 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-07-14T11:20:37.797 INFO:teuthology.orchestra.run.smithi179.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-14T11:20:37.797 INFO:teuthology.orchestra.run.smithi179.stdout:=============================================================================== 2023-07-14T11:20:37.797 INFO:teuthology.orchestra.run.smithi179.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 37 -871us[ -873us] +/- 92ms 2023-07-14T11:20:37.797 INFO:teuthology.orchestra.run.smithi179.stdout:^* hv02.front.sepia.ceph.com 3 6 377 36 -675us[ -677us] +/- 61ms 2023-07-14T11:20:37.798 INFO:teuthology.orchestra.run.smithi179.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 37 +1655us[+1653us] +/- 81ms 2023-07-14T11:20:37.798 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-07-14T11:20:37.799 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-07-14T11:20:37.808 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-07-14T11:20:37.809 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-07-14T11:20:37.842 DEBUG:teuthology.orchestra.run.smithi084:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-07-14T11:20:38.023 DEBUG:teuthology.orchestra.run.smithi179:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-07-14T11:20:38.188 DEBUG:teuthology.orchestra.run.smithi084:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-14T11:20:38.265 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-14T11:20:38.266 DEBUG:teuthology.orchestra.run.smithi179:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-14T11:20:38.341 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-14T11:20:38.342 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-07-14T11:20:38.353 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-07-14T11:20:38.371 INFO:teuthology.task.internal:Duration was 1665.995879 seconds 2023-07-14T11:20:38.372 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-07-14T11:20:38.388 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-07-14T11:20:38.389 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-07-14T11:20:38.395 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-07-14T11:20:38.506 INFO:teuthology.orchestra.run.smithi084.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-14T11:20:38.512 INFO:teuthology.orchestra.run.smithi179.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-14T11:20:38.690 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-07-14T11:20:38.690 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi084.front.sepia.ceph.com 2023-07-14T11:20:38.691 DEBUG:teuthology.orchestra.run.smithi084:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-07-14T11:20:38.752 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi179.front.sepia.ceph.com 2023-07-14T11:20:38.752 DEBUG:teuthology.orchestra.run.smithi179:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-07-14T11:20:38.814 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-07-14T11:20:38.814 DEBUG:teuthology.orchestra.run.smithi084:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-07-14T11:20:38.819 DEBUG:teuthology.orchestra.run.smithi179:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-07-14T11:20:38.903 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-07-14T11:20:38.904 DEBUG:teuthology.orchestra.run.smithi084:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-07-14T11:20:38.908 DEBUG:teuthology.orchestra.run.smithi179:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-07-14T11:20:39.030 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-07-14T11:20:39.040 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-07-14T11:20:39.040 DEBUG:teuthology.orchestra.run.smithi084:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-07-14T11:20:39.110 DEBUG:teuthology.orchestra.run.smithi179:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-07-14T11:20:39.180 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-07-14T11:20:39.190 DEBUG:teuthology.orchestra.run.smithi084:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-07-14T11:20:39.195 DEBUG:teuthology.orchestra.run.smithi179:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-07-14T11:20:39.259 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern = core 2023-07-14T11:20:39.264 INFO:teuthology.orchestra.run.smithi179.stdout:kernel.core_pattern = core 2023-07-14T11:20:39.298 DEBUG:teuthology.orchestra.run.smithi084:> test -e /home/ubuntu/cephtest/archive/coredump 2023-07-14T11:20:39.341 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-14T11:20:39.342 DEBUG:teuthology.orchestra.run.smithi179:> test -e /home/ubuntu/cephtest/archive/coredump 2023-07-14T11:20:39.386 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-14T11:20:39.387 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-07-14T11:20:39.400 INFO:teuthology.task.internal:Transferring archived files... 2023-07-14T11:20:39.401 DEBUG:teuthology.misc:Transferring archived files from smithi084:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi/7337410/remote/smithi084 2023-07-14T11:20:39.401 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-07-14T11:20:39.480 DEBUG:teuthology.misc:Transferring archived files from smithi179:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi/7337410/remote/smithi179 2023-07-14T11:20:39.481 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-07-14T11:20:39.558 INFO:teuthology.task.internal:Removing archive directory... 2023-07-14T11:20:39.559 DEBUG:teuthology.orchestra.run.smithi084:> rm -rf -- /home/ubuntu/cephtest/archive 2023-07-14T11:20:39.564 DEBUG:teuthology.orchestra.run.smithi179:> rm -rf -- /home/ubuntu/cephtest/archive 2023-07-14T11:20:39.609 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-07-14T11:20:39.620 INFO:teuthology.task.internal:Not uploading archives. 2023-07-14T11:20:39.620 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-07-14T11:20:39.637 INFO:teuthology.task.internal:Tidying up after the test... 2023-07-14T11:20:39.638 DEBUG:teuthology.orchestra.run.smithi084:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-07-14T11:20:39.649 DEBUG:teuthology.orchestra.run.smithi179:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-07-14T11:20:39.691 INFO:teuthology.orchestra.run.smithi084.stdout: 524306 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jul 14 11:20 /home/ubuntu/cephtest 2023-07-14T11:20:39.695 INFO:teuthology.orchestra.run.smithi179.stdout: 524293 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jul 14 11:20 /home/ubuntu/cephtest 2023-07-14T11:20:39.698 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-07-14T11:20:39.709 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-07-14T11:20:39.744 INFO:teuthology.nuke:Checking targets against current locks 2023-07-14T11:20:39.774 DEBUG:teuthology.nuke:shortname: smithi084 2023-07-14T11:20:39.775 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-14T11:20:39.804 DEBUG:teuthology.nuke:shortname: smithi179 2023-07-14T11:20:39.805 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-14T11:20:39.808 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi084.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi/7337410', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-14 10:27:24.821984', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO7BHmxN2RACnOY5AgcD58lLfgn+7XLSowNTataSO5kVQcm72LqT3Lz2KTGN61lhfr7s0pP0EFXaftriSqHRnZY='} 2023-07-14T11:20:39.837 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi179.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi/7337410', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-14 10:27:24.824311', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCqZv/wOGyMgL6b522Br09/irVRGhPzDuWDhH9AXCR6lN0pZbPVpTluqBIsemY44eocmee46S2PdN8yeRAwvsDISyLUNJSal7utXmyWMOylWhGMizNtgPiC1GHRxWjKJ1WHOaGoc1O+4BDTjSLYB2CnGAkqjDCiUKaUm59EIdgU8u7xk1haD/SDuFK72DaCnVKq5x+RsKzM5qnmWO2GPZZUVd/dWvKUnLg7oCmm6NSPVOjHyroQTfQqzwSUdpbH2Fb32dLhxSDDhZBeTvIBii/KqgbRBxP0S7we+prrZASAH+bC0AlV8hfKj5YYDnMlrvgBToyclQ/M7+Y9faYA6Tb1HOtvEmcSP2DgT/pgk83KG4dVuA4UXXEsW+YHL84nM9oi4+cU/PpRTqHz2RrCx86pHI3VL2fK4I/UEP3y/R8Wk/A+GoUkoawYME9NJdKulGeqV+YDmVSHohFHHZfA+kWZRRso6nndIksIoRXIRxvbFlnl3BdYNtydLiImfT+tQXk='} 2023-07-14T11:20:39.868 INFO:teuthology.orchestra.console:Power off smithi084 2023-07-14T11:20:39.869 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-14T11:20:39.892 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T11:20:39.915 INFO:teuthology.orchestra.console:Power off smithi179 2023-07-14T11:20:39.916 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-14T11:20:39.938 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T11:20:43.926 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T11:20:43.962 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T11:20:48.040 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T11:20:48.077 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T11:20:48.253 INFO:teuthology.orchestra.console:Power off for smithi084 completed 2023-07-14T11:20:52.191 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T11:20:52.403 INFO:teuthology.orchestra.console:Power off for smithi179 completed 2023-07-14T11:20:52.509 INFO:teuthology.run:Summary data: client.0-kernel-sha1: a440c79eee0258ae07e4988d8690fe6187b8b7a3 client.1-kernel-sha1: a440c79eee0258ae07e4988d8690fe6187b8b7a3 description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/misc}} duration: 1665.9958794116974 failure_reason: 'Test failure: test_subvolume_no_upgrade_v1_sanity (tasks.cephfs.test_volumes.TestMisc)' flavor: default owner: scheduled_rishabh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=8ba8de7579104a0eaa3f0b3f2757b762 status: fail success: false 2023-07-14T11:20:52.510 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T11:20:52.601 INFO:teuthology.run:FAIL